2021-11-12T05:26:16.029 INFO:root:teuthology version: 1.1.0-27954452 2021-11-12T05:26:16.031 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests} --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2021-11-05_04:10:01-fs-octopus-distro-default-gibba/6486492 --name teuthology-2021-11-05_04:10:01-fs-octopus-distro-default-gibba --verbose -- /home/teuthworker/archive/teuthology-2021-11-05_04:10:01-fs-octopus-distro-default-gibba/6486492/orig.config.yaml 2021-11-12T05:26:16.081 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-11-12T05:26:16.155 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2021-11-05_04:10:01-fs-octopus-distro-default-gibba/6486492 branch: octopus description: fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests} email: ceph-qa@ceph.io first_in_suite: false job_id: '6486492' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: gibba name: teuthology-2021-11-05_04:10:01-fs-octopus-distro-default-gibba nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: octopus ceph: cephfs_ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 15m rados osd op timeout: 15m mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 15m rados osd op timeout: 15m mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - evicting unresponsive client - POOL_APP_NOT_ENABLED - has not responded to cap revoke by MDS for over - MDS_CLIENT_LATE_RELEASE - responding to mclientcaps log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: a81ee2815de5acae59ead5b8c9137b6766fc8ea8 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: flavor: default sha1: a81ee2815de5acae59ead5b8c9137b6766fc8ea8 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: octopus sha1: a81ee2815de5acae59ead5b8c9137b6766fc8ea8 owner: scheduled_teuthology@teuthology priority: 1000 repo: https://github.com/ceph/ceph.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 - - client.1 - - client.2 sha1: a81ee2815de5acae59ead5b8c9137b6766fc8ea8 sleep_before_teardown: 0 suite: fs suite_branch: octopus suite_path: /home/teuthworker/src/github.com_ceph_ceph_a81ee2815de5acae59ead5b8c9137b6766fc8ea8/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: a81ee2815de5acae59ead5b8c9137b6766fc8ea8 targets: gibba005.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyGqPpC6QqahsfKlJnhiK5JMLITyu6yXMnFZq2y39vkntX8/vvyiJ/uBuO0prWxUJFWgi+kGHasTgGHlV7T9MPLw1rt8vEMVfuRUGXgZ9AZ59eX68W7fhPS1VWbE4IFhs3p1yJML/OKCHY2zzQ+dAO6YRIP9KGOCWTBK96849V//84aYPLrdCe+Ytot7h6OWT2bTt0sHn0kYuMBzm3XVDPwsepjwAHQVvYRKvlCunlXN6vRaKFQb5VNubWE7VHHsMjj4QVPgekZMAWX1LODwQsVGIZwlEi6uy3O1wp+vQ6SXSbmlR30+q2/Qcadwplk2csINUV5tV/84iN7HIOoDwlGWPvz4WGwbIvlHR9wgQPtm9urzD6rYcrfKhwD9Z6LK0sBamq23M3P5aeN1qla4p+sEj/L0hSICk0o6/wzWlfs0zsJjTA0eAsAiInBsik6FdLLYTpHkXw63w42lRY0tBAnPmVYL0r/xEMkl9NNmpKMic/yE9uTbhFfB0JFjAcsqU= gibba015.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDczkS8lEBqkJ8R+x6iCiFCazxt6FfxJQmaRwIo+iSbHIk5gJTD3PejSk9RspSrSXQNOD1XHlTqnNpyBdNhaZvRvUohGAyGkIuIyudpTC/KTb4Sc/s4vbWdp1Cg2XRNPuT9PCHZwOsGxTCA6lHcEcpojgvqdB9eB89ULf8VTD6hFlTXHoQyYE8fXM9FwEyY5Co9c7t8mwOGNc5ZqKA0nssySVKoyByy3Xrva5sdhswNkZfJTofG1Iyy/0IabIPN3Ha1OIn0GC8/h5YoxyY5k/tqjSNPQ3Qqxup9AxNO29UwpgCsfJH7peIsF/2bg/jr2ZhYTspb7GWTKn+Wy8BwLwfS0Eva+LImjjEkRj6YurCsZQ/hk9I/4lqDu64fJaAKouA094n14bZq31y/1z+50mmTjXj9Q6cCdrSOzj5qfb38QF8vkbsYYvUuLMedmHysHpC9F0XcEFurFofkvEMByGrs4PsKbIGjh5/ZLvDf8XGxf2z8LZSzGjj6y7q59dc6biE= gibba016.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpn2xhnKN0T4iYT1XNfF7ogRlks9QDkX4UDy6hKr7F9TwJrnwpRtkZqkjT9Hw0wS2GIhBXIXHIilGJCYcnY0C7I4A3yzcqKmpIe9NGLhlanjLw43+1h/Bwxo9tQTwbHroCzs+wedwVZGZzDxTUAG1/wTTjgys2csKQqUX2vliDAvHlmTksaEialZoZjwgNh+VQ0bNBK3JWR+N/1BKq0sxvOAbLY5EiplsNP+cld7VILfbil1T9Q5lNmaRX9PCu7EzYrh4Smt2Mx/6TyHQoL9ZCpPlIdKyVXF00+wy/NcPa9glekJujaKxVlmWuIEoUs4bjHAnVNCO43WpOkDYXObLC0qKxfmmEZwpqMUOWyJDe/x5VR0xhpXfEXYdl62mQRcv46QwYyO1mFNWvshPj1M/ZRxxMqPUYTXm1ZhhFoTO+CUJ+zF4PAPNSO7ov3dAyrhaE0iG1qgzHzvhnMQ0y478i+oT4MHgeluDrcQhbTbVBT5tQc+NLKyoOuL4p5YwR8PM= gibba038.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzGIX912XhZDjC2aybF4gTls0Ct7Q0Smf3ldSaUX4lkqaj+YGLEzntrlxbncnU8CVeAn4UqTrG6vn/ZavxT23tVN/Zg7fgu1vDOEMdhwjq9lGJTS2AQgsttT0z068l2oOxDR2vL5JTItjgYA/3cF4EfRNHpHp1kaxPZtM/yrAxnOW54N6iUto8bqOWxJ6HZxkQhgWyyQqxQ/40j6tOSkoT0GzrxLnY3ujpVlkpFJ3TwQnV8DsuuI/ycIjtDy45Pq+iakIYOInLWGJhsHDhKiKIGdj0ZXdG7I7tD9PAMzzShupRpjZuCnK/paFC53mZlJamPz+VR3xS8586FM3V8zRNJ2OvN+SyJqsGbr2SuzSRychfsNZots27c3C9eAtA1o6qANuDWtrZNCf97n5sWef4besOXSd+r7ztaycW5HIA7QgfyW/2ixPGjcbQMJ8r0vWtH1GqekeH6VDenvH4hwtJYI73wbOnJmnQpS2RasgCYDkQ3TGL/n0wmu4WJDBbMjs= gibba044.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7y85QoUA+p4f8OEGWyJbZo5cbKXlBTgXMdKso0PEAzOJxklAh/ux0oMFywnxN5i+2gfybHd6BK9+VortHfsWfU8gj/O85y9eY9iLtWOcf9x/Uuv+Zv2t9TA8SbbHq8uDBYAwGFJdSklYbKdlkEzDVUee4m0Dk9XQTDk6icpPwS/QBt/Hc5zmBYTRfvFXTDXQlOJCEqRzWod13tdw42v5E+aEAcHTbU0I4MjeTtnWFwEebRAShP5ifjFIuocFOk8ttp0QaPl8Wo6oNmVFmr9C9ptoOp0/jnuNZ4rBOaOhbihGpYlxB3rGvCLaux3/KafEGEwgOcVC1EVGVvimXqT/LCIVbgW/gtd/zPUbkZUv+j0G3ncwofpy6MEOoGRPXcLKdsYDav9gwU3U0dLUMioGRiuN6fN70lfPSStAUJoujR05sH7DNLfX6S+AJAhspWVeEbMtBLQqmEAR1Rw+pT9WG/uktQuBGFBdsDFxrbItqAzquuVKfEJ9tNWXm6SVIRi0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_misc teuthology_branch: master teuthology_sha1: 27954452159076fda5642b6c0eb0c4998b99d2e4 timestamp: 2021-11-05_04:10:01 tube: gibba user: teuthology verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.gibba.19943 2021-11-12T05:26:16.156 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_a81ee2815de5acae59ead5b8c9137b6766fc8ea8/qa; will attempt to use it 2021-11-12T05:26:16.156 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_a81ee2815de5acae59ead5b8c9137b6766fc8ea8/qa/tasks 2021-11-12T05:26:16.157 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-11-12T05:26:16.159 INFO:teuthology.task.internal:Checking packages... 2021-11-12T05:26:16.182 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'a81ee2815de5acae59ead5b8c9137b6766fc8ea8' 2021-11-12T05:26:16.182 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-11-12T05:26:16.183 INFO:teuthology.packaging:ref: None 2021-11-12T05:26:16.183 INFO:teuthology.packaging:tag: None 2021-11-12T05:26:16.184 INFO:teuthology.packaging:branch: octopus 2021-11-12T05:26:16.184 INFO:teuthology.packaging:sha1: a81ee2815de5acae59ead5b8c9137b6766fc8ea8 2021-11-12T05:26:16.184 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=octopus 2021-11-12T05:26:16.489 INFO:teuthology.task.internal:Found packages for ceph version 15.2.15-32-gb0aaed0f-1focal 2021-11-12T05:26:16.489 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-11-12T05:26:16.500 INFO:teuthology.task.internal:no buildpackages task found 2021-11-12T05:26:16.501 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-11-12T05:26:16.545 INFO:teuthology.task.internal:Saving configuration 2021-11-12T05:26:16.563 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-11-12T05:26:16.576 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-12T05:26:16.600 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'gibba005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2021-11-05_04:10:01-fs-octopus-distro-default-gibba/6486492', 'up': True, 'machine_type': 'gibba', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-11-12 05:20:20.236806', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPkWuxc41jNsJ2jEsjCoeqFJlBA11sZtxmcrl6KZuqZI'} 2021-11-12T05:26:16.622 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'gibba015.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2021-11-05_04:10:01-fs-octopus-distro-default-gibba/6486492', 'up': True, 'machine_type': 'gibba', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-11-12 05:20:20.241425', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEkfQJvRYm46e0k1YGVV1PV9OsQDgSh0uWqRh/+mOQNj'} 2021-11-12T05:26:16.644 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'gibba016.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2021-11-05_04:10:01-fs-octopus-distro-default-gibba/6486492', 'up': True, 'machine_type': 'gibba', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-11-12 05:20:20.240390', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDJ3Kbsv/bp5fNogH6yqGWU5mXo/hIQuUR4ZtX8MDsmW'} 2021-11-12T05:26:16.666 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'gibba038.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2021-11-05_04:10:01-fs-octopus-distro-default-gibba/6486492', 'up': True, 'machine_type': 'gibba', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-11-12 05:20:20.239320', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKU7Q64nUuUJjKekjMBiqu+uFihcdLVkuI+0GbjfP5//'} 2021-11-12T05:26:16.687 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'gibba044.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2021-11-05_04:10:01-fs-octopus-distro-default-gibba/6486492', 'up': True, 'machine_type': 'gibba', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-11-12 05:20:20.238186', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFAfgx6ATBTeEpcltOBvTgPsL9+xRBtQnRuI/K3+6Hul'} 2021-11-12T05:26:16.688 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-11-12T05:26:16.699 INFO:teuthology.task.internal:roles: ubuntu@gibba005.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2021-11-12T05:26:16.699 INFO:teuthology.task.internal:roles: ubuntu@gibba015.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2021-11-12T05:26:16.699 INFO:teuthology.task.internal:roles: ubuntu@gibba016.front.sepia.ceph.com - ['client.0'] 2021-11-12T05:26:16.700 INFO:teuthology.task.internal:roles: ubuntu@gibba038.front.sepia.ceph.com - ['client.1'] 2021-11-12T05:26:16.700 INFO:teuthology.task.internal:roles: ubuntu@gibba044.front.sepia.ceph.com - ['client.2'] 2021-11-12T05:26:16.700 INFO:teuthology.run_tasks:Running task console_log... 2021-11-12T05:26:16.883 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbf2a6aeae8>, signals=[15]) 2021-11-12T05:26:16.884 INFO:teuthology.run_tasks:Running task internal.connect... 2021-11-12T05:26:16.894 INFO:teuthology.task.internal:Opening connections... 2021-11-12T05:26:16.895 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba005.front.sepia.ceph.com 2021-11-12T05:26:16.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-12T05:26:16.937 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba015.front.sepia.ceph.com 2021-11-12T05:26:16.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba015.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-12T05:26:16.971 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba016.front.sepia.ceph.com 2021-11-12T05:26:16.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-12T05:26:17.007 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba038.front.sepia.ceph.com 2021-11-12T05:26:17.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-12T05:26:17.044 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba044.front.sepia.ceph.com 2021-11-12T05:26:17.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-12T05:26:17.082 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-11-12T05:26:17.094 DEBUG:teuthology.orchestra.run.gibba005:> uname -m 2021-11-12T05:26:17.103 INFO:teuthology.orchestra.run.gibba005.stdout:x86_64 2021-11-12T05:26:17.104 DEBUG:teuthology.orchestra.run.gibba005:> cat /etc/os-release 2021-11-12T05:26:17.107 INFO:teuthology.orchestra.run.gibba005.stdout:NAME="Ubuntu" 2021-11-12T05:26:17.107 INFO:teuthology.orchestra.run.gibba005.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-11-12T05:26:17.108 INFO:teuthology.orchestra.run.gibba005.stdout:ID=ubuntu 2021-11-12T05:26:17.108 INFO:teuthology.orchestra.run.gibba005.stdout:ID_LIKE=debian 2021-11-12T05:26:17.108 INFO:teuthology.orchestra.run.gibba005.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-11-12T05:26:17.108 INFO:teuthology.orchestra.run.gibba005.stdout:VERSION_ID="20.04" 2021-11-12T05:26:17.109 INFO:teuthology.orchestra.run.gibba005.stdout:HOME_URL="https://www.ubuntu.com/" 2021-11-12T05:26:17.109 INFO:teuthology.orchestra.run.gibba005.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-11-12T05:26:17.109 INFO:teuthology.orchestra.run.gibba005.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-11-12T05:26:17.109 INFO:teuthology.orchestra.run.gibba005.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-11-12T05:26:17.110 INFO:teuthology.orchestra.run.gibba005.stdout:VERSION_CODENAME=focal 2021-11-12T05:26:17.110 INFO:teuthology.orchestra.run.gibba005.stdout:UBUNTU_CODENAME=focal 2021-11-12T05:26:17.111 INFO:teuthology.lock.ops:Updating gibba005.front.sepia.ceph.com on lock server 2021-11-12T05:26:17.132 DEBUG:teuthology.orchestra.run.gibba015:> uname -m 2021-11-12T05:26:17.141 INFO:teuthology.orchestra.run.gibba015.stdout:x86_64 2021-11-12T05:26:17.141 DEBUG:teuthology.orchestra.run.gibba015:> cat /etc/os-release 2021-11-12T05:26:17.189 INFO:teuthology.orchestra.run.gibba015.stdout:NAME="Ubuntu" 2021-11-12T05:26:17.190 INFO:teuthology.orchestra.run.gibba015.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-11-12T05:26:17.190 INFO:teuthology.orchestra.run.gibba015.stdout:ID=ubuntu 2021-11-12T05:26:17.190 INFO:teuthology.orchestra.run.gibba015.stdout:ID_LIKE=debian 2021-11-12T05:26:17.191 INFO:teuthology.orchestra.run.gibba015.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-11-12T05:26:17.191 INFO:teuthology.orchestra.run.gibba015.stdout:VERSION_ID="20.04" 2021-11-12T05:26:17.191 INFO:teuthology.orchestra.run.gibba015.stdout:HOME_URL="https://www.ubuntu.com/" 2021-11-12T05:26:17.191 INFO:teuthology.orchestra.run.gibba015.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-11-12T05:26:17.191 INFO:teuthology.orchestra.run.gibba015.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-11-12T05:26:17.192 INFO:teuthology.orchestra.run.gibba015.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-11-12T05:26:17.192 INFO:teuthology.orchestra.run.gibba015.stdout:VERSION_CODENAME=focal 2021-11-12T05:26:17.192 INFO:teuthology.orchestra.run.gibba015.stdout:UBUNTU_CODENAME=focal 2021-11-12T05:26:17.192 INFO:teuthology.lock.ops:Updating gibba015.front.sepia.ceph.com on lock server 2021-11-12T05:26:17.210 DEBUG:teuthology.orchestra.run.gibba016:> uname -m 2021-11-12T05:26:17.219 INFO:teuthology.orchestra.run.gibba016.stdout:x86_64 2021-11-12T05:26:17.220 DEBUG:teuthology.orchestra.run.gibba016:> cat /etc/os-release 2021-11-12T05:26:17.265 INFO:teuthology.orchestra.run.gibba016.stdout:NAME="Ubuntu" 2021-11-12T05:26:17.266 INFO:teuthology.orchestra.run.gibba016.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-11-12T05:26:17.266 INFO:teuthology.orchestra.run.gibba016.stdout:ID=ubuntu 2021-11-12T05:26:17.266 INFO:teuthology.orchestra.run.gibba016.stdout:ID_LIKE=debian 2021-11-12T05:26:17.266 INFO:teuthology.orchestra.run.gibba016.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-11-12T05:26:17.267 INFO:teuthology.orchestra.run.gibba016.stdout:VERSION_ID="20.04" 2021-11-12T05:26:17.267 INFO:teuthology.orchestra.run.gibba016.stdout:HOME_URL="https://www.ubuntu.com/" 2021-11-12T05:26:17.267 INFO:teuthology.orchestra.run.gibba016.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-11-12T05:26:17.267 INFO:teuthology.orchestra.run.gibba016.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-11-12T05:26:17.267 INFO:teuthology.orchestra.run.gibba016.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-11-12T05:26:17.268 INFO:teuthology.orchestra.run.gibba016.stdout:VERSION_CODENAME=focal 2021-11-12T05:26:17.268 INFO:teuthology.orchestra.run.gibba016.stdout:UBUNTU_CODENAME=focal 2021-11-12T05:26:17.268 INFO:teuthology.lock.ops:Updating gibba016.front.sepia.ceph.com on lock server 2021-11-12T05:26:17.286 DEBUG:teuthology.orchestra.run.gibba038:> uname -m 2021-11-12T05:26:17.295 INFO:teuthology.orchestra.run.gibba038.stdout:x86_64 2021-11-12T05:26:17.295 DEBUG:teuthology.orchestra.run.gibba038:> cat /etc/os-release 2021-11-12T05:26:17.343 INFO:teuthology.orchestra.run.gibba038.stdout:NAME="Ubuntu" 2021-11-12T05:26:17.344 INFO:teuthology.orchestra.run.gibba038.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-11-12T05:26:17.344 INFO:teuthology.orchestra.run.gibba038.stdout:ID=ubuntu 2021-11-12T05:26:17.344 INFO:teuthology.orchestra.run.gibba038.stdout:ID_LIKE=debian 2021-11-12T05:26:17.344 INFO:teuthology.orchestra.run.gibba038.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-11-12T05:26:17.344 INFO:teuthology.orchestra.run.gibba038.stdout:VERSION_ID="20.04" 2021-11-12T05:26:17.345 INFO:teuthology.orchestra.run.gibba038.stdout:HOME_URL="https://www.ubuntu.com/" 2021-11-12T05:26:17.345 INFO:teuthology.orchestra.run.gibba038.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-11-12T05:26:17.345 INFO:teuthology.orchestra.run.gibba038.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-11-12T05:26:17.345 INFO:teuthology.orchestra.run.gibba038.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-11-12T05:26:17.346 INFO:teuthology.orchestra.run.gibba038.stdout:VERSION_CODENAME=focal 2021-11-12T05:26:17.346 INFO:teuthology.orchestra.run.gibba038.stdout:UBUNTU_CODENAME=focal 2021-11-12T05:26:17.346 INFO:teuthology.lock.ops:Updating gibba038.front.sepia.ceph.com on lock server 2021-11-12T05:26:17.364 DEBUG:teuthology.orchestra.run.gibba044:> uname -m 2021-11-12T05:26:17.374 INFO:teuthology.orchestra.run.gibba044.stdout:x86_64 2021-11-12T05:26:17.375 DEBUG:teuthology.orchestra.run.gibba044:> cat /etc/os-release 2021-11-12T05:26:17.420 INFO:teuthology.orchestra.run.gibba044.stdout:NAME="Ubuntu" 2021-11-12T05:26:17.421 INFO:teuthology.orchestra.run.gibba044.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-11-12T05:26:17.421 INFO:teuthology.orchestra.run.gibba044.stdout:ID=ubuntu 2021-11-12T05:26:17.422 INFO:teuthology.orchestra.run.gibba044.stdout:ID_LIKE=debian 2021-11-12T05:26:17.422 INFO:teuthology.orchestra.run.gibba044.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-11-12T05:26:17.422 INFO:teuthology.orchestra.run.gibba044.stdout:VERSION_ID="20.04" 2021-11-12T05:26:17.423 INFO:teuthology.orchestra.run.gibba044.stdout:HOME_URL="https://www.ubuntu.com/" 2021-11-12T05:26:17.423 INFO:teuthology.orchestra.run.gibba044.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-11-12T05:26:17.423 INFO:teuthology.orchestra.run.gibba044.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-11-12T05:26:17.424 INFO:teuthology.orchestra.run.gibba044.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-11-12T05:26:17.424 INFO:teuthology.orchestra.run.gibba044.stdout:VERSION_CODENAME=focal 2021-11-12T05:26:17.424 INFO:teuthology.orchestra.run.gibba044.stdout:UBUNTU_CODENAME=focal 2021-11-12T05:26:17.425 INFO:teuthology.lock.ops:Updating gibba044.front.sepia.ceph.com on lock server 2021-11-12T05:26:17.442 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-11-12T05:26:17.463 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-11-12T05:26:17.503 INFO:teuthology.task.internal:Checking for old test directory... 2021-11-12T05:26:17.503 DEBUG:teuthology.orchestra.run.gibba005:> test '!' -e /home/ubuntu/cephtest 2021-11-12T05:26:17.507 DEBUG:teuthology.orchestra.run.gibba015:> test '!' -e /home/ubuntu/cephtest 2021-11-12T05:26:17.510 DEBUG:teuthology.orchestra.run.gibba016:> test '!' -e /home/ubuntu/cephtest 2021-11-12T05:26:17.514 DEBUG:teuthology.orchestra.run.gibba038:> test '!' -e /home/ubuntu/cephtest 2021-11-12T05:26:17.517 DEBUG:teuthology.orchestra.run.gibba044:> test '!' -e /home/ubuntu/cephtest 2021-11-12T05:26:17.525 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-11-12T05:26:17.538 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-11-12T05:26:17.539 DEBUG:teuthology.orchestra.run.gibba005:> test -z $(ls -A /var/lib/ceph) 2021-11-12T05:26:17.542 DEBUG:teuthology.orchestra.run.gibba015:> test -z $(ls -A /var/lib/ceph) 2021-11-12T05:26:17.545 DEBUG:teuthology.orchestra.run.gibba016:> test -z $(ls -A /var/lib/ceph) 2021-11-12T05:26:17.548 DEBUG:teuthology.orchestra.run.gibba038:> test -z $(ls -A /var/lib/ceph) 2021-11-12T05:26:17.551 DEBUG:teuthology.orchestra.run.gibba044:> test -z $(ls -A /var/lib/ceph) 2021-11-12T05:26:17.589 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-11-12T05:26:17.706 INFO:teuthology.run_tasks:Running task kernel... 2021-11-12T05:26:17.725 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2021-11-12T05:26:17.726 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'client.2': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-11-12T05:26:17.726 DEBUG:teuthology.orchestra.run.gibba005:> uname -r 2021-11-12T05:26:17.735 INFO:teuthology.orchestra.run.gibba005.stdout:5.4.0-88-generic 2021-11-12T05:26:17.735 INFO:teuthology.task.kernel:Running kernel on gibba005: 5.4.0-88-generic 2021-11-12T05:26:17.736 DEBUG:teuthology.orchestra.run.gibba005:> sudo apt-get clean 2021-11-12T05:26:17.824 DEBUG:teuthology.orchestra.run.gibba005:> sudo apt-get update 2021-11-12T05:26:18.090 INFO:teuthology.orchestra.run.gibba005.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-12T05:26:18.095 INFO:teuthology.orchestra.run.gibba005.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-11-12T05:26:18.155 INFO:teuthology.orchestra.run.gibba005.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-11-12T05:26:18.493 INFO:teuthology.orchestra.run.gibba005.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-11-12T05:26:18.511 INFO:teuthology.orchestra.run.gibba005.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [987 kB] 2021-11-12T05:26:18.711 INFO:teuthology.orchestra.run.gibba005.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [562 kB] 2021-11-12T05:26:18.871 INFO:teuthology.orchestra.run.gibba005.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [306 kB] 2021-11-12T05:26:18.887 INFO:teuthology.orchestra.run.gibba005.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [183 kB] 2021-11-12T05:26:18.897 INFO:teuthology.orchestra.run.gibba005.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [8,880 B] 2021-11-12T05:26:18.897 INFO:teuthology.orchestra.run.gibba005.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [526 kB] 2021-11-12T05:26:18.927 INFO:teuthology.orchestra.run.gibba005.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [20.4 kB] 2021-11-12T05:26:18.927 INFO:teuthology.orchestra.run.gibba005.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [75.4 kB] 2021-11-12T05:26:18.943 INFO:teuthology.orchestra.run.gibba005.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,344 kB] 2021-11-12T05:26:18.954 INFO:teuthology.orchestra.run.gibba005.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [528 B] 2021-11-12T05:26:18.954 INFO:teuthology.orchestra.run.gibba005.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [515 kB] 2021-11-12T05:26:18.982 INFO:teuthology.orchestra.run.gibba005.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [651 kB] 2021-11-12T05:26:19.014 INFO:teuthology.orchestra.run.gibba005.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [107 kB] 2021-11-12T05:26:19.018 INFO:teuthology.orchestra.run.gibba005.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [12.9 kB] 2021-11-12T05:26:19.054 INFO:teuthology.orchestra.run.gibba005.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [21.9 kB] 2021-11-12T05:26:19.055 INFO:teuthology.orchestra.run.gibba005.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,212 B] 2021-11-12T05:26:19.055 INFO:teuthology.orchestra.run.gibba005.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2021-11-12T05:26:19.086 INFO:teuthology.orchestra.run.gibba005.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [276 kB] 2021-11-12T05:26:19.106 INFO:teuthology.orchestra.run.gibba005.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [14.5 kB] 2021-11-12T05:26:19.106 INFO:teuthology.orchestra.run.gibba005.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [569 kB] 2021-11-12T05:26:19.130 INFO:teuthology.orchestra.run.gibba005.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [21.7 kB] 2021-11-12T05:26:19.131 INFO:teuthology.orchestra.run.gibba005.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [81.6 kB] 2021-11-12T05:26:19.135 INFO:teuthology.orchestra.run.gibba005.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [528 B] 2021-11-12T05:26:19.135 INFO:teuthology.orchestra.run.gibba005.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [875 kB] 2021-11-12T05:26:19.174 INFO:teuthology.orchestra.run.gibba005.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [647 kB] 2021-11-12T05:26:19.194 INFO:teuthology.orchestra.run.gibba005.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [189 kB] 2021-11-12T05:26:19.199 INFO:teuthology.orchestra.run.gibba005.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [19.5 kB] 2021-11-12T05:26:19.218 INFO:teuthology.orchestra.run.gibba005.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,204 B] 2021-11-12T05:26:19.218 INFO:teuthology.orchestra.run.gibba005.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [24.5 kB] 2021-11-12T05:26:19.218 INFO:teuthology.orchestra.run.gibba005.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,856 B] 2021-11-12T05:26:19.218 INFO:teuthology.orchestra.run.gibba005.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2021-11-12T05:26:19.219 INFO:teuthology.orchestra.run.gibba005.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [5,528 B] 2021-11-12T05:26:19.259 INFO:teuthology.orchestra.run.gibba005.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [6,584 B] 2021-11-12T05:26:19.334 INFO:teuthology.orchestra.run.gibba005.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/universe Translation-en [3,292 B] 2021-11-12T05:26:19.335 INFO:teuthology.orchestra.run.gibba005.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [580 B] 2021-11-12T05:26:21.221 INFO:teuthology.orchestra.run.gibba005.stdout:Fetched 8,407 kB in 2s (5,301 kB/s) 2021-11-12T05:26:22.160 INFO:teuthology.orchestra.run.gibba005.stdout:Reading package lists... 2021-11-12T05:26:22.171 DEBUG:teuthology.orchestra.run.gibba005:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-11-12T05:26:22.207 INFO:teuthology.orchestra.run.gibba005.stdout:Reading package lists... 2021-11-12T05:26:22.311 INFO:teuthology.orchestra.run.gibba005.stdout:Building dependency tree... 2021-11-12T05:26:22.312 INFO:teuthology.orchestra.run.gibba005.stdout:Reading state information... 2021-11-12T05:26:22.392 INFO:teuthology.orchestra.run.gibba005.stdout:The following package was automatically installed and is no longer required: 2021-11-12T05:26:22.393 INFO:teuthology.orchestra.run.gibba005.stdout: libllvm11 2021-11-12T05:26:22.393 INFO:teuthology.orchestra.run.gibba005.stdout:Use 'sudo apt autoremove' to remove it. 2021-11-12T05:26:22.393 INFO:teuthology.orchestra.run.gibba005.stdout:The following additional packages will be installed: 2021-11-12T05:26:22.393 INFO:teuthology.orchestra.run.gibba005.stdout: linux-generic linux-headers-5.4.0-90 linux-headers-5.4.0-90-generic 2021-11-12T05:26:22.394 INFO:teuthology.orchestra.run.gibba005.stdout: linux-headers-generic linux-image-5.4.0-90-generic 2021-11-12T05:26:22.394 INFO:teuthology.orchestra.run.gibba005.stdout: linux-modules-5.4.0-90-generic linux-modules-extra-5.4.0-90-generic 2021-11-12T05:26:22.394 INFO:teuthology.orchestra.run.gibba005.stdout:Suggested packages: 2021-11-12T05:26:22.395 INFO:teuthology.orchestra.run.gibba005.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-11-12T05:26:22.395 INFO:teuthology.orchestra.run.gibba005.stdout:Recommended packages: 2021-11-12T05:26:22.395 INFO:teuthology.orchestra.run.gibba005.stdout: thermald 2021-11-12T05:26:22.448 INFO:teuthology.orchestra.run.gibba005.stdout:The following NEW packages will be installed: 2021-11-12T05:26:22.448 INFO:teuthology.orchestra.run.gibba005.stdout: linux-headers-5.4.0-90 linux-headers-5.4.0-90-generic 2021-11-12T05:26:22.448 INFO:teuthology.orchestra.run.gibba005.stdout: linux-image-5.4.0-90-generic linux-modules-5.4.0-90-generic 2021-11-12T05:26:22.449 INFO:teuthology.orchestra.run.gibba005.stdout: linux-modules-extra-5.4.0-90-generic 2021-11-12T05:26:22.449 INFO:teuthology.orchestra.run.gibba005.stdout:The following packages will be upgraded: 2021-11-12T05:26:22.449 INFO:teuthology.orchestra.run.gibba005.stdout: linux-generic linux-headers-generic linux-image-generic 2021-11-12T05:26:22.626 INFO:teuthology.orchestra.run.gibba005.stdout:3 upgraded, 5 newly installed, 0 to remove and 55 not upgraded. 2021-11-12T05:26:22.627 INFO:teuthology.orchestra.run.gibba005.stdout:Need to get 75.6 MB of archives. 2021-11-12T05:26:22.627 INFO:teuthology.orchestra.run.gibba005.stdout:After this operation, 378 MB of additional disk space will be used. 2021-11-12T05:26:22.627 INFO:teuthology.orchestra.run.gibba005.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-90-generic amd64 5.4.0-90.101 [14.8 MB] 2021-11-12T05:26:23.716 INFO:teuthology.orchestra.run.gibba005.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-90-generic amd64 5.4.0-90.101 [8,994 kB] 2021-11-12T05:26:23.962 INFO:teuthology.orchestra.run.gibba005.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-90-generic amd64 5.4.0-90.101 [39.4 MB] 2021-11-12T05:26:25.299 INFO:teuthology.orchestra.run.gibba005.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.90.94 [1,900 B] 2021-11-12T05:26:25.300 INFO:teuthology.orchestra.run.gibba005.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.90.94 [2,580 B] 2021-11-12T05:26:25.301 INFO:teuthology.orchestra.run.gibba005.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-90 all 5.4.0-90.101 [11.0 MB] 2021-11-12T05:26:26.126 INFO:teuthology.orchestra.run.gibba005.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-90-generic amd64 5.4.0-90.101 [1,403 kB] 2021-11-12T05:26:26.237 INFO:teuthology.orchestra.run.gibba005.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.90.94 [2,448 B] 2021-11-12T05:26:26.480 INFO:teuthology.orchestra.run.gibba005.stdout:Fetched 75.6 MB in 4s (20.0 MB/s) 2021-11-12T05:26:26.611 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package linux-modules-5.4.0-90-generic. 2021-11-12T05:26:28.529 INFO:teuthology.orchestra.run.gibba005.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138265 files and directories currently installed.) 2021-11-12T05:26:28.538 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../0-linux-modules-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-12T05:26:28.593 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking linux-modules-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:26:29.967 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package linux-image-5.4.0-90-generic. 2021-11-12T05:26:29.976 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../1-linux-image-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-12T05:26:30.058 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:26:30.904 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-90-generic. 2021-11-12T05:26:30.929 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-12T05:26:30.986 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking linux-modules-extra-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:26:34.179 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../3-linux-generic_5.4.0.90.94_amd64.deb ... 2021-11-12T05:26:34.306 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking linux-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-12T05:26:34.641 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.90.94_amd64.deb ... 2021-11-12T05:26:34.767 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking linux-image-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-12T05:26:35.129 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package linux-headers-5.4.0-90. 2021-11-12T05:26:35.156 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../5-linux-headers-5.4.0-90_5.4.0-90.101_all.deb ... 2021-11-12T05:26:35.196 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking linux-headers-5.4.0-90 (5.4.0-90.101) ... 2021-11-12T05:26:38.963 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package linux-headers-5.4.0-90-generic. 2021-11-12T05:26:39.004 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../6-linux-headers-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-12T05:26:39.046 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking linux-headers-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:26:40.805 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.90.94_amd64.deb ... 2021-11-12T05:26:40.927 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking linux-headers-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-12T05:26:41.283 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up linux-headers-5.4.0-90 (5.4.0-90.101) ... 2021-11-12T05:26:41.406 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up linux-modules-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:26:42.191 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up linux-headers-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:26:42.309 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up linux-headers-generic (5.4.0.90.94) ... 2021-11-12T05:26:42.409 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:26:43.092 INFO:teuthology.orchestra.run.gibba005.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.4.0-88-generic 2021-11-12T05:26:43.093 INFO:teuthology.orchestra.run.gibba005.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.4.0-88-generic 2021-11-12T05:26:43.093 INFO:teuthology.orchestra.run.gibba005.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-90-generic 2021-11-12T05:26:43.093 INFO:teuthology.orchestra.run.gibba005.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-90-generic 2021-11-12T05:26:43.229 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up linux-modules-extra-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:26:44.063 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up linux-image-generic (5.4.0.90.94) ... 2021-11-12T05:26:44.190 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up linux-generic (5.4.0.90.94) ... 2021-11-12T05:26:44.332 INFO:teuthology.orchestra.run.gibba005.stdout:Processing triggers for linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:26:44.464 INFO:teuthology.orchestra.run.gibba005.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-11-12T05:26:44.465 INFO:teuthology.orchestra.run.gibba005.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-90-generic 2021-11-12T05:27:05.415 INFO:teuthology.orchestra.run.gibba005.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-11-12T05:27:05.415 INFO:teuthology.orchestra.run.gibba005.stdout:Sourcing file `/etc/default/grub' 2021-11-12T05:27:05.423 INFO:teuthology.orchestra.run.gibba005.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-11-12T05:27:05.478 INFO:teuthology.orchestra.run.gibba005.stdout:Generating grub configuration file ... 2021-11-12T05:27:05.807 INFO:teuthology.orchestra.run.gibba005.stdout:Found linux image: /boot/vmlinuz-5.4.0-90-generic 2021-11-12T05:27:05.844 INFO:teuthology.orchestra.run.gibba005.stdout:Found initrd image: /boot/initrd.img-5.4.0-90-generic 2021-11-12T05:27:06.311 INFO:teuthology.orchestra.run.gibba005.stdout:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-11-12T05:27:06.325 INFO:teuthology.orchestra.run.gibba005.stdout:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-11-12T05:27:06.457 INFO:teuthology.orchestra.run.gibba005.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-11-12T05:27:06.471 INFO:teuthology.orchestra.run.gibba005.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-11-12T05:27:09.326 INFO:teuthology.orchestra.run.gibba005.stdout:done 2021-11-12T05:27:09.573 DEBUG:teuthology.orchestra.run.gibba005:> dpkg -s linux-image-generic 2021-11-12T05:27:09.588 INFO:teuthology.orchestra.run.gibba005.stdout:Package: linux-image-generic 2021-11-12T05:27:09.588 INFO:teuthology.orchestra.run.gibba005.stdout:Status: install ok installed 2021-11-12T05:27:09.589 INFO:teuthology.orchestra.run.gibba005.stdout:Priority: optional 2021-11-12T05:27:09.589 INFO:teuthology.orchestra.run.gibba005.stdout:Section: kernel 2021-11-12T05:27:09.589 INFO:teuthology.orchestra.run.gibba005.stdout:Installed-Size: 18 2021-11-12T05:27:09.589 INFO:teuthology.orchestra.run.gibba005.stdout:Maintainer: Ubuntu Kernel Team 2021-11-12T05:27:09.590 INFO:teuthology.orchestra.run.gibba005.stdout:Architecture: amd64 2021-11-12T05:27:09.590 INFO:teuthology.orchestra.run.gibba005.stdout:Source: linux-meta 2021-11-12T05:27:09.590 INFO:teuthology.orchestra.run.gibba005.stdout:Version: 5.4.0.90.94 2021-11-12T05:27:09.590 INFO:teuthology.orchestra.run.gibba005.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-11-12T05:27:09.591 INFO:teuthology.orchestra.run.gibba005.stdout:Depends: linux-image-5.4.0-90-generic, linux-modules-extra-5.4.0-90-generic, linux-firmware, intel-microcode, amd64-microcode 2021-11-12T05:27:09.591 INFO:teuthology.orchestra.run.gibba005.stdout:Recommends: thermald 2021-11-12T05:27:09.591 INFO:teuthology.orchestra.run.gibba005.stdout:Description: Generic Linux kernel image 2021-11-12T05:27:09.591 INFO:teuthology.orchestra.run.gibba005.stdout: This package will always depend on the latest generic kernel image 2021-11-12T05:27:09.592 INFO:teuthology.orchestra.run.gibba005.stdout: available. 2021-11-12T05:27:09.592 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-88-generic Expected: 5.4.0-90-generic 2021-11-12T05:27:09.592 DEBUG:teuthology.orchestra.run.gibba015:> uname -r 2021-11-12T05:27:09.601 INFO:teuthology.orchestra.run.gibba015.stdout:5.4.0-88-generic 2021-11-12T05:27:09.602 INFO:teuthology.task.kernel:Running kernel on gibba015: 5.4.0-88-generic 2021-11-12T05:27:09.602 DEBUG:teuthology.orchestra.run.gibba015:> sudo apt-get clean 2021-11-12T05:27:09.707 DEBUG:teuthology.orchestra.run.gibba015:> sudo apt-get update 2021-11-12T05:27:09.827 INFO:teuthology.orchestra.run.gibba015.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-11-12T05:27:09.933 INFO:teuthology.orchestra.run.gibba015.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-12T05:27:10.016 INFO:teuthology.orchestra.run.gibba015.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-11-12T05:27:10.092 INFO:teuthology.orchestra.run.gibba015.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [987 kB] 2021-11-12T05:27:10.198 INFO:teuthology.orchestra.run.gibba015.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [306 kB] 2021-11-12T05:27:10.204 INFO:teuthology.orchestra.run.gibba015.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [183 kB] 2021-11-12T05:27:10.209 INFO:teuthology.orchestra.run.gibba015.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [8,880 B] 2021-11-12T05:27:10.209 INFO:teuthology.orchestra.run.gibba015.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [20.4 kB] 2021-11-12T05:27:10.210 INFO:teuthology.orchestra.run.gibba015.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [526 kB] 2021-11-12T05:27:10.224 INFO:teuthology.orchestra.run.gibba015.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [75.4 kB] 2021-11-12T05:27:10.224 INFO:teuthology.orchestra.run.gibba015.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [528 B] 2021-11-12T05:27:10.225 INFO:teuthology.orchestra.run.gibba015.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [651 kB] 2021-11-12T05:27:10.239 INFO:teuthology.orchestra.run.gibba015.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [515 kB] 2021-11-12T05:27:10.251 INFO:teuthology.orchestra.run.gibba015.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [107 kB] 2021-11-12T05:27:10.254 INFO:teuthology.orchestra.run.gibba015.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [12.9 kB] 2021-11-12T05:27:10.267 INFO:teuthology.orchestra.run.gibba015.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,212 B] 2021-11-12T05:27:10.267 INFO:teuthology.orchestra.run.gibba015.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [21.9 kB] 2021-11-12T05:27:10.268 INFO:teuthology.orchestra.run.gibba015.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2021-11-12T05:27:10.370 INFO:teuthology.orchestra.run.gibba015.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-11-12T05:27:10.461 INFO:teuthology.orchestra.run.gibba015.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,344 kB] 2021-11-12T05:27:10.722 INFO:teuthology.orchestra.run.gibba015.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [562 kB] 2021-11-12T05:27:10.767 INFO:teuthology.orchestra.run.gibba015.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [276 kB] 2021-11-12T05:27:10.785 INFO:teuthology.orchestra.run.gibba015.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [14.5 kB] 2021-11-12T05:27:10.787 INFO:teuthology.orchestra.run.gibba015.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [569 kB] 2021-11-12T05:27:10.821 INFO:teuthology.orchestra.run.gibba015.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [21.7 kB] 2021-11-12T05:27:10.823 INFO:teuthology.orchestra.run.gibba015.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [81.6 kB] 2021-11-12T05:27:10.825 INFO:teuthology.orchestra.run.gibba015.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [528 B] 2021-11-12T05:27:10.825 INFO:teuthology.orchestra.run.gibba015.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [875 kB] 2021-11-12T05:27:10.859 INFO:teuthology.orchestra.run.gibba015.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [647 kB] 2021-11-12T05:27:10.880 INFO:teuthology.orchestra.run.gibba015.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [189 kB] 2021-11-12T05:27:10.906 INFO:teuthology.orchestra.run.gibba015.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [19.5 kB] 2021-11-12T05:27:10.907 INFO:teuthology.orchestra.run.gibba015.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [24.5 kB] 2021-11-12T05:27:10.908 INFO:teuthology.orchestra.run.gibba015.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,204 B] 2021-11-12T05:27:10.964 INFO:teuthology.orchestra.run.gibba015.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,856 B] 2021-11-12T05:27:10.965 INFO:teuthology.orchestra.run.gibba015.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2021-11-12T05:27:10.965 INFO:teuthology.orchestra.run.gibba015.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [5,528 B] 2021-11-12T05:27:10.966 INFO:teuthology.orchestra.run.gibba015.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [6,584 B] 2021-11-12T05:27:10.993 INFO:teuthology.orchestra.run.gibba015.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/universe Translation-en [3,292 B] 2021-11-12T05:27:10.993 INFO:teuthology.orchestra.run.gibba015.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [580 B] 2021-11-12T05:27:12.982 INFO:teuthology.orchestra.run.gibba015.stdout:Fetched 8,407 kB in 1s (6,000 kB/s) 2021-11-12T05:27:14.032 INFO:teuthology.orchestra.run.gibba015.stdout:Reading package lists... 2021-11-12T05:27:14.043 DEBUG:teuthology.orchestra.run.gibba015:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-11-12T05:27:14.079 INFO:teuthology.orchestra.run.gibba015.stdout:Reading package lists... 2021-11-12T05:27:14.182 INFO:teuthology.orchestra.run.gibba015.stdout:Building dependency tree... 2021-11-12T05:27:14.183 INFO:teuthology.orchestra.run.gibba015.stdout:Reading state information... 2021-11-12T05:27:14.261 INFO:teuthology.orchestra.run.gibba015.stdout:The following package was automatically installed and is no longer required: 2021-11-12T05:27:14.261 INFO:teuthology.orchestra.run.gibba015.stdout: libllvm11 2021-11-12T05:27:14.262 INFO:teuthology.orchestra.run.gibba015.stdout:Use 'sudo apt autoremove' to remove it. 2021-11-12T05:27:14.262 INFO:teuthology.orchestra.run.gibba015.stdout:The following additional packages will be installed: 2021-11-12T05:27:14.262 INFO:teuthology.orchestra.run.gibba015.stdout: linux-generic linux-headers-5.4.0-90 linux-headers-5.4.0-90-generic 2021-11-12T05:27:14.263 INFO:teuthology.orchestra.run.gibba015.stdout: linux-headers-generic linux-image-5.4.0-90-generic 2021-11-12T05:27:14.263 INFO:teuthology.orchestra.run.gibba015.stdout: linux-modules-5.4.0-90-generic linux-modules-extra-5.4.0-90-generic 2021-11-12T05:27:14.263 INFO:teuthology.orchestra.run.gibba015.stdout:Suggested packages: 2021-11-12T05:27:14.264 INFO:teuthology.orchestra.run.gibba015.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-11-12T05:27:14.264 INFO:teuthology.orchestra.run.gibba015.stdout:Recommended packages: 2021-11-12T05:27:14.264 INFO:teuthology.orchestra.run.gibba015.stdout: thermald 2021-11-12T05:27:14.299 INFO:teuthology.orchestra.run.gibba015.stdout:The following NEW packages will be installed: 2021-11-12T05:27:14.299 INFO:teuthology.orchestra.run.gibba015.stdout: linux-headers-5.4.0-90 linux-headers-5.4.0-90-generic 2021-11-12T05:27:14.299 INFO:teuthology.orchestra.run.gibba015.stdout: linux-image-5.4.0-90-generic linux-modules-5.4.0-90-generic 2021-11-12T05:27:14.300 INFO:teuthology.orchestra.run.gibba015.stdout: linux-modules-extra-5.4.0-90-generic 2021-11-12T05:27:14.300 INFO:teuthology.orchestra.run.gibba015.stdout:The following packages will be upgraded: 2021-11-12T05:27:14.300 INFO:teuthology.orchestra.run.gibba015.stdout: linux-generic linux-headers-generic linux-image-generic 2021-11-12T05:27:14.474 INFO:teuthology.orchestra.run.gibba015.stdout:3 upgraded, 5 newly installed, 0 to remove and 55 not upgraded. 2021-11-12T05:27:14.474 INFO:teuthology.orchestra.run.gibba015.stdout:Need to get 75.6 MB of archives. 2021-11-12T05:27:14.474 INFO:teuthology.orchestra.run.gibba015.stdout:After this operation, 378 MB of additional disk space will be used. 2021-11-12T05:27:14.475 INFO:teuthology.orchestra.run.gibba015.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-90-generic amd64 5.4.0-90.101 [14.8 MB] 2021-11-12T05:27:15.648 INFO:teuthology.orchestra.run.gibba015.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-90-generic amd64 5.4.0-90.101 [8,994 kB] 2021-11-12T05:27:15.929 INFO:teuthology.orchestra.run.gibba015.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-90-generic amd64 5.4.0-90.101 [39.4 MB] 2021-11-12T05:27:17.398 INFO:teuthology.orchestra.run.gibba015.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.90.94 [1,900 B] 2021-11-12T05:27:17.442 INFO:teuthology.orchestra.run.gibba015.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.90.94 [2,580 B] 2021-11-12T05:27:17.442 INFO:teuthology.orchestra.run.gibba015.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-90 all 5.4.0-90.101 [11.0 MB] 2021-11-12T05:27:18.007 INFO:teuthology.orchestra.run.gibba015.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-90-generic amd64 5.4.0-90.101 [1,403 kB] 2021-11-12T05:27:18.080 INFO:teuthology.orchestra.run.gibba015.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.90.94 [2,448 B] 2021-11-12T05:27:18.328 INFO:teuthology.orchestra.run.gibba015.stdout:Fetched 75.6 MB in 4s (20.0 MB/s) 2021-11-12T05:27:18.512 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package linux-modules-5.4.0-90-generic. 2021-11-12T05:27:20.514 INFO:teuthology.orchestra.run.gibba015.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138265 files and directories currently installed.) 2021-11-12T05:27:20.524 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../0-linux-modules-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-12T05:27:20.578 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking linux-modules-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:27:22.085 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package linux-image-5.4.0-90-generic. 2021-11-12T05:27:22.093 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../1-linux-image-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-12T05:27:22.178 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:27:23.072 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-90-generic. 2021-11-12T05:27:23.097 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-12T05:27:23.130 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking linux-modules-extra-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:27:26.163 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../3-linux-generic_5.4.0.90.94_amd64.deb ... 2021-11-12T05:27:26.316 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking linux-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-12T05:27:26.636 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.90.94_amd64.deb ... 2021-11-12T05:27:26.786 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking linux-image-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-12T05:27:27.147 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package linux-headers-5.4.0-90. 2021-11-12T05:27:27.174 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../5-linux-headers-5.4.0-90_5.4.0-90.101_all.deb ... 2021-11-12T05:27:27.213 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking linux-headers-5.4.0-90 (5.4.0-90.101) ... 2021-11-12T05:27:30.818 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package linux-headers-5.4.0-90-generic. 2021-11-12T05:27:30.858 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../6-linux-headers-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-12T05:27:30.893 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking linux-headers-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:27:32.659 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.90.94_amd64.deb ... 2021-11-12T05:27:32.786 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking linux-headers-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-12T05:27:33.184 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up linux-headers-5.4.0-90 (5.4.0-90.101) ... 2021-11-12T05:27:33.291 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up linux-modules-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:27:34.059 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up linux-headers-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:27:34.202 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up linux-headers-generic (5.4.0.90.94) ... 2021-11-12T05:27:34.328 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:27:35.065 INFO:teuthology.orchestra.run.gibba015.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.4.0-88-generic 2021-11-12T05:27:35.065 INFO:teuthology.orchestra.run.gibba015.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.4.0-88-generic 2021-11-12T05:27:35.065 INFO:teuthology.orchestra.run.gibba015.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-90-generic 2021-11-12T05:27:35.066 INFO:teuthology.orchestra.run.gibba015.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-90-generic 2021-11-12T05:27:35.221 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up linux-modules-extra-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:27:36.039 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up linux-image-generic (5.4.0.90.94) ... 2021-11-12T05:27:36.158 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up linux-generic (5.4.0.90.94) ... 2021-11-12T05:27:36.259 INFO:teuthology.orchestra.run.gibba015.stdout:Processing triggers for linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:27:36.388 INFO:teuthology.orchestra.run.gibba015.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-11-12T05:27:36.388 INFO:teuthology.orchestra.run.gibba015.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-90-generic 2021-11-12T05:27:57.341 INFO:teuthology.orchestra.run.gibba015.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-11-12T05:27:57.341 INFO:teuthology.orchestra.run.gibba015.stdout:Sourcing file `/etc/default/grub' 2021-11-12T05:27:57.348 INFO:teuthology.orchestra.run.gibba015.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-11-12T05:27:57.407 INFO:teuthology.orchestra.run.gibba015.stdout:Generating grub configuration file ... 2021-11-12T05:27:57.726 INFO:teuthology.orchestra.run.gibba015.stdout:Found linux image: /boot/vmlinuz-5.4.0-90-generic 2021-11-12T05:27:57.759 INFO:teuthology.orchestra.run.gibba015.stdout:Found initrd image: /boot/initrd.img-5.4.0-90-generic 2021-11-12T05:27:58.188 INFO:teuthology.orchestra.run.gibba015.stdout:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-11-12T05:27:58.202 INFO:teuthology.orchestra.run.gibba015.stdout:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-11-12T05:27:58.335 INFO:teuthology.orchestra.run.gibba015.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-11-12T05:27:58.350 INFO:teuthology.orchestra.run.gibba015.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-11-12T05:28:01.169 INFO:teuthology.orchestra.run.gibba015.stdout:done 2021-11-12T05:28:01.486 DEBUG:teuthology.orchestra.run.gibba015:> dpkg -s linux-image-generic 2021-11-12T05:28:01.514 INFO:teuthology.orchestra.run.gibba015.stdout:Package: linux-image-generic 2021-11-12T05:28:01.514 INFO:teuthology.orchestra.run.gibba015.stdout:Status: install ok installed 2021-11-12T05:28:01.514 INFO:teuthology.orchestra.run.gibba015.stdout:Priority: optional 2021-11-12T05:28:01.514 INFO:teuthology.orchestra.run.gibba015.stdout:Section: kernel 2021-11-12T05:28:01.515 INFO:teuthology.orchestra.run.gibba015.stdout:Installed-Size: 18 2021-11-12T05:28:01.515 INFO:teuthology.orchestra.run.gibba015.stdout:Maintainer: Ubuntu Kernel Team 2021-11-12T05:28:01.515 INFO:teuthology.orchestra.run.gibba015.stdout:Architecture: amd64 2021-11-12T05:28:01.515 INFO:teuthology.orchestra.run.gibba015.stdout:Source: linux-meta 2021-11-12T05:28:01.516 INFO:teuthology.orchestra.run.gibba015.stdout:Version: 5.4.0.90.94 2021-11-12T05:28:01.516 INFO:teuthology.orchestra.run.gibba015.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-11-12T05:28:01.516 INFO:teuthology.orchestra.run.gibba015.stdout:Depends: linux-image-5.4.0-90-generic, linux-modules-extra-5.4.0-90-generic, linux-firmware, intel-microcode, amd64-microcode 2021-11-12T05:28:01.516 INFO:teuthology.orchestra.run.gibba015.stdout:Recommends: thermald 2021-11-12T05:28:01.516 INFO:teuthology.orchestra.run.gibba015.stdout:Description: Generic Linux kernel image 2021-11-12T05:28:01.517 INFO:teuthology.orchestra.run.gibba015.stdout: This package will always depend on the latest generic kernel image 2021-11-12T05:28:01.517 INFO:teuthology.orchestra.run.gibba015.stdout: available. 2021-11-12T05:28:01.517 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-88-generic Expected: 5.4.0-90-generic 2021-11-12T05:28:01.518 DEBUG:teuthology.orchestra.run.gibba016:> uname -r 2021-11-12T05:28:01.526 INFO:teuthology.orchestra.run.gibba016.stdout:5.4.0-88-generic 2021-11-12T05:28:01.527 INFO:teuthology.task.kernel:Running kernel on gibba016: 5.4.0-88-generic 2021-11-12T05:28:01.527 DEBUG:teuthology.orchestra.run.gibba016:> sudo apt-get clean 2021-11-12T05:28:01.634 DEBUG:teuthology.orchestra.run.gibba016:> sudo apt-get update 2021-11-12T05:28:01.763 INFO:teuthology.orchestra.run.gibba016.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-11-12T05:28:01.890 INFO:teuthology.orchestra.run.gibba016.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-12T05:28:01.973 INFO:teuthology.orchestra.run.gibba016.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-11-12T05:28:02.012 INFO:teuthology.orchestra.run.gibba016.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [306 kB] 2021-11-12T05:28:02.083 INFO:teuthology.orchestra.run.gibba016.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [987 kB] 2021-11-12T05:28:02.162 INFO:teuthology.orchestra.run.gibba016.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [183 kB] 2021-11-12T05:28:02.167 INFO:teuthology.orchestra.run.gibba016.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [8,880 B] 2021-11-12T05:28:02.168 INFO:teuthology.orchestra.run.gibba016.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [526 kB] 2021-11-12T05:28:02.182 INFO:teuthology.orchestra.run.gibba016.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [20.4 kB] 2021-11-12T05:28:02.183 INFO:teuthology.orchestra.run.gibba016.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [75.4 kB] 2021-11-12T05:28:02.184 INFO:teuthology.orchestra.run.gibba016.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [528 B] 2021-11-12T05:28:02.184 INFO:teuthology.orchestra.run.gibba016.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [515 kB] 2021-11-12T05:28:02.186 INFO:teuthology.orchestra.run.gibba016.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [651 kB] 2021-11-12T05:28:02.195 INFO:teuthology.orchestra.run.gibba016.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [107 kB] 2021-11-12T05:28:02.196 INFO:teuthology.orchestra.run.gibba016.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [12.9 kB] 2021-11-12T05:28:02.206 INFO:teuthology.orchestra.run.gibba016.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,212 B] 2021-11-12T05:28:02.207 INFO:teuthology.orchestra.run.gibba016.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [21.9 kB] 2021-11-12T05:28:02.207 INFO:teuthology.orchestra.run.gibba016.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2021-11-12T05:28:02.310 INFO:teuthology.orchestra.run.gibba016.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-11-12T05:28:02.413 INFO:teuthology.orchestra.run.gibba016.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,344 kB] 2021-11-12T05:28:02.673 INFO:teuthology.orchestra.run.gibba016.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [562 kB] 2021-11-12T05:28:02.712 INFO:teuthology.orchestra.run.gibba016.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [276 kB] 2021-11-12T05:28:02.726 INFO:teuthology.orchestra.run.gibba016.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [14.5 kB] 2021-11-12T05:28:02.726 INFO:teuthology.orchestra.run.gibba016.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [569 kB] 2021-11-12T05:28:02.752 INFO:teuthology.orchestra.run.gibba016.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [21.7 kB] 2021-11-12T05:28:02.753 INFO:teuthology.orchestra.run.gibba016.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [81.6 kB] 2021-11-12T05:28:02.757 INFO:teuthology.orchestra.run.gibba016.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [528 B] 2021-11-12T05:28:02.757 INFO:teuthology.orchestra.run.gibba016.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [875 kB] 2021-11-12T05:28:02.784 INFO:teuthology.orchestra.run.gibba016.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [647 kB] 2021-11-12T05:28:02.805 INFO:teuthology.orchestra.run.gibba016.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [189 kB] 2021-11-12T05:28:02.839 INFO:teuthology.orchestra.run.gibba016.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [19.5 kB] 2021-11-12T05:28:02.839 INFO:teuthology.orchestra.run.gibba016.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [24.5 kB] 2021-11-12T05:28:02.840 INFO:teuthology.orchestra.run.gibba016.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,204 B] 2021-11-12T05:28:02.840 INFO:teuthology.orchestra.run.gibba016.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,856 B] 2021-11-12T05:28:02.841 INFO:teuthology.orchestra.run.gibba016.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2021-11-12T05:28:02.841 INFO:teuthology.orchestra.run.gibba016.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [6,584 B] 2021-11-12T05:28:02.841 INFO:teuthology.orchestra.run.gibba016.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [5,528 B] 2021-11-12T05:28:02.923 INFO:teuthology.orchestra.run.gibba016.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/universe Translation-en [3,292 B] 2021-11-12T05:28:02.923 INFO:teuthology.orchestra.run.gibba016.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [580 B] 2021-11-12T05:28:04.857 INFO:teuthology.orchestra.run.gibba016.stdout:Fetched 8,407 kB in 1s (5,889 kB/s) 2021-11-12T05:28:05.852 INFO:teuthology.orchestra.run.gibba016.stdout:Reading package lists... 2021-11-12T05:28:05.863 DEBUG:teuthology.orchestra.run.gibba016:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-11-12T05:28:05.899 INFO:teuthology.orchestra.run.gibba016.stdout:Reading package lists... 2021-11-12T05:28:05.999 INFO:teuthology.orchestra.run.gibba016.stdout:Building dependency tree... 2021-11-12T05:28:06.000 INFO:teuthology.orchestra.run.gibba016.stdout:Reading state information... 2021-11-12T05:28:06.079 INFO:teuthology.orchestra.run.gibba016.stdout:The following package was automatically installed and is no longer required: 2021-11-12T05:28:06.079 INFO:teuthology.orchestra.run.gibba016.stdout: libllvm11 2021-11-12T05:28:06.079 INFO:teuthology.orchestra.run.gibba016.stdout:Use 'sudo apt autoremove' to remove it. 2021-11-12T05:28:06.079 INFO:teuthology.orchestra.run.gibba016.stdout:The following additional packages will be installed: 2021-11-12T05:28:06.080 INFO:teuthology.orchestra.run.gibba016.stdout: linux-generic linux-headers-5.4.0-90 linux-headers-5.4.0-90-generic 2021-11-12T05:28:06.080 INFO:teuthology.orchestra.run.gibba016.stdout: linux-headers-generic linux-image-5.4.0-90-generic 2021-11-12T05:28:06.080 INFO:teuthology.orchestra.run.gibba016.stdout: linux-modules-5.4.0-90-generic linux-modules-extra-5.4.0-90-generic 2021-11-12T05:28:06.081 INFO:teuthology.orchestra.run.gibba016.stdout:Suggested packages: 2021-11-12T05:28:06.081 INFO:teuthology.orchestra.run.gibba016.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-11-12T05:28:06.081 INFO:teuthology.orchestra.run.gibba016.stdout:Recommended packages: 2021-11-12T05:28:06.081 INFO:teuthology.orchestra.run.gibba016.stdout: thermald 2021-11-12T05:28:06.132 INFO:teuthology.orchestra.run.gibba016.stdout:The following NEW packages will be installed: 2021-11-12T05:28:06.133 INFO:teuthology.orchestra.run.gibba016.stdout: linux-headers-5.4.0-90 linux-headers-5.4.0-90-generic 2021-11-12T05:28:06.133 INFO:teuthology.orchestra.run.gibba016.stdout: linux-image-5.4.0-90-generic linux-modules-5.4.0-90-generic 2021-11-12T05:28:06.133 INFO:teuthology.orchestra.run.gibba016.stdout: linux-modules-extra-5.4.0-90-generic 2021-11-12T05:28:06.134 INFO:teuthology.orchestra.run.gibba016.stdout:The following packages will be upgraded: 2021-11-12T05:28:06.134 INFO:teuthology.orchestra.run.gibba016.stdout: linux-generic linux-headers-generic linux-image-generic 2021-11-12T05:28:06.310 INFO:teuthology.orchestra.run.gibba016.stdout:3 upgraded, 5 newly installed, 0 to remove and 55 not upgraded. 2021-11-12T05:28:06.311 INFO:teuthology.orchestra.run.gibba016.stdout:Need to get 75.6 MB of archives. 2021-11-12T05:28:06.311 INFO:teuthology.orchestra.run.gibba016.stdout:After this operation, 378 MB of additional disk space will be used. 2021-11-12T05:28:06.312 INFO:teuthology.orchestra.run.gibba016.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-90-generic amd64 5.4.0-90.101 [14.8 MB] 2021-11-12T05:28:07.488 INFO:teuthology.orchestra.run.gibba016.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-90-generic amd64 5.4.0-90.101 [8,994 kB] 2021-11-12T05:28:07.741 INFO:teuthology.orchestra.run.gibba016.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-90-generic amd64 5.4.0-90.101 [39.4 MB] 2021-11-12T05:28:09.054 INFO:teuthology.orchestra.run.gibba016.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.90.94 [1,900 B] 2021-11-12T05:28:09.054 INFO:teuthology.orchestra.run.gibba016.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.90.94 [2,580 B] 2021-11-12T05:28:09.055 INFO:teuthology.orchestra.run.gibba016.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-90 all 5.4.0-90.101 [11.0 MB] 2021-11-12T05:28:09.338 INFO:teuthology.orchestra.run.gibba016.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-90-generic amd64 5.4.0-90.101 [1,403 kB] 2021-11-12T05:28:09.375 INFO:teuthology.orchestra.run.gibba016.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.90.94 [2,448 B] 2021-11-12T05:28:09.638 INFO:teuthology.orchestra.run.gibba016.stdout:Fetched 75.6 MB in 3s (23.4 MB/s) 2021-11-12T05:28:09.779 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package linux-modules-5.4.0-90-generic. 2021-11-12T05:28:11.672 INFO:teuthology.orchestra.run.gibba016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138265 files and directories currently installed.) 2021-11-12T05:28:11.681 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../0-linux-modules-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-12T05:28:11.734 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking linux-modules-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:28:13.099 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package linux-image-5.4.0-90-generic. 2021-11-12T05:28:13.126 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../1-linux-image-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-12T05:28:13.218 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:28:14.044 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-90-generic. 2021-11-12T05:28:14.069 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-12T05:28:14.135 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking linux-modules-extra-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:28:17.050 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../3-linux-generic_5.4.0.90.94_amd64.deb ... 2021-11-12T05:28:17.171 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking linux-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-12T05:28:17.473 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.90.94_amd64.deb ... 2021-11-12T05:28:17.597 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking linux-image-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-12T05:28:17.908 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package linux-headers-5.4.0-90. 2021-11-12T05:28:17.935 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../5-linux-headers-5.4.0-90_5.4.0-90.101_all.deb ... 2021-11-12T05:28:17.975 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking linux-headers-5.4.0-90 (5.4.0-90.101) ... 2021-11-12T05:28:21.745 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package linux-headers-5.4.0-90-generic. 2021-11-12T05:28:21.757 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../6-linux-headers-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-12T05:28:22.018 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking linux-headers-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:28:23.546 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.90.94_amd64.deb ... 2021-11-12T05:28:23.692 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking linux-headers-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-12T05:28:24.014 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up linux-headers-5.4.0-90 (5.4.0-90.101) ... 2021-11-12T05:28:24.121 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up linux-modules-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:28:24.914 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up linux-headers-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:28:25.040 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up linux-headers-generic (5.4.0.90.94) ... 2021-11-12T05:28:25.166 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:28:25.875 INFO:teuthology.orchestra.run.gibba016.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.4.0-88-generic 2021-11-12T05:28:25.876 INFO:teuthology.orchestra.run.gibba016.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.4.0-88-generic 2021-11-12T05:28:25.876 INFO:teuthology.orchestra.run.gibba016.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-90-generic 2021-11-12T05:28:25.876 INFO:teuthology.orchestra.run.gibba016.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-90-generic 2021-11-12T05:28:26.001 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up linux-modules-extra-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:28:26.803 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up linux-image-generic (5.4.0.90.94) ... 2021-11-12T05:28:26.904 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up linux-generic (5.4.0.90.94) ... 2021-11-12T05:28:27.005 INFO:teuthology.orchestra.run.gibba016.stdout:Processing triggers for linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:28:27.124 INFO:teuthology.orchestra.run.gibba016.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-11-12T05:28:27.124 INFO:teuthology.orchestra.run.gibba016.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-90-generic 2021-11-12T05:28:47.601 INFO:teuthology.orchestra.run.gibba016.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-11-12T05:28:47.602 INFO:teuthology.orchestra.run.gibba016.stdout:Sourcing file `/etc/default/grub' 2021-11-12T05:28:47.615 INFO:teuthology.orchestra.run.gibba016.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-11-12T05:28:47.627 INFO:teuthology.orchestra.run.gibba016.stdout:Generating grub configuration file ... 2021-11-12T05:28:48.006 INFO:teuthology.orchestra.run.gibba016.stdout:Found linux image: /boot/vmlinuz-5.4.0-90-generic 2021-11-12T05:28:48.044 INFO:teuthology.orchestra.run.gibba016.stdout:Found initrd image: /boot/initrd.img-5.4.0-90-generic 2021-11-12T05:28:48.477 INFO:teuthology.orchestra.run.gibba016.stdout:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-11-12T05:28:48.491 INFO:teuthology.orchestra.run.gibba016.stdout:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-11-12T05:28:48.624 INFO:teuthology.orchestra.run.gibba016.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-11-12T05:28:48.638 INFO:teuthology.orchestra.run.gibba016.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-11-12T05:28:51.408 INFO:teuthology.orchestra.run.gibba016.stdout:done 2021-11-12T05:28:51.682 DEBUG:teuthology.orchestra.run.gibba016:> dpkg -s linux-image-generic 2021-11-12T05:28:51.709 INFO:teuthology.orchestra.run.gibba016.stdout:Package: linux-image-generic 2021-11-12T05:28:51.709 INFO:teuthology.orchestra.run.gibba016.stdout:Status: install ok installed 2021-11-12T05:28:51.710 INFO:teuthology.orchestra.run.gibba016.stdout:Priority: optional 2021-11-12T05:28:51.710 INFO:teuthology.orchestra.run.gibba016.stdout:Section: kernel 2021-11-12T05:28:51.710 INFO:teuthology.orchestra.run.gibba016.stdout:Installed-Size: 18 2021-11-12T05:28:51.710 INFO:teuthology.orchestra.run.gibba016.stdout:Maintainer: Ubuntu Kernel Team 2021-11-12T05:28:51.711 INFO:teuthology.orchestra.run.gibba016.stdout:Architecture: amd64 2021-11-12T05:28:51.711 INFO:teuthology.orchestra.run.gibba016.stdout:Source: linux-meta 2021-11-12T05:28:51.711 INFO:teuthology.orchestra.run.gibba016.stdout:Version: 5.4.0.90.94 2021-11-12T05:28:51.711 INFO:teuthology.orchestra.run.gibba016.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-11-12T05:28:51.712 INFO:teuthology.orchestra.run.gibba016.stdout:Depends: linux-image-5.4.0-90-generic, linux-modules-extra-5.4.0-90-generic, linux-firmware, intel-microcode, amd64-microcode 2021-11-12T05:28:51.712 INFO:teuthology.orchestra.run.gibba016.stdout:Recommends: thermald 2021-11-12T05:28:51.712 INFO:teuthology.orchestra.run.gibba016.stdout:Description: Generic Linux kernel image 2021-11-12T05:28:51.712 INFO:teuthology.orchestra.run.gibba016.stdout: This package will always depend on the latest generic kernel image 2021-11-12T05:28:51.712 INFO:teuthology.orchestra.run.gibba016.stdout: available. 2021-11-12T05:28:51.713 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-88-generic Expected: 5.4.0-90-generic 2021-11-12T05:28:51.713 DEBUG:teuthology.orchestra.run.gibba038:> uname -r 2021-11-12T05:28:51.722 INFO:teuthology.orchestra.run.gibba038.stdout:5.4.0-88-generic 2021-11-12T05:28:51.722 INFO:teuthology.task.kernel:Running kernel on gibba038: 5.4.0-88-generic 2021-11-12T05:28:51.723 DEBUG:teuthology.orchestra.run.gibba038:> sudo apt-get clean 2021-11-12T05:28:51.799 DEBUG:teuthology.orchestra.run.gibba038:> sudo apt-get update 2021-11-12T05:28:52.042 INFO:teuthology.orchestra.run.gibba038.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-11-12T05:28:52.062 INFO:teuthology.orchestra.run.gibba038.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-12T05:28:52.131 INFO:teuthology.orchestra.run.gibba038.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-11-12T05:28:52.441 INFO:teuthology.orchestra.run.gibba038.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [306 kB] 2021-11-12T05:28:52.483 INFO:teuthology.orchestra.run.gibba038.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-11-12T05:28:52.587 INFO:teuthology.orchestra.run.gibba038.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [562 kB] 2021-11-12T05:28:52.638 INFO:teuthology.orchestra.run.gibba038.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [987 kB] 2021-11-12T05:28:52.740 INFO:teuthology.orchestra.run.gibba038.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,344 kB] 2021-11-12T05:28:52.797 INFO:teuthology.orchestra.run.gibba038.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [183 kB] 2021-11-12T05:28:52.811 INFO:teuthology.orchestra.run.gibba038.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [8,880 B] 2021-11-12T05:28:52.811 INFO:teuthology.orchestra.run.gibba038.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [526 kB] 2021-11-12T05:28:52.847 INFO:teuthology.orchestra.run.gibba038.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [20.4 kB] 2021-11-12T05:28:52.847 INFO:teuthology.orchestra.run.gibba038.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [75.4 kB] 2021-11-12T05:28:52.853 INFO:teuthology.orchestra.run.gibba038.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [528 B] 2021-11-12T05:28:52.853 INFO:teuthology.orchestra.run.gibba038.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [651 kB] 2021-11-12T05:28:52.876 INFO:teuthology.orchestra.run.gibba038.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [276 kB] 2021-11-12T05:28:52.892 INFO:teuthology.orchestra.run.gibba038.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [515 kB] 2021-11-12T05:28:52.895 INFO:teuthology.orchestra.run.gibba038.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [14.5 kB] 2021-11-12T05:28:52.896 INFO:teuthology.orchestra.run.gibba038.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [21.7 kB] 2021-11-12T05:28:52.897 INFO:teuthology.orchestra.run.gibba038.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [569 kB] 2021-11-12T05:28:52.910 INFO:teuthology.orchestra.run.gibba038.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [107 kB] 2021-11-12T05:28:52.912 INFO:teuthology.orchestra.run.gibba038.stdout:Get:22 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [12.9 kB] 2021-11-12T05:28:52.926 INFO:teuthology.orchestra.run.gibba038.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [81.6 kB] 2021-11-12T05:28:52.928 INFO:teuthology.orchestra.run.gibba038.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [528 B] 2021-11-12T05:28:52.929 INFO:teuthology.orchestra.run.gibba038.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [875 kB] 2021-11-12T05:28:52.955 INFO:teuthology.orchestra.run.gibba038.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [647 kB] 2021-11-12T05:28:52.963 INFO:teuthology.orchestra.run.gibba038.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,212 B] 2021-11-12T05:28:52.963 INFO:teuthology.orchestra.run.gibba038.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [21.9 kB] 2021-11-12T05:28:52.964 INFO:teuthology.orchestra.run.gibba038.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2021-11-12T05:28:52.975 INFO:teuthology.orchestra.run.gibba038.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [189 kB] 2021-11-12T05:28:52.980 INFO:teuthology.orchestra.run.gibba038.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [19.5 kB] 2021-11-12T05:28:53.011 INFO:teuthology.orchestra.run.gibba038.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [24.5 kB] 2021-11-12T05:28:53.012 INFO:teuthology.orchestra.run.gibba038.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,204 B] 2021-11-12T05:28:53.012 INFO:teuthology.orchestra.run.gibba038.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,856 B] 2021-11-12T05:28:53.012 INFO:teuthology.orchestra.run.gibba038.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2021-11-12T05:28:53.012 INFO:teuthology.orchestra.run.gibba038.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [5,528 B] 2021-11-12T05:28:53.042 INFO:teuthology.orchestra.run.gibba038.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [6,584 B] 2021-11-12T05:28:53.042 INFO:teuthology.orchestra.run.gibba038.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/universe Translation-en [3,292 B] 2021-11-12T05:28:53.124 INFO:teuthology.orchestra.run.gibba038.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [580 B] 2021-11-12T05:28:55.257 INFO:teuthology.orchestra.run.gibba038.stdout:Fetched 8,407 kB in 2s (5,243 kB/s) 2021-11-12T05:28:56.243 INFO:teuthology.orchestra.run.gibba038.stdout:Reading package lists... 2021-11-12T05:28:56.254 DEBUG:teuthology.orchestra.run.gibba038:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-11-12T05:28:56.335 INFO:teuthology.orchestra.run.gibba038.stdout:Reading package lists... 2021-11-12T05:28:56.436 INFO:teuthology.orchestra.run.gibba038.stdout:Building dependency tree... 2021-11-12T05:28:56.436 INFO:teuthology.orchestra.run.gibba038.stdout:Reading state information... 2021-11-12T05:28:56.515 INFO:teuthology.orchestra.run.gibba038.stdout:The following package was automatically installed and is no longer required: 2021-11-12T05:28:56.515 INFO:teuthology.orchestra.run.gibba038.stdout: libllvm11 2021-11-12T05:28:56.515 INFO:teuthology.orchestra.run.gibba038.stdout:Use 'sudo apt autoremove' to remove it. 2021-11-12T05:28:56.516 INFO:teuthology.orchestra.run.gibba038.stdout:The following additional packages will be installed: 2021-11-12T05:28:56.516 INFO:teuthology.orchestra.run.gibba038.stdout: linux-generic linux-headers-5.4.0-90 linux-headers-5.4.0-90-generic 2021-11-12T05:28:56.517 INFO:teuthology.orchestra.run.gibba038.stdout: linux-headers-generic linux-image-5.4.0-90-generic 2021-11-12T05:28:56.517 INFO:teuthology.orchestra.run.gibba038.stdout: linux-modules-5.4.0-90-generic linux-modules-extra-5.4.0-90-generic 2021-11-12T05:28:56.517 INFO:teuthology.orchestra.run.gibba038.stdout:Suggested packages: 2021-11-12T05:28:56.518 INFO:teuthology.orchestra.run.gibba038.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-11-12T05:28:56.518 INFO:teuthology.orchestra.run.gibba038.stdout:Recommended packages: 2021-11-12T05:28:56.518 INFO:teuthology.orchestra.run.gibba038.stdout: thermald 2021-11-12T05:28:56.531 INFO:teuthology.orchestra.run.gibba038.stdout:The following NEW packages will be installed: 2021-11-12T05:28:56.531 INFO:teuthology.orchestra.run.gibba038.stdout: linux-headers-5.4.0-90 linux-headers-5.4.0-90-generic 2021-11-12T05:28:56.531 INFO:teuthology.orchestra.run.gibba038.stdout: linux-image-5.4.0-90-generic linux-modules-5.4.0-90-generic 2021-11-12T05:28:56.532 INFO:teuthology.orchestra.run.gibba038.stdout: linux-modules-extra-5.4.0-90-generic 2021-11-12T05:28:56.532 INFO:teuthology.orchestra.run.gibba038.stdout:The following packages will be upgraded: 2021-11-12T05:28:56.533 INFO:teuthology.orchestra.run.gibba038.stdout: linux-generic linux-headers-generic linux-image-generic 2021-11-12T05:28:56.704 INFO:teuthology.orchestra.run.gibba038.stdout:3 upgraded, 5 newly installed, 0 to remove and 55 not upgraded. 2021-11-12T05:28:56.705 INFO:teuthology.orchestra.run.gibba038.stdout:Need to get 75.6 MB of archives. 2021-11-12T05:28:56.705 INFO:teuthology.orchestra.run.gibba038.stdout:After this operation, 378 MB of additional disk space will be used. 2021-11-12T05:28:56.705 INFO:teuthology.orchestra.run.gibba038.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-90-generic amd64 5.4.0-90.101 [14.8 MB] 2021-11-12T05:28:57.836 INFO:teuthology.orchestra.run.gibba038.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-90-generic amd64 5.4.0-90.101 [8,994 kB] 2021-11-12T05:28:58.082 INFO:teuthology.orchestra.run.gibba038.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-90-generic amd64 5.4.0-90.101 [39.4 MB] 2021-11-12T05:28:59.356 INFO:teuthology.orchestra.run.gibba038.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.90.94 [1,900 B] 2021-11-12T05:28:59.356 INFO:teuthology.orchestra.run.gibba038.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.90.94 [2,580 B] 2021-11-12T05:28:59.357 INFO:teuthology.orchestra.run.gibba038.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-90 all 5.4.0-90.101 [11.0 MB] 2021-11-12T05:29:00.087 INFO:teuthology.orchestra.run.gibba038.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-90-generic amd64 5.4.0-90.101 [1,403 kB] 2021-11-12T05:29:00.135 INFO:teuthology.orchestra.run.gibba038.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.90.94 [2,448 B] 2021-11-12T05:29:00.361 INFO:teuthology.orchestra.run.gibba038.stdout:Fetched 75.6 MB in 4s (21.0 MB/s) 2021-11-12T05:29:00.504 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package linux-modules-5.4.0-90-generic. 2021-11-12T05:29:02.390 INFO:teuthology.orchestra.run.gibba038.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138265 files and directories currently installed.) 2021-11-12T05:29:02.400 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../0-linux-modules-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-12T05:29:02.452 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking linux-modules-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:29:03.796 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package linux-image-5.4.0-90-generic. 2021-11-12T05:29:03.819 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../1-linux-image-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-12T05:29:03.906 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:29:04.721 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-90-generic. 2021-11-12T05:29:04.746 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-12T05:29:04.812 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking linux-modules-extra-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:29:07.943 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../3-linux-generic_5.4.0.90.94_amd64.deb ... 2021-11-12T05:29:08.071 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking linux-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-12T05:29:08.401 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.90.94_amd64.deb ... 2021-11-12T05:29:08.524 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking linux-image-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-12T05:29:08.877 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package linux-headers-5.4.0-90. 2021-11-12T05:29:08.887 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../5-linux-headers-5.4.0-90_5.4.0-90.101_all.deb ... 2021-11-12T05:29:08.927 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking linux-headers-5.4.0-90 (5.4.0-90.101) ... 2021-11-12T05:29:12.662 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package linux-headers-5.4.0-90-generic. 2021-11-12T05:29:12.702 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../6-linux-headers-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-12T05:29:12.737 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking linux-headers-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:29:14.277 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.90.94_amd64.deb ... 2021-11-12T05:29:14.404 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking linux-headers-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-12T05:29:14.726 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up linux-headers-5.4.0-90 (5.4.0-90.101) ... 2021-11-12T05:29:14.850 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up linux-modules-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:29:15.659 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up linux-headers-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:29:15.768 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up linux-headers-generic (5.4.0.90.94) ... 2021-11-12T05:29:15.870 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:29:16.553 INFO:teuthology.orchestra.run.gibba038.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.4.0-88-generic 2021-11-12T05:29:16.553 INFO:teuthology.orchestra.run.gibba038.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.4.0-88-generic 2021-11-12T05:29:16.553 INFO:teuthology.orchestra.run.gibba038.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-90-generic 2021-11-12T05:29:16.554 INFO:teuthology.orchestra.run.gibba038.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-90-generic 2021-11-12T05:29:16.688 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up linux-modules-extra-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:29:17.440 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up linux-image-generic (5.4.0.90.94) ... 2021-11-12T05:29:17.591 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up linux-generic (5.4.0.90.94) ... 2021-11-12T05:29:17.717 INFO:teuthology.orchestra.run.gibba038.stdout:Processing triggers for linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:29:17.842 INFO:teuthology.orchestra.run.gibba038.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-11-12T05:29:17.842 INFO:teuthology.orchestra.run.gibba038.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-90-generic 2021-11-12T05:29:38.520 INFO:teuthology.orchestra.run.gibba038.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-11-12T05:29:38.521 INFO:teuthology.orchestra.run.gibba038.stdout:Sourcing file `/etc/default/grub' 2021-11-12T05:29:38.535 INFO:teuthology.orchestra.run.gibba038.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-11-12T05:29:38.553 INFO:teuthology.orchestra.run.gibba038.stdout:Generating grub configuration file ... 2021-11-12T05:29:38.916 INFO:teuthology.orchestra.run.gibba038.stdout:Found linux image: /boot/vmlinuz-5.4.0-90-generic 2021-11-12T05:29:38.962 INFO:teuthology.orchestra.run.gibba038.stdout:Found initrd image: /boot/initrd.img-5.4.0-90-generic 2021-11-12T05:29:39.419 INFO:teuthology.orchestra.run.gibba038.stdout:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-11-12T05:29:39.433 INFO:teuthology.orchestra.run.gibba038.stdout:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-11-12T05:29:39.558 INFO:teuthology.orchestra.run.gibba038.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-11-12T05:29:39.572 INFO:teuthology.orchestra.run.gibba038.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-11-12T05:29:42.194 INFO:teuthology.orchestra.run.gibba038.stdout:done 2021-11-12T05:29:42.513 DEBUG:teuthology.orchestra.run.gibba038:> dpkg -s linux-image-generic 2021-11-12T05:29:42.528 INFO:teuthology.orchestra.run.gibba038.stdout:Package: linux-image-generic 2021-11-12T05:29:42.529 INFO:teuthology.orchestra.run.gibba038.stdout:Status: install ok installed 2021-11-12T05:29:42.529 INFO:teuthology.orchestra.run.gibba038.stdout:Priority: optional 2021-11-12T05:29:42.529 INFO:teuthology.orchestra.run.gibba038.stdout:Section: kernel 2021-11-12T05:29:42.529 INFO:teuthology.orchestra.run.gibba038.stdout:Installed-Size: 18 2021-11-12T05:29:42.530 INFO:teuthology.orchestra.run.gibba038.stdout:Maintainer: Ubuntu Kernel Team 2021-11-12T05:29:42.530 INFO:teuthology.orchestra.run.gibba038.stdout:Architecture: amd64 2021-11-12T05:29:42.530 INFO:teuthology.orchestra.run.gibba038.stdout:Source: linux-meta 2021-11-12T05:29:42.531 INFO:teuthology.orchestra.run.gibba038.stdout:Version: 5.4.0.90.94 2021-11-12T05:29:42.531 INFO:teuthology.orchestra.run.gibba038.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-11-12T05:29:42.531 INFO:teuthology.orchestra.run.gibba038.stdout:Depends: linux-image-5.4.0-90-generic, linux-modules-extra-5.4.0-90-generic, linux-firmware, intel-microcode, amd64-microcode 2021-11-12T05:29:42.531 INFO:teuthology.orchestra.run.gibba038.stdout:Recommends: thermald 2021-11-12T05:29:42.531 INFO:teuthology.orchestra.run.gibba038.stdout:Description: Generic Linux kernel image 2021-11-12T05:29:42.532 INFO:teuthology.orchestra.run.gibba038.stdout: This package will always depend on the latest generic kernel image 2021-11-12T05:29:42.532 INFO:teuthology.orchestra.run.gibba038.stdout: available. 2021-11-12T05:29:42.532 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-88-generic Expected: 5.4.0-90-generic 2021-11-12T05:29:42.533 DEBUG:teuthology.orchestra.run.gibba044:> uname -r 2021-11-12T05:29:42.542 INFO:teuthology.orchestra.run.gibba044.stdout:5.4.0-88-generic 2021-11-12T05:29:42.542 INFO:teuthology.task.kernel:Running kernel on gibba044: 5.4.0-88-generic 2021-11-12T05:29:42.542 DEBUG:teuthology.orchestra.run.gibba044:> sudo apt-get clean 2021-11-12T05:29:42.673 DEBUG:teuthology.orchestra.run.gibba044:> sudo apt-get update 2021-11-12T05:29:42.932 INFO:teuthology.orchestra.run.gibba044.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-12T05:29:42.970 INFO:teuthology.orchestra.run.gibba044.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-11-12T05:29:42.992 INFO:teuthology.orchestra.run.gibba044.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-11-12T05:29:43.329 INFO:teuthology.orchestra.run.gibba044.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-11-12T05:29:43.354 INFO:teuthology.orchestra.run.gibba044.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [306 kB] 2021-11-12T05:29:43.426 INFO:teuthology.orchestra.run.gibba044.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [562 kB] 2021-11-12T05:29:43.577 INFO:teuthology.orchestra.run.gibba044.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,344 kB] 2021-11-12T05:29:43.578 INFO:teuthology.orchestra.run.gibba044.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [987 kB] 2021-11-12T05:29:43.709 INFO:teuthology.orchestra.run.gibba044.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [276 kB] 2021-11-12T05:29:43.718 INFO:teuthology.orchestra.run.gibba044.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [14.5 kB] 2021-11-12T05:29:43.720 INFO:teuthology.orchestra.run.gibba044.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [21.7 kB] 2021-11-12T05:29:43.721 INFO:teuthology.orchestra.run.gibba044.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [569 kB] 2021-11-12T05:29:43.748 INFO:teuthology.orchestra.run.gibba044.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [81.6 kB] 2021-11-12T05:29:43.749 INFO:teuthology.orchestra.run.gibba044.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [183 kB] 2021-11-12T05:29:43.755 INFO:teuthology.orchestra.run.gibba044.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [528 B] 2021-11-12T05:29:43.755 INFO:teuthology.orchestra.run.gibba044.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [875 kB] 2021-11-12T05:29:43.761 INFO:teuthology.orchestra.run.gibba044.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [8,880 B] 2021-11-12T05:29:43.762 INFO:teuthology.orchestra.run.gibba044.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [20.4 kB] 2021-11-12T05:29:43.763 INFO:teuthology.orchestra.run.gibba044.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [526 kB] 2021-11-12T05:29:43.783 INFO:teuthology.orchestra.run.gibba044.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [647 kB] 2021-11-12T05:29:43.803 INFO:teuthology.orchestra.run.gibba044.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [189 kB] 2021-11-12T05:29:43.804 INFO:teuthology.orchestra.run.gibba044.stdout:Get:22 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [75.4 kB] 2021-11-12T05:29:43.807 INFO:teuthology.orchestra.run.gibba044.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [19.5 kB] 2021-11-12T05:29:43.809 INFO:teuthology.orchestra.run.gibba044.stdout:Get:24 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [528 B] 2021-11-12T05:29:43.810 INFO:teuthology.orchestra.run.gibba044.stdout:Get:25 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [515 kB] 2021-11-12T05:29:43.839 INFO:teuthology.orchestra.run.gibba044.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [24.5 kB] 2021-11-12T05:29:43.839 INFO:teuthology.orchestra.run.gibba044.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,204 B] 2021-11-12T05:29:43.840 INFO:teuthology.orchestra.run.gibba044.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,856 B] 2021-11-12T05:29:43.840 INFO:teuthology.orchestra.run.gibba044.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [651 kB] 2021-11-12T05:29:43.841 INFO:teuthology.orchestra.run.gibba044.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2021-11-12T05:29:43.841 INFO:teuthology.orchestra.run.gibba044.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [6,584 B] 2021-11-12T05:29:43.862 INFO:teuthology.orchestra.run.gibba044.stdout:Get:32 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [107 kB] 2021-11-12T05:29:43.864 INFO:teuthology.orchestra.run.gibba044.stdout:Get:33 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [12.9 kB] 2021-11-12T05:29:43.876 INFO:teuthology.orchestra.run.gibba044.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [5,528 B] 2021-11-12T05:29:43.876 INFO:teuthology.orchestra.run.gibba044.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-backports/universe Translation-en [3,292 B] 2021-11-12T05:29:43.916 INFO:teuthology.orchestra.run.gibba044.stdout:Get:36 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [21.9 kB] 2021-11-12T05:29:43.917 INFO:teuthology.orchestra.run.gibba044.stdout:Get:37 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,212 B] 2021-11-12T05:29:43.917 INFO:teuthology.orchestra.run.gibba044.stdout:Get:38 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2021-11-12T05:29:43.958 INFO:teuthology.orchestra.run.gibba044.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [580 B] 2021-11-12T05:29:46.107 INFO:teuthology.orchestra.run.gibba044.stdout:Fetched 8,407 kB in 2s (5,125 kB/s) 2021-11-12T05:29:47.218 INFO:teuthology.orchestra.run.gibba044.stdout:Reading package lists... 2021-11-12T05:29:47.229 DEBUG:teuthology.orchestra.run.gibba044:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-11-12T05:29:47.264 INFO:teuthology.orchestra.run.gibba044.stdout:Reading package lists... 2021-11-12T05:29:47.367 INFO:teuthology.orchestra.run.gibba044.stdout:Building dependency tree... 2021-11-12T05:29:47.368 INFO:teuthology.orchestra.run.gibba044.stdout:Reading state information... 2021-11-12T05:29:47.448 INFO:teuthology.orchestra.run.gibba044.stdout:The following package was automatically installed and is no longer required: 2021-11-12T05:29:47.448 INFO:teuthology.orchestra.run.gibba044.stdout: libllvm11 2021-11-12T05:29:47.448 INFO:teuthology.orchestra.run.gibba044.stdout:Use 'sudo apt autoremove' to remove it. 2021-11-12T05:29:47.449 INFO:teuthology.orchestra.run.gibba044.stdout:The following additional packages will be installed: 2021-11-12T05:29:47.449 INFO:teuthology.orchestra.run.gibba044.stdout: linux-generic linux-headers-5.4.0-90 linux-headers-5.4.0-90-generic 2021-11-12T05:29:47.449 INFO:teuthology.orchestra.run.gibba044.stdout: linux-headers-generic linux-image-5.4.0-90-generic 2021-11-12T05:29:47.450 INFO:teuthology.orchestra.run.gibba044.stdout: linux-modules-5.4.0-90-generic linux-modules-extra-5.4.0-90-generic 2021-11-12T05:29:47.450 INFO:teuthology.orchestra.run.gibba044.stdout:Suggested packages: 2021-11-12T05:29:47.450 INFO:teuthology.orchestra.run.gibba044.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-11-12T05:29:47.451 INFO:teuthology.orchestra.run.gibba044.stdout:Recommended packages: 2021-11-12T05:29:47.451 INFO:teuthology.orchestra.run.gibba044.stdout: thermald 2021-11-12T05:29:47.529 INFO:teuthology.orchestra.run.gibba044.stdout:The following NEW packages will be installed: 2021-11-12T05:29:47.529 INFO:teuthology.orchestra.run.gibba044.stdout: linux-headers-5.4.0-90 linux-headers-5.4.0-90-generic 2021-11-12T05:29:47.529 INFO:teuthology.orchestra.run.gibba044.stdout: linux-image-5.4.0-90-generic linux-modules-5.4.0-90-generic 2021-11-12T05:29:47.530 INFO:teuthology.orchestra.run.gibba044.stdout: linux-modules-extra-5.4.0-90-generic 2021-11-12T05:29:47.530 INFO:teuthology.orchestra.run.gibba044.stdout:The following packages will be upgraded: 2021-11-12T05:29:47.530 INFO:teuthology.orchestra.run.gibba044.stdout: linux-generic linux-headers-generic linux-image-generic 2021-11-12T05:29:47.702 INFO:teuthology.orchestra.run.gibba044.stdout:3 upgraded, 5 newly installed, 0 to remove and 55 not upgraded. 2021-11-12T05:29:47.702 INFO:teuthology.orchestra.run.gibba044.stdout:Need to get 75.6 MB of archives. 2021-11-12T05:29:47.702 INFO:teuthology.orchestra.run.gibba044.stdout:After this operation, 378 MB of additional disk space will be used. 2021-11-12T05:29:47.702 INFO:teuthology.orchestra.run.gibba044.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-90-generic amd64 5.4.0-90.101 [14.8 MB] 2021-11-12T05:29:48.801 INFO:teuthology.orchestra.run.gibba044.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-90-generic amd64 5.4.0-90.101 [8,994 kB] 2021-11-12T05:29:49.001 INFO:teuthology.orchestra.run.gibba044.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-90-generic amd64 5.4.0-90.101 [39.4 MB] 2021-11-12T05:29:50.368 INFO:teuthology.orchestra.run.gibba044.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.90.94 [1,900 B] 2021-11-12T05:29:50.369 INFO:teuthology.orchestra.run.gibba044.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.90.94 [2,580 B] 2021-11-12T05:29:50.369 INFO:teuthology.orchestra.run.gibba044.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-90 all 5.4.0-90.101 [11.0 MB] 2021-11-12T05:29:50.710 INFO:teuthology.orchestra.run.gibba044.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-90-generic amd64 5.4.0-90.101 [1,403 kB] 2021-11-12T05:29:50.748 INFO:teuthology.orchestra.run.gibba044.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.90.94 [2,448 B] 2021-11-12T05:29:50.997 INFO:teuthology.orchestra.run.gibba044.stdout:Fetched 75.6 MB in 3s (23.5 MB/s) 2021-11-12T05:29:51.171 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package linux-modules-5.4.0-90-generic. 2021-11-12T05:29:53.272 INFO:teuthology.orchestra.run.gibba044.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138265 files and directories currently installed.) 2021-11-12T05:29:53.281 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../0-linux-modules-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-12T05:29:53.344 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking linux-modules-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:29:54.917 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package linux-image-5.4.0-90-generic. 2021-11-12T05:29:54.924 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../1-linux-image-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-12T05:29:55.013 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:29:55.970 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-90-generic. 2021-11-12T05:29:55.995 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-12T05:29:56.044 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking linux-modules-extra-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:29:59.400 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../3-linux-generic_5.4.0.90.94_amd64.deb ... 2021-11-12T05:29:59.561 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking linux-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-12T05:29:59.922 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.90.94_amd64.deb ... 2021-11-12T05:30:00.080 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking linux-image-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-12T05:30:00.442 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package linux-headers-5.4.0-90. 2021-11-12T05:30:00.450 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../5-linux-headers-5.4.0-90_5.4.0-90.101_all.deb ... 2021-11-12T05:30:00.524 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking linux-headers-5.4.0-90 (5.4.0-90.101) ... 2021-11-12T05:30:04.020 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package linux-headers-5.4.0-90-generic. 2021-11-12T05:30:04.059 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../6-linux-headers-5.4.0-90-generic_5.4.0-90.101_amd64.deb ... 2021-11-12T05:30:04.103 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking linux-headers-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:30:05.759 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.90.94_amd64.deb ... 2021-11-12T05:30:05.904 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking linux-headers-generic (5.4.0.90.94) over (5.4.0.88.92) ... 2021-11-12T05:30:06.871 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up linux-headers-5.4.0-90 (5.4.0-90.101) ... 2021-11-12T05:30:07.024 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up linux-modules-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:30:07.842 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up linux-headers-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:30:07.968 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up linux-headers-generic (5.4.0.90.94) ... 2021-11-12T05:30:08.110 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:30:08.815 INFO:teuthology.orchestra.run.gibba044.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.4.0-88-generic 2021-11-12T05:30:08.816 INFO:teuthology.orchestra.run.gibba044.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.4.0-88-generic 2021-11-12T05:30:08.816 INFO:teuthology.orchestra.run.gibba044.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-90-generic 2021-11-12T05:30:08.816 INFO:teuthology.orchestra.run.gibba044.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-90-generic 2021-11-12T05:30:08.929 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up linux-modules-extra-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:30:09.706 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up linux-image-generic (5.4.0.90.94) ... 2021-11-12T05:30:09.857 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up linux-generic (5.4.0.90.94) ... 2021-11-12T05:30:10.005 INFO:teuthology.orchestra.run.gibba044.stdout:Processing triggers for linux-image-5.4.0-90-generic (5.4.0-90.101) ... 2021-11-12T05:30:10.156 INFO:teuthology.orchestra.run.gibba044.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-11-12T05:30:10.157 INFO:teuthology.orchestra.run.gibba044.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-90-generic 2021-11-12T05:30:31.109 INFO:teuthology.orchestra.run.gibba044.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-11-12T05:30:31.110 INFO:teuthology.orchestra.run.gibba044.stdout:Sourcing file `/etc/default/grub' 2021-11-12T05:30:31.140 INFO:teuthology.orchestra.run.gibba044.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-11-12T05:30:31.171 INFO:teuthology.orchestra.run.gibba044.stdout:Generating grub configuration file ... 2021-11-12T05:30:31.529 INFO:teuthology.orchestra.run.gibba044.stdout:Found linux image: /boot/vmlinuz-5.4.0-90-generic 2021-11-12T05:30:31.567 INFO:teuthology.orchestra.run.gibba044.stdout:Found initrd image: /boot/initrd.img-5.4.0-90-generic 2021-11-12T05:30:32.080 INFO:teuthology.orchestra.run.gibba044.stdout:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-11-12T05:30:32.094 INFO:teuthology.orchestra.run.gibba044.stdout:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-11-12T05:30:32.248 INFO:teuthology.orchestra.run.gibba044.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-11-12T05:30:32.262 INFO:teuthology.orchestra.run.gibba044.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-11-12T05:30:35.245 INFO:teuthology.orchestra.run.gibba044.stdout:done 2021-11-12T05:30:35.525 DEBUG:teuthology.orchestra.run.gibba044:> dpkg -s linux-image-generic 2021-11-12T05:30:35.542 INFO:teuthology.orchestra.run.gibba044.stdout:Package: linux-image-generic 2021-11-12T05:30:35.542 INFO:teuthology.orchestra.run.gibba044.stdout:Status: install ok installed 2021-11-12T05:30:35.542 INFO:teuthology.orchestra.run.gibba044.stdout:Priority: optional 2021-11-12T05:30:35.543 INFO:teuthology.orchestra.run.gibba044.stdout:Section: kernel 2021-11-12T05:30:35.543 INFO:teuthology.orchestra.run.gibba044.stdout:Installed-Size: 18 2021-11-12T05:30:35.543 INFO:teuthology.orchestra.run.gibba044.stdout:Maintainer: Ubuntu Kernel Team 2021-11-12T05:30:35.543 INFO:teuthology.orchestra.run.gibba044.stdout:Architecture: amd64 2021-11-12T05:30:35.543 INFO:teuthology.orchestra.run.gibba044.stdout:Source: linux-meta 2021-11-12T05:30:35.544 INFO:teuthology.orchestra.run.gibba044.stdout:Version: 5.4.0.90.94 2021-11-12T05:30:35.544 INFO:teuthology.orchestra.run.gibba044.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-11-12T05:30:35.544 INFO:teuthology.orchestra.run.gibba044.stdout:Depends: linux-image-5.4.0-90-generic, linux-modules-extra-5.4.0-90-generic, linux-firmware, intel-microcode, amd64-microcode 2021-11-12T05:30:35.544 INFO:teuthology.orchestra.run.gibba044.stdout:Recommends: thermald 2021-11-12T05:30:35.545 INFO:teuthology.orchestra.run.gibba044.stdout:Description: Generic Linux kernel image 2021-11-12T05:30:35.545 INFO:teuthology.orchestra.run.gibba044.stdout: This package will always depend on the latest generic kernel image 2021-11-12T05:30:35.545 INFO:teuthology.orchestra.run.gibba044.stdout: available. 2021-11-12T05:30:35.545 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-88-generic Expected: 5.4.0-90-generic 2021-11-12T05:30:35.546 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-11-12T05:30:35.546 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-11-12T05:30:35.546 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-11-12T05:30:35.547 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-11-12T05:30:35.547 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-11-12T05:30:35.547 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-11-12T05:30:35.547 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2021-11-12T05:30:35.548 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@gibba005.front.sepia.ceph.com, path=None, version=distro) 2021-11-12T05:30:35.548 DEBUG:teuthology.orchestra.run.gibba005:> sudo apt-get clean 2021-11-12T05:30:35.686 DEBUG:teuthology.orchestra.run.gibba005:> sudo apt-get update 2021-11-12T05:30:35.792 INFO:teuthology.orchestra.run.gibba005.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-11-12T05:30:35.912 INFO:teuthology.orchestra.run.gibba005.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-12T05:30:35.994 INFO:teuthology.orchestra.run.gibba005.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-11-12T05:30:36.077 INFO:teuthology.orchestra.run.gibba005.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-11-12T05:30:36.792 INFO:teuthology.orchestra.run.gibba005.stdout:Reading package lists... 2021-11-12T05:30:36.803 DEBUG:teuthology.orchestra.run.gibba005:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-11-12T05:30:36.848 INFO:teuthology.orchestra.run.gibba005.stdout:Reading package lists... 2021-11-12T05:30:36.951 INFO:teuthology.orchestra.run.gibba005.stdout:Building dependency tree... 2021-11-12T05:30:36.951 INFO:teuthology.orchestra.run.gibba005.stdout:Reading state information... 2021-11-12T05:30:37.029 INFO:teuthology.orchestra.run.gibba005.stdout:linux-image-generic is already the newest version (5.4.0.90.94). 2021-11-12T05:30:37.030 INFO:teuthology.orchestra.run.gibba005.stdout:The following packages were automatically installed and are no longer required: 2021-11-12T05:30:37.030 INFO:teuthology.orchestra.run.gibba005.stdout: libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-12T05:30:37.030 INFO:teuthology.orchestra.run.gibba005.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-12T05:30:37.031 INFO:teuthology.orchestra.run.gibba005.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-12T05:30:37.031 INFO:teuthology.orchestra.run.gibba005.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-12T05:30:37.045 INFO:teuthology.orchestra.run.gibba005.stdout:0 upgraded, 0 newly installed, 0 to remove and 55 not upgraded. 2021-11-12T05:30:37.046 DEBUG:teuthology.orchestra.run.gibba005:> dpkg -s linux-image-generic 2021-11-12T05:30:37.097 INFO:teuthology.orchestra.run.gibba005.stdout:Package: linux-image-generic 2021-11-12T05:30:37.098 INFO:teuthology.orchestra.run.gibba005.stdout:Status: install ok installed 2021-11-12T05:30:37.098 INFO:teuthology.orchestra.run.gibba005.stdout:Priority: optional 2021-11-12T05:30:37.098 INFO:teuthology.orchestra.run.gibba005.stdout:Section: kernel 2021-11-12T05:30:37.098 INFO:teuthology.orchestra.run.gibba005.stdout:Installed-Size: 18 2021-11-12T05:30:37.099 INFO:teuthology.orchestra.run.gibba005.stdout:Maintainer: Ubuntu Kernel Team 2021-11-12T05:30:37.099 INFO:teuthology.orchestra.run.gibba005.stdout:Architecture: amd64 2021-11-12T05:30:37.099 INFO:teuthology.orchestra.run.gibba005.stdout:Source: linux-meta 2021-11-12T05:30:37.099 INFO:teuthology.orchestra.run.gibba005.stdout:Version: 5.4.0.90.94 2021-11-12T05:30:37.100 INFO:teuthology.orchestra.run.gibba005.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-11-12T05:30:37.100 INFO:teuthology.orchestra.run.gibba005.stdout:Depends: linux-image-5.4.0-90-generic, linux-modules-extra-5.4.0-90-generic, linux-firmware, intel-microcode, amd64-microcode 2021-11-12T05:30:37.100 INFO:teuthology.orchestra.run.gibba005.stdout:Recommends: thermald 2021-11-12T05:30:37.101 INFO:teuthology.orchestra.run.gibba005.stdout:Description: Generic Linux kernel image 2021-11-12T05:30:37.101 INFO:teuthology.orchestra.run.gibba005.stdout: This package will always depend on the latest generic kernel image 2021-11-12T05:30:37.101 INFO:teuthology.orchestra.run.gibba005.stdout: available. 2021-11-12T05:30:37.102 DEBUG:teuthology.orchestra.run.gibba005:> mktemp 2021-11-12T05:30:37.107 INFO:teuthology.orchestra.run.gibba005.stdout:/tmp/tmp.ORdkV0fdmH 2021-11-12T05:30:37.107 DEBUG:teuthology.orchestra.run.gibba005:> sudo cp /boot/grub/grub.cfg /tmp/tmp.ORdkV0fdmH 2021-11-12T05:30:37.115 DEBUG:teuthology.orchestra.run.gibba005:> sudo chmod 0666 /tmp/tmp.ORdkV0fdmH 2021-11-12T05:30:37.209 DEBUG:teuthology.orchestra.remote:gibba005:/tmp/tmp.ORdkV0fdmH is 10KB 2021-11-12T05:30:37.218 DEBUG:teuthology.orchestra.run.gibba005:> rm -fr /tmp/tmp.ORdkV0fdmH 2021-11-12T05:30:37.221 DEBUG:teuthology.orchestra.run.gibba005:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-11-12T05:30:37.274 DEBUG:teuthology.orchestra.run.gibba005:> set -ex 2021-11-12T05:30:37.274 DEBUG:teuthology.orchestra.run.gibba005:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-11-12T05:30:37.274 DEBUG:teuthology.orchestra.run.gibba005:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-11-12T05:30:37.322 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-90-generic 2021-11-12T05:30:37.322 DEBUG:teuthology.orchestra.run.gibba005:> sudo update-grub 2021-11-12T05:30:38.548 INFO:teuthology.orchestra.run.gibba005.stderr:Sourcing file `/etc/default/grub' 2021-11-12T05:30:38.550 INFO:teuthology.orchestra.run.gibba005.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-11-12T05:30:38.584 INFO:teuthology.orchestra.run.gibba005.stderr:Generating grub configuration file ... 2021-11-12T05:30:38.893 INFO:teuthology.orchestra.run.gibba005.stderr:Found linux image: /boot/vmlinuz-5.4.0-90-generic 2021-11-12T05:30:38.908 INFO:teuthology.orchestra.run.gibba005.stderr:Found initrd image: /boot/initrd.img-5.4.0-90-generic 2021-11-12T05:30:39.391 INFO:teuthology.orchestra.run.gibba005.stderr:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-11-12T05:30:39.406 INFO:teuthology.orchestra.run.gibba005.stderr:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-11-12T05:30:39.532 INFO:teuthology.orchestra.run.gibba005.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-11-12T05:30:39.548 INFO:teuthology.orchestra.run.gibba005.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-11-12T05:30:41.245 INFO:teuthology.orchestra.run.gibba005.stderr:done 2021-11-12T05:30:41.248 DEBUG:teuthology.orchestra.run.gibba005:> sudo shutdown -r now 2021-11-12T05:30:41.251 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2021-11-12T05:30:41.251 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@gibba015.front.sepia.ceph.com, path=None, version=distro) 2021-11-12T05:30:41.251 DEBUG:teuthology.orchestra.run.gibba015:> sudo apt-get clean 2021-11-12T05:30:41.416 DEBUG:teuthology.orchestra.run.gibba015:> sudo apt-get update 2021-11-12T05:30:41.508 INFO:teuthology.orchestra.run.gibba015.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-11-12T05:30:41.635 INFO:teuthology.orchestra.run.gibba015.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-12T05:30:41.718 INFO:teuthology.orchestra.run.gibba015.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-11-12T05:30:41.800 INFO:teuthology.orchestra.run.gibba015.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-11-12T05:30:42.686 INFO:teuthology.orchestra.run.gibba015.stdout:Reading package lists... 2021-11-12T05:30:42.698 DEBUG:teuthology.orchestra.run.gibba015:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-11-12T05:30:42.733 INFO:teuthology.orchestra.run.gibba015.stdout:Reading package lists... 2021-11-12T05:30:42.837 INFO:teuthology.orchestra.run.gibba015.stdout:Building dependency tree... 2021-11-12T05:30:42.838 INFO:teuthology.orchestra.run.gibba015.stdout:Reading state information... 2021-11-12T05:30:42.915 INFO:teuthology.orchestra.run.gibba015.stdout:linux-image-generic is already the newest version (5.4.0.90.94). 2021-11-12T05:30:42.916 INFO:teuthology.orchestra.run.gibba015.stdout:The following packages were automatically installed and are no longer required: 2021-11-12T05:30:42.916 INFO:teuthology.orchestra.run.gibba015.stdout: libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-12T05:30:42.916 INFO:teuthology.orchestra.run.gibba015.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-12T05:30:42.916 INFO:teuthology.orchestra.run.gibba015.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-12T05:30:42.917 INFO:teuthology.orchestra.run.gibba015.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-12T05:30:42.931 INFO:teuthology.orchestra.run.gibba015.stdout:0 upgraded, 0 newly installed, 0 to remove and 55 not upgraded. 2021-11-12T05:30:42.932 DEBUG:teuthology.orchestra.run.gibba015:> dpkg -s linux-image-generic 2021-11-12T05:30:42.942 INFO:teuthology.orchestra.run.gibba015.stdout:Package: linux-image-generic 2021-11-12T05:30:42.942 INFO:teuthology.orchestra.run.gibba015.stdout:Status: install ok installed 2021-11-12T05:30:42.942 INFO:teuthology.orchestra.run.gibba015.stdout:Priority: optional 2021-11-12T05:30:42.943 INFO:teuthology.orchestra.run.gibba015.stdout:Section: kernel 2021-11-12T05:30:42.943 INFO:teuthology.orchestra.run.gibba015.stdout:Installed-Size: 18 2021-11-12T05:30:42.943 INFO:teuthology.orchestra.run.gibba015.stdout:Maintainer: Ubuntu Kernel Team 2021-11-12T05:30:42.943 INFO:teuthology.orchestra.run.gibba015.stdout:Architecture: amd64 2021-11-12T05:30:42.943 INFO:teuthology.orchestra.run.gibba015.stdout:Source: linux-meta 2021-11-12T05:30:42.944 INFO:teuthology.orchestra.run.gibba015.stdout:Version: 5.4.0.90.94 2021-11-12T05:30:42.944 INFO:teuthology.orchestra.run.gibba015.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-11-12T05:30:42.944 INFO:teuthology.orchestra.run.gibba015.stdout:Depends: linux-image-5.4.0-90-generic, linux-modules-extra-5.4.0-90-generic, linux-firmware, intel-microcode, amd64-microcode 2021-11-12T05:30:42.945 INFO:teuthology.orchestra.run.gibba015.stdout:Recommends: thermald 2021-11-12T05:30:42.945 INFO:teuthology.orchestra.run.gibba015.stdout:Description: Generic Linux kernel image 2021-11-12T05:30:42.945 INFO:teuthology.orchestra.run.gibba015.stdout: This package will always depend on the latest generic kernel image 2021-11-12T05:30:42.945 INFO:teuthology.orchestra.run.gibba015.stdout: available. 2021-11-12T05:30:42.946 DEBUG:teuthology.orchestra.run.gibba015:> mktemp 2021-11-12T05:30:42.987 INFO:teuthology.orchestra.run.gibba015.stdout:/tmp/tmp.AIEnzhjhha 2021-11-12T05:30:42.987 DEBUG:teuthology.orchestra.run.gibba015:> sudo cp /boot/grub/grub.cfg /tmp/tmp.AIEnzhjhha 2021-11-12T05:30:42.995 DEBUG:teuthology.orchestra.run.gibba015:> sudo chmod 0666 /tmp/tmp.AIEnzhjhha 2021-11-12T05:30:43.082 DEBUG:teuthology.orchestra.remote:gibba015:/tmp/tmp.AIEnzhjhha is 10KB 2021-11-12T05:30:43.096 DEBUG:teuthology.orchestra.run.gibba015:> rm -fr /tmp/tmp.AIEnzhjhha 2021-11-12T05:30:43.101 DEBUG:teuthology.orchestra.run.gibba015:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-11-12T05:30:43.152 DEBUG:teuthology.orchestra.run.gibba015:> set -ex 2021-11-12T05:30:43.153 DEBUG:teuthology.orchestra.run.gibba015:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-11-12T05:30:43.153 DEBUG:teuthology.orchestra.run.gibba015:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-11-12T05:30:43.175 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-90-generic 2021-11-12T05:30:43.176 DEBUG:teuthology.orchestra.run.gibba015:> sudo update-grub 2021-11-12T05:30:44.327 INFO:teuthology.orchestra.run.gibba015.stderr:Sourcing file `/etc/default/grub' 2021-11-12T05:30:44.329 INFO:teuthology.orchestra.run.gibba015.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-11-12T05:30:44.347 INFO:teuthology.orchestra.run.gibba015.stderr:Generating grub configuration file ... 2021-11-12T05:30:44.704 INFO:teuthology.orchestra.run.gibba015.stderr:Found linux image: /boot/vmlinuz-5.4.0-90-generic 2021-11-12T05:30:44.718 INFO:teuthology.orchestra.run.gibba015.stderr:Found initrd image: /boot/initrd.img-5.4.0-90-generic 2021-11-12T05:30:45.256 INFO:teuthology.orchestra.run.gibba015.stderr:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-11-12T05:30:45.270 INFO:teuthology.orchestra.run.gibba015.stderr:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-11-12T05:30:45.394 INFO:teuthology.orchestra.run.gibba015.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-11-12T05:30:45.410 INFO:teuthology.orchestra.run.gibba015.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-11-12T05:30:47.152 INFO:teuthology.orchestra.run.gibba015.stderr:done 2021-11-12T05:30:47.153 DEBUG:teuthology.orchestra.run.gibba015:> sudo shutdown -r now 2021-11-12T05:30:47.156 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2021-11-12T05:30:47.156 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@gibba016.front.sepia.ceph.com, path=None, version=distro) 2021-11-12T05:30:47.156 DEBUG:teuthology.orchestra.run.gibba016:> sudo apt-get clean 2021-11-12T05:30:47.306 DEBUG:teuthology.orchestra.run.gibba016:> sudo apt-get update 2021-11-12T05:30:47.520 INFO:teuthology.orchestra.run.gibba016.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-12T05:30:47.521 INFO:teuthology.orchestra.run.gibba016.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-11-12T05:30:47.595 INFO:teuthology.orchestra.run.gibba016.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-11-12T05:30:47.677 INFO:teuthology.orchestra.run.gibba016.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-11-12T05:30:48.564 INFO:teuthology.orchestra.run.gibba016.stdout:Reading package lists... 2021-11-12T05:30:48.575 DEBUG:teuthology.orchestra.run.gibba016:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-11-12T05:30:48.611 INFO:teuthology.orchestra.run.gibba016.stdout:Reading package lists... 2021-11-12T05:30:48.716 INFO:teuthology.orchestra.run.gibba016.stdout:Building dependency tree... 2021-11-12T05:30:48.717 INFO:teuthology.orchestra.run.gibba016.stdout:Reading state information... 2021-11-12T05:30:48.796 INFO:teuthology.orchestra.run.gibba016.stdout:linux-image-generic is already the newest version (5.4.0.90.94). 2021-11-12T05:30:48.796 INFO:teuthology.orchestra.run.gibba016.stdout:The following packages were automatically installed and are no longer required: 2021-11-12T05:30:48.797 INFO:teuthology.orchestra.run.gibba016.stdout: libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-12T05:30:48.797 INFO:teuthology.orchestra.run.gibba016.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-12T05:30:48.797 INFO:teuthology.orchestra.run.gibba016.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-12T05:30:48.797 INFO:teuthology.orchestra.run.gibba016.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-12T05:30:48.812 INFO:teuthology.orchestra.run.gibba016.stdout:0 upgraded, 0 newly installed, 0 to remove and 55 not upgraded. 2021-11-12T05:30:48.814 DEBUG:teuthology.orchestra.run.gibba016:> dpkg -s linux-image-generic 2021-11-12T05:30:48.824 INFO:teuthology.orchestra.run.gibba016.stdout:Package: linux-image-generic 2021-11-12T05:30:48.824 INFO:teuthology.orchestra.run.gibba016.stdout:Status: install ok installed 2021-11-12T05:30:48.824 INFO:teuthology.orchestra.run.gibba016.stdout:Priority: optional 2021-11-12T05:30:48.825 INFO:teuthology.orchestra.run.gibba016.stdout:Section: kernel 2021-11-12T05:30:48.825 INFO:teuthology.orchestra.run.gibba016.stdout:Installed-Size: 18 2021-11-12T05:30:48.825 INFO:teuthology.orchestra.run.gibba016.stdout:Maintainer: Ubuntu Kernel Team 2021-11-12T05:30:48.825 INFO:teuthology.orchestra.run.gibba016.stdout:Architecture: amd64 2021-11-12T05:30:48.825 INFO:teuthology.orchestra.run.gibba016.stdout:Source: linux-meta 2021-11-12T05:30:48.826 INFO:teuthology.orchestra.run.gibba016.stdout:Version: 5.4.0.90.94 2021-11-12T05:30:48.826 INFO:teuthology.orchestra.run.gibba016.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-11-12T05:30:48.826 INFO:teuthology.orchestra.run.gibba016.stdout:Depends: linux-image-5.4.0-90-generic, linux-modules-extra-5.4.0-90-generic, linux-firmware, intel-microcode, amd64-microcode 2021-11-12T05:30:48.826 INFO:teuthology.orchestra.run.gibba016.stdout:Recommends: thermald 2021-11-12T05:30:48.827 INFO:teuthology.orchestra.run.gibba016.stdout:Description: Generic Linux kernel image 2021-11-12T05:30:48.827 INFO:teuthology.orchestra.run.gibba016.stdout: This package will always depend on the latest generic kernel image 2021-11-12T05:30:48.827 INFO:teuthology.orchestra.run.gibba016.stdout: available. 2021-11-12T05:30:48.827 DEBUG:teuthology.orchestra.run.gibba016:> mktemp 2021-11-12T05:30:48.869 INFO:teuthology.orchestra.run.gibba016.stdout:/tmp/tmp.AOZtP0wCQt 2021-11-12T05:30:48.870 DEBUG:teuthology.orchestra.run.gibba016:> sudo cp /boot/grub/grub.cfg /tmp/tmp.AOZtP0wCQt 2021-11-12T05:30:48.880 DEBUG:teuthology.orchestra.run.gibba016:> sudo chmod 0666 /tmp/tmp.AOZtP0wCQt 2021-11-12T05:30:48.913 DEBUG:teuthology.orchestra.remote:gibba016:/tmp/tmp.AOZtP0wCQt is 10KB 2021-11-12T05:30:48.929 DEBUG:teuthology.orchestra.run.gibba016:> rm -fr /tmp/tmp.AOZtP0wCQt 2021-11-12T05:30:48.937 DEBUG:teuthology.orchestra.run.gibba016:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-11-12T05:30:48.997 DEBUG:teuthology.orchestra.run.gibba016:> set -ex 2021-11-12T05:30:48.997 DEBUG:teuthology.orchestra.run.gibba016:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-11-12T05:30:48.998 DEBUG:teuthology.orchestra.run.gibba016:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-11-12T05:30:49.025 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-90-generic 2021-11-12T05:30:49.025 DEBUG:teuthology.orchestra.run.gibba016:> sudo update-grub 2021-11-12T05:30:50.274 INFO:teuthology.orchestra.run.gibba016.stderr:Sourcing file `/etc/default/grub' 2021-11-12T05:30:50.299 INFO:teuthology.orchestra.run.gibba016.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-11-12T05:30:50.328 INFO:teuthology.orchestra.run.gibba016.stderr:Generating grub configuration file ... 2021-11-12T05:30:50.579 INFO:teuthology.orchestra.run.gibba016.stderr:Found linux image: /boot/vmlinuz-5.4.0-90-generic 2021-11-12T05:30:50.593 INFO:teuthology.orchestra.run.gibba016.stderr:Found initrd image: /boot/initrd.img-5.4.0-90-generic 2021-11-12T05:30:51.056 INFO:teuthology.orchestra.run.gibba016.stderr:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-11-12T05:30:51.070 INFO:teuthology.orchestra.run.gibba016.stderr:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-11-12T05:30:51.183 INFO:teuthology.orchestra.run.gibba016.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-11-12T05:30:51.197 INFO:teuthology.orchestra.run.gibba016.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-11-12T05:30:53.059 INFO:teuthology.orchestra.run.gibba016.stderr:done 2021-11-12T05:30:53.061 DEBUG:teuthology.orchestra.run.gibba016:> sudo shutdown -r now 2021-11-12T05:30:53.064 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2021-11-12T05:30:53.065 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@gibba038.front.sepia.ceph.com, path=None, version=distro) 2021-11-12T05:30:53.065 DEBUG:teuthology.orchestra.run.gibba038:> sudo apt-get clean 2021-11-12T05:30:53.249 DEBUG:teuthology.orchestra.run.gibba038:> sudo apt-get update 2021-11-12T05:30:53.531 INFO:teuthology.orchestra.run.gibba038.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-12T05:30:53.532 INFO:teuthology.orchestra.run.gibba038.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-11-12T05:30:53.632 INFO:teuthology.orchestra.run.gibba038.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-11-12T05:30:53.731 INFO:teuthology.orchestra.run.gibba038.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-11-12T05:30:54.455 INFO:teuthology.orchestra.run.gibba038.stdout:Reading package lists... 2021-11-12T05:30:54.466 DEBUG:teuthology.orchestra.run.gibba038:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-11-12T05:30:54.502 INFO:teuthology.orchestra.run.gibba038.stdout:Reading package lists... 2021-11-12T05:30:54.606 INFO:teuthology.orchestra.run.gibba038.stdout:Building dependency tree... 2021-11-12T05:30:54.606 INFO:teuthology.orchestra.run.gibba038.stdout:Reading state information... 2021-11-12T05:30:54.683 INFO:teuthology.orchestra.run.gibba038.stdout:linux-image-generic is already the newest version (5.4.0.90.94). 2021-11-12T05:30:54.684 INFO:teuthology.orchestra.run.gibba038.stdout:The following packages were automatically installed and are no longer required: 2021-11-12T05:30:54.684 INFO:teuthology.orchestra.run.gibba038.stdout: libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-12T05:30:54.684 INFO:teuthology.orchestra.run.gibba038.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-12T05:30:54.684 INFO:teuthology.orchestra.run.gibba038.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-12T05:30:54.685 INFO:teuthology.orchestra.run.gibba038.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-12T05:30:54.698 INFO:teuthology.orchestra.run.gibba038.stdout:0 upgraded, 0 newly installed, 0 to remove and 55 not upgraded. 2021-11-12T05:30:54.700 DEBUG:teuthology.orchestra.run.gibba038:> dpkg -s linux-image-generic 2021-11-12T05:30:54.750 INFO:teuthology.orchestra.run.gibba038.stdout:Package: linux-image-generic 2021-11-12T05:30:54.751 INFO:teuthology.orchestra.run.gibba038.stdout:Status: install ok installed 2021-11-12T05:30:54.751 INFO:teuthology.orchestra.run.gibba038.stdout:Priority: optional 2021-11-12T05:30:54.751 INFO:teuthology.orchestra.run.gibba038.stdout:Section: kernel 2021-11-12T05:30:54.751 INFO:teuthology.orchestra.run.gibba038.stdout:Installed-Size: 18 2021-11-12T05:30:54.752 INFO:teuthology.orchestra.run.gibba038.stdout:Maintainer: Ubuntu Kernel Team 2021-11-12T05:30:54.752 INFO:teuthology.orchestra.run.gibba038.stdout:Architecture: amd64 2021-11-12T05:30:54.752 INFO:teuthology.orchestra.run.gibba038.stdout:Source: linux-meta 2021-11-12T05:30:54.752 INFO:teuthology.orchestra.run.gibba038.stdout:Version: 5.4.0.90.94 2021-11-12T05:30:54.753 INFO:teuthology.orchestra.run.gibba038.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-11-12T05:30:54.753 INFO:teuthology.orchestra.run.gibba038.stdout:Depends: linux-image-5.4.0-90-generic, linux-modules-extra-5.4.0-90-generic, linux-firmware, intel-microcode, amd64-microcode 2021-11-12T05:30:54.753 INFO:teuthology.orchestra.run.gibba038.stdout:Recommends: thermald 2021-11-12T05:30:54.753 INFO:teuthology.orchestra.run.gibba038.stdout:Description: Generic Linux kernel image 2021-11-12T05:30:54.753 INFO:teuthology.orchestra.run.gibba038.stdout: This package will always depend on the latest generic kernel image 2021-11-12T05:30:54.754 INFO:teuthology.orchestra.run.gibba038.stdout: available. 2021-11-12T05:30:54.754 DEBUG:teuthology.orchestra.run.gibba038:> mktemp 2021-11-12T05:30:54.758 INFO:teuthology.orchestra.run.gibba038.stdout:/tmp/tmp.vyKVCvdIny 2021-11-12T05:30:54.758 DEBUG:teuthology.orchestra.run.gibba038:> sudo cp /boot/grub/grub.cfg /tmp/tmp.vyKVCvdIny 2021-11-12T05:30:54.809 DEBUG:teuthology.orchestra.run.gibba038:> sudo chmod 0666 /tmp/tmp.vyKVCvdIny 2021-11-12T05:30:54.847 DEBUG:teuthology.orchestra.remote:gibba038:/tmp/tmp.vyKVCvdIny is 10KB 2021-11-12T05:30:54.864 DEBUG:teuthology.orchestra.run.gibba038:> rm -fr /tmp/tmp.vyKVCvdIny 2021-11-12T05:30:54.872 DEBUG:teuthology.orchestra.run.gibba038:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-11-12T05:30:54.931 DEBUG:teuthology.orchestra.run.gibba038:> set -ex 2021-11-12T05:30:54.931 DEBUG:teuthology.orchestra.run.gibba038:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-11-12T05:30:54.932 DEBUG:teuthology.orchestra.run.gibba038:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-11-12T05:30:54.987 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-90-generic 2021-11-12T05:30:54.987 DEBUG:teuthology.orchestra.run.gibba038:> sudo update-grub 2021-11-12T05:30:56.171 INFO:teuthology.orchestra.run.gibba038.stderr:Sourcing file `/etc/default/grub' 2021-11-12T05:30:56.173 INFO:teuthology.orchestra.run.gibba038.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-11-12T05:30:56.203 INFO:teuthology.orchestra.run.gibba038.stderr:Generating grub configuration file ... 2021-11-12T05:30:56.549 INFO:teuthology.orchestra.run.gibba038.stderr:Found linux image: /boot/vmlinuz-5.4.0-90-generic 2021-11-12T05:30:56.565 INFO:teuthology.orchestra.run.gibba038.stderr:Found initrd image: /boot/initrd.img-5.4.0-90-generic 2021-11-12T05:30:57.038 INFO:teuthology.orchestra.run.gibba038.stderr:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-11-12T05:30:57.054 INFO:teuthology.orchestra.run.gibba038.stderr:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-11-12T05:30:57.178 INFO:teuthology.orchestra.run.gibba038.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-11-12T05:30:57.194 INFO:teuthology.orchestra.run.gibba038.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-11-12T05:30:59.072 INFO:teuthology.orchestra.run.gibba038.stderr:done 2021-11-12T05:30:59.074 DEBUG:teuthology.orchestra.run.gibba038:> sudo shutdown -r now 2021-11-12T05:30:59.077 INFO:teuthology.task.kernel:Installing distro kernel on client.2... 2021-11-12T05:30:59.078 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@gibba044.front.sepia.ceph.com, path=None, version=distro) 2021-11-12T05:30:59.078 DEBUG:teuthology.orchestra.run.gibba044:> sudo apt-get clean 2021-11-12T05:30:59.153 DEBUG:teuthology.orchestra.run.gibba044:> sudo apt-get update 2021-11-12T05:30:59.240 INFO:teuthology.orchestra.run.gibba044.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-11-12T05:30:59.357 INFO:teuthology.orchestra.run.gibba044.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-12T05:30:59.438 INFO:teuthology.orchestra.run.gibba044.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-11-12T05:30:59.522 INFO:teuthology.orchestra.run.gibba044.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-11-12T05:31:00.687 INFO:teuthology.orchestra.run.gibba044.stdout:Reading package lists... 2021-11-12T05:31:00.705 DEBUG:teuthology.orchestra.run.gibba044:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-11-12T05:31:00.774 INFO:teuthology.orchestra.run.gibba044.stdout:Reading package lists... 2021-11-12T05:31:00.876 INFO:teuthology.orchestra.run.gibba044.stdout:Building dependency tree... 2021-11-12T05:31:00.877 INFO:teuthology.orchestra.run.gibba044.stdout:Reading state information... 2021-11-12T05:31:00.953 INFO:teuthology.orchestra.run.gibba044.stdout:linux-image-generic is already the newest version (5.4.0.90.94). 2021-11-12T05:31:00.954 INFO:teuthology.orchestra.run.gibba044.stdout:The following packages were automatically installed and are no longer required: 2021-11-12T05:31:00.954 INFO:teuthology.orchestra.run.gibba044.stdout: libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-12T05:31:00.954 INFO:teuthology.orchestra.run.gibba044.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-12T05:31:00.954 INFO:teuthology.orchestra.run.gibba044.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-12T05:31:00.954 INFO:teuthology.orchestra.run.gibba044.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-12T05:31:00.968 INFO:teuthology.orchestra.run.gibba044.stdout:0 upgraded, 0 newly installed, 0 to remove and 55 not upgraded. 2021-11-12T05:31:00.970 DEBUG:teuthology.orchestra.run.gibba044:> dpkg -s linux-image-generic 2021-11-12T05:31:01.025 INFO:teuthology.orchestra.run.gibba044.stdout:Package: linux-image-generic 2021-11-12T05:31:01.025 INFO:teuthology.orchestra.run.gibba044.stdout:Status: install ok installed 2021-11-12T05:31:01.026 INFO:teuthology.orchestra.run.gibba044.stdout:Priority: optional 2021-11-12T05:31:01.026 INFO:teuthology.orchestra.run.gibba044.stdout:Section: kernel 2021-11-12T05:31:01.026 INFO:teuthology.orchestra.run.gibba044.stdout:Installed-Size: 18 2021-11-12T05:31:01.026 INFO:teuthology.orchestra.run.gibba044.stdout:Maintainer: Ubuntu Kernel Team 2021-11-12T05:31:01.027 INFO:teuthology.orchestra.run.gibba044.stdout:Architecture: amd64 2021-11-12T05:31:01.027 INFO:teuthology.orchestra.run.gibba044.stdout:Source: linux-meta 2021-11-12T05:31:01.027 INFO:teuthology.orchestra.run.gibba044.stdout:Version: 5.4.0.90.94 2021-11-12T05:31:01.027 INFO:teuthology.orchestra.run.gibba044.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.12) 2021-11-12T05:31:01.027 INFO:teuthology.orchestra.run.gibba044.stdout:Depends: linux-image-5.4.0-90-generic, linux-modules-extra-5.4.0-90-generic, linux-firmware, intel-microcode, amd64-microcode 2021-11-12T05:31:01.028 INFO:teuthology.orchestra.run.gibba044.stdout:Recommends: thermald 2021-11-12T05:31:01.028 INFO:teuthology.orchestra.run.gibba044.stdout:Description: Generic Linux kernel image 2021-11-12T05:31:01.028 INFO:teuthology.orchestra.run.gibba044.stdout: This package will always depend on the latest generic kernel image 2021-11-12T05:31:01.028 INFO:teuthology.orchestra.run.gibba044.stdout: available. 2021-11-12T05:31:01.029 DEBUG:teuthology.orchestra.run.gibba044:> mktemp 2021-11-12T05:31:01.037 INFO:teuthology.orchestra.run.gibba044.stdout:/tmp/tmp.4YSm2wgvt5 2021-11-12T05:31:01.037 DEBUG:teuthology.orchestra.run.gibba044:> sudo cp /boot/grub/grub.cfg /tmp/tmp.4YSm2wgvt5 2021-11-12T05:31:01.095 DEBUG:teuthology.orchestra.run.gibba044:> sudo chmod 0666 /tmp/tmp.4YSm2wgvt5 2021-11-12T05:31:01.253 DEBUG:teuthology.orchestra.remote:gibba044:/tmp/tmp.4YSm2wgvt5 is 10KB 2021-11-12T05:31:01.279 DEBUG:teuthology.orchestra.run.gibba044:> rm -fr /tmp/tmp.4YSm2wgvt5 2021-11-12T05:31:01.285 DEBUG:teuthology.orchestra.run.gibba044:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-11-12T05:31:01.341 DEBUG:teuthology.orchestra.run.gibba044:> set -ex 2021-11-12T05:31:01.342 DEBUG:teuthology.orchestra.run.gibba044:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-11-12T05:31:01.342 DEBUG:teuthology.orchestra.run.gibba044:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-11-12T05:31:01.409 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-90-generic 2021-11-12T05:31:01.410 DEBUG:teuthology.orchestra.run.gibba044:> sudo update-grub 2021-11-12T05:31:02.644 INFO:teuthology.orchestra.run.gibba044.stderr:Sourcing file `/etc/default/grub' 2021-11-12T05:31:02.664 INFO:teuthology.orchestra.run.gibba044.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-11-12T05:31:02.688 INFO:teuthology.orchestra.run.gibba044.stderr:Generating grub configuration file ... 2021-11-12T05:31:03.064 INFO:teuthology.orchestra.run.gibba044.stderr:Found linux image: /boot/vmlinuz-5.4.0-90-generic 2021-11-12T05:31:03.079 INFO:teuthology.orchestra.run.gibba044.stderr:Found initrd image: /boot/initrd.img-5.4.0-90-generic 2021-11-12T05:31:03.580 INFO:teuthology.orchestra.run.gibba044.stderr:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2021-11-12T05:31:03.595 INFO:teuthology.orchestra.run.gibba044.stderr:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2021-11-12T05:31:03.719 INFO:teuthology.orchestra.run.gibba044.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-11-12T05:31:03.735 INFO:teuthology.orchestra.run.gibba044.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-11-12T05:31:05.535 INFO:teuthology.orchestra.run.gibba044.stderr:done 2021-11-12T05:31:05.536 DEBUG:teuthology.orchestra.run.gibba044:> sudo shutdown -r now 2021-11-12T05:31:35.569 INFO:teuthology.misc:Re-opening connections... 2021-11-12T05:31:35.570 INFO:teuthology.misc:trying to connect to ubuntu@gibba005.front.sepia.ceph.com 2021-11-12T05:31:35.570 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba005.front.sepia.ceph.com' 2021-11-12T05:31:35.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-12T05:32:53.993 DEBUG:teuthology.orchestra.remote:timed out 2021-11-12T05:32:53.996 INFO:teuthology.misc:trying to connect to ubuntu@gibba015.front.sepia.ceph.com 2021-11-12T05:32:53.998 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba015.front.sepia.ceph.com' 2021-11-12T05:32:53.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba015.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-12T05:32:54.834 DEBUG:teuthology.orchestra.remote:No existing session 2021-11-12T05:32:54.835 INFO:teuthology.misc:trying to connect to ubuntu@gibba016.front.sepia.ceph.com 2021-11-12T05:32:54.836 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba016.front.sepia.ceph.com' 2021-11-12T05:32:54.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-12T05:33:57.959 DEBUG:teuthology.orchestra.remote:timed out 2021-11-12T05:33:57.960 INFO:teuthology.misc:trying to connect to ubuntu@gibba038.front.sepia.ceph.com 2021-11-12T05:33:57.960 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba038.front.sepia.ceph.com' 2021-11-12T05:33:57.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-12T05:33:58.155 DEBUG:teuthology.orchestra.run.gibba038:> true 2021-11-12T05:33:58.654 DEBUG:teuthology.misc:waited 143.08461236953735 2021-11-12T05:33:59.655 INFO:teuthology.misc:trying to connect to ubuntu@gibba005.front.sepia.ceph.com 2021-11-12T05:33:59.656 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba005.front.sepia.ceph.com' 2021-11-12T05:33:59.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-12T05:33:59.992 DEBUG:teuthology.orchestra.run.gibba005:> true 2021-11-12T05:34:00.484 INFO:teuthology.misc:trying to connect to ubuntu@gibba016.front.sepia.ceph.com 2021-11-12T05:34:00.485 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba016.front.sepia.ceph.com' 2021-11-12T05:34:00.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-12T05:34:00.683 DEBUG:teuthology.orchestra.run.gibba016:> true 2021-11-12T05:34:01.203 DEBUG:teuthology.misc:waited 145.63312244415283 2021-11-12T05:34:02.204 INFO:teuthology.misc:trying to connect to ubuntu@gibba015.front.sepia.ceph.com 2021-11-12T05:34:02.205 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba015.front.sepia.ceph.com' 2021-11-12T05:34:02.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba015.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-12T05:34:02.238 DEBUG:teuthology.orchestra.run.gibba015:> true 2021-11-12T05:34:02.819 DEBUG:teuthology.misc:waited 147.24936246871948 2021-11-12T05:34:03.820 INFO:teuthology.misc:trying to connect to ubuntu@gibba044.front.sepia.ceph.com 2021-11-12T05:34:03.820 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba044.front.sepia.ceph.com' 2021-11-12T05:34:03.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-12T05:34:04.026 DEBUG:teuthology.orchestra.run.gibba044:> true 2021-11-12T05:34:04.606 DEBUG:teuthology.misc:waited 149.0365686416626 2021-11-12T05:34:05.607 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2021-11-12T05:34:05.608 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-90-generic"... 2021-11-12T05:34:05.608 DEBUG:teuthology.orchestra.run.gibba005:> uname -r 2021-11-12T05:34:05.617 INFO:teuthology.orchestra.run.gibba005.stdout:5.4.0-90-generic 2021-11-12T05:34:05.618 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-90-generic vs 5.4.0-90-generic 2021-11-12T05:34:05.618 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-11-12T05:34:05.619 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-11-12T05:34:05.619 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2021-11-12T05:34:05.619 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-90-generic"... 2021-11-12T05:34:05.620 DEBUG:teuthology.orchestra.run.gibba015:> uname -r 2021-11-12T05:34:05.629 INFO:teuthology.orchestra.run.gibba015.stdout:5.4.0-90-generic 2021-11-12T05:34:05.629 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-90-generic vs 5.4.0-90-generic 2021-11-12T05:34:05.629 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-11-12T05:34:05.630 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-11-12T05:34:05.630 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2021-11-12T05:34:05.630 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.4.0-90-generic"... 2021-11-12T05:34:05.631 DEBUG:teuthology.orchestra.run.gibba016:> uname -r 2021-11-12T05:34:05.639 INFO:teuthology.orchestra.run.gibba016.stdout:5.4.0-90-generic 2021-11-12T05:34:05.640 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-90-generic vs 5.4.0-90-generic 2021-11-12T05:34:05.640 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-11-12T05:34:05.640 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-11-12T05:34:05.641 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2021-11-12T05:34:05.641 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.4.0-90-generic"... 2021-11-12T05:34:05.641 DEBUG:teuthology.orchestra.run.gibba038:> uname -r 2021-11-12T05:34:05.650 INFO:teuthology.orchestra.run.gibba038.stdout:5.4.0-90-generic 2021-11-12T05:34:05.650 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-90-generic vs 5.4.0-90-generic 2021-11-12T05:34:05.651 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-11-12T05:34:05.651 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-11-12T05:34:05.651 INFO:teuthology.task.kernel:Checking client client.2 for new kernel version... 2021-11-12T05:34:05.652 INFO:teuthology.task.kernel:Checking kernel version of client.2, want "5.4.0-90-generic"... 2021-11-12T05:34:05.652 DEBUG:teuthology.orchestra.run.gibba044:> uname -r 2021-11-12T05:34:05.660 INFO:teuthology.orchestra.run.gibba044.stdout:5.4.0-90-generic 2021-11-12T05:34:05.661 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-90-generic vs 5.4.0-90-generic 2021-11-12T05:34:05.661 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-11-12T05:34:05.661 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-11-12T05:34:06.663 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2021-11-12T05:34:06.663 DEBUG:teuthology.orchestra.run.gibba005:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-11-12T05:34:06.727 INFO:teuthology.orchestra.run.gibba005.stdout:ttyS1 2021-11-12T05:34:06.755 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2021-11-12T05:34:06.755 DEBUG:teuthology.orchestra.run.gibba015:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-11-12T05:34:06.841 INFO:teuthology.orchestra.run.gibba015.stdout:ttyS1 2021-11-12T05:34:06.883 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2021-11-12T05:34:06.883 DEBUG:teuthology.orchestra.run.gibba016:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-11-12T05:34:06.955 INFO:teuthology.orchestra.run.gibba016.stdout:ttyS1 2021-11-12T05:34:06.985 INFO:teuthology.task.kernel:Enabling kdb on client.1... 2021-11-12T05:34:06.986 DEBUG:teuthology.orchestra.run.gibba038:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-11-12T05:34:07.061 INFO:teuthology.orchestra.run.gibba038.stdout:ttyS1 2021-11-12T05:34:07.100 INFO:teuthology.task.kernel:Enabling kdb on client.2... 2021-11-12T05:34:07.101 DEBUG:teuthology.orchestra.run.gibba044:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-11-12T05:34:07.168 INFO:teuthology.orchestra.run.gibba044.stdout:ttyS1 2021-11-12T05:34:07.194 INFO:teuthology.run_tasks:Running task internal.base... 2021-11-12T05:34:07.204 INFO:teuthology.task.internal:Creating test directory... 2021-11-12T05:34:07.205 DEBUG:teuthology.orchestra.run.gibba005:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-11-12T05:34:07.208 DEBUG:teuthology.orchestra.run.gibba015:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-11-12T05:34:07.211 DEBUG:teuthology.orchestra.run.gibba016:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-11-12T05:34:07.215 DEBUG:teuthology.orchestra.run.gibba038:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-11-12T05:34:07.218 DEBUG:teuthology.orchestra.run.gibba044:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-11-12T05:34:07.224 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-11-12T05:34:07.247 INFO:teuthology.run_tasks:Running task internal.archive... 2021-11-12T05:34:07.281 INFO:teuthology.task.internal:Creating archive directory... 2021-11-12T05:34:07.281 DEBUG:teuthology.orchestra.run.gibba005:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-11-12T05:34:07.284 DEBUG:teuthology.orchestra.run.gibba015:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-11-12T05:34:07.286 DEBUG:teuthology.orchestra.run.gibba016:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-11-12T05:34:07.289 DEBUG:teuthology.orchestra.run.gibba038:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-11-12T05:34:07.291 DEBUG:teuthology.orchestra.run.gibba044:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-11-12T05:34:07.343 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-11-12T05:34:07.351 INFO:teuthology.task.internal:Enabling coredump saving... 2021-11-12T05:34:07.351 DEBUG:teuthology.orchestra.run.gibba005:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-11-12T05:34:07.354 DEBUG:teuthology.orchestra.run.gibba015:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-11-12T05:34:07.358 DEBUG:teuthology.orchestra.run.gibba016:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-11-12T05:34:07.361 DEBUG:teuthology.orchestra.run.gibba038:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-11-12T05:34:07.365 DEBUG:teuthology.orchestra.run.gibba044:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-11-12T05:34:07.372 INFO:teuthology.orchestra.run.gibba005.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-12T05:34:07.375 INFO:teuthology.orchestra.run.gibba005.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-12T05:34:07.379 INFO:teuthology.orchestra.run.gibba016.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-12T05:34:07.379 INFO:teuthology.orchestra.run.gibba015.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-12T05:34:07.382 INFO:teuthology.orchestra.run.gibba016.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-12T05:34:07.383 INFO:teuthology.orchestra.run.gibba015.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-12T05:34:07.384 INFO:teuthology.orchestra.run.gibba044.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-12T05:34:07.384 INFO:teuthology.orchestra.run.gibba038.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-12T05:34:07.386 INFO:teuthology.orchestra.run.gibba044.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-12T05:34:07.388 INFO:teuthology.orchestra.run.gibba038.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-12T05:34:07.388 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-11-12T05:34:07.403 INFO:teuthology.task.internal:Configuring sudo... 2021-11-12T05:34:07.404 DEBUG:teuthology.orchestra.run.gibba005:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-11-12T05:34:07.421 DEBUG:teuthology.orchestra.run.gibba015:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-11-12T05:34:07.424 DEBUG:teuthology.orchestra.run.gibba016:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-11-12T05:34:07.426 DEBUG:teuthology.orchestra.run.gibba038:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-11-12T05:34:07.431 DEBUG:teuthology.orchestra.run.gibba044:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-11-12T05:34:07.441 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-11-12T05:34:07.451 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-11-12T05:34:07.452 DEBUG:teuthology.orchestra.run.gibba005:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-11-12T05:34:07.455 DEBUG:teuthology.orchestra.run.gibba015:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-11-12T05:34:07.458 DEBUG:teuthology.orchestra.run.gibba016:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-11-12T05:34:07.477 DEBUG:teuthology.orchestra.run.gibba038:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-11-12T05:34:07.480 DEBUG:teuthology.orchestra.run.gibba044:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-11-12T05:34:07.490 DEBUG:teuthology.orchestra.run.gibba005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-11-12T05:34:07.511 DEBUG:teuthology.orchestra.run.gibba005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-11-12T05:34:07.515 DEBUG:teuthology.orchestra.run.gibba005:> set -ex 2021-11-12T05:34:07.516 DEBUG:teuthology.orchestra.run.gibba005:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-11-12T05:34:07.531 DEBUG:teuthology.orchestra.run.gibba015:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-11-12T05:34:07.540 DEBUG:teuthology.orchestra.run.gibba015:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-11-12T05:34:07.550 DEBUG:teuthology.orchestra.run.gibba015:> set -ex 2021-11-12T05:34:07.550 DEBUG:teuthology.orchestra.run.gibba015:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-11-12T05:34:07.622 DEBUG:teuthology.orchestra.run.gibba016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-11-12T05:34:07.631 DEBUG:teuthology.orchestra.run.gibba016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-11-12T05:34:07.635 DEBUG:teuthology.orchestra.run.gibba016:> set -ex 2021-11-12T05:34:07.636 DEBUG:teuthology.orchestra.run.gibba016:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-11-12T05:34:07.696 DEBUG:teuthology.orchestra.run.gibba038:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-11-12T05:34:07.706 DEBUG:teuthology.orchestra.run.gibba038:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-11-12T05:34:07.753 DEBUG:teuthology.orchestra.run.gibba038:> set -ex 2021-11-12T05:34:07.754 DEBUG:teuthology.orchestra.run.gibba038:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-11-12T05:34:07.766 DEBUG:teuthology.orchestra.run.gibba044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-11-12T05:34:07.775 DEBUG:teuthology.orchestra.run.gibba044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-11-12T05:34:07.779 DEBUG:teuthology.orchestra.run.gibba044:> set -ex 2021-11-12T05:34:07.779 DEBUG:teuthology.orchestra.run.gibba044:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-11-12T05:34:07.803 DEBUG:teuthology.orchestra.run.gibba005:> sudo service rsyslog restart 2021-11-12T05:34:07.806 DEBUG:teuthology.orchestra.run.gibba015:> sudo service rsyslog restart 2021-11-12T05:34:07.810 DEBUG:teuthology.orchestra.run.gibba016:> sudo service rsyslog restart 2021-11-12T05:34:07.813 DEBUG:teuthology.orchestra.run.gibba038:> sudo service rsyslog restart 2021-11-12T05:34:07.816 DEBUG:teuthology.orchestra.run.gibba044:> sudo service rsyslog restart 2021-11-12T05:34:07.897 INFO:teuthology.run_tasks:Running task internal.timer... 2021-11-12T05:34:07.910 INFO:teuthology.task.internal:Starting timer... 2021-11-12T05:34:07.910 INFO:teuthology.run_tasks:Running task pcp... 2021-11-12T05:34:07.959 INFO:teuthology.run_tasks:Running task selinux... 2021-11-12T05:34:07.997 DEBUG:teuthology.task.selinux:Excluding gibba005: OS 'ubuntu' does not support SELinux 2021-11-12T05:34:07.998 DEBUG:teuthology.task.selinux:Excluding gibba015: OS 'ubuntu' does not support SELinux 2021-11-12T05:34:07.998 DEBUG:teuthology.task.selinux:Excluding gibba016: OS 'ubuntu' does not support SELinux 2021-11-12T05:34:07.998 DEBUG:teuthology.task.selinux:Excluding gibba038: OS 'ubuntu' does not support SELinux 2021-11-12T05:34:07.999 DEBUG:teuthology.task.selinux:Excluding gibba044: OS 'ubuntu' does not support SELinux 2021-11-12T05:34:07.999 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-11-12T05:34:07.999 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2021-11-12T05:34:07.999 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-11-12T05:34:08.000 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-11-12T05:34:08.026 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated or references a specific commit; assuming it is current 2021-11-12T05:34:08.027 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-11-12T05:34:08.047 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2021-11-12T05:34:08.049 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit gibba005.front.sepia.ceph.com,gibba015.front.sepia.ceph.com,gibba016.front.sepia.ceph.com,gibba038.front.sepia.ceph.com,gibba044.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-11-12T05:34:08.472 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-11-12T05:34:09.278 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-11-12T05:34:12.162 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-11-12T05:34:12.278 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:12 +0000 (0:00:00.133) 0:00:00.133 ******* 2021-11-12T05:34:12.293 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:12 +0000 (0:00:00.014) 0:00:00.148 ******* 2021-11-12T05:34:12.306 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:12 +0000 (0:00:00.013) 0:00:00.161 ******* 2021-11-12T05:34:12.319 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:12 +0000 (0:00:00.012) 0:00:00.173 ******* 2021-11-12T05:34:12.333 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:12 +0000 (0:00:00.014) 0:00:00.188 ******* 2021-11-12T05:34:14.161 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-11-12T05:34:14.163 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host gibba015.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [gibba015.front.sepia.ceph.com] 2021-11-12T05:34:14.215 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:14 +0000 (0:00:01.882) 0:00:02.070 ******* 2021-11-12T05:34:14.228 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host gibba005.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [gibba005.front.sepia.ceph.com] 2021-11-12T05:34:14.263 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host gibba044.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [gibba044.front.sepia.ceph.com] 2021-11-12T05:34:14.301 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:14 +0000 (0:00:00.086) 0:00:02.156 ******* 2021-11-12T05:34:14.327 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host gibba016.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [gibba016.front.sepia.ceph.com] 2021-11-12T05:34:14.367 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:14 +0000 (0:00:00.066) 0:00:02.222 ******* 2021-11-12T05:34:14.378 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host gibba038.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [gibba038.front.sepia.ceph.com] 2021-11-12T05:34:14.410 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:14 +0000 (0:00:00.042) 0:00:02.265 ******* 2021-11-12T05:34:14.430 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-11-12T05:34:14.432 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-11-12T05:34:14.454 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:14 +0000 (0:00:00.043) 0:00:02.309 ******* 2021-11-12T05:34:14.479 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:14 +0000 (0:00:00.025) 0:00:02.334 ******* 2021-11-12T05:34:14.502 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:14 +0000 (0:00:00.022) 0:00:02.356 ******* 2021-11-12T05:34:14.510 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-11-12T05:34:14.512 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-11-12T05:34:14.536 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:14 +0000 (0:00:00.034) 0:00:02.391 ******* 2021-11-12T05:34:14.557 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:14 +0000 (0:00:00.021) 0:00:02.412 ******* 2021-11-12T05:34:14.607 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-11-12T05:34:14.632 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:14 +0000 (0:00:00.074) 0:00:02.487 ******* 2021-11-12T05:34:14.913 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-11-12T05:34:14.914 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-11-12T05:34:14.937 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:14 +0000 (0:00:00.304) 0:00:02.792 ******* 2021-11-12T05:34:14.944 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-11-12T05:34:14.946 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-11-12T05:34:14.947 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-11-12T05:34:14.972 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:14 +0000 (0:00:00.034) 0:00:02.826 ******* 2021-11-12T05:34:14.992 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:14 +0000 (0:00:00.019) 0:00:02.846 ******* 2021-11-12T05:34:15.013 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:15 +0000 (0:00:00.020) 0:00:02.867 ******* 2021-11-12T05:34:15.020 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-11-12T05:34:15.022 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:15.047 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:15 +0000 (0:00:00.034) 0:00:02.902 ******* 2021-11-12T05:34:15.068 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:15 +0000 (0:00:00.020) 0:00:02.922 ******* 2021-11-12T05:34:15.074 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:15.104 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:15 +0000 (0:00:00.036) 0:00:02.959 ******* 2021-11-12T05:34:15.112 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:15.113 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:15.137 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:15 +0000 (0:00:00.033) 0:00:02.992 ******* 2021-11-12T05:34:15.159 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:15 +0000 (0:00:00.021) 0:00:03.014 ******* 2021-11-12T05:34:15.167 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:15.191 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:15 +0000 (0:00:00.032) 0:00:03.046 ******* 2021-11-12T05:34:15.218 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-11-12T05:34:15.220 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-12T05:34:15.247 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:15 +0000 (0:00:00.055) 0:00:03.102 ******* 2021-11-12T05:34:15.254 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-12T05:34:15.255 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-12T05:34:15.280 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:15 +0000 (0:00:00.033) 0:00:03.135 ******* 2021-11-12T05:34:15.301 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:15 +0000 (0:00:00.020) 0:00:03.155 ******* 2021-11-12T05:34:15.307 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-12T05:34:15.308 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-12T05:34:15.334 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:15 +0000 (0:00:00.033) 0:00:03.189 ******* 2021-11-12T05:34:15.357 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:15 +0000 (0:00:00.022) 0:00:03.211 ******* 2021-11-12T05:34:16.033 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-11-12T05:34:16.035 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "size": 182, "state": "file", "uid": 0} ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "size": 182, "state": "file", "uid": 0} 2021-11-12T05:34:16.057 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:16 +0000 (0:00:00.700) 0:00:03.912 ******* 2021-11-12T05:34:16.083 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:16 +0000 (0:00:00.025) 0:00:03.937 ******* 2021-11-12T05:34:16.091 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "size": 182, "state": "file", "uid": 0} 2021-11-12T05:34:16.092 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "size": 182, "state": "file", "uid": 0} 2021-11-12T05:34:16.093 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "size": 182, "state": "file", "uid": 0} 2021-11-12T05:34:16.118 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:16 +0000 (0:00:00.035) 0:00:03.973 ******* 2021-11-12T05:34:16.140 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:16 +0000 (0:00:00.021) 0:00:03.995 ******* 2021-11-12T05:34:16.162 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:16 +0000 (0:00:00.022) 0:00:04.017 ******* 2021-11-12T05:34:16.529 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-11-12T05:34:16.531 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4 2021-11-12T05:34:16.532 INFO:teuthology.task.ansible.out:r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.c 2021-11-12T05:34:16.534 INFO:teuthology.task.ansible.out:om\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@ak 2021-11-12T05:34:16.535 INFO:teuthology.task.ansible.out:lap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-11-12T05:34:16.569 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4 2021-11-12T05:34:16.571 INFO:teuthology.task.ansible.out:r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.c 2021-11-12T05:34:16.572 INFO:teuthology.task.ansible.out:om\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@ak 2021-11-12T05:34:16.574 INFO:teuthology.task.ansible.out:lap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-11-12T05:34:16.628 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4 2021-11-12T05:34:16.630 INFO:teuthology.task.ansible.out:r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-11-12T05:34:16.719 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** 2021-11-12T05:34:16.720 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2021-11-12T05:34:16.722 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-11-12T05:34:16.738 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* Friday 12 November 2021 05:34:16 +0000 (0:00:00.575) 0:00:04.593 ******* 2021-11-12T05:34:17.154 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] 2021-11-12T05:34:17.220 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] 2021-11-12T05:34:17.241 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] 2021-11-12T05:34:17.262 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] 2021-11-12T05:34:17.273 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] 2021-11-12T05:34:17.293 INFO:teuthology.task.ansible.out: TASK [set_fact] **************************************************************** 2021-11-12T05:34:17.294 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:17 +0000 (0:00:00.554) 0:00:05.148 ******* 2021-11-12T05:34:17.321 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-11-12T05:34:17.343 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-11-12T05:34:17.364 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-11-12T05:34:17.392 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-11-12T05:34:17.403 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-11-12T05:34:17.409 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-11-12T05:34:17.585 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:17 +0000 (0:00:00.292) 0:00:05.440 ******* 2021-11-12T05:34:17.717 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:17 +0000 (0:00:00.031) 0:00:05.471 ******* Friday 12 November 2021 05:34:17 +0000 (0:00:00.030) 0:00:05.502 ******* Friday 12 November 2021 05:34:17 +0000 (0:00:00.033) 0:00:05.536 ******* Friday 12 November 2021 05:34:17 +0000 (0:00:00.024) 0:00:05.561 ******* 2021-11-12T05:34:18.301 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [gibba005.front.sepia.ceph.com] 2021-11-12T05:34:18.362 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. Friday 12 November 2021 05:34:18 +0000 (0:00:00.656) 0:00:06.217 ******* 2021-11-12T05:34:18.376 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] 2021-11-12T05:34:18.599 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] 2021-11-12T05:34:18.610 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] 2021-11-12T05:34:18.620 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] 2021-11-12T05:34:18.674 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:18 +0000 (0:00:00.311) 0:00:06.528 ******* 2021-11-12T05:34:18.724 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:18 +0000 (0:00:00.050) 0:00:06.579 ******* 2021-11-12T05:34:18.751 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:18 +0000 (0:00:00.026) 0:00:06.606 ******* 2021-11-12T05:34:18.782 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:18 +0000 (0:00:00.030) 0:00:06.637 ******* 2021-11-12T05:34:19.090 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-11-12T05:34:19.092 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.198695", "end": "2021-11-12 05:34:19.057037", "rc": 0, "start": "2021-11-12 05:34:18.858342", "stderr": "", "stderr_lines": [], "stdout": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "stdout_lines": ["d72e06d3c78c8d9639a8ca75effa043ee468910f"]} 2021-11-12T05:34:19.116 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:19 +0000 (0:00:00.334) 0:00:06.971 ******* 2021-11-12T05:34:19.159 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.214244", "end": "2021-11-12 05:34:19.130004", "rc": 0, "start": "2021-11-12 05:34:18.915760", "stderr": "", "stderr_lines": [], "stdout": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "stdout_lines": ["d72e06d3c78c8d9639a8ca75effa043ee468910f"]} 2021-11-12T05:34:19.186 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:19 +0000 (0:00:00.068) 0:00:07.040 ******* 2021-11-12T05:34:19.225 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.216633", "end": "2021-11-12 05:34:19.185450", "rc": 0, "start": "2021-11-12 05:34:18.968817", "stderr": "", "stderr_lines": [], "stdout": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "stdout_lines": ["d72e06d3c78c8d9639a8ca75effa043ee468910f"]} 2021-11-12T05:34:19.226 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.183846", "end": "2021-11-12 05:34:19.197781", "rc": 0, "start": "2021-11-12 05:34:19.013935", "stderr": "", "stderr_lines": [], "stdout": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "stdout_lines": ["d72e06d3c78c8d9639a8ca75effa043ee468910f"]} 2021-11-12T05:34:19.227 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.002142", "end": "2021-11-12 05:34:19.206282", "failed_when_result": false, "rc": 0, "start": "2021-11-12 05:34:19.204140", "stderr": "", "stderr_lines": [], "stdout": "be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec", "stdout_lines": ["be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec"]} 2021-11-12T05:34:19.255 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:19 +0000 (0:00:00.069) 0:00:07.110 ******* 2021-11-12T05:34:19.281 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:19 +0000 (0:00:00.025) 0:00:07.135 ******* 2021-11-12T05:34:19.306 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:19 +0000 (0:00:00.025) 0:00:07.161 ******* 2021-11-12T05:34:19.315 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-11-12T05:34:19.317 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.197968", "end": "2021-11-12 05:34:19.212058", "rc": 0, "start": "2021-11-12 05:34:19.014090", "stderr": "", "stderr_lines": [], "stdout": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "stdout_lines": ["d72e06d3c78c8d9639a8ca75effa043ee468910f"]} TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-11-12T05:34:19.317 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.007297", "end": "2021-11-12 05:34:19.228027", "failed_when_result": false, "rc": 0, "start": "2021-11-12 05:34:19.220730", "stderr": "", "stderr_lines": [], "stdout": "be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec", "stdout_lines": ["be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec"]} 2021-11-12T05:34:19.349 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:19 +0000 (0:00:00.041) 0:00:07.203 ******* 2021-11-12T05:34:19.376 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:19 +0000 (0:00:00.027) 0:00:07.230 ******* 2021-11-12T05:34:19.384 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-11-12T05:34:19.386 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:19.421 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:19 +0000 (0:00:00.045) 0:00:07.276 ******* 2021-11-12T05:34:19.430 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-11-12T05:34:19.432 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.015208", "end": "2021-11-12 05:34:19.523966", "failed_when_result": false, "rc": 0, "start": "2021-11-12 05:34:19.508758", "stderr": "", "stderr_lines": [], "stdout": "be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec", "stdout_lines": ["be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec"]} TASK [Determine if we can skip users and pubkeys updates] ********************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:19.433 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [gibba016.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.008304", "end": "2021-11-12 05:34:19.111883", "failed_when_result": false, "rc": 0, "start": "2021-11-12 05:34:19.103579", "stderr": "", "stderr_lines": [], "stdout": "be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec", "stdout_lines": ["be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec"]} 2021-11-12T05:34:19.460 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:19 +0000 (0:00:00.038) 0:00:07.315 ******* 2021-11-12T05:34:19.485 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:19 +0000 (0:00:00.024) 0:00:07.339 ******* 2021-11-12T05:34:19.512 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:19 +0000 (0:00:00.026) 0:00:07.366 ******* 2021-11-12T05:34:19.523 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.010682", "end": "2021-11-12 05:34:19.231386", "failed_when_result": false, "rc": 0, "start": "2021-11-12 05:34:19.220704", "stderr": "", "stderr_lines": [], "stdout": "be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec", "stdout_lines": ["be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec"]} 2021-11-12T05:34:19.525 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:19.526 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:19.553 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:19 +0000 (0:00:00.041) 0:00:07.408 ******* 2021-11-12T05:34:19.576 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:19 +0000 (0:00:00.022) 0:00:07.430 ******* 2021-11-12T05:34:19.599 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:19 +0000 (0:00:00.023) 0:00:07.454 ******* 2021-11-12T05:34:19.607 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:19.609 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:19.634 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:19 +0000 (0:00:00.034) 0:00:07.489 ******* 2021-11-12T05:34:19.657 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:19 +0000 (0:00:00.022) 0:00:07.512 ******* 2021-11-12T05:34:19.665 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-11-12T05:34:19.667 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Merge extra_admin_users into managed_admin_users] ************************ skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:19.692 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:19 +0000 (0:00:00.034) 0:00:07.546 ******* 2021-11-12T05:34:19.714 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:19 +0000 (0:00:00.022) 0:00:07.569 ******* 2021-11-12T05:34:19.721 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-11-12T05:34:19.723 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Merge extra_admin_users into managed_admin_users] ************************ skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:19.749 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:19 +0000 (0:00:00.034) 0:00:07.603 ******* 2021-11-12T05:34:19.781 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:19 +0000 (0:00:00.031) 0:00:07.635 ******* 2021-11-12T05:34:19.788 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-11-12T05:34:19.790 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Filter the managed_users list] ******************************************* skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Remove managed_admin_users from managed_users] *************************** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:19.817 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:19 +0000 (0:00:00.036) 0:00:07.672 ******* 2021-11-12T05:34:19.841 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:19 +0000 (0:00:00.024) 0:00:07.696 ******* 2021-11-12T05:34:19.867 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:19 +0000 (0:00:00.025) 0:00:07.722 ******* 2021-11-12T05:34:19.877 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:19.878 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:19.878 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:19.905 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:19 +0000 (0:00:00.037) 0:00:07.760 ******* 2021-11-12T05:34:19.928 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:19 +0000 (0:00:00.022) 0:00:07.783 ******* 2021-11-12T05:34:19.951 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:19 +0000 (0:00:00.023) 0:00:07.806 ******* 2021-11-12T05:34:19.959 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* 2021-11-12T05:34:19.960 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:19.986 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:19 +0000 (0:00:00.034) 0:00:07.841 ******* 2021-11-12T05:34:20.009 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:20 +0000 (0:00:00.023) 0:00:07.864 ******* 2021-11-12T05:34:20.017 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:20.044 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:20 +0000 (0:00:00.034) 0:00:07.898 ******* 2021-11-12T05:34:20.052 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-11-12T05:34:20.053 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Set UID_MIN to 1001] ********************************************* 2021-11-12T05:34:20.054 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-12T05:34:20.054 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-11-12T05:34:20.055 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:20.082 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:20 +0000 (0:00:00.038) 0:00:07.936 ******* 2021-11-12T05:34:20.104 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:20 +0000 (0:00:00.021) 0:00:07.958 ******* 2021-11-12T05:34:20.136 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:20 +0000 (0:00:00.031) 0:00:07.990 ******* 2021-11-12T05:34:20.144 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:20.146 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:20.175 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:20 +0000 (0:00:00.038) 0:00:08.029 ******* 2021-11-12T05:34:20.200 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:20 +0000 (0:00:00.024) 0:00:08.054 ******* 2021-11-12T05:34:20.209 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* 2021-11-12T05:34:20.211 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:20.237 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:20 +0000 (0:00:00.037) 0:00:08.092 ******* 2021-11-12T05:34:20.255 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-11-12T05:34:20.257 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-12T05:34:20.282 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:20 +0000 (0:00:00.044) 0:00:08.136 ******* 2021-11-12T05:34:20.289 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-11-12T05:34:20.291 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-11-12T05:34:20.312 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:20.347 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:20 +0000 (0:00:00.065) 0:00:08.202 ******* 2021-11-12T05:34:20.355 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-11-12T05:34:20.357 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-12T05:34:20.383 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:20 +0000 (0:00:00.035) 0:00:08.238 ******* 2021-11-12T05:34:20.390 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-12T05:34:20.391 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-11-12T05:34:20.392 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-11-12T05:34:20.418 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:20 +0000 (0:00:00.034) 0:00:08.273 ******* 2021-11-12T05:34:20.466 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-11-12T05:34:20.478 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-11-12T05:34:20.489 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-11-12T05:34:20.491 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-12T05:34:20.514 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:20 +0000 (0:00:00.096) 0:00:08.369 ******* 2021-11-12T05:34:20.563 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-11-12T05:34:20.564 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-11-12T05:34:20.577 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-11-12T05:34:20.579 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-11-12T05:34:20.665 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-11-12T05:34:20.666 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-11-12T05:34:20.677 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-11-12T05:34:20.678 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-11-12T05:34:20.711 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-11-12T05:34:20.765 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-11-12T05:34:20.767 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-11-12T05:34:20.778 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-11-12T05:34:20.790 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-11-12T05:34:20.811 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-11-12T05:34:20.854 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-11-12T05:34:20.855 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-11-12T05:34:20.867 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-11-12T05:34:20.879 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-11-12T05:34:20.901 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-11-12T05:34:20.946 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-11-12T05:34:20.948 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-11-12T05:34:20.960 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-11-12T05:34:20.973 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-11-12T05:34:20.996 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-11-12T05:34:21.039 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-11-12T05:34:21.051 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-11-12T05:34:21.063 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-11-12T05:34:21.085 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-11-12T05:34:21.107 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-11-12T05:34:21.129 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-11-12T05:34:21.140 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-11-12T05:34:21.152 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-11-12T05:34:21.185 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-11-12T05:34:21.207 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-11-12T05:34:21.230 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-11-12T05:34:21.231 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-11-12T05:34:21.254 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-11-12T05:34:21.276 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-11-12T05:34:21.309 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-11-12T05:34:21.320 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-11-12T05:34:21.321 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-11-12T05:34:21.344 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-11-12T05:34:21.367 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-11-12T05:34:21.411 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-11-12T05:34:21.412 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-11-12T05:34:21.414 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-11-12T05:34:21.435 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-11-12T05:34:21.468 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-11-12T05:34:21.511 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-11-12T05:34:21.512 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-11-12T05:34:21.516 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-11-12T05:34:21.535 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-11-12T05:34:21.557 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-11-12T05:34:21.600 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-11-12T05:34:21.601 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-11-12T05:34:21.623 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-11-12T05:34:21.646 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-11-12T05:34:21.657 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-11-12T05:34:21.689 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-11-12T05:34:21.701 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-11-12T05:34:21.715 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-11-12T05:34:21.737 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-11-12T05:34:21.748 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-11-12T05:34:21.792 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-11-12T05:34:21.794 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-11-12T05:34:21.805 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-11-12T05:34:21.826 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-11-12T05:34:21.838 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-11-12T05:34:21.882 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-11-12T05:34:21.893 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-11-12T05:34:21.905 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-11-12T05:34:21.917 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-11-12T05:34:21.946 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-11-12T05:34:21.979 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-11-12T05:34:21.990 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-11-12T05:34:22.002 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-11-12T05:34:22.025 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-11-12T05:34:22.036 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-11-12T05:34:22.080 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-11-12T05:34:22.092 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-11-12T05:34:22.103 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-11-12T05:34:22.115 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-11-12T05:34:22.137 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-11-12T05:34:22.170 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-11-12T05:34:22.193 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-11-12T05:34:22.195 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-11-12T05:34:22.218 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-11-12T05:34:22.240 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-11-12T05:34:22.262 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-11-12T05:34:22.285 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-11-12T05:34:22.297 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-11-12T05:34:22.309 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-11-12T05:34:22.343 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-11-12T05:34:22.380 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-11-12T05:34:22.384 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-11-12T05:34:22.404 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-11-12T05:34:22.415 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-11-12T05:34:22.448 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-11-12T05:34:22.491 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-11-12T05:34:22.492 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-11-12T05:34:22.504 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-11-12T05:34:22.506 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-11-12T05:34:22.540 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-11-12T05:34:22.595 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-11-12T05:34:22.597 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-11-12T05:34:22.599 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-11-12T05:34:22.600 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-11-12T05:34:22.633 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-11-12T05:34:22.688 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-11-12T05:34:22.700 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-11-12T05:34:22.702 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-11-12T05:34:22.702 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-11-12T05:34:22.736 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-11-12T05:34:22.781 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-11-12T05:34:22.792 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-11-12T05:34:22.793 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-11-12T05:34:22.795 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-11-12T05:34:22.837 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-11-12T05:34:22.880 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-11-12T05:34:22.892 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-11-12T05:34:22.893 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-11-12T05:34:22.894 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-11-12T05:34:22.927 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-11-12T05:34:22.980 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-11-12T05:34:22.981 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-11-12T05:34:22.983 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-11-12T05:34:22.983 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-11-12T05:34:23.016 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-11-12T05:34:23.080 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-11-12T05:34:23.081 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-11-12T05:34:23.082 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-11-12T05:34:23.115 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-11-12T05:34:23.116 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-11-12T05:34:23.169 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-11-12T05:34:23.181 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-11-12T05:34:23.204 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-11-12T05:34:23.205 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-11-12T05:34:23.217 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-11-12T05:34:23.260 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-11-12T05:34:23.271 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-11-12T05:34:23.294 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-11-12T05:34:23.305 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-11-12T05:34:23.306 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-11-12T05:34:23.360 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-11-12T05:34:23.392 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-11-12T05:34:23.393 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-11-12T05:34:23.405 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-11-12T05:34:23.417 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-11-12T05:34:23.450 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-11-12T05:34:23.494 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-11-12T05:34:23.495 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-11-12T05:34:23.496 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-11-12T05:34:23.507 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-11-12T05:34:23.540 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-11-12T05:34:23.583 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-11-12T05:34:23.584 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-11-12T05:34:23.596 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-11-12T05:34:23.597 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-11-12T05:34:23.640 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-11-12T05:34:23.683 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-11-12T05:34:23.684 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-11-12T05:34:23.696 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-11-12T05:34:23.697 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-11-12T05:34:23.771 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-11-12T05:34:23.773 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-11-12T05:34:23.775 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-11-12T05:34:23.786 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-11-12T05:34:23.798 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-11-12T05:34:23.861 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-11-12T05:34:23.873 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-11-12T05:34:23.874 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-11-12T05:34:23.876 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-11-12T05:34:23.888 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-11-12T05:34:23.961 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-11-12T05:34:23.962 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-11-12T05:34:23.964 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-11-12T05:34:23.975 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-11-12T05:34:23.987 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-11-12T05:34:24.061 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-11-12T05:34:24.063 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-11-12T05:34:24.074 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-11-12T05:34:24.086 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-11-12T05:34:24.097 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-11-12T05:34:24.161 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-11-12T05:34:24.172 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-11-12T05:34:24.174 INFO:teuthology.task.ansible.out: 2021-11-12T05:34:24.184 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-11-12T05:34:24.185 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-11-12T05:34:24.197 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-11-12T05:34:24.198 INFO:teuthology.task.ansible.out: 2021-11-12T05:34:24.262 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-11-12T05:34:24.273 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-11-12T05:34:24.274 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-11-12T05:34:24.286 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-11-12T05:34:24.287 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-11-12T05:34:24.351 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-11-12T05:34:24.387 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-11-12T05:34:24.389 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-11-12T05:34:24.391 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-11-12T05:34:24.403 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-11-12T05:34:24.456 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-11-12T05:34:24.489 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-11-12T05:34:24.490 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-11-12T05:34:24.492 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-11-12T05:34:24.493 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-11-12T05:34:24.546 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-11-12T05:34:24.589 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-11-12T05:34:24.590 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-11-12T05:34:24.623 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-11-12T05:34:24.624 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-11-12T05:34:24.646 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-11-12T05:34:24.679 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-11-12T05:34:24.691 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-11-12T05:34:24.713 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-11-12T05:34:24.724 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-11-12T05:34:24.737 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-11-12T05:34:24.780 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-11-12T05:34:24.782 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-11-12T05:34:24.813 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-11-12T05:34:24.825 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-11-12T05:34:24.837 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-11-12T05:34:24.870 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-11-12T05:34:24.872 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-11-12T05:34:24.916 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-11-12T05:34:24.917 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-11-12T05:34:24.929 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-11-12T05:34:24.962 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-11-12T05:34:24.963 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-11-12T05:34:24.965 INFO:teuthology.task.ansible.out: 2021-11-12T05:34:25.007 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-11-12T05:34:25.018 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-11-12T05:34:25.030 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-11-12T05:34:25.064 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-11-12T05:34:25.066 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-11-12T05:34:25.097 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-11-12T05:34:25.109 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-11-12T05:34:25.121 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-11-12T05:34:25.165 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-11-12T05:34:25.167 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-11-12T05:34:25.199 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-11-12T05:34:25.200 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-11-12T05:34:25.222 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-11-12T05:34:25.254 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-11-12T05:34:25.266 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-11-12T05:34:25.288 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-11-12T05:34:25.289 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-11-12T05:34:25.311 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-11-12T05:34:25.355 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-11-12T05:34:25.355 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-11-12T05:34:25.388 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-11-12T05:34:25.389 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-11-12T05:34:25.411 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-11-12T05:34:25.454 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-11-12T05:34:25.455 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-11-12T05:34:25.477 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-11-12T05:34:25.530 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-11-12T05:34:25.542 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-11-12T05:34:25.553 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-11-12T05:34:25.554 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-11-12T05:34:25.577 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-11-12T05:34:25.630 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-11-12T05:34:25.632 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-11-12T05:34:25.643 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-11-12T05:34:25.645 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-11-12T05:34:25.667 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-11-12T05:34:25.721 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-11-12T05:34:25.732 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-11-12T05:34:25.734 INFO:teuthology.task.ansible.out: 2021-11-12T05:34:25.745 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-11-12T05:34:25.757 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-11-12T05:34:25.789 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-11-12T05:34:25.822 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-11-12T05:34:25.844 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-11-12T05:34:25.846 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-11-12T05:34:25.857 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-11-12T05:34:25.890 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-11-12T05:34:25.923 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-11-12T05:34:25.934 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-11-12T05:34:25.946 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-11-12T05:34:25.958 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-11-12T05:34:25.981 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-11-12T05:34:26.013 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-11-12T05:34:26.035 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-11-12T05:34:26.036 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-11-12T05:34:26.048 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-11-12T05:34:26.112 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-11-12T05:34:26.123 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-11-12T05:34:26.124 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-11-12T05:34:26.136 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-11-12T05:34:26.148 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-11-12T05:34:26.201 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-11-12T05:34:26.224 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-11-12T05:34:26.225 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-11-12T05:34:26.227 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-11-12T05:34:26.248 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-11-12T05:34:26.301 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-11-12T05:34:26.313 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-11-12T05:34:26.314 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-11-12T05:34:26.329 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-11-12T05:34:26.341 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-11-12T05:34:26.410 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-11-12T05:34:26.413 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-11-12T05:34:26.424 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-11-12T05:34:26.435 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-11-12T05:34:26.510 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-11-12T05:34:26.510 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-11-12T05:34:26.522 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-11-12T05:34:26.523 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-11-12T05:34:26.536 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-11-12T05:34:26.600 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-11-12T05:34:26.601 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-11-12T05:34:26.613 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-11-12T05:34:26.625 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-11-12T05:34:26.626 INFO:teuthology.task.ansible.out: 2021-11-12T05:34:26.637 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-11-12T05:34:26.703 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-11-12T05:34:26.705 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-11-12T05:34:26.718 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-11-12T05:34:26.731 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-11-12T05:34:26.733 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-11-12T05:34:26.799 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-11-12T05:34:26.800 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-11-12T05:34:26.822 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-11-12T05:34:26.834 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-11-12T05:34:26.835 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-11-12T05:34:26.899 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-11-12T05:34:26.900 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-11-12T05:34:26.922 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-11-12T05:34:26.924 INFO:teuthology.task.ansible.out: ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-11-12T05:34:26.936 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-11-12T05:34:26.990 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-11-12T05:34:27.002 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-11-12T05:34:27.035 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-11-12T05:34:27.037 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-11-12T05:34:27.090 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-11-12T05:34:27.102 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-11-12T05:34:27.124 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-11-12T05:34:27.125 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-11-12T05:34:27.127 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-11-12T05:34:27.190 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-11-12T05:34:27.191 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-11-12T05:34:27.224 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-11-12T05:34:27.225 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-11-12T05:34:27.236 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-11-12T05:34:27.279 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-11-12T05:34:27.280 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-11-12T05:34:27.323 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-11-12T05:34:27.324 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-11-12T05:34:27.326 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-11-12T05:34:27.379 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-11-12T05:34:27.380 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-11-12T05:34:27.412 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-11-12T05:34:27.413 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-11-12T05:34:27.415 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-11-12T05:34:27.478 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-11-12T05:34:27.479 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-11-12T05:34:27.512 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-11-12T05:34:27.514 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-11-12T05:34:27.516 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-11-12T05:34:27.563 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-11-12T05:34:27.574 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-11-12T05:34:27.607 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-11-12T05:34:27.608 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-11-12T05:34:27.609 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-11-12T05:34:27.662 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-11-12T05:34:27.663 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-11-12T05:34:27.696 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-11-12T05:34:27.707 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-11-12T05:34:27.740 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-11-12T05:34:27.752 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-11-12T05:34:27.763 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-11-12T05:34:27.798 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-11-12T05:34:27.799 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-11-12T05:34:27.832 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-11-12T05:34:27.844 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-11-12T05:34:27.855 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-11-12T05:34:27.888 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-11-12T05:34:27.902 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-11-12T05:34:27.924 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-11-12T05:34:27.947 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-11-12T05:34:27.948 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-11-12T05:34:27.981 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-11-12T05:34:28.014 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-11-12T05:34:28.036 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-11-12T05:34:28.047 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-11-12T05:34:28.048 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-11-12T05:34:28.081 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-11-12T05:34:28.104 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-11-12T05:34:28.126 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-11-12T05:34:28.138 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-11-12T05:34:28.139 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-11-12T05:34:28.184 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-11-12T05:34:28.206 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-11-12T05:34:28.217 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-11-12T05:34:28.271 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-11-12T05:34:28.272 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-11-12T05:34:28.284 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-11-12T05:34:28.306 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-11-12T05:34:28.307 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-11-12T05:34:28.360 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-11-12T05:34:28.361 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-11-12T05:34:28.373 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-11-12T05:34:28.406 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-11-12T05:34:28.448 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-11-12T05:34:28.459 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-11-12T05:34:28.471 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-11-12T05:34:28.483 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-11-12T05:34:28.526 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-11-12T05:34:28.537 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-11-12T05:34:28.549 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-11-12T05:34:28.560 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-11-12T05:34:28.572 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-11-12T05:34:28.625 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-11-12T05:34:28.637 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-11-12T05:34:28.669 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-11-12T05:34:28.691 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-11-12T05:34:28.692 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-11-12T05:34:28.725 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-11-12T05:34:28.737 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-11-12T05:34:28.759 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-11-12T05:34:28.781 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-11-12T05:34:28.815 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-11-12T05:34:28.837 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-11-12T05:34:28.838 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-11-12T05:34:28.860 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-11-12T05:34:28.871 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-11-12T05:34:28.916 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-11-12T05:34:28.929 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-11-12T05:34:28.930 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-11-12T05:34:28.953 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-11-12T05:34:28.965 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-11-12T05:34:29.018 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-11-12T05:34:29.030 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-11-12T05:34:29.031 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-11-12T05:34:29.053 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-11-12T05:34:29.065 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-11-12T05:34:29.109 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-11-12T05:34:29.121 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-11-12T05:34:29.122 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-11-12T05:34:29.155 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-11-12T05:34:29.156 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-11-12T05:34:29.210 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-11-12T05:34:29.211 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-11-12T05:34:29.213 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-11-12T05:34:29.245 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-11-12T05:34:29.246 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-11-12T05:34:29.299 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-11-12T05:34:29.311 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-11-12T05:34:29.312 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-11-12T05:34:29.344 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-11-12T05:34:29.377 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-11-12T05:34:29.399 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-11-12T05:34:29.401 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-11-12T05:34:29.413 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-11-12T05:34:29.445 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-11-12T05:34:29.469 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-11-12T05:34:29.491 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-11-12T05:34:29.503 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-11-12T05:34:29.525 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-11-12T05:34:29.537 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-11-12T05:34:29.560 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-11-12T05:34:29.582 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-11-12T05:34:29.593 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-11-12T05:34:29.637 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-11-12T05:34:29.638 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-11-12T05:34:29.660 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-11-12T05:34:29.692 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-11-12T05:34:29.694 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-11-12T05:34:29.726 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-11-12T05:34:29.727 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-11-12T05:34:29.760 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-11-12T05:34:29.793 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-11-12T05:34:29.795 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-11-12T05:34:29.816 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-11-12T05:34:29.849 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-11-12T05:34:29.860 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-11-12T05:34:29.882 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-11-12T05:34:29.894 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-11-12T05:34:29.927 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-11-12T05:34:29.949 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-11-12T05:34:29.961 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-11-12T05:34:29.983 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-11-12T05:34:29.984 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-11-12T05:34:30.017 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-11-12T05:34:30.049 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-11-12T05:34:30.061 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-11-12T05:34:30.072 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-11-12T05:34:30.084 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-11-12T05:34:30.107 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-11-12T05:34:30.141 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-11-12T05:34:30.153 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-11-12T05:34:30.165 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-11-12T05:34:30.177 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-11-12T05:34:30.210 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-11-12T05:34:30.244 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-11-12T05:34:30.245 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-11-12T05:34:30.269 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-11-12T05:34:30.271 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-11-12T05:34:30.304 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-11-12T05:34:30.337 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-11-12T05:34:30.349 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-11-12T05:34:30.361 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-11-12T05:34:30.373 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-11-12T05:34:30.396 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-11-12T05:34:30.429 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-11-12T05:34:30.461 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-11-12T05:34:30.462 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-11-12T05:34:30.484 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-11-12T05:34:30.486 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-11-12T05:34:30.529 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-11-12T05:34:30.562 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-11-12T05:34:30.563 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-11-12T05:34:30.585 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-11-12T05:34:30.596 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-11-12T05:34:30.619 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-11-12T05:34:30.662 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-11-12T05:34:30.663 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-11-12T05:34:30.685 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-11-12T05:34:30.686 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-11-12T05:34:30.719 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-11-12T05:34:30.762 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-11-12T05:34:30.763 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-11-12T05:34:30.775 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-11-12T05:34:30.777 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-11-12T05:34:30.808 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-11-12T05:34:30.853 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-11-12T05:34:30.864 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-11-12T05:34:30.876 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-11-12T05:34:30.911 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-11-12T05:34:30.944 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-11-12T05:34:30.945 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-11-12T05:34:30.968 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-11-12T05:34:30.969 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-11-12T05:34:31.012 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-11-12T05:34:31.044 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-11-12T05:34:31.045 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-11-12T05:34:31.068 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-11-12T05:34:31.069 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-11-12T05:34:31.101 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-11-12T05:34:31.144 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-11-12T05:34:31.145 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-11-12T05:34:31.168 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-11-12T05:34:31.168 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-11-12T05:34:31.201 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-11-12T05:34:31.234 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-11-12T05:34:31.245 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-11-12T05:34:31.258 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-11-12T05:34:31.260 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-11-12T05:34:31.302 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-11-12T05:34:31.324 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-11-12T05:34:31.346 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-11-12T05:34:31.347 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-11-12T05:34:31.359 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-11-12T05:34:31.391 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-11-12T05:34:31.424 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-11-12T05:34:31.446 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-11-12T05:34:31.447 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-11-12T05:34:31.459 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-11-12T05:34:31.491 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-11-12T05:34:31.524 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-11-12T05:34:31.536 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-11-12T05:34:31.547 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-11-12T05:34:31.548 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-11-12T05:34:31.602 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-11-12T05:34:31.614 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-11-12T05:34:31.636 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-11-12T05:34:31.637 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-11-12T05:34:31.648 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-11-12T05:34:31.691 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-11-12T05:34:31.714 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-11-12T05:34:31.725 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-11-12T05:34:31.727 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-11-12T05:34:31.739 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-11-12T05:34:31.792 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-11-12T05:34:31.815 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-11-12T05:34:31.826 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-11-12T05:34:31.848 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-11-12T05:34:31.860 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-11-12T05:34:31.882 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-11-12T05:34:31.915 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-11-12T05:34:31.916 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-11-12T05:34:31.959 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-11-12T05:34:31.982 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-11-12T05:34:31.983 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-11-12T05:34:32.005 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-11-12T05:34:32.049 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-11-12T05:34:32.051 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-11-12T05:34:32.073 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-11-12T05:34:32.107 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-11-12T05:34:32.118 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-11-12T05:34:32.141 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-11-12T05:34:32.142 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-11-12T05:34:32.164 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-11-12T05:34:32.197 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-11-12T05:34:32.209 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-11-12T05:34:32.233 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-11-12T05:34:32.244 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-11-12T05:34:32.266 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-11-12T05:34:32.303 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-11-12T05:34:32.315 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-11-12T05:34:32.328 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-11-12T05:34:32.339 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-11-12T05:34:32.372 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-11-12T05:34:32.395 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-11-12T05:34:32.416 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-11-12T05:34:32.417 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-11-12T05:34:32.439 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-11-12T05:34:32.463 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-11-12T05:34:32.485 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-11-12T05:34:32.518 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-11-12T05:34:32.540 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-11-12T05:34:32.553 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-11-12T05:34:32.575 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-11-12T05:34:32.587 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-11-12T05:34:32.620 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-11-12T05:34:32.631 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-11-12T05:34:32.654 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-11-12T05:34:32.675 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-11-12T05:34:32.676 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-11-12T05:34:32.709 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-11-12T05:34:32.720 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-11-12T05:34:32.744 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-11-12T05:34:32.766 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-11-12T05:34:32.799 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-11-12T05:34:32.811 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-11-12T05:34:32.834 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-11-12T05:34:32.835 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-11-12T05:34:32.858 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-11-12T05:34:32.891 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-11-12T05:34:32.936 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-11-12T05:34:32.937 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-11-12T05:34:32.950 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-11-12T05:34:32.952 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-11-12T05:34:32.996 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-11-12T05:34:33.028 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-11-12T05:34:33.030 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-11-12T05:34:33.052 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-11-12T05:34:33.053 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-11-12T05:34:33.086 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-11-12T05:34:33.119 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-11-12T05:34:33.130 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-11-12T05:34:33.142 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-11-12T05:34:33.154 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-11-12T05:34:33.208 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-11-12T05:34:33.221 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-11-12T05:34:33.233 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-11-12T05:34:33.245 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-11-12T05:34:33.246 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-11-12T05:34:33.310 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-11-12T05:34:33.322 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-11-12T05:34:33.335 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-11-12T05:34:33.336 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 10102} 2021-11-12T05:34:33.350 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 10102} 2021-11-12T05:34:33.403 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-11-12T05:34:33.415 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-11-12T05:34:33.426 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 10103} 2021-11-12T05:34:33.427 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-11-12T05:34:33.439 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 10103} 2021-11-12T05:34:33.503 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-11-12T05:34:33.525 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-11-12T05:34:33.527 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-11-12T05:34:33.528 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 10104} 2021-11-12T05:34:33.540 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 10104} 2021-11-12T05:34:33.594 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 10102} 2021-11-12T05:34:33.626 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-11-12T05:34:33.627 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-11-12T05:34:33.629 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 10105} 2021-11-12T05:34:33.640 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 10105} 2021-11-12T05:34:33.683 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 10103} 2021-11-12T05:34:33.716 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 10102} 2021-11-12T05:34:33.716 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 10102} 2021-11-12T05:34:33.728 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 10106} 2021-11-12T05:34:33.729 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 10106} 2021-11-12T05:34:33.783 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 10104} 2021-11-12T05:34:33.805 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 10103} 2021-11-12T05:34:33.817 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 10103} 2021-11-12T05:34:33.818 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 10107} 2021-11-12T05:34:33.829 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 10107} 2021-11-12T05:34:33.893 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 10105} 2021-11-12T05:34:33.905 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 10104} 2021-11-12T05:34:33.907 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 10104} 2021-11-12T05:34:33.926 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 10108} 2021-11-12T05:34:33.944 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 10108} 2021-11-12T05:34:34.009 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 10106} 2021-11-12T05:34:34.023 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 10105} 2021-11-12T05:34:34.026 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 10105} 2021-11-12T05:34:34.028 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 10109} 2021-11-12T05:34:34.049 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 10109} 2021-11-12T05:34:34.113 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 10107} 2021-11-12T05:34:34.114 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 10106} 2021-11-12T05:34:34.125 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 10110} 2021-11-12T05:34:34.148 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 10110} 2021-11-12T05:34:34.160 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 10106} 2021-11-12T05:34:34.204 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 10107} 2021-11-12T05:34:34.216 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 10108} 2021-11-12T05:34:34.216 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 10111} 2021-11-12T05:34:34.239 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 10111} 2021-11-12T05:34:34.292 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 10107} 2021-11-12T05:34:34.305 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 10108} 2021-11-12T05:34:34.317 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 10112} 2021-11-12T05:34:34.318 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 10109} 2021-11-12T05:34:34.340 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 10112} 2021-11-12T05:34:34.394 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 10108} 2021-11-12T05:34:34.405 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 10109} 2021-11-12T05:34:34.407 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 10113} 2021-11-12T05:34:34.439 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 10113} 2021-11-12T05:34:34.440 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 10110} 2021-11-12T05:34:34.483 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 10109} 2021-11-12T05:34:34.495 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 10114} 2021-11-12T05:34:34.496 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 10110} 2021-11-12T05:34:34.540 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 10111} 2021-11-12T05:34:34.541 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 10114} 2021-11-12T05:34:34.585 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 10110} 2021-11-12T05:34:34.597 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 10111} 2021-11-12T05:34:34.598 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 10115} 2021-11-12T05:34:34.630 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 10115} 2021-11-12T05:34:34.631 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 10112} 2021-11-12T05:34:34.685 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 10111} 2021-11-12T05:34:34.696 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 10112} 2021-11-12T05:34:34.697 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 10116} 2021-11-12T05:34:34.720 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 10116} 2021-11-12T05:34:34.731 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 10113} 2021-11-12T05:34:34.775 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 10112} 2021-11-12T05:34:34.786 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 10113} 2021-11-12T05:34:34.798 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10118, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 10117} 2021-11-12T05:34:34.820 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 10114} 2021-11-12T05:34:34.833 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10118, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 10117} 2021-11-12T05:34:34.876 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 10113} 2021-11-12T05:34:34.878 INFO:teuthology.task.ansible.out: 2021-11-12T05:34:34.888 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 10114} 2021-11-12T05:34:34.889 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10119, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 10118} 2021-11-12T05:34:34.922 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10119, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 10118} 2021-11-12T05:34:34.933 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 10115} 2021-11-12T05:34:34.977 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 10114} 2021-11-12T05:34:34.978 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 10115} 2021-11-12T05:34:34.990 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10120, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "move_home": false, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "uid": 10119} 2021-11-12T05:34:35.023 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 10116} 2021-11-12T05:34:35.024 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10120, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "move_home": false, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "uid": 10119} 2021-11-12T05:34:35.090 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 10116} ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 10115} 2021-11-12T05:34:35.092 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10121, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "move_home": false, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "uid": 10120} 2021-11-12T05:34:35.113 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10118, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 10117} 2021-11-12T05:34:35.124 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10121, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "move_home": false, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "uid": 10120} 2021-11-12T05:34:35.178 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10118, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 10117} 2021-11-12T05:34:35.178 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 10116} 2021-11-12T05:34:35.190 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10122, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "move_home": false, "name": "xuwang", "shell": "/bin/bash", "state": "present", "uid": 10121} 2021-11-12T05:34:35.223 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10119, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 10118} 2021-11-12T05:34:35.224 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10122, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "move_home": false, "name": "xuwang", "shell": "/bin/bash", "state": "present", "uid": 10121} 2021-11-12T05:34:35.268 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10118, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 10117} 2021-11-12T05:34:35.279 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10123, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "move_home": false, "name": "blaine", "shell": "/bin/bash", "state": "present", "uid": 10122} 2021-11-12T05:34:35.281 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10119, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 10118} 2021-11-12T05:34:35.313 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10120, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "move_home": false, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "uid": 10119} 2021-11-12T05:34:35.325 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10123, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "move_home": false, "name": "blaine", "shell": "/bin/bash", "state": "present", "uid": 10122} 2021-11-12T05:34:35.368 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10119, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 10118} 2021-11-12T05:34:35.380 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10120, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "move_home": false, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "uid": 10119} 2021-11-12T05:34:35.412 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10121, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "move_home": false, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "uid": 10120} 2021-11-12T05:34:35.414 INFO:teuthology.task.ansible.out: 2021-11-12T05:34:35.467 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10120, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "move_home": false, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "uid": 10119} 2021-11-12T05:34:35.478 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10121, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "move_home": false, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "uid": 10120} 2021-11-12T05:34:35.501 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10122, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "move_home": false, "name": "xuwang", "shell": "/bin/bash", "state": "present", "uid": 10121} 2021-11-12T05:34:35.564 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10121, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "move_home": false, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "uid": 10120} 2021-11-12T05:34:35.586 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10122, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "move_home": false, "name": "xuwang", "shell": "/bin/bash", "state": "present", "uid": 10121} 2021-11-12T05:34:35.587 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10123, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "move_home": false, "name": "blaine", "shell": "/bin/bash", "state": "present", "uid": 10122} 2021-11-12T05:34:35.651 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10122, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "move_home": false, "name": "xuwang", "shell": "/bin/bash", "state": "present", "uid": 10121} 2021-11-12T05:34:35.674 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10123, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "move_home": false, "name": "blaine", "shell": "/bin/bash", "state": "present", "uid": 10122} 2021-11-12T05:34:35.748 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10123, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "move_home": false, "name": "blaine", "shell": "/bin/bash", "state": "present", "uid": 10122} 2021-11-12T05:34:35.781 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10124, "groups": "sudo", "home": "/home/choffman", "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "name": "choffman", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10123} 2021-11-12T05:34:35.898 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10124, "groups": "sudo", "home": "/home/choffman", "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "name": "choffman", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10123} 2021-11-12T05:34:35.998 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:35 +0000 (0:00:15.483) 0:00:23.852 ******* 2021-11-12T05:34:36.021 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:36 +0000 (0:00:00.023) 0:00:23.876 ******* 2021-11-12T05:34:36.065 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-11-12T05:34:36.089 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:36 +0000 (0:00:00.068) 0:00:23.944 ******* 2021-11-12T05:34:36.121 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:36 +0000 (0:00:00.031) 0:00:23.976 ******* 2021-11-12T05:34:36.170 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-11-12T05:34:36.172 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10124, "groups": "sudo", "home": "/home/choffman", "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "name": "choffman", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10123} 2021-11-12T05:34:36.174 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-11-12T05:34:36.176 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@desktop 2021-11-12T05:34:36.177 INFO:teuthology.task.ansible.out:QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-11-12T05:34:36.179 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed208 2021-11-12T05:34:36.181 INFO:teuthology.task.ansible.out:2caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": 2021-11-12T05:34:36.182 INFO:teuthology.task.ansible.out: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d 2021-11-12T05:34:36.184 INFO:teuthology.task.ansible.out:3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZY 2021-11-12T05:34:36.186 INFO:teuthology.task.ansible.out:M7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 2021-11-12T05:34:36.187 INFO:teuthology.task.ansible.out:4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name 2021-11-12T05:34:36.188 INFO:teuthology.task.ansible.out:": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp" 2021-11-12T05:34:36.189 INFO:teuthology.task.ansible.out:, "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f36 2021-11-12T05:34:36.191 INFO:teuthology.task.ansible.out:24b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9Jje 2021-11-12T05:34:36.192 INFO:teuthology.task.ansible.out:nDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shy 2021-11-12T05:34:36.194 INFO:teuthology.task.ansible.out:amsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a2 2021-11-12T05:34:36.196 INFO:teuthology.task.ansible.out:8ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": "z 2021-11-12T05:34:36.198 INFO:teuthology.task.ansible.out:l31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGG 2021-11-12T05:34:36.199 INFO:teuthology.task.ansible.out:LeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}]}, "changed": false} 2021-11-12T05:34:36.238 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-11-12T05:34:36.454 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-11-12T05:34:36.456 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@desktop 2021-11-12T05:34:36.457 INFO:teuthology.task.ansible.out:QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-11-12T05:34:36.459 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed208 2021-11-12T05:34:36.461 INFO:teuthology.task.ansible.out:2caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e 2021-11-12T05:34:36.461 INFO:teuthology.task.ansible.out:34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": 2021-11-12T05:34:36.463 INFO:teuthology.task.ansible.out: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d 2021-11-12T05:34:36.464 INFO:teuthology.task.ansible.out:3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZY 2021-11-12T05:34:36.466 INFO:teuthology.task.ansible.out:M7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 2021-11-12T05:34:36.468 INFO:teuthology.task.ansible.out:4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp" 2021-11-12T05:34:36.470 INFO:teuthology.task.ansible.out:, "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f36 2021-11-12T05:34:36.471 INFO:teuthology.task.ansible.out:24b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9Jje 2021-11-12T05:34:36.473 INFO:teuthology.task.ansible.out:nDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432a 2021-11-12T05:34:36.474 INFO:teuthology.task.ansible.out:ac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shy 2021-11-12T05:34:36.475 INFO:teuthology.task.ansible.out:amsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a2 2021-11-12T05:34:36.477 INFO:teuthology.task.ansible.out:8ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": "z 2021-11-12T05:34:36.478 INFO:teuthology.task.ansible.out:l31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}]}, "changed": false} TASK [Create all admin users with sudo access.] ******************************** changed: [gibba038.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10124, "groups": "sudo", "home": "/home/choffman", "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "name": "choffman", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10123} 2021-11-12T05:34:36.558 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10124, "groups": "sudo", "home": "/home/choffman", "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "name": "choffman", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10123} 2021-11-12T05:34:36.662 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:36 +0000 (0:00:00.541) 0:00:24.517 ******* 2021-11-12T05:34:36.689 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:36 +0000 (0:00:00.026) 0:00:24.543 ******* 2021-11-12T05:34:36.718 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:36 +0000 (0:00:00.029) 0:00:24.572 ******* 2021-11-12T05:34:36.743 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:36 +0000 (0:00:00.025) 0:00:24.598 ******* 2021-11-12T05:34:36.770 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:36 +0000 (0:00:00.027) 0:00:24.625 ******* 2021-11-12T05:34:36.809 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-11-12T05:34:36.839 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:36 +0000 (0:00:00.068) 0:00:24.693 ******* 2021-11-12T05:34:36.876 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:36 +0000 (0:00:00.037) 0:00:24.731 ******* 2021-11-12T05:34:36.918 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:36 +0000 (0:00:00.041) 0:00:24.773 ******* 2021-11-12T05:34:36.938 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-11-12T05:34:36.942 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@desktop 2021-11-12T05:34:36.943 INFO:teuthology.task.ansible.out:QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-11-12T05:34:36.945 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed208 2021-11-12T05:34:36.946 INFO:teuthology.task.ansible.out:2caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": 2021-11-12T05:34:36.948 INFO:teuthology.task.ansible.out: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d 2021-11-12T05:34:36.950 INFO:teuthology.task.ansible.out:3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZY 2021-11-12T05:34:36.951 INFO:teuthology.task.ansible.out:M7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95 2021-11-12T05:34:36.953 INFO:teuthology.task.ansible.out:579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c 2021-11-12T05:34:36.954 INFO:teuthology.task.ansible.out:00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "o 2021-11-12T05:34:36.956 INFO:teuthology.task.ansible.out:vpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e85 2021-11-12T05:34:36.958 INFO:teuthology.task.ansible.out:2317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, 2021-11-12T05:34:36.958 INFO:teuthology.task.ansible.out:{"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQd 2021-11-12T05:34:36.961 INFO:teuthology.task.ansible.out:pAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalm 2021-11-12T05:34:36.963 INFO:teuthology.task.ansible.out:a", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e 2021-11-12T05:34:36.964 INFO:teuthology.task.ansible.out:362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": 2021-11-12T05:34:36.966 INFO:teuthology.task.ansible.out: "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}]}, "changed": false} 2021-11-12T05:34:36.989 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:36 +0000 (0:00:00.071) 0:00:24.844 ******* 2021-11-12T05:34:37.011 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@desktop 2021-11-12T05:34:37.013 INFO:teuthology.task.ansible.out:QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-11-12T05:34:37.014 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed208 2021-11-12T05:34:37.016 INFO:teuthology.task.ansible.out:2caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": 2021-11-12T05:34:37.017 INFO:teuthology.task.ansible.out: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebb 2021-11-12T05:34:37.018 INFO:teuthology.task.ansible.out:a6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d 2021-11-12T05:34:37.019 INFO:teuthology.task.ansible.out:3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZY 2021-11-12T05:34:37.021 INFO:teuthology.task.ansible.out:M7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 2021-11-12T05:34:37.023 INFO:teuthology.task.ansible.out:4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp" 2021-11-12T05:34:37.024 INFO:teuthology.task.ansible.out:, "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f36 2021-11-12T05:34:37.026 INFO:teuthology.task.ansible.out:24b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9Jje 2021-11-12T05:34:37.027 INFO:teuthology.task.ansible.out:nDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shy 2021-11-12T05:34:37.029 INFO:teuthology.task.ansible.out:amsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a2 2021-11-12T05:34:37.031 INFO:teuthology.task.ansible.out:8ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": "z 2021-11-12T05:34:37.032 INFO:teuthology.task.ansible.out:l31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}]}, "changed": false} ok: [gibba044.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9 2021-11-12T05:34:37.034 INFO:teuthology.task.ansible.out:fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b95 2021-11-12T05:34:37.035 INFO:teuthology.task.ansible.out:17faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai 2021-11-12T05:34:37.037 INFO:teuthology.task.ansible.out:YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@adm 2021-11-12T05:34:37.039 INFO:teuthology.task.ansible.out:in-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebb 2021-11-12T05:34:37.039 INFO:teuthology.task.ansible.out:a6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca45 2021-11-12T05:34:37.041 INFO:teuthology.task.ansible.out:5b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb2802992184 2021-11-12T05:34:37.042 INFO:teuthology.task.ansible.out:41a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135af 2021-11-12T05:34:37.044 INFO:teuthology.task.ansible.out:df4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, 2021-11-12T05:34:37.045 INFO:teuthology.task.ansible.out: {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"n 2021-11-12T05:34:37.046 INFO:teuthology.task.ansible.out:ame": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepik 2021-11-12T05:34:37.047 INFO:teuthology.task.ansible.out:a", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, { 2021-11-12T05:34:37.049 INFO:teuthology.task.ansible.out:"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7e 2021-11-12T05:34:37.051 INFO:teuthology.task.ansible.out:b3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@ 2021-11-12T05:34:37.052 INFO:teuthology.task.ansible.out:localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e52 2021-11-12T05:34:37.053 INFO:teuthology.task.ansible.out:99298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052 2021-11-12T05:34:37.054 INFO:teuthology.task.ansible.out:887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdi 2021-11-12T05:34:37.056 INFO:teuthology.task.ansible.out:azbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}]}, "changed": false} 2021-11-12T05:34:37.085 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:37 +0000 (0:00:00.095) 0:00:24.939 ******* 2021-11-12T05:34:37.110 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:37 +0000 (0:00:00.025) 0:00:24.964 ******* 2021-11-12T05:34:37.593 INFO:teuthology.task.ansible.out:FAILED - RETRYING: Clone the keys repo (5 retries left). 2021-11-12T05:34:37.594 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-11-12T05:34:37.594 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"after": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "attempts": 1, "before": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "changed": false, "remote_url_changed": false} 2021-11-12T05:34:37.619 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:37 +0000 (0:00:00.509) 0:00:25.474 ******* 2021-11-12T05:34:37.671 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"after": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "attempts": 1, "before": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "changed": false, "remote_url_changed": false} 2021-11-12T05:34:37.697 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:37 +0000 (0:00:00.077) 0:00:25.552 ******* 2021-11-12T05:34:37.768 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"after": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "attempts": 1, "before": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "changed": false, "remote_url_changed": false} 2021-11-12T05:34:37.793 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:37 +0000 (0:00:00.096) 0:00:25.648 ******* 2021-11-12T05:34:37.812 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"after": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "attempts": 1, "before": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "changed": false, "remote_url_changed": false} 2021-11-12T05:34:37.838 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:37 +0000 (0:00:00.044) 0:00:25.692 ******* 2021-11-12T05:34:37.844 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:37.845 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-11-12T05:34:37.888 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-11-12T05:34:37.932 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-11-12T05:34:37.996 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-11-12T05:34:38.007 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-11-12T05:34:38.019 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-11-12T05:34:38.031 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-11-12T05:34:38.095 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-11-12T05:34:38.107 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-11-12T05:34:38.118 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZt 2021-11-12T05:34:38.120 INFO:teuthology.task.ansible.out:IEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-11-12T05:34:38.130 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-11-12T05:34:38.194 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZt 2021-11-12T05:34:38.195 INFO:teuthology.task.ansible.out:IEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-11-12T05:34:38.215 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-11-12T05:34:38.227 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-11-12T05:34:38.250 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-11-12T05:34:38.293 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-11-12T05:34:38.314 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZt 2021-11-12T05:34:38.316 INFO:teuthology.task.ansible.out:IEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-11-12T05:34:38.336 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZt 2021-11-12T05:34:38.338 INFO:teuthology.task.ansible.out:IEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3Nz 2021-11-12T05:34:38.340 INFO:teuthology.task.ansible.out:aC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-11-12T05:34:38.391 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o 2021-11-12T05:34:38.393 INFO:teuthology.task.ansible.out:8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-11-12T05:34:38.424 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-11-12T05:34:38.470 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-11-12T05:34:38.481 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-11-12T05:34:38.482 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-11-12T05:34:38.536 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o 2021-11-12T05:34:38.538 INFO:teuthology.task.ansible.out:8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-11-12T05:34:38.569 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-11-12T05:34:38.581 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-11-12T05:34:38.604 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o 2021-11-12T05:34:38.607 INFO:teuthology.task.ansible.out:8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-11-12T05:34:38.680 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-11-12T05:34:38.682 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-11-12T05:34:38.683 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-11-12T05:34:38.695 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:38.697 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:38.717 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-11-12T05:34:38.772 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-11-12T05:34:38.795 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorb 2021-11-12T05:34:38.797 INFO:teuthology.task.ansible.out:nuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-11-12T05:34:38.807 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorb 2021-11-12T05:34:38.809 INFO:teuthology.task.ansible.out:nuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-11-12T05:34:38.819 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-11-12T05:34:38.872 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-11-12T05:34:38.883 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:38.917 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemers 2021-11-12T05:34:38.919 INFO:teuthology.task.ansible.out:on", "validate_certs": true} 2021-11-12T05:34:38.919 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "stat 2021-11-12T05:34:38.921 INFO:teuthology.task.ansible.out:e": "present", "user": "aemerson", "validate_certs": true} ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-11-12T05:34:38.922 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:38.923 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3 2021-11-12T05:34:38.924 INFO:teuthology.task.ansible.out:W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:38.934 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:38.936 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rT 2021-11-12T05:34:38.940 INFO:teuthology.task.ansible.out:fmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:38.989 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorb 2021-11-12T05:34:38.991 INFO:teuthology.task.ansible.out:nuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-11-12T05:34:39.032 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-11-12T05:34:39.034 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-11-12T05:34:39.056 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorb 2021-11-12T05:34:39.058 INFO:teuthology.task.ansible.out:nuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-11-12T05:34:39.130 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSo 2021-11-12T05:34:39.132 INFO:teuthology.task.ansible.out:AWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@ 2021-11-12T05:34:39.133 INFO:teuthology.task.ansible.out:kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh 2021-11-12T05:34:39.135 INFO:teuthology.task.ansible.out:+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1 2021-11-12T05:34:39.137 INFO:teuthology.task.ansible.out:yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2021-11-12T05:34:39.143 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:39.154 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:39.197 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemers 2021-11-12T05:34:39.198 INFO:teuthology.task.ansible.out:on", "validate_certs": true} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:39.208 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:39.220 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-11-12T05:34:39.242 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-11-12T05:34:39.245 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-11-12T05:34:39.309 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-11-12T05:34:39.311 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-11-12T05:34:39.331 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-11-12T05:34:39.364 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSo 2021-11-12T05:34:39.366 INFO:teuthology.task.ansible.out:AWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-11-12T05:34:39.406 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSo 2021-11-12T05:34:39.408 INFO:teuthology.task.ansible.out:AWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/ 2021-11-12T05:34:39.410 INFO:teuthology.task.ansible.out:JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-11-12T05:34:39.429 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-11-12T05:34:39.472 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-11-12T05:34:39.505 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-11-12T05:34:39.516 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9C 2021-11-12T05:34:39.518 INFO:teuthology.task.ansible.out:kxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-11-12T05:34:39.528 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9C 2021-11-12T05:34:39.529 INFO:teuthology.task.ansible.out:kxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-11-12T05:34:39.550 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-11-12T05:34:39.592 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-11-12T05:34:39.614 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB 2021-11-12T05:34:39.616 INFO:teuthology.task.ansible.out:0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-11-12T05:34:39.625 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB 2021-11-12T05:34:39.627 INFO:teuthology.task.ansible.out:0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-11-12T05:34:39.647 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-11-12T05:34:39.712 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-11-12T05:34:39.724 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-11-12T05:34:39.724 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-11-12T05:34:39.746 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9C 2021-11-12T05:34:39.748 INFO:teuthology.task.ansible.out:kxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-11-12T05:34:39.799 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-11-12T05:34:39.825 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9C 2021-11-12T05:34:39.826 INFO:teuthology.task.ansible.out:kxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-11-12T05:34:39.866 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB 2021-11-12T05:34:39.868 INFO:teuthology.task.ansible.out:0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-11-12T05:34:39.920 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQ 2021-11-12T05:34:39.921 INFO:teuthology.task.ansible.out:v306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-11-12T05:34:39.931 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQ 2021-11-12T05:34:39.933 INFO:teuthology.task.ansible.out:v306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-11-12T05:34:39.953 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB 2021-11-12T05:34:39.955 INFO:teuthology.task.ansible.out:0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-11-12T05:34:40.018 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-11-12T05:34:40.030 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-11-12T05:34:40.062 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-11-12T05:34:40.073 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-11-12T05:34:40.116 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-11-12T05:34:40.141 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-11-12T05:34:40.153 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-11-12T05:34:40.176 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQ 2021-11-12T05:34:40.178 INFO:teuthology.task.ansible.out:v306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-11-12T05:34:40.220 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-11-12T05:34:40.231 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-11-12T05:34:40.253 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQ 2021-11-12T05:34:40.255 INFO:teuthology.task.ansible.out:v306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-11-12T05:34:40.265 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-11-12T05:34:40.318 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-11-12T05:34:40.320 INFO:teuthology.task.ansible.out: 2021-11-12T05:34:40.321 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-11-12T05:34:40.365 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-11-12T05:34:40.366 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-11-12T05:34:40.409 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-11-12T05:34:40.421 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-11-12T05:34:40.454 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-11-12T05:34:40.466 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-11-12T05:34:40.543 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvU 2021-11-12T05:34:40.545 INFO:teuthology.task.ansible.out:xUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clu 2021-11-12T05:34:40.547 INFO:teuthology.task.ansible.out:sterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-11-12T05:34:40.554 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-11-12T05:34:40.566 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-11-12T05:34:40.641 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-11-12T05:34:40.653 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-11-12T05:34:40.665 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-11-12T05:34:40.666 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-11-12T05:34:40.741 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-11-12T05:34:40.743 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-11-12T05:34:40.764 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvU 2021-11-12T05:34:40.766 INFO:teuthology.task.ansible.out:xUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzX 2021-11-12T05:34:40.768 INFO:teuthology.task.ansible.out:uxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-11-12T05:34:40.840 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-11-12T05:34:40.842 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-11-12T05:34:40.874 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-11-12T05:34:40.875 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvU 2021-11-12T05:34:40.877 INFO:teuthology.task.ansible.out:xUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-11-12T05:34:40.929 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-11-12T05:34:40.931 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-11-12T05:34:40.962 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-11-12T05:34:40.973 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-11-12T05:34:41.027 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-12T05:34:41.029 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-12T05:34:41.061 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-11-12T05:34:41.114 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-11-12T05:34:41.125 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-11-12T05:34:41.137 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-11-12T05:34:41.149 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-11-12T05:34:41.226 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-11-12T05:34:41.238 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-11-12T05:34:41.272 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-12T05:34:41.315 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-11-12T05:34:41.326 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1O 2021-11-12T05:34:41.328 INFO:teuthology.task.ansible.out:MJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-11-12T05:34:41.359 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-11-12T05:34:41.381 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-11-12T05:34:41.425 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1O 2021-11-12T05:34:41.427 INFO:teuthology.task.ansible.out:MJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB 2021-11-12T05:34:41.428 INFO:teuthology.task.ansible.out:5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-11-12T05:34:41.469 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-12T05:34:41.480 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-11-12T05:34:41.535 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz 2021-11-12T05:34:41.537 INFO:teuthology.task.ansible.out:2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-11-12T05:34:41.579 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-11-12T05:34:41.580 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-11-12T05:34:41.582 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1O 2021-11-12T05:34:41.583 INFO:teuthology.task.ansible.out:MJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-11-12T05:34:41.625 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-11-12T05:34:41.670 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-11-12T05:34:41.680 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz 2021-11-12T05:34:41.682 INFO:teuthology.task.ansible.out:2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-11-12T05:34:41.724 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-11-12T05:34:41.726 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-11-12T05:34:41.768 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-11-12T05:34:41.801 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-11-12T05:34:41.823 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-11-12T05:34:41.856 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1O 2021-11-12T05:34:41.858 INFO:teuthology.task.ansible.out:MJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-11-12T05:34:41.900 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-11-12T05:34:41.902 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHO 2021-11-12T05:34:41.903 INFO:teuthology.task.ansible.out:RxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-11-12T05:34:41.933 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHO 2021-11-12T05:34:41.935 INFO:teuthology.task.ansible.out:RxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-11-12T05:34:41.972 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz 2021-11-12T05:34:41.974 INFO:teuthology.task.ansible.out:2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-11-12T05:34:41.994 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEf 2021-11-12T05:34:41.996 INFO:teuthology.task.ansible.out:dVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dT 2021-11-12T05:34:41.998 INFO:teuthology.task.ansible.out:zNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-11-12T05:34:42.007 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-11-12T05:34:42.039 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEf 2021-11-12T05:34:42.041 INFO:teuthology.task.ansible.out:dVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dT 2021-11-12T05:34:42.042 INFO:teuthology.task.ansible.out:zNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-11-12T05:34:42.092 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2Z 2021-11-12T05:34:42.094 INFO:teuthology.task.ansible.out:foKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-11-12T05:34:42.136 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHO 2021-11-12T05:34:42.138 INFO:teuthology.task.ansible.out:RxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-11-12T05:34:42.148 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-11-12T05:34:42.190 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-11-12T05:34:42.192 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-11-12T05:34:42.235 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEf 2021-11-12T05:34:42.237 INFO:teuthology.task.ansible.out:dVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dT 2021-11-12T05:34:42.238 INFO:teuthology.task.ansible.out:zNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-11-12T05:34:42.247 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-11-12T05:34:42.290 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-11-12T05:34:42.302 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-11-12T05:34:42.345 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-11-12T05:34:42.346 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-11-12T05:34:42.388 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-11-12T05:34:42.411 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHO 2021-11-12T05:34:42.412 INFO:teuthology.task.ansible.out:RxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-11-12T05:34:42.443 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-11-12T05:34:42.445 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-11-12T05:34:42.498 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-11-12T05:34:42.509 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEf 2021-11-12T05:34:42.511 INFO:teuthology.task.ansible.out:dVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dT 2021-11-12T05:34:42.512 INFO:teuthology.task.ansible.out:zNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-11-12T05:34:42.531 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-11-12T05:34:42.543 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-11-12T05:34:42.607 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-11-12T05:34:42.630 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/ 2021-11-12T05:34:42.632 INFO:teuthology.task.ansible.out:nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsf 2021-11-12T05:34:42.633 INFO:teuthology.task.ansible.out:xfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-11-12T05:34:42.675 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-11-12T05:34:42.719 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-11-12T05:34:42.752 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-11-12T05:34:42.752 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-11-12T05:34:42.774 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-11-12T05:34:42.807 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-11-12T05:34:42.850 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-11-12T05:34:42.862 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-11-12T05:34:42.874 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/ 2021-11-12T05:34:42.876 INFO:teuthology.task.ansible.out:nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-11-12T05:34:42.896 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-11-12T05:34:42.971 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "g 2021-11-12T05:34:42.973 INFO:teuthology.task.ansible.out:abrioux", "validate_certs": true} ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": n 2021-11-12T05:34:42.975 INFO:teuthology.task.ansible.out:ull, "state": "present", "user": "gabrioux", "validate_certs": true} 2021-11-12T05:34:42.994 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-11-12T05:34:42.996 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-11-12T05:34:43.069 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-11-12T05:34:43.071 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-11-12T05:34:43.092 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/ 2021-11-12T05:34:43.094 INFO:teuthology.task.ansible.out:nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-11-12T05:34:43.167 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-11-12T05:34:43.169 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-11-12T05:34:43.189 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "g 2021-11-12T05:34:43.191 INFO:teuthology.task.ansible.out:abrioux", "validate_certs": true} 2021-11-12T05:34:43.254 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-11-12T05:34:43.256 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkk 2021-11-12T05:34:43.258 INFO:teuthology.task.ansible.out:e6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-11-12T05:34:43.289 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-11-12T05:34:43.301 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkk 2021-11-12T05:34:43.303 INFO:teuthology.task.ansible.out:e6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-11-12T05:34:43.355 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-11-12T05:34:43.367 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-11-12T05:34:43.390 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-11-12T05:34:43.422 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-11-12T05:34:43.444 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-11-12T05:34:43.466 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "g 2021-11-12T05:34:43.467 INFO:teuthology.task.ansible.out:abrioux", "validate_certs": true} 2021-11-12T05:34:43.488 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-11-12T05:34:43.510 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkk 2021-11-12T05:34:43.512 INFO:teuthology.task.ansible.out:e6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-11-12T05:34:43.544 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-11-12T05:34:43.568 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-11-12T05:34:43.579 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-11-12T05:34:43.612 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-11-12T05:34:43.645 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-12T05:34:43.667 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-11-12T05:34:43.689 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-12T05:34:43.723 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-11-12T05:34:43.755 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-11-12T05:34:43.779 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkk 2021-11-12T05:34:43.781 INFO:teuthology.task.ansible.out:e6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-11-12T05:34:43.826 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-11-12T05:34:43.839 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-11-12T05:34:43.873 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-11-12T05:34:43.884 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-11-12T05:34:43.938 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-11-12T05:34:43.960 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-12T05:34:43.972 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-11-12T05:34:43.973 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-11-12T05:34:44.026 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-11-12T05:34:44.059 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-11-12T05:34:44.060 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-11-12T05:34:44.071 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-11-12T05:34:44.136 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-11-12T05:34:44.148 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-11-12T05:34:44.170 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-12T05:34:44.192 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-11-12T05:34:44.225 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-11-12T05:34:44.248 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-11-12T05:34:44.271 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-11-12T05:34:44.293 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-11-12T05:34:44.338 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-11-12T05:34:44.371 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-11-12T05:34:44.384 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-11-12T05:34:44.396 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-11-12T05:34:44.439 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-11-12T05:34:44.472 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-11-12T05:34:44.474 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-11-12T05:34:44.495 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-11-12T05:34:44.527 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-11-12T05:34:44.595 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-11-12T05:34:44.608 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-11-12T05:34:44.620 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-11-12T05:34:44.644 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-11-12T05:34:44.708 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-11-12T05:34:44.711 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-11-12T05:34:44.720 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-11-12T05:34:44.746 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-11-12T05:34:44.821 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-11-12T05:34:44.823 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-11-12T05:34:44.878 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-11-12T05:34:44.924 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-11-12T05:34:44.926 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-11-12T05:34:44.938 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-11-12T05:34:44.993 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-11-12T05:34:45.025 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-11-12T05:34:45.037 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-11-12T05:34:45.038 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-11-12T05:34:45.093 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-11-12T05:34:45.115 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-11-12T05:34:45.127 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-11-12T05:34:45.129 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-11-12T05:34:45.192 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-11-12T05:34:45.224 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-11-12T05:34:45.236 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-11-12T05:34:45.258 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-11-12T05:34:45.259 INFO:teuthology.task.ansible.out: 2021-11-12T05:34:45.293 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-11-12T05:34:45.326 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-11-12T05:34:45.327 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-11-12T05:34:45.359 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-11-12T05:34:45.423 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-11-12T05:34:45.434 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1l 2021-11-12T05:34:45.436 INFO:teuthology.task.ansible.out:XTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-11-12T05:34:45.479 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-11-12T05:34:45.514 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-11-12T05:34:45.535 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-11-12T05:34:45.536 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1l 2021-11-12T05:34:45.538 INFO:teuthology.task.ansible.out:XTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-11-12T05:34:45.579 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-11-12T05:34:45.623 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-11-12T05:34:45.645 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-11-12T05:34:45.646 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-11-12T05:34:45.689 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-11-12T05:34:45.722 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1l 2021-11-12T05:34:45.724 INFO:teuthology.task.ansible.out:XTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-11-12T05:34:45.733 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-11-12T05:34:45.745 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-11-12T05:34:45.799 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-11-12T05:34:45.821 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-11-12T05:34:45.823 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2 2021-11-12T05:34:45.825 INFO:teuthology.task.ansible.out:z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-11-12T05:34:45.833 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-11-12T05:34:45.897 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-11-12T05:34:45.909 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-11-12T05:34:45.920 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-11-12T05:34:45.942 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2 2021-11-12T05:34:45.944 INFO:teuthology.task.ansible.out:z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-11-12T05:34:45.997 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1l 2021-11-12T05:34:45.999 INFO:teuthology.task.ansible.out:XTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-11-12T05:34:46.010 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-11-12T05:34:46.011 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-11-12T05:34:46.043 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-11-12T05:34:46.108 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2 2021-11-12T05:34:46.109 INFO:teuthology.task.ansible.out:z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-11-12T05:34:46.119 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-11-12T05:34:46.132 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-11-12T05:34:46.153 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-11-12T05:34:46.207 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-11-12T05:34:46.230 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-11-12T05:34:46.231 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-11-12T05:34:46.296 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-11-12T05:34:46.308 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-11-12T05:34:46.319 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-11-12T05:34:46.331 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-11-12T05:34:46.384 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-11-12T05:34:46.407 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-11-12T05:34:46.419 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-11-12T05:34:46.432 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2 2021-11-12T05:34:46.433 INFO:teuthology.task.ansible.out:z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-11-12T05:34:46.485 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-11-12T05:34:46.507 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-11-12T05:34:46.509 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-11-12T05:34:46.521 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-11-12T05:34:46.580 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-11-12T05:34:46.591 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-11-12T05:34:46.603 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loca 2021-11-12T05:34:46.605 INFO:teuthology.task.ansible.out:l", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-11-12T05:34:46.626 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-11-12T05:34:46.690 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-11-12T05:34:46.692 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-11-12T05:34:46.712 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-11-12T05:34:46.724 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-11-12T05:34:46.788 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB 2021-11-12T05:34:46.790 INFO:teuthology.task.ansible.out:3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.local", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-11-12T05:34:46.810 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-11-12T05:34:46.821 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-11-12T05:34:46.823 INFO:teuthology.task.ansible.out: 2021-11-12T05:34:46.885 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-11-12T05:34:46.897 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loca 2021-11-12T05:34:46.899 INFO:teuthology.task.ansible.out:l", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-11-12T05:34:46.931 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-11-12T05:34:46.984 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-11-12T05:34:46.986 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-11-12T05:34:47.006 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-11-12T05:34:47.070 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-11-12T05:34:47.081 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-11-12T05:34:47.082 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-11-12T05:34:47.104 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-11-12T05:34:47.168 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-11-12T05:34:47.180 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-11-12T05:34:47.191 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-11-12T05:34:47.202 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-11-12T05:34:47.256 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loca 2021-11-12T05:34:47.258 INFO:teuthology.task.ansible.out:l", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-11-12T05:34:47.278 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-11-12T05:34:47.289 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-11-12T05:34:47.300 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/y 2021-11-12T05:34:47.302 INFO:teuthology.task.ansible.out:BwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-11-12T05:34:47.365 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-11-12T05:34:47.376 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-11-12T05:34:47.388 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-11-12T05:34:47.389 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-11-12T05:34:47.475 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-11-12T05:34:47.486 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/y 2021-11-12T05:34:47.488 INFO:teuthology.task.ansible.out:BwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_c 2021-11-12T05:34:47.490 INFO:teuthology.task.ansible.out:erts": true} 2021-11-12T05:34:47.499 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-11-12T05:34:47.584 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/y 2021-11-12T05:34:47.586 INFO:teuthology.task.ansible.out:BwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shy 2021-11-12T05:34:47.588 INFO:teuthology.task.ansible.out:ukri", "validate_certs": true} ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-11-12T05:34:47.589 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-11-12T05:34:47.684 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-11-12T05:34:47.686 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdK 2021-11-12T05:34:47.687 INFO:teuthology.task.ansible.out:pnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-11-12T05:34:47.782 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-11-12T05:34:47.784 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-11-12T05:34:47.785 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-11-12T05:34:47.828 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-11-12T05:34:47.883 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-11-12T05:34:47.885 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-11-12T05:34:47.895 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-11-12T05:34:47.918 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-11-12T05:34:47.982 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-11-12T05:34:47.983 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/y 2021-11-12T05:34:47.985 INFO:teuthology.task.ansible.out:BwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-11-12T05:34:48.026 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-11-12T05:34:48.070 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-11-12T05:34:48.081 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-11-12T05:34:48.083 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-11-12T05:34:48.114 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-11-12T05:34:48.168 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-11-12T05:34:48.179 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-11-12T05:34:48.180 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-11-12T05:34:48.181 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"after": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "attempts": 2, "before": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "changed": false, "remote_url_changed": false} 2021-11-12T05:34:48.206 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:48 +0000 (0:00:10.368) 0:00:36.061 ******* 2021-11-12T05:34:48.225 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:48.227 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/ 2021-11-12T05:34:48.229 INFO:teuthology.task.ansible.out:L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-11-12T05:34:48.259 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-11-12T05:34:48.271 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-11-12T05:34:48.304 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-11-12T05:34:48.315 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-11-12T05:34:48.368 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-11-12T05:34:48.370 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-11-12T05:34:48.401 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-11-12T05:34:48.414 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-11-12T05:34:48.426 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-11-12T05:34:48.459 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-11-12T05:34:48.470 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-11-12T05:34:48.504 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-11-12T05:34:48.527 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-11-12T05:34:48.712 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2 2021-11-12T05:34:48.714 INFO:teuthology.task.ansible.out:bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/ 2021-11-12T05:34:48.716 INFO:teuthology.task.ansible.out:sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var" 2021-11-12T05:34:48.718 INFO:teuthology.task.ansible.out:: "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-11-12T05:34:48.729 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-11-12T05:34:48.777 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-11-12T05:34:48.790 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-11-12T05:34:48.845 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-11-12T05:34:48.888 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-11-12T05:34:48.890 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZt 2021-11-12T05:34:48.891 INFO:teuthology.task.ansible.out:IEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-11-12T05:34:48.900 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-11-12T05:34:48.953 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-11-12T05:34:48.987 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-11-12T05:34:48.999 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-11-12T05:34:49.024 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-11-12T05:34:49.057 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-11-12T05:34:49.058 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-11-12T05:34:49.125 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-11-12T05:34:49.148 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-11-12T05:34:49.150 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-11-12T05:34:49.172 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-11-12T05:34:49.184 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o 2021-11-12T05:34:49.186 INFO:teuthology.task.ansible.out:8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-11-12T05:34:49.264 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-11-12T05:34:49.276 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-11-12T05:34:49.279 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-11-12T05:34:49.311 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-11-12T05:34:49.323 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-11-12T05:34:49.375 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-11-12T05:34:49.377 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-11-12T05:34:49.398 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-11-12T05:34:49.420 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-11-12T05:34:49.462 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-11-12T05:34:49.484 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-11-12T05:34:49.495 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-11-12T05:34:49.517 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-11-12T05:34:49.539 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd 2021-11-12T05:34:49.541 INFO:teuthology.task.ansible.out:+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-11-12T05:34:49.592 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-11-12T05:34:49.604 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-11-12T05:34:49.606 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:49.623 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd 2021-11-12T05:34:49.625 INFO:teuthology.task.ansible.out:+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-11-12T05:34:49.639 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd 2021-11-12T05:34:49.641 INFO:teuthology.task.ansible.out:+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-11-12T05:34:49.671 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-11-12T05:34:49.716 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-11-12T05:34:49.717 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-11-12T05:34:49.728 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorb 2021-11-12T05:34:49.730 INFO:teuthology.task.ansible.out:nuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-11-12T05:34:49.750 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-11-12T05:34:49.803 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-11-12T05:34:49.814 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-11-12T05:34:49.826 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-11-12T05:34:49.849 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemers 2021-11-12T05:34:49.851 INFO:teuthology.task.ansible.out:on", "validate_certs": true} 2021-11-12T05:34:49.860 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:49.862 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:49.872 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-11-12T05:34:49.915 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-11-12T05:34:49.926 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-11-12T05:34:49.928 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-11-12T05:34:49.972 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-11-12T05:34:49.984 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-11-12T05:34:50.026 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-11-12T05:34:50.028 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-11-12T05:34:50.038 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-11-12T05:34:50.072 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSo 2021-11-12T05:34:50.074 INFO:teuthology.task.ansible.out:AWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-11-12T05:34:50.094 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-11-12T05:34:50.137 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-11-12T05:34:50.149 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-11-12T05:34:50.161 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd 2021-11-12T05:34:50.163 INFO:teuthology.task.ansible.out:+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-11-12T05:34:50.174 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-11-12T05:34:50.176 INFO:teuthology.task.ansible.out: 2021-11-12T05:34:50.208 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-11-12T05:34:50.230 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-11-12T05:34:50.252 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-11-12T05:34:50.265 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-11-12T05:34:50.298 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-11-12T05:34:50.309 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-11-12T05:34:50.341 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-11-12T05:34:50.342 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-11-12T05:34:50.364 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-11-12T05:34:50.396 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-11-12T05:34:50.440 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-11-12T05:34:50.440 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-11-12T05:34:50.452 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-11-12T05:34:50.464 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9C 2021-11-12T05:34:50.465 INFO:teuthology.task.ansible.out:kxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-11-12T05:34:50.485 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-11-12T05:34:50.539 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-11-12T05:34:50.561 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB 2021-11-12T05:34:50.563 INFO:teuthology.task.ansible.out:0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-11-12T05:34:50.575 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-11-12T05:34:50.619 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-11-12T05:34:50.630 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-11-12T05:34:50.653 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-11-12T05:34:50.665 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-11-12T05:34:50.666 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-11-12T05:34:50.719 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-11-12T05:34:50.730 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-11-12T05:34:50.752 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-11-12T05:34:50.764 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-11-12T05:34:50.764 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-11-12T05:34:50.807 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-11-12T05:34:50.829 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-11-12T05:34:50.851 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-11-12T05:34:50.862 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-11-12T05:34:50.874 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQ 2021-11-12T05:34:50.876 INFO:teuthology.task.ansible.out:v306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-11-12T05:34:50.917 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-11-12T05:34:50.960 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCoeyVaMjhcGrWQB+4Rq+SSIi8+OY/kx2s1vofiGt1gu3RNtFmG0Df1VITJJ32dbzaW7kTNxaRvhldNd/n7yEMssG+Wg+a5WKvSudlbVMmscbSXdFuVbcCW1jNrTGCYrxL7Sn5e7NQEQfAsCbfXwTcYBw33NdBVovC+gs2V3sZGvX3Y0akZONNuVg1mhu0L4m1/5IegJh005KeilwetHA2A5Dr10RG6oyIgT7t4z5gZXsrOiG3UQBXaekILYV9jxMWoFXGkVLc8TpL9SUAdxE3Owc0u1XiPqYYlEN+zDvE0554Zj8Oc2ZO6HRXCZXQFvzXeCD12YswcOfkIDmJRF7GT prashant@mauli", "key_options": null, "ke 2021-11-12T05:34:50.962 INFO:teuthology.task.ansible.out:yfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} changed: [gibba016.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCoeyVaMjhcGrWQB+4Rq+SSIi8+OY/kx2s1vofiGt1gu3RNtFmG0Df1VITJJ32dbzaW7kTNxaRvhldNd/n7yEMssG+Wg+a5WKvSudlbVMmscbSXdFuVbcCW1jNrTGCYrxL7Sn5e7NQEQfAsCbfXwTcYBw33NdBVovC+gs2V3sZGvX3Y0akZONNuVg1mhu0L4m1/5IegJh005KeilwetHA2A5Dr10RG6oyIgT7t4z5gZXsrOiG 2021-11-12T05:34:50.964 INFO:teuthology.task.ansible.out:3UQBXaekILYV9jxMWoFXGkVLc8TpL9SUAdxE3Owc0u1XiPqYYlEN+zDvE0554Zj8Oc2ZO6HRXCZXQFvzXeCD12YswcOfkIDmJRF7GT prashant@mauli", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-11-12T05:34:50.972 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-11-12T05:34:50.994 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-11-12T05:34:51.058 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-11-12T05:34:51.069 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-11-12T05:34:51.070 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCoeyVaMjhcGrWQB+4Rq+SSIi8+OY/kx2s1vofiGt1gu3RNtFmG0Df1VITJJ32dbzaW7kTNxaRvhldNd/n7yEMssG+Wg+a5WKvSudlbVMmscbSXdFuVbcCW1jNrTGCYrxL7Sn5e7NQEQfAsCbfXwTcYBw33NdBVovC+gs2V3sZGvX3Y0akZONNuVg1mhu0L4m1/5IegJh005KeilwetHA2A5Dr10RG6oyIgT7t4z5gZXsrOiG3UQBXaekILYV9jxMWoFXGkVLc8TpL9SUAdxE3Owc0u1XiPqYYlEN+zDvE0554Zj8Oc2ZO6HRXCZXQFvzXeCD12YswcOfkIDmJRF7GT prashant@mauli", "key_options": null, "ke 2021-11-12T05:34:51.072 INFO:teuthology.task.ansible.out:yfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-11-12T05:34:51.082 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-11-12T05:34:51.094 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-11-12T05:34:51.168 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-11-12T05:34:51.180 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-11-12T05:34:51.192 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-11-12T05:34:51.204 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-11-12T05:34:51.205 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-11-12T05:34:51.282 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_o 2021-11-12T05:34:51.284 INFO:teuthology.task.ansible.out:ptions": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-11-12T05:34:51.295 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-11-12T05:34:51.308 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-11-12T05:34:51.309 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_o 2021-11-12T05:34:51.311 INFO:teuthology.task.ansible.out:ptions": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-11-12T05:34:51.331 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-11-12T05:34:51.394 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt4sQTrDDg562IWY9Bw2fxFR7Y7b5lfo9egHa1qNFR5K4gt8lUwQXgzcxZK5dgSTZXHDGxrbYKWsdb8NbpgU/YjSqDUIptMZrhTI6pdHKZ2usY+nieaJj0NIZP/S7M93BbJeoNBYACjvDUr+vXEg6ZL3uAj+zFXr/4te+p4NqJBl4bSpvjcRK12O+F6HE3Q93j0Vlfs8IbXP4vcPcqOW+2usXw7JPdfjwuACJxrLTx/0mBsv8qXJDfOpPIHAMA/9SdTAzhs6XMo+fOwVOKkV+ki2fO3sl8pE16aFOkI3cYX36nkYYpZ2bJLnIPcLv37i3Nypl8eNLA4gzjkDf1o/KLO5vXOs76H189WGLqjh0SHAx/3KO6mrIhTq8Bv6YWoT3ntg22fXaxeajNhHcQ0bKZtGOAb0W1FcMRbSTkgEFAassYxlpTtuaCDIuA4fUVKW97Zu62eDDsSUtTWak/Yf940qAbptPPAw4ljmrvZRcjM9y6mGU8lKi5H4QoEOfbPok= nia@fedora", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-11-12T05:34:51.406 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-11-12T05:34:51.429 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt4sQTrDDg562IWY9Bw2fxFR7Y7b5lfo9egHa1qNFR5K4gt8lUwQXgzcxZK5dgSTZXHDGxrbYKWsdb8NbpgU/YjSqDUIptMZrhTI6pdHKZ2usY+nieaJj0NIZP/S7M93BbJeoNBYACjvDUr+vXEg6ZL3uAj+zFXr/4te+p4NqJBl4bSpvjcRK12O+F6HE3Q93j0Vlfs8IbXP4vcPcqOW+2usXw7JPdfjwuACJxrLTx/0mBsv8qXJDfOpPIHAMA/9SdTAzhs6XMo+fOwVOKkV+ki2fO3sl8pE16aFOkI3cYX36nkYYpZ2bJLnIPcLv37i3Nypl8eNLA4gzjkDf1o/KLO5vXOs76H189WGLqjh0SHAx/3KO6mrIhTq8Bv6YWoT3ntg22fXaxeajNhHcQ0bKZtGOAb0W1FcMRbSTkgEFAassYxlpTtuaCDIuA4fUVKW97Zu62eDDsSUtTWak/Yf940qAbptPPAw4ljmrvZRcjM9y6mGU8lKi5H4QoEOfbPok= nia@fedora", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-11-12T05:34:51.431 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_o 2021-11-12T05:34:51.432 INFO:teuthology.task.ansible.out:ptions": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-11-12T05:34:51.462 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-11-12T05:34:51.495 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-11-12T05:34:51.508 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-11-12T05:34:51.530 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt4sQTrDDg562IWY9Bw2fxFR7Y7b5lfo9egHa1qNFR5K4gt8lUwQXgzcxZK5dgSTZXHDGxrbYKWsdb8NbpgU/YjSqDUIptMZrhTI6pdHKZ2usY+nieaJj0NIZP/S7M93BbJeoNBYACjvDUr+vXEg6ZL3uAj+zFXr/4te+p4NqJBl4bSpvjcRK12O+F6HE3Q93j0Vlfs8IbXP4vcPcqOW+2usXw7JPdfjwuACJxrLTx/0mBsv8qXJDfOpPIHAMA/9SdTAzhs6XMo+fOwVOKkV+ki2fO3sl8pE16aFOkI3cYX36nkYYpZ2bJLnIPcLv37i3Nypl8eNLA4gzjkDf1o/KLO5vXOs76H189WGLqjh0SHAx/3KO6mrIhTq8Bv6YWoT3ntg22fXaxeajNhHcQ0bKZtGOAb0W1FcMRbSTkgEFAassYxlpTtuaCDIuA4fUVKW97Zu62eDDsSUtTWak/Yf940qAbptPPAw4ljmrvZRcjM9y6mGU8lKi5H4QoEOfbPok= nia@fedora", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-11-12T05:34:51.563 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvU 2021-11-12T05:34:51.565 INFO:teuthology.task.ansible.out:xUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-11-12T05:34:51.586 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-11-12T05:34:51.608 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCoeyVaMjhcGrWQB+4Rq+SSIi8+OY/kx2s1vofiGt1gu3RNtFmG0Df1VITJJ32dbzaW7kTNxaRvhldNd/n7yEMssG+Wg+a5WKvSudlbVMmscbSXdFuVbcCW1jNrTGCYrxL7Sn5e7NQEQfAsCbfXwTcYBw33NdBVovC+gs2V3sZGvX3Y0akZONNuVg1mhu0L4m1/5IegJh005KeilwetHA2A5Dr10RG6oyIgT7t4z5gZXsrOiG3UQBXaekILYV9jxMWoFXGkVLc8TpL9SUAdxE3Owc0u1XiPqYYlEN+zDvE0554Zj8Oc2ZO6HRXCZXQFvzXeCD12YswcOfkIDmJRF7GT prashant@mauli", "key_options": null, "ke 2021-11-12T05:34:51.610 INFO:teuthology.task.ansible.out:yfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-11-12T05:34:51.621 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-11-12T05:34:51.654 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-11-12T05:34:51.665 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-11-12T05:34:51.698 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-11-12T05:34:51.742 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-11-12T05:34:51.744 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-11-12T05:34:51.755 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-11-12T05:34:51.767 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-11-12T05:34:51.801 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-11-12T05:34:51.844 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-11-12T05:34:51.846 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-11-12T05:34:51.857 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-11-12T05:34:51.900 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-11-12T05:34:51.922 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-11-12T05:34:51.954 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_o 2021-11-12T05:34:51.962 INFO:teuthology.task.ansible.out:ptions": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-11-12T05:34:51.977 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-11-12T05:34:52.020 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-11-12T05:34:52.085 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt4sQTrDDg562IWY9Bw2fxFR7Y7b5lfo9egHa1qNFR5K4gt8lUwQXgzcxZK5dgSTZXHDGxrbYKWsdb8NbpgU/YjSqDUIptMZrhTI6pdHKZ2usY+nieaJj0NIZP/S7M93BbJeoNBYACjvDUr+vXEg6ZL3uAj+zFXr/4te+p4NqJBl4bSpvjcRK12O+F6HE3Q93j0Vlfs8IbXP4vcPcqOW+2usXw7JPdfjwuACJxrLTx/0mBsv8qXJDfOpPIHAMA/9SdTAzhs6XMo+fOwVOKkV+ki2fO3sl8pE16aFOkI3cYX36nkYYpZ2bJLnIPcLv37i3Nypl8eNLA4gzjkDf1o/KLO5vXOs76H189WGLqjh0SHAx/3KO6mrIhTq8Bv6YWoT3ntg22fXaxeajNhHcQ0bKZtGOAb0W1FcMRbSTkgEFAassYxlpTtuaCDIuA4fUVKW97Zu62eDDsSUtTWak/Yf940qAbptPPAw4ljmrvZRcjM9y6mGU8lKi5H4QoEOfbPok= nia@fedora", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-11-12T05:34:52.087 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-11-12T05:34:52.097 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-12T05:34:52.108 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-11-12T05:34:52.109 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-11-12T05:34:52.194 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-11-12T05:34:52.206 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-11-12T05:34:52.207 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-11-12T05:34:52.229 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-11-12T05:34:52.231 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-11-12T05:34:52.317 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-11-12T05:34:52.329 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-11-12T05:34:52.341 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-11-12T05:34:52.352 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-11-12T05:34:52.364 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-11-12T05:34:52.428 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-11-12T05:34:52.450 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1O 2021-11-12T05:34:52.452 INFO:teuthology.task.ansible.out:MJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRp 2021-11-12T05:34:52.453 INFO:teuthology.task.ansible.out:yqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-11-12T05:34:52.485 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-11-12T05:34:52.518 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-11-12T05:34:52.541 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz 2021-11-12T05:34:52.543 INFO:teuthology.task.ansible.out:2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-11-12T05:34:52.563 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-11-12T05:34:52.575 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-11-12T05:34:52.608 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-11-12T05:34:52.630 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-11-12T05:34:52.651 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-11-12T05:34:52.694 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-11-12T05:34:52.706 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-11-12T05:34:52.749 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-11-12T05:34:52.760 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-11-12T05:34:52.773 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-11-12T05:34:52.775 INFO:teuthology.task.ansible.out: 2021-11-12T05:34:52.807 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-11-12T05:34:52.850 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-11-12T05:34:52.852 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8Ypwy 2021-11-12T05:34:52.854 INFO:teuthology.task.ansible.out:RlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-11-12T05:34:52.885 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-11-12T05:34:52.928 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-11-12T05:34:52.950 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-11-12T05:34:52.951 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-11-12T05:34:52.963 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHO 2021-11-12T05:34:52.965 INFO:teuthology.task.ansible.out:RxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-11-12T05:34:53.006 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-11-12T05:34:53.039 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-11-12T05:34:53.050 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-11-12T05:34:53.051 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-11-12T05:34:53.053 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEf 2021-11-12T05:34:53.058 INFO:teuthology.task.ansible.out:dVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dT 2021-11-12T05:34:53.059 INFO:teuthology.task.ansible.out:zNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-11-12T05:34:53.117 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-11-12T05:34:53.151 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-11-12T05:34:53.153 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-11-12T05:34:53.154 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-11-12T05:34:53.156 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-11-12T05:34:53.231 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-11-12T05:34:53.243 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-11-12T05:34:53.254 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-11-12T05:34:53.276 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-11-12T05:34:53.288 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-11-12T05:34:53.342 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-11-12T05:34:53.354 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-11-12T05:34:53.386 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-11-12T05:34:53.388 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-11-12T05:34:53.409 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2021-11-12T05:34:53.442 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-11-12T05:34:53.443 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-11-12T05:34:53.496 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-11-12T05:34:53.507 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2021-11-12T05:34:53.519 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-11-12T05:34:53.541 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-11-12T05:34:53.552 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-11-12T05:34:53.615 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-11-12T05:34:53.647 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-11-12T05:34:53.649 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-11-12T05:34:53.660 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/ 2021-11-12T05:34:53.662 INFO:teuthology.task.ansible.out:nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-11-12T05:34:53.716 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-11-12T05:34:53.771 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2021-11-12T05:34:53.773 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-11-12T05:34:53.775 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-11-12T05:34:53.809 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-11-12T05:34:53.810 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-11-12T05:34:53.864 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-11-12T05:34:53.887 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-11-12T05:34:53.889 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDM7LPHiaPQXdE+yt9cn7UMuRr8k/LjSUmMrnrAqp8ySQtX6OA3/NcOsxg6FJ45chZqeoXwhsYEW+7pTInDqFlOlmVynR26lWnZfk9DjBJZcloUCn8y5MR9QitNYsOMs5KwCEFmBH6sP+2vCFocXBnKQcVZLRfip3MEG4LoWYfI4ir7fLmK1Hr5G+GhtMstXvVSG4VE4IgbU9/LRIOv7P9qFn4bRJoUSiS2dDbUxVIuneA9bIEnB9ZEVGahEzlUhx6qDSs0FvrnneCQ1ayOFpxClzjT5GuKk/J3LJvWAw8CAwDXCf3FzsWQsvb5ru5VSazUI9uA3o9wWkbLW2oZPgtzI8lmwbL+MT58T92tqaJOPID3IZDGjzNrRqU5BQYpvFYHpHRRiqV625og+ktYfXgO+dTbgAxScomqutydI4cyJusDtnWtljWnEocS+2hUSZpmB6B3Wj70TuuzsbYrcrJ/NgRpQNX4dwHCJl6vPT+xkoLh1imYAC7klf7cnrOyGcs= choffman@choffman.net", "key_options": null, "keyfile": "/home/choffman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "choffman", "validate_certs": true} 2021-11-12T05:34:53.900 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-11-12T05:34:53.922 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDM7LPHiaPQXdE+yt9cn7UMuRr8k/LjSUmMrnrAqp8ySQtX6OA3/NcOsxg6FJ45chZqeoXwhsYEW+7pTInDqFlOlmVynR26lWnZfk9DjBJZcloUCn8y5MR9QitNYsOMs5KwCEFmBH6sP+2vCFocXBnKQcVZLRfip3MEG4LoWYfI4ir7fLmK1Hr5G+GhtMstXvVSG4VE4IgbU9/LRIOv7P9qFn4bRJoUSiS2dDbUxVIuneA9bIEnB9ZEVGahEzlUhx6qDSs0FvrnneCQ1ayOFpxClzjT5GuKk/J3LJvWAw8CAwDXCf3FzsWQsvb5ru5VSazUI9uA3o9wWkbLW2oZPgtzI8lmwbL+MT58T92tqaJOPID3IZDGjzNrRqU5BQYpvFYHpHRRiqV625og+ktYfXgO+dTbgAxScomqutydI4cyJusDtnWtljWnEocS+2hUSZpmB6B3Wj70TuuzsbYrcrJ/NgRpQNX4dwHCJl6vPT+xkoLh1imYAC7klf7cnrOyGcs= choffman@choffman.net", "key_options": null, "keyfile": "/home/choffman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "choffman", "validate_certs": true} 2021-11-12T05:34:54.038 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-11-12T05:34:54.040 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+i 2021-11-12T05:34:54.041 INFO:teuthology.task.ansible.out:C7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gabrioux", "validate_certs": true} 2021-11-12T05:34:54.063 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:54 +0000 (0:00:05.857) 0:00:41.918 ******* 2021-11-12T05:34:54.087 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:54 +0000 (0:00:00.023) 0:00:41.942 ******* 2021-11-12T05:34:54.097 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-11-12T05:34:54.114 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-11-12T05:34:54.115 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-11-12T05:34:54.160 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-12T05:34:54.162 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.171 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.173 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** changed: [gibba005.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDM7LPHiaPQXdE+yt9cn7UMuRr8k/LjSUmMrnrAqp8ySQtX6OA3/NcOsxg6FJ45chZqeoXwhsYEW+7pTInDqFlOlmVynR26lWnZfk9DjBJZcloUCn8y5MR9QitNYsOMs5KwCEFmBH6sP+2vCFocXBnKQcVZLRfip3MEG4LoWYfI4ir7fLmK1Hr5G+GhtMstXvVSG4VE4IgbU9/LRIOv7P9qFn4bRJoUSiS2dDbUxVIuneA9bIEnB9ZEVGahEzlUhx6qDSs0FvrnneCQ1ayOFpxClzjT5GuKk/J3LJvWAw8CAwDXCf3FzsWQsvb5ru5VSazUI9uA3o9wWkbLW2oZPgtzI8lmwbL+MT58T92tqaJOPID3IZDGjzNrRqU5BQYpvFYHpHRRiqV625og+ktYfXgO+dTbgAxScomqutydI4cyJusDtnWtljWnEocS+2hUSZpmB6B3Wj70TuuzsbYrcrJ/NgRpQNX4dwHCJl6vPT+xkoLh1imYAC7klf7cnrOyGcs= choffman@choffman.net", "key_options": null, "keyfile": "/home/choffman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "choffman", "validate_certs": true} 2021-11-12T05:34:54.184 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-12T05:34:54.186 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd00 2021-11-12T05:34:54.187 INFO:teuthology.task.ansible.out:50353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.222 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:54.274 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-12T05:34:54.276 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUB 2021-11-12T05:34:54.277 INFO:teuthology.task.ansible.out:HWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540 2021-11-12T05:34:54.279 INFO:teuthology.task.ansible.out:a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ****** 2021-11-12T05:34:54.281 INFO:teuthology.task.ansible.out:**************** ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz 2021-11-12T05:34:54.282 INFO:teuthology.task.ansible.out:5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.305 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:54 +0000 (0:00:00.218) 0:00:42.160 ******* 2021-11-12T05:34:54.330 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-11-12T05:34:54.331 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.331 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.343 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:54.345 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-11-12T05:34:54.355 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkk 2021-11-12T05:34:54.357 INFO:teuthology.task.ansible.out:e6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDw 2021-11-12T05:34:54.358 INFO:teuthology.task.ansible.out:tUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-11-12T05:34:54.368 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.380 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.413 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.424 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.425 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-11-12T05:34:54.426 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.436 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.448 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.450 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "pre 2021-11-12T05:34:54.451 INFO:teuthology.task.ansible.out:sent", "user": "xuwang", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.461 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.463 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.473 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.484 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-11-12T05:34:54.538 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-11-12T05:34:54.540 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.551 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-11-12T05:34:54.562 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} TASK [ 2021-11-12T05:34:54.564 INFO:teuthology.task.ansible.out:users : Update authorized_keys using the keys repo] ********************** ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-11-12T05:34:54.577 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqy 2021-11-12T05:34:54.579 INFO:teuthology.task.ansible.out:cddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-11-12T05:34:54.592 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.594 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-11-12T05:34:54.595 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.596 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7ee 2021-11-12T05:34:54.598 INFO:teuthology.task.ansible.out:eb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945 2021-11-12T05:34:54.599 INFO:teuthology.task.ansible.out:e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was F 2021-11-12T05:34:54.601 INFO:teuthology.task.ansible.out:alse"} 2021-11-12T05:34:54.610 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.611 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.613 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.624 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.625 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.626 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e7544 2021-11-12T05:34:54.627 INFO:teuthology.task.ansible.out:34de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.637 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.639 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.649 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.651 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.660 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.663 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ******** 2021-11-12T05:34:54.665 INFO:teuthology.task.ansible.out:** skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.674 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:54.675 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDM7LPHiaPQXdE+yt9cn7UMuRr8k/LjSUmMrnrAqp8ySQtX6OA3/NcOsxg6FJ45chZqeoXwhsYEW+7pTInDqFlOlmVynR26lWnZfk9DjBJZcloUCn8y5MR9QitNYsOMs5KwCEFmBH6sP+2vCFocXBnKQcVZLRfip3MEG4LoWYfI4ir7fLmK1Hr5G+GhtMstXvVSG4VE4IgbU9/LRIOv7P9qFn4bRJoUSiS2dDbUxVIuneA9bIEnB9ZEVGahEzlUhx6qDSs0FvrnneCQ1ayOFpxClzjT5GuKk/J3LJvWAw8CAwDXCf3FzsWQsvb5ru5VSazUI9uA3o9wWkbLW2oZPgtzI8lmwbL+MT58T92tqaJOPID3IZDGjzNrRqU5BQYpvFYHpHRRiqV625og+ktYfXgO+dTbgAxScomqutydI4cyJusDtnWtljWnEocS+2hUSZpmB6B3Wj70TuuzsbYrcrJ/NgRpQNX4dwHCJl6vPT+xkoLh1imYAC7klf7cnrOyGcs= choffman@choffman.net", "key_options": null, "keyfile": "/home/choffman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "choffman", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1W 2021-11-12T05:34:54.678 INFO:teuthology.task.ansible.out:WV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.688 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-11-12T05:34:54.690 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.718 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:54.753 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-12T05:34:54.755 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8 2021-11-12T05:34:54.757 INFO:teuthology.task.ansible.out:f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [gibba 2021-11-12T05:34:54.758 INFO:teuthology.task.ansible.out:016.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.784 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:54 +0000 (0:00:00.476) 0:00:42.637 ******* 2021-11-12T05:34:54.790 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.791 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.792 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.793 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.793 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.794 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ 2021-11-12T05:34:54.797 INFO:teuthology.task.ansible.out:af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"nam 2021-11-12T05:34:54.798 INFO:teuthology.task.ansible.out:e": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Cond 2021-11-12T05:34:54.800 INFO:teuthology.task.ansible.out:itional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.801 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31 2021-11-12T05:34:54.803 INFO:teuthology.task.ansible.out:MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping 2021-11-12T05:34:54.805 INFO:teuthology.task.ansible.out:: [gibba016.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZ 2021-11-12T05:34:54.807 INFO:teuthology.task.ansible.out:jbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg 2021-11-12T05:34:54.809 INFO:teuthology.task.ansible.out:1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", 2021-11-12T05:34:54.811 INFO:teuthology.task.ansible.out: "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f 2021-11-12T05:34:54.812 INFO:teuthology.task.ansible.out:'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.825 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.827 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [g 2021-11-12T05:34:54.829 INFO:teuthology.task.ansible.out:ibba038.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.838 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.840 INFO:teuthology.task.ansible.out: skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.840 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.841 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c 2021-11-12T05:34:54.842 INFO:teuthology.task.ansible.out:2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.852 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.853 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.854 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.854 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.854 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.855 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com 2021-11-12T05:34:54.856 INFO:teuthology.task.ansible.out:] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.866 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.868 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.869 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.870 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.870 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.871 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.871 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4 2021-11-12T05:34:54.873 INFO:teuthology.task.ansible.out:076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.883 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.884 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.885 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.887 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.888 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.890 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.901 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.903 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": n 2021-11-12T05:34:54.905 INFO:teuthology.task.ansible.out:ull, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22 2021-11-12T05:34:54.906 INFO:teuthology.task.ansible.out:"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.915 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.916 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.918 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.919 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.929 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.931 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31G 2021-11-12T05:34:54.933 INFO:teuthology.task.ansible.out:bDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.943 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.945 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.956 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.957 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHL 2021-11-12T05:34:54.959 INFO:teuthology.task.ansible.out:ZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.969 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.971 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.982 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.984 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.985 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822 2021-11-12T05:34:54.987 INFO:teuthology.task.ansible.out:428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.996 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:54.998 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.009 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.011 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.012 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.023 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.025 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-11-12T05:34:55.025 INFO:teuthology.task.ansible.out: TASK [user 2021-11-12T05:34:55.027 INFO:teuthology.task.ansible.out:s : Update authorized_keys for each user with literal keys] ********** skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b 2021-11-12T05:34:55.029 INFO:teuthology.task.ansible.out:769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.038 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.040 INFO:teuthology.task.ansible.out: skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.042 INFO:teuthology.task.ansible.out: skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.043 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.054 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.055 INFO:teuthology.task.ansible.out: 2021-11-12T05:34:55.056 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.058 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.060 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.071 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.072 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.074 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.074 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.076 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.076 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.077 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.077 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/ 2021-11-12T05:34:55.079 INFO:teuthology.task.ansible.out:WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69 2021-11-12T05:34:55.080 INFO:teuthology.task.ansible.out:088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.090 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.091 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.091 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.092 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.093 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS 2021-11-12T05:34:55.095 INFO:teuthology.task.ansible.out:8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.105 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.107 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'o 2021-11-12T05:34:55.109 INFO:teuthology.task.ansible.out:friedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.120 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.122 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-12T05:34:55.123 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_re 2021-11-12T05:34:55.125 INFO:teuthology.task.ansible.out:ason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.134 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.136 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.148 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.148 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.150 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.152 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.162 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.164 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.165 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSC 2021-11-12T05:34:55.166 INFO:teuthology.task.ansible.out:INdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.167 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.178 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.180 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.181 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.182 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.182 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.193 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.195 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.206 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.207 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.209 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.210 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.210 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.210 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@m 2021-11-12T05:34:55.212 INFO:teuthology.task.ansible.out:acprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-11-12T05:34:55.222 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.224 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.224 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'vikhyat', ' 2021-11-12T05:34:55.225 INFO:teuthology.task.ansible.out:ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.225 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.236 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.238 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {" 2021-11-12T05:34:55.240 INFO:teuthology.task.ansible.out:name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.251 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:55.253 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-11-12T05:34:55.254 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.255 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.256 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.267 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.269 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.280 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.280 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.282 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.282 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.284 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.284 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.286 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.297 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.299 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.299 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.300 INFO:teuthology.task.ansible.out:skipping: [gibba 2021-11-12T05:34:55.301 INFO:teuthology.task.ansible.out:005.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.311 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.313 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.313 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.315 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.318 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.319 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.320 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.321 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.321 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.332 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.335 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'} 2021-11-12T05:34:55.337 INFO:teuthology.task.ansible.out:) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "stat 2021-11-12T05:34:55.338 INFO:teuthology.task.ansible.out:e": "present", "user": "amaredia", "validate_certs": true} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.348 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.350 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.350 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfrie 2021-11-12T05:34:55.352 INFO:teuthology.task.ansible.out:dma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-11-12T05:34:55.362 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-12T05:34:55.364 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.365 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.365 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vB 2021-11-12T05:34:55.366 INFO:teuthology.task.ansible.out:nL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171 2021-11-12T05:34:55.368 INFO:teuthology.task.ansible.out:ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.377 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.379 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.379 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.380 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={ 2021-11-12T05:34:55.381 INFO:teuthology.task.ansible.out:'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.391 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.392 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.393 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.393 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagg 2021-11-12T05:34:55.395 INFO:teuthology.task.ansible.out:a", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.404 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.406 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.416 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.418 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.419 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.419 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.419 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_v 2021-11-12T05:34:55.421 INFO:teuthology.task.ansible.out:ar": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.431 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.433 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.433 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.444 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.445 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.447 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i7 2021-11-12T05:34:55.448 INFO:teuthology.task.ansible.out:4JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.449 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.449 INFO:teuthology.task.ansible.out:skipping: [gibba04 2021-11-12T05:34:55.450 INFO:teuthology.task.ansible.out:4.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.461 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.462 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.463 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": n 2021-11-12T05:34:55.464 INFO:teuthology.task.ansible.out:ull, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a1 2021-11-12T05:34:55.466 INFO:teuthology.task.ansible.out:56febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.467 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.468 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.479 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.480 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.481 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.481 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"na 2021-11-12T05:34:55.483 INFO:teuthology.task.ansible.out:me": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjs 2021-11-12T05:34:55.484 INFO:teuthology.task.ansible.out:harm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.493 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.495 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.495 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.496 INFO:teuthology.task.ansible.out:skipping: [gibba00 2021-11-12T05:34:55.497 INFO:teuthology.task.ansible.out:5.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mel 2021-11-12T05:34:55.499 INFO:teuthology.task.ansible.out:issali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.508 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.510 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.510 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.511 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3 2021-11-12T05:34:55.512 INFO:teuthology.task.ansible.out:ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez 2021-11-12T05:34:55.514 INFO:teuthology.task.ansible.out:", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.523 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.525 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.525 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.526 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop R 2021-11-12T05:34:55.527 INFO:teuthology.task.ansible.out:kDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.529 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.548 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.550 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.575 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:55 +0000 (0:00:00.793) 0:00:43.430 ******* 2021-11-12T05:34:55.583 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.608 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.609 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23 2021-11-12T05:34:55.611 INFO:teuthology.task.ansible.out:db56"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.612 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.614 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.615 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.616 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.616 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumr 2021-11-12T05:34:55.618 INFO:teuthology.task.ansible.out:ao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.618 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-des 2021-11-12T05:34:55.620 INFO:teuthology.task.ansible.out:ktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.620 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a 2021-11-12T05:34:55.622 INFO:teuthology.task.ansible.out:8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.794 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:55 +0000 (0:00:00.218) 0:00:43.648 ******* 2021-11-12T05:34:55.802 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.802 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.804 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.804 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.805 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.805 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia. 2021-11-12T05:34:55.807 INFO:teuthology.task.ansible.out:ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-11-12T05:34:55.807 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdf 2021-11-12T05:34:55.809 INFO:teuthology.task.ansible.out:a8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.809 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.810 INFO:teuthology.task.ansible.out:skipping: [gibba005.fron 2021-11-12T05:34:55.811 INFO:teuthology.task.ansible.out:t.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.811 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name 2021-11-12T05:34:55.813 INFO:teuthology.task.ansible.out:": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.813 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4 2021-11-12T05:34:55.815 INFO:teuthology.task.ansible.out:iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.815 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:55.816 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA 2021-11-12T05:34:55.817 INFO:teuthology.task.ansible.out:9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} TASK [Filter the revoked_users list] ******************************************* skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.844 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:55 +0000 (0:00:00.050) 0:00:43.699 ******* 2021-11-12T05:34:55.852 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-12T05:34:55.853 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.854 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.856 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.857 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.858 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.859 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.860 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.860 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn' 2021-11-12T05:34:55.861 INFO:teuthology.task.ansible.out:: 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.861 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.863 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.864 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.865 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.867 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.868 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "it 2021-11-12T05:34:55.869 INFO:teuthology.task.ansible.out:em", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.870 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.871 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.893 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:55.895 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad 2021-11-12T05:34:55.896 INFO:teuthology.task.ansible.out:83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} TASK [Filter the revoked_users list] ******************************************* skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-12T05:34:55.897 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2 2021-11-12T05:34:55.899 INFO:teuthology.task.ansible.out:pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic 2021-11-12T05:34:55.900 INFO:teuthology.task.ansible.out:sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.925 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:55 +0000 (0:00:00.080) 0:00:43.780 ******* 2021-11-12T05:34:55.954 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:55 +0000 (0:00:00.028) 0:00:43.809 ******* 2021-11-12T05:34:55.962 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.963 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.964 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.965 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.966 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.966 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:55.967 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_ 2021-11-12T05:34:55.969 INFO:teuthology.task.ansible.out:var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name 2021-11-12T05:34:55.971 INFO:teuthology.task.ansible.out:': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.982 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.984 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.994 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:55.996 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.006 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.017 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.018 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.019 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.044 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:56 +0000 (0:00:00.090) 0:00:43.899 ******* 2021-11-12T05:34:56.056 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} TASK [Remove revoked users] **************************************************** ok: [gibba038.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.057 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-11-12T05:34:56.068 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-12T05:34:56.070 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.070 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.082 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.083 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.085 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.095 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.106 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.108 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.117 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.119 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} TASK [Remove revoked users] **************************************************** ok: [gibba038.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-11-12T05:34:56.130 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-11-12T05:34:56.132 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.142 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.154 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.155 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-12T05:34:56.156 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.167 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.168 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.178 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.180 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.190 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.201 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.202 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.212 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.223 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:34:56.225 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.225 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [gibba005.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-11-12T05:34:56.227 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.238 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.249 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.251 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} TASK [Remove revoked users] **************************************************** ok: [gibba038.front.sepia.ceph.com] => 2021-11-12T05:34:56.252 INFO:teuthology.task.ansible.out: (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-11-12T05:34:56.262 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.264 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.274 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.276 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.285 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.287 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.297 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.308 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.310 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [gibba016.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-11-12T05:34:56.321 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-12T05:34:56.322 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.324 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.324 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.335 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.336 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.349 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.351 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [gibba038.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.362 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:56.363 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-11-12T05:34:56.363 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [gibba005.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-11-12T05:34:56.364 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-12T05:34:56.364 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovp 2021-11-12T05:34:56.365 INFO:teuthology.task.ansible.out:n": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.375 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.377 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.387 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.388 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.417 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:34:56.419 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-11-12T05:34:56.442 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:56 +0000 (0:00:00.398) 0:00:44.297 ******* 2021-11-12T05:34:56.450 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-11-12T05:34:56.464 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-11-12T05:34:56.464 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:56.465 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-11-12T05:34:56.509 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:34:56.511 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} TASK [Filter the revoked_users list] ******************************************* skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:34:56.534 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:34:56 +0000 (0:00:00.091) 0:00:44.389 ******* 2021-11-12T05:34:56.540 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:34:56.542 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-11-12T05:34:56.552 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-11-12T05:34:56.564 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:56.565 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1l 2021-11-12T05:34:56.566 INFO:teuthology.task.ansible.out:XTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-11-12T05:34:56.596 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:34:56.598 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-11-12T05:34:56.618 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-11-12T05:34:56.641 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-11-12T05:34:56.673 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:56.675 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-11-12T05:34:56.706 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:34:56.707 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-11-12T05:34:56.719 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-11-12T05:34:56.741 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-11-12T05:34:56.743 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-11-12T05:34:56.774 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:56.776 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-11-12T05:34:56.796 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:34:56.798 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-11-12T05:34:56.808 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-11-12T05:34:56.830 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-11-12T05:34:56.831 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-11-12T05:34:56.873 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:56.875 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-11-12T05:34:56.885 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:34:56.886 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-11-12T05:34:56.896 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-11-12T05:34:56.918 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-11-12T05:34:56.919 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-11-12T05:34:56.973 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-11-12T05:34:56.975 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08Rr 2021-11-12T05:34:56.977 INFO:teuthology.task.ansible.out:DQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-11-12T05:34:56.996 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:34:56.998 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-11-12T05:34:57.008 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-11-12T05:34:57.020 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-11-12T05:34:57.063 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-11-12T05:34:57.085 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-11-12T05:34:57.086 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-11-12T05:34:57.097 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:34:57.099 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-11-12T05:34:57.109 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-11-12T05:34:57.154 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-11-12T05:34:57.176 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-11-12T05:34:57.188 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-11-12T05:34:57.200 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:57.202 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} TASK [Remove revoked users] **************************************************** ok: [gibba005.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-11-12T05:34:57.255 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-11-12T05:34:57.287 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-11-12T05:34:57.289 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} ok: [gibba005.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-11-12T05:34:57.300 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:57.301 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-11-12T05:34:57.343 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:34:57.345 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-11-12T05:34:57.376 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-11-12T05:34:57.387 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-11-12T05:34:57.388 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-11-12T05:34:57.410 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:57.412 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-11-12T05:34:57.432 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:34:57.434 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-11-12T05:34:57.465 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-11-12T05:34:57.476 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-11-12T05:34:57.477 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-11-12T05:34:57.499 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:57.501 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-11-12T05:34:57.532 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:34:57.534 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-11-12T05:34:57.554 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-11-12T05:34:57.566 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-11-12T05:34:57.567 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-11-12T05:34:57.610 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:57.611 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-11-12T05:34:57.663 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:34:57.665 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} ok: [gibba016.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-11-12T05:34:57.665 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-11-12T05:34:57.677 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-11-12T05:34:57.710 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:57.712 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-11-12T05:34:57.764 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:34:57.767 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-11-12T05:34:57.768 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-11-12T05:34:57.770 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} ok: [gibba016.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-11-12T05:34:57.814 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:57.816 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loca 2021-11-12T05:34:57.818 INFO:teuthology.task.ansible.out:l", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-11-12T05:34:57.859 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:34:57.860 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} ok: [gibba016.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-11-12T05:34:57.861 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-11-12T05:34:57.872 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-11-12T05:34:57.906 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:57.908 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-11-12T05:34:57.952 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:34:57.954 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} ok: [gibba044.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} ok: [gibba038.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-11-12T05:34:57.997 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-11-12T05:34:58.008 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:58.010 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-11-12T05:34:58.040 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:34:58.042 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} ok: [gibba005.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-11-12T05:34:58.043 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-11-12T05:34:58.086 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-11-12T05:34:58.109 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:58.110 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-11-12T05:34:58.142 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:34:58.144 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} ok: [gibba038.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} ok: [gibba005.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-11-12T05:34:58.177 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-11-12T05:34:58.199 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:58.200 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-11-12T05:34:58.231 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:34:58.233 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} ok: [gibba005.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-11-12T05:34:58.245 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-11-12T05:34:58.277 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-11-12T05:34:58.311 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:58.313 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-11-12T05:34:58.323 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:34:58.324 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-11-12T05:34:58.334 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-11-12T05:34:58.367 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-11-12T05:34:58.400 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:58.402 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-11-12T05:34:58.411 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:34:58.413 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-11-12T05:34:58.423 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-11-12T05:34:58.425 INFO:teuthology.task.ansible.out: ok: [gibba005.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-11-12T05:34:58.458 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-11-12T05:34:58.501 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:58.503 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/y 2021-11-12T05:34:58.504 INFO:teuthology.task.ansible.out:BwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-11-12T05:34:58.513 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:34:58.514 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} ok: [gibba044.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-11-12T05:34:58.526 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-11-12T05:34:58.548 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-11-12T05:34:58.592 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:58.593 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-11-12T05:34:58.603 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:34:58.605 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} ok: [gibba044.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-11-12T05:34:58.627 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-11-12T05:34:58.638 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-11-12T05:34:58.639 INFO:teuthology.task.ansible.out: 2021-11-12T05:34:58.687 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:58.689 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-11-12T05:34:58.698 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:34:58.700 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} ok: [gibba044.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-11-12T05:34:58.722 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-11-12T05:34:58.743 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-11-12T05:34:58.797 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-11-12T05:34:58.799 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:58.799 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-11-12T05:34:58.831 INFO:teuthology.task.ansible.out: 2021-11-12T05:34:58.833 INFO:teuthology.task.ansible.out:TASK [Remove revoked users] **************************************************** ok: [gibba038.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-11-12T05:34:58.844 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-11-12T05:34:58.888 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-11-12T05:34:58.889 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-11-12T05:34:58.901 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:58.903 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-11-12T05:34:58.924 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:34:58.924 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-11-12T05:34:58.937 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-11-12T05:34:58.980 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-11-12T05:34:59.002 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:59.003 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-11-12T05:34:59.013 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:34:59.015 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} ok: [gibba038.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-11-12T05:34:59.036 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-11-12T05:34:59.070 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-11-12T05:34:59.091 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:59.093 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-11-12T05:34:59.103 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:34:59.105 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-11-12T05:34:59.115 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-11-12T05:34:59.137 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-11-12T05:34:59.159 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-11-12T05:34:59.191 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:59.193 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-11-12T05:34:59.202 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:34:59.204 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-11-12T05:34:59.225 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-11-12T05:34:59.257 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-11-12T05:34:59.258 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-11-12T05:34:59.279 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:59.281 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-11-12T05:34:59.301 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:34:59.303 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-11-12T05:34:59.323 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-11-12T05:34:59.345 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-11-12T05:34:59.356 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-11-12T05:34:59.388 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:59.390 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-11-12T05:34:59.400 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:34:59.402 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-11-12T05:34:59.422 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-11-12T05:34:59.444 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-11-12T05:34:59.477 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-11-12T05:34:59.488 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:59.490 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} TASK [Remove revoked users] **************************************************** ok: [gibba038.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-11-12T05:34:59.542 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-11-12T05:34:59.553 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-11-12T05:34:59.555 INFO:teuthology.task.ansible.out: 2021-11-12T05:34:59.565 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-11-12T05:34:59.577 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-11-12T05:34:59.578 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:59.579 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-11-12T05:34:59.632 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:34:59.633 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-11-12T05:34:59.654 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-11-12T05:34:59.665 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-11-12T05:34:59.676 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-11-12T05:34:59.709 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-11-12T05:34:59.720 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:34:59.722 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-11-12T05:34:59.742 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-11-12T05:34:59.754 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": false, "item": "davidz", "name": "davidz", "state": "absent"} 2021-11-12T05:34:59.765 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-11-12T05:34:59.808 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:59.809 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-11-12T05:34:59.819 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:34:59.821 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-11-12T05:34:59.831 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-11-12T05:34:59.843 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": false, "item": "wusui", "name": "wusui", "state": "absent"} 2021-11-12T05:34:59.854 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-11-12T05:34:59.907 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:59.909 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-11-12T05:34:59.918 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:34:59.920 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-11-12T05:34:59.930 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": false, "item": "nwatkins", "name": "nwatkins", "state": "absent"} 2021-11-12T05:34:59.962 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-11-12T05:34:59.974 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-11-12T05:34:59.996 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:34:59.998 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-11-12T05:35:00.018 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:00.020 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": false, "item": "sidharthanup", "name": "sidharthanup", "state": "absent"} 2021-11-12T05:35:00.051 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": false, "item": "davidz", "name": "davidz", "state": "absent"} 2021-11-12T05:35:00.063 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": false, "item": "davidz", "name": "davidz", "state": "absent"} 2021-11-12T05:35:00.065 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-11-12T05:35:00.096 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:35:00.098 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-11-12T05:35:00.118 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:00.120 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": false, "item": "varsha", "name": "varsha", "state": "absent"} 2021-11-12T05:35:00.151 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": false, "item": "wusui", "name": "wusui", "state": "absent"} 2021-11-12T05:35:00.152 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": false, "item": "wusui", "name": "wusui", "state": "absent"} 2021-11-12T05:35:00.154 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-11-12T05:35:00.196 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:35:00.197 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-11-12T05:35:00.208 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:00.209 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": false, "item": "hmunjulu", "name": "hmunjulu", "state": "absent"} 2021-11-12T05:35:00.241 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": false, "item": "nwatkins", "name": "nwatkins", "state": "absent"} 2021-11-12T05:35:00.243 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-11-12T05:35:00.296 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": false, "item": "nwatkins", "name": "nwatkins", "state": "absent"} 2021-11-12T05:35:00.298 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-11-12T05:35:00.308 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:00.311 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-11-12T05:35:00.330 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": false, "item": "sidharthanup", "name": "sidharthanup", "state": "absent"} 2021-11-12T05:35:00.342 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-11-12T05:35:00.384 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": false, "item": "sidharthanup", "name": "sidharthanup", "state": "absent"} 2021-11-12T05:35:00.406 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-11-12T05:35:00.417 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:35:00.419 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd 2021-11-12T05:35:00.420 INFO:teuthology.task.ansible.out:+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-11-12T05:35:00.429 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:00.431 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": false, "item": "davidz", "name": "davidz", "state": "absent"} 2021-11-12T05:35:00.442 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": false, "item": "varsha", "name": "varsha", "state": "absent"} 2021-11-12T05:35:00.475 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": false, "item": "varsha", "name": "varsha", "state": "absent"} 2021-11-12T05:35:00.497 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-11-12T05:35:00.518 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": false, "item": "wusui", "name": "wusui", "state": "absent"} 2021-11-12T05:35:00.530 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": false, "item": "hmunjulu", "name": "hmunjulu", "state": "absent"} 2021-11-12T05:35:00.541 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:35:00.542 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-11-12T05:35:00.573 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:00.575 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": false, "item": "hmunjulu", "name": "hmunjulu", "state": "absent"} 2021-11-12T05:35:00.585 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-11-12T05:35:00.618 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": false, "item": "nwatkins", "name": "nwatkins", "state": "absent"} 2021-11-12T05:35:00.619 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-11-12T05:35:00.662 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-11-12T05:35:00.674 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-11-12T05:35:00.697 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:35:00.699 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-11-12T05:35:00.709 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:00.710 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": false, "item": "sidharthanup", "name": "sidharthanup", "state": "absent"} ok: [gibba005.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-11-12T05:35:00.774 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-11-12T05:35:00.774 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-11-12T05:35:00.797 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": false, "item": "varsha", "name": "varsha", "state": "absent"} 2021-11-12T05:35:00.808 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-11-12T05:35:00.840 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:35:00.841 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-11-12T05:35:00.862 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:00.863 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-11-12T05:35:00.895 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-11-12T05:35:00.906 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-11-12T05:35:00.918 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": false, "item": "hmunjulu", "name": "hmunjulu", "state": "absent"} 2021-11-12T05:35:00.939 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:35:00.941 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-11-12T05:35:00.961 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:00.963 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-11-12T05:35:00.994 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-11-12T05:35:01.005 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-11-12T05:35:01.016 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-11-12T05:35:01.038 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:35:01.040 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-11-12T05:35:01.050 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:01.051 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-11-12T05:35:01.093 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-11-12T05:35:01.094 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-11-12T05:35:01.105 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-11-12T05:35:01.137 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:35:01.139 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} TASK [Remove revoked users] **************************************************** ok: [gibba016.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-11-12T05:35:01.182 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-11-12T05:35:01.184 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-11-12T05:35:01.216 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-11-12T05:35:01.241 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:01 +0000 (0:00:04.706) 0:00:49.095 ******* 2021-11-12T05:35:01.248 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:35:01.250 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-11-12T05:35:01.263 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:01.265 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-11-12T05:35:01.285 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-11-12T05:35:01.297 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-11-12T05:35:01.319 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:35:01.320 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-11-12T05:35:01.362 INFO:teuthology.task.ansible.out: 2021-11-12T05:35:01.364 INFO:teuthology.task.ansible.out:TASK [Remove revoked users] **************************************************** ok: [gibba016.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} ok: [gibba005.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-11-12T05:35:01.407 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-11-12T05:35:01.428 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:35:01.430 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-11-12T05:35:01.451 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:01.452 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-11-12T05:35:01.463 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-11-12T05:35:01.520 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:01 +0000 (0:00:00.279) 0:00:49.375 ******* 2021-11-12T05:35:01.528 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:35:01.530 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-11-12T05:35:01.530 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:01.530 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-11-12T05:35:01.543 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-11-12T05:35:01.608 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:01 +0000 (0:00:00.088) 0:00:49.463 ******* 2021-11-12T05:35:01.617 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:35:01.619 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-11-12T05:35:01.620 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:01.620 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-11-12T05:35:01.666 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-11-12T05:35:01.668 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "checksum": "b3b89f3dabc35f78585fcbe6afcac330df9308f6", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "69c3df528743245bb36ff3b8fc484a02", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1636695301.3242311-27837-189816681151620/source", "state": "file", "uid": 0} 2021-11-12T05:35:01.692 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:01 +0000 (0:00:00.083) 0:00:49.546 ******* 2021-11-12T05:35:01.710 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:01.712 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-11-12T05:35:01.722 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:35:01.724 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-11-12T05:35:01.755 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-11-12T05:35:01.757 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => { "msg": "Host gibba038.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-11-12T05:35:01.780 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:01 +0000 (0:00:00.088) 0:00:49.635 ******* 2021-11-12T05:35:01.807 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:01.809 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-11-12T05:35:01.819 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:35:01.821 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCoeyVaMjhcGrWQB+4Rq+SSIi8+OY/kx2s1vofiGt1gu3RNtFmG0Df1VITJJ32dbzaW7kTNxaRvhldNd/n7yEMssG+Wg+a5WKvSudlbVMmscbSXdFuVbcCW1jNrTGCYrxL7Sn5e7NQEQfAsCbfXwTcYBw33NdBVovC+gs2V3sZGvX3Y0akZONNuVg1mhu0L4m1/5IegJh005KeilwetHA2A5Dr10RG6oyIgT7t4z5gZXsrOiG3UQBXaekILYV9jxMWoFXGkVLc8TpL9SUAdxE3Owc0u1XiPqYYlEN+zDvE0554Zj8Oc2ZO6HRXCZXQFvzXeCD12YswcOfkIDmJRF7GT prashant@mauli", "key_options": null, "ke 2021-11-12T05:35:01.822 INFO:teuthology.task.ansible.out:yfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-11-12T05:35:01.852 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** ok: [gibba038.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-11-12T05:35:01.878 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:01 +0000 (0:00:00.098) 0:00:49.733 ******* 2021-11-12T05:35:01.896 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:01.898 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-11-12T05:35:01.930 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-11-12T05:35:01.932 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "checksum": "b3b89f3dabc35f78585fcbe6afcac330df9308f6", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "69c3df528743245bb36ff3b8fc484a02", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1636695301.6151786-27876-174298915726186/source", "state": "file", "uid": 0} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-11-12T05:35:01.955 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:01 +0000 (0:00:00.077) 0:00:49.810 ******* 2021-11-12T05:35:01.984 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:01 +0000 (0:00:00.028) 0:00:49.839 ******* 2021-11-12T05:35:01.991 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-11-12T05:35:01.993 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** changed: [gibba016.front.sepia.ceph.com] => {"changed": true, "checksum": "b3b89f3dabc35f78585fcbe6afcac330df9308f6", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "69c3df528743245bb36ff3b8fc484a02", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1636695301.6969352-27896-145198058298849/source", "state": "file", "uid": 0} 2021-11-12T05:35:02.021 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:02 +0000 (0:00:00.036) 0:00:49.875 ******* 2021-11-12T05:35:02.048 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:02 +0000 (0:00:00.026) 0:00:49.902 ******* 2021-11-12T05:35:02.055 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-11-12T05:35:02.057 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => { "msg": "Host gibba005.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-11-12T05:35:02.084 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:02 +0000 (0:00:00.036) 0:00:49.939 ******* 2021-11-12T05:35:02.093 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-11-12T05:35:02.095 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => { "msg": "Host gibba016.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-11-12T05:35:02.120 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:02 +0000 (0:00:00.036) 0:00:49.975 ******* 2021-11-12T05:35:02.127 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-11-12T05:35:02.129 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:02.154 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:02 +0000 (0:00:00.033) 0:00:50.008 ******* 2021-11-12T05:35:02.161 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:35:02.163 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_o 2021-11-12T05:35:02.164 INFO:teuthology.task.ansible.out:ptions": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} TASK [common : Including major version specific variables.] ******************** ok: [gibba005.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-11-12T05:35:02.190 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:02 +0000 (0:00:00.035) 0:00:50.044 ******* 2021-11-12T05:35:02.208 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-11-12T05:35:02.234 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:02 +0000 (0:00:00.044) 0:00:50.089 ******* 2021-11-12T05:35:02.241 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-11-12T05:35:02.243 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** changed: [gibba015.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt4sQTrDDg562IWY9Bw2fxFR7Y7b5lfo9egHa1qNFR5K4gt8lUwQXgzcxZK5dgSTZXHDGxrbYKWsdb8NbpgU/YjSqDUIptMZrhTI6pdHKZ2usY+nieaJj0NIZP/S7M93BbJeoNBYACjvDUr+vXEg6ZL3uAj+zFXr/4te+p4NqJBl4bSpvjcRK12O+F6HE3Q93j0Vlfs8IbXP4vcPcqOW+2usXw7JPdfjwuACJxrLTx/0mBsv8qXJDfOpPIHAMA/9SdTAzhs6XMo+fOwVOKkV+ki2fO3sl8pE16aFOkI3cYX36nkYYpZ2bJLnIPcLv37i3Nypl8eNLA4gzjkDf1o/KLO5vXOs76H189WGLqjh0SHAx/3KO6mrIhTq8Bv6YWoT3ntg22fXaxeajNhHcQ0bKZtGOAb0W1FcMRbSTkgEFAassYxlpTtuaCDIuA4fUVKW97Zu62eDDsSUtTWak/Yf940qAbptPPAw4ljmrvZRcjM9y6mGU8lKi5H4QoEOfbPok= nia@fedora", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-11-12T05:35:02.270 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:02 +0000 (0:00:00.035) 0:00:50.125 ******* 2021-11-12T05:35:02.278 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-11-12T05:35:02.280 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:02.306 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:02 +0000 (0:00:00.035) 0:00:50.161 ******* 2021-11-12T05:35:02.313 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:02.341 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:02 +0000 (0:00:00.034) 0:00:50.195 ******* 2021-11-12T05:35:02.349 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-11-12T05:35:02.351 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"changed": true, "checksum": "b3b89f3dabc35f78585fcbe6afcac330df9308f6", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "69c3df528743245bb36ff3b8fc484a02", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1636695302.0756688-27938-40347017016511/source", "state": "file", "uid": 0} 2021-11-12T05:35:02.351 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:02.353 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-11-12T05:35:02.384 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:02 +0000 (0:00:00.043) 0:00:50.239 ******* 2021-11-12T05:35:02.413 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:02 +0000 (0:00:00.028) 0:00:50.268 ******* 2021-11-12T05:35:02.419 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-11-12T05:35:02.421 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:02.447 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:02 +0000 (0:00:00.033) 0:00:50.301 ******* 2021-11-12T05:35:02.455 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:02.489 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:02 +0000 (0:00:00.042) 0:00:50.344 ******* 2021-11-12T05:35:02.497 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-11-12T05:35:02.498 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-11-12T05:35:02.499 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-11-12T05:35:02.499 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => { "msg": "Host gibba044.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-11-12T05:35:02.526 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:02 +0000 (0:00:00.036) 0:00:50.380 ******* 2021-11-12T05:35:02.550 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:02 +0000 (0:00:00.024) 0:00:50.404 ******* 2021-11-12T05:35:02.558 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-11-12T05:35:02.560 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:02.586 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:02 +0000 (0:00:00.036) 0:00:50.441 ******* 2021-11-12T05:35:02.612 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:02 +0000 (0:00:00.025) 0:00:50.467 ******* 2021-11-12T05:35:02.620 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-11-12T05:35:02.621 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:02.622 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-11-12T05:35:02.623 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** ok: [gibba044.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-11-12T05:35:02.650 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:02 +0000 (0:00:00.038) 0:00:50.505 ******* 2021-11-12T05:35:02.674 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:02 +0000 (0:00:00.023) 0:00:50.529 ******* 2021-11-12T05:35:02.682 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-11-12T05:35:02.684 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:02.714 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:02 +0000 (0:00:00.038) 0:00:50.568 ******* 2021-11-12T05:35:02.739 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:02 +0000 (0:00:00.025) 0:00:50.594 ******* 2021-11-12T05:35:02.749 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-11-12T05:35:02.750 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-11-12T05:35:02.776 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:02 +0000 (0:00:00.037) 0:00:50.631 ******* 2021-11-12T05:35:02.786 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-11-12T05:35:02.788 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:02.814 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:02 +0000 (0:00:00.037) 0:00:50.669 ******* 2021-11-12T05:35:02.820 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-11-12T05:35:02.822 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:02.848 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:02 +0000 (0:00:00.034) 0:00:50.703 ******* 2021-11-12T05:35:02.878 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:02 +0000 (0:00:00.030) 0:00:50.733 ******* 2021-11-12T05:35:02.886 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-11-12T05:35:02.888 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-11-12T05:35:02.889 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:02.915 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:02 +0000 (0:00:00.036) 0:00:50.770 ******* 2021-11-12T05:35:02.939 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:02 +0000 (0:00:00.023) 0:00:50.794 ******* 2021-11-12T05:35:02.947 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-11-12T05:35:02.949 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:02.976 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:02 +0000 (0:00:00.037) 0:00:50.831 ******* 2021-11-12T05:35:03.007 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:03 +0000 (0:00:00.030) 0:00:50.861 ******* 2021-11-12T05:35:03.015 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:35:03.016 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [gibba038.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-12T05:35:03.017 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-11-12T05:35:03.017 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:03.045 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:03 +0000 (0:00:00.037) 0:00:50.899 ******* 2021-11-12T05:35:03.069 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:03 +0000 (0:00:00.024) 0:00:50.924 ******* 2021-11-12T05:35:03.076 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-11-12T05:35:03.078 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:03.104 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:03 +0000 (0:00:00.035) 0:00:50.959 ******* 2021-11-12T05:35:03.128 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:03 +0000 (0:00:00.023) 0:00:50.982 ******* 2021-11-12T05:35:03.137 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:35:03.139 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} TASK [common : Set have_entitlements] ****************************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:03.166 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:03 +0000 (0:00:00.038) 0:00:51.021 ******* 2021-11-12T05:35:03.174 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-11-12T05:35:03.176 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:03.201 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:03 +0000 (0:00:00.034) 0:00:51.056 ******* 2021-11-12T05:35:03.207 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-11-12T05:35:03.209 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:03.235 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:03 +0000 (0:00:00.034) 0:00:51.090 ******* 2021-11-12T05:35:03.267 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:03 +0000 (0:00:00.031) 0:00:51.122 ******* 2021-11-12T05:35:03.276 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:35:03.277 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-11-12T05:35:03.278 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:03.304 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:03 +0000 (0:00:00.037) 0:00:51.159 ******* 2021-11-12T05:35:03.330 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:03 +0000 (0:00:00.024) 0:00:51.184 ******* 2021-11-12T05:35:03.342 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-11-12T05:35:03.344 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [gibba005.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-12T05:35:03.344 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-11-12T05:35:03.346 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [gibba016.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [gibba016.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-12T05:35:03.372 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:03 +0000 (0:00:00.042) 0:00:51.226 ******* 2021-11-12T05:35:03.394 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:03 +0000 (0:00:00.022) 0:00:51.249 ******* 2021-11-12T05:35:03.401 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* 2021-11-12T05:35:03.403 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:03.429 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:03 +0000 (0:00:00.034) 0:00:51.284 ******* 2021-11-12T05:35:03.453 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:03 +0000 (0:00:00.023) 0:00:51.307 ******* 2021-11-12T05:35:03.459 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:35:03.460 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-11-12T05:35:03.462 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:03.489 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:03 +0000 (0:00:00.036) 0:00:51.343 ******* 2021-11-12T05:35:03.512 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:03 +0000 (0:00:00.023) 0:00:51.366 ******* 2021-11-12T05:35:03.520 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-11-12T05:35:03.520 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-12T05:35:03.548 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:03 +0000 (0:00:00.036) 0:00:51.403 ******* 2021-11-12T05:35:03.555 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-11-12T05:35:03.557 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-11-12T05:35:03.585 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:03 +0000 (0:00:00.037) 0:00:51.440 ******* 2021-11-12T05:35:03.593 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-11-12T05:35:03.594 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:03.620 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:03 +0000 (0:00:00.034) 0:00:51.475 ******* 2021-11-12T05:35:03.627 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:03.629 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:03.661 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:03 +0000 (0:00:00.041) 0:00:51.516 ******* 2021-11-12T05:35:03.685 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:03 +0000 (0:00:00.023) 0:00:51.539 ******* 2021-11-12T05:35:03.693 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:35:03.695 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} TASK [common : Set entitlements_path] ****************************************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:03.696 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:03.722 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:03 +0000 (0:00:00.037) 0:00:51.577 ******* 2021-11-12T05:35:03.748 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:03 +0000 (0:00:00.025) 0:00:51.602 ******* 2021-11-12T05:35:03.755 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:03.756 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** skipping: [gibba038.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-12T05:35:03.782 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:03 +0000 (0:00:00.034) 0:00:51.637 ******* 2021-11-12T05:35:03.805 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:03 +0000 (0:00:00.022) 0:00:51.660 ******* 2021-11-12T05:35:03.813 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:35:03.814 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [gibba005.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-12T05:35:03.841 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:03 +0000 (0:00:00.035) 0:00:51.696 ******* 2021-11-12T05:35:03.848 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-11-12T05:35:03.850 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [gibba044.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [gibba016.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-12T05:35:03.877 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:03 +0000 (0:00:00.035) 0:00:51.731 ******* 2021-11-12T05:35:03.899 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:03 +0000 (0:00:00.022) 0:00:51.754 ******* 2021-11-12T05:35:03.906 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-11-12T05:35:03.909 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-11-12T05:35:03.909 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:03.936 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:03 +0000 (0:00:00.036) 0:00:51.791 ******* 2021-11-12T05:35:03.959 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:03 +0000 (0:00:00.022) 0:00:51.814 ******* 2021-11-12T05:35:03.977 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-11-12T05:35:03.979 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:04.003 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:04 +0000 (0:00:00.044) 0:00:51.858 ******* 2021-11-12T05:35:04.034 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:04 +0000 (0:00:00.030) 0:00:51.889 ******* 2021-11-12T05:35:04.042 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:35:04.044 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} TASK [common : Register with subscription-manager.] **************************** skipping: [gibba005.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : List CDN releases available to system] ************************** 2021-11-12T05:35:04.045 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:04.071 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:04 +0000 (0:00:00.036) 0:00:51.925 ******* 2021-11-12T05:35:04.093 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:04 +0000 (0:00:00.021) 0:00:51.947 ******* 2021-11-12T05:35:04.101 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-11-12T05:35:04.103 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-12T05:35:04.128 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:04 +0000 (0:00:00.035) 0:00:51.983 ******* 2021-11-12T05:35:04.135 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-11-12T05:35:04.137 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-11-12T05:35:04.137 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:04.164 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:04 +0000 (0:00:00.035) 0:00:52.019 ******* 2021-11-12T05:35:04.187 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:04 +0000 (0:00:00.022) 0:00:52.041 ******* 2021-11-12T05:35:04.193 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-11-12T05:35:04.195 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:04.222 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:04 +0000 (0:00:00.034) 0:00:52.076 ******* 2021-11-12T05:35:04.228 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-11-12T05:35:04.230 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-11-12T05:35:04.231 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:04.259 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:04 +0000 (0:00:00.037) 0:00:52.114 ******* 2021-11-12T05:35:04.289 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:04 +0000 (0:00:00.028) 0:00:52.142 ******* 2021-11-12T05:35:04.297 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* 2021-11-12T05:35:04.299 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:04.328 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:04 +0000 (0:00:00.039) 0:00:52.182 ******* 2021-11-12T05:35:04.360 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:04 +0000 (0:00:00.032) 0:00:52.214 ******* 2021-11-12T05:35:04.368 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:35:04.368 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2021-11-12T05:35:04.370 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : List CDN releases available to system] ************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:04.397 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:04 +0000 (0:00:00.036) 0:00:52.251 ******* 2021-11-12T05:35:04.429 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:04 +0000 (0:00:00.032) 0:00:52.284 ******* 2021-11-12T05:35:04.438 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-11-12T05:35:04.439 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [gibba044.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-12T05:35:04.441 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-11-12T05:35:04.468 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:04 +0000 (0:00:00.038) 0:00:52.323 ******* 2021-11-12T05:35:04.492 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:04 +0000 (0:00:00.024) 0:00:52.347 ******* 2021-11-12T05:35:04.501 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-11-12T05:35:04.503 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:04.531 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:04 +0000 (0:00:00.038) 0:00:52.386 ******* 2021-11-12T05:35:04.558 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:04 +0000 (0:00:00.027) 0:00:52.413 ******* 2021-11-12T05:35:04.566 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:35:04.567 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-11-12T05:35:04.568 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:04.569 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:04.596 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:04 +0000 (0:00:00.037) 0:00:52.451 ******* 2021-11-12T05:35:04.621 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:04 +0000 (0:00:00.025) 0:00:52.476 ******* 2021-11-12T05:35:04.629 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-11-12T05:35:04.630 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-12T05:35:04.657 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:04 +0000 (0:00:00.036) 0:00:52.512 ******* 2021-11-12T05:35:04.666 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-11-12T05:35:04.668 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-11-12T05:35:04.700 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:04 +0000 (0:00:00.042) 0:00:52.555 ******* 2021-11-12T05:35:04.707 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-11-12T05:35:04.709 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Register with subscription-manager.] **************************** skipping: [gibba044.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-12T05:35:04.738 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:04 +0000 (0:00:00.038) 0:00:52.593 ******* 2021-11-12T05:35:04.782 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:04 +0000 (0:00:00.043) 0:00:52.637 ******* 2021-11-12T05:35:04.790 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:35:04.792 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDM7LPHiaPQXdE+yt9cn7UMuRr8k/LjSUmMrnrAqp8ySQtX6OA3/NcOsxg6FJ45chZqeoXwhsYEW+7pTInDqFlOlmVynR26lWnZfk9DjBJZcloUCn8y5MR9QitNYsOMs5KwCEFmBH6sP+2vCFocXBnKQcVZLRfip3MEG4LoWYfI4ir7fLmK1Hr5G+GhtMstXvVSG4VE4IgbU9/LRIOv7P9qFn4bRJoUSiS2dDbUxVIuneA9bIEnB9ZEVGahEzlUhx6qDSs0FvrnneCQ1ayOFpxClzjT5GuKk/J3LJvWAw8CAwDXCf3FzsWQsvb5ru5VSazUI9uA3o9wWkbLW2oZPgtzI8lmwbL+MT58T92tqaJOPID3IZDGjzNrRqU5BQYpvFYHpHRRiqV625og+ktYfXgO+dTbgAxScomqutydI4cyJusDtnWtljWnEocS+2hUSZpmB6B3Wj70TuuzsbYrcrJ/NgRpQNX4dwHCJl6vPT+xkoLh1imYAC7klf7cnrOyGcs= choffman@choffman.net", "key_options": null, "keyfile": "/home/choffman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "choffman", "validate_certs": true} TASK [common : Clean yum cache] ************************************************ skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:04.815 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-12T05:35:04.851 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [gibba016.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-12T05:35:04.853 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:04.876 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:04 +0000 (0:00:00.094) 0:00:52.731 ******* 2021-11-12T05:35:04.899 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:04 +0000 (0:00:00.022) 0:00:52.754 ******* 2021-11-12T05:35:04.925 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:04 +0000 (0:00:00.025) 0:00:52.780 ******* 2021-11-12T05:35:04.951 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:04 +0000 (0:00:00.025) 0:00:52.806 ******* 2021-11-12T05:35:04.980 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:04 +0000 (0:00:00.029) 0:00:52.835 ******* 2021-11-12T05:35:04.991 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-11-12T05:35:04.993 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-12T05:35:04.994 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.033 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:05 +0000 (0:00:00.052) 0:00:52.887 ******* 2021-11-12T05:35:05.049 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-11-12T05:35:05.051 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.052 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-12T05:35:05.052 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.054 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.054 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.056 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-11-12T05:35:05.058 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.058 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.059 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.059 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis 2021-11-12T05:35:05.060 INFO:teuthology.task.ansible.out:.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} TASK [common : List CDN releases available to system] ************************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.088 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:05 +0000 (0:00:00.055) 0:00:52.943 ******* 2021-11-12T05:35:05.112 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:05 +0000 (0:00:00.023) 0:00:52.966 ******* 2021-11-12T05:35:05.135 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:05 +0000 (0:00:00.023) 0:00:52.990 ******* 2021-11-12T05:35:05.144 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-11-12T05:35:05.145 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.173 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:05 +0000 (0:00:00.037) 0:00:53.028 ******* 2021-11-12T05:35:05.181 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-12T05:35:05.183 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e19 2021-11-12T05:35:05.184 INFO:teuthology.task.ansible.out:02a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.185 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-11-12T05:35:05.185 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": " 2021-11-12T05:35:05.187 INFO:teuthology.task.ansible.out:Conditional result was False"} 2021-11-12T05:35:05.211 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:05 +0000 (0:00:00.038) 0:00:53.066 ******* 2021-11-12T05:35:05.234 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:05 +0000 (0:00:00.022) 0:00:53.088 ******* 2021-11-12T05:35:05.242 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-11-12T05:35:05.243 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.270 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:05 +0000 (0:00:00.035) 0:00:53.124 ******* 2021-11-12T05:35:05.293 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:05 +0000 (0:00:00.023) 0:00:53.148 ******* 2021-11-12T05:35:05.301 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-12T05:35:05.303 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-11-12T05:35:05.305 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-11-12T05:35:05.306 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-11-12T05:35:05.307 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.347 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:05 +0000 (0:00:00.053) 0:00:53.201 ******* 2021-11-12T05:35:05.388 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:05 +0000 (0:00:00.040) 0:00:53.242 ******* 2021-11-12T05:35:05.398 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-11-12T05:35:05.400 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [gibba015.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "va 2021-11-12T05:35:05.401 INFO:teuthology.task.ansible.out:lidate_certs": true} TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.402 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.se 2021-11-12T05:35:05.404 INFO:teuthology.task.ansible.out:pia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.429 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:05 +0000 (0:00:00.041) 0:00:53.283 ******* 2021-11-12T05:35:05.452 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:05 +0000 (0:00:00.023) 0:00:53.307 ******* 2021-11-12T05:35:05.460 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.463 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.464 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.466 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.466 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.468 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.468 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.469 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.470 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** skipping: [gibba038.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.503 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:05 +0000 (0:00:00.050) 0:00:53.357 ******* 2021-11-12T05:35:05.531 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:05 +0000 (0:00:00.028) 0:00:53.386 ******* 2021-11-12T05:35:05.545 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.546 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.547 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.549 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.549 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.551 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-11-12T05:35:05.551 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-12T05:35:05.553 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.555 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.585 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:05 +0000 (0:00:00.054) 0:00:53.440 ******* 2021-11-12T05:35:05.615 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:05 +0000 (0:00:00.029) 0:00:53.469 ******* 2021-11-12T05:35:05.625 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.626 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-11-12T05:35:05.627 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.627 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-12T05:35:05.627 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.629 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.629 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.631 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} TASK [common : Enable necessary rhsm repos] ************************************ skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.632 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.632 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9ca 2021-11-12T05:35:05.634 INFO:teuthology.task.ansible.out:c5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.659 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:05 +0000 (0:00:00.044) 0:00:53.514 ******* 2021-11-12T05:35:05.687 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:05 +0000 (0:00:00.027) 0:00:53.542 ******* 2021-11-12T05:35:05.696 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.696 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.698 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** skipping: [gibba005.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-12T05:35:05.699 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.700 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.700 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.702 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} TASK [common : Clean yum cache] ************************************************ skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.702 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.704 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.732 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:05 +0000 (0:00:00.044) 0:00:53.587 ******* 2021-11-12T05:35:05.760 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:05 +0000 (0:00:00.027) 0:00:53.615 ******* 2021-11-12T05:35:05.768 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.769 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.771 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.771 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.773 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-11-12T05:35:05.773 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.773 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.775 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.775 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.776 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos 2021-11-12T05:35:05.778 INFO:teuthology.task.ansible.out: TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.806 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:05 +0000 (0:00:00.045) 0:00:53.660 ******* 2021-11-12T05:35:05.831 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:05 +0000 (0:00:00.025) 0:00:53.686 ******* 2021-11-12T05:35:05.840 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.841 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.843 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} TASK [common : Enable necessary rhsm repos] ************************************ 2021-11-12T05:35:05.843 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.844 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-12T05:35:05.844 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.846 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.846 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.847 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.847 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", " 2021-11-12T05:35:05.849 INFO:teuthology.task.ansible.out:changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.876 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:05 +0000 (0:00:00.045) 0:00:53.731 ******* 2021-11-12T05:35:05.886 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.887 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-11-12T05:35:05.887 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.887 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.889 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.889 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** skipping: [gibba016.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-12T05:35:05.890 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516 2021-11-12T05:35:05.892 INFO:teuthology.task.ansible.out:664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.892 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.920 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:05 +0000 (0:00:00.043) 0:00:53.774 ******* 2021-11-12T05:35:05.956 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:05 +0000 (0:00:00.035) 0:00:53.810 ******* 2021-11-12T05:35:05.966 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.967 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-11-12T05:35:05.968 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.968 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.970 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.970 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.971 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:05.971 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_lo 2021-11-12T05:35:05.973 INFO:teuthology.task.ansible.out:op_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.001 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:05 +0000 (0:00:00.045) 0:00:53.856 ******* 2021-11-12T05:35:06.028 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:06 +0000 (0:00:00.026) 0:00:53.883 ******* 2021-11-12T05:35:06.038 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.040 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.040 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.041 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-12T05:35:06.041 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.041 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.043 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.045 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.045 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.046 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-12T05:35:06.046 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.047 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.048 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.076 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:06 +0000 (0:00:00.047) 0:00:53.931 ******* 2021-11-12T05:35:06.102 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:06 +0000 (0:00:00.025) 0:00:53.956 ******* 2021-11-12T05:35:06.110 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.111 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.112 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.112 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.114 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.114 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.115 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.115 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-11-12T05:35:06.115 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': ' 2021-11-12T05:35:06.120 INFO:teuthology.task.ansible.out:priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.143 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:06 +0000 (0:00:00.041) 0:00:53.998 ******* 2021-11-12T05:35:06.152 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-12T05:35:06.153 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.154 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.156 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.156 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.183 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:06 +0000 (0:00:00.039) 0:00:54.037 ******* 2021-11-12T05:35:06.206 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:06 +0000 (0:00:00.023) 0:00:54.061 ******* 2021-11-12T05:35:06.214 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.215 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.216 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.217 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-12T05:35:06.217 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.217 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.219 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.220 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.221 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** skipping: [gibba005.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.222 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.222 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** skipping: [gibba005.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-t 2021-11-12T05:35:06.224 INFO:teuthology.task.ansible.out:esting", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.249 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:06 +0000 (0:00:00.042) 0:00:54.104 ******* 2021-11-12T05:35:06.272 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:06 +0000 (0:00:00.022) 0:00:54.126 ******* 2021-11-12T05:35:06.280 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-12T05:35:06.281 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.281 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.283 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} TASK [common : Increase the yum timeout.] ************************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-12T05:35:06.284 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.284 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.284 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb27174 2021-11-12T05:35:06.286 INFO:teuthology.task.ansible.out:7a"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} TASK [common : Configure local epel mirrorlists] ******************************* skipping: [gibba038.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.286 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* skipping: [gibba038.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.312 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:06 +0000 (0:00:00.040) 0:00:54.167 ******* 2021-11-12T05:35:06.321 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-12T05:35:06.322 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.323 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.351 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:06 +0000 (0:00:00.038) 0:00:54.206 ******* 2021-11-12T05:35:06.360 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.362 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} TASK [common : Configure local epel mirrorlists] ******************************* skipping: [gibba005.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.364 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.365 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.366 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.368 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.368 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.368 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.369 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"} 2021-11-12T05:35:06.370 INFO:teuthology.task.ansible.out:, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.404 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:06 +0000 (0:00:00.052) 0:00:54.258 ******* 2021-11-12T05:35:06.429 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:06 +0000 (0:00:00.025) 0:00:54.284 ******* 2021-11-12T05:35:06.438 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.440 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.460 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-11-12T05:35:06.462 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.463 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.488 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:06 +0000 (0:00:00.058) 0:00:54.342 ******* 2021-11-12T05:35:06.511 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:06 +0000 (0:00:00.023) 0:00:54.366 ******* 2021-11-12T05:35:06.534 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:06 +0000 (0:00:00.023) 0:00:54.389 ******* 2021-11-12T05:35:06.542 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.543 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.569 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:06 +0000 (0:00:00.035) 0:00:54.424 ******* 2021-11-12T05:35:06.595 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:06 +0000 (0:00:00.026) 0:00:54.450 ******* 2021-11-12T05:35:06.602 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* 2021-11-12T05:35:06.604 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure local epel mirrorlists] ******************************* skipping: [gibba016.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.633 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:06 +0000 (0:00:00.037) 0:00:54.487 ******* 2021-11-12T05:35:06.664 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:06 +0000 (0:00:00.031) 0:00:54.519 ******* 2021-11-12T05:35:06.676 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-11-12T05:35:06.677 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-12T05:35:06.724 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:06 +0000 (0:00:00.060) 0:00:54.579 ******* 2021-11-12T05:35:06.743 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-11-12T05:35:06.745 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.010676", "end": "2021-11-12 05:35:06.620701", "rc": 0, "start": "2021-11-12 05:35:06.610025", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} TASK [common : Clean yum cache] ************************************************ skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.745 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.020369", "end": "2021-11-12 05:35:06.717377", "rc": 0, "start": "2021-11-12 05:35:06.697008", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-11-12T05:35:06.773 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:06 +0000 (0:00:00.048) 0:00:54.627 ******* 2021-11-12T05:35:06.797 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:06 +0000 (0:00:00.024) 0:00:54.652 ******* 2021-11-12T05:35:06.822 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:06 +0000 (0:00:00.024) 0:00:54.676 ******* 2021-11-12T05:35:06.829 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-11-12T05:35:06.831 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Remove revoked users] **************************************************** ok: [gibba015.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-11-12T05:35:06.858 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:06 +0000 (0:00:00.036) 0:00:54.712 ******* 2021-11-12T05:35:06.864 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-11-12T05:35:06.866 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.892 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:06 +0000 (0:00:00.034) 0:00:54.747 ******* 2021-11-12T05:35:06.899 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.927 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:06 +0000 (0:00:00.034) 0:00:54.781 ******* 2021-11-12T05:35:06.934 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:06.936 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:06.964 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:06 +0000 (0:00:00.036) 0:00:54.818 ******* 2021-11-12T05:35:06.977 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-11-12T05:35:06.979 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.007631", "end": "2021-11-12 05:35:06.634580", "rc": 0, "start": "2021-11-12 05:35:06.626949", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} TASK [common : Inform the OS of the new timezone] ****************************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:07.007 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:07 +0000 (0:00:00.043) 0:00:54.861 ******* 2021-11-12T05:35:07.030 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:07 +0000 (0:00:00.022) 0:00:54.884 ******* 2021-11-12T05:35:07.039 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:07.040 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-11-12T05:35:07.041 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Increase the yum timeout.] ************************************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:07.068 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:07 +0000 (0:00:00.038) 0:00:54.923 ******* 2021-11-12T05:35:07.094 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:07 +0000 (0:00:00.025) 0:00:54.948 ******* 2021-11-12T05:35:07.116 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:07.118 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:07.153 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:07 +0000 (0:00:00.058) 0:00:55.007 ******* 2021-11-12T05:35:07.184 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-11-12T05:35:07.186 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:07.196 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:07.198 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:07.198 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-11-12T05:35:07.225 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:07 +0000 (0:00:00.072) 0:00:55.080 ******* 2021-11-12T05:35:07.231 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-11-12T05:35:07.233 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:07.260 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:07 +0000 (0:00:00.034) 0:00:55.114 ******* 2021-11-12T05:35:07.290 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:07.291 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-11-12T05:35:07.302 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-11-12T05:35:07.304 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-11-12T05:35:07.330 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:07 +0000 (0:00:00.070) 0:00:55.185 ******* 2021-11-12T05:35:07.391 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:07.393 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-11-12T05:35:07.414 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:07.440 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:07 +0000 (0:00:00.109) 0:00:55.294 ******* 2021-11-12T05:35:07.511 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:07.513 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-11-12T05:35:07.609 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-11-12T05:35:07.611 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.008675", "end": "2021-11-12 05:35:07.349306", "rc": 0, "start": "2021-11-12 05:35:07.340631", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} TASK [Remove revoked users] **************************************************** ok: [gibba015.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-11-12T05:35:07.634 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:07 +0000 (0:00:00.194) 0:00:55.489 ******* 2021-11-12T05:35:07.636 INFO:teuthology.task.ansible.out: 2021-11-12T05:35:07.695 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-11-12T05:35:07.696 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "grub-common.service grub-initrd-fallback.service", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/sleep.target", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked", "Wants": "grub-initrd-fallback.service grub-common.service"}} ok: [gibba016.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "grub-common.service grub-initrd-fallback.service", "CanIsolate": "no", "CanRe 2021-11-12T05:35:07.698 INFO:teuthology.task.ansible.out:load": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/sleep.target", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked", "Wants": "grub-common.service grub-initrd-fallback.service"}} 2021-11-12T05:35:07.709 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "grub-initrd-fallback.service grub-common.service", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/sleep.target", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked", "Wants": "grub-common.service grub-initrd-fallback.service"}} 2021-11-12T05:35:07.709 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:07.710 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-11-12T05:35:07.721 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-11-12T05:35:07.723 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:07.746 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:07 +0000 (0:00:00.111) 0:00:55.601 ******* 2021-11-12T05:35:07.797 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:07.798 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-11-12T05:35:07.821 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** ok: [gibba038.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/suspend.target", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-12T05:35:07.822 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/suspend.target", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-12T05:35:07.824 INFO:teuthology.task.ansible.out: 2021-11-12T05:35:07.836 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-11-12T05:35:07.838 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Mask sleep units] *********************************************** ok: [gibba005.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/suspend.target", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-12T05:35:07.862 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:07 +0000 (0:00:00.116) 0:00:55.717 ******* 2021-11-12T05:35:07.935 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:07.936 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-11-12T05:35:07.946 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-11-12T05:35:07.948 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hibernate.target", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-12T05:35:07.969 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hibernate.target", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-12T05:35:07.971 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hibernate.target", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-12T05:35:08.027 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:08.029 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-11-12T05:35:08.061 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-11-12T05:35:08.063 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hybrid-sleep.target", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-12T05:35:08.091 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:08 +0000 (0:00:00.228) 0:00:55.945 ******* 2021-11-12T05:35:08.111 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hybrid-sleep.target", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-12T05:35:08.140 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:08 +0000 (0:00:00.049) 0:00:55.995 ******* 2021-11-12T05:35:08.148 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:08.150 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} TASK [common : Mask sleep units] *********************************************** 2021-11-12T05:35:08.151 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hybrid-sleep.target", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-12T05:35:08.184 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:08 +0000 (0:00:00.043) 0:00:56.038 ******* 2021-11-12T05:35:08.214 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:08.215 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-11-12T05:35:08.237 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-11-12T05:35:08.239 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "grub-initrd-fallback.service grub-common.service", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/sleep.target", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked", "Wants": "grub-initrd-fallback.service grub-common.service"}} 2021-11-12T05:35:08.302 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:08.481 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:08 +0000 (0:00:00.296) 0:00:56.335 ******* 2021-11-12T05:35:08.489 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:08.490 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} TASK [common : Mask sleep units] *********************************************** 2021-11-12T05:35:08.492 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/suspend.target", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} TASK [common : Get the current timezone] *************************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:08.492 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:08.494 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [gibba015.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-11-12T05:35:08.494 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** ok: [gibba044.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hibernate.target", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-12T05:35:08.521 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:08 +0000 (0:00:00.040) 0:00:56.376 ******* 2021-11-12T05:35:08.547 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:08 +0000 (0:00:00.025) 0:00:56.401 ******* 2021-11-12T05:35:08.554 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:08.555 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-11-12T05:35:08.557 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:08.583 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:08 +0000 (0:00:00.036) 0:00:56.438 ******* 2021-11-12T05:35:08.602 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:08.603 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [gibba015.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} TASK [common : Mask sleep units] *********************************************** 2021-11-12T05:35:08.604 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hybrid-sleep.target", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-12T05:35:08.634 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:08 +0000 (0:00:00.050) 0:00:56.489 ******* 2021-11-12T05:35:08.673 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:08 +0000 (0:00:00.038) 0:00:56.527 ******* 2021-11-12T05:35:08.682 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-11-12T05:35:08.684 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:08.710 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:08 +0000 (0:00:00.037) 0:00:56.565 ******* 2021-11-12T05:35:08.735 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:08 +0000 (0:00:00.024) 0:00:56.590 ******* 2021-11-12T05:35:08.743 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:08.744 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:08.744 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-11-12T05:35:08.746 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:08.774 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:08 +0000 (0:00:00.038) 0:00:56.629 ******* 2021-11-12T05:35:08.810 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:08 +0000 (0:00:00.036) 0:00:56.665 ******* 2021-11-12T05:35:08.818 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-11-12T05:35:08.820 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:08.852 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:08 +0000 (0:00:00.041) 0:00:56.707 ******* 2021-11-12T05:35:08.876 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:08 +0000 (0:00:00.023) 0:00:56.731 ******* 2021-11-12T05:35:08.886 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:08.888 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set the timezone] *********************************************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:08.914 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:08 +0000 (0:00:00.037) 0:00:56.769 ******* 2021-11-12T05:35:08.938 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:08 +0000 (0:00:00.024) 0:00:56.793 ******* 2021-11-12T05:35:08.945 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-11-12T05:35:08.947 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Remove revoked users] **************************************************** ok: [gibba015.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-11-12T05:35:08.947 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:08.976 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:08 +0000 (0:00:00.037) 0:00:56.831 ******* 2021-11-12T05:35:08.999 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:08 +0000 (0:00:00.022) 0:00:56.853 ******* 2021-11-12T05:35:09.005 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-11-12T05:35:09.007 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:09.033 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:09 +0000 (0:00:00.034) 0:00:56.888 ******* 2021-11-12T05:35:09.057 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:09 +0000 (0:00:00.023) 0:00:56.912 ******* 2021-11-12T05:35:09.065 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:09.066 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-11-12T05:35:09.077 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-11-12T05:35:09.079 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:09.104 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:09 +0000 (0:00:00.047) 0:00:56.959 ******* 2021-11-12T05:35:09.124 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-11-12T05:35:09.125 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:09.158 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:09 +0000 (0:00:00.053) 0:00:57.013 ******* 2021-11-12T05:35:09.170 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:09.171 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-11-12T05:35:09.237 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-11-12T05:35:09.239 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:09.265 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:09 +0000 (0:00:00.107) 0:00:57.120 ******* 2021-11-12T05:35:09.297 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:09.298 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-11-12T05:35:09.384 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-11-12T05:35:09.502 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-11-12T05:35:09.525 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-11-12T05:35:09.526 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.387040", "end": "2021-11-12 05:35:09.500919", "rc": 0, "start": "2021-11-12 05:35:09.113879", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:35:09.559 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:09 +0000 (0:00:00.293) 0:00:57.414 ******* 2021-11-12T05:35:09.579 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.372821", "end": "2021-11-12 05:35:09.500929", "rc": 0, "start": "2021-11-12 05:35:09.128108", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:35:09.606 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:09 +0000 (0:00:00.047) 0:00:57.461 ******* 2021-11-12T05:35:09.616 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:09.618 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-11-12T05:35:09.639 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:09.666 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:09 +0000 (0:00:00.059) 0:00:57.520 ******* 2021-11-12T05:35:09.685 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:09.687 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [gibba015.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-11-12T05:35:09.719 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:09 +0000 (0:00:00.053) 0:00:57.573 ******* 2021-11-12T05:35:09.753 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-11-12T05:35:09.755 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.380863", "end": "2021-11-12 05:35:09.500901", "rc": 0, "start": "2021-11-12 05:35:09.120038", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:35:09.780 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:09 +0000 (0:00:00.061) 0:00:57.634 ******* 2021-11-12T05:35:09.809 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.738094", "end": "2021-11-12 05:35:09.500878", "rc": 0, "start": "2021-11-12 05:35:08.762784", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:35:09.851 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:09 +0000 (0:00:00.071) 0:00:57.706 ******* 2021-11-12T05:35:09.863 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:09.865 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} TASK [common : Install Kerberos Packages (RedHat)] ***************************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:09.894 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:09 +0000 (0:00:00.042) 0:00:57.749 ******* 2021-11-12T05:35:09.901 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-11-12T05:35:09.902 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2021-11-12T05:35:09.903 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.079042", "end": "2021-11-12 05:35:09.870615", "rc": 0, "start": "2021-11-12 05:35:09.791573", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:35:09.939 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:09 +0000 (0:00:00.044) 0:00:57.793 ******* 2021-11-12T05:35:09.952 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [gibba015.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-11-12T05:35:09.953 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:09.985 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:09 +0000 (0:00:00.046) 0:00:57.840 ******* 2021-11-12T05:35:10.026 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:10.028 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-11-12T05:35:10.082 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-11-12T05:35:10.084 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.193880", "end": "2021-11-12 05:35:09.994649", "rc": 0, "start": "2021-11-12 05:35:09.800769", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:35:10.107 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:10 +0000 (0:00:00.122) 0:00:57.962 ******* 2021-11-12T05:35:10.169 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:10.171 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} TASK [common : Clean apt cache] ************************************************ changed: [gibba044.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.120386", "end": "2021-11-12 05:35:09.899380", "rc": 0, "start": "2021-11-12 05:35:09.778994", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:35:10.208 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:10 +0000 (0:00:00.100) 0:00:58.062 ******* 2021-11-12T05:35:10.281 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:10.282 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-11-12T05:35:10.316 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-11-12T05:35:10.318 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.159479", "end": "2021-11-12 05:35:09.986202", "rc": 0, "start": "2021-11-12 05:35:09.826723", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:35:10.345 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:10 +0000 (0:00:00.137) 0:00:58.199 ******* 2021-11-12T05:35:10.385 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-12T05:35:10.387 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-11-12T05:35:10.472 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-11-12T05:35:10.569 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-11-12T05:35:10.662 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-11-12T05:35:10.780 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-11-12T05:35:10.875 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": false, "item": "davidz", "name": "davidz", "state": "absent"} 2021-11-12T05:35:10.970 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": false, "item": "wusui", "name": "wusui", "state": "absent"} 2021-11-12T05:35:11.086 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": false, "item": "nwatkins", "name": "nwatkins", "state": "absent"} 2021-11-12T05:35:11.171 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": false, "item": "sidharthanup", "name": "sidharthanup", "state": "absent"} 2021-11-12T05:35:11.298 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": false, "item": "varsha", "name": "varsha", "state": "absent"} 2021-11-12T05:35:11.384 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": false, "item": "hmunjulu", "name": "hmunjulu", "state": "absent"} 2021-11-12T05:35:11.481 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-11-12T05:35:11.567 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-11-12T05:35:11.653 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-11-12T05:35:11.749 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-11-12T05:35:11.846 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-11-12T05:35:11.930 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-11-12T05:35:12.028 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-11-12T05:35:12.154 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-11-12T05:35:12.250 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-11-12T05:35:12.387 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-11-12T05:35:12.444 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:12 +0000 (0:00:02.098) 0:01:00.298 ******* 2021-11-12T05:35:12.834 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-11-12T05:35:12.836 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"changed": true, "checksum": "b3b89f3dabc35f78585fcbe6afcac330df9308f6", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "69c3df528743245bb36ff3b8fc484a02", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1636695312.5376887-29214-200935393379281/source", "state": "file", "uid": 0} 2021-11-12T05:35:12.860 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:12 +0000 (0:00:00.415) 0:01:00.714 ******* 2021-11-12T05:35:12.930 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-11-12T05:35:12.931 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => { "msg": "Host gibba015.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-11-12T05:35:12.954 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:12 +0000 (0:00:00.094) 0:01:00.809 ******* 2021-11-12T05:35:13.034 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-11-12T05:35:13.036 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} TASK [common : Update apt cache] *********************************************** ok: [gibba005.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1636694779, "cache_updated": false, "changed": false} 2021-11-12T05:35:13.060 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:13 +0000 (0:00:00.105) 0:01:00.915 ******* 2021-11-12T05:35:13.086 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:13 +0000 (0:00:00.026) 0:01:00.941 ******* 2021-11-12T05:35:13.108 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1636694933, "cache_updated": false, "changed": false} 2021-11-12T05:35:13.136 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:13 +0000 (0:00:00.050) 0:01:00.991 ******* 2021-11-12T05:35:13.166 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-11-12T05:35:13.168 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:13.192 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:13 +0000 (0:00:00.055) 0:01:01.046 ******* 2021-11-12T05:35:13.261 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-11-12T05:35:13.263 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:13.285 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:13 +0000 (0:00:00.093) 0:01:01.140 ******* 2021-11-12T05:35:13.354 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-11-12T05:35:13.356 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:13.378 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:13 +0000 (0:00:00.093) 0:01:01.233 ******* 2021-11-12T05:35:13.448 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-11-12T05:35:13.449 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:13.471 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:13 +0000 (0:00:00.093) 0:01:01.326 ******* 2021-11-12T05:35:13.540 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-11-12T05:35:13.542 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1636694984, "cache_updated": false, "changed": false} TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:13.570 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:13 +0000 (0:00:00.098) 0:01:01.425 ******* 2021-11-12T05:35:13.593 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:13 +0000 (0:00:00.023) 0:01:01.448 ******* 2021-11-12T05:35:13.600 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-11-12T05:35:13.602 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"cache_update_time": 1636694779, "cache_updated": false, "changed": false} 2021-11-12T05:35:13.631 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:13 +0000 (0:00:00.038) 0:01:01.486 ******* 2021-11-12T05:35:13.638 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1636694933, "cache_updated": false, "changed": false} 2021-11-12T05:35:13.639 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-11-12T05:35:13.639 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:13.668 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:13 +0000 (0:00:00.036) 0:01:01.523 ******* 2021-11-12T05:35:13.690 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:13 +0000 (0:00:00.022) 0:01:01.545 ******* 2021-11-12T05:35:13.697 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-11-12T05:35:13.699 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1636694883, "cache_updated": false, "changed": false} TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:13.724 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:13 +0000 (0:00:00.034) 0:01:01.579 ******* 2021-11-12T05:35:13.749 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:13 +0000 (0:00:00.023) 0:01:01.603 ******* 2021-11-12T05:35:13.755 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-11-12T05:35:13.756 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:13.782 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:13 +0000 (0:00:00.033) 0:01:01.637 ******* 2021-11-12T05:35:13.804 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:13 +0000 (0:00:00.022) 0:01:01.659 ******* 2021-11-12T05:35:13.877 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-11-12T05:35:13.879 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:13.905 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:13 +0000 (0:00:00.100) 0:01:01.760 ******* 2021-11-12T05:35:13.998 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [gibba015.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-12T05:35:14.000 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-12T05:35:14.022 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:14 +0000 (0:00:00.117) 0:01:01.877 ******* 2021-11-12T05:35:14.030 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-11-12T05:35:14.032 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-11-12T05:35:14.059 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:14 +0000 (0:00:00.036) 0:01:01.914 ******* 2021-11-12T05:35:14.088 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-11-12T05:35:14.090 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"cache_update_time": 1636694984, "cache_updated": false, "changed": false} 2021-11-12T05:35:14.120 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:14 +0000 (0:00:00.061) 0:01:01.975 ******* 2021-11-12T05:35:14.129 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-11-12T05:35:14.130 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Add krb5 config file] ******************************************* ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-11-12T05:35:14.158 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:14 +0000 (0:00:00.037) 0:01:02.013 ******* 2021-11-12T05:35:14.185 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:14 +0000 (0:00:00.026) 0:01:02.040 ******* 2021-11-12T05:35:14.195 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-11-12T05:35:14.197 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:14.226 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:14 +0000 (0:00:00.040) 0:01:02.081 ******* 2021-11-12T05:35:14.233 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-11-12T05:35:14.234 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:14.261 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:14 +0000 (0:00:00.034) 0:01:02.115 ******* 2021-11-12T05:35:14.278 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-11-12T05:35:14.280 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"cache_update_time": 1636694883, "cache_updated": false, "changed": false} 2021-11-12T05:35:14.305 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:14 +0000 (0:00:00.044) 0:01:02.159 ******* 2021-11-12T05:35:14.334 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* 2021-11-12T05:35:14.336 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:14.360 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:14 +0000 (0:00:00.054) 0:01:02.214 ******* 2021-11-12T05:35:14.377 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-11-12T05:35:14.379 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:14.404 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:14 +0000 (0:00:00.044) 0:01:02.259 ******* 2021-11-12T05:35:14.432 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-11-12T05:35:14.434 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-12T05:35:14.458 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:14 +0000 (0:00:00.054) 0:01:02.313 ******* 2021-11-12T05:35:14.518 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-11-12T05:35:14.520 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-11-12T05:35:14.543 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:14 +0000 (0:00:00.085) 0:01:02.398 ******* 2021-11-12T05:35:14.550 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-11-12T05:35:14.552 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Make sure smartmontools is installed] *************************** ok: [gibba005.front.sepia.ceph.com] => {"cache_update_time": 1636694779, "cache_updated": false, "changed": false} 2021-11-12T05:35:14.578 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:14 +0000 (0:00:00.034) 0:01:02.433 ******* 2021-11-12T05:35:14.600 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:14 +0000 (0:00:00.022) 0:01:02.455 ******* 2021-11-12T05:35:14.672 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1636694933, "cache_updated": false, "changed": false} 2021-11-12T05:35:14.702 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:14 +0000 (0:00:00.101) 0:01:02.557 ******* 2021-11-12T05:35:14.710 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-11-12T05:35:14.712 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Add krb5 config file] ******************************************* ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-11-12T05:35:14.738 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:14 +0000 (0:00:00.036) 0:01:02.593 ******* 2021-11-12T05:35:14.763 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:14 +0000 (0:00:00.025) 0:01:02.618 ******* 2021-11-12T05:35:14.813 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-11-12T05:35:14.815 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:14.841 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:14 +0000 (0:00:00.077) 0:01:02.696 ******* 2021-11-12T05:35:14.901 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-11-12T05:35:14.903 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:14.926 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:14 +0000 (0:00:00.084) 0:01:02.781 ******* 2021-11-12T05:35:14.933 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-11-12T05:35:14.935 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-11-12T05:35:14.987 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:15.012 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:15 +0000 (0:00:00.086) 0:01:02.867 ******* 2021-11-12T05:35:15.073 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-11-12T05:35:15.075 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-11-12T05:35:15.076 INFO:teuthology.task.ansible.out:TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:15.102 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:15 +0000 (0:00:00.089) 0:01:02.957 ******* 2021-11-12T05:35:15.110 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-11-12T05:35:15.112 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"cache_update_time": 1636694984, "cache_updated": false, "changed": false} 2021-11-12T05:35:15.139 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:15 +0000 (0:00:00.037) 0:01:02.994 ******* 2021-11-12T05:35:15.168 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-11-12T05:35:15.170 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [gibba015.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-12T05:35:15.197 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:15 +0000 (0:00:00.057) 0:01:03.051 ******* 2021-11-12T05:35:15.269 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-11-12T05:35:15.271 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"cache_update_time": 1636694883, "cache_updated": false, "changed": false} TASK [common : Clean yum cache] ************************************************ skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:15.294 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:15 +0000 (0:00:00.097) 0:01:03.149 ******* 2021-11-12T05:35:15.318 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:15 +0000 (0:00:00.023) 0:01:03.173 ******* 2021-11-12T05:35:15.326 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-11-12T05:35:15.328 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-11-12T05:35:15.372 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-11-12T05:35:15.373 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:15.403 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:15 +0000 (0:00:00.084) 0:01:03.257 ******* 2021-11-12T05:35:15.411 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-11-12T05:35:15.413 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-11-12T05:35:15.448 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:15 +0000 (0:00:00.045) 0:01:03.302 ******* 2021-11-12T05:35:15.476 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-11-12T05:35:15.478 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:15.503 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:15 +0000 (0:00:00.055) 0:01:03.358 ******* 2021-11-12T05:35:15.510 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-11-12T05:35:15.512 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-11-12T05:35:15.513 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-11-12T05:35:15.552 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:15 +0000 (0:00:00.049) 0:01:03.407 ******* 2021-11-12T05:35:15.561 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-11-12T05:35:15.563 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-11-12T05:35:15.590 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:15 +0000 (0:00:00.037) 0:01:03.445 ******* 2021-11-12T05:35:15.598 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-11-12T05:35:15.600 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:15.627 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:15 +0000 (0:00:00.036) 0:01:03.481 ******* 2021-11-12T05:35:15.644 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-11-12T05:35:15.646 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-11-12T05:35:15.688 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-11-12T05:35:15.690 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-11-12T05:35:15.713 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:15 +0000 (0:00:00.086) 0:01:03.568 ******* 2021-11-12T05:35:15.720 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-11-12T05:35:15.721 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [gibba044.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-11-12T05:35:15.747 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:15 +0000 (0:00:00.034) 0:01:03.602 ******* 2021-11-12T05:35:15.831 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-11-12T05:35:15.833 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:15.855 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:15 +0000 (0:00:00.107) 0:01:03.710 ******* 2021-11-12T05:35:15.886 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-11-12T05:35:15.888 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-11-12T05:35:15.899 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-11-12T05:35:15.900 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-11-12T05:35:15.932 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-11-12T05:35:15.933 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-12T05:35:15.956 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:15 +0000 (0:00:00.100) 0:01:03.811 ******* 2021-11-12T05:35:15.964 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-11-12T05:35:15.966 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-11-12T05:35:15.994 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:15 +0000 (0:00:00.038) 0:01:03.849 ******* 2021-11-12T05:35:16.013 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-11-12T05:35:16.013 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-11-12T05:35:16.035 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:16.062 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:16 +0000 (0:00:00.067) 0:01:03.917 ******* 2021-11-12T05:35:16.080 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-11-12T05:35:16.083 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-11-12T05:35:16.103 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-11-12T05:35:16.105 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-11-12T05:35:16.142 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:16 +0000 (0:00:00.079) 0:01:03.996 ******* 2021-11-12T05:35:16.152 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-11-12T05:35:16.153 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-11-12T05:35:16.157 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-11-12T05:35:16.159 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:16.193 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:16 +0000 (0:00:00.051) 0:01:04.048 ******* 2021-11-12T05:35:16.218 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:16 +0000 (0:00:00.024) 0:01:04.073 ******* 2021-11-12T05:35:16.228 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-11-12T05:35:16.230 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-11-12T05:35:16.262 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:16.289 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:16 +0000 (0:00:00.070) 0:01:04.143 ******* 2021-11-12T05:35:16.296 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-11-12T05:35:16.298 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3612, "state": "file", "uid": 0} 2021-11-12T05:35:16.363 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:16 +0000 (0:00:00.074) 0:01:04.217 ******* 2021-11-12T05:35:16.370 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-11-12T05:35:16.372 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:16.374 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:16.402 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:16 +0000 (0:00:00.039) 0:01:04.257 ******* 2021-11-12T05:35:16.425 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:16 +0000 (0:00:00.022) 0:01:04.280 ******* 2021-11-12T05:35:16.436 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-11-12T05:35:16.439 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} TASK [common : Configure local epel mirrorlists] ******************************* skipping: [gibba015.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-11-12T05:35:16.470 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:16 +0000 (0:00:00.044) 0:01:04.325 ******* 2021-11-12T05:35:16.481 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-11-12T05:35:16.483 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3612, "state": "file", "uid": 0} 2021-11-12T05:35:16.485 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-11-12T05:35:16.509 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:16 +0000 (0:00:00.039) 0:01:04.364 ******* 2021-11-12T05:35:16.533 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:16 +0000 (0:00:00.023) 0:01:04.388 ******* 2021-11-12T05:35:16.542 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-11-12T05:35:16.544 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Clean yum cache] ************************************************ skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:16.572 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:16 +0000 (0:00:00.038) 0:01:04.426 ******* 2021-11-12T05:35:16.596 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:16 +0000 (0:00:00.023) 0:01:04.450 ******* 2021-11-12T05:35:16.603 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-11-12T05:35:16.605 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-11-12T05:35:16.606 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [gibba005.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-12T05:35:16.633 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:16 +0000 (0:00:00.037) 0:01:04.487 ******* 2021-11-12T05:35:16.641 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-12T05:35:16.642 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-12T05:35:16.670 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:16 +0000 (0:00:00.036) 0:01:04.524 ******* 2021-11-12T05:35:16.677 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* skipping: [gibba038.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-12T05:35:16.702 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:16 +0000 (0:00:00.032) 0:01:04.556 ******* 2021-11-12T05:35:16.709 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-11-12T05:35:16.711 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:16.712 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-11-12T05:35:16.712 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-11-12T05:35:16.739 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:16 +0000 (0:00:00.037) 0:01:04.593 ******* 2021-11-12T05:35:16.748 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-11-12T05:35:16.749 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.016227", "end": "2021-11-12 05:35:16.838694", "rc": 0, "start": "2021-11-12 05:35:16.822467", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-11-12T05:35:16.751 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [gibba038.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-12T05:35:16.752 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-12T05:35:16.777 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:16 +0000 (0:00:00.038) 0:01:04.632 ******* 2021-11-12T05:35:16.786 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-12T05:35:16.813 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:16 +0000 (0:00:00.035) 0:01:04.668 ******* 2021-11-12T05:35:16.825 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-11-12T05:35:16.827 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:16.851 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:16 +0000 (0:00:00.038) 0:01:04.706 ******* 2021-11-12T05:35:16.859 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-11-12T05:35:16.861 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:16.896 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:16 +0000 (0:00:00.044) 0:01:04.750 ******* 2021-11-12T05:35:16.904 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-11-12T05:35:16.905 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} TASK [common : Inform the OS of the new timezone] ****************************** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:16.934 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:16 +0000 (0:00:00.037) 0:01:04.788 ******* 2021-11-12T05:35:16.942 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-11-12T05:35:16.943 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3612, "state": "file", "uid": 0} 2021-11-12T05:35:16.971 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:16 +0000 (0:00:00.037) 0:01:04.826 ******* 2021-11-12T05:35:17.013 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-11-12T05:35:17.015 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-11-12T05:35:17.037 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:17 +0000 (0:00:00.066) 0:01:04.892 ******* 2021-11-12T05:35:17.065 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-11-12T05:35:17.067 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-12T05:35:17.091 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:17 +0000 (0:00:00.053) 0:01:04.946 ******* 2021-11-12T05:35:17.098 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-11-12T05:35:17.099 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "grub-common.service grub-initrd-fallback.service", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/sleep.target", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked", "Wants": "grub-common.service grub-initrd-fallback.service"}} 2021-11-12T05:35:17.111 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-11-12T05:35:17.113 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3612, "state": "file", "uid": 0} 2021-11-12T05:35:17.141 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:17 +0000 (0:00:00.050) 0:01:04.996 ******* 2021-11-12T05:35:17.150 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-11-12T05:35:17.151 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-12T05:35:17.162 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-12T05:35:17.164 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-12T05:35:17.188 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:17 +0000 (0:00:00.046) 0:01:05.043 ******* 2021-11-12T05:35:17.195 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-11-12T05:35:17.197 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-11-12T05:35:17.228 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:17 +0000 (0:00:00.040) 0:01:05.083 ******* 2021-11-12T05:35:17.236 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-11-12T05:35:17.237 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/suspend.target", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-12T05:35:17.239 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:17.239 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (non-RHEL/CentOS)] ******** ok: [gibba005.front.sepia.ceph.com] => {"cache_update_time": 1636694779, "cache_updated": false, "changed": false} 2021-11-12T05:35:17.264 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:17 +0000 (0:00:00.035) 0:01:05.119 ******* 2021-11-12T05:35:17.287 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:17 +0000 (0:00:00.022) 0:01:05.141 ******* 2021-11-12T05:35:17.294 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-11-12T05:35:17.297 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-12T05:35:17.322 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:17 +0000 (0:00:00.035) 0:01:05.176 ******* 2021-11-12T05:35:17.330 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-11-12T05:35:17.332 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hibernate.target", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-12T05:35:17.343 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (non-RHEL/CentOS)] ******** 2021-11-12T05:35:17.344 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1636694933, "cache_updated": false, "changed": false} 2021-11-12T05:35:17.368 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:17 +0000 (0:00:00.046) 0:01:05.223 ******* 2021-11-12T05:35:17.376 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-11-12T05:35:17.378 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-12T05:35:17.390 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-12T05:35:17.442 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:17 +0000 (0:00:00.073) 0:01:05.297 ******* 2021-11-12T05:35:17.452 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-11-12T05:35:17.453 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hybrid-sleep.target", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2021-11-12T05:35:17.493 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:17 +0000 (0:00:00.050) 0:01:05.347 ******* 2021-11-12T05:35:17.500 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-11-12T05:35:17.502 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:17.527 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:17 +0000 (0:00:00.034) 0:01:05.382 ******* 2021-11-12T05:35:17.535 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-11-12T05:35:17.536 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} TASK [common : Get the current timezone] *************************************** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:17.564 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:17 +0000 (0:00:00.037) 0:01:05.419 ******* 2021-11-12T05:35:17.589 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:17 +0000 (0:00:00.024) 0:01:05.443 ******* 2021-11-12T05:35:17.618 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-11-12T05:35:17.620 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} TASK [common : Set the timezone] *********************************************** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:17.644 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:17 +0000 (0:00:00.055) 0:01:05.498 ******* 2021-11-12T05:35:17.666 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:17 +0000 (0:00:00.022) 0:01:05.521 ******* 2021-11-12T05:35:17.673 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-11-12T05:35:17.675 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:17.700 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:17 +0000 (0:00:00.033) 0:01:05.555 ******* 2021-11-12T05:35:17.729 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:17.752 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:17 +0000 (0:00:00.052) 0:01:05.607 ******* 2021-11-12T05:35:17.760 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (non-RHEL/CentOS)] ******** 2021-11-12T05:35:17.762 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"cache_update_time": 1636694984, "cache_updated": false, "changed": false} 2021-11-12T05:35:17.787 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:17 +0000 (0:00:00.034) 0:01:05.641 ******* 2021-11-12T05:35:17.794 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-11-12T05:35:17.796 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:17.821 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:17 +0000 (0:00:00.034) 0:01:05.676 ******* 2021-11-12T05:35:17.928 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-11-12T05:35:17.930 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-11-12T05:35:17.957 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:17 +0000 (0:00:00.136) 0:01:05.812 ******* 2021-11-12T05:35:17.966 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-11-12T05:35:18.003 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:18 +0000 (0:00:00.045) 0:01:05.858 ******* 2021-11-12T05:35:18.012 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (non-RHEL/CentOS)] ******** 2021-11-12T05:35:18.014 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"cache_update_time": 1636694883, "cache_updated": false, "changed": false} 2021-11-12T05:35:18.044 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:18 +0000 (0:00:00.040) 0:01:05.899 ******* 2021-11-12T05:35:18.056 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-11-12T05:35:18.058 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-11-12T05:35:18.085 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:18 +0000 (0:00:00.041) 0:01:05.940 ******* 2021-11-12T05:35:18.097 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-11-12T05:35:18.099 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-11-12T05:35:18.131 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-11-12T05:35:18.175 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-11-12T05:35:18.203 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:18 +0000 (0:00:00.117) 0:01:06.058 ******* 2021-11-12T05:35:18.232 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-11-12T05:35:18.234 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:18.258 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:18 +0000 (0:00:00.054) 0:01:06.112 ******* 2021-11-12T05:35:18.266 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-11-12T05:35:18.267 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-11-12T05:35:18.295 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:18 +0000 (0:00:00.037) 0:01:06.150 ******* 2021-11-12T05:35:18.303 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-11-12T05:35:18.305 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-12T05:35:18.330 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:18 +0000 (0:00:00.034) 0:01:06.185 ******* 2021-11-12T05:35:18.338 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-11-12T05:35:18.340 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:18.366 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:18 +0000 (0:00:00.036) 0:01:06.221 ******* 2021-11-12T05:35:18.390 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:18 +0000 (0:00:00.023) 0:01:06.244 ******* 2021-11-12T05:35:18.396 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-11-12T05:35:18.399 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set the hardware clock] ***************************************** changed: [gibba015.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.448915", "end": "2021-11-12 05:35:18.500914", "rc": 0, "start": "2021-11-12 05:35:18.051999", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [common : Upload nagios check_mem script] ********************************* ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-11-12T05:35:18.399 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** skipping: [gibba005.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-12T05:35:18.427 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:18 +0000 (0:00:00.036) 0:01:06.281 ******* 2021-11-12T05:35:18.449 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:18 +0000 (0:00:00.022) 0:01:06.304 ******* 2021-11-12T05:35:18.471 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:18 +0000 (0:00:00.021) 0:01:06.325 ******* 2021-11-12T05:35:18.500 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:18 +0000 (0:00:00.029) 0:01:06.354 ******* 2021-11-12T05:35:18.508 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-11-12T05:35:18.509 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Install Kerberos Packages (RedHat)] ***************************** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:18.535 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:18 +0000 (0:00:00.035) 0:01:06.390 ******* 2021-11-12T05:35:18.560 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:18 +0000 (0:00:00.024) 0:01:06.414 ******* 2021-11-12T05:35:18.621 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-11-12T05:35:18.623 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-11-12T05:35:18.676 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-11-12T05:35:18.678 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-11-12T05:35:18.703 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:18 +0000 (0:00:00.143) 0:01:06.558 ******* 2021-11-12T05:35:18.710 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-11-12T05:35:18.712 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-11-12T05:35:18.739 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:18 +0000 (0:00:00.036) 0:01:06.594 ******* 2021-11-12T05:35:18.746 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-11-12T05:35:18.748 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-11-12T05:35:18.775 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:18 +0000 (0:00:00.035) 0:01:06.630 ******* 2021-11-12T05:35:18.783 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-11-12T05:35:18.785 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:18.810 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:18 +0000 (0:00:00.034) 0:01:06.665 ******* 2021-11-12T05:35:18.817 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-11-12T05:35:18.819 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-11-12T05:35:18.851 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:18 +0000 (0:00:00.040) 0:01:06.705 ******* 2021-11-12T05:35:18.858 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-11-12T05:35:18.860 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-12T05:35:18.885 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:18 +0000 (0:00:00.034) 0:01:06.740 ******* 2021-11-12T05:35:18.893 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-11-12T05:35:18.895 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} TASK [common : Clean apt cache] ************************************************ 2021-11-12T05:35:18.895 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.174887", "end": "2021-11-12 05:35:18.973977", "rc": 0, "start": "2021-11-12 05:35:18.799090", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:35:18.921 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:18 +0000 (0:00:00.036) 0:01:06.776 ******* 2021-11-12T05:35:18.929 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-11-12T05:35:18.930 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:18.956 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:18 +0000 (0:00:00.034) 0:01:06.810 ******* 2021-11-12T05:35:18.963 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-11-12T05:35:18.963 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-11-12T05:35:18.967 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-11-12T05:35:18.968 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-11-12 05:33:04 UTC", "ActiveEnterTimestampMonotonic": "12662942", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "local-fs.target sysinit.target remote-fs.target -.mount time-sync.target systemd-tmpfiles-setup.service system.slice nss-lookup.target network.target var-run.mount systemd-journald.socket basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-11-12 05:33:04 UTC", "AssertTimestampMonotonic": "12643250", "Before": "xdm.service shutdown.target plymouth-quit.service getty@tty1.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-11-12 05:33:04 UTC", "Con 2021-11-12T05:35:18.970 INFO:teuthology.task.ansible.out:ditionTimestampMonotonic": "12643250", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "966", "ExecMainStartTimestamp": "Fri 2021-11-12 05:33:04 UTC", "ExecMainStartTimestampMonotonic": "12662827", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Fri 2021-11-12 05:33:04 UTC] ; stop_time=[n/a] ; pid=966 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Fri 2021-11-12 05:33:04 UTC] ; stop_time=[n/a] ; pid=966 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID 2021-11-12T05:35:18.971 INFO:teuthology.task.ansible.out:": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-11-12 05:33:04 UTC", "InactiveExitTimestampMonotonic": "12662942", "InvocationID": "e2444cdd6e944eee978f5e59a4aecaa3", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "966", "MemoryAccounting": "yes", "MemoryCurrent": "1327104", "MemoryDe 2021-11-12T05:35:18.973 INFO:teuthology.task.ansible.out:nyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-11-12 05:33:04 UTC", "StateChangeTimestampMonotonic": "12662942", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", 2021-11-12T05:35:18.975 INFO:teuthology.task.ansible.out: "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38346", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-12T05:35:19.002 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:18 +0000 (0:00:00.046) 0:01:06.857 ******* 2021-11-12T05:35:19.026 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:19 +0000 (0:00:00.023) 0:01:06.880 ******* 2021-11-12T05:35:19.035 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-11-12T05:35:19.037 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:19.062 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:19 +0000 (0:00:00.036) 0:01:06.917 ******* 2021-11-12T05:35:19.070 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-11-12T05:35:19.072 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-11-12 05:32:53 UTC", "ActiveEnterTimestampMonotonic": "15103720", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "local-fs.target system.slice basic.target sysinit.target var-run.mount nss-lookup.target remote-fs.target systemd-tmpfiles-setup.service network.target systemd-journald.socket -.mount time-sync.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-11-12 05:32:53 UTC", "AssertTimestampMonotonic": "15075351", "Before": "getty@tty1.service xdm.service multi-user.target plymouth-quit.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-11-12 05:32:53 UTC", "Con 2021-11-12T05:35:19.073 INFO:teuthology.task.ansible.out:ditionTimestampMonotonic": "15075350", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1013", "ExecMainStartTimestamp": "Fri 2021-11-12 05:32:53 UTC", "ExecMainStartTimestampMonotonic": "15103614", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Fri 2021-11-12 05:32:53 UTC] ; stop_time=[n/a] ; pid=1013 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Fri 2021-11-12 05:32:53 UTC] ; stop_time=[n/a] ; pid=1013 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", " 2021-11-12T05:35:19.075 INFO:teuthology.task.ansible.out:GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-11-12 05:32:53 UTC", "InactiveExitTimestampMonotonic": "15103720", "InvocationID": "afad01556bd748ab9bdc39f722ac6212", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1013", "MemoryAccounting": "yes", "MemoryCurrent": "1265664", "Memo 2021-11-12T05:35:19.077 INFO:teuthology.task.ansible.out:ryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-11-12 05:32:53 UTC", "StateChangeTimestampMonotonic": "15103720", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": " 2021-11-12T05:35:19.078 INFO:teuthology.task.ansible.out:no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "n 2021-11-12T05:35:19.079 INFO:teuthology.task.ansible.out:o", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38346", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-12T05:35:19.081 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-11-12T05:35:19.082 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:19.106 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:19 +0000 (0:00:00.044) 0:01:06.961 ******* 2021-11-12T05:35:19.128 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:19 +0000 (0:00:00.022) 0:01:06.983 ******* 2021-11-12T05:35:19.135 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-11-12T05:35:19.137 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Get SELinux status] ********************************************* skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:19.162 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:19 +0000 (0:00:00.033) 0:01:07.017 ******* 2021-11-12T05:35:19.186 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:19 +0000 (0:00:00.023) 0:01:07.040 ******* 2021-11-12T05:35:19.192 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-11-12T05:35:19.194 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:19.219 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:19 +0000 (0:00:00.033) 0:01:07.074 ******* 2021-11-12T05:35:19.241 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:19 +0000 (0:00:00.021) 0:01:07.095 ******* 2021-11-12T05:35:19.248 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-11-12T05:35:19.250 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:19.250 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:19.274 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:19 +0000 (0:00:00.033) 0:01:07.129 ******* 2021-11-12T05:35:19.297 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:19 +0000 (0:00:00.022) 0:01:07.152 ******* 2021-11-12T05:35:19.329 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:19 +0000 (0:00:00.031) 0:01:07.184 ******* 2021-11-12T05:35:19.337 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:19.338 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:19.365 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:19 +0000 (0:00:00.036) 0:01:07.220 ******* 2021-11-12T05:35:19.389 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:19 +0000 (0:00:00.023) 0:01:07.244 ******* 2021-11-12T05:35:19.399 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-11-12T05:35:19.401 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:19.427 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:19 +0000 (0:00:00.038) 0:01:07.282 ******* 2021-11-12T05:35:19.435 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-11-12T05:35:19.437 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:19.462 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:19 +0000 (0:00:00.034) 0:01:07.317 ******* 2021-11-12T05:35:19.470 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-11-12T05:35:19.471 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:19.496 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:19 +0000 (0:00:00.034) 0:01:07.351 ******* 2021-11-12T05:35:19.504 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-11-12T05:35:19.725 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 12 November 2021 05:35:19 +0000 (0:00:00.040) 0:01:07.391 ******* TASK [common : Make sure nagios nrpe service is running.] ********************** ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-11-12 05:33:13 UTC", "ActiveEnterTimestampMonotonic": "12935850", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "time-sync.target var-run.mount remote-fs.target system.slice sysinit.target network.target basic.target nss-lookup.target systemd-tmpfiles-setup.service local-fs.target systemd-journald.socket -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-11-12 05:33:13 UTC", "AssertTimestampMonotonic": "12927349", "Before": "plymouth-quit.service getty@tty1.service shutdown.target xdm.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_le 2021-11-12T05:35:19.728 INFO:teuthology.task.ansible.out:ase cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-11-12 05:33:13 UTC", "ConditionTimestampMonotonic": "12927349", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "962", "ExecMainStartTimestamp": "Fri 2021-11-12 05:33:13 UTC", "ExecMainStartTimestampMonotonic": "12935742", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Fri 2021-11-12 05:33:13 UTC] ; stop_time=[n/a] ; pid=962 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Fri 2021-11-12 05:33:13 UTC] ; stop_time=[n/a] ; pid=962 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/r 2021-11-12T05:35:19.730 INFO:teuthology.task.ansible.out:m ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-11-12 05:33:13 UTC", "InactiveExitTimestampMonotonic": "12935850", "InvocationID": "9cc3b7fb57c247d8a5382c172ef242c9", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "i 2021-11-12T05:35:19.732 INFO:teuthology.task.ansible.out:nfinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "962", "MemoryAccounting": "yes", "MemoryCurrent": "1327104", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not se 2021-11-12T05:35:19.734 INFO:teuthology.task.ansible.out:t]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-11-12 05:33:13 UTC", "StateChangeTimestampMonotonic": "12935850", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38346", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [common : nrpe - Compile SELinux module file] ***************************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Upload nagios nrpe config.] ************************************* ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} Friday 12 November 2021 05:35:19 +0000 (0:00:00.045) 0:01:07.436 ******* Friday 12 November 2021 05:35:19 +0000 (0:00:00.025) 0:01:07.461 ******* Friday 12 November 2021 05:35:19 +0000 (0:00:00.024) 0:01:07.486 ******* TASK [common : nrpe - Copy SELinux type enforcement file] ********************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was 2021-11-12T05:35:19.735 INFO:teuthology.task.ansible.out:False"} TASK [common : nrpe - Build SELinux policy package] **************************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 12 November 2021 05:35:19 +0000 (0:00:00.043) 0:01:07.530 ******* Friday 12 November 2021 05:35:19 +0000 (0:00:00.039) 0:01:07.569 ******* TASK [common : Get SELinux status] ********************************************* skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Load SELinux policy package] ***************************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:19.752 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:19 +0000 (0:00:00.037) 0:01:07.606 ******* 2021-11-12T05:35:19.777 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:19 +0000 (0:00:00.024) 0:01:07.631 ******* 2021-11-12T05:35:19.784 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-11-12T05:35:19.786 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Remove temporary files] ********************************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:19.813 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:19 +0000 (0:00:00.036) 0:01:07.668 ******* 2021-11-12T05:35:19.838 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:19 +0000 (0:00:00.024) 0:01:07.692 ******* 2021-11-12T05:35:19.845 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-11-12T05:35:19.847 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-11-12T05:35:19.848 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-11-12 05:33:00 UTC", "ActiveEnterTimestampMonotonic": "13061722", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "nss-lookup.target local-fs.target systemd-journald.socket remote-fs.target basic.target sysinit.target systemd-tmpfiles-setup.service system.slice time-sync.target var-run.mount network.target -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-11-12 05:33:00 UTC", "AssertTimestampMonotonic": "13047087", "Before": "xdm.service multi-user.target shutdown.target getty@tty1.service plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-11-12 05:33:00 UTC", "Con 2021-11-12T05:35:19.850 INFO:teuthology.task.ansible.out:ditionTimestampMonotonic": "13047086", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "966", "ExecMainStartTimestamp": "Fri 2021-11-12 05:33:00 UTC", "ExecMainStartTimestampMonotonic": "13061615", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Fri 2021-11-12 05:33:00 UTC] ; stop_time=[n/a] ; pid=966 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Fri 2021-11-12 05:33:00 UTC] ; stop_time=[n/a] ; pid=966 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID 2021-11-12T05:35:19.852 INFO:teuthology.task.ansible.out:": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-11-12 05:33:00 UTC", "InactiveExitTimestampMonotonic": "13061722", "InvocationID": "f7201c929c05477cadf6ea406768ad96", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "966", "MemoryAccounting": "yes", "MemoryCurrent": "1269760", "MemoryDe 2021-11-12T05:35:19.854 INFO:teuthology.task.ansible.out:nyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-11-12 05:33:00 UTC", "StateChangeTimestampMonotonic": "13061722", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", 2021-11-12T05:35:19.856 INFO:teuthology.task.ansible.out: "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38346", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [testnode : Include package type specific vars.] ************************** ok: [gibba005.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-11-12T05:35:19.877 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:19 +0000 (0:00:00.039) 0:01:07.732 ******* 2021-11-12T05:35:19.899 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:19 +0000 (0:00:00.022) 0:01:07.754 ******* 2021-11-12T05:35:19.924 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:19 +0000 (0:00:00.024) 0:01:07.778 ******* 2021-11-12T05:35:19.931 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-11-12T05:35:19.933 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Including distro specific variables.] ************************* 2021-11-12T05:35:19.934 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common", "libgnutls30"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-11-12T05:35:19.936 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:19.960 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:19 +0000 (0:00:00.036) 0:01:07.815 ******* 2021-11-12T05:35:19.982 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:19 +0000 (0:00:00.022) 0:01:07.837 ******* 2021-11-12T05:35:20.009 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:20 +0000 (0:00:00.026) 0:01:07.863 ******* 2021-11-12T05:35:20.019 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-11-12T05:35:20.021 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Including major version specific variables.] ****************** ok: [gibba005.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-venv", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-11-12T05:35:20.022 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:20.052 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:20 +0000 (0:00:00.042) 0:01:07.906 ******* 2021-11-12T05:35:20.076 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:20 +0000 (0:00:00.025) 0:01:07.931 ******* 2021-11-12T05:35:20.102 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:20 +0000 (0:00:00.025) 0:01:07.957 ******* 2021-11-12T05:35:20.109 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-11-12T05:35:20.111 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Including version specific variables.] ************************ ok: [gibba005.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-11-12T05:35:20.111 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:20.138 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:20 +0000 (0:00:00.035) 0:01:07.992 ******* 2021-11-12T05:35:20.162 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:20 +0000 (0:00:00.022) 0:01:08.015 ******* 2021-11-12T05:35:20.183 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:20 +0000 (0:00:00.022) 0:01:08.038 ******* 2021-11-12T05:35:20.190 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-11-12T05:35:20.192 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:20.218 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:20 +0000 (0:00:00.034) 0:01:08.073 ******* 2021-11-12T05:35:20.243 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:20 +0000 (0:00:00.024) 0:01:08.098 ******* 2021-11-12T05:35:20.249 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-11-12T05:35:20.251 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:20.276 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:20 +0000 (0:00:00.033) 0:01:08.131 ******* 2021-11-12T05:35:20.283 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-11-12T05:35:20.285 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} TASK [common : nrpe - Remove SELinux policy package] *************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:20.310 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:20 +0000 (0:00:00.033) 0:01:08.164 ******* 2021-11-12T05:35:20.331 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:20 +0000 (0:00:00.021) 0:01:08.185 ******* 2021-11-12T05:35:20.353 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:20 +0000 (0:00:00.022) 0:01:08.208 ******* 2021-11-12T05:35:20.360 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-11-12T05:35:20.361 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} TASK [common : nrpe - Copy SELinux type enforcement file] ********************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:20.395 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:20 +0000 (0:00:00.041) 0:01:08.249 ******* 2021-11-12T05:35:20.419 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:20 +0000 (0:00:00.024) 0:01:08.274 ******* 2021-11-12T05:35:20.425 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:20.452 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:20 +0000 (0:00:00.032) 0:01:08.307 ******* 2021-11-12T05:35:20.458 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-11-12T05:35:20.460 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} TASK [common : nrpe - Compile SELinux module file] ***************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:20.486 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:20 +0000 (0:00:00.034) 0:01:08.341 ******* 2021-11-12T05:35:20.509 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:20 +0000 (0:00:00.023) 0:01:08.364 ******* 2021-11-12T05:35:20.517 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-11-12T05:35:20.518 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common", "libgnutls30"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-11-12T05:35:20.520 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-11-12T05:35:20.522 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create the teuthology user.] ********************************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:20.546 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:20 +0000 (0:00:00.036) 0:01:08.401 ******* 2021-11-12T05:35:20.569 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:20 +0000 (0:00:00.022) 0:01:08.424 ******* 2021-11-12T05:35:20.592 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:20 +0000 (0:00:00.023) 0:01:08.447 ******* 2021-11-12T05:35:20.599 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-11-12T05:35:20.601 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Delete the teuthology users password.] ************************ skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:20.626 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:20 +0000 (0:00:00.033) 0:01:08.480 ******* 2021-11-12T05:35:20.647 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:20 +0000 (0:00:00.021) 0:01:08.502 ******* 2021-11-12T05:35:20.657 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** ok: [gibba038.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-venv", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-11-12T05:35:20.659 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:20.686 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:20 +0000 (0:00:00.038) 0:01:08.541 ******* 2021-11-12T05:35:20.709 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:20 +0000 (0:00:00.022) 0:01:08.563 ******* 2021-11-12T05:35:20.718 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-11-12T05:35:20.720 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:20.721 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [gibba038.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-11-12T05:35:20.751 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:20 +0000 (0:00:00.043) 0:01:08.606 ******* 2021-11-12T05:35:20.940 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:20 +0000 (0:00:00.188) 0:01:08.795 ******* 2021-11-12T05:35:20.951 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-11-12T05:35:20.953 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add a user for xfstests to test user quotas.] ***************** ok: [gibba005.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-11-12T05:35:20.954 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:20.984 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:20 +0000 (0:00:00.043) 0:01:08.838 ******* 2021-11-12T05:35:21.009 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:21 +0000 (0:00:00.025) 0:01:08.864 ******* 2021-11-12T05:35:21.036 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:21 +0000 (0:00:00.026) 0:01:08.891 ******* 2021-11-12T05:35:21.054 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-11-12T05:35:21.056 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-11-12T05:35:21.081 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:21 +0000 (0:00:00.044) 0:01:08.935 ******* 2021-11-12T05:35:21.107 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:21 +0000 (0:00:00.026) 0:01:08.962 ******* 2021-11-12T05:35:21.116 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-11-12T05:35:21.118 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:21.143 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:21 +0000 (0:00:00.036) 0:01:08.998 ******* 2021-11-12T05:35:21.151 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-11-12T05:35:21.152 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common", "libgnutls30"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-11-12T05:35:21.191 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:21 +0000 (0:00:00.047) 0:01:09.046 ******* 2021-11-12T05:35:21.199 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-11-12T05:35:21.199 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-11-12T05:35:21.227 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:21 +0000 (0:00:00.035) 0:01:09.082 ******* 2021-11-12T05:35:21.234 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-11-12T05:35:21.235 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-11-12T05:35:21.262 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:21 +0000 (0:00:00.035) 0:01:09.117 ******* 2021-11-12T05:35:21.271 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-11-12T05:35:21.273 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-venv", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-11-12T05:35:21.274 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-11-12T05:35:21.275 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common", "libgnutls30"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-11-12T05:35:21.301 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:21 +0000 (0:00:00.038) 0:01:09.156 ******* 2021-11-12T05:35:21.325 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:21 +0000 (0:00:00.023) 0:01:09.179 ******* 2021-11-12T05:35:21.332 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-11-12T05:35:21.334 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-11-12T05:35:21.336 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-11-12T05:35:21.336 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-11-12T05:35:21.336 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-11-12T05:35:21.368 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:21 +0000 (0:00:00.043) 0:01:09.223 ******* 2021-11-12T05:35:21.393 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:21 +0000 (0:00:00.024) 0:01:09.248 ******* 2021-11-12T05:35:21.420 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:21 +0000 (0:00:00.026) 0:01:09.274 ******* 2021-11-12T05:35:21.428 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-11-12T05:35:21.430 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-venv", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-11-12T05:35:21.432 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* ok: [gibba005.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "gibba005"}, "changed": false} 2021-11-12T05:35:21.457 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:21 +0000 (0:00:00.037) 0:01:09.312 ******* 2021-11-12T05:35:21.481 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:21 +0000 (0:00:00.023) 0:01:09.336 ******* 2021-11-12T05:35:21.488 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-11-12T05:35:21.490 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:21.516 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:21 +0000 (0:00:00.035) 0:01:09.371 ******* 2021-11-12T05:35:21.524 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-11-12T05:35:21.526 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-11-12T05:35:21.552 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:21 +0000 (0:00:00.036) 0:01:09.407 ******* 2021-11-12T05:35:21.561 INFO:teuthology.task.ansible.out: 2021-11-12T05:35:21.562 INFO:teuthology.task.ansible.out:TASK [testnode : Including version specific variables.] ************************ ok: [gibba044.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-11-12T05:35:21.591 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:21 +0000 (0:00:00.038) 0:01:09.445 ******* 2021-11-12T05:35:21.642 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-11-12T05:35:21.644 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-11-12T05:35:21.671 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:21 +0000 (0:00:00.080) 0:01:09.526 ******* 2021-11-12T05:35:21.680 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-11-12T05:35:21.682 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-11-12T05:35:21.708 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:21 +0000 (0:00:00.036) 0:01:09.563 ******* 2021-11-12T05:35:21.717 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-11-12T05:35:21.743 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:21 +0000 (0:00:00.034) 0:01:09.597 ******* 2021-11-12T05:35:21.750 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:21.780 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:21 +0000 (0:00:00.036) 0:01:09.634 ******* 2021-11-12T05:35:21.809 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-11-12T05:35:21.810 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:21.842 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:21 +0000 (0:00:00.062) 0:01:09.697 ******* 2021-11-12T05:35:21.884 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-11-12T05:35:21.886 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-11-12T05:35:21.911 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:21 +0000 (0:00:00.068) 0:01:09.765 ******* 2021-11-12T05:35:21.940 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-11-12T05:35:21.941 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1636694831, "cache_updated": false, "changed": false} TASK [testnode : Create the teuthology user.] ********************************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:21.966 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:21 +0000 (0:00:00.055) 0:01:09.821 ******* 2021-11-12T05:35:21.998 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:21 +0000 (0:00:00.032) 0:01:09.853 ******* 2021-11-12T05:35:22.006 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-11-12T05:35:22.007 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-11-12T05:35:22.035 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:22 +0000 (0:00:00.036) 0:01:09.889 ******* 2021-11-12T05:35:22.058 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:22 +0000 (0:00:00.023) 0:01:09.913 ******* 2021-11-12T05:35:22.067 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-11-12T05:35:22.069 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set the system's hostname] ************************************ changed: [gibba005.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "gibba005.front.sepia.ceph.com", "ansible_hostname": "gibba005", "ansible_nodename": "gibba005"}, "changed": true, "name": "gibba005"} 2021-11-12T05:35:22.095 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:22 +0000 (0:00:00.036) 0:01:09.950 ******* 2021-11-12T05:35:22.118 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:22 +0000 (0:00:00.022) 0:01:09.972 ******* 2021-11-12T05:35:22.126 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-11-12T05:35:22.127 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "gibba038"}, "changed": false} 2021-11-12T05:35:22.153 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:22 +0000 (0:00:00.035) 0:01:10.008 ******* 2021-11-12T05:35:22.245 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-11-12T05:35:22.247 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-11-12T05:35:22.272 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:22 +0000 (0:00:00.118) 0:01:10.127 ******* 2021-11-12T05:35:22.375 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-11-12T05:35:22.377 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-11-12T05:35:22.402 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:22 +0000 (0:00:00.130) 0:01:10.257 ******* 2021-11-12T05:35:22.411 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-11-12T05:35:22.412 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "gibba038.front.sepia.ceph.com", "ansible_hostname": "gibba038", "ansible_nodename": "gibba038"}, "changed": true, "name": "gibba038"} TASK [testnode : Upload distro major version specific sshd_config] ************* ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-11-12T05:35:22.441 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:22 +0000 (0:00:00.038) 0:01:10.296 ******* 2021-11-12T05:35:22.472 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:22 +0000 (0:00:00.030) 0:01:10.326 ******* 2021-11-12T05:35:22.479 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-11-12T05:35:22.481 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "gibba016"}, "changed": false} TASK [common : Install Kerberos Packages (Debian)] ***************************** ok: [gibba015.front.sepia.ceph.com] => {"cache_update_time": 1636694831, "cache_updated": false, "changed": false} 2021-11-12T05:35:22.508 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:22 +0000 (0:00:00.036) 0:01:10.363 ******* 2021-11-12T05:35:22.533 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:22 +0000 (0:00:00.024) 0:01:10.388 ******* 2021-11-12T05:35:22.541 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:22.568 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:22 +0000 (0:00:00.035) 0:01:10.423 ******* 2021-11-12T05:35:22.607 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-11-12T05:35:22.609 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-11-12T05:35:22.635 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:22 +0000 (0:00:00.066) 0:01:10.489 ******* 2021-11-12T05:35:22.665 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-11-12T05:35:22.666 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "gibba044"}, "changed": false} 2021-11-12T05:35:22.692 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:22 +0000 (0:00:00.057) 0:01:10.546 ******* 2021-11-12T05:35:22.700 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-11-12T05:35:22.701 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-11-12T05:35:22.727 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:22 +0000 (0:00:00.035) 0:01:10.582 ******* 2021-11-12T05:35:22.736 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-11-12T05:35:22.738 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-11-12T05:35:22.764 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:22 +0000 (0:00:00.036) 0:01:10.618 ******* 2021-11-12T05:35:22.803 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-11-12T05:35:22.805 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-11-12T05:35:22.830 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:22 +0000 (0:00:00.066) 0:01:10.684 ******* 2021-11-12T05:35:22.965 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-11-12T05:35:22.967 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "gibba044.front.sepia.ceph.com", "ansible_hostname": "gibba044", "ansible_nodename": "gibba044"}, "changed": true, "name": "gibba044"} changed: [gibba016.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "gibba016.front.sepia.ceph.com", "ansible_hostname": "gibba016", "ansible_nodename": "gibba016"}, "changed": true, "name": "gibba016"} 2021-11-12T05:35:22.994 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:22 +0000 (0:00:00.164) 0:01:10.849 ******* 2021-11-12T05:35:23.021 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:23 +0000 (0:00:00.026) 0:01:10.876 ******* 2021-11-12T05:35:23.092 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-11-12T05:35:23.093 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-11-12T05:35:23.118 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:23 +0000 (0:00:00.096) 0:01:10.973 ******* 2021-11-12T05:35:23.168 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-11-12T05:35:23.170 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-11-12T05:35:23.207 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:23 +0000 (0:00:00.089) 0:01:11.062 ******* 2021-11-12T05:35:23.237 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:23.262 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:23 +0000 (0:00:00.054) 0:01:11.117 ******* 2021-11-12T05:35:23.269 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-11-12T05:35:23.270 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-11-12T05:35:23.297 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:23 +0000 (0:00:00.035) 0:01:11.152 ******* 2021-11-12T05:35:23.304 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-11-12T05:35:23.306 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:23.333 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:23 +0000 (0:00:00.036) 0:01:11.188 ******* 2021-11-12T05:35:23.341 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-11-12T05:35:23.343 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"cache_update_time": 1636694831, "cache_updated": false, "changed": false} TASK [testnode : Upload distro major version specific sshd_config] ************* ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-11-12T05:35:23.371 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:23 +0000 (0:00:00.037) 0:01:11.225 ******* 2021-11-12T05:35:23.396 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:23 +0000 (0:00:00.025) 0:01:11.251 ******* 2021-11-12T05:35:23.406 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:23.434 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:23 +0000 (0:00:00.037) 0:01:11.288 ******* 2021-11-12T05:35:23.464 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-11-12T05:35:23.466 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:23.490 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:23 +0000 (0:00:00.056) 0:01:11.345 ******* 2021-11-12T05:35:23.502 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** changed: [gibba038.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-11-12T05:35:23.528 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:23 +0000 (0:00:00.038) 0:01:11.383 ******* 2021-11-12T05:35:23.537 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-11-12T05:35:23.539 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:23.569 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:23 +0000 (0:00:00.039) 0:01:11.422 ******* 2021-11-12T05:35:23.576 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-11-12T05:35:23.578 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload ssh_config] ******************************************** ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-11-12T05:35:23.604 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:23 +0000 (0:00:00.036) 0:01:11.459 ******* 2021-11-12T05:35:23.626 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:23 +0000 (0:00:00.021) 0:01:11.480 ******* 2021-11-12T05:35:23.634 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-11-12T05:35:23.635 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:23.672 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:23 +0000 (0:00:00.046) 0:01:11.527 ******* 2021-11-12T05:35:23.681 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-11-12T05:35:23.681 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-11-12T05:35:23.683 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:23.710 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:23 +0000 (0:00:00.035) 0:01:11.562 ******* 2021-11-12T05:35:23.732 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:23 +0000 (0:00:00.024) 0:01:11.587 ******* 2021-11-12T05:35:23.740 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-11-12T05:35:23.740 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-11-12T05:35:23.742 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-11-12T05:35:23.742 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:23.769 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:23 +0000 (0:00:00.037) 0:01:11.624 ******* 2021-11-12T05:35:23.793 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:23 +0000 (0:00:00.023) 0:01:11.647 ******* 2021-11-12T05:35:23.800 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ 2021-11-12T05:35:23.802 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:23.827 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:23 +0000 (0:00:00.034) 0:01:11.682 ******* 2021-11-12T05:35:23.835 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-11-12T05:35:23.837 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:23.870 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:23 +0000 (0:00:00.043) 0:01:11.725 ******* 2021-11-12T05:35:23.878 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-12T05:35:23.880 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:23.906 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:23 +0000 (0:00:00.034) 0:01:11.760 ******* 2021-11-12T05:35:23.913 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-11-12T05:35:23.914 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:23.943 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:23 +0000 (0:00:00.038) 0:01:11.798 ******* 2021-11-12T05:35:23.951 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* 2021-11-12T05:35:23.952 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-11-12T05:35:23.953 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-11-12T05:35:23.978 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:23 +0000 (0:00:00.034) 0:01:11.833 ******* 2021-11-12T05:35:23.985 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-11-12T05:35:23.987 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:24.013 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:24 +0000 (0:00:00.034) 0:01:11.868 ******* 2021-11-12T05:35:24.022 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-11-12T05:35:24.023 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-11-12T05:35:24.024 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:24.049 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:24 +0000 (0:00:00.035) 0:01:11.903 ******* 2021-11-12T05:35:24.078 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:24 +0000 (0:00:00.029) 0:01:11.933 ******* 2021-11-12T05:35:24.087 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-11-12T05:35:24.089 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-11-12T05:35:24.115 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:24 +0000 (0:00:00.036) 0:01:11.970 ******* 2021-11-12T05:35:24.138 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:24 +0000 (0:00:00.023) 0:01:11.993 ******* 2021-11-12T05:35:24.145 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-11-12T05:35:24.147 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add ssh pubkeys] ********************************************** changed: [gibba044.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-11-12T05:35:24.147 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-11-12T05:35:24.175 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:24 +0000 (0:00:00.037) 0:01:12.030 ******* 2021-11-12T05:35:24.201 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:24 +0000 (0:00:00.025) 0:01:12.056 ******* 2021-11-12T05:35:24.226 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:24 +0000 (0:00:00.025) 0:01:12.081 ******* 2021-11-12T05:35:24.233 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ 2021-11-12T05:35:24.235 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [gibba015.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-11-12T05:35:24.238 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:24.265 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:24 +0000 (0:00:00.038) 0:01:12.120 ******* 2021-11-12T05:35:24.289 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:24 +0000 (0:00:00.023) 0:01:12.143 ******* 2021-11-12T05:35:24.313 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:24 +0000 (0:00:00.023) 0:01:12.167 ******* 2021-11-12T05:35:24.335 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:24 +0000 (0:00:00.022) 0:01:12.190 ******* 2021-11-12T05:35:24.343 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-11-12T05:35:24.344 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install GPG] ************************************************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:24.345 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:24.371 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:24 +0000 (0:00:00.035) 0:01:12.225 ******* 2021-11-12T05:35:24.397 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:24 +0000 (0:00:00.026) 0:01:12.252 ******* 2021-11-12T05:35:24.428 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:24 +0000 (0:00:00.030) 0:01:12.283 ******* 2021-11-12T05:35:24.435 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-12T05:35:24.436 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Create /usr/libexec.] ******************************************* ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-11-12T05:35:24.437 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-11-12T05:35:24.437 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-11-12T05:35:24.438 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-11-12T05:35:24.438 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=https://dist.apache.org/repos/dist/dev/arrow/KEYS) => {"ansible_loop_var": "item", "changed": false, "item": "https://dist.apache.org/repos/dist/dev/arrow/KEYS", "skip_reason": "Conditional result was False"} 2021-11-12T05:35:24.440 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:24.465 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:24 +0000 (0:00:00.037) 0:01:12.320 ******* 2021-11-12T05:35:24.488 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:24 +0000 (0:00:00.022) 0:01:12.343 ******* 2021-11-12T05:35:24.512 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:24 +0000 (0:00:00.023) 0:01:12.366 ******* 2021-11-12T05:35:24.538 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:24 +0000 (0:00:00.026) 0:01:12.393 ******* 2021-11-12T05:35:24.549 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-11-12T05:35:24.551 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Clean yum cache] ********************************************** 2021-11-12T05:35:24.551 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-11-12T05:35:24.552 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:24.580 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:24 +0000 (0:00:00.041) 0:01:12.434 ******* 2021-11-12T05:35:24.604 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:24 +0000 (0:00:00.024) 0:01:12.459 ******* 2021-11-12T05:35:24.628 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:24 +0000 (0:00:00.023) 0:01:12.483 ******* 2021-11-12T05:35:24.636 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* 2021-11-12T05:35:24.637 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:24.639 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:24.667 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:24 +0000 (0:00:00.039) 0:01:12.522 ******* 2021-11-12T05:35:24.694 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:24 +0000 (0:00:00.026) 0:01:12.549 ******* 2021-11-12T05:35:24.719 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:24 +0000 (0:00:00.024) 0:01:12.573 ******* 2021-11-12T05:35:24.726 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-11-12T05:35:24.728 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:24.753 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:24 +0000 (0:00:00.034) 0:01:12.608 ******* 2021-11-12T05:35:24.780 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:24 +0000 (0:00:00.026) 0:01:12.635 ******* 2021-11-12T05:35:24.804 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:24 +0000 (0:00:00.023) 0:01:12.659 ******* 2021-11-12T05:35:24.811 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-11-12T05:35:24.813 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} TASK [testnode : Configure local mirrorlists] ********************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:24.813 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:24.814 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:24.814 INFO:teuthology.task.ansible.out: 2021-11-12T05:35:24.839 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:24 +0000 (0:00:00.035) 0:01:12.694 ******* 2021-11-12T05:35:24.863 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:24 +0000 (0:00:00.023) 0:01:12.718 ******* 2021-11-12T05:35:24.892 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:24 +0000 (0:00:00.028) 0:01:12.747 ******* 2021-11-12T05:35:24.907 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-11-12T05:35:24.909 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check if ceph-debuginfo is installed] ************************* skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:24.941 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:24 +0000 (0:00:00.047) 0:01:12.795 ******* 2021-11-12T05:35:24.972 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:24 +0000 (0:00:00.028) 0:01:12.823 ******* 2021-11-12T05:35:24.995 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:24 +0000 (0:00:00.026) 0:01:12.850 ******* 2021-11-12T05:35:25.002 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-11-12T05:35:25.003 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-11-12T05:35:25.003 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:25.038 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:25 +0000 (0:00:00.042) 0:01:12.893 ******* 2021-11-12T05:35:25.074 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:25 +0000 (0:00:00.035) 0:01:12.929 ******* 2021-11-12T05:35:25.083 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* 2021-11-12T05:35:25.089 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [gibba015.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:25.118 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:25 +0000 (0:00:00.044) 0:01:12.973 ******* 2021-11-12T05:35:25.150 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:25 +0000 (0:00:00.030) 0:01:13.004 ******* 2021-11-12T05:35:25.187 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:25 +0000 (0:00:00.037) 0:01:13.041 ******* 2021-11-12T05:35:25.196 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-11-12T05:35:25.198 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure local mirrorlists] ********************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:25.227 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:25 +0000 (0:00:00.039) 0:01:13.081 ******* 2021-11-12T05:35:25.251 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:25 +0000 (0:00:00.024) 0:01:13.105 ******* 2021-11-12T05:35:25.274 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:25 +0000 (0:00:00.023) 0:01:13.129 ******* 2021-11-12T05:35:25.281 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-11-12T05:35:25.283 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages] ********************************************* skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-11-12T05:35:25.309 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:25 +0000 (0:00:00.033) 0:01:13.163 ******* 2021-11-12T05:35:25.333 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:25 +0000 (0:00:00.024) 0:01:13.188 ******* 2021-11-12T05:35:25.356 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:25 +0000 (0:00:00.023) 0:01:13.211 ******* 2021-11-12T05:35:25.362 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-11-12T05:35:25.363 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-11-12T05:35:25.365 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3612, "state": "file", "uid": 0} 2021-11-12T05:35:25.367 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-11-12T05:35:25.368 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-11-12T05:35:25.392 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:25 +0000 (0:00:00.035) 0:01:13.247 ******* 2021-11-12T05:35:25.423 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:25 +0000 (0:00:00.030) 0:01:13.278 ******* 2021-11-12T05:35:25.448 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:25 +0000 (0:00:00.024) 0:01:13.302 ******* 2021-11-12T05:35:25.471 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:25 +0000 (0:00:00.022) 0:01:13.325 ******* 2021-11-12T05:35:25.478 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-11-12T05:35:25.480 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove packages] ********************************************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Include apt_system vars] **************************************** ok: [gibba015.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-11-12T05:35:25.482 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-11-12T05:35:25.519 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:25 +0000 (0:00:00.048) 0:01:13.373 ******* 2021-11-12T05:35:25.555 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:25 +0000 (0:00:00.036) 0:01:13.410 ******* 2021-11-12T05:35:25.587 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:25 +0000 (0:00:00.031) 0:01:13.442 ******* 2021-11-12T05:35:25.618 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:25 +0000 (0:00:00.030) 0:01:13.473 ******* 2021-11-12T05:35:25.627 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-11-12T05:35:25.629 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade packages] ********************************************* skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:25.630 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* skipping: [gibba015.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-12T05:35:25.631 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:25.661 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:25 +0000 (0:00:00.042) 0:01:13.516 ******* 2021-11-12T05:35:25.692 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:25 +0000 (0:00:00.031) 0:01:13.547 ******* 2021-11-12T05:35:25.721 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:25 +0000 (0:00:00.028) 0:01:13.576 ******* 2021-11-12T05:35:25.760 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:25 +0000 (0:00:00.038) 0:01:13.614 ******* 2021-11-12T05:35:25.771 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ 2021-11-12T05:35:25.773 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop and disable firewalld] *********************************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:25.774 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-11-12T05:35:25.775 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-12T05:35:25.775 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-12T05:35:25.778 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-12T05:35:25.779 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [gibba016.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-11-12T05:35:25.780 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item=https://dist.apache.org/repos/dist/dev/arrow/KEYS) => {"ansible_loop_var": "item", "changed": false, "item": "https://dist.apache.org/repos/dist/dev/arrow/KEYS", "skip_reason": "Conditional result was False"} 2021-11-12T05:35:25.814 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:25 +0000 (0:00:00.054) 0:01:13.669 ******* 2021-11-12T05:35:25.838 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:25 +0000 (0:00:00.024) 0:01:13.693 ******* 2021-11-12T05:35:25.863 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:25 +0000 (0:00:00.024) 0:01:13.717 ******* 2021-11-12T05:35:25.884 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:25 +0000 (0:00:00.021) 0:01:13.738 ******* 2021-11-12T05:35:25.890 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-11-12T05:35:25.891 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-11-12T05:35:25.892 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=https://dist.apache.org/repos/dist/dev/arrow/KEYS) => {"ansible_loop_var": "item", "changed": false, "item": "https://dist.apache.org/repos/dist/dev/arrow/KEYS", "skip_reason": "Conditional result was False"} 2021-11-12T05:35:25.893 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-11-12T05:35:25.893 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:25.894 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:25.894 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:25.918 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:25 +0000 (0:00:00.034) 0:01:13.773 ******* 2021-11-12T05:35:25.946 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:25 +0000 (0:00:00.027) 0:01:13.801 ******* 2021-11-12T05:35:25.970 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:25 +0000 (0:00:00.024) 0:01:13.825 ******* 2021-11-12T05:35:25.996 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:25 +0000 (0:00:00.025) 0:01:13.851 ******* 2021-11-12T05:35:26.004 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-12T05:35:26.006 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable SELinux] *********************************************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:26.032 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:26 +0000 (0:00:00.035) 0:01:13.887 ******* 2021-11-12T05:35:26.055 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:26 +0000 (0:00:00.023) 0:01:13.910 ******* 2021-11-12T05:35:26.082 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:26 +0000 (0:00:00.026) 0:01:13.936 ******* 2021-11-12T05:35:26.087 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-11-12T05:35:26.088 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:26.090 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:26.118 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:26 +0000 (0:00:00.034) 0:01:13.971 ******* 2021-11-12T05:35:26.139 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:26 +0000 (0:00:00.022) 0:01:13.994 ******* 2021-11-12T05:35:26.161 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:26 +0000 (0:00:00.021) 0:01:14.016 ******* 2021-11-12T05:35:26.168 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* 2021-11-12T05:35:26.170 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} TASK [testnode : Enable abrt-auto-reporting] *********************************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Removing saved yum transactions] ****************************** 2021-11-12T05:35:26.171 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:26.197 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:26 +0000 (0:00:00.035) 0:01:14.051 ******* 2021-11-12T05:35:26.220 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:26 +0000 (0:00:00.023) 0:01:14.075 ******* 2021-11-12T05:35:26.243 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:26 +0000 (0:00:00.022) 0:01:14.097 ******* 2021-11-12T05:35:26.249 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-12T05:35:26.251 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:26.281 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:26 +0000 (0:00:00.037) 0:01:14.135 ******* 2021-11-12T05:35:26.304 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:26 +0000 (0:00:00.023) 0:01:14.158 ******* 2021-11-12T05:35:26.313 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-11-12T05:35:26.315 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure local mirrorlists] ********************************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:26.340 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:26 +0000 (0:00:00.036) 0:01:14.195 ******* 2021-11-12T05:35:26.364 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:26 +0000 (0:00:00.023) 0:01:14.218 ******* 2021-11-12T05:35:26.386 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:26 +0000 (0:00:00.022) 0:01:14.240 ******* 2021-11-12T05:35:26.393 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-11-12T05:35:26.394 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Restart abrtd] ************************************************ skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:26.421 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:26 +0000 (0:00:00.034) 0:01:14.275 ******* 2021-11-12T05:35:26.445 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:26 +0000 (0:00:00.024) 0:01:14.299 ******* 2021-11-12T05:35:26.471 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:26 +0000 (0:00:00.026) 0:01:14.326 ******* 2021-11-12T05:35:26.479 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-11-12T05:35:26.480 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (non-RHEL/CentOS)] ******** 2021-11-12T05:35:26.480 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"cache_update_time": 1636694831, "cache_updated": false, "changed": false} 2021-11-12T05:35:26.482 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:26.508 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:26 +0000 (0:00:00.036) 0:01:14.363 ******* 2021-11-12T05:35:26.532 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:26 +0000 (0:00:00.023) 0:01:14.386 ******* 2021-11-12T05:35:26.555 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:26 +0000 (0:00:00.022) 0:01:14.409 ******* 2021-11-12T05:35:26.562 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:26.564 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.001308", "end": "2021-11-12 05:35:26.509902", "rc": 0, "start": "2021-11-12 05:35:26.508594", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:35:26.564 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:26.594 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:26 +0000 (0:00:00.039) 0:01:14.449 ******* 2021-11-12T05:35:26.630 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:26 +0000 (0:00:00.035) 0:01:14.484 ******* 2021-11-12T05:35:26.657 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:26 +0000 (0:00:00.027) 0:01:14.511 ******* 2021-11-12T05:35:26.666 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-11-12T05:35:26.668 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** TASK [testnode : Install packages] ********************************************* skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:26.696 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:26 +0000 (0:00:00.038) 0:01:14.550 ******* 2021-11-12T05:35:26.722 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:26 +0000 (0:00:00.026) 0:01:14.577 ******* 2021-11-12T05:35:26.750 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:26 +0000 (0:00:00.027) 0:01:14.604 ******* 2021-11-12T05:35:26.757 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-11-12T05:35:26.758 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:26.784 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:26 +0000 (0:00:00.034) 0:01:14.639 ******* 2021-11-12T05:35:26.791 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-11-12T05:35:26.793 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable copr repos] ******************************************** TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-11-12T05:35:26.793 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-11-12T05:35:26.820 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:26 +0000 (0:00:00.035) 0:01:14.674 ******* 2021-11-12T05:35:26.843 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:26 +0000 (0:00:00.023) 0:01:14.698 ******* 2021-11-12T05:35:26.869 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:26 +0000 (0:00:00.024) 0:01:14.722 ******* 2021-11-12T05:35:26.875 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-11-12T05:35:26.877 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove packages] ********************************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:26.910 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:26 +0000 (0:00:00.042) 0:01:14.764 ******* 2021-11-12T05:35:26.933 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:26 +0000 (0:00:00.022) 0:01:14.787 ******* 2021-11-12T05:35:26.939 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-11-12T05:35:26.941 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade packages] ********************************************* skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:26.967 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:26 +0000 (0:00:00.034) 0:01:14.822 ******* 2021-11-12T05:35:27.003 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:27 +0000 (0:00:00.035) 0:01:14.858 ******* 2021-11-12T05:35:27.012 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-11-12T05:35:27.013 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:27.015 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:27.044 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:27 +0000 (0:00:00.041) 0:01:14.899 ******* 2021-11-12T05:35:27.074 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:27 +0000 (0:00:00.029) 0:01:14.928 ******* 2021-11-12T05:35:27.100 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:27 +0000 (0:00:00.026) 0:01:14.955 ******* 2021-11-12T05:35:27.108 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-11-12T05:35:27.109 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item=https://dist.apache.org/repos/dist/dev/arrow/KEYS) => {"ansible_loop_var": "item", "changed": false, "item": "https://dist.apache.org/repos/dist/dev/arrow/KEYS", "skip_reason": "Conditional result was False"} 2021-11-12T05:35:27.111 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Upload nagios check_mem script] ********************************* 2021-11-12T05:35:27.112 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-11-12T05:35:27.112 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:27.138 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:27 +0000 (0:00:00.037) 0:01:14.992 ******* 2021-11-12T05:35:27.162 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:27 +0000 (0:00:00.023) 0:01:15.016 ******* 2021-11-12T05:35:27.188 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:27 +0000 (0:00:00.026) 0:01:15.043 ******* 2021-11-12T05:35:27.214 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:27 +0000 (0:00:00.025) 0:01:15.069 ******* 2021-11-12T05:35:27.222 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-11-12T05:35:27.224 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable SELinux] *********************************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:27.250 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:27 +0000 (0:00:00.035) 0:01:15.104 ******* 2021-11-12T05:35:27.277 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:27 +0000 (0:00:00.024) 0:01:15.129 ******* 2021-11-12T05:35:27.284 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-11-12T05:35:27.286 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install abrt] ************************************************* skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:27.286 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-11-12T05:35:27.287 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-11-12T05:35:27.312 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:27 +0000 (0:00:00.037) 0:01:15.167 ******* 2021-11-12T05:35:27.334 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:27 +0000 (0:00:00.022) 0:01:15.189 ******* 2021-11-12T05:35:27.342 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-12T05:35:27.344 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable abrt-auto-reporting] *********************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:27.379 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:27 +0000 (0:00:00.044) 0:01:15.233 ******* 2021-11-12T05:35:27.411 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:27 +0000 (0:00:00.032) 0:01:15.266 ******* 2021-11-12T05:35:27.423 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-11-12T05:35:27.425 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-11-12T05:35:27.428 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:27.430 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:27.458 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:27 +0000 (0:00:00.046) 0:01:15.313 ******* 2021-11-12T05:35:27.486 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:27 +0000 (0:00:00.027) 0:01:15.341 ******* 2021-11-12T05:35:27.511 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:27 +0000 (0:00:00.025) 0:01:15.366 ******* 2021-11-12T05:35:27.519 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-11-12T05:35:27.520 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:27.546 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:27 +0000 (0:00:00.034) 0:01:15.400 ******* 2021-11-12T05:35:27.570 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:27 +0000 (0:00:00.024) 0:01:15.425 ******* 2021-11-12T05:35:27.595 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:27 +0000 (0:00:00.024) 0:01:15.449 ******* 2021-11-12T05:35:27.602 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-11-12T05:35:27.604 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:27.605 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** skipping: [gibba015.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [testnode : Restart abrtd] ************************************************ 2021-11-12T05:35:27.606 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:27.633 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:27 +0000 (0:00:00.038) 0:01:15.488 ******* 2021-11-12T05:35:27.658 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:27 +0000 (0:00:00.024) 0:01:15.513 ******* 2021-11-12T05:35:27.681 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:27 +0000 (0:00:00.022) 0:01:15.536 ******* 2021-11-12T05:35:27.693 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:27.695 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:27.724 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:27 +0000 (0:00:00.043) 0:01:15.579 ******* 2021-11-12T05:35:27.756 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:27 +0000 (0:00:00.031) 0:01:15.611 ******* 2021-11-12T05:35:27.765 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-11-12T05:35:27.767 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:27.791 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:27 +0000 (0:00:00.035) 0:01:15.646 ******* 2021-11-12T05:35:27.798 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-11-12T05:35:27.800 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.001329", "end": "2021-11-12 05:35:27.458358", "rc": 0, "start": "2021-11-12 05:35:27.457029", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Upgrade packages] ********************************************* skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:27.826 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:27 +0000 (0:00:00.035) 0:01:15.681 ******* 2021-11-12T05:35:27.850 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:27 +0000 (0:00:00.023) 0:01:15.704 ******* 2021-11-12T05:35:27.857 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-11-12T05:35:27.859 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove custom repos] ****************************************** 2021-11-12T05:35:27.885 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:27 +0000 (0:00:00.035) 0:01:15.740 ******* 2021-11-12T05:35:27.911 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:27 +0000 (0:00:00.026) 0:01:15.766 ******* 2021-11-12T05:35:27.920 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-11-12T05:35:27.922 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:27.949 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:27 +0000 (0:00:00.037) 0:01:15.804 ******* 2021-11-12T05:35:27.960 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-11-12T05:35:27.962 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:27.989 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:27 +0000 (0:00:00.040) 0:01:15.844 ******* 2021-11-12T05:35:27.996 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-11-12T05:35:27.998 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Upload nagios nrpe config.] ************************************* ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-11-12T05:35:28.024 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:28 +0000 (0:00:00.034) 0:01:15.879 ******* 2021-11-12T05:35:28.046 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:28 +0000 (0:00:00.022) 0:01:15.901 ******* 2021-11-12T05:35:28.055 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-11-12T05:35:28.057 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:28.085 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:28 +0000 (0:00:00.038) 0:01:15.939 ******* 2021-11-12T05:35:28.092 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-11-12T05:35:28.094 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:28.119 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:28 +0000 (0:00:00.034) 0:01:15.974 ******* 2021-11-12T05:35:28.128 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-11-12T05:35:28.130 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:28.164 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:28 +0000 (0:00:00.044) 0:01:16.019 ******* 2021-11-12T05:35:28.172 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-11-12T05:35:28.174 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-11-12T05:35:28.176 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:28.205 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:28 +0000 (0:00:00.040) 0:01:16.059 ******* 2021-11-12T05:35:28.231 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:28 +0000 (0:00:00.026) 0:01:16.086 ******* 2021-11-12T05:35:28.240 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-11-12T05:35:28.242 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-11-12 05:32:56 UTC", "ActiveEnterTimestampMonotonic": "15497974", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service systemd-journald.socket local-fs.target basic.target -.mount remote-fs.target time-sync.target network.target system.slice sysinit.target var-run.mount nss-lookup.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-11-12 05:32:56 UTC", "AssertTimestampMonotonic": "15487016", "Before": "getty@tty1.service multi-user.target xdm.service shutdown.target plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-11-12 05:32:56 UTC", "Con 2021-11-12T05:35:28.244 INFO:teuthology.task.ansible.out:ditionTimestampMonotonic": "15487016", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1018", "ExecMainStartTimestamp": "Fri 2021-11-12 05:32:56 UTC", "ExecMainStartTimestampMonotonic": "15497871", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Fri 2021-11-12 05:32:56 UTC] ; stop_time=[n/a] ; pid=1018 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Fri 2021-11-12 05:32:56 UTC] ; stop_time=[n/a] ; pid=1018 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", " 2021-11-12T05:35:28.246 INFO:teuthology.task.ansible.out:GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-11-12 05:32:56 UTC", "InactiveExitTimestampMonotonic": "15497974", "InvocationID": "1148f91a2389441c8cf8f4b8285040f9", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1018", "MemoryAccounting": "yes", "MemoryCurrent": "1323008", "Memo 2021-11-12T05:35:28.247 INFO:teuthology.task.ansible.out:ryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-11-12 05:32:56 UTC", "StateChangeTimestampMonotonic": "15497974", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": " 2021-11-12T05:35:28.249 INFO:teuthology.task.ansible.out:no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38346", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [testnode : Install packages] ********************************************* skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install apt keys] ********************************************* ok: [gibba005.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} TASK [testnode : Add sources list] ********************************************* skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:28.277 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:28 +0000 (0:00:00.045) 0:01:16.132 ******* 2021-11-12T05:35:28.306 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:28 +0000 (0:00:00.028) 0:01:16.160 ******* 2021-11-12T05:35:28.337 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:28 +0000 (0:00:00.031) 0:01:16.192 ******* 2021-11-12T05:35:28.347 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-11-12T05:35:28.349 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get SELinux status] ********************************************* skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:28.377 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:28 +0000 (0:00:00.039) 0:01:16.232 ******* 2021-11-12T05:35:28.402 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:28 +0000 (0:00:00.025) 0:01:16.257 ******* 2021-11-12T05:35:28.410 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-11-12T05:35:28.412 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Install SELinux dependencies] **************************** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:28.450 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:28 +0000 (0:00:00.047) 0:01:16.304 ******* 2021-11-12T05:35:28.480 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:28 +0000 (0:00:00.030) 0:01:16.335 ******* 2021-11-12T05:35:28.487 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-11-12T05:35:28.489 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:28.515 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:28 +0000 (0:00:00.035) 0:01:16.370 ******* 2021-11-12T05:35:28.546 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:28 +0000 (0:00:00.030) 0:01:16.401 ******* 2021-11-12T05:35:28.554 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-11-12T05:35:28.555 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:28.580 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:28 +0000 (0:00:00.033) 0:01:16.435 ******* 2021-11-12T05:35:28.607 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:28 +0000 (0:00:00.026) 0:01:16.461 ******* 2021-11-12T05:35:28.613 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-11-12T05:35:28.615 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Remove SELinux policy package] *************************** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:28.641 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:28 +0000 (0:00:00.034) 0:01:16.496 ******* 2021-11-12T05:35:28.667 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:28 +0000 (0:00:00.025) 0:01:16.521 ******* 2021-11-12T05:35:28.674 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-12T05:35:28.675 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Copy SELinux type enforcement file] ********************** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:28.700 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:28 +0000 (0:00:00.033) 0:01:16.555 ******* 2021-11-12T05:35:28.724 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:28 +0000 (0:00:00.023) 0:01:16.579 ******* 2021-11-12T05:35:28.731 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-11-12T05:35:28.733 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Compile SELinux module file] ***************************** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:28.757 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:28 +0000 (0:00:00.033) 0:01:16.612 ******* 2021-11-12T05:35:28.780 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:28 +0000 (0:00:00.022) 0:01:16.635 ******* 2021-11-12T05:35:28.787 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-11-12T05:35:28.788 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Build SELinux policy package] **************************** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:28.813 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:28 +0000 (0:00:00.032) 0:01:16.668 ******* 2021-11-12T05:35:28.836 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:28 +0000 (0:00:00.023) 0:01:16.691 ******* 2021-11-12T05:35:28.844 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-11-12T05:35:28.846 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:28.871 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:28 +0000 (0:00:00.034) 0:01:16.726 ******* 2021-11-12T05:35:28.878 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-11-12T05:35:28.879 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:28.916 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:28 +0000 (0:00:00.044) 0:01:16.771 ******* 2021-11-12T05:35:28.925 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-11-12T05:35:28.927 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.001349", "end": "2021-11-12 05:35:28.815777", "rc": 0, "start": "2021-11-12 05:35:28.814428", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [common : nrpe - Remove temporary files] ********************************** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:28.953 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:28 +0000 (0:00:00.036) 0:01:16.808 ******* 2021-11-12T05:35:28.977 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:28 +0000 (0:00:00.024) 0:01:16.832 ******* 2021-11-12T05:35:28.985 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-11-12T05:35:28.987 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-11-12T05:35:28.987 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-11-12T05:35:28.988 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install apt keys] ********************************************* ok: [gibba016.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-11-12T05:35:28.989 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-11-12T05:35:28.989 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-11-12T05:35:29.015 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:29 +0000 (0:00:00.038) 0:01:16.870 ******* 2021-11-12T05:35:29.038 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:29 +0000 (0:00:00.022) 0:01:16.893 ******* 2021-11-12T05:35:29.063 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:29 +0000 (0:00:00.024) 0:01:16.917 ******* 2021-11-12T05:35:29.069 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-11-12T05:35:29.096 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:29 +0000 (0:00:00.033) 0:01:16.951 ******* 2021-11-12T05:35:29.103 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-11-12T05:35:29.104 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common", "libgnutls30"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-11-12T05:35:29.106 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:29.134 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:29 +0000 (0:00:00.037) 0:01:16.988 ******* 2021-11-12T05:35:29.158 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:29 +0000 (0:00:00.024) 0:01:17.013 ******* 2021-11-12T05:35:29.177 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-11-12T05:35:29.179 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-venv", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-11-12T05:35:29.202 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:29 +0000 (0:00:00.044) 0:01:17.057 ******* 2021-11-12T05:35:29.211 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-11-12T05:35:29.212 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:29.238 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:29 +0000 (0:00:00.035) 0:01:17.093 ******* 2021-11-12T05:35:29.245 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-11-12T05:35:29.247 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-11-12T05:35:29.273 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:29 +0000 (0:00:00.034) 0:01:17.128 ******* 2021-11-12T05:35:29.281 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-11-12T05:35:29.283 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:29.321 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:29 +0000 (0:00:00.047) 0:01:17.175 ******* 2021-11-12T05:35:29.341 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-11-12T05:35:29.343 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-11-12T05:35:29.533 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:29 +0000 (0:00:00.211) 0:01:17.387 ******* 2021-11-12T05:35:29.541 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-11-12T05:35:29.542 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-11-12T05:35:29.543 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* ok: [gibba005.front.sepia.ceph.com] => {"cache_update_time": 1636694779, "cache_updated": false, "changed": false} 2021-11-12T05:35:29.570 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:29 +0000 (0:00:00.037) 0:01:17.425 ******* 2021-11-12T05:35:29.594 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:29 +0000 (0:00:00.023) 0:01:17.448 ******* 2021-11-12T05:35:29.617 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:29 +0000 (0:00:00.023) 0:01:17.472 ******* 2021-11-12T05:35:29.625 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-11-12T05:35:29.626 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add local apt repos.] ***************************************** 2021-11-12T05:35:29.627 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* ok: [gibba016.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-11-12T05:35:29.654 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:29 +0000 (0:00:00.036) 0:01:17.509 ******* 2021-11-12T05:35:29.680 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:29 +0000 (0:00:00.025) 0:01:17.535 ******* 2021-11-12T05:35:29.709 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:29 +0000 (0:00:00.027) 0:01:17.562 ******* 2021-11-12T05:35:29.716 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-11-12T05:35:29.717 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-11-12T05:35:29.744 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:29 +0000 (0:00:00.036) 0:01:17.599 ******* 2021-11-12T05:35:29.768 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:29 +0000 (0:00:00.024) 0:01:17.623 ******* 2021-11-12T05:35:29.775 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-11-12T05:35:29.777 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Blast the apt cache.] ***************************************** [WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.010632", "end": "2021-11-12 05:35:29.753622", "rc": 0, "start": "2021-11-12 05:35:29.742990", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:35:29.803 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:29 +0000 (0:00:00.034) 0:01:17.658 ******* 2021-11-12T05:35:29.828 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:29 +0000 (0:00:00.024) 0:01:17.683 ******* 2021-11-12T05:35:29.858 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-11-12T05:35:29.859 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:29.882 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:29 +0000 (0:00:00.053) 0:01:17.736 ******* 2021-11-12T05:35:29.888 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-11-12T05:35:29.890 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.001239", "end": "2021-11-12 05:35:29.618835", "rc": 0, "start": "2021-11-12 05:35:29.617596", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:35:29.923 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:29 +0000 (0:00:00.041) 0:01:17.778 ******* 2021-11-12T05:35:29.953 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-11-12T05:35:29.977 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:29 +0000 (0:00:00.054) 0:01:17.832 ******* 2021-11-12T05:35:30.006 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-11-12T05:35:30.008 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-11-12T05:35:30.032 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:30 +0000 (0:00:00.054) 0:01:17.886 ******* 2021-11-12T05:35:30.137 INFO:teuthology.task.ansible.out: 2021-11-12T05:35:30.138 INFO:teuthology.task.ansible.out:TASK [testnode : Install python-apt] ******************************************* ok: [gibba016.front.sepia.ceph.com] => {"cache_update_time": 1636694883, "cache_updated": false, "changed": false} 2021-11-12T05:35:30.164 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:30 +0000 (0:00:00.132) 0:01:18.019 ******* 2021-11-12T05:35:30.193 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-11-12T05:35:30.217 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:30 +0000 (0:00:00.053) 0:01:18.072 ******* 2021-11-12T05:35:30.235 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-11-12T05:35:30.237 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-11-12T05:35:30.263 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:30 +0000 (0:00:00.046) 0:01:18.118 ******* 2021-11-12T05:35:30.265 INFO:teuthology.task.ansible.out: 2021-11-12T05:35:30.314 INFO:teuthology.task.ansible.out: 2021-11-12T05:35:30.315 INFO:teuthology.task.ansible.out:TASK [testnode : Add sources list] ********************************************* skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:30.339 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:30 +0000 (0:00:00.075) 0:01:18.194 ******* 2021-11-12T05:35:30.357 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-11-12T05:35:30.358 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.010693", "end": "2021-11-12 05:35:30.036147", "rc": 0, "start": "2021-11-12 05:35:30.025454", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:35:30.385 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:30 +0000 (0:00:00.045) 0:01:18.240 ******* 2021-11-12T05:35:30.405 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-11-12T05:35:30.407 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-11-12T05:35:30.432 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:30 +0000 (0:00:00.047) 0:01:18.287 ******* 2021-11-12T05:35:30.450 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-11-12T05:35:30.452 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-11-12T05:35:30.461 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-11-12T05:35:30.463 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "gibba015"}, "changed": false} 2021-11-12T05:35:30.486 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:30 +0000 (0:00:00.053) 0:01:18.340 ******* 2021-11-12T05:35:30.725 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-11-12T05:35:30.727 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "gibba015.front.sepia.ceph.com", "ansible_hostname": "gibba015", "ansible_nodename": "gibba015"}, "changed": true, "name": "gibba015"} 2021-11-12T05:35:30.750 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:30 +0000 (0:00:00.264) 0:01:18.605 ******* 2021-11-12T05:35:31.030 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-11-12T05:35:31.032 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-11-12T05:35:31.061 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:31 +0000 (0:00:00.310) 0:01:18.916 ******* 2021-11-12T05:35:31.090 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-11-12T05:35:31.092 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-11-12T05:35:31.103 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-11-12T05:35:31.104 INFO:teuthology.task.ansible.out: 2021-11-12T05:35:31.131 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:31 +0000 (0:00:00.069) 0:01:18.986 ******* 2021-11-12T05:35:31.308 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-11-12T05:35:31.309 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-11-12T05:35:31.353 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:31 +0000 (0:00:00.221) 0:01:19.208 ******* 2021-11-12T05:35:31.410 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-11-12T05:35:31.412 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"cache_update_time": 1636694779, "cache_updated": false, "changed": false} 2021-11-12T05:35:31.437 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:31 +0000 (0:00:00.084) 0:01:19.292 ******* 2021-11-12T05:35:31.577 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* ok: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1636694933, "cache_updated": false, "changed": false} 2021-11-12T05:35:31.603 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:31 +0000 (0:00:00.165) 0:01:19.458 ******* 2021-11-12T05:35:31.632 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-11-12T05:35:31.656 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:31 +0000 (0:00:00.053) 0:01:19.511 ******* 2021-11-12T05:35:31.748 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-11-12T05:35:31.749 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-11-12T05:35:31.774 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:31 +0000 (0:00:00.117) 0:01:19.629 ******* 2021-11-12T05:35:31.782 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-11-12T05:35:31.783 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-11-12T05:35:31.809 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:31 +0000 (0:00:00.035) 0:01:19.664 ******* 2021-11-12T05:35:31.818 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-11-12T05:35:31.818 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.011360", "end": "2021-11-12 05:35:31.712204", "rc": 0, "start": "2021-11-12 05:35:31.700844", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:35:31.844 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:31 +0000 (0:00:00.035) 0:01:19.699 ******* 2021-11-12T05:35:31.852 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-11-12T05:35:31.854 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"cache_update_time": 1636694883, "cache_updated": false, "changed": false} TASK [testnode : Create remote.conf] ******************************************* skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:31.880 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:31 +0000 (0:00:00.035) 0:01:19.735 ******* 2021-11-12T05:35:31.903 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:31 +0000 (0:00:00.022) 0:01:19.757 ******* 2021-11-12T05:35:31.910 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-11-12T05:35:31.912 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:31.946 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:31 +0000 (0:00:00.042) 0:01:19.800 ******* 2021-11-12T05:35:31.977 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:32.000 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:31 +0000 (0:00:00.054) 0:01:19.855 ******* 2021-11-12T05:35:32.033 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-11-12T05:35:32.035 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:32.057 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:32 +0000 (0:00:00.056) 0:01:19.912 ******* 2021-11-12T05:35:32.085 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-11-12T05:35:32.087 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:32.108 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:32 +0000 (0:00:00.051) 0:01:19.963 ******* 2021-11-12T05:35:32.136 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-11-12T05:35:32.137 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:32.162 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:32 +0000 (0:00:00.053) 0:01:20.016 ******* 2021-11-12T05:35:32.190 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:32.213 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:32 +0000 (0:00:00.051) 0:01:20.068 ******* 2021-11-12T05:35:32.221 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-11-12T05:35:32.222 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"cache_update_time": 1636694984, "cache_updated": false, "changed": false} 2021-11-12T05:35:32.247 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:32 +0000 (0:00:00.033) 0:01:20.102 ******* 2021-11-12T05:35:32.254 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ 2021-11-12T05:35:32.256 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:32.280 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:32 +0000 (0:00:00.033) 0:01:20.135 ******* 2021-11-12T05:35:32.288 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-11-12T05:35:32.314 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:32 +0000 (0:00:00.033) 0:01:20.169 ******* 2021-11-12T05:35:32.321 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-12T05:35:32.322 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:32.349 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:32 +0000 (0:00:00.034) 0:01:20.204 ******* 2021-11-12T05:35:32.388 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* 2021-11-12T05:35:32.390 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} 2021-11-12T05:35:32.413 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:32 +0000 (0:00:00.063) 0:01:20.267 ******* 2021-11-12T05:35:32.430 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-11-12T05:35:32.432 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.011079", "end": "2021-11-12 05:35:32.171193", "rc": 0, "start": "2021-11-12 05:35:32.160114", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:35:32.455 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:32 +0000 (0:00:00.042) 0:01:20.310 ******* 2021-11-12T05:35:32.462 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-11-12T05:35:32.464 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:32.509 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:32 +0000 (0:00:00.053) 0:01:20.363 ******* 2021-11-12T05:35:32.542 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-11-12T05:35:32.566 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:32 +0000 (0:00:00.057) 0:01:20.421 ******* 2021-11-12T05:35:32.595 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-11-12T05:35:32.634 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:32 +0000 (0:00:00.067) 0:01:20.488 ******* 2021-11-12T05:35:32.670 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-11-12T05:35:32.710 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:32 +0000 (0:00:00.076) 0:01:20.565 ******* 2021-11-12T05:35:32.747 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-11-12T05:35:32.749 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:32.774 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:32 +0000 (0:00:00.063) 0:01:20.628 ******* 2021-11-12T05:35:32.824 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-11-12T05:35:32.826 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-11-12T05:35:32.836 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-11-12T05:35:32.837 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=https://dist.apache.org/repos/dist/dev/arrow/KEYS) => {"ansible_loop_var": "item", "changed": false, "item": "https://dist.apache.org/repos/dist/dev/arrow/KEYS", "skip_reason": "Conditional result was False"} 2021-11-12T05:35:32.861 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:32 +0000 (0:00:00.086) 0:01:20.715 ******* 2021-11-12T05:35:32.890 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-11-12T05:35:32.892 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:32.914 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:32 +0000 (0:00:00.053) 0:01:20.769 ******* 2021-11-12T05:35:32.945 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-12T05:35:32.947 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:32.971 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:32 +0000 (0:00:00.056) 0:01:20.825 ******* 2021-11-12T05:35:32.999 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-11-12T05:35:33.001 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:33.024 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:33 +0000 (0:00:00.054) 0:01:20.879 ******* 2021-11-12T05:35:33.053 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-11-12T05:35:33.055 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:33.078 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:33 +0000 (0:00:00.053) 0:01:20.932 ******* 2021-11-12T05:35:33.107 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:33.131 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:33 +0000 (0:00:00.053) 0:01:20.986 ******* 2021-11-12T05:35:33.161 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:33.185 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:33 +0000 (0:00:00.053) 0:01:21.040 ******* 2021-11-12T05:35:33.213 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-11-12T05:35:33.215 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:33.240 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:33 +0000 (0:00:00.055) 0:01:21.095 ******* 2021-11-12T05:35:33.268 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-11-12T05:35:33.269 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:33.291 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:33 +0000 (0:00:00.051) 0:01:21.146 ******* 2021-11-12T05:35:33.319 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-12T05:35:33.321 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:33.344 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:33 +0000 (0:00:00.052) 0:01:21.199 ******* 2021-11-12T05:35:33.373 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-11-12T05:35:33.375 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:33.398 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:33 +0000 (0:00:00.053) 0:01:21.252 ******* 2021-11-12T05:35:33.416 INFO:teuthology.task.ansible.out: 2021-11-12T05:35:33.418 INFO:teuthology.task.ansible.out:TASK [testnode : Update apt cache.] ******************************************** 2021-11-12T05:35:33.418 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1636694933, "cache_updated": false, "changed": false} 2021-11-12T05:35:33.454 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:33 +0000 (0:00:00.044) 0:01:21.297 ******* 2021-11-12T05:35:33.459 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-11-12T05:35:33.461 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:33.486 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:33 +0000 (0:00:00.043) 0:01:21.341 ******* 2021-11-12T05:35:33.516 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-12T05:35:33.518 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:33.540 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:33 +0000 (0:00:00.054) 0:01:21.395 ******* 2021-11-12T05:35:33.568 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-11-12T05:35:33.570 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:33.598 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:33 +0000 (0:00:00.057) 0:01:21.453 ******* 2021-11-12T05:35:33.627 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-11-12T05:35:33.629 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:33.655 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:33 +0000 (0:00:00.056) 0:01:21.510 ******* 2021-11-12T05:35:33.688 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-11-12T05:35:33.690 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:33.714 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:33 +0000 (0:00:00.059) 0:01:21.569 ******* 2021-11-12T05:35:33.743 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-11-12T05:35:33.744 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:33.768 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:33 +0000 (0:00:00.054) 0:01:21.623 ******* 2021-11-12T05:35:33.798 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-11-12T05:35:33.800 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:33.823 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:33 +0000 (0:00:00.054) 0:01:21.677 ******* 2021-11-12T05:35:33.851 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-11-12T05:35:33.853 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:33.881 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:33 +0000 (0:00:00.057) 0:01:21.735 ******* 2021-11-12T05:35:33.908 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-11-12T05:35:33.910 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:33.934 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:33 +0000 (0:00:00.052) 0:01:21.788 ******* 2021-11-12T05:35:33.961 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-11-12T05:35:33.963 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"cache_update_time": 1636694984, "cache_updated": false, "changed": false} 2021-11-12T05:35:33.987 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:33 +0000 (0:00:00.053) 0:01:21.842 ******* 2021-11-12T05:35:33.995 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-11-12T05:35:33.997 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:34.023 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:34 +0000 (0:00:00.035) 0:01:21.878 ******* 2021-11-12T05:35:34.137 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-11-12T05:35:34.139 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.001320", "end": "2021-11-12 05:35:34.263199", "rc": 0, "start": "2021-11-12 05:35:34.261879", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:35:34.166 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:34 +0000 (0:00:00.143) 0:01:22.021 ******* 2021-11-12T05:35:34.199 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-11-12T05:35:34.233 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:34 +0000 (0:00:00.066) 0:01:22.087 ******* 2021-11-12T05:35:34.499 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-11-12T05:35:34.501 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-11-12T05:35:34.524 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:34 +0000 (0:00:00.291) 0:01:22.379 ******* 2021-11-12T05:35:34.554 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-11-12T05:35:34.555 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:34.578 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:34 +0000 (0:00:00.053) 0:01:22.432 ******* 2021-11-12T05:35:35.299 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-11-12T05:35:35.301 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-11-12T05:35:35.952 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-11-12T05:35:35.976 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:35 +0000 (0:00:01.398) 0:01:23.831 ******* 2021-11-12T05:35:36.425 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-11-12T05:35:36.427 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"cache_update_time": 1636694831, "cache_updated": false, "changed": false} 2021-11-12T05:35:36.450 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:36 +0000 (0:00:00.474) 0:01:24.305 ******* 2021-11-12T05:35:36.479 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-11-12T05:35:36.503 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:36 +0000 (0:00:00.052) 0:01:24.358 ******* 2021-11-12T05:35:36.636 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-11-12T05:35:36.638 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.011458", "end": "2021-11-12 05:35:36.766759", "rc": 0, "start": "2021-11-12 05:35:36.755301", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:35:36.661 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:36 +0000 (0:00:00.157) 0:01:24.516 ******* 2021-11-12T05:35:38.173 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-11-12T05:35:38.175 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"cache_update_time": 1636694831, "cache_updated": false, "changed": false} 2021-11-12T05:35:38.202 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:38 +0000 (0:00:01.540) 0:01:26.056 ******* 2021-11-12T05:35:38.727 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-11-12T05:35:38.729 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 49 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading databa 2021-11-12T05:35:38.731 INFO:teuthology.task.ansible.out:se ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nRemoving librbd1 (15.2.13-0ubuntu0.20.04.2) ...\r\nRemoving librados2 (15.2.13-0ubuntu0.20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 49 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Readi 2021-11-12T05:35:38.732 INFO:teuthology.task.ansible.out:ng database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.17) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Removing librbd1 (15.2.13-0ubuntu0.20.04.2) ...", "Removing librados2 (15.2.13-0ubuntu0.20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-11-12T05:35:38.758 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:38 +0000 (0:00:00.555) 0:01:26.612 ******* 2021-11-12T05:35:39.556 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 49 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading databa 2021-11-12T05:35:39.558 INFO:teuthology.task.ansible.out:se ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nRemoving librbd1 (15.2.13-0ubuntu0.20.04.2) ...\r\nRemoving librados2 (15.2.13-0ubuntu0.20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 49 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Readi 2021-11-12T05:35:39.560 INFO:teuthology.task.ansible.out:ng database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.17) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Removing librbd1 (15.2.13-0ubuntu0.20.04.2) ...", "Removing librados2 (15.2.13-0ubuntu0.20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-11-12T05:35:39.583 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:39 +0000 (0:00:00.825) 0:01:27.438 ******* 2021-11-12T05:35:40.850 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 49 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading databa 2021-11-12T05:35:40.851 INFO:teuthology.task.ansible.out:se ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nRemoving librbd1 (15.2.13-0ubuntu0.20.04.2) ...\r\nRemoving librados2 (15.2.13-0ubuntu0.20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 49 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Readi 2021-11-12T05:35:40.853 INFO:teuthology.task.ansible.out:ng database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.17) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Removing librbd1 (15.2.13-0ubuntu0.20.04.2) ...", "Removing librados2 (15.2.13-0ubuntu0.20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-11-12T05:35:40.876 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:40 +0000 (0:00:01.292) 0:01:28.731 ******* 2021-11-12T05:35:41.675 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 49 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading databa 2021-11-12T05:35:41.677 INFO:teuthology.task.ansible.out:se ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nRemoving librbd1 (15.2.13-0ubuntu0.20.04.2) ...\r\nRemoving librados2 (15.2.13-0ubuntu0.20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 49 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Readi 2021-11-12T05:35:41.678 INFO:teuthology.task.ansible.out:ng database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.17) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Removing librbd1 (15.2.13-0ubuntu0.20.04.2) ...", "Removing librados2 (15.2.13-0ubuntu0.20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-11-12T05:35:41.702 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:41 +0000 (0:00:00.825) 0:01:29.557 ******* 2021-11-12T05:35:45.387 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 49 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading databa 2021-11-12T05:35:45.389 INFO:teuthology.task.ansible.out:se ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nRemoving librbd1 (15.2.13-0ubuntu0.20.04.2) ...\r\nRemoving librados2 (15.2.13-0ubuntu0.20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 49 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Readi 2021-11-12T05:35:45.390 INFO:teuthology.task.ansible.out:ng database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.17) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Removing librbd1 (15.2.13-0ubuntu0.20.04.2) ...", "Removing librados2 (15.2.13-0ubuntu0.20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-11-12T05:35:45.418 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:45 +0000 (0:00:03.715) 0:01:33.272 ******* 2021-11-12T05:35:52.550 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-12T05:35:52.552 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"cache_update_time": 1636694779, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils\n4 upgraded, 0 newly installed, 0 to remove and 45 not upgraded.\nNeed to get 1519 kB of archives.\nAfter this operation, 3072 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.8 [95.5 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.8 [118 2021-11-12T05:35:52.554 INFO:teuthology.task.ansible.out:1 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.8 [159 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.8 [84.5 kB]\nFetched 1519 kB in 1s (1666 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.8_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.8) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.13) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and ar 2021-11-12T05:35:52.555 INFO:teuthology.task.ansible.out:e no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils", "4 upgraded, 0 newly installed, 0 to remove and 45 not upgraded.", "Need to get 1519 kB of archives.", "After this operation, 3072 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.8 [95.5 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.8 [1181 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.8 [159 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.8 [84.5 kB]", "Fetched 1519 kB in 1s (1666 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading databas 2021-11-12T05:35:52.557 INFO:teuthology.task.ansible.out:e ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.8_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.8) ...", "Setting up apache2-data (2.4.41-4ubuntu3.8) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.8) ...", "Setting up apache2 (2.4.41-4ubuntu3.8) ...", "Processing triggers for systemd (245.4-4ubuntu3.13) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for ufw (0.36-6) ..."]} 2021-11-12T05:35:52.577 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:52 +0000 (0:00:07.159) 0:01:40.431 ******* 2021-11-12T05:35:52.617 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-11-12T05:35:52.619 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:52.641 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:52 +0000 (0:00:00.064) 0:01:40.496 ******* 2021-11-12T05:35:54.169 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-12T05:35:54.171 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1636694933, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils\n4 upgraded, 0 newly installed, 0 to remove and 45 not upgraded.\nNeed to get 1519 kB of archives.\nAfter this operation, 3072 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.8 [95.5 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.8 [118 2021-11-12T05:35:54.173 INFO:teuthology.task.ansible.out:1 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.8 [159 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.8 [84.5 kB]\nFetched 1519 kB in 1s (1810 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.8_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.8) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.13) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and ar 2021-11-12T05:35:54.175 INFO:teuthology.task.ansible.out:e no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils", "4 upgraded, 0 newly installed, 0 to remove and 45 not upgraded.", "Need to get 1519 kB of archives.", "After this operation, 3072 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.8 [95.5 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.8 [1181 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.8 [159 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.8 [84.5 kB]", "Fetched 1519 kB in 1s (1810 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading databas 2021-11-12T05:35:54.177 INFO:teuthology.task.ansible.out:e ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.8_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.8) ...", "Setting up apache2-data (2.4.41-4ubuntu3.8) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.8) ...", "Setting up apache2 (2.4.41-4ubuntu3.8) ...", "Processing triggers for systemd (245.4-4ubuntu3.13) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for ufw (0.36-6) ..."]} 2021-11-12T05:35:54.196 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:54 +0000 (0:00:01.554) 0:01:42.051 ******* 2021-11-12T05:35:54.225 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-11-12T05:35:54.227 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:54.251 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:54 +0000 (0:00:00.055) 0:01:42.106 ******* 2021-11-12T05:35:54.704 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-12T05:35:54.706 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => {"cache_update_time": 1636694883, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils\n4 upgraded, 0 newly installed, 0 to remove and 45 not upgraded.\nNeed to get 1519 kB of archives.\nAfter this operation, 3072 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.8 [95.5 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.8 [118 2021-11-12T05:35:54.707 INFO:teuthology.task.ansible.out:1 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.8 [159 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.8 [84.5 kB]\nFetched 1519 kB in 1s (1722 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.8_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.8) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.13) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and ar 2021-11-12T05:35:54.709 INFO:teuthology.task.ansible.out:e no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils", "4 upgraded, 0 newly installed, 0 to remove and 45 not upgraded.", "Need to get 1519 kB of archives.", "After this operation, 3072 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.8 [95.5 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.8 [1181 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.8 [159 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.8 [84.5 kB]", "Fetched 1519 kB in 1s (1722 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading databas 2021-11-12T05:35:54.710 INFO:teuthology.task.ansible.out:e ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.8_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.8) ...", "Setting up apache2-data (2.4.41-4ubuntu3.8) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.8) ...", "Setting up apache2 (2.4.41-4ubuntu3.8) ...", "Processing triggers for systemd (245.4-4ubuntu3.13) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for ufw (0.36-6) ..."]} 2021-11-12T05:35:54.730 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:54 +0000 (0:00:00.478) 0:01:42.585 ******* 2021-11-12T05:35:54.760 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:54.784 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:54 +0000 (0:00:00.053) 0:01:42.638 ******* 2021-11-12T05:35:55.667 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-12T05:35:55.669 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"cache_update_time": 1636694984, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils\n4 upgraded, 0 newly installed, 0 to remove and 45 not upgraded.\nNeed to get 1519 kB of archives.\nAfter this operation, 3072 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.8 [95.5 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.8 [118 2021-11-12T05:35:55.670 INFO:teuthology.task.ansible.out:1 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.8 [159 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.8 [84.5 kB]\nFetched 1519 kB in 1s (1833 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.8_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.8) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.13) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and ar 2021-11-12T05:35:55.672 INFO:teuthology.task.ansible.out:e no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils", "4 upgraded, 0 newly installed, 0 to remove and 45 not upgraded.", "Need to get 1519 kB of archives.", "After this operation, 3072 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.8 [95.5 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.8 [1181 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.8 [159 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.8 [84.5 kB]", "Fetched 1519 kB in 1s (1833 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading databas 2021-11-12T05:35:55.674 INFO:teuthology.task.ansible.out:e ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.8_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.8) ...", "Setting up apache2-data (2.4.41-4ubuntu3.8) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.8) ...", "Setting up apache2 (2.4.41-4ubuntu3.8) ...", "Processing triggers for systemd (245.4-4ubuntu3.13) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for ufw (0.36-6) ..."]} 2021-11-12T05:35:55.693 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:55 +0000 (0:00:00.909) 0:01:43.547 ******* 2021-11-12T05:35:55.720 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-11-12T05:35:55.722 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:55.745 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:55 +0000 (0:00:00.052) 0:01:43.600 ******* 2021-11-12T05:35:59.311 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-12T05:35:59.313 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"cache_update_time": 1636694831, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils\n4 upgraded, 0 newly installed, 0 to remove and 45 not upgraded.\nNeed to get 1519 kB of archives.\nAfter this operation, 3072 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.8 [95.5 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.8 [118 2021-11-12T05:35:59.315 INFO:teuthology.task.ansible.out:1 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.8 [159 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.8 [84.5 kB]\nFetched 1519 kB in 1s (1832 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.8_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.8_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.8) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.8) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.13) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and ar 2021-11-12T05:35:59.317 INFO:teuthology.task.ansible.out:e no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils", "4 upgraded, 0 newly installed, 0 to remove and 45 not upgraded.", "Need to get 1519 kB of archives.", "After this operation, 3072 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.8 [95.5 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.8 [1181 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.8 [159 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.8 [84.5 kB]", "Fetched 1519 kB in 1s (1832 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading databas 2021-11-12T05:35:59.319 INFO:teuthology.task.ansible.out:e ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.8_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.8_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.8) over (2.4.41-4ubuntu3.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.8) ...", "Setting up apache2-data (2.4.41-4ubuntu3.8) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.8) ...", "Setting up apache2 (2.4.41-4ubuntu3.8) ...", "Processing triggers for systemd (245.4-4ubuntu3.13) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for ufw (0.36-6) ..."]} 2021-11-12T05:35:59.337 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:59 +0000 (0:00:03.592) 0:01:47.192 ******* 2021-11-12T05:35:59.367 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-11-12T05:35:59.369 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:35:59.392 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:35:59 +0000 (0:00:00.054) 0:01:47.247 ******* 2021-11-12T05:36:02.538 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-12T05:36:02.539 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"cache_update_time": 1636694779, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3.2).\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n qemu-system-data qemu-system-gui\n2 upgraded, 6 newly installed, 0 to remove and 43 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qe 2021-11-12T05:36:02.541 INFO:teuthology.task.ansible.out:mu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]\nFetched 14.3 MB in 1s (11.5 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nPreparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 (1:4.2-3ub 2021-11-12T05:36:02.542 INFO:teuthology.task.ansible.out:untu6.18) over (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.18) ...\r\nSetting up librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.18) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.25.1-1ubuntu3.2).", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " qemu-system-data qemu-system-gui", "2 upgrade 2021-11-12T05:36:02.544 INFO:teuthology.task.ansible.out:d, 6 newly installed, 0 to remove and 43 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]", "Fetched 14.3 MB in 1s (11.5 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.14-0ubuntu0.20.04.1) ..." 2021-11-12T05:36:02.546 INFO:teuthology.task.ansible.out:, "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.18) ...", "Preparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.18) ...", "Setting up librados2 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.18) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.18) ...", "Proce 2021-11-12T05:36:02.546 INFO:teuthology.task.ansible.out:ssing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for mime-support (3.64ubuntu1) ..."]} 2021-11-12T05:36:02.572 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:02 +0000 (0:00:03.179) 0:01:50.426 ******* 2021-11-12T05:36:03.015 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-11-12T05:36:03.017 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"cache_update_time": 1636694779, "cache_updated": false, "changed": false} 2021-11-12T05:36:03.039 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:03 +0000 (0:00:00.467) 0:01:50.894 ******* 2021-11-12T05:36:03.505 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** ok: [gibba005.front.sepia.ceph.com] => {"cache_update_time": 1636694779, "cache_updated": false, "changed": false} 2021-11-12T05:36:03.529 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:03 +0000 (0:00:00.489) 0:01:51.383 ******* 2021-11-12T05:36:03.631 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-11-12T05:36:03.634 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-11-12T05:36:03.656 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:03 +0000 (0:00:00.127) 0:01:51.511 ******* 2021-11-12T05:36:03.684 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-11-12T05:36:03.686 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:03.708 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:03 +0000 (0:00:00.051) 0:01:51.562 ******* 2021-11-12T05:36:03.809 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-11-12T05:36:03.811 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-11-12T05:36:03.836 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:03 +0000 (0:00:00.127) 0:01:51.690 ******* 2021-11-12T05:36:04.096 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-11-12T05:36:04.098 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-11-12T05:36:04.121 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:04 +0000 (0:00:00.285) 0:01:51.976 ******* 2021-11-12T05:36:04.276 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-11-12T05:36:04.278 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-11-12T05:36:04.301 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:04 +0000 (0:00:00.180) 0:01:52.156 ******* 2021-11-12T05:36:04.414 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** ok: [gibba005.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-12T05:36:04.438 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:04 +0000 (0:00:00.136) 0:01:52.293 ******* 2021-11-12T05:36:04.532 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-12T05:36:04.533 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1636694933, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3.2).\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n qemu-system-data qemu-system-gui\n2 upgraded, 6 newly installed, 0 to remove and 43 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qe 2021-11-12T05:36:04.534 INFO:teuthology.task.ansible.out:mu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]\nFetched 14.3 MB in 1s (12.0 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nPreparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 (1:4.2-3ub 2021-11-12T05:36:04.536 INFO:teuthology.task.ansible.out:untu6.18) over (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.18) ...\r\nSetting up librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.18) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.25.1-1ubuntu3.2).", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " qemu-system-data qemu-system-gui", "2 upgrade 2021-11-12T05:36:04.538 INFO:teuthology.task.ansible.out:d, 6 newly installed, 0 to remove and 43 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]", "Fetched 14.3 MB in 1s (12.0 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.14-0ubuntu0.20.04.1) ..." 2021-11-12T05:36:04.539 INFO:teuthology.task.ansible.out:, "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.18) ...", "Preparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.18) ...", "Setting up librados2 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.18) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.18) ...", "Proce 2021-11-12T05:36:04.540 INFO:teuthology.task.ansible.out:ssing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for mime-support (3.64ubuntu1) ..."]} 2021-11-12T05:36:04.566 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:04 +0000 (0:00:00.128) 0:01:52.421 ******* 2021-11-12T05:36:04.630 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-11-12T05:36:04.631 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Fri 2021-11-12 05:35:50 UTC", "ActiveEnterTimestampMonotonic": "192671613", "ActiveExitTimestamp": "Fri 2021-11-12 05:35:50 UTC", "ActiveExitTimestampMonotonic": "192628327", "ActiveState": "active", "After": "-.mount systemd-journald.socket nss-lookup.target system.slice sysinit.target systemd-tmpfiles-setup.service network.target remote-fs.target basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-11-12 05:35:50 UTC", "AssertTimestampMonotonic": "192659280", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-11-12 05:35:50 UTC", "ConditionTimestampMonotonic": "192659279", "ConfigurationDirect 2021-11-12T05:36:04.633 INFO:teuthology.task.ansible.out:oryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6649", "ExecMainStartTimestamp": "Fri 2021-11-12 05:35:50 UTC", "ExecMainStartTimestampMonotonic": "192671604", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriori 2021-11-12T05:36:04.634 INFO:teuthology.task.ansible.out:ty": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Fri 2021-11-12 05:35:50 UTC", "InactiveEnterTimestampMonotonic": "192658804", "InactiveExitTimestamp": "Fri 2021-11-12 05:35:50 UTC", "InactiveExitTimestampMonotonic": "192659967", "InvocationID": "7114ac1afa584b2bb6a6eafc3e3f78a9", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6649", "MemoryAccounting": "yes", "MemoryCurrent": "7053312", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySw 2021-11-12T05:36:04.636 INFO:teuthology.task.ansible.out:apMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-11-12 05:35:50 UTC", "StateChangeTimestampMonotonic": "192671613", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "T 2021-11-12T05:36:04.638 INFO:teuthology.task.ansible.out:TYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38346", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-12T05:36:04.657 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:04 +0000 (0:00:00.090) 0:01:52.512 ******* 2021-11-12T05:36:04.684 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-11-12T05:36:04.686 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:04.709 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:04 +0000 (0:00:00.051) 0:01:52.563 ******* 2021-11-12T05:36:04.737 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-11-12T05:36:04.739 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:04.760 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:04 +0000 (0:00:00.052) 0:01:52.615 ******* 2021-11-12T05:36:04.788 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-11-12T05:36:04.790 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:04.812 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:04 +0000 (0:00:00.051) 0:01:52.667 ******* 2021-11-12T05:36:04.840 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-11-12T05:36:04.842 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:04.864 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:04 +0000 (0:00:00.051) 0:01:52.718 ******* 2021-11-12T05:36:04.892 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-11-12T05:36:04.894 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:04.920 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:04 +0000 (0:00:00.056) 0:01:52.775 ******* 2021-11-12T05:36:04.948 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-11-12T05:36:04.950 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:04.975 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:04 +0000 (0:00:00.054) 0:01:52.830 ******* 2021-11-12T05:36:05.003 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-11-12T05:36:05.005 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install non aarch64 packages] ********************************* ok: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1636694933, "cache_updated": false, "changed": false} 2021-11-12T05:36:05.029 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:05 +0000 (0:00:00.053) 0:01:52.884 ******* 2021-11-12T05:36:05.052 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:05 +0000 (0:00:00.023) 0:01:52.907 ******* 2021-11-12T05:36:05.060 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-11-12T05:36:05.061 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:05.087 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:05 +0000 (0:00:00.034) 0:01:52.941 ******* 2021-11-12T05:36:05.114 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-12T05:36:05.116 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:05.144 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:05 +0000 (0:00:00.057) 0:01:52.999 ******* 2021-11-12T05:36:05.172 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-11-12T05:36:05.174 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:05.201 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:05 +0000 (0:00:00.051) 0:01:53.050 ******* 2021-11-12T05:36:05.231 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-12T05:36:05.233 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:05.256 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:05 +0000 (0:00:00.060) 0:01:53.111 ******* 2021-11-12T05:36:05.285 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-12T05:36:05.287 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:05.314 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:05 +0000 (0:00:00.058) 0:01:53.169 ******* 2021-11-12T05:36:05.345 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-11-12T05:36:05.347 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:05.369 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:05 +0000 (0:00:00.053) 0:01:53.223 ******* 2021-11-12T05:36:05.396 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-11-12T05:36:05.398 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:05.419 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:05 +0000 (0:00:00.051) 0:01:53.274 ******* 2021-11-12T05:36:05.448 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-12T05:36:05.449 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => {"cache_update_time": 1636694883, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3.2).\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n qemu-system-data qemu-system-gui\n2 upgraded, 6 newly installed, 0 to remove and 43 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qe 2021-11-12T05:36:05.451 INFO:teuthology.task.ansible.out:mu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]\nFetched 14.3 MB in 1s (11.4 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nPreparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 (1:4.2-3ub 2021-11-12T05:36:05.452 INFO:teuthology.task.ansible.out:untu6.18) over (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.18) ...\r\nSetting up librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.18) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.25.1-1ubuntu3.2).", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " qemu-system-data qemu-system-gui", "2 upgrade 2021-11-12T05:36:05.454 INFO:teuthology.task.ansible.out:d, 6 newly installed, 0 to remove and 43 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]", "Fetched 14.3 MB in 1s (11.4 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.14-0ubuntu0.20.04.1) ..." 2021-11-12T05:36:05.455 INFO:teuthology.task.ansible.out:, "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.18) ...", "Preparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.18) ...", "Setting up librados2 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.18) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.18) ...", "Proce 2021-11-12T05:36:05.456 INFO:teuthology.task.ansible.out:ssing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for mime-support (3.64ubuntu1) ..."]} 2021-11-12T05:36:05.457 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:05.481 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:05 +0000 (0:00:00.061) 0:01:53.336 ******* 2021-11-12T05:36:05.511 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:05 +0000 (0:00:00.030) 0:01:53.366 ******* 2021-11-12T05:36:05.519 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-11-12T05:36:05.521 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1636694933, "cache_updated": false, "changed": false} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:05.549 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:05 +0000 (0:00:00.037) 0:01:53.403 ******* 2021-11-12T05:36:05.572 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:05 +0000 (0:00:00.023) 0:01:53.427 ******* 2021-11-12T05:36:05.589 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-11-12T05:36:05.591 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:05.615 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:05 +0000 (0:00:00.043) 0:01:53.470 ******* 2021-11-12T05:36:05.645 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-11-12T05:36:05.647 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:05.671 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:05 +0000 (0:00:00.055) 0:01:53.526 ******* 2021-11-12T05:36:05.689 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-11-12T05:36:05.691 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-11-12T05:36:05.714 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:05 +0000 (0:00:00.042) 0:01:53.569 ******* 2021-11-12T05:36:05.720 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-11-12T05:36:05.722 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:05.746 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:05 +0000 (0:00:00.032) 0:01:53.601 ******* 2021-11-12T05:36:05.754 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-11-12T05:36:05.756 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:05.784 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:05 +0000 (0:00:00.037) 0:01:53.639 ******* 2021-11-12T05:36:05.794 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-11-12T05:36:05.795 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:05.820 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:05 +0000 (0:00:00.036) 0:01:53.675 ******* 2021-11-12T05:36:05.849 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-11-12T05:36:05.851 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:05.874 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:05 +0000 (0:00:00.053) 0:01:53.729 ******* 2021-11-12T05:36:05.903 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-11-12T05:36:05.905 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:05.928 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:05 +0000 (0:00:00.053) 0:01:53.783 ******* 2021-11-12T05:36:05.952 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:05 +0000 (0:00:00.024) 0:01:53.807 ******* 2021-11-12T05:36:05.960 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-11-12T05:36:05.962 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"cache_update_time": 1636694883, "cache_updated": false, "changed": false} 2021-11-12T05:36:05.962 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-12T05:36:05.963 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"cache_update_time": 1636694984, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3.2).\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n qemu-system-data qemu-system-gui\n2 upgraded, 6 newly installed, 0 to remove and 43 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3u 2021-11-12T05:36:05.964 INFO:teuthology.task.ansible.out:buntu6.18 [1056 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]\nFetched 14.3 MB in 1s (11.6 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nPreparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...\r\n 2021-11-12T05:36:05.966 INFO:teuthology.task.ansible.out:Unpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.18) ...\r\nSetting up librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.18) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.25.1-1ubuntu3.2).", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will 2021-11-12T05:36:05.968 INFO:teuthology.task.ansible.out: be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " qemu-system-data qemu-system-gui", "2 upgraded, 6 newly installed, 0 to remove and 43 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]", "Fetched 14.3 MB in 1s (11.6 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Read 2021-11-12T05:36:05.969 INFO:teuthology.task.ansible.out:ing database ... 174615 files and directories currently installed.)", "Preparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.14-0ubuntu0.20.04.1) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.18) ...", "Preparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.18) ...", "Setting up librados2 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.18) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.18) ...", "Processing triggers for hicolor-icon-theme (0.17-2) ...", "Processing trigge 2021-11-12T05:36:05.971 INFO:teuthology.task.ansible.out:rs for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for mime-support (3.64ubuntu1) ..."]} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:05.998 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:05 +0000 (0:00:00.045) 0:01:53.853 ******* 2021-11-12T05:36:06.022 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:06 +0000 (0:00:00.023) 0:01:53.877 ******* 2021-11-12T05:36:06.045 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:06 +0000 (0:00:00.023) 0:01:53.900 ******* 2021-11-12T05:36:06.053 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-11-12T05:36:06.055 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:06.081 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:06 +0000 (0:00:00.035) 0:01:53.936 ******* 2021-11-12T05:36:06.110 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-11-12T05:36:06.112 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:06.136 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:06 +0000 (0:00:00.055) 0:01:53.991 ******* 2021-11-12T05:36:06.164 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-11-12T05:36:06.166 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:06.189 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:06 +0000 (0:00:00.052) 0:01:54.044 ******* 2021-11-12T05:36:06.228 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-11-12T05:36:06.230 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-11-12T05:36:06.255 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:06 +0000 (0:00:00.065) 0:01:54.110 ******* 2021-11-12T05:36:06.304 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-11-12T05:36:06.306 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-11-12T05:36:06.331 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:06 +0000 (0:00:00.075) 0:01:54.186 ******* 2021-11-12T05:36:06.423 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-11-12T05:36:06.424 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-11-12T05:36:06.450 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:06 +0000 (0:00:00.119) 0:01:54.305 ******* 2021-11-12T05:36:06.457 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-11-12T05:36:06.459 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"cache_update_time": 1636694883, "cache_updated": false, "changed": false} 2021-11-12T05:36:06.485 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:06 +0000 (0:00:00.034) 0:01:54.340 ******* 2021-11-12T05:36:06.492 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-11-12T05:36:06.493 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"cache_update_time": 1636694984, "cache_updated": false, "changed": false} 2021-11-12T05:36:06.519 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:06 +0000 (0:00:00.034) 0:01:54.374 ******* 2021-11-12T05:36:06.579 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-11-12T05:36:06.581 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-11-12T05:36:06.582 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-11-12T05:36:06.608 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:06 +0000 (0:00:00.088) 0:01:54.462 ******* 2021-11-12T05:36:06.638 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:06 +0000 (0:00:00.030) 0:01:54.493 ******* 2021-11-12T05:36:06.661 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:06 +0000 (0:00:00.022) 0:01:54.516 ******* 2021-11-12T05:36:06.670 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-11-12T05:36:06.672 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:06.699 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:06 +0000 (0:00:00.037) 0:01:54.554 ******* 2021-11-12T05:36:06.723 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:06 +0000 (0:00:00.023) 0:01:54.577 ******* 2021-11-12T05:36:06.840 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-11-12T05:36:06.842 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-11-12T05:36:06.865 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:06 +0000 (0:00:00.142) 0:01:54.720 ******* 2021-11-12T05:36:06.873 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-11-12T05:36:06.875 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Fri 2021-11-12 05:35:52 UTC", "ActiveEnterTimestampMonotonic": "180230508", "ActiveExitTimestamp": "Fri 2021-11-12 05:35:52 UTC", "ActiveExitTimestampMonotonic": "180187495", "ActiveState": "active", "After": "nss-lookup.target systemd-tmpfiles-setup.service network.target basic.target -.mount remote-fs.target system.slice systemd-journald.socket sysinit.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-11-12 05:35:52 UTC", "AssertTimestampMonotonic": "180218469", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-11-12 05:35:52 UTC", "ConditionTimestampMonotonic": "180218469", "ConfigurationDirect 2021-11-12T05:36:06.877 INFO:teuthology.task.ansible.out:oryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6635", "ExecMainStartTimestamp": "Fri 2021-11-12 05:35:52 UTC", "ExecMainStartTimestampMonotonic": "180230498", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriori 2021-11-12T05:36:06.878 INFO:teuthology.task.ansible.out:ty": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Fri 2021-11-12 05:35:52 UTC", "InactiveEnterTimestampMonotonic": "180218085", "InactiveExitTimestamp": "Fri 2021-11-12 05:35:52 UTC", "InactiveExitTimestampMonotonic": "180220430", "InvocationID": "703bbb49df634a3aa0a02f1702857097", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6635", "MemoryAccounting": "yes", "MemoryCurrent": "6729728", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySw 2021-11-12T05:36:06.880 INFO:teuthology.task.ansible.out:apMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-11-12 05:35:52 UTC", "StateChangeTimestampMonotonic": "180230508", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "T 2021-11-12T05:36:06.882 INFO:teuthology.task.ansible.out:TYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38346", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-12T05:36:06.903 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:06 +0000 (0:00:00.037) 0:01:54.758 ******* 2021-11-12T05:36:06.930 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-11-12T05:36:06.932 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:06.954 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:06 +0000 (0:00:00.051) 0:01:54.809 ******* 2021-11-12T05:36:06.971 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-11-12T05:36:06.973 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} TASK [testnode : Install packages with --no-install-recommends] **************** ok: [gibba044.front.sepia.ceph.com] => {"cache_update_time": 1636694984, "cache_updated": false, "changed": false} 2021-11-12T05:36:06.998 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:06 +0000 (0:00:00.043) 0:01:54.852 ******* 2021-11-12T05:36:07.021 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:07 +0000 (0:00:00.024) 0:01:54.876 ******* 2021-11-12T05:36:07.029 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-11-12T05:36:07.030 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:07.061 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:07 +0000 (0:00:00.039) 0:01:54.916 ******* 2021-11-12T05:36:07.088 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-11-12T05:36:07.090 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:07.113 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:07 +0000 (0:00:00.052) 0:01:54.968 ******* 2021-11-12T05:36:07.121 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-11-12T05:36:07.123 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-11-12T05:36:07.156 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:07 +0000 (0:00:00.042) 0:01:55.011 ******* 2021-11-12T05:36:07.164 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-11-12T05:36:07.166 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:07.195 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:07 +0000 (0:00:00.038) 0:01:55.049 ******* 2021-11-12T05:36:07.227 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:07 +0000 (0:00:00.031) 0:01:55.081 ******* 2021-11-12T05:36:07.235 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-11-12T05:36:07.236 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:07.263 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:07 +0000 (0:00:00.036) 0:01:55.117 ******* 2021-11-12T05:36:07.270 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-11-12T05:36:07.272 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:07.300 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:07 +0000 (0:00:00.037) 0:01:55.155 ******* 2021-11-12T05:36:07.326 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:07 +0000 (0:00:00.024) 0:01:55.180 ******* 2021-11-12T05:36:07.334 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-11-12T05:36:07.335 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ ok: [gibba016.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-11-12T05:36:07.363 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:07 +0000 (0:00:00.037) 0:01:55.218 ******* 2021-11-12T05:36:07.388 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:07 +0000 (0:00:00.024) 0:01:55.243 ******* 2021-11-12T05:36:07.430 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-11-12T05:36:07.432 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure fuse group exists.] ************************************ ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-11-12T05:36:07.455 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:07 +0000 (0:00:00.066) 0:01:55.309 ******* 2021-11-12T05:36:07.479 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:07 +0000 (0:00:00.023) 0:01:55.333 ******* 2021-11-12T05:36:07.486 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-11-12T05:36:07.488 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:07.513 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:07 +0000 (0:00:00.034) 0:01:55.368 ******* 2021-11-12T05:36:07.531 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-11-12T05:36:07.533 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-12T05:36:07.564 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:07 +0000 (0:00:00.050) 0:01:55.418 ******* 2021-11-12T05:36:07.574 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-12T05:36:07.575 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-11-12T05:36:07.576 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-11-12T05:36:07.610 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:07 +0000 (0:00:00.045) 0:01:55.464 ******* 2021-11-12T05:36:07.633 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:07 +0000 (0:00:00.023) 0:01:55.488 ******* 2021-11-12T05:36:07.664 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:07.688 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:07 +0000 (0:00:00.054) 0:01:55.543 ******* 2021-11-12T05:36:07.716 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-12T05:36:07.718 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:07.741 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:07 +0000 (0:00:00.053) 0:01:55.596 ******* 2021-11-12T05:36:07.749 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-11-12T05:36:07.751 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-11-12T05:36:07.776 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:07 +0000 (0:00:00.034) 0:01:55.630 ******* 2021-11-12T05:36:07.783 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-11-12T05:36:07.785 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Fri 2021-11-12 05:35:52 UTC", "ActiveEnterTimestampMonotonic": "184999599", "ActiveExitTimestamp": "Fri 2021-11-12 05:35:52 UTC", "ActiveExitTimestampMonotonic": "184957655", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service remote-fs.target system.slice sysinit.target nss-lookup.target network.target systemd-journald.socket -.mount basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-11-12 05:35:52 UTC", "AssertTimestampMonotonic": "184988291", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-11-12 05:35:52 UTC", "ConditionTimestampMonotonic": "184988291", "ConfigurationDirect 2021-11-12T05:36:07.787 INFO:teuthology.task.ansible.out:oryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6635", "ExecMainStartTimestamp": "Fri 2021-11-12 05:35:52 UTC", "ExecMainStartTimestampMonotonic": "184999589", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriori 2021-11-12T05:36:07.788 INFO:teuthology.task.ansible.out:ty": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Fri 2021-11-12 05:35:52 UTC", "InactiveEnterTimestampMonotonic": "184987904", "InactiveExitTimestamp": "Fri 2021-11-12 05:35:52 UTC", "InactiveExitTimestampMonotonic": "184989105", "InvocationID": "e9544dabfaed4c988839f3f3cabe4237", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6635", "MemoryAccounting": "yes", "MemoryCurrent": "7196672", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySw 2021-11-12T05:36:07.790 INFO:teuthology.task.ansible.out:apMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-11-12 05:35:52 UTC", "StateChangeTimestampMonotonic": "184999599", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "T 2021-11-12T05:36:07.792 INFO:teuthology.task.ansible.out:TYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38346", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [testnode : Upgrade packages] ********************************************* skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** ok: [gibba005.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-12T05:36:07.815 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:07 +0000 (0:00:00.039) 0:01:55.670 ******* 2021-11-12T05:36:07.838 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:07 +0000 (0:00:00.022) 0:01:55.693 ******* 2021-11-12T05:36:07.859 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:07 +0000 (0:00:00.021) 0:01:55.714 ******* 2021-11-12T05:36:07.866 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-11-12T05:36:07.868 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:07.893 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:07 +0000 (0:00:00.033) 0:01:55.747 ******* 2021-11-12T05:36:07.914 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:07 +0000 (0:00:00.021) 0:01:55.769 ******* 2021-11-12T05:36:07.920 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-11-12T05:36:07.922 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop collectl] ************************************************ skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:07.947 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:07 +0000 (0:00:00.032) 0:01:55.801 ******* 2021-11-12T05:36:07.976 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:07 +0000 (0:00:00.029) 0:01:55.831 ******* 2021-11-12T05:36:07.985 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-11-12T05:36:07.987 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:07.987 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-11-12T05:36:07.988 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-11-12T05:36:07.989 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:08.019 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:08 +0000 (0:00:00.042) 0:01:55.873 ******* 2021-11-12T05:36:08.044 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:08 +0000 (0:00:00.025) 0:01:55.899 ******* 2021-11-12T05:36:08.069 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:08 +0000 (0:00:00.024) 0:01:55.924 ******* 2021-11-12T05:36:08.076 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-11-12T05:36:08.077 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:08.105 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:08 +0000 (0:00:00.035) 0:01:55.959 ******* 2021-11-12T05:36:08.127 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:08 +0000 (0:00:00.022) 0:01:55.982 ******* 2021-11-12T05:36:08.149 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:08 +0000 (0:00:00.021) 0:01:56.004 ******* 2021-11-12T05:36:08.156 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-11-12T05:36:08.158 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:08.182 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:08 +0000 (0:00:00.033) 0:01:56.037 ******* 2021-11-12T05:36:08.190 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-11-12T05:36:08.192 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set up static IP in /etc/hosts.] ****************************** ok: [gibba044.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-12T05:36:08.217 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:08 +0000 (0:00:00.034) 0:01:56.072 ******* 2021-11-12T05:36:08.238 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:08 +0000 (0:00:00.020) 0:01:56.093 ******* 2021-11-12T05:36:08.260 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:08 +0000 (0:00:00.021) 0:01:56.115 ******* 2021-11-12T05:36:08.267 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-12T05:36:08.267 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-11-12T05:36:08.268 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:08.269 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:08.295 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:08 +0000 (0:00:00.034) 0:01:56.150 ******* 2021-11-12T05:36:08.333 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:08 +0000 (0:00:00.037) 0:01:56.187 ******* 2021-11-12T05:36:08.360 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:08 +0000 (0:00:00.027) 0:01:56.215 ******* 2021-11-12T05:36:08.367 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-11-12T05:36:08.368 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:08.379 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-11-12T05:36:08.381 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [gibba005.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:08.405 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:08 +0000 (0:00:00.045) 0:01:56.260 ******* 2021-11-12T05:36:08.413 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:08.414 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:08.416 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** ok: [gibba005.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-11-12T05:36:08.416 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:08.417 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:08.417 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:08.418 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:08.445 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:08 +0000 (0:00:00.039) 0:01:56.300 ******* 2021-11-12T05:36:08.453 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:08.454 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-11-12T05:36:08.454 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:08.455 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-11-12T05:36:08.455 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:08.457 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:08.459 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-11-12T05:36:08.461 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Fri 2021-11-12 05:35:53 UTC", "ActiveEnterTimestampMonotonic": "173492965", "ActiveExitTimestamp": "Fri 2021-11-12 05:35:53 UTC", "ActiveExitTimestampMonotonic": "173450951", "ActiveState": "active", "After": "sysinit.target remote-fs.target network.target basic.target systemd-tmpfiles-setup.service systemd-journald.socket nss-lookup.target -.mount system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-11-12 05:35:53 UTC", "AssertTimestampMonotonic": "173481618", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-11-12 05:35:53 UTC", "ConditionTimestampMonotonic": "173481618", "ConfigurationDirect 2021-11-12T05:36:08.462 INFO:teuthology.task.ansible.out:oryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6626", "ExecMainStartTimestamp": "Fri 2021-11-12 05:35:53 UTC", "ExecMainStartTimestampMonotonic": "173492956", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriori 2021-11-12T05:36:08.464 INFO:teuthology.task.ansible.out:ty": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Fri 2021-11-12 05:35:53 UTC", "InactiveEnterTimestampMonotonic": "173481225", "InactiveExitTimestamp": "Fri 2021-11-12 05:35:53 UTC", "InactiveExitTimestampMonotonic": "173482275", "InvocationID": "b959c27473ae4ad1b7a0b3b7755f476e", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6626", "MemoryAccounting": "yes", "MemoryCurrent": "7118848", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySw 2021-11-12T05:36:08.466 INFO:teuthology.task.ansible.out:apMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-11-12 05:35:53 UTC", "StateChangeTimestampMonotonic": "173492965", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "T 2021-11-12T05:36:08.467 INFO:teuthology.task.ansible.out:TYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38346", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-12T05:36:08.499 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:08 +0000 (0:00:00.054) 0:01:56.354 ******* 2021-11-12T05:36:08.523 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:08 +0000 (0:00:00.023) 0:01:56.377 ******* 2021-11-12T05:36:08.545 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:08 +0000 (0:00:00.022) 0:01:56.400 ******* 2021-11-12T05:36:08.551 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-11-12T05:36:08.553 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:08.578 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:08 +0000 (0:00:00.033) 0:01:56.433 ******* 2021-11-12T05:36:08.600 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:08 +0000 (0:00:00.021) 0:01:56.454 ******* 2021-11-12T05:36:08.606 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-11-12T05:36:08.607 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:08.634 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:08 +0000 (0:00:00.032) 0:01:56.487 ******* 2021-11-12T05:36:08.655 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:08 +0000 (0:00:00.022) 0:01:56.510 ******* 2021-11-12T05:36:08.661 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-11-12T05:36:08.663 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove packages] ********************************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:08.693 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:08 +0000 (0:00:00.038) 0:01:56.548 ******* 2021-11-12T05:36:08.717 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:08 +0000 (0:00:00.023) 0:01:56.572 ******* 2021-11-12T05:36:08.725 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-11-12T05:36:08.726 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:08.727 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003497", "end": "2021-11-12 05:36:08.674390", "rc": 0, "start": "2021-11-12 05:36:08.670893", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/bin/teuthology-lock"]} 2021-11-12T05:36:08.729 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:08.756 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:08 +0000 (0:00:00.038) 0:01:56.611 ******* 2021-11-12T05:36:08.779 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:08 +0000 (0:00:00.023) 0:01:56.634 ******* 2021-11-12T05:36:08.804 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:08 +0000 (0:00:00.024) 0:01:56.659 ******* 2021-11-12T05:36:08.810 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-11-12T05:36:08.812 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:08.813 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:08.840 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:08 +0000 (0:00:00.035) 0:01:56.694 ******* 2021-11-12T05:36:08.863 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:08 +0000 (0:00:00.023) 0:01:56.718 ******* 2021-11-12T05:36:08.885 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:08 +0000 (0:00:00.021) 0:01:56.740 ******* 2021-11-12T05:36:08.892 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-11-12T05:36:08.894 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:08.919 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:08 +0000 (0:00:00.034) 0:01:56.774 ******* 2021-11-12T05:36:08.942 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:08 +0000 (0:00:00.022) 0:01:56.797 ******* 2021-11-12T05:36:08.964 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:08 +0000 (0:00:00.022) 0:01:56.819 ******* 2021-11-12T05:36:08.971 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-11-12T05:36:08.973 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:08.998 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:08 +0000 (0:00:00.033) 0:01:56.853 ******* 2021-11-12T05:36:09.033 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:09 +0000 (0:00:00.034) 0:01:56.888 ******* 2021-11-12T05:36:09.060 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:09 +0000 (0:00:00.027) 0:01:56.915 ******* 2021-11-12T05:36:09.068 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-11-12T05:36:09.070 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:09.096 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:09 +0000 (0:00:00.036) 0:01:56.951 ******* 2021-11-12T05:36:09.123 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:09 +0000 (0:00:00.026) 0:01:56.978 ******* 2021-11-12T05:36:09.130 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-11-12T05:36:09.132 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:09.158 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:09 +0000 (0:00:00.034) 0:01:57.012 ******* 2021-11-12T05:36:09.183 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:09 +0000 (0:00:00.025) 0:01:57.038 ******* 2021-11-12T05:36:09.191 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-11-12T05:36:09.194 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:09.219 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:09 +0000 (0:00:00.036) 0:01:57.074 ******* 2021-11-12T05:36:09.248 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:09 +0000 (0:00:00.028) 0:01:57.102 ******* 2021-11-12T05:36:09.255 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-11-12T05:36:09.257 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:09.281 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:09 +0000 (0:00:00.033) 0:01:57.135 ******* 2021-11-12T05:36:09.305 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:09 +0000 (0:00:00.024) 0:01:57.160 ******* 2021-11-12T05:36:09.313 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-11-12T05:36:09.315 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:09.343 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:09 +0000 (0:00:00.038) 0:01:57.198 ******* 2021-11-12T05:36:09.381 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:09 +0000 (0:00:00.038) 0:01:57.236 ******* 2021-11-12T05:36:09.390 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:09.391 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-11-12T05:36:09.391 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:09.425 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:09 +0000 (0:00:00.044) 0:01:57.280 ******* 2021-11-12T05:36:09.448 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:09 +0000 (0:00:00.022) 0:01:57.303 ******* 2021-11-12T05:36:09.455 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-11-12T05:36:09.457 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make sure apt dependencies are installed] ********************* ok: [gibba005.front.sepia.ceph.com] => {"cache_update_time": 1636694779, "cache_updated": false, "changed": false} 2021-11-12T05:36:09.457 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:09.491 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:09 +0000 (0:00:00.043) 0:01:57.346 ******* 2021-11-12T05:36:09.523 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:09 +0000 (0:00:00.031) 0:01:57.378 ******* 2021-11-12T05:36:09.551 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:09 +0000 (0:00:00.028) 0:01:57.406 ******* 2021-11-12T05:36:09.558 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-12T05:36:09.559 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"cache_update_time": 1636694831, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3.2).\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n qemu-system-data qemu-system-gui\n2 upgraded, 6 newly installed, 0 to remove and 43 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qe 2021-11-12T05:36:09.561 INFO:teuthology.task.ansible.out:mu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]\nFetched 14.3 MB in 1s (10.9 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174615 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nPreparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 (1:4.2-3ub 2021-11-12T05:36:09.562 INFO:teuthology.task.ansible.out:untu6.18) over (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.18) ...\r\nSetting up librados2 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.18) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.25.1-1ubuntu3.2).", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " qemu-system-data qemu-system-gui", "2 upgrade 2021-11-12T05:36:09.564 INFO:teuthology.task.ansible.out:d, 6 newly installed, 0 to remove and 43 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.1 [3215 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.1 [1620 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.18 [54.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.18 [1056 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.18 [563 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.18 [40.8 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.18 [6748 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.18 [973 kB]", "Fetched 14.3 MB in 1s (10.9 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174615 files and directories currently installed.)", "Preparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.14-0ubuntu0.20.04.1) ..." 2021-11-12T05:36:09.566 INFO:teuthology.task.ansible.out:, "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.18) ...", "Preparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.18_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) over (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.18_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.18) ...", "Setting up librados2 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up librbd1 (15.2.14-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.18) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.18) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.18) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.18) ...", "Processing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for mime-support (3.64ubuntu1) ..."]} TASK [testnode : Make fsstress same path as ubuntu 2021-11-12T05:36:09.567 INFO:teuthology.task.ansible.out:.] *************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make sure rpm dependencies are installed] ********************* skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:09.587 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:09 +0000 (0:00:00.035) 0:01:57.441 ******* 2021-11-12T05:36:09.610 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:09 +0000 (0:00:00.023) 0:01:57.465 ******* 2021-11-12T05:36:09.636 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:09 +0000 (0:00:00.025) 0:01:57.491 ******* 2021-11-12T05:36:09.660 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:09 +0000 (0:00:00.023) 0:01:57.515 ******* 2021-11-12T05:36:09.667 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-11-12T05:36:09.669 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set root disk] ************************************************ 2021-11-12T05:36:09.670 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'block_used': 14049728, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045380, 'size_available': 925881876480, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187097, 'block_size': 4096, 'inode_available': 60867879}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045380, "block_size": 4096, "block_total": 240095108, "block_used": 14049728, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867879, "inode_total": 61054976, "inode_used": 187097, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881876480, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}} 2021-11-12T05:36:09.670 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:09.695 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:09 +0000 (0:00:00.035) 0:01:57.550 ******* 2021-11-12T05:36:09.721 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:09 +0000 (0:00:00.025) 0:01:57.576 ******* 2021-11-12T05:36:09.749 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:09 +0000 (0:00:00.027) 0:01:57.603 ******* 2021-11-12T05:36:09.756 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-11-12T05:36:09.758 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:09.792 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:09 +0000 (0:00:00.043) 0:01:57.647 ******* 2021-11-12T05:36:09.816 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:09 +0000 (0:00:00.024) 0:01:57.671 ******* 2021-11-12T05:36:09.824 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-12T05:36:09.826 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Compile list of non-root partitions] ************************** changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.002381", "end": "2021-11-12 05:36:09.782277", "rc": 0, "start": "2021-11-12 05:36:09.779896", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:09.827 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:09.855 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:09 +0000 (0:00:00.038) 0:01:57.710 ******* 2021-11-12T05:36:09.883 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:09 +0000 (0:00:00.027) 0:01:57.737 ******* 2021-11-12T05:36:09.910 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:09 +0000 (0:00:00.027) 0:01:57.765 ******* 2021-11-12T05:36:09.917 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-11-12T05:36:09.918 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'block_used': 14049728, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045380, 'size_available': 925881876480, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187097, 'block_size': 4096, 'inode_available': 60867879}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045380, "block_size": 4096, "block_total": 240095108, "block_used": 14049728, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867879, "inode_total": 61054976, "inode_used": 187097, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881876480, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:09.919 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-11-12T05:36:09.919 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:09.943 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:09 +0000 (0:00:00.033) 0:01:57.798 ******* 2021-11-12T05:36:09.965 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:09 +0000 (0:00:00.021) 0:01:57.819 ******* 2021-11-12T05:36:09.972 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-11-12T05:36:09.973 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} TASK [testnode : Remove packages] ********************************************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-11-12T05:36:09.999 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:09 +0000 (0:00:00.034) 0:01:57.854 ******* 2021-11-12T05:36:10.023 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:10 +0000 (0:00:00.023) 0:01:57.878 ******* 2021-11-12T05:36:10.051 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:10 +0000 (0:00:00.027) 0:01:57.906 ******* 2021-11-12T05:36:10.059 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-11-12T05:36:10.061 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"cache_update_time": 1636694831, "cache_updated": false, "changed": false} TASK [testnode : Zap all non-root disks] *************************************** 2021-11-12T05:36:10.061 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:10.087 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:10 +0000 (0:00:00.036) 0:01:57.942 ******* 2021-11-12T05:36:10.097 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-11-12T05:36:10.098 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} TASK [testnode : Install packages] ********************************************* skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:10.139 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:10 +0000 (0:00:00.051) 0:01:57.993 ******* 2021-11-12T05:36:10.183 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:10 +0000 (0:00:00.044) 0:01:58.038 ******* 2021-11-12T05:36:10.213 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-12T05:36:10.215 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:10.238 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:10 +0000 (0:00:00.054) 0:01:58.092 ******* 2021-11-12T05:36:10.266 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-11-12T05:36:10.268 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:10.291 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:10 +0000 (0:00:00.053) 0:01:58.146 ******* 2021-11-12T05:36:10.299 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-11-12T05:36:10.300 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-11-12T05:36:10.327 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:10 +0000 (0:00:00.035) 0:01:58.182 ******* 2021-11-12T05:36:10.335 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-11-12T05:36:10.337 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:10.363 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:10 +0000 (0:00:00.036) 0:01:58.218 ******* 2021-11-12T05:36:10.370 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-11-12T05:36:10.371 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:10.397 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:10 +0000 (0:00:00.033) 0:01:58.252 ******* 2021-11-12T05:36:10.405 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-11-12T05:36:10.407 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:10.435 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:10 +0000 (0:00:00.037) 0:01:58.290 ******* 2021-11-12T05:36:10.453 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-11-12T05:36:10.455 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-11-12T05:36:10.479 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:10 +0000 (0:00:00.044) 0:01:58.334 ******* 2021-11-12T05:36:10.487 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-11-12T05:36:10.489 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:10.527 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:10 +0000 (0:00:00.047) 0:01:58.382 ******* 2021-11-12T05:36:10.535 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-11-12T05:36:10.536 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages with --no-install-recommends] **************** ok: [gibba015.front.sepia.ceph.com] => {"cache_update_time": 1636694831, "cache_updated": false, "changed": false} 2021-11-12T05:36:10.563 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:10 +0000 (0:00:00.035) 0:01:58.418 ******* 2021-11-12T05:36:10.587 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:10 +0000 (0:00:00.024) 0:01:58.442 ******* 2021-11-12T05:36:10.595 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-11-12T05:36:10.596 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:10.628 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:10 +0000 (0:00:00.040) 0:01:58.483 ******* 2021-11-12T05:36:10.661 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-11-12T05:36:10.662 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:10.694 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:10 +0000 (0:00:00.065) 0:01:58.548 ******* 2021-11-12T05:36:10.701 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-11-12T05:36:10.703 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-11-12T05:36:10.889 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:10 +0000 (0:00:00.195) 0:01:58.744 ******* 2021-11-12T05:36:10.897 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-11-12T05:36:10.898 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:10.899 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-11-12T05:36:10.899 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-11-12T05:36:10.928 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:10 +0000 (0:00:00.038) 0:01:58.783 ******* 2021-11-12T05:36:10.955 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:10 +0000 (0:00:00.026) 0:01:58.810 ******* 2021-11-12T05:36:10.981 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:10 +0000 (0:00:00.025) 0:01:58.836 ******* 2021-11-12T05:36:10.988 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:11.016 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:11 +0000 (0:00:00.035) 0:01:58.871 ******* 2021-11-12T05:36:11.024 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-11-12T05:36:11.026 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:11.051 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:11 +0000 (0:00:00.035) 0:01:58.906 ******* 2021-11-12T05:36:11.078 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-11-12T05:36:11.080 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:11.102 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:11 +0000 (0:00:00.050) 0:01:58.957 ******* 2021-11-12T05:36:11.130 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-11-12T05:36:11.133 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-11-12T05:36:11.155 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:11 +0000 (0:00:00.052) 0:01:59.010 ******* 2021-11-12T05:36:11.161 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-11-12T05:36:11.164 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-11-12T05:36:11.189 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:11 +0000 (0:00:00.034) 0:01:59.044 ******* 2021-11-12T05:36:11.212 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:11 +0000 (0:00:00.022) 0:01:59.067 ******* 2021-11-12T05:36:11.241 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-11-12T05:36:11.243 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:11.269 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:11 +0000 (0:00:00.056) 0:01:59.123 ******* 2021-11-12T05:36:11.292 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:11 +0000 (0:00:00.023) 0:01:59.147 ******* 2021-11-12T05:36:11.321 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-11-12T05:36:11.323 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:11.357 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:11 +0000 (0:00:00.064) 0:01:59.211 ******* 2021-11-12T05:36:11.385 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-11-12T05:36:11.387 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:11.409 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:11 +0000 (0:00:00.052) 0:01:59.264 ******* 2021-11-12T05:36:11.426 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-11-12T05:36:11.428 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-11-12T05:36:11.451 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:11 +0000 (0:00:00.042) 0:01:59.306 ******* 2021-11-12T05:36:11.461 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-11-12T05:36:11.462 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:11.463 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-11-12T05:36:11.490 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:11 +0000 (0:00:00.038) 0:01:59.345 ******* 2021-11-12T05:36:11.515 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:11 +0000 (0:00:00.024) 0:01:59.369 ******* 2021-11-12T05:36:11.533 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-11-12T05:36:11.560 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:11 +0000 (0:00:00.044) 0:01:59.414 ******* 2021-11-12T05:36:11.611 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-11-12T05:36:11.613 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-11-12T05:36:11.638 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:11 +0000 (0:00:00.078) 0:01:59.493 ******* 2021-11-12T05:36:11.647 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-11-12T05:36:11.648 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** ok: [gibba038.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-12T05:36:11.677 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:11 +0000 (0:00:00.038) 0:01:59.531 ******* 2021-11-12T05:36:11.702 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:11 +0000 (0:00:00.024) 0:01:59.556 ******* 2021-11-12T05:36:11.709 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-12T05:36:11.710 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-mlkPpOrpm99LPKzXdt4H14xe5ymHS3PlWsJZlRL9AO5L9r879kkMkLOlqMYAaEbZ'], 'uuids': ['b4fc68b1-6688-46e8-bd0d-1aa2b3f6ff97']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.515037", "end": "2021-11-12 05:36:11.641482", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-mlkPpOrpm99LPKzXdt4H14xe5ymHS3PlWsJZlRL9AO5L9r879kkMkLOlqMYAaEbZ"], "labels": [], "masters": [], "uuids": ["b4fc68b1-6688-46e8-bd0d-1aa2b3f6ff97"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:10.126445", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-12T05:36:11.711 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** ok: [gibba016.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-12T05:36:11.713 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** skipping: [gibba005.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:11.715 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-11-12T05:36:11.715 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:11.742 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:11 +0000 (0:00:00.040) 0:01:59.596 ******* 2021-11-12T05:36:11.766 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:11 +0000 (0:00:00.024) 0:01:59.621 ******* 2021-11-12T05:36:11.773 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-11-12T05:36:11.775 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:11.802 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:11 +0000 (0:00:00.035) 0:01:59.657 ******* 2021-11-12T05:36:11.834 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:11 +0000 (0:00:00.031) 0:01:59.688 ******* 2021-11-12T05:36:11.842 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-11-12T05:36:11.844 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:11.868 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:11 +0000 (0:00:00.034) 0:01:59.723 ******* 2021-11-12T05:36:11.876 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:11.902 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:11 +0000 (0:00:00.033) 0:01:59.756 ******* 2021-11-12T05:36:11.909 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-11-12T05:36:11.911 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:11.934 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:11 +0000 (0:00:00.032) 0:01:59.789 ******* 2021-11-12T05:36:11.944 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:11.945 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-11-12T05:36:11.946 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-11-12T05:36:11.972 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:11 +0000 (0:00:00.037) 0:01:59.826 ******* 2021-11-12T05:36:11.997 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:11 +0000 (0:00:00.024) 0:01:59.851 ******* 2021-11-12T05:36:12.004 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-11-12T05:36:12.005 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:12.033 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:12 +0000 (0:00:00.035) 0:01:59.887 ******* 2021-11-12T05:36:12.057 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:12 +0000 (0:00:00.024) 0:01:59.912 ******* 2021-11-12T05:36:12.071 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-11-12T05:36:12.073 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Fri 2021-11-12 05:35:57 UTC", "ActiveEnterTimestampMonotonic": "196631251", "ActiveExitTimestamp": "Fri 2021-11-12 05:35:57 UTC", "ActiveExitTimestampMonotonic": "196588045", "ActiveState": "active", "After": "system.slice systemd-journald.socket nss-lookup.target network.target remote-fs.target basic.target -.mount sysinit.target systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-11-12 05:35:57 UTC", "AssertTimestampMonotonic": "196619188", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-11-12 05:35:57 UTC", "ConditionTimestampMonotonic": "196619188", "ConfigurationDirect 2021-11-12T05:36:12.075 INFO:teuthology.task.ansible.out:oryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6638", "ExecMainStartTimestamp": "Fri 2021-11-12 05:35:57 UTC", "ExecMainStartTimestampMonotonic": "196631242", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriori 2021-11-12T05:36:12.077 INFO:teuthology.task.ansible.out:ty": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Fri 2021-11-12 05:35:57 UTC", "InactiveEnterTimestampMonotonic": "196618807", "InactiveExitTimestamp": "Fri 2021-11-12 05:35:57 UTC", "InactiveExitTimestampMonotonic": "196619860", "InvocationID": "ae935a622dbc4ae4bc798bc7e074d4b9", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6638", "MemoryAccounting": "yes", "MemoryCurrent": "7000064", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySw 2021-11-12T05:36:12.078 INFO:teuthology.task.ansible.out:apMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-11-12 05:35:57 UTC", "StateChangeTimestampMonotonic": "196631251", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "T 2021-11-12T05:36:12.081 INFO:teuthology.task.ansible.out:TYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38346", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:12.101 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:12 +0000 (0:00:00.043) 0:01:59.955 ******* 2021-11-12T05:36:12.125 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:12 +0000 (0:00:00.024) 0:01:59.980 ******* 2021-11-12T05:36:12.151 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:12 +0000 (0:00:00.025) 0:02:00.005 ******* 2021-11-12T05:36:12.159 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:12.160 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** ok: [gibba016.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-11-12T05:36:12.197 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:12 +0000 (0:00:00.046) 0:02:00.052 ******* 2021-11-12T05:36:12.223 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:12 +0000 (0:00:00.025) 0:02:00.077 ******* 2021-11-12T05:36:12.248 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:12 +0000 (0:00:00.025) 0:02:00.102 ******* 2021-11-12T05:36:12.258 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-11-12T05:36:12.259 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:12.286 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:12 +0000 (0:00:00.038) 0:02:00.141 ******* 2021-11-12T05:36:12.295 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-11-12T05:36:12.296 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:12.296 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:12.298 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** ok: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-11-12T05:36:12.299 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [gibba016.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:12.300 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:12.324 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:12 +0000 (0:00:00.038) 0:02:00.179 ******* 2021-11-12T05:36:12.332 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-11-12T05:36:12.334 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [gibba016.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:12.361 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:12 +0000 (0:00:00.036) 0:02:00.216 ******* 2021-11-12T05:36:12.368 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:12.370 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:12.370 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:12.372 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:12.374 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:12.374 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:12.403 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:12 +0000 (0:00:00.041) 0:02:00.257 ******* 2021-11-12T05:36:12.411 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:12.412 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-11-12T05:36:12.414 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:12.414 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [gibba038.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:12.415 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:12.415 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:12.417 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [gibba038.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-11-12T05:36:12.417 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-11-12T05:36:12.418 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [gibba038.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:12.447 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:12 +0000 (0:00:00.044) 0:02:00.302 ******* 2021-11-12T05:36:12.473 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:12 +0000 (0:00:00.026) 0:02:00.328 ******* 2021-11-12T05:36:12.481 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:12.483 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:12.483 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:12.485 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:12.487 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-11-12T05:36:12.488 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:12.516 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:12 +0000 (0:00:00.042) 0:02:00.370 ******* 2021-11-12T05:36:12.542 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:12 +0000 (0:00:00.026) 0:02:00.397 ******* 2021-11-12T05:36:12.548 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-11-12T05:36:12.550 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:12.578 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:12 +0000 (0:00:00.035) 0:02:00.432 ******* 2021-11-12T05:36:12.608 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-11-12T05:36:12.610 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003806", "end": "2021-11-12 05:36:12.581155", "rc": 0, "start": "2021-11-12 05:36:12.577349", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/bin/teuthology-lock"]} 2021-11-12T05:36:12.610 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-11-12T05:36:12.610 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:12.643 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:12 +0000 (0:00:00.065) 0:02:00.498 ******* 2021-11-12T05:36:12.671 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:12 +0000 (0:00:00.027) 0:02:00.526 ******* 2021-11-12T05:36:12.678 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-11-12T05:36:12.680 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:12.706 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:12 +0000 (0:00:00.034) 0:02:00.561 ******* 2021-11-12T05:36:12.715 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:12.744 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:12 +0000 (0:00:00.038) 0:02:00.599 ******* 2021-11-12T05:36:12.752 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-12T05:36:12.754 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for teuthology-lock command] **************************** changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003926", "end": "2021-11-12 05:36:12.710093", "rc": 0, "start": "2021-11-12 05:36:12.706167", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/bin/teuthology-lock"]} 2021-11-12T05:36:12.754 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-11-12T05:36:12.755 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-11-12T05:36:12.781 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:12 +0000 (0:00:00.036) 0:02:00.635 ******* 2021-11-12T05:36:12.808 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:12 +0000 (0:00:00.027) 0:02:00.663 ******* 2021-11-12T05:36:12.834 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:12 +0000 (0:00:00.025) 0:02:00.688 ******* 2021-11-12T05:36:12.841 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-11-12T05:36:12.843 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove packages] ********************************************** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:12.870 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:12 +0000 (0:00:00.036) 0:02:00.724 ******* 2021-11-12T05:36:12.895 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:12 +0000 (0:00:00.025) 0:02:00.750 ******* 2021-11-12T05:36:12.903 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-11-12T05:36:12.905 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Zap all non-root disks] *************************************** 2021-11-12T05:36:12.906 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-mlkPpOrpm99LPKzXdt4H14xe5ymHS3PlwE1avRCytax9ZfsbF7Nsz1mucFaNjBlT'], 'uuids': ['f578a374-cb35-4ae3-84c7-f352a0027263']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.091966", "end": "2021-11-12 05:36:12.849790", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-mlkPpOrpm99LPKzXdt4H14xe5ymHS3PlwE1avRCytax9ZfsbF7Nsz1mucFaNjBlT"], "labels": [], "masters": [], "uuids": ["f578a374-cb35-4ae3-84c7-f352a0027263"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:11.757824", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used 2021-11-12T05:36:12.908 INFO:teuthology.task.ansible.out:at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [gibba005.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I8K38MF6XF', 'wwn-0x50000399aba8166c'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I8K38MF6XF-part1', 'wwn-0x50000399aba8166c-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399aba8166c', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I8K38MF6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I8K38MF6XF", "wwn-0x50000399aba8166c"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I8K38MF6XF-part1", "wwn-0x50000399aba8166c-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sect 2021-11-12T05:36:12.909 INFO:teuthology.task.ansible.out:orsize": "512", "serial": "Y9I8K38MF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399aba8166c"}}, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages] ********************************************* skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:12.933 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:12 +0000 (0:00:00.038) 0:02:00.788 ******* 2021-11-12T05:36:12.959 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:12 +0000 (0:00:00.025) 0:02:00.814 ******* 2021-11-12T05:36:12.967 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-11-12T05:36:12.969 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade packages] ********************************************* skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:12.993 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:12 +0000 (0:00:00.033) 0:02:00.848 ******* 2021-11-12T05:36:13.027 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:13 +0000 (0:00:00.033) 0:02:00.881 ******* 2021-11-12T05:36:13.035 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-11-12T05:36:13.037 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:13.066 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:13 +0000 (0:00:00.039) 0:02:00.921 ******* 2021-11-12T05:36:13.094 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:13 +0000 (0:00:00.027) 0:02:00.948 ******* 2021-11-12T05:36:13.103 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-11-12T05:36:13.104 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:13.131 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:13 +0000 (0:00:00.037) 0:02:00.986 ******* 2021-11-12T05:36:13.158 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:13 +0000 (0:00:00.026) 0:02:01.013 ******* 2021-11-12T05:36:13.165 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-11-12T05:36:13.167 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:13.194 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:13 +0000 (0:00:00.036) 0:02:01.049 ******* 2021-11-12T05:36:13.221 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:13 +0000 (0:00:00.026) 0:02:01.075 ******* 2021-11-12T05:36:13.238 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-11-12T05:36:13.240 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:13.269 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:13 +0000 (0:00:00.048) 0:02:01.124 ******* 2021-11-12T05:36:13.278 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-11-12T05:36:13.279 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-12T05:36:13.305 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:13 +0000 (0:00:00.035) 0:02:01.160 ******* 2021-11-12T05:36:13.312 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-11-12T05:36:13.314 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:13.341 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:13 +0000 (0:00:00.035) 0:02:01.195 ******* 2021-11-12T05:36:13.351 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-11-12T05:36:13.352 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:13.378 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:13 +0000 (0:00:00.037) 0:02:01.233 ******* 2021-11-12T05:36:13.386 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-11-12T05:36:13.387 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:13.412 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:13 +0000 (0:00:00.034) 0:02:01.267 ******* 2021-11-12T05:36:13.422 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-11-12T05:36:13.424 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:13.456 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:13 +0000 (0:00:00.043) 0:02:01.311 ******* 2021-11-12T05:36:13.463 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-11-12T05:36:13.465 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make sure apt dependencies are installed] ********************* ok: [gibba016.front.sepia.ceph.com] => {"cache_update_time": 1636694883, "cache_updated": false, "changed": false} 2021-11-12T05:36:13.490 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:13 +0000 (0:00:00.034) 0:02:01.345 ******* 2021-11-12T05:36:13.514 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:13 +0000 (0:00:00.023) 0:02:01.369 ******* 2021-11-12T05:36:13.523 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-11-12T05:36:13.524 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:13.549 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:13 +0000 (0:00:00.034) 0:02:01.404 ******* 2021-11-12T05:36:13.572 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:13 +0000 (0:00:00.023) 0:02:01.427 ******* 2021-11-12T05:36:13.580 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-11-12T05:36:13.581 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:13.607 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:13 +0000 (0:00:00.034) 0:02:01.461 ******* 2021-11-12T05:36:13.631 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:13 +0000 (0:00:00.023) 0:02:01.485 ******* 2021-11-12T05:36:13.639 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-11-12T05:36:13.640 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:13.666 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:13 +0000 (0:00:00.035) 0:02:01.521 ******* 2021-11-12T05:36:13.689 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:13 +0000 (0:00:00.022) 0:02:01.543 ******* 2021-11-12T05:36:13.695 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-11-12T05:36:13.697 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1636694933, "cache_updated": false, "changed": false} TASK [testnode : Set root disk] ************************************************ ok: [gibba016.front.sepia.ceph.com] => (item={'block_used': 14049720, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045388, 'size_available': 925881909248, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187091, 'block_size': 4096, 'inode_available': 60867885}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045388, "block_size": 4096, "block_total": 240095108, "block_used": 14049720, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867885, "inode_total": 61054976, "inode_used": 187091, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881909248, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}} 2021-11-12T05:36:13.699 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-11-12T05:36:13.701 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:13.724 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:13 +0000 (0:00:00.035) 0:02:01.579 ******* 2021-11-12T05:36:13.748 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:13 +0000 (0:00:00.023) 0:02:01.602 ******* 2021-11-12T05:36:13.770 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:13 +0000 (0:00:00.022) 0:02:01.625 ******* 2021-11-12T05:36:13.778 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-11-12T05:36:13.780 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:13.813 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:13 +0000 (0:00:00.043) 0:02:01.668 ******* 2021-11-12T05:36:13.837 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:13 +0000 (0:00:00.023) 0:02:01.692 ******* 2021-11-12T05:36:13.844 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-11-12T05:36:13.846 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:13.872 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:13 +0000 (0:00:00.035) 0:02:01.727 ******* 2021-11-12T05:36:13.896 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:13 +0000 (0:00:00.023) 0:02:01.750 ******* 2021-11-12T05:36:13.902 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-11-12T05:36:13.903 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.002386", "end": "2021-11-12 05:36:13.544714", "rc": 0, "start": "2021-11-12 05:36:13.542328", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:13.905 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [gibba044.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} TASK [testnode : Set grub config.] ********************************************* skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:13.933 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:13 +0000 (0:00:00.036) 0:02:01.787 ******* 2021-11-12T05:36:13.956 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:13 +0000 (0:00:00.023) 0:02:01.811 ******* 2021-11-12T05:36:13.979 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:13 +0000 (0:00:00.022) 0:02:01.834 ******* 2021-11-12T05:36:13.986 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-11-12T05:36:13.988 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item={'block_used': 14049726, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045382, 'size_available': 925881884672, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187097, 'block_size': 4096, 'inode_available': 60867879}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045382, "block_size": 4096, "block_total": 240095108, "block_used": 14049726, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867879, "inode_total": 61054976, "inode_used": 187097, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881884672, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}} 2021-11-12T05:36:14.016 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:14 +0000 (0:00:00.037) 0:02:01.871 ******* 2021-11-12T05:36:14.025 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-11-12T05:36:14.026 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'block_used': 14049720, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045388, 'size_available': 925881909248, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187091, 'block_size': 4096, 'inode_available': 60867885}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045388, "block_size": 4096, "block_total": 240095108, "block_used": 14049720, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867885, "inode_total": 61054976, "inode_used": 187091, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881909248, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:14.054 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:14 +0000 (0:00:00.037) 0:02:01.909 ******* 2021-11-12T05:36:14.062 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-11-12T05:36:14.064 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:14.066 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:14.066 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-11-12T05:36:14.066 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-11-12T05:36:14.067 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [gibba044.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:14.067 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:14.068 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:14.068 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:14.069 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-11-12T05:36:14.094 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:14 +0000 (0:00:00.039) 0:02:01.949 ******* 2021-11-12T05:36:14.103 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:14.104 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-11-12T05:36:14.105 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [gibba044.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:14.133 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:14 +0000 (0:00:00.038) 0:02:01.987 ******* 2021-11-12T05:36:14.142 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-12T05:36:14.143 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-B0GE2x-JiHD-i8Ni-wfza-XPi4-BVpV-3bJTYE', 'nvme-INTEL_SSDPEL1K375GA_PHKM9200003U375A', 'nvme-nvme.8086-50484b4d393230303030335533373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.113807", "end": "2021-11-12 05:36:14.064967", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-B0GE2x-JiHD-i8Ni-wfza-XPi4-BVpV-3bJTYE", "nvme-INTEL_SSDPEL1K375GA_PHKM9200003U375A", "nvme-nvme.8086-50484b4d393230303030335533373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:12.951160", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures destroyed! You m 2021-11-12T05:36:14.144 INFO:teuthology.task.ansible.out:ay now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [gibba044.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:14.145 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** skipping: [gibba005.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:14.148 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [gibba044.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} TASK [testnode : Zap all non-root disks] *************************************** skipping: [gibba005.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [gibba044.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:14.148 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:14.150 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-11-12T05:36:14.152 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.002416", "end": "2021-11-12 05:36:14.054284", "rc": 0, "start": "2021-11-12 05:36:14.051868", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:14.184 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:14 +0000 (0:00:00.051) 0:02:02.039 ******* 2021-11-12T05:36:14.211 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:14 +0000 (0:00:00.026) 0:02:02.065 ******* 2021-11-12T05:36:14.220 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-12T05:36:14.222 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:14.233 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-11-12T05:36:14.234 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'block_used': 14049726, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045382, 'size_available': 925881884672, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187097, 'block_size': 4096, 'inode_available': 60867879}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045382, "block_size": 4096, "block_total": 240095108, "block_used": 14049726, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867879, "inode_total": 61054976, "inode_used": 187097, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881884672, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:14.261 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:14 +0000 (0:00:00.050) 0:02:02.116 ******* 2021-11-12T05:36:14.289 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-11-12T05:36:14.315 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:14 +0000 (0:00:00.054) 0:02:02.170 ******* 2021-11-12T05:36:14.356 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-11-12T05:36:14.357 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-11-12T05:36:14.384 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:14 +0000 (0:00:00.068) 0:02:02.239 ******* 2021-11-12T05:36:14.393 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-12T05:36:14.395 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:14.405 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-11-12T05:36:14.407 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003250", "end": "2021-11-12 05:36:14.383884", "rc": 0, "start": "2021-11-12 05:36:14.380634", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/bin/teuthology-lock"]} 2021-11-12T05:36:14.433 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:14 +0000 (0:00:00.049) 0:02:02.288 ******* 2021-11-12T05:36:14.440 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-11-12T05:36:14.442 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:14.468 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:14 +0000 (0:00:00.034) 0:02:02.323 ******* 2021-11-12T05:36:14.474 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-11-12T05:36:14.476 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:14.505 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:14 +0000 (0:00:00.037) 0:02:02.360 ******* 2021-11-12T05:36:14.533 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-11-12T05:36:14.534 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:14.560 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:14 +0000 (0:00:00.054) 0:02:02.415 ******* 2021-11-12T05:36:14.588 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-11-12T05:36:14.590 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:14.613 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:14 +0000 (0:00:00.052) 0:02:02.468 ******* 2021-11-12T05:36:14.725 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-11-12T05:36:14.727 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-11-12T05:36:14.752 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:14 +0000 (0:00:00.139) 0:02:02.607 ******* 2021-11-12T05:36:15.024 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-11-12T05:36:15.026 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-11-12T05:36:15.054 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:15 +0000 (0:00:00.301) 0:02:02.908 ******* 2021-11-12T05:36:15.062 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-11-12T05:36:15.063 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"cache_update_time": 1636694984, "cache_updated": false, "changed": false} 2021-11-12T05:36:15.093 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:15 +0000 (0:00:00.038) 0:02:02.947 ******* 2021-11-12T05:36:15.121 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-11-12T05:36:15.123 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:15.147 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:15 +0000 (0:00:00.053) 0:02:03.001 ******* 2021-11-12T05:36:15.186 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-11-12T05:36:15.188 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'block_used': 14049713, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045395, 'size_available': 925881937920, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187093, 'block_size': 4096, 'inode_available': 60867883}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045395, "block_size": 4096, "block_total": 240095108, "block_used": 14049713, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867883, "inode_total": 61054976, "inode_used": 187093, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881937920, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}} 2021-11-12T05:36:15.214 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:15 +0000 (0:00:00.066) 0:02:03.068 ******* 2021-11-12T05:36:15.305 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-11-12T05:36:15.307 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-11-12T05:36:15.333 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:15 +0000 (0:00:00.119) 0:02:03.188 ******* 2021-11-12T05:36:15.351 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-12T05:36:15.353 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-mlkPpOrpm99LPKzXdt4H14xe5ymHS3Pl0Geush2PqYUjNy4HFECcweALDC9Mz2sv'], 'uuids': ['41b86dd9-05c3-41e4-9d9f-96017450b295']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.095384", "end": "2021-11-12 05:36:15.309884", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-mlkPpOrpm99LPKzXdt4H14xe5ymHS3Pl0Geush2PqYUjNy4HFECcweALDC9Mz2sv"], "labels": [], "masters": [], "uuids": ["41b86dd9-05c3-41e4-9d9f-96017450b295"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:14.214500", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} TASK [testnode : Compile li 2021-11-12T05:36:15.355 INFO:teuthology.task.ansible.out:st of non-root partitions] ************************** changed: [gibba044.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.002423", "end": "2021-11-12 05:36:15.078818", "rc": 0, "start": "2021-11-12 05:36:15.076395", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Zap all non-root disks] *************************************** skipping: [gibba005.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:15.356 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:15.383 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:15 +0000 (0:00:00.049) 0:02:03.237 ******* 2021-11-12T05:36:15.421 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-11-12T05:36:15.423 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'block_used': 14049713, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045395, 'size_available': 925881937920, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187093, 'block_size': 4096, 'inode_available': 60867883}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045395, "block_size": 4096, "block_total": 240095108, "block_used": 14049713, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867883, "inode_total": 61054976, "inode_used": 187093, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881937920, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:15.448 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:15 +0000 (0:00:00.065) 0:02:03.302 ******* 2021-11-12T05:36:15.455 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-11-12T05:36:15.456 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-12T05:36:15.488 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:15 +0000 (0:00:00.040) 0:02:03.343 ******* 2021-11-12T05:36:15.495 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-11-12T05:36:15.522 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:15 +0000 (0:00:00.034) 0:02:03.377 ******* 2021-11-12T05:36:15.529 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-11-12T05:36:15.530 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:15.556 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:15 +0000 (0:00:00.033) 0:02:03.410 ******* 2021-11-12T05:36:15.575 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-12T05:36:15.577 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:15.587 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-11-12T05:36:15.589 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:15.611 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:15 +0000 (0:00:00.055) 0:02:03.466 ******* 2021-11-12T05:36:15.639 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-11-12T05:36:15.641 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:15.663 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:15 +0000 (0:00:00.051) 0:02:03.518 ******* 2021-11-12T05:36:15.691 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-11-12T05:36:15.692 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:15.720 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:15 +0000 (0:00:00.056) 0:02:03.575 ******* 2021-11-12T05:36:15.748 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-11-12T05:36:15.750 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:15.772 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:15 +0000 (0:00:00.052) 0:02:03.627 ******* 2021-11-12T05:36:15.793 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-12T05:36:15.794 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-ZTKmfoO0KLQV5mZUsB6h51mZwozyOPZi0o7k2I4W2VXLsvVfLLXdPeJ7l10BlSH9'], 'uuids': ['56767267-b78d-4031-9637-6ab60867d425']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.498153", "end": "2021-11-12 05:36:15.462964", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-ZTKmfoO0KLQV5mZUsB6h51mZwozyOPZi0o7k2I4W2VXLsvVfLLXdPeJ7l10BlSH9"], "labels": [], "masters": [], "uuids": ["56767267-b78d-4031-9637-6ab60867d425"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:13.964811", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-12T05:36:15.795 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:15.806 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:15.807 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [gibba015.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-11-12T05:36:15.831 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:15 +0000 (0:00:00.059) 0:02:03.686 ******* 2021-11-12T05:36:15.872 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-12T05:36:15.874 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-OMb88TSca2jKbyA0ARyebJSkhDU8ti52sW3UO8KRRw7mdWFKO2DaPcdoH20x6lPX'], 'uuids': ['27599c33-72f7-4d65-9f7e-ae40f5f08f5b']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.416092", "end": "2021-11-12 05:36:15.794970", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-OMb88TSca2jKbyA0ARyebJSkhDU8ti52sW3UO8KRRw7mdWFKO2DaPcdoH20x6lPX"], "labels": [], "masters": [], "uuids": ["27599c33-72f7-4d65-9f7e-ae40f5f08f5b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:14.378878", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-12T05:36:15.885 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:15.887 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [gibba015.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:15.897 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-12T05:36:15.898 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [gibba015.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:15.909 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:15.911 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:15.921 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:15.932 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-11-12T05:36:15.934 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:15.943 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:15.945 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:15.955 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:15.966 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:15.977 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:15.979 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:16.006 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:16 +0000 (0:00:00.174) 0:02:03.860 ******* 2021-11-12T05:36:16.213 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-11-12T05:36:16.214 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003366", "end": "2021-11-12 05:36:16.180275", "rc": 0, "start": "2021-11-12 05:36:16.176909", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/bin/teuthology-lock"]} 2021-11-12T05:36:16.240 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:16 +0000 (0:00:00.234) 0:02:04.095 ******* 2021-11-12T05:36:16.269 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:16.295 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:16 +0000 (0:00:00.055) 0:02:04.150 ******* 2021-11-12T05:36:16.324 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-11-12T05:36:16.326 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:16.349 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:16 +0000 (0:00:00.053) 0:02:04.204 ******* 2021-11-12T05:36:16.389 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-11-12T05:36:16.390 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:16.413 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:16 +0000 (0:00:00.063) 0:02:04.268 ******* 2021-11-12T05:36:16.562 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-12T05:36:16.563 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-mlkPpOrpm99LPKzXdt4H14xe5ymHS3PlltA1rQN8l0WKngjvWtOPLzzsPr3PHdLX'], 'uuids': ['9da630fc-0f6c-44b2-9edd-c42b8f6f60e5']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.104554", "end": "2021-11-12 05:36:16.523607", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-mlkPpOrpm99LPKzXdt4H14xe5ymHS3PlltA1rQN8l0WKngjvWtOPLzzsPr3PHdLX"], "labels": [], "masters": [], "uuids": ["9da630fc-0f6c-44b2-9edd-c42b8f6f60e5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:15.419053", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-12T05:36:16.564 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.s 2021-11-12T05:36:16.565 INFO:teuthology.task.ansible.out:epia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:16.848 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-11-12T05:36:16.849 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"cache_update_time": 1636694831, "cache_updated": false, "changed": false} 2021-11-12T05:36:16.872 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:16 +0000 (0:00:00.459) 0:02:04.727 ******* 2021-11-12T05:36:16.901 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-11-12T05:36:16.902 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:16.925 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:16 +0000 (0:00:00.052) 0:02:04.779 ******* 2021-11-12T05:36:16.974 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-11-12T05:36:16.976 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item={'block_used': 14049728, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045380, 'size_available': 925881876480, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187098, 'block_size': 4096, 'inode_available': 60867878}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045380, "block_size": 4096, "block_total": 240095108, "block_used": 14049728, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867878, "inode_total": 61054976, "inode_used": 187098, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881876480, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}} 2021-11-12T05:36:17.007 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:17 +0000 (0:00:00.081) 0:02:04.861 ******* 2021-11-12T05:36:17.014 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-12T05:36:17.015 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-ZTKmfoO0KLQV5mZUsB6h51mZwozyOPZi5PqDIW74912j0dq3amBCurfOSm0LF3es'], 'uuids': ['e2b55a07-1bf1-4e0d-8785-0a545c4aa5c4']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.099345", "end": "2021-11-12 05:36:16.672251", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-ZTKmfoO0KLQV5mZUsB6h51mZwozyOPZi5PqDIW74912j0dq3amBCurfOSm0LF3es"], "labels": [], "masters": [], "uuids": ["e2b55a07-1bf1-4e0d-8785-0a545c4aa5c4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:15.572906", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-12T05:36:17.017 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I8K38HF6XF', 'wwn-0x50000399aba81667'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I8K38HF6XF-part1', 'wwn-0x50000399aba81667-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399aba81667', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I8K38HF6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I8K38HF6XF", "wwn-0x50000399aba81667"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I8K38HF6XF-part1", "wwn-0x50000399aba81667-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I8K38HF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399aba81667"}}, "skip_reason": "Cond 2021-11-12T05:36:17.018 INFO:teuthology.task.ansible.out:itional result was False"} 2021-11-12T05:36:17.083 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-OMb88TSca2jKbyA0ARyebJSkhDU8ti52QObcqW1o91qvq96kFLOtOj2VcnWJ3OOR'], 'uuids': ['86f63aa7-52b8-4008-aa5b-b0028e55d35b']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.091084", "end": "2021-11-12 05:36:16.991562", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-OMb88TSca2jKbyA0ARyebJSkhDU8ti52QObcqW1o91qvq96kFLOtOj2VcnWJ3OOR"], "labels": [], "masters": [], "uuids": ["86f63aa7-52b8-4008-aa5b-b0028e55d35b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:15.900478", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-12T05:36:17.084 INFO:teuthology.task.ansible.out: 2021-11-12T05:36:17.085 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I3K3Q0F6XF', 'wwn-0x50000399ab801e94'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I3K3Q0F6XF-part1', 'wwn-0x50000399ab801e94-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab801e94', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I3K3Q0F6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I3K3Q0F6XF", "wwn-0x50000399ab801e94"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I3K3Q0F6XF-part1", "wwn-0x50000399ab801e94-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I3K3Q0F6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab801e94"}}, "skip_reason": "Co 2021-11-12T05:36:17.086 INFO:teuthology.task.ansible.out:nditional result was False"} 2021-11-12T05:36:17.118 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** changed: [gibba015.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.002444", "end": "2021-11-12 05:36:17.105896", "rc": 0, "start": "2021-11-12 05:36:17.103452", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:17.144 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:17 +0000 (0:00:00.137) 0:02:04.999 ******* 2021-11-12T05:36:17.153 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-12T05:36:17.153 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-CZvq3MExy6Af8c46vjHC7DbKTQGtvd1OQ5dzNYKMGoQtJxhYlsOOv23aathBbuFE'], 'uuids': ['11e3a87f-735c-4e99-9436-43580711516c']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.426564", "end": "2021-11-12 05:36:16.863325", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-CZvq3MExy6Af8c46vjHC7DbKTQGtvd1OQ5dzNYKMGoQtJxhYlsOOv23aathBbuFE"], "labels": [], "masters": [], "uuids": ["11e3a87f-735c-4e99-9436-43580711516c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:15.436761", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-12T05:36:17.156 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:17.157 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:17.190 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-11-12T05:36:17.192 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'block_used': 14049728, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045380, 'size_available': 925881876480, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187098, 'block_size': 4096, 'inode_available': 60867878}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045380, "block_size": 4096, "block_total": 240095108, "block_used": 14049728, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867878, "inode_total": 61054976, "inode_used": 187098, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881876480, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:17.215 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:17 +0000 (0:00:00.070) 0:02:05.070 ******* 2021-11-12T05:36:17.243 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-11-12T05:36:17.269 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:17 +0000 (0:00:00.053) 0:02:05.123 ******* 2021-11-12T05:36:17.330 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-12T05:36:17.332 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:17.773 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-mlkPpOrpm99LPKzXdt4H14xe5ymHS3PlBS7viRFTdMQrODUmQjmO23pFGvVkpD1J'], 'uuids': ['ae981258-3bca-4080-9a26-75e348970b36']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.104137", "end": "2021-11-12 05:36:17.752176", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-mlkPpOrpm99LPKzXdt4H14xe5ymHS3PlBS7viRFTdMQrODUmQjmO23pFGvVkpD1J"], "labels": [], "masters": [], "uuids": ["ae981258-3bca-4080-9a26-75e348970b36"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:16.648039", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-12T05:36:17.819 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:17 +0000 (0:00:00.550) 0:02:05.674 ******* 2021-11-12T05:36:17.869 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-12T05:36:17.871 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:18.038 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-mlkPpOrpm99LPKzXdt4H14xe5ymHS3PlWsJZlRL9AO5L9r879kkMkLOlqMYAaEbZ'], 'uuids': ['b4fc68b1-6688-46e8-bd0d-1aa2b3f6ff97']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.078476", "end": "2021-11-12 05:36:18.019851", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-mlkPpOrpm99LPKzXdt4H14xe5ymHS3PlWsJZlRL9AO5L9r879kkMkLOlqMYAaEbZ"], "labels": [], "masters": [], "uuids": ["b4fc68b1-6688-46e8-bd0d-1aa2b3f6ff97"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:17.941375", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0771685 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0771685 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:18.050 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:18.061 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:18.210 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-12T05:36:18.212 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-qUZQil-l2dw-xdPB-wB1N-Pi80-S2Ug-l0hEIf', 'nvme-INTEL_SSDPEL1K375GA_PHKM9200001H375A', 'nvme-nvme.8086-50484b4d393230303030314833373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.119190", "end": "2021-11-12 05:36:17.889164", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-qUZQil-l2dw-xdPB-wB1N-Pi80-S2Ug-l0hEIf", "nvme-INTEL_SSDPEL1K375GA_PHKM9200001H375A", "nvme-nvme.8086-50484b4d393230303030314833373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:16.769974", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures destroyed! You m 2021-11-12T05:36:18.214 INFO:teuthology.task.ansible.out:ay now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-12T05:36:18.222 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:18.224 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:18.234 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-12T05:36:18.236 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-mlkPpOrpm99LPKzXdt4H14xe5ymHS3PlwE1avRCytax9ZfsbF7Nsz1mucFaNjBlT'], 'uuids': ['f578a374-cb35-4ae3-84c7-f352a0027263']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.078504", "end": "2021-11-12 05:36:18.214965", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-mlkPpOrpm99LPKzXdt4H14xe5ymHS3PlwE1avRCytax9ZfsbF7Nsz1mucFaNjBlT"], "labels": [], "masters": [], "uuids": ["f578a374-cb35-4ae3-84c7-f352a0027263"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:18.136461", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0773048 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0773048 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:18.247 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I8K38MF6XF', 'wwn-0x50000399aba8166c'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I8K38MF6XF-part1', 'wwn-0x50000399aba8166c-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399aba8166c', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I8K38MF6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I8K38MF6XF", "wwn-0x50000399aba8166c"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I8K38MF6XF-part1", "wwn-0x50000399aba8166c-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I8K38MF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399aba8166c"}}, "skip_reason": "Cond 2021-11-12T05:36:18.249 INFO:teuthology.task.ansible.out:itional result was False"} 2021-11-12T05:36:18.300 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-12T05:36:18.302 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-APjU23-vl3s-spbE-tVuF-oZYv-53p7-ASdmZ7', 'nvme-INTEL_SSDPEL1K375GA_PHKM920000A4375A', 'nvme-nvme.8086-50484b4d393230303030413433373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.123402", "end": "2021-11-12 05:36:18.220843", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-APjU23-vl3s-spbE-tVuF-oZYv-53p7-ASdmZ7", "nvme-INTEL_SSDPEL1K375GA_PHKM920000A4375A", "nvme-nvme.8086-50484b4d393230303030413433373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:17.097441", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures destroyed! You m 2021-11-12T05:36:18.304 INFO:teuthology.task.ansible.out:ay now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-12T05:36:18.313 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:18.314 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:18.326 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-CZvq3MExy6Af8c46vjHC7DbKTQGtvd1OowtXGwiMxxdlcMdnez56kVOOO0suxYvG'], 'uuids': ['192a6408-39a7-4299-a9aa-0f6201cabe2a']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.095274", "end": "2021-11-12 05:36:18.060385", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-CZvq3MExy6Af8c46vjHC7DbKTQGtvd1OowtXGwiMxxdlcMdnez56kVOOO0suxYvG"], "labels": [], "masters": [], "uuids": ["192a6408-39a7-4299-a9aa-0f6201cabe2a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:16.965111", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-12T05:36:18.337 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I8K38NF6XF', 'wwn-0x50000399aba8166d'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I8K38NF6XF-part1', 'wwn-0x50000399aba8166d-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399aba8166d', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I8K38NF6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I8K38NF6XF", "wwn-0x50000399aba8166d"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I8K38NF6XF-part1", "wwn-0x50000399aba8166d-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I8K38NF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399aba8166d"}}, "skip_reason": "Cond 2021-11-12T05:36:18.339 INFO:teuthology.task.ansible.out:itional result was False"} 2021-11-12T05:36:18.413 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-12T05:36:18.415 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-B0GE2x-JiHD-i8Ni-wfza-XPi4-BVpV-3bJTYE', 'nvme-INTEL_SSDPEL1K375GA_PHKM9200003U375A', 'nvme-nvme.8086-50484b4d393230303030335533373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.025371", "end": "2021-11-12 05:36:18.387174", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-B0GE2x-JiHD-i8Ni-wfza-XPi4-BVpV-3bJTYE", "nvme-INTEL_SSDPEL1K375GA_PHKM9200003U375A", "nvme-nvme.8086-50484b4d393230303030335533373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:18.361803", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0241444 s, 4.8 GB/s", "stderr_lines": ["1 2021-11-12T05:36:18.416 INFO:teuthology.task.ansible.out:10+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0241444 s, 4.8 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:18.426 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:18.439 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:18.598 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-mlkPpOrpm99LPKzXdt4H14xe5ymHS3Pl0Geush2PqYUjNy4HFECcweALDC9Mz2sv'], 'uuids': ['41b86dd9-05c3-41e4-9d9f-96017450b295']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.078487", "end": "2021-11-12 05:36:18.572311", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-mlkPpOrpm99LPKzXdt4H14xe5ymHS3Pl0Geush2PqYUjNy4HFECcweALDC9Mz2sv"], "labels": [], "masters": [], "uuids": ["41b86dd9-05c3-41e4-9d9f-96017450b295"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:18.493824", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0772118 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0772118 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:18.600 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:18.612 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:18.805 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-mlkPpOrpm99LPKzXdt4H14xe5ymHS3PlltA1rQN8l0WKngjvWtOPLzzsPr3PHdLX'], 'uuids': ['9da630fc-0f6c-44b2-9edd-c42b8f6f60e5']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.078537", "end": "2021-11-12 05:36:18.776270", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-mlkPpOrpm99LPKzXdt4H14xe5ymHS3PlltA1rQN8l0WKngjvWtOPLzzsPr3PHdLX"], "labels": [], "masters": [], "uuids": ["9da630fc-0f6c-44b2-9edd-c42b8f6f60e5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:18.697733", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0772937 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0772937 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:18.807 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:18.927 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-12T05:36:18.929 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-CgRWXV5SwkTCR0h6oEAFo5cLBHMnvoo1Wd8pbhW6tSJhfkBEmYRCuhXx1cf6jIbc'], 'uuids': ['2f13d3a3-ec9f-44f8-b4cc-ba7502e09cdf']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.497692", "end": "2021-11-12 05:36:18.900548", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-CgRWXV5SwkTCR0h6oEAFo5cLBHMnvoo1Wd8pbhW6tSJhfkBEmYRCuhXx1cf6jIbc"], "labels": [], "masters": [], "uuids": ["2f13d3a3-ec9f-44f8-b4cc-ba7502e09cdf"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:17.402856", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-12T05:36:18.940 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:18.953 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:18.976 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-12T05:36:18.977 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-mlkPpOrpm99LPKzXdt4H14xe5ymHS3PlBS7viRFTdMQrODUmQjmO23pFGvVkpD1J'], 'uuids': ['ae981258-3bca-4080-9a26-75e348970b36']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.079035", "end": "2021-11-12 05:36:18.956478", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-mlkPpOrpm99LPKzXdt4H14xe5ymHS3PlBS7viRFTdMQrODUmQjmO23pFGvVkpD1J"], "labels": [], "masters": [], "uuids": ["ae981258-3bca-4080-9a26-75e348970b36"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:18.877443", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0777781 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0777781 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:19.022 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:19 +0000 (0:00:01.202) 0:02:06.877 ******* 2021-11-12T05:36:19.339 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-11-12T05:36:19.340 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.178339", "end": "2021-11-12 05:36:19.284827", "rc": 0, "start": "2021-11-12 05:36:19.106488", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:19.368 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:19 +0000 (0:00:00.345) 0:02:07.223 ******* 2021-11-12T05:36:19.419 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-12T05:36:19.420 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-ZTKmfoO0KLQV5mZUsB6h51mZwozyOPZiFf3WbhRaUBqcTY9yoLqMDPqT6z2svETR'], 'uuids': ['6d85dfd3-cac3-4934-8426-42752d0768e5']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.401487", "end": "2021-11-12 05:36:19.395977", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-ZTKmfoO0KLQV5mZUsB6h51mZwozyOPZiFf3WbhRaUBqcTY9yoLqMDPqT6z2svETR"], "labels": [], "masters": [], "uuids": ["6d85dfd3-cac3-4934-8426-42752d0768e5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:17.994490", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-12T05:36:19.433 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:19.446 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:19.522 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-OMb88TSca2jKbyA0ARyebJSkhDU8ti52vaMQg7OdktIcJdad8FO1UE84cbsmXxpN'], 'uuids': ['11e5a874-a348-492f-b23a-06353f607cc9']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.113662", "end": "2021-11-12 05:36:19.440406", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-OMb88TSca2jKbyA0ARyebJSkhDU8ti52vaMQg7OdktIcJdad8FO1UE84cbsmXxpN"], "labels": [], "masters": [], "uuids": ["11e5a874-a348-492f-b23a-06353f607cc9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:18.326744", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-12T05:36:19.533 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:19.535 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-C0Uxad-iVVs-gx2f-dpeN-Jf2Q-20vh-C7rErg', 'nvme-INTEL_SSDPEL1K375GA_PHKM913400FA375A', 'nvme-nvme.8086-50484b4d393133343030464133373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.111148", "end": "2021-11-12 05:36:19.269489", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-C0Uxad-iVVs-gx2f-dpeN-Jf2Q-20vh-C7rErg", "nvme-INTEL_SSDPEL1K375GA_PHKM913400FA375A", "nvme-nvme.8086-50484b4d393133343030464133373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:18.158341", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures destroyed! You m 2021-11-12T05:36:19.536 INFO:teuthology.task.ansible.out:ay now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-12T05:36:19.546 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:19.548 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:19.550 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:19.591 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-11-12T05:36:19.593 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.096401", "end": "2021-11-12 05:36:19.564827", "rc": 0, "start": "2021-11-12 05:36:19.468426", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:19.616 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:19 +0000 (0:00:00.248) 0:02:07.471 ******* 2021-11-12T05:36:19.646 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-11-12T05:36:19.673 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:19 +0000 (0:00:00.056) 0:02:07.527 ******* 2021-11-12T05:36:19.701 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-11-12T05:36:19.703 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:19.733 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:19 +0000 (0:00:00.060) 0:02:07.588 ******* 2021-11-12T05:36:19.761 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-11-12T05:36:19.763 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:19.785 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:19 +0000 (0:00:00.052) 0:02:07.640 ******* 2021-11-12T05:36:19.813 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-11-12T05:36:19.815 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:19.839 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:19 +0000 (0:00:00.053) 0:02:07.694 ******* 2021-11-12T05:36:19.877 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-11-12T05:36:19.879 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:19.902 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:19 +0000 (0:00:00.062) 0:02:07.756 ******* 2021-11-12T05:36:20.003 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-11-12T05:36:20.004 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-12T05:36:20.027 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:20 +0000 (0:00:00.125) 0:02:07.882 ******* 2021-11-12T05:36:20.107 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-11-12T05:36:20.109 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'block_used': 14049728, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045380, 'size_available': 925881876480, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187097, 'block_size': 4096, 'inode_available': 60867879}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045380, "block_size": 4096, "block_total": 240095108, "block_used": 14049728, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867879, "inode_total": 61054976, "inode_used": 187097, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881876480, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:20.136 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:20 +0000 (0:00:00.109) 0:02:07.991 ******* 2021-11-12T05:36:20.156 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-12T05:36:20.158 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-CgRWXV5SwkTCR0h6oEAFo5cLBHMnvoo19PJzdg3PPcCpObJT41Oq9mdrH2HrBPYE'], 'uuids': ['eb6ba0c2-b128-446b-838e-0ffde8f94810']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.106969", "end": "2021-11-12 05:36:20.123037", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-CgRWXV5SwkTCR0h6oEAFo5cLBHMnvoo19PJzdg3PPcCpObJT41Oq9mdrH2HrBPYE"], "labels": [], "masters": [], "uuids": ["eb6ba0c2-b128-446b-838e-0ffde8f94810"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:19.016068", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-12T05:36:20.159 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF', 'wwn-0x50000399ab801e93'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF-part1', 'wwn-0x50000399ab801e93-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab801e93', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I3K3PZF6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF", "wwn-0x50000399ab801e93"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF-part1", "wwn-0x50000399ab801e93-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I3K3PZF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab801e93"}}, "skip_reason": "Cond 2021-11-12T05:36:20.161 INFO:teuthology.task.ansible.out:itional result was False"} 2021-11-12T05:36:20.170 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-11-12T05:36:20.171 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:20.194 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:20 +0000 (0:00:00.057) 0:02:08.049 ******* 2021-11-12T05:36:20.232 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-12T05:36:20.234 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:20.256 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:20 +0000 (0:00:00.062) 0:02:08.111 ******* 2021-11-12T05:36:20.284 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-12T05:36:20.286 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:20.308 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:20 +0000 (0:00:00.051) 0:02:08.163 ******* 2021-11-12T05:36:20.336 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-11-12T05:36:20.338 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:20.360 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:20 +0000 (0:00:00.051) 0:02:08.215 ******* 2021-11-12T05:36:20.390 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-11-12T05:36:20.391 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:20.415 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:20 +0000 (0:00:00.054) 0:02:08.270 ******* 2021-11-12T05:36:20.443 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:20.467 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:20 +0000 (0:00:00.052) 0:02:08.322 ******* 2021-11-12T05:36:20.678 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-12T05:36:20.679 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-ZTKmfoO0KLQV5mZUsB6h51mZwozyOPZiYX2pgpXwmhsxXAoiDGmb7D9nrr7U5PwX'], 'uuids': ['9133581f-fb4b-45ca-af97-ec1e80e0102e']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.130578", "end": "2021-11-12 05:36:20.638589", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-ZTKmfoO0KLQV5mZUsB6h51mZwozyOPZiYX2pgpXwmhsxXAoiDGmb7D9nrr7U5PwX"], "labels": [], "masters": [], "uuids": ["9133581f-fb4b-45ca-af97-ec1e80e0102e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:19.508011", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-12T05:36:20.681 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:20.724 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-OMb88TSca2jKbyA0ARyebJSkhDU8ti529zfUeOqXdCFJZBQG2W1Lm1n6lUgSpqLQ'], 'uuids': ['dad4f7f1-ae8e-4834-98d6-c7c75f83598e']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.088025", "end": "2021-11-12 05:36:20.642998", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-OMb88TSca2jKbyA0ARyebJSkhDU8ti529zfUeOqXdCFJZBQG2W1Lm1n6lUgSpqLQ"], "labels": [], "masters": [], "uuids": ["dad4f7f1-ae8e-4834-98d6-c7c75f83598e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:19.554973", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-12T05:36:20.736 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:20.748 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-CZvq3MExy6Af8c46vjHC7DbKTQGtvd1OyOpYBU9FiVFRH3yjJb5IS7vqWfeuuCth'], 'uuids': ['c9976ac4-9d95-4753-9c9d-864257d53974']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.098198", "end": "2021-11-12 05:36:20.478314", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-CZvq3MExy6Af8c46vjHC7DbKTQGtvd1OyOpYBU9FiVFRH3yjJb5IS7vqWfeuuCth"], "labels": [], "masters": [], "uuids": ["c9976ac4-9d95-4753-9c9d-864257d53974"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:19.380116", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-12T05:36:20.750 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:20.752 INFO:teuthology.task.ansible.out: 2021-11-12T05:36:20.763 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:21.183 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-11-12T05:36:21.185 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-11-12T05:36:21.207 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:21 +0000 (0:00:00.739) 0:02:09.062 ******* 2021-11-12T05:36:21.351 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-12T05:36:21.353 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-ACJ85G-VWJl-Rjfp-Kzgf-vT6l-k4eh-Sht7Tj', 'nvme-INTEL_SSDPEL1K375GA_PHKM913400GH375A', 'nvme-nvme.8086-50484b4d393133343030474833373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.108613", "end": "2021-11-12 05:36:21.325209", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-ACJ85G-VWJl-Rjfp-Kzgf-vT6l-k4eh-Sht7Tj", "nvme-INTEL_SSDPEL1K375GA_PHKM913400GH375A", "nvme-nvme.8086-50484b4d393133343030474833373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:20.216596", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures destroyed! You m 2021-11-12T05:36:21.354 INFO:teuthology.task.ansible.out:ay now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:21.364 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:21.837 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-12T05:36:21.839 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-12T05:36:21.906 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-12T05:36:21.908 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-ZTKmfoO0KLQV5mZUsB6h51mZwozyOPZiXV36t4n9b9HH2ixOXtd0gy6MtDIJ1ih0'], 'uuids': ['e636989f-21c1-471b-b866-77c6c632a191']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.130081", "end": "2021-11-12 05:36:21.879912", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-ZTKmfoO0KLQV5mZUsB6h51mZwozyOPZiXV36t4n9b9HH2ixOXtd0gy6MtDIJ1ih0"], "labels": [], "masters": [], "uuids": ["e636989f-21c1-471b-b866-77c6c632a191"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:20.749831", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-12T05:36:21.946 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:21 +0000 (0:00:00.738) 0:02:09.801 ******* 2021-11-12T05:36:21.957 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-OMb88TSca2jKbyA0ARyebJSkhDU8ti52P0CBNo37HYOE3acf5cAK5P4bpviKmTwX'], 'uuids': ['75ce2d99-04e5-401a-88ff-7d732ceb15a0']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.093793", "end": "2021-11-12 05:36:21.860760", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-OMb88TSca2jKbyA0ARyebJSkhDU8ti52P0CBNo37HYOE3acf5cAK5P4bpviKmTwX"], "labels": [], "masters": [], "uuids": ["75ce2d99-04e5-401a-88ff-7d732ceb15a0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:20.766967", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-12T05:36:21.972 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-CZvq3MExy6Af8c46vjHC7DbKTQGtvd1O429QmKQLZf9RPmOVepec9dYty0vZm2cc'], 'uuids': ['8aff17e4-db14-4a39-b065-16e6c8701921']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.092528", "end": "2021-11-12 05:36:21.686817", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-CZvq3MExy6Af8c46vjHC7DbKTQGtvd1O429QmKQLZf9RPmOVepec9dYty0vZm2cc"], "labels": [], "masters": [], "uuids": ["8aff17e4-db14-4a39-b065-16e6c8701921"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:20.594289", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-12T05:36:21.973 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:22.003 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:22 +0000 (0:00:00.057) 0:02:09.858 ******* 2021-11-12T05:36:22.012 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-12T05:36:22.014 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:22.057 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:22.174 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-ZTKmfoO0KLQV5mZUsB6h51mZwozyOPZi0o7k2I4W2VXLsvVfLLXdPeJ7l10BlSH9'], 'uuids': ['56767267-b78d-4031-9637-6ab60867d425']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.077869", "end": "2021-11-12 05:36:22.149477", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-ZTKmfoO0KLQV5mZUsB6h51mZwozyOPZi0o7k2I4W2VXLsvVfLLXdPeJ7l10BlSH9"], "labels": [], "masters": [], "uuids": ["56767267-b78d-4031-9637-6ab60867d425"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:22.071608", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0766465 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0766465 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:22.176 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:22.187 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:22.188 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-12T05:36:22.188 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-12T05:36:22.221 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-12T05:36:22.222 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-OMb88TSca2jKbyA0ARyebJSkhDU8ti52sW3UO8KRRw7mdWFKO2DaPcdoH20x6lPX'], 'uuids': ['27599c33-72f7-4d65-9f7e-ae40f5f08f5b']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.078280", "end": "2021-11-12 05:36:22.145362", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-OMb88TSca2jKbyA0ARyebJSkhDU8ti52sW3UO8KRRw7mdWFKO2DaPcdoH20x6lPX"], "labels": [], "masters": [], "uuids": ["27599c33-72f7-4d65-9f7e-ae40f5f08f5b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:22.067082", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0768603 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0768603 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:22.233 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:22.245 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:22.361 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-ZTKmfoO0KLQV5mZUsB6h51mZwozyOPZi5PqDIW74912j0dq3amBCurfOSm0LF3es'], 'uuids': ['e2b55a07-1bf1-4e0d-8785-0a545c4aa5c4']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.078643", "end": "2021-11-12 05:36:22.341892", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-ZTKmfoO0KLQV5mZUsB6h51mZwozyOPZi5PqDIW74912j0dq3amBCurfOSm0LF3es"], "labels": [], "masters": [], "uuids": ["e2b55a07-1bf1-4e0d-8785-0a545c4aa5c4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:22.263249", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.077455 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.077455 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:22.373 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I8K38HF6XF', 'wwn-0x50000399aba81667'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I8K38HF6XF-part1', 'wwn-0x50000399aba81667-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399aba81667', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I8K38HF6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I8K38HF6XF", "wwn-0x50000399aba81667"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I8K38HF6XF-part1", "wwn-0x50000399aba81667-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I8K38HF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399aba81667"}}, "skip_reason": "Cond 2021-11-12T05:36:22.375 INFO:teuthology.task.ansible.out:itional result was False"} 2021-11-12T05:36:22.406 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-OMb88TSca2jKbyA0ARyebJSkhDU8ti52QObcqW1o91qvq96kFLOtOj2VcnWJ3OOR'], 'uuids': ['86f63aa7-52b8-4008-aa5b-b0028e55d35b']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.078184", "end": "2021-11-12 05:36:22.332034", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-OMb88TSca2jKbyA0ARyebJSkhDU8ti52QObcqW1o91qvq96kFLOtOj2VcnWJ3OOR"], "labels": [], "masters": [], "uuids": ["86f63aa7-52b8-4008-aa5b-b0028e55d35b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:22.253850", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0769624 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0769624 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:22.418 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I3K3Q0F6XF', 'wwn-0x50000399ab801e94'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I3K3Q0F6XF-part1', 'wwn-0x50000399ab801e94-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab801e94', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I3K3Q0F6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I3K3Q0F6XF", "wwn-0x50000399ab801e94"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I3K3Q0F6XF-part1", "wwn-0x50000399ab801e94-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I3K3Q0F6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab801e94"}}, "skip_reason": "Cond 2021-11-12T05:36:22.420 INFO:teuthology.task.ansible.out:itional result was False"} 2021-11-12T05:36:22.474 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-qUZQil-l2dw-xdPB-wB1N-Pi80-S2Ug-l0hEIf', 'nvme-INTEL_SSDPEL1K375GA_PHKM9200001H375A', 'nvme-nvme.8086-50484b4d393230303030314833373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.025482", "end": "2021-11-12 05:36:22.460110", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-qUZQil-l2dw-xdPB-wB1N-Pi80-S2Ug-l0hEIf", "nvme-INTEL_SSDPEL1K375GA_PHKM9200001H375A", "nvme-nvme.8086-50484b4d393230303030314833373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:22.434628", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0242897 s, 4.7 GB/s", "stderr_lines": ["1 2021-11-12T05:36:22.476 INFO:teuthology.task.ansible.out:10+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0242897 s, 4.7 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:22.486 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:22.497 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:22.540 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-APjU23-vl3s-spbE-tVuF-oZYv-53p7-ASdmZ7', 'nvme-INTEL_SSDPEL1K375GA_PHKM920000A4375A', 'nvme-nvme.8086-50484b4d393230303030413433373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.025514", "end": "2021-11-12 05:36:22.460503", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-APjU23-vl3s-spbE-tVuF-oZYv-53p7-ASdmZ7", "nvme-INTEL_SSDPEL1K375GA_PHKM920000A4375A", "nvme-nvme.8086-50484b4d393230303030413433373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:22.434989", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0242715 s, 4.8 GB/s", "stderr_lines": ["1 2021-11-12T05:36:22.542 INFO:teuthology.task.ansible.out:10+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0242715 s, 4.8 GB/s"], "stdout": "", "stdout_lines": []} skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:22.553 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:22.565 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-12T05:36:22.566 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} TASK [testnode : Zap all non-root disks] *************************************** changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-CgRWXV5SwkTCR0h6oEAFo5cLBHMnvoo1fcsH4plqkXb1DZwzG2Mur5mKsGs1FczO'], 'uuids': ['59ec9466-302f-42f7-92a2-f51100a69a51']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.107354", "end": "2021-11-12 05:36:22.540142", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-CgRWXV5SwkTCR0h6oEAFo5cLBHMnvoo1fcsH4plqkXb1DZwzG2Mur5mKsGs1FczO"], "labels": [], "masters": [], "uuids": ["59ec9466-302f-42f7-92a2-f51100a69a51"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:21.432788", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\ 2021-11-12T05:36:22.568 INFO:teuthology.task.ansible.out:nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-12T05:36:22.578 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:22.590 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:22.665 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-12T05:36:22.666 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-ZTKmfoO0KLQV5mZUsB6h51mZwozyOPZiFf3WbhRaUBqcTY9yoLqMDPqT6z2svETR'], 'uuids': ['6d85dfd3-cac3-4934-8426-42752d0768e5']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.077540", "end": "2021-11-12 05:36:22.651580", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-ZTKmfoO0KLQV5mZUsB6h51mZwozyOPZiFf3WbhRaUBqcTY9yoLqMDPqT6z2svETR"], "labels": [], "masters": [], "uuids": ["6d85dfd3-cac3-4934-8426-42752d0768e5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:22.574040", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0762483 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0762483 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:22.677 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:22.689 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:22.743 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-OMb88TSca2jKbyA0ARyebJSkhDU8ti52vaMQg7OdktIcJdad8FO1UE84cbsmXxpN'], 'uuids': ['11e5a874-a348-492f-b23a-06353f607cc9']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.078004", "end": "2021-11-12 05:36:22.663006", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-OMb88TSca2jKbyA0ARyebJSkhDU8ti52vaMQg7OdktIcJdad8FO1UE84cbsmXxpN"], "labels": [], "masters": [], "uuids": ["11e5a874-a348-492f-b23a-06353f607cc9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:22.585002", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0767451 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0767451 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:22.745 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:22.756 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:22.855 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-ZTKmfoO0KLQV5mZUsB6h51mZwozyOPZiYX2pgpXwmhsxXAoiDGmb7D9nrr7U5PwX'], 'uuids': ['9133581f-fb4b-45ca-af97-ec1e80e0102e']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.078562", "end": "2021-11-12 05:36:22.831046", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-ZTKmfoO0KLQV5mZUsB6h51mZwozyOPZiYX2pgpXwmhsxXAoiDGmb7D9nrr7U5PwX"], "labels": [], "masters": [], "uuids": ["9133581f-fb4b-45ca-af97-ec1e80e0102e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:22.752484", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0773015 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0773015 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:22.908 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:22.932 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-OMb88TSca2jKbyA0ARyebJSkhDU8ti529zfUeOqXdCFJZBQG2W1Lm1n6lUgSpqLQ'], 'uuids': ['dad4f7f1-ae8e-4834-98d6-c7c75f83598e']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.136752", "end": "2021-11-12 05:36:22.913017", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-OMb88TSca2jKbyA0ARyebJSkhDU8ti529zfUeOqXdCFJZBQG2W1Lm1n6lUgSpqLQ"], "labels": [], "masters": [], "uuids": ["dad4f7f1-ae8e-4834-98d6-c7c75f83598e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:22.776265", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0766937 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0766937 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:22.945 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:22.968 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-12T05:36:22.970 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-12T05:36:23.088 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-12T05:36:23.090 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-ZTKmfoO0KLQV5mZUsB6h51mZwozyOPZiXV36t4n9b9HH2ixOXtd0gy6MtDIJ1ih0'], 'uuids': ['e636989f-21c1-471b-b866-77c6c632a191']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.078190", "end": "2021-11-12 05:36:23.066307", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-ZTKmfoO0KLQV5mZUsB6h51mZwozyOPZiXV36t4n9b9HH2ixOXtd0gy6MtDIJ1ih0"], "labels": [], "masters": [], "uuids": ["e636989f-21c1-471b-b866-77c6c632a191"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:22.988117", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0768805 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0768805 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:23.139 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:23 +0000 (0:00:01.135) 0:02:10.994 ******* 2021-11-12T05:36:23.161 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-OMb88TSca2jKbyA0ARyebJSkhDU8ti52P0CBNo37HYOE3acf5cAK5P4bpviKmTwX'], 'uuids': ['75ce2d99-04e5-401a-88ff-7d732ceb15a0']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.078754", "end": "2021-11-12 05:36:23.128439", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-OMb88TSca2jKbyA0ARyebJSkhDU8ti52P0CBNo37HYOE3acf5cAK5P4bpviKmTwX"], "labels": [], "masters": [], "uuids": ["75ce2d99-04e5-401a-88ff-7d732ceb15a0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:23.049685", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0774648 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0774648 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:23.210 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:23 +0000 (0:00:00.070) 0:02:11.065 ******* 2021-11-12T05:36:23.219 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-12T05:36:23.221 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-CZvq3MExy6Af8c46vjHC7DbKTQGtvd1OYrfh2w0EcFGQdli9Er1khISU6c1Th7cz'], 'uuids': ['aa71c934-3b75-4af8-9283-40ab6c03646d']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.109701", "end": "2021-11-12 05:36:22.929961", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-CZvq3MExy6Af8c46vjHC7DbKTQGtvd1OYrfh2w0EcFGQdli9Er1khISU6c1Th7cz"], "labels": [], "masters": [], "uuids": ["aa71c934-3b75-4af8-9283-40ab6c03646d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:21.820260", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-12T05:36:23.272 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:23 +0000 (0:00:00.061) 0:02:11.126 ******* 2021-11-12T05:36:23.324 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-12T05:36:23.326 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:23.370 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-12T05:36:23.372 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-12T05:36:23.402 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:23 +0000 (0:00:00.129) 0:02:11.256 ******* 2021-11-12T05:36:23.464 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** changed: [gibba016.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.192542", "end": "2021-11-12 05:36:23.426502", "rc": 0, "start": "2021-11-12 05:36:23.233960", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:23.490 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:23 +0000 (0:00:00.089) 0:02:11.345 ******* 2021-11-12T05:36:23.530 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-12T05:36:23.532 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-CZvq3MExy6Af8c46vjHC7DbKTQGtvd1OQ5dzNYKMGoQtJxhYlsOOv23aathBbuFE'], 'uuids': ['11e3a87f-735c-4e99-9436-43580711516c']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.078203", "end": "2021-11-12 05:36:23.263227", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-CZvq3MExy6Af8c46vjHC7DbKTQGtvd1OQ5dzNYKMGoQtJxhYlsOOv23aathBbuFE"], "labels": [], "masters": [], "uuids": ["11e3a87f-735c-4e99-9436-43580711516c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:23.185024", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0769371 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0769371 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} TASK [testnode : Remove all LVM data] ****************************************** changed: [gibba038.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.163095", "end": "2021-11-12 05:36:23.487649", "rc": 0, "start": "2021-11-12 05:36:23.324554", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:23.533 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratc 2021-11-12T05:36:23.535 INFO:teuthology.task.ansible.out:h_devs so we know it's accurate] ***************** changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:23.566 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:23 +0000 (0:00:00.076) 0:02:11.421 ******* 2021-11-12T05:36:23.594 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:23 +0000 (0:00:00.027) 0:02:11.449 ******* 2021-11-12T05:36:23.605 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:23.705 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-12T05:36:23.708 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-12T05:36:23.717 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-11-12T05:36:23.718 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.104151", "end": "2021-11-12 05:36:23.690576", "rc": 0, "start": "2021-11-12 05:36:23.586425", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:23.745 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:23 +0000 (0:00:00.150) 0:02:11.600 ******* 2021-11-12T05:36:23.753 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-12T05:36:23.754 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-CZvq3MExy6Af8c46vjHC7DbKTQGtvd1OowtXGwiMxxdlcMdnez56kVOOO0suxYvG'], 'uuids': ['192a6408-39a7-4299-a9aa-0f6201cabe2a']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.078893", "end": "2021-11-12 05:36:23.470783", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-CZvq3MExy6Af8c46vjHC7DbKTQGtvd1OowtXGwiMxxdlcMdnez56kVOOO0suxYvG"], "labels": [], "masters": [], "uuids": ["192a6408-39a7-4299-a9aa-0f6201cabe2a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:23.391890", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0776895 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0776895 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:23.755 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I8K38NF6XF', 'wwn-0x50000399aba8166d'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I8K38NF6XF-part1', 'wwn-0x50000399aba8166d-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399aba8166d', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I8K38NF6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I8K38NF6XF", "wwn-0x50000399aba8166d"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I8K38NF6XF-part1", "wwn-0x50000399aba8166d-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I8K38NF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399aba8166d"}}, "skip_reason": "Cond 2021-11-12T05:36:23.757 INFO:teuthology.task.ansible.out:itional result was False"} 2021-11-12T05:36:23.768 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-11-12T05:36:23.769 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-CgRWXV5SwkTCR0h6oEAFo5cLBHMnvoo1r9LE9dFTv8gPpHKiTTcxEO4TtW5AJ1uS'], 'uuids': ['c1a616a2-5f64-4634-a0b0-3d040d20dcf4']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.085372", "end": "2021-11-12 05:36:23.748734", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-CgRWXV5SwkTCR0h6oEAFo5cLBHMnvoo1r9LE9dFTv8gPpHKiTTcxEO4TtW5AJ1uS"], "labels": [], "masters": [], "uuids": ["c1a616a2-5f64-4634-a0b0-3d040d20dcf4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:22.663362", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now p 2021-11-12T05:36:23.771 INFO:teuthology.task.ansible.out:artition the disk using fdisk or", "other utilities."]} 2021-11-12T05:36:23.797 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:23 +0000 (0:00:00.052) 0:02:11.652 ******* 2021-11-12T05:36:23.808 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:23.819 INFO:teuthology.task.ansible.out: 2021-11-12T05:36:23.820 INFO:teuthology.task.ansible.out:TASK [testnode : Check for physical volumes] *********************************** changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.072626", "end": "2021-11-12 05:36:23.795244", "rc": 0, "start": "2021-11-12 05:36:23.722618", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:23.822 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-12T05:36:23.851 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:23 +0000 (0:00:00.054) 0:02:11.706 ******* 2021-11-12T05:36:23.859 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-11-12T05:36:23.861 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:23.887 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:23 +0000 (0:00:00.035) 0:02:11.742 ******* 2021-11-12T05:36:23.895 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-12T05:36:23.896 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-C0Uxad-iVVs-gx2f-dpeN-Jf2Q-20vh-C7rErg', 'nvme-INTEL_SSDPEL1K375GA_PHKM913400FA375A', 'nvme-nvme.8086-50484b4d393133343030464133373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.025506", "end": "2021-11-12 05:36:23.598135", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-C0Uxad-iVVs-gx2f-dpeN-Jf2Q-20vh-C7rErg", "nvme-INTEL_SSDPEL1K375GA_PHKM913400FA375A", "nvme-nvme.8086-50484b4d393133343030464133373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:23.572629", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0242471 s, 4.8 GB/s", "stderr_lines": ["1 2021-11-12T05:36:23.898 INFO:teuthology.task.ansible.out:10+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0242471 s, 4.8 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:23.899 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} TASK [testnode : Remove physical volumes] ************************************** 2021-11-12T05:36:23.901 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:23.902 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-12T05:36:23.929 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:23 +0000 (0:00:00.041) 0:02:11.783 ******* 2021-11-12T05:36:23.936 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-11-12T05:36:23.937 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:23.962 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:23 +0000 (0:00:00.033) 0:02:11.816 ******* 2021-11-12T05:36:23.968 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-11-12T05:36:23.972 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:23.997 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:23 +0000 (0:00:00.035) 0:02:11.852 ******* 2021-11-12T05:36:24.004 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-12T05:36:24.005 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-11-12T05:36:24.006 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:24.006 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** skipping: [gibba005.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:24.035 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:24 +0000 (0:00:00.037) 0:02:11.890 ******* 2021-11-12T05:36:24.062 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:24 +0000 (0:00:00.027) 0:02:11.917 ******* 2021-11-12T05:36:24.069 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-11-12T05:36:24.071 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:24.072 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-CZvq3MExy6Af8c46vjHC7DbKTQGtvd1OyOpYBU9FiVFRH3yjJb5IS7vqWfeuuCth'], 'uuids': ['c9976ac4-9d95-4753-9c9d-864257d53974']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.078354", "end": "2021-11-12 05:36:23.787187", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-CZvq3MExy6Af8c46vjHC7DbKTQGtvd1OyOpYBU9FiVFRH3yjJb5IS7vqWfeuuCth"], "labels": [], "masters": [], "uuids": ["c9976ac4-9d95-4753-9c9d-864257d53974"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:23.708833", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0771289 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0771289 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:24.073 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:24.074 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-12T05:36:24.075 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (ite 2021-11-12T05:36:24.079 INFO:teuthology.task.ansible.out:m={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:24.102 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:24 +0000 (0:00:00.039) 0:02:11.956 ******* 2021-11-12T05:36:24.125 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:24 +0000 (0:00:00.022) 0:02:11.978 ******* 2021-11-12T05:36:24.132 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-11-12T05:36:24.133 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:24.157 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:24 +0000 (0:00:00.033) 0:02:12.012 ******* 2021-11-12T05:36:24.164 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-11-12T05:36:24.166 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:24.192 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:24 +0000 (0:00:00.034) 0:02:12.047 ******* 2021-11-12T05:36:24.222 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:24 +0000 (0:00:00.029) 0:02:12.077 ******* 2021-11-12T05:36:24.258 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-11-12T05:36:24.259 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:24.290 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:24 +0000 (0:00:00.068) 0:02:12.145 ******* 2021-11-12T05:36:24.298 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-12T05:36:24.299 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-CZvq3MExy6Af8c46vjHC7DbKTQGtvd1O429QmKQLZf9RPmOVepec9dYty0vZm2cc'], 'uuids': ['8aff17e4-db14-4a39-b065-16e6c8701921']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.078626", "end": "2021-11-12 05:36:23.999990", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-CZvq3MExy6Af8c46vjHC7DbKTQGtvd1O429QmKQLZf9RPmOVepec9dYty0vZm2cc"], "labels": [], "masters": [], "uuids": ["8aff17e4-db14-4a39-b065-16e6c8701921"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:23.921364", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0773673 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0773673 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:24.301 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-11-12T05:36:24.303 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-12T05:36:24.303 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:24.304 INFO:teuthology.task.ansible.out: 2021-11-12T05:36:24.305 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-11-12T05:36:24.335 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:24 +0000 (0:00:00.044) 0:02:12.189 ******* 2021-11-12T05:36:24.364 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:24 +0000 (0:00:00.029) 0:02:12.218 ******* 2021-11-12T05:36:24.385 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-11-12T05:36:24.387 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-11-12T05:36:24.423 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:24 +0000 (0:00:00.058) 0:02:12.277 ******* 2021-11-12T05:36:24.431 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-11-12T05:36:24.433 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [testnode : Set root disk] ************************************************ 2021-11-12T05:36:24.433 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'block_used': 14049720, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045388, 'size_available': 925881909248, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187091, 'block_size': 4096, 'inode_available': 60867885}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045388, "block_size": 4096, "block_total": 240095108, "block_used": 14049720, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867885, "inode_total": 61054976, "inode_used": 187091, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881909248, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:24.465 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:24 +0000 (0:00:00.041) 0:02:12.319 ******* 2021-11-12T05:36:24.490 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:24 +0000 (0:00:00.025) 0:02:12.345 ******* 2021-11-12T05:36:24.500 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-12T05:36:24.501 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-CZvq3MExy6Af8c46vjHC7DbKTQGtvd1OYrfh2w0EcFGQdli9Er1khISU6c1Th7cz'], 'uuids': ['aa71c934-3b75-4af8-9283-40ab6c03646d']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.078406", "end": "2021-11-12 05:36:24.187513", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-CZvq3MExy6Af8c46vjHC7DbKTQGtvd1OYrfh2w0EcFGQdli9Er1khISU6c1Th7cz"], "labels": [], "masters": [], "uuids": ["aa71c934-3b75-4af8-9283-40ab6c03646d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:24.109107", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0771866 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0771866 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:24.515 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:24.545 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:24 +0000 (0:00:00.054) 0:02:12.400 ******* 2021-11-12T05:36:24.571 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:24 +0000 (0:00:00.025) 0:02:12.426 ******* 2021-11-12T05:36:24.579 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-11-12T05:36:24.581 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'block_used': 14049726, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045382, 'size_available': 925881884672, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187097, 'block_size': 4096, 'inode_available': 60867879}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045382, "block_size": 4096, "block_total": 240095108, "block_used": 14049726, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867879, "inode_total": 61054976, "inode_used": 187097, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881884672, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:24.583 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:24.611 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:24 +0000 (0:00:00.040) 0:02:12.466 ******* 2021-11-12T05:36:24.636 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:24 +0000 (0:00:00.023) 0:02:12.490 ******* 2021-11-12T05:36:24.645 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-12T05:36:24.647 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:24.684 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:24 +0000 (0:00:00.048) 0:02:12.538 ******* 2021-11-12T05:36:24.692 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-11-12T05:36:24.693 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:24.720 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:24 +0000 (0:00:00.036) 0:02:12.574 ******* 2021-11-12T05:36:24.727 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-11-12T05:36:24.728 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:24.755 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:24 +0000 (0:00:00.035) 0:02:12.609 ******* 2021-11-12T05:36:24.763 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-12T05:36:24.764 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:24.791 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:24 +0000 (0:00:00.036) 0:02:12.645 ******* 2021-11-12T05:36:24.797 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-11-12T05:36:24.799 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:24.825 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:24 +0000 (0:00:00.034) 0:02:12.680 ******* 2021-11-12T05:36:24.832 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-12T05:36:24.834 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [gibba005.front.sepia.ceph.com] => {"changed": true} 2021-11-12T05:36:24.863 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:24 +0000 (0:00:00.037) 0:02:12.718 ******* 2021-11-12T05:36:24.887 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:24 +0000 (0:00:00.023) 0:02:12.741 ******* 2021-11-12T05:36:24.896 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-11-12T05:36:24.898 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove all LVM data] ****************************************** changed: [gibba044.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.193071", "end": "2021-11-12 05:36:24.609249", "rc": 0, "start": "2021-11-12 05:36:24.416178", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:24.924 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:24 +0000 (0:00:00.037) 0:02:12.779 ******* 2021-11-12T05:36:24.949 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:24 +0000 (0:00:00.024) 0:02:12.804 ******* 2021-11-12T05:36:24.957 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-11-12T05:36:24.958 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:24.986 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:24 +0000 (0:00:00.037) 0:02:12.841 ******* 2021-11-12T05:36:24.997 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-12T05:36:24.998 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-CgRWXV5SwkTCR0h6oEAFo5cLBHMnvoo13C21fyTenkbTVXxeTiLzVrJwO06VGUsw'], 'uuids': ['10e4626c-23f4-418a-9464-846670464841']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.087179", "end": "2021-11-12 05:36:24.957309", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-CgRWXV5SwkTCR0h6oEAFo5cLBHMnvoo13C21fyTenkbTVXxeTiLzVrJwO06VGUsw"], "labels": [], "masters": [], "uuids": ["10e4626c-23f4-418a-9464-846670464841"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:23.870130", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-12T05:36:25.044 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:25 +0000 (0:00:00.058) 0:02:12.899 ******* 2021-11-12T05:36:25.053 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-11-12T05:36:25.055 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:25.083 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:25 +0000 (0:00:00.038) 0:02:12.937 ******* 2021-11-12T05:36:25.102 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-12T05:36:25.104 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:25.115 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:25.140 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:25 +0000 (0:00:00.057) 0:02:12.994 ******* 2021-11-12T05:36:25.157 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-11-12T05:36:25.159 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.071061", "end": "2021-11-12 05:36:24.870767", "rc": 0, "start": "2021-11-12 05:36:24.799706", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:25.185 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:25 +0000 (0:00:00.045) 0:02:13.040 ******* 2021-11-12T05:36:25.213 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-11-12T05:36:25.240 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:25 +0000 (0:00:00.054) 0:02:13.095 ******* 2021-11-12T05:36:25.270 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-11-12T05:36:25.272 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-CgRWXV5SwkTCR0h6oEAFo5cLBHMnvoo1Wd8pbhW6tSJhfkBEmYRCuhXx1cf6jIbc'], 'uuids': ['2f13d3a3-ec9f-44f8-b4cc-ba7502e09cdf']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.078329", "end": "2021-11-12 05:36:25.256237", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-CgRWXV5SwkTCR0h6oEAFo5cLBHMnvoo1Wd8pbhW6tSJhfkBEmYRCuhXx1cf6jIbc"], "labels": [], "masters": [], "uuids": ["2f13d3a3-ec9f-44f8-b4cc-ba7502e09cdf"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:25.177908", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0770654 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0770654 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:25.272 INFO:teuthology.task.ansible.out: 2021-11-12T05:36:25.274 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-11-12T05:36:25.300 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:25 +0000 (0:00:00.059) 0:02:13.154 ******* 2021-11-12T05:36:25.329 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:25 +0000 (0:00:00.028) 0:02:13.183 ******* 2021-11-12T05:36:25.336 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-12T05:36:25.337 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:25.340 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} TASK [testnode : Install cachefilesd] ****************************************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:25.374 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:25 +0000 (0:00:00.044) 0:02:13.228 ******* 2021-11-12T05:36:25.381 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-11-12T05:36:25.383 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:25.407 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:25 +0000 (0:00:00.033) 0:02:13.262 ******* 2021-11-12T05:36:25.415 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-11-12T05:36:25.416 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:25.441 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:25 +0000 (0:00:00.033) 0:02:13.295 ******* 2021-11-12T05:36:25.448 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-11-12T05:36:25.450 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:25.478 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:25 +0000 (0:00:00.037) 0:02:13.333 ******* 2021-11-12T05:36:25.485 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-11-12T05:36:25.487 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-11-12T05:36:25.488 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-CgRWXV5SwkTCR0h6oEAFo5cLBHMnvoo19PJzdg3PPcCpObJT41Oq9mdrH2HrBPYE'], 'uuids': ['eb6ba0c2-b128-446b-838e-0ffde8f94810']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.078419", "end": "2021-11-12 05:36:25.448817", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-CgRWXV5SwkTCR0h6oEAFo5cLBHMnvoo19PJzdg3PPcCpObJT41Oq9mdrH2HrBPYE"], "labels": [], "masters": [], "uuids": ["eb6ba0c2-b128-446b-838e-0ffde8f94810"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:25.370398", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0772017 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0772017 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:25.489 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-11-12T05:36:25.489 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:25.489 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-12T05:36:25.490 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (i 2021-11-12T05:36:25.491 INFO:teuthology.task.ansible.out:tem={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF', 'wwn-0x50000399ab801e93'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF-part1', 'wwn-0x50000399ab801e93-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab801e93', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I3K3PZF6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF", "wwn-0x50000399ab801e93"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I3K3PZF6XF-part1", "wwn-0x50000399ab801e93-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I3K3PZF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab801e93"}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:25.517 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:25 +0000 (0:00:00.038) 0:02:13.371 ******* 2021-11-12T05:36:25.547 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:25 +0000 (0:00:00.030) 0:02:13.402 ******* 2021-11-12T05:36:25.556 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-11-12T05:36:25.558 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Restart cachefilesd] ****************************************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:25.586 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:25 +0000 (0:00:00.039) 0:02:13.441 ******* 2021-11-12T05:36:25.618 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:25 +0000 (0:00:00.031) 0:02:13.473 ******* 2021-11-12T05:36:25.625 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-12T05:36:25.626 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-ACJ85G-VWJl-Rjfp-Kzgf-vT6l-k4eh-Sht7Tj', 'nvme-INTEL_SSDPEL1K375GA_PHKM913400GH375A', 'nvme-nvme.8086-50484b4d393133343030474833373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.025587", "end": "2021-11-12 05:36:25.568600", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-ACJ85G-VWJl-Rjfp-Kzgf-vT6l-k4eh-Sht7Tj", "nvme-INTEL_SSDPEL1K375GA_PHKM913400GH375A", "nvme-nvme.8086-50484b4d393133343030474833373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:25.543013", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0243615 s, 4.7 GB/s", "stderr_lines": ["1 2021-11-12T05:36:25.629 INFO:teuthology.task.ansible.out:10+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0243615 s, 4.7 GB/s"], "stdout": "", "stdout_lines": []} skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:25.630 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:25.674 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-11-12T05:36:25.676 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-11-12T05:36:25.703 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:25 +0000 (0:00:00.085) 0:02:13.558 ******* 2021-11-12T05:36:25.713 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-11-12T05:36:25.715 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-11-12T05:36:25.741 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:25 +0000 (0:00:00.037) 0:02:13.596 ******* 2021-11-12T05:36:25.749 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-11-12T05:36:25.750 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-12T05:36:25.778 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:25 +0000 (0:00:00.036) 0:02:13.632 ******* 2021-11-12T05:36:25.796 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-12T05:36:25.797 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-CgRWXV5SwkTCR0h6oEAFo5cLBHMnvoo1fcsH4plqkXb1DZwzG2Mur5mKsGs1FczO'], 'uuids': ['59ec9466-302f-42f7-92a2-f51100a69a51']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.077971", "end": "2021-11-12 05:36:25.764481", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-CgRWXV5SwkTCR0h6oEAFo5cLBHMnvoo1fcsH4plqkXb1DZwzG2Mur5mKsGs1FczO"], "labels": [], "masters": [], "uuids": ["59ec9466-302f-42f7-92a2-f51100a69a51"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:25.686510", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0767943 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0767943 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:25.799 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:25.821 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-11-12T05:36:25.823 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'block_used': 14049713, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045395, 'size_available': 925881937920, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187093, 'block_size': 4096, 'inode_available': 60867883}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045395, "block_size": 4096, "block_total": 240095108, "block_used": 14049713, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867883, "inode_total": 61054976, "inode_used": 187093, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881937920, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:25.846 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:25 +0000 (0:00:00.068) 0:02:13.701 ******* 2021-11-12T05:36:25.874 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-11-12T05:36:25.876 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} TASK [testnode : Combine list of non-root disks] ******************************* skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:25.900 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:25 +0000 (0:00:00.053) 0:02:13.754 ******* 2021-11-12T05:36:25.924 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:25 +0000 (0:00:00.024) 0:02:13.779 ******* 2021-11-12T05:36:25.953 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-12T05:36:25.955 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} TASK [testnode : set_fact] ***************************************************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:25.984 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:25 +0000 (0:00:00.059) 0:02:13.839 ******* 2021-11-12T05:36:25.999 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-12T05:36:26.000 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-CgRWXV5SwkTCR0h6oEAFo5cLBHMnvoo1r9LE9dFTv8gPpHKiTTcxEO4TtW5AJ1uS'], 'uuids': ['c1a616a2-5f64-4634-a0b0-3d040d20dcf4']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.079380", "end": "2021-11-12 05:36:25.956279", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-CgRWXV5SwkTCR0h6oEAFo5cLBHMnvoo1r9LE9dFTv8gPpHKiTTcxEO4TtW5AJ1uS"], "labels": [], "masters": [], "uuids": ["c1a616a2-5f64-4634-a0b0-3d040d20dcf4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:25.876899", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0781844 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0781844 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:26.003 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:26.029 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:26.054 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:26 +0000 (0:00:00.069) 0:02:13.909 ******* 2021-11-12T05:36:26.094 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-11-12T05:36:26.096 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:26.120 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:26 +0000 (0:00:00.066) 0:02:13.975 ******* 2021-11-12T05:36:26.127 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-12T05:36:26.128 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-12T05:36:26.150 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-11-12T05:36:26.152 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:26.177 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:26 +0000 (0:00:00.056) 0:02:14.031 ******* 2021-11-12T05:36:26.184 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-12T05:36:26.185 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-CgRWXV5SwkTCR0h6oEAFo5cLBHMnvoo13C21fyTenkbTVXxeTiLzVrJwO06VGUsw'], 'uuids': ['10e4626c-23f4-418a-9464-846670464841']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.078574", "end": "2021-11-12 05:36:26.142579", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-CgRWXV5SwkTCR0h6oEAFo5cLBHMnvoo13C21fyTenkbTVXxeTiLzVrJwO06VGUsw"], "labels": [], "masters": [], "uuids": ["10e4626c-23f4-418a-9464-846670464841"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-12 05:36:26.064005", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.077367 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.077367 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:26.198 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-11-12T05:36:26.199 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-11-12T05:36:26.224 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:26 +0000 (0:00:00.047) 0:02:14.079 ******* 2021-11-12T05:36:26.248 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:26 +0000 (0:00:00.023) 0:02:14.102 ******* 2021-11-12T05:36:26.256 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-11-12T05:36:26.258 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:26.284 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:26 +0000 (0:00:00.036) 0:02:14.139 ******* 2021-11-12T05:36:26.302 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-12T05:36:26.304 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-12T05:36:26.505 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-11-12T05:36:26.507 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} TASK [testnode : Create logical volume(s)] ************************************* changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-12T05:36:26.532 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:26 +0000 (0:00:00.247) 0:02:14.387 ******* 2021-11-12T05:36:26.584 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-11-12T05:36:26.585 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.155637", "end": "2021-11-12 05:36:26.545088", "rc": 0, "start": "2021-11-12 05:36:26.389451", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:26.611 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:26 +0000 (0:00:00.078) 0:02:14.465 ******* 2021-11-12T05:36:26.714 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-12T05:36:26.716 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-12T05:36:26.811 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-11-12T05:36:26.813 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.088527", "end": "2021-11-12 05:36:26.792877", "rc": 0, "start": "2021-11-12 05:36:26.704350", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:26.836 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:26 +0000 (0:00:00.225) 0:02:14.690 ******* 2021-11-12T05:36:26.844 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-11-12T05:36:26.846 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-11-12T05:36:26.872 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:26 +0000 (0:00:00.036) 0:02:14.727 ******* 2021-11-12T05:36:26.879 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-11-12T05:36:26.915 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:26 +0000 (0:00:00.042) 0:02:14.770 ******* 2021-11-12T05:36:26.924 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-12T05:36:26.926 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-12T05:36:26.947 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-11-12T05:36:26.949 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:26.973 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:26 +0000 (0:00:00.058) 0:02:14.828 ******* 2021-11-12T05:36:26.991 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-11-12T05:36:26.993 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"cache_update_time": 1636694779, "cache_updated": false, "changed": false} 2021-11-12T05:36:27.016 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:27 +0000 (0:00:00.042) 0:02:14.871 ******* 2021-11-12T05:36:27.026 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-11-12T05:36:27.028 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical volume(s)] ************************************* changed: [gibba016.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-12T05:36:27.057 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:27 +0000 (0:00:00.041) 0:02:14.912 ******* 2021-11-12T05:36:27.094 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-11-12T05:36:27.096 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:27.123 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:27 +0000 (0:00:00.065) 0:02:14.978 ******* 2021-11-12T05:36:27.153 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-11-12T05:36:27.155 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:27.177 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:27 +0000 (0:00:00.054) 0:02:15.032 ******* 2021-11-12T05:36:27.269 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-11-12T05:36:27.271 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.136780", "end": "2021-11-12 05:36:27.240504", "rc": 0, "start": "2021-11-12 05:36:27.103724", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-11-12T05:36:27.296 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:27 +0000 (0:00:00.119) 0:02:15.151 ******* 2021-11-12T05:36:27.304 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-11-12T05:36:27.306 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [testnode : Create logical volume(s)] ************************************* 2021-11-12T05:36:27.307 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-12T05:36:27.308 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-12T05:36:27.336 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:27 +0000 (0:00:00.039) 0:02:15.191 ******* 2021-11-12T05:36:27.343 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-11-12T05:36:27.345 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:27.370 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:27 +0000 (0:00:00.034) 0:02:15.225 ******* 2021-11-12T05:36:27.392 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-11-12T05:36:27.394 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'block_used': 14049728, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226045380, 'size_available': 925881876480, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187098, 'block_size': 4096, 'inode_available': 60867878}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226045380, "block_size": 4096, "block_total": 240095108, "block_used": 14049728, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867878, "inode_total": 61054976, "inode_used": 187098, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925881876480, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:27.418 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:27 +0000 (0:00:00.047) 0:02:15.272 ******* 2021-11-12T05:36:27.425 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-11-12T05:36:27.427 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:27.452 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:27 +0000 (0:00:00.034) 0:02:15.306 ******* 2021-11-12T05:36:27.464 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-11-12T05:36:27.466 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical volume(s)] ************************************* 2021-11-12T05:36:27.466 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-12T05:36:27.502 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:27 +0000 (0:00:00.050) 0:02:15.357 ******* 2021-11-12T05:36:27.549 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:27 +0000 (0:00:00.046) 0:02:15.403 ******* 2021-11-12T05:36:27.562 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:27.597 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:27 +0000 (0:00:00.048) 0:02:15.452 ******* 2021-11-12T05:36:27.625 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-12T05:36:27.627 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:27.650 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:27 +0000 (0:00:00.052) 0:02:15.505 ******* 2021-11-12T05:36:27.658 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-12T05:36:27.660 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-12T05:36:27.689 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:27 +0000 (0:00:00.039) 0:02:15.544 ******* 2021-11-12T05:36:27.697 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-11-12T05:36:27.699 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} TASK [testnode : Create volume_groups dict] ************************************ skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:27.699 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-12T05:36:27.732 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:27 +0000 (0:00:00.041) 0:02:15.586 ******* 2021-11-12T05:36:27.762 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:27 +0000 (0:00:00.030) 0:02:15.616 ******* 2021-11-12T05:36:27.770 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-11-12T05:36:27.772 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:27.798 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:27 +0000 (0:00:00.035) 0:02:15.652 ******* 2021-11-12T05:36:27.816 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-11-12T05:36:27.817 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-11-12T05:36:27.843 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:27 +0000 (0:00:00.045) 0:02:15.698 ******* 2021-11-12T05:36:27.852 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-11-12T05:36:27.853 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:27.879 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:27 +0000 (0:00:00.035) 0:02:15.733 ******* 2021-11-12T05:36:27.890 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-12T05:36:27.892 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-11-12T05:36:27.892 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"cache_update_time": 1636694779, "cache_updated": false, "changed": false} 2021-11-12T05:36:27.921 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:27 +0000 (0:00:00.042) 0:02:15.776 ******* 2021-11-12T05:36:27.923 INFO:teuthology.task.ansible.out: 2021-11-12T05:36:27.951 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:27.982 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:27 +0000 (0:00:00.060) 0:02:15.837 ******* 2021-11-12T05:36:27.990 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-12T05:36:27.992 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-12T05:36:28.057 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-12T05:36:28.058 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-12T05:36:28.059 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-12T05:36:28.145 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-12T05:36:28.158 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-12T05:36:28.159 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:28.199 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:28 +0000 (0:00:00.216) 0:02:16.054 ******* 2021-11-12T05:36:28.239 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:28.264 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:28 +0000 (0:00:00.065) 0:02:16.119 ******* 2021-11-12T05:36:28.273 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-11-12T05:36:28.274 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-11-12T05:36:28.301 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:28 +0000 (0:00:00.037) 0:02:16.156 ******* 2021-11-12T05:36:28.310 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-12T05:36:28.311 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-12T05:36:28.313 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:28.316 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-11-12T05:36:28.317 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:28.345 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:28 +0000 (0:00:00.043) 0:02:16.199 ******* 2021-11-12T05:36:28.370 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:28 +0000 (0:00:00.024) 0:02:16.224 ******* 2021-11-12T05:36:28.383 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create volume group(s)] *************************************** changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-11-12T05:36:28.408 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:28 +0000 (0:00:00.038) 0:02:16.263 ******* 2021-11-12T05:36:28.432 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:28 +0000 (0:00:00.024) 0:02:16.287 ******* 2021-11-12T05:36:28.441 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-11-12T05:36:28.442 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical volume(s)] ************************************* changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-12T05:36:28.473 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:28 +0000 (0:00:00.040) 0:02:16.327 ******* 2021-11-12T05:36:28.481 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-11-12T05:36:28.482 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-11-12T05:36:28.509 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:28 +0000 (0:00:00.036) 0:02:16.364 ******* 2021-11-12T05:36:28.516 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-11-12T05:36:28.518 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:28.545 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:28 +0000 (0:00:00.034) 0:02:16.398 ******* 2021-11-12T05:36:28.552 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [gibba016.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-11-12T05:36:28.586 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:28 +0000 (0:00:00.042) 0:02:16.441 ******* 2021-11-12T05:36:28.596 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-11-12T05:36:28.598 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-11-12 05:32:51 UTC", "ActiveEnterTimestampMonotonic": "12863225", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target system.slice systemd-tmpfiles-setup.service sysinit.target network.target systemd-journald.socket -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-11-12 05:32:50 UTC", "AssertTimestampMonotonic": "12743003", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-11-12 05:32:50 UTC", "ConditionTimestampMonotonic": "12743002", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": 2021-11-12T05:36:28.602 INFO:teuthology.task.ansible.out:"/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "944", "ExecMainStartTimestamp": "Fri 2021-11-12 05:32:51 UTC", "ExecMainStartTimestampMonotonic": "12863217", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-11-12 05:32:50 UTC", "InactiveExitTimestampMonotonic": "12743632", "InvocationID": "45199a5a464749c5af38acacf67989f2", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Limi 2021-11-12T05:36:28.604 INFO:teuthology.task.ansible.out:tCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "944", "MemoryAccounting": "yes", "MemoryCurrent": "3719168", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "Requir 2021-11-12T05:36:28.606 INFO:teuthology.task.ansible.out:esMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-11-12 05:32:51 UTC", "StateChangeTimestampMonotonic": "12863225", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38346", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-12T05:36:28.785 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:28 +0000 (0:00:00.198) 0:02:16.639 ******* 2021-11-12T05:36:28.793 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-11-12T05:36:28.795 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-11-12T05:36:28.822 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:28 +0000 (0:00:00.037) 0:02:16.676 ******* 2021-11-12T05:36:28.831 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-11-12T05:36:28.833 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => {"changed": true} TASK [testnode : set_fact] ***************************************************** ok: [gibba005.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-11-12T05:36:28.833 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-12T05:36:28.864 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:28 +0000 (0:00:00.042) 0:02:16.719 ******* 2021-11-12T05:36:28.889 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:28 +0000 (0:00:00.024) 0:02:16.743 ******* 2021-11-12T05:36:28.915 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:28 +0000 (0:00:00.026) 0:02:16.769 ******* 2021-11-12T05:36:28.922 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-11-12T05:36:28.923 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-11-12T05:36:28.925 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [gibba005.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-11-12T05:36:28.926 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-12T05:36:28.958 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:28 +0000 (0:00:00.043) 0:02:16.813 ******* 2021-11-12T05:36:28.984 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:28 +0000 (0:00:00.025) 0:02:16.839 ******* 2021-11-12T05:36:28.994 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-11-12T05:36:28.996 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:29.024 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:29 +0000 (0:00:00.039) 0:02:16.878 ******* 2021-11-12T05:36:29.043 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-11-12T05:36:29.045 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-11-12T05:36:29.074 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:29 +0000 (0:00:00.050) 0:02:16.929 ******* 2021-11-12T05:36:29.081 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-11-12T05:36:29.082 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-11-12T05:36:29.113 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:29 +0000 (0:00:00.038) 0:02:16.967 ******* 2021-11-12T05:36:29.133 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-11-12T05:36:29.135 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true} 2021-11-12T05:36:29.158 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:29 +0000 (0:00:00.045) 0:02:17.013 ******* 2021-11-12T05:36:29.165 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-11-12T05:36:29.167 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:29.193 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:29 +0000 (0:00:00.034) 0:02:17.047 ******* 2021-11-12T05:36:29.211 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-12T05:36:29.212 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-12T05:36:29.236 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-11-12T05:36:29.237 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:29.269 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:29 +0000 (0:00:00.076) 0:02:17.124 ******* 2021-11-12T05:36:29.287 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-12T05:36:29.290 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-12T05:36:29.299 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-11-12T05:36:29.301 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:29.308 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-12T05:36:29.327 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:29 +0000 (0:00:00.057) 0:02:17.181 ******* 2021-11-12T05:36:29.347 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-11-12T05:36:29.349 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-11-12T05:36:29.373 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:29 +0000 (0:00:00.045) 0:02:17.227 ******* 2021-11-12T05:36:29.381 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-11-12T05:36:29.383 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:29.411 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:29 +0000 (0:00:00.038) 0:02:17.266 ******* 2021-11-12T05:36:29.419 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-12T05:36:29.420 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-12T05:36:29.420 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-11-12T05:36:29.421 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:29.447 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:29 +0000 (0:00:00.036) 0:02:17.302 ******* 2021-11-12T05:36:29.478 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-12T05:36:29.479 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} TASK [testnode : Install cachefilesd conf file] ******************************** 2021-11-12T05:36:29.480 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:29.504 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:29 +0000 (0:00:00.056) 0:02:17.359 ******* 2021-11-12T05:36:29.512 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-12T05:36:29.513 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:29.542 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:29 +0000 (0:00:00.037) 0:02:17.396 ******* 2021-11-12T05:36:29.548 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-11-12T05:36:29.549 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:29.550 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-11-12T05:36:29.551 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-11-12T05:36:29.576 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:29 +0000 (0:00:00.034) 0:02:17.431 ******* 2021-11-12T05:36:29.599 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:29 +0000 (0:00:00.021) 0:02:17.453 ******* 2021-11-12T05:36:29.607 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:29.634 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:29 +0000 (0:00:00.035) 0:02:17.488 ******* 2021-11-12T05:36:29.641 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-11-12T05:36:29.642 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:29.674 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:29 +0000 (0:00:00.040) 0:02:17.529 ******* 2021-11-12T05:36:29.686 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-11-12T05:36:29.688 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical volume(s)] ************************************* changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-12T05:36:29.722 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:29 +0000 (0:00:00.047) 0:02:17.577 ******* 2021-11-12T05:36:29.740 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-11-12T05:36:29.742 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-11-12T05:36:29.769 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:29 +0000 (0:00:00.046) 0:02:17.623 ******* 2021-11-12T05:36:29.800 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-11-12T05:36:29.800 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-11-12T05:36:29.835 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:29 +0000 (0:00:00.066) 0:02:17.690 ******* 2021-11-12T05:36:29.843 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-11-12T05:36:29.845 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-11-12T05:36:29.874 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:29 +0000 (0:00:00.038) 0:02:17.728 ******* 2021-11-12T05:36:29.913 INFO:teuthology.task.ansible.out: 2021-11-12T05:36:29.915 INFO:teuthology.task.ansible.out:TASK [testnode : Install python-pip on apt based systems.] ********************* ok: [gibba005.front.sepia.ceph.com] => {"cache_update_time": 1636694779, "cache_updated": false, "changed": false} TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [gibba044.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-11-12T05:36:29.943 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:29 +0000 (0:00:00.069) 0:02:17.798 ******* 2021-11-12T05:36:29.972 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:29 +0000 (0:00:00.028) 0:02:17.827 ******* 2021-11-12T05:36:29.980 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-11-12T05:36:29.981 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-11-12T05:36:30.010 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:30 +0000 (0:00:00.037) 0:02:17.865 ******* 2021-11-12T05:36:30.018 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-11-12T05:36:30.020 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:30.047 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:30 +0000 (0:00:00.037) 0:02:17.902 ******* 2021-11-12T05:36:30.065 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-11-12T05:36:30.067 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-11-12T05:36:30.093 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:30 +0000 (0:00:00.045) 0:02:17.947 ******* 2021-11-12T05:36:30.101 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-12T05:36:30.103 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-12T05:36:30.136 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [gibba044.front.sepia.ceph.com] => {"changed": true} 2021-11-12T05:36:30.173 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:30 +0000 (0:00:00.080) 0:02:18.028 ******* 2021-11-12T05:36:30.183 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-11-12T05:36:30.184 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-11-12T05:36:30.212 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:30 +0000 (0:00:00.038) 0:02:18.066 ******* 2021-11-12T05:36:30.284 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-11-12T05:36:30.286 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-11-12T05:36:30.310 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:30 +0000 (0:00:00.098) 0:02:18.165 ******* 2021-11-12T05:36:30.350 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-11-12T05:36:30.352 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-11-12T05:36:30.387 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:30 +0000 (0:00:00.076) 0:02:18.241 ******* 2021-11-12T05:36:30.396 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-11-12T05:36:30.397 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-11-12T05:36:30.425 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:30 +0000 (0:00:00.038) 0:02:18.279 ******* 2021-11-12T05:36:30.432 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-11-12T05:36:30.434 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:30.462 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:30 +0000 (0:00:00.037) 0:02:18.317 ******* 2021-11-12T05:36:30.469 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-12T05:36:30.471 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-12T05:36:30.501 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:30 +0000 (0:00:00.038) 0:02:18.355 ******* 2021-11-12T05:36:30.509 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-11-12T05:36:30.511 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:30.537 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:30 +0000 (0:00:00.036) 0:02:18.392 ******* 2021-11-12T05:36:30.564 INFO:teuthology.task.ansible.out: 2021-11-12T05:36:30.565 INFO:teuthology.task.ansible.out:TASK [testnode : Restart cachefilesd] ****************************************** 2021-11-12T05:36:30.566 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:30.591 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:30 +0000 (0:00:00.053) 0:02:18.445 ******* 2021-11-12T05:36:30.597 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-11-12T05:36:30.599 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} TASK [testnode : Upload CPAN config for root.] ********************************* ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-11-12T05:36:30.627 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:30 +0000 (0:00:00.036) 0:02:18.482 ******* 2021-11-12T05:36:30.651 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:30 +0000 (0:00:00.023) 0:02:18.506 ******* 2021-11-12T05:36:30.659 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-11-12T05:36:30.660 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} TASK [testnode : Restart cachefilesd] ****************************************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:30.687 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:30 +0000 (0:00:00.035) 0:02:18.542 ******* 2021-11-12T05:36:30.710 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:30 +0000 (0:00:00.022) 0:02:18.564 ******* 2021-11-12T05:36:30.813 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-12T05:36:30.815 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-12T05:36:30.836 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-11-12T05:36:30.838 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-11-12T05:36:30.861 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:30 +0000 (0:00:00.151) 0:02:18.716 ******* 2021-11-12T05:36:30.869 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** ok: [gibba016.front.sepia.ceph.com] => {"cache_update_time": 1636694883, "cache_updated": false, "changed": false} 2021-11-12T05:36:30.896 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:30 +0000 (0:00:00.034) 0:02:18.750 ******* 2021-11-12T05:36:30.935 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-12T05:36:30.936 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-12T05:36:30.989 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-11-12T05:36:30.991 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-11-12T05:36:31.025 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:31 +0000 (0:00:00.128) 0:02:18.879 ******* 2021-11-12T05:36:31.033 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-12T05:36:31.035 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-12T05:36:31.090 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-11-12T05:36:31.092 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1636694933, "cache_updated": false, "changed": false} 2021-11-12T05:36:31.116 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:31 +0000 (0:00:00.091) 0:02:18.971 ******* 2021-11-12T05:36:31.125 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-12T05:36:31.126 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-12T05:36:31.128 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:31.131 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-11-12T05:36:31.132 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.098489", "end": "2021-11-12 05:36:31.113243", "rc": 0, "start": "2021-11-12 05:36:31.014754", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-11-12T05:36:31.158 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:31 +0000 (0:00:00.041) 0:02:19.012 ******* 2021-11-12T05:36:31.183 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:31 +0000 (0:00:00.024) 0:02:19.037 ******* 2021-11-12T05:36:31.189 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-11-12T05:36:31.191 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:31.217 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:31 +0000 (0:00:00.034) 0:02:19.071 ******* 2021-11-12T05:36:31.224 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-11-12T05:36:31.226 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:31.251 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:31 +0000 (0:00:00.033) 0:02:19.105 ******* 2021-11-12T05:36:31.258 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-11-12T05:36:31.260 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:31.283 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:31 +0000 (0:00:00.032) 0:02:19.138 ******* 2021-11-12T05:36:31.290 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-11-12T05:36:31.292 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:31.318 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:31 +0000 (0:00:00.034) 0:02:19.173 ******* 2021-11-12T05:36:31.336 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-11-12T05:36:31.338 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-11-12T05:36:31.364 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:31 +0000 (0:00:00.045) 0:02:19.218 ******* 2021-11-12T05:36:31.370 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-11-12T05:36:31.372 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.119278", "end": "2021-11-12 05:36:31.350410", "rc": 0, "start": "2021-11-12 05:36:31.231132", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-11-12T05:36:31.399 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:31 +0000 (0:00:00.035) 0:02:19.254 ******* 2021-11-12T05:36:31.414 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-11-12T05:36:31.415 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-11-12T05:36:31.441 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:31 +0000 (0:00:00.042) 0:02:19.296 ******* 2021-11-12T05:36:31.449 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-11-12T05:36:31.451 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:31.476 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:31 +0000 (0:00:00.034) 0:02:19.330 ******* 2021-11-12T05:36:31.483 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-11-12T05:36:31.485 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-11-12T05:36:31.518 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:31 +0000 (0:00:00.042) 0:02:19.373 ******* 2021-11-12T05:36:31.526 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-11-12T05:36:31.527 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:31.553 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:31 +0000 (0:00:00.034) 0:02:19.407 ******* 2021-11-12T05:36:31.645 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-11-12T05:36:31.648 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-11-12T05:36:31.672 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:31 +0000 (0:00:00.119) 0:02:19.527 ******* 2021-11-12T05:36:31.679 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-11-12T05:36:31.681 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"changed": true} 2021-11-12T05:36:31.707 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:31 +0000 (0:00:00.035) 0:02:19.562 ******* 2021-11-12T05:36:31.739 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-11-12T05:36:31.741 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"cache_update_time": 1636694883, "cache_updated": false, "changed": false} 2021-11-12T05:36:31.767 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:31 +0000 (0:00:00.059) 0:02:19.622 ******* 2021-11-12T05:36:31.797 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-11-12T05:36:31.798 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:31.822 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:31 +0000 (0:00:00.054) 0:02:19.676 ******* 2021-11-12T05:36:31.882 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-11-12T05:36:31.884 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-11-12T05:36:31.910 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:31 +0000 (0:00:00.088) 0:02:19.765 ******* 2021-11-12T05:36:31.938 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-11-12T05:36:31.940 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:31.962 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:31 +0000 (0:00:00.051) 0:02:19.817 ******* 2021-11-12T05:36:31.980 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-11-12T05:36:31.982 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1636694933, "cache_updated": false, "changed": false} 2021-11-12T05:36:32.010 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:32 +0000 (0:00:00.047) 0:02:19.865 ******* 2021-11-12T05:36:32.021 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-11-12T05:36:32.021 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:32.056 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:32 +0000 (0:00:00.046) 0:02:19.911 ******* 2021-11-12T05:36:32.065 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-11-12T05:36:32.067 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:32.102 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:32 +0000 (0:00:00.046) 0:02:19.957 ******* 2021-11-12T05:36:32.111 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-11-12T05:36:32.114 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-11-12T05:36:32.114 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** ok: [gibba044.front.sepia.ceph.com] => {"cache_update_time": 1636694984, "cache_updated": false, "changed": false} 2021-11-12T05:36:32.140 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:32 +0000 (0:00:00.037) 0:02:19.995 ******* 2021-11-12T05:36:32.174 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:32 +0000 (0:00:00.033) 0:02:20.028 ******* 2021-11-12T05:36:32.198 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:32 +0000 (0:00:00.024) 0:02:20.053 ******* 2021-11-12T05:36:32.206 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-11-12T05:36:32.208 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create the chrony.conf file] ********************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:32.235 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:32 +0000 (0:00:00.037) 0:02:20.090 ******* 2021-11-12T05:36:32.260 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:32 +0000 (0:00:00.024) 0:02:20.115 ******* 2021-11-12T05:36:32.342 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-11-12T05:36:32.344 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-11-12T05:36:32.371 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:32 +0000 (0:00:00.110) 0:02:20.226 ******* 2021-11-12T05:36:32.379 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-11-12T05:36:32.381 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} TASK [testnode : Add CPAN config directory for the teuthology user.] *********** ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-11-12T05:36:32.409 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:32 +0000 (0:00:00.037) 0:02:20.263 ******* 2021-11-12T05:36:32.435 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:32 +0000 (0:00:00.026) 0:02:20.290 ******* 2021-11-12T05:36:32.443 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-11-12T05:36:32.444 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:32.445 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-11-12T05:36:32.446 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-11-12 05:33:00 UTC", "ActiveEnterTimestampMonotonic": "13128548", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket system.slice basic.target network.target sysinit.target -.mount systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-11-12 05:33:00 UTC", "AssertTimestampMonotonic": "12862956", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-11-12 05:33:00 UTC", "ConditionTimestampMonotonic": "12862956", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": 2021-11-12T05:36:32.448 INFO:teuthology.task.ansible.out:"/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "951", "ExecMainStartTimestamp": "Fri 2021-11-12 05:33:00 UTC", "ExecMainStartTimestampMonotonic": "13128541", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-11-12 05:33:00 UTC", "InactiveExitTimestampMonotonic": "12863624", "InvocationID": "c27f358fb52649c2b10126bf8203a0b4", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Limi 2021-11-12T05:36:32.449 INFO:teuthology.task.ansible.out:tCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "951", "MemoryAccounting": "yes", "MemoryCurrent": "3960832", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "Requir 2021-11-12T05:36:32.451 INFO:teuthology.task.ansible.out:esMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-11-12 05:33:00 UTC", "StateChangeTimestampMonotonic": "13128548", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38346", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-12T05:36:32.474 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:32 +0000 (0:00:00.039) 0:02:20.329 ******* 2021-11-12T05:36:32.497 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:32 +0000 (0:00:00.023) 0:02:20.352 ******* 2021-11-12T05:36:32.505 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-11-12T05:36:32.506 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.179400", "end": "2021-11-12 05:36:32.468508", "rc": 0, "start": "2021-11-12 05:36:32.289108", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} TASK [testnode : set_fact] ***************************************************** ok: [gibba016.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-11-12T05:36:32.534 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:32 +0000 (0:00:00.036) 0:02:20.388 ******* 2021-11-12T05:36:32.558 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:32 +0000 (0:00:00.024) 0:02:20.413 ******* 2021-11-12T05:36:32.566 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-11-12T05:36:32.568 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-11-12T05:36:32.601 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:32 +0000 (0:00:00.042) 0:02:20.455 ******* 2021-11-12T05:36:32.610 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-12T05:36:32.611 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:32.638 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:32 +0000 (0:00:00.037) 0:02:20.493 ******* 2021-11-12T05:36:32.663 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:32 +0000 (0:00:00.024) 0:02:20.518 ******* 2021-11-12T05:36:32.670 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-11-12T05:36:32.672 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-11-12 05:33:04 UTC", "ActiveEnterTimestampMonotonic": "12701252", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service basic.target network.target sysinit.target systemd-journald.socket -.mount system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-11-12 05:33:04 UTC", "AssertTimestampMonotonic": "12510854", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-11-12 05:33:04 UTC", "ConditionTimestampMonotonic": "12510853", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": 2021-11-12T05:36:32.674 INFO:teuthology.task.ansible.out:"/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "948", "ExecMainStartTimestamp": "Fri 2021-11-12 05:33:04 UTC", "ExecMainStartTimestampMonotonic": "12701244", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-11-12 05:33:04 UTC", "InactiveExitTimestampMonotonic": "12511445", "InvocationID": "00b58c3a59e2440685bcc8e79c21ef1a", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Limi 2021-11-12T05:36:32.676 INFO:teuthology.task.ansible.out:tCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "948", "MemoryAccounting": "yes", "MemoryCurrent": "4042752", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "Requir 2021-11-12T05:36:32.677 INFO:teuthology.task.ansible.out:esMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-11-12 05:33:04 UTC", "StateChangeTimestampMonotonic": "12701252", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38346", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:32.700 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:32 +0000 (0:00:00.037) 0:02:20.555 ******* 2021-11-12T05:36:32.728 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:32 +0000 (0:00:00.027) 0:02:20.582 ******* 2021-11-12T05:36:32.738 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:32.767 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:32 +0000 (0:00:00.039) 0:02:20.622 ******* 2021-11-12T05:36:32.773 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-12T05:36:32.775 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-11-12T05:36:32.801 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:32 +0000 (0:00:00.033) 0:02:20.656 ******* 2021-11-12T05:36:32.808 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-11-12T05:36:32.810 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false} 2021-11-12T05:36:32.835 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:32 +0000 (0:00:00.034) 0:02:20.690 ******* 2021-11-12T05:36:32.844 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-12T05:36:32.846 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-11-12T05:36:32.875 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:32 +0000 (0:00:00.039) 0:02:20.729 ******* 2021-11-12T05:36:32.883 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-11-12T05:36:32.884 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp1s0f0"}, "changed": false} 2021-11-12T05:36:32.909 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:32 +0000 (0:00:00.034) 0:02:20.764 ******* 2021-11-12T05:36:32.918 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-11-12T05:36:32.920 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:32.947 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:32 +0000 (0:00:00.037) 0:02:20.802 ******* 2021-11-12T05:36:32.954 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-11-12T05:36:32.956 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-11-12T05:36:32.983 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:32 +0000 (0:00:00.035) 0:02:20.838 ******* 2021-11-12T05:36:33.055 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-11-12T05:36:33.057 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1636694720.019375, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1636694720.015375, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 158, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1636694720.015375, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1582242096", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-11-12T05:36:33.090 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:33 +0000 (0:00:00.106) 0:02:20.945 ******* 2021-11-12T05:36:33.194 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-11-12T05:36:33.196 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"cache_update_time": 1636694984, "cache_updated": false, "changed": false} 2021-11-12T05:36:33.222 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:33 +0000 (0:00:00.132) 0:02:21.077 ******* 2021-11-12T05:36:33.252 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-11-12T05:36:33.254 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:33.278 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:33 +0000 (0:00:00.055) 0:02:21.132 ******* 2021-11-12T05:36:33.295 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-11-12T05:36:33.297 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-11-12T05:36:33.323 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:33 +0000 (0:00:00.045) 0:02:21.178 ******* 2021-11-12T05:36:33.481 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-11-12T05:36:33.509 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:33 +0000 (0:00:00.185) 0:02:21.364 ******* 2021-11-12T05:36:33.538 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-11-12T05:36:33.540 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [gibba005.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-11-12T05:36:33.564 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:33 +0000 (0:00:00.054) 0:02:21.419 ******* 2021-11-12T05:36:33.587 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:33 +0000 (0:00:00.023) 0:02:21.442 ******* 2021-11-12T05:36:33.594 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-11-12T05:36:33.596 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:33.621 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:33 +0000 (0:00:00.033) 0:02:21.476 ******* 2021-11-12T05:36:33.630 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-11-12T05:36:33.631 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:33.658 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:33 +0000 (0:00:00.037) 0:02:21.513 ******* 2021-11-12T05:36:33.708 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-11-12T05:36:33.710 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"cache_update_time": 1636694883, "cache_updated": false, "changed": false} 2021-11-12T05:36:33.734 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:33 +0000 (0:00:00.076) 0:02:21.589 ******* 2021-11-12T05:36:33.753 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-11-12T05:36:33.755 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-11-12T05:36:33.778 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:33 +0000 (0:00:00.043) 0:02:21.633 ******* 2021-11-12T05:36:33.785 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-11-12T05:36:33.787 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** ok: [gibba015.front.sepia.ceph.com] => {"cache_update_time": 1636694831, "cache_updated": false, "changed": false} 2021-11-12T05:36:33.813 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:33 +0000 (0:00:00.034) 0:02:21.668 ******* 2021-11-12T05:36:33.845 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:33 +0000 (0:00:00.032) 0:02:21.700 ******* 2021-11-12T05:36:33.854 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-11-12T05:36:33.856 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-11-12 05:33:13 UTC", "ActiveEnterTimestampMonotonic": "12990910", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target -.mount systemd-tmpfiles-setup.service system.slice sysinit.target systemd-journald.socket basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-11-12 05:33:13 UTC", "AssertTimestampMonotonic": "12799201", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-11-12 05:33:13 UTC", "ConditionTimestampMonotonic": "12799200", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": 2021-11-12T05:36:33.858 INFO:teuthology.task.ansible.out:"/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "959", "ExecMainStartTimestamp": "Fri 2021-11-12 05:33:13 UTC", "ExecMainStartTimestampMonotonic": "12990901", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-11-12 05:33:13 UTC", "InactiveExitTimestampMonotonic": "12799835", "InvocationID": "e070ddac9c374bbcadcbbff0285386da", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Limi 2021-11-12T05:36:33.859 INFO:teuthology.task.ansible.out:tCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "959", "MemoryAccounting": "yes", "MemoryCurrent": "3997696", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "Requir 2021-11-12T05:36:33.861 INFO:teuthology.task.ansible.out:esMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-11-12 05:33:13 UTC", "StateChangeTimestampMonotonic": "12990910", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38346", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-12T05:36:33.887 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:33 +0000 (0:00:00.041) 0:02:21.742 ******* 2021-11-12T05:36:33.916 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-12T05:36:33.918 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-11-12T05:36:33.953 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:33 +0000 (0:00:00.065) 0:02:21.808 ******* 2021-11-12T05:36:33.962 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-11-12T05:36:33.966 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} TASK [testnode : Install python-pip on apt based systems.] ********************* ok: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1636694933, "cache_updated": false, "changed": false} 2021-11-12T05:36:33.994 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:33 +0000 (0:00:00.040) 0:02:21.849 ******* 2021-11-12T05:36:34.016 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:34 +0000 (0:00:00.022) 0:02:21.871 ******* 2021-11-12T05:36:34.024 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-11-12T05:36:34.025 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} TASK [testnode : set_fact] ***************************************************** ok: [gibba044.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-11-12T05:36:34.026 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:34.053 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:34 +0000 (0:00:00.037) 0:02:21.908 ******* 2021-11-12T05:36:34.080 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:34 +0000 (0:00:00.025) 0:02:21.934 ******* 2021-11-12T05:36:34.108 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:34 +0000 (0:00:00.028) 0:02:21.963 ******* 2021-11-12T05:36:34.118 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-11-12T05:36:34.119 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [gibba005.front.sepia.ceph.com] => (item=docker0) => {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:34.121 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.129304", "end": "2021-11-12 05:36:34.072234", "rc": 0, "start": "2021-11-12 05:36:33.942930", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-11-12T05:36:34.121 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=enp1s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:34.122 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=enp1s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:34.122 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:34.122 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:34.123 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:34.151 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:34 +0000 (0:00:00.042) 0:02:22.006 ******* 2021-11-12T05:36:34.175 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:34 +0000 (0:00:00.023) 0:02:22.029 ******* 2021-11-12T05:36:34.200 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:34 +0000 (0:00:00.025) 0:02:22.055 ******* 2021-11-12T05:36:34.208 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-11-12T05:36:34.210 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Define net_to_configure var] ********************************** skipping: [gibba005.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'docker0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:34.210 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:34.211 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:34.240 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:34 +0000 (0:00:00.039) 0:02:22.095 ******* 2021-11-12T05:36:34.248 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:34.249 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-11-12T05:36:34.249 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:34.249 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** skipping: [gibba005.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:34.251 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:34.288 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:34 +0000 (0:00:00.048) 0:02:22.143 ******* 2021-11-12T05:36:34.321 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:34 +0000 (0:00:00.032) 0:02:22.176 ******* 2021-11-12T05:36:34.330 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-12T05:36:34.331 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:34.360 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:34 +0000 (0:00:00.038) 0:02:22.214 ******* 2021-11-12T05:36:34.368 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-11-12T05:36:34.370 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:34.398 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:34 +0000 (0:00:00.037) 0:02:22.252 ******* 2021-11-12T05:36:34.424 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:34 +0000 (0:00:00.024) 0:02:22.277 ******* 2021-11-12T05:36:34.432 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-11-12T05:36:34.433 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:34.461 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:34 +0000 (0:00:00.038) 0:02:22.316 ******* 2021-11-12T05:36:34.470 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-11-12T05:36:34.498 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:34 +0000 (0:00:00.037) 0:02:22.353 ******* 2021-11-12T05:36:34.507 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-11-12T05:36:34.509 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:34.538 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:34 +0000 (0:00:00.039) 0:02:22.393 ******* 2021-11-12T05:36:34.567 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-11-12T05:36:34.569 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:34.592 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:34 +0000 (0:00:00.053) 0:02:22.447 ******* 2021-11-12T05:36:34.620 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:34.647 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:34 +0000 (0:00:00.054) 0:02:22.502 ******* 2021-11-12T05:36:34.674 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-11-12T05:36:34.676 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:34.701 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:34 +0000 (0:00:00.054) 0:02:22.556 ******* 2021-11-12T05:36:34.740 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-11-12T05:36:34.742 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:34.766 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:34 +0000 (0:00:00.065) 0:02:22.621 ******* 2021-11-12T05:36:34.774 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-11-12T05:36:34.776 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-11-12T05:36:34.808 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:34 +0000 (0:00:00.041) 0:02:22.663 ******* 2021-11-12T05:36:34.816 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-11-12T05:36:34.818 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:34.844 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:34 +0000 (0:00:00.035) 0:02:22.698 ******* 2021-11-12T05:36:34.852 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-11-12T05:36:34.854 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"cache_update_time": 1636694831, "cache_updated": false, "changed": false} 2021-11-12T05:36:34.881 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:34 +0000 (0:00:00.036) 0:02:22.735 ******* 2021-11-12T05:36:34.908 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:34.933 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:34 +0000 (0:00:00.052) 0:02:22.788 ******* 2021-11-12T05:36:34.995 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-12T05:36:34.997 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.002594", "end": "2021-11-12 05:36:34.963279", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-11-12 05:36:34.960685", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:35.095 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.001787", "end": "2021-11-12 05:36:35.068786", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-11-12 05:36:35.066999", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:35.194 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-11-12T05:36:35.195 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-11-12T05:36:35.230 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:35 +0000 (0:00:00.296) 0:02:23.085 ******* 2021-11-12T05:36:35.242 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-12T05:36:35.243 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.001643", "end": "2021-11-12 05:36:35.182908", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-11-12 05:36:35.181265", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:35.255 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-11-12T05:36:35.257 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:35.281 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:35 +0000 (0:00:00.050) 0:02:23.136 ******* 2021-11-12T05:36:35.288 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-11-12T05:36:35.290 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"cache_update_time": 1636694984, "cache_updated": false, "changed": false} 2021-11-12T05:36:35.315 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:35 +0000 (0:00:00.034) 0:02:23.170 ******* 2021-11-12T05:36:35.343 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-12T05:36:35.345 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.026877", "end": "2021-11-12 05:36:35.316163", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-11-12 05:36:35.289286", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:35.347 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:35.371 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:35 +0000 (0:00:00.056) 0:02:23.226 ******* 2021-11-12T05:36:35.395 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:35 +0000 (0:00:00.023) 0:02:23.250 ******* 2021-11-12T05:36:35.402 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-11-12T05:36:35.431 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:35 +0000 (0:00:00.034) 0:02:23.284 ******* 2021-11-12T05:36:35.456 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-11-12T05:36:35.458 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-11-12 05:32:54 UTC", "ActiveEnterTimestampMonotonic": "12830081", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket network.target -.mount basic.target sysinit.target systemd-tmpfiles-setup.service system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-11-12 05:32:53 UTC", "AssertTimestampMonotonic": "12647073", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-11-12 05:32:53 UTC", "ConditionTimestampMonotonic": "12647072", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": 2021-11-12T05:36:35.459 INFO:teuthology.task.ansible.out:"/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "956", "ExecMainStartTimestamp": "Fri 2021-11-12 05:32:54 UTC", "ExecMainStartTimestampMonotonic": "12830072", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2021-11-12 05:32:53 UTC", "InactiveExitTimestampMonotonic": "12647770", "InvocationID": "b57d57acb1d84dadb24fb530c62d74dc", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Limi 2021-11-12T05:36:35.461 INFO:teuthology.task.ansible.out:tCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127820", "LimitNPROCSoft": "127820", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "956", "MemoryAccounting": "yes", "MemoryCurrent": "3784704", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "Requir 2021-11-12T05:36:35.462 INFO:teuthology.task.ansible.out:esMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-11-12 05:32:54 UTC", "StateChangeTimestampMonotonic": "12830081", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38346", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-12T05:36:35.493 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:35 +0000 (0:00:00.063) 0:02:23.348 ******* 2021-11-12T05:36:35.502 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-11-12T05:36:35.504 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:35.530 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [gibba015.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-11-12T05:36:35.532 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-11-12T05:36:35.565 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:35 +0000 (0:00:00.071) 0:02:23.420 ******* 2021-11-12T05:36:35.588 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:35 +0000 (0:00:00.022) 0:02:23.443 ******* 2021-11-12T05:36:35.607 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-12T05:36:35.609 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-11-12T05:36:35.634 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:35 +0000 (0:00:00.045) 0:02:23.489 ******* 2021-11-12T05:36:35.662 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-11-12T05:36:35.664 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:35.686 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:35 +0000 (0:00:00.052) 0:02:23.541 ******* 2021-11-12T05:36:35.909 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-11-12T05:36:35.910 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-11-12T05:36:35.937 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:35 +0000 (0:00:00.250) 0:02:23.792 ******* 2021-11-12T05:36:36.294 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-11-12T05:36:36.296 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-11-12T05:36:36.321 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:36 +0000 (0:00:00.384) 0:02:24.176 ******* 2021-11-12T05:36:36.469 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-11-12T05:36:36.496 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:36 +0000 (0:00:00.174) 0:02:24.351 ******* 2021-11-12T05:36:36.673 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-11-12T05:36:36.675 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"changed": false} 2021-11-12T05:36:36.708 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:36 +0000 (0:00:00.211) 0:02:24.562 ******* 2021-11-12T05:36:36.727 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-11-12T05:36:36.729 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"cache_update_time": 1636694831, "cache_updated": false, "changed": false} 2021-11-12T05:36:36.755 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:36 +0000 (0:00:00.047) 0:02:24.609 ******* 2021-11-12T05:36:36.764 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-11-12T05:36:36.766 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp1s0f0"}, "changed": false} 2021-11-12T05:36:36.790 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:36 +0000 (0:00:00.035) 0:02:24.645 ******* 2021-11-12T05:36:36.800 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-11-12T05:36:36.801 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:36.827 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:36 +0000 (0:00:00.036) 0:02:24.682 ******* 2021-11-12T05:36:36.879 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-11-12T05:36:36.880 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false} 2021-11-12T05:36:36.906 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:36 +0000 (0:00:00.078) 0:02:24.760 ******* 2021-11-12T05:36:36.925 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-11-12T05:36:36.927 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1636694722.7417212, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1636694722.7377212, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 158, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1636694722.7377212, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1582242096", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-11-12T05:36:36.952 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:36 +0000 (0:00:00.046) 0:02:24.807 ******* 2021-11-12T05:36:36.961 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-11-12T05:36:36.963 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp1s0f0"}, "changed": false} 2021-11-12T05:36:36.988 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:36 +0000 (0:00:00.035) 0:02:24.843 ******* 2021-11-12T05:36:36.996 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-11-12T05:36:36.998 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-11-12T05:36:37.025 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:37 +0000 (0:00:00.036) 0:02:24.880 ******* 2021-11-12T05:36:37.117 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-11-12T05:36:37.119 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "msg": ""} TASK [testnode : Check for presence of /etc/network/interfaces] **************** ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1636694719.093621, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1636694719.089621, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 158, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1636694719.089621, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1582242096", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-11-12T05:36:37.146 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:37 +0000 (0:00:00.121) 0:02:25.001 ******* 2021-11-12T05:36:37.171 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:37 +0000 (0:00:00.024) 0:02:25.026 ******* 2021-11-12T05:36:37.191 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-11-12T05:36:37.192 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-11-12T05:36:37.217 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:37 +0000 (0:00:00.045) 0:02:25.072 ******* 2021-11-12T05:36:37.246 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-11-12T05:36:37.248 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:37.274 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:37 +0000 (0:00:00.056) 0:02:25.129 ******* 2021-11-12T05:36:37.304 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-11-12T05:36:37.306 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-11-12T05:36:37.342 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:37 +0000 (0:00:00.068) 0:02:25.197 ******* 2021-11-12T05:36:37.384 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-11-12T05:36:37.386 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-11-12T05:36:37.413 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:37 +0000 (0:00:00.070) 0:02:25.267 ******* 2021-11-12T05:36:37.438 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:37 +0000 (0:00:00.025) 0:02:25.293 ******* 2021-11-12T05:36:37.449 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-11-12T05:36:37.457 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-11-12T05:36:37.479 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:37 +0000 (0:00:00.040) 0:02:25.334 ******* 2021-11-12T05:36:37.486 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-11-12T05:36:37.488 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:37.516 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:37 +0000 (0:00:00.036) 0:02:25.370 ******* 2021-11-12T05:36:37.609 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-11-12T05:36:37.611 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-11-12T05:36:37.637 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:37 +0000 (0:00:00.121) 0:02:25.492 ******* 2021-11-12T05:36:37.644 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-11-12T05:36:37.646 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-11-12T05:36:37.647 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [gibba038.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-11-12T05:36:37.674 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:37 +0000 (0:00:00.036) 0:02:25.528 ******* 2021-11-12T05:36:37.696 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:37 +0000 (0:00:00.022) 0:02:25.551 ******* 2021-11-12T05:36:37.704 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-11-12T05:36:37.705 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:37.733 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:37 +0000 (0:00:00.037) 0:02:25.588 ******* 2021-11-12T05:36:37.771 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-11-12T05:36:37.773 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item=docker0) => {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:37.783 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item=enp1s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:37.784 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item=enp1s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:37.794 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:37.796 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:37.821 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:37 +0000 (0:00:00.087) 0:02:25.676 ******* 2021-11-12T05:36:37.828 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-11-12T05:36:37.829 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-11-12T05:36:37.854 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:37 +0000 (0:00:00.033) 0:02:25.709 ******* 2021-11-12T05:36:37.862 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-11-12T05:36:37.864 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'docker0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:37.875 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:37.877 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba016.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:37.878 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:37.879 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-11-12T05:36:37.881 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:37.904 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:37 +0000 (0:00:00.049) 0:02:25.758 ******* 2021-11-12T05:36:37.933 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:37 +0000 (0:00:00.028) 0:02:25.787 ******* 2021-11-12T05:36:37.940 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-12T05:36:37.942 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:37.972 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:37 +0000 (0:00:00.039) 0:02:25.826 ******* 2021-11-12T05:36:37.980 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-11-12T05:36:37.982 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=docker0) => {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:37.992 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=enp1s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:37.994 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=enp1s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:37.994 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:37.996 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:38.020 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:38 +0000 (0:00:00.048) 0:02:25.875 ******* 2021-11-12T05:36:38.044 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:38 +0000 (0:00:00.023) 0:02:25.898 ******* 2021-11-12T05:36:38.051 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-11-12T05:36:38.052 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Purge resolvconf] ********************************************* ok: [gibba044.front.sepia.ceph.com] => {"changed": false} 2021-11-12T05:36:38.082 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:38 +0000 (0:00:00.038) 0:02:25.937 ******* 2021-11-12T05:36:38.106 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:38 +0000 (0:00:00.024) 0:02:25.961 ******* 2021-11-12T05:36:38.113 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-11-12T05:36:38.115 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'docker0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:38.115 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:38.117 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba038.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:38.117 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:38.119 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-11-12T05:36:38.121 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:38.144 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:38 +0000 (0:00:00.038) 0:02:25.999 ******* 2021-11-12T05:36:38.167 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:38 +0000 (0:00:00.022) 0:02:26.021 ******* 2021-11-12T05:36:38.174 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-11-12T05:36:38.176 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp1s0f0"}, "changed": false} TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:38.203 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:38 +0000 (0:00:00.036) 0:02:26.058 ******* 2021-11-12T05:36:38.225 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:38 +0000 (0:00:00.022) 0:02:26.080 ******* 2021-11-12T05:36:38.232 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-12T05:36:38.234 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:38.264 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:38 +0000 (0:00:00.038) 0:02:26.118 ******* 2021-11-12T05:36:38.292 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:38 +0000 (0:00:00.028) 0:02:26.147 ******* 2021-11-12T05:36:38.298 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-11-12T05:36:38.300 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:38.336 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:38 +0000 (0:00:00.043) 0:02:26.190 ******* 2021-11-12T05:36:38.345 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-11-12T05:36:38.347 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:38.371 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:38 +0000 (0:00:00.035) 0:02:26.226 ******* 2021-11-12T05:36:38.379 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-11-12T05:36:38.381 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1636694717.0835795, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1636694717.0795794, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 158, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1636694717.0795794, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1582242096", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:38.407 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:38 +0000 (0:00:00.035) 0:02:26.262 ******* 2021-11-12T05:36:38.431 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:38 +0000 (0:00:00.024) 0:02:26.286 ******* 2021-11-12T05:36:38.450 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:38.477 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:38 +0000 (0:00:00.045) 0:02:26.332 ******* 2021-11-12T05:36:38.506 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-11-12T05:36:38.508 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:38.532 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:38 +0000 (0:00:00.054) 0:02:26.387 ******* 2021-11-12T05:36:38.560 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-11-12T05:36:38.562 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:38.589 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:38 +0000 (0:00:00.056) 0:02:26.443 ******* 2021-11-12T05:36:38.596 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-12T05:36:38.598 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.002494", "end": "2021-11-12 05:36:38.541342", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-11-12 05:36:38.538848", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:38.609 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-11-12T05:36:38.610 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-11-12T05:36:38.634 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:38 +0000 (0:00:00.045) 0:02:26.488 ******* 2021-11-12T05:36:38.641 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-11-12T05:36:38.642 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:38.672 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:38 +0000 (0:00:00.038) 0:02:26.527 ******* 2021-11-12T05:36:38.682 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-11-12T05:36:38.684 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-11-12T05:36:38.731 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:38 +0000 (0:00:00.058) 0:02:26.585 ******* 2021-11-12T05:36:38.740 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-11-12T05:36:38.742 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-12T05:36:38.743 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.001769", "end": "2021-11-12 05:36:38.689801", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-11-12 05:36:38.688032", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:38.781 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:38 +0000 (0:00:00.050) 0:02:26.636 ******* 2021-11-12T05:36:38.789 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:38.822 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:38 +0000 (0:00:00.040) 0:02:26.676 ******* 2021-11-12T05:36:38.831 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-11-12T05:36:38.833 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:38.876 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:38 +0000 (0:00:00.054) 0:02:26.731 ******* 2021-11-12T05:36:38.887 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-12T05:36:38.888 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.001608", "end": "2021-11-12 05:36:38.814974", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-11-12 05:36:38.813366", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:38.955 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-11-12T05:36:38.956 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-11-12T05:36:38.996 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:38 +0000 (0:00:00.120) 0:02:26.851 ******* 2021-11-12T05:36:39.019 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-12T05:36:39.021 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.027953", "end": "2021-11-12 05:36:38.985465", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-11-12 05:36:38.957512", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:39.054 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:39 +0000 (0:00:00.057) 0:02:26.908 ******* 2021-11-12T05:36:39.064 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.002524", "end": "2021-11-12 05:36:39.008214", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-11-12 05:36:39.005690", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:39.087 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-11-12T05:36:39.111 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:39 +0000 (0:00:00.057) 0:02:26.966 ******* 2021-11-12T05:36:39.140 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-11-12T05:36:39.142 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} TASK [testnode : Touch /ceph-qa-ready] ***************************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:39.180 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:39 +0000 (0:00:00.068) 0:02:27.034 ******* 2021-11-12T05:36:39.188 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-12T05:36:39.189 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.001773", "end": "2021-11-12 05:36:39.142811", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-11-12 05:36:39.141038", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:39.190 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-11-12T05:36:39.217 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:39 +0000 (0:00:00.037) 0:02:27.072 ******* 2021-11-12T05:36:39.242 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-11-12T05:36:39.243 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:39.266 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:39 +0000 (0:00:00.049) 0:02:27.121 ******* 2021-11-12T05:36:39.275 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-12T05:36:39.277 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.001657", "end": "2021-11-12 05:36:39.247143", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-11-12 05:36:39.245486", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:39.309 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-11-12T05:36:39.310 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item=docker0) => {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item=enp1s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:39.320 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item=enp1s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:39.322 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:39.332 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:39.357 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:39 +0000 (0:00:00.090) 0:02:27.212 ******* 2021-11-12T05:36:39.396 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-11-12T05:36:39.397 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'docker0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-12T05:36:39.398 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.033299", "end": "2021-11-12 05:36:39.380235", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-11-12 05:36:39.346936", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:39.411 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-11-12T05:36:39.413 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:39.436 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:39 +0000 (0:00:00.079) 0:02:27.291 ******* 2021-11-12T05:36:39.444 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:39.476 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:39 +0000 (0:00:00.038) 0:02:27.330 ******* 2021-11-12T05:36:39.483 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-11-12T05:36:39.517 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:39 +0000 (0:00:00.041) 0:02:27.372 ******* 2021-11-12T05:36:39.525 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-12T05:36:39.527 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:39.554 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:39 +0000 (0:00:00.037) 0:02:27.409 ******* 2021-11-12T05:36:39.562 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-11-12T05:36:39.564 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:39.588 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-11-12T05:36:39.589 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false} TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:39.611 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:39 +0000 (0:00:00.056) 0:02:27.465 ******* 2021-11-12T05:36:39.647 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:39 +0000 (0:00:00.035) 0:02:27.501 ******* 2021-11-12T05:36:39.653 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-11-12T05:36:39.655 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp1s0f0"}, "changed": false} 2021-11-12T05:36:39.681 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:39 +0000 (0:00:00.034) 0:02:27.535 ******* 2021-11-12T05:36:39.689 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-11-12T05:36:39.691 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:39.721 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:39 +0000 (0:00:00.040) 0:02:27.575 ******* 2021-11-12T05:36:39.749 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-11-12T05:36:39.750 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:39.774 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:39 +0000 (0:00:00.052) 0:02:27.628 ******* 2021-11-12T05:36:39.802 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-11-12T05:36:39.803 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:39.829 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:39 +0000 (0:00:00.055) 0:02:27.683 ******* 2021-11-12T05:36:39.836 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-11-12T05:36:39.837 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1636694717.977644, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1636694717.969644, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 158, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1636694717.969644, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1582242096", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-11-12T05:36:39.863 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:39 +0000 (0:00:00.034) 0:02:27.718 ******* 2021-11-12T05:36:39.870 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-11-12T05:36:39.872 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:39.900 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:39 +0000 (0:00:00.036) 0:02:27.754 ******* 2021-11-12T05:36:39.938 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-11-12T05:36:39.939 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:39.976 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:39 +0000 (0:00:00.076) 0:02:27.831 ******* 2021-11-12T05:36:39.994 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-11-12T05:36:39.999 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-11-12T05:36:40.019 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:40 +0000 (0:00:00.043) 0:02:27.874 ******* 2021-11-12T05:36:40.028 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-11-12T05:36:40.029 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:40.055 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:40 +0000 (0:00:00.035) 0:02:27.910 ******* 2021-11-12T05:36:40.062 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-11-12T05:36:40.063 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-11-12T05:36:40.089 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:40 +0000 (0:00:00.033) 0:02:27.943 ******* 2021-11-12T05:36:40.117 INFO:teuthology.task.ansible.out: 2021-11-12T05:36:40.119 INFO:teuthology.task.ansible.out:TASK [testnode : ifdown and ifup] ********************************************** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:40.142 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:40 +0000 (0:00:00.053) 0:02:27.997 ******* 2021-11-12T05:36:40.201 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-12T05:36:40.203 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.002498", "end": "2021-11-12 05:36:40.170748", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-11-12 05:36:40.168250", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:40.297 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-11-12T05:36:40.299 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-11-12T05:36:40.321 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:40 +0000 (0:00:00.179) 0:02:28.176 ******* 2021-11-12T05:36:40.329 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-12T05:36:40.331 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.001734", "end": "2021-11-12 05:36:40.282352", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-11-12 05:36:40.280618", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:40.405 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.001647", "end": "2021-11-12 05:36:40.382941", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-11-12 05:36:40.381294", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:40.481 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-11-12T05:36:40.482 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-11-12T05:36:40.508 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:40 +0000 (0:00:00.186) 0:02:28.363 ******* 2021-11-12T05:36:40.536 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:40.538 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [gibba044.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.024339", "end": "2021-11-12 05:36:40.513246", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-11-12 05:36:40.488907", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:40.562 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:40 +0000 (0:00:00.054) 0:02:28.417 ******* 2021-11-12T05:36:40.585 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:40 +0000 (0:00:00.022) 0:02:28.440 ******* 2021-11-12T05:36:40.602 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-11-12T05:36:40.604 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item=docker0) => {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item=enp1s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item=enp1s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:40.614 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-11-12T05:36:40.616 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [gibba015.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-11-12T05:36:40.640 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:40 +0000 (0:00:00.055) 0:02:28.495 ******* 2021-11-12T05:36:40.663 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:40 +0000 (0:00:00.022) 0:02:28.517 ******* 2021-11-12T05:36:40.680 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-11-12T05:36:40.682 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'docker0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:40.684 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:40.685 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:40.729 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-11-12T05:36:40.731 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba015.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:40.731 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:40.758 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:40 +0000 (0:00:00.095) 0:02:28.613 ******* 2021-11-12T05:36:40.793 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:40.817 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:40 +0000 (0:00:00.059) 0:02:28.672 ******* 2021-11-12T05:36:40.845 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-11-12T05:36:40.847 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:40.870 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:40 +0000 (0:00:00.051) 0:02:28.724 ******* 2021-11-12T05:36:40.897 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-11-12T05:36:40.899 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:40.925 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:40 +0000 (0:00:00.055) 0:02:28.779 ******* 2021-11-12T05:36:40.956 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-11-12T05:36:40.957 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:40.981 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:40 +0000 (0:00:00.056) 0:02:28.835 ******* 2021-11-12T05:36:41.008 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-11-12T05:36:41.010 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:41.036 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:41 +0000 (0:00:00.055) 0:02:28.891 ******* 2021-11-12T05:36:41.064 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-11-12T05:36:41.066 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:41.092 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:41 +0000 (0:00:00.055) 0:02:28.946 ******* 2021-11-12T05:36:41.120 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-11-12T05:36:41.121 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:41.147 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:41 +0000 (0:00:00.055) 0:02:29.002 ******* 2021-11-12T05:36:41.178 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-11-12T05:36:41.179 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:41.201 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:41 +0000 (0:00:00.054) 0:02:29.056 ******* 2021-11-12T05:36:41.342 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-12T05:36:41.344 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.002482", "end": "2021-11-12 05:36:41.312280", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-11-12 05:36:41.309798", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:41.446 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.001800", "end": "2021-11-12 05:36:41.416368", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-11-12 05:36:41.414568", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:41.562 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.001653", "end": "2021-11-12 05:36:41.529931", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-11-12 05:36:41.528278", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:41.715 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.026738", "end": "2021-11-12 05:36:41.674611", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-11-12 05:36:41.647873", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:36:41.879 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:41 +0000 (0:00:00.678) 0:02:29.734 ******* 2021-11-12T05:36:41.909 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-11-12T05:36:41.934 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:41 +0000 (0:00:00.054) 0:02:29.788 ******* 2021-11-12T05:36:41.962 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-11-12T05:36:41.964 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:42.034 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-11-12T05:36:42.053 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:42 +0000 (0:00:00.119) 0:02:29.908 ******* 2021-11-12T05:36:42.074 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:42 +0000 (0:00:00.021) 0:02:29.929 ******* 2021-11-12T05:36:42.104 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:42 +0000 (0:00:00.029) 0:02:29.958 ******* 2021-11-12T05:36:42.128 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:42 +0000 (0:00:00.024) 0:02:29.983 ******* 2021-11-12T05:36:42.154 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:42 +0000 (0:00:00.025) 0:02:30.008 ******* 2021-11-12T05:36:42.914 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-11-12T05:36:42.916 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] 2021-11-12T05:36:42.949 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] 2021-11-12T05:36:42.979 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:42 +0000 (0:00:00.825) 0:02:30.834 ******* 2021-11-12T05:36:43.007 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] 2021-11-12T05:36:43.015 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-12T05:36:43.017 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-11-12T05:36:43.040 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:43 +0000 (0:00:00.060) 0:02:30.895 ******* 2021-11-12T05:36:43.065 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:43 +0000 (0:00:00.024) 0:02:30.920 ******* 2021-11-12T05:36:43.092 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [gibba044.front.sepia.ceph.com] 2021-11-12T05:36:43.103 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] 2021-11-12T05:36:43.111 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:43.113 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** ok: [gibba015.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-11-12T05:36:43.134 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:43 +0000 (0:00:00.069) 0:02:30.989 ******* 2021-11-12T05:36:43.161 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:43 +0000 (0:00:00.026) 0:02:31.016 ******* 2021-11-12T05:36:43.196 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:43 +0000 (0:00:00.034) 0:02:31.051 ******* 2021-11-12T05:36:43.220 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-11-12T05:36:43.222 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} TASK [container-host : set_fact] *********************************************** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:43.244 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:43 +0000 (0:00:00.048) 0:02:31.099 ******* 2021-11-12T05:36:43.267 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:43 +0000 (0:00:00.022) 0:02:31.122 ******* 2021-11-12T05:36:43.291 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:43 +0000 (0:00:00.023) 0:02:31.146 ******* 2021-11-12T05:36:43.315 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:43 +0000 (0:00:00.024) 0:02:31.170 ******* 2021-11-12T05:36:43.322 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-12T05:36:43.324 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-11-12T05:36:43.326 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** ok: [gibba015.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-11-12T05:36:43.326 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** ok: [gibba016.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-11-12T05:36:43.353 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:43 +0000 (0:00:00.037) 0:02:31.207 ******* 2021-11-12T05:36:43.373 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:43 +0000 (0:00:00.020) 0:02:31.228 ******* 2021-11-12T05:36:43.395 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:43 +0000 (0:00:00.021) 0:02:31.250 ******* 2021-11-12T05:36:43.402 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-11-12T05:36:43.404 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:43.427 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:43 +0000 (0:00:00.032) 0:02:31.282 ******* 2021-11-12T05:36:43.458 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:43 +0000 (0:00:00.030) 0:02:31.312 ******* 2021-11-12T05:36:43.465 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:43.490 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:43 +0000 (0:00:00.032) 0:02:31.345 ******* 2021-11-12T05:36:43.497 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-11-12T05:36:43.499 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-11-12T05:36:43.506 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:43.532 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:43 +0000 (0:00:00.041) 0:02:31.386 ******* 2021-11-12T05:36:43.556 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:43 +0000 (0:00:00.023) 0:02:31.410 ******* 2021-11-12T05:36:43.562 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-11-12T05:36:43.564 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-11-12T05:36:43.600 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:43 +0000 (0:00:00.044) 0:02:31.455 ******* 2021-11-12T05:36:43.607 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-11-12T05:36:43.635 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:43 +0000 (0:00:00.034) 0:02:31.490 ******* 2021-11-12T05:36:56.796 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-11-12T05:36:56.797 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"cache_update_time": 1636694779, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 42 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 4096 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 3s (13.2 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...\r\nUnpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...\r\nSetting up docker.io (20.10.7-0ubuntu5~20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", " 2021-11-12T05:36:56.799 INFO:teuthology.task.ansible.out:Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The following packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 42 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 4096 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 3s (13.2 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...", "Unpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...", "Setting up docker.io (20.10.7-0ubuntu5~20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ..."]} 2021-11-12T05:36:56.821 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:56 +0000 (0:00:13.186) 0:02:44.676 ******* 2021-11-12T05:36:56.850 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-12T05:36:56.852 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:56.874 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:56 +0000 (0:00:00.052) 0:02:44.729 ******* 2021-11-12T05:36:56.913 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** ok: [gibba005.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-11-12T05:36:56.915 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** changed: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1636694933, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 42 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 4096 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 3s (13.8 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...\r\nUnpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...\r\nSetting up docker.io (20.10.7-0ubuntu5~20.04.2) ...\r\nProcessing tr 2021-11-12T05:36:56.917 INFO:teuthology.task.ansible.out:iggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The following packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 42 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 4096 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 3s (13.8 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...", "Unpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...", "Setting up docker.io (20.10.7-0ubuntu5~20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ..."]} 2021-11-12T05:36:56.939 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:56 +0000 (0:00:00.065) 0:02:44.794 ******* 2021-11-12T05:36:56.965 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:56 +0000 (0:00:00.025) 0:02:44.820 ******* 2021-11-12T05:36:56.994 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-12T05:36:56.996 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:57.025 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:57 +0000 (0:00:00.059) 0:02:44.880 ******* 2021-11-12T05:36:57.032 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-11-12T05:36:57.033 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"cache_update_time": 1636694984, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 42 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 4096 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 3s (12.8 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...\r\nUnpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...\r\nSetting up docker.io (20.10.7-0ubuntu5~20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", " 2021-11-12T05:36:57.034 INFO:teuthology.task.ansible.out:Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The following packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 42 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 4096 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 3s (12.8 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...", "Unpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...", "Setting up docker.io (20.10.7-0ubuntu5~20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ..."]} changed: [gibba015.front.sepia.ceph.com] => {"cache_update_time": 1636694831, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": 2021-11-12T05:36:57.036 INFO:teuthology.task.ansible.out: "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 42 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 4096 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 3s (13.0 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...\r\nUnpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...\r\nSetting up docker.io (20.10.7-0ubuntu5~20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " libllvm11 linu 2021-11-12T05:36:57.037 INFO:teuthology.task.ansible.out:x-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The following packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 42 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 4096 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 3s (13.0 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...", "Unpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...", "Setting up docker.io (20.10.7-0ubuntu5~20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ..."]} 2021-11-12T05:36:57.066 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:57 +0000 (0:00:00.040) 0:02:44.921 ******* 2021-11-12T05:36:57.090 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:57 +0000 (0:00:00.023) 0:02:44.944 ******* 2021-11-12T05:36:57.100 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => {"cache_update_time": 1636694883, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 42 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 4096 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 3s (13.1 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174687 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...\r\nUnpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...\r\nSetting up docker.io (20.10.7-0ubuntu5~20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", " 2021-11-12T05:36:57.102 INFO:teuthology.task.ansible.out:Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The following packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 42 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 4096 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 3s (13.1 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174687 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...", "Unpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...", "Setting up docker.io (20.10.7-0ubuntu5~20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ..."]} TASK [container-host : set_fact] *********************************************** ok: [gibba038.front.sepia.ceph.com] => {"ansible_facts": {"container_service_c 2021-11-12T05:36:57.103 INFO:teuthology.task.ansible.out:onf": "/etc/docker/daemon.json"}, "changed": false} TASK [container-host : set_fact] *********************************************** skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [container-host : Create container_mirror_cert_paths] ********************* ok: [gibba005.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-11-12T05:36:57.131 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:57 +0000 (0:00:00.041) 0:02:44.986 ******* 2021-11-12T05:36:57.157 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:57 +0000 (0:00:00.026) 0:02:45.012 ******* 2021-11-12T05:36:57.183 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:57 +0000 (0:00:00.026) 0:02:45.038 ******* 2021-11-12T05:36:57.190 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-12T05:36:57.190 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:57.192 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** ok: [gibba015.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} TASK [container-host : set_fact] *********************************************** skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:36:57.219 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:57 +0000 (0:00:00.035) 0:02:45.074 ******* 2021-11-12T05:36:57.242 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:57 +0000 (0:00:00.022) 0:02:45.096 ******* 2021-11-12T05:36:57.268 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:57 +0000 (0:00:00.025) 0:02:45.122 ******* 2021-11-12T05:36:57.275 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-11-12T05:36:57.277 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-11-12T05:36:57.278 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** ok: [gibba016.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-11-12T05:36:57.306 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:57 +0000 (0:00:00.038) 0:02:45.161 ******* 2021-11-12T05:36:57.328 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:57 +0000 (0:00:00.022) 0:02:45.183 ******* 2021-11-12T05:36:57.336 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-11-12T05:36:57.338 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-11-12T05:36:57.340 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-11-12T05:36:57.368 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:57 +0000 (0:00:00.040) 0:02:45.223 ******* 2021-11-12T05:36:57.389 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-11-12T05:36:57.464 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-11-12T05:36:57.493 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:57 +0000 (0:00:00.124) 0:02:45.348 ******* 2021-11-12T05:36:57.504 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-11-12T05:36:57.505 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-11-12T05:36:57.542 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:57 +0000 (0:00:00.049) 0:02:45.397 ******* 2021-11-12T05:36:57.544 INFO:teuthology.task.ansible.out: 2021-11-12T05:36:57.552 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-11-12T05:36:57.616 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-11-12T05:36:57.618 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-11-12T05:36:57.620 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-11-12T05:36:57.644 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:57 +0000 (0:00:00.102) 0:02:45.499 ******* 2021-11-12T05:36:57.683 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-11-12T05:36:57.685 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-11-12T05:36:57.713 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:57 +0000 (0:00:00.068) 0:02:45.568 ******* 2021-11-12T05:36:57.806 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-11-12T05:36:57.807 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-11-12T05:36:57.893 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-11-12T05:36:57.895 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-11-12T05:36:57.920 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:57 +0000 (0:00:00.206) 0:02:45.774 ******* 2021-11-12T05:36:57.959 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-11-12T05:36:58.078 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-11-12T05:36:58.102 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-11-12T05:36:58.130 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:58 +0000 (0:00:00.209) 0:02:45.984 ******* 2021-11-12T05:36:58.157 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-11-12T05:36:58.186 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:58 +0000 (0:00:00.055) 0:02:46.040 ******* 2021-11-12T05:36:58.245 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-11-12T05:36:58.273 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:58 +0000 (0:00:00.087) 0:02:46.128 ******* 2021-11-12T05:36:58.375 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2021-11-12T05:36:58.403 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:58 +0000 (0:00:00.129) 0:02:46.257 ******* 2021-11-12T05:36:58.441 INFO:teuthology.task.ansible.out: TASK [container-host : Ensure git is installed] ******************************** 2021-11-12T05:36:58.443 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"cache_update_time": 1636694779, "cache_updated": false, "changed": false} 2021-11-12T05:36:58.466 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:58 +0000 (0:00:00.063) 0:02:46.321 ******* 2021-11-12T05:36:58.672 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"cache_update_time": 1636694933, "cache_updated": false, "changed": false} 2021-11-12T05:36:58.697 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:58 +0000 (0:00:00.230) 0:02:46.552 ******* 2021-11-12T05:36:58.716 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"cache_update_time": 1636694831, "cache_updated": false, "changed": false} 2021-11-12T05:36:58.741 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:58 +0000 (0:00:00.044) 0:02:46.596 ******* 2021-11-12T05:36:58.772 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"cache_update_time": 1636694883, "cache_updated": false, "changed": false} 2021-11-12T05:36:58.802 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:58 +0000 (0:00:00.060) 0:02:46.656 ******* 2021-11-12T05:36:58.926 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"cache_update_time": 1636694984, "cache_updated": false, "changed": false} 2021-11-12T05:36:58.961 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:36:58 +0000 (0:00:00.159) 0:02:46.815 ******* 2021-11-12T05:37:01.838 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-11-12T05:37:01.840 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-zyx49s05\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-zyx49s05"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-zyx49s05\nRequirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)\nRequirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)\nBuilding wheels for collected packages: registries-conf-ctl\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=28ee8e76d3be7d13724269ec387543262c1029a7b3a59fb94a389735e4022ec6\n Stored in directory: /tmp/pip-ephem-wheel-cache-kddagqb_/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\nSuccessfully built registries-conf-ctl\nInstalling collected packages: registries-conf-ctl\n Attempting uninstall: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/regi 2021-11-12T05:37:01.842 INFO:teuthology.task.ansible.out:stries-conf-ctl to ./pip-req-build-zyx49s05", "Requirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)", "Requirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)", "Building wheels for collected packages: registries-conf-ctl", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=28ee8e76d3be7d13724269ec387543262c1029a7b3a59fb94a389735e4022ec6", " Stored in directory: /tmp/pip-ephem-wheel-cache-kddagqb_/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", "Successfully built registries-conf-ctl", "Installing collected packages: registries-conf-ctl", " Attempting uninstall: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-11-12T05:37:01.864 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:37:01 +0000 (0:00:02.903) 0:02:49.719 ******* 2021-11-12T05:37:02.019 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-11-12T05:37:02.021 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1636694708.803342, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "13ed9dbcd1f35408627b14794589868021e7d546", "ctime": 1633111259.4300582, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 97715, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1633111259.4300582, "nlink": 1, "path": "/etc/docker/daemon.json", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 151, "uid": 0, "version": "539352039", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-11-12T05:37:02.047 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:37:02 +0000 (0:00:00.183) 0:02:49.902 ******* 2021-11-12T05:37:02.066 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-11-12T05:37:02.067 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-61vtqc7h\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-61vtqc7h"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-61vtqc7h\nRequirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)\nRequirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)\nBuilding wheels for collected packages: registries-conf-ctl\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=28ee8e76d3be7d13724269ec387543262c1029a7b3a59fb94a389735e4022ec6\n Stored in directory: /tmp/pip-ephem-wheel-cache-do2s4xpf/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\nSuccessfully built registries-conf-ctl\nInstalling collected packages: registries-conf-ctl\n Attempting uninstall: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/regi 2021-11-12T05:37:02.069 INFO:teuthology.task.ansible.out:stries-conf-ctl to ./pip-req-build-61vtqc7h", "Requirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)", "Requirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)", "Building wheels for collected packages: registries-conf-ctl", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=28ee8e76d3be7d13724269ec387543262c1029a7b3a59fb94a389735e4022ec6", " Stored in directory: /tmp/pip-ephem-wheel-cache-do2s4xpf/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", "Successfully built registries-conf-ctl", "Installing collected packages: registries-conf-ctl", " Attempting uninstall: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-11-12T05:37:02.094 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:37:02 +0000 (0:00:00.046) 0:02:49.948 ******* 2021-11-12T05:37:02.103 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-11-12T05:37:02.104 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [container-host : Install registries-conf-ctl] **************************** ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-dhy62k_2\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-dhy62k_2"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-dhy62k_2\nRequirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)\nRequirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)\nBuilding wheels for collected packages: registries-conf-ctl\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=28ee8e76d3be7d13724269ec387543262c1029a7b3a59fb94a389735e4022ec6\n Stored in directory: /tmp/pip-ephem-wheel-cache-rp1sdmga/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\nSuccessfully built registries-conf-ctl\nInstalling collected packages: registries-conf-ctl\n Attempting uninstall: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\ 2021-11-12T05:37:02.106 INFO:teuthology.task.ansible.out:nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-dhy62k_2", "Requirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)", "Requirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)", "Building wheels for collected packages: registries-conf-ctl", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=28ee8e76d3be7d13724269ec387543262c1029a7b3a59fb94a389735e4022ec6", " Stored in directory: /tmp/pip-ephem-wheel-cache-rp1sdmga/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", "Successfully built registries-conf-ctl", "Installing collected packages: registries-conf-ctl", " Attempting uninstall: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-11-12T05:37:02.139 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:37:02 +0000 (0:00:00.045) 0:02:49.994 ******* 2021-11-12T05:37:02.168 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:37:02 +0000 (0:00:00.028) 0:02:50.022 ******* 2021-11-12T05:37:02.188 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-vnl7oryv\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-vnl7oryv"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-vnl7oryv\nRequirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)\nRequirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)\nBuilding wheels for collected packages: registries-conf-ctl\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=28ee8e76d3be7d13724269ec387543262c1029a7b3a59fb94a389735e4022ec6\n Stored in directory: /tmp/pip-ephem-wheel-cache-_oemwmhh/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\nSuccessfully built registries-conf-ctl\nInstalling collected packages: registries-conf-ctl\n Attempting uninstall: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/regi 2021-11-12T05:37:02.190 INFO:teuthology.task.ansible.out:stries-conf-ctl to ./pip-req-build-vnl7oryv", "Requirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)", "Requirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)", "Building wheels for collected packages: registries-conf-ctl", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=28ee8e76d3be7d13724269ec387543262c1029a7b3a59fb94a389735e4022ec6", " Stored in directory: /tmp/pip-ephem-wheel-cache-_oemwmhh/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", "Successfully built registries-conf-ctl", "Installing collected packages: registries-conf-ctl", " Attempting uninstall: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-11-12T05:37:02.216 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:37:02 +0000 (0:00:00.048) 0:02:50.071 ******* 2021-11-12T05:37:02.256 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-11-12T05:37:02.257 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1636694706.929586, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "13ed9dbcd1f35408627b14794589868021e7d546", "ctime": 1633111259.4300582, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 97715, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1633111259.4300582, "nlink": 1, "path": "/etc/docker/daemon.json", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 151, "uid": 0, "version": "539352039", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-11-12T05:37:02.283 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:37:02 +0000 (0:00:00.067) 0:02:50.138 ******* 2021-11-12T05:37:02.312 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1636694708.1896155, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "13ed9dbcd1f35408627b14794589868021e7d546", "ctime": 1633111259.4300582, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 97715, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1633111259.4300582, "nlink": 1, "path": "/etc/docker/daemon.json", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 151, "uid": 0, "version": "539352039", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-11-12T05:37:02.314 INFO:teuthology.task.ansible.out: 2021-11-12T05:37:02.339 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:37:02 +0000 (0:00:00.055) 0:02:50.193 ******* 2021-11-12T05:37:02.346 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-11-12T05:37:02.348 INFO:teuthology.task.ansible.out:skipping: [gibba038.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [container-host : Install registries-conf-ctl] **************************** ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-ujumdd3y\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-ujumdd3y"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-ujumdd3y\nRequirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)\nRequirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)\nBuilding wheels for collected packages: registries-conf-ctl\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=28ee8e76d3be7d13724269ec387543262c1029a7b3a59fb94a389735e4022ec6\n Stored in directory: /tmp/pip-ephem-wheel-cache-y5a4eu55/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\nSuccessfully built registries-conf-ctl\nInstalling collected packages: registries-conf-ctl\n Attempting uninstall: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\ 2021-11-12T05:37:02.349 INFO:teuthology.task.ansible.out:nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-ujumdd3y", "Requirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)", "Requirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)", "Building wheels for collected packages: registries-conf-ctl", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8180 sha256=28ee8e76d3be7d13724269ec387543262c1029a7b3a59fb94a389735e4022ec6", " Stored in directory: /tmp/pip-ephem-wheel-cache-y5a4eu55/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", "Successfully built registries-conf-ctl", "Installing collected packages: registries-conf-ctl", " Attempting uninstall: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} TASK [container-host : Add local docker.io registry mirror] ******************** changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.044948", "end": "2021-11-12 05:37:02.327145", "rc": 0, "start": "2021-11-12 05:37:02.282197", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:37:02.376 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:37:02 +0000 (0:00:00.037) 0:02:50.231 ******* 2021-11-12T05:37:02.399 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:37:02 +0000 (0:00:00.022) 0:02:50.254 ******* 2021-11-12T05:37:02.422 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:37:02 +0000 (0:00:00.022) 0:02:50.277 ******* 2021-11-12T05:37:02.429 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-11-12T05:37:02.431 INFO:teuthology.task.ansible.out:skipping: [gibba015.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [container-host : Check for docker's daemon.json] ************************* ok: [gibba016.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1636694711.9896896, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "13ed9dbcd1f35408627b14794589868021e7d546", "ctime": 1633111259.4300582, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 97715, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1633111259.4300582, "nlink": 1, "path": "/etc/docker/daemon.json", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 151, "uid": 0, "version": "539352039", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-11-12T05:37:02.461 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:37:02 +0000 (0:00:00.038) 0:02:50.316 ******* 2021-11-12T05:37:02.486 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:37:02 +0000 (0:00:00.024) 0:02:50.340 ******* 2021-11-12T05:37:02.526 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-11-12T05:37:02.528 INFO:teuthology.task.ansible.out:skipping: [gibba016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:37:02.550 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:37:02 +0000 (0:00:00.064) 0:02:50.405 ******* 2021-11-12T05:37:02.567 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-11-12T05:37:02.569 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1636694707.04355, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "13ed9dbcd1f35408627b14794589868021e7d546", "ctime": 1633111259.4300582, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 97715, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1633111259.4300582, "nlink": 1, "path": "/etc/docker/daemon.json", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 151, "uid": 0, "version": "539352039", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-11-12T05:37:02.594 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:37:02 +0000 (0:00:00.044) 0:02:50.449 ******* 2021-11-12T05:37:02.612 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-11-12T05:37:02.614 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.068106", "end": "2021-11-12 05:37:02.578585", "rc": 0, "start": "2021-11-12 05:37:02.510479", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:37:02.645 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:37:02 +0000 (0:00:00.051) 0:02:50.500 ******* 2021-11-12T05:37:02.653 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-11-12T05:37:02.655 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-12T05:37:02.681 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:37:02 +0000 (0:00:00.035) 0:02:50.535 ******* 2021-11-12T05:37:02.688 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-11-12T05:37:02.690 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.054980", "end": "2021-11-12 05:37:02.637248", "rc": 0, "start": "2021-11-12 05:37:02.582268", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:37:02.715 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:37:02 +0000 (0:00:00.034) 0:02:50.570 ******* 2021-11-12T05:37:02.744 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.057457", "end": "2021-11-12 05:37:02.728198", "rc": 0, "start": "2021-11-12 05:37:02.670741", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:37:02.770 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:37:02 +0000 (0:00:00.054) 0:02:50.624 ******* 2021-11-12T05:37:02.884 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.056768", "end": "2021-11-12 05:37:02.866506", "rc": 0, "start": "2021-11-12 05:37:02.809738", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-12T05:37:02.911 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:37:02 +0000 (0:00:00.141) 0:02:50.766 ******* 2021-11-12T05:37:04.117 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-11-12T05:37:04.119 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-11-12 05:36:54 UTC", "ActiveEnterTimestampMonotonic": "256046477", "ActiveExitTimestamp": "Fri 2021-11-12 05:36:53 UTC", "ActiveExitTimestampMonotonic": "255061623", "ActiveState": "active", "After": "systemd-journald.socket containerd.service network-online.target docker.socket firewalld.service basic.target system.slice sysinit.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-11-12 05:36:53 UTC", "AssertTimestampMonotonic": "255066469", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-11-12 05:36:53 UTC", "ConditionTimestampMonotonic": "255066469", "ConfigurationDirectoryMode": "0755", 2021-11-12T05:37:04.120 INFO:teuthology.task.ansible.out: "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8492", "ExecMainStartTimestamp": "Fri 2021-11-12 05:36:53 UTC", "ExecMainStartTimestampMonotonic": "255066831", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IP 2021-11-12T05:37:04.122 INFO:teuthology.task.ansible.out:IngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Fri 2021-11-12 05:36:53 UTC", "InactiveEnterTimestampMonotonic": "255064185", "InactiveExitTimestamp": "Fri 2021-11-12 05:36:53 UTC", "InactiveExitTimestampMonotonic": "255067124", "InvocationID": "852d12a6f1484ffb887ff00c642ac6ec", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8492", "MemoryAccounting": "yes", "MemoryCurrent": "47890432", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": 2021-11-12T05:37:04.124 INFO:teuthology.task.ansible.out: "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "docker.socket system.slice sysinit.target", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-11-12 05:36:54 UTC", "StateChangeTimestampMonotonic": "256046477", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "19", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec 2021-11-12T05:37:04.125 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "containerd.service network-online.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-12T05:37:04.273 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-11-12 05:36:54 UTC", "ActiveEnterTimestampMonotonic": "241973269", "ActiveExitTimestamp": "Fri 2021-11-12 05:36:53 UTC", "ActiveExitTimestampMonotonic": "241163263", "ActiveState": "active", "After": "sysinit.target basic.target system.slice firewalld.service containerd.service network-online.target systemd-journald.socket docker.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-11-12 05:36:53 UTC", "AssertTimestampMonotonic": "241167993", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-11-12 05:36:53 UTC", "ConditionTimestampMonotonic": "241167993", "ConfigurationDirectoryMode": "0755", 2021-11-12T05:37:04.275 INFO:teuthology.task.ansible.out: "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8428", "ExecMainStartTimestamp": "Fri 2021-11-12 05:36:53 UTC", "ExecMainStartTimestampMonotonic": "241168368", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IP 2021-11-12T05:37:04.277 INFO:teuthology.task.ansible.out:IngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Fri 2021-11-12 05:36:53 UTC", "InactiveEnterTimestampMonotonic": "241165664", "InactiveExitTimestamp": "Fri 2021-11-12 05:36:53 UTC", "InactiveExitTimestampMonotonic": "241168628", "InvocationID": "cda22700aef14365bf944a9880f5afbc", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8428", "MemoryAccounting": "yes", "MemoryCurrent": "47550464", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": 2021-11-12T05:37:04.278 INFO:teuthology.task.ansible.out: "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target docker.socket", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-11-12 05:36:54 UTC", "StateChangeTimestampMonotonic": "241973269", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "22", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec 2021-11-12T05:37:04.280 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init 2021-11-12T05:37:04.281 INFO:teuthology.task.ansible.out:", "WantedBy": "multi-user.target", "Wants": "network-online.target containerd.service", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-12T05:37:04.374 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-11-12 05:36:54 UTC", "ActiveEnterTimestampMonotonic": "253077672", "ActiveExitTimestamp": "Fri 2021-11-12 05:36:53 UTC", "ActiveExitTimestampMonotonic": "252276715", "ActiveState": "active", "After": "sysinit.target system.slice containerd.service firewalld.service systemd-journald.socket docker.socket basic.target network-online.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-11-12 05:36:53 UTC", "AssertTimestampMonotonic": "252281224", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-11-12 05:36:53 UTC", "ConditionTimestampMonotonic": "252281224", "ConfigurationDirectoryMode": "0755", 2021-11-12T05:37:04.375 INFO:teuthology.task.ansible.out: "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8442", "ExecMainStartTimestamp": "Fri 2021-11-12 05:36:53 UTC", "ExecMainStartTimestampMonotonic": "252281592", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IP 2021-11-12T05:37:04.377 INFO:teuthology.task.ansible.out:IngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Fri 2021-11-12 05:36:53 UTC", "InactiveEnterTimestampMonotonic": "252279123", "InactiveExitTimestamp": "Fri 2021-11-12 05:36:53 UTC", "InactiveExitTimestampMonotonic": "252281679", "InvocationID": "f4440b2f32d24662b7d1c5396b0142ff", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8442", "MemoryAccounting": "yes", "MemoryCurrent": "48472064", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": 2021-11-12T05:37:04.379 INFO:teuthology.task.ansible.out: "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target docker.socket", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-11-12 05:36:54 UTC", "StateChangeTimestampMonotonic": "253077672", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "21", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartU 2021-11-12T05:37:04.379 INFO:teuthology.task.ansible.out:Sec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec 2021-11-12T05:37:04.381 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "network-online.target containerd.service", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-12T05:37:04.441 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-11-12 05:36:54 UTC", "ActiveEnterTimestampMonotonic": "246969188", "ActiveExitTimestamp": "Fri 2021-11-12 05:36:53 UTC", "ActiveExitTimestampMonotonic": "246066981", "ActiveState": "active", "After": "network-online.target sysinit.target firewalld.service basic.target docker.socket system.slice systemd-journald.socket containerd.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-11-12 05:36:53 UTC", "AssertTimestampMonotonic": "246071950", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-11-12 05:36:53 UTC", "ConditionTimestampMonotonic": "246071950", "ConfigurationDirectoryMode": "0755", 2021-11-12T05:37:04.443 INFO:teuthology.task.ansible.out: "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8441", "ExecMainStartTimestamp": "Fri 2021-11-12 05:36:53 UTC", "ExecMainStartTimestampMonotonic": "246072312", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IP 2021-11-12T05:37:04.445 INFO:teuthology.task.ansible.out:IngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Fri 2021-11-12 05:36:53 UTC", "InactiveEnterTimestampMonotonic": "246069680", "InactiveExitTimestamp": "Fri 2021-11-12 05:36:53 UTC", "InactiveExitTimestampMonotonic": "246072560", "InvocationID": "62b4daeb7f054afab91573d61bc73ce6", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8441", "MemoryAccounting": "yes", "MemoryCurrent": "46886912", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": 2021-11-12T05:37:04.446 INFO:teuthology.task.ansible.out: "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "docker.socket system.slice sysinit.target", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-11-12 05:36:54 UTC", "StateChangeTimestampMonotonic": "246969188", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "21", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec 2021-11-12T05:37:04.447 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "network-online.target containerd.service", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-12T05:37:04.584 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2021-11-12 05:36:54 UTC", "ActiveEnterTimestampMonotonic": "233992465", "ActiveExitTimestamp": "Fri 2021-11-12 05:36:53 UTC", "ActiveExitTimestampMonotonic": "233181738", "ActiveState": "active", "After": "basic.target system.slice systemd-journald.socket network-online.target containerd.service docker.socket sysinit.target firewalld.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2021-11-12 05:36:53 UTC", "AssertTimestampMonotonic": "233186029", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2021-11-12 05:36:53 UTC", "ConditionTimestampMonotonic": "233186029", "ConfigurationDirectoryMode": "0755", 2021-11-12T05:37:04.586 INFO:teuthology.task.ansible.out: "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8416", "ExecMainStartTimestamp": "Fri 2021-11-12 05:36:53 UTC", "ExecMainStartTimestampMonotonic": "233186371", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IP 2021-11-12T05:37:04.588 INFO:teuthology.task.ansible.out:IngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Fri 2021-11-12 05:36:53 UTC", "InactiveEnterTimestampMonotonic": "233184193", "InactiveExitTimestamp": "Fri 2021-11-12 05:36:53 UTC", "InactiveExitTimestampMonotonic": "233186469", "InvocationID": "4cd9785588ad47b09bc0328777cc9613", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127820", "LimitSIGPENDINGSoft": "127820", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8416", "MemoryAccounting": "yes", "MemoryCurrent": "48795648", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": 2021-11-12T05:37:04.589 INFO:teuthology.task.ansible.out: "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice docker.socket", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2021-11-12 05:36:54 UTC", "StateChangeTimestampMonotonic": "233992465", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "22", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec 2021-11-12T05:37:04.591 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init 2021-11-12T05:37:04.591 INFO:teuthology.task.ansible.out:", "WantedBy": "multi-user.target", "Wants": "network-online.target containerd.service", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-12T05:37:04.664 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-11-12T05:37:04.665 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-11-12T05:37:04.666 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2021-11-12T05:37:04.668 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-11-12T05:37:04.684 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-11-12T05:37:04.686 INFO:teuthology.task.ansible.out:Friday 12 November 2021 05:37:04 +0000 (0:00:01.773) 0:02:52.539 ******* 2021-11-12T05:37:05.453 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] 2021-11-12T05:37:05.480 INFO:teuthology.task.ansible.out:ok: [gibba015.front.sepia.ceph.com] 2021-11-12T05:37:05.533 INFO:teuthology.task.ansible.out:ok: [gibba016.front.sepia.ceph.com] 2021-11-12T05:37:05.586 INFO:teuthology.task.ansible.out:ok: [gibba038.front.sepia.ceph.com] 2021-11-12T05:37:05.631 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] 2021-11-12T05:37:05.651 INFO:teuthology.task.ansible.out: TASK [Touch /ceph-qa-ready] **************************************************** Friday 12 November 2021 05:37:05 +0000 (0:00:00.966) 0:02:53.506 ******* 2021-11-12T05:37:05.789 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-11-12T05:37:05.811 INFO:teuthology.task.ansible.out:changed: [gibba015.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-11-12T05:37:05.833 INFO:teuthology.task.ansible.out:changed: [gibba016.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-11-12T05:37:05.865 INFO:teuthology.task.ansible.out:changed: [gibba038.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-11-12T05:37:05.897 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-11-12T05:37:05.900 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* gibba005.front.sepia.ceph.com : ok=131 changed=32 unreachable=0 failed=0 skipped=188 rescued=0 ignored=0 gibba015.front.sepia.ceph.com : ok=131 changed=32 unreachable=0 failed=0 skipped=188 rescued=0 ignored=0 gibba016.front.sepia.ceph.com : ok=131 changed=32 unreachable=0 failed=0 skipped=188 rescued=0 ignored=0 gibba038.front.sepia.ceph.com : ok=131 changed=32 unreachable=0 failed=0 skipped=188 rescued=0 ignored=0 gibba044.front.sepia.ceph.com : ok=131 changed=32 unreachable=0 failed=0 skipped=188 rescued=0 ignored=0 Friday 12 November 2021 05:37:05 +0000 (0:00:00.248) 0:02:53.755 ******* =============================================================================== 2021-11-12T05:37:05.901 INFO:teuthology.task.ansible.out:Create all admin users with sudo access. ------------------------------- 15.48s container-host : Install container packages ---------------------------- 13.19s testnode : Upgrade packages --------------------------------------------- 7.16s users : Update authorized_keys using the keys repo ---------------------- 5.86s testnode : Install packages --------------------------------------------- 3.18s container-host : Install registries-conf-ctl ---------------------------- 2.90s 2021-11-12T05:37:05.901 INFO:teuthology.task.ansible.out:Gathering Facts --------------------------------------------------------- 1.88s container-host : Restart docker service --------------------------------- 1.77s testnode : Update apt cache. -------------------------------------------- 1.54s testnode : Install apt keys --------------------------------------------- 1.40s Gathering Facts --------------------------------------------------------- 0.97s Gathering Facts --------------------------------------------------------- 0.83s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 0.70s testnode : List any leftover Ceph artifacts from previous jobs ---------- 0.68s Gathering Facts --------------------------------------------------------- 0.66s ansible-managed : Add authorized keys for the ansible user. ------------- 0.58s testnode : Ensure packages are not present. ----------------------------- 0.56s Gathering Facts --------------------------------------------------------- 0.55s testnode : Zap all non-root disks --------------------------------------- 0.55s users : Clone the keys repo --------------------------------------------- 0.51s 2021-11-12T05:37:06.294 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@gibba005.front.sepia.ceph.com'), Remote(name='ubuntu@gibba015.front.sepia.ceph.com'), Remote(name='ubuntu@gibba016.front.sepia.ceph.com'), Remote(name='ubuntu@gibba038.front.sepia.ceph.com'), Remote(name='ubuntu@gibba044.front.sepia.ceph.com')] 2021-11-12T05:37:06.295 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba005.front.sepia.ceph.com' 2021-11-12T05:37:06.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-12T05:37:06.336 DEBUG:teuthology.orchestra.run.gibba005:> true 2021-11-12T05:37:06.421 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba015.front.sepia.ceph.com' 2021-11-12T05:37:06.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba015.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-12T05:37:06.455 DEBUG:teuthology.orchestra.run.gibba015:> true 2021-11-12T05:37:06.538 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba016.front.sepia.ceph.com' 2021-11-12T05:37:06.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-12T05:37:06.574 DEBUG:teuthology.orchestra.run.gibba016:> true 2021-11-12T05:37:06.658 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba038.front.sepia.ceph.com' 2021-11-12T05:37:06.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-12T05:37:06.693 DEBUG:teuthology.orchestra.run.gibba038:> true 2021-11-12T05:37:06.778 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba044.front.sepia.ceph.com' 2021-11-12T05:37:06.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-12T05:37:06.814 DEBUG:teuthology.orchestra.run.gibba044:> true 2021-11-12T05:37:06.895 INFO:teuthology.run_tasks:Running task clock... 2021-11-12T05:37:06.910 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-11-12T05:37:06.910 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-11-12T05:37:06.912 DEBUG:teuthology.orchestra.run.gibba005:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-11-12T05:37:06.932 INFO:teuthology.orchestra.run.gibba005.stdout:12 Nov 05:37:06 ntpd[9909]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-11-12T05:37:06.932 INFO:teuthology.orchestra.run.gibba005.stdout:12 Nov 05:37:06 ntpd[9909]: Command line: ntpd -gq 2021-11-12T05:37:06.933 INFO:teuthology.orchestra.run.gibba005.stdout:12 Nov 05:37:06 ntpd[9909]: proto: precision = 0.033 usec (-25) 2021-11-12T05:37:06.933 INFO:teuthology.orchestra.run.gibba005.stdout:12 Nov 05:37:06 ntpd[9909]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-11-12T05:37:06.933 INFO:teuthology.orchestra.run.gibba005.stdout:12 Nov 05:37:06 ntpd[9909]: restrict ::: KOD does nothing without LIMITED. 2021-11-12T05:37:06.934 INFO:teuthology.orchestra.run.gibba005.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-11-12T05:37:06.934 INFO:teuthology.orchestra.run.gibba005.stderr:restrict ::: KOD does nothing without LIMITED. 2021-11-12T05:37:06.935 INFO:teuthology.orchestra.run.gibba005.stdout:12 Nov 05:37:06 ntpd[9909]: Listen and drop on 0 v6wildcard [::]:123 2021-11-12T05:37:06.935 INFO:teuthology.orchestra.run.gibba005.stdout:12 Nov 05:37:06 ntpd[9909]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-11-12T05:37:06.936 INFO:teuthology.orchestra.run.gibba005.stdout:12 Nov 05:37:06 ntpd[9909]: Listen normally on 2 lo 127.0.0.1:123 2021-11-12T05:37:06.936 INFO:teuthology.orchestra.run.gibba005.stdout:12 Nov 05:37:06 ntpd[9909]: Listen normally on 3 enp1s0f0 172.21.2.105:123 2021-11-12T05:37:06.936 INFO:teuthology.orchestra.run.gibba005.stdout:12 Nov 05:37:06 ntpd[9909]: Listen normally on 4 lo [::1]:123 2021-11-12T05:37:06.936 INFO:teuthology.orchestra.run.gibba005.stdout:12 Nov 05:37:06 ntpd[9909]: Listen normally on 5 enp1s0f0 [fe80::3eec:efff:fe3d:8dba%4]:123 2021-11-12T05:37:06.936 INFO:teuthology.orchestra.run.gibba005.stdout:12 Nov 05:37:06 ntpd[9909]: Listening on routing socket on fd #22 for interface updates 2021-11-12T05:37:07.934 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:07 ntpd[9909]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:07.935 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:07 ntpd[9909]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:07.935 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:07 ntpd[9909]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:07.935 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:07 ntpd[9909]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:07.936 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:07 ntpd[9909]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:07.936 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:07 ntpd[9909]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:09.934 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:09 ntpd[9909]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:09.935 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:09 ntpd[9909]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:09.935 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:09 ntpd[9909]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:09.935 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:09 ntpd[9909]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:09.935 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:09 ntpd[9909]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:09.935 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:09 ntpd[9909]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:09.936 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:09 ntpd[9909]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:09.936 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:09 ntpd[9909]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:09.936 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:09 ntpd[9909]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:09.936 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:09 ntpd[9909]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:09.937 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:09 ntpd[9909]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:09.937 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:09 ntpd[9909]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:09.937 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:09 ntpd[9909]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:09.937 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:09 ntpd[9909]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:09.938 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:09 ntpd[9909]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:09.938 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:09 ntpd[9909]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:09.938 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:09 ntpd[9909]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:09.938 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:09 ntpd[9909]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:11.935 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:11 ntpd[9909]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:11.935 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:11 ntpd[9909]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:11.935 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:11 ntpd[9909]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:11.936 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:11 ntpd[9909]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:11.936 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:11 ntpd[9909]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:11.936 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:11 ntpd[9909]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:11.936 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:11 ntpd[9909]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:11.937 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:11 ntpd[9909]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:11.937 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:11 ntpd[9909]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:11.937 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:11 ntpd[9909]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:11.937 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:11 ntpd[9909]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:11.937 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:11 ntpd[9909]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:11.938 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:11 ntpd[9909]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:11.938 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:11 ntpd[9909]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:11.938 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:11 ntpd[9909]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:11.938 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:11 ntpd[9909]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:11.939 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:11 ntpd[9909]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:11.939 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:11 ntpd[9909]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:11.939 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:11 ntpd[9909]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:11.939 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:11 ntpd[9909]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:11.939 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:11 ntpd[9909]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:11.940 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:11 ntpd[9909]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:11.940 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:11 ntpd[9909]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:11.940 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:11 ntpd[9909]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:13.934 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:13 ntpd[9909]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:13.934 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:13 ntpd[9909]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:13.934 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:13 ntpd[9909]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:13.935 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:13 ntpd[9909]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:13.935 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:13 ntpd[9909]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:13.935 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:13 ntpd[9909]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:13.935 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:13 ntpd[9909]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:13.935 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:13 ntpd[9909]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:13.936 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:13 ntpd[9909]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:13.936 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:13 ntpd[9909]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:13.936 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:13 ntpd[9909]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:13.936 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:13 ntpd[9909]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:13.937 INFO:teuthology.orchestra.run.gibba005.stdout:12 Nov 05:37:13 ntpd[9909]: ntpd: time slew -0.000120 s 2021-11-12T05:37:13.937 INFO:teuthology.orchestra.run.gibba005.stdout:ntpd: time slew -0.000120s 2021-11-12T05:37:13.938 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:13 ntpd[9909]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-11-12T05:37:13.938 INFO:teuthology.orchestra.run.gibba005.stderr:12 Nov 05:37:13 ntpd[9909]: can't open /var/log/ntpstats/loopstats.20211112: Permission denied 2021-11-12T05:37:13.979 INFO:teuthology.orchestra.run.gibba005.stdout: remote refid st t when poll reach delay offset jitter 2021-11-12T05:37:13.979 INFO:teuthology.orchestra.run.gibba005.stdout:============================================================================== 2021-11-12T05:37:13.980 INFO:teuthology.orchestra.run.gibba005.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-12T05:37:13.980 INFO:teuthology.orchestra.run.gibba005.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-12T05:37:13.980 INFO:teuthology.orchestra.run.gibba005.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-12T05:37:13.980 INFO:teuthology.orchestra.run.gibba005.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-12T05:37:13.981 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-11-12T05:37:13.981 DEBUG:teuthology.orchestra.run.gibba015:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-11-12T05:37:14.002 INFO:teuthology.orchestra.run.gibba015.stdout:12 Nov 05:37:13 ntpd[9867]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-11-12T05:37:14.002 INFO:teuthology.orchestra.run.gibba015.stdout:12 Nov 05:37:13 ntpd[9867]: Command line: ntpd -gq 2021-11-12T05:37:14.003 INFO:teuthology.orchestra.run.gibba015.stdout:12 Nov 05:37:13 ntpd[9867]: proto: precision = 0.043 usec (-24) 2021-11-12T05:37:14.003 INFO:teuthology.orchestra.run.gibba015.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-11-12T05:37:14.004 INFO:teuthology.orchestra.run.gibba015.stdout:12 Nov 05:37:14 ntpd[9867]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-11-12T05:37:14.004 INFO:teuthology.orchestra.run.gibba015.stderr:restrict ::: KOD does nothing without LIMITED. 2021-11-12T05:37:14.005 INFO:teuthology.orchestra.run.gibba015.stdout:12 Nov 05:37:14 ntpd[9867]: restrict ::: KOD does nothing without LIMITED. 2021-11-12T05:37:14.005 INFO:teuthology.orchestra.run.gibba015.stdout:12 Nov 05:37:14 ntpd[9867]: Listen and drop on 0 v6wildcard [::]:123 2021-11-12T05:37:14.006 INFO:teuthology.orchestra.run.gibba015.stdout:12 Nov 05:37:14 ntpd[9867]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-11-12T05:37:14.006 INFO:teuthology.orchestra.run.gibba015.stdout:12 Nov 05:37:14 ntpd[9867]: Listen normally on 2 lo 127.0.0.1:123 2021-11-12T05:37:14.006 INFO:teuthology.orchestra.run.gibba015.stdout:12 Nov 05:37:14 ntpd[9867]: Listen normally on 3 enp1s0f0 172.21.2.115:123 2021-11-12T05:37:14.006 INFO:teuthology.orchestra.run.gibba015.stdout:12 Nov 05:37:14 ntpd[9867]: Listen normally on 4 lo [::1]:123 2021-11-12T05:37:14.007 INFO:teuthology.orchestra.run.gibba015.stdout:12 Nov 05:37:14 ntpd[9867]: Listen normally on 5 enp1s0f0 [fe80::3eec:efff:fe3d:9252%4]:123 2021-11-12T05:37:14.007 INFO:teuthology.orchestra.run.gibba015.stdout:12 Nov 05:37:14 ntpd[9867]: Listening on routing socket on fd #22 for interface updates 2021-11-12T05:37:15.003 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:15 ntpd[9867]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:15.003 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:15 ntpd[9867]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:15.004 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:15 ntpd[9867]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:15.004 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:15 ntpd[9867]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:15.005 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:15 ntpd[9867]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:15.005 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:15 ntpd[9867]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:17.004 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:17 ntpd[9867]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:17.005 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:17 ntpd[9867]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:17.005 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:17 ntpd[9867]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:17.005 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:17 ntpd[9867]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:17.005 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:17 ntpd[9867]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:17.006 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:17 ntpd[9867]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:17.006 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:17 ntpd[9867]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:17.006 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:17 ntpd[9867]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:17.006 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:17 ntpd[9867]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:17.006 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:17 ntpd[9867]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:17.007 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:17 ntpd[9867]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:17.007 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:17 ntpd[9867]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:17.007 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:17 ntpd[9867]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:17.007 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:17 ntpd[9867]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:17.008 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:17 ntpd[9867]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:17.008 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:17 ntpd[9867]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:17.008 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:17 ntpd[9867]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:17.008 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:17 ntpd[9867]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:19.005 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:19 ntpd[9867]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:19.005 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:19 ntpd[9867]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:19.006 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:19 ntpd[9867]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:19.006 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:19 ntpd[9867]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:19.006 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:19 ntpd[9867]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:19.006 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:19 ntpd[9867]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:19.007 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:19 ntpd[9867]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:19.007 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:19 ntpd[9867]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:19.007 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:19 ntpd[9867]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:19.007 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:19 ntpd[9867]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:19.008 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:19 ntpd[9867]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:19.008 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:19 ntpd[9867]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:19.008 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:19 ntpd[9867]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:19.008 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:19 ntpd[9867]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:19.008 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:19 ntpd[9867]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:19.009 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:19 ntpd[9867]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:19.009 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:19 ntpd[9867]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:19.009 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:19 ntpd[9867]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:19.009 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:19 ntpd[9867]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:19.010 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:19 ntpd[9867]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:19.010 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:19 ntpd[9867]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:19.010 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:19 ntpd[9867]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:19.010 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:19 ntpd[9867]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:19.011 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:19 ntpd[9867]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:21.004 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:21 ntpd[9867]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:21.005 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:21 ntpd[9867]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:21.005 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:21 ntpd[9867]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:21.005 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:21 ntpd[9867]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:21.006 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:21 ntpd[9867]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:21.006 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:21 ntpd[9867]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:21.006 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:21 ntpd[9867]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:21.006 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:21 ntpd[9867]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:21.007 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:21 ntpd[9867]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:21.007 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:21 ntpd[9867]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:21.007 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:21 ntpd[9867]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:21.007 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:21 ntpd[9867]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:21.007 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:21 ntpd[9867]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:21.008 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:21 ntpd[9867]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:21.008 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:21 ntpd[9867]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:21.008 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:21 ntpd[9867]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:21.009 INFO:teuthology.orchestra.run.gibba015.stdout:12 Nov 05:37:21 ntpd[9867]: ntpd: time slew +0.001027 s 2021-11-12T05:37:21.009 INFO:teuthology.orchestra.run.gibba015.stdout:ntpd: time slew +0.001027s 2021-11-12T05:37:21.009 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:21 ntpd[9867]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-11-12T05:37:21.010 INFO:teuthology.orchestra.run.gibba015.stderr:12 Nov 05:37:21 ntpd[9867]: can't open /var/log/ntpstats/loopstats.20211112: Permission denied 2021-11-12T05:37:21.046 INFO:teuthology.orchestra.run.gibba015.stdout: remote refid st t when poll reach delay offset jitter 2021-11-12T05:37:21.047 INFO:teuthology.orchestra.run.gibba015.stdout:============================================================================== 2021-11-12T05:37:21.047 INFO:teuthology.orchestra.run.gibba015.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-12T05:37:21.047 INFO:teuthology.orchestra.run.gibba015.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-12T05:37:21.048 INFO:teuthology.orchestra.run.gibba015.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-12T05:37:21.048 INFO:teuthology.orchestra.run.gibba015.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-12T05:37:21.048 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-11-12T05:37:21.049 DEBUG:teuthology.orchestra.run.gibba016:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-11-12T05:37:21.069 INFO:teuthology.orchestra.run.gibba016.stdout:12 Nov 05:37:21 ntpd[9858]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-11-12T05:37:21.069 INFO:teuthology.orchestra.run.gibba016.stdout:12 Nov 05:37:21 ntpd[9858]: Command line: ntpd -gq 2021-11-12T05:37:21.070 INFO:teuthology.orchestra.run.gibba016.stdout:12 Nov 05:37:21 ntpd[9858]: proto: precision = 0.034 usec (-25) 2021-11-12T05:37:21.070 INFO:teuthology.orchestra.run.gibba016.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-11-12T05:37:21.071 INFO:teuthology.orchestra.run.gibba016.stdout:12 Nov 05:37:21 ntpd[9858]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-11-12T05:37:21.071 INFO:teuthology.orchestra.run.gibba016.stdout:12 Nov 05:37:21 ntpd[9858]: restrict ::: KOD does nothing without LIMITED. 2021-11-12T05:37:21.072 INFO:teuthology.orchestra.run.gibba016.stderr:restrict ::: KOD does nothing without LIMITED. 2021-11-12T05:37:21.073 INFO:teuthology.orchestra.run.gibba016.stdout:12 Nov 05:37:21 ntpd[9858]: Listen and drop on 0 v6wildcard [::]:123 2021-11-12T05:37:21.073 INFO:teuthology.orchestra.run.gibba016.stdout:12 Nov 05:37:21 ntpd[9858]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-11-12T05:37:21.073 INFO:teuthology.orchestra.run.gibba016.stdout:12 Nov 05:37:21 ntpd[9858]: Listen normally on 2 lo 127.0.0.1:123 2021-11-12T05:37:21.074 INFO:teuthology.orchestra.run.gibba016.stdout:12 Nov 05:37:21 ntpd[9858]: Listen normally on 3 enp1s0f0 172.21.2.116:123 2021-11-12T05:37:21.074 INFO:teuthology.orchestra.run.gibba016.stdout:12 Nov 05:37:21 ntpd[9858]: Listen normally on 4 lo [::1]:123 2021-11-12T05:37:21.074 INFO:teuthology.orchestra.run.gibba016.stdout:12 Nov 05:37:21 ntpd[9858]: Listen normally on 5 enp1s0f0 [fe80::3eec:efff:fe3d:8de6%4]:123 2021-11-12T05:37:21.074 INFO:teuthology.orchestra.run.gibba016.stdout:12 Nov 05:37:21 ntpd[9858]: Listening on routing socket on fd #22 for interface updates 2021-11-12T05:37:23.070 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:23 ntpd[9858]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:23.071 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:23 ntpd[9858]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:23.071 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:23 ntpd[9858]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:23.071 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:23 ntpd[9858]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:23.071 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:23 ntpd[9858]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:23.072 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:23 ntpd[9858]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:24.070 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:24 ntpd[9858]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:24.071 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:24 ntpd[9858]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:24.071 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:24 ntpd[9858]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:24.071 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:24 ntpd[9858]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:24.071 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:24 ntpd[9858]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:24.071 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:24 ntpd[9858]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:25.071 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:25 ntpd[9858]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:25.071 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:25 ntpd[9858]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:25.071 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:25 ntpd[9858]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:25.072 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:25 ntpd[9858]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:25.072 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:25 ntpd[9858]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:25.072 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:25 ntpd[9858]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:25.072 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:25 ntpd[9858]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:25.073 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:25 ntpd[9858]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:25.073 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:25 ntpd[9858]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:25.073 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:25 ntpd[9858]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:25.073 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:25 ntpd[9858]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:25.074 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:25 ntpd[9858]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:26.071 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:26 ntpd[9858]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:26.071 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:26 ntpd[9858]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:26.071 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:26 ntpd[9858]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:26.072 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:26 ntpd[9858]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:26.072 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:26 ntpd[9858]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:26.072 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:26 ntpd[9858]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:26.072 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:26 ntpd[9858]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:26.073 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:26 ntpd[9858]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:26.073 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:26 ntpd[9858]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:26.073 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:26 ntpd[9858]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:26.073 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:26 ntpd[9858]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:26.074 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:26 ntpd[9858]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:27.071 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:27 ntpd[9858]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:27.071 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:27 ntpd[9858]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:27.071 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:27 ntpd[9858]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:27.072 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:27 ntpd[9858]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:27.072 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:27 ntpd[9858]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:27.072 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:27 ntpd[9858]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:27.073 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:27 ntpd[9858]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:27.073 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:27 ntpd[9858]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:27.073 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:27 ntpd[9858]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:27.073 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:27 ntpd[9858]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:27.073 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:27 ntpd[9858]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:27.074 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:27 ntpd[9858]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:28.072 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:28 ntpd[9858]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:28.072 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:28 ntpd[9858]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:28.073 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:28 ntpd[9858]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:28.073 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:28 ntpd[9858]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:28.073 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:28 ntpd[9858]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:28.074 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:28 ntpd[9858]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:28.074 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:28 ntpd[9858]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:28.075 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:28 ntpd[9858]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:28.075 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:28 ntpd[9858]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:28.075 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:28 ntpd[9858]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:28.075 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:28 ntpd[9858]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:28.076 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:28 ntpd[9858]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:29.071 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:29 ntpd[9858]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:29.071 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:29 ntpd[9858]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:29.071 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:29 ntpd[9858]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:29.071 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:29 ntpd[9858]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:29.072 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:29 ntpd[9858]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:29.072 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:29 ntpd[9858]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:29.072 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:29 ntpd[9858]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:29.072 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:29 ntpd[9858]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:29.073 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:29 ntpd[9858]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:29.073 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:29 ntpd[9858]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:29.073 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:29 ntpd[9858]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:29.073 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:29 ntpd[9858]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:29.074 INFO:teuthology.orchestra.run.gibba016.stdout:12 Nov 05:37:29 ntpd[9858]: ntpd: time slew +0.010691 s 2021-11-12T05:37:29.074 INFO:teuthology.orchestra.run.gibba016.stdout:ntpd: time slew +0.010691s 2021-11-12T05:37:29.075 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:29 ntpd[9858]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-11-12T05:37:29.075 INFO:teuthology.orchestra.run.gibba016.stderr:12 Nov 05:37:29 ntpd[9858]: can't open /var/log/ntpstats/loopstats.20211112: Permission denied 2021-11-12T05:37:29.137 INFO:teuthology.orchestra.run.gibba016.stdout: remote refid st t when poll reach delay offset jitter 2021-11-12T05:37:29.137 INFO:teuthology.orchestra.run.gibba016.stdout:============================================================================== 2021-11-12T05:37:29.138 INFO:teuthology.orchestra.run.gibba016.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-12T05:37:29.138 INFO:teuthology.orchestra.run.gibba016.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-12T05:37:29.138 INFO:teuthology.orchestra.run.gibba016.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-12T05:37:29.138 INFO:teuthology.orchestra.run.gibba016.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-12T05:37:29.139 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-11-12T05:37:29.140 DEBUG:teuthology.orchestra.run.gibba038:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-11-12T05:37:29.160 INFO:teuthology.orchestra.run.gibba038.stdout:12 Nov 05:37:29 ntpd[9849]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-11-12T05:37:29.161 INFO:teuthology.orchestra.run.gibba038.stdout:12 Nov 05:37:29 ntpd[9849]: Command line: ntpd -gq 2021-11-12T05:37:29.161 INFO:teuthology.orchestra.run.gibba038.stdout:12 Nov 05:37:29 ntpd[9849]: proto: precision = 0.052 usec (-24) 2021-11-12T05:37:29.161 INFO:teuthology.orchestra.run.gibba038.stdout:12 Nov 05:37:29 ntpd[9849]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-11-12T05:37:29.161 INFO:teuthology.orchestra.run.gibba038.stdout:12 Nov 05:37:29 ntpd[9849]: restrict ::: KOD does nothing without LIMITED. 2021-11-12T05:37:29.162 INFO:teuthology.orchestra.run.gibba038.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-11-12T05:37:29.162 INFO:teuthology.orchestra.run.gibba038.stderr:restrict ::: KOD does nothing without LIMITED. 2021-11-12T05:37:29.163 INFO:teuthology.orchestra.run.gibba038.stdout:12 Nov 05:37:29 ntpd[9849]: Listen and drop on 0 v6wildcard [::]:123 2021-11-12T05:37:29.163 INFO:teuthology.orchestra.run.gibba038.stdout:12 Nov 05:37:29 ntpd[9849]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-11-12T05:37:29.163 INFO:teuthology.orchestra.run.gibba038.stdout:12 Nov 05:37:29 ntpd[9849]: Listen normally on 2 lo 127.0.0.1:123 2021-11-12T05:37:29.164 INFO:teuthology.orchestra.run.gibba038.stdout:12 Nov 05:37:29 ntpd[9849]: Listen normally on 3 enp1s0f0 172.21.2.138:123 2021-11-12T05:37:29.164 INFO:teuthology.orchestra.run.gibba038.stdout:12 Nov 05:37:29 ntpd[9849]: Listen normally on 4 lo [::1]:123 2021-11-12T05:37:29.164 INFO:teuthology.orchestra.run.gibba038.stdout:12 Nov 05:37:29 ntpd[9849]: Listen normally on 5 enp1s0f0 [fe80::3eec:efff:fe3d:9112%3]:123 2021-11-12T05:37:29.164 INFO:teuthology.orchestra.run.gibba038.stdout:12 Nov 05:37:29 ntpd[9849]: Listening on routing socket on fd #22 for interface updates 2021-11-12T05:37:30.161 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:30 ntpd[9849]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:30.162 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:30 ntpd[9849]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:30.162 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:30 ntpd[9849]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:30.162 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:30 ntpd[9849]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:30.163 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:30 ntpd[9849]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:30.163 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:30 ntpd[9849]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:31.163 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:31 ntpd[9849]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:31.164 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:31 ntpd[9849]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:31.164 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:31 ntpd[9849]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:31.165 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:31 ntpd[9849]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:31.165 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:31 ntpd[9849]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:31.166 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:31 ntpd[9849]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:31.167 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:31 ntpd[9849]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:31.167 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:31 ntpd[9849]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:31.167 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:31 ntpd[9849]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:31.167 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:31 ntpd[9849]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:31.167 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:31 ntpd[9849]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:31.168 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:31 ntpd[9849]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:32.161 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:32 ntpd[9849]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:32.162 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:32 ntpd[9849]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:32.162 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:32 ntpd[9849]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:32.162 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:32 ntpd[9849]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:32.162 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:32 ntpd[9849]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:32.163 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:32 ntpd[9849]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:33.162 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:33 ntpd[9849]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:33.162 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:33 ntpd[9849]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:33.162 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:33 ntpd[9849]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:33.162 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:33 ntpd[9849]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:33.163 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:33 ntpd[9849]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:33.163 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:33 ntpd[9849]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:33.163 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:33 ntpd[9849]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:33.163 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:33 ntpd[9849]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:33.164 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:33 ntpd[9849]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:33.164 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:33 ntpd[9849]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:33.164 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:33 ntpd[9849]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:33.164 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:33 ntpd[9849]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:34.162 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:34 ntpd[9849]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:34.162 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:34 ntpd[9849]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:34.162 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:34 ntpd[9849]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:34.163 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:34 ntpd[9849]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:34.163 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:34 ntpd[9849]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:34.163 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:34 ntpd[9849]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:34.163 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:34 ntpd[9849]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:34.164 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:34 ntpd[9849]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:34.164 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:34 ntpd[9849]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:34.164 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:34 ntpd[9849]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:34.164 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:34 ntpd[9849]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:34.164 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:34 ntpd[9849]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:35.162 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:35 ntpd[9849]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:35.163 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:35 ntpd[9849]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:35.163 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:35 ntpd[9849]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:35.163 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:35 ntpd[9849]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:35.163 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:35 ntpd[9849]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:35.164 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:35 ntpd[9849]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:35.164 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:35 ntpd[9849]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:35.164 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:35 ntpd[9849]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:35.164 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:35 ntpd[9849]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:35.164 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:35 ntpd[9849]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:35.165 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:35 ntpd[9849]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:35.165 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:35 ntpd[9849]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:36.162 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:36 ntpd[9849]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:36.162 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:36 ntpd[9849]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:36.162 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:36 ntpd[9849]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:36.163 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:36 ntpd[9849]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:36.163 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:36 ntpd[9849]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:36.163 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:36 ntpd[9849]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:36.163 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:36 ntpd[9849]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:36.163 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:36 ntpd[9849]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:36.164 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:36 ntpd[9849]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:36.164 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:36 ntpd[9849]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:36.164 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:36 ntpd[9849]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:36.164 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:36 ntpd[9849]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:36.165 INFO:teuthology.orchestra.run.gibba038.stdout:12 Nov 05:37:36 ntpd[9849]: ntpd: time slew +0.008961 s 2021-11-12T05:37:36.165 INFO:teuthology.orchestra.run.gibba038.stdout:ntpd: time slew +0.008961s 2021-11-12T05:37:36.166 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:36 ntpd[9849]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-11-12T05:37:36.166 INFO:teuthology.orchestra.run.gibba038.stderr:12 Nov 05:37:36 ntpd[9849]: can't open /var/log/ntpstats/loopstats.20211112: Permission denied 2021-11-12T05:37:36.204 INFO:teuthology.orchestra.run.gibba038.stdout: remote refid st t when poll reach delay offset jitter 2021-11-12T05:37:36.205 INFO:teuthology.orchestra.run.gibba038.stdout:============================================================================== 2021-11-12T05:37:36.205 INFO:teuthology.orchestra.run.gibba038.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-12T05:37:36.205 INFO:teuthology.orchestra.run.gibba038.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-12T05:37:36.206 INFO:teuthology.orchestra.run.gibba038.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-12T05:37:36.206 INFO:teuthology.orchestra.run.gibba038.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-12T05:37:36.206 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-11-12T05:37:36.207 DEBUG:teuthology.orchestra.run.gibba044:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-11-12T05:37:36.227 INFO:teuthology.orchestra.run.gibba044.stdout:12 Nov 05:37:36 ntpd[9838]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-11-12T05:37:36.227 INFO:teuthology.orchestra.run.gibba044.stdout:12 Nov 05:37:36 ntpd[9838]: Command line: ntpd -gq 2021-11-12T05:37:36.227 INFO:teuthology.orchestra.run.gibba044.stdout:12 Nov 05:37:36 ntpd[9838]: proto: precision = 0.035 usec (-25) 2021-11-12T05:37:36.228 INFO:teuthology.orchestra.run.gibba044.stdout:12 Nov 05:37:36 ntpd[9838]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-11-12T05:37:36.228 INFO:teuthology.orchestra.run.gibba044.stdout:12 Nov 05:37:36 ntpd[9838]: restrict ::: KOD does nothing without LIMITED. 2021-11-12T05:37:36.228 INFO:teuthology.orchestra.run.gibba044.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-11-12T05:37:36.229 INFO:teuthology.orchestra.run.gibba044.stderr:restrict ::: KOD does nothing without LIMITED. 2021-11-12T05:37:36.229 INFO:teuthology.orchestra.run.gibba044.stdout:12 Nov 05:37:36 ntpd[9838]: Listen and drop on 0 v6wildcard [::]:123 2021-11-12T05:37:36.230 INFO:teuthology.orchestra.run.gibba044.stdout:12 Nov 05:37:36 ntpd[9838]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-11-12T05:37:36.230 INFO:teuthology.orchestra.run.gibba044.stdout:12 Nov 05:37:36 ntpd[9838]: Listen normally on 2 lo 127.0.0.1:123 2021-11-12T05:37:36.230 INFO:teuthology.orchestra.run.gibba044.stdout:12 Nov 05:37:36 ntpd[9838]: Listen normally on 3 enp1s0f0 172.21.2.144:123 2021-11-12T05:37:36.230 INFO:teuthology.orchestra.run.gibba044.stdout:12 Nov 05:37:36 ntpd[9838]: Listen normally on 4 lo [::1]:123 2021-11-12T05:37:36.231 INFO:teuthology.orchestra.run.gibba044.stdout:12 Nov 05:37:36 ntpd[9838]: Listen normally on 5 enp1s0f0 [fe80::3eec:efff:fe3d:9198%4]:123 2021-11-12T05:37:36.231 INFO:teuthology.orchestra.run.gibba044.stdout:12 Nov 05:37:36 ntpd[9838]: Listening on routing socket on fd #22 for interface updates 2021-11-12T05:37:37.227 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:37 ntpd[9838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:37.227 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:37 ntpd[9838]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:37.228 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:37 ntpd[9838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:37.229 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:37 ntpd[9838]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:37.229 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:37 ntpd[9838]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:37.229 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:37 ntpd[9838]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:38.228 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:38 ntpd[9838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:38.228 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:38 ntpd[9838]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:38.228 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:38 ntpd[9838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:38.228 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:38 ntpd[9838]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:38.229 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:38 ntpd[9838]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:38.229 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:38 ntpd[9838]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:39.228 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:39 ntpd[9838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:39.229 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:39 ntpd[9838]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:39.229 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:39 ntpd[9838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:39.230 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:39 ntpd[9838]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:39.230 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:39 ntpd[9838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:39.231 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:39 ntpd[9838]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:39.231 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:39 ntpd[9838]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:39.232 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:39 ntpd[9838]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:39.232 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:39 ntpd[9838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:39.232 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:39 ntpd[9838]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:39.233 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:39 ntpd[9838]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:39.233 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:39 ntpd[9838]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:40.228 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:40 ntpd[9838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:40.228 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:40 ntpd[9838]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:40.228 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:40 ntpd[9838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:40.229 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:40 ntpd[9838]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:40.229 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:40 ntpd[9838]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:40.229 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:40 ntpd[9838]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:41.228 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:41 ntpd[9838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:41.229 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:41 ntpd[9838]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:41.229 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:41 ntpd[9838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:41.229 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:41 ntpd[9838]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:41.229 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:41 ntpd[9838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:41.230 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:41 ntpd[9838]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:41.230 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:41 ntpd[9838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:41.230 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:41 ntpd[9838]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:41.230 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:41 ntpd[9838]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:41.231 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:41 ntpd[9838]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:41.231 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:41 ntpd[9838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:41.231 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:41 ntpd[9838]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:41.231 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:41 ntpd[9838]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:41.231 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:41 ntpd[9838]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:41.232 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:41 ntpd[9838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:41.232 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:41 ntpd[9838]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:41.232 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:41 ntpd[9838]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:41.232 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:41 ntpd[9838]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:42.228 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:42 ntpd[9838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:42.228 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:42 ntpd[9838]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:42.228 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:42 ntpd[9838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:42.229 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:42 ntpd[9838]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:42.229 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:42 ntpd[9838]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:42.229 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:42 ntpd[9838]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:43.228 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:43 ntpd[9838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:43.229 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:43 ntpd[9838]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:43.229 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:43 ntpd[9838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:43.229 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:43 ntpd[9838]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:43.229 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:43 ntpd[9838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:43.230 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:43 ntpd[9838]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:43.230 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:43 ntpd[9838]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-11-12T05:37:43.230 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:43 ntpd[9838]: can't open /var/log/ntpstats/rawstats.20211112: Permission denied 2021-11-12T05:37:43.230 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:43 ntpd[9838]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-11-12T05:37:43.231 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:43 ntpd[9838]: can't open /var/log/ntpstats/peerstats.20211112: Permission denied 2021-11-12T05:37:43.231 INFO:teuthology.orchestra.run.gibba044.stdout:12 Nov 05:37:43 ntpd[9838]: ntpd: time slew -0.000309 s 2021-11-12T05:37:43.231 INFO:teuthology.orchestra.run.gibba044.stdout:ntpd: time slew -0.000309s 2021-11-12T05:37:43.232 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:43 ntpd[9838]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-11-12T05:37:43.232 INFO:teuthology.orchestra.run.gibba044.stderr:12 Nov 05:37:43 ntpd[9838]: can't open /var/log/ntpstats/loopstats.20211112: Permission denied 2021-11-12T05:37:43.265 INFO:teuthology.orchestra.run.gibba044.stdout: remote refid st t when poll reach delay offset jitter 2021-11-12T05:37:43.265 INFO:teuthology.orchestra.run.gibba044.stdout:============================================================================== 2021-11-12T05:37:43.265 INFO:teuthology.orchestra.run.gibba044.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-12T05:37:43.265 INFO:teuthology.orchestra.run.gibba044.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-12T05:37:43.266 INFO:teuthology.orchestra.run.gibba044.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-12T05:37:43.266 INFO:teuthology.orchestra.run.gibba044.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-11-12T05:37:43.266 INFO:teuthology.run_tasks:Running task install... 2021-11-12T05:37:43.277 DEBUG:teuthology.task.install:project ceph 2021-11-12T05:37:43.278 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a81ee2815de5acae59ead5b8c9137b6766fc8ea8'}} 2021-11-12T05:37:43.278 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'a81ee2815de5acae59ead5b8c9137b6766fc8ea8'} 2021-11-12T05:37:43.279 INFO:teuthology.task.install:Using flavor: default 2021-11-12T05:37:43.285 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-11-12T05:37:43.286 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']} 2021-11-12T05:37:43.286 DEBUG:teuthology.orchestra.run.gibba005:> sudo lsb_release -is 2021-11-12T05:37:43.314 INFO:teuthology.orchestra.run.gibba005.stdout:Ubuntu 2021-11-12T05:37:43.317 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-12T05:37:43.317 DEBUG:teuthology.orchestra.run.gibba015:> sudo lsb_release -is 2021-11-12T05:37:43.319 DEBUG:teuthology.orchestra.run.gibba005:> sudo apt-key list | grep Ceph 2021-11-12T05:37:43.345 INFO:teuthology.orchestra.run.gibba015.stdout:Ubuntu 2021-11-12T05:37:43.348 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-12T05:37:43.348 DEBUG:teuthology.orchestra.run.gibba016:> sudo lsb_release -is 2021-11-12T05:37:43.349 DEBUG:teuthology.orchestra.run.gibba015:> sudo apt-key list | grep Ceph 2021-11-12T05:37:43.375 INFO:teuthology.orchestra.run.gibba016.stdout:Ubuntu 2021-11-12T05:37:43.378 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-12T05:37:43.378 DEBUG:teuthology.orchestra.run.gibba038:> sudo lsb_release -is 2021-11-12T05:37:43.379 DEBUG:teuthology.orchestra.run.gibba016:> sudo apt-key list | grep Ceph 2021-11-12T05:37:43.381 INFO:teuthology.orchestra.run.gibba015.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-11-12T05:37:43.406 INFO:teuthology.orchestra.run.gibba015.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-11-12T05:37:43.407 INFO:teuthology.orchestra.run.gibba015.stdout:uid [ unknown] Ceph.com (release key) 2021-11-12T05:37:43.407 DEBUG:teuthology.orchestra.run.gibba015:> sudo lsb_release -is 2021-11-12T05:37:43.409 INFO:teuthology.orchestra.run.gibba038.stdout:Ubuntu 2021-11-12T05:37:43.409 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-12T05:37:43.409 DEBUG:teuthology.orchestra.run.gibba044:> sudo lsb_release -is 2021-11-12T05:37:43.410 DEBUG:teuthology.orchestra.run.gibba038:> sudo apt-key list | grep Ceph 2021-11-12T05:37:43.411 INFO:teuthology.orchestra.run.gibba005.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-11-12T05:37:43.431 INFO:teuthology.orchestra.run.gibba005.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-11-12T05:37:43.432 INFO:teuthology.orchestra.run.gibba005.stdout:uid [ unknown] Ceph.com (release key) 2021-11-12T05:37:43.432 DEBUG:teuthology.orchestra.run.gibba005:> sudo lsb_release -is 2021-11-12T05:37:43.445 INFO:teuthology.orchestra.run.gibba038.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-11-12T05:37:43.450 INFO:teuthology.orchestra.run.gibba044.stdout:Ubuntu 2021-11-12T05:37:43.451 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-12T05:37:43.452 DEBUG:teuthology.orchestra.run.gibba044:> sudo apt-key list | grep Ceph 2021-11-12T05:37:43.458 INFO:teuthology.orchestra.run.gibba005.stdout:Ubuntu 2021-11-12T05:37:43.460 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-12T05:37:43.461 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-11-12T05:37:43.461 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-11-12T05:37:43.461 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=a81ee2815de5acae59ead5b8c9137b6766fc8ea8 2021-11-12T05:37:43.474 INFO:teuthology.orchestra.run.gibba038.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-11-12T05:37:43.474 INFO:teuthology.orchestra.run.gibba038.stdout:uid [ unknown] Ceph.com (release key) 2021-11-12T05:37:43.475 DEBUG:teuthology.orchestra.run.gibba038:> sudo lsb_release -is 2021-11-12T05:37:43.476 INFO:teuthology.orchestra.run.gibba015.stdout:Ubuntu 2021-11-12T05:37:43.477 INFO:teuthology.orchestra.run.gibba016.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-11-12T05:37:43.479 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-12T05:37:43.479 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-11-12T05:37:43.480 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-11-12T05:37:43.480 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=a81ee2815de5acae59ead5b8c9137b6766fc8ea8 2021-11-12T05:37:43.496 INFO:teuthology.orchestra.run.gibba016.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-11-12T05:37:43.497 INFO:teuthology.orchestra.run.gibba016.stdout:uid [ unknown] Ceph.com (release key) 2021-11-12T05:37:43.497 DEBUG:teuthology.orchestra.run.gibba016:> sudo lsb_release -is 2021-11-12T05:37:43.524 INFO:teuthology.orchestra.run.gibba016.stdout:Ubuntu 2021-11-12T05:37:43.528 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-12T05:37:43.528 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-11-12T05:37:43.528 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-11-12T05:37:43.529 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=a81ee2815de5acae59ead5b8c9137b6766fc8ea8 2021-11-12T05:37:43.550 INFO:teuthology.orchestra.run.gibba038.stdout:Ubuntu 2021-11-12T05:37:43.552 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-12T05:37:43.553 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-11-12T05:37:43.553 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-11-12T05:37:43.553 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=a81ee2815de5acae59ead5b8c9137b6766fc8ea8 2021-11-12T05:37:43.563 INFO:teuthology.orchestra.run.gibba044.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-11-12T05:37:43.583 INFO:teuthology.orchestra.run.gibba044.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-11-12T05:37:43.583 INFO:teuthology.orchestra.run.gibba044.stdout:uid [ unknown] Ceph.com (release key) 2021-11-12T05:37:43.584 DEBUG:teuthology.orchestra.run.gibba044:> sudo lsb_release -is 2021-11-12T05:37:43.609 INFO:teuthology.orchestra.run.gibba044.stdout:Ubuntu 2021-11-12T05:37:43.611 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-12T05:37:43.612 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-11-12T05:37:43.612 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-11-12T05:37:43.612 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=a81ee2815de5acae59ead5b8c9137b6766fc8ea8 2021-11-12T05:37:43.696 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default/ 2021-11-12T05:37:43.696 INFO:teuthology.task.install.deb:Package version is 15.2.15-22-ga81ee281-1focal 2021-11-12T05:37:43.702 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default/ 2021-11-12T05:37:43.702 INFO:teuthology.task.install.deb:Package version is 15.2.15-22-ga81ee281-1focal 2021-11-12T05:37:43.742 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default/ 2021-11-12T05:37:43.742 INFO:teuthology.task.install.deb:Package version is 15.2.15-22-ga81ee281-1focal 2021-11-12T05:37:43.772 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default/ 2021-11-12T05:37:43.773 INFO:teuthology.task.install.deb:Package version is 15.2.15-22-ga81ee281-1focal 2021-11-12T05:37:43.821 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default/ 2021-11-12T05:37:43.822 INFO:teuthology.task.install.deb:Package version is 15.2.15-22-ga81ee281-1focal 2021-11-12T05:37:43.859 DEBUG:teuthology.orchestra.run.gibba015:> set -ex 2021-11-12T05:37:43.860 DEBUG:teuthology.orchestra.run.gibba015:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-11-12T05:37:43.873 DEBUG:teuthology.orchestra.run.gibba015:> sudo apt-get update 2021-11-12T05:37:43.877 DEBUG:teuthology.orchestra.run.gibba005:> set -ex 2021-11-12T05:37:43.878 DEBUG:teuthology.orchestra.run.gibba005:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-11-12T05:37:43.892 DEBUG:teuthology.orchestra.run.gibba005:> sudo apt-get update 2021-11-12T05:37:43.909 DEBUG:teuthology.orchestra.run.gibba016:> set -ex 2021-11-12T05:37:43.910 DEBUG:teuthology.orchestra.run.gibba016:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-11-12T05:37:43.921 DEBUG:teuthology.orchestra.run.gibba016:> sudo apt-get update 2021-11-12T05:37:43.950 DEBUG:teuthology.orchestra.run.gibba038:> set -ex 2021-11-12T05:37:43.951 DEBUG:teuthology.orchestra.run.gibba038:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-11-12T05:37:43.962 DEBUG:teuthology.orchestra.run.gibba038:> sudo apt-get update 2021-11-12T05:37:44.007 DEBUG:teuthology.orchestra.run.gibba044:> set -ex 2021-11-12T05:37:44.007 DEBUG:teuthology.orchestra.run.gibba044:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-11-12T05:37:44.019 DEBUG:teuthology.orchestra.run.gibba044:> sudo apt-get update 2021-11-12T05:37:44.020 INFO:teuthology.orchestra.run.gibba005.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-11-12T05:37:44.072 INFO:teuthology.orchestra.run.gibba015.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal InRelease 2021-11-12T05:37:44.084 INFO:teuthology.orchestra.run.gibba015.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-12T05:37:44.098 INFO:teuthology.orchestra.run.gibba015.stdout:Hit:3 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-11-12T05:37:44.100 INFO:teuthology.orchestra.run.gibba038.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-11-12T05:37:44.106 INFO:teuthology.orchestra.run.gibba015.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-11-12T05:37:44.124 INFO:teuthology.orchestra.run.gibba005.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal InRelease 2021-11-12T05:37:44.140 INFO:teuthology.orchestra.run.gibba015.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal Release.gpg 2021-11-12T05:37:44.146 INFO:teuthology.orchestra.run.gibba005.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-12T05:37:44.150 INFO:teuthology.orchestra.run.gibba044.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-11-12T05:37:44.154 INFO:teuthology.orchestra.run.gibba016.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal InRelease 2021-11-12T05:37:44.158 INFO:teuthology.orchestra.run.gibba005.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-11-12T05:37:44.160 INFO:teuthology.orchestra.run.gibba015.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-11-12T05:37:44.174 INFO:teuthology.orchestra.run.gibba015.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main i386 Packages [3,039 B] 2021-11-12T05:37:44.182 INFO:teuthology.orchestra.run.gibba016.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-12T05:37:44.183 INFO:teuthology.orchestra.run.gibba016.stdout:Hit:3 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-11-12T05:37:44.188 INFO:teuthology.orchestra.run.gibba016.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-11-12T05:37:44.192 INFO:teuthology.orchestra.run.gibba005.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal Release.gpg 2021-11-12T05:37:44.202 INFO:teuthology.orchestra.run.gibba038.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal InRelease 2021-11-12T05:37:44.218 INFO:teuthology.orchestra.run.gibba015.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 Packages [15.8 kB] 2021-11-12T05:37:44.221 INFO:teuthology.orchestra.run.gibba038.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-12T05:37:44.222 INFO:teuthology.orchestra.run.gibba016.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal Release.gpg 2021-11-12T05:37:44.226 INFO:teuthology.orchestra.run.gibba005.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main i386 Packages [3,039 B] 2021-11-12T05:37:44.236 INFO:teuthology.orchestra.run.gibba038.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-11-12T05:37:44.242 INFO:teuthology.orchestra.run.gibba005.stdout:Hit:7 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-11-12T05:37:44.242 INFO:teuthology.orchestra.run.gibba015.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-11-12T05:37:44.257 INFO:teuthology.orchestra.run.gibba016.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 Packages [15.8 kB] 2021-11-12T05:37:44.257 INFO:teuthology.orchestra.run.gibba016.stdout:Hit:7 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-11-12T05:37:44.263 INFO:teuthology.orchestra.run.gibba044.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal InRelease 2021-11-12T05:37:44.270 INFO:teuthology.orchestra.run.gibba038.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal Release.gpg 2021-11-12T05:37:44.271 INFO:teuthology.orchestra.run.gibba044.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal InRelease 2021-11-12T05:37:44.276 INFO:teuthology.orchestra.run.gibba005.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 Packages [15.8 kB] 2021-11-12T05:37:44.301 INFO:teuthology.orchestra.run.gibba016.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main i386 Packages [3,039 B] 2021-11-12T05:37:44.301 INFO:teuthology.orchestra.run.gibba044.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-11-12T05:37:44.303 INFO:teuthology.orchestra.run.gibba038.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-11-12T05:37:44.304 INFO:teuthology.orchestra.run.gibba038.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 Packages [15.8 kB] 2021-11-12T05:37:44.311 INFO:teuthology.orchestra.run.gibba005.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-11-12T05:37:44.340 INFO:teuthology.orchestra.run.gibba016.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-11-12T05:37:44.340 INFO:teuthology.orchestra.run.gibba044.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal Release.gpg 2021-11-12T05:37:44.354 INFO:teuthology.orchestra.run.gibba044.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-11-12T05:37:44.354 INFO:teuthology.orchestra.run.gibba038.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main i386 Packages [3,039 B] 2021-11-12T05:37:44.378 INFO:teuthology.orchestra.run.gibba044.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 Packages [15.8 kB] 2021-11-12T05:37:44.385 INFO:teuthology.orchestra.run.gibba038.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-11-12T05:37:44.429 INFO:teuthology.orchestra.run.gibba044.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main i386 Packages [3,039 B] 2021-11-12T05:37:44.436 INFO:teuthology.orchestra.run.gibba044.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-11-12T05:37:44.501 INFO:teuthology.orchestra.run.gibba005.stdout:Fetched 26.5 kB in 0s (63.3 kB/s) 2021-11-12T05:37:44.559 INFO:teuthology.orchestra.run.gibba015.stdout:Fetched 26.5 kB in 1s (48.3 kB/s) 2021-11-12T05:37:44.574 INFO:teuthology.orchestra.run.gibba044.stdout:Fetched 26.5 kB in 0s (66.9 kB/s) 2021-11-12T05:37:44.592 INFO:teuthology.orchestra.run.gibba038.stdout:Fetched 26.5 kB in 0s (55.5 kB/s) 2021-11-12T05:37:44.650 INFO:teuthology.orchestra.run.gibba016.stdout:Fetched 26.5 kB in 1s (47.6 kB/s) 2021-11-12T05:37:45.027 INFO:teuthology.orchestra.run.gibba005.stdout:Reading package lists... 2021-11-12T05:37:45.038 DEBUG:teuthology.orchestra.run.gibba005:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.15-22-ga81ee281-1focal cephadm=15.2.15-22-ga81ee281-1focal ceph-mds=15.2.15-22-ga81ee281-1focal ceph-mgr=15.2.15-22-ga81ee281-1focal ceph-common=15.2.15-22-ga81ee281-1focal ceph-fuse=15.2.15-22-ga81ee281-1focal ceph-test=15.2.15-22-ga81ee281-1focal radosgw=15.2.15-22-ga81ee281-1focal python3-rados=15.2.15-22-ga81ee281-1focal python3-rgw=15.2.15-22-ga81ee281-1focal python3-cephfs=15.2.15-22-ga81ee281-1focal python3-rbd=15.2.15-22-ga81ee281-1focal libcephfs2=15.2.15-22-ga81ee281-1focal libcephfs-dev=15.2.15-22-ga81ee281-1focal librados2=15.2.15-22-ga81ee281-1focal librbd1=15.2.15-22-ga81ee281-1focal rbd-fuse=15.2.15-22-ga81ee281-1focal python3-cephfs=15.2.15-22-ga81ee281-1focal cephfs-shell=15.2.15-22-ga81ee281-1focal 2021-11-12T05:37:45.074 INFO:teuthology.orchestra.run.gibba005.stdout:Reading package lists... 2021-11-12T05:37:45.079 INFO:teuthology.orchestra.run.gibba015.stdout:Reading package lists... 2021-11-12T05:37:45.090 DEBUG:teuthology.orchestra.run.gibba015:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.15-22-ga81ee281-1focal cephadm=15.2.15-22-ga81ee281-1focal ceph-mds=15.2.15-22-ga81ee281-1focal ceph-mgr=15.2.15-22-ga81ee281-1focal ceph-common=15.2.15-22-ga81ee281-1focal ceph-fuse=15.2.15-22-ga81ee281-1focal ceph-test=15.2.15-22-ga81ee281-1focal radosgw=15.2.15-22-ga81ee281-1focal python3-rados=15.2.15-22-ga81ee281-1focal python3-rgw=15.2.15-22-ga81ee281-1focal python3-cephfs=15.2.15-22-ga81ee281-1focal python3-rbd=15.2.15-22-ga81ee281-1focal libcephfs2=15.2.15-22-ga81ee281-1focal libcephfs-dev=15.2.15-22-ga81ee281-1focal librados2=15.2.15-22-ga81ee281-1focal librbd1=15.2.15-22-ga81ee281-1focal rbd-fuse=15.2.15-22-ga81ee281-1focal python3-cephfs=15.2.15-22-ga81ee281-1focal cephfs-shell=15.2.15-22-ga81ee281-1focal 2021-11-12T05:37:45.097 INFO:teuthology.orchestra.run.gibba044.stdout:Reading package lists... 2021-11-12T05:37:45.108 DEBUG:teuthology.orchestra.run.gibba044:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.15-22-ga81ee281-1focal cephadm=15.2.15-22-ga81ee281-1focal ceph-mds=15.2.15-22-ga81ee281-1focal ceph-mgr=15.2.15-22-ga81ee281-1focal ceph-common=15.2.15-22-ga81ee281-1focal ceph-fuse=15.2.15-22-ga81ee281-1focal ceph-test=15.2.15-22-ga81ee281-1focal radosgw=15.2.15-22-ga81ee281-1focal python3-rados=15.2.15-22-ga81ee281-1focal python3-rgw=15.2.15-22-ga81ee281-1focal python3-cephfs=15.2.15-22-ga81ee281-1focal python3-rbd=15.2.15-22-ga81ee281-1focal libcephfs2=15.2.15-22-ga81ee281-1focal libcephfs-dev=15.2.15-22-ga81ee281-1focal librados2=15.2.15-22-ga81ee281-1focal librbd1=15.2.15-22-ga81ee281-1focal rbd-fuse=15.2.15-22-ga81ee281-1focal python3-cephfs=15.2.15-22-ga81ee281-1focal cephfs-shell=15.2.15-22-ga81ee281-1focal 2021-11-12T05:37:45.109 INFO:teuthology.orchestra.run.gibba038.stdout:Reading package lists... 2021-11-12T05:37:45.119 DEBUG:teuthology.orchestra.run.gibba038:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.15-22-ga81ee281-1focal cephadm=15.2.15-22-ga81ee281-1focal ceph-mds=15.2.15-22-ga81ee281-1focal ceph-mgr=15.2.15-22-ga81ee281-1focal ceph-common=15.2.15-22-ga81ee281-1focal ceph-fuse=15.2.15-22-ga81ee281-1focal ceph-test=15.2.15-22-ga81ee281-1focal radosgw=15.2.15-22-ga81ee281-1focal python3-rados=15.2.15-22-ga81ee281-1focal python3-rgw=15.2.15-22-ga81ee281-1focal python3-cephfs=15.2.15-22-ga81ee281-1focal python3-rbd=15.2.15-22-ga81ee281-1focal libcephfs2=15.2.15-22-ga81ee281-1focal libcephfs-dev=15.2.15-22-ga81ee281-1focal librados2=15.2.15-22-ga81ee281-1focal librbd1=15.2.15-22-ga81ee281-1focal rbd-fuse=15.2.15-22-ga81ee281-1focal python3-cephfs=15.2.15-22-ga81ee281-1focal cephfs-shell=15.2.15-22-ga81ee281-1focal 2021-11-12T05:37:45.126 INFO:teuthology.orchestra.run.gibba015.stdout:Reading package lists... 2021-11-12T05:37:45.144 INFO:teuthology.orchestra.run.gibba044.stdout:Reading package lists... 2021-11-12T05:37:45.155 INFO:teuthology.orchestra.run.gibba038.stdout:Reading package lists... 2021-11-12T05:37:45.168 INFO:teuthology.orchestra.run.gibba016.stdout:Reading package lists... 2021-11-12T05:37:45.175 INFO:teuthology.orchestra.run.gibba005.stdout:Building dependency tree... 2021-11-12T05:37:45.176 INFO:teuthology.orchestra.run.gibba005.stdout:Reading state information... 2021-11-12T05:37:45.179 DEBUG:teuthology.orchestra.run.gibba016:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.15-22-ga81ee281-1focal cephadm=15.2.15-22-ga81ee281-1focal ceph-mds=15.2.15-22-ga81ee281-1focal ceph-mgr=15.2.15-22-ga81ee281-1focal ceph-common=15.2.15-22-ga81ee281-1focal ceph-fuse=15.2.15-22-ga81ee281-1focal ceph-test=15.2.15-22-ga81ee281-1focal radosgw=15.2.15-22-ga81ee281-1focal python3-rados=15.2.15-22-ga81ee281-1focal python3-rgw=15.2.15-22-ga81ee281-1focal python3-cephfs=15.2.15-22-ga81ee281-1focal python3-rbd=15.2.15-22-ga81ee281-1focal libcephfs2=15.2.15-22-ga81ee281-1focal libcephfs-dev=15.2.15-22-ga81ee281-1focal librados2=15.2.15-22-ga81ee281-1focal librbd1=15.2.15-22-ga81ee281-1focal rbd-fuse=15.2.15-22-ga81ee281-1focal python3-cephfs=15.2.15-22-ga81ee281-1focal cephfs-shell=15.2.15-22-ga81ee281-1focal 2021-11-12T05:37:45.215 INFO:teuthology.orchestra.run.gibba016.stdout:Reading package lists... 2021-11-12T05:37:45.231 INFO:teuthology.orchestra.run.gibba015.stdout:Building dependency tree... 2021-11-12T05:37:45.232 INFO:teuthology.orchestra.run.gibba015.stdout:Reading state information... 2021-11-12T05:37:45.248 INFO:teuthology.orchestra.run.gibba044.stdout:Building dependency tree... 2021-11-12T05:37:45.249 INFO:teuthology.orchestra.run.gibba044.stdout:Reading state information... 2021-11-12T05:37:45.256 INFO:teuthology.orchestra.run.gibba005.stdout:The following packages were automatically installed and are no longer required: 2021-11-12T05:37:45.257 INFO:teuthology.orchestra.run.gibba005.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-11-12T05:37:45.257 INFO:teuthology.orchestra.run.gibba005.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-12T05:37:45.257 INFO:teuthology.orchestra.run.gibba005.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-12T05:37:45.257 INFO:teuthology.orchestra.run.gibba005.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-12T05:37:45.257 INFO:teuthology.orchestra.run.gibba005.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-12T05:37:45.258 INFO:teuthology.orchestra.run.gibba005.stdout:The following additional packages will be installed: 2021-11-12T05:37:45.258 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-11-12T05:37:45.258 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-11-12T05:37:45.258 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-11-12T05:37:45.259 INFO:teuthology.orchestra.run.gibba005.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-11-12T05:37:45.259 INFO:teuthology.orchestra.run.gibba005.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2021-11-12T05:37:45.259 INFO:teuthology.orchestra.run.gibba005.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2021-11-12T05:37:45.259 INFO:teuthology.orchestra.run.gibba005.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2021-11-12T05:37:45.259 INFO:teuthology.orchestra.run.gibba005.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-11-12T05:37:45.260 INFO:teuthology.orchestra.run.gibba005.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2021-11-12T05:37:45.260 INFO:teuthology.orchestra.run.gibba005.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2021-11-12T05:37:45.260 INFO:teuthology.orchestra.run.gibba005.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2021-11-12T05:37:45.260 INFO:teuthology.orchestra.run.gibba005.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2021-11-12T05:37:45.260 INFO:teuthology.orchestra.run.gibba005.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2021-11-12T05:37:45.261 INFO:teuthology.orchestra.run.gibba005.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2021-11-12T05:37:45.261 INFO:teuthology.orchestra.run.gibba005.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2021-11-12T05:37:45.261 INFO:teuthology.orchestra.run.gibba005.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2021-11-12T05:37:45.261 INFO:teuthology.orchestra.run.gibba005.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-11-12T05:37:45.261 INFO:teuthology.orchestra.run.gibba005.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-11-12T05:37:45.262 INFO:teuthology.orchestra.run.gibba005.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2021-11-12T05:37:45.262 INFO:teuthology.orchestra.run.gibba005.stdout: xmlstarlet 2021-11-12T05:37:45.262 INFO:teuthology.orchestra.run.gibba005.stdout:Suggested packages: 2021-11-12T05:37:45.262 INFO:teuthology.orchestra.run.gibba005.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-11-12T05:37:45.263 INFO:teuthology.orchestra.run.gibba005.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-11-12T05:37:45.263 INFO:teuthology.orchestra.run.gibba005.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-11-12T05:37:45.263 INFO:teuthology.orchestra.run.gibba005.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-11-12T05:37:45.263 INFO:teuthology.orchestra.run.gibba005.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-11-12T05:37:45.263 INFO:teuthology.orchestra.run.gibba005.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-11-12T05:37:45.264 INFO:teuthology.orchestra.run.gibba005.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-11-12T05:37:45.264 INFO:teuthology.orchestra.run.gibba005.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-11-12T05:37:45.264 INFO:teuthology.orchestra.run.gibba005.stdout:Recommended packages: 2021-11-12T05:37:45.264 INFO:teuthology.orchestra.run.gibba005.stdout: btrfs-tools 2021-11-12T05:37:45.265 INFO:teuthology.orchestra.run.gibba038.stdout:Building dependency tree... 2021-11-12T05:37:45.265 INFO:teuthology.orchestra.run.gibba038.stdout:Reading state information... 2021-11-12T05:37:45.308 INFO:teuthology.orchestra.run.gibba005.stdout:The following NEW packages will be installed: 2021-11-12T05:37:45.309 INFO:teuthology.orchestra.run.gibba005.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-11-12T05:37:45.309 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-11-12T05:37:45.309 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-11-12T05:37:45.309 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq libcephfs-dev libcephfs2 2021-11-12T05:37:45.310 INFO:teuthology.orchestra.run.gibba005.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-11-12T05:37:45.310 INFO:teuthology.orchestra.run.gibba005.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-11-12T05:37:45.310 INFO:teuthology.orchestra.run.gibba005.stdout: librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl python3-atomicwrites 2021-11-12T05:37:45.310 INFO:teuthology.orchestra.run.gibba005.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2021-11-12T05:37:45.311 INFO:teuthology.orchestra.run.gibba005.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2021-11-12T05:37:45.311 INFO:teuthology.orchestra.run.gibba005.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2021-11-12T05:37:45.311 INFO:teuthology.orchestra.run.gibba005.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2021-11-12T05:37:45.311 INFO:teuthology.orchestra.run.gibba005.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-11-12T05:37:45.311 INFO:teuthology.orchestra.run.gibba005.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-11-12T05:37:45.312 INFO:teuthology.orchestra.run.gibba005.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-11-12T05:37:45.312 INFO:teuthology.orchestra.run.gibba005.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-11-12T05:37:45.312 INFO:teuthology.orchestra.run.gibba005.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2021-11-12T05:37:45.312 INFO:teuthology.orchestra.run.gibba005.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2021-11-12T05:37:45.312 INFO:teuthology.orchestra.run.gibba005.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-11-12T05:37:45.313 INFO:teuthology.orchestra.run.gibba005.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-11-12T05:37:45.313 INFO:teuthology.orchestra.run.gibba005.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-11-12T05:37:45.313 INFO:teuthology.orchestra.run.gibba005.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-11-12T05:37:45.314 INFO:teuthology.orchestra.run.gibba005.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-11-12T05:37:45.314 INFO:teuthology.orchestra.run.gibba005.stdout:The following packages will be upgraded: 2021-11-12T05:37:45.314 INFO:teuthology.orchestra.run.gibba005.stdout: librados2 librbd1 2021-11-12T05:37:45.315 INFO:teuthology.orchestra.run.gibba015.stdout:The following packages were automatically installed and are no longer required: 2021-11-12T05:37:45.316 INFO:teuthology.orchestra.run.gibba015.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-11-12T05:37:45.316 INFO:teuthology.orchestra.run.gibba015.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-12T05:37:45.316 INFO:teuthology.orchestra.run.gibba015.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-12T05:37:45.316 INFO:teuthology.orchestra.run.gibba015.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-12T05:37:45.317 INFO:teuthology.orchestra.run.gibba015.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-12T05:37:45.317 INFO:teuthology.orchestra.run.gibba015.stdout:The following additional packages will be installed: 2021-11-12T05:37:45.317 INFO:teuthology.orchestra.run.gibba015.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-11-12T05:37:45.317 INFO:teuthology.orchestra.run.gibba015.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-11-12T05:37:45.317 INFO:teuthology.orchestra.run.gibba015.stdout: ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-11-12T05:37:45.318 INFO:teuthology.orchestra.run.gibba015.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-11-12T05:37:45.318 INFO:teuthology.orchestra.run.gibba015.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2021-11-12T05:37:45.318 INFO:teuthology.orchestra.run.gibba015.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2021-11-12T05:37:45.318 INFO:teuthology.orchestra.run.gibba015.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2021-11-12T05:37:45.318 INFO:teuthology.orchestra.run.gibba015.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-11-12T05:37:45.319 INFO:teuthology.orchestra.run.gibba015.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2021-11-12T05:37:45.319 INFO:teuthology.orchestra.run.gibba015.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2021-11-12T05:37:45.319 INFO:teuthology.orchestra.run.gibba015.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2021-11-12T05:37:45.319 INFO:teuthology.orchestra.run.gibba015.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2021-11-12T05:37:45.319 INFO:teuthology.orchestra.run.gibba015.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2021-11-12T05:37:45.320 INFO:teuthology.orchestra.run.gibba015.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2021-11-12T05:37:45.320 INFO:teuthology.orchestra.run.gibba015.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2021-11-12T05:37:45.320 INFO:teuthology.orchestra.run.gibba015.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2021-11-12T05:37:45.320 INFO:teuthology.orchestra.run.gibba015.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-11-12T05:37:45.320 INFO:teuthology.orchestra.run.gibba015.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-11-12T05:37:45.321 INFO:teuthology.orchestra.run.gibba015.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2021-11-12T05:37:45.321 INFO:teuthology.orchestra.run.gibba015.stdout: xmlstarlet 2021-11-12T05:37:45.321 INFO:teuthology.orchestra.run.gibba015.stdout:Suggested packages: 2021-11-12T05:37:45.321 INFO:teuthology.orchestra.run.gibba015.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-11-12T05:37:45.322 INFO:teuthology.orchestra.run.gibba015.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-11-12T05:37:45.322 INFO:teuthology.orchestra.run.gibba015.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-11-12T05:37:45.322 INFO:teuthology.orchestra.run.gibba015.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-11-12T05:37:45.322 INFO:teuthology.orchestra.run.gibba015.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-11-12T05:37:45.322 INFO:teuthology.orchestra.run.gibba015.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-11-12T05:37:45.323 INFO:teuthology.orchestra.run.gibba015.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-11-12T05:37:45.323 INFO:teuthology.orchestra.run.gibba015.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-11-12T05:37:45.323 INFO:teuthology.orchestra.run.gibba015.stdout:Recommended packages: 2021-11-12T05:37:45.323 INFO:teuthology.orchestra.run.gibba015.stdout: btrfs-tools 2021-11-12T05:37:45.324 INFO:teuthology.orchestra.run.gibba016.stdout:Building dependency tree... 2021-11-12T05:37:45.324 INFO:teuthology.orchestra.run.gibba016.stdout:Reading state information... 2021-11-12T05:37:45.325 INFO:teuthology.orchestra.run.gibba044.stdout:The following packages were automatically installed and are no longer required: 2021-11-12T05:37:45.326 INFO:teuthology.orchestra.run.gibba044.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-11-12T05:37:45.326 INFO:teuthology.orchestra.run.gibba044.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-12T05:37:45.326 INFO:teuthology.orchestra.run.gibba044.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-12T05:37:45.327 INFO:teuthology.orchestra.run.gibba044.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-12T05:37:45.328 INFO:teuthology.orchestra.run.gibba044.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-12T05:37:45.328 INFO:teuthology.orchestra.run.gibba044.stdout:The following additional packages will be installed: 2021-11-12T05:37:45.328 INFO:teuthology.orchestra.run.gibba044.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-11-12T05:37:45.328 INFO:teuthology.orchestra.run.gibba044.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-11-12T05:37:45.329 INFO:teuthology.orchestra.run.gibba044.stdout: ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-11-12T05:37:45.329 INFO:teuthology.orchestra.run.gibba044.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-11-12T05:37:45.329 INFO:teuthology.orchestra.run.gibba044.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2021-11-12T05:37:45.329 INFO:teuthology.orchestra.run.gibba044.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2021-11-12T05:37:45.329 INFO:teuthology.orchestra.run.gibba044.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2021-11-12T05:37:45.330 INFO:teuthology.orchestra.run.gibba044.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-11-12T05:37:45.330 INFO:teuthology.orchestra.run.gibba044.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2021-11-12T05:37:45.330 INFO:teuthology.orchestra.run.gibba044.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2021-11-12T05:37:45.331 INFO:teuthology.orchestra.run.gibba044.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2021-11-12T05:37:45.331 INFO:teuthology.orchestra.run.gibba044.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2021-11-12T05:37:45.331 INFO:teuthology.orchestra.run.gibba044.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2021-11-12T05:37:45.331 INFO:teuthology.orchestra.run.gibba044.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2021-11-12T05:37:45.331 INFO:teuthology.orchestra.run.gibba044.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2021-11-12T05:37:45.332 INFO:teuthology.orchestra.run.gibba044.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2021-11-12T05:37:45.332 INFO:teuthology.orchestra.run.gibba044.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-11-12T05:37:45.332 INFO:teuthology.orchestra.run.gibba044.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-11-12T05:37:45.332 INFO:teuthology.orchestra.run.gibba044.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2021-11-12T05:37:45.333 INFO:teuthology.orchestra.run.gibba044.stdout: xmlstarlet 2021-11-12T05:37:45.333 INFO:teuthology.orchestra.run.gibba044.stdout:Suggested packages: 2021-11-12T05:37:45.333 INFO:teuthology.orchestra.run.gibba044.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-11-12T05:37:45.333 INFO:teuthology.orchestra.run.gibba044.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-11-12T05:37:45.333 INFO:teuthology.orchestra.run.gibba044.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-11-12T05:37:45.334 INFO:teuthology.orchestra.run.gibba044.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-11-12T05:37:45.334 INFO:teuthology.orchestra.run.gibba044.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-11-12T05:37:45.334 INFO:teuthology.orchestra.run.gibba044.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-11-12T05:37:45.334 INFO:teuthology.orchestra.run.gibba044.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-11-12T05:37:45.334 INFO:teuthology.orchestra.run.gibba044.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-11-12T05:37:45.335 INFO:teuthology.orchestra.run.gibba044.stdout:Recommended packages: 2021-11-12T05:37:45.335 INFO:teuthology.orchestra.run.gibba044.stdout: btrfs-tools 2021-11-12T05:37:45.337 INFO:teuthology.orchestra.run.gibba038.stdout:The following packages were automatically installed and are no longer required: 2021-11-12T05:37:45.337 INFO:teuthology.orchestra.run.gibba038.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-11-12T05:37:45.338 INFO:teuthology.orchestra.run.gibba038.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-12T05:37:45.338 INFO:teuthology.orchestra.run.gibba038.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-12T05:37:45.339 INFO:teuthology.orchestra.run.gibba038.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-12T05:37:45.339 INFO:teuthology.orchestra.run.gibba038.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-12T05:37:45.340 INFO:teuthology.orchestra.run.gibba038.stdout:The following additional packages will be installed: 2021-11-12T05:37:45.340 INFO:teuthology.orchestra.run.gibba038.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-11-12T05:37:45.340 INFO:teuthology.orchestra.run.gibba038.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-11-12T05:37:45.340 INFO:teuthology.orchestra.run.gibba038.stdout: ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-11-12T05:37:45.340 INFO:teuthology.orchestra.run.gibba038.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-11-12T05:37:45.341 INFO:teuthology.orchestra.run.gibba038.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2021-11-12T05:37:45.341 INFO:teuthology.orchestra.run.gibba038.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2021-11-12T05:37:45.341 INFO:teuthology.orchestra.run.gibba038.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2021-11-12T05:37:45.341 INFO:teuthology.orchestra.run.gibba038.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-11-12T05:37:45.342 INFO:teuthology.orchestra.run.gibba038.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2021-11-12T05:37:45.342 INFO:teuthology.orchestra.run.gibba038.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2021-11-12T05:37:45.342 INFO:teuthology.orchestra.run.gibba038.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2021-11-12T05:37:45.342 INFO:teuthology.orchestra.run.gibba038.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2021-11-12T05:37:45.342 INFO:teuthology.orchestra.run.gibba038.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2021-11-12T05:37:45.343 INFO:teuthology.orchestra.run.gibba038.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2021-11-12T05:37:45.343 INFO:teuthology.orchestra.run.gibba038.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2021-11-12T05:37:45.343 INFO:teuthology.orchestra.run.gibba038.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2021-11-12T05:37:45.343 INFO:teuthology.orchestra.run.gibba038.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-11-12T05:37:45.343 INFO:teuthology.orchestra.run.gibba038.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-11-12T05:37:45.344 INFO:teuthology.orchestra.run.gibba038.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2021-11-12T05:37:45.344 INFO:teuthology.orchestra.run.gibba038.stdout: xmlstarlet 2021-11-12T05:37:45.344 INFO:teuthology.orchestra.run.gibba038.stdout:Suggested packages: 2021-11-12T05:37:45.344 INFO:teuthology.orchestra.run.gibba038.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-11-12T05:37:45.344 INFO:teuthology.orchestra.run.gibba038.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-11-12T05:37:45.345 INFO:teuthology.orchestra.run.gibba038.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-11-12T05:37:45.345 INFO:teuthology.orchestra.run.gibba038.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-11-12T05:37:45.345 INFO:teuthology.orchestra.run.gibba038.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-11-12T05:37:45.345 INFO:teuthology.orchestra.run.gibba038.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-11-12T05:37:45.346 INFO:teuthology.orchestra.run.gibba038.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-11-12T05:37:45.346 INFO:teuthology.orchestra.run.gibba038.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-11-12T05:37:45.346 INFO:teuthology.orchestra.run.gibba038.stdout:Recommended packages: 2021-11-12T05:37:45.346 INFO:teuthology.orchestra.run.gibba038.stdout: btrfs-tools 2021-11-12T05:37:45.365 INFO:teuthology.orchestra.run.gibba015.stdout:The following NEW packages will be installed: 2021-11-12T05:37:45.365 INFO:teuthology.orchestra.run.gibba015.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-11-12T05:37:45.365 INFO:teuthology.orchestra.run.gibba015.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-11-12T05:37:45.366 INFO:teuthology.orchestra.run.gibba015.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-11-12T05:37:45.366 INFO:teuthology.orchestra.run.gibba015.stdout: ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq libcephfs-dev libcephfs2 2021-11-12T05:37:45.366 INFO:teuthology.orchestra.run.gibba015.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-11-12T05:37:45.366 INFO:teuthology.orchestra.run.gibba015.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-11-12T05:37:45.367 INFO:teuthology.orchestra.run.gibba015.stdout: librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl python3-atomicwrites 2021-11-12T05:37:45.367 INFO:teuthology.orchestra.run.gibba015.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2021-11-12T05:37:45.367 INFO:teuthology.orchestra.run.gibba015.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2021-11-12T05:37:45.367 INFO:teuthology.orchestra.run.gibba015.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2021-11-12T05:37:45.367 INFO:teuthology.orchestra.run.gibba015.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2021-11-12T05:37:45.368 INFO:teuthology.orchestra.run.gibba015.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-11-12T05:37:45.368 INFO:teuthology.orchestra.run.gibba015.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-11-12T05:37:45.368 INFO:teuthology.orchestra.run.gibba015.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-11-12T05:37:45.368 INFO:teuthology.orchestra.run.gibba015.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-11-12T05:37:45.368 INFO:teuthology.orchestra.run.gibba015.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2021-11-12T05:37:45.369 INFO:teuthology.orchestra.run.gibba015.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2021-11-12T05:37:45.369 INFO:teuthology.orchestra.run.gibba015.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-11-12T05:37:45.369 INFO:teuthology.orchestra.run.gibba015.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-11-12T05:37:45.369 INFO:teuthology.orchestra.run.gibba015.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-11-12T05:37:45.369 INFO:teuthology.orchestra.run.gibba015.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-11-12T05:37:45.370 INFO:teuthology.orchestra.run.gibba015.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-11-12T05:37:45.370 INFO:teuthology.orchestra.run.gibba015.stdout:The following packages will be upgraded: 2021-11-12T05:37:45.370 INFO:teuthology.orchestra.run.gibba015.stdout: librados2 librbd1 2021-11-12T05:37:45.378 INFO:teuthology.orchestra.run.gibba044.stdout:The following NEW packages will be installed: 2021-11-12T05:37:45.379 INFO:teuthology.orchestra.run.gibba044.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-11-12T05:37:45.379 INFO:teuthology.orchestra.run.gibba044.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-11-12T05:37:45.379 INFO:teuthology.orchestra.run.gibba044.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-11-12T05:37:45.379 INFO:teuthology.orchestra.run.gibba044.stdout: ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq libcephfs-dev libcephfs2 2021-11-12T05:37:45.380 INFO:teuthology.orchestra.run.gibba044.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-11-12T05:37:45.380 INFO:teuthology.orchestra.run.gibba044.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-11-12T05:37:45.380 INFO:teuthology.orchestra.run.gibba044.stdout: librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl python3-atomicwrites 2021-11-12T05:37:45.380 INFO:teuthology.orchestra.run.gibba044.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2021-11-12T05:37:45.380 INFO:teuthology.orchestra.run.gibba044.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2021-11-12T05:37:45.381 INFO:teuthology.orchestra.run.gibba044.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2021-11-12T05:37:45.381 INFO:teuthology.orchestra.run.gibba044.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2021-11-12T05:37:45.381 INFO:teuthology.orchestra.run.gibba044.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-11-12T05:37:45.381 INFO:teuthology.orchestra.run.gibba044.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-11-12T05:37:45.382 INFO:teuthology.orchestra.run.gibba044.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-11-12T05:37:45.382 INFO:teuthology.orchestra.run.gibba044.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-11-12T05:37:45.382 INFO:teuthology.orchestra.run.gibba044.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2021-11-12T05:37:45.383 INFO:teuthology.orchestra.run.gibba044.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2021-11-12T05:37:45.383 INFO:teuthology.orchestra.run.gibba044.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-11-12T05:37:45.383 INFO:teuthology.orchestra.run.gibba044.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-11-12T05:37:45.383 INFO:teuthology.orchestra.run.gibba044.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-11-12T05:37:45.384 INFO:teuthology.orchestra.run.gibba044.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-11-12T05:37:45.384 INFO:teuthology.orchestra.run.gibba044.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-11-12T05:37:45.384 INFO:teuthology.orchestra.run.gibba044.stdout:The following packages will be upgraded: 2021-11-12T05:37:45.384 INFO:teuthology.orchestra.run.gibba044.stdout: librados2 librbd1 2021-11-12T05:37:45.390 INFO:teuthology.orchestra.run.gibba038.stdout:The following NEW packages will be installed: 2021-11-12T05:37:45.390 INFO:teuthology.orchestra.run.gibba038.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-11-12T05:37:45.390 INFO:teuthology.orchestra.run.gibba038.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-11-12T05:37:45.390 INFO:teuthology.orchestra.run.gibba038.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-11-12T05:37:45.391 INFO:teuthology.orchestra.run.gibba038.stdout: ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq libcephfs-dev libcephfs2 2021-11-12T05:37:45.391 INFO:teuthology.orchestra.run.gibba038.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-11-12T05:37:45.391 INFO:teuthology.orchestra.run.gibba038.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-11-12T05:37:45.391 INFO:teuthology.orchestra.run.gibba038.stdout: librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl python3-atomicwrites 2021-11-12T05:37:45.392 INFO:teuthology.orchestra.run.gibba038.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2021-11-12T05:37:45.392 INFO:teuthology.orchestra.run.gibba038.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2021-11-12T05:37:45.392 INFO:teuthology.orchestra.run.gibba038.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2021-11-12T05:37:45.392 INFO:teuthology.orchestra.run.gibba038.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2021-11-12T05:37:45.393 INFO:teuthology.orchestra.run.gibba038.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-11-12T05:37:45.393 INFO:teuthology.orchestra.run.gibba038.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-11-12T05:37:45.393 INFO:teuthology.orchestra.run.gibba038.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-11-12T05:37:45.393 INFO:teuthology.orchestra.run.gibba038.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-11-12T05:37:45.394 INFO:teuthology.orchestra.run.gibba038.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2021-11-12T05:37:45.394 INFO:teuthology.orchestra.run.gibba038.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2021-11-12T05:37:45.394 INFO:teuthology.orchestra.run.gibba038.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-11-12T05:37:45.394 INFO:teuthology.orchestra.run.gibba038.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-11-12T05:37:45.394 INFO:teuthology.orchestra.run.gibba038.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-11-12T05:37:45.395 INFO:teuthology.orchestra.run.gibba038.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-11-12T05:37:45.395 INFO:teuthology.orchestra.run.gibba038.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-11-12T05:37:45.395 INFO:teuthology.orchestra.run.gibba038.stdout:The following packages will be upgraded: 2021-11-12T05:37:45.395 INFO:teuthology.orchestra.run.gibba038.stdout: librados2 librbd1 2021-11-12T05:37:45.397 INFO:teuthology.orchestra.run.gibba016.stdout:The following packages were automatically installed and are no longer required: 2021-11-12T05:37:45.397 INFO:teuthology.orchestra.run.gibba016.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-11-12T05:37:45.397 INFO:teuthology.orchestra.run.gibba016.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-12T05:37:45.398 INFO:teuthology.orchestra.run.gibba016.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-12T05:37:45.398 INFO:teuthology.orchestra.run.gibba016.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-12T05:37:45.398 INFO:teuthology.orchestra.run.gibba016.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-12T05:37:45.398 INFO:teuthology.orchestra.run.gibba016.stdout:The following additional packages will be installed: 2021-11-12T05:37:45.399 INFO:teuthology.orchestra.run.gibba016.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-11-12T05:37:45.399 INFO:teuthology.orchestra.run.gibba016.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-11-12T05:37:45.399 INFO:teuthology.orchestra.run.gibba016.stdout: ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-11-12T05:37:45.399 INFO:teuthology.orchestra.run.gibba016.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-11-12T05:37:45.399 INFO:teuthology.orchestra.run.gibba016.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2021-11-12T05:37:45.400 INFO:teuthology.orchestra.run.gibba016.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2021-11-12T05:37:45.400 INFO:teuthology.orchestra.run.gibba016.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2021-11-12T05:37:45.400 INFO:teuthology.orchestra.run.gibba016.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-11-12T05:37:45.400 INFO:teuthology.orchestra.run.gibba016.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2021-11-12T05:37:45.400 INFO:teuthology.orchestra.run.gibba016.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2021-11-12T05:37:45.401 INFO:teuthology.orchestra.run.gibba016.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2021-11-12T05:37:45.401 INFO:teuthology.orchestra.run.gibba016.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2021-11-12T05:37:45.401 INFO:teuthology.orchestra.run.gibba016.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2021-11-12T05:37:45.401 INFO:teuthology.orchestra.run.gibba016.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2021-11-12T05:37:45.401 INFO:teuthology.orchestra.run.gibba016.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2021-11-12T05:37:45.402 INFO:teuthology.orchestra.run.gibba016.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2021-11-12T05:37:45.402 INFO:teuthology.orchestra.run.gibba016.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-11-12T05:37:45.402 INFO:teuthology.orchestra.run.gibba016.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-11-12T05:37:45.402 INFO:teuthology.orchestra.run.gibba016.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2021-11-12T05:37:45.403 INFO:teuthology.orchestra.run.gibba016.stdout: xmlstarlet 2021-11-12T05:37:45.403 INFO:teuthology.orchestra.run.gibba016.stdout:Suggested packages: 2021-11-12T05:37:45.403 INFO:teuthology.orchestra.run.gibba016.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-11-12T05:37:45.403 INFO:teuthology.orchestra.run.gibba016.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-11-12T05:37:45.403 INFO:teuthology.orchestra.run.gibba016.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-11-12T05:37:45.404 INFO:teuthology.orchestra.run.gibba016.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-11-12T05:37:45.404 INFO:teuthology.orchestra.run.gibba016.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-11-12T05:37:45.404 INFO:teuthology.orchestra.run.gibba016.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-11-12T05:37:45.404 INFO:teuthology.orchestra.run.gibba016.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-11-12T05:37:45.404 INFO:teuthology.orchestra.run.gibba016.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-11-12T05:37:45.405 INFO:teuthology.orchestra.run.gibba016.stdout:Recommended packages: 2021-11-12T05:37:45.405 INFO:teuthology.orchestra.run.gibba016.stdout: btrfs-tools 2021-11-12T05:37:45.449 INFO:teuthology.orchestra.run.gibba016.stdout:The following NEW packages will be installed: 2021-11-12T05:37:45.450 INFO:teuthology.orchestra.run.gibba016.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-11-12T05:37:45.450 INFO:teuthology.orchestra.run.gibba016.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-11-12T05:37:45.450 INFO:teuthology.orchestra.run.gibba016.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-11-12T05:37:45.451 INFO:teuthology.orchestra.run.gibba016.stdout: ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq libcephfs-dev libcephfs2 2021-11-12T05:37:45.451 INFO:teuthology.orchestra.run.gibba016.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-11-12T05:37:45.451 INFO:teuthology.orchestra.run.gibba016.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-11-12T05:37:45.451 INFO:teuthology.orchestra.run.gibba016.stdout: librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl python3-atomicwrites 2021-11-12T05:37:45.451 INFO:teuthology.orchestra.run.gibba016.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2021-11-12T05:37:45.452 INFO:teuthology.orchestra.run.gibba016.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2021-11-12T05:37:45.452 INFO:teuthology.orchestra.run.gibba016.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2021-11-12T05:37:45.452 INFO:teuthology.orchestra.run.gibba016.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2021-11-12T05:37:45.452 INFO:teuthology.orchestra.run.gibba016.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-11-12T05:37:45.453 INFO:teuthology.orchestra.run.gibba016.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-11-12T05:37:45.453 INFO:teuthology.orchestra.run.gibba016.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-11-12T05:37:45.453 INFO:teuthology.orchestra.run.gibba016.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-11-12T05:37:45.453 INFO:teuthology.orchestra.run.gibba016.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2021-11-12T05:37:45.453 INFO:teuthology.orchestra.run.gibba016.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2021-11-12T05:37:45.454 INFO:teuthology.orchestra.run.gibba016.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-11-12T05:37:45.454 INFO:teuthology.orchestra.run.gibba016.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-11-12T05:37:45.455 INFO:teuthology.orchestra.run.gibba016.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-11-12T05:37:45.456 INFO:teuthology.orchestra.run.gibba016.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-11-12T05:37:45.456 INFO:teuthology.orchestra.run.gibba016.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-11-12T05:37:45.456 INFO:teuthology.orchestra.run.gibba016.stdout:The following packages will be upgraded: 2021-11-12T05:37:45.456 INFO:teuthology.orchestra.run.gibba016.stdout: librados2 librbd1 2021-11-12T05:37:45.484 INFO:teuthology.orchestra.run.gibba005.stdout:2 upgraded, 101 newly installed, 0 to remove and 42 not upgraded. 2021-11-12T05:37:45.484 INFO:teuthology.orchestra.run.gibba005.stdout:Need to get 153 MB of archives. 2021-11-12T05:37:45.484 INFO:teuthology.orchestra.run.gibba005.stdout:After this operation, 698 MB of additional disk space will be used. 2021-11-12T05:37:45.485 INFO:teuthology.orchestra.run.gibba005.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2021-11-12T05:37:45.495 INFO:teuthology.orchestra.run.gibba005.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.15-22-ga81ee281-1focal [1,693 kB] 2021-11-12T05:37:45.540 INFO:teuthology.orchestra.run.gibba015.stdout:2 upgraded, 101 newly installed, 0 to remove and 42 not upgraded. 2021-11-12T05:37:45.541 INFO:teuthology.orchestra.run.gibba015.stdout:Need to get 153 MB of archives. 2021-11-12T05:37:45.541 INFO:teuthology.orchestra.run.gibba015.stdout:After this operation, 698 MB of additional disk space will be used. 2021-11-12T05:37:45.541 INFO:teuthology.orchestra.run.gibba015.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2021-11-12T05:37:45.553 INFO:teuthology.orchestra.run.gibba044.stdout:2 upgraded, 101 newly installed, 0 to remove and 42 not upgraded. 2021-11-12T05:37:45.554 INFO:teuthology.orchestra.run.gibba044.stdout:Need to get 153 MB of archives. 2021-11-12T05:37:45.554 INFO:teuthology.orchestra.run.gibba044.stdout:After this operation, 698 MB of additional disk space will be used. 2021-11-12T05:37:45.554 INFO:teuthology.orchestra.run.gibba044.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2021-11-12T05:37:45.555 INFO:teuthology.orchestra.run.gibba015.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.15-22-ga81ee281-1focal [1,693 kB] 2021-11-12T05:37:45.566 INFO:teuthology.orchestra.run.gibba038.stdout:2 upgraded, 101 newly installed, 0 to remove and 42 not upgraded. 2021-11-12T05:37:45.566 INFO:teuthology.orchestra.run.gibba038.stdout:Need to get 153 MB of archives. 2021-11-12T05:37:45.566 INFO:teuthology.orchestra.run.gibba038.stdout:After this operation, 698 MB of additional disk space will be used. 2021-11-12T05:37:45.567 INFO:teuthology.orchestra.run.gibba038.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2021-11-12T05:37:45.570 INFO:teuthology.orchestra.run.gibba005.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-11-12T05:37:45.576 INFO:teuthology.orchestra.run.gibba038.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.15-22-ga81ee281-1focal [1,693 kB] 2021-11-12T05:37:45.583 INFO:teuthology.orchestra.run.gibba044.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.15-22-ga81ee281-1focal [1,693 kB] 2021-11-12T05:37:45.597 INFO:teuthology.orchestra.run.gibba005.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2021-11-12T05:37:45.624 INFO:teuthology.orchestra.run.gibba016.stdout:2 upgraded, 101 newly installed, 0 to remove and 42 not upgraded. 2021-11-12T05:37:45.624 INFO:teuthology.orchestra.run.gibba016.stdout:Need to get 153 MB of archives. 2021-11-12T05:37:45.625 INFO:teuthology.orchestra.run.gibba016.stdout:After this operation, 698 MB of additional disk space will be used. 2021-11-12T05:37:45.625 INFO:teuthology.orchestra.run.gibba016.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2021-11-12T05:37:45.625 INFO:teuthology.orchestra.run.gibba015.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-11-12T05:37:45.638 INFO:teuthology.orchestra.run.gibba016.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.15-22-ga81ee281-1focal [1,693 kB] 2021-11-12T05:37:45.639 INFO:teuthology.orchestra.run.gibba044.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-11-12T05:37:45.652 INFO:teuthology.orchestra.run.gibba038.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-11-12T05:37:45.654 INFO:teuthology.orchestra.run.gibba015.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2021-11-12T05:37:45.660 INFO:teuthology.orchestra.run.gibba038.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2021-11-12T05:37:45.667 INFO:teuthology.orchestra.run.gibba044.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2021-11-12T05:37:45.711 INFO:teuthology.orchestra.run.gibba005.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-11-12T05:37:45.744 INFO:teuthology.orchestra.run.gibba005.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.15-22-ga81ee281-1focal [3,245 kB] 2021-11-12T05:37:45.757 INFO:teuthology.orchestra.run.gibba016.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-11-12T05:37:45.760 INFO:teuthology.orchestra.run.gibba015.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-11-12T05:37:45.764 INFO:teuthology.orchestra.run.gibba016.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2021-11-12T05:37:45.767 INFO:teuthology.orchestra.run.gibba038.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-11-12T05:37:45.778 INFO:teuthology.orchestra.run.gibba044.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-11-12T05:37:45.845 INFO:teuthology.orchestra.run.gibba005.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-11-12T05:37:45.850 INFO:teuthology.orchestra.run.gibba005.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-11-12T05:37:45.856 INFO:teuthology.orchestra.run.gibba005.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-11-12T05:37:45.887 INFO:teuthology.orchestra.run.gibba015.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.15-22-ga81ee281-1focal [3,245 kB] 2021-11-12T05:37:45.889 INFO:teuthology.orchestra.run.gibba016.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-11-12T05:37:45.896 INFO:teuthology.orchestra.run.gibba015.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-11-12T05:37:45.897 INFO:teuthology.orchestra.run.gibba015.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-11-12T05:37:45.908 INFO:teuthology.orchestra.run.gibba015.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-11-12T05:37:45.909 INFO:teuthology.orchestra.run.gibba044.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-11-12T05:37:45.910 INFO:teuthology.orchestra.run.gibba044.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-11-12T05:37:45.917 INFO:teuthology.orchestra.run.gibba044.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-11-12T05:37:45.926 INFO:teuthology.orchestra.run.gibba038.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-11-12T05:37:45.932 INFO:teuthology.orchestra.run.gibba038.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-11-12T05:37:45.938 INFO:teuthology.orchestra.run.gibba038.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-11-12T05:37:45.969 INFO:teuthology.orchestra.run.gibba005.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-11-12T05:37:45.993 INFO:teuthology.orchestra.run.gibba005.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-11-12T05:37:46.006 INFO:teuthology.orchestra.run.gibba005.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-11-12T05:37:46.015 INFO:teuthology.orchestra.run.gibba038.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.15-22-ga81ee281-1focal [3,245 kB] 2021-11-12T05:37:46.021 INFO:teuthology.orchestra.run.gibba015.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-11-12T05:37:46.024 INFO:teuthology.orchestra.run.gibba005.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-11-12T05:37:46.028 INFO:teuthology.orchestra.run.gibba005.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-11-12T05:37:46.029 INFO:teuthology.orchestra.run.gibba005.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-11-12T05:37:46.035 INFO:teuthology.orchestra.run.gibba044.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-11-12T05:37:46.035 INFO:teuthology.orchestra.run.gibba005.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.15-22-ga81ee281-1focal [463 kB] 2021-11-12T05:37:46.036 INFO:teuthology.orchestra.run.gibba016.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-11-12T05:37:46.045 INFO:teuthology.orchestra.run.gibba005.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-11-12T05:37:46.045 INFO:teuthology.orchestra.run.gibba005.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-11-12T05:37:46.046 INFO:teuthology.orchestra.run.gibba016.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-11-12T05:37:46.047 INFO:teuthology.orchestra.run.gibba038.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-11-12T05:37:46.047 INFO:teuthology.orchestra.run.gibba005.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-11-12T05:37:46.050 INFO:teuthology.orchestra.run.gibba005.stdout:Get:20 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.15-22-ga81ee281-1focal [365 kB] 2021-11-12T05:37:46.052 INFO:teuthology.orchestra.run.gibba015.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-11-12T05:37:46.057 INFO:teuthology.orchestra.run.gibba016.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-11-12T05:37:46.058 INFO:teuthology.orchestra.run.gibba015.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-11-12T05:37:46.062 INFO:teuthology.orchestra.run.gibba044.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-11-12T05:37:46.069 INFO:teuthology.orchestra.run.gibba044.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-11-12T05:37:46.076 INFO:teuthology.orchestra.run.gibba038.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-11-12T05:37:46.081 INFO:teuthology.orchestra.run.gibba015.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-11-12T05:37:46.082 INFO:teuthology.orchestra.run.gibba038.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-11-12T05:37:46.086 INFO:teuthology.orchestra.run.gibba015.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-11-12T05:37:46.088 INFO:teuthology.orchestra.run.gibba015.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-11-12T05:37:46.093 INFO:teuthology.orchestra.run.gibba044.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-11-12T05:37:46.094 INFO:teuthology.orchestra.run.gibba005.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-11-12T05:37:46.096 INFO:teuthology.orchestra.run.gibba005.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-11-12T05:37:46.097 INFO:teuthology.orchestra.run.gibba005.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-11-12T05:37:46.098 INFO:teuthology.orchestra.run.gibba044.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-11-12T05:37:46.100 INFO:teuthology.orchestra.run.gibba044.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-11-12T05:37:46.101 INFO:teuthology.orchestra.run.gibba005.stdout:Get:24 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.15-22-ga81ee281-1focal [20.8 kB] 2021-11-12T05:37:46.101 INFO:teuthology.orchestra.run.gibba005.stdout:Get:25 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.15-22-ga81ee281-1focal [156 kB] 2021-11-12T05:37:46.102 INFO:teuthology.orchestra.run.gibba015.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-11-12T05:37:46.103 INFO:teuthology.orchestra.run.gibba015.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-11-12T05:37:46.104 INFO:teuthology.orchestra.run.gibba015.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-11-12T05:37:46.106 INFO:teuthology.orchestra.run.gibba005.stdout:Get:26 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.15-22-ga81ee281-1focal [29.4 kB] 2021-11-12T05:37:46.107 INFO:teuthology.orchestra.run.gibba038.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-11-12T05:37:46.107 INFO:teuthology.orchestra.run.gibba005.stdout:Get:27 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.15-22-ga81ee281-1focal [364 kB] 2021-11-12T05:37:46.111 INFO:teuthology.orchestra.run.gibba038.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-11-12T05:37:46.113 INFO:teuthology.orchestra.run.gibba038.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-11-12T05:37:46.116 INFO:teuthology.orchestra.run.gibba044.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-11-12T05:37:46.118 INFO:teuthology.orchestra.run.gibba044.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-11-12T05:37:46.119 INFO:teuthology.orchestra.run.gibba044.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-11-12T05:37:46.130 INFO:teuthology.orchestra.run.gibba038.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-11-12T05:37:46.132 INFO:teuthology.orchestra.run.gibba038.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-11-12T05:37:46.133 INFO:teuthology.orchestra.run.gibba015.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.15-22-ga81ee281-1focal [463 kB] 2021-11-12T05:37:46.133 INFO:teuthology.orchestra.run.gibba038.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-11-12T05:37:46.149 INFO:teuthology.orchestra.run.gibba015.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-11-12T05:37:46.152 INFO:teuthology.orchestra.run.gibba015.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-11-12T05:37:46.153 INFO:teuthology.orchestra.run.gibba015.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-11-12T05:37:46.158 INFO:teuthology.orchestra.run.gibba005.stdout:Get:28 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.15-22-ga81ee281-1focal [3,138 kB] 2021-11-12T05:37:46.160 INFO:teuthology.orchestra.run.gibba044.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-11-12T05:37:46.162 INFO:teuthology.orchestra.run.gibba016.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-11-12T05:37:46.163 INFO:teuthology.orchestra.run.gibba044.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-11-12T05:37:46.164 INFO:teuthology.orchestra.run.gibba044.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-11-12T05:37:46.175 INFO:teuthology.orchestra.run.gibba038.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-11-12T05:37:46.176 INFO:teuthology.orchestra.run.gibba005.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-11-12T05:37:46.178 INFO:teuthology.orchestra.run.gibba038.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-11-12T05:37:46.179 INFO:teuthology.orchestra.run.gibba005.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-11-12T05:37:46.180 INFO:teuthology.orchestra.run.gibba038.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-11-12T05:37:46.180 INFO:teuthology.orchestra.run.gibba005.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-11-12T05:37:46.183 INFO:teuthology.orchestra.run.gibba005.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-11-12T05:37:46.184 INFO:teuthology.orchestra.run.gibba016.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-11-12T05:37:46.186 INFO:teuthology.orchestra.run.gibba005.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-11-12T05:37:46.187 INFO:teuthology.orchestra.run.gibba005.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-11-12T05:37:46.188 INFO:teuthology.orchestra.run.gibba015.stdout:Get:23 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.15-22-ga81ee281-1focal [365 kB] 2021-11-12T05:37:46.190 INFO:teuthology.orchestra.run.gibba016.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-11-12T05:37:46.199 INFO:teuthology.orchestra.run.gibba015.stdout:Get:24 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.15-22-ga81ee281-1focal [20.8 kB] 2021-11-12T05:37:46.204 INFO:teuthology.orchestra.run.gibba015.stdout:Get:25 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.15-22-ga81ee281-1focal [156 kB] 2021-11-12T05:37:46.206 INFO:teuthology.orchestra.run.gibba005.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-11-12T05:37:46.215 INFO:teuthology.orchestra.run.gibba016.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-11-12T05:37:46.219 INFO:teuthology.orchestra.run.gibba015.stdout:Get:26 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.15-22-ga81ee281-1focal [29.4 kB] 2021-11-12T05:37:46.219 INFO:teuthology.orchestra.run.gibba016.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-11-12T05:37:46.223 INFO:teuthology.orchestra.run.gibba016.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-11-12T05:37:46.231 INFO:teuthology.orchestra.run.gibba015.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-11-12T05:37:46.233 INFO:teuthology.orchestra.run.gibba015.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-11-12T05:37:46.234 INFO:teuthology.orchestra.run.gibba015.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-11-12T05:37:46.237 INFO:teuthology.orchestra.run.gibba016.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-11-12T05:37:46.238 INFO:teuthology.orchestra.run.gibba015.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-11-12T05:37:46.239 INFO:teuthology.orchestra.run.gibba016.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-11-12T05:37:46.241 INFO:teuthology.orchestra.run.gibba016.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-11-12T05:37:46.242 INFO:teuthology.orchestra.run.gibba015.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-11-12T05:37:46.243 INFO:teuthology.orchestra.run.gibba044.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-11-12T05:37:46.243 INFO:teuthology.orchestra.run.gibba015.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-11-12T05:37:46.245 INFO:teuthology.orchestra.run.gibba044.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-11-12T05:37:46.246 INFO:teuthology.orchestra.run.gibba015.stdout:Get:33 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.15-22-ga81ee281-1focal [364 kB] 2021-11-12T05:37:46.247 INFO:teuthology.orchestra.run.gibba044.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-11-12T05:37:46.250 INFO:teuthology.orchestra.run.gibba044.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-11-12T05:37:46.254 INFO:teuthology.orchestra.run.gibba044.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-11-12T05:37:46.255 INFO:teuthology.orchestra.run.gibba044.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-11-12T05:37:46.258 INFO:teuthology.orchestra.run.gibba038.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-11-12T05:37:46.259 INFO:teuthology.orchestra.run.gibba015.stdout:Get:34 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.15-22-ga81ee281-1focal [3,138 kB] 2021-11-12T05:37:46.259 INFO:teuthology.orchestra.run.gibba005.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-11-12T05:37:46.259 INFO:teuthology.orchestra.run.gibba005.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-11-12T05:37:46.260 INFO:teuthology.orchestra.run.gibba005.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-11-12T05:37:46.261 INFO:teuthology.orchestra.run.gibba038.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-11-12T05:37:46.263 INFO:teuthology.orchestra.run.gibba038.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-11-12T05:37:46.263 INFO:teuthology.orchestra.run.gibba015.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-11-12T05:37:46.266 INFO:teuthology.orchestra.run.gibba038.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-11-12T05:37:46.269 INFO:teuthology.orchestra.run.gibba038.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-11-12T05:37:46.270 INFO:teuthology.orchestra.run.gibba038.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-11-12T05:37:46.275 INFO:teuthology.orchestra.run.gibba044.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-11-12T05:37:46.283 INFO:teuthology.orchestra.run.gibba016.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-11-12T05:37:46.286 INFO:teuthology.orchestra.run.gibba016.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-11-12T05:37:46.287 INFO:teuthology.orchestra.run.gibba016.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-11-12T05:37:46.290 INFO:teuthology.orchestra.run.gibba038.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-11-12T05:37:46.313 INFO:teuthology.orchestra.run.gibba015.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-11-12T05:37:46.314 INFO:teuthology.orchestra.run.gibba015.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-11-12T05:37:46.315 INFO:teuthology.orchestra.run.gibba015.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-11-12T05:37:46.325 INFO:teuthology.orchestra.run.gibba044.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-11-12T05:37:46.325 INFO:teuthology.orchestra.run.gibba044.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-11-12T05:37:46.327 INFO:teuthology.orchestra.run.gibba044.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-11-12T05:37:46.340 INFO:teuthology.orchestra.run.gibba038.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-11-12T05:37:46.341 INFO:teuthology.orchestra.run.gibba038.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-11-12T05:37:46.342 INFO:teuthology.orchestra.run.gibba005.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-11-12T05:37:46.342 INFO:teuthology.orchestra.run.gibba038.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-11-12T05:37:46.347 INFO:teuthology.orchestra.run.gibba005.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-11-12T05:37:46.350 INFO:teuthology.orchestra.run.gibba005.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-11-12T05:37:46.351 INFO:teuthology.orchestra.run.gibba005.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-11-12T05:37:46.352 INFO:teuthology.orchestra.run.gibba005.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-11-12T05:37:46.353 INFO:teuthology.orchestra.run.gibba005.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-11-12T05:37:46.353 INFO:teuthology.orchestra.run.gibba005.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-11-12T05:37:46.366 INFO:teuthology.orchestra.run.gibba016.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-11-12T05:37:46.369 INFO:teuthology.orchestra.run.gibba016.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-11-12T05:37:46.370 INFO:teuthology.orchestra.run.gibba016.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-11-12T05:37:46.373 INFO:teuthology.orchestra.run.gibba016.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-11-12T05:37:46.377 INFO:teuthology.orchestra.run.gibba016.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-11-12T05:37:46.378 INFO:teuthology.orchestra.run.gibba016.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-11-12T05:37:46.395 INFO:teuthology.orchestra.run.gibba015.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-11-12T05:37:46.397 INFO:teuthology.orchestra.run.gibba016.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-11-12T05:37:46.401 INFO:teuthology.orchestra.run.gibba015.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-11-12T05:37:46.401 INFO:teuthology.orchestra.run.gibba015.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-11-12T05:37:46.402 INFO:teuthology.orchestra.run.gibba015.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-11-12T05:37:46.403 INFO:teuthology.orchestra.run.gibba015.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-11-12T05:37:46.404 INFO:teuthology.orchestra.run.gibba015.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-11-12T05:37:46.406 INFO:teuthology.orchestra.run.gibba015.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-11-12T05:37:46.407 INFO:teuthology.orchestra.run.gibba044.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-11-12T05:37:46.412 INFO:teuthology.orchestra.run.gibba044.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-11-12T05:37:46.415 INFO:teuthology.orchestra.run.gibba044.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-11-12T05:37:46.416 INFO:teuthology.orchestra.run.gibba044.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-11-12T05:37:46.417 INFO:teuthology.orchestra.run.gibba044.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-11-12T05:37:46.417 INFO:teuthology.orchestra.run.gibba044.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-11-12T05:37:46.418 INFO:teuthology.orchestra.run.gibba044.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-11-12T05:37:46.419 INFO:teuthology.orchestra.run.gibba005.stdout:Get:46 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.15-22-ga81ee281-1focal [115 kB] 2021-11-12T05:37:46.422 INFO:teuthology.orchestra.run.gibba038.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-11-12T05:37:46.423 INFO:teuthology.orchestra.run.gibba005.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-11-12T05:37:46.424 INFO:teuthology.orchestra.run.gibba005.stdout:Get:48 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.15-22-ga81ee281-1focal [361 kB] 2021-11-12T05:37:46.424 INFO:teuthology.orchestra.run.gibba005.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-11-12T05:37:46.427 INFO:teuthology.orchestra.run.gibba038.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-11-12T05:37:46.430 INFO:teuthology.orchestra.run.gibba038.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-11-12T05:37:46.430 INFO:teuthology.orchestra.run.gibba038.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-11-12T05:37:46.432 INFO:teuthology.orchestra.run.gibba038.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-11-12T05:37:46.433 INFO:teuthology.orchestra.run.gibba038.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-11-12T05:37:46.435 INFO:teuthology.orchestra.run.gibba038.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-11-12T05:37:46.438 INFO:teuthology.orchestra.run.gibba005.stdout:Get:50 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.15-22-ga81ee281-1focal [20.0 MB] 2021-11-12T05:37:46.448 INFO:teuthology.orchestra.run.gibba016.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-11-12T05:37:46.449 INFO:teuthology.orchestra.run.gibba016.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-11-12T05:37:46.450 INFO:teuthology.orchestra.run.gibba016.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-11-12T05:37:46.471 INFO:teuthology.orchestra.run.gibba038.stdout:Get:39 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.15-22-ga81ee281-1focal [463 kB] 2021-11-12T05:37:46.477 INFO:teuthology.orchestra.run.gibba015.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-11-12T05:37:46.478 INFO:teuthology.orchestra.run.gibba015.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-11-12T05:37:46.490 INFO:teuthology.orchestra.run.gibba044.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-11-12T05:37:46.490 INFO:teuthology.orchestra.run.gibba044.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-11-12T05:37:46.508 INFO:teuthology.orchestra.run.gibba038.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-11-12T05:37:46.510 INFO:teuthology.orchestra.run.gibba038.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-11-12T05:37:46.555 INFO:teuthology.orchestra.run.gibba016.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-11-12T05:37:46.563 INFO:teuthology.orchestra.run.gibba016.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-11-12T05:37:46.568 INFO:teuthology.orchestra.run.gibba038.stdout:Get:42 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.15-22-ga81ee281-1focal [365 kB] 2021-11-12T05:37:46.569 INFO:teuthology.orchestra.run.gibba016.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-11-12T05:37:46.571 INFO:teuthology.orchestra.run.gibba016.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-11-12T05:37:46.575 INFO:teuthology.orchestra.run.gibba016.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-11-12T05:37:46.578 INFO:teuthology.orchestra.run.gibba016.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-11-12T05:37:46.581 INFO:teuthology.orchestra.run.gibba016.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-11-12T05:37:46.602 INFO:teuthology.orchestra.run.gibba015.stdout:Get:48 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.15-22-ga81ee281-1focal [115 kB] 2021-11-12T05:37:46.606 INFO:teuthology.orchestra.run.gibba015.stdout:Get:49 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.15-22-ga81ee281-1focal [361 kB] 2021-11-12T05:37:46.617 INFO:teuthology.orchestra.run.gibba015.stdout:Get:50 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.15-22-ga81ee281-1focal [20.0 MB] 2021-11-12T05:37:46.636 INFO:teuthology.orchestra.run.gibba038.stdout:Get:43 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.15-22-ga81ee281-1focal [20.8 kB] 2021-11-12T05:37:46.637 INFO:teuthology.orchestra.run.gibba038.stdout:Get:44 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.15-22-ga81ee281-1focal [156 kB] 2021-11-12T05:37:46.672 INFO:teuthology.orchestra.run.gibba016.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-11-12T05:37:46.673 INFO:teuthology.orchestra.run.gibba016.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-11-12T05:37:46.773 INFO:teuthology.orchestra.run.gibba044.stdout:Get:40 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.15-22-ga81ee281-1focal [3,245 kB] 2021-11-12T05:37:46.821 INFO:teuthology.orchestra.run.gibba038.stdout:Get:45 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.15-22-ga81ee281-1focal [29.4 kB] 2021-11-12T05:37:46.821 INFO:teuthology.orchestra.run.gibba038.stdout:Get:46 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.15-22-ga81ee281-1focal [364 kB] 2021-11-12T05:37:46.823 INFO:teuthology.orchestra.run.gibba038.stdout:Get:47 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.15-22-ga81ee281-1focal [3,138 kB] 2021-11-12T05:37:47.011 INFO:teuthology.orchestra.run.gibba016.stdout:Get:40 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.15-22-ga81ee281-1focal [3,245 kB] 2021-11-12T05:37:47.089 INFO:teuthology.orchestra.run.gibba005.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-11-12T05:37:47.143 INFO:teuthology.orchestra.run.gibba005.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-11-12T05:37:47.144 INFO:teuthology.orchestra.run.gibba005.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-11-12T05:37:47.147 INFO:teuthology.orchestra.run.gibba044.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-11-12T05:37:47.168 INFO:teuthology.orchestra.run.gibba038.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-11-12T05:37:47.175 INFO:teuthology.orchestra.run.gibba044.stdout:Get:42 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.15-22-ga81ee281-1focal [463 kB] 2021-11-12T05:37:47.236 INFO:teuthology.orchestra.run.gibba005.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-11-12T05:37:47.237 INFO:teuthology.orchestra.run.gibba005.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-11-12T05:37:47.237 INFO:teuthology.orchestra.run.gibba038.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-11-12T05:37:47.238 INFO:teuthology.orchestra.run.gibba005.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-11-12T05:37:47.240 INFO:teuthology.orchestra.run.gibba005.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-11-12T05:37:47.241 INFO:teuthology.orchestra.run.gibba005.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-11-12T05:37:47.242 INFO:teuthology.orchestra.run.gibba038.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-11-12T05:37:47.243 INFO:teuthology.orchestra.run.gibba005.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-11-12T05:37:47.243 INFO:teuthology.orchestra.run.gibba005.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-11-12T05:37:47.256 INFO:teuthology.orchestra.run.gibba015.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-11-12T05:37:47.304 INFO:teuthology.orchestra.run.gibba005.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-11-12T05:37:47.305 INFO:teuthology.orchestra.run.gibba005.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-11-12T05:37:47.370 INFO:teuthology.orchestra.run.gibba044.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-11-12T05:37:47.370 INFO:teuthology.orchestra.run.gibba044.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-11-12T05:37:47.385 INFO:teuthology.orchestra.run.gibba005.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-11-12T05:37:47.389 INFO:teuthology.orchestra.run.gibba005.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-11-12T05:37:47.390 INFO:teuthology.orchestra.run.gibba005.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-11-12T05:37:47.391 INFO:teuthology.orchestra.run.gibba038.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-11-12T05:37:47.391 INFO:teuthology.orchestra.run.gibba038.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-11-12T05:37:47.392 INFO:teuthology.orchestra.run.gibba038.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-11-12T05:37:47.392 INFO:teuthology.orchestra.run.gibba038.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-11-12T05:37:47.393 INFO:teuthology.orchestra.run.gibba038.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-11-12T05:37:47.393 INFO:teuthology.orchestra.run.gibba038.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-11-12T05:37:47.393 INFO:teuthology.orchestra.run.gibba038.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-11-12T05:37:47.394 INFO:teuthology.orchestra.run.gibba005.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-11-12T05:37:47.395 INFO:teuthology.orchestra.run.gibba005.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-11-12T05:37:47.395 INFO:teuthology.orchestra.run.gibba038.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-11-12T05:37:47.395 INFO:teuthology.orchestra.run.gibba038.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-11-12T05:37:47.396 INFO:teuthology.orchestra.run.gibba015.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-11-12T05:37:47.396 INFO:teuthology.orchestra.run.gibba016.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-11-12T05:37:47.397 INFO:teuthology.orchestra.run.gibba005.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-11-12T05:37:47.399 INFO:teuthology.orchestra.run.gibba005.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-11-12T05:37:47.400 INFO:teuthology.orchestra.run.gibba015.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-11-12T05:37:47.402 INFO:teuthology.orchestra.run.gibba044.stdout:Get:45 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.15-22-ga81ee281-1focal [365 kB] 2021-11-12T05:37:47.403 INFO:teuthology.orchestra.run.gibba005.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2021-11-12T05:37:47.413 INFO:teuthology.orchestra.run.gibba044.stdout:Get:46 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.15-22-ga81ee281-1focal [20.8 kB] 2021-11-12T05:37:47.414 INFO:teuthology.orchestra.run.gibba044.stdout:Get:47 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.15-22-ga81ee281-1focal [156 kB] 2021-11-12T05:37:47.419 INFO:teuthology.orchestra.run.gibba044.stdout:Get:48 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.15-22-ga81ee281-1focal [29.4 kB] 2021-11-12T05:37:47.421 INFO:teuthology.orchestra.run.gibba044.stdout:Get:49 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.15-22-ga81ee281-1focal [364 kB] 2021-11-12T05:37:47.427 INFO:teuthology.orchestra.run.gibba015.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-11-12T05:37:47.428 INFO:teuthology.orchestra.run.gibba015.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-11-12T05:37:47.430 INFO:teuthology.orchestra.run.gibba015.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-11-12T05:37:47.438 INFO:teuthology.orchestra.run.gibba044.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-11-12T05:37:47.439 INFO:teuthology.orchestra.run.gibba044.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-11-12T05:37:47.445 INFO:teuthology.orchestra.run.gibba038.stdout:Get:60 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.15-22-ga81ee281-1focal [115 kB] 2021-11-12T05:37:47.451 INFO:teuthology.orchestra.run.gibba044.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-11-12T05:37:47.453 INFO:teuthology.orchestra.run.gibba044.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-11-12T05:37:47.454 INFO:teuthology.orchestra.run.gibba044.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-11-12T05:37:47.456 INFO:teuthology.orchestra.run.gibba044.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-11-12T05:37:47.457 INFO:teuthology.orchestra.run.gibba044.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-11-12T05:37:47.457 INFO:teuthology.orchestra.run.gibba044.stdout:Get:57 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.15-22-ga81ee281-1focal [3,138 kB] 2021-11-12T05:37:47.467 INFO:teuthology.orchestra.run.gibba015.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-11-12T05:37:47.468 INFO:teuthology.orchestra.run.gibba005.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-11-12T05:37:47.469 INFO:teuthology.orchestra.run.gibba015.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-11-12T05:37:47.471 INFO:teuthology.orchestra.run.gibba015.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-11-12T05:37:47.472 INFO:teuthology.orchestra.run.gibba005.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-11-12T05:37:47.472 INFO:teuthology.orchestra.run.gibba015.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-11-12T05:37:47.474 INFO:teuthology.orchestra.run.gibba038.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-11-12T05:37:47.477 INFO:teuthology.orchestra.run.gibba038.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.15-22-ga81ee281-1focal [361 kB] 2021-11-12T05:37:47.478 INFO:teuthology.orchestra.run.gibba038.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-11-12T05:37:47.484 INFO:teuthology.orchestra.run.gibba016.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-11-12T05:37:47.485 INFO:teuthology.orchestra.run.gibba016.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-11-12T05:37:47.533 INFO:teuthology.orchestra.run.gibba016.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-11-12T05:37:47.533 INFO:teuthology.orchestra.run.gibba016.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-11-12T05:37:47.534 INFO:teuthology.orchestra.run.gibba016.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-11-12T05:37:47.534 INFO:teuthology.orchestra.run.gibba016.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-11-12T05:37:47.535 INFO:teuthology.orchestra.run.gibba016.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-11-12T05:37:47.535 INFO:teuthology.orchestra.run.gibba016.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-11-12T05:37:47.536 INFO:teuthology.orchestra.run.gibba044.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-11-12T05:37:47.536 INFO:teuthology.orchestra.run.gibba016.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-11-12T05:37:47.536 INFO:teuthology.orchestra.run.gibba044.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-11-12T05:37:47.537 INFO:teuthology.orchestra.run.gibba044.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-11-12T05:37:47.544 INFO:teuthology.orchestra.run.gibba038.stdout:Get:64 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.15-22-ga81ee281-1focal [20.0 MB] 2021-11-12T05:37:47.545 INFO:teuthology.orchestra.run.gibba044.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-11-12T05:37:47.550 INFO:teuthology.orchestra.run.gibba005.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-11-12T05:37:47.552 INFO:teuthology.orchestra.run.gibba005.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-11-12T05:37:47.553 INFO:teuthology.orchestra.run.gibba005.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-11-12T05:37:47.554 INFO:teuthology.orchestra.run.gibba015.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-11-12T05:37:47.555 INFO:teuthology.orchestra.run.gibba015.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-11-12T05:37:47.555 INFO:teuthology.orchestra.run.gibba005.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-11-12T05:37:47.556 INFO:teuthology.orchestra.run.gibba038.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-11-12T05:37:47.557 INFO:teuthology.orchestra.run.gibba015.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-11-12T05:37:47.559 INFO:teuthology.orchestra.run.gibba038.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-11-12T05:37:47.560 INFO:teuthology.orchestra.run.gibba038.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-11-12T05:37:47.569 INFO:teuthology.orchestra.run.gibba038.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-11-12T05:37:47.570 INFO:teuthology.orchestra.run.gibba038.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-11-12T05:37:47.576 INFO:teuthology.orchestra.run.gibba038.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2021-11-12T05:37:47.577 INFO:teuthology.orchestra.run.gibba038.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-11-12T05:37:47.577 INFO:teuthology.orchestra.run.gibba015.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-11-12T05:37:47.578 INFO:teuthology.orchestra.run.gibba005.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-11-12T05:37:47.579 INFO:teuthology.orchestra.run.gibba005.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-11-12T05:37:47.580 INFO:teuthology.orchestra.run.gibba005.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-11-12T05:37:47.580 INFO:teuthology.orchestra.run.gibba005.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-11-12T05:37:47.584 INFO:teuthology.orchestra.run.gibba038.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-11-12T05:37:47.586 INFO:teuthology.orchestra.run.gibba015.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-11-12T05:37:47.589 INFO:teuthology.orchestra.run.gibba015.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-11-12T05:37:47.590 INFO:teuthology.orchestra.run.gibba015.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-11-12T05:37:47.597 INFO:teuthology.orchestra.run.gibba015.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-11-12T05:37:47.603 INFO:teuthology.orchestra.run.gibba015.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-11-12T05:37:47.615 INFO:teuthology.orchestra.run.gibba015.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2021-11-12T05:37:47.618 INFO:teuthology.orchestra.run.gibba044.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-11-12T05:37:47.619 INFO:teuthology.orchestra.run.gibba016.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-11-12T05:37:47.620 INFO:teuthology.orchestra.run.gibba016.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-11-12T05:37:47.621 INFO:teuthology.orchestra.run.gibba016.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-11-12T05:37:47.622 INFO:teuthology.orchestra.run.gibba044.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-11-12T05:37:47.624 INFO:teuthology.orchestra.run.gibba044.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-11-12T05:37:47.629 INFO:teuthology.orchestra.run.gibba016.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-11-12T05:37:47.633 INFO:teuthology.orchestra.run.gibba016.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-11-12T05:37:47.634 INFO:teuthology.orchestra.run.gibba044.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-11-12T05:37:47.638 INFO:teuthology.orchestra.run.gibba016.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-11-12T05:37:47.638 INFO:teuthology.orchestra.run.gibba044.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-11-12T05:37:47.640 INFO:teuthology.orchestra.run.gibba016.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-11-12T05:37:47.641 INFO:teuthology.orchestra.run.gibba005.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2021-11-12T05:37:47.641 INFO:teuthology.orchestra.run.gibba005.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-11-12T05:37:47.643 INFO:teuthology.orchestra.run.gibba038.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-11-12T05:37:47.643 INFO:teuthology.orchestra.run.gibba038.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-11-12T05:37:47.645 INFO:teuthology.orchestra.run.gibba044.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2021-11-12T05:37:47.649 INFO:teuthology.orchestra.run.gibba016.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-11-12T05:37:47.677 INFO:teuthology.orchestra.run.gibba015.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-11-12T05:37:47.688 INFO:teuthology.orchestra.run.gibba016.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-11-12T05:37:47.691 INFO:teuthology.orchestra.run.gibba015.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-11-12T05:37:47.692 INFO:teuthology.orchestra.run.gibba015.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-11-12T05:37:47.694 INFO:teuthology.orchestra.run.gibba015.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-11-12T05:37:47.695 INFO:teuthology.orchestra.run.gibba015.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-11-12T05:37:47.695 INFO:teuthology.orchestra.run.gibba016.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2021-11-12T05:37:47.697 INFO:teuthology.orchestra.run.gibba015.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-11-12T05:37:47.700 INFO:teuthology.orchestra.run.gibba044.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-11-12T05:37:47.710 INFO:teuthology.orchestra.run.gibba044.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-11-12T05:37:47.711 INFO:teuthology.orchestra.run.gibba044.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-11-12T05:37:47.712 INFO:teuthology.orchestra.run.gibba044.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-11-12T05:37:47.723 INFO:teuthology.orchestra.run.gibba005.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-11-12T05:37:47.726 INFO:teuthology.orchestra.run.gibba038.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-11-12T05:37:47.728 INFO:teuthology.orchestra.run.gibba005.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-11-12T05:37:47.729 INFO:teuthology.orchestra.run.gibba038.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-11-12T05:37:47.747 INFO:teuthology.orchestra.run.gibba038.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-11-12T05:37:47.747 INFO:teuthology.orchestra.run.gibba038.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-11-12T05:37:47.747 INFO:teuthology.orchestra.run.gibba038.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-11-12T05:37:47.748 INFO:teuthology.orchestra.run.gibba038.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-11-12T05:37:47.750 INFO:teuthology.orchestra.run.gibba038.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2021-11-12T05:37:47.751 INFO:teuthology.orchestra.run.gibba038.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-11-12T05:37:47.759 INFO:teuthology.orchestra.run.gibba015.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-11-12T05:37:47.760 INFO:teuthology.orchestra.run.gibba015.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-11-12T05:37:47.762 INFO:teuthology.orchestra.run.gibba015.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-11-12T05:37:47.763 INFO:teuthology.orchestra.run.gibba015.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-11-12T05:37:47.770 INFO:teuthology.orchestra.run.gibba016.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-11-12T05:37:47.780 INFO:teuthology.orchestra.run.gibba016.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-11-12T05:37:47.781 INFO:teuthology.orchestra.run.gibba016.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-11-12T05:37:47.782 INFO:teuthology.orchestra.run.gibba044.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-11-12T05:37:47.783 INFO:teuthology.orchestra.run.gibba016.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-11-12T05:37:47.784 INFO:teuthology.orchestra.run.gibba016.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-11-12T05:37:47.785 INFO:teuthology.orchestra.run.gibba044.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-11-12T05:37:47.787 INFO:teuthology.orchestra.run.gibba016.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-11-12T05:37:47.811 INFO:teuthology.orchestra.run.gibba044.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-11-12T05:37:47.811 INFO:teuthology.orchestra.run.gibba044.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-11-12T05:37:47.811 INFO:teuthology.orchestra.run.gibba044.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-11-12T05:37:47.812 INFO:teuthology.orchestra.run.gibba044.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-11-12T05:37:47.812 INFO:teuthology.orchestra.run.gibba038.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-11-12T05:37:47.814 INFO:teuthology.orchestra.run.gibba038.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-11-12T05:37:47.816 INFO:teuthology.orchestra.run.gibba016.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-11-12T05:37:47.817 INFO:teuthology.orchestra.run.gibba016.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-11-12T05:37:47.842 INFO:teuthology.orchestra.run.gibba015.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2021-11-12T05:37:47.844 INFO:teuthology.orchestra.run.gibba015.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-11-12T05:37:47.845 INFO:teuthology.orchestra.run.gibba015.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-11-12T05:37:47.852 INFO:teuthology.orchestra.run.gibba016.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-11-12T05:37:47.852 INFO:teuthology.orchestra.run.gibba016.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-11-12T05:37:47.853 INFO:teuthology.orchestra.run.gibba015.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-11-12T05:37:47.864 INFO:teuthology.orchestra.run.gibba044.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2021-11-12T05:37:47.865 INFO:teuthology.orchestra.run.gibba044.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-11-12T05:37:47.865 INFO:teuthology.orchestra.run.gibba044.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-11-12T05:37:47.867 INFO:teuthology.orchestra.run.gibba044.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-11-12T05:37:47.935 INFO:teuthology.orchestra.run.gibba016.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2021-11-12T05:37:47.937 INFO:teuthology.orchestra.run.gibba016.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-11-12T05:37:47.938 INFO:teuthology.orchestra.run.gibba016.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-11-12T05:37:47.943 INFO:teuthology.orchestra.run.gibba016.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-11-12T05:37:47.994 INFO:teuthology.orchestra.run.gibba044.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.15-22-ga81ee281-1focal [115 kB] 2021-11-12T05:37:48.021 INFO:teuthology.orchestra.run.gibba044.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.15-22-ga81ee281-1focal [361 kB] 2021-11-12T05:37:48.068 INFO:teuthology.orchestra.run.gibba044.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.15-22-ga81ee281-1focal [20.0 MB] 2021-11-12T05:37:48.750 INFO:teuthology.orchestra.run.gibba016.stdout:Get:75 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.15-22-ga81ee281-1focal [463 kB] 2021-11-12T05:37:48.959 INFO:teuthology.orchestra.run.gibba016.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.15-22-ga81ee281-1focal [365 kB] 2021-11-12T05:37:48.968 INFO:teuthology.orchestra.run.gibba005.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.15-22-ga81ee281-1focal [5,332 kB] 2021-11-12T05:37:49.096 INFO:teuthology.orchestra.run.gibba016.stdout:Get:77 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.15-22-ga81ee281-1focal [20.8 kB] 2021-11-12T05:37:49.098 INFO:teuthology.orchestra.run.gibba016.stdout:Get:78 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.15-22-ga81ee281-1focal [156 kB] 2021-11-12T05:37:49.170 INFO:teuthology.orchestra.run.gibba016.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.15-22-ga81ee281-1focal [29.4 kB] 2021-11-12T05:37:49.171 INFO:teuthology.orchestra.run.gibba016.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.15-22-ga81ee281-1focal [364 kB] 2021-11-12T05:37:49.239 INFO:teuthology.orchestra.run.gibba015.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.15-22-ga81ee281-1focal [5,332 kB] 2021-11-12T05:37:49.317 INFO:teuthology.orchestra.run.gibba016.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.15-22-ga81ee281-1focal [3,138 kB] 2021-11-12T05:37:49.535 INFO:teuthology.orchestra.run.gibba005.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.15-22-ga81ee281-1focal [162 kB] 2021-11-12T05:37:49.566 INFO:teuthology.orchestra.run.gibba005.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.15-22-ga81ee281-1focal [1,402 kB] 2021-11-12T05:37:49.721 INFO:teuthology.orchestra.run.gibba005.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.15-22-ga81ee281-1focal [6,173 kB] 2021-11-12T05:37:49.847 INFO:teuthology.orchestra.run.gibba015.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.15-22-ga81ee281-1focal [162 kB] 2021-11-12T05:37:49.878 INFO:teuthology.orchestra.run.gibba015.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.15-22-ga81ee281-1focal [1,402 kB] 2021-11-12T05:37:50.040 INFO:teuthology.orchestra.run.gibba015.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.15-22-ga81ee281-1focal [6,173 kB] 2021-11-12T05:37:50.482 INFO:teuthology.orchestra.run.gibba016.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.15-22-ga81ee281-1focal [115 kB] 2021-11-12T05:37:50.488 INFO:teuthology.orchestra.run.gibba005.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.15-22-ga81ee281-1focal [23.9 MB] 2021-11-12T05:37:50.522 INFO:teuthology.orchestra.run.gibba016.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.15-22-ga81ee281-1focal [361 kB] 2021-11-12T05:37:50.646 INFO:teuthology.orchestra.run.gibba016.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.15-22-ga81ee281-1focal [20.0 MB] 2021-11-12T05:37:50.841 INFO:teuthology.orchestra.run.gibba015.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.15-22-ga81ee281-1focal [23.9 MB] 2021-11-12T05:37:51.360 INFO:teuthology.orchestra.run.gibba044.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.15-22-ga81ee281-1focal [5,332 kB] 2021-11-12T05:37:51.369 INFO:teuthology.orchestra.run.gibba038.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.15-22-ga81ee281-1focal [5,332 kB] 2021-11-12T05:37:52.151 INFO:teuthology.orchestra.run.gibba044.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.15-22-ga81ee281-1focal [162 kB] 2021-11-12T05:37:52.183 INFO:teuthology.orchestra.run.gibba044.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.15-22-ga81ee281-1focal [1,402 kB] 2021-11-12T05:37:52.281 INFO:teuthology.orchestra.run.gibba038.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.15-22-ga81ee281-1focal [162 kB] 2021-11-12T05:37:52.298 INFO:teuthology.orchestra.run.gibba038.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.15-22-ga81ee281-1focal [1,402 kB] 2021-11-12T05:37:52.404 INFO:teuthology.orchestra.run.gibba044.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.15-22-ga81ee281-1focal [6,173 kB] 2021-11-12T05:37:52.568 INFO:teuthology.orchestra.run.gibba038.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.15-22-ga81ee281-1focal [6,173 kB] 2021-11-12T05:37:53.419 INFO:teuthology.orchestra.run.gibba044.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.15-22-ga81ee281-1focal [23.9 MB] 2021-11-12T05:37:53.576 INFO:teuthology.orchestra.run.gibba005.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.15-22-ga81ee281-1focal [4,012 B] 2021-11-12T05:37:53.577 INFO:teuthology.orchestra.run.gibba005.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.15-22-ga81ee281-1focal [538 kB] 2021-11-12T05:37:53.592 INFO:teuthology.orchestra.run.gibba005.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.15-22-ga81ee281-1focal [2,007 kB] 2021-11-12T05:37:53.658 INFO:teuthology.orchestra.run.gibba038.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.15-22-ga81ee281-1focal [23.9 MB] 2021-11-12T05:37:53.839 INFO:teuthology.orchestra.run.gibba005.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.15-22-ga81ee281-1focal [53.2 kB] 2021-11-12T05:37:53.841 INFO:teuthology.orchestra.run.gibba005.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.15-22-ga81ee281-1focal [58.2 kB] 2021-11-12T05:37:53.844 INFO:teuthology.orchestra.run.gibba005.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.15-22-ga81ee281-1focal [3,208 kB] 2021-11-12T05:37:54.001 INFO:teuthology.orchestra.run.gibba015.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.15-22-ga81ee281-1focal [4,012 B] 2021-11-12T05:37:54.003 INFO:teuthology.orchestra.run.gibba015.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.15-22-ga81ee281-1focal [538 kB] 2021-11-12T05:37:54.007 INFO:teuthology.orchestra.run.gibba015.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.15-22-ga81ee281-1focal [2,007 kB] 2021-11-12T05:37:54.266 INFO:teuthology.orchestra.run.gibba005.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.15-22-ga81ee281-1focal [34.4 kB] 2021-11-12T05:37:54.267 INFO:teuthology.orchestra.run.gibba005.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.15-22-ga81ee281-1focal [7,869 kB] 2021-11-12T05:37:54.299 INFO:teuthology.orchestra.run.gibba015.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.15-22-ga81ee281-1focal [53.2 kB] 2021-11-12T05:37:54.301 INFO:teuthology.orchestra.run.gibba015.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.15-22-ga81ee281-1focal [58.2 kB] 2021-11-12T05:37:54.303 INFO:teuthology.orchestra.run.gibba015.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.15-22-ga81ee281-1focal [3,208 kB] 2021-11-12T05:37:54.717 INFO:teuthology.orchestra.run.gibba015.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.15-22-ga81ee281-1focal [34.4 kB] 2021-11-12T05:37:54.718 INFO:teuthology.orchestra.run.gibba015.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.15-22-ga81ee281-1focal [7,869 kB] 2021-11-12T05:37:55.298 INFO:teuthology.orchestra.run.gibba005.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.15-22-ga81ee281-1focal [4,128 B] 2021-11-12T05:37:55.299 INFO:teuthology.orchestra.run.gibba005.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.15-22-ga81ee281-1focal [39.8 MB] 2021-11-12T05:37:55.772 INFO:teuthology.orchestra.run.gibba015.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.15-22-ga81ee281-1focal [4,128 B] 2021-11-12T05:37:55.773 INFO:teuthology.orchestra.run.gibba015.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.15-22-ga81ee281-1focal [39.8 MB] 2021-11-12T05:37:56.575 INFO:teuthology.orchestra.run.gibba016.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.15-22-ga81ee281-1focal [5,332 kB] 2021-11-12T05:37:57.428 INFO:teuthology.orchestra.run.gibba044.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.15-22-ga81ee281-1focal [4,012 B] 2021-11-12T05:37:57.428 INFO:teuthology.orchestra.run.gibba044.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.15-22-ga81ee281-1focal [538 kB] 2021-11-12T05:37:57.480 INFO:teuthology.orchestra.run.gibba044.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.15-22-ga81ee281-1focal [2,007 kB] 2021-11-12T05:37:57.783 INFO:teuthology.orchestra.run.gibba016.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.15-22-ga81ee281-1focal [162 kB] 2021-11-12T05:37:57.801 INFO:teuthology.orchestra.run.gibba044.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.15-22-ga81ee281-1focal [53.2 kB] 2021-11-12T05:37:57.809 INFO:teuthology.orchestra.run.gibba044.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.15-22-ga81ee281-1focal [58.2 kB] 2021-11-12T05:37:57.814 INFO:teuthology.orchestra.run.gibba044.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.15-22-ga81ee281-1focal [3,208 kB] 2021-11-12T05:37:57.840 INFO:teuthology.orchestra.run.gibba016.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.15-22-ga81ee281-1focal [1,402 kB] 2021-11-12T05:37:57.974 INFO:teuthology.orchestra.run.gibba038.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.15-22-ga81ee281-1focal [4,012 B] 2021-11-12T05:37:57.975 INFO:teuthology.orchestra.run.gibba038.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.15-22-ga81ee281-1focal [538 kB] 2021-11-12T05:37:58.033 INFO:teuthology.orchestra.run.gibba038.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.15-22-ga81ee281-1focal [2,007 kB] 2021-11-12T05:37:58.088 INFO:teuthology.orchestra.run.gibba016.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.15-22-ga81ee281-1focal [6,173 kB] 2021-11-12T05:37:58.356 INFO:teuthology.orchestra.run.gibba044.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.15-22-ga81ee281-1focal [34.4 kB] 2021-11-12T05:37:58.363 INFO:teuthology.orchestra.run.gibba044.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.15-22-ga81ee281-1focal [7,869 kB] 2021-11-12T05:37:58.391 INFO:teuthology.orchestra.run.gibba038.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.15-22-ga81ee281-1focal [53.2 kB] 2021-11-12T05:37:58.393 INFO:teuthology.orchestra.run.gibba038.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.15-22-ga81ee281-1focal [58.2 kB] 2021-11-12T05:37:58.424 INFO:teuthology.orchestra.run.gibba038.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.15-22-ga81ee281-1focal [3,208 kB] 2021-11-12T05:37:58.963 INFO:teuthology.orchestra.run.gibba038.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.15-22-ga81ee281-1focal [34.4 kB] 2021-11-12T05:37:58.995 INFO:teuthology.orchestra.run.gibba038.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.15-22-ga81ee281-1focal [7,869 kB] 2021-11-12T05:37:59.213 INFO:teuthology.orchestra.run.gibba016.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.15-22-ga81ee281-1focal [23.9 MB] 2021-11-12T05:37:59.713 INFO:teuthology.orchestra.run.gibba044.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.15-22-ga81ee281-1focal [4,128 B] 2021-11-12T05:37:59.716 INFO:teuthology.orchestra.run.gibba044.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.15-22-ga81ee281-1focal [39.8 MB] 2021-11-12T05:38:00.342 INFO:teuthology.orchestra.run.gibba038.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.15-22-ga81ee281-1focal [4,128 B] 2021-11-12T05:38:00.343 INFO:teuthology.orchestra.run.gibba038.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.15-22-ga81ee281-1focal [39.8 MB] 2021-11-12T05:38:01.190 INFO:teuthology.orchestra.run.gibba005.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 15.2.15-22-ga81ee281-1focal [15.9 kB] 2021-11-12T05:38:01.191 INFO:teuthology.orchestra.run.gibba005.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.15-22-ga81ee281-1focal [18.1 kB] 2021-11-12T05:38:01.191 INFO:teuthology.orchestra.run.gibba005.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.15-22-ga81ee281-1focal [9,716 kB] 2021-11-12T05:38:01.447 INFO:teuthology.orchestra.run.gibba015.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 15.2.15-22-ga81ee281-1focal [15.9 kB] 2021-11-12T05:38:01.448 INFO:teuthology.orchestra.run.gibba015.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.15-22-ga81ee281-1focal [18.1 kB] 2021-11-12T05:38:01.449 INFO:teuthology.orchestra.run.gibba015.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.15-22-ga81ee281-1focal [9,716 kB] 2021-11-12T05:38:02.542 INFO:teuthology.orchestra.run.gibba015.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.15-22-ga81ee281-1focal [60.9 kB] 2021-11-12T05:38:02.772 INFO:teuthology.orchestra.run.gibba005.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.15-22-ga81ee281-1focal [60.9 kB] 2021-11-12T05:38:02.863 INFO:teuthology.orchestra.run.gibba015.stdout:Fetched 153 MB in 17s (8,899 kB/s) 2021-11-12T05:38:03.032 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-pyperclip. 2021-11-12T05:38:03.104 INFO:teuthology.orchestra.run.gibba015.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174687 files and directories currently installed.) 2021-11-12T05:38:03.107 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2021-11-12T05:38:03.146 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2021-11-12T05:38:03.457 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-wcwidth. 2021-11-12T05:38:03.487 INFO:teuthology.orchestra.run.gibba005.stdout:Fetched 153 MB in 18s (8,559 kB/s) 2021-11-12T05:38:03.489 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-11-12T05:38:03.532 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-11-12T05:38:03.622 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-pyperclip. 2021-11-12T05:38:03.696 INFO:teuthology.orchestra.run.gibba005.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174687 files and directories currently installed.) 2021-11-12T05:38:03.700 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2021-11-12T05:38:03.737 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2021-11-12T05:38:03.868 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-cmd2. 2021-11-12T05:38:03.878 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2021-11-12T05:38:03.918 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2021-11-12T05:38:04.045 INFO:teuthology.orchestra.run.gibba016.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.15-22-ga81ee281-1focal [4,012 B] 2021-11-12T05:38:04.074 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-wcwidth. 2021-11-12T05:38:04.087 INFO:teuthology.orchestra.run.gibba016.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.15-22-ga81ee281-1focal [538 kB] 2021-11-12T05:38:04.105 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-11-12T05:38:04.124 INFO:teuthology.orchestra.run.gibba016.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.15-22-ga81ee281-1focal [2,007 kB] 2021-11-12T05:38:04.148 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-11-12T05:38:04.179 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-11-12T05:38:04.212 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-11-12T05:38:04.287 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-11-12T05:38:04.468 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-cmd2. 2021-11-12T05:38:04.478 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2021-11-12T05:38:04.517 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2021-11-12T05:38:04.533 INFO:teuthology.orchestra.run.gibba016.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.15-22-ga81ee281-1focal [53.2 kB] 2021-11-12T05:38:04.559 INFO:teuthology.orchestra.run.gibba016.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.15-22-ga81ee281-1focal [58.2 kB] 2021-11-12T05:38:04.564 INFO:teuthology.orchestra.run.gibba016.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.15-22-ga81ee281-1focal [3,208 kB] 2021-11-12T05:38:04.634 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../004-librbd1_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:04.758 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking librbd1 (15.2.15-22-ga81ee281-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-11-12T05:38:04.829 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-11-12T05:38:04.861 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-11-12T05:38:04.929 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-11-12T05:38:05.172 INFO:teuthology.orchestra.run.gibba016.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.15-22-ga81ee281-1focal [34.4 kB] 2021-11-12T05:38:05.173 INFO:teuthology.orchestra.run.gibba016.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.15-22-ga81ee281-1focal [7,869 kB] 2021-11-12T05:38:05.258 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../004-librbd1_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:05.305 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../005-librados2_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:05.382 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking librbd1 (15.2.15-22-ga81ee281-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-11-12T05:38:05.404 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking librados2 (15.2.15-22-ga81ee281-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-11-12T05:38:05.969 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../005-librados2_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:06.057 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package libcephfs2. 2021-11-12T05:38:06.068 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../006-libcephfs2_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:06.078 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking librados2 (15.2.15-22-ga81ee281-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-11-12T05:38:06.107 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking libcephfs2 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:06.237 INFO:teuthology.orchestra.run.gibba038.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 15.2.15-22-ga81ee281-1focal [15.9 kB] 2021-11-12T05:38:06.238 INFO:teuthology.orchestra.run.gibba038.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.15-22-ga81ee281-1focal [18.1 kB] 2021-11-12T05:38:06.239 INFO:teuthology.orchestra.run.gibba038.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.15-22-ga81ee281-1focal [9,716 kB] 2021-11-12T05:38:06.410 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-rados. 2021-11-12T05:38:06.442 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../007-python3-rados_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:06.518 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-rados (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:06.551 INFO:teuthology.orchestra.run.gibba016.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.15-22-ga81ee281-1focal [4,128 B] 2021-11-12T05:38:06.552 INFO:teuthology.orchestra.run.gibba016.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.15-22-ga81ee281-1focal [39.8 MB] 2021-11-12T05:38:06.623 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package libcephfs2. 2021-11-12T05:38:06.633 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../006-libcephfs2_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:06.673 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking libcephfs2 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:06.869 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-11-12T05:38:06.879 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../008-python3-ceph-argparse_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:06.918 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-ceph-argparse (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:07.000 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-rados. 2021-11-12T05:38:07.032 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../007-python3-rados_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:07.075 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-rados (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:07.215 INFO:teuthology.orchestra.run.gibba038.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.15-22-ga81ee281-1focal [60.9 kB] 2021-11-12T05:38:07.263 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-cephfs. 2021-11-12T05:38:07.295 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../009-python3-cephfs_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:07.339 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-cephfs (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:07.452 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-11-12T05:38:07.462 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../008-python3-ceph-argparse_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:07.502 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-ceph-argparse (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:07.532 INFO:teuthology.orchestra.run.gibba038.stdout:Fetched 153 MB in 22s (7,003 kB/s) 2021-11-12T05:38:07.583 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-ceph-common. 2021-11-12T05:38:07.615 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../010-python3-ceph-common_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:07.649 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-ceph-common (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:07.650 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-pyperclip. 2021-11-12T05:38:07.721 INFO:teuthology.orchestra.run.gibba038.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174687 files and directories currently installed.) 2021-11-12T05:38:07.724 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2021-11-12T05:38:07.757 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2021-11-12T05:38:07.804 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-cephfs. 2021-11-12T05:38:07.836 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../009-python3-cephfs_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:07.897 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-cephfs (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:08.051 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-wcwidth. 2021-11-12T05:38:08.083 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-11-12T05:38:08.119 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-prettytable. 2021-11-12T05:38:08.126 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-11-12T05:38:08.129 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2021-11-12T05:38:08.133 INFO:teuthology.orchestra.run.gibba044.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 15.2.15-22-ga81ee281-1focal [15.9 kB] 2021-11-12T05:38:08.134 INFO:teuthology.orchestra.run.gibba044.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.15-22-ga81ee281-1focal [18.1 kB] 2021-11-12T05:38:08.135 INFO:teuthology.orchestra.run.gibba044.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.15-22-ga81ee281-1focal [9,716 kB] 2021-11-12T05:38:08.166 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-ceph-common. 2021-11-12T05:38:08.168 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-11-12T05:38:08.176 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../010-python3-ceph-common_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:08.215 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-ceph-common (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:08.429 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-rbd. 2021-11-12T05:38:08.461 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../012-python3-rbd_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:08.479 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-cmd2. 2021-11-12T05:38:08.485 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-prettytable. 2021-11-12T05:38:08.489 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2021-11-12T05:38:08.504 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-rbd (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:08.517 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2021-11-12T05:38:08.528 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2021-11-12T05:38:08.551 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-11-12T05:38:08.795 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-rbd. 2021-11-12T05:38:08.827 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../012-python3-rbd_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:08.870 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-rbd (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:08.873 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-11-12T05:38:08.904 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-11-12T05:38:08.915 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-11-12T05:38:08.926 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../013-librabbitmq4_0.10.0-1_amd64.deb ... 2021-11-12T05:38:08.965 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-11-12T05:38:08.989 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-11-12T05:38:09.255 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-11-12T05:38:09.277 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../004-librbd1_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:09.282 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-11-12T05:38:09.286 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../014-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-11-12T05:38:09.291 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../013-librabbitmq4_0.10.0-1_amd64.deb ... 2021-11-12T05:38:09.331 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-11-12T05:38:09.371 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-11-12T05:38:09.401 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking librbd1 (15.2.15-22-ga81ee281-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-11-12T05:38:09.576 INFO:teuthology.orchestra.run.gibba044.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.15-22-ga81ee281-1focal [60.9 kB] 2021-11-12T05:38:09.642 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-11-12T05:38:09.674 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../014-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-11-12T05:38:09.707 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package librgw2. 2021-11-12T05:38:09.708 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-11-12T05:38:09.717 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../015-librgw2_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:09.757 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking librgw2 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:09.889 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../005-librados2_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:09.895 INFO:teuthology.orchestra.run.gibba044.stdout:Fetched 153 MB in 24s (6,317 kB/s) 2021-11-12T05:38:09.986 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package librgw2. 2021-11-12T05:38:09.996 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../015-librgw2_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:10.013 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking librados2 (15.2.15-22-ga81ee281-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-11-12T05:38:10.058 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-pyperclip. 2021-11-12T05:38:10.060 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking librgw2 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:10.113 INFO:teuthology.orchestra.run.gibba044.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174687 files and directories currently installed.) 2021-11-12T05:38:10.116 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2021-11-12T05:38:10.156 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2021-11-12T05:38:10.243 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-rgw. 2021-11-12T05:38:10.275 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../016-python3-rgw_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:10.309 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-rgw (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:10.501 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-wcwidth. 2021-11-12T05:38:10.509 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-11-12T05:38:10.551 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-11-12T05:38:10.584 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package libcephfs2. 2021-11-12T05:38:10.588 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-rgw. 2021-11-12T05:38:10.593 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../006-libcephfs2_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:10.598 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../016-python3-rgw_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:10.625 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking libcephfs2 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:10.645 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-11-12T05:38:10.646 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-rgw (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:10.655 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../017-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-11-12T05:38:10.694 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-11-12T05:38:10.845 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-cmd2. 2021-11-12T05:38:10.877 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2021-11-12T05:38:10.877 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-rados. 2021-11-12T05:38:10.910 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../007-python3-rados_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:10.911 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2021-11-12T05:38:10.957 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-11-12T05:38:10.965 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-rados (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:10.989 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../017-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-11-12T05:38:11.032 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-11-12T05:38:11.075 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package liboath0. 2021-11-12T05:38:11.104 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../018-liboath0_2.6.1-1.3_amd64.deb ... 2021-11-12T05:38:11.147 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-11-12T05:38:11.239 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-11-12T05:38:11.271 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-11-12T05:38:11.339 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-11-12T05:38:11.347 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-11-12T05:38:11.357 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../008-python3-ceph-argparse_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:11.376 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package liboath0. 2021-11-12T05:38:11.385 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../018-liboath0_2.6.1-1.3_amd64.deb ... 2021-11-12T05:38:11.396 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-ceph-argparse (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:11.417 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-11-12T05:38:11.509 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package libradosstriper1. 2021-11-12T05:38:11.519 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../019-libradosstriper1_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:11.566 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking libradosstriper1 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:11.674 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-cephfs. 2021-11-12T05:38:11.700 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../004-librbd1_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:11.706 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../009-python3-cephfs_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:11.712 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package libradosstriper1. 2021-11-12T05:38:11.740 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-cephfs (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:11.744 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../019-libradosstriper1_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:11.778 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking libradosstriper1 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:11.789 INFO:teuthology.orchestra.run.gibba016.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 15.2.15-22-ga81ee281-1focal [15.9 kB] 2021-11-12T05:38:11.826 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking librbd1 (15.2.15-22-ga81ee281-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-11-12T05:38:11.856 INFO:teuthology.orchestra.run.gibba016.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.15-22-ga81ee281-1focal [18.1 kB] 2021-11-12T05:38:11.856 INFO:teuthology.orchestra.run.gibba016.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.15-22-ga81ee281-1focal [9,716 kB] 2021-11-12T05:38:11.936 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package ceph-common. 2021-11-12T05:38:11.968 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../020-ceph-common_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:12.011 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking ceph-common (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:12.058 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-ceph-common. 2021-11-12T05:38:12.068 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../010-python3-ceph-common_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:12.107 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-ceph-common (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:12.240 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package ceph-common. 2021-11-12T05:38:12.250 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../020-ceph-common_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:12.289 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking ceph-common (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:12.331 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../005-librados2_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:12.344 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-prettytable. 2021-11-12T05:38:12.376 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2021-11-12T05:38:12.410 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-11-12T05:38:12.454 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking librados2 (15.2.15-22-ga81ee281-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-11-12T05:38:12.688 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-rbd. 2021-11-12T05:38:12.720 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../012-python3-rbd_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:12.762 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-rbd (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:12.808 INFO:teuthology.orchestra.run.gibba016.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/octopus/a81ee2815de5acae59ead5b8c9137b6766fc8ea8/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.15-22-ga81ee281-1focal [60.9 kB] 2021-11-12T05:38:12.999 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package libcephfs2. 2021-11-12T05:38:13.031 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../006-libcephfs2_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:13.074 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking libcephfs2 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:13.127 INFO:teuthology.orchestra.run.gibba016.stdout:Fetched 153 MB in 27s (5,587 kB/s) 2021-11-12T05:38:13.183 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-11-12T05:38:13.192 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../013-librabbitmq4_0.10.0-1_amd64.deb ... 2021-11-12T05:38:13.231 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-11-12T05:38:13.246 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-pyperclip. 2021-11-12T05:38:13.316 INFO:teuthology.orchestra.run.gibba016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174687 files and directories currently installed.) 2021-11-12T05:38:13.320 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2021-11-12T05:38:13.360 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2021-11-12T05:38:13.593 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-11-12T05:38:13.618 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-rados. 2021-11-12T05:38:13.625 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../014-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-11-12T05:38:13.627 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../007-python3-rados_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:13.659 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-11-12T05:38:13.667 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-rados (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:13.688 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-wcwidth. 2021-11-12T05:38:13.719 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-11-12T05:38:13.743 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package ceph-base. 2021-11-12T05:38:13.775 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../021-ceph-base_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:13.782 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-11-12T05:38:13.824 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking ceph-base (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:13.921 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package librgw2. 2021-11-12T05:38:13.952 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../015-librgw2_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:13.987 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking librgw2 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:14.004 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-11-12T05:38:14.036 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../008-python3-ceph-argparse_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:14.055 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package ceph-base. 2021-11-12T05:38:14.087 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../021-ceph-base_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:14.104 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-ceph-argparse (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:14.132 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-cmd2. 2021-11-12T05:38:14.135 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking ceph-base (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:14.142 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2021-11-12T05:38:14.181 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2021-11-12T05:38:14.415 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-cephfs. 2021-11-12T05:38:14.424 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../009-python3-cephfs_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:14.464 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-cephfs (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:14.541 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-11-12T05:38:14.573 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-11-12T05:38:14.622 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-cryptography. 2021-11-12T05:38:14.651 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-11-12T05:38:14.654 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../022-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-11-12T05:38:14.688 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-11-12T05:38:14.798 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-ceph-common. 2021-11-12T05:38:14.814 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-rgw. 2021-11-12T05:38:14.830 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../010-python3-ceph-common_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:14.847 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../016-python3-rgw_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:14.873 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-ceph-common (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:14.889 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-rgw (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:14.964 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../004-librbd1_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:14.984 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-cryptography. 2021-11-12T05:38:14.993 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../022-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-11-12T05:38:15.034 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-11-12T05:38:15.067 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-openssl. 2021-11-12T05:38:15.099 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../023-python3-openssl_19.0.0-1build1_all.deb ... 2021-11-12T05:38:15.113 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking librbd1 (15.2.15-22-ga81ee281-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-11-12T05:38:15.142 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-11-12T05:38:15.167 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-prettytable. 2021-11-12T05:38:15.199 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2021-11-12T05:38:15.233 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-11-12T05:38:15.241 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-11-12T05:38:15.252 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../017-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-11-12T05:38:15.291 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-11-12T05:38:15.412 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-openssl. 2021-11-12T05:38:15.419 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-11-12T05:38:15.444 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../023-python3-openssl_19.0.0-1build1_all.deb ... 2021-11-12T05:38:15.451 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../024-ceph-mgr-modules-core_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:15.461 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-rbd. 2021-11-12T05:38:15.492 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../012-python3-rbd_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:15.494 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking ceph-mgr-modules-core (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:15.520 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-11-12T05:38:15.527 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-rbd (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:15.619 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package liboath0. 2021-11-12T05:38:15.651 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../018-liboath0_2.6.1-1.3_amd64.deb ... 2021-11-12T05:38:15.668 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../005-librados2_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:15.685 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-11-12T05:38:15.799 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-11-12T05:38:15.808 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../024-ceph-mgr-modules-core_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:15.834 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking librados2 (15.2.15-22-ga81ee281-1focal) over (15.2.14-0ubuntu0.20.04.1) ... 2021-11-12T05:38:15.841 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-bcrypt. 2021-11-12T05:38:15.856 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking ceph-mgr-modules-core (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:15.872 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-11-12T05:38:15.916 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-11-12T05:38:15.930 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-11-12T05:38:15.939 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../013-librabbitmq4_0.10.0-1_amd64.deb ... 2021-11-12T05:38:15.979 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-11-12T05:38:16.001 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package libradosstriper1. 2021-11-12T05:38:16.011 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../019-libradosstriper1_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:16.050 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking libradosstriper1 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:16.219 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-bcrypt. 2021-11-12T05:38:16.235 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-cherrypy3. 2021-11-12T05:38:16.245 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-6_all.deb ... 2021-11-12T05:38:16.251 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-11-12T05:38:16.284 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-11-12T05:38:16.293 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-11-12T05:38:16.350 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-11-12T05:38:16.381 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../014-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-11-12T05:38:16.424 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-11-12T05:38:16.437 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-common. 2021-11-12T05:38:16.463 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package libcephfs2. 2021-11-12T05:38:16.469 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../020-ceph-common_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:16.472 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../006-libcephfs2_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:16.505 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-common (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:16.512 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking libcephfs2 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:16.640 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-cherrypy3. 2021-11-12T05:38:16.646 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-jwt. 2021-11-12T05:38:16.649 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-6_all.deb ... 2021-11-12T05:38:16.678 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../027-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-11-12T05:38:16.698 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-11-12T05:38:16.722 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-11-12T05:38:16.751 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package librgw2. 2021-11-12T05:38:16.761 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../015-librgw2_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:16.801 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking librgw2 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:16.915 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-rados. 2021-11-12T05:38:16.946 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../007-python3-rados_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:16.981 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-rados (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:17.010 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-jwt. 2021-11-12T05:38:17.042 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../027-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-11-12T05:38:17.066 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-logutils. 2021-11-12T05:38:17.076 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../028-python3-logutils_0.3.3-7_all.deb ... 2021-11-12T05:38:17.077 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-11-12T05:38:17.124 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-11-12T05:38:17.287 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-rgw. 2021-11-12T05:38:17.318 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../016-python3-rgw_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:17.353 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-rgw (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:17.382 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-11-12T05:38:17.392 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../008-python3-ceph-argparse_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:17.402 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-markupsafe. 2021-11-12T05:38:17.404 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-logutils. 2021-11-12T05:38:17.415 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../028-python3-logutils_0.3.3-7_all.deb ... 2021-11-12T05:38:17.431 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-ceph-argparse (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:17.433 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../029-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-11-12T05:38:17.454 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-11-12T05:38:17.468 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-11-12T05:38:17.661 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-11-12T05:38:17.692 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../017-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-11-12T05:38:17.727 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-11-12T05:38:17.768 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-cephfs. 2021-11-12T05:38:17.790 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-markupsafe. 2021-11-12T05:38:17.797 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-mako. 2021-11-12T05:38:17.799 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../009-python3-cephfs_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:17.822 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../029-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-11-12T05:38:17.828 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../030-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-11-12T05:38:17.865 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-11-12T05:38:17.867 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-cephfs (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:17.871 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-11-12T05:38:18.072 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package liboath0. 2021-11-12T05:38:18.080 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../018-liboath0_2.6.1-1.3_amd64.deb ... 2021-11-12T05:38:18.121 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-11-12T05:38:18.201 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-base. 2021-11-12T05:38:18.219 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-mako. 2021-11-12T05:38:18.220 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-ceph-common. 2021-11-12T05:38:18.229 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../030-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-11-12T05:38:18.230 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../010-python3-ceph-common_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:18.233 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../021-ceph-base_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:18.270 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-ceph-common (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:18.276 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-11-12T05:38:18.290 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-base (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:18.466 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package libradosstriper1. 2021-11-12T05:38:18.499 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../019-libradosstriper1_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:18.499 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-simplegeneric. 2021-11-12T05:38:18.510 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../031-python3-simplegeneric_0.8.1-3_all.deb ... 2021-11-12T05:38:18.541 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking libradosstriper1 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:18.588 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-simplegeneric. 2021-11-12T05:38:18.620 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../031-python3-simplegeneric_0.8.1-3_all.deb ... 2021-11-12T05:38:18.648 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-prettytable. 2021-11-12T05:38:18.654 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-11-12T05:38:18.658 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2021-11-12T05:38:18.697 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-11-12T05:38:18.900 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-11-12T05:38:18.942 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-rbd. 2021-11-12T05:38:18.974 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../012-python3-rbd_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:19.006 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-singledispatch. 2021-11-12T05:38:19.008 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-rbd (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:19.039 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../032-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-11-12T05:38:19.063 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-cryptography. 2021-11-12T05:38:19.081 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-11-12T05:38:19.094 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../022-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-11-12T05:38:19.137 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-11-12T05:38:19.241 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-singledispatch. 2021-11-12T05:38:19.273 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../032-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-11-12T05:38:19.311 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-11-12T05:38:19.403 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-11-12T05:38:19.408 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-webob. 2021-11-12T05:38:19.411 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../013-librabbitmq4_0.10.0-1_amd64.deb ... 2021-11-12T05:38:19.417 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../033-python3-webob_1%3a1.8.5-2_all.deb ... 2021-11-12T05:38:19.452 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-11-12T05:38:19.458 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-11-12T05:38:19.494 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package ceph-common. 2021-11-12T05:38:19.526 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../020-ceph-common_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:19.557 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-openssl. 2021-11-12T05:38:19.560 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking ceph-common (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:19.567 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../023-python3-openssl_19.0.0-1build1_all.deb ... 2021-11-12T05:38:19.607 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-11-12T05:38:19.622 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-webob. 2021-11-12T05:38:19.632 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../033-python3-webob_1%3a1.8.5-2_all.deb ... 2021-11-12T05:38:19.672 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-11-12T05:38:19.787 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-soupsieve. 2021-11-12T05:38:19.797 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-11-12T05:38:19.819 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../034-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-11-12T05:38:19.829 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../014-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-11-12T05:38:19.870 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-11-12T05:38:19.905 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-11-12T05:38:20.025 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-soupsieve. 2021-11-12T05:38:20.057 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../034-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-11-12T05:38:20.100 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-11-12T05:38:20.255 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package librgw2. 2021-11-12T05:38:20.264 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../015-librgw2_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:20.304 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking librgw2 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:20.393 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-11-12T05:38:20.424 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../024-ceph-mgr-modules-core_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:20.429 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-bs4. 2021-11-12T05:38:20.439 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../035-python3-bs4_4.8.2-1_all.deb ... 2021-11-12T05:38:20.459 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-mgr-modules-core (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:20.478 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-11-12T05:38:20.797 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-bcrypt. 2021-11-12T05:38:20.824 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-rgw. 2021-11-12T05:38:20.829 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-11-12T05:38:20.856 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../016-python3-rgw_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:20.865 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-waitress. 2021-11-12T05:38:20.872 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-11-12T05:38:20.897 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../036-python3-waitress_1.4.1-1_all.deb ... 2021-11-12T05:38:20.915 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-rgw (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:20.943 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-11-12T05:38:21.007 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-bs4. 2021-11-12T05:38:21.039 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../035-python3-bs4_4.8.2-1_all.deb ... 2021-11-12T05:38:21.072 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-11-12T05:38:21.193 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-11-12T05:38:21.203 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../017-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-11-12T05:38:21.208 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-cherrypy3. 2021-11-12T05:38:21.218 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-6_all.deb ... 2021-11-12T05:38:21.242 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-11-12T05:38:21.265 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-11-12T05:38:21.267 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-tempita. 2021-11-12T05:38:21.277 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../037-python3-tempita_0.5.2-6_all.deb ... 2021-11-12T05:38:21.317 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-11-12T05:38:21.359 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package ceph-base. 2021-11-12T05:38:21.369 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../021-ceph-base_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:21.384 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-waitress. 2021-11-12T05:38:21.412 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking ceph-base (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:21.416 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../036-python3-waitress_1.4.1-1_all.deb ... 2021-11-12T05:38:21.454 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-11-12T05:38:21.574 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-jwt. 2021-11-12T05:38:21.606 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../027-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-11-12T05:38:21.647 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package liboath0. 2021-11-12T05:38:21.649 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-11-12T05:38:21.659 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-paste. 2021-11-12T05:38:21.679 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../018-liboath0_2.6.1-1.3_amd64.deb ... 2021-11-12T05:38:21.691 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../038-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-11-12T05:38:21.728 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-11-12T05:38:21.734 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-11-12T05:38:21.738 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-tempita. 2021-11-12T05:38:21.770 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../037-python3-tempita_0.5.2-6_all.deb ... 2021-11-12T05:38:21.804 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-11-12T05:38:21.977 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-logutils. 2021-11-12T05:38:21.987 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../028-python3-logutils_0.3.3-7_all.deb ... 2021-11-12T05:38:22.027 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-11-12T05:38:22.028 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-11-12T05:38:22.061 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../039-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-11-12T05:38:22.103 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-11-12T05:38:22.150 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-paste. 2021-11-12T05:38:22.160 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../038-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-11-12T05:38:22.199 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-11-12T05:38:22.221 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-cryptography. 2021-11-12T05:38:22.253 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../022-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-11-12T05:38:22.295 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-11-12T05:38:22.321 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-markupsafe. 2021-11-12T05:38:22.353 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../029-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-11-12T05:38:22.373 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package libradosstriper1. 2021-11-12T05:38:22.396 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-11-12T05:38:22.405 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../019-libradosstriper1_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:22.423 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-pastedeploy. 2021-11-12T05:38:22.432 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../040-python3-pastedeploy_2.1.0-1_all.deb ... 2021-11-12T05:38:22.473 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking libradosstriper1 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:22.474 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-11-12T05:38:22.495 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-11-12T05:38:22.527 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../039-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-11-12T05:38:22.603 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-11-12T05:38:22.741 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-mako. 2021-11-12T05:38:22.749 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../030-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-11-12T05:38:22.759 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-openssl. 2021-11-12T05:38:22.768 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../023-python3-openssl_19.0.0-1build1_all.deb ... 2021-11-12T05:38:22.790 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-11-12T05:38:22.793 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-webtest. 2021-11-12T05:38:22.808 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-11-12T05:38:22.825 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../041-python3-webtest_2.0.32-2_all.deb ... 2021-11-12T05:38:22.859 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package ceph-common. 2021-11-12T05:38:22.867 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-11-12T05:38:22.868 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../020-ceph-common_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:22.897 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-pastedeploy. 2021-11-12T05:38:22.907 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../040-python3-pastedeploy_2.1.0-1_all.deb ... 2021-11-12T05:38:22.908 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking ceph-common (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:22.946 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-11-12T05:38:23.077 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-simplegeneric. 2021-11-12T05:38:23.103 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-11-12T05:38:23.109 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../031-python3-simplegeneric_0.8.1-3_all.deb ... 2021-11-12T05:38:23.134 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../024-ceph-mgr-modules-core_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:23.152 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-11-12T05:38:23.177 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking ceph-mgr-modules-core (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:23.187 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-pecan. 2021-11-12T05:38:23.198 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../042-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-11-12T05:38:23.244 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-11-12T05:38:23.283 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-webtest. 2021-11-12T05:38:23.315 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../041-python3-webtest_2.0.32-2_all.deb ... 2021-11-12T05:38:23.357 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-11-12T05:38:23.463 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-singledispatch. 2021-11-12T05:38:23.473 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../032-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-11-12T05:38:23.529 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-11-12T05:38:23.565 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-bcrypt. 2021-11-12T05:38:23.574 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-11-12T05:38:23.617 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-werkzeug. 2021-11-12T05:38:23.622 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-11-12T05:38:23.648 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../043-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-11-12T05:38:23.683 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-11-12T05:38:23.695 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-pecan. 2021-11-12T05:38:23.704 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../042-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-11-12T05:38:23.744 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-11-12T05:38:23.840 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-webob. 2021-11-12T05:38:23.872 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../033-python3-webob_1%3a1.8.5-2_all.deb ... 2021-11-12T05:38:23.915 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-11-12T05:38:23.968 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-cherrypy3. 2021-11-12T05:38:23.999 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-6_all.deb ... 2021-11-12T05:38:24.036 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package ceph-mgr. 2021-11-12T05:38:24.042 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-11-12T05:38:24.047 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../044-ceph-mgr_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:24.065 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-werkzeug. 2021-11-12T05:38:24.097 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../043-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-11-12T05:38:24.102 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking ceph-mgr (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:24.140 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-11-12T05:38:24.309 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-soupsieve. 2021-11-12T05:38:24.319 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../034-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-11-12T05:38:24.384 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-11-12T05:38:24.415 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-jwt. 2021-11-12T05:38:24.424 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../027-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-11-12T05:38:24.465 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-11-12T05:38:24.511 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package ceph-mgr. 2021-11-12T05:38:24.520 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../044-ceph-mgr_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:24.556 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package ceph-mon. 2021-11-12T05:38:24.559 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking ceph-mgr (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:24.565 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../045-ceph-mon_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:24.606 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking ceph-mon (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:24.712 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-bs4. 2021-11-12T05:38:24.723 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../035-python3-bs4_4.8.2-1_all.deb ... 2021-11-12T05:38:24.753 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-11-12T05:38:24.776 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-logutils. 2021-11-12T05:38:24.808 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package ceph-base. 2021-11-12T05:38:24.809 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../028-python3-logutils_0.3.3-7_all.deb ... 2021-11-12T05:38:24.818 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../021-ceph-base_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:24.851 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-11-12T05:38:24.861 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking ceph-base (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:25.038 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package ceph-mon. 2021-11-12T05:38:25.048 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../045-ceph-mon_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:25.095 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking ceph-mon (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:25.098 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-waitress. 2021-11-12T05:38:25.131 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../036-python3-waitress_1.4.1-1_all.deb ... 2021-11-12T05:38:25.194 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-11-12T05:38:25.212 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-markupsafe. 2021-11-12T05:38:25.221 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../029-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-11-12T05:38:25.269 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-11-12T05:38:25.468 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-tempita. 2021-11-12T05:38:25.500 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../037-python3-tempita_0.5.2-6_all.deb ... 2021-11-12T05:38:25.518 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package ceph-osd. 2021-11-12T05:38:25.528 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../046-ceph-osd_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:25.534 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-11-12T05:38:25.575 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking ceph-osd (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:25.597 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-mako. 2021-11-12T05:38:25.629 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../030-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-11-12T05:38:25.671 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-11-12T05:38:25.721 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-cryptography. 2021-11-12T05:38:25.752 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../022-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-11-12T05:38:25.787 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-paste. 2021-11-12T05:38:25.812 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-11-12T05:38:25.819 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../038-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-11-12T05:38:25.854 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-11-12T05:38:25.966 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package ceph-osd. 2021-11-12T05:38:25.976 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../046-ceph-osd_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:26.015 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking ceph-osd (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:26.025 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-simplegeneric. 2021-11-12T05:38:26.035 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../031-python3-simplegeneric_0.8.1-3_all.deb ... 2021-11-12T05:38:26.075 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-11-12T05:38:26.190 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-11-12T05:38:26.199 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-openssl. 2021-11-12T05:38:26.201 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../039-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-11-12T05:38:26.208 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../023-python3-openssl_19.0.0-1build1_all.deb ... 2021-11-12T05:38:26.239 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-11-12T05:38:26.271 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-11-12T05:38:26.370 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-singledispatch. 2021-11-12T05:38:26.402 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../032-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-11-12T05:38:26.469 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-11-12T05:38:26.537 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-pastedeploy. 2021-11-12T05:38:26.568 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-11-12T05:38:26.569 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../040-python3-pastedeploy_2.1.0-1_all.deb ... 2021-11-12T05:38:26.599 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../024-ceph-mgr-modules-core_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:26.612 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-11-12T05:38:26.642 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking ceph-mgr-modules-core (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:26.789 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-webob. 2021-11-12T05:38:26.798 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../033-python3-webob_1%3a1.8.5-2_all.deb ... 2021-11-12T05:38:26.846 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-11-12T05:38:26.949 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-webtest. 2021-11-12T05:38:26.957 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../041-python3-webtest_2.0.32-2_all.deb ... 2021-11-12T05:38:26.998 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-11-12T05:38:27.047 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-bcrypt. 2021-11-12T05:38:27.056 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-11-12T05:38:27.105 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-11-12T05:38:27.204 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-soupsieve. 2021-11-12T05:38:27.235 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../034-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-11-12T05:38:27.278 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-11-12T05:38:27.309 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-pecan. 2021-11-12T05:38:27.342 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../042-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-11-12T05:38:27.384 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-11-12T05:38:27.489 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package ceph. 2021-11-12T05:38:27.499 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../047-ceph_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:27.538 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking ceph (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:27.548 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-cherrypy3. 2021-11-12T05:38:27.558 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-6_all.deb ... 2021-11-12T05:38:27.607 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-11-12T05:38:27.631 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-bs4. 2021-11-12T05:38:27.641 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../035-python3-bs4_4.8.2-1_all.deb ... 2021-11-12T05:38:27.680 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-11-12T05:38:27.722 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-werkzeug. 2021-11-12T05:38:27.732 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../043-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-11-12T05:38:27.771 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-11-12T05:38:27.909 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package ceph-fuse. 2021-11-12T05:38:27.930 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package ceph. 2021-11-12T05:38:27.941 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../048-ceph-fuse_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:27.960 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-jwt. 2021-11-12T05:38:27.962 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../047-ceph_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:27.983 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking ceph-fuse (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:27.991 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../027-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-11-12T05:38:28.038 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking ceph (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:28.060 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-11-12T05:38:28.076 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-waitress. 2021-11-12T05:38:28.108 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../036-python3-waitress_1.4.1-1_all.deb ... 2021-11-12T05:38:28.125 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-mgr. 2021-11-12T05:38:28.155 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-11-12T05:38:28.157 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../044-ceph-mgr_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:28.200 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-mgr (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:28.353 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package ceph-mds. 2021-11-12T05:38:28.363 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../049-ceph-mds_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:28.365 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package ceph-fuse. 2021-11-12T05:38:28.376 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../048-ceph-fuse_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:28.404 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-logutils. 2021-11-12T05:38:28.412 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../028-python3-logutils_0.3.3-7_all.deb ... 2021-11-12T05:38:28.414 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking ceph-fuse (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:28.429 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking ceph-mds (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:28.453 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-tempita. 2021-11-12T05:38:28.454 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-11-12T05:38:28.463 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../037-python3-tempita_0.5.2-6_all.deb ... 2021-11-12T05:38:28.536 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-11-12T05:38:28.669 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-mon. 2021-11-12T05:38:28.679 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../045-ceph-mon_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:28.719 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-mon (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:28.815 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-markupsafe. 2021-11-12T05:38:28.818 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package ceph-mds. 2021-11-12T05:38:28.846 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../029-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-11-12T05:38:28.847 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-paste. 2021-11-12T05:38:28.850 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../049-ceph-mds_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:28.872 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package cephadm. 2021-11-12T05:38:28.879 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../038-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-11-12T05:38:28.882 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../050-cephadm_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:28.890 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-11-12T05:38:28.892 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking ceph-mds (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:28.921 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking cephadm (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:28.922 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-11-12T05:38:29.233 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-jinja2. 2021-11-12T05:38:29.243 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-mako. 2021-11-12T05:38:29.251 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../030-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-11-12T05:38:29.266 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../051-python3-jinja2_2.10.1-2_all.deb ... 2021-11-12T05:38:29.274 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-11-12T05:38:29.285 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../039-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-11-12T05:38:29.308 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-11-12T05:38:29.324 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-11-12T05:38:29.326 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-11-12T05:38:29.388 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package cephadm. 2021-11-12T05:38:29.420 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../050-cephadm_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:29.462 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking cephadm (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:29.606 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-osd. 2021-11-12T05:38:29.615 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../046-ceph-osd_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:29.627 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-11-12T05:38:29.637 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../052-ceph-mgr-cephadm_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:29.654 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-simplegeneric. 2021-11-12T05:38:29.663 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-osd (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:29.670 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-pastedeploy. 2021-11-12T05:38:29.676 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking ceph-mgr-cephadm (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:29.686 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../031-python3-simplegeneric_0.8.1-3_all.deb ... 2021-11-12T05:38:29.702 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../040-python3-pastedeploy_2.1.0-1_all.deb ... 2021-11-12T05:38:29.729 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-11-12T05:38:29.745 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-11-12T05:38:29.807 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-jinja2. 2021-11-12T05:38:29.817 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../051-python3-jinja2_2.10.1-2_all.deb ... 2021-11-12T05:38:29.856 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-11-12T05:38:30.029 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-repoze.lru. 2021-11-12T05:38:30.037 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../053-python3-repoze.lru_0.7-2_all.deb ... 2021-11-12T05:38:30.080 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-11-12T05:38:30.106 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-webtest. 2021-11-12T05:38:30.115 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-singledispatch. 2021-11-12T05:38:30.116 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../041-python3-webtest_2.0.32-2_all.deb ... 2021-11-12T05:38:30.147 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../032-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-11-12T05:38:30.155 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-11-12T05:38:30.159 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-11-12T05:38:30.182 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-11-12T05:38:30.191 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../052-ceph-mgr-cephadm_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:30.242 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking ceph-mgr-cephadm (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:30.357 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package libjs-underscore. 2021-11-12T05:38:30.368 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../054-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-11-12T05:38:30.407 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-11-12T05:38:30.476 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-pecan. 2021-11-12T05:38:30.501 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-webob. 2021-11-12T05:38:30.507 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../042-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-11-12T05:38:30.510 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../033-python3-webob_1%3a1.8.5-2_all.deb ... 2021-11-12T05:38:30.553 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-repoze.lru. 2021-11-12T05:38:30.562 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../053-python3-repoze.lru_0.7-2_all.deb ... 2021-11-12T05:38:30.583 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-11-12T05:38:30.592 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-11-12T05:38:30.602 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-11-12T05:38:30.718 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-11-12T05:38:30.750 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../055-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-11-12T05:38:30.793 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-11-12T05:38:30.888 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-werkzeug. 2021-11-12T05:38:30.889 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package libjs-underscore. 2021-11-12T05:38:30.898 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../043-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-11-12T05:38:30.922 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../054-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-11-12T05:38:30.928 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-11-12T05:38:30.964 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-11-12T05:38:30.970 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-soupsieve. 2021-11-12T05:38:31.002 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../034-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-11-12T05:38:31.067 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-11-12T05:38:31.112 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-routes. 2021-11-12T05:38:31.122 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../056-python3-routes_2.4.1-2_all.deb ... 2021-11-12T05:38:31.161 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-11-12T05:38:31.258 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-11-12T05:38:31.291 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../055-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-11-12T05:38:31.315 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package ceph-mgr. 2021-11-12T05:38:31.341 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-11-12T05:38:31.347 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../044-ceph-mgr_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:31.390 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking ceph-mgr (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:31.424 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-bs4. 2021-11-12T05:38:31.434 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../035-python3-bs4_4.8.2-1_all.deb ... 2021-11-12T05:38:31.481 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-11-12T05:38:31.523 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-11-12T05:38:31.555 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../057-ceph-mgr-dashboard_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:31.569 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph. 2021-11-12T05:38:31.580 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../047-ceph_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:31.597 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking ceph-mgr-dashboard (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:31.627 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:31.669 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-routes. 2021-11-12T05:38:31.679 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../056-python3-routes_2.4.1-2_all.deb ... 2021-11-12T05:38:31.726 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-11-12T05:38:31.852 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package ceph-mon. 2021-11-12T05:38:31.946 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-waitress. 2021-11-12T05:38:31.947 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../036-python3-waitress_1.4.1-1_all.deb ... 2021-11-12T05:38:31.947 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../045-ceph-mon_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:31.947 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking ceph-mon (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:31.954 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-fuse. 2021-11-12T05:38:31.960 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-11-12T05:38:31.987 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../048-ceph-fuse_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:32.029 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-fuse (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:32.080 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-11-12T05:38:32.112 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../057-ceph-mgr-dashboard_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:32.154 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking ceph-mgr-dashboard (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:32.304 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-tempita. 2021-11-12T05:38:32.335 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../037-python3-tempita_0.5.2-6_all.deb ... 2021-11-12T05:38:32.346 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-11-12T05:38:32.380 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../058-ceph-mgr-diskprediction-cloud_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:32.388 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-11-12T05:38:32.390 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-mds. 2021-11-12T05:38:32.401 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../049-ceph-mds_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:32.421 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:32.440 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-mds (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:32.717 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-paste. 2021-11-12T05:38:32.727 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../038-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-11-12T05:38:32.757 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-decorator. 2021-11-12T05:38:32.766 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-11-12T05:38:32.767 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../059-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-11-12T05:38:32.788 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package ceph-osd. 2021-11-12T05:38:32.798 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../046-ceph-osd_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:32.806 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-11-12T05:38:32.845 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-11-12T05:38:32.845 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking ceph-osd (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:32.856 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../058-ceph-mgr-diskprediction-cloud_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:32.927 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package cephadm. 2021-11-12T05:38:32.936 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:32.937 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../050-cephadm_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:32.976 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking cephadm (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:33.118 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-11-12T05:38:33.150 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../060-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-11-12T05:38:33.153 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-11-12T05:38:33.185 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../039-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-11-12T05:38:33.192 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-11-12T05:38:33.227 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-11-12T05:38:33.247 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-decorator. 2021-11-12T05:38:33.279 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../059-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-11-12T05:38:33.287 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-jinja2. 2021-11-12T05:38:33.313 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-11-12T05:38:33.319 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../051-python3-jinja2_2.10.1-2_all.deb ... 2021-11-12T05:38:33.362 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-11-12T05:38:33.581 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-pastedeploy. 2021-11-12T05:38:33.591 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../040-python3-pastedeploy_2.1.0-1_all.deb ... 2021-11-12T05:38:33.607 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-scipy. 2021-11-12T05:38:33.618 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../061-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-11-12T05:38:33.659 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-11-12T05:38:33.664 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-11-12T05:38:33.669 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../060-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-11-12T05:38:33.672 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-11-12T05:38:33.708 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-11-12T05:38:33.723 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-11-12T05:38:33.733 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../052-ceph-mgr-cephadm_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:33.780 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-mgr-cephadm (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:34.025 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-webtest. 2021-11-12T05:38:34.052 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-scipy. 2021-11-12T05:38:34.056 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../041-python3-webtest_2.0.32-2_all.deb ... 2021-11-12T05:38:34.085 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../061-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-11-12T05:38:34.101 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-repoze.lru. 2021-11-12T05:38:34.120 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-11-12T05:38:34.127 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-11-12T05:38:34.133 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../053-python3-repoze.lru_0.7-2_all.deb ... 2021-11-12T05:38:34.176 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-11-12T05:38:34.469 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-pecan. 2021-11-12T05:38:34.478 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package libjs-underscore. 2021-11-12T05:38:34.479 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../042-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-11-12T05:38:34.487 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../054-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-11-12T05:38:34.527 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-11-12T05:38:34.527 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-11-12T05:38:34.697 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-11-12T05:38:34.730 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../062-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-11-12T05:38:34.793 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package ceph. 2021-11-12T05:38:34.797 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-11-12T05:38:34.803 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../047-ceph_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:34.814 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-11-12T05:38:34.843 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking ceph (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:34.846 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../055-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-11-12T05:38:34.888 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-11-12T05:38:34.965 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-werkzeug. 2021-11-12T05:38:34.975 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../043-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-11-12T05:38:35.023 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-11-12T05:38:35.061 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-11-12T05:38:35.072 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../062-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-11-12T05:38:35.135 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-11-12T05:38:35.195 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package ceph-fuse. 2021-11-12T05:38:35.227 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../048-ceph-fuse_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:35.249 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-routes. 2021-11-12T05:38:35.260 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../056-python3-routes_2.4.1-2_all.deb ... 2021-11-12T05:38:35.270 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking ceph-fuse (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:35.283 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-joblib. 2021-11-12T05:38:35.293 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../063-python3-joblib_0.14.0-3_all.deb ... 2021-11-12T05:38:35.298 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-11-12T05:38:35.341 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-11-12T05:38:35.460 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package ceph-mgr. 2021-11-12T05:38:35.470 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../044-ceph-mgr_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:35.509 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking ceph-mgr (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:35.589 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-joblib. 2021-11-12T05:38:35.611 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-11-12T05:38:35.622 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../063-python3-joblib_0.14.0-3_all.deb ... 2021-11-12T05:38:35.643 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../057-ceph-mgr-dashboard_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:35.680 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-11-12T05:38:35.685 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-mgr-dashboard (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:35.711 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-sklearn. 2021-11-12T05:38:35.721 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../064-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-11-12T05:38:35.731 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package ceph-mds. 2021-11-12T05:38:35.740 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../049-ceph-mds_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:35.760 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-11-12T05:38:35.780 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking ceph-mds (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:35.996 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package ceph-mon. 2021-11-12T05:38:36.004 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../045-ceph-mon_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:36.016 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-sklearn. 2021-11-12T05:38:36.025 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../064-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-11-12T05:38:36.045 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking ceph-mon (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:36.083 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-11-12T05:38:36.258 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package cephadm. 2021-11-12T05:38:36.268 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../050-cephadm_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:36.307 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking cephadm (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:36.311 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-11-12T05:38:36.343 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../065-ceph-mgr-diskprediction-local_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:36.385 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:36.508 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-11-12T05:38:36.541 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../058-ceph-mgr-diskprediction-cloud_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:36.582 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:36.616 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-11-12T05:38:36.628 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-jinja2. 2021-11-12T05:38:36.649 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../065-ceph-mgr-diskprediction-local_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:36.659 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../051-python3-jinja2_2.10.1-2_all.deb ... 2021-11-12T05:38:36.691 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:36.744 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-11-12T05:38:36.903 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-decorator. 2021-11-12T05:38:36.913 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../059-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-11-12T05:38:36.952 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-11-12T05:38:37.033 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package ceph-osd. 2021-11-12T05:38:37.043 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../046-ceph-osd_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:37.063 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-11-12T05:38:37.074 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../052-ceph-mgr-cephadm_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:37.090 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking ceph-osd (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:37.113 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking ceph-mgr-cephadm (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:37.263 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-11-12T05:38:37.295 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../060-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-11-12T05:38:37.337 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-11-12T05:38:37.347 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-cachetools. 2021-11-12T05:38:37.357 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../066-python3-cachetools_4.0.0-1_all.deb ... 2021-11-12T05:38:37.405 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-11-12T05:38:37.491 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-repoze.lru. 2021-11-12T05:38:37.523 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../053-python3-repoze.lru_0.7-2_all.deb ... 2021-11-12T05:38:37.565 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-11-12T05:38:37.578 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-cachetools. 2021-11-12T05:38:37.611 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../066-python3-cachetools_4.0.0-1_all.deb ... 2021-11-12T05:38:37.644 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-11-12T05:38:37.690 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-scipy. 2021-11-12T05:38:37.701 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../061-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-11-12T05:38:37.742 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-pyasn1. 2021-11-12T05:38:37.747 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-11-12T05:38:37.752 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-11-12T05:38:37.790 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-11-12T05:38:37.859 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package libjs-underscore. 2021-11-12T05:38:37.891 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../054-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-11-12T05:38:37.934 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-11-12T05:38:37.964 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-pyasn1. 2021-11-12T05:38:37.997 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-11-12T05:38:38.038 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-11-12T05:38:38.102 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-11-12T05:38:38.135 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-11-12T05:38:38.177 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-11-12T05:38:38.279 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-11-12T05:38:38.289 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../055-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-11-12T05:38:38.328 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-11-12T05:38:38.366 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-11-12T05:38:38.377 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-11-12T05:38:38.440 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-11-12T05:38:38.538 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-rsa. 2021-11-12T05:38:38.547 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../069-python3-rsa_4.0-3_all.deb ... 2021-11-12T05:38:38.587 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-rsa (4.0-3) ... 2021-11-12T05:38:38.672 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-routes. 2021-11-12T05:38:38.673 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-11-12T05:38:38.684 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../062-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-11-12T05:38:38.704 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../056-python3-routes_2.4.1-2_all.deb ... 2021-11-12T05:38:38.722 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-11-12T05:38:38.752 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-rsa. 2021-11-12T05:38:38.784 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../069-python3-rsa_4.0-3_all.deb ... 2021-11-12T05:38:38.789 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-11-12T05:38:38.827 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-rsa (4.0-3) ... 2021-11-12T05:38:38.900 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-google-auth. 2021-11-12T05:38:38.932 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../070-python3-google-auth_1.5.1-2_all.deb ... 2021-11-12T05:38:38.974 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-11-12T05:38:39.071 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package ceph. 2021-11-12T05:38:39.081 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../047-ceph_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:39.120 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking ceph (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:39.141 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-11-12T05:38:39.152 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../057-ceph-mgr-dashboard_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:39.155 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-google-auth. 2021-11-12T05:38:39.166 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../070-python3-google-auth_1.5.1-2_all.deb ... 2021-11-12T05:38:39.193 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-joblib. 2021-11-12T05:38:39.197 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-11-12T05:38:39.199 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking ceph-mgr-dashboard (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:39.225 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../063-python3-joblib_0.14.0-3_all.deb ... 2021-11-12T05:38:39.268 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-11-12T05:38:39.336 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-blinker. 2021-11-12T05:38:39.345 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../071-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-11-12T05:38:39.385 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-11-12T05:38:39.466 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-blinker. 2021-11-12T05:38:39.490 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package ceph-fuse. 2021-11-12T05:38:39.499 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../071-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-11-12T05:38:39.522 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../048-ceph-fuse_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:39.541 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-11-12T05:38:39.565 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking ceph-fuse (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:39.638 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-sklearn. 2021-11-12T05:38:39.648 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../064-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-11-12T05:38:39.687 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-11-12T05:38:39.794 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-oauthlib. 2021-11-12T05:38:39.827 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../072-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-11-12T05:38:39.868 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-11-12T05:38:39.932 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-11-12T05:38:39.964 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../058-ceph-mgr-diskprediction-cloud_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:40.005 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:40.009 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package ceph-mds. 2021-11-12T05:38:40.016 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../049-ceph-mds_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:40.050 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking ceph-mds (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:40.180 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-oauthlib. 2021-11-12T05:38:40.213 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../072-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-11-12T05:38:40.233 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-11-12T05:38:40.241 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../073-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-11-12T05:38:40.245 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-11-12T05:38:40.254 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-11-12T05:38:40.278 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../065-ceph-mgr-diskprediction-local_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:40.288 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-11-12T05:38:40.319 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:40.341 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-decorator. 2021-11-12T05:38:40.374 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../059-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-11-12T05:38:40.408 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-11-12T05:38:40.554 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package cephadm. 2021-11-12T05:38:40.563 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../050-cephadm_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:40.575 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-11-12T05:38:40.585 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../073-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-11-12T05:38:40.603 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking cephadm (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:40.633 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-websocket. 2021-11-12T05:38:40.666 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-11-12T05:38:40.667 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../074-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-11-12T05:38:40.668 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-11-12T05:38:40.678 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../060-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-11-12T05:38:40.708 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-11-12T05:38:40.718 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-11-12T05:38:40.946 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-jinja2. 2021-11-12T05:38:40.978 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../051-python3-jinja2_2.10.1-2_all.deb ... 2021-11-12T05:38:40.985 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-websocket. 2021-11-12T05:38:41.019 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-kubernetes. 2021-11-12T05:38:41.019 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../074-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-11-12T05:38:41.023 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-11-12T05:38:41.029 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../075-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-11-12T05:38:41.062 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-scipy. 2021-11-12T05:38:41.068 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-11-12T05:38:41.068 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-11-12T05:38:41.095 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../061-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-11-12T05:38:41.137 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-11-12T05:38:41.315 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-cachetools. 2021-11-12T05:38:41.348 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../066-python3-cachetools_4.0.0-1_all.deb ... 2021-11-12T05:38:41.351 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-11-12T05:38:41.360 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../052-ceph-mgr-cephadm_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:41.389 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-11-12T05:38:41.391 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking ceph-mgr-cephadm (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:41.413 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-kubernetes. 2021-11-12T05:38:41.424 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../075-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-11-12T05:38:41.462 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-11-12T05:38:41.532 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-11-12T05:38:41.565 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:41.607 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking ceph-mgr-k8sevents (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:41.704 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-repoze.lru. 2021-11-12T05:38:41.708 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-pyasn1. 2021-11-12T05:38:41.717 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-11-12T05:38:41.735 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../053-python3-repoze.lru_0.7-2_all.deb ... 2021-11-12T05:38:41.758 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-11-12T05:38:41.778 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-11-12T05:38:41.909 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-11-12T05:38:41.943 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:41.968 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package libonig5:amd64. 2021-11-12T05:38:41.977 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../077-libonig5_6.9.4-1_amd64.deb ... 2021-11-12T05:38:41.984 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking ceph-mgr-k8sevents (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:42.026 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-11-12T05:38:42.031 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package libjs-underscore. 2021-11-12T05:38:42.063 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../054-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-11-12T05:38:42.098 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-11-12T05:38:42.104 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-11-12T05:38:42.136 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-11-12T05:38:42.137 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-11-12T05:38:42.147 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../062-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-11-12T05:38:42.177 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-11-12T05:38:42.195 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-11-12T05:38:42.345 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package libonig5:amd64. 2021-11-12T05:38:42.356 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../077-libonig5_6.9.4-1_amd64.deb ... 2021-11-12T05:38:42.387 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package libjq1:amd64. 2021-11-12T05:38:42.394 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-11-12T05:38:42.408 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-11-12T05:38:42.420 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../078-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-11-12T05:38:42.439 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../055-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-11-12T05:38:42.461 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-11-12T05:38:42.481 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-rsa. 2021-11-12T05:38:42.491 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../069-python3-rsa_4.0-3_all.deb ... 2021-11-12T05:38:42.491 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-11-12T05:38:42.538 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-rsa (4.0-3) ... 2021-11-12T05:38:42.724 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-joblib. 2021-11-12T05:38:42.731 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package jq. 2021-11-12T05:38:42.734 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../063-python3-joblib_0.14.0-3_all.deb ... 2021-11-12T05:38:42.764 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../079-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-11-12T05:38:42.772 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package libjq1:amd64. 2021-11-12T05:38:42.773 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-11-12T05:38:42.806 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../078-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-11-12T05:38:42.814 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-11-12T05:38:42.827 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-routes. 2021-11-12T05:38:42.836 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../056-python3-routes_2.4.1-2_all.deb ... 2021-11-12T05:38:42.847 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-11-12T05:38:42.866 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-google-auth. 2021-11-12T05:38:42.876 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-11-12T05:38:42.900 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../070-python3-google-auth_1.5.1-2_all.deb ... 2021-11-12T05:38:42.941 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-11-12T05:38:43.075 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package socat. 2021-11-12T05:38:43.108 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../080-socat_1.7.3.3-2_amd64.deb ... 2021-11-12T05:38:43.125 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package jq. 2021-11-12T05:38:43.149 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking socat (1.7.3.3-2) ... 2021-11-12T05:38:43.151 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-sklearn. 2021-11-12T05:38:43.158 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../079-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-11-12T05:38:43.185 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../064-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-11-12T05:38:43.200 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-11-12T05:38:43.226 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-11-12T05:38:43.269 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-blinker. 2021-11-12T05:38:43.272 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-11-12T05:38:43.278 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../071-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-11-12T05:38:43.303 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../057-ceph-mgr-dashboard_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:43.318 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-11-12T05:38:43.346 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking ceph-mgr-dashboard (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:43.494 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package socat. 2021-11-12T05:38:43.505 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../080-socat_1.7.3.3-2_amd64.deb ... 2021-11-12T05:38:43.543 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking socat (1.7.3.3-2) ... 2021-11-12T05:38:43.630 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-11-12T05:38:43.640 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../081-libxslt1.1_1.1.34-4_amd64.deb ... 2021-11-12T05:38:43.646 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-oauthlib. 2021-11-12T05:38:43.679 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../072-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-11-12T05:38:43.680 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-11-12T05:38:43.722 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-11-12T05:38:43.834 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-11-12T05:38:43.844 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../065-ceph-mgr-diskprediction-local_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:43.883 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:43.959 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package xmlstarlet. 2021-11-12T05:38:43.991 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-11-12T05:38:43.992 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../082-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-11-12T05:38:44.024 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../081-libxslt1.1_1.1.34-4_amd64.deb ... 2021-11-12T05:38:44.033 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-11-12T05:38:44.033 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-11-12T05:38:44.042 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../073-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-11-12T05:38:44.066 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-11-12T05:38:44.082 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-11-12T05:38:44.136 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-11-12T05:38:44.146 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../058-ceph-mgr-diskprediction-cloud_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:44.186 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:44.355 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package ceph-test. 2021-11-12T05:38:44.378 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package xmlstarlet. 2021-11-12T05:38:44.387 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../082-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-11-12T05:38:44.388 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../083-ceph-test_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:44.410 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-websocket. 2021-11-12T05:38:44.427 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-11-12T05:38:44.443 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../074-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-11-12T05:38:44.446 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking ceph-test (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:44.485 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-11-12T05:38:44.564 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-decorator. 2021-11-12T05:38:44.595 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../059-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-11-12T05:38:44.638 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-11-12T05:38:44.749 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package ceph-test. 2021-11-12T05:38:44.782 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../083-ceph-test_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:44.804 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-kubernetes. 2021-11-12T05:38:44.813 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../075-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-11-12T05:38:44.823 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking ceph-test (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:44.853 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-11-12T05:38:45.024 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-11-12T05:38:45.034 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../060-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-11-12T05:38:45.073 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-11-12T05:38:45.236 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-cachetools. 2021-11-12T05:38:45.247 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../066-python3-cachetools_4.0.0-1_all.deb ... 2021-11-12T05:38:45.294 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-11-12T05:38:45.351 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-11-12T05:38:45.384 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:45.411 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-scipy. 2021-11-12T05:38:45.433 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-mgr-k8sevents (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:45.442 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../061-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-11-12T05:38:45.506 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-11-12T05:38:45.589 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-pyasn1. 2021-11-12T05:38:45.621 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-11-12T05:38:45.688 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-11-12T05:38:45.836 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package libonig5:amd64. 2021-11-12T05:38:45.846 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../077-libonig5_6.9.4-1_amd64.deb ... 2021-11-12T05:38:46.017 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-11-12T05:38:46.027 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-11-12T05:38:46.074 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-11-12T05:38:46.186 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-11-12T05:38:46.468 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-11-12T05:38:46.480 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../062-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-11-12T05:38:46.481 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-rsa. 2021-11-12T05:38:46.511 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../069-python3-rsa_4.0-3_all.deb ... 2021-11-12T05:38:46.521 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package libjq1:amd64. 2021-11-12T05:38:46.532 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../078-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-11-12T05:38:46.551 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-11-12T05:38:46.560 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-rsa (4.0-3) ... 2021-11-12T05:38:46.571 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-11-12T05:38:46.841 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package jq. 2021-11-12T05:38:46.874 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../079-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-11-12T05:38:46.916 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-11-12T05:38:46.921 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-google-auth. 2021-11-12T05:38:46.931 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../070-python3-google-auth_1.5.1-2_all.deb ... 2021-11-12T05:38:46.971 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-11-12T05:38:47.096 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-joblib. 2021-11-12T05:38:47.106 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../063-python3-joblib_0.14.0-3_all.deb ... 2021-11-12T05:38:47.146 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-11-12T05:38:47.235 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package socat. 2021-11-12T05:38:47.267 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../080-socat_1.7.3.3-2_amd64.deb ... 2021-11-12T05:38:47.293 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-colorama. 2021-11-12T05:38:47.309 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking socat (1.7.3.3-2) ... 2021-11-12T05:38:47.315 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-blinker. 2021-11-12T05:38:47.326 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../084-python3-colorama_0.4.3-1build1_all.deb ... 2021-11-12T05:38:47.348 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../071-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-11-12T05:38:47.367 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2021-11-12T05:38:47.390 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-11-12T05:38:47.496 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-colorama. 2021-11-12T05:38:47.505 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../084-python3-colorama_0.4.3-1build1_all.deb ... 2021-11-12T05:38:47.545 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2021-11-12T05:38:47.557 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-sklearn. 2021-11-12T05:38:47.590 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../064-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-11-12T05:38:47.637 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package cephfs-shell. 2021-11-12T05:38:47.654 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-11-12T05:38:47.670 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../085-cephfs-shell_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:47.736 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking cephfs-shell (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:47.752 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-oauthlib. 2021-11-12T05:38:47.762 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../072-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-11-12T05:38:47.773 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-11-12T05:38:47.782 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../081-libxslt1.1_1.1.34-4_amd64.deb ... 2021-11-12T05:38:47.801 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-11-12T05:38:47.815 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package cephfs-shell. 2021-11-12T05:38:47.840 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-11-12T05:38:47.845 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../085-cephfs-shell_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:47.889 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking cephfs-shell (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:48.022 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package libcephfs-dev. 2021-11-12T05:38:48.033 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../086-libcephfs-dev_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:48.071 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking libcephfs-dev (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:48.110 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package xmlstarlet. 2021-11-12T05:38:48.112 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-11-12T05:38:48.142 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package libcephfs-dev. 2021-11-12T05:38:48.142 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../082-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-11-12T05:38:48.145 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../073-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-11-12T05:38:48.175 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../086-libcephfs-dev_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:48.184 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-11-12T05:38:48.187 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-11-12T05:38:48.216 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking libcephfs-dev (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:48.232 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-11-12T05:38:48.242 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../065-ceph-mgr-diskprediction-local_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:48.315 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:48.476 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package nvme-cli. 2021-11-12T05:38:48.486 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../087-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-11-12T05:38:48.506 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package ceph-test. 2021-11-12T05:38:48.516 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../083-ceph-test_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:48.531 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-11-12T05:38:48.540 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-websocket. 2021-11-12T05:38:48.548 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../074-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-11-12T05:38:48.555 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking ceph-test (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:48.589 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-11-12T05:38:48.620 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package nvme-cli. 2021-11-12T05:38:48.631 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../087-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-11-12T05:38:48.676 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-11-12T05:38:48.897 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-atomicwrites. 2021-11-12T05:38:48.931 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../088-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-11-12T05:38:48.942 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-kubernetes. 2021-11-12T05:38:48.972 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-11-12T05:38:48.975 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../075-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-11-12T05:38:49.000 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-atomicwrites. 2021-11-12T05:38:49.017 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-11-12T05:38:49.032 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../088-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-11-12T05:38:49.074 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-11-12T05:38:49.291 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-attr. 2021-11-12T05:38:49.301 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../089-python3-attr_19.3.0-2_all.deb ... 2021-11-12T05:38:49.326 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-cachetools. 2021-11-12T05:38:49.359 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../066-python3-cachetools_4.0.0-1_all.deb ... 2021-11-12T05:38:49.390 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-11-12T05:38:49.400 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-11-12T05:38:49.420 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-attr. 2021-11-12T05:38:49.430 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../089-python3-attr_19.3.0-2_all.deb ... 2021-11-12T05:38:49.477 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-11-12T05:38:49.522 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-11-12T05:38:49.555 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:49.604 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking ceph-mgr-k8sevents (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:49.720 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-webencodings. 2021-11-12T05:38:49.752 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../090-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-11-12T05:38:49.754 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-pyasn1. 2021-11-12T05:38:49.764 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-11-12T05:38:49.772 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-webencodings. 2021-11-12T05:38:49.794 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-11-12T05:38:49.805 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../090-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-11-12T05:38:49.811 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-11-12T05:38:49.880 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-11-12T05:38:49.991 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package libonig5:amd64. 2021-11-12T05:38:50.001 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../077-libonig5_6.9.4-1_amd64.deb ... 2021-11-12T05:38:50.039 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-11-12T05:38:50.130 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-html5lib. 2021-11-12T05:38:50.140 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../091-python3-html5lib_1.0.1-2_all.deb ... 2021-11-12T05:38:50.173 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-11-12T05:38:50.174 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-html5lib. 2021-11-12T05:38:50.179 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-11-12T05:38:50.185 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../091-python3-html5lib_1.0.1-2_all.deb ... 2021-11-12T05:38:50.206 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-11-12T05:38:50.223 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-11-12T05:38:50.248 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-11-12T05:38:50.409 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package libjq1:amd64. 2021-11-12T05:38:50.442 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../078-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-11-12T05:38:50.484 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-11-12T05:38:50.525 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-11-12T05:38:50.558 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../092-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-11-12T05:38:50.569 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-11-12T05:38:50.592 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-rsa. 2021-11-12T05:38:50.599 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-11-12T05:38:50.603 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../092-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-11-12T05:38:50.603 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../069-python3-rsa_4.0-3_all.deb ... 2021-11-12T05:38:50.644 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-11-12T05:38:50.675 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-rsa (4.0-3) ... 2021-11-12T05:38:50.762 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package jq. 2021-11-12T05:38:50.795 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../079-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-11-12T05:38:50.870 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-11-12T05:38:51.020 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-google-auth. 2021-11-12T05:38:51.053 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../070-python3-google-auth_1.5.1-2_all.deb ... 2021-11-12T05:38:51.064 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-packaging. 2021-11-12T05:38:51.070 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-packaging. 2021-11-12T05:38:51.074 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../093-python3-packaging_20.3-1_all.deb ... 2021-11-12T05:38:51.081 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../093-python3-packaging_20.3-1_all.deb ... 2021-11-12T05:38:51.095 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-11-12T05:38:51.113 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-packaging (20.3-1) ... 2021-11-12T05:38:51.119 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-packaging (20.3-1) ... 2021-11-12T05:38:51.122 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package socat. 2021-11-12T05:38:51.132 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../080-socat_1.7.3.3-2_amd64.deb ... 2021-11-12T05:38:51.180 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking socat (1.7.3.3-2) ... 2021-11-12T05:38:51.285 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-colorama. 2021-11-12T05:38:51.295 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../084-python3-colorama_0.4.3-1build1_all.deb ... 2021-11-12T05:38:51.335 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2021-11-12T05:38:51.458 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-pastescript. 2021-11-12T05:38:51.473 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-blinker. 2021-11-12T05:38:51.483 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../071-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-11-12T05:38:51.491 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../094-python3-pastescript_2.0.2-4_all.deb ... 2021-11-12T05:38:51.522 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-11-12T05:38:51.532 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-11-12T05:38:51.596 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package cephfs-shell. 2021-11-12T05:38:51.629 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../085-cephfs-shell_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:51.671 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking cephfs-shell (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:51.694 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-11-12T05:38:51.727 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../081-libxslt1.1_1.1.34-4_amd64.deb ... 2021-11-12T05:38:51.733 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-pastescript. 2021-11-12T05:38:51.744 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../094-python3-pastescript_2.0.2-4_all.deb ... 2021-11-12T05:38:51.768 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-11-12T05:38:51.836 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-pluggy. 2021-11-12T05:38:51.870 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../095-python3-pluggy_0.13.0-2_all.deb ... 2021-11-12T05:38:51.897 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-11-12T05:38:51.900 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-oauthlib. 2021-11-12T05:38:51.910 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-11-12T05:38:51.933 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../072-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-11-12T05:38:51.948 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package libcephfs-dev. 2021-11-12T05:38:51.975 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-11-12T05:38:51.981 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../086-libcephfs-dev_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:52.048 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking libcephfs-dev (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:52.089 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package xmlstarlet. 2021-11-12T05:38:52.099 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../082-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-11-12T05:38:52.138 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-11-12T05:38:52.226 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-pluggy. 2021-11-12T05:38:52.251 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-psutil. 2021-11-12T05:38:52.257 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../096-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-11-12T05:38:52.259 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../095-python3-pluggy_0.13.0-2_all.deb ... 2021-11-12T05:38:52.300 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-11-12T05:38:52.305 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-11-12T05:38:52.329 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-11-12T05:38:52.340 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../073-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-11-12T05:38:52.351 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package nvme-cli. 2021-11-12T05:38:52.384 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../087-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-11-12T05:38:52.411 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-11-12T05:38:52.440 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-11-12T05:38:52.530 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package ceph-test. 2021-11-12T05:38:52.559 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../083-ceph-test_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:52.601 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking ceph-test (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:52.620 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-psutil. 2021-11-12T05:38:52.631 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../096-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-11-12T05:38:52.675 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-py. 2021-11-12T05:38:52.703 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-11-12T05:38:52.708 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../097-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2021-11-12T05:38:52.750 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2021-11-12T05:38:52.773 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-atomicwrites. 2021-11-12T05:38:52.794 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-websocket. 2021-11-12T05:38:52.803 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../074-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-11-12T05:38:52.806 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../088-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-11-12T05:38:52.872 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-11-12T05:38:53.031 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-py. 2021-11-12T05:38:53.065 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../097-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2021-11-12T05:38:53.070 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-pyinotify. 2021-11-12T05:38:53.080 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../098-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-11-12T05:38:53.106 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2021-11-12T05:38:53.127 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-11-12T05:38:53.172 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-11-12T05:38:53.183 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-attr. 2021-11-12T05:38:53.216 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../089-python3-attr_19.3.0-2_all.deb ... 2021-11-12T05:38:53.258 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-11-12T05:38:53.459 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-pyinotify. 2021-11-12T05:38:53.465 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-pytest. 2021-11-12T05:38:53.470 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../098-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-11-12T05:38:53.498 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../099-python3-pytest_4.6.9-1_all.deb ... 2021-11-12T05:38:53.516 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-11-12T05:38:53.519 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-webencodings. 2021-11-12T05:38:53.533 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-kubernetes. 2021-11-12T05:38:53.539 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-11-12T05:38:53.543 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../075-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-11-12T05:38:53.552 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../090-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-11-12T05:38:53.586 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-11-12T05:38:53.616 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-11-12T05:38:53.870 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-pytest. 2021-11-12T05:38:53.872 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-html5lib. 2021-11-12T05:38:53.876 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package python3-simplejson. 2021-11-12T05:38:53.887 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../100-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-11-12T05:38:53.903 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../099-python3-pytest_4.6.9-1_all.deb ... 2021-11-12T05:38:53.904 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../091-python3-html5lib_1.0.1-2_all.deb ... 2021-11-12T05:38:53.933 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-11-12T05:38:53.938 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-11-12T05:38:53.944 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-11-12T05:38:54.121 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-11-12T05:38:54.155 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:54.196 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking ceph-mgr-k8sevents (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:54.199 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-11-12T05:38:54.232 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../092-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-11-12T05:38:54.274 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-11-12T05:38:54.315 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package python3-simplejson. 2021-11-12T05:38:54.326 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../100-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-11-12T05:38:54.364 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-11-12T05:38:54.404 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package radosgw. 2021-11-12T05:38:54.414 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../101-radosgw_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:54.453 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking radosgw (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:54.557 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package libonig5:amd64. 2021-11-12T05:38:54.568 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../077-libonig5_6.9.4-1_amd64.deb ... 2021-11-12T05:38:54.649 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-11-12T05:38:54.736 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-packaging. 2021-11-12T05:38:54.744 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../093-python3-packaging_20.3-1_all.deb ... 2021-11-12T05:38:54.785 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package radosgw. 2021-11-12T05:38:54.785 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-packaging (20.3-1) ... 2021-11-12T05:38:54.794 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../101-radosgw_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:54.859 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking radosgw (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:55.026 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package libjq1:amd64. 2021-11-12T05:38:55.059 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../078-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-11-12T05:38:55.097 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-pastescript. 2021-11-12T05:38:55.125 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-11-12T05:38:55.129 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../094-python3-pastescript_2.0.2-4_all.deb ... 2021-11-12T05:38:55.171 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-11-12T05:38:55.289 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-colorama. 2021-11-12T05:38:55.291 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package rbd-fuse. 2021-11-12T05:38:55.299 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../084-python3-colorama_0.4.3-1build1_all.deb ... 2021-11-12T05:38:55.325 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../102-rbd-fuse_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:55.338 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2021-11-12T05:38:55.365 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking rbd-fuse (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:55.420 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package jq. 2021-11-12T05:38:55.452 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../079-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-11-12T05:38:55.492 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-pluggy. 2021-11-12T05:38:55.494 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-11-12T05:38:55.524 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../095-python3-pluggy_0.13.0-2_all.deb ... 2021-11-12T05:38:55.566 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-11-12T05:38:55.592 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package cephfs-shell. 2021-11-12T05:38:55.622 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../085-cephfs-shell_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:38:55.659 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking cephfs-shell (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:55.708 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-attr (19.3.0-2) ... 2021-11-12T05:38:55.746 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package rbd-fuse. 2021-11-12T05:38:55.780 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../102-rbd-fuse_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:55.797 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package socat. 2021-11-12T05:38:55.807 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../080-socat_1.7.3.3-2_amd64.deb ... 2021-11-12T05:38:55.821 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking rbd-fuse (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:55.861 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-psutil. 2021-11-12T05:38:55.889 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking socat (1.7.3.3-2) ... 2021-11-12T05:38:55.893 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../096-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-11-12T05:38:55.902 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package libcephfs-dev. 2021-11-12T05:38:55.932 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../086-libcephfs-dev_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:55.936 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-11-12T05:38:55.978 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-11-12T05:38:56.001 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking libcephfs-dev (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:56.104 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-11-12T05:38:56.164 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-attr (19.3.0-2) ... 2021-11-12T05:38:56.256 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-11-12T05:38:56.281 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-py. 2021-11-12T05:38:56.313 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../097-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2021-11-12T05:38:56.355 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2021-11-12T05:38:56.388 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package nvme-cli. 2021-11-12T05:38:56.397 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../087-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-11-12T05:38:56.411 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-11-12T05:38:56.421 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../081-libxslt1.1_1.1.34-4_amd64.deb ... 2021-11-12T05:38:56.442 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-11-12T05:38:56.443 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-11-12T05:38:56.457 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up cephadm (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:56.460 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-11-12T05:38:56.577 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-11-12T05:38:56.666 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-pyinotify. 2021-11-12T05:38:56.677 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-11-12T05:38:56.700 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../098-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-11-12T05:38:56.741 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-11-12T05:38:56.751 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-atomicwrites. 2021-11-12T05:38:56.772 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package xmlstarlet. 2021-11-12T05:38:56.784 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../088-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-11-12T05:38:56.805 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../082-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-11-12T05:38:56.817 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-11-12T05:38:56.845 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up cephadm (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:56.847 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-11-12T05:38:57.086 INFO:teuthology.orchestra.run.gibba015.stdout:Adding system user cephadm....done 2021-11-12T05:38:57.094 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-pytest. 2021-11-12T05:38:57.095 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-attr. 2021-11-12T05:38:57.102 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../099-python3-pytest_4.6.9-1_all.deb ... 2021-11-12T05:38:57.127 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../089-python3-attr_19.3.0-2_all.deb ... 2021-11-12T05:38:57.144 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-11-12T05:38:57.161 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-11-12T05:38:57.211 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package ceph-test. 2021-11-12T05:38:57.220 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../083-ceph-test_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:57.256 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-11-12T05:38:57.259 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking ceph-test (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:57.451 INFO:teuthology.orchestra.run.gibba005.stdout:Adding system user cephadm....done 2021-11-12T05:38:57.456 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package python3-simplejson. 2021-11-12T05:38:57.481 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-webencodings. 2021-11-12T05:38:57.489 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../100-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-11-12T05:38:57.491 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../090-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-11-12T05:38:57.497 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-11-12T05:38:57.530 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-11-12T05:38:57.564 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-11-12T05:38:57.635 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-11-12T05:38:57.740 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-11-12T05:38:57.861 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-11-12T05:38:57.867 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2021-11-12T05:38:57.875 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-html5lib. 2021-11-12T05:38:57.908 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../091-python3-html5lib_1.0.1-2_all.deb ... 2021-11-12T05:38:57.950 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-11-12T05:38:57.951 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package radosgw. 2021-11-12T05:38:57.960 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../101-radosgw_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:57.999 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking radosgw (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:58.045 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-11-12T05:38:58.101 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-11-12T05:38:58.205 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2021-11-12T05:38:58.319 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-11-12T05:38:58.329 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../092-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-11-12T05:38:58.368 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-11-12T05:38:58.411 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-11-12T05:38:58.432 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-11-12T05:38:58.637 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-11-12T05:38:58.775 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-11-12T05:38:58.805 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-packaging. 2021-11-12T05:38:58.838 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../093-python3-packaging_20.3-1_all.deb ... 2021-11-12T05:38:58.880 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2021-11-12T05:38:58.888 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-packaging (20.3-1) ... 2021-11-12T05:38:58.979 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package rbd-fuse. 2021-11-12T05:38:59.001 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-11-12T05:38:59.011 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../102-rbd-fuse_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:38:59.053 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking rbd-fuse (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:59.156 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-11-12T05:38:59.235 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2021-11-12T05:38:59.258 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-pastescript. 2021-11-12T05:38:59.268 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../094-python3-pastescript_2.0.2-4_all.deb ... 2021-11-12T05:38:59.308 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-11-12T05:38:59.336 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-attr (19.3.0-2) ... 2021-11-12T05:38:59.358 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-11-12T05:38:59.462 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-11-12T05:38:59.599 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-11-12T05:38:59.608 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-ceph-argparse (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:59.670 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-pluggy. 2021-11-12T05:38:59.687 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-11-12T05:38:59.702 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../095-python3-pluggy_0.13.0-2_all.deb ... 2021-11-12T05:38:59.725 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-11-12T05:38:59.744 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-11-12T05:38:59.843 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-11-12T05:38:59.851 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-11-12T05:38:59.952 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2021-11-12T05:38:59.956 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-colorama. 2021-11-12T05:38:59.963 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-ceph-argparse (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:38:59.989 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../084-python3-colorama_0.4.3-1build1_all.deb ... 2021-11-12T05:39:00.018 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up cephadm (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:00.030 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2021-11-12T05:39:00.078 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-psutil. 2021-11-12T05:39:00.085 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../096-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-11-12T05:39:00.128 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-11-12T05:39:00.129 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-11-12T05:39:00.166 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-11-12T05:39:00.325 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2021-11-12T05:39:00.334 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package cephfs-shell. 2021-11-12T05:39:00.344 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../085-cephfs-shell_15.2.15-22-ga81ee281-1focal_all.deb ... 2021-11-12T05:39:00.383 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking cephfs-shell (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:00.413 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-11-12T05:39:00.442 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-py. 2021-11-12T05:39:00.475 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../097-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2021-11-12T05:39:00.516 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2021-11-12T05:39:00.517 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-11-12T05:39:00.565 INFO:teuthology.orchestra.run.gibba038.stdout:Adding system user cephadm....done 2021-11-12T05:39:00.622 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-11-12T05:39:00.696 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package libcephfs-dev. 2021-11-12T05:39:00.724 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-11-12T05:39:00.728 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../086-libcephfs-dev_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:39:00.744 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-11-12T05:39:00.778 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking libcephfs-dev (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:00.853 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-pyinotify. 2021-11-12T05:39:00.863 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../098-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-11-12T05:39:00.902 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-11-12T05:39:00.931 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-11-12T05:39:00.967 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-11-12T05:39:01.003 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-11-12T05:39:01.133 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-11-12T05:39:01.238 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-pytest. 2021-11-12T05:39:01.243 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-11-12T05:39:01.248 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package nvme-cli. 2021-11-12T05:39:01.258 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../087-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-11-12T05:39:01.271 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../099-python3-pytest_4.6.9-1_all.deb ... 2021-11-12T05:39:01.287 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-11-12T05:39:01.312 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-11-12T05:39:01.314 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-11-12T05:39:01.344 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2021-11-12T05:39:01.426 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-11-12T05:39:01.547 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-11-12T05:39:01.554 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-11-12T05:39:01.666 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package python3-simplejson. 2021-11-12T05:39:01.669 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-11-12T05:39:01.676 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../100-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-11-12T05:39:01.715 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-11-12T05:39:01.728 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-atomicwrites. 2021-11-12T05:39:01.760 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../088-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-11-12T05:39:01.802 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-11-12T05:39:01.856 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-11-12T05:39:01.873 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-11-12T05:39:01.953 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-11-12T05:39:02.107 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-11-12T05:39:02.138 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-attr. 2021-11-12T05:39:02.141 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-11-12T05:39:02.148 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../089-python3-attr_19.3.0-2_all.deb ... 2021-11-12T05:39:02.161 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package radosgw. 2021-11-12T05:39:02.172 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../101-radosgw_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:39:02.204 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-packaging (20.3-1) ... 2021-11-12T05:39:02.209 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-11-12T05:39:02.219 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking radosgw (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:02.350 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2021-11-12T05:39:02.384 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-11-12T05:39:02.464 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-11-12T05:39:02.558 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-webencodings. 2021-11-12T05:39:02.597 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-packaging (20.3-1) ... 2021-11-12T05:39:02.597 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-11-12T05:39:02.597 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../090-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-11-12T05:39:02.615 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-11-12T05:39:02.624 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-11-12T05:39:02.819 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-11-12T05:39:02.825 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-11-12T05:39:02.835 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-11-12T05:39:02.921 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-11-12T05:39:02.994 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-html5lib. 2021-11-12T05:39:03.004 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../091-python3-html5lib_1.0.1-2_all.deb ... 2021-11-12T05:39:03.043 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-11-12T05:39:03.086 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-ceph-argparse (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:03.135 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2021-11-12T05:39:03.142 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package rbd-fuse. 2021-11-12T05:39:03.175 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../102-rbd-fuse_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:39:03.180 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-11-12T05:39:03.222 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking rbd-fuse (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:03.312 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-11-12T05:39:03.377 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-11-12T05:39:03.404 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-11-12T05:39:03.413 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2021-11-12T05:39:03.438 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../092-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-11-12T05:39:03.465 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2021-11-12T05:39:03.512 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-11-12T05:39:03.565 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-attr (19.3.0-2) ... 2021-11-12T05:39:03.637 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-11-12T05:39:03.656 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-11-12T05:39:03.741 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-11-12T05:39:03.885 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-11-12T05:39:03.908 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-packaging. 2021-11-12T05:39:03.915 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-11-12T05:39:03.941 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../093-python3-packaging_20.3-1_all.deb ... 2021-11-12T05:39:03.955 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up socat (1.7.3.3-2) ... 2021-11-12T05:39:03.999 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-packaging (20.3-1) ... 2021-11-12T05:39:04.001 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-11-12T05:39:04.011 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-11-12T05:39:04.082 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-ceph-common (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:04.136 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-11-12T05:39:04.158 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-11-12T05:39:04.270 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up socat (1.7.3.3-2) ... 2021-11-12T05:39:04.299 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-11-12T05:39:04.327 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-pastescript. 2021-11-12T05:39:04.337 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../094-python3-pastescript_2.0.2-4_all.deb ... 2021-11-12T05:39:04.371 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-ceph-common (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:04.376 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-11-12T05:39:04.379 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up cephadm (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:04.468 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-11-12T05:39:04.564 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-11-12T05:39:04.576 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-11-12T05:39:04.719 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-11-12T05:39:04.735 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-11-12T05:39:04.780 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-pluggy. 2021-11-12T05:39:04.814 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../095-python3-pluggy_0.13.0-2_all.deb ... 2021-11-12T05:39:04.855 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-11-12T05:39:04.873 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-11-12T05:39:04.920 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-11-12T05:39:04.960 INFO:teuthology.orchestra.run.gibba044.stdout:Adding system user cephadm....done 2021-11-12T05:39:05.000 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-11-12T05:39:05.020 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-11-12T05:39:05.046 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-11-12T05:39:05.119 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-11-12T05:39:05.208 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-psutil. 2021-11-12T05:39:05.217 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-11-12T05:39:05.219 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../096-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-11-12T05:39:05.246 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-11-12T05:39:05.283 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-11-12T05:39:05.336 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-11-12T05:39:05.395 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-11-12T05:39:05.415 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-11-12T05:39:05.506 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-11-12T05:39:05.579 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-11-12T05:39:05.604 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-11-12T05:39:05.623 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-11-12T05:39:05.636 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-py. 2021-11-12T05:39:05.669 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../097-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2021-11-12T05:39:05.710 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2021-11-12T05:39:05.749 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-packaging (20.3-1) ... 2021-11-12T05:39:05.755 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2021-11-12T05:39:05.805 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-11-12T05:39:05.875 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-11-12T05:39:05.977 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-11-12T05:39:05.981 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-11-12T05:39:05.989 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-11-12T05:39:05.999 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-11-12T05:39:06.097 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-pyinotify. 2021-11-12T05:39:06.108 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../098-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-11-12T05:39:06.115 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-11-12T05:39:06.125 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-11-12T05:39:06.154 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-11-12T05:39:06.219 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-11-12T05:39:06.258 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-11-12T05:39:06.360 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-11-12T05:39:06.366 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-11-12T05:39:06.453 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-11-12T05:39:06.484 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-11-12T05:39:06.541 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-pytest. 2021-11-12T05:39:06.575 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../099-python3-pytest_4.6.9-1_all.deb ... 2021-11-12T05:39:06.617 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-11-12T05:39:06.624 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-11-12T05:39:06.663 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-11-12T05:39:06.669 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2021-11-12T05:39:06.732 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2021-11-12T05:39:06.876 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-11-12T05:39:06.887 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-11-12T05:39:06.978 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-11-12T05:39:07.020 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package python3-simplejson. 2021-11-12T05:39:07.027 INFO:teuthology.orchestra.run.gibba015.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-11-12T05:39:07.030 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../100-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-11-12T05:39:07.069 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-11-12T05:39:07.172 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-11-12T05:39:07.182 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-11-12T05:39:07.243 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-11-12T05:39:07.306 INFO:teuthology.orchestra.run.gibba005.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-11-12T05:39:07.308 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-11-12T05:39:07.455 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-ceph-argparse (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:07.465 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up socat (1.7.3.3-2) ... 2021-11-12T05:39:07.479 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-11-12T05:39:07.534 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-11-12T05:39:07.539 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package radosgw. 2021-11-12T05:39:07.549 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../101-radosgw_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:39:07.581 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-11-12T05:39:07.588 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking radosgw (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:07.592 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-ceph-common (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:07.664 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-11-12T05:39:07.801 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-11-12T05:39:07.802 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-11-12T05:39:07.807 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2021-11-12T05:39:07.839 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-11-12T05:39:07.929 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-11-12T05:39:07.983 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-11-12T05:39:08.055 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-11-12T05:39:08.070 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-11-12T05:39:08.166 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-11-12T05:39:08.167 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-11-12T05:39:08.170 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-11-12T05:39:08.289 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-11-12T05:39:08.292 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-11-12T05:39:08.360 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-11-12T05:39:08.396 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-11-12T05:39:08.437 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-11-12T05:39:08.498 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-11-12T05:39:08.499 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up librados2 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:08.543 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package rbd-fuse. 2021-11-12T05:39:08.576 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../102-rbd-fuse_15.2.15-22-ga81ee281-1focal_amd64.deb ... 2021-11-12T05:39:08.617 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking rbd-fuse (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:08.624 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-11-12T05:39:08.645 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-11-12T05:39:08.677 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-11-12T05:39:08.766 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-11-12T05:39:08.854 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-11-12T05:39:08.904 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up librados2 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:08.978 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-attr (19.3.0-2) ... 2021-11-12T05:39:09.008 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-11-12T05:39:09.039 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-11-12T05:39:09.164 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-11-12T05:39:09.260 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-11-12T05:39:09.289 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-11-12T05:39:09.386 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-11-12T05:39:09.397 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-11-12T05:39:09.414 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-11-12T05:39:09.498 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-11-12T05:39:09.595 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-11-12T05:39:09.632 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-11-12T05:39:09.680 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up librgw2 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:09.708 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up cephadm (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:09.806 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-11-12T05:39:09.821 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-11-12T05:39:09.867 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-packaging (20.3-1) ... 2021-11-12T05:39:09.932 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-11-12T05:39:10.055 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-11-12T05:39:10.092 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-11-12T05:39:10.119 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up librgw2 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:10.194 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-11-12T05:39:10.200 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-11-12T05:39:10.236 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-11-12T05:39:10.338 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-11-12T05:39:10.396 INFO:teuthology.orchestra.run.gibba016.stdout:Adding system user cephadm....done 2021-11-12T05:39:10.428 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-11-12T05:39:10.437 INFO:teuthology.orchestra.run.gibba038.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-11-12T05:39:10.542 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-11-12T05:39:10.580 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-11-12T05:39:10.581 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-11-12T05:39:10.591 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-11-12T05:39:10.705 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2021-11-12T05:39:10.718 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-11-12T05:39:10.832 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-11-12T05:39:10.849 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-11-12T05:39:10.964 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-11-12T05:39:10.985 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-11-12T05:39:11.050 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-11-12T05:39:11.100 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-11-12T05:39:11.110 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-11-12T05:39:11.227 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2021-11-12T05:39:11.245 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-11-12T05:39:11.266 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-11-12T05:39:11.338 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up libcephfs2 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:11.354 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-11-12T05:39:11.359 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up libcephfs2 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:11.455 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-11-12T05:39:11.463 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-11-12T05:39:11.485 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-11-12T05:39:11.486 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-11-12T05:39:11.526 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up socat (1.7.3.3-2) ... 2021-11-12T05:39:11.652 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-ceph-common (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:11.664 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-11-12T05:39:11.745 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up libradosstriper1 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:11.765 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up libradosstriper1 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:11.823 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-11-12T05:39:11.846 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-11-12T05:39:11.849 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up librados2 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:11.891 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-11-12T05:39:11.903 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-11-12T05:39:11.976 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-11-12T05:39:12.056 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-11-12T05:39:12.097 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-11-12T05:39:12.121 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-11-12T05:39:12.125 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-11-12T05:39:12.223 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-11-12T05:39:12.298 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2021-11-12T05:39:12.457 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-11-12T05:39:12.532 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-11-12T05:39:12.583 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-11-12T05:39:12.809 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-11-12T05:39:12.833 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-11-12T05:39:12.844 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up librbd1 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:12.923 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up librbd1 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:12.946 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-11-12T05:39:13.039 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up librgw2 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:13.046 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-11-12T05:39:13.049 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-11-12T05:39:13.084 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-11-12T05:39:13.127 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-ceph-argparse (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:13.140 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-11-12T05:39:13.148 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-11-12T05:39:13.200 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-11-12T05:39:13.241 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-11-12T05:39:13.294 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-11-12T05:39:13.326 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-11-12T05:39:13.374 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-11-12T05:39:13.386 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-11-12T05:39:13.445 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-11-12T05:39:13.492 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-11-12T05:39:13.500 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-rsa (4.0-3) ... 2021-11-12T05:39:13.504 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2021-11-12T05:39:13.543 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-11-12T05:39:13.621 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-11-12T05:39:13.645 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-rsa (4.0-3) ... 2021-11-12T05:39:13.751 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-11-12T05:39:13.752 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-11-12T05:39:13.779 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-11-12T05:39:13.847 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-11-12T05:39:13.854 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-11-12T05:39:13.994 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-11-12T05:39:14.011 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up ceph-mgr-modules-core (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:14.055 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up ceph-mgr-modules-core (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:14.079 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-11-12T05:39:14.124 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-11-12T05:39:14.137 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up ceph-fuse (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:14.182 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up ceph-fuse (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:14.271 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up libcephfs2 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:14.281 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-11-12T05:39:14.320 INFO:teuthology.orchestra.run.gibba005.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-11-12T05:39:14.320 INFO:teuthology.orchestra.run.gibba005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-11-12T05:39:14.340 INFO:teuthology.orchestra.run.gibba015.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-11-12T05:39:14.340 INFO:teuthology.orchestra.run.gibba015.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-11-12T05:39:14.372 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-11-12T05:39:14.551 INFO:teuthology.orchestra.run.gibba044.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-11-12T05:39:14.581 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up libradosstriper1 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:14.596 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up libcephfs-dev (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:14.599 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-11-12T05:39:14.624 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up libcephfs-dev (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:14.683 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-11-12T05:39:14.698 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-11-12T05:39:14.704 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-11-12T05:39:14.751 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-11-12T05:39:14.827 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-11-12T05:39:14.876 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-11-12T05:39:14.883 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-11-12T05:39:14.951 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-11-12T05:39:14.960 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-11-12T05:39:15.136 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-11-12T05:39:15.167 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-11-12T05:39:15.186 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-11-12T05:39:15.246 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-11-12T05:39:15.379 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-11-12T05:39:15.436 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-11-12T05:39:15.452 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-rados (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:15.480 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-rados (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:15.513 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-11-12T05:39:15.607 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-rbd (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:15.612 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-rbd (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:15.614 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-11-12T05:39:15.713 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-11-12T05:39:15.733 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up rbd-fuse (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:15.738 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up rbd-fuse (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:15.739 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up librbd1 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:15.840 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-11-12T05:39:15.847 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-routes (2.4.1-2) ... 2021-11-12T05:39:15.859 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-routes (2.4.1-2) ... 2021-11-12T05:39:15.941 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-11-12T05:39:15.989 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-packaging (20.3-1) ... 2021-11-12T05:39:16.051 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-11-12T05:39:16.108 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-11-12T05:39:16.116 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-11-12T05:39:16.177 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-11-12T05:39:16.231 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-11-12T05:39:16.277 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-11-12T05:39:16.309 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up librados2 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:16.351 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-rgw (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:16.370 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-rgw (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:16.399 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-11-12T05:39:16.403 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-rsa (4.0-3) ... 2021-11-12T05:39:16.435 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-11-12T05:39:16.471 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-cephfs (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:16.477 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-cephfs (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:16.612 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-11-12T05:39:16.650 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-11-12T05:39:16.707 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up cephfs-shell (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:16.728 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up cephfs-shell (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:16.832 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-11-12T05:39:16.854 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-11-12T05:39:16.977 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2021-11-12T05:39:17.130 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-mgr-modules-core (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:17.231 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-fuse (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:17.270 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-11-12T05:39:17.371 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-11-12T05:39:17.372 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-11-12T05:39:17.477 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up ceph-common (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:17.497 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up librgw2 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:17.507 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up ceph-common (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:17.581 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-11-12T05:39:17.640 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-11-12T05:39:17.691 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up libcephfs-dev (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:17.742 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-11-12T05:39:17.792 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-11-12T05:39:17.864 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up socat (1.7.3.3-2) ... 2021-11-12T05:39:17.965 INFO:teuthology.orchestra.run.gibba015.stdout:Adding group ceph....done 2021-11-12T05:39:17.991 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-ceph-common (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:17.993 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-11-12T05:39:18.043 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-11-12T05:39:18.070 INFO:teuthology.orchestra.run.gibba005.stdout:Adding group ceph....done 2021-11-12T05:39:18.261 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-11-12T05:39:18.267 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-11-12T05:39:18.336 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-11-12T05:39:18.391 INFO:teuthology.orchestra.run.gibba015.stdout:Adding system user ceph....done 2021-11-12T05:39:18.463 INFO:teuthology.orchestra.run.gibba005.stdout:Adding system user ceph....done 2021-11-12T05:39:18.555 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-rados (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:18.557 INFO:teuthology.orchestra.run.gibba015.stdout:Setting system user ceph properties....done 2021-11-12T05:39:18.572 INFO:teuthology.orchestra.run.gibba015.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-11-12T05:39:18.584 INFO:teuthology.orchestra.run.gibba005.stdout:Setting system user ceph properties....done 2021-11-12T05:39:18.586 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-11-12T05:39:18.601 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-11-12T05:39:18.602 INFO:teuthology.orchestra.run.gibba005.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-11-12T05:39:18.649 INFO:teuthology.orchestra.run.gibba015.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-11-12T05:39:18.672 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-rbd (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:18.680 INFO:teuthology.orchestra.run.gibba005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-11-12T05:39:18.744 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-11-12T05:39:18.815 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up rbd-fuse (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:18.819 INFO:teuthology.orchestra.run.gibba015.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-11-12T05:39:18.855 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up libcephfs2 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:18.869 INFO:teuthology.orchestra.run.gibba005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-11-12T05:39:18.932 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-routes (2.4.1-2) ... 2021-11-12T05:39:18.964 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-11-12T05:39:19.021 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-11-12T05:39:19.079 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up ceph-test (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:19.133 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up ceph-test (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:19.172 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-11-12T05:39:19.179 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up radosgw (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:19.190 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up libradosstriper1 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:19.192 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-11-12T05:39:19.259 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up radosgw (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:19.291 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-11-12T05:39:19.357 INFO:teuthology.orchestra.run.gibba015.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-11-12T05:39:19.357 INFO:teuthology.orchestra.run.gibba015.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-11-12T05:39:19.398 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-11-12T05:39:19.428 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-rgw (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:19.496 INFO:teuthology.orchestra.run.gibba005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-11-12T05:39:19.496 INFO:teuthology.orchestra.run.gibba005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-11-12T05:39:19.551 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-11-12T05:39:19.554 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-cephfs (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:19.641 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-11-12T05:39:19.731 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up ceph-base (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:19.830 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up cephfs-shell (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:19.892 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-11-12T05:39:19.903 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up ceph-base (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:19.956 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-11-12T05:39:19.956 INFO:teuthology.orchestra.run.gibba015.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-11-12T05:39:20.018 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-11-12T05:39:20.119 INFO:teuthology.orchestra.run.gibba005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-11-12T05:39:20.234 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up ceph-mds (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:20.243 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-11-12T05:39:20.372 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up librbd1 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:20.384 INFO:teuthology.orchestra.run.gibba015.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-11-12T05:39:20.384 INFO:teuthology.orchestra.run.gibba015.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-11-12T05:39:20.430 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up ceph-mds (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:20.473 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-11-12T05:39:20.520 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-11-12T05:39:20.574 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-11-12T05:39:20.581 INFO:teuthology.orchestra.run.gibba005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-11-12T05:39:20.582 INFO:teuthology.orchestra.run.gibba005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-11-12T05:39:20.625 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-common (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:20.635 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up ceph-mgr (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:20.700 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-11-12T05:39:20.771 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-11-12T05:39:20.824 INFO:teuthology.orchestra.run.gibba015.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-11-12T05:39:20.824 INFO:teuthology.orchestra.run.gibba015.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-11-12T05:39:20.840 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up ceph-mgr (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:20.902 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-11-12T05:39:20.987 INFO:teuthology.orchestra.run.gibba005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-11-12T05:39:20.987 INFO:teuthology.orchestra.run.gibba005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-11-12T05:39:21.028 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-rsa (4.0-3) ... 2021-11-12T05:39:21.072 INFO:teuthology.orchestra.run.gibba038.stdout:Adding group ceph....done 2021-11-12T05:39:21.094 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:21.212 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up ceph-osd (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:21.245 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-11-12T05:39:21.248 INFO:teuthology.orchestra.run.gibba016.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-11-12T05:39:21.274 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:21.390 INFO:teuthology.orchestra.run.gibba038.stdout:Adding system user ceph....done 2021-11-12T05:39:21.390 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-11-12T05:39:21.392 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up ceph-osd (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:21.496 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up ceph-mgr-modules-core (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:21.516 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-11-12T05:39:21.574 INFO:teuthology.orchestra.run.gibba038.stdout:Setting system user ceph properties....done 2021-11-12T05:39:21.600 INFO:teuthology.orchestra.run.gibba038.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-11-12T05:39:21.601 INFO:teuthology.orchestra.run.gibba015.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-11-12T05:39:21.601 INFO:teuthology.orchestra.run.gibba015.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-11-12T05:39:21.614 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up ceph-fuse (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:21.679 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-11-12T05:39:21.819 INFO:teuthology.orchestra.run.gibba044.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-11-12T05:39:21.819 INFO:teuthology.orchestra.run.gibba044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-11-12T05:39:21.832 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-11-12T05:39:21.837 INFO:teuthology.orchestra.run.gibba005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-11-12T05:39:21.837 INFO:teuthology.orchestra.run.gibba005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-11-12T05:39:21.864 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-11-12T05:39:21.881 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up ceph-mgr-k8sevents (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:22.007 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up ceph-mgr-diskprediction-local (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:22.107 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up libcephfs-dev (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:22.135 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-11-12T05:39:22.141 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up ceph-mon (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:22.151 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-test (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:22.153 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up ceph-mgr-k8sevents (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:22.250 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-11-12T05:39:22.252 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up radosgw (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:22.261 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-11-12T05:39:22.287 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up ceph-mgr-diskprediction-local (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:22.293 INFO:teuthology.orchestra.run.gibba015.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-11-12T05:39:22.293 INFO:teuthology.orchestra.run.gibba015.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-11-12T05:39:22.430 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-11-12T05:39:22.430 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-11-12T05:39:22.431 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-11-12T05:39:22.434 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-11-12T05:39:22.576 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up ceph-mgr-cephadm (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:22.644 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up ceph-mon (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:22.663 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-11-12T05:39:22.677 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-11-12T05:39:22.703 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up ceph (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:22.804 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up ceph-mgr-dashboard (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:22.915 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up librados2 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:22.938 INFO:teuthology.orchestra.run.gibba015.stdout:Processing triggers for systemd (245.4-4ubuntu3.13) ... 2021-11-12T05:39:22.955 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-base (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:22.971 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-rados (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:22.996 INFO:teuthology.orchestra.run.gibba005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-11-12T05:39:22.996 INFO:teuthology.orchestra.run.gibba005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-11-12T05:39:23.041 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-11-12T05:39:23.097 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-rbd (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:23.155 INFO:teuthology.orchestra.run.gibba015.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-11-12T05:39:23.179 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-11-12T05:39:23.215 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up rbd-fuse (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:23.290 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up ceph-mgr-cephadm (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:23.357 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-routes (2.4.1-2) ... 2021-11-12T05:39:23.407 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up ceph (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:23.472 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-mds (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:23.508 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up ceph-mgr-dashboard (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:23.626 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-11-12T05:39:23.643 INFO:teuthology.orchestra.run.gibba005.stdout:Processing triggers for systemd (245.4-4ubuntu3.13) ... 2021-11-12T05:39:23.676 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-11-12T05:39:23.677 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-11-12T05:39:23.853 INFO:teuthology.orchestra.run.gibba005.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-11-12T05:39:23.869 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-rgw (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:23.974 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-mgr (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:23.995 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-cephfs (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:24.139 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-11-12T05:39:24.140 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-11-12T05:39:24.171 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up librgw2 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:24.238 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up cephfs-shell (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:24.298 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-11-12T05:39:24.406 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-11-12T05:39:24.434 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:24.448 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-11-12T05:39:24.543 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-osd (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:24.666 INFO:teuthology.orchestra.run.gibba015.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-11-12T05:39:24.716 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-11-12T05:39:24.956 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-11-12T05:39:24.957 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-11-12T05:39:24.978 INFO:teuthology.orchestra.run.gibba015.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-11-12T05:39:24.980 DEBUG:teuthology.orchestra.run.gibba015:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-11-12T05:39:25.016 INFO:teuthology.orchestra.run.gibba015.stdout:Reading package lists... 2021-11-12T05:39:25.017 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-11-12T05:39:25.058 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up ceph-common (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:25.117 INFO:teuthology.orchestra.run.gibba015.stdout:Building dependency tree... 2021-11-12T05:39:25.118 INFO:teuthology.orchestra.run.gibba015.stdout:Reading state information... 2021-11-12T05:39:25.194 INFO:teuthology.orchestra.run.gibba015.stdout:libtool-bin is already the newest version (2.4.6-14). 2021-11-12T05:39:25.194 INFO:teuthology.orchestra.run.gibba015.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2021-11-12T05:39:25.194 INFO:teuthology.orchestra.run.gibba015.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.1). 2021-11-12T05:39:25.195 INFO:teuthology.orchestra.run.gibba015.stdout:The following packages were automatically installed and are no longer required: 2021-11-12T05:39:25.195 INFO:teuthology.orchestra.run.gibba015.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-11-12T05:39:25.195 INFO:teuthology.orchestra.run.gibba015.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-12T05:39:25.195 INFO:teuthology.orchestra.run.gibba015.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-12T05:39:25.196 INFO:teuthology.orchestra.run.gibba015.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-12T05:39:25.196 INFO:teuthology.orchestra.run.gibba015.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-12T05:39:25.196 INFO:teuthology.orchestra.run.gibba015.stdout:Suggested packages: 2021-11-12T05:39:25.197 INFO:teuthology.orchestra.run.gibba015.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-11-12T05:39:25.206 INFO:teuthology.orchestra.run.gibba015.stdout:The following NEW packages will be installed: 2021-11-12T05:39:25.206 INFO:teuthology.orchestra.run.gibba015.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2021-11-12T05:39:25.207 INFO:teuthology.orchestra.run.gibba015.stdout: libssl-dev 2021-11-12T05:39:25.253 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-mgr-k8sevents (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:25.344 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-11-12T05:39:25.355 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-mgr-diskprediction-local (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:25.457 INFO:teuthology.orchestra.run.gibba015.stdout:0 upgraded, 10 newly installed, 0 to remove and 42 not upgraded. 2021-11-12T05:39:25.457 INFO:teuthology.orchestra.run.gibba015.stdout:Need to get 2,913 kB of archives. 2021-11-12T05:39:25.457 INFO:teuthology.orchestra.run.gibba015.stdout:After this operation, 12.4 MB of additional disk space will be used. 2021-11-12T05:39:25.458 INFO:teuthology.orchestra.run.gibba015.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2021-11-12T05:39:25.463 INFO:teuthology.orchestra.run.gibba005.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-11-12T05:39:25.522 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-mon (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:25.571 INFO:teuthology.orchestra.run.gibba044.stdout:Adding group ceph....done 2021-11-12T05:39:25.661 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up libcephfs2 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:25.724 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-11-12T05:39:25.724 INFO:teuthology.orchestra.run.gibba038.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-11-12T05:39:25.788 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-11-12T05:39:25.820 INFO:teuthology.orchestra.run.gibba005.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-11-12T05:39:25.822 DEBUG:teuthology.orchestra.run.gibba005:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-11-12T05:39:25.857 INFO:teuthology.orchestra.run.gibba005.stdout:Reading package lists... 2021-11-12T05:39:25.922 INFO:teuthology.orchestra.run.gibba044.stdout:Adding system user ceph....done 2021-11-12T05:39:25.958 INFO:teuthology.orchestra.run.gibba005.stdout:Building dependency tree... 2021-11-12T05:39:25.959 INFO:teuthology.orchestra.run.gibba005.stdout:Reading state information... 2021-11-12T05:39:25.982 INFO:teuthology.orchestra.run.gibba015.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2021-11-12T05:39:26.035 INFO:teuthology.orchestra.run.gibba005.stdout:libtool-bin is already the newest version (2.4.6-14). 2021-11-12T05:39:26.035 INFO:teuthology.orchestra.run.gibba005.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2021-11-12T05:39:26.035 INFO:teuthology.orchestra.run.gibba005.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.1). 2021-11-12T05:39:26.036 INFO:teuthology.orchestra.run.gibba005.stdout:The following packages were automatically installed and are no longer required: 2021-11-12T05:39:26.036 INFO:teuthology.orchestra.run.gibba005.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-11-12T05:39:26.036 INFO:teuthology.orchestra.run.gibba005.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-12T05:39:26.036 INFO:teuthology.orchestra.run.gibba005.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-12T05:39:26.036 INFO:teuthology.orchestra.run.gibba005.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-12T05:39:26.037 INFO:teuthology.orchestra.run.gibba005.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-12T05:39:26.037 INFO:teuthology.orchestra.run.gibba005.stdout:Suggested packages: 2021-11-12T05:39:26.037 INFO:teuthology.orchestra.run.gibba005.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-11-12T05:39:26.047 INFO:teuthology.orchestra.run.gibba005.stdout:The following NEW packages will be installed: 2021-11-12T05:39:26.047 INFO:teuthology.orchestra.run.gibba005.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2021-11-12T05:39:26.048 INFO:teuthology.orchestra.run.gibba005.stdout: libssl-dev 2021-11-12T05:39:26.055 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-mgr-cephadm (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:26.073 INFO:teuthology.orchestra.run.gibba044.stdout:Setting system user ceph properties....done 2021-11-12T05:39:26.073 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up libradosstriper1 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:26.086 INFO:teuthology.orchestra.run.gibba044.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-11-12T05:39:26.137 INFO:teuthology.orchestra.run.gibba015.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2021-11-12T05:39:26.145 INFO:teuthology.orchestra.run.gibba015.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2021-11-12T05:39:26.160 INFO:teuthology.orchestra.run.gibba044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-11-12T05:39:26.162 INFO:teuthology.orchestra.run.gibba015.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2021-11-12T05:39:26.168 INFO:teuthology.orchestra.run.gibba015.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2021-11-12T05:39:26.170 INFO:teuthology.orchestra.run.gibba015.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2021-11-12T05:39:26.175 INFO:teuthology.orchestra.run.gibba015.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2021-11-12T05:39:26.176 INFO:teuthology.orchestra.run.gibba015.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2021-11-12T05:39:26.177 INFO:teuthology.orchestra.run.gibba015.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.8 [1,584 kB] 2021-11-12T05:39:26.191 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:26.199 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-11-12T05:39:26.221 INFO:teuthology.orchestra.run.gibba005.stdout:0 upgraded, 10 newly installed, 0 to remove and 42 not upgraded. 2021-11-12T05:39:26.221 INFO:teuthology.orchestra.run.gibba005.stdout:Need to get 2,913 kB of archives. 2021-11-12T05:39:26.222 INFO:teuthology.orchestra.run.gibba005.stdout:After this operation, 12.4 MB of additional disk space will be used. 2021-11-12T05:39:26.222 INFO:teuthology.orchestra.run.gibba005.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2021-11-12T05:39:26.326 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up ceph-mgr-dashboard (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:26.345 INFO:teuthology.orchestra.run.gibba044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-11-12T05:39:26.460 INFO:teuthology.orchestra.run.gibba038.stdout:Processing triggers for systemd (245.4-4ubuntu3.13) ... 2021-11-12T05:39:26.464 INFO:teuthology.orchestra.run.gibba015.stdout:Fetched 2,913 kB in 1s (2,713 kB/s) 2021-11-12T05:39:26.475 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-11-12T05:39:26.598 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package flex. 2021-11-12T05:39:26.670 INFO:teuthology.orchestra.run.gibba038.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-11-12T05:39:26.673 INFO:teuthology.orchestra.run.gibba015.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 182110 files and directories currently installed.) 2021-11-12T05:39:26.677 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../0-flex_2.6.4-6.2_amd64.deb ... 2021-11-12T05:39:26.692 INFO:teuthology.orchestra.run.gibba005.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2021-11-12T05:39:26.712 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking flex (2.6.4-6.2) ... 2021-11-12T05:39:26.836 INFO:teuthology.orchestra.run.gibba005.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2021-11-12T05:39:26.839 INFO:teuthology.orchestra.run.gibba005.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2021-11-12T05:39:26.850 INFO:teuthology.orchestra.run.gibba005.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2021-11-12T05:39:26.864 INFO:teuthology.orchestra.run.gibba005.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2021-11-12T05:39:26.865 INFO:teuthology.orchestra.run.gibba005.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2021-11-12T05:39:26.872 INFO:teuthology.orchestra.run.gibba005.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2021-11-12T05:39:26.873 INFO:teuthology.orchestra.run.gibba005.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2021-11-12T05:39:26.874 INFO:teuthology.orchestra.run.gibba005.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.8 [1,584 kB] 2021-11-12T05:39:26.909 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up ceph-test (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:27.010 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up radosgw (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:27.075 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package bison. 2021-11-12T05:39:27.108 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../1-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2021-11-12T05:39:27.156 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2021-11-12T05:39:27.159 INFO:teuthology.orchestra.run.gibba005.stdout:Fetched 2,913 kB in 1s (3,140 kB/s) 2021-11-12T05:39:27.220 INFO:teuthology.orchestra.run.gibba044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-11-12T05:39:27.220 INFO:teuthology.orchestra.run.gibba044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-11-12T05:39:27.286 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package flex. 2021-11-12T05:39:27.338 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up librbd1 (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:27.361 INFO:teuthology.orchestra.run.gibba005.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 182110 files and directories currently installed.) 2021-11-12T05:39:27.365 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../0-flex_2.6.4-6.2_amd64.deb ... 2021-11-12T05:39:27.409 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking flex (2.6.4-6.2) ... 2021-11-12T05:39:27.465 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-11-12T05:39:27.521 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package liblzo2-2:amd64. 2021-11-12T05:39:27.531 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../2-liblzo2-2_2.10-2_amd64.deb ... 2021-11-12T05:39:27.613 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2021-11-12T05:39:27.616 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-11-12T05:39:27.679 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up ceph-base (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:27.741 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-11-12T05:39:27.864 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package bison. 2021-11-12T05:39:27.872 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../1-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2021-11-12T05:39:27.907 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2021-11-12T05:39:27.931 INFO:teuthology.orchestra.run.gibba044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-11-12T05:39:27.983 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package dump. 2021-11-12T05:39:27.984 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-11-12T05:39:28.016 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../3-dump_0.4b46-6_amd64.deb ... 2021-11-12T05:39:28.065 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking dump (0.4b46-6) ... 2021-11-12T05:39:28.144 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-rsa (4.0-3) ... 2021-11-12T05:39:28.198 INFO:teuthology.orchestra.run.gibba038.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-11-12T05:39:28.231 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up ceph-mds (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:28.327 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package indent. 2021-11-12T05:39:28.360 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../4-indent_2.2.12-1_amd64.deb ... 2021-11-12T05:39:28.394 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking indent (2.2.12-1) ... 2021-11-12T05:39:28.403 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-11-12T05:39:28.411 INFO:teuthology.orchestra.run.gibba044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-11-12T05:39:28.412 INFO:teuthology.orchestra.run.gibba044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-11-12T05:39:28.530 INFO:teuthology.orchestra.run.gibba038.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-11-12T05:39:28.532 DEBUG:teuthology.orchestra.run.gibba038:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-11-12T05:39:28.613 INFO:teuthology.orchestra.run.gibba038.stdout:Reading package lists... 2021-11-12T05:39:28.647 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-11-12T05:39:28.662 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up ceph-mgr-modules-core (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:28.680 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../5-libaio-dev_0.3.112-5_amd64.deb ... 2021-11-12T05:39:28.699 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up ceph-mgr (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:28.715 INFO:teuthology.orchestra.run.gibba038.stdout:Building dependency tree... 2021-11-12T05:39:28.715 INFO:teuthology.orchestra.run.gibba038.stdout:Reading state information... 2021-11-12T05:39:28.721 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2021-11-12T05:39:28.788 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up ceph-fuse (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:28.793 INFO:teuthology.orchestra.run.gibba038.stdout:libtool-bin is already the newest version (2.4.6-14). 2021-11-12T05:39:28.793 INFO:teuthology.orchestra.run.gibba038.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2021-11-12T05:39:28.794 INFO:teuthology.orchestra.run.gibba038.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.1). 2021-11-12T05:39:28.794 INFO:teuthology.orchestra.run.gibba038.stdout:The following packages were automatically installed and are no longer required: 2021-11-12T05:39:28.794 INFO:teuthology.orchestra.run.gibba038.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-11-12T05:39:28.794 INFO:teuthology.orchestra.run.gibba038.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-12T05:39:28.795 INFO:teuthology.orchestra.run.gibba038.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-12T05:39:28.795 INFO:teuthology.orchestra.run.gibba038.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-12T05:39:28.795 INFO:teuthology.orchestra.run.gibba038.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-12T05:39:28.796 INFO:teuthology.orchestra.run.gibba038.stdout:Suggested packages: 2021-11-12T05:39:28.796 INFO:teuthology.orchestra.run.gibba038.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-11-12T05:39:28.806 INFO:teuthology.orchestra.run.gibba038.stdout:The following NEW packages will be installed: 2021-11-12T05:39:28.806 INFO:teuthology.orchestra.run.gibba038.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2021-11-12T05:39:28.806 INFO:teuthology.orchestra.run.gibba038.stdout: libssl-dev 2021-11-12T05:39:28.835 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package liblzo2-2:amd64. 2021-11-12T05:39:28.865 INFO:teuthology.orchestra.run.gibba044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-11-12T05:39:28.866 INFO:teuthology.orchestra.run.gibba044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-11-12T05:39:28.867 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../2-liblzo2-2_2.10-2_amd64.deb ... 2021-11-12T05:39:28.935 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2021-11-12T05:39:28.971 INFO:teuthology.orchestra.run.gibba016.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-11-12T05:39:28.971 INFO:teuthology.orchestra.run.gibba016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-11-12T05:39:29.006 INFO:teuthology.orchestra.run.gibba038.stdout:0 upgraded, 10 newly installed, 0 to remove and 42 not upgraded. 2021-11-12T05:39:29.007 INFO:teuthology.orchestra.run.gibba038.stdout:Need to get 2,913 kB of archives. 2021-11-12T05:39:29.007 INFO:teuthology.orchestra.run.gibba038.stdout:After this operation, 12.4 MB of additional disk space will be used. 2021-11-12T05:39:29.007 INFO:teuthology.orchestra.run.gibba038.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2021-11-12T05:39:29.050 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-11-12T05:39:29.083 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../6-libelf-dev_0.176-1.1build1_amd64.deb ... 2021-11-12T05:39:29.124 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2021-11-12T05:39:29.150 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:29.257 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up libcephfs-dev (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:29.262 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package dump. 2021-11-12T05:39:29.272 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../3-dump_0.4b46-6_amd64.deb ... 2021-11-12T05:39:29.284 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up ceph-osd (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:29.312 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking dump (0.4b46-6) ... 2021-11-12T05:39:29.408 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-11-12T05:39:29.503 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package libfl2:amd64. 2021-11-12T05:39:29.510 INFO:teuthology.orchestra.run.gibba038.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2021-11-12T05:39:29.513 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../7-libfl2_2.6.4-6.2_amd64.deb ... 2021-11-12T05:39:29.552 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2021-11-12T05:39:29.575 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package indent. 2021-11-12T05:39:29.608 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../4-indent_2.2.12-1_amd64.deb ... 2021-11-12T05:39:29.625 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-11-12T05:39:29.649 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking indent (2.2.12-1) ... 2021-11-12T05:39:29.667 INFO:teuthology.orchestra.run.gibba038.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2021-11-12T05:39:29.674 INFO:teuthology.orchestra.run.gibba038.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2021-11-12T05:39:29.684 INFO:teuthology.orchestra.run.gibba038.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2021-11-12T05:39:29.690 INFO:teuthology.orchestra.run.gibba038.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2021-11-12T05:39:29.691 INFO:teuthology.orchestra.run.gibba038.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2021-11-12T05:39:29.697 INFO:teuthology.orchestra.run.gibba038.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2021-11-12T05:39:29.697 INFO:teuthology.orchestra.run.gibba038.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2021-11-12T05:39:29.698 INFO:teuthology.orchestra.run.gibba038.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.8 [1,584 kB] 2021-11-12T05:39:29.731 INFO:teuthology.orchestra.run.gibba044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-11-12T05:39:29.732 INFO:teuthology.orchestra.run.gibba044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-11-12T05:39:29.780 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-11-12T05:39:29.813 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../8-libfl-dev_2.6.4-6.2_amd64.deb ... 2021-11-12T05:39:29.847 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2021-11-12T05:39:29.893 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-11-12T05:39:29.969 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-11-12T05:39:29.989 INFO:teuthology.orchestra.run.gibba038.stdout:Fetched 2,913 kB in 1s (2,923 kB/s) 2021-11-12T05:39:30.001 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../5-libaio-dev_0.3.112-5_amd64.deb ... 2021-11-12T05:39:30.043 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2021-11-12T05:39:30.044 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up ceph-mgr-k8sevents (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:30.090 INFO:teuthology.orchestra.run.gibba015.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-11-12T05:39:30.095 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package flex. 2021-11-12T05:39:30.119 INFO:teuthology.orchestra.run.gibba015.stdout:Preparing to unpack .../9-libssl-dev_1.1.1f-1ubuntu2.8_amd64.deb ... 2021-11-12T05:39:30.166 INFO:teuthology.orchestra.run.gibba015.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.8) ... 2021-11-12T05:39:30.169 INFO:teuthology.orchestra.run.gibba038.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 182110 files and directories currently installed.) 2021-11-12T05:39:30.170 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up ceph-mgr-diskprediction-local (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:30.172 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../0-flex_2.6.4-6.2_amd64.deb ... 2021-11-12T05:39:30.195 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-rados (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:30.209 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking flex (2.6.4-6.2) ... 2021-11-12T05:39:30.305 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up ceph-mon (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:30.329 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-11-12T05:39:30.347 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-rbd (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:30.363 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../6-libelf-dev_0.176-1.1build1_amd64.deb ... 2021-11-12T05:39:30.405 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2021-11-12T05:39:30.472 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up rbd-fuse (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:30.508 INFO:teuthology.orchestra.run.gibba044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-11-12T05:39:30.508 INFO:teuthology.orchestra.run.gibba044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-11-12T05:39:30.615 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up flex (2.6.4-6.2) ... 2021-11-12T05:39:30.623 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-routes (2.4.1-2) ... 2021-11-12T05:39:30.698 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package bison. 2021-11-12T05:39:30.708 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../1-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2021-11-12T05:39:30.734 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package libfl2:amd64. 2021-11-12T05:39:30.737 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2021-11-12T05:39:30.744 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../7-libfl2_2.6.4-6.2_amd64.deb ... 2021-11-12T05:39:30.749 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2021-11-12T05:39:30.783 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2021-11-12T05:39:30.789 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up ceph-mgr-cephadm (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:30.880 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2021-11-12T05:39:30.909 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-11-12T05:39:30.959 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up ceph (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:30.981 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.8) ... 2021-11-12T05:39:31.077 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-11-12T05:39:31.081 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2021-11-12T05:39:31.083 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up ceph-mgr-dashboard (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:31.088 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../8-libfl-dev_2.6.4-6.2_amd64.deb ... 2021-11-12T05:39:31.109 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package liblzo2-2:amd64. 2021-11-12T05:39:31.127 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2021-11-12T05:39:31.143 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../2-liblzo2-2_2.10-2_amd64.deb ... 2021-11-12T05:39:31.169 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-rgw (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:31.183 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2021-11-12T05:39:31.209 INFO:teuthology.orchestra.run.gibba044.stdout:Processing triggers for systemd (245.4-4ubuntu3.13) ... 2021-11-12T05:39:31.226 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2021-11-12T05:39:31.295 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-cephfs (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:31.309 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up dump (0.4b46-6) ... 2021-11-12T05:39:31.388 INFO:teuthology.orchestra.run.gibba005.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-11-12T05:39:31.421 INFO:teuthology.orchestra.run.gibba005.stdout:Preparing to unpack .../9-libssl-dev_1.1.1f-1ubuntu2.8_amd64.deb ... 2021-11-12T05:39:31.426 INFO:teuthology.orchestra.run.gibba044.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-11-12T05:39:31.466 INFO:teuthology.orchestra.run.gibba015.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-11-12T05:39:31.471 INFO:teuthology.orchestra.run.gibba005.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.8) ... 2021-11-12T05:39:31.537 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up cephfs-shell (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:31.596 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package dump. 2021-11-12T05:39:31.605 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../3-dump_0.4b46-6_amd64.deb ... 2021-11-12T05:39:31.619 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2021-11-12T05:39:31.645 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking dump (0.4b46-6) ... 2021-11-12T05:39:31.689 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-11-12T05:39:31.711 INFO:teuthology.orchestra.run.gibba015.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-11-12T05:39:31.779 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up indent (2.2.12-1) ... 2021-11-12T05:39:31.870 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up flex (2.6.4-6.2) ... 2021-11-12T05:39:31.881 INFO:teuthology.orchestra.run.gibba015.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2021-11-12T05:39:31.916 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package indent. 2021-11-12T05:39:31.949 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../4-indent_2.2.12-1_amd64.deb ... 2021-11-12T05:39:31.983 INFO:teuthology.orchestra.run.gibba015.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-11-12T05:39:31.990 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking indent (2.2.12-1) ... 2021-11-12T05:39:32.018 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2021-11-12T05:39:32.134 INFO:teuthology.orchestra.run.gibba015.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-11-12T05:39:32.144 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2021-11-12T05:39:32.245 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.8) ... 2021-11-12T05:39:32.346 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2021-11-12T05:39:32.383 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up ceph-common (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:32.446 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2021-11-12T05:39:32.581 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up dump (0.4b46-6) ... 2021-11-12T05:39:32.619 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-11-12T05:39:32.652 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../5-libaio-dev_0.3.112-5_amd64.deb ... 2021-11-12T05:39:32.662 INFO:teuthology.orchestra.run.gibba005.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-11-12T05:39:32.693 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2021-11-12T05:39:32.715 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2021-11-12T05:39:32.790 INFO:teuthology.orchestra.run.gibba005.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-11-12T05:39:32.860 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up indent (2.2.12-1) ... 2021-11-12T05:39:32.913 INFO:teuthology.orchestra.run.gibba044.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-11-12T05:39:32.963 INFO:teuthology.orchestra.run.gibba016.stdout:Adding group ceph....done 2021-11-12T05:39:32.985 INFO:teuthology.orchestra.run.gibba005.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2021-11-12T05:39:33.047 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-11-12T05:39:33.057 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../6-libelf-dev_0.176-1.1build1_amd64.deb ... 2021-11-12T05:39:33.096 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2021-11-12T05:39:33.129 INFO:teuthology.orchestra.run.gibba005.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-11-12T05:39:33.254 INFO:teuthology.orchestra.run.gibba005.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-11-12T05:39:33.273 INFO:teuthology.orchestra.run.gibba044.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-11-12T05:39:33.275 DEBUG:teuthology.orchestra.run.gibba044:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-11-12T05:39:33.311 INFO:teuthology.orchestra.run.gibba044.stdout:Reading package lists... 2021-11-12T05:39:33.354 INFO:teuthology.orchestra.run.gibba016.stdout:Adding system user ceph....done 2021-11-12T05:39:33.392 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package libfl2:amd64. 2021-11-12T05:39:33.414 INFO:teuthology.orchestra.run.gibba044.stdout:Building dependency tree... 2021-11-12T05:39:33.415 INFO:teuthology.orchestra.run.gibba044.stdout:Reading state information... 2021-11-12T05:39:33.424 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../7-libfl2_2.6.4-6.2_amd64.deb ... 2021-11-12T05:39:33.458 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2021-11-12T05:39:33.494 INFO:teuthology.orchestra.run.gibba044.stdout:libtool-bin is already the newest version (2.4.6-14). 2021-11-12T05:39:33.494 INFO:teuthology.orchestra.run.gibba044.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2021-11-12T05:39:33.495 INFO:teuthology.orchestra.run.gibba044.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.1). 2021-11-12T05:39:33.495 INFO:teuthology.orchestra.run.gibba044.stdout:The following packages were automatically installed and are no longer required: 2021-11-12T05:39:33.495 INFO:teuthology.orchestra.run.gibba044.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-11-12T05:39:33.495 INFO:teuthology.orchestra.run.gibba044.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-12T05:39:33.496 INFO:teuthology.orchestra.run.gibba044.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-12T05:39:33.496 INFO:teuthology.orchestra.run.gibba044.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-12T05:39:33.496 INFO:teuthology.orchestra.run.gibba044.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-12T05:39:33.497 INFO:teuthology.orchestra.run.gibba044.stdout:Suggested packages: 2021-11-12T05:39:33.497 INFO:teuthology.orchestra.run.gibba044.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-11-12T05:39:33.506 INFO:teuthology.orchestra.run.gibba044.stdout:The following NEW packages will be installed: 2021-11-12T05:39:33.507 INFO:teuthology.orchestra.run.gibba044.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2021-11-12T05:39:33.507 INFO:teuthology.orchestra.run.gibba044.stdout: libssl-dev 2021-11-12T05:39:33.511 INFO:teuthology.orchestra.run.gibba016.stdout:Setting system user ceph properties....done 2021-11-12T05:39:33.524 INFO:teuthology.orchestra.run.gibba016.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-11-12T05:39:33.602 INFO:teuthology.orchestra.run.gibba016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-11-12T05:39:33.611 INFO:teuthology.orchestra.run.gibba015.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2021-11-12T05:39:33.677 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-11-12T05:39:33.680 INFO:teuthology.orchestra.run.gibba044.stdout:0 upgraded, 10 newly installed, 0 to remove and 42 not upgraded. 2021-11-12T05:39:33.680 INFO:teuthology.orchestra.run.gibba044.stdout:Need to get 2,913 kB of archives. 2021-11-12T05:39:33.681 INFO:teuthology.orchestra.run.gibba044.stdout:After this operation, 12.4 MB of additional disk space will be used. 2021-11-12T05:39:33.681 INFO:teuthology.orchestra.run.gibba044.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2021-11-12T05:39:33.709 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../8-libfl-dev_2.6.4-6.2_amd64.deb ... 2021-11-12T05:39:33.760 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2021-11-12T05:39:33.767 INFO:teuthology.orchestra.run.gibba016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-11-12T05:39:34.013 INFO:teuthology.orchestra.run.gibba038.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-11-12T05:39:34.027 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up ceph-test (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:34.045 INFO:teuthology.orchestra.run.gibba038.stdout:Preparing to unpack .../9-libssl-dev_1.1.1f-1ubuntu2.8_amd64.deb ... 2021-11-12T05:39:34.087 INFO:teuthology.orchestra.run.gibba038.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.8) ... 2021-11-12T05:39:34.152 INFO:teuthology.orchestra.run.gibba044.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2021-11-12T05:39:34.186 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up radosgw (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:34.279 INFO:teuthology.orchestra.run.gibba015.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-11-12T05:39:34.281 DEBUG:teuthology.parallel:result is None 2021-11-12T05:39:34.283 INFO:teuthology.orchestra.run.gibba005.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2021-11-12T05:39:34.326 INFO:teuthology.orchestra.run.gibba044.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2021-11-12T05:39:34.339 INFO:teuthology.orchestra.run.gibba044.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2021-11-12T05:39:34.351 INFO:teuthology.orchestra.run.gibba044.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2021-11-12T05:39:34.359 INFO:teuthology.orchestra.run.gibba044.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2021-11-12T05:39:34.359 INFO:teuthology.orchestra.run.gibba044.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2021-11-12T05:39:34.366 INFO:teuthology.orchestra.run.gibba044.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2021-11-12T05:39:34.366 INFO:teuthology.orchestra.run.gibba044.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2021-11-12T05:39:34.367 INFO:teuthology.orchestra.run.gibba044.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.8 [1,584 kB] 2021-11-12T05:39:34.389 INFO:teuthology.orchestra.run.gibba016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-11-12T05:39:34.390 INFO:teuthology.orchestra.run.gibba016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-11-12T05:39:34.519 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up flex (2.6.4-6.2) ... 2021-11-12T05:39:34.659 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2021-11-12T05:39:34.721 INFO:teuthology.orchestra.run.gibba044.stdout:Fetched 2,913 kB in 1s (2,930 kB/s) 2021-11-12T05:39:34.771 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up ceph-base (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:34.785 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2021-11-12T05:39:34.819 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package flex. 2021-11-12T05:39:34.894 INFO:teuthology.orchestra.run.gibba044.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 182110 files and directories currently installed.) 2021-11-12T05:39:34.898 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../0-flex_2.6.4-6.2_amd64.deb ... 2021-11-12T05:39:34.910 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.8) ... 2021-11-12T05:39:34.933 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking flex (2.6.4-6.2) ... 2021-11-12T05:39:35.002 INFO:teuthology.orchestra.run.gibba005.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-11-12T05:39:35.003 DEBUG:teuthology.parallel:result is None 2021-11-12T05:39:35.036 INFO:teuthology.orchestra.run.gibba016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-11-12T05:39:35.037 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2021-11-12T05:39:35.137 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2021-11-12T05:39:35.238 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up dump (0.4b46-6) ... 2021-11-12T05:39:35.297 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up ceph-mds (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:35.320 INFO:teuthology.orchestra.run.gibba038.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-11-12T05:39:35.371 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package bison. 2021-11-12T05:39:35.380 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../1-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2021-11-12T05:39:35.381 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2021-11-12T05:39:35.422 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2021-11-12T05:39:35.489 INFO:teuthology.orchestra.run.gibba038.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-11-12T05:39:35.542 INFO:teuthology.orchestra.run.gibba016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-11-12T05:39:35.543 INFO:teuthology.orchestra.run.gibba016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-11-12T05:39:35.558 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up indent (2.2.12-1) ... 2021-11-12T05:39:35.684 INFO:teuthology.orchestra.run.gibba038.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2021-11-12T05:39:35.807 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up ceph-mgr (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:35.811 INFO:teuthology.orchestra.run.gibba038.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-11-12T05:39:35.825 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package liblzo2-2:amd64. 2021-11-12T05:39:35.858 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../2-liblzo2-2_2.10-2_amd64.deb ... 2021-11-12T05:39:35.942 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2021-11-12T05:39:35.953 INFO:teuthology.orchestra.run.gibba038.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-11-12T05:39:36.038 INFO:teuthology.orchestra.run.gibba016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-11-12T05:39:36.038 INFO:teuthology.orchestra.run.gibba016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-11-12T05:39:36.318 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:36.469 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up ceph-osd (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:36.553 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package dump. 2021-11-12T05:39:36.563 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../3-dump_0.4b46-6_amd64.deb ... 2021-11-12T05:39:36.644 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking dump (0.4b46-6) ... 2021-11-12T05:39:36.886 INFO:teuthology.orchestra.run.gibba016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-11-12T05:39:36.887 INFO:teuthology.orchestra.run.gibba016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-11-12T05:39:36.923 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package indent. 2021-11-12T05:39:36.956 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../4-indent_2.2.12-1_amd64.deb ... 2021-11-12T05:39:36.997 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking indent (2.2.12-1) ... 2021-11-12T05:39:37.038 INFO:teuthology.orchestra.run.gibba038.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2021-11-12T05:39:37.145 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up ceph-mgr-k8sevents (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:37.272 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up ceph-mgr-diskprediction-local (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:37.283 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-11-12T05:39:37.316 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../5-libaio-dev_0.3.112-5_amd64.deb ... 2021-11-12T05:39:37.358 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2021-11-12T05:39:37.423 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up ceph-mon (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:37.565 INFO:teuthology.orchestra.run.gibba016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-11-12T05:39:37.565 INFO:teuthology.orchestra.run.gibba016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-11-12T05:39:37.670 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-11-12T05:39:37.703 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../6-libelf-dev_0.176-1.1build1_amd64.deb ... 2021-11-12T05:39:37.744 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2021-11-12T05:39:37.775 INFO:teuthology.orchestra.run.gibba038.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-11-12T05:39:37.776 DEBUG:teuthology.parallel:result is None 2021-11-12T05:39:37.891 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up ceph-mgr-cephadm (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:38.008 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up ceph (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:38.147 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package libfl2:amd64. 2021-11-12T05:39:38.151 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up ceph-mgr-dashboard (15.2.15-22-ga81ee281-1focal) ... 2021-11-12T05:39:38.157 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../7-libfl2_2.6.4-6.2_amd64.deb ... 2021-11-12T05:39:38.196 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2021-11-12T05:39:38.287 INFO:teuthology.orchestra.run.gibba016.stdout:Processing triggers for systemd (245.4-4ubuntu3.13) ... 2021-11-12T05:39:38.457 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-11-12T05:39:38.479 INFO:teuthology.orchestra.run.gibba016.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-11-12T05:39:38.491 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../8-libfl-dev_2.6.4-6.2_amd64.deb ... 2021-11-12T05:39:38.532 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2021-11-12T05:39:38.827 INFO:teuthology.orchestra.run.gibba044.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-11-12T05:39:38.860 INFO:teuthology.orchestra.run.gibba044.stdout:Preparing to unpack .../9-libssl-dev_1.1.1f-1ubuntu2.8_amd64.deb ... 2021-11-12T05:39:38.902 INFO:teuthology.orchestra.run.gibba044.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.8) ... 2021-11-12T05:39:39.350 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up flex (2.6.4-6.2) ... 2021-11-12T05:39:39.472 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2021-11-12T05:39:39.598 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2021-11-12T05:39:39.757 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.8) ... 2021-11-12T05:39:39.875 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2021-11-12T05:39:39.976 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2021-11-12T05:39:40.077 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up dump (0.4b46-6) ... 2021-11-12T05:39:40.173 INFO:teuthology.orchestra.run.gibba016.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-11-12T05:39:40.183 INFO:teuthology.orchestra.run.gibba044.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-11-12T05:39:40.253 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2021-11-12T05:39:40.345 INFO:teuthology.orchestra.run.gibba044.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-11-12T05:39:40.413 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up indent (2.2.12-1) ... 2021-11-12T05:39:40.526 INFO:teuthology.orchestra.run.gibba016.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-11-12T05:39:40.527 DEBUG:teuthology.orchestra.run.gibba016:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-11-12T05:39:40.539 INFO:teuthology.orchestra.run.gibba044.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2021-11-12T05:39:40.562 INFO:teuthology.orchestra.run.gibba016.stdout:Reading package lists... 2021-11-12T05:39:40.663 INFO:teuthology.orchestra.run.gibba016.stdout:Building dependency tree... 2021-11-12T05:39:40.664 INFO:teuthology.orchestra.run.gibba016.stdout:Reading state information... 2021-11-12T05:39:40.708 INFO:teuthology.orchestra.run.gibba044.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-11-12T05:39:40.739 INFO:teuthology.orchestra.run.gibba016.stdout:libtool-bin is already the newest version (2.4.6-14). 2021-11-12T05:39:40.740 INFO:teuthology.orchestra.run.gibba016.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2021-11-12T05:39:40.740 INFO:teuthology.orchestra.run.gibba016.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.1). 2021-11-12T05:39:40.740 INFO:teuthology.orchestra.run.gibba016.stdout:The following packages were automatically installed and are no longer required: 2021-11-12T05:39:40.740 INFO:teuthology.orchestra.run.gibba016.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2021-11-12T05:39:40.740 INFO:teuthology.orchestra.run.gibba016.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2021-11-12T05:39:40.741 INFO:teuthology.orchestra.run.gibba016.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2021-11-12T05:39:40.741 INFO:teuthology.orchestra.run.gibba016.stdout: linux-modules-extra-5.4.0-66-generic 2021-11-12T05:39:40.741 INFO:teuthology.orchestra.run.gibba016.stdout:Use 'sudo apt autoremove' to remove them. 2021-11-12T05:39:40.742 INFO:teuthology.orchestra.run.gibba016.stdout:Suggested packages: 2021-11-12T05:39:40.742 INFO:teuthology.orchestra.run.gibba016.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-11-12T05:39:40.751 INFO:teuthology.orchestra.run.gibba016.stdout:The following NEW packages will be installed: 2021-11-12T05:39:40.752 INFO:teuthology.orchestra.run.gibba016.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2021-11-12T05:39:40.752 INFO:teuthology.orchestra.run.gibba016.stdout: libssl-dev 2021-11-12T05:39:40.859 INFO:teuthology.orchestra.run.gibba044.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-11-12T05:39:40.925 INFO:teuthology.orchestra.run.gibba016.stdout:0 upgraded, 10 newly installed, 0 to remove and 42 not upgraded. 2021-11-12T05:39:40.925 INFO:teuthology.orchestra.run.gibba016.stdout:Need to get 2,913 kB of archives. 2021-11-12T05:39:40.925 INFO:teuthology.orchestra.run.gibba016.stdout:After this operation, 12.4 MB of additional disk space will be used. 2021-11-12T05:39:40.925 INFO:teuthology.orchestra.run.gibba016.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2021-11-12T05:39:41.387 INFO:teuthology.orchestra.run.gibba016.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2021-11-12T05:39:41.531 INFO:teuthology.orchestra.run.gibba016.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2021-11-12T05:39:41.538 INFO:teuthology.orchestra.run.gibba016.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2021-11-12T05:39:41.554 INFO:teuthology.orchestra.run.gibba016.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2021-11-12T05:39:41.561 INFO:teuthology.orchestra.run.gibba016.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2021-11-12T05:39:41.562 INFO:teuthology.orchestra.run.gibba016.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2021-11-12T05:39:41.567 INFO:teuthology.orchestra.run.gibba016.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2021-11-12T05:39:41.568 INFO:teuthology.orchestra.run.gibba016.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2021-11-12T05:39:41.570 INFO:teuthology.orchestra.run.gibba016.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.8 [1,584 kB] 2021-11-12T05:39:41.852 INFO:teuthology.orchestra.run.gibba016.stdout:Fetched 2,913 kB in 1s (3,183 kB/s) 2021-11-12T05:39:41.953 INFO:teuthology.orchestra.run.gibba044.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2021-11-12T05:39:41.979 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package flex. 2021-11-12T05:39:42.052 INFO:teuthology.orchestra.run.gibba016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 182110 files and directories currently installed.) 2021-11-12T05:39:42.056 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../0-flex_2.6.4-6.2_amd64.deb ... 2021-11-12T05:39:42.128 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking flex (2.6.4-6.2) ... 2021-11-12T05:39:42.682 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package bison. 2021-11-12T05:39:42.692 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../1-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2021-11-12T05:39:42.704 INFO:teuthology.orchestra.run.gibba044.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-11-12T05:39:42.706 DEBUG:teuthology.parallel:result is None 2021-11-12T05:39:42.733 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2021-11-12T05:39:43.210 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package liblzo2-2:amd64. 2021-11-12T05:39:43.220 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../2-liblzo2-2_2.10-2_amd64.deb ... 2021-11-12T05:39:43.302 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2021-11-12T05:39:43.705 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package dump. 2021-11-12T05:39:43.716 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../3-dump_0.4b46-6_amd64.deb ... 2021-11-12T05:39:43.755 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking dump (0.4b46-6) ... 2021-11-12T05:39:44.067 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package indent. 2021-11-12T05:39:44.099 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../4-indent_2.2.12-1_amd64.deb ... 2021-11-12T05:39:44.166 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking indent (2.2.12-1) ... 2021-11-12T05:39:44.836 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-11-12T05:39:44.869 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../5-libaio-dev_0.3.112-5_amd64.deb ... 2021-11-12T05:39:44.936 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2021-11-12T05:39:45.273 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-11-12T05:39:45.284 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../6-libelf-dev_0.176-1.1build1_amd64.deb ... 2021-11-12T05:39:45.322 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2021-11-12T05:39:45.726 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package libfl2:amd64. 2021-11-12T05:39:45.759 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../7-libfl2_2.6.4-6.2_amd64.deb ... 2021-11-12T05:39:45.800 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2021-11-12T05:39:46.103 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-11-12T05:39:46.113 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../8-libfl-dev_2.6.4-6.2_amd64.deb ... 2021-11-12T05:39:46.194 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2021-11-12T05:39:46.498 INFO:teuthology.orchestra.run.gibba016.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-11-12T05:39:46.531 INFO:teuthology.orchestra.run.gibba016.stdout:Preparing to unpack .../9-libssl-dev_1.1.1f-1ubuntu2.8_amd64.deb ... 2021-11-12T05:39:46.572 INFO:teuthology.orchestra.run.gibba016.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.8) ... 2021-11-12T05:39:47.045 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up flex (2.6.4-6.2) ... 2021-11-12T05:39:47.201 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2021-11-12T05:39:47.327 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2021-11-12T05:39:47.495 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.8) ... 2021-11-12T05:39:47.621 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2021-11-12T05:39:47.789 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2021-11-12T05:39:47.948 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up dump (0.4b46-6) ... 2021-11-12T05:39:48.046 INFO:teuthology.orchestra.run.gibba016.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-11-12T05:39:48.108 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2021-11-12T05:39:48.232 INFO:teuthology.orchestra.run.gibba016.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-11-12T05:39:48.293 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up indent (2.2.12-1) ... 2021-11-12T05:39:48.452 INFO:teuthology.orchestra.run.gibba016.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2021-11-12T05:39:48.579 INFO:teuthology.orchestra.run.gibba016.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-11-12T05:39:48.748 INFO:teuthology.orchestra.run.gibba016.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-11-12T05:39:50.250 INFO:teuthology.orchestra.run.gibba016.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2021-11-12T05:39:51.042 INFO:teuthology.orchestra.run.gibba016.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-11-12T05:39:51.044 DEBUG:teuthology.parallel:result is None 2021-11-12T05:39:51.045 DEBUG:teuthology.orchestra.run.gibba005:> sudo lsb_release -is 2021-11-12T05:39:51.072 INFO:teuthology.orchestra.run.gibba005.stdout:Ubuntu 2021-11-12T05:39:51.076 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-12T05:39:51.076 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=a81ee2815de5acae59ead5b8c9137b6766fc8ea8 2021-11-12T05:39:51.299 DEBUG:teuthology.orchestra.run.gibba005:> dpkg-query -W -f '${Version}' ceph 2021-11-12T05:39:51.342 INFO:teuthology.orchestra.run.gibba005.stdout:15.2.15-22-ga81ee281-1focal 2021-11-12T05:39:51.343 INFO:teuthology.packaging:The installed version of ceph is 15.2.15-22-ga81ee281-1focal 2021-11-12T05:39:51.344 INFO:teuthology.task.install:The correct ceph version 15.2.15-22-ga81ee281-1focal is installed. 2021-11-12T05:39:51.344 DEBUG:teuthology.orchestra.run.gibba015:> sudo lsb_release -is 2021-11-12T05:39:51.371 INFO:teuthology.orchestra.run.gibba015.stdout:Ubuntu 2021-11-12T05:39:51.374 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-12T05:39:51.375 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=a81ee2815de5acae59ead5b8c9137b6766fc8ea8 2021-11-12T05:39:51.605 DEBUG:teuthology.orchestra.run.gibba015:> dpkg-query -W -f '${Version}' ceph 2021-11-12T05:39:51.649 INFO:teuthology.orchestra.run.gibba015.stdout:15.2.15-22-ga81ee281-1focal 2021-11-12T05:39:51.650 INFO:teuthology.packaging:The installed version of ceph is 15.2.15-22-ga81ee281-1focal 2021-11-12T05:39:51.650 INFO:teuthology.task.install:The correct ceph version 15.2.15-22-ga81ee281-1focal is installed. 2021-11-12T05:39:51.651 DEBUG:teuthology.orchestra.run.gibba016:> sudo lsb_release -is 2021-11-12T05:39:51.678 INFO:teuthology.orchestra.run.gibba016.stdout:Ubuntu 2021-11-12T05:39:51.681 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-12T05:39:51.682 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=a81ee2815de5acae59ead5b8c9137b6766fc8ea8 2021-11-12T05:39:51.930 DEBUG:teuthology.orchestra.run.gibba016:> dpkg-query -W -f '${Version}' ceph 2021-11-12T05:39:51.973 INFO:teuthology.orchestra.run.gibba016.stdout:15.2.15-22-ga81ee281-1focal 2021-11-12T05:39:51.974 INFO:teuthology.packaging:The installed version of ceph is 15.2.15-22-ga81ee281-1focal 2021-11-12T05:39:51.974 INFO:teuthology.task.install:The correct ceph version 15.2.15-22-ga81ee281-1focal is installed. 2021-11-12T05:39:51.975 DEBUG:teuthology.orchestra.run.gibba038:> sudo lsb_release -is 2021-11-12T05:39:52.002 INFO:teuthology.orchestra.run.gibba038.stdout:Ubuntu 2021-11-12T05:39:52.005 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-12T05:39:52.005 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=a81ee2815de5acae59ead5b8c9137b6766fc8ea8 2021-11-12T05:39:52.218 DEBUG:teuthology.orchestra.run.gibba038:> dpkg-query -W -f '${Version}' ceph 2021-11-12T05:39:52.263 INFO:teuthology.orchestra.run.gibba038.stdout:15.2.15-22-ga81ee281-1focal 2021-11-12T05:39:52.263 INFO:teuthology.packaging:The installed version of ceph is 15.2.15-22-ga81ee281-1focal 2021-11-12T05:39:52.263 INFO:teuthology.task.install:The correct ceph version 15.2.15-22-ga81ee281-1focal is installed. 2021-11-12T05:39:52.264 DEBUG:teuthology.orchestra.run.gibba044:> sudo lsb_release -is 2021-11-12T05:39:52.292 INFO:teuthology.orchestra.run.gibba044.stdout:Ubuntu 2021-11-12T05:39:52.295 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-11-12T05:39:52.295 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=a81ee2815de5acae59ead5b8c9137b6766fc8ea8 2021-11-12T05:39:52.503 DEBUG:teuthology.orchestra.run.gibba044:> dpkg-query -W -f '${Version}' ceph 2021-11-12T05:39:52.546 INFO:teuthology.orchestra.run.gibba044.stdout:15.2.15-22-ga81ee281-1focal 2021-11-12T05:39:52.547 INFO:teuthology.packaging:The installed version of ceph is 15.2.15-22-ga81ee281-1focal 2021-11-12T05:39:52.547 INFO:teuthology.task.install:The correct ceph version 15.2.15-22-ga81ee281-1focal is installed. 2021-11-12T05:39:52.548 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-11-12T05:39:52.548 DEBUG:teuthology.orchestra.run.gibba005:> set -ex 2021-11-12T05:39:52.549 DEBUG:teuthology.orchestra.run.gibba005:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-11-12T05:39:52.561 DEBUG:teuthology.orchestra.run.gibba015:> set -ex 2021-11-12T05:39:52.561 DEBUG:teuthology.orchestra.run.gibba015:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-11-12T05:39:52.572 DEBUG:teuthology.orchestra.run.gibba016:> set -ex 2021-11-12T05:39:52.573 DEBUG:teuthology.orchestra.run.gibba016:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-11-12T05:39:52.584 DEBUG:teuthology.orchestra.run.gibba038:> set -ex 2021-11-12T05:39:52.585 DEBUG:teuthology.orchestra.run.gibba038:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-11-12T05:39:52.596 DEBUG:teuthology.orchestra.run.gibba044:> set -ex 2021-11-12T05:39:52.596 DEBUG:teuthology.orchestra.run.gibba044:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-11-12T05:39:52.618 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-11-12T05:39:52.619 DEBUG:teuthology.orchestra.run.gibba005:> set -ex 2021-11-12T05:39:52.619 DEBUG:teuthology.orchestra.run.gibba005:> sudo dd of=/usr/bin/daemon-helper 2021-11-12T05:39:52.629 DEBUG:teuthology.orchestra.run.gibba005:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-11-12T05:39:52.691 DEBUG:teuthology.orchestra.run.gibba015:> set -ex 2021-11-12T05:39:52.692 DEBUG:teuthology.orchestra.run.gibba015:> sudo dd of=/usr/bin/daemon-helper 2021-11-12T05:39:52.713 DEBUG:teuthology.orchestra.run.gibba015:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-11-12T05:39:52.775 DEBUG:teuthology.orchestra.run.gibba016:> set -ex 2021-11-12T05:39:52.775 DEBUG:teuthology.orchestra.run.gibba016:> sudo dd of=/usr/bin/daemon-helper 2021-11-12T05:39:52.797 DEBUG:teuthology.orchestra.run.gibba016:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-11-12T05:39:52.817 DEBUG:teuthology.orchestra.run.gibba038:> set -ex 2021-11-12T05:39:52.818 DEBUG:teuthology.orchestra.run.gibba038:> sudo dd of=/usr/bin/daemon-helper 2021-11-12T05:39:52.840 DEBUG:teuthology.orchestra.run.gibba038:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-11-12T05:39:52.851 DEBUG:teuthology.orchestra.run.gibba044:> set -ex 2021-11-12T05:39:52.851 DEBUG:teuthology.orchestra.run.gibba044:> sudo dd of=/usr/bin/daemon-helper 2021-11-12T05:39:52.863 DEBUG:teuthology.orchestra.run.gibba044:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-11-12T05:39:52.870 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-11-12T05:39:52.870 DEBUG:teuthology.orchestra.run.gibba005:> set -ex 2021-11-12T05:39:52.871 DEBUG:teuthology.orchestra.run.gibba005:> sudo dd of=/usr/bin/adjust-ulimits 2021-11-12T05:39:52.892 DEBUG:teuthology.orchestra.run.gibba005:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-11-12T05:39:52.955 DEBUG:teuthology.orchestra.run.gibba015:> set -ex 2021-11-12T05:39:52.955 DEBUG:teuthology.orchestra.run.gibba015:> sudo dd of=/usr/bin/adjust-ulimits 2021-11-12T05:39:52.977 DEBUG:teuthology.orchestra.run.gibba015:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-11-12T05:39:52.998 DEBUG:teuthology.orchestra.run.gibba016:> set -ex 2021-11-12T05:39:52.998 DEBUG:teuthology.orchestra.run.gibba016:> sudo dd of=/usr/bin/adjust-ulimits 2021-11-12T05:39:53.020 DEBUG:teuthology.orchestra.run.gibba016:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-11-12T05:39:53.083 DEBUG:teuthology.orchestra.run.gibba038:> set -ex 2021-11-12T05:39:53.084 DEBUG:teuthology.orchestra.run.gibba038:> sudo dd of=/usr/bin/adjust-ulimits 2021-11-12T05:39:53.092 DEBUG:teuthology.orchestra.run.gibba038:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-11-12T05:39:53.145 DEBUG:teuthology.orchestra.run.gibba044:> set -ex 2021-11-12T05:39:53.145 DEBUG:teuthology.orchestra.run.gibba044:> sudo dd of=/usr/bin/adjust-ulimits 2021-11-12T05:39:53.167 DEBUG:teuthology.orchestra.run.gibba044:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-11-12T05:39:53.188 INFO:teuthology.run_tasks:Running task ceph... 2021-11-12T05:39:53.248 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2021-11-12T05:39:53.249 DEBUG:teuthology.orchestra.run.gibba005:> sudo chmod 777 /var/log/ceph 2021-11-12T05:39:53.253 DEBUG:teuthology.orchestra.run.gibba015:> sudo chmod 777 /var/log/ceph 2021-11-12T05:39:53.256 DEBUG:teuthology.orchestra.run.gibba016:> sudo chmod 777 /var/log/ceph 2021-11-12T05:39:53.260 DEBUG:teuthology.orchestra.run.gibba038:> sudo chmod 777 /var/log/ceph 2021-11-12T05:39:53.264 DEBUG:teuthology.orchestra.run.gibba044:> sudo chmod 777 /var/log/ceph 2021-11-12T05:39:53.282 INFO:tasks.ceph:Disabling ceph logrotate... 2021-11-12T05:39:53.282 DEBUG:teuthology.orchestra.run.gibba005:> sudo rm -f -- /etc/logrotate.d/ceph 2021-11-12T05:39:53.285 DEBUG:teuthology.orchestra.run.gibba015:> sudo rm -f -- /etc/logrotate.d/ceph 2021-11-12T05:39:53.288 DEBUG:teuthology.orchestra.run.gibba016:> sudo rm -f -- /etc/logrotate.d/ceph 2021-11-12T05:39:53.293 DEBUG:teuthology.orchestra.run.gibba038:> sudo rm -f -- /etc/logrotate.d/ceph 2021-11-12T05:39:53.296 DEBUG:teuthology.orchestra.run.gibba044:> sudo rm -f -- /etc/logrotate.d/ceph 2021-11-12T05:39:53.314 INFO:tasks.ceph:Creating extra log directories... 2021-11-12T05:39:53.315 DEBUG:teuthology.orchestra.run.gibba005:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-11-12T05:39:53.337 DEBUG:teuthology.orchestra.run.gibba015:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-11-12T05:39:53.340 DEBUG:teuthology.orchestra.run.gibba016:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-11-12T05:39:53.343 DEBUG:teuthology.orchestra.run.gibba038:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-11-12T05:39:53.357 DEBUG:teuthology.orchestra.run.gibba044:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-11-12T05:39:53.378 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2021-11-12T05:39:53.379 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2021-11-12T05:39:53.379 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2021-11-12T05:39:53.379 DEBUG:teuthology.orchestra.run.gibba005:> set -ex 2021-11-12T05:39:53.380 DEBUG:teuthology.orchestra.run.gibba005:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-11-12T05:39:53.390 DEBUG:teuthology.orchestra.run.gibba005:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-11-12T05:39:53.410 DEBUG:teuthology.orchestra.run.gibba015:> set -ex 2021-11-12T05:39:53.410 DEBUG:teuthology.orchestra.run.gibba015:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-11-12T05:39:53.420 DEBUG:teuthology.orchestra.run.gibba015:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-11-12T05:39:53.481 DEBUG:teuthology.orchestra.run.gibba016:> set -ex 2021-11-12T05:39:53.482 DEBUG:teuthology.orchestra.run.gibba016:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-11-12T05:39:53.491 DEBUG:teuthology.orchestra.run.gibba016:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-11-12T05:39:53.554 DEBUG:teuthology.orchestra.run.gibba038:> set -ex 2021-11-12T05:39:53.555 DEBUG:teuthology.orchestra.run.gibba038:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-11-12T05:39:53.564 DEBUG:teuthology.orchestra.run.gibba038:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-11-12T05:39:53.627 DEBUG:teuthology.orchestra.run.gibba044:> set -ex 2021-11-12T05:39:53.627 DEBUG:teuthology.orchestra.run.gibba044:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-11-12T05:39:53.637 DEBUG:teuthology.orchestra.run.gibba044:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-11-12T05:39:53.700 INFO:tasks.ceph:Creating ceph cluster ceph... 2021-11-12T05:39:53.700 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'POOL_APP_NOT_ENABLED', 'has not responded to cap revoke by MDS for over', 'MDS_CLIENT_LATE_RELEASE', 'responding to mclientcaps'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2021-11-12T05:39:53.701 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2021-11-05_04:10:01-fs-octopus-distro-default-gibba/6486492', 'branch': 'octopus', 'description': 'fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests}', 'email': 'ceph-qa@ceph.io', 'first_in_suite': False, 'job_id': '6486492', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'gibba', 'name': 'teuthology-2021-11-05_04:10:01-fs-octopus-distro-default-gibba', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'octopus'}, 'ceph': {'cephfs_ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'POOL_APP_NOT_ENABLED', 'has not responded to cap revoke by MDS for over', 'MDS_CLIENT_LATE_RELEASE', 'responding to mclientcaps'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'a81ee2815de5acae59ead5b8c9137b6766fc8ea8'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a81ee2815de5acae59ead5b8c9137b6766fc8ea8'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'octopus', 'sha1': 'a81ee2815de5acae59ead5b8c9137b6766fc8ea8'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 1000, 'repo': 'https://github.com/ceph/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0'], ['client.1'], ['client.2']], 'sha1': 'a81ee2815de5acae59ead5b8c9137b6766fc8ea8', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'octopus', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_a81ee2815de5acae59ead5b8c9137b6766fc8ea8/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': 'a81ee2815de5acae59ead5b8c9137b6766fc8ea8', 'targets': {'gibba005.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyGqPpC6QqahsfKlJnhiK5JMLITyu6yXMnFZq2y39vkntX8/vvyiJ/uBuO0prWxUJFWgi+kGHasTgGHlV7T9MPLw1rt8vEMVfuRUGXgZ9AZ59eX68W7fhPS1VWbE4IFhs3p1yJML/OKCHY2zzQ+dAO6YRIP9KGOCWTBK96849V//84aYPLrdCe+Ytot7h6OWT2bTt0sHn0kYuMBzm3XVDPwsepjwAHQVvYRKvlCunlXN6vRaKFQb5VNubWE7VHHsMjj4QVPgekZMAWX1LODwQsVGIZwlEi6uy3O1wp+vQ6SXSbmlR30+q2/Qcadwplk2csINUV5tV/84iN7HIOoDwlGWPvz4WGwbIvlHR9wgQPtm9urzD6rYcrfKhwD9Z6LK0sBamq23M3P5aeN1qla4p+sEj/L0hSICk0o6/wzWlfs0zsJjTA0eAsAiInBsik6FdLLYTpHkXw63w42lRY0tBAnPmVYL0r/xEMkl9NNmpKMic/yE9uTbhFfB0JFjAcsqU=', 'gibba015.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDczkS8lEBqkJ8R+x6iCiFCazxt6FfxJQmaRwIo+iSbHIk5gJTD3PejSk9RspSrSXQNOD1XHlTqnNpyBdNhaZvRvUohGAyGkIuIyudpTC/KTb4Sc/s4vbWdp1Cg2XRNPuT9PCHZwOsGxTCA6lHcEcpojgvqdB9eB89ULf8VTD6hFlTXHoQyYE8fXM9FwEyY5Co9c7t8mwOGNc5ZqKA0nssySVKoyByy3Xrva5sdhswNkZfJTofG1Iyy/0IabIPN3Ha1OIn0GC8/h5YoxyY5k/tqjSNPQ3Qqxup9AxNO29UwpgCsfJH7peIsF/2bg/jr2ZhYTspb7GWTKn+Wy8BwLwfS0Eva+LImjjEkRj6YurCsZQ/hk9I/4lqDu64fJaAKouA094n14bZq31y/1z+50mmTjXj9Q6cCdrSOzj5qfb38QF8vkbsYYvUuLMedmHysHpC9F0XcEFurFofkvEMByGrs4PsKbIGjh5/ZLvDf8XGxf2z8LZSzGjj6y7q59dc6biE=', 'gibba016.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpn2xhnKN0T4iYT1XNfF7ogRlks9QDkX4UDy6hKr7F9TwJrnwpRtkZqkjT9Hw0wS2GIhBXIXHIilGJCYcnY0C7I4A3yzcqKmpIe9NGLhlanjLw43+1h/Bwxo9tQTwbHroCzs+wedwVZGZzDxTUAG1/wTTjgys2csKQqUX2vliDAvHlmTksaEialZoZjwgNh+VQ0bNBK3JWR+N/1BKq0sxvOAbLY5EiplsNP+cld7VILfbil1T9Q5lNmaRX9PCu7EzYrh4Smt2Mx/6TyHQoL9ZCpPlIdKyVXF00+wy/NcPa9glekJujaKxVlmWuIEoUs4bjHAnVNCO43WpOkDYXObLC0qKxfmmEZwpqMUOWyJDe/x5VR0xhpXfEXYdl62mQRcv46QwYyO1mFNWvshPj1M/ZRxxMqPUYTXm1ZhhFoTO+CUJ+zF4PAPNSO7ov3dAyrhaE0iG1qgzHzvhnMQ0y478i+oT4MHgeluDrcQhbTbVBT5tQc+NLKyoOuL4p5YwR8PM=', 'gibba038.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzGIX912XhZDjC2aybF4gTls0Ct7Q0Smf3ldSaUX4lkqaj+YGLEzntrlxbncnU8CVeAn4UqTrG6vn/ZavxT23tVN/Zg7fgu1vDOEMdhwjq9lGJTS2AQgsttT0z068l2oOxDR2vL5JTItjgYA/3cF4EfRNHpHp1kaxPZtM/yrAxnOW54N6iUto8bqOWxJ6HZxkQhgWyyQqxQ/40j6tOSkoT0GzrxLnY3ujpVlkpFJ3TwQnV8DsuuI/ycIjtDy45Pq+iakIYOInLWGJhsHDhKiKIGdj0ZXdG7I7tD9PAMzzShupRpjZuCnK/paFC53mZlJamPz+VR3xS8586FM3V8zRNJ2OvN+SyJqsGbr2SuzSRychfsNZots27c3C9eAtA1o6qANuDWtrZNCf97n5sWef4besOXSd+r7ztaycW5HIA7QgfyW/2ixPGjcbQMJ8r0vWtH1GqekeH6VDenvH4hwtJYI73wbOnJmnQpS2RasgCYDkQ3TGL/n0wmu4WJDBbMjs=', 'gibba044.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7y85QoUA+p4f8OEGWyJbZo5cbKXlBTgXMdKso0PEAzOJxklAh/ux0oMFywnxN5i+2gfybHd6BK9+VortHfsWfU8gj/O85y9eY9iLtWOcf9x/Uuv+Zv2t9TA8SbbHq8uDBYAwGFJdSklYbKdlkEzDVUee4m0Dk9XQTDk6icpPwS/QBt/Hc5zmBYTRfvFXTDXQlOJCEqRzWod13tdw42v5E+aEAcHTbU0I4MjeTtnWFwEebRAShP5ifjFIuocFOk8ttp0QaPl8Wo6oNmVFmr9C9ptoOp0/jnuNZ4rBOaOhbihGpYlxB3rGvCLaux3/KafEGEwgOcVC1EVGVvimXqT/LCIVbgW/gtd/zPUbkZUv+j0G3ncwofpy6MEOoGRPXcLKdsYDav9gwU3U0dLUMioGRiuN6fN70lfPSStAUJoujR05sH7DNLfX6S+AJAhspWVeEbMtBLQqmEAR1Rw+pT9WG/uktQuBGFBdsDFxrbItqAzquuVKfEJ9tNWXm6SVIRi0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'a81ee2815de5acae59ead5b8c9137b6766fc8ea8'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_misc']}}], 'teuthology_branch': 'master', 'teuthology_sha1': '27954452159076fda5642b6c0eb0c4998b99d2e4', 'timestamp': '2021-11-05_04:10:01', 'tube': 'gibba', 'user': 'teuthology', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.gibba.19943'} 2021-11-12T05:39:53.702 DEBUG:teuthology.orchestra.run.gibba005:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-11-12T05:39:53.706 DEBUG:teuthology.orchestra.run.gibba015:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-11-12T05:39:53.709 DEBUG:teuthology.orchestra.run.gibba016:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-11-12T05:39:53.713 DEBUG:teuthology.orchestra.run.gibba038:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-11-12T05:39:53.717 DEBUG:teuthology.orchestra.run.gibba044:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-11-12T05:39:53.727 DEBUG:teuthology.orchestra.run.gibba005:> sudo install -d -m0777 -- /var/run/ceph 2021-11-12T05:39:53.729 DEBUG:teuthology.orchestra.run.gibba015:> sudo install -d -m0777 -- /var/run/ceph 2021-11-12T05:39:53.760 DEBUG:teuthology.orchestra.run.gibba016:> sudo install -d -m0777 -- /var/run/ceph 2021-11-12T05:39:53.764 DEBUG:teuthology.orchestra.run.gibba038:> sudo install -d -m0777 -- /var/run/ceph 2021-11-12T05:39:53.768 DEBUG:teuthology.orchestra.run.gibba044:> sudo install -d -m0777 -- /var/run/ceph 2021-11-12T05:39:53.789 DEBUG:teuthology.orchestra.run.gibba005:> set -ex 2021-11-12T05:39:53.790 DEBUG:teuthology.orchestra.run.gibba005:> dd if=/scratch_devs of=/dev/stdout 2021-11-12T05:39:53.796 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-11-12T05:39:53.797 DEBUG:teuthology.orchestra.run.gibba005:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-11-12T05:39:53.805 INFO:teuthology.orchestra.run.gibba005.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-11-12T05:39:53.805 INFO:teuthology.orchestra.run.gibba005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-12T05:39:53.805 INFO:teuthology.orchestra.run.gibba005.stdout:Device: 6h/6d Inode: 369 Links: 1 2021-11-12T05:39:53.806 INFO:teuthology.orchestra.run.gibba005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-12T05:39:53.806 INFO:teuthology.orchestra.run.gibba005.stdout:Access: 2021-11-12 05:36:21.937234087 +0000 2021-11-12T05:39:53.806 INFO:teuthology.orchestra.run.gibba005.stdout:Modify: 2021-11-12 05:36:21.801212473 +0000 2021-11-12T05:39:53.806 INFO:teuthology.orchestra.run.gibba005.stdout:Change: 2021-11-12 05:36:21.801212473 +0000 2021-11-12T05:39:53.807 INFO:teuthology.orchestra.run.gibba005.stdout: Birth: - 2021-11-12T05:39:53.813 INFO:teuthology.orchestra.run.gibba005.stderr:1+0 records in 2021-11-12T05:39:53.813 INFO:teuthology.orchestra.run.gibba005.stderr:1+0 records out 2021-11-12T05:39:53.813 INFO:teuthology.orchestra.run.gibba005.stderr:512 bytes copied, 0.000252989 s, 2.0 MB/s 2021-11-12T05:39:53.814 DEBUG:teuthology.orchestra.run.gibba005:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-11-12T05:39:53.819 INFO:teuthology.orchestra.run.gibba005.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-11-12T05:39:53.819 INFO:teuthology.orchestra.run.gibba005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-12T05:39:53.819 INFO:teuthology.orchestra.run.gibba005.stdout:Device: 6h/6d Inode: 373 Links: 1 2021-11-12T05:39:53.819 INFO:teuthology.orchestra.run.gibba005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-12T05:39:53.820 INFO:teuthology.orchestra.run.gibba005.stdout:Access: 2021-11-12 05:36:22.309291679 +0000 2021-11-12T05:39:53.820 INFO:teuthology.orchestra.run.gibba005.stdout:Modify: 2021-11-12 05:36:22.145266436 +0000 2021-11-12T05:39:53.820 INFO:teuthology.orchestra.run.gibba005.stdout:Change: 2021-11-12 05:36:22.145266436 +0000 2021-11-12T05:39:53.820 INFO:teuthology.orchestra.run.gibba005.stdout: Birth: - 2021-11-12T05:39:53.821 INFO:teuthology.orchestra.run.gibba005.stderr:1+0 records in 2021-11-12T05:39:53.821 INFO:teuthology.orchestra.run.gibba005.stderr:1+0 records out 2021-11-12T05:39:53.821 INFO:teuthology.orchestra.run.gibba005.stderr:512 bytes copied, 0.000174926 s, 2.9 MB/s 2021-11-12T05:39:53.823 DEBUG:teuthology.orchestra.run.gibba005:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-11-12T05:39:53.827 INFO:teuthology.orchestra.run.gibba005.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-11-12T05:39:53.827 INFO:teuthology.orchestra.run.gibba005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-12T05:39:53.827 INFO:teuthology.orchestra.run.gibba005.stdout:Device: 6h/6d Inode: 381 Links: 1 2021-11-12T05:39:53.828 INFO:teuthology.orchestra.run.gibba005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-12T05:39:53.828 INFO:teuthology.orchestra.run.gibba005.stdout:Access: 2021-11-12 05:36:22.669347094 +0000 2021-11-12T05:39:53.828 INFO:teuthology.orchestra.run.gibba005.stdout:Modify: 2021-11-12 05:36:22.549328623 +0000 2021-11-12T05:39:53.828 INFO:teuthology.orchestra.run.gibba005.stdout:Change: 2021-11-12 05:36:22.549328623 +0000 2021-11-12T05:39:53.829 INFO:teuthology.orchestra.run.gibba005.stdout: Birth: - 2021-11-12T05:39:53.830 INFO:teuthology.orchestra.run.gibba005.stderr:1+0 records in 2021-11-12T05:39:53.830 INFO:teuthology.orchestra.run.gibba005.stderr:1+0 records out 2021-11-12T05:39:53.830 INFO:teuthology.orchestra.run.gibba005.stderr:512 bytes copied, 0.000166993 s, 3.1 MB/s 2021-11-12T05:39:53.832 DEBUG:teuthology.orchestra.run.gibba005:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-11-12T05:39:53.880 INFO:teuthology.orchestra.run.gibba005.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-11-12T05:39:53.881 INFO:teuthology.orchestra.run.gibba005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-12T05:39:53.881 INFO:teuthology.orchestra.run.gibba005.stdout:Device: 6h/6d Inode: 389 Links: 1 2021-11-12T05:39:53.881 INFO:teuthology.orchestra.run.gibba005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-12T05:39:53.882 INFO:teuthology.orchestra.run.gibba005.stdout:Access: 2021-11-12 05:36:23.053405951 +0000 2021-11-12T05:39:53.882 INFO:teuthology.orchestra.run.gibba005.stdout:Modify: 2021-11-12 05:36:22.869377879 +0000 2021-11-12T05:39:53.882 INFO:teuthology.orchestra.run.gibba005.stdout:Change: 2021-11-12 05:36:22.869377879 +0000 2021-11-12T05:39:53.882 INFO:teuthology.orchestra.run.gibba005.stdout: Birth: - 2021-11-12T05:39:53.887 INFO:teuthology.orchestra.run.gibba005.stderr:1+0 records in 2021-11-12T05:39:53.888 INFO:teuthology.orchestra.run.gibba005.stderr:1+0 records out 2021-11-12T05:39:53.888 INFO:teuthology.orchestra.run.gibba005.stderr:512 bytes copied, 0.000233977 s, 2.2 MB/s 2021-11-12T05:39:53.889 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-11-12T05:39:53.890 DEBUG:teuthology.orchestra.run.gibba015:> set -ex 2021-11-12T05:39:53.890 DEBUG:teuthology.orchestra.run.gibba015:> dd if=/scratch_devs of=/dev/stdout 2021-11-12T05:39:53.899 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-11-12T05:39:53.900 DEBUG:teuthology.orchestra.run.gibba015:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-11-12T05:39:53.909 INFO:teuthology.orchestra.run.gibba015.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-11-12T05:39:53.910 INFO:teuthology.orchestra.run.gibba015.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-12T05:39:53.910 INFO:teuthology.orchestra.run.gibba015.stdout:Device: 6h/6d Inode: 348 Links: 1 2021-11-12T05:39:53.910 INFO:teuthology.orchestra.run.gibba015.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-12T05:39:53.910 INFO:teuthology.orchestra.run.gibba015.stdout:Access: 2021-11-12 05:36:28.984074233 +0000 2021-11-12T05:39:53.911 INFO:teuthology.orchestra.run.gibba015.stdout:Modify: 2021-11-12 05:36:28.860073876 +0000 2021-11-12T05:39:53.911 INFO:teuthology.orchestra.run.gibba015.stdout:Change: 2021-11-12 05:36:28.860073876 +0000 2021-11-12T05:39:53.911 INFO:teuthology.orchestra.run.gibba015.stdout: Birth: - 2021-11-12T05:39:53.916 INFO:teuthology.orchestra.run.gibba015.stderr:1+0 records in 2021-11-12T05:39:53.917 INFO:teuthology.orchestra.run.gibba015.stderr:1+0 records out 2021-11-12T05:39:53.917 INFO:teuthology.orchestra.run.gibba015.stderr:512 bytes copied, 0.00020404 s, 2.5 MB/s 2021-11-12T05:39:53.918 DEBUG:teuthology.orchestra.run.gibba015:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-11-12T05:39:53.922 INFO:teuthology.orchestra.run.gibba015.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-11-12T05:39:53.922 INFO:teuthology.orchestra.run.gibba015.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-12T05:39:53.922 INFO:teuthology.orchestra.run.gibba015.stdout:Device: 6h/6d Inode: 357 Links: 1 2021-11-12T05:39:53.923 INFO:teuthology.orchestra.run.gibba015.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-12T05:39:53.923 INFO:teuthology.orchestra.run.gibba015.stdout:Access: 2021-11-12 05:36:29.364075328 +0000 2021-11-12T05:39:53.923 INFO:teuthology.orchestra.run.gibba015.stdout:Modify: 2021-11-12 05:36:29.252075005 +0000 2021-11-12T05:39:53.923 INFO:teuthology.orchestra.run.gibba015.stdout:Change: 2021-11-12 05:36:29.252075005 +0000 2021-11-12T05:39:53.924 INFO:teuthology.orchestra.run.gibba015.stdout: Birth: - 2021-11-12T05:39:53.925 INFO:teuthology.orchestra.run.gibba015.stderr:1+0 records in 2021-11-12T05:39:53.925 INFO:teuthology.orchestra.run.gibba015.stderr:1+0 records out 2021-11-12T05:39:53.925 INFO:teuthology.orchestra.run.gibba015.stderr:512 bytes copied, 0.00022394 s, 2.3 MB/s 2021-11-12T05:39:53.927 DEBUG:teuthology.orchestra.run.gibba015:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-11-12T05:39:53.974 INFO:teuthology.orchestra.run.gibba015.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-11-12T05:39:53.975 INFO:teuthology.orchestra.run.gibba015.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-12T05:39:53.975 INFO:teuthology.orchestra.run.gibba015.stdout:Device: 6h/6d Inode: 362 Links: 1 2021-11-12T05:39:53.975 INFO:teuthology.orchestra.run.gibba015.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-12T05:39:53.976 INFO:teuthology.orchestra.run.gibba015.stdout:Access: 2021-11-12 05:36:29.756076459 +0000 2021-11-12T05:39:53.976 INFO:teuthology.orchestra.run.gibba015.stdout:Modify: 2021-11-12 05:36:29.608076032 +0000 2021-11-12T05:39:53.976 INFO:teuthology.orchestra.run.gibba015.stdout:Change: 2021-11-12 05:36:29.608076032 +0000 2021-11-12T05:39:53.976 INFO:teuthology.orchestra.run.gibba015.stdout: Birth: - 2021-11-12T05:39:53.979 INFO:teuthology.orchestra.run.gibba015.stderr:1+0 records in 2021-11-12T05:39:53.979 INFO:teuthology.orchestra.run.gibba015.stderr:1+0 records out 2021-11-12T05:39:53.980 INFO:teuthology.orchestra.run.gibba015.stderr:512 bytes copied, 0.000296447 s, 1.7 MB/s 2021-11-12T05:39:53.982 DEBUG:teuthology.orchestra.run.gibba015:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-11-12T05:39:53.988 INFO:teuthology.orchestra.run.gibba015.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-11-12T05:39:53.988 INFO:teuthology.orchestra.run.gibba015.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-12T05:39:53.988 INFO:teuthology.orchestra.run.gibba015.stdout:Device: 6h/6d Inode: 369 Links: 1 2021-11-12T05:39:53.988 INFO:teuthology.orchestra.run.gibba015.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-12T05:39:53.989 INFO:teuthology.orchestra.run.gibba015.stdout:Access: 2021-11-12 05:36:30.204077751 +0000 2021-11-12T05:39:53.989 INFO:teuthology.orchestra.run.gibba015.stdout:Modify: 2021-11-12 05:36:30.028077244 +0000 2021-11-12T05:39:53.989 INFO:teuthology.orchestra.run.gibba015.stdout:Change: 2021-11-12 05:36:30.028077244 +0000 2021-11-12T05:39:53.989 INFO:teuthology.orchestra.run.gibba015.stdout: Birth: - 2021-11-12T05:39:53.995 INFO:teuthology.orchestra.run.gibba015.stderr:1+0 records in 2021-11-12T05:39:53.995 INFO:teuthology.orchestra.run.gibba015.stderr:1+0 records out 2021-11-12T05:39:53.995 INFO:teuthology.orchestra.run.gibba015.stderr:512 bytes copied, 0.000227705 s, 2.2 MB/s 2021-11-12T05:39:54.000 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-11-12T05:39:54.000 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@gibba005.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@gibba015.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2021-11-12T05:39:54.001 INFO:tasks.ceph:Generating config... 2021-11-12T05:39:54.002 INFO:tasks.ceph:[client] client mount timeout = 600 2021-11-12T05:39:54.003 INFO:tasks.ceph:[client] debug client = 20 2021-11-12T05:39:54.003 INFO:tasks.ceph:[client] debug ms = 1 2021-11-12T05:39:54.003 INFO:tasks.ceph:[client] rados mon op timeout = 15m 2021-11-12T05:39:54.003 INFO:tasks.ceph:[client] rados osd op timeout = 15m 2021-11-12T05:39:54.004 INFO:tasks.ceph:[mds] debug mds = 20 2021-11-12T05:39:54.004 INFO:tasks.ceph:[mds] debug ms = 1 2021-11-12T05:39:54.004 INFO:tasks.ceph:[mds] mds bal frag = True 2021-11-12T05:39:54.005 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2021-11-12T05:39:54.005 INFO:tasks.ceph:[mds] mds bal merge size = 5 2021-11-12T05:39:54.005 INFO:tasks.ceph:[mds] mds bal split bits = 3 2021-11-12T05:39:54.006 INFO:tasks.ceph:[mds] mds bal split size = 100 2021-11-12T05:39:54.006 INFO:tasks.ceph:[mds] mds debug frag = True 2021-11-12T05:39:54.006 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2021-11-12T05:39:54.006 INFO:tasks.ceph:[mds] mds op complaint time = 180 2021-11-12T05:39:54.007 INFO:tasks.ceph:[mds] mds verify scatter = True 2021-11-12T05:39:54.007 INFO:tasks.ceph:[mds] osd op complaint time = 180 2021-11-12T05:39:54.007 INFO:tasks.ceph:[mds] rados mon op timeout = 15m 2021-11-12T05:39:54.008 INFO:tasks.ceph:[mds] rados osd op timeout = 15m 2021-11-12T05:39:54.010 INFO:tasks.ceph:[mgr] debug mgr = 20 2021-11-12T05:39:54.010 INFO:tasks.ceph:[mgr] debug ms = 1 2021-11-12T05:39:54.010 INFO:tasks.ceph:[mon] debug mon = 20 2021-11-12T05:39:54.011 INFO:tasks.ceph:[mon] debug ms = 1 2021-11-12T05:39:54.011 INFO:tasks.ceph:[mon] debug paxos = 20 2021-11-12T05:39:54.011 INFO:tasks.ceph:[mon] mon op complaint time = 120 2021-11-12T05:39:54.011 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2021-11-12T05:39:54.012 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2021-11-12T05:39:54.012 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2021-11-12T05:39:54.012 INFO:tasks.ceph:[osd] debug bluefs = 20 2021-11-12T05:39:54.013 INFO:tasks.ceph:[osd] debug bluestore = 20 2021-11-12T05:39:54.013 INFO:tasks.ceph:[osd] debug ms = 1 2021-11-12T05:39:54.013 INFO:tasks.ceph:[osd] debug osd = 20 2021-11-12T05:39:54.014 INFO:tasks.ceph:[osd] debug rocksdb = 10 2021-11-12T05:39:54.014 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2021-11-12T05:39:54.014 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2021-11-12T05:39:54.015 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2021-11-12T05:39:54.015 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2021-11-12T05:39:54.015 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2021-11-12T05:39:54.016 INFO:tasks.ceph:[osd] osd op complaint time = 180 2021-11-12T05:39:54.016 INFO:tasks.ceph:Setting up mon.a... 2021-11-12T05:39:54.016 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2021-11-12T05:39:54.072 INFO:teuthology.orchestra.run.gibba005.stdout:creating /etc/ceph/ceph.keyring 2021-11-12T05:39:54.074 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2021-11-12T05:39:54.092 DEBUG:teuthology.orchestra.run.gibba005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-11-12T05:39:54.157 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.2.105'), ('mon.b', '172.21.2.115'), ('mon.c', '[v2:172.21.2.115:3301,v1:172.21.2.115:6790]')] 2021-11-12T05:39:54.158 DEBUG:teuthology.orchestra.run.gibba005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.2.105 --add b 172.21.2.115 --addv c '[v2:172.21.2.115:3301,v1:172.21.2.115:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2021-11-12T05:39:54.218 INFO:teuthology.orchestra.run.gibba005.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2021-11-12T05:39:54.218 INFO:teuthology.orchestra.run.gibba005.stdout:monmaptool: generated fsid 22928e10-9f3c-479a-96ca-77d6ddf80f9f 2021-11-12T05:39:54.218 INFO:teuthology.orchestra.run.gibba005.stdout:epoch 0 2021-11-12T05:39:54.219 INFO:teuthology.orchestra.run.gibba005.stdout:fsid 22928e10-9f3c-479a-96ca-77d6ddf80f9f 2021-11-12T05:39:54.219 INFO:teuthology.orchestra.run.gibba005.stdout:last_changed 2021-11-12T05:39:54.217629+0000 2021-11-12T05:39:54.219 INFO:teuthology.orchestra.run.gibba005.stdout:created 2021-11-12T05:39:54.217629+0000 2021-11-12T05:39:54.219 INFO:teuthology.orchestra.run.gibba005.stdout:min_mon_release 0 (unknown) 2021-11-12T05:39:54.220 INFO:teuthology.orchestra.run.gibba005.stdout:0: [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] mon.a 2021-11-12T05:39:54.220 INFO:teuthology.orchestra.run.gibba005.stdout:1: [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] mon.b 2021-11-12T05:39:54.220 INFO:teuthology.orchestra.run.gibba005.stdout:2: [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] mon.c 2021-11-12T05:39:54.220 INFO:teuthology.orchestra.run.gibba005.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2021-11-12T05:39:54.222 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 22928e10-9f3c-479a-96ca-77d6ddf80f9f... 2021-11-12T05:39:54.223 DEBUG:teuthology.orchestra.run.gibba005:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-12T05:39:54.226 DEBUG:teuthology.orchestra.run.gibba015:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-12T05:39:54.231 DEBUG:teuthology.orchestra.run.gibba016:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-12T05:39:54.235 DEBUG:teuthology.orchestra.run.gibba038:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-12T05:39:54.240 DEBUG:teuthology.orchestra.run.gibba044:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-12T05:39:54.245 INFO:teuthology.orchestra.run.gibba005.stdout:[global] 2021-11-12T05:39:54.245 INFO:teuthology.orchestra.run.gibba005.stdout: chdir = "" 2021-11-12T05:39:54.245 INFO:teuthology.orchestra.run.gibba005.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-12T05:39:54.245 INFO:teuthology.orchestra.run.gibba005.stdout: auth supported = cephx 2021-11-12T05:39:54.246 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:39:54.246 INFO:teuthology.orchestra.run.gibba005.stdout: filestore xattr use omap = true 2021-11-12T05:39:54.246 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:39:54.246 INFO:teuthology.orchestra.run.gibba005.stdout: mon clock drift allowed = 1.000 2021-11-12T05:39:54.247 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:39:54.247 INFO:teuthology.orchestra.run.gibba005.stdout: osd crush chooseleaf type = 0 2021-11-12T05:39:54.247 INFO:teuthology.orchestra.run.gibba005.stdout: auth debug = true 2021-11-12T05:39:54.247 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:39:54.247 INFO:teuthology.orchestra.run.gibba005.stdout: ms die on old message = true 2021-11-12T05:39:54.248 INFO:teuthology.orchestra.run.gibba005.stdout: ms die on bug = true 2021-11-12T05:39:54.248 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:39:54.248 INFO:teuthology.orchestra.run.gibba005.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-12T05:39:54.248 INFO:teuthology.orchestra.run.gibba005.stdout: mon pg warn max object skew = 0 2021-11-12T05:39:54.249 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:39:54.249 INFO:teuthology.orchestra.run.gibba005.stdout: # disable pg_autoscaler by default for new pools 2021-11-12T05:39:54.249 INFO:teuthology.orchestra.run.gibba005.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-12T05:39:54.250 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:39:54.250 INFO:teuthology.orchestra.run.gibba005.stdout: osd pool default size = 2 2021-11-12T05:39:54.250 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:39:54.250 INFO:teuthology.orchestra.run.gibba005.stdout: mon osd allow primary affinity = true 2021-11-12T05:39:54.251 INFO:teuthology.orchestra.run.gibba005.stdout: mon osd allow pg remap = true 2021-11-12T05:39:54.251 INFO:teuthology.orchestra.run.gibba005.stdout: mon warn on legacy crush tunables = false 2021-11-12T05:39:54.251 INFO:teuthology.orchestra.run.gibba005.stdout: mon warn on crush straw calc version zero = false 2021-11-12T05:39:54.251 INFO:teuthology.orchestra.run.gibba005.stdout: mon warn on no sortbitwise = false 2021-11-12T05:39:54.251 INFO:teuthology.orchestra.run.gibba005.stdout: mon warn on osd down out interval zero = false 2021-11-12T05:39:54.252 INFO:teuthology.orchestra.run.gibba005.stdout: mon warn on too few osds = false 2021-11-12T05:39:54.252 INFO:teuthology.orchestra.run.gibba005.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-12T05:39:54.252 INFO:teuthology.orchestra.run.gibba005.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-12T05:39:54.252 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:39:54.253 INFO:teuthology.orchestra.run.gibba005.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-12T05:39:54.253 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:39:54.253 INFO:teuthology.orchestra.run.gibba005.stdout: osd default data pool replay window = 5 2021-11-12T05:39:54.253 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:39:54.253 INFO:teuthology.orchestra.run.gibba005.stdout: mon allow pool delete = true 2021-11-12T05:39:54.254 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:39:54.254 INFO:teuthology.orchestra.run.gibba005.stdout: mon cluster log file level = debug 2021-11-12T05:39:54.254 INFO:teuthology.orchestra.run.gibba005.stdout: debug asserts on shutdown = true 2021-11-12T05:39:54.254 INFO:teuthology.orchestra.run.gibba005.stdout: mon health detail to clog = false 2021-11-12T05:39:54.254 INFO:teuthology.orchestra.run.gibba005.stdout: mon host = "172.21.2.105,172.21.2.115,[v2:172.21.2.115:3301,v1:172.21.2.115:6790]" 2021-11-12T05:39:54.255 INFO:teuthology.orchestra.run.gibba005.stdout: fsid = 22928e10-9f3c-479a-96ca-77d6ddf80f9f 2021-11-12T05:39:54.255 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:39:54.255 INFO:teuthology.orchestra.run.gibba005.stdout:[osd] 2021-11-12T05:39:54.256 INFO:teuthology.orchestra.run.gibba005.stdout: osd journal size = 100 2021-11-12T05:39:54.256 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:39:54.256 INFO:teuthology.orchestra.run.gibba005.stdout: osd scrub load threshold = 5.0 2021-11-12T05:39:54.256 INFO:teuthology.orchestra.run.gibba005.stdout: osd scrub max interval = 600 2021-11-12T05:39:54.256 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:39:54.257 INFO:teuthology.orchestra.run.gibba005.stdout: osd recover clone overlap = true 2021-11-12T05:39:54.257 INFO:teuthology.orchestra.run.gibba005.stdout: osd recovery max chunk = 1048576 2021-11-12T05:39:54.257 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:39:54.257 INFO:teuthology.orchestra.run.gibba005.stdout: osd debug shutdown = true 2021-11-12T05:39:54.258 INFO:teuthology.orchestra.run.gibba005.stdout: osd debug op order = true 2021-11-12T05:39:54.258 INFO:teuthology.orchestra.run.gibba005.stdout: osd debug verify stray on activate = true 2021-11-12T05:39:54.258 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:39:54.258 INFO:teuthology.orchestra.run.gibba005.stdout: osd open classes on start = true 2021-11-12T05:39:54.258 INFO:teuthology.orchestra.run.gibba005.stdout: osd debug pg log writeout = true 2021-11-12T05:39:54.259 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:39:54.259 INFO:teuthology.orchestra.run.gibba005.stdout: osd deep scrub update digest min age = 30 2021-11-12T05:39:54.259 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:39:54.259 INFO:teuthology.orchestra.run.gibba005.stdout: osd map max advance = 10 2021-11-12T05:39:54.259 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:39:54.260 INFO:teuthology.orchestra.run.gibba005.stdout: journal zero on create = true 2021-11-12T05:39:54.260 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:39:54.261 INFO:teuthology.orchestra.run.gibba005.stdout: filestore ondisk finisher threads = 3 2021-11-12T05:39:54.261 INFO:teuthology.orchestra.run.gibba005.stdout: filestore apply finisher threads = 3 2021-11-12T05:39:54.261 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:39:54.261 INFO:teuthology.orchestra.run.gibba005.stdout: bdev debug aio = true 2021-11-12T05:39:54.261 INFO:teuthology.orchestra.run.gibba005.stdout: osd debug misdirected ops = true 2021-11-12T05:39:54.262 INFO:teuthology.orchestra.run.gibba005.stdout: bluestore block size = 96636764160 2021-11-12T05:39:54.262 INFO:teuthology.orchestra.run.gibba005.stdout: bluestore compression mode = aggressive 2021-11-12T05:39:54.262 INFO:teuthology.orchestra.run.gibba005.stdout: bluestore fsck on mount = True 2021-11-12T05:39:54.262 INFO:teuthology.orchestra.run.gibba005.stdout: debug bluefs = 20 2021-11-12T05:39:54.263 INFO:teuthology.orchestra.run.gibba005.stdout: debug bluestore = 20 2021-11-12T05:39:54.263 INFO:teuthology.orchestra.run.gibba005.stdout: debug ms = 1 2021-11-12T05:39:54.263 INFO:teuthology.orchestra.run.gibba005.stdout: debug osd = 20 2021-11-12T05:39:54.263 INFO:teuthology.orchestra.run.gibba005.stdout: debug rocksdb = 10 2021-11-12T05:39:54.263 INFO:teuthology.orchestra.run.gibba005.stdout: mon osd backfillfull_ratio = 0.85 2021-11-12T05:39:54.264 INFO:teuthology.orchestra.run.gibba005.stdout: mon osd full ratio = 0.9 2021-11-12T05:39:54.264 INFO:teuthology.orchestra.run.gibba005.stdout: mon osd nearfull ratio = 0.8 2021-11-12T05:39:54.264 INFO:teuthology.orchestra.run.gibba005.stdout: osd failsafe full ratio = 0.95 2021-11-12T05:39:54.264 INFO:teuthology.orchestra.run.gibba005.stdout: osd objectstore = bluestore 2021-11-12T05:39:54.265 INFO:teuthology.orchestra.run.gibba005.stdout: osd op complaint time = 180 2021-11-12T05:39:54.265 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:39:54.265 INFO:teuthology.orchestra.run.gibba005.stdout:[mgr] 2021-11-12T05:39:54.265 INFO:teuthology.orchestra.run.gibba005.stdout: debug ms = 1 2021-11-12T05:39:54.266 INFO:teuthology.orchestra.run.gibba005.stdout: debug mgr = 20 2021-11-12T05:39:54.266 INFO:teuthology.orchestra.run.gibba005.stdout: debug mon = 20 2021-11-12T05:39:54.266 INFO:teuthology.orchestra.run.gibba005.stdout: debug auth = 20 2021-11-12T05:39:54.266 INFO:teuthology.orchestra.run.gibba005.stdout: mon reweight min pgs per osd = 4 2021-11-12T05:39:54.266 INFO:teuthology.orchestra.run.gibba005.stdout: mon reweight min bytes per osd = 10 2021-11-12T05:39:54.267 INFO:teuthology.orchestra.run.gibba005.stdout: mgr/telemetry/nag = false 2021-11-12T05:39:54.267 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:39:54.267 INFO:teuthology.orchestra.run.gibba005.stdout:[mon] 2021-11-12T05:39:54.267 INFO:teuthology.orchestra.run.gibba005.stdout: debug ms = 1 2021-11-12T05:39:54.268 INFO:teuthology.orchestra.run.gibba005.stdout: debug mon = 20 2021-11-12T05:39:54.268 INFO:teuthology.orchestra.run.gibba005.stdout: debug paxos = 20 2021-11-12T05:39:54.268 INFO:teuthology.orchestra.run.gibba005.stdout: debug auth = 20 2021-11-12T05:39:54.268 INFO:teuthology.orchestra.run.gibba005.stdout: mon data avail warn = 5 2021-11-12T05:39:54.268 INFO:teuthology.orchestra.run.gibba005.stdout: mon mgr mkfs grace = 240 2021-11-12T05:39:54.269 INFO:teuthology.orchestra.run.gibba005.stdout: mon reweight min pgs per osd = 4 2021-11-12T05:39:54.269 INFO:teuthology.orchestra.run.gibba005.stdout: mon osd reporter subtree level = osd 2021-11-12T05:39:54.269 INFO:teuthology.orchestra.run.gibba005.stdout: mon osd prime pg temp = true 2021-11-12T05:39:54.269 INFO:teuthology.orchestra.run.gibba005.stdout: mon reweight min bytes per osd = 10 2021-11-12T05:39:54.269 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:39:54.270 INFO:teuthology.orchestra.run.gibba005.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-12T05:39:54.270 INFO:teuthology.orchestra.run.gibba005.stdout: auth mon ticket ttl = 660 # 11m 2021-11-12T05:39:54.270 INFO:teuthology.orchestra.run.gibba005.stdout: auth service ticket ttl = 240 # 4m 2021-11-12T05:39:54.271 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:39:54.271 INFO:teuthology.orchestra.run.gibba005.stdout: # don't complain about insecure global_id in the test suite 2021-11-12T05:39:54.271 INFO:teuthology.orchestra.run.gibba005.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-12T05:39:54.271 INFO:teuthology.orchestra.run.gibba005.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-12T05:39:54.272 INFO:teuthology.orchestra.run.gibba005.stdout: mon op complaint time = 120 2021-11-12T05:39:54.272 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:39:54.272 INFO:teuthology.orchestra.run.gibba005.stdout:[client] 2021-11-12T05:39:54.272 INFO:teuthology.orchestra.run.gibba005.stdout: rgw cache enabled = true 2021-11-12T05:39:54.273 INFO:teuthology.orchestra.run.gibba005.stdout: rgw enable ops log = true 2021-11-12T05:39:54.273 INFO:teuthology.orchestra.run.gibba005.stdout: rgw enable usage log = true 2021-11-12T05:39:54.273 INFO:teuthology.orchestra.run.gibba005.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-12T05:39:54.273 INFO:teuthology.orchestra.run.gibba005.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-12T05:39:54.273 INFO:teuthology.orchestra.run.gibba005.stdout: client mount timeout = 600 2021-11-12T05:39:54.274 INFO:teuthology.orchestra.run.gibba005.stdout: debug client = 20 2021-11-12T05:39:54.274 INFO:teuthology.orchestra.run.gibba005.stdout: debug ms = 1 2021-11-12T05:39:54.274 INFO:teuthology.orchestra.run.gibba005.stdout: rados mon op timeout = 15m 2021-11-12T05:39:54.274 INFO:teuthology.orchestra.run.gibba005.stdout: rados osd op timeout = 15m 2021-11-12T05:39:54.274 INFO:teuthology.orchestra.run.gibba005.stdout:[mon.a] 2021-11-12T05:39:54.275 INFO:teuthology.orchestra.run.gibba005.stdout:[mon.b] 2021-11-12T05:39:54.275 INFO:teuthology.orchestra.run.gibba005.stdout:[mon.c] 2021-11-12T05:39:54.275 INFO:teuthology.orchestra.run.gibba005.stdout:[mds.a] 2021-11-12T05:39:54.275 INFO:teuthology.orchestra.run.gibba005.stdout:[mds.b] 2021-11-12T05:39:54.276 INFO:teuthology.orchestra.run.gibba005.stdout:[mds] 2021-11-12T05:39:54.276 INFO:teuthology.orchestra.run.gibba005.stdout: debug mds = 20 2021-11-12T05:39:54.276 INFO:teuthology.orchestra.run.gibba005.stdout: debug ms = 1 2021-11-12T05:39:54.276 INFO:teuthology.orchestra.run.gibba005.stdout: mds bal frag = True 2021-11-12T05:39:54.276 INFO:teuthology.orchestra.run.gibba005.stdout: mds bal fragment size max = 10000 2021-11-12T05:39:54.277 INFO:teuthology.orchestra.run.gibba005.stdout: mds bal merge size = 5 2021-11-12T05:39:54.277 INFO:teuthology.orchestra.run.gibba005.stdout: mds bal split bits = 3 2021-11-12T05:39:54.277 INFO:teuthology.orchestra.run.gibba005.stdout: mds bal split size = 100 2021-11-12T05:39:54.277 INFO:teuthology.orchestra.run.gibba005.stdout: mds debug frag = True 2021-11-12T05:39:54.277 INFO:teuthology.orchestra.run.gibba005.stdout: mds debug scatterstat = True 2021-11-12T05:39:54.278 INFO:teuthology.orchestra.run.gibba005.stdout: mds op complaint time = 180 2021-11-12T05:39:54.278 INFO:teuthology.orchestra.run.gibba005.stdout: mds verify scatter = True 2021-11-12T05:39:54.278 INFO:teuthology.orchestra.run.gibba005.stdout: osd op complaint time = 180 2021-11-12T05:39:54.278 INFO:teuthology.orchestra.run.gibba005.stdout: rados mon op timeout = 15m 2021-11-12T05:39:54.279 INFO:teuthology.orchestra.run.gibba005.stdout: rados osd op timeout = 15m 2021-11-12T05:39:54.283 INFO:teuthology.orchestra.run.gibba044.stdout:[global] 2021-11-12T05:39:54.283 INFO:teuthology.orchestra.run.gibba044.stdout: chdir = "" 2021-11-12T05:39:54.283 INFO:teuthology.orchestra.run.gibba044.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-12T05:39:54.283 INFO:teuthology.orchestra.run.gibba044.stdout: auth supported = cephx 2021-11-12T05:39:54.284 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:39:54.284 INFO:teuthology.orchestra.run.gibba044.stdout: filestore xattr use omap = true 2021-11-12T05:39:54.284 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:39:54.284 INFO:teuthology.orchestra.run.gibba044.stdout: mon clock drift allowed = 1.000 2021-11-12T05:39:54.284 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:39:54.285 INFO:teuthology.orchestra.run.gibba044.stdout: osd crush chooseleaf type = 0 2021-11-12T05:39:54.285 INFO:teuthology.orchestra.run.gibba044.stdout: auth debug = true 2021-11-12T05:39:54.285 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:39:54.285 INFO:teuthology.orchestra.run.gibba044.stdout: ms die on old message = true 2021-11-12T05:39:54.285 INFO:teuthology.orchestra.run.gibba044.stdout: ms die on bug = true 2021-11-12T05:39:54.286 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:39:54.286 INFO:teuthology.orchestra.run.gibba044.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-12T05:39:54.286 INFO:teuthology.orchestra.run.gibba044.stdout: mon pg warn max object skew = 0 2021-11-12T05:39:54.286 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:39:54.287 INFO:teuthology.orchestra.run.gibba044.stdout: # disable pg_autoscaler by default for new pools 2021-11-12T05:39:54.287 INFO:teuthology.orchestra.run.gibba044.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-12T05:39:54.287 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:39:54.287 INFO:teuthology.orchestra.run.gibba044.stdout: osd pool default size = 2 2021-11-12T05:39:54.287 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:39:54.288 INFO:teuthology.orchestra.run.gibba044.stdout: mon osd allow primary affinity = true 2021-11-12T05:39:54.288 INFO:teuthology.orchestra.run.gibba044.stdout: mon osd allow pg remap = true 2021-11-12T05:39:54.288 INFO:teuthology.orchestra.run.gibba044.stdout: mon warn on legacy crush tunables = false 2021-11-12T05:39:54.288 INFO:teuthology.orchestra.run.gibba044.stdout: mon warn on crush straw calc version zero = false 2021-11-12T05:39:54.288 INFO:teuthology.orchestra.run.gibba044.stdout: mon warn on no sortbitwise = false 2021-11-12T05:39:54.289 INFO:teuthology.orchestra.run.gibba044.stdout: mon warn on osd down out interval zero = false 2021-11-12T05:39:54.289 INFO:teuthology.orchestra.run.gibba044.stdout: mon warn on too few osds = false 2021-11-12T05:39:54.289 INFO:teuthology.orchestra.run.gibba044.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-12T05:39:54.290 INFO:teuthology.orchestra.run.gibba044.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-12T05:39:54.290 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:39:54.290 INFO:teuthology.orchestra.run.gibba044.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-12T05:39:54.290 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:39:54.290 INFO:teuthology.orchestra.run.gibba044.stdout: osd default data pool replay window = 5 2021-11-12T05:39:54.291 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:39:54.291 INFO:teuthology.orchestra.run.gibba044.stdout: mon allow pool delete = true 2021-11-12T05:39:54.292 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:39:54.292 INFO:teuthology.orchestra.run.gibba044.stdout: mon cluster log file level = debug 2021-11-12T05:39:54.292 INFO:teuthology.orchestra.run.gibba044.stdout: debug asserts on shutdown = true 2021-11-12T05:39:54.292 INFO:teuthology.orchestra.run.gibba044.stdout: mon health detail to clog = false 2021-11-12T05:39:54.292 INFO:teuthology.orchestra.run.gibba044.stdout: mon host = "172.21.2.105,172.21.2.115,[v2:172.21.2.115:3301,v1:172.21.2.115:6790]" 2021-11-12T05:39:54.293 INFO:teuthology.orchestra.run.gibba044.stdout: fsid = 22928e10-9f3c-479a-96ca-77d6ddf80f9f 2021-11-12T05:39:54.293 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:39:54.293 INFO:teuthology.orchestra.run.gibba044.stdout:[osd] 2021-11-12T05:39:54.293 INFO:teuthology.orchestra.run.gibba044.stdout: osd journal size = 100 2021-11-12T05:39:54.294 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:39:54.294 INFO:teuthology.orchestra.run.gibba044.stdout: osd scrub load threshold = 5.0 2021-11-12T05:39:54.294 INFO:teuthology.orchestra.run.gibba044.stdout: osd scrub max interval = 600 2021-11-12T05:39:54.294 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:39:54.294 INFO:teuthology.orchestra.run.gibba044.stdout: osd recover clone overlap = true 2021-11-12T05:39:54.295 INFO:teuthology.orchestra.run.gibba044.stdout: osd recovery max chunk = 1048576 2021-11-12T05:39:54.295 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:39:54.295 INFO:teuthology.orchestra.run.gibba044.stdout: osd debug shutdown = true 2021-11-12T05:39:54.295 INFO:teuthology.orchestra.run.gibba044.stdout: osd debug op order = true 2021-11-12T05:39:54.295 INFO:teuthology.orchestra.run.gibba044.stdout: osd debug verify stray on activate = true 2021-11-12T05:39:54.296 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:39:54.296 INFO:teuthology.orchestra.run.gibba044.stdout: osd open classes on start = true 2021-11-12T05:39:54.296 INFO:teuthology.orchestra.run.gibba044.stdout: osd debug pg log writeout = true 2021-11-12T05:39:54.296 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:39:54.297 INFO:teuthology.orchestra.run.gibba044.stdout: osd deep scrub update digest min age = 30 2021-11-12T05:39:54.297 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:39:54.297 INFO:teuthology.orchestra.run.gibba044.stdout: osd map max advance = 10 2021-11-12T05:39:54.297 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:39:54.297 INFO:teuthology.orchestra.run.gibba044.stdout: journal zero on create = true 2021-11-12T05:39:54.298 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:39:54.298 INFO:teuthology.orchestra.run.gibba044.stdout: filestore ondisk finisher threads = 3 2021-11-12T05:39:54.298 INFO:teuthology.orchestra.run.gibba044.stdout: filestore apply finisher threads = 3 2021-11-12T05:39:54.298 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:39:54.298 INFO:teuthology.orchestra.run.gibba044.stdout: bdev debug aio = true 2021-11-12T05:39:54.299 INFO:teuthology.orchestra.run.gibba044.stdout: osd debug misdirected ops = true 2021-11-12T05:39:54.299 INFO:teuthology.orchestra.run.gibba044.stdout: bluestore block size = 96636764160 2021-11-12T05:39:54.299 INFO:teuthology.orchestra.run.gibba044.stdout: bluestore compression mode = aggressive 2021-11-12T05:39:54.299 INFO:teuthology.orchestra.run.gibba044.stdout: bluestore fsck on mount = True 2021-11-12T05:39:54.299 INFO:teuthology.orchestra.run.gibba044.stdout: debug bluefs = 20 2021-11-12T05:39:54.300 INFO:teuthology.orchestra.run.gibba044.stdout: debug bluestore = 20 2021-11-12T05:39:54.300 INFO:teuthology.orchestra.run.gibba044.stdout: debug ms = 1 2021-11-12T05:39:54.300 INFO:teuthology.orchestra.run.gibba044.stdout: debug osd = 20 2021-11-12T05:39:54.300 INFO:teuthology.orchestra.run.gibba044.stdout: debug rocksdb = 10 2021-11-12T05:39:54.301 INFO:teuthology.orchestra.run.gibba044.stdout: mon osd backfillfull_ratio = 0.85 2021-11-12T05:39:54.301 INFO:teuthology.orchestra.run.gibba044.stdout: mon osd full ratio = 0.9 2021-11-12T05:39:54.301 INFO:teuthology.orchestra.run.gibba044.stdout: mon osd nearfull ratio = 0.8 2021-11-12T05:39:54.302 INFO:teuthology.orchestra.run.gibba044.stdout: osd failsafe full ratio = 0.95 2021-11-12T05:39:54.302 INFO:teuthology.orchestra.run.gibba044.stdout: osd objectstore = bluestore 2021-11-12T05:39:54.302 INFO:teuthology.orchestra.run.gibba044.stdout: osd op complaint time = 180 2021-11-12T05:39:54.302 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:39:54.303 INFO:teuthology.orchestra.run.gibba044.stdout:[mgr] 2021-11-12T05:39:54.303 INFO:teuthology.orchestra.run.gibba044.stdout: debug ms = 1 2021-11-12T05:39:54.303 INFO:teuthology.orchestra.run.gibba044.stdout: debug mgr = 20 2021-11-12T05:39:54.303 INFO:teuthology.orchestra.run.gibba044.stdout: debug mon = 20 2021-11-12T05:39:54.303 INFO:teuthology.orchestra.run.gibba044.stdout: debug auth = 20 2021-11-12T05:39:54.304 INFO:teuthology.orchestra.run.gibba044.stdout: mon reweight min pgs per osd = 4 2021-11-12T05:39:54.304 INFO:teuthology.orchestra.run.gibba044.stdout: mon reweight min bytes per osd = 10 2021-11-12T05:39:54.304 INFO:teuthology.orchestra.run.gibba044.stdout: mgr/telemetry/nag = false 2021-11-12T05:39:54.304 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:39:54.304 INFO:teuthology.orchestra.run.gibba044.stdout:[mon] 2021-11-12T05:39:54.305 INFO:teuthology.orchestra.run.gibba044.stdout: debug ms = 1 2021-11-12T05:39:54.305 INFO:teuthology.orchestra.run.gibba044.stdout: debug mon = 20 2021-11-12T05:39:54.305 INFO:teuthology.orchestra.run.gibba044.stdout: debug paxos = 20 2021-11-12T05:39:54.305 INFO:teuthology.orchestra.run.gibba044.stdout: debug auth = 20 2021-11-12T05:39:54.306 INFO:teuthology.orchestra.run.gibba044.stdout: mon data avail warn = 5 2021-11-12T05:39:54.306 INFO:teuthology.orchestra.run.gibba044.stdout: mon mgr mkfs grace = 240 2021-11-12T05:39:54.306 INFO:teuthology.orchestra.run.gibba044.stdout: mon reweight min pgs per osd = 4 2021-11-12T05:39:54.306 INFO:teuthology.orchestra.run.gibba044.stdout: mon osd reporter subtree level = osd 2021-11-12T05:39:54.306 INFO:teuthology.orchestra.run.gibba044.stdout: mon osd prime pg temp = true 2021-11-12T05:39:54.307 INFO:teuthology.orchestra.run.gibba044.stdout: mon reweight min bytes per osd = 10 2021-11-12T05:39:54.307 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:39:54.307 INFO:teuthology.orchestra.run.gibba044.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-12T05:39:54.307 INFO:teuthology.orchestra.run.gibba044.stdout: auth mon ticket ttl = 660 # 11m 2021-11-12T05:39:54.307 INFO:teuthology.orchestra.run.gibba044.stdout: auth service ticket ttl = 240 # 4m 2021-11-12T05:39:54.308 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:39:54.308 INFO:teuthology.orchestra.run.gibba044.stdout: # don't complain about insecure global_id in the test suite 2021-11-12T05:39:54.308 INFO:teuthology.orchestra.run.gibba044.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-12T05:39:54.308 INFO:teuthology.orchestra.run.gibba044.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-12T05:39:54.309 INFO:teuthology.orchestra.run.gibba044.stdout: mon op complaint time = 120 2021-11-12T05:39:54.309 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:39:54.309 INFO:teuthology.orchestra.run.gibba044.stdout:[client] 2021-11-12T05:39:54.309 INFO:teuthology.orchestra.run.gibba044.stdout: rgw cache enabled = true 2021-11-12T05:39:54.310 INFO:teuthology.orchestra.run.gibba044.stdout: rgw enable ops log = true 2021-11-12T05:39:54.310 INFO:teuthology.orchestra.run.gibba044.stdout: rgw enable usage log = true 2021-11-12T05:39:54.310 INFO:teuthology.orchestra.run.gibba044.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-12T05:39:54.310 INFO:teuthology.orchestra.run.gibba044.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-12T05:39:54.311 INFO:teuthology.orchestra.run.gibba044.stdout: client mount timeout = 600 2021-11-12T05:39:54.311 INFO:teuthology.orchestra.run.gibba044.stdout: debug client = 20 2021-11-12T05:39:54.311 INFO:teuthology.orchestra.run.gibba044.stdout: debug ms = 1 2021-11-12T05:39:54.311 INFO:teuthology.orchestra.run.gibba044.stdout: rados mon op timeout = 15m 2021-11-12T05:39:54.311 INFO:teuthology.orchestra.run.gibba044.stdout: rados osd op timeout = 15m 2021-11-12T05:39:54.312 INFO:teuthology.orchestra.run.gibba044.stdout:[mon.a] 2021-11-12T05:39:54.313 INFO:teuthology.orchestra.run.gibba044.stdout:[mon.b] 2021-11-12T05:39:54.313 INFO:teuthology.orchestra.run.gibba044.stdout:[mon.c] 2021-11-12T05:39:54.313 INFO:teuthology.orchestra.run.gibba044.stdout:[mds.a] 2021-11-12T05:39:54.313 INFO:teuthology.orchestra.run.gibba044.stdout:[mds.b] 2021-11-12T05:39:54.314 INFO:teuthology.orchestra.run.gibba044.stdout:[mds] 2021-11-12T05:39:54.314 INFO:teuthology.orchestra.run.gibba044.stdout: debug mds = 20 2021-11-12T05:39:54.314 INFO:teuthology.orchestra.run.gibba044.stdout: debug ms = 1 2021-11-12T05:39:54.314 INFO:teuthology.orchestra.run.gibba044.stdout: mds bal frag = True 2021-11-12T05:39:54.314 INFO:teuthology.orchestra.run.gibba044.stdout: mds bal fragment size max = 10000 2021-11-12T05:39:54.315 INFO:teuthology.orchestra.run.gibba044.stdout: mds bal merge size = 5 2021-11-12T05:39:54.315 INFO:teuthology.orchestra.run.gibba044.stdout: mds bal split bits = 3 2021-11-12T05:39:54.315 INFO:teuthology.orchestra.run.gibba044.stdout: mds bal split size = 100 2021-11-12T05:39:54.315 INFO:teuthology.orchestra.run.gibba044.stdout: mds debug frag = True 2021-11-12T05:39:54.316 INFO:teuthology.orchestra.run.gibba044.stdout: mds debug scatterstat = True 2021-11-12T05:39:54.316 INFO:teuthology.orchestra.run.gibba044.stdout: mds op complaint time = 180 2021-11-12T05:39:54.316 INFO:teuthology.orchestra.run.gibba044.stdout: mds verify scatter = True 2021-11-12T05:39:54.316 INFO:teuthology.orchestra.run.gibba044.stdout: osd op complaint time = 180 2021-11-12T05:39:54.316 INFO:teuthology.orchestra.run.gibba044.stdout: rados mon op timeout = 15m 2021-11-12T05:39:54.317 INFO:teuthology.orchestra.run.gibba044.stdout: rados osd op timeout = 15m 2021-11-12T05:39:54.317 INFO:teuthology.orchestra.run.gibba038.stdout:[global] 2021-11-12T05:39:54.317 INFO:teuthology.orchestra.run.gibba038.stdout: chdir = "" 2021-11-12T05:39:54.317 INFO:teuthology.orchestra.run.gibba038.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-12T05:39:54.318 INFO:teuthology.orchestra.run.gibba038.stdout: auth supported = cephx 2021-11-12T05:39:54.318 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:39:54.318 INFO:teuthology.orchestra.run.gibba038.stdout: filestore xattr use omap = true 2021-11-12T05:39:54.318 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:39:54.319 INFO:teuthology.orchestra.run.gibba038.stdout: mon clock drift allowed = 1.000 2021-11-12T05:39:54.319 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:39:54.319 INFO:teuthology.orchestra.run.gibba038.stdout: osd crush chooseleaf type = 0 2021-11-12T05:39:54.319 INFO:teuthology.orchestra.run.gibba038.stdout: auth debug = true 2021-11-12T05:39:54.319 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:39:54.320 INFO:teuthology.orchestra.run.gibba038.stdout: ms die on old message = true 2021-11-12T05:39:54.320 INFO:teuthology.orchestra.run.gibba038.stdout: ms die on bug = true 2021-11-12T05:39:54.320 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:39:54.320 INFO:teuthology.orchestra.run.gibba038.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-12T05:39:54.320 INFO:teuthology.orchestra.run.gibba038.stdout: mon pg warn max object skew = 0 2021-11-12T05:39:54.321 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:39:54.321 INFO:teuthology.orchestra.run.gibba038.stdout: # disable pg_autoscaler by default for new pools 2021-11-12T05:39:54.321 INFO:teuthology.orchestra.run.gibba038.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-12T05:39:54.321 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:39:54.322 INFO:teuthology.orchestra.run.gibba038.stdout: osd pool default size = 2 2021-11-12T05:39:54.322 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:39:54.322 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd allow primary affinity = true 2021-11-12T05:39:54.322 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd allow pg remap = true 2021-11-12T05:39:54.322 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on legacy crush tunables = false 2021-11-12T05:39:54.323 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on crush straw calc version zero = false 2021-11-12T05:39:54.323 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on no sortbitwise = false 2021-11-12T05:39:54.323 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on osd down out interval zero = false 2021-11-12T05:39:54.323 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on too few osds = false 2021-11-12T05:39:54.323 INFO:teuthology.orchestra.run.gibba038.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-12T05:39:54.324 INFO:teuthology.orchestra.run.gibba038.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-12T05:39:54.324 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:39:54.324 INFO:teuthology.orchestra.run.gibba038.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-12T05:39:54.324 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:39:54.324 INFO:teuthology.orchestra.run.gibba038.stdout: osd default data pool replay window = 5 2021-11-12T05:39:54.325 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:39:54.325 INFO:teuthology.orchestra.run.gibba038.stdout: mon allow pool delete = true 2021-11-12T05:39:54.325 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:39:54.325 INFO:teuthology.orchestra.run.gibba038.stdout: mon cluster log file level = debug 2021-11-12T05:39:54.326 INFO:teuthology.orchestra.run.gibba038.stdout: debug asserts on shutdown = true 2021-11-12T05:39:54.326 INFO:teuthology.orchestra.run.gibba038.stdout: mon health detail to clog = false 2021-11-12T05:39:54.326 INFO:teuthology.orchestra.run.gibba038.stdout: mon host = "172.21.2.105,172.21.2.115,[v2:172.21.2.115:3301,v1:172.21.2.115:6790]" 2021-11-12T05:39:54.326 INFO:teuthology.orchestra.run.gibba038.stdout: fsid = 22928e10-9f3c-479a-96ca-77d6ddf80f9f 2021-11-12T05:39:54.326 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:39:54.327 INFO:teuthology.orchestra.run.gibba038.stdout:[osd] 2021-11-12T05:39:54.327 INFO:teuthology.orchestra.run.gibba038.stdout: osd journal size = 100 2021-11-12T05:39:54.327 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:39:54.327 INFO:teuthology.orchestra.run.gibba038.stdout: osd scrub load threshold = 5.0 2021-11-12T05:39:54.327 INFO:teuthology.orchestra.run.gibba038.stdout: osd scrub max interval = 600 2021-11-12T05:39:54.328 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:39:54.328 INFO:teuthology.orchestra.run.gibba038.stdout: osd recover clone overlap = true 2021-11-12T05:39:54.328 INFO:teuthology.orchestra.run.gibba038.stdout: osd recovery max chunk = 1048576 2021-11-12T05:39:54.328 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:39:54.328 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug shutdown = true 2021-11-12T05:39:54.329 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug op order = true 2021-11-12T05:39:54.329 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug verify stray on activate = true 2021-11-12T05:39:54.329 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:39:54.329 INFO:teuthology.orchestra.run.gibba038.stdout: osd open classes on start = true 2021-11-12T05:39:54.330 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug pg log writeout = true 2021-11-12T05:39:54.330 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:39:54.330 INFO:teuthology.orchestra.run.gibba038.stdout: osd deep scrub update digest min age = 30 2021-11-12T05:39:54.330 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:39:54.330 INFO:teuthology.orchestra.run.gibba038.stdout: osd map max advance = 10 2021-11-12T05:39:54.331 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:39:54.331 INFO:teuthology.orchestra.run.gibba038.stdout: journal zero on create = true 2021-11-12T05:39:54.331 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:39:54.331 INFO:teuthology.orchestra.run.gibba038.stdout: filestore ondisk finisher threads = 3 2021-11-12T05:39:54.331 INFO:teuthology.orchestra.run.gibba038.stdout: filestore apply finisher threads = 3 2021-11-12T05:39:54.332 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:39:54.332 INFO:teuthology.orchestra.run.gibba038.stdout: bdev debug aio = true 2021-11-12T05:39:54.332 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug misdirected ops = true 2021-11-12T05:39:54.332 INFO:teuthology.orchestra.run.gibba038.stdout: bluestore block size = 96636764160 2021-11-12T05:39:54.332 INFO:teuthology.orchestra.run.gibba038.stdout: bluestore compression mode = aggressive 2021-11-12T05:39:54.333 INFO:teuthology.orchestra.run.gibba038.stdout: bluestore fsck on mount = True 2021-11-12T05:39:54.333 INFO:teuthology.orchestra.run.gibba038.stdout: debug bluefs = 20 2021-11-12T05:39:54.333 INFO:teuthology.orchestra.run.gibba038.stdout: debug bluestore = 20 2021-11-12T05:39:54.333 INFO:teuthology.orchestra.run.gibba038.stdout: debug ms = 1 2021-11-12T05:39:54.333 INFO:teuthology.orchestra.run.gibba038.stdout: debug osd = 20 2021-11-12T05:39:54.334 INFO:teuthology.orchestra.run.gibba038.stdout: debug rocksdb = 10 2021-11-12T05:39:54.334 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd backfillfull_ratio = 0.85 2021-11-12T05:39:54.334 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd full ratio = 0.9 2021-11-12T05:39:54.334 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd nearfull ratio = 0.8 2021-11-12T05:39:54.335 INFO:teuthology.orchestra.run.gibba038.stdout: osd failsafe full ratio = 0.95 2021-11-12T05:39:54.335 INFO:teuthology.orchestra.run.gibba038.stdout: osd objectstore = bluestore 2021-11-12T05:39:54.335 INFO:teuthology.orchestra.run.gibba038.stdout: osd op complaint time = 180 2021-11-12T05:39:54.335 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:39:54.335 INFO:teuthology.orchestra.run.gibba038.stdout:[mgr] 2021-11-12T05:39:54.336 INFO:teuthology.orchestra.run.gibba038.stdout: debug ms = 1 2021-11-12T05:39:54.336 INFO:teuthology.orchestra.run.gibba038.stdout: debug mgr = 20 2021-11-12T05:39:54.336 INFO:teuthology.orchestra.run.gibba038.stdout: debug mon = 20 2021-11-12T05:39:54.336 INFO:teuthology.orchestra.run.gibba038.stdout: debug auth = 20 2021-11-12T05:39:54.336 INFO:teuthology.orchestra.run.gibba038.stdout: mon reweight min pgs per osd = 4 2021-11-12T05:39:54.337 INFO:teuthology.orchestra.run.gibba038.stdout: mon reweight min bytes per osd = 10 2021-11-12T05:39:54.337 INFO:teuthology.orchestra.run.gibba038.stdout: mgr/telemetry/nag = false 2021-11-12T05:39:54.337 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:39:54.337 INFO:teuthology.orchestra.run.gibba038.stdout:[mon] 2021-11-12T05:39:54.337 INFO:teuthology.orchestra.run.gibba038.stdout: debug ms = 1 2021-11-12T05:39:54.338 INFO:teuthology.orchestra.run.gibba038.stdout: debug mon = 20 2021-11-12T05:39:54.338 INFO:teuthology.orchestra.run.gibba038.stdout: debug paxos = 20 2021-11-12T05:39:54.338 INFO:teuthology.orchestra.run.gibba038.stdout: debug auth = 20 2021-11-12T05:39:54.338 INFO:teuthology.orchestra.run.gibba038.stdout: mon data avail warn = 5 2021-11-12T05:39:54.338 INFO:teuthology.orchestra.run.gibba038.stdout: mon mgr mkfs grace = 240 2021-11-12T05:39:54.339 INFO:teuthology.orchestra.run.gibba038.stdout: mon reweight min pgs per osd = 4 2021-11-12T05:39:54.339 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd reporter subtree level = osd 2021-11-12T05:39:54.339 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd prime pg temp = true 2021-11-12T05:39:54.340 INFO:teuthology.orchestra.run.gibba038.stdout: mon reweight min bytes per osd = 10 2021-11-12T05:39:54.340 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:39:54.340 INFO:teuthology.orchestra.run.gibba038.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-12T05:39:54.340 INFO:teuthology.orchestra.run.gibba038.stdout: auth mon ticket ttl = 660 # 11m 2021-11-12T05:39:54.340 INFO:teuthology.orchestra.run.gibba038.stdout: auth service ticket ttl = 240 # 4m 2021-11-12T05:39:54.341 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:39:54.341 INFO:teuthology.orchestra.run.gibba038.stdout: # don't complain about insecure global_id in the test suite 2021-11-12T05:39:54.341 INFO:teuthology.orchestra.run.gibba038.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-12T05:39:54.341 INFO:teuthology.orchestra.run.gibba038.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-12T05:39:54.342 INFO:teuthology.orchestra.run.gibba038.stdout: mon op complaint time = 120 2021-11-12T05:39:54.342 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:39:54.342 INFO:teuthology.orchestra.run.gibba038.stdout:[client] 2021-11-12T05:39:54.342 INFO:teuthology.orchestra.run.gibba038.stdout: rgw cache enabled = true 2021-11-12T05:39:54.342 INFO:teuthology.orchestra.run.gibba038.stdout: rgw enable ops log = true 2021-11-12T05:39:54.343 INFO:teuthology.orchestra.run.gibba038.stdout: rgw enable usage log = true 2021-11-12T05:39:54.343 INFO:teuthology.orchestra.run.gibba038.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-12T05:39:54.343 INFO:teuthology.orchestra.run.gibba038.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-12T05:39:54.343 INFO:teuthology.orchestra.run.gibba038.stdout: client mount timeout = 600 2021-11-12T05:39:54.343 INFO:teuthology.orchestra.run.gibba038.stdout: debug client = 20 2021-11-12T05:39:54.344 INFO:teuthology.orchestra.run.gibba038.stdout: debug ms = 1 2021-11-12T05:39:54.344 INFO:teuthology.orchestra.run.gibba038.stdout: rados mon op timeout = 15m 2021-11-12T05:39:54.344 INFO:teuthology.orchestra.run.gibba038.stdout: rados osd op timeout = 15m 2021-11-12T05:39:54.344 INFO:teuthology.orchestra.run.gibba038.stdout:[mon.a] 2021-11-12T05:39:54.344 INFO:teuthology.orchestra.run.gibba038.stdout:[mon.b] 2021-11-12T05:39:54.345 INFO:teuthology.orchestra.run.gibba038.stdout:[mon.c] 2021-11-12T05:39:54.345 INFO:teuthology.orchestra.run.gibba038.stdout:[mds.a] 2021-11-12T05:39:54.345 INFO:teuthology.orchestra.run.gibba038.stdout:[mds.b] 2021-11-12T05:39:54.345 INFO:teuthology.orchestra.run.gibba038.stdout:[mds] 2021-11-12T05:39:54.345 INFO:teuthology.orchestra.run.gibba038.stdout: debug mds = 20 2021-11-12T05:39:54.346 INFO:teuthology.orchestra.run.gibba038.stdout: debug ms = 1 2021-11-12T05:39:54.346 INFO:teuthology.orchestra.run.gibba038.stdout: mds bal frag = True 2021-11-12T05:39:54.346 INFO:teuthology.orchestra.run.gibba038.stdout: mds bal fragment size max = 10000 2021-11-12T05:39:54.346 INFO:teuthology.orchestra.run.gibba038.stdout: mds bal merge size = 5 2021-11-12T05:39:54.347 INFO:teuthology.orchestra.run.gibba038.stdout: mds bal split bits = 3 2021-11-12T05:39:54.347 INFO:teuthology.orchestra.run.gibba038.stdout: mds bal split size = 100 2021-11-12T05:39:54.347 INFO:teuthology.orchestra.run.gibba038.stdout: mds debug frag = True 2021-11-12T05:39:54.347 INFO:teuthology.orchestra.run.gibba038.stdout: mds debug scatterstat = True 2021-11-12T05:39:54.347 INFO:teuthology.orchestra.run.gibba038.stdout: mds op complaint time = 180 2021-11-12T05:39:54.348 INFO:teuthology.orchestra.run.gibba038.stdout: mds verify scatter = True 2021-11-12T05:39:54.348 INFO:teuthology.orchestra.run.gibba038.stdout: osd op complaint time = 180 2021-11-12T05:39:54.348 INFO:teuthology.orchestra.run.gibba038.stdout: rados mon op timeout = 15m 2021-11-12T05:39:54.348 INFO:teuthology.orchestra.run.gibba038.stdout: rados osd op timeout = 15m 2021-11-12T05:39:54.348 INFO:teuthology.orchestra.run.gibba016.stdout:[global] 2021-11-12T05:39:54.349 INFO:teuthology.orchestra.run.gibba016.stdout: chdir = "" 2021-11-12T05:39:54.349 INFO:teuthology.orchestra.run.gibba016.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-12T05:39:54.349 INFO:teuthology.orchestra.run.gibba016.stdout: auth supported = cephx 2021-11-12T05:39:54.349 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:39:54.350 INFO:teuthology.orchestra.run.gibba016.stdout: filestore xattr use omap = true 2021-11-12T05:39:54.350 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:39:54.350 INFO:teuthology.orchestra.run.gibba016.stdout: mon clock drift allowed = 1.000 2021-11-12T05:39:54.350 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:39:54.350 INFO:teuthology.orchestra.run.gibba016.stdout: osd crush chooseleaf type = 0 2021-11-12T05:39:54.351 INFO:teuthology.orchestra.run.gibba016.stdout: auth debug = true 2021-11-12T05:39:54.351 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:39:54.351 INFO:teuthology.orchestra.run.gibba016.stdout: ms die on old message = true 2021-11-12T05:39:54.351 INFO:teuthology.orchestra.run.gibba016.stdout: ms die on bug = true 2021-11-12T05:39:54.351 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:39:54.352 INFO:teuthology.orchestra.run.gibba016.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-12T05:39:54.352 INFO:teuthology.orchestra.run.gibba016.stdout: mon pg warn max object skew = 0 2021-11-12T05:39:54.352 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:39:54.352 INFO:teuthology.orchestra.run.gibba016.stdout: # disable pg_autoscaler by default for new pools 2021-11-12T05:39:54.353 INFO:teuthology.orchestra.run.gibba016.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-12T05:39:54.353 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:39:54.353 INFO:teuthology.orchestra.run.gibba016.stdout: osd pool default size = 2 2021-11-12T05:39:54.353 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:39:54.353 INFO:teuthology.orchestra.run.gibba016.stdout: mon osd allow primary affinity = true 2021-11-12T05:39:54.354 INFO:teuthology.orchestra.run.gibba016.stdout: mon osd allow pg remap = true 2021-11-12T05:39:54.354 INFO:teuthology.orchestra.run.gibba016.stdout: mon warn on legacy crush tunables = false 2021-11-12T05:39:54.354 INFO:teuthology.orchestra.run.gibba016.stdout: mon warn on crush straw calc version zero = false 2021-11-12T05:39:54.354 INFO:teuthology.orchestra.run.gibba016.stdout: mon warn on no sortbitwise = false 2021-11-12T05:39:54.354 INFO:teuthology.orchestra.run.gibba016.stdout: mon warn on osd down out interval zero = false 2021-11-12T05:39:54.355 INFO:teuthology.orchestra.run.gibba016.stdout: mon warn on too few osds = false 2021-11-12T05:39:54.355 INFO:teuthology.orchestra.run.gibba016.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-12T05:39:54.355 INFO:teuthology.orchestra.run.gibba016.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-12T05:39:54.355 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:39:54.355 INFO:teuthology.orchestra.run.gibba016.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-12T05:39:54.356 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:39:54.356 INFO:teuthology.orchestra.run.gibba016.stdout: osd default data pool replay window = 5 2021-11-12T05:39:54.356 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:39:54.357 INFO:teuthology.orchestra.run.gibba016.stdout: mon allow pool delete = true 2021-11-12T05:39:54.357 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:39:54.357 INFO:teuthology.orchestra.run.gibba016.stdout: mon cluster log file level = debug 2021-11-12T05:39:54.357 INFO:teuthology.orchestra.run.gibba016.stdout: debug asserts on shutdown = true 2021-11-12T05:39:54.357 INFO:teuthology.orchestra.run.gibba016.stdout: mon health detail to clog = false 2021-11-12T05:39:54.358 INFO:teuthology.orchestra.run.gibba016.stdout: mon host = "172.21.2.105,172.21.2.115,[v2:172.21.2.115:3301,v1:172.21.2.115:6790]" 2021-11-12T05:39:54.358 INFO:teuthology.orchestra.run.gibba016.stdout: fsid = 22928e10-9f3c-479a-96ca-77d6ddf80f9f 2021-11-12T05:39:54.358 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:39:54.358 INFO:teuthology.orchestra.run.gibba016.stdout:[osd] 2021-11-12T05:39:54.358 INFO:teuthology.orchestra.run.gibba016.stdout: osd journal size = 100 2021-11-12T05:39:54.359 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:39:54.359 INFO:teuthology.orchestra.run.gibba016.stdout: osd scrub load threshold = 5.0 2021-11-12T05:39:54.359 INFO:teuthology.orchestra.run.gibba016.stdout: osd scrub max interval = 600 2021-11-12T05:39:54.359 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:39:54.359 INFO:teuthology.orchestra.run.gibba016.stdout: osd recover clone overlap = true 2021-11-12T05:39:54.360 INFO:teuthology.orchestra.run.gibba016.stdout: osd recovery max chunk = 1048576 2021-11-12T05:39:54.360 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:39:54.360 INFO:teuthology.orchestra.run.gibba016.stdout: osd debug shutdown = true 2021-11-12T05:39:54.360 INFO:teuthology.orchestra.run.gibba016.stdout: osd debug op order = true 2021-11-12T05:39:54.361 INFO:teuthology.orchestra.run.gibba016.stdout: osd debug verify stray on activate = true 2021-11-12T05:39:54.361 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:39:54.361 INFO:teuthology.orchestra.run.gibba016.stdout: osd open classes on start = true 2021-11-12T05:39:54.361 INFO:teuthology.orchestra.run.gibba016.stdout: osd debug pg log writeout = true 2021-11-12T05:39:54.361 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:39:54.362 INFO:teuthology.orchestra.run.gibba016.stdout: osd deep scrub update digest min age = 30 2021-11-12T05:39:54.362 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:39:54.362 INFO:teuthology.orchestra.run.gibba016.stdout: osd map max advance = 10 2021-11-12T05:39:54.362 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:39:54.362 INFO:teuthology.orchestra.run.gibba016.stdout: journal zero on create = true 2021-11-12T05:39:54.363 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:39:54.363 INFO:teuthology.orchestra.run.gibba016.stdout: filestore ondisk finisher threads = 3 2021-11-12T05:39:54.363 INFO:teuthology.orchestra.run.gibba016.stdout: filestore apply finisher threads = 3 2021-11-12T05:39:54.363 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:39:54.363 INFO:teuthology.orchestra.run.gibba016.stdout: bdev debug aio = true 2021-11-12T05:39:54.364 INFO:teuthology.orchestra.run.gibba016.stdout: osd debug misdirected ops = true 2021-11-12T05:39:54.364 INFO:teuthology.orchestra.run.gibba016.stdout: bluestore block size = 96636764160 2021-11-12T05:39:54.364 INFO:teuthology.orchestra.run.gibba016.stdout: bluestore compression mode = aggressive 2021-11-12T05:39:54.364 INFO:teuthology.orchestra.run.gibba016.stdout: bluestore fsck on mount = True 2021-11-12T05:39:54.365 INFO:teuthology.orchestra.run.gibba016.stdout: debug bluefs = 20 2021-11-12T05:39:54.365 INFO:teuthology.orchestra.run.gibba016.stdout: debug bluestore = 20 2021-11-12T05:39:54.365 INFO:teuthology.orchestra.run.gibba016.stdout: debug ms = 1 2021-11-12T05:39:54.365 INFO:teuthology.orchestra.run.gibba016.stdout: debug osd = 20 2021-11-12T05:39:54.365 INFO:teuthology.orchestra.run.gibba016.stdout: debug rocksdb = 10 2021-11-12T05:39:54.366 INFO:teuthology.orchestra.run.gibba016.stdout: mon osd backfillfull_ratio = 0.85 2021-11-12T05:39:54.366 INFO:teuthology.orchestra.run.gibba016.stdout: mon osd full ratio = 0.9 2021-11-12T05:39:54.366 INFO:teuthology.orchestra.run.gibba016.stdout: mon osd nearfull ratio = 0.8 2021-11-12T05:39:54.366 INFO:teuthology.orchestra.run.gibba016.stdout: osd failsafe full ratio = 0.95 2021-11-12T05:39:54.366 INFO:teuthology.orchestra.run.gibba016.stdout: osd objectstore = bluestore 2021-11-12T05:39:54.367 INFO:teuthology.orchestra.run.gibba016.stdout: osd op complaint time = 180 2021-11-12T05:39:54.367 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:39:54.367 INFO:teuthology.orchestra.run.gibba016.stdout:[mgr] 2021-11-12T05:39:54.367 INFO:teuthology.orchestra.run.gibba016.stdout: debug ms = 1 2021-11-12T05:39:54.367 INFO:teuthology.orchestra.run.gibba016.stdout: debug mgr = 20 2021-11-12T05:39:54.368 INFO:teuthology.orchestra.run.gibba016.stdout: debug mon = 20 2021-11-12T05:39:54.368 INFO:teuthology.orchestra.run.gibba016.stdout: debug auth = 20 2021-11-12T05:39:54.368 INFO:teuthology.orchestra.run.gibba016.stdout: mon reweight min pgs per osd = 4 2021-11-12T05:39:54.368 INFO:teuthology.orchestra.run.gibba016.stdout: mon reweight min bytes per osd = 10 2021-11-12T05:39:54.368 INFO:teuthology.orchestra.run.gibba016.stdout: mgr/telemetry/nag = false 2021-11-12T05:39:54.369 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:39:54.369 INFO:teuthology.orchestra.run.gibba016.stdout:[mon] 2021-11-12T05:39:54.369 INFO:teuthology.orchestra.run.gibba016.stdout: debug ms = 1 2021-11-12T05:39:54.369 INFO:teuthology.orchestra.run.gibba016.stdout: debug mon = 20 2021-11-12T05:39:54.369 INFO:teuthology.orchestra.run.gibba016.stdout: debug paxos = 20 2021-11-12T05:39:54.370 INFO:teuthology.orchestra.run.gibba016.stdout: debug auth = 20 2021-11-12T05:39:54.370 INFO:teuthology.orchestra.run.gibba016.stdout: mon data avail warn = 5 2021-11-12T05:39:54.370 INFO:teuthology.orchestra.run.gibba016.stdout: mon mgr mkfs grace = 240 2021-11-12T05:39:54.370 INFO:teuthology.orchestra.run.gibba016.stdout: mon reweight min pgs per osd = 4 2021-11-12T05:39:54.371 INFO:teuthology.orchestra.run.gibba016.stdout: mon osd reporter subtree level = osd 2021-11-12T05:39:54.371 INFO:teuthology.orchestra.run.gibba016.stdout: mon osd prime pg temp = true 2021-11-12T05:39:54.371 INFO:teuthology.orchestra.run.gibba016.stdout: mon reweight min bytes per osd = 10 2021-11-12T05:39:54.371 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:39:54.371 INFO:teuthology.orchestra.run.gibba016.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-12T05:39:54.372 INFO:teuthology.orchestra.run.gibba016.stdout: auth mon ticket ttl = 660 # 11m 2021-11-12T05:39:54.372 INFO:teuthology.orchestra.run.gibba016.stdout: auth service ticket ttl = 240 # 4m 2021-11-12T05:39:54.372 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:39:54.372 INFO:teuthology.orchestra.run.gibba016.stdout: # don't complain about insecure global_id in the test suite 2021-11-12T05:39:54.372 INFO:teuthology.orchestra.run.gibba016.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-12T05:39:54.373 INFO:teuthology.orchestra.run.gibba016.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-12T05:39:54.373 INFO:teuthology.orchestra.run.gibba016.stdout: mon op complaint time = 120 2021-11-12T05:39:54.373 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:39:54.373 INFO:teuthology.orchestra.run.gibba016.stdout:[client] 2021-11-12T05:39:54.373 INFO:teuthology.orchestra.run.gibba016.stdout: rgw cache enabled = true 2021-11-12T05:39:54.374 INFO:teuthology.orchestra.run.gibba016.stdout: rgw enable ops log = true 2021-11-12T05:39:54.374 INFO:teuthology.orchestra.run.gibba016.stdout: rgw enable usage log = true 2021-11-12T05:39:54.374 INFO:teuthology.orchestra.run.gibba016.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-12T05:39:54.374 INFO:teuthology.orchestra.run.gibba016.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-12T05:39:54.374 INFO:teuthology.orchestra.run.gibba016.stdout: client mount timeout = 600 2021-11-12T05:39:54.375 INFO:teuthology.orchestra.run.gibba016.stdout: debug client = 20 2021-11-12T05:39:54.375 INFO:teuthology.orchestra.run.gibba016.stdout: debug ms = 1 2021-11-12T05:39:54.375 INFO:teuthology.orchestra.run.gibba016.stdout: rados mon op timeout = 15m 2021-11-12T05:39:54.375 INFO:teuthology.orchestra.run.gibba016.stdout: rados osd op timeout = 15m 2021-11-12T05:39:54.375 INFO:teuthology.orchestra.run.gibba016.stdout:[mon.a] 2021-11-12T05:39:54.376 INFO:teuthology.orchestra.run.gibba016.stdout:[mon.b] 2021-11-12T05:39:54.376 INFO:teuthology.orchestra.run.gibba016.stdout:[mon.c] 2021-11-12T05:39:54.376 INFO:teuthology.orchestra.run.gibba016.stdout:[mds.a] 2021-11-12T05:39:54.376 INFO:teuthology.orchestra.run.gibba016.stdout:[mds.b] 2021-11-12T05:39:54.376 INFO:teuthology.orchestra.run.gibba016.stdout:[mds] 2021-11-12T05:39:54.377 INFO:teuthology.orchestra.run.gibba016.stdout: debug mds = 20 2021-11-12T05:39:54.377 INFO:teuthology.orchestra.run.gibba016.stdout: debug ms = 1 2021-11-12T05:39:54.377 INFO:teuthology.orchestra.run.gibba016.stdout: mds bal frag = True 2021-11-12T05:39:54.377 INFO:teuthology.orchestra.run.gibba016.stdout: mds bal fragment size max = 10000 2021-11-12T05:39:54.378 INFO:teuthology.orchestra.run.gibba016.stdout: mds bal merge size = 5 2021-11-12T05:39:54.378 INFO:teuthology.orchestra.run.gibba016.stdout: mds bal split bits = 3 2021-11-12T05:39:54.378 INFO:teuthology.orchestra.run.gibba016.stdout: mds bal split size = 100 2021-11-12T05:39:54.378 INFO:teuthology.orchestra.run.gibba016.stdout: mds debug frag = True 2021-11-12T05:39:54.378 INFO:teuthology.orchestra.run.gibba016.stdout: mds debug scatterstat = True 2021-11-12T05:39:54.379 INFO:teuthology.orchestra.run.gibba016.stdout: mds op complaint time = 180 2021-11-12T05:39:54.379 INFO:teuthology.orchestra.run.gibba016.stdout: mds verify scatter = True 2021-11-12T05:39:54.379 INFO:teuthology.orchestra.run.gibba016.stdout: osd op complaint time = 180 2021-11-12T05:39:54.379 INFO:teuthology.orchestra.run.gibba016.stdout: rados mon op timeout = 15m 2021-11-12T05:39:54.379 INFO:teuthology.orchestra.run.gibba016.stdout: rados osd op timeout = 15m 2021-11-12T05:39:54.380 INFO:teuthology.orchestra.run.gibba015.stdout:[global] 2021-11-12T05:39:54.380 INFO:teuthology.orchestra.run.gibba015.stdout: chdir = "" 2021-11-12T05:39:54.380 INFO:teuthology.orchestra.run.gibba015.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-12T05:39:54.380 INFO:teuthology.orchestra.run.gibba015.stdout: auth supported = cephx 2021-11-12T05:39:54.381 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:39:54.381 INFO:teuthology.orchestra.run.gibba015.stdout: filestore xattr use omap = true 2021-11-12T05:39:54.381 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:39:54.381 INFO:teuthology.orchestra.run.gibba015.stdout: mon clock drift allowed = 1.000 2021-11-12T05:39:54.381 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:39:54.382 INFO:teuthology.orchestra.run.gibba015.stdout: osd crush chooseleaf type = 0 2021-11-12T05:39:54.382 INFO:teuthology.orchestra.run.gibba015.stdout: auth debug = true 2021-11-12T05:39:54.382 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:39:54.382 INFO:teuthology.orchestra.run.gibba015.stdout: ms die on old message = true 2021-11-12T05:39:54.382 INFO:teuthology.orchestra.run.gibba015.stdout: ms die on bug = true 2021-11-12T05:39:54.383 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:39:54.383 INFO:teuthology.orchestra.run.gibba015.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-12T05:39:54.383 INFO:teuthology.orchestra.run.gibba015.stdout: mon pg warn max object skew = 0 2021-11-12T05:39:54.383 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:39:54.384 INFO:teuthology.orchestra.run.gibba015.stdout: # disable pg_autoscaler by default for new pools 2021-11-12T05:39:54.384 INFO:teuthology.orchestra.run.gibba015.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-12T05:39:54.384 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:39:54.384 INFO:teuthology.orchestra.run.gibba015.stdout: osd pool default size = 2 2021-11-12T05:39:54.384 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:39:54.385 INFO:teuthology.orchestra.run.gibba015.stdout: mon osd allow primary affinity = true 2021-11-12T05:39:54.385 INFO:teuthology.orchestra.run.gibba015.stdout: mon osd allow pg remap = true 2021-11-12T05:39:54.385 INFO:teuthology.orchestra.run.gibba015.stdout: mon warn on legacy crush tunables = false 2021-11-12T05:39:54.385 INFO:teuthology.orchestra.run.gibba015.stdout: mon warn on crush straw calc version zero = false 2021-11-12T05:39:54.385 INFO:teuthology.orchestra.run.gibba015.stdout: mon warn on no sortbitwise = false 2021-11-12T05:39:54.386 INFO:teuthology.orchestra.run.gibba015.stdout: mon warn on osd down out interval zero = false 2021-11-12T05:39:54.386 INFO:teuthology.orchestra.run.gibba015.stdout: mon warn on too few osds = false 2021-11-12T05:39:54.386 INFO:teuthology.orchestra.run.gibba015.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-12T05:39:54.386 INFO:teuthology.orchestra.run.gibba015.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-12T05:39:54.386 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:39:54.387 INFO:teuthology.orchestra.run.gibba015.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-12T05:39:54.387 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:39:54.387 INFO:teuthology.orchestra.run.gibba015.stdout: osd default data pool replay window = 5 2021-11-12T05:39:54.387 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:39:54.387 INFO:teuthology.orchestra.run.gibba015.stdout: mon allow pool delete = true 2021-11-12T05:39:54.388 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:39:54.388 INFO:teuthology.orchestra.run.gibba015.stdout: mon cluster log file level = debug 2021-11-12T05:39:54.388 INFO:teuthology.orchestra.run.gibba015.stdout: debug asserts on shutdown = true 2021-11-12T05:39:54.388 INFO:teuthology.orchestra.run.gibba015.stdout: mon health detail to clog = false 2021-11-12T05:39:54.389 INFO:teuthology.orchestra.run.gibba015.stdout: mon host = "172.21.2.105,172.21.2.115,[v2:172.21.2.115:3301,v1:172.21.2.115:6790]" 2021-11-12T05:39:54.389 INFO:teuthology.orchestra.run.gibba015.stdout: fsid = 22928e10-9f3c-479a-96ca-77d6ddf80f9f 2021-11-12T05:39:54.389 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:39:54.389 INFO:teuthology.orchestra.run.gibba015.stdout:[osd] 2021-11-12T05:39:54.389 INFO:teuthology.orchestra.run.gibba015.stdout: osd journal size = 100 2021-11-12T05:39:54.390 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:39:54.390 INFO:teuthology.orchestra.run.gibba015.stdout: osd scrub load threshold = 5.0 2021-11-12T05:39:54.390 INFO:teuthology.orchestra.run.gibba015.stdout: osd scrub max interval = 600 2021-11-12T05:39:54.390 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:39:54.390 INFO:teuthology.orchestra.run.gibba015.stdout: osd recover clone overlap = true 2021-11-12T05:39:54.391 INFO:teuthology.orchestra.run.gibba015.stdout: osd recovery max chunk = 1048576 2021-11-12T05:39:54.391 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:39:54.391 INFO:teuthology.orchestra.run.gibba015.stdout: osd debug shutdown = true 2021-11-12T05:39:54.391 INFO:teuthology.orchestra.run.gibba015.stdout: osd debug op order = true 2021-11-12T05:39:54.391 INFO:teuthology.orchestra.run.gibba015.stdout: osd debug verify stray on activate = true 2021-11-12T05:39:54.392 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:39:54.392 INFO:teuthology.orchestra.run.gibba015.stdout: osd open classes on start = true 2021-11-12T05:39:54.392 INFO:teuthology.orchestra.run.gibba015.stdout: osd debug pg log writeout = true 2021-11-12T05:39:54.392 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:39:54.392 INFO:teuthology.orchestra.run.gibba015.stdout: osd deep scrub update digest min age = 30 2021-11-12T05:39:54.393 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:39:54.393 INFO:teuthology.orchestra.run.gibba015.stdout: osd map max advance = 10 2021-11-12T05:39:54.393 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:39:54.393 INFO:teuthology.orchestra.run.gibba015.stdout: journal zero on create = true 2021-11-12T05:39:54.394 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:39:54.394 INFO:teuthology.orchestra.run.gibba015.stdout: filestore ondisk finisher threads = 3 2021-11-12T05:39:54.394 INFO:teuthology.orchestra.run.gibba015.stdout: filestore apply finisher threads = 3 2021-11-12T05:39:54.394 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:39:54.394 INFO:teuthology.orchestra.run.gibba015.stdout: bdev debug aio = true 2021-11-12T05:39:54.395 INFO:teuthology.orchestra.run.gibba015.stdout: osd debug misdirected ops = true 2021-11-12T05:39:54.395 INFO:teuthology.orchestra.run.gibba015.stdout: bluestore block size = 96636764160 2021-11-12T05:39:54.395 INFO:teuthology.orchestra.run.gibba015.stdout: bluestore compression mode = aggressive 2021-11-12T05:39:54.395 INFO:teuthology.orchestra.run.gibba015.stdout: bluestore fsck on mount = True 2021-11-12T05:39:54.395 INFO:teuthology.orchestra.run.gibba015.stdout: debug bluefs = 20 2021-11-12T05:39:54.396 INFO:teuthology.orchestra.run.gibba015.stdout: debug bluestore = 20 2021-11-12T05:39:54.396 INFO:teuthology.orchestra.run.gibba015.stdout: debug ms = 1 2021-11-12T05:39:54.396 INFO:teuthology.orchestra.run.gibba015.stdout: debug osd = 20 2021-11-12T05:39:54.396 INFO:teuthology.orchestra.run.gibba015.stdout: debug rocksdb = 10 2021-11-12T05:39:54.396 INFO:teuthology.orchestra.run.gibba015.stdout: mon osd backfillfull_ratio = 0.85 2021-11-12T05:39:54.397 INFO:teuthology.orchestra.run.gibba015.stdout: mon osd full ratio = 0.9 2021-11-12T05:39:54.397 INFO:teuthology.orchestra.run.gibba015.stdout: mon osd nearfull ratio = 0.8 2021-11-12T05:39:54.397 INFO:teuthology.orchestra.run.gibba015.stdout: osd failsafe full ratio = 0.95 2021-11-12T05:39:54.397 INFO:teuthology.orchestra.run.gibba015.stdout: osd objectstore = bluestore 2021-11-12T05:39:54.397 INFO:teuthology.orchestra.run.gibba015.stdout: osd op complaint time = 180 2021-11-12T05:39:54.398 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:39:54.398 INFO:teuthology.orchestra.run.gibba015.stdout:[mgr] 2021-11-12T05:39:54.398 INFO:teuthology.orchestra.run.gibba015.stdout: debug ms = 1 2021-11-12T05:39:54.398 INFO:teuthology.orchestra.run.gibba015.stdout: debug mgr = 20 2021-11-12T05:39:54.398 INFO:teuthology.orchestra.run.gibba015.stdout: debug mon = 20 2021-11-12T05:39:54.399 INFO:teuthology.orchestra.run.gibba015.stdout: debug auth = 20 2021-11-12T05:39:54.399 INFO:teuthology.orchestra.run.gibba015.stdout: mon reweight min pgs per osd = 4 2021-11-12T05:39:54.399 INFO:teuthology.orchestra.run.gibba015.stdout: mon reweight min bytes per osd = 10 2021-11-12T05:39:54.399 INFO:teuthology.orchestra.run.gibba015.stdout: mgr/telemetry/nag = false 2021-11-12T05:39:54.400 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:39:54.400 INFO:teuthology.orchestra.run.gibba015.stdout:[mon] 2021-11-12T05:39:54.400 INFO:teuthology.orchestra.run.gibba015.stdout: debug ms = 1 2021-11-12T05:39:54.400 INFO:teuthology.orchestra.run.gibba015.stdout: debug mon = 20 2021-11-12T05:39:54.400 INFO:teuthology.orchestra.run.gibba015.stdout: debug paxos = 20 2021-11-12T05:39:54.401 INFO:teuthology.orchestra.run.gibba015.stdout: debug auth = 20 2021-11-12T05:39:54.401 INFO:teuthology.orchestra.run.gibba015.stdout: mon data avail warn = 5 2021-11-12T05:39:54.401 INFO:teuthology.orchestra.run.gibba015.stdout: mon mgr mkfs grace = 240 2021-11-12T05:39:54.401 INFO:teuthology.orchestra.run.gibba015.stdout: mon reweight min pgs per osd = 4 2021-11-12T05:39:54.401 INFO:teuthology.orchestra.run.gibba015.stdout: mon osd reporter subtree level = osd 2021-11-12T05:39:54.402 INFO:teuthology.orchestra.run.gibba015.stdout: mon osd prime pg temp = true 2021-11-12T05:39:54.402 INFO:teuthology.orchestra.run.gibba015.stdout: mon reweight min bytes per osd = 10 2021-11-12T05:39:54.402 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:39:54.402 INFO:teuthology.orchestra.run.gibba015.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-12T05:39:54.402 INFO:teuthology.orchestra.run.gibba015.stdout: auth mon ticket ttl = 660 # 11m 2021-11-12T05:39:54.403 INFO:teuthology.orchestra.run.gibba015.stdout: auth service ticket ttl = 240 # 4m 2021-11-12T05:39:54.403 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:39:54.403 INFO:teuthology.orchestra.run.gibba015.stdout: # don't complain about insecure global_id in the test suite 2021-11-12T05:39:54.403 INFO:teuthology.orchestra.run.gibba015.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-12T05:39:54.404 INFO:teuthology.orchestra.run.gibba015.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-12T05:39:54.404 INFO:teuthology.orchestra.run.gibba015.stdout: mon op complaint time = 120 2021-11-12T05:39:54.404 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:39:54.404 INFO:teuthology.orchestra.run.gibba015.stdout:[client] 2021-11-12T05:39:54.404 INFO:teuthology.orchestra.run.gibba015.stdout: rgw cache enabled = true 2021-11-12T05:39:54.405 INFO:teuthology.orchestra.run.gibba015.stdout: rgw enable ops log = true 2021-11-12T05:39:54.405 INFO:teuthology.orchestra.run.gibba015.stdout: rgw enable usage log = true 2021-11-12T05:39:54.405 INFO:teuthology.orchestra.run.gibba015.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-12T05:39:54.405 INFO:teuthology.orchestra.run.gibba015.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-12T05:39:54.405 INFO:teuthology.orchestra.run.gibba015.stdout: client mount timeout = 600 2021-11-12T05:39:54.406 INFO:teuthology.orchestra.run.gibba015.stdout: debug client = 20 2021-11-12T05:39:54.406 INFO:teuthology.orchestra.run.gibba015.stdout: debug ms = 1 2021-11-12T05:39:54.406 INFO:teuthology.orchestra.run.gibba015.stdout: rados mon op timeout = 15m 2021-11-12T05:39:54.406 INFO:teuthology.orchestra.run.gibba015.stdout: rados osd op timeout = 15m 2021-11-12T05:39:54.406 INFO:teuthology.orchestra.run.gibba015.stdout:[mon.a] 2021-11-12T05:39:54.407 INFO:teuthology.orchestra.run.gibba015.stdout:[mon.b] 2021-11-12T05:39:54.407 INFO:teuthology.orchestra.run.gibba015.stdout:[mon.c] 2021-11-12T05:39:54.407 INFO:teuthology.orchestra.run.gibba015.stdout:[mds.a] 2021-11-12T05:39:54.407 INFO:teuthology.orchestra.run.gibba015.stdout:[mds.b] 2021-11-12T05:39:54.408 INFO:teuthology.orchestra.run.gibba015.stdout:[mds] 2021-11-12T05:39:54.408 INFO:teuthology.orchestra.run.gibba015.stdout: debug mds = 20 2021-11-12T05:39:54.408 INFO:teuthology.orchestra.run.gibba015.stdout: debug ms = 1 2021-11-12T05:39:54.408 INFO:teuthology.orchestra.run.gibba015.stdout: mds bal frag = True 2021-11-12T05:39:54.408 INFO:teuthology.orchestra.run.gibba015.stdout: mds bal fragment size max = 10000 2021-11-12T05:39:54.409 INFO:teuthology.orchestra.run.gibba015.stdout: mds bal merge size = 5 2021-11-12T05:39:54.409 INFO:teuthology.orchestra.run.gibba015.stdout: mds bal split bits = 3 2021-11-12T05:39:54.409 INFO:teuthology.orchestra.run.gibba015.stdout: mds bal split size = 100 2021-11-12T05:39:54.409 INFO:teuthology.orchestra.run.gibba015.stdout: mds debug frag = True 2021-11-12T05:39:54.409 INFO:teuthology.orchestra.run.gibba015.stdout: mds debug scatterstat = True 2021-11-12T05:39:54.410 INFO:teuthology.orchestra.run.gibba015.stdout: mds op complaint time = 180 2021-11-12T05:39:54.410 INFO:teuthology.orchestra.run.gibba015.stdout: mds verify scatter = True 2021-11-12T05:39:54.410 INFO:teuthology.orchestra.run.gibba015.stdout: osd op complaint time = 180 2021-11-12T05:39:54.410 INFO:teuthology.orchestra.run.gibba015.stdout: rados mon op timeout = 15m 2021-11-12T05:39:54.410 INFO:teuthology.orchestra.run.gibba015.stdout: rados osd op timeout = 15m 2021-11-12T05:39:54.411 INFO:tasks.ceph:Creating admin key on mon.a... 2021-11-12T05:39:54.411 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2021-11-12T05:39:54.488 INFO:tasks.ceph:Copying monmap to all nodes... 2021-11-12T05:39:54.497 DEBUG:teuthology.orchestra.remote:gibba005:/etc/ceph/ceph.keyring is 206B 2021-11-12T05:39:54.554 DEBUG:teuthology.orchestra.remote:gibba005:/home/ubuntu/cephtest/ceph.monmap is 379B 2021-11-12T05:39:54.571 INFO:tasks.ceph:Sending monmap to node ubuntu@gibba005.front.sepia.ceph.com 2021-11-12T05:39:54.572 DEBUG:teuthology.orchestra.run.gibba005:> set -ex 2021-11-12T05:39:54.572 DEBUG:teuthology.orchestra.run.gibba005:> sudo dd of=/etc/ceph/ceph.keyring 2021-11-12T05:39:54.573 DEBUG:teuthology.orchestra.run.gibba005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-11-12T05:39:54.608 DEBUG:teuthology.orchestra.run.gibba005:> set -ex 2021-11-12T05:39:54.608 DEBUG:teuthology.orchestra.run.gibba005:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-11-12T05:39:54.659 INFO:tasks.ceph:Sending monmap to node ubuntu@gibba015.front.sepia.ceph.com 2021-11-12T05:39:54.660 DEBUG:teuthology.orchestra.run.gibba015:> set -ex 2021-11-12T05:39:54.660 DEBUG:teuthology.orchestra.run.gibba015:> sudo dd of=/etc/ceph/ceph.keyring 2021-11-12T05:39:54.661 DEBUG:teuthology.orchestra.run.gibba015:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-11-12T05:39:54.678 DEBUG:teuthology.orchestra.run.gibba015:> set -ex 2021-11-12T05:39:54.678 DEBUG:teuthology.orchestra.run.gibba015:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-11-12T05:39:54.682 INFO:tasks.ceph:Sending monmap to node ubuntu@gibba016.front.sepia.ceph.com 2021-11-12T05:39:54.682 DEBUG:teuthology.orchestra.run.gibba016:> set -ex 2021-11-12T05:39:54.683 DEBUG:teuthology.orchestra.run.gibba016:> sudo dd of=/etc/ceph/ceph.keyring 2021-11-12T05:39:54.683 DEBUG:teuthology.orchestra.run.gibba016:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-11-12T05:39:54.700 DEBUG:teuthology.orchestra.run.gibba016:> set -ex 2021-11-12T05:39:54.701 DEBUG:teuthology.orchestra.run.gibba016:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-11-12T05:39:54.748 INFO:tasks.ceph:Sending monmap to node ubuntu@gibba038.front.sepia.ceph.com 2021-11-12T05:39:54.749 DEBUG:teuthology.orchestra.run.gibba038:> set -ex 2021-11-12T05:39:54.750 DEBUG:teuthology.orchestra.run.gibba038:> sudo dd of=/etc/ceph/ceph.keyring 2021-11-12T05:39:54.750 DEBUG:teuthology.orchestra.run.gibba038:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-11-12T05:39:54.769 DEBUG:teuthology.orchestra.run.gibba038:> set -ex 2021-11-12T05:39:54.769 DEBUG:teuthology.orchestra.run.gibba038:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-11-12T05:39:54.815 INFO:tasks.ceph:Sending monmap to node ubuntu@gibba044.front.sepia.ceph.com 2021-11-12T05:39:54.816 DEBUG:teuthology.orchestra.run.gibba044:> set -ex 2021-11-12T05:39:54.816 DEBUG:teuthology.orchestra.run.gibba044:> sudo dd of=/etc/ceph/ceph.keyring 2021-11-12T05:39:54.817 DEBUG:teuthology.orchestra.run.gibba044:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-11-12T05:39:54.834 DEBUG:teuthology.orchestra.run.gibba044:> set -ex 2021-11-12T05:39:54.835 DEBUG:teuthology.orchestra.run.gibba044:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-11-12T05:39:54.879 INFO:tasks.ceph:Setting up mon nodes... 2021-11-12T05:39:54.880 INFO:tasks.ceph:Setting up mgr nodes... 2021-11-12T05:39:54.880 DEBUG:teuthology.orchestra.run.gibba005:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2021-11-12T05:39:54.905 INFO:teuthology.orchestra.run.gibba005.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2021-11-12T05:39:54.906 DEBUG:teuthology.orchestra.run.gibba015:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2021-11-12T05:39:54.961 INFO:teuthology.orchestra.run.gibba015.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2021-11-12T05:39:54.963 INFO:tasks.ceph:Setting up mds nodes... 2021-11-12T05:39:54.964 DEBUG:teuthology.orchestra.run.gibba005:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2021-11-12T05:39:54.987 INFO:teuthology.orchestra.run.gibba005.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2021-11-12T05:39:54.989 DEBUG:teuthology.orchestra.run.gibba005:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2021-11-12T05:39:55.039 DEBUG:teuthology.orchestra.run.gibba015:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2021-11-12T05:39:55.063 INFO:teuthology.orchestra.run.gibba015.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2021-11-12T05:39:55.065 DEBUG:teuthology.orchestra.run.gibba015:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2021-11-12T05:39:55.071 INFO:tasks.ceph_client:Setting up client nodes... 2021-11-12T05:39:55.072 DEBUG:teuthology.orchestra.run.gibba016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2021-11-12T05:39:55.140 INFO:teuthology.orchestra.run.gibba016.stdout:creating /etc/ceph/ceph.client.0.keyring 2021-11-12T05:39:55.144 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2021-11-12T05:39:55.188 INFO:teuthology.orchestra.run.gibba038.stdout:creating /etc/ceph/ceph.client.1.keyring 2021-11-12T05:39:55.192 DEBUG:teuthology.orchestra.run.gibba044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2021-11-12T05:39:55.248 INFO:teuthology.orchestra.run.gibba044.stdout:creating /etc/ceph/ceph.client.2.keyring 2021-11-12T05:39:55.254 INFO:tasks.ceph:Running mkfs on osd nodes... 2021-11-12T05:39:55.254 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@gibba005.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@gibba015.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2021-11-12T05:39:55.255 DEBUG:teuthology.orchestra.run.gibba005:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2021-11-12T05:39:55.276 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-11-12T05:39:55.277 INFO:tasks.ceph:role: osd.0 2021-11-12T05:39:55.277 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@gibba005.front.sepia.ceph.com 2021-11-12T05:39:55.277 DEBUG:teuthology.orchestra.run.gibba005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-11-12T05:39:55.321 INFO:teuthology.orchestra.run.gibba005.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5505024 blks 2021-11-12T05:39:55.321 INFO:teuthology.orchestra.run.gibba005.stdout: = sectsz=512 attr=2, projid32bit=1 2021-11-12T05:39:55.321 INFO:teuthology.orchestra.run.gibba005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-11-12T05:39:55.322 INFO:teuthology.orchestra.run.gibba005.stdout: = reflink=1 2021-11-12T05:39:55.322 INFO:teuthology.orchestra.run.gibba005.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-11-12T05:39:55.322 INFO:teuthology.orchestra.run.gibba005.stdout: = sunit=0 swidth=0 blks 2021-11-12T05:39:55.322 INFO:teuthology.orchestra.run.gibba005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-11-12T05:39:55.323 INFO:teuthology.orchestra.run.gibba005.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-11-12T05:39:55.323 INFO:teuthology.orchestra.run.gibba005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-11-12T05:39:55.323 INFO:teuthology.orchestra.run.gibba005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-11-12T05:39:55.324 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@gibba005.front.sepia.ceph.com -o noatime 2021-11-12T05:39:55.325 DEBUG:teuthology.orchestra.run.gibba005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2021-11-12T05:39:55.338 DEBUG:teuthology.orchestra.run.gibba005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2021-11-12T05:39:55.388 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:39:55.389 INFO:teuthology.orchestra.run.gibba005.stderr:sudo: /sbin/restorecon: command not found 2021-11-12T05:39:55.389 DEBUG:teuthology.orchestra.run.gibba005:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2021-11-12T05:39:55.396 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-11-12T05:39:55.396 INFO:tasks.ceph:role: osd.1 2021-11-12T05:39:55.396 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@gibba005.front.sepia.ceph.com 2021-11-12T05:39:55.397 DEBUG:teuthology.orchestra.run.gibba005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-11-12T05:39:55.442 INFO:teuthology.orchestra.run.gibba005.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5505024 blks 2021-11-12T05:39:55.443 INFO:teuthology.orchestra.run.gibba005.stdout: = sectsz=512 attr=2, projid32bit=1 2021-11-12T05:39:55.443 INFO:teuthology.orchestra.run.gibba005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-11-12T05:39:55.443 INFO:teuthology.orchestra.run.gibba005.stdout: = reflink=1 2021-11-12T05:39:55.443 INFO:teuthology.orchestra.run.gibba005.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-11-12T05:39:55.444 INFO:teuthology.orchestra.run.gibba005.stdout: = sunit=0 swidth=0 blks 2021-11-12T05:39:55.444 INFO:teuthology.orchestra.run.gibba005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-11-12T05:39:55.444 INFO:teuthology.orchestra.run.gibba005.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-11-12T05:39:55.444 INFO:teuthology.orchestra.run.gibba005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-11-12T05:39:55.445 INFO:teuthology.orchestra.run.gibba005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-11-12T05:39:55.446 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@gibba005.front.sepia.ceph.com -o noatime 2021-11-12T05:39:55.446 DEBUG:teuthology.orchestra.run.gibba005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2021-11-12T05:39:55.504 DEBUG:teuthology.orchestra.run.gibba005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2021-11-12T05:39:55.510 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:39:55.511 INFO:teuthology.orchestra.run.gibba005.stderr:sudo: /sbin/restorecon: command not found 2021-11-12T05:39:55.511 DEBUG:teuthology.orchestra.run.gibba005:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2021-11-12T05:39:55.522 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-11-12T05:39:55.523 INFO:tasks.ceph:role: osd.2 2021-11-12T05:39:55.524 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@gibba005.front.sepia.ceph.com 2021-11-12T05:39:55.524 DEBUG:teuthology.orchestra.run.gibba005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-11-12T05:39:55.608 INFO:teuthology.orchestra.run.gibba005.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5505024 blks 2021-11-12T05:39:55.609 INFO:teuthology.orchestra.run.gibba005.stdout: = sectsz=512 attr=2, projid32bit=1 2021-11-12T05:39:55.609 INFO:teuthology.orchestra.run.gibba005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-11-12T05:39:55.610 INFO:teuthology.orchestra.run.gibba005.stdout: = reflink=1 2021-11-12T05:39:55.610 INFO:teuthology.orchestra.run.gibba005.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-11-12T05:39:55.610 INFO:teuthology.orchestra.run.gibba005.stdout: = sunit=0 swidth=0 blks 2021-11-12T05:39:55.611 INFO:teuthology.orchestra.run.gibba005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-11-12T05:39:55.611 INFO:teuthology.orchestra.run.gibba005.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-11-12T05:39:55.611 INFO:teuthology.orchestra.run.gibba005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-11-12T05:39:55.611 INFO:teuthology.orchestra.run.gibba005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-11-12T05:39:55.612 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@gibba005.front.sepia.ceph.com -o noatime 2021-11-12T05:39:55.613 DEBUG:teuthology.orchestra.run.gibba005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2021-11-12T05:39:55.627 DEBUG:teuthology.orchestra.run.gibba005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2021-11-12T05:39:55.677 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:39:55.678 INFO:teuthology.orchestra.run.gibba005.stderr:sudo: /sbin/restorecon: command not found 2021-11-12T05:39:55.678 DEBUG:teuthology.orchestra.run.gibba005:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2021-11-12T05:39:55.688 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-11-12T05:39:55.688 INFO:tasks.ceph:role: osd.3 2021-11-12T05:39:55.689 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@gibba005.front.sepia.ceph.com 2021-11-12T05:39:55.689 DEBUG:teuthology.orchestra.run.gibba005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2021-11-12T05:39:55.733 INFO:teuthology.orchestra.run.gibba005.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5505024 blks 2021-11-12T05:39:55.733 INFO:teuthology.orchestra.run.gibba005.stdout: = sectsz=512 attr=2, projid32bit=1 2021-11-12T05:39:55.733 INFO:teuthology.orchestra.run.gibba005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-11-12T05:39:55.734 INFO:teuthology.orchestra.run.gibba005.stdout: = reflink=1 2021-11-12T05:39:55.734 INFO:teuthology.orchestra.run.gibba005.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-11-12T05:39:55.734 INFO:teuthology.orchestra.run.gibba005.stdout: = sunit=0 swidth=0 blks 2021-11-12T05:39:55.734 INFO:teuthology.orchestra.run.gibba005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-11-12T05:39:55.734 INFO:teuthology.orchestra.run.gibba005.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-11-12T05:39:55.735 INFO:teuthology.orchestra.run.gibba005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-11-12T05:39:55.735 INFO:teuthology.orchestra.run.gibba005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-11-12T05:39:55.736 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@gibba005.front.sepia.ceph.com -o noatime 2021-11-12T05:39:55.736 DEBUG:teuthology.orchestra.run.gibba005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2021-11-12T05:39:55.810 DEBUG:teuthology.orchestra.run.gibba005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2021-11-12T05:39:55.826 INFO:teuthology.orchestra.run.gibba005.stderr:sudo: /sbin/restorecon: command not found 2021-11-12T05:39:55.827 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:39:55.828 DEBUG:teuthology.orchestra.run.gibba005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-11-12T05:39:55.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:39:55.957+0000 7f7d29e42d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2021-11-12T05:39:55.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:39:55.957+0000 7f7d29e42d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2021-11-12T05:39:55.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:39:55.957+0000 7f7d29e42d80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-11-12T05:39:55.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:39:55.957+0000 7f7d29e42d80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-11-12T05:39:55.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:39:55.957+0000 7f7d29e42d80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-11-12T05:39:55.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:39:55.961+0000 7f7d29e42d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2021-11-12T05:39:55.974 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:39:55.969+0000 7f7d29e42d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-11-12T05:39:58.420 DEBUG:teuthology.orchestra.run.gibba005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-11-12T05:39:58.427 DEBUG:teuthology.orchestra.run.gibba005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-11-12T05:39:58.443 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:39:58.441+0000 7fdc489fbd80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2021-11-12T05:39:58.444 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:39:58.441+0000 7fdc489fbd80 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2021-11-12T05:39:58.444 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:39:58.441+0000 7fdc489fbd80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-11-12T05:39:58.444 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:39:58.441+0000 7fdc489fbd80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-11-12T05:39:58.445 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:39:58.441+0000 7fdc489fbd80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-11-12T05:39:58.445 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:39:58.441+0000 7fdc489fbd80 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2021-11-12T05:39:58.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:39:58.449+0000 7fdc489fbd80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-11-12T05:40:00.905 DEBUG:teuthology.orchestra.run.gibba005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-11-12T05:40:00.957 DEBUG:teuthology.orchestra.run.gibba005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-11-12T05:40:00.975 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:00.969+0000 7f451e1a2d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2021-11-12T05:40:00.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:00.969+0000 7f451e1a2d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2021-11-12T05:40:00.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:00.969+0000 7f451e1a2d80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-11-12T05:40:00.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:00.969+0000 7f451e1a2d80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-11-12T05:40:00.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:00.969+0000 7f451e1a2d80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-11-12T05:40:00.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:00.973+0000 7f451e1a2d80 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2021-11-12T05:40:00.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:00.977+0000 7f451e1a2d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-11-12T05:40:03.444 DEBUG:teuthology.orchestra.run.gibba005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-11-12T05:40:03.456 DEBUG:teuthology.orchestra.run.gibba005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-11-12T05:40:03.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:03.521+0000 7fdcb75f5d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2021-11-12T05:40:03.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:03.521+0000 7fdcb75f5d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2021-11-12T05:40:03.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:03.521+0000 7fdcb75f5d80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-11-12T05:40:03.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:03.525+0000 7fdcb75f5d80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-11-12T05:40:03.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:03.525+0000 7fdcb75f5d80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-11-12T05:40:03.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:03.525+0000 7fdcb75f5d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2021-11-12T05:40:03.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:03.537+0000 7fdcb75f5d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-11-12T05:40:05.980 DEBUG:teuthology.orchestra.run.gibba005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-11-12T05:40:05.991 DEBUG:teuthology.orchestra.run.gibba015:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2021-11-12T05:40:06.003 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-11-12T05:40:06.003 INFO:tasks.ceph:role: osd.4 2021-11-12T05:40:06.004 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@gibba015.front.sepia.ceph.com 2021-11-12T05:40:06.004 DEBUG:teuthology.orchestra.run.gibba015:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-11-12T05:40:06.044 INFO:teuthology.orchestra.run.gibba015.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5505024 blks 2021-11-12T05:40:06.044 INFO:teuthology.orchestra.run.gibba015.stdout: = sectsz=512 attr=2, projid32bit=1 2021-11-12T05:40:06.045 INFO:teuthology.orchestra.run.gibba015.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-11-12T05:40:06.045 INFO:teuthology.orchestra.run.gibba015.stdout: = reflink=1 2021-11-12T05:40:06.045 INFO:teuthology.orchestra.run.gibba015.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-11-12T05:40:06.045 INFO:teuthology.orchestra.run.gibba015.stdout: = sunit=0 swidth=0 blks 2021-11-12T05:40:06.046 INFO:teuthology.orchestra.run.gibba015.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-11-12T05:40:06.046 INFO:teuthology.orchestra.run.gibba015.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-11-12T05:40:06.046 INFO:teuthology.orchestra.run.gibba015.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-11-12T05:40:06.047 INFO:teuthology.orchestra.run.gibba015.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-11-12T05:40:06.048 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@gibba015.front.sepia.ceph.com -o noatime 2021-11-12T05:40:06.048 DEBUG:teuthology.orchestra.run.gibba015:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2021-11-12T05:40:06.122 DEBUG:teuthology.orchestra.run.gibba015:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2021-11-12T05:40:06.137 INFO:teuthology.orchestra.run.gibba015.stderr:sudo: /sbin/restorecon: command not found 2021-11-12T05:40:06.137 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:40:06.138 DEBUG:teuthology.orchestra.run.gibba015:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2021-11-12T05:40:06.161 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-11-12T05:40:06.162 INFO:tasks.ceph:role: osd.5 2021-11-12T05:40:06.162 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@gibba015.front.sepia.ceph.com 2021-11-12T05:40:06.162 DEBUG:teuthology.orchestra.run.gibba015:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-11-12T05:40:06.249 INFO:teuthology.orchestra.run.gibba015.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5505024 blks 2021-11-12T05:40:06.250 INFO:teuthology.orchestra.run.gibba015.stdout: = sectsz=512 attr=2, projid32bit=1 2021-11-12T05:40:06.250 INFO:teuthology.orchestra.run.gibba015.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-11-12T05:40:06.250 INFO:teuthology.orchestra.run.gibba015.stdout: = reflink=1 2021-11-12T05:40:06.250 INFO:teuthology.orchestra.run.gibba015.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-11-12T05:40:06.251 INFO:teuthology.orchestra.run.gibba015.stdout: = sunit=0 swidth=0 blks 2021-11-12T05:40:06.251 INFO:teuthology.orchestra.run.gibba015.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-11-12T05:40:06.251 INFO:teuthology.orchestra.run.gibba015.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-11-12T05:40:06.251 INFO:teuthology.orchestra.run.gibba015.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-11-12T05:40:06.251 INFO:teuthology.orchestra.run.gibba015.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-11-12T05:40:06.253 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@gibba015.front.sepia.ceph.com -o noatime 2021-11-12T05:40:06.253 DEBUG:teuthology.orchestra.run.gibba015:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2021-11-12T05:40:06.266 DEBUG:teuthology.orchestra.run.gibba015:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2021-11-12T05:40:06.315 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:40:06.316 INFO:teuthology.orchestra.run.gibba015.stderr:sudo: /sbin/restorecon: command not found 2021-11-12T05:40:06.316 DEBUG:teuthology.orchestra.run.gibba015:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2021-11-12T05:40:06.322 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-11-12T05:40:06.323 INFO:tasks.ceph:role: osd.6 2021-11-12T05:40:06.323 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@gibba015.front.sepia.ceph.com 2021-11-12T05:40:06.323 DEBUG:teuthology.orchestra.run.gibba015:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-11-12T05:40:06.367 INFO:teuthology.orchestra.run.gibba015.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5505024 blks 2021-11-12T05:40:06.367 INFO:teuthology.orchestra.run.gibba015.stdout: = sectsz=512 attr=2, projid32bit=1 2021-11-12T05:40:06.367 INFO:teuthology.orchestra.run.gibba015.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-11-12T05:40:06.368 INFO:teuthology.orchestra.run.gibba015.stdout: = reflink=1 2021-11-12T05:40:06.368 INFO:teuthology.orchestra.run.gibba015.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-11-12T05:40:06.368 INFO:teuthology.orchestra.run.gibba015.stdout: = sunit=0 swidth=0 blks 2021-11-12T05:40:06.368 INFO:teuthology.orchestra.run.gibba015.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-11-12T05:40:06.369 INFO:teuthology.orchestra.run.gibba015.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-11-12T05:40:06.369 INFO:teuthology.orchestra.run.gibba015.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-11-12T05:40:06.369 INFO:teuthology.orchestra.run.gibba015.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-11-12T05:40:06.370 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@gibba015.front.sepia.ceph.com -o noatime 2021-11-12T05:40:06.371 DEBUG:teuthology.orchestra.run.gibba015:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2021-11-12T05:40:06.385 DEBUG:teuthology.orchestra.run.gibba015:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2021-11-12T05:40:06.389 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:40:06.390 INFO:teuthology.orchestra.run.gibba015.stderr:sudo: /sbin/restorecon: command not found 2021-11-12T05:40:06.391 DEBUG:teuthology.orchestra.run.gibba015:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2021-11-12T05:40:06.397 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-11-12T05:40:06.397 INFO:tasks.ceph:role: osd.7 2021-11-12T05:40:06.397 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@gibba015.front.sepia.ceph.com 2021-11-12T05:40:06.398 DEBUG:teuthology.orchestra.run.gibba015:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2021-11-12T05:40:06.487 INFO:teuthology.orchestra.run.gibba015.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5505024 blks 2021-11-12T05:40:06.488 INFO:teuthology.orchestra.run.gibba015.stdout: = sectsz=512 attr=2, projid32bit=1 2021-11-12T05:40:06.488 INFO:teuthology.orchestra.run.gibba015.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-11-12T05:40:06.488 INFO:teuthology.orchestra.run.gibba015.stdout: = reflink=1 2021-11-12T05:40:06.488 INFO:teuthology.orchestra.run.gibba015.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-11-12T05:40:06.489 INFO:teuthology.orchestra.run.gibba015.stdout: = sunit=0 swidth=0 blks 2021-11-12T05:40:06.489 INFO:teuthology.orchestra.run.gibba015.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-11-12T05:40:06.489 INFO:teuthology.orchestra.run.gibba015.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-11-12T05:40:06.489 INFO:teuthology.orchestra.run.gibba015.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-11-12T05:40:06.489 INFO:teuthology.orchestra.run.gibba015.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-11-12T05:40:06.490 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@gibba015.front.sepia.ceph.com -o noatime 2021-11-12T05:40:06.491 DEBUG:teuthology.orchestra.run.gibba015:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2021-11-12T05:40:06.522 DEBUG:teuthology.orchestra.run.gibba015:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2021-11-12T05:40:06.578 INFO:teuthology.orchestra.run.gibba015.stderr:sudo: /sbin/restorecon: command not found 2021-11-12T05:40:06.578 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:40:06.579 DEBUG:teuthology.orchestra.run.gibba015:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-11-12T05:40:06.691 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:06.689+0000 7f5086428d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2021-11-12T05:40:06.692 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:06.689+0000 7f5086428d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2021-11-12T05:40:06.692 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:06.689+0000 7f5086428d80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-11-12T05:40:06.692 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:06.689+0000 7f5086428d80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-11-12T05:40:06.692 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:06.689+0000 7f5086428d80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-11-12T05:40:06.693 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:06.689+0000 7f5086428d80 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2021-11-12T05:40:06.704 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:06.701+0000 7f5086428d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-11-12T05:40:09.151 DEBUG:teuthology.orchestra.run.gibba015:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-11-12T05:40:09.158 DEBUG:teuthology.orchestra.run.gibba015:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-11-12T05:40:09.223 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:09.217+0000 7f0356888d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2021-11-12T05:40:09.223 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:09.217+0000 7f0356888d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2021-11-12T05:40:09.223 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:09.217+0000 7f0356888d80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-11-12T05:40:09.224 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:09.217+0000 7f0356888d80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-11-12T05:40:09.224 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:09.217+0000 7f0356888d80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-11-12T05:40:09.224 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:09.221+0000 7f0356888d80 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2021-11-12T05:40:09.231 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:09.229+0000 7f0356888d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-11-12T05:40:11.695 DEBUG:teuthology.orchestra.run.gibba015:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-11-12T05:40:11.702 DEBUG:teuthology.orchestra.run.gibba015:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-11-12T05:40:11.721 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:11.717+0000 7fb38a1eed80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2021-11-12T05:40:11.721 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:11.717+0000 7fb38a1eed80 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2021-11-12T05:40:11.721 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:11.717+0000 7fb38a1eed80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-11-12T05:40:11.722 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:11.717+0000 7fb38a1eed80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-11-12T05:40:11.722 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:11.717+0000 7fb38a1eed80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-11-12T05:40:11.722 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:11.717+0000 7fb38a1eed80 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2021-11-12T05:40:11.730 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:11.725+0000 7fb38a1eed80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-11-12T05:40:14.200 DEBUG:teuthology.orchestra.run.gibba015:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-11-12T05:40:14.253 DEBUG:teuthology.orchestra.run.gibba015:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-11-12T05:40:14.271 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:14.265+0000 7fe529999d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2021-11-12T05:40:14.271 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:14.265+0000 7fe529999d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2021-11-12T05:40:14.272 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:14.265+0000 7fe529999d80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-11-12T05:40:14.272 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:14.265+0000 7fe529999d80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-11-12T05:40:14.272 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:14.265+0000 7fe529999d80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-11-12T05:40:14.273 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:14.269+0000 7fe529999d80 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2021-11-12T05:40:14.279 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:14.277+0000 7fe529999d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-11-12T05:40:16.752 DEBUG:teuthology.orchestra.run.gibba015:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-11-12T05:40:16.763 INFO:tasks.ceph:Reading keys from all nodes... 2021-11-12T05:40:16.763 DEBUG:teuthology.orchestra.run.gibba005:> mktemp 2021-11-12T05:40:16.772 INFO:teuthology.orchestra.run.gibba005.stdout:/tmp/tmp.csjXjBMHDT 2021-11-12T05:40:16.773 DEBUG:teuthology.orchestra.run.gibba005:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.csjXjBMHDT 2021-11-12T05:40:16.823 DEBUG:teuthology.orchestra.run.gibba005:> sudo chmod 0666 /tmp/tmp.csjXjBMHDT 2021-11-12T05:40:16.842 DEBUG:teuthology.orchestra.remote:gibba005:/tmp/tmp.csjXjBMHDT is 56B 2021-11-12T05:40:16.856 DEBUG:teuthology.orchestra.run.gibba005:> rm -fr /tmp/tmp.csjXjBMHDT 2021-11-12T05:40:16.864 DEBUG:teuthology.orchestra.run.gibba005:> mktemp 2021-11-12T05:40:16.915 INFO:teuthology.orchestra.run.gibba005.stdout:/tmp/tmp.YaaRk7Ii1A 2021-11-12T05:40:16.916 DEBUG:teuthology.orchestra.run.gibba005:> sudo cp /var/lib/ceph/mds/ceph-a/keyring /tmp/tmp.YaaRk7Ii1A 2021-11-12T05:40:16.938 DEBUG:teuthology.orchestra.run.gibba005:> sudo chmod 0666 /tmp/tmp.YaaRk7Ii1A 2021-11-12T05:40:17.015 DEBUG:teuthology.orchestra.remote:gibba005:/tmp/tmp.YaaRk7Ii1A is 56B 2021-11-12T05:40:17.030 DEBUG:teuthology.orchestra.run.gibba005:> rm -fr /tmp/tmp.YaaRk7Ii1A 2021-11-12T05:40:17.034 DEBUG:teuthology.orchestra.run.gibba005:> mktemp 2021-11-12T05:40:17.078 INFO:teuthology.orchestra.run.gibba005.stdout:/tmp/tmp.Js7ZVTuGtM 2021-11-12T05:40:17.079 DEBUG:teuthology.orchestra.run.gibba005:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.Js7ZVTuGtM 2021-11-12T05:40:17.088 DEBUG:teuthology.orchestra.run.gibba005:> sudo chmod 0666 /tmp/tmp.Js7ZVTuGtM 2021-11-12T05:40:17.103 DEBUG:teuthology.orchestra.remote:gibba005:/tmp/tmp.Js7ZVTuGtM is 56B 2021-11-12T05:40:17.154 DEBUG:teuthology.orchestra.run.gibba005:> rm -fr /tmp/tmp.Js7ZVTuGtM 2021-11-12T05:40:17.159 DEBUG:teuthology.orchestra.run.gibba005:> mktemp 2021-11-12T05:40:17.166 INFO:teuthology.orchestra.run.gibba005.stdout:/tmp/tmp.P6uaxzt621 2021-11-12T05:40:17.166 DEBUG:teuthology.orchestra.run.gibba005:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.P6uaxzt621 2021-11-12T05:40:17.228 DEBUG:teuthology.orchestra.run.gibba005:> sudo chmod 0666 /tmp/tmp.P6uaxzt621 2021-11-12T05:40:17.265 DEBUG:teuthology.orchestra.remote:gibba005:/tmp/tmp.P6uaxzt621 is 56B 2021-11-12T05:40:17.285 DEBUG:teuthology.orchestra.run.gibba005:> rm -fr /tmp/tmp.P6uaxzt621 2021-11-12T05:40:17.293 DEBUG:teuthology.orchestra.run.gibba005:> mktemp 2021-11-12T05:40:17.347 INFO:teuthology.orchestra.run.gibba005.stdout:/tmp/tmp.JYYPF9gsrm 2021-11-12T05:40:17.348 DEBUG:teuthology.orchestra.run.gibba005:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.JYYPF9gsrm 2021-11-12T05:40:17.370 DEBUG:teuthology.orchestra.run.gibba005:> sudo chmod 0666 /tmp/tmp.JYYPF9gsrm 2021-11-12T05:40:17.447 DEBUG:teuthology.orchestra.remote:gibba005:/tmp/tmp.JYYPF9gsrm is 56B 2021-11-12T05:40:17.467 DEBUG:teuthology.orchestra.run.gibba005:> rm -fr /tmp/tmp.JYYPF9gsrm 2021-11-12T05:40:17.476 DEBUG:teuthology.orchestra.run.gibba005:> mktemp 2021-11-12T05:40:17.527 INFO:teuthology.orchestra.run.gibba005.stdout:/tmp/tmp.x8t6nfK1Mk 2021-11-12T05:40:17.528 DEBUG:teuthology.orchestra.run.gibba005:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.x8t6nfK1Mk 2021-11-12T05:40:17.550 DEBUG:teuthology.orchestra.run.gibba005:> sudo chmod 0666 /tmp/tmp.x8t6nfK1Mk 2021-11-12T05:40:17.627 DEBUG:teuthology.orchestra.remote:gibba005:/tmp/tmp.x8t6nfK1Mk is 56B 2021-11-12T05:40:17.642 DEBUG:teuthology.orchestra.run.gibba005:> rm -fr /tmp/tmp.x8t6nfK1Mk 2021-11-12T05:40:17.646 DEBUG:teuthology.orchestra.run.gibba015:> mktemp 2021-11-12T05:40:17.655 INFO:teuthology.orchestra.run.gibba015.stdout:/tmp/tmp.33Gkpjv1h9 2021-11-12T05:40:17.655 DEBUG:teuthology.orchestra.run.gibba015:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.33Gkpjv1h9 2021-11-12T05:40:17.706 DEBUG:teuthology.orchestra.run.gibba015:> sudo chmod 0666 /tmp/tmp.33Gkpjv1h9 2021-11-12T05:40:17.724 DEBUG:teuthology.orchestra.remote:gibba015:/tmp/tmp.33Gkpjv1h9 is 56B 2021-11-12T05:40:17.737 DEBUG:teuthology.orchestra.run.gibba015:> rm -fr /tmp/tmp.33Gkpjv1h9 2021-11-12T05:40:17.741 DEBUG:teuthology.orchestra.run.gibba015:> mktemp 2021-11-12T05:40:17.787 INFO:teuthology.orchestra.run.gibba015.stdout:/tmp/tmp.nPwB9iaVLy 2021-11-12T05:40:17.788 DEBUG:teuthology.orchestra.run.gibba015:> sudo cp /var/lib/ceph/mds/ceph-b/keyring /tmp/tmp.nPwB9iaVLy 2021-11-12T05:40:17.797 DEBUG:teuthology.orchestra.run.gibba015:> sudo chmod 0666 /tmp/tmp.nPwB9iaVLy 2021-11-12T05:40:17.855 DEBUG:teuthology.orchestra.remote:gibba015:/tmp/tmp.nPwB9iaVLy is 56B 2021-11-12T05:40:17.869 DEBUG:teuthology.orchestra.run.gibba015:> rm -fr /tmp/tmp.nPwB9iaVLy 2021-11-12T05:40:17.877 DEBUG:teuthology.orchestra.run.gibba015:> mktemp 2021-11-12T05:40:17.927 INFO:teuthology.orchestra.run.gibba015.stdout:/tmp/tmp.Kd3SQseUJR 2021-11-12T05:40:17.927 DEBUG:teuthology.orchestra.run.gibba015:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.Kd3SQseUJR 2021-11-12T05:40:17.934 DEBUG:teuthology.orchestra.run.gibba015:> sudo chmod 0666 /tmp/tmp.Kd3SQseUJR 2021-11-12T05:40:17.992 DEBUG:teuthology.orchestra.remote:gibba015:/tmp/tmp.Kd3SQseUJR is 56B 2021-11-12T05:40:18.008 DEBUG:teuthology.orchestra.run.gibba015:> rm -fr /tmp/tmp.Kd3SQseUJR 2021-11-12T05:40:18.017 DEBUG:teuthology.orchestra.run.gibba015:> mktemp 2021-11-12T05:40:18.067 INFO:teuthology.orchestra.run.gibba015.stdout:/tmp/tmp.HjNX8Gyr55 2021-11-12T05:40:18.067 DEBUG:teuthology.orchestra.run.gibba015:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.HjNX8Gyr55 2021-11-12T05:40:18.089 DEBUG:teuthology.orchestra.run.gibba015:> sudo chmod 0666 /tmp/tmp.HjNX8Gyr55 2021-11-12T05:40:18.168 DEBUG:teuthology.orchestra.remote:gibba015:/tmp/tmp.HjNX8Gyr55 is 56B 2021-11-12T05:40:18.189 DEBUG:teuthology.orchestra.run.gibba015:> rm -fr /tmp/tmp.HjNX8Gyr55 2021-11-12T05:40:18.199 DEBUG:teuthology.orchestra.run.gibba015:> mktemp 2021-11-12T05:40:18.247 INFO:teuthology.orchestra.run.gibba015.stdout:/tmp/tmp.Xlul7k4304 2021-11-12T05:40:18.247 DEBUG:teuthology.orchestra.run.gibba015:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.Xlul7k4304 2021-11-12T05:40:18.269 DEBUG:teuthology.orchestra.run.gibba015:> sudo chmod 0666 /tmp/tmp.Xlul7k4304 2021-11-12T05:40:18.347 DEBUG:teuthology.orchestra.remote:gibba015:/tmp/tmp.Xlul7k4304 is 56B 2021-11-12T05:40:18.361 DEBUG:teuthology.orchestra.run.gibba015:> rm -fr /tmp/tmp.Xlul7k4304 2021-11-12T05:40:18.365 DEBUG:teuthology.orchestra.run.gibba015:> mktemp 2021-11-12T05:40:18.410 INFO:teuthology.orchestra.run.gibba015.stdout:/tmp/tmp.bxcir5GRrp 2021-11-12T05:40:18.411 DEBUG:teuthology.orchestra.run.gibba015:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.bxcir5GRrp 2021-11-12T05:40:18.420 DEBUG:teuthology.orchestra.run.gibba015:> sudo chmod 0666 /tmp/tmp.bxcir5GRrp 2021-11-12T05:40:18.487 DEBUG:teuthology.orchestra.remote:gibba015:/tmp/tmp.bxcir5GRrp is 56B 2021-11-12T05:40:18.509 DEBUG:teuthology.orchestra.run.gibba015:> rm -fr /tmp/tmp.bxcir5GRrp 2021-11-12T05:40:18.535 DEBUG:teuthology.orchestra.remote:gibba016:/etc/ceph/ceph.client.0.keyring is 59B 2021-11-12T05:40:18.599 DEBUG:teuthology.orchestra.remote:gibba038:/etc/ceph/ceph.client.1.keyring is 59B 2021-11-12T05:40:18.662 DEBUG:teuthology.orchestra.remote:gibba044:/etc/ceph/ceph.client.2.keyring is 59B 2021-11-12T05:40:18.714 INFO:tasks.ceph:Adding keys to all mons... 2021-11-12T05:40:18.715 DEBUG:teuthology.orchestra.run.gibba005:> sudo tee -a /etc/ceph/ceph.keyring 2021-11-12T05:40:18.718 DEBUG:teuthology.orchestra.run.gibba015:> sudo tee -a /etc/ceph/ceph.keyring 2021-11-12T05:40:18.727 INFO:teuthology.orchestra.run.gibba005.stdout:[mgr.y] 2021-11-12T05:40:18.727 INFO:teuthology.orchestra.run.gibba005.stdout: key = AQAq/o1hwfvvNRAASU7NmYBG/Yb6/ma1/Ew7mw== 2021-11-12T05:40:18.727 INFO:teuthology.orchestra.run.gibba005.stdout:[mds.a] 2021-11-12T05:40:18.727 INFO:teuthology.orchestra.run.gibba005.stdout: key = AQAq/o1hGVLeOhAAX2029T+USC1Um93TSzjxdA== 2021-11-12T05:40:18.728 INFO:teuthology.orchestra.run.gibba005.stdout:[osd.0] 2021-11-12T05:40:18.728 INFO:teuthology.orchestra.run.gibba005.stdout: key = AQAr/o1ht05fORAAN2YrbsxBau1FQC4C8Dvb3g== 2021-11-12T05:40:18.728 INFO:teuthology.orchestra.run.gibba005.stdout:[osd.1] 2021-11-12T05:40:18.728 INFO:teuthology.orchestra.run.gibba005.stdout: key = AQAu/o1hzp1vGhAAQ6u3Npb+yNGlNOUdoHzFZA== 2021-11-12T05:40:18.729 INFO:teuthology.orchestra.run.gibba005.stdout:[osd.2] 2021-11-12T05:40:18.729 INFO:teuthology.orchestra.run.gibba005.stdout: key = AQAw/o1hHWwOOhAAx7txWG8rbch18+SBnJkfkQ== 2021-11-12T05:40:18.729 INFO:teuthology.orchestra.run.gibba005.stdout:[osd.3] 2021-11-12T05:40:18.729 INFO:teuthology.orchestra.run.gibba005.stdout: key = AQAz/o1howZpHxAAKgUVxU2tSNZbxW+6OfJF9g== 2021-11-12T05:40:18.730 INFO:teuthology.orchestra.run.gibba005.stdout:[mgr.x] 2021-11-12T05:40:18.730 INFO:teuthology.orchestra.run.gibba005.stdout: key = AQAq/o1h6JBaORAAbgxQtCzGNj7MLfgwGd4cWA== 2021-11-12T05:40:18.730 INFO:teuthology.orchestra.run.gibba005.stdout:[mds.b] 2021-11-12T05:40:18.730 INFO:teuthology.orchestra.run.gibba005.stdout: key = AQAr/o1hiebUAxAAGcjDAGyvecjzagGoRBX8tg== 2021-11-12T05:40:18.731 INFO:teuthology.orchestra.run.gibba005.stdout:[osd.4] 2021-11-12T05:40:18.731 INFO:teuthology.orchestra.run.gibba005.stdout: key = AQA2/o1humA5KRAAVbO6UYLOBQDq3WiEkkS6xw== 2021-11-12T05:40:18.732 INFO:teuthology.orchestra.run.gibba005.stdout:[osd.5] 2021-11-12T05:40:18.732 INFO:teuthology.orchestra.run.gibba005.stdout: key = AQA5/o1hALdKDRAAR9nsaDOo9GUgpmBPHVp5HQ== 2021-11-12T05:40:18.732 INFO:teuthology.orchestra.run.gibba005.stdout:[osd.6] 2021-11-12T05:40:18.733 INFO:teuthology.orchestra.run.gibba005.stdout: key = AQA7/o1hCVP2KhAAHj5SxnJ81mKrJOg2CE2wLQ== 2021-11-12T05:40:18.733 INFO:teuthology.orchestra.run.gibba005.stdout:[osd.7] 2021-11-12T05:40:18.733 INFO:teuthology.orchestra.run.gibba005.stdout: key = AQA+/o1hWCEqEBAAv8nF9NeF2Ue5W8Ijj8Skgg== 2021-11-12T05:40:18.733 INFO:teuthology.orchestra.run.gibba005.stdout:[client.0] 2021-11-12T05:40:18.733 INFO:teuthology.orchestra.run.gibba005.stdout: key = AQAr/o1hzEzhCBAATF8giEBtrj13SAr5EJV4TA== 2021-11-12T05:40:18.734 INFO:teuthology.orchestra.run.gibba005.stdout:[client.1] 2021-11-12T05:40:18.734 INFO:teuthology.orchestra.run.gibba005.stdout: key = AQAr/o1hO6zfCxAAae1obagtpsnA9e8FlTExVA== 2021-11-12T05:40:18.734 INFO:teuthology.orchestra.run.gibba005.stdout:[client.2] 2021-11-12T05:40:18.734 INFO:teuthology.orchestra.run.gibba005.stdout: key = AQAr/o1hFYDGDhAAyz77VXKtOz86ztJ8FUIvAg== 2021-11-12T05:40:18.736 INFO:teuthology.orchestra.run.gibba015.stdout:[mgr.y] 2021-11-12T05:40:18.736 INFO:teuthology.orchestra.run.gibba015.stdout: key = AQAq/o1hwfvvNRAASU7NmYBG/Yb6/ma1/Ew7mw== 2021-11-12T05:40:18.736 INFO:teuthology.orchestra.run.gibba015.stdout:[mds.a] 2021-11-12T05:40:18.736 INFO:teuthology.orchestra.run.gibba015.stdout: key = AQAq/o1hGVLeOhAAX2029T+USC1Um93TSzjxdA== 2021-11-12T05:40:18.737 INFO:teuthology.orchestra.run.gibba015.stdout:[osd.0] 2021-11-12T05:40:18.737 INFO:teuthology.orchestra.run.gibba015.stdout: key = AQAr/o1ht05fORAAN2YrbsxBau1FQC4C8Dvb3g== 2021-11-12T05:40:18.737 INFO:teuthology.orchestra.run.gibba015.stdout:[osd.1] 2021-11-12T05:40:18.737 INFO:teuthology.orchestra.run.gibba015.stdout: key = AQAu/o1hzp1vGhAAQ6u3Npb+yNGlNOUdoHzFZA== 2021-11-12T05:40:18.738 INFO:teuthology.orchestra.run.gibba015.stdout:[osd.2] 2021-11-12T05:40:18.738 INFO:teuthology.orchestra.run.gibba015.stdout: key = AQAw/o1hHWwOOhAAx7txWG8rbch18+SBnJkfkQ== 2021-11-12T05:40:18.738 INFO:teuthology.orchestra.run.gibba015.stdout:[osd.3] 2021-11-12T05:40:18.738 INFO:teuthology.orchestra.run.gibba015.stdout: key = AQAz/o1howZpHxAAKgUVxU2tSNZbxW+6OfJF9g== 2021-11-12T05:40:18.739 INFO:teuthology.orchestra.run.gibba015.stdout:[mgr.x] 2021-11-12T05:40:18.739 INFO:teuthology.orchestra.run.gibba015.stdout: key = AQAq/o1h6JBaORAAbgxQtCzGNj7MLfgwGd4cWA== 2021-11-12T05:40:18.739 INFO:teuthology.orchestra.run.gibba015.stdout:[mds.b] 2021-11-12T05:40:18.739 INFO:teuthology.orchestra.run.gibba015.stdout: key = AQAr/o1hiebUAxAAGcjDAGyvecjzagGoRBX8tg== 2021-11-12T05:40:18.739 INFO:teuthology.orchestra.run.gibba015.stdout:[osd.4] 2021-11-12T05:40:18.740 INFO:teuthology.orchestra.run.gibba015.stdout: key = AQA2/o1humA5KRAAVbO6UYLOBQDq3WiEkkS6xw== 2021-11-12T05:40:18.740 INFO:teuthology.orchestra.run.gibba015.stdout:[osd.5] 2021-11-12T05:40:18.740 INFO:teuthology.orchestra.run.gibba015.stdout: key = AQA5/o1hALdKDRAAR9nsaDOo9GUgpmBPHVp5HQ== 2021-11-12T05:40:18.740 INFO:teuthology.orchestra.run.gibba015.stdout:[osd.6] 2021-11-12T05:40:18.741 INFO:teuthology.orchestra.run.gibba015.stdout: key = AQA7/o1hCVP2KhAAHj5SxnJ81mKrJOg2CE2wLQ== 2021-11-12T05:40:18.741 INFO:teuthology.orchestra.run.gibba015.stdout:[osd.7] 2021-11-12T05:40:18.741 INFO:teuthology.orchestra.run.gibba015.stdout: key = AQA+/o1hWCEqEBAAv8nF9NeF2Ue5W8Ijj8Skgg== 2021-11-12T05:40:18.741 INFO:teuthology.orchestra.run.gibba015.stdout:[client.0] 2021-11-12T05:40:18.741 INFO:teuthology.orchestra.run.gibba015.stdout: key = AQAr/o1hzEzhCBAATF8giEBtrj13SAr5EJV4TA== 2021-11-12T05:40:18.742 INFO:teuthology.orchestra.run.gibba015.stdout:[client.1] 2021-11-12T05:40:18.742 INFO:teuthology.orchestra.run.gibba015.stdout: key = AQAr/o1hO6zfCxAAae1obagtpsnA9e8FlTExVA== 2021-11-12T05:40:18.742 INFO:teuthology.orchestra.run.gibba015.stdout:[client.2] 2021-11-12T05:40:18.742 INFO:teuthology.orchestra.run.gibba015.stdout: key = AQAr/o1hFYDGDhAAyz77VXKtOz86ztJ8FUIvAg== 2021-11-12T05:40:18.743 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-11-12T05:40:18.745 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-11-12T05:40:18.766 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-11-12T05:40:18.809 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-11-12T05:40:18.845 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-12T05:40:18.847 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-12T05:40:18.880 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-12T05:40:18.882 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-12T05:40:18.972 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-12T05:40:18.975 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-12T05:40:19.034 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-12T05:40:19.036 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-12T05:40:19.065 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-11-12T05:40:19.067 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-11-12T05:40:19.167 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-11-12T05:40:19.170 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-11-12T05:40:19.229 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-12T05:40:19.232 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-12T05:40:19.256 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-12T05:40:19.258 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-12T05:40:19.345 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-12T05:40:19.348 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-12T05:40:19.380 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-12T05:40:19.383 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-11-12T05:40:19.461 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-12T05:40:19.464 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-12T05:40:19.500 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-12T05:40:19.503 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-12T05:40:19.588 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-12T05:40:19.592 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-12T05:40:19.640 INFO:tasks.ceph:Running mkfs on mon nodes... 2021-11-12T05:40:19.641 DEBUG:teuthology.orchestra.run.gibba005:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2021-11-12T05:40:19.649 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-11-12T05:40:19.680 DEBUG:teuthology.orchestra.run.gibba005:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2021-11-12T05:40:19.687 DEBUG:teuthology.orchestra.run.gibba015:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2021-11-12T05:40:19.697 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-11-12T05:40:19.726 DEBUG:teuthology.orchestra.run.gibba015:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2021-11-12T05:40:19.734 DEBUG:teuthology.orchestra.run.gibba015:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2021-11-12T05:40:19.789 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-11-12T05:40:19.818 DEBUG:teuthology.orchestra.run.gibba015:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2021-11-12T05:40:19.825 DEBUG:teuthology.orchestra.run.gibba005:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-11-12T05:40:19.829 DEBUG:teuthology.orchestra.run.gibba015:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-11-12T05:40:19.871 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2021-11-12T05:40:19.872 INFO:tasks.ceph.mon.a:Restarting daemon 2021-11-12T05:40:19.873 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2021-11-12T05:40:19.875 INFO:tasks.ceph.mon.a:Started 2021-11-12T05:40:19.876 INFO:tasks.ceph.mon.b:Restarting daemon 2021-11-12T05:40:19.876 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2021-11-12T05:40:19.879 INFO:tasks.ceph.mon.b:Started 2021-11-12T05:40:19.879 INFO:tasks.ceph.mon.c:Restarting daemon 2021-11-12T05:40:19.879 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2021-11-12T05:40:19.882 INFO:tasks.ceph.mon.c:Started 2021-11-12T05:40:19.882 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2021-11-12T05:40:19.882 INFO:tasks.ceph.mgr.y:Restarting daemon 2021-11-12T05:40:19.883 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2021-11-12T05:40:19.885 INFO:tasks.ceph.mgr.y:Started 2021-11-12T05:40:19.885 INFO:tasks.ceph.mgr.x:Restarting daemon 2021-11-12T05:40:19.885 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2021-11-12T05:40:19.888 INFO:tasks.ceph.mgr.x:Started 2021-11-12T05:40:19.889 INFO:tasks.ceph:Setting crush tunables to default 2021-11-12T05:40:19.889 DEBUG:teuthology.orchestra.run.gibba005:> sudo ceph --cluster ceph osd crush tunables default 2021-11-12T05:40:19.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:19.941+0000 7fa35b30a700 1 Processor -- start 2021-11-12T05:40:19.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:19.941+0000 7fa35b30a700 1 -- start start 2021-11-12T05:40:19.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:19.941+0000 7fa35b30a700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fa354147310 0x7fa35405fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:19.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:19.941+0000 7fa35b30a700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa3540602b0 0x7fa354143140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:19.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:19.941+0000 7fa35b30a700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa354146700 con 0x7fa3540b2d30 2021-11-12T05:40:19.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:19.941+0000 7fa35b30a700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3540b3110 con 0x7fa3540602b0 2021-11-12T05:40:19.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:19.941+0000 7fa35b30a700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa354146930 con 0x7fa354147310 2021-11-12T05:40:19.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:19.941+0000 7fa3598a7700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa3540602b0 0x7fa354143140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:19.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:19.941+0000 7fa3598a7700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa3540602b0 0x7fa354143140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42050/0 (socket says 172.21.2.105:42050) 2021-11-12T05:40:19.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:19.941+0000 7fa3598a7700 1 -- 172.21.2.105:0/3659798550 learned_addr learned my addr 172.21.2.105:0/3659798550 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:19.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:19.941+0000 7fa3590a6700 1 --1- 172.21.2.105:0/3659798550 >> v1:172.21.2.105:6789/0 conn(0x7fa3540b2d30 0x7fa35405f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:52442/0 (socket says 172.21.2.105:52442) 2021-11-12T05:40:19.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:19.941+0000 7fa3598a7700 1 -- 172.21.2.105:0/3659798550 >> v2:172.21.2.105:3300/0 conn(0x7fa3540602b0 msgr2=0x7fa354143140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2021-11-12T05:40:19.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:19.941+0000 7fa3598a7700 1 -- 172.21.2.105:0/3659798550 >> v2:172.21.2.105:3300/0 conn(0x7fa3540602b0 msgr2=0x7fa354143140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-11-12T05:40:19.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:19.941+0000 7fa3598a7700 1 --2- 172.21.2.105:0/3659798550 >> v2:172.21.2.105:3300/0 conn(0x7fa3540602b0 0x7fa354143140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-11-12T05:40:19.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:19.941+0000 7fa3598a7700 1 --2- 172.21.2.105:0/3659798550 >> v2:172.21.2.105:3300/0 conn(0x7fa3540602b0 0x7fa354143140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-11-12T05:40:19.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:19.941+0000 7fa3588a5700 1 --2- 172.21.2.105:0/3659798550 >> v2:172.21.2.115:3300/0 conn(0x7fa354147310 0x7fa35405fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:19.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:19.941+0000 7fa3588a5700 1 -- 172.21.2.105:0/3659798550 >> v2:172.21.2.115:3300/0 conn(0x7fa354147310 msgr2=0x7fa35405fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-11-12T05:40:19.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:19.941+0000 7fa3588a5700 1 -- 172.21.2.105:0/3659798550 >> v2:172.21.2.115:3300/0 conn(0x7fa354147310 msgr2=0x7fa35405fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-11-12T05:40:19.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:19.941+0000 7fa3588a5700 1 --2- 172.21.2.105:0/3659798550 >> v2:172.21.2.115:3300/0 conn(0x7fa354147310 0x7fa35405fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-11-12T05:40:19.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:19.941+0000 7fa3588a5700 1 --2- 172.21.2.105:0/3659798550 >> v2:172.21.2.115:3300/0 conn(0x7fa354147310 0x7fa35405fdc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-11-12T05:40:20.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.013+0000 7fa353fff700 1 -- 172.21.2.105:0/3659798550 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4006924349 0 0) 0x7fa354146700 con 0x7fa3540b2d30 2021-11-12T05:40:20.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.013+0000 7fa353fff700 1 -- 172.21.2.105:0/3659798550 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa338003260 con 0x7fa3540b2d30 2021-11-12T05:40:20.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.013+0000 7fa353fff700 1 -- 172.21.2.105:0/3659798550 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3540322971 0 0) 0x7fa338003260 con 0x7fa3540b2d30 2021-11-12T05:40:20.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.013+0000 7fa353fff700 1 -- 172.21.2.105:0/3659798550 >> v2:172.21.2.115:3300/0 conn(0x7fa354147310 msgr2=0x7fa35405fdc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-11-12T05:40:20.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.013+0000 7fa353fff700 1 --2- 172.21.2.105:0/3659798550 >> v2:172.21.2.115:3300/0 conn(0x7fa354147310 0x7fa35405fdc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:20.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa353fff700 1 -- 172.21.2.105:0/3659798550 >> v2:172.21.2.105:3300/0 conn(0x7fa3540602b0 msgr2=0x7fa354143140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-11-12T05:40:20.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa353fff700 1 --2- 172.21.2.105:0/3659798550 >> v2:172.21.2.105:3300/0 conn(0x7fa3540602b0 0x7fa354143140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:20.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa353fff700 1 -- 172.21.2.105:0/3659798550 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa354146bd0 con 0x7fa3540b2d30 2021-11-12T05:40:20.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa353fff700 1 -- 172.21.2.105:0/3659798550 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fa34c001660 con 0x7fa3540b2d30 2021-11-12T05:40:20.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa353fff700 1 -- 172.21.2.105:0/3659798550 >> v1:172.21.2.105:6789/0 conn(0x7fa3540b2d30 legacy=0x7fa35405f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:20.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa353fff700 1 --2- 172.21.2.105:0/3659798550 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa338003750 0x7fa338003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:20.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa353fff700 1 --2- 172.21.2.105:0/3659798550 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa338004500 0x7fa338004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:20.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa353fff700 1 --2- 172.21.2.105:0/3659798550 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa338004e70 0x7fa33800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:20.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa353fff700 1 -- 172.21.2.105:0/3659798550 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3540b3110 con 0x7fa338004500 2021-11-12T05:40:20.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa353fff700 1 -- 172.21.2.105:0/3659798550 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa354146930 con 0x7fa338004e70 2021-11-12T05:40:20.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa353fff700 1 -- 172.21.2.105:0/3659798550 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa33800bd70 con 0x7fa338003750 2021-11-12T05:40:20.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa3588a5700 1 --2- 172.21.2.105:0/3659798550 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa338004500 0x7fa338004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:20.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa3588a5700 1 -- 172.21.2.105:0/3659798550 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa338003750 msgr2=0x7fa338003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:20.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa3588a5700 1 --2- 172.21.2.105:0/3659798550 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa338003750 0x7fa338003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:20.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa3588a5700 1 -- 172.21.2.105:0/3659798550 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa338004e70 msgr2=0x7fa33800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:20.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa3588a5700 1 --2- 172.21.2.105:0/3659798550 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa338004e70 0x7fa33800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:20.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa3598a7700 1 -- 172.21.2.105:0/3659798550 reap_dead start 2021-11-12T05:40:20.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa3588a5700 1 -- 172.21.2.105:0/3659798550 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa338003260 con 0x7fa338004500 2021-11-12T05:40:20.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa3588a5700 1 --2- 172.21.2.105:0/3659798550 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa338004500 0x7fa338004980 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fa340000e90 tx=0x7fa340008040).ready entity=mon.0 client_cookie=ee2f9d3db73db2bb server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:20.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa353fff700 1 -- 172.21.2.105:0/3659798550 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa340013620 con 0x7fa338004500 2021-11-12T05:40:20.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa353fff700 1 -- 172.21.2.105:0/3659798550 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa340013780 con 0x7fa338004500 2021-11-12T05:40:20.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa353fff700 1 -- 172.21.2.105:0/3659798550 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa340013ae0 con 0x7fa338004500 2021-11-12T05:40:20.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa35b30a700 1 -- 172.21.2.105:0/3659798550 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa338004500 msgr2=0x7fa338004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:20.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa35b30a700 1 --2- 172.21.2.105:0/3659798550 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa338004500 0x7fa338004980 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fa340000e90 tx=0x7fa340008040).stop 2021-11-12T05:40:20.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa35b30a700 1 -- 172.21.2.105:0/3659798550 shutdown_connections 2021-11-12T05:40:20.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa35b30a700 1 --2- 172.21.2.105:0/3659798550 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa338004500 0x7fa338004980 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:20.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa35b30a700 1 -- 172.21.2.105:0/3659798550 >> 172.21.2.105:0/3659798550 conn(0x7fa354062f60 msgr2=0x7fa354063370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:20.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa35b30a700 1 -- 172.21.2.105:0/3659798550 shutdown_connections 2021-11-12T05:40:20.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa35b30a700 1 -- 172.21.2.105:0/3659798550 wait complete. 2021-11-12T05:40:20.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa35b30a700 1 Processor -- start 2021-11-12T05:40:20.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa35b30a700 1 -- start start 2021-11-12T05:40:20.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa35b30a700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa338004500 0x7fa354064130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:20.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa35b30a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa354065e90 0x7fa3540a2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:20.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa35b30a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa354155ac0 0x7fa354155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:20.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa35b30a700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa354063fa0 con 0x7fa354065e90 2021-11-12T05:40:20.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa35b30a700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3540677b0 con 0x7fa338004500 2021-11-12T05:40:20.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa35b30a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3540679e0 con 0x7fa354155ac0 2021-11-12T05:40:20.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa3588a5700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa354065e90 0x7fa3540a2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:20.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa3588a5700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa354065e90 0x7fa3540a2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42076/0 (socket says 172.21.2.105:42076) 2021-11-12T05:40:20.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa3588a5700 1 -- 172.21.2.105:0/1018769588 learned_addr learned my addr 172.21.2.105:0/1018769588 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:20.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa3588a5700 1 -- 172.21.2.105:0/1018769588 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa354155ac0 msgr2=0x7fa354155f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:20.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa3588a5700 1 --2- 172.21.2.105:0/1018769588 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa354155ac0 0x7fa354155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:20.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa3588a5700 1 -- 172.21.2.105:0/1018769588 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa338004500 msgr2=0x7fa354064130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:20.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa3588a5700 1 --2- 172.21.2.105:0/1018769588 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa338004500 0x7fa354064130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:20.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa3588a5700 1 -- 172.21.2.105:0/1018769588 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa354067c80 con 0x7fa354065e90 2021-11-12T05:40:20.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa3588a5700 1 --2- 172.21.2.105:0/1018769588 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa354065e90 0x7fa3540a2dc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fa354065480 tx=0x7fa340008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:20.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa3527fc700 1 -- 172.21.2.105:0/1018769588 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa340013e10 con 0x7fa354065e90 2021-11-12T05:40:20.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa3527fc700 1 -- 172.21.2.105:0/1018769588 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa340012c50 con 0x7fa354065e90 2021-11-12T05:40:20.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa3527fc700 1 -- 172.21.2.105:0/1018769588 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa340006030 con 0x7fa354065e90 2021-11-12T05:40:20.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa35b30a700 1 -- 172.21.2.105:0/1018769588 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa354065a00 con 0x7fa354065e90 2021-11-12T05:40:20.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa35b30a700 1 -- 172.21.2.105:0/1018769588 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa354156440 con 0x7fa354065e90 2021-11-12T05:40:20.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa3527fc700 1 -- 172.21.2.105:0/1018769588 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fa340026030 con 0x7fa354065e90 2021-11-12T05:40:20.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa3527fc700 1 -- 172.21.2.105:0/1018769588 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7fa3400056f0 con 0x7fa354065e90 2021-11-12T05:40:20.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.017+0000 7fa35b30a700 1 -- 172.21.2.105:0/1018769588 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa354146e70 con 0x7fa354065e90 2021-11-12T05:40:20.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.021+0000 7fa3527fc700 1 -- 172.21.2.105:0/1018769588 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fa340024070 con 0x7fa354065e90 2021-11-12T05:40:20.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.061+0000 7fa35b30a700 1 -- 172.21.2.105:0/1018769588 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fa354057350 con 0x7fa354065e90 2021-11-12T05:40:20.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.065+0000 7fa3527fc700 1 -- 172.21.2.105:0/1018769588 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fa3400058b0 con 0x7fa354065e90 2021-11-12T05:40:20.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.065+0000 7fa35b30a700 1 -- 172.21.2.105:0/1018769588 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa354065e90 msgr2=0x7fa3540a2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:20.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.065+0000 7fa35b30a700 1 --2- 172.21.2.105:0/1018769588 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa354065e90 0x7fa3540a2dc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fa354065480 tx=0x7fa340008040).stop 2021-11-12T05:40:20.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.069+0000 7fa35b30a700 1 -- 172.21.2.105:0/1018769588 shutdown_connections 2021-11-12T05:40:20.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.069+0000 7fa35b30a700 1 --2- 172.21.2.105:0/1018769588 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa354155ac0 0x7fa354155f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:20.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.069+0000 7fa35b30a700 1 --2- 172.21.2.105:0/1018769588 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa354065e90 0x7fa3540a2dc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:20.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.069+0000 7fa35b30a700 1 --2- 172.21.2.105:0/1018769588 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa338004500 0x7fa354064130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:20.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.069+0000 7fa35b30a700 1 -- 172.21.2.105:0/1018769588 >> 172.21.2.105:0/1018769588 conn(0x7fa354062f60 msgr2=0x7fa35413bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:20.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.069+0000 7fa35b30a700 1 -- 172.21.2.105:0/1018769588 shutdown_connections 2021-11-12T05:40:20.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:20.069+0000 7fa35b30a700 1 -- 172.21.2.105:0/1018769588 wait complete. 2021-11-12T05:40:20.077 INFO:teuthology.orchestra.run.gibba005.stderr:adjusted tunables profile to default 2021-11-12T05:40:20.078 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2021-11-12T05:40:20.079 DEBUG:teuthology.orchestra.run.gibba005:> mktemp 2021-11-12T05:40:20.083 INFO:teuthology.orchestra.run.gibba005.stdout:/tmp/tmp.79Eg92Np9S 2021-11-12T05:40:20.085 DEBUG:teuthology.orchestra.run.gibba005:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.79Eg92Np9S 2021-11-12T05:40:20.091 DEBUG:teuthology.orchestra.run.gibba005:> sudo chmod 0666 /tmp/tmp.79Eg92Np9S 2021-11-12T05:40:20.151 DEBUG:teuthology.orchestra.remote:gibba005:/tmp/tmp.79Eg92Np9S is 37B 2021-11-12T05:40:20.163 DEBUG:teuthology.orchestra.run.gibba005:> rm -fr /tmp/tmp.79Eg92Np9S 2021-11-12T05:40:20.169 DEBUG:teuthology.orchestra.run.gibba005:> mktemp 2021-11-12T05:40:20.218 INFO:teuthology.orchestra.run.gibba005.stdout:/tmp/tmp.oVE5iRvH95 2021-11-12T05:40:20.218 DEBUG:teuthology.orchestra.run.gibba005:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.oVE5iRvH95 2021-11-12T05:40:20.224 DEBUG:teuthology.orchestra.run.gibba005:> sudo chmod 0666 /tmp/tmp.oVE5iRvH95 2021-11-12T05:40:20.237 DEBUG:teuthology.orchestra.remote:gibba005:/tmp/tmp.oVE5iRvH95 is 37B 2021-11-12T05:40:20.287 DEBUG:teuthology.orchestra.run.gibba005:> rm -fr /tmp/tmp.oVE5iRvH95 2021-11-12T05:40:20.291 DEBUG:teuthology.orchestra.run.gibba005:> mktemp 2021-11-12T05:40:20.294 INFO:teuthology.orchestra.run.gibba005.stdout:/tmp/tmp.gZIpPFnRLm 2021-11-12T05:40:20.294 DEBUG:teuthology.orchestra.run.gibba005:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.gZIpPFnRLm 2021-11-12T05:40:20.344 DEBUG:teuthology.orchestra.run.gibba005:> sudo chmod 0666 /tmp/tmp.gZIpPFnRLm 2021-11-12T05:40:20.355 DEBUG:teuthology.orchestra.remote:gibba005:/tmp/tmp.gZIpPFnRLm is 37B 2021-11-12T05:40:20.405 DEBUG:teuthology.orchestra.run.gibba005:> rm -fr /tmp/tmp.gZIpPFnRLm 2021-11-12T05:40:20.410 DEBUG:teuthology.orchestra.run.gibba005:> mktemp 2021-11-12T05:40:20.416 INFO:teuthology.orchestra.run.gibba005.stdout:/tmp/tmp.tjDclpRtdd 2021-11-12T05:40:20.417 DEBUG:teuthology.orchestra.run.gibba005:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.tjDclpRtdd 2021-11-12T05:40:20.468 DEBUG:teuthology.orchestra.run.gibba005:> sudo chmod 0666 /tmp/tmp.tjDclpRtdd 2021-11-12T05:40:20.479 DEBUG:teuthology.orchestra.remote:gibba005:/tmp/tmp.tjDclpRtdd is 37B 2021-11-12T05:40:20.529 DEBUG:teuthology.orchestra.run.gibba005:> rm -fr /tmp/tmp.tjDclpRtdd 2021-11-12T05:40:20.533 DEBUG:teuthology.orchestra.run.gibba015:> mktemp 2021-11-12T05:40:20.537 INFO:teuthology.orchestra.run.gibba015.stdout:/tmp/tmp.OPbXaVsgYN 2021-11-12T05:40:20.537 DEBUG:teuthology.orchestra.run.gibba015:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.OPbXaVsgYN 2021-11-12T05:40:20.585 DEBUG:teuthology.orchestra.run.gibba015:> sudo chmod 0666 /tmp/tmp.OPbXaVsgYN 2021-11-12T05:40:20.599 DEBUG:teuthology.orchestra.remote:gibba015:/tmp/tmp.OPbXaVsgYN is 37B 2021-11-12T05:40:20.651 DEBUG:teuthology.orchestra.run.gibba015:> rm -fr /tmp/tmp.OPbXaVsgYN 2021-11-12T05:40:20.655 DEBUG:teuthology.orchestra.run.gibba015:> mktemp 2021-11-12T05:40:20.658 INFO:teuthology.orchestra.run.gibba015.stdout:/tmp/tmp.bxXM6h9Kx2 2021-11-12T05:40:20.658 DEBUG:teuthology.orchestra.run.gibba015:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.bxXM6h9Kx2 2021-11-12T05:40:20.704 DEBUG:teuthology.orchestra.run.gibba015:> sudo chmod 0666 /tmp/tmp.bxXM6h9Kx2 2021-11-12T05:40:20.715 DEBUG:teuthology.orchestra.remote:gibba015:/tmp/tmp.bxXM6h9Kx2 is 37B 2021-11-12T05:40:20.764 DEBUG:teuthology.orchestra.run.gibba015:> rm -fr /tmp/tmp.bxXM6h9Kx2 2021-11-12T05:40:20.769 DEBUG:teuthology.orchestra.run.gibba015:> mktemp 2021-11-12T05:40:20.772 INFO:teuthology.orchestra.run.gibba015.stdout:/tmp/tmp.oONi2e2znS 2021-11-12T05:40:20.773 DEBUG:teuthology.orchestra.run.gibba015:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.oONi2e2znS 2021-11-12T05:40:20.779 DEBUG:teuthology.orchestra.run.gibba015:> sudo chmod 0666 /tmp/tmp.oONi2e2znS 2021-11-12T05:40:20.832 DEBUG:teuthology.orchestra.remote:gibba015:/tmp/tmp.oONi2e2znS is 37B 2021-11-12T05:40:20.839 DEBUG:teuthology.orchestra.run.gibba015:> rm -fr /tmp/tmp.oONi2e2znS 2021-11-12T05:40:20.842 DEBUG:teuthology.orchestra.run.gibba015:> mktemp 2021-11-12T05:40:20.886 INFO:teuthology.orchestra.run.gibba015.stdout:/tmp/tmp.jbM1h1CHvr 2021-11-12T05:40:20.886 DEBUG:teuthology.orchestra.run.gibba015:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.jbM1h1CHvr 2021-11-12T05:40:20.892 DEBUG:teuthology.orchestra.run.gibba015:> sudo chmod 0666 /tmp/tmp.jbM1h1CHvr 2021-11-12T05:40:20.945 DEBUG:teuthology.orchestra.remote:gibba015:/tmp/tmp.jbM1h1CHvr is 37B 2021-11-12T05:40:20.953 DEBUG:teuthology.orchestra.run.gibba015:> rm -fr /tmp/tmp.jbM1h1CHvr 2021-11-12T05:40:20.956 DEBUG:teuthology.orchestra.run.gibba015:> sudo ceph --cluster ceph osd new ee8e30a0-4819-4475-80ec-dd3ee7d01322 0 2021-11-12T05:40:21.049 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.045+0000 7fe9fa119700 1 Processor -- start 2021-11-12T05:40:21.049 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.045+0000 7fe9fa119700 1 -- start start 2021-11-12T05:40:21.054 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.045+0000 7fe9fa119700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe9f405d760 0x7fe9f40b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:21.054 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.045+0000 7fe9fa119700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe9f40b06e0 0x7fe9f40af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:21.055 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.045+0000 7fe9fa119700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f40ae9e0 con 0x7fe9f405fdc0 2021-11-12T05:40:21.055 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.045+0000 7fe9fa119700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9f40b31f0 con 0x7fe9f40b06e0 2021-11-12T05:40:21.055 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.045+0000 7fe9fa119700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f4067cb0 con 0x7fe9f405d760 2021-11-12T05:40:21.056 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.045+0000 7fe9f37fe700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe9f405d760 0x7fe9f40b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:21.056 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.045+0000 7fe9f37fe700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe9f405d760 0x7fe9f40b1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3301/0 says I am v2:172.21.2.115:40210/0 (socket says 172.21.2.115:40210) 2021-11-12T05:40:21.056 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.045+0000 7fe9f37fe700 1 -- 172.21.2.115:0/1323777635 learned_addr learned my addr 172.21.2.115:0/1323777635 (peer_addr_for_me v2:172.21.2.115:0/0) 2021-11-12T05:40:21.056 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.045+0000 7fe9f2ffd700 1 --2- 172.21.2.115:0/1323777635 >> v2:172.21.2.105:3300/0 conn(0x7fe9f40b06e0 0x7fe9f40af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:21.056 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.045+0000 7fe9f37fe700 1 -- 172.21.2.115:0/1323777635 >> v2:172.21.2.105:3300/0 conn(0x7fe9f40b06e0 msgr2=0x7fe9f40af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:21.057 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.045+0000 7fe9f37fe700 1 --2- 172.21.2.115:0/1323777635 >> v2:172.21.2.105:3300/0 conn(0x7fe9f40b06e0 0x7fe9f40af0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.057 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.045+0000 7fe9f37fe700 1 -- 172.21.2.115:0/1323777635 >> v1:172.21.2.105:6789/0 conn(0x7fe9f405fdc0 legacy=0x7fe9f41425d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:21.057 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.045+0000 7fe9f37fe700 1 -- 172.21.2.115:0/1323777635 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f40b0bf0 con 0x7fe9f405d760 2021-11-12T05:40:21.058 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.045+0000 7fe9f37fe700 1 --2- 172.21.2.115:0/1323777635 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe9f405d760 0x7fe9f40b1200 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fe9dc002f70 tx=0x7fe9dc006f40).ready entity=mon.2 client_cookie=f422264e0b7cc91a server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:21.058 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.045+0000 7fe9f27fc700 1 -- 172.21.2.115:0/1323777635 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9dc00da80 con 0x7fe9f405d760 2021-11-12T05:40:21.058 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.045+0000 7fe9f27fc700 1 -- 172.21.2.115:0/1323777635 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9dc000e90 con 0x7fe9f405d760 2021-11-12T05:40:21.058 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.045+0000 7fe9f27fc700 1 -- 172.21.2.115:0/1323777635 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9dc00de10 con 0x7fe9f405d760 2021-11-12T05:40:21.059 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.049+0000 7fe9fa119700 1 -- 172.21.2.115:0/1323777635 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe9f405d760 msgr2=0x7fe9f40b1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.059 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.049+0000 7fe9fa119700 1 --2- 172.21.2.115:0/1323777635 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe9f405d760 0x7fe9f40b1200 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fe9dc002f70 tx=0x7fe9dc006f40).stop 2021-11-12T05:40:21.059 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.049+0000 7fe9fa119700 1 -- 172.21.2.115:0/1323777635 shutdown_connections 2021-11-12T05:40:21.060 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.049+0000 7fe9fa119700 1 --2- 172.21.2.115:0/1323777635 >> v2:172.21.2.105:3300/0 conn(0x7fe9f40b06e0 0x7fe9f40af0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.060 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.049+0000 7fe9fa119700 1 --2- 172.21.2.115:0/1323777635 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe9f405d760 0x7fe9f40b1200 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.060 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.049+0000 7fe9fa119700 1 -- 172.21.2.115:0/1323777635 >> 172.21.2.115:0/1323777635 conn(0x7fe9f40632b0 msgr2=0x7fe9f405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:21.060 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.049+0000 7fe9fa119700 1 -- 172.21.2.115:0/1323777635 shutdown_connections 2021-11-12T05:40:21.061 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.049+0000 7fe9fa119700 1 -- 172.21.2.115:0/1323777635 wait complete. 2021-11-12T05:40:21.061 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.049+0000 7fe9fa119700 1 Processor -- start 2021-11-12T05:40:21.061 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.049+0000 7fe9fa119700 1 -- start start 2021-11-12T05:40:21.062 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.049+0000 7fe9fa119700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9f405d760 0x7fe9f40b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:21.062 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.049+0000 7fe9fa119700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe9f405fdc0 0x7fe9f413bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:21.063 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.049+0000 7fe9fa119700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe9f40b06e0 0x7fe9f413c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:21.063 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.049+0000 7fe9fa119700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f4144080 con 0x7fe9f405d760 2021-11-12T05:40:21.064 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.049+0000 7fe9fa119700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f4144320 con 0x7fe9f40b06e0 2021-11-12T05:40:21.064 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.049+0000 7fe9fa119700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f41445c0 con 0x7fe9f405fdc0 2021-11-12T05:40:21.065 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.049+0000 7fe9f2ffd700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe9f405fdc0 0x7fe9f413bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:21.065 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.049+0000 7fe9f2ffd700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe9f405fdc0 0x7fe9f413bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3301/0 says I am v2:172.21.2.115:40216/0 (socket says 172.21.2.115:40216) 2021-11-12T05:40:21.065 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.049+0000 7fe9f2ffd700 1 -- 172.21.2.115:0/1927459895 learned_addr learned my addr 172.21.2.115:0/1927459895 (peer_addr_for_me v2:172.21.2.115:0/0) 2021-11-12T05:40:21.065 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.049+0000 7fe9f3fff700 1 --2- 172.21.2.115:0/1927459895 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe9f40b06e0 0x7fe9f413c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:21.066 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.049+0000 7fe9f37fe700 1 --2- 172.21.2.115:0/1927459895 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9f405d760 0x7fe9f40b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:21.066 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.049+0000 7fe9f2ffd700 1 -- 172.21.2.115:0/1927459895 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe9f40b06e0 msgr2=0x7fe9f413c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.066 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.049+0000 7fe9f2ffd700 1 --2- 172.21.2.115:0/1927459895 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe9f40b06e0 0x7fe9f413c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.066 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.049+0000 7fe9f2ffd700 1 -- 172.21.2.115:0/1927459895 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9f405d760 msgr2=0x7fe9f40b48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.066 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.049+0000 7fe9f2ffd700 1 --2- 172.21.2.115:0/1927459895 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9f405d760 0x7fe9f40b48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.067 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.049+0000 7fe9f2ffd700 1 -- 172.21.2.115:0/1927459895 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9dc00b460 con 0x7fe9f405fdc0 2021-11-12T05:40:21.067 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.049+0000 7fe9f37fe700 1 --2- 172.21.2.115:0/1927459895 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9f405d760 0x7fe9f40b48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:40:21.067 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.049+0000 7fe9f2ffd700 1 --2- 172.21.2.115:0/1927459895 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe9f405fdc0 0x7fe9f413bf00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fe9e400c000 tx=0x7fe9e4006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:21.067 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.049+0000 7fe9f0ff9700 1 -- 172.21.2.115:0/1927459895 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9e4010780 con 0x7fe9f405fdc0 2021-11-12T05:40:21.068 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.049+0000 7fe9f0ff9700 1 -- 172.21.2.115:0/1927459895 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e40108e0 con 0x7fe9f405fdc0 2021-11-12T05:40:21.068 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.049+0000 7fe9fa119700 1 -- 172.21.2.115:0/1927459895 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f4143dc0 con 0x7fe9f405fdc0 2021-11-12T05:40:21.068 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.049+0000 7fe9f0ff9700 1 -- 172.21.2.115:0/1927459895 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9e4010c40 con 0x7fe9f405fdc0 2021-11-12T05:40:21.068 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.049+0000 7fe9fa119700 1 -- 172.21.2.115:0/1927459895 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f4144a60 con 0x7fe9f405fdc0 2021-11-12T05:40:21.068 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.049+0000 7fe9f0ff9700 1 -- 172.21.2.115:0/1927459895 <== mon.2 v2:172.21.2.115:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fe9e401c460 con 0x7fe9f405fdc0 2021-11-12T05:40:21.069 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.049+0000 7fe9f0ff9700 1 -- 172.21.2.115:0/1927459895 <== mon.2 v2:172.21.2.115:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7fe9e40123f0 con 0x7fe9f405fdc0 2021-11-12T05:40:21.069 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.049+0000 7fe9fa119700 1 -- 172.21.2.115:0/1927459895 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9f4144780 con 0x7fe9f405fdc0 2021-11-12T05:40:21.070 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.053+0000 7fe9f0ff9700 1 -- 172.21.2.115:0/1927459895 <== mon.2 v2:172.21.2.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fe9e4012600 con 0x7fe9f405fdc0 2021-11-12T05:40:21.099 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.093+0000 7fe9fa119700 1 -- 172.21.2.115:0/1927459895 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ee8e30a0-4819-4475-80ec-dd3ee7d01322", "id": 0} v 0) v1 -- 0x7fe9f40aec10 con 0x7fe9f405fdc0 2021-11-12T05:40:21.103 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.101+0000 7fe9f0ff9700 1 -- 172.21.2.115:0/1927459895 <== mon.2 v2:172.21.2.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ee8e30a0-4819-4475-80ec-dd3ee7d01322", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe9e4006020 con 0x7fe9f405fdc0 2021-11-12T05:40:21.103 INFO:teuthology.orchestra.run.gibba015.stdout:0 2021-11-12T05:40:21.105 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.101+0000 7fe9fa119700 1 -- 172.21.2.115:0/1927459895 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe9f405fdc0 msgr2=0x7fe9f413bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.105 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.101+0000 7fe9fa119700 1 --2- 172.21.2.115:0/1927459895 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe9f405fdc0 0x7fe9f413bf00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fe9e400c000 tx=0x7fe9e4006df0).stop 2021-11-12T05:40:21.105 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.101+0000 7fe9fa119700 1 -- 172.21.2.115:0/1927459895 shutdown_connections 2021-11-12T05:40:21.105 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.101+0000 7fe9fa119700 1 --2- 172.21.2.115:0/1927459895 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe9f40b06e0 0x7fe9f413c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.106 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.101+0000 7fe9fa119700 1 --2- 172.21.2.115:0/1927459895 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe9f405fdc0 0x7fe9f413bf00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.106 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.101+0000 7fe9fa119700 1 --2- 172.21.2.115:0/1927459895 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9f405d760 0x7fe9f40b48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.106 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.101+0000 7fe9fa119700 1 -- 172.21.2.115:0/1927459895 >> 172.21.2.115:0/1927459895 conn(0x7fe9f40632b0 msgr2=0x7fe9f4064b70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:21.106 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.101+0000 7fe9fa119700 1 -- 172.21.2.115:0/1927459895 shutdown_connections 2021-11-12T05:40:21.107 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.101+0000 7fe9fa119700 1 -- 172.21.2.115:0/1927459895 wait complete. 2021-11-12T05:40:21.110 DEBUG:teuthology.orchestra.run.gibba015:> sudo ceph --cluster ceph osd new b1bb06c3-26d0-4d92-82f8-b3e882242785 1 2021-11-12T05:40:21.161 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.157+0000 7f066f014700 1 Processor -- start 2021-11-12T05:40:21.162 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.157+0000 7f066f014700 1 -- start start 2021-11-12T05:40:21.164 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.157+0000 7f066f014700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f06680ade50 0x7f06680b68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:21.164 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.157+0000 7f066f014700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f06680b14f0 0x7f06681396c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:21.164 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.157+0000 7f066f014700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f066813fd30 con 0x7f06680b64d0 2021-11-12T05:40:21.165 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.157+0000 7f066f014700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06680ae820 con 0x7f06680b14f0 2021-11-12T05:40:21.165 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.157+0000 7f066f014700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f066813ffd0 con 0x7f06680ade50 2021-11-12T05:40:21.165 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.157+0000 7f066d811700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f06680ade50 0x7f06680b68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:21.165 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.157+0000 7f066e012700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7f06680b64d0 0x7f0668140470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.115:41996/0 (socket says 172.21.2.115:41996) 2021-11-12T05:40:21.165 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.157+0000 7f066e012700 1 -- 172.21.2.115:0/1825943497 learned_addr learned my addr 172.21.2.115:0/1825943497 (peer_addr_for_me v1:172.21.2.115:0/0) 2021-11-12T05:40:21.166 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.157+0000 7f066e813700 1 --2- 172.21.2.115:0/1825943497 >> v2:172.21.2.115:3300/0 conn(0x7f06680b14f0 0x7f06681396c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:21.166 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.157+0000 7f066d811700 1 -- 172.21.2.115:0/1825943497 >> v2:172.21.2.115:3300/0 conn(0x7f06680b14f0 msgr2=0x7f06681396c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:21.166 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.157+0000 7f066d811700 1 --2- 172.21.2.115:0/1825943497 >> v2:172.21.2.115:3300/0 conn(0x7f06680b14f0 0x7f06681396c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.166 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.157+0000 7f066d811700 1 -- 172.21.2.115:0/1825943497 >> v1:172.21.2.115:6789/0 conn(0x7f06680b64d0 legacy=0x7f0668140470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.167 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.157+0000 7f066d010700 1 -- 172.21.2.115:0/1825943497 <== mon.1 v1:172.21.2.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 709580883 0 0) 0x7f066813fd30 con 0x7f06680b64d0 2021-11-12T05:40:21.167 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.157+0000 7f066d811700 1 -- 172.21.2.115:0/1825943497 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06680b1b50 con 0x7f06680ade50 2021-11-12T05:40:21.167 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.157+0000 7f066d811700 1 --2- 172.21.2.115:0/1825943497 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f06680ade50 0x7f06680b68b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f06680af410 tx=0x7f065c006d90).ready entity=mon.2 client_cookie=a64760a8971ae1f5 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:21.167 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.157+0000 7f066d010700 1 -- 172.21.2.115:0/1825943497 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f065c00f8a0 con 0x7f06680ade50 2021-11-12T05:40:21.167 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.157+0000 7f066d010700 1 -- 172.21.2.115:0/1825943497 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f065c000e90 con 0x7f06680ade50 2021-11-12T05:40:21.168 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.157+0000 7f066d010700 1 -- 172.21.2.115:0/1825943497 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f065c00fbf0 con 0x7f06680ade50 2021-11-12T05:40:21.168 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.161+0000 7f066f014700 1 -- 172.21.2.115:0/1825943497 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f06680ade50 msgr2=0x7f06680b68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.168 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.161+0000 7f066f014700 1 --2- 172.21.2.115:0/1825943497 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f06680ade50 0x7f06680b68b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f06680af410 tx=0x7f065c006d90).stop 2021-11-12T05:40:21.168 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.161+0000 7f066f014700 1 -- 172.21.2.115:0/1825943497 shutdown_connections 2021-11-12T05:40:21.169 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.161+0000 7f066f014700 1 --2- 172.21.2.115:0/1825943497 >> v2:172.21.2.115:3300/0 conn(0x7f06680b14f0 0x7f06681396c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.169 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.161+0000 7f066f014700 1 --2- 172.21.2.115:0/1825943497 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f06680ade50 0x7f06680b68b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.169 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.161+0000 7f066f014700 1 -- 172.21.2.115:0/1825943497 >> 172.21.2.115:0/1825943497 conn(0x7f06680613f0 msgr2=0x7f06680617d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:21.169 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.161+0000 7f066f014700 1 -- 172.21.2.115:0/1825943497 shutdown_connections 2021-11-12T05:40:21.169 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.161+0000 7f066f014700 1 -- 172.21.2.115:0/1825943497 wait complete. 2021-11-12T05:40:21.170 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.161+0000 7f066f014700 1 Processor -- start 2021-11-12T05:40:21.170 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.161+0000 7f066f014700 1 -- start start 2021-11-12T05:40:21.173 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.161+0000 7f066f014700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f06680ade50 0x7f066813e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:21.173 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.161+0000 7f066f014700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f06680b14f0 0x7f0668064d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:21.173 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.161+0000 7f066f014700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06680b64d0 0x7f06681525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:21.173 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.161+0000 7f066f014700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06680653d0 con 0x7f06680b64d0 2021-11-12T05:40:21.174 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.161+0000 7f066f014700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0668065670 con 0x7f06680ade50 2021-11-12T05:40:21.174 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.161+0000 7f066f014700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0668065910 con 0x7f06680b14f0 2021-11-12T05:40:21.174 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.161+0000 7f066d811700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f06680b14f0 0x7f0668064d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:21.174 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.161+0000 7f066d811700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f06680b14f0 0x7f0668064d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3301/0 says I am v2:172.21.2.115:40230/0 (socket says 172.21.2.115:40230) 2021-11-12T05:40:21.175 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.161+0000 7f066d811700 1 -- 172.21.2.115:0/2300756930 learned_addr learned my addr 172.21.2.115:0/2300756930 (peer_addr_for_me v2:172.21.2.115:0/0) 2021-11-12T05:40:21.175 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.161+0000 7f066e012700 1 --2- 172.21.2.115:0/2300756930 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f06680ade50 0x7f066813e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:21.175 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.161+0000 7f066e813700 1 --2- 172.21.2.115:0/2300756930 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06680b64d0 0x7f06681525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:21.175 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.161+0000 7f066d811700 1 -- 172.21.2.115:0/2300756930 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f06680ade50 msgr2=0x7f066813e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.176 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.161+0000 7f066d811700 1 --2- 172.21.2.115:0/2300756930 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f06680ade50 0x7f066813e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.176 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.161+0000 7f066d811700 1 -- 172.21.2.115:0/2300756930 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06680b64d0 msgr2=0x7f06681525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.176 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.161+0000 7f066d811700 1 --2- 172.21.2.115:0/2300756930 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06680b64d0 0x7f06681525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.176 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.161+0000 7f066d811700 1 -- 172.21.2.115:0/2300756930 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f065c00b120 con 0x7f06680b14f0 2021-11-12T05:40:21.177 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.161+0000 7f066e813700 1 --2- 172.21.2.115:0/2300756930 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06680b64d0 0x7f06681525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:40:21.177 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.161+0000 7f066d811700 1 --2- 172.21.2.115:0/2300756930 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f06680b14f0 0x7f0668064d30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f06680af410 tx=0x7f065c016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:21.177 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.161+0000 7f065b7fe700 1 -- 172.21.2.115:0/2300756930 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f065c00fbe0 con 0x7f06680b14f0 2021-11-12T05:40:21.177 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.161+0000 7f065b7fe700 1 -- 172.21.2.115:0/2300756930 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f065c01e070 con 0x7f06680b14f0 2021-11-12T05:40:21.178 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.161+0000 7f066f014700 1 -- 172.21.2.115:0/2300756930 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0668152140 con 0x7f06680b14f0 2021-11-12T05:40:21.178 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.161+0000 7f066f014700 1 -- 172.21.2.115:0/2300756930 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06681421d0 con 0x7f06680b14f0 2021-11-12T05:40:21.178 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.161+0000 7f065b7fe700 1 -- 172.21.2.115:0/2300756930 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f065c010e90 con 0x7f06680b14f0 2021-11-12T05:40:21.178 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.161+0000 7f065b7fe700 1 -- 172.21.2.115:0/2300756930 <== mon.2 v2:172.21.2.115:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f065c02a070 con 0x7f06680b14f0 2021-11-12T05:40:21.178 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.161+0000 7f065b7fe700 1 -- 172.21.2.115:0/2300756930 <== mon.2 v2:172.21.2.115:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7f065c01a410 con 0x7f06680b14f0 2021-11-12T05:40:21.179 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.161+0000 7f066f014700 1 -- 172.21.2.115:0/2300756930 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0668065220 con 0x7f06680b14f0 2021-11-12T05:40:21.179 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.165+0000 7f065b7fe700 1 -- 172.21.2.115:0/2300756930 <== mon.2 v2:172.21.2.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f065c028060 con 0x7f06680b14f0 2021-11-12T05:40:21.212 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.209+0000 7f066f014700 1 -- 172.21.2.115:0/2300756930 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b1bb06c3-26d0-4d92-82f8-b3e882242785", "id": 1} v 0) v1 -- 0x7f0668065ad0 con 0x7f06680b14f0 2021-11-12T05:40:21.216 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.213+0000 7f065b7fe700 1 -- 172.21.2.115:0/2300756930 <== mon.2 v2:172.21.2.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b1bb06c3-26d0-4d92-82f8-b3e882242785", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f065c014030 con 0x7f06680b14f0 2021-11-12T05:40:21.217 INFO:teuthology.orchestra.run.gibba015.stdout:1 2021-11-12T05:40:21.217 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.213+0000 7f066f014700 1 -- 172.21.2.115:0/2300756930 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f06680b14f0 msgr2=0x7f0668064d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.218 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.213+0000 7f066f014700 1 --2- 172.21.2.115:0/2300756930 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f06680b14f0 0x7f0668064d30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f06680af410 tx=0x7f065c016000).stop 2021-11-12T05:40:21.218 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.213+0000 7f066f014700 1 -- 172.21.2.115:0/2300756930 shutdown_connections 2021-11-12T05:40:21.218 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.213+0000 7f066f014700 1 --2- 172.21.2.115:0/2300756930 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06680b64d0 0x7f06681525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.219 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.213+0000 7f066f014700 1 --2- 172.21.2.115:0/2300756930 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f06680b14f0 0x7f0668064d30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.219 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.213+0000 7f066f014700 1 --2- 172.21.2.115:0/2300756930 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f06680ade50 0x7f066813e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.219 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.213+0000 7f066f014700 1 -- 172.21.2.115:0/2300756930 >> 172.21.2.115:0/2300756930 conn(0x7f06680613f0 msgr2=0x7f06680617d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:21.219 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.213+0000 7f066f014700 1 -- 172.21.2.115:0/2300756930 shutdown_connections 2021-11-12T05:40:21.219 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.213+0000 7f066f014700 1 -- 172.21.2.115:0/2300756930 wait complete. 2021-11-12T05:40:21.223 DEBUG:teuthology.orchestra.run.gibba015:> sudo ceph --cluster ceph osd new 837b2c60-c335-4382-9f47-d86543a14022 2 2021-11-12T05:40:21.275 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.269+0000 7fdb5fb94700 1 Processor -- start 2021-11-12T05:40:21.275 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.269+0000 7fdb5fb94700 1 -- start start 2021-11-12T05:40:21.277 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5fb94700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdb580b01b0 0x7fdb580aea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:21.277 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5fb94700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb580afe70 con 0x7fdb58060100 2021-11-12T05:40:21.277 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5fb94700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb580604e0 con 0x7fdb580b06c0 2021-11-12T05:40:21.278 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5fb94700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb58142f70 con 0x7fdb580b01b0 2021-11-12T05:40:21.278 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5d12f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdb580b01b0 0x7fdb580aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:21.278 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5d12f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdb580b01b0 0x7fdb580aea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3301/0 says I am v2:172.21.2.115:40236/0 (socket says 172.21.2.115:40236) 2021-11-12T05:40:21.278 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5d12f700 1 -- 172.21.2.115:0/3905017660 learned_addr learned my addr 172.21.2.115:0/3905017660 (peer_addr_for_me v2:172.21.2.115:0/0) 2021-11-12T05:40:21.279 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5d12f700 1 -- 172.21.2.115:0/3905017660 >> v1:172.21.2.115:6789/0 conn(0x7fdb580b06c0 legacy=0x7fdb58141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.279 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5c92e700 1 -- 172.21.2.115:0/3905017660 <== mon.1 v1:172.21.2.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 282019443 0 0) 0x7fdb580604e0 con 0x7fdb580b06c0 2021-11-12T05:40:21.279 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5d12f700 1 -- 172.21.2.115:0/3905017660 >> v1:172.21.2.105:6789/0 conn(0x7fdb58060100 legacy=0x7fdb580ae2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.279 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5d12f700 1 -- 172.21.2.115:0/3905017660 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb580b16a0 con 0x7fdb580b01b0 2021-11-12T05:40:21.279 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5d12f700 1 --2- 172.21.2.115:0/3905017660 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdb580b01b0 0x7fdb580aea00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fdb54002f70 tx=0x7fdb54006eb0).ready entity=mon.2 client_cookie=401108833c48c72e server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:21.280 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5c92e700 1 -- 172.21.2.115:0/3905017660 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb54009600 con 0x7fdb580b01b0 2021-11-12T05:40:21.280 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5c92e700 1 -- 172.21.2.115:0/3905017660 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb54000e90 con 0x7fdb580b01b0 2021-11-12T05:40:21.280 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5c92e700 1 -- 172.21.2.115:0/3905017660 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb54009990 con 0x7fdb580b01b0 2021-11-12T05:40:21.280 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5fb94700 1 -- 172.21.2.115:0/3905017660 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdb580b01b0 msgr2=0x7fdb580aea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.281 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5fb94700 1 --2- 172.21.2.115:0/3905017660 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdb580b01b0 0x7fdb580aea00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fdb54002f70 tx=0x7fdb54006eb0).stop 2021-11-12T05:40:21.281 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5fb94700 1 -- 172.21.2.115:0/3905017660 shutdown_connections 2021-11-12T05:40:21.281 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5fb94700 1 --2- 172.21.2.115:0/3905017660 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdb580b01b0 0x7fdb580aea00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.281 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5fb94700 1 -- 172.21.2.115:0/3905017660 >> 172.21.2.115:0/3905017660 conn(0x7fdb580632b0 msgr2=0x7fdb5805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:21.281 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5fb94700 1 -- 172.21.2.115:0/3905017660 shutdown_connections 2021-11-12T05:40:21.282 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5fb94700 1 -- 172.21.2.115:0/3905017660 wait complete. 2021-11-12T05:40:21.284 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5fb94700 1 Processor -- start 2021-11-12T05:40:21.284 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5fb94700 1 -- start start 2021-11-12T05:40:21.285 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5fb94700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdb58060100 0x7fdb58152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:21.285 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5fb94700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdb580b01b0 0x7fdb5814a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:21.285 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5fb94700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdb580b06c0 0x7fdb5813a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:21.285 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5fb94700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb58140a60 con 0x7fdb580b06c0 2021-11-12T05:40:21.285 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5fb94700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb58152760 con 0x7fdb580b01b0 2021-11-12T05:40:21.286 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5fb94700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5813f650 con 0x7fdb58060100 2021-11-12T05:40:21.286 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5d12f700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdb580b01b0 0x7fdb5814a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:21.286 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5d12f700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdb580b01b0 0x7fdb5814a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3300/0 says I am v2:172.21.2.115:40408/0 (socket says 172.21.2.115:40408) 2021-11-12T05:40:21.286 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5d930700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdb58060100 0x7fdb58152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:21.287 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5d12f700 1 -- 172.21.2.115:0/1658769938 learned_addr learned my addr 172.21.2.115:0/1658769938 (peer_addr_for_me v2:172.21.2.115:0/0) 2021-11-12T05:40:21.287 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5e131700 1 --2- 172.21.2.115:0/1658769938 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdb580b06c0 0x7fdb5813a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:21.287 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5d930700 1 -- 172.21.2.115:0/1658769938 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdb580b01b0 msgr2=0x7fdb5814a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.287 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5d930700 1 --2- 172.21.2.115:0/1658769938 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdb580b01b0 0x7fdb5814a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.287 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5d930700 1 -- 172.21.2.115:0/1658769938 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdb580b06c0 msgr2=0x7fdb5813a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.288 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5d930700 1 --2- 172.21.2.115:0/1658769938 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdb580b06c0 0x7fdb5813a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.288 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5d930700 1 -- 172.21.2.115:0/1658769938 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb5400b1e0 con 0x7fdb58060100 2021-11-12T05:40:21.288 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5d12f700 1 --2- 172.21.2.115:0/1658769938 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdb580b01b0 0x7fdb5814a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-12T05:40:21.288 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5d930700 1 --2- 172.21.2.115:0/1658769938 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdb58060100 0x7fdb58152270 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fdb580aeef0 tx=0x7fdb48007b90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:21.289 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb46ffd700 1 -- 172.21.2.115:0/1658769938 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb48012400 con 0x7fdb58060100 2021-11-12T05:40:21.289 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb46ffd700 1 -- 172.21.2.115:0/1658769938 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb48012560 con 0x7fdb58060100 2021-11-12T05:40:21.289 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5fb94700 1 -- 172.21.2.115:0/1658769938 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb58140c90 con 0x7fdb58060100 2021-11-12T05:40:21.289 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb46ffd700 1 -- 172.21.2.115:0/1658769938 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb480128c0 con 0x7fdb58060100 2021-11-12T05:40:21.289 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.273+0000 7fdb5fb94700 1 -- 172.21.2.115:0/1658769938 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb5813f1e0 con 0x7fdb58060100 2021-11-12T05:40:21.290 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.277+0000 7fdb46ffd700 1 -- 172.21.2.115:0/1658769938 <== mon.2 v2:172.21.2.115:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fdb48019030 con 0x7fdb58060100 2021-11-12T05:40:21.290 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.277+0000 7fdb46ffd700 1 -- 172.21.2.115:0/1658769938 <== mon.2 v2:172.21.2.115:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7fdb4801b800 con 0x7fdb58060100 2021-11-12T05:40:21.290 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.277+0000 7fdb5fb94700 1 -- 172.21.2.115:0/1658769938 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb5813f490 con 0x7fdb58060100 2021-11-12T05:40:21.290 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.277+0000 7fdb46ffd700 1 -- 172.21.2.115:0/1658769938 <== mon.2 v2:172.21.2.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fdb48017070 con 0x7fdb58060100 2021-11-12T05:40:21.325 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.321+0000 7fdb5fb94700 1 -- 172.21.2.115:0/1658769938 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_command({"prefix": "osd new", "uuid": "837b2c60-c335-4382-9f47-d86543a14022", "id": 2} v 0) v1 -- 0x7fdb580b1940 con 0x7fdb58060100 2021-11-12T05:40:21.329 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.325+0000 7fdb46ffd700 1 -- 172.21.2.115:0/1658769938 <== mon.2 v2:172.21.2.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "837b2c60-c335-4382-9f47-d86543a14022", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdb4801b3b0 con 0x7fdb58060100 2021-11-12T05:40:21.330 INFO:teuthology.orchestra.run.gibba015.stdout:2 2021-11-12T05:40:21.331 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.325+0000 7fdb5fb94700 1 -- 172.21.2.115:0/1658769938 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdb58060100 msgr2=0x7fdb58152270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.331 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.325+0000 7fdb5fb94700 1 --2- 172.21.2.115:0/1658769938 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdb58060100 0x7fdb58152270 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fdb580aeef0 tx=0x7fdb48007b90).stop 2021-11-12T05:40:21.331 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.325+0000 7fdb5fb94700 1 -- 172.21.2.115:0/1658769938 shutdown_connections 2021-11-12T05:40:21.332 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.325+0000 7fdb5fb94700 1 --2- 172.21.2.115:0/1658769938 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdb580b06c0 0x7fdb5813a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.332 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.325+0000 7fdb5fb94700 1 --2- 172.21.2.115:0/1658769938 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdb580b01b0 0x7fdb5814a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.332 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.325+0000 7fdb5fb94700 1 --2- 172.21.2.115:0/1658769938 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdb58060100 0x7fdb58152270 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.332 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.325+0000 7fdb5fb94700 1 -- 172.21.2.115:0/1658769938 >> 172.21.2.115:0/1658769938 conn(0x7fdb580632b0 msgr2=0x7fdb580ae1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:21.332 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.325+0000 7fdb5fb94700 1 -- 172.21.2.115:0/1658769938 shutdown_connections 2021-11-12T05:40:21.333 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.325+0000 7fdb5fb94700 1 -- 172.21.2.115:0/1658769938 wait complete. 2021-11-12T05:40:21.336 DEBUG:teuthology.orchestra.run.gibba015:> sudo ceph --cluster ceph osd new eb2b737b-dda6-444b-a306-f33cbbd51f70 3 2021-11-12T05:40:21.387 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.385+0000 7fafd2969700 1 Processor -- start 2021-11-12T05:40:21.388 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.385+0000 7fafd2969700 1 -- start start 2021-11-12T05:40:21.390 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.385+0000 7fafd2969700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fafcc0b7b00 0x7fafcc140d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:21.390 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.385+0000 7fafd2969700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafcc0b7ee0 con 0x7fafcc0ae090 2021-11-12T05:40:21.390 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.385+0000 7fafd2969700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafcc0b2030 con 0x7fafcc0b3980 2021-11-12T05:40:21.391 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.385+0000 7fafd2969700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc0b22d0 con 0x7fafcc0b7b00 2021-11-12T05:40:21.391 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.385+0000 7fafcbfff700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fafcc0b7b00 0x7fafcc140d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:21.391 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.385+0000 7fafd0f06700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7fafcc0b3980 0x7fafcc0b3df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.115:42022/0 (socket says 172.21.2.115:42022) 2021-11-12T05:40:21.391 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.385+0000 7fafd0f06700 1 -- 172.21.2.115:0/2417140830 learned_addr learned my addr 172.21.2.115:0/2417140830 (peer_addr_for_me v1:172.21.2.115:0/0) 2021-11-12T05:40:21.392 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.385+0000 7fafcaffd700 1 -- 172.21.2.115:0/2417140830 <== mon.1 v1:172.21.2.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3102521190 0 0) 0x7fafcc0b2030 con 0x7fafcc0b3980 2021-11-12T05:40:21.392 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.385+0000 7fafcbfff700 1 -- 172.21.2.115:0/2417140830 >> v1:172.21.2.115:6789/0 conn(0x7fafcc0b3980 legacy=0x7fafcc0b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.392 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.385+0000 7fafcbfff700 1 -- 172.21.2.115:0/2417140830 >> v1:172.21.2.105:6789/0 conn(0x7fafcc0ae090 legacy=0x7fafcc0b2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.392 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.385+0000 7fafcbfff700 1 -- 172.21.2.115:0/2417140830 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafcc0b2570 con 0x7fafcc0b7b00 2021-11-12T05:40:21.392 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.385+0000 7fafcbfff700 1 --2- 172.21.2.115:0/2417140830 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fafcc0b7b00 0x7fafcc140d80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fafbc002f70 tx=0x7fafbc006df0).ready entity=mon.2 client_cookie=98b1e6bbac814e84 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:21.393 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.385+0000 7fafcaffd700 1 -- 172.21.2.115:0/2417140830 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafbc00d5c0 con 0x7fafcc0b7b00 2021-11-12T05:40:21.393 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.385+0000 7fafcaffd700 1 -- 172.21.2.115:0/2417140830 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafbc000e90 con 0x7fafcc0b7b00 2021-11-12T05:40:21.393 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.385+0000 7fafcaffd700 1 -- 172.21.2.115:0/2417140830 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafbc00d910 con 0x7fafcc0b7b00 2021-11-12T05:40:21.393 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.385+0000 7fafd2969700 1 -- 172.21.2.115:0/2417140830 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fafcc0b7b00 msgr2=0x7fafcc140d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.393 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.385+0000 7fafd2969700 1 --2- 172.21.2.115:0/2417140830 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fafcc0b7b00 0x7fafcc140d80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fafbc002f70 tx=0x7fafbc006df0).stop 2021-11-12T05:40:21.394 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.385+0000 7fafd2969700 1 -- 172.21.2.115:0/2417140830 shutdown_connections 2021-11-12T05:40:21.394 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.385+0000 7fafd2969700 1 --2- 172.21.2.115:0/2417140830 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fafcc0b7b00 0x7fafcc140d80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.394 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.385+0000 7fafd2969700 1 -- 172.21.2.115:0/2417140830 >> 172.21.2.115:0/2417140830 conn(0x7fafcc0608d0 msgr2=0x7fafcc05c490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:21.394 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.385+0000 7fafd2969700 1 -- 172.21.2.115:0/2417140830 shutdown_connections 2021-11-12T05:40:21.394 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.385+0000 7fafd2969700 1 -- 172.21.2.115:0/2417140830 wait complete. 2021-11-12T05:40:21.395 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.385+0000 7fafd2969700 1 Processor -- start 2021-11-12T05:40:21.395 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.385+0000 7fafd2969700 1 -- start start 2021-11-12T05:40:21.398 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.385+0000 7fafd2969700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fafcc0ae090 0x7fafcc13f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:21.398 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.385+0000 7fafd2969700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fafcc0b3980 0x7fafcc143c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:21.399 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.385+0000 7fafd2969700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fafcc0b7b00 0x7fafcc144150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:21.399 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.385+0000 7fafd2969700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc1452b0 con 0x7fafcc0ae090 2021-11-12T05:40:21.399 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.385+0000 7fafd2969700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc0b1980 con 0x7fafcc0b7b00 2021-11-12T05:40:21.399 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.385+0000 7fafd2969700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc143420 con 0x7fafcc0b3980 2021-11-12T05:40:21.399 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.385+0000 7fafd0f06700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fafcc0b7b00 0x7fafcc144150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:21.400 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.385+0000 7fafcb7fe700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fafcc0b3980 0x7fafcc143c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:21.400 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.385+0000 7fafd0f06700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fafcc0b7b00 0x7fafcc144150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3300/0 says I am v2:172.21.2.115:40422/0 (socket says 172.21.2.115:40422) 2021-11-12T05:40:21.400 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.385+0000 7fafd0f06700 1 -- 172.21.2.115:0/1236212223 learned_addr learned my addr 172.21.2.115:0/1236212223 (peer_addr_for_me v2:172.21.2.115:0/0) 2021-11-12T05:40:21.400 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.385+0000 7fafcb7fe700 1 --2- 172.21.2.115:0/1236212223 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fafcc0b3980 0x7fafcc143c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3301/0 says I am v2:172.21.2.115:40252/0 (socket says 172.21.2.115:40252) 2021-11-12T05:40:21.401 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.389+0000 7fafcbfff700 1 --2- 172.21.2.115:0/1236212223 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fafcc0ae090 0x7fafcc13f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:21.401 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.389+0000 7fafd0f06700 1 -- 172.21.2.115:0/1236212223 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fafcc0b3980 msgr2=0x7fafcc143c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.401 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.389+0000 7fafd0f06700 1 --2- 172.21.2.115:0/1236212223 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fafcc0b3980 0x7fafcc143c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.401 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.389+0000 7fafd0f06700 1 -- 172.21.2.115:0/1236212223 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fafcc0ae090 msgr2=0x7fafcc13f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.401 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.389+0000 7fafd0f06700 1 --2- 172.21.2.115:0/1236212223 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fafcc0ae090 0x7fafcc13f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.402 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.389+0000 7fafd0f06700 1 -- 172.21.2.115:0/1236212223 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafbc00b180 con 0x7fafcc0b7b00 2021-11-12T05:40:21.402 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.389+0000 7fafcb7fe700 1 --2- 172.21.2.115:0/1236212223 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fafcc0b3980 0x7fafcc143c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-12T05:40:21.402 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.389+0000 7fafcbfff700 1 --2- 172.21.2.115:0/1236212223 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fafcc0ae090 0x7fafcc13f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:40:21.402 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.389+0000 7fafd0f06700 1 --2- 172.21.2.115:0/1236212223 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fafcc0b7b00 0x7fafcc144150 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fafcc0b1600 tx=0x7fafc4007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:21.403 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.389+0000 7fafc97fa700 1 -- 172.21.2.115:0/1236212223 <== mon.1 v2:172.21.2.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafc4005c70 con 0x7fafcc0b7b00 2021-11-12T05:40:21.403 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.389+0000 7fafc97fa700 1 -- 172.21.2.115:0/1236212223 <== mon.1 v2:172.21.2.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc4005dd0 con 0x7fafcc0b7b00 2021-11-12T05:40:21.403 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.389+0000 7fafc97fa700 1 -- 172.21.2.115:0/1236212223 <== mon.1 v2:172.21.2.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafc4004a90 con 0x7fafcc0b7b00 2021-11-12T05:40:21.403 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.389+0000 7fafd2969700 1 -- 172.21.2.115:0/1236212223 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafcc13fea0 con 0x7fafcc0b7b00 2021-11-12T05:40:21.404 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.389+0000 7fafd2969700 1 -- 172.21.2.115:0/1236212223 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafcc13f5b0 con 0x7fafcc0b7b00 2021-11-12T05:40:21.404 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.389+0000 7fafc97fa700 1 -- 172.21.2.115:0/1236212223 <== mon.1 v2:172.21.2.115:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fafc4007110 con 0x7fafcc0b7b00 2021-11-12T05:40:21.404 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.389+0000 7fafc97fa700 1 -- 172.21.2.115:0/1236212223 <== mon.1 v2:172.21.2.115:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7fafc4004dc0 con 0x7fafcc0b7b00 2021-11-12T05:40:21.404 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.389+0000 7fafd2969700 1 -- 172.21.2.115:0/1236212223 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafcc057350 con 0x7fafcc0b7b00 2021-11-12T05:40:21.404 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.389+0000 7fafc97fa700 1 -- 172.21.2.115:0/1236212223 <== mon.1 v2:172.21.2.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fafc4005030 con 0x7fafcc0b7b00 2021-11-12T05:40:21.438 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.433+0000 7fafd2969700 1 -- 172.21.2.115:0/1236212223 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_command({"prefix": "osd new", "uuid": "eb2b737b-dda6-444b-a306-f33cbbd51f70", "id": 3} v 0) v1 -- 0x7fafcc0b33d0 con 0x7fafcc0b7b00 2021-11-12T05:40:21.442 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.437+0000 7fafc97fa700 1 -- 172.21.2.115:0/1236212223 <== mon.1 v2:172.21.2.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "eb2b737b-dda6-444b-a306-f33cbbd51f70", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fafc4005290 con 0x7fafcc0b7b00 2021-11-12T05:40:21.443 INFO:teuthology.orchestra.run.gibba015.stdout:3 2021-11-12T05:40:21.444 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.441+0000 7fafd2969700 1 -- 172.21.2.115:0/1236212223 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fafcc0b7b00 msgr2=0x7fafcc144150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.444 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.441+0000 7fafd2969700 1 --2- 172.21.2.115:0/1236212223 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fafcc0b7b00 0x7fafcc144150 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fafcc0b1600 tx=0x7fafc4007dc0).stop 2021-11-12T05:40:21.444 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.441+0000 7fafd2969700 1 -- 172.21.2.115:0/1236212223 shutdown_connections 2021-11-12T05:40:21.444 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.441+0000 7fafd2969700 1 --2- 172.21.2.115:0/1236212223 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fafcc0b7b00 0x7fafcc144150 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.445 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.441+0000 7fafd2969700 1 --2- 172.21.2.115:0/1236212223 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fafcc0b3980 0x7fafcc143c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.445 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.441+0000 7fafd2969700 1 --2- 172.21.2.115:0/1236212223 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fafcc0ae090 0x7fafcc13f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.445 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.441+0000 7fafd2969700 1 -- 172.21.2.115:0/1236212223 >> 172.21.2.115:0/1236212223 conn(0x7fafcc0608d0 msgr2=0x7fafcc0b3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:21.445 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.441+0000 7fafd2969700 1 -- 172.21.2.115:0/1236212223 shutdown_connections 2021-11-12T05:40:21.445 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.441+0000 7fafd2969700 1 -- 172.21.2.115:0/1236212223 wait complete. 2021-11-12T05:40:21.449 DEBUG:teuthology.orchestra.run.gibba015:> sudo ceph --cluster ceph osd new 721529a1-c047-486a-a7ca-ddc15d80cdde 4 2021-11-12T05:40:21.500 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.497+0000 7ff824f18700 1 Processor -- start 2021-11-12T05:40:21.500 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.497+0000 7ff824f18700 1 -- start start 2021-11-12T05:40:21.502 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.497+0000 7ff824f18700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff8200b4060 0x7ff820146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:21.502 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.497+0000 7ff824f18700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff8201471b0 0x7ff820140040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:21.502 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.497+0000 7ff824f18700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8200b6810 con 0x7ff8200b6430 2021-11-12T05:40:21.503 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.497+0000 7ff824f18700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8201475f0 con 0x7ff8201471b0 2021-11-12T05:40:21.503 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.497+0000 7ff824f18700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8200b6d60 con 0x7ff8200b4060 2021-11-12T05:40:21.503 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.497+0000 7ff81dd9b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff8200b4060 0x7ff820146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:21.503 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.497+0000 7ff81dd9b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff8200b4060 0x7ff820146cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3301/0 says I am v2:172.21.2.115:40256/0 (socket says 172.21.2.115:40256) 2021-11-12T05:40:21.504 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.497+0000 7ff81dd9b700 1 -- 172.21.2.115:0/3400384205 learned_addr learned my addr 172.21.2.115:0/3400384205 (peer_addr_for_me v2:172.21.2.115:0/0) 2021-11-12T05:40:21.504 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.497+0000 7ff81dd9b700 1 -- 172.21.2.115:0/3400384205 >> v2:172.21.2.105:3300/0 conn(0x7ff8201471b0 msgr2=0x7ff820140040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:21.504 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.497+0000 7ff81dd9b700 1 --2- 172.21.2.115:0/3400384205 >> v2:172.21.2.105:3300/0 conn(0x7ff8201471b0 0x7ff820140040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:21.504 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.497+0000 7ff81dd9b700 1 -- 172.21.2.115:0/3400384205 >> v1:172.21.2.105:6789/0 conn(0x7ff8200b6430 legacy=0x7ff820143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:21.505 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.497+0000 7ff81dd9b700 1 -- 172.21.2.115:0/3400384205 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff820146820 con 0x7ff8200b4060 2021-11-12T05:40:21.505 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.497+0000 7ff81dd9b700 1 --2- 172.21.2.115:0/3400384205 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff8200b4060 0x7ff820146cc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7ff820061c60 tx=0x7ff810006eb0).ready entity=mon.2 client_cookie=ae209f7a870c88b6 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:21.505 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.497+0000 7ff81d59a700 1 -- 172.21.2.115:0/3400384205 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff81000d570 con 0x7ff8200b4060 2021-11-12T05:40:21.505 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.497+0000 7ff81d59a700 1 -- 172.21.2.115:0/3400384205 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff810000e90 con 0x7ff8200b4060 2021-11-12T05:40:21.506 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.497+0000 7ff81d59a700 1 -- 172.21.2.115:0/3400384205 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff81000d8c0 con 0x7ff8200b4060 2021-11-12T05:40:21.506 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.497+0000 7ff824f18700 1 -- 172.21.2.115:0/3400384205 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff8200b4060 msgr2=0x7ff820146cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.506 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.497+0000 7ff824f18700 1 --2- 172.21.2.115:0/3400384205 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff8200b4060 0x7ff820146cc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7ff820061c60 tx=0x7ff810006eb0).stop 2021-11-12T05:40:21.506 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.497+0000 7ff824f18700 1 -- 172.21.2.115:0/3400384205 shutdown_connections 2021-11-12T05:40:21.507 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.497+0000 7ff824f18700 1 --2- 172.21.2.115:0/3400384205 >> v2:172.21.2.105:3300/0 conn(0x7ff8201471b0 0x7ff820140040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:21.507 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.497+0000 7ff824f18700 1 --2- 172.21.2.115:0/3400384205 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff8200b4060 0x7ff820146cc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.507 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.497+0000 7ff824f18700 1 -- 172.21.2.115:0/3400384205 >> 172.21.2.115:0/3400384205 conn(0x7ff820062030 msgr2=0x7ff820062440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:21.508 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.497+0000 7ff824f18700 1 -- 172.21.2.115:0/3400384205 shutdown_connections 2021-11-12T05:40:21.508 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.497+0000 7ff824f18700 1 -- 172.21.2.115:0/3400384205 wait complete. 2021-11-12T05:40:21.510 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.497+0000 7ff824f18700 1 Processor -- start 2021-11-12T05:40:21.510 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.497+0000 7ff824f18700 1 -- start start 2021-11-12T05:40:21.511 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.501+0000 7ff824f18700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff8200b4060 0x7ff8200b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:21.511 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.501+0000 7ff824f18700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff8200b6430 0x7ff820151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:21.511 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.501+0000 7ff824f18700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff8201471b0 0x7ff820151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:21.512 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.501+0000 7ff824f18700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff820140bb0 con 0x7ff8200b4060 2021-11-12T05:40:21.512 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.501+0000 7ff824f18700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff820140e50 con 0x7ff8200b6430 2021-11-12T05:40:21.512 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.501+0000 7ff824f18700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8201410f0 con 0x7ff8201471b0 2021-11-12T05:40:21.512 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.501+0000 7ff81ed9d700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff8201471b0 0x7ff820151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:21.513 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.501+0000 7ff81ed9d700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff8201471b0 0x7ff820151e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3301/0 says I am v2:172.21.2.115:40266/0 (socket says 172.21.2.115:40266) 2021-11-12T05:40:21.513 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.501+0000 7ff81ed9d700 1 -- 172.21.2.115:0/2087978641 learned_addr learned my addr 172.21.2.115:0/2087978641 (peer_addr_for_me v2:172.21.2.115:0/0) 2021-11-12T05:40:21.513 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.501+0000 7ff81dd9b700 1 --2- 172.21.2.115:0/2087978641 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff8200b6430 0x7ff820151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:21.513 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.501+0000 7ff81e59c700 1 --2- 172.21.2.115:0/2087978641 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff8200b4060 0x7ff8200b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:21.514 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.501+0000 7ff81ed9d700 1 -- 172.21.2.115:0/2087978641 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff8200b6430 msgr2=0x7ff820151910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.514 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.501+0000 7ff81ed9d700 1 --2- 172.21.2.115:0/2087978641 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff8200b6430 0x7ff820151910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.514 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.501+0000 7ff81ed9d700 1 -- 172.21.2.115:0/2087978641 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff8200b4060 msgr2=0x7ff8200b4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.514 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.501+0000 7ff81ed9d700 1 --2- 172.21.2.115:0/2087978641 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff8200b4060 0x7ff8200b4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.515 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.501+0000 7ff81ed9d700 1 -- 172.21.2.115:0/2087978641 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff81000b1e0 con 0x7ff8201471b0 2021-11-12T05:40:21.515 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.501+0000 7ff81e59c700 1 --2- 172.21.2.115:0/2087978641 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff8200b4060 0x7ff8200b4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:40:21.515 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.501+0000 7ff81ed9d700 1 --2- 172.21.2.115:0/2087978641 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff8201471b0 0x7ff820151e00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7ff8180032f0 tx=0x7ff8180091a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:21.515 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.501+0000 7ff8177fe700 1 -- 172.21.2.115:0/2087978641 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff81800f510 con 0x7ff8201471b0 2021-11-12T05:40:21.516 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.501+0000 7ff8177fe700 1 -- 172.21.2.115:0/2087978641 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81800f670 con 0x7ff8201471b0 2021-11-12T05:40:21.516 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.501+0000 7ff824f18700 1 -- 172.21.2.115:0/2087978641 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8200b5380 con 0x7ff8201471b0 2021-11-12T05:40:21.516 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.501+0000 7ff8177fe700 1 -- 172.21.2.115:0/2087978641 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff81800f7e0 con 0x7ff8201471b0 2021-11-12T05:40:21.516 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.501+0000 7ff824f18700 1 -- 172.21.2.115:0/2087978641 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8201522f0 con 0x7ff8201471b0 2021-11-12T05:40:21.517 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.501+0000 7ff8177fe700 1 -- 172.21.2.115:0/2087978641 <== mon.2 v2:172.21.2.115:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7ff81800f070 con 0x7ff8201471b0 2021-11-12T05:40:21.517 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.501+0000 7ff8177fe700 1 -- 172.21.2.115:0/2087978641 <== mon.2 v2:172.21.2.115:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7ff81801a930 con 0x7ff8201471b0 2021-11-12T05:40:21.517 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.501+0000 7ff824f18700 1 -- 172.21.2.115:0/2087978641 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8200b39a0 con 0x7ff8201471b0 2021-11-12T05:40:21.517 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.501+0000 7ff8177fe700 1 -- 172.21.2.115:0/2087978641 <== mon.2 v2:172.21.2.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7ff81801abd0 con 0x7ff8201471b0 2021-11-12T05:40:21.550 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.545+0000 7ff824f18700 1 -- 172.21.2.115:0/2087978641 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_command({"prefix": "osd new", "uuid": "721529a1-c047-486a-a7ca-ddc15d80cdde", "id": 4} v 0) v1 -- 0x7ff820057350 con 0x7ff8201471b0 2021-11-12T05:40:21.554 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.549+0000 7ff8177fe700 1 -- 172.21.2.115:0/2087978641 <== mon.2 v2:172.21.2.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "721529a1-c047-486a-a7ca-ddc15d80cdde", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff81801ad70 con 0x7ff8201471b0 2021-11-12T05:40:21.555 INFO:teuthology.orchestra.run.gibba015.stdout:4 2021-11-12T05:40:21.555 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.553+0000 7ff824f18700 1 -- 172.21.2.115:0/2087978641 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff8201471b0 msgr2=0x7ff820151e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.556 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.553+0000 7ff824f18700 1 --2- 172.21.2.115:0/2087978641 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff8201471b0 0x7ff820151e00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7ff8180032f0 tx=0x7ff8180091a0).stop 2021-11-12T05:40:21.556 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.553+0000 7ff824f18700 1 -- 172.21.2.115:0/2087978641 shutdown_connections 2021-11-12T05:40:21.556 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.553+0000 7ff824f18700 1 --2- 172.21.2.115:0/2087978641 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff8201471b0 0x7ff820151e00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.556 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.553+0000 7ff824f18700 1 --2- 172.21.2.115:0/2087978641 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff8200b6430 0x7ff820151910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.557 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.553+0000 7ff824f18700 1 --2- 172.21.2.115:0/2087978641 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff8200b4060 0x7ff8200b4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.557 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.553+0000 7ff824f18700 1 -- 172.21.2.115:0/2087978641 >> 172.21.2.115:0/2087978641 conn(0x7ff820062030 msgr2=0x7ff82013e690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:21.557 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.553+0000 7ff824f18700 1 -- 172.21.2.115:0/2087978641 shutdown_connections 2021-11-12T05:40:21.557 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.553+0000 7ff824f18700 1 -- 172.21.2.115:0/2087978641 wait complete. 2021-11-12T05:40:21.562 DEBUG:teuthology.orchestra.run.gibba015:> sudo ceph --cluster ceph osd new 68b72ab2-fa82-4b5c-bf33-528f002e4950 5 2021-11-12T05:40:21.615 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.609+0000 7fd64944c700 1 Processor -- start 2021-11-12T05:40:21.616 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.609+0000 7fd64944c700 1 -- start start 2021-11-12T05:40:21.616 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.609+0000 7fd64944c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6440b6430 0x7fd644143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:21.616 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.609+0000 7fd64944c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd6440b4060 0x7fd644146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:21.616 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.609+0000 7fd64944c700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6440b6810 con 0x7fd6441471b0 2021-11-12T05:40:21.616 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.609+0000 7fd64944c700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd644147610 con 0x7fd6440b4060 2021-11-12T05:40:21.617 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.609+0000 7fd64944c700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6440b6d60 con 0x7fd6440b6430 2021-11-12T05:40:21.617 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.609+0000 7fd642ffd700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6440b6430 0x7fd644143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:21.617 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.609+0000 7fd642ffd700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6440b6430 0x7fd644143090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3301/0 says I am v2:172.21.2.115:40268/0 (socket says 172.21.2.115:40268) 2021-11-12T05:40:21.617 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.609+0000 7fd642ffd700 1 -- 172.21.2.115:0/4208153523 learned_addr learned my addr 172.21.2.115:0/4208153523 (peer_addr_for_me v2:172.21.2.115:0/0) 2021-11-12T05:40:21.618 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.609+0000 7fd6427fc700 1 --2- 172.21.2.115:0/4208153523 >> v2:172.21.2.105:3300/0 conn(0x7fd6440b4060 0x7fd644146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:21.618 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.609+0000 7fd642ffd700 1 -- 172.21.2.115:0/4208153523 >> v2:172.21.2.105:3300/0 conn(0x7fd6440b4060 msgr2=0x7fd644146cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:21.618 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.609+0000 7fd642ffd700 1 --2- 172.21.2.115:0/4208153523 >> v2:172.21.2.105:3300/0 conn(0x7fd6440b4060 0x7fd644146cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.618 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.609+0000 7fd642ffd700 1 -- 172.21.2.115:0/4208153523 >> v1:172.21.2.105:6789/0 conn(0x7fd6441471b0 legacy=0x7fd644140040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:21.618 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.609+0000 7fd642ffd700 1 -- 172.21.2.115:0/4208153523 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd644146820 con 0x7fd6440b6430 2021-11-12T05:40:21.619 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.609+0000 7fd642ffd700 1 --2- 172.21.2.115:0/4208153523 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6440b6430 0x7fd644143090 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fd644061c60 tx=0x7fd634006eb0).ready entity=mon.2 client_cookie=2e82aee7d147fa12 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:21.619 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.609+0000 7fd641ffb700 1 -- 172.21.2.115:0/4208153523 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd63400d570 con 0x7fd6440b6430 2021-11-12T05:40:21.619 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.609+0000 7fd641ffb700 1 -- 172.21.2.115:0/4208153523 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd634000e90 con 0x7fd6440b6430 2021-11-12T05:40:21.619 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.609+0000 7fd641ffb700 1 -- 172.21.2.115:0/4208153523 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd63400d8c0 con 0x7fd6440b6430 2021-11-12T05:40:21.620 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.609+0000 7fd64944c700 1 -- 172.21.2.115:0/4208153523 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6440b6430 msgr2=0x7fd644143090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.620 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.609+0000 7fd64944c700 1 --2- 172.21.2.115:0/4208153523 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6440b6430 0x7fd644143090 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fd644061c60 tx=0x7fd634006eb0).stop 2021-11-12T05:40:21.620 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.609+0000 7fd64944c700 1 -- 172.21.2.115:0/4208153523 shutdown_connections 2021-11-12T05:40:21.620 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.609+0000 7fd64944c700 1 --2- 172.21.2.115:0/4208153523 >> v2:172.21.2.105:3300/0 conn(0x7fd6440b4060 0x7fd644146cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.620 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.609+0000 7fd64944c700 1 --2- 172.21.2.115:0/4208153523 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6440b6430 0x7fd644143090 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.621 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.609+0000 7fd64944c700 1 -- 172.21.2.115:0/4208153523 >> 172.21.2.115:0/4208153523 conn(0x7fd644062030 msgr2=0x7fd644062440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:21.621 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.609+0000 7fd64944c700 1 -- 172.21.2.115:0/4208153523 shutdown_connections 2021-11-12T05:40:21.621 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.609+0000 7fd64944c700 1 -- 172.21.2.115:0/4208153523 wait complete. 2021-11-12T05:40:21.621 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.613+0000 7fd64944c700 1 Processor -- start 2021-11-12T05:40:21.621 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.613+0000 7fd64944c700 1 -- start start 2021-11-12T05:40:21.624 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.613+0000 7fd64944c700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd6440b4060 0x7fd6441419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:21.624 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.613+0000 7fd64944c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6440b6430 0x7fd644140a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:21.625 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.613+0000 7fd64944c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6441471b0 0x7fd64413d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:21.625 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.613+0000 7fd64944c700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd644064810 con 0x7fd6441471b0 2021-11-12T05:40:21.625 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.613+0000 7fd64944c700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd644064a90 con 0x7fd6440b4060 2021-11-12T05:40:21.625 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.613+0000 7fd64944c700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd644064d30 con 0x7fd6440b6430 2021-11-12T05:40:21.625 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.613+0000 7fd6427fc700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6440b6430 0x7fd644140a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:21.626 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.613+0000 7fd6427fc700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6440b6430 0x7fd644140a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3301/0 says I am v2:172.21.2.115:40276/0 (socket says 172.21.2.115:40276) 2021-11-12T05:40:21.626 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.613+0000 7fd642ffd700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd6440b4060 0x7fd6441419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:21.626 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.613+0000 7fd6427fc700 1 -- 172.21.2.115:0/30289531 learned_addr learned my addr 172.21.2.115:0/30289531 (peer_addr_for_me v2:172.21.2.115:0/0) 2021-11-12T05:40:21.626 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.613+0000 7fd6437fe700 1 --2- 172.21.2.115:0/30289531 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6441471b0 0x7fd64413d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:21.627 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.613+0000 7fd6427fc700 1 -- 172.21.2.115:0/30289531 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd6440b4060 msgr2=0x7fd6441419d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.627 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.613+0000 7fd6427fc700 1 --2- 172.21.2.115:0/30289531 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd6440b4060 0x7fd6441419d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.627 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.613+0000 7fd6427fc700 1 -- 172.21.2.115:0/30289531 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6441471b0 msgr2=0x7fd64413d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.627 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.613+0000 7fd6427fc700 1 --2- 172.21.2.115:0/30289531 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6441471b0 0x7fd64413d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.627 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.613+0000 7fd6427fc700 1 -- 172.21.2.115:0/30289531 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd63400b1e0 con 0x7fd6440b6430 2021-11-12T05:40:21.628 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.613+0000 7fd6427fc700 1 --2- 172.21.2.115:0/30289531 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6440b6430 0x7fd644140a00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fd62c00a000 tx=0x7fd62c008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:21.628 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.613+0000 7fd63bfff700 1 -- 172.21.2.115:0/30289531 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd62c00dea0 con 0x7fd6440b6430 2021-11-12T05:40:21.628 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.613+0000 7fd63bfff700 1 -- 172.21.2.115:0/30289531 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62c011780 con 0x7fd6440b6430 2021-11-12T05:40:21.628 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.613+0000 7fd63bfff700 1 -- 172.21.2.115:0/30289531 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd62c011ae0 con 0x7fd6440b6430 2021-11-12T05:40:21.629 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.613+0000 7fd64944c700 1 -- 172.21.2.115:0/30289531 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd644064fd0 con 0x7fd6440b6430 2021-11-12T05:40:21.629 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.613+0000 7fd64944c700 1 -- 172.21.2.115:0/30289531 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd644065690 con 0x7fd6440b6430 2021-11-12T05:40:21.629 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.613+0000 7fd63bfff700 1 -- 172.21.2.115:0/30289531 <== mon.2 v2:172.21.2.115:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fd62c01c460 con 0x7fd6440b6430 2021-11-12T05:40:21.629 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.613+0000 7fd63bfff700 1 -- 172.21.2.115:0/30289531 <== mon.2 v2:172.21.2.115:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7fd62c011e10 con 0x7fd6440b6430 2021-11-12T05:40:21.629 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.613+0000 7fd64944c700 1 -- 172.21.2.115:0/30289531 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd644065160 con 0x7fd6440b6430 2021-11-12T05:40:21.630 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.613+0000 7fd63bfff700 1 -- 172.21.2.115:0/30289531 <== mon.2 v2:172.21.2.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fd62c01cb50 con 0x7fd6440b6430 2021-11-12T05:40:21.664 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.661+0000 7fd64944c700 1 -- 172.21.2.115:0/30289531 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_command({"prefix": "osd new", "uuid": "68b72ab2-fa82-4b5c-bf33-528f002e4950", "id": 5} v 0) v1 -- 0x7fd644143580 con 0x7fd6440b6430 2021-11-12T05:40:21.668 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.665+0000 7fd63bfff700 1 -- 172.21.2.115:0/30289531 <== mon.2 v2:172.21.2.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "68b72ab2-fa82-4b5c-bf33-528f002e4950", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd62c01ccf0 con 0x7fd6440b6430 2021-11-12T05:40:21.668 INFO:teuthology.orchestra.run.gibba015.stdout:5 2021-11-12T05:40:21.669 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.665+0000 7fd64944c700 1 -- 172.21.2.115:0/30289531 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6440b6430 msgr2=0x7fd644140a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.670 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.665+0000 7fd64944c700 1 --2- 172.21.2.115:0/30289531 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6440b6430 0x7fd644140a00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fd62c00a000 tx=0x7fd62c008040).stop 2021-11-12T05:40:21.670 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.665+0000 7fd64944c700 1 -- 172.21.2.115:0/30289531 shutdown_connections 2021-11-12T05:40:21.670 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.665+0000 7fd64944c700 1 --2- 172.21.2.115:0/30289531 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6441471b0 0x7fd64413d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.670 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.665+0000 7fd64944c700 1 --2- 172.21.2.115:0/30289531 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6440b6430 0x7fd644140a00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.670 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.665+0000 7fd64944c700 1 --2- 172.21.2.115:0/30289531 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd6440b4060 0x7fd6441419d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.671 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.665+0000 7fd64944c700 1 -- 172.21.2.115:0/30289531 >> 172.21.2.115:0/30289531 conn(0x7fd644062030 msgr2=0x7fd64413f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:21.671 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.665+0000 7fd64944c700 1 -- 172.21.2.115:0/30289531 shutdown_connections 2021-11-12T05:40:21.671 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.665+0000 7fd64944c700 1 -- 172.21.2.115:0/30289531 wait complete. 2021-11-12T05:40:21.675 DEBUG:teuthology.orchestra.run.gibba015:> sudo ceph --cluster ceph osd new a2c83b5d-8d37-4d30-ac04-30d89a76e485 6 2021-11-12T05:40:21.726 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.721+0000 7f87c5bd0700 1 Processor -- start 2021-11-12T05:40:21.726 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.721+0000 7f87c5bd0700 1 -- start start 2021-11-12T05:40:21.731 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.721+0000 7f87c5bd0700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f87c00b7c80 0x7f87c0067170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:21.731 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.721+0000 7f87c5bd0700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f87c0140f90 0x7f87c01413b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:21.732 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.721+0000 7f87c5bd0700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c00b8060 con 0x7f87c0064900 2021-11-12T05:40:21.732 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.721+0000 7f87c5bd0700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c0067d80 con 0x7f87c0140f90 2021-11-12T05:40:21.732 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.721+0000 7f87c5bd0700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c0067660 con 0x7f87c00b7c80 2021-11-12T05:40:21.732 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.721+0000 7f87bf7fe700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f87c00b7c80 0x7f87c0067170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:21.733 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.721+0000 7f87bf7fe700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f87c00b7c80 0x7f87c0067170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3300/0 says I am v2:172.21.2.115:40448/0 (socket says 172.21.2.115:40448) 2021-11-12T05:40:21.733 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.721+0000 7f87bf7fe700 1 -- 172.21.2.115:0/3280228163 learned_addr learned my addr 172.21.2.115:0/3280228163 (peer_addr_for_me v2:172.21.2.115:0/0) 2021-11-12T05:40:21.733 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.721+0000 7f87bffff700 1 --2- 172.21.2.115:0/3280228163 >> v2:172.21.2.105:3300/0 conn(0x7f87c0140f90 0x7f87c01413b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:21.733 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.721+0000 7f87bf7fe700 1 -- 172.21.2.115:0/3280228163 >> v2:172.21.2.105:3300/0 conn(0x7f87c0140f90 msgr2=0x7f87c01413b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:21.734 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.721+0000 7f87bf7fe700 1 --2- 172.21.2.115:0/3280228163 >> v2:172.21.2.105:3300/0 conn(0x7f87c0140f90 0x7f87c01413b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.734 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.721+0000 7f87bf7fe700 1 -- 172.21.2.115:0/3280228163 >> v1:172.21.2.105:6789/0 conn(0x7f87c0064900 legacy=0x7f87c0064d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:21.734 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.721+0000 7f87bf7fe700 1 -- 172.21.2.115:0/3280228163 --> v2:172.21.2.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c0067840 con 0x7f87c00b7c80 2021-11-12T05:40:21.734 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.721+0000 7f87bf7fe700 1 --2- 172.21.2.115:0/3280228163 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f87c00b7c80 0x7f87c0067170 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f87c00b2d90 tx=0x7f87a8006eb0).ready entity=mon.1 client_cookie=76b2c1c348d4cf03 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:21.735 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.721+0000 7f87be7fc700 1 -- 172.21.2.115:0/3280228163 <== mon.1 v2:172.21.2.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87a800d5c0 con 0x7f87c00b7c80 2021-11-12T05:40:21.735 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.721+0000 7f87be7fc700 1 -- 172.21.2.115:0/3280228163 <== mon.1 v2:172.21.2.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a8000e90 con 0x7f87c00b7c80 2021-11-12T05:40:21.735 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.721+0000 7f87be7fc700 1 -- 172.21.2.115:0/3280228163 <== mon.1 v2:172.21.2.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87a800d950 con 0x7f87c00b7c80 2021-11-12T05:40:21.735 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.725+0000 7f87c5bd0700 1 -- 172.21.2.115:0/3280228163 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f87c00b7c80 msgr2=0x7f87c0067170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.736 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.725+0000 7f87c5bd0700 1 --2- 172.21.2.115:0/3280228163 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f87c00b7c80 0x7f87c0067170 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f87c00b2d90 tx=0x7f87a8006eb0).stop 2021-11-12T05:40:21.736 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.725+0000 7f87c5bd0700 1 -- 172.21.2.115:0/3280228163 shutdown_connections 2021-11-12T05:40:21.736 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.725+0000 7f87c5bd0700 1 --2- 172.21.2.115:0/3280228163 >> v2:172.21.2.105:3300/0 conn(0x7f87c0140f90 0x7f87c01413b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.736 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.725+0000 7f87c5bd0700 1 --2- 172.21.2.115:0/3280228163 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f87c00b7c80 0x7f87c0067170 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.737 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.725+0000 7f87c5bd0700 1 -- 172.21.2.115:0/3280228163 >> 172.21.2.115:0/3280228163 conn(0x7f87c005c860 msgr2=0x7f87c00608d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:21.737 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.725+0000 7f87c5bd0700 1 -- 172.21.2.115:0/3280228163 shutdown_connections 2021-11-12T05:40:21.737 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.725+0000 7f87c5bd0700 1 -- 172.21.2.115:0/3280228163 wait complete. 2021-11-12T05:40:21.737 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.725+0000 7f87c5bd0700 1 Processor -- start 2021-11-12T05:40:21.737 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.725+0000 7f87c5bd0700 1 -- start start 2021-11-12T05:40:21.738 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.725+0000 7f87c5bd0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f87c0064900 0x7f87c0144130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:21.738 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.725+0000 7f87c5bd0700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f87c00b7c80 0x7f87c013fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:21.738 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.725+0000 7f87c5bd0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f87c0140f90 0x7f87c0140060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:21.738 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.725+0000 7f87c5bd0700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c013e700 con 0x7f87c0064900 2021-11-12T05:40:21.739 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.725+0000 7f87c5bd0700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c013dd20 con 0x7f87c00b7c80 2021-11-12T05:40:21.739 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.725+0000 7f87c5bd0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c013dfc0 con 0x7f87c0140f90 2021-11-12T05:40:21.739 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.725+0000 7f87bffff700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f87c0140f90 0x7f87c0140060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:21.739 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.725+0000 7f87bffff700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f87c0140f90 0x7f87c0140060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3301/0 says I am v2:172.21.2.115:40286/0 (socket says 172.21.2.115:40286) 2021-11-12T05:40:21.740 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.725+0000 7f87bffff700 1 -- 172.21.2.115:0/2001442732 learned_addr learned my addr 172.21.2.115:0/2001442732 (peer_addr_for_me v2:172.21.2.115:0/0) 2021-11-12T05:40:21.740 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.725+0000 7f87beffd700 1 --2- 172.21.2.115:0/2001442732 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f87c00b7c80 0x7f87c013fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:21.740 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.725+0000 7f87bf7fe700 1 --2- 172.21.2.115:0/2001442732 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f87c0064900 0x7f87c0144130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:21.740 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.725+0000 7f87bffff700 1 -- 172.21.2.115:0/2001442732 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f87c00b7c80 msgr2=0x7f87c013fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.740 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.725+0000 7f87bffff700 1 --2- 172.21.2.115:0/2001442732 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f87c00b7c80 0x7f87c013fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.741 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.725+0000 7f87bffff700 1 -- 172.21.2.115:0/2001442732 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f87c0064900 msgr2=0x7f87c0144130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.741 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.725+0000 7f87bffff700 1 --2- 172.21.2.115:0/2001442732 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f87c0064900 0x7f87c0144130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.741 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.725+0000 7f87bffff700 1 -- 172.21.2.115:0/2001442732 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a800b1e0 con 0x7f87c0140f90 2021-11-12T05:40:21.741 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.725+0000 7f87bffff700 1 --2- 172.21.2.115:0/2001442732 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f87c0140f90 0x7f87c0140060 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f87b8006e00 tx=0x7f87b80091d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:21.742 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.725+0000 7f87bcff9700 1 -- 172.21.2.115:0/2001442732 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87b800c670 con 0x7f87c0140f90 2021-11-12T05:40:21.742 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.725+0000 7f87bcff9700 1 -- 172.21.2.115:0/2001442732 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b800c7d0 con 0x7f87c0140f90 2021-11-12T05:40:21.742 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.725+0000 7f87bcff9700 1 -- 172.21.2.115:0/2001442732 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87b800cb30 con 0x7f87c0140f90 2021-11-12T05:40:21.742 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.725+0000 7f87c5bd0700 1 -- 172.21.2.115:0/2001442732 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c013e260 con 0x7f87c0140f90 2021-11-12T05:40:21.743 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.725+0000 7f87c5bd0700 1 -- 172.21.2.115:0/2001442732 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c0140bf0 con 0x7f87c0140f90 2021-11-12T05:40:21.743 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.725+0000 7f87bcff9700 1 -- 172.21.2.115:0/2001442732 <== mon.2 v2:172.21.2.115:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f87b801b400 con 0x7f87c0140f90 2021-11-12T05:40:21.743 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.725+0000 7f87bcff9700 1 -- 172.21.2.115:0/2001442732 <== mon.2 v2:172.21.2.115:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7f87b8012a10 con 0x7f87c0140f90 2021-11-12T05:40:21.743 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.725+0000 7f87c5bd0700 1 -- 172.21.2.115:0/2001442732 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c013c750 con 0x7f87c0140f90 2021-11-12T05:40:21.744 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.729+0000 7f87bcff9700 1 -- 172.21.2.115:0/2001442732 <== mon.2 v2:172.21.2.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f87c013c750 con 0x7f87c0140f90 2021-11-12T05:40:21.776 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.773+0000 7f87c5bd0700 1 -- 172.21.2.115:0/2001442732 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a2c83b5d-8d37-4d30-ac04-30d89a76e485", "id": 6} v 0) v1 -- 0x7f87c013e3f0 con 0x7f87c0140f90 2021-11-12T05:40:21.779 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.777+0000 7f87bcff9700 1 -- 172.21.2.115:0/2001442732 <== mon.2 v2:172.21.2.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a2c83b5d-8d37-4d30-ac04-30d89a76e485", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f87b8016020 con 0x7f87c0140f90 2021-11-12T05:40:21.780 INFO:teuthology.orchestra.run.gibba015.stdout:6 2021-11-12T05:40:21.781 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.777+0000 7f87c5bd0700 1 -- 172.21.2.115:0/2001442732 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f87c0140f90 msgr2=0x7f87c0140060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.781 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.777+0000 7f87c5bd0700 1 --2- 172.21.2.115:0/2001442732 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f87c0140f90 0x7f87c0140060 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f87b8006e00 tx=0x7f87b80091d0).stop 2021-11-12T05:40:21.781 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.777+0000 7f87c5bd0700 1 -- 172.21.2.115:0/2001442732 shutdown_connections 2021-11-12T05:40:21.782 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.777+0000 7f87c5bd0700 1 --2- 172.21.2.115:0/2001442732 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f87c0140f90 0x7f87c0140060 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.782 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.777+0000 7f87c5bd0700 1 --2- 172.21.2.115:0/2001442732 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f87c00b7c80 0x7f87c013fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.782 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.777+0000 7f87c5bd0700 1 --2- 172.21.2.115:0/2001442732 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f87c0064900 0x7f87c0144130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.782 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.777+0000 7f87c5bd0700 1 -- 172.21.2.115:0/2001442732 >> 172.21.2.115:0/2001442732 conn(0x7f87c005c860 msgr2=0x7f87c0144ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:21.783 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.777+0000 7f87c5bd0700 1 -- 172.21.2.115:0/2001442732 shutdown_connections 2021-11-12T05:40:21.783 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.777+0000 7f87c5bd0700 1 -- 172.21.2.115:0/2001442732 wait complete. 2021-11-12T05:40:21.786 DEBUG:teuthology.orchestra.run.gibba015:> sudo ceph --cluster ceph osd new 786ce966-d0fb-4181-aed4-c26e3ef61c43 7 2021-11-12T05:40:21.839 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.833+0000 7f5ee6ab0700 1 Processor -- start 2021-11-12T05:40:21.839 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.833+0000 7f5ee6ab0700 1 -- start start 2021-11-12T05:40:21.841 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5ee6ab0700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f5ee0062a80 0x7f5ee0142fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:21.841 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5ee6ab0700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee00b2390 con 0x7f5ee00b7870 2021-11-12T05:40:21.841 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5ee6ab0700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee00b2630 con 0x7f5ee00ae090 2021-11-12T05:40:21.842 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5ee6ab0700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee00618b0 con 0x7f5ee0062a80 2021-11-12T05:40:21.842 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5edffff700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7f5ee00ae090 0x7f5ee0062370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.115:42066/0 (socket says 172.21.2.115:42066) 2021-11-12T05:40:21.842 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5edffff700 1 -- 172.21.2.115:0/3479326131 learned_addr learned my addr 172.21.2.115:0/3479326131 (peer_addr_for_me v1:172.21.2.115:0/0) 2021-11-12T05:40:21.842 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5ee504d700 1 --2- 172.21.2.115:0/3479326131 >> v2:172.21.2.115:3300/0 conn(0x7f5ee0062a80 0x7f5ee0142fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:21.843 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5edf7fe700 1 -- 172.21.2.115:0/3479326131 <== mon.1 v1:172.21.2.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 775036775 0 0) 0x7f5ee00b2630 con 0x7f5ee00ae090 2021-11-12T05:40:21.843 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5edf7fe700 1 -- 172.21.2.115:0/3479326131 --> v1:172.21.2.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ec0003260 con 0x7f5ee00ae090 2021-11-12T05:40:21.843 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5ee504d700 1 -- 172.21.2.115:0/3479326131 >> v1:172.21.2.115:6789/0 conn(0x7f5ee00ae090 legacy=0x7f5ee0062370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.843 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5ee504d700 1 -- 172.21.2.115:0/3479326131 >> v1:172.21.2.105:6789/0 conn(0x7f5ee00b7870 legacy=0x7f5ee013cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.844 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5ee504d700 1 -- 172.21.2.115:0/3479326131 --> v2:172.21.2.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee00b28d0 con 0x7f5ee0062a80 2021-11-12T05:40:21.844 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5ee504d700 1 --2- 172.21.2.115:0/3479326131 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5ee0062a80 0x7f5ee0142fc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f5ed8002f70 tx=0x7f5ed8006df0).ready entity=mon.1 client_cookie=a47064338bc60740 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:21.844 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5edf7fe700 1 -- 172.21.2.115:0/3479326131 <== mon.1 v2:172.21.2.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ed800d610 con 0x7f5ee0062a80 2021-11-12T05:40:21.844 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5edf7fe700 1 -- 172.21.2.115:0/3479326131 <== mon.1 v2:172.21.2.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed8000e90 con 0x7f5ee0062a80 2021-11-12T05:40:21.844 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5edf7fe700 1 -- 172.21.2.115:0/3479326131 <== mon.1 v2:172.21.2.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ed800d960 con 0x7f5ee0062a80 2021-11-12T05:40:21.845 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5ee6ab0700 1 -- 172.21.2.115:0/3479326131 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5ee0062a80 msgr2=0x7f5ee0142fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.845 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5ee6ab0700 1 --2- 172.21.2.115:0/3479326131 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5ee0062a80 0x7f5ee0142fc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f5ed8002f70 tx=0x7f5ed8006df0).stop 2021-11-12T05:40:21.845 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5ee6ab0700 1 -- 172.21.2.115:0/3479326131 shutdown_connections 2021-11-12T05:40:21.845 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5ee6ab0700 1 --2- 172.21.2.115:0/3479326131 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5ee0062a80 0x7f5ee0142fc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.845 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5ee6ab0700 1 -- 172.21.2.115:0/3479326131 >> 172.21.2.115:0/3479326131 conn(0x7f5ee00608d0 msgr2=0x7f5ee005c490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:21.846 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5ee6ab0700 1 -- 172.21.2.115:0/3479326131 shutdown_connections 2021-11-12T05:40:21.846 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5ee6ab0700 1 -- 172.21.2.115:0/3479326131 wait complete. 2021-11-12T05:40:21.849 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5ee6ab0700 1 Processor -- start 2021-11-12T05:40:21.850 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5ee6ab0700 1 -- start start 2021-11-12T05:40:21.850 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5ee6ab0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ee0062a80 0x7f5ee0066790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:21.850 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5ee6ab0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5ee00ae090 0x7f5ee0066c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:21.851 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5ee6ab0700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5ee00b7870 0x7f5ee0145380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:21.851 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5ee6ab0700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee0067170 con 0x7f5ee0062a80 2021-11-12T05:40:21.851 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5ee6ab0700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee01530c0 con 0x7f5ee00b7870 2021-11-12T05:40:21.851 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5ee6ab0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee0153360 con 0x7f5ee00ae090 2021-11-12T05:40:21.851 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5edffff700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5ee00ae090 0x7f5ee0066c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:21.852 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5ee484c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ee0062a80 0x7f5ee0066790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:21.852 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5edffff700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5ee00ae090 0x7f5ee0066c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3301/0 says I am v2:172.21.2.115:40298/0 (socket says 172.21.2.115:40298) 2021-11-12T05:40:21.852 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5edffff700 1 -- 172.21.2.115:0/4084027617 learned_addr learned my addr 172.21.2.115:0/4084027617 (peer_addr_for_me v2:172.21.2.115:0/0) 2021-11-12T05:40:21.852 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5ee504d700 1 --2- 172.21.2.115:0/4084027617 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5ee00b7870 0x7f5ee0145380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:21.853 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5edffff700 1 -- 172.21.2.115:0/4084027617 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5ee00b7870 msgr2=0x7f5ee0145380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.853 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5edffff700 1 --2- 172.21.2.115:0/4084027617 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5ee00b7870 0x7f5ee0145380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.853 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5edffff700 1 -- 172.21.2.115:0/4084027617 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ee0062a80 msgr2=0x7f5ee0066790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.853 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5edffff700 1 --2- 172.21.2.115:0/4084027617 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ee0062a80 0x7f5ee0066790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.854 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5edffff700 1 -- 172.21.2.115:0/4084027617 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed800b180 con 0x7f5ee00ae090 2021-11-12T05:40:21.854 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5ee504d700 1 --2- 172.21.2.115:0/4084027617 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5ee00b7870 0x7f5ee0145380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-12T05:40:21.854 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5edffff700 1 --2- 172.21.2.115:0/4084027617 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5ee00ae090 0x7f5ee0066c80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f5ee00672b0 tx=0x7f5ed0007e50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:21.854 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5eddffb700 1 -- 172.21.2.115:0/4084027617 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ed0005ba0 con 0x7f5ee00ae090 2021-11-12T05:40:21.854 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5eddffb700 1 -- 172.21.2.115:0/4084027617 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed0005d00 con 0x7f5ee00ae090 2021-11-12T05:40:21.855 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5ee6ab0700 1 -- 172.21.2.115:0/4084027617 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee0146290 con 0x7f5ee00ae090 2021-11-12T05:40:21.855 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5eddffb700 1 -- 172.21.2.115:0/4084027617 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ed00072c0 con 0x7f5ee00ae090 2021-11-12T05:40:21.855 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5ee6ab0700 1 -- 172.21.2.115:0/4084027617 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee00afb80 con 0x7f5ee00ae090 2021-11-12T05:40:21.855 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.837+0000 7f5eddffb700 1 -- 172.21.2.115:0/4084027617 <== mon.2 v2:172.21.2.115:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f5ed0010070 con 0x7f5ee00ae090 2021-11-12T05:40:21.856 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.841+0000 7f5eddffb700 1 -- 172.21.2.115:0/4084027617 <== mon.2 v2:172.21.2.115:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7f5ed00075f0 con 0x7f5ee00ae090 2021-11-12T05:40:21.856 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.841+0000 7f5ee6ab0700 1 -- 172.21.2.115:0/4084027617 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ee013d460 con 0x7f5ee00ae090 2021-11-12T05:40:21.856 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.841+0000 7f5eddffb700 1 -- 172.21.2.115:0/4084027617 <== mon.2 v2:172.21.2.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f5ed001c3f0 con 0x7f5ee00ae090 2021-11-12T05:40:21.889 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.885+0000 7f5ee6ab0700 1 -- 172.21.2.115:0/4084027617 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_command({"prefix": "osd new", "uuid": "786ce966-d0fb-4181-aed4-c26e3ef61c43", "id": 7} v 0) v1 -- 0x7f5ee005f280 con 0x7f5ee00ae090 2021-11-12T05:40:21.893 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.889+0000 7f5eddffb700 1 -- 172.21.2.115:0/4084027617 <== mon.2 v2:172.21.2.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "786ce966-d0fb-4181-aed4-c26e3ef61c43", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5ed001c590 con 0x7f5ee00ae090 2021-11-12T05:40:21.893 INFO:teuthology.orchestra.run.gibba015.stdout:7 2021-11-12T05:40:21.895 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.889+0000 7f5ee6ab0700 1 -- 172.21.2.115:0/4084027617 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5ee00ae090 msgr2=0x7f5ee0066c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:21.895 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.889+0000 7f5ee6ab0700 1 --2- 172.21.2.115:0/4084027617 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5ee00ae090 0x7f5ee0066c80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f5ee00672b0 tx=0x7f5ed0007e50).stop 2021-11-12T05:40:21.895 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.889+0000 7f5ee6ab0700 1 -- 172.21.2.115:0/4084027617 shutdown_connections 2021-11-12T05:40:21.895 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.889+0000 7f5ee6ab0700 1 --2- 172.21.2.115:0/4084027617 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5ee00b7870 0x7f5ee0145380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.896 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.889+0000 7f5ee6ab0700 1 --2- 172.21.2.115:0/4084027617 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5ee00ae090 0x7f5ee0066c80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.896 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.889+0000 7f5ee6ab0700 1 --2- 172.21.2.115:0/4084027617 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ee0062a80 0x7f5ee0066790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:21.896 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.889+0000 7f5ee6ab0700 1 -- 172.21.2.115:0/4084027617 >> 172.21.2.115:0/4084027617 conn(0x7f5ee00608d0 msgr2=0x7f5ee00b64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:21.896 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.889+0000 7f5ee6ab0700 1 -- 172.21.2.115:0/4084027617 shutdown_connections 2021-11-12T05:40:21.897 INFO:teuthology.orchestra.run.gibba015.stderr:2021-11-12T05:40:21.889+0000 7f5ee6ab0700 1 -- 172.21.2.115:0/4084027617 wait complete. 2021-11-12T05:40:21.900 INFO:tasks.ceph.osd.0:Restarting daemon 2021-11-12T05:40:21.901 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2021-11-12T05:40:21.903 INFO:tasks.ceph.osd.0:Started 2021-11-12T05:40:21.903 INFO:tasks.ceph.osd.1:Restarting daemon 2021-11-12T05:40:21.904 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2021-11-12T05:40:21.905 INFO:tasks.ceph.osd.1:Started 2021-11-12T05:40:21.906 INFO:tasks.ceph.osd.2:Restarting daemon 2021-11-12T05:40:21.906 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2021-11-12T05:40:21.908 INFO:tasks.ceph.osd.2:Started 2021-11-12T05:40:21.909 INFO:tasks.ceph.osd.3:Restarting daemon 2021-11-12T05:40:21.909 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2021-11-12T05:40:21.911 INFO:tasks.ceph.osd.3:Started 2021-11-12T05:40:21.911 INFO:tasks.ceph.osd.4:Restarting daemon 2021-11-12T05:40:21.911 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2021-11-12T05:40:21.913 INFO:tasks.ceph.osd.4:Started 2021-11-12T05:40:21.913 INFO:tasks.ceph.osd.5:Restarting daemon 2021-11-12T05:40:21.914 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2021-11-12T05:40:21.916 INFO:tasks.ceph.osd.5:Started 2021-11-12T05:40:21.916 INFO:tasks.ceph.osd.6:Restarting daemon 2021-11-12T05:40:21.916 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2021-11-12T05:40:21.918 INFO:tasks.ceph.osd.6:Started 2021-11-12T05:40:21.918 INFO:tasks.ceph.osd.7:Restarting daemon 2021-11-12T05:40:21.919 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2021-11-12T05:40:21.920 INFO:tasks.ceph.osd.7:Started 2021-11-12T05:40:21.921 INFO:tasks.ceph:Waiting for OSDs to come up 2021-11-12T05:40:22.242 INFO:tasks.ceph.osd.4.gibba015.stderr:2021-11-12T05:40:22.237+0000 7fb145153d80 -1 Falling back to public interface 2021-11-12T05:40:22.278 INFO:tasks.ceph.osd.5.gibba015.stderr:2021-11-12T05:40:22.273+0000 7ff392516d80 -1 Falling back to public interface 2021-11-12T05:40:22.486 INFO:tasks.ceph.osd.0.gibba005.stderr:2021-11-12T05:40:22.481+0000 7f498bb93d80 -1 Falling back to public interface 2021-11-12T05:40:22.496 INFO:tasks.ceph.osd.1.gibba005.stderr:2021-11-12T05:40:22.493+0000 7fa7b6589d80 -1 Falling back to public interface 2021-11-12T05:40:22.498 INFO:tasks.ceph.osd.6.gibba015.stderr:2021-11-12T05:40:22.493+0000 7fd7a7ff7d80 -1 Falling back to public interface 2021-11-12T05:40:22.512 INFO:tasks.ceph.osd.2.gibba005.stderr:2021-11-12T05:40:22.509+0000 7f1368f3ed80 -1 Falling back to public interface 2021-11-12T05:40:22.516 INFO:tasks.ceph.osd.3.gibba005.stderr:2021-11-12T05:40:22.513+0000 7faa9a3bad80 -1 Falling back to public interface 2021-11-12T05:40:22.524 INFO:tasks.ceph.osd.7.gibba015.stderr:2021-11-12T05:40:22.521+0000 7f0fa4be2d80 -1 Falling back to public interface 2021-11-12T05:40:22.725 DEBUG:teuthology.orchestra.run.gibba005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-11-12T05:40:22.784 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.781+0000 7f0da18d3700 1 Processor -- start 2021-11-12T05:40:22.784 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.781+0000 7f0da18d3700 1 -- start start 2021-11-12T05:40:22.786 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.781+0000 7f0da18d3700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d9c0b1480 0x7f0d9c0b07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:22.786 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.781+0000 7f0da18d3700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f0d9c0682a0 0x7f0d9c0b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:22.786 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.781+0000 7f0da18d3700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d9c0b00e0 con 0x7f0d9c0b6190 2021-11-12T05:40:22.787 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.781+0000 7f0da18d3700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d9c0b6570 con 0x7f0d9c0682a0 2021-11-12T05:40:22.787 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.781+0000 7f0da18d3700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9c13fe60 con 0x7f0d9c0b1480 2021-11-12T05:40:22.787 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.781+0000 7f0d9b7fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f0d9c0682a0 0x7f0d9c0b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:22.788 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.781+0000 7f0d9affd700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f0d9c0b6190 0x7f0d9c0ad2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:52530/0 (socket says 172.21.2.105:52530) 2021-11-12T05:40:22.788 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.781+0000 7f0d9affd700 1 -- 172.21.2.105:0/656758247 learned_addr learned my addr 172.21.2.105:0/656758247 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:22.788 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.781+0000 7f0d9a7fc700 1 --2- 172.21.2.105:0/656758247 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d9c0b1480 0x7f0d9c0b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:22.788 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.781+0000 7f0d9b7fe700 1 -- 172.21.2.105:0/656758247 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d9c0b1480 msgr2=0x7f0d9c0b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:22.789 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.781+0000 7f0d9b7fe700 1 --2- 172.21.2.105:0/656758247 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d9c0b1480 0x7f0d9c0b07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:22.790 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.781+0000 7f0d9b7fe700 1 -- 172.21.2.105:0/656758247 >> v1:172.21.2.105:6789/0 conn(0x7f0d9c0b6190 legacy=0x7f0d9c0ad2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:22.791 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.781+0000 7f0d9b7fe700 1 -- 172.21.2.105:0/656758247 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d9c0b0310 con 0x7f0d9c0682a0 2021-11-12T05:40:22.791 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.781+0000 7f0d9b7fe700 1 --2- 172.21.2.105:0/656758247 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d9c0682a0 0x7f0d9c0b0ca0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f0d940032f0 tx=0x7f0d940091d0).ready entity=mon.0 client_cookie=c2e8c61374a8948e server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:22.791 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.781+0000 7f0d99ffb700 1 -- 172.21.2.105:0/656758247 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d94009ea0 con 0x7f0d9c0682a0 2021-11-12T05:40:22.791 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.781+0000 7f0d99ffb700 1 -- 172.21.2.105:0/656758247 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9400b8a0 con 0x7f0d9c0682a0 2021-11-12T05:40:22.792 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.781+0000 7f0d99ffb700 1 -- 172.21.2.105:0/656758247 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d9400ba10 con 0x7f0d9c0682a0 2021-11-12T05:40:22.792 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.781+0000 7f0da18d3700 1 -- 172.21.2.105:0/656758247 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d9c0682a0 msgr2=0x7f0d9c0b0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:22.792 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.781+0000 7f0da18d3700 1 --2- 172.21.2.105:0/656758247 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d9c0682a0 0x7f0d9c0b0ca0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f0d940032f0 tx=0x7f0d940091d0).stop 2021-11-12T05:40:22.792 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.781+0000 7f0da18d3700 1 -- 172.21.2.105:0/656758247 shutdown_connections 2021-11-12T05:40:22.793 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.781+0000 7f0da18d3700 1 --2- 172.21.2.105:0/656758247 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d9c0682a0 0x7f0d9c0b0ca0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:22.793 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.781+0000 7f0da18d3700 1 --2- 172.21.2.105:0/656758247 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d9c0b1480 0x7f0d9c0b07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:22.793 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.781+0000 7f0da18d3700 1 -- 172.21.2.105:0/656758247 >> 172.21.2.105:0/656758247 conn(0x7f0d9c0600d0 msgr2=0x7f0d9c0b5740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:22.793 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.781+0000 7f0da18d3700 1 -- 172.21.2.105:0/656758247 shutdown_connections 2021-11-12T05:40:22.793 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.781+0000 7f0da18d3700 1 -- 172.21.2.105:0/656758247 wait complete. 2021-11-12T05:40:22.796 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.781+0000 7f0da18d3700 1 Processor -- start 2021-11-12T05:40:22.797 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.781+0000 7f0da18d3700 1 -- start start 2021-11-12T05:40:22.797 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.785+0000 7f0da18d3700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0d9c0682a0 0x7f0d9c13ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:22.797 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.785+0000 7f0da18d3700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d9c0b1480 0x7f0d9c065df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:22.797 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.785+0000 7f0da18d3700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d9c0b6190 0x7f0d9c0639a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:22.798 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.785+0000 7f0da18d3700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9c1454d0 con 0x7f0d9c0b1480 2021-11-12T05:40:22.798 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.785+0000 7f0da18d3700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9c0664b0 con 0x7f0d9c0682a0 2021-11-12T05:40:22.798 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.785+0000 7f0da18d3700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9c0636b0 con 0x7f0d9c0b6190 2021-11-12T05:40:22.798 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.785+0000 7f0d9a7fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d9c0b1480 0x7f0d9c065df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:22.799 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.785+0000 7f0d9a7fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d9c0b1480 0x7f0d9c065df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42142/0 (socket says 172.21.2.105:42142) 2021-11-12T05:40:22.799 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.785+0000 7f0d9a7fc700 1 -- 172.21.2.105:0/537312659 learned_addr learned my addr 172.21.2.105:0/537312659 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:22.799 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.785+0000 7f0d9affd700 1 --2- 172.21.2.105:0/537312659 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0d9c0682a0 0x7f0d9c13ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:22.799 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.785+0000 7f0d9b7fe700 1 --2- 172.21.2.105:0/537312659 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d9c0b6190 0x7f0d9c0639a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:22.800 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.785+0000 7f0d9a7fc700 1 -- 172.21.2.105:0/537312659 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d9c0b6190 msgr2=0x7f0d9c0639a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:22.800 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.785+0000 7f0d9a7fc700 1 --2- 172.21.2.105:0/537312659 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d9c0b6190 0x7f0d9c0639a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:22.800 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.785+0000 7f0d9a7fc700 1 -- 172.21.2.105:0/537312659 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0d9c0682a0 msgr2=0x7f0d9c13ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:22.800 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.785+0000 7f0d9a7fc700 1 --2- 172.21.2.105:0/537312659 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0d9c0682a0 0x7f0d9c13ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:22.801 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.785+0000 7f0d9a7fc700 1 -- 172.21.2.105:0/537312659 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d94009470 con 0x7f0d9c0b1480 2021-11-12T05:40:22.801 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.785+0000 7f0d9affd700 1 --2- 172.21.2.105:0/537312659 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0d9c0682a0 0x7f0d9c13ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:40:22.801 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.785+0000 7f0d9b7fe700 1 --2- 172.21.2.105:0/537312659 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d9c0b6190 0x7f0d9c0639a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:40:22.801 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.785+0000 7f0d9a7fc700 1 --2- 172.21.2.105:0/537312659 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d9c0b1480 0x7f0d9c065df0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f0d900030b0 tx=0x7f0d90008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:22.802 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.785+0000 7f0d8bfff700 1 -- 172.21.2.105:0/537312659 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d90011780 con 0x7f0d9c0b1480 2021-11-12T05:40:22.802 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.785+0000 7f0d8bfff700 1 -- 172.21.2.105:0/537312659 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d900118e0 con 0x7f0d9c0b1480 2021-11-12T05:40:22.802 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.785+0000 7f0da18d3700 1 -- 172.21.2.105:0/537312659 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d9c063410 con 0x7f0d9c0b1480 2021-11-12T05:40:22.802 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.785+0000 7f0da18d3700 1 -- 172.21.2.105:0/537312659 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d9c145ed0 con 0x7f0d9c0b1480 2021-11-12T05:40:22.803 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.785+0000 7f0d8bfff700 1 -- 172.21.2.105:0/537312659 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d90011c40 con 0x7f0d9c0b1480 2021-11-12T05:40:22.803 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.785+0000 7f0d8bfff700 1 -- 172.21.2.105:0/537312659 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 2) v1 ==== 32742+0+0 (secure 0 0 0) 0x7f0d9001c460 con 0x7f0d9c0b1480 2021-11-12T05:40:22.803 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.785+0000 7f0da18d3700 1 -- 172.21.2.105:0/537312659 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d9c1461e0 con 0x7f0d9c0b1480 2021-11-12T05:40:22.803 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.785+0000 7f0d8bfff700 1 -- 172.21.2.105:0/537312659 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7f0d9003a4f0 con 0x7f0d9c0b1480 2021-11-12T05:40:22.804 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.785+0000 7f0d8bfff700 1 -- 172.21.2.105:0/537312659 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f0d9001a360 con 0x7f0d9c0b1480 2021-11-12T05:40:22.828 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.825+0000 7f0da18d3700 1 -- 172.21.2.105:0/537312659 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d9c0662e0 con 0x7f0d9c0b1480 2021-11-12T05:40:22.829 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.825+0000 7f0d8bfff700 1 -- 172.21.2.105:0/537312659 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+6849 (secure 0 0 0) 0x7f0d900102e0 con 0x7f0d9c0b1480 2021-11-12T05:40:22.830 INFO:teuthology.misc.health.gibba005.stdout: 2021-11-12T05:40:22.830 INFO:teuthology.misc.health.gibba005.stdout:{"epoch":10,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:40:21.890069+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:40:22.831 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.825+0000 7f0da18d3700 1 -- 172.21.2.105:0/537312659 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d9c0b1480 msgr2=0x7f0d9c065df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:22.831 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.825+0000 7f0da18d3700 1 --2- 172.21.2.105:0/537312659 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d9c0b1480 0x7f0d9c065df0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f0d900030b0 tx=0x7f0d90008040).stop 2021-11-12T05:40:22.831 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.825+0000 7f0da18d3700 1 -- 172.21.2.105:0/537312659 shutdown_connections 2021-11-12T05:40:22.832 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.825+0000 7f0da18d3700 1 --2- 172.21.2.105:0/537312659 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d9c0b6190 0x7f0d9c0639a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:22.832 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.825+0000 7f0da18d3700 1 --2- 172.21.2.105:0/537312659 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d9c0b1480 0x7f0d9c065df0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:22.832 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.825+0000 7f0da18d3700 1 --2- 172.21.2.105:0/537312659 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0d9c0682a0 0x7f0d9c13ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:22.832 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.825+0000 7f0da18d3700 1 -- 172.21.2.105:0/537312659 >> 172.21.2.105:0/537312659 conn(0x7f0d9c0600d0 msgr2=0x7f0d9c148840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:22.833 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.825+0000 7f0da18d3700 1 -- 172.21.2.105:0/537312659 shutdown_connections 2021-11-12T05:40:22.833 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:22.825+0000 7f0da18d3700 1 -- 172.21.2.105:0/537312659 wait complete. 2021-11-12T05:40:22.836 DEBUG:teuthology.misc:0 of 8 OSDs are up 2021-11-12T05:40:23.439 INFO:tasks.ceph.osd.4.gibba015.stderr:2021-11-12T05:40:23.437+0000 7fb145153d80 -1 osd.4 0 log_to_monitors {default=true} 2021-11-12T05:40:23.444 INFO:tasks.ceph.osd.3.gibba005.stderr:2021-11-12T05:40:23.441+0000 7faa9a3bad80 -1 osd.3 0 log_to_monitors {default=true} 2021-11-12T05:40:23.504 INFO:tasks.ceph.osd.5.gibba015.stderr:2021-11-12T05:40:23.501+0000 7ff392516d80 -1 osd.5 0 log_to_monitors {default=true} 2021-11-12T05:40:23.649 INFO:tasks.ceph.osd.1.gibba005.stderr:2021-11-12T05:40:23.645+0000 7fa7b6589d80 -1 osd.1 0 log_to_monitors {default=true} 2021-11-12T05:40:23.654 INFO:tasks.ceph.osd.6.gibba015.stderr:2021-11-12T05:40:23.649+0000 7fd7a7ff7d80 -1 osd.6 0 log_to_monitors {default=true} 2021-11-12T05:40:23.655 INFO:tasks.ceph.osd.0.gibba005.stderr:2021-11-12T05:40:23.653+0000 7f498bb93d80 -1 osd.0 0 log_to_monitors {default=true} 2021-11-12T05:40:23.703 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:40:23.707 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:40:23.709 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:40:23.713 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:40:23.716 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:40:23.724 INFO:tasks.ceph.osd.2.gibba005.stderr:2021-11-12T05:40:23.721+0000 7f1368f3ed80 -1 osd.2 0 log_to_monitors {default=true} 2021-11-12T05:40:23.761 INFO:tasks.ceph.osd.7.gibba015.stderr:2021-11-12T05:40:23.757+0000 7f0fa4be2d80 -1 osd.7 0 log_to_monitors {default=true} 2021-11-12T05:40:25.045 INFO:tasks.ceph.osd.5.gibba015.stderr:2021-11-12T05:40:25.041+0000 7ff3845bd700 -1 osd.5 0 waiting for initial osdmap 2021-11-12T05:40:25.046 INFO:tasks.ceph.osd.7.gibba015.stderr:2021-11-12T05:40:25.041+0000 7f0f96c89700 -1 osd.7 0 waiting for initial osdmap 2021-11-12T05:40:25.046 INFO:tasks.ceph.osd.4.gibba015.stderr:2021-11-12T05:40:25.041+0000 7fb1371fa700 -1 osd.4 0 waiting for initial osdmap 2021-11-12T05:40:25.047 INFO:tasks.ceph.osd.6.gibba015.stderr:2021-11-12T05:40:25.041+0000 7fd79a09e700 -1 osd.6 0 waiting for initial osdmap 2021-11-12T05:40:25.047 INFO:tasks.ceph.osd.1.gibba005.stderr:2021-11-12T05:40:25.041+0000 7fa7a8630700 -1 osd.1 0 waiting for initial osdmap 2021-11-12T05:40:25.048 INFO:tasks.ceph.osd.3.gibba005.stderr:2021-11-12T05:40:25.041+0000 7faa8c461700 -1 osd.3 0 waiting for initial osdmap 2021-11-12T05:40:25.048 INFO:tasks.ceph.osd.2.gibba005.stderr:2021-11-12T05:40:25.041+0000 7f135afe5700 -1 osd.2 0 waiting for initial osdmap 2021-11-12T05:40:25.049 INFO:tasks.ceph.osd.0.gibba005.stderr:2021-11-12T05:40:25.041+0000 7f497dc3a700 -1 osd.0 0 waiting for initial osdmap 2021-11-12T05:40:25.049 INFO:tasks.ceph.osd.4.gibba015.stderr:2021-11-12T05:40:25.045+0000 7fb13e676700 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-12T05:40:25.050 INFO:tasks.ceph.osd.6.gibba015.stderr:2021-11-12T05:40:25.045+0000 7fd7a151a700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-12T05:40:25.050 INFO:tasks.ceph.osd.5.gibba015.stderr:2021-11-12T05:40:25.045+0000 7ff38ba39700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-12T05:40:25.051 INFO:tasks.ceph.osd.7.gibba015.stderr:2021-11-12T05:40:25.045+0000 7f0f9e105700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-12T05:40:25.051 INFO:tasks.ceph.osd.2.gibba005.stderr:2021-11-12T05:40:25.045+0000 7f1362461700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-12T05:40:25.052 INFO:tasks.ceph.osd.0.gibba005.stderr:2021-11-12T05:40:25.045+0000 7f49850b6700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-12T05:40:25.053 INFO:tasks.ceph.osd.1.gibba005.stderr:2021-11-12T05:40:25.045+0000 7fa7afaac700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-12T05:40:25.053 INFO:tasks.ceph.osd.3.gibba005.stderr:2021-11-12T05:40:25.045+0000 7faa938dd700 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-12T05:40:29.641 DEBUG:teuthology.orchestra.run.gibba005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-11-12T05:40:29.700 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6c1324700 1 Processor -- start 2021-11-12T05:40:29.700 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6c1324700 1 -- start start 2021-11-12T05:40:29.703 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6c1324700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fa6bc0b37a0 0x7fa6bc0add80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:29.703 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6c1324700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6bc0ae270 con 0x7fa6bc0b42c0 2021-11-12T05:40:29.704 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6c1324700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6bc140f80 con 0x7fa6bc0ae490 2021-11-12T05:40:29.704 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6c1324700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6bc140d90 con 0x7fa6bc0b37a0 2021-11-12T05:40:29.704 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6baffd700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fa6bc0b42c0 0x7fa6bc0ad670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:52784/0 (socket says 172.21.2.105:52784) 2021-11-12T05:40:29.704 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6baffd700 1 -- 172.21.2.105:0/3423603635 learned_addr learned my addr 172.21.2.105:0/3423603635 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:29.705 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6b9ffb700 1 -- 172.21.2.105:0/3423603635 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1969891465 0 0) 0x7fa6bc0ae270 con 0x7fa6bc0b42c0 2021-11-12T05:40:29.705 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6b9ffb700 1 -- 172.21.2.105:0/3423603635 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa69c003260 con 0x7fa6bc0b42c0 2021-11-12T05:40:29.705 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6bb7fe700 1 --2- 172.21.2.105:0/3423603635 >> v2:172.21.2.115:3300/0 conn(0x7fa6bc0b37a0 0x7fa6bc0add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:29.705 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6b9ffb700 1 -- 172.21.2.105:0/3423603635 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1968686592 0 0) 0x7fa69c003260 con 0x7fa6bc0b42c0 2021-11-12T05:40:29.706 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6b9ffb700 1 -- 172.21.2.105:0/3423603635 >> v2:172.21.2.115:3300/0 conn(0x7fa6bc0b37a0 msgr2=0x7fa6bc0add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:29.706 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6b9ffb700 1 --2- 172.21.2.105:0/3423603635 >> v2:172.21.2.115:3300/0 conn(0x7fa6bc0b37a0 0x7fa6bc0add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:29.706 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6b9ffb700 1 -- 172.21.2.105:0/3423603635 >> v1:172.21.2.115:6789/0 conn(0x7fa6bc0ae490 legacy=0x7fa6bc1298d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:29.706 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6b9ffb700 1 -- 172.21.2.105:0/3423603635 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6bc0b1ef0 con 0x7fa6bc0b42c0 2021-11-12T05:40:29.707 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6b9ffb700 1 -- 172.21.2.105:0/3423603635 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fa6a4001680 con 0x7fa6bc0b42c0 2021-11-12T05:40:29.707 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6b9ffb700 1 -- 172.21.2.105:0/3423603635 >> v1:172.21.2.105:6789/0 conn(0x7fa6bc0b42c0 legacy=0x7fa6bc0ad670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:29.707 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6b9ffb700 1 --2- 172.21.2.105:0/3423603635 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa69c0037a0 0x7fa69c003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:29.707 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6b9ffb700 1 --2- 172.21.2.105:0/3423603635 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa69c004500 0x7fa69c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:29.707 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6b9ffb700 1 --2- 172.21.2.105:0/3423603635 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa69c004f90 0x7fa69c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:29.708 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6b9ffb700 1 -- 172.21.2.105:0/3423603635 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c00bdd0 con 0x7fa69c004f90 2021-11-12T05:40:29.708 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6b9ffb700 1 -- 172.21.2.105:0/3423603635 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c00bf40 con 0x7fa69c004500 2021-11-12T05:40:29.708 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6b9ffb700 1 -- 172.21.2.105:0/3423603635 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c00c100 con 0x7fa69c0037a0 2021-11-12T05:40:29.708 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6bb7fe700 1 --2- 172.21.2.105:0/3423603635 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa69c004f90 0x7fa69c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:29.709 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6ba7fc700 1 --2- 172.21.2.105:0/3423603635 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa69c004500 0x7fa69c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:29.709 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6bb7fe700 1 -- 172.21.2.105:0/3423603635 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa69c0037a0 msgr2=0x7fa69c003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:29.709 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6bb7fe700 1 --2- 172.21.2.105:0/3423603635 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa69c0037a0 0x7fa69c003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:29.709 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6bb7fe700 1 -- 172.21.2.105:0/3423603635 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa69c004500 msgr2=0x7fa69c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:29.709 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6bb7fe700 1 --2- 172.21.2.105:0/3423603635 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa69c004500 0x7fa69c004980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:29.710 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6bb7fe700 1 -- 172.21.2.105:0/3423603635 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa69c003260 con 0x7fa69c004f90 2021-11-12T05:40:29.710 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6bb7fe700 1 -- 172.21.2.105:0/3423603635 reap_dead start 2021-11-12T05:40:29.710 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6bb7fe700 1 --2- 172.21.2.105:0/3423603635 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa69c004f90 0x7fa69c00b750 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fa6b400a000 tx=0x7fa6b4008040).ready entity=mon.0 client_cookie=27c4f64048f29a97 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:29.710 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6b9ffb700 1 -- 172.21.2.105:0/3423603635 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6b400c070 con 0x7fa69c004f90 2021-11-12T05:40:29.710 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6b9ffb700 1 -- 172.21.2.105:0/3423603635 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b400e5f0 con 0x7fa69c004f90 2021-11-12T05:40:29.711 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6b9ffb700 1 -- 172.21.2.105:0/3423603635 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6b400e950 con 0x7fa69c004f90 2021-11-12T05:40:29.711 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6c1324700 1 -- 172.21.2.105:0/3423603635 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa69c004f90 msgr2=0x7fa69c00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:29.711 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6c1324700 1 --2- 172.21.2.105:0/3423603635 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa69c004f90 0x7fa69c00b750 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fa6b400a000 tx=0x7fa6b4008040).stop 2021-11-12T05:40:29.711 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6c1324700 1 -- 172.21.2.105:0/3423603635 shutdown_connections 2021-11-12T05:40:29.712 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6c1324700 1 --2- 172.21.2.105:0/3423603635 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa69c004f90 0x7fa69c00b750 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:29.712 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6c1324700 1 -- 172.21.2.105:0/3423603635 >> 172.21.2.105:0/3423603635 conn(0x7fa6bc05c4c0 msgr2=0x7fa6bc05c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:29.712 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6c1324700 1 -- 172.21.2.105:0/3423603635 shutdown_connections 2021-11-12T05:40:29.712 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.697+0000 7fa6c1324700 1 -- 172.21.2.105:0/3423603635 wait complete. 2021-11-12T05:40:29.715 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.701+0000 7fa6c1324700 1 Processor -- start 2021-11-12T05:40:29.715 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.701+0000 7fa6c1324700 1 -- start start 2021-11-12T05:40:29.716 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.701+0000 7fa6c1324700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa69c004f90 0x7fa6bc1404c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:29.716 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.701+0000 7fa6c1324700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa6bc0b5660 0x7fa6bc0b5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:29.716 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.701+0000 7fa6c1324700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa6bc0aec30 0x7fa6bc0af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:29.717 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.701+0000 7fa6c1324700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6bc0b6480 con 0x7fa6bc0aec30 2021-11-12T05:40:29.719 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.701+0000 7fa6c1324700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6bc0b17f0 con 0x7fa69c004f90 2021-11-12T05:40:29.719 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.701+0000 7fa6c1324700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6bc0b0ab0 con 0x7fa6bc0b5660 2021-11-12T05:40:29.720 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.701+0000 7fa6bb7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa6bc0aec30 0x7fa6bc0af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:29.720 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.701+0000 7fa6bb7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa6bc0aec30 0x7fa6bc0af0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42404/0 (socket says 172.21.2.105:42404) 2021-11-12T05:40:29.720 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.701+0000 7fa6bb7fe700 1 -- 172.21.2.105:0/865488921 learned_addr learned my addr 172.21.2.105:0/865488921 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:29.720 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.701+0000 7fa6baffd700 1 --2- 172.21.2.105:0/865488921 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa69c004f90 0x7fa6bc1404c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:29.721 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.701+0000 7fa6ba7fc700 1 --2- 172.21.2.105:0/865488921 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa6bc0b5660 0x7fa6bc0b5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:29.721 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.701+0000 7fa6bb7fe700 1 -- 172.21.2.105:0/865488921 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa6bc0b5660 msgr2=0x7fa6bc0b5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:29.721 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.701+0000 7fa6bb7fe700 1 --2- 172.21.2.105:0/865488921 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa6bc0b5660 0x7fa6bc0b5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:29.721 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.701+0000 7fa6bb7fe700 1 -- 172.21.2.105:0/865488921 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa69c004f90 msgr2=0x7fa6bc1404c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:29.722 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.701+0000 7fa6bb7fe700 1 --2- 172.21.2.105:0/865488921 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa69c004f90 0x7fa6bc1404c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:29.722 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.701+0000 7fa6bb7fe700 1 -- 172.21.2.105:0/865488921 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6bc0b8000 con 0x7fa6bc0aec30 2021-11-12T05:40:29.722 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.701+0000 7fa6bb7fe700 1 --2- 172.21.2.105:0/865488921 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa6bc0aec30 0x7fa6bc0af0b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fa6b400a000 tx=0x7fa6b4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:29.722 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.701+0000 7fa6b3fff700 1 -- 172.21.2.105:0/865488921 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6b4021070 con 0x7fa6bc0aec30 2021-11-12T05:40:29.722 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.701+0000 7fa6b3fff700 1 -- 172.21.2.105:0/865488921 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b401d440 con 0x7fa6bc0aec30 2021-11-12T05:40:29.723 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.701+0000 7fa6c1324700 1 -- 172.21.2.105:0/865488921 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6bc0b82a0 con 0x7fa6bc0aec30 2021-11-12T05:40:29.723 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.701+0000 7fa6b3fff700 1 -- 172.21.2.105:0/865488921 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6b401d7a0 con 0x7fa6bc0aec30 2021-11-12T05:40:29.723 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.701+0000 7fa6c1324700 1 -- 172.21.2.105:0/865488921 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6bc0b50b0 con 0x7fa6bc0aec30 2021-11-12T05:40:29.723 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.701+0000 7fa6c1324700 1 -- 172.21.2.105:0/865488921 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6bc0b6150 con 0x7fa6bc0aec30 2021-11-12T05:40:29.724 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.701+0000 7fa6b3fff700 1 -- 172.21.2.105:0/865488921 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa6b401d900 con 0x7fa6bc0aec30 2021-11-12T05:40:29.724 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.701+0000 7fa6b3fff700 1 --2- 172.21.2.105:0/865488921 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa6a00534f0 0x7fa6a00559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:29.724 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.701+0000 7fa6b3fff700 1 -- 172.21.2.105:0/865488921 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4896+0+0 (secure 0 0 0) 0x7fa6b406c500 con 0x7fa6bc0aec30 2021-11-12T05:40:29.724 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.701+0000 7fa6baffd700 1 --2- 172.21.2.105:0/865488921 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa6a00534f0 0x7fa6a00559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:29.724 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.701+0000 7fa6baffd700 1 --2- 172.21.2.105:0/865488921 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa6a00534f0 0x7fa6a00559b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fa6a400b000 tx=0x7fa6a4001630).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:29.725 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.705+0000 7fa6b3fff700 1 -- 172.21.2.105:0/865488921 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa6b4043b00 con 0x7fa6bc0aec30 2021-11-12T05:40:29.790 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.785+0000 7fa6c1324700 1 -- 172.21.2.105:0/865488921 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6bc0b08d0 con 0x7fa6bc0aec30 2021-11-12T05:40:29.791 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.785+0000 7fa6b3fff700 1 -- 172.21.2.105:0/865488921 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11805 (secure 0 0 0) 0x7fa6b4047120 con 0x7fa6bc0aec30 2021-11-12T05:40:29.791 INFO:teuthology.misc.health.gibba005.stdout: 2021-11-12T05:40:29.792 INFO:teuthology.misc.health.gibba005.stdout:{"epoch":16,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:40:28.073159+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:40:29.793 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.789+0000 7fa6c1324700 1 -- 172.21.2.105:0/865488921 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa6a00534f0 msgr2=0x7fa6a00559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:29.793 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.789+0000 7fa6c1324700 1 --2- 172.21.2.105:0/865488921 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa6a00534f0 0x7fa6a00559b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fa6a400b000 tx=0x7fa6a4001630).stop 2021-11-12T05:40:29.793 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.789+0000 7fa6c1324700 1 -- 172.21.2.105:0/865488921 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa6bc0aec30 msgr2=0x7fa6bc0af0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:29.794 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.789+0000 7fa6c1324700 1 --2- 172.21.2.105:0/865488921 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa6bc0aec30 0x7fa6bc0af0b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fa6b400a000 tx=0x7fa6b4008040).stop 2021-11-12T05:40:29.794 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.789+0000 7fa6c1324700 1 -- 172.21.2.105:0/865488921 shutdown_connections 2021-11-12T05:40:29.795 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.789+0000 7fa6c1324700 1 --2- 172.21.2.105:0/865488921 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa6a00534f0 0x7fa6a00559b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:29.795 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.789+0000 7fa6c1324700 1 --2- 172.21.2.105:0/865488921 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa6bc0aec30 0x7fa6bc0af0b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:29.795 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.789+0000 7fa6c1324700 1 --2- 172.21.2.105:0/865488921 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa6bc0b5660 0x7fa6bc0b5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:29.795 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.789+0000 7fa6c1324700 1 --2- 172.21.2.105:0/865488921 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa69c004f90 0x7fa6bc1404c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:29.796 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.789+0000 7fa6c1324700 1 -- 172.21.2.105:0/865488921 >> 172.21.2.105:0/865488921 conn(0x7fa6bc05c4c0 msgr2=0x7fa6bc11cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:29.796 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.789+0000 7fa6c1324700 1 -- 172.21.2.105:0/865488921 shutdown_connections 2021-11-12T05:40:29.796 INFO:teuthology.misc.health.gibba005.stderr:2021-11-12T05:40:29.789+0000 7fa6c1324700 1 -- 172.21.2.105:0/865488921 wait complete. 2021-11-12T05:40:29.798 DEBUG:teuthology.misc:8 of 8 OSDs are up 2021-11-12T05:40:29.799 INFO:tasks.ceph:Creating RBD pool 2021-11-12T05:40:29.799 DEBUG:teuthology.orchestra.run.gibba005:> sudo ceph --cluster ceph osd pool create rbd 8 2021-11-12T05:40:29.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.845+0000 7fb4888d3700 1 Processor -- start 2021-11-12T05:40:29.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.845+0000 7fb4888d3700 1 -- start start 2021-11-12T05:40:29.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb4888d3700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fb4840aca40 0x7fb4840ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:29.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb4888d3700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb484144180 0x7fb484144610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:29.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb4888d3700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4840b1840 con 0x7fb4840b0520 2021-11-12T05:40:29.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb4888d3700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4840b09d0 con 0x7fb4840aca40 2021-11-12T05:40:29.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb4888d3700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4840af2b0 con 0x7fb484144180 2021-11-12T05:40:29.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb481d9b700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fb4840b0520 0x7fb4841473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:52808/0 (socket says 172.21.2.105:52808) 2021-11-12T05:40:29.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb481d9b700 1 -- 172.21.2.105:0/126113665 learned_addr learned my addr 172.21.2.105:0/126113665 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:29.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb48159a700 1 -- 172.21.2.105:0/126113665 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2528832945 0 0) 0x7fb4840b1840 con 0x7fb4840b0520 2021-11-12T05:40:29.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb48159a700 1 -- 172.21.2.105:0/126113665 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb464003260 con 0x7fb4840b0520 2021-11-12T05:40:29.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb48159a700 1 -- 172.21.2.105:0/126113665 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 732508424 0 0) 0x7fb464003260 con 0x7fb4840b0520 2021-11-12T05:40:29.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb48159a700 1 -- 172.21.2.105:0/126113665 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb484144180 msgr2=0x7fb484144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:29.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb48159a700 1 --2- 172.21.2.105:0/126113665 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb484144180 0x7fb484144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:29.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb48159a700 1 -- 172.21.2.105:0/126113665 >> v2:172.21.2.115:3300/0 conn(0x7fb4840aca40 msgr2=0x7fb4840ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:29.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb48159a700 1 --2- 172.21.2.105:0/126113665 >> v2:172.21.2.115:3300/0 conn(0x7fb4840aca40 0x7fb4840ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:29.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb48159a700 1 -- 172.21.2.105:0/126113665 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4840b1a70 con 0x7fb4840b0520 2021-11-12T05:40:29.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb48159a700 1 -- 172.21.2.105:0/126113665 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fb46c001660 con 0x7fb4840b0520 2021-11-12T05:40:29.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb48159a700 1 -- 172.21.2.105:0/126113665 >> v1:172.21.2.105:6789/0 conn(0x7fb4840b0520 legacy=0x7fb4841473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:29.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb48159a700 1 --2- 172.21.2.105:0/126113665 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb484144180 0x7fb4640037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:29.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb48159a700 1 --2- 172.21.2.105:0/126113665 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb464003ee0 0x7fb464004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:29.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb48159a700 1 --2- 172.21.2.105:0/126113665 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb464004bf0 0x7fb46400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:29.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb48159a700 1 -- 172.21.2.105:0/126113665 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4840b09d0 con 0x7fb464004bf0 2021-11-12T05:40:29.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb48159a700 1 -- 172.21.2.105:0/126113665 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4840af2b0 con 0x7fb464003ee0 2021-11-12T05:40:29.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb48159a700 1 -- 172.21.2.105:0/126113665 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4640053a0 con 0x7fb484144180 2021-11-12T05:40:29.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb482d9d700 1 --2- 172.21.2.105:0/126113665 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb464004bf0 0x7fb46400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:29.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb482d9d700 1 -- 172.21.2.105:0/126113665 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb484144180 msgr2=0x7fb4640037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:29.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb482d9d700 1 --2- 172.21.2.105:0/126113665 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb484144180 0x7fb4640037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:29.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb482d9d700 1 -- 172.21.2.105:0/126113665 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb464003ee0 msgr2=0x7fb464004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:29.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb482d9d700 1 --2- 172.21.2.105:0/126113665 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb464003ee0 0x7fb464004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:29.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb482d9d700 1 -- 172.21.2.105:0/126113665 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb464003260 con 0x7fb464004bf0 2021-11-12T05:40:29.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb482d9d700 1 --2- 172.21.2.105:0/126113665 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb464004bf0 0x7fb46400b750 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fb47c0032f0 tx=0x7fb47c006f90).ready entity=mon.0 client_cookie=6e0dd6b0e4de5b4c server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:29.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb48159a700 1 -- 172.21.2.105:0/126113665 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb47c00b460 con 0x7fb464004bf0 2021-11-12T05:40:29.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb48159a700 1 -- 172.21.2.105:0/126113665 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47c00b5c0 con 0x7fb464004bf0 2021-11-12T05:40:29.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb48159a700 1 -- 172.21.2.105:0/126113665 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb47c00b730 con 0x7fb464004bf0 2021-11-12T05:40:29.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb4888d3700 1 -- 172.21.2.105:0/126113665 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb464004bf0 msgr2=0x7fb46400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:29.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb4888d3700 1 --2- 172.21.2.105:0/126113665 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb464004bf0 0x7fb46400b750 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fb47c0032f0 tx=0x7fb47c006f90).stop 2021-11-12T05:40:29.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb482d9d700 1 -- 172.21.2.105:0/126113665 reap_dead start 2021-11-12T05:40:29.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb4888d3700 1 -- 172.21.2.105:0/126113665 shutdown_connections 2021-11-12T05:40:29.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb4888d3700 1 -- 172.21.2.105:0/126113665 >> 172.21.2.105:0/126113665 conn(0x7fb48405c490 msgr2=0x7fb4840b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:29.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb4888d3700 1 -- 172.21.2.105:0/126113665 shutdown_connections 2021-11-12T05:40:29.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb4888d3700 1 -- 172.21.2.105:0/126113665 wait complete. 2021-11-12T05:40:29.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb4888d3700 1 Processor -- start 2021-11-12T05:40:29.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb4888d3700 1 -- start start 2021-11-12T05:40:29.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb4888d3700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb464004bf0 0x7fb4841575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:29.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb4888d3700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb4840aa870 0x7fb484062490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:29.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb4888d3700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb484062980 0x7fb4840a8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:29.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb4888d3700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb484142890 con 0x7fb4840aa870 2021-11-12T05:40:29.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb4888d3700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb484156c00 con 0x7fb464004bf0 2021-11-12T05:40:29.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb4888d3700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb484156ea0 con 0x7fb484062980 2021-11-12T05:40:29.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb481d9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb4840aa870 0x7fb484062490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:29.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb481d9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb4840aa870 0x7fb484062490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42424/0 (socket says 172.21.2.105:42424) 2021-11-12T05:40:29.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb481d9b700 1 -- 172.21.2.105:0/3943723376 learned_addr learned my addr 172.21.2.105:0/3943723376 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:29.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb481d9b700 1 -- 172.21.2.105:0/3943723376 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb484062980 msgr2=0x7fb4840a8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:29.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb481d9b700 1 --2- 172.21.2.105:0/3943723376 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb484062980 0x7fb4840a8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:29.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb481d9b700 1 -- 172.21.2.105:0/3943723376 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb464004bf0 msgr2=0x7fb4841575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:29.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb481d9b700 1 --2- 172.21.2.105:0/3943723376 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb464004bf0 0x7fb4841575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:29.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.849+0000 7fb481d9b700 1 -- 172.21.2.105:0/3943723376 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb484157140 con 0x7fb4840aa870 2021-11-12T05:40:29.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.853+0000 7fb481d9b700 1 --2- 172.21.2.105:0/3943723376 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb4840aa870 0x7fb484062490 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fb46c001370 tx=0x7fb46c001a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:29.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.853+0000 7fb47b7fe700 1 -- 172.21.2.105:0/3943723376 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb46c007170 con 0x7fb4840aa870 2021-11-12T05:40:29.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.853+0000 7fb47b7fe700 1 -- 172.21.2.105:0/3943723376 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46c0072d0 con 0x7fb4840aa870 2021-11-12T05:40:29.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.853+0000 7fb47b7fe700 1 -- 172.21.2.105:0/3943723376 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb46c004920 con 0x7fb4840aa870 2021-11-12T05:40:29.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.853+0000 7fb4888d3700 1 -- 172.21.2.105:0/3943723376 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4840abde0 con 0x7fb4840aa870 2021-11-12T05:40:29.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.853+0000 7fb4888d3700 1 -- 172.21.2.105:0/3943723376 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4840a93e0 con 0x7fb4840aa870 2021-11-12T05:40:29.873 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.853+0000 7fb4888d3700 1 -- 172.21.2.105:0/3943723376 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb484057350 con 0x7fb4840aa870 2021-11-12T05:40:29.873 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.853+0000 7fb47b7fe700 1 -- 172.21.2.105:0/3943723376 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb46c004a80 con 0x7fb4840aa870 2021-11-12T05:40:29.873 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.853+0000 7fb47b7fe700 1 --2- 172.21.2.105:0/3943723376 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb468053640 0x7fb468055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:29.873 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.853+0000 7fb47b7fe700 1 -- 172.21.2.105:0/3943723376 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4896+0+0 (secure 0 0 0) 0x7fb46c06b110 con 0x7fb4840aa870 2021-11-12T05:40:29.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.853+0000 7fb48259c700 1 --2- 172.21.2.105:0/3943723376 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb468053640 0x7fb468055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:29.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.853+0000 7fb48259c700 1 --2- 172.21.2.105:0/3943723376 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb468053640 0x7fb468055b00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fb474002f70 tx=0x7fb474006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:29.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.853+0000 7fb47b7fe700 1 -- 172.21.2.105:0/3943723376 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb46c0426b0 con 0x7fb4840aa870 2021-11-12T05:40:29.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:29.941+0000 7fb4888d3700 1 -- 172.21.2.105:0/3943723376 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fb48405f280 con 0x7fb4840aa870 2021-11-12T05:40:30.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:30.945+0000 7fb47b7fe700 1 -- 172.21.2.105:0/3943723376 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7fb46c045cd0 con 0x7fb4840aa870 2021-11-12T05:40:30.951 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:30.945+0000 7fb4888d3700 1 -- 172.21.2.105:0/3943723376 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb468053640 msgr2=0x7fb468055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:30.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:30.945+0000 7fb4888d3700 1 --2- 172.21.2.105:0/3943723376 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb468053640 0x7fb468055b00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fb474002f70 tx=0x7fb474006a80).stop 2021-11-12T05:40:30.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:30.945+0000 7fb4888d3700 1 -- 172.21.2.105:0/3943723376 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb4840aa870 msgr2=0x7fb484062490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:30.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:30.945+0000 7fb4888d3700 1 --2- 172.21.2.105:0/3943723376 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb4840aa870 0x7fb484062490 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fb46c001370 tx=0x7fb46c001a60).stop 2021-11-12T05:40:30.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:30.945+0000 7fb4888d3700 1 -- 172.21.2.105:0/3943723376 shutdown_connections 2021-11-12T05:40:30.953 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:30.945+0000 7fb4888d3700 1 --2- 172.21.2.105:0/3943723376 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb468053640 0x7fb468055b00 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:30.953 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:30.945+0000 7fb4888d3700 1 --2- 172.21.2.105:0/3943723376 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb484062980 0x7fb4840a8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:30.953 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:30.945+0000 7fb4888d3700 1 --2- 172.21.2.105:0/3943723376 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb4840aa870 0x7fb484062490 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:30.953 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:30.945+0000 7fb4888d3700 1 --2- 172.21.2.105:0/3943723376 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb464004bf0 0x7fb4841575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:30.954 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:30.945+0000 7fb4888d3700 1 -- 172.21.2.105:0/3943723376 >> 172.21.2.105:0/3943723376 conn(0x7fb48405c490 msgr2=0x7fb484148890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:30.954 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:30.945+0000 7fb4888d3700 1 -- 172.21.2.105:0/3943723376 shutdown_connections 2021-11-12T05:40:30.954 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:30.945+0000 7fb4888d3700 1 -- 172.21.2.105:0/3943723376 wait complete. 2021-11-12T05:40:30.954 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'rbd' created 2021-11-12T05:40:30.957 DEBUG:teuthology.orchestra.run.gibba005:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2021-11-12T05:40:31.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.005+0000 7f98d2f65700 1 Processor -- start 2021-11-12T05:40:31.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.005+0000 7f98d2f65700 1 -- start start 2021-11-12T05:40:31.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.005+0000 7f98d2f65700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f98cc0ade80 0x7f98cc0601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:31.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.005+0000 7f98d2f65700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f98cc13a9c0 0x7f98cc13ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:31.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.005+0000 7f98d2f65700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98cc066150 con 0x7f98cc05fdc0 2021-11-12T05:40:31.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.005+0000 7f98d2f65700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98cc141fb0 con 0x7f98cc0ade80 2021-11-12T05:40:31.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.005+0000 7f98d2f65700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98cc0663f0 con 0x7f98cc13a9c0 2021-11-12T05:40:31.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.005+0000 7f98cbfff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f98cc0ade80 0x7f98cc0601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:31.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.005+0000 7f98cbfff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f98cc0ade80 0x7f98cc0601a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42432/0 (socket says 172.21.2.105:42432) 2021-11-12T05:40:31.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.005+0000 7f98cbfff700 1 -- 172.21.2.105:0/2053624275 learned_addr learned my addr 172.21.2.105:0/2053624275 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:31.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.005+0000 7f98cbfff700 1 -- 172.21.2.105:0/2053624275 >> v2:172.21.2.115:3300/0 conn(0x7f98cc13a9c0 msgr2=0x7f98cc13ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:31.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.005+0000 7f98cbfff700 1 --2- 172.21.2.105:0/2053624275 >> v2:172.21.2.115:3300/0 conn(0x7f98cc13a9c0 0x7f98cc13ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:31.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.005+0000 7f98cbfff700 1 -- 172.21.2.105:0/2053624275 >> v1:172.21.2.115:6789/0 conn(0x7f98cc05fdc0 legacy=0x7f98cc066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:31.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.005+0000 7f98cbfff700 1 -- 172.21.2.105:0/2053624275 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98cc140fd0 con 0x7f98cc0ade80 2021-11-12T05:40:31.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.009+0000 7f98cbfff700 1 --2- 172.21.2.105:0/2053624275 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98cc0ade80 0x7f98cc0601a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f98cc060e00 tx=0x7f98c0006eb0).ready entity=mon.0 client_cookie=67b8b0ff7df79afe server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:31.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.009+0000 7f98cb7fe700 1 -- 172.21.2.105:0/2053624275 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98c000d5c0 con 0x7f98cc0ade80 2021-11-12T05:40:31.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.009+0000 7f98cb7fe700 1 -- 172.21.2.105:0/2053624275 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c0000e90 con 0x7f98cc0ade80 2021-11-12T05:40:31.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.009+0000 7f98cb7fe700 1 -- 172.21.2.105:0/2053624275 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98c000d910 con 0x7f98cc0ade80 2021-11-12T05:40:31.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.009+0000 7f98d2f65700 1 -- 172.21.2.105:0/2053624275 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98cc0ade80 msgr2=0x7f98cc0601a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:31.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.009+0000 7f98d2f65700 1 --2- 172.21.2.105:0/2053624275 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98cc0ade80 0x7f98cc0601a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f98cc060e00 tx=0x7f98c0006eb0).stop 2021-11-12T05:40:31.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.009+0000 7f98d2f65700 1 -- 172.21.2.105:0/2053624275 shutdown_connections 2021-11-12T05:40:31.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.009+0000 7f98d2f65700 1 --2- 172.21.2.105:0/2053624275 >> v2:172.21.2.115:3300/0 conn(0x7f98cc13a9c0 0x7f98cc13ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:31.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.009+0000 7f98d2f65700 1 --2- 172.21.2.105:0/2053624275 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98cc0ade80 0x7f98cc0601a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:31.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.009+0000 7f98d2f65700 1 -- 172.21.2.105:0/2053624275 >> 172.21.2.105:0/2053624275 conn(0x7f98cc0608d0 msgr2=0x7f98cc05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:31.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.009+0000 7f98d2f65700 1 -- 172.21.2.105:0/2053624275 shutdown_connections 2021-11-12T05:40:31.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.009+0000 7f98d2f65700 1 -- 172.21.2.105:0/2053624275 wait complete. 2021-11-12T05:40:31.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.009+0000 7f98d2f65700 1 Processor -- start 2021-11-12T05:40:31.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.009+0000 7f98d2f65700 1 -- start start 2021-11-12T05:40:31.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.009+0000 7f98d2f65700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98cc05fdc0 0x7f98cc0b7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:31.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.009+0000 7f98d2f65700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f98cc0ade80 0x7f98cc0b7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:31.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.009+0000 7f98d2f65700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f98cc13a9c0 0x7f98cc159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:31.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.009+0000 7f98d2f65700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc143040 con 0x7f98cc05fdc0 2021-11-12T05:40:31.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.009+0000 7f98d2f65700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc1432e0 con 0x7f98cc0ade80 2021-11-12T05:40:31.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.009+0000 7f98d2f65700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98cc143580 con 0x7f98cc13a9c0 2021-11-12T05:40:31.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.009+0000 7f98d0d01700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98cc05fdc0 0x7f98cc0b7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:31.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.009+0000 7f98d0d01700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98cc05fdc0 0x7f98cc0b7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42436/0 (socket says 172.21.2.105:42436) 2021-11-12T05:40:31.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.009+0000 7f98d0d01700 1 -- 172.21.2.105:0/3151874372 learned_addr learned my addr 172.21.2.105:0/3151874372 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:31.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.009+0000 7f98d0d01700 1 -- 172.21.2.105:0/3151874372 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f98cc13a9c0 msgr2=0x7f98cc159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:31.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.009+0000 7f98d0d01700 1 --2- 172.21.2.105:0/3151874372 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f98cc13a9c0 0x7f98cc159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:31.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.009+0000 7f98d0d01700 1 -- 172.21.2.105:0/3151874372 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f98cc0ade80 msgr2=0x7f98cc0b7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:31.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.009+0000 7f98d0d01700 1 --2- 172.21.2.105:0/3151874372 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f98cc0ade80 0x7f98cc0b7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:31.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.009+0000 7f98d0d01700 1 -- 172.21.2.105:0/3151874372 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c000b1e0 con 0x7f98cc05fdc0 2021-11-12T05:40:31.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.009+0000 7f98d0d01700 1 --2- 172.21.2.105:0/3151874372 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98cc05fdc0 0x7f98cc0b7d60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f98bc002f90 tx=0x7f98bc006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:31.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.009+0000 7f98c9ffb700 1 -- 172.21.2.105:0/3151874372 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98bc013460 con 0x7f98cc05fdc0 2021-11-12T05:40:31.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.009+0000 7f98c9ffb700 1 -- 172.21.2.105:0/3151874372 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98bc0135c0 con 0x7f98cc05fdc0 2021-11-12T05:40:31.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.009+0000 7f98d2f65700 1 -- 172.21.2.105:0/3151874372 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98cc13e1c0 con 0x7f98cc05fdc0 2021-11-12T05:40:31.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.009+0000 7f98d2f65700 1 -- 172.21.2.105:0/3151874372 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98cc15a3b0 con 0x7f98cc05fdc0 2021-11-12T05:40:31.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.009+0000 7f98c9ffb700 1 -- 172.21.2.105:0/3151874372 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98bc013920 con 0x7f98cc05fdc0 2021-11-12T05:40:31.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.009+0000 7f98d2f65700 1 -- 172.21.2.105:0/3151874372 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98cc143740 con 0x7f98cc05fdc0 2021-11-12T05:40:31.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.009+0000 7f98c9ffb700 1 -- 172.21.2.105:0/3151874372 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f98bc01a060 con 0x7f98cc05fdc0 2021-11-12T05:40:31.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.009+0000 7f98c9ffb700 1 --2- 172.21.2.105:0/3151874372 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f98ac0535d0 0x7f98ac055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:31.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.013+0000 7f98c9ffb700 1 -- 172.21.2.105:0/3151874372 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5238+0+0 (secure 0 0 0) 0x7f98bc06af00 con 0x7f98cc05fdc0 2021-11-12T05:40:31.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.013+0000 7f98cbfff700 1 --2- 172.21.2.105:0/3151874372 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f98ac0535d0 0x7f98ac055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:31.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.013+0000 7f98cbfff700 1 --2- 172.21.2.105:0/3151874372 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f98ac0535d0 0x7f98ac055a90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f98cc060e00 tx=0x7f98c0015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:31.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.013+0000 7f98c9ffb700 1 -- 172.21.2.105:0/3151874372 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f98bc0423a0 con 0x7f98cc05fdc0 2021-11-12T05:40:31.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.097+0000 7f98d2f65700 1 -- 172.21.2.105:0/3151874372 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f98cc057350 con 0x7f98cc05fdc0 2021-11-12T05:40:31.954 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.949+0000 7f98c9ffb700 1 -- 172.21.2.105:0/3151874372 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7f98bc018020 con 0x7f98cc05fdc0 2021-11-12T05:40:31.957 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.953+0000 7f98d2f65700 1 -- 172.21.2.105:0/3151874372 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f98ac0535d0 msgr2=0x7f98ac055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:31.957 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.953+0000 7f98d2f65700 1 --2- 172.21.2.105:0/3151874372 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f98ac0535d0 0x7f98ac055a90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f98cc060e00 tx=0x7f98c0015000).stop 2021-11-12T05:40:31.957 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.953+0000 7f98d2f65700 1 -- 172.21.2.105:0/3151874372 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98cc05fdc0 msgr2=0x7f98cc0b7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:31.957 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.953+0000 7f98d2f65700 1 --2- 172.21.2.105:0/3151874372 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98cc05fdc0 0x7f98cc0b7d60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f98bc002f90 tx=0x7f98bc006df0).stop 2021-11-12T05:40:31.958 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.953+0000 7f98d2f65700 1 -- 172.21.2.105:0/3151874372 shutdown_connections 2021-11-12T05:40:31.958 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.953+0000 7f98d2f65700 1 --2- 172.21.2.105:0/3151874372 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f98ac0535d0 0x7f98ac055a90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:31.958 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.953+0000 7f98d2f65700 1 --2- 172.21.2.105:0/3151874372 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f98cc13a9c0 0x7f98cc159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:31.958 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.953+0000 7f98d2f65700 1 --2- 172.21.2.105:0/3151874372 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f98cc0ade80 0x7f98cc0b7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:31.959 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.953+0000 7f98d2f65700 1 --2- 172.21.2.105:0/3151874372 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98cc05fdc0 0x7f98cc0b7d60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:31.959 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.953+0000 7f98d2f65700 1 -- 172.21.2.105:0/3151874372 >> 172.21.2.105:0/3151874372 conn(0x7f98cc0608d0 msgr2=0x7f98cc146c30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:31.959 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.953+0000 7f98d2f65700 1 -- 172.21.2.105:0/3151874372 shutdown_connections 2021-11-12T05:40:31.959 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:31.953+0000 7f98d2f65700 1 -- 172.21.2.105:0/3151874372 wait complete. 2021-11-12T05:40:31.959 INFO:teuthology.orchestra.run.gibba005.stderr:enabled application 'rbd' on pool 'rbd' 2021-11-12T05:40:31.963 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2021-11-12T05:40:31.964 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-12T05:40:31.964 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-12T05:40:31.966 INFO:tasks.ceph.mds.a:Started 2021-11-12T05:40:31.966 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-12T05:40:31.967 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-12T05:40:31.968 INFO:tasks.ceph.mds.b:Started 2021-11-12T05:40:31.969 INFO:tasks.ceph:Setting up CephFS filesystem... 2021-11-12T05:40:31.969 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:40:31.998 INFO:tasks.ceph.mds.a.gibba005.stdout:starting mds.a at 2021-11-12T05:40:32.009 INFO:tasks.ceph.mds.b.gibba015.stdout:starting mds.b at 2021-11-12T05:40:32.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.017+0000 7f9c35835700 1 Processor -- start 2021-11-12T05:40:32.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.017+0000 7f9c35835700 1 -- start start 2021-11-12T05:40:32.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.017+0000 7f9c35835700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f9c30062010 0x7f9c300b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:32.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.017+0000 7f9c35835700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f9c300b4d50 0x7f9c300b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:32.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.017+0000 7f9c35835700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c300b2110 con 0x7f9c300b3100 2021-11-12T05:40:32.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.017+0000 7f9c35835700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c300b2370 con 0x7f9c300b4d50 2021-11-12T05:40:32.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.017+0000 7f9c35835700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c300b2610 con 0x7f9c30062010 2021-11-12T05:40:32.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.017+0000 7f9c2f7fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f9c300b4d50 0x7f9c300b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:32.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.017+0000 7f9c2f7fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f9c300b4d50 0x7f9c300b2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42458/0 (socket says 172.21.2.105:42458) 2021-11-12T05:40:32.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.017+0000 7f9c2f7fe700 1 -- 172.21.2.105:0/829481484 learned_addr learned my addr 172.21.2.105:0/829481484 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:32.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.017+0000 7f9c2effd700 1 --2- 172.21.2.105:0/829481484 >> v2:172.21.2.115:3300/0 conn(0x7f9c30062010 0x7f9c300b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:32.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.017+0000 7f9c2f7fe700 1 -- 172.21.2.105:0/829481484 >> v2:172.21.2.115:3300/0 conn(0x7f9c30062010 msgr2=0x7f9c300b5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:32.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.017+0000 7f9c2f7fe700 1 --2- 172.21.2.105:0/829481484 >> v2:172.21.2.115:3300/0 conn(0x7f9c30062010 0x7f9c300b5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:32.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.017+0000 7f9c2f7fe700 1 -- 172.21.2.105:0/829481484 >> v1:172.21.2.105:6789/0 conn(0x7f9c300b3100 legacy=0x7f9c300b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:32.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.017+0000 7f9c2f7fe700 1 -- 172.21.2.105:0/829481484 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c300b4330 con 0x7f9c300b4d50 2021-11-12T05:40:32.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.017+0000 7f9c2f7fe700 1 --2- 172.21.2.105:0/829481484 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9c300b4d50 0x7f9c300b2ab0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f9c300b1fb0 tx=0x7f9c28009290).ready entity=mon.0 client_cookie=c79f3f60b17a10a5 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:32.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.017+0000 7f9c2dffb700 1 -- 172.21.2.105:0/829481484 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c2800b830 con 0x7f9c300b4d50 2021-11-12T05:40:32.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.017+0000 7f9c2dffb700 1 -- 172.21.2.105:0/829481484 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2800b990 con 0x7f9c300b4d50 2021-11-12T05:40:32.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.017+0000 7f9c2dffb700 1 -- 172.21.2.105:0/829481484 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c2800bb40 con 0x7f9c300b4d50 2021-11-12T05:40:32.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.017+0000 7f9c35835700 1 -- 172.21.2.105:0/829481484 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9c300b4d50 msgr2=0x7f9c300b2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:32.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.017+0000 7f9c35835700 1 --2- 172.21.2.105:0/829481484 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9c300b4d50 0x7f9c300b2ab0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f9c300b1fb0 tx=0x7f9c28009290).stop 2021-11-12T05:40:32.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.017+0000 7f9c35835700 1 -- 172.21.2.105:0/829481484 shutdown_connections 2021-11-12T05:40:32.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.017+0000 7f9c35835700 1 --2- 172.21.2.105:0/829481484 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9c300b4d50 0x7f9c300b2ab0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:32.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.017+0000 7f9c35835700 1 --2- 172.21.2.105:0/829481484 >> v2:172.21.2.115:3300/0 conn(0x7f9c30062010 0x7f9c300b5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:32.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.017+0000 7f9c35835700 1 -- 172.21.2.105:0/829481484 >> 172.21.2.105:0/829481484 conn(0x7f9c300b9790 msgr2=0x7f9c300b9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:32.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.017+0000 7f9c35835700 1 -- 172.21.2.105:0/829481484 shutdown_connections 2021-11-12T05:40:32.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.017+0000 7f9c35835700 1 -- 172.21.2.105:0/829481484 wait complete. 2021-11-12T05:40:32.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.021+0000 7f9c35835700 1 Processor -- start 2021-11-12T05:40:32.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.021+0000 7f9c35835700 1 -- start start 2021-11-12T05:40:32.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.021+0000 7f9c35835700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9c30062010 0x7f9c30113390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:32.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.021+0000 7f9c35835700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9c300b3100 0x7f9c300b8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:32.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.021+0000 7f9c35835700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9c300b4d50 0x7f9c30152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:32.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.021+0000 7f9c35835700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c301401b0 con 0x7f9c300b4d50 2021-11-12T05:40:32.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.021+0000 7f9c35835700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c300b8330 con 0x7f9c300b3100 2021-11-12T05:40:32.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.021+0000 7f9c35835700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c300af9d0 con 0x7f9c30062010 2021-11-12T05:40:32.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.021+0000 7f9c2f7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9c300b4d50 0x7f9c30152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:32.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.021+0000 7f9c2f7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9c300b4d50 0x7f9c30152c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42460/0 (socket says 172.21.2.105:42460) 2021-11-12T05:40:32.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.021+0000 7f9c2f7fe700 1 -- 172.21.2.105:0/846451702 learned_addr learned my addr 172.21.2.105:0/846451702 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:32.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.021+0000 7f9c2effd700 1 --2- 172.21.2.105:0/846451702 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9c30062010 0x7f9c30113390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:32.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.021+0000 7f9c2e7fc700 1 --2- 172.21.2.105:0/846451702 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9c300b3100 0x7f9c300b8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:32.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.021+0000 7f9c2f7fe700 1 -- 172.21.2.105:0/846451702 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9c30062010 msgr2=0x7f9c30113390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:32.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.021+0000 7f9c2f7fe700 1 --2- 172.21.2.105:0/846451702 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9c30062010 0x7f9c30113390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:32.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.021+0000 7f9c2f7fe700 1 -- 172.21.2.105:0/846451702 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9c300b3100 msgr2=0x7f9c300b8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:32.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.021+0000 7f9c2f7fe700 1 --2- 172.21.2.105:0/846451702 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9c300b3100 0x7f9c300b8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:32.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.021+0000 7f9c2f7fe700 1 -- 172.21.2.105:0/846451702 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c28009530 con 0x7f9c300b4d50 2021-11-12T05:40:32.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.021+0000 7f9c2f7fe700 1 --2- 172.21.2.105:0/846451702 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9c300b4d50 0x7f9c30152c10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f9c300b1fb0 tx=0x7f9c28016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:32.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.021+0000 7f9c1ffff700 1 -- 172.21.2.105:0/846451702 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c2800b830 con 0x7f9c300b4d50 2021-11-12T05:40:32.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.021+0000 7f9c1ffff700 1 -- 172.21.2.105:0/846451702 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c28021630 con 0x7f9c300b4d50 2021-11-12T05:40:32.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.021+0000 7f9c1ffff700 1 -- 172.21.2.105:0/846451702 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c28021990 con 0x7f9c300b4d50 2021-11-12T05:40:32.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.021+0000 7f9c35835700 1 -- 172.21.2.105:0/846451702 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c300afc70 con 0x7f9c300b4d50 2021-11-12T05:40:32.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.021+0000 7f9c35835700 1 -- 172.21.2.105:0/846451702 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c300b8f70 con 0x7f9c300b4d50 2021-11-12T05:40:32.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.021+0000 7f9c35835700 1 -- 172.21.2.105:0/846451702 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c300afe00 con 0x7f9c300b4d50 2021-11-12T05:40:32.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.021+0000 7f9c1ffff700 1 -- 172.21.2.105:0/846451702 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9c28027020 con 0x7f9c300b4d50 2021-11-12T05:40:32.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.021+0000 7f9c1ffff700 1 --2- 172.21.2.105:0/846451702 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9c0c053660 0x7f9c0c055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:32.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.021+0000 7f9c1ffff700 1 -- 172.21.2.105:0/846451702 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f9c2806c950 con 0x7f9c300b4d50 2021-11-12T05:40:32.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.021+0000 7f9c2effd700 1 --2- 172.21.2.105:0/846451702 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9c0c053660 0x7f9c0c055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:32.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.021+0000 7f9c2effd700 1 --2- 172.21.2.105:0/846451702 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9c0c053660 0x7f9c0c055b20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f9c2000c000 tx=0x7f9c20008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:32.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.025+0000 7f9c1ffff700 1 -- 172.21.2.105:0/846451702 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9c28043e90 con 0x7f9c300b4d50 2021-11-12T05:40:32.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.109+0000 7f9c35835700 1 -- 172.21.2.105:0/846451702 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c300623f0 con 0x7f9c300b4d50 2021-11-12T05:40:32.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.109+0000 7f9c1ffff700 1 -- 172.21.2.105:0/846451702 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+13191 (secure 0 0 0) 0x7f9c28015070 con 0x7f9c300b4d50 2021-11-12T05:40:32.115 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:40:32.115 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":18,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:40:31.942448+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:40:32.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.113+0000 7f9c35835700 1 -- 172.21.2.105:0/846451702 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9c0c053660 msgr2=0x7f9c0c055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:32.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.113+0000 7f9c35835700 1 --2- 172.21.2.105:0/846451702 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9c0c053660 0x7f9c0c055b20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f9c2000c000 tx=0x7f9c20008040).stop 2021-11-12T05:40:32.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.113+0000 7f9c35835700 1 -- 172.21.2.105:0/846451702 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9c300b4d50 msgr2=0x7f9c30152c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:32.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.113+0000 7f9c35835700 1 --2- 172.21.2.105:0/846451702 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9c300b4d50 0x7f9c30152c10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f9c300b1fb0 tx=0x7f9c28016000).stop 2021-11-12T05:40:32.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.113+0000 7f9c35835700 1 -- 172.21.2.105:0/846451702 shutdown_connections 2021-11-12T05:40:32.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.113+0000 7f9c35835700 1 --2- 172.21.2.105:0/846451702 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9c0c053660 0x7f9c0c055b20 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:32.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.113+0000 7f9c35835700 1 --2- 172.21.2.105:0/846451702 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9c300b4d50 0x7f9c30152c10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:32.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.113+0000 7f9c35835700 1 --2- 172.21.2.105:0/846451702 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9c300b3100 0x7f9c300b8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:32.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.113+0000 7f9c35835700 1 --2- 172.21.2.105:0/846451702 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9c30062010 0x7f9c30113390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:32.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.113+0000 7f9c35835700 1 -- 172.21.2.105:0/846451702 >> 172.21.2.105:0/846451702 conn(0x7f9c300b9790 msgr2=0x7f9c300b5160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:32.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.113+0000 7f9c35835700 1 -- 172.21.2.105:0/846451702 shutdown_connections 2021-11-12T05:40:32.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.113+0000 7f9c35835700 1 -- 172.21.2.105:0/846451702 wait complete. 2021-11-12T05:40:32.122 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-12T05:40:32.123 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:40:32.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.221+0000 7fee27c80700 1 Processor -- start 2021-11-12T05:40:32.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.221+0000 7fee27c80700 1 -- start start 2021-11-12T05:40:32.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.225+0000 7fee27c80700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fee200b30a0 0x7fee20140240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:32.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.225+0000 7fee27c80700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee200aa0b0 con 0x7fee200b2cc0 2021-11-12T05:40:32.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.225+0000 7fee27c80700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee200a9b70 con 0x7fee200b2290 2021-11-12T05:40:32.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.225+0000 7fee27c80700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee200a9e10 con 0x7fee200b30a0 2021-11-12T05:40:32.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.225+0000 7fee25a1c700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fee200b2cc0 0x7fee20143690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:52866/0 (socket says 172.21.2.105:52866) 2021-11-12T05:40:32.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.225+0000 7fee25a1c700 1 -- 172.21.2.105:0/1052064177 learned_addr learned my addr 172.21.2.105:0/1052064177 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:32.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.225+0000 7fee2621d700 1 --2- 172.21.2.105:0/1052064177 >> v2:172.21.2.105:3300/0 conn(0x7fee200b30a0 0x7fee20140240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:32.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.225+0000 7fee2621d700 1 -- 172.21.2.105:0/1052064177 >> v1:172.21.2.115:6789/0 conn(0x7fee200b2290 legacy=0x7fee20143da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:32.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.225+0000 7fee2621d700 1 -- 172.21.2.105:0/1052064177 >> v1:172.21.2.105:6789/0 conn(0x7fee200b2cc0 legacy=0x7fee20143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:32.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.225+0000 7fee2621d700 1 -- 172.21.2.105:0/1052064177 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee200b0800 con 0x7fee200b30a0 2021-11-12T05:40:32.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.225+0000 7fee2621d700 1 --2- 172.21.2.105:0/1052064177 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee200b30a0 0x7fee20140240 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fee200afc20 tx=0x7fee180091d0).ready entity=mon.0 client_cookie=5ffa439c4ef209c9 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:32.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.225+0000 7fee24a1a700 1 -- 172.21.2.105:0/1052064177 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee1800ba10 con 0x7fee200b30a0 2021-11-12T05:40:32.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.225+0000 7fee24a1a700 1 -- 172.21.2.105:0/1052064177 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1800bb70 con 0x7fee200b30a0 2021-11-12T05:40:32.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.225+0000 7fee24a1a700 1 -- 172.21.2.105:0/1052064177 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee18010470 con 0x7fee200b30a0 2021-11-12T05:40:32.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.225+0000 7fee27c80700 1 -- 172.21.2.105:0/1052064177 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee200b30a0 msgr2=0x7fee20140240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:32.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.225+0000 7fee27c80700 1 --2- 172.21.2.105:0/1052064177 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee200b30a0 0x7fee20140240 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fee200afc20 tx=0x7fee180091d0).stop 2021-11-12T05:40:32.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.225+0000 7fee27c80700 1 -- 172.21.2.105:0/1052064177 shutdown_connections 2021-11-12T05:40:32.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.225+0000 7fee27c80700 1 --2- 172.21.2.105:0/1052064177 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee200b30a0 0x7fee20140240 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:32.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.225+0000 7fee27c80700 1 -- 172.21.2.105:0/1052064177 >> 172.21.2.105:0/1052064177 conn(0x7fee2005c490 msgr2=0x7fee2005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:32.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.225+0000 7fee27c80700 1 -- 172.21.2.105:0/1052064177 shutdown_connections 2021-11-12T05:40:32.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.225+0000 7fee27c80700 1 -- 172.21.2.105:0/1052064177 wait complete. 2021-11-12T05:40:32.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.225+0000 7fee27c80700 1 Processor -- start 2021-11-12T05:40:32.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.225+0000 7fee27c80700 1 -- start start 2021-11-12T05:40:32.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.225+0000 7fee27c80700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee200b2290 0x7fee20064600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:32.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.225+0000 7fee27c80700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fee200b2cc0 0x7fee200aa350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:32.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.225+0000 7fee27c80700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fee200b30a0 0x7fee20063970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:32.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.225+0000 7fee27c80700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee20066f30 con 0x7fee200b2290 2021-11-12T05:40:32.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.225+0000 7fee27c80700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee200671d0 con 0x7fee200b30a0 2021-11-12T05:40:32.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.225+0000 7fee27c80700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee200acb10 con 0x7fee200b2cc0 2021-11-12T05:40:32.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.225+0000 7fee25a1c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee200b2290 0x7fee20064600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:32.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.225+0000 7fee25a1c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee200b2290 0x7fee20064600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42476/0 (socket says 172.21.2.105:42476) 2021-11-12T05:40:32.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.225+0000 7fee25a1c700 1 -- 172.21.2.105:0/1977245798 learned_addr learned my addr 172.21.2.105:0/1977245798 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:32.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.225+0000 7fee25a1c700 1 -- 172.21.2.105:0/1977245798 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fee200b2cc0 msgr2=0x7fee200aa350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:32.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.225+0000 7fee25a1c700 1 --2- 172.21.2.105:0/1977245798 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fee200b2cc0 0x7fee200aa350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:32.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.225+0000 7fee25a1c700 1 -- 172.21.2.105:0/1977245798 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fee200b30a0 msgr2=0x7fee20063970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:32.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.225+0000 7fee25a1c700 1 --2- 172.21.2.105:0/1977245798 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fee200b30a0 0x7fee20063970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:32.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.225+0000 7fee25a1c700 1 -- 172.21.2.105:0/1977245798 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee18009470 con 0x7fee200b2290 2021-11-12T05:40:32.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.229+0000 7fee25a1c700 1 --2- 172.21.2.105:0/1977245798 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee200b2290 0x7fee20064600 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fee2005d0d0 tx=0x7fee1c007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:32.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.229+0000 7fee12ffd700 1 -- 172.21.2.105:0/1977245798 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee1c00ce30 con 0x7fee200b2290 2021-11-12T05:40:32.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.229+0000 7fee12ffd700 1 -- 172.21.2.105:0/1977245798 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1c0072e0 con 0x7fee200b2290 2021-11-12T05:40:32.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.229+0000 7fee12ffd700 1 -- 172.21.2.105:0/1977245798 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee1c005800 con 0x7fee200b2290 2021-11-12T05:40:32.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.229+0000 7fee27c80700 1 -- 172.21.2.105:0/1977245798 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee200ad040 con 0x7fee200b2290 2021-11-12T05:40:32.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.229+0000 7fee27c80700 1 -- 172.21.2.105:0/1977245798 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee200aa9e0 con 0x7fee200b2290 2021-11-12T05:40:32.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.229+0000 7fee27c80700 1 -- 172.21.2.105:0/1977245798 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee200acd90 con 0x7fee200b2290 2021-11-12T05:40:32.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.229+0000 7fee12ffd700 1 -- 172.21.2.105:0/1977245798 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fee1c010070 con 0x7fee200b2290 2021-11-12T05:40:32.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.229+0000 7fee12ffd700 1 --2- 172.21.2.105:0/1977245798 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fee08053640 0x7fee08055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:32.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.229+0000 7fee12ffd700 1 -- 172.21.2.105:0/1977245798 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fee1c06ac20 con 0x7fee200b2290 2021-11-12T05:40:32.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.229+0000 7fee2521b700 1 --2- 172.21.2.105:0/1977245798 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fee08053640 0x7fee08055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:32.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.229+0000 7fee2521b700 1 --2- 172.21.2.105:0/1977245798 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fee08053640 0x7fee08055b00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fee14002f90 tx=0x7fee140069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:32.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.233+0000 7fee12ffd700 1 -- 172.21.2.105:0/1977245798 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fee1c0420b0 con 0x7fee200b2290 2021-11-12T05:40:32.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.313+0000 7fee27c80700 1 -- 172.21.2.105:0/1977245798 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fee200ad830 con 0x7fee200b2290 2021-11-12T05:40:32.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.313+0000 7fee12ffd700 1 -- 172.21.2.105:0/1977245798 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v18) v1 ==== 110+0+10 (secure 0 0 0) 0x7fee1c018030 con 0x7fee200b2290 2021-11-12T05:40:32.318 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:40:32.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.313+0000 7fee27c80700 1 -- 172.21.2.105:0/1977245798 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fee08053640 msgr2=0x7fee08055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:32.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.313+0000 7fee27c80700 1 --2- 172.21.2.105:0/1977245798 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fee08053640 0x7fee08055b00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fee14002f90 tx=0x7fee140069b0).stop 2021-11-12T05:40:32.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.313+0000 7fee27c80700 1 -- 172.21.2.105:0/1977245798 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee200b2290 msgr2=0x7fee20064600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:32.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.313+0000 7fee27c80700 1 --2- 172.21.2.105:0/1977245798 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee200b2290 0x7fee20064600 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fee2005d0d0 tx=0x7fee1c007c40).stop 2021-11-12T05:40:32.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.313+0000 7fee27c80700 1 -- 172.21.2.105:0/1977245798 shutdown_connections 2021-11-12T05:40:32.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.313+0000 7fee27c80700 1 --2- 172.21.2.105:0/1977245798 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fee08053640 0x7fee08055b00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:32.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.313+0000 7fee27c80700 1 --2- 172.21.2.105:0/1977245798 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fee200b30a0 0x7fee20063970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:32.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.313+0000 7fee27c80700 1 --2- 172.21.2.105:0/1977245798 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fee200b2cc0 0x7fee200aa350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:32.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.313+0000 7fee27c80700 1 --2- 172.21.2.105:0/1977245798 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee200b2290 0x7fee20064600 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:32.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.313+0000 7fee27c80700 1 -- 172.21.2.105:0/1977245798 >> 172.21.2.105:0/1977245798 conn(0x7fee2005c490 msgr2=0x7fee200b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:32.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.313+0000 7fee27c80700 1 -- 172.21.2.105:0/1977245798 shutdown_connections 2021-11-12T05:40:32.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.313+0000 7fee27c80700 1 -- 172.21.2.105:0/1977245798 wait complete. 2021-11-12T05:40:32.325 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:40:32.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.373+0000 7f718eaf6700 1 Processor -- start 2021-11-12T05:40:32.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.373+0000 7f718eaf6700 1 -- start start 2021-11-12T05:40:32.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.373+0000 7f718eaf6700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f71880b2290 0x7f71880b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:32.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.373+0000 7f718eaf6700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f7188143da0 0x7f7188140240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:32.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.373+0000 7f718eaf6700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71880aa0b0 con 0x7f71880b2cc0 2021-11-12T05:40:32.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.373+0000 7f718eaf6700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71880a9b70 con 0x7f7188143da0 2021-11-12T05:40:32.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.373+0000 7f718eaf6700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71880a9e10 con 0x7f71880b2290 2021-11-12T05:40:32.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.373+0000 7f718c892700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f71880b2cc0 0x7f7188143690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:52882/0 (socket says 172.21.2.105:52882) 2021-11-12T05:40:32.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.373+0000 7f718c892700 1 -- 172.21.2.105:0/68756630 learned_addr learned my addr 172.21.2.105:0/68756630 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:32.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.373+0000 7f718d093700 1 --2- 172.21.2.105:0/68756630 >> v2:172.21.2.105:3300/0 conn(0x7f7188143da0 0x7f7188140240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:32.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.373+0000 7f718d093700 1 -- 172.21.2.105:0/68756630 >> v2:172.21.2.115:3300/0 conn(0x7f71880b2290 msgr2=0x7f71880b30a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:40:32.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.373+0000 7f718d093700 1 --2- 172.21.2.105:0/68756630 >> v2:172.21.2.115:3300/0 conn(0x7f71880b2290 0x7f71880b30a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:32.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.373+0000 7f718d093700 1 -- 172.21.2.105:0/68756630 >> v1:172.21.2.105:6789/0 conn(0x7f71880b2cc0 legacy=0x7f7188143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:32.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.373+0000 7f718d093700 1 -- 172.21.2.105:0/68756630 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71880b0800 con 0x7f7188143da0 2021-11-12T05:40:32.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.373+0000 7f718d093700 1 --2- 172.21.2.105:0/68756630 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7188143da0 0x7f7188140240 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f71880afc20 tx=0x7f71800091d0).ready entity=mon.0 client_cookie=a57f3b64722e4f80 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:32.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.377+0000 7f71877fe700 1 -- 172.21.2.105:0/68756630 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7180009ea0 con 0x7f7188143da0 2021-11-12T05:40:32.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.377+0000 7f71877fe700 1 -- 172.21.2.105:0/68756630 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718000ba50 con 0x7f7188143da0 2021-11-12T05:40:32.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.377+0000 7f71877fe700 1 -- 172.21.2.105:0/68756630 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f718000bdf0 con 0x7f7188143da0 2021-11-12T05:40:32.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.377+0000 7f718eaf6700 1 -- 172.21.2.105:0/68756630 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7188143da0 msgr2=0x7f7188140240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:32.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.377+0000 7f718eaf6700 1 --2- 172.21.2.105:0/68756630 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7188143da0 0x7f7188140240 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f71880afc20 tx=0x7f71800091d0).stop 2021-11-12T05:40:32.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.377+0000 7f718eaf6700 1 -- 172.21.2.105:0/68756630 shutdown_connections 2021-11-12T05:40:32.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.377+0000 7f718eaf6700 1 --2- 172.21.2.105:0/68756630 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7188143da0 0x7f7188140240 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:32.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.377+0000 7f718eaf6700 1 --2- 172.21.2.105:0/68756630 >> v2:172.21.2.115:3300/0 conn(0x7f71880b2290 0x7f71880b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:32.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.377+0000 7f718eaf6700 1 -- 172.21.2.105:0/68756630 >> 172.21.2.105:0/68756630 conn(0x7f718805c490 msgr2=0x7f718805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:32.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.377+0000 7f718eaf6700 1 -- 172.21.2.105:0/68756630 shutdown_connections 2021-11-12T05:40:32.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.377+0000 7f718eaf6700 1 -- 172.21.2.105:0/68756630 wait complete. 2021-11-12T05:40:32.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.377+0000 7f718eaf6700 1 Processor -- start 2021-11-12T05:40:32.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.377+0000 7f718eaf6700 1 -- start start 2021-11-12T05:40:32.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.377+0000 7f718eaf6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71880b2290 0x7f7188066180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:32.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.377+0000 7f718eaf6700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f71880b2cc0 0x7f71880b0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:32.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.377+0000 7f718eaf6700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7188143da0 0x7f718815aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:32.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.377+0000 7f718eaf6700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7188066890 con 0x7f71880b2290 2021-11-12T05:40:32.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.377+0000 7f718eaf6700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71881400f0 con 0x7f7188143da0 2021-11-12T05:40:32.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.377+0000 7f718eaf6700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7188066ac0 con 0x7f71880b2cc0 2021-11-12T05:40:32.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.377+0000 7f718c892700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71880b2290 0x7f7188066180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:32.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.377+0000 7f718c892700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71880b2290 0x7f7188066180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42490/0 (socket says 172.21.2.105:42490) 2021-11-12T05:40:32.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.377+0000 7f718c892700 1 -- 172.21.2.105:0/1688283094 learned_addr learned my addr 172.21.2.105:0/1688283094 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:32.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.377+0000 7f718c892700 1 -- 172.21.2.105:0/1688283094 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f71880b2cc0 msgr2=0x7f71880b0fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:40:32.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.377+0000 7f718c892700 1 --2- 172.21.2.105:0/1688283094 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f71880b2cc0 0x7f71880b0fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:32.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.377+0000 7f718c892700 1 -- 172.21.2.105:0/1688283094 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7188143da0 msgr2=0x7f718815aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:32.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.377+0000 7f718c892700 1 --2- 172.21.2.105:0/1688283094 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7188143da0 0x7f718815aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:32.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.377+0000 7f718c892700 1 -- 172.21.2.105:0/1688283094 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7180009470 con 0x7f71880b2290 2021-11-12T05:40:32.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.377+0000 7f718c892700 1 --2- 172.21.2.105:0/1688283094 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71880b2290 0x7f7188066180 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f7188140280 tx=0x7f7178007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:32.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.377+0000 7f7185ffb700 1 -- 172.21.2.105:0/1688283094 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f717800ce20 con 0x7f71880b2290 2021-11-12T05:40:32.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.377+0000 7f7185ffb700 1 -- 172.21.2.105:0/1688283094 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71780072e0 con 0x7f71880b2290 2021-11-12T05:40:32.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.377+0000 7f718eaf6700 1 -- 172.21.2.105:0/1688283094 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7188066d60 con 0x7f71880b2290 2021-11-12T05:40:32.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.377+0000 7f7185ffb700 1 -- 172.21.2.105:0/1688283094 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7178005800 con 0x7f71880b2290 2021-11-12T05:40:32.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.377+0000 7f718eaf6700 1 -- 172.21.2.105:0/1688283094 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71880b14d0 con 0x7f71880b2290 2021-11-12T05:40:32.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.377+0000 7f718eaf6700 1 -- 172.21.2.105:0/1688283094 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7188066ef0 con 0x7f71880b2290 2021-11-12T05:40:32.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.377+0000 7f7185ffb700 1 -- 172.21.2.105:0/1688283094 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7178010070 con 0x7f71880b2290 2021-11-12T05:40:32.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.377+0000 7f7185ffb700 1 --2- 172.21.2.105:0/1688283094 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7168053660 0x7f7168055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:32.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.377+0000 7f7185ffb700 1 -- 172.21.2.105:0/1688283094 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f717806ae10 con 0x7f71880b2290 2021-11-12T05:40:32.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.377+0000 7f7187fff700 1 --2- 172.21.2.105:0/1688283094 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7168053660 0x7f7168055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:32.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.381+0000 7f7187fff700 1 --2- 172.21.2.105:0/1688283094 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7168053660 0x7f7168055b20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f717c002fb0 tx=0x7f717c006930).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:32.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.381+0000 7f7185ffb700 1 -- 172.21.2.105:0/1688283094 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7178042190 con 0x7f71880b2290 2021-11-12T05:40:32.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.465+0000 7f718eaf6700 1 -- 172.21.2.105:0/1688283094 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f71880666a0 con 0x7f71880b2290 2021-11-12T05:40:32.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.465+0000 7f7185ffb700 1 -- 172.21.2.105:0/1688283094 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7f71780457b0 con 0x7f71880b2290 2021-11-12T05:40:32.470 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:40:32.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.465+0000 7f718eaf6700 1 -- 172.21.2.105:0/1688283094 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7168053660 msgr2=0x7f7168055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:32.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.465+0000 7f718eaf6700 1 --2- 172.21.2.105:0/1688283094 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7168053660 0x7f7168055b20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f717c002fb0 tx=0x7f717c006930).stop 2021-11-12T05:40:32.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.465+0000 7f718eaf6700 1 -- 172.21.2.105:0/1688283094 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71880b2290 msgr2=0x7f7188066180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:32.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.465+0000 7f718eaf6700 1 --2- 172.21.2.105:0/1688283094 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71880b2290 0x7f7188066180 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f7188140280 tx=0x7f7178007c40).stop 2021-11-12T05:40:32.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.465+0000 7f718eaf6700 1 -- 172.21.2.105:0/1688283094 shutdown_connections 2021-11-12T05:40:32.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.465+0000 7f718eaf6700 1 --2- 172.21.2.105:0/1688283094 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7168053660 0x7f7168055b20 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:32.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.465+0000 7f718eaf6700 1 --2- 172.21.2.105:0/1688283094 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7188143da0 0x7f718815aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:32.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.465+0000 7f718eaf6700 1 --2- 172.21.2.105:0/1688283094 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f71880b2cc0 0x7f71880b0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:32.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.465+0000 7f718eaf6700 1 --2- 172.21.2.105:0/1688283094 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71880b2290 0x7f7188066180 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:32.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.465+0000 7f718eaf6700 1 -- 172.21.2.105:0/1688283094 >> 172.21.2.105:0/1688283094 conn(0x7f718805c490 msgr2=0x7f71881412c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:32.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.465+0000 7f718eaf6700 1 -- 172.21.2.105:0/1688283094 shutdown_connections 2021-11-12T05:40:32.474 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.465+0000 7f718eaf6700 1 -- 172.21.2.105:0/1688283094 wait complete. 2021-11-12T05:40:32.477 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-12T05:40:32.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.521+0000 7fd6e94fc700 1 Processor -- start 2021-11-12T05:40:32.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.521+0000 7fd6e94fc700 1 -- start start 2021-11-12T05:40:32.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.525+0000 7fd6e94fc700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6e405fdc0 0x7fd6e40601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:32.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.525+0000 7fd6e94fc700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fd6e413a9c0 0x7fd6e413ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:32.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.525+0000 7fd6e94fc700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e4066150 con 0x7fd6e40ade80 2021-11-12T05:40:32.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.525+0000 7fd6e94fc700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6e4141fb0 con 0x7fd6e413a9c0 2021-11-12T05:40:32.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.525+0000 7fd6e94fc700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e40663f0 con 0x7fd6e405fdc0 2021-11-12T05:40:32.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.525+0000 7fd6e2ffd700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6e405fdc0 0x7fd6e40601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:32.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.525+0000 7fd6e37fe700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fd6e413a9c0 0x7fd6e413ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:32.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.525+0000 7fd6e2ffd700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6e405fdc0 0x7fd6e40601a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3301/0 says I am v2:172.21.2.105:33688/0 (socket says 172.21.2.105:33688) 2021-11-12T05:40:32.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.525+0000 7fd6e37fe700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fd6e413a9c0 0x7fd6e413ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3300/0 says I am v2:172.21.2.105:59672/0 (socket says 172.21.2.105:59672) 2021-11-12T05:40:32.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.525+0000 7fd6e2ffd700 1 -- 172.21.2.105:0/4130569103 learned_addr learned my addr 172.21.2.105:0/4130569103 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:32.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.525+0000 7fd6e27fc700 1 --1- 172.21.2.105:0/4130569103 >> v1:172.21.2.115:6789/0 conn(0x7fd6e40ade80 0x7fd6e4066730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:51362/0 (socket says 172.21.2.105:51362) 2021-11-12T05:40:32.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.525+0000 7fd6e2ffd700 1 -- 172.21.2.105:0/4130569103 >> v2:172.21.2.115:3300/0 conn(0x7fd6e413a9c0 msgr2=0x7fd6e413ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:32.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.525+0000 7fd6e2ffd700 1 --2- 172.21.2.105:0/4130569103 >> v2:172.21.2.115:3300/0 conn(0x7fd6e413a9c0 0x7fd6e413ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:32.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.525+0000 7fd6e1ffb700 1 -- 172.21.2.105:0/4130569103 <== mon.1 v1:172.21.2.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913591964 0 0) 0x7fd6e4066150 con 0x7fd6e40ade80 2021-11-12T05:40:32.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.525+0000 7fd6e2ffd700 1 -- 172.21.2.105:0/4130569103 >> v1:172.21.2.115:6789/0 conn(0x7fd6e40ade80 legacy=0x7fd6e4066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:32.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.525+0000 7fd6e2ffd700 1 -- 172.21.2.105:0/4130569103 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e4140fd0 con 0x7fd6e405fdc0 2021-11-12T05:40:32.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.525+0000 7fd6e2ffd700 1 --2- 172.21.2.105:0/4130569103 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6e405fdc0 0x7fd6e40601a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fd6cc002f70 tx=0x7fd6cc006eb0).ready entity=mon.2 client_cookie=a41c4b5eeac1da57 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:32.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.525+0000 7fd6e1ffb700 1 -- 172.21.2.105:0/4130569103 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6cc00d570 con 0x7fd6e405fdc0 2021-11-12T05:40:32.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.525+0000 7fd6e1ffb700 1 -- 172.21.2.105:0/4130569103 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6cc000e90 con 0x7fd6e405fdc0 2021-11-12T05:40:32.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.529+0000 7fd6e1ffb700 1 -- 172.21.2.105:0/4130569103 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6cc00d8c0 con 0x7fd6e405fdc0 2021-11-12T05:40:32.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.529+0000 7fd6e94fc700 1 -- 172.21.2.105:0/4130569103 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6e405fdc0 msgr2=0x7fd6e40601a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:32.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.529+0000 7fd6e94fc700 1 --2- 172.21.2.105:0/4130569103 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6e405fdc0 0x7fd6e40601a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fd6cc002f70 tx=0x7fd6cc006eb0).stop 2021-11-12T05:40:32.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.529+0000 7fd6e94fc700 1 -- 172.21.2.105:0/4130569103 shutdown_connections 2021-11-12T05:40:32.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.529+0000 7fd6e94fc700 1 --2- 172.21.2.105:0/4130569103 >> v2:172.21.2.115:3300/0 conn(0x7fd6e413a9c0 0x7fd6e413ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:32.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.529+0000 7fd6e94fc700 1 --2- 172.21.2.105:0/4130569103 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6e405fdc0 0x7fd6e40601a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:32.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.529+0000 7fd6e94fc700 1 -- 172.21.2.105:0/4130569103 >> 172.21.2.105:0/4130569103 conn(0x7fd6e40608d0 msgr2=0x7fd6e405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:32.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.529+0000 7fd6e94fc700 1 -- 172.21.2.105:0/4130569103 shutdown_connections 2021-11-12T05:40:32.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.529+0000 7fd6e94fc700 1 -- 172.21.2.105:0/4130569103 wait complete. 2021-11-12T05:40:32.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.529+0000 7fd6e94fc700 1 Processor -- start 2021-11-12T05:40:32.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.529+0000 7fd6e94fc700 1 -- start start 2021-11-12T05:40:32.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.529+0000 7fd6e94fc700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6e405fdc0 0x7fd6e40b3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:32.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.529+0000 7fd6e94fc700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd6e40ade80 0x7fd6e412f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:32.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.529+0000 7fd6e94fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6e413a9c0 0x7fd6e412f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:32.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.529+0000 7fd6e94fc700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e413c3f0 con 0x7fd6e413a9c0 2021-11-12T05:40:32.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.529+0000 7fd6e94fc700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e40b1440 con 0x7fd6e40ade80 2021-11-12T05:40:32.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.529+0000 7fd6e94fc700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e413c6a0 con 0x7fd6e405fdc0 2021-11-12T05:40:32.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.529+0000 7fd6e37fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6e413a9c0 0x7fd6e412f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:32.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.529+0000 7fd6e37fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6e413a9c0 0x7fd6e412f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42506/0 (socket says 172.21.2.105:42506) 2021-11-12T05:40:32.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.529+0000 7fd6e37fe700 1 -- 172.21.2.105:0/3504536835 learned_addr learned my addr 172.21.2.105:0/3504536835 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:32.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.529+0000 7fd6e37fe700 1 -- 172.21.2.105:0/3504536835 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6e405fdc0 msgr2=0x7fd6e40b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:32.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.529+0000 7fd6e37fe700 1 --2- 172.21.2.105:0/3504536835 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6e405fdc0 0x7fd6e40b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:32.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.529+0000 7fd6e37fe700 1 -- 172.21.2.105:0/3504536835 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd6e40ade80 msgr2=0x7fd6e412f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:32.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.529+0000 7fd6e37fe700 1 --2- 172.21.2.105:0/3504536835 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd6e40ade80 0x7fd6e412f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:32.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.529+0000 7fd6e37fe700 1 -- 172.21.2.105:0/3504536835 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6cc00b1e0 con 0x7fd6e413a9c0 2021-11-12T05:40:32.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.529+0000 7fd6e37fe700 1 --2- 172.21.2.105:0/3504536835 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6e413a9c0 0x7fd6e412f7b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fd6dc006e00 tx=0x7fd6dc0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:32.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.529+0000 7fd6dbfff700 1 -- 172.21.2.105:0/3504536835 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6dc009580 con 0x7fd6e413a9c0 2021-11-12T05:40:32.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.529+0000 7fd6dbfff700 1 -- 172.21.2.105:0/3504536835 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6dc00c7f0 con 0x7fd6e413a9c0 2021-11-12T05:40:32.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.529+0000 7fd6e94fc700 1 -- 172.21.2.105:0/3504536835 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6e413c940 con 0x7fd6e413a9c0 2021-11-12T05:40:32.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.529+0000 7fd6dbfff700 1 -- 172.21.2.105:0/3504536835 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6dc00cb50 con 0x7fd6e413a9c0 2021-11-12T05:40:32.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.529+0000 7fd6e94fc700 1 -- 172.21.2.105:0/3504536835 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e412fca0 con 0x7fd6e413a9c0 2021-11-12T05:40:32.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.529+0000 7fd6e94fc700 1 -- 172.21.2.105:0/3504536835 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6e4057350 con 0x7fd6e413a9c0 2021-11-12T05:40:32.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.529+0000 7fd6dbfff700 1 -- 172.21.2.105:0/3504536835 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd6dc022070 con 0x7fd6e413a9c0 2021-11-12T05:40:32.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.533+0000 7fd6dbfff700 1 --2- 172.21.2.105:0/3504536835 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd6c8053610 0x7fd6c8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:32.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.533+0000 7fd6dbfff700 1 -- 172.21.2.105:0/3504536835 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fd6dc06bc40 con 0x7fd6e413a9c0 2021-11-12T05:40:32.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.533+0000 7fd6e2ffd700 1 --2- 172.21.2.105:0/3504536835 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd6c8053610 0x7fd6c8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:32.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.533+0000 7fd6e2ffd700 1 --2- 172.21.2.105:0/3504536835 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd6c8053610 0x7fd6c8055ad0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fd6cc002f70 tx=0x7fd6cc015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:32.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.533+0000 7fd6dbfff700 1 -- 172.21.2.105:0/3504536835 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd6dc0430d0 con 0x7fd6e413a9c0 2021-11-12T05:40:32.621 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.617+0000 7fd6e94fc700 1 -- 172.21.2.105:0/3504536835 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd6e40660c0 con 0x7fd6e413a9c0 2021-11-12T05:40:32.622 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.617+0000 7fd6dbfff700 1 -- 172.21.2.105:0/3504536835 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+143 (secure 0 0 0) 0x7fd6dc016020 con 0x7fd6e413a9c0 2021-11-12T05:40:32.622 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:40:32.623 INFO:teuthology.orchestra.run.gibba005.stdout:[ 2021-11-12T05:40:32.623 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:32.623 INFO:teuthology.orchestra.run.gibba005.stdout: "poolnum": 1, 2021-11-12T05:40:32.623 INFO:teuthology.orchestra.run.gibba005.stdout: "poolname": "device_health_metrics" 2021-11-12T05:40:32.623 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:32.624 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:32.624 INFO:teuthology.orchestra.run.gibba005.stdout: "poolnum": 2, 2021-11-12T05:40:32.624 INFO:teuthology.orchestra.run.gibba005.stdout: "poolname": "rbd" 2021-11-12T05:40:32.624 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:32.625 INFO:teuthology.orchestra.run.gibba005.stdout:] 2021-11-12T05:40:32.625 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.617+0000 7fd6e94fc700 1 -- 172.21.2.105:0/3504536835 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd6c8053610 msgr2=0x7fd6c8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:32.626 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.617+0000 7fd6e94fc700 1 --2- 172.21.2.105:0/3504536835 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd6c8053610 0x7fd6c8055ad0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fd6cc002f70 tx=0x7fd6cc015000).stop 2021-11-12T05:40:32.626 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.617+0000 7fd6e94fc700 1 -- 172.21.2.105:0/3504536835 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6e413a9c0 msgr2=0x7fd6e412f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:32.626 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.617+0000 7fd6e94fc700 1 --2- 172.21.2.105:0/3504536835 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6e413a9c0 0x7fd6e412f7b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fd6dc006e00 tx=0x7fd6dc0091d0).stop 2021-11-12T05:40:32.627 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.621+0000 7fd6e94fc700 1 -- 172.21.2.105:0/3504536835 shutdown_connections 2021-11-12T05:40:32.627 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.621+0000 7fd6e94fc700 1 --2- 172.21.2.105:0/3504536835 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd6c8053610 0x7fd6c8055ad0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:32.627 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.621+0000 7fd6e94fc700 1 --2- 172.21.2.105:0/3504536835 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6e413a9c0 0x7fd6e412f7b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:32.627 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.621+0000 7fd6e94fc700 1 --2- 172.21.2.105:0/3504536835 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd6e40ade80 0x7fd6e412f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:32.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.621+0000 7fd6e94fc700 1 --2- 172.21.2.105:0/3504536835 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6e405fdc0 0x7fd6e40b3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:32.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.621+0000 7fd6e94fc700 1 -- 172.21.2.105:0/3504536835 >> 172.21.2.105:0/3504536835 conn(0x7fd6e40608d0 msgr2=0x7fd6e40b4530 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:32.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.621+0000 7fd6e94fc700 1 -- 172.21.2.105:0/3504536835 shutdown_connections 2021-11-12T05:40:32.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.621+0000 7fd6e94fc700 1 -- 172.21.2.105:0/3504536835 wait complete. 2021-11-12T05:40:32.630 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-12T05:40:32.630 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-12T05:40:32.684 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.681+0000 7f830b459700 1 Processor -- start 2021-11-12T05:40:32.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.681+0000 7f830b459700 1 -- start start 2021-11-12T05:40:32.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.681+0000 7f830b459700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f83040b0bf0 0x7f8304142e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:32.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.681+0000 7f830b459700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8304143dc0 0x7f83041468b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:32.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.681+0000 7f830b459700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83040b43f0 con 0x7f83040621b0 2021-11-12T05:40:32.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.681+0000 7f830b459700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83040b6590 con 0x7f83040b0bf0 2021-11-12T05:40:32.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.681+0000 7f830b459700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8304062590 con 0x7f8304143dc0 2021-11-12T05:40:32.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.681+0000 7f83089f4700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f83040b0bf0 0x7f8304142e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:32.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.681+0000 7f83099f6700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8304143dc0 0x7f83041468b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:32.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.681+0000 7f83089f4700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f83040b0bf0 0x7f8304142e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3300/0 says I am v2:172.21.2.105:59688/0 (socket says 172.21.2.105:59688) 2021-11-12T05:40:32.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.681+0000 7f83089f4700 1 -- 172.21.2.105:0/1380126172 learned_addr learned my addr 172.21.2.105:0/1380126172 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:32.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.681+0000 7f83089f4700 1 -- 172.21.2.105:0/1380126172 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8304143dc0 msgr2=0x7f83041468b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:32.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.681+0000 7f83089f4700 1 --2- 172.21.2.105:0/1380126172 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8304143dc0 0x7f83041468b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:32.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.681+0000 7f83089f4700 1 -- 172.21.2.105:0/1380126172 >> v1:172.21.2.115:6789/0 conn(0x7f83040621b0 legacy=0x7f83041436b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:32.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.681+0000 7f83089f4700 1 -- 172.21.2.105:0/1380126172 --> v2:172.21.2.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83040b4150 con 0x7f83040b0bf0 2021-11-12T05:40:32.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.681+0000 7f83089f4700 1 --2- 172.21.2.105:0/1380126172 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f83040b0bf0 0x7f8304142e60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f82f4002f70 tx=0x7f82f4006eb0).ready entity=mon.1 client_cookie=f6ccdad42b35ce38 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:32.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f82f3fff700 1 -- 172.21.2.105:0/1380126172 <== mon.1 v2:172.21.2.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82f400d570 con 0x7f83040b0bf0 2021-11-12T05:40:32.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f82f3fff700 1 -- 172.21.2.105:0/1380126172 <== mon.1 v2:172.21.2.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f4000e90 con 0x7f83040b0bf0 2021-11-12T05:40:32.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f82f3fff700 1 -- 172.21.2.105:0/1380126172 <== mon.1 v2:172.21.2.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82f400d900 con 0x7f83040b0bf0 2021-11-12T05:40:32.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f830b459700 1 -- 172.21.2.105:0/1380126172 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f83040b0bf0 msgr2=0x7f8304142e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:32.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f830b459700 1 --2- 172.21.2.105:0/1380126172 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f83040b0bf0 0x7f8304142e60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f82f4002f70 tx=0x7f82f4006eb0).stop 2021-11-12T05:40:32.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f830b459700 1 -- 172.21.2.105:0/1380126172 shutdown_connections 2021-11-12T05:40:32.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f830b459700 1 --2- 172.21.2.105:0/1380126172 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8304143dc0 0x7f83041468b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:32.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f830b459700 1 --2- 172.21.2.105:0/1380126172 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f83040b0bf0 0x7f8304142e60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:32.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f830b459700 1 -- 172.21.2.105:0/1380126172 >> 172.21.2.105:0/1380126172 conn(0x7f83040b97b0 msgr2=0x7f83040b9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:32.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f830b459700 1 -- 172.21.2.105:0/1380126172 shutdown_connections 2021-11-12T05:40:32.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f830b459700 1 -- 172.21.2.105:0/1380126172 wait complete. 2021-11-12T05:40:32.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f830b459700 1 Processor -- start 2021-11-12T05:40:32.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f830b459700 1 -- start start 2021-11-12T05:40:32.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f830b459700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f83040621b0 0x7f830414b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:32.701 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f830b459700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8304143dc0 0x7f8304149f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:32.701 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f830b459700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8304144970 0x7f8304156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:32.701 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f830b459700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830415a8e0 con 0x7f83040621b0 2021-11-12T05:40:32.701 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f830b459700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830415ab80 con 0x7f8304144970 2021-11-12T05:40:32.702 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f830b459700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83041567c0 con 0x7f8304143dc0 2021-11-12T05:40:32.702 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f83091f5700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f83040621b0 0x7f830414b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:32.702 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f83091f5700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f83040621b0 0x7f830414b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42516/0 (socket says 172.21.2.105:42516) 2021-11-12T05:40:32.702 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f83091f5700 1 -- 172.21.2.105:0/612856053 learned_addr learned my addr 172.21.2.105:0/612856053 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:32.702 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f83099f6700 1 --2- 172.21.2.105:0/612856053 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8304144970 0x7f8304156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:32.703 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f83091f5700 1 -- 172.21.2.105:0/612856053 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8304143dc0 msgr2=0x7f8304149f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:32.703 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f83091f5700 1 --2- 172.21.2.105:0/612856053 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8304143dc0 0x7f8304149f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:32.703 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f83091f5700 1 -- 172.21.2.105:0/612856053 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8304144970 msgr2=0x7f8304156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:32.703 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f83091f5700 1 --2- 172.21.2.105:0/612856053 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8304144970 0x7f8304156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:32.704 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f83091f5700 1 -- 172.21.2.105:0/612856053 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f400b1e0 con 0x7f83040621b0 2021-11-12T05:40:32.704 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f83091f5700 1 --2- 172.21.2.105:0/612856053 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f83040621b0 0x7f830414b810 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f83040607f0 tx=0x7f8300007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:32.704 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f82f27fc700 1 -- 172.21.2.105:0/612856053 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f830000ce30 con 0x7f83040621b0 2021-11-12T05:40:32.704 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f82f27fc700 1 -- 172.21.2.105:0/612856053 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8300007240 con 0x7f83040621b0 2021-11-12T05:40:32.705 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f830b459700 1 -- 172.21.2.105:0/612856053 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f830414bf40 con 0x7f83040621b0 2021-11-12T05:40:32.705 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f830b459700 1 -- 172.21.2.105:0/612856053 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83041573a0 con 0x7f83040621b0 2021-11-12T05:40:32.705 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f82f27fc700 1 -- 172.21.2.105:0/612856053 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8300006700 con 0x7f83040621b0 2021-11-12T05:40:32.705 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f830b459700 1 -- 172.21.2.105:0/612856053 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83040b62f0 con 0x7f83040621b0 2021-11-12T05:40:32.705 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f82f27fc700 1 -- 172.21.2.105:0/612856053 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8300010030 con 0x7f83040621b0 2021-11-12T05:40:32.706 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f82f27fc700 1 --2- 172.21.2.105:0/612856053 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f82e4053720 0x7f82e4055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:32.706 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f82f27fc700 1 -- 172.21.2.105:0/612856053 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f830006b3c0 con 0x7f83040621b0 2021-11-12T05:40:32.706 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.685+0000 7f83089f4700 1 --2- 172.21.2.105:0/612856053 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f82e4053720 0x7f82e4055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:32.706 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.689+0000 7f83089f4700 1 --2- 172.21.2.105:0/612856053 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f82e4053720 0x7f82e4055be0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f82f4002f70 tx=0x7f82f4015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:32.707 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.689+0000 7f82f27fc700 1 -- 172.21.2.105:0/612856053 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8300042740 con 0x7f83040621b0 2021-11-12T05:40:32.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.773+0000 7f830b459700 1 -- 172.21.2.105:0/612856053 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f8304156a70 con 0x7f83040621b0 2021-11-12T05:40:32.972 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.969+0000 7f82f27fc700 1 -- 172.21.2.105:0/612856053 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v19) v1 ==== 133+0+0 (secure 0 0 0) 0x7f8304156a70 con 0x7f83040621b0 2021-11-12T05:40:32.973 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.969+0000 7f830b459700 1 -- 172.21.2.105:0/612856053 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f82e4053720 msgr2=0x7f82e4055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:32.974 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.969+0000 7f830b459700 1 --2- 172.21.2.105:0/612856053 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f82e4053720 0x7f82e4055be0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f82f4002f70 tx=0x7f82f4015000).stop 2021-11-12T05:40:32.974 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.969+0000 7f830b459700 1 -- 172.21.2.105:0/612856053 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f83040621b0 msgr2=0x7f830414b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:32.975 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.969+0000 7f830b459700 1 --2- 172.21.2.105:0/612856053 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f83040621b0 0x7f830414b810 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f83040607f0 tx=0x7f8300007c10).stop 2021-11-12T05:40:32.975 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.969+0000 7f830b459700 1 -- 172.21.2.105:0/612856053 shutdown_connections 2021-11-12T05:40:32.975 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.969+0000 7f830b459700 1 --2- 172.21.2.105:0/612856053 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f82e4053720 0x7f82e4055be0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:32.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.969+0000 7f830b459700 1 --2- 172.21.2.105:0/612856053 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8304144970 0x7f8304156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:32.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.969+0000 7f830b459700 1 --2- 172.21.2.105:0/612856053 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8304143dc0 0x7f8304149f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:32.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.969+0000 7f830b459700 1 --2- 172.21.2.105:0/612856053 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f83040621b0 0x7f830414b810 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:32.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.969+0000 7f830b459700 1 -- 172.21.2.105:0/612856053 >> 172.21.2.105:0/612856053 conn(0x7f83040b97b0 msgr2=0x7f830405fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:32.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.969+0000 7f830b459700 1 -- 172.21.2.105:0/612856053 shutdown_connections 2021-11-12T05:40:32.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:32.969+0000 7f830b459700 1 -- 172.21.2.105:0/612856053 wait complete. 2021-11-12T05:40:32.978 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_metadata' created 2021-11-12T05:40:32.980 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2021-11-12T05:40:32.981 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data m=2 k=2 crush-failure-domain=osd 2021-11-12T05:40:33.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.033+0000 7fabd3316700 1 Processor -- start 2021-11-12T05:40:33.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.033+0000 7fabd3316700 1 -- start start 2021-11-12T05:40:33.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.033+0000 7fabd3316700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fabcc0ac280 0x7fabcc14b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:33.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.033+0000 7fabd3316700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fabcc0af730 0x7fabcc0ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:33.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.033+0000 7fabd3316700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabcc0ac7b0 con 0x7fabcc0ad080 2021-11-12T05:40:33.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.033+0000 7fabd3316700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabcc1488a0 con 0x7fabcc0af730 2021-11-12T05:40:33.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.033+0000 7fabd3316700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabcc0ac9e0 con 0x7fabcc0ac280 2021-11-12T05:40:33.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.033+0000 7fabd10b2700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fabcc0ad080 0x7fabcc14abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:52918/0 (socket says 172.21.2.105:52918) 2021-11-12T05:40:33.042 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.033+0000 7fabd10b2700 1 -- 172.21.2.105:0/1366448819 learned_addr learned my addr 172.21.2.105:0/1366448819 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:33.042 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.033+0000 7fabd18b3700 1 --2- 172.21.2.105:0/1366448819 >> v2:172.21.2.105:3300/0 conn(0x7fabcc0af730 0x7fabcc0ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:33.042 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.033+0000 7fabd18b3700 1 -- 172.21.2.105:0/1366448819 >> v2:172.21.2.115:3300/0 conn(0x7fabcc0ac280 msgr2=0x7fabcc14b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:33.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.033+0000 7fabd18b3700 1 --2- 172.21.2.105:0/1366448819 >> v2:172.21.2.115:3300/0 conn(0x7fabcc0ac280 0x7fabcc14b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:33.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.033+0000 7fabd18b3700 1 -- 172.21.2.105:0/1366448819 >> v1:172.21.2.105:6789/0 conn(0x7fabcc0ad080 legacy=0x7fabcc14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:33.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.033+0000 7fabd18b3700 1 -- 172.21.2.105:0/1366448819 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabcc0b0b30 con 0x7fabcc0af730 2021-11-12T05:40:33.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.033+0000 7fabd18b3700 1 --2- 172.21.2.105:0/1366448819 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fabcc0af730 0x7fabcc0ad460 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fabcc0b1000 tx=0x7fabc40091d0).ready entity=mon.0 client_cookie=67ab2d118f8cae24 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:33.048 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.033+0000 7fabbffff700 1 -- 172.21.2.105:0/1366448819 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabc4009ea0 con 0x7fabcc0af730 2021-11-12T05:40:33.048 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.033+0000 7fabbffff700 1 -- 172.21.2.105:0/1366448819 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc400b860 con 0x7fabcc0af730 2021-11-12T05:40:33.049 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.033+0000 7fabbffff700 1 -- 172.21.2.105:0/1366448819 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabc400b9d0 con 0x7fabcc0af730 2021-11-12T05:40:33.049 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.033+0000 7fabd3316700 1 -- 172.21.2.105:0/1366448819 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fabcc0af730 msgr2=0x7fabcc0ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:33.049 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.033+0000 7fabd3316700 1 --2- 172.21.2.105:0/1366448819 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fabcc0af730 0x7fabcc0ad460 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fabcc0b1000 tx=0x7fabc40091d0).stop 2021-11-12T05:40:33.049 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.033+0000 7fabd3316700 1 -- 172.21.2.105:0/1366448819 shutdown_connections 2021-11-12T05:40:33.050 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.033+0000 7fabd3316700 1 --2- 172.21.2.105:0/1366448819 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fabcc0af730 0x7fabcc0ad460 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:33.050 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.033+0000 7fabd3316700 1 --2- 172.21.2.105:0/1366448819 >> v2:172.21.2.115:3300/0 conn(0x7fabcc0ac280 0x7fabcc14b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:33.050 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.033+0000 7fabd3316700 1 -- 172.21.2.105:0/1366448819 >> 172.21.2.105:0/1366448819 conn(0x7fabcc0b5370 msgr2=0x7fabcc0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:33.050 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.033+0000 7fabd3316700 1 -- 172.21.2.105:0/1366448819 shutdown_connections 2021-11-12T05:40:33.051 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.033+0000 7fabd3316700 1 -- 172.21.2.105:0/1366448819 wait complete. 2021-11-12T05:40:33.051 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.037+0000 7fabd3316700 1 Processor -- start 2021-11-12T05:40:33.051 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.037+0000 7fabd3316700 1 -- start start 2021-11-12T05:40:33.052 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.037+0000 7fabd3316700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fabcc0ac280 0x7fabcc0aba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:33.052 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.037+0000 7fabd3316700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fabcc0ad080 0x7fabcc0637e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:33.052 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.037+0000 7fabd3316700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fabcc0af730 0x7fabcc1427a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:33.052 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.037+0000 7fabd3316700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabcc0640a0 con 0x7fabcc0af730 2021-11-12T05:40:33.052 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.037+0000 7fabd3316700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabcc0ab330 con 0x7fabcc0ad080 2021-11-12T05:40:33.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.037+0000 7fabd3316700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabcc0ab5d0 con 0x7fabcc0ac280 2021-11-12T05:40:33.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.037+0000 7fabd18b3700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fabcc0af730 0x7fabcc1427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:33.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.037+0000 7fabd18b3700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fabcc0af730 0x7fabcc1427a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42532/0 (socket says 172.21.2.105:42532) 2021-11-12T05:40:33.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.037+0000 7fabd18b3700 1 -- 172.21.2.105:0/2517932282 learned_addr learned my addr 172.21.2.105:0/2517932282 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:33.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.037+0000 7fabd18b3700 1 -- 172.21.2.105:0/2517932282 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fabcc0ac280 msgr2=0x7fabcc0aba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:33.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.037+0000 7fabd18b3700 1 --2- 172.21.2.105:0/2517932282 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fabcc0ac280 0x7fabcc0aba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:33.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.037+0000 7fabd18b3700 1 -- 172.21.2.105:0/2517932282 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fabcc0ad080 msgr2=0x7fabcc0637e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:33.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.037+0000 7fabd18b3700 1 --2- 172.21.2.105:0/2517932282 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fabcc0ad080 0x7fabcc0637e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:33.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.037+0000 7fabd18b3700 1 -- 172.21.2.105:0/2517932282 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc4009470 con 0x7fabcc0af730 2021-11-12T05:40:33.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.037+0000 7fabd18b3700 1 --2- 172.21.2.105:0/2517932282 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fabcc0af730 0x7fabcc1427a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fabcc0b1000 tx=0x7fabc4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:33.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.037+0000 7fabbe7fc700 1 -- 172.21.2.105:0/2517932282 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabc4006ea0 con 0x7fabcc0af730 2021-11-12T05:40:33.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.037+0000 7fabbe7fc700 1 -- 172.21.2.105:0/2517932282 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc40032f0 con 0x7fabcc0af730 2021-11-12T05:40:33.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.037+0000 7fabbe7fc700 1 -- 172.21.2.105:0/2517932282 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabc40107a0 con 0x7fabcc0af730 2021-11-12T05:40:33.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.037+0000 7fabd3316700 1 -- 172.21.2.105:0/2517932282 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabcc063cd0 con 0x7fabcc0af730 2021-11-12T05:40:33.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.037+0000 7fabd3316700 1 -- 172.21.2.105:0/2517932282 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabcc0a96a0 con 0x7fabcc0af730 2021-11-12T05:40:33.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.037+0000 7fabd3316700 1 -- 172.21.2.105:0/2517932282 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabcc063ef0 con 0x7fabcc0af730 2021-11-12T05:40:33.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.037+0000 7fabbe7fc700 1 -- 172.21.2.105:0/2517932282 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fabc4027020 con 0x7fabcc0af730 2021-11-12T05:40:33.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.037+0000 7fabbe7fc700 1 --2- 172.21.2.105:0/2517932282 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fabac0536a0 0x7fabac055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:33.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.037+0000 7fabbe7fc700 1 -- 172.21.2.105:0/2517932282 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5603+0+0 (secure 0 0 0) 0x7fabc406cf50 con 0x7fabcc0af730 2021-11-12T05:40:33.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.037+0000 7fabd10b2700 1 --2- 172.21.2.105:0/2517932282 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fabac0536a0 0x7fabac055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:33.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.037+0000 7fabd10b2700 1 --2- 172.21.2.105:0/2517932282 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fabac0536a0 0x7fabac055b60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fabcc0b0eb0 tx=0x7fabc8007800).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:33.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.041+0000 7fabbe7fc700 1 -- 172.21.2.105:0/2517932282 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fabc406ae90 con 0x7fabcc0af730 2021-11-12T05:40:33.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.129+0000 7fabd3316700 1 -- 172.21.2.105:0/2517932282 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fabcc0ab790 con 0x7fabcc0af730 2021-11-12T05:40:33.982 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.977+0000 7fabbe7fc700 1 -- 172.21.2.105:0/2517932282 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 154+0+0 (secure 0 0 0) 0x7fabc4015020 con 0x7fabcc0af730 2021-11-12T05:40:33.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.981+0000 7fabd3316700 1 -- 172.21.2.105:0/2517932282 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fabac0536a0 msgr2=0x7fabac055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:33.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.981+0000 7fabd3316700 1 --2- 172.21.2.105:0/2517932282 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fabac0536a0 0x7fabac055b60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fabcc0b0eb0 tx=0x7fabc8007800).stop 2021-11-12T05:40:33.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.981+0000 7fabd3316700 1 -- 172.21.2.105:0/2517932282 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fabcc0af730 msgr2=0x7fabcc1427a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:33.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.981+0000 7fabd3316700 1 --2- 172.21.2.105:0/2517932282 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fabcc0af730 0x7fabcc1427a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fabcc0b1000 tx=0x7fabc4016000).stop 2021-11-12T05:40:33.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.981+0000 7fabd3316700 1 -- 172.21.2.105:0/2517932282 shutdown_connections 2021-11-12T05:40:33.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.981+0000 7fabd3316700 1 --2- 172.21.2.105:0/2517932282 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fabac0536a0 0x7fabac055b60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:33.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.981+0000 7fabd3316700 1 --2- 172.21.2.105:0/2517932282 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fabcc0af730 0x7fabcc1427a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:33.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.981+0000 7fabd3316700 1 --2- 172.21.2.105:0/2517932282 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fabcc0ad080 0x7fabcc0637e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:33.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.981+0000 7fabd3316700 1 --2- 172.21.2.105:0/2517932282 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fabcc0ac280 0x7fabcc0aba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:33.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.981+0000 7fabd3316700 1 -- 172.21.2.105:0/2517932282 >> 172.21.2.105:0/2517932282 conn(0x7fabcc0b5370 msgr2=0x7fabcc1450e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:33.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.981+0000 7fabd3316700 1 -- 172.21.2.105:0/2517932282 shutdown_connections 2021-11-12T05:40:33.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:33.981+0000 7fabd3316700 1 -- 172.21.2.105:0/2517932282 wait complete. 2021-11-12T05:40:33.991 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 erasure cephfs_data 2021-11-12T05:40:34.052 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.041+0000 7f5ac7960700 1 Processor -- start 2021-11-12T05:40:34.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.041+0000 7f5ac7960700 1 -- start start 2021-11-12T05:40:34.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac7960700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f5ac005fdc0 0x7f5ac00601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:34.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac7960700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f5ac013a9c0 0x7f5ac013ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:34.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac7960700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ac0066150 con 0x7f5ac00ade80 2021-11-12T05:40:34.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac7960700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ac0141fb0 con 0x7f5ac005fdc0 2021-11-12T05:40:34.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac7960700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ac00663f0 con 0x7f5ac013a9c0 2021-11-12T05:40:34.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac56fc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f5ac005fdc0 0x7f5ac00601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:34.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac56fc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f5ac005fdc0 0x7f5ac00601a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42536/0 (socket says 172.21.2.105:42536) 2021-11-12T05:40:34.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac56fc700 1 -- 172.21.2.105:0/3911859343 learned_addr learned my addr 172.21.2.105:0/3911859343 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:34.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac56fc700 1 -- 172.21.2.105:0/3911859343 >> v2:172.21.2.115:3300/0 conn(0x7f5ac013a9c0 msgr2=0x7f5ac013ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:34.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac56fc700 1 --2- 172.21.2.105:0/3911859343 >> v2:172.21.2.115:3300/0 conn(0x7f5ac013a9c0 0x7f5ac013ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:34.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac56fc700 1 -- 172.21.2.105:0/3911859343 >> v1:172.21.2.115:6789/0 conn(0x7f5ac00ade80 legacy=0x7f5ac0066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:34.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac56fc700 1 -- 172.21.2.105:0/3911859343 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac0140fd0 con 0x7f5ac005fdc0 2021-11-12T05:40:34.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac56fc700 1 --2- 172.21.2.105:0/3911859343 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ac005fdc0 0x7f5ac00601a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f5ac0060e00 tx=0x7f5ab4006eb0).ready entity=mon.0 client_cookie=abd3bd6185206020 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:34.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ab3fff700 1 -- 172.21.2.105:0/3911859343 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ab400d5c0 con 0x7f5ac005fdc0 2021-11-12T05:40:34.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ab3fff700 1 -- 172.21.2.105:0/3911859343 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab4000e90 con 0x7f5ac005fdc0 2021-11-12T05:40:34.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ab3fff700 1 -- 172.21.2.105:0/3911859343 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ab400d910 con 0x7f5ac005fdc0 2021-11-12T05:40:34.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac7960700 1 -- 172.21.2.105:0/3911859343 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ac005fdc0 msgr2=0x7f5ac00601a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:34.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac7960700 1 --2- 172.21.2.105:0/3911859343 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ac005fdc0 0x7f5ac00601a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f5ac0060e00 tx=0x7f5ab4006eb0).stop 2021-11-12T05:40:34.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac7960700 1 -- 172.21.2.105:0/3911859343 shutdown_connections 2021-11-12T05:40:34.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac7960700 1 --2- 172.21.2.105:0/3911859343 >> v2:172.21.2.115:3300/0 conn(0x7f5ac013a9c0 0x7f5ac013ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:34.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac7960700 1 --2- 172.21.2.105:0/3911859343 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ac005fdc0 0x7f5ac00601a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:34.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac7960700 1 -- 172.21.2.105:0/3911859343 >> 172.21.2.105:0/3911859343 conn(0x7f5ac00608d0 msgr2=0x7f5ac005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:34.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac7960700 1 -- 172.21.2.105:0/3911859343 shutdown_connections 2021-11-12T05:40:34.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac7960700 1 -- 172.21.2.105:0/3911859343 wait complete. 2021-11-12T05:40:34.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac7960700 1 Processor -- start 2021-11-12T05:40:34.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac7960700 1 -- start start 2021-11-12T05:40:34.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac7960700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ac005fdc0 0x7f5ac00628d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:34.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac7960700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5ac00ade80 0x7f5ac00b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:34.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac7960700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5ac013a9c0 0x7f5ac00b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:34.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac7960700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac00b81c0 con 0x7f5ac005fdc0 2021-11-12T05:40:34.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac7960700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac00b0270 con 0x7f5ac00ade80 2021-11-12T05:40:34.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac7960700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac013e380 con 0x7f5ac013a9c0 2021-11-12T05:40:34.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac56fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ac005fdc0 0x7f5ac00628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:34.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac56fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ac005fdc0 0x7f5ac00628d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42544/0 (socket says 172.21.2.105:42544) 2021-11-12T05:40:34.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac56fc700 1 -- 172.21.2.105:0/1655318198 learned_addr learned my addr 172.21.2.105:0/1655318198 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:34.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac56fc700 1 -- 172.21.2.105:0/1655318198 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5ac013a9c0 msgr2=0x7f5ac00b5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:34.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac56fc700 1 --2- 172.21.2.105:0/1655318198 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5ac013a9c0 0x7f5ac00b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:34.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac56fc700 1 -- 172.21.2.105:0/1655318198 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5ac00ade80 msgr2=0x7f5ac00b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:34.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac56fc700 1 --2- 172.21.2.105:0/1655318198 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5ac00ade80 0x7f5ac00b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:34.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac56fc700 1 -- 172.21.2.105:0/1655318198 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab400b1e0 con 0x7f5ac005fdc0 2021-11-12T05:40:34.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac56fc700 1 --2- 172.21.2.105:0/1655318198 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ac005fdc0 0x7f5ac00628d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f5ac00b0460 tx=0x7f5ab4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:34.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ab27fc700 1 -- 172.21.2.105:0/1655318198 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ab4006be0 con 0x7f5ac005fdc0 2021-11-12T05:40:34.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ab27fc700 1 -- 172.21.2.105:0/1655318198 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab4002f70 con 0x7f5ac005fdc0 2021-11-12T05:40:34.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac7960700 1 -- 172.21.2.105:0/1655318198 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ac013e5b0 con 0x7f5ac005fdc0 2021-11-12T05:40:34.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ab27fc700 1 -- 172.21.2.105:0/1655318198 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ab4011e90 con 0x7f5ac005fdc0 2021-11-12T05:40:34.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.045+0000 7f5ac7960700 1 -- 172.21.2.105:0/1655318198 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac00b7f20 con 0x7f5ac005fdc0 2021-11-12T05:40:34.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.049+0000 7f5ac7960700 1 -- 172.21.2.105:0/1655318198 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ac0140c40 con 0x7f5ac005fdc0 2021-11-12T05:40:34.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.049+0000 7f5ab27fc700 1 -- 172.21.2.105:0/1655318198 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5ab4025030 con 0x7f5ac005fdc0 2021-11-12T05:40:34.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.049+0000 7f5ab27fc700 1 --2- 172.21.2.105:0/1655318198 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5aa0053580 0x7f5aa0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:34.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.049+0000 7f5ab27fc700 1 -- 172.21.2.105:0/1655318198 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5859+0+0 (secure 0 0 0) 0x7f5ab406cd30 con 0x7f5ac005fdc0 2021-11-12T05:40:34.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.049+0000 7f5ac4efb700 1 --2- 172.21.2.105:0/1655318198 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5aa0053580 0x7f5aa0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:34.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.049+0000 7f5ac4efb700 1 --2- 172.21.2.105:0/1655318198 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5aa0053580 0x7f5aa0055a40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f5abc002f90 tx=0x7f5abc0069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:34.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.049+0000 7f5ab27fc700 1 -- 172.21.2.105:0/1655318198 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5ab4043e50 con 0x7f5ac005fdc0 2021-11-12T05:40:34.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:34.133+0000 7f5ac7960700 1 -- 172.21.2.105:0/1655318198 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"} v 0) v1 -- 0x7f5ac0057350 con 0x7f5ac005fdc0 2021-11-12T05:40:36.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.009+0000 7f5ab27fc700 1 -- 172.21.2.105:0/1655318198 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"}]=0 pool 'cephfs_data' created v22) v1 ==== 188+0+0 (secure 0 0 0) 0x7f5ab4023020 con 0x7f5ac005fdc0 2021-11-12T05:40:36.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.009+0000 7f5ac7960700 1 -- 172.21.2.105:0/1655318198 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5aa0053580 msgr2=0x7f5aa0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:36.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.009+0000 7f5ac7960700 1 --2- 172.21.2.105:0/1655318198 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5aa0053580 0x7f5aa0055a40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f5abc002f90 tx=0x7f5abc0069b0).stop 2021-11-12T05:40:36.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.009+0000 7f5ac7960700 1 -- 172.21.2.105:0/1655318198 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ac005fdc0 msgr2=0x7f5ac00628d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:36.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.009+0000 7f5ac7960700 1 --2- 172.21.2.105:0/1655318198 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ac005fdc0 0x7f5ac00628d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f5ac00b0460 tx=0x7f5ab4015000).stop 2021-11-12T05:40:36.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.009+0000 7f5ac7960700 1 -- 172.21.2.105:0/1655318198 shutdown_connections 2021-11-12T05:40:36.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.009+0000 7f5ac7960700 1 --2- 172.21.2.105:0/1655318198 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5aa0053580 0x7f5aa0055a40 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:36.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.009+0000 7f5ac7960700 1 --2- 172.21.2.105:0/1655318198 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5ac013a9c0 0x7f5ac00b5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:36.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.009+0000 7f5ac7960700 1 --2- 172.21.2.105:0/1655318198 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5ac00ade80 0x7f5ac00b56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:36.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.009+0000 7f5ac7960700 1 --2- 172.21.2.105:0/1655318198 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ac005fdc0 0x7f5ac00628d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:36.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.009+0000 7f5ac7960700 1 -- 172.21.2.105:0/1655318198 >> 172.21.2.105:0/1655318198 conn(0x7f5ac00608d0 msgr2=0x7f5ac0066730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:36.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.009+0000 7f5ac7960700 1 -- 172.21.2.105:0/1655318198 shutdown_connections 2021-11-12T05:40:36.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.009+0000 7f5ac7960700 1 -- 172.21.2.105:0/1655318198 wait complete. 2021-11-12T05:40:36.016 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_data' created 2021-11-12T05:40:36.019 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data allow_ec_overwrites true 2021-11-12T05:40:36.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.069+0000 7f186649f700 1 Processor -- start 2021-11-12T05:40:36.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.069+0000 7f186649f700 1 -- start start 2021-11-12T05:40:36.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.069+0000 7f186649f700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f186005ff60 0x7f1860140b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:36.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.069+0000 7f186649f700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f186013a7d0 0x7f186013ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:36.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.069+0000 7f186649f700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18600b2060 con 0x7f18600b2a40 2021-11-12T05:40:36.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.069+0000 7f186649f700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18600b2300 con 0x7f186005ff60 2021-11-12T05:40:36.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.069+0000 7f186649f700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18600b25a0 con 0x7f186013a7d0 2021-11-12T05:40:36.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.069+0000 7f186549d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f186005ff60 0x7f1860140b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:36.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.069+0000 7f186549d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f186005ff60 0x7f1860140b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42548/0 (socket says 172.21.2.105:42548) 2021-11-12T05:40:36.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.069+0000 7f186549d700 1 -- 172.21.2.105:0/132707614 learned_addr learned my addr 172.21.2.105:0/132707614 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:36.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.069+0000 7f186549d700 1 -- 172.21.2.105:0/132707614 >> v2:172.21.2.115:3300/0 conn(0x7f186013a7d0 msgr2=0x7f186013ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:36.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.069+0000 7f186549d700 1 --2- 172.21.2.105:0/132707614 >> v2:172.21.2.115:3300/0 conn(0x7f186013a7d0 0x7f186013ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:36.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.069+0000 7f186549d700 1 -- 172.21.2.105:0/132707614 >> v1:172.21.2.115:6789/0 conn(0x7f18600b2a40 legacy=0x7f18600b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:36.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.069+0000 7f186549d700 1 -- 172.21.2.105:0/132707614 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18600b2ea0 con 0x7f186005ff60 2021-11-12T05:40:36.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.069+0000 7f186549d700 1 --2- 172.21.2.105:0/132707614 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f186005ff60 0x7f1860140b40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f1860060d30 tx=0x7f185c006eb0).ready entity=mon.0 client_cookie=39738db6bcec5a21 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:36.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.069+0000 7f1853fff700 1 -- 172.21.2.105:0/132707614 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f185c00d5c0 con 0x7f186005ff60 2021-11-12T05:40:36.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.069+0000 7f1853fff700 1 -- 172.21.2.105:0/132707614 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185c000e90 con 0x7f186005ff60 2021-11-12T05:40:36.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.069+0000 7f1853fff700 1 -- 172.21.2.105:0/132707614 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f185c00d910 con 0x7f186005ff60 2021-11-12T05:40:36.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.069+0000 7f186649f700 1 -- 172.21.2.105:0/132707614 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f186005ff60 msgr2=0x7f1860140b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:36.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.069+0000 7f186649f700 1 --2- 172.21.2.105:0/132707614 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f186005ff60 0x7f1860140b40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f1860060d30 tx=0x7f185c006eb0).stop 2021-11-12T05:40:36.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.069+0000 7f186649f700 1 -- 172.21.2.105:0/132707614 shutdown_connections 2021-11-12T05:40:36.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.069+0000 7f186649f700 1 --2- 172.21.2.105:0/132707614 >> v2:172.21.2.115:3300/0 conn(0x7f186013a7d0 0x7f186013ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:36.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.069+0000 7f186649f700 1 --2- 172.21.2.105:0/132707614 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f186005ff60 0x7f1860140b40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:36.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.069+0000 7f186649f700 1 -- 172.21.2.105:0/132707614 >> 172.21.2.105:0/132707614 conn(0x7f18600608d0 msgr2=0x7f186005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:36.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.069+0000 7f186649f700 1 -- 172.21.2.105:0/132707614 shutdown_connections 2021-11-12T05:40:36.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.069+0000 7f186649f700 1 -- 172.21.2.105:0/132707614 wait complete. 2021-11-12T05:40:36.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.069+0000 7f186649f700 1 Processor -- start 2021-11-12T05:40:36.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.069+0000 7f186649f700 1 -- start start 2021-11-12T05:40:36.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.073+0000 7f186649f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f186005ff60 0x7f18600b1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:36.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.073+0000 7f186649f700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f18600b2a40 0x7f1860066ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:36.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.073+0000 7f186649f700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f186013a7d0 0x7f1860143d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:36.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.073+0000 7f186649f700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1860144250 con 0x7f186013a7d0 2021-11-12T05:40:36.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.073+0000 7f186649f700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18601444e0 con 0x7f18600b2a40 2021-11-12T05:40:36.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.073+0000 7f186649f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1860144780 con 0x7f186005ff60 2021-11-12T05:40:36.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.073+0000 7f1865c9e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f186013a7d0 0x7f1860143d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:36.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.073+0000 7f1865c9e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f186013a7d0 0x7f1860143d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42556/0 (socket says 172.21.2.105:42556) 2021-11-12T05:40:36.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.073+0000 7f1865c9e700 1 -- 172.21.2.105:0/4129597016 learned_addr learned my addr 172.21.2.105:0/4129597016 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:36.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.073+0000 7f1864c9c700 1 --2- 172.21.2.105:0/4129597016 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f18600b2a40 0x7f1860066ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:36.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.073+0000 7f186549d700 1 --2- 172.21.2.105:0/4129597016 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f186005ff60 0x7f18600b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:36.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.073+0000 7f1865c9e700 1 -- 172.21.2.105:0/4129597016 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f186005ff60 msgr2=0x7f18600b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:36.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.073+0000 7f1865c9e700 1 --2- 172.21.2.105:0/4129597016 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f186005ff60 0x7f18600b1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:36.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.073+0000 7f1865c9e700 1 -- 172.21.2.105:0/4129597016 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f18600b2a40 msgr2=0x7f1860066ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:36.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.073+0000 7f1865c9e700 1 --2- 172.21.2.105:0/4129597016 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f18600b2a40 0x7f1860066ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:36.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.073+0000 7f1865c9e700 1 -- 172.21.2.105:0/4129597016 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185c00b1e0 con 0x7f186013a7d0 2021-11-12T05:40:36.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.073+0000 7f1864c9c700 1 --2- 172.21.2.105:0/4129597016 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f18600b2a40 0x7f1860066ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:40:36.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.073+0000 7f1865c9e700 1 --2- 172.21.2.105:0/4129597016 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f186013a7d0 0x7f1860143d60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f18580032f0 tx=0x7f18580091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:36.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.073+0000 7f18527fc700 1 -- 172.21.2.105:0/4129597016 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f185800d4a0 con 0x7f186013a7d0 2021-11-12T05:40:36.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.073+0000 7f18527fc700 1 -- 172.21.2.105:0/4129597016 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185800d600 con 0x7f186013a7d0 2021-11-12T05:40:36.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.073+0000 7f18527fc700 1 -- 172.21.2.105:0/4129597016 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f185800d960 con 0x7f186013a7d0 2021-11-12T05:40:36.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.073+0000 7f186649f700 1 -- 172.21.2.105:0/4129597016 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1860153830 con 0x7f186013a7d0 2021-11-12T05:40:36.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.073+0000 7f186649f700 1 -- 172.21.2.105:0/4129597016 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1860153e70 con 0x7f186013a7d0 2021-11-12T05:40:36.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.073+0000 7f186649f700 1 -- 172.21.2.105:0/4129597016 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18601539c0 con 0x7f186013a7d0 2021-11-12T05:40:36.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.073+0000 7f18527fc700 1 -- 172.21.2.105:0/4129597016 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1858018030 con 0x7f186013a7d0 2021-11-12T05:40:36.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.073+0000 7f18527fc700 1 --2- 172.21.2.105:0/4129597016 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f18400534f0 0x7f18400559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:36.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.073+0000 7f18527fc700 1 -- 172.21.2.105:0/4129597016 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6311+0+0 (secure 0 0 0) 0x7f185806b460 con 0x7f186013a7d0 2021-11-12T05:40:36.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.073+0000 7f186549d700 1 --2- 172.21.2.105:0/4129597016 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f18400534f0 0x7f18400559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:36.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.073+0000 7f186549d700 1 --2- 172.21.2.105:0/4129597016 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f18400534f0 0x7f18400559b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f185c017000 tx=0x7f185c015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:36.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.077+0000 7f18527fc700 1 -- 172.21.2.105:0/4129597016 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1858042470 con 0x7f186013a7d0 2021-11-12T05:40:36.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:36.161+0000 7f186649f700 1 -- 172.21.2.105:0/4129597016 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f1860057350 con 0x7f186013a7d0 2021-11-12T05:40:37.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.013+0000 7f18527fc700 1 -- 172.21.2.105:0/4129597016 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 166+0+0 (secure 0 0 0) 0x7f1858045a90 con 0x7f186013a7d0 2021-11-12T05:40:37.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.013+0000 7f186649f700 1 -- 172.21.2.105:0/4129597016 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f18400534f0 msgr2=0x7f18400559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:37.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.013+0000 7f186649f700 1 --2- 172.21.2.105:0/4129597016 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f18400534f0 0x7f18400559b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f185c017000 tx=0x7f185c015000).stop 2021-11-12T05:40:37.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.013+0000 7f186649f700 1 -- 172.21.2.105:0/4129597016 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f186013a7d0 msgr2=0x7f1860143d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:37.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.013+0000 7f186649f700 1 --2- 172.21.2.105:0/4129597016 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f186013a7d0 0x7f1860143d60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f18580032f0 tx=0x7f18580091a0).stop 2021-11-12T05:40:37.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.013+0000 7f186649f700 1 -- 172.21.2.105:0/4129597016 shutdown_connections 2021-11-12T05:40:37.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.013+0000 7f186649f700 1 --2- 172.21.2.105:0/4129597016 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f18400534f0 0x7f18400559b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:37.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.013+0000 7f186649f700 1 --2- 172.21.2.105:0/4129597016 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f186013a7d0 0x7f1860143d60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:37.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.013+0000 7f186649f700 1 --2- 172.21.2.105:0/4129597016 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f18600b2a40 0x7f1860066ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:37.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.013+0000 7f186649f700 1 --2- 172.21.2.105:0/4129597016 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f186005ff60 0x7f18600b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:37.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.013+0000 7f186649f700 1 -- 172.21.2.105:0/4129597016 >> 172.21.2.105:0/4129597016 conn(0x7f18600608d0 msgr2=0x7f18600653c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:37.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.013+0000 7f186649f700 1 -- 172.21.2.105:0/4129597016 shutdown_connections 2021-11-12T05:40:37.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.013+0000 7f186649f700 1 -- 172.21.2.105:0/4129597016 wait complete. 2021-11-12T05:40:37.021 INFO:teuthology.orchestra.run.gibba005.stderr:set pool 4 allow_ec_overwrites to true 2021-11-12T05:40:37.025 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-12T05:40:37.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.073+0000 7fa1fcd0c700 1 Processor -- start 2021-11-12T05:40:37.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.073+0000 7fa1fcd0c700 1 -- start start 2021-11-12T05:40:37.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.073+0000 7fa1fcd0c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1f80ade80 0x7fa1f80601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:37.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.073+0000 7fa1fcd0c700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fa1f813a9c0 0x7fa1f813ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:37.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.073+0000 7fa1fcd0c700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f8066150 con 0x7fa1f805fdc0 2021-11-12T05:40:37.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.073+0000 7fa1fcd0c700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f8141fb0 con 0x7fa1f813a9c0 2021-11-12T05:40:37.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.073+0000 7fa1fcd0c700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f80663f0 con 0x7fa1f80ade80 2021-11-12T05:40:37.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.073+0000 7fa1f659c700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fa1f805fdc0 0x7fa1f8066730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:52956/0 (socket says 172.21.2.105:52956) 2021-11-12T05:40:37.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.073+0000 7fa1f659c700 1 -- 172.21.2.105:0/1689152391 learned_addr learned my addr 172.21.2.105:0/1689152391 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:37.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.073+0000 7fa1f559a700 1 -- 172.21.2.105:0/1689152391 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 502837941 0 0) 0x7fa1f8066150 con 0x7fa1f805fdc0 2021-11-12T05:40:37.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.073+0000 7fa1f559a700 1 -- 172.21.2.105:0/1689152391 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1dc003260 con 0x7fa1f805fdc0 2021-11-12T05:40:37.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f6d9d700 1 --2- 172.21.2.105:0/1689152391 >> v2:172.21.2.115:3300/0 conn(0x7fa1f813a9c0 0x7fa1f813ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:37.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f5d9b700 1 --2- 172.21.2.105:0/1689152391 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1f80ade80 0x7fa1f80601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:37.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f559a700 1 -- 172.21.2.105:0/1689152391 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 646900681 0 0) 0x7fa1dc003260 con 0x7fa1f805fdc0 2021-11-12T05:40:37.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f559a700 1 -- 172.21.2.105:0/1689152391 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1f80ade80 msgr2=0x7fa1f80601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:37.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f559a700 1 --2- 172.21.2.105:0/1689152391 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1f80ade80 0x7fa1f80601a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:37.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f559a700 1 -- 172.21.2.105:0/1689152391 >> v2:172.21.2.115:3300/0 conn(0x7fa1f813a9c0 msgr2=0x7fa1f813ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:37.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f559a700 1 --2- 172.21.2.105:0/1689152391 >> v2:172.21.2.115:3300/0 conn(0x7fa1f813a9c0 0x7fa1f813ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:37.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f559a700 1 -- 172.21.2.105:0/1689152391 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f8140fd0 con 0x7fa1f805fdc0 2021-11-12T05:40:37.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f559a700 1 -- 172.21.2.105:0/1689152391 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fa1e8001680 con 0x7fa1f805fdc0 2021-11-12T05:40:37.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f559a700 1 -- 172.21.2.105:0/1689152391 >> v1:172.21.2.105:6789/0 conn(0x7fa1f805fdc0 legacy=0x7fa1f8066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:37.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f559a700 1 --2- 172.21.2.105:0/1689152391 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1dc0037d0 0x7fa1dc003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:37.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f559a700 1 --2- 172.21.2.105:0/1689152391 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1f80ade80 0x7fa1dc004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:37.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f559a700 1 --2- 172.21.2.105:0/1689152391 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa1dc0049f0 0x7fa1dc004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:37.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f559a700 1 -- 172.21.2.105:0/1689152391 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f80663f0 con 0x7fa1dc0037d0 2021-11-12T05:40:37.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f559a700 1 -- 172.21.2.105:0/1689152391 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc00b800 con 0x7fa1dc0049f0 2021-11-12T05:40:37.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f559a700 1 -- 172.21.2.105:0/1689152391 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc00b9c0 con 0x7fa1f80ade80 2021-11-12T05:40:37.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f6d9d700 1 --2- 172.21.2.105:0/1689152391 >> v2:172.21.2.115:3300/0 conn(0x7fa1f813a9c0 0x7fa1f813ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:40:37.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f659c700 1 --2- 172.21.2.105:0/1689152391 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1dc0037d0 0x7fa1dc003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:37.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f5d9b700 1 --2- 172.21.2.105:0/1689152391 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1f80ade80 0x7fa1dc004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:37.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f659c700 1 -- 172.21.2.105:0/1689152391 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1f80ade80 msgr2=0x7fa1dc004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:37.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f659c700 1 --2- 172.21.2.105:0/1689152391 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1f80ade80 0x7fa1dc004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:37.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f659c700 1 -- 172.21.2.105:0/1689152391 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa1dc0049f0 msgr2=0x7fa1dc004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:37.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f659c700 1 --2- 172.21.2.105:0/1689152391 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa1dc0049f0 0x7fa1dc004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:37.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f659c700 1 -- 172.21.2.105:0/1689152391 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1dc003260 con 0x7fa1dc0037d0 2021-11-12T05:40:37.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f659c700 1 --2- 172.21.2.105:0/1689152391 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1dc0037d0 0x7fa1dc003bf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fa1e8001390 tx=0x7fa1f80662e0).ready entity=mon.0 client_cookie=f5d7315aae79a39d server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:37.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f559a700 1 -- 172.21.2.105:0/1689152391 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1e80070d0 con 0x7fa1dc0037d0 2021-11-12T05:40:37.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f559a700 1 -- 172.21.2.105:0/1689152391 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e8007230 con 0x7fa1dc0037d0 2021-11-12T05:40:37.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f559a700 1 -- 172.21.2.105:0/1689152391 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1e800c990 con 0x7fa1dc0037d0 2021-11-12T05:40:37.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1fcd0c700 1 -- 172.21.2.105:0/1689152391 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1dc0037d0 msgr2=0x7fa1dc003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:37.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1fcd0c700 1 --2- 172.21.2.105:0/1689152391 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1dc0037d0 0x7fa1dc003bf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fa1e8001390 tx=0x7fa1f80662e0).stop 2021-11-12T05:40:37.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f6d9d700 1 -- 172.21.2.105:0/1689152391 reap_dead start 2021-11-12T05:40:37.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1fcd0c700 1 -- 172.21.2.105:0/1689152391 shutdown_connections 2021-11-12T05:40:37.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1fcd0c700 1 -- 172.21.2.105:0/1689152391 >> 172.21.2.105:0/1689152391 conn(0x7fa1f80608d0 msgr2=0x7fa1f805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:37.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1fcd0c700 1 -- 172.21.2.105:0/1689152391 shutdown_connections 2021-11-12T05:40:37.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1fcd0c700 1 -- 172.21.2.105:0/1689152391 wait complete. 2021-11-12T05:40:37.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1fcd0c700 1 Processor -- start 2021-11-12T05:40:37.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1fcd0c700 1 -- start start 2021-11-12T05:40:37.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1fcd0c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1dc0037d0 0x7fa1f8145410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:37.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1fcd0c700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa1f8146bb0 0x7fa1f8061b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:37.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1fcd0c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1f8136980 0x7fa1f8136e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:37.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1fcd0c700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f80af130 con 0x7fa1dc0037d0 2021-11-12T05:40:37.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1fcd0c700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f8147940 con 0x7fa1f8146bb0 2021-11-12T05:40:37.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1fcd0c700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f8147be0 con 0x7fa1f8136980 2021-11-12T05:40:37.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f659c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1dc0037d0 0x7fa1f8145410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:37.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f659c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1dc0037d0 0x7fa1f8145410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42574/0 (socket says 172.21.2.105:42574) 2021-11-12T05:40:37.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f659c700 1 -- 172.21.2.105:0/2896587130 learned_addr learned my addr 172.21.2.105:0/2896587130 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:37.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f6d9d700 1 --2- 172.21.2.105:0/2896587130 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1f8136980 0x7fa1f8136e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:37.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f5d9b700 1 --2- 172.21.2.105:0/2896587130 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa1f8146bb0 0x7fa1f8061b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:37.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f659c700 1 -- 172.21.2.105:0/2896587130 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1f8136980 msgr2=0x7fa1f8136e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:37.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f659c700 1 --2- 172.21.2.105:0/2896587130 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1f8136980 0x7fa1f8136e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:37.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f659c700 1 -- 172.21.2.105:0/2896587130 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa1f8146bb0 msgr2=0x7fa1f8061b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:37.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f659c700 1 --2- 172.21.2.105:0/2896587130 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa1f8146bb0 0x7fa1f8061b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:37.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f659c700 1 -- 172.21.2.105:0/2896587130 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f8147e80 con 0x7fa1dc0037d0 2021-11-12T05:40:37.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1f659c700 1 --2- 172.21.2.105:0/2896587130 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1dc0037d0 0x7fa1f8145410 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fa1e8001390 tx=0x7fa1e8013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:37.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1e77fe700 1 -- 172.21.2.105:0/2896587130 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1e80070d0 con 0x7fa1dc0037d0 2021-11-12T05:40:37.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1e77fe700 1 -- 172.21.2.105:0/2896587130 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e8004730 con 0x7fa1dc0037d0 2021-11-12T05:40:37.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1fcd0c700 1 -- 172.21.2.105:0/2896587130 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f8062000 con 0x7fa1dc0037d0 2021-11-12T05:40:37.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1e77fe700 1 -- 172.21.2.105:0/2896587130 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1e8001bc0 con 0x7fa1dc0037d0 2021-11-12T05:40:37.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.077+0000 7fa1fcd0c700 1 -- 172.21.2.105:0/2896587130 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f80624d0 con 0x7fa1dc0037d0 2021-11-12T05:40:37.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.081+0000 7fa1fcd0c700 1 -- 172.21.2.105:0/2896587130 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1f8057350 con 0x7fa1dc0037d0 2021-11-12T05:40:37.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.081+0000 7fa1e77fe700 1 -- 172.21.2.105:0/2896587130 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa1e8028070 con 0x7fa1dc0037d0 2021-11-12T05:40:37.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.081+0000 7fa1e77fe700 1 --2- 172.21.2.105:0/2896587130 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa1d4053580 0x7fa1d4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:37.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.081+0000 7fa1e77fe700 1 -- 172.21.2.105:0/2896587130 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6311+0+0 (secure 0 0 0) 0x7fa1e806bf50 con 0x7fa1dc0037d0 2021-11-12T05:40:37.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.081+0000 7fa1f5d9b700 1 --2- 172.21.2.105:0/2896587130 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa1d4053580 0x7fa1d4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:37.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.081+0000 7fa1f5d9b700 1 --2- 172.21.2.105:0/2896587130 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa1d4053580 0x7fa1d4055a40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fa1ec00c000 tx=0x7fa1ec008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:37.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.081+0000 7fa1e77fe700 1 -- 172.21.2.105:0/2896587130 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa1e8042fc0 con 0x7fa1dc0037d0 2021-11-12T05:40:37.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.193+0000 7fa1fcd0c700 1 -- 172.21.2.105:0/2896587130 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fa1f80b04b0 con 0x7fa1dc0037d0 2021-11-12T05:40:37.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.201+0000 7fa1e77fe700 1 -- 172.21.2.105:0/2896587130 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 187+0+0 (secure 0 0 0) 0x7fa1e80465e0 con 0x7fa1dc0037d0 2021-11-12T05:40:37.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.201+0000 7fa1fcd0c700 1 -- 172.21.2.105:0/2896587130 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa1d4053580 msgr2=0x7fa1d4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:37.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.201+0000 7fa1fcd0c700 1 --2- 172.21.2.105:0/2896587130 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa1d4053580 0x7fa1d4055a40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fa1ec00c000 tx=0x7fa1ec008040).stop 2021-11-12T05:40:37.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.201+0000 7fa1fcd0c700 1 -- 172.21.2.105:0/2896587130 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1dc0037d0 msgr2=0x7fa1f8145410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:37.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.201+0000 7fa1fcd0c700 1 --2- 172.21.2.105:0/2896587130 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1dc0037d0 0x7fa1f8145410 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fa1e8001390 tx=0x7fa1e8013000).stop 2021-11-12T05:40:37.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.201+0000 7fa1fcd0c700 1 -- 172.21.2.105:0/2896587130 shutdown_connections 2021-11-12T05:40:37.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.201+0000 7fa1fcd0c700 1 --2- 172.21.2.105:0/2896587130 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa1d4053580 0x7fa1d4055a40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:37.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.201+0000 7fa1fcd0c700 1 --2- 172.21.2.105:0/2896587130 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1f8136980 0x7fa1f8136e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:37.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.201+0000 7fa1fcd0c700 1 --2- 172.21.2.105:0/2896587130 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa1f8146bb0 0x7fa1f8061b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:37.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.201+0000 7fa1fcd0c700 1 --2- 172.21.2.105:0/2896587130 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1dc0037d0 0x7fa1f8145410 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:37.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.201+0000 7fa1fcd0c700 1 -- 172.21.2.105:0/2896587130 >> 172.21.2.105:0/2896587130 conn(0x7fa1f80608d0 msgr2=0x7fa1f80b4580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:37.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.201+0000 7fa1fcd0c700 1 -- 172.21.2.105:0/2896587130 shutdown_connections 2021-11-12T05:40:37.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.201+0000 7fa1fcd0c700 1 -- 172.21.2.105:0/2896587130 wait complete. 2021-11-12T05:40:37.208 INFO:teuthology.orchestra.run.gibba005.stderr:new fs with metadata pool 3 and data pool 4 2021-11-12T05:40:37.213 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:40:37.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.257+0000 7f9265d73700 1 Processor -- start 2021-11-12T05:40:37.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.257+0000 7f9265d73700 1 -- start start 2021-11-12T05:40:37.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f9265d73700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f926014b2f0 0x7f92600af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:37.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f9265d73700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92600ac7b0 con 0x7f92600ad080 2021-11-12T05:40:37.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f9265d73700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92600ac9e0 con 0x7f92600ac280 2021-11-12T05:40:37.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f9265d73700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92601488a0 con 0x7f926014b2f0 2021-11-12T05:40:37.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925f7fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f92600ad080 0x7f926014abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:52986/0 (socket says 172.21.2.105:52986) 2021-11-12T05:40:37.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925f7fe700 1 -- 172.21.2.105:0/2304929889 learned_addr learned my addr 172.21.2.105:0/2304929889 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:37.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925ffff700 1 --2- 172.21.2.105:0/2304929889 >> v2:172.21.2.115:3300/0 conn(0x7f926014b2f0 0x7f92600af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:37.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925e7fc700 1 -- 172.21.2.105:0/2304929889 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 506113657 0 0) 0x7f92600ac7b0 con 0x7f92600ad080 2021-11-12T05:40:37.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925e7fc700 1 -- 172.21.2.105:0/2304929889 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9240003260 con 0x7f92600ad080 2021-11-12T05:40:37.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925e7fc700 1 -- 172.21.2.105:0/2304929889 <== mon.1 v1:172.21.2.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3418745756 0 0) 0x7f92600ac9e0 con 0x7f92600ac280 2021-11-12T05:40:37.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925e7fc700 1 -- 172.21.2.105:0/2304929889 --> v1:172.21.2.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92600ac7b0 con 0x7f92600ac280 2021-11-12T05:40:37.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925e7fc700 1 -- 172.21.2.105:0/2304929889 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1224728651 0 0) 0x7f9240003260 con 0x7f92600ad080 2021-11-12T05:40:37.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925e7fc700 1 -- 172.21.2.105:0/2304929889 >> v2:172.21.2.115:3300/0 conn(0x7f926014b2f0 msgr2=0x7f92600af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:37.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925e7fc700 1 --2- 172.21.2.105:0/2304929889 >> v2:172.21.2.115:3300/0 conn(0x7f926014b2f0 0x7f92600af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:37.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925e7fc700 1 -- 172.21.2.105:0/2304929889 >> v1:172.21.2.115:6789/0 conn(0x7f92600ac280 legacy=0x7f9260147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:37.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925e7fc700 1 -- 172.21.2.105:0/2304929889 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92600b0b30 con 0x7f92600ad080 2021-11-12T05:40:37.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925e7fc700 1 -- 172.21.2.105:0/2304929889 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f9250001660 con 0x7f92600ad080 2021-11-12T05:40:37.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925e7fc700 1 -- 172.21.2.105:0/2304929889 >> v1:172.21.2.105:6789/0 conn(0x7f92600ad080 legacy=0x7f926014abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:37.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925e7fc700 1 --2- 172.21.2.105:0/2304929889 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9240003930 0x7f9240003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:37.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925e7fc700 1 --2- 172.21.2.105:0/2304929889 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9240004500 0x7f9240004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:37.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925e7fc700 1 --2- 172.21.2.105:0/2304929889 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9240004e70 0x7f924000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:37.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925e7fc700 1 -- 172.21.2.105:0/2304929889 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92601488a0 con 0x7f9240003930 2021-11-12T05:40:37.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925e7fc700 1 -- 172.21.2.105:0/2304929889 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924000bd20 con 0x7f9240004500 2021-11-12T05:40:37.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925e7fc700 1 -- 172.21.2.105:0/2304929889 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f924000bee0 con 0x7f9240004e70 2021-11-12T05:40:37.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925f7fe700 1 --2- 172.21.2.105:0/2304929889 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9240003930 0x7f9240003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:37.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925f7fe700 1 -- 172.21.2.105:0/2304929889 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9240004e70 msgr2=0x7f924000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:37.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925f7fe700 1 --2- 172.21.2.105:0/2304929889 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9240004e70 0x7f924000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:37.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925f7fe700 1 -- 172.21.2.105:0/2304929889 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9240004500 msgr2=0x7f9240004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:37.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925f7fe700 1 --2- 172.21.2.105:0/2304929889 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9240004500 0x7f9240004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:37.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925f7fe700 1 -- 172.21.2.105:0/2304929889 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9240003260 con 0x7f9240003930 2021-11-12T05:40:37.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925ffff700 1 -- 172.21.2.105:0/2304929889 reap_dead start 2021-11-12T05:40:37.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925f7fe700 1 --2- 172.21.2.105:0/2304929889 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9240003930 0x7f9240003d30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f9250001430 tx=0x7f92600ada20).ready entity=mon.0 client_cookie=6e4d45fc6d2829e0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:37.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925e7fc700 1 -- 172.21.2.105:0/2304929889 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92500070d0 con 0x7f9240003930 2021-11-12T05:40:37.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925e7fc700 1 -- 172.21.2.105:0/2304929889 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9250007230 con 0x7f9240003930 2021-11-12T05:40:37.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925e7fc700 1 -- 172.21.2.105:0/2304929889 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f925000c8f0 con 0x7f9240003930 2021-11-12T05:40:37.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f9265d73700 1 -- 172.21.2.105:0/2304929889 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9240003930 msgr2=0x7f9240003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:37.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f9265d73700 1 --2- 172.21.2.105:0/2304929889 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9240003930 0x7f9240003d30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f9250001430 tx=0x7f92600ada20).stop 2021-11-12T05:40:37.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f9265d73700 1 -- 172.21.2.105:0/2304929889 shutdown_connections 2021-11-12T05:40:37.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f9265d73700 1 --2- 172.21.2.105:0/2304929889 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9240003930 0x7f9240003d30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:37.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f9265d73700 1 -- 172.21.2.105:0/2304929889 >> 172.21.2.105:0/2304929889 conn(0x7f92600b5370 msgr2=0x7f92600b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:37.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f9265d73700 1 -- 172.21.2.105:0/2304929889 shutdown_connections 2021-11-12T05:40:37.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f9265d73700 1 -- 172.21.2.105:0/2304929889 wait complete. 2021-11-12T05:40:37.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f9265d73700 1 Processor -- start 2021-11-12T05:40:37.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f9265d73700 1 -- start start 2021-11-12T05:40:37.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f9265d73700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9240003930 0x7f92600aa980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:37.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f9265d73700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f92600603c0 0x7f926015a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:37.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f9265d73700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9260063890 0x7f9260063d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:37.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f9265d73700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9260060820 con 0x7f9240003930 2021-11-12T05:40:37.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f9265d73700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9260063460 con 0x7f92600603c0 2021-11-12T05:40:37.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f9265d73700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9260064200 con 0x7f9260063890 2021-11-12T05:40:37.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925f7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9240003930 0x7f92600aa980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:37.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925f7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9240003930 0x7f92600aa980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42602/0 (socket says 172.21.2.105:42602) 2021-11-12T05:40:37.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925f7fe700 1 -- 172.21.2.105:0/1286254023 learned_addr learned my addr 172.21.2.105:0/1286254023 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:37.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925f7fe700 1 -- 172.21.2.105:0/1286254023 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9260063890 msgr2=0x7f9260063d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:37.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925f7fe700 1 --2- 172.21.2.105:0/1286254023 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9260063890 0x7f9260063d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:37.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925f7fe700 1 -- 172.21.2.105:0/1286254023 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f92600603c0 msgr2=0x7f926015a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:37.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925f7fe700 1 --2- 172.21.2.105:0/1286254023 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f92600603c0 0x7f926015a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:37.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.261+0000 7f925f7fe700 1 -- 172.21.2.105:0/1286254023 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92600a9780 con 0x7f9240003930 2021-11-12T05:40:37.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.265+0000 7f925f7fe700 1 --2- 172.21.2.105:0/1286254023 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9240003930 0x7f92600aa980 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f9260063770 tx=0x7f9250015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:37.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.265+0000 7f925cff9700 1 -- 172.21.2.105:0/1286254023 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9250001ac0 con 0x7f9240003930 2021-11-12T05:40:37.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.265+0000 7f925cff9700 1 -- 172.21.2.105:0/1286254023 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9250000e90 con 0x7f9240003930 2021-11-12T05:40:37.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.265+0000 7f9265d73700 1 -- 172.21.2.105:0/1286254023 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92600a9a20 con 0x7f9240003930 2021-11-12T05:40:37.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.265+0000 7f925cff9700 1 -- 172.21.2.105:0/1286254023 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9250004900 con 0x7f9240003930 2021-11-12T05:40:37.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.265+0000 7f9265d73700 1 -- 172.21.2.105:0/1286254023 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92600ab920 con 0x7f9240003930 2021-11-12T05:40:37.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.265+0000 7f9265d73700 1 -- 172.21.2.105:0/1286254023 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92600b1440 con 0x7f9240003930 2021-11-12T05:40:37.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.265+0000 7f925cff9700 1 -- 172.21.2.105:0/1286254023 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9250025070 con 0x7f9240003930 2021-11-12T05:40:37.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.265+0000 7f925cff9700 1 --2- 172.21.2.105:0/1286254023 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9244053610 0x7f9244055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:37.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.265+0000 7f925cff9700 1 -- 172.21.2.105:0/1286254023 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f925006be40 con 0x7f9240003930 2021-11-12T05:40:37.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.265+0000 7f925effd700 1 --2- 172.21.2.105:0/1286254023 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9244053610 0x7f9244055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:37.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.265+0000 7f925effd700 1 --2- 172.21.2.105:0/1286254023 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9244053610 0x7f9244055ad0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f9248001110 tx=0x7f92480077b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:37.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.265+0000 7f925cff9700 1 -- 172.21.2.105:0/1286254023 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9250042d30 con 0x7f9240003930 2021-11-12T05:40:37.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.349+0000 7f9265d73700 1 -- 172.21.2.105:0/1286254023 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9260057350 con 0x7f9240003930 2021-11-12T05:40:37.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.349+0000 7f925cff9700 1 -- 172.21.2.105:0/1286254023 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16312 (secure 0 0 0) 0x7f9250046350 con 0x7f9240003930 2021-11-12T05:40:37.358 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:40:37.359 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":24,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:40:37.198480+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:40:32.786926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-12T05:40:35.006506+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:40:37.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.353+0000 7f9265d73700 1 -- 172.21.2.105:0/1286254023 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9244053610 msgr2=0x7f9244055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:37.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.353+0000 7f9265d73700 1 --2- 172.21.2.105:0/1286254023 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9244053610 0x7f9244055ad0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f9248001110 tx=0x7f92480077b0).stop 2021-11-12T05:40:37.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.353+0000 7f9265d73700 1 -- 172.21.2.105:0/1286254023 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9240003930 msgr2=0x7f92600aa980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:37.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.353+0000 7f9265d73700 1 --2- 172.21.2.105:0/1286254023 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9240003930 0x7f92600aa980 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f9260063770 tx=0x7f9250015000).stop 2021-11-12T05:40:37.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.353+0000 7f9265d73700 1 -- 172.21.2.105:0/1286254023 shutdown_connections 2021-11-12T05:40:37.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.353+0000 7f9265d73700 1 --2- 172.21.2.105:0/1286254023 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9244053610 0x7f9244055ad0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:37.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.353+0000 7f9265d73700 1 --2- 172.21.2.105:0/1286254023 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9260063890 0x7f9260063d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:37.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.353+0000 7f9265d73700 1 --2- 172.21.2.105:0/1286254023 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f92600603c0 0x7f926015a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:37.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.353+0000 7f9265d73700 1 --2- 172.21.2.105:0/1286254023 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9240003930 0x7f92600aa980 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:37.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.353+0000 7f9265d73700 1 -- 172.21.2.105:0/1286254023 >> 172.21.2.105:0/1286254023 conn(0x7f92600b5370 msgr2=0x7f9260144360 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:37.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.353+0000 7f9265d73700 1 -- 172.21.2.105:0/1286254023 shutdown_connections 2021-11-12T05:40:37.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.353+0000 7f9265d73700 1 -- 172.21.2.105:0/1286254023 wait complete. 2021-11-12T05:40:37.364 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:40:37.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff74b528700 1 Processor -- start 2021-11-12T05:40:37.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff74b528700 1 -- start start 2021-11-12T05:40:37.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff74b528700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff7440b2940 0x7ff744142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:37.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff74b528700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff7440b0780 0x7ff7441432b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:37.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff74b528700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7440b2d20 con 0x7ff7440b0cc0 2021-11-12T05:40:37.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff74b528700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7440b1fc0 con 0x7ff7440b0780 2021-11-12T05:40:37.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff74b528700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7440b15e0 con 0x7ff7440b2940 2021-11-12T05:40:37.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff748ac3700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff7440b0780 0x7ff7441432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:37.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff748ac3700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff7440b0780 0x7ff7441432b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42612/0 (socket says 172.21.2.105:42612) 2021-11-12T05:40:37.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff748ac3700 1 -- 172.21.2.105:0/4158810605 learned_addr learned my addr 172.21.2.105:0/4158810605 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:37.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff748ac3700 1 -- 172.21.2.105:0/4158810605 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff7440b2940 msgr2=0x7ff744142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:37.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff748ac3700 1 --2- 172.21.2.105:0/4158810605 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff7440b2940 0x7ff744142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:37.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff748ac3700 1 -- 172.21.2.105:0/4158810605 >> v1:172.21.2.115:6789/0 conn(0x7ff7440b0cc0 legacy=0x7ff74413fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:37.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff748ac3700 1 -- 172.21.2.105:0/4158810605 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7440b1880 con 0x7ff7440b0780 2021-11-12T05:40:37.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff748ac3700 1 --2- 172.21.2.105:0/4158810605 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff7440b0780 0x7ff7441432b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7ff744060ba0 tx=0x7ff73c009290).ready entity=mon.0 client_cookie=23c281acde956957 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:37.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff733fff700 1 -- 172.21.2.105:0/4158810605 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff73c00ba50 con 0x7ff7440b0780 2021-11-12T05:40:37.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff733fff700 1 -- 172.21.2.105:0/4158810605 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73c00bbb0 con 0x7ff7440b0780 2021-11-12T05:40:37.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff733fff700 1 -- 172.21.2.105:0/4158810605 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff73c010470 con 0x7ff7440b0780 2021-11-12T05:40:37.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff74b528700 1 -- 172.21.2.105:0/4158810605 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff7440b0780 msgr2=0x7ff7441432b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:37.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff74b528700 1 --2- 172.21.2.105:0/4158810605 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff7440b0780 0x7ff7441432b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7ff744060ba0 tx=0x7ff73c009290).stop 2021-11-12T05:40:37.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff74b528700 1 -- 172.21.2.105:0/4158810605 shutdown_connections 2021-11-12T05:40:37.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff74b528700 1 --2- 172.21.2.105:0/4158810605 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff7440b0780 0x7ff7441432b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:37.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff74b528700 1 --2- 172.21.2.105:0/4158810605 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff7440b2940 0x7ff744142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:37.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff74b528700 1 -- 172.21.2.105:0/4158810605 >> 172.21.2.105:0/4158810605 conn(0x7ff744068440 msgr2=0x7ff744062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:37.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff74b528700 1 -- 172.21.2.105:0/4158810605 shutdown_connections 2021-11-12T05:40:37.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff74b528700 1 -- 172.21.2.105:0/4158810605 wait complete. 2021-11-12T05:40:37.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff74b528700 1 Processor -- start 2021-11-12T05:40:37.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff74b528700 1 -- start start 2021-11-12T05:40:37.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff74b528700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff7440b0780 0x7ff744066770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:37.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff74b528700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff7440b0cc0 0x7ff74413ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:37.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff74b528700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff7440b2940 0x7ff74413f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:37.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff74b528700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff744146bc0 con 0x7ff7440b2940 2021-11-12T05:40:37.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff74b528700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff744141550 con 0x7ff7440b0780 2021-11-12T05:40:37.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff74b528700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7441417f0 con 0x7ff7440b0cc0 2021-11-12T05:40:37.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff749ac5700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff7440b2940 0x7ff74413f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:37.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff749ac5700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff7440b2940 0x7ff74413f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42620/0 (socket says 172.21.2.105:42620) 2021-11-12T05:40:37.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff749ac5700 1 -- 172.21.2.105:0/1777015930 learned_addr learned my addr 172.21.2.105:0/1777015930 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:37.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff749ac5700 1 -- 172.21.2.105:0/1777015930 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff7440b0cc0 msgr2=0x7ff74413ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:37.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff749ac5700 1 --2- 172.21.2.105:0/1777015930 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff7440b0cc0 0x7ff74413ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:37.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff749ac5700 1 -- 172.21.2.105:0/1777015930 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff7440b0780 msgr2=0x7ff744066770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:37.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff749ac5700 1 --2- 172.21.2.105:0/1777015930 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff7440b0780 0x7ff744066770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:37.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff749ac5700 1 -- 172.21.2.105:0/1777015930 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff73c009530 con 0x7ff7440b2940 2021-11-12T05:40:37.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.413+0000 7ff749ac5700 1 --2- 172.21.2.105:0/1777015930 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff7440b2940 0x7ff74413f280 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7ff740002f90 tx=0x7ff740006d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:37.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.417+0000 7ff7327fc700 1 -- 172.21.2.105:0/1777015930 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff740012410 con 0x7ff7440b2940 2021-11-12T05:40:37.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.417+0000 7ff7327fc700 1 -- 172.21.2.105:0/1777015930 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff740012570 con 0x7ff7440b2940 2021-11-12T05:40:37.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.417+0000 7ff74b528700 1 -- 172.21.2.105:0/1777015930 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff744141a90 con 0x7ff7440b2940 2021-11-12T05:40:37.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.417+0000 7ff7327fc700 1 -- 172.21.2.105:0/1777015930 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7400128d0 con 0x7ff7440b2940 2021-11-12T05:40:37.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.417+0000 7ff74b528700 1 -- 172.21.2.105:0/1777015930 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff744141f30 con 0x7ff7440b2940 2021-11-12T05:40:37.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.417+0000 7ff74b528700 1 -- 172.21.2.105:0/1777015930 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff744141c20 con 0x7ff7440b2940 2021-11-12T05:40:37.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.417+0000 7ff7327fc700 1 -- 172.21.2.105:0/1777015930 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff74000f030 con 0x7ff7440b2940 2021-11-12T05:40:37.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.417+0000 7ff7327fc700 1 --2- 172.21.2.105:0/1777015930 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff7240536a0 0x7ff724055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:37.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.417+0000 7ff7327fc700 1 -- 172.21.2.105:0/1777015930 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6427+0+0 (secure 0 0 0) 0x7ff74006b7d0 con 0x7ff7440b2940 2021-11-12T05:40:37.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.417+0000 7ff7492c4700 1 --2- 172.21.2.105:0/1777015930 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff7240536a0 0x7ff724055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:37.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.417+0000 7ff7492c4700 1 --2- 172.21.2.105:0/1777015930 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff7240536a0 0x7ff724055b60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7ff734002f70 tx=0x7ff7340069e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:37.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.417+0000 7ff7327fc700 1 -- 172.21.2.105:0/1777015930 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff740042660 con 0x7ff7440b2940 2021-11-12T05:40:37.504 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.501+0000 7ff74b528700 1 -- 172.21.2.105:0/1777015930 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7440b1b20 con 0x7ff7440b2940 2021-11-12T05:40:37.505 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.501+0000 7ff7327fc700 1 -- 172.21.2.105:0/1777015930 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16312 (secure 0 0 0) 0x7ff740045c80 con 0x7ff7440b2940 2021-11-12T05:40:37.506 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:40:37.506 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":24,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:40:37.198480+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:40:32.786926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-12T05:40:35.006506+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:40:37.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.501+0000 7ff74b528700 1 -- 172.21.2.105:0/1777015930 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff7240536a0 msgr2=0x7ff724055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:37.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.501+0000 7ff74b528700 1 --2- 172.21.2.105:0/1777015930 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff7240536a0 0x7ff724055b60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7ff734002f70 tx=0x7ff7340069e0).stop 2021-11-12T05:40:37.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.501+0000 7ff74b528700 1 -- 172.21.2.105:0/1777015930 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff7440b2940 msgr2=0x7ff74413f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:37.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.501+0000 7ff74b528700 1 --2- 172.21.2.105:0/1777015930 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff7440b2940 0x7ff74413f280 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7ff740002f90 tx=0x7ff740006d70).stop 2021-11-12T05:40:37.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.501+0000 7ff74b528700 1 -- 172.21.2.105:0/1777015930 shutdown_connections 2021-11-12T05:40:37.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.501+0000 7ff74b528700 1 --2- 172.21.2.105:0/1777015930 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff7240536a0 0x7ff724055b60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:37.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.501+0000 7ff74b528700 1 --2- 172.21.2.105:0/1777015930 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff7440b2940 0x7ff74413f280 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:37.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.501+0000 7ff74b528700 1 --2- 172.21.2.105:0/1777015930 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff7440b0cc0 0x7ff74413ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:37.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.501+0000 7ff74b528700 1 --2- 172.21.2.105:0/1777015930 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff7440b0780 0x7ff744066770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:37.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.501+0000 7ff74b528700 1 -- 172.21.2.105:0/1777015930 >> 172.21.2.105:0/1777015930 conn(0x7ff744068440 msgr2=0x7ff7440b4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:37.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.501+0000 7ff74b528700 1 -- 172.21.2.105:0/1777015930 shutdown_connections 2021-11-12T05:40:37.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.501+0000 7ff74b528700 1 -- 172.21.2.105:0/1777015930 wait complete. 2021-11-12T05:40:37.513 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-12T05:40:37.565 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.561+0000 7f9391792700 1 Processor -- start 2021-11-12T05:40:37.566 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.561+0000 7f9391792700 1 -- start start 2021-11-12T05:40:37.566 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.561+0000 7f9391792700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f938c0b7b00 0x7f938c140d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:37.566 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.561+0000 7f9391792700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f938c0ae090 0x7f938c0b2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:37.566 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.561+0000 7f9391792700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f938c0b2f00 0x7f938c144390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:37.567 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.561+0000 7f9391792700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f938c0b7ee0 con 0x7f938c0b7b00 2021-11-12T05:40:37.567 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.561+0000 7f9391792700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f938c0b2030 con 0x7f938c0ae090 2021-11-12T05:40:37.567 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.561+0000 7f9391792700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f938c0b22d0 con 0x7f938c0b2f00 2021-11-12T05:40:37.567 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.561+0000 7f938affd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f938c0b7b00 0x7f938c140d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:37.568 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.561+0000 7f938affd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f938c0b7b00 0x7f938c140d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42624/0 (socket says 172.21.2.105:42624) 2021-11-12T05:40:37.568 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.561+0000 7f938affd700 1 -- 172.21.2.105:0/2337832928 learned_addr learned my addr 172.21.2.105:0/2337832928 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:37.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.561+0000 7f938affd700 1 -- 172.21.2.105:0/2337832928 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f938c0b2f00 msgr2=0x7f938c144390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:40:37.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.561+0000 7f938affd700 1 --2- 172.21.2.105:0/2337832928 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f938c0b2f00 0x7f938c144390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:37.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.561+0000 7f938affd700 1 -- 172.21.2.105:0/2337832928 >> v2:172.21.2.115:3300/0 conn(0x7f938c0ae090 msgr2=0x7f938c0b2a10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:40:37.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.561+0000 7f938affd700 1 --2- 172.21.2.105:0/2337832928 >> v2:172.21.2.115:3300/0 conn(0x7f938c0ae090 0x7f938c0b2a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:37.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.561+0000 7f938affd700 1 -- 172.21.2.105:0/2337832928 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938c0b2570 con 0x7f938c0b7b00 2021-11-12T05:40:37.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.561+0000 7f938affd700 1 --2- 172.21.2.105:0/2337832928 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f938c0b7b00 0x7f938c140d80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f9380002f70 tx=0x7f9380006eb0).ready entity=mon.0 client_cookie=1e64aadf4c8a23ef server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:37.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.561+0000 7f9389ffb700 1 -- 172.21.2.105:0/2337832928 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9380010b60 con 0x7f938c0b7b00 2021-11-12T05:40:37.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.561+0000 7f9389ffb700 1 -- 172.21.2.105:0/2337832928 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9380000e90 con 0x7f938c0b7b00 2021-11-12T05:40:37.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.561+0000 7f9389ffb700 1 -- 172.21.2.105:0/2337832928 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93800183d0 con 0x7f938c0b7b00 2021-11-12T05:40:37.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.561+0000 7f9391792700 1 -- 172.21.2.105:0/2337832928 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f938c0b7b00 msgr2=0x7f938c140d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:37.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.561+0000 7f9391792700 1 --2- 172.21.2.105:0/2337832928 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f938c0b7b00 0x7f938c140d80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f9380002f70 tx=0x7f9380006eb0).stop 2021-11-12T05:40:37.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.561+0000 7f9391792700 1 -- 172.21.2.105:0/2337832928 shutdown_connections 2021-11-12T05:40:37.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.561+0000 7f9391792700 1 --2- 172.21.2.105:0/2337832928 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f938c0b2f00 0x7f938c144390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:37.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.561+0000 7f9391792700 1 --2- 172.21.2.105:0/2337832928 >> v2:172.21.2.115:3300/0 conn(0x7f938c0ae090 0x7f938c0b2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:37.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.561+0000 7f9391792700 1 --2- 172.21.2.105:0/2337832928 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f938c0b7b00 0x7f938c140d80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:37.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.561+0000 7f9391792700 1 -- 172.21.2.105:0/2337832928 >> 172.21.2.105:0/2337832928 conn(0x7f938c0608d0 msgr2=0x7f938c05c490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:37.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.561+0000 7f9391792700 1 -- 172.21.2.105:0/2337832928 shutdown_connections 2021-11-12T05:40:37.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.561+0000 7f9391792700 1 -- 172.21.2.105:0/2337832928 wait complete. 2021-11-12T05:40:37.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.565+0000 7f9391792700 1 Processor -- start 2021-11-12T05:40:37.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.565+0000 7f9391792700 1 -- start start 2021-11-12T05:40:37.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.565+0000 7f9391792700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f938c0ae090 0x7f938c0af8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:37.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.565+0000 7f9391792700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f938c0b2f00 0x7f938c140430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:37.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.565+0000 7f9391792700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f938c0b7b00 0x7f938c140920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:37.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.565+0000 7f9391792700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c14efb0 con 0x7f938c0ae090 2021-11-12T05:40:37.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.565+0000 7f9391792700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c0b00e0 con 0x7f938c0b7b00 2021-11-12T05:40:37.586 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.565+0000 7f9391792700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f938c0b0380 con 0x7f938c0b2f00 2021-11-12T05:40:37.586 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.565+0000 7f938affd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f938c0ae090 0x7f938c0af8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:37.586 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.565+0000 7f938affd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f938c0ae090 0x7f938c0af8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42632/0 (socket says 172.21.2.105:42632) 2021-11-12T05:40:37.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.565+0000 7f938affd700 1 -- 172.21.2.105:0/2693138507 learned_addr learned my addr 172.21.2.105:0/2693138507 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:37.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.565+0000 7f938affd700 1 -- 172.21.2.105:0/2693138507 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f938c0b2f00 msgr2=0x7f938c140430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:37.588 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.565+0000 7f938affd700 1 --2- 172.21.2.105:0/2693138507 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f938c0b2f00 0x7f938c140430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:37.588 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.565+0000 7f938affd700 1 -- 172.21.2.105:0/2693138507 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f938c0b7b00 msgr2=0x7f938c140920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:37.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.565+0000 7f938affd700 1 --2- 172.21.2.105:0/2693138507 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f938c0b7b00 0x7f938c140920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:37.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.565+0000 7f938affd700 1 -- 172.21.2.105:0/2693138507 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938000b1e0 con 0x7f938c0ae090 2021-11-12T05:40:37.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.565+0000 7f938affd700 1 --2- 172.21.2.105:0/2693138507 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f938c0ae090 0x7f938c0af8c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f9380002f70 tx=0x7f9380017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:37.590 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.565+0000 7f937bfff700 1 -- 172.21.2.105:0/2693138507 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9380019cd0 con 0x7f938c0ae090 2021-11-12T05:40:37.590 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.565+0000 7f937bfff700 1 -- 172.21.2.105:0/2693138507 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9380019e30 con 0x7f938c0ae090 2021-11-12T05:40:37.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.565+0000 7f9391792700 1 -- 172.21.2.105:0/2693138507 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f938c0afdb0 con 0x7f938c0ae090 2021-11-12T05:40:37.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.565+0000 7f937bfff700 1 -- 172.21.2.105:0/2693138507 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9380025640 con 0x7f938c0ae090 2021-11-12T05:40:37.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.565+0000 7f9391792700 1 -- 172.21.2.105:0/2693138507 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f938c14eaa0 con 0x7f938c0ae090 2021-11-12T05:40:37.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.565+0000 7f9391792700 1 -- 172.21.2.105:0/2693138507 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f938c0b0540 con 0x7f938c0ae090 2021-11-12T05:40:37.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.565+0000 7f937bfff700 1 -- 172.21.2.105:0/2693138507 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9380022070 con 0x7f938c0ae090 2021-11-12T05:40:37.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.565+0000 7f937bfff700 1 --2- 172.21.2.105:0/2693138507 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f93680536a0 0x7f9368055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:37.594 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.565+0000 7f937bfff700 1 -- 172.21.2.105:0/2693138507 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f9380070e90 con 0x7f938c0ae090 2021-11-12T05:40:37.594 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.565+0000 7f938a7fc700 1 --2- 172.21.2.105:0/2693138507 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f93680536a0 0x7f9368055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:37.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.565+0000 7f938a7fc700 1 --2- 172.21.2.105:0/2693138507 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f93680536a0 0x7f9368055b60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f937c002fb0 tx=0x7f937c0069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:37.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.569+0000 7f937bfff700 1 -- 172.21.2.105:0/2693138507 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9380047d80 con 0x7f938c0ae090 2021-11-12T05:40:37.680 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:37.677+0000 7f9391792700 1 -- 172.21.2.105:0/2693138507 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f938c057350 con 0x7f938c0ae090 2021-11-12T05:40:38.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.209+0000 7f937bfff700 1 -- 172.21.2.105:0/2693138507 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f938002a030 con 0x7f938c0ae090 2021-11-12T05:40:38.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.209+0000 7f9391792700 1 -- 172.21.2.105:0/2693138507 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f93680536a0 msgr2=0x7f9368055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:38.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.209+0000 7f9391792700 1 --2- 172.21.2.105:0/2693138507 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f93680536a0 0x7f9368055b60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f937c002fb0 tx=0x7f937c0069b0).stop 2021-11-12T05:40:38.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.209+0000 7f9391792700 1 -- 172.21.2.105:0/2693138507 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f938c0ae090 msgr2=0x7f938c0af8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:38.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.209+0000 7f9391792700 1 --2- 172.21.2.105:0/2693138507 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f938c0ae090 0x7f938c0af8c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f9380002f70 tx=0x7f9380017000).stop 2021-11-12T05:40:38.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.209+0000 7f9391792700 1 -- 172.21.2.105:0/2693138507 shutdown_connections 2021-11-12T05:40:38.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.209+0000 7f9391792700 1 --2- 172.21.2.105:0/2693138507 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f93680536a0 0x7f9368055b60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:38.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.209+0000 7f9391792700 1 --2- 172.21.2.105:0/2693138507 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f938c0b7b00 0x7f938c140920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:38.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.209+0000 7f9391792700 1 --2- 172.21.2.105:0/2693138507 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f938c0b2f00 0x7f938c140430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:38.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.209+0000 7f9391792700 1 --2- 172.21.2.105:0/2693138507 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f938c0ae090 0x7f938c0af8c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:38.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.209+0000 7f9391792700 1 -- 172.21.2.105:0/2693138507 >> 172.21.2.105:0/2693138507 conn(0x7f938c0608d0 msgr2=0x7f938c05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:38.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.209+0000 7f9391792700 1 -- 172.21.2.105:0/2693138507 shutdown_connections 2021-11-12T05:40:38.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.209+0000 7f9391792700 1 -- 172.21.2.105:0/2693138507 wait complete. 2021-11-12T05:40:38.219 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:40:38.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.265+0000 7fd133141700 1 Processor -- start 2021-11-12T05:40:38.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.265+0000 7fd133141700 1 -- start start 2021-11-12T05:40:38.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.265+0000 7fd133141700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd12c05fdc0 0x7fd12c0601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:38.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.265+0000 7fd133141700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd12c063030 con 0x7fd12c0b1cf0 2021-11-12T05:40:38.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.265+0000 7fd133141700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd12c063290 con 0x7fd12c0ae2a0 2021-11-12T05:40:38.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.265+0000 7fd133141700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd12c061650 con 0x7fd12c05fdc0 2021-11-12T05:40:38.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.265+0000 7fd132940700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fd12c0b1cf0 0x7fd12c1436a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:53036/0 (socket says 172.21.2.105:53036) 2021-11-12T05:40:38.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.265+0000 7fd132940700 1 -- 172.21.2.105:0/923014082 learned_addr learned my addr 172.21.2.105:0/923014082 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:38.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.265+0000 7fd13213f700 1 --2- 172.21.2.105:0/923014082 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd12c05fdc0 0x7fd12c0601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:38.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.265+0000 7fd13113d700 1 -- 172.21.2.105:0/923014082 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 9243696 0 0) 0x7fd12c063030 con 0x7fd12c0b1cf0 2021-11-12T05:40:38.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.265+0000 7fd13113d700 1 -- 172.21.2.105:0/923014082 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd114003260 con 0x7fd12c0b1cf0 2021-11-12T05:40:38.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.265+0000 7fd13113d700 1 -- 172.21.2.105:0/923014082 <== mon.1 v1:172.21.2.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 181846905 0 0) 0x7fd12c063290 con 0x7fd12c0ae2a0 2021-11-12T05:40:38.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.265+0000 7fd13113d700 1 -- 172.21.2.105:0/923014082 --> v1:172.21.2.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd12c063030 con 0x7fd12c0ae2a0 2021-11-12T05:40:38.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.265+0000 7fd13113d700 1 -- 172.21.2.105:0/923014082 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 546923419 0 0) 0x7fd114003260 con 0x7fd12c0b1cf0 2021-11-12T05:40:38.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.265+0000 7fd13113d700 1 -- 172.21.2.105:0/923014082 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd12c05fdc0 msgr2=0x7fd12c0601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:38.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.265+0000 7fd13113d700 1 --2- 172.21.2.105:0/923014082 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd12c05fdc0 0x7fd12c0601a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:38.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.265+0000 7fd13113d700 1 -- 172.21.2.105:0/923014082 >> v1:172.21.2.115:6789/0 conn(0x7fd12c0ae2a0 legacy=0x7fd12c144430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:38.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.265+0000 7fd13113d700 1 -- 172.21.2.105:0/923014082 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd12c143200 con 0x7fd12c0b1cf0 2021-11-12T05:40:38.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.265+0000 7fd13113d700 1 -- 172.21.2.105:0/923014082 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fd1240019e0 con 0x7fd12c0b1cf0 2021-11-12T05:40:38.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.265+0000 7fd13113d700 1 -- 172.21.2.105:0/923014082 >> v1:172.21.2.105:6789/0 conn(0x7fd12c0b1cf0 legacy=0x7fd12c1436a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:38.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.265+0000 7fd13113d700 1 --2- 172.21.2.105:0/923014082 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd114003910 0x7fd114003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:38.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.265+0000 7fd13113d700 1 --2- 172.21.2.105:0/923014082 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd114004500 0x7fd114004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:38.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.265+0000 7fd13113d700 1 --2- 172.21.2.105:0/923014082 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd12c05fdc0 0x7fd114004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:38.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.265+0000 7fd13113d700 1 -- 172.21.2.105:0/923014082 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd11400b750 con 0x7fd114004500 2021-11-12T05:40:38.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.265+0000 7fd13113d700 1 -- 172.21.2.105:0/923014082 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd11400b8c0 con 0x7fd114003910 2021-11-12T05:40:38.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.265+0000 7fd13113d700 1 -- 172.21.2.105:0/923014082 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd11400ba80 con 0x7fd12c05fdc0 2021-11-12T05:40:38.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.265+0000 7fd13193e700 1 --2- 172.21.2.105:0/923014082 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd114004500 0x7fd114004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:38.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd13213f700 1 --2- 172.21.2.105:0/923014082 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd114003910 0x7fd114003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:38.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd13193e700 1 -- 172.21.2.105:0/923014082 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd12c05fdc0 msgr2=0x7fd114004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:38.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd132940700 1 --2- 172.21.2.105:0/923014082 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd12c05fdc0 0x7fd114004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:38.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd13193e700 1 --2- 172.21.2.105:0/923014082 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd12c05fdc0 0x7fd114004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:38.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd13193e700 1 -- 172.21.2.105:0/923014082 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd114003910 msgr2=0x7fd114003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:38.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd13193e700 1 --2- 172.21.2.105:0/923014082 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd114003910 0x7fd114003d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:38.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd13193e700 1 -- 172.21.2.105:0/923014082 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd114003260 con 0x7fd114004500 2021-11-12T05:40:38.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd13213f700 1 --2- 172.21.2.105:0/923014082 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd114003910 0x7fd114003d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:40:38.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd132940700 1 --2- 172.21.2.105:0/923014082 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd12c05fdc0 0x7fd114004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:40:38.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd13193e700 1 --2- 172.21.2.105:0/923014082 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd114004500 0x7fd114004980 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fd120001110 tx=0x7fd120007a00).ready entity=mon.0 client_cookie=d2250cfc345e1ce3 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:38.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd13113d700 1 -- 172.21.2.105:0/923014082 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd120007d10 con 0x7fd114004500 2021-11-12T05:40:38.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd13113d700 1 -- 172.21.2.105:0/923014082 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd120007030 con 0x7fd114004500 2021-11-12T05:40:38.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd13113d700 1 -- 172.21.2.105:0/923014082 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd120007390 con 0x7fd114004500 2021-11-12T05:40:38.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd133141700 1 -- 172.21.2.105:0/923014082 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd114004500 msgr2=0x7fd114004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:38.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd133141700 1 --2- 172.21.2.105:0/923014082 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd114004500 0x7fd114004980 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fd120001110 tx=0x7fd120007a00).stop 2021-11-12T05:40:38.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd132940700 1 -- 172.21.2.105:0/923014082 reap_dead start 2021-11-12T05:40:38.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd133141700 1 -- 172.21.2.105:0/923014082 shutdown_connections 2021-11-12T05:40:38.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd133141700 1 -- 172.21.2.105:0/923014082 >> 172.21.2.105:0/923014082 conn(0x7fd12c0608d0 msgr2=0x7fd12c05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:38.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd133141700 1 -- 172.21.2.105:0/923014082 shutdown_connections 2021-11-12T05:40:38.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd133141700 1 -- 172.21.2.105:0/923014082 wait complete. 2021-11-12T05:40:38.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd133141700 1 Processor -- start 2021-11-12T05:40:38.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd133141700 1 -- start start 2021-11-12T05:40:38.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd133141700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd114004500 0x7fd12c0644e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:38.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd133141700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd12c065880 0x7fd12c0b0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:38.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd133141700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd12c066a50 0x7fd12c1169f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:38.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd133141700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12c065d90 con 0x7fd12c065880 2021-11-12T05:40:38.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd133141700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12c066030 con 0x7fd114004500 2021-11-12T05:40:38.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd133141700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd12c067450 con 0x7fd12c066a50 2021-11-12T05:40:38.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd13193e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd12c065880 0x7fd12c0b0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:38.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd13193e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd12c065880 0x7fd12c0b0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42652/0 (socket says 172.21.2.105:42652) 2021-11-12T05:40:38.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd13193e700 1 -- 172.21.2.105:0/1043855277 learned_addr learned my addr 172.21.2.105:0/1043855277 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:38.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd13193e700 1 -- 172.21.2.105:0/1043855277 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd12c066a50 msgr2=0x7fd12c1169f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:38.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd13193e700 1 --2- 172.21.2.105:0/1043855277 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd12c066a50 0x7fd12c1169f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:38.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd13213f700 1 --2- 172.21.2.105:0/1043855277 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd114004500 0x7fd12c0644e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:38.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd13193e700 1 -- 172.21.2.105:0/1043855277 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd114004500 msgr2=0x7fd12c0644e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:38.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd13193e700 1 --2- 172.21.2.105:0/1043855277 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd114004500 0x7fd12c0644e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:38.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd13193e700 1 -- 172.21.2.105:0/1043855277 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd12c116500 con 0x7fd12c065880 2021-11-12T05:40:38.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd13213f700 1 --2- 172.21.2.105:0/1043855277 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd114004500 0x7fd12c0644e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:40:38.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd13193e700 1 --2- 172.21.2.105:0/1043855277 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd12c065880 0x7fd12c0b0a80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fd120001110 tx=0x7fd120016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:38.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd11f7fe700 1 -- 172.21.2.105:0/1043855277 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd12001f620 con 0x7fd12c065880 2021-11-12T05:40:38.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd11f7fe700 1 -- 172.21.2.105:0/1043855277 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12001f780 con 0x7fd12c065880 2021-11-12T05:40:38.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd133141700 1 -- 172.21.2.105:0/1043855277 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd12c0b0f70 con 0x7fd12c065880 2021-11-12T05:40:38.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd11f7fe700 1 -- 172.21.2.105:0/1043855277 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd12001fae0 con 0x7fd12c065880 2021-11-12T05:40:38.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd133141700 1 -- 172.21.2.105:0/1043855277 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd12c117100 con 0x7fd12c065880 2021-11-12T05:40:38.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd133141700 1 -- 172.21.2.105:0/1043855277 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd12c142f20 con 0x7fd12c065880 2021-11-12T05:40:38.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd11f7fe700 1 -- 172.21.2.105:0/1043855277 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd120025020 con 0x7fd12c065880 2021-11-12T05:40:38.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd11f7fe700 1 --2- 172.21.2.105:0/1043855277 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd10c053600 0x7fd10c055ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:38.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd11f7fe700 1 -- 172.21.2.105:0/1043855277 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fd12006cb40 con 0x7fd12c065880 2021-11-12T05:40:38.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.269+0000 7fd13213f700 1 --2- 172.21.2.105:0/1043855277 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd10c053600 0x7fd10c055ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:38.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.273+0000 7fd13213f700 1 --2- 172.21.2.105:0/1043855277 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd10c053600 0x7fd10c055ac0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fd12800b000 tx=0x7fd128008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:38.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.273+0000 7fd11f7fe700 1 -- 172.21.2.105:0/1043855277 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd120043a30 con 0x7fd12c065880 2021-11-12T05:40:38.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.385+0000 7fd133141700 1 -- 172.21.2.105:0/1043855277 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd12c142f20 con 0x7fd12c065880 2021-11-12T05:40:38.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.385+0000 7fd11f7fe700 1 -- 172.21.2.105:0/1043855277 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2134 (secure 0 0 0) 0x7fd12006ce60 con 0x7fd12c065880 2021-11-12T05:40:38.388 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:40:38.389 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4222,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/3123627686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":3123627686},{"type":"v1","addr":"172.21.2.115:6833","nonce":3123627686}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:40:37.198589+0000","modified":"2021-11-12T05:40:38.201943+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/2223420138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":2223420138},{"type":"v1","addr":"172.21.2.105:6835","nonce":2223420138}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-11-12T05:40:38.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.385+0000 7fd133141700 1 -- 172.21.2.105:0/1043855277 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd10c053600 msgr2=0x7fd10c055ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:38.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.385+0000 7fd133141700 1 --2- 172.21.2.105:0/1043855277 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd10c053600 0x7fd10c055ac0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fd12800b000 tx=0x7fd128008040).stop 2021-11-12T05:40:38.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.385+0000 7fd133141700 1 -- 172.21.2.105:0/1043855277 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd12c065880 msgr2=0x7fd12c0b0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:38.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.385+0000 7fd133141700 1 --2- 172.21.2.105:0/1043855277 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd12c065880 0x7fd12c0b0a80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fd120001110 tx=0x7fd120016000).stop 2021-11-12T05:40:38.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.385+0000 7fd133141700 1 -- 172.21.2.105:0/1043855277 shutdown_connections 2021-11-12T05:40:38.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.385+0000 7fd133141700 1 --2- 172.21.2.105:0/1043855277 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd10c053600 0x7fd10c055ac0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:38.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.385+0000 7fd133141700 1 --2- 172.21.2.105:0/1043855277 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd12c066a50 0x7fd12c1169f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:38.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.385+0000 7fd133141700 1 --2- 172.21.2.105:0/1043855277 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd12c065880 0x7fd12c0b0a80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:38.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.385+0000 7fd133141700 1 --2- 172.21.2.105:0/1043855277 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd114004500 0x7fd12c0644e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:38.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.385+0000 7fd133141700 1 -- 172.21.2.105:0/1043855277 >> 172.21.2.105:0/1043855277 conn(0x7fd12c0608d0 msgr2=0x7fd12c1457a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:38.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.385+0000 7fd133141700 1 -- 172.21.2.105:0/1043855277 shutdown_connections 2021-11-12T05:40:38.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.385+0000 7fd133141700 1 -- 172.21.2.105:0/1043855277 wait complete. 2021-11-12T05:40:38.392 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 5 2021-11-12T05:40:38.395 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:40:38.444 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f69a1919700 1 Processor -- start 2021-11-12T05:40:38.444 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f69a1919700 1 -- start start 2021-11-12T05:40:38.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f69a1919700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f699c0ade80 0x7f699c0601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:38.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f69a1919700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f699c13a9c0 0x7f699c13ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:38.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f69a1919700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f699c066150 con 0x7f699c05fdc0 2021-11-12T05:40:38.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f69a1919700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f699c141fb0 con 0x7f699c13a9c0 2021-11-12T05:40:38.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f69a1919700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f699c0663f0 con 0x7f699c0ade80 2021-11-12T05:40:38.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f699affd700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f699c05fdc0 0x7f699c066730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:53052/0 (socket says 172.21.2.105:53052) 2021-11-12T05:40:38.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f699affd700 1 -- 172.21.2.105:0/2263524335 learned_addr learned my addr 172.21.2.105:0/2263524335 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:38.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f699b7fe700 1 --2- 172.21.2.105:0/2263524335 >> v2:172.21.2.115:3300/0 conn(0x7f699c13a9c0 0x7f699c13ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:38.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f6999ffb700 1 -- 172.21.2.105:0/2263524335 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2963216928 0 0) 0x7f699c066150 con 0x7f699c05fdc0 2021-11-12T05:40:38.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f6999ffb700 1 -- 172.21.2.105:0/2263524335 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f697c003260 con 0x7f699c05fdc0 2021-11-12T05:40:38.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f699a7fc700 1 --2- 172.21.2.105:0/2263524335 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f699c0ade80 0x7f699c0601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:38.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f6999ffb700 1 -- 172.21.2.105:0/2263524335 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4212099653 0 0) 0x7f697c003260 con 0x7f699c05fdc0 2021-11-12T05:40:38.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f6999ffb700 1 -- 172.21.2.105:0/2263524335 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f699c0ade80 msgr2=0x7f699c0601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:38.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f6999ffb700 1 --2- 172.21.2.105:0/2263524335 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f699c0ade80 0x7f699c0601a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:38.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f6999ffb700 1 -- 172.21.2.105:0/2263524335 >> v2:172.21.2.115:3300/0 conn(0x7f699c13a9c0 msgr2=0x7f699c13ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:38.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f6999ffb700 1 --2- 172.21.2.105:0/2263524335 >> v2:172.21.2.115:3300/0 conn(0x7f699c13a9c0 0x7f699c13ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:38.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f6999ffb700 1 -- 172.21.2.105:0/2263524335 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f699c140fd0 con 0x7f699c05fdc0 2021-11-12T05:40:38.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f6999ffb700 1 -- 172.21.2.105:0/2263524335 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f6984001680 con 0x7f699c05fdc0 2021-11-12T05:40:38.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f6999ffb700 1 -- 172.21.2.105:0/2263524335 >> v1:172.21.2.105:6789/0 conn(0x7f699c05fdc0 legacy=0x7f699c066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:38.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f6999ffb700 1 --2- 172.21.2.105:0/2263524335 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f697c0037d0 0x7f697c003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:38.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f6999ffb700 1 --2- 172.21.2.105:0/2263524335 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f697c004500 0x7f697c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:38.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f6999ffb700 1 --2- 172.21.2.105:0/2263524335 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f699c0ade80 0x7f697c004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:38.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f6999ffb700 1 -- 172.21.2.105:0/2263524335 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699c0663f0 con 0x7f697c0037d0 2021-11-12T05:40:38.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f6999ffb700 1 -- 172.21.2.105:0/2263524335 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697c00b750 con 0x7f697c004500 2021-11-12T05:40:38.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f6999ffb700 1 -- 172.21.2.105:0/2263524335 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697c00b910 con 0x7f699c0ade80 2021-11-12T05:40:38.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f699affd700 1 --2- 172.21.2.105:0/2263524335 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f697c0037d0 0x7f697c003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:38.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f699affd700 1 -- 172.21.2.105:0/2263524335 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f699c0ade80 msgr2=0x7f697c004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:38.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f699affd700 1 --2- 172.21.2.105:0/2263524335 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f699c0ade80 0x7f697c004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:38.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f699affd700 1 -- 172.21.2.105:0/2263524335 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f697c004500 msgr2=0x7f697c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:38.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f699affd700 1 --2- 172.21.2.105:0/2263524335 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f697c004500 0x7f697c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:38.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f699affd700 1 -- 172.21.2.105:0/2263524335 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697c003260 con 0x7f697c0037d0 2021-11-12T05:40:38.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f699affd700 1 --2- 172.21.2.105:0/2263524335 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f697c0037d0 0x7f697c003bf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f6984001390 tx=0x7f699c0662e0).ready entity=mon.0 client_cookie=7c46e61ab4401c87 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:38.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f6999ffb700 1 -- 172.21.2.105:0/2263524335 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6984007170 con 0x7f697c0037d0 2021-11-12T05:40:38.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f6999ffb700 1 -- 172.21.2.105:0/2263524335 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69840072d0 con 0x7f697c0037d0 2021-11-12T05:40:38.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f6999ffb700 1 -- 172.21.2.105:0/2263524335 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f698400c9c0 con 0x7f697c0037d0 2021-11-12T05:40:38.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f69a1919700 1 -- 172.21.2.105:0/2263524335 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f697c0037d0 msgr2=0x7f697c003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:38.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f69a1919700 1 --2- 172.21.2.105:0/2263524335 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f697c0037d0 0x7f697c003bf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f6984001390 tx=0x7f699c0662e0).stop 2021-11-12T05:40:38.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.441+0000 7f699b7fe700 1 -- 172.21.2.105:0/2263524335 reap_dead start 2021-11-12T05:40:38.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.445+0000 7f69a1919700 1 -- 172.21.2.105:0/2263524335 shutdown_connections 2021-11-12T05:40:38.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.445+0000 7f69a1919700 1 -- 172.21.2.105:0/2263524335 >> 172.21.2.105:0/2263524335 conn(0x7f699c0608d0 msgr2=0x7f699c05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:38.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.445+0000 7f69a1919700 1 -- 172.21.2.105:0/2263524335 shutdown_connections 2021-11-12T05:40:38.458 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.445+0000 7f69a1919700 1 -- 172.21.2.105:0/2263524335 wait complete. 2021-11-12T05:40:38.458 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.445+0000 7f69a1919700 1 Processor -- start 2021-11-12T05:40:38.458 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.445+0000 7f69a1919700 1 -- start start 2021-11-12T05:40:38.458 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.445+0000 7f69a1919700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f697c0037d0 0x7f699c0b80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:38.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.445+0000 7f69a1919700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f699c0b6240 0x7f699c0b6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:38.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.445+0000 7f69a1919700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f699c148670 0x7f699c148af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:38.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.445+0000 7f69a1919700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699c0b6b70 con 0x7f697c0037d0 2021-11-12T05:40:38.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.445+0000 7f69a1919700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699c0b73a0 con 0x7f699c148670 2021-11-12T05:40:38.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.445+0000 7f69a1919700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f699c0b5f00 con 0x7f699c0b6240 2021-11-12T05:40:38.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.445+0000 7f699affd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f697c0037d0 0x7f699c0b80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:38.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.445+0000 7f699affd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f697c0037d0 0x7f699c0b80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42672/0 (socket says 172.21.2.105:42672) 2021-11-12T05:40:38.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.445+0000 7f699affd700 1 -- 172.21.2.105:0/235994481 learned_addr learned my addr 172.21.2.105:0/235994481 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:38.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.445+0000 7f699affd700 1 -- 172.21.2.105:0/235994481 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f699c0b6240 msgr2=0x7f699c0b6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:38.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.445+0000 7f699affd700 1 --2- 172.21.2.105:0/235994481 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f699c0b6240 0x7f699c0b6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:38.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.445+0000 7f699affd700 1 -- 172.21.2.105:0/235994481 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f699c148670 msgr2=0x7f699c148af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:38.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.445+0000 7f699affd700 1 --2- 172.21.2.105:0/235994481 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f699c148670 0x7f699c148af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:38.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.445+0000 7f699affd700 1 -- 172.21.2.105:0/235994481 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f699c144650 con 0x7f697c0037d0 2021-11-12T05:40:38.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.445+0000 7f699affd700 1 --2- 172.21.2.105:0/235994481 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f697c0037d0 0x7f699c0b80e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f699c143f60 tx=0x7f6984013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:38.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.445+0000 7f6993fff700 1 -- 172.21.2.105:0/235994481 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6984007440 con 0x7f697c0037d0 2021-11-12T05:40:38.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.445+0000 7f6993fff700 1 -- 172.21.2.105:0/235994481 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6984004730 con 0x7f697c0037d0 2021-11-12T05:40:38.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.445+0000 7f69a1919700 1 -- 172.21.2.105:0/235994481 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f699c148fe0 con 0x7f697c0037d0 2021-11-12T05:40:38.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.445+0000 7f6993fff700 1 -- 172.21.2.105:0/235994481 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6984004a90 con 0x7f697c0037d0 2021-11-12T05:40:38.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.445+0000 7f69a1919700 1 -- 172.21.2.105:0/235994481 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f699c144b20 con 0x7f697c0037d0 2021-11-12T05:40:38.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.445+0000 7f69a1919700 1 -- 172.21.2.105:0/235994481 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f699c144ce0 con 0x7f697c0037d0 2021-11-12T05:40:38.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.445+0000 7f6993fff700 1 -- 172.21.2.105:0/235994481 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6984027070 con 0x7f697c0037d0 2021-11-12T05:40:38.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.445+0000 7f6993fff700 1 --2- 172.21.2.105:0/235994481 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6980053580 0x7f6980055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:38.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.445+0000 7f6993fff700 1 -- 172.21.2.105:0/235994481 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f698406c0b0 con 0x7f697c0037d0 2021-11-12T05:40:38.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.445+0000 7f699a7fc700 1 --2- 172.21.2.105:0/235994481 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6980053580 0x7f6980055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:38.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.445+0000 7f699a7fc700 1 --2- 172.21.2.105:0/235994481 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6980053580 0x7f6980055a40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f698c00a000 tx=0x7f698c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:38.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.449+0000 7f6993fff700 1 -- 172.21.2.105:0/235994481 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f69840430b0 con 0x7f697c0037d0 2021-11-12T05:40:38.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.533+0000 7f69a1919700 1 -- 172.21.2.105:0/235994481 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f699c057350 con 0x7f697c0037d0 2021-11-12T05:40:38.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.533+0000 7f6993fff700 1 -- 172.21.2.105:0/235994481 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f69840466d0 con 0x7f697c0037d0 2021-11-12T05:40:38.538 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:40:38.539 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":25,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:40:38.203083+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:40:32.786926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-12T05:40:35.006506+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:40:38.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.533+0000 7f69a1919700 1 -- 172.21.2.105:0/235994481 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6980053580 msgr2=0x7f6980055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:38.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.533+0000 7f69a1919700 1 --2- 172.21.2.105:0/235994481 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6980053580 0x7f6980055a40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f698c00a000 tx=0x7f698c008040).stop 2021-11-12T05:40:38.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.533+0000 7f69a1919700 1 -- 172.21.2.105:0/235994481 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f697c0037d0 msgr2=0x7f699c0b80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:38.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.533+0000 7f69a1919700 1 --2- 172.21.2.105:0/235994481 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f697c0037d0 0x7f699c0b80e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f699c143f60 tx=0x7f6984013000).stop 2021-11-12T05:40:38.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.533+0000 7f69a1919700 1 -- 172.21.2.105:0/235994481 shutdown_connections 2021-11-12T05:40:38.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.533+0000 7f69a1919700 1 --2- 172.21.2.105:0/235994481 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6980053580 0x7f6980055a40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:38.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.533+0000 7f69a1919700 1 --2- 172.21.2.105:0/235994481 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f699c148670 0x7f699c148af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:38.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.533+0000 7f69a1919700 1 --2- 172.21.2.105:0/235994481 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f699c0b6240 0x7f699c0b6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:38.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.533+0000 7f69a1919700 1 --2- 172.21.2.105:0/235994481 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f697c0037d0 0x7f699c0b80e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:38.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.533+0000 7f69a1919700 1 -- 172.21.2.105:0/235994481 >> 172.21.2.105:0/235994481 conn(0x7f699c0608d0 msgr2=0x7f699c141390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:38.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.533+0000 7f69a1919700 1 -- 172.21.2.105:0/235994481 shutdown_connections 2021-11-12T05:40:38.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.533+0000 7f69a1919700 1 -- 172.21.2.105:0/235994481 wait complete. 2021-11-12T05:40:38.546 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:40:38.547 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2021-11-12T05:40:38.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.593+0000 7fdd4e2f7700 1 Processor -- start 2021-11-12T05:40:38.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.593+0000 7fdd4e2f7700 1 -- start start 2021-11-12T05:40:38.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.593+0000 7fdd4e2f7700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fdd4805fdc0 0x7fdd480601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:38.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.593+0000 7fdd4e2f7700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd48066150 con 0x7fdd4813a9c0 2021-11-12T05:40:38.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.593+0000 7fdd4e2f7700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd480663f0 con 0x7fdd480ade80 2021-11-12T05:40:38.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.593+0000 7fdd4e2f7700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd48141fb0 con 0x7fdd4805fdc0 2021-11-12T05:40:38.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.593+0000 7fdd4c894700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fdd4813a9c0 0x7fdd48141470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:53072/0 (socket says 172.21.2.105:53072) 2021-11-12T05:40:38.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.593+0000 7fdd4c894700 1 -- 172.21.2.105:0/2383832126 learned_addr learned my addr 172.21.2.105:0/2383832126 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:38.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.593+0000 7fdd47fff700 1 --2- 172.21.2.105:0/2383832126 >> v2:172.21.2.105:3300/0 conn(0x7fdd4805fdc0 0x7fdd480601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:38.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.593+0000 7fdd47fff700 1 -- 172.21.2.105:0/2383832126 >> v1:172.21.2.115:6789/0 conn(0x7fdd480ade80 legacy=0x7fdd48066730 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:40:38.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.593+0000 7fdd47fff700 1 -- 172.21.2.105:0/2383832126 >> v1:172.21.2.105:6789/0 conn(0x7fdd4813a9c0 legacy=0x7fdd48141470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:38.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.593+0000 7fdd46ffd700 1 -- 172.21.2.105:0/2383832126 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2807365555 0 0) 0x7fdd48066150 con 0x7fdd4813a9c0 2021-11-12T05:40:38.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.593+0000 7fdd47fff700 1 -- 172.21.2.105:0/2383832126 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd48140fd0 con 0x7fdd4805fdc0 2021-11-12T05:40:38.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.593+0000 7fdd47fff700 1 --2- 172.21.2.105:0/2383832126 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdd4805fdc0 0x7fdd480601a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fdd48060ea0 tx=0x7fdd3c006df0).ready entity=mon.0 client_cookie=af8bb801bd8eb630 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:38.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.593+0000 7fdd46ffd700 1 -- 172.21.2.105:0/2383832126 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd3c00d5c0 con 0x7fdd4805fdc0 2021-11-12T05:40:38.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.593+0000 7fdd46ffd700 1 -- 172.21.2.105:0/2383832126 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3c000e90 con 0x7fdd4805fdc0 2021-11-12T05:40:38.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.593+0000 7fdd46ffd700 1 -- 172.21.2.105:0/2383832126 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd3c00d910 con 0x7fdd4805fdc0 2021-11-12T05:40:38.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.597+0000 7fdd4e2f7700 1 -- 172.21.2.105:0/2383832126 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdd4805fdc0 msgr2=0x7fdd480601a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:38.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.597+0000 7fdd4e2f7700 1 --2- 172.21.2.105:0/2383832126 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdd4805fdc0 0x7fdd480601a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fdd48060ea0 tx=0x7fdd3c006df0).stop 2021-11-12T05:40:38.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.597+0000 7fdd4e2f7700 1 -- 172.21.2.105:0/2383832126 shutdown_connections 2021-11-12T05:40:38.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.597+0000 7fdd4e2f7700 1 --2- 172.21.2.105:0/2383832126 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdd4805fdc0 0x7fdd480601a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:38.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.597+0000 7fdd4e2f7700 1 -- 172.21.2.105:0/2383832126 >> 172.21.2.105:0/2383832126 conn(0x7fdd480608d0 msgr2=0x7fdd4805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:38.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.597+0000 7fdd4e2f7700 1 -- 172.21.2.105:0/2383832126 shutdown_connections 2021-11-12T05:40:38.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.597+0000 7fdd4e2f7700 1 -- 172.21.2.105:0/2383832126 wait complete. 2021-11-12T05:40:38.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.597+0000 7fdd4e2f7700 1 Processor -- start 2021-11-12T05:40:38.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.597+0000 7fdd4e2f7700 1 -- start start 2021-11-12T05:40:38.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.597+0000 7fdd4e2f7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdd4805fdc0 0x7fdd4813b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:38.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.597+0000 7fdd4e2f7700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdd480ade80 0x7fdd48144c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:38.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.597+0000 7fdd4e2f7700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdd4813a9c0 0x7fdd4813dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:38.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.597+0000 7fdd4e2f7700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd480b7700 con 0x7fdd4805fdc0 2021-11-12T05:40:38.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.597+0000 7fdd4e2f7700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4813ae20 con 0x7fdd4813a9c0 2021-11-12T05:40:38.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.597+0000 7fdd4e2f7700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd480b53d0 con 0x7fdd480ade80 2021-11-12T05:40:38.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.597+0000 7fdd47fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdd4805fdc0 0x7fdd4813b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:38.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.597+0000 7fdd47fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdd4805fdc0 0x7fdd4813b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42684/0 (socket says 172.21.2.105:42684) 2021-11-12T05:40:38.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.597+0000 7fdd47fff700 1 -- 172.21.2.105:0/2295762719 learned_addr learned my addr 172.21.2.105:0/2295762719 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:38.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.597+0000 7fdd47fff700 1 -- 172.21.2.105:0/2295762719 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdd480ade80 msgr2=0x7fdd48144c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:38.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.597+0000 7fdd47fff700 1 --2- 172.21.2.105:0/2295762719 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdd480ade80 0x7fdd48144c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:38.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.597+0000 7fdd47fff700 1 -- 172.21.2.105:0/2295762719 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdd4813a9c0 msgr2=0x7fdd4813dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:38.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.597+0000 7fdd47fff700 1 --2- 172.21.2.105:0/2295762719 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdd4813a9c0 0x7fdd4813dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:38.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.597+0000 7fdd47fff700 1 -- 172.21.2.105:0/2295762719 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd3c00b180 con 0x7fdd4805fdc0 2021-11-12T05:40:38.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.597+0000 7fdd47fff700 1 --2- 172.21.2.105:0/2295762719 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdd4805fdc0 0x7fdd4813b790 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fdd48060ea0 tx=0x7fdd3c012000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:38.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.597+0000 7fdd457fa700 1 -- 172.21.2.105:0/2295762719 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd3c002f50 con 0x7fdd4805fdc0 2021-11-12T05:40:38.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.597+0000 7fdd457fa700 1 -- 172.21.2.105:0/2295762719 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3c013d50 con 0x7fdd4805fdc0 2021-11-12T05:40:38.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.597+0000 7fdd4e2f7700 1 -- 172.21.2.105:0/2295762719 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd4813b050 con 0x7fdd4805fdc0 2021-11-12T05:40:38.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.597+0000 7fdd4e2f7700 1 -- 172.21.2.105:0/2295762719 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd48151090 con 0x7fdd4805fdc0 2021-11-12T05:40:38.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.597+0000 7fdd457fa700 1 -- 172.21.2.105:0/2295762719 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd3c01f640 con 0x7fdd4805fdc0 2021-11-12T05:40:38.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.597+0000 7fdd4e2f7700 1 -- 172.21.2.105:0/2295762719 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd48140c40 con 0x7fdd4805fdc0 2021-11-12T05:40:38.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.597+0000 7fdd457fa700 1 -- 172.21.2.105:0/2295762719 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdd3c01c070 con 0x7fdd4805fdc0 2021-11-12T05:40:38.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.597+0000 7fdd457fa700 1 --2- 172.21.2.105:0/2295762719 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdd28053660 0x7fdd28055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:38.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.597+0000 7fdd457fa700 1 -- 172.21.2.105:0/2295762719 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fdd3c06c850 con 0x7fdd4805fdc0 2021-11-12T05:40:38.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.597+0000 7fdd477fe700 1 --2- 172.21.2.105:0/2295762719 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdd28053660 0x7fdd28055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:38.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.597+0000 7fdd477fe700 1 --2- 172.21.2.105:0/2295762719 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdd28053660 0x7fdd28055b20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fdd38002fb0 tx=0x7fdd380069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:38.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.601+0000 7fdd457fa700 1 -- 172.21.2.105:0/2295762719 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdd3c043850 con 0x7fdd4805fdc0 2021-11-12T05:40:38.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.685+0000 7fdd4e2f7700 1 -- 172.21.2.105:0/2295762719 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd48057350 con 0x7fdd4805fdc0 2021-11-12T05:40:38.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.685+0000 7fdd457fa700 1 -- 172.21.2.105:0/2295762719 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7fdd3c046e70 con 0x7fdd4805fdc0 2021-11-12T05:40:38.689 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:40:38.690 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":25,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:40:38.203083+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:40:32.786926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-12T05:40:35.006506+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:40:38.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.685+0000 7fdd4e2f7700 1 -- 172.21.2.105:0/2295762719 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdd28053660 msgr2=0x7fdd28055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:38.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.685+0000 7fdd4e2f7700 1 --2- 172.21.2.105:0/2295762719 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdd28053660 0x7fdd28055b20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fdd38002fb0 tx=0x7fdd380069b0).stop 2021-11-12T05:40:38.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.685+0000 7fdd4e2f7700 1 -- 172.21.2.105:0/2295762719 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdd4805fdc0 msgr2=0x7fdd4813b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:38.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.685+0000 7fdd4e2f7700 1 --2- 172.21.2.105:0/2295762719 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdd4805fdc0 0x7fdd4813b790 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fdd48060ea0 tx=0x7fdd3c012000).stop 2021-11-12T05:40:38.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.685+0000 7fdd4e2f7700 1 -- 172.21.2.105:0/2295762719 shutdown_connections 2021-11-12T05:40:38.692 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.685+0000 7fdd4e2f7700 1 --2- 172.21.2.105:0/2295762719 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdd28053660 0x7fdd28055b20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:38.692 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.685+0000 7fdd4e2f7700 1 --2- 172.21.2.105:0/2295762719 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdd4813a9c0 0x7fdd4813dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:38.692 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.685+0000 7fdd4e2f7700 1 --2- 172.21.2.105:0/2295762719 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdd480ade80 0x7fdd48144c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:38.692 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.685+0000 7fdd4e2f7700 1 --2- 172.21.2.105:0/2295762719 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdd4805fdc0 0x7fdd4813b790 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:38.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.685+0000 7fdd4e2f7700 1 -- 172.21.2.105:0/2295762719 >> 172.21.2.105:0/2295762719 conn(0x7fdd480608d0 msgr2=0x7fdd4813f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:38.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.685+0000 7fdd4e2f7700 1 -- 172.21.2.105:0/2295762719 shutdown_connections 2021-11-12T05:40:38.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.685+0000 7fdd4e2f7700 1 -- 172.21.2.105:0/2295762719 wait complete. 2021-11-12T05:40:38.696 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-12T05:40:32.786926+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-11-12T05:40:35.006506+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-12T05:40:38.697 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:40:38.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.745+0000 7f69050b5700 1 Processor -- start 2021-11-12T05:40:38.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.745+0000 7f69050b5700 1 -- start start 2021-11-12T05:40:38.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f69050b5700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f69000b2f70 0x7f69000b7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:38.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f69050b5700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69000b2590 con 0x7f6900142fc0 2021-11-12T05:40:38.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f69050b5700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69000b2830 con 0x7f69000b76d0 2021-11-12T05:40:38.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f69050b5700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69000b2ad0 con 0x7f69000b2f70 2021-11-12T05:40:38.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f68ff59e700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f6900142fc0 0x7f6900062340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:53090/0 (socket says 172.21.2.105:53090) 2021-11-12T05:40:38.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f68ff59e700 1 -- 172.21.2.105:0/2446362542 learned_addr learned my addr 172.21.2.105:0/2446362542 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:38.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f68fdd9b700 1 -- 172.21.2.105:0/2446362542 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2883483438 0 0) 0x7f69000b2590 con 0x7f6900142fc0 2021-11-12T05:40:38.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f68fdd9b700 1 -- 172.21.2.105:0/2446362542 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68e0003260 con 0x7f6900142fc0 2021-11-12T05:40:38.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f68fe59c700 1 --2- 172.21.2.105:0/2446362542 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f69000b2f70 0x7f69000b7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:38.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f68fdd9b700 1 -- 172.21.2.105:0/2446362542 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3915873392 0 0) 0x7f68e0003260 con 0x7f6900142fc0 2021-11-12T05:40:38.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f68fdd9b700 1 -- 172.21.2.105:0/2446362542 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f69000b2f70 msgr2=0x7f69000b7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:38.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f68fdd9b700 1 --2- 172.21.2.105:0/2446362542 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f69000b2f70 0x7f69000b7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:38.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f68fdd9b700 1 -- 172.21.2.105:0/2446362542 >> v1:172.21.2.115:6789/0 conn(0x7f69000b76d0 legacy=0x7f690013cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:38.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f68fdd9b700 1 -- 172.21.2.105:0/2446362542 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f690013d460 con 0x7f6900142fc0 2021-11-12T05:40:38.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f68fdd9b700 1 -- 172.21.2.105:0/2446362542 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f68f80019e0 con 0x7f6900142fc0 2021-11-12T05:40:38.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f68fdd9b700 1 -- 172.21.2.105:0/2446362542 >> v1:172.21.2.105:6789/0 conn(0x7f6900142fc0 legacy=0x7f6900062340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:38.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f68fdd9b700 1 --2- 172.21.2.105:0/2446362542 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f68e0003780 0x7f68e0003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:38.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f68fdd9b700 1 --2- 172.21.2.105:0/2446362542 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f68e0004500 0x7f68e0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:38.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f68fdd9b700 1 --2- 172.21.2.105:0/2446362542 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f68e0004ec0 0x7f68e000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:38.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f68fdd9b700 1 -- 172.21.2.105:0/2446362542 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69000b2ad0 con 0x7f68e0004500 2021-11-12T05:40:38.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f68fdd9b700 1 -- 172.21.2.105:0/2446362542 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e000bd20 con 0x7f68e0003780 2021-11-12T05:40:38.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f68fdd9b700 1 -- 172.21.2.105:0/2446362542 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e000bee0 con 0x7f68e0004ec0 2021-11-12T05:40:38.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f68fe59c700 1 --2- 172.21.2.105:0/2446362542 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f68e0004500 0x7f68e0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:38.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f68fe59c700 1 -- 172.21.2.105:0/2446362542 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f68e0004ec0 msgr2=0x7f68e000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:38.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f68fe59c700 1 --2- 172.21.2.105:0/2446362542 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f68e0004ec0 0x7f68e000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:38.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f68fe59c700 1 -- 172.21.2.105:0/2446362542 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f68e0003780 msgr2=0x7f68e0003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:38.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f68fe59c700 1 --2- 172.21.2.105:0/2446362542 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f68e0003780 0x7f68e0003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:38.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f68fe59c700 1 -- 172.21.2.105:0/2446362542 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f690013d460 con 0x7f68e0004500 2021-11-12T05:40:38.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f68fe59c700 1 --2- 172.21.2.105:0/2446362542 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f68e0004500 0x7f68e0004980 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f68f000a000 tx=0x7f68f0008040).ready entity=mon.0 client_cookie=927f1c65644887a7 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:38.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f68fdd9b700 1 -- 172.21.2.105:0/2446362542 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68f0013620 con 0x7f68e0004500 2021-11-12T05:40:38.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f68fdd9b700 1 -- 172.21.2.105:0/2446362542 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f0013780 con 0x7f68e0004500 2021-11-12T05:40:38.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f68fdd9b700 1 -- 172.21.2.105:0/2446362542 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68f0013ae0 con 0x7f68e0004500 2021-11-12T05:40:38.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f69050b5700 1 -- 172.21.2.105:0/2446362542 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f68e0004500 msgr2=0x7f68e0004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:38.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f69050b5700 1 --2- 172.21.2.105:0/2446362542 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f68e0004500 0x7f68e0004980 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f68f000a000 tx=0x7f68f0008040).stop 2021-11-12T05:40:38.763 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f68ff59e700 1 -- 172.21.2.105:0/2446362542 reap_dead start 2021-11-12T05:40:38.763 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f69050b5700 1 -- 172.21.2.105:0/2446362542 shutdown_connections 2021-11-12T05:40:38.763 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f69050b5700 1 -- 172.21.2.105:0/2446362542 >> 172.21.2.105:0/2446362542 conn(0x7f69000608d0 msgr2=0x7f690005c490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:38.763 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f69050b5700 1 -- 172.21.2.105:0/2446362542 shutdown_connections 2021-11-12T05:40:38.764 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f69050b5700 1 -- 172.21.2.105:0/2446362542 wait complete. 2021-11-12T05:40:38.764 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f69050b5700 1 Processor -- start 2021-11-12T05:40:38.764 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f69050b5700 1 -- start start 2021-11-12T05:40:38.767 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f69050b5700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f68e0004500 0x7f690013fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:38.768 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f69050b5700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f69000b0190 0x7f6900139510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:38.768 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f69050b5700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6900139a00 0x7f6900155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:38.768 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f69050b5700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69001400b0 con 0x7f6900139a00 2021-11-12T05:40:38.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f69050b5700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6900140350 con 0x7f68e0004500 2021-11-12T05:40:38.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f69050b5700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690013f1c0 con 0x7f69000b0190 2021-11-12T05:40:38.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f68ff59e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6900139a00 0x7f6900155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:38.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f68ff59e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6900139a00 0x7f6900155b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42706/0 (socket says 172.21.2.105:42706) 2021-11-12T05:40:38.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f68ff59e700 1 -- 172.21.2.105:0/901278857 learned_addr learned my addr 172.21.2.105:0/901278857 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:38.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f68ff59e700 1 -- 172.21.2.105:0/901278857 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f69000b0190 msgr2=0x7f6900139510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:38.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f68ff59e700 1 --2- 172.21.2.105:0/901278857 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f69000b0190 0x7f6900139510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:38.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f68ff59e700 1 -- 172.21.2.105:0/901278857 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f68e0004500 msgr2=0x7f690013fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:38.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f68ff59e700 1 --2- 172.21.2.105:0/901278857 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f68e0004500 0x7f690013fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:38.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.749+0000 7f68ff59e700 1 -- 172.21.2.105:0/901278857 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69000af770 con 0x7f6900139a00 2021-11-12T05:40:38.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.753+0000 7f68ff59e700 1 --2- 172.21.2.105:0/901278857 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6900139a00 0x7f6900155b00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f68f8001490 tx=0x7f68f8001d30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:38.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.753+0000 7f68f7fff700 1 -- 172.21.2.105:0/901278857 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68f8004ab0 con 0x7f6900139a00 2021-11-12T05:40:38.772 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.753+0000 7f68f7fff700 1 -- 172.21.2.105:0/901278857 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f8004c10 con 0x7f6900139a00 2021-11-12T05:40:38.772 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.753+0000 7f68f7fff700 1 -- 172.21.2.105:0/901278857 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68f8007170 con 0x7f6900139a00 2021-11-12T05:40:38.772 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.753+0000 7f69050b5700 1 -- 172.21.2.105:0/901278857 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69000af2b0 con 0x7f6900139a00 2021-11-12T05:40:38.772 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.753+0000 7f69050b5700 1 -- 172.21.2.105:0/901278857 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f690013a020 con 0x7f6900139a00 2021-11-12T05:40:38.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.753+0000 7f69050b5700 1 -- 172.21.2.105:0/901278857 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f690013f380 con 0x7f6900139a00 2021-11-12T05:40:38.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.753+0000 7f68f7fff700 1 -- 172.21.2.105:0/901278857 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f68f801d070 con 0x7f6900139a00 2021-11-12T05:40:38.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.753+0000 7f68f7fff700 1 --2- 172.21.2.105:0/901278857 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f68e40536a0 0x7f68e4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:38.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.753+0000 7f68f7fff700 1 -- 172.21.2.105:0/901278857 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f68f806b2e0 con 0x7f6900139a00 2021-11-12T05:40:38.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.753+0000 7f68fed9d700 1 --2- 172.21.2.105:0/901278857 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f68e40536a0 0x7f68e4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:38.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.753+0000 7f68fed9d700 1 --2- 172.21.2.105:0/901278857 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f68e40536a0 0x7f68e4055b60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f69000b7420 tx=0x7f68e80077f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:38.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.753+0000 7f68f7fff700 1 -- 172.21.2.105:0/901278857 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f68f80421d0 con 0x7f6900139a00 2021-11-12T05:40:38.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.841+0000 7f69050b5700 1 -- 172.21.2.105:0/901278857 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f69000b2210 con 0x7f6900139a00 2021-11-12T05:40:38.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.841+0000 7f68f7fff700 1 -- 172.21.2.105:0/901278857 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7f68f80457f0 con 0x7f6900139a00 2021-11-12T05:40:38.844 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:40:38.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.841+0000 7f69050b5700 1 -- 172.21.2.105:0/901278857 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f68e40536a0 msgr2=0x7f68e4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:38.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.841+0000 7f69050b5700 1 --2- 172.21.2.105:0/901278857 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f68e40536a0 0x7f68e4055b60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f69000b7420 tx=0x7f68e80077f0).stop 2021-11-12T05:40:38.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.841+0000 7f69050b5700 1 -- 172.21.2.105:0/901278857 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6900139a00 msgr2=0x7f6900155b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:38.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.841+0000 7f69050b5700 1 --2- 172.21.2.105:0/901278857 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6900139a00 0x7f6900155b00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f68f8001490 tx=0x7f68f8001d30).stop 2021-11-12T05:40:38.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.841+0000 7f69050b5700 1 -- 172.21.2.105:0/901278857 shutdown_connections 2021-11-12T05:40:38.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.841+0000 7f69050b5700 1 --2- 172.21.2.105:0/901278857 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f68e40536a0 0x7f68e4055b60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:38.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.841+0000 7f69050b5700 1 --2- 172.21.2.105:0/901278857 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6900139a00 0x7f6900155b00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:38.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.841+0000 7f69050b5700 1 --2- 172.21.2.105:0/901278857 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f69000b0190 0x7f6900139510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:38.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.841+0000 7f69050b5700 1 --2- 172.21.2.105:0/901278857 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f68e0004500 0x7f690013fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:38.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.841+0000 7f69050b5700 1 -- 172.21.2.105:0/901278857 >> 172.21.2.105:0/901278857 conn(0x7f69000608d0 msgr2=0x7f690013c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:38.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.841+0000 7f69050b5700 1 -- 172.21.2.105:0/901278857 shutdown_connections 2021-11-12T05:40:38.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.841+0000 7f69050b5700 1 -- 172.21.2.105:0/901278857 wait complete. 2021-11-12T05:40:38.851 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:40:38.905 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.901+0000 7fcbd8f97700 1 Processor -- start 2021-11-12T05:40:38.905 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.901+0000 7fcbd8f97700 1 -- start start 2021-11-12T05:40:38.912 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.901+0000 7fcbd8f97700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbd40b2e20 0x7fcbd40b1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:38.912 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.901+0000 7fcbd8f97700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd40ad400 con 0x7fcbd4142c50 2021-11-12T05:40:38.913 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.901+0000 7fcbd8f97700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd40b3200 con 0x7fcbd413ea50 2021-11-12T05:40:38.913 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.901+0000 7fcbd8f97700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd40ad660 con 0x7fcbd40b2e20 2021-11-12T05:40:38.913 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.901+0000 7fcbd2d9d700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fcbd4142c50 0x7fcbd41430c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:53108/0 (socket says 172.21.2.105:53108) 2021-11-12T05:40:38.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.901+0000 7fcbd2d9d700 1 -- 172.21.2.105:0/3653998178 learned_addr learned my addr 172.21.2.105:0/3653998178 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:38.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.901+0000 7fcbd159a700 1 -- 172.21.2.105:0/3653998178 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 674949780 0 0) 0x7fcbd40ad400 con 0x7fcbd4142c50 2021-11-12T05:40:38.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.901+0000 7fcbd159a700 1 -- 172.21.2.105:0/3653998178 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbb4003260 con 0x7fcbd4142c50 2021-11-12T05:40:38.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.901+0000 7fcbd259c700 1 --2- 172.21.2.105:0/3653998178 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbd40b2e20 0x7fcbd40b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:38.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.901+0000 7fcbd159a700 1 -- 172.21.2.105:0/3653998178 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2338371587 0 0) 0x7fcbb4003260 con 0x7fcbd4142c50 2021-11-12T05:40:38.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.901+0000 7fcbd159a700 1 -- 172.21.2.105:0/3653998178 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbd40b2e20 msgr2=0x7fcbd40b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:38.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.901+0000 7fcbd159a700 1 --2- 172.21.2.105:0/3653998178 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbd40b2e20 0x7fcbd40b1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:38.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.901+0000 7fcbd159a700 1 -- 172.21.2.105:0/3653998178 >> v1:172.21.2.115:6789/0 conn(0x7fcbd413ea50 legacy=0x7fcbd413ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:38.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.901+0000 7fcbd159a700 1 -- 172.21.2.105:0/3653998178 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd40ad900 con 0x7fcbd4142c50 2021-11-12T05:40:38.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.901+0000 7fcbd159a700 1 -- 172.21.2.105:0/3653998178 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fcbcc001a00 con 0x7fcbd4142c50 2021-11-12T05:40:38.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.901+0000 7fcbd159a700 1 -- 172.21.2.105:0/3653998178 >> v1:172.21.2.105:6789/0 conn(0x7fcbd4142c50 legacy=0x7fcbd41430c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:38.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.901+0000 7fcbd159a700 1 --2- 172.21.2.105:0/3653998178 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcbb4003780 0x7fcbb4003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:38.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.901+0000 7fcbd159a700 1 --2- 172.21.2.105:0/3653998178 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbd40b2e20 0x7fcbb4004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:38.918 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.901+0000 7fcbd159a700 1 --2- 172.21.2.105:0/3653998178 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbb4004a40 0x7fcbb4004ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:38.918 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.901+0000 7fcbd159a700 1 -- 172.21.2.105:0/3653998178 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd40ad660 con 0x7fcbb4004a40 2021-11-12T05:40:38.919 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.901+0000 7fcbd159a700 1 -- 172.21.2.105:0/3653998178 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb400daf0 con 0x7fcbb4003780 2021-11-12T05:40:38.919 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.901+0000 7fcbd159a700 1 -- 172.21.2.105:0/3653998178 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb400dc60 con 0x7fcbd40b2e20 2021-11-12T05:40:38.919 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.901+0000 7fcbd2d9d700 1 --2- 172.21.2.105:0/3653998178 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbb4004a40 0x7fcbb4004ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:38.919 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.901+0000 7fcbd2d9d700 1 -- 172.21.2.105:0/3653998178 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbd40b2e20 msgr2=0x7fcbb4004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:38.920 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.901+0000 7fcbd2d9d700 1 --2- 172.21.2.105:0/3653998178 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbd40b2e20 0x7fcbb4004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:38.920 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.901+0000 7fcbd2d9d700 1 -- 172.21.2.105:0/3653998178 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcbb4003780 msgr2=0x7fcbb4003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:38.920 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.901+0000 7fcbd2d9d700 1 --2- 172.21.2.105:0/3653998178 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcbb4003780 0x7fcbb4003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:38.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.901+0000 7fcbd2d9d700 1 -- 172.21.2.105:0/3653998178 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb4003260 con 0x7fcbb4004a40 2021-11-12T05:40:38.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.901+0000 7fcbd2d9d700 1 --2- 172.21.2.105:0/3653998178 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbb4004a40 0x7fcbb4004ec0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fcbcc001710 tx=0x7fcbcc0020e0).ready entity=mon.0 client_cookie=bbd949967d7ce91 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:38.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.901+0000 7fcbd159a700 1 -- 172.21.2.105:0/3653998178 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbcc00cc00 con 0x7fcbb4004a40 2021-11-12T05:40:38.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.901+0000 7fcbd159a700 1 -- 172.21.2.105:0/3653998178 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbcc00cd60 con 0x7fcbb4004a40 2021-11-12T05:40:38.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.901+0000 7fcbd159a700 1 -- 172.21.2.105:0/3653998178 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbcc004b50 con 0x7fcbb4004a40 2021-11-12T05:40:38.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.905+0000 7fcbd8f97700 1 -- 172.21.2.105:0/3653998178 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbb4004a40 msgr2=0x7fcbb4004ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:38.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.905+0000 7fcbd8f97700 1 --2- 172.21.2.105:0/3653998178 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbb4004a40 0x7fcbb4004ec0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fcbcc001710 tx=0x7fcbcc0020e0).stop 2021-11-12T05:40:38.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.905+0000 7fcbd2d9d700 1 -- 172.21.2.105:0/3653998178 reap_dead start 2021-11-12T05:40:38.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.905+0000 7fcbd8f97700 1 -- 172.21.2.105:0/3653998178 shutdown_connections 2021-11-12T05:40:38.924 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.905+0000 7fcbd8f97700 1 -- 172.21.2.105:0/3653998178 >> 172.21.2.105:0/3653998178 conn(0x7fcbd4062f60 msgr2=0x7fcbd4063370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:38.924 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.905+0000 7fcbd8f97700 1 -- 172.21.2.105:0/3653998178 shutdown_connections 2021-11-12T05:40:38.924 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.905+0000 7fcbd8f97700 1 -- 172.21.2.105:0/3653998178 wait complete. 2021-11-12T05:40:38.925 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.905+0000 7fcbd8f97700 1 Processor -- start 2021-11-12T05:40:38.925 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.905+0000 7fcbd8f97700 1 -- start start 2021-11-12T05:40:38.925 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.905+0000 7fcbd8f97700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbb4004a40 0x7fcbd413b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:38.926 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.905+0000 7fcbd8f97700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcbd413c580 0x7fcbd414ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:38.926 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.905+0000 7fcbd8f97700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbd40aab20 0x7fcbd40aafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:38.926 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.905+0000 7fcbd8f97700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd40ab490 con 0x7fcbd40aab20 2021-11-12T05:40:38.927 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.905+0000 7fcbd8f97700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd414f350 con 0x7fcbd413c580 2021-11-12T05:40:38.927 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.905+0000 7fcbd8f97700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd413d810 con 0x7fcbb4004a40 2021-11-12T05:40:38.927 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.905+0000 7fcbd2d9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbd40aab20 0x7fcbd40aafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:38.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.905+0000 7fcbd2d9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbd40aab20 0x7fcbd40aafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42726/0 (socket says 172.21.2.105:42726) 2021-11-12T05:40:38.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.905+0000 7fcbd2d9d700 1 -- 172.21.2.105:0/3265228505 learned_addr learned my addr 172.21.2.105:0/3265228505 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:38.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.905+0000 7fcbd2d9d700 1 -- 172.21.2.105:0/3265228505 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbb4004a40 msgr2=0x7fcbd413b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:38.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.905+0000 7fcbd2d9d700 1 --2- 172.21.2.105:0/3265228505 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbb4004a40 0x7fcbd413b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:38.929 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.905+0000 7fcbd2d9d700 1 -- 172.21.2.105:0/3265228505 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcbd413c580 msgr2=0x7fcbd414ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:38.929 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.905+0000 7fcbd2d9d700 1 --2- 172.21.2.105:0/3265228505 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcbd413c580 0x7fcbd414ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:38.929 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.905+0000 7fcbd2d9d700 1 -- 172.21.2.105:0/3265228505 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd414e480 con 0x7fcbd40aab20 2021-11-12T05:40:38.930 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.905+0000 7fcbd2d9d700 1 --2- 172.21.2.105:0/3265228505 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbd40aab20 0x7fcbd40aafa0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fcbd40ab5d0 tx=0x7fcbcc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:38.930 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.905+0000 7fcbcb7fe700 1 -- 172.21.2.105:0/3265228505 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbcc0074d0 con 0x7fcbd40aab20 2021-11-12T05:40:38.931 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.905+0000 7fcbcb7fe700 1 -- 172.21.2.105:0/3265228505 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbcc019030 con 0x7fcbd40aab20 2021-11-12T05:40:38.931 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.905+0000 7fcbcb7fe700 1 -- 172.21.2.105:0/3265228505 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbcc007820 con 0x7fcbd40aab20 2021-11-12T05:40:38.931 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.905+0000 7fcbd8f97700 1 -- 172.21.2.105:0/3265228505 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd414e720 con 0x7fcbd40aab20 2021-11-12T05:40:38.931 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.905+0000 7fcbd8f97700 1 -- 172.21.2.105:0/3265228505 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd414e170 con 0x7fcbd40aab20 2021-11-12T05:40:38.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.905+0000 7fcbd8f97700 1 -- 172.21.2.105:0/3265228505 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd4057350 con 0x7fcbd40aab20 2021-11-12T05:40:38.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.905+0000 7fcbcb7fe700 1 -- 172.21.2.105:0/3265228505 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcbcc027070 con 0x7fcbd40aab20 2021-11-12T05:40:38.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.905+0000 7fcbcb7fe700 1 --2- 172.21.2.105:0/3265228505 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcbb80536a0 0x7fcbb8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:38.933 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.905+0000 7fcbcb7fe700 1 -- 172.21.2.105:0/3265228505 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fcbcc01c040 con 0x7fcbd40aab20 2021-11-12T05:40:38.933 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.905+0000 7fcbd259c700 1 --2- 172.21.2.105:0/3265228505 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcbb80536a0 0x7fcbb8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:38.933 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.905+0000 7fcbd259c700 1 --2- 172.21.2.105:0/3265228505 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcbb80536a0 0x7fcbb8055b60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fcbc400b000 tx=0x7fcbc4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:38.934 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.909+0000 7fcbcb7fe700 1 -- 172.21.2.105:0/3265228505 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcbcc043180 con 0x7fcbd40aab20 2021-11-12T05:40:38.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.989+0000 7fcbd8f97700 1 -- 172.21.2.105:0/3265228505 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcbd40b2040 con 0x7fcbd40aab20 2021-11-12T05:40:38.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.989+0000 7fcbcb7fe700 1 -- 172.21.2.105:0/3265228505 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcbcc0467a0 con 0x7fcbd40aab20 2021-11-12T05:40:38.995 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:40:38.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.993+0000 7fcbd8f97700 1 -- 172.21.2.105:0/3265228505 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcbb80536a0 msgr2=0x7fcbb8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:38.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.993+0000 7fcbd8f97700 1 --2- 172.21.2.105:0/3265228505 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcbb80536a0 0x7fcbb8055b60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fcbc400b000 tx=0x7fcbc4008040).stop 2021-11-12T05:40:38.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.993+0000 7fcbd8f97700 1 -- 172.21.2.105:0/3265228505 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbd40aab20 msgr2=0x7fcbd40aafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:38.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.993+0000 7fcbd8f97700 1 --2- 172.21.2.105:0/3265228505 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbd40aab20 0x7fcbd40aafa0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fcbd40ab5d0 tx=0x7fcbcc015000).stop 2021-11-12T05:40:38.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.993+0000 7fcbd8f97700 1 -- 172.21.2.105:0/3265228505 shutdown_connections 2021-11-12T05:40:38.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.993+0000 7fcbd8f97700 1 --2- 172.21.2.105:0/3265228505 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcbb80536a0 0x7fcbb8055b60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:38.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.993+0000 7fcbd8f97700 1 --2- 172.21.2.105:0/3265228505 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbd40aab20 0x7fcbd40aafa0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:38.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.993+0000 7fcbd8f97700 1 --2- 172.21.2.105:0/3265228505 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcbd413c580 0x7fcbd414ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:38.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.993+0000 7fcbd8f97700 1 --2- 172.21.2.105:0/3265228505 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbb4004a40 0x7fcbd413b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:38.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.993+0000 7fcbd8f97700 1 -- 172.21.2.105:0/3265228505 >> 172.21.2.105:0/3265228505 conn(0x7fcbd4062f60 msgr2=0x7fcbd40b6280 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:38.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.993+0000 7fcbd8f97700 1 -- 172.21.2.105:0/3265228505 shutdown_connections 2021-11-12T05:40:38.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:38.993+0000 7fcbd8f97700 1 -- 172.21.2.105:0/3265228505 wait complete. 2021-11-12T05:40:39.002 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-12T05:40:39.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f3b2e700 1 Processor -- start 2021-11-12T05:40:39.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f3b2e700 1 -- start start 2021-11-12T05:40:39.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f3b2e700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f93ec0af750 0x7f93ec062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f3b2e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f93ec130a80 0x7f93ec1474d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f3b2e700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93ec0b0d50 con 0x7f93ec0626b0 2021-11-12T05:40:39.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f3b2e700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93ec0ad380 con 0x7f93ec0af750 2021-11-12T05:40:39.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f3b2e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec0ae190 con 0x7f93ec130a80 2021-11-12T05:40:39.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f18ca700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f93ec0626b0 0x7f93ec130370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:53126/0 (socket says 172.21.2.105:53126) 2021-11-12T05:40:39.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f18ca700 1 -- 172.21.2.105:0/69217002 learned_addr learned my addr 172.21.2.105:0/69217002 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:39.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f10c9700 1 --2- 172.21.2.105:0/69217002 >> v2:172.21.2.105:3300/0 conn(0x7f93ec0af750 0x7f93ec062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:39.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f08c8700 1 -- 172.21.2.105:0/69217002 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 635474944 0 0) 0x7f93ec0b0d50 con 0x7f93ec0626b0 2021-11-12T05:40:39.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f08c8700 1 -- 172.21.2.105:0/69217002 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93d4003260 con 0x7f93ec0626b0 2021-11-12T05:40:39.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f10c9700 1 -- 172.21.2.105:0/69217002 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f93ec130a80 msgr2=0x7f93ec1474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:39.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f10c9700 1 --2- 172.21.2.105:0/69217002 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f93ec130a80 0x7f93ec1474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:39.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f10c9700 1 -- 172.21.2.105:0/69217002 >> v1:172.21.2.105:6789/0 conn(0x7f93ec0626b0 legacy=0x7f93ec130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f10c9700 1 -- 172.21.2.105:0/69217002 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ec1479c0 con 0x7f93ec0af750 2021-11-12T05:40:39.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f10c9700 1 --2- 172.21.2.105:0/69217002 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f93ec0af750 0x7f93ec062a90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f93e0002f70 tx=0x7f93e0006df0).ready entity=mon.0 client_cookie=7f537f1d8830e386 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:39.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f08c8700 1 -- 172.21.2.105:0/69217002 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93e000d570 con 0x7f93ec0af750 2021-11-12T05:40:39.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f08c8700 1 -- 172.21.2.105:0/69217002 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e0000e90 con 0x7f93ec0af750 2021-11-12T05:40:39.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f08c8700 1 -- 172.21.2.105:0/69217002 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93e000d900 con 0x7f93ec0af750 2021-11-12T05:40:39.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f3b2e700 1 -- 172.21.2.105:0/69217002 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f93ec0af750 msgr2=0x7f93ec062a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f3b2e700 1 --2- 172.21.2.105:0/69217002 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f93ec0af750 0x7f93ec062a90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f93e0002f70 tx=0x7f93e0006df0).stop 2021-11-12T05:40:39.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f3b2e700 1 -- 172.21.2.105:0/69217002 shutdown_connections 2021-11-12T05:40:39.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f3b2e700 1 --2- 172.21.2.105:0/69217002 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f93ec130a80 0x7f93ec1474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:39.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f3b2e700 1 --2- 172.21.2.105:0/69217002 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f93ec0af750 0x7f93ec062a90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:39.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f3b2e700 1 -- 172.21.2.105:0/69217002 >> 172.21.2.105:0/69217002 conn(0x7f93ec0b5320 msgr2=0x7f93ec0b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:39.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f3b2e700 1 -- 172.21.2.105:0/69217002 shutdown_connections 2021-11-12T05:40:39.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f3b2e700 1 -- 172.21.2.105:0/69217002 wait complete. 2021-11-12T05:40:39.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f3b2e700 1 Processor -- start 2021-11-12T05:40:39.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f3b2e700 1 -- start start 2021-11-12T05:40:39.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f3b2e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f93ec0626b0 0x7f93ec1465c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f3b2e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f93ec0af750 0x7f93ec0647d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f3b2e700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f93ec130a80 0x7f93ec064cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f3b2e700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec063aa0 con 0x7f93ec0af750 2021-11-12T05:40:39.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f3b2e700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec14b590 con 0x7f93ec130a80 2021-11-12T05:40:39.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f3b2e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec14b830 con 0x7f93ec0626b0 2021-11-12T05:40:39.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f10c9700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f93ec0af750 0x7f93ec0647d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:39.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f10c9700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f93ec0af750 0x7f93ec0647d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42736/0 (socket says 172.21.2.105:42736) 2021-11-12T05:40:39.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f10c9700 1 -- 172.21.2.105:0/1162929053 learned_addr learned my addr 172.21.2.105:0/1162929053 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:39.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f18ca700 1 --2- 172.21.2.105:0/1162929053 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f93ec0626b0 0x7f93ec1465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:39.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f20cb700 1 --2- 172.21.2.105:0/1162929053 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f93ec130a80 0x7f93ec064cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:39.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f10c9700 1 -- 172.21.2.105:0/1162929053 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f93ec0626b0 msgr2=0x7f93ec1465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f10c9700 1 --2- 172.21.2.105:0/1162929053 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f93ec0626b0 0x7f93ec1465c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:39.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f10c9700 1 -- 172.21.2.105:0/1162929053 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f93ec130a80 msgr2=0x7f93ec064cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f10c9700 1 --2- 172.21.2.105:0/1162929053 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f93ec130a80 0x7f93ec064cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:39.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f10c9700 1 -- 172.21.2.105:0/1162929053 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e000b180 con 0x7f93ec0af750 2021-11-12T05:40:39.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f20cb700 1 --2- 172.21.2.105:0/1162929053 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f93ec130a80 0x7f93ec064cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:40:39.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f10c9700 1 --2- 172.21.2.105:0/1162929053 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f93ec0af750 0x7f93ec0647d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f93e0002f70 tx=0x7f93e0014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:39.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93deffd700 1 -- 172.21.2.105:0/1162929053 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93e000dea0 con 0x7f93ec0af750 2021-11-12T05:40:39.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93deffd700 1 -- 172.21.2.105:0/1162929053 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e001e400 con 0x7f93ec0af750 2021-11-12T05:40:39.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f3b2e700 1 -- 172.21.2.105:0/1162929053 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93ec14bad0 con 0x7f93ec0af750 2021-11-12T05:40:39.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93deffd700 1 -- 172.21.2.105:0/1162929053 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93e001e760 con 0x7f93ec0af750 2021-11-12T05:40:39.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.053+0000 7f93f3b2e700 1 -- 172.21.2.105:0/1162929053 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93ec1498f0 con 0x7f93ec0af750 2021-11-12T05:40:39.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.057+0000 7f93f3b2e700 1 -- 172.21.2.105:0/1162929053 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93ec057350 con 0x7f93ec0af750 2021-11-12T05:40:39.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.057+0000 7f93deffd700 1 -- 172.21.2.105:0/1162929053 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f93e0025030 con 0x7f93ec0af750 2021-11-12T05:40:39.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.057+0000 7f93deffd700 1 --2- 172.21.2.105:0/1162929053 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f93cc0536d0 0x7f93cc055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.057+0000 7f93deffd700 1 -- 172.21.2.105:0/1162929053 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f93e006c950 con 0x7f93ec0af750 2021-11-12T05:40:39.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.057+0000 7f93f18ca700 1 --2- 172.21.2.105:0/1162929053 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f93cc0536d0 0x7f93cc055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:39.074 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.057+0000 7f93f18ca700 1 --2- 172.21.2.105:0/1162929053 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f93cc0536d0 0x7f93cc055b90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f93e800b000 tx=0x7f93e8009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:39.074 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.057+0000 7f93deffd700 1 -- 172.21.2.105:0/1162929053 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f93e0043840 con 0x7f93ec0af750 2021-11-12T05:40:39.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.141+0000 7f93f3b2e700 1 -- 172.21.2.105:0/1162929053 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f93ec146f90 con 0x7f93ec0af750 2021-11-12T05:40:39.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.141+0000 7f93deffd700 1 -- 172.21.2.105:0/1162929053 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7f93e00230a0 con 0x7f93ec0af750 2021-11-12T05:40:39.146 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:40:39.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.141+0000 7f93f3b2e700 1 -- 172.21.2.105:0/1162929053 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f93cc0536d0 msgr2=0x7f93cc055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.141+0000 7f93f3b2e700 1 --2- 172.21.2.105:0/1162929053 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f93cc0536d0 0x7f93cc055b90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f93e800b000 tx=0x7f93e8009040).stop 2021-11-12T05:40:39.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.141+0000 7f93f3b2e700 1 -- 172.21.2.105:0/1162929053 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f93ec0af750 msgr2=0x7f93ec0647d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.141+0000 7f93f3b2e700 1 --2- 172.21.2.105:0/1162929053 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f93ec0af750 0x7f93ec0647d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f93e0002f70 tx=0x7f93e0014000).stop 2021-11-12T05:40:39.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.141+0000 7f93f3b2e700 1 -- 172.21.2.105:0/1162929053 shutdown_connections 2021-11-12T05:40:39.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.141+0000 7f93f3b2e700 1 --2- 172.21.2.105:0/1162929053 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f93cc0536d0 0x7f93cc055b90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:39.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.141+0000 7f93f3b2e700 1 --2- 172.21.2.105:0/1162929053 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f93ec130a80 0x7f93ec064cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:39.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.141+0000 7f93f3b2e700 1 --2- 172.21.2.105:0/1162929053 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f93ec0af750 0x7f93ec0647d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:39.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.141+0000 7f93f3b2e700 1 --2- 172.21.2.105:0/1162929053 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f93ec0626b0 0x7f93ec1465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:39.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.141+0000 7f93f3b2e700 1 -- 172.21.2.105:0/1162929053 >> 172.21.2.105:0/1162929053 conn(0x7f93ec0b5320 msgr2=0x7f93ec0ad580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:39.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.141+0000 7f93f3b2e700 1 -- 172.21.2.105:0/1162929053 shutdown_connections 2021-11-12T05:40:39.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.141+0000 7f93f3b2e700 1 -- 172.21.2.105:0/1162929053 wait complete. 2021-11-12T05:40:39.153 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-12T05:40:39.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.201+0000 7f17a7c6c700 1 Processor -- start 2021-11-12T05:40:39.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.201+0000 7f17a7c6c700 1 -- start start 2021-11-12T05:40:39.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.201+0000 7f17a7c6c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f17a00b4060 0x7f17a0146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.201+0000 7f17a7c6c700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f17a01471b0 0x7f17a0140040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.201+0000 7f17a7c6c700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17a0147620 con 0x7f17a00b6430 2021-11-12T05:40:39.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.201+0000 7f17a7c6c700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17a00b6810 con 0x7f17a00b4060 2021-11-12T05:40:39.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.201+0000 7f17a7c6c700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17a00b6d60 con 0x7f17a01471b0 2021-11-12T05:40:39.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.201+0000 7f17a5207700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f17a00b4060 0x7f17a0146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:39.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.201+0000 7f17a5207700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f17a00b4060 0x7f17a0146cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42746/0 (socket says 172.21.2.105:42746) 2021-11-12T05:40:39.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.201+0000 7f17a5207700 1 -- 172.21.2.105:0/804188316 learned_addr learned my addr 172.21.2.105:0/804188316 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:39.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.201+0000 7f17a5207700 1 -- 172.21.2.105:0/804188316 >> v2:172.21.2.115:3300/0 conn(0x7f17a01471b0 msgr2=0x7f17a0140040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:39.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.201+0000 7f17a5207700 1 --2- 172.21.2.105:0/804188316 >> v2:172.21.2.115:3300/0 conn(0x7f17a01471b0 0x7f17a0140040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:39.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.201+0000 7f17a5207700 1 -- 172.21.2.105:0/804188316 >> v1:172.21.2.115:6789/0 conn(0x7f17a00b6430 legacy=0x7f17a0143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:39.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.201+0000 7f17a5207700 1 -- 172.21.2.105:0/804188316 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a0146820 con 0x7f17a00b4060 2021-11-12T05:40:39.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.201+0000 7f17a5207700 1 --2- 172.21.2.105:0/804188316 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f17a00b4060 0x7f17a0146cc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f17a00ae3f0 tx=0x7f179c006eb0).ready entity=mon.0 client_cookie=51e945f38c3b2d81 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:39.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.201+0000 7f17a4a06700 1 -- 172.21.2.105:0/804188316 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f179c00d5c0 con 0x7f17a00b4060 2021-11-12T05:40:39.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.201+0000 7f17a4a06700 1 -- 172.21.2.105:0/804188316 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179c000e90 con 0x7f17a00b4060 2021-11-12T05:40:39.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.201+0000 7f17a4a06700 1 -- 172.21.2.105:0/804188316 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f179c00d910 con 0x7f17a00b4060 2021-11-12T05:40:39.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.205+0000 7f17a7c6c700 1 -- 172.21.2.105:0/804188316 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f17a00b4060 msgr2=0x7f17a0146cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.205+0000 7f17a7c6c700 1 --2- 172.21.2.105:0/804188316 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f17a00b4060 0x7f17a0146cc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f17a00ae3f0 tx=0x7f179c006eb0).stop 2021-11-12T05:40:39.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.205+0000 7f17a7c6c700 1 -- 172.21.2.105:0/804188316 shutdown_connections 2021-11-12T05:40:39.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.205+0000 7f17a7c6c700 1 --2- 172.21.2.105:0/804188316 >> v2:172.21.2.115:3300/0 conn(0x7f17a01471b0 0x7f17a0140040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:39.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.205+0000 7f17a7c6c700 1 --2- 172.21.2.105:0/804188316 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f17a00b4060 0x7f17a0146cc0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:39.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.205+0000 7f17a7c6c700 1 -- 172.21.2.105:0/804188316 >> 172.21.2.105:0/804188316 conn(0x7f17a0062030 msgr2=0x7f17a0062440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:39.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.205+0000 7f17a7c6c700 1 -- 172.21.2.105:0/804188316 shutdown_connections 2021-11-12T05:40:39.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.205+0000 7f17a7c6c700 1 -- 172.21.2.105:0/804188316 wait complete. 2021-11-12T05:40:39.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.205+0000 7f17a7c6c700 1 Processor -- start 2021-11-12T05:40:39.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.205+0000 7f17a7c6c700 1 -- start start 2021-11-12T05:40:39.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.205+0000 7f17a7c6c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f17a00b4060 0x7f17a0113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.205+0000 7f17a7c6c700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f17a00b6430 0x7f17a0140960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.205+0000 7f17a7c6c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f17a01471b0 0x7f17a0140e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.205+0000 7f17a7c6c700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a013db80 con 0x7f17a00b4060 2021-11-12T05:40:39.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.205+0000 7f17a7c6c700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a0141340 con 0x7f17a00b6430 2021-11-12T05:40:39.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.205+0000 7f17a7c6c700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a01131b0 con 0x7f17a01471b0 2021-11-12T05:40:39.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.205+0000 7f17a5a08700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f17a00b4060 0x7f17a0113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:39.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.205+0000 7f17a5a08700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f17a00b4060 0x7f17a0113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42750/0 (socket says 172.21.2.105:42750) 2021-11-12T05:40:39.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.205+0000 7f17a5a08700 1 -- 172.21.2.105:0/226453338 learned_addr learned my addr 172.21.2.105:0/226453338 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:39.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.205+0000 7f17a5a08700 1 -- 172.21.2.105:0/226453338 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f17a01471b0 msgr2=0x7f17a0140e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.205+0000 7f17a5a08700 1 --2- 172.21.2.105:0/226453338 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f17a01471b0 0x7f17a0140e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:39.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.205+0000 7f17a5a08700 1 -- 172.21.2.105:0/226453338 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f17a00b6430 msgr2=0x7f17a0140960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.205+0000 7f17a5a08700 1 --2- 172.21.2.105:0/226453338 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f17a00b6430 0x7f17a0140960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:39.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.205+0000 7f17a5a08700 1 -- 172.21.2.105:0/226453338 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f179c00b1e0 con 0x7f17a00b4060 2021-11-12T05:40:39.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.205+0000 7f17a5a08700 1 --2- 172.21.2.105:0/226453338 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f17a00b4060 0x7f17a0113b90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f1794002f90 tx=0x7f1794006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:39.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.205+0000 7f1792ffd700 1 -- 172.21.2.105:0/226453338 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1794013460 con 0x7f17a00b4060 2021-11-12T05:40:39.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.205+0000 7f1792ffd700 1 -- 172.21.2.105:0/226453338 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17940135c0 con 0x7f17a00b4060 2021-11-12T05:40:39.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.205+0000 7f17a7c6c700 1 -- 172.21.2.105:0/226453338 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a0113450 con 0x7f17a00b4060 2021-11-12T05:40:39.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.205+0000 7f1792ffd700 1 -- 172.21.2.105:0/226453338 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1794013920 con 0x7f17a00b4060 2021-11-12T05:40:39.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.205+0000 7f17a7c6c700 1 -- 172.21.2.105:0/226453338 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a0141d90 con 0x7f17a00b4060 2021-11-12T05:40:39.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.205+0000 7f17a7c6c700 1 -- 172.21.2.105:0/226453338 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17a01138f0 con 0x7f17a00b4060 2021-11-12T05:40:39.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.205+0000 7f1792ffd700 1 -- 172.21.2.105:0/226453338 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f179400f070 con 0x7f17a00b4060 2021-11-12T05:40:39.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.205+0000 7f1792ffd700 1 --2- 172.21.2.105:0/226453338 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1780053580 0x7f1780055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.205+0000 7f1792ffd700 1 -- 172.21.2.105:0/226453338 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f179406b490 con 0x7f17a00b4060 2021-11-12T05:40:39.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.209+0000 7f17a5207700 1 --2- 172.21.2.105:0/226453338 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1780053580 0x7f1780055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:39.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.209+0000 7f17a5207700 1 --2- 172.21.2.105:0/226453338 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1780053580 0x7f1780055a40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f17a00ae3f0 tx=0x7f179c015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:39.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.209+0000 7f1792ffd700 1 -- 172.21.2.105:0/226453338 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f17a01138f0 con 0x7f17a00b4060 2021-11-12T05:40:39.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.289+0000 7f17a7c6c700 1 -- 172.21.2.105:0/226453338 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f17a01138f0 con 0x7f17a00b4060 2021-11-12T05:40:39.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.293+0000 7f1792ffd700 1 -- 172.21.2.105:0/226453338 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7f17a01138f0 con 0x7f17a00b4060 2021-11-12T05:40:39.297 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:40:39.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.293+0000 7f17a7c6c700 1 -- 172.21.2.105:0/226453338 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1780053580 msgr2=0x7f1780055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.293+0000 7f17a7c6c700 1 --2- 172.21.2.105:0/226453338 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1780053580 0x7f1780055a40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f17a00ae3f0 tx=0x7f179c015000).stop 2021-11-12T05:40:39.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.293+0000 7f17a7c6c700 1 -- 172.21.2.105:0/226453338 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f17a00b4060 msgr2=0x7f17a0113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.293+0000 7f17a7c6c700 1 --2- 172.21.2.105:0/226453338 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f17a00b4060 0x7f17a0113b90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f1794002f90 tx=0x7f1794006df0).stop 2021-11-12T05:40:39.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.293+0000 7f17a7c6c700 1 -- 172.21.2.105:0/226453338 shutdown_connections 2021-11-12T05:40:39.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.293+0000 7f17a7c6c700 1 --2- 172.21.2.105:0/226453338 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1780053580 0x7f1780055a40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:39.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.293+0000 7f17a7c6c700 1 --2- 172.21.2.105:0/226453338 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f17a01471b0 0x7f17a0140e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:39.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.293+0000 7f17a7c6c700 1 --2- 172.21.2.105:0/226453338 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f17a00b6430 0x7f17a0140960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:39.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.293+0000 7f17a7c6c700 1 --2- 172.21.2.105:0/226453338 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f17a00b4060 0x7f17a0113b90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:39.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.293+0000 7f17a7c6c700 1 -- 172.21.2.105:0/226453338 >> 172.21.2.105:0/226453338 conn(0x7f17a0062030 msgr2=0x7f17a013e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:39.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.293+0000 7f17a7c6c700 1 -- 172.21.2.105:0/226453338 shutdown_connections 2021-11-12T05:40:39.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.293+0000 7f17a7c6c700 1 -- 172.21.2.105:0/226453338 wait complete. 2021-11-12T05:40:39.303 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2021-11-12T05:40:39.303 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2021-11-12T05:40:39.304 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2021-11-12T05:40:39.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.349+0000 7ff6ed3af700 1 Processor -- start 2021-11-12T05:40:39.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.349+0000 7ff6ed3af700 1 -- start start 2021-11-12T05:40:39.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6ed3af700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff6e80b4d50 0x7ff6e80b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6ed3af700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff6e80b3100 0x7ff6e80b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6ed3af700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6e80b2110 con 0x7ff6e8062010 2021-11-12T05:40:39.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6ed3af700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6e80b2370 con 0x7ff6e80b3100 2021-11-12T05:40:39.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6ed3af700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e80b2610 con 0x7ff6e80b4d50 2021-11-12T05:40:39.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6e77fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff6e80b3100 0x7ff6e80b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:39.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6e77fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff6e80b3100 0x7ff6e80b2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42760/0 (socket says 172.21.2.105:42760) 2021-11-12T05:40:39.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6e77fe700 1 -- 172.21.2.105:0/1126613988 learned_addr learned my addr 172.21.2.105:0/1126613988 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:39.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6e77fe700 1 -- 172.21.2.105:0/1126613988 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff6e80b4d50 msgr2=0x7ff6e80b5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:39.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6e77fe700 1 --2- 172.21.2.105:0/1126613988 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff6e80b4d50 0x7ff6e80b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:39.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6e77fe700 1 -- 172.21.2.105:0/1126613988 >> v1:172.21.2.115:6789/0 conn(0x7ff6e8062010 legacy=0x7ff6e80b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:39.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6e77fe700 1 -- 172.21.2.105:0/1126613988 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e80b4330 con 0x7ff6e80b3100 2021-11-12T05:40:39.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6e77fe700 1 --2- 172.21.2.105:0/1126613988 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff6e80b3100 0x7ff6e80b2ab0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7ff6e80b2990 tx=0x7ff6e0009290).ready entity=mon.0 client_cookie=a8a8288a4d5d1014 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:39.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6e5ffb700 1 -- 172.21.2.105:0/1126613988 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6e000b830 con 0x7ff6e80b3100 2021-11-12T05:40:39.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6e5ffb700 1 -- 172.21.2.105:0/1126613988 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e000b990 con 0x7ff6e80b3100 2021-11-12T05:40:39.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6e5ffb700 1 -- 172.21.2.105:0/1126613988 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6e000bb00 con 0x7ff6e80b3100 2021-11-12T05:40:39.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6ed3af700 1 -- 172.21.2.105:0/1126613988 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff6e80b3100 msgr2=0x7ff6e80b2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6ed3af700 1 --2- 172.21.2.105:0/1126613988 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff6e80b3100 0x7ff6e80b2ab0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7ff6e80b2990 tx=0x7ff6e0009290).stop 2021-11-12T05:40:39.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6ed3af700 1 -- 172.21.2.105:0/1126613988 shutdown_connections 2021-11-12T05:40:39.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6ed3af700 1 --2- 172.21.2.105:0/1126613988 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff6e80b3100 0x7ff6e80b2ab0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:39.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6ed3af700 1 --2- 172.21.2.105:0/1126613988 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff6e80b4d50 0x7ff6e80b5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:39.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6ed3af700 1 -- 172.21.2.105:0/1126613988 >> 172.21.2.105:0/1126613988 conn(0x7ff6e80b9790 msgr2=0x7ff6e80b9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:39.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6ed3af700 1 -- 172.21.2.105:0/1126613988 shutdown_connections 2021-11-12T05:40:39.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6ed3af700 1 -- 172.21.2.105:0/1126613988 wait complete. 2021-11-12T05:40:39.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6ed3af700 1 Processor -- start 2021-11-12T05:40:39.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6ed3af700 1 -- start start 2021-11-12T05:40:39.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6ed3af700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff6e8062010 0x7ff6e8146b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6ed3af700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff6e80b3100 0x7ff6e8155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6ed3af700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff6e80b4d50 0x7ff6e81152d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6ed3af700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e80af3a0 con 0x7ff6e8062010 2021-11-12T05:40:39.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6ed3af700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e81562d0 con 0x7ff6e80b4d50 2021-11-12T05:40:39.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6ed3af700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e8114e70 con 0x7ff6e80b3100 2021-11-12T05:40:39.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6e6ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff6e8062010 0x7ff6e8146b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:39.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6e6ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff6e8062010 0x7ff6e8146b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42764/0 (socket says 172.21.2.105:42764) 2021-11-12T05:40:39.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6e6ffd700 1 -- 172.21.2.105:0/616963685 learned_addr learned my addr 172.21.2.105:0/616963685 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:39.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6e6ffd700 1 -- 172.21.2.105:0/616963685 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff6e80b3100 msgr2=0x7ff6e8155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6e6ffd700 1 --2- 172.21.2.105:0/616963685 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff6e80b3100 0x7ff6e8155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:39.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6e6ffd700 1 -- 172.21.2.105:0/616963685 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff6e80b4d50 msgr2=0x7ff6e81152d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6e6ffd700 1 --2- 172.21.2.105:0/616963685 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff6e80b4d50 0x7ff6e81152d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:39.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6e6ffd700 1 -- 172.21.2.105:0/616963685 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e0009530 con 0x7ff6e8062010 2021-11-12T05:40:39.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6e6ffd700 1 --2- 172.21.2.105:0/616963685 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff6e8062010 0x7ff6e8146b50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7ff6d8002f90 tx=0x7ff6d8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:39.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6dffff700 1 -- 172.21.2.105:0/616963685 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6d8013460 con 0x7ff6e8062010 2021-11-12T05:40:39.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6dffff700 1 -- 172.21.2.105:0/616963685 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d80135c0 con 0x7ff6e8062010 2021-11-12T05:40:39.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6ed3af700 1 -- 172.21.2.105:0/616963685 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6e80af5d0 con 0x7ff6e8062010 2021-11-12T05:40:39.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6dffff700 1 -- 172.21.2.105:0/616963685 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6d8013920 con 0x7ff6e8062010 2021-11-12T05:40:39.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.353+0000 7ff6ed3af700 1 -- 172.21.2.105:0/616963685 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6e80b02a0 con 0x7ff6e8062010 2021-11-12T05:40:39.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.357+0000 7ff6ed3af700 1 -- 172.21.2.105:0/616963685 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6e80623f0 con 0x7ff6e8062010 2021-11-12T05:40:39.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.357+0000 7ff6dffff700 1 -- 172.21.2.105:0/616963685 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff6d801a060 con 0x7ff6e8062010 2021-11-12T05:40:39.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.357+0000 7ff6dffff700 1 --2- 172.21.2.105:0/616963685 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff6cc0534f0 0x7ff6cc0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.357+0000 7ff6dffff700 1 -- 172.21.2.105:0/616963685 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7ff6d806b4b0 con 0x7ff6e8062010 2021-11-12T05:40:39.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.357+0000 7ff6e67fc700 1 --2- 172.21.2.105:0/616963685 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff6cc0534f0 0x7ff6cc0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:39.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.357+0000 7ff6e67fc700 1 --2- 172.21.2.105:0/616963685 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff6cc0534f0 0x7ff6cc0559b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7ff6d0002f70 tx=0x7ff6d00069f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:39.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.357+0000 7ff6dffff700 1 -- 172.21.2.105:0/616963685 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff6d80423a0 con 0x7ff6e8062010 2021-11-12T05:40:39.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.461+0000 7ff6ed3af700 1 -- 172.21.2.105:0/616963685 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ff6e8114fb0 con 0x7ff6e8062010 2021-11-12T05:40:39.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.461+0000 7ff6dffff700 1 -- 172.21.2.105:0/616963685 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+131253 (secure 0 0 0) 0x7ff6d80459c0 con 0x7ff6e8062010 2021-11-12T05:40:39.468 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:40:39.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.461+0000 7ff6ed3af700 1 -- 172.21.2.105:0/616963685 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff6cc0534f0 msgr2=0x7ff6cc0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.461+0000 7ff6ed3af700 1 --2- 172.21.2.105:0/616963685 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff6cc0534f0 0x7ff6cc0559b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7ff6d0002f70 tx=0x7ff6d00069f0).stop 2021-11-12T05:40:39.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.461+0000 7ff6ed3af700 1 -- 172.21.2.105:0/616963685 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff6e8062010 msgr2=0x7ff6e8146b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.461+0000 7ff6ed3af700 1 --2- 172.21.2.105:0/616963685 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff6e8062010 0x7ff6e8146b50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7ff6d8002f90 tx=0x7ff6d8006df0).stop 2021-11-12T05:40:39.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.461+0000 7ff6ed3af700 1 -- 172.21.2.105:0/616963685 shutdown_connections 2021-11-12T05:40:39.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.461+0000 7ff6ed3af700 1 --2- 172.21.2.105:0/616963685 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff6cc0534f0 0x7ff6cc0559b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:39.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.461+0000 7ff6ed3af700 1 --2- 172.21.2.105:0/616963685 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff6e80b4d50 0x7ff6e81152d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:39.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.461+0000 7ff6ed3af700 1 --2- 172.21.2.105:0/616963685 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff6e80b3100 0x7ff6e8155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:39.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.461+0000 7ff6ed3af700 1 --2- 172.21.2.105:0/616963685 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff6e8062010 0x7ff6e8146b50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:39.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.461+0000 7ff6ed3af700 1 -- 172.21.2.105:0/616963685 >> 172.21.2.105:0/616963685 conn(0x7ff6e80b9790 msgr2=0x7ff6e80b45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:39.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.461+0000 7ff6ed3af700 1 -- 172.21.2.105:0/616963685 shutdown_connections 2021-11-12T05:40:39.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.461+0000 7ff6ed3af700 1 -- 172.21.2.105:0/616963685 wait complete. 2021-11-12T05:40:39.473 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":5,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6800","nonce":14730},{"type":"v1","addr":"172.21.2.105:6801","nonce":14730}]},"active_addr":"172.21.2.105:6801/14730","active_change":"2021-11-12T05:40:22.004190+0000","active_mgr_features":4540138292840890367,"available":true,"standbys":[{"gid":4099,"name":"x","mgr_features":4540138292840890367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.2.105:0","nonce":537079290}]},{"addrvec":[{"type":"v2","addr":"172.21.2.105:0","nonce":1293060481}]},{"addrvec":[{"type":"v2","addr":"172.21.2.105:0","nonce":1091740605}]}]}} 2021-11-12T05:40:39.479 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2021-11-12T05:40:39.480 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2021-11-12T05:40:39.480 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:40:39.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.525+0000 7f73e0073700 1 Processor -- start 2021-11-12T05:40:39.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.525+0000 7f73e0073700 1 -- start start 2021-11-12T05:40:39.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.525+0000 7f73e0073700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f73d805fdc0 0x7f73d80601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.525+0000 7f73e0073700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f73d80ade80 0x7f73d8066730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.525+0000 7f73e0073700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73d8066150 con 0x7f73d813a9c0 2021-11-12T05:40:39.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.525+0000 7f73e0073700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73d8141fb0 con 0x7f73d805fdc0 2021-11-12T05:40:39.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.525+0000 7f73e0073700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73d80663f0 con 0x7f73d80ade80 2021-11-12T05:40:39.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73dde0f700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f73d805fdc0 0x7f73d80601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:39.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73dde0f700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f73d805fdc0 0x7f73d80601a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42772/0 (socket says 172.21.2.105:42772) 2021-11-12T05:40:39.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73dde0f700 1 -- 172.21.2.105:0/993706426 learned_addr learned my addr 172.21.2.105:0/993706426 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:39.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73dde0f700 1 -- 172.21.2.105:0/993706426 >> v2:172.21.2.115:3300/0 conn(0x7f73d80ade80 msgr2=0x7f73d8066730 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:40:39.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73dde0f700 1 --2- 172.21.2.105:0/993706426 >> v2:172.21.2.115:3300/0 conn(0x7f73d80ade80 0x7f73d8066730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:39.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73dde0f700 1 -- 172.21.2.105:0/993706426 >> v1:172.21.2.115:6789/0 conn(0x7f73d813a9c0 legacy=0x7f73d8141470 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:40:39.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73dde0f700 1 -- 172.21.2.105:0/993706426 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d8140fd0 con 0x7f73d805fdc0 2021-11-12T05:40:39.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73dde0f700 1 --2- 172.21.2.105:0/993706426 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f73d805fdc0 0x7f73d80601a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f73d8060e00 tx=0x7f73d4006eb0).ready entity=mon.0 client_cookie=831f640ef74bbd9 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:39.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73dce0d700 1 -- 172.21.2.105:0/993706426 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73d400d5c0 con 0x7f73d805fdc0 2021-11-12T05:40:39.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73dce0d700 1 -- 172.21.2.105:0/993706426 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d4000e90 con 0x7f73d805fdc0 2021-11-12T05:40:39.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73dce0d700 1 -- 172.21.2.105:0/993706426 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73d400d910 con 0x7f73d805fdc0 2021-11-12T05:40:39.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73e0073700 1 -- 172.21.2.105:0/993706426 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f73d805fdc0 msgr2=0x7f73d80601a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73e0073700 1 --2- 172.21.2.105:0/993706426 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f73d805fdc0 0x7f73d80601a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f73d8060e00 tx=0x7f73d4006eb0).stop 2021-11-12T05:40:39.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73e0073700 1 -- 172.21.2.105:0/993706426 shutdown_connections 2021-11-12T05:40:39.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73e0073700 1 --2- 172.21.2.105:0/993706426 >> v2:172.21.2.115:3300/0 conn(0x7f73d80ade80 0x7f73d8066730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:39.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73e0073700 1 --2- 172.21.2.105:0/993706426 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f73d805fdc0 0x7f73d80601a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:39.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73e0073700 1 -- 172.21.2.105:0/993706426 >> 172.21.2.105:0/993706426 conn(0x7f73d80608d0 msgr2=0x7f73d805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:39.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73e0073700 1 -- 172.21.2.105:0/993706426 shutdown_connections 2021-11-12T05:40:39.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73e0073700 1 -- 172.21.2.105:0/993706426 wait complete. 2021-11-12T05:40:39.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73e0073700 1 Processor -- start 2021-11-12T05:40:39.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73e0073700 1 -- start start 2021-11-12T05:40:39.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73e0073700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f73d805fdc0 0x7f73d80b0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73e0073700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f73d80ade80 0x7f73d813cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73e0073700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f73d813a9c0 0x7f73d813d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73e0073700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d80b7a00 con 0x7f73d813a9c0 2021-11-12T05:40:39.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73e0073700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d813c530 con 0x7f73d805fdc0 2021-11-12T05:40:39.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73e0073700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d813c7d0 con 0x7f73d80ade80 2021-11-12T05:40:39.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73de610700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f73d813a9c0 0x7f73d813d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:39.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73de610700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f73d813a9c0 0x7f73d813d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42782/0 (socket says 172.21.2.105:42782) 2021-11-12T05:40:39.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73de610700 1 -- 172.21.2.105:0/1302514188 learned_addr learned my addr 172.21.2.105:0/1302514188 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:39.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73de610700 1 -- 172.21.2.105:0/1302514188 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f73d80ade80 msgr2=0x7f73d813cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73de610700 1 --2- 172.21.2.105:0/1302514188 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f73d80ade80 0x7f73d813cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:39.545 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73de610700 1 -- 172.21.2.105:0/1302514188 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f73d805fdc0 msgr2=0x7f73d80b0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.545 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73de610700 1 --2- 172.21.2.105:0/1302514188 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f73d805fdc0 0x7f73d80b0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:39.545 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73de610700 1 -- 172.21.2.105:0/1302514188 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d400b1e0 con 0x7f73d813a9c0 2021-11-12T05:40:39.545 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73de610700 1 --2- 172.21.2.105:0/1302514188 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f73d813a9c0 0x7f73d813d4a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f73d0001250 tx=0x7f73d00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:39.545 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73caffd700 1 -- 172.21.2.105:0/1302514188 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73d00014e0 con 0x7f73d813a9c0 2021-11-12T05:40:39.546 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73caffd700 1 -- 172.21.2.105:0/1302514188 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d0001640 con 0x7f73d813a9c0 2021-11-12T05:40:39.546 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73caffd700 1 -- 172.21.2.105:0/1302514188 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73d00019a0 con 0x7f73d813a9c0 2021-11-12T05:40:39.546 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73e0073700 1 -- 172.21.2.105:0/1302514188 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73d80b0d10 con 0x7f73d813a9c0 2021-11-12T05:40:39.546 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.529+0000 7f73e0073700 1 -- 172.21.2.105:0/1302514188 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73d813b7d0 con 0x7f73d813a9c0 2021-11-12T05:40:39.547 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.533+0000 7f73e0073700 1 -- 172.21.2.105:0/1302514188 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73d8145050 con 0x7f73d813a9c0 2021-11-12T05:40:39.547 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.533+0000 7f73caffd700 1 -- 172.21.2.105:0/1302514188 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f73d0018030 con 0x7f73d813a9c0 2021-11-12T05:40:39.547 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.533+0000 7f73caffd700 1 --2- 172.21.2.105:0/1302514188 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f73b8053660 0x7f73b8055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.547 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.533+0000 7f73caffd700 1 -- 172.21.2.105:0/1302514188 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f73d006b510 con 0x7f73d813a9c0 2021-11-12T05:40:39.548 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.533+0000 7f73dde0f700 1 --2- 172.21.2.105:0/1302514188 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f73b8053660 0x7f73b8055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:39.548 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.533+0000 7f73dde0f700 1 --2- 172.21.2.105:0/1302514188 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f73b8053660 0x7f73b8055b20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f73d8060e00 tx=0x7f73d4015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:39.548 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.533+0000 7f73caffd700 1 -- 172.21.2.105:0/1302514188 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f73d00424b0 con 0x7f73d813a9c0 2021-11-12T05:40:39.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.618+0000 7f73e0073700 1 -- 172.21.2.105:0/1302514188 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73d813c990 con 0x7f73d813a9c0 2021-11-12T05:40:39.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.618+0000 7f73caffd700 1 -- 172.21.2.105:0/1302514188 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f73d0045ad0 con 0x7f73d813a9c0 2021-11-12T05:40:39.620 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:40:39.621 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":25,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:40:38.203083+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:40:32.786926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-12T05:40:35.006506+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:40:39.622 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.618+0000 7f73e0073700 1 -- 172.21.2.105:0/1302514188 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f73b8053660 msgr2=0x7f73b8055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.622 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.618+0000 7f73e0073700 1 --2- 172.21.2.105:0/1302514188 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f73b8053660 0x7f73b8055b20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f73d8060e00 tx=0x7f73d4015000).stop 2021-11-12T05:40:39.622 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.618+0000 7f73e0073700 1 -- 172.21.2.105:0/1302514188 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f73d813a9c0 msgr2=0x7f73d813d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.623 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.618+0000 7f73e0073700 1 --2- 172.21.2.105:0/1302514188 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f73d813a9c0 0x7f73d813d4a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f73d0001250 tx=0x7f73d00090f0).stop 2021-11-12T05:40:39.623 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.618+0000 7f73e0073700 1 -- 172.21.2.105:0/1302514188 shutdown_connections 2021-11-12T05:40:39.623 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.618+0000 7f73e0073700 1 --2- 172.21.2.105:0/1302514188 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f73b8053660 0x7f73b8055b20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:39.623 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.618+0000 7f73e0073700 1 --2- 172.21.2.105:0/1302514188 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f73d813a9c0 0x7f73d813d4a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:39.624 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.618+0000 7f73e0073700 1 --2- 172.21.2.105:0/1302514188 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f73d80ade80 0x7f73d813cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:39.624 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.618+0000 7f73e0073700 1 --2- 172.21.2.105:0/1302514188 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f73d805fdc0 0x7f73d80b0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:39.624 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.618+0000 7f73e0073700 1 -- 172.21.2.105:0/1302514188 >> 172.21.2.105:0/1302514188 conn(0x7f73d80608d0 msgr2=0x7f73d8139540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:39.625 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.618+0000 7f73e0073700 1 -- 172.21.2.105:0/1302514188 shutdown_connections 2021-11-12T05:40:39.625 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.618+0000 7f73e0073700 1 -- 172.21.2.105:0/1302514188 wait complete. 2021-11-12T05:40:39.628 INFO:tasks.ceph.ceph_manager.ceph:all up! 2021-11-12T05:40:39.629 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:40:39.680 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d97249700 1 Processor -- start 2021-11-12T05:40:39.680 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d97249700 1 -- start start 2021-11-12T05:40:39.680 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d97249700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f0d900ad080 0x7f0d900af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.681 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d97249700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f0d900ac280 0x7f0d900ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.681 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d97249700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d900ac7b0 con 0x7f0d9014abe0 2021-11-12T05:40:39.681 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d97249700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d901488a0 con 0x7f0d900ac280 2021-11-12T05:40:39.681 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d97249700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d900ac9e0 con 0x7f0d900ad080 2021-11-12T05:40:39.682 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d957e6700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f0d9014abe0 0x7f0d9014b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:53184/0 (socket says 172.21.2.105:53184) 2021-11-12T05:40:39.682 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d957e6700 1 -- 172.21.2.105:0/953713994 learned_addr learned my addr 172.21.2.105:0/953713994 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:39.682 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d8ffff700 1 --2- 172.21.2.105:0/953713994 >> v2:172.21.2.105:3300/0 conn(0x7f0d900ac280 0x7f0d900ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:39.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d8ffff700 1 -- 172.21.2.105:0/953713994 >> v2:172.21.2.115:3300/0 conn(0x7f0d900ad080 msgr2=0x7f0d900af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:39.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d8ffff700 1 --2- 172.21.2.105:0/953713994 >> v2:172.21.2.115:3300/0 conn(0x7f0d900ad080 0x7f0d900af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:39.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d8ffff700 1 -- 172.21.2.105:0/953713994 >> v1:172.21.2.105:6789/0 conn(0x7f0d9014abe0 legacy=0x7f0d9014b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d8ffff700 1 -- 172.21.2.105:0/953713994 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d900b0b30 con 0x7f0d900ac280 2021-11-12T05:40:39.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d8ffff700 1 --2- 172.21.2.105:0/953713994 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d900ac280 0x7f0d900ad460 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f0d78002f70 tx=0x7f0d78006df0).ready entity=mon.0 client_cookie=bac324ee58518534 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:39.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d8f7fe700 1 -- 172.21.2.105:0/953713994 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d7800d5c0 con 0x7f0d900ac280 2021-11-12T05:40:39.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d8f7fe700 1 -- 172.21.2.105:0/953713994 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d78000e90 con 0x7f0d900ac280 2021-11-12T05:40:39.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d8f7fe700 1 -- 172.21.2.105:0/953713994 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d7800d910 con 0x7f0d900ac280 2021-11-12T05:40:39.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d97249700 1 -- 172.21.2.105:0/953713994 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d900ac280 msgr2=0x7f0d900ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d97249700 1 --2- 172.21.2.105:0/953713994 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d900ac280 0x7f0d900ad460 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f0d78002f70 tx=0x7f0d78006df0).stop 2021-11-12T05:40:39.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d97249700 1 -- 172.21.2.105:0/953713994 shutdown_connections 2021-11-12T05:40:39.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d97249700 1 --2- 172.21.2.105:0/953713994 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d900ac280 0x7f0d900ad460 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:39.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d97249700 1 --2- 172.21.2.105:0/953713994 >> v2:172.21.2.115:3300/0 conn(0x7f0d900ad080 0x7f0d900af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:39.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d97249700 1 -- 172.21.2.105:0/953713994 >> 172.21.2.105:0/953713994 conn(0x7f0d900b5370 msgr2=0x7f0d900b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:39.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d97249700 1 -- 172.21.2.105:0/953713994 shutdown_connections 2021-11-12T05:40:39.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d97249700 1 -- 172.21.2.105:0/953713994 wait complete. 2021-11-12T05:40:39.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d97249700 1 Processor -- start 2021-11-12T05:40:39.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d97249700 1 -- start start 2021-11-12T05:40:39.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d97249700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d900ac280 0x7f0d900aacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d97249700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0d900ad080 0x7f0d900ab400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d97249700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d9014abe0 0x7f0d900ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d97249700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d90064570 con 0x7f0d9014abe0 2021-11-12T05:40:39.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d97249700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d900abde0 con 0x7f0d900ad080 2021-11-12T05:40:39.692 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d97249700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d900642d0 con 0x7f0d900ac280 2021-11-12T05:40:39.692 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d957e6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d9014abe0 0x7f0d900ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:39.692 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d957e6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d9014abe0 0x7f0d900ab8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42794/0 (socket says 172.21.2.105:42794) 2021-11-12T05:40:39.692 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d957e6700 1 -- 172.21.2.105:0/712833349 learned_addr learned my addr 172.21.2.105:0/712833349 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:39.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d957e6700 1 -- 172.21.2.105:0/712833349 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d900ac280 msgr2=0x7f0d900aacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d957e6700 1 --2- 172.21.2.105:0/712833349 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d900ac280 0x7f0d900aacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:39.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d957e6700 1 -- 172.21.2.105:0/712833349 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0d900ad080 msgr2=0x7f0d900ab400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.678+0000 7f0d957e6700 1 --2- 172.21.2.105:0/712833349 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0d900ad080 0x7f0d900ab400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:39.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.682+0000 7f0d957e6700 1 -- 172.21.2.105:0/712833349 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7800b180 con 0x7f0d9014abe0 2021-11-12T05:40:39.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.682+0000 7f0d957e6700 1 --2- 172.21.2.105:0/712833349 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d9014abe0 0x7f0d900ab8f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f0d9014bc40 tx=0x7f0d88007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:39.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.682+0000 7f0d8dffb700 1 -- 172.21.2.105:0/712833349 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d88005ba0 con 0x7f0d9014abe0 2021-11-12T05:40:39.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.682+0000 7f0d8dffb700 1 -- 172.21.2.105:0/712833349 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d88005d00 con 0x7f0d9014abe0 2021-11-12T05:40:39.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.682+0000 7f0d97249700 1 -- 172.21.2.105:0/712833349 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d900a9860 con 0x7f0d9014abe0 2021-11-12T05:40:39.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.682+0000 7f0d97249700 1 -- 172.21.2.105:0/712833349 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d90066a70 con 0x7f0d9014abe0 2021-11-12T05:40:39.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.682+0000 7f0d8dffb700 1 -- 172.21.2.105:0/712833349 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d880072c0 con 0x7f0d9014abe0 2021-11-12T05:40:39.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.682+0000 7f0d97249700 1 -- 172.21.2.105:0/712833349 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d900a99f0 con 0x7f0d9014abe0 2021-11-12T05:40:39.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.682+0000 7f0d8dffb700 1 -- 172.21.2.105:0/712833349 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0d88010070 con 0x7f0d9014abe0 2021-11-12T05:40:39.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.682+0000 7f0d8dffb700 1 --2- 172.21.2.105:0/712833349 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0d74053610 0x7f0d74055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.682+0000 7f0d8dffb700 1 -- 172.21.2.105:0/712833349 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f0d8806b420 con 0x7f0d9014abe0 2021-11-12T05:40:39.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.682+0000 7f0d94fe5700 1 --2- 172.21.2.105:0/712833349 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0d74053610 0x7f0d74055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:39.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.682+0000 7f0d94fe5700 1 --2- 172.21.2.105:0/712833349 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0d74053610 0x7f0d74055ad0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f0d80002f70 tx=0x7f0d80006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:39.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.686+0000 7f0d8dffb700 1 -- 172.21.2.105:0/712833349 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0d880422b0 con 0x7f0d9014abe0 2021-11-12T05:40:39.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.766+0000 7f0d97249700 1 -- 172.21.2.105:0/712833349 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d900b1440 con 0x7f0d9014abe0 2021-11-12T05:40:39.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.766+0000 7f0d8dffb700 1 -- 172.21.2.105:0/712833349 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f0d880458d0 con 0x7f0d9014abe0 2021-11-12T05:40:39.771 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:40:39.771 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":25,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:40:38.203083+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:40:32.786926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-12T05:40:35.006506+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:40:39.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.770+0000 7f0d97249700 1 -- 172.21.2.105:0/712833349 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0d74053610 msgr2=0x7f0d74055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.770+0000 7f0d97249700 1 --2- 172.21.2.105:0/712833349 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0d74053610 0x7f0d74055ad0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f0d80002f70 tx=0x7f0d80006a80).stop 2021-11-12T05:40:39.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.770+0000 7f0d97249700 1 -- 172.21.2.105:0/712833349 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d9014abe0 msgr2=0x7f0d900ab8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.770+0000 7f0d97249700 1 --2- 172.21.2.105:0/712833349 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d9014abe0 0x7f0d900ab8f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f0d9014bc40 tx=0x7f0d88007f60).stop 2021-11-12T05:40:39.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.770+0000 7f0d97249700 1 -- 172.21.2.105:0/712833349 shutdown_connections 2021-11-12T05:40:39.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.770+0000 7f0d97249700 1 --2- 172.21.2.105:0/712833349 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0d74053610 0x7f0d74055ad0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:39.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.770+0000 7f0d97249700 1 --2- 172.21.2.105:0/712833349 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d9014abe0 0x7f0d900ab8f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:39.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.770+0000 7f0d97249700 1 --2- 172.21.2.105:0/712833349 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0d900ad080 0x7f0d900ab400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:39.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.770+0000 7f0d97249700 1 --2- 172.21.2.105:0/712833349 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d900ac280 0x7f0d900aacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:39.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.770+0000 7f0d97249700 1 -- 172.21.2.105:0/712833349 >> 172.21.2.105:0/712833349 conn(0x7f0d900b5370 msgr2=0x7f0d900b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:39.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.770+0000 7f0d97249700 1 -- 172.21.2.105:0/712833349 shutdown_connections 2021-11-12T05:40:39.776 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.770+0000 7f0d97249700 1 -- 172.21.2.105:0/712833349 wait complete. 2021-11-12T05:40:39.778 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2021-11-12T05:40:39.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.826+0000 7f9d5edc3700 1 Processor -- start 2021-11-12T05:40:39.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.826+0000 7f9d5edc3700 1 -- start start 2021-11-12T05:40:39.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.826+0000 7f9d5edc3700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9d580ad080 0x7f9d580af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.826+0000 7f9d5edc3700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f9d5814b2f0 0x7f9d580ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.826+0000 7f9d5edc3700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d580ac7b0 con 0x7f9d580ac280 2021-11-12T05:40:39.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.826+0000 7f9d5edc3700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d581488a0 con 0x7f9d5814b2f0 2021-11-12T05:40:39.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.826+0000 7f9d5edc3700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d580ac9e0 con 0x7f9d580ad080 2021-11-12T05:40:39.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.830+0000 7f9d5d360700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f9d5814b2f0 0x7f9d580ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:39.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.830+0000 7f9d5cb5f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9d580ad080 0x7f9d580af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:39.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.830+0000 7f9d57fff700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7f9d580ac280 0x7f9d5814abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:51668/0 (socket says 172.21.2.105:51668) 2021-11-12T05:40:39.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.830+0000 7f9d57fff700 1 -- 172.21.2.105:0/2432426705 learned_addr learned my addr 172.21.2.105:0/2432426705 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:39.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.830+0000 7f9d5d360700 1 -- 172.21.2.105:0/2432426705 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9d580ad080 msgr2=0x7f9d580af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:39.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.830+0000 7f9d5d360700 1 --2- 172.21.2.105:0/2432426705 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9d580ad080 0x7f9d580af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:39.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.830+0000 7f9d5d360700 1 -- 172.21.2.105:0/2432426705 >> v1:172.21.2.115:6789/0 conn(0x7f9d580ac280 legacy=0x7f9d5814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.830+0000 7f9d5d360700 1 -- 172.21.2.105:0/2432426705 --> v2:172.21.2.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d580b0b30 con 0x7f9d5814b2f0 2021-11-12T05:40:39.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.830+0000 7f9d5d360700 1 --2- 172.21.2.105:0/2432426705 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9d5814b2f0 0x7f9d580ad460 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f9d580ac6a0 tx=0x7f9d500091d0).ready entity=mon.1 client_cookie=4264690512c53525 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:39.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.830+0000 7f9d577fe700 1 -- 172.21.2.105:0/2432426705 <== mon.1 v2:172.21.2.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d5000b680 con 0x7f9d5814b2f0 2021-11-12T05:40:39.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.830+0000 7f9d577fe700 1 -- 172.21.2.105:0/2432426705 <== mon.1 v2:172.21.2.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5000b7e0 con 0x7f9d5814b2f0 2021-11-12T05:40:39.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.830+0000 7f9d577fe700 1 -- 172.21.2.105:0/2432426705 <== mon.1 v2:172.21.2.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d5000b950 con 0x7f9d5814b2f0 2021-11-12T05:40:39.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.830+0000 7f9d5edc3700 1 -- 172.21.2.105:0/2432426705 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9d5814b2f0 msgr2=0x7f9d580ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.830+0000 7f9d5edc3700 1 --2- 172.21.2.105:0/2432426705 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9d5814b2f0 0x7f9d580ad460 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f9d580ac6a0 tx=0x7f9d500091d0).stop 2021-11-12T05:40:39.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.830+0000 7f9d5edc3700 1 -- 172.21.2.105:0/2432426705 shutdown_connections 2021-11-12T05:40:39.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.830+0000 7f9d5edc3700 1 --2- 172.21.2.105:0/2432426705 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9d5814b2f0 0x7f9d580ad460 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:39.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.830+0000 7f9d5edc3700 1 --2- 172.21.2.105:0/2432426705 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9d580ad080 0x7f9d580af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:39.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.830+0000 7f9d5edc3700 1 -- 172.21.2.105:0/2432426705 >> 172.21.2.105:0/2432426705 conn(0x7f9d580b5370 msgr2=0x7f9d580b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:39.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.830+0000 7f9d5edc3700 1 -- 172.21.2.105:0/2432426705 shutdown_connections 2021-11-12T05:40:39.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.830+0000 7f9d5edc3700 1 -- 172.21.2.105:0/2432426705 wait complete. 2021-11-12T05:40:39.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.830+0000 7f9d5edc3700 1 Processor -- start 2021-11-12T05:40:39.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.830+0000 7f9d5edc3700 1 -- start start 2021-11-12T05:40:39.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.834+0000 7f9d5edc3700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9d580ac280 0x7f9d58147120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.834+0000 7f9d5edc3700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9d580ad080 0x7f9d58149c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.834+0000 7f9d5edc3700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9d5814b2f0 0x7f9d5815a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.834+0000 7f9d5edc3700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5814b090 con 0x7f9d580ad080 2021-11-12T05:40:39.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.834+0000 7f9d5edc3700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d580a9eb0 con 0x7f9d580ac280 2021-11-12T05:40:39.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.834+0000 7f9d5edc3700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d580aa150 con 0x7f9d5814b2f0 2021-11-12T05:40:39.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.834+0000 7f9d57fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9d580ad080 0x7f9d58149c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:39.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.834+0000 7f9d57fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9d580ad080 0x7f9d58149c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42806/0 (socket says 172.21.2.105:42806) 2021-11-12T05:40:39.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.834+0000 7f9d57fff700 1 -- 172.21.2.105:0/4038368937 learned_addr learned my addr 172.21.2.105:0/4038368937 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:39.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.834+0000 7f9d5cb5f700 1 --2- 172.21.2.105:0/4038368937 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9d580ac280 0x7f9d58147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:39.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.834+0000 7f9d5d360700 1 --2- 172.21.2.105:0/4038368937 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9d5814b2f0 0x7f9d5815a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:39.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.834+0000 7f9d57fff700 1 -- 172.21.2.105:0/4038368937 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9d5814b2f0 msgr2=0x7f9d5815a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.834+0000 7f9d57fff700 1 --2- 172.21.2.105:0/4038368937 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9d5814b2f0 0x7f9d5815a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:39.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.834+0000 7f9d57fff700 1 -- 172.21.2.105:0/4038368937 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9d580ac280 msgr2=0x7f9d58147120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.834+0000 7f9d57fff700 1 --2- 172.21.2.105:0/4038368937 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9d580ac280 0x7f9d58147120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:39.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.834+0000 7f9d57fff700 1 -- 172.21.2.105:0/4038368937 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d50009470 con 0x7f9d580ad080 2021-11-12T05:40:39.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.834+0000 7f9d57fff700 1 --2- 172.21.2.105:0/4038368937 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9d580ad080 0x7f9d58149c60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f9d580b0550 tx=0x7f9d40007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:39.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.834+0000 7f9d55ffb700 1 -- 172.21.2.105:0/4038368937 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d4000ce30 con 0x7f9d580ad080 2021-11-12T05:40:39.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.834+0000 7f9d55ffb700 1 -- 172.21.2.105:0/4038368937 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d400072e0 con 0x7f9d580ad080 2021-11-12T05:40:39.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.834+0000 7f9d55ffb700 1 -- 172.21.2.105:0/4038368937 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d40005800 con 0x7f9d580ad080 2021-11-12T05:40:39.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.834+0000 7f9d5edc3700 1 -- 172.21.2.105:0/4038368937 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d5814ad10 con 0x7f9d580ad080 2021-11-12T05:40:39.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.834+0000 7f9d5edc3700 1 -- 172.21.2.105:0/4038368937 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d5815a800 con 0x7f9d580ad080 2021-11-12T05:40:39.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.834+0000 7f9d5edc3700 1 -- 172.21.2.105:0/4038368937 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9d5814aea0 con 0x7f9d580ad080 2021-11-12T05:40:39.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.834+0000 7f9d55ffb700 1 -- 172.21.2.105:0/4038368937 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9d40010070 con 0x7f9d580ad080 2021-11-12T05:40:39.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.834+0000 7f9d55ffb700 1 --2- 172.21.2.105:0/4038368937 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9d3c0536a0 0x7f9d3c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.834+0000 7f9d55ffb700 1 -- 172.21.2.105:0/4038368937 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f9d4006b0e0 con 0x7f9d580ad080 2021-11-12T05:40:39.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.834+0000 7f9d5cb5f700 1 --2- 172.21.2.105:0/4038368937 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9d3c0536a0 0x7f9d3c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:39.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.834+0000 7f9d55ffb700 1 --2- 172.21.2.105:0/4038368937 >> [v2:172.21.2.105:6802/14874,v1:172.21.2.105:6803/14874] conn(0x7f9d3c05b120 0x7f9d3c05d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.834+0000 7f9d55ffb700 1 -- 172.21.2.105:0/4038368937 --> [v2:172.21.2.105:6802/14874,v1:172.21.2.105:6803/14874] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9d3c05db00 con 0x7f9d3c05b120 2021-11-12T05:40:39.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.834+0000 7f9d55ffb700 1 -- 172.21.2.105:0/4038368937 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d4006d770 con 0x7f9d580ad080 2021-11-12T05:40:39.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.834+0000 7f9d5d360700 1 --2- 172.21.2.105:0/4038368937 >> [v2:172.21.2.105:6802/14874,v1:172.21.2.105:6803/14874] conn(0x7f9d3c05b120 0x7f9d3c05d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:39.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.834+0000 7f9d5cb5f700 1 --2- 172.21.2.105:0/4038368937 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9d3c0536a0 0x7f9d3c055b60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f9d4800b000 tx=0x7f9d48008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:39.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.834+0000 7f9d5d360700 1 --2- 172.21.2.105:0/4038368937 >> [v2:172.21.2.105:6802/14874,v1:172.21.2.105:6803/14874] conn(0x7f9d3c05b120 0x7f9d3c05d540 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:39.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.834+0000 7f9d55ffb700 1 -- 172.21.2.105:0/4038368937 <== osd.0 v2:172.21.2.105:6802/14874 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f9d3c05db00 con 0x7f9d3c05b120 2021-11-12T05:40:39.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.846+0000 7f9d5edc3700 1 -- 172.21.2.105:0/4038368937 --> [v2:172.21.2.105:6802/14874,v1:172.21.2.105:6803/14874] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9d5815a000 con 0x7f9d3c05b120 2021-11-12T05:40:39.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.846+0000 7f9d55ffb700 1 -- 172.21.2.105:0/4038368937 <== osd.0 v2:172.21.2.105:6802/14874 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9d5815a000 con 0x7f9d3c05b120 2021-11-12T05:40:39.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.846+0000 7f9d5edc3700 1 -- 172.21.2.105:0/4038368937 >> [v2:172.21.2.105:6802/14874,v1:172.21.2.105:6803/14874] conn(0x7f9d3c05b120 msgr2=0x7f9d3c05d540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.846+0000 7f9d5edc3700 1 --2- 172.21.2.105:0/4038368937 >> [v2:172.21.2.105:6802/14874,v1:172.21.2.105:6803/14874] conn(0x7f9d3c05b120 0x7f9d3c05d540 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:39.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.846+0000 7f9d5edc3700 1 -- 172.21.2.105:0/4038368937 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9d3c0536a0 msgr2=0x7f9d3c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.846+0000 7f9d5edc3700 1 --2- 172.21.2.105:0/4038368937 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9d3c0536a0 0x7f9d3c055b60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f9d4800b000 tx=0x7f9d48008040).stop 2021-11-12T05:40:39.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.846+0000 7f9d5edc3700 1 -- 172.21.2.105:0/4038368937 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9d580ad080 msgr2=0x7f9d58149c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.846+0000 7f9d5edc3700 1 --2- 172.21.2.105:0/4038368937 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9d580ad080 0x7f9d58149c60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f9d580b0550 tx=0x7f9d40007c40).stop 2021-11-12T05:40:39.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.846+0000 7f9d5d360700 1 -- 172.21.2.105:0/4038368937 reap_dead start 2021-11-12T05:40:39.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.846+0000 7f9d5edc3700 1 -- 172.21.2.105:0/4038368937 shutdown_connections 2021-11-12T05:40:39.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.846+0000 7f9d5edc3700 1 -- 172.21.2.105:0/4038368937 >> 172.21.2.105:0/4038368937 conn(0x7f9d580b5370 msgr2=0x7f9d58145d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:39.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.846+0000 7f9d5edc3700 1 -- 172.21.2.105:0/4038368937 shutdown_connections 2021-11-12T05:40:39.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.846+0000 7f9d5edc3700 1 -- 172.21.2.105:0/4038368937 wait complete. 2021-11-12T05:40:39.857 INFO:teuthology.orchestra.run.gibba005.stdout:60129542149 2021-11-12T05:40:39.858 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2021-11-12T05:40:39.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.910+0000 7f1b819ac700 1 Processor -- start 2021-11-12T05:40:39.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.910+0000 7f1b819ac700 1 -- start start 2021-11-12T05:40:39.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.910+0000 7f1b819ac700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1b7c0b97a0 0x7f1b7c143780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.910+0000 7f1b819ac700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f1b7c0b4500 0x7f1b7c0b4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.910+0000 7f1b819ac700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f1b7c0b4e10 0x7f1b7c1463d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.910+0000 7f1b819ac700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b7c0b40a0 con 0x7f1b7c0b4e10 2021-11-12T05:40:39.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.910+0000 7f1b819ac700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b7c0b9b80 con 0x7f1b7c0b4500 2021-11-12T05:40:39.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.910+0000 7f1b819ac700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7c062710 con 0x7f1b7c0b97a0 2021-11-12T05:40:39.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.910+0000 7f1b811ab700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f1b7c0b4e10 0x7f1b7c1463d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:39.918 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.910+0000 7f1b811ab700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f1b7c0b4e10 0x7f1b7c1463d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42816/0 (socket says 172.21.2.105:42816) 2021-11-12T05:40:39.918 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.910+0000 7f1b811ab700 1 -- 172.21.2.105:0/2880286702 learned_addr learned my addr 172.21.2.105:0/2880286702 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:39.918 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.910+0000 7f1b811ab700 1 -- 172.21.2.105:0/2880286702 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1b7c0b97a0 msgr2=0x7f1b7c143780 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:40:39.918 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.910+0000 7f1b811ab700 1 --2- 172.21.2.105:0/2880286702 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1b7c0b97a0 0x7f1b7c143780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:39.919 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.910+0000 7f1b811ab700 1 -- 172.21.2.105:0/2880286702 >> v2:172.21.2.115:3300/0 conn(0x7f1b7c0b4500 msgr2=0x7f1b7c0b4920 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:40:39.919 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.910+0000 7f1b811ab700 1 --2- 172.21.2.105:0/2880286702 >> v2:172.21.2.115:3300/0 conn(0x7f1b7c0b4500 0x7f1b7c0b4920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:39.919 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.910+0000 7f1b811ab700 1 -- 172.21.2.105:0/2880286702 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b7c0629b0 con 0x7f1b7c0b4e10 2021-11-12T05:40:39.919 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.910+0000 7f1b811ab700 1 --2- 172.21.2.105:0/2880286702 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1b7c0b4e10 0x7f1b7c1463d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f1b740032f0 tx=0x7f1b74009290).ready entity=mon.0 client_cookie=2b101624adfbc385 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:39.919 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b7b7fe700 1 -- 172.21.2.105:0/2880286702 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b7400b870 con 0x7f1b7c0b4e10 2021-11-12T05:40:39.920 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b7b7fe700 1 -- 172.21.2.105:0/2880286702 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7400b9d0 con 0x7f1b7c0b4e10 2021-11-12T05:40:39.920 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b7b7fe700 1 -- 172.21.2.105:0/2880286702 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b7400bb80 con 0x7f1b7c0b4e10 2021-11-12T05:40:39.920 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b819ac700 1 -- 172.21.2.105:0/2880286702 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1b7c0b4e10 msgr2=0x7f1b7c1463d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.920 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b819ac700 1 --2- 172.21.2.105:0/2880286702 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1b7c0b4e10 0x7f1b7c1463d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f1b740032f0 tx=0x7f1b74009290).stop 2021-11-12T05:40:39.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b819ac700 1 -- 172.21.2.105:0/2880286702 shutdown_connections 2021-11-12T05:40:39.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b819ac700 1 --2- 172.21.2.105:0/2880286702 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1b7c0b4e10 0x7f1b7c1463d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:39.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b819ac700 1 --2- 172.21.2.105:0/2880286702 >> v2:172.21.2.115:3300/0 conn(0x7f1b7c0b4500 0x7f1b7c0b4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:39.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b819ac700 1 --2- 172.21.2.105:0/2880286702 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1b7c0b97a0 0x7f1b7c143780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:39.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b819ac700 1 -- 172.21.2.105:0/2880286702 >> 172.21.2.105:0/2880286702 conn(0x7f1b7c05c490 msgr2=0x7f1b7c0608d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:39.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b819ac700 1 -- 172.21.2.105:0/2880286702 shutdown_connections 2021-11-12T05:40:39.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b819ac700 1 -- 172.21.2.105:0/2880286702 wait complete. 2021-11-12T05:40:39.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b819ac700 1 Processor -- start 2021-11-12T05:40:39.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b819ac700 1 -- start start 2021-11-12T05:40:39.925 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b819ac700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1b7c0b4500 0x7f1b7c0b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.925 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b819ac700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1b7c0b4e10 0x7f1b7c0ae200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.925 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b819ac700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1b7c0b97a0 0x7f1b7c12ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.925 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b819ac700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7c0b6b90 con 0x7f1b7c0b97a0 2021-11-12T05:40:39.926 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b819ac700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7c13ded0 con 0x7f1b7c0b4e10 2021-11-12T05:40:39.926 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b819ac700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7c13d430 con 0x7f1b7c0b4500 2021-11-12T05:40:39.926 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b811ab700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1b7c0b97a0 0x7f1b7c12ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:39.926 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b811ab700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1b7c0b97a0 0x7f1b7c12ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42822/0 (socket says 172.21.2.105:42822) 2021-11-12T05:40:39.927 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b811ab700 1 -- 172.21.2.105:0/2458224158 learned_addr learned my addr 172.21.2.105:0/2458224158 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:39.927 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b811ab700 1 -- 172.21.2.105:0/2458224158 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1b7c0b4500 msgr2=0x7f1b7c0b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.927 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b811ab700 1 --2- 172.21.2.105:0/2458224158 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1b7c0b4500 0x7f1b7c0b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:39.927 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b811ab700 1 -- 172.21.2.105:0/2458224158 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1b7c0b4e10 msgr2=0x7f1b7c0ae200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b811ab700 1 --2- 172.21.2.105:0/2458224158 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1b7c0b4e10 0x7f1b7c0ae200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:39.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b811ab700 1 -- 172.21.2.105:0/2458224158 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b74009530 con 0x7f1b7c0b97a0 2021-11-12T05:40:39.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b811ab700 1 --2- 172.21.2.105:0/2458224158 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1b7c0b97a0 0x7f1b7c12ce10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f1b740032f0 tx=0x7f1b74016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:39.929 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b79ffb700 1 -- 172.21.2.105:0/2458224158 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b74021630 con 0x7f1b7c0b97a0 2021-11-12T05:40:39.929 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b79ffb700 1 -- 172.21.2.105:0/2458224158 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b74021790 con 0x7f1b7c0b97a0 2021-11-12T05:40:39.929 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b79ffb700 1 -- 172.21.2.105:0/2458224158 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b74021af0 con 0x7f1b7c0b97a0 2021-11-12T05:40:39.929 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b819ac700 1 -- 172.21.2.105:0/2458224158 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b7c140640 con 0x7f1b7c0b97a0 2021-11-12T05:40:39.929 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b819ac700 1 -- 172.21.2.105:0/2458224158 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b7c0ae6f0 con 0x7f1b7c0b97a0 2021-11-12T05:40:39.930 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b819ac700 1 -- 172.21.2.105:0/2458224158 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1b7c13dd50 con 0x7f1b7c0b97a0 2021-11-12T05:40:39.930 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b79ffb700 1 -- 172.21.2.105:0/2458224158 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1b7400f070 con 0x7f1b7c0b97a0 2021-11-12T05:40:39.930 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b79ffb700 1 --2- 172.21.2.105:0/2458224158 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1b600536f0 0x7f1b60055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.930 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b79ffb700 1 -- 172.21.2.105:0/2458224158 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f1b7406d900 con 0x7f1b7c0b97a0 2021-11-12T05:40:39.931 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b79ffb700 1 --2- 172.21.2.105:0/2458224158 >> [v2:172.21.2.105:6810/14875,v1:172.21.2.105:6811/14875] conn(0x7f1b6005b270 0x7f1b6005d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.931 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b79ffb700 1 -- 172.21.2.105:0/2458224158 --> [v2:172.21.2.105:6810/14875,v1:172.21.2.105:6811/14875] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1b6005dc50 con 0x7f1b6005b270 2021-11-12T05:40:39.931 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b79ffb700 1 -- 172.21.2.105:0/2458224158 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b74072240 con 0x7f1b7c0b97a0 2021-11-12T05:40:39.931 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b809aa700 1 --2- 172.21.2.105:0/2458224158 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1b600536f0 0x7f1b60055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:39.931 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b7bfff700 1 --2- 172.21.2.105:0/2458224158 >> [v2:172.21.2.105:6810/14875,v1:172.21.2.105:6811/14875] conn(0x7f1b6005b270 0x7f1b6005d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:39.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b809aa700 1 --2- 172.21.2.105:0/2458224158 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1b600536f0 0x7f1b60055bb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f1b64000ed0 tx=0x7f1b64006930).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:39.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.914+0000 7f1b7bfff700 1 --2- 172.21.2.105:0/2458224158 >> [v2:172.21.2.105:6810/14875,v1:172.21.2.105:6811/14875] conn(0x7f1b6005b270 0x7f1b6005d690 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:39.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.918+0000 7f1b79ffb700 1 -- 172.21.2.105:0/2458224158 <== osd.1 v2:172.21.2.105:6810/14875 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f1b6005dc50 con 0x7f1b6005b270 2021-11-12T05:40:39.933 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.926+0000 7f1b819ac700 1 -- 172.21.2.105:0/2458224158 --> [v2:172.21.2.105:6810/14875,v1:172.21.2.105:6811/14875] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1b7c0b6b90 con 0x7f1b6005b270 2021-11-12T05:40:39.933 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.926+0000 7f1b79ffb700 1 -- 172.21.2.105:0/2458224158 <== osd.1 v2:172.21.2.105:6810/14875 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1b7c0b6b90 con 0x7f1b6005b270 2021-11-12T05:40:39.934 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.926+0000 7f1b819ac700 1 -- 172.21.2.105:0/2458224158 >> [v2:172.21.2.105:6810/14875,v1:172.21.2.105:6811/14875] conn(0x7f1b6005b270 msgr2=0x7f1b6005d690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.934 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.926+0000 7f1b819ac700 1 --2- 172.21.2.105:0/2458224158 >> [v2:172.21.2.105:6810/14875,v1:172.21.2.105:6811/14875] conn(0x7f1b6005b270 0x7f1b6005d690 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:39.935 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.926+0000 7f1b819ac700 1 -- 172.21.2.105:0/2458224158 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1b600536f0 msgr2=0x7f1b60055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.935 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.926+0000 7f1b819ac700 1 --2- 172.21.2.105:0/2458224158 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1b600536f0 0x7f1b60055bb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f1b64000ed0 tx=0x7f1b64006930).stop 2021-11-12T05:40:39.935 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.926+0000 7f1b819ac700 1 -- 172.21.2.105:0/2458224158 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1b7c0b97a0 msgr2=0x7f1b7c12ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.935 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.926+0000 7f1b819ac700 1 --2- 172.21.2.105:0/2458224158 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1b7c0b97a0 0x7f1b7c12ce10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f1b740032f0 tx=0x7f1b74016000).stop 2021-11-12T05:40:39.935 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.926+0000 7f1b811ab700 1 -- 172.21.2.105:0/2458224158 reap_dead start 2021-11-12T05:40:39.936 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.926+0000 7f1b819ac700 1 -- 172.21.2.105:0/2458224158 shutdown_connections 2021-11-12T05:40:39.936 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.926+0000 7f1b819ac700 1 -- 172.21.2.105:0/2458224158 >> 172.21.2.105:0/2458224158 conn(0x7f1b7c05c490 msgr2=0x7f1b7c13ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:39.936 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.926+0000 7f1b819ac700 1 -- 172.21.2.105:0/2458224158 shutdown_connections 2021-11-12T05:40:39.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.926+0000 7f1b819ac700 1 -- 172.21.2.105:0/2458224158 wait complete. 2021-11-12T05:40:39.938 INFO:teuthology.orchestra.run.gibba005.stdout:60129542149 2021-11-12T05:40:39.938 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2021-11-12T05:40:39.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.990+0000 7fbe077ea700 1 Processor -- start 2021-11-12T05:40:39.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.990+0000 7fbe077ea700 1 -- start start 2021-11-12T05:40:39.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.990+0000 7fbe077ea700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fbe000ad080 0x7fbe000af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.990+0000 7fbe077ea700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fbe000ac280 0x7fbe000ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:39.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.990+0000 7fbe077ea700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe000ac7b0 con 0x7fbe0014abe0 2021-11-12T05:40:39.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.990+0000 7fbe077ea700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe001488a0 con 0x7fbe000ad080 2021-11-12T05:40:39.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.990+0000 7fbe077ea700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe000ac9e0 con 0x7fbe000ac280 2021-11-12T05:40:39.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.990+0000 7fbe05d87700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fbe0014abe0 0x7fbe0014b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:53232/0 (socket says 172.21.2.105:53232) 2021-11-12T05:40:39.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.990+0000 7fbe05d87700 1 -- 172.21.2.105:0/652312991 learned_addr learned my addr 172.21.2.105:0/652312991 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:39.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.990+0000 7fbe05586700 1 --2- 172.21.2.105:0/652312991 >> v2:172.21.2.105:3300/0 conn(0x7fbe000ad080 0x7fbe000af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:39.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.990+0000 7fbe05586700 1 -- 172.21.2.105:0/652312991 >> v2:172.21.2.115:3300/0 conn(0x7fbe000ac280 msgr2=0x7fbe000ad460 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:40:39.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.990+0000 7fbdeffff700 1 -- 172.21.2.105:0/652312991 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 753225985 0 0) 0x7fbe000ac7b0 con 0x7fbe0014abe0 2021-11-12T05:40:39.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.990+0000 7fbe05586700 1 --2- 172.21.2.105:0/652312991 >> v2:172.21.2.115:3300/0 conn(0x7fbe000ac280 0x7fbe000ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:39.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.990+0000 7fbe05586700 1 -- 172.21.2.105:0/652312991 >> v1:172.21.2.105:6789/0 conn(0x7fbe0014abe0 legacy=0x7fbe0014b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:39.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.990+0000 7fbe05586700 1 -- 172.21.2.105:0/652312991 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe000b0b30 con 0x7fbe000ad080 2021-11-12T05:40:39.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.990+0000 7fbe05586700 1 --2- 172.21.2.105:0/652312991 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbe000ad080 0x7fbe000af730 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fbdf0002f70 tx=0x7fbdf0006df0).ready entity=mon.0 client_cookie=4874b0c0a82eea10 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:39.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.990+0000 7fbdeffff700 1 -- 172.21.2.105:0/652312991 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdf000d5c0 con 0x7fbe000ad080 2021-11-12T05:40:40.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.990+0000 7fbdeffff700 1 -- 172.21.2.105:0/652312991 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf0000e90 con 0x7fbe000ad080 2021-11-12T05:40:40.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.990+0000 7fbdeffff700 1 -- 172.21.2.105:0/652312991 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdf000d910 con 0x7fbe000ad080 2021-11-12T05:40:40.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbe077ea700 1 -- 172.21.2.105:0/652312991 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbe000ad080 msgr2=0x7fbe000af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbe077ea700 1 --2- 172.21.2.105:0/652312991 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbe000ad080 0x7fbe000af730 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fbdf0002f70 tx=0x7fbdf0006df0).stop 2021-11-12T05:40:40.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbe077ea700 1 -- 172.21.2.105:0/652312991 shutdown_connections 2021-11-12T05:40:40.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbe077ea700 1 --2- 172.21.2.105:0/652312991 >> v2:172.21.2.115:3300/0 conn(0x7fbe000ac280 0x7fbe000ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:40.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbe077ea700 1 --2- 172.21.2.105:0/652312991 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbe000ad080 0x7fbe000af730 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:40.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbe077ea700 1 -- 172.21.2.105:0/652312991 >> 172.21.2.105:0/652312991 conn(0x7fbe000b5370 msgr2=0x7fbe000b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:40.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbe077ea700 1 -- 172.21.2.105:0/652312991 shutdown_connections 2021-11-12T05:40:40.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbe077ea700 1 -- 172.21.2.105:0/652312991 wait complete. 2021-11-12T05:40:40.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbe077ea700 1 Processor -- start 2021-11-12T05:40:40.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbe077ea700 1 -- start start 2021-11-12T05:40:40.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbe077ea700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbe000ac280 0x7fbe000a7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbe077ea700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbe000ad080 0x7fbe000a7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbe077ea700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbe0014abe0 0x7fbe000b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbe077ea700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe000a7290 con 0x7fbe000ad080 2021-11-12T05:40:40.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbe077ea700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe00149a00 con 0x7fbe000ac280 2021-11-12T05:40:40.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbe077ea700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe00156de0 con 0x7fbe0014abe0 2021-11-12T05:40:40.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbe04d85700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbe000ad080 0x7fbe000a7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:40.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbe04d85700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbe000ad080 0x7fbe000a7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42838/0 (socket says 172.21.2.105:42838) 2021-11-12T05:40:40.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbe04d85700 1 -- 172.21.2.105:0/960620032 learned_addr learned my addr 172.21.2.105:0/960620032 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:40.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbe04d85700 1 -- 172.21.2.105:0/960620032 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbe0014abe0 msgr2=0x7fbe000b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbe04d85700 1 --2- 172.21.2.105:0/960620032 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbe0014abe0 0x7fbe000b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:40.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbe04d85700 1 -- 172.21.2.105:0/960620032 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbe000ac280 msgr2=0x7fbe000a7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbe04d85700 1 --2- 172.21.2.105:0/960620032 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbe000ac280 0x7fbe000a7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:40.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbe04d85700 1 -- 172.21.2.105:0/960620032 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf000b180 con 0x7fbe000ad080 2021-11-12T05:40:40.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbe04d85700 1 --2- 172.21.2.105:0/960620032 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbe000ad080 0x7fbe000a7c60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fbdfc002f70 tx=0x7fbdfc006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:40.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbdee7fc700 1 -- 172.21.2.105:0/960620032 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdfc013460 con 0x7fbe000ad080 2021-11-12T05:40:40.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbdee7fc700 1 -- 172.21.2.105:0/960620032 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdfc0135c0 con 0x7fbe000ad080 2021-11-12T05:40:40.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbe077ea700 1 -- 172.21.2.105:0/960620032 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe00156af0 con 0x7fbe000ad080 2021-11-12T05:40:40.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbe077ea700 1 -- 172.21.2.105:0/960620032 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe00149690 con 0x7fbe000ad080 2021-11-12T05:40:40.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbdee7fc700 1 -- 172.21.2.105:0/960620032 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdfc013920 con 0x7fbe000ad080 2021-11-12T05:40:40.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbe077ea700 1 -- 172.21.2.105:0/960620032 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbe00156fa0 con 0x7fbe000ad080 2021-11-12T05:40:40.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbdee7fc700 1 -- 172.21.2.105:0/960620032 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbdfc01a060 con 0x7fbe000ad080 2021-11-12T05:40:40.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbdee7fc700 1 --2- 172.21.2.105:0/960620032 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbde0053660 0x7fbde0055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbdee7fc700 1 -- 172.21.2.105:0/960620032 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fbdfc06b660 con 0x7fbe000ad080 2021-11-12T05:40:40.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbdee7fc700 1 --2- 172.21.2.105:0/960620032 >> [v2:172.21.2.105:6818/14905,v1:172.21.2.105:6819/14905] conn(0x7fbde005b1e0 0x7fbde005d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbdee7fc700 1 -- 172.21.2.105:0/960620032 --> [v2:172.21.2.105:6818/14905,v1:172.21.2.105:6819/14905] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbde005dbc0 con 0x7fbde005b1e0 2021-11-12T05:40:40.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbdee7fc700 1 -- 172.21.2.105:0/960620032 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbdfc06dc20 con 0x7fbe000ad080 2021-11-12T05:40:40.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbe05586700 1 --2- 172.21.2.105:0/960620032 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbde0053660 0x7fbde0055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:40.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbe05d87700 1 --2- 172.21.2.105:0/960620032 >> [v2:172.21.2.105:6818/14905,v1:172.21.2.105:6819/14905] conn(0x7fbde005b1e0 0x7fbde005d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:40.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbe05d87700 1 --2- 172.21.2.105:0/960620032 >> [v2:172.21.2.105:6818/14905,v1:172.21.2.105:6819/14905] conn(0x7fbde005b1e0 0x7fbde005d600 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:40.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.994+0000 7fbe05586700 1 --2- 172.21.2.105:0/960620032 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbde0053660 0x7fbde0055b20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fbdf0002f70 tx=0x7fbdf0014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:40.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:39.998+0000 7fbdee7fc700 1 -- 172.21.2.105:0/960620032 <== osd.2 v2:172.21.2.105:6818/14905 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7fbde005dbc0 con 0x7fbde005b1e0 2021-11-12T05:40:40.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.006+0000 7fbe077ea700 1 -- 172.21.2.105:0/960620032 --> [v2:172.21.2.105:6818/14905,v1:172.21.2.105:6819/14905] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbe000b1440 con 0x7fbde005b1e0 2021-11-12T05:40:40.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.006+0000 7fbdee7fc700 1 -- 172.21.2.105:0/960620032 <== osd.2 v2:172.21.2.105:6818/14905 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbe000b1440 con 0x7fbde005b1e0 2021-11-12T05:40:40.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.006+0000 7fbe077ea700 1 -- 172.21.2.105:0/960620032 >> [v2:172.21.2.105:6818/14905,v1:172.21.2.105:6819/14905] conn(0x7fbde005b1e0 msgr2=0x7fbde005d600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.006+0000 7fbe077ea700 1 --2- 172.21.2.105:0/960620032 >> [v2:172.21.2.105:6818/14905,v1:172.21.2.105:6819/14905] conn(0x7fbde005b1e0 0x7fbde005d600 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:40.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.006+0000 7fbe077ea700 1 -- 172.21.2.105:0/960620032 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbde0053660 msgr2=0x7fbde0055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.006+0000 7fbe077ea700 1 --2- 172.21.2.105:0/960620032 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbde0053660 0x7fbde0055b20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fbdf0002f70 tx=0x7fbdf0014000).stop 2021-11-12T05:40:40.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.006+0000 7fbe077ea700 1 -- 172.21.2.105:0/960620032 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbe000ad080 msgr2=0x7fbe000a7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.006+0000 7fbe077ea700 1 --2- 172.21.2.105:0/960620032 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbe000ad080 0x7fbe000a7c60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fbdfc002f70 tx=0x7fbdfc006ec0).stop 2021-11-12T05:40:40.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.006+0000 7fbe05d87700 1 -- 172.21.2.105:0/960620032 reap_dead start 2021-11-12T05:40:40.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.006+0000 7fbe077ea700 1 -- 172.21.2.105:0/960620032 shutdown_connections 2021-11-12T05:40:40.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.006+0000 7fbe077ea700 1 -- 172.21.2.105:0/960620032 >> 172.21.2.105:0/960620032 conn(0x7fbe000b5370 msgr2=0x7fbe00145c10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:40.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.006+0000 7fbe077ea700 1 -- 172.21.2.105:0/960620032 shutdown_connections 2021-11-12T05:40:40.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.006+0000 7fbe077ea700 1 -- 172.21.2.105:0/960620032 wait complete. 2021-11-12T05:40:40.018 INFO:teuthology.orchestra.run.gibba005.stdout:60129542148 2021-11-12T05:40:40.018 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2021-11-12T05:40:40.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac03cd0700 1 Processor -- start 2021-11-12T05:40:40.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac03cd0700 1 -- start start 2021-11-12T05:40:40.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac03cd0700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fabfc062010 0x7fabfc0b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac03cd0700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabfc0b2110 con 0x7fabfc0b4d50 2021-11-12T05:40:40.074 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac03cd0700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabfc0b2370 con 0x7fabfc0b3100 2021-11-12T05:40:40.074 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac03cd0700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabfc0b2610 con 0x7fabfc062010 2021-11-12T05:40:40.074 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac0226d700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fabfc0b4d50 0x7fabfc141e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:53244/0 (socket says 172.21.2.105:53244) 2021-11-12T05:40:40.074 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac0226d700 1 -- 172.21.2.105:0/2014084726 learned_addr learned my addr 172.21.2.105:0/2014084726 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:40.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac01a6c700 1 --2- 172.21.2.105:0/2014084726 >> v2:172.21.2.105:3300/0 conn(0x7fabfc062010 0x7fabfc0b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:40.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac01a6c700 1 -- 172.21.2.105:0/2014084726 >> v1:172.21.2.115:6789/0 conn(0x7fabfc0b3100 legacy=0x7fabfc0b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:40.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac01a6c700 1 -- 172.21.2.105:0/2014084726 >> v1:172.21.2.105:6789/0 conn(0x7fabfc0b4d50 legacy=0x7fabfc141e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac01a6c700 1 -- 172.21.2.105:0/2014084726 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabfc0b4330 con 0x7fabfc062010 2021-11-12T05:40:40.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac01a6c700 1 --2- 172.21.2.105:0/2014084726 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fabfc062010 0x7fabfc0b5b00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fabfc0b0ac0 tx=0x7fabf8006df0).ready entity=mon.0 client_cookie=473e03e4d3ec5d39 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:40.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac00a6a700 1 -- 172.21.2.105:0/2014084726 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabf800d5c0 con 0x7fabfc062010 2021-11-12T05:40:40.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac00a6a700 1 -- 172.21.2.105:0/2014084726 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf8000e90 con 0x7fabfc062010 2021-11-12T05:40:40.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac00a6a700 1 -- 172.21.2.105:0/2014084726 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabf800d910 con 0x7fabfc062010 2021-11-12T05:40:40.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac03cd0700 1 -- 172.21.2.105:0/2014084726 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fabfc062010 msgr2=0x7fabfc0b5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac03cd0700 1 --2- 172.21.2.105:0/2014084726 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fabfc062010 0x7fabfc0b5b00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fabfc0b0ac0 tx=0x7fabf8006df0).stop 2021-11-12T05:40:40.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac03cd0700 1 -- 172.21.2.105:0/2014084726 shutdown_connections 2021-11-12T05:40:40.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac03cd0700 1 --2- 172.21.2.105:0/2014084726 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fabfc062010 0x7fabfc0b5b00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:40.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac03cd0700 1 -- 172.21.2.105:0/2014084726 >> 172.21.2.105:0/2014084726 conn(0x7fabfc0b9790 msgr2=0x7fabfc0b9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:40.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac03cd0700 1 -- 172.21.2.105:0/2014084726 shutdown_connections 2021-11-12T05:40:40.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac03cd0700 1 -- 172.21.2.105:0/2014084726 wait complete. 2021-11-12T05:40:40.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac03cd0700 1 Processor -- start 2021-11-12T05:40:40.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac03cd0700 1 -- start start 2021-11-12T05:40:40.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac03cd0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fabfc062010 0x7fabfc146d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac03cd0700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fabfc0b3100 0x7fabfc155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac03cd0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fabfc0b4d50 0x7fabfc14ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac03cd0700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc14a220 con 0x7fabfc062010 2021-11-12T05:40:40.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac03cd0700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc112980 con 0x7fabfc0b3100 2021-11-12T05:40:40.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac03cd0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc156480 con 0x7fabfc0b4d50 2021-11-12T05:40:40.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac01a6c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fabfc062010 0x7fabfc146d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:40.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac01a6c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fabfc062010 0x7fabfc146d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42852/0 (socket says 172.21.2.105:42852) 2021-11-12T05:40:40.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac01a6c700 1 -- 172.21.2.105:0/12169095 learned_addr learned my addr 172.21.2.105:0/12169095 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:40.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac01a6c700 1 -- 172.21.2.105:0/12169095 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fabfc0b4d50 msgr2=0x7fabfc14ace0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:40:40.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac01a6c700 1 --2- 172.21.2.105:0/12169095 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fabfc0b4d50 0x7fabfc14ace0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:40.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac01a6c700 1 -- 172.21.2.105:0/12169095 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fabfc0b3100 msgr2=0x7fabfc155f90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:40:40.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac01a6c700 1 --2- 172.21.2.105:0/12169095 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fabfc0b3100 0x7fabfc155f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:40.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac01a6c700 1 -- 172.21.2.105:0/12169095 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf800b180 con 0x7fabfc062010 2021-11-12T05:40:40.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac01a6c700 1 --2- 172.21.2.105:0/12169095 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fabfc062010 0x7fabfc146d00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fabfc0b0ac0 tx=0x7fabf8012000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:40.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fabeaffd700 1 -- 172.21.2.105:0/12169095 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabf8002f50 con 0x7fabfc062010 2021-11-12T05:40:40.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fabeaffd700 1 -- 172.21.2.105:0/12169095 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf8013d50 con 0x7fabfc062010 2021-11-12T05:40:40.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fabeaffd700 1 -- 172.21.2.105:0/12169095 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabf801f640 con 0x7fabfc062010 2021-11-12T05:40:40.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac03cd0700 1 -- 172.21.2.105:0/12169095 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabfc1477c0 con 0x7fabfc062010 2021-11-12T05:40:40.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.070+0000 7fac03cd0700 1 -- 172.21.2.105:0/12169095 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabfc149850 con 0x7fabfc062010 2021-11-12T05:40:40.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.074+0000 7fac03cd0700 1 -- 172.21.2.105:0/12169095 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fabfc0b0290 con 0x7fabfc062010 2021-11-12T05:40:40.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.074+0000 7fabeaffd700 1 -- 172.21.2.105:0/12169095 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fabf8026070 con 0x7fabfc062010 2021-11-12T05:40:40.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.074+0000 7fabeaffd700 1 --2- 172.21.2.105:0/12169095 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fabdc053610 0x7fabdc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.074+0000 7fabeaffd700 1 -- 172.21.2.105:0/12169095 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fabf806c510 con 0x7fabfc062010 2021-11-12T05:40:40.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.074+0000 7fabeaffd700 1 --2- 172.21.2.105:0/12169095 >> [v2:172.21.2.105:6826/14876,v1:172.21.2.105:6827/14876] conn(0x7fabdc05b090 0x7fabdc05d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.074+0000 7fabeaffd700 1 -- 172.21.2.105:0/12169095 --> [v2:172.21.2.105:6826/14876,v1:172.21.2.105:6827/14876] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fabdc05da70 con 0x7fabdc05b090 2021-11-12T05:40:40.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.074+0000 7fabeaffd700 1 -- 172.21.2.105:0/12169095 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fabf806eba0 con 0x7fabfc062010 2021-11-12T05:40:40.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.074+0000 7fac0126b700 1 --2- 172.21.2.105:0/12169095 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fabdc053610 0x7fabdc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:40.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.074+0000 7fac0226d700 1 --2- 172.21.2.105:0/12169095 >> [v2:172.21.2.105:6826/14876,v1:172.21.2.105:6827/14876] conn(0x7fabdc05b090 0x7fabdc05d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:40.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.074+0000 7fac0226d700 1 --2- 172.21.2.105:0/12169095 >> [v2:172.21.2.105:6826/14876,v1:172.21.2.105:6827/14876] conn(0x7fabdc05b090 0x7fabdc05d4b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:40.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.074+0000 7fac0126b700 1 --2- 172.21.2.105:0/12169095 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fabdc053610 0x7fabdc055ad0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fabec002f90 tx=0x7fabec006930).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:40.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.074+0000 7fabeaffd700 1 -- 172.21.2.105:0/12169095 <== osd.3 v2:172.21.2.105:6826/14876 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7fabdc05da70 con 0x7fabdc05b090 2021-11-12T05:40:40.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.082+0000 7fac03cd0700 1 -- 172.21.2.105:0/12169095 --> [v2:172.21.2.105:6826/14876,v1:172.21.2.105:6827/14876] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fabfc147640 con 0x7fabdc05b090 2021-11-12T05:40:40.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.082+0000 7fabeaffd700 1 -- 172.21.2.105:0/12169095 <== osd.3 v2:172.21.2.105:6826/14876 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fabf40015e0 con 0x7fabdc05b090 2021-11-12T05:40:40.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.082+0000 7fac03cd0700 1 -- 172.21.2.105:0/12169095 >> [v2:172.21.2.105:6826/14876,v1:172.21.2.105:6827/14876] conn(0x7fabdc05b090 msgr2=0x7fabdc05d4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.082+0000 7fac03cd0700 1 --2- 172.21.2.105:0/12169095 >> [v2:172.21.2.105:6826/14876,v1:172.21.2.105:6827/14876] conn(0x7fabdc05b090 0x7fabdc05d4b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:40.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.082+0000 7fac03cd0700 1 -- 172.21.2.105:0/12169095 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fabdc053610 msgr2=0x7fabdc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.082+0000 7fac03cd0700 1 --2- 172.21.2.105:0/12169095 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fabdc053610 0x7fabdc055ad0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fabec002f90 tx=0x7fabec006930).stop 2021-11-12T05:40:40.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.082+0000 7fac03cd0700 1 -- 172.21.2.105:0/12169095 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fabfc062010 msgr2=0x7fabfc146d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.082+0000 7fac03cd0700 1 --2- 172.21.2.105:0/12169095 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fabfc062010 0x7fabfc146d00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fabfc0b0ac0 tx=0x7fabf8012000).stop 2021-11-12T05:40:40.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.082+0000 7fac0226d700 1 -- 172.21.2.105:0/12169095 reap_dead start 2021-11-12T05:40:40.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.082+0000 7fac03cd0700 1 -- 172.21.2.105:0/12169095 shutdown_connections 2021-11-12T05:40:40.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.082+0000 7fac03cd0700 1 -- 172.21.2.105:0/12169095 >> 172.21.2.105:0/12169095 conn(0x7fabfc0b9790 msgr2=0x7fabfc0b9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:40.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.082+0000 7fac03cd0700 1 -- 172.21.2.105:0/12169095 shutdown_connections 2021-11-12T05:40:40.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.082+0000 7fac03cd0700 1 -- 172.21.2.105:0/12169095 wait complete. 2021-11-12T05:40:40.094 INFO:teuthology.orchestra.run.gibba005.stdout:60129542149 2021-11-12T05:40:40.095 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2021-11-12T05:40:40.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85e60e2700 1 Processor -- start 2021-11-12T05:40:40.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85e60e2700 1 -- start start 2021-11-12T05:40:40.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85e60e2700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f85e00601a0 0x7f85e0141470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85e60e2700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e0066150 con 0x7f85e005fdc0 2021-11-12T05:40:40.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85e60e2700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e00663f0 con 0x7f85e00ade80 2021-11-12T05:40:40.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85e60e2700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e0141fb0 con 0x7f85e00601a0 2021-11-12T05:40:40.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85df7fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f85e005fdc0 0x7f85e0066730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:53258/0 (socket says 172.21.2.105:53258) 2021-11-12T05:40:40.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85df7fe700 1 -- 172.21.2.105:0/828820407 learned_addr learned my addr 172.21.2.105:0/828820407 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:40.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85de7fc700 1 -- 172.21.2.105:0/828820407 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3198048227 0 0) 0x7f85e0066150 con 0x7f85e005fdc0 2021-11-12T05:40:40.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85de7fc700 1 -- 172.21.2.105:0/828820407 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85c0003260 con 0x7f85e005fdc0 2021-11-12T05:40:40.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85dffff700 1 --2- 172.21.2.105:0/828820407 >> v2:172.21.2.115:3300/0 conn(0x7f85e00601a0 0x7f85e0141470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:40.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85de7fc700 1 -- 172.21.2.105:0/828820407 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1309556193 0 0) 0x7f85c0003260 con 0x7f85e005fdc0 2021-11-12T05:40:40.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85de7fc700 1 -- 172.21.2.105:0/828820407 >> v2:172.21.2.115:3300/0 conn(0x7f85e00601a0 msgr2=0x7f85e0141470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:40.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85de7fc700 1 --2- 172.21.2.105:0/828820407 >> v2:172.21.2.115:3300/0 conn(0x7f85e00601a0 0x7f85e0141470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:40.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85de7fc700 1 -- 172.21.2.105:0/828820407 >> v1:172.21.2.115:6789/0 conn(0x7f85e00ade80 legacy=0x7f85e013a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:40.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85de7fc700 1 -- 172.21.2.105:0/828820407 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e0140fd0 con 0x7f85e005fdc0 2021-11-12T05:40:40.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85de7fc700 1 -- 172.21.2.105:0/828820407 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f85d0001660 con 0x7f85e005fdc0 2021-11-12T05:40:40.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85de7fc700 1 -- 172.21.2.105:0/828820407 >> v1:172.21.2.105:6789/0 conn(0x7f85e005fdc0 legacy=0x7f85e0066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85de7fc700 1 --2- 172.21.2.105:0/828820407 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f85c0003820 0x7f85c0003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85de7fc700 1 --2- 172.21.2.105:0/828820407 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85c0004500 0x7f85c0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85de7fc700 1 --2- 172.21.2.105:0/828820407 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f85c0005050 0x7f85c000fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85de7fc700 1 -- 172.21.2.105:0/828820407 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c0010320 con 0x7f85c0004500 2021-11-12T05:40:40.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85de7fc700 1 -- 172.21.2.105:0/828820407 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c0010490 con 0x7f85c0005050 2021-11-12T05:40:40.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85de7fc700 1 -- 172.21.2.105:0/828820407 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c0010650 con 0x7f85c0003820 2021-11-12T05:40:40.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85deffd700 1 --2- 172.21.2.105:0/828820407 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85c0004500 0x7f85c0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:40.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85dffff700 1 --2- 172.21.2.105:0/828820407 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f85c0005050 0x7f85c000fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:40.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85deffd700 1 -- 172.21.2.105:0/828820407 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f85c0003820 msgr2=0x7f85c0003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:40.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85deffd700 1 --2- 172.21.2.105:0/828820407 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f85c0003820 0x7f85c0003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:40.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85deffd700 1 -- 172.21.2.105:0/828820407 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f85c0005050 msgr2=0x7f85c000fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:40.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85deffd700 1 --2- 172.21.2.105:0/828820407 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f85c0005050 0x7f85c000fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:40.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85dffff700 1 -- 172.21.2.105:0/828820407 reap_dead start 2021-11-12T05:40:40.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85deffd700 1 -- 172.21.2.105:0/828820407 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c0003260 con 0x7f85c0004500 2021-11-12T05:40:40.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85deffd700 1 --2- 172.21.2.105:0/828820407 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85c0004500 0x7f85c0004980 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f85c8001fa0 tx=0x7f85c8007a00).ready entity=mon.0 client_cookie=8134a7c1cb12d282 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:40.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85de7fc700 1 -- 172.21.2.105:0/828820407 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85c8007070 con 0x7f85c0004500 2021-11-12T05:40:40.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85de7fc700 1 -- 172.21.2.105:0/828820407 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c80071d0 con 0x7f85c0004500 2021-11-12T05:40:40.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85de7fc700 1 -- 172.21.2.105:0/828820407 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85c8006510 con 0x7f85c0004500 2021-11-12T05:40:40.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85e60e2700 1 -- 172.21.2.105:0/828820407 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85c0004500 msgr2=0x7f85c0004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85e60e2700 1 --2- 172.21.2.105:0/828820407 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85c0004500 0x7f85c0004980 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f85c8001fa0 tx=0x7f85c8007a00).stop 2021-11-12T05:40:40.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85e60e2700 1 -- 172.21.2.105:0/828820407 shutdown_connections 2021-11-12T05:40:40.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85e60e2700 1 --2- 172.21.2.105:0/828820407 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85c0004500 0x7f85c0004980 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:40.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85e60e2700 1 -- 172.21.2.105:0/828820407 >> 172.21.2.105:0/828820407 conn(0x7f85e00608d0 msgr2=0x7f85e005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:40.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85e60e2700 1 -- 172.21.2.105:0/828820407 shutdown_connections 2021-11-12T05:40:40.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.150+0000 7f85e60e2700 1 -- 172.21.2.105:0/828820407 wait complete. 2021-11-12T05:40:40.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.154+0000 7f85e60e2700 1 Processor -- start 2021-11-12T05:40:40.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.154+0000 7f85e60e2700 1 -- start start 2021-11-12T05:40:40.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.154+0000 7f85e60e2700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f85c0004500 0x7f85e00af940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.154+0000 7f85e60e2700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f85e00b8050 0x7f85e0143f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.154+0000 7f85e60e2700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85e0144440 0x7f85e01448c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.154+0000 7f85e60e2700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e00b6e70 con 0x7f85e0144440 2021-11-12T05:40:40.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.154+0000 7f85e60e2700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e01423c0 con 0x7f85c0004500 2021-11-12T05:40:40.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.154+0000 7f85e60e2700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e0142660 con 0x7f85e00b8050 2021-11-12T05:40:40.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.154+0000 7f85dffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85e0144440 0x7f85e01448c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:40.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.154+0000 7f85dffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85e0144440 0x7f85e01448c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42874/0 (socket says 172.21.2.105:42874) 2021-11-12T05:40:40.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.154+0000 7f85dffff700 1 -- 172.21.2.105:0/2495038691 learned_addr learned my addr 172.21.2.105:0/2495038691 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:40.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.154+0000 7f85dffff700 1 -- 172.21.2.105:0/2495038691 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f85e00b8050 msgr2=0x7f85e0143f50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:40:40.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.154+0000 7f85dffff700 1 --2- 172.21.2.105:0/2495038691 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f85e00b8050 0x7f85e0143f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:40.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.154+0000 7f85dffff700 1 -- 172.21.2.105:0/2495038691 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f85c0004500 msgr2=0x7f85e00af940 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:40:40.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.154+0000 7f85dffff700 1 --2- 172.21.2.105:0/2495038691 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f85c0004500 0x7f85e00af940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:40.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.154+0000 7f85dffff700 1 -- 172.21.2.105:0/2495038691 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e00b6b60 con 0x7f85e0144440 2021-11-12T05:40:40.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.154+0000 7f85dffff700 1 --2- 172.21.2.105:0/2495038691 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85e0144440 0x7f85e01448c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f85d0001110 tx=0x7f85d8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:40.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.154+0000 7f85dcff9700 1 -- 172.21.2.105:0/2495038691 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85d8016070 con 0x7f85e0144440 2021-11-12T05:40:40.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.154+0000 7f85dcff9700 1 -- 172.21.2.105:0/2495038691 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d800c040 con 0x7f85e0144440 2021-11-12T05:40:40.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.154+0000 7f85e60e2700 1 -- 172.21.2.105:0/2495038691 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e0142b00 con 0x7f85e0144440 2021-11-12T05:40:40.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.154+0000 7f85dcff9700 1 -- 172.21.2.105:0/2495038691 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85d80117e0 con 0x7f85e0144440 2021-11-12T05:40:40.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.154+0000 7f85e60e2700 1 -- 172.21.2.105:0/2495038691 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e0145100 con 0x7f85e0144440 2021-11-12T05:40:40.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.154+0000 7f85e60e2700 1 -- 172.21.2.105:0/2495038691 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f85e0142860 con 0x7f85e0144440 2021-11-12T05:40:40.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.154+0000 7f85dcff9700 1 -- 172.21.2.105:0/2495038691 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f85d8011940 con 0x7f85e0144440 2021-11-12T05:40:40.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.154+0000 7f85dcff9700 1 --2- 172.21.2.105:0/2495038691 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f85c40536d0 0x7f85c4055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.154+0000 7f85dcff9700 1 -- 172.21.2.105:0/2495038691 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f85d806bb60 con 0x7f85e0144440 2021-11-12T05:40:40.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.154+0000 7f85dcff9700 1 --2- 172.21.2.105:0/2495038691 >> [v2:172.21.2.115:6800/15096,v1:172.21.2.115:6801/15096] conn(0x7f85c405b150 0x7f85c405d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.154+0000 7f85dcff9700 1 -- 172.21.2.105:0/2495038691 --> [v2:172.21.2.115:6800/15096,v1:172.21.2.115:6801/15096] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f85c405db30 con 0x7f85c405b150 2021-11-12T05:40:40.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.154+0000 7f85dcff9700 1 -- 172.21.2.105:0/2495038691 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85d8070240 con 0x7f85e0144440 2021-11-12T05:40:40.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.154+0000 7f85df7fe700 1 --2- 172.21.2.105:0/2495038691 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f85c40536d0 0x7f85c4055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:40.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.154+0000 7f85df7fe700 1 --2- 172.21.2.105:0/2495038691 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f85c40536d0 0x7f85c4055b90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f85e0060ea0 tx=0x7f85e00662e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:40.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.154+0000 7f85deffd700 1 --2- 172.21.2.105:0/2495038691 >> [v2:172.21.2.115:6800/15096,v1:172.21.2.115:6801/15096] conn(0x7f85c405b150 0x7f85c405d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:40.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.154+0000 7f85deffd700 1 --2- 172.21.2.105:0/2495038691 >> [v2:172.21.2.115:6800/15096,v1:172.21.2.115:6801/15096] conn(0x7f85c405b150 0x7f85c405d570 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:40.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.158+0000 7f85dcff9700 1 -- 172.21.2.105:0/2495038691 <== osd.4 v2:172.21.2.115:6800/15096 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f85c405db30 con 0x7f85c405b150 2021-11-12T05:40:40.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.166+0000 7f85e60e2700 1 -- 172.21.2.105:0/2495038691 --> [v2:172.21.2.115:6800/15096,v1:172.21.2.115:6801/15096] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f85e0062540 con 0x7f85c405b150 2021-11-12T05:40:40.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.170+0000 7f85dcff9700 1 -- 172.21.2.105:0/2495038691 <== osd.4 v2:172.21.2.115:6800/15096 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f85c8000e90 con 0x7f85c405b150 2021-11-12T05:40:40.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.170+0000 7f85e60e2700 1 -- 172.21.2.105:0/2495038691 >> [v2:172.21.2.115:6800/15096,v1:172.21.2.115:6801/15096] conn(0x7f85c405b150 msgr2=0x7f85c405d570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.170+0000 7f85e60e2700 1 --2- 172.21.2.105:0/2495038691 >> [v2:172.21.2.115:6800/15096,v1:172.21.2.115:6801/15096] conn(0x7f85c405b150 0x7f85c405d570 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:40.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.170+0000 7f85e60e2700 1 -- 172.21.2.105:0/2495038691 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f85c40536d0 msgr2=0x7f85c4055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.170+0000 7f85e60e2700 1 --2- 172.21.2.105:0/2495038691 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f85c40536d0 0x7f85c4055b90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f85e0060ea0 tx=0x7f85e00662e0).stop 2021-11-12T05:40:40.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.170+0000 7f85e60e2700 1 -- 172.21.2.105:0/2495038691 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85e0144440 msgr2=0x7f85e01448c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.170+0000 7f85e60e2700 1 --2- 172.21.2.105:0/2495038691 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85e0144440 0x7f85e01448c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f85d0001110 tx=0x7f85d8008040).stop 2021-11-12T05:40:40.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.170+0000 7f85dffff700 1 -- 172.21.2.105:0/2495038691 reap_dead start 2021-11-12T05:40:40.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.170+0000 7f85e60e2700 1 -- 172.21.2.105:0/2495038691 shutdown_connections 2021-11-12T05:40:40.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.170+0000 7f85e60e2700 1 -- 172.21.2.105:0/2495038691 >> 172.21.2.105:0/2495038691 conn(0x7f85e00608d0 msgr2=0x7f85e005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:40.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.170+0000 7f85e60e2700 1 -- 172.21.2.105:0/2495038691 shutdown_connections 2021-11-12T05:40:40.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.170+0000 7f85e60e2700 1 -- 172.21.2.105:0/2495038691 wait complete. 2021-11-12T05:40:40.181 INFO:teuthology.orchestra.run.gibba005.stdout:60129542149 2021-11-12T05:40:40.181 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2021-11-12T05:40:40.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.230+0000 7f71b08da700 1 Processor -- start 2021-11-12T05:40:40.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.230+0000 7f71b08da700 1 -- start start 2021-11-12T05:40:40.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.230+0000 7f71b08da700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f71ac05fdc0 0x7f71ac0601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.230+0000 7f71b08da700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f71ac0ade80 0x7f71ac066730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.230+0000 7f71b08da700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71ac066150 con 0x7f71ac13a9c0 2021-11-12T05:40:40.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.230+0000 7f71b08da700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71ac141fb0 con 0x7f71ac0ade80 2021-11-12T05:40:40.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.230+0000 7f71b08da700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71ac0663f0 con 0x7f71ac05fdc0 2021-11-12T05:40:40.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.230+0000 7f71a9d9b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f71ac0ade80 0x7f71ac066730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:40.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.230+0000 7f71a9d9b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f71ac0ade80 0x7f71ac066730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42888/0 (socket says 172.21.2.105:42888) 2021-11-12T05:40:40.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.230+0000 7f71a9d9b700 1 -- 172.21.2.105:0/841382027 learned_addr learned my addr 172.21.2.105:0/841382027 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:40.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.230+0000 7f71a9d9b700 1 -- 172.21.2.105:0/841382027 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f71ac05fdc0 msgr2=0x7f71ac0601a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:40:40.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.230+0000 7f71a9d9b700 1 --2- 172.21.2.105:0/841382027 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f71ac05fdc0 0x7f71ac0601a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:40.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.230+0000 7f71a9d9b700 1 -- 172.21.2.105:0/841382027 >> v1:172.21.2.115:6789/0 conn(0x7f71ac13a9c0 legacy=0x7f71ac141470 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:40:40.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.230+0000 7f71a9d9b700 1 -- 172.21.2.105:0/841382027 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ac140fd0 con 0x7f71ac0ade80 2021-11-12T05:40:40.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.230+0000 7f71a9d9b700 1 --2- 172.21.2.105:0/841382027 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71ac0ade80 0x7f71ac066730 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f71ac0adc40 tx=0x7f7194006eb0).ready entity=mon.0 client_cookie=73a63f0700508be5 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:40.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.230+0000 7f71a959a700 1 -- 172.21.2.105:0/841382027 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f719400d570 con 0x7f71ac0ade80 2021-11-12T05:40:40.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.230+0000 7f71a959a700 1 -- 172.21.2.105:0/841382027 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7194000e90 con 0x7f71ac0ade80 2021-11-12T05:40:40.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.230+0000 7f71a959a700 1 -- 172.21.2.105:0/841382027 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f719400d8c0 con 0x7f71ac0ade80 2021-11-12T05:40:40.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.230+0000 7f71b08da700 1 -- 172.21.2.105:0/841382027 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71ac0ade80 msgr2=0x7f71ac066730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.230+0000 7f71b08da700 1 --2- 172.21.2.105:0/841382027 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71ac0ade80 0x7f71ac066730 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f71ac0adc40 tx=0x7f7194006eb0).stop 2021-11-12T05:40:40.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.230+0000 7f71b08da700 1 -- 172.21.2.105:0/841382027 shutdown_connections 2021-11-12T05:40:40.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.230+0000 7f71b08da700 1 --2- 172.21.2.105:0/841382027 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71ac0ade80 0x7f71ac066730 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:40.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.230+0000 7f71b08da700 1 --2- 172.21.2.105:0/841382027 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f71ac05fdc0 0x7f71ac0601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:40.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.230+0000 7f71b08da700 1 -- 172.21.2.105:0/841382027 >> 172.21.2.105:0/841382027 conn(0x7f71ac0608d0 msgr2=0x7f71ac05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:40.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.230+0000 7f71b08da700 1 -- 172.21.2.105:0/841382027 shutdown_connections 2021-11-12T05:40:40.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.230+0000 7f71b08da700 1 -- 172.21.2.105:0/841382027 wait complete. 2021-11-12T05:40:40.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.234+0000 7f71b08da700 1 Processor -- start 2021-11-12T05:40:40.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.234+0000 7f71b08da700 1 -- start start 2021-11-12T05:40:40.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.234+0000 7f71b08da700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f71ac05fdc0 0x7f71ac0b5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.234+0000 7f71b08da700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f71ac0ade80 0x7f71ac0afe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.234+0000 7f71b08da700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71ac13a9c0 0x7f71ac138e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.234+0000 7f71b08da700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ac0b8400 con 0x7f71ac13a9c0 2021-11-12T05:40:40.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.234+0000 7f71b08da700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ac0b54e0 con 0x7f71ac05fdc0 2021-11-12T05:40:40.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.234+0000 7f71b08da700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71ac0b0890 con 0x7f71ac0ade80 2021-11-12T05:40:40.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.234+0000 7f71aad9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71ac13a9c0 0x7f71ac138e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:40.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.234+0000 7f71aad9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71ac13a9c0 0x7f71ac138e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42894/0 (socket says 172.21.2.105:42894) 2021-11-12T05:40:40.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.234+0000 7f71aad9d700 1 -- 172.21.2.105:0/1448047910 learned_addr learned my addr 172.21.2.105:0/1448047910 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:40.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.234+0000 7f71aad9d700 1 -- 172.21.2.105:0/1448047910 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f71ac0ade80 msgr2=0x7f71ac0afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.234+0000 7f71aad9d700 1 --2- 172.21.2.105:0/1448047910 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f71ac0ade80 0x7f71ac0afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:40.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.234+0000 7f71aad9d700 1 -- 172.21.2.105:0/1448047910 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f71ac05fdc0 msgr2=0x7f71ac0b5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.234+0000 7f71aad9d700 1 --2- 172.21.2.105:0/1448047910 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f71ac05fdc0 0x7f71ac0b5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:40.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.234+0000 7f71aad9d700 1 -- 172.21.2.105:0/1448047910 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719400b1e0 con 0x7f71ac13a9c0 2021-11-12T05:40:40.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.234+0000 7f71aad9d700 1 --2- 172.21.2.105:0/1448047910 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71ac13a9c0 0x7f71ac138e10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f71a4001250 tx=0x7f71a40090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:40.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.234+0000 7f71a37fe700 1 -- 172.21.2.105:0/1448047910 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71a40014e0 con 0x7f71ac13a9c0 2021-11-12T05:40:40.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.234+0000 7f71a37fe700 1 -- 172.21.2.105:0/1448047910 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a4001640 con 0x7f71ac13a9c0 2021-11-12T05:40:40.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.234+0000 7f71b08da700 1 -- 172.21.2.105:0/1448047910 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71ac0b0330 con 0x7f71ac13a9c0 2021-11-12T05:40:40.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.234+0000 7f71a37fe700 1 -- 172.21.2.105:0/1448047910 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71a40019a0 con 0x7f71ac13a9c0 2021-11-12T05:40:40.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.234+0000 7f71b08da700 1 -- 172.21.2.105:0/1448047910 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71ac13e3f0 con 0x7f71ac13a9c0 2021-11-12T05:40:40.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.234+0000 7f71b08da700 1 -- 172.21.2.105:0/1448047910 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f71ac0b56a0 con 0x7f71ac13a9c0 2021-11-12T05:40:40.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.234+0000 7f71a37fe700 1 -- 172.21.2.105:0/1448047910 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f71a4018030 con 0x7f71ac13a9c0 2021-11-12T05:40:40.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.234+0000 7f71a37fe700 1 --2- 172.21.2.105:0/1448047910 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f71900536d0 0x7f7190055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.234+0000 7f71a37fe700 1 -- 172.21.2.105:0/1448047910 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f71a406b420 con 0x7f71ac13a9c0 2021-11-12T05:40:40.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.234+0000 7f71a37fe700 1 --2- 172.21.2.105:0/1448047910 >> [v2:172.21.2.115:6808/15097,v1:172.21.2.115:6809/15097] conn(0x7f719005b150 0x7f719005d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.234+0000 7f71a37fe700 1 -- 172.21.2.105:0/1448047910 --> [v2:172.21.2.115:6808/15097,v1:172.21.2.115:6809/15097] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f719005db30 con 0x7f719005b150 2021-11-12T05:40:40.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.234+0000 7f71a37fe700 1 -- 172.21.2.105:0/1448047910 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71a406dab0 con 0x7f71ac13a9c0 2021-11-12T05:40:40.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.234+0000 7f71aa59c700 1 --2- 172.21.2.105:0/1448047910 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f71900536d0 0x7f7190055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:40.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.234+0000 7f71aa59c700 1 --2- 172.21.2.105:0/1448047910 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f71900536d0 0x7f7190055b90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f719c002fb0 tx=0x7f719c0069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:40.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.234+0000 7f71a9d9b700 1 --2- 172.21.2.105:0/1448047910 >> [v2:172.21.2.115:6808/15097,v1:172.21.2.115:6809/15097] conn(0x7f719005b150 0x7f719005d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:40.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.238+0000 7f71a9d9b700 1 --2- 172.21.2.105:0/1448047910 >> [v2:172.21.2.115:6808/15097,v1:172.21.2.115:6809/15097] conn(0x7f719005b150 0x7f719005d570 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:40.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.238+0000 7f71a37fe700 1 -- 172.21.2.105:0/1448047910 <== osd.5 v2:172.21.2.115:6808/15097 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f719005db30 con 0x7f719005b150 2021-11-12T05:40:40.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.270+0000 7f71b08da700 1 -- 172.21.2.105:0/1448047910 --> [v2:172.21.2.115:6808/15097,v1:172.21.2.115:6809/15097] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f71ac0b5360 con 0x7f719005b150 2021-11-12T05:40:40.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.270+0000 7f71a37fe700 1 -- 172.21.2.105:0/1448047910 <== osd.5 v2:172.21.2.115:6808/15097 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f719400d6b0 con 0x7f719005b150 2021-11-12T05:40:40.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.270+0000 7f71b08da700 1 -- 172.21.2.105:0/1448047910 >> [v2:172.21.2.115:6808/15097,v1:172.21.2.115:6809/15097] conn(0x7f719005b150 msgr2=0x7f719005d570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.270+0000 7f71b08da700 1 --2- 172.21.2.105:0/1448047910 >> [v2:172.21.2.115:6808/15097,v1:172.21.2.115:6809/15097] conn(0x7f719005b150 0x7f719005d570 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:40.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.270+0000 7f71b08da700 1 -- 172.21.2.105:0/1448047910 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f71900536d0 msgr2=0x7f7190055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.270+0000 7f71b08da700 1 --2- 172.21.2.105:0/1448047910 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f71900536d0 0x7f7190055b90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f719c002fb0 tx=0x7f719c0069b0).stop 2021-11-12T05:40:40.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.270+0000 7f71b08da700 1 -- 172.21.2.105:0/1448047910 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71ac13a9c0 msgr2=0x7f71ac138e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.270+0000 7f71b08da700 1 --2- 172.21.2.105:0/1448047910 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71ac13a9c0 0x7f71ac138e10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f71a4001250 tx=0x7f71a40090f0).stop 2021-11-12T05:40:40.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.270+0000 7f71aad9d700 1 -- 172.21.2.105:0/1448047910 reap_dead start 2021-11-12T05:40:40.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.270+0000 7f71b08da700 1 -- 172.21.2.105:0/1448047910 shutdown_connections 2021-11-12T05:40:40.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.270+0000 7f71b08da700 1 -- 172.21.2.105:0/1448047910 >> 172.21.2.105:0/1448047910 conn(0x7f71ac0608d0 msgr2=0x7f71ac139e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:40.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.270+0000 7f71b08da700 1 -- 172.21.2.105:0/1448047910 shutdown_connections 2021-11-12T05:40:40.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.270+0000 7f71b08da700 1 -- 172.21.2.105:0/1448047910 wait complete. 2021-11-12T05:40:40.283 INFO:teuthology.orchestra.run.gibba005.stdout:60129542150 2021-11-12T05:40:40.284 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2021-11-12T05:40:40.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.342+0000 7f9fd377e700 1 Processor -- start 2021-11-12T05:40:40.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.342+0000 7f9fd377e700 1 -- start start 2021-11-12T05:40:40.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.342+0000 7f9fd377e700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f9fcc0ade80 0x7f9fcc0601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.342+0000 7f9fd377e700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f9fcc13a9c0 0x7f9fcc13ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.342+0000 7f9fd377e700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fcc066150 con 0x7f9fcc05fdc0 2021-11-12T05:40:40.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.342+0000 7f9fd377e700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fcc141fb0 con 0x7f9fcc0ade80 2021-11-12T05:40:40.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.342+0000 7f9fd377e700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fcc0663f0 con 0x7f9fcc13a9c0 2021-11-12T05:40:40.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.342+0000 7f9fd0d19700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f9fcc0ade80 0x7f9fcc0601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:40.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.342+0000 7f9fd0d19700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f9fcc0ade80 0x7f9fcc0601a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42904/0 (socket says 172.21.2.105:42904) 2021-11-12T05:40:40.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.342+0000 7f9fd0d19700 1 -- 172.21.2.105:0/4284840414 learned_addr learned my addr 172.21.2.105:0/4284840414 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:40.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.342+0000 7f9fd0d19700 1 -- 172.21.2.105:0/4284840414 >> v2:172.21.2.115:3300/0 conn(0x7f9fcc13a9c0 msgr2=0x7f9fcc13ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:40.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.342+0000 7f9fd0d19700 1 --2- 172.21.2.105:0/4284840414 >> v2:172.21.2.115:3300/0 conn(0x7f9fcc13a9c0 0x7f9fcc13ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:40.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.342+0000 7f9fd0d19700 1 -- 172.21.2.105:0/4284840414 >> v1:172.21.2.115:6789/0 conn(0x7f9fcc05fdc0 legacy=0x7f9fcc066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:40.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.342+0000 7f9fd0d19700 1 -- 172.21.2.105:0/4284840414 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fcc140fd0 con 0x7f9fcc0ade80 2021-11-12T05:40:40.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.342+0000 7f9fd0d19700 1 --2- 172.21.2.105:0/4284840414 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9fcc0ade80 0x7f9fcc0601a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f9fcc060e00 tx=0x7f9fc8006eb0).ready entity=mon.0 client_cookie=6dd2083838ecc114 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:40.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.342+0000 7f9fbffff700 1 -- 172.21.2.105:0/4284840414 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fc800d5c0 con 0x7f9fcc0ade80 2021-11-12T05:40:40.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.342+0000 7f9fbffff700 1 -- 172.21.2.105:0/4284840414 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc8000e90 con 0x7f9fcc0ade80 2021-11-12T05:40:40.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.342+0000 7f9fbffff700 1 -- 172.21.2.105:0/4284840414 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fc800d910 con 0x7f9fcc0ade80 2021-11-12T05:40:40.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.342+0000 7f9fd377e700 1 -- 172.21.2.105:0/4284840414 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9fcc0ade80 msgr2=0x7f9fcc0601a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.342+0000 7f9fd377e700 1 --2- 172.21.2.105:0/4284840414 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9fcc0ade80 0x7f9fcc0601a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f9fcc060e00 tx=0x7f9fc8006eb0).stop 2021-11-12T05:40:40.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.342+0000 7f9fd377e700 1 -- 172.21.2.105:0/4284840414 shutdown_connections 2021-11-12T05:40:40.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.342+0000 7f9fd377e700 1 --2- 172.21.2.105:0/4284840414 >> v2:172.21.2.115:3300/0 conn(0x7f9fcc13a9c0 0x7f9fcc13ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:40.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.342+0000 7f9fd377e700 1 --2- 172.21.2.105:0/4284840414 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9fcc0ade80 0x7f9fcc0601a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:40.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.342+0000 7f9fd377e700 1 -- 172.21.2.105:0/4284840414 >> 172.21.2.105:0/4284840414 conn(0x7f9fcc0608d0 msgr2=0x7f9fcc05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:40.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.342+0000 7f9fd377e700 1 -- 172.21.2.105:0/4284840414 shutdown_connections 2021-11-12T05:40:40.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.342+0000 7f9fd377e700 1 -- 172.21.2.105:0/4284840414 wait complete. 2021-11-12T05:40:40.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.342+0000 7f9fd377e700 1 Processor -- start 2021-11-12T05:40:40.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.346+0000 7f9fd377e700 1 -- start start 2021-11-12T05:40:40.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.346+0000 7f9fd377e700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9fcc05fdc0 0x7f9fcc152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.346+0000 7f9fd377e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9fcc0ade80 0x7f9fcc0b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.346+0000 7f9fd377e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9fcc13a9c0 0x7f9fcc1446e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.346+0000 7f9fd377e700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc142d20 con 0x7f9fcc13a9c0 2021-11-12T05:40:40.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.346+0000 7f9fd377e700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc063430 con 0x7f9fcc05fdc0 2021-11-12T05:40:40.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.346+0000 7f9fd377e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc142f80 con 0x7f9fcc0ade80 2021-11-12T05:40:40.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.346+0000 7f9fd1d1b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9fcc13a9c0 0x7f9fcc1446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:40.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.346+0000 7f9fd1d1b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9fcc13a9c0 0x7f9fcc1446e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42906/0 (socket says 172.21.2.105:42906) 2021-11-12T05:40:40.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.346+0000 7f9fd1d1b700 1 -- 172.21.2.105:0/3333642539 learned_addr learned my addr 172.21.2.105:0/3333642539 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:40.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.346+0000 7f9fd1d1b700 1 -- 172.21.2.105:0/3333642539 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9fcc0ade80 msgr2=0x7f9fcc0b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.346+0000 7f9fd1d1b700 1 --2- 172.21.2.105:0/3333642539 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9fcc0ade80 0x7f9fcc0b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:40.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.346+0000 7f9fd1d1b700 1 -- 172.21.2.105:0/3333642539 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9fcc05fdc0 msgr2=0x7f9fcc152550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.346+0000 7f9fd1d1b700 1 --2- 172.21.2.105:0/3333642539 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9fcc05fdc0 0x7f9fcc152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:40.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.346+0000 7f9fd1d1b700 1 -- 172.21.2.105:0/3333642539 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc800b1e0 con 0x7f9fcc13a9c0 2021-11-12T05:40:40.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.346+0000 7f9fd1d1b700 1 --2- 172.21.2.105:0/3333642539 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9fcc13a9c0 0x7f9fcc1446e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f9fc40032f0 tx=0x7f9fc40091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:40.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.346+0000 7f9fbe7fc700 1 -- 172.21.2.105:0/3333642539 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fc400f510 con 0x7f9fcc13a9c0 2021-11-12T05:40:40.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.346+0000 7f9fbe7fc700 1 -- 172.21.2.105:0/3333642539 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc400f670 con 0x7f9fcc13a9c0 2021-11-12T05:40:40.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.346+0000 7f9fd377e700 1 -- 172.21.2.105:0/3333642539 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fcc063120 con 0x7f9fcc13a9c0 2021-11-12T05:40:40.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.346+0000 7f9fbe7fc700 1 -- 172.21.2.105:0/3333642539 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fc400f7e0 con 0x7f9fcc13a9c0 2021-11-12T05:40:40.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.346+0000 7f9fd377e700 1 -- 172.21.2.105:0/3333642539 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fcc062ed0 con 0x7f9fcc13a9c0 2021-11-12T05:40:40.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.346+0000 7f9fd377e700 1 -- 172.21.2.105:0/3333642539 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9fcc143180 con 0x7f9fcc13a9c0 2021-11-12T05:40:40.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.346+0000 7f9fbe7fc700 1 -- 172.21.2.105:0/3333642539 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9fc400f070 con 0x7f9fcc13a9c0 2021-11-12T05:40:40.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.346+0000 7f9fbe7fc700 1 --2- 172.21.2.105:0/3333642539 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9fac053580 0x7f9fac055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.346+0000 7f9fbe7fc700 1 -- 172.21.2.105:0/3333642539 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f9fc406b780 con 0x7f9fcc13a9c0 2021-11-12T05:40:40.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.346+0000 7f9fd151a700 1 --2- 172.21.2.105:0/3333642539 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9fac053580 0x7f9fac055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:40.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.346+0000 7f9fbe7fc700 1 --2- 172.21.2.105:0/3333642539 >> [v2:172.21.2.115:6816/15098,v1:172.21.2.115:6817/15098] conn(0x7f9fac05b000 0x7f9fac05d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.346+0000 7f9fbe7fc700 1 -- 172.21.2.105:0/3333642539 --> [v2:172.21.2.115:6816/15098,v1:172.21.2.115:6817/15098] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9fac05da80 con 0x7f9fac05b000 2021-11-12T05:40:40.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.346+0000 7f9fbe7fc700 1 -- 172.21.2.105:0/3333642539 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9fc406dd00 con 0x7f9fcc13a9c0 2021-11-12T05:40:40.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.346+0000 7f9fd151a700 1 --2- 172.21.2.105:0/3333642539 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9fac053580 0x7f9fac055a40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f9fc0002f90 tx=0x7f9fc00069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:40.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.346+0000 7f9fd0d19700 1 --2- 172.21.2.105:0/3333642539 >> [v2:172.21.2.115:6816/15098,v1:172.21.2.115:6817/15098] conn(0x7f9fac05b000 0x7f9fac05d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:40.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.350+0000 7f9fd0d19700 1 --2- 172.21.2.105:0/3333642539 >> [v2:172.21.2.115:6816/15098,v1:172.21.2.115:6817/15098] conn(0x7f9fac05b000 0x7f9fac05d420 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:40.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.350+0000 7f9fbe7fc700 1 -- 172.21.2.105:0/3333642539 <== osd.6 v2:172.21.2.115:6816/15098 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f9fac05da80 con 0x7f9fac05b000 2021-11-12T05:40:40.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.358+0000 7f9fd377e700 1 -- 172.21.2.105:0/3333642539 --> [v2:172.21.2.115:6816/15098,v1:172.21.2.115:6817/15098] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9fcc144e90 con 0x7f9fac05b000 2021-11-12T05:40:40.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.362+0000 7f9fbe7fc700 1 -- 172.21.2.105:0/3333642539 <== osd.6 v2:172.21.2.115:6816/15098 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9fcc144e90 con 0x7f9fac05b000 2021-11-12T05:40:40.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.362+0000 7f9fd377e700 1 -- 172.21.2.105:0/3333642539 >> [v2:172.21.2.115:6816/15098,v1:172.21.2.115:6817/15098] conn(0x7f9fac05b000 msgr2=0x7f9fac05d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.362+0000 7f9fd377e700 1 --2- 172.21.2.105:0/3333642539 >> [v2:172.21.2.115:6816/15098,v1:172.21.2.115:6817/15098] conn(0x7f9fac05b000 0x7f9fac05d420 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:40.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.362+0000 7f9fd377e700 1 -- 172.21.2.105:0/3333642539 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9fac053580 msgr2=0x7f9fac055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.362+0000 7f9fd377e700 1 --2- 172.21.2.105:0/3333642539 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9fac053580 0x7f9fac055a40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f9fc0002f90 tx=0x7f9fc00069b0).stop 2021-11-12T05:40:40.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.362+0000 7f9fd377e700 1 -- 172.21.2.105:0/3333642539 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9fcc13a9c0 msgr2=0x7f9fcc1446e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.362+0000 7f9fd377e700 1 --2- 172.21.2.105:0/3333642539 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9fcc13a9c0 0x7f9fcc1446e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f9fc40032f0 tx=0x7f9fc40091a0).stop 2021-11-12T05:40:40.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.362+0000 7f9fd1d1b700 1 -- 172.21.2.105:0/3333642539 reap_dead start 2021-11-12T05:40:40.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.362+0000 7f9fd377e700 1 -- 172.21.2.105:0/3333642539 shutdown_connections 2021-11-12T05:40:40.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.362+0000 7f9fd377e700 1 -- 172.21.2.105:0/3333642539 >> 172.21.2.105:0/3333642539 conn(0x7f9fcc0608d0 msgr2=0x7f9fcc13f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:40.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.362+0000 7f9fd377e700 1 -- 172.21.2.105:0/3333642539 shutdown_connections 2021-11-12T05:40:40.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.362+0000 7f9fd377e700 1 -- 172.21.2.105:0/3333642539 wait complete. 2021-11-12T05:40:40.373 INFO:teuthology.orchestra.run.gibba005.stdout:60129542149 2021-11-12T05:40:40.374 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2021-11-12T05:40:40.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.478+0000 7fa57d4ca700 1 Processor -- start 2021-11-12T05:40:40.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.478+0000 7fa57d4ca700 1 -- start start 2021-11-12T05:40:40.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.478+0000 7fa57d4ca700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa578143b40 0x7fa5780aded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.478+0000 7fa57d4ca700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fa5780ae3c0 0x7fa5780afe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.478+0000 7fa57d4ca700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa578067860 con 0x7fa5780adaf0 2021-11-12T05:40:40.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.478+0000 7fa57d4ca700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5781404a0 con 0x7fa578143b40 2021-11-12T05:40:40.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.478+0000 7fa57d4ca700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa578143400 con 0x7fa5780ae3c0 2021-11-12T05:40:40.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.478+0000 7fa5767fc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa578143b40 0x7fa5780aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:40.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.478+0000 7fa5767fc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa578143b40 0x7fa5780aded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42918/0 (socket says 172.21.2.105:42918) 2021-11-12T05:40:40.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.478+0000 7fa5767fc700 1 -- 172.21.2.105:0/1542827881 learned_addr learned my addr 172.21.2.105:0/1542827881 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:40.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.478+0000 7fa5767fc700 1 -- 172.21.2.105:0/1542827881 >> v2:172.21.2.115:3300/0 conn(0x7fa5780ae3c0 msgr2=0x7fa5780afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:40.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.478+0000 7fa5767fc700 1 --2- 172.21.2.105:0/1542827881 >> v2:172.21.2.115:3300/0 conn(0x7fa5780ae3c0 0x7fa5780afe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:40.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.478+0000 7fa5767fc700 1 -- 172.21.2.105:0/1542827881 >> v1:172.21.2.115:6789/0 conn(0x7fa5780adaf0 legacy=0x7fa57813fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:40.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.478+0000 7fa5767fc700 1 -- 172.21.2.105:0/1542827881 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5781436a0 con 0x7fa578143b40 2021-11-12T05:40:40.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.478+0000 7fa5767fc700 1 --2- 172.21.2.105:0/1542827881 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa578143b40 0x7fa5780aded0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fa5780af9a0 tx=0x7fa568006f40).ready entity=mon.0 client_cookie=57709aeae5d46938 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:40.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.478+0000 7fa575ffb700 1 -- 172.21.2.105:0/1542827881 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa56800dc30 con 0x7fa578143b40 2021-11-12T05:40:40.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa575ffb700 1 -- 172.21.2.105:0/1542827881 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa568000e90 con 0x7fa578143b40 2021-11-12T05:40:40.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa575ffb700 1 -- 172.21.2.105:0/1542827881 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa56800be90 con 0x7fa578143b40 2021-11-12T05:40:40.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa57d4ca700 1 -- 172.21.2.105:0/1542827881 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa578143b40 msgr2=0x7fa5780aded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa57d4ca700 1 --2- 172.21.2.105:0/1542827881 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa578143b40 0x7fa5780aded0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fa5780af9a0 tx=0x7fa568006f40).stop 2021-11-12T05:40:40.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa57d4ca700 1 -- 172.21.2.105:0/1542827881 shutdown_connections 2021-11-12T05:40:40.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa57d4ca700 1 --2- 172.21.2.105:0/1542827881 >> v2:172.21.2.115:3300/0 conn(0x7fa5780ae3c0 0x7fa5780afe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:40.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa57d4ca700 1 --2- 172.21.2.105:0/1542827881 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa578143b40 0x7fa5780aded0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:40.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa57d4ca700 1 -- 172.21.2.105:0/1542827881 >> 172.21.2.105:0/1542827881 conn(0x7fa57805c490 msgr2=0x7fa57805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:40.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa57d4ca700 1 -- 172.21.2.105:0/1542827881 shutdown_connections 2021-11-12T05:40:40.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa57d4ca700 1 -- 172.21.2.105:0/1542827881 wait complete. 2021-11-12T05:40:40.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa57d4ca700 1 Processor -- start 2021-11-12T05:40:40.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa57d4ca700 1 -- start start 2021-11-12T05:40:40.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa57d4ca700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa5780adaf0 0x7fa578142df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa57d4ca700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa5780ae3c0 0x7fa5780ac160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa57d4ca700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa578143b40 0x7fa5781519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa57d4ca700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5780ab190 con 0x7fa5780adaf0 2021-11-12T05:40:40.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa57d4ca700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa578151ed0 con 0x7fa5780ae3c0 2021-11-12T05:40:40.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa57d4ca700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa578063a70 con 0x7fa578143b40 2021-11-12T05:40:40.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa576ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa5780adaf0 0x7fa578142df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:40.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa576ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa5780adaf0 0x7fa578142df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42924/0 (socket says 172.21.2.105:42924) 2021-11-12T05:40:40.498 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa576ffd700 1 -- 172.21.2.105:0/501373658 learned_addr learned my addr 172.21.2.105:0/501373658 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:40.498 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa576ffd700 1 -- 172.21.2.105:0/501373658 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa578143b40 msgr2=0x7fa5781519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.498 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa576ffd700 1 --2- 172.21.2.105:0/501373658 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa578143b40 0x7fa5781519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:40.499 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa576ffd700 1 -- 172.21.2.105:0/501373658 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa5780ae3c0 msgr2=0x7fa5780ac160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.499 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa576ffd700 1 --2- 172.21.2.105:0/501373658 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa5780ae3c0 0x7fa5780ac160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:40.499 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa576ffd700 1 -- 172.21.2.105:0/501373658 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56800b460 con 0x7fa5780adaf0 2021-11-12T05:40:40.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa576ffd700 1 --2- 172.21.2.105:0/501373658 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa5780adaf0 0x7fa578142df0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fa560002f90 tx=0x7fa560006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:40.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa56ffff700 1 -- 172.21.2.105:0/501373658 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa560009e70 con 0x7fa5780adaf0 2021-11-12T05:40:40.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa56ffff700 1 -- 172.21.2.105:0/501373658 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa560013460 con 0x7fa5780adaf0 2021-11-12T05:40:40.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa56ffff700 1 -- 172.21.2.105:0/501373658 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5600137c0 con 0x7fa5780adaf0 2021-11-12T05:40:40.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa57d4ca700 1 -- 172.21.2.105:0/501373658 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5780ab3c0 con 0x7fa5780adaf0 2021-11-12T05:40:40.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa57d4ca700 1 -- 172.21.2.105:0/501373658 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5780aa380 con 0x7fa5780adaf0 2021-11-12T05:40:40.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa57d4ca700 1 -- 172.21.2.105:0/501373658 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa578063c30 con 0x7fa5780adaf0 2021-11-12T05:40:40.505 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa56ffff700 1 -- 172.21.2.105:0/501373658 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa56000f070 con 0x7fa5780adaf0 2021-11-12T05:40:40.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa56ffff700 1 --2- 172.21.2.105:0/501373658 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa55c0535b0 0x7fa55c055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa56ffff700 1 -- 172.21.2.105:0/501373658 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fa56006b1e0 con 0x7fa5780adaf0 2021-11-12T05:40:40.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa5767fc700 1 --2- 172.21.2.105:0/501373658 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa55c0535b0 0x7fa55c055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:40.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa56ffff700 1 --2- 172.21.2.105:0/501373658 >> [v2:172.21.2.115:6824/15099,v1:172.21.2.115:6825/15099] conn(0x7fa55c05afb0 0x7fa55c05d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa56ffff700 1 -- 172.21.2.105:0/501373658 --> [v2:172.21.2.115:6824/15099,v1:172.21.2.115:6825/15099] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa55c05da30 con 0x7fa55c05afb0 2021-11-12T05:40:40.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.482+0000 7fa56ffff700 1 -- 172.21.2.105:0/501373658 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5600421e0 con 0x7fa5780adaf0 2021-11-12T05:40:40.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.486+0000 7fa5767fc700 1 --2- 172.21.2.105:0/501373658 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa55c0535b0 0x7fa55c055a70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fa5780af9a0 tx=0x7fa5781405e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:40.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.486+0000 7fa5777fe700 1 --2- 172.21.2.105:0/501373658 >> [v2:172.21.2.115:6824/15099,v1:172.21.2.115:6825/15099] conn(0x7fa55c05afb0 0x7fa55c05d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:40.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.486+0000 7fa5777fe700 1 --2- 172.21.2.105:0/501373658 >> [v2:172.21.2.115:6824/15099,v1:172.21.2.115:6825/15099] conn(0x7fa55c05afb0 0x7fa55c05d3d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:40.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.486+0000 7fa56ffff700 1 -- 172.21.2.105:0/501373658 <== osd.7 v2:172.21.2.115:6824/15099 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7fa55c05da30 con 0x7fa55c05afb0 2021-11-12T05:40:40.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.498+0000 7fa57d4ca700 1 -- 172.21.2.105:0/501373658 --> [v2:172.21.2.115:6824/15099,v1:172.21.2.115:6825/15099] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa5780b2b40 con 0x7fa55c05afb0 2021-11-12T05:40:40.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.498+0000 7fa56ffff700 1 -- 172.21.2.105:0/501373658 <== osd.7 v2:172.21.2.115:6824/15099 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa5780b2b40 con 0x7fa55c05afb0 2021-11-12T05:40:40.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.498+0000 7fa57d4ca700 1 -- 172.21.2.105:0/501373658 >> [v2:172.21.2.115:6824/15099,v1:172.21.2.115:6825/15099] conn(0x7fa55c05afb0 msgr2=0x7fa55c05d3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.498+0000 7fa57d4ca700 1 --2- 172.21.2.105:0/501373658 >> [v2:172.21.2.115:6824/15099,v1:172.21.2.115:6825/15099] conn(0x7fa55c05afb0 0x7fa55c05d3d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:40.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.498+0000 7fa57d4ca700 1 -- 172.21.2.105:0/501373658 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa55c0535b0 msgr2=0x7fa55c055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.498+0000 7fa57d4ca700 1 --2- 172.21.2.105:0/501373658 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa55c0535b0 0x7fa55c055a70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fa5780af9a0 tx=0x7fa5781405e0).stop 2021-11-12T05:40:40.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.498+0000 7fa57d4ca700 1 -- 172.21.2.105:0/501373658 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa5780adaf0 msgr2=0x7fa578142df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.498+0000 7fa57d4ca700 1 --2- 172.21.2.105:0/501373658 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa5780adaf0 0x7fa578142df0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fa560002f90 tx=0x7fa560006df0).stop 2021-11-12T05:40:40.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.498+0000 7fa5777fe700 1 -- 172.21.2.105:0/501373658 reap_dead start 2021-11-12T05:40:40.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.498+0000 7fa57d4ca700 1 -- 172.21.2.105:0/501373658 shutdown_connections 2021-11-12T05:40:40.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.498+0000 7fa57d4ca700 1 -- 172.21.2.105:0/501373658 >> 172.21.2.105:0/501373658 conn(0x7fa57805c490 msgr2=0x7fa5780b1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:40.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.498+0000 7fa57d4ca700 1 -- 172.21.2.105:0/501373658 shutdown_connections 2021-11-12T05:40:40.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.498+0000 7fa57d4ca700 1 -- 172.21.2.105:0/501373658 wait complete. 2021-11-12T05:40:40.513 INFO:teuthology.orchestra.run.gibba005.stdout:60129542150 2021-11-12T05:40:40.514 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2021-11-12T05:40:40.565 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.562+0000 7f2e70edf700 1 Processor -- start 2021-11-12T05:40:40.566 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.562+0000 7f2e70edf700 1 -- start start 2021-11-12T05:40:40.571 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.562+0000 7f2e70edf700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2e6c0ade80 0x7f2e6c0601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.571 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.562+0000 7f2e70edf700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e6c066150 con 0x7f2e6c05fdc0 2021-11-12T05:40:40.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.562+0000 7f2e70edf700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e6c0663f0 con 0x7f2e6c13a9c0 2021-11-12T05:40:40.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.562+0000 7f2e70edf700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c141fb0 con 0x7f2e6c0ade80 2021-11-12T05:40:40.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.562+0000 7f2e6a59c700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f2e6c05fdc0 0x7f2e6c066730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:53328/0 (socket says 172.21.2.105:53328) 2021-11-12T05:40:40.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.562+0000 7f2e6a59c700 1 -- 172.21.2.105:0/4028889658 learned_addr learned my addr 172.21.2.105:0/4028889658 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:40.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.562+0000 7f2e6959a700 1 -- 172.21.2.105:0/4028889658 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2146614537 0 0) 0x7f2e6c066150 con 0x7f2e6c05fdc0 2021-11-12T05:40:40.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.562+0000 7f2e6959a700 1 -- 172.21.2.105:0/4028889658 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e4c003260 con 0x7f2e6c05fdc0 2021-11-12T05:40:40.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.562+0000 7f2e6959a700 1 -- 172.21.2.105:0/4028889658 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3424279617 0 0) 0x7f2e4c003260 con 0x7f2e6c05fdc0 2021-11-12T05:40:40.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.562+0000 7f2e6959a700 1 -- 172.21.2.105:0/4028889658 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2e6c0ade80 msgr2=0x7f2e6c0601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:40.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.562+0000 7f2e6959a700 1 --2- 172.21.2.105:0/4028889658 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2e6c0ade80 0x7f2e6c0601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:40.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.562+0000 7f2e6959a700 1 -- 172.21.2.105:0/4028889658 >> v1:172.21.2.115:6789/0 conn(0x7f2e6c13a9c0 legacy=0x7f2e6c141470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:40.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.562+0000 7f2e6959a700 1 -- 172.21.2.105:0/4028889658 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6c140fd0 con 0x7f2e6c05fdc0 2021-11-12T05:40:40.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.562+0000 7f2e6959a700 1 -- 172.21.2.105:0/4028889658 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f2e5c001660 con 0x7f2e6c05fdc0 2021-11-12T05:40:40.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.562+0000 7f2e6959a700 1 -- 172.21.2.105:0/4028889658 >> v1:172.21.2.105:6789/0 conn(0x7f2e6c05fdc0 legacy=0x7f2e6c066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.562+0000 7f2e6959a700 1 --2- 172.21.2.105:0/4028889658 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2e4c003780 0x7f2e4c003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.562+0000 7f2e6959a700 1 --2- 172.21.2.105:0/4028889658 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2e6c0ade80 0x7f2e4c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.562+0000 7f2e6959a700 1 --2- 172.21.2.105:0/4028889658 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2e4c004b10 0x7f2e4c004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.562+0000 7f2e6959a700 1 -- 172.21.2.105:0/4028889658 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c00fcf0 con 0x7f2e4c003780 2021-11-12T05:40:40.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.562+0000 7f2e6959a700 1 -- 172.21.2.105:0/4028889658 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c00fe60 con 0x7f2e4c004b10 2021-11-12T05:40:40.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.562+0000 7f2e6959a700 1 -- 172.21.2.105:0/4028889658 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c010020 con 0x7f2e6c0ade80 2021-11-12T05:40:40.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.562+0000 7f2e6a59c700 1 --2- 172.21.2.105:0/4028889658 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2e4c003780 0x7f2e4c003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:40.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e6a59c700 1 -- 172.21.2.105:0/4028889658 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2e6c0ade80 msgr2=0x7f2e4c004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:40.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e6a59c700 1 --2- 172.21.2.105:0/4028889658 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2e6c0ade80 0x7f2e4c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:40.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e6a59c700 1 -- 172.21.2.105:0/4028889658 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2e4c004b10 msgr2=0x7f2e4c004f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:40.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e6a59c700 1 --2- 172.21.2.105:0/4028889658 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2e4c004b10 0x7f2e4c004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:40.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e6a59c700 1 -- 172.21.2.105:0/4028889658 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4c003260 con 0x7f2e4c003780 2021-11-12T05:40:40.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e6a59c700 1 --2- 172.21.2.105:0/4028889658 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2e4c003780 0x7f2e4c003b80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f2e6c141350 tx=0x7f2e6c0662e0).ready entity=mon.0 client_cookie=4ef2a1ccfaf003d6 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:40.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e6959a700 1 -- 172.21.2.105:0/4028889658 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e5c0070d0 con 0x7f2e4c003780 2021-11-12T05:40:40.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e6959a700 1 -- 172.21.2.105:0/4028889658 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5c007230 con 0x7f2e4c003780 2021-11-12T05:40:40.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e6959a700 1 -- 172.21.2.105:0/4028889658 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e5c00c9c0 con 0x7f2e4c003780 2021-11-12T05:40:40.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e70edf700 1 -- 172.21.2.105:0/4028889658 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2e4c003780 msgr2=0x7f2e4c003b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e70edf700 1 --2- 172.21.2.105:0/4028889658 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2e4c003780 0x7f2e4c003b80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f2e6c141350 tx=0x7f2e6c0662e0).stop 2021-11-12T05:40:40.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e6ad9d700 1 -- 172.21.2.105:0/4028889658 reap_dead start 2021-11-12T05:40:40.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e70edf700 1 -- 172.21.2.105:0/4028889658 shutdown_connections 2021-11-12T05:40:40.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e70edf700 1 -- 172.21.2.105:0/4028889658 >> 172.21.2.105:0/4028889658 conn(0x7f2e6c0608d0 msgr2=0x7f2e6c05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:40.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e70edf700 1 -- 172.21.2.105:0/4028889658 shutdown_connections 2021-11-12T05:40:40.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e70edf700 1 -- 172.21.2.105:0/4028889658 wait complete. 2021-11-12T05:40:40.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e70edf700 1 Processor -- start 2021-11-12T05:40:40.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e70edf700 1 -- start start 2021-11-12T05:40:40.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e70edf700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2e6c136780 0x7f2e6c0b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e70edf700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2e6c0b4580 0x7f2e6c131ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e70edf700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2e6c1323b0 0x7f2e6c0aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e70edf700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c136b60 con 0x7f2e6c136780 2021-11-12T05:40:40.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e70edf700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c1357d0 con 0x7f2e6c0b4580 2021-11-12T05:40:40.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e70edf700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6c135bc0 con 0x7f2e6c1323b0 2021-11-12T05:40:40.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e6a59c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2e6c136780 0x7f2e6c0b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:40.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e6a59c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2e6c136780 0x7f2e6c0b35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42944/0 (socket says 172.21.2.105:42944) 2021-11-12T05:40:40.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e6a59c700 1 -- 172.21.2.105:0/2299267030 learned_addr learned my addr 172.21.2.105:0/2299267030 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:40.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e6a59c700 1 -- 172.21.2.105:0/2299267030 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2e6c1323b0 msgr2=0x7f2e6c0aeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e6a59c700 1 --2- 172.21.2.105:0/2299267030 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2e6c1323b0 0x7f2e6c0aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:40.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e6a59c700 1 -- 172.21.2.105:0/2299267030 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2e6c0b4580 msgr2=0x7f2e6c131ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e6a59c700 1 --2- 172.21.2.105:0/2299267030 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2e6c0b4580 0x7f2e6c131ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:40.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e6a59c700 1 -- 172.21.2.105:0/2299267030 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6c0b3150 con 0x7f2e6c136780 2021-11-12T05:40:40.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e6a59c700 1 --2- 172.21.2.105:0/2299267030 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2e6c136780 0x7f2e6c0b35f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f2e6c141350 tx=0x7f2e5c013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:40.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e637fe700 1 -- 172.21.2.105:0/2299267030 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e5c01a070 con 0x7f2e6c136780 2021-11-12T05:40:40.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e637fe700 1 -- 172.21.2.105:0/2299267030 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5c0049e0 con 0x7f2e6c136780 2021-11-12T05:40:40.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e70edf700 1 -- 172.21.2.105:0/2299267030 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e6c132840 con 0x7f2e6c136780 2021-11-12T05:40:40.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e70edf700 1 -- 172.21.2.105:0/2299267030 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e6c1371f0 con 0x7f2e6c136780 2021-11-12T05:40:40.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e637fe700 1 -- 172.21.2.105:0/2299267030 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e5c0070d0 con 0x7f2e6c136780 2021-11-12T05:40:40.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e70edf700 1 -- 172.21.2.105:0/2299267030 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e6c0b32e0 con 0x7f2e6c136780 2021-11-12T05:40:40.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e637fe700 1 -- 172.21.2.105:0/2299267030 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2e5c010070 con 0x7f2e6c136780 2021-11-12T05:40:40.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e637fe700 1 --2- 172.21.2.105:0/2299267030 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2e50053720 0x7f2e50055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:40.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e637fe700 1 -- 172.21.2.105:0/2299267030 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f2e5c06bed0 con 0x7f2e6c136780 2021-11-12T05:40:40.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e69d9b700 1 --2- 172.21.2.105:0/2299267030 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2e50053720 0x7f2e50055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:40.586 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.566+0000 7f2e69d9b700 1 --2- 172.21.2.105:0/2299267030 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2e50053720 0x7f2e50055be0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f2e54002f70 tx=0x7f2e54006a10).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:40.586 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.570+0000 7f2e637fe700 1 -- 172.21.2.105:0/2299267030 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2e5c042dc0 con 0x7f2e6c136780 2021-11-12T05:40:40.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.658+0000 7f2e70edf700 1 -- 172.21.2.105:0/2299267030 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2e6c057350 con 0x7f2e6c136780 2021-11-12T05:40:40.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.658+0000 7f2e637fe700 1 -- 172.21.2.105:0/2299267030 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2e5c0463e0 con 0x7f2e6c136780 2021-11-12T05:40:40.660 INFO:teuthology.orchestra.run.gibba005.stdout:60129542148 2021-11-12T05:40:40.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.658+0000 7f2e70edf700 1 -- 172.21.2.105:0/2299267030 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2e50053720 msgr2=0x7f2e50055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.658+0000 7f2e70edf700 1 --2- 172.21.2.105:0/2299267030 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2e50053720 0x7f2e50055be0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f2e54002f70 tx=0x7f2e54006a10).stop 2021-11-12T05:40:40.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.658+0000 7f2e70edf700 1 -- 172.21.2.105:0/2299267030 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2e6c136780 msgr2=0x7f2e6c0b35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:40.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.658+0000 7f2e70edf700 1 --2- 172.21.2.105:0/2299267030 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2e6c136780 0x7f2e6c0b35f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f2e6c141350 tx=0x7f2e5c013000).stop 2021-11-12T05:40:40.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.658+0000 7f2e70edf700 1 -- 172.21.2.105:0/2299267030 shutdown_connections 2021-11-12T05:40:40.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.658+0000 7f2e70edf700 1 --2- 172.21.2.105:0/2299267030 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2e50053720 0x7f2e50055be0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:40.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.658+0000 7f2e70edf700 1 --2- 172.21.2.105:0/2299267030 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2e6c1323b0 0x7f2e6c0aeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:40.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.658+0000 7f2e70edf700 1 --2- 172.21.2.105:0/2299267030 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2e6c0b4580 0x7f2e6c131ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:40.663 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.658+0000 7f2e70edf700 1 --2- 172.21.2.105:0/2299267030 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2e6c136780 0x7f2e6c0b35f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:40.663 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.658+0000 7f2e70edf700 1 -- 172.21.2.105:0/2299267030 >> 172.21.2.105:0/2299267030 conn(0x7f2e6c0608d0 msgr2=0x7f2e6c141390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:40.663 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.658+0000 7f2e70edf700 1 -- 172.21.2.105:0/2299267030 shutdown_connections 2021-11-12T05:40:40.663 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:40.658+0000 7f2e70edf700 1 -- 172.21.2.105:0/2299267030 wait complete. 2021-11-12T05:40:40.667 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.0 2021-11-12T05:40:41.669 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2021-11-12T05:40:41.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.722+0000 7fded22a3700 1 Processor -- start 2021-11-12T05:40:41.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.722+0000 7fded22a3700 1 -- start start 2021-11-12T05:40:41.726 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.722+0000 7fded22a3700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fdecc0b2940 0x7fdecc142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:41.726 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.722+0000 7fded22a3700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdecc0b0cc0 0x7fdecc1432b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:41.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.722+0000 7fded22a3700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdecc0b2d20 con 0x7fdecc0b0780 2021-11-12T05:40:41.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.722+0000 7fded22a3700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdecc05cba0 con 0x7fdecc0b2940 2021-11-12T05:40:41.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.722+0000 7fded22a3700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc0b1fc0 con 0x7fdecc0b0cc0 2021-11-12T05:40:41.728 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.722+0000 7fded0840700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdecc0b0cc0 0x7fdecc1432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:41.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.722+0000 7fdecbfff700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fdecc0b2940 0x7fdecc142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:41.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.722+0000 7fded0840700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdecc0b0cc0 0x7fdecc1432b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3301/0 says I am v2:172.21.2.105:34146/0 (socket says 172.21.2.105:34146) 2021-11-12T05:40:41.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.722+0000 7fded0840700 1 -- 172.21.2.105:0/3822761315 learned_addr learned my addr 172.21.2.105:0/3822761315 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:41.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.726+0000 7fded0840700 1 -- 172.21.2.105:0/3822761315 >> v2:172.21.2.115:3300/0 conn(0x7fdecc0b2940 msgr2=0x7fdecc142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:41.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.726+0000 7fded0840700 1 --2- 172.21.2.105:0/3822761315 >> v2:172.21.2.115:3300/0 conn(0x7fdecc0b2940 0x7fdecc142dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:41.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.726+0000 7fded0840700 1 -- 172.21.2.105:0/3822761315 >> v1:172.21.2.115:6789/0 conn(0x7fdecc0b0780 legacy=0x7fdecc05c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:41.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.726+0000 7fded0840700 1 -- 172.21.2.105:0/3822761315 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdecc0b15e0 con 0x7fdecc0b0cc0 2021-11-12T05:40:41.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.726+0000 7fded0840700 1 --2- 172.21.2.105:0/3822761315 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdecc0b0cc0 0x7fdecc1432b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fdec40032f0 tx=0x7fdec400b530).ready entity=mon.2 client_cookie=fc2acd354b6586c3 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:41.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.726+0000 7fdecaffd700 1 -- 172.21.2.105:0/3822761315 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdec400de20 con 0x7fdecc0b0cc0 2021-11-12T05:40:41.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.726+0000 7fdecaffd700 1 -- 172.21.2.105:0/3822761315 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec4010470 con 0x7fdecc0b0cc0 2021-11-12T05:40:41.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.726+0000 7fdecaffd700 1 -- 172.21.2.105:0/3822761315 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdec40107d0 con 0x7fdecc0b0cc0 2021-11-12T05:40:41.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.726+0000 7fded22a3700 1 -- 172.21.2.105:0/3822761315 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdecc0b0cc0 msgr2=0x7fdecc1432b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:41.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.726+0000 7fded22a3700 1 --2- 172.21.2.105:0/3822761315 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdecc0b0cc0 0x7fdecc1432b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fdec40032f0 tx=0x7fdec400b530).stop 2021-11-12T05:40:41.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.726+0000 7fded22a3700 1 -- 172.21.2.105:0/3822761315 shutdown_connections 2021-11-12T05:40:41.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.726+0000 7fded22a3700 1 --2- 172.21.2.105:0/3822761315 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdecc0b0cc0 0x7fdecc1432b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:41.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.726+0000 7fded22a3700 1 --2- 172.21.2.105:0/3822761315 >> v2:172.21.2.115:3300/0 conn(0x7fdecc0b2940 0x7fdecc142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:41.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.726+0000 7fded22a3700 1 -- 172.21.2.105:0/3822761315 >> 172.21.2.105:0/3822761315 conn(0x7fdecc068440 msgr2=0x7fdecc062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:41.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.726+0000 7fded22a3700 1 -- 172.21.2.105:0/3822761315 shutdown_connections 2021-11-12T05:40:41.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.726+0000 7fded22a3700 1 -- 172.21.2.105:0/3822761315 wait complete. 2021-11-12T05:40:41.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.726+0000 7fded22a3700 1 Processor -- start 2021-11-12T05:40:41.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.726+0000 7fded22a3700 1 -- start start 2021-11-12T05:40:41.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.726+0000 7fded22a3700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdecc0b0780 0x7fdecc148180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:41.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.726+0000 7fded22a3700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdecc0b0cc0 0x7fdecc1461b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:41.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.726+0000 7fded22a3700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdecc0b2940 0x7fdecc1466a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:41.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.726+0000 7fded22a3700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc066050 con 0x7fdecc0b0780 2021-11-12T05:40:41.738 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.726+0000 7fded22a3700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc0662f0 con 0x7fdecc0b2940 2021-11-12T05:40:41.738 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.726+0000 7fded22a3700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc146b90 con 0x7fdecc0b0cc0 2021-11-12T05:40:41.738 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.726+0000 7fdecbfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdecc0b0780 0x7fdecc148180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:41.738 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.730+0000 7fdecbfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdecc0b0780 0x7fdecc148180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42958/0 (socket says 172.21.2.105:42958) 2021-11-12T05:40:41.738 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.730+0000 7fdecbfff700 1 -- 172.21.2.105:0/1634673305 learned_addr learned my addr 172.21.2.105:0/1634673305 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:41.739 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.730+0000 7fdecbfff700 1 -- 172.21.2.105:0/1634673305 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdecc0b0cc0 msgr2=0x7fdecc1461b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:41.739 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.730+0000 7fdecbfff700 1 --2- 172.21.2.105:0/1634673305 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdecc0b0cc0 0x7fdecc1461b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:41.739 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.730+0000 7fdecbfff700 1 -- 172.21.2.105:0/1634673305 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdecc0b2940 msgr2=0x7fdecc1466a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:41.739 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.730+0000 7fdecbfff700 1 --2- 172.21.2.105:0/1634673305 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdecc0b2940 0x7fdecc1466a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:41.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.730+0000 7fdecbfff700 1 -- 172.21.2.105:0/1634673305 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec400b7d0 con 0x7fdecc0b0780 2021-11-12T05:40:41.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.730+0000 7fdecbfff700 1 --2- 172.21.2.105:0/1634673305 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdecc0b0780 0x7fdecc148180 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fdebc00c000 tx=0x7fdebc006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:41.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.730+0000 7fdec97fa700 1 -- 172.21.2.105:0/1634673305 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdebc010780 con 0x7fdecc0b0780 2021-11-12T05:40:41.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.730+0000 7fdec97fa700 1 -- 172.21.2.105:0/1634673305 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdebc0108e0 con 0x7fdecc0b0780 2021-11-12T05:40:41.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.730+0000 7fded22a3700 1 -- 172.21.2.105:0/1634673305 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdecc066590 con 0x7fdecc0b0780 2021-11-12T05:40:41.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.730+0000 7fded22a3700 1 -- 172.21.2.105:0/1634673305 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdecc140d30 con 0x7fdecc0b0780 2021-11-12T05:40:41.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.730+0000 7fdec97fa700 1 -- 172.21.2.105:0/1634673305 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdebc010c40 con 0x7fdecc0b0780 2021-11-12T05:40:41.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.730+0000 7fded22a3700 1 -- 172.21.2.105:0/1634673305 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdecc142f50 con 0x7fdecc0b0780 2021-11-12T05:40:41.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.730+0000 7fdec97fa700 1 -- 172.21.2.105:0/1634673305 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdebc01c460 con 0x7fdecc0b0780 2021-11-12T05:40:41.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.730+0000 7fdec97fa700 1 --2- 172.21.2.105:0/1634673305 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdeac0536a0 0x7fdeac055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:41.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.730+0000 7fdec97fa700 1 -- 172.21.2.105:0/1634673305 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fdebc06c060 con 0x7fdecc0b0780 2021-11-12T05:40:41.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.730+0000 7fdecb7fe700 1 --2- 172.21.2.105:0/1634673305 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdeac0536a0 0x7fdeac055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:41.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.730+0000 7fdecb7fe700 1 --2- 172.21.2.105:0/1634673305 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdeac0536a0 0x7fdeac055b60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fdecc0b2f60 tx=0x7fdec0007810).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:41.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.734+0000 7fdec97fa700 1 -- 172.21.2.105:0/1634673305 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdebc042ef0 con 0x7fdecc0b0780 2021-11-12T05:40:41.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.814+0000 7fded22a3700 1 -- 172.21.2.105:0/1634673305 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdecc0b1880 con 0x7fdecc0b0780 2021-11-12T05:40:41.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.814+0000 7fdec97fa700 1 -- 172.21.2.105:0/1634673305 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdebc046510 con 0x7fdecc0b0780 2021-11-12T05:40:41.818 INFO:teuthology.orchestra.run.gibba005.stdout:60129542149 2021-11-12T05:40:41.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.814+0000 7fded22a3700 1 -- 172.21.2.105:0/1634673305 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdeac0536a0 msgr2=0x7fdeac055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:41.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.814+0000 7fded22a3700 1 --2- 172.21.2.105:0/1634673305 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdeac0536a0 0x7fdeac055b60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fdecc0b2f60 tx=0x7fdec0007810).stop 2021-11-12T05:40:41.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.814+0000 7fded22a3700 1 -- 172.21.2.105:0/1634673305 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdecc0b0780 msgr2=0x7fdecc148180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:41.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.814+0000 7fded22a3700 1 --2- 172.21.2.105:0/1634673305 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdecc0b0780 0x7fdecc148180 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fdebc00c000 tx=0x7fdebc006df0).stop 2021-11-12T05:40:41.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.814+0000 7fded22a3700 1 -- 172.21.2.105:0/1634673305 shutdown_connections 2021-11-12T05:40:41.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.814+0000 7fded22a3700 1 --2- 172.21.2.105:0/1634673305 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdeac0536a0 0x7fdeac055b60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:41.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.814+0000 7fded22a3700 1 --2- 172.21.2.105:0/1634673305 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdecc0b2940 0x7fdecc1466a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:41.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.814+0000 7fded22a3700 1 --2- 172.21.2.105:0/1634673305 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdecc0b0cc0 0x7fdecc1461b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:41.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.814+0000 7fded22a3700 1 --2- 172.21.2.105:0/1634673305 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdecc0b0780 0x7fdecc148180 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:41.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.814+0000 7fded22a3700 1 -- 172.21.2.105:0/1634673305 >> 172.21.2.105:0/1634673305 conn(0x7fdecc068440 msgr2=0x7fdecc0ac310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:41.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.814+0000 7fded22a3700 1 -- 172.21.2.105:0/1634673305 shutdown_connections 2021-11-12T05:40:41.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.814+0000 7fded22a3700 1 -- 172.21.2.105:0/1634673305 wait complete. 2021-11-12T05:40:41.825 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.0 2021-11-12T05:40:41.826 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2021-11-12T05:40:41.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.874+0000 7fd8cac18700 1 Processor -- start 2021-11-12T05:40:41.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.874+0000 7fd8cac18700 1 -- start start 2021-11-12T05:40:41.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.874+0000 7fd8cac18700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fd8c405fdc0 0x7fd8c40601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:41.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.874+0000 7fd8cac18700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd8c40ade80 0x7fd8c4066730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:41.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.874+0000 7fd8cac18700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd8c413a9c0 0x7fd8c413ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:41.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.874+0000 7fd8cac18700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8c4141fb0 con 0x7fd8c413a9c0 2021-11-12T05:40:41.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.874+0000 7fd8cac18700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8c4066150 con 0x7fd8c405fdc0 2021-11-12T05:40:41.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.874+0000 7fd8cac18700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c40663f0 con 0x7fd8c40ade80 2021-11-12T05:40:41.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.874+0000 7fd8c91b5700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd8c413a9c0 0x7fd8c413ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:41.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.874+0000 7fd8c91b5700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd8c413a9c0 0x7fd8c413ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42970/0 (socket says 172.21.2.105:42970) 2021-11-12T05:40:41.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.874+0000 7fd8c91b5700 1 -- 172.21.2.105:0/415728430 learned_addr learned my addr 172.21.2.105:0/415728430 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:41.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.874+0000 7fd8c91b5700 1 -- 172.21.2.105:0/415728430 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd8c40ade80 msgr2=0x7fd8c4066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:41.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.874+0000 7fd8c91b5700 1 --2- 172.21.2.105:0/415728430 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd8c40ade80 0x7fd8c4066730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:41.881 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.874+0000 7fd8c91b5700 1 -- 172.21.2.105:0/415728430 >> v2:172.21.2.115:3300/0 conn(0x7fd8c405fdc0 msgr2=0x7fd8c40601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:41.881 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.874+0000 7fd8c91b5700 1 --2- 172.21.2.105:0/415728430 >> v2:172.21.2.115:3300/0 conn(0x7fd8c405fdc0 0x7fd8c40601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:41.881 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.874+0000 7fd8c91b5700 1 -- 172.21.2.105:0/415728430 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c4140fd0 con 0x7fd8c413a9c0 2021-11-12T05:40:41.881 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.874+0000 7fd8c91b5700 1 --2- 172.21.2.105:0/415728430 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd8c413a9c0 0x7fd8c413ae70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fd8bc0032f0 tx=0x7fd8bc009290).ready entity=mon.0 client_cookie=7736b5d574de92be server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:41.882 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.874+0000 7fd8c37fe700 1 -- 172.21.2.105:0/415728430 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8bc00ba60 con 0x7fd8c413a9c0 2021-11-12T05:40:41.882 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.874+0000 7fd8c37fe700 1 -- 172.21.2.105:0/415728430 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8bc00bbc0 con 0x7fd8c413a9c0 2021-11-12T05:40:41.882 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.874+0000 7fd8c37fe700 1 -- 172.21.2.105:0/415728430 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8bc010560 con 0x7fd8c413a9c0 2021-11-12T05:40:41.885 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.874+0000 7fd8cac18700 1 -- 172.21.2.105:0/415728430 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd8c413a9c0 msgr2=0x7fd8c413ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:41.885 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.874+0000 7fd8cac18700 1 --2- 172.21.2.105:0/415728430 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd8c413a9c0 0x7fd8c413ae70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fd8bc0032f0 tx=0x7fd8bc009290).stop 2021-11-12T05:40:41.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.874+0000 7fd8cac18700 1 -- 172.21.2.105:0/415728430 shutdown_connections 2021-11-12T05:40:41.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.874+0000 7fd8cac18700 1 --2- 172.21.2.105:0/415728430 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd8c413a9c0 0x7fd8c413ae70 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:41.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.874+0000 7fd8cac18700 1 --2- 172.21.2.105:0/415728430 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd8c40ade80 0x7fd8c4066730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:41.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.874+0000 7fd8cac18700 1 --2- 172.21.2.105:0/415728430 >> v2:172.21.2.115:3300/0 conn(0x7fd8c405fdc0 0x7fd8c40601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:41.887 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.874+0000 7fd8cac18700 1 -- 172.21.2.105:0/415728430 >> 172.21.2.105:0/415728430 conn(0x7fd8c40608d0 msgr2=0x7fd8c405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:41.887 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.874+0000 7fd8cac18700 1 -- 172.21.2.105:0/415728430 shutdown_connections 2021-11-12T05:40:41.887 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.874+0000 7fd8cac18700 1 -- 172.21.2.105:0/415728430 wait complete. 2021-11-12T05:40:41.888 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.878+0000 7fd8cac18700 1 Processor -- start 2021-11-12T05:40:41.888 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.878+0000 7fd8cac18700 1 -- start start 2021-11-12T05:40:41.888 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.878+0000 7fd8cac18700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd8c405fdc0 0x7fd8c4151660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:41.888 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.878+0000 7fd8cac18700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd8c40ade80 0x7fd8c40b64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:41.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.878+0000 7fd8cac18700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd8c413a9c0 0x7fd8c40b69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:41.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.878+0000 7fd8cac18700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c40b7690 con 0x7fd8c40ade80 2021-11-12T05:40:41.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.878+0000 7fd8cac18700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c4151f20 con 0x7fd8c413a9c0 2021-11-12T05:40:41.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.878+0000 7fd8cac18700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c40b5470 con 0x7fd8c405fdc0 2021-11-12T05:40:41.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.878+0000 7fd8c3fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd8c40ade80 0x7fd8c40b64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:41.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.878+0000 7fd8c3fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd8c40ade80 0x7fd8c40b64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42974/0 (socket says 172.21.2.105:42974) 2021-11-12T05:40:41.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.878+0000 7fd8c3fff700 1 -- 172.21.2.105:0/3687896889 learned_addr learned my addr 172.21.2.105:0/3687896889 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:41.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.878+0000 7fd8c3fff700 1 -- 172.21.2.105:0/3687896889 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd8c405fdc0 msgr2=0x7fd8c4151660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:41.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.878+0000 7fd8c3fff700 1 --2- 172.21.2.105:0/3687896889 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd8c405fdc0 0x7fd8c4151660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:41.891 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.878+0000 7fd8c3fff700 1 -- 172.21.2.105:0/3687896889 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd8c413a9c0 msgr2=0x7fd8c40b69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:41.891 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.878+0000 7fd8c3fff700 1 --2- 172.21.2.105:0/3687896889 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd8c413a9c0 0x7fd8c40b69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:41.891 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.878+0000 7fd8c3fff700 1 -- 172.21.2.105:0/3687896889 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8bc009530 con 0x7fd8c40ade80 2021-11-12T05:40:41.891 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.878+0000 7fd8c3fff700 1 --2- 172.21.2.105:0/3687896889 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd8c40ade80 0x7fd8c40b64c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fd8c4152060 tx=0x7fd8b4006e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:41.891 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.878+0000 7fd8c1ffb700 1 -- 172.21.2.105:0/3687896889 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8b4013460 con 0x7fd8c40ade80 2021-11-12T05:40:41.892 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.878+0000 7fd8c1ffb700 1 -- 172.21.2.105:0/3687896889 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b40135c0 con 0x7fd8c40ade80 2021-11-12T05:40:41.892 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.878+0000 7fd8c1ffb700 1 -- 172.21.2.105:0/3687896889 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8b4013920 con 0x7fd8c40ade80 2021-11-12T05:40:41.892 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.878+0000 7fd8cac18700 1 -- 172.21.2.105:0/3687896889 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c40b1090 con 0x7fd8c40ade80 2021-11-12T05:40:41.892 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.878+0000 7fd8cac18700 1 -- 172.21.2.105:0/3687896889 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c40b00a0 con 0x7fd8c40ade80 2021-11-12T05:40:41.893 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.878+0000 7fd8cac18700 1 -- 172.21.2.105:0/3687896889 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8c413e760 con 0x7fd8c40ade80 2021-11-12T05:40:41.893 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.878+0000 7fd8c1ffb700 1 -- 172.21.2.105:0/3687896889 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd8b401a060 con 0x7fd8c40ade80 2021-11-12T05:40:41.893 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.878+0000 7fd8c1ffb700 1 --2- 172.21.2.105:0/3687896889 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd8a8053660 0x7fd8a8055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:41.893 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.878+0000 7fd8c1ffb700 1 -- 172.21.2.105:0/3687896889 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fd8b406b450 con 0x7fd8c40ade80 2021-11-12T05:40:41.894 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.878+0000 7fd8c89b4700 1 --2- 172.21.2.105:0/3687896889 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd8a8053660 0x7fd8a8055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:41.894 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.878+0000 7fd8c89b4700 1 --2- 172.21.2.105:0/3687896889 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd8a8053660 0x7fd8a8055b20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fd8ac002f70 tx=0x7fd8ac006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:41.894 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.882+0000 7fd8c1ffb700 1 -- 172.21.2.105:0/3687896889 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd8c413e760 con 0x7fd8c40ade80 2021-11-12T05:40:41.967 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.966+0000 7fd8cac18700 1 -- 172.21.2.105:0/3687896889 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd8c413e760 con 0x7fd8c40ade80 2021-11-12T05:40:41.968 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.966+0000 7fd8c1ffb700 1 -- 172.21.2.105:0/3687896889 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd8c413e760 con 0x7fd8c40ade80 2021-11-12T05:40:41.968 INFO:teuthology.orchestra.run.gibba005.stdout:60129542149 2021-11-12T05:40:41.969 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.966+0000 7fd8cac18700 1 -- 172.21.2.105:0/3687896889 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd8a8053660 msgr2=0x7fd8a8055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:41.969 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.966+0000 7fd8cac18700 1 --2- 172.21.2.105:0/3687896889 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd8a8053660 0x7fd8a8055b20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fd8ac002f70 tx=0x7fd8ac006a80).stop 2021-11-12T05:40:41.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.966+0000 7fd8cac18700 1 -- 172.21.2.105:0/3687896889 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd8c40ade80 msgr2=0x7fd8c40b64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:41.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.966+0000 7fd8cac18700 1 --2- 172.21.2.105:0/3687896889 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd8c40ade80 0x7fd8c40b64c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fd8c4152060 tx=0x7fd8b4006e10).stop 2021-11-12T05:40:41.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.966+0000 7fd8cac18700 1 -- 172.21.2.105:0/3687896889 shutdown_connections 2021-11-12T05:40:41.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.966+0000 7fd8cac18700 1 --2- 172.21.2.105:0/3687896889 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd8a8053660 0x7fd8a8055b20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:41.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.966+0000 7fd8cac18700 1 --2- 172.21.2.105:0/3687896889 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd8c413a9c0 0x7fd8c40b69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:41.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.966+0000 7fd8cac18700 1 --2- 172.21.2.105:0/3687896889 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd8c40ade80 0x7fd8c40b64c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:41.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.966+0000 7fd8cac18700 1 --2- 172.21.2.105:0/3687896889 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd8c405fdc0 0x7fd8c4151660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:41.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.966+0000 7fd8cac18700 1 -- 172.21.2.105:0/3687896889 >> 172.21.2.105:0/3687896889 conn(0x7fd8c40608d0 msgr2=0x7fd8c40b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:41.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.966+0000 7fd8cac18700 1 -- 172.21.2.105:0/3687896889 shutdown_connections 2021-11-12T05:40:41.972 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:41.966+0000 7fd8cac18700 1 -- 172.21.2.105:0/3687896889 wait complete. 2021-11-12T05:40:41.975 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.1 2021-11-12T05:40:41.976 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2021-11-12T05:40:42.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.026+0000 7f416ebed700 1 Processor -- start 2021-11-12T05:40:42.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.026+0000 7f416ebed700 1 -- start start 2021-11-12T05:40:42.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.026+0000 7f416ebed700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f416805fdc0 0x7f41680601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.026+0000 7f416ebed700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f416813a9c0 0x7f416813ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.026+0000 7f416ebed700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4168066150 con 0x7f41680ade80 2021-11-12T05:40:42.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.026+0000 7f416ebed700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4168141fb0 con 0x7f416813a9c0 2021-11-12T05:40:42.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.026+0000 7f416ebed700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41680663f0 con 0x7f416805fdc0 2021-11-12T05:40:42.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.026+0000 7f416c989700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f416805fdc0 0x7f41680601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:42.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.026+0000 7f416d18a700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f416813a9c0 0x7f416813ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:42.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.026+0000 7f4167fff700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7f41680ade80 0x7f4168066730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:51844/0 (socket says 172.21.2.105:51844) 2021-11-12T05:40:42.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.026+0000 7f4167fff700 1 -- 172.21.2.105:0/854392212 learned_addr learned my addr 172.21.2.105:0/854392212 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:42.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.026+0000 7f416c989700 1 -- 172.21.2.105:0/854392212 >> v2:172.21.2.115:3300/0 conn(0x7f416813a9c0 msgr2=0x7f416813ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:42.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.026+0000 7f416c989700 1 --2- 172.21.2.105:0/854392212 >> v2:172.21.2.115:3300/0 conn(0x7f416813a9c0 0x7f416813ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:42.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.026+0000 7f416c989700 1 -- 172.21.2.105:0/854392212 >> v1:172.21.2.115:6789/0 conn(0x7f41680ade80 legacy=0x7f4168066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:42.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.026+0000 7f416c989700 1 -- 172.21.2.105:0/854392212 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4168140fd0 con 0x7f416805fdc0 2021-11-12T05:40:42.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.030+0000 7f416c989700 1 --2- 172.21.2.105:0/854392212 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f416805fdc0 0x7f41680601a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f4150002f70 tx=0x7f4150006df0).ready entity=mon.2 client_cookie=f8b3640a30101bc7 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:42.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.030+0000 7f41677fe700 1 -- 172.21.2.105:0/854392212 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f415000d570 con 0x7f416805fdc0 2021-11-12T05:40:42.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.030+0000 7f41677fe700 1 -- 172.21.2.105:0/854392212 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4150000e90 con 0x7f416805fdc0 2021-11-12T05:40:42.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.030+0000 7f41677fe700 1 -- 172.21.2.105:0/854392212 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f415000d8c0 con 0x7f416805fdc0 2021-11-12T05:40:42.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.030+0000 7f416ebed700 1 -- 172.21.2.105:0/854392212 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f416805fdc0 msgr2=0x7f41680601a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:42.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.030+0000 7f416ebed700 1 --2- 172.21.2.105:0/854392212 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f416805fdc0 0x7f41680601a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f4150002f70 tx=0x7f4150006df0).stop 2021-11-12T05:40:42.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.030+0000 7f416ebed700 1 -- 172.21.2.105:0/854392212 shutdown_connections 2021-11-12T05:40:42.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.030+0000 7f416ebed700 1 --2- 172.21.2.105:0/854392212 >> v2:172.21.2.115:3300/0 conn(0x7f416813a9c0 0x7f416813ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:42.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.030+0000 7f416ebed700 1 --2- 172.21.2.105:0/854392212 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f416805fdc0 0x7f41680601a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:42.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.030+0000 7f416ebed700 1 -- 172.21.2.105:0/854392212 >> 172.21.2.105:0/854392212 conn(0x7f41680608d0 msgr2=0x7f416805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:42.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.030+0000 7f416ebed700 1 -- 172.21.2.105:0/854392212 shutdown_connections 2021-11-12T05:40:42.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.030+0000 7f416ebed700 1 -- 172.21.2.105:0/854392212 wait complete. 2021-11-12T05:40:42.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.030+0000 7f416ebed700 1 Processor -- start 2021-11-12T05:40:42.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.030+0000 7f416ebed700 1 -- start start 2021-11-12T05:40:42.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.030+0000 7f416ebed700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f416805fdc0 0x7f4168145f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.030+0000 7f416ebed700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f41680ade80 0x7f41680b5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.030+0000 7f416ebed700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f416813a9c0 0x7f41680b7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.030+0000 7f416ebed700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4168143f10 con 0x7f416813a9c0 2021-11-12T05:40:42.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.030+0000 7f416ebed700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41681441c0 con 0x7f416805fdc0 2021-11-12T05:40:42.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.030+0000 7f416ebed700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4168151d00 con 0x7f41680ade80 2021-11-12T05:40:42.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.030+0000 7f416d18a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f416813a9c0 0x7f41680b7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:42.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.030+0000 7f416d18a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f416813a9c0 0x7f41680b7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:42988/0 (socket says 172.21.2.105:42988) 2021-11-12T05:40:42.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.030+0000 7f416d18a700 1 -- 172.21.2.105:0/2352686886 learned_addr learned my addr 172.21.2.105:0/2352686886 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:42.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.030+0000 7f416c989700 1 --2- 172.21.2.105:0/2352686886 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f416805fdc0 0x7f4168145f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:42.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.030+0000 7f416d18a700 1 -- 172.21.2.105:0/2352686886 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f41680ade80 msgr2=0x7f41680b5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:42.042 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.030+0000 7f416d18a700 1 --2- 172.21.2.105:0/2352686886 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f41680ade80 0x7f41680b5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:42.042 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.030+0000 7f416d18a700 1 -- 172.21.2.105:0/2352686886 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f416805fdc0 msgr2=0x7f4168145f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:42.042 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.030+0000 7f416d18a700 1 --2- 172.21.2.105:0/2352686886 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f416805fdc0 0x7f4168145f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:42.042 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.030+0000 7f416d18a700 1 -- 172.21.2.105:0/2352686886 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f415000b180 con 0x7f416813a9c0 2021-11-12T05:40:42.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.030+0000 7f416d18a700 1 --2- 172.21.2.105:0/2352686886 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f416813a9c0 0x7f41680b7a30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f4160006e00 tx=0x7f41600091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:42.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.030+0000 7f4165ffb700 1 -- 172.21.2.105:0/2352686886 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f416000c7f0 con 0x7f416813a9c0 2021-11-12T05:40:42.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.030+0000 7f4165ffb700 1 -- 172.21.2.105:0/2352686886 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f416000c950 con 0x7f416813a9c0 2021-11-12T05:40:42.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.030+0000 7f416ebed700 1 -- 172.21.2.105:0/2352686886 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4168151fa0 con 0x7f416813a9c0 2021-11-12T05:40:42.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.030+0000 7f4165ffb700 1 -- 172.21.2.105:0/2352686886 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f416000ccb0 con 0x7f416813a9c0 2021-11-12T05:40:42.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.030+0000 7f416ebed700 1 -- 172.21.2.105:0/2352686886 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f416813b380 con 0x7f416813a9c0 2021-11-12T05:40:42.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.034+0000 7f416ebed700 1 -- 172.21.2.105:0/2352686886 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4168152130 con 0x7f416813a9c0 2021-11-12T05:40:42.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.034+0000 7f4165ffb700 1 -- 172.21.2.105:0/2352686886 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4160022070 con 0x7f416813a9c0 2021-11-12T05:40:42.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.034+0000 7f4165ffb700 1 --2- 172.21.2.105:0/2352686886 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f414c053640 0x7f414c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.045 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.034+0000 7f4165ffb700 1 -- 172.21.2.105:0/2352686886 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f416006c180 con 0x7f416813a9c0 2021-11-12T05:40:42.045 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.034+0000 7f416c989700 1 --2- 172.21.2.105:0/2352686886 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f414c053640 0x7f414c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:42.045 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.034+0000 7f416c989700 1 --2- 172.21.2.105:0/2352686886 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f414c053640 0x7f414c055b00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f4150018000 tx=0x7f4150014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:42.045 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.034+0000 7f4165ffb700 1 -- 172.21.2.105:0/2352686886 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4160043180 con 0x7f416813a9c0 2021-11-12T05:40:42.122 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.118+0000 7f416ebed700 1 -- 172.21.2.105:0/2352686886 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4168057350 con 0x7f416813a9c0 2021-11-12T05:40:42.123 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.118+0000 7f4165ffb700 1 -- 172.21.2.105:0/2352686886 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4160016070 con 0x7f416813a9c0 2021-11-12T05:40:42.123 INFO:teuthology.orchestra.run.gibba005.stdout:60129542148 2021-11-12T05:40:42.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.122+0000 7f416ebed700 1 -- 172.21.2.105:0/2352686886 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f414c053640 msgr2=0x7f414c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:42.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.122+0000 7f416ebed700 1 --2- 172.21.2.105:0/2352686886 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f414c053640 0x7f414c055b00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f4150018000 tx=0x7f4150014000).stop 2021-11-12T05:40:42.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.122+0000 7f416ebed700 1 -- 172.21.2.105:0/2352686886 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f416813a9c0 msgr2=0x7f41680b7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:42.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.122+0000 7f416ebed700 1 --2- 172.21.2.105:0/2352686886 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f416813a9c0 0x7f41680b7a30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f4160006e00 tx=0x7f41600091d0).stop 2021-11-12T05:40:42.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.122+0000 7f416ebed700 1 -- 172.21.2.105:0/2352686886 shutdown_connections 2021-11-12T05:40:42.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.122+0000 7f416ebed700 1 --2- 172.21.2.105:0/2352686886 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f414c053640 0x7f414c055b00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:42.127 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.122+0000 7f416ebed700 1 --2- 172.21.2.105:0/2352686886 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f416813a9c0 0x7f41680b7a30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:42.127 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.122+0000 7f416ebed700 1 --2- 172.21.2.105:0/2352686886 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f41680ade80 0x7f41680b5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:42.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.122+0000 7f416ebed700 1 --2- 172.21.2.105:0/2352686886 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f416805fdc0 0x7f4168145f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:42.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.122+0000 7f416ebed700 1 -- 172.21.2.105:0/2352686886 >> 172.21.2.105:0/2352686886 conn(0x7f41680608d0 msgr2=0x7f41680652a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:42.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.122+0000 7f416ebed700 1 -- 172.21.2.105:0/2352686886 shutdown_connections 2021-11-12T05:40:42.129 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.122+0000 7f416ebed700 1 -- 172.21.2.105:0/2352686886 wait complete. 2021-11-12T05:40:42.130 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.2 2021-11-12T05:40:42.132 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2021-11-12T05:40:42.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.182+0000 7fae2f31b700 1 Processor -- start 2021-11-12T05:40:42.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.182+0000 7fae2f31b700 1 -- start start 2021-11-12T05:40:42.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.182+0000 7fae2f31b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fae28143b40 0x7fae280aded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.182+0000 7fae2f31b700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae28067860 con 0x7fae280adaf0 2021-11-12T05:40:42.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.182+0000 7fae2f31b700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae281404a0 con 0x7fae280ae3c0 2021-11-12T05:40:42.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.182+0000 7fae2f31b700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae28143400 con 0x7fae28143b40 2021-11-12T05:40:42.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.182+0000 7fae2d0b7700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fae280adaf0 0x7fae2813fd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:53388/0 (socket says 172.21.2.105:53388) 2021-11-12T05:40:42.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.182+0000 7fae2d0b7700 1 -- 172.21.2.105:0/18403245 learned_addr learned my addr 172.21.2.105:0/18403245 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:42.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.182+0000 7fae2c8b6700 1 --2- 172.21.2.105:0/18403245 >> v2:172.21.2.105:3300/0 conn(0x7fae28143b40 0x7fae280aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:42.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.182+0000 7fae17fff700 1 -- 172.21.2.105:0/18403245 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2964827471 0 0) 0x7fae28067860 con 0x7fae280adaf0 2021-11-12T05:40:42.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.182+0000 7fae17fff700 1 -- 172.21.2.105:0/18403245 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae10003260 con 0x7fae280adaf0 2021-11-12T05:40:42.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.182+0000 7fae2c8b6700 1 -- 172.21.2.105:0/18403245 >> v1:172.21.2.115:6789/0 conn(0x7fae280ae3c0 legacy=0x7fae280afe10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:40:42.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.182+0000 7fae2c8b6700 1 -- 172.21.2.105:0/18403245 >> v1:172.21.2.105:6789/0 conn(0x7fae280adaf0 legacy=0x7fae2813fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:42.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.182+0000 7fae2c8b6700 1 -- 172.21.2.105:0/18403245 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae281436a0 con 0x7fae28143b40 2021-11-12T05:40:42.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.182+0000 7fae2c8b6700 1 --2- 172.21.2.105:0/18403245 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fae28143b40 0x7fae280aded0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fae280625f0 tx=0x7fae24006df0).ready entity=mon.0 client_cookie=8824e32b3aeb029f server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:42.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.182+0000 7fae17fff700 1 -- 172.21.2.105:0/18403245 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae2400d5c0 con 0x7fae28143b40 2021-11-12T05:40:42.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.182+0000 7fae17fff700 1 -- 172.21.2.105:0/18403245 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae24000e90 con 0x7fae28143b40 2021-11-12T05:40:42.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.182+0000 7fae17fff700 1 -- 172.21.2.105:0/18403245 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae2400d910 con 0x7fae28143b40 2021-11-12T05:40:42.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.182+0000 7fae2f31b700 1 -- 172.21.2.105:0/18403245 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fae28143b40 msgr2=0x7fae280aded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:42.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.182+0000 7fae2f31b700 1 --2- 172.21.2.105:0/18403245 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fae28143b40 0x7fae280aded0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fae280625f0 tx=0x7fae24006df0).stop 2021-11-12T05:40:42.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.182+0000 7fae2f31b700 1 -- 172.21.2.105:0/18403245 shutdown_connections 2021-11-12T05:40:42.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.182+0000 7fae2f31b700 1 --2- 172.21.2.105:0/18403245 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fae28143b40 0x7fae280aded0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:42.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.182+0000 7fae2f31b700 1 -- 172.21.2.105:0/18403245 >> 172.21.2.105:0/18403245 conn(0x7fae2805c490 msgr2=0x7fae2805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:42.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.182+0000 7fae2f31b700 1 -- 172.21.2.105:0/18403245 shutdown_connections 2021-11-12T05:40:42.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.182+0000 7fae2f31b700 1 -- 172.21.2.105:0/18403245 wait complete. 2021-11-12T05:40:42.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.182+0000 7fae2f31b700 1 Processor -- start 2021-11-12T05:40:42.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.182+0000 7fae2f31b700 1 -- start start 2021-11-12T05:40:42.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.186+0000 7fae2f31b700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fae280adaf0 0x7fae28065530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.186+0000 7fae2f31b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fae280ae3c0 0x7fae280a9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.186+0000 7fae2f31b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fae28143b40 0x7fae28150c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.186+0000 7fae2f31b700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2809f9d0 con 0x7fae280ae3c0 2021-11-12T05:40:42.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.186+0000 7fae2f31b700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae28150550 con 0x7fae280adaf0 2021-11-12T05:40:42.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.186+0000 7fae2f31b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae281507f0 con 0x7fae28143b40 2021-11-12T05:40:42.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.186+0000 7fae2c8b6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fae280ae3c0 0x7fae280a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:42.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.186+0000 7fae2c8b6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fae280ae3c0 0x7fae280a9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43000/0 (socket says 172.21.2.105:43000) 2021-11-12T05:40:42.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.186+0000 7fae2c8b6700 1 -- 172.21.2.105:0/240633739 learned_addr learned my addr 172.21.2.105:0/240633739 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:42.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.186+0000 7fae2c8b6700 1 -- 172.21.2.105:0/240633739 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fae28143b40 msgr2=0x7fae28150c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:42.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.186+0000 7fae2c8b6700 1 --2- 172.21.2.105:0/240633739 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fae28143b40 0x7fae28150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:42.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.186+0000 7fae2c8b6700 1 -- 172.21.2.105:0/240633739 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fae280adaf0 msgr2=0x7fae28065530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:42.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.186+0000 7fae2c8b6700 1 --2- 172.21.2.105:0/240633739 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fae280adaf0 0x7fae28065530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:42.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.186+0000 7fae2c8b6700 1 -- 172.21.2.105:0/240633739 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae2400b180 con 0x7fae280ae3c0 2021-11-12T05:40:42.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.186+0000 7fae2c8b6700 1 --2- 172.21.2.105:0/240633739 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fae280ae3c0 0x7fae280a9130 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fae280625f0 tx=0x7fae24014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:42.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.186+0000 7fae167fc700 1 -- 172.21.2.105:0/240633739 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae24016070 con 0x7fae280ae3c0 2021-11-12T05:40:42.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.186+0000 7fae167fc700 1 -- 172.21.2.105:0/240633739 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae24002f70 con 0x7fae280ae3c0 2021-11-12T05:40:42.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.186+0000 7fae2f31b700 1 -- 172.21.2.105:0/240633739 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae280a9620 con 0x7fae280ae3c0 2021-11-12T05:40:42.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.186+0000 7fae2f31b700 1 -- 172.21.2.105:0/240633739 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae28064180 con 0x7fae280ae3c0 2021-11-12T05:40:42.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.186+0000 7fae167fc700 1 -- 172.21.2.105:0/240633739 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae2400de70 con 0x7fae280ae3c0 2021-11-12T05:40:42.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.186+0000 7fae2f31b700 1 -- 172.21.2.105:0/240633739 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae28064850 con 0x7fae280ae3c0 2021-11-12T05:40:42.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.186+0000 7fae167fc700 1 -- 172.21.2.105:0/240633739 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fae24025030 con 0x7fae280ae3c0 2021-11-12T05:40:42.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.186+0000 7fae167fc700 1 --2- 172.21.2.105:0/240633739 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fae080536f0 0x7fae08055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.186+0000 7fae167fc700 1 -- 172.21.2.105:0/240633739 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fae2406cd60 con 0x7fae280ae3c0 2021-11-12T05:40:42.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.186+0000 7fae2d0b7700 1 --2- 172.21.2.105:0/240633739 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fae080536f0 0x7fae08055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:42.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.186+0000 7fae2d0b7700 1 --2- 172.21.2.105:0/240633739 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fae080536f0 0x7fae08055bb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fae18001110 tx=0x7fae180076c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:42.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.190+0000 7fae167fc700 1 -- 172.21.2.105:0/240633739 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fae28064850 con 0x7fae280ae3c0 2021-11-12T05:40:42.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.274+0000 7fae2f31b700 1 -- 172.21.2.105:0/240633739 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fae28064850 con 0x7fae280ae3c0 2021-11-12T05:40:42.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.274+0000 7fae167fc700 1 -- 172.21.2.105:0/240633739 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fae28064850 con 0x7fae280ae3c0 2021-11-12T05:40:42.278 INFO:teuthology.orchestra.run.gibba005.stdout:60129542149 2021-11-12T05:40:42.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.274+0000 7fae2f31b700 1 -- 172.21.2.105:0/240633739 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fae080536f0 msgr2=0x7fae08055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:42.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.274+0000 7fae2f31b700 1 --2- 172.21.2.105:0/240633739 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fae080536f0 0x7fae08055bb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fae18001110 tx=0x7fae180076c0).stop 2021-11-12T05:40:42.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.274+0000 7fae2f31b700 1 -- 172.21.2.105:0/240633739 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fae280ae3c0 msgr2=0x7fae280a9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:42.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.274+0000 7fae2f31b700 1 --2- 172.21.2.105:0/240633739 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fae280ae3c0 0x7fae280a9130 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fae280625f0 tx=0x7fae24014000).stop 2021-11-12T05:40:42.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.274+0000 7fae2f31b700 1 -- 172.21.2.105:0/240633739 shutdown_connections 2021-11-12T05:40:42.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.274+0000 7fae2f31b700 1 --2- 172.21.2.105:0/240633739 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fae080536f0 0x7fae08055bb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:42.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.274+0000 7fae2f31b700 1 --2- 172.21.2.105:0/240633739 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fae28143b40 0x7fae28150c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:42.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.274+0000 7fae2f31b700 1 --2- 172.21.2.105:0/240633739 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fae280ae3c0 0x7fae280a9130 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:42.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.274+0000 7fae2f31b700 1 --2- 172.21.2.105:0/240633739 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fae280adaf0 0x7fae28065530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:42.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.274+0000 7fae2f31b700 1 -- 172.21.2.105:0/240633739 >> 172.21.2.105:0/240633739 conn(0x7fae2805c490 msgr2=0x7fae2813f990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:42.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.274+0000 7fae2f31b700 1 -- 172.21.2.105:0/240633739 shutdown_connections 2021-11-12T05:40:42.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.274+0000 7fae2f31b700 1 -- 172.21.2.105:0/240633739 wait complete. 2021-11-12T05:40:42.286 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.3 2021-11-12T05:40:42.287 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2021-11-12T05:40:42.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.338+0000 7fd16e513700 1 Processor -- start 2021-11-12T05:40:42.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.338+0000 7fd16e513700 1 -- start start 2021-11-12T05:40:42.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.338+0000 7fd16e513700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fd1680b4d50 0x7fd1680b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.338+0000 7fd16e513700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd1680b3100 0x7fd1680b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.338+0000 7fd16e513700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1680b2110 con 0x7fd168062010 2021-11-12T05:40:42.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.338+0000 7fd16e513700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1680b2370 con 0x7fd1680b3100 2021-11-12T05:40:42.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.338+0000 7fd16e513700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1680b2610 con 0x7fd1680b4d50 2021-11-12T05:40:42.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.338+0000 7fd16cab0700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd1680b3100 0x7fd1680b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:42.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.338+0000 7fd16cab0700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd1680b3100 0x7fd1680b2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43010/0 (socket says 172.21.2.105:43010) 2021-11-12T05:40:42.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.338+0000 7fd16cab0700 1 -- 172.21.2.105:0/498758674 learned_addr learned my addr 172.21.2.105:0/498758674 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:42.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.338+0000 7fd16cab0700 1 -- 172.21.2.105:0/498758674 >> v2:172.21.2.115:3300/0 conn(0x7fd1680b4d50 msgr2=0x7fd1680b5b00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:40:42.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.338+0000 7fd16cab0700 1 --2- 172.21.2.105:0/498758674 >> v2:172.21.2.115:3300/0 conn(0x7fd1680b4d50 0x7fd1680b5b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:42.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.338+0000 7fd16cab0700 1 -- 172.21.2.105:0/498758674 >> v1:172.21.2.115:6789/0 conn(0x7fd168062010 legacy=0x7fd1680b4640 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:40:42.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.338+0000 7fd16cab0700 1 -- 172.21.2.105:0/498758674 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1680b4330 con 0x7fd1680b3100 2021-11-12T05:40:42.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.338+0000 7fd16cab0700 1 --2- 172.21.2.105:0/498758674 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1680b3100 0x7fd1680b2ab0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fd1680b1fb0 tx=0x7fd160009290).ready entity=mon.0 client_cookie=96bed7443b54ad79 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:42.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.338+0000 7fd166ffd700 1 -- 172.21.2.105:0/498758674 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd16000b830 con 0x7fd1680b3100 2021-11-12T05:40:42.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.338+0000 7fd166ffd700 1 -- 172.21.2.105:0/498758674 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd16000b990 con 0x7fd1680b3100 2021-11-12T05:40:42.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.338+0000 7fd166ffd700 1 -- 172.21.2.105:0/498758674 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd16000bb40 con 0x7fd1680b3100 2021-11-12T05:40:42.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.338+0000 7fd16e513700 1 -- 172.21.2.105:0/498758674 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1680b3100 msgr2=0x7fd1680b2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:42.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.338+0000 7fd16e513700 1 --2- 172.21.2.105:0/498758674 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1680b3100 0x7fd1680b2ab0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fd1680b1fb0 tx=0x7fd160009290).stop 2021-11-12T05:40:42.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.338+0000 7fd16e513700 1 -- 172.21.2.105:0/498758674 shutdown_connections 2021-11-12T05:40:42.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.338+0000 7fd16e513700 1 --2- 172.21.2.105:0/498758674 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1680b3100 0x7fd1680b2ab0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:42.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.338+0000 7fd16e513700 1 --2- 172.21.2.105:0/498758674 >> v2:172.21.2.115:3300/0 conn(0x7fd1680b4d50 0x7fd1680b5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:42.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.338+0000 7fd16e513700 1 -- 172.21.2.105:0/498758674 >> 172.21.2.105:0/498758674 conn(0x7fd1680b9790 msgr2=0x7fd1680b9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:42.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.338+0000 7fd16e513700 1 -- 172.21.2.105:0/498758674 shutdown_connections 2021-11-12T05:40:42.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.338+0000 7fd16e513700 1 -- 172.21.2.105:0/498758674 wait complete. 2021-11-12T05:40:42.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.338+0000 7fd16e513700 1 Processor -- start 2021-11-12T05:40:42.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.338+0000 7fd16e513700 1 -- start start 2021-11-12T05:40:42.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.342+0000 7fd16e513700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd168062010 0x7fd168143560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.342+0000 7fd16e513700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd1680b3100 0x7fd1680aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.342+0000 7fd16e513700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1680b4d50 0x7fd1680ad270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.342+0000 7fd16e513700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1680af240 con 0x7fd1680b4d50 2021-11-12T05:40:42.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.342+0000 7fd16e513700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd168065860 con 0x7fd1680b3100 2021-11-12T05:40:42.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.342+0000 7fd16e513700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1680af4e0 con 0x7fd168062010 2021-11-12T05:40:42.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.342+0000 7fd16cab0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1680b4d50 0x7fd1680ad270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:42.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.342+0000 7fd16cab0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1680b4d50 0x7fd1680ad270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43016/0 (socket says 172.21.2.105:43016) 2021-11-12T05:40:42.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.342+0000 7fd16cab0700 1 -- 172.21.2.105:0/1642588009 learned_addr learned my addr 172.21.2.105:0/1642588009 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:42.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.342+0000 7fd16cab0700 1 -- 172.21.2.105:0/1642588009 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd168062010 msgr2=0x7fd168143560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:42.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.342+0000 7fd16cab0700 1 --2- 172.21.2.105:0/1642588009 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd168062010 0x7fd168143560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:42.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.342+0000 7fd16cab0700 1 -- 172.21.2.105:0/1642588009 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd1680b3100 msgr2=0x7fd1680aeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:42.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.342+0000 7fd16cab0700 1 --2- 172.21.2.105:0/1642588009 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd1680b3100 0x7fd1680aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:42.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.342+0000 7fd16cab0700 1 -- 172.21.2.105:0/1642588009 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd160009530 con 0x7fd1680b4d50 2021-11-12T05:40:42.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.342+0000 7fd16cab0700 1 --2- 172.21.2.105:0/1642588009 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1680b4d50 0x7fd1680ad270 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fd1680b1fb0 tx=0x7fd160016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:42.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.342+0000 7fd1657fa700 1 -- 172.21.2.105:0/1642588009 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd160021630 con 0x7fd1680b4d50 2021-11-12T05:40:42.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.342+0000 7fd1657fa700 1 -- 172.21.2.105:0/1642588009 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd160021790 con 0x7fd1680b4d50 2021-11-12T05:40:42.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.342+0000 7fd1657fa700 1 -- 172.21.2.105:0/1642588009 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd160021af0 con 0x7fd1680b4d50 2021-11-12T05:40:42.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.342+0000 7fd16e513700 1 -- 172.21.2.105:0/1642588009 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1680affc0 con 0x7fd1680b4d50 2021-11-12T05:40:42.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.342+0000 7fd16e513700 1 -- 172.21.2.105:0/1642588009 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1680b02a0 con 0x7fd1680b4d50 2021-11-12T05:40:42.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.342+0000 7fd16e513700 1 -- 172.21.2.105:0/1642588009 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1680af090 con 0x7fd1680b4d50 2021-11-12T05:40:42.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.342+0000 7fd1657fa700 1 -- 172.21.2.105:0/1642588009 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd16000f070 con 0x7fd1680b4d50 2021-11-12T05:40:42.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.342+0000 7fd1657fa700 1 --2- 172.21.2.105:0/1642588009 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd14c0536d0 0x7fd14c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.342+0000 7fd1657fa700 1 -- 172.21.2.105:0/1642588009 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fd16006d2e0 con 0x7fd1680b4d50 2021-11-12T05:40:42.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.342+0000 7fd167fff700 1 --2- 172.21.2.105:0/1642588009 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd14c0536d0 0x7fd14c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:42.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.342+0000 7fd167fff700 1 --2- 172.21.2.105:0/1642588009 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd14c0536d0 0x7fd14c055b90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fd150002fb0 tx=0x7fd1500069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:42.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.346+0000 7fd1657fa700 1 -- 172.21.2.105:0/1642588009 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd1600442e0 con 0x7fd1680b4d50 2021-11-12T05:40:42.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.426+0000 7fd16e513700 1 -- 172.21.2.105:0/1642588009 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fd168065a20 con 0x7fd1680b4d50 2021-11-12T05:40:42.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.426+0000 7fd1657fa700 1 -- 172.21.2.105:0/1642588009 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd160015070 con 0x7fd1680b4d50 2021-11-12T05:40:42.433 INFO:teuthology.orchestra.run.gibba005.stdout:60129542149 2021-11-12T05:40:42.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.430+0000 7fd16e513700 1 -- 172.21.2.105:0/1642588009 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd14c0536d0 msgr2=0x7fd14c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:42.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.430+0000 7fd16e513700 1 --2- 172.21.2.105:0/1642588009 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd14c0536d0 0x7fd14c055b90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fd150002fb0 tx=0x7fd1500069b0).stop 2021-11-12T05:40:42.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.430+0000 7fd16e513700 1 -- 172.21.2.105:0/1642588009 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1680b4d50 msgr2=0x7fd1680ad270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:42.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.430+0000 7fd16e513700 1 --2- 172.21.2.105:0/1642588009 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1680b4d50 0x7fd1680ad270 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fd1680b1fb0 tx=0x7fd160016000).stop 2021-11-12T05:40:42.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.430+0000 7fd16e513700 1 -- 172.21.2.105:0/1642588009 shutdown_connections 2021-11-12T05:40:42.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.430+0000 7fd16e513700 1 --2- 172.21.2.105:0/1642588009 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd14c0536d0 0x7fd14c055b90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:42.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.430+0000 7fd16e513700 1 --2- 172.21.2.105:0/1642588009 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1680b4d50 0x7fd1680ad270 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:42.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.430+0000 7fd16e513700 1 --2- 172.21.2.105:0/1642588009 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd1680b3100 0x7fd1680aeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:42.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.430+0000 7fd16e513700 1 --2- 172.21.2.105:0/1642588009 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd168062010 0x7fd168143560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:42.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.430+0000 7fd16e513700 1 -- 172.21.2.105:0/1642588009 >> 172.21.2.105:0/1642588009 conn(0x7fd1680b9790 msgr2=0x7fd16813fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:42.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.430+0000 7fd16e513700 1 -- 172.21.2.105:0/1642588009 shutdown_connections 2021-11-12T05:40:42.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.430+0000 7fd16e513700 1 -- 172.21.2.105:0/1642588009 wait complete. 2021-11-12T05:40:42.437 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.4 2021-11-12T05:40:42.438 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2021-11-12T05:40:42.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0ae54e0700 1 Processor -- start 2021-11-12T05:40:42.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0ae54e0700 1 -- start start 2021-11-12T05:40:42.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0ae54e0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0ae005fdc0 0x7f0ae00601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0ae54e0700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f0ae013a9c0 0x7f0ae013ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0ae54e0700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ae0066150 con 0x7f0ae00ade80 2021-11-12T05:40:42.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0ae54e0700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ae0141fb0 con 0x7f0ae013a9c0 2021-11-12T05:40:42.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0ae54e0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae00663f0 con 0x7f0ae005fdc0 2021-11-12T05:40:42.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0ade7fc700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f0ae00ade80 0x7f0ae0066730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:53416/0 (socket says 172.21.2.105:53416) 2021-11-12T05:40:42.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0ade7fc700 1 -- 172.21.2.105:0/461601608 learned_addr learned my addr 172.21.2.105:0/461601608 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:42.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0addffb700 1 -- 172.21.2.105:0/461601608 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3239759486 0 0) 0x7f0ae0066150 con 0x7f0ae00ade80 2021-11-12T05:40:42.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0addffb700 1 -- 172.21.2.105:0/461601608 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ac0003260 con 0x7f0ae00ade80 2021-11-12T05:40:42.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0addffb700 1 -- 172.21.2.105:0/461601608 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 909113984 0 0) 0x7f0ac0003260 con 0x7f0ae00ade80 2021-11-12T05:40:42.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0addffb700 1 -- 172.21.2.105:0/461601608 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0ae005fdc0 msgr2=0x7f0ae00601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:42.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0addffb700 1 --2- 172.21.2.105:0/461601608 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0ae005fdc0 0x7f0ae00601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:42.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0addffb700 1 -- 172.21.2.105:0/461601608 >> v2:172.21.2.115:3300/0 conn(0x7f0ae013a9c0 msgr2=0x7f0ae013ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:42.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0addffb700 1 --2- 172.21.2.105:0/461601608 >> v2:172.21.2.115:3300/0 conn(0x7f0ae013a9c0 0x7f0ae013ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:42.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0addffb700 1 -- 172.21.2.105:0/461601608 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae0140fd0 con 0x7f0ae00ade80 2021-11-12T05:40:42.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0addffb700 1 -- 172.21.2.105:0/461601608 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f0ac8001660 con 0x7f0ae00ade80 2021-11-12T05:40:42.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0addffb700 1 -- 172.21.2.105:0/461601608 >> v1:172.21.2.105:6789/0 conn(0x7f0ae00ade80 legacy=0x7f0ae0066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:42.498 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0addffb700 1 --2- 172.21.2.105:0/461601608 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0ae005fdc0 0x7f0ac00037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.498 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0addffb700 1 --2- 172.21.2.105:0/461601608 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0ac0003ee0 0x7f0ac0004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.498 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0addffb700 1 --2- 172.21.2.105:0/461601608 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0ac0004bf0 0x7f0ac000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.498 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0addffb700 1 -- 172.21.2.105:0/461601608 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae00663f0 con 0x7f0ac0003ee0 2021-11-12T05:40:42.498 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0addffb700 1 -- 172.21.2.105:0/461601608 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac0005320 con 0x7f0ac0004bf0 2021-11-12T05:40:42.499 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0addffb700 1 -- 172.21.2.105:0/461601608 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac000bc40 con 0x7f0ae005fdc0 2021-11-12T05:40:42.499 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0ade7fc700 1 --2- 172.21.2.105:0/461601608 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0ac0003ee0 0x7f0ac0004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:42.499 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0ade7fc700 1 -- 172.21.2.105:0/461601608 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0ae005fdc0 msgr2=0x7f0ac00037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:42.499 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0ade7fc700 1 --2- 172.21.2.105:0/461601608 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0ae005fdc0 0x7f0ac00037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:42.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0ade7fc700 1 -- 172.21.2.105:0/461601608 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0ac0004bf0 msgr2=0x7f0ac000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:42.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0ade7fc700 1 --2- 172.21.2.105:0/461601608 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0ac0004bf0 0x7f0ac000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:42.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0ade7fc700 1 -- 172.21.2.105:0/461601608 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac0003260 con 0x7f0ac0003ee0 2021-11-12T05:40:42.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0ade7fc700 1 --2- 172.21.2.105:0/461601608 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0ac0003ee0 0x7f0ac0004500 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f0ac8001370 tx=0x7f0ae0066690).ready entity=mon.0 client_cookie=ad268dccc7b71fd server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:42.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0addffb700 1 -- 172.21.2.105:0/461601608 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ac80070d0 con 0x7f0ac0003ee0 2021-11-12T05:40:42.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0addffb700 1 -- 172.21.2.105:0/461601608 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac8007230 con 0x7f0ac0003ee0 2021-11-12T05:40:42.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0addffb700 1 -- 172.21.2.105:0/461601608 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ac800c8f0 con 0x7f0ac0003ee0 2021-11-12T05:40:42.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0ae54e0700 1 -- 172.21.2.105:0/461601608 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0ac0003ee0 msgr2=0x7f0ac0004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:42.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0ae54e0700 1 --2- 172.21.2.105:0/461601608 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0ac0003ee0 0x7f0ac0004500 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f0ac8001370 tx=0x7f0ae0066690).stop 2021-11-12T05:40:42.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0adf7fe700 1 -- 172.21.2.105:0/461601608 reap_dead start 2021-11-12T05:40:42.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0ae54e0700 1 -- 172.21.2.105:0/461601608 shutdown_connections 2021-11-12T05:40:42.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0ae54e0700 1 -- 172.21.2.105:0/461601608 >> 172.21.2.105:0/461601608 conn(0x7f0ae00608d0 msgr2=0x7f0ae005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:42.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0ae54e0700 1 -- 172.21.2.105:0/461601608 shutdown_connections 2021-11-12T05:40:42.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.486+0000 7f0ae54e0700 1 -- 172.21.2.105:0/461601608 wait complete. 2021-11-12T05:40:42.503 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.490+0000 7f0ae54e0700 1 Processor -- start 2021-11-12T05:40:42.503 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.490+0000 7f0ae54e0700 1 -- start start 2021-11-12T05:40:42.503 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.490+0000 7f0ae54e0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0ac0003ee0 0x7f0ae013fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.503 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.490+0000 7f0ae54e0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0ae013d7f0 0x7f0ae01500c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.504 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.490+0000 7f0ae54e0700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0ae01505b0 0x7f0ae00b7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.504 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.490+0000 7f0ae54e0700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae00b6bc0 con 0x7f0ae013d7f0 2021-11-12T05:40:42.504 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.490+0000 7f0ae54e0700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae013d2c0 con 0x7f0ae01505b0 2021-11-12T05:40:42.504 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.490+0000 7f0ae54e0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae013d0e0 con 0x7f0ac0003ee0 2021-11-12T05:40:42.504 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.490+0000 7f0ade7fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0ae013d7f0 0x7f0ae01500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:42.505 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.490+0000 7f0ade7fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0ae013d7f0 0x7f0ae01500c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43036/0 (socket says 172.21.2.105:43036) 2021-11-12T05:40:42.505 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.490+0000 7f0ade7fc700 1 -- 172.21.2.105:0/2587617926 learned_addr learned my addr 172.21.2.105:0/2587617926 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:42.505 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.490+0000 7f0ade7fc700 1 -- 172.21.2.105:0/2587617926 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0ac0003ee0 msgr2=0x7f0ae013fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:42.505 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.490+0000 7f0ade7fc700 1 --2- 172.21.2.105:0/2587617926 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0ac0003ee0 0x7f0ae013fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:42.505 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.490+0000 7f0ade7fc700 1 -- 172.21.2.105:0/2587617926 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0ae01505b0 msgr2=0x7f0ae00b7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:42.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.490+0000 7f0ade7fc700 1 --2- 172.21.2.105:0/2587617926 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0ae01505b0 0x7f0ae00b7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:42.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.490+0000 7f0ade7fc700 1 -- 172.21.2.105:0/2587617926 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae013e340 con 0x7f0ae013d7f0 2021-11-12T05:40:42.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.490+0000 7f0ade7fc700 1 --2- 172.21.2.105:0/2587617926 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0ae013d7f0 0x7f0ae01500c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f0ac8001370 tx=0x7f0ac8013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:42.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.490+0000 7f0ad7fff700 1 -- 172.21.2.105:0/2587617926 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ac8021070 con 0x7f0ae013d7f0 2021-11-12T05:40:42.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.490+0000 7f0ad7fff700 1 -- 172.21.2.105:0/2587617926 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac801d750 con 0x7f0ae013d7f0 2021-11-12T05:40:42.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.490+0000 7f0ad7fff700 1 -- 172.21.2.105:0/2587617926 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ac801dab0 con 0x7f0ae013d7f0 2021-11-12T05:40:42.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.490+0000 7f0ae54e0700 1 -- 172.21.2.105:0/2587617926 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae013d4f0 con 0x7f0ae013d7f0 2021-11-12T05:40:42.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.490+0000 7f0ae54e0700 1 -- 172.21.2.105:0/2587617926 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae0142200 con 0x7f0ae013d7f0 2021-11-12T05:40:42.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.490+0000 7f0ae54e0700 1 -- 172.21.2.105:0/2587617926 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ae00b79a0 con 0x7f0ae013d7f0 2021-11-12T05:40:42.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.490+0000 7f0ad7fff700 1 -- 172.21.2.105:0/2587617926 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0ac8010070 con 0x7f0ae013d7f0 2021-11-12T05:40:42.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.490+0000 7f0ad7fff700 1 --2- 172.21.2.105:0/2587617926 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0ac4053690 0x7f0ac4055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.490+0000 7f0ad7fff700 1 -- 172.21.2.105:0/2587617926 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f0ac806fbe0 con 0x7f0ae013d7f0 2021-11-12T05:40:42.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.490+0000 7f0adeffd700 1 --2- 172.21.2.105:0/2587617926 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0ac4053690 0x7f0ac4055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:42.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.490+0000 7f0adeffd700 1 --2- 172.21.2.105:0/2587617926 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0ac4053690 0x7f0ac4055b50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f0ad0002f70 tx=0x7f0ad0006a10).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:42.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.494+0000 7f0ad7fff700 1 -- 172.21.2.105:0/2587617926 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0ac8046ad0 con 0x7f0ae013d7f0 2021-11-12T05:40:42.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.574+0000 7f0ae54e0700 1 -- 172.21.2.105:0/2587617926 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f0ae013e130 con 0x7f0ae013d7f0 2021-11-12T05:40:42.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.574+0000 7f0ad7fff700 1 -- 172.21.2.105:0/2587617926 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0ac804a0f0 con 0x7f0ae013d7f0 2021-11-12T05:40:42.579 INFO:teuthology.orchestra.run.gibba005.stdout:60129542150 2021-11-12T05:40:42.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.578+0000 7f0ae54e0700 1 -- 172.21.2.105:0/2587617926 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0ac4053690 msgr2=0x7f0ac4055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:42.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.578+0000 7f0ae54e0700 1 --2- 172.21.2.105:0/2587617926 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0ac4053690 0x7f0ac4055b50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f0ad0002f70 tx=0x7f0ad0006a10).stop 2021-11-12T05:40:42.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.578+0000 7f0ae54e0700 1 -- 172.21.2.105:0/2587617926 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0ae013d7f0 msgr2=0x7f0ae01500c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:42.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.578+0000 7f0ae54e0700 1 --2- 172.21.2.105:0/2587617926 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0ae013d7f0 0x7f0ae01500c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f0ac8001370 tx=0x7f0ac8013000).stop 2021-11-12T05:40:42.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.578+0000 7f0ae54e0700 1 -- 172.21.2.105:0/2587617926 shutdown_connections 2021-11-12T05:40:42.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.578+0000 7f0ae54e0700 1 --2- 172.21.2.105:0/2587617926 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0ac4053690 0x7f0ac4055b50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:42.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.578+0000 7f0ae54e0700 1 --2- 172.21.2.105:0/2587617926 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0ae01505b0 0x7f0ae00b7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:42.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.578+0000 7f0ae54e0700 1 --2- 172.21.2.105:0/2587617926 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0ae013d7f0 0x7f0ae01500c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:42.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.578+0000 7f0ae54e0700 1 --2- 172.21.2.105:0/2587617926 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0ac0003ee0 0x7f0ae013fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:42.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.578+0000 7f0ae54e0700 1 -- 172.21.2.105:0/2587617926 >> 172.21.2.105:0/2587617926 conn(0x7f0ae00608d0 msgr2=0x7f0ae005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:42.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.578+0000 7f0ae54e0700 1 -- 172.21.2.105:0/2587617926 shutdown_connections 2021-11-12T05:40:42.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.578+0000 7f0ae54e0700 1 -- 172.21.2.105:0/2587617926 wait complete. 2021-11-12T05:40:42.586 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.5 2021-11-12T05:40:42.586 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2021-11-12T05:40:42.636 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.634+0000 7f786fe91700 1 Processor -- start 2021-11-12T05:40:42.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.634+0000 7f786fe91700 1 -- start start 2021-11-12T05:40:42.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.634+0000 7f786fe91700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f78680b0780 0x7f78681434d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.634+0000 7f786fe91700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f78680b0cc0 0x7f786805c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.634+0000 7f786fe91700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78680b2d20 con 0x7f78680b2940 2021-11-12T05:40:42.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.634+0000 7f786fe91700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78680b1fc0 con 0x7f78680b0780 2021-11-12T05:40:42.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.634+0000 7f786fe91700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78680b15e0 con 0x7f78680b0cc0 2021-11-12T05:40:42.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.634+0000 7f786d42c700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f78680b0780 0x7f78681434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:42.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.638+0000 7f786e42e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f78680b0cc0 0x7f786805c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:42.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.638+0000 7f786dc2d700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7f78680b2940 0x7f7868142dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:51904/0 (socket says 172.21.2.105:51904) 2021-11-12T05:40:42.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.638+0000 7f786dc2d700 1 -- 172.21.2.105:0/2199896717 learned_addr learned my addr 172.21.2.105:0/2199896717 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:42.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.638+0000 7f786d42c700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f78680b0780 0x7f78681434d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3300/0 says I am v2:172.21.2.105:60216/0 (socket says 172.21.2.105:60216) 2021-11-12T05:40:42.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.638+0000 7f786d42c700 1 -- 172.21.2.105:0/2199896717 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f78680b0cc0 msgr2=0x7f786805c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:42.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.638+0000 7f786d42c700 1 --2- 172.21.2.105:0/2199896717 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f78680b0cc0 0x7f786805c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:42.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.638+0000 7f786d42c700 1 -- 172.21.2.105:0/2199896717 >> v1:172.21.2.115:6789/0 conn(0x7f78680b2940 legacy=0x7f7868142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:42.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.638+0000 7f786d42c700 1 -- 172.21.2.105:0/2199896717 --> v2:172.21.2.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78680b1880 con 0x7f78680b0780 2021-11-12T05:40:42.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.638+0000 7f786e42e700 1 --2- 172.21.2.105:0/2199896717 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f78680b0cc0 0x7f786805c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-12T05:40:42.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.638+0000 7f786d42c700 1 --2- 172.21.2.105:0/2199896717 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f78680b0780 0x7f78681434d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f7864002f70 tx=0x7f7864006df0).ready entity=mon.1 client_cookie=5757afbe9e48a8c1 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:42.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.638+0000 7f786cc2b700 1 -- 172.21.2.105:0/2199896717 <== mon.1 v2:172.21.2.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f786400d570 con 0x7f78680b0780 2021-11-12T05:40:42.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.638+0000 7f786cc2b700 1 -- 172.21.2.105:0/2199896717 <== mon.1 v2:172.21.2.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7864000e90 con 0x7f78680b0780 2021-11-12T05:40:42.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.638+0000 7f786cc2b700 1 -- 172.21.2.105:0/2199896717 <== mon.1 v2:172.21.2.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f786400d8c0 con 0x7f78680b0780 2021-11-12T05:40:42.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.638+0000 7f786fe91700 1 -- 172.21.2.105:0/2199896717 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f78680b0780 msgr2=0x7f78681434d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:42.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.638+0000 7f786fe91700 1 --2- 172.21.2.105:0/2199896717 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f78680b0780 0x7f78681434d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f7864002f70 tx=0x7f7864006df0).stop 2021-11-12T05:40:42.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.638+0000 7f786fe91700 1 -- 172.21.2.105:0/2199896717 shutdown_connections 2021-11-12T05:40:42.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.638+0000 7f786fe91700 1 --2- 172.21.2.105:0/2199896717 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f78680b0cc0 0x7f786805c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:42.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.638+0000 7f786fe91700 1 --2- 172.21.2.105:0/2199896717 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f78680b0780 0x7f78681434d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:42.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.638+0000 7f786fe91700 1 -- 172.21.2.105:0/2199896717 >> 172.21.2.105:0/2199896717 conn(0x7f7868068440 msgr2=0x7f7868062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:42.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.638+0000 7f786fe91700 1 -- 172.21.2.105:0/2199896717 shutdown_connections 2021-11-12T05:40:42.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.638+0000 7f786fe91700 1 -- 172.21.2.105:0/2199896717 wait complete. 2021-11-12T05:40:42.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.638+0000 7f786fe91700 1 Processor -- start 2021-11-12T05:40:42.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.638+0000 7f786fe91700 1 -- start start 2021-11-12T05:40:42.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.638+0000 7f786fe91700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f78680b0780 0x7f786814d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.638+0000 7f786fe91700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f78680b0cc0 0x7f7868066810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.638+0000 7f786fe91700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f78680b2940 0x7f78680ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.638+0000 7f786fe91700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7868065ea0 con 0x7f78680b0780 2021-11-12T05:40:42.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.638+0000 7f786fe91700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78680660d0 con 0x7f78680b2940 2021-11-12T05:40:42.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.638+0000 7f786fe91700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7868066370 con 0x7f78680b0cc0 2021-11-12T05:40:42.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.638+0000 7f786dc2d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f78680b0780 0x7f786814d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:42.650 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.638+0000 7f786dc2d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f78680b0780 0x7f786814d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43046/0 (socket says 172.21.2.105:43046) 2021-11-12T05:40:42.650 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.638+0000 7f786dc2d700 1 -- 172.21.2.105:0/286410294 learned_addr learned my addr 172.21.2.105:0/286410294 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:42.650 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.638+0000 7f786dc2d700 1 -- 172.21.2.105:0/286410294 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f78680b0cc0 msgr2=0x7f7868066810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:42.650 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.638+0000 7f786dc2d700 1 --2- 172.21.2.105:0/286410294 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f78680b0cc0 0x7f7868066810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:42.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.638+0000 7f786dc2d700 1 -- 172.21.2.105:0/286410294 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f78680b2940 msgr2=0x7f78680ab8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:42.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.638+0000 7f786dc2d700 1 --2- 172.21.2.105:0/286410294 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f78680b2940 0x7f78680ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:42.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.638+0000 7f786dc2d700 1 -- 172.21.2.105:0/286410294 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7860009470 con 0x7f78680b0780 2021-11-12T05:40:42.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.638+0000 7f786dc2d700 1 --2- 172.21.2.105:0/286410294 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f78680b0780 0x7f786814d000 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f78680b2f60 tx=0x7f785c007ca0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:42.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.642+0000 7f785affd700 1 -- 172.21.2.105:0/286410294 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f785c00ce30 con 0x7f78680b0780 2021-11-12T05:40:42.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.642+0000 7f785affd700 1 -- 172.21.2.105:0/286410294 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785c0072e0 con 0x7f78680b0780 2021-11-12T05:40:42.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.642+0000 7f785affd700 1 -- 172.21.2.105:0/286410294 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f785c005800 con 0x7f78680b0780 2021-11-12T05:40:42.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.642+0000 7f786fe91700 1 -- 172.21.2.105:0/286410294 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f786400b180 con 0x7f78680b0780 2021-11-12T05:40:42.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.642+0000 7f786fe91700 1 -- 172.21.2.105:0/286410294 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7868065200 con 0x7f78680b0780 2021-11-12T05:40:42.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.642+0000 7f786fe91700 1 -- 172.21.2.105:0/286410294 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7868066530 con 0x7f78680b0780 2021-11-12T05:40:42.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.642+0000 7f785affd700 1 -- 172.21.2.105:0/286410294 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f785c010070 con 0x7f78680b0780 2021-11-12T05:40:42.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.642+0000 7f785affd700 1 --2- 172.21.2.105:0/286410294 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7848053720 0x7f7848055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.642+0000 7f785affd700 1 -- 172.21.2.105:0/286410294 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f785c06b230 con 0x7f78680b0780 2021-11-12T05:40:42.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.642+0000 7f786d42c700 1 --2- 172.21.2.105:0/286410294 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7848053720 0x7f7848055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:42.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.642+0000 7f786d42c700 1 --2- 172.21.2.105:0/286410294 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7848053720 0x7f7848055be0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f7864002f70 tx=0x7f7864014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:42.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.646+0000 7f785affd700 1 -- 172.21.2.105:0/286410294 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f785c042120 con 0x7f78680b0780 2021-11-12T05:40:42.728 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.726+0000 7f786fe91700 1 -- 172.21.2.105:0/286410294 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f78680abd90 con 0x7f78680b0780 2021-11-12T05:40:42.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.726+0000 7f785affd700 1 -- 172.21.2.105:0/286410294 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f785c045740 con 0x7f78680b0780 2021-11-12T05:40:42.729 INFO:teuthology.orchestra.run.gibba005.stdout:60129542149 2021-11-12T05:40:42.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.726+0000 7f786fe91700 1 -- 172.21.2.105:0/286410294 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7848053720 msgr2=0x7f7848055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:42.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.726+0000 7f786fe91700 1 --2- 172.21.2.105:0/286410294 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7848053720 0x7f7848055be0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f7864002f70 tx=0x7f7864014000).stop 2021-11-12T05:40:42.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.726+0000 7f786fe91700 1 -- 172.21.2.105:0/286410294 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f78680b0780 msgr2=0x7f786814d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:42.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.726+0000 7f786fe91700 1 --2- 172.21.2.105:0/286410294 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f78680b0780 0x7f786814d000 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f78680b2f60 tx=0x7f785c007ca0).stop 2021-11-12T05:40:42.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.726+0000 7f786fe91700 1 -- 172.21.2.105:0/286410294 shutdown_connections 2021-11-12T05:40:42.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.726+0000 7f786fe91700 1 --2- 172.21.2.105:0/286410294 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7848053720 0x7f7848055be0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:42.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.726+0000 7f786fe91700 1 --2- 172.21.2.105:0/286410294 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f78680b2940 0x7f78680ab8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:42.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.726+0000 7f786fe91700 1 --2- 172.21.2.105:0/286410294 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f78680b0cc0 0x7f7868066810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:42.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.726+0000 7f786fe91700 1 --2- 172.21.2.105:0/286410294 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f78680b0780 0x7f786814d000 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:42.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.726+0000 7f786fe91700 1 -- 172.21.2.105:0/286410294 >> 172.21.2.105:0/286410294 conn(0x7f7868068440 msgr2=0x7f7868138870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:42.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.726+0000 7f786fe91700 1 -- 172.21.2.105:0/286410294 shutdown_connections 2021-11-12T05:40:42.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.726+0000 7f786fe91700 1 -- 172.21.2.105:0/286410294 wait complete. 2021-11-12T05:40:42.736 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.6 2021-11-12T05:40:42.736 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2021-11-12T05:40:42.787 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.782+0000 7f6f64057700 1 Processor -- start 2021-11-12T05:40:42.787 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.782+0000 7f6f64057700 1 -- start start 2021-11-12T05:40:42.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f64057700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f6f5c0ac280 0x7f6f5c14b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f64057700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f6f5c0af730 0x7f6f5c0ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f64057700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5c0ac7b0 con 0x7f6f5c0ad080 2021-11-12T05:40:42.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f64057700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f5c1488a0 con 0x7f6f5c0ac280 2021-11-12T05:40:42.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f64057700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f5c0ac9e0 con 0x7f6f5c0af730 2021-11-12T05:40:42.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f615f2700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f6f5c0ac280 0x7f6f5c14b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:42.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f615f2700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f6f5c0ac280 0x7f6f5c14b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43054/0 (socket says 172.21.2.105:43054) 2021-11-12T05:40:42.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f615f2700 1 -- 172.21.2.105:0/3519180185 learned_addr learned my addr 172.21.2.105:0/3519180185 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:42.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f615f2700 1 -- 172.21.2.105:0/3519180185 >> v2:172.21.2.115:3300/0 conn(0x7f6f5c0af730 msgr2=0x7f6f5c0ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:42.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f615f2700 1 --2- 172.21.2.105:0/3519180185 >> v2:172.21.2.115:3300/0 conn(0x7f6f5c0af730 0x7f6f5c0ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:42.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f615f2700 1 -- 172.21.2.105:0/3519180185 >> v1:172.21.2.115:6789/0 conn(0x7f6f5c0ad080 legacy=0x7f6f5c14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:42.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f615f2700 1 -- 172.21.2.105:0/3519180185 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5c0b0b30 con 0x7f6f5c0ac280 2021-11-12T05:40:42.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f615f2700 1 --2- 172.21.2.105:0/3519180185 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6f5c0ac280 0x7f6f5c14b2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f6f5c0b0eb0 tx=0x7f6f50006eb0).ready entity=mon.0 client_cookie=8847e972b14169ee server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:42.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f60df1700 1 -- 172.21.2.105:0/3519180185 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f5000d5c0 con 0x7f6f5c0ac280 2021-11-12T05:40:42.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f60df1700 1 -- 172.21.2.105:0/3519180185 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f50000e90 con 0x7f6f5c0ac280 2021-11-12T05:40:42.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f60df1700 1 -- 172.21.2.105:0/3519180185 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f5000d950 con 0x7f6f5c0ac280 2021-11-12T05:40:42.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f64057700 1 -- 172.21.2.105:0/3519180185 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6f5c0ac280 msgr2=0x7f6f5c14b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:42.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f64057700 1 --2- 172.21.2.105:0/3519180185 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6f5c0ac280 0x7f6f5c14b2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f6f5c0b0eb0 tx=0x7f6f50006eb0).stop 2021-11-12T05:40:42.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f64057700 1 -- 172.21.2.105:0/3519180185 shutdown_connections 2021-11-12T05:40:42.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f64057700 1 --2- 172.21.2.105:0/3519180185 >> v2:172.21.2.115:3300/0 conn(0x7f6f5c0af730 0x7f6f5c0ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:42.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f64057700 1 --2- 172.21.2.105:0/3519180185 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6f5c0ac280 0x7f6f5c14b2f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:42.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f64057700 1 -- 172.21.2.105:0/3519180185 >> 172.21.2.105:0/3519180185 conn(0x7f6f5c0b5370 msgr2=0x7f6f5c0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:42.798 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f64057700 1 -- 172.21.2.105:0/3519180185 shutdown_connections 2021-11-12T05:40:42.798 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f64057700 1 -- 172.21.2.105:0/3519180185 wait complete. 2021-11-12T05:40:42.798 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f64057700 1 Processor -- start 2021-11-12T05:40:42.798 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f64057700 1 -- start start 2021-11-12T05:40:42.798 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f64057700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6f5c0ac280 0x7f6f5c15a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f64057700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6f5c0ad080 0x7f6f5c15a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f64057700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6f5c0af730 0x7f6f5c0a8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f64057700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c0ab220 con 0x7f6f5c0ac280 2021-11-12T05:40:42.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f64057700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c0a9d10 con 0x7f6f5c0ad080 2021-11-12T05:40:42.800 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f64057700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c0ab410 con 0x7f6f5c0af730 2021-11-12T05:40:42.800 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f61df3700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6f5c0ac280 0x7f6f5c15a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:42.800 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f61df3700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6f5c0ac280 0x7f6f5c15a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43060/0 (socket says 172.21.2.105:43060) 2021-11-12T05:40:42.800 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f61df3700 1 -- 172.21.2.105:0/2705967668 learned_addr learned my addr 172.21.2.105:0/2705967668 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:42.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f61df3700 1 -- 172.21.2.105:0/2705967668 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6f5c0af730 msgr2=0x7f6f5c0a8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:42.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f61df3700 1 --2- 172.21.2.105:0/2705967668 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6f5c0af730 0x7f6f5c0a8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:42.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f61df3700 1 -- 172.21.2.105:0/2705967668 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6f5c0ad080 msgr2=0x7f6f5c15a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:42.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f61df3700 1 --2- 172.21.2.105:0/2705967668 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6f5c0ad080 0x7f6f5c15a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:42.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f61df3700 1 -- 172.21.2.105:0/2705967668 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5000b1e0 con 0x7f6f5c0ac280 2021-11-12T05:40:42.802 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f61df3700 1 --2- 172.21.2.105:0/2705967668 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6f5c0ac280 0x7f6f5c15a4d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f6f58002f90 tx=0x7f6f58006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:42.802 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f4effd700 1 -- 172.21.2.105:0/2705967668 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f58013460 con 0x7f6f5c0ac280 2021-11-12T05:40:42.802 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f4effd700 1 -- 172.21.2.105:0/2705967668 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f580135c0 con 0x7f6f5c0ac280 2021-11-12T05:40:42.802 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f4effd700 1 -- 172.21.2.105:0/2705967668 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f58013920 con 0x7f6f5c0ac280 2021-11-12T05:40:42.803 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f64057700 1 -- 172.21.2.105:0/2705967668 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f5c0a9550 con 0x7f6f5c0ac280 2021-11-12T05:40:42.803 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.786+0000 7f6f64057700 1 -- 172.21.2.105:0/2705967668 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f5c0a9a90 con 0x7f6f5c0ac280 2021-11-12T05:40:42.803 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.790+0000 7f6f64057700 1 -- 172.21.2.105:0/2705967668 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f5c0b1440 con 0x7f6f5c0ac280 2021-11-12T05:40:42.803 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.790+0000 7f6f4effd700 1 -- 172.21.2.105:0/2705967668 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6f5800f070 con 0x7f6f5c0ac280 2021-11-12T05:40:42.804 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.790+0000 7f6f4effd700 1 --2- 172.21.2.105:0/2705967668 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6f440536a0 0x7f6f44055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.804 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.790+0000 7f6f4effd700 1 -- 172.21.2.105:0/2705967668 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f6f5806b3a0 con 0x7f6f5c0ac280 2021-11-12T05:40:42.804 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.790+0000 7f6f615f2700 1 --2- 172.21.2.105:0/2705967668 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6f440536a0 0x7f6f44055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:42.804 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.790+0000 7f6f615f2700 1 --2- 172.21.2.105:0/2705967668 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6f440536a0 0x7f6f44055b60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f6f5c0b0eb0 tx=0x7f6f50015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:42.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.790+0000 7f6f4effd700 1 -- 172.21.2.105:0/2705967668 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6f58042290 con 0x7f6f5c0ac280 2021-11-12T05:40:42.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.874+0000 7f6f64057700 1 -- 172.21.2.105:0/2705967668 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f6f5c068700 con 0x7f6f5c0ac280 2021-11-12T05:40:42.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.874+0000 7f6f4effd700 1 -- 172.21.2.105:0/2705967668 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6f580458b0 con 0x7f6f5c0ac280 2021-11-12T05:40:42.878 INFO:teuthology.orchestra.run.gibba005.stdout:60129542150 2021-11-12T05:40:42.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.874+0000 7f6f64057700 1 -- 172.21.2.105:0/2705967668 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6f440536a0 msgr2=0x7f6f44055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:42.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.874+0000 7f6f64057700 1 --2- 172.21.2.105:0/2705967668 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6f440536a0 0x7f6f44055b60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f6f5c0b0eb0 tx=0x7f6f50015000).stop 2021-11-12T05:40:42.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.874+0000 7f6f64057700 1 -- 172.21.2.105:0/2705967668 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6f5c0ac280 msgr2=0x7f6f5c15a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:42.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.874+0000 7f6f64057700 1 --2- 172.21.2.105:0/2705967668 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6f5c0ac280 0x7f6f5c15a4d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f6f58002f90 tx=0x7f6f58006df0).stop 2021-11-12T05:40:42.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.874+0000 7f6f64057700 1 -- 172.21.2.105:0/2705967668 shutdown_connections 2021-11-12T05:40:42.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.874+0000 7f6f64057700 1 --2- 172.21.2.105:0/2705967668 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6f440536a0 0x7f6f44055b60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:42.881 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.874+0000 7f6f64057700 1 --2- 172.21.2.105:0/2705967668 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6f5c0af730 0x7f6f5c0a8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:42.881 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.874+0000 7f6f64057700 1 --2- 172.21.2.105:0/2705967668 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6f5c0ad080 0x7f6f5c15a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:42.881 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.874+0000 7f6f64057700 1 --2- 172.21.2.105:0/2705967668 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6f5c0ac280 0x7f6f5c15a4d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:42.881 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.874+0000 7f6f64057700 1 -- 172.21.2.105:0/2705967668 >> 172.21.2.105:0/2705967668 conn(0x7f6f5c0b5370 msgr2=0x7f6f5c1451e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:42.882 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.874+0000 7f6f64057700 1 -- 172.21.2.105:0/2705967668 shutdown_connections 2021-11-12T05:40:42.882 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.874+0000 7f6f64057700 1 -- 172.21.2.105:0/2705967668 wait complete. 2021-11-12T05:40:42.885 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.7 2021-11-12T05:40:42.885 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2021-11-12T05:40:42.886 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-11-12T05:40:42.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.934+0000 7f4f8cce1700 1 Processor -- start 2021-11-12T05:40:42.938 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.934+0000 7f4f8cce1700 1 -- start start 2021-11-12T05:40:42.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.934+0000 7f4f8cce1700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f4f880ade80 0x7f4f880601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.934+0000 7f4f8cce1700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f4f8813a9c0 0x7f4f8813ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.934+0000 7f4f8cce1700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f88066150 con 0x7f4f8805fdc0 2021-11-12T05:40:42.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.934+0000 7f4f8cce1700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f88141fb0 con 0x7f4f880ade80 2021-11-12T05:40:42.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.934+0000 7f4f8cce1700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f880663f0 con 0x7f4f8813a9c0 2021-11-12T05:40:42.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.934+0000 7f4f85d9b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f4f880ade80 0x7f4f880601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:42.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.934+0000 7f4f85d9b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f4f880ade80 0x7f4f880601a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43072/0 (socket says 172.21.2.105:43072) 2021-11-12T05:40:42.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.934+0000 7f4f85d9b700 1 -- 172.21.2.105:0/2176383222 learned_addr learned my addr 172.21.2.105:0/2176383222 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:42.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.934+0000 7f4f85d9b700 1 -- 172.21.2.105:0/2176383222 >> v2:172.21.2.115:3300/0 conn(0x7f4f8813a9c0 msgr2=0x7f4f8813ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:42.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.934+0000 7f4f85d9b700 1 --2- 172.21.2.105:0/2176383222 >> v2:172.21.2.115:3300/0 conn(0x7f4f8813a9c0 0x7f4f8813ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:42.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.934+0000 7f4f85d9b700 1 -- 172.21.2.105:0/2176383222 >> v1:172.21.2.115:6789/0 conn(0x7f4f8805fdc0 legacy=0x7f4f88066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:42.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.934+0000 7f4f85d9b700 1 -- 172.21.2.105:0/2176383222 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f88140fd0 con 0x7f4f880ade80 2021-11-12T05:40:42.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.934+0000 7f4f85d9b700 1 --2- 172.21.2.105:0/2176383222 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4f880ade80 0x7f4f880601a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f4f88060e00 tx=0x7f4f78006eb0).ready entity=mon.0 client_cookie=c027abafd855c4d2 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:42.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.934+0000 7f4f8559a700 1 -- 172.21.2.105:0/2176383222 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f7800d5c0 con 0x7f4f880ade80 2021-11-12T05:40:42.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.934+0000 7f4f8559a700 1 -- 172.21.2.105:0/2176383222 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f78000e90 con 0x7f4f880ade80 2021-11-12T05:40:42.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.934+0000 7f4f8559a700 1 -- 172.21.2.105:0/2176383222 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f7800d910 con 0x7f4f880ade80 2021-11-12T05:40:42.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.938+0000 7f4f8cce1700 1 -- 172.21.2.105:0/2176383222 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4f880ade80 msgr2=0x7f4f880601a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:42.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.938+0000 7f4f8cce1700 1 --2- 172.21.2.105:0/2176383222 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4f880ade80 0x7f4f880601a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f4f88060e00 tx=0x7f4f78006eb0).stop 2021-11-12T05:40:42.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.938+0000 7f4f8cce1700 1 -- 172.21.2.105:0/2176383222 shutdown_connections 2021-11-12T05:40:42.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.938+0000 7f4f8cce1700 1 --2- 172.21.2.105:0/2176383222 >> v2:172.21.2.115:3300/0 conn(0x7f4f8813a9c0 0x7f4f8813ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:42.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.938+0000 7f4f8cce1700 1 --2- 172.21.2.105:0/2176383222 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4f880ade80 0x7f4f880601a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:42.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.938+0000 7f4f8cce1700 1 -- 172.21.2.105:0/2176383222 >> 172.21.2.105:0/2176383222 conn(0x7f4f880608d0 msgr2=0x7f4f8805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:42.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.938+0000 7f4f8cce1700 1 -- 172.21.2.105:0/2176383222 shutdown_connections 2021-11-12T05:40:42.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.938+0000 7f4f8cce1700 1 -- 172.21.2.105:0/2176383222 wait complete. 2021-11-12T05:40:42.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.938+0000 7f4f8cce1700 1 Processor -- start 2021-11-12T05:40:42.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.938+0000 7f4f8cce1700 1 -- start start 2021-11-12T05:40:42.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.938+0000 7f4f8cce1700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4f8805fdc0 0x7f4f880b5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.938+0000 7f4f8cce1700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4f880ade80 0x7f4f8813d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.938+0000 7f4f8cce1700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4f8813a9c0 0x7f4f88142200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.950 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.938+0000 7f4f8cce1700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8813df90 con 0x7f4f8805fdc0 2021-11-12T05:40:42.950 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.938+0000 7f4f8cce1700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f881437e0 con 0x7f4f8813a9c0 2021-11-12T05:40:42.950 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.938+0000 7f4f8cce1700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f88143a50 con 0x7f4f880ade80 2021-11-12T05:40:42.950 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.938+0000 7f4f8659c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4f8805fdc0 0x7f4f880b5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:42.950 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.938+0000 7f4f8659c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4f8805fdc0 0x7f4f880b5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43074/0 (socket says 172.21.2.105:43074) 2021-11-12T05:40:42.951 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.938+0000 7f4f8659c700 1 -- 172.21.2.105:0/2508183346 learned_addr learned my addr 172.21.2.105:0/2508183346 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:42.951 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.938+0000 7f4f8659c700 1 -- 172.21.2.105:0/2508183346 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4f880ade80 msgr2=0x7f4f8813d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:42.951 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.938+0000 7f4f8659c700 1 --2- 172.21.2.105:0/2508183346 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4f880ade80 0x7f4f8813d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:42.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.938+0000 7f4f8659c700 1 -- 172.21.2.105:0/2508183346 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4f8813a9c0 msgr2=0x7f4f88142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:42.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.938+0000 7f4f8659c700 1 --2- 172.21.2.105:0/2508183346 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4f8813a9c0 0x7f4f88142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:42.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.938+0000 7f4f8659c700 1 -- 172.21.2.105:0/2508183346 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f7800b1e0 con 0x7f4f8805fdc0 2021-11-12T05:40:42.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.938+0000 7f4f8659c700 1 --2- 172.21.2.105:0/2508183346 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4f8805fdc0 0x7f4f880b5360 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f4f88143970 tx=0x7f4f70006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:42.953 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.938+0000 7f4f7f7fe700 1 -- 172.21.2.105:0/2508183346 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f70013460 con 0x7f4f8805fdc0 2021-11-12T05:40:42.953 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.938+0000 7f4f7f7fe700 1 -- 172.21.2.105:0/2508183346 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f700135c0 con 0x7f4f8805fdc0 2021-11-12T05:40:42.953 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.938+0000 7f4f8cce1700 1 -- 172.21.2.105:0/2508183346 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f88156900 con 0x7f4f8805fdc0 2021-11-12T05:40:42.953 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.938+0000 7f4f7f7fe700 1 -- 172.21.2.105:0/2508183346 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f70013920 con 0x7f4f8805fdc0 2021-11-12T05:40:42.953 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.938+0000 7f4f8cce1700 1 -- 172.21.2.105:0/2508183346 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f88144f70 con 0x7f4f8805fdc0 2021-11-12T05:40:42.954 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.938+0000 7f4f8cce1700 1 -- 172.21.2.105:0/2508183346 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f88139c30 con 0x7f4f8805fdc0 2021-11-12T05:40:42.954 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.938+0000 7f4f7f7fe700 1 -- 172.21.2.105:0/2508183346 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4f7000f070 con 0x7f4f8805fdc0 2021-11-12T05:40:42.954 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.938+0000 7f4f7f7fe700 1 --2- 172.21.2.105:0/2508183346 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4f6c053580 0x7f4f6c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:42.954 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.938+0000 7f4f7f7fe700 1 -- 172.21.2.105:0/2508183346 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f4f7006b410 con 0x7f4f8805fdc0 2021-11-12T05:40:42.955 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.938+0000 7f4f85d9b700 1 --2- 172.21.2.105:0/2508183346 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4f6c053580 0x7f4f6c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:42.955 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.938+0000 7f4f85d9b700 1 --2- 172.21.2.105:0/2508183346 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4f6c053580 0x7f4f6c055a40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f4f88060e00 tx=0x7f4f78015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:42.955 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:42.942+0000 7f4f7f7fe700 1 -- 172.21.2.105:0/2508183346 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4f70042300 con 0x7f4f8805fdc0 2021-11-12T05:40:43.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.022+0000 7f4f8cce1700 1 -- 172.21.2.105:0/2508183346 --> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4f88143c10 con 0x7f4f6c053580 2021-11-12T05:40:43.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.022+0000 7f4f7f7fe700 1 -- 172.21.2.105:0/2508183346 <== mgr.4107 v2:172.21.2.105:6800/14730 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82344 (secure 0 0 0) 0x7f4f88143c10 con 0x7f4f6c053580 2021-11-12T05:40:43.027 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:40:43.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.026+0000 7f4f8cce1700 1 -- 172.21.2.105:0/2508183346 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4f6c053580 msgr2=0x7f4f6c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:43.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.026+0000 7f4f8cce1700 1 --2- 172.21.2.105:0/2508183346 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4f6c053580 0x7f4f6c055a40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f4f88060e00 tx=0x7f4f78015000).stop 2021-11-12T05:40:43.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.026+0000 7f4f8cce1700 1 -- 172.21.2.105:0/2508183346 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4f8805fdc0 msgr2=0x7f4f880b5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:43.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.026+0000 7f4f8cce1700 1 --2- 172.21.2.105:0/2508183346 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4f8805fdc0 0x7f4f880b5360 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f4f88143970 tx=0x7f4f70006df0).stop 2021-11-12T05:40:43.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.026+0000 7f4f8cce1700 1 -- 172.21.2.105:0/2508183346 shutdown_connections 2021-11-12T05:40:43.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.026+0000 7f4f8cce1700 1 --2- 172.21.2.105:0/2508183346 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4f6c053580 0x7f4f6c055a40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:43.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.026+0000 7f4f8cce1700 1 --2- 172.21.2.105:0/2508183346 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4f8813a9c0 0x7f4f88142200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.026+0000 7f4f8cce1700 1 --2- 172.21.2.105:0/2508183346 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4f880ade80 0x7f4f8813d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.026+0000 7f4f8cce1700 1 --2- 172.21.2.105:0/2508183346 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4f8805fdc0 0x7f4f880b5360 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:43.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.026+0000 7f4f8cce1700 1 -- 172.21.2.105:0/2508183346 >> 172.21.2.105:0/2508183346 conn(0x7f4f880608d0 msgr2=0x7f4f88062070 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:43.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.026+0000 7f4f8cce1700 1 -- 172.21.2.105:0/2508183346 shutdown_connections 2021-11-12T05:40:43.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.026+0000 7f4f8cce1700 1 -- 172.21.2.105:0/2508183346 wait complete. 2021-11-12T05:40:43.032 INFO:teuthology.orchestra.run.gibba005.stderr:dumped all 2021-11-12T05:40:43.033 INFO:teuthology.orchestra.run.gibba005.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2021-11-12T05:40:42.012385+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":60,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390784,"kb_used_data":2112,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746583936,"statfs":{"total":773094113280,"available":764501950464,"internally_reserved":8589934592,"allocated":2162688,"data_stored":840760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001349"},"pg_stats":[{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.213994+0000","last_change":"2021-11-12T05:40:37.213436+0000","last_active":"2021-11-12T05:40:37.213994+0000","last_peered":"2021-11-12T05:40:37.213994+0000","last_clean":"2021-11-12T05:40:37.213994+0000","last_became_active":"2021-11-12T05:40:37.213046+0000","last_became_peered":"2021-11-12T05:40:37.213046+0000","last_unstale":"2021-11-12T05:40:37.213994+0000","last_undegraded":"2021-11-12T05:40:37.213994+0000","last_fullsized":"2021-11-12T05:40:37.213994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:35.998246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:35.998246+0000","last_clean_scrub_stamp":"2021-11-12T05:40:35.998246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.211737+0000","last_change":"2021-11-12T05:40:27.633039+0000","last_active":"2021-11-12T05:40:37.211737+0000","last_peered":"2021-11-12T05:40:37.211737+0000","last_clean":"2021-11-12T05:40:37.211737+0000","last_became_active":"2021-11-12T05:40:27.631630+0000","last_became_peered":"2021-11-12T05:40:27.631630+0000","last_unstale":"2021-11-12T05:40:37.211737+0000","last_undegraded":"2021-11-12T05:40:37.211737+0000","last_fullsized":"2021-11-12T05:40:37.211737+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:23.018147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:23.018147+0000","last_clean_scrub_stamp":"2021-11-12T05:40:23.018147+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.210716+0000","last_change":"2021-11-12T05:40:31.959167+0000","last_active":"2021-11-12T05:40:37.210716+0000","last_peered":"2021-11-12T05:40:37.210716+0000","last_clean":"2021-11-12T05:40:37.210716+0000","last_became_active":"2021-11-12T05:40:31.958938+0000","last_became_peered":"2021-11-12T05:40:31.958938+0000","last_unstale":"2021-11-12T05:40:37.210716+0000","last_undegraded":"2021-11-12T05:40:37.210716+0000","last_fullsized":"2021-11-12T05:40:37.210716+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_clean_scrub_stamp":"2021-11-12T05:40:30.930115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"24'1","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.207676+0000","last_change":"2021-11-12T05:40:33.985425+0000","last_active":"2021-11-12T05:40:37.207676+0000","last_peered":"2021-11-12T05:40:37.207676+0000","last_clean":"2021-11-12T05:40:37.207676+0000","last_became_active":"2021-11-12T05:40:33.985205+0000","last_became_peered":"2021-11-12T05:40:33.985205+0000","last_unstale":"2021-11-12T05:40:37.207676+0000","last_undegraded":"2021-11-12T05:40:37.207676+0000","last_fullsized":"2021-11-12T05:40:37.207676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:32.958222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:32.958222+0000","last_clean_scrub_stamp":"2021-11-12T05:40:32.958222+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.214142+0000","last_change":"2021-11-12T05:40:37.213212+0000","last_active":"2021-11-12T05:40:37.214142+0000","last_peered":"2021-11-12T05:40:37.214142+0000","last_clean":"2021-11-12T05:40:37.214142+0000","last_became_active":"2021-11-12T05:40:37.212918+0000","last_became_peered":"2021-11-12T05:40:37.212918+0000","last_unstale":"2021-11-12T05:40:37.214142+0000","last_undegraded":"2021-11-12T05:40:37.214142+0000","last_fullsized":"2021-11-12T05:40:37.214142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:35.998246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:35.998246+0000","last_clean_scrub_stamp":"2021-11-12T05:40:35.998246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.211712+0000","last_change":"2021-11-12T05:40:31.957870+0000","last_active":"2021-11-12T05:40:37.211712+0000","last_peered":"2021-11-12T05:40:37.211712+0000","last_clean":"2021-11-12T05:40:37.211712+0000","last_became_active":"2021-11-12T05:40:31.957678+0000","last_became_peered":"2021-11-12T05:40:31.957678+0000","last_unstale":"2021-11-12T05:40:37.211712+0000","last_undegraded":"2021-11-12T05:40:37.211712+0000","last_fullsized":"2021-11-12T05:40:37.211712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_clean_scrub_stamp":"2021-11-12T05:40:30.930115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.205827+0000","last_change":"2021-11-12T05:40:33.985234+0000","last_active":"2021-11-12T05:40:37.205827+0000","last_peered":"2021-11-12T05:40:37.205827+0000","last_clean":"2021-11-12T05:40:37.205827+0000","last_became_active":"2021-11-12T05:40:33.985011+0000","last_became_peered":"2021-11-12T05:40:33.985011+0000","last_unstale":"2021-11-12T05:40:37.205827+0000","last_undegraded":"2021-11-12T05:40:37.205827+0000","last_fullsized":"2021-11-12T05:40:37.205827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:32.958222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:32.958222+0000","last_clean_scrub_stamp":"2021-11-12T05:40:32.958222+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.205959+0000","last_change":"2021-11-12T05:40:37.019986+0000","last_active":"2021-11-12T05:40:37.205959+0000","last_peered":"2021-11-12T05:40:37.205959+0000","last_clean":"2021-11-12T05:40:37.205959+0000","last_became_active":"2021-11-12T05:40:37.019734+0000","last_became_peered":"2021-11-12T05:40:37.019734+0000","last_unstale":"2021-11-12T05:40:37.205959+0000","last_undegraded":"2021-11-12T05:40:37.205959+0000","last_fullsized":"2021-11-12T05:40:37.205959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:35.998246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:35.998246+0000","last_clean_scrub_stamp":"2021-11-12T05:40:35.998246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.207281+0000","last_change":"2021-11-12T05:40:31.957439+0000","last_active":"2021-11-12T05:40:37.207281+0000","last_peered":"2021-11-12T05:40:37.207281+0000","last_clean":"2021-11-12T05:40:37.207281+0000","last_became_active":"2021-11-12T05:40:31.957234+0000","last_became_peered":"2021-11-12T05:40:31.957234+0000","last_unstale":"2021-11-12T05:40:37.207281+0000","last_undegraded":"2021-11-12T05:40:37.207281+0000","last_fullsized":"2021-11-12T05:40:37.207281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_clean_scrub_stamp":"2021-11-12T05:40:30.930115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"24'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.209419+0000","last_change":"2021-11-12T05:40:34.010660+0000","last_active":"2021-11-12T05:40:37.209419+0000","last_peered":"2021-11-12T05:40:37.209419+0000","last_clean":"2021-11-12T05:40:37.209419+0000","last_became_active":"2021-11-12T05:40:34.010481+0000","last_became_peered":"2021-11-12T05:40:34.010481+0000","last_unstale":"2021-11-12T05:40:37.209419+0000","last_undegraded":"2021-11-12T05:40:37.209419+0000","last_fullsized":"2021-11-12T05:40:37.209419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:32.958222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:32.958222+0000","last_clean_scrub_stamp":"2021-11-12T05:40:32.958222+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.205923+0000","last_change":"2021-11-12T05:40:37.020271+0000","last_active":"2021-11-12T05:40:37.205923+0000","last_peered":"2021-11-12T05:40:37.205923+0000","last_clean":"2021-11-12T05:40:37.205923+0000","last_became_active":"2021-11-12T05:40:37.019951+0000","last_became_peered":"2021-11-12T05:40:37.019951+0000","last_unstale":"2021-11-12T05:40:37.205923+0000","last_undegraded":"2021-11-12T05:40:37.205923+0000","last_fullsized":"2021-11-12T05:40:37.205923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:35.998246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:35.998246+0000","last_clean_scrub_stamp":"2021-11-12T05:40:35.998246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.210786+0000","last_change":"2021-11-12T05:40:31.959024+0000","last_active":"2021-11-12T05:40:37.210786+0000","last_peered":"2021-11-12T05:40:37.210786+0000","last_clean":"2021-11-12T05:40:37.210786+0000","last_became_active":"2021-11-12T05:40:31.958760+0000","last_became_peered":"2021-11-12T05:40:31.958760+0000","last_unstale":"2021-11-12T05:40:37.210786+0000","last_undegraded":"2021-11-12T05:40:37.210786+0000","last_fullsized":"2021-11-12T05:40:37.210786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_clean_scrub_stamp":"2021-11-12T05:40:30.930115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"24'5","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.214572+0000","last_change":"2021-11-12T05:40:33.985476+0000","last_active":"2021-11-12T05:40:37.214572+0000","last_peered":"2021-11-12T05:40:37.214572+0000","last_clean":"2021-11-12T05:40:37.214572+0000","last_became_active":"2021-11-12T05:40:33.985259+0000","last_became_peered":"2021-11-12T05:40:33.985259+0000","last_unstale":"2021-11-12T05:40:37.214572+0000","last_undegraded":"2021-11-12T05:40:37.214572+0000","last_fullsized":"2021-11-12T05:40:37.214572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:32.958222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:32.958222+0000","last_clean_scrub_stamp":"2021-11-12T05:40:32.958222+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.205798+0000","last_change":"2021-11-12T05:40:37.020142+0000","last_active":"2021-11-12T05:40:37.205798+0000","last_peered":"2021-11-12T05:40:37.205798+0000","last_clean":"2021-11-12T05:40:37.205798+0000","last_became_active":"2021-11-12T05:40:37.019769+0000","last_became_peered":"2021-11-12T05:40:37.019769+0000","last_unstale":"2021-11-12T05:40:37.205798+0000","last_undegraded":"2021-11-12T05:40:37.205798+0000","last_fullsized":"2021-11-12T05:40:37.205798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:35.998246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:35.998246+0000","last_clean_scrub_stamp":"2021-11-12T05:40:35.998246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"24'6","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.213859+0000","last_change":"2021-11-12T05:40:33.985216+0000","last_active":"2021-11-12T05:40:37.213859+0000","last_peered":"2021-11-12T05:40:37.213859+0000","last_clean":"2021-11-12T05:40:37.213859+0000","last_became_active":"2021-11-12T05:40:33.985048+0000","last_became_peered":"2021-11-12T05:40:33.985048+0000","last_unstale":"2021-11-12T05:40:37.213859+0000","last_undegraded":"2021-11-12T05:40:37.213859+0000","last_fullsized":"2021-11-12T05:40:37.213859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:32.958222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:32.958222+0000","last_clean_scrub_stamp":"2021-11-12T05:40:32.958222+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.205991+0000","last_change":"2021-11-12T05:40:31.966265+0000","last_active":"2021-11-12T05:40:37.205991+0000","last_peered":"2021-11-12T05:40:37.205991+0000","last_clean":"2021-11-12T05:40:37.205991+0000","last_became_active":"2021-11-12T05:40:31.966094+0000","last_became_peered":"2021-11-12T05:40:31.966094+0000","last_unstale":"2021-11-12T05:40:37.205991+0000","last_undegraded":"2021-11-12T05:40:37.205991+0000","last_fullsized":"2021-11-12T05:40:37.205991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_clean_scrub_stamp":"2021-11-12T05:40:30.930115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.214151+0000","last_change":"2021-11-12T05:40:37.213250+0000","last_active":"2021-11-12T05:40:37.214151+0000","last_peered":"2021-11-12T05:40:37.214151+0000","last_clean":"2021-11-12T05:40:37.214151+0000","last_became_active":"2021-11-12T05:40:37.212938+0000","last_became_peered":"2021-11-12T05:40:37.212938+0000","last_unstale":"2021-11-12T05:40:37.214151+0000","last_undegraded":"2021-11-12T05:40:37.214151+0000","last_fullsized":"2021-11-12T05:40:37.214151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:35.998246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:35.998246+0000","last_clean_scrub_stamp":"2021-11-12T05:40:35.998246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"24'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.215303+0000","last_change":"2021-11-12T05:40:34.010701+0000","last_active":"2021-11-12T05:40:37.215303+0000","last_peered":"2021-11-12T05:40:37.215303+0000","last_clean":"2021-11-12T05:40:37.215303+0000","last_became_active":"2021-11-12T05:40:34.010535+0000","last_became_peered":"2021-11-12T05:40:34.010535+0000","last_unstale":"2021-11-12T05:40:37.215303+0000","last_undegraded":"2021-11-12T05:40:37.215303+0000","last_fullsized":"2021-11-12T05:40:37.215303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:32.958222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:32.958222+0000","last_clean_scrub_stamp":"2021-11-12T05:40:32.958222+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.211800+0000","last_change":"2021-11-12T05:40:31.966703+0000","last_active":"2021-11-12T05:40:37.211800+0000","last_peered":"2021-11-12T05:40:37.211800+0000","last_clean":"2021-11-12T05:40:37.211800+0000","last_became_active":"2021-11-12T05:40:31.966492+0000","last_became_peered":"2021-11-12T05:40:31.966492+0000","last_unstale":"2021-11-12T05:40:37.211800+0000","last_undegraded":"2021-11-12T05:40:37.211800+0000","last_fullsized":"2021-11-12T05:40:37.211800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_clean_scrub_stamp":"2021-11-12T05:40:30.930115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.213894+0000","last_change":"2021-11-12T05:40:37.213315+0000","last_active":"2021-11-12T05:40:37.213894+0000","last_peered":"2021-11-12T05:40:37.213894+0000","last_clean":"2021-11-12T05:40:37.213894+0000","last_became_active":"2021-11-12T05:40:37.212930+0000","last_became_peered":"2021-11-12T05:40:37.212930+0000","last_unstale":"2021-11-12T05:40:37.213894+0000","last_undegraded":"2021-11-12T05:40:37.213894+0000","last_fullsized":"2021-11-12T05:40:37.213894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:35.998246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:35.998246+0000","last_clean_scrub_stamp":"2021-11-12T05:40:35.998246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"24'7","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.211579+0000","last_change":"2021-11-12T05:40:34.010450+0000","last_active":"2021-11-12T05:40:37.211579+0000","last_peered":"2021-11-12T05:40:37.211579+0000","last_clean":"2021-11-12T05:40:37.211579+0000","last_became_active":"2021-11-12T05:40:34.010161+0000","last_became_peered":"2021-11-12T05:40:34.010161+0000","last_unstale":"2021-11-12T05:40:37.211579+0000","last_undegraded":"2021-11-12T05:40:37.211579+0000","last_fullsized":"2021-11-12T05:40:37.211579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:32.958222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:32.958222+0000","last_clean_scrub_stamp":"2021-11-12T05:40:32.958222+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.206046+0000","last_change":"2021-11-12T05:40:31.958555+0000","last_active":"2021-11-12T05:40:37.206046+0000","last_peered":"2021-11-12T05:40:37.206046+0000","last_clean":"2021-11-12T05:40:37.206046+0000","last_became_active":"2021-11-12T05:40:31.958357+0000","last_became_peered":"2021-11-12T05:40:31.958357+0000","last_unstale":"2021-11-12T05:40:37.206046+0000","last_undegraded":"2021-11-12T05:40:37.206046+0000","last_fullsized":"2021-11-12T05:40:37.206046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_clean_scrub_stamp":"2021-11-12T05:40:30.930115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.214157+0000","last_change":"2021-11-12T05:40:37.213459+0000","last_active":"2021-11-12T05:40:37.214157+0000","last_peered":"2021-11-12T05:40:37.214157+0000","last_clean":"2021-11-12T05:40:37.214157+0000","last_became_active":"2021-11-12T05:40:37.213021+0000","last_became_peered":"2021-11-12T05:40:37.213021+0000","last_unstale":"2021-11-12T05:40:37.214157+0000","last_undegraded":"2021-11-12T05:40:37.214157+0000","last_fullsized":"2021-11-12T05:40:37.214157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:35.998246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:35.998246+0000","last_clean_scrub_stamp":"2021-11-12T05:40:35.998246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"24'3","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.207988+0000","last_change":"2021-11-12T05:40:33.984973+0000","last_active":"2021-11-12T05:40:37.207988+0000","last_peered":"2021-11-12T05:40:37.207988+0000","last_clean":"2021-11-12T05:40:37.207988+0000","last_became_active":"2021-11-12T05:40:33.984747+0000","last_became_peered":"2021-11-12T05:40:33.984747+0000","last_unstale":"2021-11-12T05:40:37.207988+0000","last_undegraded":"2021-11-12T05:40:37.207988+0000","last_fullsized":"2021-11-12T05:40:37.207988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:32.958222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:32.958222+0000","last_clean_scrub_stamp":"2021-11-12T05:40:32.958222+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.210568+0000","last_change":"2021-11-12T05:40:31.959219+0000","last_active":"2021-11-12T05:40:37.210568+0000","last_peered":"2021-11-12T05:40:37.210568+0000","last_clean":"2021-11-12T05:40:37.210568+0000","last_became_active":"2021-11-12T05:40:31.958961+0000","last_became_peered":"2021-11-12T05:40:31.958961+0000","last_unstale":"2021-11-12T05:40:37.210568+0000","last_undegraded":"2021-11-12T05:40:37.210568+0000","last_fullsized":"2021-11-12T05:40:37.210568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_clean_scrub_stamp":"2021-11-12T05:40:30.930115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048848,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322992,"statfs":{"total":96636764160,"available":95562743808,"internally_reserved":1073741824,"allocated":270336,"data_stored":105094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.427}]}]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":104519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048848,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322992,"statfs":{"total":96636764160,"available":95562743808,"internally_reserved":1073741824,"allocated":270336,"data_stored":104679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.528}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6020000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2210000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6870000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":104553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4350000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048856,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322984,"statfs":{"total":96636764160,"available":95562735616,"internally_reserved":1073741824,"allocated":278528,"data_stored":105254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4079999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":106054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":106054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]}]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":104553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5289999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4510000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5700000000000001}]}]}]}} 2021-11-12T05:40:43.036 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-11-12T05:40:43.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.086+0000 7fbc4a103700 1 Processor -- start 2021-11-12T05:40:43.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.086+0000 7fbc4a103700 1 -- start start 2021-11-12T05:40:43.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.086+0000 7fbc4a103700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fbc440b01b0 0x7fbc440b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.086+0000 7fbc4a103700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fbc440aeb80 0x7fbc4413e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.086+0000 7fbc4a103700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc440b5ea0 con 0x7fbc440b5ac0 2021-11-12T05:40:43.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.086+0000 7fbc4a103700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc440b1a60 con 0x7fbc440b01b0 2021-11-12T05:40:43.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.086+0000 7fbc4a103700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc440accd0 con 0x7fbc440aeb80 2021-11-12T05:40:43.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.086+0000 7fbc437fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fbc440b5ac0 0x7fbc440ae470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:53478/0 (socket says 172.21.2.105:53478) 2021-11-12T05:40:43.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.086+0000 7fbc437fe700 1 -- 172.21.2.105:0/3645395651 learned_addr learned my addr 172.21.2.105:0/3645395651 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:43.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.086+0000 7fbc42ffd700 1 --2- 172.21.2.105:0/3645395651 >> v2:172.21.2.105:3300/0 conn(0x7fbc440b01b0 0x7fbc440b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:43.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.086+0000 7fbc42ffd700 1 -- 172.21.2.105:0/3645395651 >> v2:172.21.2.115:3300/0 conn(0x7fbc440aeb80 msgr2=0x7fbc4413e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:43.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.086+0000 7fbc42ffd700 1 --2- 172.21.2.105:0/3645395651 >> v2:172.21.2.115:3300/0 conn(0x7fbc440aeb80 0x7fbc4413e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.086+0000 7fbc42ffd700 1 -- 172.21.2.105:0/3645395651 >> v1:172.21.2.105:6789/0 conn(0x7fbc440b5ac0 legacy=0x7fbc440ae470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:43.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.086+0000 7fbc42ffd700 1 -- 172.21.2.105:0/3645395651 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc440acf70 con 0x7fbc440b01b0 2021-11-12T05:40:43.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.086+0000 7fbc42ffd700 1 --2- 172.21.2.105:0/3645395651 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbc440b01b0 0x7fbc440b13c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fbc2c002f70 tx=0x7fbc2c007f00).ready entity=mon.0 client_cookie=fdfa1f5a685c3650 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:43.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.086+0000 7fbc427fc700 1 -- 172.21.2.105:0/3645395651 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc2c007610 con 0x7fbc440b01b0 2021-11-12T05:40:43.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.086+0000 7fbc427fc700 1 -- 172.21.2.105:0/3645395651 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2c0056f0 con 0x7fbc440b01b0 2021-11-12T05:40:43.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.086+0000 7fbc427fc700 1 -- 172.21.2.105:0/3645395651 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc2c005a50 con 0x7fbc440b01b0 2021-11-12T05:40:43.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.086+0000 7fbc4a103700 1 -- 172.21.2.105:0/3645395651 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbc440b01b0 msgr2=0x7fbc440b13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:43.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.086+0000 7fbc4a103700 1 --2- 172.21.2.105:0/3645395651 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbc440b01b0 0x7fbc440b13c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fbc2c002f70 tx=0x7fbc2c007f00).stop 2021-11-12T05:40:43.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.086+0000 7fbc4a103700 1 -- 172.21.2.105:0/3645395651 shutdown_connections 2021-11-12T05:40:43.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.086+0000 7fbc4a103700 1 --2- 172.21.2.105:0/3645395651 >> v2:172.21.2.115:3300/0 conn(0x7fbc440aeb80 0x7fbc4413e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.086+0000 7fbc4a103700 1 --2- 172.21.2.105:0/3645395651 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbc440b01b0 0x7fbc440b13c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:43.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.086+0000 7fbc4a103700 1 -- 172.21.2.105:0/3645395651 >> 172.21.2.105:0/3645395651 conn(0x7fbc440628b0 msgr2=0x7fbc44062c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:43.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.086+0000 7fbc4a103700 1 -- 172.21.2.105:0/3645395651 shutdown_connections 2021-11-12T05:40:43.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.086+0000 7fbc4a103700 1 -- 172.21.2.105:0/3645395651 wait complete. 2021-11-12T05:40:43.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.086+0000 7fbc4a103700 1 Processor -- start 2021-11-12T05:40:43.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.086+0000 7fbc4a103700 1 -- start start 2021-11-12T05:40:43.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.086+0000 7fbc4a103700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbc440aeb80 0x7fbc44138490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.086+0000 7fbc4a103700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbc440b01b0 0x7fbc441359e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.086+0000 7fbc4a103700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbc440b5ac0 0x7fbc44131580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.086+0000 7fbc4a103700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc44067370 con 0x7fbc440b01b0 2021-11-12T05:40:43.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.086+0000 7fbc4a103700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc44067610 con 0x7fbc440aeb80 2021-11-12T05:40:43.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.086+0000 7fbc4a103700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc44137d50 con 0x7fbc440b5ac0 2021-11-12T05:40:43.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.086+0000 7fbc42ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbc440b01b0 0x7fbc441359e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:43.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.090+0000 7fbc42ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbc440b01b0 0x7fbc441359e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43090/0 (socket says 172.21.2.105:43090) 2021-11-12T05:40:43.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.090+0000 7fbc42ffd700 1 -- 172.21.2.105:0/2818664087 learned_addr learned my addr 172.21.2.105:0/2818664087 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:43.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.090+0000 7fbc42ffd700 1 -- 172.21.2.105:0/2818664087 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbc440b5ac0 msgr2=0x7fbc44131580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:43.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.090+0000 7fbc42ffd700 1 --2- 172.21.2.105:0/2818664087 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbc440b5ac0 0x7fbc44131580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.090+0000 7fbc42ffd700 1 -- 172.21.2.105:0/2818664087 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbc440aeb80 msgr2=0x7fbc44138490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:43.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.090+0000 7fbc42ffd700 1 --2- 172.21.2.105:0/2818664087 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbc440aeb80 0x7fbc44138490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.090+0000 7fbc42ffd700 1 -- 172.21.2.105:0/2818664087 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc2c00c200 con 0x7fbc440b01b0 2021-11-12T05:40:43.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.090+0000 7fbc42ffd700 1 --2- 172.21.2.105:0/2818664087 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbc440b01b0 0x7fbc441359e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fbc2c002f70 tx=0x7fbc2c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:43.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.090+0000 7fbc40ff9700 1 -- 172.21.2.105:0/2818664087 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc2c010bc0 con 0x7fbc440b01b0 2021-11-12T05:40:43.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.090+0000 7fbc40ff9700 1 -- 172.21.2.105:0/2818664087 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2c000e90 con 0x7fbc440b01b0 2021-11-12T05:40:43.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.090+0000 7fbc4a103700 1 -- 172.21.2.105:0/2818664087 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc44137ff0 con 0x7fbc440b01b0 2021-11-12T05:40:43.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.090+0000 7fbc4a103700 1 -- 172.21.2.105:0/2818664087 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc44066c10 con 0x7fbc440b01b0 2021-11-12T05:40:43.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.090+0000 7fbc40ff9700 1 -- 172.21.2.105:0/2818664087 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc2c01c420 con 0x7fbc440b01b0 2021-11-12T05:40:43.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.090+0000 7fbc4a103700 1 -- 172.21.2.105:0/2818664087 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc44138180 con 0x7fbc440b01b0 2021-11-12T05:40:43.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.090+0000 7fbc40ff9700 1 -- 172.21.2.105:0/2818664087 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbc2c01c580 con 0x7fbc440b01b0 2021-11-12T05:40:43.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.090+0000 7fbc40ff9700 1 --2- 172.21.2.105:0/2818664087 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbc280536f0 0x7fbc28055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.090+0000 7fbc40ff9700 1 -- 172.21.2.105:0/2818664087 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fbc2c06d930 con 0x7fbc440b01b0 2021-11-12T05:40:43.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.090+0000 7fbc437fe700 1 --2- 172.21.2.105:0/2818664087 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbc280536f0 0x7fbc28055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:43.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.090+0000 7fbc437fe700 1 --2- 172.21.2.105:0/2818664087 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbc280536f0 0x7fbc28055bb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fbc440b6470 tx=0x7fbc34005980).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:43.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.094+0000 7fbc40ff9700 1 -- 172.21.2.105:0/2818664087 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbc2c044870 con 0x7fbc440b01b0 2021-11-12T05:40:43.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.174+0000 7fbc4a103700 1 -- 172.21.2.105:0/2818664087 --> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbc440ad410 con 0x7fbc280536f0 2021-11-12T05:40:43.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.178+0000 7fbc40ff9700 1 -- 172.21.2.105:0/2818664087 <== mgr.4107 v2:172.21.2.105:6800/14730 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82344 (secure 0 0 0) 0x7fbc440ad410 con 0x7fbc280536f0 2021-11-12T05:40:43.181 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:40:43.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.178+0000 7fbc4a103700 1 -- 172.21.2.105:0/2818664087 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbc280536f0 msgr2=0x7fbc28055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:43.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.178+0000 7fbc4a103700 1 --2- 172.21.2.105:0/2818664087 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbc280536f0 0x7fbc28055bb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fbc440b6470 tx=0x7fbc34005980).stop 2021-11-12T05:40:43.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.178+0000 7fbc4a103700 1 -- 172.21.2.105:0/2818664087 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbc440b01b0 msgr2=0x7fbc441359e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:43.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.178+0000 7fbc4a103700 1 --2- 172.21.2.105:0/2818664087 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbc440b01b0 0x7fbc441359e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fbc2c002f70 tx=0x7fbc2c017000).stop 2021-11-12T05:40:43.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.178+0000 7fbc4a103700 1 -- 172.21.2.105:0/2818664087 shutdown_connections 2021-11-12T05:40:43.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.178+0000 7fbc4a103700 1 --2- 172.21.2.105:0/2818664087 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbc280536f0 0x7fbc28055bb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:43.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.178+0000 7fbc4a103700 1 --2- 172.21.2.105:0/2818664087 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbc440b5ac0 0x7fbc44131580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.178+0000 7fbc4a103700 1 --2- 172.21.2.105:0/2818664087 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbc440b01b0 0x7fbc441359e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:43.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.178+0000 7fbc4a103700 1 --2- 172.21.2.105:0/2818664087 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbc440aeb80 0x7fbc44138490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.178+0000 7fbc4a103700 1 -- 172.21.2.105:0/2818664087 >> 172.21.2.105:0/2818664087 conn(0x7fbc440628b0 msgr2=0x7fbc440adfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:43.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.178+0000 7fbc4a103700 1 -- 172.21.2.105:0/2818664087 shutdown_connections 2021-11-12T05:40:43.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.178+0000 7fbc4a103700 1 -- 172.21.2.105:0/2818664087 wait complete. 2021-11-12T05:40:43.185 INFO:teuthology.orchestra.run.gibba005.stderr:dumped all 2021-11-12T05:40:43.187 INFO:teuthology.orchestra.run.gibba005.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2021-11-12T05:40:42.012385+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":60,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390784,"kb_used_data":2112,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746583936,"statfs":{"total":773094113280,"available":764501950464,"internally_reserved":8589934592,"allocated":2162688,"data_stored":840760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001349"},"pg_stats":[{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.213994+0000","last_change":"2021-11-12T05:40:37.213436+0000","last_active":"2021-11-12T05:40:37.213994+0000","last_peered":"2021-11-12T05:40:37.213994+0000","last_clean":"2021-11-12T05:40:37.213994+0000","last_became_active":"2021-11-12T05:40:37.213046+0000","last_became_peered":"2021-11-12T05:40:37.213046+0000","last_unstale":"2021-11-12T05:40:37.213994+0000","last_undegraded":"2021-11-12T05:40:37.213994+0000","last_fullsized":"2021-11-12T05:40:37.213994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:35.998246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:35.998246+0000","last_clean_scrub_stamp":"2021-11-12T05:40:35.998246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.211737+0000","last_change":"2021-11-12T05:40:27.633039+0000","last_active":"2021-11-12T05:40:37.211737+0000","last_peered":"2021-11-12T05:40:37.211737+0000","last_clean":"2021-11-12T05:40:37.211737+0000","last_became_active":"2021-11-12T05:40:27.631630+0000","last_became_peered":"2021-11-12T05:40:27.631630+0000","last_unstale":"2021-11-12T05:40:37.211737+0000","last_undegraded":"2021-11-12T05:40:37.211737+0000","last_fullsized":"2021-11-12T05:40:37.211737+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:23.018147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:23.018147+0000","last_clean_scrub_stamp":"2021-11-12T05:40:23.018147+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.210716+0000","last_change":"2021-11-12T05:40:31.959167+0000","last_active":"2021-11-12T05:40:37.210716+0000","last_peered":"2021-11-12T05:40:37.210716+0000","last_clean":"2021-11-12T05:40:37.210716+0000","last_became_active":"2021-11-12T05:40:31.958938+0000","last_became_peered":"2021-11-12T05:40:31.958938+0000","last_unstale":"2021-11-12T05:40:37.210716+0000","last_undegraded":"2021-11-12T05:40:37.210716+0000","last_fullsized":"2021-11-12T05:40:37.210716+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_clean_scrub_stamp":"2021-11-12T05:40:30.930115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"24'1","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.207676+0000","last_change":"2021-11-12T05:40:33.985425+0000","last_active":"2021-11-12T05:40:37.207676+0000","last_peered":"2021-11-12T05:40:37.207676+0000","last_clean":"2021-11-12T05:40:37.207676+0000","last_became_active":"2021-11-12T05:40:33.985205+0000","last_became_peered":"2021-11-12T05:40:33.985205+0000","last_unstale":"2021-11-12T05:40:37.207676+0000","last_undegraded":"2021-11-12T05:40:37.207676+0000","last_fullsized":"2021-11-12T05:40:37.207676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:32.958222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:32.958222+0000","last_clean_scrub_stamp":"2021-11-12T05:40:32.958222+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.214142+0000","last_change":"2021-11-12T05:40:37.213212+0000","last_active":"2021-11-12T05:40:37.214142+0000","last_peered":"2021-11-12T05:40:37.214142+0000","last_clean":"2021-11-12T05:40:37.214142+0000","last_became_active":"2021-11-12T05:40:37.212918+0000","last_became_peered":"2021-11-12T05:40:37.212918+0000","last_unstale":"2021-11-12T05:40:37.214142+0000","last_undegraded":"2021-11-12T05:40:37.214142+0000","last_fullsized":"2021-11-12T05:40:37.214142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:35.998246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:35.998246+0000","last_clean_scrub_stamp":"2021-11-12T05:40:35.998246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.211712+0000","last_change":"2021-11-12T05:40:31.957870+0000","last_active":"2021-11-12T05:40:37.211712+0000","last_peered":"2021-11-12T05:40:37.211712+0000","last_clean":"2021-11-12T05:40:37.211712+0000","last_became_active":"2021-11-12T05:40:31.957678+0000","last_became_peered":"2021-11-12T05:40:31.957678+0000","last_unstale":"2021-11-12T05:40:37.211712+0000","last_undegraded":"2021-11-12T05:40:37.211712+0000","last_fullsized":"2021-11-12T05:40:37.211712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_clean_scrub_stamp":"2021-11-12T05:40:30.930115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.205827+0000","last_change":"2021-11-12T05:40:33.985234+0000","last_active":"2021-11-12T05:40:37.205827+0000","last_peered":"2021-11-12T05:40:37.205827+0000","last_clean":"2021-11-12T05:40:37.205827+0000","last_became_active":"2021-11-12T05:40:33.985011+0000","last_became_peered":"2021-11-12T05:40:33.985011+0000","last_unstale":"2021-11-12T05:40:37.205827+0000","last_undegraded":"2021-11-12T05:40:37.205827+0000","last_fullsized":"2021-11-12T05:40:37.205827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:32.958222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:32.958222+0000","last_clean_scrub_stamp":"2021-11-12T05:40:32.958222+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.205959+0000","last_change":"2021-11-12T05:40:37.019986+0000","last_active":"2021-11-12T05:40:37.205959+0000","last_peered":"2021-11-12T05:40:37.205959+0000","last_clean":"2021-11-12T05:40:37.205959+0000","last_became_active":"2021-11-12T05:40:37.019734+0000","last_became_peered":"2021-11-12T05:40:37.019734+0000","last_unstale":"2021-11-12T05:40:37.205959+0000","last_undegraded":"2021-11-12T05:40:37.205959+0000","last_fullsized":"2021-11-12T05:40:37.205959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:35.998246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:35.998246+0000","last_clean_scrub_stamp":"2021-11-12T05:40:35.998246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.207281+0000","last_change":"2021-11-12T05:40:31.957439+0000","last_active":"2021-11-12T05:40:37.207281+0000","last_peered":"2021-11-12T05:40:37.207281+0000","last_clean":"2021-11-12T05:40:37.207281+0000","last_became_active":"2021-11-12T05:40:31.957234+0000","last_became_peered":"2021-11-12T05:40:31.957234+0000","last_unstale":"2021-11-12T05:40:37.207281+0000","last_undegraded":"2021-11-12T05:40:37.207281+0000","last_fullsized":"2021-11-12T05:40:37.207281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_clean_scrub_stamp":"2021-11-12T05:40:30.930115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"24'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.209419+0000","last_change":"2021-11-12T05:40:34.010660+0000","last_active":"2021-11-12T05:40:37.209419+0000","last_peered":"2021-11-12T05:40:37.209419+0000","last_clean":"2021-11-12T05:40:37.209419+0000","last_became_active":"2021-11-12T05:40:34.010481+0000","last_became_peered":"2021-11-12T05:40:34.010481+0000","last_unstale":"2021-11-12T05:40:37.209419+0000","last_undegraded":"2021-11-12T05:40:37.209419+0000","last_fullsized":"2021-11-12T05:40:37.209419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:32.958222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:32.958222+0000","last_clean_scrub_stamp":"2021-11-12T05:40:32.958222+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.205923+0000","last_change":"2021-11-12T05:40:37.020271+0000","last_active":"2021-11-12T05:40:37.205923+0000","last_peered":"2021-11-12T05:40:37.205923+0000","last_clean":"2021-11-12T05:40:37.205923+0000","last_became_active":"2021-11-12T05:40:37.019951+0000","last_became_peered":"2021-11-12T05:40:37.019951+0000","last_unstale":"2021-11-12T05:40:37.205923+0000","last_undegraded":"2021-11-12T05:40:37.205923+0000","last_fullsized":"2021-11-12T05:40:37.205923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:35.998246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:35.998246+0000","last_clean_scrub_stamp":"2021-11-12T05:40:35.998246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.210786+0000","last_change":"2021-11-12T05:40:31.959024+0000","last_active":"2021-11-12T05:40:37.210786+0000","last_peered":"2021-11-12T05:40:37.210786+0000","last_clean":"2021-11-12T05:40:37.210786+0000","last_became_active":"2021-11-12T05:40:31.958760+0000","last_became_peered":"2021-11-12T05:40:31.958760+0000","last_unstale":"2021-11-12T05:40:37.210786+0000","last_undegraded":"2021-11-12T05:40:37.210786+0000","last_fullsized":"2021-11-12T05:40:37.210786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_clean_scrub_stamp":"2021-11-12T05:40:30.930115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"24'5","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.214572+0000","last_change":"2021-11-12T05:40:33.985476+0000","last_active":"2021-11-12T05:40:37.214572+0000","last_peered":"2021-11-12T05:40:37.214572+0000","last_clean":"2021-11-12T05:40:37.214572+0000","last_became_active":"2021-11-12T05:40:33.985259+0000","last_became_peered":"2021-11-12T05:40:33.985259+0000","last_unstale":"2021-11-12T05:40:37.214572+0000","last_undegraded":"2021-11-12T05:40:37.214572+0000","last_fullsized":"2021-11-12T05:40:37.214572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:32.958222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:32.958222+0000","last_clean_scrub_stamp":"2021-11-12T05:40:32.958222+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.205798+0000","last_change":"2021-11-12T05:40:37.020142+0000","last_active":"2021-11-12T05:40:37.205798+0000","last_peered":"2021-11-12T05:40:37.205798+0000","last_clean":"2021-11-12T05:40:37.205798+0000","last_became_active":"2021-11-12T05:40:37.019769+0000","last_became_peered":"2021-11-12T05:40:37.019769+0000","last_unstale":"2021-11-12T05:40:37.205798+0000","last_undegraded":"2021-11-12T05:40:37.205798+0000","last_fullsized":"2021-11-12T05:40:37.205798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:35.998246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:35.998246+0000","last_clean_scrub_stamp":"2021-11-12T05:40:35.998246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"24'6","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.213859+0000","last_change":"2021-11-12T05:40:33.985216+0000","last_active":"2021-11-12T05:40:37.213859+0000","last_peered":"2021-11-12T05:40:37.213859+0000","last_clean":"2021-11-12T05:40:37.213859+0000","last_became_active":"2021-11-12T05:40:33.985048+0000","last_became_peered":"2021-11-12T05:40:33.985048+0000","last_unstale":"2021-11-12T05:40:37.213859+0000","last_undegraded":"2021-11-12T05:40:37.213859+0000","last_fullsized":"2021-11-12T05:40:37.213859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:32.958222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:32.958222+0000","last_clean_scrub_stamp":"2021-11-12T05:40:32.958222+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.205991+0000","last_change":"2021-11-12T05:40:31.966265+0000","last_active":"2021-11-12T05:40:37.205991+0000","last_peered":"2021-11-12T05:40:37.205991+0000","last_clean":"2021-11-12T05:40:37.205991+0000","last_became_active":"2021-11-12T05:40:31.966094+0000","last_became_peered":"2021-11-12T05:40:31.966094+0000","last_unstale":"2021-11-12T05:40:37.205991+0000","last_undegraded":"2021-11-12T05:40:37.205991+0000","last_fullsized":"2021-11-12T05:40:37.205991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_clean_scrub_stamp":"2021-11-12T05:40:30.930115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.214151+0000","last_change":"2021-11-12T05:40:37.213250+0000","last_active":"2021-11-12T05:40:37.214151+0000","last_peered":"2021-11-12T05:40:37.214151+0000","last_clean":"2021-11-12T05:40:37.214151+0000","last_became_active":"2021-11-12T05:40:37.212938+0000","last_became_peered":"2021-11-12T05:40:37.212938+0000","last_unstale":"2021-11-12T05:40:37.214151+0000","last_undegraded":"2021-11-12T05:40:37.214151+0000","last_fullsized":"2021-11-12T05:40:37.214151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:35.998246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:35.998246+0000","last_clean_scrub_stamp":"2021-11-12T05:40:35.998246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"24'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.215303+0000","last_change":"2021-11-12T05:40:34.010701+0000","last_active":"2021-11-12T05:40:37.215303+0000","last_peered":"2021-11-12T05:40:37.215303+0000","last_clean":"2021-11-12T05:40:37.215303+0000","last_became_active":"2021-11-12T05:40:34.010535+0000","last_became_peered":"2021-11-12T05:40:34.010535+0000","last_unstale":"2021-11-12T05:40:37.215303+0000","last_undegraded":"2021-11-12T05:40:37.215303+0000","last_fullsized":"2021-11-12T05:40:37.215303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:32.958222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:32.958222+0000","last_clean_scrub_stamp":"2021-11-12T05:40:32.958222+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.211800+0000","last_change":"2021-11-12T05:40:31.966703+0000","last_active":"2021-11-12T05:40:37.211800+0000","last_peered":"2021-11-12T05:40:37.211800+0000","last_clean":"2021-11-12T05:40:37.211800+0000","last_became_active":"2021-11-12T05:40:31.966492+0000","last_became_peered":"2021-11-12T05:40:31.966492+0000","last_unstale":"2021-11-12T05:40:37.211800+0000","last_undegraded":"2021-11-12T05:40:37.211800+0000","last_fullsized":"2021-11-12T05:40:37.211800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_clean_scrub_stamp":"2021-11-12T05:40:30.930115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.213894+0000","last_change":"2021-11-12T05:40:37.213315+0000","last_active":"2021-11-12T05:40:37.213894+0000","last_peered":"2021-11-12T05:40:37.213894+0000","last_clean":"2021-11-12T05:40:37.213894+0000","last_became_active":"2021-11-12T05:40:37.212930+0000","last_became_peered":"2021-11-12T05:40:37.212930+0000","last_unstale":"2021-11-12T05:40:37.213894+0000","last_undegraded":"2021-11-12T05:40:37.213894+0000","last_fullsized":"2021-11-12T05:40:37.213894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:35.998246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:35.998246+0000","last_clean_scrub_stamp":"2021-11-12T05:40:35.998246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"24'7","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.211579+0000","last_change":"2021-11-12T05:40:34.010450+0000","last_active":"2021-11-12T05:40:37.211579+0000","last_peered":"2021-11-12T05:40:37.211579+0000","last_clean":"2021-11-12T05:40:37.211579+0000","last_became_active":"2021-11-12T05:40:34.010161+0000","last_became_peered":"2021-11-12T05:40:34.010161+0000","last_unstale":"2021-11-12T05:40:37.211579+0000","last_undegraded":"2021-11-12T05:40:37.211579+0000","last_fullsized":"2021-11-12T05:40:37.211579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:32.958222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:32.958222+0000","last_clean_scrub_stamp":"2021-11-12T05:40:32.958222+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.206046+0000","last_change":"2021-11-12T05:40:31.958555+0000","last_active":"2021-11-12T05:40:37.206046+0000","last_peered":"2021-11-12T05:40:37.206046+0000","last_clean":"2021-11-12T05:40:37.206046+0000","last_became_active":"2021-11-12T05:40:31.958357+0000","last_became_peered":"2021-11-12T05:40:31.958357+0000","last_unstale":"2021-11-12T05:40:37.206046+0000","last_undegraded":"2021-11-12T05:40:37.206046+0000","last_fullsized":"2021-11-12T05:40:37.206046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_clean_scrub_stamp":"2021-11-12T05:40:30.930115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.214157+0000","last_change":"2021-11-12T05:40:37.213459+0000","last_active":"2021-11-12T05:40:37.214157+0000","last_peered":"2021-11-12T05:40:37.214157+0000","last_clean":"2021-11-12T05:40:37.214157+0000","last_became_active":"2021-11-12T05:40:37.213021+0000","last_became_peered":"2021-11-12T05:40:37.213021+0000","last_unstale":"2021-11-12T05:40:37.214157+0000","last_undegraded":"2021-11-12T05:40:37.214157+0000","last_fullsized":"2021-11-12T05:40:37.214157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:35.998246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:35.998246+0000","last_clean_scrub_stamp":"2021-11-12T05:40:35.998246+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"24'3","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.207988+0000","last_change":"2021-11-12T05:40:33.984973+0000","last_active":"2021-11-12T05:40:37.207988+0000","last_peered":"2021-11-12T05:40:37.207988+0000","last_clean":"2021-11-12T05:40:37.207988+0000","last_became_active":"2021-11-12T05:40:33.984747+0000","last_became_peered":"2021-11-12T05:40:33.984747+0000","last_unstale":"2021-11-12T05:40:37.207988+0000","last_undegraded":"2021-11-12T05:40:37.207988+0000","last_fullsized":"2021-11-12T05:40:37.207988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:32.958222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:32.958222+0000","last_clean_scrub_stamp":"2021-11-12T05:40:32.958222+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2021-11-12T05:40:37.210568+0000","last_change":"2021-11-12T05:40:31.959219+0000","last_active":"2021-11-12T05:40:37.210568+0000","last_peered":"2021-11-12T05:40:37.210568+0000","last_clean":"2021-11-12T05:40:37.210568+0000","last_became_active":"2021-11-12T05:40:31.958961+0000","last_became_peered":"2021-11-12T05:40:31.958961+0000","last_unstale":"2021-11-12T05:40:37.210568+0000","last_undegraded":"2021-11-12T05:40:37.210568+0000","last_fullsized":"2021-11-12T05:40:37.210568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_clean_scrub_stamp":"2021-11-12T05:40:30.930115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048848,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322992,"statfs":{"total":96636764160,"available":95562743808,"internally_reserved":1073741824,"allocated":270336,"data_stored":105094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.427}]}]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":104519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048848,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322992,"statfs":{"total":96636764160,"available":95562743808,"internally_reserved":1073741824,"allocated":270336,"data_stored":104679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.528}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6020000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2210000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6870000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":104553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4350000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048856,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322984,"statfs":{"total":96636764160,"available":95562735616,"internally_reserved":1073741824,"allocated":278528,"data_stored":105254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4079999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":106054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":106054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]}]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":104553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5289999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4510000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5700000000000001}]}]}]}} 2021-11-12T05:40:43.189 INFO:tasks.ceph.ceph_manager.ceph:clean! 2021-11-12T05:40:43.190 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2021-11-12T05:40:43.190 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2021-11-12T05:40:43.191 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-11-12T05:40:43.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.238+0000 7f1ded520700 1 Processor -- start 2021-11-12T05:40:43.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.238+0000 7f1ded520700 1 -- start start 2021-11-12T05:40:43.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.238+0000 7f1ded520700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1de80aca40 0x7f1de80ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.238+0000 7f1ded520700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de80b1840 con 0x7f1de8144180 2021-11-12T05:40:43.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.238+0000 7f1ded520700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de80af2b0 con 0x7f1de80b0520 2021-11-12T05:40:43.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.238+0000 7f1ded520700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de80b09a0 con 0x7f1de80aca40 2021-11-12T05:40:43.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.238+0000 7f1de77fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f1de8144180 0x7f1de8144610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:53492/0 (socket says 172.21.2.105:53492) 2021-11-12T05:40:43.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.238+0000 7f1de77fe700 1 -- 172.21.2.105:0/1003248036 learned_addr learned my addr 172.21.2.105:0/1003248036 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:43.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.238+0000 7f1de5ffb700 1 -- 172.21.2.105:0/1003248036 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 850480024 0 0) 0x7f1de80b1840 con 0x7f1de8144180 2021-11-12T05:40:43.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.238+0000 7f1de5ffb700 1 -- 172.21.2.105:0/1003248036 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dc8003260 con 0x7f1de8144180 2021-11-12T05:40:43.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.238+0000 7f1de5ffb700 1 -- 172.21.2.105:0/1003248036 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2011530936 0 0) 0x7f1dc8003260 con 0x7f1de8144180 2021-11-12T05:40:43.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.238+0000 7f1de5ffb700 1 -- 172.21.2.105:0/1003248036 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1de80aca40 msgr2=0x7f1de80ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:43.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.238+0000 7f1de5ffb700 1 --2- 172.21.2.105:0/1003248036 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1de80aca40 0x7f1de80ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.238+0000 7f1de5ffb700 1 -- 172.21.2.105:0/1003248036 >> v1:172.21.2.115:6789/0 conn(0x7f1de80b0520 legacy=0x7f1de81473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:43.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.238+0000 7f1de5ffb700 1 -- 172.21.2.105:0/1003248036 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de80b1a70 con 0x7f1de8144180 2021-11-12T05:40:43.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.238+0000 7f1de5ffb700 1 -- 172.21.2.105:0/1003248036 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f1de00019e0 con 0x7f1de8144180 2021-11-12T05:40:43.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.238+0000 7f1de5ffb700 1 -- 172.21.2.105:0/1003248036 >> v1:172.21.2.105:6789/0 conn(0x7f1de8144180 legacy=0x7f1de8144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:43.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.238+0000 7f1de5ffb700 1 --2- 172.21.2.105:0/1003248036 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1dc8003800 0x7f1dc8003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.238+0000 7f1de5ffb700 1 --2- 172.21.2.105:0/1003248036 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1dc8004500 0x7f1dc8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.238+0000 7f1de5ffb700 1 --2- 172.21.2.105:0/1003248036 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1dc8005070 0x7f1dc800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.238+0000 7f1de5ffb700 1 -- 172.21.2.105:0/1003248036 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de80b09a0 con 0x7f1dc8005070 2021-11-12T05:40:43.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.238+0000 7f1de5ffb700 1 -- 172.21.2.105:0/1003248036 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc800bed0 con 0x7f1dc8004500 2021-11-12T05:40:43.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.238+0000 7f1de5ffb700 1 -- 172.21.2.105:0/1003248036 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc800c090 con 0x7f1dc8003800 2021-11-12T05:40:43.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.238+0000 7f1de77fe700 1 --2- 172.21.2.105:0/1003248036 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1dc8005070 0x7f1dc800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:43.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.238+0000 7f1de77fe700 1 -- 172.21.2.105:0/1003248036 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1dc8003800 msgr2=0x7f1dc8003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:43.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.238+0000 7f1de77fe700 1 --2- 172.21.2.105:0/1003248036 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1dc8003800 0x7f1dc8003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.238+0000 7f1de77fe700 1 -- 172.21.2.105:0/1003248036 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1dc8004500 msgr2=0x7f1dc8004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:43.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.238+0000 7f1de77fe700 1 --2- 172.21.2.105:0/1003248036 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1dc8004500 0x7f1dc8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.238+0000 7f1de77fe700 1 -- 172.21.2.105:0/1003248036 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc8003260 con 0x7f1dc8005070 2021-11-12T05:40:43.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.238+0000 7f1de77fe700 1 --2- 172.21.2.105:0/1003248036 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1dc8005070 0x7f1dc800b750 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f1de80af5f0 tx=0x7f1de00020e0).ready entity=mon.0 client_cookie=d24279a64b7ac5cb server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:43.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.238+0000 7f1de5ffb700 1 -- 172.21.2.105:0/1003248036 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1de000cc60 con 0x7f1dc8005070 2021-11-12T05:40:43.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.238+0000 7f1de5ffb700 1 -- 172.21.2.105:0/1003248036 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de000cdc0 con 0x7f1dc8005070 2021-11-12T05:40:43.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.238+0000 7f1de5ffb700 1 -- 172.21.2.105:0/1003248036 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1de0005b80 con 0x7f1dc8005070 2021-11-12T05:40:43.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.242+0000 7f1ded520700 1 -- 172.21.2.105:0/1003248036 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1dc8005070 msgr2=0x7f1dc800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:43.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.242+0000 7f1ded520700 1 --2- 172.21.2.105:0/1003248036 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1dc8005070 0x7f1dc800b750 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f1de80af5f0 tx=0x7f1de00020e0).stop 2021-11-12T05:40:43.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.242+0000 7f1de77fe700 1 -- 172.21.2.105:0/1003248036 reap_dead start 2021-11-12T05:40:43.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.242+0000 7f1ded520700 1 -- 172.21.2.105:0/1003248036 shutdown_connections 2021-11-12T05:40:43.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.242+0000 7f1ded520700 1 -- 172.21.2.105:0/1003248036 >> 172.21.2.105:0/1003248036 conn(0x7f1de805c490 msgr2=0x7f1de80b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:43.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.242+0000 7f1ded520700 1 -- 172.21.2.105:0/1003248036 shutdown_connections 2021-11-12T05:40:43.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.242+0000 7f1ded520700 1 -- 172.21.2.105:0/1003248036 wait complete. 2021-11-12T05:40:43.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.242+0000 7f1ded520700 1 Processor -- start 2021-11-12T05:40:43.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.242+0000 7f1ded520700 1 -- start start 2021-11-12T05:40:43.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.242+0000 7f1ded520700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1dc8005070 0x7f1de81564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.242+0000 7f1ded520700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1de8064c40 0x7f1de8065820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.242+0000 7f1ded520700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1de8065d10 0x7f1de8066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.242+0000 7f1ded520700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de8157490 con 0x7f1de8065d10 2021-11-12T05:40:43.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.242+0000 7f1ded520700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de8066680 con 0x7f1de8064c40 2021-11-12T05:40:43.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.242+0000 7f1ded520700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de80640a0 con 0x7f1dc8005070 2021-11-12T05:40:43.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.242+0000 7f1de77fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1de8065d10 0x7f1de8066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:43.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.242+0000 7f1de77fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1de8065d10 0x7f1de8066190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43110/0 (socket says 172.21.2.105:43110) 2021-11-12T05:40:43.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.242+0000 7f1de77fe700 1 -- 172.21.2.105:0/4088320214 learned_addr learned my addr 172.21.2.105:0/4088320214 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:43.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.242+0000 7f1de77fe700 1 -- 172.21.2.105:0/4088320214 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1dc8005070 msgr2=0x7f1de81564c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:43.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.242+0000 7f1de77fe700 1 --2- 172.21.2.105:0/4088320214 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1dc8005070 0x7f1de81564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.242+0000 7f1de77fe700 1 -- 172.21.2.105:0/4088320214 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1de8064c40 msgr2=0x7f1de8065820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:43.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.242+0000 7f1de77fe700 1 --2- 172.21.2.105:0/4088320214 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1de8064c40 0x7f1de8065820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.242+0000 7f1de77fe700 1 -- 172.21.2.105:0/4088320214 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de8156ab0 con 0x7f1de8065d10 2021-11-12T05:40:43.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.242+0000 7f1de77fe700 1 --2- 172.21.2.105:0/4088320214 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1de8065d10 0x7f1de8066190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f1de80ae520 tx=0x7f1de0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:43.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.242+0000 7f1ddffff700 1 -- 172.21.2.105:0/4088320214 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1de00074d0 con 0x7f1de8065d10 2021-11-12T05:40:43.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.242+0000 7f1ddffff700 1 -- 172.21.2.105:0/4088320214 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de0007630 con 0x7f1de8065d10 2021-11-12T05:40:43.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.242+0000 7f1ded520700 1 -- 172.21.2.105:0/4088320214 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de8156d50 con 0x7f1de8065d10 2021-11-12T05:40:43.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.242+0000 7f1ded520700 1 -- 172.21.2.105:0/4088320214 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de80650c0 con 0x7f1de8065d10 2021-11-12T05:40:43.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.242+0000 7f1ddffff700 1 -- 172.21.2.105:0/4088320214 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1de00020e0 con 0x7f1de8065d10 2021-11-12T05:40:43.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.242+0000 7f1ded520700 1 -- 172.21.2.105:0/4088320214 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de8057350 con 0x7f1de8065d10 2021-11-12T05:40:43.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.242+0000 7f1ddffff700 1 -- 172.21.2.105:0/4088320214 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1de001d070 con 0x7f1de8065d10 2021-11-12T05:40:43.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.246+0000 7f1ddffff700 1 --2- 172.21.2.105:0/4088320214 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1dcc0536d0 0x7f1dcc055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.246+0000 7f1ddffff700 1 -- 172.21.2.105:0/4088320214 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f1de006c5f0 con 0x7f1de8065d10 2021-11-12T05:40:43.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.246+0000 7f1de6ffd700 1 --2- 172.21.2.105:0/4088320214 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1dcc0536d0 0x7f1dcc055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:43.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.246+0000 7f1de6ffd700 1 --2- 172.21.2.105:0/4088320214 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1dcc0536d0 0x7f1dcc055b90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f1dd8002f70 tx=0x7f1dd8006a00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:43.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.246+0000 7f1ddffff700 1 -- 172.21.2.105:0/4088320214 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1de00435f0 con 0x7f1de8065d10 2021-11-12T05:40:43.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.358+0000 7f1ded520700 1 -- 172.21.2.105:0/4088320214 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1de805f280 con 0x7f1de8065d10 2021-11-12T05:40:43.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.358+0000 7f1ddffff700 1 -- 172.21.2.105:0/4088320214 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f1de001a020 con 0x7f1de8065d10 2021-11-12T05:40:43.363 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:40:43.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.362+0000 7f1ded520700 1 -- 172.21.2.105:0/4088320214 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1dcc0536d0 msgr2=0x7f1dcc055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:43.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.362+0000 7f1ded520700 1 --2- 172.21.2.105:0/4088320214 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1dcc0536d0 0x7f1dcc055b90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f1dd8002f70 tx=0x7f1dd8006a00).stop 2021-11-12T05:40:43.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.362+0000 7f1ded520700 1 -- 172.21.2.105:0/4088320214 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1de8065d10 msgr2=0x7f1de8066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:43.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.362+0000 7f1ded520700 1 --2- 172.21.2.105:0/4088320214 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1de8065d10 0x7f1de8066190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f1de80ae520 tx=0x7f1de0015000).stop 2021-11-12T05:40:43.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.362+0000 7f1ded520700 1 -- 172.21.2.105:0/4088320214 shutdown_connections 2021-11-12T05:40:43.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.362+0000 7f1ded520700 1 --2- 172.21.2.105:0/4088320214 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1dcc0536d0 0x7f1dcc055b90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:43.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.362+0000 7f1ded520700 1 --2- 172.21.2.105:0/4088320214 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1de8065d10 0x7f1de8066190 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:43.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.362+0000 7f1ded520700 1 --2- 172.21.2.105:0/4088320214 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1de8064c40 0x7f1de8065820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.362+0000 7f1ded520700 1 --2- 172.21.2.105:0/4088320214 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1dc8005070 0x7f1de81564c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.362+0000 7f1ded520700 1 -- 172.21.2.105:0/4088320214 >> 172.21.2.105:0/4088320214 conn(0x7f1de805c490 msgr2=0x7f1de8141660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:43.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.362+0000 7f1ded520700 1 -- 172.21.2.105:0/4088320214 shutdown_connections 2021-11-12T05:40:43.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.362+0000 7f1ded520700 1 -- 172.21.2.105:0/4088320214 wait complete. 2021-11-12T05:40:43.369 INFO:teuthology.orchestra.run.gibba005.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-11-12T05:40:43.370 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2021-11-12T05:40:43.370 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:40:43.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.418+0000 7f7466e2b700 1 Processor -- start 2021-11-12T05:40:43.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.418+0000 7f7466e2b700 1 -- start start 2021-11-12T05:40:43.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.418+0000 7f7466e2b700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f74600adaf0 0x7f746013fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.418+0000 7f7466e2b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7460143b40 0x7f7460143f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.418+0000 7f7466e2b700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7460067860 con 0x7f74600aded0 2021-11-12T05:40:43.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.418+0000 7f7466e2b700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7460143400 con 0x7f74600adaf0 2021-11-12T05:40:43.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.418+0000 7f7466e2b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74601436a0 con 0x7f7460143b40 2021-11-12T05:40:43.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.418+0000 7f74653c8700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f74600aded0 0x7f74600afe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:53514/0 (socket says 172.21.2.105:53514) 2021-11-12T05:40:43.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.418+0000 7f74653c8700 1 -- 172.21.2.105:0/1767149474 learned_addr learned my addr 172.21.2.105:0/1767149474 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:43.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.418+0000 7f745f7fe700 1 -- 172.21.2.105:0/1767149474 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4065154556 0 0) 0x7f7460067860 con 0x7f74600aded0 2021-11-12T05:40:43.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.418+0000 7f745f7fe700 1 -- 172.21.2.105:0/1767149474 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f744c003260 con 0x7f74600aded0 2021-11-12T05:40:43.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.418+0000 7f745f7fe700 1 -- 172.21.2.105:0/1767149474 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 834169288 0 0) 0x7f744c003260 con 0x7f74600aded0 2021-11-12T05:40:43.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.418+0000 7f745f7fe700 1 -- 172.21.2.105:0/1767149474 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7460143b40 msgr2=0x7f7460143f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:43.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.418+0000 7f745f7fe700 1 --2- 172.21.2.105:0/1767149474 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7460143b40 0x7f7460143f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.418+0000 7f745f7fe700 1 -- 172.21.2.105:0/1767149474 >> v2:172.21.2.115:3300/0 conn(0x7f74600adaf0 msgr2=0x7f746013fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:43.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.418+0000 7f745f7fe700 1 --2- 172.21.2.105:0/1767149474 >> v2:172.21.2.115:3300/0 conn(0x7f74600adaf0 0x7f746013fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.418+0000 7f745f7fe700 1 -- 172.21.2.105:0/1767149474 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74600b2b40 con 0x7f74600aded0 2021-11-12T05:40:43.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.418+0000 7f745f7fe700 1 -- 172.21.2.105:0/1767149474 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f74580019e0 con 0x7f74600aded0 2021-11-12T05:40:43.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.418+0000 7f745f7fe700 1 -- 172.21.2.105:0/1767149474 >> v1:172.21.2.105:6789/0 conn(0x7f74600aded0 legacy=0x7f74600afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:43.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.418+0000 7f745f7fe700 1 --2- 172.21.2.105:0/1767149474 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f744c003750 0x7f744c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.418+0000 7f745f7fe700 1 --2- 172.21.2.105:0/1767149474 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f744c004500 0x7f744c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.418+0000 7f745f7fe700 1 --2- 172.21.2.105:0/1767149474 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f744c004f90 0x7f744c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.418+0000 7f745f7fe700 1 -- 172.21.2.105:0/1767149474 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7460143400 con 0x7f744c004f90 2021-11-12T05:40:43.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.418+0000 7f745f7fe700 1 -- 172.21.2.105:0/1767149474 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74601436a0 con 0x7f744c004500 2021-11-12T05:40:43.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.418+0000 7f745f7fe700 1 -- 172.21.2.105:0/1767149474 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f744c00be50 con 0x7f744c003750 2021-11-12T05:40:43.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.418+0000 7f74653c8700 1 --2- 172.21.2.105:0/1767149474 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f744c004f90 0x7f744c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:43.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f74653c8700 1 -- 172.21.2.105:0/1767149474 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f744c003750 msgr2=0x7f744c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:43.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f74653c8700 1 --2- 172.21.2.105:0/1767149474 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f744c003750 0x7f744c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f74653c8700 1 -- 172.21.2.105:0/1767149474 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f744c004500 msgr2=0x7f744c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:43.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f74653c8700 1 --2- 172.21.2.105:0/1767149474 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f744c004500 0x7f744c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f74653c8700 1 -- 172.21.2.105:0/1767149474 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744c003260 con 0x7f744c004f90 2021-11-12T05:40:43.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f74653c8700 1 --2- 172.21.2.105:0/1767149474 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f744c004f90 0x7f744c00b750 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f74580016f0 tx=0x7f74580021d0).ready entity=mon.0 client_cookie=f553a4ac3775ad25 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:43.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f745f7fe700 1 -- 172.21.2.105:0/1767149474 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f745800cc80 con 0x7f744c004f90 2021-11-12T05:40:43.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f745f7fe700 1 -- 172.21.2.105:0/1767149474 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745800cde0 con 0x7f744c004f90 2021-11-12T05:40:43.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f745f7fe700 1 -- 172.21.2.105:0/1767149474 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7458005b80 con 0x7f744c004f90 2021-11-12T05:40:43.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f7466e2b700 1 -- 172.21.2.105:0/1767149474 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f744c004f90 msgr2=0x7f744c00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:43.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f7466e2b700 1 --2- 172.21.2.105:0/1767149474 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f744c004f90 0x7f744c00b750 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f74580016f0 tx=0x7f74580021d0).stop 2021-11-12T05:40:43.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f74653c8700 1 -- 172.21.2.105:0/1767149474 reap_dead start 2021-11-12T05:40:43.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f7466e2b700 1 -- 172.21.2.105:0/1767149474 shutdown_connections 2021-11-12T05:40:43.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f7466e2b700 1 -- 172.21.2.105:0/1767149474 >> 172.21.2.105:0/1767149474 conn(0x7f746005c490 msgr2=0x7f746005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:43.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f7466e2b700 1 -- 172.21.2.105:0/1767149474 shutdown_connections 2021-11-12T05:40:43.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f7466e2b700 1 -- 172.21.2.105:0/1767149474 wait complete. 2021-11-12T05:40:43.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f7466e2b700 1 Processor -- start 2021-11-12T05:40:43.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f7466e2b700 1 -- start start 2021-11-12T05:40:43.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f7466e2b700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f744c004f90 0x7f7460157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f7466e2b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f746013cd30 0x7f7460063950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f7466e2b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f74600b4900 0x7f74600b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f7466e2b700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7460157d10 con 0x7f746013cd30 2021-11-12T05:40:43.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f7466e2b700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74600b4450 con 0x7f744c004f90 2021-11-12T05:40:43.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f7466e2b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7460064130 con 0x7f74600b4900 2021-11-12T05:40:43.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f745ffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f746013cd30 0x7f7460063950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:43.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f745ffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f746013cd30 0x7f7460063950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43128/0 (socket says 172.21.2.105:43128) 2021-11-12T05:40:43.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f745ffff700 1 -- 172.21.2.105:0/337891199 learned_addr learned my addr 172.21.2.105:0/337891199 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:43.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f745ffff700 1 -- 172.21.2.105:0/337891199 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f74600b4900 msgr2=0x7f74600b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:43.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f745ffff700 1 --2- 172.21.2.105:0/337891199 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f74600b4900 0x7f74600b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f745ffff700 1 -- 172.21.2.105:0/337891199 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f744c004f90 msgr2=0x7f7460157820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:43.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f745ffff700 1 --2- 172.21.2.105:0/337891199 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f744c004f90 0x7f7460157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f745ffff700 1 -- 172.21.2.105:0/337891199 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7460063e40 con 0x7f746013cd30 2021-11-12T05:40:43.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f745ffff700 1 --2- 172.21.2.105:0/337891199 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f746013cd30 0x7f7460063950 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f7450000b60 tx=0x7f7450006e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:43.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f745dffb700 1 -- 172.21.2.105:0/337891199 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7450009e40 con 0x7f746013cd30 2021-11-12T05:40:43.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f745dffb700 1 -- 172.21.2.105:0/337891199 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7450013460 con 0x7f746013cd30 2021-11-12T05:40:43.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f7466e2b700 1 -- 172.21.2.105:0/337891199 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f746013d150 con 0x7f746013cd30 2021-11-12T05:40:43.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f745dffb700 1 -- 172.21.2.105:0/337891199 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74500137c0 con 0x7f746013cd30 2021-11-12T05:40:43.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f7466e2b700 1 -- 172.21.2.105:0/337891199 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74600b5580 con 0x7f746013cd30 2021-11-12T05:40:43.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f7466e2b700 1 -- 172.21.2.105:0/337891199 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74600afb00 con 0x7f746013cd30 2021-11-12T05:40:43.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.422+0000 7f745dffb700 1 -- 172.21.2.105:0/337891199 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f745001a060 con 0x7f746013cd30 2021-11-12T05:40:43.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.426+0000 7f745dffb700 1 --2- 172.21.2.105:0/337891199 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7440053610 0x7f7440055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.426+0000 7f745dffb700 1 -- 172.21.2.105:0/337891199 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f745006b4c0 con 0x7f746013cd30 2021-11-12T05:40:43.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.426+0000 7f7464bc7700 1 --2- 172.21.2.105:0/337891199 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7440053610 0x7f7440055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:43.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.426+0000 7f7464bc7700 1 --2- 172.21.2.105:0/337891199 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7440053610 0x7f7440055ad0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f7454002f70 tx=0x7f7454006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:43.443 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.426+0000 7f745dffb700 1 -- 172.21.2.105:0/337891199 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f74500423b0 con 0x7f746013cd30 2021-11-12T05:40:43.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.510+0000 7f7466e2b700 1 -- 172.21.2.105:0/337891199 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7460057350 con 0x7f746013cd30 2021-11-12T05:40:43.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.510+0000 7f745dffb700 1 -- 172.21.2.105:0/337891199 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f7450018020 con 0x7f746013cd30 2021-11-12T05:40:43.514 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:40:43.515 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":25,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:40:38.203083+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:40:32.786926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-12T05:40:35.006506+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:40:43.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.514+0000 7f7466e2b700 1 -- 172.21.2.105:0/337891199 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7440053610 msgr2=0x7f7440055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:43.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.514+0000 7f7466e2b700 1 --2- 172.21.2.105:0/337891199 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7440053610 0x7f7440055ad0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f7454002f70 tx=0x7f7454006a80).stop 2021-11-12T05:40:43.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.514+0000 7f7466e2b700 1 -- 172.21.2.105:0/337891199 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f746013cd30 msgr2=0x7f7460063950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:43.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.514+0000 7f7466e2b700 1 --2- 172.21.2.105:0/337891199 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f746013cd30 0x7f7460063950 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f7450000b60 tx=0x7f7450006e10).stop 2021-11-12T05:40:43.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.514+0000 7f7466e2b700 1 -- 172.21.2.105:0/337891199 shutdown_connections 2021-11-12T05:40:43.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.514+0000 7f7466e2b700 1 --2- 172.21.2.105:0/337891199 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7440053610 0x7f7440055ad0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:43.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.514+0000 7f7466e2b700 1 --2- 172.21.2.105:0/337891199 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f74600b4900 0x7f74600b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.514+0000 7f7466e2b700 1 --2- 172.21.2.105:0/337891199 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f746013cd30 0x7f7460063950 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:43.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.514+0000 7f7466e2b700 1 --2- 172.21.2.105:0/337891199 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f744c004f90 0x7f7460157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.514+0000 7f7466e2b700 1 -- 172.21.2.105:0/337891199 >> 172.21.2.105:0/337891199 conn(0x7f746005c490 msgr2=0x7f7460141260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:43.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.514+0000 7f7466e2b700 1 -- 172.21.2.105:0/337891199 shutdown_connections 2021-11-12T05:40:43.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.514+0000 7f7466e2b700 1 -- 172.21.2.105:0/337891199 wait complete. 2021-11-12T05:40:43.522 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-12T05:40:32.786926+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-11-12T05:40:35.006506+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-12T05:40:43.523 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:40:43.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f3284b5e700 1 Processor -- start 2021-11-12T05:40:43.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f3284b5e700 1 -- start start 2021-11-12T05:40:43.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f3284b5e700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f32800b1060 0x7f328013f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f3284b5e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3280142c50 0x7f32801430e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f3284b5e700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32800ad400 con 0x7f32800b2e20 2021-11-12T05:40:43.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f3284b5e700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32800b3200 con 0x7f32800b1060 2021-11-12T05:40:43.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f3284b5e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32800ad660 con 0x7f3280142c50 2021-11-12T05:40:43.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f327e59c700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f32800b2e20 0x7f328013ea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:53530/0 (socket says 172.21.2.105:53530) 2021-11-12T05:40:43.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f327e59c700 1 -- 172.21.2.105:0/3767578717 learned_addr learned my addr 172.21.2.105:0/3767578717 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:43.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f327d59a700 1 -- 172.21.2.105:0/3767578717 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1018882690 0 0) 0x7f32800ad400 con 0x7f32800b2e20 2021-11-12T05:40:43.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f327d59a700 1 -- 172.21.2.105:0/3767578717 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3264003260 con 0x7f32800b2e20 2021-11-12T05:40:43.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f327d59a700 1 -- 172.21.2.105:0/3767578717 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4248799751 0 0) 0x7f3264003260 con 0x7f32800b2e20 2021-11-12T05:40:43.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f327d59a700 1 -- 172.21.2.105:0/3767578717 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3280142c50 msgr2=0x7f32801430e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:43.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f327d59a700 1 --2- 172.21.2.105:0/3767578717 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3280142c50 0x7f32801430e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f327d59a700 1 -- 172.21.2.105:0/3767578717 >> v2:172.21.2.115:3300/0 conn(0x7f32800b1060 msgr2=0x7f328013f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:43.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f327dd9b700 1 --2- 172.21.2.105:0/3767578717 >> v2:172.21.2.115:3300/0 conn(0x7f32800b1060 0x7f328013f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:43.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f327d59a700 1 --2- 172.21.2.105:0/3767578717 >> v2:172.21.2.115:3300/0 conn(0x7f32800b1060 0x7f328013f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:43.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f327d59a700 1 -- 172.21.2.105:0/3767578717 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32800ad900 con 0x7f32800b2e20 2021-11-12T05:40:43.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f327d59a700 1 -- 172.21.2.105:0/3767578717 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f3274001660 con 0x7f32800b2e20 2021-11-12T05:40:43.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f327d59a700 1 -- 172.21.2.105:0/3767578717 >> v1:172.21.2.105:6789/0 conn(0x7f32800b2e20 legacy=0x7f328013ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:43.586 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f327d59a700 1 --2- 172.21.2.105:0/3767578717 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3280142c50 0x7f32640037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.586 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f327d59a700 1 --2- 172.21.2.105:0/3767578717 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3264003ee0 0x7f3264004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.586 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f327d59a700 1 --2- 172.21.2.105:0/3767578717 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3264004bf0 0x7f326400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.586 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f327d59a700 1 -- 172.21.2.105:0/3767578717 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32800b3200 con 0x7f3264003ee0 2021-11-12T05:40:43.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f327d59a700 1 -- 172.21.2.105:0/3767578717 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32800ad660 con 0x7f3264004bf0 2021-11-12T05:40:43.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f327d59a700 1 -- 172.21.2.105:0/3767578717 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32640053a0 con 0x7f3280142c50 2021-11-12T05:40:43.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f327dd9b700 1 --2- 172.21.2.105:0/3767578717 >> v2:172.21.2.115:3300/0 conn(0x7f32800b1060 0x7f328013f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:40:43.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f327dd9b700 1 --2- 172.21.2.105:0/3767578717 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3264003ee0 0x7f3264004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:43.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f327dd9b700 1 -- 172.21.2.105:0/3767578717 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3280142c50 msgr2=0x7f32640037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:43.588 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f327dd9b700 1 --2- 172.21.2.105:0/3767578717 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3280142c50 0x7f32640037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.588 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f327dd9b700 1 -- 172.21.2.105:0/3767578717 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3264004bf0 msgr2=0x7f326400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:43.588 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f327dd9b700 1 --2- 172.21.2.105:0/3767578717 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3264004bf0 0x7f326400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.588 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f327dd9b700 1 -- 172.21.2.105:0/3767578717 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3264003260 con 0x7f3264003ee0 2021-11-12T05:40:43.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f327dd9b700 1 --2- 172.21.2.105:0/3767578717 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3264003ee0 0x7f3264004500 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f3270007000 tx=0x7f3270008040).ready entity=mon.0 client_cookie=cf632dfd33372759 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:43.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f327d59a700 1 -- 172.21.2.105:0/3767578717 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3270015070 con 0x7f3264003ee0 2021-11-12T05:40:43.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f327d59a700 1 -- 172.21.2.105:0/3767578717 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3270011410 con 0x7f3264003ee0 2021-11-12T05:40:43.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f327d59a700 1 -- 172.21.2.105:0/3767578717 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3270011770 con 0x7f3264003ee0 2021-11-12T05:40:43.590 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f3284b5e700 1 -- 172.21.2.105:0/3767578717 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3264003ee0 msgr2=0x7f3264004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:43.590 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f3284b5e700 1 --2- 172.21.2.105:0/3767578717 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3264003ee0 0x7f3264004500 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f3270007000 tx=0x7f3270008040).stop 2021-11-12T05:40:43.590 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f327ed9d700 1 -- 172.21.2.105:0/3767578717 reap_dead start 2021-11-12T05:40:43.590 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f3284b5e700 1 -- 172.21.2.105:0/3767578717 shutdown_connections 2021-11-12T05:40:43.590 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f3284b5e700 1 -- 172.21.2.105:0/3767578717 >> 172.21.2.105:0/3767578717 conn(0x7f3280062f60 msgr2=0x7f3280063370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:43.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f3284b5e700 1 -- 172.21.2.105:0/3767578717 shutdown_connections 2021-11-12T05:40:43.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.574+0000 7f3284b5e700 1 -- 172.21.2.105:0/3767578717 wait complete. 2021-11-12T05:40:43.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.578+0000 7f3284b5e700 1 Processor -- start 2021-11-12T05:40:43.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.578+0000 7f3284b5e700 1 -- start start 2021-11-12T05:40:43.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.578+0000 7f3284b5e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3264003ee0 0x7f328013c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.578+0000 7f3284b5e700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f328013dce0 0x7f32800aba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.578+0000 7f3284b5e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f32800655a0 0x7f3280065a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.578+0000 7f3284b5e700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32800abf70 con 0x7f3264003ee0 2021-11-12T05:40:43.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.578+0000 7f3284b5e700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328013d020 con 0x7f328013dce0 2021-11-12T05:40:43.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.578+0000 7f3284b5e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f328013d2c0 con 0x7f32800655a0 2021-11-12T05:40:43.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.578+0000 7f327e59c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3264003ee0 0x7f328013c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:43.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.578+0000 7f327e59c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3264003ee0 0x7f328013c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43144/0 (socket says 172.21.2.105:43144) 2021-11-12T05:40:43.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.578+0000 7f327e59c700 1 -- 172.21.2.105:0/409467581 learned_addr learned my addr 172.21.2.105:0/409467581 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:43.594 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.578+0000 7f327e59c700 1 -- 172.21.2.105:0/409467581 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f32800655a0 msgr2=0x7f3280065a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:43.594 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.578+0000 7f327e59c700 1 --2- 172.21.2.105:0/409467581 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f32800655a0 0x7f3280065a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.594 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.578+0000 7f327e59c700 1 -- 172.21.2.105:0/409467581 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f328013dce0 msgr2=0x7f32800aba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:43.594 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.578+0000 7f327e59c700 1 --2- 172.21.2.105:0/409467581 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f328013dce0 0x7f32800aba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.594 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.578+0000 7f327e59c700 1 -- 172.21.2.105:0/409467581 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f328013d560 con 0x7f3264003ee0 2021-11-12T05:40:43.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.578+0000 7f327e59c700 1 --2- 172.21.2.105:0/409467581 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3264003ee0 0x7f328013c750 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f3274001370 tx=0x7f3274001b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:43.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.578+0000 7f326f7fe700 1 -- 172.21.2.105:0/409467581 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3274007170 con 0x7f3264003ee0 2021-11-12T05:40:43.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.578+0000 7f326f7fe700 1 -- 172.21.2.105:0/409467581 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32740072d0 con 0x7f3264003ee0 2021-11-12T05:40:43.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.578+0000 7f3284b5e700 1 -- 172.21.2.105:0/409467581 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f328013da00 con 0x7f3264003ee0 2021-11-12T05:40:43.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.578+0000 7f3284b5e700 1 -- 172.21.2.105:0/409467581 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32800660b0 con 0x7f3264003ee0 2021-11-12T05:40:43.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.578+0000 7f326f7fe700 1 -- 172.21.2.105:0/409467581 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3274004920 con 0x7f3264003ee0 2021-11-12T05:40:43.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.578+0000 7f3284b5e700 1 -- 172.21.2.105:0/409467581 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f328013d6f0 con 0x7f3264003ee0 2021-11-12T05:40:43.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.578+0000 7f326f7fe700 1 -- 172.21.2.105:0/409467581 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3274004a80 con 0x7f3264003ee0 2021-11-12T05:40:43.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.578+0000 7f326f7fe700 1 --2- 172.21.2.105:0/409467581 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f325c053720 0x7f325c055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.578+0000 7f326f7fe700 1 -- 172.21.2.105:0/409467581 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f327406b8a0 con 0x7f3264003ee0 2021-11-12T05:40:43.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.578+0000 7f327dd9b700 1 --2- 172.21.2.105:0/409467581 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f325c053720 0x7f325c055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:43.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.578+0000 7f327dd9b700 1 --2- 172.21.2.105:0/409467581 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f325c053720 0x7f325c055be0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f3270007000 tx=0x7f3270008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:43.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.582+0000 7f326f7fe700 1 -- 172.21.2.105:0/409467581 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3274042790 con 0x7f3264003ee0 2021-11-12T05:40:43.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.666+0000 7f3284b5e700 1 -- 172.21.2.105:0/409467581 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f32800b2060 con 0x7f3264003ee0 2021-11-12T05:40:43.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.666+0000 7f326f7fe700 1 -- 172.21.2.105:0/409467581 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3274045db0 con 0x7f3264003ee0 2021-11-12T05:40:43.669 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:40:43.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.666+0000 7f3284b5e700 1 -- 172.21.2.105:0/409467581 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f325c053720 msgr2=0x7f325c055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:43.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.666+0000 7f3284b5e700 1 --2- 172.21.2.105:0/409467581 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f325c053720 0x7f325c055be0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f3270007000 tx=0x7f3270008040).stop 2021-11-12T05:40:43.671 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.666+0000 7f3284b5e700 1 -- 172.21.2.105:0/409467581 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3264003ee0 msgr2=0x7f328013c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:43.671 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.666+0000 7f3284b5e700 1 --2- 172.21.2.105:0/409467581 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3264003ee0 0x7f328013c750 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f3274001370 tx=0x7f3274001b30).stop 2021-11-12T05:40:43.671 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.666+0000 7f3284b5e700 1 -- 172.21.2.105:0/409467581 shutdown_connections 2021-11-12T05:40:43.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.666+0000 7f3284b5e700 1 --2- 172.21.2.105:0/409467581 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f325c053720 0x7f325c055be0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:43.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.666+0000 7f3284b5e700 1 --2- 172.21.2.105:0/409467581 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f32800655a0 0x7f3280065a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.666+0000 7f3284b5e700 1 --2- 172.21.2.105:0/409467581 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f328013dce0 0x7f32800aba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.666+0000 7f3284b5e700 1 --2- 172.21.2.105:0/409467581 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3264003ee0 0x7f328013c750 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:43.673 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.666+0000 7f3284b5e700 1 -- 172.21.2.105:0/409467581 >> 172.21.2.105:0/409467581 conn(0x7f3280062f60 msgr2=0x7f32800af350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:43.673 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.666+0000 7f3284b5e700 1 -- 172.21.2.105:0/409467581 shutdown_connections 2021-11-12T05:40:43.673 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.666+0000 7f3284b5e700 1 -- 172.21.2.105:0/409467581 wait complete. 2021-11-12T05:40:43.676 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:40:43.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6787dfc700 1 Processor -- start 2021-11-12T05:40:43.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6787dfc700 1 -- start start 2021-11-12T05:40:43.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6787dfc700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f67800ae090 0x7f6780140d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6787dfc700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67800b7ee0 con 0x7f67800b3980 2021-11-12T05:40:43.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6787dfc700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67800b2030 con 0x7f67800b7b00 2021-11-12T05:40:43.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6787dfc700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67800b22d0 con 0x7f67800ae090 2021-11-12T05:40:43.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6786399700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f67800b3980 0x7f67800b3e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:53552/0 (socket says 172.21.2.105:53552) 2021-11-12T05:40:43.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6786399700 1 -- 172.21.2.105:0/2187986484 learned_addr learned my addr 172.21.2.105:0/2187986484 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:43.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6784b96700 1 -- 172.21.2.105:0/2187986484 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3965575224 0 0) 0x7f67800b7ee0 con 0x7f67800b3980 2021-11-12T05:40:43.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6784b96700 1 -- 172.21.2.105:0/2187986484 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6768003260 con 0x7f67800b3980 2021-11-12T05:40:43.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6784b96700 1 -- 172.21.2.105:0/2187986484 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1411277901 0 0) 0x7f6768003260 con 0x7f67800b3980 2021-11-12T05:40:43.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6784b96700 1 -- 172.21.2.105:0/2187986484 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f67800ae090 msgr2=0x7f6780140d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:43.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6784b96700 1 --2- 172.21.2.105:0/2187986484 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f67800ae090 0x7f6780140d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6784b96700 1 -- 172.21.2.105:0/2187986484 >> v1:172.21.2.115:6789/0 conn(0x7f67800b7b00 legacy=0x7f67800b2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:43.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6784b96700 1 -- 172.21.2.105:0/2187986484 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67800b2570 con 0x7f67800b3980 2021-11-12T05:40:43.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6784b96700 1 -- 172.21.2.105:0/2187986484 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f67780019e0 con 0x7f67800b3980 2021-11-12T05:40:43.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6784b96700 1 -- 172.21.2.105:0/2187986484 >> v1:172.21.2.105:6789/0 conn(0x7f67800b3980 legacy=0x7f67800b3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:43.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6784b96700 1 --2- 172.21.2.105:0/2187986484 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6768003780 0x7f6768003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.738 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6784b96700 1 --2- 172.21.2.105:0/2187986484 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f67800ae090 0x7f6768004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.738 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6784b96700 1 --2- 172.21.2.105:0/2187986484 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6768004b10 0x7f6768004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.738 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6784b96700 1 -- 172.21.2.105:0/2187986484 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67800b22d0 con 0x7f6768003780 2021-11-12T05:40:43.738 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6784b96700 1 -- 172.21.2.105:0/2187986484 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676800b910 con 0x7f6768004b10 2021-11-12T05:40:43.738 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6784b96700 1 -- 172.21.2.105:0/2187986484 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f676800bad0 con 0x7f67800ae090 2021-11-12T05:40:43.739 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6785b98700 1 --2- 172.21.2.105:0/2187986484 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6768003780 0x7f6768003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:43.739 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6785b98700 1 -- 172.21.2.105:0/2187986484 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f67800ae090 msgr2=0x7f6768004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:43.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6785b98700 1 --2- 172.21.2.105:0/2187986484 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f67800ae090 0x7f6768004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6785b98700 1 -- 172.21.2.105:0/2187986484 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6768004b10 msgr2=0x7f6768004f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:43.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6785b98700 1 --2- 172.21.2.105:0/2187986484 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6768004b10 0x7f6768004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6785b98700 1 -- 172.21.2.105:0/2187986484 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6768003260 con 0x7f6768003780 2021-11-12T05:40:43.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6785b98700 1 --2- 172.21.2.105:0/2187986484 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6768003780 0x7f6768003b80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f677c000f70 tx=0x7f677c0079e0).ready entity=mon.0 client_cookie=f08753d84709cef1 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:43.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6784b96700 1 -- 172.21.2.105:0/2187986484 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f677c007cf0 con 0x7f6768003780 2021-11-12T05:40:43.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6784b96700 1 -- 172.21.2.105:0/2187986484 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677c014410 con 0x7f6768003780 2021-11-12T05:40:43.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6784b96700 1 -- 172.21.2.105:0/2187986484 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f677c014770 con 0x7f6768003780 2021-11-12T05:40:43.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6787dfc700 1 -- 172.21.2.105:0/2187986484 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6768003780 msgr2=0x7f6768003b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:43.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6787dfc700 1 --2- 172.21.2.105:0/2187986484 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6768003780 0x7f6768003b80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f677c000f70 tx=0x7f677c0079e0).stop 2021-11-12T05:40:43.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6786399700 1 -- 172.21.2.105:0/2187986484 reap_dead start 2021-11-12T05:40:43.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6787dfc700 1 -- 172.21.2.105:0/2187986484 shutdown_connections 2021-11-12T05:40:43.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6787dfc700 1 -- 172.21.2.105:0/2187986484 >> 172.21.2.105:0/2187986484 conn(0x7f67800608d0 msgr2=0x7f678005c490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:43.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6787dfc700 1 -- 172.21.2.105:0/2187986484 shutdown_connections 2021-11-12T05:40:43.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.726+0000 7f6787dfc700 1 -- 172.21.2.105:0/2187986484 wait complete. 2021-11-12T05:40:43.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.730+0000 7f6787dfc700 1 Processor -- start 2021-11-12T05:40:43.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.730+0000 7f6787dfc700 1 -- start start 2021-11-12T05:40:43.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.730+0000 7f6787dfc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6768003780 0x7f6780061760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.730+0000 7f6787dfc700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f67800af8a0 0x7f6780144c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.730+0000 7f6787dfc700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f67800afd00 0x7f6780129040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.730+0000 7f6787dfc700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67800624c0 con 0x7f6768003780 2021-11-12T05:40:43.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.730+0000 7f6787dfc700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67800b1460 con 0x7f67800afd00 2021-11-12T05:40:43.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.730+0000 7f6787dfc700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6780144540 con 0x7f67800af8a0 2021-11-12T05:40:43.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.730+0000 7f6785b98700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6768003780 0x7f6780061760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:43.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.730+0000 7f6785b98700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6768003780 0x7f6780061760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43164/0 (socket says 172.21.2.105:43164) 2021-11-12T05:40:43.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.730+0000 7f6785b98700 1 -- 172.21.2.105:0/2099259068 learned_addr learned my addr 172.21.2.105:0/2099259068 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:43.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.730+0000 7f6785b98700 1 -- 172.21.2.105:0/2099259068 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f67800af8a0 msgr2=0x7f6780144c40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:40:43.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.730+0000 7f6785b98700 1 --2- 172.21.2.105:0/2099259068 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f67800af8a0 0x7f6780144c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.730+0000 7f6785b98700 1 -- 172.21.2.105:0/2099259068 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f67800afd00 msgr2=0x7f6780129040 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:40:43.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.730+0000 7f6785b98700 1 --2- 172.21.2.105:0/2099259068 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f67800afd00 0x7f6780129040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.730+0000 7f6785b98700 1 -- 172.21.2.105:0/2099259068 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67800b1690 con 0x7f6768003780 2021-11-12T05:40:43.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.730+0000 7f6785b98700 1 --2- 172.21.2.105:0/2099259068 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6768003780 0x7f6780061760 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f677c000f70 tx=0x7f677c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:43.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.730+0000 7f676effd700 1 -- 172.21.2.105:0/2099259068 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f677c013840 con 0x7f6768003780 2021-11-12T05:40:43.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.730+0000 7f676effd700 1 -- 172.21.2.105:0/2099259068 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677c0139a0 con 0x7f6768003780 2021-11-12T05:40:43.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.730+0000 7f676effd700 1 -- 172.21.2.105:0/2099259068 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f677c013d00 con 0x7f6768003780 2021-11-12T05:40:43.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.730+0000 7f6787dfc700 1 -- 172.21.2.105:0/2099259068 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67801447a0 con 0x7f6768003780 2021-11-12T05:40:43.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.730+0000 7f6787dfc700 1 -- 172.21.2.105:0/2099259068 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67800b0dc0 con 0x7f6768003780 2021-11-12T05:40:43.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.730+0000 7f6787dfc700 1 -- 172.21.2.105:0/2099259068 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6780144930 con 0x7f6768003780 2021-11-12T05:40:43.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.730+0000 7f676effd700 1 -- 172.21.2.105:0/2099259068 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f677c02b3f0 con 0x7f6768003780 2021-11-12T05:40:43.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.730+0000 7f676effd700 1 --2- 172.21.2.105:0/2099259068 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6760053690 0x7f6760055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.730+0000 7f676effd700 1 -- 172.21.2.105:0/2099259068 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f677c01c040 con 0x7f6768003780 2021-11-12T05:40:43.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.730+0000 7f6785397700 1 --2- 172.21.2.105:0/2099259068 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6760053690 0x7f6760055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:43.750 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.730+0000 7f6785397700 1 --2- 172.21.2.105:0/2099259068 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6760053690 0x7f6760055b50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f6770002f70 tx=0x7f67700069a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:43.750 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.734+0000 7f676effd700 1 -- 172.21.2.105:0/2099259068 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f677c043ee0 con 0x7f6768003780 2021-11-12T05:40:43.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.814+0000 7f6787dfc700 1 -- 172.21.2.105:0/2099259068 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6780057350 con 0x7f6768003780 2021-11-12T05:40:43.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.814+0000 7f676effd700 1 -- 172.21.2.105:0/2099259068 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f677c047500 con 0x7f6768003780 2021-11-12T05:40:43.819 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:40:43.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.818+0000 7f6787dfc700 1 -- 172.21.2.105:0/2099259068 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6760053690 msgr2=0x7f6760055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:43.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.818+0000 7f6787dfc700 1 --2- 172.21.2.105:0/2099259068 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6760053690 0x7f6760055b50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f6770002f70 tx=0x7f67700069a0).stop 2021-11-12T05:40:43.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.818+0000 7f6787dfc700 1 -- 172.21.2.105:0/2099259068 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6768003780 msgr2=0x7f6780061760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:43.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.818+0000 7f6787dfc700 1 --2- 172.21.2.105:0/2099259068 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6768003780 0x7f6780061760 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f677c000f70 tx=0x7f677c015000).stop 2021-11-12T05:40:43.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.818+0000 7f6787dfc700 1 -- 172.21.2.105:0/2099259068 shutdown_connections 2021-11-12T05:40:43.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.818+0000 7f6787dfc700 1 --2- 172.21.2.105:0/2099259068 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6760053690 0x7f6760055b50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:43.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.818+0000 7f6787dfc700 1 --2- 172.21.2.105:0/2099259068 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f67800afd00 0x7f6780129040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.818+0000 7f6787dfc700 1 --2- 172.21.2.105:0/2099259068 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f67800af8a0 0x7f6780144c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.818+0000 7f6787dfc700 1 --2- 172.21.2.105:0/2099259068 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6768003780 0x7f6780061760 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:43.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.818+0000 7f6787dfc700 1 -- 172.21.2.105:0/2099259068 >> 172.21.2.105:0/2099259068 conn(0x7f67800608d0 msgr2=0x7f6780066460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:43.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.818+0000 7f6787dfc700 1 -- 172.21.2.105:0/2099259068 shutdown_connections 2021-11-12T05:40:43.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.818+0000 7f6787dfc700 1 -- 172.21.2.105:0/2099259068 wait complete. 2021-11-12T05:40:43.826 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-12T05:40:43.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901fd43700 1 Processor -- start 2021-11-12T05:40:43.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901fd43700 1 -- start start 2021-11-12T05:40:43.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901fd43700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f90180b1cd0 0x7f90180ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901fd43700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f90180aa700 0x7f90180ac270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901fd43700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90180b20b0 con 0x7f90180b0e60 2021-11-12T05:40:43.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901fd43700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90180b2870 con 0x7f90180aa700 2021-11-12T05:40:43.881 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901fd43700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90180b13e0 con 0x7f90180b1cd0 2021-11-12T05:40:43.885 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901d2de700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f90180b0e60 0x7f90180abb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:53568/0 (socket says 172.21.2.105:53568) 2021-11-12T05:40:43.885 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901d2de700 1 -- 172.21.2.105:0/1672899101 learned_addr learned my addr 172.21.2.105:0/1672899101 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:43.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901e2e0700 1 --2- 172.21.2.105:0/1672899101 >> v2:172.21.2.105:3300/0 conn(0x7f90180aa700 0x7f90180ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:43.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901e2e0700 1 -- 172.21.2.105:0/1672899101 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f90180b1cd0 msgr2=0x7f90180ad2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:43.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901e2e0700 1 --2- 172.21.2.105:0/1672899101 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f90180b1cd0 0x7f90180ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901e2e0700 1 -- 172.21.2.105:0/1672899101 >> v1:172.21.2.105:6789/0 conn(0x7f90180b0e60 legacy=0x7f90180abb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:43.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901e2e0700 1 -- 172.21.2.105:0/1672899101 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90180ace10 con 0x7f90180aa700 2021-11-12T05:40:43.887 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901cadd700 1 -- 172.21.2.105:0/1672899101 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1243458175 0 0) 0x7f90180b20b0 con 0x7f90180b0e60 2021-11-12T05:40:43.887 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901e2e0700 1 --2- 172.21.2.105:0/1672899101 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f90180aa700 0x7f90180ac270 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f9014002f70 tx=0x7f9014006df0).ready entity=mon.0 client_cookie=7b6611ae668f2ec3 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:43.887 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901cadd700 1 -- 172.21.2.105:0/1672899101 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f901400d570 con 0x7f90180aa700 2021-11-12T05:40:43.887 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901cadd700 1 -- 172.21.2.105:0/1672899101 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9014000e90 con 0x7f90180aa700 2021-11-12T05:40:43.888 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901cadd700 1 -- 172.21.2.105:0/1672899101 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f901400d8c0 con 0x7f90180aa700 2021-11-12T05:40:43.888 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901fd43700 1 -- 172.21.2.105:0/1672899101 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f90180aa700 msgr2=0x7f90180ac270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:43.888 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901fd43700 1 --2- 172.21.2.105:0/1672899101 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f90180aa700 0x7f90180ac270 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f9014002f70 tx=0x7f9014006df0).stop 2021-11-12T05:40:43.888 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901fd43700 1 -- 172.21.2.105:0/1672899101 shutdown_connections 2021-11-12T05:40:43.888 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901fd43700 1 --2- 172.21.2.105:0/1672899101 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f90180aa700 0x7f90180ac270 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:43.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901fd43700 1 --2- 172.21.2.105:0/1672899101 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f90180b1cd0 0x7f90180ad2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901fd43700 1 -- 172.21.2.105:0/1672899101 >> 172.21.2.105:0/1672899101 conn(0x7f9018063610 msgr2=0x7f90180639f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:43.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901fd43700 1 -- 172.21.2.105:0/1672899101 shutdown_connections 2021-11-12T05:40:43.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901fd43700 1 -- 172.21.2.105:0/1672899101 wait complete. 2021-11-12T05:40:43.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901fd43700 1 Processor -- start 2021-11-12T05:40:43.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901fd43700 1 -- start start 2021-11-12T05:40:43.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901fd43700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f90180aa700 0x7f901805c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901fd43700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f90180b0e60 0x7f90181560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901fd43700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f90180b1cd0 0x7f90181565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.891 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901fd43700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90180aef30 con 0x7f90180b1cd0 2021-11-12T05:40:43.891 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901fd43700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9018155d00 con 0x7f90180b0e60 2021-11-12T05:40:43.891 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901fd43700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90180af420 con 0x7f90180aa700 2021-11-12T05:40:43.891 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901e2e0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f90180b1cd0 0x7f90181565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:43.891 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901e2e0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f90180b1cd0 0x7f90181565b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43182/0 (socket says 172.21.2.105:43182) 2021-11-12T05:40:43.892 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901e2e0700 1 -- 172.21.2.105:0/4174859550 learned_addr learned my addr 172.21.2.105:0/4174859550 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:43.892 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901e2e0700 1 -- 172.21.2.105:0/4174859550 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f90180aa700 msgr2=0x7f901805c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:43.892 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901e2e0700 1 --2- 172.21.2.105:0/4174859550 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f90180aa700 0x7f901805c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.892 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901e2e0700 1 -- 172.21.2.105:0/4174859550 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f90180b0e60 msgr2=0x7f90181560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:43.892 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901e2e0700 1 --2- 172.21.2.105:0/4174859550 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f90180b0e60 0x7f90181560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.893 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901e2e0700 1 -- 172.21.2.105:0/4174859550 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f901400b180 con 0x7f90180b1cd0 2021-11-12T05:40:43.893 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901e2e0700 1 --2- 172.21.2.105:0/4174859550 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f90180b1cd0 0x7f90181565b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f9014002f70 tx=0x7f9014015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:43.893 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f9006ffd700 1 -- 172.21.2.105:0/4174859550 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9014011990 con 0x7f90180b1cd0 2021-11-12T05:40:43.893 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f9006ffd700 1 -- 172.21.2.105:0/4174859550 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9014011af0 con 0x7f90180b1cd0 2021-11-12T05:40:43.894 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.878+0000 7f901fd43700 1 -- 172.21.2.105:0/4174859550 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90180af6c0 con 0x7f90180b1cd0 2021-11-12T05:40:43.894 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.882+0000 7f9006ffd700 1 -- 172.21.2.105:0/4174859550 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9014011e50 con 0x7f90180b1cd0 2021-11-12T05:40:43.894 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.882+0000 7f901fd43700 1 -- 172.21.2.105:0/4174859550 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90180af0a0 con 0x7f90180b1cd0 2021-11-12T05:40:43.894 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.882+0000 7f901fd43700 1 -- 172.21.2.105:0/4174859550 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90180adf50 con 0x7f90180b1cd0 2021-11-12T05:40:43.894 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.882+0000 7f9006ffd700 1 -- 172.21.2.105:0/4174859550 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9014025030 con 0x7f90180b1cd0 2021-11-12T05:40:43.895 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.882+0000 7f9006ffd700 1 --2- 172.21.2.105:0/4174859550 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8ff80534f0 0x7f8ff80559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:43.895 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.882+0000 7f9006ffd700 1 -- 172.21.2.105:0/4174859550 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f901406cd20 con 0x7f90180b1cd0 2021-11-12T05:40:43.895 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.882+0000 7f901dadf700 1 --2- 172.21.2.105:0/4174859550 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8ff80534f0 0x7f8ff80559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:43.895 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.882+0000 7f901dadf700 1 --2- 172.21.2.105:0/4174859550 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8ff80534f0 0x7f8ff80559b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f9008002f70 tx=0x7f90080069e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:43.896 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.882+0000 7f9006ffd700 1 -- 172.21.2.105:0/4174859550 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9014043d20 con 0x7f90180b1cd0 2021-11-12T05:40:43.969 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.966+0000 7f901fd43700 1 -- 172.21.2.105:0/4174859550 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f90180af260 con 0x7f90180b1cd0 2021-11-12T05:40:43.969 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.966+0000 7f9006ffd700 1 -- 172.21.2.105:0/4174859550 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7f90140230a0 con 0x7f90180b1cd0 2021-11-12T05:40:43.970 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:40:43.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.966+0000 7f901fd43700 1 -- 172.21.2.105:0/4174859550 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8ff80534f0 msgr2=0x7f8ff80559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:43.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.966+0000 7f901fd43700 1 --2- 172.21.2.105:0/4174859550 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8ff80534f0 0x7f8ff80559b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f9008002f70 tx=0x7f90080069e0).stop 2021-11-12T05:40:43.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.966+0000 7f901fd43700 1 -- 172.21.2.105:0/4174859550 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f90180b1cd0 msgr2=0x7f90181565b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:43.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.966+0000 7f901fd43700 1 --2- 172.21.2.105:0/4174859550 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f90180b1cd0 0x7f90181565b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f9014002f70 tx=0x7f9014015000).stop 2021-11-12T05:40:43.972 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.966+0000 7f901fd43700 1 -- 172.21.2.105:0/4174859550 shutdown_connections 2021-11-12T05:40:43.972 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.966+0000 7f901fd43700 1 --2- 172.21.2.105:0/4174859550 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8ff80534f0 0x7f8ff80559b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:43.972 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.966+0000 7f901fd43700 1 --2- 172.21.2.105:0/4174859550 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f90180b1cd0 0x7f90181565b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:43.972 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.966+0000 7f901fd43700 1 --2- 172.21.2.105:0/4174859550 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f90180b0e60 0x7f90181560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.973 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.966+0000 7f901fd43700 1 --2- 172.21.2.105:0/4174859550 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f90180aa700 0x7f901805c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:43.973 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.966+0000 7f901fd43700 1 -- 172.21.2.105:0/4174859550 >> 172.21.2.105:0/4174859550 conn(0x7f9018063610 msgr2=0x7f90180639f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:43.973 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.966+0000 7f901fd43700 1 -- 172.21.2.105:0/4174859550 shutdown_connections 2021-11-12T05:40:43.973 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:43.966+0000 7f901fd43700 1 -- 172.21.2.105:0/4174859550 wait complete. 2021-11-12T05:40:43.977 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-12T05:40:44.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.026+0000 7ff4fe2c4700 1 Processor -- start 2021-11-12T05:40:44.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.026+0000 7ff4fe2c4700 1 -- start start 2021-11-12T05:40:44.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.026+0000 7ff4fe2c4700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff4f8140d80 0x7ff4f80b4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:44.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.026+0000 7ff4fe2c4700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f80b7ee0 con 0x7ff4f80ae090 2021-11-12T05:40:44.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.026+0000 7ff4fe2c4700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f80b2030 con 0x7ff4f80b7b00 2021-11-12T05:40:44.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.026+0000 7ff4fe2c4700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f80b22d0 con 0x7ff4f8140d80 2021-11-12T05:40:44.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.026+0000 7ff4f77fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7ff4f80ae090 0x7ff4f80b3980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:53582/0 (socket says 172.21.2.105:53582) 2021-11-12T05:40:44.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.026+0000 7ff4f77fe700 1 -- 172.21.2.105:0/2871443217 learned_addr learned my addr 172.21.2.105:0/2871443217 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:44.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.026+0000 7ff4fc861700 1 --2- 172.21.2.105:0/2871443217 >> v2:172.21.2.105:3300/0 conn(0x7ff4f8140d80 0x7ff4f80b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:44.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.026+0000 7ff4f6ffd700 1 -- 172.21.2.105:0/2871443217 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 371188694 0 0) 0x7ff4f80b7ee0 con 0x7ff4f80ae090 2021-11-12T05:40:44.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.026+0000 7ff4f6ffd700 1 -- 172.21.2.105:0/2871443217 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4d8003260 con 0x7ff4f80ae090 2021-11-12T05:40:44.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.026+0000 7ff4fc861700 1 -- 172.21.2.105:0/2871443217 >> v1:172.21.2.115:6789/0 conn(0x7ff4f80b7b00 legacy=0x7ff4f80b2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:44.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.026+0000 7ff4fc861700 1 -- 172.21.2.105:0/2871443217 >> v1:172.21.2.105:6789/0 conn(0x7ff4f80ae090 legacy=0x7ff4f80b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:44.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.026+0000 7ff4fc861700 1 -- 172.21.2.105:0/2871443217 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f80b2570 con 0x7ff4f8140d80 2021-11-12T05:40:44.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.026+0000 7ff4fc861700 1 --2- 172.21.2.105:0/2871443217 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff4f8140d80 0x7ff4f80b4090 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7ff4f80b5070 tx=0x7ff4f00091d0).ready entity=mon.0 client_cookie=9141977b0d7c1b18 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:44.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.026+0000 7ff4f6ffd700 1 -- 172.21.2.105:0/2871443217 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4f000b680 con 0x7ff4f8140d80 2021-11-12T05:40:44.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.026+0000 7ff4f6ffd700 1 -- 172.21.2.105:0/2871443217 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f000b7e0 con 0x7ff4f8140d80 2021-11-12T05:40:44.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.026+0000 7ff4f6ffd700 1 -- 172.21.2.105:0/2871443217 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4f000b950 con 0x7ff4f8140d80 2021-11-12T05:40:44.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.026+0000 7ff4fe2c4700 1 -- 172.21.2.105:0/2871443217 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff4f8140d80 msgr2=0x7ff4f80b4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:44.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.026+0000 7ff4fe2c4700 1 --2- 172.21.2.105:0/2871443217 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff4f8140d80 0x7ff4f80b4090 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7ff4f80b5070 tx=0x7ff4f00091d0).stop 2021-11-12T05:40:44.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.026+0000 7ff4fe2c4700 1 -- 172.21.2.105:0/2871443217 shutdown_connections 2021-11-12T05:40:44.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.026+0000 7ff4fe2c4700 1 --2- 172.21.2.105:0/2871443217 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff4f8140d80 0x7ff4f80b4090 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:44.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.026+0000 7ff4fe2c4700 1 -- 172.21.2.105:0/2871443217 >> 172.21.2.105:0/2871443217 conn(0x7ff4f80608d0 msgr2=0x7ff4f805c490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:44.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.026+0000 7ff4fe2c4700 1 -- 172.21.2.105:0/2871443217 shutdown_connections 2021-11-12T05:40:44.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.026+0000 7ff4fe2c4700 1 -- 172.21.2.105:0/2871443217 wait complete. 2021-11-12T05:40:44.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.026+0000 7ff4fe2c4700 1 Processor -- start 2021-11-12T05:40:44.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.026+0000 7ff4fe2c4700 1 -- start start 2021-11-12T05:40:44.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.030+0000 7ff4fe2c4700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff4f80ae090 0x7ff4f8146080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:44.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.030+0000 7ff4fe2c4700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff4f80b7b00 0x7ff4f80ae910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:44.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.030+0000 7ff4fe2c4700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff4f8140d80 0x7ff4f80b59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:44.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.030+0000 7ff4fe2c4700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f80b0320 con 0x7ff4f80ae090 2021-11-12T05:40:44.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.030+0000 7ff4fe2c4700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f80b09b0 con 0x7ff4f80b7b00 2021-11-12T05:40:44.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.030+0000 7ff4fe2c4700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f80aee00 con 0x7ff4f8140d80 2021-11-12T05:40:44.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.030+0000 7ff4f7fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff4f80ae090 0x7ff4f8146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:44.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.030+0000 7ff4f7fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff4f80ae090 0x7ff4f8146080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43192/0 (socket says 172.21.2.105:43192) 2021-11-12T05:40:44.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.030+0000 7ff4f7fff700 1 -- 172.21.2.105:0/3510742932 learned_addr learned my addr 172.21.2.105:0/3510742932 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:44.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.030+0000 7ff4f7fff700 1 -- 172.21.2.105:0/3510742932 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff4f8140d80 msgr2=0x7ff4f80b59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:44.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.030+0000 7ff4f7fff700 1 --2- 172.21.2.105:0/3510742932 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff4f8140d80 0x7ff4f80b59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:44.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.030+0000 7ff4f7fff700 1 -- 172.21.2.105:0/3510742932 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff4f80b7b00 msgr2=0x7ff4f80ae910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:44.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.030+0000 7ff4f7fff700 1 --2- 172.21.2.105:0/3510742932 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff4f80b7b00 0x7ff4f80ae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:44.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.030+0000 7ff4f7fff700 1 -- 172.21.2.105:0/3510742932 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f0009470 con 0x7ff4f80ae090 2021-11-12T05:40:44.042 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.030+0000 7ff4f7fff700 1 --2- 172.21.2.105:0/3510742932 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff4f80ae090 0x7ff4f8146080 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7ff4f80b0af0 tx=0x7ff4e8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:44.042 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.030+0000 7ff4f57fa700 1 -- 172.21.2.105:0/3510742932 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4e8013460 con 0x7ff4f80ae090 2021-11-12T05:40:44.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.030+0000 7ff4f57fa700 1 -- 172.21.2.105:0/3510742932 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e80135c0 con 0x7ff4f80ae090 2021-11-12T05:40:44.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.030+0000 7ff4f57fa700 1 -- 172.21.2.105:0/3510742932 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4e8013920 con 0x7ff4f80ae090 2021-11-12T05:40:44.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.030+0000 7ff4fe2c4700 1 -- 172.21.2.105:0/3510742932 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f80b0f50 con 0x7ff4f80ae090 2021-11-12T05:40:44.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.030+0000 7ff4fe2c4700 1 -- 172.21.2.105:0/3510742932 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f80b0510 con 0x7ff4f80ae090 2021-11-12T05:40:44.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.030+0000 7ff4fe2c4700 1 -- 172.21.2.105:0/3510742932 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f80b06d0 con 0x7ff4f80ae090 2021-11-12T05:40:44.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.030+0000 7ff4f57fa700 1 -- 172.21.2.105:0/3510742932 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff4e801a060 con 0x7ff4f80ae090 2021-11-12T05:40:44.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.030+0000 7ff4f57fa700 1 --2- 172.21.2.105:0/3510742932 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff4dc0535d0 0x7ff4dc055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:44.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.030+0000 7ff4f57fa700 1 -- 172.21.2.105:0/3510742932 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7ff4e806b3a0 con 0x7ff4f80ae090 2021-11-12T05:40:44.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.030+0000 7ff4f77fe700 1 --2- 172.21.2.105:0/3510742932 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff4dc0535d0 0x7ff4dc055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:44.045 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.030+0000 7ff4f77fe700 1 --2- 172.21.2.105:0/3510742932 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff4dc0535d0 0x7ff4dc055a90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7ff4e0001110 tx=0x7ff4e00076c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:44.045 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.034+0000 7ff4f57fa700 1 -- 172.21.2.105:0/3510742932 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff4e80423a0 con 0x7ff4f80ae090 2021-11-12T05:40:44.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.114+0000 7ff4fe2c4700 1 -- 172.21.2.105:0/3510742932 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff4f8057350 con 0x7ff4f80ae090 2021-11-12T05:40:44.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.118+0000 7ff4f57fa700 1 -- 172.21.2.105:0/3510742932 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7ff4e80459c0 con 0x7ff4f80ae090 2021-11-12T05:40:44.120 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:40:44.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.118+0000 7ff4fe2c4700 1 -- 172.21.2.105:0/3510742932 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff4dc0535d0 msgr2=0x7ff4dc055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:44.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.118+0000 7ff4fe2c4700 1 --2- 172.21.2.105:0/3510742932 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff4dc0535d0 0x7ff4dc055a90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7ff4e0001110 tx=0x7ff4e00076c0).stop 2021-11-12T05:40:44.121 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.118+0000 7ff4fe2c4700 1 -- 172.21.2.105:0/3510742932 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff4f80ae090 msgr2=0x7ff4f8146080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:44.121 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.118+0000 7ff4fe2c4700 1 --2- 172.21.2.105:0/3510742932 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff4f80ae090 0x7ff4f8146080 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7ff4f80b0af0 tx=0x7ff4e8006df0).stop 2021-11-12T05:40:44.121 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.118+0000 7ff4fe2c4700 1 -- 172.21.2.105:0/3510742932 shutdown_connections 2021-11-12T05:40:44.121 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.118+0000 7ff4fe2c4700 1 --2- 172.21.2.105:0/3510742932 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff4dc0535d0 0x7ff4dc055a90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:44.122 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.118+0000 7ff4fe2c4700 1 --2- 172.21.2.105:0/3510742932 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff4f8140d80 0x7ff4f80b59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:44.122 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.118+0000 7ff4fe2c4700 1 --2- 172.21.2.105:0/3510742932 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff4f80b7b00 0x7ff4f80ae910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:44.122 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.118+0000 7ff4fe2c4700 1 --2- 172.21.2.105:0/3510742932 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff4f80ae090 0x7ff4f8146080 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:44.122 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.118+0000 7ff4fe2c4700 1 -- 172.21.2.105:0/3510742932 >> 172.21.2.105:0/3510742932 conn(0x7ff4f80608d0 msgr2=0x7ff4f80b6550 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:44.123 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.118+0000 7ff4fe2c4700 1 -- 172.21.2.105:0/3510742932 shutdown_connections 2021-11-12T05:40:44.123 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.118+0000 7ff4fe2c4700 1 -- 172.21.2.105:0/3510742932 wait complete. 2021-11-12T05:40:44.126 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:40:44.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.174+0000 7f71560cf700 1 Processor -- start 2021-11-12T05:40:44.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.174+0000 7f71560cf700 1 -- start start 2021-11-12T05:40:44.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.174+0000 7f71560cf700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f715005fdc0 0x7f71500601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:44.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.174+0000 7f71560cf700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7150066150 con 0x7f71500ade80 2021-11-12T05:40:44.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.174+0000 7f71560cf700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71500663f0 con 0x7f715013a9c0 2021-11-12T05:40:44.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.174+0000 7f71560cf700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7150141fb0 con 0x7f715005fdc0 2021-11-12T05:40:44.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.174+0000 7f714effd700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f71500ade80 0x7f7150066730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:53594/0 (socket says 172.21.2.105:53594) 2021-11-12T05:40:44.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.174+0000 7f714effd700 1 -- 172.21.2.105:0/2467722568 learned_addr learned my addr 172.21.2.105:0/2467722568 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:44.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.174+0000 7f714e7fc700 1 -- 172.21.2.105:0/2467722568 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 159017747 0 0) 0x7f7150066150 con 0x7f71500ade80 2021-11-12T05:40:44.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.174+0000 7f714e7fc700 1 -- 172.21.2.105:0/2467722568 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7130003260 con 0x7f71500ade80 2021-11-12T05:40:44.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.174+0000 7f714e7fc700 1 -- 172.21.2.105:0/2467722568 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2697996667 0 0) 0x7f7130003260 con 0x7f71500ade80 2021-11-12T05:40:44.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.174+0000 7f714e7fc700 1 -- 172.21.2.105:0/2467722568 >> v2:172.21.2.115:3300/0 conn(0x7f715005fdc0 msgr2=0x7f71500601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:44.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.174+0000 7f714e7fc700 1 --2- 172.21.2.105:0/2467722568 >> v2:172.21.2.115:3300/0 conn(0x7f715005fdc0 0x7f71500601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:44.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.174+0000 7f714e7fc700 1 -- 172.21.2.105:0/2467722568 >> v1:172.21.2.115:6789/0 conn(0x7f715013a9c0 legacy=0x7f7150141470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:44.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.174+0000 7f714e7fc700 1 -- 172.21.2.105:0/2467722568 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7150140fd0 con 0x7f71500ade80 2021-11-12T05:40:44.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f714e7fc700 1 -- 172.21.2.105:0/2467722568 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f7138001660 con 0x7f71500ade80 2021-11-12T05:40:44.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f714e7fc700 1 -- 172.21.2.105:0/2467722568 >> v1:172.21.2.105:6789/0 conn(0x7f71500ade80 legacy=0x7f7150066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:44.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f714e7fc700 1 --2- 172.21.2.105:0/2467722568 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7130003750 0x7f7130003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:44.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f714e7fc700 1 --2- 172.21.2.105:0/2467722568 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7130004500 0x7f7130004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:44.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f714e7fc700 1 --2- 172.21.2.105:0/2467722568 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7130004f90 0x7f713000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:44.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f714e7fc700 1 -- 172.21.2.105:0/2467722568 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713000be50 con 0x7f7130003750 2021-11-12T05:40:44.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f714e7fc700 1 -- 172.21.2.105:0/2467722568 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713000bfc0 con 0x7f7130004f90 2021-11-12T05:40:44.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f714e7fc700 1 -- 172.21.2.105:0/2467722568 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f713000c180 con 0x7f7130004500 2021-11-12T05:40:44.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f714f7fe700 1 --2- 172.21.2.105:0/2467722568 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7130003750 0x7f7130003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:44.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f714f7fe700 1 -- 172.21.2.105:0/2467722568 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7130004500 msgr2=0x7f7130004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:44.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f714f7fe700 1 --2- 172.21.2.105:0/2467722568 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7130004500 0x7f7130004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:44.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f714f7fe700 1 -- 172.21.2.105:0/2467722568 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7130004f90 msgr2=0x7f713000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:44.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f714f7fe700 1 --2- 172.21.2.105:0/2467722568 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7130004f90 0x7f713000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:44.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f714f7fe700 1 -- 172.21.2.105:0/2467722568 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7130003260 con 0x7f7130003750 2021-11-12T05:40:44.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f714ffff700 1 -- 172.21.2.105:0/2467722568 reap_dead start 2021-11-12T05:40:44.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f714f7fe700 1 --2- 172.21.2.105:0/2467722568 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7130003750 0x7f7130003b50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f7140002f70 tx=0x7f7140006ca0).ready entity=mon.0 client_cookie=cf1603119ff23c77 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:44.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f714e7fc700 1 -- 172.21.2.105:0/2467722568 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71400108f0 con 0x7f7130003750 2021-11-12T05:40:44.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f714e7fc700 1 -- 172.21.2.105:0/2467722568 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7140014070 con 0x7f7130003750 2021-11-12T05:40:44.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f714e7fc700 1 -- 172.21.2.105:0/2467722568 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7140010c40 con 0x7f7130003750 2021-11-12T05:40:44.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f71560cf700 1 -- 172.21.2.105:0/2467722568 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7130003750 msgr2=0x7f7130003b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:44.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f71560cf700 1 --2- 172.21.2.105:0/2467722568 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7130003750 0x7f7130003b50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f7140002f70 tx=0x7f7140006ca0).stop 2021-11-12T05:40:44.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f71560cf700 1 -- 172.21.2.105:0/2467722568 shutdown_connections 2021-11-12T05:40:44.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f71560cf700 1 --2- 172.21.2.105:0/2467722568 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7130003750 0x7f7130003b50 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:44.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f71560cf700 1 -- 172.21.2.105:0/2467722568 >> 172.21.2.105:0/2467722568 conn(0x7f71500608d0 msgr2=0x7f715005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:44.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f71560cf700 1 -- 172.21.2.105:0/2467722568 shutdown_connections 2021-11-12T05:40:44.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f71560cf700 1 -- 172.21.2.105:0/2467722568 wait complete. 2021-11-12T05:40:44.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f71560cf700 1 Processor -- start 2021-11-12T05:40:44.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f71560cf700 1 -- start start 2021-11-12T05:40:44.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f71560cf700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7130003750 0x7f71500b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:44.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f71560cf700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71500b80d0 0x7f7150151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:44.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f71560cf700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f715014e2b0 0x7f715014e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:44.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f71560cf700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7150145260 con 0x7f71500b80d0 2021-11-12T05:40:44.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f71560cf700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715014ec50 con 0x7f715014e2b0 2021-11-12T05:40:44.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f71560cf700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71500b76d0 con 0x7f7130003750 2021-11-12T05:40:44.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f714effd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71500b80d0 0x7f7150151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:44.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f714effd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71500b80d0 0x7f7150151240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43212/0 (socket says 172.21.2.105:43212) 2021-11-12T05:40:44.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f714effd700 1 -- 172.21.2.105:0/1701574868 learned_addr learned my addr 172.21.2.105:0/1701574868 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:44.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f714effd700 1 -- 172.21.2.105:0/1701574868 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7130003750 msgr2=0x7f71500b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:44.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f714effd700 1 --2- 172.21.2.105:0/1701574868 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7130003750 0x7f71500b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:44.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f714effd700 1 -- 172.21.2.105:0/1701574868 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f715014e2b0 msgr2=0x7f715014e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:44.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f714effd700 1 --2- 172.21.2.105:0/1701574868 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f715014e2b0 0x7f715014e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:44.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f714effd700 1 -- 172.21.2.105:0/1701574868 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71500b7430 con 0x7f71500b80d0 2021-11-12T05:40:44.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f714effd700 1 --2- 172.21.2.105:0/1701574868 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71500b80d0 0x7f7150151240 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f71501445c0 tx=0x7f7150066580).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:44.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f714cff9700 1 -- 172.21.2.105:0/1701574868 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7138007170 con 0x7f71500b80d0 2021-11-12T05:40:44.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f714cff9700 1 -- 172.21.2.105:0/1701574868 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71380072d0 con 0x7f71500b80d0 2021-11-12T05:40:44.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f71560cf700 1 -- 172.21.2.105:0/1701574868 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f715014de10 con 0x7f71500b80d0 2021-11-12T05:40:44.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f71560cf700 1 -- 172.21.2.105:0/1701574868 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f715013ade0 con 0x7f71500b80d0 2021-11-12T05:40:44.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.178+0000 7f714cff9700 1 -- 172.21.2.105:0/1701574868 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7138004920 con 0x7f71500b80d0 2021-11-12T05:40:44.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.182+0000 7f71560cf700 1 -- 172.21.2.105:0/1701574868 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f715014dc60 con 0x7f71500b80d0 2021-11-12T05:40:44.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.182+0000 7f714cff9700 1 -- 172.21.2.105:0/1701574868 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f713801b070 con 0x7f71500b80d0 2021-11-12T05:40:44.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.182+0000 7f714cff9700 1 --2- 172.21.2.105:0/1701574868 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7134053720 0x7f7134055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:44.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.182+0000 7f714cff9700 1 -- 172.21.2.105:0/1701574868 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f713806b3d0 con 0x7f71500b80d0 2021-11-12T05:40:44.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.182+0000 7f714f7fe700 1 --2- 172.21.2.105:0/1701574868 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7134053720 0x7f7134055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:44.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.182+0000 7f714f7fe700 1 --2- 172.21.2.105:0/1701574868 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7134053720 0x7f7134055be0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f7140002f70 tx=0x7f7140016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:44.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.182+0000 7f714cff9700 1 -- 172.21.2.105:0/1701574868 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f71380422c0 con 0x7f71500b80d0 2021-11-12T05:40:44.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.294+0000 7f71560cf700 1 -- 172.21.2.105:0/1701574868 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71500b7240 con 0x7f71500b80d0 2021-11-12T05:40:44.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.294+0000 7f714cff9700 1 -- 172.21.2.105:0/1701574868 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2134 (secure 0 0 0) 0x7f71380458e0 con 0x7f71500b80d0 2021-11-12T05:40:44.297 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:40:44.298 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4222,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/3123627686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":3123627686},{"type":"v1","addr":"172.21.2.115:6833","nonce":3123627686}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:40:37.198589+0000","modified":"2021-11-12T05:40:38.201943+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/2223420138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":2223420138},{"type":"v1","addr":"172.21.2.105:6835","nonce":2223420138}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-11-12T05:40:44.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.294+0000 7f71560cf700 1 -- 172.21.2.105:0/1701574868 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7134053720 msgr2=0x7f7134055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:44.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.294+0000 7f71560cf700 1 --2- 172.21.2.105:0/1701574868 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7134053720 0x7f7134055be0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f7140002f70 tx=0x7f7140016000).stop 2021-11-12T05:40:44.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.294+0000 7f71560cf700 1 -- 172.21.2.105:0/1701574868 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71500b80d0 msgr2=0x7f7150151240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:44.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.294+0000 7f71560cf700 1 --2- 172.21.2.105:0/1701574868 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71500b80d0 0x7f7150151240 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f71501445c0 tx=0x7f7150066580).stop 2021-11-12T05:40:44.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.294+0000 7f71560cf700 1 -- 172.21.2.105:0/1701574868 shutdown_connections 2021-11-12T05:40:44.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.294+0000 7f71560cf700 1 --2- 172.21.2.105:0/1701574868 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7134053720 0x7f7134055be0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:44.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.294+0000 7f71560cf700 1 --2- 172.21.2.105:0/1701574868 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f715014e2b0 0x7f715014e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:44.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.294+0000 7f71560cf700 1 --2- 172.21.2.105:0/1701574868 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71500b80d0 0x7f7150151240 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:44.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.294+0000 7f71560cf700 1 --2- 172.21.2.105:0/1701574868 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7130003750 0x7f71500b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:44.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.294+0000 7f71560cf700 1 -- 172.21.2.105:0/1701574868 >> 172.21.2.105:0/1701574868 conn(0x7f71500608d0 msgr2=0x7f7150066730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:44.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.294+0000 7f71560cf700 1 -- 172.21.2.105:0/1701574868 shutdown_connections 2021-11-12T05:40:44.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.294+0000 7f71560cf700 1 -- 172.21.2.105:0/1701574868 wait complete. 2021-11-12T05:40:44.304 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 5 2021-11-12T05:40:44.507 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:40:37.198589+0000', 'modified': '2021-11-12T05:40:38.201943+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4251}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4251': {'gid': 4251, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/2223420138', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 2223420138}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 2223420138}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:40:44.508 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:40:44.508 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:40:44.573 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":4251,"want_state":"up:active","state":"up:active","rank_uptime":7.3672598799999998,"mdsmap_epoch":5,"osdmap_epoch":25,"osdmap_epoch_barrier":24,"uptime":12.569664587} 2021-11-12T05:40:44.574 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 4251, "mdsmap_epoch": 5, "osdmap_epoch": 25, "osdmap_epoch_barrier": 24, "rank_uptime": 7.36725988, "state": "up:active", "uptime": 12.569664587, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:40:44.574 INFO:teuthology.run_tasks:Running task ceph-fuse... 2021-11-12T05:40:44.591 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2021-11-12T05:40:44.592 INFO:tasks.ceph_fuse:config is None 2021-11-12T05:40:44.592 INFO:tasks.ceph_fuse:new config is {'client.0': None, 'client.1': None, 'client.2': None} 2021-11-12T05:40:44.592 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2021-11-12T05:40:44.593 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:40:44.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.642+0000 7f315d6b5700 1 Processor -- start 2021-11-12T05:40:44.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.642+0000 7f315d6b5700 1 -- start start 2021-11-12T05:40:44.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.642+0000 7f315d6b5700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f31580adaf0 0x7f315813fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:44.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.642+0000 7f315d6b5700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3158143b40 0x7f3158143f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:44.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.642+0000 7f315d6b5700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3158067860 con 0x7f31580aded0 2021-11-12T05:40:44.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.642+0000 7f315d6b5700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3158143400 con 0x7f31580adaf0 2021-11-12T05:40:44.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.642+0000 7f315d6b5700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31581436a0 con 0x7f3158143b40 2021-11-12T05:40:44.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.642+0000 7f3156ffd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f31580adaf0 0x7f315813fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:44.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.642+0000 7f3156ffd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f31580adaf0 0x7f315813fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43218/0 (socket says 172.21.2.105:43218) 2021-11-12T05:40:44.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.642+0000 7f3156ffd700 1 -- 172.21.2.105:0/1339186043 learned_addr learned my addr 172.21.2.105:0/1339186043 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:44.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.642+0000 7f3156ffd700 1 -- 172.21.2.105:0/1339186043 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3158143b40 msgr2=0x7f3158143f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:44.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.642+0000 7f3156ffd700 1 --2- 172.21.2.105:0/1339186043 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3158143b40 0x7f3158143f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:44.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.642+0000 7f3156ffd700 1 -- 172.21.2.105:0/1339186043 >> v1:172.21.2.115:6789/0 conn(0x7f31580aded0 legacy=0x7f31580afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:44.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.642+0000 7f3156ffd700 1 -- 172.21.2.105:0/1339186043 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31580b2b40 con 0x7f31580adaf0 2021-11-12T05:40:44.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.642+0000 7f3156ffd700 1 --2- 172.21.2.105:0/1339186043 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f31580adaf0 0x7f315813fd90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f31580b63f0 tx=0x7f3148006f40).ready entity=mon.0 client_cookie=2e2097e083247b02 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:44.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.642+0000 7f31567fc700 1 -- 172.21.2.105:0/1339186043 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f314800dc30 con 0x7f31580adaf0 2021-11-12T05:40:44.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.642+0000 7f31567fc700 1 -- 172.21.2.105:0/1339186043 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3148000e90 con 0x7f31580adaf0 2021-11-12T05:40:44.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.642+0000 7f31567fc700 1 -- 172.21.2.105:0/1339186043 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f314800be90 con 0x7f31580adaf0 2021-11-12T05:40:44.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.642+0000 7f315d6b5700 1 -- 172.21.2.105:0/1339186043 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f31580adaf0 msgr2=0x7f315813fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:44.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.642+0000 7f315d6b5700 1 --2- 172.21.2.105:0/1339186043 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f31580adaf0 0x7f315813fd90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f31580b63f0 tx=0x7f3148006f40).stop 2021-11-12T05:40:44.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.642+0000 7f315d6b5700 1 -- 172.21.2.105:0/1339186043 shutdown_connections 2021-11-12T05:40:44.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.642+0000 7f315d6b5700 1 --2- 172.21.2.105:0/1339186043 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3158143b40 0x7f3158143f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:44.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.642+0000 7f315d6b5700 1 --2- 172.21.2.105:0/1339186043 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f31580adaf0 0x7f315813fd90 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:44.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.642+0000 7f315d6b5700 1 -- 172.21.2.105:0/1339186043 >> 172.21.2.105:0/1339186043 conn(0x7f315805c490 msgr2=0x7f315805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:44.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.642+0000 7f315d6b5700 1 -- 172.21.2.105:0/1339186043 shutdown_connections 2021-11-12T05:40:44.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.642+0000 7f315d6b5700 1 -- 172.21.2.105:0/1339186043 wait complete. 2021-11-12T05:40:44.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.642+0000 7f315d6b5700 1 Processor -- start 2021-11-12T05:40:44.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.642+0000 7f315d6b5700 1 -- start start 2021-11-12T05:40:44.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.642+0000 7f315d6b5700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f31580adaf0 0x7f31580b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:44.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.642+0000 7f315d6b5700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f31580aded0 0x7f315813c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:44.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.642+0000 7f315d6b5700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3158143b40 0x7f315813cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:44.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.642+0000 7f315d6b5700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3158066d20 con 0x7f3158143b40 2021-11-12T05:40:44.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.642+0000 7f315d6b5700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3158152860 con 0x7f31580aded0 2021-11-12T05:40:44.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.642+0000 7f315d6b5700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3158066f50 con 0x7f31580adaf0 2021-11-12T05:40:44.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.646+0000 7f31577fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3158143b40 0x7f315813cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:44.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.646+0000 7f31577fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3158143b40 0x7f315813cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43228/0 (socket says 172.21.2.105:43228) 2021-11-12T05:40:44.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.646+0000 7f31577fe700 1 -- 172.21.2.105:0/1550655022 learned_addr learned my addr 172.21.2.105:0/1550655022 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:44.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.646+0000 7f31577fe700 1 -- 172.21.2.105:0/1550655022 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f31580adaf0 msgr2=0x7f31580b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:44.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.646+0000 7f31577fe700 1 --2- 172.21.2.105:0/1550655022 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f31580adaf0 0x7f31580b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:44.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.646+0000 7f31577fe700 1 -- 172.21.2.105:0/1550655022 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f31580aded0 msgr2=0x7f315813c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:44.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.646+0000 7f31577fe700 1 --2- 172.21.2.105:0/1550655022 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f31580aded0 0x7f315813c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:44.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.646+0000 7f31577fe700 1 -- 172.21.2.105:0/1550655022 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314800b460 con 0x7f3158143b40 2021-11-12T05:40:44.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.646+0000 7f31577fe700 1 --2- 172.21.2.105:0/1550655022 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3158143b40 0x7f315813cb20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f3150003310 tx=0x7f31500091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:44.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.646+0000 7f3154ff9700 1 -- 172.21.2.105:0/1550655022 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3150001500 con 0x7f3158143b40 2021-11-12T05:40:44.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.646+0000 7f3154ff9700 1 -- 172.21.2.105:0/1550655022 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3150001660 con 0x7f3158143b40 2021-11-12T05:40:44.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.646+0000 7f315d6b5700 1 -- 172.21.2.105:0/1550655022 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31580673f0 con 0x7f3158143b40 2021-11-12T05:40:44.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.646+0000 7f3154ff9700 1 -- 172.21.2.105:0/1550655022 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31500019c0 con 0x7f3158143b40 2021-11-12T05:40:44.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.646+0000 7f315d6b5700 1 -- 172.21.2.105:0/1550655022 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31580ac620 con 0x7f3158143b40 2021-11-12T05:40:44.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.646+0000 7f315d6b5700 1 -- 172.21.2.105:0/1550655022 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31580afb00 con 0x7f3158143b40 2021-11-12T05:40:44.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.646+0000 7f3154ff9700 1 -- 172.21.2.105:0/1550655022 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3150018030 con 0x7f3158143b40 2021-11-12T05:40:44.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.646+0000 7f3154ff9700 1 --2- 172.21.2.105:0/1550655022 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f313c0536d0 0x7f313c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:44.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.646+0000 7f3154ff9700 1 -- 172.21.2.105:0/1550655022 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f315006b490 con 0x7f3158143b40 2021-11-12T05:40:44.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.646+0000 7f3156ffd700 1 --2- 172.21.2.105:0/1550655022 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f313c0536d0 0x7f313c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:44.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.646+0000 7f3156ffd700 1 --2- 172.21.2.105:0/1550655022 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f313c0536d0 0x7f313c055b90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f31580b63f0 tx=0x7f3148006f40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:44.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.650+0000 7f3154ff9700 1 -- 172.21.2.105:0/1550655022 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3150042540 con 0x7f3158143b40 2021-11-12T05:40:44.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.730+0000 7f315d6b5700 1 -- 172.21.2.105:0/1550655022 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3158057350 con 0x7f3158143b40 2021-11-12T05:40:44.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.730+0000 7f3154ff9700 1 -- 172.21.2.105:0/1550655022 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f3150045b60 con 0x7f3158143b40 2021-11-12T05:40:44.734 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:40:44.734 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":25,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:40:38.203083+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:40:32.786926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-12T05:40:35.006506+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:40:44.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.730+0000 7f315d6b5700 1 -- 172.21.2.105:0/1550655022 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f313c0536d0 msgr2=0x7f313c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:44.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.730+0000 7f315d6b5700 1 --2- 172.21.2.105:0/1550655022 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f313c0536d0 0x7f313c055b90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f31580b63f0 tx=0x7f3148006f40).stop 2021-11-12T05:40:44.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.730+0000 7f315d6b5700 1 -- 172.21.2.105:0/1550655022 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3158143b40 msgr2=0x7f315813cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:44.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.730+0000 7f315d6b5700 1 --2- 172.21.2.105:0/1550655022 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3158143b40 0x7f315813cb20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f3150003310 tx=0x7f31500091a0).stop 2021-11-12T05:40:44.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.730+0000 7f315d6b5700 1 -- 172.21.2.105:0/1550655022 shutdown_connections 2021-11-12T05:40:44.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.730+0000 7f315d6b5700 1 --2- 172.21.2.105:0/1550655022 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f313c0536d0 0x7f313c055b90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:44.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.730+0000 7f315d6b5700 1 --2- 172.21.2.105:0/1550655022 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3158143b40 0x7f315813cb20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:44.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.730+0000 7f315d6b5700 1 --2- 172.21.2.105:0/1550655022 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f31580aded0 0x7f315813c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:44.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.730+0000 7f315d6b5700 1 --2- 172.21.2.105:0/1550655022 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f31580adaf0 0x7f31580b10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:44.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.730+0000 7f315d6b5700 1 -- 172.21.2.105:0/1550655022 >> 172.21.2.105:0/1550655022 conn(0x7f315805c490 msgr2=0x7f31580b5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:44.738 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.730+0000 7f315d6b5700 1 -- 172.21.2.105:0/1550655022 shutdown_connections 2021-11-12T05:40:44.738 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.730+0000 7f315d6b5700 1 -- 172.21.2.105:0/1550655022 wait complete. 2021-11-12T05:40:44.741 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-12T05:40:32.786926+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-11-12T05:40:35.006506+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-12T05:40:44.742 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:40:44.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.790+0000 7f6fb38bb700 1 Processor -- start 2021-11-12T05:40:44.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.790+0000 7f6fb38bb700 1 -- start start 2021-11-12T05:40:44.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.790+0000 7f6fb38bb700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f6fac0b2e20 0x7f6fac0b1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:44.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.790+0000 7f6fb38bb700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6fac13ea50 0x7f6fac13ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:44.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.790+0000 7f6fb38bb700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fac0ad400 con 0x7f6fac05f6b0 2021-11-12T05:40:44.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.790+0000 7f6fb38bb700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fac0b3200 con 0x7f6fac0b2e20 2021-11-12T05:40:44.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.790+0000 7f6fb38bb700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fac0ad660 con 0x7f6fac13ea50 2021-11-12T05:40:44.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.790+0000 7f6fb1e58700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f6fac05f6b0 0x7f6fac05fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:53632/0 (socket says 172.21.2.105:53632) 2021-11-12T05:40:44.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.790+0000 7f6fb1e58700 1 -- 172.21.2.105:0/1641317222 learned_addr learned my addr 172.21.2.105:0/1641317222 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:44.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.790+0000 7f6fb1657700 1 --2- 172.21.2.105:0/1641317222 >> v2:172.21.2.105:3300/0 conn(0x7f6fac0b2e20 0x7f6fac0b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:44.798 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.790+0000 7f6f9ffff700 1 -- 172.21.2.105:0/1641317222 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1447442866 0 0) 0x7f6fac0ad400 con 0x7f6fac05f6b0 2021-11-12T05:40:44.798 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.790+0000 7f6f9ffff700 1 -- 172.21.2.105:0/1641317222 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f94003260 con 0x7f6fac05f6b0 2021-11-12T05:40:44.798 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.790+0000 7f6fb1657700 1 -- 172.21.2.105:0/1641317222 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6fac13ea50 msgr2=0x7f6fac13ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:44.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.790+0000 7f6fb1657700 1 --2- 172.21.2.105:0/1641317222 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6fac13ea50 0x7f6fac13ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:44.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.790+0000 7f6fb1657700 1 -- 172.21.2.105:0/1641317222 >> v1:172.21.2.105:6789/0 conn(0x7f6fac05f6b0 legacy=0x7f6fac05fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:44.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.790+0000 7f6fb1657700 1 -- 172.21.2.105:0/1641317222 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fac0ad900 con 0x7f6fac0b2e20 2021-11-12T05:40:44.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.790+0000 7f6fb1657700 1 --2- 172.21.2.105:0/1641317222 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6fac0b2e20 0x7f6fac0b1060 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f6fa8002f70 tx=0x7f6fa8007f00).ready entity=mon.0 client_cookie=574c4aed4666d30 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:44.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.790+0000 7f6f9ffff700 1 -- 172.21.2.105:0/1641317222 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fa8010510 con 0x7f6fac0b2e20 2021-11-12T05:40:44.800 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.790+0000 7f6f9ffff700 1 -- 172.21.2.105:0/1641317222 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa8000e90 con 0x7f6fac0b2e20 2021-11-12T05:40:44.800 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.790+0000 7f6f9ffff700 1 -- 172.21.2.105:0/1641317222 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fa8010670 con 0x7f6fac0b2e20 2021-11-12T05:40:44.800 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.794+0000 7f6fb38bb700 1 -- 172.21.2.105:0/1641317222 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6fac0b2e20 msgr2=0x7f6fac0b1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:44.800 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.794+0000 7f6fb38bb700 1 --2- 172.21.2.105:0/1641317222 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6fac0b2e20 0x7f6fac0b1060 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f6fa8002f70 tx=0x7f6fa8007f00).stop 2021-11-12T05:40:44.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.794+0000 7f6fb38bb700 1 -- 172.21.2.105:0/1641317222 shutdown_connections 2021-11-12T05:40:44.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.794+0000 7f6fb38bb700 1 --2- 172.21.2.105:0/1641317222 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6fac13ea50 0x7f6fac13ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:44.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.794+0000 7f6fb38bb700 1 --2- 172.21.2.105:0/1641317222 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6fac0b2e20 0x7f6fac0b1060 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:44.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.794+0000 7f6fb38bb700 1 -- 172.21.2.105:0/1641317222 >> 172.21.2.105:0/1641317222 conn(0x7f6fac062f60 msgr2=0x7f6fac063370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:44.802 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.794+0000 7f6fb38bb700 1 -- 172.21.2.105:0/1641317222 shutdown_connections 2021-11-12T05:40:44.802 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.794+0000 7f6fb38bb700 1 -- 172.21.2.105:0/1641317222 wait complete. 2021-11-12T05:40:44.804 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.794+0000 7f6fb38bb700 1 Processor -- start 2021-11-12T05:40:44.804 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.794+0000 7f6fb38bb700 1 -- start start 2021-11-12T05:40:44.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.794+0000 7f6fb38bb700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6fac05f6b0 0x7f6fac13b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:44.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.794+0000 7f6fb38bb700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6fac0b2e20 0x7f6fac13d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:44.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.794+0000 7f6fb38bb700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6fac13ea50 0x7f6fac151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:44.806 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.794+0000 7f6fb38bb700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fac063dd0 con 0x7f6fac13ea50 2021-11-12T05:40:44.806 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.794+0000 7f6fb38bb700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fac14f280 con 0x7f6fac0b2e20 2021-11-12T05:40:44.806 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.794+0000 7f6fb38bb700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fac064000 con 0x7f6fac05f6b0 2021-11-12T05:40:44.806 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.794+0000 7f6fb1e58700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6fac13ea50 0x7f6fac151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:44.807 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.794+0000 7f6fb1e58700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6fac13ea50 0x7f6fac151810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43242/0 (socket says 172.21.2.105:43242) 2021-11-12T05:40:44.807 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.794+0000 7f6fb1e58700 1 -- 172.21.2.105:0/1712647542 learned_addr learned my addr 172.21.2.105:0/1712647542 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:44.807 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.794+0000 7f6fb1e58700 1 -- 172.21.2.105:0/1712647542 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6fac05f6b0 msgr2=0x7f6fac13b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:44.807 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.794+0000 7f6fb1e58700 1 --2- 172.21.2.105:0/1712647542 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6fac05f6b0 0x7f6fac13b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:44.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.794+0000 7f6fb1e58700 1 -- 172.21.2.105:0/1712647542 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6fac0b2e20 msgr2=0x7f6fac13d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:44.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.794+0000 7f6fb1e58700 1 --2- 172.21.2.105:0/1712647542 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6fac0b2e20 0x7f6fac13d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:44.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.794+0000 7f6fb1e58700 1 -- 172.21.2.105:0/1712647542 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa800c200 con 0x7f6fac13ea50 2021-11-12T05:40:44.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.794+0000 7f6fb1e58700 1 --2- 172.21.2.105:0/1712647542 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6fac13ea50 0x7f6fac151810 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f6fa4001490 tx=0x7f6fa4007e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:44.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.794+0000 7f6f9e7fc700 1 -- 172.21.2.105:0/1712647542 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fa4005d90 con 0x7f6fac13ea50 2021-11-12T05:40:44.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.794+0000 7f6f9e7fc700 1 -- 172.21.2.105:0/1712647542 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa400c7f0 con 0x7f6fac13ea50 2021-11-12T05:40:44.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.794+0000 7f6f9e7fc700 1 -- 172.21.2.105:0/1712647542 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fa400cb50 con 0x7f6fac13ea50 2021-11-12T05:40:44.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.794+0000 7f6fb38bb700 1 -- 172.21.2.105:0/1712647542 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fac0642a0 con 0x7f6fac13ea50 2021-11-12T05:40:44.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.794+0000 7f6fb38bb700 1 -- 172.21.2.105:0/1712647542 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fac142e50 con 0x7f6fac13ea50 2021-11-12T05:40:44.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.794+0000 7f6fb38bb700 1 -- 172.21.2.105:0/1712647542 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fac0b2060 con 0x7f6fac13ea50 2021-11-12T05:40:44.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.794+0000 7f6f9e7fc700 1 -- 172.21.2.105:0/1712647542 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6fa400ccb0 con 0x7f6fac13ea50 2021-11-12T05:40:44.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.794+0000 7f6f9e7fc700 1 --2- 172.21.2.105:0/1712647542 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6f8c0534f0 0x7f6f8c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:44.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.794+0000 7f6f9e7fc700 1 -- 172.21.2.105:0/1712647542 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f6fa406e5b0 con 0x7f6fac13ea50 2021-11-12T05:40:44.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.794+0000 7f6fb1657700 1 --2- 172.21.2.105:0/1712647542 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6f8c0534f0 0x7f6f8c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:44.811 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.798+0000 7f6fb1657700 1 --2- 172.21.2.105:0/1712647542 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6f8c0534f0 0x7f6f8c0559b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f6fa8002f70 tx=0x7f6fa8017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:44.811 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.798+0000 7f6f9e7fc700 1 -- 172.21.2.105:0/1712647542 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6fa40454a0 con 0x7f6fac13ea50 2021-11-12T05:40:44.884 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.882+0000 7f6fb38bb700 1 -- 172.21.2.105:0/1712647542 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6fac057350 con 0x7f6fac13ea50 2021-11-12T05:40:44.885 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.882+0000 7f6f9e7fc700 1 -- 172.21.2.105:0/1712647542 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6fa4048ac0 con 0x7f6fac13ea50 2021-11-12T05:40:44.885 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:40:44.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.882+0000 7f6fb38bb700 1 -- 172.21.2.105:0/1712647542 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6f8c0534f0 msgr2=0x7f6f8c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:44.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.882+0000 7f6fb38bb700 1 --2- 172.21.2.105:0/1712647542 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6f8c0534f0 0x7f6f8c0559b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f6fa8002f70 tx=0x7f6fa8017000).stop 2021-11-12T05:40:44.887 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.882+0000 7f6fb38bb700 1 -- 172.21.2.105:0/1712647542 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6fac13ea50 msgr2=0x7f6fac151810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:44.887 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.882+0000 7f6fb38bb700 1 --2- 172.21.2.105:0/1712647542 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6fac13ea50 0x7f6fac151810 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f6fa4001490 tx=0x7f6fa4007e30).stop 2021-11-12T05:40:44.887 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.882+0000 7f6fb38bb700 1 -- 172.21.2.105:0/1712647542 shutdown_connections 2021-11-12T05:40:44.887 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.882+0000 7f6fb38bb700 1 --2- 172.21.2.105:0/1712647542 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6f8c0534f0 0x7f6f8c0559b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:44.888 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.882+0000 7f6fb38bb700 1 --2- 172.21.2.105:0/1712647542 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6fac13ea50 0x7f6fac151810 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:44.888 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.882+0000 7f6fb38bb700 1 --2- 172.21.2.105:0/1712647542 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6fac0b2e20 0x7f6fac13d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:44.888 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.882+0000 7f6fb38bb700 1 --2- 172.21.2.105:0/1712647542 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6fac05f6b0 0x7f6fac13b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:44.888 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.882+0000 7f6fb38bb700 1 -- 172.21.2.105:0/1712647542 >> 172.21.2.105:0/1712647542 conn(0x7f6fac062f60 msgr2=0x7f6fac05bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:44.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.882+0000 7f6fb38bb700 1 -- 172.21.2.105:0/1712647542 shutdown_connections 2021-11-12T05:40:44.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.882+0000 7f6fb38bb700 1 -- 172.21.2.105:0/1712647542 wait complete. 2021-11-12T05:40:44.892 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:40:44.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.942+0000 7f5ab503d700 1 Processor -- start 2021-11-12T05:40:44.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.942+0000 7f5ab503d700 1 -- start start 2021-11-12T05:40:44.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.942+0000 7f5ab503d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f5ab00b7b00 0x7f5ab0140d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:44.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.942+0000 7f5ab503d700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ab00b7ee0 con 0x7f5ab00b3980 2021-11-12T05:40:44.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.942+0000 7f5ab503d700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ab00b2030 con 0x7f5ab00ae090 2021-11-12T05:40:44.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.942+0000 7f5ab503d700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ab00b22d0 con 0x7f5ab00b7b00 2021-11-12T05:40:44.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.942+0000 7f5aaf59e700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f5ab00b3980 0x7f5ab00b3df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:53646/0 (socket says 172.21.2.105:53646) 2021-11-12T05:40:44.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.942+0000 7f5aaf59e700 1 -- 172.21.2.105:0/3878786871 learned_addr learned my addr 172.21.2.105:0/3878786871 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:44.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.942+0000 7f5aaed9d700 1 --2- 172.21.2.105:0/3878786871 >> v2:172.21.2.105:3300/0 conn(0x7f5ab00b7b00 0x7f5ab0140d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:44.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.942+0000 7f5aaed9d700 1 -- 172.21.2.105:0/3878786871 >> v1:172.21.2.115:6789/0 conn(0x7f5ab00ae090 legacy=0x7f5ab00b2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:44.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.942+0000 7f5aadd9b700 1 -- 172.21.2.105:0/3878786871 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3452606661 0 0) 0x7f5ab00b7ee0 con 0x7f5ab00b3980 2021-11-12T05:40:44.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.942+0000 7f5aaed9d700 1 -- 172.21.2.105:0/3878786871 >> v1:172.21.2.105:6789/0 conn(0x7f5ab00b3980 legacy=0x7f5ab00b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:44.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.942+0000 7f5aaed9d700 1 -- 172.21.2.105:0/3878786871 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab00b2570 con 0x7f5ab00b7b00 2021-11-12T05:40:44.950 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.942+0000 7f5aaed9d700 1 --2- 172.21.2.105:0/3878786871 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ab00b7b00 0x7f5ab0140d80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f5aa0002f70 tx=0x7f5aa0006df0).ready entity=mon.0 client_cookie=32bd4c9608e99cb4 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:44.950 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.942+0000 7f5aadd9b700 1 -- 172.21.2.105:0/3878786871 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5aa000d610 con 0x7f5ab00b7b00 2021-11-12T05:40:44.950 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.942+0000 7f5aadd9b700 1 -- 172.21.2.105:0/3878786871 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa0000e90 con 0x7f5ab00b7b00 2021-11-12T05:40:44.950 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.942+0000 7f5aadd9b700 1 -- 172.21.2.105:0/3878786871 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5aa000d960 con 0x7f5ab00b7b00 2021-11-12T05:40:44.951 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.942+0000 7f5ab503d700 1 -- 172.21.2.105:0/3878786871 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ab00b7b00 msgr2=0x7f5ab0140d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:44.951 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.942+0000 7f5ab503d700 1 --2- 172.21.2.105:0/3878786871 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ab00b7b00 0x7f5ab0140d80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f5aa0002f70 tx=0x7f5aa0006df0).stop 2021-11-12T05:40:44.951 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.942+0000 7f5ab503d700 1 -- 172.21.2.105:0/3878786871 shutdown_connections 2021-11-12T05:40:44.951 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.942+0000 7f5ab503d700 1 --2- 172.21.2.105:0/3878786871 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ab00b7b00 0x7f5ab0140d80 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:44.951 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.942+0000 7f5ab503d700 1 -- 172.21.2.105:0/3878786871 >> 172.21.2.105:0/3878786871 conn(0x7f5ab00608d0 msgr2=0x7f5ab005c490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:44.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.942+0000 7f5ab503d700 1 -- 172.21.2.105:0/3878786871 shutdown_connections 2021-11-12T05:40:44.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.942+0000 7f5ab503d700 1 -- 172.21.2.105:0/3878786871 wait complete. 2021-11-12T05:40:44.957 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.946+0000 7f5ab503d700 1 Processor -- start 2021-11-12T05:40:44.957 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.946+0000 7f5ab503d700 1 -- start start 2021-11-12T05:40:44.957 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.946+0000 7f5ab503d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ab00ae090 0x7f5ab01443b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:44.958 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.946+0000 7f5ab503d700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5ab00b3980 0x7f5ab00b0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:44.958 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.946+0000 7f5ab503d700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5ab00b7b00 0x7f5ab01437c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:44.959 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.946+0000 7f5ab503d700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab0143410 con 0x7f5ab00ae090 2021-11-12T05:40:44.959 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.946+0000 7f5ab503d700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab0143170 con 0x7f5ab00b3980 2021-11-12T05:40:44.960 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.946+0000 7f5ab503d700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab0062e80 con 0x7f5ab00b7b00 2021-11-12T05:40:44.960 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.946+0000 7f5aaed9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ab00ae090 0x7f5ab01443b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:44.960 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.946+0000 7f5aaed9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ab00ae090 0x7f5ab01443b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43252/0 (socket says 172.21.2.105:43252) 2021-11-12T05:40:44.961 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.946+0000 7f5aaed9d700 1 -- 172.21.2.105:0/2835872243 learned_addr learned my addr 172.21.2.105:0/2835872243 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:44.961 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.946+0000 7f5aae59c700 1 --2- 172.21.2.105:0/2835872243 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5ab00b3980 0x7f5ab00b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:44.961 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.946+0000 7f5aaf59e700 1 --2- 172.21.2.105:0/2835872243 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5ab00b7b00 0x7f5ab01437c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:44.962 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.946+0000 7f5aaed9d700 1 -- 172.21.2.105:0/2835872243 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5ab00b7b00 msgr2=0x7f5ab01437c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:44.962 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.946+0000 7f5aaed9d700 1 --2- 172.21.2.105:0/2835872243 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5ab00b7b00 0x7f5ab01437c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:44.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.946+0000 7f5aaed9d700 1 -- 172.21.2.105:0/2835872243 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5ab00b3980 msgr2=0x7f5ab00b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:44.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.946+0000 7f5aaed9d700 1 --2- 172.21.2.105:0/2835872243 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5ab00b3980 0x7f5ab00b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:44.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.946+0000 7f5aaed9d700 1 -- 172.21.2.105:0/2835872243 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa000b180 con 0x7f5ab00ae090 2021-11-12T05:40:44.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.946+0000 7f5aaf59e700 1 --2- 172.21.2.105:0/2835872243 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5ab00b7b00 0x7f5ab01437c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:40:44.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.946+0000 7f5aaed9d700 1 --2- 172.21.2.105:0/2835872243 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ab00ae090 0x7f5ab01443b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f5aa0002f70 tx=0x7f5aa0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:44.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.946+0000 7f5aa7fff700 1 -- 172.21.2.105:0/2835872243 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5aa000d290 con 0x7f5ab00ae090 2021-11-12T05:40:44.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.946+0000 7f5aa7fff700 1 -- 172.21.2.105:0/2835872243 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa000de80 con 0x7f5ab00ae090 2021-11-12T05:40:44.965 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.946+0000 7f5ab503d700 1 -- 172.21.2.105:0/2835872243 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab01448a0 con 0x7f5ab00ae090 2021-11-12T05:40:44.965 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.946+0000 7f5aa7fff700 1 -- 172.21.2.105:0/2835872243 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5aa0011e20 con 0x7f5ab00ae090 2021-11-12T05:40:44.965 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.946+0000 7f5ab503d700 1 -- 172.21.2.105:0/2835872243 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab00b0ba0 con 0x7f5ab00ae090 2021-11-12T05:40:44.965 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.946+0000 7f5ab503d700 1 -- 172.21.2.105:0/2835872243 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab0142c80 con 0x7f5ab00ae090 2021-11-12T05:40:44.965 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.946+0000 7f5aa7fff700 1 -- 172.21.2.105:0/2835872243 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5aa0025030 con 0x7f5ab00ae090 2021-11-12T05:40:44.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.946+0000 7f5aa7fff700 1 --2- 172.21.2.105:0/2835872243 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5a940535b0 0x7f5a94055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:44.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.946+0000 7f5aa7fff700 1 -- 172.21.2.105:0/2835872243 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f5aa006ccf0 con 0x7f5ab00ae090 2021-11-12T05:40:44.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.946+0000 7f5aae59c700 1 --2- 172.21.2.105:0/2835872243 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5a940535b0 0x7f5a94055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:44.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.946+0000 7f5aae59c700 1 --2- 172.21.2.105:0/2835872243 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5a940535b0 0x7f5a94055a70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f5a9800d000 tx=0x7f5a98007b90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:44.967 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:44.950+0000 7f5aa7fff700 1 -- 172.21.2.105:0/2835872243 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5ab0142c80 con 0x7f5ab00ae090 2021-11-12T05:40:45.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.034+0000 7f5ab503d700 1 -- 172.21.2.105:0/2835872243 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5ab0142c80 con 0x7f5ab00ae090 2021-11-12T05:40:45.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.034+0000 7f5aa7fff700 1 -- 172.21.2.105:0/2835872243 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5ab0142c80 con 0x7f5ab00ae090 2021-11-12T05:40:45.037 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:40:45.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.034+0000 7f5ab503d700 1 -- 172.21.2.105:0/2835872243 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5a940535b0 msgr2=0x7f5a94055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:45.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.034+0000 7f5ab503d700 1 --2- 172.21.2.105:0/2835872243 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5a940535b0 0x7f5a94055a70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f5a9800d000 tx=0x7f5a98007b90).stop 2021-11-12T05:40:45.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.034+0000 7f5ab503d700 1 -- 172.21.2.105:0/2835872243 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ab00ae090 msgr2=0x7f5ab01443b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:45.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.034+0000 7f5ab503d700 1 --2- 172.21.2.105:0/2835872243 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ab00ae090 0x7f5ab01443b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f5aa0002f70 tx=0x7f5aa0015000).stop 2021-11-12T05:40:45.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.034+0000 7f5ab503d700 1 -- 172.21.2.105:0/2835872243 shutdown_connections 2021-11-12T05:40:45.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.034+0000 7f5ab503d700 1 --2- 172.21.2.105:0/2835872243 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5a940535b0 0x7f5a94055a70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:45.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.034+0000 7f5ab503d700 1 --2- 172.21.2.105:0/2835872243 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5ab00b7b00 0x7f5ab01437c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:45.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.034+0000 7f5ab503d700 1 --2- 172.21.2.105:0/2835872243 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5ab00b3980 0x7f5ab00b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:45.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.034+0000 7f5ab503d700 1 --2- 172.21.2.105:0/2835872243 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ab00ae090 0x7f5ab01443b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:45.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.034+0000 7f5ab503d700 1 -- 172.21.2.105:0/2835872243 >> 172.21.2.105:0/2835872243 conn(0x7f5ab00608d0 msgr2=0x7f5ab01407d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:45.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.034+0000 7f5ab503d700 1 -- 172.21.2.105:0/2835872243 shutdown_connections 2021-11-12T05:40:45.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.034+0000 7f5ab503d700 1 -- 172.21.2.105:0/2835872243 wait complete. 2021-11-12T05:40:45.044 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-12T05:40:45.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.094+0000 7fd36a138700 1 Processor -- start 2021-11-12T05:40:45.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.094+0000 7fd36a138700 1 -- start start 2021-11-12T05:40:45.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.094+0000 7fd36a138700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fd364141c10 0x7fd36414b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:45.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.094+0000 7fd36a138700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3640b26e0 con 0x7fd3640b37d0 2021-11-12T05:40:45.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.094+0000 7fd36a138700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3640604e0 con 0x7fd364060100 2021-11-12T05:40:45.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.094+0000 7fd36a138700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd364145160 con 0x7fd364141c10 2021-11-12T05:40:45.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.094+0000 7fd362ffd700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fd3640b37d0 0x7fd364141500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:53658/0 (socket says 172.21.2.105:53658) 2021-11-12T05:40:45.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.094+0000 7fd362ffd700 1 -- 172.21.2.105:0/2201900150 learned_addr learned my addr 172.21.2.105:0/2201900150 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:45.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.094+0000 7fd3627fc700 1 -- 172.21.2.105:0/2201900150 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 33876466 0 0) 0x7fd3640b26e0 con 0x7fd3640b37d0 2021-11-12T05:40:45.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.094+0000 7fd3627fc700 1 -- 172.21.2.105:0/2201900150 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd344003260 con 0x7fd3640b37d0 2021-11-12T05:40:45.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.094+0000 7fd363fff700 1 --2- 172.21.2.105:0/2201900150 >> v2:172.21.2.115:3300/0 conn(0x7fd364141c10 0x7fd36414b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:45.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.094+0000 7fd3627fc700 1 -- 172.21.2.105:0/2201900150 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2340271456 0 0) 0x7fd344003260 con 0x7fd3640b37d0 2021-11-12T05:40:45.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.094+0000 7fd3627fc700 1 -- 172.21.2.105:0/2201900150 >> v2:172.21.2.115:3300/0 conn(0x7fd364141c10 msgr2=0x7fd36414b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:45.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.094+0000 7fd3627fc700 1 --2- 172.21.2.105:0/2201900150 >> v2:172.21.2.115:3300/0 conn(0x7fd364141c10 0x7fd36414b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:45.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.094+0000 7fd3627fc700 1 -- 172.21.2.105:0/2201900150 >> v1:172.21.2.115:6789/0 conn(0x7fd364060100 legacy=0x7fd3640b1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:45.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.094+0000 7fd3627fc700 1 -- 172.21.2.105:0/2201900150 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd364141060 con 0x7fd3640b37d0 2021-11-12T05:40:45.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.094+0000 7fd3627fc700 1 -- 172.21.2.105:0/2201900150 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fd354001660 con 0x7fd3640b37d0 2021-11-12T05:40:45.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.094+0000 7fd3627fc700 1 -- 172.21.2.105:0/2201900150 >> v1:172.21.2.105:6789/0 conn(0x7fd3640b37d0 legacy=0x7fd364141500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:45.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.094+0000 7fd3627fc700 1 --2- 172.21.2.105:0/2201900150 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd344003750 0x7fd344003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:45.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.094+0000 7fd3627fc700 1 --2- 172.21.2.105:0/2201900150 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd344004500 0x7fd344004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:45.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.094+0000 7fd3627fc700 1 --2- 172.21.2.105:0/2201900150 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd344004e70 0x7fd34400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:45.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.094+0000 7fd3627fc700 1 -- 172.21.2.105:0/2201900150 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd364145160 con 0x7fd344004500 2021-11-12T05:40:45.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.094+0000 7fd3627fc700 1 -- 172.21.2.105:0/2201900150 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34400bd20 con 0x7fd344003750 2021-11-12T05:40:45.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.094+0000 7fd3627fc700 1 -- 172.21.2.105:0/2201900150 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd34400bee0 con 0x7fd344004e70 2021-11-12T05:40:45.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.094+0000 7fd362ffd700 1 --2- 172.21.2.105:0/2201900150 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd344004500 0x7fd344004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:45.110 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.094+0000 7fd3637fe700 1 --2- 172.21.2.105:0/2201900150 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd344003750 0x7fd344003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:45.110 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd362ffd700 1 -- 172.21.2.105:0/2201900150 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd344004e70 msgr2=0x7fd34400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:45.110 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd362ffd700 1 --2- 172.21.2.105:0/2201900150 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd344004e70 0x7fd34400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:45.110 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd362ffd700 1 -- 172.21.2.105:0/2201900150 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd344003750 msgr2=0x7fd344003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:45.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd362ffd700 1 --2- 172.21.2.105:0/2201900150 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd344003750 0x7fd344003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:45.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd362ffd700 1 -- 172.21.2.105:0/2201900150 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd364141060 con 0x7fd344004500 2021-11-12T05:40:45.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd363fff700 1 -- 172.21.2.105:0/2201900150 reap_dead start 2021-11-12T05:40:45.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd362ffd700 1 --2- 172.21.2.105:0/2201900150 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd344004500 0x7fd344004980 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fd354001370 tx=0x7fd354001dc0).ready entity=mon.0 client_cookie=d9d5c3d35b034592 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:45.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd3627fc700 1 -- 172.21.2.105:0/2201900150 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3540071a0 con 0x7fd344004500 2021-11-12T05:40:45.112 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd3627fc700 1 -- 172.21.2.105:0/2201900150 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd354007300 con 0x7fd344004500 2021-11-12T05:40:45.112 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd3627fc700 1 -- 172.21.2.105:0/2201900150 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd35400cae0 con 0x7fd344004500 2021-11-12T05:40:45.112 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd36a138700 1 -- 172.21.2.105:0/2201900150 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd344004500 msgr2=0x7fd344004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:45.112 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd36a138700 1 --2- 172.21.2.105:0/2201900150 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd344004500 0x7fd344004980 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fd354001370 tx=0x7fd354001dc0).stop 2021-11-12T05:40:45.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd36a138700 1 -- 172.21.2.105:0/2201900150 shutdown_connections 2021-11-12T05:40:45.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd36a138700 1 --2- 172.21.2.105:0/2201900150 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd344004500 0x7fd344004980 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:45.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd36a138700 1 -- 172.21.2.105:0/2201900150 >> 172.21.2.105:0/2201900150 conn(0x7fd3640608d0 msgr2=0x7fd36405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:45.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd36a138700 1 -- 172.21.2.105:0/2201900150 shutdown_connections 2021-11-12T05:40:45.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd36a138700 1 -- 172.21.2.105:0/2201900150 wait complete. 2021-11-12T05:40:45.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd36a138700 1 Processor -- start 2021-11-12T05:40:45.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd36a138700 1 -- start start 2021-11-12T05:40:45.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd36a138700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd344004500 0x7fd364129260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:45.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd36a138700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3640b10c0 0x7fd364150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:45.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd36a138700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3640b06f0 0x7fd364150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:45.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd36a138700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36412df60 con 0x7fd3640b06f0 2021-11-12T05:40:45.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd36a138700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3640b04a0 con 0x7fd344004500 2021-11-12T05:40:45.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd36a138700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd36414fea0 con 0x7fd3640b10c0 2021-11-12T05:40:45.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd3637fe700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd344004500 0x7fd364129260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:45.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd363fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3640b06f0 0x7fd364150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:45.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd3637fe700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd344004500 0x7fd364129260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3300/0 says I am v2:172.21.2.105:60446/0 (socket says 172.21.2.105:60446) 2021-11-12T05:40:45.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd3637fe700 1 -- 172.21.2.105:0/870332608 learned_addr learned my addr 172.21.2.105:0/870332608 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:45.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd362ffd700 1 --2- 172.21.2.105:0/870332608 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3640b10c0 0x7fd364150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:45.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd363fff700 1 -- 172.21.2.105:0/870332608 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3640b10c0 msgr2=0x7fd364150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:45.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd363fff700 1 --2- 172.21.2.105:0/870332608 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3640b10c0 0x7fd364150380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:45.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd363fff700 1 -- 172.21.2.105:0/870332608 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd344004500 msgr2=0x7fd364129260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:45.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd363fff700 1 --2- 172.21.2.105:0/870332608 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd344004500 0x7fd364129260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:45.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd363fff700 1 -- 172.21.2.105:0/870332608 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd364129750 con 0x7fd3640b06f0 2021-11-12T05:40:45.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd3637fe700 1 --2- 172.21.2.105:0/870332608 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd344004500 0x7fd364129260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-12T05:40:45.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd363fff700 1 --2- 172.21.2.105:0/870332608 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3640b06f0 0x7fd364150870 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fd35c001210 tx=0x7fd35c0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:45.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd360ff9700 1 -- 172.21.2.105:0/870332608 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd35c017070 con 0x7fd3640b06f0 2021-11-12T05:40:45.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd360ff9700 1 -- 172.21.2.105:0/870332608 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd35c0127f0 con 0x7fd3640b06f0 2021-11-12T05:40:45.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd36a138700 1 -- 172.21.2.105:0/870332608 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd364150d60 con 0x7fd3640b06f0 2021-11-12T05:40:45.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd360ff9700 1 -- 172.21.2.105:0/870332608 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd35c012b50 con 0x7fd3640b06f0 2021-11-12T05:40:45.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd36a138700 1 -- 172.21.2.105:0/870332608 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3641534b0 con 0x7fd3640b06f0 2021-11-12T05:40:45.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd36a138700 1 -- 172.21.2.105:0/870332608 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd36412e0d0 con 0x7fd3640b06f0 2021-11-12T05:40:45.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd360ff9700 1 -- 172.21.2.105:0/870332608 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd35c012cb0 con 0x7fd3640b06f0 2021-11-12T05:40:45.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd360ff9700 1 --2- 172.21.2.105:0/870332608 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd3480535b0 0x7fd348055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:45.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd360ff9700 1 -- 172.21.2.105:0/870332608 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fd35c06bc40 con 0x7fd3640b06f0 2021-11-12T05:40:45.121 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd3637fe700 1 --2- 172.21.2.105:0/870332608 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd3480535b0 0x7fd348055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:45.121 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.098+0000 7fd3637fe700 1 --2- 172.21.2.105:0/870332608 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd3480535b0 0x7fd348055a70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fd34c00d000 tx=0x7fd34c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:45.121 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.102+0000 7fd360ff9700 1 -- 172.21.2.105:0/870332608 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd36412e0d0 con 0x7fd3640b06f0 2021-11-12T05:40:45.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.186+0000 7fd36a138700 1 -- 172.21.2.105:0/870332608 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd36412e0a0 con 0x7fd3640b06f0 2021-11-12T05:40:45.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.186+0000 7fd360ff9700 1 -- 172.21.2.105:0/870332608 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7fd35c042b40 con 0x7fd3640b06f0 2021-11-12T05:40:45.189 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:40:45.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.186+0000 7fd36a138700 1 -- 172.21.2.105:0/870332608 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd3480535b0 msgr2=0x7fd348055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:45.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.186+0000 7fd36a138700 1 --2- 172.21.2.105:0/870332608 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd3480535b0 0x7fd348055a70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fd34c00d000 tx=0x7fd34c009040).stop 2021-11-12T05:40:45.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.186+0000 7fd36a138700 1 -- 172.21.2.105:0/870332608 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3640b06f0 msgr2=0x7fd364150870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:45.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.186+0000 7fd36a138700 1 --2- 172.21.2.105:0/870332608 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3640b06f0 0x7fd364150870 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fd35c001210 tx=0x7fd35c0091d0).stop 2021-11-12T05:40:45.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.186+0000 7fd36a138700 1 -- 172.21.2.105:0/870332608 shutdown_connections 2021-11-12T05:40:45.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.186+0000 7fd36a138700 1 --2- 172.21.2.105:0/870332608 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd3480535b0 0x7fd348055a70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:45.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.186+0000 7fd36a138700 1 --2- 172.21.2.105:0/870332608 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3640b06f0 0x7fd364150870 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:45.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.186+0000 7fd36a138700 1 --2- 172.21.2.105:0/870332608 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3640b10c0 0x7fd364150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:45.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.186+0000 7fd36a138700 1 --2- 172.21.2.105:0/870332608 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd344004500 0x7fd364129260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:45.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.186+0000 7fd36a138700 1 -- 172.21.2.105:0/870332608 >> 172.21.2.105:0/870332608 conn(0x7fd3640608d0 msgr2=0x7fd364127bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:45.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.186+0000 7fd36a138700 1 -- 172.21.2.105:0/870332608 shutdown_connections 2021-11-12T05:40:45.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.186+0000 7fd36a138700 1 -- 172.21.2.105:0/870332608 wait complete. 2021-11-12T05:40:45.196 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-12T05:40:45.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.246+0000 7f993a3aa700 1 Processor -- start 2021-11-12T05:40:45.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.246+0000 7f993a3aa700 1 -- start start 2021-11-12T05:40:45.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.246+0000 7f993a3aa700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f99340b30a0 0x7f9934140240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:45.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.246+0000 7f993a3aa700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99340aa0b0 con 0x7f99340b2cc0 2021-11-12T05:40:45.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.246+0000 7f993a3aa700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99340a9b70 con 0x7f99340b2290 2021-11-12T05:40:45.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.246+0000 7f993a3aa700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99340a9e10 con 0x7f99340b30a0 2021-11-12T05:40:45.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f9933fff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f99340b2cc0 0x7f9934143690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:53678/0 (socket says 172.21.2.105:53678) 2021-11-12T05:40:45.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f9933fff700 1 -- 172.21.2.105:0/3708886242 learned_addr learned my addr 172.21.2.105:0/3708886242 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:45.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f9938947700 1 --2- 172.21.2.105:0/3708886242 >> v2:172.21.2.105:3300/0 conn(0x7f99340b30a0 0x7f9934140240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:45.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f9938947700 1 -- 172.21.2.105:0/3708886242 >> v1:172.21.2.115:6789/0 conn(0x7f99340b2290 legacy=0x7f9934143da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:45.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f9938947700 1 -- 172.21.2.105:0/3708886242 >> v1:172.21.2.105:6789/0 conn(0x7f99340b2cc0 legacy=0x7f9934143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:45.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f9938947700 1 -- 172.21.2.105:0/3708886242 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99340b0800 con 0x7f99340b30a0 2021-11-12T05:40:45.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f9938947700 1 --2- 172.21.2.105:0/3708886242 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99340b30a0 0x7f9934140240 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f99340afc20 tx=0x7f992c0091d0).ready entity=mon.0 client_cookie=4a34126318774c54 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:45.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f9932ffd700 1 -- 172.21.2.105:0/3708886242 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f992c00b820 con 0x7f99340b30a0 2021-11-12T05:40:45.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f9932ffd700 1 -- 172.21.2.105:0/3708886242 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992c00b980 con 0x7f99340b30a0 2021-11-12T05:40:45.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f9932ffd700 1 -- 172.21.2.105:0/3708886242 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f992c00baf0 con 0x7f99340b30a0 2021-11-12T05:40:45.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f993a3aa700 1 -- 172.21.2.105:0/3708886242 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99340b30a0 msgr2=0x7f9934140240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:45.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f993a3aa700 1 --2- 172.21.2.105:0/3708886242 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99340b30a0 0x7f9934140240 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f99340afc20 tx=0x7f992c0091d0).stop 2021-11-12T05:40:45.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f993a3aa700 1 -- 172.21.2.105:0/3708886242 shutdown_connections 2021-11-12T05:40:45.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f993a3aa700 1 --2- 172.21.2.105:0/3708886242 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99340b30a0 0x7f9934140240 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:45.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f993a3aa700 1 -- 172.21.2.105:0/3708886242 >> 172.21.2.105:0/3708886242 conn(0x7f993405c490 msgr2=0x7f993405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:45.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f993a3aa700 1 -- 172.21.2.105:0/3708886242 shutdown_connections 2021-11-12T05:40:45.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f993a3aa700 1 -- 172.21.2.105:0/3708886242 wait complete. 2021-11-12T05:40:45.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f993a3aa700 1 Processor -- start 2021-11-12T05:40:45.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f993a3aa700 1 -- start start 2021-11-12T05:40:45.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f993a3aa700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f99340b2290 0x7f993409ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:45.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f993a3aa700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f99340b2cc0 0x7f99340aba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:45.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f993a3aa700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99340b30a0 0x7f9934064f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:45.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f993a3aa700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9934066e40 con 0x7f99340b30a0 2021-11-12T05:40:45.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f993a3aa700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99340635d0 con 0x7f99340b2cc0 2021-11-12T05:40:45.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f993a3aa700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9934063870 con 0x7f99340b2290 2021-11-12T05:40:45.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f9938947700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99340b30a0 0x7f9934064f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:45.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f9938947700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99340b30a0 0x7f9934064f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43286/0 (socket says 172.21.2.105:43286) 2021-11-12T05:40:45.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f9938947700 1 -- 172.21.2.105:0/3929333912 learned_addr learned my addr 172.21.2.105:0/3929333912 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:45.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f9938947700 1 -- 172.21.2.105:0/3929333912 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f99340b2290 msgr2=0x7f993409ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:45.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f9938947700 1 --2- 172.21.2.105:0/3929333912 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f99340b2290 0x7f993409ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:45.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f9938947700 1 -- 172.21.2.105:0/3929333912 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f99340b2cc0 msgr2=0x7f99340aba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:45.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f9938947700 1 --2- 172.21.2.105:0/3929333912 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f99340b2cc0 0x7f99340aba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:45.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f9938947700 1 -- 172.21.2.105:0/3929333912 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992c009470 con 0x7f99340b30a0 2021-11-12T05:40:45.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f9938947700 1 --2- 172.21.2.105:0/3929333912 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99340b30a0 0x7f9934064f20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f99340afc20 tx=0x7f992c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:45.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f99317fa700 1 -- 172.21.2.105:0/3929333912 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f992c00b820 con 0x7f99340b30a0 2021-11-12T05:40:45.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f99317fa700 1 -- 172.21.2.105:0/3929333912 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992c0032f0 con 0x7f99340b30a0 2021-11-12T05:40:45.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f99317fa700 1 -- 172.21.2.105:0/3929333912 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f992c01f5e0 con 0x7f99340b30a0 2021-11-12T05:40:45.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f993a3aa700 1 -- 172.21.2.105:0/3929333912 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9934063b10 con 0x7f99340b30a0 2021-11-12T05:40:45.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.250+0000 7f993a3aa700 1 -- 172.21.2.105:0/3929333912 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99340a9590 con 0x7f99340b30a0 2021-11-12T05:40:45.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.254+0000 7f993a3aa700 1 -- 172.21.2.105:0/3929333912 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9934063ca0 con 0x7f99340b30a0 2021-11-12T05:40:45.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.254+0000 7f99317fa700 1 -- 172.21.2.105:0/3929333912 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f992c026030 con 0x7f99340b30a0 2021-11-12T05:40:45.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.254+0000 7f99317fa700 1 --2- 172.21.2.105:0/3929333912 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9918053690 0x7f9918055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:45.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.254+0000 7f99317fa700 1 -- 172.21.2.105:0/3929333912 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f992c06c8a0 con 0x7f99340b30a0 2021-11-12T05:40:45.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.254+0000 7f9933fff700 1 --2- 172.21.2.105:0/3929333912 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9918053690 0x7f9918055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:45.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.254+0000 7f9933fff700 1 --2- 172.21.2.105:0/3929333912 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9918053690 0x7f9918055b50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f993405d0d0 tx=0x7f991c007800).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:45.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.254+0000 7f99317fa700 1 -- 172.21.2.105:0/3929333912 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f992c043790 con 0x7f99340b30a0 2021-11-12T05:40:45.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.342+0000 7f993a3aa700 1 -- 172.21.2.105:0/3929333912 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f99340ad830 con 0x7f99340b30a0 2021-11-12T05:40:45.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.342+0000 7f99317fa700 1 -- 172.21.2.105:0/3929333912 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7f992c015020 con 0x7f99340b30a0 2021-11-12T05:40:45.344 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:40:45.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.342+0000 7f993a3aa700 1 -- 172.21.2.105:0/3929333912 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9918053690 msgr2=0x7f9918055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:45.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.342+0000 7f993a3aa700 1 --2- 172.21.2.105:0/3929333912 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9918053690 0x7f9918055b50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f993405d0d0 tx=0x7f991c007800).stop 2021-11-12T05:40:45.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.342+0000 7f993a3aa700 1 -- 172.21.2.105:0/3929333912 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99340b30a0 msgr2=0x7f9934064f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:45.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.342+0000 7f993a3aa700 1 --2- 172.21.2.105:0/3929333912 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99340b30a0 0x7f9934064f20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f99340afc20 tx=0x7f992c016000).stop 2021-11-12T05:40:45.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.342+0000 7f993a3aa700 1 -- 172.21.2.105:0/3929333912 shutdown_connections 2021-11-12T05:40:45.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.342+0000 7f993a3aa700 1 --2- 172.21.2.105:0/3929333912 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9918053690 0x7f9918055b50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:45.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.342+0000 7f993a3aa700 1 --2- 172.21.2.105:0/3929333912 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99340b30a0 0x7f9934064f20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:45.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.342+0000 7f993a3aa700 1 --2- 172.21.2.105:0/3929333912 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f99340b2cc0 0x7f99340aba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:45.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.342+0000 7f993a3aa700 1 --2- 172.21.2.105:0/3929333912 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f99340b2290 0x7f993409ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:45.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.342+0000 7f993a3aa700 1 -- 172.21.2.105:0/3929333912 >> 172.21.2.105:0/3929333912 conn(0x7f993405c490 msgr2=0x7f993413e450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:45.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.342+0000 7f993a3aa700 1 -- 172.21.2.105:0/3929333912 shutdown_connections 2021-11-12T05:40:45.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.342+0000 7f993a3aa700 1 -- 172.21.2.105:0/3929333912 wait complete. 2021-11-12T05:40:45.351 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-12T05:40:45.351 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:40:45.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.398+0000 7f849dc0f700 1 Processor -- start 2021-11-12T05:40:45.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.398+0000 7f849dc0f700 1 -- start start 2021-11-12T05:40:45.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f849dc0f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f84980adaf0 0x7f849813fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:45.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f849dc0f700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f8498143b40 0x7f8498143f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:45.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f849dc0f700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f84980aded0 0x7f84980ae300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:45.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f849dc0f700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8498067860 con 0x7f84980aded0 2021-11-12T05:40:45.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f849dc0f700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8498143400 con 0x7f8498143b40 2021-11-12T05:40:45.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f849dc0f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84981436a0 con 0x7f84980adaf0 2021-11-12T05:40:45.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f8497fff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f84980aded0 0x7f84980ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:45.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f8497fff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f84980aded0 0x7f84980ae300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43298/0 (socket says 172.21.2.105:43298) 2021-11-12T05:40:45.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f8497fff700 1 -- 172.21.2.105:0/361946325 learned_addr learned my addr 172.21.2.105:0/361946325 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:45.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f8497fff700 1 -- 172.21.2.105:0/361946325 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f84980adaf0 msgr2=0x7f849813fd90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:40:45.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f8497fff700 1 --2- 172.21.2.105:0/361946325 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f84980adaf0 0x7f849813fd90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:45.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f8497fff700 1 -- 172.21.2.105:0/361946325 >> v2:172.21.2.115:3300/0 conn(0x7f8498143b40 msgr2=0x7f8498143f80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:40:45.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f8497fff700 1 --2- 172.21.2.105:0/361946325 >> v2:172.21.2.115:3300/0 conn(0x7f8498143b40 0x7f8498143f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:45.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f8497fff700 1 -- 172.21.2.105:0/361946325 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84980b2b40 con 0x7f84980aded0 2021-11-12T05:40:45.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f8497fff700 1 --2- 172.21.2.105:0/361946325 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f84980aded0 0x7f84980ae300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f84900032f0 tx=0x7f849000b530).ready entity=mon.0 client_cookie=6e398311cab3d283 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:45.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f84967fc700 1 -- 172.21.2.105:0/361946325 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f849000be70 con 0x7f84980aded0 2021-11-12T05:40:45.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f84967fc700 1 -- 172.21.2.105:0/361946325 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8490010470 con 0x7f84980aded0 2021-11-12T05:40:45.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f84967fc700 1 -- 172.21.2.105:0/361946325 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8490010810 con 0x7f84980aded0 2021-11-12T05:40:45.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f849dc0f700 1 -- 172.21.2.105:0/361946325 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f84980aded0 msgr2=0x7f84980ae300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:45.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f849dc0f700 1 --2- 172.21.2.105:0/361946325 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f84980aded0 0x7f84980ae300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f84900032f0 tx=0x7f849000b530).stop 2021-11-12T05:40:45.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f849dc0f700 1 -- 172.21.2.105:0/361946325 shutdown_connections 2021-11-12T05:40:45.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f849dc0f700 1 --2- 172.21.2.105:0/361946325 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f84980aded0 0x7f84980ae300 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:45.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f849dc0f700 1 --2- 172.21.2.105:0/361946325 >> v2:172.21.2.115:3300/0 conn(0x7f8498143b40 0x7f8498143f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:45.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f849dc0f700 1 --2- 172.21.2.105:0/361946325 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f84980adaf0 0x7f849813fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:45.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f849dc0f700 1 -- 172.21.2.105:0/361946325 >> 172.21.2.105:0/361946325 conn(0x7f849805c490 msgr2=0x7f849805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:45.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f849dc0f700 1 -- 172.21.2.105:0/361946325 shutdown_connections 2021-11-12T05:40:45.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f849dc0f700 1 -- 172.21.2.105:0/361946325 wait complete. 2021-11-12T05:40:45.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f849dc0f700 1 Processor -- start 2021-11-12T05:40:45.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f849dc0f700 1 -- start start 2021-11-12T05:40:45.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f849dc0f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f84980adaf0 0x7f84980ac220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:45.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f849dc0f700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f84980aded0 0x7f8498064330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:45.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f849dc0f700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8498143b40 0x7f84980aa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:45.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f849dc0f700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8498063950 con 0x7f84980aded0 2021-11-12T05:40:45.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f849dc0f700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8498063bf0 con 0x7f8498143b40 2021-11-12T05:40:45.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f849dc0f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8498063e90 con 0x7f84980adaf0 2021-11-12T05:40:45.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f8496ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f84980aded0 0x7f8498064330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:45.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f8496ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f84980aded0 0x7f8498064330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43300/0 (socket says 172.21.2.105:43300) 2021-11-12T05:40:45.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f8496ffd700 1 -- 172.21.2.105:0/998867091 learned_addr learned my addr 172.21.2.105:0/998867091 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:45.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f8496ffd700 1 -- 172.21.2.105:0/998867091 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f84980adaf0 msgr2=0x7f84980ac220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:45.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f8496ffd700 1 --2- 172.21.2.105:0/998867091 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f84980adaf0 0x7f84980ac220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:45.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f8496ffd700 1 -- 172.21.2.105:0/998867091 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8498143b40 msgr2=0x7f84980aa6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:45.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f8496ffd700 1 --2- 172.21.2.105:0/998867091 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8498143b40 0x7f84980aa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:45.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f8496ffd700 1 -- 172.21.2.105:0/998867091 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849000b7d0 con 0x7f84980aded0 2021-11-12T05:40:45.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f8496ffd700 1 --2- 172.21.2.105:0/998867091 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f84980aded0 0x7f8498064330 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f8488000ed0 tx=0x7f8488006d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:45.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f8494ff9700 1 -- 172.21.2.105:0/998867091 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8488012410 con 0x7f84980aded0 2021-11-12T05:40:45.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f8494ff9700 1 -- 172.21.2.105:0/998867091 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8488012570 con 0x7f84980aded0 2021-11-12T05:40:45.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f849dc0f700 1 -- 172.21.2.105:0/998867091 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8498145fd0 con 0x7f84980aded0 2021-11-12T05:40:45.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f849dc0f700 1 -- 172.21.2.105:0/998867091 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84980ab3f0 con 0x7f84980aded0 2021-11-12T05:40:45.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f8494ff9700 1 -- 172.21.2.105:0/998867091 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84880128d0 con 0x7f84980aded0 2021-11-12T05:40:45.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.402+0000 7f849dc0f700 1 -- 172.21.2.105:0/998867091 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8498064050 con 0x7f84980aded0 2021-11-12T05:40:45.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.406+0000 7f8494ff9700 1 -- 172.21.2.105:0/998867091 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f848800f030 con 0x7f84980aded0 2021-11-12T05:40:45.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.406+0000 7f8494ff9700 1 --2- 172.21.2.105:0/998867091 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f847c053540 0x7f847c055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:45.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.406+0000 7f8494ff9700 1 -- 172.21.2.105:0/998867091 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f848806b790 con 0x7f84980aded0 2021-11-12T05:40:45.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.406+0000 7f84977fe700 1 --2- 172.21.2.105:0/998867091 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f847c053540 0x7f847c055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:45.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.406+0000 7f84977fe700 1 --2- 172.21.2.105:0/998867091 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f847c053540 0x7f847c055a00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f8480002fb0 tx=0x7f84800069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:45.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.406+0000 7f8494ff9700 1 -- 172.21.2.105:0/998867091 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8488042680 con 0x7f84980aded0 2021-11-12T05:40:45.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.514+0000 7f849dc0f700 1 -- 172.21.2.105:0/998867091 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84980afb00 con 0x7f84980aded0 2021-11-12T05:40:45.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.514+0000 7f8494ff9700 1 -- 172.21.2.105:0/998867091 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2134 (secure 0 0 0) 0x7f8488045ca0 con 0x7f84980aded0 2021-11-12T05:40:45.516 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:40:45.517 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4222,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/3123627686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":3123627686},{"type":"v1","addr":"172.21.2.115:6833","nonce":3123627686}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:40:37.198589+0000","modified":"2021-11-12T05:40:38.201943+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/2223420138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":2223420138},{"type":"v1","addr":"172.21.2.105:6835","nonce":2223420138}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-11-12T05:40:45.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.514+0000 7f849dc0f700 1 -- 172.21.2.105:0/998867091 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f847c053540 msgr2=0x7f847c055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:45.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.514+0000 7f849dc0f700 1 --2- 172.21.2.105:0/998867091 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f847c053540 0x7f847c055a00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f8480002fb0 tx=0x7f84800069b0).stop 2021-11-12T05:40:45.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.514+0000 7f849dc0f700 1 -- 172.21.2.105:0/998867091 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f84980aded0 msgr2=0x7f8498064330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:45.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.514+0000 7f849dc0f700 1 --2- 172.21.2.105:0/998867091 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f84980aded0 0x7f8498064330 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f8488000ed0 tx=0x7f8488006d70).stop 2021-11-12T05:40:45.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.514+0000 7f849dc0f700 1 -- 172.21.2.105:0/998867091 shutdown_connections 2021-11-12T05:40:45.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.514+0000 7f849dc0f700 1 --2- 172.21.2.105:0/998867091 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f847c053540 0x7f847c055a00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:45.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.514+0000 7f849dc0f700 1 --2- 172.21.2.105:0/998867091 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8498143b40 0x7f84980aa6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:45.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.514+0000 7f849dc0f700 1 --2- 172.21.2.105:0/998867091 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f84980aded0 0x7f8498064330 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:45.520 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.514+0000 7f849dc0f700 1 --2- 172.21.2.105:0/998867091 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f84980adaf0 0x7f84980ac220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:45.520 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.514+0000 7f849dc0f700 1 -- 172.21.2.105:0/998867091 >> 172.21.2.105:0/998867091 conn(0x7f849805c490 msgr2=0x7f84980b02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:45.520 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.514+0000 7f849dc0f700 1 -- 172.21.2.105:0/998867091 shutdown_connections 2021-11-12T05:40:45.521 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:45.514+0000 7f849dc0f700 1 -- 172.21.2.105:0/998867091 wait complete. 2021-11-12T05:40:45.521 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 5 2021-11-12T05:40:45.726 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:40:37.198589+0000', 'modified': '2021-11-12T05:40:38.201943+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4251}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4251': {'gid': 4251, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/2223420138', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 2223420138}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 2223420138}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:40:45.726 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:40:45.727 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:40:45.792 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":4251,"want_state":"up:active","state":"up:active","rank_uptime":8.5854522840000005,"mdsmap_epoch":5,"osdmap_epoch":25,"osdmap_epoch_barrier":24,"uptime":13.787857885999999} 2021-11-12T05:40:45.792 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 4251, "mdsmap_epoch": 5, "osdmap_epoch": 25, "osdmap_epoch_barrier": 24, "rank_uptime": 8.585452284, "state": "up:active", "uptime": 13.787857886, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:40:45.793 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-12T05:40:45.793 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-12T05:40:45.793 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba016.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-12T05:40:45.794 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:40:45.794 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:40:45.805 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:40:45.817 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:40:45.817 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:40:45.823 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:40:45.824 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:40:45.825 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:40:45.825 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:40:45.829 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-12T05:40:45.830 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:40:45.832 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:40:45.838 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:40:45.838 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:40:45.885 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:40:45.886 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:40:45.887 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:40:45.887 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:40:45.900 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:2021-11-12T05:40:45.908+0000 7fa429a64080 -1 init, newargv = 0x5606a807afe0 newargc=9 2021-11-12T05:40:45.901 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[13971]: starting ceph client 2021-11-12T05:40:45.913 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[13971]: starting fuse 2021-11-12T05:40:46.992 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:40:47.004 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:40:47.005 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:40:47.056 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:40:47.057 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:40:47.058 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:40:47.058 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:40:47.065 INFO:teuthology.orchestra.run.gibba016.stdout:52 2021-11-12T05:40:47.066 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-12T05:40:47.066 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:40:47.067 DEBUG:teuthology.orchestra.run.gibba016:> sudo python3 -c ' 2021-11-12T05:40:47.068 DEBUG:teuthology.orchestra.run.gibba016:> import glob 2021-11-12T05:40:47.069 DEBUG:teuthology.orchestra.run.gibba016:> import re 2021-11-12T05:40:47.069 DEBUG:teuthology.orchestra.run.gibba016:> import os 2021-11-12T05:40:47.070 DEBUG:teuthology.orchestra.run.gibba016:> import subprocess 2021-11-12T05:40:47.071 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:40:47.071 DEBUG:teuthology.orchestra.run.gibba016:> def find_socket(client_name): 2021-11-12T05:40:47.072 DEBUG:teuthology.orchestra.run.gibba016:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-12T05:40:47.073 DEBUG:teuthology.orchestra.run.gibba016:> files = glob.glob(asok_path) 2021-11-12T05:40:47.074 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:40:47.074 DEBUG:teuthology.orchestra.run.gibba016:> # Given a non-glob path, it better be there 2021-11-12T05:40:47.075 DEBUG:teuthology.orchestra.run.gibba016:> if "*" not in asok_path: 2021-11-12T05:40:47.076 DEBUG:teuthology.orchestra.run.gibba016:> assert(len(files) == 1) 2021-11-12T05:40:47.076 DEBUG:teuthology.orchestra.run.gibba016:> return files[0] 2021-11-12T05:40:47.077 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:40:47.078 DEBUG:teuthology.orchestra.run.gibba016:> for f in files: 2021-11-12T05:40:47.078 DEBUG:teuthology.orchestra.run.gibba016:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-12T05:40:47.079 DEBUG:teuthology.orchestra.run.gibba016:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-12T05:40:47.080 DEBUG:teuthology.orchestra.run.gibba016:> return f 2021-11-12T05:40:47.080 DEBUG:teuthology.orchestra.run.gibba016:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-12T05:40:47.081 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:40:47.081 DEBUG:teuthology.orchestra.run.gibba016:> print(find_socket("client.0")) 2021-11-12T05:40:47.082 DEBUG:teuthology.orchestra.run.gibba016:> ' 2021-11-12T05:40:47.117 INFO:teuthology.orchestra.run.gibba016.stdout:/var/run/ceph/ceph-client.0.13971.asok 2021-11-12T05:40:47.119 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13971.asok 2021-11-12T05:40:47.120 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:40:47.120 DEBUG:teuthology.orchestra.run.gibba016:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13971.asok status 2021-11-12T05:40:47.230 INFO:teuthology.orchestra.run.gibba016.stdout:{ 2021-11-12T05:40:47.231 INFO:teuthology.orchestra.run.gibba016.stdout: "metadata": { 2021-11-12T05:40:47.231 INFO:teuthology.orchestra.run.gibba016.stdout: "ceph_sha1": "a81ee2815de5acae59ead5b8c9137b6766fc8ea8", 2021-11-12T05:40:47.231 INFO:teuthology.orchestra.run.gibba016.stdout: "ceph_version": "ceph version 15.2.15-22-ga81ee281 (a81ee2815de5acae59ead5b8c9137b6766fc8ea8) octopus (stable)", 2021-11-12T05:40:47.232 INFO:teuthology.orchestra.run.gibba016.stdout: "entity_id": "0", 2021-11-12T05:40:47.232 INFO:teuthology.orchestra.run.gibba016.stdout: "hostname": "gibba016", 2021-11-12T05:40:47.232 INFO:teuthology.orchestra.run.gibba016.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-12T05:40:47.232 INFO:teuthology.orchestra.run.gibba016.stdout: "pid": "13971", 2021-11-12T05:40:47.232 INFO:teuthology.orchestra.run.gibba016.stdout: "root": "/" 2021-11-12T05:40:47.233 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:40:47.233 INFO:teuthology.orchestra.run.gibba016.stdout: "dentry_count": 0, 2021-11-12T05:40:47.233 INFO:teuthology.orchestra.run.gibba016.stdout: "dentry_pinned_count": 0, 2021-11-12T05:40:47.233 INFO:teuthology.orchestra.run.gibba016.stdout: "id": 4614, 2021-11-12T05:40:47.234 INFO:teuthology.orchestra.run.gibba016.stdout: "inst": { 2021-11-12T05:40:47.234 INFO:teuthology.orchestra.run.gibba016.stdout: "name": { 2021-11-12T05:40:47.234 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "client", 2021-11-12T05:40:47.234 INFO:teuthology.orchestra.run.gibba016.stdout: "num": 4614 2021-11-12T05:40:47.234 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:40:47.235 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": { 2021-11-12T05:40:47.235 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "v1", 2021-11-12T05:40:47.235 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": "172.21.2.116:0", 2021-11-12T05:40:47.235 INFO:teuthology.orchestra.run.gibba016.stdout: "nonce": 2367675859 2021-11-12T05:40:47.235 INFO:teuthology.orchestra.run.gibba016.stdout: } 2021-11-12T05:40:47.236 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:40:47.236 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": { 2021-11-12T05:40:47.236 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "v1", 2021-11-12T05:40:47.237 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": "172.21.2.116:0", 2021-11-12T05:40:47.237 INFO:teuthology.orchestra.run.gibba016.stdout: "nonce": 2367675859 2021-11-12T05:40:47.237 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:40:47.237 INFO:teuthology.orchestra.run.gibba016.stdout: "inst_str": "client.4614 172.21.2.116:0/2367675859", 2021-11-12T05:40:47.237 INFO:teuthology.orchestra.run.gibba016.stdout: "addr_str": "172.21.2.116:0/2367675859", 2021-11-12T05:40:47.238 INFO:teuthology.orchestra.run.gibba016.stdout: "inode_count": 1, 2021-11-12T05:40:47.238 INFO:teuthology.orchestra.run.gibba016.stdout: "mds_epoch": 5, 2021-11-12T05:40:47.238 INFO:teuthology.orchestra.run.gibba016.stdout: "osd_epoch": 25, 2021-11-12T05:40:47.238 INFO:teuthology.orchestra.run.gibba016.stdout: "osd_epoch_barrier": 0, 2021-11-12T05:40:47.239 INFO:teuthology.orchestra.run.gibba016.stdout: "blacklisted": false, 2021-11-12T05:40:47.239 INFO:teuthology.orchestra.run.gibba016.stdout: "fs_name": "cephfs" 2021-11-12T05:40:47.239 INFO:teuthology.orchestra.run.gibba016.stdout:} 2021-11-12T05:40:47.240 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:40:47.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd2927f700 1 Processor -- start 2021-11-12T05:40:47.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd2927f700 1 -- start start 2021-11-12T05:40:47.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd2927f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbd2414b2f0 0x7fbd240af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:47.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd2927f700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd240ac7b0 con 0x7fbd240ad080 2021-11-12T05:40:47.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd2927f700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd240ac9e0 con 0x7fbd240ac280 2021-11-12T05:40:47.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd2927f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd241488a0 con 0x7fbd2414b2f0 2021-11-12T05:40:47.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd22ffd700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fbd240ad080 0x7fbd2414abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:53704/0 (socket says 172.21.2.105:53704) 2021-11-12T05:40:47.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd22ffd700 1 -- 172.21.2.105:0/3824669740 learned_addr learned my addr 172.21.2.105:0/3824669740 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:47.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd21ffb700 1 -- 172.21.2.105:0/3824669740 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2398462853 0 0) 0x7fbd240ac7b0 con 0x7fbd240ad080 2021-11-12T05:40:47.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd21ffb700 1 -- 172.21.2.105:0/3824669740 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd08003260 con 0x7fbd240ad080 2021-11-12T05:40:47.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd237fe700 1 --2- 172.21.2.105:0/3824669740 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbd2414b2f0 0x7fbd240af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:47.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd21ffb700 1 -- 172.21.2.105:0/3824669740 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 216644930 0 0) 0x7fbd08003260 con 0x7fbd240ad080 2021-11-12T05:40:47.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd21ffb700 1 -- 172.21.2.105:0/3824669740 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbd2414b2f0 msgr2=0x7fbd240af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:47.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd21ffb700 1 --2- 172.21.2.105:0/3824669740 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbd2414b2f0 0x7fbd240af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:47.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd21ffb700 1 -- 172.21.2.105:0/3824669740 >> v1:172.21.2.115:6789/0 conn(0x7fbd240ac280 legacy=0x7fbd24147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:47.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd21ffb700 1 -- 172.21.2.105:0/3824669740 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd240b0b30 con 0x7fbd240ad080 2021-11-12T05:40:47.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd21ffb700 1 -- 172.21.2.105:0/3824669740 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fbd14001660 con 0x7fbd240ad080 2021-11-12T05:40:47.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd21ffb700 1 -- 172.21.2.105:0/3824669740 >> v1:172.21.2.105:6789/0 conn(0x7fbd240ad080 legacy=0x7fbd2414abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:47.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd21ffb700 1 --2- 172.21.2.105:0/3824669740 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbd08003800 0x7fbd08003c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:47.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd21ffb700 1 --2- 172.21.2.105:0/3824669740 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbd08004500 0x7fbd08004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:47.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd21ffb700 1 --2- 172.21.2.105:0/3824669740 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbd08005070 0x7fbd0800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:47.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd21ffb700 1 -- 172.21.2.105:0/3824669740 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd241488a0 con 0x7fbd08004500 2021-11-12T05:40:47.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd21ffb700 1 -- 172.21.2.105:0/3824669740 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0800bea0 con 0x7fbd08005070 2021-11-12T05:40:47.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd21ffb700 1 -- 172.21.2.105:0/3824669740 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0800c060 con 0x7fbd08003800 2021-11-12T05:40:47.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd237fe700 1 --2- 172.21.2.105:0/3824669740 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbd2414b2f0 0x7fbd240af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:40:47.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd227fc700 1 --2- 172.21.2.105:0/3824669740 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbd08004500 0x7fbd08004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:47.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd227fc700 1 -- 172.21.2.105:0/3824669740 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbd08003800 msgr2=0x7fbd08003c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:47.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd227fc700 1 --2- 172.21.2.105:0/3824669740 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbd08003800 0x7fbd08003c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:47.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd227fc700 1 -- 172.21.2.105:0/3824669740 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbd08005070 msgr2=0x7fbd0800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:47.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd227fc700 1 --2- 172.21.2.105:0/3824669740 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbd08005070 0x7fbd0800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:47.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd227fc700 1 -- 172.21.2.105:0/3824669740 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd08003260 con 0x7fbd08004500 2021-11-12T05:40:47.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd227fc700 1 --2- 172.21.2.105:0/3824669740 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbd08004500 0x7fbd08004980 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fbd18001fa0 tx=0x7fbd18007a00).ready entity=mon.0 client_cookie=3174962ef48e2c9d server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:47.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd21ffb700 1 -- 172.21.2.105:0/3824669740 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd18007070 con 0x7fbd08004500 2021-11-12T05:40:47.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd21ffb700 1 -- 172.21.2.105:0/3824669740 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd180071d0 con 0x7fbd08004500 2021-11-12T05:40:47.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd21ffb700 1 -- 172.21.2.105:0/3824669740 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd18006510 con 0x7fbd08004500 2021-11-12T05:40:47.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd2927f700 1 -- 172.21.2.105:0/3824669740 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbd08004500 msgr2=0x7fbd08004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:47.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd2927f700 1 --2- 172.21.2.105:0/3824669740 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbd08004500 0x7fbd08004980 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fbd18001fa0 tx=0x7fbd18007a00).stop 2021-11-12T05:40:47.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd237fe700 1 -- 172.21.2.105:0/3824669740 reap_dead start 2021-11-12T05:40:47.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd2927f700 1 -- 172.21.2.105:0/3824669740 shutdown_connections 2021-11-12T05:40:47.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd2927f700 1 -- 172.21.2.105:0/3824669740 >> 172.21.2.105:0/3824669740 conn(0x7fbd240b5370 msgr2=0x7fbd240b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:47.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd2927f700 1 -- 172.21.2.105:0/3824669740 shutdown_connections 2021-11-12T05:40:47.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.294+0000 7fbd2927f700 1 -- 172.21.2.105:0/3824669740 wait complete. 2021-11-12T05:40:47.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.298+0000 7fbd2927f700 1 Processor -- start 2021-11-12T05:40:47.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.298+0000 7fbd2927f700 1 -- start start 2021-11-12T05:40:47.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.298+0000 7fbd2927f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbd08004500 0x7fbd2414eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:47.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.298+0000 7fbd2927f700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbd24149e20 0x7fbd2415a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:47.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.298+0000 7fbd2927f700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbd2415a800 0x7fbd240a92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:47.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.298+0000 7fbd2927f700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2414b120 con 0x7fbd24149e20 2021-11-12T05:40:47.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.298+0000 7fbd2927f700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd24159f20 con 0x7fbd2415a800 2021-11-12T05:40:47.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.298+0000 7fbd2927f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd240a7bb0 con 0x7fbd08004500 2021-11-12T05:40:47.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.298+0000 7fbd227fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbd24149e20 0x7fbd2415a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:47.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.298+0000 7fbd227fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbd24149e20 0x7fbd2415a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43320/0 (socket says 172.21.2.105:43320) 2021-11-12T05:40:47.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.298+0000 7fbd227fc700 1 -- 172.21.2.105:0/2148584619 learned_addr learned my addr 172.21.2.105:0/2148584619 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:47.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.298+0000 7fbd227fc700 1 -- 172.21.2.105:0/2148584619 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbd08004500 msgr2=0x7fbd2414eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:47.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.298+0000 7fbd227fc700 1 --2- 172.21.2.105:0/2148584619 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbd08004500 0x7fbd2414eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:47.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.298+0000 7fbd227fc700 1 -- 172.21.2.105:0/2148584619 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbd2415a800 msgr2=0x7fbd240a92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:47.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.298+0000 7fbd227fc700 1 --2- 172.21.2.105:0/2148584619 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbd2415a800 0x7fbd240a92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:47.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.298+0000 7fbd227fc700 1 -- 172.21.2.105:0/2148584619 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2414ae80 con 0x7fbd24149e20 2021-11-12T05:40:47.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.298+0000 7fbd227fc700 1 --2- 172.21.2.105:0/2148584619 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbd24149e20 0x7fbd2415a310 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fbd18001fa0 tx=0x7fbd18015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:47.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.298+0000 7fbd13fff700 1 -- 172.21.2.105:0/2148584619 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd18014600 con 0x7fbd24149e20 2021-11-12T05:40:47.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.298+0000 7fbd13fff700 1 -- 172.21.2.105:0/2148584619 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd18014760 con 0x7fbd24149e20 2021-11-12T05:40:47.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.298+0000 7fbd13fff700 1 -- 172.21.2.105:0/2148584619 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd18014b00 con 0x7fbd24149e20 2021-11-12T05:40:47.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.298+0000 7fbd2927f700 1 -- 172.21.2.105:0/2148584619 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd24148f60 con 0x7fbd24149e20 2021-11-12T05:40:47.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.298+0000 7fbd2927f700 1 -- 172.21.2.105:0/2148584619 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd2415ae20 con 0x7fbd24149e20 2021-11-12T05:40:47.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.298+0000 7fbd2927f700 1 -- 172.21.2.105:0/2148584619 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd240a79f0 con 0x7fbd24149e20 2021-11-12T05:40:47.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.298+0000 7fbd13fff700 1 -- 172.21.2.105:0/2148584619 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbd1801d070 con 0x7fbd24149e20 2021-11-12T05:40:47.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.298+0000 7fbd13fff700 1 --2- 172.21.2.105:0/2148584619 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbd000536f0 0x7fbd00055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:47.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.298+0000 7fbd13fff700 1 -- 172.21.2.105:0/2148584619 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fbd1806c4e0 con 0x7fbd24149e20 2021-11-12T05:40:47.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.298+0000 7fbd22ffd700 1 --2- 172.21.2.105:0/2148584619 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbd000536f0 0x7fbd00055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:47.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.298+0000 7fbd22ffd700 1 --2- 172.21.2.105:0/2148584619 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbd000536f0 0x7fbd00055bb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fbd240b60a0 tx=0x7fbd14001620).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:47.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.302+0000 7fbd13fff700 1 -- 172.21.2.105:0/2148584619 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbd180433d0 con 0x7fbd24149e20 2021-11-12T05:40:47.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.386+0000 7fbd2927f700 1 -- 172.21.2.105:0/2148584619 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd2415ae20 con 0x7fbd24149e20 2021-11-12T05:40:47.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.386+0000 7fbd13fff700 1 -- 172.21.2.105:0/2148584619 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7fbd18030fc0 con 0x7fbd24149e20 2021-11-12T05:40:47.388 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:40:47.388 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":25,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:40:38.203083+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:40:32.786926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-12T05:40:35.006506+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:40:47.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.386+0000 7fbd2927f700 1 -- 172.21.2.105:0/2148584619 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbd000536f0 msgr2=0x7fbd00055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:47.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.386+0000 7fbd2927f700 1 --2- 172.21.2.105:0/2148584619 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbd000536f0 0x7fbd00055bb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fbd240b60a0 tx=0x7fbd14001620).stop 2021-11-12T05:40:47.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.386+0000 7fbd2927f700 1 -- 172.21.2.105:0/2148584619 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbd24149e20 msgr2=0x7fbd2415a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:47.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.386+0000 7fbd2927f700 1 --2- 172.21.2.105:0/2148584619 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbd24149e20 0x7fbd2415a310 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fbd18001fa0 tx=0x7fbd18015000).stop 2021-11-12T05:40:47.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.386+0000 7fbd2927f700 1 -- 172.21.2.105:0/2148584619 shutdown_connections 2021-11-12T05:40:47.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.386+0000 7fbd2927f700 1 --2- 172.21.2.105:0/2148584619 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbd000536f0 0x7fbd00055bb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:47.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.386+0000 7fbd2927f700 1 --2- 172.21.2.105:0/2148584619 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbd2415a800 0x7fbd240a92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:47.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.386+0000 7fbd2927f700 1 --2- 172.21.2.105:0/2148584619 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbd24149e20 0x7fbd2415a310 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:47.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.386+0000 7fbd2927f700 1 --2- 172.21.2.105:0/2148584619 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbd08004500 0x7fbd2414eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:47.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.386+0000 7fbd2927f700 1 -- 172.21.2.105:0/2148584619 >> 172.21.2.105:0/2148584619 conn(0x7fbd240b5370 msgr2=0x7fbd240b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:47.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.386+0000 7fbd2927f700 1 -- 172.21.2.105:0/2148584619 shutdown_connections 2021-11-12T05:40:47.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.386+0000 7fbd2927f700 1 -- 172.21.2.105:0/2148584619 wait complete. 2021-11-12T05:40:47.395 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-12T05:40:32.786926+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-11-12T05:40:35.006506+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-12T05:40:47.396 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:40:47.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.446+0000 7f45aad34700 1 Processor -- start 2021-11-12T05:40:47.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.446+0000 7f45aad34700 1 -- start start 2021-11-12T05:40:47.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.446+0000 7f45aad34700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f45a40b2e20 0x7f45a40b1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:47.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.446+0000 7f45aad34700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f45a413ea50 0x7f45a413ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:47.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.446+0000 7f45aad34700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a40ad400 con 0x7f45a405f6b0 2021-11-12T05:40:47.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.446+0000 7f45aad34700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a40b3200 con 0x7f45a40b2e20 2021-11-12T05:40:47.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.446+0000 7f45aad34700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a40ad660 con 0x7f45a413ea50 2021-11-12T05:40:47.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.446+0000 7f45a3fff700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f45a413ea50 0x7f45a413ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:47.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.446+0000 7f45a8ad0700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f45a40b2e20 0x7f45a40b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:47.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.446+0000 7f45a8ad0700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f45a40b2e20 0x7f45a40b1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3300/0 says I am v2:172.21.2.105:60502/0 (socket says 172.21.2.105:60502) 2021-11-12T05:40:47.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.446+0000 7f45a3fff700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f45a413ea50 0x7f45a413ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3301/0 says I am v2:172.21.2.105:34522/0 (socket says 172.21.2.105:34522) 2021-11-12T05:40:47.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.446+0000 7f45a8ad0700 1 -- 172.21.2.105:0/2509723787 learned_addr learned my addr 172.21.2.105:0/2509723787 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:47.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.446+0000 7f45a92d1700 1 --1- 172.21.2.105:0/2509723787 >> v1:172.21.2.115:6789/0 conn(0x7f45a405f6b0 0x7f45a405fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:52192/0 (socket says 172.21.2.105:52192) 2021-11-12T05:40:47.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.446+0000 7f45a3fff700 1 -- 172.21.2.105:0/2509723787 >> v2:172.21.2.115:3300/0 conn(0x7f45a40b2e20 msgr2=0x7f45a40b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:47.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.446+0000 7f45a3fff700 1 --2- 172.21.2.105:0/2509723787 >> v2:172.21.2.115:3300/0 conn(0x7f45a40b2e20 0x7f45a40b1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:47.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.446+0000 7f45a3fff700 1 -- 172.21.2.105:0/2509723787 >> v1:172.21.2.115:6789/0 conn(0x7f45a405f6b0 legacy=0x7f45a405fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:47.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.446+0000 7f45a3fff700 1 -- 172.21.2.105:0/2509723787 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a40ad900 con 0x7f45a413ea50 2021-11-12T05:40:47.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.446+0000 7f45a8ad0700 1 --2- 172.21.2.105:0/2509723787 >> v2:172.21.2.115:3300/0 conn(0x7f45a40b2e20 0x7f45a40b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-12T05:40:47.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.446+0000 7f45a3fff700 1 --2- 172.21.2.105:0/2509723787 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f45a413ea50 0x7f45a413ee90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f4594002f70 tx=0x7f4594006df0).ready entity=mon.2 client_cookie=1e0ab1eba82392b0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:47.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.450+0000 7f45a37fe700 1 -- 172.21.2.105:0/2509723787 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f459400d570 con 0x7f45a413ea50 2021-11-12T05:40:47.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.450+0000 7f45a37fe700 1 -- 172.21.2.105:0/2509723787 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4594000e90 con 0x7f45a413ea50 2021-11-12T05:40:47.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.450+0000 7f45a37fe700 1 -- 172.21.2.105:0/2509723787 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f459400d8c0 con 0x7f45a413ea50 2021-11-12T05:40:47.458 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.450+0000 7f45aad34700 1 -- 172.21.2.105:0/2509723787 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f45a413ea50 msgr2=0x7f45a413ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:47.458 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.450+0000 7f45aad34700 1 --2- 172.21.2.105:0/2509723787 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f45a413ea50 0x7f45a413ee90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f4594002f70 tx=0x7f4594006df0).stop 2021-11-12T05:40:47.458 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.450+0000 7f45aad34700 1 -- 172.21.2.105:0/2509723787 shutdown_connections 2021-11-12T05:40:47.458 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.450+0000 7f45aad34700 1 --2- 172.21.2.105:0/2509723787 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f45a413ea50 0x7f45a413ee90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:47.458 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.450+0000 7f45aad34700 1 --2- 172.21.2.105:0/2509723787 >> v2:172.21.2.115:3300/0 conn(0x7f45a40b2e20 0x7f45a40b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:47.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.450+0000 7f45aad34700 1 -- 172.21.2.105:0/2509723787 >> 172.21.2.105:0/2509723787 conn(0x7f45a4062f60 msgr2=0x7f45a4063370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:47.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.450+0000 7f45aad34700 1 -- 172.21.2.105:0/2509723787 shutdown_connections 2021-11-12T05:40:47.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.450+0000 7f45aad34700 1 -- 172.21.2.105:0/2509723787 wait complete. 2021-11-12T05:40:47.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.450+0000 7f45aad34700 1 Processor -- start 2021-11-12T05:40:47.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.450+0000 7f45aad34700 1 -- start start 2021-11-12T05:40:47.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.450+0000 7f45aad34700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f45a405f6b0 0x7f45a4142be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:47.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.450+0000 7f45aad34700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f45a40b2e20 0x7f45a40abba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:47.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.450+0000 7f45aad34700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f45a413ea50 0x7f45a40ac090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:47.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.450+0000 7f45aad34700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a4142690 con 0x7f45a413ea50 2021-11-12T05:40:47.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.450+0000 7f45aad34700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a4141d40 con 0x7f45a405f6b0 2021-11-12T05:40:47.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.450+0000 7f45aad34700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a41430d0 con 0x7f45a40b2e20 2021-11-12T05:40:47.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.450+0000 7f45a92d1700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f45a413ea50 0x7f45a40ac090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:47.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.450+0000 7f45a92d1700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f45a413ea50 0x7f45a40ac090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43338/0 (socket says 172.21.2.105:43338) 2021-11-12T05:40:47.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.450+0000 7f45a92d1700 1 -- 172.21.2.105:0/1399797205 learned_addr learned my addr 172.21.2.105:0/1399797205 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:47.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.450+0000 7f45a3fff700 1 --2- 172.21.2.105:0/1399797205 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f45a40b2e20 0x7f45a40abba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:47.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.450+0000 7f45a8ad0700 1 --2- 172.21.2.105:0/1399797205 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f45a405f6b0 0x7f45a4142be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:47.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.450+0000 7f45a92d1700 1 -- 172.21.2.105:0/1399797205 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f45a40b2e20 msgr2=0x7f45a40abba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:47.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.450+0000 7f45a92d1700 1 --2- 172.21.2.105:0/1399797205 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f45a40b2e20 0x7f45a40abba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:47.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.450+0000 7f45a92d1700 1 -- 172.21.2.105:0/1399797205 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f45a405f6b0 msgr2=0x7f45a4142be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:47.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.450+0000 7f45a92d1700 1 --2- 172.21.2.105:0/1399797205 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f45a405f6b0 0x7f45a4142be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:47.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.450+0000 7f45a92d1700 1 -- 172.21.2.105:0/1399797205 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459800d4d0 con 0x7f45a413ea50 2021-11-12T05:40:47.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.450+0000 7f45a92d1700 1 --2- 172.21.2.105:0/1399797205 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f45a413ea50 0x7f45a40ac090 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f45a40b25f0 tx=0x7f459c007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:47.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.450+0000 7f45a1ffb700 1 -- 172.21.2.105:0/1399797205 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f459c005ae0 con 0x7f45a413ea50 2021-11-12T05:40:47.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.450+0000 7f45a1ffb700 1 -- 172.21.2.105:0/1399797205 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459c005c40 con 0x7f45a413ea50 2021-11-12T05:40:47.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.450+0000 7f45aad34700 1 -- 172.21.2.105:0/1399797205 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f459400b180 con 0x7f45a413ea50 2021-11-12T05:40:47.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.450+0000 7f45a1ffb700 1 -- 172.21.2.105:0/1399797205 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f459c0070d0 con 0x7f45a413ea50 2021-11-12T05:40:47.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.450+0000 7f45aad34700 1 -- 172.21.2.105:0/1399797205 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a40ac720 con 0x7f45a413ea50 2021-11-12T05:40:47.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.450+0000 7f45aad34700 1 -- 172.21.2.105:0/1399797205 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a4141f00 con 0x7f45a413ea50 2021-11-12T05:40:47.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.450+0000 7f45a1ffb700 1 -- 172.21.2.105:0/1399797205 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f459c010070 con 0x7f45a413ea50 2021-11-12T05:40:47.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.454+0000 7f45a1ffb700 1 --2- 172.21.2.105:0/1399797205 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4584053610 0x7f4584055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:47.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.454+0000 7f45a1ffb700 1 -- 172.21.2.105:0/1399797205 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f459c06b1f0 con 0x7f45a413ea50 2021-11-12T05:40:47.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.454+0000 7f45a8ad0700 1 --2- 172.21.2.105:0/1399797205 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4584053610 0x7f4584055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:47.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.454+0000 7f45a8ad0700 1 --2- 172.21.2.105:0/1399797205 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4584053610 0x7f4584055ad0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f4598008000 tx=0x7f459800f040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:47.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.454+0000 7f45a1ffb700 1 -- 172.21.2.105:0/1399797205 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f459c0421f0 con 0x7f45a413ea50 2021-11-12T05:40:47.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.538+0000 7f45aad34700 1 -- 172.21.2.105:0/1399797205 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f45a40ac720 con 0x7f45a413ea50 2021-11-12T05:40:47.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.538+0000 7f45a1ffb700 1 -- 172.21.2.105:0/1399797205 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7f45a40ac720 con 0x7f45a413ea50 2021-11-12T05:40:47.541 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:40:47.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.538+0000 7f45aad34700 1 -- 172.21.2.105:0/1399797205 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4584053610 msgr2=0x7f4584055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:47.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.538+0000 7f45aad34700 1 --2- 172.21.2.105:0/1399797205 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4584053610 0x7f4584055ad0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f4598008000 tx=0x7f459800f040).stop 2021-11-12T05:40:47.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.538+0000 7f45aad34700 1 -- 172.21.2.105:0/1399797205 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f45a413ea50 msgr2=0x7f45a40ac090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:47.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.538+0000 7f45aad34700 1 --2- 172.21.2.105:0/1399797205 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f45a413ea50 0x7f45a40ac090 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f45a40b25f0 tx=0x7f459c007f40).stop 2021-11-12T05:40:47.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.538+0000 7f45aad34700 1 -- 172.21.2.105:0/1399797205 shutdown_connections 2021-11-12T05:40:47.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.538+0000 7f45aad34700 1 --2- 172.21.2.105:0/1399797205 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4584053610 0x7f4584055ad0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:47.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.538+0000 7f45aad34700 1 --2- 172.21.2.105:0/1399797205 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f45a413ea50 0x7f45a40ac090 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:47.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.538+0000 7f45aad34700 1 --2- 172.21.2.105:0/1399797205 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f45a40b2e20 0x7f45a40abba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:47.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.538+0000 7f45aad34700 1 --2- 172.21.2.105:0/1399797205 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f45a405f6b0 0x7f45a4142be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:47.545 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.538+0000 7f45aad34700 1 -- 172.21.2.105:0/1399797205 >> 172.21.2.105:0/1399797205 conn(0x7f45a4062f60 msgr2=0x7f45a405bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:47.545 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.538+0000 7f45aad34700 1 -- 172.21.2.105:0/1399797205 shutdown_connections 2021-11-12T05:40:47.545 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.538+0000 7f45aad34700 1 -- 172.21.2.105:0/1399797205 wait complete. 2021-11-12T05:40:47.548 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:40:47.634 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.630+0000 7f852fae9700 1 Processor -- start 2021-11-12T05:40:47.634 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.630+0000 7f852fae9700 1 -- start start 2021-11-12T05:40:47.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.630+0000 7f852fae9700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f85280aca40 0x7f85280ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:47.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.630+0000 7f852fae9700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f85280b0520 0x7f85281473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:47.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.630+0000 7f852fae9700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85280b1840 con 0x7f85281478b0 2021-11-12T05:40:47.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.630+0000 7f852fae9700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8528147d40 con 0x7f85280aca40 2021-11-12T05:40:47.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.630+0000 7f852fae9700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85280af2b0 con 0x7f85280b0520 2021-11-12T05:40:47.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.630+0000 7f852e086700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f85281478b0 0x7f8528144180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:53740/0 (socket says 172.21.2.105:53740) 2021-11-12T05:40:47.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.630+0000 7f852e086700 1 -- 172.21.2.105:0/2305182006 learned_addr learned my addr 172.21.2.105:0/2305182006 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:47.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.630+0000 7f852c883700 1 -- 172.21.2.105:0/2305182006 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3934878488 0 0) 0x7f85280b1840 con 0x7f85281478b0 2021-11-12T05:40:47.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.630+0000 7f852c883700 1 -- 172.21.2.105:0/2305182006 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8510003260 con 0x7f85281478b0 2021-11-12T05:40:47.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852c883700 1 -- 172.21.2.105:0/2305182006 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2700908203 0 0) 0x7f8510003260 con 0x7f85281478b0 2021-11-12T05:40:47.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852c883700 1 -- 172.21.2.105:0/2305182006 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f85280b0520 msgr2=0x7f85281473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:47.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852c883700 1 --2- 172.21.2.105:0/2305182006 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f85280b0520 0x7f85281473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:47.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852c883700 1 -- 172.21.2.105:0/2305182006 >> v2:172.21.2.115:3300/0 conn(0x7f85280aca40 msgr2=0x7f85280ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:47.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852c883700 1 --2- 172.21.2.105:0/2305182006 >> v2:172.21.2.115:3300/0 conn(0x7f85280aca40 0x7f85280ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:47.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852c883700 1 -- 172.21.2.105:0/2305182006 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85280b09a0 con 0x7f85281478b0 2021-11-12T05:40:47.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852c883700 1 -- 172.21.2.105:0/2305182006 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f85200019e0 con 0x7f85281478b0 2021-11-12T05:40:47.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852c883700 1 -- 172.21.2.105:0/2305182006 >> v1:172.21.2.105:6789/0 conn(0x7f85281478b0 legacy=0x7f8528144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:47.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852c883700 1 --2- 172.21.2.105:0/2305182006 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85100037d0 0x7f8510003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:47.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852c883700 1 --2- 172.21.2.105:0/2305182006 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8510004500 0x7f8510004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:47.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852c883700 1 --2- 172.21.2.105:0/2305182006 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f85280b0520 0x7f851000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:47.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852c883700 1 -- 172.21.2.105:0/2305182006 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8528147d40 con 0x7f85100037d0 2021-11-12T05:40:47.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852c883700 1 -- 172.21.2.105:0/2305182006 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85280af2b0 con 0x7f8510004500 2021-11-12T05:40:47.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852c883700 1 -- 172.21.2.105:0/2305182006 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8510005360 con 0x7f85280b0520 2021-11-12T05:40:47.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852d885700 1 --2- 172.21.2.105:0/2305182006 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85100037d0 0x7f8510003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:47.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852d084700 1 --2- 172.21.2.105:0/2305182006 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8510004500 0x7f8510004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:47.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852e086700 1 --2- 172.21.2.105:0/2305182006 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f85280b0520 0x7f851000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:47.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852d885700 1 -- 172.21.2.105:0/2305182006 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f85280b0520 msgr2=0x7f851000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:47.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852d885700 1 --2- 172.21.2.105:0/2305182006 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f85280b0520 0x7f851000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:47.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852d885700 1 -- 172.21.2.105:0/2305182006 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8510004500 msgr2=0x7f8510004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:47.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852d885700 1 --2- 172.21.2.105:0/2305182006 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8510004500 0x7f8510004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:47.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852d885700 1 -- 172.21.2.105:0/2305182006 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85280b09a0 con 0x7f85100037d0 2021-11-12T05:40:47.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852e086700 1 --2- 172.21.2.105:0/2305182006 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f85280b0520 0x7f851000b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:40:47.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852d885700 1 --2- 172.21.2.105:0/2305182006 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85100037d0 0x7f8510003bf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f851c002f70 tx=0x7f851c006ca0).ready entity=mon.0 client_cookie=5dff860b6d7608d7 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:47.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852c883700 1 -- 172.21.2.105:0/2305182006 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f851c012410 con 0x7f85100037d0 2021-11-12T05:40:47.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852c883700 1 -- 172.21.2.105:0/2305182006 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851c012570 con 0x7f85100037d0 2021-11-12T05:40:47.650 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852c883700 1 -- 172.21.2.105:0/2305182006 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f851c0128d0 con 0x7f85100037d0 2021-11-12T05:40:47.650 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852fae9700 1 -- 172.21.2.105:0/2305182006 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85100037d0 msgr2=0x7f8510003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:47.650 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852fae9700 1 --2- 172.21.2.105:0/2305182006 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85100037d0 0x7f8510003bf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f851c002f70 tx=0x7f851c006ca0).stop 2021-11-12T05:40:47.650 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852e086700 1 -- 172.21.2.105:0/2305182006 reap_dead start 2021-11-12T05:40:47.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852fae9700 1 -- 172.21.2.105:0/2305182006 shutdown_connections 2021-11-12T05:40:47.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852fae9700 1 -- 172.21.2.105:0/2305182006 >> 172.21.2.105:0/2305182006 conn(0x7f852805c490 msgr2=0x7f85280b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:47.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852fae9700 1 -- 172.21.2.105:0/2305182006 shutdown_connections 2021-11-12T05:40:47.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852fae9700 1 -- 172.21.2.105:0/2305182006 wait complete. 2021-11-12T05:40:47.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852fae9700 1 Processor -- start 2021-11-12T05:40:47.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852fae9700 1 -- start start 2021-11-12T05:40:47.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852fae9700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85100037d0 0x7f85280631c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:47.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852fae9700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8528063780 0x7f85280b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:47.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852fae9700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8528065c30 0x7f85280660b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:47.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852fae9700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8528062500 con 0x7f85100037d0 2021-11-12T05:40:47.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852fae9700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8528062760 con 0x7f8528065c30 2021-11-12T05:40:47.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852fae9700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8528066fe0 con 0x7f8528063780 2021-11-12T05:40:47.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852d885700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85100037d0 0x7f85280631c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:47.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852d885700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85100037d0 0x7f85280631c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43356/0 (socket says 172.21.2.105:43356) 2021-11-12T05:40:47.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852d885700 1 -- 172.21.2.105:0/447584742 learned_addr learned my addr 172.21.2.105:0/447584742 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:47.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852d885700 1 -- 172.21.2.105:0/447584742 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8528063780 msgr2=0x7f85280b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:47.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852d885700 1 --2- 172.21.2.105:0/447584742 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8528063780 0x7f85280b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:47.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852d885700 1 -- 172.21.2.105:0/447584742 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8528065c30 msgr2=0x7f85280660b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:47.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852d885700 1 --2- 172.21.2.105:0/447584742 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8528065c30 0x7f85280660b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:47.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852d885700 1 -- 172.21.2.105:0/447584742 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85280672b0 con 0x7f85100037d0 2021-11-12T05:40:47.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852d885700 1 --2- 172.21.2.105:0/447584742 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85100037d0 0x7f85280631c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f851c002f70 tx=0x7f851c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:47.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f851affd700 1 -- 172.21.2.105:0/447584742 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f851c012410 con 0x7f85100037d0 2021-11-12T05:40:47.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f851affd700 1 -- 172.21.2.105:0/447584742 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851c011e40 con 0x7f85100037d0 2021-11-12T05:40:47.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f851affd700 1 -- 172.21.2.105:0/447584742 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f851c01d610 con 0x7f85100037d0 2021-11-12T05:40:47.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852fae9700 1 -- 172.21.2.105:0/447584742 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85280665a0 con 0x7f85100037d0 2021-11-12T05:40:47.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.634+0000 7f852fae9700 1 -- 172.21.2.105:0/447584742 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85280647c0 con 0x7f85100037d0 2021-11-12T05:40:47.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.638+0000 7f852fae9700 1 -- 172.21.2.105:0/447584742 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8528057350 con 0x7f85100037d0 2021-11-12T05:40:47.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.638+0000 7f851affd700 1 -- 172.21.2.105:0/447584742 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f851c00f030 con 0x7f85100037d0 2021-11-12T05:40:47.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.638+0000 7f851affd700 1 --2- 172.21.2.105:0/447584742 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f85080536a0 0x7f8508055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:47.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.638+0000 7f851affd700 1 -- 172.21.2.105:0/447584742 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f851c06c810 con 0x7f85100037d0 2021-11-12T05:40:47.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.638+0000 7f852d084700 1 --2- 172.21.2.105:0/447584742 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f85080536a0 0x7f8508055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:47.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.638+0000 7f852d084700 1 --2- 172.21.2.105:0/447584742 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f85080536a0 0x7f8508055b60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f852400a000 tx=0x7f8524008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:47.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.638+0000 7f851affd700 1 -- 172.21.2.105:0/447584742 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f851c0438c0 con 0x7f85100037d0 2021-11-12T05:40:47.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.722+0000 7f852fae9700 1 -- 172.21.2.105:0/447584742 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f852805f280 con 0x7f85100037d0 2021-11-12T05:40:47.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.722+0000 7f851affd700 1 -- 172.21.2.105:0/447584742 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f851c022070 con 0x7f85100037d0 2021-11-12T05:40:47.726 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:40:47.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.722+0000 7f852fae9700 1 -- 172.21.2.105:0/447584742 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f85080536a0 msgr2=0x7f8508055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:47.728 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.722+0000 7f852fae9700 1 --2- 172.21.2.105:0/447584742 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f85080536a0 0x7f8508055b60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f852400a000 tx=0x7f8524008040).stop 2021-11-12T05:40:47.728 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.722+0000 7f852fae9700 1 -- 172.21.2.105:0/447584742 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85100037d0 msgr2=0x7f85280631c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:47.728 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.722+0000 7f852fae9700 1 --2- 172.21.2.105:0/447584742 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85100037d0 0x7f85280631c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f851c002f70 tx=0x7f851c015000).stop 2021-11-12T05:40:47.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.722+0000 7f852fae9700 1 -- 172.21.2.105:0/447584742 shutdown_connections 2021-11-12T05:40:47.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.722+0000 7f852fae9700 1 --2- 172.21.2.105:0/447584742 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f85080536a0 0x7f8508055b60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:47.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.722+0000 7f852fae9700 1 --2- 172.21.2.105:0/447584742 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8528065c30 0x7f85280660b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:47.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.722+0000 7f852fae9700 1 --2- 172.21.2.105:0/447584742 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8528063780 0x7f85280b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:47.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.722+0000 7f852fae9700 1 --2- 172.21.2.105:0/447584742 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85100037d0 0x7f85280631c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:47.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.722+0000 7f852fae9700 1 -- 172.21.2.105:0/447584742 >> 172.21.2.105:0/447584742 conn(0x7f852805c490 msgr2=0x7f852814ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:47.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.722+0000 7f852fae9700 1 -- 172.21.2.105:0/447584742 shutdown_connections 2021-11-12T05:40:47.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.722+0000 7f852fae9700 1 -- 172.21.2.105:0/447584742 wait complete. 2021-11-12T05:40:47.732 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-12T05:40:47.784 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.782+0000 7fd53a353700 1 Processor -- start 2021-11-12T05:40:47.785 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.782+0000 7fd53a353700 1 -- start start 2021-11-12T05:40:47.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.782+0000 7fd53a353700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd534141c10 0x7fd53414b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:47.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.782+0000 7fd53a353700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5340b26e0 con 0x7fd534060100 2021-11-12T05:40:47.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.782+0000 7fd53a353700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5340604e0 con 0x7fd5340b37d0 2021-11-12T05:40:47.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.782+0000 7fd53a353700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd534145160 con 0x7fd534141c10 2021-11-12T05:40:47.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.782+0000 7fd533fff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fd534060100 0x7fd5340b1fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:53758/0 (socket says 172.21.2.105:53758) 2021-11-12T05:40:47.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.782+0000 7fd533fff700 1 -- 172.21.2.105:0/4145420484 learned_addr learned my addr 172.21.2.105:0/4145420484 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:47.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.782+0000 7fd532ffd700 1 -- 172.21.2.105:0/4145420484 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3600432265 0 0) 0x7fd5340b26e0 con 0x7fd534060100 2021-11-12T05:40:47.798 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.782+0000 7fd532ffd700 1 -- 172.21.2.105:0/4145420484 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd514003260 con 0x7fd534060100 2021-11-12T05:40:47.798 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.782+0000 7fd532ffd700 1 -- 172.21.2.105:0/4145420484 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2344599356 0 0) 0x7fd514003260 con 0x7fd534060100 2021-11-12T05:40:47.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.782+0000 7fd532ffd700 1 -- 172.21.2.105:0/4145420484 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd534141c10 msgr2=0x7fd53414b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:47.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.782+0000 7fd532ffd700 1 --2- 172.21.2.105:0/4145420484 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd534141c10 0x7fd53414b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:47.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.782+0000 7fd532ffd700 1 -- 172.21.2.105:0/4145420484 >> v1:172.21.2.115:6789/0 conn(0x7fd5340b37d0 legacy=0x7fd534141500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:47.800 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.782+0000 7fd532ffd700 1 -- 172.21.2.105:0/4145420484 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd534141060 con 0x7fd534060100 2021-11-12T05:40:47.800 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.782+0000 7fd532ffd700 1 -- 172.21.2.105:0/4145420484 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fd524001660 con 0x7fd534060100 2021-11-12T05:40:47.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.782+0000 7fd532ffd700 1 -- 172.21.2.105:0/4145420484 >> v1:172.21.2.105:6789/0 conn(0x7fd534060100 legacy=0x7fd5340b1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:47.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.782+0000 7fd532ffd700 1 --2- 172.21.2.105:0/4145420484 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd514003800 0x7fd514003c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:47.802 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.782+0000 7fd532ffd700 1 --2- 172.21.2.105:0/4145420484 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd534141c10 0x7fd514004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:47.802 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.782+0000 7fd532ffd700 1 --2- 172.21.2.105:0/4145420484 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd514004bf0 0x7fd51400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:47.802 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.782+0000 7fd532ffd700 1 -- 172.21.2.105:0/4145420484 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd534145160 con 0x7fd514003800 2021-11-12T05:40:47.803 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.782+0000 7fd532ffd700 1 -- 172.21.2.105:0/4145420484 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd514005280 con 0x7fd514004bf0 2021-11-12T05:40:47.803 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.782+0000 7fd532ffd700 1 -- 172.21.2.105:0/4145420484 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51400bc40 con 0x7fd534141c10 2021-11-12T05:40:47.804 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.782+0000 7fd533fff700 1 --2- 172.21.2.105:0/4145420484 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd514003800 0x7fd514003c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:47.804 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.782+0000 7fd533fff700 1 -- 172.21.2.105:0/4145420484 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd534141c10 msgr2=0x7fd514004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:47.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.782+0000 7fd533fff700 1 --2- 172.21.2.105:0/4145420484 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd534141c10 0x7fd514004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:47.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.782+0000 7fd533fff700 1 -- 172.21.2.105:0/4145420484 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd514004bf0 msgr2=0x7fd51400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:47.806 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.782+0000 7fd533fff700 1 --2- 172.21.2.105:0/4145420484 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd514004bf0 0x7fd51400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:47.806 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.782+0000 7fd533fff700 1 -- 172.21.2.105:0/4145420484 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd534141060 con 0x7fd514003800 2021-11-12T05:40:47.806 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.782+0000 7fd533fff700 1 --2- 172.21.2.105:0/4145420484 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd514003800 0x7fd514003c00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fd524001020 tx=0x7fd524001e20).ready entity=mon.0 client_cookie=ad38db702abc7d3f server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:47.807 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.782+0000 7fd532ffd700 1 -- 172.21.2.105:0/4145420484 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5240070d0 con 0x7fd514003800 2021-11-12T05:40:47.807 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.782+0000 7fd532ffd700 1 -- 172.21.2.105:0/4145420484 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd524007230 con 0x7fd514003800 2021-11-12T05:40:47.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.782+0000 7fd532ffd700 1 -- 172.21.2.105:0/4145420484 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd52400c9c0 con 0x7fd514003800 2021-11-12T05:40:47.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.786+0000 7fd53a353700 1 -- 172.21.2.105:0/4145420484 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd514003800 msgr2=0x7fd514003c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:47.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.786+0000 7fd53a353700 1 --2- 172.21.2.105:0/4145420484 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd514003800 0x7fd514003c00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fd524001020 tx=0x7fd524001e20).stop 2021-11-12T05:40:47.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.786+0000 7fd5388f0700 1 -- 172.21.2.105:0/4145420484 reap_dead start 2021-11-12T05:40:47.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.786+0000 7fd53a353700 1 -- 172.21.2.105:0/4145420484 shutdown_connections 2021-11-12T05:40:47.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.786+0000 7fd53a353700 1 -- 172.21.2.105:0/4145420484 >> 172.21.2.105:0/4145420484 conn(0x7fd5340608d0 msgr2=0x7fd53405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:47.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.786+0000 7fd53a353700 1 -- 172.21.2.105:0/4145420484 shutdown_connections 2021-11-12T05:40:47.811 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.786+0000 7fd53a353700 1 -- 172.21.2.105:0/4145420484 wait complete. 2021-11-12T05:40:47.811 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.786+0000 7fd53a353700 1 Processor -- start 2021-11-12T05:40:47.812 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.786+0000 7fd53a353700 1 -- start start 2021-11-12T05:40:47.812 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.786+0000 7fd53a353700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd514003800 0x7fd534140700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:47.813 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.786+0000 7fd53a353700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd534065690 0x7fd534065b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:47.813 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.786+0000 7fd53a353700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd5340b0790 0x7fd5340b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:47.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.786+0000 7fd53a353700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5340ae700 con 0x7fd514003800 2021-11-12T05:40:47.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.786+0000 7fd53a353700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd534066e00 con 0x7fd534065690 2021-11-12T05:40:47.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.786+0000 7fd53a353700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5340b1100 con 0x7fd5340b0790 2021-11-12T05:40:47.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.786+0000 7fd533fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd514003800 0x7fd534140700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:47.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.786+0000 7fd533fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd514003800 0x7fd534140700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43374/0 (socket says 172.21.2.105:43374) 2021-11-12T05:40:47.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.786+0000 7fd533fff700 1 -- 172.21.2.105:0/814855625 learned_addr learned my addr 172.21.2.105:0/814855625 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:47.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.786+0000 7fd533fff700 1 -- 172.21.2.105:0/814855625 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd5340b0790 msgr2=0x7fd5340b0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:47.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.786+0000 7fd533fff700 1 --2- 172.21.2.105:0/814855625 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd5340b0790 0x7fd5340b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:47.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.786+0000 7fd533fff700 1 -- 172.21.2.105:0/814855625 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd534065690 msgr2=0x7fd534065b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:47.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.786+0000 7fd5337fe700 1 --2- 172.21.2.105:0/814855625 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd534065690 0x7fd534065b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:47.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.786+0000 7fd533fff700 1 --2- 172.21.2.105:0/814855625 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd534065690 0x7fd534065b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:47.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.786+0000 7fd533fff700 1 -- 172.21.2.105:0/814855625 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5340b0340 con 0x7fd514003800 2021-11-12T05:40:47.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.786+0000 7fd5337fe700 1 --2- 172.21.2.105:0/814855625 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd534065690 0x7fd534065b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:40:47.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.786+0000 7fd533fff700 1 --2- 172.21.2.105:0/814855625 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd514003800 0x7fd534140700 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fd53412a7a0 tx=0x7fd524015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:47.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.786+0000 7fd5317fa700 1 -- 172.21.2.105:0/814855625 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd524004920 con 0x7fd514003800 2021-11-12T05:40:47.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.786+0000 7fd5317fa700 1 -- 172.21.2.105:0/814855625 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd524004a80 con 0x7fd514003800 2021-11-12T05:40:47.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.786+0000 7fd53a353700 1 -- 172.21.2.105:0/814855625 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5341447a0 con 0x7fd514003800 2021-11-12T05:40:47.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.786+0000 7fd5317fa700 1 -- 172.21.2.105:0/814855625 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd524004de0 con 0x7fd514003800 2021-11-12T05:40:47.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.786+0000 7fd53a353700 1 -- 172.21.2.105:0/814855625 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd534067190 con 0x7fd514003800 2021-11-12T05:40:47.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.786+0000 7fd53a353700 1 -- 172.21.2.105:0/814855625 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd534142990 con 0x7fd514003800 2021-11-12T05:40:47.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.786+0000 7fd5317fa700 1 -- 172.21.2.105:0/814855625 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd524027070 con 0x7fd514003800 2021-11-12T05:40:47.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.786+0000 7fd5317fa700 1 --2- 172.21.2.105:0/814855625 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd518053640 0x7fd518055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:47.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.786+0000 7fd5317fa700 1 -- 172.21.2.105:0/814855625 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fd52406c940 con 0x7fd514003800 2021-11-12T05:40:47.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.786+0000 7fd5337fe700 1 --2- 172.21.2.105:0/814855625 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd518053640 0x7fd518055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:47.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.790+0000 7fd5337fe700 1 --2- 172.21.2.105:0/814855625 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd518053640 0x7fd518055b00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fd51c007000 tx=0x7fd51c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:47.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.790+0000 7fd5317fa700 1 -- 172.21.2.105:0/814855625 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd524043940 con 0x7fd514003800 2021-11-12T05:40:47.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.874+0000 7fd53a353700 1 -- 172.21.2.105:0/814855625 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd534144930 con 0x7fd514003800 2021-11-12T05:40:47.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.874+0000 7fd5317fa700 1 -- 172.21.2.105:0/814855625 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7fd52401a0a0 con 0x7fd514003800 2021-11-12T05:40:47.877 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:40:47.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.874+0000 7fd53a353700 1 -- 172.21.2.105:0/814855625 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd518053640 msgr2=0x7fd518055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:47.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.874+0000 7fd53a353700 1 --2- 172.21.2.105:0/814855625 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd518053640 0x7fd518055b00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fd51c007000 tx=0x7fd51c008040).stop 2021-11-12T05:40:47.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.874+0000 7fd53a353700 1 -- 172.21.2.105:0/814855625 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd514003800 msgr2=0x7fd534140700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:47.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.874+0000 7fd53a353700 1 --2- 172.21.2.105:0/814855625 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd514003800 0x7fd534140700 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fd53412a7a0 tx=0x7fd524015000).stop 2021-11-12T05:40:47.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.874+0000 7fd53a353700 1 -- 172.21.2.105:0/814855625 shutdown_connections 2021-11-12T05:40:47.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.874+0000 7fd53a353700 1 --2- 172.21.2.105:0/814855625 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd518053640 0x7fd518055b00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:47.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.874+0000 7fd53a353700 1 --2- 172.21.2.105:0/814855625 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd5340b0790 0x7fd5340b0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:47.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.874+0000 7fd53a353700 1 --2- 172.21.2.105:0/814855625 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd534065690 0x7fd534065b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:47.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.874+0000 7fd53a353700 1 --2- 172.21.2.105:0/814855625 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd514003800 0x7fd534140700 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:47.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.874+0000 7fd53a353700 1 -- 172.21.2.105:0/814855625 >> 172.21.2.105:0/814855625 conn(0x7fd5340608d0 msgr2=0x7fd53405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:47.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.874+0000 7fd53a353700 1 -- 172.21.2.105:0/814855625 shutdown_connections 2021-11-12T05:40:47.881 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.874+0000 7fd53a353700 1 -- 172.21.2.105:0/814855625 wait complete. 2021-11-12T05:40:47.884 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-12T05:40:47.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.934+0000 7f1e9d551700 1 Processor -- start 2021-11-12T05:40:47.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.934+0000 7f1e9d551700 1 -- start start 2021-11-12T05:40:47.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.934+0000 7f1e9d551700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f1e981498f0 0x7f1e9814bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:47.942 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.934+0000 7f1e9d551700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e98067600 con 0x7f1e98067170 2021-11-12T05:40:47.942 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.934+0000 7f1e9d551700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e980b8060 con 0x7f1e980b7c80 2021-11-12T05:40:47.942 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.934+0000 7f1e9d551700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e98067d80 con 0x7f1e981498f0 2021-11-12T05:40:47.942 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.934+0000 7f1e977fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f1e981498f0 0x7f1e9814bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:47.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.934+0000 7f1e977fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f1e981498f0 0x7f1e9814bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43382/0 (socket says 172.21.2.105:43382) 2021-11-12T05:40:47.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.934+0000 7f1e977fe700 1 -- 172.21.2.105:0/577598988 learned_addr learned my addr 172.21.2.105:0/577598988 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:47.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.934+0000 7f1e967fc700 1 --1- 172.21.2.105:0/577598988 >> v1:172.21.2.105:6789/0 conn(0x7f1e98067170 0x7f1e98065010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:53782/0 (socket says 172.21.2.105:53782) 2021-11-12T05:40:47.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.934+0000 7f1e977fe700 1 -- 172.21.2.105:0/577598988 >> v1:172.21.2.115:6789/0 conn(0x7f1e980b7c80 legacy=0x7f1e98064900 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:40:47.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.934+0000 7f1e977fe700 1 -- 172.21.2.105:0/577598988 >> v1:172.21.2.105:6789/0 conn(0x7f1e98067170 legacy=0x7f1e98065010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:47.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.934+0000 7f1e977fe700 1 -- 172.21.2.105:0/577598988 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e98067840 con 0x7f1e981498f0 2021-11-12T05:40:47.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.934+0000 7f1e977fe700 1 --2- 172.21.2.105:0/577598988 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1e981498f0 0x7f1e9814bce0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f1e980b7850 tx=0x7f1e90009290).ready entity=mon.0 client_cookie=618dbe87bb7d29d server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:47.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.934+0000 7f1e95ffb700 1 -- 172.21.2.105:0/577598988 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e9000b860 con 0x7f1e981498f0 2021-11-12T05:40:47.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.934+0000 7f1e95ffb700 1 -- 172.21.2.105:0/577598988 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e9000b9c0 con 0x7f1e981498f0 2021-11-12T05:40:47.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.934+0000 7f1e95ffb700 1 -- 172.21.2.105:0/577598988 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e9000bb30 con 0x7f1e981498f0 2021-11-12T05:40:47.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.938+0000 7f1e9d551700 1 -- 172.21.2.105:0/577598988 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1e981498f0 msgr2=0x7f1e9814bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:47.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.938+0000 7f1e9d551700 1 --2- 172.21.2.105:0/577598988 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1e981498f0 0x7f1e9814bce0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f1e980b7850 tx=0x7f1e90009290).stop 2021-11-12T05:40:47.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.938+0000 7f1e9d551700 1 -- 172.21.2.105:0/577598988 shutdown_connections 2021-11-12T05:40:47.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.938+0000 7f1e9d551700 1 --2- 172.21.2.105:0/577598988 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1e981498f0 0x7f1e9814bce0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:47.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.938+0000 7f1e9d551700 1 -- 172.21.2.105:0/577598988 >> 172.21.2.105:0/577598988 conn(0x7f1e9805c860 msgr2=0x7f1e980608d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:47.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.938+0000 7f1e9d551700 1 -- 172.21.2.105:0/577598988 shutdown_connections 2021-11-12T05:40:47.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.938+0000 7f1e9d551700 1 -- 172.21.2.105:0/577598988 wait complete. 2021-11-12T05:40:47.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.938+0000 7f1e9d551700 1 Processor -- start 2021-11-12T05:40:47.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.938+0000 7f1e9d551700 1 -- start start 2021-11-12T05:40:47.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.938+0000 7f1e9d551700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1e98067170 0x7f1e98143630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:47.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.938+0000 7f1e9d551700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1e980b7c80 0x7f1e981460b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:47.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.938+0000 7f1e9d551700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1e981498f0 0x7f1e981465a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:47.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.938+0000 7f1e9d551700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e98141890 con 0x7f1e980b7c80 2021-11-12T05:40:47.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.938+0000 7f1e9d551700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e98147390 con 0x7f1e981498f0 2021-11-12T05:40:47.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.938+0000 7f1e9d551700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e980b10e0 con 0x7f1e98067170 2021-11-12T05:40:47.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.938+0000 7f1e967fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1e980b7c80 0x7f1e981460b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:47.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.938+0000 7f1e967fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1e980b7c80 0x7f1e981460b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43390/0 (socket says 172.21.2.105:43390) 2021-11-12T05:40:47.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.938+0000 7f1e967fc700 1 -- 172.21.2.105:0/1919062693 learned_addr learned my addr 172.21.2.105:0/1919062693 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:47.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.938+0000 7f1e967fc700 1 -- 172.21.2.105:0/1919062693 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1e98067170 msgr2=0x7f1e98143630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:47.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.938+0000 7f1e967fc700 1 --2- 172.21.2.105:0/1919062693 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1e98067170 0x7f1e98143630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:47.950 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.938+0000 7f1e967fc700 1 -- 172.21.2.105:0/1919062693 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1e981498f0 msgr2=0x7f1e981465a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:47.950 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.938+0000 7f1e967fc700 1 --2- 172.21.2.105:0/1919062693 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1e981498f0 0x7f1e981465a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:47.950 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.938+0000 7f1e967fc700 1 -- 172.21.2.105:0/1919062693 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e90009530 con 0x7f1e980b7c80 2021-11-12T05:40:47.950 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.938+0000 7f1e967fc700 1 --2- 172.21.2.105:0/1919062693 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1e980b7c80 0x7f1e981460b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f1e980b2d90 tx=0x7f1e88007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:47.950 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.938+0000 7f1e8ffff700 1 -- 172.21.2.105:0/1919062693 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e8800ce30 con 0x7f1e980b7c80 2021-11-12T05:40:47.951 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.938+0000 7f1e8ffff700 1 -- 172.21.2.105:0/1919062693 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e880072e0 con 0x7f1e980b7c80 2021-11-12T05:40:47.951 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.938+0000 7f1e9d551700 1 -- 172.21.2.105:0/1919062693 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e98141b20 con 0x7f1e980b7c80 2021-11-12T05:40:47.951 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.938+0000 7f1e9d551700 1 -- 172.21.2.105:0/1919062693 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e981443a0 con 0x7f1e980b7c80 2021-11-12T05:40:47.951 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.938+0000 7f1e8ffff700 1 -- 172.21.2.105:0/1919062693 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e88007450 con 0x7f1e980b7c80 2021-11-12T05:40:47.953 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.938+0000 7f1e9d551700 1 -- 172.21.2.105:0/1919062693 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e98057350 con 0x7f1e980b7c80 2021-11-12T05:40:47.953 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.938+0000 7f1e8ffff700 1 -- 172.21.2.105:0/1919062693 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1e88010070 con 0x7f1e980b7c80 2021-11-12T05:40:47.953 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.938+0000 7f1e8ffff700 1 --2- 172.21.2.105:0/1919062693 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1e7c053690 0x7f1e7c055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:47.953 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.942+0000 7f1e8ffff700 1 -- 172.21.2.105:0/1919062693 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f1e8806afe0 con 0x7f1e980b7c80 2021-11-12T05:40:47.954 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.942+0000 7f1e96ffd700 1 --2- 172.21.2.105:0/1919062693 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1e7c053690 0x7f1e7c055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:47.954 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.942+0000 7f1e96ffd700 1 --2- 172.21.2.105:0/1919062693 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1e7c053690 0x7f1e7c055b50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f1e80002fb0 tx=0x7f1e800069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:47.954 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:47.942+0000 7f1e8ffff700 1 -- 172.21.2.105:0/1919062693 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1e88041fe0 con 0x7f1e980b7c80 2021-11-12T05:40:48.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.026+0000 7f1e9d551700 1 -- 172.21.2.105:0/1919062693 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1e98067600 con 0x7f1e980b7c80 2021-11-12T05:40:48.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.026+0000 7f1e8ffff700 1 -- 172.21.2.105:0/1919062693 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7f1e98067600 con 0x7f1e980b7c80 2021-11-12T05:40:48.030 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:40:48.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.026+0000 7f1e9d551700 1 -- 172.21.2.105:0/1919062693 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1e7c053690 msgr2=0x7f1e7c055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:48.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.026+0000 7f1e9d551700 1 --2- 172.21.2.105:0/1919062693 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1e7c053690 0x7f1e7c055b50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f1e80002fb0 tx=0x7f1e800069b0).stop 2021-11-12T05:40:48.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.026+0000 7f1e9d551700 1 -- 172.21.2.105:0/1919062693 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1e980b7c80 msgr2=0x7f1e981460b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:48.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.026+0000 7f1e9d551700 1 --2- 172.21.2.105:0/1919062693 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1e980b7c80 0x7f1e981460b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f1e980b2d90 tx=0x7f1e88007c40).stop 2021-11-12T05:40:48.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.026+0000 7f1e9d551700 1 -- 172.21.2.105:0/1919062693 shutdown_connections 2021-11-12T05:40:48.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.026+0000 7f1e9d551700 1 --2- 172.21.2.105:0/1919062693 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1e7c053690 0x7f1e7c055b50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:48.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.026+0000 7f1e9d551700 1 --2- 172.21.2.105:0/1919062693 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1e981498f0 0x7f1e981465a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:48.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.026+0000 7f1e9d551700 1 --2- 172.21.2.105:0/1919062693 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1e980b7c80 0x7f1e981460b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:48.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.026+0000 7f1e9d551700 1 --2- 172.21.2.105:0/1919062693 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1e98067170 0x7f1e98143630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:48.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.026+0000 7f1e9d551700 1 -- 172.21.2.105:0/1919062693 >> 172.21.2.105:0/1919062693 conn(0x7f1e9805c860 msgr2=0x7f1e980b53b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:48.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.026+0000 7f1e9d551700 1 -- 172.21.2.105:0/1919062693 shutdown_connections 2021-11-12T05:40:48.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.026+0000 7f1e9d551700 1 -- 172.21.2.105:0/1919062693 wait complete. 2021-11-12T05:40:48.037 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-12T05:40:48.037 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:40:48.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.086+0000 7f8327ee2700 1 Processor -- start 2021-11-12T05:40:48.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.086+0000 7f8327ee2700 1 -- start start 2021-11-12T05:40:48.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.086+0000 7f8327ee2700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f8320062010 0x7f83200b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:48.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.086+0000 7f8327ee2700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f83200b3100 0x7f83200b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:48.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.086+0000 7f8327ee2700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f83200b4640 0x7f83200b4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:48.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.086+0000 7f8327ee2700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83200b2110 con 0x7f83200b3100 2021-11-12T05:40:48.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.086+0000 7f8327ee2700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83200b4fc0 con 0x7f8320062010 2021-11-12T05:40:48.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.086+0000 7f8327ee2700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83200b2370 con 0x7f83200b4640 2021-11-12T05:40:48.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.086+0000 7f832547d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f83200b3100 0x7f83200b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:48.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.086+0000 7f832547d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f83200b3100 0x7f83200b2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43398/0 (socket says 172.21.2.105:43398) 2021-11-12T05:40:48.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.086+0000 7f832547d700 1 -- 172.21.2.105:0/2424089664 learned_addr learned my addr 172.21.2.105:0/2424089664 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:48.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.086+0000 7f832547d700 1 -- 172.21.2.105:0/2424089664 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f83200b4640 msgr2=0x7f83200b4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:48.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.086+0000 7f832547d700 1 --2- 172.21.2.105:0/2424089664 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f83200b4640 0x7f83200b4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:48.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.086+0000 7f832547d700 1 -- 172.21.2.105:0/2424089664 >> v2:172.21.2.115:3300/0 conn(0x7f8320062010 msgr2=0x7f83200b5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:48.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.086+0000 7f832547d700 1 --2- 172.21.2.105:0/2424089664 >> v2:172.21.2.115:3300/0 conn(0x7f8320062010 0x7f83200b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:48.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.086+0000 7f832547d700 1 -- 172.21.2.105:0/2424089664 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83200b2610 con 0x7f83200b3100 2021-11-12T05:40:48.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.086+0000 7f832547d700 1 --2- 172.21.2.105:0/2424089664 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f83200b3100 0x7f83200b2ab0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f8314002f70 tx=0x7f8314006eb0).ready entity=mon.0 client_cookie=20c1630aed95a56e server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:48.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.086+0000 7f8324c7c700 1 -- 172.21.2.105:0/2424089664 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f831400d570 con 0x7f83200b3100 2021-11-12T05:40:48.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.086+0000 7f8324c7c700 1 -- 172.21.2.105:0/2424089664 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8314000e90 con 0x7f83200b3100 2021-11-12T05:40:48.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.086+0000 7f8324c7c700 1 -- 172.21.2.105:0/2424089664 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f831400d900 con 0x7f83200b3100 2021-11-12T05:40:48.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.086+0000 7f8327ee2700 1 -- 172.21.2.105:0/2424089664 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f83200b3100 msgr2=0x7f83200b2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:48.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.086+0000 7f8327ee2700 1 --2- 172.21.2.105:0/2424089664 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f83200b3100 0x7f83200b2ab0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f8314002f70 tx=0x7f8314006eb0).stop 2021-11-12T05:40:48.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.086+0000 7f8327ee2700 1 -- 172.21.2.105:0/2424089664 shutdown_connections 2021-11-12T05:40:48.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.086+0000 7f8327ee2700 1 --2- 172.21.2.105:0/2424089664 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f83200b4640 0x7f83200b4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:48.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.086+0000 7f8327ee2700 1 --2- 172.21.2.105:0/2424089664 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f83200b3100 0x7f83200b2ab0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:48.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.086+0000 7f8327ee2700 1 --2- 172.21.2.105:0/2424089664 >> v2:172.21.2.115:3300/0 conn(0x7f8320062010 0x7f83200b5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:48.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.086+0000 7f8327ee2700 1 -- 172.21.2.105:0/2424089664 >> 172.21.2.105:0/2424089664 conn(0x7f83200b9790 msgr2=0x7f83200b9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:48.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.086+0000 7f8327ee2700 1 -- 172.21.2.105:0/2424089664 shutdown_connections 2021-11-12T05:40:48.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.086+0000 7f8327ee2700 1 -- 172.21.2.105:0/2424089664 wait complete. 2021-11-12T05:40:48.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.090+0000 7f8327ee2700 1 Processor -- start 2021-11-12T05:40:48.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.090+0000 7f8327ee2700 1 -- start start 2021-11-12T05:40:48.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.090+0000 7f8327ee2700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8320062010 0x7f832015a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:48.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.090+0000 7f8327ee2700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f83200b3100 0x7f83200afad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:48.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.090+0000 7f8327ee2700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f83200b4640 0x7f83200659d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:48.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.090+0000 7f8327ee2700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83200655e0 con 0x7f8320062010 2021-11-12T05:40:48.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.090+0000 7f8327ee2700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8320064230 con 0x7f83200b4640 2021-11-12T05:40:48.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.090+0000 7f8327ee2700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8320145b90 con 0x7f83200b3100 2021-11-12T05:40:48.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.090+0000 7f8325c7e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8320062010 0x7f832015a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:48.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.090+0000 7f8325c7e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8320062010 0x7f832015a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43404/0 (socket says 172.21.2.105:43404) 2021-11-12T05:40:48.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.090+0000 7f8325c7e700 1 -- 172.21.2.105:0/182877978 learned_addr learned my addr 172.21.2.105:0/182877978 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:48.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.090+0000 7f8325c7e700 1 -- 172.21.2.105:0/182877978 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f83200b3100 msgr2=0x7f83200afad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:48.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.090+0000 7f8325c7e700 1 --2- 172.21.2.105:0/182877978 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f83200b3100 0x7f83200afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:48.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.090+0000 7f8325c7e700 1 -- 172.21.2.105:0/182877978 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f83200b4640 msgr2=0x7f83200659d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:48.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.090+0000 7f8325c7e700 1 --2- 172.21.2.105:0/182877978 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f83200b4640 0x7f83200659d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:48.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.090+0000 7f8325c7e700 1 -- 172.21.2.105:0/182877978 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831400b1e0 con 0x7f8320062010 2021-11-12T05:40:48.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.090+0000 7f8325c7e700 1 --2- 172.21.2.105:0/182877978 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8320062010 0x7f832015a050 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f831c002f70 tx=0x7f831c006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:48.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.090+0000 7f8312ffd700 1 -- 172.21.2.105:0/182877978 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f831c013460 con 0x7f8320062010 2021-11-12T05:40:48.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.090+0000 7f8312ffd700 1 -- 172.21.2.105:0/182877978 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831c0135c0 con 0x7f8320062010 2021-11-12T05:40:48.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.090+0000 7f8312ffd700 1 -- 172.21.2.105:0/182877978 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f831c013920 con 0x7f8320062010 2021-11-12T05:40:48.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.090+0000 7f8327ee2700 1 -- 172.21.2.105:0/182877978 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8320145e30 con 0x7f8320062010 2021-11-12T05:40:48.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.090+0000 7f8327ee2700 1 -- 172.21.2.105:0/182877978 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8320147270 con 0x7f8320062010 2021-11-12T05:40:48.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.090+0000 7f8327ee2700 1 -- 172.21.2.105:0/182877978 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8320063bf0 con 0x7f8320062010 2021-11-12T05:40:48.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.090+0000 7f8312ffd700 1 -- 172.21.2.105:0/182877978 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f831c00f070 con 0x7f8320062010 2021-11-12T05:40:48.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.090+0000 7f8312ffd700 1 --2- 172.21.2.105:0/182877978 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f83000536a0 0x7f8300055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:48.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.090+0000 7f8312ffd700 1 -- 172.21.2.105:0/182877978 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f831c06b470 con 0x7f8320062010 2021-11-12T05:40:48.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.090+0000 7f832547d700 1 --2- 172.21.2.105:0/182877978 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f83000536a0 0x7f8300055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:48.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.090+0000 7f832547d700 1 --2- 172.21.2.105:0/182877978 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f83000536a0 0x7f8300055b60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f8314002f70 tx=0x7f8314015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:48.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.094+0000 7f8312ffd700 1 -- 172.21.2.105:0/182877978 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8320063bf0 con 0x7f8320062010 2021-11-12T05:40:48.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.202+0000 7f8327ee2700 1 -- 172.21.2.105:0/182877978 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8320063bf0 con 0x7f8320062010 2021-11-12T05:40:48.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.202+0000 7f8312ffd700 1 -- 172.21.2.105:0/182877978 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2134 (secure 0 0 0) 0x7f8320063bf0 con 0x7f8320062010 2021-11-12T05:40:48.204 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:40:48.204 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4222,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/3123627686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":3123627686},{"type":"v1","addr":"172.21.2.115:6833","nonce":3123627686}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:40:37.198589+0000","modified":"2021-11-12T05:40:38.201943+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/2223420138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":2223420138},{"type":"v1","addr":"172.21.2.105:6835","nonce":2223420138}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-11-12T05:40:48.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.202+0000 7f8327ee2700 1 -- 172.21.2.105:0/182877978 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f83000536a0 msgr2=0x7f8300055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:48.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.202+0000 7f8327ee2700 1 --2- 172.21.2.105:0/182877978 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f83000536a0 0x7f8300055b60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f8314002f70 tx=0x7f8314015000).stop 2021-11-12T05:40:48.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.202+0000 7f8327ee2700 1 -- 172.21.2.105:0/182877978 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8320062010 msgr2=0x7f832015a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:48.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.202+0000 7f8327ee2700 1 --2- 172.21.2.105:0/182877978 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8320062010 0x7f832015a050 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f831c002f70 tx=0x7f831c006ec0).stop 2021-11-12T05:40:48.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.202+0000 7f8327ee2700 1 -- 172.21.2.105:0/182877978 shutdown_connections 2021-11-12T05:40:48.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.202+0000 7f8327ee2700 1 --2- 172.21.2.105:0/182877978 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f83000536a0 0x7f8300055b60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:48.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.202+0000 7f8327ee2700 1 --2- 172.21.2.105:0/182877978 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f83200b4640 0x7f83200659d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:48.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.202+0000 7f8327ee2700 1 --2- 172.21.2.105:0/182877978 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f83200b3100 0x7f83200afad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:48.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.202+0000 7f8327ee2700 1 --2- 172.21.2.105:0/182877978 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8320062010 0x7f832015a050 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:48.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.202+0000 7f8327ee2700 1 -- 172.21.2.105:0/182877978 >> 172.21.2.105:0/182877978 conn(0x7f83200b9790 msgr2=0x7f83201430c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:48.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.202+0000 7f8327ee2700 1 -- 172.21.2.105:0/182877978 shutdown_connections 2021-11-12T05:40:48.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:48.202+0000 7f8327ee2700 1 -- 172.21.2.105:0/182877978 wait complete. 2021-11-12T05:40:48.208 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 5 2021-11-12T05:40:48.413 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:40:37.198589+0000', 'modified': '2021-11-12T05:40:38.201943+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4251}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4251': {'gid': 4251, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/2223420138', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 2223420138}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 2223420138}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:40:48.414 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:40:48.414 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:40:48.480 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":4251,"want_state":"up:active","state":"up:active","rank_uptime":11.274274002,"mdsmap_epoch":5,"osdmap_epoch":25,"osdmap_epoch_barrier":24,"uptime":16.476677947999999} 2021-11-12T05:40:48.481 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 4251, "mdsmap_epoch": 5, "osdmap_epoch": 25, "osdmap_epoch_barrier": 24, "rank_uptime": 11.274274002, "state": "up:active", "uptime": 16.476677948, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:40:48.481 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-12T05:40:48.482 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-11-12T05:40:48.482 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@gibba038.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-11-12T05:40:48.482 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:40:48.483 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:40:48.493 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-12T05:40:48.545 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:40:48.546 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:40:48.551 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:40:48.552 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:40:48.553 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:40:48.553 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-12T05:40:48.557 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-12T05:40:48.557 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:40:48.600 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-12T05:40:48.609 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:40:48.610 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:40:48.615 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:40:48.615 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:40:48.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:40:48.616 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-12T05:40:48.652 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:2021-11-12T05:40:48.661+0000 7fa49f940080 -1 init, newargv = 0x560a466a52a0 newargc=9 2021-11-12T05:40:48.653 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:ceph-fuse[13967]: starting ceph client 2021-11-12T05:40:48.664 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:ceph-fuse[13967]: starting fuse 2021-11-12T05:40:49.722 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-12T05:40:49.734 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:40:49.734 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:40:49.781 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:40:49.782 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:40:49.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:40:49.784 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-12T05:40:49.789 INFO:teuthology.orchestra.run.gibba038.stdout:52 2021-11-12T05:40:49.789 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-12T05:40:49.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:40:49.790 DEBUG:teuthology.orchestra.run.gibba038:> sudo python3 -c ' 2021-11-12T05:40:49.790 DEBUG:teuthology.orchestra.run.gibba038:> import glob 2021-11-12T05:40:49.790 DEBUG:teuthology.orchestra.run.gibba038:> import re 2021-11-12T05:40:49.791 DEBUG:teuthology.orchestra.run.gibba038:> import os 2021-11-12T05:40:49.791 DEBUG:teuthology.orchestra.run.gibba038:> import subprocess 2021-11-12T05:40:49.791 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:40:49.792 DEBUG:teuthology.orchestra.run.gibba038:> def find_socket(client_name): 2021-11-12T05:40:49.792 DEBUG:teuthology.orchestra.run.gibba038:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-11-12T05:40:49.792 DEBUG:teuthology.orchestra.run.gibba038:> files = glob.glob(asok_path) 2021-11-12T05:40:49.792 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:40:49.793 DEBUG:teuthology.orchestra.run.gibba038:> # Given a non-glob path, it better be there 2021-11-12T05:40:49.793 DEBUG:teuthology.orchestra.run.gibba038:> if "*" not in asok_path: 2021-11-12T05:40:49.793 DEBUG:teuthology.orchestra.run.gibba038:> assert(len(files) == 1) 2021-11-12T05:40:49.794 DEBUG:teuthology.orchestra.run.gibba038:> return files[0] 2021-11-12T05:40:49.794 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:40:49.794 DEBUG:teuthology.orchestra.run.gibba038:> for f in files: 2021-11-12T05:40:49.795 DEBUG:teuthology.orchestra.run.gibba038:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-12T05:40:49.795 DEBUG:teuthology.orchestra.run.gibba038:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-12T05:40:49.795 DEBUG:teuthology.orchestra.run.gibba038:> return f 2021-11-12T05:40:49.795 DEBUG:teuthology.orchestra.run.gibba038:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-12T05:40:49.796 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:40:49.796 DEBUG:teuthology.orchestra.run.gibba038:> print(find_socket("client.1")) 2021-11-12T05:40:49.796 DEBUG:teuthology.orchestra.run.gibba038:> ' 2021-11-12T05:40:49.865 INFO:teuthology.orchestra.run.gibba038.stdout:/var/run/ceph/ceph-client.1.13967.asok 2021-11-12T05:40:49.867 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.13967.asok 2021-11-12T05:40:49.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:40:49.868 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.13967.asok status 2021-11-12T05:40:49.925 INFO:teuthology.orchestra.run.gibba038.stdout:{ 2021-11-12T05:40:49.926 INFO:teuthology.orchestra.run.gibba038.stdout: "metadata": { 2021-11-12T05:40:49.926 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_sha1": "a81ee2815de5acae59ead5b8c9137b6766fc8ea8", 2021-11-12T05:40:49.926 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_version": "ceph version 15.2.15-22-ga81ee281 (a81ee2815de5acae59ead5b8c9137b6766fc8ea8) octopus (stable)", 2021-11-12T05:40:49.927 INFO:teuthology.orchestra.run.gibba038.stdout: "entity_id": "1", 2021-11-12T05:40:49.927 INFO:teuthology.orchestra.run.gibba038.stdout: "hostname": "gibba038", 2021-11-12T05:40:49.927 INFO:teuthology.orchestra.run.gibba038.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-11-12T05:40:49.927 INFO:teuthology.orchestra.run.gibba038.stdout: "pid": "13967", 2021-11-12T05:40:49.928 INFO:teuthology.orchestra.run.gibba038.stdout: "root": "/" 2021-11-12T05:40:49.928 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:40:49.928 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_count": 0, 2021-11-12T05:40:49.928 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_pinned_count": 0, 2021-11-12T05:40:49.928 INFO:teuthology.orchestra.run.gibba038.stdout: "id": 4659, 2021-11-12T05:40:49.929 INFO:teuthology.orchestra.run.gibba038.stdout: "inst": { 2021-11-12T05:40:49.929 INFO:teuthology.orchestra.run.gibba038.stdout: "name": { 2021-11-12T05:40:49.929 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "client", 2021-11-12T05:40:49.929 INFO:teuthology.orchestra.run.gibba038.stdout: "num": 4659 2021-11-12T05:40:49.929 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:40:49.930 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-12T05:40:49.930 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-12T05:40:49.930 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-12T05:40:49.930 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 2650391253 2021-11-12T05:40:49.931 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-11-12T05:40:49.931 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:40:49.931 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-12T05:40:49.931 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-12T05:40:49.931 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-12T05:40:49.932 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 2650391253 2021-11-12T05:40:49.932 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:40:49.932 INFO:teuthology.orchestra.run.gibba038.stdout: "inst_str": "client.4659 172.21.2.138:0/2650391253", 2021-11-12T05:40:49.932 INFO:teuthology.orchestra.run.gibba038.stdout: "addr_str": "172.21.2.138:0/2650391253", 2021-11-12T05:40:49.932 INFO:teuthology.orchestra.run.gibba038.stdout: "inode_count": 1, 2021-11-12T05:40:49.933 INFO:teuthology.orchestra.run.gibba038.stdout: "mds_epoch": 5, 2021-11-12T05:40:49.933 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch": 25, 2021-11-12T05:40:49.933 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch_barrier": 0, 2021-11-12T05:40:49.933 INFO:teuthology.orchestra.run.gibba038.stdout: "blacklisted": false, 2021-11-12T05:40:49.934 INFO:teuthology.orchestra.run.gibba038.stdout: "fs_name": "cephfs" 2021-11-12T05:40:49.934 INFO:teuthology.orchestra.run.gibba038.stdout:} 2021-11-12T05:40:49.935 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:40:49.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.986+0000 7f9047e14700 1 Processor -- start 2021-11-12T05:40:49.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.986+0000 7f9047e14700 1 -- start start 2021-11-12T05:40:49.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.986+0000 7f9047e14700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f90400624d0 0x7f90400601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:49.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.986+0000 7f9047e14700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9040063310 con 0x7f9040147e30 2021-11-12T05:40:49.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.986+0000 7f9047e14700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9040147450 con 0x7f904005fdc0 2021-11-12T05:40:49.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.986+0000 7f9047e14700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90401476f0 con 0x7f90400624d0 2021-11-12T05:40:49.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.986+0000 7f90463b1700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f9040147e30 0x7f9040148810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:53810/0 (socket says 172.21.2.105:53810) 2021-11-12T05:40:49.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.986+0000 7f90463b1700 1 -- 172.21.2.105:0/1909542492 learned_addr learned my addr 172.21.2.105:0/1909542492 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:49.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.986+0000 7f9044bae700 1 -- 172.21.2.105:0/1909542492 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1120577707 0 0) 0x7f9040063310 con 0x7f9040147e30 2021-11-12T05:40:49.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.986+0000 7f90453af700 1 --2- 172.21.2.105:0/1909542492 >> v2:172.21.2.115:3300/0 conn(0x7f90400624d0 0x7f90400601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:49.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.986+0000 7f9044bae700 1 -- 172.21.2.105:0/1909542492 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9028003260 con 0x7f9040147e30 2021-11-12T05:40:49.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.986+0000 7f9044bae700 1 -- 172.21.2.105:0/1909542492 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2283333681 0 0) 0x7f9028003260 con 0x7f9040147e30 2021-11-12T05:40:49.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.986+0000 7f9044bae700 1 -- 172.21.2.105:0/1909542492 >> v2:172.21.2.115:3300/0 conn(0x7f90400624d0 msgr2=0x7f90400601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:49.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.986+0000 7f9044bae700 1 --2- 172.21.2.105:0/1909542492 >> v2:172.21.2.115:3300/0 conn(0x7f90400624d0 0x7f90400601a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:49.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.986+0000 7f9044bae700 1 -- 172.21.2.105:0/1909542492 >> v1:172.21.2.115:6789/0 conn(0x7f904005fdc0 legacy=0x7f90401445b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:49.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.986+0000 7f9044bae700 1 -- 172.21.2.105:0/1909542492 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9040147990 con 0x7f9040147e30 2021-11-12T05:40:49.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.986+0000 7f9044bae700 1 -- 172.21.2.105:0/1909542492 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f903c001660 con 0x7f9040147e30 2021-11-12T05:40:49.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.986+0000 7f9044bae700 1 -- 172.21.2.105:0/1909542492 >> v1:172.21.2.105:6789/0 conn(0x7f9040147e30 legacy=0x7f9040148810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:49.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.986+0000 7f9044bae700 1 --2- 172.21.2.105:0/1909542492 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9028003820 0x7f9028003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:49.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.986+0000 7f9044bae700 1 --2- 172.21.2.105:0/1909542492 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9028004500 0x7f9028004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:49.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.986+0000 7f9044bae700 1 --2- 172.21.2.105:0/1909542492 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9028004ec0 0x7f902800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:49.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.986+0000 7f9044bae700 1 -- 172.21.2.105:0/1909542492 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90401476f0 con 0x7f9028004ec0 2021-11-12T05:40:49.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.986+0000 7f9044bae700 1 -- 172.21.2.105:0/1909542492 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902800bda0 con 0x7f9028004500 2021-11-12T05:40:49.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.986+0000 7f9044bae700 1 -- 172.21.2.105:0/1909542492 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f902800bf60 con 0x7f9028003820 2021-11-12T05:40:49.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.986+0000 7f90463b1700 1 --2- 172.21.2.105:0/1909542492 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9028004ec0 0x7f902800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:49.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.986+0000 7f90463b1700 1 -- 172.21.2.105:0/1909542492 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9028003820 msgr2=0x7f9028003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:49.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.986+0000 7f90463b1700 1 --2- 172.21.2.105:0/1909542492 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9028003820 0x7f9028003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:49.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.986+0000 7f90463b1700 1 -- 172.21.2.105:0/1909542492 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9028004500 msgr2=0x7f9028004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:49.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.986+0000 7f90463b1700 1 --2- 172.21.2.105:0/1909542492 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9028004500 0x7f9028004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:49.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.986+0000 7f90463b1700 1 -- 172.21.2.105:0/1909542492 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9028003260 con 0x7f9028004ec0 2021-11-12T05:40:50.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.986+0000 7f90463b1700 1 -- 172.21.2.105:0/1909542492 reap_dead start 2021-11-12T05:40:50.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.986+0000 7f90463b1700 1 --2- 172.21.2.105:0/1909542492 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9028004ec0 0x7f902800b750 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f9040060e00 tx=0x7f90400ad760).ready entity=mon.0 client_cookie=6e6ad1a5942a03d8 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:50.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.986+0000 7f9044bae700 1 -- 172.21.2.105:0/1909542492 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f903c0070d0 con 0x7f9028004ec0 2021-11-12T05:40:50.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.990+0000 7f9044bae700 1 -- 172.21.2.105:0/1909542492 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903c007230 con 0x7f9028004ec0 2021-11-12T05:40:50.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.990+0000 7f9044bae700 1 -- 172.21.2.105:0/1909542492 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f903c00c8f0 con 0x7f9028004ec0 2021-11-12T05:40:50.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.990+0000 7f9047e14700 1 -- 172.21.2.105:0/1909542492 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9028004ec0 msgr2=0x7f902800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:50.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.990+0000 7f9047e14700 1 --2- 172.21.2.105:0/1909542492 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9028004ec0 0x7f902800b750 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f9040060e00 tx=0x7f90400ad760).stop 2021-11-12T05:40:50.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.990+0000 7f9047e14700 1 -- 172.21.2.105:0/1909542492 shutdown_connections 2021-11-12T05:40:50.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.990+0000 7f9047e14700 1 --2- 172.21.2.105:0/1909542492 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9028004ec0 0x7f902800b750 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:50.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.990+0000 7f9047e14700 1 -- 172.21.2.105:0/1909542492 >> 172.21.2.105:0/1909542492 conn(0x7f90400608d0 msgr2=0x7f904005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:50.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.990+0000 7f9047e14700 1 -- 172.21.2.105:0/1909542492 shutdown_connections 2021-11-12T05:40:50.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.990+0000 7f9047e14700 1 -- 172.21.2.105:0/1909542492 wait complete. 2021-11-12T05:40:50.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.990+0000 7f9047e14700 1 Processor -- start 2021-11-12T05:40:50.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.990+0000 7f9047e14700 1 -- start start 2021-11-12T05:40:50.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.990+0000 7f9047e14700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9028004ec0 0x7f904014e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:50.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.990+0000 7f9047e14700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f904014c4c0 0x7f90401445b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:50.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.990+0000 7f9047e14700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f904014d680 0x7f9040144aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:50.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.990+0000 7f9047e14700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90400b01b0 con 0x7f904014d680 2021-11-12T05:40:50.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.990+0000 7f9047e14700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90400b0660 con 0x7f9028004ec0 2021-11-12T05:40:50.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.990+0000 7f9047e14700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904014c960 con 0x7f904014c4c0 2021-11-12T05:40:50.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.990+0000 7f90463b1700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f904014d680 0x7f9040144aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:50.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.990+0000 7f90463b1700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f904014d680 0x7f9040144aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43426/0 (socket says 172.21.2.105:43426) 2021-11-12T05:40:50.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.990+0000 7f90463b1700 1 -- 172.21.2.105:0/1557458053 learned_addr learned my addr 172.21.2.105:0/1557458053 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:50.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.990+0000 7f90463b1700 1 -- 172.21.2.105:0/1557458053 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f904014c4c0 msgr2=0x7f90401445b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:50.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.990+0000 7f90463b1700 1 --2- 172.21.2.105:0/1557458053 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f904014c4c0 0x7f90401445b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:50.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.990+0000 7f90463b1700 1 -- 172.21.2.105:0/1557458053 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9028004ec0 msgr2=0x7f904014e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:50.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.990+0000 7f90463b1700 1 --2- 172.21.2.105:0/1557458053 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9028004ec0 0x7f904014e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:50.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.990+0000 7f90463b1700 1 -- 172.21.2.105:0/1557458053 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90400b03c0 con 0x7f904014d680 2021-11-12T05:40:50.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.990+0000 7f90463b1700 1 --2- 172.21.2.105:0/1557458053 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f904014d680 0x7f9040144aa0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f904014dde0 tx=0x7f903c013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:50.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.990+0000 7f902effd700 1 -- 172.21.2.105:0/1557458053 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f903c01a040 con 0x7f904014d680 2021-11-12T05:40:50.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.990+0000 7f902effd700 1 -- 172.21.2.105:0/1557458053 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903c004710 con 0x7f904014d680 2021-11-12T05:40:50.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.990+0000 7f9047e14700 1 -- 172.21.2.105:0/1557458053 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f904014ba50 con 0x7f904014d680 2021-11-12T05:40:50.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.990+0000 7f9047e14700 1 -- 172.21.2.105:0/1557458053 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f904014df00 con 0x7f904014d680 2021-11-12T05:40:50.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.990+0000 7f902effd700 1 -- 172.21.2.105:0/1557458053 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f903c0070d0 con 0x7f904014d680 2021-11-12T05:40:50.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.990+0000 7f9047e14700 1 -- 172.21.2.105:0/1557458053 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f904014dbf0 con 0x7f904014d680 2021-11-12T05:40:50.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.990+0000 7f902effd700 1 -- 172.21.2.105:0/1557458053 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f903c027030 con 0x7f904014d680 2021-11-12T05:40:50.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.990+0000 7f902effd700 1 --2- 172.21.2.105:0/1557458053 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9020053640 0x7f9020055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:50.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.990+0000 7f902effd700 1 -- 172.21.2.105:0/1557458053 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f903c06c670 con 0x7f904014d680 2021-11-12T05:40:50.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.990+0000 7f9045bb0700 1 --2- 172.21.2.105:0/1557458053 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9020053640 0x7f9020055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:50.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.994+0000 7f9045bb0700 1 --2- 172.21.2.105:0/1557458053 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9020053640 0x7f9020055b00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f9030001fa0 tx=0x7f90300077f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:50.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:49.994+0000 7f902effd700 1 -- 172.21.2.105:0/1557458053 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f903c043670 con 0x7f904014d680 2021-11-12T05:40:50.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.082+0000 7f9047e14700 1 -- 172.21.2.105:0/1557458053 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90400ae3b0 con 0x7f904014d680 2021-11-12T05:40:50.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.082+0000 7f902effd700 1 -- 172.21.2.105:0/1557458053 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f903c046c90 con 0x7f904014d680 2021-11-12T05:40:50.171 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:40:50.171 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":25,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:40:38.203083+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:40:32.786926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-12T05:40:35.006506+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:40:50.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.082+0000 7f9047e14700 1 -- 172.21.2.105:0/1557458053 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9020053640 msgr2=0x7f9020055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:50.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.082+0000 7f9047e14700 1 --2- 172.21.2.105:0/1557458053 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9020053640 0x7f9020055b00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f9030001fa0 tx=0x7f90300077f0).stop 2021-11-12T05:40:50.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.082+0000 7f9047e14700 1 -- 172.21.2.105:0/1557458053 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f904014d680 msgr2=0x7f9040144aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:50.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.082+0000 7f9047e14700 1 --2- 172.21.2.105:0/1557458053 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f904014d680 0x7f9040144aa0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f904014dde0 tx=0x7f903c013000).stop 2021-11-12T05:40:50.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.082+0000 7f9047e14700 1 -- 172.21.2.105:0/1557458053 shutdown_connections 2021-11-12T05:40:50.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.082+0000 7f9047e14700 1 --2- 172.21.2.105:0/1557458053 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9020053640 0x7f9020055b00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:50.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.082+0000 7f9047e14700 1 --2- 172.21.2.105:0/1557458053 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f904014d680 0x7f9040144aa0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:50.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.082+0000 7f9047e14700 1 --2- 172.21.2.105:0/1557458053 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f904014c4c0 0x7f90401445b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:50.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.082+0000 7f9047e14700 1 --2- 172.21.2.105:0/1557458053 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9028004ec0 0x7f904014e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:50.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.082+0000 7f9047e14700 1 -- 172.21.2.105:0/1557458053 >> 172.21.2.105:0/1557458053 conn(0x7f90400608d0 msgr2=0x7f90400b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:50.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.082+0000 7f9047e14700 1 -- 172.21.2.105:0/1557458053 shutdown_connections 2021-11-12T05:40:50.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.082+0000 7f9047e14700 1 -- 172.21.2.105:0/1557458053 wait complete. 2021-11-12T05:40:50.176 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-12T05:40:32.786926+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-11-12T05:40:35.006506+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-12T05:40:50.177 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:40:50.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.230+0000 7fe34c9fb700 1 Processor -- start 2021-11-12T05:40:50.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.230+0000 7fe34c9fb700 1 -- start start 2021-11-12T05:40:50.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.230+0000 7fe34c9fb700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe3480afc60 0x7fe3480ae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:50.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.230+0000 7fe34c9fb700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3480b16c0 con 0x7fe348060d60 2021-11-12T05:40:50.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.230+0000 7fe34c9fb700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3480b18f0 con 0x7fe348066be0 2021-11-12T05:40:50.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.230+0000 7fe34c9fb700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe348066fc0 con 0x7fe3480afc60 2021-11-12T05:40:50.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.230+0000 7fe346d9d700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fe348060d60 0x7fe348143360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:53830/0 (socket says 172.21.2.105:53830) 2021-11-12T05:40:50.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.230+0000 7fe346d9d700 1 -- 172.21.2.105:0/2398716511 learned_addr learned my addr 172.21.2.105:0/2398716511 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:50.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe34559a700 1 -- 172.21.2.105:0/2398716511 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3230083541 0 0) 0x7fe3480b16c0 con 0x7fe348060d60 2021-11-12T05:40:50.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe34559a700 1 -- 172.21.2.105:0/2398716511 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe328003260 con 0x7fe348060d60 2021-11-12T05:40:50.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe34559a700 1 -- 172.21.2.105:0/2398716511 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2250505963 0 0) 0x7fe328003260 con 0x7fe348060d60 2021-11-12T05:40:50.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe34559a700 1 -- 172.21.2.105:0/2398716511 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe3480afc60 msgr2=0x7fe3480ae0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:50.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe34559a700 1 --2- 172.21.2.105:0/2398716511 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe3480afc60 0x7fe3480ae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:50.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe34559a700 1 -- 172.21.2.105:0/2398716511 >> v1:172.21.2.115:6789/0 conn(0x7fe348066be0 legacy=0x7fe3480ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:50.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe34559a700 1 -- 172.21.2.105:0/2398716511 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3480b0760 con 0x7fe348060d60 2021-11-12T05:40:50.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe34559a700 1 -- 172.21.2.105:0/2398716511 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fe3400019e0 con 0x7fe348060d60 2021-11-12T05:40:50.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe34559a700 1 -- 172.21.2.105:0/2398716511 >> v1:172.21.2.105:6789/0 conn(0x7fe348060d60 legacy=0x7fe348143360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:50.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe34559a700 1 --2- 172.21.2.105:0/2398716511 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe328003800 0x7fe328003c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:50.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe34559a700 1 --2- 172.21.2.105:0/2398716511 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe328004500 0x7fe328004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:50.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe34559a700 1 --2- 172.21.2.105:0/2398716511 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe3480afc60 0x7fe32800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:50.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe34559a700 1 -- 172.21.2.105:0/2398716511 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe348066fc0 con 0x7fe328004500 2021-11-12T05:40:50.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe34559a700 1 -- 172.21.2.105:0/2398716511 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3280052c0 con 0x7fe328003800 2021-11-12T05:40:50.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe34559a700 1 -- 172.21.2.105:0/2398716511 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe32800bc40 con 0x7fe3480afc60 2021-11-12T05:40:50.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe345d9b700 1 --2- 172.21.2.105:0/2398716511 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe328004500 0x7fe328004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:50.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe346d9d700 1 --2- 172.21.2.105:0/2398716511 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe3480afc60 0x7fe32800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:50.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe34659c700 1 --2- 172.21.2.105:0/2398716511 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe328003800 0x7fe328003c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:50.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe345d9b700 1 -- 172.21.2.105:0/2398716511 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe3480afc60 msgr2=0x7fe32800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:50.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe345d9b700 1 --2- 172.21.2.105:0/2398716511 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe3480afc60 0x7fe32800b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:50.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe345d9b700 1 -- 172.21.2.105:0/2398716511 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe328003800 msgr2=0x7fe328003c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:50.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe345d9b700 1 --2- 172.21.2.105:0/2398716511 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe328003800 0x7fe328003c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:50.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe345d9b700 1 -- 172.21.2.105:0/2398716511 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe328003260 con 0x7fe328004500 2021-11-12T05:40:50.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe345d9b700 1 --2- 172.21.2.105:0/2398716511 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe328004500 0x7fe328004980 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fe3280054d0 tx=0x7fe338006ca0).ready entity=mon.0 client_cookie=94c40c17d2de2b14 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:50.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe34559a700 1 -- 172.21.2.105:0/2398716511 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe338013410 con 0x7fe328004500 2021-11-12T05:40:50.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe34559a700 1 -- 172.21.2.105:0/2398716511 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe338013570 con 0x7fe328004500 2021-11-12T05:40:50.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe34559a700 1 -- 172.21.2.105:0/2398716511 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3380138d0 con 0x7fe328004500 2021-11-12T05:40:50.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe34c9fb700 1 -- 172.21.2.105:0/2398716511 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe328004500 msgr2=0x7fe328004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:50.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe34c9fb700 1 --2- 172.21.2.105:0/2398716511 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe328004500 0x7fe328004980 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fe3280054d0 tx=0x7fe338006ca0).stop 2021-11-12T05:40:50.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe346d9d700 1 -- 172.21.2.105:0/2398716511 reap_dead start 2021-11-12T05:40:50.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe34c9fb700 1 -- 172.21.2.105:0/2398716511 shutdown_connections 2021-11-12T05:40:50.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe34c9fb700 1 -- 172.21.2.105:0/2398716511 >> 172.21.2.105:0/2398716511 conn(0x7fe34805c490 msgr2=0x7fe3480b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:50.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe34c9fb700 1 -- 172.21.2.105:0/2398716511 shutdown_connections 2021-11-12T05:40:50.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe34c9fb700 1 -- 172.21.2.105:0/2398716511 wait complete. 2021-11-12T05:40:50.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe34c9fb700 1 Processor -- start 2021-11-12T05:40:50.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe34c9fb700 1 -- start start 2021-11-12T05:40:50.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe34c9fb700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe328004500 0x7fe3480a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:50.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe34c9fb700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe348155800 0x7fe3480b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:50.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe34c9fb700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe348152760 0x7fe348152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:50.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe34c9fb700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe348155c60 con 0x7fe348152760 2021-11-12T05:40:50.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe34c9fb700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3481530d0 con 0x7fe348155800 2021-11-12T05:40:50.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe34c9fb700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3480a1000 con 0x7fe328004500 2021-11-12T05:40:50.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe346d9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe348152760 0x7fe348152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:50.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe346d9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe348152760 0x7fe348152be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43446/0 (socket says 172.21.2.105:43446) 2021-11-12T05:40:50.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe346d9d700 1 -- 172.21.2.105:0/321812042 learned_addr learned my addr 172.21.2.105:0/321812042 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:50.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe345d9b700 1 --2- 172.21.2.105:0/321812042 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe348155800 0x7fe3480b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:50.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe34659c700 1 --2- 172.21.2.105:0/321812042 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe328004500 0x7fe3480a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:50.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe346d9d700 1 -- 172.21.2.105:0/321812042 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe328004500 msgr2=0x7fe3480a4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:50.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe346d9d700 1 --2- 172.21.2.105:0/321812042 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe328004500 0x7fe3480a4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:50.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe346d9d700 1 -- 172.21.2.105:0/321812042 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe348155800 msgr2=0x7fe3480b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:50.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe346d9d700 1 --2- 172.21.2.105:0/321812042 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe348155800 0x7fe3480b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:50.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe346d9d700 1 -- 172.21.2.105:0/321812042 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3480a12a0 con 0x7fe348152760 2021-11-12T05:40:50.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.234+0000 7fe346d9d700 1 --2- 172.21.2.105:0/321812042 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe348152760 0x7fe348152be0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fe340001bc0 tx=0x7fe340009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:50.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.238+0000 7fe33f7fe700 1 -- 172.21.2.105:0/321812042 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe340004ab0 con 0x7fe348152760 2021-11-12T05:40:50.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.238+0000 7fe33f7fe700 1 -- 172.21.2.105:0/321812042 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe340004c10 con 0x7fe348152760 2021-11-12T05:40:50.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.238+0000 7fe33f7fe700 1 -- 172.21.2.105:0/321812042 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3400070d0 con 0x7fe348152760 2021-11-12T05:40:50.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.238+0000 7fe34c9fb700 1 -- 172.21.2.105:0/321812042 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3480a0cf0 con 0x7fe348152760 2021-11-12T05:40:50.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.238+0000 7fe34c9fb700 1 -- 172.21.2.105:0/321812042 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3480a0930 con 0x7fe348152760 2021-11-12T05:40:50.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.238+0000 7fe34c9fb700 1 -- 172.21.2.105:0/321812042 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3480af570 con 0x7fe348152760 2021-11-12T05:40:50.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.238+0000 7fe33f7fe700 1 -- 172.21.2.105:0/321812042 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe340007230 con 0x7fe348152760 2021-11-12T05:40:50.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.238+0000 7fe33f7fe700 1 --2- 172.21.2.105:0/321812042 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe32c053660 0x7fe32c055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:50.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.238+0000 7fe33f7fe700 1 -- 172.21.2.105:0/321812042 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fe34006ba40 con 0x7fe348152760 2021-11-12T05:40:50.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.238+0000 7fe34659c700 1 --2- 172.21.2.105:0/321812042 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe32c053660 0x7fe32c055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:50.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.238+0000 7fe34659c700 1 --2- 172.21.2.105:0/321812042 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe32c053660 0x7fe32c055b20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fe33000c000 tx=0x7fe330009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:50.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.238+0000 7fe33f7fe700 1 -- 172.21.2.105:0/321812042 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe3400428d0 con 0x7fe348152760 2021-11-12T05:40:50.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.322+0000 7fe34c9fb700 1 -- 172.21.2.105:0/321812042 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe348057350 con 0x7fe348152760 2021-11-12T05:40:50.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.322+0000 7fe33f7fe700 1 -- 172.21.2.105:0/321812042 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe340045ef0 con 0x7fe348152760 2021-11-12T05:40:50.325 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:40:50.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.322+0000 7fe34c9fb700 1 -- 172.21.2.105:0/321812042 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe32c053660 msgr2=0x7fe32c055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:50.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.322+0000 7fe34c9fb700 1 --2- 172.21.2.105:0/321812042 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe32c053660 0x7fe32c055b20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fe33000c000 tx=0x7fe330009040).stop 2021-11-12T05:40:50.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.322+0000 7fe34c9fb700 1 -- 172.21.2.105:0/321812042 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe348152760 msgr2=0x7fe348152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:50.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.322+0000 7fe34c9fb700 1 --2- 172.21.2.105:0/321812042 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe348152760 0x7fe348152be0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fe340001bc0 tx=0x7fe340009040).stop 2021-11-12T05:40:50.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.322+0000 7fe34c9fb700 1 -- 172.21.2.105:0/321812042 shutdown_connections 2021-11-12T05:40:50.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.322+0000 7fe34c9fb700 1 --2- 172.21.2.105:0/321812042 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe32c053660 0x7fe32c055b20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:50.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.322+0000 7fe34c9fb700 1 --2- 172.21.2.105:0/321812042 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe348152760 0x7fe348152be0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:50.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.322+0000 7fe34c9fb700 1 --2- 172.21.2.105:0/321812042 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe348155800 0x7fe3480b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:50.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.322+0000 7fe34c9fb700 1 --2- 172.21.2.105:0/321812042 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe328004500 0x7fe3480a4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:50.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.322+0000 7fe34c9fb700 1 -- 172.21.2.105:0/321812042 >> 172.21.2.105:0/321812042 conn(0x7fe34805c490 msgr2=0x7fe3480ad960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:50.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.322+0000 7fe34c9fb700 1 -- 172.21.2.105:0/321812042 shutdown_connections 2021-11-12T05:40:50.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.322+0000 7fe34c9fb700 1 -- 172.21.2.105:0/321812042 wait complete. 2021-11-12T05:40:50.332 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:40:50.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.382+0000 7fad12e06700 1 Processor -- start 2021-11-12T05:40:50.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.382+0000 7fad12e06700 1 -- start start 2021-11-12T05:40:50.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.382+0000 7fad12e06700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fad0c0b2e20 0x7fad0c0b1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:50.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.382+0000 7fad12e06700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fad0c142c50 0x7fad0c143070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:50.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.382+0000 7fad12e06700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad0c0ad400 con 0x7fad0c13ea50 2021-11-12T05:40:50.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.382+0000 7fad12e06700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad0c0b3200 con 0x7fad0c142c50 2021-11-12T05:40:50.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.382+0000 7fad12e06700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad0c0ad660 con 0x7fad0c0b2e20 2021-11-12T05:40:50.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.382+0000 7fad113a3700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fad0c142c50 0x7fad0c143070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:50.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.382+0000 7fad113a3700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fad0c142c50 0x7fad0c143070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43450/0 (socket says 172.21.2.105:43450) 2021-11-12T05:40:50.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.382+0000 7fad113a3700 1 -- 172.21.2.105:0/1750664994 learned_addr learned my addr 172.21.2.105:0/1750664994 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:50.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.382+0000 7fad113a3700 1 -- 172.21.2.105:0/1750664994 >> v2:172.21.2.115:3300/0 conn(0x7fad0c0b2e20 msgr2=0x7fad0c0b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:50.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.382+0000 7fad113a3700 1 --2- 172.21.2.105:0/1750664994 >> v2:172.21.2.115:3300/0 conn(0x7fad0c0b2e20 0x7fad0c0b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:50.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.382+0000 7fad113a3700 1 -- 172.21.2.105:0/1750664994 >> v1:172.21.2.115:6789/0 conn(0x7fad0c13ea50 legacy=0x7fad0c13eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:50.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.382+0000 7fad113a3700 1 -- 172.21.2.105:0/1750664994 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0c0ad900 con 0x7fad0c142c50 2021-11-12T05:40:50.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.382+0000 7fad113a3700 1 --2- 172.21.2.105:0/1750664994 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fad0c142c50 0x7fad0c143070 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fad0c0b3520 tx=0x7fad0400b530).ready entity=mon.0 client_cookie=5b6202b111b6be7f server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:50.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.382+0000 7fad0b7fe700 1 -- 172.21.2.105:0/1750664994 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad040155e0 con 0x7fad0c142c50 2021-11-12T05:40:50.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.382+0000 7fad0b7fe700 1 -- 172.21.2.105:0/1750664994 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad04015740 con 0x7fad0c142c50 2021-11-12T05:40:50.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.382+0000 7fad0b7fe700 1 -- 172.21.2.105:0/1750664994 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad04015aa0 con 0x7fad0c142c50 2021-11-12T05:40:50.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.382+0000 7fad12e06700 1 -- 172.21.2.105:0/1750664994 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fad0c142c50 msgr2=0x7fad0c143070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:50.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.382+0000 7fad12e06700 1 --2- 172.21.2.105:0/1750664994 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fad0c142c50 0x7fad0c143070 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fad0c0b3520 tx=0x7fad0400b530).stop 2021-11-12T05:40:50.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.382+0000 7fad12e06700 1 -- 172.21.2.105:0/1750664994 shutdown_connections 2021-11-12T05:40:50.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.382+0000 7fad12e06700 1 --2- 172.21.2.105:0/1750664994 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fad0c142c50 0x7fad0c143070 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:50.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.382+0000 7fad12e06700 1 --2- 172.21.2.105:0/1750664994 >> v2:172.21.2.115:3300/0 conn(0x7fad0c0b2e20 0x7fad0c0b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:50.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.382+0000 7fad12e06700 1 -- 172.21.2.105:0/1750664994 >> 172.21.2.105:0/1750664994 conn(0x7fad0c062f60 msgr2=0x7fad0c063370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:50.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.382+0000 7fad12e06700 1 -- 172.21.2.105:0/1750664994 shutdown_connections 2021-11-12T05:40:50.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.382+0000 7fad12e06700 1 -- 172.21.2.105:0/1750664994 wait complete. 2021-11-12T05:40:50.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.386+0000 7fad12e06700 1 Processor -- start 2021-11-12T05:40:50.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.386+0000 7fad12e06700 1 -- start start 2021-11-12T05:40:50.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.386+0000 7fad12e06700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fad0c0b2e20 0x7fad0c0a8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:50.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.386+0000 7fad12e06700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fad0c13ea50 0x7fad0c13c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:50.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.386+0000 7fad12e06700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fad0c142c50 0x7fad0c13dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:50.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.386+0000 7fad12e06700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c0ab2f0 con 0x7fad0c142c50 2021-11-12T05:40:50.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.386+0000 7fad12e06700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c0ab590 con 0x7fad0c0b2e20 2021-11-12T05:40:50.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.386+0000 7fad12e06700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c13d900 con 0x7fad0c13ea50 2021-11-12T05:40:50.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.386+0000 7fad113a3700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fad0c142c50 0x7fad0c13dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:50.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.386+0000 7fad113a3700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fad0c142c50 0x7fad0c13dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43460/0 (socket says 172.21.2.105:43460) 2021-11-12T05:40:50.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.386+0000 7fad113a3700 1 -- 172.21.2.105:0/906318276 learned_addr learned my addr 172.21.2.105:0/906318276 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:50.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.386+0000 7fad113a3700 1 -- 172.21.2.105:0/906318276 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fad0c13ea50 msgr2=0x7fad0c13c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:50.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.386+0000 7fad113a3700 1 --2- 172.21.2.105:0/906318276 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fad0c13ea50 0x7fad0c13c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:50.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.386+0000 7fad113a3700 1 -- 172.21.2.105:0/906318276 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fad0c0b2e20 msgr2=0x7fad0c0a8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:50.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.386+0000 7fad113a3700 1 --2- 172.21.2.105:0/906318276 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fad0c0b2e20 0x7fad0c0a8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:50.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.386+0000 7fad113a3700 1 -- 172.21.2.105:0/906318276 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0400b7d0 con 0x7fad0c142c50 2021-11-12T05:40:50.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.386+0000 7fad113a3700 1 --2- 172.21.2.105:0/906318276 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fad0c142c50 0x7fad0c13dda0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fad0c0b3520 tx=0x7fad04019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:50.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.386+0000 7fad09ffb700 1 -- 172.21.2.105:0/906318276 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad04009040 con 0x7fad0c142c50 2021-11-12T05:40:50.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.386+0000 7fad09ffb700 1 -- 172.21.2.105:0/906318276 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0401c580 con 0x7fad0c142c50 2021-11-12T05:40:50.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.386+0000 7fad12e06700 1 -- 172.21.2.105:0/906318276 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad0c0ac940 con 0x7fad0c142c50 2021-11-12T05:40:50.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.386+0000 7fad09ffb700 1 -- 172.21.2.105:0/906318276 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad0401c8e0 con 0x7fad0c142c50 2021-11-12T05:40:50.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.386+0000 7fad12e06700 1 -- 172.21.2.105:0/906318276 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad0c0aae50 con 0x7fad0c142c50 2021-11-12T05:40:50.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.386+0000 7fad12e06700 1 -- 172.21.2.105:0/906318276 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad0c0ab130 con 0x7fad0c142c50 2021-11-12T05:40:50.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.386+0000 7fad09ffb700 1 -- 172.21.2.105:0/906318276 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fad0401ca40 con 0x7fad0c142c50 2021-11-12T05:40:50.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.386+0000 7fad09ffb700 1 --2- 172.21.2.105:0/906318276 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7facf0053660 0x7facf0055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:50.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.386+0000 7fad09ffb700 1 -- 172.21.2.105:0/906318276 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fad0406d950 con 0x7fad0c142c50 2021-11-12T05:40:50.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.386+0000 7fad10ba2700 1 --2- 172.21.2.105:0/906318276 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7facf0053660 0x7facf0055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:50.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.386+0000 7fad10ba2700 1 --2- 172.21.2.105:0/906318276 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7facf0053660 0x7facf0055b20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7facf4002f70 tx=0x7facf4006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:50.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.390+0000 7fad09ffb700 1 -- 172.21.2.105:0/906318276 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fad04044840 con 0x7fad0c142c50 2021-11-12T05:40:50.475 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.474+0000 7fad12e06700 1 -- 172.21.2.105:0/906318276 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fad0c13dac0 con 0x7fad0c142c50 2021-11-12T05:40:50.476 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.474+0000 7fad09ffb700 1 -- 172.21.2.105:0/906318276 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fad04047e60 con 0x7fad0c142c50 2021-11-12T05:40:50.476 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:40:50.477 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.474+0000 7fad12e06700 1 -- 172.21.2.105:0/906318276 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7facf0053660 msgr2=0x7facf0055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:50.477 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.474+0000 7fad12e06700 1 --2- 172.21.2.105:0/906318276 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7facf0053660 0x7facf0055b20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7facf4002f70 tx=0x7facf4006a80).stop 2021-11-12T05:40:50.478 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.474+0000 7fad12e06700 1 -- 172.21.2.105:0/906318276 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fad0c142c50 msgr2=0x7fad0c13dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:50.478 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.474+0000 7fad12e06700 1 --2- 172.21.2.105:0/906318276 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fad0c142c50 0x7fad0c13dda0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fad0c0b3520 tx=0x7fad04019000).stop 2021-11-12T05:40:50.478 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.474+0000 7fad12e06700 1 -- 172.21.2.105:0/906318276 shutdown_connections 2021-11-12T05:40:50.478 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.474+0000 7fad12e06700 1 --2- 172.21.2.105:0/906318276 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7facf0053660 0x7facf0055b20 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:50.479 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.474+0000 7fad12e06700 1 --2- 172.21.2.105:0/906318276 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fad0c142c50 0x7fad0c13dda0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:50.479 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.474+0000 7fad12e06700 1 --2- 172.21.2.105:0/906318276 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fad0c13ea50 0x7fad0c13c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:50.479 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.474+0000 7fad12e06700 1 --2- 172.21.2.105:0/906318276 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fad0c0b2e20 0x7fad0c0a8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:50.479 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.474+0000 7fad12e06700 1 -- 172.21.2.105:0/906318276 >> 172.21.2.105:0/906318276 conn(0x7fad0c062f60 msgr2=0x7fad0c0aeb20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:50.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.474+0000 7fad12e06700 1 -- 172.21.2.105:0/906318276 shutdown_connections 2021-11-12T05:40:50.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.474+0000 7fad12e06700 1 -- 172.21.2.105:0/906318276 wait complete. 2021-11-12T05:40:50.483 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-12T05:40:50.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.534+0000 7fac87378700 1 Processor -- start 2021-11-12T05:40:50.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.534+0000 7fac87378700 1 -- start start 2021-11-12T05:40:50.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.534+0000 7fac87378700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fac80062ac0 0x7fac8014a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:50.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.534+0000 7fac87378700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fac80148010 0x7fac80146850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:50.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.534+0000 7fac87378700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac800aee30 con 0x7fac800b2950 2021-11-12T05:40:50.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.534+0000 7fac87378700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac800b3020 con 0x7fac80148010 2021-11-12T05:40:50.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.534+0000 7fac87378700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac800af0d0 con 0x7fac80062ac0 2021-11-12T05:40:50.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.534+0000 7fac85915700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fac80148010 0x7fac80146850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:50.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.534+0000 7fac84913700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fac800b2950 0x7fac80147900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:53864/0 (socket says 172.21.2.105:53864) 2021-11-12T05:40:50.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.534+0000 7fac84913700 1 -- 172.21.2.105:0/4218219501 learned_addr learned my addr 172.21.2.105:0/4218219501 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:50.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.534+0000 7fac85915700 1 -- 172.21.2.105:0/4218219501 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fac80062ac0 msgr2=0x7fac8014a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:50.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.534+0000 7fac85915700 1 --2- 172.21.2.105:0/4218219501 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fac80062ac0 0x7fac8014a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:50.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.534+0000 7fac85915700 1 -- 172.21.2.105:0/4218219501 >> v1:172.21.2.105:6789/0 conn(0x7fac800b2950 legacy=0x7fac80147900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:50.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.534+0000 7fac85915700 1 -- 172.21.2.105:0/4218219501 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac80147460 con 0x7fac80148010 2021-11-12T05:40:50.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.534+0000 7fac85915700 1 --2- 172.21.2.105:0/4218219501 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fac80148010 0x7fac80146850 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fac780032f0 tx=0x7fac780091d0).ready entity=mon.0 client_cookie=3a68c79a806e815f server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:50.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.534+0000 7fac73fff700 1 -- 172.21.2.105:0/4218219501 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac78009ea0 con 0x7fac80148010 2021-11-12T05:40:50.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.534+0000 7fac73fff700 1 -- 172.21.2.105:0/4218219501 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7800b8a0 con 0x7fac80148010 2021-11-12T05:40:50.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.534+0000 7fac73fff700 1 -- 172.21.2.105:0/4218219501 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac7800ba10 con 0x7fac80148010 2021-11-12T05:40:50.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.534+0000 7fac87378700 1 -- 172.21.2.105:0/4218219501 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fac80148010 msgr2=0x7fac80146850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:50.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.534+0000 7fac87378700 1 --2- 172.21.2.105:0/4218219501 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fac80148010 0x7fac80146850 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fac780032f0 tx=0x7fac780091d0).stop 2021-11-12T05:40:50.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.534+0000 7fac87378700 1 -- 172.21.2.105:0/4218219501 shutdown_connections 2021-11-12T05:40:50.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.534+0000 7fac87378700 1 --2- 172.21.2.105:0/4218219501 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fac80148010 0x7fac80146850 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:50.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.534+0000 7fac87378700 1 --2- 172.21.2.105:0/4218219501 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fac80062ac0 0x7fac8014a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:50.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.534+0000 7fac87378700 1 -- 172.21.2.105:0/4218219501 >> 172.21.2.105:0/4218219501 conn(0x7fac8005c490 msgr2=0x7fac8005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:50.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.534+0000 7fac87378700 1 -- 172.21.2.105:0/4218219501 shutdown_connections 2021-11-12T05:40:50.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.534+0000 7fac87378700 1 -- 172.21.2.105:0/4218219501 wait complete. 2021-11-12T05:40:50.546 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.534+0000 7fac87378700 1 Processor -- start 2021-11-12T05:40:50.546 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.534+0000 7fac87378700 1 -- start start 2021-11-12T05:40:50.546 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.538+0000 7fac87378700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fac80062ac0 0x7fac8014b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:50.547 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.538+0000 7fac87378700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fac800b2950 0x7fac8014d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:50.547 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.538+0000 7fac87378700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fac80148010 0x7fac8015a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:50.548 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.538+0000 7fac87378700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac80065400 con 0x7fac800b2950 2021-11-12T05:40:50.548 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.538+0000 7fac87378700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac800656a0 con 0x7fac80148010 2021-11-12T05:40:50.548 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.538+0000 7fac87378700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac80141d30 con 0x7fac80062ac0 2021-11-12T05:40:50.549 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.538+0000 7fac84913700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fac800b2950 0x7fac8014d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:50.549 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.538+0000 7fac84913700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fac800b2950 0x7fac8014d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43472/0 (socket says 172.21.2.105:43472) 2021-11-12T05:40:50.549 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.538+0000 7fac84913700 1 -- 172.21.2.105:0/461365469 learned_addr learned my addr 172.21.2.105:0/461365469 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:50.549 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.538+0000 7fac84913700 1 -- 172.21.2.105:0/461365469 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fac80062ac0 msgr2=0x7fac8014b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:50.550 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.538+0000 7fac85114700 1 --2- 172.21.2.105:0/461365469 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fac80062ac0 0x7fac8014b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:50.550 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.538+0000 7fac85915700 1 --2- 172.21.2.105:0/461365469 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fac80148010 0x7fac8015a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:50.550 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.538+0000 7fac84913700 1 --2- 172.21.2.105:0/461365469 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fac80062ac0 0x7fac8014b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:50.550 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.538+0000 7fac84913700 1 -- 172.21.2.105:0/461365469 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fac80148010 msgr2=0x7fac8015a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:50.550 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.538+0000 7fac84913700 1 --2- 172.21.2.105:0/461365469 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fac80148010 0x7fac8015a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:50.551 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.538+0000 7fac84913700 1 -- 172.21.2.105:0/461365469 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac78009470 con 0x7fac800b2950 2021-11-12T05:40:50.551 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.538+0000 7fac85915700 1 --2- 172.21.2.105:0/461365469 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fac80148010 0x7fac8015a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:40:50.551 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.538+0000 7fac85114700 1 --2- 172.21.2.105:0/461365469 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fac80062ac0 0x7fac8014b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:40:50.551 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.538+0000 7fac84913700 1 --2- 172.21.2.105:0/461365469 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fac800b2950 0x7fac8014d270 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7fac801477e0 tx=0x7fac74007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:50.552 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.538+0000 7fac727fc700 1 -- 172.21.2.105:0/461365469 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac7400ce30 con 0x7fac800b2950 2021-11-12T05:40:50.552 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.538+0000 7fac727fc700 1 -- 172.21.2.105:0/461365469 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac740072e0 con 0x7fac800b2950 2021-11-12T05:40:50.552 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.538+0000 7fac727fc700 1 -- 172.21.2.105:0/461365469 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac74005800 con 0x7fac800b2950 2021-11-12T05:40:50.552 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.538+0000 7fac87378700 1 -- 172.21.2.105:0/461365469 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac8014d760 con 0x7fac800b2950 2021-11-12T05:40:50.552 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.538+0000 7fac87378700 1 -- 172.21.2.105:0/461365469 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac8014bba0 con 0x7fac800b2950 2021-11-12T05:40:50.553 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.538+0000 7fac87378700 1 -- 172.21.2.105:0/461365469 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac8014c9d0 con 0x7fac800b2950 2021-11-12T05:40:50.553 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.538+0000 7fac727fc700 1 -- 172.21.2.105:0/461365469 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fac74010070 con 0x7fac800b2950 2021-11-12T05:40:50.553 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.538+0000 7fac727fc700 1 --2- 172.21.2.105:0/461365469 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fac60053660 0x7fac60055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:50.553 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.538+0000 7fac727fc700 1 -- 172.21.2.105:0/461365469 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fac7406b2c0 con 0x7fac800b2950 2021-11-12T05:40:50.554 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.538+0000 7fac85114700 1 --2- 172.21.2.105:0/461365469 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fac60053660 0x7fac60055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:50.554 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.538+0000 7fac85114700 1 --2- 172.21.2.105:0/461365469 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fac60053660 0x7fac60055b20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fac7c007000 tx=0x7fac7c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:50.554 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.542+0000 7fac727fc700 1 -- 172.21.2.105:0/461365469 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fac8014c9d0 con 0x7fac800b2950 2021-11-12T05:40:50.626 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.622+0000 7fac87378700 1 -- 172.21.2.105:0/461365469 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fac8014c9d0 con 0x7fac800b2950 2021-11-12T05:40:50.626 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.622+0000 7fac727fc700 1 -- 172.21.2.105:0/461365469 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7fac8014c9d0 con 0x7fac800b2950 2021-11-12T05:40:50.627 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:40:50.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.626+0000 7fac87378700 1 -- 172.21.2.105:0/461365469 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fac60053660 msgr2=0x7fac60055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:50.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.626+0000 7fac87378700 1 --2- 172.21.2.105:0/461365469 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fac60053660 0x7fac60055b20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fac7c007000 tx=0x7fac7c008040).stop 2021-11-12T05:40:50.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.626+0000 7fac87378700 1 -- 172.21.2.105:0/461365469 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fac800b2950 msgr2=0x7fac8014d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:50.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.626+0000 7fac87378700 1 --2- 172.21.2.105:0/461365469 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fac800b2950 0x7fac8014d270 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7fac801477e0 tx=0x7fac74007c40).stop 2021-11-12T05:40:50.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.626+0000 7fac87378700 1 -- 172.21.2.105:0/461365469 shutdown_connections 2021-11-12T05:40:50.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.626+0000 7fac87378700 1 --2- 172.21.2.105:0/461365469 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fac60053660 0x7fac60055b20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:50.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.626+0000 7fac87378700 1 --2- 172.21.2.105:0/461365469 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fac80148010 0x7fac8015a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:50.630 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.626+0000 7fac87378700 1 --2- 172.21.2.105:0/461365469 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fac800b2950 0x7fac8014d270 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:50.630 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.626+0000 7fac87378700 1 --2- 172.21.2.105:0/461365469 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fac80062ac0 0x7fac8014b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:50.630 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.626+0000 7fac87378700 1 -- 172.21.2.105:0/461365469 >> 172.21.2.105:0/461365469 conn(0x7fac8005c490 msgr2=0x7fac8005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:50.630 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.626+0000 7fac87378700 1 -- 172.21.2.105:0/461365469 shutdown_connections 2021-11-12T05:40:50.630 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.626+0000 7fac87378700 1 -- 172.21.2.105:0/461365469 wait complete. 2021-11-12T05:40:50.634 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-12T05:40:50.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.682+0000 7f16c51e9700 1 Processor -- start 2021-11-12T05:40:50.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.682+0000 7f16c51e9700 1 -- start start 2021-11-12T05:40:50.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.682+0000 7f16c51e9700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f16c00621b0 0x7f16c0143c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:50.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.682+0000 7f16c51e9700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f16c00b40d0 0x7f16c0147110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:50.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.682+0000 7f16c51e9700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c0143070 con 0x7f16c00b47f0 2021-11-12T05:40:50.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.682+0000 7f16c51e9700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c00b52e0 con 0x7f16c00621b0 2021-11-12T05:40:50.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.682+0000 7f16c51e9700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c00b5fc0 con 0x7f16c00b40d0 2021-11-12T05:40:50.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.682+0000 7f16bed9d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f16c00621b0 0x7f16c0143c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:50.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16bed9d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f16c00621b0 0x7f16c0143c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43478/0 (socket says 172.21.2.105:43478) 2021-11-12T05:40:50.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16bed9d700 1 -- 172.21.2.105:0/1631559971 learned_addr learned my addr 172.21.2.105:0/1631559971 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:50.692 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16bed9d700 1 -- 172.21.2.105:0/1631559971 >> v2:172.21.2.115:3300/0 conn(0x7f16c00b40d0 msgr2=0x7f16c0147110 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:40:50.692 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16bed9d700 1 --2- 172.21.2.105:0/1631559971 >> v2:172.21.2.115:3300/0 conn(0x7f16c00b40d0 0x7f16c0147110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:50.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16bed9d700 1 -- 172.21.2.105:0/1631559971 >> v1:172.21.2.115:6789/0 conn(0x7f16c00b47f0 legacy=0x7f16c00b4bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:40:50.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16bed9d700 1 -- 172.21.2.105:0/1631559971 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c0062590 con 0x7f16c00621b0 2021-11-12T05:40:50.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16bed9d700 1 --2- 172.21.2.105:0/1631559971 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f16c00621b0 0x7f16c0143c80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f16c0063070 tx=0x7f16b0006eb0).ready entity=mon.0 client_cookie=e84ca92f60bff6a6 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:50.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16bdd9b700 1 -- 172.21.2.105:0/1631559971 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16b000d5c0 con 0x7f16c00621b0 2021-11-12T05:40:50.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16bdd9b700 1 -- 172.21.2.105:0/1631559971 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b0000e90 con 0x7f16c00621b0 2021-11-12T05:40:50.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16bdd9b700 1 -- 172.21.2.105:0/1631559971 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16b000d910 con 0x7f16c00621b0 2021-11-12T05:40:50.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16c51e9700 1 -- 172.21.2.105:0/1631559971 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f16c00621b0 msgr2=0x7f16c0143c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:50.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16c51e9700 1 --2- 172.21.2.105:0/1631559971 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f16c00621b0 0x7f16c0143c80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f16c0063070 tx=0x7f16b0006eb0).stop 2021-11-12T05:40:50.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16c51e9700 1 -- 172.21.2.105:0/1631559971 shutdown_connections 2021-11-12T05:40:50.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16c51e9700 1 --2- 172.21.2.105:0/1631559971 >> v2:172.21.2.115:3300/0 conn(0x7f16c00b40d0 0x7f16c0147110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:50.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16c51e9700 1 --2- 172.21.2.105:0/1631559971 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f16c00621b0 0x7f16c0143c80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:50.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16c51e9700 1 -- 172.21.2.105:0/1631559971 >> 172.21.2.105:0/1631559971 conn(0x7f16c00b9730 msgr2=0x7f16c00b9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:50.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16c51e9700 1 -- 172.21.2.105:0/1631559971 shutdown_connections 2021-11-12T05:40:50.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16c51e9700 1 -- 172.21.2.105:0/1631559971 wait complete. 2021-11-12T05:40:50.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16c51e9700 1 Processor -- start 2021-11-12T05:40:50.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16c51e9700 1 -- start start 2021-11-12T05:40:50.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16c51e9700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f16c00621b0 0x7f16c00b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:50.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16c51e9700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f16c00b40d0 0x7f16c015a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:50.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16c51e9700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f16c00b47f0 0x7f16c0156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:50.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16c51e9700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c0136120 con 0x7f16c00b47f0 2021-11-12T05:40:50.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16c51e9700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c015a110 con 0x7f16c00621b0 2021-11-12T05:40:50.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16c51e9700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c0135da0 con 0x7f16c00b40d0 2021-11-12T05:40:50.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16bf59e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f16c00b47f0 0x7f16c0156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:50.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16bf59e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f16c00b47f0 0x7f16c0156a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43488/0 (socket says 172.21.2.105:43488) 2021-11-12T05:40:50.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16bf59e700 1 -- 172.21.2.105:0/1909503144 learned_addr learned my addr 172.21.2.105:0/1909503144 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:50.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16bf59e700 1 -- 172.21.2.105:0/1909503144 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f16c00b40d0 msgr2=0x7f16c015a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:50.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16bf59e700 1 --2- 172.21.2.105:0/1909503144 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f16c00b40d0 0x7f16c015a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:50.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16bf59e700 1 -- 172.21.2.105:0/1909503144 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f16c00621b0 msgr2=0x7f16c00b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:50.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16bf59e700 1 --2- 172.21.2.105:0/1909503144 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f16c00621b0 0x7f16c00b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:50.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16bf59e700 1 -- 172.21.2.105:0/1909503144 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b000b1e0 con 0x7f16c00b47f0 2021-11-12T05:40:50.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16bf59e700 1 --2- 172.21.2.105:0/1909503144 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f16c00b47f0 0x7f16c0156a60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f16b8001250 tx=0x7f16b80090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:50.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16b7fff700 1 -- 172.21.2.105:0/1909503144 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16b80014e0 con 0x7f16c00b47f0 2021-11-12T05:40:50.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16b7fff700 1 -- 172.21.2.105:0/1909503144 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b8001640 con 0x7f16c00b47f0 2021-11-12T05:40:50.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16b7fff700 1 -- 172.21.2.105:0/1909503144 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16b80019a0 con 0x7f16c00b47f0 2021-11-12T05:40:50.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16c51e9700 1 -- 172.21.2.105:0/1909503144 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c00648c0 con 0x7f16c00b47f0 2021-11-12T05:40:50.701 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.686+0000 7f16c51e9700 1 -- 172.21.2.105:0/1909503144 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c015aee0 con 0x7f16c00b47f0 2021-11-12T05:40:50.701 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.690+0000 7f16c51e9700 1 -- 172.21.2.105:0/1909503144 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c01432a0 con 0x7f16c00b47f0 2021-11-12T05:40:50.701 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.690+0000 7f16b7fff700 1 -- 172.21.2.105:0/1909503144 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f16b8018030 con 0x7f16c00b47f0 2021-11-12T05:40:50.701 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.690+0000 7f16b7fff700 1 --2- 172.21.2.105:0/1909503144 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f16a40536d0 0x7f16a4055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:50.701 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.690+0000 7f16b7fff700 1 -- 172.21.2.105:0/1909503144 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f16b806b380 con 0x7f16c00b47f0 2021-11-12T05:40:50.702 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.690+0000 7f16bed9d700 1 --2- 172.21.2.105:0/1909503144 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f16a40536d0 0x7f16a4055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:50.702 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.690+0000 7f16bed9d700 1 --2- 172.21.2.105:0/1909503144 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f16a40536d0 0x7f16a4055b90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f16c0063070 tx=0x7f16b0015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:50.702 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.690+0000 7f16b7fff700 1 -- 172.21.2.105:0/1909503144 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f16b8042430 con 0x7f16c00b47f0 2021-11-12T05:40:50.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.774+0000 7f16c51e9700 1 -- 172.21.2.105:0/1909503144 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f16c005f280 con 0x7f16c00b47f0 2021-11-12T05:40:50.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.778+0000 7f16b7fff700 1 -- 172.21.2.105:0/1909503144 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7f16b8045a50 con 0x7f16c00b47f0 2021-11-12T05:40:50.779 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:40:50.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.778+0000 7f16c51e9700 1 -- 172.21.2.105:0/1909503144 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f16a40536d0 msgr2=0x7f16a4055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:50.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.778+0000 7f16c51e9700 1 --2- 172.21.2.105:0/1909503144 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f16a40536d0 0x7f16a4055b90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f16c0063070 tx=0x7f16b0015000).stop 2021-11-12T05:40:50.781 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.778+0000 7f16c51e9700 1 -- 172.21.2.105:0/1909503144 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f16c00b47f0 msgr2=0x7f16c0156a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:50.781 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.778+0000 7f16c51e9700 1 --2- 172.21.2.105:0/1909503144 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f16c00b47f0 0x7f16c0156a60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f16b8001250 tx=0x7f16b80090f0).stop 2021-11-12T05:40:50.781 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.778+0000 7f16c51e9700 1 -- 172.21.2.105:0/1909503144 shutdown_connections 2021-11-12T05:40:50.781 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.778+0000 7f16c51e9700 1 --2- 172.21.2.105:0/1909503144 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f16a40536d0 0x7f16a4055b90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:50.782 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.778+0000 7f16c51e9700 1 --2- 172.21.2.105:0/1909503144 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f16c00b47f0 0x7f16c0156a60 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:50.782 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.778+0000 7f16c51e9700 1 --2- 172.21.2.105:0/1909503144 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f16c00b40d0 0x7f16c015a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:50.782 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.778+0000 7f16c51e9700 1 --2- 172.21.2.105:0/1909503144 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f16c00621b0 0x7f16c00b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:50.782 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.778+0000 7f16c51e9700 1 -- 172.21.2.105:0/1909503144 >> 172.21.2.105:0/1909503144 conn(0x7f16c00b9730 msgr2=0x7f16c00ae850 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:50.783 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.778+0000 7f16c51e9700 1 -- 172.21.2.105:0/1909503144 shutdown_connections 2021-11-12T05:40:50.783 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.778+0000 7f16c51e9700 1 -- 172.21.2.105:0/1909503144 wait complete. 2021-11-12T05:40:50.786 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-12T05:40:50.787 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:40:50.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.834+0000 7fee6113f700 1 Processor -- start 2021-11-12T05:40:50.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.834+0000 7fee6113f700 1 -- start start 2021-11-12T05:40:50.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.834+0000 7fee6113f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fee5c0ad080 0x7fee5c0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:50.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.834+0000 7fee6113f700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee5c0ac7b0 con 0x7fee5c0ac280 2021-11-12T05:40:50.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.834+0000 7fee6113f700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee5c0ac9e0 con 0x7fee5c14b2f0 2021-11-12T05:40:50.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.834+0000 7fee6113f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c1488a0 con 0x7fee5c0ad080 2021-11-12T05:40:50.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.834+0000 7fee5a59c700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fee5c0ac280 0x7fee5c14abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:53888/0 (socket says 172.21.2.105:53888) 2021-11-12T05:40:50.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.834+0000 7fee5a59c700 1 -- 172.21.2.105:0/3692009729 learned_addr learned my addr 172.21.2.105:0/3692009729 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:50.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.834+0000 7fee59d9b700 1 -- 172.21.2.105:0/3692009729 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2444536283 0 0) 0x7fee5c0ac7b0 con 0x7fee5c0ac280 2021-11-12T05:40:50.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.834+0000 7fee59d9b700 1 -- 172.21.2.105:0/3692009729 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee3c003260 con 0x7fee5c0ac280 2021-11-12T05:40:50.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.834+0000 7fee5ad9d700 1 --2- 172.21.2.105:0/3692009729 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fee5c0ad080 0x7fee5c0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:50.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.834+0000 7fee59d9b700 1 -- 172.21.2.105:0/3692009729 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 170180466 0 0) 0x7fee3c003260 con 0x7fee5c0ac280 2021-11-12T05:40:50.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.834+0000 7fee59d9b700 1 -- 172.21.2.105:0/3692009729 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fee5c0ad080 msgr2=0x7fee5c0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:50.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.834+0000 7fee59d9b700 1 --2- 172.21.2.105:0/3692009729 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fee5c0ad080 0x7fee5c0af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:50.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.834+0000 7fee59d9b700 1 -- 172.21.2.105:0/3692009729 >> v1:172.21.2.115:6789/0 conn(0x7fee5c14b2f0 legacy=0x7fee5c147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:50.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.834+0000 7fee59d9b700 1 -- 172.21.2.105:0/3692009729 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee5c0b0b30 con 0x7fee5c0ac280 2021-11-12T05:40:50.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.834+0000 7fee59d9b700 1 -- 172.21.2.105:0/3692009729 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fee4c001660 con 0x7fee5c0ac280 2021-11-12T05:40:50.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.834+0000 7fee59d9b700 1 -- 172.21.2.105:0/3692009729 >> v1:172.21.2.105:6789/0 conn(0x7fee5c0ac280 legacy=0x7fee5c14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:50.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.834+0000 7fee59d9b700 1 --2- 172.21.2.105:0/3692009729 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fee3c003800 0x7fee3c003c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:50.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.834+0000 7fee59d9b700 1 --2- 172.21.2.105:0/3692009729 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fee5c0ad080 0x7fee3c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:50.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.834+0000 7fee59d9b700 1 --2- 172.21.2.105:0/3692009729 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee3c004b10 0x7fee3c004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:50.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.834+0000 7fee59d9b700 1 -- 172.21.2.105:0/3692009729 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c1488a0 con 0x7fee3c004b10 2021-11-12T05:40:50.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.834+0000 7fee59d9b700 1 -- 172.21.2.105:0/3692009729 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3c00b910 con 0x7fee3c003800 2021-11-12T05:40:50.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.834+0000 7fee59d9b700 1 -- 172.21.2.105:0/3692009729 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee3c00bad0 con 0x7fee5c0ad080 2021-11-12T05:40:50.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.834+0000 7fee5b59e700 1 --2- 172.21.2.105:0/3692009729 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee3c004b10 0x7fee3c004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:50.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee5b59e700 1 -- 172.21.2.105:0/3692009729 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fee5c0ad080 msgr2=0x7fee3c004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:50.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee5b59e700 1 --2- 172.21.2.105:0/3692009729 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fee5c0ad080 0x7fee3c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:50.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee5b59e700 1 -- 172.21.2.105:0/3692009729 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fee3c003800 msgr2=0x7fee3c003c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:50.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee5b59e700 1 --2- 172.21.2.105:0/3692009729 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fee3c003800 0x7fee3c003c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:50.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee5b59e700 1 -- 172.21.2.105:0/3692009729 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee3c003260 con 0x7fee3c004b10 2021-11-12T05:40:50.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee5b59e700 1 --2- 172.21.2.105:0/3692009729 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee3c004b10 0x7fee3c004f90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fee54002320 tx=0x7fee54007d80).ready entity=mon.0 client_cookie=6fb05b3087a5e854 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:50.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee59d9b700 1 -- 172.21.2.105:0/3692009729 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee54002510 con 0x7fee3c004b10 2021-11-12T05:40:50.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee59d9b700 1 -- 172.21.2.105:0/3692009729 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee54006890 con 0x7fee3c004b10 2021-11-12T05:40:50.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee59d9b700 1 -- 172.21.2.105:0/3692009729 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee54006bf0 con 0x7fee3c004b10 2021-11-12T05:40:50.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee6113f700 1 -- 172.21.2.105:0/3692009729 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee3c004b10 msgr2=0x7fee3c004f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:50.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee6113f700 1 --2- 172.21.2.105:0/3692009729 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee3c004b10 0x7fee3c004f90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fee54002320 tx=0x7fee54007d80).stop 2021-11-12T05:40:50.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee5b59e700 1 -- 172.21.2.105:0/3692009729 reap_dead start 2021-11-12T05:40:50.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee6113f700 1 -- 172.21.2.105:0/3692009729 shutdown_connections 2021-11-12T05:40:50.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee6113f700 1 -- 172.21.2.105:0/3692009729 >> 172.21.2.105:0/3692009729 conn(0x7fee5c0b5370 msgr2=0x7fee5c0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:50.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee6113f700 1 -- 172.21.2.105:0/3692009729 shutdown_connections 2021-11-12T05:40:50.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee6113f700 1 -- 172.21.2.105:0/3692009729 wait complete. 2021-11-12T05:40:50.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee6113f700 1 Processor -- start 2021-11-12T05:40:50.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee6113f700 1 -- start start 2021-11-12T05:40:50.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee6113f700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee3c004b10 0x7fee5c063a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:50.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee6113f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fee5c0a9750 0x7fee5c0aaf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:50.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee6113f700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fee5c0ab420 0x7fee5c0a8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:50.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee6113f700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c0a9320 con 0x7fee3c004b10 2021-11-12T05:40:50.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee6113f700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c063f80 con 0x7fee5c0ab420 2021-11-12T05:40:50.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee6113f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c0aa5c0 con 0x7fee5c0a9750 2021-11-12T05:40:50.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee5ad9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee3c004b10 0x7fee5c063a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:50.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee5ad9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee3c004b10 0x7fee5c063a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43504/0 (socket says 172.21.2.105:43504) 2021-11-12T05:40:50.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee5ad9d700 1 -- 172.21.2.105:0/1682338125 learned_addr learned my addr 172.21.2.105:0/1682338125 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:50.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee5ad9d700 1 -- 172.21.2.105:0/1682338125 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fee5c0a9750 msgr2=0x7fee5c0aaf30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:40:50.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee5ad9d700 1 --2- 172.21.2.105:0/1682338125 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fee5c0a9750 0x7fee5c0aaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:50.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee5ad9d700 1 -- 172.21.2.105:0/1682338125 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fee5c0ab420 msgr2=0x7fee5c0a8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:50.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee5ad9d700 1 --2- 172.21.2.105:0/1682338125 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fee5c0ab420 0x7fee5c0a8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:50.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee5ad9d700 1 -- 172.21.2.105:0/1682338125 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee5c0aa860 con 0x7fee3c004b10 2021-11-12T05:40:50.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee5ad9d700 1 --2- 172.21.2.105:0/1682338125 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee3c004b10 0x7fee5c063a90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fee4400a000 tx=0x7fee44008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:50.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee53fff700 1 -- 172.21.2.105:0/1682338125 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee44016070 con 0x7fee3c004b10 2021-11-12T05:40:50.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee53fff700 1 -- 172.21.2.105:0/1682338125 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee44000e90 con 0x7fee3c004b10 2021-11-12T05:40:50.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee53fff700 1 -- 172.21.2.105:0/1682338125 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee44011970 con 0x7fee3c004b10 2021-11-12T05:40:50.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee6113f700 1 -- 172.21.2.105:0/1682338125 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee5c0a8520 con 0x7fee3c004b10 2021-11-12T05:40:50.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee6113f700 1 -- 172.21.2.105:0/1682338125 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee5c0a8a50 con 0x7fee3c004b10 2021-11-12T05:40:50.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee6113f700 1 -- 172.21.2.105:0/1682338125 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee5c0a9490 con 0x7fee3c004b10 2021-11-12T05:40:50.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.838+0000 7fee53fff700 1 -- 172.21.2.105:0/1682338125 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fee44011ad0 con 0x7fee3c004b10 2021-11-12T05:40:50.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.842+0000 7fee53fff700 1 --2- 172.21.2.105:0/1682338125 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fee400536f0 0x7fee40055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:50.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.842+0000 7fee53fff700 1 -- 172.21.2.105:0/1682338125 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fee4406b9a0 con 0x7fee3c004b10 2021-11-12T05:40:50.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.842+0000 7fee5a59c700 1 --2- 172.21.2.105:0/1682338125 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fee400536f0 0x7fee40055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:50.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.842+0000 7fee5a59c700 1 --2- 172.21.2.105:0/1682338125 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fee400536f0 0x7fee40055bb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fee5c0b6060 tx=0x7fee5c0b0fd0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:50.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.842+0000 7fee53fff700 1 -- 172.21.2.105:0/1682338125 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fee5c0a9490 con 0x7fee3c004b10 2021-11-12T05:40:50.953 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.950+0000 7fee6113f700 1 -- 172.21.2.105:0/1682338125 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee5c0a9460 con 0x7fee3c004b10 2021-11-12T05:40:50.953 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.950+0000 7fee53fff700 1 -- 172.21.2.105:0/1682338125 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2134 (secure 0 0 0) 0x7fee44042890 con 0x7fee3c004b10 2021-11-12T05:40:50.954 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:40:50.954 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4222,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/3123627686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":3123627686},{"type":"v1","addr":"172.21.2.115:6833","nonce":3123627686}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:40:37.198589+0000","modified":"2021-11-12T05:40:38.201943+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/2223420138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":2223420138},{"type":"v1","addr":"172.21.2.105:6835","nonce":2223420138}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-11-12T05:40:50.955 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.950+0000 7fee6113f700 1 -- 172.21.2.105:0/1682338125 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fee400536f0 msgr2=0x7fee40055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:50.956 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.950+0000 7fee6113f700 1 --2- 172.21.2.105:0/1682338125 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fee400536f0 0x7fee40055bb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fee5c0b6060 tx=0x7fee5c0b0fd0).stop 2021-11-12T05:40:50.956 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.950+0000 7fee6113f700 1 -- 172.21.2.105:0/1682338125 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee3c004b10 msgr2=0x7fee5c063a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:50.956 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.950+0000 7fee6113f700 1 --2- 172.21.2.105:0/1682338125 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee3c004b10 0x7fee5c063a90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fee4400a000 tx=0x7fee44008040).stop 2021-11-12T05:40:50.956 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.950+0000 7fee6113f700 1 -- 172.21.2.105:0/1682338125 shutdown_connections 2021-11-12T05:40:50.957 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.950+0000 7fee6113f700 1 --2- 172.21.2.105:0/1682338125 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fee400536f0 0x7fee40055bb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:50.957 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.950+0000 7fee6113f700 1 --2- 172.21.2.105:0/1682338125 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fee5c0ab420 0x7fee5c0a8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:50.957 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.950+0000 7fee6113f700 1 --2- 172.21.2.105:0/1682338125 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fee5c0a9750 0x7fee5c0aaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:50.957 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.950+0000 7fee6113f700 1 --2- 172.21.2.105:0/1682338125 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee3c004b10 0x7fee5c063a90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:50.958 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.950+0000 7fee6113f700 1 -- 172.21.2.105:0/1682338125 >> 172.21.2.105:0/1682338125 conn(0x7fee5c0b5370 msgr2=0x7fee5c14abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:50.958 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.954+0000 7fee6113f700 1 -- 172.21.2.105:0/1682338125 shutdown_connections 2021-11-12T05:40:50.958 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:50.954+0000 7fee6113f700 1 -- 172.21.2.105:0/1682338125 wait complete. 2021-11-12T05:40:50.958 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 5 2021-11-12T05:40:51.162 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:40:37.198589+0000', 'modified': '2021-11-12T05:40:38.201943+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4251}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4251': {'gid': 4251, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/2223420138', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 2223420138}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 2223420138}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:40:51.163 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:40:51.164 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:40:51.230 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":4251,"want_state":"up:active","state":"up:active","rank_uptime":14.024352061,"mdsmap_epoch":5,"osdmap_epoch":25,"osdmap_epoch_barrier":24,"uptime":19.226755621999999} 2021-11-12T05:40:51.231 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 4251, "mdsmap_epoch": 5, "osdmap_epoch": 25, "osdmap_epoch_barrier": 24, "rank_uptime": 14.024352061, "state": "up:active", "uptime": 19.226755622, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:40:51.231 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-12T05:40:51.231 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2021-11-12T05:40:51.232 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.2 at ubuntu@gibba044.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.2... 2021-11-12T05:40:51.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:40:51.232 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:40:51.243 DEBUG:teuthology.orchestra.run.gibba044:> sudo modprobe fuse 2021-11-12T05:40:51.255 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:40:51.255 DEBUG:teuthology.orchestra.run.gibba044:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:40:51.303 INFO:teuthology.orchestra.run.gibba044.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:40:51.303 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:40:51.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:40:51.305 DEBUG:teuthology.orchestra.run.gibba044:> ls /sys/fs/fuse/connections 2021-11-12T05:40:51.310 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-12T05:40:51.310 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.2 /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:40:51.355 DEBUG:teuthology.orchestra.run.gibba044:> sudo modprobe fuse 2021-11-12T05:40:51.367 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:40:51.367 DEBUG:teuthology.orchestra.run.gibba044:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:40:51.372 INFO:teuthology.orchestra.run.gibba044.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:40:51.373 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:40:51.374 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:40:51.374 DEBUG:teuthology.orchestra.run.gibba044:> ls /sys/fs/fuse/connections 2021-11-12T05:40:51.404 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.gibba044.stderr:2021-11-12T05:40:51.400+0000 7fc7f9c62080 -1 init, newargv = 0x55c3d7c51e90 newargc=9 2021-11-12T05:40:51.405 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.gibba044.stderr:ceph-fuse[13927]: starting ceph client 2021-11-12T05:40:51.419 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.gibba044.stderr:ceph-fuse[13927]: starting fuse 2021-11-12T05:40:52.509 DEBUG:teuthology.orchestra.run.gibba044:> sudo modprobe fuse 2021-11-12T05:40:52.521 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:40:52.522 DEBUG:teuthology.orchestra.run.gibba044:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:40:52.571 INFO:teuthology.orchestra.run.gibba044.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:40:52.572 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:40:52.573 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:40:52.573 DEBUG:teuthology.orchestra.run.gibba044:> ls /sys/fs/fuse/connections 2021-11-12T05:40:52.578 INFO:teuthology.orchestra.run.gibba044.stdout:52 2021-11-12T05:40:52.579 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-12T05:40:52.579 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:40:52.580 DEBUG:teuthology.orchestra.run.gibba044:> sudo python3 -c ' 2021-11-12T05:40:52.580 DEBUG:teuthology.orchestra.run.gibba044:> import glob 2021-11-12T05:40:52.581 DEBUG:teuthology.orchestra.run.gibba044:> import re 2021-11-12T05:40:52.581 DEBUG:teuthology.orchestra.run.gibba044:> import os 2021-11-12T05:40:52.581 DEBUG:teuthology.orchestra.run.gibba044:> import subprocess 2021-11-12T05:40:52.582 DEBUG:teuthology.orchestra.run.gibba044:> 2021-11-12T05:40:52.582 DEBUG:teuthology.orchestra.run.gibba044:> def find_socket(client_name): 2021-11-12T05:40:52.583 DEBUG:teuthology.orchestra.run.gibba044:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2021-11-12T05:40:52.583 DEBUG:teuthology.orchestra.run.gibba044:> files = glob.glob(asok_path) 2021-11-12T05:40:52.583 DEBUG:teuthology.orchestra.run.gibba044:> 2021-11-12T05:40:52.584 DEBUG:teuthology.orchestra.run.gibba044:> # Given a non-glob path, it better be there 2021-11-12T05:40:52.584 DEBUG:teuthology.orchestra.run.gibba044:> if "*" not in asok_path: 2021-11-12T05:40:52.584 DEBUG:teuthology.orchestra.run.gibba044:> assert(len(files) == 1) 2021-11-12T05:40:52.585 DEBUG:teuthology.orchestra.run.gibba044:> return files[0] 2021-11-12T05:40:52.585 DEBUG:teuthology.orchestra.run.gibba044:> 2021-11-12T05:40:52.585 DEBUG:teuthology.orchestra.run.gibba044:> for f in files: 2021-11-12T05:40:52.586 DEBUG:teuthology.orchestra.run.gibba044:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-12T05:40:52.586 DEBUG:teuthology.orchestra.run.gibba044:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-12T05:40:52.586 DEBUG:teuthology.orchestra.run.gibba044:> return f 2021-11-12T05:40:52.587 DEBUG:teuthology.orchestra.run.gibba044:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-12T05:40:52.587 DEBUG:teuthology.orchestra.run.gibba044:> 2021-11-12T05:40:52.587 DEBUG:teuthology.orchestra.run.gibba044:> print(find_socket("client.2")) 2021-11-12T05:40:52.588 DEBUG:teuthology.orchestra.run.gibba044:> ' 2021-11-12T05:40:52.655 INFO:teuthology.orchestra.run.gibba044.stdout:/var/run/ceph/ceph-client.2.13927.asok 2021-11-12T05:40:52.657 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.13927.asok 2021-11-12T05:40:52.658 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:40:52.658 DEBUG:teuthology.orchestra.run.gibba044:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.13927.asok status 2021-11-12T05:40:52.705 INFO:teuthology.orchestra.run.gibba044.stdout:{ 2021-11-12T05:40:52.705 INFO:teuthology.orchestra.run.gibba044.stdout: "metadata": { 2021-11-12T05:40:52.706 INFO:teuthology.orchestra.run.gibba044.stdout: "ceph_sha1": "a81ee2815de5acae59ead5b8c9137b6766fc8ea8", 2021-11-12T05:40:52.706 INFO:teuthology.orchestra.run.gibba044.stdout: "ceph_version": "ceph version 15.2.15-22-ga81ee281 (a81ee2815de5acae59ead5b8c9137b6766fc8ea8) octopus (stable)", 2021-11-12T05:40:52.706 INFO:teuthology.orchestra.run.gibba044.stdout: "entity_id": "2", 2021-11-12T05:40:52.706 INFO:teuthology.orchestra.run.gibba044.stdout: "hostname": "gibba044", 2021-11-12T05:40:52.707 INFO:teuthology.orchestra.run.gibba044.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2021-11-12T05:40:52.707 INFO:teuthology.orchestra.run.gibba044.stdout: "pid": "13927", 2021-11-12T05:40:52.707 INFO:teuthology.orchestra.run.gibba044.stdout: "root": "/" 2021-11-12T05:40:52.707 INFO:teuthology.orchestra.run.gibba044.stdout: }, 2021-11-12T05:40:52.708 INFO:teuthology.orchestra.run.gibba044.stdout: "dentry_count": 0, 2021-11-12T05:40:52.708 INFO:teuthology.orchestra.run.gibba044.stdout: "dentry_pinned_count": 0, 2021-11-12T05:40:52.708 INFO:teuthology.orchestra.run.gibba044.stdout: "id": 4707, 2021-11-12T05:40:52.708 INFO:teuthology.orchestra.run.gibba044.stdout: "inst": { 2021-11-12T05:40:52.709 INFO:teuthology.orchestra.run.gibba044.stdout: "name": { 2021-11-12T05:40:52.709 INFO:teuthology.orchestra.run.gibba044.stdout: "type": "client", 2021-11-12T05:40:52.709 INFO:teuthology.orchestra.run.gibba044.stdout: "num": 4707 2021-11-12T05:40:52.709 INFO:teuthology.orchestra.run.gibba044.stdout: }, 2021-11-12T05:40:52.709 INFO:teuthology.orchestra.run.gibba044.stdout: "addr": { 2021-11-12T05:40:52.710 INFO:teuthology.orchestra.run.gibba044.stdout: "type": "v1", 2021-11-12T05:40:52.710 INFO:teuthology.orchestra.run.gibba044.stdout: "addr": "172.21.2.144:0", 2021-11-12T05:40:52.710 INFO:teuthology.orchestra.run.gibba044.stdout: "nonce": 4167502935 2021-11-12T05:40:52.710 INFO:teuthology.orchestra.run.gibba044.stdout: } 2021-11-12T05:40:52.711 INFO:teuthology.orchestra.run.gibba044.stdout: }, 2021-11-12T05:40:52.711 INFO:teuthology.orchestra.run.gibba044.stdout: "addr": { 2021-11-12T05:40:52.711 INFO:teuthology.orchestra.run.gibba044.stdout: "type": "v1", 2021-11-12T05:40:52.711 INFO:teuthology.orchestra.run.gibba044.stdout: "addr": "172.21.2.144:0", 2021-11-12T05:40:52.712 INFO:teuthology.orchestra.run.gibba044.stdout: "nonce": 4167502935 2021-11-12T05:40:52.712 INFO:teuthology.orchestra.run.gibba044.stdout: }, 2021-11-12T05:40:52.712 INFO:teuthology.orchestra.run.gibba044.stdout: "inst_str": "client.4707 172.21.2.144:0/4167502935", 2021-11-12T05:40:52.712 INFO:teuthology.orchestra.run.gibba044.stdout: "addr_str": "172.21.2.144:0/4167502935", 2021-11-12T05:40:52.712 INFO:teuthology.orchestra.run.gibba044.stdout: "inode_count": 1, 2021-11-12T05:40:52.713 INFO:teuthology.orchestra.run.gibba044.stdout: "mds_epoch": 5, 2021-11-12T05:40:52.713 INFO:teuthology.orchestra.run.gibba044.stdout: "osd_epoch": 25, 2021-11-12T05:40:52.713 INFO:teuthology.orchestra.run.gibba044.stdout: "osd_epoch_barrier": 0, 2021-11-12T05:40:52.713 INFO:teuthology.orchestra.run.gibba044.stdout: "blacklisted": false, 2021-11-12T05:40:52.714 INFO:teuthology.orchestra.run.gibba044.stdout: "fs_name": "cephfs" 2021-11-12T05:40:52.714 INFO:teuthology.orchestra.run.gibba044.stdout:} 2021-11-12T05:40:52.715 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:40:52.715 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:40:52.716 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:40:52.728 INFO:teuthology.orchestra.run.gibba016.stdout:fuseblk 2021-11-12T05:40:52.729 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-12T05:40:52.730 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:40:52.730 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:40:52.750 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:40:52.750 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:40:52.750 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:40:52.762 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-12T05:40:52.764 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-12T05:40:52.764 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:40:52.765 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:40:52.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:40:52.833 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:40:52.833 DEBUG:teuthology.orchestra.run.gibba044:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:40:52.844 INFO:teuthology.orchestra.run.gibba044.stdout:fuseblk 2021-11-12T05:40:52.846 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2021-11-12T05:40:52.846 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:40:52.847 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:40:52.922 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2021-11-12T05:40:52.954 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:40:53.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.006+0000 7f4a404d4700 1 Processor -- start 2021-11-12T05:40:53.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.006+0000 7f4a404d4700 1 -- start start 2021-11-12T05:40:53.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.006+0000 7f4a404d4700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f4a380ac280 0x7f4a3814b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.006+0000 7f4a404d4700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4a380af730 0x7f4a380ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.006+0000 7f4a404d4700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a380ac7b0 con 0x7f4a380ad080 2021-11-12T05:40:53.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.006+0000 7f4a404d4700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a381488a0 con 0x7f4a380ac280 2021-11-12T05:40:53.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.006+0000 7f4a404d4700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a380ac9e0 con 0x7f4a380af730 2021-11-12T05:40:53.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.006+0000 7f4a3da6f700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f4a380ac280 0x7f4a3814b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:53.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.006+0000 7f4a3da6f700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f4a380ac280 0x7f4a3814b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43514/0 (socket says 172.21.2.105:43514) 2021-11-12T05:40:53.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.006+0000 7f4a3da6f700 1 -- 172.21.2.105:0/4143591350 learned_addr learned my addr 172.21.2.105:0/4143591350 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:53.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.006+0000 7f4a3da6f700 1 -- 172.21.2.105:0/4143591350 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4a380af730 msgr2=0x7f4a380ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:53.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.006+0000 7f4a3da6f700 1 --2- 172.21.2.105:0/4143591350 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4a380af730 0x7f4a380ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:53.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.006+0000 7f4a3da6f700 1 -- 172.21.2.105:0/4143591350 >> v1:172.21.2.115:6789/0 conn(0x7f4a380ad080 legacy=0x7f4a3814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:53.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.006+0000 7f4a3da6f700 1 -- 172.21.2.105:0/4143591350 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a380b0b30 con 0x7f4a380ac280 2021-11-12T05:40:53.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.006+0000 7f4a3da6f700 1 --2- 172.21.2.105:0/4143591350 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4a380ac280 0x7f4a3814b2f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f4a380b6060 tx=0x7f4a34006eb0).ready entity=mon.0 client_cookie=ea2e8d4483c2a5a6 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:53.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.006+0000 7f4a3d26e700 1 -- 172.21.2.105:0/4143591350 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a3400d570 con 0x7f4a380ac280 2021-11-12T05:40:53.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.006+0000 7f4a3d26e700 1 -- 172.21.2.105:0/4143591350 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a34000e90 con 0x7f4a380ac280 2021-11-12T05:40:53.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.006+0000 7f4a3d26e700 1 -- 172.21.2.105:0/4143591350 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a3400d8c0 con 0x7f4a380ac280 2021-11-12T05:40:53.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.006+0000 7f4a404d4700 1 -- 172.21.2.105:0/4143591350 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4a380ac280 msgr2=0x7f4a3814b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:53.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.006+0000 7f4a404d4700 1 --2- 172.21.2.105:0/4143591350 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4a380ac280 0x7f4a3814b2f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f4a380b6060 tx=0x7f4a34006eb0).stop 2021-11-12T05:40:53.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.006+0000 7f4a404d4700 1 -- 172.21.2.105:0/4143591350 shutdown_connections 2021-11-12T05:40:53.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.006+0000 7f4a404d4700 1 --2- 172.21.2.105:0/4143591350 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4a380af730 0x7f4a380ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:53.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.006+0000 7f4a404d4700 1 --2- 172.21.2.105:0/4143591350 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4a380ac280 0x7f4a3814b2f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:53.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.006+0000 7f4a404d4700 1 -- 172.21.2.105:0/4143591350 >> 172.21.2.105:0/4143591350 conn(0x7f4a380b5370 msgr2=0x7f4a380b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:53.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.006+0000 7f4a404d4700 1 -- 172.21.2.105:0/4143591350 shutdown_connections 2021-11-12T05:40:53.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.006+0000 7f4a404d4700 1 -- 172.21.2.105:0/4143591350 wait complete. 2021-11-12T05:40:53.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.006+0000 7f4a404d4700 1 Processor -- start 2021-11-12T05:40:53.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.006+0000 7f4a404d4700 1 -- start start 2021-11-12T05:40:53.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.010+0000 7f4a404d4700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4a380ac280 0x7f4a38063a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.010+0000 7f4a404d4700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4a380ad080 0x7f4a380669a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.010+0000 7f4a404d4700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4a380af730 0x7f4a38066e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.010+0000 7f4a404d4700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a380629c0 con 0x7f4a380af730 2021-11-12T05:40:53.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.010+0000 7f4a404d4700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a380aa0f0 con 0x7f4a380ac280 2021-11-12T05:40:53.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.010+0000 7f4a404d4700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a380ab530 con 0x7f4a380ad080 2021-11-12T05:40:53.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.010+0000 7f4a3ea71700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4a380af730 0x7f4a38066e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:53.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.010+0000 7f4a3da6f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4a380ad080 0x7f4a380669a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:53.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.010+0000 7f4a3ea71700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4a380af730 0x7f4a38066e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43522/0 (socket says 172.21.2.105:43522) 2021-11-12T05:40:53.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.010+0000 7f4a3ea71700 1 -- 172.21.2.105:0/2182831491 learned_addr learned my addr 172.21.2.105:0/2182831491 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:53.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.010+0000 7f4a3e270700 1 --2- 172.21.2.105:0/2182831491 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4a380ac280 0x7f4a38063a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:53.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.010+0000 7f4a3ea71700 1 -- 172.21.2.105:0/2182831491 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4a380ad080 msgr2=0x7f4a380669a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:53.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.010+0000 7f4a3ea71700 1 --2- 172.21.2.105:0/2182831491 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4a380ad080 0x7f4a380669a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:53.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.010+0000 7f4a3ea71700 1 -- 172.21.2.105:0/2182831491 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4a380ac280 msgr2=0x7f4a38063a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:53.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.010+0000 7f4a3ea71700 1 --2- 172.21.2.105:0/2182831491 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4a380ac280 0x7f4a38063a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:53.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.010+0000 7f4a3ea71700 1 -- 172.21.2.105:0/2182831491 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a3400b1e0 con 0x7f4a380af730 2021-11-12T05:40:53.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.010+0000 7f4a3ea71700 1 --2- 172.21.2.105:0/2182831491 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4a380af730 0x7f4a38066e90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f4a380aa230 tx=0x7f4a300091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:53.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.010+0000 7f4a277fe700 1 -- 172.21.2.105:0/2182831491 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a3000e470 con 0x7f4a380af730 2021-11-12T05:40:53.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.010+0000 7f4a277fe700 1 -- 172.21.2.105:0/2182831491 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a3000e5d0 con 0x7f4a380af730 2021-11-12T05:40:53.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.010+0000 7f4a277fe700 1 -- 172.21.2.105:0/2182831491 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a3000e930 con 0x7f4a380af730 2021-11-12T05:40:53.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.010+0000 7f4a404d4700 1 -- 172.21.2.105:0/2182831491 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a38064330 con 0x7f4a380af730 2021-11-12T05:40:53.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.010+0000 7f4a404d4700 1 -- 172.21.2.105:0/2182831491 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a380a8c30 con 0x7f4a380af730 2021-11-12T05:40:53.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.010+0000 7f4a404d4700 1 -- 172.21.2.105:0/2182831491 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a380ab6a0 con 0x7f4a380af730 2021-11-12T05:40:53.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.010+0000 7f4a277fe700 1 -- 172.21.2.105:0/2182831491 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4a30018030 con 0x7f4a380af730 2021-11-12T05:40:53.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.010+0000 7f4a277fe700 1 --2- 172.21.2.105:0/2182831491 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4a18053610 0x7f4a18055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.010+0000 7f4a277fe700 1 -- 172.21.2.105:0/2182831491 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f4a3006b420 con 0x7f4a380af730 2021-11-12T05:40:53.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.010+0000 7f4a3e270700 1 --2- 172.21.2.105:0/2182831491 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4a18053610 0x7f4a18055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:53.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.010+0000 7f4a3e270700 1 --2- 172.21.2.105:0/2182831491 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4a18053610 0x7f4a18055ad0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f4a2800d000 tx=0x7f4a28007b70).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:53.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.014+0000 7f4a277fe700 1 -- 172.21.2.105:0/2182831491 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4a380ab6a0 con 0x7f4a380af730 2021-11-12T05:40:53.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.098+0000 7f4a404d4700 1 -- 172.21.2.105:0/2182831491 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a380ab6a0 con 0x7f4a380af730 2021-11-12T05:40:53.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.098+0000 7f4a277fe700 1 -- 172.21.2.105:0/2182831491 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f4a380ab6a0 con 0x7f4a380af730 2021-11-12T05:40:53.101 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:40:53.102 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":25,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:40:38.203083+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:40:32.786926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-12T05:40:35.006506+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:40:53.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.098+0000 7f4a404d4700 1 -- 172.21.2.105:0/2182831491 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4a18053610 msgr2=0x7f4a18055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:53.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.098+0000 7f4a404d4700 1 --2- 172.21.2.105:0/2182831491 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4a18053610 0x7f4a18055ad0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f4a2800d000 tx=0x7f4a28007b70).stop 2021-11-12T05:40:53.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.098+0000 7f4a404d4700 1 -- 172.21.2.105:0/2182831491 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4a380af730 msgr2=0x7f4a38066e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:53.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.098+0000 7f4a404d4700 1 --2- 172.21.2.105:0/2182831491 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4a380af730 0x7f4a38066e90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f4a380aa230 tx=0x7f4a300091a0).stop 2021-11-12T05:40:53.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.098+0000 7f4a404d4700 1 -- 172.21.2.105:0/2182831491 shutdown_connections 2021-11-12T05:40:53.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.098+0000 7f4a404d4700 1 --2- 172.21.2.105:0/2182831491 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4a18053610 0x7f4a18055ad0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:53.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.098+0000 7f4a404d4700 1 --2- 172.21.2.105:0/2182831491 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4a380af730 0x7f4a38066e90 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:53.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.098+0000 7f4a404d4700 1 --2- 172.21.2.105:0/2182831491 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4a380ad080 0x7f4a380669a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:53.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.098+0000 7f4a404d4700 1 --2- 172.21.2.105:0/2182831491 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4a380ac280 0x7f4a38063a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:53.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.098+0000 7f4a404d4700 1 -- 172.21.2.105:0/2182831491 >> 172.21.2.105:0/2182831491 conn(0x7f4a380b5370 msgr2=0x7f4a38145dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:53.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.098+0000 7f4a404d4700 1 -- 172.21.2.105:0/2182831491 shutdown_connections 2021-11-12T05:40:53.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.098+0000 7f4a404d4700 1 -- 172.21.2.105:0/2182831491 wait complete. 2021-11-12T05:40:53.109 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-12T05:40:32.786926+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-11-12T05:40:35.006506+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-12T05:40:53.110 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:40:53.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca96ab700 1 Processor -- start 2021-11-12T05:40:53.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca96ab700 1 -- start start 2021-11-12T05:40:53.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca96ab700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f4ca40ace20 0x7f4ca40b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca96ab700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ca40b1840 con 0x7f4ca4144180 2021-11-12T05:40:53.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca96ab700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ca40af2b0 con 0x7f4ca40aca40 2021-11-12T05:40:53.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca96ab700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ca40b0a10 con 0x7f4ca40ace20 2021-11-12T05:40:53.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca37fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f4ca4144180 0x7f4ca41445f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:53922/0 (socket says 172.21.2.105:53922) 2021-11-12T05:40:53.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca37fe700 1 -- 172.21.2.105:0/1740679 learned_addr learned my addr 172.21.2.105:0/1740679 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:53.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca1ffb700 1 -- 172.21.2.105:0/1740679 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1552155225 0 0) 0x7f4ca40b1840 con 0x7f4ca4144180 2021-11-12T05:40:53.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca1ffb700 1 -- 172.21.2.105:0/1740679 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c84003260 con 0x7f4ca4144180 2021-11-12T05:40:53.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca27fc700 1 --2- 172.21.2.105:0/1740679 >> v2:172.21.2.115:3300/0 conn(0x7f4ca40ace20 0x7f4ca40b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:53.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca1ffb700 1 -- 172.21.2.105:0/1740679 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1287203481 0 0) 0x7f4c84003260 con 0x7f4ca4144180 2021-11-12T05:40:53.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca1ffb700 1 -- 172.21.2.105:0/1740679 >> v2:172.21.2.115:3300/0 conn(0x7f4ca40ace20 msgr2=0x7f4ca40b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:53.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca1ffb700 1 --2- 172.21.2.105:0/1740679 >> v2:172.21.2.115:3300/0 conn(0x7f4ca40ace20 0x7f4ca40b0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:53.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca1ffb700 1 -- 172.21.2.105:0/1740679 >> v1:172.21.2.115:6789/0 conn(0x7f4ca40aca40 legacy=0x7f4ca41473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:53.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca1ffb700 1 -- 172.21.2.105:0/1740679 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca40b1a70 con 0x7f4ca4144180 2021-11-12T05:40:53.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca1ffb700 1 -- 172.21.2.105:0/1740679 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f4c9c0019e0 con 0x7f4ca4144180 2021-11-12T05:40:53.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca1ffb700 1 -- 172.21.2.105:0/1740679 >> v1:172.21.2.105:6789/0 conn(0x7f4ca4144180 legacy=0x7f4ca41445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:53.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca1ffb700 1 --2- 172.21.2.105:0/1740679 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4c84003750 0x7f4c84003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca1ffb700 1 --2- 172.21.2.105:0/1740679 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4c84004500 0x7f4c84004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca1ffb700 1 --2- 172.21.2.105:0/1740679 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4c84004f90 0x7f4c8400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca1ffb700 1 -- 172.21.2.105:0/1740679 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca40b0a10 con 0x7f4c84003750 2021-11-12T05:40:53.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca1ffb700 1 -- 172.21.2.105:0/1740679 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8400be80 con 0x7f4c84004f90 2021-11-12T05:40:53.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca1ffb700 1 -- 172.21.2.105:0/1740679 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8400c040 con 0x7f4c84004500 2021-11-12T05:40:53.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca2ffd700 1 --2- 172.21.2.105:0/1740679 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4c84003750 0x7f4c84003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:53.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca2ffd700 1 -- 172.21.2.105:0/1740679 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4c84004500 msgr2=0x7f4c84004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:53.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca2ffd700 1 --2- 172.21.2.105:0/1740679 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4c84004500 0x7f4c84004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:53.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca2ffd700 1 -- 172.21.2.105:0/1740679 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4c84004f90 msgr2=0x7f4c8400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:53.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca2ffd700 1 --2- 172.21.2.105:0/1740679 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4c84004f90 0x7f4c8400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:53.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca37fe700 1 -- 172.21.2.105:0/1740679 reap_dead start 2021-11-12T05:40:53.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca2ffd700 1 -- 172.21.2.105:0/1740679 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c84003260 con 0x7f4c84003750 2021-11-12T05:40:53.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca2ffd700 1 --2- 172.21.2.105:0/1740679 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4c84003750 0x7f4c84003b50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f4c94000f70 tx=0x7f4c940079e0).ready entity=mon.0 client_cookie=dce6fba08d8b929f server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:53.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca1ffb700 1 -- 172.21.2.105:0/1740679 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c94007cf0 con 0x7f4c84003750 2021-11-12T05:40:53.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca1ffb700 1 -- 172.21.2.105:0/1740679 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c94014410 con 0x7f4c84003750 2021-11-12T05:40:53.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca1ffb700 1 -- 172.21.2.105:0/1740679 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c94014770 con 0x7f4c84003750 2021-11-12T05:40:53.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca96ab700 1 -- 172.21.2.105:0/1740679 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4c84003750 msgr2=0x7f4c84003b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:53.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca96ab700 1 --2- 172.21.2.105:0/1740679 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4c84003750 0x7f4c84003b50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f4c94000f70 tx=0x7f4c940079e0).stop 2021-11-12T05:40:53.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca96ab700 1 -- 172.21.2.105:0/1740679 shutdown_connections 2021-11-12T05:40:53.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca96ab700 1 --2- 172.21.2.105:0/1740679 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4c84003750 0x7f4c84003b50 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:53.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca96ab700 1 -- 172.21.2.105:0/1740679 >> 172.21.2.105:0/1740679 conn(0x7f4ca405c490 msgr2=0x7f4ca40b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:53.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca96ab700 1 -- 172.21.2.105:0/1740679 shutdown_connections 2021-11-12T05:40:53.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.162+0000 7f4ca96ab700 1 -- 172.21.2.105:0/1740679 wait complete. 2021-11-12T05:40:53.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.166+0000 7f4ca96ab700 1 Processor -- start 2021-11-12T05:40:53.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.166+0000 7f4ca96ab700 1 -- start start 2021-11-12T05:40:53.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.166+0000 7f4ca96ab700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4c84003750 0x7f4ca40649d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.166+0000 7f4ca96ab700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4ca40aaf10 0x7f4ca40aa280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.166+0000 7f4ca96ab700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4ca40ab500 0x7f4ca4142160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.166+0000 7f4ca96ab700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca40aa770 con 0x7f4ca40ab500 2021-11-12T05:40:53.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.166+0000 7f4ca96ab700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca4062ee0 con 0x7f4c84003750 2021-11-12T05:40:53.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.166+0000 7f4ca96ab700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca4064290 con 0x7f4ca40aaf10 2021-11-12T05:40:53.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.166+0000 7f4ca37fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4ca40ab500 0x7f4ca4142160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:53.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.166+0000 7f4ca37fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4ca40ab500 0x7f4ca4142160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43542/0 (socket says 172.21.2.105:43542) 2021-11-12T05:40:53.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.166+0000 7f4ca37fe700 1 -- 172.21.2.105:0/3780816561 learned_addr learned my addr 172.21.2.105:0/3780816561 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:53.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.166+0000 7f4ca37fe700 1 -- 172.21.2.105:0/3780816561 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4ca40aaf10 msgr2=0x7f4ca40aa280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:53.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.166+0000 7f4ca37fe700 1 --2- 172.21.2.105:0/3780816561 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4ca40aaf10 0x7f4ca40aa280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:53.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.166+0000 7f4ca2ffd700 1 --2- 172.21.2.105:0/3780816561 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4c84003750 0x7f4ca40649d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:53.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.166+0000 7f4ca37fe700 1 -- 172.21.2.105:0/3780816561 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4c84003750 msgr2=0x7f4ca40649d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:53.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.166+0000 7f4ca37fe700 1 --2- 172.21.2.105:0/3780816561 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4c84003750 0x7f4ca40649d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:53.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.166+0000 7f4ca37fe700 1 -- 172.21.2.105:0/3780816561 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca4064530 con 0x7f4ca40ab500 2021-11-12T05:40:53.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.166+0000 7f4ca37fe700 1 --2- 172.21.2.105:0/3780816561 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4ca40ab500 0x7f4ca4142160 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f4ca40af5f0 tx=0x7f4ca40ad870).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:53.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.166+0000 7f4c9bfff700 1 -- 172.21.2.105:0/3780816561 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c9c004ab0 con 0x7f4ca40ab500 2021-11-12T05:40:53.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.166+0000 7f4c9bfff700 1 -- 172.21.2.105:0/3780816561 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9c004c10 con 0x7f4ca40ab500 2021-11-12T05:40:53.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.166+0000 7f4ca96ab700 1 -- 172.21.2.105:0/3780816561 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca4063fc0 con 0x7f4ca40ab500 2021-11-12T05:40:53.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.166+0000 7f4ca96ab700 1 -- 172.21.2.105:0/3780816561 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca40abbd0 con 0x7f4ca40ab500 2021-11-12T05:40:53.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.166+0000 7f4c9bfff700 1 -- 172.21.2.105:0/3780816561 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c9c007030 con 0x7f4ca40ab500 2021-11-12T05:40:53.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.166+0000 7f4ca96ab700 1 -- 172.21.2.105:0/3780816561 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ca40646c0 con 0x7f4ca40ab500 2021-11-12T05:40:53.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.166+0000 7f4c9bfff700 1 -- 172.21.2.105:0/3780816561 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4c9c01b060 con 0x7f4ca40ab500 2021-11-12T05:40:53.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.166+0000 7f4c9bfff700 1 --2- 172.21.2.105:0/3780816561 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4c880536f0 0x7f4c88055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.166+0000 7f4c9bfff700 1 -- 172.21.2.105:0/3780816561 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f4c9c06b590 con 0x7f4ca40ab500 2021-11-12T05:40:53.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.166+0000 7f4ca2ffd700 1 --2- 172.21.2.105:0/3780816561 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4c880536f0 0x7f4c88055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:53.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.166+0000 7f4ca2ffd700 1 --2- 172.21.2.105:0/3780816561 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4c880536f0 0x7f4c88055bb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f4c94017000 tx=0x7f4c94015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:53.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.170+0000 7f4c9bfff700 1 -- 172.21.2.105:0/3780816561 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4c9c042480 con 0x7f4ca40ab500 2021-11-12T05:40:53.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.254+0000 7f4ca96ab700 1 -- 172.21.2.105:0/3780816561 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4ca4057350 con 0x7f4ca40ab500 2021-11-12T05:40:53.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.254+0000 7f4c9bfff700 1 -- 172.21.2.105:0/3780816561 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4c9c019030 con 0x7f4ca40ab500 2021-11-12T05:40:53.256 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:40:53.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.254+0000 7f4ca96ab700 1 -- 172.21.2.105:0/3780816561 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4c880536f0 msgr2=0x7f4c88055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:53.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.254+0000 7f4ca96ab700 1 --2- 172.21.2.105:0/3780816561 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4c880536f0 0x7f4c88055bb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f4c94017000 tx=0x7f4c94015000).stop 2021-11-12T05:40:53.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.254+0000 7f4ca96ab700 1 -- 172.21.2.105:0/3780816561 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4ca40ab500 msgr2=0x7f4ca4142160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:53.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.254+0000 7f4ca96ab700 1 --2- 172.21.2.105:0/3780816561 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4ca40ab500 0x7f4ca4142160 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f4ca40af5f0 tx=0x7f4ca40ad870).stop 2021-11-12T05:40:53.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.254+0000 7f4ca96ab700 1 -- 172.21.2.105:0/3780816561 shutdown_connections 2021-11-12T05:40:53.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.254+0000 7f4ca96ab700 1 --2- 172.21.2.105:0/3780816561 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4c880536f0 0x7f4c88055bb0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:53.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.254+0000 7f4ca96ab700 1 --2- 172.21.2.105:0/3780816561 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4ca40ab500 0x7f4ca4142160 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:53.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.254+0000 7f4ca96ab700 1 --2- 172.21.2.105:0/3780816561 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4ca40aaf10 0x7f4ca40aa280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:53.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.254+0000 7f4ca96ab700 1 --2- 172.21.2.105:0/3780816561 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4c84003750 0x7f4ca40649d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:53.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.254+0000 7f4ca96ab700 1 -- 172.21.2.105:0/3780816561 >> 172.21.2.105:0/3780816561 conn(0x7f4ca405c490 msgr2=0x7f4ca4148890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:53.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.254+0000 7f4ca96ab700 1 -- 172.21.2.105:0/3780816561 shutdown_connections 2021-11-12T05:40:53.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.254+0000 7f4ca96ab700 1 -- 172.21.2.105:0/3780816561 wait complete. 2021-11-12T05:40:53.263 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:40:53.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.314+0000 7f4925eb9700 1 Processor -- start 2021-11-12T05:40:53.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.314+0000 7f4925eb9700 1 -- start start 2021-11-12T05:40:53.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.314+0000 7f4925eb9700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f49200b2290 0x7f49200b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.314+0000 7f4925eb9700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49200aa0b0 con 0x7f49200b2cc0 2021-11-12T05:40:53.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.314+0000 7f4925eb9700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49200a9b70 con 0x7f4920143da0 2021-11-12T05:40:53.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.314+0000 7f4925eb9700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49200a9e10 con 0x7f49200b2290 2021-11-12T05:40:53.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.314+0000 7f491f7fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f49200b2cc0 0x7f4920143690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:53942/0 (socket says 172.21.2.105:53942) 2021-11-12T05:40:53.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.314+0000 7f491f7fe700 1 -- 172.21.2.105:0/2756950287 learned_addr learned my addr 172.21.2.105:0/2756950287 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:53.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.314+0000 7f491effd700 1 --2- 172.21.2.105:0/2756950287 >> v2:172.21.2.105:3300/0 conn(0x7f49200b2290 0x7f49200b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:53.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.314+0000 7f491effd700 1 -- 172.21.2.105:0/2756950287 >> v1:172.21.2.115:6789/0 conn(0x7f4920143da0 legacy=0x7f4920140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:53.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.314+0000 7f491effd700 1 -- 172.21.2.105:0/2756950287 >> v1:172.21.2.105:6789/0 conn(0x7f49200b2cc0 legacy=0x7f4920143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:53.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.314+0000 7f491effd700 1 -- 172.21.2.105:0/2756950287 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49200b0800 con 0x7f49200b2290 2021-11-12T05:40:53.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.314+0000 7f491effd700 1 --2- 172.21.2.105:0/2756950287 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f49200b2290 0x7f49200b30a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f49200b3840 tx=0x7f4910006df0).ready entity=mon.0 client_cookie=99905737c05d4740 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:53.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.314+0000 7f491e7fc700 1 -- 172.21.2.105:0/2756950287 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f491000d5c0 con 0x7f49200b2290 2021-11-12T05:40:53.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.314+0000 7f491e7fc700 1 -- 172.21.2.105:0/2756950287 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4910000e90 con 0x7f49200b2290 2021-11-12T05:40:53.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.314+0000 7f491e7fc700 1 -- 172.21.2.105:0/2756950287 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f491000d910 con 0x7f49200b2290 2021-11-12T05:40:53.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.314+0000 7f4925eb9700 1 -- 172.21.2.105:0/2756950287 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f49200b2290 msgr2=0x7f49200b30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:53.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.314+0000 7f4925eb9700 1 --2- 172.21.2.105:0/2756950287 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f49200b2290 0x7f49200b30a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f49200b3840 tx=0x7f4910006df0).stop 2021-11-12T05:40:53.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.314+0000 7f4925eb9700 1 -- 172.21.2.105:0/2756950287 shutdown_connections 2021-11-12T05:40:53.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.314+0000 7f4925eb9700 1 --2- 172.21.2.105:0/2756950287 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f49200b2290 0x7f49200b30a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:53.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.314+0000 7f4925eb9700 1 -- 172.21.2.105:0/2756950287 >> 172.21.2.105:0/2756950287 conn(0x7f492005c490 msgr2=0x7f492005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:53.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.314+0000 7f4925eb9700 1 -- 172.21.2.105:0/2756950287 shutdown_connections 2021-11-12T05:40:53.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.314+0000 7f4925eb9700 1 -- 172.21.2.105:0/2756950287 wait complete. 2021-11-12T05:40:53.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.318+0000 7f4925eb9700 1 Processor -- start 2021-11-12T05:40:53.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.318+0000 7f4925eb9700 1 -- start start 2021-11-12T05:40:53.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.318+0000 7f4925eb9700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f49200b2290 0x7f49200a8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.318+0000 7f4925eb9700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f49200b2cc0 0x7f49200a91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.318+0000 7f4925eb9700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4920143da0 0x7f492013d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.318+0000 7f4925eb9700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4920067360 con 0x7f49200b2290 2021-11-12T05:40:53.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.318+0000 7f4925eb9700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49200a96c0 con 0x7f4920143da0 2021-11-12T05:40:53.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.318+0000 7f4925eb9700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49200a7620 con 0x7f49200b2cc0 2021-11-12T05:40:53.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.318+0000 7f491f7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f49200b2290 0x7f49200a8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:53.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.318+0000 7f491f7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f49200b2290 0x7f49200a8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43552/0 (socket says 172.21.2.105:43552) 2021-11-12T05:40:53.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.318+0000 7f491f7fe700 1 -- 172.21.2.105:0/1050925592 learned_addr learned my addr 172.21.2.105:0/1050925592 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:53.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.318+0000 7f491f7fe700 1 -- 172.21.2.105:0/1050925592 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f49200b2cc0 msgr2=0x7f49200a91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:53.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.318+0000 7f491f7fe700 1 --2- 172.21.2.105:0/1050925592 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f49200b2cc0 0x7f49200a91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:53.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.318+0000 7f491f7fe700 1 -- 172.21.2.105:0/1050925592 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4920143da0 msgr2=0x7f492013d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:53.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.318+0000 7f491f7fe700 1 --2- 172.21.2.105:0/1050925592 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4920143da0 0x7f492013d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:53.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.318+0000 7f491f7fe700 1 -- 172.21.2.105:0/1050925592 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491000b180 con 0x7f49200b2290 2021-11-12T05:40:53.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.318+0000 7f491f7fe700 1 --2- 172.21.2.105:0/1050925592 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f49200b2290 0x7f49200a8150 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f49200a9850 tx=0x7f4908007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:53.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.318+0000 7f491cff9700 1 -- 172.21.2.105:0/1050925592 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f490800ce20 con 0x7f49200b2290 2021-11-12T05:40:53.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.318+0000 7f491cff9700 1 -- 172.21.2.105:0/1050925592 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49080072e0 con 0x7f49200b2290 2021-11-12T05:40:53.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.318+0000 7f4925eb9700 1 -- 172.21.2.105:0/1050925592 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49200a78c0 con 0x7f49200b2290 2021-11-12T05:40:53.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.318+0000 7f491cff9700 1 -- 172.21.2.105:0/1050925592 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4908005800 con 0x7f49200b2290 2021-11-12T05:40:53.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.318+0000 7f4925eb9700 1 -- 172.21.2.105:0/1050925592 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4920063610 con 0x7f49200b2290 2021-11-12T05:40:53.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.318+0000 7f4925eb9700 1 -- 172.21.2.105:0/1050925592 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49200a7a50 con 0x7f49200b2290 2021-11-12T05:40:53.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.318+0000 7f491cff9700 1 -- 172.21.2.105:0/1050925592 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4908010070 con 0x7f49200b2290 2021-11-12T05:40:53.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.318+0000 7f491cff9700 1 --2- 172.21.2.105:0/1050925592 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4904053610 0x7f4904055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.318+0000 7f491cff9700 1 -- 172.21.2.105:0/1050925592 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f490806b090 con 0x7f49200b2290 2021-11-12T05:40:53.334 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.318+0000 7f491effd700 1 --2- 172.21.2.105:0/1050925592 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4904053610 0x7f4904055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:53.334 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.318+0000 7f491effd700 1 --2- 172.21.2.105:0/1050925592 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4904053610 0x7f4904055ad0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f49200b3840 tx=0x7f4910014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:53.334 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.322+0000 7f491cff9700 1 -- 172.21.2.105:0/1050925592 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4908042090 con 0x7f49200b2290 2021-11-12T05:40:53.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.406+0000 7f4925eb9700 1 -- 172.21.2.105:0/1050925592 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4920144230 con 0x7f49200b2290 2021-11-12T05:40:53.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.406+0000 7f491cff9700 1 -- 172.21.2.105:0/1050925592 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4908018030 con 0x7f49200b2290 2021-11-12T05:40:53.408 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:40:53.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.406+0000 7f4925eb9700 1 -- 172.21.2.105:0/1050925592 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4904053610 msgr2=0x7f4904055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:53.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.406+0000 7f4925eb9700 1 --2- 172.21.2.105:0/1050925592 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4904053610 0x7f4904055ad0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f49200b3840 tx=0x7f4910014000).stop 2021-11-12T05:40:53.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.406+0000 7f4925eb9700 1 -- 172.21.2.105:0/1050925592 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f49200b2290 msgr2=0x7f49200a8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:53.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.406+0000 7f4925eb9700 1 --2- 172.21.2.105:0/1050925592 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f49200b2290 0x7f49200a8150 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f49200a9850 tx=0x7f4908007c40).stop 2021-11-12T05:40:53.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.406+0000 7f4925eb9700 1 -- 172.21.2.105:0/1050925592 shutdown_connections 2021-11-12T05:40:53.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.406+0000 7f4925eb9700 1 --2- 172.21.2.105:0/1050925592 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4904053610 0x7f4904055ad0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:53.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.406+0000 7f4925eb9700 1 --2- 172.21.2.105:0/1050925592 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4920143da0 0x7f492013d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:53.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.406+0000 7f4925eb9700 1 --2- 172.21.2.105:0/1050925592 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f49200b2cc0 0x7f49200a91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:53.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.406+0000 7f4925eb9700 1 --2- 172.21.2.105:0/1050925592 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f49200b2290 0x7f49200a8150 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:53.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.406+0000 7f4925eb9700 1 -- 172.21.2.105:0/1050925592 >> 172.21.2.105:0/1050925592 conn(0x7f492005c490 msgr2=0x7f492013fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:53.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.406+0000 7f4925eb9700 1 -- 172.21.2.105:0/1050925592 shutdown_connections 2021-11-12T05:40:53.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.406+0000 7f4925eb9700 1 -- 172.21.2.105:0/1050925592 wait complete. 2021-11-12T05:40:53.415 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-12T05:40:53.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.466+0000 7f0e95439700 1 Processor -- start 2021-11-12T05:40:53.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.466+0000 7f0e95439700 1 -- start start 2021-11-12T05:40:53.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.466+0000 7f0e95439700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f0e900af750 0x7f0e90062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.466+0000 7f0e95439700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f0e90130a80 0x7f0e901474d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.466+0000 7f0e95439700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e900b0d50 con 0x7f0e900626b0 2021-11-12T05:40:53.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.466+0000 7f0e95439700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e900ad380 con 0x7f0e900af750 2021-11-12T05:40:53.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.466+0000 7f0e95439700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e900ae190 con 0x7f0e90130a80 2021-11-12T05:40:53.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.466+0000 7f0e8e7fc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f0e900af750 0x7f0e90062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:53.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.466+0000 7f0e8effd700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f0e900626b0 0x7f0e90130370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:53956/0 (socket says 172.21.2.105:53956) 2021-11-12T05:40:53.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.466+0000 7f0e8effd700 1 -- 172.21.2.105:0/663705604 learned_addr learned my addr 172.21.2.105:0/663705604 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:53.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.466+0000 7f0e8e7fc700 1 -- 172.21.2.105:0/663705604 >> v2:172.21.2.115:3300/0 conn(0x7f0e90130a80 msgr2=0x7f0e901474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:53.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.466+0000 7f0e8e7fc700 1 --2- 172.21.2.105:0/663705604 >> v2:172.21.2.115:3300/0 conn(0x7f0e90130a80 0x7f0e901474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:53.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.466+0000 7f0e8e7fc700 1 -- 172.21.2.105:0/663705604 >> v1:172.21.2.105:6789/0 conn(0x7f0e900626b0 legacy=0x7f0e90130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:53.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.466+0000 7f0e8e7fc700 1 -- 172.21.2.105:0/663705604 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e901479c0 con 0x7f0e900af750 2021-11-12T05:40:53.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.466+0000 7f0e8e7fc700 1 --2- 172.21.2.105:0/663705604 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0e900af750 0x7f0e90062a90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f0e78002f70 tx=0x7f0e78006df0).ready entity=mon.0 client_cookie=817494cc13d9f90 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:53.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.466+0000 7f0e8dffb700 1 -- 172.21.2.105:0/663705604 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e7800d5c0 con 0x7f0e900af750 2021-11-12T05:40:53.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.466+0000 7f0e8dffb700 1 -- 172.21.2.105:0/663705604 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e78000e90 con 0x7f0e900af750 2021-11-12T05:40:53.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.466+0000 7f0e8dffb700 1 -- 172.21.2.105:0/663705604 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e7800d950 con 0x7f0e900af750 2021-11-12T05:40:53.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.466+0000 7f0e95439700 1 -- 172.21.2.105:0/663705604 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0e900af750 msgr2=0x7f0e90062a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:53.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.466+0000 7f0e95439700 1 --2- 172.21.2.105:0/663705604 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0e900af750 0x7f0e90062a90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f0e78002f70 tx=0x7f0e78006df0).stop 2021-11-12T05:40:53.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.466+0000 7f0e95439700 1 -- 172.21.2.105:0/663705604 shutdown_connections 2021-11-12T05:40:53.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.466+0000 7f0e95439700 1 --2- 172.21.2.105:0/663705604 >> v2:172.21.2.115:3300/0 conn(0x7f0e90130a80 0x7f0e901474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:53.474 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.466+0000 7f0e95439700 1 --2- 172.21.2.105:0/663705604 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0e900af750 0x7f0e90062a90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:53.474 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.466+0000 7f0e95439700 1 -- 172.21.2.105:0/663705604 >> 172.21.2.105:0/663705604 conn(0x7f0e900b5320 msgr2=0x7f0e900b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:53.474 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.466+0000 7f0e95439700 1 -- 172.21.2.105:0/663705604 shutdown_connections 2021-11-12T05:40:53.474 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.466+0000 7f0e95439700 1 -- 172.21.2.105:0/663705604 wait complete. 2021-11-12T05:40:53.477 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.466+0000 7f0e95439700 1 Processor -- start 2021-11-12T05:40:53.478 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.466+0000 7f0e95439700 1 -- start start 2021-11-12T05:40:53.478 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.466+0000 7f0e95439700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0e900626b0 0x7f0e900632f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.478 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.466+0000 7f0e95439700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0e900af750 0x7f0e9012c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.478 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.466+0000 7f0e95439700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0e90130a80 0x7f0e9012cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.478 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.466+0000 7f0e95439700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9012deb0 con 0x7f0e900af750 2021-11-12T05:40:53.479 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.466+0000 7f0e95439700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e901459a0 con 0x7f0e90130a80 2021-11-12T05:40:53.479 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.466+0000 7f0e95439700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e90145c40 con 0x7f0e900626b0 2021-11-12T05:40:53.479 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.466+0000 7f0e8e7fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0e900af750 0x7f0e9012c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:53.479 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.466+0000 7f0e8e7fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0e900af750 0x7f0e9012c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43568/0 (socket says 172.21.2.105:43568) 2021-11-12T05:40:53.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.466+0000 7f0e8e7fc700 1 -- 172.21.2.105:0/1073212387 learned_addr learned my addr 172.21.2.105:0/1073212387 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:53.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.470+0000 7f0e8e7fc700 1 -- 172.21.2.105:0/1073212387 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0e900626b0 msgr2=0x7f0e900632f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:53.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.470+0000 7f0e8e7fc700 1 --2- 172.21.2.105:0/1073212387 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0e900626b0 0x7f0e900632f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:53.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.470+0000 7f0e8e7fc700 1 -- 172.21.2.105:0/1073212387 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0e90130a80 msgr2=0x7f0e9012cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:53.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.470+0000 7f0e8e7fc700 1 --2- 172.21.2.105:0/1073212387 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0e90130a80 0x7f0e9012cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:53.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.470+0000 7f0e8e7fc700 1 -- 172.21.2.105:0/1073212387 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e7800b180 con 0x7f0e900af750 2021-11-12T05:40:53.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.470+0000 7f0e8e7fc700 1 --2- 172.21.2.105:0/1073212387 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0e900af750 0x7f0e9012c860 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f0e78002f70 tx=0x7f0e78014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:53.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.470+0000 7f0e87fff700 1 -- 172.21.2.105:0/1073212387 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e78006b20 con 0x7f0e900af750 2021-11-12T05:40:53.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.470+0000 7f0e87fff700 1 -- 172.21.2.105:0/1073212387 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e7801e400 con 0x7f0e900af750 2021-11-12T05:40:53.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.470+0000 7f0e95439700 1 -- 172.21.2.105:0/1073212387 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e9012d240 con 0x7f0e900af750 2021-11-12T05:40:53.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.470+0000 7f0e87fff700 1 -- 172.21.2.105:0/1073212387 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e7801e760 con 0x7f0e900af750 2021-11-12T05:40:53.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.470+0000 7f0e95439700 1 -- 172.21.2.105:0/1073212387 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e901455a0 con 0x7f0e900af750 2021-11-12T05:40:53.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.470+0000 7f0e95439700 1 -- 172.21.2.105:0/1073212387 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e9012e020 con 0x7f0e900af750 2021-11-12T05:40:53.483 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.470+0000 7f0e87fff700 1 -- 172.21.2.105:0/1073212387 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0e78025030 con 0x7f0e900af750 2021-11-12T05:40:53.483 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.470+0000 7f0e87fff700 1 --2- 172.21.2.105:0/1073212387 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0e74053640 0x7f0e74055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.483 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.470+0000 7f0e87fff700 1 -- 172.21.2.105:0/1073212387 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f0e7806c950 con 0x7f0e900af750 2021-11-12T05:40:53.483 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.470+0000 7f0e8effd700 1 --2- 172.21.2.105:0/1073212387 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0e74053640 0x7f0e74055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:53.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.470+0000 7f0e8effd700 1 --2- 172.21.2.105:0/1073212387 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0e74053640 0x7f0e74055b00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f0e900b0690 tx=0x7f0e80007800).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:53.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.474+0000 7f0e87fff700 1 -- 172.21.2.105:0/1073212387 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0e9012e020 con 0x7f0e900af750 2021-11-12T05:40:53.558 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.554+0000 7f0e95439700 1 -- 172.21.2.105:0/1073212387 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0e9012dff0 con 0x7f0e900af750 2021-11-12T05:40:53.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.554+0000 7f0e87fff700 1 -- 172.21.2.105:0/1073212387 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7f0e78043950 con 0x7f0e900af750 2021-11-12T05:40:53.559 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:40:53.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.558+0000 7f0e95439700 1 -- 172.21.2.105:0/1073212387 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0e74053640 msgr2=0x7f0e74055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:53.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.558+0000 7f0e95439700 1 --2- 172.21.2.105:0/1073212387 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0e74053640 0x7f0e74055b00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f0e900b0690 tx=0x7f0e80007800).stop 2021-11-12T05:40:53.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.558+0000 7f0e95439700 1 -- 172.21.2.105:0/1073212387 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0e900af750 msgr2=0x7f0e9012c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:53.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.558+0000 7f0e95439700 1 --2- 172.21.2.105:0/1073212387 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0e900af750 0x7f0e9012c860 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f0e78002f70 tx=0x7f0e78014000).stop 2021-11-12T05:40:53.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.558+0000 7f0e95439700 1 -- 172.21.2.105:0/1073212387 shutdown_connections 2021-11-12T05:40:53.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.558+0000 7f0e95439700 1 --2- 172.21.2.105:0/1073212387 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0e74053640 0x7f0e74055b00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:53.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.558+0000 7f0e95439700 1 --2- 172.21.2.105:0/1073212387 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0e90130a80 0x7f0e9012cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:53.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.558+0000 7f0e95439700 1 --2- 172.21.2.105:0/1073212387 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0e900af750 0x7f0e9012c860 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:53.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.558+0000 7f0e95439700 1 --2- 172.21.2.105:0/1073212387 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0e900626b0 0x7f0e900632f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:53.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.558+0000 7f0e95439700 1 -- 172.21.2.105:0/1073212387 >> 172.21.2.105:0/1073212387 conn(0x7f0e900b5320 msgr2=0x7f0e900b4610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:53.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.558+0000 7f0e95439700 1 -- 172.21.2.105:0/1073212387 shutdown_connections 2021-11-12T05:40:53.563 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.558+0000 7f0e95439700 1 -- 172.21.2.105:0/1073212387 wait complete. 2021-11-12T05:40:53.566 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-12T05:40:53.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc92a719700 1 Processor -- start 2021-11-12T05:40:53.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc92a719700 1 -- start start 2021-11-12T05:40:53.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc92a719700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc9240b0520 0x7fc924144890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc92a719700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9240b1840 con 0x7fc9240aca40 2021-11-12T05:40:53.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc92a719700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9240af2b0 con 0x7fc9240ace20 2021-11-12T05:40:53.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc92a719700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9240b09b0 con 0x7fc9240b0520 2021-11-12T05:40:53.621 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc923fff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fc9240aca40 0x7fc9241473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:53970/0 (socket says 172.21.2.105:53970) 2021-11-12T05:40:53.621 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc923fff700 1 -- 172.21.2.105:0/1362460207 learned_addr learned my addr 172.21.2.105:0/1362460207 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:53.625 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc922ffd700 1 -- 172.21.2.105:0/1362460207 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 662526750 0 0) 0x7fc9240b1840 con 0x7fc9240aca40 2021-11-12T05:40:53.625 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc922ffd700 1 -- 172.21.2.105:0/1362460207 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc904003260 con 0x7fc9240aca40 2021-11-12T05:40:53.625 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc922ffd700 1 -- 172.21.2.105:0/1362460207 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1758065829 0 0) 0x7fc904003260 con 0x7fc9240aca40 2021-11-12T05:40:53.625 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc922ffd700 1 -- 172.21.2.105:0/1362460207 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc9240b0520 msgr2=0x7fc924144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:53.626 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc922ffd700 1 --2- 172.21.2.105:0/1362460207 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc9240b0520 0x7fc924144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:53.626 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc922ffd700 1 -- 172.21.2.105:0/1362460207 >> v1:172.21.2.115:6789/0 conn(0x7fc9240ace20 legacy=0x7fc924144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:53.626 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc922ffd700 1 -- 172.21.2.105:0/1362460207 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc924144d80 con 0x7fc9240aca40 2021-11-12T05:40:53.626 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc922ffd700 1 -- 172.21.2.105:0/1362460207 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fc90c001660 con 0x7fc9240aca40 2021-11-12T05:40:53.626 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc922ffd700 1 -- 172.21.2.105:0/1362460207 >> v1:172.21.2.105:6789/0 conn(0x7fc9240aca40 legacy=0x7fc9241473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:53.627 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc922ffd700 1 --2- 172.21.2.105:0/1362460207 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc9240b0520 0x7fc904003800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.627 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc922ffd700 1 --2- 172.21.2.105:0/1362460207 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc904003ef0 0x7fc904004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.627 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc922ffd700 1 --2- 172.21.2.105:0/1362460207 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc904004bf0 0x7fc90400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.627 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc922ffd700 1 -- 172.21.2.105:0/1362460207 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9240b09b0 con 0x7fc904004bf0 2021-11-12T05:40:53.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc922ffd700 1 -- 172.21.2.105:0/1362460207 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9040052f0 con 0x7fc904003ef0 2021-11-12T05:40:53.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc922ffd700 1 -- 172.21.2.105:0/1362460207 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc90400bc40 con 0x7fc9240b0520 2021-11-12T05:40:53.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc928cb6700 1 --2- 172.21.2.105:0/1362460207 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc904004bf0 0x7fc90400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:53.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc923fff700 1 --2- 172.21.2.105:0/1362460207 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc9240b0520 0x7fc904003800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:53.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc9237fe700 1 --2- 172.21.2.105:0/1362460207 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc904003ef0 0x7fc904004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:53.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc928cb6700 1 -- 172.21.2.105:0/1362460207 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc9240b0520 msgr2=0x7fc904003800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:53.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc928cb6700 1 --2- 172.21.2.105:0/1362460207 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc9240b0520 0x7fc904003800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:53.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc928cb6700 1 -- 172.21.2.105:0/1362460207 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc904003ef0 msgr2=0x7fc904004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:53.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc928cb6700 1 --2- 172.21.2.105:0/1362460207 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc904003ef0 0x7fc904004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:53.630 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc928cb6700 1 -- 172.21.2.105:0/1362460207 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc904003260 con 0x7fc904004bf0 2021-11-12T05:40:53.630 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc923fff700 1 --2- 172.21.2.105:0/1362460207 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc9240b0520 0x7fc904003800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:40:53.630 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc9237fe700 1 --2- 172.21.2.105:0/1362460207 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc904003ef0 0x7fc904004500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:40:53.630 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc928cb6700 1 --2- 172.21.2.105:0/1362460207 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc904004bf0 0x7fc90400b750 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fc91c0032f0 tx=0x7fc91c006f90).ready entity=mon.0 client_cookie=6aa8bed62e706182 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:53.630 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc922ffd700 1 -- 172.21.2.105:0/1362460207 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc91c011400 con 0x7fc904004bf0 2021-11-12T05:40:53.631 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc922ffd700 1 -- 172.21.2.105:0/1362460207 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91c011560 con 0x7fc904004bf0 2021-11-12T05:40:53.631 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc922ffd700 1 -- 172.21.2.105:0/1362460207 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc91c0118c0 con 0x7fc904004bf0 2021-11-12T05:40:53.631 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc92a719700 1 -- 172.21.2.105:0/1362460207 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc904004bf0 msgr2=0x7fc90400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:53.631 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc92a719700 1 --2- 172.21.2.105:0/1362460207 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc904004bf0 0x7fc90400b750 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fc91c0032f0 tx=0x7fc91c006f90).stop 2021-11-12T05:40:53.632 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc928cb6700 1 -- 172.21.2.105:0/1362460207 reap_dead start 2021-11-12T05:40:53.632 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc92a719700 1 -- 172.21.2.105:0/1362460207 shutdown_connections 2021-11-12T05:40:53.632 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc92a719700 1 -- 172.21.2.105:0/1362460207 >> 172.21.2.105:0/1362460207 conn(0x7fc92405c490 msgr2=0x7fc9240b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:53.632 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc92a719700 1 -- 172.21.2.105:0/1362460207 shutdown_connections 2021-11-12T05:40:53.632 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.618+0000 7fc92a719700 1 -- 172.21.2.105:0/1362460207 wait complete. 2021-11-12T05:40:53.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.622+0000 7fc92a719700 1 Processor -- start 2021-11-12T05:40:53.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.622+0000 7fc92a719700 1 -- start start 2021-11-12T05:40:53.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.622+0000 7fc92a719700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc904004bf0 0x7fc924063940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.622+0000 7fc92a719700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc9240aba80 0x7fc9240664e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.634 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.622+0000 7fc92a719700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc924063e30 0x7fc9240669d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.634 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.622+0000 7fc92a719700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc924065f80 con 0x7fc924063e30 2021-11-12T05:40:53.634 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.622+0000 7fc92a719700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc924066220 con 0x7fc9240aba80 2021-11-12T05:40:53.634 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.622+0000 7fc92a719700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9240ab5e0 con 0x7fc904004bf0 2021-11-12T05:40:53.634 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.622+0000 7fc928cb6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc924063e30 0x7fc9240669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:53.635 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.622+0000 7fc928cb6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc924063e30 0x7fc9240669d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43590/0 (socket says 172.21.2.105:43590) 2021-11-12T05:40:53.635 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.622+0000 7fc928cb6700 1 -- 172.21.2.105:0/283668522 learned_addr learned my addr 172.21.2.105:0/283668522 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:53.635 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.622+0000 7fc9237fe700 1 --2- 172.21.2.105:0/283668522 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc9240aba80 0x7fc9240664e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:53.635 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.622+0000 7fc923fff700 1 --2- 172.21.2.105:0/283668522 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc904004bf0 0x7fc924063940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:53.636 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.622+0000 7fc928cb6700 1 -- 172.21.2.105:0/283668522 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc904004bf0 msgr2=0x7fc924063940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:53.636 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.622+0000 7fc928cb6700 1 --2- 172.21.2.105:0/283668522 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc904004bf0 0x7fc924063940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:53.636 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.622+0000 7fc928cb6700 1 -- 172.21.2.105:0/283668522 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc9240aba80 msgr2=0x7fc9240664e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:53.636 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.622+0000 7fc928cb6700 1 --2- 172.21.2.105:0/283668522 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc9240aba80 0x7fc9240664e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:53.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.622+0000 7fc928cb6700 1 -- 172.21.2.105:0/283668522 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9240aabe0 con 0x7fc924063e30 2021-11-12T05:40:53.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.622+0000 7fc928cb6700 1 --2- 172.21.2.105:0/283668522 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc924063e30 0x7fc9240669d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7fc9240af5f0 tx=0x7fc91c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:53.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.622+0000 7fc9217fa700 1 -- 172.21.2.105:0/283668522 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc91c009370 con 0x7fc924063e30 2021-11-12T05:40:53.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.622+0000 7fc9217fa700 1 -- 172.21.2.105:0/283668522 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91c00bd60 con 0x7fc924063e30 2021-11-12T05:40:53.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.622+0000 7fc92a719700 1 -- 172.21.2.105:0/283668522 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc924066ec0 con 0x7fc924063e30 2021-11-12T05:40:53.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.622+0000 7fc92a719700 1 -- 172.21.2.105:0/283668522 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc924063020 con 0x7fc924063e30 2021-11-12T05:40:53.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.622+0000 7fc9217fa700 1 -- 172.21.2.105:0/283668522 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc91c01d620 con 0x7fc924063e30 2021-11-12T05:40:53.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.622+0000 7fc92a719700 1 -- 172.21.2.105:0/283668522 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9240ab7a0 con 0x7fc924063e30 2021-11-12T05:40:53.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.622+0000 7fc9217fa700 1 -- 172.21.2.105:0/283668522 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc91c00f070 con 0x7fc924063e30 2021-11-12T05:40:53.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.622+0000 7fc9217fa700 1 --2- 172.21.2.105:0/283668522 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc908053600 0x7fc908055ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.622+0000 7fc9217fa700 1 -- 172.21.2.105:0/283668522 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fc91c06d1f0 con 0x7fc924063e30 2021-11-12T05:40:53.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.622+0000 7fc923fff700 1 --2- 172.21.2.105:0/283668522 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc908053600 0x7fc908055ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:53.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.622+0000 7fc923fff700 1 --2- 172.21.2.105:0/283668522 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc908053600 0x7fc908055ac0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fc90c00c000 tx=0x7fc90c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:53.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.626+0000 7fc9217fa700 1 -- 172.21.2.105:0/283668522 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc91c0440e0 con 0x7fc924063e30 2021-11-12T05:40:53.710 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.706+0000 7fc92a719700 1 -- 172.21.2.105:0/283668522 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc92405f280 con 0x7fc924063e30 2021-11-12T05:40:53.711 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.706+0000 7fc9217fa700 1 -- 172.21.2.105:0/283668522 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7fc91c047700 con 0x7fc924063e30 2021-11-12T05:40:53.711 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:40:53.712 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.710+0000 7fc92a719700 1 -- 172.21.2.105:0/283668522 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc908053600 msgr2=0x7fc908055ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:53.712 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.710+0000 7fc92a719700 1 --2- 172.21.2.105:0/283668522 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc908053600 0x7fc908055ac0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fc90c00c000 tx=0x7fc90c009040).stop 2021-11-12T05:40:53.713 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.710+0000 7fc92a719700 1 -- 172.21.2.105:0/283668522 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc924063e30 msgr2=0x7fc9240669d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:53.713 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.710+0000 7fc92a719700 1 --2- 172.21.2.105:0/283668522 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc924063e30 0x7fc9240669d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7fc9240af5f0 tx=0x7fc91c016000).stop 2021-11-12T05:40:53.713 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.710+0000 7fc92a719700 1 -- 172.21.2.105:0/283668522 shutdown_connections 2021-11-12T05:40:53.713 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.710+0000 7fc92a719700 1 --2- 172.21.2.105:0/283668522 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc908053600 0x7fc908055ac0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:53.714 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.710+0000 7fc92a719700 1 --2- 172.21.2.105:0/283668522 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc924063e30 0x7fc9240669d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:53.714 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.710+0000 7fc92a719700 1 --2- 172.21.2.105:0/283668522 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc9240aba80 0x7fc9240664e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:53.714 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.710+0000 7fc92a719700 1 --2- 172.21.2.105:0/283668522 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc904004bf0 0x7fc924063940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:53.715 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.710+0000 7fc92a719700 1 -- 172.21.2.105:0/283668522 >> 172.21.2.105:0/283668522 conn(0x7fc92405c490 msgr2=0x7fc924148890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:53.715 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.710+0000 7fc92a719700 1 -- 172.21.2.105:0/283668522 shutdown_connections 2021-11-12T05:40:53.715 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.710+0000 7fc92a719700 1 -- 172.21.2.105:0/283668522 wait complete. 2021-11-12T05:40:53.718 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:40:53.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.766+0000 7fd5819ce700 1 Processor -- start 2021-11-12T05:40:53.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.766+0000 7fd5819ce700 1 -- start start 2021-11-12T05:40:53.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.766+0000 7fd5819ce700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd57c0b2940 0x7fd57c142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.766+0000 7fd5819ce700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fd57c0b0780 0x7fd57c1432b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.766+0000 7fd5819ce700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd57c0b2d20 con 0x7fd57c0b0cc0 2021-11-12T05:40:53.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.766+0000 7fd5819ce700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd57c05cba0 con 0x7fd57c0b0780 2021-11-12T05:40:53.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.766+0000 7fd5819ce700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c0b1fc0 con 0x7fd57c0b2940 2021-11-12T05:40:53.772 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.770+0000 7fd57a7fc700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fd57c0b0780 0x7fd57c1432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:53.772 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.770+0000 7fd57affd700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd57c0b2940 0x7fd57c142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:53.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.770+0000 7fd57affd700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd57c0b2940 0x7fd57c142dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3301/0 says I am v2:172.21.2.105:34784/0 (socket says 172.21.2.105:34784) 2021-11-12T05:40:53.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.770+0000 7fd57affd700 1 -- 172.21.2.105:0/3628456258 learned_addr learned my addr 172.21.2.105:0/3628456258 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:53.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.770+0000 7fd57affd700 1 -- 172.21.2.105:0/3628456258 >> v2:172.21.2.115:3300/0 conn(0x7fd57c0b0780 msgr2=0x7fd57c1432b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:53.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.770+0000 7fd57affd700 1 --2- 172.21.2.105:0/3628456258 >> v2:172.21.2.115:3300/0 conn(0x7fd57c0b0780 0x7fd57c1432b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:53.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.770+0000 7fd57affd700 1 -- 172.21.2.105:0/3628456258 >> v1:172.21.2.115:6789/0 conn(0x7fd57c0b0cc0 legacy=0x7fd57c05c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:53.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.770+0000 7fd57affd700 1 -- 172.21.2.105:0/3628456258 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57c0b15e0 con 0x7fd57c0b2940 2021-11-12T05:40:53.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.770+0000 7fd57affd700 1 --2- 172.21.2.105:0/3628456258 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd57c0b2940 0x7fd57c142dc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fd570002f70 tx=0x7fd570006eb0).ready entity=mon.2 client_cookie=29f4af57d6752420 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:53.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.770+0000 7fd579ffb700 1 -- 172.21.2.105:0/3628456258 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd57000d570 con 0x7fd57c0b2940 2021-11-12T05:40:53.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.770+0000 7fd579ffb700 1 -- 172.21.2.105:0/3628456258 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd570000e90 con 0x7fd57c0b2940 2021-11-12T05:40:53.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.770+0000 7fd579ffb700 1 -- 172.21.2.105:0/3628456258 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd57000d900 con 0x7fd57c0b2940 2021-11-12T05:40:53.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.770+0000 7fd5819ce700 1 -- 172.21.2.105:0/3628456258 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd57c0b2940 msgr2=0x7fd57c142dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:53.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.770+0000 7fd5819ce700 1 --2- 172.21.2.105:0/3628456258 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd57c0b2940 0x7fd57c142dc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fd570002f70 tx=0x7fd570006eb0).stop 2021-11-12T05:40:53.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.770+0000 7fd5819ce700 1 -- 172.21.2.105:0/3628456258 shutdown_connections 2021-11-12T05:40:53.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.770+0000 7fd5819ce700 1 --2- 172.21.2.105:0/3628456258 >> v2:172.21.2.115:3300/0 conn(0x7fd57c0b0780 0x7fd57c1432b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:53.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.770+0000 7fd5819ce700 1 --2- 172.21.2.105:0/3628456258 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd57c0b2940 0x7fd57c142dc0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:53.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.770+0000 7fd5819ce700 1 -- 172.21.2.105:0/3628456258 >> 172.21.2.105:0/3628456258 conn(0x7fd57c068440 msgr2=0x7fd57c062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:53.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.770+0000 7fd5819ce700 1 -- 172.21.2.105:0/3628456258 shutdown_connections 2021-11-12T05:40:53.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.770+0000 7fd5819ce700 1 -- 172.21.2.105:0/3628456258 wait complete. 2021-11-12T05:40:53.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.770+0000 7fd5819ce700 1 Processor -- start 2021-11-12T05:40:53.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.770+0000 7fd5819ce700 1 -- start start 2021-11-12T05:40:53.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.770+0000 7fd5819ce700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd57c0b0780 0x7fd57c064060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.770+0000 7fd5819ce700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd57c0b0cc0 0x7fd57c0ac0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.770+0000 7fd5819ce700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd57c0b2940 0x7fd57c064d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.770+0000 7fd5819ce700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c064690 con 0x7fd57c0b0780 2021-11-12T05:40:53.781 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.770+0000 7fd5819ce700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c0ab9a0 con 0x7fd57c0b2940 2021-11-12T05:40:53.781 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.770+0000 7fd5819ce700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd57c0abc40 con 0x7fd57c0b0cc0 2021-11-12T05:40:53.781 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.770+0000 7fd57affd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd57c0b0780 0x7fd57c064060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:53.781 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.770+0000 7fd57affd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd57c0b0780 0x7fd57c064060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43602/0 (socket says 172.21.2.105:43602) 2021-11-12T05:40:53.781 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.770+0000 7fd57affd700 1 -- 172.21.2.105:0/683329520 learned_addr learned my addr 172.21.2.105:0/683329520 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:53.782 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.774+0000 7fd57affd700 1 -- 172.21.2.105:0/683329520 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd57c0b0cc0 msgr2=0x7fd57c0ac0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:53.782 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.774+0000 7fd57affd700 1 --2- 172.21.2.105:0/683329520 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd57c0b0cc0 0x7fd57c0ac0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:53.782 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.774+0000 7fd57affd700 1 -- 172.21.2.105:0/683329520 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd57c0b2940 msgr2=0x7fd57c064d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:53.782 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.774+0000 7fd57affd700 1 --2- 172.21.2.105:0/683329520 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd57c0b2940 0x7fd57c064d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:53.783 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.774+0000 7fd57affd700 1 -- 172.21.2.105:0/683329520 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57000b1e0 con 0x7fd57c0b0780 2021-11-12T05:40:53.783 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.774+0000 7fd57affd700 1 --2- 172.21.2.105:0/683329520 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd57c0b0780 0x7fd57c064060 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fd570002f70 tx=0x7fd570015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:53.783 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.774+0000 7fd56bfff700 1 -- 172.21.2.105:0/683329520 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5700068b0 con 0x7fd57c0b0780 2021-11-12T05:40:53.783 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.774+0000 7fd56bfff700 1 -- 172.21.2.105:0/683329520 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57000de20 con 0x7fd57c0b0780 2021-11-12T05:40:53.783 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.774+0000 7fd56bfff700 1 -- 172.21.2.105:0/683329520 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd57001e460 con 0x7fd57c0b0780 2021-11-12T05:40:53.784 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.774+0000 7fd5819ce700 1 -- 172.21.2.105:0/683329520 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd57c0ac5d0 con 0x7fd57c0b0780 2021-11-12T05:40:53.784 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.774+0000 7fd5819ce700 1 -- 172.21.2.105:0/683329520 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd57c065480 con 0x7fd57c0b0780 2021-11-12T05:40:53.784 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.774+0000 7fd5819ce700 1 -- 172.21.2.105:0/683329520 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd57c0abe00 con 0x7fd57c0b0780 2021-11-12T05:40:53.784 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.774+0000 7fd56bfff700 1 -- 172.21.2.105:0/683329520 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd570025030 con 0x7fd57c0b0780 2021-11-12T05:40:53.784 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.774+0000 7fd56bfff700 1 --2- 172.21.2.105:0/683329520 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd5580536f0 0x7fd558055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.785 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.774+0000 7fd56bfff700 1 -- 172.21.2.105:0/683329520 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fd57006cd40 con 0x7fd57c0b0780 2021-11-12T05:40:53.785 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.774+0000 7fd57a7fc700 1 --2- 172.21.2.105:0/683329520 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd5580536f0 0x7fd558055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:53.785 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.774+0000 7fd57a7fc700 1 --2- 172.21.2.105:0/683329520 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd5580536f0 0x7fd558055bb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fd56c00c000 tx=0x7fd56c006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:53.785 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.774+0000 7fd56bfff700 1 -- 172.21.2.105:0/683329520 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd570043d80 con 0x7fd57c0b0780 2021-11-12T05:40:53.835 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:40:53.837 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:40:53.840 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:40:53.844 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:40:53.847 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:40:53.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.858+0000 7fd5819ce700 1 -- 172.21.2.105:0/683329520 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd57c0b1880 con 0x7fd57c0b0780 2021-11-12T05:40:53.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.862+0000 7fd56bfff700 1 -- 172.21.2.105:0/683329520 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7fd570023020 con 0x7fd57c0b0780 2021-11-12T05:40:53.863 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:40:53.864 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":25,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:40:38.203083+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:40:32.786926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-12T05:40:35.006506+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:40:53.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.862+0000 7fd5819ce700 1 -- 172.21.2.105:0/683329520 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd5580536f0 msgr2=0x7fd558055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:53.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.862+0000 7fd5819ce700 1 --2- 172.21.2.105:0/683329520 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd5580536f0 0x7fd558055bb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fd56c00c000 tx=0x7fd56c006df0).stop 2021-11-12T05:40:53.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.862+0000 7fd5819ce700 1 -- 172.21.2.105:0/683329520 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd57c0b0780 msgr2=0x7fd57c064060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:53.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.862+0000 7fd5819ce700 1 --2- 172.21.2.105:0/683329520 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd57c0b0780 0x7fd57c064060 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fd570002f70 tx=0x7fd570015000).stop 2021-11-12T05:40:53.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.862+0000 7fd5819ce700 1 -- 172.21.2.105:0/683329520 shutdown_connections 2021-11-12T05:40:53.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.862+0000 7fd5819ce700 1 --2- 172.21.2.105:0/683329520 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd5580536f0 0x7fd558055bb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:53.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.862+0000 7fd5819ce700 1 --2- 172.21.2.105:0/683329520 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd57c0b2940 0x7fd57c064d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:53.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.862+0000 7fd5819ce700 1 --2- 172.21.2.105:0/683329520 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd57c0b0cc0 0x7fd57c0ac0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:53.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.862+0000 7fd5819ce700 1 --2- 172.21.2.105:0/683329520 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd57c0b0780 0x7fd57c064060 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:53.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.862+0000 7fd5819ce700 1 -- 172.21.2.105:0/683329520 >> 172.21.2.105:0/683329520 conn(0x7fd57c068440 msgr2=0x7fd57c138750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:53.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.862+0000 7fd5819ce700 1 -- 172.21.2.105:0/683329520 shutdown_connections 2021-11-12T05:40:53.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.862+0000 7fd5819ce700 1 -- 172.21.2.105:0/683329520 wait complete. 2021-11-12T05:40:53.871 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-12T05:40:32.786926+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-11-12T05:40:35.006506+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-12T05:40:53.872 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:40:53.981 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.978+0000 7f959670a700 1 Processor -- start 2021-11-12T05:40:53.981 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.978+0000 7f959670a700 1 -- start start 2021-11-12T05:40:53.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.978+0000 7f959670a700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f95900aca40 0x7f95900ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.978+0000 7f959670a700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95900b1840 con 0x7f9590144180 2021-11-12T05:40:53.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.978+0000 7f959670a700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95900b09d0 con 0x7f95900b0520 2021-11-12T05:40:53.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.978+0000 7f959670a700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95900af2b0 con 0x7f95900aca40 2021-11-12T05:40:53.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.978+0000 7f9594ca7700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f9590144180 0x7f95901445f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:54004/0 (socket says 172.21.2.105:54004) 2021-11-12T05:40:53.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.978+0000 7f9594ca7700 1 -- 172.21.2.105:0/1319917526 learned_addr learned my addr 172.21.2.105:0/1319917526 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:53.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.978+0000 7f958effd700 1 -- 172.21.2.105:0/1319917526 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 94499171 0 0) 0x7f95900b1840 con 0x7f9590144180 2021-11-12T05:40:53.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.978+0000 7f958effd700 1 -- 172.21.2.105:0/1319917526 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9570003260 con 0x7f9590144180 2021-11-12T05:40:53.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.978+0000 7f958ffff700 1 --2- 172.21.2.105:0/1319917526 >> v2:172.21.2.115:3300/0 conn(0x7f95900aca40 0x7f95900ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:53.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.978+0000 7f958effd700 1 -- 172.21.2.105:0/1319917526 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1968326101 0 0) 0x7f9570003260 con 0x7f9590144180 2021-11-12T05:40:53.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.978+0000 7f958effd700 1 -- 172.21.2.105:0/1319917526 >> v2:172.21.2.115:3300/0 conn(0x7f95900aca40 msgr2=0x7f95900ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:53.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.978+0000 7f958effd700 1 --2- 172.21.2.105:0/1319917526 >> v2:172.21.2.115:3300/0 conn(0x7f95900aca40 0x7f95900ace20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:53.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.978+0000 7f958effd700 1 -- 172.21.2.105:0/1319917526 >> v1:172.21.2.115:6789/0 conn(0x7f95900b0520 legacy=0x7f95901473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:53.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.978+0000 7f958effd700 1 -- 172.21.2.105:0/1319917526 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95900b1a70 con 0x7f9590144180 2021-11-12T05:40:53.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.978+0000 7f958effd700 1 -- 172.21.2.105:0/1319917526 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f95880019e0 con 0x7f9590144180 2021-11-12T05:40:53.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.978+0000 7f958effd700 1 -- 172.21.2.105:0/1319917526 >> v1:172.21.2.105:6789/0 conn(0x7f9590144180 legacy=0x7f95901445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:53.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.978+0000 7f958effd700 1 --2- 172.21.2.105:0/1319917526 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9570003750 0x7f9570003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.978+0000 7f958effd700 1 --2- 172.21.2.105:0/1319917526 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9570004500 0x7f9570004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.978+0000 7f958effd700 1 --2- 172.21.2.105:0/1319917526 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9570004e70 0x7f957000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.978+0000 7f958effd700 1 -- 172.21.2.105:0/1319917526 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95900af2b0 con 0x7f9570004500 2021-11-12T05:40:53.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.978+0000 7f958effd700 1 -- 172.21.2.105:0/1319917526 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957000bcc0 con 0x7f9570003750 2021-11-12T05:40:53.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.978+0000 7f958effd700 1 -- 172.21.2.105:0/1319917526 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f957000be80 con 0x7f9570004e70 2021-11-12T05:40:53.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.978+0000 7f958f7fe700 1 --2- 172.21.2.105:0/1319917526 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9570004500 0x7f9570004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:53.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.978+0000 7f958ffff700 1 --2- 172.21.2.105:0/1319917526 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9570003750 0x7f9570003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:53.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.978+0000 7f9594ca7700 1 --2- 172.21.2.105:0/1319917526 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9570004e70 0x7f957000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:53.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.978+0000 7f958f7fe700 1 -- 172.21.2.105:0/1319917526 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9570004e70 msgr2=0x7f957000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:53.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f958f7fe700 1 --2- 172.21.2.105:0/1319917526 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9570004e70 0x7f957000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:53.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f958f7fe700 1 -- 172.21.2.105:0/1319917526 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9570003750 msgr2=0x7f9570003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:53.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f958f7fe700 1 --2- 172.21.2.105:0/1319917526 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9570003750 0x7f9570003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:53.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f958f7fe700 1 -- 172.21.2.105:0/1319917526 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95900b1a70 con 0x7f9570004500 2021-11-12T05:40:53.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f9594ca7700 1 --2- 172.21.2.105:0/1319917526 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9570004e70 0x7f957000b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:40:53.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f9594ca7700 1 -- 172.21.2.105:0/1319917526 reap_dead start 2021-11-12T05:40:53.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f958f7fe700 1 --2- 172.21.2.105:0/1319917526 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9570004500 0x7f9570004980 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f95900611e0 tx=0x7f9580007a00).ready entity=mon.0 client_cookie=c9395cdc051cca7d server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:53.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f958effd700 1 -- 172.21.2.105:0/1319917526 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9580007d10 con 0x7f9570004500 2021-11-12T05:40:53.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f958effd700 1 -- 172.21.2.105:0/1319917526 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9580007030 con 0x7f9570004500 2021-11-12T05:40:53.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f958effd700 1 -- 172.21.2.105:0/1319917526 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9580007390 con 0x7f9570004500 2021-11-12T05:40:53.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f959670a700 1 -- 172.21.2.105:0/1319917526 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9570004500 msgr2=0x7f9570004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:53.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f959670a700 1 --2- 172.21.2.105:0/1319917526 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9570004500 0x7f9570004980 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f95900611e0 tx=0x7f9580007a00).stop 2021-11-12T05:40:53.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f959670a700 1 -- 172.21.2.105:0/1319917526 shutdown_connections 2021-11-12T05:40:53.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f959670a700 1 --2- 172.21.2.105:0/1319917526 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9570004500 0x7f9570004980 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:53.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f959670a700 1 -- 172.21.2.105:0/1319917526 >> 172.21.2.105:0/1319917526 conn(0x7f959005c490 msgr2=0x7f95900b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:53.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f959670a700 1 -- 172.21.2.105:0/1319917526 shutdown_connections 2021-11-12T05:40:53.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f959670a700 1 -- 172.21.2.105:0/1319917526 wait complete. 2021-11-12T05:40:53.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f959670a700 1 Processor -- start 2021-11-12T05:40:53.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f959670a700 1 -- start start 2021-11-12T05:40:53.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f959670a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9570004500 0x7f95900aa110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f959670a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f959014a220 0x7f9590143540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f959670a700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9590143a30 0x7f95900ab370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:53.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f959670a700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95901484c0 con 0x7f959014a220 2021-11-12T05:40:53.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f959670a700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95900a7b80 con 0x7f9590143a30 2021-11-12T05:40:53.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f959670a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95900a7e20 con 0x7f9570004500 2021-11-12T05:40:53.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f958f7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f959014a220 0x7f9590143540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:53.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f958f7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f959014a220 0x7f9590143540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43620/0 (socket says 172.21.2.105:43620) 2021-11-12T05:40:53.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f958f7fe700 1 -- 172.21.2.105:0/1875591971 learned_addr learned my addr 172.21.2.105:0/1875591971 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:54.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f9594ca7700 1 --2- 172.21.2.105:0/1875591971 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9590143a30 0x7f95900ab370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:54.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f958ffff700 1 --2- 172.21.2.105:0/1875591971 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9570004500 0x7f95900aa110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:54.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f958f7fe700 1 -- 172.21.2.105:0/1875591971 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9570004500 msgr2=0x7f95900aa110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f958f7fe700 1 --2- 172.21.2.105:0/1875591971 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9570004500 0x7f95900aa110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:54.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f958f7fe700 1 -- 172.21.2.105:0/1875591971 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9590143a30 msgr2=0x7f95900ab370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f958f7fe700 1 --2- 172.21.2.105:0/1875591971 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9590143a30 0x7f95900ab370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:54.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f958f7fe700 1 -- 172.21.2.105:0/1875591971 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9590143eb0 con 0x7f959014a220 2021-11-12T05:40:54.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f958ffff700 1 --2- 172.21.2.105:0/1875591971 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9570004500 0x7f95900aa110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:40:54.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f958f7fe700 1 --2- 172.21.2.105:0/1875591971 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f959014a220 0x7f9590143540 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f95900611e0 tx=0x7f9580015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:54.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f958d7fa700 1 -- 172.21.2.105:0/1875591971 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95800127b0 con 0x7f959014a220 2021-11-12T05:40:54.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f958d7fa700 1 -- 172.21.2.105:0/1875591971 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9580012910 con 0x7f959014a220 2021-11-12T05:40:54.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f959670a700 1 -- 172.21.2.105:0/1875591971 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9590148140 con 0x7f959014a220 2021-11-12T05:40:54.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f958d7fa700 1 -- 172.21.2.105:0/1875591971 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9580012c70 con 0x7f959014a220 2021-11-12T05:40:54.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f959670a700 1 -- 172.21.2.105:0/1875591971 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9590147d60 con 0x7f959014a220 2021-11-12T05:40:54.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f959670a700 1 -- 172.21.2.105:0/1875591971 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9590057350 con 0x7f959014a220 2021-11-12T05:40:54.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.982+0000 7f958d7fa700 1 -- 172.21.2.105:0/1875591971 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9580028030 con 0x7f959014a220 2021-11-12T05:40:54.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.986+0000 7f958d7fa700 1 --2- 172.21.2.105:0/1875591971 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f95740536d0 0x7f9574055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.986+0000 7f958d7fa700 1 -- 172.21.2.105:0/1875591971 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f9580001e40 con 0x7f959014a220 2021-11-12T05:40:54.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.986+0000 7f958ffff700 1 --2- 172.21.2.105:0/1875591971 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f95740536d0 0x7f9574055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:54.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.986+0000 7f958ffff700 1 --2- 172.21.2.105:0/1875591971 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f95740536d0 0x7f9574055b90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f957800b000 tx=0x7f9578008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:54.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:53.986+0000 7f958d7fa700 1 -- 172.21.2.105:0/1875591971 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9580043ab0 con 0x7f959014a220 2021-11-12T05:40:54.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.074+0000 7f959670a700 1 -- 172.21.2.105:0/1875591971 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f95900b09d0 con 0x7f959014a220 2021-11-12T05:40:54.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.074+0000 7f958d7fa700 1 -- 172.21.2.105:0/1875591971 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7f95900b09d0 con 0x7f959014a220 2021-11-12T05:40:54.076 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:40:54.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.074+0000 7f959670a700 1 -- 172.21.2.105:0/1875591971 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f95740536d0 msgr2=0x7f9574055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.074+0000 7f959670a700 1 --2- 172.21.2.105:0/1875591971 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f95740536d0 0x7f9574055b90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f957800b000 tx=0x7f9578008040).stop 2021-11-12T05:40:54.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.074+0000 7f959670a700 1 -- 172.21.2.105:0/1875591971 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f959014a220 msgr2=0x7f9590143540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.074+0000 7f959670a700 1 --2- 172.21.2.105:0/1875591971 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f959014a220 0x7f9590143540 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f95900611e0 tx=0x7f9580015000).stop 2021-11-12T05:40:54.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.074+0000 7f959670a700 1 -- 172.21.2.105:0/1875591971 shutdown_connections 2021-11-12T05:40:54.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.074+0000 7f959670a700 1 --2- 172.21.2.105:0/1875591971 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f95740536d0 0x7f9574055b90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:54.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.074+0000 7f959670a700 1 --2- 172.21.2.105:0/1875591971 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9590143a30 0x7f95900ab370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:54.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.074+0000 7f959670a700 1 --2- 172.21.2.105:0/1875591971 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f959014a220 0x7f9590143540 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:54.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.074+0000 7f959670a700 1 --2- 172.21.2.105:0/1875591971 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9570004500 0x7f95900aa110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:54.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.074+0000 7f959670a700 1 -- 172.21.2.105:0/1875591971 >> 172.21.2.105:0/1875591971 conn(0x7f959005c490 msgr2=0x7f959014b250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:54.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.074+0000 7f959670a700 1 -- 172.21.2.105:0/1875591971 shutdown_connections 2021-11-12T05:40:54.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.074+0000 7f959670a700 1 -- 172.21.2.105:0/1875591971 wait complete. 2021-11-12T05:40:54.083 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:40:54.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc26b416700 1 Processor -- start 2021-11-12T05:40:54.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc26b416700 1 -- start start 2021-11-12T05:40:54.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc26b416700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc2640ace20 0x7fc2640b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc26b416700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fc264144180 0x7fc264144610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc26b416700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2640b1840 con 0x7fc2640aca40 2021-11-12T05:40:54.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc26b416700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2640ad2a0 con 0x7fc264144180 2021-11-12T05:40:54.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc26b416700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2640b0a10 con 0x7fc2640ace20 2021-11-12T05:40:54.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc2691b2700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fc2640aca40 0x7fc2641473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:54024/0 (socket says 172.21.2.105:54024) 2021-11-12T05:40:54.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc2691b2700 1 -- 172.21.2.105:0/3228559268 learned_addr learned my addr 172.21.2.105:0/3228559268 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:54.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc257fff700 1 -- 172.21.2.105:0/3228559268 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1587220953 0 0) 0x7fc2640b1840 con 0x7fc2640aca40 2021-11-12T05:40:54.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc257fff700 1 -- 172.21.2.105:0/3228559268 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc24c003260 con 0x7fc2640aca40 2021-11-12T05:40:54.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc2699b3700 1 --2- 172.21.2.105:0/3228559268 >> v2:172.21.2.115:3300/0 conn(0x7fc264144180 0x7fc264144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:54.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc2689b1700 1 --2- 172.21.2.105:0/3228559268 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc2640ace20 0x7fc2640b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:54.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc257fff700 1 -- 172.21.2.105:0/3228559268 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1062402806 0 0) 0x7fc24c003260 con 0x7fc2640aca40 2021-11-12T05:40:54.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc257fff700 1 -- 172.21.2.105:0/3228559268 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc2640ace20 msgr2=0x7fc2640b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:54.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc257fff700 1 --2- 172.21.2.105:0/3228559268 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc2640ace20 0x7fc2640b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:54.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc257fff700 1 -- 172.21.2.105:0/3228559268 >> v2:172.21.2.115:3300/0 conn(0x7fc264144180 msgr2=0x7fc264144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:54.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc257fff700 1 --2- 172.21.2.105:0/3228559268 >> v2:172.21.2.115:3300/0 conn(0x7fc264144180 0x7fc264144610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:54.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc257fff700 1 -- 172.21.2.105:0/3228559268 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2640af2b0 con 0x7fc2640aca40 2021-11-12T05:40:54.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc257fff700 1 -- 172.21.2.105:0/3228559268 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fc260001660 con 0x7fc2640aca40 2021-11-12T05:40:54.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc257fff700 1 -- 172.21.2.105:0/3228559268 >> v1:172.21.2.105:6789/0 conn(0x7fc2640aca40 legacy=0x7fc2641473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc257fff700 1 --2- 172.21.2.105:0/3228559268 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc24c0037d0 0x7fc24c003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc257fff700 1 --2- 172.21.2.105:0/3228559268 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc24c004500 0x7fc24c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc257fff700 1 --2- 172.21.2.105:0/3228559268 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc2640ace20 0x7fc24c004f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc257fff700 1 -- 172.21.2.105:0/3228559268 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2640b0a10 con 0x7fc24c0037d0 2021-11-12T05:40:54.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc257fff700 1 -- 172.21.2.105:0/3228559268 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c00b830 con 0x7fc24c004500 2021-11-12T05:40:54.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc257fff700 1 -- 172.21.2.105:0/3228559268 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c00b9f0 con 0x7fc2640ace20 2021-11-12T05:40:54.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc2691b2700 1 --2- 172.21.2.105:0/3228559268 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc24c0037d0 0x7fc24c003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:54.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc2691b2700 1 -- 172.21.2.105:0/3228559268 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc2640ace20 msgr2=0x7fc24c004f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:54.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc2691b2700 1 --2- 172.21.2.105:0/3228559268 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc2640ace20 0x7fc24c004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:54.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc2691b2700 1 -- 172.21.2.105:0/3228559268 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc24c004500 msgr2=0x7fc24c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:54.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc2691b2700 1 --2- 172.21.2.105:0/3228559268 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc24c004500 0x7fc24c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:54.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc2691b2700 1 -- 172.21.2.105:0/3228559268 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc24c003260 con 0x7fc24c0037d0 2021-11-12T05:40:54.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc2691b2700 1 --2- 172.21.2.105:0/3228559268 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc24c0037d0 0x7fc24c003bf0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fc260001370 tx=0x7fc260001d80).ready entity=mon.0 client_cookie=75065760128d2208 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:54.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc257fff700 1 -- 172.21.2.105:0/3228559268 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2600070d0 con 0x7fc24c0037d0 2021-11-12T05:40:54.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc257fff700 1 -- 172.21.2.105:0/3228559268 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc260007230 con 0x7fc24c0037d0 2021-11-12T05:40:54.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc257fff700 1 -- 172.21.2.105:0/3228559268 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc26000c8f0 con 0x7fc24c0037d0 2021-11-12T05:40:54.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc26b416700 1 -- 172.21.2.105:0/3228559268 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc24c0037d0 msgr2=0x7fc24c003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc26b416700 1 --2- 172.21.2.105:0/3228559268 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc24c0037d0 0x7fc24c003bf0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fc260001370 tx=0x7fc260001d80).stop 2021-11-12T05:40:54.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc2699b3700 1 -- 172.21.2.105:0/3228559268 reap_dead start 2021-11-12T05:40:54.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc26b416700 1 -- 172.21.2.105:0/3228559268 shutdown_connections 2021-11-12T05:40:54.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc26b416700 1 -- 172.21.2.105:0/3228559268 >> 172.21.2.105:0/3228559268 conn(0x7fc26405c490 msgr2=0x7fc2640b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:54.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc26b416700 1 -- 172.21.2.105:0/3228559268 shutdown_connections 2021-11-12T05:40:54.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.134+0000 7fc26b416700 1 -- 172.21.2.105:0/3228559268 wait complete. 2021-11-12T05:40:54.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.138+0000 7fc26b416700 1 Processor -- start 2021-11-12T05:40:54.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.138+0000 7fc26b416700 1 -- start start 2021-11-12T05:40:54.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.138+0000 7fc26b416700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc2640627a0 0x7fc26414e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.138+0000 7fc26b416700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc2641478a0 0x7fc2641427f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.138+0000 7fc26b416700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc264142ce0 0x7fc264064e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.138+0000 7fc26b416700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26414e1b0 con 0x7fc2640627a0 2021-11-12T05:40:54.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.138+0000 7fc26b416700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc264147db0 con 0x7fc2641478a0 2021-11-12T05:40:54.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.138+0000 7fc26b416700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc264146aa0 con 0x7fc264142ce0 2021-11-12T05:40:54.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.138+0000 7fc2691b2700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc2640627a0 0x7fc26414e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:54.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.138+0000 7fc2691b2700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc2640627a0 0x7fc26414e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43640/0 (socket says 172.21.2.105:43640) 2021-11-12T05:40:54.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.138+0000 7fc2691b2700 1 -- 172.21.2.105:0/1360781747 learned_addr learned my addr 172.21.2.105:0/1360781747 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:54.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.138+0000 7fc2689b1700 1 --2- 172.21.2.105:0/1360781747 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc2641478a0 0x7fc2641427f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:54.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.138+0000 7fc2699b3700 1 --2- 172.21.2.105:0/1360781747 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc264142ce0 0x7fc264064e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:54.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.138+0000 7fc2691b2700 1 -- 172.21.2.105:0/1360781747 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc264142ce0 msgr2=0x7fc264064e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.138+0000 7fc2691b2700 1 --2- 172.21.2.105:0/1360781747 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc264142ce0 0x7fc264064e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:54.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.138+0000 7fc2691b2700 1 -- 172.21.2.105:0/1360781747 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc2641478a0 msgr2=0x7fc2641427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.138+0000 7fc2691b2700 1 --2- 172.21.2.105:0/1360781747 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc2641478a0 0x7fc2641427f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:54.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.138+0000 7fc2691b2700 1 -- 172.21.2.105:0/1360781747 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc264062b80 con 0x7fc2640627a0 2021-11-12T05:40:54.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.138+0000 7fc2691b2700 1 --2- 172.21.2.105:0/1360781747 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc2640627a0 0x7fc26414e5a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7fc264143130 tx=0x7fc260015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:54.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.138+0000 7fc2567fc700 1 -- 172.21.2.105:0/1360781747 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2600070d0 con 0x7fc2640627a0 2021-11-12T05:40:54.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.138+0000 7fc2567fc700 1 -- 172.21.2.105:0/1360781747 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26000ce60 con 0x7fc2640627a0 2021-11-12T05:40:54.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.138+0000 7fc26b416700 1 -- 172.21.2.105:0/1360781747 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc264147fe0 con 0x7fc2640627a0 2021-11-12T05:40:54.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.138+0000 7fc26b416700 1 -- 172.21.2.105:0/1360781747 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2640ac310 con 0x7fc2640627a0 2021-11-12T05:40:54.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.138+0000 7fc2567fc700 1 -- 172.21.2.105:0/1360781747 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2600049e0 con 0x7fc2640627a0 2021-11-12T05:40:54.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.138+0000 7fc26b416700 1 -- 172.21.2.105:0/1360781747 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2640ac310 con 0x7fc2640627a0 2021-11-12T05:40:54.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.138+0000 7fc2567fc700 1 -- 172.21.2.105:0/1360781747 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc260025020 con 0x7fc2640627a0 2021-11-12T05:40:54.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.138+0000 7fc2567fc700 1 --2- 172.21.2.105:0/1360781747 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc244053720 0x7fc244055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.138+0000 7fc2567fc700 1 -- 172.21.2.105:0/1360781747 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fc26006cc30 con 0x7fc2640627a0 2021-11-12T05:40:54.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.138+0000 7fc2689b1700 1 --2- 172.21.2.105:0/1360781747 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc244053720 0x7fc244055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:54.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.138+0000 7fc2689b1700 1 --2- 172.21.2.105:0/1360781747 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc244053720 0x7fc244055be0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fc25800c000 tx=0x7fc258008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:54.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.142+0000 7fc2567fc700 1 -- 172.21.2.105:0/1360781747 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc260043b20 con 0x7fc2640627a0 2021-11-12T05:40:54.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.226+0000 7fc26b416700 1 -- 172.21.2.105:0/1360781747 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc2640ac310 con 0x7fc2640627a0 2021-11-12T05:40:54.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.226+0000 7fc2567fc700 1 -- 172.21.2.105:0/1360781747 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc260047140 con 0x7fc2640627a0 2021-11-12T05:40:54.229 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:40:54.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.226+0000 7fc26b416700 1 -- 172.21.2.105:0/1360781747 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc244053720 msgr2=0x7fc244055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.226+0000 7fc26b416700 1 --2- 172.21.2.105:0/1360781747 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc244053720 0x7fc244055be0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fc25800c000 tx=0x7fc258008040).stop 2021-11-12T05:40:54.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.226+0000 7fc26b416700 1 -- 172.21.2.105:0/1360781747 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc2640627a0 msgr2=0x7fc26414e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.226+0000 7fc26b416700 1 --2- 172.21.2.105:0/1360781747 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc2640627a0 0x7fc26414e5a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7fc264143130 tx=0x7fc260015000).stop 2021-11-12T05:40:54.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.226+0000 7fc26b416700 1 -- 172.21.2.105:0/1360781747 shutdown_connections 2021-11-12T05:40:54.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.226+0000 7fc26b416700 1 --2- 172.21.2.105:0/1360781747 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc244053720 0x7fc244055be0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:54.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.226+0000 7fc26b416700 1 --2- 172.21.2.105:0/1360781747 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc264142ce0 0x7fc264064e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:54.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.226+0000 7fc26b416700 1 --2- 172.21.2.105:0/1360781747 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc2641478a0 0x7fc2641427f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:54.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.226+0000 7fc26b416700 1 --2- 172.21.2.105:0/1360781747 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc2640627a0 0x7fc26414e5a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:54.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.226+0000 7fc26b416700 1 -- 172.21.2.105:0/1360781747 >> 172.21.2.105:0/1360781747 conn(0x7fc26405c490 msgr2=0x7fc264148890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:54.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.226+0000 7fc26b416700 1 -- 172.21.2.105:0/1360781747 shutdown_connections 2021-11-12T05:40:54.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.226+0000 7fc26b416700 1 -- 172.21.2.105:0/1360781747 wait complete. 2021-11-12T05:40:54.235 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-12T05:40:54.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.286+0000 7fed76df6700 1 Processor -- start 2021-11-12T05:40:54.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.286+0000 7fed76df6700 1 -- start start 2021-11-12T05:40:54.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.286+0000 7fed76df6700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fed700626b0 0x7fed70062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.286+0000 7fed76df6700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fed700af750 0x7fed70130370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.286+0000 7fed76df6700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed70130cf0 con 0x7fed70130860 2021-11-12T05:40:54.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.286+0000 7fed76df6700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed700b0d50 con 0x7fed700af750 2021-11-12T05:40:54.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.286+0000 7fed76df6700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed700ad380 con 0x7fed700626b0 2021-11-12T05:40:54.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.286+0000 7fed75393700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fed70130860 0x7fed7014a950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:54046/0 (socket says 172.21.2.105:54046) 2021-11-12T05:40:54.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.286+0000 7fed75393700 1 -- 172.21.2.105:0/2961944251 learned_addr learned my addr 172.21.2.105:0/2961944251 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:54.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.286+0000 7fed6ffff700 1 --2- 172.21.2.105:0/2961944251 >> v2:172.21.2.105:3300/0 conn(0x7fed700af750 0x7fed70130370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:54.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.286+0000 7fed6ffff700 1 -- 172.21.2.105:0/2961944251 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fed700626b0 msgr2=0x7fed70062a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:54.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.286+0000 7fed6ffff700 1 --2- 172.21.2.105:0/2961944251 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fed700626b0 0x7fed70062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:54.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.286+0000 7fed6ffff700 1 -- 172.21.2.105:0/2961944251 >> v1:172.21.2.105:6789/0 conn(0x7fed70130860 legacy=0x7fed7014a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.286+0000 7fed6ffff700 1 -- 172.21.2.105:0/2961944251 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed700ae190 con 0x7fed700af750 2021-11-12T05:40:54.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.286+0000 7fed6ffff700 1 --2- 172.21.2.105:0/2961944251 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fed700af750 0x7fed70130370 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7fed60002f70 tx=0x7fed60006df0).ready entity=mon.0 client_cookie=96cd32d198544b49 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:54.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.286+0000 7fed6f7fe700 1 -- 172.21.2.105:0/2961944251 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed6000d570 con 0x7fed700af750 2021-11-12T05:40:54.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.286+0000 7fed6f7fe700 1 -- 172.21.2.105:0/2961944251 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed60000e90 con 0x7fed700af750 2021-11-12T05:40:54.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.286+0000 7fed6f7fe700 1 -- 172.21.2.105:0/2961944251 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed6000d8c0 con 0x7fed700af750 2021-11-12T05:40:54.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.286+0000 7fed76df6700 1 -- 172.21.2.105:0/2961944251 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fed700af750 msgr2=0x7fed70130370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.286+0000 7fed76df6700 1 --2- 172.21.2.105:0/2961944251 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fed700af750 0x7fed70130370 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7fed60002f70 tx=0x7fed60006df0).stop 2021-11-12T05:40:54.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.286+0000 7fed76df6700 1 -- 172.21.2.105:0/2961944251 shutdown_connections 2021-11-12T05:40:54.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.286+0000 7fed76df6700 1 --2- 172.21.2.105:0/2961944251 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fed700af750 0x7fed70130370 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:54.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.286+0000 7fed76df6700 1 --2- 172.21.2.105:0/2961944251 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fed700626b0 0x7fed70062a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:54.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.286+0000 7fed76df6700 1 -- 172.21.2.105:0/2961944251 >> 172.21.2.105:0/2961944251 conn(0x7fed700b5320 msgr2=0x7fed700b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:54.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.286+0000 7fed76df6700 1 -- 172.21.2.105:0/2961944251 shutdown_connections 2021-11-12T05:40:54.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.286+0000 7fed76df6700 1 -- 172.21.2.105:0/2961944251 wait complete. 2021-11-12T05:40:54.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.290+0000 7fed76df6700 1 Processor -- start 2021-11-12T05:40:54.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.290+0000 7fed76df6700 1 -- start start 2021-11-12T05:40:54.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.290+0000 7fed76df6700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fed700626b0 0x7fed70066370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.290+0000 7fed76df6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fed700af750 0x7fed70066860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.290+0000 7fed76df6700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fed70130860 0x7fed701445d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.290+0000 7fed76df6700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7014f140 con 0x7fed700af750 2021-11-12T05:40:54.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.290+0000 7fed76df6700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed70064d90 con 0x7fed700626b0 2021-11-12T05:40:54.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.290+0000 7fed76df6700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed70064af0 con 0x7fed70130860 2021-11-12T05:40:54.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.290+0000 7fed6ffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fed700af750 0x7fed70066860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:54.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.290+0000 7fed6ffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fed700af750 0x7fed70066860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43658/0 (socket says 172.21.2.105:43658) 2021-11-12T05:40:54.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.290+0000 7fed6ffff700 1 -- 172.21.2.105:0/3413147653 learned_addr learned my addr 172.21.2.105:0/3413147653 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:54.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.290+0000 7fed6ffff700 1 -- 172.21.2.105:0/3413147653 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fed70130860 msgr2=0x7fed701445d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.290+0000 7fed6ffff700 1 --2- 172.21.2.105:0/3413147653 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fed70130860 0x7fed701445d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:54.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.290+0000 7fed6ffff700 1 -- 172.21.2.105:0/3413147653 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fed700626b0 msgr2=0x7fed70066370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.290+0000 7fed6ffff700 1 --2- 172.21.2.105:0/3413147653 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fed700626b0 0x7fed70066370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:54.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.290+0000 7fed6ffff700 1 -- 172.21.2.105:0/3413147653 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6000b180 con 0x7fed700af750 2021-11-12T05:40:54.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.290+0000 7fed6ffff700 1 --2- 172.21.2.105:0/3413147653 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fed700af750 0x7fed70066860 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fed60002f70 tx=0x7fed60015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:54.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.290+0000 7fed6dffb700 1 -- 172.21.2.105:0/3413147653 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed6000de60 con 0x7fed700af750 2021-11-12T05:40:54.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.290+0000 7fed6dffb700 1 -- 172.21.2.105:0/3413147653 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed60011ca0 con 0x7fed700af750 2021-11-12T05:40:54.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.290+0000 7fed76df6700 1 -- 172.21.2.105:0/3413147653 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed70062ba0 con 0x7fed700af750 2021-11-12T05:40:54.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.290+0000 7fed76df6700 1 -- 172.21.2.105:0/3413147653 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed70063040 con 0x7fed700af750 2021-11-12T05:40:54.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.290+0000 7fed6dffb700 1 -- 172.21.2.105:0/3413147653 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed6001e460 con 0x7fed700af750 2021-11-12T05:40:54.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.290+0000 7fed76df6700 1 -- 172.21.2.105:0/3413147653 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed70063e10 con 0x7fed700af750 2021-11-12T05:40:54.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.290+0000 7fed6dffb700 1 -- 172.21.2.105:0/3413147653 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fed60025030 con 0x7fed700af750 2021-11-12T05:40:54.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.290+0000 7fed6dffb700 1 --2- 172.21.2.105:0/3413147653 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fed54053660 0x7fed54055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.290+0000 7fed6dffb700 1 -- 172.21.2.105:0/3413147653 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fed6006cff0 con 0x7fed700af750 2021-11-12T05:40:54.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.290+0000 7fed74b92700 1 --2- 172.21.2.105:0/3413147653 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fed54053660 0x7fed54055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:54.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.290+0000 7fed74b92700 1 --2- 172.21.2.105:0/3413147653 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fed54053660 0x7fed54055b20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fed58002f70 tx=0x7fed58006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:54.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.294+0000 7fed6dffb700 1 -- 172.21.2.105:0/3413147653 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fed70063e10 con 0x7fed700af750 2021-11-12T05:40:54.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.378+0000 7fed76df6700 1 -- 172.21.2.105:0/3413147653 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fed70063e10 con 0x7fed700af750 2021-11-12T05:40:54.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.378+0000 7fed6dffb700 1 -- 172.21.2.105:0/3413147653 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7fed70063e10 con 0x7fed700af750 2021-11-12T05:40:54.380 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:40:54.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.378+0000 7fed76df6700 1 -- 172.21.2.105:0/3413147653 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fed54053660 msgr2=0x7fed54055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.378+0000 7fed76df6700 1 --2- 172.21.2.105:0/3413147653 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fed54053660 0x7fed54055b20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fed58002f70 tx=0x7fed58006a80).stop 2021-11-12T05:40:54.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.378+0000 7fed76df6700 1 -- 172.21.2.105:0/3413147653 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fed700af750 msgr2=0x7fed70066860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.378+0000 7fed76df6700 1 --2- 172.21.2.105:0/3413147653 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fed700af750 0x7fed70066860 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fed60002f70 tx=0x7fed60015000).stop 2021-11-12T05:40:54.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.378+0000 7fed76df6700 1 -- 172.21.2.105:0/3413147653 shutdown_connections 2021-11-12T05:40:54.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.378+0000 7fed76df6700 1 --2- 172.21.2.105:0/3413147653 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fed54053660 0x7fed54055b20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:54.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.378+0000 7fed76df6700 1 --2- 172.21.2.105:0/3413147653 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fed70130860 0x7fed701445d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:54.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.378+0000 7fed76df6700 1 --2- 172.21.2.105:0/3413147653 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fed700af750 0x7fed70066860 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:54.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.378+0000 7fed76df6700 1 --2- 172.21.2.105:0/3413147653 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fed700626b0 0x7fed70066370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:54.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.378+0000 7fed76df6700 1 -- 172.21.2.105:0/3413147653 >> 172.21.2.105:0/3413147653 conn(0x7fed700b5320 msgr2=0x7fed7014a860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:54.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.378+0000 7fed76df6700 1 -- 172.21.2.105:0/3413147653 shutdown_connections 2021-11-12T05:40:54.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.378+0000 7fed76df6700 1 -- 172.21.2.105:0/3413147653 wait complete. 2021-11-12T05:40:54.387 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-12T05:40:54.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.438+0000 7f900bd51700 1 Processor -- start 2021-11-12T05:40:54.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.438+0000 7f900bd51700 1 -- start start 2021-11-12T05:40:54.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.438+0000 7f900bd51700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f900413f160 0x7f9004143360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.438+0000 7f900bd51700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90040ad400 con 0x7f90040b1060 2021-11-12T05:40:54.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.438+0000 7f900bd51700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90040b3200 con 0x7f90040b2e20 2021-11-12T05:40:54.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.438+0000 7f900bd51700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90040ad660 con 0x7f900413f160 2021-11-12T05:40:54.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.438+0000 7f900a2ee700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f900413f160 0x7f9004143360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:54.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.438+0000 7f90092ec700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f90040b1060 0x7f9004142c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:54060/0 (socket says 172.21.2.105:54060) 2021-11-12T05:40:54.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.438+0000 7f90092ec700 1 -- 172.21.2.105:0/533666476 learned_addr learned my addr 172.21.2.105:0/533666476 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:54.445 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.438+0000 7f900a2ee700 1 -- 172.21.2.105:0/533666476 >> v1:172.21.2.115:6789/0 conn(0x7f90040b2e20 legacy=0x7f900413ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:54.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.438+0000 7f900a2ee700 1 -- 172.21.2.105:0/533666476 >> v1:172.21.2.105:6789/0 conn(0x7f90040b1060 legacy=0x7f9004142c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.438+0000 7f900a2ee700 1 -- 172.21.2.105:0/533666476 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90040ad900 con 0x7f900413f160 2021-11-12T05:40:54.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.438+0000 7f900a2ee700 1 --2- 172.21.2.105:0/533666476 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f900413f160 0x7f9004143360 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f90040b35c0 tx=0x7f8ffc0091d0).ready entity=mon.0 client_cookie=e89c1af31eede3fa server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:54.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.438+0000 7f9008aeb700 1 -- 172.21.2.105:0/533666476 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ffc009ea0 con 0x7f900413f160 2021-11-12T05:40:54.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.438+0000 7f9008aeb700 1 -- 172.21.2.105:0/533666476 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ffc00b860 con 0x7f900413f160 2021-11-12T05:40:54.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.438+0000 7f9008aeb700 1 -- 172.21.2.105:0/533666476 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ffc00b9d0 con 0x7f900413f160 2021-11-12T05:40:54.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.438+0000 7f900bd51700 1 -- 172.21.2.105:0/533666476 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f900413f160 msgr2=0x7f9004143360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.438+0000 7f900bd51700 1 --2- 172.21.2.105:0/533666476 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f900413f160 0x7f9004143360 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f90040b35c0 tx=0x7f8ffc0091d0).stop 2021-11-12T05:40:54.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.438+0000 7f900bd51700 1 -- 172.21.2.105:0/533666476 shutdown_connections 2021-11-12T05:40:54.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.438+0000 7f900bd51700 1 --2- 172.21.2.105:0/533666476 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f900413f160 0x7f9004143360 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:54.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.438+0000 7f900bd51700 1 -- 172.21.2.105:0/533666476 >> 172.21.2.105:0/533666476 conn(0x7f9004062f60 msgr2=0x7f9004063370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:54.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.438+0000 7f900bd51700 1 -- 172.21.2.105:0/533666476 shutdown_connections 2021-11-12T05:40:54.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.438+0000 7f900bd51700 1 -- 172.21.2.105:0/533666476 wait complete. 2021-11-12T05:40:54.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.442+0000 7f900bd51700 1 Processor -- start 2021-11-12T05:40:54.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.442+0000 7f900bd51700 1 -- start start 2021-11-12T05:40:54.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.442+0000 7f900bd51700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f90040b1060 0x7f90040a56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.442+0000 7f900bd51700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f90040b2e20 0x7f9004064ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.442+0000 7f900bd51700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f900413f160 0x7f9004064fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.442+0000 7f900bd51700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90040a5be0 con 0x7f90040b2e20 2021-11-12T05:40:54.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.442+0000 7f900bd51700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90040673c0 con 0x7f900413f160 2021-11-12T05:40:54.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.442+0000 7f900bd51700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9004067120 con 0x7f90040b1060 2021-11-12T05:40:54.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.442+0000 7f90092ec700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f90040b2e20 0x7f9004064ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:54.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.442+0000 7f90092ec700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f90040b2e20 0x7f9004064ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43670/0 (socket says 172.21.2.105:43670) 2021-11-12T05:40:54.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.442+0000 7f90092ec700 1 -- 172.21.2.105:0/3741389120 learned_addr learned my addr 172.21.2.105:0/3741389120 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:54.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.442+0000 7f90092ec700 1 -- 172.21.2.105:0/3741389120 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f90040b1060 msgr2=0x7f90040a56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.442+0000 7f90092ec700 1 --2- 172.21.2.105:0/3741389120 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f90040b1060 0x7f90040a56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:54.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.442+0000 7f90092ec700 1 -- 172.21.2.105:0/3741389120 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f900413f160 msgr2=0x7f9004064fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.442+0000 7f90092ec700 1 --2- 172.21.2.105:0/3741389120 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f900413f160 0x7f9004064fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:54.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.442+0000 7f90092ec700 1 -- 172.21.2.105:0/3741389120 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ffc009470 con 0x7f90040b2e20 2021-11-12T05:40:54.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.442+0000 7f90092ec700 1 --2- 172.21.2.105:0/3741389120 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f90040b2e20 0x7f9004064ad0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f90040a4480 tx=0x7f9000007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:54.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.442+0000 7f8ff6ffd700 1 -- 172.21.2.105:0/3741389120 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f900000ce20 con 0x7f90040b2e20 2021-11-12T05:40:54.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.442+0000 7f8ff6ffd700 1 -- 172.21.2.105:0/3741389120 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90000072e0 con 0x7f90040b2e20 2021-11-12T05:40:54.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.442+0000 7f900bd51700 1 -- 172.21.2.105:0/3741389120 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90040a5de0 con 0x7f90040b2e20 2021-11-12T05:40:54.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.442+0000 7f8ff6ffd700 1 -- 172.21.2.105:0/3741389120 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90000057c0 con 0x7f90040b2e20 2021-11-12T05:40:54.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.442+0000 7f900bd51700 1 -- 172.21.2.105:0/3741389120 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9004067700 con 0x7f90040b2e20 2021-11-12T05:40:54.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.442+0000 7f900bd51700 1 -- 172.21.2.105:0/3741389120 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90040a5f70 con 0x7f90040b2e20 2021-11-12T05:40:54.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.442+0000 7f8ff6ffd700 1 -- 172.21.2.105:0/3741389120 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9000010070 con 0x7f90040b2e20 2021-11-12T05:40:54.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.442+0000 7f8ff6ffd700 1 --2- 172.21.2.105:0/3741389120 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8fe40536a0 0x7f8fe4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.442+0000 7f8ff6ffd700 1 -- 172.21.2.105:0/3741389120 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f900006b060 con 0x7f90040b2e20 2021-11-12T05:40:54.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.442+0000 7f9009aed700 1 --2- 172.21.2.105:0/3741389120 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8fe40536a0 0x7f8fe4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:54.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.442+0000 7f9009aed700 1 --2- 172.21.2.105:0/3741389120 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8fe40536a0 0x7f8fe4055b60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f8ff8002f90 tx=0x7f8ff80069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:54.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.446+0000 7f8ff6ffd700 1 -- 172.21.2.105:0/3741389120 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9000042060 con 0x7f90040b2e20 2021-11-12T05:40:54.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.526+0000 7f900bd51700 1 -- 172.21.2.105:0/3741389120 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f90040b2060 con 0x7f90040b2e20 2021-11-12T05:40:54.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.526+0000 7f8ff6ffd700 1 -- 172.21.2.105:0/3741389120 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7f9000045680 con 0x7f90040b2e20 2021-11-12T05:40:54.530 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:40:54.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.526+0000 7f900bd51700 1 -- 172.21.2.105:0/3741389120 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8fe40536a0 msgr2=0x7f8fe4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.526+0000 7f900bd51700 1 --2- 172.21.2.105:0/3741389120 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8fe40536a0 0x7f8fe4055b60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f8ff8002f90 tx=0x7f8ff80069b0).stop 2021-11-12T05:40:54.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.526+0000 7f900bd51700 1 -- 172.21.2.105:0/3741389120 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f90040b2e20 msgr2=0x7f9004064ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.526+0000 7f900bd51700 1 --2- 172.21.2.105:0/3741389120 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f90040b2e20 0x7f9004064ad0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f90040a4480 tx=0x7f9000007c30).stop 2021-11-12T05:40:54.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.526+0000 7f900bd51700 1 -- 172.21.2.105:0/3741389120 shutdown_connections 2021-11-12T05:40:54.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.526+0000 7f900bd51700 1 --2- 172.21.2.105:0/3741389120 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8fe40536a0 0x7f8fe4055b60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:54.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.526+0000 7f900bd51700 1 --2- 172.21.2.105:0/3741389120 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f900413f160 0x7f9004064fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:54.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.526+0000 7f900bd51700 1 --2- 172.21.2.105:0/3741389120 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f90040b2e20 0x7f9004064ad0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:54.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.526+0000 7f900bd51700 1 --2- 172.21.2.105:0/3741389120 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f90040b1060 0x7f90040a56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:54.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.526+0000 7f900bd51700 1 -- 172.21.2.105:0/3741389120 >> 172.21.2.105:0/3741389120 conn(0x7f9004062f60 msgr2=0x7f900413dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:54.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.526+0000 7f900bd51700 1 -- 172.21.2.105:0/3741389120 shutdown_connections 2021-11-12T05:40:54.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.526+0000 7f900bd51700 1 -- 172.21.2.105:0/3741389120 wait complete. 2021-11-12T05:40:54.537 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:40:54.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00ba079700 1 Processor -- start 2021-11-12T05:40:54.588 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00ba079700 1 -- start start 2021-11-12T05:40:54.588 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00ba079700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f00b40b6430 0x7f00b40b6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.588 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00ba079700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f00b40b3150 0x7f00b414aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00ba079700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b40b3c50 con 0x7f00b40ab3b0 2021-11-12T05:40:54.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00ba079700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b414bac0 con 0x7f00b40b6430 2021-11-12T05:40:54.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00ba079700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b40a9cb0 con 0x7f00b40b3150 2021-11-12T05:40:54.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00b2ffd700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f00b40ab3b0 0x7f00b4146b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:54076/0 (socket says 172.21.2.105:54076) 2021-11-12T05:40:54.590 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00b2ffd700 1 -- 172.21.2.105:0/1616101700 learned_addr learned my addr 172.21.2.105:0/1616101700 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:54.594 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00b27fc700 1 -- 172.21.2.105:0/1616101700 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2566276670 0 0) 0x7f00b40b3c50 con 0x7f00b40ab3b0 2021-11-12T05:40:54.594 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00b27fc700 1 -- 172.21.2.105:0/1616101700 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0094003260 con 0x7f00b40ab3b0 2021-11-12T05:40:54.594 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00b37fe700 1 --2- 172.21.2.105:0/1616101700 >> v2:172.21.2.115:3300/0 conn(0x7f00b40b6430 0x7f00b40b6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:54.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00b3fff700 1 --2- 172.21.2.105:0/1616101700 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f00b40b3150 0x7f00b414aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:54.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00b27fc700 1 -- 172.21.2.105:0/1616101700 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1435086454 0 0) 0x7f0094003260 con 0x7f00b40ab3b0 2021-11-12T05:40:54.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00b27fc700 1 -- 172.21.2.105:0/1616101700 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f00b40b3150 msgr2=0x7f00b414aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:54.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00b27fc700 1 --2- 172.21.2.105:0/1616101700 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f00b40b3150 0x7f00b414aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:54.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00b27fc700 1 -- 172.21.2.105:0/1616101700 >> v2:172.21.2.115:3300/0 conn(0x7f00b40b6430 msgr2=0x7f00b40b6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:54.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00b27fc700 1 --2- 172.21.2.105:0/1616101700 >> v2:172.21.2.115:3300/0 conn(0x7f00b40b6430 0x7f00b40b6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:54.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00b27fc700 1 -- 172.21.2.105:0/1616101700 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b40a9f50 con 0x7f00b40ab3b0 2021-11-12T05:40:54.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00b27fc700 1 -- 172.21.2.105:0/1616101700 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f009c001660 con 0x7f00b40ab3b0 2021-11-12T05:40:54.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00b27fc700 1 -- 172.21.2.105:0/1616101700 >> v1:172.21.2.105:6789/0 conn(0x7f00b40ab3b0 legacy=0x7f00b4146b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00b27fc700 1 --2- 172.21.2.105:0/1616101700 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f00b40b3150 0x7f00940037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00b27fc700 1 --2- 172.21.2.105:0/1616101700 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0094003e00 0x7f0094004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00b27fc700 1 --2- 172.21.2.105:0/1616101700 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f00940049f0 0x7f0094004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00b27fc700 1 -- 172.21.2.105:0/1616101700 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b414bac0 con 0x7f0094003e00 2021-11-12T05:40:54.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00b27fc700 1 -- 172.21.2.105:0/1616101700 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b40a9cb0 con 0x7f00940049f0 2021-11-12T05:40:54.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00b27fc700 1 -- 172.21.2.105:0/1616101700 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f009400b8e0 con 0x7f00b40b3150 2021-11-12T05:40:54.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00b2ffd700 1 --2- 172.21.2.105:0/1616101700 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0094003e00 0x7f0094004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:54.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00b2ffd700 1 -- 172.21.2.105:0/1616101700 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f00b40b3150 msgr2=0x7f00940037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:54.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00b2ffd700 1 --2- 172.21.2.105:0/1616101700 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f00b40b3150 0x7f00940037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:54.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00b2ffd700 1 -- 172.21.2.105:0/1616101700 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f00940049f0 msgr2=0x7f0094004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:54.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00b2ffd700 1 --2- 172.21.2.105:0/1616101700 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f00940049f0 0x7f0094004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:54.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00b2ffd700 1 -- 172.21.2.105:0/1616101700 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0094003260 con 0x7f0094003e00 2021-11-12T05:40:54.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00b2ffd700 1 --2- 172.21.2.105:0/1616101700 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0094003e00 0x7f0094004500 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f009c001370 tx=0x7f009c001d80).ready entity=mon.0 client_cookie=ab1b4496e9fdd55a server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:54.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00b27fc700 1 -- 172.21.2.105:0/1616101700 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f009c0070d0 con 0x7f0094003e00 2021-11-12T05:40:54.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00b27fc700 1 -- 172.21.2.105:0/1616101700 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009c007230 con 0x7f0094003e00 2021-11-12T05:40:54.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00b27fc700 1 -- 172.21.2.105:0/1616101700 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f009c00c8f0 con 0x7f0094003e00 2021-11-12T05:40:54.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00ba079700 1 -- 172.21.2.105:0/1616101700 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0094003e00 msgr2=0x7f0094004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00ba079700 1 --2- 172.21.2.105:0/1616101700 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0094003e00 0x7f0094004500 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f009c001370 tx=0x7f009c001d80).stop 2021-11-12T05:40:54.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00b3fff700 1 -- 172.21.2.105:0/1616101700 reap_dead start 2021-11-12T05:40:54.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00ba079700 1 -- 172.21.2.105:0/1616101700 shutdown_connections 2021-11-12T05:40:54.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00ba079700 1 -- 172.21.2.105:0/1616101700 >> 172.21.2.105:0/1616101700 conn(0x7f00b4063610 msgr2=0x7f00b40639f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:54.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00ba079700 1 -- 172.21.2.105:0/1616101700 shutdown_connections 2021-11-12T05:40:54.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.586+0000 7f00ba079700 1 -- 172.21.2.105:0/1616101700 wait complete. 2021-11-12T05:40:54.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.590+0000 7f00ba079700 1 Processor -- start 2021-11-12T05:40:54.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.590+0000 7f00ba079700 1 -- start start 2021-11-12T05:40:54.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.590+0000 7f00ba079700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0094003e00 0x7f00b409e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.590+0000 7f00ba079700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f00b4067510 0x7f00b4155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.590+0000 7f00ba079700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f00b41563e0 0x7f00b4064ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.590+0000 7f00ba079700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b40b0060 con 0x7f0094003e00 2021-11-12T05:40:54.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.590+0000 7f00ba079700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b40b08f0 con 0x7f00b41563e0 2021-11-12T05:40:54.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.590+0000 7f00ba079700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b4157810 con 0x7f00b4067510 2021-11-12T05:40:54.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.590+0000 7f00b37fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0094003e00 0x7f00b409e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:54.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.590+0000 7f00b37fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0094003e00 0x7f00b409e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43688/0 (socket says 172.21.2.105:43688) 2021-11-12T05:40:54.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.590+0000 7f00b37fe700 1 -- 172.21.2.105:0/370199797 learned_addr learned my addr 172.21.2.105:0/370199797 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:54.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.590+0000 7f00b37fe700 1 -- 172.21.2.105:0/370199797 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f00b4067510 msgr2=0x7f00b4155ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.590+0000 7f00b37fe700 1 --2- 172.21.2.105:0/370199797 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f00b4067510 0x7f00b4155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:54.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.590+0000 7f00b37fe700 1 -- 172.21.2.105:0/370199797 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f00b41563e0 msgr2=0x7f00b4064ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.590+0000 7f00b37fe700 1 --2- 172.21.2.105:0/370199797 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f00b41563e0 0x7f00b4064ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:54.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.590+0000 7f00b37fe700 1 -- 172.21.2.105:0/370199797 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b40b0450 con 0x7f0094003e00 2021-11-12T05:40:54.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.590+0000 7f00b37fe700 1 --2- 172.21.2.105:0/370199797 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0094003e00 0x7f00b409e9b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f00a400a000 tx=0x7f00a4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:54.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.590+0000 7f00b0ff9700 1 -- 172.21.2.105:0/370199797 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00a4016070 con 0x7f0094003e00 2021-11-12T05:40:54.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.590+0000 7f00b0ff9700 1 -- 172.21.2.105:0/370199797 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a4000e90 con 0x7f0094003e00 2021-11-12T05:40:54.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.590+0000 7f00ba079700 1 -- 172.21.2.105:0/370199797 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b4156860 con 0x7f0094003e00 2021-11-12T05:40:54.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.590+0000 7f00b0ff9700 1 -- 172.21.2.105:0/370199797 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00a4011a40 con 0x7f0094003e00 2021-11-12T05:40:54.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.590+0000 7f00ba079700 1 -- 172.21.2.105:0/370199797 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b40af3f0 con 0x7f0094003e00 2021-11-12T05:40:54.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.590+0000 7f00ba079700 1 -- 172.21.2.105:0/370199797 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00b40b05e0 con 0x7f0094003e00 2021-11-12T05:40:54.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.590+0000 7f00b0ff9700 1 -- 172.21.2.105:0/370199797 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f00a4011ba0 con 0x7f0094003e00 2021-11-12T05:40:54.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.590+0000 7f00b0ff9700 1 --2- 172.21.2.105:0/370199797 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0098053570 0x7f0098055a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.590+0000 7f00b0ff9700 1 -- 172.21.2.105:0/370199797 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f00a406b9d0 con 0x7f0094003e00 2021-11-12T05:40:54.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.590+0000 7f00b2ffd700 1 --2- 172.21.2.105:0/370199797 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0098053570 0x7f0098055a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:54.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.590+0000 7f00b2ffd700 1 --2- 172.21.2.105:0/370199797 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0098053570 0x7f0098055a30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f009c001370 tx=0x7f009c015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:54.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.594+0000 7f00b0ff9700 1 -- 172.21.2.105:0/370199797 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f00a40428c0 con 0x7f0094003e00 2021-11-12T05:40:54.682 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.678+0000 7f00ba079700 1 -- 172.21.2.105:0/370199797 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00b4057350 con 0x7f0094003e00 2021-11-12T05:40:54.683 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.682+0000 7f00b0ff9700 1 -- 172.21.2.105:0/370199797 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f00a4045ee0 con 0x7f0094003e00 2021-11-12T05:40:54.684 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:40:54.684 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":25,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:40:38.203083+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:40:32.786926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-12T05:40:35.006506+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:40:54.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.682+0000 7f00ba079700 1 -- 172.21.2.105:0/370199797 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0098053570 msgr2=0x7f0098055a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.682+0000 7f00ba079700 1 --2- 172.21.2.105:0/370199797 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0098053570 0x7f0098055a30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f009c001370 tx=0x7f009c015000).stop 2021-11-12T05:40:54.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.682+0000 7f00ba079700 1 -- 172.21.2.105:0/370199797 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0094003e00 msgr2=0x7f00b409e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.682+0000 7f00ba079700 1 --2- 172.21.2.105:0/370199797 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0094003e00 0x7f00b409e9b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f00a400a000 tx=0x7f00a4008040).stop 2021-11-12T05:40:54.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.682+0000 7f00ba079700 1 -- 172.21.2.105:0/370199797 shutdown_connections 2021-11-12T05:40:54.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.682+0000 7f00ba079700 1 --2- 172.21.2.105:0/370199797 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0098053570 0x7f0098055a30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:54.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.682+0000 7f00ba079700 1 --2- 172.21.2.105:0/370199797 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f00b41563e0 0x7f00b4064ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:54.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.682+0000 7f00ba079700 1 --2- 172.21.2.105:0/370199797 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f00b4067510 0x7f00b4155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:54.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.682+0000 7f00ba079700 1 --2- 172.21.2.105:0/370199797 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0094003e00 0x7f00b409e9b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:54.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.682+0000 7f00ba079700 1 -- 172.21.2.105:0/370199797 >> 172.21.2.105:0/370199797 conn(0x7f00b4063610 msgr2=0x7f00b4146620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:54.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.682+0000 7f00ba079700 1 -- 172.21.2.105:0/370199797 shutdown_connections 2021-11-12T05:40:54.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.682+0000 7f00ba079700 1 -- 172.21.2.105:0/370199797 wait complete. 2021-11-12T05:40:54.691 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-12T05:40:32.786926+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-11-12T05:40:35.006506+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-12T05:40:54.692 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:40:54.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.742+0000 7f2a330fc700 1 Processor -- start 2021-11-12T05:40:54.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.742+0000 7f2a330fc700 1 -- start start 2021-11-12T05:40:54.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.742+0000 7f2a330fc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f2a2c0ace20 0x7f2a2c0b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.742+0000 7f2a330fc700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a2c0b1840 con 0x7f2a2c0aca40 2021-11-12T05:40:54.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.742+0000 7f2a330fc700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a2c0af2b0 con 0x7f2a2c144180 2021-11-12T05:40:54.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.742+0000 7f2a330fc700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a2c0b0a10 con 0x7f2a2c0ace20 2021-11-12T05:40:54.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.742+0000 7f2a2bfff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f2a2c0ace20 0x7f2a2c0b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:54.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.742+0000 7f2a30e98700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f2a2c0aca40 0x7f2a2c1473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:54092/0 (socket says 172.21.2.105:54092) 2021-11-12T05:40:54.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.742+0000 7f2a30e98700 1 -- 172.21.2.105:0/3493835294 learned_addr learned my addr 172.21.2.105:0/3493835294 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:54.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.742+0000 7f2a2bfff700 1 -- 172.21.2.105:0/3493835294 >> v1:172.21.2.115:6789/0 conn(0x7f2a2c144180 legacy=0x7f2a2c1445f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:40:54.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.742+0000 7f2a2bfff700 1 -- 172.21.2.105:0/3493835294 >> v1:172.21.2.105:6789/0 conn(0x7f2a2c0aca40 legacy=0x7f2a2c1473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.742+0000 7f2a2bfff700 1 -- 172.21.2.105:0/3493835294 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c0b1a70 con 0x7f2a2c0ace20 2021-11-12T05:40:54.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.742+0000 7f2a2bfff700 1 --2- 172.21.2.105:0/3493835294 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2a2c0ace20 0x7f2a2c0b0520 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f2a2c0611e0 tx=0x7f2a1c006df0).ready entity=mon.0 client_cookie=948d746bd3794f24 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:54.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.742+0000 7f2a2b7fe700 1 -- 172.21.2.105:0/3493835294 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a1c00d5c0 con 0x7f2a2c0ace20 2021-11-12T05:40:54.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.742+0000 7f2a2b7fe700 1 -- 172.21.2.105:0/3493835294 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1c000e90 con 0x7f2a2c0ace20 2021-11-12T05:40:54.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.742+0000 7f2a2b7fe700 1 -- 172.21.2.105:0/3493835294 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a1c00d910 con 0x7f2a2c0ace20 2021-11-12T05:40:54.752 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.742+0000 7f2a330fc700 1 -- 172.21.2.105:0/3493835294 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2a2c0ace20 msgr2=0x7f2a2c0b0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.752 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.742+0000 7f2a330fc700 1 --2- 172.21.2.105:0/3493835294 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2a2c0ace20 0x7f2a2c0b0520 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f2a2c0611e0 tx=0x7f2a1c006df0).stop 2021-11-12T05:40:54.753 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.742+0000 7f2a330fc700 1 -- 172.21.2.105:0/3493835294 shutdown_connections 2021-11-12T05:40:54.753 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.742+0000 7f2a330fc700 1 --2- 172.21.2.105:0/3493835294 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2a2c0ace20 0x7f2a2c0b0520 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:54.753 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.742+0000 7f2a330fc700 1 -- 172.21.2.105:0/3493835294 >> 172.21.2.105:0/3493835294 conn(0x7f2a2c05c490 msgr2=0x7f2a2c0b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:54.753 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.742+0000 7f2a330fc700 1 -- 172.21.2.105:0/3493835294 shutdown_connections 2021-11-12T05:40:54.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.742+0000 7f2a330fc700 1 -- 172.21.2.105:0/3493835294 wait complete. 2021-11-12T05:40:54.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.746+0000 7f2a330fc700 1 Processor -- start 2021-11-12T05:40:54.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.746+0000 7f2a330fc700 1 -- start start 2021-11-12T05:40:54.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.746+0000 7f2a330fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2a2c0aca40 0x7f2a2c0a8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.746+0000 7f2a330fc700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2a2c0ace20 0x7f2a2c156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.746+0000 7f2a330fc700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2a2c144180 0x7f2a2c156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.746+0000 7f2a330fc700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c157100 con 0x7f2a2c0aca40 2021-11-12T05:40:54.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.746+0000 7f2a330fc700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c0a8e10 con 0x7f2a2c144180 2021-11-12T05:40:54.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.746+0000 7f2a330fc700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c1578b0 con 0x7f2a2c0ace20 2021-11-12T05:40:54.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.746+0000 7f2a30e98700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2a2c0aca40 0x7f2a2c0a8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:54.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.746+0000 7f2a30e98700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2a2c0aca40 0x7f2a2c0a8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43702/0 (socket says 172.21.2.105:43702) 2021-11-12T05:40:54.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.746+0000 7f2a30e98700 1 -- 172.21.2.105:0/4143706038 learned_addr learned my addr 172.21.2.105:0/4143706038 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:54.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.746+0000 7f2a30e98700 1 -- 172.21.2.105:0/4143706038 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2a2c0ace20 msgr2=0x7f2a2c156720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.746+0000 7f2a30e98700 1 --2- 172.21.2.105:0/4143706038 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2a2c0ace20 0x7f2a2c156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:54.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.746+0000 7f2a30e98700 1 -- 172.21.2.105:0/4143706038 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2a2c144180 msgr2=0x7f2a2c156c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.746+0000 7f2a30e98700 1 --2- 172.21.2.105:0/4143706038 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2a2c144180 0x7f2a2c156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:54.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.746+0000 7f2a30e98700 1 -- 172.21.2.105:0/4143706038 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a1c00b180 con 0x7f2a2c0aca40 2021-11-12T05:40:54.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.746+0000 7f2a30e98700 1 --2- 172.21.2.105:0/4143706038 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2a2c0aca40 0x7f2a2c0a8540 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f2a2c061140 tx=0x7f2a20007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:54.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.746+0000 7f2a29ffb700 1 -- 172.21.2.105:0/4143706038 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a2000ce30 con 0x7f2a2c0aca40 2021-11-12T05:40:54.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.746+0000 7f2a29ffb700 1 -- 172.21.2.105:0/4143706038 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a200072e0 con 0x7f2a2c0aca40 2021-11-12T05:40:54.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.746+0000 7f2a330fc700 1 -- 172.21.2.105:0/4143706038 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a2c065220 con 0x7f2a2c0aca40 2021-11-12T05:40:54.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.746+0000 7f2a29ffb700 1 -- 172.21.2.105:0/4143706038 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a20005800 con 0x7f2a2c0aca40 2021-11-12T05:40:54.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.746+0000 7f2a330fc700 1 -- 172.21.2.105:0/4143706038 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a2c157580 con 0x7f2a2c0aca40 2021-11-12T05:40:54.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.746+0000 7f2a330fc700 1 -- 172.21.2.105:0/4143706038 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a2c157270 con 0x7f2a2c0aca40 2021-11-12T05:40:54.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.746+0000 7f2a29ffb700 1 -- 172.21.2.105:0/4143706038 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2a20010070 con 0x7f2a2c0aca40 2021-11-12T05:40:54.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.746+0000 7f2a29ffb700 1 --2- 172.21.2.105:0/4143706038 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2a0c053610 0x7f2a0c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.746+0000 7f2a29ffb700 1 -- 172.21.2.105:0/4143706038 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f2a2006b100 con 0x7f2a2c0aca40 2021-11-12T05:40:54.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.746+0000 7f2a2bfff700 1 --2- 172.21.2.105:0/4143706038 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2a0c053610 0x7f2a0c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:54.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.746+0000 7f2a2bfff700 1 --2- 172.21.2.105:0/4143706038 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2a0c053610 0x7f2a0c055ad0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f2a2c0611e0 tx=0x7f2a1c012000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:54.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.750+0000 7f2a29ffb700 1 -- 172.21.2.105:0/4143706038 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2a20042100 con 0x7f2a2c0aca40 2021-11-12T05:40:54.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.834+0000 7f2a330fc700 1 -- 172.21.2.105:0/4143706038 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f2a2c057350 con 0x7f2a2c0aca40 2021-11-12T05:40:54.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.834+0000 7f2a29ffb700 1 -- 172.21.2.105:0/4143706038 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2a20018070 con 0x7f2a2c0aca40 2021-11-12T05:40:54.836 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:40:54.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.834+0000 7f2a330fc700 1 -- 172.21.2.105:0/4143706038 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2a0c053610 msgr2=0x7f2a0c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.834+0000 7f2a330fc700 1 --2- 172.21.2.105:0/4143706038 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2a0c053610 0x7f2a0c055ad0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f2a2c0611e0 tx=0x7f2a1c012000).stop 2021-11-12T05:40:54.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.834+0000 7f2a330fc700 1 -- 172.21.2.105:0/4143706038 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2a2c0aca40 msgr2=0x7f2a2c0a8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.834+0000 7f2a330fc700 1 --2- 172.21.2.105:0/4143706038 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2a2c0aca40 0x7f2a2c0a8540 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f2a2c061140 tx=0x7f2a20007c40).stop 2021-11-12T05:40:54.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.834+0000 7f2a330fc700 1 -- 172.21.2.105:0/4143706038 shutdown_connections 2021-11-12T05:40:54.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.834+0000 7f2a330fc700 1 --2- 172.21.2.105:0/4143706038 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2a0c053610 0x7f2a0c055ad0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:54.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.834+0000 7f2a330fc700 1 --2- 172.21.2.105:0/4143706038 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2a2c144180 0x7f2a2c156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:54.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.834+0000 7f2a330fc700 1 --2- 172.21.2.105:0/4143706038 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2a2c0ace20 0x7f2a2c156720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:54.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.834+0000 7f2a330fc700 1 --2- 172.21.2.105:0/4143706038 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2a2c0aca40 0x7f2a2c0a8540 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:54.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.834+0000 7f2a330fc700 1 -- 172.21.2.105:0/4143706038 >> 172.21.2.105:0/4143706038 conn(0x7f2a2c05c490 msgr2=0x7f2a2c143830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:54.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.834+0000 7f2a330fc700 1 -- 172.21.2.105:0/4143706038 shutdown_connections 2021-11-12T05:40:54.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.834+0000 7f2a330fc700 1 -- 172.21.2.105:0/4143706038 wait complete. 2021-11-12T05:40:54.843 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:40:54.897 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.894+0000 7fb1b0f94700 1 Processor -- start 2021-11-12T05:40:54.898 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.894+0000 7fb1b0f94700 1 -- start start 2021-11-12T05:40:54.898 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.894+0000 7fb1b0f94700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb1ac0ae090 0x7fb1ac140d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.894+0000 7fb1b0f94700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fb1ac0b3980 0x7fb1ac0b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.894+0000 7fb1b0f94700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac0b7ee0 con 0x7fb1ac0b7b00 2021-11-12T05:40:54.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.894+0000 7fb1b0f94700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1ac0b2030 con 0x7fb1ac0b3980 2021-11-12T05:40:54.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.894+0000 7fb1b0f94700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac0b22d0 con 0x7fb1ac0ae090 2021-11-12T05:40:54.904 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.898+0000 7fb1aad9d700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fb1ac0b3980 0x7fb1ac0b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:54.904 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.898+0000 7fb1aa59c700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7fb1ac0b7b00 0x7fb1ac0b2a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:52574/0 (socket says 172.21.2.105:52574) 2021-11-12T05:40:54.904 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.898+0000 7fb1aa59c700 1 -- 172.21.2.105:0/2410644321 learned_addr learned my addr 172.21.2.105:0/2410644321 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:54.905 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.898+0000 7fb1a9d9b700 1 --2- 172.21.2.105:0/2410644321 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb1ac0ae090 0x7fb1ac140d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:54.905 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.898+0000 7fb1aad9d700 1 -- 172.21.2.105:0/2410644321 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb1ac0ae090 msgr2=0x7fb1ac140d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:54.905 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.898+0000 7fb1aad9d700 1 --2- 172.21.2.105:0/2410644321 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb1ac0ae090 0x7fb1ac140d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:54.906 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.898+0000 7fb1aad9d700 1 -- 172.21.2.105:0/2410644321 >> v1:172.21.2.115:6789/0 conn(0x7fb1ac0b7b00 legacy=0x7fb1ac0b2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.907 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.898+0000 7fb1aad9d700 1 -- 172.21.2.105:0/2410644321 --> v2:172.21.2.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ac0b2570 con 0x7fb1ac0b3980 2021-11-12T05:40:54.907 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.898+0000 7fb1aad9d700 1 --2- 172.21.2.105:0/2410644321 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb1ac0b3980 0x7fb1ac0b3e10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fb1a40032f0 tx=0x7fb1a40091d0).ready entity=mon.1 client_cookie=165b61f7b98c9246 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:54.907 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.898+0000 7fb1a959a700 1 -- 172.21.2.105:0/2410644321 <== mon.1 v2:172.21.2.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1a400b6c0 con 0x7fb1ac0b3980 2021-11-12T05:40:54.907 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.898+0000 7fb1a959a700 1 -- 172.21.2.105:0/2410644321 <== mon.1 v2:172.21.2.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a400b820 con 0x7fb1ac0b3980 2021-11-12T05:40:54.907 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.898+0000 7fb1a959a700 1 -- 172.21.2.105:0/2410644321 <== mon.1 v2:172.21.2.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1a400b990 con 0x7fb1ac0b3980 2021-11-12T05:40:54.908 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.898+0000 7fb1b0f94700 1 -- 172.21.2.105:0/2410644321 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb1ac0b3980 msgr2=0x7fb1ac0b3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.908 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.898+0000 7fb1b0f94700 1 --2- 172.21.2.105:0/2410644321 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb1ac0b3980 0x7fb1ac0b3e10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fb1a40032f0 tx=0x7fb1a40091d0).stop 2021-11-12T05:40:54.908 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.898+0000 7fb1b0f94700 1 -- 172.21.2.105:0/2410644321 shutdown_connections 2021-11-12T05:40:54.908 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.898+0000 7fb1b0f94700 1 --2- 172.21.2.105:0/2410644321 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb1ac0b3980 0x7fb1ac0b3e10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:54.909 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.898+0000 7fb1b0f94700 1 --2- 172.21.2.105:0/2410644321 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb1ac0ae090 0x7fb1ac140d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:54.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.898+0000 7fb1b0f94700 1 -- 172.21.2.105:0/2410644321 >> 172.21.2.105:0/2410644321 conn(0x7fb1ac0608d0 msgr2=0x7fb1ac05c490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:54.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.898+0000 7fb1b0f94700 1 -- 172.21.2.105:0/2410644321 shutdown_connections 2021-11-12T05:40:54.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.898+0000 7fb1b0f94700 1 -- 172.21.2.105:0/2410644321 wait complete. 2021-11-12T05:40:54.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.898+0000 7fb1b0f94700 1 Processor -- start 2021-11-12T05:40:54.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.898+0000 7fb1b0f94700 1 -- start start 2021-11-12T05:40:54.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.898+0000 7fb1b0f94700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb1ac0ae090 0x7fb1ac142660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.898+0000 7fb1b0f94700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb1ac0b3980 0x7fb1ac0b6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.898+0000 7fb1b0f94700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb1ac0b7b00 0x7fb1ac129df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.912 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.898+0000 7fb1b0f94700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac0673f0 con 0x7fb1ac0b7b00 2021-11-12T05:40:54.912 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.898+0000 7fb1b0f94700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac066850 con 0x7fb1ac0b3980 2021-11-12T05:40:54.912 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.898+0000 7fb1b0f94700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac067620 con 0x7fb1ac0ae090 2021-11-12T05:40:54.912 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.898+0000 7fb1aad9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb1ac0b7b00 0x7fb1ac129df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:54.913 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.898+0000 7fb1aad9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb1ac0b7b00 0x7fb1ac129df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43720/0 (socket says 172.21.2.105:43720) 2021-11-12T05:40:54.913 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.898+0000 7fb1aad9d700 1 -- 172.21.2.105:0/667392576 learned_addr learned my addr 172.21.2.105:0/667392576 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:54.913 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.898+0000 7fb1aad9d700 1 -- 172.21.2.105:0/667392576 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb1ac0ae090 msgr2=0x7fb1ac142660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.913 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.898+0000 7fb1a9d9b700 1 --2- 172.21.2.105:0/667392576 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb1ac0b3980 0x7fb1ac0b6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:54.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.898+0000 7fb1aad9d700 1 --2- 172.21.2.105:0/667392576 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb1ac0ae090 0x7fb1ac142660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:54.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.898+0000 7fb1aad9d700 1 -- 172.21.2.105:0/667392576 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb1ac0b3980 msgr2=0x7fb1ac0b6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.898+0000 7fb1aad9d700 1 --2- 172.21.2.105:0/667392576 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb1ac0b3980 0x7fb1ac0b6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:54.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.898+0000 7fb1aad9d700 1 -- 172.21.2.105:0/667392576 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a4009470 con 0x7fb1ac0b7b00 2021-11-12T05:40:54.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.898+0000 7fb1aad9d700 1 --2- 172.21.2.105:0/667392576 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb1ac0b7b00 0x7fb1ac129df0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fb1a40032f0 tx=0x7fb1a4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:54.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.902+0000 7fb1a37fe700 1 -- 172.21.2.105:0/667392576 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1a400b6c0 con 0x7fb1ac0b7b00 2021-11-12T05:40:54.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.902+0000 7fb1b0f94700 1 -- 172.21.2.105:0/667392576 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1ac142b50 con 0x7fb1ac0b7b00 2021-11-12T05:40:54.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.902+0000 7fb1a37fe700 1 -- 172.21.2.105:0/667392576 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a4011e50 con 0x7fb1ac0b7b00 2021-11-12T05:40:54.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.902+0000 7fb1a37fe700 1 -- 172.21.2.105:0/667392576 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1a40107a0 con 0x7fb1ac0b7b00 2021-11-12T05:40:54.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.902+0000 7fb1b0f94700 1 -- 172.21.2.105:0/667392576 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1ac065780 con 0x7fb1ac0b7b00 2021-11-12T05:40:54.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.902+0000 7fb1b0f94700 1 -- 172.21.2.105:0/667392576 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1ac057350 con 0x7fb1ac0b7b00 2021-11-12T05:40:54.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.902+0000 7fb1a37fe700 1 -- 172.21.2.105:0/667392576 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb1a400f070 con 0x7fb1ac0b7b00 2021-11-12T05:40:54.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.902+0000 7fb1a37fe700 1 --2- 172.21.2.105:0/667392576 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb190053610 0x7fb190055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:54.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.902+0000 7fb1a37fe700 1 -- 172.21.2.105:0/667392576 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fb1a406c880 con 0x7fb1ac0b7b00 2021-11-12T05:40:54.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.902+0000 7fb1aa59c700 1 --2- 172.21.2.105:0/667392576 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb190053610 0x7fb190055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:54.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.902+0000 7fb1aa59c700 1 --2- 172.21.2.105:0/667392576 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb190053610 0x7fb190055ad0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fb1ac065530 tx=0x7fb194007860).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:54.918 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.902+0000 7fb1a37fe700 1 -- 172.21.2.105:0/667392576 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb1a4043780 con 0x7fb1ac0b7b00 2021-11-12T05:40:54.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.986+0000 7fb1b0f94700 1 -- 172.21.2.105:0/667392576 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb1ac141ae0 con 0x7fb1ac0b7b00 2021-11-12T05:40:54.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.986+0000 7fb1a37fe700 1 -- 172.21.2.105:0/667392576 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb1a4015020 con 0x7fb1ac0b7b00 2021-11-12T05:40:54.991 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:40:54.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.990+0000 7fb1b0f94700 1 -- 172.21.2.105:0/667392576 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb190053610 msgr2=0x7fb190055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.990+0000 7fb1b0f94700 1 --2- 172.21.2.105:0/667392576 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb190053610 0x7fb190055ad0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fb1ac065530 tx=0x7fb194007860).stop 2021-11-12T05:40:54.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.990+0000 7fb1b0f94700 1 -- 172.21.2.105:0/667392576 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb1ac0b7b00 msgr2=0x7fb1ac129df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:54.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.990+0000 7fb1b0f94700 1 --2- 172.21.2.105:0/667392576 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb1ac0b7b00 0x7fb1ac129df0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fb1a40032f0 tx=0x7fb1a4016000).stop 2021-11-12T05:40:54.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.990+0000 7fb1b0f94700 1 -- 172.21.2.105:0/667392576 shutdown_connections 2021-11-12T05:40:54.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.990+0000 7fb1b0f94700 1 --2- 172.21.2.105:0/667392576 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb190053610 0x7fb190055ad0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:54.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.990+0000 7fb1b0f94700 1 --2- 172.21.2.105:0/667392576 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb1ac0b7b00 0x7fb1ac129df0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:54.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.990+0000 7fb1b0f94700 1 --2- 172.21.2.105:0/667392576 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb1ac0b3980 0x7fb1ac0b6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:54.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.990+0000 7fb1b0f94700 1 --2- 172.21.2.105:0/667392576 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb1ac0ae090 0x7fb1ac142660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:54.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.990+0000 7fb1b0f94700 1 -- 172.21.2.105:0/667392576 >> 172.21.2.105:0/667392576 conn(0x7fb1ac0608d0 msgr2=0x7fb1ac05fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:54.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.990+0000 7fb1b0f94700 1 -- 172.21.2.105:0/667392576 shutdown_connections 2021-11-12T05:40:54.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:54.990+0000 7fb1b0f94700 1 -- 172.21.2.105:0/667392576 wait complete. 2021-11-12T05:40:54.998 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-12T05:40:55.052 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.046+0000 7fb2e19b0700 1 Processor -- start 2021-11-12T05:40:55.052 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.046+0000 7fb2e19b0700 1 -- start start 2021-11-12T05:40:55.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.046+0000 7fb2e19b0700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb2dc0b37d0 0x7fb2dc141500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.046+0000 7fb2e19b0700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fb2dc1419f0 0x7fb2dc0b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.046+0000 7fb2e19b0700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2dc0b26e0 con 0x7fb2dc060100 2021-11-12T05:40:55.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.046+0000 7fb2e19b0700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2dc0604e0 con 0x7fb2dc0b37d0 2021-11-12T05:40:55.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.046+0000 7fb2e19b0700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2dc145160 con 0x7fb2dc1419f0 2021-11-12T05:40:55.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2da7fc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb2dc0b37d0 0x7fb2dc141500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:55.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2daffd700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fb2dc060100 0x7fb2dc0b1fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:54122/0 (socket says 172.21.2.105:54122) 2021-11-12T05:40:55.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2daffd700 1 -- 172.21.2.105:0/1385179365 learned_addr learned my addr 172.21.2.105:0/1385179365 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:55.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2db7fe700 1 --2- 172.21.2.105:0/1385179365 >> v2:172.21.2.115:3300/0 conn(0x7fb2dc1419f0 0x7fb2dc0b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:55.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2da7fc700 1 -- 172.21.2.105:0/1385179365 >> v2:172.21.2.115:3300/0 conn(0x7fb2dc1419f0 msgr2=0x7fb2dc0b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:55.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2da7fc700 1 --2- 172.21.2.105:0/1385179365 >> v2:172.21.2.115:3300/0 conn(0x7fb2dc1419f0 0x7fb2dc0b3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:55.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2da7fc700 1 -- 172.21.2.105:0/1385179365 >> v1:172.21.2.105:6789/0 conn(0x7fb2dc060100 legacy=0x7fb2dc0b1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:55.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2da7fc700 1 -- 172.21.2.105:0/1385179365 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2dc141060 con 0x7fb2dc0b37d0 2021-11-12T05:40:55.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2da7fc700 1 --2- 172.21.2.105:0/1385179365 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb2dc0b37d0 0x7fb2dc141500 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fb2dc065610 tx=0x7fb2c4006df0).ready entity=mon.0 client_cookie=ac56323d6ca2bc3e server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:55.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2d9ffb700 1 -- 172.21.2.105:0/1385179365 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2c400d5c0 con 0x7fb2dc0b37d0 2021-11-12T05:40:55.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2d9ffb700 1 -- 172.21.2.105:0/1385179365 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c4000e90 con 0x7fb2dc0b37d0 2021-11-12T05:40:55.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2d9ffb700 1 -- 172.21.2.105:0/1385179365 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2c400d910 con 0x7fb2dc0b37d0 2021-11-12T05:40:55.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2e19b0700 1 -- 172.21.2.105:0/1385179365 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb2dc0b37d0 msgr2=0x7fb2dc141500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:55.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2e19b0700 1 --2- 172.21.2.105:0/1385179365 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb2dc0b37d0 0x7fb2dc141500 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fb2dc065610 tx=0x7fb2c4006df0).stop 2021-11-12T05:40:55.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2e19b0700 1 -- 172.21.2.105:0/1385179365 shutdown_connections 2021-11-12T05:40:55.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2e19b0700 1 --2- 172.21.2.105:0/1385179365 >> v2:172.21.2.115:3300/0 conn(0x7fb2dc1419f0 0x7fb2dc0b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:55.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2e19b0700 1 --2- 172.21.2.105:0/1385179365 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb2dc0b37d0 0x7fb2dc141500 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:55.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2e19b0700 1 -- 172.21.2.105:0/1385179365 >> 172.21.2.105:0/1385179365 conn(0x7fb2dc0608d0 msgr2=0x7fb2dc05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:55.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2e19b0700 1 -- 172.21.2.105:0/1385179365 shutdown_connections 2021-11-12T05:40:55.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2e19b0700 1 -- 172.21.2.105:0/1385179365 wait complete. 2021-11-12T05:40:55.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2e19b0700 1 Processor -- start 2021-11-12T05:40:55.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2e19b0700 1 -- start start 2021-11-12T05:40:55.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2e19b0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb2dc060100 0x7fb2dc0b6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2e19b0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb2dc1419f0 0x7fb2dc0b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2e19b0700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb2dc159e60 0x7fb2dc15a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2e19b0700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2dc0628a0 con 0x7fb2dc060100 2021-11-12T05:40:55.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2e19b0700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2dc062b40 con 0x7fb2dc159e60 2021-11-12T05:40:55.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2e19b0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2dc062de0 con 0x7fb2dc1419f0 2021-11-12T05:40:55.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2daffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb2dc060100 0x7fb2dc0b6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:55.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2daffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb2dc060100 0x7fb2dc0b6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43730/0 (socket says 172.21.2.105:43730) 2021-11-12T05:40:55.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2daffd700 1 -- 172.21.2.105:0/213673070 learned_addr learned my addr 172.21.2.105:0/213673070 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:55.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2daffd700 1 -- 172.21.2.105:0/213673070 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb2dc1419f0 msgr2=0x7fb2dc0b08f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:40:55.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2daffd700 1 --2- 172.21.2.105:0/213673070 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb2dc1419f0 0x7fb2dc0b08f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:55.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2daffd700 1 -- 172.21.2.105:0/213673070 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb2dc159e60 msgr2=0x7fb2dc15a2f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:40:55.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2daffd700 1 --2- 172.21.2.105:0/213673070 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb2dc159e60 0x7fb2dc15a2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:55.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2daffd700 1 -- 172.21.2.105:0/213673070 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c400b180 con 0x7fb2dc060100 2021-11-12T05:40:55.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2daffd700 1 --2- 172.21.2.105:0/213673070 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb2dc060100 0x7fb2dc0b6440 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7fb2dc0ad790 tx=0x7fb2cc007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:55.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2d3fff700 1 -- 172.21.2.105:0/213673070 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2cc00ce30 con 0x7fb2dc060100 2021-11-12T05:40:55.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2d3fff700 1 -- 172.21.2.105:0/213673070 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2cc0072e0 con 0x7fb2dc060100 2021-11-12T05:40:55.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2e19b0700 1 -- 172.21.2.105:0/213673070 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2dc157a30 con 0x7fb2dc060100 2021-11-12T05:40:55.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2e19b0700 1 -- 172.21.2.105:0/213673070 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2dc0b0de0 con 0x7fb2dc060100 2021-11-12T05:40:55.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2d3fff700 1 -- 172.21.2.105:0/213673070 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2cc005800 con 0x7fb2dc060100 2021-11-12T05:40:55.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.050+0000 7fb2e19b0700 1 -- 172.21.2.105:0/213673070 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2dc062fa0 con 0x7fb2dc060100 2021-11-12T05:40:55.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.054+0000 7fb2d3fff700 1 -- 172.21.2.105:0/213673070 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb2cc010070 con 0x7fb2dc060100 2021-11-12T05:40:55.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.054+0000 7fb2d3fff700 1 --2- 172.21.2.105:0/213673070 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb2c0053610 0x7fb2c0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.054+0000 7fb2d3fff700 1 -- 172.21.2.105:0/213673070 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fb2cc06b100 con 0x7fb2dc060100 2021-11-12T05:40:55.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.054+0000 7fb2da7fc700 1 --2- 172.21.2.105:0/213673070 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb2c0053610 0x7fb2c0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:55.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.054+0000 7fb2da7fc700 1 --2- 172.21.2.105:0/213673070 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb2c0053610 0x7fb2c0055ad0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fb2dc065610 tx=0x7fb2c4012000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:55.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.054+0000 7fb2d3fff700 1 -- 172.21.2.105:0/213673070 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb2cc042100 con 0x7fb2dc060100 2021-11-12T05:40:55.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.138+0000 7fb2e19b0700 1 -- 172.21.2.105:0/213673070 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb2dc141e80 con 0x7fb2dc060100 2021-11-12T05:40:55.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.138+0000 7fb2d3fff700 1 -- 172.21.2.105:0/213673070 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7fb2cc045720 con 0x7fb2dc060100 2021-11-12T05:40:55.142 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:40:55.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.138+0000 7fb2e19b0700 1 -- 172.21.2.105:0/213673070 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb2c0053610 msgr2=0x7fb2c0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:55.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.138+0000 7fb2e19b0700 1 --2- 172.21.2.105:0/213673070 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb2c0053610 0x7fb2c0055ad0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fb2dc065610 tx=0x7fb2c4012000).stop 2021-11-12T05:40:55.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.138+0000 7fb2e19b0700 1 -- 172.21.2.105:0/213673070 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb2dc060100 msgr2=0x7fb2dc0b6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:55.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.138+0000 7fb2e19b0700 1 --2- 172.21.2.105:0/213673070 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb2dc060100 0x7fb2dc0b6440 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7fb2dc0ad790 tx=0x7fb2cc007c40).stop 2021-11-12T05:40:55.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.138+0000 7fb2e19b0700 1 -- 172.21.2.105:0/213673070 shutdown_connections 2021-11-12T05:40:55.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.138+0000 7fb2e19b0700 1 --2- 172.21.2.105:0/213673070 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb2c0053610 0x7fb2c0055ad0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:55.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.138+0000 7fb2e19b0700 1 --2- 172.21.2.105:0/213673070 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb2dc159e60 0x7fb2dc15a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:55.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.138+0000 7fb2e19b0700 1 --2- 172.21.2.105:0/213673070 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb2dc1419f0 0x7fb2dc0b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:55.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.138+0000 7fb2e19b0700 1 --2- 172.21.2.105:0/213673070 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb2dc060100 0x7fb2dc0b6440 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:55.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.138+0000 7fb2e19b0700 1 -- 172.21.2.105:0/213673070 >> 172.21.2.105:0/213673070 conn(0x7fb2dc0608d0 msgr2=0x7fb2dc0b5380 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:55.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.138+0000 7fb2e19b0700 1 -- 172.21.2.105:0/213673070 shutdown_connections 2021-11-12T05:40:55.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.138+0000 7fb2e19b0700 1 -- 172.21.2.105:0/213673070 wait complete. 2021-11-12T05:40:55.149 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-12T05:40:55.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.198+0000 7f97db0f6700 1 Processor -- start 2021-11-12T05:40:55.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.198+0000 7f97db0f6700 1 -- start start 2021-11-12T05:40:55.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.198+0000 7f97db0f6700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f97d40ace20 0x7f97d40b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.198+0000 7f97db0f6700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d40b1840 con 0x7f97d40aca40 2021-11-12T05:40:55.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.198+0000 7f97db0f6700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d40af2b0 con 0x7f97d4144180 2021-11-12T05:40:55.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.198+0000 7f97db0f6700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97d40b0a10 con 0x7f97d40ace20 2021-11-12T05:40:55.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.198+0000 7f97d8e92700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f97d40aca40 0x7f97d41473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:54134/0 (socket says 172.21.2.105:54134) 2021-11-12T05:40:55.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.198+0000 7f97d8e92700 1 -- 172.21.2.105:0/271607341 learned_addr learned my addr 172.21.2.105:0/271607341 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:55.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.198+0000 7f97d37fe700 1 -- 172.21.2.105:0/271607341 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2661928228 0 0) 0x7f97d40b1840 con 0x7f97d40aca40 2021-11-12T05:40:55.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.198+0000 7f97d37fe700 1 -- 172.21.2.105:0/271607341 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97b4003260 con 0x7f97d40aca40 2021-11-12T05:40:55.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.198+0000 7f97d37fe700 1 -- 172.21.2.105:0/271607341 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 511028789 0 0) 0x7f97b4003260 con 0x7f97d40aca40 2021-11-12T05:40:55.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.198+0000 7f97d37fe700 1 -- 172.21.2.105:0/271607341 >> v2:172.21.2.115:3300/0 conn(0x7f97d40ace20 msgr2=0x7f97d40b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:55.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.198+0000 7f97d37fe700 1 --2- 172.21.2.105:0/271607341 >> v2:172.21.2.115:3300/0 conn(0x7f97d40ace20 0x7f97d40b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:55.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.198+0000 7f97d37fe700 1 -- 172.21.2.105:0/271607341 >> v1:172.21.2.115:6789/0 conn(0x7f97d4144180 legacy=0x7f97d41445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:55.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.198+0000 7f97d37fe700 1 -- 172.21.2.105:0/271607341 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d40b1a70 con 0x7f97d40aca40 2021-11-12T05:40:55.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.198+0000 7f97d37fe700 1 -- 172.21.2.105:0/271607341 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f97bc001660 con 0x7f97d40aca40 2021-11-12T05:40:55.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.198+0000 7f97d37fe700 1 -- 172.21.2.105:0/271607341 >> v1:172.21.2.105:6789/0 conn(0x7f97d40aca40 legacy=0x7f97d41473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:55.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.198+0000 7f97d37fe700 1 --2- 172.21.2.105:0/271607341 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f97b4003820 0x7f97b4003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.198+0000 7f97d37fe700 1 --2- 172.21.2.105:0/271607341 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f97b4004500 0x7f97b4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.198+0000 7f97d37fe700 1 --2- 172.21.2.105:0/271607341 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f97b4005050 0x7f97b400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.198+0000 7f97d37fe700 1 -- 172.21.2.105:0/271607341 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d40b0a10 con 0x7f97b4003820 2021-11-12T05:40:55.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.198+0000 7f97d37fe700 1 -- 172.21.2.105:0/271607341 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b400bf40 con 0x7f97b4005050 2021-11-12T05:40:55.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.198+0000 7f97d37fe700 1 -- 172.21.2.105:0/271607341 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b400c100 con 0x7f97b4004500 2021-11-12T05:40:55.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97d8e92700 1 --2- 172.21.2.105:0/271607341 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f97b4003820 0x7f97b4003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:55.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97d8e92700 1 -- 172.21.2.105:0/271607341 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f97b4004500 msgr2=0x7f97b4004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:55.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97d8e92700 1 --2- 172.21.2.105:0/271607341 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f97b4004500 0x7f97b4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:55.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97d8e92700 1 -- 172.21.2.105:0/271607341 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f97b4005050 msgr2=0x7f97b400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:55.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97d8e92700 1 --2- 172.21.2.105:0/271607341 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f97b4005050 0x7f97b400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:55.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97d8e92700 1 -- 172.21.2.105:0/271607341 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b4003260 con 0x7f97b4003820 2021-11-12T05:40:55.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97d9693700 1 -- 172.21.2.105:0/271607341 reap_dead start 2021-11-12T05:40:55.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97d8e92700 1 --2- 172.21.2.105:0/271607341 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f97b4003820 0x7f97b4003c20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f97d40611e0 tx=0x7f97d40ad870).ready entity=mon.0 client_cookie=f71486e56cfa3e6b server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:55.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97d37fe700 1 -- 172.21.2.105:0/271607341 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97bc0070d0 con 0x7f97b4003820 2021-11-12T05:40:55.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97d37fe700 1 -- 172.21.2.105:0/271607341 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97bc007230 con 0x7f97b4003820 2021-11-12T05:40:55.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97d37fe700 1 -- 172.21.2.105:0/271607341 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97bc00c8f0 con 0x7f97b4003820 2021-11-12T05:40:55.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97db0f6700 1 -- 172.21.2.105:0/271607341 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f97b4003820 msgr2=0x7f97b4003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:55.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97db0f6700 1 --2- 172.21.2.105:0/271607341 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f97b4003820 0x7f97b4003c20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f97d40611e0 tx=0x7f97d40ad870).stop 2021-11-12T05:40:55.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97db0f6700 1 -- 172.21.2.105:0/271607341 shutdown_connections 2021-11-12T05:40:55.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97db0f6700 1 --2- 172.21.2.105:0/271607341 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f97b4003820 0x7f97b4003c20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:55.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97db0f6700 1 -- 172.21.2.105:0/271607341 >> 172.21.2.105:0/271607341 conn(0x7f97d405c490 msgr2=0x7f97d40b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:55.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97db0f6700 1 -- 172.21.2.105:0/271607341 shutdown_connections 2021-11-12T05:40:55.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97db0f6700 1 -- 172.21.2.105:0/271607341 wait complete. 2021-11-12T05:40:55.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97db0f6700 1 Processor -- start 2021-11-12T05:40:55.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97db0f6700 1 -- start start 2021-11-12T05:40:55.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97db0f6700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f97b4003820 0x7f97d40a7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97db0f6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f97d40a7510 0x7f97d40a8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97db0f6700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f97d414e080 0x7f97d40a9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97db0f6700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d414e5f0 con 0x7f97d40a7510 2021-11-12T05:40:55.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97db0f6700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d414d540 con 0x7f97d414e080 2021-11-12T05:40:55.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97db0f6700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d414d7e0 con 0x7f97b4003820 2021-11-12T05:40:55.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97d3fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f97d40a7510 0x7f97d40a8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:55.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97d3fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f97d40a7510 0x7f97d40a8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43752/0 (socket says 172.21.2.105:43752) 2021-11-12T05:40:55.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97d3fff700 1 -- 172.21.2.105:0/3449703474 learned_addr learned my addr 172.21.2.105:0/3449703474 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:55.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97d3fff700 1 -- 172.21.2.105:0/3449703474 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f97b4003820 msgr2=0x7f97d40a7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:55.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97d3fff700 1 --2- 172.21.2.105:0/3449703474 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f97b4003820 0x7f97d40a7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:55.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97d3fff700 1 -- 172.21.2.105:0/3449703474 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f97d414e080 msgr2=0x7f97d40a9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:55.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97d3fff700 1 --2- 172.21.2.105:0/3449703474 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f97d414e080 0x7f97d40a9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:55.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97d3fff700 1 -- 172.21.2.105:0/3449703474 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d414e820 con 0x7f97d40a7510 2021-11-12T05:40:55.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97d3fff700 1 --2- 172.21.2.105:0/3449703474 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f97d40a7510 0x7f97d40a8e80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f97c4002f70 tx=0x7f97c4006de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:55.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97d1ffb700 1 -- 172.21.2.105:0/3449703474 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97c4009e80 con 0x7f97d40a7510 2021-11-12T05:40:55.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97d1ffb700 1 -- 172.21.2.105:0/3449703474 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c4013460 con 0x7f97d40a7510 2021-11-12T05:40:55.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97db0f6700 1 -- 172.21.2.105:0/3449703474 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97d40a9860 con 0x7f97d40a7510 2021-11-12T05:40:55.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97db0f6700 1 -- 172.21.2.105:0/3449703474 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97d415a190 con 0x7f97d40a7510 2021-11-12T05:40:55.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97d1ffb700 1 -- 172.21.2.105:0/3449703474 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97c40137c0 con 0x7f97d40a7510 2021-11-12T05:40:55.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97db0f6700 1 -- 172.21.2.105:0/3449703474 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97ac003410 con 0x7f97d40a7510 2021-11-12T05:40:55.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.202+0000 7f97d1ffb700 1 -- 172.21.2.105:0/3449703474 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f97c401a060 con 0x7f97d40a7510 2021-11-12T05:40:55.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.206+0000 7f97d1ffb700 1 --2- 172.21.2.105:0/3449703474 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f97b8053720 0x7f97b8055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.206+0000 7f97d1ffb700 1 -- 172.21.2.105:0/3449703474 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f97c406b400 con 0x7f97d40a7510 2021-11-12T05:40:55.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.206+0000 7f97d8e92700 1 --2- 172.21.2.105:0/3449703474 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f97b8053720 0x7f97b8055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:55.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.206+0000 7f97d8e92700 1 --2- 172.21.2.105:0/3449703474 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f97b8053720 0x7f97b8055be0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f97d40611e0 tx=0x7f97bc015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:55.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.206+0000 7f97d1ffb700 1 -- 172.21.2.105:0/3449703474 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f97c4042400 con 0x7f97d40a7510 2021-11-12T05:40:55.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.290+0000 7f97db0f6700 1 -- 172.21.2.105:0/3449703474 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f97ac003c40 con 0x7f97d40a7510 2021-11-12T05:40:55.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.290+0000 7f97d1ffb700 1 -- 172.21.2.105:0/3449703474 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7f97c4018020 con 0x7f97d40a7510 2021-11-12T05:40:55.292 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:40:55.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.290+0000 7f97db0f6700 1 -- 172.21.2.105:0/3449703474 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f97b8053720 msgr2=0x7f97b8055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:55.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.290+0000 7f97db0f6700 1 --2- 172.21.2.105:0/3449703474 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f97b8053720 0x7f97b8055be0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f97d40611e0 tx=0x7f97bc015000).stop 2021-11-12T05:40:55.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.290+0000 7f97db0f6700 1 -- 172.21.2.105:0/3449703474 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f97d40a7510 msgr2=0x7f97d40a8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:55.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.290+0000 7f97db0f6700 1 --2- 172.21.2.105:0/3449703474 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f97d40a7510 0x7f97d40a8e80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f97c4002f70 tx=0x7f97c4006de0).stop 2021-11-12T05:40:55.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.290+0000 7f97db0f6700 1 -- 172.21.2.105:0/3449703474 shutdown_connections 2021-11-12T05:40:55.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.290+0000 7f97db0f6700 1 --2- 172.21.2.105:0/3449703474 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f97b8053720 0x7f97b8055be0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:55.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.290+0000 7f97db0f6700 1 --2- 172.21.2.105:0/3449703474 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f97d414e080 0x7f97d40a9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:55.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.290+0000 7f97db0f6700 1 --2- 172.21.2.105:0/3449703474 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f97d40a7510 0x7f97d40a8e80 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:55.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.290+0000 7f97db0f6700 1 --2- 172.21.2.105:0/3449703474 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f97b4003820 0x7f97d40a7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:55.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.290+0000 7f97db0f6700 1 -- 172.21.2.105:0/3449703474 >> 172.21.2.105:0/3449703474 conn(0x7f97d405c490 msgr2=0x7f97d40608a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:55.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.290+0000 7f97db0f6700 1 -- 172.21.2.105:0/3449703474 shutdown_connections 2021-11-12T05:40:55.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.290+0000 7f97db0f6700 1 -- 172.21.2.105:0/3449703474 wait complete. 2021-11-12T05:40:55.299 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:40:55.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.346+0000 7ff3bd851700 1 Processor -- start 2021-11-12T05:40:55.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.346+0000 7ff3bd851700 1 -- start start 2021-11-12T05:40:55.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.346+0000 7ff3bd851700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff3b8143b40 0x7ff3b8143f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.346+0000 7ff3bd851700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff3b80aded0 0x7ff3b80ae300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.346+0000 7ff3bd851700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b8067860 con 0x7ff3b80adaf0 2021-11-12T05:40:55.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.346+0000 7ff3bd851700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3b81404a0 con 0x7ff3b80aded0 2021-11-12T05:40:55.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.346+0000 7ff3bd851700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b8143400 con 0x7ff3b8143b40 2021-11-12T05:40:55.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3b77fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff3b80aded0 0x7ff3b80ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:55.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3b77fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff3b80aded0 0x7ff3b80ae300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43760/0 (socket says 172.21.2.105:43760) 2021-11-12T05:40:55.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3b77fe700 1 -- 172.21.2.105:0/1077387422 learned_addr learned my addr 172.21.2.105:0/1077387422 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:55.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3b77fe700 1 -- 172.21.2.105:0/1077387422 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff3b8143b40 msgr2=0x7ff3b8143f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:55.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3b77fe700 1 --2- 172.21.2.105:0/1077387422 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff3b8143b40 0x7ff3b8143f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:55.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3b77fe700 1 -- 172.21.2.105:0/1077387422 >> v1:172.21.2.115:6789/0 conn(0x7ff3b80adaf0 legacy=0x7ff3b813fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:55.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3b77fe700 1 -- 172.21.2.105:0/1077387422 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b81436a0 con 0x7ff3b80aded0 2021-11-12T05:40:55.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3b77fe700 1 --2- 172.21.2.105:0/1077387422 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3b80aded0 0x7ff3b80ae300 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7ff3b80b63f0 tx=0x7ff3b0006f40).ready entity=mon.0 client_cookie=2a0eea11ca174bff server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:55.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3b5ffb700 1 -- 172.21.2.105:0/1077387422 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3b000dc30 con 0x7ff3b80aded0 2021-11-12T05:40:55.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3b5ffb700 1 -- 172.21.2.105:0/1077387422 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b0000e90 con 0x7ff3b80aded0 2021-11-12T05:40:55.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3b5ffb700 1 -- 172.21.2.105:0/1077387422 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3b000be90 con 0x7ff3b80aded0 2021-11-12T05:40:55.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3bd851700 1 -- 172.21.2.105:0/1077387422 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3b80aded0 msgr2=0x7ff3b80ae300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:55.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3bd851700 1 --2- 172.21.2.105:0/1077387422 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3b80aded0 0x7ff3b80ae300 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7ff3b80b63f0 tx=0x7ff3b0006f40).stop 2021-11-12T05:40:55.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3bd851700 1 -- 172.21.2.105:0/1077387422 shutdown_connections 2021-11-12T05:40:55.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3bd851700 1 --2- 172.21.2.105:0/1077387422 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3b80aded0 0x7ff3b80ae300 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:55.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3bd851700 1 --2- 172.21.2.105:0/1077387422 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff3b8143b40 0x7ff3b8143f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:55.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3bd851700 1 -- 172.21.2.105:0/1077387422 >> 172.21.2.105:0/1077387422 conn(0x7ff3b805c490 msgr2=0x7ff3b805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:55.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3bd851700 1 -- 172.21.2.105:0/1077387422 shutdown_connections 2021-11-12T05:40:55.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3bd851700 1 -- 172.21.2.105:0/1077387422 wait complete. 2021-11-12T05:40:55.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3bd851700 1 Processor -- start 2021-11-12T05:40:55.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3bd851700 1 -- start start 2021-11-12T05:40:55.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3bd851700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff3b80adaf0 0x7ff3b80654c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3bd851700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff3b80aded0 0x7ff3b809e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3bd851700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3b8143b40 0x7ff3b8066b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3bd851700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b8063640 con 0x7ff3b8143b40 2021-11-12T05:40:55.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3bd851700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b815a1a0 con 0x7ff3b80aded0 2021-11-12T05:40:55.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3bd851700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b80a9aa0 con 0x7ff3b80adaf0 2021-11-12T05:40:55.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3b77fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3b8143b40 0x7ff3b8066b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:55.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3b77fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3b8143b40 0x7ff3b8066b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43768/0 (socket says 172.21.2.105:43768) 2021-11-12T05:40:55.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3b77fe700 1 -- 172.21.2.105:0/1182644426 learned_addr learned my addr 172.21.2.105:0/1182644426 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:55.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3b67fc700 1 --2- 172.21.2.105:0/1182644426 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff3b80aded0 0x7ff3b809e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:55.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3b77fe700 1 -- 172.21.2.105:0/1182644426 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff3b80adaf0 msgr2=0x7ff3b80654c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:55.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3b77fe700 1 --2- 172.21.2.105:0/1182644426 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff3b80adaf0 0x7ff3b80654c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:55.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3b77fe700 1 -- 172.21.2.105:0/1182644426 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff3b80aded0 msgr2=0x7ff3b809e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:55.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3b77fe700 1 --2- 172.21.2.105:0/1182644426 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff3b80aded0 0x7ff3b809e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:55.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3b77fe700 1 -- 172.21.2.105:0/1182644426 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b000b460 con 0x7ff3b8143b40 2021-11-12T05:40:55.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3b77fe700 1 --2- 172.21.2.105:0/1182644426 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3b8143b40 0x7ff3b8066b90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7ff3b80b63f0 tx=0x7ff3b81405e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:55.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3affff700 1 -- 172.21.2.105:0/1182644426 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3b001d070 con 0x7ff3b8143b40 2021-11-12T05:40:55.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3affff700 1 -- 172.21.2.105:0/1182644426 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b0022410 con 0x7ff3b8143b40 2021-11-12T05:40:55.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3affff700 1 -- 172.21.2.105:0/1182644426 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3b0022770 con 0x7ff3b8143b40 2021-11-12T05:40:55.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3bd851700 1 -- 172.21.2.105:0/1182644426 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3b80ad1c0 con 0x7ff3b8143b40 2021-11-12T05:40:55.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3bd851700 1 -- 172.21.2.105:0/1182644426 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b8067220 con 0x7ff3b8143b40 2021-11-12T05:40:55.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.350+0000 7ff3bd851700 1 -- 172.21.2.105:0/1182644426 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b80b2b40 con 0x7ff3b8143b40 2021-11-12T05:40:55.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.354+0000 7ff3affff700 1 -- 172.21.2.105:0/1182644426 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff3b0018400 con 0x7ff3b8143b40 2021-11-12T05:40:55.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.354+0000 7ff3affff700 1 --2- 172.21.2.105:0/1182644426 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff39c053610 0x7ff39c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.354+0000 7ff3affff700 1 -- 172.21.2.105:0/1182644426 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7ff3b006d020 con 0x7ff3b8143b40 2021-11-12T05:40:55.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.354+0000 7ff3b6ffd700 1 --2- 172.21.2.105:0/1182644426 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff39c053610 0x7ff39c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:55.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.354+0000 7ff3b6ffd700 1 --2- 172.21.2.105:0/1182644426 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff39c053610 0x7ff39c055ad0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7ff3a0002f90 tx=0x7ff3a00069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:55.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.354+0000 7ff3affff700 1 -- 172.21.2.105:0/1182644426 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff3b0043eb0 con 0x7ff3b8143b40 2021-11-12T05:40:55.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.438+0000 7ff3bd851700 1 -- 172.21.2.105:0/1182644426 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3b8057350 con 0x7ff3b8143b40 2021-11-12T05:40:55.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.438+0000 7ff3affff700 1 -- 172.21.2.105:0/1182644426 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16299 (secure 0 0 0) 0x7ff3b0027030 con 0x7ff3b8143b40 2021-11-12T05:40:55.442 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:40:55.442 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":25,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:40:38.203083+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:40:32.786926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-11-12T05:40:35.006506+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:40:55.443 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.438+0000 7ff3bd851700 1 -- 172.21.2.105:0/1182644426 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff39c053610 msgr2=0x7ff39c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:55.444 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.438+0000 7ff3bd851700 1 --2- 172.21.2.105:0/1182644426 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff39c053610 0x7ff39c055ad0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7ff3a0002f90 tx=0x7ff3a00069b0).stop 2021-11-12T05:40:55.444 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.438+0000 7ff3bd851700 1 -- 172.21.2.105:0/1182644426 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3b8143b40 msgr2=0x7ff3b8066b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:55.444 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.438+0000 7ff3bd851700 1 --2- 172.21.2.105:0/1182644426 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3b8143b40 0x7ff3b8066b90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7ff3b80b63f0 tx=0x7ff3b81405e0).stop 2021-11-12T05:40:55.444 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.438+0000 7ff3bd851700 1 -- 172.21.2.105:0/1182644426 shutdown_connections 2021-11-12T05:40:55.445 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.438+0000 7ff3bd851700 1 --2- 172.21.2.105:0/1182644426 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff39c053610 0x7ff39c055ad0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:55.445 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.438+0000 7ff3bd851700 1 --2- 172.21.2.105:0/1182644426 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3b8143b40 0x7ff3b8066b90 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:55.445 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.438+0000 7ff3bd851700 1 --2- 172.21.2.105:0/1182644426 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff3b80aded0 0x7ff3b809e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:55.445 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.438+0000 7ff3bd851700 1 --2- 172.21.2.105:0/1182644426 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff3b80adaf0 0x7ff3b80654c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:55.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.438+0000 7ff3bd851700 1 -- 172.21.2.105:0/1182644426 >> 172.21.2.105:0/1182644426 conn(0x7ff3b805c490 msgr2=0x7ff3b80b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:55.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.438+0000 7ff3bd851700 1 -- 172.21.2.105:0/1182644426 shutdown_connections 2021-11-12T05:40:55.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.438+0000 7ff3bd851700 1 -- 172.21.2.105:0/1182644426 wait complete. 2021-11-12T05:40:55.449 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-12T05:40:32.786926+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-11-12T05:40:35.006506+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-12T05:40:55.450 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:40:55.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.498+0000 7fd9dc951700 1 Processor -- start 2021-11-12T05:40:55.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.498+0000 7fd9dc951700 1 -- start start 2021-11-12T05:40:55.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.498+0000 7fd9dc951700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fd9d80aca40 0x7fd9d80ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.498+0000 7fd9dc951700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd9d8144180 0x7fd9d81445f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.498+0000 7fd9dc951700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d80b1840 con 0x7fd9d80b0520 2021-11-12T05:40:55.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.498+0000 7fd9dc951700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d80b09d0 con 0x7fd9d8144180 2021-11-12T05:40:55.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.498+0000 7fd9dc951700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d80af2b0 con 0x7fd9d80aca40 2021-11-12T05:40:55.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.498+0000 7fd9d6d9d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd9d8144180 0x7fd9d81445f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:55.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.498+0000 7fd9d6d9d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd9d8144180 0x7fd9d81445f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43776/0 (socket says 172.21.2.105:43776) 2021-11-12T05:40:55.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.498+0000 7fd9d6d9d700 1 -- 172.21.2.105:0/1646263682 learned_addr learned my addr 172.21.2.105:0/1646263682 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:55.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.502+0000 7fd9d6d9d700 1 -- 172.21.2.105:0/1646263682 >> v2:172.21.2.115:3300/0 conn(0x7fd9d80aca40 msgr2=0x7fd9d80ace20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:40:55.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.502+0000 7fd9d6d9d700 1 --2- 172.21.2.105:0/1646263682 >> v2:172.21.2.115:3300/0 conn(0x7fd9d80aca40 0x7fd9d80ace20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:55.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.502+0000 7fd9d6d9d700 1 -- 172.21.2.105:0/1646263682 >> v1:172.21.2.115:6789/0 conn(0x7fd9d80b0520 legacy=0x7fd9d81473c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:40:55.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.502+0000 7fd9d6d9d700 1 -- 172.21.2.105:0/1646263682 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d80b1a70 con 0x7fd9d8144180 2021-11-12T05:40:55.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.502+0000 7fd9d6d9d700 1 --2- 172.21.2.105:0/1646263682 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd9d8144180 0x7fd9d81445f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fd9d8061140 tx=0x7fd9d0009290).ready entity=mon.0 client_cookie=1bf338720a310546 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:55.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.502+0000 7fd9d559a700 1 -- 172.21.2.105:0/1646263682 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9d000b830 con 0x7fd9d8144180 2021-11-12T05:40:55.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.502+0000 7fd9d559a700 1 -- 172.21.2.105:0/1646263682 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d000b990 con 0x7fd9d8144180 2021-11-12T05:40:55.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.502+0000 7fd9d559a700 1 -- 172.21.2.105:0/1646263682 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9d000bb40 con 0x7fd9d8144180 2021-11-12T05:40:55.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.502+0000 7fd9dc951700 1 -- 172.21.2.105:0/1646263682 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd9d8144180 msgr2=0x7fd9d81445f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:55.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.502+0000 7fd9dc951700 1 --2- 172.21.2.105:0/1646263682 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd9d8144180 0x7fd9d81445f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fd9d8061140 tx=0x7fd9d0009290).stop 2021-11-12T05:40:55.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.502+0000 7fd9dc951700 1 -- 172.21.2.105:0/1646263682 shutdown_connections 2021-11-12T05:40:55.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.502+0000 7fd9dc951700 1 --2- 172.21.2.105:0/1646263682 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd9d8144180 0x7fd9d81445f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:55.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.502+0000 7fd9dc951700 1 --2- 172.21.2.105:0/1646263682 >> v2:172.21.2.115:3300/0 conn(0x7fd9d80aca40 0x7fd9d80ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:55.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.502+0000 7fd9dc951700 1 -- 172.21.2.105:0/1646263682 >> 172.21.2.105:0/1646263682 conn(0x7fd9d805c490 msgr2=0x7fd9d80b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:55.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.502+0000 7fd9dc951700 1 -- 172.21.2.105:0/1646263682 shutdown_connections 2021-11-12T05:40:55.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.502+0000 7fd9dc951700 1 -- 172.21.2.105:0/1646263682 wait complete. 2021-11-12T05:40:55.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.502+0000 7fd9dc951700 1 Processor -- start 2021-11-12T05:40:55.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.502+0000 7fd9dc951700 1 -- start start 2021-11-12T05:40:55.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.502+0000 7fd9dc951700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd9d80aca40 0x7fd9d8144920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.502+0000 7fd9dc951700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd9d80b0520 0x7fd9d8159d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.502+0000 7fd9dc951700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd9d8144180 0x7fd9d815a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.502+0000 7fd9dc951700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d80a7020 con 0x7fd9d80b0520 2021-11-12T05:40:55.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.502+0000 7fd9dc951700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d80a7250 con 0x7fd9d8144180 2021-11-12T05:40:55.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.502+0000 7fd9dc951700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d80a74f0 con 0x7fd9d80aca40 2021-11-12T05:40:55.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.502+0000 7fd9d5d9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd9d80b0520 0x7fd9d8159d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:55.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.502+0000 7fd9d5d9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd9d80b0520 0x7fd9d8159d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43778/0 (socket says 172.21.2.105:43778) 2021-11-12T05:40:55.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.502+0000 7fd9d5d9b700 1 -- 172.21.2.105:0/2265904112 learned_addr learned my addr 172.21.2.105:0/2265904112 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:55.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.502+0000 7fd9d5d9b700 1 -- 172.21.2.105:0/2265904112 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd9d80aca40 msgr2=0x7fd9d8144920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:55.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.502+0000 7fd9d5d9b700 1 --2- 172.21.2.105:0/2265904112 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd9d80aca40 0x7fd9d8144920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:55.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.502+0000 7fd9d5d9b700 1 -- 172.21.2.105:0/2265904112 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd9d8144180 msgr2=0x7fd9d815a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:55.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.502+0000 7fd9d5d9b700 1 --2- 172.21.2.105:0/2265904112 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd9d8144180 0x7fd9d815a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:55.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.502+0000 7fd9d5d9b700 1 -- 172.21.2.105:0/2265904112 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d0009530 con 0x7fd9d80b0520 2021-11-12T05:40:55.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.502+0000 7fd9d5d9b700 1 --2- 172.21.2.105:0/2265904112 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd9d80b0520 0x7fd9d8159d30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fd9c0002fb0 tx=0x7fd9c0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:55.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.502+0000 7fd9cf7fe700 1 -- 172.21.2.105:0/2265904112 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9c0013460 con 0x7fd9d80b0520 2021-11-12T05:40:55.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.502+0000 7fd9cf7fe700 1 -- 172.21.2.105:0/2265904112 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c00135c0 con 0x7fd9d80b0520 2021-11-12T05:40:55.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.502+0000 7fd9cf7fe700 1 -- 172.21.2.105:0/2265904112 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9c0013920 con 0x7fd9d80b0520 2021-11-12T05:40:55.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.502+0000 7fd9dc951700 1 -- 172.21.2.105:0/2265904112 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d80a7790 con 0x7fd9d80b0520 2021-11-12T05:40:55.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.502+0000 7fd9dc951700 1 -- 172.21.2.105:0/2265904112 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d80b5130 con 0x7fd9d80b0520 2021-11-12T05:40:55.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.506+0000 7fd9dc951700 1 -- 172.21.2.105:0/2265904112 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9d8057350 con 0x7fd9d80b0520 2021-11-12T05:40:55.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.506+0000 7fd9cf7fe700 1 -- 172.21.2.105:0/2265904112 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd9c000f070 con 0x7fd9d80b0520 2021-11-12T05:40:55.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.506+0000 7fd9cf7fe700 1 --2- 172.21.2.105:0/2265904112 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd9bc053580 0x7fd9bc055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.506+0000 7fd9cf7fe700 1 -- 172.21.2.105:0/2265904112 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fd9c006b330 con 0x7fd9d80b0520 2021-11-12T05:40:55.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.506+0000 7fd9d659c700 1 --2- 172.21.2.105:0/2265904112 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd9bc053580 0x7fd9bc055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:55.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.506+0000 7fd9d659c700 1 --2- 172.21.2.105:0/2265904112 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd9bc053580 0x7fd9bc055a40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fd9c8002fb0 tx=0x7fd9c80069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:55.520 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.506+0000 7fd9cf7fe700 1 -- 172.21.2.105:0/2265904112 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd9c0042220 con 0x7fd9d80b0520 2021-11-12T05:40:55.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.590+0000 7fd9dc951700 1 -- 172.21.2.105:0/2265904112 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd9d805f280 con 0x7fd9d80b0520 2021-11-12T05:40:55.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.590+0000 7fd9cf7fe700 1 -- 172.21.2.105:0/2265904112 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd9c0018030 con 0x7fd9d80b0520 2021-11-12T05:40:55.592 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:40:55.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.590+0000 7fd9dc951700 1 -- 172.21.2.105:0/2265904112 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd9bc053580 msgr2=0x7fd9bc055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:55.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.590+0000 7fd9dc951700 1 --2- 172.21.2.105:0/2265904112 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd9bc053580 0x7fd9bc055a40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fd9c8002fb0 tx=0x7fd9c80069b0).stop 2021-11-12T05:40:55.594 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.590+0000 7fd9dc951700 1 -- 172.21.2.105:0/2265904112 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd9d80b0520 msgr2=0x7fd9d8159d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:55.594 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.590+0000 7fd9dc951700 1 --2- 172.21.2.105:0/2265904112 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd9d80b0520 0x7fd9d8159d30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fd9c0002fb0 tx=0x7fd9c0006df0).stop 2021-11-12T05:40:55.594 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.590+0000 7fd9dc951700 1 -- 172.21.2.105:0/2265904112 shutdown_connections 2021-11-12T05:40:55.594 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.590+0000 7fd9dc951700 1 --2- 172.21.2.105:0/2265904112 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd9bc053580 0x7fd9bc055a40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:55.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.590+0000 7fd9dc951700 1 --2- 172.21.2.105:0/2265904112 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd9d8144180 0x7fd9d815a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:55.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.590+0000 7fd9dc951700 1 --2- 172.21.2.105:0/2265904112 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd9d80b0520 0x7fd9d8159d30 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:55.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.590+0000 7fd9dc951700 1 --2- 172.21.2.105:0/2265904112 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd9d80aca40 0x7fd9d8144920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:55.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.590+0000 7fd9dc951700 1 -- 172.21.2.105:0/2265904112 >> 172.21.2.105:0/2265904112 conn(0x7fd9d805c490 msgr2=0x7fd9d8149cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:55.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.590+0000 7fd9dc951700 1 -- 172.21.2.105:0/2265904112 shutdown_connections 2021-11-12T05:40:55.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.590+0000 7fd9dc951700 1 -- 172.21.2.105:0/2265904112 wait complete. 2021-11-12T05:40:55.599 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:40:55.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.650+0000 7f3a15d37700 1 Processor -- start 2021-11-12T05:40:55.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.650+0000 7f3a15d37700 1 -- start start 2021-11-12T05:40:55.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.650+0000 7f3a15d37700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f3a100aca40 0x7f3a100ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.650+0000 7f3a15d37700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3a10144180 0x7f3a10144610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.650+0000 7f3a15d37700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a100b1840 con 0x7f3a100b0520 2021-11-12T05:40:55.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.650+0000 7f3a15d37700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a100b09d0 con 0x7f3a100aca40 2021-11-12T05:40:55.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.650+0000 7f3a15d37700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a100af2b0 con 0x7f3a10144180 2021-11-12T05:40:55.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.650+0000 7f3a0f7fe700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f3a100aca40 0x7f3a100ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:55.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.650+0000 7f3a0f7fe700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f3a100aca40 0x7f3a100ace20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3300/0 says I am v2:172.21.2.105:60960/0 (socket says 172.21.2.105:60960) 2021-11-12T05:40:55.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.650+0000 7f3a0f7fe700 1 -- 172.21.2.105:0/3433416294 learned_addr learned my addr 172.21.2.105:0/3433416294 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:55.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.650+0000 7f3a0ffff700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3a10144180 0x7f3a10144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:55.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.650+0000 7f3a0f7fe700 1 -- 172.21.2.105:0/3433416294 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3a10144180 msgr2=0x7f3a10144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:55.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.650+0000 7f3a0f7fe700 1 --2- 172.21.2.105:0/3433416294 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3a10144180 0x7f3a10144610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:55.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.650+0000 7f3a0f7fe700 1 -- 172.21.2.105:0/3433416294 >> v1:172.21.2.115:6789/0 conn(0x7f3a100b0520 legacy=0x7f3a101473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:55.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.650+0000 7f3a0f7fe700 1 -- 172.21.2.105:0/3433416294 --> v2:172.21.2.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a100b1a70 con 0x7f3a100aca40 2021-11-12T05:40:55.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.650+0000 7f3a0ffff700 1 --2- 172.21.2.105:0/3433416294 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3a10144180 0x7f3a10144610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-12T05:40:55.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.650+0000 7f3a0f7fe700 1 --2- 172.21.2.105:0/3433416294 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3a100aca40 0x7f3a100ace20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f39f8002f70 tx=0x7f39f8006eb0).ready entity=mon.1 client_cookie=e3edeaaf21e11f85 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:55.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.654+0000 7f3a0e7fc700 1 -- 172.21.2.105:0/3433416294 <== mon.1 v2:172.21.2.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39f800d570 con 0x7f3a100aca40 2021-11-12T05:40:55.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.654+0000 7f3a0e7fc700 1 -- 172.21.2.105:0/3433416294 <== mon.1 v2:172.21.2.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f8000e90 con 0x7f3a100aca40 2021-11-12T05:40:55.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.654+0000 7f3a0e7fc700 1 -- 172.21.2.105:0/3433416294 <== mon.1 v2:172.21.2.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39f800d900 con 0x7f3a100aca40 2021-11-12T05:40:55.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.654+0000 7f3a15d37700 1 -- 172.21.2.105:0/3433416294 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3a100aca40 msgr2=0x7f3a100ace20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:55.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.654+0000 7f3a15d37700 1 --2- 172.21.2.105:0/3433416294 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3a100aca40 0x7f3a100ace20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f39f8002f70 tx=0x7f39f8006eb0).stop 2021-11-12T05:40:55.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.654+0000 7f3a15d37700 1 -- 172.21.2.105:0/3433416294 shutdown_connections 2021-11-12T05:40:55.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.654+0000 7f3a15d37700 1 --2- 172.21.2.105:0/3433416294 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3a10144180 0x7f3a10144610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:55.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.654+0000 7f3a15d37700 1 --2- 172.21.2.105:0/3433416294 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3a100aca40 0x7f3a100ace20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:55.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.654+0000 7f3a15d37700 1 -- 172.21.2.105:0/3433416294 >> 172.21.2.105:0/3433416294 conn(0x7f3a1005c490 msgr2=0x7f3a100b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:55.663 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.654+0000 7f3a15d37700 1 -- 172.21.2.105:0/3433416294 shutdown_connections 2021-11-12T05:40:55.663 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.654+0000 7f3a15d37700 1 -- 172.21.2.105:0/3433416294 wait complete. 2021-11-12T05:40:55.663 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.654+0000 7f3a15d37700 1 Processor -- start 2021-11-12T05:40:55.663 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.654+0000 7f3a15d37700 1 -- start start 2021-11-12T05:40:55.664 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.654+0000 7f3a15d37700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3a100aca40 0x7f3a10145a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.664 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.654+0000 7f3a15d37700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a100b0520 0x7f3a10159d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.664 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.654+0000 7f3a15d37700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3a10144180 0x7f3a10140140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.664 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.654+0000 7f3a15d37700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a10144fd0 con 0x7f3a100b0520 2021-11-12T05:40:55.665 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.654+0000 7f3a15d37700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a10144a90 con 0x7f3a10144180 2021-11-12T05:40:55.665 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.654+0000 7f3a15d37700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a10144d30 con 0x7f3a100aca40 2021-11-12T05:40:55.665 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.654+0000 7f3a0effd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a100b0520 0x7f3a10159d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:55.665 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.654+0000 7f3a0effd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a100b0520 0x7f3a10159d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43792/0 (socket says 172.21.2.105:43792) 2021-11-12T05:40:55.665 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.654+0000 7f3a0effd700 1 -- 172.21.2.105:0/3749266758 learned_addr learned my addr 172.21.2.105:0/3749266758 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:55.666 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.654+0000 7f3a0effd700 1 -- 172.21.2.105:0/3749266758 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3a100aca40 msgr2=0x7f3a10145a30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:40:55.666 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.654+0000 7f3a0effd700 1 --2- 172.21.2.105:0/3749266758 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3a100aca40 0x7f3a10145a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:55.666 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.654+0000 7f3a0effd700 1 -- 172.21.2.105:0/3749266758 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3a10144180 msgr2=0x7f3a10140140 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:40:55.666 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.654+0000 7f3a0effd700 1 --2- 172.21.2.105:0/3749266758 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3a10144180 0x7f3a10140140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:55.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.654+0000 7f3a0effd700 1 -- 172.21.2.105:0/3749266758 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a08009470 con 0x7f3a100b0520 2021-11-12T05:40:55.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.654+0000 7f3a0effd700 1 --2- 172.21.2.105:0/3749266758 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a100b0520 0x7f3a10159d30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f3a10061140 tx=0x7f3a00007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:55.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.654+0000 7f3a0cff9700 1 -- 172.21.2.105:0/3749266758 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a0000ce30 con 0x7f3a100b0520 2021-11-12T05:40:55.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.654+0000 7f3a0cff9700 1 -- 172.21.2.105:0/3749266758 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0000f470 con 0x7f3a100b0520 2021-11-12T05:40:55.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.654+0000 7f3a0cff9700 1 -- 172.21.2.105:0/3749266758 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a0000f7d0 con 0x7f3a100b0520 2021-11-12T05:40:55.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.654+0000 7f3a15d37700 1 -- 172.21.2.105:0/3749266758 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39f800b1e0 con 0x7f3a100b0520 2021-11-12T05:40:55.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.654+0000 7f3a15d37700 1 -- 172.21.2.105:0/3749266758 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a1015a220 con 0x7f3a100b0520 2021-11-12T05:40:55.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.654+0000 7f3a15d37700 1 -- 172.21.2.105:0/3749266758 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a101407d0 con 0x7f3a100b0520 2021-11-12T05:40:55.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.658+0000 7f3a0cff9700 1 -- 172.21.2.105:0/3749266758 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3a00019030 con 0x7f3a100b0520 2021-11-12T05:40:55.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.658+0000 7f3a0cff9700 1 --2- 172.21.2.105:0/3749266758 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f39f4053660 0x7f39f4055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.658+0000 7f3a0cff9700 1 -- 172.21.2.105:0/3749266758 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f3a0006b070 con 0x7f3a100b0520 2021-11-12T05:40:55.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.658+0000 7f3a0f7fe700 1 --2- 172.21.2.105:0/3749266758 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f39f4053660 0x7f39f4055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:55.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.658+0000 7f3a0f7fe700 1 --2- 172.21.2.105:0/3749266758 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f39f4053660 0x7f39f4055b20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f39f8002f70 tx=0x7f39f8015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:55.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.658+0000 7f3a0cff9700 1 -- 172.21.2.105:0/3749266758 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3a00041f60 con 0x7f3a100b0520 2021-11-12T05:40:55.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.742+0000 7f3a15d37700 1 -- 172.21.2.105:0/3749266758 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3a10057350 con 0x7f3a100b0520 2021-11-12T05:40:55.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.742+0000 7f3a0cff9700 1 -- 172.21.2.105:0/3749266758 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3a00045580 con 0x7f3a100b0520 2021-11-12T05:40:55.745 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:40:55.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.742+0000 7f3a15d37700 1 -- 172.21.2.105:0/3749266758 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f39f4053660 msgr2=0x7f39f4055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:55.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.742+0000 7f3a15d37700 1 --2- 172.21.2.105:0/3749266758 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f39f4053660 0x7f39f4055b20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f39f8002f70 tx=0x7f39f8015000).stop 2021-11-12T05:40:55.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.742+0000 7f3a15d37700 1 -- 172.21.2.105:0/3749266758 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a100b0520 msgr2=0x7f3a10159d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:55.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.742+0000 7f3a15d37700 1 --2- 172.21.2.105:0/3749266758 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a100b0520 0x7f3a10159d30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f3a10061140 tx=0x7f3a00007c50).stop 2021-11-12T05:40:55.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.742+0000 7f3a15d37700 1 -- 172.21.2.105:0/3749266758 shutdown_connections 2021-11-12T05:40:55.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.742+0000 7f3a15d37700 1 --2- 172.21.2.105:0/3749266758 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f39f4053660 0x7f39f4055b20 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:55.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.742+0000 7f3a15d37700 1 --2- 172.21.2.105:0/3749266758 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3a10144180 0x7f3a10140140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:55.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.742+0000 7f3a15d37700 1 --2- 172.21.2.105:0/3749266758 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a100b0520 0x7f3a10159d30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:55.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.742+0000 7f3a15d37700 1 --2- 172.21.2.105:0/3749266758 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3a100aca40 0x7f3a10145a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:55.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.742+0000 7f3a15d37700 1 -- 172.21.2.105:0/3749266758 >> 172.21.2.105:0/3749266758 conn(0x7f3a1005c490 msgr2=0x7f3a10148bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:55.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.742+0000 7f3a15d37700 1 -- 172.21.2.105:0/3749266758 shutdown_connections 2021-11-12T05:40:55.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.742+0000 7f3a15d37700 1 -- 172.21.2.105:0/3749266758 wait complete. 2021-11-12T05:40:55.752 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-12T05:40:55.804 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.802+0000 7f9c124b7700 1 Processor -- start 2021-11-12T05:40:55.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.802+0000 7f9c124b7700 1 -- start start 2021-11-12T05:40:55.813 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.802+0000 7f9c124b7700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f9c0c0626b0 0x7f9c0c062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.802+0000 7f9c124b7700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f9c0c0af750 0x7f9c0c130370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.802+0000 7f9c124b7700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c0c130cf0 con 0x7f9c0c130860 2021-11-12T05:40:55.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.802+0000 7f9c124b7700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c0c0b0d50 con 0x7f9c0c0626b0 2021-11-12T05:40:55.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.802+0000 7f9c124b7700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c0c0ad380 con 0x7f9c0c0af750 2021-11-12T05:40:55.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.802+0000 7f9c0bfff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f9c0c0626b0 0x7f9c0c062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:55.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.802+0000 7f9c0bfff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f9c0c0626b0 0x7f9c0c062a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43800/0 (socket says 172.21.2.105:43800) 2021-11-12T05:40:55.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.802+0000 7f9c0bfff700 1 -- 172.21.2.105:0/2637107117 learned_addr learned my addr 172.21.2.105:0/2637107117 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:55.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.802+0000 7f9c0bfff700 1 -- 172.21.2.105:0/2637107117 >> v2:172.21.2.115:3300/0 conn(0x7f9c0c0af750 msgr2=0x7f9c0c130370 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:40:55.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.802+0000 7f9c0bfff700 1 --2- 172.21.2.105:0/2637107117 >> v2:172.21.2.115:3300/0 conn(0x7f9c0c0af750 0x7f9c0c130370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:55.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.802+0000 7f9c0bfff700 1 -- 172.21.2.105:0/2637107117 >> v1:172.21.2.115:6789/0 conn(0x7f9c0c130860 legacy=0x7f9c0c14a950 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:40:55.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.802+0000 7f9c0bfff700 1 -- 172.21.2.105:0/2637107117 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0c0ae190 con 0x7f9c0c0626b0 2021-11-12T05:40:55.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.802+0000 7f9c0bfff700 1 --2- 172.21.2.105:0/2637107117 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9c0c0626b0 0x7f9c0c062a90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f9c0c0b0690 tx=0x7f9bf4006eb0).ready entity=mon.0 client_cookie=963fe66b2163c197 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:55.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.802+0000 7f9c0affd700 1 -- 172.21.2.105:0/2637107117 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bf400d5c0 con 0x7f9c0c0626b0 2021-11-12T05:40:55.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.802+0000 7f9c0affd700 1 -- 172.21.2.105:0/2637107117 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf4000e90 con 0x7f9c0c0626b0 2021-11-12T05:40:55.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.802+0000 7f9c0affd700 1 -- 172.21.2.105:0/2637107117 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bf400d910 con 0x7f9c0c0626b0 2021-11-12T05:40:55.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.802+0000 7f9c124b7700 1 -- 172.21.2.105:0/2637107117 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9c0c0626b0 msgr2=0x7f9c0c062a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:55.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.802+0000 7f9c124b7700 1 --2- 172.21.2.105:0/2637107117 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9c0c0626b0 0x7f9c0c062a90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f9c0c0b0690 tx=0x7f9bf4006eb0).stop 2021-11-12T05:40:55.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.802+0000 7f9c124b7700 1 -- 172.21.2.105:0/2637107117 shutdown_connections 2021-11-12T05:40:55.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.802+0000 7f9c124b7700 1 --2- 172.21.2.105:0/2637107117 >> v2:172.21.2.115:3300/0 conn(0x7f9c0c0af750 0x7f9c0c130370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:55.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.802+0000 7f9c124b7700 1 --2- 172.21.2.105:0/2637107117 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9c0c0626b0 0x7f9c0c062a90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:55.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.802+0000 7f9c124b7700 1 -- 172.21.2.105:0/2637107117 >> 172.21.2.105:0/2637107117 conn(0x7f9c0c0b5320 msgr2=0x7f9c0c0b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:55.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.802+0000 7f9c124b7700 1 -- 172.21.2.105:0/2637107117 shutdown_connections 2021-11-12T05:40:55.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.802+0000 7f9c124b7700 1 -- 172.21.2.105:0/2637107117 wait complete. 2021-11-12T05:40:55.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.806+0000 7f9c124b7700 1 Processor -- start 2021-11-12T05:40:55.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.806+0000 7f9c124b7700 1 -- start start 2021-11-12T05:40:55.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.806+0000 7f9c124b7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9c0c0626b0 0x7f9c0c14dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.806+0000 7f9c124b7700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9c0c0af750 0x7f9c0c064010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.806+0000 7f9c124b7700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9c0c130860 0x7f9c0c064500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.806+0000 7f9c124b7700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c066a10 con 0x7f9c0c0626b0 2021-11-12T05:40:55.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.806+0000 7f9c124b7700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c063aa0 con 0x7f9c0c0af750 2021-11-12T05:40:55.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.806+0000 7f9c124b7700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c066c70 con 0x7f9c0c130860 2021-11-12T05:40:55.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.806+0000 7f9c0bfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9c0c0626b0 0x7f9c0c14dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:55.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.806+0000 7f9c0bfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9c0c0626b0 0x7f9c0c14dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43804/0 (socket says 172.21.2.105:43804) 2021-11-12T05:40:55.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.806+0000 7f9c0bfff700 1 -- 172.21.2.105:0/3728753855 learned_addr learned my addr 172.21.2.105:0/3728753855 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:55.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.806+0000 7f9c0bfff700 1 -- 172.21.2.105:0/3728753855 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9c0c130860 msgr2=0x7f9c0c064500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:55.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.806+0000 7f9c0b7fe700 1 --2- 172.21.2.105:0/3728753855 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9c0c0af750 0x7f9c0c064010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:55.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.806+0000 7f9c0bfff700 1 --2- 172.21.2.105:0/3728753855 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9c0c130860 0x7f9c0c064500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:55.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.806+0000 7f9c0bfff700 1 -- 172.21.2.105:0/3728753855 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9c0c0af750 msgr2=0x7f9c0c064010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:55.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.806+0000 7f9c0bfff700 1 --2- 172.21.2.105:0/3728753855 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9c0c0af750 0x7f9c0c064010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:55.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.806+0000 7f9c0bfff700 1 -- 172.21.2.105:0/3728753855 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf400b1e0 con 0x7f9c0c0626b0 2021-11-12T05:40:55.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.806+0000 7f9c0bfff700 1 --2- 172.21.2.105:0/3728753855 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9c0c0626b0 0x7f9c0c14dc60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f9c0c0b0690 tx=0x7f9bf4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:55.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.806+0000 7f9c097fa700 1 -- 172.21.2.105:0/3728753855 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bf40118a0 con 0x7f9c0c0626b0 2021-11-12T05:40:55.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.806+0000 7f9c097fa700 1 -- 172.21.2.105:0/3728753855 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf4011a00 con 0x7f9c0c0626b0 2021-11-12T05:40:55.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.806+0000 7f9c124b7700 1 -- 172.21.2.105:0/3728753855 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c0c063760 con 0x7f9c0c0626b0 2021-11-12T05:40:55.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.806+0000 7f9c124b7700 1 -- 172.21.2.105:0/3728753855 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c0c063240 con 0x7f9c0c0626b0 2021-11-12T05:40:55.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.806+0000 7f9c097fa700 1 -- 172.21.2.105:0/3728753855 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bf4011d60 con 0x7f9c0c0626b0 2021-11-12T05:40:55.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.806+0000 7f9c124b7700 1 -- 172.21.2.105:0/3728753855 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c0c057350 con 0x7f9c0c0626b0 2021-11-12T05:40:55.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.806+0000 7f9c097fa700 1 -- 172.21.2.105:0/3728753855 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9bf4025030 con 0x7f9c0c0626b0 2021-11-12T05:40:55.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.806+0000 7f9c097fa700 1 --2- 172.21.2.105:0/3728753855 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9bf0053690 0x7f9bf0055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.806+0000 7f9c097fa700 1 -- 172.21.2.105:0/3728753855 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f9bf406ce40 con 0x7f9c0c0626b0 2021-11-12T05:40:55.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.806+0000 7f9c0b7fe700 1 --2- 172.21.2.105:0/3728753855 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9bf0053690 0x7f9bf0055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:55.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.806+0000 7f9c0b7fe700 1 --2- 172.21.2.105:0/3728753855 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9bf0053690 0x7f9bf0055b50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f9bfc007000 tx=0x7f9bfc008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:55.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.810+0000 7f9c097fa700 1 -- 172.21.2.105:0/3728753855 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9bf4043d30 con 0x7f9c0c0626b0 2021-11-12T05:40:55.895 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.894+0000 7f9c124b7700 1 -- 172.21.2.105:0/3728753855 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9c0c063240 con 0x7f9c0c0626b0 2021-11-12T05:40:55.896 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.894+0000 7f9c097fa700 1 -- 172.21.2.105:0/3728753855 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7f9bf4023020 con 0x7f9c0c0626b0 2021-11-12T05:40:55.897 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:40:55.897 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.894+0000 7f9c124b7700 1 -- 172.21.2.105:0/3728753855 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9bf0053690 msgr2=0x7f9bf0055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:55.898 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.894+0000 7f9c124b7700 1 --2- 172.21.2.105:0/3728753855 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9bf0053690 0x7f9bf0055b50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f9bfc007000 tx=0x7f9bfc008040).stop 2021-11-12T05:40:55.898 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.894+0000 7f9c124b7700 1 -- 172.21.2.105:0/3728753855 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9c0c0626b0 msgr2=0x7f9c0c14dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:55.898 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.894+0000 7f9c124b7700 1 --2- 172.21.2.105:0/3728753855 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9c0c0626b0 0x7f9c0c14dc60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f9c0c0b0690 tx=0x7f9bf4015000).stop 2021-11-12T05:40:55.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.894+0000 7f9c124b7700 1 -- 172.21.2.105:0/3728753855 shutdown_connections 2021-11-12T05:40:55.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.894+0000 7f9c124b7700 1 --2- 172.21.2.105:0/3728753855 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9bf0053690 0x7f9bf0055b50 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:55.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.894+0000 7f9c124b7700 1 --2- 172.21.2.105:0/3728753855 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9c0c130860 0x7f9c0c064500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:55.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.894+0000 7f9c124b7700 1 --2- 172.21.2.105:0/3728753855 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9c0c0af750 0x7f9c0c064010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:55.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.894+0000 7f9c124b7700 1 --2- 172.21.2.105:0/3728753855 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9c0c0626b0 0x7f9c0c14dc60 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:55.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.894+0000 7f9c124b7700 1 -- 172.21.2.105:0/3728753855 >> 172.21.2.105:0/3728753855 conn(0x7f9c0c0b5320 msgr2=0x7f9c0c0b4720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:55.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.894+0000 7f9c124b7700 1 -- 172.21.2.105:0/3728753855 shutdown_connections 2021-11-12T05:40:55.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.894+0000 7f9c124b7700 1 -- 172.21.2.105:0/3728753855 wait complete. 2021-11-12T05:40:55.904 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-12T05:40:55.957 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.954+0000 7fde2527c700 1 Processor -- start 2021-11-12T05:40:55.957 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.954+0000 7fde2527c700 1 -- start start 2021-11-12T05:40:55.957 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.954+0000 7fde2527c700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fde200b0520 0x7fde20144890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.958 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.954+0000 7fde2527c700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde200b1840 con 0x7fde200ace20 2021-11-12T05:40:55.958 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.954+0000 7fde2527c700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde200af2b0 con 0x7fde200aca40 2021-11-12T05:40:55.958 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.954+0000 7fde2527c700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde200b0990 con 0x7fde200b0520 2021-11-12T05:40:55.958 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.954+0000 7fde1e7fc700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fde200ace20 0x7fde20144180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:54212/0 (socket says 172.21.2.105:54212) 2021-11-12T05:40:55.959 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.954+0000 7fde1e7fc700 1 -- 172.21.2.105:0/3790316662 learned_addr learned my addr 172.21.2.105:0/3790316662 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:55.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.954+0000 7fde1dffb700 1 -- 172.21.2.105:0/3790316662 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1457596232 0 0) 0x7fde200b1840 con 0x7fde200ace20 2021-11-12T05:40:55.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.954+0000 7fde1dffb700 1 -- 172.21.2.105:0/3790316662 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde04003260 con 0x7fde200ace20 2021-11-12T05:40:55.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.954+0000 7fde1dffb700 1 -- 172.21.2.105:0/3790316662 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2518260518 0 0) 0x7fde04003260 con 0x7fde200ace20 2021-11-12T05:40:55.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.954+0000 7fde1dffb700 1 -- 172.21.2.105:0/3790316662 >> v2:172.21.2.115:3300/0 conn(0x7fde200b0520 msgr2=0x7fde20144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:55.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.954+0000 7fde1dffb700 1 --2- 172.21.2.105:0/3790316662 >> v2:172.21.2.115:3300/0 conn(0x7fde200b0520 0x7fde20144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:55.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.954+0000 7fde1dffb700 1 -- 172.21.2.105:0/3790316662 >> v1:172.21.2.115:6789/0 conn(0x7fde200aca40 legacy=0x7fde201473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:55.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.954+0000 7fde1dffb700 1 -- 172.21.2.105:0/3790316662 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde20144d80 con 0x7fde200ace20 2021-11-12T05:40:55.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.954+0000 7fde1dffb700 1 -- 172.21.2.105:0/3790316662 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fde14001660 con 0x7fde200ace20 2021-11-12T05:40:55.965 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.954+0000 7fde1dffb700 1 -- 172.21.2.105:0/3790316662 >> v1:172.21.2.105:6789/0 conn(0x7fde200ace20 legacy=0x7fde20144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:55.965 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.954+0000 7fde1dffb700 1 --2- 172.21.2.105:0/3790316662 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fde040037d0 0x7fde04003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.965 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.954+0000 7fde1dffb700 1 --2- 172.21.2.105:0/3790316662 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde04004500 0x7fde04004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.965 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.954+0000 7fde1dffb700 1 --2- 172.21.2.105:0/3790316662 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fde04005070 0x7fde0400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.954+0000 7fde1dffb700 1 -- 172.21.2.105:0/3790316662 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde200b0990 con 0x7fde04004500 2021-11-12T05:40:55.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.954+0000 7fde1dffb700 1 -- 172.21.2.105:0/3790316662 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0400bef0 con 0x7fde040037d0 2021-11-12T05:40:55.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.954+0000 7fde1dffb700 1 -- 172.21.2.105:0/3790316662 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde0400c0b0 con 0x7fde04005070 2021-11-12T05:40:55.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.954+0000 7fde1e7fc700 1 --2- 172.21.2.105:0/3790316662 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde04004500 0x7fde04004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:55.967 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.954+0000 7fde1e7fc700 1 -- 172.21.2.105:0/3790316662 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fde04005070 msgr2=0x7fde0400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:55.967 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.954+0000 7fde1e7fc700 1 --2- 172.21.2.105:0/3790316662 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fde04005070 0x7fde0400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:55.967 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.954+0000 7fde1e7fc700 1 -- 172.21.2.105:0/3790316662 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fde040037d0 msgr2=0x7fde04003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:55.967 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.954+0000 7fde1e7fc700 1 --2- 172.21.2.105:0/3790316662 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fde040037d0 0x7fde04003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:55.967 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.954+0000 7fde1e7fc700 1 -- 172.21.2.105:0/3790316662 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde20144d80 con 0x7fde04004500 2021-11-12T05:40:55.968 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.954+0000 7fde1f7fe700 1 -- 172.21.2.105:0/3790316662 reap_dead start 2021-11-12T05:40:55.968 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.954+0000 7fde1e7fc700 1 --2- 172.21.2.105:0/3790316662 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde04004500 0x7fde04004980 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7fde14001020 tx=0x7fde14001e20).ready entity=mon.0 client_cookie=8f06fe766c3e9002 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:55.968 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.954+0000 7fde1dffb700 1 -- 172.21.2.105:0/3790316662 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde140070d0 con 0x7fde04004500 2021-11-12T05:40:55.968 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.954+0000 7fde1dffb700 1 -- 172.21.2.105:0/3790316662 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde14007230 con 0x7fde04004500 2021-11-12T05:40:55.969 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.954+0000 7fde1dffb700 1 -- 172.21.2.105:0/3790316662 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde1400c9c0 con 0x7fde04004500 2021-11-12T05:40:55.969 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.958+0000 7fde2527c700 1 -- 172.21.2.105:0/3790316662 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde04004500 msgr2=0x7fde04004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:55.969 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.958+0000 7fde2527c700 1 --2- 172.21.2.105:0/3790316662 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde04004500 0x7fde04004980 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7fde14001020 tx=0x7fde14001e20).stop 2021-11-12T05:40:55.969 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.958+0000 7fde2527c700 1 -- 172.21.2.105:0/3790316662 shutdown_connections 2021-11-12T05:40:55.969 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.958+0000 7fde2527c700 1 --2- 172.21.2.105:0/3790316662 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde04004500 0x7fde04004980 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:55.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.958+0000 7fde2527c700 1 -- 172.21.2.105:0/3790316662 >> 172.21.2.105:0/3790316662 conn(0x7fde2005c490 msgr2=0x7fde200b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:55.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.958+0000 7fde2527c700 1 -- 172.21.2.105:0/3790316662 shutdown_connections 2021-11-12T05:40:55.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.958+0000 7fde2527c700 1 -- 172.21.2.105:0/3790316662 wait complete. 2021-11-12T05:40:55.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.958+0000 7fde2527c700 1 Processor -- start 2021-11-12T05:40:55.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.958+0000 7fde2527c700 1 -- start start 2021-11-12T05:40:55.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.958+0000 7fde2527c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde04004500 0x7fde20147a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.958+0000 7fde2527c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fde20063c30 0x7fde200627f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.958+0000 7fde2527c700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fde20062ce0 0x7fde20143170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.958+0000 7fde2527c700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde200640b0 con 0x7fde04004500 2021-11-12T05:40:55.972 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.958+0000 7fde2527c700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde20148080 con 0x7fde20062ce0 2021-11-12T05:40:55.972 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.958+0000 7fde2527c700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde20065450 con 0x7fde20063c30 2021-11-12T05:40:55.972 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.958+0000 7fde1effd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde04004500 0x7fde20147a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:55.972 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.958+0000 7fde1effd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde04004500 0x7fde20147a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43826/0 (socket says 172.21.2.105:43826) 2021-11-12T05:40:55.972 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.958+0000 7fde1effd700 1 -- 172.21.2.105:0/2315161155 learned_addr learned my addr 172.21.2.105:0/2315161155 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:55.973 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.958+0000 7fde1effd700 1 -- 172.21.2.105:0/2315161155 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fde20063c30 msgr2=0x7fde200627f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:55.973 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.958+0000 7fde1effd700 1 --2- 172.21.2.105:0/2315161155 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fde20063c30 0x7fde200627f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:55.973 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.958+0000 7fde1effd700 1 -- 172.21.2.105:0/2315161155 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fde20062ce0 msgr2=0x7fde20143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:55.973 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.958+0000 7fde1effd700 1 --2- 172.21.2.105:0/2315161155 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fde20062ce0 0x7fde20143170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:55.973 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.958+0000 7fde1effd700 1 -- 172.21.2.105:0/2315161155 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde200656f0 con 0x7fde04004500 2021-11-12T05:40:55.974 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.958+0000 7fde1effd700 1 --2- 172.21.2.105:0/2315161155 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde04004500 0x7fde20147a20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7fde10000f70 tx=0x7fde10006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:55.974 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.958+0000 7fde0ffff700 1 -- 172.21.2.105:0/2315161155 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde10013460 con 0x7fde04004500 2021-11-12T05:40:55.974 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.958+0000 7fde0ffff700 1 -- 172.21.2.105:0/2315161155 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde100135c0 con 0x7fde04004500 2021-11-12T05:40:55.974 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.958+0000 7fde0ffff700 1 -- 172.21.2.105:0/2315161155 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde10013920 con 0x7fde04004500 2021-11-12T05:40:55.975 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.958+0000 7fde2527c700 1 -- 172.21.2.105:0/2315161155 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde20143660 con 0x7fde04004500 2021-11-12T05:40:55.975 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.958+0000 7fde2527c700 1 -- 172.21.2.105:0/2315161155 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde20159a90 con 0x7fde04004500 2021-11-12T05:40:55.975 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.958+0000 7fde2527c700 1 -- 172.21.2.105:0/2315161155 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde20065880 con 0x7fde04004500 2021-11-12T05:40:55.975 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.958+0000 7fde0ffff700 1 -- 172.21.2.105:0/2315161155 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fde1000f070 con 0x7fde04004500 2021-11-12T05:40:55.975 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.958+0000 7fde0ffff700 1 --2- 172.21.2.105:0/2315161155 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fddfc0536a0 0x7fddfc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:55.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.958+0000 7fde0ffff700 1 -- 172.21.2.105:0/2315161155 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fde1006b310 con 0x7fde04004500 2021-11-12T05:40:55.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.958+0000 7fde1e7fc700 1 --2- 172.21.2.105:0/2315161155 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fddfc0536a0 0x7fddfc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:55.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.958+0000 7fde1e7fc700 1 --2- 172.21.2.105:0/2315161155 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fddfc0536a0 0x7fddfc055b60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fde14001020 tx=0x7fde14015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:55.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:55.962+0000 7fde0ffff700 1 -- 172.21.2.105:0/2315161155 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fde10042310 con 0x7fde04004500 2021-11-12T05:40:56.050 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.046+0000 7fde2527c700 1 -- 172.21.2.105:0/2315161155 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fde20057350 con 0x7fde04004500 2021-11-12T05:40:56.050 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.046+0000 7fde0ffff700 1 -- 172.21.2.105:0/2315161155 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7fde10045930 con 0x7fde04004500 2021-11-12T05:40:56.051 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:40:56.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.046+0000 7fde2527c700 1 -- 172.21.2.105:0/2315161155 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fddfc0536a0 msgr2=0x7fddfc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:56.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.046+0000 7fde2527c700 1 --2- 172.21.2.105:0/2315161155 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fddfc0536a0 0x7fddfc055b60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fde14001020 tx=0x7fde14015000).stop 2021-11-12T05:40:56.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.046+0000 7fde2527c700 1 -- 172.21.2.105:0/2315161155 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde04004500 msgr2=0x7fde20147a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:56.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.046+0000 7fde2527c700 1 --2- 172.21.2.105:0/2315161155 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde04004500 0x7fde20147a20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7fde10000f70 tx=0x7fde10006df0).stop 2021-11-12T05:40:56.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.050+0000 7fde2527c700 1 -- 172.21.2.105:0/2315161155 shutdown_connections 2021-11-12T05:40:56.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.050+0000 7fde2527c700 1 --2- 172.21.2.105:0/2315161155 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fddfc0536a0 0x7fddfc055b60 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:56.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.050+0000 7fde2527c700 1 --2- 172.21.2.105:0/2315161155 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fde20062ce0 0x7fde20143170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:56.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.050+0000 7fde2527c700 1 --2- 172.21.2.105:0/2315161155 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fde20063c30 0x7fde200627f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:56.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.050+0000 7fde2527c700 1 --2- 172.21.2.105:0/2315161155 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde04004500 0x7fde20147a20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:56.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.050+0000 7fde2527c700 1 -- 172.21.2.105:0/2315161155 >> 172.21.2.105:0/2315161155 conn(0x7fde2005c490 msgr2=0x7fde200b19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:56.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.050+0000 7fde2527c700 1 -- 172.21.2.105:0/2315161155 shutdown_connections 2021-11-12T05:40:56.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.050+0000 7fde2527c700 1 -- 172.21.2.105:0/2315161155 wait complete. 2021-11-12T05:40:56.066 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command (tasks.cephfs.test_misc.TestCacheDrop) 2021-11-12T05:40:56.067 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command' 2021-11-12T05:40:56.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.118+0000 7f4284d41700 1 Processor -- start 2021-11-12T05:40:56.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.118+0000 7f4284d41700 1 -- start start 2021-11-12T05:40:56.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.118+0000 7f4284d41700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f42800ad080 0x7f42800af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:56.121 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.118+0000 7f4284d41700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f42800ac280 0x7f42800ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:56.121 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.118+0000 7f4284d41700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42800ac7b0 con 0x7f428014abe0 2021-11-12T05:40:56.121 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.118+0000 7f4284d41700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42801488a0 con 0x7f42800ac280 2021-11-12T05:40:56.122 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.118+0000 7f4284d41700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42800ac9e0 con 0x7f42800ad080 2021-11-12T05:40:56.124 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.118+0000 7f427dd9b700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f42800ac280 0x7f42800ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:56.124 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.118+0000 7f427e59c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f42800ad080 0x7f42800af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:56.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.118+0000 7f427ed9d700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7f428014abe0 0x7f428014b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:52700/0 (socket says 172.21.2.105:52700) 2021-11-12T05:40:56.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.118+0000 7f427ed9d700 1 -- 172.21.2.105:0/1094817545 learned_addr learned my addr 172.21.2.105:0/1094817545 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:56.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.118+0000 7f427e59c700 1 -- 172.21.2.105:0/1094817545 >> v2:172.21.2.115:3300/0 conn(0x7f42800ac280 msgr2=0x7f42800ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:56.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.118+0000 7f427e59c700 1 --2- 172.21.2.105:0/1094817545 >> v2:172.21.2.115:3300/0 conn(0x7f42800ac280 0x7f42800ad460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:56.127 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.118+0000 7f427e59c700 1 -- 172.21.2.105:0/1094817545 >> v1:172.21.2.115:6789/0 conn(0x7f428014abe0 legacy=0x7f428014b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:56.127 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.118+0000 7f427e59c700 1 -- 172.21.2.105:0/1094817545 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42800b0b30 con 0x7f42800ad080 2021-11-12T05:40:56.127 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.118+0000 7f427e59c700 1 --2- 172.21.2.105:0/1094817545 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f42800ad080 0x7f42800af730 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f42700032f0 tx=0x7f42700091d0).ready entity=mon.2 client_cookie=d16c2fac65ae74ab server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:56.127 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.122+0000 7f427d59a700 1 -- 172.21.2.105:0/1094817545 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f427000b6c0 con 0x7f42800ad080 2021-11-12T05:40:56.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.122+0000 7f427d59a700 1 -- 172.21.2.105:0/1094817545 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427000b820 con 0x7f42800ad080 2021-11-12T05:40:56.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.122+0000 7f427d59a700 1 -- 172.21.2.105:0/1094817545 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f427000b990 con 0x7f42800ad080 2021-11-12T05:40:56.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.122+0000 7f4284d41700 1 -- 172.21.2.105:0/1094817545 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f42800ad080 msgr2=0x7f42800af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:56.129 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.122+0000 7f4284d41700 1 --2- 172.21.2.105:0/1094817545 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f42800ad080 0x7f42800af730 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f42700032f0 tx=0x7f42700091d0).stop 2021-11-12T05:40:56.129 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.122+0000 7f4284d41700 1 -- 172.21.2.105:0/1094817545 shutdown_connections 2021-11-12T05:40:56.129 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.122+0000 7f4284d41700 1 --2- 172.21.2.105:0/1094817545 >> v2:172.21.2.115:3300/0 conn(0x7f42800ac280 0x7f42800ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:56.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.122+0000 7f4284d41700 1 --2- 172.21.2.105:0/1094817545 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f42800ad080 0x7f42800af730 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:56.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.122+0000 7f4284d41700 1 -- 172.21.2.105:0/1094817545 >> 172.21.2.105:0/1094817545 conn(0x7f42800b5370 msgr2=0x7f42800b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:56.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.122+0000 7f4284d41700 1 -- 172.21.2.105:0/1094817545 shutdown_connections 2021-11-12T05:40:56.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.122+0000 7f4284d41700 1 -- 172.21.2.105:0/1094817545 wait complete. 2021-11-12T05:40:56.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.122+0000 7f4284d41700 1 Processor -- start 2021-11-12T05:40:56.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.122+0000 7f4284d41700 1 -- start start 2021-11-12T05:40:56.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.122+0000 7f4284d41700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f42800ac280 0x7f4280148ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:56.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.122+0000 7f4284d41700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f42800ad080 0x7f4280143650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:56.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.122+0000 7f4284d41700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f428014abe0 0x7f42801428a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:56.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.122+0000 7f4284d41700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4280142d90 con 0x7f428014abe0 2021-11-12T05:40:56.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.122+0000 7f4284d41700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4280142f70 con 0x7f42800ac280 2021-11-12T05:40:56.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.122+0000 7f4284d41700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428014a3b0 con 0x7f42800ad080 2021-11-12T05:40:56.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.122+0000 7f427ed9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f428014abe0 0x7f42801428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:56.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.122+0000 7f427ed9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f428014abe0 0x7f42801428a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43842/0 (socket says 172.21.2.105:43842) 2021-11-12T05:40:56.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.122+0000 7f427ed9d700 1 -- 172.21.2.105:0/127954918 learned_addr learned my addr 172.21.2.105:0/127954918 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:56.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.122+0000 7f427e59c700 1 --2- 172.21.2.105:0/127954918 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f42800ac280 0x7f4280148ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:56.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.122+0000 7f427ed9d700 1 -- 172.21.2.105:0/127954918 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f42800ad080 msgr2=0x7f4280143650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:56.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.122+0000 7f427ed9d700 1 --2- 172.21.2.105:0/127954918 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f42800ad080 0x7f4280143650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:56.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.122+0000 7f427ed9d700 1 -- 172.21.2.105:0/127954918 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f42800ac280 msgr2=0x7f4280148ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:56.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.122+0000 7f427ed9d700 1 --2- 172.21.2.105:0/127954918 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f42800ac280 0x7f4280148ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:56.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.122+0000 7f427ed9d700 1 -- 172.21.2.105:0/127954918 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4270009470 con 0x7f428014abe0 2021-11-12T05:40:56.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.122+0000 7f427ed9d700 1 --2- 172.21.2.105:0/127954918 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f428014abe0 0x7f42801428a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f42800b6060 tx=0x7f4278007be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:56.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.122+0000 7f42777fe700 1 -- 172.21.2.105:0/127954918 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42780070d0 con 0x7f428014abe0 2021-11-12T05:40:56.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.122+0000 7f42777fe700 1 -- 172.21.2.105:0/127954918 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4278007230 con 0x7f428014abe0 2021-11-12T05:40:56.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.122+0000 7f42777fe700 1 -- 172.21.2.105:0/127954918 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4278005610 con 0x7f428014abe0 2021-11-12T05:40:56.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.122+0000 7f4284d41700 1 -- 172.21.2.105:0/127954918 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4280149c70 con 0x7f428014abe0 2021-11-12T05:40:56.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.122+0000 7f4284d41700 1 -- 172.21.2.105:0/127954918 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42801414f0 con 0x7f428014abe0 2021-11-12T05:40:56.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.126+0000 7f4284d41700 1 -- 172.21.2.105:0/127954918 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4280149e30 con 0x7f428014abe0 2021-11-12T05:40:56.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.126+0000 7f42777fe700 1 -- 172.21.2.105:0/127954918 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f427801a070 con 0x7f428014abe0 2021-11-12T05:40:56.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.126+0000 7f42777fe700 1 --2- 172.21.2.105:0/127954918 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4264053610 0x7f4264055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:56.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.126+0000 7f42777fe700 1 -- 172.21.2.105:0/127954918 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f427806ad90 con 0x7f428014abe0 2021-11-12T05:40:56.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.126+0000 7f427e59c700 1 --2- 172.21.2.105:0/127954918 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4264053610 0x7f4264055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:56.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.126+0000 7f427e59c700 1 --2- 172.21.2.105:0/127954918 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4264053610 0x7f4264055ad0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f4270019000 tx=0x7f4270016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:56.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.126+0000 7f42777fe700 1 -- 172.21.2.105:0/127954918 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4280149e30 con 0x7f428014abe0 2021-11-12T05:40:56.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.238+0000 7f4284d41700 1 -- 172.21.2.105:0/127954918 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]} v 0) v1 -- 0x7f4280149e00 con 0x7f428014abe0 2021-11-12T05:40:56.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.986+0000 7f42777fe700 1 -- 172.21.2.105:0/127954918 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]}]=0 v36) v1 ==== 142+0+0 (secure 0 0 0) 0x7f4278041c80 con 0x7f428014abe0 2021-11-12T05:40:56.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.986+0000 7f4284d41700 1 -- 172.21.2.105:0/127954918 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4264053610 msgr2=0x7f4264055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:56.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.986+0000 7f4284d41700 1 --2- 172.21.2.105:0/127954918 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4264053610 0x7f4264055ad0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f4270019000 tx=0x7f4270016000).stop 2021-11-12T05:40:56.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.986+0000 7f4284d41700 1 -- 172.21.2.105:0/127954918 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f428014abe0 msgr2=0x7f42801428a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:56.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.986+0000 7f4284d41700 1 --2- 172.21.2.105:0/127954918 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f428014abe0 0x7f42801428a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f42800b6060 tx=0x7f4278007be0).stop 2021-11-12T05:40:56.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.986+0000 7f4284d41700 1 -- 172.21.2.105:0/127954918 shutdown_connections 2021-11-12T05:40:56.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.986+0000 7f4284d41700 1 --2- 172.21.2.105:0/127954918 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4264053610 0x7f4264055ad0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:56.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.986+0000 7f4284d41700 1 --2- 172.21.2.105:0/127954918 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f428014abe0 0x7f42801428a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:56.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.986+0000 7f4284d41700 1 --2- 172.21.2.105:0/127954918 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f42800ad080 0x7f4280143650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:56.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.986+0000 7f4284d41700 1 --2- 172.21.2.105:0/127954918 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f42800ac280 0x7f4280148ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:56.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.986+0000 7f4284d41700 1 -- 172.21.2.105:0/127954918 >> 172.21.2.105:0/127954918 conn(0x7f42800b5370 msgr2=0x7f42800ae880 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:56.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.986+0000 7f4284d41700 1 -- 172.21.2.105:0/127954918 shutdown_connections 2021-11-12T05:40:56.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:56.986+0000 7f4284d41700 1 -- 172.21.2.105:0/127954918 wait complete. 2021-11-12T05:40:56.996 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-11-12T05:40:57.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.050+0000 7f9d89c46700 1 Processor -- start 2021-11-12T05:40:57.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.050+0000 7f9d89c46700 1 -- start start 2021-11-12T05:40:57.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.050+0000 7f9d89c46700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9d840b1060 0x7f9d8413f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:57.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.050+0000 7f9d89c46700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d840ad400 con 0x7f9d840b2e20 2021-11-12T05:40:57.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.050+0000 7f9d89c46700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d840b3200 con 0x7f9d8405c490 2021-11-12T05:40:57.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.050+0000 7f9d89c46700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d840ad660 con 0x7f9d840b1060 2021-11-12T05:40:57.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.050+0000 7f9d837fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f9d840b2e20 0x7f9d8413ea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:54242/0 (socket says 172.21.2.105:54242) 2021-11-12T05:40:57.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.050+0000 7f9d837fe700 1 -- 172.21.2.105:0/2845418357 learned_addr learned my addr 172.21.2.105:0/2845418357 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:57.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.050+0000 7f9d82ffd700 1 --2- 172.21.2.105:0/2845418357 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9d840b1060 0x7f9d8413f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:57.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.050+0000 7f9d827fc700 1 -- 172.21.2.105:0/2845418357 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4006529723 0 0) 0x7f9d840ad400 con 0x7f9d840b2e20 2021-11-12T05:40:57.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.050+0000 7f9d827fc700 1 -- 172.21.2.105:0/2845418357 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d64003260 con 0x7f9d840b2e20 2021-11-12T05:40:57.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.050+0000 7f9d827fc700 1 -- 172.21.2.105:0/2845418357 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3823454464 0 0) 0x7f9d64003260 con 0x7f9d840b2e20 2021-11-12T05:40:57.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.050+0000 7f9d827fc700 1 -- 172.21.2.105:0/2845418357 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9d840b1060 msgr2=0x7f9d8413f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:57.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.050+0000 7f9d827fc700 1 --2- 172.21.2.105:0/2845418357 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9d840b1060 0x7f9d8413f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:57.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.050+0000 7f9d827fc700 1 -- 172.21.2.105:0/2845418357 >> v1:172.21.2.115:6789/0 conn(0x7f9d8405c490 legacy=0x7f9d84142c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:57.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.050+0000 7f9d827fc700 1 -- 172.21.2.105:0/2845418357 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d840ad900 con 0x7f9d840b2e20 2021-11-12T05:40:57.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.050+0000 7f9d827fc700 1 -- 172.21.2.105:0/2845418357 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f9d6c001660 con 0x7f9d840b2e20 2021-11-12T05:40:57.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.050+0000 7f9d827fc700 1 -- 172.21.2.105:0/2845418357 >> v1:172.21.2.105:6789/0 conn(0x7f9d840b2e20 legacy=0x7f9d8413ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:57.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.050+0000 7f9d827fc700 1 --2- 172.21.2.105:0/2845418357 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9d64003780 0x7f9d64003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:57.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.050+0000 7f9d827fc700 1 --2- 172.21.2.105:0/2845418357 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9d64004500 0x7f9d64004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:57.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.050+0000 7f9d827fc700 1 --2- 172.21.2.105:0/2845418357 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9d840b1060 0x7f9d64004eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:57.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.050+0000 7f9d827fc700 1 -- 172.21.2.105:0/2845418357 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d840ad660 con 0x7f9d64003780 2021-11-12T05:40:57.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.050+0000 7f9d827fc700 1 -- 172.21.2.105:0/2845418357 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6400b800 con 0x7f9d64004500 2021-11-12T05:40:57.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.050+0000 7f9d827fc700 1 -- 172.21.2.105:0/2845418357 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6400b9c0 con 0x7f9d840b1060 2021-11-12T05:40:57.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.050+0000 7f9d837fe700 1 --2- 172.21.2.105:0/2845418357 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9d64003780 0x7f9d64003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:57.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d837fe700 1 -- 172.21.2.105:0/2845418357 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9d840b1060 msgr2=0x7f9d64004eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:57.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d837fe700 1 --2- 172.21.2.105:0/2845418357 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9d840b1060 0x7f9d64004eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:57.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d837fe700 1 -- 172.21.2.105:0/2845418357 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9d64004500 msgr2=0x7f9d64004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:57.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d837fe700 1 --2- 172.21.2.105:0/2845418357 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9d64004500 0x7f9d64004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:57.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d837fe700 1 -- 172.21.2.105:0/2845418357 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d64003260 con 0x7f9d64003780 2021-11-12T05:40:57.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d837fe700 1 --2- 172.21.2.105:0/2845418357 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9d64003780 0x7f9d64003ba0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f9d6c001370 tx=0x7f9d6c001d40).ready entity=mon.0 client_cookie=ababdbda9131def server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:57.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d827fc700 1 -- 172.21.2.105:0/2845418357 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d6c0070d0 con 0x7f9d64003780 2021-11-12T05:40:57.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d827fc700 1 -- 172.21.2.105:0/2845418357 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6c007230 con 0x7f9d64003780 2021-11-12T05:40:57.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d827fc700 1 -- 172.21.2.105:0/2845418357 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d6c00c8f0 con 0x7f9d64003780 2021-11-12T05:40:57.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d89c46700 1 -- 172.21.2.105:0/2845418357 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9d64003780 msgr2=0x7f9d64003ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:57.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d89c46700 1 --2- 172.21.2.105:0/2845418357 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9d64003780 0x7f9d64003ba0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f9d6c001370 tx=0x7f9d6c001d40).stop 2021-11-12T05:40:57.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d83fff700 1 -- 172.21.2.105:0/2845418357 reap_dead start 2021-11-12T05:40:57.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d89c46700 1 -- 172.21.2.105:0/2845418357 shutdown_connections 2021-11-12T05:40:57.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d89c46700 1 -- 172.21.2.105:0/2845418357 >> 172.21.2.105:0/2845418357 conn(0x7f9d84062f60 msgr2=0x7f9d84063370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:57.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d89c46700 1 -- 172.21.2.105:0/2845418357 shutdown_connections 2021-11-12T05:40:57.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d89c46700 1 -- 172.21.2.105:0/2845418357 wait complete. 2021-11-12T05:40:57.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d89c46700 1 Processor -- start 2021-11-12T05:40:57.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d89c46700 1 -- start start 2021-11-12T05:40:57.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d89c46700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9d64003780 0x7f9d840ac4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:57.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d89c46700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9d840a9b90 0x7f9d841518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:57.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d89c46700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9d840b5220 0x7f9d84151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:57.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d89c46700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d840b4c40 con 0x7f9d840b5220 2021-11-12T05:40:57.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d89c46700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d840aab70 con 0x7f9d64003780 2021-11-12T05:40:57.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d89c46700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d84152280 con 0x7f9d840a9b90 2021-11-12T05:40:57.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d83fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9d840b5220 0x7f9d84151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:57.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d83fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9d840b5220 0x7f9d84151d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43862/0 (socket says 172.21.2.105:43862) 2021-11-12T05:40:57.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d83fff700 1 -- 172.21.2.105:0/710735325 learned_addr learned my addr 172.21.2.105:0/710735325 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:57.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d837fe700 1 --2- 172.21.2.105:0/710735325 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9d64003780 0x7f9d840ac4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:57.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d82ffd700 1 --2- 172.21.2.105:0/710735325 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9d840a9b90 0x7f9d841518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:57.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d83fff700 1 -- 172.21.2.105:0/710735325 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9d840a9b90 msgr2=0x7f9d841518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:57.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d83fff700 1 --2- 172.21.2.105:0/710735325 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9d840a9b90 0x7f9d841518a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:57.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d83fff700 1 -- 172.21.2.105:0/710735325 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9d64003780 msgr2=0x7f9d840ac4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:57.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d83fff700 1 --2- 172.21.2.105:0/710735325 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9d64003780 0x7f9d840ac4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:57.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d83fff700 1 -- 172.21.2.105:0/710735325 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d84152440 con 0x7f9d840b5220 2021-11-12T05:40:57.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d83fff700 1 --2- 172.21.2.105:0/710735325 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9d840b5220 0x7f9d84151d90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f9d6c001110 tx=0x7f9d7c007e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:57.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d80ff9700 1 -- 172.21.2.105:0/710735325 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d7c005880 con 0x7f9d840b5220 2021-11-12T05:40:57.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d89c46700 1 -- 172.21.2.105:0/710735325 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d841526f0 con 0x7f9d840b5220 2021-11-12T05:40:57.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d80ff9700 1 -- 172.21.2.105:0/710735325 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7c0059e0 con 0x7f9d840b5220 2021-11-12T05:40:57.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d80ff9700 1 -- 172.21.2.105:0/710735325 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d7c005d40 con 0x7f9d840b5220 2021-11-12T05:40:57.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.054+0000 7f9d89c46700 1 -- 172.21.2.105:0/710735325 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d84136d50 con 0x7f9d840b5220 2021-11-12T05:40:57.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.058+0000 7f9d89c46700 1 -- 172.21.2.105:0/710735325 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d840aa9c0 con 0x7f9d840b5220 2021-11-12T05:40:57.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.058+0000 7f9d80ff9700 1 -- 172.21.2.105:0/710735325 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9d7c01a060 con 0x7f9d840b5220 2021-11-12T05:40:57.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.058+0000 7f9d80ff9700 1 --2- 172.21.2.105:0/710735325 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9d68053610 0x7f9d68055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:57.074 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.058+0000 7f9d80ff9700 1 -- 172.21.2.105:0/710735325 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f9d7c06b2c0 con 0x7f9d840b5220 2021-11-12T05:40:57.074 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.058+0000 7f9d837fe700 1 --2- 172.21.2.105:0/710735325 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9d68053610 0x7f9d68055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:57.074 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.058+0000 7f9d837fe700 1 --2- 172.21.2.105:0/710735325 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9d68053610 0x7f9d68055ad0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f9d6c01a000 tx=0x7f9d6c015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:57.074 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.058+0000 7f9d80ff9700 1 -- 172.21.2.105:0/710735325 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9d7c042260 con 0x7f9d840b5220 2021-11-12T05:40:57.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.142+0000 7f9d89c46700 1 -- 172.21.2.105:0/710735325 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f9d840b4570 con 0x7f9d840b5220 2021-11-12T05:40:57.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.146+0000 7f9d80ff9700 1 -- 172.21.2.105:0/710735325 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9d7c018020 con 0x7f9d840b5220 2021-11-12T05:40:57.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.150+0000 7f9d89c46700 1 -- 172.21.2.105:0/710735325 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9d68053610 msgr2=0x7f9d68055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:57.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.150+0000 7f9d89c46700 1 --2- 172.21.2.105:0/710735325 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9d68053610 0x7f9d68055ad0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f9d6c01a000 tx=0x7f9d6c015000).stop 2021-11-12T05:40:57.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.150+0000 7f9d89c46700 1 -- 172.21.2.105:0/710735325 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9d840b5220 msgr2=0x7f9d84151d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:57.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.150+0000 7f9d89c46700 1 --2- 172.21.2.105:0/710735325 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9d840b5220 0x7f9d84151d90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f9d6c001110 tx=0x7f9d7c007e30).stop 2021-11-12T05:40:57.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.150+0000 7f9d89c46700 1 -- 172.21.2.105:0/710735325 shutdown_connections 2021-11-12T05:40:57.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.150+0000 7f9d89c46700 1 --2- 172.21.2.105:0/710735325 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9d68053610 0x7f9d68055ad0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:57.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.150+0000 7f9d89c46700 1 --2- 172.21.2.105:0/710735325 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9d840b5220 0x7f9d84151d90 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:57.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.150+0000 7f9d89c46700 1 --2- 172.21.2.105:0/710735325 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9d840a9b90 0x7f9d841518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:57.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.150+0000 7f9d89c46700 1 --2- 172.21.2.105:0/710735325 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9d64003780 0x7f9d840ac4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:57.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.150+0000 7f9d89c46700 1 -- 172.21.2.105:0/710735325 >> 172.21.2.105:0/710735325 conn(0x7f9d84062f60 msgr2=0x7f9d840af700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:57.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.150+0000 7f9d89c46700 1 -- 172.21.2.105:0/710735325 shutdown_connections 2021-11-12T05:40:57.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.150+0000 7f9d89c46700 1 -- 172.21.2.105:0/710735325 wait complete. 2021-11-12T05:40:57.157 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-12T05:40:57.158 DEBUG:teuthology.orchestra.run.gibba005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:40:57.166 DEBUG:teuthology.orchestra.run.gibba015:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:40:57.175 DEBUG:teuthology.orchestra.run.gibba016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:40:57.188 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:40:57.201 DEBUG:teuthology.orchestra.run.gibba044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:40:57.215 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-12T05:40:57.215 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:40:57.216 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:40:57.216 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:40:57.239 INFO:teuthology.orchestra.run.gibba016.stdout:fuseblk 2021-11-12T05:40:57.241 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-12T05:40:57.241 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:40:57.242 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:40:57.242 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:40:57.253 INFO:teuthology.orchestra.run.gibba016.stdout:fuseblk 2021-11-12T05:40:57.254 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-12T05:40:57.254 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:40:57.255 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:40:57.255 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:40:57.306 INFO:teuthology.orchestra.run.gibba016.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-11-12T05:40:57.307 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:40:57.308 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-11-12T05:40:57.309 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba016.front.sepia.ceph.com... 2021-11-12T05:40:57.309 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-12T05:40:57.309 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:40:57.328 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:40:57.328 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:40:57.329 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:40:57.333 INFO:teuthology.orchestra.run.gibba016.stdout:ext2/ext3 2021-11-12T05:40:57.333 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-12T05:40:57.334 INFO:teuthology.orchestra.run:waiting for 900 2021-11-12T05:40:57.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:40:57.335 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:40:57.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:40:57.387 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:40:57.388 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:40:57.399 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-12T05:40:57.400 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-12T05:40:57.401 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:40:57.401 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:40:57.402 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:40:57.413 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-12T05:40:57.414 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-12T05:40:57.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:40:57.415 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:40:57.416 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:40:57.464 INFO:teuthology.orchestra.run.gibba038.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': Transport endpoint is not connected 2021-11-12T05:40:57.464 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:40:57.465 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.1 2021-11-12T05:40:57.466 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba038.front.sepia.ceph.com... 2021-11-12T05:40:57.466 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-12T05:40:57.467 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:40:57.482 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:40:57.483 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:40:57.483 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:40:57.488 INFO:teuthology.orchestra.run.gibba038.stdout:ext2/ext3 2021-11-12T05:40:57.489 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-12T05:40:57.489 INFO:teuthology.orchestra.run:waiting for 900 2021-11-12T05:40:57.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:40:57.490 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:40:57.542 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:40:57.543 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:40:57.543 DEBUG:teuthology.orchestra.run.gibba044:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:40:57.554 INFO:teuthology.orchestra.run.gibba044.stdout:fuseblk 2021-11-12T05:40:57.555 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2021-11-12T05:40:57.556 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:40:57.556 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:40:57.557 DEBUG:teuthology.orchestra.run.gibba044:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:40:57.568 INFO:teuthology.orchestra.run.gibba044.stdout:fuseblk 2021-11-12T05:40:57.569 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2021-11-12T05:40:57.570 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:40:57.570 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:40:57.571 DEBUG:teuthology.orchestra.run.gibba044:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:40:57.620 INFO:teuthology.orchestra.run.gibba044.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': Transport endpoint is not connected 2021-11-12T05:40:57.621 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:40:57.622 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.2 2021-11-12T05:40:57.623 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba044.front.sepia.ceph.com... 2021-11-12T05:40:57.623 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-12T05:40:57.624 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:40:57.645 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:40:57.645 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:40:57.646 DEBUG:teuthology.orchestra.run.gibba044:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:40:57.650 INFO:teuthology.orchestra.run.gibba044.stdout:ext2/ext3 2021-11-12T05:40:57.650 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-12T05:40:57.651 INFO:teuthology.orchestra.run:waiting for 900 2021-11-12T05:40:57.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:40:57.652 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:40:57.672 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-12T05:40:57.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.726+0000 7f6aad0e0700 1 Processor -- start 2021-11-12T05:40:57.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.726+0000 7f6aad0e0700 1 -- start start 2021-11-12T05:40:57.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.726+0000 7f6aad0e0700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f6aa80626b0 0x7f6aa8062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:57.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.726+0000 7f6aad0e0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6aa80af750 0x7f6aa8130370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:57.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.726+0000 7f6aad0e0700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aa8130d10 con 0x7f6aa8130860 2021-11-12T05:40:57.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.726+0000 7f6aad0e0700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aa80b0d50 con 0x7f6aa80626b0 2021-11-12T05:40:57.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.726+0000 7f6aad0e0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa80ad380 con 0x7f6aa80af750 2021-11-12T05:40:57.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.726+0000 7f6aa759e700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f6aa8130860 0x7f6aa814a950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:54266/0 (socket says 172.21.2.105:54266) 2021-11-12T05:40:57.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.726+0000 7f6aa759e700 1 -- 172.21.2.105:0/1720833719 learned_addr learned my addr 172.21.2.105:0/1720833719 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:57.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.726+0000 7f6aa6d9d700 1 --2- 172.21.2.105:0/1720833719 >> v2:172.21.2.105:3300/0 conn(0x7f6aa80626b0 0x7f6aa8062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:57.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.726+0000 7f6aa6d9d700 1 -- 172.21.2.105:0/1720833719 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6aa80af750 msgr2=0x7f6aa8130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:57.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.726+0000 7f6aa6d9d700 1 --2- 172.21.2.105:0/1720833719 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6aa80af750 0x7f6aa8130370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:57.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.726+0000 7f6aa6d9d700 1 -- 172.21.2.105:0/1720833719 >> v1:172.21.2.105:6789/0 conn(0x7f6aa8130860 legacy=0x7f6aa814a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:57.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.726+0000 7f6aa6d9d700 1 -- 172.21.2.105:0/1720833719 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa80ae190 con 0x7f6aa80626b0 2021-11-12T05:40:57.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.726+0000 7f6aa6d9d700 1 --2- 172.21.2.105:0/1720833719 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6aa80626b0 0x7f6aa8062a90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f6a90002f70 tx=0x7f6a90006df0).ready entity=mon.0 client_cookie=c0fa83eff9f1082a server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:57.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.726+0000 7f6aa5d9b700 1 -- 172.21.2.105:0/1720833719 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a9000d570 con 0x7f6aa80626b0 2021-11-12T05:40:57.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.726+0000 7f6aa5d9b700 1 -- 172.21.2.105:0/1720833719 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a90000e90 con 0x7f6aa80626b0 2021-11-12T05:40:57.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.726+0000 7f6aa5d9b700 1 -- 172.21.2.105:0/1720833719 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a9000d8c0 con 0x7f6aa80626b0 2021-11-12T05:40:57.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.726+0000 7f6aad0e0700 1 -- 172.21.2.105:0/1720833719 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6aa80626b0 msgr2=0x7f6aa8062a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:57.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.726+0000 7f6aad0e0700 1 --2- 172.21.2.105:0/1720833719 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6aa80626b0 0x7f6aa8062a90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f6a90002f70 tx=0x7f6a90006df0).stop 2021-11-12T05:40:57.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.726+0000 7f6aad0e0700 1 -- 172.21.2.105:0/1720833719 shutdown_connections 2021-11-12T05:40:57.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.726+0000 7f6aad0e0700 1 --2- 172.21.2.105:0/1720833719 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6aa80af750 0x7f6aa8130370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:57.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.726+0000 7f6aad0e0700 1 --2- 172.21.2.105:0/1720833719 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6aa80626b0 0x7f6aa8062a90 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:57.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.726+0000 7f6aad0e0700 1 -- 172.21.2.105:0/1720833719 >> 172.21.2.105:0/1720833719 conn(0x7f6aa80b5320 msgr2=0x7f6aa80b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:57.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.726+0000 7f6aad0e0700 1 -- 172.21.2.105:0/1720833719 shutdown_connections 2021-11-12T05:40:57.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.726+0000 7f6aad0e0700 1 -- 172.21.2.105:0/1720833719 wait complete. 2021-11-12T05:40:57.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.726+0000 7f6aad0e0700 1 Processor -- start 2021-11-12T05:40:57.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.726+0000 7f6aad0e0700 1 -- start start 2021-11-12T05:40:57.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.726+0000 7f6aad0e0700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6aa80626b0 0x7f6aa8064510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:57.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.726+0000 7f6aad0e0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6aa80af750 0x7f6aa8144600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:57.738 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.726+0000 7f6aad0e0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6aa8130860 0x7f6aa8144af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:57.738 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.726+0000 7f6aad0e0700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa814eff0 con 0x7f6aa8130860 2021-11-12T05:40:57.738 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.726+0000 7f6aad0e0700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa814eab0 con 0x7f6aa80626b0 2021-11-12T05:40:57.738 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.726+0000 7f6aad0e0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa814ed50 con 0x7f6aa80af750 2021-11-12T05:40:57.738 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.730+0000 7f6aa759e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6aa8130860 0x7f6aa8144af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:57.739 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.730+0000 7f6aa759e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6aa8130860 0x7f6aa8144af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43876/0 (socket says 172.21.2.105:43876) 2021-11-12T05:40:57.739 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.730+0000 7f6aa759e700 1 -- 172.21.2.105:0/1860156966 learned_addr learned my addr 172.21.2.105:0/1860156966 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:57.739 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.730+0000 7f6aa759e700 1 -- 172.21.2.105:0/1860156966 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6aa80af750 msgr2=0x7f6aa8144600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:57.739 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.730+0000 7f6aa759e700 1 --2- 172.21.2.105:0/1860156966 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6aa80af750 0x7f6aa8144600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:57.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.730+0000 7f6aa759e700 1 -- 172.21.2.105:0/1860156966 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6aa80626b0 msgr2=0x7f6aa8064510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:57.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.730+0000 7f6aa759e700 1 --2- 172.21.2.105:0/1860156966 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6aa80626b0 0x7f6aa8064510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:57.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.730+0000 7f6aa759e700 1 -- 172.21.2.105:0/1860156966 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9000b180 con 0x7f6aa8130860 2021-11-12T05:40:57.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.730+0000 7f6aa759e700 1 --2- 172.21.2.105:0/1860156966 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6aa8130860 0x7f6aa8144af0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f6aa80af1d0 tx=0x7f6aa00013a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:57.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.730+0000 7f6a9ffff700 1 -- 172.21.2.105:0/1860156966 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6aa0005ba0 con 0x7f6aa8130860 2021-11-12T05:40:57.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.730+0000 7f6a9ffff700 1 -- 172.21.2.105:0/1860156966 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa0005d00 con 0x7f6aa8130860 2021-11-12T05:40:57.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.730+0000 7f6a9ffff700 1 -- 172.21.2.105:0/1860156966 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6aa00072c0 con 0x7f6aa8130860 2021-11-12T05:40:57.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.730+0000 7f6aad0e0700 1 -- 172.21.2.105:0/1860156966 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aa814e040 con 0x7f6aa8130860 2021-11-12T05:40:57.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.730+0000 7f6aad0e0700 1 -- 172.21.2.105:0/1860156966 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aa80632c0 con 0x7f6aa8130860 2021-11-12T05:40:57.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.730+0000 7f6aad0e0700 1 -- 172.21.2.105:0/1860156966 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aa8063f80 con 0x7f6aa8130860 2021-11-12T05:40:57.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.730+0000 7f6a9ffff700 1 -- 172.21.2.105:0/1860156966 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6aa001a060 con 0x7f6aa8130860 2021-11-12T05:40:57.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.730+0000 7f6a9ffff700 1 --2- 172.21.2.105:0/1860156966 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6a8c0535d0 0x7f6a8c055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:57.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.730+0000 7f6a9ffff700 1 -- 172.21.2.105:0/1860156966 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f6aa006b630 con 0x7f6aa8130860 2021-11-12T05:40:57.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.730+0000 7f6aa6d9d700 1 --2- 172.21.2.105:0/1860156966 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6a8c0535d0 0x7f6a8c055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:57.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.730+0000 7f6aa6d9d700 1 --2- 172.21.2.105:0/1860156966 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6a8c0535d0 0x7f6a8c055a90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f6a90002f70 tx=0x7f6a90015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:57.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.734+0000 7f6a9ffff700 1 -- 172.21.2.105:0/1860156966 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6aa0042520 con 0x7f6aa8130860 2021-11-12T05:40:57.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.814+0000 7f6aad0e0700 1 -- 172.21.2.105:0/1860156966 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f6aa8062fb0 con 0x7f6aa8130860 2021-11-12T05:40:57.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.814+0000 7f6a9ffff700 1 -- 172.21.2.105:0/1860156966 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v25) v1 ==== 81+0+34065 (secure 0 0 0) 0x7f6aa0018020 con 0x7f6aa8130860 2021-11-12T05:40:57.817 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:40:57.817 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:40:57.818 INFO:teuthology.orchestra.run.gibba005.stdout: "epoch": 25, 2021-11-12T05:40:57.818 INFO:teuthology.orchestra.run.gibba005.stdout: "fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", 2021-11-12T05:40:57.818 INFO:teuthology.orchestra.run.gibba005.stdout: "created": "2021-11-12T05:40:19.986390+0000", 2021-11-12T05:40:57.818 INFO:teuthology.orchestra.run.gibba005.stdout: "modified": "2021-11-12T05:40:38.203083+0000", 2021-11-12T05:40:57.819 INFO:teuthology.orchestra.run.gibba005.stdout: "last_up_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:40:57.819 INFO:teuthology.orchestra.run.gibba005.stdout: "last_in_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:40:57.819 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-12T05:40:57.819 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_num": 5799936, 2021-11-12T05:40:57.820 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_set": [ 2021-11-12T05:40:57.820 INFO:teuthology.orchestra.run.gibba005.stdout: "pglog_hardlimit", 2021-11-12T05:40:57.820 INFO:teuthology.orchestra.run.gibba005.stdout: "purged_snapdirs", 2021-11-12T05:40:57.820 INFO:teuthology.orchestra.run.gibba005.stdout: "recovery_deletes", 2021-11-12T05:40:57.821 INFO:teuthology.orchestra.run.gibba005.stdout: "sortbitwise" 2021-11-12T05:40:57.821 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:40:57.821 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_version": 5, 2021-11-12T05:40:57.821 INFO:teuthology.orchestra.run.gibba005.stdout: "full_ratio": 0.94999998807907104, 2021-11-12T05:40:57.822 INFO:teuthology.orchestra.run.gibba005.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-12T05:40:57.822 INFO:teuthology.orchestra.run.gibba005.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-12T05:40:57.822 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_snapshot": "", 2021-11-12T05:40:57.822 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_max": 4, 2021-11-12T05:40:57.822 INFO:teuthology.orchestra.run.gibba005.stdout: "max_osd": 8, 2021-11-12T05:40:57.823 INFO:teuthology.orchestra.run.gibba005.stdout: "require_min_compat_client": "jewel", 2021-11-12T05:40:57.823 INFO:teuthology.orchestra.run.gibba005.stdout: "min_compat_client": "jewel", 2021-11-12T05:40:57.823 INFO:teuthology.orchestra.run.gibba005.stdout: "require_osd_release": "octopus", 2021-11-12T05:40:57.823 INFO:teuthology.orchestra.run.gibba005.stdout: "pools": [ 2021-11-12T05:40:57.824 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.824 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 1, 2021-11-12T05:40:57.824 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "device_health_metrics", 2021-11-12T05:40:57.824 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:22.022116+0000", 2021-11-12T05:40:57.825 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:40:57.825 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:40:57.825 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:40:57.825 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:40:57.826 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:40:57.826 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:40:57.826 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:40:57.826 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:40:57.826 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 1, 2021-11-12T05:40:57.827 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 1, 2021-11-12T05:40:57.827 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 1, 2021-11-12T05:40:57.827 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 1, 2021-11-12T05:40:57.827 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 1, 2021-11-12T05:40:57.828 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:40:57.828 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:40:57.828 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:40:57.828 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:40:57.828 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:40:57.829 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:40:57.829 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:40:57.829 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.829 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "16", 2021-11-12T05:40:57.829 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:40:57.830 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:40:57.830 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:40:57.830 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:40:57.830 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:40:57.831 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:40:57.831 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:40:57.831 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:40:57.831 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:40:57.831 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:40:57.832 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:40:57.832 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:40:57.832 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:40:57.832 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:40:57.833 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:40:57.833 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:40:57.833 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:40:57.833 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:40:57.833 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:40:57.834 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:40:57.834 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:40:57.834 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:40:57.834 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:40:57.834 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:40:57.835 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:40:57.835 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:40:57.835 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.835 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:40:57.836 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:40:57.836 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:40:57.836 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:40:57.836 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:40:57.836 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:40:57.837 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:40:57.837 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:40:57.837 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:40:57.837 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:40:57.838 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:40:57.838 INFO:teuthology.orchestra.run.gibba005.stdout: "options": { 2021-11-12T05:40:57.838 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_min": 1 2021-11-12T05:40:57.838 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.839 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:40:57.839 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr_devicehealth": {} 2021-11-12T05:40:57.839 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:57.839 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.839 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.840 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 2, 2021-11-12T05:40:57.840 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "rbd", 2021-11-12T05:40:57.840 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:29.953617+0000", 2021-11-12T05:40:57.840 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:40:57.841 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:40:57.841 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:40:57.841 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:40:57.841 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:40:57.841 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:40:57.842 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:40:57.842 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:40:57.842 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:40:57.842 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:40:57.843 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:40:57.843 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:40:57.843 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:40:57.843 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:40:57.843 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:40:57.844 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:40:57.844 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:40:57.844 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:40:57.844 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:40:57.844 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:40:57.845 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.845 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "19", 2021-11-12T05:40:57.845 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:40:57.845 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:40:57.846 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:40:57.846 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:40:57.846 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:40:57.846 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:40:57.846 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:40:57.847 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:40:57.847 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:40:57.847 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:40:57.847 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:40:57.848 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:40:57.848 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:40:57.848 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:40:57.848 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:40:57.849 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:40:57.849 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:40:57.849 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:40:57.849 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:40:57.849 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:40:57.850 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:40:57.850 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:40:57.850 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:40:57.850 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:40:57.851 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:40:57.851 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:40:57.851 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.851 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:40:57.851 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:40:57.852 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:40:57.852 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:40:57.852 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:40:57.852 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:40:57.852 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:40:57.853 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:40:57.853 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:40:57.856 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:40:57.856 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:40:57.856 INFO:teuthology.orchestra.run.gibba005.stdout: "options": {}, 2021-11-12T05:40:57.857 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:40:57.857 INFO:teuthology.orchestra.run.gibba005.stdout: "rbd": {} 2021-11-12T05:40:57.857 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:57.857 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.858 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.858 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 3, 2021-11-12T05:40:57.858 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "cephfs_metadata", 2021-11-12T05:40:57.858 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:32.786926+0000", 2021-11-12T05:40:57.859 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:40:57.859 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:40:57.859 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:40:57.859 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:40:57.859 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:40:57.860 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:40:57.860 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:40:57.860 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:40:57.860 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:40:57.861 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:40:57.861 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:40:57.861 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:40:57.861 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:40:57.861 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:40:57.862 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:40:57.862 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:40:57.862 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:40:57.862 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:40:57.862 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:40:57.863 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:40:57.863 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.863 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "24", 2021-11-12T05:40:57.863 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:40:57.864 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:40:57.864 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:40:57.864 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:40:57.864 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:40:57.864 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:40:57.865 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:40:57.865 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:40:57.865 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:40:57.865 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:40:57.865 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:40:57.866 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:40:57.866 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:40:57.866 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:40:57.866 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:40:57.867 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:40:57.867 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:40:57.867 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:40:57.867 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:40:57.868 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:40:57.868 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:40:57.868 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:40:57.868 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:40:57.869 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:40:57.869 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:40:57.869 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:40:57.869 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.869 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:40:57.870 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:40:57.870 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:40:57.870 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:40:57.870 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:40:57.871 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:40:57.871 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:40:57.871 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:40:57.871 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:40:57.871 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:40:57.872 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:40:57.872 INFO:teuthology.orchestra.run.gibba005.stdout: "options": { 2021-11-12T05:40:57.872 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_bias": 4, 2021-11-12T05:40:57.872 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_min": 16, 2021-11-12T05:40:57.873 INFO:teuthology.orchestra.run.gibba005.stdout: "recovery_priority": 5 2021-11-12T05:40:57.873 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.873 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:40:57.873 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs": { 2021-11-12T05:40:57.873 INFO:teuthology.orchestra.run.gibba005.stdout: "metadata": "cephfs" 2021-11-12T05:40:57.874 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:57.874 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:57.874 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.874 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.875 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 4, 2021-11-12T05:40:57.875 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "cephfs_data", 2021-11-12T05:40:57.875 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:35.006506+0000", 2021-11-12T05:40:57.875 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 5, 2021-11-12T05:40:57.875 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool,ec_overwrites", 2021-11-12T05:40:57.876 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 3, 2021-11-12T05:40:57.876 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 4, 2021-11-12T05:40:57.876 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 3, 2021-11-12T05:40:57.876 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 1, 2021-11-12T05:40:57.877 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:40:57.877 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:40:57.877 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:40:57.877 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:40:57.877 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:40:57.878 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:40:57.878 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:40:57.878 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:40:57.878 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:40:57.878 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:40:57.879 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:40:57.879 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:40:57.879 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:40:57.879 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:40:57.880 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.880 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "25", 2021-11-12T05:40:57.880 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:40:57.880 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:40:57.880 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:40:57.881 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:40:57.881 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:40:57.881 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:40:57.881 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:40:57.882 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:40:57.882 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:40:57.882 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:40:57.882 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:40:57.883 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:40:57.883 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:40:57.883 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:40:57.883 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:40:57.883 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:40:57.884 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:40:57.884 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:40:57.884 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:40:57.884 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:40:57.884 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:40:57.885 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:40:57.885 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:40:57.885 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "cephfs_data", 2021-11-12T05:40:57.886 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:40:57.886 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:40:57.886 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.886 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:40:57.886 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:40:57.887 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:40:57.887 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:40:57.887 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:40:57.887 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:40:57.888 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:40:57.888 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:40:57.888 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 8192, 2021-11-12T05:40:57.888 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:40:57.888 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:40:57.889 INFO:teuthology.orchestra.run.gibba005.stdout: "options": {}, 2021-11-12T05:40:57.889 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:40:57.889 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs": { 2021-11-12T05:40:57.889 INFO:teuthology.orchestra.run.gibba005.stdout: "data": "cephfs" 2021-11-12T05:40:57.889 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:57.890 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:57.890 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:57.890 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:40:57.890 INFO:teuthology.orchestra.run.gibba005.stdout: "osds": [ 2021-11-12T05:40:57.891 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.891 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:40:57.891 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "ee8e30a0-4819-4475-80ec-dd3ee7d01322", 2021-11-12T05:40:57.891 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:40:57.891 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:40:57.892 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:40:57.892 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:40:57.892 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:40:57.892 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:40:57.893 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:40:57.893 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 22, 2021-11-12T05:40:57.893 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:40:57.893 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:40:57.893 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:40:57.894 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:40:57.894 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.894 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:40:57.894 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6802", 2021-11-12T05:40:57.895 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:40:57.895 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.895 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.895 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:40:57.896 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6803", 2021-11-12T05:40:57.896 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:40:57.896 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:57.896 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:57.896 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.897 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:40:57.897 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:40:57.897 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.897 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:40:57.898 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6804", 2021-11-12T05:40:57.898 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:40:57.898 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.898 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.899 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:40:57.899 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6805", 2021-11-12T05:40:57.899 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:40:57.899 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:57.900 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:57.900 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.900 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:40:57.900 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:40:57.901 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.901 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:40:57.901 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6808", 2021-11-12T05:40:57.901 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:40:57.902 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.902 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.902 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:40:57.902 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6809", 2021-11-12T05:40:57.903 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:40:57.903 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:57.903 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:57.903 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.904 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:40:57.904 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:40:57.904 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.904 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:40:57.905 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6806", 2021-11-12T05:40:57.905 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:40:57.905 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.905 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.906 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:40:57.906 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6807", 2021-11-12T05:40:57.906 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:40:57.907 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:57.907 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:57.907 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.907 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6803/14874", 2021-11-12T05:40:57.908 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6805/14874", 2021-11-12T05:40:57.908 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6809/14874", 2021-11-12T05:40:57.908 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6807/14874", 2021-11-12T05:40:57.909 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:40:57.909 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:40:57.909 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:40:57.909 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:57.910 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.910 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.910 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:40:57.910 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "b1bb06c3-26d0-4d92-82f8-b3e882242785", 2021-11-12T05:40:57.911 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:40:57.911 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:40:57.911 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:40:57.911 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:40:57.912 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:40:57.912 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:40:57.912 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:40:57.912 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 22, 2021-11-12T05:40:57.913 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:40:57.913 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:40:57.913 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:40:57.913 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:40:57.914 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.914 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:40:57.914 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6810", 2021-11-12T05:40:57.914 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:40:57.915 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.915 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.915 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:40:57.915 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6811", 2021-11-12T05:40:57.915 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:40:57.916 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:57.916 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:57.916 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.916 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:40:57.917 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:40:57.917 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.917 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:40:57.917 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6812", 2021-11-12T05:40:57.918 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:40:57.918 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.918 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.918 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:40:57.919 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6813", 2021-11-12T05:40:57.919 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:40:57.919 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:57.919 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:57.920 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.920 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:40:57.920 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:40:57.920 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.921 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:40:57.921 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6816", 2021-11-12T05:40:57.921 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:40:57.921 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.922 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.922 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:40:57.922 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6817", 2021-11-12T05:40:57.922 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:40:57.923 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:57.923 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:57.923 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.923 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:40:57.924 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:40:57.924 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.924 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:40:57.925 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6814", 2021-11-12T05:40:57.925 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:40:57.925 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.925 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.925 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:40:57.926 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6815", 2021-11-12T05:40:57.926 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:40:57.926 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:57.926 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:57.927 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.927 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6811/14875", 2021-11-12T05:40:57.927 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6813/14875", 2021-11-12T05:40:57.927 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6817/14875", 2021-11-12T05:40:57.928 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6815/14875", 2021-11-12T05:40:57.928 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:40:57.928 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:40:57.928 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:40:57.929 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:57.929 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.929 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.929 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:40:57.930 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "837b2c60-c335-4382-9f47-d86543a14022", 2021-11-12T05:40:57.930 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:40:57.930 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:40:57.930 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:40:57.930 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:40:57.931 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:40:57.931 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:40:57.931 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:40:57.932 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 17, 2021-11-12T05:40:57.932 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:40:57.932 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:40:57.932 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:40:57.933 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:40:57.933 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.933 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:40:57.933 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6818", 2021-11-12T05:40:57.933 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:40:57.934 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.934 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.934 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:40:57.934 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6819", 2021-11-12T05:40:57.935 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:40:57.935 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:57.935 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:57.935 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.936 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:40:57.936 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:40:57.936 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.936 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:40:57.937 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6820", 2021-11-12T05:40:57.937 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:40:57.937 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.937 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.938 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:40:57.938 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6821", 2021-11-12T05:40:57.938 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:40:57.938 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:57.939 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:57.939 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.939 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:40:57.939 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:40:57.939 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.940 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:40:57.940 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6824", 2021-11-12T05:40:57.940 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:40:57.940 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.941 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.941 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:40:57.941 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6825", 2021-11-12T05:40:57.941 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:40:57.942 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:57.942 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:57.942 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.943 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:40:57.943 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:40:57.943 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.943 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:40:57.943 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6822", 2021-11-12T05:40:57.944 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:40:57.944 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.944 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.944 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:40:57.945 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6823", 2021-11-12T05:40:57.945 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:40:57.945 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:57.945 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:57.945 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.946 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6819/14905", 2021-11-12T05:40:57.946 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6821/14905", 2021-11-12T05:40:57.946 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6825/14905", 2021-11-12T05:40:57.946 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6823/14905", 2021-11-12T05:40:57.947 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:40:57.947 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:40:57.947 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:40:57.947 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:57.948 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.948 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.948 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:40:57.948 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "eb2b737b-dda6-444b-a306-f33cbbd51f70", 2021-11-12T05:40:57.949 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:40:57.949 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:40:57.949 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:40:57.949 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:40:57.950 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:40:57.950 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:40:57.950 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:40:57.950 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 22, 2021-11-12T05:40:57.951 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:40:57.951 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:40:57.951 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:40:57.951 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:40:57.951 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.952 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:40:57.952 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6826", 2021-11-12T05:40:57.952 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:40:57.952 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.953 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.953 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:40:57.953 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6827", 2021-11-12T05:40:57.953 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:40:57.954 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:57.954 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:57.954 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.954 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:40:57.954 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:40:57.955 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.955 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:40:57.955 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6828", 2021-11-12T05:40:57.955 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:40:57.956 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.956 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.956 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:40:57.956 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6829", 2021-11-12T05:40:57.957 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:40:57.957 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:57.957 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:57.957 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.958 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:40:57.958 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:40:57.958 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.958 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:40:57.959 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6832", 2021-11-12T05:40:57.959 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:40:57.959 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.959 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.959 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:40:57.960 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6833", 2021-11-12T05:40:57.960 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:40:57.960 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:57.960 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:57.961 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.961 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:40:57.961 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:40:57.961 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.961 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:40:57.962 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6830", 2021-11-12T05:40:57.962 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:40:57.962 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.962 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.963 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:40:57.963 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6831", 2021-11-12T05:40:57.963 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:40:57.963 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:57.963 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:57.964 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.964 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6827/14876", 2021-11-12T05:40:57.964 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6829/14876", 2021-11-12T05:40:57.964 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6833/14876", 2021-11-12T05:40:57.965 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6831/14876", 2021-11-12T05:40:57.965 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:40:57.965 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:40:57.965 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:40:57.966 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:57.966 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.966 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.966 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:40:57.967 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "721529a1-c047-486a-a7ca-ddc15d80cdde", 2021-11-12T05:40:57.967 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:40:57.967 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:40:57.967 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:40:57.967 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:40:57.968 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:40:57.968 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:40:57.968 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:40:57.968 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 22, 2021-11-12T05:40:57.969 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:40:57.969 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:40:57.969 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:40:57.969 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:40:57.969 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.970 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:40:57.970 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6800", 2021-11-12T05:40:57.970 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:40:57.970 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.971 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.971 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:40:57.971 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6801", 2021-11-12T05:40:57.971 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:40:57.971 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:57.972 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:57.972 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.972 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:40:57.972 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:40:57.973 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.973 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:40:57.973 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6802", 2021-11-12T05:40:57.973 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:40:57.973 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.974 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.974 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:40:57.974 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6803", 2021-11-12T05:40:57.974 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:40:57.975 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:57.975 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:57.975 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.975 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:40:57.976 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:40:57.976 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.976 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:40:57.976 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6806", 2021-11-12T05:40:57.976 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:40:57.977 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.977 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.977 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:40:57.977 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6807", 2021-11-12T05:40:57.978 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:40:57.978 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:57.978 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:57.978 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.978 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:40:57.979 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:40:57.979 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.979 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:40:57.979 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6804", 2021-11-12T05:40:57.980 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:40:57.980 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.980 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.980 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:40:57.980 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6805", 2021-11-12T05:40:57.981 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:40:57.981 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:57.981 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:57.981 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.982 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6801/15096", 2021-11-12T05:40:57.982 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6803/15096", 2021-11-12T05:40:57.982 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6807/15096", 2021-11-12T05:40:57.982 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6805/15096", 2021-11-12T05:40:57.982 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:40:57.983 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:40:57.983 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:40:57.983 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:57.983 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.984 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.984 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:40:57.984 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "68b72ab2-fa82-4b5c-bf33-528f002e4950", 2021-11-12T05:40:57.984 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:40:57.984 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:40:57.985 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:40:57.985 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:40:57.985 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:40:57.986 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:40:57.986 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:40:57.986 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 19, 2021-11-12T05:40:57.986 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:40:57.986 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:40:57.987 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:40:57.987 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:40:57.987 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.987 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:40:57.988 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6808", 2021-11-12T05:40:57.988 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:40:57.988 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.988 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.988 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:40:57.989 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6809", 2021-11-12T05:40:57.989 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:40:57.989 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:57.989 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:57.990 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.990 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:40:57.990 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:40:57.990 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.990 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:40:57.991 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6810", 2021-11-12T05:40:57.991 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:40:57.991 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.991 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.992 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:40:57.992 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6811", 2021-11-12T05:40:57.992 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:40:57.992 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:57.992 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:57.993 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.993 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:40:57.993 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:40:57.993 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.994 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:40:57.994 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6814", 2021-11-12T05:40:57.994 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:40:57.994 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.995 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.995 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:40:57.995 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6815", 2021-11-12T05:40:57.995 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:40:57.995 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:57.996 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:57.996 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.996 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:40:57.996 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:40:57.996 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.997 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:40:57.997 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6812", 2021-11-12T05:40:57.997 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:40:57.997 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.998 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:57.998 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:40:57.998 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6813", 2021-11-12T05:40:57.998 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:40:57.999 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:57.999 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:57.999 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:57.999 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6809/15097", 2021-11-12T05:40:57.999 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6811/15097", 2021-11-12T05:40:58.000 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6815/15097", 2021-11-12T05:40:58.000 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6813/15097", 2021-11-12T05:40:58.000 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:40:58.000 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:40:58.000 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:40:58.001 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:58.001 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:58.001 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:58.001 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:40:58.002 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "a2c83b5d-8d37-4d30-ac04-30d89a76e485", 2021-11-12T05:40:58.002 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:40:58.002 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:40:58.002 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:40:58.003 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:40:58.003 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:40:58.003 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:40:58.003 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:40:58.003 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 22, 2021-11-12T05:40:58.004 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:40:58.004 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:40:58.004 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:40:58.004 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:40:58.004 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:58.005 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:40:58.005 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6816", 2021-11-12T05:40:58.005 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:40:58.005 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:58.006 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:58.006 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:40:58.006 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6817", 2021-11-12T05:40:58.006 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:40:58.006 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:58.007 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:58.007 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:58.007 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:40:58.007 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:40:58.008 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:58.008 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:40:58.008 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6818", 2021-11-12T05:40:58.008 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:40:58.008 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:58.009 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:58.009 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:40:58.009 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6819", 2021-11-12T05:40:58.009 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:40:58.009 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:58.010 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:58.010 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:58.010 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:40:58.010 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:40:58.011 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:58.011 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:40:58.011 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6822", 2021-11-12T05:40:58.011 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:40:58.012 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:58.012 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:58.012 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:40:58.012 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6823", 2021-11-12T05:40:58.013 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:40:58.013 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:58.013 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:58.013 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:58.014 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:40:58.014 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:40:58.014 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:58.014 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:40:58.015 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6820", 2021-11-12T05:40:58.015 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:40:58.015 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:58.015 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:58.015 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:40:58.016 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6821", 2021-11-12T05:40:58.016 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:40:58.016 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:58.016 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:58.017 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:58.017 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6817/15098", 2021-11-12T05:40:58.017 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6819/15098", 2021-11-12T05:40:58.017 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6823/15098", 2021-11-12T05:40:58.018 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6821/15098", 2021-11-12T05:40:58.018 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:40:58.018 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:40:58.018 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:40:58.019 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:58.019 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:58.019 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:58.019 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:40:58.019 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "786ce966-d0fb-4181-aed4-c26e3ef61c43", 2021-11-12T05:40:58.020 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:40:58.020 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:40:58.020 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:40:58.020 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:40:58.021 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:40:58.021 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:40:58.021 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:40:58.021 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 17, 2021-11-12T05:40:58.021 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:40:58.022 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:40:58.022 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:40:58.022 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:40:58.022 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:58.023 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:40:58.023 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6824", 2021-11-12T05:40:58.023 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:40:58.023 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:58.023 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:58.024 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:40:58.024 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6825", 2021-11-12T05:40:58.024 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:40:58.024 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:58.024 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:58.025 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:58.025 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:40:58.025 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:40:58.025 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:58.026 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:40:58.026 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6826", 2021-11-12T05:40:58.026 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:40:58.026 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:58.027 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:58.027 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:40:58.027 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6827", 2021-11-12T05:40:58.027 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:40:58.027 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:58.028 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:58.028 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:58.028 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:40:58.028 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:40:58.029 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:58.029 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:40:58.029 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6830", 2021-11-12T05:40:58.029 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:40:58.029 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:58.030 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:58.030 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:40:58.030 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6831", 2021-11-12T05:40:58.030 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:40:58.031 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:58.031 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:58.031 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:58.031 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:40:58.032 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:40:58.032 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:58.032 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:40:58.032 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6828", 2021-11-12T05:40:58.033 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:40:58.033 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:58.033 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:58.033 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:40:58.033 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6829", 2021-11-12T05:40:58.034 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:40:58.034 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:58.034 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:58.034 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:58.035 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6825/15099", 2021-11-12T05:40:58.035 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6827/15099", 2021-11-12T05:40:58.035 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6831/15099", 2021-11-12T05:40:58.035 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6829/15099", 2021-11-12T05:40:58.035 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:40:58.036 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:40:58.036 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:40:58.036 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:40:58.036 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:58.037 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:40:58.037 INFO:teuthology.orchestra.run.gibba005.stdout: "osd_xinfo": [ 2021-11-12T05:40:58.037 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:58.037 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:40:58.038 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:40:58.038 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:40:58.038 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:40:58.038 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:40:58.039 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:40:58.039 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.615112+0000", 2021-11-12T05:40:58.039 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:40:58.039 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:58.039 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:58.040 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:40:58.040 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:40:58.040 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:40:58.040 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:40:58.041 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:40:58.041 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:40:58.041 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.665935+0000", 2021-11-12T05:40:58.041 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:40:58.041 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:58.042 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:58.042 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:40:58.042 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:40:58.042 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:40:58.043 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:40:58.043 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:40:58.043 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:40:58.043 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.715877+0000", 2021-11-12T05:40:58.043 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:40:58.044 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:58.044 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:58.044 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:40:58.044 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:40:58.045 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:40:58.045 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:40:58.045 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:40:58.045 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:40:58.045 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.489234+0000", 2021-11-12T05:40:58.046 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:40:58.046 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:58.046 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:58.046 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:40:58.046 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:40:58.047 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:40:58.047 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:40:58.047 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:40:58.047 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:40:58.048 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.413776+0000", 2021-11-12T05:40:58.048 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:40:58.048 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:58.048 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:58.048 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:40:58.049 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:40:58.049 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:40:58.049 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:40:58.049 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:40:58.050 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:40:58.050 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.507960+0000", 2021-11-12T05:40:58.050 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:40:58.050 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:58.051 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:58.051 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:40:58.051 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:40:58.051 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:40:58.052 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:40:58.052 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:40:58.052 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:40:58.052 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.635696+0000", 2021-11-12T05:40:58.052 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:40:58.053 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:58.053 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:40:58.053 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:40:58.053 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:40:58.054 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:40:58.054 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:40:58.054 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:40:58.054 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:40:58.054 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.746949+0000", 2021-11-12T05:40:58.055 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:40:58.055 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:58.055 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:40:58.055 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap": [], 2021-11-12T05:40:58.056 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap_items": [], 2021-11-12T05:40:58.056 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_temp": [], 2021-11-12T05:40:58.056 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_temp": [], 2021-11-12T05:40:58.056 INFO:teuthology.orchestra.run.gibba005.stdout: "blacklist": {}, 2021-11-12T05:40:58.056 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profiles": { 2021-11-12T05:40:58.057 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs_data": { 2021-11-12T05:40:58.057 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-device-class": "", 2021-11-12T05:40:58.057 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:40:58.057 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-root": "default", 2021-11-12T05:40:58.057 INFO:teuthology.orchestra.run.gibba005.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-12T05:40:58.058 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:40:58.058 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "2", 2021-11-12T05:40:58.058 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:40:58.058 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:40:58.058 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van", 2021-11-12T05:40:58.059 INFO:teuthology.orchestra.run.gibba005.stdout: "w": "8" 2021-11-12T05:40:58.059 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:58.059 INFO:teuthology.orchestra.run.gibba005.stdout: "default": { 2021-11-12T05:40:58.059 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:40:58.060 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:40:58.060 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "1", 2021-11-12T05:40:58.060 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:40:58.060 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:40:58.060 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van" 2021-11-12T05:40:58.061 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:40:58.061 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:40:58.061 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps_queue": [], 2021-11-12T05:40:58.061 INFO:teuthology.orchestra.run.gibba005.stdout: "new_removed_snaps": [], 2021-11-12T05:40:58.061 INFO:teuthology.orchestra.run.gibba005.stdout: "new_purged_snaps": [], 2021-11-12T05:40:58.062 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_node_flags": {}, 2021-11-12T05:40:58.062 INFO:teuthology.orchestra.run.gibba005.stdout: "device_class_flags": {} 2021-11-12T05:40:58.062 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:40:58.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.814+0000 7f6aad0e0700 1 -- 172.21.2.105:0/1860156966 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6a8c0535d0 msgr2=0x7f6a8c055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:58.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.814+0000 7f6aad0e0700 1 --2- 172.21.2.105:0/1860156966 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6a8c0535d0 0x7f6a8c055a90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f6a90002f70 tx=0x7f6a90015000).stop 2021-11-12T05:40:58.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.814+0000 7f6aad0e0700 1 -- 172.21.2.105:0/1860156966 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6aa8130860 msgr2=0x7f6aa8144af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:58.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.814+0000 7f6aad0e0700 1 --2- 172.21.2.105:0/1860156966 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6aa8130860 0x7f6aa8144af0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f6aa80af1d0 tx=0x7f6aa00013a0).stop 2021-11-12T05:40:58.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.814+0000 7f6aad0e0700 1 -- 172.21.2.105:0/1860156966 shutdown_connections 2021-11-12T05:40:58.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.814+0000 7f6aad0e0700 1 --2- 172.21.2.105:0/1860156966 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6a8c0535d0 0x7f6a8c055a90 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:58.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.814+0000 7f6aad0e0700 1 --2- 172.21.2.105:0/1860156966 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6aa8130860 0x7f6aa8144af0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:58.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.814+0000 7f6aad0e0700 1 --2- 172.21.2.105:0/1860156966 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6aa80af750 0x7f6aa8144600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:58.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.814+0000 7f6aad0e0700 1 --2- 172.21.2.105:0/1860156966 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6aa80626b0 0x7f6aa8064510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:58.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.814+0000 7f6aad0e0700 1 -- 172.21.2.105:0/1860156966 >> 172.21.2.105:0/1860156966 conn(0x7f6aa80b5320 msgr2=0x7f6aa80ae590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:58.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.814+0000 7f6aad0e0700 1 -- 172.21.2.105:0/1860156966 shutdown_connections 2021-11-12T05:40:58.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:57.814+0000 7f6aad0e0700 1 -- 172.21.2.105:0/1860156966 wait complete. 2021-11-12T05:40:58.067 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:40:58.121 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.118+0000 7fa1e2f8c700 1 Processor -- start 2021-11-12T05:40:58.121 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.118+0000 7fa1e2f8c700 1 -- start start 2021-11-12T05:40:58.122 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.118+0000 7fa1e2f8c700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fa1dc0ad080 0x7fa1dc0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:58.122 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.118+0000 7fa1e2f8c700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1dc0ac7b0 con 0x7fa1dc14b2f0 2021-11-12T05:40:58.122 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.118+0000 7fa1e2f8c700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1dc0ac9e0 con 0x7fa1dc0ac280 2021-11-12T05:40:58.122 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.118+0000 7fa1e2f8c700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1dc1488a0 con 0x7fa1dc0ad080 2021-11-12T05:40:58.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.118+0000 7fa1e1529700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fa1dc14b2f0 0x7fa1dc147a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:54276/0 (socket says 172.21.2.105:54276) 2021-11-12T05:40:58.129 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.118+0000 7fa1e1529700 1 -- 172.21.2.105:0/4274680462 learned_addr learned my addr 172.21.2.105:0/4274680462 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:58.129 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.118+0000 7fa1db7fe700 1 -- 172.21.2.105:0/4274680462 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 458216069 0 0) 0x7fa1dc0ac7b0 con 0x7fa1dc14b2f0 2021-11-12T05:40:58.129 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.118+0000 7fa1db7fe700 1 -- 172.21.2.105:0/4274680462 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1bc003260 con 0x7fa1dc14b2f0 2021-11-12T05:40:58.129 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.118+0000 7fa1e0d28700 1 --2- 172.21.2.105:0/4274680462 >> v2:172.21.2.115:3300/0 conn(0x7fa1dc0ad080 0x7fa1dc0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:58.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.118+0000 7fa1db7fe700 1 -- 172.21.2.105:0/4274680462 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2206265987 0 0) 0x7fa1bc003260 con 0x7fa1dc14b2f0 2021-11-12T05:40:58.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.118+0000 7fa1db7fe700 1 -- 172.21.2.105:0/4274680462 >> v2:172.21.2.115:3300/0 conn(0x7fa1dc0ad080 msgr2=0x7fa1dc0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:58.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.118+0000 7fa1db7fe700 1 --2- 172.21.2.105:0/4274680462 >> v2:172.21.2.115:3300/0 conn(0x7fa1dc0ad080 0x7fa1dc0af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:58.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.118+0000 7fa1db7fe700 1 -- 172.21.2.105:0/4274680462 >> v1:172.21.2.115:6789/0 conn(0x7fa1dc0ac280 legacy=0x7fa1dc14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:58.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.118+0000 7fa1db7fe700 1 -- 172.21.2.105:0/4274680462 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1dc0b0b30 con 0x7fa1dc14b2f0 2021-11-12T05:40:58.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.118+0000 7fa1db7fe700 1 -- 172.21.2.105:0/4274680462 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fa1d40019e0 con 0x7fa1dc14b2f0 2021-11-12T05:40:58.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.118+0000 7fa1db7fe700 1 -- 172.21.2.105:0/4274680462 >> v1:172.21.2.105:6789/0 conn(0x7fa1dc14b2f0 legacy=0x7fa1dc147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:58.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.118+0000 7fa1db7fe700 1 --2- 172.21.2.105:0/4274680462 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1bc003820 0x7fa1bc003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:58.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.118+0000 7fa1db7fe700 1 --2- 172.21.2.105:0/4274680462 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1bc004500 0x7fa1bc004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:58.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.118+0000 7fa1db7fe700 1 --2- 172.21.2.105:0/4274680462 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa1bc005050 0x7fa1bc00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:58.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.118+0000 7fa1db7fe700 1 -- 172.21.2.105:0/4274680462 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc1488a0 con 0x7fa1bc004500 2021-11-12T05:40:58.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.118+0000 7fa1db7fe700 1 -- 172.21.2.105:0/4274680462 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc00bf40 con 0x7fa1bc005050 2021-11-12T05:40:58.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.118+0000 7fa1db7fe700 1 -- 172.21.2.105:0/4274680462 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc00c100 con 0x7fa1bc003820 2021-11-12T05:40:58.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.118+0000 7fa1e0d28700 1 --2- 172.21.2.105:0/4274680462 >> v2:172.21.2.115:3300/0 conn(0x7fa1dc0ad080 0x7fa1dc0af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:40:58.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.118+0000 7fa1dbfff700 1 --2- 172.21.2.105:0/4274680462 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1bc004500 0x7fa1bc004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:58.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1dbfff700 1 -- 172.21.2.105:0/4274680462 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1bc003820 msgr2=0x7fa1bc003c20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:40:58.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1dbfff700 1 --2- 172.21.2.105:0/4274680462 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1bc003820 0x7fa1bc003c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:58.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1dbfff700 1 -- 172.21.2.105:0/4274680462 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa1bc005050 msgr2=0x7fa1bc00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:58.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1dbfff700 1 --2- 172.21.2.105:0/4274680462 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa1bc005050 0x7fa1bc00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:58.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1e1529700 1 -- 172.21.2.105:0/4274680462 reap_dead start 2021-11-12T05:40:58.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1dbfff700 1 -- 172.21.2.105:0/4274680462 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1bc003260 con 0x7fa1bc004500 2021-11-12T05:40:58.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1dbfff700 1 --2- 172.21.2.105:0/4274680462 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1bc004500 0x7fa1bc004980 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7fa1cc000f70 tx=0x7fa1cc0079e0).ready entity=mon.0 client_cookie=339d2704d6658eb0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:58.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1db7fe700 1 -- 172.21.2.105:0/4274680462 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1cc007cf0 con 0x7fa1bc004500 2021-11-12T05:40:58.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1db7fe700 1 -- 172.21.2.105:0/4274680462 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1cc014410 con 0x7fa1bc004500 2021-11-12T05:40:58.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1db7fe700 1 -- 172.21.2.105:0/4274680462 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1cc014770 con 0x7fa1bc004500 2021-11-12T05:40:58.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1e2f8c700 1 -- 172.21.2.105:0/4274680462 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1bc004500 msgr2=0x7fa1bc004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:58.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1e2f8c700 1 --2- 172.21.2.105:0/4274680462 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1bc004500 0x7fa1bc004980 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7fa1cc000f70 tx=0x7fa1cc0079e0).stop 2021-11-12T05:40:58.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1e2f8c700 1 -- 172.21.2.105:0/4274680462 shutdown_connections 2021-11-12T05:40:58.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1e2f8c700 1 --2- 172.21.2.105:0/4274680462 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1bc004500 0x7fa1bc004980 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:58.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1e2f8c700 1 -- 172.21.2.105:0/4274680462 >> 172.21.2.105:0/4274680462 conn(0x7fa1dc0b5370 msgr2=0x7fa1dc0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:58.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1e2f8c700 1 -- 172.21.2.105:0/4274680462 shutdown_connections 2021-11-12T05:40:58.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1e2f8c700 1 -- 172.21.2.105:0/4274680462 wait complete. 2021-11-12T05:40:58.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1e2f8c700 1 Processor -- start 2021-11-12T05:40:58.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1e2f8c700 1 -- start start 2021-11-12T05:40:58.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1e2f8c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1bc004500 0x7fa1dc0ab1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:58.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1e2f8c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1dc0ab810 0x7fa1dc0a7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:58.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1e2f8c700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa1dc0aa800 0x7fa1dc0a7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:58.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1e2f8c700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc157d10 con 0x7fa1dc0ab810 2021-11-12T05:40:58.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1e2f8c700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc157a70 con 0x7fa1dc0aa800 2021-11-12T05:40:58.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1e2f8c700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc0a9540 con 0x7fa1bc004500 2021-11-12T05:40:58.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1dbfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1dc0ab810 0x7fa1dc0a7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:58.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1dbfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1dc0ab810 0x7fa1dc0a7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43894/0 (socket says 172.21.2.105:43894) 2021-11-12T05:40:58.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1dbfff700 1 -- 172.21.2.105:0/1461659707 learned_addr learned my addr 172.21.2.105:0/1461659707 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:58.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1dbfff700 1 -- 172.21.2.105:0/1461659707 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1bc004500 msgr2=0x7fa1dc0ab1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:58.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1dbfff700 1 --2- 172.21.2.105:0/1461659707 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1bc004500 0x7fa1dc0ab1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:58.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1dbfff700 1 -- 172.21.2.105:0/1461659707 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa1dc0aa800 msgr2=0x7fa1dc0a7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:58.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1dbfff700 1 --2- 172.21.2.105:0/1461659707 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa1dc0aa800 0x7fa1dc0a7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:58.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1dbfff700 1 -- 172.21.2.105:0/1461659707 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1dc157790 con 0x7fa1dc0ab810 2021-11-12T05:40:58.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1dbfff700 1 --2- 172.21.2.105:0/1461659707 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1dc0ab810 0x7fa1dc0a7020 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7fa1cc000f70 tx=0x7fa1cc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:58.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1d9ffb700 1 -- 172.21.2.105:0/1461659707 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1cc0138c0 con 0x7fa1dc0ab810 2021-11-12T05:40:58.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1d9ffb700 1 -- 172.21.2.105:0/1461659707 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1cc013a20 con 0x7fa1dc0ab810 2021-11-12T05:40:58.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1e2f8c700 1 -- 172.21.2.105:0/1461659707 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1dc0a99e0 con 0x7fa1dc0ab810 2021-11-12T05:40:58.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1d9ffb700 1 -- 172.21.2.105:0/1461659707 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1cc013da0 con 0x7fa1dc0ab810 2021-11-12T05:40:58.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1e2f8c700 1 -- 172.21.2.105:0/1461659707 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1dc0a7ba0 con 0x7fa1dc0ab810 2021-11-12T05:40:58.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.122+0000 7fa1e2f8c700 1 -- 172.21.2.105:0/1461659707 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1dc0b1440 con 0x7fa1dc0ab810 2021-11-12T05:40:58.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.126+0000 7fa1d9ffb700 1 -- 172.21.2.105:0/1461659707 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa1cc022470 con 0x7fa1dc0ab810 2021-11-12T05:40:58.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.126+0000 7fa1d9ffb700 1 --2- 172.21.2.105:0/1461659707 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa1c00534f0 0x7fa1c00559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:58.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.126+0000 7fa1d9ffb700 1 -- 172.21.2.105:0/1461659707 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fa1cc01c040 con 0x7fa1dc0ab810 2021-11-12T05:40:58.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.126+0000 7fa1e0d28700 1 --2- 172.21.2.105:0/1461659707 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa1c00534f0 0x7fa1c00559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:58.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.126+0000 7fa1e0d28700 1 --2- 172.21.2.105:0/1461659707 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa1c00534f0 0x7fa1c00559b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fa1c4007000 tx=0x7fa1c4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:58.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.126+0000 7fa1d9ffb700 1 -- 172.21.2.105:0/1461659707 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa1cc043d10 con 0x7fa1dc0ab810 2021-11-12T05:40:58.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.234+0000 7fa1e2f8c700 1 -- 172.21.2.105:0/1461659707 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1dc057350 con 0x7fa1dc0ab810 2021-11-12T05:40:58.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.234+0000 7fa1d9ffb700 1 -- 172.21.2.105:0/1461659707 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2134 (secure 0 0 0) 0x7fa1cc027030 con 0x7fa1dc0ab810 2021-11-12T05:40:58.237 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:40:58.238 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4222,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/3123627686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":3123627686},{"type":"v1","addr":"172.21.2.115:6833","nonce":3123627686}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:40:37.198589+0000","modified":"2021-11-12T05:40:38.201943+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/2223420138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":2223420138},{"type":"v1","addr":"172.21.2.105:6835","nonce":2223420138}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-11-12T05:40:58.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.234+0000 7fa1e2f8c700 1 -- 172.21.2.105:0/1461659707 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa1c00534f0 msgr2=0x7fa1c00559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:58.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.234+0000 7fa1e2f8c700 1 --2- 172.21.2.105:0/1461659707 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa1c00534f0 0x7fa1c00559b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fa1c4007000 tx=0x7fa1c4008040).stop 2021-11-12T05:40:58.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.234+0000 7fa1e2f8c700 1 -- 172.21.2.105:0/1461659707 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1dc0ab810 msgr2=0x7fa1dc0a7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:58.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.234+0000 7fa1e2f8c700 1 --2- 172.21.2.105:0/1461659707 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1dc0ab810 0x7fa1dc0a7020 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7fa1cc000f70 tx=0x7fa1cc015000).stop 2021-11-12T05:40:58.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.234+0000 7fa1e2f8c700 1 -- 172.21.2.105:0/1461659707 shutdown_connections 2021-11-12T05:40:58.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.234+0000 7fa1e2f8c700 1 --2- 172.21.2.105:0/1461659707 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa1c00534f0 0x7fa1c00559b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:58.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.234+0000 7fa1e2f8c700 1 --2- 172.21.2.105:0/1461659707 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa1dc0aa800 0x7fa1dc0a7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:58.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.234+0000 7fa1e2f8c700 1 --2- 172.21.2.105:0/1461659707 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1dc0ab810 0x7fa1dc0a7020 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:58.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.234+0000 7fa1e2f8c700 1 --2- 172.21.2.105:0/1461659707 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1bc004500 0x7fa1dc0ab1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:58.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.234+0000 7fa1e2f8c700 1 -- 172.21.2.105:0/1461659707 >> 172.21.2.105:0/1461659707 conn(0x7fa1dc0b5370 msgr2=0x7fa1dc14aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:58.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.234+0000 7fa1e2f8c700 1 -- 172.21.2.105:0/1461659707 shutdown_connections 2021-11-12T05:40:58.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.234+0000 7fa1e2f8c700 1 -- 172.21.2.105:0/1461659707 wait complete. 2021-11-12T05:40:58.242 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 5 2021-11-12T05:40:58.244 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-12T05:40:58.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f189142a700 1 Processor -- start 2021-11-12T05:40:58.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f189142a700 1 -- start start 2021-11-12T05:40:58.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f189142a700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f188c0b6380 0x7f188c0b6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:58.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f189142a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f188c142900 0x7f188c13f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:58.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f189142a700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f188c1390a0 0x7f188c1394f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:58.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f189142a700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f188c13fab0 con 0x7f188c0b6380 2021-11-12T05:40:58.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f189142a700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f188c13fd50 con 0x7f188c1390a0 2021-11-12T05:40:58.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f189142a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f188c13fff0 con 0x7f188c142900 2021-11-12T05:40:58.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f188affd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f188c0b6380 0x7f188c0b6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:58.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f188affd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f188c0b6380 0x7f188c0b6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43902/0 (socket says 172.21.2.105:43902) 2021-11-12T05:40:58.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f188affd700 1 -- 172.21.2.105:0/1538937286 learned_addr learned my addr 172.21.2.105:0/1538937286 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:58.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f188affd700 1 -- 172.21.2.105:0/1538937286 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f188c142900 msgr2=0x7f188c13f300 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:40:58.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f188affd700 1 --2- 172.21.2.105:0/1538937286 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f188c142900 0x7f188c13f300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:58.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f188affd700 1 -- 172.21.2.105:0/1538937286 >> v2:172.21.2.115:3300/0 conn(0x7f188c1390a0 msgr2=0x7f188c1394f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:40:58.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f188affd700 1 --2- 172.21.2.105:0/1538937286 >> v2:172.21.2.115:3300/0 conn(0x7f188c1390a0 0x7f188c1394f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:58.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f188affd700 1 -- 172.21.2.105:0/1538937286 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f188c13f7f0 con 0x7f188c0b6380 2021-11-12T05:40:58.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f188affd700 1 --2- 172.21.2.105:0/1538937286 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f188c0b6380 0x7f188c0b6760 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f1880002f70 tx=0x7f1880006e40).ready entity=mon.0 client_cookie=bf612cda8c0dd9ce server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:58.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f1889ffb700 1 -- 172.21.2.105:0/1538937286 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f188000bb00 con 0x7f188c0b6380 2021-11-12T05:40:58.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f1889ffb700 1 -- 172.21.2.105:0/1538937286 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1880000e90 con 0x7f188c0b6380 2021-11-12T05:40:58.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f1889ffb700 1 -- 172.21.2.105:0/1538937286 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f188000be90 con 0x7f188c0b6380 2021-11-12T05:40:58.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f189142a700 1 -- 172.21.2.105:0/1538937286 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f188c0b6380 msgr2=0x7f188c0b6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:58.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f189142a700 1 --2- 172.21.2.105:0/1538937286 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f188c0b6380 0x7f188c0b6760 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f1880002f70 tx=0x7f1880006e40).stop 2021-11-12T05:40:58.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f189142a700 1 -- 172.21.2.105:0/1538937286 shutdown_connections 2021-11-12T05:40:58.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f189142a700 1 --2- 172.21.2.105:0/1538937286 >> v2:172.21.2.115:3300/0 conn(0x7f188c1390a0 0x7f188c1394f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:58.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f189142a700 1 --2- 172.21.2.105:0/1538937286 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f188c142900 0x7f188c13f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:58.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f189142a700 1 --2- 172.21.2.105:0/1538937286 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f188c0b6380 0x7f188c0b6760 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:58.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f189142a700 1 -- 172.21.2.105:0/1538937286 >> 172.21.2.105:0/1538937286 conn(0x7f188c063810 msgr2=0x7f188c0b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:58.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f189142a700 1 -- 172.21.2.105:0/1538937286 shutdown_connections 2021-11-12T05:40:58.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f189142a700 1 -- 172.21.2.105:0/1538937286 wait complete. 2021-11-12T05:40:58.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f189142a700 1 Processor -- start 2021-11-12T05:40:58.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f189142a700 1 -- start start 2021-11-12T05:40:58.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f189142a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f188c0b6380 0x7f188c0603c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:58.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f189142a700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f188c1390a0 0x7f188c064220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:58.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f189142a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f188c142900 0x7f188c0651e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:58.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f189142a700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188c0649a0 con 0x7f188c0b6380 2021-11-12T05:40:58.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f189142a700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188c064b80 con 0x7f188c1390a0 2021-11-12T05:40:58.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f189142a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f188c064e20 con 0x7f188c142900 2021-11-12T05:40:58.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f188affd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f188c0b6380 0x7f188c0603c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:58.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f188affd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f188c0b6380 0x7f188c0603c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43908/0 (socket says 172.21.2.105:43908) 2021-11-12T05:40:58.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f188affd700 1 -- 172.21.2.105:0/1152646272 learned_addr learned my addr 172.21.2.105:0/1152646272 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:58.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f188affd700 1 -- 172.21.2.105:0/1152646272 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f188c142900 msgr2=0x7f188c0651e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:58.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f188affd700 1 --2- 172.21.2.105:0/1152646272 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f188c142900 0x7f188c0651e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:58.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f188affd700 1 -- 172.21.2.105:0/1152646272 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f188c1390a0 msgr2=0x7f188c064220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:58.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f188affd700 1 --2- 172.21.2.105:0/1152646272 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f188c1390a0 0x7f188c064220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:58.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f188affd700 1 -- 172.21.2.105:0/1152646272 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f188000d4d0 con 0x7f188c0b6380 2021-11-12T05:40:58.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f188affd700 1 --2- 172.21.2.105:0/1152646272 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f188c0b6380 0x7f188c0603c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f1880006fc0 tx=0x7f1880006e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:58.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f187bfff700 1 -- 172.21.2.105:0/1152646272 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1880020070 con 0x7f188c0b6380 2021-11-12T05:40:58.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.294+0000 7f187bfff700 1 -- 172.21.2.105:0/1152646272 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1880025460 con 0x7f188c0b6380 2021-11-12T05:40:58.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.298+0000 7f189142a700 1 -- 172.21.2.105:0/1152646272 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f188c064710 con 0x7f188c0b6380 2021-11-12T05:40:58.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.298+0000 7f187bfff700 1 -- 172.21.2.105:0/1152646272 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18800257c0 con 0x7f188c0b6380 2021-11-12T05:40:58.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.298+0000 7f189142a700 1 -- 172.21.2.105:0/1152646272 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f188c139a40 con 0x7f188c0b6380 2021-11-12T05:40:58.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.298+0000 7f189142a700 1 -- 172.21.2.105:0/1152646272 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f188c064fe0 con 0x7f188c0b6380 2021-11-12T05:40:58.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.298+0000 7f187bfff700 1 -- 172.21.2.105:0/1152646272 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1880025920 con 0x7f188c0b6380 2021-11-12T05:40:58.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.298+0000 7f187bfff700 1 --2- 172.21.2.105:0/1152646272 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f18680536a0 0x7f1868055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:58.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.298+0000 7f187bfff700 1 -- 172.21.2.105:0/1152646272 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f1880071340 con 0x7f188c0b6380 2021-11-12T05:40:58.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.298+0000 7f188a7fc700 1 --2- 172.21.2.105:0/1152646272 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f18680536a0 0x7f1868055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:58.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.298+0000 7f188a7fc700 1 --2- 172.21.2.105:0/1152646272 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f18680536a0 0x7f1868055b60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f1884001250 tx=0x7f1884006cb0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:58.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.298+0000 7f187bfff700 1 -- 172.21.2.105:0/1152646272 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1880048340 con 0x7f188c0b6380 2021-11-12T05:40:58.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:58.410+0000 7f189142a700 1 -- 172.21.2.105:0/1152646272 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f188c057350 con 0x7f188c0b6380 2021-11-12T05:40:58.994 INFO:tasks.ceph.mon.a.gibba005.stderr:2021-11-12T05:40:58.990+0000 7fe9772b2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-12T05:40:59.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.006+0000 7f187bfff700 1 -- 172.21.2.105:0/1152646272 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v6) v1 ==== 161+0+0 (secure 0 0 0) 0x7f188004b960 con 0x7f188c0b6380 2021-11-12T05:40:59.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.006+0000 7f189142a700 1 -- 172.21.2.105:0/1152646272 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f18680536a0 msgr2=0x7f1868055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:59.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.006+0000 7f189142a700 1 --2- 172.21.2.105:0/1152646272 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f18680536a0 0x7f1868055b60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f1884001250 tx=0x7f1884006cb0).stop 2021-11-12T05:40:59.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.006+0000 7f189142a700 1 -- 172.21.2.105:0/1152646272 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f188c0b6380 msgr2=0x7f188c0603c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:59.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.006+0000 7f189142a700 1 --2- 172.21.2.105:0/1152646272 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f188c0b6380 0x7f188c0603c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f1880006fc0 tx=0x7f1880006e40).stop 2021-11-12T05:40:59.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.006+0000 7f189142a700 1 -- 172.21.2.105:0/1152646272 shutdown_connections 2021-11-12T05:40:59.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.006+0000 7f189142a700 1 --2- 172.21.2.105:0/1152646272 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f18680536a0 0x7f1868055b60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:59.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.006+0000 7f189142a700 1 --2- 172.21.2.105:0/1152646272 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f188c142900 0x7f188c0651e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:59.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.006+0000 7f189142a700 1 --2- 172.21.2.105:0/1152646272 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f188c1390a0 0x7f188c064220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:59.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.006+0000 7f189142a700 1 --2- 172.21.2.105:0/1152646272 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f188c0b6380 0x7f188c0603c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:59.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.006+0000 7f189142a700 1 -- 172.21.2.105:0/1152646272 >> 172.21.2.105:0/1152646272 conn(0x7f188c063810 msgr2=0x7f188c0afc50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:59.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.006+0000 7f189142a700 1 -- 172.21.2.105:0/1152646272 shutdown_connections 2021-11-12T05:40:59.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.006+0000 7f189142a700 1 -- 172.21.2.105:0/1152646272 wait complete. 2021-11-12T05:40:59.011 INFO:teuthology.orchestra.run.gibba005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-12T05:40:59.015 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:40:59.019 INFO:tasks.ceph.mds.a.gibba005.stdout:starting mds.a at 2021-11-12T05:40:59.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.062+0000 7f91db420700 1 Processor -- start 2021-11-12T05:40:59.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.062+0000 7f91db420700 1 -- start start 2021-11-12T05:40:59.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91db420700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f91d40ad080 0x7f91d40af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:59.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91db420700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f91d40ac280 0x7f91d40ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:59.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91db420700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f91d414abe0 0x7f91d414b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:59.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91db420700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91d41488a0 con 0x7f91d40ad080 2021-11-12T05:40:59.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91db420700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91d40ac7b0 con 0x7f91d414abe0 2021-11-12T05:40:59.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91db420700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d40ac9e0 con 0x7f91d40ac280 2021-11-12T05:40:59.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91d91bc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f91d40ad080 0x7f91d40af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:59.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91d91bc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f91d40ad080 0x7f91d40af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43924/0 (socket says 172.21.2.105:43924) 2021-11-12T05:40:59.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91d91bc700 1 -- 172.21.2.105:0/2839458191 learned_addr learned my addr 172.21.2.105:0/2839458191 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:59.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91d91bc700 1 -- 172.21.2.105:0/2839458191 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f91d40ac280 msgr2=0x7f91d40ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:59.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91d91bc700 1 --2- 172.21.2.105:0/2839458191 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f91d40ac280 0x7f91d40ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:59.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91d91bc700 1 -- 172.21.2.105:0/2839458191 >> v2:172.21.2.115:3300/0 conn(0x7f91d414abe0 msgr2=0x7f91d414b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:59.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91d91bc700 1 --2- 172.21.2.105:0/2839458191 >> v2:172.21.2.115:3300/0 conn(0x7f91d414abe0 0x7f91d414b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:59.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91d91bc700 1 -- 172.21.2.105:0/2839458191 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d40b0b30 con 0x7f91d40ad080 2021-11-12T05:40:59.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91d91bc700 1 --2- 172.21.2.105:0/2839458191 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f91d40ad080 0x7f91d40af730 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f91d40ac6a0 tx=0x7f91c8006eb0).ready entity=mon.0 client_cookie=84e8a69d788515e7 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:59.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91c7fff700 1 -- 172.21.2.105:0/2839458191 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91c800d570 con 0x7f91d40ad080 2021-11-12T05:40:59.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91c7fff700 1 -- 172.21.2.105:0/2839458191 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c8000e90 con 0x7f91d40ad080 2021-11-12T05:40:59.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91c7fff700 1 -- 172.21.2.105:0/2839458191 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91c800d8c0 con 0x7f91d40ad080 2021-11-12T05:40:59.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91db420700 1 -- 172.21.2.105:0/2839458191 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f91d40ad080 msgr2=0x7f91d40af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:59.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91db420700 1 --2- 172.21.2.105:0/2839458191 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f91d40ad080 0x7f91d40af730 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f91d40ac6a0 tx=0x7f91c8006eb0).stop 2021-11-12T05:40:59.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91db420700 1 -- 172.21.2.105:0/2839458191 shutdown_connections 2021-11-12T05:40:59.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91db420700 1 --2- 172.21.2.105:0/2839458191 >> v2:172.21.2.115:3300/0 conn(0x7f91d414abe0 0x7f91d414b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:59.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91db420700 1 --2- 172.21.2.105:0/2839458191 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f91d40ac280 0x7f91d40ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:59.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91db420700 1 --2- 172.21.2.105:0/2839458191 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f91d40ad080 0x7f91d40af730 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:59.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91db420700 1 -- 172.21.2.105:0/2839458191 >> 172.21.2.105:0/2839458191 conn(0x7f91d40b5370 msgr2=0x7f91d40b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:59.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91db420700 1 -- 172.21.2.105:0/2839458191 shutdown_connections 2021-11-12T05:40:59.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91db420700 1 -- 172.21.2.105:0/2839458191 wait complete. 2021-11-12T05:40:59.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91db420700 1 Processor -- start 2021-11-12T05:40:59.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91db420700 1 -- start start 2021-11-12T05:40:59.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91db420700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f91d40ac280 0x7f91d40b4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:59.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91db420700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f91d40ad080 0x7f91d4156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:59.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91db420700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f91d414abe0 0x7f91d40aad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:59.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91db420700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d4063240 con 0x7f91d40ad080 2021-11-12T05:40:59.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91db420700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d41570e0 con 0x7f91d40ac280 2021-11-12T05:40:59.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91db420700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d40a9260 con 0x7f91d414abe0 2021-11-12T05:40:59.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91d89bb700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f91d40ad080 0x7f91d4156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:59.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91d89bb700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f91d40ad080 0x7f91d4156bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43930/0 (socket says 172.21.2.105:43930) 2021-11-12T05:40:59.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91d89bb700 1 -- 172.21.2.105:0/3776532130 learned_addr learned my addr 172.21.2.105:0/3776532130 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:59.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91d89bb700 1 -- 172.21.2.105:0/3776532130 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f91d414abe0 msgr2=0x7f91d40aad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:59.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91d89bb700 1 --2- 172.21.2.105:0/3776532130 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f91d414abe0 0x7f91d40aad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:59.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91d89bb700 1 -- 172.21.2.105:0/3776532130 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f91d40ac280 msgr2=0x7f91d40b4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:59.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91d89bb700 1 --2- 172.21.2.105:0/3776532130 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f91d40ac280 0x7f91d40b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:59.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91d89bb700 1 -- 172.21.2.105:0/3776532130 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c800b1e0 con 0x7f91d40ad080 2021-11-12T05:40:59.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91d89bb700 1 --2- 172.21.2.105:0/3776532130 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f91d40ad080 0x7f91d4156bf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f91d0002f70 tx=0x7f91d0006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:59.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91c67fc700 1 -- 172.21.2.105:0/3776532130 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91d0013460 con 0x7f91d40ad080 2021-11-12T05:40:59.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.066+0000 7f91c67fc700 1 -- 172.21.2.105:0/3776532130 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d00135c0 con 0x7f91d40ad080 2021-11-12T05:40:59.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.070+0000 7f91db420700 1 -- 172.21.2.105:0/3776532130 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91d40a9500 con 0x7f91d40ad080 2021-11-12T05:40:59.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.070+0000 7f91c67fc700 1 -- 172.21.2.105:0/3776532130 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91d0013920 con 0x7f91d40ad080 2021-11-12T05:40:59.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.070+0000 7f91db420700 1 -- 172.21.2.105:0/3776532130 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91d40a7690 con 0x7f91d40ad080 2021-11-12T05:40:59.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.070+0000 7f91db420700 1 -- 172.21.2.105:0/3776532130 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91d414b580 con 0x7f91d40ad080 2021-11-12T05:40:59.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.070+0000 7f91c67fc700 1 -- 172.21.2.105:0/3776532130 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f91d001a060 con 0x7f91d40ad080 2021-11-12T05:40:59.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.070+0000 7f91c67fc700 1 --2- 172.21.2.105:0/3776532130 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f91b40536a0 0x7f91b4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:59.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.070+0000 7f91c67fc700 1 -- 172.21.2.105:0/3776532130 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6513+0+0 (secure 0 0 0) 0x7f91d006b510 con 0x7f91d40ad080 2021-11-12T05:40:59.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.070+0000 7f91d91bc700 1 --2- 172.21.2.105:0/3776532130 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f91b40536a0 0x7f91b4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:59.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.070+0000 7f91d91bc700 1 --2- 172.21.2.105:0/3776532130 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f91b40536a0 0x7f91b4055b60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f91d40ac6a0 tx=0x7f91c8015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:59.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.070+0000 7f91c67fc700 1 -- 172.21.2.105:0/3776532130 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f91d00424b0 con 0x7f91d40ad080 2021-11-12T05:40:59.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.182+0000 7f91db420700 1 -- 172.21.2.105:0/3776532130 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91d4057350 con 0x7f91d40ad080 2021-11-12T05:40:59.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.182+0000 7f91c67fc700 1 -- 172.21.2.105:0/3776532130 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+1774 (secure 0 0 0) 0x7f91d0045ad0 con 0x7f91d40ad080 2021-11-12T05:40:59.185 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:40:59.185 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4222,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/3123627686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":3123627686},{"type":"v1","addr":"172.21.2.115:6833","nonce":3123627686}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:40:37.198589+0000","modified":"2021-11-12T05:40:58.994552+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":26,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-11-12T05:40:59.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.182+0000 7f91db420700 1 -- 172.21.2.105:0/3776532130 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f91b40536a0 msgr2=0x7f91b4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:59.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.182+0000 7f91db420700 1 --2- 172.21.2.105:0/3776532130 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f91b40536a0 0x7f91b4055b60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f91d40ac6a0 tx=0x7f91c8015000).stop 2021-11-12T05:40:59.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.182+0000 7f91db420700 1 -- 172.21.2.105:0/3776532130 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f91d40ad080 msgr2=0x7f91d4156bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:59.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.182+0000 7f91db420700 1 --2- 172.21.2.105:0/3776532130 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f91d40ad080 0x7f91d4156bf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f91d0002f70 tx=0x7f91d0006ec0).stop 2021-11-12T05:40:59.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.182+0000 7f91db420700 1 -- 172.21.2.105:0/3776532130 shutdown_connections 2021-11-12T05:40:59.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.182+0000 7f91db420700 1 --2- 172.21.2.105:0/3776532130 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f91b40536a0 0x7f91b4055b60 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:59.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.182+0000 7f91db420700 1 --2- 172.21.2.105:0/3776532130 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f91d414abe0 0x7f91d40aad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:59.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.182+0000 7f91db420700 1 --2- 172.21.2.105:0/3776532130 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f91d40ad080 0x7f91d4156bf0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:59.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.182+0000 7f91db420700 1 --2- 172.21.2.105:0/3776532130 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f91d40ac280 0x7f91d40b4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:40:59.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.182+0000 7f91db420700 1 -- 172.21.2.105:0/3776532130 >> 172.21.2.105:0/3776532130 conn(0x7f91d40b5370 msgr2=0x7f91d4143c60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:59.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.182+0000 7f91db420700 1 -- 172.21.2.105:0/3776532130 shutdown_connections 2021-11-12T05:40:59.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.182+0000 7f91db420700 1 -- 172.21.2.105:0/3776532130 wait complete. 2021-11-12T05:40:59.189 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 6 2021-11-12T05:40:59.191 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-12T05:40:59.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.238+0000 7fa04d5c3700 1 Processor -- start 2021-11-12T05:40:59.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.238+0000 7fa04d5c3700 1 -- start start 2021-11-12T05:40:59.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa04d5c3700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa0480b2cc0 0x7fa0480b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:59.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa04d5c3700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0480aa0b0 con 0x7fa0480b2290 2021-11-12T05:40:59.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa04d5c3700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0480a9b70 con 0x7fa048143da0 2021-11-12T05:40:59.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa04d5c3700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0480a9e10 con 0x7fa0480b2cc0 2021-11-12T05:40:59.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa0467fc700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fa0480b2290 0x7fa048143690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:54332/0 (socket says 172.21.2.105:54332) 2021-11-12T05:40:59.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa0467fc700 1 -- 172.21.2.105:0/4256547288 learned_addr learned my addr 172.21.2.105:0/4256547288 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:40:59.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa045ffb700 1 -- 172.21.2.105:0/4256547288 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 772932973 0 0) 0x7fa0480aa0b0 con 0x7fa0480b2290 2021-11-12T05:40:59.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa045ffb700 1 -- 172.21.2.105:0/4256547288 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa028003260 con 0x7fa0480b2290 2021-11-12T05:40:59.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa046ffd700 1 --2- 172.21.2.105:0/4256547288 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa0480b2cc0 0x7fa0480b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:59.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa045ffb700 1 -- 172.21.2.105:0/4256547288 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1098670114 0 0) 0x7fa028003260 con 0x7fa0480b2290 2021-11-12T05:40:59.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa045ffb700 1 -- 172.21.2.105:0/4256547288 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa0480b2cc0 msgr2=0x7fa0480b30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:59.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa045ffb700 1 --2- 172.21.2.105:0/4256547288 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa0480b2cc0 0x7fa0480b30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:59.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa045ffb700 1 -- 172.21.2.105:0/4256547288 >> v1:172.21.2.115:6789/0 conn(0x7fa048143da0 legacy=0x7fa048140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:59.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa045ffb700 1 -- 172.21.2.105:0/4256547288 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0480b0800 con 0x7fa0480b2290 2021-11-12T05:40:59.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa045ffb700 1 -- 172.21.2.105:0/4256547288 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fa030001660 con 0x7fa0480b2290 2021-11-12T05:40:59.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa045ffb700 1 -- 172.21.2.105:0/4256547288 >> v1:172.21.2.105:6789/0 conn(0x7fa0480b2290 legacy=0x7fa048143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:59.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa045ffb700 1 --2- 172.21.2.105:0/4256547288 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa028003780 0x7fa028003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:59.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa045ffb700 1 --2- 172.21.2.105:0/4256547288 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa028004500 0x7fa028004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:59.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa045ffb700 1 --2- 172.21.2.105:0/4256547288 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa028004f90 0x7fa02800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:59.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa045ffb700 1 -- 172.21.2.105:0/4256547288 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0480a9e10 con 0x7fa028004f90 2021-11-12T05:40:59.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa045ffb700 1 -- 172.21.2.105:0/4256547288 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02800bdd0 con 0x7fa028003780 2021-11-12T05:40:59.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa045ffb700 1 -- 172.21.2.105:0/4256547288 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa02800bf90 con 0x7fa028004500 2021-11-12T05:40:59.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa046ffd700 1 --2- 172.21.2.105:0/4256547288 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa0480b2cc0 0x7fa0480b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:40:59.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa0477fe700 1 --2- 172.21.2.105:0/4256547288 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa028004f90 0x7fa02800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:59.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa0467fc700 1 --2- 172.21.2.105:0/4256547288 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa028004500 0x7fa028004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:59.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa046ffd700 1 --2- 172.21.2.105:0/4256547288 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa028003780 0x7fa028003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:59.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa0477fe700 1 -- 172.21.2.105:0/4256547288 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa028004500 msgr2=0x7fa028004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:59.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa0477fe700 1 --2- 172.21.2.105:0/4256547288 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa028004500 0x7fa028004980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:59.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa0477fe700 1 -- 172.21.2.105:0/4256547288 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa028003780 msgr2=0x7fa028003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:40:59.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa0477fe700 1 --2- 172.21.2.105:0/4256547288 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa028003780 0x7fa028003b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:59.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa0477fe700 1 -- 172.21.2.105:0/4256547288 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa028003260 con 0x7fa028004f90 2021-11-12T05:40:59.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa0477fe700 1 --2- 172.21.2.105:0/4256547288 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa028004f90 0x7fa02800b750 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fa040002320 tx=0x7fa040007d80).ready entity=mon.0 client_cookie=5f52d6daf1e71ea server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:59.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa045ffb700 1 -- 172.21.2.105:0/4256547288 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa040006890 con 0x7fa028004f90 2021-11-12T05:40:59.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa045ffb700 1 -- 172.21.2.105:0/4256547288 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0400069f0 con 0x7fa028004f90 2021-11-12T05:40:59.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa045ffb700 1 -- 172.21.2.105:0/4256547288 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa040006d50 con 0x7fa028004f90 2021-11-12T05:40:59.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa04d5c3700 1 -- 172.21.2.105:0/4256547288 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa028004f90 msgr2=0x7fa02800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:59.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa04d5c3700 1 --2- 172.21.2.105:0/4256547288 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa028004f90 0x7fa02800b750 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fa040002320 tx=0x7fa040007d80).stop 2021-11-12T05:40:59.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa0477fe700 1 -- 172.21.2.105:0/4256547288 reap_dead start 2021-11-12T05:40:59.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa04d5c3700 1 -- 172.21.2.105:0/4256547288 shutdown_connections 2021-11-12T05:40:59.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa04d5c3700 1 -- 172.21.2.105:0/4256547288 >> 172.21.2.105:0/4256547288 conn(0x7fa04805c490 msgr2=0x7fa04805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:40:59.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa04d5c3700 1 -- 172.21.2.105:0/4256547288 shutdown_connections 2021-11-12T05:40:59.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa04d5c3700 1 -- 172.21.2.105:0/4256547288 wait complete. 2021-11-12T05:40:59.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa04d5c3700 1 Processor -- start 2021-11-12T05:40:59.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.242+0000 7fa04d5c3700 1 -- start start 2021-11-12T05:40:59.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.246+0000 7fa04d5c3700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa048066950 0x7fa0480aa280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:59.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.246+0000 7fa04d5c3700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa0480ace20 0x7fa0480645f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:59.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.246+0000 7fa04d5c3700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa048064ae0 0x7fa0481328c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:59.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.246+0000 7fa04d5c3700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa048065b40 con 0x7fa048064ae0 2021-11-12T05:40:59.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.246+0000 7fa04d5c3700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0480acad0 con 0x7fa048066950 2021-11-12T05:40:59.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.246+0000 7fa04d5c3700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa04813afe0 con 0x7fa0480ace20 2021-11-12T05:40:59.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.246+0000 7fa0477fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa048064ae0 0x7fa0481328c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:59.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.246+0000 7fa0477fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa048064ae0 0x7fa0481328c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43952/0 (socket says 172.21.2.105:43952) 2021-11-12T05:40:59.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.246+0000 7fa0477fe700 1 -- 172.21.2.105:0/1928332382 learned_addr learned my addr 172.21.2.105:0/1928332382 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:40:59.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.246+0000 7fa0467fc700 1 --2- 172.21.2.105:0/1928332382 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa0480ace20 0x7fa0480645f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:59.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.246+0000 7fa046ffd700 1 --2- 172.21.2.105:0/1928332382 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa048066950 0x7fa0480aa280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:59.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.246+0000 7fa0477fe700 1 -- 172.21.2.105:0/1928332382 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa0480ace20 msgr2=0x7fa0480645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:59.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.246+0000 7fa0477fe700 1 --2- 172.21.2.105:0/1928332382 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa0480ace20 0x7fa0480645f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:59.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.246+0000 7fa0477fe700 1 -- 172.21.2.105:0/1928332382 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa048066950 msgr2=0x7fa0480aa280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:40:59.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.246+0000 7fa0477fe700 1 --2- 172.21.2.105:0/1928332382 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa048066950 0x7fa0480aa280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:40:59.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.246+0000 7fa0477fe700 1 -- 172.21.2.105:0/1928332382 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa048067130 con 0x7fa048064ae0 2021-11-12T05:40:59.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.246+0000 7fa0477fe700 1 --2- 172.21.2.105:0/1928332382 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa048064ae0 0x7fa0481328c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7fa0480afc60 tx=0x7fa040016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:59.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.246+0000 7fa03ffff700 1 -- 172.21.2.105:0/1928332382 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa040006890 con 0x7fa048064ae0 2021-11-12T05:40:59.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.246+0000 7fa03ffff700 1 -- 172.21.2.105:0/1928332382 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0400127b0 con 0x7fa048064ae0 2021-11-12T05:40:59.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.246+0000 7fa03ffff700 1 -- 172.21.2.105:0/1928332382 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa040012b10 con 0x7fa048064ae0 2021-11-12T05:40:59.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.246+0000 7fa04d5c3700 1 -- 172.21.2.105:0/1928332382 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa048066d30 con 0x7fa048064ae0 2021-11-12T05:40:59.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.246+0000 7fa04d5c3700 1 -- 172.21.2.105:0/1928332382 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0480aa910 con 0x7fa048064ae0 2021-11-12T05:40:59.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.246+0000 7fa04d5c3700 1 -- 172.21.2.105:0/1928332382 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa048066f80 con 0x7fa048064ae0 2021-11-12T05:40:59.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.246+0000 7fa03ffff700 1 -- 172.21.2.105:0/1928332382 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa04001b070 con 0x7fa048064ae0 2021-11-12T05:40:59.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.246+0000 7fa03ffff700 1 --2- 172.21.2.105:0/1928332382 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa02c053610 0x7fa02c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:40:59.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.246+0000 7fa046ffd700 1 --2- 172.21.2.105:0/1928332382 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa02c053610 0x7fa02c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:40:59.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.246+0000 7fa03ffff700 1 -- 172.21.2.105:0/1928332382 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6513+0+0 (secure 0 0 0) 0x7fa04006c8a0 con 0x7fa048064ae0 2021-11-12T05:40:59.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.246+0000 7fa046ffd700 1 --2- 172.21.2.105:0/1928332382 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa02c053610 0x7fa02c055ad0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fa03800c000 tx=0x7fa038008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:40:59.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.250+0000 7fa03ffff700 1 -- 172.21.2.105:0/1928332382 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa040043880 con 0x7fa048064ae0 2021-11-12T05:40:59.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:40:59.358+0000 7fa04d5c3700 1 -- 172.21.2.105:0/1928332382 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa048144210 con 0x7fa048064ae0 2021-11-12T05:41:00.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.010+0000 7fa03ffff700 1 -- 172.21.2.105:0/1928332382 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa040023020 con 0x7fa048064ae0 2021-11-12T05:41:00.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.010+0000 7fa04d5c3700 1 -- 172.21.2.105:0/1928332382 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa02c053610 msgr2=0x7fa02c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:00.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.010+0000 7fa04d5c3700 1 --2- 172.21.2.105:0/1928332382 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa02c053610 0x7fa02c055ad0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fa03800c000 tx=0x7fa038008040).stop 2021-11-12T05:41:00.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.010+0000 7fa04d5c3700 1 -- 172.21.2.105:0/1928332382 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa048064ae0 msgr2=0x7fa0481328c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:00.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.010+0000 7fa04d5c3700 1 --2- 172.21.2.105:0/1928332382 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa048064ae0 0x7fa0481328c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7fa0480afc60 tx=0x7fa040016000).stop 2021-11-12T05:41:00.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.010+0000 7fa04d5c3700 1 -- 172.21.2.105:0/1928332382 shutdown_connections 2021-11-12T05:41:00.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.010+0000 7fa04d5c3700 1 --2- 172.21.2.105:0/1928332382 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa02c053610 0x7fa02c055ad0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:00.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.010+0000 7fa04d5c3700 1 --2- 172.21.2.105:0/1928332382 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa048064ae0 0x7fa0481328c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:00.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.010+0000 7fa04d5c3700 1 --2- 172.21.2.105:0/1928332382 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa0480ace20 0x7fa0480645f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:00.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.010+0000 7fa04d5c3700 1 --2- 172.21.2.105:0/1928332382 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa048066950 0x7fa0480aa280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:00.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.010+0000 7fa04d5c3700 1 -- 172.21.2.105:0/1928332382 >> 172.21.2.105:0/1928332382 conn(0x7fa04805c490 msgr2=0x7fa048142830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:00.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.010+0000 7fa04d5c3700 1 -- 172.21.2.105:0/1928332382 shutdown_connections 2021-11-12T05:41:00.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.010+0000 7fa04d5c3700 1 -- 172.21.2.105:0/1928332382 wait complete. 2021-11-12T05:41:00.020 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-12T05:41:00.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.070+0000 7f5483076700 1 Processor -- start 2021-11-12T05:41:00.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.070+0000 7f5483076700 1 -- start start 2021-11-12T05:41:00.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.070+0000 7f5483076700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f547c143b40 0x7f547c143f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:00.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.070+0000 7f5483076700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f547c0aded0 0x7f547c0ae300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:00.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.070+0000 7f5483076700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f547c067860 con 0x7f547c0adaf0 2021-11-12T05:41:00.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.070+0000 7f5483076700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f547c1404a0 con 0x7f547c0aded0 2021-11-12T05:41:00.074 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.070+0000 7f5483076700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f547c143400 con 0x7f547c143b40 2021-11-12T05:41:00.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.070+0000 7f5481613700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f547c0aded0 0x7f547c0ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:00.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.070+0000 7f547bfff700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f547c143b40 0x7f547c143f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:00.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.070+0000 7f547bfff700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f547c143b40 0x7f547c143f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3301/0 says I am v2:172.21.2.105:35146/0 (socket says 172.21.2.105:35146) 2021-11-12T05:41:00.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.070+0000 7f547bfff700 1 -- 172.21.2.105:0/2402786379 learned_addr learned my addr 172.21.2.105:0/2402786379 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:00.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.070+0000 7f5481613700 1 -- 172.21.2.105:0/2402786379 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f547c143b40 msgr2=0x7f547c143f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:00.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.070+0000 7f5481613700 1 --2- 172.21.2.105:0/2402786379 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f547c143b40 0x7f547c143f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:00.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.070+0000 7f5481613700 1 -- 172.21.2.105:0/2402786379 >> v1:172.21.2.115:6789/0 conn(0x7f547c0adaf0 legacy=0x7f547c13fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:00.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.070+0000 7f5481613700 1 -- 172.21.2.105:0/2402786379 --> v2:172.21.2.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f547c1436a0 con 0x7f547c0aded0 2021-11-12T05:41:00.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.074+0000 7f5481613700 1 --2- 172.21.2.105:0/2402786379 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f547c0aded0 0x7f547c0ae300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f54740032f0 tx=0x7f54740091d0).ready entity=mon.1 client_cookie=3146475534d1d369 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:00.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.074+0000 7f547b7fe700 1 -- 172.21.2.105:0/2402786379 <== mon.1 v2:172.21.2.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f547400b6c0 con 0x7f547c0aded0 2021-11-12T05:41:00.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.074+0000 7f547b7fe700 1 -- 172.21.2.105:0/2402786379 <== mon.1 v2:172.21.2.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547400b820 con 0x7f547c0aded0 2021-11-12T05:41:00.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.074+0000 7f547b7fe700 1 -- 172.21.2.105:0/2402786379 <== mon.1 v2:172.21.2.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f547400b990 con 0x7f547c0aded0 2021-11-12T05:41:00.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.074+0000 7f5483076700 1 -- 172.21.2.105:0/2402786379 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f547c0aded0 msgr2=0x7f547c0ae300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:00.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.074+0000 7f5483076700 1 --2- 172.21.2.105:0/2402786379 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f547c0aded0 0x7f547c0ae300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f54740032f0 tx=0x7f54740091d0).stop 2021-11-12T05:41:00.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.074+0000 7f5483076700 1 -- 172.21.2.105:0/2402786379 shutdown_connections 2021-11-12T05:41:00.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.074+0000 7f5483076700 1 --2- 172.21.2.105:0/2402786379 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f547c0aded0 0x7f547c0ae300 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:00.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.074+0000 7f5483076700 1 --2- 172.21.2.105:0/2402786379 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f547c143b40 0x7f547c143f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:00.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.074+0000 7f5483076700 1 -- 172.21.2.105:0/2402786379 >> 172.21.2.105:0/2402786379 conn(0x7f547c05c490 msgr2=0x7f547c05c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:00.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.074+0000 7f5483076700 1 -- 172.21.2.105:0/2402786379 shutdown_connections 2021-11-12T05:41:00.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.074+0000 7f5483076700 1 -- 172.21.2.105:0/2402786379 wait complete. 2021-11-12T05:41:00.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.074+0000 7f5483076700 1 Processor -- start 2021-11-12T05:41:00.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.074+0000 7f5483076700 1 -- start start 2021-11-12T05:41:00.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.074+0000 7f5483076700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f547c0adaf0 0x7f547c0b5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:00.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.074+0000 7f5483076700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f547c0aded0 0x7f547c066960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:00.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.074+0000 7f5483076700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f547c143b40 0x7f547c066e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:00.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.074+0000 7f5483076700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c1527e0 con 0x7f547c0aded0 2021-11-12T05:41:00.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.074+0000 7f5483076700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c0636b0 con 0x7f547c0adaf0 2021-11-12T05:41:00.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.074+0000 7f5483076700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f547c0653a0 con 0x7f547c143b40 2021-11-12T05:41:00.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.074+0000 7f547bfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f547c0aded0 0x7f547c066960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:00.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.074+0000 7f547bfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f547c0aded0 0x7f547c066960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43964/0 (socket says 172.21.2.105:43964) 2021-11-12T05:41:00.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.074+0000 7f547bfff700 1 -- 172.21.2.105:0/1152125605 learned_addr learned my addr 172.21.2.105:0/1152125605 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:00.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.074+0000 7f5481613700 1 --2- 172.21.2.105:0/1152125605 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f547c143b40 0x7f547c066e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:00.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.074+0000 7f5480e12700 1 --2- 172.21.2.105:0/1152125605 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f547c0adaf0 0x7f547c0b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:00.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.074+0000 7f547bfff700 1 -- 172.21.2.105:0/1152125605 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f547c143b40 msgr2=0x7f547c066e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:00.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.074+0000 7f547bfff700 1 --2- 172.21.2.105:0/1152125605 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f547c143b40 0x7f547c066e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:00.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.074+0000 7f547bfff700 1 -- 172.21.2.105:0/1152125605 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f547c0adaf0 msgr2=0x7f547c0b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:00.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.074+0000 7f547bfff700 1 --2- 172.21.2.105:0/1152125605 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f547c0adaf0 0x7f547c0b5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:00.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.074+0000 7f547bfff700 1 -- 172.21.2.105:0/1152125605 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5474009470 con 0x7f547c0aded0 2021-11-12T05:41:00.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.074+0000 7f547bfff700 1 --2- 172.21.2.105:0/1152125605 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f547c0aded0 0x7f547c066960 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f546c00e000 tx=0x7f546c006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:00.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.074+0000 7f5479ffb700 1 -- 172.21.2.105:0/1152125605 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f546c00da50 con 0x7f547c0aded0 2021-11-12T05:41:00.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.074+0000 7f5479ffb700 1 -- 172.21.2.105:0/1152125605 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546c00dbb0 con 0x7f547c0aded0 2021-11-12T05:41:00.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.074+0000 7f5483076700 1 -- 172.21.2.105:0/1152125605 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f547c067340 con 0x7f547c0aded0 2021-11-12T05:41:00.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.074+0000 7f5479ffb700 1 -- 172.21.2.105:0/1152125605 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f546c010440 con 0x7f547c0aded0 2021-11-12T05:41:00.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.078+0000 7f5483076700 1 -- 172.21.2.105:0/1152125605 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f547c064550 con 0x7f547c0aded0 2021-11-12T05:41:00.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.078+0000 7f5483076700 1 -- 172.21.2.105:0/1152125605 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f547c0b2b40 con 0x7f547c0aded0 2021-11-12T05:41:00.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.078+0000 7f5479ffb700 1 -- 172.21.2.105:0/1152125605 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f546c020070 con 0x7f547c0aded0 2021-11-12T05:41:00.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.078+0000 7f5479ffb700 1 --2- 172.21.2.105:0/1152125605 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5460053640 0x7f5460055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:00.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.078+0000 7f5479ffb700 1 -- 172.21.2.105:0/1152125605 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6513+0+0 (secure 0 0 0) 0x7f546c06c3d0 con 0x7f547c0aded0 2021-11-12T05:41:00.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.078+0000 7f5480e12700 1 --2- 172.21.2.105:0/1152125605 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5460053640 0x7f5460055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:00.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.078+0000 7f5480e12700 1 --2- 172.21.2.105:0/1152125605 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5460053640 0x7f5460055b00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f546400b000 tx=0x7f5464009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:00.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.078+0000 7f5479ffb700 1 -- 172.21.2.105:0/1152125605 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f546c043260 con 0x7f547c0aded0 2021-11-12T05:41:00.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:00.162+0000 7f5483076700 1 -- 172.21.2.105:0/1152125605 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f547c057350 con 0x7f547c0aded0 2021-11-12T05:41:01.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.022+0000 7f5479ffb700 1 -- 172.21.2.105:0/1152125605 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v27) v1 ==== 185+0+0 (secure 0 0 0) 0x7f546c046880 con 0x7f547c0aded0 2021-11-12T05:41:01.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.022+0000 7f5483076700 1 -- 172.21.2.105:0/1152125605 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5460053640 msgr2=0x7f5460055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:01.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.022+0000 7f5483076700 1 --2- 172.21.2.105:0/1152125605 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5460053640 0x7f5460055b00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f546400b000 tx=0x7f5464009040).stop 2021-11-12T05:41:01.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.022+0000 7f5483076700 1 -- 172.21.2.105:0/1152125605 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f547c0aded0 msgr2=0x7f547c066960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:01.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.022+0000 7f5483076700 1 --2- 172.21.2.105:0/1152125605 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f547c0aded0 0x7f547c066960 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f546c00e000 tx=0x7f546c006f40).stop 2021-11-12T05:41:01.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.022+0000 7f5483076700 1 -- 172.21.2.105:0/1152125605 shutdown_connections 2021-11-12T05:41:01.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.022+0000 7f5483076700 1 --2- 172.21.2.105:0/1152125605 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5460053640 0x7f5460055b00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:01.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.022+0000 7f5483076700 1 --2- 172.21.2.105:0/1152125605 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f547c143b40 0x7f547c066e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:01.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.022+0000 7f5483076700 1 --2- 172.21.2.105:0/1152125605 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f547c0aded0 0x7f547c066960 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:01.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.022+0000 7f5483076700 1 --2- 172.21.2.105:0/1152125605 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f547c0adaf0 0x7f547c0b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:01.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.022+0000 7f5483076700 1 -- 172.21.2.105:0/1152125605 >> 172.21.2.105:0/1152125605 conn(0x7f547c05c490 msgr2=0x7f547c05c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:01.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.022+0000 7f5483076700 1 -- 172.21.2.105:0/1152125605 shutdown_connections 2021-11-12T05:41:01.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.022+0000 7f5483076700 1 -- 172.21.2.105:0/1152125605 wait complete. 2021-11-12T05:41:01.027 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_metadata' removed 2021-11-12T05:41:01.031 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-12T05:41:01.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.082+0000 7f2d9e097700 1 Processor -- start 2021-11-12T05:41:01.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.082+0000 7f2d9e097700 1 -- start start 2021-11-12T05:41:01.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.082+0000 7f2d9e097700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2d980ad080 0x7f2d980af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:01.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.082+0000 7f2d9e097700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f2d9814b2f0 0x7f2d980ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:01.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.082+0000 7f2d9e097700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d980ac7b0 con 0x7f2d980ac280 2021-11-12T05:41:01.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.082+0000 7f2d9e097700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d981488a0 con 0x7f2d9814b2f0 2021-11-12T05:41:01.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.082+0000 7f2d9e097700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d980ac9e0 con 0x7f2d980ad080 2021-11-12T05:41:01.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.082+0000 7f2d97fff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f2d9814b2f0 0x7f2d980ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:01.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.082+0000 7f2d97fff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f2d9814b2f0 0x7f2d980ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43972/0 (socket says 172.21.2.105:43972) 2021-11-12T05:41:01.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.082+0000 7f2d97fff700 1 -- 172.21.2.105:0/369367718 learned_addr learned my addr 172.21.2.105:0/369367718 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:01.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.082+0000 7f2d97fff700 1 -- 172.21.2.105:0/369367718 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2d980ad080 msgr2=0x7f2d980af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:01.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.082+0000 7f2d97fff700 1 --2- 172.21.2.105:0/369367718 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2d980ad080 0x7f2d980af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:01.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.082+0000 7f2d97fff700 1 -- 172.21.2.105:0/369367718 >> v1:172.21.2.115:6789/0 conn(0x7f2d980ac280 legacy=0x7f2d9814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:01.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.082+0000 7f2d97fff700 1 -- 172.21.2.105:0/369367718 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d980b0b30 con 0x7f2d9814b2f0 2021-11-12T05:41:01.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.082+0000 7f2d97fff700 1 --2- 172.21.2.105:0/369367718 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2d9814b2f0 0x7f2d980ad460 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f2d980b0550 tx=0x7f2d90009290).ready entity=mon.0 client_cookie=a2c486749d9f2f53 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:01.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.082+0000 7f2d967fc700 1 -- 172.21.2.105:0/369367718 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d9000b820 con 0x7f2d9814b2f0 2021-11-12T05:41:01.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.082+0000 7f2d967fc700 1 -- 172.21.2.105:0/369367718 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9000b980 con 0x7f2d9814b2f0 2021-11-12T05:41:01.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.082+0000 7f2d967fc700 1 -- 172.21.2.105:0/369367718 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d9000bb30 con 0x7f2d9814b2f0 2021-11-12T05:41:01.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.082+0000 7f2d9e097700 1 -- 172.21.2.105:0/369367718 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2d9814b2f0 msgr2=0x7f2d980ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:01.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.082+0000 7f2d9e097700 1 --2- 172.21.2.105:0/369367718 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2d9814b2f0 0x7f2d980ad460 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f2d980b0550 tx=0x7f2d90009290).stop 2021-11-12T05:41:01.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.082+0000 7f2d9e097700 1 -- 172.21.2.105:0/369367718 shutdown_connections 2021-11-12T05:41:01.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.082+0000 7f2d9e097700 1 --2- 172.21.2.105:0/369367718 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2d9814b2f0 0x7f2d980ad460 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:01.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.082+0000 7f2d9e097700 1 --2- 172.21.2.105:0/369367718 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2d980ad080 0x7f2d980af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:01.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.082+0000 7f2d9e097700 1 -- 172.21.2.105:0/369367718 >> 172.21.2.105:0/369367718 conn(0x7f2d980b5370 msgr2=0x7f2d980b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:01.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.082+0000 7f2d9e097700 1 -- 172.21.2.105:0/369367718 shutdown_connections 2021-11-12T05:41:01.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.082+0000 7f2d9e097700 1 -- 172.21.2.105:0/369367718 wait complete. 2021-11-12T05:41:01.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.086+0000 7f2d9e097700 1 Processor -- start 2021-11-12T05:41:01.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.086+0000 7f2d9e097700 1 -- start start 2021-11-12T05:41:01.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.086+0000 7f2d9e097700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2d980ac280 0x7f2d980ab650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:01.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.086+0000 7f2d9e097700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2d980ad080 0x7f2d9815a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:01.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.086+0000 7f2d9e097700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2d9814b2f0 0x7f2d9815aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:01.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.086+0000 7f2d9e097700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d980628a0 con 0x7f2d980ad080 2021-11-12T05:41:01.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.086+0000 7f2d9e097700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9815b190 con 0x7f2d980ac280 2021-11-12T05:41:01.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.086+0000 7f2d9e097700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d980aaf40 con 0x7f2d9814b2f0 2021-11-12T05:41:01.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.086+0000 7f2d96ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2d980ad080 0x7f2d9815a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:01.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.086+0000 7f2d96ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2d980ad080 0x7f2d9815a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:43976/0 (socket says 172.21.2.105:43976) 2021-11-12T05:41:01.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.086+0000 7f2d96ffd700 1 -- 172.21.2.105:0/1696098837 learned_addr learned my addr 172.21.2.105:0/1696098837 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:01.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.086+0000 7f2d977fe700 1 --2- 172.21.2.105:0/1696098837 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2d980ac280 0x7f2d980ab650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:01.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.086+0000 7f2d97fff700 1 --2- 172.21.2.105:0/1696098837 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2d9814b2f0 0x7f2d9815aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:01.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.086+0000 7f2d96ffd700 1 -- 172.21.2.105:0/1696098837 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2d9814b2f0 msgr2=0x7f2d9815aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:01.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.086+0000 7f2d96ffd700 1 --2- 172.21.2.105:0/1696098837 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2d9814b2f0 0x7f2d9815aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:01.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.086+0000 7f2d96ffd700 1 -- 172.21.2.105:0/1696098837 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2d980ac280 msgr2=0x7f2d980ab650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:01.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.086+0000 7f2d96ffd700 1 --2- 172.21.2.105:0/1696098837 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2d980ac280 0x7f2d980ab650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:01.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.086+0000 7f2d96ffd700 1 -- 172.21.2.105:0/1696098837 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d90009530 con 0x7f2d980ad080 2021-11-12T05:41:01.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.086+0000 7f2d96ffd700 1 --2- 172.21.2.105:0/1696098837 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2d980ad080 0x7f2d9815a510 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f2d980ab0d0 tx=0x7f2d80006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:01.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.086+0000 7f2d94ff9700 1 -- 172.21.2.105:0/1696098837 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d80009e10 con 0x7f2d980ad080 2021-11-12T05:41:01.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.086+0000 7f2d94ff9700 1 -- 172.21.2.105:0/1696098837 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d80013460 con 0x7f2d980ad080 2021-11-12T05:41:01.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.086+0000 7f2d9e097700 1 -- 172.21.2.105:0/1696098837 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d980a9910 con 0x7f2d980ad080 2021-11-12T05:41:01.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.086+0000 7f2d94ff9700 1 -- 172.21.2.105:0/1696098837 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d800137c0 con 0x7f2d980ad080 2021-11-12T05:41:01.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.086+0000 7f2d9e097700 1 -- 172.21.2.105:0/1696098837 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d980a95b0 con 0x7f2d980ad080 2021-11-12T05:41:01.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.086+0000 7f2d9e097700 1 -- 172.21.2.105:0/1696098837 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d980ab110 con 0x7f2d980ad080 2021-11-12T05:41:01.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.086+0000 7f2d94ff9700 1 -- 172.21.2.105:0/1696098837 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2d8001a060 con 0x7f2d980ad080 2021-11-12T05:41:01.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.086+0000 7f2d94ff9700 1 --2- 172.21.2.105:0/1696098837 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2d7c0536d0 0x7f2d7c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:01.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.086+0000 7f2d94ff9700 1 -- 172.21.2.105:0/1696098837 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6075+0+0 (secure 0 0 0) 0x7f2d8006b0c0 con 0x7f2d980ad080 2021-11-12T05:41:01.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.086+0000 7f2d977fe700 1 --2- 172.21.2.105:0/1696098837 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2d7c0536d0 0x7f2d7c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:01.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.086+0000 7f2d977fe700 1 --2- 172.21.2.105:0/1696098837 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2d7c0536d0 0x7f2d7c055b90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f2d8800c000 tx=0x7f2d88008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:01.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.090+0000 7f2d94ff9700 1 -- 172.21.2.105:0/1696098837 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2d80042220 con 0x7f2d980ad080 2021-11-12T05:41:01.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:01.174+0000 7f2d9e097700 1 -- 172.21.2.105:0/1696098837 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2d980b1440 con 0x7f2d980ad080 2021-11-12T05:41:02.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.034+0000 7f2d94ff9700 1 -- 172.21.2.105:0/1696098837 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v28) v1 ==== 173+0+0 (secure 0 0 0) 0x7f2d80018070 con 0x7f2d980ad080 2021-11-12T05:41:02.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.034+0000 7f2d9e097700 1 -- 172.21.2.105:0/1696098837 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2d7c0536d0 msgr2=0x7f2d7c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:02.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.034+0000 7f2d9e097700 1 --2- 172.21.2.105:0/1696098837 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2d7c0536d0 0x7f2d7c055b90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f2d8800c000 tx=0x7f2d88008040).stop 2021-11-12T05:41:02.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.034+0000 7f2d9e097700 1 -- 172.21.2.105:0/1696098837 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2d980ad080 msgr2=0x7f2d9815a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:02.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.034+0000 7f2d9e097700 1 --2- 172.21.2.105:0/1696098837 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2d980ad080 0x7f2d9815a510 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f2d980ab0d0 tx=0x7f2d80006df0).stop 2021-11-12T05:41:02.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.034+0000 7f2d9e097700 1 -- 172.21.2.105:0/1696098837 shutdown_connections 2021-11-12T05:41:02.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.034+0000 7f2d9e097700 1 --2- 172.21.2.105:0/1696098837 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2d7c0536d0 0x7f2d7c055b90 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:02.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.034+0000 7f2d9e097700 1 --2- 172.21.2.105:0/1696098837 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2d9814b2f0 0x7f2d9815aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:02.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.034+0000 7f2d9e097700 1 --2- 172.21.2.105:0/1696098837 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2d980ad080 0x7f2d9815a510 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:02.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.034+0000 7f2d9e097700 1 --2- 172.21.2.105:0/1696098837 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2d980ac280 0x7f2d980ab650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:02.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.034+0000 7f2d9e097700 1 -- 172.21.2.105:0/1696098837 >> 172.21.2.105:0/1696098837 conn(0x7f2d980b5370 msgr2=0x7f2d9814aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:02.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.034+0000 7f2d9e097700 1 -- 172.21.2.105:0/1696098837 shutdown_connections 2021-11-12T05:41:02.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.034+0000 7f2d9e097700 1 -- 172.21.2.105:0/1696098837 wait complete. 2021-11-12T05:41:02.040 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_data' removed 2021-11-12T05:41:02.044 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-12T05:41:02.044 INFO:tasks.ceph.mds.a:Stopping old one... 2021-11-12T05:41:02.044 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-12T05:41:02.045 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T05:41:02.045 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-12T05:41:02.045 INFO:tasks.ceph.mds.b:Stopping old one... 2021-11-12T05:41:02.046 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-12T05:41:02.046 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T05:41:02.050 INFO:tasks.ceph.mds.a:Stopped 2021-11-12T05:41:02.051 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-12T05:41:02.052 INFO:tasks.ceph.mds.b:Stopped 2021-11-12T05:41:02.052 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-12T05:41:02.054 INFO:tasks.ceph.mds.a:Started 2021-11-12T05:41:02.055 DEBUG:teuthology.parallel:result is None 2021-11-12T05:41:02.056 INFO:tasks.ceph.mds.b:Started 2021-11-12T05:41:02.056 DEBUG:teuthology.parallel:result is None 2021-11-12T05:41:02.056 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-11-12T05:41:02.089 INFO:tasks.ceph.mds.b.gibba015.stdout:starting mds.b at 2021-11-12T05:41:02.090 INFO:tasks.ceph.mds.a.gibba005.stdout:starting mds.a at 2021-11-12T05:41:02.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.110+0000 7fb5c8611700 1 Processor -- start 2021-11-12T05:41:02.112 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.110+0000 7fb5c8611700 1 -- start start 2021-11-12T05:41:02.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.110+0000 7fb5c8611700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fb5c0143430 0x7fb5c0060aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:02.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.110+0000 7fb5c8611700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb5c00afe00 0x7fb5c00b0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:02.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.110+0000 7fb5c8611700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c01438d0 con 0x7fb5c00606c0 2021-11-12T05:41:02.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.110+0000 7fb5c8611700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c00b19c0 con 0x7fb5c00afe00 2021-11-12T05:41:02.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.110+0000 7fb5c8611700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c00b1c60 con 0x7fb5c0143430 2021-11-12T05:41:02.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.110+0000 7fb5c63ad700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fb5c00606c0 0x7fb5c00b0700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:54390/0 (socket says 172.21.2.105:54390) 2021-11-12T05:41:02.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.110+0000 7fb5c6bae700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb5c00afe00 0x7fb5c00b0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:02.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.110+0000 7fb5c63ad700 1 -- 172.21.2.105:0/997856902 learned_addr learned my addr 172.21.2.105:0/997856902 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:41:02.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.110+0000 7fb5c5bac700 1 --2- 172.21.2.105:0/997856902 >> v2:172.21.2.115:3300/0 conn(0x7fb5c0143430 0x7fb5c0060aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:02.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.110+0000 7fb5c6bae700 1 -- 172.21.2.105:0/997856902 >> v2:172.21.2.115:3300/0 conn(0x7fb5c0143430 msgr2=0x7fb5c0060aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:02.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.110+0000 7fb5c6bae700 1 --2- 172.21.2.105:0/997856902 >> v2:172.21.2.115:3300/0 conn(0x7fb5c0143430 0x7fb5c0060aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:02.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.110+0000 7fb5c6bae700 1 -- 172.21.2.105:0/997856902 >> v1:172.21.2.105:6789/0 conn(0x7fb5c00606c0 legacy=0x7fb5c00b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:02.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.110+0000 7fb5c6bae700 1 -- 172.21.2.105:0/997856902 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c00b2580 con 0x7fb5c00afe00 2021-11-12T05:41:02.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.110+0000 7fb5c6bae700 1 --2- 172.21.2.105:0/997856902 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb5c00afe00 0x7fb5c00b0e10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7fb5b80032f0 tx=0x7fb5b80091d0).ready entity=mon.0 client_cookie=4dfbb0ba5631dc00 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:02.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.110+0000 7fb5c53ab700 1 -- 172.21.2.105:0/997856902 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5b800b680 con 0x7fb5c00afe00 2021-11-12T05:41:02.121 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.110+0000 7fb5c53ab700 1 -- 172.21.2.105:0/997856902 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b800b7e0 con 0x7fb5c00afe00 2021-11-12T05:41:02.122 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.110+0000 7fb5c53ab700 1 -- 172.21.2.105:0/997856902 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5b800b950 con 0x7fb5c00afe00 2021-11-12T05:41:02.122 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.110+0000 7fb5c8611700 1 -- 172.21.2.105:0/997856902 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb5c00afe00 msgr2=0x7fb5c00b0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:02.122 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.110+0000 7fb5c8611700 1 --2- 172.21.2.105:0/997856902 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb5c00afe00 0x7fb5c00b0e10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7fb5b80032f0 tx=0x7fb5b80091d0).stop 2021-11-12T05:41:02.123 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.110+0000 7fb5c8611700 1 -- 172.21.2.105:0/997856902 shutdown_connections 2021-11-12T05:41:02.123 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.110+0000 7fb5c8611700 1 --2- 172.21.2.105:0/997856902 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb5c00afe00 0x7fb5c00b0e10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:02.123 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.110+0000 7fb5c8611700 1 --2- 172.21.2.105:0/997856902 >> v2:172.21.2.115:3300/0 conn(0x7fb5c0143430 0x7fb5c0060aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:02.123 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.110+0000 7fb5c8611700 1 -- 172.21.2.105:0/997856902 >> 172.21.2.105:0/997856902 conn(0x7fb5c00b67b0 msgr2=0x7fb5c00b2800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:02.123 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.110+0000 7fb5c8611700 1 -- 172.21.2.105:0/997856902 shutdown_connections 2021-11-12T05:41:02.124 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.110+0000 7fb5c8611700 1 -- 172.21.2.105:0/997856902 wait complete. 2021-11-12T05:41:02.124 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.114+0000 7fb5c8611700 1 Processor -- start 2021-11-12T05:41:02.124 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.114+0000 7fb5c8611700 1 -- start start 2021-11-12T05:41:02.124 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.114+0000 7fb5c8611700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb5c00606c0 0x7fb5c013f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:02.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.114+0000 7fb5c8611700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb5c00afe00 0x7fb5c01455f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:02.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.114+0000 7fb5c8611700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb5c0143430 0x7fb5c0145ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:02.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.114+0000 7fb5c8611700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c0143f00 con 0x7fb5c00afe00 2021-11-12T05:41:02.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.114+0000 7fb5c8611700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c01441a0 con 0x7fb5c0143430 2021-11-12T05:41:02.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.114+0000 7fb5c8611700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c0145fd0 con 0x7fb5c00606c0 2021-11-12T05:41:02.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.114+0000 7fb5c5bac700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb5c00afe00 0x7fb5c01455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:02.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.114+0000 7fb5c5bac700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb5c00afe00 0x7fb5c01455f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44002/0 (socket says 172.21.2.105:44002) 2021-11-12T05:41:02.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.114+0000 7fb5c5bac700 1 -- 172.21.2.105:0/825051352 learned_addr learned my addr 172.21.2.105:0/825051352 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:02.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.114+0000 7fb5c6bae700 1 --2- 172.21.2.105:0/825051352 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb5c0143430 0x7fb5c0145ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:02.127 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.114+0000 7fb5c63ad700 1 --2- 172.21.2.105:0/825051352 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb5c00606c0 0x7fb5c013f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:02.127 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.114+0000 7fb5c5bac700 1 -- 172.21.2.105:0/825051352 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb5c00606c0 msgr2=0x7fb5c013f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:02.127 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.114+0000 7fb5c5bac700 1 --2- 172.21.2.105:0/825051352 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb5c00606c0 0x7fb5c013f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:02.127 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.114+0000 7fb5c5bac700 1 -- 172.21.2.105:0/825051352 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb5c0143430 msgr2=0x7fb5c0145ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:02.127 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.114+0000 7fb5c5bac700 1 --2- 172.21.2.105:0/825051352 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb5c0143430 0x7fb5c0145ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:02.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.114+0000 7fb5c5bac700 1 -- 172.21.2.105:0/825051352 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b8009470 con 0x7fb5c00afe00 2021-11-12T05:41:02.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.114+0000 7fb5c5bac700 1 --2- 172.21.2.105:0/825051352 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb5c00afe00 0x7fb5c01455f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fb5b000c000 tx=0x7fb5b0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:02.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.114+0000 7fb5af7fe700 1 -- 172.21.2.105:0/825051352 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5b0010780 con 0x7fb5c00afe00 2021-11-12T05:41:02.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.114+0000 7fb5af7fe700 1 -- 172.21.2.105:0/825051352 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b00108e0 con 0x7fb5c00afe00 2021-11-12T05:41:02.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.114+0000 7fb5c8611700 1 -- 172.21.2.105:0/825051352 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c0143b80 con 0x7fb5c00afe00 2021-11-12T05:41:02.129 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.114+0000 7fb5af7fe700 1 -- 172.21.2.105:0/825051352 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5b0010c40 con 0x7fb5c00afe00 2021-11-12T05:41:02.129 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.114+0000 7fb5c8611700 1 -- 172.21.2.105:0/825051352 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c0066620 con 0x7fb5c00afe00 2021-11-12T05:41:02.129 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.114+0000 7fb5c8611700 1 -- 172.21.2.105:0/825051352 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c00b1300 con 0x7fb5c00afe00 2021-11-12T05:41:02.129 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.114+0000 7fb5af7fe700 1 -- 172.21.2.105:0/825051352 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb5b001c460 con 0x7fb5c00afe00 2021-11-12T05:41:02.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.118+0000 7fb5af7fe700 1 --2- 172.21.2.105:0/825051352 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb5a0053610 0x7fb5a0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:02.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.118+0000 7fb5af7fe700 1 -- 172.21.2.105:0/825051352 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fb5b006bce0 con 0x7fb5c00afe00 2021-11-12T05:41:02.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.118+0000 7fb5c63ad700 1 --2- 172.21.2.105:0/825051352 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb5a0053610 0x7fb5a0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:02.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.118+0000 7fb5c63ad700 1 --2- 172.21.2.105:0/825051352 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb5a0053610 0x7fb5a0055ad0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fb5bc00b000 tx=0x7fb5bc009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:02.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.118+0000 7fb5af7fe700 1 -- 172.21.2.105:0/825051352 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb5b0042ec0 con 0x7fb5c00afe00 2021-11-12T05:41:02.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:02.210+0000 7fb5c8611700 1 -- 172.21.2.105:0/825051352 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fb5c0057350 con 0x7fb5c00afe00 2021-11-12T05:41:03.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.126+0000 7fb5af7fe700 1 -- 172.21.2.105:0/825051352 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb5b00464e0 con 0x7fb5c00afe00 2021-11-12T05:41:03.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.130+0000 7fb5c8611700 1 -- 172.21.2.105:0/825051352 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb5a0053610 msgr2=0x7fb5a0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:03.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.130+0000 7fb5c8611700 1 --2- 172.21.2.105:0/825051352 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb5a0053610 0x7fb5a0055ad0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fb5bc00b000 tx=0x7fb5bc009040).stop 2021-11-12T05:41:03.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.130+0000 7fb5c8611700 1 -- 172.21.2.105:0/825051352 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb5c00afe00 msgr2=0x7fb5c01455f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:03.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.130+0000 7fb5c8611700 1 --2- 172.21.2.105:0/825051352 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb5c00afe00 0x7fb5c01455f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fb5b000c000 tx=0x7fb5b0006df0).stop 2021-11-12T05:41:03.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.130+0000 7fb5c8611700 1 -- 172.21.2.105:0/825051352 shutdown_connections 2021-11-12T05:41:03.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.130+0000 7fb5c8611700 1 --2- 172.21.2.105:0/825051352 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb5a0053610 0x7fb5a0055ad0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:03.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.130+0000 7fb5c8611700 1 --2- 172.21.2.105:0/825051352 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb5c0143430 0x7fb5c0145ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:03.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.130+0000 7fb5c8611700 1 --2- 172.21.2.105:0/825051352 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb5c00afe00 0x7fb5c01455f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:03.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.130+0000 7fb5c8611700 1 --2- 172.21.2.105:0/825051352 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb5c00606c0 0x7fb5c013f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:03.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.130+0000 7fb5c8611700 1 -- 172.21.2.105:0/825051352 >> 172.21.2.105:0/825051352 conn(0x7fb5c00b67b0 msgr2=0x7fb5c005bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:03.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.130+0000 7fb5c8611700 1 -- 172.21.2.105:0/825051352 shutdown_connections 2021-11-12T05:41:03.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.130+0000 7fb5c8611700 1 -- 172.21.2.105:0/825051352 wait complete. 2021-11-12T05:41:03.135 INFO:teuthology.orchestra.run.gibba005.stderr: removed all blacklist entries 2021-11-12T05:41:03.138 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-11-12T05:41:03.138 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-11-12T05:41:03.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.186+0000 7fa7a4663700 1 Processor -- start 2021-11-12T05:41:03.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.186+0000 7fa7a4663700 1 -- start start 2021-11-12T05:41:03.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a4663700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa79c0b2ef0 0x7fa79c0ab3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:03.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a4663700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa79c0b6b70 con 0x7fa79c146780 2021-11-12T05:41:03.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a4663700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa79c0ab890 con 0x7fa79c0b6790 2021-11-12T05:41:03.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a4663700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa79c060500 con 0x7fa79c0b2ef0 2021-11-12T05:41:03.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a2c00700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fa79c146780 0x7fa79c0acab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:54408/0 (socket says 172.21.2.105:54408) 2021-11-12T05:41:03.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a2c00700 1 -- 172.21.2.105:0/3554995996 learned_addr learned my addr 172.21.2.105:0/3554995996 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:41:03.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a1bfe700 1 --2- 172.21.2.105:0/3554995996 >> v2:172.21.2.105:3300/0 conn(0x7fa79c0b2ef0 0x7fa79c0ab3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:03.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a1bfe700 1 -- 172.21.2.105:0/3554995996 >> v1:172.21.2.115:6789/0 conn(0x7fa79c0b6790 legacy=0x7fa79c05fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:03.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a1bfe700 1 -- 172.21.2.105:0/3554995996 >> v1:172.21.2.105:6789/0 conn(0x7fa79c146780 legacy=0x7fa79c0acab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:03.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a1bfe700 1 -- 172.21.2.105:0/3554995996 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79c0b3470 con 0x7fa79c0b2ef0 2021-11-12T05:41:03.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a1bfe700 1 --2- 172.21.2.105:0/3554995996 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa79c0b2ef0 0x7fa79c0ab3a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fa79c0b40c0 tx=0x7fa790006df0).ready entity=mon.0 client_cookie=5a7bda03885e32ec server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:03.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a13fd700 1 -- 172.21.2.105:0/3554995996 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa79000d5c0 con 0x7fa79c0b2ef0 2021-11-12T05:41:03.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a13fd700 1 -- 172.21.2.105:0/3554995996 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa790000e90 con 0x7fa79c0b2ef0 2021-11-12T05:41:03.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a13fd700 1 -- 172.21.2.105:0/3554995996 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa79000d910 con 0x7fa79c0b2ef0 2021-11-12T05:41:03.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a4663700 1 -- 172.21.2.105:0/3554995996 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa79c0b2ef0 msgr2=0x7fa79c0ab3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:03.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a4663700 1 --2- 172.21.2.105:0/3554995996 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa79c0b2ef0 0x7fa79c0ab3a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fa79c0b40c0 tx=0x7fa790006df0).stop 2021-11-12T05:41:03.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a4663700 1 -- 172.21.2.105:0/3554995996 shutdown_connections 2021-11-12T05:41:03.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a4663700 1 --2- 172.21.2.105:0/3554995996 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa79c0b2ef0 0x7fa79c0ab3a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:03.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a4663700 1 -- 172.21.2.105:0/3554995996 >> 172.21.2.105:0/3554995996 conn(0x7fa79c063610 msgr2=0x7fa79c0639f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:03.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a4663700 1 -- 172.21.2.105:0/3554995996 shutdown_connections 2021-11-12T05:41:03.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a4663700 1 -- 172.21.2.105:0/3554995996 wait complete. 2021-11-12T05:41:03.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a4663700 1 Processor -- start 2021-11-12T05:41:03.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a4663700 1 -- start start 2021-11-12T05:41:03.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a4663700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa79c0b2ef0 0x7fa79c0afc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:03.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a4663700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa79c0b6790 0x7fa79c065f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:03.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a4663700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa79c146780 0x7fa79c066480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:03.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a4663700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c0b0930 con 0x7fa79c0b2ef0 2021-11-12T05:41:03.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a4663700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c0655b0 con 0x7fa79c146780 2021-11-12T05:41:03.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a4663700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c065850 con 0x7fa79c0b6790 2021-11-12T05:41:03.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a23ff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa79c0b2ef0 0x7fa79c0afc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:03.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a23ff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa79c0b2ef0 0x7fa79c0afc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44018/0 (socket says 172.21.2.105:44018) 2021-11-12T05:41:03.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a23ff700 1 -- 172.21.2.105:0/1391514666 learned_addr learned my addr 172.21.2.105:0/1391514666 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:03.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a23ff700 1 -- 172.21.2.105:0/1391514666 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa79c0b6790 msgr2=0x7fa79c065f90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:41:03.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a23ff700 1 --2- 172.21.2.105:0/1391514666 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa79c0b6790 0x7fa79c065f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:03.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a23ff700 1 -- 172.21.2.105:0/1391514666 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa79c146780 msgr2=0x7fa79c066480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:03.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a23ff700 1 --2- 172.21.2.105:0/1391514666 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa79c146780 0x7fa79c066480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:03.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a23ff700 1 -- 172.21.2.105:0/1391514666 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79000b180 con 0x7fa79c0b2ef0 2021-11-12T05:41:03.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a23ff700 1 --2- 172.21.2.105:0/1391514666 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa79c0b2ef0 0x7fa79c0afc50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7fa798002f90 tx=0x7fa798006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:03.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa78f7fe700 1 -- 172.21.2.105:0/1391514666 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa798013460 con 0x7fa79c0b2ef0 2021-11-12T05:41:03.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a4663700 1 -- 172.21.2.105:0/1391514666 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa79c065af0 con 0x7fa79c0b2ef0 2021-11-12T05:41:03.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa78f7fe700 1 -- 172.21.2.105:0/1391514666 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7980135c0 con 0x7fa79c0b2ef0 2021-11-12T05:41:03.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa78f7fe700 1 -- 172.21.2.105:0/1391514666 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa798013920 con 0x7fa79c0b2ef0 2021-11-12T05:41:03.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.190+0000 7fa7a4663700 1 -- 172.21.2.105:0/1391514666 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa79c0671b0 con 0x7fa79c0b2ef0 2021-11-12T05:41:03.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.194+0000 7fa7a4663700 1 -- 172.21.2.105:0/1391514666 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa79c065c80 con 0x7fa79c0b2ef0 2021-11-12T05:41:03.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.194+0000 7fa78f7fe700 1 -- 172.21.2.105:0/1391514666 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa79801a060 con 0x7fa79c0b2ef0 2021-11-12T05:41:03.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.194+0000 7fa78f7fe700 1 --2- 172.21.2.105:0/1391514666 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa77c053610 0x7fa77c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:03.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.194+0000 7fa78f7fe700 1 -- 172.21.2.105:0/1391514666 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fa79806aff0 con 0x7fa79c0b2ef0 2021-11-12T05:41:03.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.194+0000 7fa7a1bfe700 1 --2- 172.21.2.105:0/1391514666 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa77c053610 0x7fa77c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:03.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.194+0000 7fa7a1bfe700 1 --2- 172.21.2.105:0/1391514666 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa77c053610 0x7fa77c055ad0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fa79c0b40c0 tx=0x7fa790012000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:03.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.194+0000 7fa78f7fe700 1 -- 172.21.2.105:0/1391514666 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa798042330 con 0x7fa79c0b2ef0 2021-11-12T05:41:03.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.310+0000 7fa7a4663700 1 -- 172.21.2.105:0/1391514666 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa79c05f6b0 con 0x7fa79c0b2ef0 2021-11-12T05:41:03.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.310+0000 7fa78f7fe700 1 -- 172.21.2.105:0/1391514666 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+5627 (secure 0 0 0) 0x7fa798018070 con 0x7fa79c0b2ef0 2021-11-12T05:41:03.312 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:41:03.313 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:41:03.313 INFO:teuthology.orchestra.run.gibba005.stdout: "auth_dump": [ 2021-11-12T05:41:03.313 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:41:03.313 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mds.a", 2021-11-12T05:41:03.313 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1hGVLeOhAAX2029T+USC1Um93TSzjxdA==", 2021-11-12T05:41:03.314 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:41:03.314 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:41:03.314 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:41:03.314 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:41:03.315 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:41:03.315 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:41:03.316 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:41:03.316 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:41:03.316 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mds.b", 2021-11-12T05:41:03.316 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hiebUAxAAGcjDAGyvecjzagGoRBX8tg==", 2021-11-12T05:41:03.317 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:41:03.317 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:41:03.317 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:41:03.317 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:41:03.317 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:41:03.318 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:41:03.318 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:41:03.318 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:41:03.318 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.0", 2021-11-12T05:41:03.319 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1ht05fORAAN2YrbsxBau1FQC4C8Dvb3g==", 2021-11-12T05:41:03.319 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:41:03.319 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:41:03.319 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:41:03.319 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:41:03.320 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:41:03.320 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:41:03.320 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:41:03.320 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.1", 2021-11-12T05:41:03.320 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAu/o1hzp1vGhAAQ6u3Npb+yNGlNOUdoHzFZA==", 2021-11-12T05:41:03.321 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:41:03.321 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:41:03.321 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:41:03.321 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:41:03.322 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:41:03.322 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:41:03.322 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:41:03.322 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.2", 2021-11-12T05:41:03.323 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAw/o1hHWwOOhAAx7txWG8rbch18+SBnJkfkQ==", 2021-11-12T05:41:03.323 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:41:03.323 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:41:03.323 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:41:03.323 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:41:03.324 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:41:03.324 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:41:03.324 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:41:03.324 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.3", 2021-11-12T05:41:03.325 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAz/o1howZpHxAAKgUVxU2tSNZbxW+6OfJF9g==", 2021-11-12T05:41:03.325 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:41:03.325 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:41:03.325 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:41:03.325 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:41:03.326 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:41:03.326 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:41:03.326 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:41:03.326 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.4", 2021-11-12T05:41:03.326 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA2/o1humA5KRAAVbO6UYLOBQDq3WiEkkS6xw==", 2021-11-12T05:41:03.327 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:41:03.327 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:41:03.327 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:41:03.327 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:41:03.327 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:41:03.328 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:41:03.328 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:41:03.328 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.5", 2021-11-12T05:41:03.328 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA5/o1hALdKDRAAR9nsaDOo9GUgpmBPHVp5HQ==", 2021-11-12T05:41:03.328 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:41:03.329 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:41:03.329 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:41:03.329 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:41:03.329 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:41:03.329 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:41:03.330 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:41:03.330 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.6", 2021-11-12T05:41:03.330 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA7/o1hCVP2KhAAHj5SxnJ81mKrJOg2CE2wLQ==", 2021-11-12T05:41:03.330 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:41:03.331 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:41:03.331 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:41:03.331 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:41:03.331 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:41:03.331 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:41:03.332 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:41:03.332 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.7", 2021-11-12T05:41:03.332 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA+/o1hWCEqEBAAv8nF9NeF2Ue5W8Ijj8Skgg==", 2021-11-12T05:41:03.332 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:41:03.332 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:41:03.332 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:41:03.333 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:41:03.333 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:41:03.333 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:41:03.333 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:41:03.333 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.0", 2021-11-12T05:41:03.334 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hzEzhCBAATF8giEBtrj13SAr5EJV4TA==", 2021-11-12T05:41:03.334 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:41:03.334 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:41:03.334 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow r", 2021-11-12T05:41:03.335 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow rw", 2021-11-12T05:41:03.335 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow rwx" 2021-11-12T05:41:03.335 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:41:03.335 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:41:03.335 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:41:03.336 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.1", 2021-11-12T05:41:03.336 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hO6zfCxAAae1obagtpsnA9e8FlTExVA==", 2021-11-12T05:41:03.336 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:41:03.336 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:41:03.337 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow r", 2021-11-12T05:41:03.337 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow rw", 2021-11-12T05:41:03.337 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow rwx" 2021-11-12T05:41:03.337 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:41:03.337 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:41:03.338 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:41:03.338 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.2", 2021-11-12T05:41:03.338 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hFYDGDhAAyz77VXKtOz86ztJ8FUIvAg==", 2021-11-12T05:41:03.338 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:41:03.339 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:41:03.339 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow r", 2021-11-12T05:41:03.339 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow rw", 2021-11-12T05:41:03.339 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow rwx" 2021-11-12T05:41:03.339 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:41:03.340 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:41:03.340 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:41:03.340 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.admin", 2021-11-12T05:41:03.340 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1hwdoBHRAAUHHEU3dbyso2BnE/JppV8A==", 2021-11-12T05:41:03.340 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:41:03.340 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow *", 2021-11-12T05:41:03.341 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:41:03.341 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:41:03.341 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:41:03.341 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:41:03.342 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:41:03.342 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:41:03.342 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.bootstrap-mds", 2021-11-12T05:41:03.342 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQBD/o1hO6HnOhAA+RlsqNXbCvmaXKgExscT2A==", 2021-11-12T05:41:03.342 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:41:03.343 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow profile bootstrap-mds" 2021-11-12T05:41:03.343 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:41:03.343 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:41:03.343 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:41:03.343 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.bootstrap-mgr", 2021-11-12T05:41:03.344 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQBD/o1h3MPnOhAAVp+pqFGI6qnT8/zhr9iIwg==", 2021-11-12T05:41:03.344 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:41:03.344 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow profile bootstrap-mgr" 2021-11-12T05:41:03.344 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:41:03.344 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:41:03.345 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:41:03.345 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.bootstrap-osd", 2021-11-12T05:41:03.345 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQBD/o1h+t/nOhAAH+rdjjBeGgeMnQu+lGC2jQ==", 2021-11-12T05:41:03.345 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:41:03.345 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow profile bootstrap-osd" 2021-11-12T05:41:03.346 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:41:03.346 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:41:03.346 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:41:03.346 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.bootstrap-rbd", 2021-11-12T05:41:03.347 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQBD/o1h+PrnOhAA1ax72OuZnXl82aHCbdTs+w==", 2021-11-12T05:41:03.347 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:41:03.347 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow profile bootstrap-rbd" 2021-11-12T05:41:03.347 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:41:03.347 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:41:03.348 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:41:03.348 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.bootstrap-rbd-mirror", 2021-11-12T05:41:03.348 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQBD/o1hdRroOhAAWSuCXYVbqfZfAbiO1Rn0yg==", 2021-11-12T05:41:03.348 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:41:03.348 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2021-11-12T05:41:03.349 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:41:03.349 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:41:03.349 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:41:03.349 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.bootstrap-rgw", 2021-11-12T05:41:03.349 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQBD/o1h6TfoOhAAqnqazfvwAfSaE9S1KZb5Qg==", 2021-11-12T05:41:03.350 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:41:03.350 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow profile bootstrap-rgw" 2021-11-12T05:41:03.350 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:41:03.350 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:41:03.351 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:41:03.351 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mgr.x", 2021-11-12T05:41:03.351 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1h6JBaORAAbgxQtCzGNj7MLfgwGd4cWA==", 2021-11-12T05:41:03.351 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:41:03.351 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow *", 2021-11-12T05:41:03.352 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow profile mgr", 2021-11-12T05:41:03.352 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:41:03.352 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:41:03.352 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:41:03.352 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:41:03.353 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mgr.y", 2021-11-12T05:41:03.353 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1hwfvvNRAASU7NmYBG/Yb6/ma1/Ew7mw==", 2021-11-12T05:41:03.353 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:41:03.353 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow *", 2021-11-12T05:41:03.354 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow profile mgr", 2021-11-12T05:41:03.354 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:41:03.354 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:41:03.354 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:41:03.354 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:41:03.355 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:41:03.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.310+0000 7fa7a4663700 1 -- 172.21.2.105:0/1391514666 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa77c053610 msgr2=0x7fa77c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:03.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.310+0000 7fa7a4663700 1 --2- 172.21.2.105:0/1391514666 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa77c053610 0x7fa77c055ad0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fa79c0b40c0 tx=0x7fa790012000).stop 2021-11-12T05:41:03.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.310+0000 7fa7a4663700 1 -- 172.21.2.105:0/1391514666 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa79c0b2ef0 msgr2=0x7fa79c0afc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:03.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.310+0000 7fa7a4663700 1 --2- 172.21.2.105:0/1391514666 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa79c0b2ef0 0x7fa79c0afc50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7fa798002f90 tx=0x7fa798006df0).stop 2021-11-12T05:41:03.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.310+0000 7fa7a4663700 1 -- 172.21.2.105:0/1391514666 shutdown_connections 2021-11-12T05:41:03.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.310+0000 7fa7a4663700 1 --2- 172.21.2.105:0/1391514666 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa77c053610 0x7fa77c055ad0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:03.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.310+0000 7fa7a4663700 1 --2- 172.21.2.105:0/1391514666 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa79c146780 0x7fa79c066480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:03.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.310+0000 7fa7a4663700 1 --2- 172.21.2.105:0/1391514666 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa79c0b6790 0x7fa79c065f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:03.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.310+0000 7fa7a4663700 1 --2- 172.21.2.105:0/1391514666 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa79c0b2ef0 0x7fa79c0afc50 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:03.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.310+0000 7fa7a4663700 1 -- 172.21.2.105:0/1391514666 >> 172.21.2.105:0/1391514666 conn(0x7fa79c063610 msgr2=0x7fa79c0acd30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:03.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.310+0000 7fa7a4663700 1 -- 172.21.2.105:0/1391514666 shutdown_connections 2021-11-12T05:41:03.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.310+0000 7fa7a4663700 1 -- 172.21.2.105:0/1391514666 wait complete. 2021-11-12T05:41:03.359 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2021-11-12T05:41:03.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bc31da700 1 Processor -- start 2021-11-12T05:41:03.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bc31da700 1 -- start start 2021-11-12T05:41:03.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bc31da700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f5bbc0626b0 0x7f5bbc062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:03.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bc31da700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bbc0b0d50 con 0x7f5bbc0af750 2021-11-12T05:41:03.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bc31da700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bbc0ad380 con 0x7f5bbc130a80 2021-11-12T05:41:03.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bc31da700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bbc0ae190 con 0x7f5bbc0626b0 2021-11-12T05:41:03.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bbbfff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f5bbc0af750 0x7f5bbc130370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:54422/0 (socket says 172.21.2.105:54422) 2021-11-12T05:41:03.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bbbfff700 1 -- 172.21.2.105:0/1657384955 learned_addr learned my addr 172.21.2.105:0/1657384955 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:41:03.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bbb7fe700 1 -- 172.21.2.105:0/1657384955 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1011352250 0 0) 0x7f5bbc0b0d50 con 0x7f5bbc0af750 2021-11-12T05:41:03.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bbb7fe700 1 -- 172.21.2.105:0/1657384955 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b9c003260 con 0x7f5bbc0af750 2021-11-12T05:41:03.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bc0f76700 1 --2- 172.21.2.105:0/1657384955 >> v2:172.21.2.115:3300/0 conn(0x7f5bbc0626b0 0x7f5bbc062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:03.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bbb7fe700 1 -- 172.21.2.105:0/1657384955 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2406467876 0 0) 0x7f5b9c003260 con 0x7f5bbc0af750 2021-11-12T05:41:03.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bbb7fe700 1 -- 172.21.2.105:0/1657384955 >> v2:172.21.2.115:3300/0 conn(0x7f5bbc0626b0 msgr2=0x7f5bbc062a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:03.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bbb7fe700 1 --2- 172.21.2.105:0/1657384955 >> v2:172.21.2.115:3300/0 conn(0x7f5bbc0626b0 0x7f5bbc062a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:03.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bbb7fe700 1 -- 172.21.2.105:0/1657384955 >> v1:172.21.2.115:6789/0 conn(0x7f5bbc130a80 legacy=0x7f5bbc1474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:03.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bbb7fe700 1 -- 172.21.2.105:0/1657384955 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bbc0ae2d0 con 0x7f5bbc0af750 2021-11-12T05:41:03.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bbb7fe700 1 -- 172.21.2.105:0/1657384955 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f5bac001660 con 0x7f5bbc0af750 2021-11-12T05:41:03.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bbb7fe700 1 -- 172.21.2.105:0/1657384955 >> v1:172.21.2.105:6789/0 conn(0x7f5bbc0af750 legacy=0x7f5bbc130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:03.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bbb7fe700 1 --2- 172.21.2.105:0/1657384955 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5b9c0037d0 0x7f5b9c003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:03.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bbb7fe700 1 --2- 172.21.2.105:0/1657384955 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5b9c004500 0x7f5b9c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:03.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bbb7fe700 1 --2- 172.21.2.105:0/1657384955 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5b9c004f90 0x7f5b9c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:03.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bbb7fe700 1 -- 172.21.2.105:0/1657384955 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc0ae190 con 0x7f5b9c004500 2021-11-12T05:41:03.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bbb7fe700 1 -- 172.21.2.105:0/1657384955 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c00be00 con 0x7f5b9c0037d0 2021-11-12T05:41:03.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bbb7fe700 1 -- 172.21.2.105:0/1657384955 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9c00bfc0 con 0x7f5b9c004f90 2021-11-12T05:41:03.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bbbfff700 1 --2- 172.21.2.105:0/1657384955 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5b9c004500 0x7f5b9c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:03.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bc0f76700 1 --2- 172.21.2.105:0/1657384955 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5b9c0037d0 0x7f5b9c003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:03.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bc1777700 1 --2- 172.21.2.105:0/1657384955 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5b9c004f90 0x7f5b9c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:03.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bbbfff700 1 -- 172.21.2.105:0/1657384955 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5b9c004f90 msgr2=0x7f5b9c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:03.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bbbfff700 1 --2- 172.21.2.105:0/1657384955 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5b9c004f90 0x7f5b9c00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:03.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bbbfff700 1 -- 172.21.2.105:0/1657384955 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5b9c0037d0 msgr2=0x7f5b9c003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:03.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bbbfff700 1 --2- 172.21.2.105:0/1657384955 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5b9c0037d0 0x7f5b9c003bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:03.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bbbfff700 1 -- 172.21.2.105:0/1657384955 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b9c003260 con 0x7f5b9c004500 2021-11-12T05:41:03.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bc1777700 1 --2- 172.21.2.105:0/1657384955 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5b9c004f90 0x7f5b9c00b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:41:03.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bc1777700 1 -- 172.21.2.105:0/1657384955 reap_dead start 2021-11-12T05:41:03.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bbbfff700 1 --2- 172.21.2.105:0/1657384955 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5b9c004500 0x7f5b9c004980 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f5bac001020 tx=0x7f5bac001e20).ready entity=mon.0 client_cookie=5c50a477f37d6bd server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:03.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bbb7fe700 1 -- 172.21.2.105:0/1657384955 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bac0070d0 con 0x7f5b9c004500 2021-11-12T05:41:03.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bbb7fe700 1 -- 172.21.2.105:0/1657384955 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bac007230 con 0x7f5b9c004500 2021-11-12T05:41:03.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bbb7fe700 1 -- 172.21.2.105:0/1657384955 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bac00c990 con 0x7f5b9c004500 2021-11-12T05:41:03.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bc31da700 1 -- 172.21.2.105:0/1657384955 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5b9c004500 msgr2=0x7f5b9c004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:03.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bc31da700 1 --2- 172.21.2.105:0/1657384955 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5b9c004500 0x7f5b9c004980 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f5bac001020 tx=0x7f5bac001e20).stop 2021-11-12T05:41:03.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bc31da700 1 -- 172.21.2.105:0/1657384955 shutdown_connections 2021-11-12T05:41:03.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bc31da700 1 --2- 172.21.2.105:0/1657384955 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5b9c004500 0x7f5b9c004980 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:03.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bc31da700 1 -- 172.21.2.105:0/1657384955 >> 172.21.2.105:0/1657384955 conn(0x7f5bbc0b5320 msgr2=0x7f5bbc0b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:03.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bc31da700 1 -- 172.21.2.105:0/1657384955 shutdown_connections 2021-11-12T05:41:03.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.410+0000 7f5bc31da700 1 -- 172.21.2.105:0/1657384955 wait complete. 2021-11-12T05:41:03.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.414+0000 7f5bc31da700 1 Processor -- start 2021-11-12T05:41:03.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.414+0000 7f5bc31da700 1 -- start start 2021-11-12T05:41:03.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.414+0000 7f5bc31da700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5b9c004500 0x7f5bbc148850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:03.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.414+0000 7f5bc31da700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5bbc12f3b0 0x7f5bbc156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:03.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.414+0000 7f5bc31da700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5bbc146280 0x7f5bbc12be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:03.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.414+0000 7f5bc31da700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc14b410 con 0x7f5bbc146280 2021-11-12T05:41:03.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.414+0000 7f5bc31da700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc1574f0 con 0x7f5b9c004500 2021-11-12T05:41:03.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.414+0000 7f5bc31da700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc1567f0 con 0x7f5bbc12f3b0 2021-11-12T05:41:03.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.414+0000 7f5bc1777700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5bbc146280 0x7f5bbc12be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:03.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.414+0000 7f5bc1777700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5bbc146280 0x7f5bbc12be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44040/0 (socket says 172.21.2.105:44040) 2021-11-12T05:41:03.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.414+0000 7f5bc1777700 1 -- 172.21.2.105:0/2025942068 learned_addr learned my addr 172.21.2.105:0/2025942068 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:03.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.414+0000 7f5bc0f76700 1 --2- 172.21.2.105:0/2025942068 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5b9c004500 0x7f5bbc148850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:03.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.414+0000 7f5bbbfff700 1 --2- 172.21.2.105:0/2025942068 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5bbc12f3b0 0x7f5bbc156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:03.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.414+0000 7f5bc1777700 1 -- 172.21.2.105:0/2025942068 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5bbc12f3b0 msgr2=0x7f5bbc156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:03.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.414+0000 7f5bc1777700 1 --2- 172.21.2.105:0/2025942068 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5bbc12f3b0 0x7f5bbc156300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:03.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.414+0000 7f5bc1777700 1 -- 172.21.2.105:0/2025942068 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5b9c004500 msgr2=0x7f5bbc148850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:03.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.414+0000 7f5bc1777700 1 --2- 172.21.2.105:0/2025942068 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5b9c004500 0x7f5bbc148850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:03.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.414+0000 7f5bc1777700 1 -- 172.21.2.105:0/2025942068 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bbc14b600 con 0x7f5bbc146280 2021-11-12T05:41:03.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.414+0000 7f5bc0f76700 1 --2- 172.21.2.105:0/2025942068 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5b9c004500 0x7f5bbc148850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:41:03.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.414+0000 7f5bbbfff700 1 --2- 172.21.2.105:0/2025942068 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5bbc12f3b0 0x7f5bbc156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:41:03.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.414+0000 7f5bc1777700 1 --2- 172.21.2.105:0/2025942068 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5bbc146280 0x7f5bbc12be70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f5bbc14abf0 tx=0x7f5bb4009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:03.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.414+0000 7f5bb9ffb700 1 -- 172.21.2.105:0/2025942068 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bb400dec0 con 0x7f5bbc146280 2021-11-12T05:41:03.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.414+0000 7f5bb9ffb700 1 -- 172.21.2.105:0/2025942068 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb40104e0 con 0x7f5bbc146280 2021-11-12T05:41:03.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.414+0000 7f5bc31da700 1 -- 172.21.2.105:0/2025942068 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bbc12df90 con 0x7f5bbc146280 2021-11-12T05:41:03.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.414+0000 7f5bc31da700 1 -- 172.21.2.105:0/2025942068 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bbc146950 con 0x7f5bbc146280 2021-11-12T05:41:03.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.414+0000 7f5bb9ffb700 1 -- 172.21.2.105:0/2025942068 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bb4010840 con 0x7f5bbc146280 2021-11-12T05:41:03.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.414+0000 7f5bc31da700 1 -- 172.21.2.105:0/2025942068 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bbc14b790 con 0x7f5bbc146280 2021-11-12T05:41:03.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.414+0000 7f5bb9ffb700 1 -- 172.21.2.105:0/2025942068 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5bb401a030 con 0x7f5bbc146280 2021-11-12T05:41:03.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.414+0000 7f5bb9ffb700 1 --2- 172.21.2.105:0/2025942068 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5ba0053570 0x7f5ba0055a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:03.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.414+0000 7f5bb9ffb700 1 -- 172.21.2.105:0/2025942068 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f5bb406af20 con 0x7f5bbc146280 2021-11-12T05:41:03.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.414+0000 7f5bc0f76700 1 --2- 172.21.2.105:0/2025942068 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5ba0053570 0x7f5ba0055a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:03.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.414+0000 7f5bc0f76700 1 --2- 172.21.2.105:0/2025942068 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5ba0053570 0x7f5ba0055a30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f5ba400c000 tx=0x7f5ba4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:03.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.418+0000 7f5bb9ffb700 1 -- 172.21.2.105:0/2025942068 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5bb4042150 con 0x7f5bbc146280 2021-11-12T05:41:03.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.526+0000 7f5bc31da700 1 -- 172.21.2.105:0/2025942068 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f5bbc12e120 con 0x7f5bbc146280 2021-11-12T05:41:03.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.534+0000 7f5bb9ffb700 1 -- 172.21.2.105:0/2025942068 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 updated v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5bb4045770 con 0x7f5bbc146280 2021-11-12T05:41:03.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.534+0000 7f5bc31da700 1 -- 172.21.2.105:0/2025942068 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5ba0053570 msgr2=0x7f5ba0055a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:03.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.534+0000 7f5bc31da700 1 --2- 172.21.2.105:0/2025942068 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5ba0053570 0x7f5ba0055a30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f5ba400c000 tx=0x7f5ba4008040).stop 2021-11-12T05:41:03.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.534+0000 7f5bc31da700 1 -- 172.21.2.105:0/2025942068 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5bbc146280 msgr2=0x7f5bbc12be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:03.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.534+0000 7f5bc31da700 1 --2- 172.21.2.105:0/2025942068 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5bbc146280 0x7f5bbc12be70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f5bbc14abf0 tx=0x7f5bb4009040).stop 2021-11-12T05:41:03.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.534+0000 7f5bc31da700 1 -- 172.21.2.105:0/2025942068 shutdown_connections 2021-11-12T05:41:03.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.534+0000 7f5bc31da700 1 --2- 172.21.2.105:0/2025942068 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5ba0053570 0x7f5ba0055a30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:03.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.534+0000 7f5bc31da700 1 --2- 172.21.2.105:0/2025942068 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5bbc146280 0x7f5bbc12be70 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:03.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.534+0000 7f5bc31da700 1 --2- 172.21.2.105:0/2025942068 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5bbc12f3b0 0x7f5bbc156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:03.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.534+0000 7f5bc31da700 1 --2- 172.21.2.105:0/2025942068 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5b9c004500 0x7f5bbc148850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:03.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.534+0000 7f5bc31da700 1 -- 172.21.2.105:0/2025942068 >> 172.21.2.105:0/2025942068 conn(0x7f5bbc0b5320 msgr2=0x7f5bbc060410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:03.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.534+0000 7f5bc31da700 1 -- 172.21.2.105:0/2025942068 shutdown_connections 2021-11-12T05:41:03.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.534+0000 7f5bc31da700 1 -- 172.21.2.105:0/2025942068 wait complete. 2021-11-12T05:41:03.540 INFO:teuthology.orchestra.run.gibba005.stderr:updated 2021-11-12T05:41:03.543 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2021-11-12T05:41:03.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ffd523700 1 Processor -- start 2021-11-12T05:41:03.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ffd523700 1 -- start start 2021-11-12T05:41:03.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ffd523700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f5ff80af750 0x7f5ff8062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:03.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ffd523700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff80b0d50 con 0x7f5ff8130a80 2021-11-12T05:41:03.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ffd523700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff80ad380 con 0x7f5ff80626b0 2021-11-12T05:41:03.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ffd523700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff80ae190 con 0x7f5ff80af750 2021-11-12T05:41:03.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ff77fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f5ff8130a80 0x7f5ff81474d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:54442/0 (socket says 172.21.2.105:54442) 2021-11-12T05:41:03.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ff77fe700 1 -- 172.21.2.105:0/3109032208 learned_addr learned my addr 172.21.2.105:0/3109032208 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:41:03.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ff5ffb700 1 -- 172.21.2.105:0/3109032208 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1003784398 0 0) 0x7f5ff80b0d50 con 0x7f5ff8130a80 2021-11-12T05:41:03.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ff5ffb700 1 -- 172.21.2.105:0/3109032208 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fd8003260 con 0x7f5ff8130a80 2021-11-12T05:41:03.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ff67fc700 1 --2- 172.21.2.105:0/3109032208 >> v2:172.21.2.115:3300/0 conn(0x7f5ff80af750 0x7f5ff8062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:03.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ff5ffb700 1 -- 172.21.2.105:0/3109032208 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2351031084 0 0) 0x7f5fd8003260 con 0x7f5ff8130a80 2021-11-12T05:41:03.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ff5ffb700 1 -- 172.21.2.105:0/3109032208 >> v2:172.21.2.115:3300/0 conn(0x7f5ff80af750 msgr2=0x7f5ff8062a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:03.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ff5ffb700 1 --2- 172.21.2.105:0/3109032208 >> v2:172.21.2.115:3300/0 conn(0x7f5ff80af750 0x7f5ff8062a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:03.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ff5ffb700 1 -- 172.21.2.105:0/3109032208 >> v1:172.21.2.115:6789/0 conn(0x7f5ff80626b0 legacy=0x7f5ff8130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:03.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ff5ffb700 1 -- 172.21.2.105:0/3109032208 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff80ae2d0 con 0x7f5ff8130a80 2021-11-12T05:41:03.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ff5ffb700 1 -- 172.21.2.105:0/3109032208 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f5ff00019e0 con 0x7f5ff8130a80 2021-11-12T05:41:03.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ff5ffb700 1 -- 172.21.2.105:0/3109032208 >> v1:172.21.2.105:6789/0 conn(0x7f5ff8130a80 legacy=0x7f5ff81474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:03.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ff5ffb700 1 --2- 172.21.2.105:0/3109032208 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5fd8003820 0x7f5fd8003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:03.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ff5ffb700 1 --2- 172.21.2.105:0/3109032208 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5fd8004500 0x7f5fd8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:03.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ff5ffb700 1 --2- 172.21.2.105:0/3109032208 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5fd8004f70 0x7f5fd800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:03.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ff5ffb700 1 -- 172.21.2.105:0/3109032208 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff80ae190 con 0x7f5fd8004500 2021-11-12T05:41:03.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ff5ffb700 1 -- 172.21.2.105:0/3109032208 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd800be50 con 0x7f5fd8004f70 2021-11-12T05:41:03.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ff5ffb700 1 -- 172.21.2.105:0/3109032208 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd800c010 con 0x7f5fd8003820 2021-11-12T05:41:03.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ff67fc700 1 --2- 172.21.2.105:0/3109032208 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5fd8004500 0x7f5fd8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:03.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ff6ffd700 1 --2- 172.21.2.105:0/3109032208 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5fd8003820 0x7f5fd8003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:03.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ff67fc700 1 -- 172.21.2.105:0/3109032208 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5fd8003820 msgr2=0x7f5fd8003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:03.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ff67fc700 1 --2- 172.21.2.105:0/3109032208 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5fd8003820 0x7f5fd8003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:03.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ff67fc700 1 -- 172.21.2.105:0/3109032208 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5fd8004f70 msgr2=0x7f5fd800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:03.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ff67fc700 1 --2- 172.21.2.105:0/3109032208 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5fd8004f70 0x7f5fd800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:03.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ff77fe700 1 -- 172.21.2.105:0/3109032208 reap_dead start 2021-11-12T05:41:03.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ff67fc700 1 -- 172.21.2.105:0/3109032208 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd8003260 con 0x7f5fd8004500 2021-11-12T05:41:03.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ff6ffd700 1 --2- 172.21.2.105:0/3109032208 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5fd8003820 0x7f5fd8003c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:41:03.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ff67fc700 1 --2- 172.21.2.105:0/3109032208 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5fd8004500 0x7f5fd8004980 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f5fe000a000 tx=0x7f5fe0008040).ready entity=mon.0 client_cookie=9c753e85b8e510c4 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:03.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ff5ffb700 1 -- 172.21.2.105:0/3109032208 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fe0013670 con 0x7f5fd8004500 2021-11-12T05:41:03.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ff5ffb700 1 -- 172.21.2.105:0/3109032208 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe00137d0 con 0x7f5fd8004500 2021-11-12T05:41:03.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ff5ffb700 1 -- 172.21.2.105:0/3109032208 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fe0013b30 con 0x7f5fd8004500 2021-11-12T05:41:03.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ffd523700 1 -- 172.21.2.105:0/3109032208 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5fd8004500 msgr2=0x7f5fd8004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:03.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ffd523700 1 --2- 172.21.2.105:0/3109032208 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5fd8004500 0x7f5fd8004980 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f5fe000a000 tx=0x7f5fe0008040).stop 2021-11-12T05:41:03.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ffd523700 1 -- 172.21.2.105:0/3109032208 shutdown_connections 2021-11-12T05:41:03.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ffd523700 1 --2- 172.21.2.105:0/3109032208 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5fd8004500 0x7f5fd8004980 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:03.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ffd523700 1 -- 172.21.2.105:0/3109032208 >> 172.21.2.105:0/3109032208 conn(0x7f5ff80b5320 msgr2=0x7f5ff80b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:03.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ffd523700 1 -- 172.21.2.105:0/3109032208 shutdown_connections 2021-11-12T05:41:03.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ffd523700 1 -- 172.21.2.105:0/3109032208 wait complete. 2021-11-12T05:41:03.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ffd523700 1 Processor -- start 2021-11-12T05:41:03.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ffd523700 1 -- start start 2021-11-12T05:41:03.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ffd523700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5fd8004500 0x7f5ff80b3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:03.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ffd523700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5ff8065970 0x7f5ff8156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:03.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ffd523700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5ff80661e0 0x7f5ff8066670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:03.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ffd523700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff8066b60 con 0x7f5fd8004500 2021-11-12T05:41:03.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ffd523700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff8063990 con 0x7f5ff80661e0 2021-11-12T05:41:03.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ffd523700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff8063bf0 con 0x7f5ff8065970 2021-11-12T05:41:03.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ff6ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5fd8004500 0x7f5ff80b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:03.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.594+0000 7f5ff6ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5fd8004500 0x7f5ff80b3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44058/0 (socket says 172.21.2.105:44058) 2021-11-12T05:41:03.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.598+0000 7f5ff6ffd700 1 -- 172.21.2.105:0/1470000534 learned_addr learned my addr 172.21.2.105:0/1470000534 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:03.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.598+0000 7f5ff6ffd700 1 -- 172.21.2.105:0/1470000534 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5ff8065970 msgr2=0x7f5ff8156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:03.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.598+0000 7f5ff6ffd700 1 --2- 172.21.2.105:0/1470000534 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5ff8065970 0x7f5ff8156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:03.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.598+0000 7f5ff6ffd700 1 -- 172.21.2.105:0/1470000534 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5ff80661e0 msgr2=0x7f5ff8066670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:03.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.598+0000 7f5ff6ffd700 1 --2- 172.21.2.105:0/1470000534 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5ff80661e0 0x7f5ff8066670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:03.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.598+0000 7f5ff6ffd700 1 -- 172.21.2.105:0/1470000534 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff8063e90 con 0x7f5fd8004500 2021-11-12T05:41:03.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.598+0000 7f5ff6ffd700 1 --2- 172.21.2.105:0/1470000534 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5fd8004500 0x7f5ff80b3490 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f5fe8008000 tx=0x7f5fe8009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:03.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.598+0000 7f5feffff700 1 -- 172.21.2.105:0/1470000534 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fe8012410 con 0x7f5fd8004500 2021-11-12T05:41:03.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.598+0000 7f5feffff700 1 -- 172.21.2.105:0/1470000534 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe8000e90 con 0x7f5fd8004500 2021-11-12T05:41:03.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.598+0000 7f5ffd523700 1 -- 172.21.2.105:0/1470000534 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff8064930 con 0x7f5fd8004500 2021-11-12T05:41:03.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.598+0000 7f5feffff700 1 -- 172.21.2.105:0/1470000534 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fe80127a0 con 0x7f5fd8004500 2021-11-12T05:41:03.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.598+0000 7f5ffd523700 1 -- 172.21.2.105:0/1470000534 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff80646f0 con 0x7f5fd8004500 2021-11-12T05:41:03.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.598+0000 7f5ffd523700 1 -- 172.21.2.105:0/1470000534 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff8062a90 con 0x7f5fd8004500 2021-11-12T05:41:03.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.598+0000 7f5feffff700 1 -- 172.21.2.105:0/1470000534 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5fe8019030 con 0x7f5fd8004500 2021-11-12T05:41:03.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.598+0000 7f5feffff700 1 --2- 172.21.2.105:0/1470000534 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5fdc053580 0x7f5fdc055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:03.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.598+0000 7f5feffff700 1 -- 172.21.2.105:0/1470000534 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f5fe806ae00 con 0x7f5fd8004500 2021-11-12T05:41:03.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.598+0000 7f5ff67fc700 1 --2- 172.21.2.105:0/1470000534 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5fdc053580 0x7f5fdc055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:03.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.598+0000 7f5ff67fc700 1 --2- 172.21.2.105:0/1470000534 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5fdc053580 0x7f5fdc055a40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f5fe000a000 tx=0x7f5fe0017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:03.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.602+0000 7f5feffff700 1 -- 172.21.2.105:0/1470000534 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5fe8041fd0 con 0x7f5fd8004500 2021-11-12T05:41:03.718 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.714+0000 7f5ffd523700 1 -- 172.21.2.105:0/1470000534 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f5ff8057350 con 0x7f5fd8004500 2021-11-12T05:41:03.723 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.722+0000 7f5feffff700 1 -- 172.21.2.105:0/1470000534 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 updated v8) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5fe80455f0 con 0x7f5fd8004500 2021-11-12T05:41:03.724 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.722+0000 7f5ffd523700 1 -- 172.21.2.105:0/1470000534 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5fdc053580 msgr2=0x7f5fdc055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:03.724 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.722+0000 7f5ffd523700 1 --2- 172.21.2.105:0/1470000534 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5fdc053580 0x7f5fdc055a40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f5fe000a000 tx=0x7f5fe0017000).stop 2021-11-12T05:41:03.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.722+0000 7f5ffd523700 1 -- 172.21.2.105:0/1470000534 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5fd8004500 msgr2=0x7f5ff80b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:03.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.722+0000 7f5ffd523700 1 --2- 172.21.2.105:0/1470000534 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5fd8004500 0x7f5ff80b3490 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f5fe8008000 tx=0x7f5fe8009040).stop 2021-11-12T05:41:03.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.722+0000 7f5ffd523700 1 -- 172.21.2.105:0/1470000534 shutdown_connections 2021-11-12T05:41:03.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.722+0000 7f5ffd523700 1 --2- 172.21.2.105:0/1470000534 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5fdc053580 0x7f5fdc055a40 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:03.726 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.722+0000 7f5ffd523700 1 --2- 172.21.2.105:0/1470000534 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5ff80661e0 0x7f5ff8066670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:03.726 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.722+0000 7f5ffd523700 1 --2- 172.21.2.105:0/1470000534 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5ff8065970 0x7f5ff8156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:03.726 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.722+0000 7f5ffd523700 1 --2- 172.21.2.105:0/1470000534 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5fd8004500 0x7f5ff80b3490 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:03.726 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.722+0000 7f5ffd523700 1 -- 172.21.2.105:0/1470000534 >> 172.21.2.105:0/1470000534 conn(0x7f5ff80b5320 msgr2=0x7f5ff812ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:03.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.722+0000 7f5ffd523700 1 -- 172.21.2.105:0/1470000534 shutdown_connections 2021-11-12T05:41:03.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.722+0000 7f5ffd523700 1 -- 172.21.2.105:0/1470000534 wait complete. 2021-11-12T05:41:03.727 INFO:teuthology.orchestra.run.gibba005.stderr:updated 2021-11-12T05:41:03.731 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2021-11-12T05:41:03.782 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.778+0000 7f935091e700 1 Processor -- start 2021-11-12T05:41:03.782 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.778+0000 7f935091e700 1 -- start start 2021-11-12T05:41:03.784 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.778+0000 7f935091e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f934c0af750 0x7f934c062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:03.784 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.778+0000 7f935091e700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f934c130a80 0x7f934c1474d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:03.784 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.778+0000 7f935091e700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f934c0b0d50 con 0x7f934c0626b0 2021-11-12T05:41:03.785 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.778+0000 7f935091e700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f934c0ad380 con 0x7f934c130a80 2021-11-12T05:41:03.785 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.778+0000 7f935091e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f934c0ae190 con 0x7f934c0af750 2021-11-12T05:41:03.785 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.778+0000 7f934ad9d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f934c130a80 0x7f934c1474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:03.785 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.778+0000 7f934ad9d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f934c130a80 0x7f934c1474d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44068/0 (socket says 172.21.2.105:44068) 2021-11-12T05:41:03.786 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.778+0000 7f934ad9d700 1 -- 172.21.2.105:0/3835309421 learned_addr learned my addr 172.21.2.105:0/3835309421 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:03.786 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f934ad9d700 1 -- 172.21.2.105:0/3835309421 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f934c0af750 msgr2=0x7f934c062a90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:41:03.786 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f934ad9d700 1 --2- 172.21.2.105:0/3835309421 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f934c0af750 0x7f934c062a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:03.786 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f934ad9d700 1 -- 172.21.2.105:0/3835309421 >> v1:172.21.2.115:6789/0 conn(0x7f934c0626b0 legacy=0x7f934c130370 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:41:03.787 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f934ad9d700 1 -- 172.21.2.105:0/3835309421 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934c1479c0 con 0x7f934c130a80 2021-11-12T05:41:03.787 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f934ad9d700 1 --2- 172.21.2.105:0/3835309421 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f934c130a80 0x7f934c1474d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f934c0af1d0 tx=0x7f9344009290).ready entity=mon.0 client_cookie=65cecc4640504d5 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:03.787 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f934959a700 1 -- 172.21.2.105:0/3835309421 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f934400b860 con 0x7f934c130a80 2021-11-12T05:41:03.787 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f934959a700 1 -- 172.21.2.105:0/3835309421 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934400b9c0 con 0x7f934c130a80 2021-11-12T05:41:03.787 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f934959a700 1 -- 172.21.2.105:0/3835309421 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f934400bb70 con 0x7f934c130a80 2021-11-12T05:41:03.788 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f935091e700 1 -- 172.21.2.105:0/3835309421 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f934c130a80 msgr2=0x7f934c1474d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:03.788 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f935091e700 1 --2- 172.21.2.105:0/3835309421 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f934c130a80 0x7f934c1474d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f934c0af1d0 tx=0x7f9344009290).stop 2021-11-12T05:41:03.788 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f935091e700 1 -- 172.21.2.105:0/3835309421 shutdown_connections 2021-11-12T05:41:03.788 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f935091e700 1 --2- 172.21.2.105:0/3835309421 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f934c130a80 0x7f934c1474d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:03.789 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f935091e700 1 --2- 172.21.2.105:0/3835309421 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f934c0af750 0x7f934c062a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:03.789 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f935091e700 1 -- 172.21.2.105:0/3835309421 >> 172.21.2.105:0/3835309421 conn(0x7f934c0b5320 msgr2=0x7f934c0b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:03.789 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f935091e700 1 -- 172.21.2.105:0/3835309421 shutdown_connections 2021-11-12T05:41:03.789 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f935091e700 1 -- 172.21.2.105:0/3835309421 wait complete. 2021-11-12T05:41:03.789 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f935091e700 1 Processor -- start 2021-11-12T05:41:03.790 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f935091e700 1 -- start start 2021-11-12T05:41:03.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f935091e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f934c0626b0 0x7f934c14abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:03.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f935091e700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f934c0af750 0x7f934c14d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:03.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f935091e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f934c130a80 0x7f934c064410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:03.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f935091e700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934c0635e0 con 0x7f934c130a80 2021-11-12T05:41:03.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f935091e700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934c14c500 con 0x7f934c0af750 2021-11-12T05:41:03.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f935091e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f934c14c730 con 0x7f934c0626b0 2021-11-12T05:41:03.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f934ad9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f934c130a80 0x7f934c064410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:03.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f934ad9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f934c130a80 0x7f934c064410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44074/0 (socket says 172.21.2.105:44074) 2021-11-12T05:41:03.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f934ad9d700 1 -- 172.21.2.105:0/1562313163 learned_addr learned my addr 172.21.2.105:0/1562313163 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:03.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f934a59c700 1 --2- 172.21.2.105:0/1562313163 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f934c0626b0 0x7f934c14abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:03.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f9349d9b700 1 --2- 172.21.2.105:0/1562313163 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f934c0af750 0x7f934c14d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:03.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f934ad9d700 1 -- 172.21.2.105:0/1562313163 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f934c0626b0 msgr2=0x7f934c14abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:03.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f934ad9d700 1 --2- 172.21.2.105:0/1562313163 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f934c0626b0 0x7f934c14abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:03.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f934ad9d700 1 -- 172.21.2.105:0/1562313163 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f934c0af750 msgr2=0x7f934c14d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:03.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f934ad9d700 1 --2- 172.21.2.105:0/1562313163 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f934c0af750 0x7f934c14d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:03.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f934ad9d700 1 -- 172.21.2.105:0/1562313163 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9344009530 con 0x7f934c130a80 2021-11-12T05:41:03.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f934ad9d700 1 --2- 172.21.2.105:0/1562313163 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f934c130a80 0x7f934c064410 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f934c0af1d0 tx=0x7f9344016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:03.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f93437fe700 1 -- 172.21.2.105:0/1562313163 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9344021620 con 0x7f934c130a80 2021-11-12T05:41:03.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f93437fe700 1 -- 172.21.2.105:0/1562313163 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9344021780 con 0x7f934c130a80 2021-11-12T05:41:03.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f935091e700 1 -- 172.21.2.105:0/1562313163 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f934c148930 con 0x7f934c130a80 2021-11-12T05:41:03.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f93437fe700 1 -- 172.21.2.105:0/1562313163 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9344021ae0 con 0x7f934c130a80 2021-11-12T05:41:03.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.782+0000 7f935091e700 1 -- 172.21.2.105:0/1562313163 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f934c14a790 con 0x7f934c130a80 2021-11-12T05:41:03.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.786+0000 7f935091e700 1 -- 172.21.2.105:0/1562313163 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f934c149930 con 0x7f934c130a80 2021-11-12T05:41:03.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.786+0000 7f93437fe700 1 -- 172.21.2.105:0/1562313163 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f934400f070 con 0x7f934c130a80 2021-11-12T05:41:03.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.786+0000 7f93437fe700 1 --2- 172.21.2.105:0/1562313163 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f93300536d0 0x7f9330055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:03.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.786+0000 7f93437fe700 1 -- 172.21.2.105:0/1562313163 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f934406cd80 con 0x7f934c130a80 2021-11-12T05:41:03.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.786+0000 7f934a59c700 1 --2- 172.21.2.105:0/1562313163 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f93300536d0 0x7f9330055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:03.798 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.786+0000 7f934a59c700 1 --2- 172.21.2.105:0/1562313163 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f93300536d0 0x7f9330055b90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f933c00a000 tx=0x7f933c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:03.798 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.786+0000 7f93437fe700 1 -- 172.21.2.105:0/1562313163 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f934c149930 con 0x7f934c130a80 2021-11-12T05:41:03.903 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.902+0000 7f935091e700 1 -- 172.21.2.105:0/1562313163 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f934c064150 con 0x7f934c130a80 2021-11-12T05:41:03.908 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.906+0000 7f93437fe700 1 -- 172.21.2.105:0/1562313163 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 updated v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f934c064150 con 0x7f934c130a80 2021-11-12T05:41:03.909 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.906+0000 7f935091e700 1 -- 172.21.2.105:0/1562313163 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f93300536d0 msgr2=0x7f9330055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:03.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.906+0000 7f935091e700 1 --2- 172.21.2.105:0/1562313163 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f93300536d0 0x7f9330055b90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f933c00a000 tx=0x7f933c008040).stop 2021-11-12T05:41:03.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.906+0000 7f935091e700 1 -- 172.21.2.105:0/1562313163 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f934c130a80 msgr2=0x7f934c064410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:03.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.906+0000 7f935091e700 1 --2- 172.21.2.105:0/1562313163 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f934c130a80 0x7f934c064410 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f934c0af1d0 tx=0x7f9344016000).stop 2021-11-12T05:41:03.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.906+0000 7f935091e700 1 -- 172.21.2.105:0/1562313163 shutdown_connections 2021-11-12T05:41:03.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.906+0000 7f935091e700 1 --2- 172.21.2.105:0/1562313163 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f93300536d0 0x7f9330055b90 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:03.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.906+0000 7f935091e700 1 --2- 172.21.2.105:0/1562313163 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f934c130a80 0x7f934c064410 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:03.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.906+0000 7f935091e700 1 --2- 172.21.2.105:0/1562313163 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f934c0af750 0x7f934c14d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:03.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.906+0000 7f935091e700 1 --2- 172.21.2.105:0/1562313163 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f934c0626b0 0x7f934c14abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:03.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.906+0000 7f935091e700 1 -- 172.21.2.105:0/1562313163 >> 172.21.2.105:0/1562313163 conn(0x7f934c0b5320 msgr2=0x7f934c0ad580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:03.912 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.906+0000 7f935091e700 1 -- 172.21.2.105:0/1562313163 shutdown_connections 2021-11-12T05:41:03.912 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.906+0000 7f935091e700 1 -- 172.21.2.105:0/1562313163 wait complete. 2021-11-12T05:41:03.912 INFO:teuthology.orchestra.run.gibba005.stderr:updated 2021-11-12T05:41:03.916 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2021-11-12T05:41:03.967 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.966+0000 7f992bf86700 1 Processor -- start 2021-11-12T05:41:03.968 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.966+0000 7f992bf86700 1 -- start start 2021-11-12T05:41:03.969 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.966+0000 7f992bf86700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f99240af750 0x7f9924062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:03.969 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.966+0000 7f992bf86700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99240b0d50 con 0x7f99240626b0 2021-11-12T05:41:03.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.966+0000 7f992bf86700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99240ad380 con 0x7f9924130a80 2021-11-12T05:41:03.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.966+0000 7f992bf86700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99240ae190 con 0x7f99240af750 2021-11-12T05:41:03.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.966+0000 7f9929d22700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f99240626b0 0x7f9924130370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:54476/0 (socket says 172.21.2.105:54476) 2021-11-12T05:41:03.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.966+0000 7f9929d22700 1 -- 172.21.2.105:0/1089831524 learned_addr learned my addr 172.21.2.105:0/1089831524 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:41:03.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.966+0000 7f9929521700 1 --2- 172.21.2.105:0/1089831524 >> v2:172.21.2.115:3300/0 conn(0x7f99240af750 0x7f9924062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:03.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.966+0000 7f9928d20700 1 -- 172.21.2.105:0/1089831524 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3129675421 0 0) 0x7f99240b0d50 con 0x7f99240626b0 2021-11-12T05:41:03.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.966+0000 7f9928d20700 1 -- 172.21.2.105:0/1089831524 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f990c003260 con 0x7f99240626b0 2021-11-12T05:41:03.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.966+0000 7f9929521700 1 -- 172.21.2.105:0/1089831524 >> v1:172.21.2.115:6789/0 conn(0x7f9924130a80 legacy=0x7f99241474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:03.972 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.966+0000 7f9929521700 1 -- 172.21.2.105:0/1089831524 >> v1:172.21.2.105:6789/0 conn(0x7f99240626b0 legacy=0x7f9924130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:03.972 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.966+0000 7f9929521700 1 -- 172.21.2.105:0/1089831524 --> v2:172.21.2.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99240ae2d0 con 0x7f99240af750 2021-11-12T05:41:03.972 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.966+0000 7f9929521700 1 --2- 172.21.2.105:0/1089831524 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f99240af750 0x7f9924062a90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f991c0032f0 tx=0x7f991c0091d0).ready entity=mon.1 client_cookie=4fe607954e610a45 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:03.972 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.966+0000 7f9928d20700 1 -- 172.21.2.105:0/1089831524 <== mon.1 v2:172.21.2.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f991c00b6c0 con 0x7f99240af750 2021-11-12T05:41:03.972 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.966+0000 7f9928d20700 1 -- 172.21.2.105:0/1089831524 <== mon.1 v2:172.21.2.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991c00b820 con 0x7f99240af750 2021-11-12T05:41:03.973 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.966+0000 7f9928d20700 1 -- 172.21.2.105:0/1089831524 <== mon.1 v2:172.21.2.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f991c00b990 con 0x7f99240af750 2021-11-12T05:41:03.975 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.966+0000 7f992bf86700 1 -- 172.21.2.105:0/1089831524 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f99240af750 msgr2=0x7f9924062a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:03.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.966+0000 7f992bf86700 1 --2- 172.21.2.105:0/1089831524 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f99240af750 0x7f9924062a90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f991c0032f0 tx=0x7f991c0091d0).stop 2021-11-12T05:41:03.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.966+0000 7f992bf86700 1 -- 172.21.2.105:0/1089831524 shutdown_connections 2021-11-12T05:41:03.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.966+0000 7f992bf86700 1 --2- 172.21.2.105:0/1089831524 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f99240af750 0x7f9924062a90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:03.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.966+0000 7f992bf86700 1 -- 172.21.2.105:0/1089831524 >> 172.21.2.105:0/1089831524 conn(0x7f99240b5320 msgr2=0x7f99240b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:03.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.966+0000 7f992bf86700 1 -- 172.21.2.105:0/1089831524 shutdown_connections 2021-11-12T05:41:03.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.966+0000 7f992bf86700 1 -- 172.21.2.105:0/1089831524 wait complete. 2021-11-12T05:41:03.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.970+0000 7f992bf86700 1 Processor -- start 2021-11-12T05:41:03.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.970+0000 7f992bf86700 1 -- start start 2021-11-12T05:41:03.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.970+0000 7f992bf86700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99240626b0 0x7f9924065f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:03.978 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.970+0000 7f992bf86700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f99240af750 0x7f99240b4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:03.978 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.970+0000 7f992bf86700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9924130a80 0x7f9924062fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:03.978 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.970+0000 7f992bf86700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992414aac0 con 0x7f99240626b0 2021-11-12T05:41:03.978 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.970+0000 7f992bf86700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9924064940 con 0x7f99240af750 2021-11-12T05:41:03.979 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.970+0000 7f992bf86700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9924065530 con 0x7f9924130a80 2021-11-12T05:41:03.979 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.970+0000 7f9929d22700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99240626b0 0x7f9924065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:03.979 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.970+0000 7f9929d22700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99240626b0 0x7f9924065f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44086/0 (socket says 172.21.2.105:44086) 2021-11-12T05:41:03.979 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.970+0000 7f9929d22700 1 -- 172.21.2.105:0/473820207 learned_addr learned my addr 172.21.2.105:0/473820207 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:03.979 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.970+0000 7f9929521700 1 --2- 172.21.2.105:0/473820207 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f99240af750 0x7f99240b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:03.980 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.970+0000 7f992a523700 1 --2- 172.21.2.105:0/473820207 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9924130a80 0x7f9924062fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:03.980 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.970+0000 7f9929d22700 1 -- 172.21.2.105:0/473820207 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9924130a80 msgr2=0x7f9924062fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:03.980 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.970+0000 7f9929d22700 1 --2- 172.21.2.105:0/473820207 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9924130a80 0x7f9924062fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:03.980 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.970+0000 7f9929d22700 1 -- 172.21.2.105:0/473820207 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f99240af750 msgr2=0x7f99240b4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:03.981 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.970+0000 7f9929d22700 1 --2- 172.21.2.105:0/473820207 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f99240af750 0x7f99240b4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:03.981 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.970+0000 7f9929d22700 1 -- 172.21.2.105:0/473820207 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991c009470 con 0x7f99240626b0 2021-11-12T05:41:03.981 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.970+0000 7f9929d22700 1 --2- 172.21.2.105:0/473820207 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99240626b0 0x7f9924065f10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f9914001110 tx=0x7f9914007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:03.981 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.970+0000 7f9912ffd700 1 -- 172.21.2.105:0/473820207 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f991400ce20 con 0x7f99240626b0 2021-11-12T05:41:03.981 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.970+0000 7f9912ffd700 1 -- 172.21.2.105:0/473820207 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99140072e0 con 0x7f99240626b0 2021-11-12T05:41:03.982 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.970+0000 7f992bf86700 1 -- 172.21.2.105:0/473820207 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99240657d0 con 0x7f99240626b0 2021-11-12T05:41:03.982 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.970+0000 7f9912ffd700 1 -- 172.21.2.105:0/473820207 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9914005800 con 0x7f99240626b0 2021-11-12T05:41:03.982 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.970+0000 7f992bf86700 1 -- 172.21.2.105:0/473820207 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f992414b4d0 con 0x7f99240626b0 2021-11-12T05:41:03.982 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.970+0000 7f992bf86700 1 -- 172.21.2.105:0/473820207 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9924147be0 con 0x7f99240626b0 2021-11-12T05:41:03.982 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.970+0000 7f9912ffd700 1 -- 172.21.2.105:0/473820207 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9914010070 con 0x7f99240626b0 2021-11-12T05:41:03.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.970+0000 7f9912ffd700 1 --2- 172.21.2.105:0/473820207 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f99040536d0 0x7f9904055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:03.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.970+0000 7f9912ffd700 1 -- 172.21.2.105:0/473820207 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f991406adf0 con 0x7f99240626b0 2021-11-12T05:41:03.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.970+0000 7f9929521700 1 --2- 172.21.2.105:0/473820207 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f99040536d0 0x7f9904055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:03.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.970+0000 7f9929521700 1 --2- 172.21.2.105:0/473820207 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f99040536d0 0x7f9904055b90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f991c01b000 tx=0x7f991c016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:03.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:03.974+0000 7f9912ffd700 1 -- 172.21.2.105:0/473820207 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9914042130 con 0x7f99240626b0 2021-11-12T05:41:04.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.086+0000 7f992bf86700 1 -- 172.21.2.105:0/473820207 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f9924057350 con 0x7f99240626b0 2021-11-12T05:41:04.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.090+0000 7f9912ffd700 1 -- 172.21.2.105:0/473820207 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 updated v10) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9914018070 con 0x7f99240626b0 2021-11-12T05:41:04.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.094+0000 7f992bf86700 1 -- 172.21.2.105:0/473820207 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f99040536d0 msgr2=0x7f9904055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:04.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.094+0000 7f992bf86700 1 --2- 172.21.2.105:0/473820207 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f99040536d0 0x7f9904055b90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f991c01b000 tx=0x7f991c016000).stop 2021-11-12T05:41:04.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.094+0000 7f992bf86700 1 -- 172.21.2.105:0/473820207 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99240626b0 msgr2=0x7f9924065f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:04.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.094+0000 7f992bf86700 1 --2- 172.21.2.105:0/473820207 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99240626b0 0x7f9924065f10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f9914001110 tx=0x7f9914007ad0).stop 2021-11-12T05:41:04.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.094+0000 7f992bf86700 1 -- 172.21.2.105:0/473820207 shutdown_connections 2021-11-12T05:41:04.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.094+0000 7f992bf86700 1 --2- 172.21.2.105:0/473820207 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f99040536d0 0x7f9904055b90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:04.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.094+0000 7f992bf86700 1 --2- 172.21.2.105:0/473820207 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9924130a80 0x7f9924062fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:04.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.094+0000 7f992bf86700 1 --2- 172.21.2.105:0/473820207 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f99240af750 0x7f99240b4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:04.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.094+0000 7f992bf86700 1 --2- 172.21.2.105:0/473820207 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99240626b0 0x7f9924065f10 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:04.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.094+0000 7f992bf86700 1 -- 172.21.2.105:0/473820207 >> 172.21.2.105:0/473820207 conn(0x7f99240b5320 msgr2=0x7f99240607e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:04.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.094+0000 7f992bf86700 1 -- 172.21.2.105:0/473820207 shutdown_connections 2021-11-12T05:41:04.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.094+0000 7f992bf86700 1 -- 172.21.2.105:0/473820207 wait complete. 2021-11-12T05:41:04.099 INFO:teuthology.orchestra.run.gibba005.stderr:updated 2021-11-12T05:41:04.102 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2021-11-12T05:41:04.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.150+0000 7f082fd66700 1 Processor -- start 2021-11-12T05:41:04.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.150+0000 7f082fd66700 1 -- start start 2021-11-12T05:41:04.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.150+0000 7f082fd66700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f08280ad080 0x7f08280af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.150+0000 7f082fd66700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f08280ac280 0x7f08280ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.150+0000 7f082fd66700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08280ac7b0 con 0x7f082814abe0 2021-11-12T05:41:04.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.150+0000 7f082fd66700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08281488a0 con 0x7f08280ac280 2021-11-12T05:41:04.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.150+0000 7f082fd66700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08280ac9e0 con 0x7f08280ad080 2021-11-12T05:41:04.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.154+0000 7f082db02700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f08280ad080 0x7f08280af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:04.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.154+0000 7f082d301700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f08280ac280 0x7f08280ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:04.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.154+0000 7f082e303700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7f082814abe0 0x7f082814b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:52956/0 (socket says 172.21.2.105:52956) 2021-11-12T05:41:04.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.154+0000 7f082e303700 1 -- 172.21.2.105:0/3787847359 learned_addr learned my addr 172.21.2.105:0/3787847359 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:41:04.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.154+0000 7f082db02700 1 -- 172.21.2.105:0/3787847359 >> v2:172.21.2.115:3300/0 conn(0x7f08280ac280 msgr2=0x7f08280ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:04.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.154+0000 7f082db02700 1 --2- 172.21.2.105:0/3787847359 >> v2:172.21.2.115:3300/0 conn(0x7f08280ac280 0x7f08280ad460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:04.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.154+0000 7f082db02700 1 -- 172.21.2.105:0/3787847359 >> v1:172.21.2.115:6789/0 conn(0x7f082814abe0 legacy=0x7f082814b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:04.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.154+0000 7f082db02700 1 -- 172.21.2.105:0/3787847359 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08280b0b30 con 0x7f08280ad080 2021-11-12T05:41:04.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.154+0000 7f082db02700 1 --2- 172.21.2.105:0/3787847359 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f08280ad080 0x7f08280af730 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f0824002f70 tx=0x7f0824006df0).ready entity=mon.2 client_cookie=65341deeec66f9a server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:04.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.154+0000 7f082cb00700 1 -- 172.21.2.105:0/3787847359 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f082400d570 con 0x7f08280ad080 2021-11-12T05:41:04.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.154+0000 7f082cb00700 1 -- 172.21.2.105:0/3787847359 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0824000e90 con 0x7f08280ad080 2021-11-12T05:41:04.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.154+0000 7f082cb00700 1 -- 172.21.2.105:0/3787847359 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f082400d8c0 con 0x7f08280ad080 2021-11-12T05:41:04.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.154+0000 7f082fd66700 1 -- 172.21.2.105:0/3787847359 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f08280ad080 msgr2=0x7f08280af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:04.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.154+0000 7f082fd66700 1 --2- 172.21.2.105:0/3787847359 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f08280ad080 0x7f08280af730 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f0824002f70 tx=0x7f0824006df0).stop 2021-11-12T05:41:04.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.158+0000 7f082fd66700 1 -- 172.21.2.105:0/3787847359 shutdown_connections 2021-11-12T05:41:04.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.158+0000 7f082fd66700 1 --2- 172.21.2.105:0/3787847359 >> v2:172.21.2.115:3300/0 conn(0x7f08280ac280 0x7f08280ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:04.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.158+0000 7f082fd66700 1 --2- 172.21.2.105:0/3787847359 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f08280ad080 0x7f08280af730 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:04.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.158+0000 7f082fd66700 1 -- 172.21.2.105:0/3787847359 >> 172.21.2.105:0/3787847359 conn(0x7f08280b5370 msgr2=0x7f08280b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:04.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.158+0000 7f082fd66700 1 -- 172.21.2.105:0/3787847359 shutdown_connections 2021-11-12T05:41:04.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.158+0000 7f082fd66700 1 -- 172.21.2.105:0/3787847359 wait complete. 2021-11-12T05:41:04.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.158+0000 7f082fd66700 1 Processor -- start 2021-11-12T05:41:04.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.158+0000 7f082fd66700 1 -- start start 2021-11-12T05:41:04.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.158+0000 7f082fd66700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f08280ac280 0x7f08280a7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.158+0000 7f082fd66700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f08280ad080 0x7f08280aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.158+0000 7f082fd66700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f082814abe0 0x7f0828157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.158+0000 7f082fd66700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0828156ac0 con 0x7f08280ad080 2021-11-12T05:41:04.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.158+0000 7f082fd66700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082815a440 con 0x7f08280ac280 2021-11-12T05:41:04.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.158+0000 7f082fd66700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0828156cb0 con 0x7f082814abe0 2021-11-12T05:41:04.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.158+0000 7f082d301700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f08280ad080 0x7f08280aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:04.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.158+0000 7f082d301700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f08280ad080 0x7f08280aa3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44100/0 (socket says 172.21.2.105:44100) 2021-11-12T05:41:04.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.158+0000 7f082d301700 1 -- 172.21.2.105:0/2314897431 learned_addr learned my addr 172.21.2.105:0/2314897431 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:04.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.158+0000 7f082d301700 1 -- 172.21.2.105:0/2314897431 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f082814abe0 msgr2=0x7f0828157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:04.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.158+0000 7f082d301700 1 --2- 172.21.2.105:0/2314897431 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f082814abe0 0x7f0828157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:04.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.158+0000 7f082d301700 1 -- 172.21.2.105:0/2314897431 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f08280ac280 msgr2=0x7f08280a7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:04.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.158+0000 7f082d301700 1 --2- 172.21.2.105:0/2314897431 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f08280ac280 0x7f08280a7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:04.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.158+0000 7f082d301700 1 -- 172.21.2.105:0/2314897431 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f082400b180 con 0x7f08280ad080 2021-11-12T05:41:04.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.158+0000 7f082d301700 1 --2- 172.21.2.105:0/2314897431 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f08280ad080 0x7f08280aa3f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f081c00c000 tx=0x7f081c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:04.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.158+0000 7f081affd700 1 -- 172.21.2.105:0/2314897431 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f081c010780 con 0x7f08280ad080 2021-11-12T05:41:04.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.158+0000 7f081affd700 1 -- 172.21.2.105:0/2314897431 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081c0108e0 con 0x7f08280ad080 2021-11-12T05:41:04.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.158+0000 7f082fd66700 1 -- 172.21.2.105:0/2314897431 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f082815a1a0 con 0x7f08280ad080 2021-11-12T05:41:04.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.158+0000 7f081affd700 1 -- 172.21.2.105:0/2314897431 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f081c010c40 con 0x7f08280ad080 2021-11-12T05:41:04.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.158+0000 7f082fd66700 1 -- 172.21.2.105:0/2314897431 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08280a9df0 con 0x7f08280ad080 2021-11-12T05:41:04.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.158+0000 7f082fd66700 1 -- 172.21.2.105:0/2314897431 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08280b1440 con 0x7f08280ad080 2021-11-12T05:41:04.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.158+0000 7f081affd700 1 -- 172.21.2.105:0/2314897431 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f081c01c460 con 0x7f08280ad080 2021-11-12T05:41:04.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.158+0000 7f081affd700 1 --2- 172.21.2.105:0/2314897431 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f08080536f0 0x7f0808055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.158+0000 7f081affd700 1 -- 172.21.2.105:0/2314897431 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f081c06be10 con 0x7f08280ad080 2021-11-12T05:41:04.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.158+0000 7f082db02700 1 --2- 172.21.2.105:0/2314897431 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f08080536f0 0x7f0808055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:04.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.162+0000 7f082db02700 1 --2- 172.21.2.105:0/2314897431 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f08080536f0 0x7f0808055bb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f0824002f70 tx=0x7f0824014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:04.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.162+0000 7f081affd700 1 -- 172.21.2.105:0/2314897431 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f081c042fe0 con 0x7f08280ad080 2021-11-12T05:41:04.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.274+0000 7f082fd66700 1 -- 172.21.2.105:0/2314897431 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f0828068700 con 0x7f08280ad080 2021-11-12T05:41:04.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.278+0000 7f081affd700 1 -- 172.21.2.105:0/2314897431 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 updated v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f081c046600 con 0x7f08280ad080 2021-11-12T05:41:04.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.278+0000 7f082fd66700 1 -- 172.21.2.105:0/2314897431 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f08080536f0 msgr2=0x7f0808055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:04.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.278+0000 7f082fd66700 1 --2- 172.21.2.105:0/2314897431 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f08080536f0 0x7f0808055bb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f0824002f70 tx=0x7f0824014000).stop 2021-11-12T05:41:04.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.278+0000 7f082fd66700 1 -- 172.21.2.105:0/2314897431 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f08280ad080 msgr2=0x7f08280aa3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:04.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.278+0000 7f082fd66700 1 --2- 172.21.2.105:0/2314897431 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f08280ad080 0x7f08280aa3f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f081c00c000 tx=0x7f081c006df0).stop 2021-11-12T05:41:04.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.278+0000 7f082fd66700 1 -- 172.21.2.105:0/2314897431 shutdown_connections 2021-11-12T05:41:04.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.278+0000 7f082fd66700 1 --2- 172.21.2.105:0/2314897431 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f08080536f0 0x7f0808055bb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:04.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.278+0000 7f082fd66700 1 --2- 172.21.2.105:0/2314897431 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f082814abe0 0x7f0828157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:04.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.278+0000 7f082fd66700 1 --2- 172.21.2.105:0/2314897431 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f08280ad080 0x7f08280aa3f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:04.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.278+0000 7f082fd66700 1 --2- 172.21.2.105:0/2314897431 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f08280ac280 0x7f08280a7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:04.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.278+0000 7f082fd66700 1 -- 172.21.2.105:0/2314897431 >> 172.21.2.105:0/2314897431 conn(0x7f08280b5370 msgr2=0x7f0828143c60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:04.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.278+0000 7f082fd66700 1 -- 172.21.2.105:0/2314897431 shutdown_connections 2021-11-12T05:41:04.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.278+0000 7f082fd66700 1 -- 172.21.2.105:0/2314897431 wait complete. 2021-11-12T05:41:04.287 INFO:teuthology.orchestra.run.gibba005.stderr:updated 2021-11-12T05:41:04.288 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2021-11-12T05:41:04.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56b6642700 1 Processor -- start 2021-11-12T05:41:04.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56b6642700 1 -- start start 2021-11-12T05:41:04.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56b6642700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f56b00af750 0x7f56b0062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56b6642700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f56b0130a80 0x7f56b01474d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56b6642700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b00b0d50 con 0x7f56b00626b0 2021-11-12T05:41:04.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56b6642700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56b00ad380 con 0x7f56b0130a80 2021-11-12T05:41:04.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56b6642700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b00ae190 con 0x7f56b00af750 2021-11-12T05:41:04.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56affff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f56b00626b0 0x7f56b0130370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:54502/0 (socket says 172.21.2.105:54502) 2021-11-12T05:41:04.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56affff700 1 -- 172.21.2.105:0/3645078843 learned_addr learned my addr 172.21.2.105:0/3645078843 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:41:04.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56aeffd700 1 -- 172.21.2.105:0/3645078843 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2846177314 0 0) 0x7f56b00b0d50 con 0x7f56b00626b0 2021-11-12T05:41:04.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56aeffd700 1 -- 172.21.2.105:0/3645078843 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5690003260 con 0x7f56b00626b0 2021-11-12T05:41:04.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56aeffd700 1 -- 172.21.2.105:0/3645078843 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3417102894 0 0) 0x7f5690003260 con 0x7f56b00626b0 2021-11-12T05:41:04.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56aeffd700 1 -- 172.21.2.105:0/3645078843 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f56b00af750 msgr2=0x7f56b0062a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:04.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56aeffd700 1 --2- 172.21.2.105:0/3645078843 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f56b00af750 0x7f56b0062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:04.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56aeffd700 1 -- 172.21.2.105:0/3645078843 >> v2:172.21.2.115:3300/0 conn(0x7f56b0130a80 msgr2=0x7f56b01474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:04.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56b4bdf700 1 --2- 172.21.2.105:0/3645078843 >> v2:172.21.2.115:3300/0 conn(0x7f56b0130a80 0x7f56b01474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:04.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56aeffd700 1 --2- 172.21.2.105:0/3645078843 >> v2:172.21.2.115:3300/0 conn(0x7f56b0130a80 0x7f56b01474d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:04.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56aeffd700 1 -- 172.21.2.105:0/3645078843 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b01479c0 con 0x7f56b00626b0 2021-11-12T05:41:04.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56aeffd700 1 -- 172.21.2.105:0/3645078843 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f56a0001660 con 0x7f56b00626b0 2021-11-12T05:41:04.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56aeffd700 1 -- 172.21.2.105:0/3645078843 >> v1:172.21.2.105:6789/0 conn(0x7f56b00626b0 legacy=0x7f56b0130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:04.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56aeffd700 1 --2- 172.21.2.105:0/3645078843 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f56b00af750 0x7f56900037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56aeffd700 1 --2- 172.21.2.105:0/3645078843 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5690003e90 0x7f5690004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56aeffd700 1 --2- 172.21.2.105:0/3645078843 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5690004b10 0x7f5690004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56aeffd700 1 -- 172.21.2.105:0/3645078843 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b00ad380 con 0x7f5690003e90 2021-11-12T05:41:04.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56aeffd700 1 -- 172.21.2.105:0/3645078843 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b00ae190 con 0x7f5690004b10 2021-11-12T05:41:04.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56aeffd700 1 -- 172.21.2.105:0/3645078843 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569000ba60 con 0x7f56b00af750 2021-11-12T05:41:04.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56b4bdf700 1 --2- 172.21.2.105:0/3645078843 >> v2:172.21.2.115:3300/0 conn(0x7f56b0130a80 0x7f56b01474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:41:04.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56af7fe700 1 --2- 172.21.2.105:0/3645078843 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5690003e90 0x7f5690004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:04.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56affff700 1 --2- 172.21.2.105:0/3645078843 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f56b00af750 0x7f56900037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:04.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56b4bdf700 1 --2- 172.21.2.105:0/3645078843 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5690004b10 0x7f5690004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:04.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56af7fe700 1 -- 172.21.2.105:0/3645078843 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f56b00af750 msgr2=0x7f56900037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:04.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56af7fe700 1 --2- 172.21.2.105:0/3645078843 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f56b00af750 0x7f56900037d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:04.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56af7fe700 1 -- 172.21.2.105:0/3645078843 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5690004b10 msgr2=0x7f5690004f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:04.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56af7fe700 1 --2- 172.21.2.105:0/3645078843 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5690004b10 0x7f5690004f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:04.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56af7fe700 1 -- 172.21.2.105:0/3645078843 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b01479c0 con 0x7f5690003e90 2021-11-12T05:41:04.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56b4bdf700 1 --2- 172.21.2.105:0/3645078843 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5690004b10 0x7f5690004f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:41:04.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56af7fe700 1 --2- 172.21.2.105:0/3645078843 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5690003e90 0x7f5690004500 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f5698002f70 tx=0x7f5698006ca0).ready entity=mon.0 client_cookie=642d7a0d3a9b9dc2 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:04.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56aeffd700 1 -- 172.21.2.105:0/3645078843 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5698013410 con 0x7f5690003e90 2021-11-12T05:41:04.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56aeffd700 1 -- 172.21.2.105:0/3645078843 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5698013570 con 0x7f5690003e90 2021-11-12T05:41:04.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.338+0000 7f56aeffd700 1 -- 172.21.2.105:0/3645078843 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56980138d0 con 0x7f5690003e90 2021-11-12T05:41:04.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.342+0000 7f56b6642700 1 -- 172.21.2.105:0/3645078843 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5690003e90 msgr2=0x7f5690004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:04.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.342+0000 7f56b6642700 1 --2- 172.21.2.105:0/3645078843 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5690003e90 0x7f5690004500 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f5698002f70 tx=0x7f5698006ca0).stop 2021-11-12T05:41:04.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.342+0000 7f56b4bdf700 1 -- 172.21.2.105:0/3645078843 reap_dead start 2021-11-12T05:41:04.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.342+0000 7f56b6642700 1 -- 172.21.2.105:0/3645078843 shutdown_connections 2021-11-12T05:41:04.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.342+0000 7f56b6642700 1 -- 172.21.2.105:0/3645078843 >> 172.21.2.105:0/3645078843 conn(0x7f56b00b5320 msgr2=0x7f56b00b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:04.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.342+0000 7f56b6642700 1 -- 172.21.2.105:0/3645078843 shutdown_connections 2021-11-12T05:41:04.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.342+0000 7f56b6642700 1 -- 172.21.2.105:0/3645078843 wait complete. 2021-11-12T05:41:04.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.342+0000 7f56b6642700 1 Processor -- start 2021-11-12T05:41:04.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.342+0000 7f56b6642700 1 -- start start 2021-11-12T05:41:04.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.342+0000 7f56b6642700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5690003e90 0x7f56b0065280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.342+0000 7f56b6642700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f56b0146d30 0x7f56b014aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.342+0000 7f56b6642700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f56b0063360 0x7f56b00637f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.342+0000 7f56b6642700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b0145a80 con 0x7f56b0146d30 2021-11-12T05:41:04.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.342+0000 7f56b6642700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b0145cb0 con 0x7f5690003e90 2021-11-12T05:41:04.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.342+0000 7f56b6642700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b0066cf0 con 0x7f56b0063360 2021-11-12T05:41:04.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.342+0000 7f56af7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f56b0146d30 0x7f56b014aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:04.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.342+0000 7f56af7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f56b0146d30 0x7f56b014aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44118/0 (socket says 172.21.2.105:44118) 2021-11-12T05:41:04.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.342+0000 7f56af7fe700 1 -- 172.21.2.105:0/2699889688 learned_addr learned my addr 172.21.2.105:0/2699889688 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:04.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.342+0000 7f56b4bdf700 1 --2- 172.21.2.105:0/2699889688 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f56b0063360 0x7f56b00637f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:04.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.342+0000 7f56affff700 1 --2- 172.21.2.105:0/2699889688 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5690003e90 0x7f56b0065280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:04.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.342+0000 7f56af7fe700 1 -- 172.21.2.105:0/2699889688 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f56b0063360 msgr2=0x7f56b00637f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:04.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.342+0000 7f56af7fe700 1 --2- 172.21.2.105:0/2699889688 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f56b0063360 0x7f56b00637f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:04.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.342+0000 7f56af7fe700 1 -- 172.21.2.105:0/2699889688 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5690003e90 msgr2=0x7f56b0065280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:04.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.342+0000 7f56af7fe700 1 --2- 172.21.2.105:0/2699889688 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5690003e90 0x7f56b0065280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:04.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.342+0000 7f56af7fe700 1 -- 172.21.2.105:0/2699889688 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b014b500 con 0x7f56b0146d30 2021-11-12T05:41:04.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.342+0000 7f56af7fe700 1 --2- 172.21.2.105:0/2699889688 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f56b0146d30 0x7f56b014aba0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f5698002f70 tx=0x7f5698014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:04.373 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.342+0000 7f56ad7fa700 1 -- 172.21.2.105:0/2699889688 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5698013410 con 0x7f56b0146d30 2021-11-12T05:41:04.373 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.342+0000 7f56ad7fa700 1 -- 172.21.2.105:0/2699889688 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5698012da0 con 0x7f56b0146d30 2021-11-12T05:41:04.373 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.342+0000 7f56ad7fa700 1 -- 172.21.2.105:0/2699889688 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5698021660 con 0x7f56b0146d30 2021-11-12T05:41:04.374 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.342+0000 7f56b6642700 1 -- 172.21.2.105:0/2699889688 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56b0063ce0 con 0x7f56b0146d30 2021-11-12T05:41:04.374 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.342+0000 7f56b6642700 1 -- 172.21.2.105:0/2699889688 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56b012f9d0 con 0x7f56b0146d30 2021-11-12T05:41:04.375 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.342+0000 7f56b6642700 1 -- 172.21.2.105:0/2699889688 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56b0057350 con 0x7f56b0146d30 2021-11-12T05:41:04.375 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.342+0000 7f56ad7fa700 1 -- 172.21.2.105:0/2699889688 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f56980217c0 con 0x7f56b0146d30 2021-11-12T05:41:04.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.342+0000 7f56ad7fa700 1 --2- 172.21.2.105:0/2699889688 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5694053580 0x7f5694055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.342+0000 7f56ad7fa700 1 -- 172.21.2.105:0/2699889688 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f569801b040 con 0x7f56b0146d30 2021-11-12T05:41:04.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.342+0000 7f56affff700 1 --2- 172.21.2.105:0/2699889688 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5694053580 0x7f5694055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:04.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.346+0000 7f56affff700 1 --2- 172.21.2.105:0/2699889688 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5694053580 0x7f5694055a40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f56a0006000 tx=0x7f56a0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:04.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.346+0000 7f56ad7fa700 1 -- 172.21.2.105:0/2699889688 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5698043d30 con 0x7f56b0146d30 2021-11-12T05:41:04.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.458+0000 7f56b6642700 1 -- 172.21.2.105:0/2699889688 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f56b0145a80 con 0x7f56b0146d30 2021-11-12T05:41:04.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.462+0000 7f56ad7fa700 1 -- 172.21.2.105:0/2699889688 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 updated v12) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5698026070 con 0x7f56b0146d30 2021-11-12T05:41:04.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.462+0000 7f56b6642700 1 -- 172.21.2.105:0/2699889688 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5694053580 msgr2=0x7f5694055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:04.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.462+0000 7f56b6642700 1 --2- 172.21.2.105:0/2699889688 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5694053580 0x7f5694055a40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f56a0006000 tx=0x7f56a0009040).stop 2021-11-12T05:41:04.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.462+0000 7f56b6642700 1 -- 172.21.2.105:0/2699889688 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f56b0146d30 msgr2=0x7f56b014aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:04.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.462+0000 7f56b6642700 1 --2- 172.21.2.105:0/2699889688 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f56b0146d30 0x7f56b014aba0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f5698002f70 tx=0x7f5698014000).stop 2021-11-12T05:41:04.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.462+0000 7f56b6642700 1 -- 172.21.2.105:0/2699889688 shutdown_connections 2021-11-12T05:41:04.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.462+0000 7f56b6642700 1 --2- 172.21.2.105:0/2699889688 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5694053580 0x7f5694055a40 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:04.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.462+0000 7f56b6642700 1 --2- 172.21.2.105:0/2699889688 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f56b0063360 0x7f56b00637f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:04.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.462+0000 7f56b6642700 1 --2- 172.21.2.105:0/2699889688 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f56b0146d30 0x7f56b014aba0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:04.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.462+0000 7f56b6642700 1 --2- 172.21.2.105:0/2699889688 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5690003e90 0x7f56b0065280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:04.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.462+0000 7f56b6642700 1 -- 172.21.2.105:0/2699889688 >> 172.21.2.105:0/2699889688 conn(0x7f56b00b5320 msgr2=0x7f56b0147fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:04.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.462+0000 7f56b6642700 1 -- 172.21.2.105:0/2699889688 shutdown_connections 2021-11-12T05:41:04.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.462+0000 7f56b6642700 1 -- 172.21.2.105:0/2699889688 wait complete. 2021-11-12T05:41:04.470 INFO:teuthology.orchestra.run.gibba005.stderr:updated 2021-11-12T05:41:04.473 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:41:04.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.522+0000 7f64bcd9b700 1 Processor -- start 2021-11-12T05:41:04.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.522+0000 7f64bcd9b700 1 -- start start 2021-11-12T05:41:04.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.522+0000 7f64bcd9b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f64b80ad080 0x7f64b80af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.522+0000 7f64bcd9b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f64b80ac280 0x7f64b80ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.522+0000 7f64bcd9b700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f64b814abe0 0x7f64b814b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.522+0000 7f64bcd9b700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b81488a0 con 0x7f64b80ad080 2021-11-12T05:41:04.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.522+0000 7f64bcd9b700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b80ac7b0 con 0x7f64b814abe0 2021-11-12T05:41:04.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.522+0000 7f64bcd9b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b80ac9e0 con 0x7f64b80ac280 2021-11-12T05:41:04.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.522+0000 7f64b659c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f64b80ad080 0x7f64b80af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:04.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.522+0000 7f64b659c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f64b80ad080 0x7f64b80af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44126/0 (socket says 172.21.2.105:44126) 2021-11-12T05:41:04.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.522+0000 7f64b659c700 1 -- 172.21.2.105:0/26490520 learned_addr learned my addr 172.21.2.105:0/26490520 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:04.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.522+0000 7f64b659c700 1 -- 172.21.2.105:0/26490520 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f64b80ac280 msgr2=0x7f64b80ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:04.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.522+0000 7f64b659c700 1 --2- 172.21.2.105:0/26490520 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f64b80ac280 0x7f64b80ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:04.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.522+0000 7f64b659c700 1 -- 172.21.2.105:0/26490520 >> v2:172.21.2.115:3300/0 conn(0x7f64b814abe0 msgr2=0x7f64b814b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:04.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.522+0000 7f64b659c700 1 --2- 172.21.2.105:0/26490520 >> v2:172.21.2.115:3300/0 conn(0x7f64b814abe0 0x7f64b814b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:04.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.522+0000 7f64b659c700 1 -- 172.21.2.105:0/26490520 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b80b0b30 con 0x7f64b80ad080 2021-11-12T05:41:04.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.522+0000 7f64b659c700 1 --2- 172.21.2.105:0/26490520 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f64b80ad080 0x7f64b80af730 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f64b80ac6a0 tx=0x7f64ac006eb0).ready entity=mon.0 client_cookie=b00ee2f50273bb9a server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:04.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.522+0000 7f64b559a700 1 -- 172.21.2.105:0/26490520 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64ac00d570 con 0x7f64b80ad080 2021-11-12T05:41:04.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.526+0000 7f64b559a700 1 -- 172.21.2.105:0/26490520 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ac000e90 con 0x7f64b80ad080 2021-11-12T05:41:04.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.526+0000 7f64b559a700 1 -- 172.21.2.105:0/26490520 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64ac00d8c0 con 0x7f64b80ad080 2021-11-12T05:41:04.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.526+0000 7f64bcd9b700 1 -- 172.21.2.105:0/26490520 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f64b80ad080 msgr2=0x7f64b80af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:04.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.526+0000 7f64bcd9b700 1 --2- 172.21.2.105:0/26490520 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f64b80ad080 0x7f64b80af730 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f64b80ac6a0 tx=0x7f64ac006eb0).stop 2021-11-12T05:41:04.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.526+0000 7f64bcd9b700 1 -- 172.21.2.105:0/26490520 shutdown_connections 2021-11-12T05:41:04.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.526+0000 7f64bcd9b700 1 --2- 172.21.2.105:0/26490520 >> v2:172.21.2.115:3300/0 conn(0x7f64b814abe0 0x7f64b814b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:04.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.526+0000 7f64bcd9b700 1 --2- 172.21.2.105:0/26490520 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f64b80ac280 0x7f64b80ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:04.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.526+0000 7f64bcd9b700 1 --2- 172.21.2.105:0/26490520 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f64b80ad080 0x7f64b80af730 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:04.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.526+0000 7f64bcd9b700 1 -- 172.21.2.105:0/26490520 >> 172.21.2.105:0/26490520 conn(0x7f64b80b5370 msgr2=0x7f64b80b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:04.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.526+0000 7f64bcd9b700 1 -- 172.21.2.105:0/26490520 shutdown_connections 2021-11-12T05:41:04.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.526+0000 7f64bcd9b700 1 -- 172.21.2.105:0/26490520 wait complete. 2021-11-12T05:41:04.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.526+0000 7f64bcd9b700 1 Processor -- start 2021-11-12T05:41:04.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.526+0000 7f64bcd9b700 1 -- start start 2021-11-12T05:41:04.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.526+0000 7f64bcd9b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f64b80ac280 0x7f64b80a9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.526+0000 7f64bcd9b700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f64b80ad080 0x7f64b80a85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.526+0000 7f64bcd9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f64b814abe0 0x7f64b80a8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.526+0000 7f64bcd9b700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b80ab9a0 con 0x7f64b814abe0 2021-11-12T05:41:04.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.526+0000 7f64bcd9b700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b80abc40 con 0x7f64b80ad080 2021-11-12T05:41:04.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.526+0000 7f64bcd9b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b80a7730 con 0x7f64b80ac280 2021-11-12T05:41:04.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.526+0000 7f64b6d9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f64b814abe0 0x7f64b80a8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:04.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.526+0000 7f64b6d9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f64b814abe0 0x7f64b80a8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44134/0 (socket says 172.21.2.105:44134) 2021-11-12T05:41:04.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.526+0000 7f64b6d9d700 1 -- 172.21.2.105:0/2456954622 learned_addr learned my addr 172.21.2.105:0/2456954622 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:04.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.526+0000 7f64b6d9d700 1 -- 172.21.2.105:0/2456954622 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f64b80ac280 msgr2=0x7f64b80a9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:04.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.526+0000 7f64b6d9d700 1 --2- 172.21.2.105:0/2456954622 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f64b80ac280 0x7f64b80a9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:04.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.526+0000 7f64b6d9d700 1 -- 172.21.2.105:0/2456954622 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f64b80ad080 msgr2=0x7f64b80a85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:04.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.526+0000 7f64b6d9d700 1 --2- 172.21.2.105:0/2456954622 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f64b80ad080 0x7f64b80a85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:04.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.526+0000 7f64b6d9d700 1 -- 172.21.2.105:0/2456954622 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ac00b1e0 con 0x7f64b814abe0 2021-11-12T05:41:04.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.526+0000 7f64b6d9d700 1 --2- 172.21.2.105:0/2456954622 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f64b814abe0 0x7f64b80a8ec0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f64b00032f0 tx=0x7f64b0009120).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:04.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.526+0000 7f64a77fe700 1 -- 172.21.2.105:0/2456954622 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64b000f510 con 0x7f64b814abe0 2021-11-12T05:41:04.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.526+0000 7f64a77fe700 1 -- 172.21.2.105:0/2456954622 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b000f670 con 0x7f64b814abe0 2021-11-12T05:41:04.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.526+0000 7f64bcd9b700 1 -- 172.21.2.105:0/2456954622 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b80a79c0 con 0x7f64b814abe0 2021-11-12T05:41:04.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.526+0000 7f64bcd9b700 1 -- 172.21.2.105:0/2456954622 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64b8156ff0 con 0x7f64b814abe0 2021-11-12T05:41:04.545 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.526+0000 7f64a77fe700 1 -- 172.21.2.105:0/2456954622 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64b000f7e0 con 0x7f64b814abe0 2021-11-12T05:41:04.545 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.526+0000 7f64bcd9b700 1 -- 172.21.2.105:0/2456954622 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6490003410 con 0x7f64b814abe0 2021-11-12T05:41:04.545 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.526+0000 7f64a77fe700 1 -- 172.21.2.105:0/2456954622 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f64b000f070 con 0x7f64b814abe0 2021-11-12T05:41:04.546 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.526+0000 7f64a77fe700 1 --2- 172.21.2.105:0/2456954622 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6494053720 0x7f6494055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.546 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.526+0000 7f64a77fe700 1 -- 172.21.2.105:0/2456954622 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f64b006b390 con 0x7f64b814abe0 2021-11-12T05:41:04.547 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.526+0000 7f64b659c700 1 --2- 172.21.2.105:0/2456954622 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6494053720 0x7f6494055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:04.547 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.530+0000 7f64b659c700 1 --2- 172.21.2.105:0/2456954622 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6494053720 0x7f6494055be0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f64b80ac6a0 tx=0x7f64ac015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:04.547 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.530+0000 7f64a77fe700 1 -- 172.21.2.105:0/2456954622 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f64b0042560 con 0x7f64b814abe0 2021-11-12T05:41:04.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.614+0000 7f64bcd9b700 1 -- 172.21.2.105:0/2456954622 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64900036c0 con 0x7f64b814abe0 2021-11-12T05:41:04.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.614+0000 7f64a77fe700 1 -- 172.21.2.105:0/2456954622 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+13414 (secure 0 0 0) 0x7f64b0045b80 con 0x7f64b814abe0 2021-11-12T05:41:04.616 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:41:04.616 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":30,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:41:03.119121+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:41:04.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.614+0000 7f64bcd9b700 1 -- 172.21.2.105:0/2456954622 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6494053720 msgr2=0x7f6494055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:04.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.614+0000 7f64bcd9b700 1 --2- 172.21.2.105:0/2456954622 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6494053720 0x7f6494055be0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f64b80ac6a0 tx=0x7f64ac015000).stop 2021-11-12T05:41:04.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.614+0000 7f64bcd9b700 1 -- 172.21.2.105:0/2456954622 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f64b814abe0 msgr2=0x7f64b80a8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:04.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.614+0000 7f64bcd9b700 1 --2- 172.21.2.105:0/2456954622 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f64b814abe0 0x7f64b80a8ec0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f64b00032f0 tx=0x7f64b0009120).stop 2021-11-12T05:41:04.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.614+0000 7f64bcd9b700 1 -- 172.21.2.105:0/2456954622 shutdown_connections 2021-11-12T05:41:04.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.614+0000 7f64bcd9b700 1 --2- 172.21.2.105:0/2456954622 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6494053720 0x7f6494055be0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:04.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.614+0000 7f64bcd9b700 1 --2- 172.21.2.105:0/2456954622 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f64b814abe0 0x7f64b80a8ec0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:04.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.614+0000 7f64bcd9b700 1 --2- 172.21.2.105:0/2456954622 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f64b80ad080 0x7f64b80a85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:04.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.614+0000 7f64bcd9b700 1 --2- 172.21.2.105:0/2456954622 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f64b80ac280 0x7f64b80a9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:04.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.614+0000 7f64bcd9b700 1 -- 172.21.2.105:0/2456954622 >> 172.21.2.105:0/2456954622 conn(0x7f64b80b5370 msgr2=0x7f64b8147900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:04.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.614+0000 7f64bcd9b700 1 -- 172.21.2.105:0/2456954622 shutdown_connections 2021-11-12T05:41:04.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.614+0000 7f64bcd9b700 1 -- 172.21.2.105:0/2456954622 wait complete. 2021-11-12T05:41:04.623 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-12T05:41:04.623 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:41:04.676 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.674+0000 7f0164b1f700 1 Processor -- start 2021-11-12T05:41:04.676 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.674+0000 7f0164b1f700 1 -- start start 2021-11-12T05:41:04.680 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.674+0000 7f0164b1f700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f01600aca40 0x7f01600ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.680 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.674+0000 7f0164b1f700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f01600b0520 0x7f01601473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.680 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.674+0000 7f0164b1f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f01601478b0 0x7f0160144180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.681 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.674+0000 7f0164b1f700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0160147d40 con 0x7f01600aca40 2021-11-12T05:41:04.681 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.674+0000 7f0164b1f700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01600b1840 con 0x7f01600b0520 2021-11-12T05:41:04.681 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.674+0000 7f0164b1f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01600b09d0 con 0x7f01601478b0 2021-11-12T05:41:04.681 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.674+0000 7f015e59c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f01600aca40 0x7f01600ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:04.682 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.674+0000 7f015e59c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f01600aca40 0x7f01600ace20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44138/0 (socket says 172.21.2.105:44138) 2021-11-12T05:41:04.682 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.674+0000 7f015e59c700 1 -- 172.21.2.105:0/3816085 learned_addr learned my addr 172.21.2.105:0/3816085 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:04.682 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.674+0000 7f015e59c700 1 -- 172.21.2.105:0/3816085 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f01601478b0 msgr2=0x7f0160144180 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:41:04.682 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.674+0000 7f015e59c700 1 --2- 172.21.2.105:0/3816085 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f01601478b0 0x7f0160144180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:04.683 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.674+0000 7f015e59c700 1 -- 172.21.2.105:0/3816085 >> v2:172.21.2.115:3300/0 conn(0x7f01600b0520 msgr2=0x7f01601473c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:41:04.683 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.674+0000 7f015e59c700 1 --2- 172.21.2.105:0/3816085 >> v2:172.21.2.115:3300/0 conn(0x7f01600b0520 0x7f01601473c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:04.683 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.674+0000 7f015e59c700 1 -- 172.21.2.105:0/3816085 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01600af2b0 con 0x7f01600aca40 2021-11-12T05:41:04.683 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.674+0000 7f015e59c700 1 --2- 172.21.2.105:0/3816085 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f01600aca40 0x7f01600ace20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f01600ae6a0 tx=0x7f0148006eb0).ready entity=mon.0 client_cookie=a42ab5014efc14d server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:04.684 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.674+0000 7f015d59a700 1 -- 172.21.2.105:0/3816085 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f014800d570 con 0x7f01600aca40 2021-11-12T05:41:04.684 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.674+0000 7f015d59a700 1 -- 172.21.2.105:0/3816085 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0148000e90 con 0x7f01600aca40 2021-11-12T05:41:04.684 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.674+0000 7f015d59a700 1 -- 172.21.2.105:0/3816085 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f014800d8c0 con 0x7f01600aca40 2021-11-12T05:41:04.684 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.674+0000 7f0164b1f700 1 -- 172.21.2.105:0/3816085 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f01600aca40 msgr2=0x7f01600ace20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:04.684 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.674+0000 7f0164b1f700 1 --2- 172.21.2.105:0/3816085 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f01600aca40 0x7f01600ace20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f01600ae6a0 tx=0x7f0148006eb0).stop 2021-11-12T05:41:04.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.674+0000 7f0164b1f700 1 -- 172.21.2.105:0/3816085 shutdown_connections 2021-11-12T05:41:04.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.674+0000 7f0164b1f700 1 --2- 172.21.2.105:0/3816085 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f01601478b0 0x7f0160144180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:04.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.674+0000 7f0164b1f700 1 --2- 172.21.2.105:0/3816085 >> v2:172.21.2.115:3300/0 conn(0x7f01600b0520 0x7f01601473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:04.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.674+0000 7f0164b1f700 1 --2- 172.21.2.105:0/3816085 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f01600aca40 0x7f01600ace20 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:04.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.674+0000 7f0164b1f700 1 -- 172.21.2.105:0/3816085 >> 172.21.2.105:0/3816085 conn(0x7f016005c490 msgr2=0x7f01600b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:04.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.674+0000 7f0164b1f700 1 -- 172.21.2.105:0/3816085 shutdown_connections 2021-11-12T05:41:04.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.674+0000 7f0164b1f700 1 -- 172.21.2.105:0/3816085 wait complete. 2021-11-12T05:41:04.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.678+0000 7f0164b1f700 1 Processor -- start 2021-11-12T05:41:04.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.678+0000 7f0164b1f700 1 -- start start 2021-11-12T05:41:04.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.678+0000 7f0164b1f700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f01600aca40 0x7f0160064d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.678+0000 7f0164b1f700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f01600b0520 0x7f01600ab830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.678+0000 7f0164b1f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f01601478b0 0x7f01600aa570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.678+0000 7f0164b1f700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0160063850 con 0x7f01600aca40 2021-11-12T05:41:04.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.678+0000 7f0164b1f700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01600643a0 con 0x7f01600b0520 2021-11-12T05:41:04.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.678+0000 7f0164b1f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0160064640 con 0x7f01601478b0 2021-11-12T05:41:04.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.678+0000 7f015e59c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f01600aca40 0x7f0160064d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:04.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.678+0000 7f015e59c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f01600aca40 0x7f0160064d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44144/0 (socket says 172.21.2.105:44144) 2021-11-12T05:41:04.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.678+0000 7f015e59c700 1 -- 172.21.2.105:0/3005067999 learned_addr learned my addr 172.21.2.105:0/3005067999 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:04.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.678+0000 7f015e59c700 1 -- 172.21.2.105:0/3005067999 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f01601478b0 msgr2=0x7f01600aa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:04.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.678+0000 7f015e59c700 1 --2- 172.21.2.105:0/3005067999 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f01601478b0 0x7f01600aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:04.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.678+0000 7f015e59c700 1 -- 172.21.2.105:0/3005067999 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f01600b0520 msgr2=0x7f01600ab830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:04.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.678+0000 7f015e59c700 1 --2- 172.21.2.105:0/3005067999 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f01600b0520 0x7f01600ab830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:04.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.678+0000 7f015e59c700 1 -- 172.21.2.105:0/3005067999 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014800b1e0 con 0x7f01600aca40 2021-11-12T05:41:04.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.678+0000 7f015e59c700 1 --2- 172.21.2.105:0/3005067999 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f01600aca40 0x7f0160064d80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f01600ae6a0 tx=0x7f0148015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:04.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.678+0000 7f01577fe700 1 -- 172.21.2.105:0/3005067999 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01480119d0 con 0x7f01600aca40 2021-11-12T05:41:04.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.678+0000 7f01577fe700 1 -- 172.21.2.105:0/3005067999 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0148011b30 con 0x7f01600aca40 2021-11-12T05:41:04.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.678+0000 7f0164b1f700 1 -- 172.21.2.105:0/3005067999 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01600648e0 con 0x7f01600aca40 2021-11-12T05:41:04.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.678+0000 7f0164b1f700 1 -- 172.21.2.105:0/3005067999 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01600aaa60 con 0x7f01600aca40 2021-11-12T05:41:04.692 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.678+0000 7f01577fe700 1 -- 172.21.2.105:0/3005067999 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0148011e90 con 0x7f01600aca40 2021-11-12T05:41:04.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.678+0000 7f0164b1f700 1 -- 172.21.2.105:0/3005067999 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0160064aa0 con 0x7f01600aca40 2021-11-12T05:41:04.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.678+0000 7f01577fe700 1 -- 172.21.2.105:0/3005067999 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f014800f070 con 0x7f01600aca40 2021-11-12T05:41:04.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.678+0000 7f01577fe700 1 --2- 172.21.2.105:0/3005067999 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0144053660 0x7f0144055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.678+0000 7f01577fe700 1 -- 172.21.2.105:0/3005067999 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f014806d390 con 0x7f01600aca40 2021-11-12T05:41:04.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.678+0000 7f015dd9b700 1 --2- 172.21.2.105:0/3005067999 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0144053660 0x7f0144055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:04.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.678+0000 7f015dd9b700 1 --2- 172.21.2.105:0/3005067999 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0144053660 0x7f0144055b20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f0150002fb0 tx=0x7f01500069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:04.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.682+0000 7f01577fe700 1 -- 172.21.2.105:0/3005067999 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0148047ff0 con 0x7f01600aca40 2021-11-12T05:41:04.767 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.766+0000 7f0164b1f700 1 -- 172.21.2.105:0/3005067999 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0160057350 con 0x7f01600aca40 2021-11-12T05:41:04.768 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.766+0000 7f01577fe700 1 -- 172.21.2.105:0/3005067999 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v30) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0148047be0 con 0x7f01600aca40 2021-11-12T05:41:04.768 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:41:04.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.766+0000 7f0164b1f700 1 -- 172.21.2.105:0/3005067999 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0144053660 msgr2=0x7f0144055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:04.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.766+0000 7f0164b1f700 1 --2- 172.21.2.105:0/3005067999 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0144053660 0x7f0144055b20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f0150002fb0 tx=0x7f01500069b0).stop 2021-11-12T05:41:04.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.766+0000 7f0164b1f700 1 -- 172.21.2.105:0/3005067999 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f01600aca40 msgr2=0x7f0160064d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:04.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.766+0000 7f0164b1f700 1 --2- 172.21.2.105:0/3005067999 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f01600aca40 0x7f0160064d80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f01600ae6a0 tx=0x7f0148015000).stop 2021-11-12T05:41:04.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.766+0000 7f0164b1f700 1 -- 172.21.2.105:0/3005067999 shutdown_connections 2021-11-12T05:41:04.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.766+0000 7f0164b1f700 1 --2- 172.21.2.105:0/3005067999 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0144053660 0x7f0144055b20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:04.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.766+0000 7f0164b1f700 1 --2- 172.21.2.105:0/3005067999 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f01601478b0 0x7f01600aa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:04.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.766+0000 7f0164b1f700 1 --2- 172.21.2.105:0/3005067999 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f01600b0520 0x7f01600ab830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:04.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.766+0000 7f0164b1f700 1 --2- 172.21.2.105:0/3005067999 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f01600aca40 0x7f0160064d80 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:04.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.766+0000 7f0164b1f700 1 -- 172.21.2.105:0/3005067999 >> 172.21.2.105:0/3005067999 conn(0x7f016005c490 msgr2=0x7f0160144e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:04.772 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.766+0000 7f0164b1f700 1 -- 172.21.2.105:0/3005067999 shutdown_connections 2021-11-12T05:41:04.772 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.766+0000 7f0164b1f700 1 -- 172.21.2.105:0/3005067999 wait complete. 2021-11-12T05:41:04.776 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:41:04.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.826+0000 7ff4c2c97700 1 Processor -- start 2021-11-12T05:41:04.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.826+0000 7ff4c2c97700 1 -- start start 2021-11-12T05:41:04.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.826+0000 7ff4c2c97700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7ff4bc0b0520 0x7ff4bc144890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.826+0000 7ff4c2c97700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4bc0b1840 con 0x7ff4bc0aca40 2021-11-12T05:41:04.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.826+0000 7ff4c2c97700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4bc0af2b0 con 0x7ff4bc0ace20 2021-11-12T05:41:04.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.826+0000 7ff4c2c97700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4bc0b0990 con 0x7ff4bc0b0520 2021-11-12T05:41:04.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.826+0000 7ff4c0a33700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7ff4bc0aca40 0x7ff4bc1473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:54546/0 (socket says 172.21.2.105:54546) 2021-11-12T05:41:04.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.826+0000 7ff4c0a33700 1 -- 172.21.2.105:0/1131436134 learned_addr learned my addr 172.21.2.105:0/1131436134 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:41:04.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.826+0000 7ff4bb7fe700 1 -- 172.21.2.105:0/1131436134 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1767343587 0 0) 0x7ff4bc0b1840 con 0x7ff4bc0aca40 2021-11-12T05:41:04.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.826+0000 7ff4bb7fe700 1 -- 172.21.2.105:0/1131436134 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff49c003260 con 0x7ff4bc0aca40 2021-11-12T05:41:04.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.826+0000 7ff4c1234700 1 --2- 172.21.2.105:0/1131436134 >> v2:172.21.2.115:3300/0 conn(0x7ff4bc0b0520 0x7ff4bc144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:04.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.826+0000 7ff4bb7fe700 1 -- 172.21.2.105:0/1131436134 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4278791658 0 0) 0x7ff49c003260 con 0x7ff4bc0aca40 2021-11-12T05:41:04.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.826+0000 7ff4bb7fe700 1 -- 172.21.2.105:0/1131436134 >> v2:172.21.2.115:3300/0 conn(0x7ff4bc0b0520 msgr2=0x7ff4bc144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:04.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.826+0000 7ff4bb7fe700 1 --2- 172.21.2.105:0/1131436134 >> v2:172.21.2.115:3300/0 conn(0x7ff4bc0b0520 0x7ff4bc144890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:04.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.826+0000 7ff4bb7fe700 1 -- 172.21.2.105:0/1131436134 >> v1:172.21.2.115:6789/0 conn(0x7ff4bc0ace20 legacy=0x7ff4bc144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:04.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.826+0000 7ff4bb7fe700 1 -- 172.21.2.105:0/1131436134 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4bc144d80 con 0x7ff4bc0aca40 2021-11-12T05:41:04.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.826+0000 7ff4bb7fe700 1 -- 172.21.2.105:0/1131436134 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7ff4ac001660 con 0x7ff4bc0aca40 2021-11-12T05:41:04.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.826+0000 7ff4bb7fe700 1 -- 172.21.2.105:0/1131436134 >> v1:172.21.2.105:6789/0 conn(0x7ff4bc0aca40 legacy=0x7ff4bc1473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:04.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.826+0000 7ff4bb7fe700 1 --2- 172.21.2.105:0/1131436134 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff49c003750 0x7ff49c003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.826+0000 7ff4bb7fe700 1 --2- 172.21.2.105:0/1131436134 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff49c004500 0x7ff49c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.826+0000 7ff4bb7fe700 1 --2- 172.21.2.105:0/1131436134 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff49c004f90 0x7ff49c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.826+0000 7ff4bb7fe700 1 -- 172.21.2.105:0/1131436134 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc0b0990 con 0x7ff49c004f90 2021-11-12T05:41:04.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.826+0000 7ff4bb7fe700 1 -- 172.21.2.105:0/1131436134 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c00be80 con 0x7ff49c003750 2021-11-12T05:41:04.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.826+0000 7ff4bb7fe700 1 -- 172.21.2.105:0/1131436134 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c00c040 con 0x7ff49c004500 2021-11-12T05:41:04.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.826+0000 7ff4c1234700 1 --2- 172.21.2.105:0/1131436134 >> v2:172.21.2.115:3300/0 conn(0x7ff4bc0b0520 0x7ff4bc144890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:41:04.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.826+0000 7ff4c1234700 1 --2- 172.21.2.105:0/1131436134 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff49c004f90 0x7ff49c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:04.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4c1234700 1 -- 172.21.2.105:0/1131436134 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff49c004500 msgr2=0x7ff49c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:04.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4c1234700 1 --2- 172.21.2.105:0/1131436134 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff49c004500 0x7ff49c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:04.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4c1234700 1 -- 172.21.2.105:0/1131436134 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff49c003750 msgr2=0x7ff49c003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:04.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4c0a33700 1 --2- 172.21.2.105:0/1131436134 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff49c003750 0x7ff49c003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:04.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4c1234700 1 --2- 172.21.2.105:0/1131436134 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff49c003750 0x7ff49c003b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:04.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4c1234700 1 -- 172.21.2.105:0/1131436134 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49c003260 con 0x7ff49c004f90 2021-11-12T05:41:04.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4c1234700 1 -- 172.21.2.105:0/1131436134 reap_dead start 2021-11-12T05:41:04.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4c1234700 1 --2- 172.21.2.105:0/1131436134 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff49c004f90 0x7ff49c00b750 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7ff4b4007000 tx=0x7ff4b4008040).ready entity=mon.0 client_cookie=d886b56585c6ce6e server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:04.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4bb7fe700 1 -- 172.21.2.105:0/1131436134 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4b4006b40 con 0x7ff49c004f90 2021-11-12T05:41:04.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4bb7fe700 1 -- 172.21.2.105:0/1131436134 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b400c640 con 0x7ff49c004f90 2021-11-12T05:41:04.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4bb7fe700 1 -- 172.21.2.105:0/1131436134 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4b400c7b0 con 0x7ff49c004f90 2021-11-12T05:41:04.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4c2c97700 1 -- 172.21.2.105:0/1131436134 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff49c004f90 msgr2=0x7ff49c00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:04.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4c2c97700 1 --2- 172.21.2.105:0/1131436134 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff49c004f90 0x7ff49c00b750 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7ff4b4007000 tx=0x7ff4b4008040).stop 2021-11-12T05:41:04.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4c2c97700 1 -- 172.21.2.105:0/1131436134 shutdown_connections 2021-11-12T05:41:04.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4c2c97700 1 --2- 172.21.2.105:0/1131436134 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff49c004f90 0x7ff49c00b750 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:04.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4c2c97700 1 -- 172.21.2.105:0/1131436134 >> 172.21.2.105:0/1131436134 conn(0x7ff4bc05c490 msgr2=0x7ff4bc0b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:04.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4c2c97700 1 -- 172.21.2.105:0/1131436134 shutdown_connections 2021-11-12T05:41:04.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4c2c97700 1 -- 172.21.2.105:0/1131436134 wait complete. 2021-11-12T05:41:04.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4c2c97700 1 Processor -- start 2021-11-12T05:41:04.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4c2c97700 1 -- start start 2021-11-12T05:41:04.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4c2c97700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff49c004f90 0x7ff4bc0a73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4c2c97700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff4bc0ac150 0x7ff4bc0a94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4c2c97700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff4bc1569d0 0x7ff4bc156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4c2c97700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc064f40 con 0x7ff49c004f90 2021-11-12T05:41:04.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4c2c97700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc065900 con 0x7ff4bc1569d0 2021-11-12T05:41:04.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4c2c97700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc065ba0 con 0x7ff4bc0ac150 2021-11-12T05:41:04.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4c0a33700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff49c004f90 0x7ff4bc0a73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:04.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4c0a33700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff49c004f90 0x7ff4bc0a73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44162/0 (socket says 172.21.2.105:44162) 2021-11-12T05:41:04.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4c0a33700 1 -- 172.21.2.105:0/1200540632 learned_addr learned my addr 172.21.2.105:0/1200540632 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:04.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4c0a33700 1 -- 172.21.2.105:0/1200540632 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff4bc0ac150 msgr2=0x7ff4bc0a94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:04.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4c0a33700 1 --2- 172.21.2.105:0/1200540632 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff4bc0ac150 0x7ff4bc0a94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:04.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4c0a33700 1 -- 172.21.2.105:0/1200540632 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff4bc1569d0 msgr2=0x7ff4bc156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:04.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4c0a33700 1 --2- 172.21.2.105:0/1200540632 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff4bc1569d0 0x7ff4bc156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:04.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4c0a33700 1 -- 172.21.2.105:0/1200540632 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4bc157340 con 0x7ff49c004f90 2021-11-12T05:41:04.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4c0a33700 1 --2- 172.21.2.105:0/1200540632 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff49c004f90 0x7ff4bc0a73c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7ff4ac008000 tx=0x7ff4ac009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:04.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4b9ffb700 1 -- 172.21.2.105:0/1200540632 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4ac007170 con 0x7ff49c004f90 2021-11-12T05:41:04.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4b9ffb700 1 -- 172.21.2.105:0/1200540632 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac0072d0 con 0x7ff49c004f90 2021-11-12T05:41:04.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4c2c97700 1 -- 172.21.2.105:0/1200540632 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4bc156450 con 0x7ff49c004f90 2021-11-12T05:41:04.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4c2c97700 1 -- 172.21.2.105:0/1200540632 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4bc159e00 con 0x7ff49c004f90 2021-11-12T05:41:04.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4b9ffb700 1 -- 172.21.2.105:0/1200540632 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4ac004920 con 0x7ff49c004f90 2021-11-12T05:41:04.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.830+0000 7ff4c2c97700 1 -- 172.21.2.105:0/1200540632 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff494003410 con 0x7ff49c004f90 2021-11-12T05:41:04.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.834+0000 7ff4b9ffb700 1 -- 172.21.2.105:0/1200540632 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff4ac01b060 con 0x7ff49c004f90 2021-11-12T05:41:04.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.834+0000 7ff4b9ffb700 1 --2- 172.21.2.105:0/1200540632 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff4a0053690 0x7ff4a0055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.834+0000 7ff4b9ffb700 1 -- 172.21.2.105:0/1200540632 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5596+0+0 (secure 0 0 0) 0x7ff4ac06b310 con 0x7ff49c004f90 2021-11-12T05:41:04.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.834+0000 7ff4bbfff700 1 --2- 172.21.2.105:0/1200540632 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff4a0053690 0x7ff4a0055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:04.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.834+0000 7ff4bbfff700 1 --2- 172.21.2.105:0/1200540632 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff4a0053690 0x7ff4a0055b50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7ff4a4000f70 tx=0x7ff4a40069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:04.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.834+0000 7ff4b9ffb700 1 -- 172.21.2.105:0/1200540632 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff4ac042540 con 0x7ff49c004f90 2021-11-12T05:41:04.919 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.918+0000 7ff4c2c97700 1 -- 172.21.2.105:0/1200540632 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff494003c40 con 0x7ff49c004f90 2021-11-12T05:41:04.920 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.918+0000 7ff4b9ffb700 1 -- 172.21.2.105:0/1200540632 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff4ac019070 con 0x7ff49c004f90 2021-11-12T05:41:04.920 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:41:04.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.918+0000 7ff4c2c97700 1 -- 172.21.2.105:0/1200540632 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff4a0053690 msgr2=0x7ff4a0055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:04.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.918+0000 7ff4c2c97700 1 --2- 172.21.2.105:0/1200540632 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff4a0053690 0x7ff4a0055b50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7ff4a4000f70 tx=0x7ff4a40069b0).stop 2021-11-12T05:41:04.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.918+0000 7ff4c2c97700 1 -- 172.21.2.105:0/1200540632 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff49c004f90 msgr2=0x7ff4bc0a73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:04.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.918+0000 7ff4c2c97700 1 --2- 172.21.2.105:0/1200540632 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff49c004f90 0x7ff4bc0a73c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7ff4ac008000 tx=0x7ff4ac009040).stop 2021-11-12T05:41:04.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.918+0000 7ff4c2c97700 1 -- 172.21.2.105:0/1200540632 shutdown_connections 2021-11-12T05:41:04.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.918+0000 7ff4c2c97700 1 --2- 172.21.2.105:0/1200540632 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff4a0053690 0x7ff4a0055b50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:04.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.918+0000 7ff4c2c97700 1 --2- 172.21.2.105:0/1200540632 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff4bc1569d0 0x7ff4bc156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:04.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.918+0000 7ff4c2c97700 1 --2- 172.21.2.105:0/1200540632 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff4bc0ac150 0x7ff4bc0a94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:04.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.918+0000 7ff4c2c97700 1 --2- 172.21.2.105:0/1200540632 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff49c004f90 0x7ff4bc0a73c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:04.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.918+0000 7ff4c2c97700 1 -- 172.21.2.105:0/1200540632 >> 172.21.2.105:0/1200540632 conn(0x7ff4bc05c490 msgr2=0x7ff4bc144430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:04.924 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.918+0000 7ff4c2c97700 1 -- 172.21.2.105:0/1200540632 shutdown_connections 2021-11-12T05:41:04.924 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.918+0000 7ff4c2c97700 1 -- 172.21.2.105:0/1200540632 wait complete. 2021-11-12T05:41:04.928 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-12T05:41:04.979 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae7fc0700 1 Processor -- start 2021-11-12T05:41:04.979 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae7fc0700 1 -- start start 2021-11-12T05:41:04.979 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae7fc0700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f2ae005fdc0 0x7f2ae00601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.980 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae7fc0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2ae00ade80 0x7f2ae0066730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.980 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae7fc0700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ae0066150 con 0x7f2ae013a9c0 2021-11-12T05:41:04.980 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae7fc0700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae0141fb0 con 0x7f2ae005fdc0 2021-11-12T05:41:04.980 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae7fc0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae00663f0 con 0x7f2ae00ade80 2021-11-12T05:41:04.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae655d700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f2ae013a9c0 0x7f2ae0141470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:54566/0 (socket says 172.21.2.105:54566) 2021-11-12T05:41:04.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae655d700 1 -- 172.21.2.105:0/2872565572 learned_addr learned my addr 172.21.2.105:0/2872565572 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:41:04.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae4d5a700 1 -- 172.21.2.105:0/2872565572 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2366944357 0 0) 0x7f2ae0066150 con 0x7f2ae013a9c0 2021-11-12T05:41:04.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae4d5a700 1 -- 172.21.2.105:0/2872565572 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ac8003260 con 0x7f2ae013a9c0 2021-11-12T05:41:04.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae5d5c700 1 --2- 172.21.2.105:0/2872565572 >> v2:172.21.2.115:3300/0 conn(0x7f2ae005fdc0 0x7f2ae00601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:04.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae555b700 1 --2- 172.21.2.105:0/2872565572 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2ae00ade80 0x7f2ae0066730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:04.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae4d5a700 1 -- 172.21.2.105:0/2872565572 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3449828007 0 0) 0x7f2ac8003260 con 0x7f2ae013a9c0 2021-11-12T05:41:04.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae4d5a700 1 -- 172.21.2.105:0/2872565572 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2ae00ade80 msgr2=0x7f2ae0066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:04.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae4d5a700 1 --2- 172.21.2.105:0/2872565572 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2ae00ade80 0x7f2ae0066730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:04.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae4d5a700 1 -- 172.21.2.105:0/2872565572 >> v2:172.21.2.115:3300/0 conn(0x7f2ae005fdc0 msgr2=0x7f2ae00601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:04.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae4d5a700 1 --2- 172.21.2.105:0/2872565572 >> v2:172.21.2.115:3300/0 conn(0x7f2ae005fdc0 0x7f2ae00601a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:04.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae4d5a700 1 -- 172.21.2.105:0/2872565572 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae0140fd0 con 0x7f2ae013a9c0 2021-11-12T05:41:04.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae4d5a700 1 -- 172.21.2.105:0/2872565572 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f2ad80019e0 con 0x7f2ae013a9c0 2021-11-12T05:41:04.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae4d5a700 1 -- 172.21.2.105:0/2872565572 >> v1:172.21.2.105:6789/0 conn(0x7f2ae013a9c0 legacy=0x7f2ae0141470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:04.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae4d5a700 1 --2- 172.21.2.105:0/2872565572 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ac80037d0 0x7f2ac8003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae4d5a700 1 --2- 172.21.2.105:0/2872565572 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2ae00ade80 0x7f2ac8004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae4d5a700 1 --2- 172.21.2.105:0/2872565572 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2ac80049f0 0x7f2ac8004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae4d5a700 1 -- 172.21.2.105:0/2872565572 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae00663f0 con 0x7f2ac80037d0 2021-11-12T05:41:04.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae4d5a700 1 -- 172.21.2.105:0/2872565572 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac800b750 con 0x7f2ac80049f0 2021-11-12T05:41:04.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae4d5a700 1 -- 172.21.2.105:0/2872565572 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac800b910 con 0x7f2ae00ade80 2021-11-12T05:41:04.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae5d5c700 1 --2- 172.21.2.105:0/2872565572 >> v2:172.21.2.115:3300/0 conn(0x7f2ae005fdc0 0x7f2ae00601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:41:04.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae5d5c700 1 --2- 172.21.2.105:0/2872565572 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ac80037d0 0x7f2ac8003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:04.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae655d700 1 --2- 172.21.2.105:0/2872565572 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2ac80049f0 0x7f2ac8004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:04.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae555b700 1 --2- 172.21.2.105:0/2872565572 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2ae00ade80 0x7f2ac8004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:04.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae5d5c700 1 -- 172.21.2.105:0/2872565572 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2ae00ade80 msgr2=0x7f2ac8004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:04.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae5d5c700 1 --2- 172.21.2.105:0/2872565572 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2ae00ade80 0x7f2ac8004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:04.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae5d5c700 1 -- 172.21.2.105:0/2872565572 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2ac80049f0 msgr2=0x7f2ac8004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:04.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae5d5c700 1 --2- 172.21.2.105:0/2872565572 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2ac80049f0 0x7f2ac8004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:04.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae5d5c700 1 -- 172.21.2.105:0/2872565572 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac8003260 con 0x7f2ac80037d0 2021-11-12T05:41:04.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae5d5c700 1 --2- 172.21.2.105:0/2872565572 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ac80037d0 0x7f2ac8003bf0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f2adc00a000 tx=0x7f2adc008040).ready entity=mon.0 client_cookie=703d4baccf732262 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:04.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae4d5a700 1 -- 172.21.2.105:0/2872565572 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2adc012610 con 0x7f2ac80037d0 2021-11-12T05:41:04.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae4d5a700 1 -- 172.21.2.105:0/2872565572 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2adc012770 con 0x7f2ac80037d0 2021-11-12T05:41:04.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae4d5a700 1 -- 172.21.2.105:0/2872565572 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2adc012ad0 con 0x7f2ac80037d0 2021-11-12T05:41:04.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae7fc0700 1 -- 172.21.2.105:0/2872565572 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ac80037d0 msgr2=0x7f2ac8003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:04.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae7fc0700 1 --2- 172.21.2.105:0/2872565572 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ac80037d0 0x7f2ac8003bf0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f2adc00a000 tx=0x7f2adc008040).stop 2021-11-12T05:41:04.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae655d700 1 -- 172.21.2.105:0/2872565572 reap_dead start 2021-11-12T05:41:04.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae7fc0700 1 -- 172.21.2.105:0/2872565572 shutdown_connections 2021-11-12T05:41:04.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae7fc0700 1 -- 172.21.2.105:0/2872565572 >> 172.21.2.105:0/2872565572 conn(0x7f2ae00608d0 msgr2=0x7f2ae005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:04.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae7fc0700 1 -- 172.21.2.105:0/2872565572 shutdown_connections 2021-11-12T05:41:04.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.978+0000 7f2ae7fc0700 1 -- 172.21.2.105:0/2872565572 wait complete. 2021-11-12T05:41:04.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.982+0000 7f2ae7fc0700 1 Processor -- start 2021-11-12T05:41:04.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.982+0000 7f2ae7fc0700 1 -- start start 2021-11-12T05:41:04.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.982+0000 7f2ae7fc0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ac80037d0 0x7f2ae00b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.982+0000 7f2ae7fc0700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2ae00b4c50 0x7f2ae013ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.982+0000 7f2ae7fc0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2ae0153490 0x7f2ae013f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:04.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.982+0000 7f2ae7fc0700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae00b6a00 con 0x7f2ac80037d0 2021-11-12T05:41:04.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.982+0000 7f2ae7fc0700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae00b7f20 con 0x7f2ae00b4c50 2021-11-12T05:41:04.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.982+0000 7f2ae7fc0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae00b8180 con 0x7f2ae0153490 2021-11-12T05:41:04.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.982+0000 7f2ae5d5c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ac80037d0 0x7f2ae00b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:04.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.982+0000 7f2ae5d5c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ac80037d0 0x7f2ae00b3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44180/0 (socket says 172.21.2.105:44180) 2021-11-12T05:41:04.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.982+0000 7f2ae5d5c700 1 -- 172.21.2.105:0/4249752912 learned_addr learned my addr 172.21.2.105:0/4249752912 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:04.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.982+0000 7f2ae555b700 1 --2- 172.21.2.105:0/4249752912 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2ae00b4c50 0x7f2ae013ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:04.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.982+0000 7f2ae655d700 1 --2- 172.21.2.105:0/4249752912 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2ae0153490 0x7f2ae013f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:04.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.982+0000 7f2ae5d5c700 1 -- 172.21.2.105:0/4249752912 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2ae0153490 msgr2=0x7f2ae013f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:04.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.982+0000 7f2ae5d5c700 1 --2- 172.21.2.105:0/4249752912 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2ae0153490 0x7f2ae013f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:04.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.982+0000 7f2ae5d5c700 1 -- 172.21.2.105:0/4249752912 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2ae00b4c50 msgr2=0x7f2ae013ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:05.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.982+0000 7f2ae5d5c700 1 --2- 172.21.2.105:0/4249752912 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2ae00b4c50 0x7f2ae013ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:05.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.982+0000 7f2ae5d5c700 1 -- 172.21.2.105:0/4249752912 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae013c580 con 0x7f2ac80037d0 2021-11-12T05:41:05.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.982+0000 7f2ae555b700 1 --2- 172.21.2.105:0/4249752912 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2ae00b4c50 0x7f2ae013ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:41:05.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.982+0000 7f2ae5d5c700 1 --2- 172.21.2.105:0/4249752912 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ac80037d0 0x7f2ae00b3dd0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f2adc00a000 tx=0x7f2adc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:05.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.982+0000 7f2ad2ffd700 1 -- 172.21.2.105:0/4249752912 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2adc01c800 con 0x7f2ac80037d0 2021-11-12T05:41:05.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.982+0000 7f2ad2ffd700 1 -- 172.21.2.105:0/4249752912 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2adc000e90 con 0x7f2ac80037d0 2021-11-12T05:41:05.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.982+0000 7f2ae7fc0700 1 -- 172.21.2.105:0/4249752912 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ae013c290 con 0x7f2ac80037d0 2021-11-12T05:41:05.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.982+0000 7f2ad2ffd700 1 -- 172.21.2.105:0/4249752912 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2adc01cb50 con 0x7f2ac80037d0 2021-11-12T05:41:05.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.982+0000 7f2ae7fc0700 1 -- 172.21.2.105:0/4249752912 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae013cf10 con 0x7f2ac80037d0 2021-11-12T05:41:05.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.982+0000 7f2ae7fc0700 1 -- 172.21.2.105:0/4249752912 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ae013c710 con 0x7f2ac80037d0 2021-11-12T05:41:05.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.982+0000 7f2ad2ffd700 1 -- 172.21.2.105:0/4249752912 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2adc0068b0 con 0x7f2ac80037d0 2021-11-12T05:41:05.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.982+0000 7f2ad2ffd700 1 --2- 172.21.2.105:0/4249752912 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2ac00536d0 0x7f2ac0055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:05.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.982+0000 7f2ad2ffd700 1 -- 172.21.2.105:0/4249752912 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f2adc06cfb0 con 0x7f2ac80037d0 2021-11-12T05:41:05.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.982+0000 7f2ae555b700 1 --2- 172.21.2.105:0/4249752912 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2ac00536d0 0x7f2ac0055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:05.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.982+0000 7f2ae555b700 1 --2- 172.21.2.105:0/4249752912 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2ac00536d0 0x7f2ac0055b90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f2ad400b000 tx=0x7f2ad4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:05.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:04.986+0000 7f2ad2ffd700 1 -- 172.21.2.105:0/4249752912 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2adc044290 con 0x7f2ac80037d0 2021-11-12T05:41:05.074 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.074+0000 7f2ae7fc0700 1 -- 172.21.2.105:0/4249752912 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2ae0057350 con 0x7f2ac80037d0 2021-11-12T05:41:05.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.074+0000 7f2ad2ffd700 1 -- 172.21.2.105:0/4249752912 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+143 (secure 0 0 0) 0x7f2adc029030 con 0x7f2ac80037d0 2021-11-12T05:41:05.075 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:41:05.076 INFO:teuthology.orchestra.run.gibba005.stdout:[ 2021-11-12T05:41:05.076 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:41:05.076 INFO:teuthology.orchestra.run.gibba005.stdout: "poolnum": 1, 2021-11-12T05:41:05.076 INFO:teuthology.orchestra.run.gibba005.stdout: "poolname": "device_health_metrics" 2021-11-12T05:41:05.077 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:41:05.077 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:41:05.077 INFO:teuthology.orchestra.run.gibba005.stdout: "poolnum": 2, 2021-11-12T05:41:05.077 INFO:teuthology.orchestra.run.gibba005.stdout: "poolname": "rbd" 2021-11-12T05:41:05.077 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:41:05.078 INFO:teuthology.orchestra.run.gibba005.stdout:] 2021-11-12T05:41:05.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.074+0000 7f2ae7fc0700 1 -- 172.21.2.105:0/4249752912 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2ac00536d0 msgr2=0x7f2ac0055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:05.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.074+0000 7f2ae7fc0700 1 --2- 172.21.2.105:0/4249752912 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2ac00536d0 0x7f2ac0055b90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f2ad400b000 tx=0x7f2ad4008040).stop 2021-11-12T05:41:05.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.074+0000 7f2ae7fc0700 1 -- 172.21.2.105:0/4249752912 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ac80037d0 msgr2=0x7f2ae00b3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:05.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.074+0000 7f2ae7fc0700 1 --2- 172.21.2.105:0/4249752912 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ac80037d0 0x7f2ae00b3dd0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f2adc00a000 tx=0x7f2adc008040).stop 2021-11-12T05:41:05.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.074+0000 7f2ae7fc0700 1 -- 172.21.2.105:0/4249752912 shutdown_connections 2021-11-12T05:41:05.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.074+0000 7f2ae7fc0700 1 --2- 172.21.2.105:0/4249752912 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2ac00536d0 0x7f2ac0055b90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:05.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.074+0000 7f2ae7fc0700 1 --2- 172.21.2.105:0/4249752912 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2ae0153490 0x7f2ae013f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:05.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.074+0000 7f2ae7fc0700 1 --2- 172.21.2.105:0/4249752912 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2ae00b4c50 0x7f2ae013ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:05.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.074+0000 7f2ae7fc0700 1 --2- 172.21.2.105:0/4249752912 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ac80037d0 0x7f2ae00b3dd0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:05.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.074+0000 7f2ae7fc0700 1 -- 172.21.2.105:0/4249752912 >> 172.21.2.105:0/4249752912 conn(0x7f2ae00608d0 msgr2=0x7f2ae00ae710 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:05.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.074+0000 7f2ae7fc0700 1 -- 172.21.2.105:0/4249752912 shutdown_connections 2021-11-12T05:41:05.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.074+0000 7f2ae7fc0700 1 -- 172.21.2.105:0/4249752912 wait complete. 2021-11-12T05:41:05.083 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-12T05:41:05.083 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-12T05:41:05.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.134+0000 7f72b31b0700 1 Processor -- start 2021-11-12T05:41:05.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.134+0000 7f72b31b0700 1 -- start start 2021-11-12T05:41:05.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.134+0000 7f72b31b0700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f72ac0626b0 0x7f72ac062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:05.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.134+0000 7f72b31b0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f72ac0af750 0x7f72ac130370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:05.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.134+0000 7f72b31b0700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72ac130d10 con 0x7f72ac130860 2021-11-12T05:41:05.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.134+0000 7f72b31b0700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72ac0b0d50 con 0x7f72ac0626b0 2021-11-12T05:41:05.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.134+0000 7f72b31b0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac0ad380 con 0x7f72ac0af750 2021-11-12T05:41:05.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.134+0000 7f72b0f4c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f72ac0626b0 0x7f72ac062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:05.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.134+0000 7f72b0f4c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f72ac0626b0 0x7f72ac062a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44188/0 (socket says 172.21.2.105:44188) 2021-11-12T05:41:05.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.134+0000 7f72b0f4c700 1 -- 172.21.2.105:0/1666898974 learned_addr learned my addr 172.21.2.105:0/1666898974 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:05.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.134+0000 7f72b0f4c700 1 -- 172.21.2.105:0/1666898974 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f72ac0af750 msgr2=0x7f72ac130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:05.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.134+0000 7f72b0f4c700 1 --2- 172.21.2.105:0/1666898974 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f72ac0af750 0x7f72ac130370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:05.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.134+0000 7f72b0f4c700 1 -- 172.21.2.105:0/1666898974 >> v1:172.21.2.115:6789/0 conn(0x7f72ac130860 legacy=0x7f72ac14a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:05.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.134+0000 7f72b0f4c700 1 -- 172.21.2.105:0/1666898974 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ac0ae190 con 0x7f72ac0626b0 2021-11-12T05:41:05.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.134+0000 7f72b0f4c700 1 --2- 172.21.2.105:0/1666898974 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f72ac0626b0 0x7f72ac062a90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f72ac0af1d0 tx=0x7f729c006eb0).ready entity=mon.0 client_cookie=e7848962bea0dd96 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:05.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.134+0000 7f72ab7fe700 1 -- 172.21.2.105:0/1666898974 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f729c00d570 con 0x7f72ac0626b0 2021-11-12T05:41:05.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.134+0000 7f72ab7fe700 1 -- 172.21.2.105:0/1666898974 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729c000e90 con 0x7f72ac0626b0 2021-11-12T05:41:05.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.134+0000 7f72ab7fe700 1 -- 172.21.2.105:0/1666898974 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f729c00d8c0 con 0x7f72ac0626b0 2021-11-12T05:41:05.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.134+0000 7f72b31b0700 1 -- 172.21.2.105:0/1666898974 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f72ac0626b0 msgr2=0x7f72ac062a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:05.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.134+0000 7f72b31b0700 1 --2- 172.21.2.105:0/1666898974 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f72ac0626b0 0x7f72ac062a90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f72ac0af1d0 tx=0x7f729c006eb0).stop 2021-11-12T05:41:05.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.134+0000 7f72b31b0700 1 -- 172.21.2.105:0/1666898974 shutdown_connections 2021-11-12T05:41:05.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.134+0000 7f72b31b0700 1 --2- 172.21.2.105:0/1666898974 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f72ac0af750 0x7f72ac130370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:05.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.134+0000 7f72b31b0700 1 --2- 172.21.2.105:0/1666898974 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f72ac0626b0 0x7f72ac062a90 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:05.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.134+0000 7f72b31b0700 1 -- 172.21.2.105:0/1666898974 >> 172.21.2.105:0/1666898974 conn(0x7f72ac0b5320 msgr2=0x7f72ac0b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:05.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.134+0000 7f72b31b0700 1 -- 172.21.2.105:0/1666898974 shutdown_connections 2021-11-12T05:41:05.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.134+0000 7f72b31b0700 1 -- 172.21.2.105:0/1666898974 wait complete. 2021-11-12T05:41:05.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.134+0000 7f72b31b0700 1 Processor -- start 2021-11-12T05:41:05.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.134+0000 7f72b31b0700 1 -- start start 2021-11-12T05:41:05.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.138+0000 7f72b31b0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f72ac0626b0 0x7f72ac063c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:05.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.138+0000 7f72b31b0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f72ac0af750 0x7f72ac14ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:05.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.138+0000 7f72b31b0700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f72ac130860 0x7f72ac12f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:05.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.138+0000 7f72b31b0700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac0655d0 con 0x7f72ac0626b0 2021-11-12T05:41:05.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.138+0000 7f72b31b0700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac0660c0 con 0x7f72ac130860 2021-11-12T05:41:05.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.138+0000 7f72b31b0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac066340 con 0x7f72ac0af750 2021-11-12T05:41:05.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.138+0000 7f72b0f4c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f72ac0626b0 0x7f72ac063c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:05.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.138+0000 7f72b0f4c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f72ac0626b0 0x7f72ac063c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44194/0 (socket says 172.21.2.105:44194) 2021-11-12T05:41:05.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.138+0000 7f72b0f4c700 1 -- 172.21.2.105:0/1631630357 learned_addr learned my addr 172.21.2.105:0/1631630357 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:05.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.138+0000 7f72b0f4c700 1 -- 172.21.2.105:0/1631630357 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f72ac0af750 msgr2=0x7f72ac14ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:05.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.138+0000 7f72b0f4c700 1 --2- 172.21.2.105:0/1631630357 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f72ac0af750 0x7f72ac14ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:05.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.138+0000 7f72b0f4c700 1 -- 172.21.2.105:0/1631630357 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f72ac130860 msgr2=0x7f72ac12f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:05.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.138+0000 7f72b0f4c700 1 --2- 172.21.2.105:0/1631630357 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f72ac130860 0x7f72ac12f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:05.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.138+0000 7f72b0f4c700 1 -- 172.21.2.105:0/1631630357 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f729c00b1e0 con 0x7f72ac0626b0 2021-11-12T05:41:05.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.138+0000 7f72b0f4c700 1 --2- 172.21.2.105:0/1631630357 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f72ac0626b0 0x7f72ac063c20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f72ac0af1d0 tx=0x7f729c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:05.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.138+0000 7f72a9ffb700 1 -- 172.21.2.105:0/1631630357 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f729c002f70 con 0x7f72ac0626b0 2021-11-12T05:41:05.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.138+0000 7f72a9ffb700 1 -- 172.21.2.105:0/1631630357 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729c006b80 con 0x7f72ac0626b0 2021-11-12T05:41:05.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.138+0000 7f72b31b0700 1 -- 172.21.2.105:0/1631630357 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72ac0665e0 con 0x7f72ac0626b0 2021-11-12T05:41:05.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.138+0000 7f72a9ffb700 1 -- 172.21.2.105:0/1631630357 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f729c00de20 con 0x7f72ac0626b0 2021-11-12T05:41:05.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.138+0000 7f72b31b0700 1 -- 172.21.2.105:0/1631630357 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72ac063020 con 0x7f72ac0626b0 2021-11-12T05:41:05.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.138+0000 7f72b31b0700 1 -- 172.21.2.105:0/1631630357 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72ac057350 con 0x7f72ac0626b0 2021-11-12T05:41:05.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.138+0000 7f72a9ffb700 1 -- 172.21.2.105:0/1631630357 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f729c025030 con 0x7f72ac0626b0 2021-11-12T05:41:05.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.138+0000 7f72a9ffb700 1 --2- 172.21.2.105:0/1631630357 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7290053610 0x7f7290055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:05.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.138+0000 7f72a9ffb700 1 -- 172.21.2.105:0/1631630357 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f729c06cbc0 con 0x7f72ac0626b0 2021-11-12T05:41:05.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.138+0000 7f72abfff700 1 --2- 172.21.2.105:0/1631630357 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7290053610 0x7f7290055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:05.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.138+0000 7f72abfff700 1 --2- 172.21.2.105:0/1631630357 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7290053610 0x7f7290055ad0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f7294002f70 tx=0x7f7294006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:05.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.142+0000 7f72a9ffb700 1 -- 172.21.2.105:0/1631630357 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f729c043e30 con 0x7f72ac0626b0 2021-11-12T05:41:05.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:05.222+0000 7f72b31b0700 1 -- 172.21.2.105:0/1631630357 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f72ac066a80 con 0x7f72ac0626b0 2021-11-12T05:41:06.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.058+0000 7f72a9ffb700 1 -- 172.21.2.105:0/1631630357 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v31) v1 ==== 133+0+0 (secure 0 0 0) 0x7f729c023070 con 0x7f72ac0626b0 2021-11-12T05:41:06.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.058+0000 7f72b31b0700 1 -- 172.21.2.105:0/1631630357 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7290053610 msgr2=0x7f7290055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:06.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.058+0000 7f72b31b0700 1 --2- 172.21.2.105:0/1631630357 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7290053610 0x7f7290055ad0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f7294002f70 tx=0x7f7294006a80).stop 2021-11-12T05:41:06.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.058+0000 7f72b31b0700 1 -- 172.21.2.105:0/1631630357 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f72ac0626b0 msgr2=0x7f72ac063c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:06.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.058+0000 7f72b31b0700 1 --2- 172.21.2.105:0/1631630357 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f72ac0626b0 0x7f72ac063c20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f72ac0af1d0 tx=0x7f729c015000).stop 2021-11-12T05:41:06.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.058+0000 7f72b31b0700 1 -- 172.21.2.105:0/1631630357 shutdown_connections 2021-11-12T05:41:06.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.058+0000 7f72b31b0700 1 --2- 172.21.2.105:0/1631630357 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7290053610 0x7f7290055ad0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:06.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.058+0000 7f72b31b0700 1 --2- 172.21.2.105:0/1631630357 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f72ac130860 0x7f72ac12f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:06.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.058+0000 7f72b31b0700 1 --2- 172.21.2.105:0/1631630357 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f72ac0af750 0x7f72ac14ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:06.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.058+0000 7f72b31b0700 1 --2- 172.21.2.105:0/1631630357 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f72ac0626b0 0x7f72ac063c20 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:06.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.058+0000 7f72b31b0700 1 -- 172.21.2.105:0/1631630357 >> 172.21.2.105:0/1631630357 conn(0x7f72ac0b5320 msgr2=0x7f72ac130140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:06.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.058+0000 7f72b31b0700 1 -- 172.21.2.105:0/1631630357 shutdown_connections 2021-11-12T05:41:06.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.058+0000 7f72b31b0700 1 -- 172.21.2.105:0/1631630357 wait complete. 2021-11-12T05:41:06.064 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_metadata' created 2021-11-12T05:41:06.068 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-11-12T05:41:06.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.122+0000 7f75e6f5a700 1 Processor -- start 2021-11-12T05:41:06.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.122+0000 7f75e6f5a700 1 -- start start 2021-11-12T05:41:06.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.122+0000 7f75e6f5a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f75e00aca40 0x7f75e00ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:06.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.122+0000 7f75e6f5a700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e00b1840 con 0x7f75e0144180 2021-11-12T05:41:06.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.122+0000 7f75e6f5a700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e00af2b0 con 0x7f75e00b0520 2021-11-12T05:41:06.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.122+0000 7f75e6f5a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e00b09a0 con 0x7f75e00aca40 2021-11-12T05:41:06.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.122+0000 7f75e54f7700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f75e0144180 0x7f75e0144610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:54600/0 (socket says 172.21.2.105:54600) 2021-11-12T05:41:06.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.122+0000 7f75e54f7700 1 -- 172.21.2.105:0/1687416170 learned_addr learned my addr 172.21.2.105:0/1687416170 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:41:06.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.122+0000 7f75e4cf6700 1 --2- 172.21.2.105:0/1687416170 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f75e00aca40 0x7f75e00ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:06.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.122+0000 7f75df7fe700 1 -- 172.21.2.105:0/1687416170 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2827424963 0 0) 0x7f75e00b1840 con 0x7f75e0144180 2021-11-12T05:41:06.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.122+0000 7f75df7fe700 1 -- 172.21.2.105:0/1687416170 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75cc003260 con 0x7f75e0144180 2021-11-12T05:41:06.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.122+0000 7f75df7fe700 1 -- 172.21.2.105:0/1687416170 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2089066860 0 0) 0x7f75cc003260 con 0x7f75e0144180 2021-11-12T05:41:06.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.122+0000 7f75df7fe700 1 -- 172.21.2.105:0/1687416170 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f75e00aca40 msgr2=0x7f75e00ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:06.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.122+0000 7f75df7fe700 1 --2- 172.21.2.105:0/1687416170 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f75e00aca40 0x7f75e00ace20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:06.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.122+0000 7f75df7fe700 1 -- 172.21.2.105:0/1687416170 >> v1:172.21.2.115:6789/0 conn(0x7f75e00b0520 legacy=0x7f75e01473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:06.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.122+0000 7f75df7fe700 1 -- 172.21.2.105:0/1687416170 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e00b1a70 con 0x7f75e0144180 2021-11-12T05:41:06.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.122+0000 7f75df7fe700 1 -- 172.21.2.105:0/1687416170 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f75d80019e0 con 0x7f75e0144180 2021-11-12T05:41:06.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.122+0000 7f75df7fe700 1 -- 172.21.2.105:0/1687416170 >> v1:172.21.2.105:6789/0 conn(0x7f75e0144180 legacy=0x7f75e0144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:06.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.122+0000 7f75df7fe700 1 --2- 172.21.2.105:0/1687416170 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75cc003780 0x7f75cc003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:06.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.122+0000 7f75df7fe700 1 --2- 172.21.2.105:0/1687416170 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f75e00aca40 0x7f75cc004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:06.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.122+0000 7f75df7fe700 1 --2- 172.21.2.105:0/1687416170 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f75cc0049f0 0x7f75cc004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:06.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.122+0000 7f75df7fe700 1 -- 172.21.2.105:0/1687416170 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e00b09a0 con 0x7f75cc003780 2021-11-12T05:41:06.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.122+0000 7f75df7fe700 1 -- 172.21.2.105:0/1687416170 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc00b800 con 0x7f75cc0049f0 2021-11-12T05:41:06.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.122+0000 7f75df7fe700 1 -- 172.21.2.105:0/1687416170 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc00b970 con 0x7f75e00aca40 2021-11-12T05:41:06.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.122+0000 7f75e4cf6700 1 --2- 172.21.2.105:0/1687416170 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75cc003780 0x7f75cc003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:06.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75e4cf6700 1 -- 172.21.2.105:0/1687416170 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f75e00aca40 msgr2=0x7f75cc004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:06.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75e4cf6700 1 --2- 172.21.2.105:0/1687416170 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f75e00aca40 0x7f75cc004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:06.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75e4cf6700 1 -- 172.21.2.105:0/1687416170 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f75cc0049f0 msgr2=0x7f75cc004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:06.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75e4cf6700 1 --2- 172.21.2.105:0/1687416170 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f75cc0049f0 0x7f75cc004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:06.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75e4cf6700 1 -- 172.21.2.105:0/1687416170 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75cc003260 con 0x7f75cc003780 2021-11-12T05:41:06.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75e4cf6700 1 --2- 172.21.2.105:0/1687416170 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75cc003780 0x7f75cc003bc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f75d000c000 tx=0x7f75d0006df0).ready entity=mon.0 client_cookie=c240b1cac1b15bc7 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:06.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75df7fe700 1 -- 172.21.2.105:0/1687416170 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75d000e800 con 0x7f75cc003780 2021-11-12T05:41:06.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75df7fe700 1 -- 172.21.2.105:0/1687416170 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d000e960 con 0x7f75cc003780 2021-11-12T05:41:06.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75df7fe700 1 -- 172.21.2.105:0/1687416170 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75d000ecc0 con 0x7f75cc003780 2021-11-12T05:41:06.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75e6f5a700 1 -- 172.21.2.105:0/1687416170 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75cc003780 msgr2=0x7f75cc003bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:06.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75e6f5a700 1 --2- 172.21.2.105:0/1687416170 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75cc003780 0x7f75cc003bc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f75d000c000 tx=0x7f75d0006df0).stop 2021-11-12T05:41:06.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75e54f7700 1 -- 172.21.2.105:0/1687416170 reap_dead start 2021-11-12T05:41:06.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75e6f5a700 1 -- 172.21.2.105:0/1687416170 shutdown_connections 2021-11-12T05:41:06.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75e6f5a700 1 -- 172.21.2.105:0/1687416170 >> 172.21.2.105:0/1687416170 conn(0x7f75e005c490 msgr2=0x7f75e00b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:06.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75e6f5a700 1 -- 172.21.2.105:0/1687416170 shutdown_connections 2021-11-12T05:41:06.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75e6f5a700 1 -- 172.21.2.105:0/1687416170 wait complete. 2021-11-12T05:41:06.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75e6f5a700 1 Processor -- start 2021-11-12T05:41:06.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75e6f5a700 1 -- start start 2021-11-12T05:41:06.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75e6f5a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75cc003780 0x7f75e00b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:06.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75e6f5a700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f75e00a87f0 0x7f75e00a7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:06.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75e6f5a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f75e00627e0 0x7f75e0062c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:06.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75e6f5a700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e0142290 con 0x7f75cc003780 2021-11-12T05:41:06.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75e6f5a700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e0063160 con 0x7f75e00a87f0 2021-11-12T05:41:06.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75e6f5a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e00a7510 con 0x7f75e00627e0 2021-11-12T05:41:06.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75e4cf6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75cc003780 0x7f75e00b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:06.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75e4cf6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75cc003780 0x7f75e00b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44214/0 (socket says 172.21.2.105:44214) 2021-11-12T05:41:06.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75e4cf6700 1 -- 172.21.2.105:0/2119759151 learned_addr learned my addr 172.21.2.105:0/2119759151 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:06.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75dffff700 1 --2- 172.21.2.105:0/2119759151 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f75e00a87f0 0x7f75e00a7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:06.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75e4cf6700 1 -- 172.21.2.105:0/2119759151 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f75e00627e0 msgr2=0x7f75e0062c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:06.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75e4cf6700 1 --2- 172.21.2.105:0/2119759151 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f75e00627e0 0x7f75e0062c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:06.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75e4cf6700 1 -- 172.21.2.105:0/2119759151 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f75e00a87f0 msgr2=0x7f75e00a7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:06.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75e4cf6700 1 --2- 172.21.2.105:0/2119759151 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f75e00a87f0 0x7f75e00a7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:06.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75e4cf6700 1 -- 172.21.2.105:0/2119759151 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e01574f0 con 0x7f75cc003780 2021-11-12T05:41:06.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75e4cf6700 1 --2- 172.21.2.105:0/2119759151 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75cc003780 0x7f75e00b43c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f75d000c000 tx=0x7f75d0019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:06.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75ddffb700 1 -- 172.21.2.105:0/2119759151 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75d001b820 con 0x7f75cc003780 2021-11-12T05:41:06.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75ddffb700 1 -- 172.21.2.105:0/2119759151 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d0000e90 con 0x7f75cc003780 2021-11-12T05:41:06.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75e6f5a700 1 -- 172.21.2.105:0/2119759151 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75e01571f0 con 0x7f75cc003780 2021-11-12T05:41:06.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75ddffb700 1 -- 172.21.2.105:0/2119759151 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75d001bb70 con 0x7f75cc003780 2021-11-12T05:41:06.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75e6f5a700 1 -- 172.21.2.105:0/2119759151 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75e00a8430 con 0x7f75cc003780 2021-11-12T05:41:06.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75e6f5a700 1 -- 172.21.2.105:0/2119759151 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75e0057350 con 0x7f75cc003780 2021-11-12T05:41:06.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75ddffb700 1 -- 172.21.2.105:0/2119759151 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f75d001bcd0 con 0x7f75cc003780 2021-11-12T05:41:06.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75ddffb700 1 --2- 172.21.2.105:0/2119759151 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f75c0053660 0x7f75c0055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:06.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75ddffb700 1 -- 172.21.2.105:0/2119759151 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5950+0+0 (secure 0 0 0) 0x7f75d006ccd0 con 0x7f75cc003780 2021-11-12T05:41:06.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75dffff700 1 --2- 172.21.2.105:0/2119759151 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f75c0053660 0x7f75c0055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:06.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.126+0000 7f75dffff700 1 --2- 172.21.2.105:0/2119759151 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f75c0053660 0x7f75c0055b20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f75d400b000 tx=0x7f75d4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:06.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.130+0000 7f75ddffb700 1 -- 172.21.2.105:0/2119759151 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f75d0072020 con 0x7f75cc003780 2021-11-12T05:41:06.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:06.214+0000 7f75e6f5a700 1 -- 172.21.2.105:0/2119759151 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f75e005f280 con 0x7f75cc003780 2021-11-12T05:41:07.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.070+0000 7f75ddffb700 1 -- 172.21.2.105:0/2119759151 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v32) v1 ==== 125+0+0 (secure 0 0 0) 0x7f75d0043da0 con 0x7f75cc003780 2021-11-12T05:41:07.074 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.070+0000 7f75e6f5a700 1 -- 172.21.2.105:0/2119759151 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f75c0053660 msgr2=0x7f75c0055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:07.074 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.070+0000 7f75e6f5a700 1 --2- 172.21.2.105:0/2119759151 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f75c0053660 0x7f75c0055b20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f75d400b000 tx=0x7f75d4009040).stop 2021-11-12T05:41:07.074 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.070+0000 7f75e6f5a700 1 -- 172.21.2.105:0/2119759151 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75cc003780 msgr2=0x7f75e00b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:07.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.070+0000 7f75e6f5a700 1 --2- 172.21.2.105:0/2119759151 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75cc003780 0x7f75e00b43c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f75d000c000 tx=0x7f75d0019000).stop 2021-11-12T05:41:07.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.070+0000 7f75e6f5a700 1 -- 172.21.2.105:0/2119759151 shutdown_connections 2021-11-12T05:41:07.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.070+0000 7f75e6f5a700 1 --2- 172.21.2.105:0/2119759151 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f75c0053660 0x7f75c0055b20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:07.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.070+0000 7f75e6f5a700 1 --2- 172.21.2.105:0/2119759151 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f75e00627e0 0x7f75e0062c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:07.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.070+0000 7f75e6f5a700 1 --2- 172.21.2.105:0/2119759151 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f75e00a87f0 0x7f75e00a7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:07.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.070+0000 7f75e6f5a700 1 --2- 172.21.2.105:0/2119759151 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75cc003780 0x7f75e00b43c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:07.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.070+0000 7f75e6f5a700 1 -- 172.21.2.105:0/2119759151 >> 172.21.2.105:0/2119759151 conn(0x7f75e005c490 msgr2=0x7f75e005bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:07.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.070+0000 7f75e6f5a700 1 -- 172.21.2.105:0/2119759151 shutdown_connections 2021-11-12T05:41:07.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.070+0000 7f75e6f5a700 1 -- 172.21.2.105:0/2119759151 wait complete. 2021-11-12T05:41:07.077 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_data' created 2021-11-12T05:41:07.080 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-12T05:41:07.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6ca4aeb700 1 Processor -- start 2021-11-12T05:41:07.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6ca4aeb700 1 -- start start 2021-11-12T05:41:07.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6ca4aeb700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f6ca00ad080 0x7f6ca00af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:07.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6ca4aeb700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca00ac7b0 con 0x7f6ca00ac280 2021-11-12T05:41:07.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6ca4aeb700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca00ac9e0 con 0x7f6ca014b2f0 2021-11-12T05:41:07.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6ca4aeb700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca01488a0 con 0x7f6ca00ad080 2021-11-12T05:41:07.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6c9dd9b700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f6ca00ac280 0x7f6ca014abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:54618/0 (socket says 172.21.2.105:54618) 2021-11-12T05:41:07.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6c9dd9b700 1 -- 172.21.2.105:0/1748582715 learned_addr learned my addr 172.21.2.105:0/1748582715 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:41:07.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6c9e59c700 1 --2- 172.21.2.105:0/1748582715 >> v2:172.21.2.105:3300/0 conn(0x7f6ca00ad080 0x7f6ca00af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:07.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6c9e59c700 1 -- 172.21.2.105:0/1748582715 >> v1:172.21.2.115:6789/0 conn(0x7f6ca014b2f0 legacy=0x7f6ca0147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:07.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6c9e59c700 1 -- 172.21.2.105:0/1748582715 >> v1:172.21.2.105:6789/0 conn(0x7f6ca00ac280 legacy=0x7f6ca014abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:07.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6c9e59c700 1 -- 172.21.2.105:0/1748582715 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca00b0b30 con 0x7f6ca00ad080 2021-11-12T05:41:07.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6c9e59c700 1 --2- 172.21.2.105:0/1748582715 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6ca00ad080 0x7f6ca00af730 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f6ca00b0eb0 tx=0x7f6c90006df0).ready entity=mon.0 client_cookie=7dcb939809617cdd server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:07.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6c9d59a700 1 -- 172.21.2.105:0/1748582715 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c9000d5c0 con 0x7f6ca00ad080 2021-11-12T05:41:07.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6c9d59a700 1 -- 172.21.2.105:0/1748582715 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c90000e90 con 0x7f6ca00ad080 2021-11-12T05:41:07.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6c9d59a700 1 -- 172.21.2.105:0/1748582715 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c9000d910 con 0x7f6ca00ad080 2021-11-12T05:41:07.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6ca4aeb700 1 -- 172.21.2.105:0/1748582715 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6ca00ad080 msgr2=0x7f6ca00af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:07.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6ca4aeb700 1 --2- 172.21.2.105:0/1748582715 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6ca00ad080 0x7f6ca00af730 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f6ca00b0eb0 tx=0x7f6c90006df0).stop 2021-11-12T05:41:07.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6ca4aeb700 1 -- 172.21.2.105:0/1748582715 shutdown_connections 2021-11-12T05:41:07.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6ca4aeb700 1 --2- 172.21.2.105:0/1748582715 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6ca00ad080 0x7f6ca00af730 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:07.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6ca4aeb700 1 -- 172.21.2.105:0/1748582715 >> 172.21.2.105:0/1748582715 conn(0x7f6ca00b5370 msgr2=0x7f6ca00b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:07.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6ca4aeb700 1 -- 172.21.2.105:0/1748582715 shutdown_connections 2021-11-12T05:41:07.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6ca4aeb700 1 -- 172.21.2.105:0/1748582715 wait complete. 2021-11-12T05:41:07.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6ca4aeb700 1 Processor -- start 2021-11-12T05:41:07.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6ca4aeb700 1 -- start start 2021-11-12T05:41:07.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6ca4aeb700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6ca00ac280 0x7f6ca00b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:07.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6ca4aeb700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6ca00ad080 0x7f6ca0156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:07.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6ca4aeb700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6ca014b2f0 0x7f6ca00a9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:07.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6ca4aeb700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca0143450 con 0x7f6ca00ad080 2021-11-12T05:41:07.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6ca4aeb700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca00a9ed0 con 0x7f6ca014b2f0 2021-11-12T05:41:07.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6ca4aeb700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca00a9c30 con 0x7f6ca00ac280 2021-11-12T05:41:07.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6c9dd9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6ca00ad080 0x7f6ca0156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:07.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6c9dd9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6ca00ad080 0x7f6ca0156bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44228/0 (socket says 172.21.2.105:44228) 2021-11-12T05:41:07.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6c9dd9b700 1 -- 172.21.2.105:0/897994187 learned_addr learned my addr 172.21.2.105:0/897994187 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:07.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6c9ed9d700 1 --2- 172.21.2.105:0/897994187 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6ca014b2f0 0x7f6ca00a9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:07.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6c9dd9b700 1 -- 172.21.2.105:0/897994187 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6ca00ac280 msgr2=0x7f6ca00b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:07.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6c9dd9b700 1 --2- 172.21.2.105:0/897994187 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6ca00ac280 0x7f6ca00b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:07.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6c9dd9b700 1 -- 172.21.2.105:0/897994187 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6ca014b2f0 msgr2=0x7f6ca00a9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:07.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6c9dd9b700 1 --2- 172.21.2.105:0/897994187 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6ca014b2f0 0x7f6ca00a9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:07.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6c9dd9b700 1 -- 172.21.2.105:0/897994187 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c9000b180 con 0x7f6ca00ad080 2021-11-12T05:41:07.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6c9ed9d700 1 --2- 172.21.2.105:0/897994187 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6ca014b2f0 0x7f6ca00a9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:41:07.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6c9dd9b700 1 --2- 172.21.2.105:0/897994187 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6ca00ad080 0x7f6ca0156bf0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f6ca00b06e0 tx=0x7f6c88007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:07.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6c977fe700 1 -- 172.21.2.105:0/897994187 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c8800ce30 con 0x7f6ca00ad080 2021-11-12T05:41:07.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6c977fe700 1 -- 172.21.2.105:0/897994187 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c880072e0 con 0x7f6ca00ad080 2021-11-12T05:41:07.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6ca4aeb700 1 -- 172.21.2.105:0/897994187 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca015a300 con 0x7f6ca00ad080 2021-11-12T05:41:07.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6c977fe700 1 -- 172.21.2.105:0/897994187 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c88005800 con 0x7f6ca00ad080 2021-11-12T05:41:07.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.134+0000 7f6ca4aeb700 1 -- 172.21.2.105:0/897994187 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca00a98f0 con 0x7f6ca00ad080 2021-11-12T05:41:07.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.138+0000 7f6ca4aeb700 1 -- 172.21.2.105:0/897994187 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca015a490 con 0x7f6ca00ad080 2021-11-12T05:41:07.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.138+0000 7f6c977fe700 1 -- 172.21.2.105:0/897994187 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6c88010070 con 0x7f6ca00ad080 2021-11-12T05:41:07.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.138+0000 7f6c977fe700 1 --2- 172.21.2.105:0/897994187 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6c840536d0 0x7f6c84055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:07.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.138+0000 7f6c977fe700 1 -- 172.21.2.105:0/897994187 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6300+0+0 (secure 0 0 0) 0x7f6c8806b090 con 0x7f6ca00ad080 2021-11-12T05:41:07.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.138+0000 7f6c9e59c700 1 --2- 172.21.2.105:0/897994187 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6c840536d0 0x7f6c84055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:07.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.138+0000 7f6c9e59c700 1 --2- 172.21.2.105:0/897994187 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6c840536d0 0x7f6c84055b90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f6ca00b0eb0 tx=0x7f6c90012000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:07.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.138+0000 7f6c977fe700 1 -- 172.21.2.105:0/897994187 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6c88042110 con 0x7f6ca00ad080 2021-11-12T05:41:07.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.246+0000 7f6ca4aeb700 1 -- 172.21.2.105:0/897994187 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f6ca0057350 con 0x7f6ca00ad080 2021-11-12T05:41:07.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.254+0000 7f6c977fe700 1 -- 172.21.2.105:0/897994187 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 5 and data pool 6 v9) v1 ==== 187+0+0 (secure 0 0 0) 0x7f6c88045730 con 0x7f6ca00ad080 2021-11-12T05:41:07.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.254+0000 7f6ca4aeb700 1 -- 172.21.2.105:0/897994187 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6c840536d0 msgr2=0x7f6c84055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:07.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.254+0000 7f6ca4aeb700 1 --2- 172.21.2.105:0/897994187 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6c840536d0 0x7f6c84055b90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f6ca00b0eb0 tx=0x7f6c90012000).stop 2021-11-12T05:41:07.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.254+0000 7f6ca4aeb700 1 -- 172.21.2.105:0/897994187 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6ca00ad080 msgr2=0x7f6ca0156bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:07.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.254+0000 7f6ca4aeb700 1 --2- 172.21.2.105:0/897994187 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6ca00ad080 0x7f6ca0156bf0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f6ca00b06e0 tx=0x7f6c88007c40).stop 2021-11-12T05:41:07.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.254+0000 7f6ca4aeb700 1 -- 172.21.2.105:0/897994187 shutdown_connections 2021-11-12T05:41:07.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.254+0000 7f6ca4aeb700 1 --2- 172.21.2.105:0/897994187 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6c840536d0 0x7f6c84055b90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:07.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.254+0000 7f6ca4aeb700 1 --2- 172.21.2.105:0/897994187 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6ca014b2f0 0x7f6ca00a9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:07.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.254+0000 7f6ca4aeb700 1 --2- 172.21.2.105:0/897994187 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6ca00ad080 0x7f6ca0156bf0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:07.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.254+0000 7f6ca4aeb700 1 --2- 172.21.2.105:0/897994187 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6ca00ac280 0x7f6ca00b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:07.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.254+0000 7f6ca4aeb700 1 -- 172.21.2.105:0/897994187 >> 172.21.2.105:0/897994187 conn(0x7f6ca00b5370 msgr2=0x7f6ca014aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:07.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.254+0000 7f6ca4aeb700 1 -- 172.21.2.105:0/897994187 shutdown_connections 2021-11-12T05:41:07.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.254+0000 7f6ca4aeb700 1 -- 172.21.2.105:0/897994187 wait complete. 2021-11-12T05:41:07.260 INFO:teuthology.orchestra.run.gibba005.stderr:new fs with metadata pool 5 and data pool 6 2021-11-12T05:41:07.264 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:41:07.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e90d2700 1 Processor -- start 2021-11-12T05:41:07.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e90d2700 1 -- start start 2021-11-12T05:41:07.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e90d2700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f10e40b3100 0x7f10e40b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:07.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e90d2700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10e40b2110 con 0x7f10e40b4d50 2021-11-12T05:41:07.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e90d2700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10e40b2370 con 0x7f10e4062010 2021-11-12T05:41:07.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e90d2700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e40b2610 con 0x7f10e40b3100 2021-11-12T05:41:07.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e259c700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f10e40b4d50 0x7f10e4141e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:54644/0 (socket says 172.21.2.105:54644) 2021-11-12T05:41:07.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e259c700 1 -- 172.21.2.105:0/3158984904 learned_addr learned my addr 172.21.2.105:0/3158984904 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:41:07.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e1d9b700 1 -- 172.21.2.105:0/3158984904 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2707895232 0 0) 0x7f10e40b2110 con 0x7f10e40b4d50 2021-11-12T05:41:07.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e1d9b700 1 -- 172.21.2.105:0/3158984904 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10c4003260 con 0x7f10e40b4d50 2021-11-12T05:41:07.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e359e700 1 --2- 172.21.2.105:0/3158984904 >> v2:172.21.2.115:3300/0 conn(0x7f10e40b3100 0x7f10e40b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:07.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e1d9b700 1 -- 172.21.2.105:0/3158984904 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2795151114 0 0) 0x7f10c4003260 con 0x7f10e40b4d50 2021-11-12T05:41:07.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e1d9b700 1 -- 172.21.2.105:0/3158984904 >> v2:172.21.2.115:3300/0 conn(0x7f10e40b3100 msgr2=0x7f10e40b5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:07.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e1d9b700 1 --2- 172.21.2.105:0/3158984904 >> v2:172.21.2.115:3300/0 conn(0x7f10e40b3100 0x7f10e40b5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:07.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e1d9b700 1 -- 172.21.2.105:0/3158984904 >> v1:172.21.2.115:6789/0 conn(0x7f10e4062010 legacy=0x7f10e40b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:07.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e1d9b700 1 -- 172.21.2.105:0/3158984904 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e40b4330 con 0x7f10e40b4d50 2021-11-12T05:41:07.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e1d9b700 1 -- 172.21.2.105:0/3158984904 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f10d4001660 con 0x7f10e40b4d50 2021-11-12T05:41:07.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e1d9b700 1 -- 172.21.2.105:0/3158984904 >> v1:172.21.2.105:6789/0 conn(0x7f10e40b4d50 legacy=0x7f10e4141e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:07.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e1d9b700 1 --2- 172.21.2.105:0/3158984904 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f10c4003750 0x7f10c4003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:07.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e1d9b700 1 --2- 172.21.2.105:0/3158984904 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f10c4004500 0x7f10c4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:07.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e1d9b700 1 --2- 172.21.2.105:0/3158984904 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f10c4004e70 0x7f10c400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:07.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e1d9b700 1 -- 172.21.2.105:0/3158984904 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e40b2610 con 0x7f10c4003750 2021-11-12T05:41:07.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e1d9b700 1 -- 172.21.2.105:0/3158984904 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c400bd20 con 0x7f10c4004e70 2021-11-12T05:41:07.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e1d9b700 1 -- 172.21.2.105:0/3158984904 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c400bee0 con 0x7f10c4004500 2021-11-12T05:41:07.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e2d9d700 1 --2- 172.21.2.105:0/3158984904 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f10c4003750 0x7f10c4003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:07.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e2d9d700 1 -- 172.21.2.105:0/3158984904 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f10c4004500 msgr2=0x7f10c4004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:07.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e2d9d700 1 --2- 172.21.2.105:0/3158984904 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f10c4004500 0x7f10c4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:07.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e2d9d700 1 -- 172.21.2.105:0/3158984904 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f10c4004e70 msgr2=0x7f10c400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:07.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e2d9d700 1 --2- 172.21.2.105:0/3158984904 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f10c4004e70 0x7f10c400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:07.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e2d9d700 1 -- 172.21.2.105:0/3158984904 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e40b4330 con 0x7f10c4003750 2021-11-12T05:41:07.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e359e700 1 -- 172.21.2.105:0/3158984904 reap_dead start 2021-11-12T05:41:07.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e2d9d700 1 --2- 172.21.2.105:0/3158984904 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f10c4003750 0x7f10c4003b70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f10e40b0ac0 tx=0x7f10cc0079c0).ready entity=mon.0 client_cookie=d2119eff3d781c53 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:07.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e1d9b700 1 -- 172.21.2.105:0/3158984904 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10cc014410 con 0x7f10c4003750 2021-11-12T05:41:07.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e1d9b700 1 -- 172.21.2.105:0/3158984904 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10cc014570 con 0x7f10c4003750 2021-11-12T05:41:07.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e1d9b700 1 -- 172.21.2.105:0/3158984904 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10cc0148d0 con 0x7f10c4003750 2021-11-12T05:41:07.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e90d2700 1 -- 172.21.2.105:0/3158984904 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f10c4003750 msgr2=0x7f10c4003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:07.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e90d2700 1 --2- 172.21.2.105:0/3158984904 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f10c4003750 0x7f10c4003b70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f10e40b0ac0 tx=0x7f10cc0079c0).stop 2021-11-12T05:41:07.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e90d2700 1 -- 172.21.2.105:0/3158984904 shutdown_connections 2021-11-12T05:41:07.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e90d2700 1 --2- 172.21.2.105:0/3158984904 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f10c4003750 0x7f10c4003b70 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:07.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e90d2700 1 -- 172.21.2.105:0/3158984904 >> 172.21.2.105:0/3158984904 conn(0x7f10e40b9790 msgr2=0x7f10e40b9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:07.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e90d2700 1 -- 172.21.2.105:0/3158984904 shutdown_connections 2021-11-12T05:41:07.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e90d2700 1 -- 172.21.2.105:0/3158984904 wait complete. 2021-11-12T05:41:07.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e90d2700 1 Processor -- start 2021-11-12T05:41:07.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e90d2700 1 -- start start 2021-11-12T05:41:07.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e90d2700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f10c4003750 0x7f10e414a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:07.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e90d2700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f10e41444a0 0x7f10e4145aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:07.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e90d2700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f10e4155cd0 0x7f10e4156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:07.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e90d2700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e40adfb0 con 0x7f10c4003750 2021-11-12T05:41:07.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e90d2700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e4145130 con 0x7f10e41444a0 2021-11-12T05:41:07.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e90d2700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e4156670 con 0x7f10e4155cd0 2021-11-12T05:41:07.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e2d9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f10c4003750 0x7f10e414a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:07.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e2d9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f10c4003750 0x7f10e414a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44258/0 (socket says 172.21.2.105:44258) 2021-11-12T05:41:07.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.314+0000 7f10e2d9d700 1 -- 172.21.2.105:0/4046949184 learned_addr learned my addr 172.21.2.105:0/4046949184 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:07.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.318+0000 7f10e2d9d700 1 -- 172.21.2.105:0/4046949184 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f10e4155cd0 msgr2=0x7f10e4156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:07.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.318+0000 7f10e2d9d700 1 --2- 172.21.2.105:0/4046949184 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f10e4155cd0 0x7f10e4156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:07.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.318+0000 7f10e2d9d700 1 -- 172.21.2.105:0/4046949184 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f10e41444a0 msgr2=0x7f10e4145aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:07.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.318+0000 7f10e2d9d700 1 --2- 172.21.2.105:0/4046949184 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f10e41444a0 0x7f10e4145aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:07.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.318+0000 7f10e2d9d700 1 -- 172.21.2.105:0/4046949184 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e4145360 con 0x7f10c4003750 2021-11-12T05:41:07.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.318+0000 7f10e2d9d700 1 --2- 172.21.2.105:0/4046949184 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f10c4003750 0x7f10e414a590 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f10e4144970 tx=0x7f10cc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:07.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.318+0000 7f10dbfff700 1 -- 172.21.2.105:0/4046949184 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10cc014410 con 0x7f10c4003750 2021-11-12T05:41:07.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.318+0000 7f10dbfff700 1 -- 172.21.2.105:0/4046949184 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10cc018070 con 0x7f10c4003750 2021-11-12T05:41:07.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.318+0000 7f10dbfff700 1 -- 172.21.2.105:0/4046949184 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10cc007cb0 con 0x7f10c4003750 2021-11-12T05:41:07.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.318+0000 7f10e90d2700 1 -- 172.21.2.105:0/4046949184 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e4145600 con 0x7f10c4003750 2021-11-12T05:41:07.334 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.318+0000 7f10e90d2700 1 -- 172.21.2.105:0/4046949184 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e40b00a0 con 0x7f10c4003750 2021-11-12T05:41:07.334 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.318+0000 7f10e90d2700 1 -- 172.21.2.105:0/4046949184 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10e4145790 con 0x7f10c4003750 2021-11-12T05:41:07.334 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.318+0000 7f10dbfff700 1 -- 172.21.2.105:0/4046949184 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f10cc01d070 con 0x7f10c4003750 2021-11-12T05:41:07.334 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.318+0000 7f10dbfff700 1 --2- 172.21.2.105:0/4046949184 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f10c8053610 0x7f10c8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:07.334 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.318+0000 7f10dbfff700 1 -- 172.21.2.105:0/4046949184 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f10cc06c560 con 0x7f10c4003750 2021-11-12T05:41:07.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.318+0000 7f10e259c700 1 --2- 172.21.2.105:0/4046949184 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f10c8053610 0x7f10c8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:07.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.318+0000 7f10e259c700 1 --2- 172.21.2.105:0/4046949184 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f10c8053610 0x7f10c8055ad0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f10d4001370 tx=0x7f10d4001630).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:07.336 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.318+0000 7f10dbfff700 1 -- 172.21.2.105:0/4046949184 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f10cc043570 con 0x7f10c4003750 2021-11-12T05:41:07.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.406+0000 7f10e90d2700 1 -- 172.21.2.105:0/4046949184 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10e4057350 con 0x7f10c4003750 2021-11-12T05:41:07.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.406+0000 7f10dbfff700 1 -- 172.21.2.105:0/4046949184 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16297 (secure 0 0 0) 0x7f10cc01a070 con 0x7f10c4003750 2021-11-12T05:41:07.409 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:41:07.409 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":33,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:41:07.250033+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:41:05.236029+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2021-11-12T05:41:06.227573+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:41:07.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.406+0000 7f10e90d2700 1 -- 172.21.2.105:0/4046949184 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f10c8053610 msgr2=0x7f10c8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:07.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.406+0000 7f10e90d2700 1 --2- 172.21.2.105:0/4046949184 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f10c8053610 0x7f10c8055ad0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f10d4001370 tx=0x7f10d4001630).stop 2021-11-12T05:41:07.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.406+0000 7f10e90d2700 1 -- 172.21.2.105:0/4046949184 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f10c4003750 msgr2=0x7f10e414a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:07.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.406+0000 7f10e90d2700 1 --2- 172.21.2.105:0/4046949184 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f10c4003750 0x7f10e414a590 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f10e4144970 tx=0x7f10cc015000).stop 2021-11-12T05:41:07.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.406+0000 7f10e90d2700 1 -- 172.21.2.105:0/4046949184 shutdown_connections 2021-11-12T05:41:07.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.406+0000 7f10e90d2700 1 --2- 172.21.2.105:0/4046949184 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f10c8053610 0x7f10c8055ad0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:07.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.406+0000 7f10e90d2700 1 --2- 172.21.2.105:0/4046949184 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f10e4155cd0 0x7f10e4156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:07.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.406+0000 7f10e90d2700 1 --2- 172.21.2.105:0/4046949184 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f10e41444a0 0x7f10e4145aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:07.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.406+0000 7f10e90d2700 1 --2- 172.21.2.105:0/4046949184 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f10c4003750 0x7f10e414a590 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:07.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.406+0000 7f10e90d2700 1 -- 172.21.2.105:0/4046949184 >> 172.21.2.105:0/4046949184 conn(0x7f10e40b9790 msgr2=0x7f10e40b8060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:07.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.406+0000 7f10e90d2700 1 -- 172.21.2.105:0/4046949184 shutdown_connections 2021-11-12T05:41:07.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.406+0000 7f10e90d2700 1 -- 172.21.2.105:0/4046949184 wait complete. 2021-11-12T05:41:07.416 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:41:07.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.466+0000 7f9f5bcc9700 1 Processor -- start 2021-11-12T05:41:07.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.466+0000 7f9f5bcc9700 1 -- start start 2021-11-12T05:41:07.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.466+0000 7f9f5bcc9700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f9f540ade80 0x7f9f540601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:07.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.466+0000 7f9f5bcc9700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f9f5413a9c0 0x7f9f5413ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:07.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.466+0000 7f9f5bcc9700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f54066150 con 0x7f9f5405fdc0 2021-11-12T05:41:07.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.466+0000 7f9f5bcc9700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f54141fb0 con 0x7f9f540ade80 2021-11-12T05:41:07.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.466+0000 7f9f5bcc9700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f540663f0 con 0x7f9f5413a9c0 2021-11-12T05:41:07.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.466+0000 7f9f59264700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f9f540ade80 0x7f9f540601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:07.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.466+0000 7f9f59264700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f9f540ade80 0x7f9f540601a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44270/0 (socket says 172.21.2.105:44270) 2021-11-12T05:41:07.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.466+0000 7f9f59264700 1 -- 172.21.2.105:0/4048853970 learned_addr learned my addr 172.21.2.105:0/4048853970 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:07.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.466+0000 7f9f59264700 1 -- 172.21.2.105:0/4048853970 >> v2:172.21.2.115:3300/0 conn(0x7f9f5413a9c0 msgr2=0x7f9f5413ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:07.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.466+0000 7f9f59264700 1 --2- 172.21.2.105:0/4048853970 >> v2:172.21.2.115:3300/0 conn(0x7f9f5413a9c0 0x7f9f5413ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:07.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.466+0000 7f9f59264700 1 -- 172.21.2.105:0/4048853970 >> v1:172.21.2.115:6789/0 conn(0x7f9f5405fdc0 legacy=0x7f9f54066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:07.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.466+0000 7f9f59264700 1 -- 172.21.2.105:0/4048853970 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f54140fd0 con 0x7f9f540ade80 2021-11-12T05:41:07.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.466+0000 7f9f59264700 1 --2- 172.21.2.105:0/4048853970 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9f540ade80 0x7f9f540601a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f9f54060e00 tx=0x7f9f48006eb0).ready entity=mon.0 client_cookie=fe0352e4a064fbe3 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:07.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.466+0000 7f9f58a63700 1 -- 172.21.2.105:0/4048853970 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f4800d5c0 con 0x7f9f540ade80 2021-11-12T05:41:07.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.466+0000 7f9f58a63700 1 -- 172.21.2.105:0/4048853970 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f48000e90 con 0x7f9f540ade80 2021-11-12T05:41:07.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.466+0000 7f9f58a63700 1 -- 172.21.2.105:0/4048853970 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f4800d910 con 0x7f9f540ade80 2021-11-12T05:41:07.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.466+0000 7f9f5bcc9700 1 -- 172.21.2.105:0/4048853970 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9f540ade80 msgr2=0x7f9f540601a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:07.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.466+0000 7f9f5bcc9700 1 --2- 172.21.2.105:0/4048853970 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9f540ade80 0x7f9f540601a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f9f54060e00 tx=0x7f9f48006eb0).stop 2021-11-12T05:41:07.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.466+0000 7f9f5bcc9700 1 -- 172.21.2.105:0/4048853970 shutdown_connections 2021-11-12T05:41:07.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.466+0000 7f9f5bcc9700 1 --2- 172.21.2.105:0/4048853970 >> v2:172.21.2.115:3300/0 conn(0x7f9f5413a9c0 0x7f9f5413ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:07.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.466+0000 7f9f5bcc9700 1 --2- 172.21.2.105:0/4048853970 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9f540ade80 0x7f9f540601a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:07.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.466+0000 7f9f5bcc9700 1 -- 172.21.2.105:0/4048853970 >> 172.21.2.105:0/4048853970 conn(0x7f9f540608d0 msgr2=0x7f9f5405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:07.474 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.466+0000 7f9f5bcc9700 1 -- 172.21.2.105:0/4048853970 shutdown_connections 2021-11-12T05:41:07.474 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.466+0000 7f9f5bcc9700 1 -- 172.21.2.105:0/4048853970 wait complete. 2021-11-12T05:41:07.476 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.466+0000 7f9f5bcc9700 1 Processor -- start 2021-11-12T05:41:07.477 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.466+0000 7f9f5bcc9700 1 -- start start 2021-11-12T05:41:07.477 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.466+0000 7f9f5bcc9700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9f5405fdc0 0x7f9f54150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:07.477 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.466+0000 7f9f5bcc9700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9f540ade80 0x7f9f540b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:07.477 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.466+0000 7f9f5bcc9700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9f5413a9c0 0x7f9f54142200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:07.477 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.466+0000 7f9f5bcc9700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f540b7620 con 0x7f9f5413a9c0 2021-11-12T05:41:07.478 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.466+0000 7f9f5bcc9700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f540b7fb0 con 0x7f9f5405fdc0 2021-11-12T05:41:07.478 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.466+0000 7f9f5bcc9700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f541502a0 con 0x7f9f540ade80 2021-11-12T05:41:07.478 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.466+0000 7f9f5a266700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9f5413a9c0 0x7f9f54142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:07.478 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.466+0000 7f9f5a266700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9f5413a9c0 0x7f9f54142200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44276/0 (socket says 172.21.2.105:44276) 2021-11-12T05:41:07.479 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.466+0000 7f9f5a266700 1 -- 172.21.2.105:0/452755814 learned_addr learned my addr 172.21.2.105:0/452755814 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:07.479 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.470+0000 7f9f5a266700 1 -- 172.21.2.105:0/452755814 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9f540ade80 msgr2=0x7f9f540b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:07.479 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.470+0000 7f9f5a266700 1 --2- 172.21.2.105:0/452755814 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9f540ade80 0x7f9f540b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:07.479 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.470+0000 7f9f5a266700 1 -- 172.21.2.105:0/452755814 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9f5405fdc0 msgr2=0x7f9f54150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:07.479 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.470+0000 7f9f5a266700 1 --2- 172.21.2.105:0/452755814 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9f5405fdc0 0x7f9f54150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:07.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.470+0000 7f9f5a266700 1 -- 172.21.2.105:0/452755814 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f4800b1e0 con 0x7f9f5413a9c0 2021-11-12T05:41:07.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.470+0000 7f9f5a266700 1 --2- 172.21.2.105:0/452755814 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9f5413a9c0 0x7f9f54142200 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f9f4c0032f0 tx=0x7f9f4c0091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:07.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.470+0000 7f9f46ffd700 1 -- 172.21.2.105:0/452755814 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f4c00f510 con 0x7f9f5413a9c0 2021-11-12T05:41:07.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.470+0000 7f9f46ffd700 1 -- 172.21.2.105:0/452755814 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4c00f670 con 0x7f9f5413a9c0 2021-11-12T05:41:07.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.470+0000 7f9f5bcc9700 1 -- 172.21.2.105:0/452755814 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f54150540 con 0x7f9f5413a9c0 2021-11-12T05:41:07.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.470+0000 7f9f5bcc9700 1 -- 172.21.2.105:0/452755814 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f54143a00 con 0x7f9f5413a9c0 2021-11-12T05:41:07.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.470+0000 7f9f46ffd700 1 -- 172.21.2.105:0/452755814 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f4c00f7e0 con 0x7f9f5413a9c0 2021-11-12T05:41:07.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.470+0000 7f9f5bcc9700 1 -- 172.21.2.105:0/452755814 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f5413c530 con 0x7f9f5413a9c0 2021-11-12T05:41:07.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.470+0000 7f9f46ffd700 1 -- 172.21.2.105:0/452755814 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9f4c00f070 con 0x7f9f5413a9c0 2021-11-12T05:41:07.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.470+0000 7f9f46ffd700 1 --2- 172.21.2.105:0/452755814 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9f340535d0 0x7f9f34055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:07.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.470+0000 7f9f46ffd700 1 -- 172.21.2.105:0/452755814 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f9f4c06b7c0 con 0x7f9f5413a9c0 2021-11-12T05:41:07.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.470+0000 7f9f59a65700 1 --2- 172.21.2.105:0/452755814 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9f340535d0 0x7f9f34055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:07.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.470+0000 7f9f59a65700 1 --2- 172.21.2.105:0/452755814 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9f340535d0 0x7f9f34055a90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f9f50002f90 tx=0x7f9f500069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:07.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.474+0000 7f9f46ffd700 1 -- 172.21.2.105:0/452755814 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9f5413c530 con 0x7f9f5413a9c0 2021-11-12T05:41:07.558 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.558+0000 7f9f5bcc9700 1 -- 172.21.2.105:0/452755814 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f5413c530 con 0x7f9f5413a9c0 2021-11-12T05:41:07.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.558+0000 7f9f46ffd700 1 -- 172.21.2.105:0/452755814 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16297 (secure 0 0 0) 0x7f9f5413c530 con 0x7f9f5413a9c0 2021-11-12T05:41:07.560 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:41:07.560 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":33,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:41:07.250033+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:41:05.236029+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2021-11-12T05:41:06.227573+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:41:07.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.558+0000 7f9f5bcc9700 1 -- 172.21.2.105:0/452755814 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9f340535d0 msgr2=0x7f9f34055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:07.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.558+0000 7f9f5bcc9700 1 --2- 172.21.2.105:0/452755814 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9f340535d0 0x7f9f34055a90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f9f50002f90 tx=0x7f9f500069b0).stop 2021-11-12T05:41:07.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.558+0000 7f9f5bcc9700 1 -- 172.21.2.105:0/452755814 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9f5413a9c0 msgr2=0x7f9f54142200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:07.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.558+0000 7f9f5bcc9700 1 --2- 172.21.2.105:0/452755814 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9f5413a9c0 0x7f9f54142200 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f9f4c0032f0 tx=0x7f9f4c0091a0).stop 2021-11-12T05:41:07.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.558+0000 7f9f5bcc9700 1 -- 172.21.2.105:0/452755814 shutdown_connections 2021-11-12T05:41:07.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.558+0000 7f9f5bcc9700 1 --2- 172.21.2.105:0/452755814 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9f340535d0 0x7f9f34055a90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:07.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.558+0000 7f9f5bcc9700 1 --2- 172.21.2.105:0/452755814 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9f5413a9c0 0x7f9f54142200 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:07.563 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.558+0000 7f9f5bcc9700 1 --2- 172.21.2.105:0/452755814 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9f540ade80 0x7f9f540b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:07.563 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.558+0000 7f9f5bcc9700 1 --2- 172.21.2.105:0/452755814 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9f5405fdc0 0x7f9f54150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:07.563 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.558+0000 7f9f5bcc9700 1 -- 172.21.2.105:0/452755814 >> 172.21.2.105:0/452755814 conn(0x7f9f540608d0 msgr2=0x7f9f5413f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:07.563 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.558+0000 7f9f5bcc9700 1 -- 172.21.2.105:0/452755814 shutdown_connections 2021-11-12T05:41:07.563 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.558+0000 7f9f5bcc9700 1 -- 172.21.2.105:0/452755814 wait complete. 2021-11-12T05:41:07.568 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-12T05:41:07.621 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.618+0000 7fa31b6d6700 1 Processor -- start 2021-11-12T05:41:07.622 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.618+0000 7fa31b6d6700 1 -- start start 2021-11-12T05:41:07.622 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.618+0000 7fa31b6d6700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa3140b2e20 0x7fa3140b1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:07.622 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.618+0000 7fa31b6d6700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fa31413ea50 0x7fa31413ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:07.622 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.618+0000 7fa31b6d6700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3140ad400 con 0x7fa31405f6b0 2021-11-12T05:41:07.623 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.618+0000 7fa31b6d6700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3140b3200 con 0x7fa31413ea50 2021-11-12T05:41:07.623 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.618+0000 7fa31b6d6700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3140ad660 con 0x7fa3140b2e20 2021-11-12T05:41:07.623 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.618+0000 7fa319c73700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fa31405f6b0 0x7fa31405fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:54678/0 (socket says 172.21.2.105:54678) 2021-11-12T05:41:07.623 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.618+0000 7fa319c73700 1 -- 172.21.2.105:0/3874416818 learned_addr learned my addr 172.21.2.105:0/3874416818 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:41:07.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.618+0000 7fa303fff700 1 -- 172.21.2.105:0/3874416818 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2801902266 0 0) 0x7fa3140ad400 con 0x7fa31405f6b0 2021-11-12T05:41:07.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.618+0000 7fa303fff700 1 -- 172.21.2.105:0/3874416818 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2fc003260 con 0x7fa31405f6b0 2021-11-12T05:41:07.630 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.618+0000 7fa318c71700 1 --2- 172.21.2.105:0/3874416818 >> v2:172.21.2.115:3300/0 conn(0x7fa31413ea50 0x7fa31413ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:07.630 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.618+0000 7fa303fff700 1 -- 172.21.2.105:0/3874416818 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3935988991 0 0) 0x7fa2fc003260 con 0x7fa31405f6b0 2021-11-12T05:41:07.630 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.618+0000 7fa303fff700 1 -- 172.21.2.105:0/3874416818 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa3140b2e20 msgr2=0x7fa3140b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:07.630 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.618+0000 7fa319472700 1 --2- 172.21.2.105:0/3874416818 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa3140b2e20 0x7fa3140b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:07.631 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.618+0000 7fa303fff700 1 --2- 172.21.2.105:0/3874416818 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa3140b2e20 0x7fa3140b1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:07.631 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.618+0000 7fa303fff700 1 -- 172.21.2.105:0/3874416818 >> v2:172.21.2.115:3300/0 conn(0x7fa31413ea50 msgr2=0x7fa31413ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:07.631 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.618+0000 7fa303fff700 1 --2- 172.21.2.105:0/3874416818 >> v2:172.21.2.115:3300/0 conn(0x7fa31413ea50 0x7fa31413ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:07.631 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.618+0000 7fa303fff700 1 -- 172.21.2.105:0/3874416818 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3140ad900 con 0x7fa31405f6b0 2021-11-12T05:41:07.631 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.618+0000 7fa303fff700 1 -- 172.21.2.105:0/3874416818 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fa30c0019e0 con 0x7fa31405f6b0 2021-11-12T05:41:07.632 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.618+0000 7fa303fff700 1 -- 172.21.2.105:0/3874416818 >> v1:172.21.2.105:6789/0 conn(0x7fa31405f6b0 legacy=0x7fa31405fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:07.632 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.618+0000 7fa303fff700 1 --2- 172.21.2.105:0/3874416818 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa2fc003750 0x7fa2fc003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:07.632 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.618+0000 7fa303fff700 1 --2- 172.21.2.105:0/3874416818 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa2fc004500 0x7fa2fc004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:07.632 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.618+0000 7fa303fff700 1 --2- 172.21.2.105:0/3874416818 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa2fc004e70 0x7fa2fc00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:07.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.618+0000 7fa303fff700 1 -- 172.21.2.105:0/3874416818 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3140b3200 con 0x7fa2fc003750 2021-11-12T05:41:07.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.618+0000 7fa303fff700 1 -- 172.21.2.105:0/3874416818 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3140ad660 con 0x7fa2fc004e70 2021-11-12T05:41:07.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.618+0000 7fa303fff700 1 -- 172.21.2.105:0/3874416818 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2fc00bd70 con 0x7fa2fc004500 2021-11-12T05:41:07.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.618+0000 7fa319472700 1 --2- 172.21.2.105:0/3874416818 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa3140b2e20 0x7fa3140b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:41:07.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa319472700 1 --2- 172.21.2.105:0/3874416818 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa2fc003750 0x7fa2fc003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:07.634 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa319c73700 1 --2- 172.21.2.105:0/3874416818 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa2fc004e70 0x7fa2fc00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:07.634 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa318c71700 1 --2- 172.21.2.105:0/3874416818 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa2fc004500 0x7fa2fc004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:07.634 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa319472700 1 -- 172.21.2.105:0/3874416818 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa2fc004500 msgr2=0x7fa2fc004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:07.634 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa319472700 1 --2- 172.21.2.105:0/3874416818 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa2fc004500 0x7fa2fc004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:07.635 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa319472700 1 -- 172.21.2.105:0/3874416818 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa2fc004e70 msgr2=0x7fa2fc00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:07.635 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa319472700 1 --2- 172.21.2.105:0/3874416818 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa2fc004e70 0x7fa2fc00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:07.635 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa319472700 1 -- 172.21.2.105:0/3874416818 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2fc003260 con 0x7fa2fc003750 2021-11-12T05:41:07.635 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa319472700 1 --2- 172.21.2.105:0/3874416818 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa2fc003750 0x7fa2fc003b70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7fa304007000 tx=0x7fa304008040).ready entity=mon.0 client_cookie=d0a553d1e9b21736 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:07.635 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa303fff700 1 -- 172.21.2.105:0/3874416818 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa304012430 con 0x7fa2fc003750 2021-11-12T05:41:07.636 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa303fff700 1 -- 172.21.2.105:0/3874416818 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30400c030 con 0x7fa2fc003750 2021-11-12T05:41:07.636 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa303fff700 1 -- 172.21.2.105:0/3874416818 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa304012780 con 0x7fa2fc003750 2021-11-12T05:41:07.636 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa31b6d6700 1 -- 172.21.2.105:0/3874416818 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa2fc003750 msgr2=0x7fa2fc003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:07.636 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa31b6d6700 1 --2- 172.21.2.105:0/3874416818 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa2fc003750 0x7fa2fc003b70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7fa304007000 tx=0x7fa304008040).stop 2021-11-12T05:41:07.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa319c73700 1 -- 172.21.2.105:0/3874416818 reap_dead start 2021-11-12T05:41:07.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa31b6d6700 1 -- 172.21.2.105:0/3874416818 shutdown_connections 2021-11-12T05:41:07.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa31b6d6700 1 -- 172.21.2.105:0/3874416818 >> 172.21.2.105:0/3874416818 conn(0x7fa314062f60 msgr2=0x7fa314063370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:07.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa31b6d6700 1 -- 172.21.2.105:0/3874416818 shutdown_connections 2021-11-12T05:41:07.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa31b6d6700 1 -- 172.21.2.105:0/3874416818 wait complete. 2021-11-12T05:41:07.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa31b6d6700 1 Processor -- start 2021-11-12T05:41:07.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa31b6d6700 1 -- start start 2021-11-12T05:41:07.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa31b6d6700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa2fc003750 0x7fa31413c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:07.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa31b6d6700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa31413cec0 0x7fa3140672d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:07.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa31b6d6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa3140677c0 0x7fa31414e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:07.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa31b6d6700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31413b980 con 0x7fa3140677c0 2021-11-12T05:41:07.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa31b6d6700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa314060d50 con 0x7fa2fc003750 2021-11-12T05:41:07.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa31b6d6700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa31413e220 con 0x7fa31413cec0 2021-11-12T05:41:07.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa319c73700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa3140677c0 0x7fa31414e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:07.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa319c73700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa3140677c0 0x7fa31414e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44296/0 (socket says 172.21.2.105:44296) 2021-11-12T05:41:07.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa319c73700 1 -- 172.21.2.105:0/1704045804 learned_addr learned my addr 172.21.2.105:0/1704045804 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:07.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa319472700 1 --2- 172.21.2.105:0/1704045804 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa2fc003750 0x7fa31413c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:07.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa318c71700 1 --2- 172.21.2.105:0/1704045804 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa31413cec0 0x7fa3140672d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:07.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa319c73700 1 -- 172.21.2.105:0/1704045804 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa31413cec0 msgr2=0x7fa3140672d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:07.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa319c73700 1 --2- 172.21.2.105:0/1704045804 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa31413cec0 0x7fa3140672d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:07.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa319c73700 1 -- 172.21.2.105:0/1704045804 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa2fc003750 msgr2=0x7fa31413c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:07.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa319c73700 1 --2- 172.21.2.105:0/1704045804 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa2fc003750 0x7fa31413c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:07.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa319c73700 1 -- 172.21.2.105:0/1704045804 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa314064070 con 0x7fa3140677c0 2021-11-12T05:41:07.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa318c71700 1 --2- 172.21.2.105:0/1704045804 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa31413cec0 0x7fa3140672d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:41:07.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa319c73700 1 --2- 172.21.2.105:0/1704045804 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa3140677c0 0x7fa31414e210 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7fa30c000b60 tx=0x7fa30c0021d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:07.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa3027fc700 1 -- 172.21.2.105:0/1704045804 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa30c00fa30 con 0x7fa3140677c0 2021-11-12T05:41:07.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa3027fc700 1 -- 172.21.2.105:0/1704045804 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30c00fb90 con 0x7fa3140677c0 2021-11-12T05:41:07.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa31b6d6700 1 -- 172.21.2.105:0/1704045804 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa314064310 con 0x7fa3140677c0 2021-11-12T05:41:07.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa3027fc700 1 -- 172.21.2.105:0/1704045804 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa30c0077f0 con 0x7fa3140677c0 2021-11-12T05:41:07.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa31b6d6700 1 -- 172.21.2.105:0/1704045804 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa314064850 con 0x7fa3140677c0 2021-11-12T05:41:07.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa31b6d6700 1 -- 172.21.2.105:0/1704045804 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3140649e0 con 0x7fa3140677c0 2021-11-12T05:41:07.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa3027fc700 1 -- 172.21.2.105:0/1704045804 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa30c01c360 con 0x7fa3140677c0 2021-11-12T05:41:07.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa3027fc700 1 --2- 172.21.2.105:0/1704045804 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa2f4053660 0x7fa2f4055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:07.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa3027fc700 1 -- 172.21.2.105:0/1704045804 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fa30c06b500 con 0x7fa3140677c0 2021-11-12T05:41:07.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.622+0000 7fa319472700 1 --2- 172.21.2.105:0/1704045804 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa2f4053660 0x7fa2f4055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:07.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.626+0000 7fa319472700 1 --2- 172.21.2.105:0/1704045804 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa2f4053660 0x7fa2f4055b20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fa30401c000 tx=0x7fa304008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:07.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.626+0000 7fa3027fc700 1 -- 172.21.2.105:0/1704045804 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa30c0424b0 con 0x7fa3140677c0 2021-11-12T05:41:07.739 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:07.738+0000 7fa31b6d6700 1 -- 172.21.2.105:0/1704045804 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa3140b2060 con 0x7fa3140677c0 2021-11-12T05:41:08.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.266+0000 7fa3027fc700 1 -- 172.21.2.105:0/1704045804 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v10) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa30c019030 con 0x7fa3140677c0 2021-11-12T05:41:08.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.266+0000 7fa31b6d6700 1 -- 172.21.2.105:0/1704045804 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa2f4053660 msgr2=0x7fa2f4055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:08.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.266+0000 7fa31b6d6700 1 --2- 172.21.2.105:0/1704045804 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa2f4053660 0x7fa2f4055b20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fa30401c000 tx=0x7fa304008040).stop 2021-11-12T05:41:08.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.266+0000 7fa31b6d6700 1 -- 172.21.2.105:0/1704045804 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa3140677c0 msgr2=0x7fa31414e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:08.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.266+0000 7fa31b6d6700 1 --2- 172.21.2.105:0/1704045804 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa3140677c0 0x7fa31414e210 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7fa30c000b60 tx=0x7fa30c0021d0).stop 2021-11-12T05:41:08.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.266+0000 7fa31b6d6700 1 -- 172.21.2.105:0/1704045804 shutdown_connections 2021-11-12T05:41:08.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.266+0000 7fa31b6d6700 1 --2- 172.21.2.105:0/1704045804 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa2f4053660 0x7fa2f4055b20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:08.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.266+0000 7fa31b6d6700 1 --2- 172.21.2.105:0/1704045804 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa3140677c0 0x7fa31414e210 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:08.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.266+0000 7fa31b6d6700 1 --2- 172.21.2.105:0/1704045804 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa31413cec0 0x7fa3140672d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:08.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.266+0000 7fa31b6d6700 1 --2- 172.21.2.105:0/1704045804 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa2fc003750 0x7fa31413c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:08.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.266+0000 7fa31b6d6700 1 -- 172.21.2.105:0/1704045804 >> 172.21.2.105:0/1704045804 conn(0x7fa314062f60 msgr2=0x7fa314060620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:08.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.266+0000 7fa31b6d6700 1 -- 172.21.2.105:0/1704045804 shutdown_connections 2021-11-12T05:41:08.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.266+0000 7fa31b6d6700 1 -- 172.21.2.105:0/1704045804 wait complete. 2021-11-12T05:41:08.275 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:41:08.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f6293138700 1 Processor -- start 2021-11-12T05:41:08.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f6293138700 1 -- start start 2021-11-12T05:41:08.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f6293138700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f628c0601a0 0x7f628c141470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:08.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f6293138700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f628c066150 con 0x7f628c05fdc0 2021-11-12T05:41:08.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f6293138700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f628c0663f0 con 0x7f628c0ade80 2021-11-12T05:41:08.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f6293138700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f628c141fb0 con 0x7f628c0601a0 2021-11-12T05:41:08.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f6290ed4700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f628c05fdc0 0x7f628c066730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:54696/0 (socket says 172.21.2.105:54696) 2021-11-12T05:41:08.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f6290ed4700 1 -- 172.21.2.105:0/132345470 learned_addr learned my addr 172.21.2.105:0/132345470 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:41:08.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f628b7fe700 1 -- 172.21.2.105:0/132345470 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 344723564 0 0) 0x7f628c066150 con 0x7f628c05fdc0 2021-11-12T05:41:08.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f628b7fe700 1 -- 172.21.2.105:0/132345470 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6278003260 con 0x7f628c05fdc0 2021-11-12T05:41:08.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f628b7fe700 1 -- 172.21.2.105:0/132345470 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1029642630 0 0) 0x7f6278003260 con 0x7f628c05fdc0 2021-11-12T05:41:08.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f628b7fe700 1 -- 172.21.2.105:0/132345470 >> v2:172.21.2.115:3300/0 conn(0x7f628c0601a0 msgr2=0x7f628c141470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:08.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f628b7fe700 1 --2- 172.21.2.105:0/132345470 >> v2:172.21.2.115:3300/0 conn(0x7f628c0601a0 0x7f628c141470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:08.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f628b7fe700 1 -- 172.21.2.105:0/132345470 >> v1:172.21.2.115:6789/0 conn(0x7f628c0ade80 legacy=0x7f628c13a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:08.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f628b7fe700 1 -- 172.21.2.105:0/132345470 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f628c140fd0 con 0x7f628c05fdc0 2021-11-12T05:41:08.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f628b7fe700 1 -- 172.21.2.105:0/132345470 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f627c001660 con 0x7f628c05fdc0 2021-11-12T05:41:08.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f628b7fe700 1 -- 172.21.2.105:0/132345470 >> v1:172.21.2.105:6789/0 conn(0x7f628c05fdc0 legacy=0x7f628c066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:08.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f628b7fe700 1 --2- 172.21.2.105:0/132345470 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6278003820 0x7f6278003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:08.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f628b7fe700 1 --2- 172.21.2.105:0/132345470 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6278004500 0x7f6278004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:08.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f628b7fe700 1 --2- 172.21.2.105:0/132345470 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6278005050 0x7f627800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:08.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f628b7fe700 1 -- 172.21.2.105:0/132345470 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627800bf10 con 0x7f6278003820 2021-11-12T05:41:08.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f628b7fe700 1 -- 172.21.2.105:0/132345470 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627800c080 con 0x7f6278004500 2021-11-12T05:41:08.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f628b7fe700 1 -- 172.21.2.105:0/132345470 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627800c240 con 0x7f6278005050 2021-11-12T05:41:08.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f6290ed4700 1 --2- 172.21.2.105:0/132345470 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6278003820 0x7f6278003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:08.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f6290ed4700 1 -- 172.21.2.105:0/132345470 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6278005050 msgr2=0x7f627800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:08.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f6290ed4700 1 --2- 172.21.2.105:0/132345470 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6278005050 0x7f627800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:08.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f6290ed4700 1 -- 172.21.2.105:0/132345470 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6278004500 msgr2=0x7f6278004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:08.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f6290ed4700 1 --2- 172.21.2.105:0/132345470 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6278004500 0x7f6278004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:08.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f6290ed4700 1 -- 172.21.2.105:0/132345470 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6278003260 con 0x7f6278003820 2021-11-12T05:41:08.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f62916d5700 1 -- 172.21.2.105:0/132345470 reap_dead start 2021-11-12T05:41:08.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f6290ed4700 1 --2- 172.21.2.105:0/132345470 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6278003820 0x7f6278003c20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f628c060ea0 tx=0x7f628c0662e0).ready entity=mon.0 client_cookie=6f572d244b4e7481 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:08.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f628b7fe700 1 -- 172.21.2.105:0/132345470 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f627c0070d0 con 0x7f6278003820 2021-11-12T05:41:08.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f628b7fe700 1 -- 172.21.2.105:0/132345470 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627c007230 con 0x7f6278003820 2021-11-12T05:41:08.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f628b7fe700 1 -- 172.21.2.105:0/132345470 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f627c00c8f0 con 0x7f6278003820 2021-11-12T05:41:08.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f6293138700 1 -- 172.21.2.105:0/132345470 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6278003820 msgr2=0x7f6278003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:08.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f6293138700 1 --2- 172.21.2.105:0/132345470 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6278003820 0x7f6278003c20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f628c060ea0 tx=0x7f628c0662e0).stop 2021-11-12T05:41:08.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f6293138700 1 -- 172.21.2.105:0/132345470 shutdown_connections 2021-11-12T05:41:08.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f6293138700 1 --2- 172.21.2.105:0/132345470 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6278003820 0x7f6278003c20 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:08.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f6293138700 1 -- 172.21.2.105:0/132345470 >> 172.21.2.105:0/132345470 conn(0x7f628c0608d0 msgr2=0x7f628c05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:08.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f6293138700 1 -- 172.21.2.105:0/132345470 shutdown_connections 2021-11-12T05:41:08.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f6293138700 1 -- 172.21.2.105:0/132345470 wait complete. 2021-11-12T05:41:08.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f6293138700 1 Processor -- start 2021-11-12T05:41:08.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f6293138700 1 -- start start 2021-11-12T05:41:08.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f6293138700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6278003820 0x7f628c0b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:08.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f6293138700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f628c138020 0x7f628c1372a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:08.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.334+0000 7f6293138700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f628c0b3c80 0x7f628c137790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:08.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.338+0000 7f6293138700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628c14e150 con 0x7f628c138020 2021-11-12T05:41:08.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.338+0000 7f6293138700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628c0ae7f0 con 0x7f628c0b3c80 2021-11-12T05:41:08.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.338+0000 7f6293138700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f628c14deb0 con 0x7f6278003820 2021-11-12T05:41:08.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.338+0000 7f628bfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f628c138020 0x7f628c1372a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:08.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.338+0000 7f628bfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f628c138020 0x7f628c1372a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44314/0 (socket says 172.21.2.105:44314) 2021-11-12T05:41:08.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.338+0000 7f628bfff700 1 -- 172.21.2.105:0/4223608942 learned_addr learned my addr 172.21.2.105:0/4223608942 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:08.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.338+0000 7f628bfff700 1 -- 172.21.2.105:0/4223608942 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6278003820 msgr2=0x7f628c0b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:08.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.338+0000 7f628bfff700 1 --2- 172.21.2.105:0/4223608942 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6278003820 0x7f628c0b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:08.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.338+0000 7f628bfff700 1 -- 172.21.2.105:0/4223608942 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f628c0b3c80 msgr2=0x7f628c137790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:08.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.338+0000 7f628bfff700 1 --2- 172.21.2.105:0/4223608942 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f628c0b3c80 0x7f628c137790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:08.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.338+0000 7f628bfff700 1 -- 172.21.2.105:0/4223608942 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f628c0b3a00 con 0x7f628c138020 2021-11-12T05:41:08.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.338+0000 7f628bfff700 1 --2- 172.21.2.105:0/4223608942 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f628c138020 0x7f628c1372a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f6280000f70 tx=0x7f6280006d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:08.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.338+0000 7f6289ffb700 1 -- 172.21.2.105:0/4223608942 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6280012410 con 0x7f628c138020 2021-11-12T05:41:08.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.338+0000 7f6289ffb700 1 -- 172.21.2.105:0/4223608942 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6280012570 con 0x7f628c138020 2021-11-12T05:41:08.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.338+0000 7f6293138700 1 -- 172.21.2.105:0/4223608942 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f628c0b4640 con 0x7f628c138020 2021-11-12T05:41:08.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.338+0000 7f6293138700 1 -- 172.21.2.105:0/4223608942 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f628c0aedf0 con 0x7f628c138020 2021-11-12T05:41:08.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.338+0000 7f6289ffb700 1 -- 172.21.2.105:0/4223608942 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62800128d0 con 0x7f628c138020 2021-11-12T05:41:08.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.338+0000 7f6293138700 1 -- 172.21.2.105:0/4223608942 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f628c14dcf0 con 0x7f628c138020 2021-11-12T05:41:08.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.338+0000 7f6289ffb700 1 -- 172.21.2.105:0/4223608942 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f628000f030 con 0x7f628c138020 2021-11-12T05:41:08.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.338+0000 7f6289ffb700 1 --2- 172.21.2.105:0/4223608942 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f626c0535d0 0x7f626c055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:08.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.338+0000 7f6289ffb700 1 -- 172.21.2.105:0/4223608942 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f628006b770 con 0x7f628c138020 2021-11-12T05:41:08.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.338+0000 7f6290ed4700 1 --2- 172.21.2.105:0/4223608942 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f626c0535d0 0x7f626c055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:08.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.338+0000 7f6290ed4700 1 --2- 172.21.2.105:0/4223608942 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f626c0535d0 0x7f626c055a90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f628c060ea0 tx=0x7f627c013000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:08.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.338+0000 7f6289ffb700 1 -- 172.21.2.105:0/4223608942 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6280042670 con 0x7f628c138020 2021-11-12T05:41:08.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.450+0000 7f6293138700 1 -- 172.21.2.105:0/4223608942 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f628c057350 con 0x7f628c138020 2021-11-12T05:41:08.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.450+0000 7f6289ffb700 1 -- 172.21.2.105:0/4223608942 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f6280045c90 con 0x7f628c138020 2021-11-12T05:41:08.453 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:41:08.453 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4429,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/4118304786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":4118304786},{"type":"v1","addr":"172.21.2.115:6833","nonce":4118304786}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:41:07.250137+0000","modified":"2021-11-12T05:41:08.255185+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4908},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4908":{"gid":4908,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/2626499955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":2626499955},{"type":"v1","addr":"172.21.2.105:6835","nonce":2626499955}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-11-12T05:41:08.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.450+0000 7f6293138700 1 -- 172.21.2.105:0/4223608942 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f626c0535d0 msgr2=0x7f626c055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:08.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.450+0000 7f6293138700 1 --2- 172.21.2.105:0/4223608942 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f626c0535d0 0x7f626c055a90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f628c060ea0 tx=0x7f627c013000).stop 2021-11-12T05:41:08.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.450+0000 7f6293138700 1 -- 172.21.2.105:0/4223608942 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f628c138020 msgr2=0x7f628c1372a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:08.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.450+0000 7f6293138700 1 --2- 172.21.2.105:0/4223608942 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f628c138020 0x7f628c1372a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f6280000f70 tx=0x7f6280006d10).stop 2021-11-12T05:41:08.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.450+0000 7f6293138700 1 -- 172.21.2.105:0/4223608942 shutdown_connections 2021-11-12T05:41:08.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.450+0000 7f6293138700 1 --2- 172.21.2.105:0/4223608942 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f626c0535d0 0x7f626c055a90 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:08.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.450+0000 7f6293138700 1 --2- 172.21.2.105:0/4223608942 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f628c0b3c80 0x7f628c137790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:08.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.450+0000 7f6293138700 1 --2- 172.21.2.105:0/4223608942 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f628c138020 0x7f628c1372a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:08.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.450+0000 7f6293138700 1 --2- 172.21.2.105:0/4223608942 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6278003820 0x7f628c0b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:08.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.450+0000 7f6293138700 1 -- 172.21.2.105:0/4223608942 >> 172.21.2.105:0/4223608942 conn(0x7f628c0608d0 msgr2=0x7f628c13fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:08.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.450+0000 7f6293138700 1 -- 172.21.2.105:0/4223608942 shutdown_connections 2021-11-12T05:41:08.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.450+0000 7f6293138700 1 -- 172.21.2.105:0/4223608942 wait complete. 2021-11-12T05:41:08.457 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 10 2021-11-12T05:41:08.461 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:41:08.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.510+0000 7f0bbd098700 1 Processor -- start 2021-11-12T05:41:08.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.510+0000 7f0bbd098700 1 -- start start 2021-11-12T05:41:08.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.510+0000 7f0bbd098700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f0bb80ad080 0x7f0bb80af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:08.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.510+0000 7f0bbd098700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f0bb80ac280 0x7f0bb80ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:08.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.510+0000 7f0bbd098700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bb80ac7b0 con 0x7f0bb814abe0 2021-11-12T05:41:08.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.510+0000 7f0bbd098700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bb81488a0 con 0x7f0bb80ac280 2021-11-12T05:41:08.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.510+0000 7f0bbd098700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bb80ac9e0 con 0x7f0bb80ad080 2021-11-12T05:41:08.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.510+0000 7f0bb659c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f0bb80ac280 0x7f0bb80ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:08.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.510+0000 7f0bb759e700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f0bb814abe0 0x7f0bb814b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:54718/0 (socket says 172.21.2.105:54718) 2021-11-12T05:41:08.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.510+0000 7f0bb759e700 1 -- 172.21.2.105:0/2901164124 learned_addr learned my addr 172.21.2.105:0/2901164124 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:41:08.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.510+0000 7f0bb659c700 1 -- 172.21.2.105:0/2901164124 >> v2:172.21.2.115:3300/0 conn(0x7f0bb80ad080 msgr2=0x7f0bb80af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:08.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.510+0000 7f0bb659c700 1 --2- 172.21.2.105:0/2901164124 >> v2:172.21.2.115:3300/0 conn(0x7f0bb80ad080 0x7f0bb80af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:08.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.510+0000 7f0bb659c700 1 -- 172.21.2.105:0/2901164124 >> v1:172.21.2.105:6789/0 conn(0x7f0bb814abe0 legacy=0x7f0bb814b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:08.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.510+0000 7f0bb659c700 1 -- 172.21.2.105:0/2901164124 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb80b0b30 con 0x7f0bb80ac280 2021-11-12T05:41:08.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.510+0000 7f0bb659c700 1 --2- 172.21.2.105:0/2901164124 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0bb80ac280 0x7f0bb80ad460 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f0bac002f70 tx=0x7f0bac006df0).ready entity=mon.0 client_cookie=a424191ceb4b8d4b server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:08.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.510+0000 7f0bb5d9b700 1 -- 172.21.2.105:0/2901164124 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bac00d5c0 con 0x7f0bb80ac280 2021-11-12T05:41:08.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.510+0000 7f0bb5d9b700 1 -- 172.21.2.105:0/2901164124 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bac000e90 con 0x7f0bb80ac280 2021-11-12T05:41:08.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.510+0000 7f0bb5d9b700 1 -- 172.21.2.105:0/2901164124 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bac00d910 con 0x7f0bb80ac280 2021-11-12T05:41:08.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.510+0000 7f0bbd098700 1 -- 172.21.2.105:0/2901164124 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0bb80ac280 msgr2=0x7f0bb80ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:08.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.510+0000 7f0bbd098700 1 --2- 172.21.2.105:0/2901164124 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0bb80ac280 0x7f0bb80ad460 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f0bac002f70 tx=0x7f0bac006df0).stop 2021-11-12T05:41:08.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.510+0000 7f0bbd098700 1 -- 172.21.2.105:0/2901164124 shutdown_connections 2021-11-12T05:41:08.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.510+0000 7f0bbd098700 1 --2- 172.21.2.105:0/2901164124 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0bb80ac280 0x7f0bb80ad460 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:08.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.510+0000 7f0bbd098700 1 --2- 172.21.2.105:0/2901164124 >> v2:172.21.2.115:3300/0 conn(0x7f0bb80ad080 0x7f0bb80af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:08.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.510+0000 7f0bbd098700 1 -- 172.21.2.105:0/2901164124 >> 172.21.2.105:0/2901164124 conn(0x7f0bb80b5370 msgr2=0x7f0bb80b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:08.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.510+0000 7f0bbd098700 1 -- 172.21.2.105:0/2901164124 shutdown_connections 2021-11-12T05:41:08.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.510+0000 7f0bbd098700 1 -- 172.21.2.105:0/2901164124 wait complete. 2021-11-12T05:41:08.521 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.510+0000 7f0bbd098700 1 Processor -- start 2021-11-12T05:41:08.521 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.510+0000 7f0bbd098700 1 -- start start 2021-11-12T05:41:08.521 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.514+0000 7f0bbd098700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0bb80ac280 0x7f0bb80aae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:08.521 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.514+0000 7f0bbd098700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0bb80ad080 0x7f0bb8066940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:08.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.514+0000 7f0bbd098700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0bb814abe0 0x7f0bb8066e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:08.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.514+0000 7f0bbd098700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb8062820 con 0x7f0bb80ad080 2021-11-12T05:41:08.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.514+0000 7f0bbd098700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb8062ac0 con 0x7f0bb80ac280 2021-11-12T05:41:08.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.514+0000 7f0bbd098700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb8062d60 con 0x7f0bb814abe0 2021-11-12T05:41:08.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.514+0000 7f0bb659c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0bb80ad080 0x7f0bb8066940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:08.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.514+0000 7f0bb659c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0bb80ad080 0x7f0bb8066940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44328/0 (socket says 172.21.2.105:44328) 2021-11-12T05:41:08.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.514+0000 7f0bb659c700 1 -- 172.21.2.105:0/2838139088 learned_addr learned my addr 172.21.2.105:0/2838139088 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:08.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.514+0000 7f0bb659c700 1 -- 172.21.2.105:0/2838139088 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0bb814abe0 msgr2=0x7f0bb8066e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:08.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.514+0000 7f0bb659c700 1 --2- 172.21.2.105:0/2838139088 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0bb814abe0 0x7f0bb8066e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:08.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.514+0000 7f0bb659c700 1 -- 172.21.2.105:0/2838139088 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0bb80ac280 msgr2=0x7f0bb80aae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:08.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.514+0000 7f0bb659c700 1 --2- 172.21.2.105:0/2838139088 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0bb80ac280 0x7f0bb80aae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:08.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.514+0000 7f0bb659c700 1 -- 172.21.2.105:0/2838139088 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bac00b180 con 0x7f0bb80ad080 2021-11-12T05:41:08.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.514+0000 7f0bb659c700 1 --2- 172.21.2.105:0/2838139088 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0bb80ad080 0x7f0bb8066940 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f0bac002f70 tx=0x7f0bac014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:08.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.514+0000 7f0ba7fff700 1 -- 172.21.2.105:0/2838139088 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bac01e400 con 0x7f0bb80ad080 2021-11-12T05:41:08.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.514+0000 7f0ba7fff700 1 -- 172.21.2.105:0/2838139088 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bac01e560 con 0x7f0bb80ad080 2021-11-12T05:41:08.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.514+0000 7f0bbd098700 1 -- 172.21.2.105:0/2838139088 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bb80aa7e0 con 0x7f0bb80ad080 2021-11-12T05:41:08.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.514+0000 7f0ba7fff700 1 -- 172.21.2.105:0/2838139088 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bac01e8c0 con 0x7f0bb80ad080 2021-11-12T05:41:08.526 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.514+0000 7f0bbd098700 1 -- 172.21.2.105:0/2838139088 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb8067320 con 0x7f0bb80ad080 2021-11-12T05:41:08.526 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.514+0000 7f0bbd098700 1 -- 172.21.2.105:0/2838139088 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bb8062f20 con 0x7f0bb80ad080 2021-11-12T05:41:08.526 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.514+0000 7f0ba7fff700 1 -- 172.21.2.105:0/2838139088 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0bac025030 con 0x7f0bb80ad080 2021-11-12T05:41:08.526 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.514+0000 7f0ba7fff700 1 --2- 172.21.2.105:0/2838139088 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0b940535d0 0x7f0b94055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:08.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.514+0000 7f0ba7fff700 1 -- 172.21.2.105:0/2838139088 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f0bac06cb30 con 0x7f0bb80ad080 2021-11-12T05:41:08.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.514+0000 7f0bb6d9d700 1 --2- 172.21.2.105:0/2838139088 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0b940535d0 0x7f0b94055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:08.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.514+0000 7f0bb6d9d700 1 --2- 172.21.2.105:0/2838139088 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0b940535d0 0x7f0b94055a90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f0ba8002f70 tx=0x7f0ba8006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:08.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.518+0000 7f0ba7fff700 1 -- 172.21.2.105:0/2838139088 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0bac043a30 con 0x7f0bb80ad080 2021-11-12T05:41:08.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.598+0000 7f0bbd098700 1 -- 172.21.2.105:0/2838139088 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0bb80b1440 con 0x7f0bb80ad080 2021-11-12T05:41:08.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.602+0000 7f0ba7fff700 1 -- 172.21.2.105:0/2838139088 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16284 (secure 0 0 0) 0x7f0bac023090 con 0x7f0bb80ad080 2021-11-12T05:41:08.603 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:41:08.604 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":34,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:41:08.253518+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:41:05.236029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2021-11-12T05:41:06.227573+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:41:08.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.602+0000 7f0bbd098700 1 -- 172.21.2.105:0/2838139088 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0b940535d0 msgr2=0x7f0b94055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:08.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.602+0000 7f0bbd098700 1 --2- 172.21.2.105:0/2838139088 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0b940535d0 0x7f0b94055a90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f0ba8002f70 tx=0x7f0ba8006a80).stop 2021-11-12T05:41:08.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.602+0000 7f0bbd098700 1 -- 172.21.2.105:0/2838139088 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0bb80ad080 msgr2=0x7f0bb8066940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:08.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.602+0000 7f0bbd098700 1 --2- 172.21.2.105:0/2838139088 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0bb80ad080 0x7f0bb8066940 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f0bac002f70 tx=0x7f0bac014000).stop 2021-11-12T05:41:08.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.602+0000 7f0bbd098700 1 -- 172.21.2.105:0/2838139088 shutdown_connections 2021-11-12T05:41:08.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.602+0000 7f0bbd098700 1 --2- 172.21.2.105:0/2838139088 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0b940535d0 0x7f0b94055a90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:08.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.602+0000 7f0bbd098700 1 --2- 172.21.2.105:0/2838139088 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0bb814abe0 0x7f0bb8066e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:08.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.602+0000 7f0bbd098700 1 --2- 172.21.2.105:0/2838139088 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0bb80ad080 0x7f0bb8066940 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:08.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.602+0000 7f0bbd098700 1 --2- 172.21.2.105:0/2838139088 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0bb80ac280 0x7f0bb80aae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:08.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.602+0000 7f0bbd098700 1 -- 172.21.2.105:0/2838139088 >> 172.21.2.105:0/2838139088 conn(0x7f0bb80b5370 msgr2=0x7f0bb80b4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:08.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.602+0000 7f0bbd098700 1 -- 172.21.2.105:0/2838139088 shutdown_connections 2021-11-12T05:41:08.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.602+0000 7f0bbd098700 1 -- 172.21.2.105:0/2838139088 wait complete. 2021-11-12T05:41:08.611 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-12T05:41:08.665 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.662+0000 7f96a6f5b700 1 Processor -- start 2021-11-12T05:41:08.666 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.662+0000 7f96a6f5b700 1 -- start start 2021-11-12T05:41:08.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.662+0000 7f96a6f5b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f96a0143b40 0x7f96a00aded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:08.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.662+0000 7f96a6f5b700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f96a00ae3c0 0x7f96a00afe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:08.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.662+0000 7f96a6f5b700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a0067860 con 0x7f96a00adaf0 2021-11-12T05:41:08.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.662+0000 7f96a6f5b700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a01404a0 con 0x7f96a0143b40 2021-11-12T05:41:08.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.662+0000 7f96a6f5b700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a0143400 con 0x7f96a00ae3c0 2021-11-12T05:41:08.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.662+0000 7f96a4cf7700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f96a00adaf0 0x7f96a013fd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:54730/0 (socket says 172.21.2.105:54730) 2021-11-12T05:41:08.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.662+0000 7f96a4cf7700 1 -- 172.21.2.105:0/3887641443 learned_addr learned my addr 172.21.2.105:0/3887641443 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:41:08.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.662+0000 7f969ffff700 1 --2- 172.21.2.105:0/3887641443 >> v2:172.21.2.105:3300/0 conn(0x7f96a0143b40 0x7f96a00aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:08.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f969ffff700 1 -- 172.21.2.105:0/3887641443 >> v2:172.21.2.115:3300/0 conn(0x7f96a00ae3c0 msgr2=0x7f96a00afe10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:41:08.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f969ffff700 1 --2- 172.21.2.105:0/3887641443 >> v2:172.21.2.115:3300/0 conn(0x7f96a00ae3c0 0x7f96a00afe10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:08.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f969ffff700 1 -- 172.21.2.105:0/3887641443 >> v1:172.21.2.105:6789/0 conn(0x7f96a00adaf0 legacy=0x7f96a013fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:08.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f969ffff700 1 -- 172.21.2.105:0/3887641443 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a01436a0 con 0x7f96a0143b40 2021-11-12T05:41:08.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f969ffff700 1 --2- 172.21.2.105:0/3887641443 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f96a0143b40 0x7f96a00aded0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f9688002f70 tx=0x7f9688006df0).ready entity=mon.0 client_cookie=ca8c91ba7b37efaa server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:08.671 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f969f7fe700 1 -- 172.21.2.105:0/3887641443 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f968800d5c0 con 0x7f96a0143b40 2021-11-12T05:41:08.671 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f969f7fe700 1 -- 172.21.2.105:0/3887641443 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9688000e90 con 0x7f96a0143b40 2021-11-12T05:41:08.671 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f969f7fe700 1 -- 172.21.2.105:0/3887641443 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f968800d950 con 0x7f96a0143b40 2021-11-12T05:41:08.671 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f96a6f5b700 1 -- 172.21.2.105:0/3887641443 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f96a0143b40 msgr2=0x7f96a00aded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:08.671 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f96a6f5b700 1 --2- 172.21.2.105:0/3887641443 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f96a0143b40 0x7f96a00aded0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f9688002f70 tx=0x7f9688006df0).stop 2021-11-12T05:41:08.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f96a6f5b700 1 -- 172.21.2.105:0/3887641443 shutdown_connections 2021-11-12T05:41:08.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f96a6f5b700 1 --2- 172.21.2.105:0/3887641443 >> v2:172.21.2.115:3300/0 conn(0x7f96a00ae3c0 0x7f96a00afe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:08.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f96a6f5b700 1 --2- 172.21.2.105:0/3887641443 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f96a0143b40 0x7f96a00aded0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:08.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f96a6f5b700 1 -- 172.21.2.105:0/3887641443 >> 172.21.2.105:0/3887641443 conn(0x7f96a005c490 msgr2=0x7f96a005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:08.673 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f96a6f5b700 1 -- 172.21.2.105:0/3887641443 shutdown_connections 2021-11-12T05:41:08.673 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f96a6f5b700 1 -- 172.21.2.105:0/3887641443 wait complete. 2021-11-12T05:41:08.675 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f96a6f5b700 1 Processor -- start 2021-11-12T05:41:08.675 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f96a6f5b700 1 -- start start 2021-11-12T05:41:08.676 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f96a6f5b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f96a00adaf0 0x7f96a013eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:08.676 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f96a6f5b700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f96a00ae3c0 0x7f96a00636f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:08.676 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f96a6f5b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f96a0143b40 0x7f96a0063be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:08.676 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f96a6f5b700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a00abfd0 con 0x7f96a00adaf0 2021-11-12T05:41:08.677 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f96a6f5b700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a00ad0f0 con 0x7f96a00ae3c0 2021-11-12T05:41:08.677 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f96a6f5b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a00ac200 con 0x7f96a0143b40 2021-11-12T05:41:08.677 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f96a4cf7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f96a00adaf0 0x7f96a013eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:08.677 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f96a4cf7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f96a00adaf0 0x7f96a013eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44338/0 (socket says 172.21.2.105:44338) 2021-11-12T05:41:08.677 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f96a4cf7700 1 -- 172.21.2.105:0/3828317107 learned_addr learned my addr 172.21.2.105:0/3828317107 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:08.678 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f96a4cf7700 1 -- 172.21.2.105:0/3828317107 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f96a0143b40 msgr2=0x7f96a0063be0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:41:08.678 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f96a4cf7700 1 --2- 172.21.2.105:0/3828317107 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f96a0143b40 0x7f96a0063be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:08.678 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f96a4cf7700 1 -- 172.21.2.105:0/3828317107 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f96a00ae3c0 msgr2=0x7f96a00636f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:41:08.678 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f96a4cf7700 1 --2- 172.21.2.105:0/3828317107 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f96a00ae3c0 0x7f96a00636f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:08.679 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f96a4cf7700 1 -- 172.21.2.105:0/3828317107 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968800b180 con 0x7f96a00adaf0 2021-11-12T05:41:08.679 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f96a4cf7700 1 --2- 172.21.2.105:0/3828317107 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f96a00adaf0 0x7f96a013eef0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f96a00af9a0 tx=0x7f9690007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:08.679 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f969dffb700 1 -- 172.21.2.105:0/3828317107 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f969000ce30 con 0x7f96a00adaf0 2021-11-12T05:41:08.679 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f969dffb700 1 -- 172.21.2.105:0/3828317107 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96900072e0 con 0x7f96a00adaf0 2021-11-12T05:41:08.679 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f969dffb700 1 -- 172.21.2.105:0/3828317107 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9690005800 con 0x7f96a00adaf0 2021-11-12T05:41:08.680 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f96a6f5b700 1 -- 172.21.2.105:0/3828317107 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96a013fb40 con 0x7f96a00adaf0 2021-11-12T05:41:08.680 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f96a6f5b700 1 -- 172.21.2.105:0/3828317107 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a00abbd0 con 0x7f96a00adaf0 2021-11-12T05:41:08.680 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f96a6f5b700 1 -- 172.21.2.105:0/3828317107 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96a00b2b40 con 0x7f96a00adaf0 2021-11-12T05:41:08.680 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f969dffb700 1 -- 172.21.2.105:0/3828317107 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9690010070 con 0x7f96a00adaf0 2021-11-12T05:41:08.681 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f969dffb700 1 --2- 172.21.2.105:0/3828317107 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9684053660 0x7f9684055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:08.681 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.666+0000 7f969dffb700 1 -- 172.21.2.105:0/3828317107 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f969006b290 con 0x7f96a00adaf0 2021-11-12T05:41:08.681 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.670+0000 7f969ffff700 1 --2- 172.21.2.105:0/3828317107 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9684053660 0x7f9684055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:08.681 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.670+0000 7f969ffff700 1 --2- 172.21.2.105:0/3828317107 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9684053660 0x7f9684055b20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f9688002f70 tx=0x7f9688014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:08.682 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.670+0000 7f969dffb700 1 -- 172.21.2.105:0/3828317107 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9690042190 con 0x7f96a00adaf0 2021-11-12T05:41:08.782 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.778+0000 7f96a6f5b700 1 -- 172.21.2.105:0/3828317107 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f96a0057350 con 0x7f96a00adaf0 2021-11-12T05:41:08.787 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.786+0000 7f969dffb700 1 -- 172.21.2.105:0/3828317107 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v13) v1 ==== 184+0+0 (secure 0 0 0) 0x7f96900457b0 con 0x7f96a00adaf0 2021-11-12T05:41:08.790 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.786+0000 7f96a6f5b700 1 -- 172.21.2.105:0/3828317107 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9684053660 msgr2=0x7f9684055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:08.790 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.786+0000 7f96a6f5b700 1 --2- 172.21.2.105:0/3828317107 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9684053660 0x7f9684055b20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f9688002f70 tx=0x7f9688014000).stop 2021-11-12T05:41:08.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.786+0000 7f96a6f5b700 1 -- 172.21.2.105:0/3828317107 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f96a00adaf0 msgr2=0x7f96a013eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:08.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.786+0000 7f96a6f5b700 1 --2- 172.21.2.105:0/3828317107 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f96a00adaf0 0x7f96a013eef0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f96a00af9a0 tx=0x7f9690007c40).stop 2021-11-12T05:41:08.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.786+0000 7f96a6f5b700 1 -- 172.21.2.105:0/3828317107 shutdown_connections 2021-11-12T05:41:08.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.786+0000 7f96a6f5b700 1 --2- 172.21.2.105:0/3828317107 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9684053660 0x7f9684055b20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:08.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.786+0000 7f96a6f5b700 1 --2- 172.21.2.105:0/3828317107 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f96a0143b40 0x7f96a0063be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:08.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.786+0000 7f96a6f5b700 1 --2- 172.21.2.105:0/3828317107 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f96a00ae3c0 0x7f96a00636f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:08.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.786+0000 7f96a6f5b700 1 --2- 172.21.2.105:0/3828317107 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f96a00adaf0 0x7f96a013eef0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:08.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.786+0000 7f96a6f5b700 1 -- 172.21.2.105:0/3828317107 >> 172.21.2.105:0/3828317107 conn(0x7f96a005c490 msgr2=0x7f96a0142af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:08.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.786+0000 7f96a6f5b700 1 -- 172.21.2.105:0/3828317107 shutdown_connections 2021-11-12T05:41:08.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.786+0000 7f96a6f5b700 1 -- 172.21.2.105:0/3828317107 wait complete. 2021-11-12T05:41:08.794 INFO:teuthology.orchestra.run.gibba005.stderr:updated caps for client.0 2021-11-12T05:41:08.796 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-12T05:41:08.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.850+0000 7fcdce7e9700 1 Processor -- start 2021-11-12T05:41:08.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.850+0000 7fcdce7e9700 1 -- start start 2021-11-12T05:41:08.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.850+0000 7fcdce7e9700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fcdc805fdc0 0x7fcdc80601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:08.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.850+0000 7fcdce7e9700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fcdc813a9c0 0x7fcdc813ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:08.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.850+0000 7fcdce7e9700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdc8066150 con 0x7fcdc80ade80 2021-11-12T05:41:08.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.850+0000 7fcdce7e9700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdc8141fb0 con 0x7fcdc805fdc0 2021-11-12T05:41:08.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.850+0000 7fcdce7e9700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdc80663f0 con 0x7fcdc813a9c0 2021-11-12T05:41:08.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.850+0000 7fcdc77fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fcdc80ade80 0x7fcdc8066730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:54746/0 (socket says 172.21.2.105:54746) 2021-11-12T05:41:08.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.850+0000 7fcdc77fe700 1 -- 172.21.2.105:0/1019704608 learned_addr learned my addr 172.21.2.105:0/1019704608 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:41:08.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.850+0000 7fcdc7fff700 1 --2- 172.21.2.105:0/1019704608 >> v2:172.21.2.105:3300/0 conn(0x7fcdc805fdc0 0x7fcdc80601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:08.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.850+0000 7fcdc7fff700 1 -- 172.21.2.105:0/1019704608 >> v2:172.21.2.115:3300/0 conn(0x7fcdc813a9c0 msgr2=0x7fcdc813ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:08.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.850+0000 7fcdccd86700 1 --2- 172.21.2.105:0/1019704608 >> v2:172.21.2.115:3300/0 conn(0x7fcdc813a9c0 0x7fcdc813ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:08.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.850+0000 7fcdc7fff700 1 --2- 172.21.2.105:0/1019704608 >> v2:172.21.2.115:3300/0 conn(0x7fcdc813a9c0 0x7fcdc813ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:08.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.850+0000 7fcdc7fff700 1 -- 172.21.2.105:0/1019704608 >> v1:172.21.2.105:6789/0 conn(0x7fcdc80ade80 legacy=0x7fcdc8066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:08.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.850+0000 7fcdc7fff700 1 -- 172.21.2.105:0/1019704608 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc8140fd0 con 0x7fcdc805fdc0 2021-11-12T05:41:08.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.850+0000 7fcdc7fff700 1 --2- 172.21.2.105:0/1019704608 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcdc805fdc0 0x7fcdc80601a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7fcdb8001110 tx=0x7fcdb0006df0).ready entity=mon.0 client_cookie=492741b2bbf8a6bb server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:08.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.850+0000 7fcdc6ffd700 1 -- 172.21.2.105:0/1019704608 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdb000d570 con 0x7fcdc805fdc0 2021-11-12T05:41:08.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.850+0000 7fcdc6ffd700 1 -- 172.21.2.105:0/1019704608 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb0000e90 con 0x7fcdc805fdc0 2021-11-12T05:41:08.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.850+0000 7fcdc6ffd700 1 -- 172.21.2.105:0/1019704608 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdb000d8c0 con 0x7fcdc805fdc0 2021-11-12T05:41:08.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.850+0000 7fcdce7e9700 1 -- 172.21.2.105:0/1019704608 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcdc805fdc0 msgr2=0x7fcdc80601a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:08.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.850+0000 7fcdce7e9700 1 --2- 172.21.2.105:0/1019704608 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcdc805fdc0 0x7fcdc80601a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7fcdb8001110 tx=0x7fcdb0006df0).stop 2021-11-12T05:41:08.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.850+0000 7fcdce7e9700 1 -- 172.21.2.105:0/1019704608 shutdown_connections 2021-11-12T05:41:08.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.850+0000 7fcdce7e9700 1 --2- 172.21.2.105:0/1019704608 >> v2:172.21.2.115:3300/0 conn(0x7fcdc813a9c0 0x7fcdc813ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:08.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.850+0000 7fcdce7e9700 1 --2- 172.21.2.105:0/1019704608 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcdc805fdc0 0x7fcdc80601a0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:08.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.850+0000 7fcdce7e9700 1 -- 172.21.2.105:0/1019704608 >> 172.21.2.105:0/1019704608 conn(0x7fcdc80608d0 msgr2=0x7fcdc805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:08.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.850+0000 7fcdce7e9700 1 -- 172.21.2.105:0/1019704608 shutdown_connections 2021-11-12T05:41:08.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.850+0000 7fcdce7e9700 1 -- 172.21.2.105:0/1019704608 wait complete. 2021-11-12T05:41:08.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.854+0000 7fcdce7e9700 1 Processor -- start 2021-11-12T05:41:08.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.854+0000 7fcdce7e9700 1 -- start start 2021-11-12T05:41:08.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.854+0000 7fcdce7e9700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcdc805fdc0 0x7fcdc8139fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:08.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.854+0000 7fcdce7e9700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcdc80ade80 0x7fcdc8148060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:08.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.854+0000 7fcdce7e9700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcdc813a9c0 0x7fcdc81431f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:08.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.854+0000 7fcdce7e9700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc8142f80 con 0x7fcdc805fdc0 2021-11-12T05:41:08.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.854+0000 7fcdce7e9700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc8142ce0 con 0x7fcdc813a9c0 2021-11-12T05:41:08.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.854+0000 7fcdce7e9700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc8142710 con 0x7fcdc80ade80 2021-11-12T05:41:08.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.854+0000 7fcdc7fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcdc805fdc0 0x7fcdc8139fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:08.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.854+0000 7fcdc7fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcdc805fdc0 0x7fcdc8139fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44354/0 (socket says 172.21.2.105:44354) 2021-11-12T05:41:08.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.854+0000 7fcdc7fff700 1 -- 172.21.2.105:0/629482317 learned_addr learned my addr 172.21.2.105:0/629482317 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:08.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.854+0000 7fcdc7fff700 1 -- 172.21.2.105:0/629482317 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcdc80ade80 msgr2=0x7fcdc8148060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:08.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.854+0000 7fcdc7fff700 1 --2- 172.21.2.105:0/629482317 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcdc80ade80 0x7fcdc8148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:08.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.854+0000 7fcdc7fff700 1 -- 172.21.2.105:0/629482317 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcdc813a9c0 msgr2=0x7fcdc81431f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:08.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.854+0000 7fcdc7fff700 1 --2- 172.21.2.105:0/629482317 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcdc813a9c0 0x7fcdc81431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:08.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.854+0000 7fcdc7fff700 1 -- 172.21.2.105:0/629482317 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb000b180 con 0x7fcdc805fdc0 2021-11-12T05:41:08.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.854+0000 7fcdc7fff700 1 --2- 172.21.2.105:0/629482317 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcdc805fdc0 0x7fcdc8139fb0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7fcdb8001110 tx=0x7fcdb0014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:08.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.854+0000 7fcdc57fa700 1 -- 172.21.2.105:0/629482317 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdb0002f50 con 0x7fcdc805fdc0 2021-11-12T05:41:08.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.854+0000 7fcdc57fa700 1 -- 172.21.2.105:0/629482317 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb001e400 con 0x7fcdc805fdc0 2021-11-12T05:41:08.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.854+0000 7fcdce7e9700 1 -- 172.21.2.105:0/629482317 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdc8142200 con 0x7fcdc805fdc0 2021-11-12T05:41:08.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.854+0000 7fcdc57fa700 1 -- 172.21.2.105:0/629482317 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdb001e760 con 0x7fcdc805fdc0 2021-11-12T05:41:08.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.854+0000 7fcdce7e9700 1 -- 172.21.2.105:0/629482317 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdc8143880 con 0x7fcdc805fdc0 2021-11-12T05:41:08.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.854+0000 7fcdce7e9700 1 -- 172.21.2.105:0/629482317 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdc8140c40 con 0x7fcdc805fdc0 2021-11-12T05:41:08.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.854+0000 7fcdc57fa700 1 -- 172.21.2.105:0/629482317 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcdb001c070 con 0x7fcdc805fdc0 2021-11-12T05:41:08.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.854+0000 7fcdc57fa700 1 --2- 172.21.2.105:0/629482317 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcdac053640 0x7fcdac055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:08.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.854+0000 7fcdc57fa700 1 -- 172.21.2.105:0/629482317 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fcdb006c6d0 con 0x7fcdc805fdc0 2021-11-12T05:41:08.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.854+0000 7fcdc77fe700 1 --2- 172.21.2.105:0/629482317 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcdac053640 0x7fcdac055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:08.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.854+0000 7fcdc77fe700 1 --2- 172.21.2.105:0/629482317 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcdac053640 0x7fcdac055b00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fcdb80011d0 tx=0x7fcdb8007790).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:08.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.858+0000 7fcdc57fa700 1 -- 172.21.2.105:0/629482317 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcdb00435d0 con 0x7fcdc805fdc0 2021-11-12T05:41:08.973 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.970+0000 7fcdce7e9700 1 -- 172.21.2.105:0/629482317 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fcdc80b56d0 con 0x7fcdc805fdc0 2021-11-12T05:41:08.979 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.978+0000 7fcdc57fa700 1 -- 172.21.2.105:0/629482317 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v14) v1 ==== 184+0+0 (secure 0 0 0) 0x7fcdb00230e0 con 0x7fcdc805fdc0 2021-11-12T05:41:08.980 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.978+0000 7fcdce7e9700 1 -- 172.21.2.105:0/629482317 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcdac053640 msgr2=0x7fcdac055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:08.981 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.978+0000 7fcdce7e9700 1 --2- 172.21.2.105:0/629482317 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcdac053640 0x7fcdac055b00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fcdb80011d0 tx=0x7fcdb8007790).stop 2021-11-12T05:41:08.981 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.978+0000 7fcdce7e9700 1 -- 172.21.2.105:0/629482317 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcdc805fdc0 msgr2=0x7fcdc8139fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:08.981 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.978+0000 7fcdce7e9700 1 --2- 172.21.2.105:0/629482317 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcdc805fdc0 0x7fcdc8139fb0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7fcdb8001110 tx=0x7fcdb0014000).stop 2021-11-12T05:41:08.982 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.978+0000 7fcdce7e9700 1 -- 172.21.2.105:0/629482317 shutdown_connections 2021-11-12T05:41:08.982 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.978+0000 7fcdce7e9700 1 --2- 172.21.2.105:0/629482317 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcdac053640 0x7fcdac055b00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:08.982 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.978+0000 7fcdce7e9700 1 --2- 172.21.2.105:0/629482317 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcdc813a9c0 0x7fcdc81431f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:08.982 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.978+0000 7fcdce7e9700 1 --2- 172.21.2.105:0/629482317 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcdc80ade80 0x7fcdc8148060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:08.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.978+0000 7fcdce7e9700 1 --2- 172.21.2.105:0/629482317 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcdc805fdc0 0x7fcdc8139fb0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:08.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.978+0000 7fcdce7e9700 1 -- 172.21.2.105:0/629482317 >> 172.21.2.105:0/629482317 conn(0x7fcdc80608d0 msgr2=0x7fcdc8066730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:08.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.978+0000 7fcdce7e9700 1 -- 172.21.2.105:0/629482317 shutdown_connections 2021-11-12T05:41:08.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:08.978+0000 7fcdce7e9700 1 -- 172.21.2.105:0/629482317 wait complete. 2021-11-12T05:41:08.984 INFO:teuthology.orchestra.run.gibba005.stderr:updated caps for client.1 2021-11-12T05:41:08.987 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-12T05:41:09.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.038+0000 7f3acea98700 1 Processor -- start 2021-11-12T05:41:09.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.038+0000 7f3acea98700 1 -- start start 2021-11-12T05:41:09.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.038+0000 7f3acea98700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f3ac80ac280 0x7f3ac814b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:09.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.038+0000 7f3acea98700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3ac80af730 0x7f3ac80ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:09.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.038+0000 7f3acea98700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ac80ac7b0 con 0x7f3ac80ad080 2021-11-12T05:41:09.045 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.038+0000 7f3acea98700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ac81488a0 con 0x7f3ac80ac280 2021-11-12T05:41:09.045 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.038+0000 7f3acea98700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac80ac9e0 con 0x7f3ac80af730 2021-11-12T05:41:09.045 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3acc834700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f3ac80ad080 0x7f3ac814abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:54758/0 (socket says 172.21.2.105:54758) 2021-11-12T05:41:09.045 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3acc834700 1 -- 172.21.2.105:0/1580579830 learned_addr learned my addr 172.21.2.105:0/1580579830 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:41:09.046 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3ac7fff700 1 --2- 172.21.2.105:0/1580579830 >> v2:172.21.2.115:3300/0 conn(0x7f3ac80ac280 0x7f3ac814b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:09.046 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3acd035700 1 --2- 172.21.2.105:0/1580579830 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3ac80af730 0x7f3ac80ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:09.046 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3ac77fe700 1 -- 172.21.2.105:0/1580579830 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 478305103 0 0) 0x7f3ac80ac7b0 con 0x7f3ac80ad080 2021-11-12T05:41:09.046 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3ac77fe700 1 -- 172.21.2.105:0/1580579830 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3aa8003260 con 0x7f3ac80ad080 2021-11-12T05:41:09.047 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3acd035700 1 -- 172.21.2.105:0/1580579830 >> v2:172.21.2.115:3300/0 conn(0x7f3ac80ac280 msgr2=0x7f3ac814b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:09.047 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3acd035700 1 --2- 172.21.2.105:0/1580579830 >> v2:172.21.2.115:3300/0 conn(0x7f3ac80ac280 0x7f3ac814b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:09.047 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3acd035700 1 -- 172.21.2.105:0/1580579830 >> v1:172.21.2.105:6789/0 conn(0x7f3ac80ad080 legacy=0x7f3ac814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:09.047 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3acd035700 1 -- 172.21.2.105:0/1580579830 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac80b0b30 con 0x7f3ac80af730 2021-11-12T05:41:09.047 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3acd035700 1 --2- 172.21.2.105:0/1580579830 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3ac80af730 0x7f3ac80ad460 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f3ab8001800 tx=0x7f3ac00091d0).ready entity=mon.2 client_cookie=6b22e643d3ed11cc server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:09.051 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3ac77fe700 1 -- 172.21.2.105:0/1580579830 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ab8001660 con 0x7f3ac80af730 2021-11-12T05:41:09.051 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3ac77fe700 1 -- 172.21.2.105:0/1580579830 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac000d4a0 con 0x7f3ac80af730 2021-11-12T05:41:09.051 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3ac77fe700 1 -- 172.21.2.105:0/1580579830 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ac000d610 con 0x7f3ac80af730 2021-11-12T05:41:09.052 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3acea98700 1 -- 172.21.2.105:0/1580579830 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3ac80af730 msgr2=0x7f3ac80ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:09.052 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3acea98700 1 --2- 172.21.2.105:0/1580579830 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3ac80af730 0x7f3ac80ad460 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f3ab8001800 tx=0x7f3ac00091d0).stop 2021-11-12T05:41:09.052 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3acea98700 1 -- 172.21.2.105:0/1580579830 shutdown_connections 2021-11-12T05:41:09.052 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3acea98700 1 --2- 172.21.2.105:0/1580579830 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3ac80af730 0x7f3ac80ad460 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:09.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3acea98700 1 --2- 172.21.2.105:0/1580579830 >> v2:172.21.2.115:3300/0 conn(0x7f3ac80ac280 0x7f3ac814b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:09.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3acea98700 1 -- 172.21.2.105:0/1580579830 >> 172.21.2.105:0/1580579830 conn(0x7f3ac80b5370 msgr2=0x7f3ac80b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:09.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3acea98700 1 -- 172.21.2.105:0/1580579830 shutdown_connections 2021-11-12T05:41:09.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3acea98700 1 -- 172.21.2.105:0/1580579830 wait complete. 2021-11-12T05:41:09.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3acea98700 1 Processor -- start 2021-11-12T05:41:09.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3acea98700 1 -- start start 2021-11-12T05:41:09.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3acea98700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3ac80ac280 0x7f3ac8062dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:09.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3acea98700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3ac80ad080 0x7f3ac8060520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:09.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3acea98700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3ac80af730 0x7f3ac80aa950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:09.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3acea98700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac81426a0 con 0x7f3ac80af730 2021-11-12T05:41:09.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3acea98700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac8142900 con 0x7f3ac80ad080 2021-11-12T05:41:09.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3acea98700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac8142ba0 con 0x7f3ac80ac280 2021-11-12T05:41:09.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3acd035700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3ac80af730 0x7f3ac80aa950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:09.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3acd035700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3ac80af730 0x7f3ac80aa950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44370/0 (socket says 172.21.2.105:44370) 2021-11-12T05:41:09.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3acd035700 1 -- 172.21.2.105:0/886660768 learned_addr learned my addr 172.21.2.105:0/886660768 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:09.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3acd035700 1 -- 172.21.2.105:0/886660768 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3ac80ac280 msgr2=0x7f3ac8062dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:09.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3acd035700 1 --2- 172.21.2.105:0/886660768 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3ac80ac280 0x7f3ac8062dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:09.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3acd035700 1 -- 172.21.2.105:0/886660768 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3ac80ad080 msgr2=0x7f3ac8060520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:09.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3acd035700 1 --2- 172.21.2.105:0/886660768 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3ac80ad080 0x7f3ac8060520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:09.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3acd035700 1 -- 172.21.2.105:0/886660768 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac0009470 con 0x7f3ac80af730 2021-11-12T05:41:09.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3acd035700 1 --2- 172.21.2.105:0/886660768 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3ac80af730 0x7f3ac80aa950 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f3ab8001800 tx=0x7f3ac80b0fd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:09.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3ac5ffb700 1 -- 172.21.2.105:0/886660768 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ac00032d0 con 0x7f3ac80af730 2021-11-12T05:41:09.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3ac5ffb700 1 -- 172.21.2.105:0/886660768 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac000de40 con 0x7f3ac80af730 2021-11-12T05:41:09.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.042+0000 7f3acea98700 1 -- 172.21.2.105:0/886660768 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ac80a9910 con 0x7f3ac80af730 2021-11-12T05:41:09.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.046+0000 7f3ac5ffb700 1 -- 172.21.2.105:0/886660768 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ac001d450 con 0x7f3ac80af730 2021-11-12T05:41:09.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.046+0000 7f3acea98700 1 -- 172.21.2.105:0/886660768 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ac80a9e20 con 0x7f3ac80af730 2021-11-12T05:41:09.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.046+0000 7f3acea98700 1 -- 172.21.2.105:0/886660768 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ac80b1440 con 0x7f3ac80af730 2021-11-12T05:41:09.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.046+0000 7f3ac5ffb700 1 -- 172.21.2.105:0/886660768 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3ac0024030 con 0x7f3ac80af730 2021-11-12T05:41:09.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.046+0000 7f3ac5ffb700 1 --2- 172.21.2.105:0/886660768 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3aac0536d0 0x7f3aac055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:09.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.046+0000 7f3ac5ffb700 1 -- 172.21.2.105:0/886660768 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f3ac006cac0 con 0x7f3ac80af730 2021-11-12T05:41:09.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.046+0000 7f3acc834700 1 --2- 172.21.2.105:0/886660768 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3aac0536d0 0x7f3aac055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:09.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.046+0000 7f3acc834700 1 --2- 172.21.2.105:0/886660768 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3aac0536d0 0x7f3aac055b90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f3ab8001370 tx=0x7f3ab80014c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:09.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.046+0000 7f3ac5ffb700 1 -- 172.21.2.105:0/886660768 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3ac0043ad0 con 0x7f3ac80af730 2021-11-12T05:41:09.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.158+0000 7f3acea98700 1 -- 172.21.2.105:0/886660768 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f3ac8142d70 con 0x7f3ac80af730 2021-11-12T05:41:09.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.162+0000 7f3ac5ffb700 1 -- 172.21.2.105:0/886660768 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v15) v1 ==== 184+0+0 (secure 0 0 0) 0x7f3ac00220e0 con 0x7f3ac80af730 2021-11-12T05:41:09.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.166+0000 7f3acea98700 1 -- 172.21.2.105:0/886660768 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3aac0536d0 msgr2=0x7f3aac055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:09.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.166+0000 7f3acea98700 1 --2- 172.21.2.105:0/886660768 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3aac0536d0 0x7f3aac055b90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f3ab8001370 tx=0x7f3ab80014c0).stop 2021-11-12T05:41:09.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.166+0000 7f3acea98700 1 -- 172.21.2.105:0/886660768 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3ac80af730 msgr2=0x7f3ac80aa950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:09.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.166+0000 7f3acea98700 1 --2- 172.21.2.105:0/886660768 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3ac80af730 0x7f3ac80aa950 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f3ab8001800 tx=0x7f3ac80b0fd0).stop 2021-11-12T05:41:09.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.166+0000 7f3acea98700 1 -- 172.21.2.105:0/886660768 shutdown_connections 2021-11-12T05:41:09.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.166+0000 7f3acea98700 1 --2- 172.21.2.105:0/886660768 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3aac0536d0 0x7f3aac055b90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:09.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.166+0000 7f3acea98700 1 --2- 172.21.2.105:0/886660768 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3ac80af730 0x7f3ac80aa950 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:09.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.166+0000 7f3acea98700 1 --2- 172.21.2.105:0/886660768 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3ac80ad080 0x7f3ac8060520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:09.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.166+0000 7f3acea98700 1 --2- 172.21.2.105:0/886660768 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3ac80ac280 0x7f3ac8062dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:09.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.166+0000 7f3acea98700 1 -- 172.21.2.105:0/886660768 >> 172.21.2.105:0/886660768 conn(0x7f3ac80b5370 msgr2=0x7f3ac8143a30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:09.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.166+0000 7f3acea98700 1 -- 172.21.2.105:0/886660768 shutdown_connections 2021-11-12T05:41:09.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.166+0000 7f3acea98700 1 -- 172.21.2.105:0/886660768 wait complete. 2021-11-12T05:41:09.171 INFO:teuthology.orchestra.run.gibba005.stderr:updated caps for client.2 2021-11-12T05:41:09.174 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:41:09.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.222+0000 7fb56f33e700 1 Processor -- start 2021-11-12T05:41:09.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.222+0000 7fb56f33e700 1 -- start start 2021-11-12T05:41:09.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.222+0000 7fb56f33e700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fb5680ac280 0x7fb56814b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:09.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.222+0000 7fb56f33e700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5680ac7b0 con 0x7fb5680af730 2021-11-12T05:41:09.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.222+0000 7fb56f33e700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5680ac9e0 con 0x7fb5680ad080 2021-11-12T05:41:09.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.222+0000 7fb56f33e700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5681488a0 con 0x7fb5680ac280 2021-11-12T05:41:09.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.222+0000 7fb56d8db700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fb5680af730 0x7fb568147a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:54774/0 (socket says 172.21.2.105:54774) 2021-11-12T05:41:09.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.222+0000 7fb56d8db700 1 -- 172.21.2.105:0/1654408500 learned_addr learned my addr 172.21.2.105:0/1654408500 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:41:09.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.222+0000 7fb56c8d9700 1 --2- 172.21.2.105:0/1654408500 >> v2:172.21.2.115:3300/0 conn(0x7fb5680ac280 0x7fb56814b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:09.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.222+0000 7fb55bfff700 1 -- 172.21.2.105:0/1654408500 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4199272108 0 0) 0x7fb5680ac7b0 con 0x7fb5680af730 2021-11-12T05:41:09.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.222+0000 7fb55bfff700 1 -- 172.21.2.105:0/1654408500 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb550003260 con 0x7fb5680af730 2021-11-12T05:41:09.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.222+0000 7fb55bfff700 1 -- 172.21.2.105:0/1654408500 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3673369311 0 0) 0x7fb550003260 con 0x7fb5680af730 2021-11-12T05:41:09.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.222+0000 7fb55bfff700 1 -- 172.21.2.105:0/1654408500 >> v2:172.21.2.115:3300/0 conn(0x7fb5680ac280 msgr2=0x7fb56814b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:09.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.222+0000 7fb55bfff700 1 --2- 172.21.2.105:0/1654408500 >> v2:172.21.2.115:3300/0 conn(0x7fb5680ac280 0x7fb56814b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:09.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.222+0000 7fb55bfff700 1 -- 172.21.2.105:0/1654408500 >> v1:172.21.2.115:6789/0 conn(0x7fb5680ad080 legacy=0x7fb56814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:09.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.222+0000 7fb55bfff700 1 -- 172.21.2.105:0/1654408500 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5680b0b30 con 0x7fb5680af730 2021-11-12T05:41:09.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.222+0000 7fb55bfff700 1 -- 172.21.2.105:0/1654408500 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fb5600019e0 con 0x7fb5680af730 2021-11-12T05:41:09.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.222+0000 7fb55bfff700 1 -- 172.21.2.105:0/1654408500 >> v1:172.21.2.105:6789/0 conn(0x7fb5680af730 legacy=0x7fb568147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:09.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.222+0000 7fb55bfff700 1 --2- 172.21.2.105:0/1654408500 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb550003750 0x7fb550003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:09.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.222+0000 7fb55bfff700 1 --2- 172.21.2.105:0/1654408500 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb550004500 0x7fb550004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:09.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.222+0000 7fb55bfff700 1 --2- 172.21.2.105:0/1654408500 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb550004e70 0x7fb55000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:09.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.222+0000 7fb55bfff700 1 -- 172.21.2.105:0/1654408500 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5681488a0 con 0x7fb550004500 2021-11-12T05:41:09.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.222+0000 7fb55bfff700 1 -- 172.21.2.105:0/1654408500 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55000bd20 con 0x7fb550004e70 2021-11-12T05:41:09.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.222+0000 7fb55bfff700 1 -- 172.21.2.105:0/1654408500 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55000bee0 con 0x7fb550003750 2021-11-12T05:41:09.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56c8d9700 1 --2- 172.21.2.105:0/1654408500 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb550004500 0x7fb550004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:09.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56d0da700 1 --2- 172.21.2.105:0/1654408500 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb550003750 0x7fb550003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:09.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56d8db700 1 --2- 172.21.2.105:0/1654408500 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb550004e70 0x7fb55000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:09.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56c8d9700 1 -- 172.21.2.105:0/1654408500 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb550003750 msgr2=0x7fb550003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:09.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56c8d9700 1 --2- 172.21.2.105:0/1654408500 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb550003750 0x7fb550003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:09.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56c8d9700 1 -- 172.21.2.105:0/1654408500 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb550004e70 msgr2=0x7fb55000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:09.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56c8d9700 1 --2- 172.21.2.105:0/1654408500 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb550004e70 0x7fb55000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:09.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56d8db700 1 -- 172.21.2.105:0/1654408500 reap_dead start 2021-11-12T05:41:09.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56c8d9700 1 -- 172.21.2.105:0/1654408500 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb550003260 con 0x7fb550004500 2021-11-12T05:41:09.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56c8d9700 1 --2- 172.21.2.105:0/1654408500 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb550004500 0x7fb550004980 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7fb56400c000 tx=0x7fb564006df0).ready entity=mon.0 client_cookie=371a12ccc5291214 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:09.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb55bfff700 1 -- 172.21.2.105:0/1654408500 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb56400e830 con 0x7fb550004500 2021-11-12T05:41:09.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb55bfff700 1 -- 172.21.2.105:0/1654408500 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56400e990 con 0x7fb550004500 2021-11-12T05:41:09.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb55bfff700 1 -- 172.21.2.105:0/1654408500 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb56400ecf0 con 0x7fb550004500 2021-11-12T05:41:09.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56f33e700 1 -- 172.21.2.105:0/1654408500 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb550004500 msgr2=0x7fb550004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:09.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56f33e700 1 --2- 172.21.2.105:0/1654408500 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb550004500 0x7fb550004980 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7fb56400c000 tx=0x7fb564006df0).stop 2021-11-12T05:41:09.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56f33e700 1 -- 172.21.2.105:0/1654408500 shutdown_connections 2021-11-12T05:41:09.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56f33e700 1 --2- 172.21.2.105:0/1654408500 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb550004500 0x7fb550004980 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:09.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56f33e700 1 -- 172.21.2.105:0/1654408500 >> 172.21.2.105:0/1654408500 conn(0x7fb5680b5370 msgr2=0x7fb5680b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:09.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56f33e700 1 -- 172.21.2.105:0/1654408500 shutdown_connections 2021-11-12T05:41:09.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56f33e700 1 -- 172.21.2.105:0/1654408500 wait complete. 2021-11-12T05:41:09.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56f33e700 1 Processor -- start 2021-11-12T05:41:09.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56f33e700 1 -- start start 2021-11-12T05:41:09.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56f33e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb550004500 0x7fb5680a9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:09.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56f33e700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb568157c30 0x7fb5680ab520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:09.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56f33e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb5680aba10 0x7fb5680a7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:09.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56f33e700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5681580b0 con 0x7fb550004500 2021-11-12T05:41:09.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56f33e700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5680a97b0 con 0x7fb568157c30 2021-11-12T05:41:09.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56f33e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5680aaae0 con 0x7fb5680aba10 2021-11-12T05:41:09.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56d0da700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb550004500 0x7fb5680a9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:09.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56d0da700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb550004500 0x7fb5680a9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44386/0 (socket says 172.21.2.105:44386) 2021-11-12T05:41:09.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56d0da700 1 -- 172.21.2.105:0/1947069788 learned_addr learned my addr 172.21.2.105:0/1947069788 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:09.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56c8d9700 1 --2- 172.21.2.105:0/1947069788 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb568157c30 0x7fb5680ab520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:09.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56d0da700 1 -- 172.21.2.105:0/1947069788 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb5680aba10 msgr2=0x7fb5680a7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:09.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56d0da700 1 --2- 172.21.2.105:0/1947069788 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb5680aba10 0x7fb5680a7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:09.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56d0da700 1 -- 172.21.2.105:0/1947069788 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb568157c30 msgr2=0x7fb5680ab520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:09.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56d0da700 1 --2- 172.21.2.105:0/1947069788 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb568157c30 0x7fb5680ab520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:09.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56d0da700 1 -- 172.21.2.105:0/1947069788 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5680aad80 con 0x7fb550004500 2021-11-12T05:41:09.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56d0da700 1 --2- 172.21.2.105:0/1947069788 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb550004500 0x7fb5680a9d30 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7fb55c00b000 tx=0x7fb55c009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:09.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb55a7fc700 1 -- 172.21.2.105:0/1947069788 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb55c010640 con 0x7fb550004500 2021-11-12T05:41:09.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb55a7fc700 1 -- 172.21.2.105:0/1947069788 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55c0107a0 con 0x7fb550004500 2021-11-12T05:41:09.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb55a7fc700 1 -- 172.21.2.105:0/1947069788 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb55c010b00 con 0x7fb550004500 2021-11-12T05:41:09.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56f33e700 1 -- 172.21.2.105:0/1947069788 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5680a7510 con 0x7fb550004500 2021-11-12T05:41:09.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56f33e700 1 -- 172.21.2.105:0/1947069788 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5680a79c0 con 0x7fb550004500 2021-11-12T05:41:09.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56f33e700 1 -- 172.21.2.105:0/1947069788 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb568157950 con 0x7fb550004500 2021-11-12T05:41:09.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb55a7fc700 1 -- 172.21.2.105:0/1947069788 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb55c010c60 con 0x7fb550004500 2021-11-12T05:41:09.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb55a7fc700 1 --2- 172.21.2.105:0/1947069788 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb5480536f0 0x7fb548055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:09.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb55a7fc700 1 -- 172.21.2.105:0/1947069788 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fb55c06b970 con 0x7fb550004500 2021-11-12T05:41:09.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56c8d9700 1 --2- 172.21.2.105:0/1947069788 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb5480536f0 0x7fb548055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:09.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.226+0000 7fb56c8d9700 1 --2- 172.21.2.105:0/1947069788 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb5480536f0 0x7fb548055bb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fb56401a000 tx=0x7fb564019000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:09.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.230+0000 7fb55a7fc700 1 -- 172.21.2.105:0/1947069788 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb55c042920 con 0x7fb550004500 2021-11-12T05:41:09.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.342+0000 7fb56f33e700 1 -- 172.21.2.105:0/1947069788 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5680b1440 con 0x7fb550004500 2021-11-12T05:41:09.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.342+0000 7fb55a7fc700 1 -- 172.21.2.105:0/1947069788 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2136 (secure 0 0 0) 0x7fb55c045f40 con 0x7fb550004500 2021-11-12T05:41:09.344 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:41:09.344 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4429,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/4118304786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":4118304786},{"type":"v1","addr":"172.21.2.115:6833","nonce":4118304786}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:41:07.250137+0000","modified":"2021-11-12T05:41:08.255185+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4908},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4908":{"gid":4908,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/2626499955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":2626499955},{"type":"v1","addr":"172.21.2.105:6835","nonce":2626499955}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-11-12T05:41:09.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.342+0000 7fb56f33e700 1 -- 172.21.2.105:0/1947069788 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb5480536f0 msgr2=0x7fb548055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:09.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.342+0000 7fb56f33e700 1 --2- 172.21.2.105:0/1947069788 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb5480536f0 0x7fb548055bb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fb56401a000 tx=0x7fb564019000).stop 2021-11-12T05:41:09.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.342+0000 7fb56f33e700 1 -- 172.21.2.105:0/1947069788 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb550004500 msgr2=0x7fb5680a9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:09.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.342+0000 7fb56f33e700 1 --2- 172.21.2.105:0/1947069788 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb550004500 0x7fb5680a9d30 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7fb55c00b000 tx=0x7fb55c009040).stop 2021-11-12T05:41:09.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.342+0000 7fb56f33e700 1 -- 172.21.2.105:0/1947069788 shutdown_connections 2021-11-12T05:41:09.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.342+0000 7fb56f33e700 1 --2- 172.21.2.105:0/1947069788 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb5480536f0 0x7fb548055bb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:09.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.342+0000 7fb56f33e700 1 --2- 172.21.2.105:0/1947069788 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb5680aba10 0x7fb5680a7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:09.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.342+0000 7fb56f33e700 1 --2- 172.21.2.105:0/1947069788 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb568157c30 0x7fb5680ab520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:09.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.342+0000 7fb56f33e700 1 --2- 172.21.2.105:0/1947069788 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb550004500 0x7fb5680a9d30 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:09.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.342+0000 7fb56f33e700 1 -- 172.21.2.105:0/1947069788 >> 172.21.2.105:0/1947069788 conn(0x7fb5680b5370 msgr2=0x7fb5680b49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:09.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.342+0000 7fb56f33e700 1 -- 172.21.2.105:0/1947069788 shutdown_connections 2021-11-12T05:41:09.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.342+0000 7fb56f33e700 1 -- 172.21.2.105:0/1947069788 wait complete. 2021-11-12T05:41:09.349 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 10 2021-11-12T05:41:09.553 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:41:07.250137+0000', 'modified': '2021-11-12T05:41:08.255185+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4908}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4908': {'gid': 4908, 'name': 'a', 'rank': 0, 'incarnation': 9, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/2626499955', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 2626499955}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 2626499955}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:41:09.554 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:41:09.554 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:41:09.618 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":4908,"want_state":"up:active","state":"up:active","rank_uptime":2.36089554,"mdsmap_epoch":10,"osdmap_epoch":35,"osdmap_epoch_barrier":34,"uptime":7.5225515789999999} 2021-11-12T05:41:09.619 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 4908, "mdsmap_epoch": 10, "osdmap_epoch": 35, "osdmap_epoch_barrier": 34, "rank_uptime": 2.36089554, "state": "up:active", "uptime": 7.522551579, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:41:09.620 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:41:09.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.666+0000 7fe21340e700 1 Processor -- start 2021-11-12T05:41:09.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.666+0000 7fe21340e700 1 -- start start 2021-11-12T05:41:09.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.666+0000 7fe21340e700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe20c0b2940 0x7fe20c142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:09.673 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.666+0000 7fe21340e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe20c0b0cc0 0x7fe20c05f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:09.673 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.666+0000 7fe21340e700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe20c0b2d20 con 0x7fe20c0b0780 2021-11-12T05:41:09.673 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.666+0000 7fe21340e700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe20c0b1fc0 con 0x7fe20c0b2940 2021-11-12T05:41:09.673 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.666+0000 7fe21340e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c0b15e0 con 0x7fe20c0b0cc0 2021-11-12T05:41:09.674 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.666+0000 7fe2111aa700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe20c0b2940 0x7fe20c142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:09.674 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.666+0000 7fe2111aa700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe20c0b2940 0x7fe20c142dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44394/0 (socket says 172.21.2.105:44394) 2021-11-12T05:41:09.674 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.666+0000 7fe2111aa700 1 -- 172.21.2.105:0/487287445 learned_addr learned my addr 172.21.2.105:0/487287445 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:09.674 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.670+0000 7fe2111aa700 1 -- 172.21.2.105:0/487287445 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe20c0b0cc0 msgr2=0x7fe20c05f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:09.675 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.670+0000 7fe2111aa700 1 --2- 172.21.2.105:0/487287445 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe20c0b0cc0 0x7fe20c05f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:09.675 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.670+0000 7fe2111aa700 1 -- 172.21.2.105:0/487287445 >> v1:172.21.2.115:6789/0 conn(0x7fe20c0b0780 legacy=0x7fe20c1432b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:09.675 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.670+0000 7fe2111aa700 1 -- 172.21.2.105:0/487287445 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe20c0b1880 con 0x7fe20c0b2940 2021-11-12T05:41:09.675 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.670+0000 7fe2111aa700 1 --2- 172.21.2.105:0/487287445 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe20c0b2940 0x7fe20c142dc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7fe20c0b2f60 tx=0x7fe200006eb0).ready entity=mon.0 client_cookie=2e59ad59c9a1dcdc server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:09.675 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.670+0000 7fe20bfff700 1 -- 172.21.2.105:0/487287445 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe20000d570 con 0x7fe20c0b2940 2021-11-12T05:41:09.676 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.670+0000 7fe20bfff700 1 -- 172.21.2.105:0/487287445 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe200000e90 con 0x7fe20c0b2940 2021-11-12T05:41:09.676 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.670+0000 7fe20bfff700 1 -- 172.21.2.105:0/487287445 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe20000d8c0 con 0x7fe20c0b2940 2021-11-12T05:41:09.676 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.670+0000 7fe21340e700 1 -- 172.21.2.105:0/487287445 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe20c0b2940 msgr2=0x7fe20c142dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:09.676 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.670+0000 7fe21340e700 1 --2- 172.21.2.105:0/487287445 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe20c0b2940 0x7fe20c142dc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7fe20c0b2f60 tx=0x7fe200006eb0).stop 2021-11-12T05:41:09.677 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.670+0000 7fe21340e700 1 -- 172.21.2.105:0/487287445 shutdown_connections 2021-11-12T05:41:09.677 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.670+0000 7fe21340e700 1 --2- 172.21.2.105:0/487287445 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe20c0b0cc0 0x7fe20c05f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:09.677 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.670+0000 7fe21340e700 1 --2- 172.21.2.105:0/487287445 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe20c0b2940 0x7fe20c142dc0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:09.677 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.670+0000 7fe21340e700 1 -- 172.21.2.105:0/487287445 >> 172.21.2.105:0/487287445 conn(0x7fe20c068440 msgr2=0x7fe20c062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:09.677 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.670+0000 7fe21340e700 1 -- 172.21.2.105:0/487287445 shutdown_connections 2021-11-12T05:41:09.678 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.670+0000 7fe21340e700 1 -- 172.21.2.105:0/487287445 wait complete. 2021-11-12T05:41:09.681 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.670+0000 7fe21340e700 1 Processor -- start 2021-11-12T05:41:09.681 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.670+0000 7fe21340e700 1 -- start start 2021-11-12T05:41:09.682 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.670+0000 7fe21340e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe20c0b0780 0x7fe20c0662b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:09.682 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.670+0000 7fe21340e700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe20c0b0cc0 0x7fe20c140d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:09.682 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.670+0000 7fe21340e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe20c0b2940 0x7fe20c143f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:09.682 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.670+0000 7fe21340e700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c142c70 con 0x7fe20c0b2940 2021-11-12T05:41:09.682 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.670+0000 7fe21340e700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c1424d0 con 0x7fe20c0b0cc0 2021-11-12T05:41:09.683 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.670+0000 7fe21340e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c142770 con 0x7fe20c0b0780 2021-11-12T05:41:09.683 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.670+0000 7fe2119ab700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe20c0b2940 0x7fe20c143f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:09.683 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.670+0000 7fe2119ab700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe20c0b2940 0x7fe20c143f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44404/0 (socket says 172.21.2.105:44404) 2021-11-12T05:41:09.683 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.670+0000 7fe2119ab700 1 -- 172.21.2.105:0/793729054 learned_addr learned my addr 172.21.2.105:0/793729054 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:09.684 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.670+0000 7fe2119ab700 1 -- 172.21.2.105:0/793729054 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe20c0b0780 msgr2=0x7fe20c0662b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:09.684 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.670+0000 7fe2119ab700 1 --2- 172.21.2.105:0/793729054 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe20c0b0780 0x7fe20c0662b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:09.684 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.670+0000 7fe2119ab700 1 -- 172.21.2.105:0/793729054 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe20c0b0cc0 msgr2=0x7fe20c140d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:09.684 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.670+0000 7fe2119ab700 1 --2- 172.21.2.105:0/793729054 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe20c0b0cc0 0x7fe20c140d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:09.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.670+0000 7fe2119ab700 1 -- 172.21.2.105:0/793729054 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe20000b1e0 con 0x7fe20c0b2940 2021-11-12T05:41:09.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.670+0000 7fe2119ab700 1 --2- 172.21.2.105:0/793729054 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe20c0b2940 0x7fe20c143f70 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7fe2040032f0 tx=0x7fe204009220).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:09.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.670+0000 7fe20a7fc700 1 -- 172.21.2.105:0/793729054 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe20400d580 con 0x7fe20c0b2940 2021-11-12T05:41:09.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.670+0000 7fe20a7fc700 1 -- 172.21.2.105:0/793729054 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe20400d6e0 con 0x7fe20c0b2940 2021-11-12T05:41:09.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.670+0000 7fe20a7fc700 1 -- 172.21.2.105:0/793729054 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe20400da40 con 0x7fe20c0b2940 2021-11-12T05:41:09.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.670+0000 7fe21340e700 1 -- 172.21.2.105:0/793729054 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe20c141f30 con 0x7fe20c0b2940 2021-11-12T05:41:09.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.670+0000 7fe21340e700 1 -- 172.21.2.105:0/793729054 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe20c145990 con 0x7fe20c0b2940 2021-11-12T05:41:09.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.674+0000 7fe21340e700 1 -- 172.21.2.105:0/793729054 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe20c142930 con 0x7fe20c0b2940 2021-11-12T05:41:09.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.674+0000 7fe20a7fc700 1 -- 172.21.2.105:0/793729054 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe20400dba0 con 0x7fe20c0b2940 2021-11-12T05:41:09.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.674+0000 7fe20a7fc700 1 --2- 172.21.2.105:0/793729054 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe1ec053660 0x7fe1ec055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:09.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.674+0000 7fe20a7fc700 1 -- 172.21.2.105:0/793729054 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fe20406bf50 con 0x7fe20c0b2940 2021-11-12T05:41:09.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.674+0000 7fe2111aa700 1 --2- 172.21.2.105:0/793729054 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe1ec053660 0x7fe1ec055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:09.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.674+0000 7fe2111aa700 1 --2- 172.21.2.105:0/793729054 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe1ec053660 0x7fe1ec055b20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fe20c0b2f60 tx=0x7fe200015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:09.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.674+0000 7fe20a7fc700 1 -- 172.21.2.105:0/793729054 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe204042e50 con 0x7fe20c0b2940 2021-11-12T05:41:09.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.758+0000 7fe21340e700 1 -- 172.21.2.105:0/793729054 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe20c1420c0 con 0x7fe20c0b2940 2021-11-12T05:41:09.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.758+0000 7fe20a7fc700 1 -- 172.21.2.105:0/793729054 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16271 (secure 0 0 0) 0x7fe204046470 con 0x7fe20c0b2940 2021-11-12T05:41:09.762 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:41:09.762 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":35,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:41:09.267002+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:41:05.236029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2021-11-12T05:41:06.227573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:41:09.764 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.758+0000 7fe21340e700 1 -- 172.21.2.105:0/793729054 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe1ec053660 msgr2=0x7fe1ec055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:09.764 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.758+0000 7fe21340e700 1 --2- 172.21.2.105:0/793729054 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe1ec053660 0x7fe1ec055b20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fe20c0b2f60 tx=0x7fe200015000).stop 2021-11-12T05:41:09.764 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.758+0000 7fe21340e700 1 -- 172.21.2.105:0/793729054 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe20c0b2940 msgr2=0x7fe20c143f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:09.764 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.758+0000 7fe21340e700 1 --2- 172.21.2.105:0/793729054 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe20c0b2940 0x7fe20c143f70 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7fe2040032f0 tx=0x7fe204009220).stop 2021-11-12T05:41:09.765 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.758+0000 7fe21340e700 1 -- 172.21.2.105:0/793729054 shutdown_connections 2021-11-12T05:41:09.765 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.758+0000 7fe21340e700 1 --2- 172.21.2.105:0/793729054 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe1ec053660 0x7fe1ec055b20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:09.765 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.758+0000 7fe21340e700 1 --2- 172.21.2.105:0/793729054 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe20c0b2940 0x7fe20c143f70 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:09.765 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.758+0000 7fe21340e700 1 --2- 172.21.2.105:0/793729054 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe20c0b0cc0 0x7fe20c140d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:09.766 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.758+0000 7fe21340e700 1 --2- 172.21.2.105:0/793729054 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe20c0b0780 0x7fe20c0662b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:09.766 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.758+0000 7fe21340e700 1 -- 172.21.2.105:0/793729054 >> 172.21.2.105:0/793729054 conn(0x7fe20c068440 msgr2=0x7fe20c0b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:09.766 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.758+0000 7fe21340e700 1 -- 172.21.2.105:0/793729054 shutdown_connections 2021-11-12T05:41:09.766 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.762+0000 7fe21340e700 1 -- 172.21.2.105:0/793729054 wait complete. 2021-11-12T05:41:09.769 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-12T05:41:05.236029+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2021-11-12T05:41:06.227573+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-12T05:41:09.770 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:41:09.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.818+0000 7f2a63f0f700 1 Processor -- start 2021-11-12T05:41:09.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.818+0000 7f2a63f0f700 1 -- start start 2021-11-12T05:41:09.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a63f0f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2a5c0aca40 0x7f2a5c0ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:09.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a63f0f700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f2a5c0b0520 0x7f2a5c1473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:09.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a63f0f700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f2a5c1478b0 0x7f2a5c144180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:09.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a63f0f700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a5c147d40 con 0x7f2a5c1478b0 2021-11-12T05:41:09.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a63f0f700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a5c0b1840 con 0x7f2a5c0b0520 2021-11-12T05:41:09.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a63f0f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c0af2b0 con 0x7f2a5c0aca40 2021-11-12T05:41:09.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a624ac700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f2a5c1478b0 0x7f2a5c144180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:09.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a624ac700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f2a5c1478b0 0x7f2a5c144180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44412/0 (socket says 172.21.2.105:44412) 2021-11-12T05:41:09.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a624ac700 1 -- 172.21.2.105:0/1006408652 learned_addr learned my addr 172.21.2.105:0/1006408652 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:09.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a624ac700 1 -- 172.21.2.105:0/1006408652 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2a5c0aca40 msgr2=0x7f2a5c0ace20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:41:09.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a624ac700 1 --2- 172.21.2.105:0/1006408652 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2a5c0aca40 0x7f2a5c0ace20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:09.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a624ac700 1 -- 172.21.2.105:0/1006408652 >> v2:172.21.2.115:3300/0 conn(0x7f2a5c0b0520 msgr2=0x7f2a5c1473c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:41:09.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a624ac700 1 --2- 172.21.2.105:0/1006408652 >> v2:172.21.2.115:3300/0 conn(0x7f2a5c0b0520 0x7f2a5c1473c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:09.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a624ac700 1 -- 172.21.2.105:0/1006408652 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a5c0b09a0 con 0x7f2a5c1478b0 2021-11-12T05:41:09.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a624ac700 1 --2- 172.21.2.105:0/1006408652 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2a5c1478b0 0x7f2a5c144180 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f2a540032f0 tx=0x7f2a54009290).ready entity=mon.0 client_cookie=a362c526457223c4 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:09.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a60ca9700 1 -- 172.21.2.105:0/1006408652 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a5400b870 con 0x7f2a5c1478b0 2021-11-12T05:41:09.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a60ca9700 1 -- 172.21.2.105:0/1006408652 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5400b9d0 con 0x7f2a5c1478b0 2021-11-12T05:41:09.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a60ca9700 1 -- 172.21.2.105:0/1006408652 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a5400bb80 con 0x7f2a5c1478b0 2021-11-12T05:41:09.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a63f0f700 1 -- 172.21.2.105:0/1006408652 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2a5c1478b0 msgr2=0x7f2a5c144180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:09.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a63f0f700 1 --2- 172.21.2.105:0/1006408652 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2a5c1478b0 0x7f2a5c144180 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f2a540032f0 tx=0x7f2a54009290).stop 2021-11-12T05:41:09.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a63f0f700 1 -- 172.21.2.105:0/1006408652 shutdown_connections 2021-11-12T05:41:09.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a63f0f700 1 --2- 172.21.2.105:0/1006408652 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2a5c1478b0 0x7f2a5c144180 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:09.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a63f0f700 1 --2- 172.21.2.105:0/1006408652 >> v2:172.21.2.115:3300/0 conn(0x7f2a5c0b0520 0x7f2a5c1473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:09.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a63f0f700 1 --2- 172.21.2.105:0/1006408652 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2a5c0aca40 0x7f2a5c0ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:09.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a63f0f700 1 -- 172.21.2.105:0/1006408652 >> 172.21.2.105:0/1006408652 conn(0x7f2a5c05c490 msgr2=0x7f2a5c0b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:09.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a63f0f700 1 -- 172.21.2.105:0/1006408652 shutdown_connections 2021-11-12T05:41:09.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a63f0f700 1 -- 172.21.2.105:0/1006408652 wait complete. 2021-11-12T05:41:09.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a63f0f700 1 Processor -- start 2021-11-12T05:41:09.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a63f0f700 1 -- start start 2021-11-12T05:41:09.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a63f0f700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2a5c0aca40 0x7f2a5c065ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:09.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a63f0f700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2a5c0b0520 0x7f2a5c0a7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:09.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a63f0f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2a5c1478b0 0x7f2a5c0a7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:09.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a63f0f700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c1577d0 con 0x7f2a5c0b0520 2021-11-12T05:41:09.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a63f0f700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c157290 con 0x7f2a5c0aca40 2021-11-12T05:41:09.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a63f0f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c157530 con 0x7f2a5c1478b0 2021-11-12T05:41:09.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a614aa700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2a5c0b0520 0x7f2a5c0a7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:09.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a614aa700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2a5c0b0520 0x7f2a5c0a7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44414/0 (socket says 172.21.2.105:44414) 2021-11-12T05:41:09.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a614aa700 1 -- 172.21.2.105:0/522092856 learned_addr learned my addr 172.21.2.105:0/522092856 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:09.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a614aa700 1 -- 172.21.2.105:0/522092856 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2a5c1478b0 msgr2=0x7f2a5c0a7850 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:41:09.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a614aa700 1 --2- 172.21.2.105:0/522092856 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2a5c1478b0 0x7f2a5c0a7850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:09.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a614aa700 1 -- 172.21.2.105:0/522092856 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2a5c0aca40 msgr2=0x7f2a5c065ca0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:41:09.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a614aa700 1 --2- 172.21.2.105:0/522092856 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2a5c0aca40 0x7f2a5c065ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:09.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.822+0000 7f2a614aa700 1 -- 172.21.2.105:0/522092856 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a54009530 con 0x7f2a5c0b0520 2021-11-12T05:41:09.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.826+0000 7f2a614aa700 1 --2- 172.21.2.105:0/522092856 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2a5c0b0520 0x7f2a5c0a7360 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f2a58002fb0 tx=0x7f2a58006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:09.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.826+0000 7f2a4effd700 1 -- 172.21.2.105:0/522092856 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a58009e00 con 0x7f2a5c0b0520 2021-11-12T05:41:09.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.826+0000 7f2a4effd700 1 -- 172.21.2.105:0/522092856 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a58013460 con 0x7f2a5c0b0520 2021-11-12T05:41:09.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.826+0000 7f2a63f0f700 1 -- 172.21.2.105:0/522092856 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a5c0b48a0 con 0x7f2a5c0b0520 2021-11-12T05:41:09.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.826+0000 7f2a63f0f700 1 -- 172.21.2.105:0/522092856 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a5c066d70 con 0x7f2a5c0b0520 2021-11-12T05:41:09.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.826+0000 7f2a4effd700 1 -- 172.21.2.105:0/522092856 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a580137c0 con 0x7f2a5c0b0520 2021-11-12T05:41:09.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.826+0000 7f2a63f0f700 1 -- 172.21.2.105:0/522092856 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a5c057350 con 0x7f2a5c0b0520 2021-11-12T05:41:09.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.826+0000 7f2a4effd700 1 -- 172.21.2.105:0/522092856 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2a5800f070 con 0x7f2a5c0b0520 2021-11-12T05:41:09.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.826+0000 7f2a4effd700 1 --2- 172.21.2.105:0/522092856 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2a440536f0 0x7f2a44055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:09.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.826+0000 7f2a4effd700 1 -- 172.21.2.105:0/522092856 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f2a5806b560 con 0x7f2a5c0b0520 2021-11-12T05:41:09.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.826+0000 7f2a61cab700 1 --2- 172.21.2.105:0/522092856 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2a440536f0 0x7f2a44055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:09.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.826+0000 7f2a61cab700 1 --2- 172.21.2.105:0/522092856 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2a440536f0 0x7f2a44055bb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f2a50002fb0 tx=0x7f2a50006930).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:09.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.826+0000 7f2a4effd700 1 -- 172.21.2.105:0/522092856 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2a58042460 con 0x7f2a5c0b0520 2021-11-12T05:41:09.913 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.910+0000 7f2a63f0f700 1 -- 172.21.2.105:0/522092856 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f2a5c06a280 con 0x7f2a5c0b0520 2021-11-12T05:41:09.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.910+0000 7f2a4effd700 1 -- 172.21.2.105:0/522092856 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v35) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2a58045a80 con 0x7f2a5c0b0520 2021-11-12T05:41:09.914 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:41:09.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.914+0000 7f2a63f0f700 1 -- 172.21.2.105:0/522092856 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2a440536f0 msgr2=0x7f2a44055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:09.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.914+0000 7f2a63f0f700 1 --2- 172.21.2.105:0/522092856 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2a440536f0 0x7f2a44055bb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f2a50002fb0 tx=0x7f2a50006930).stop 2021-11-12T05:41:09.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.914+0000 7f2a63f0f700 1 -- 172.21.2.105:0/522092856 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2a5c0b0520 msgr2=0x7f2a5c0a7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:09.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.914+0000 7f2a63f0f700 1 --2- 172.21.2.105:0/522092856 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2a5c0b0520 0x7f2a5c0a7360 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f2a58002fb0 tx=0x7f2a58006df0).stop 2021-11-12T05:41:09.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.914+0000 7f2a63f0f700 1 -- 172.21.2.105:0/522092856 shutdown_connections 2021-11-12T05:41:09.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.914+0000 7f2a63f0f700 1 --2- 172.21.2.105:0/522092856 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2a440536f0 0x7f2a44055bb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:09.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.914+0000 7f2a63f0f700 1 --2- 172.21.2.105:0/522092856 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2a5c1478b0 0x7f2a5c0a7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:09.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.914+0000 7f2a63f0f700 1 --2- 172.21.2.105:0/522092856 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2a5c0b0520 0x7f2a5c0a7360 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:09.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.914+0000 7f2a63f0f700 1 --2- 172.21.2.105:0/522092856 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2a5c0aca40 0x7f2a5c065ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:09.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.914+0000 7f2a63f0f700 1 -- 172.21.2.105:0/522092856 >> 172.21.2.105:0/522092856 conn(0x7f2a5c05c490 msgr2=0x7f2a5c0b1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:09.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.914+0000 7f2a63f0f700 1 -- 172.21.2.105:0/522092856 shutdown_connections 2021-11-12T05:41:09.918 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.914+0000 7f2a63f0f700 1 -- 172.21.2.105:0/522092856 wait complete. 2021-11-12T05:41:09.921 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:41:09.975 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.970+0000 7f7df8466700 1 Processor -- start 2021-11-12T05:41:09.975 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.970+0000 7f7df8466700 1 -- start start 2021-11-12T05:41:09.975 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df8466700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7df00b1720 0x7f7df0066d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:09.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df8466700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7df00af6c0 con 0x7f7df0060530 2021-11-12T05:41:09.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df8466700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7df00af180 con 0x7f7df0143620 2021-11-12T05:41:09.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df8466700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df0143ab0 con 0x7f7df00b1720 2021-11-12T05:41:09.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df6202700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f7df0060530 0x7f7df0066620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:54818/0 (socket says 172.21.2.105:54818) 2021-11-12T05:41:09.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df6202700 1 -- 172.21.2.105:0/2977018674 learned_addr learned my addr 172.21.2.105:0/2977018674 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:41:09.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df5200700 1 -- 172.21.2.105:0/2977018674 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 148063720 0 0) 0x7f7df00af6c0 con 0x7f7df0060530 2021-11-12T05:41:09.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df5200700 1 -- 172.21.2.105:0/2977018674 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dd8003260 con 0x7f7df0060530 2021-11-12T05:41:09.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df5a01700 1 --2- 172.21.2.105:0/2977018674 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7df00b1720 0x7f7df0066d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:09.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df5200700 1 -- 172.21.2.105:0/2977018674 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2509066926 0 0) 0x7f7dd8003260 con 0x7f7df0060530 2021-11-12T05:41:09.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df5200700 1 -- 172.21.2.105:0/2977018674 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7df00b1720 msgr2=0x7f7df0066d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:09.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df5200700 1 --2- 172.21.2.105:0/2977018674 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7df00b1720 0x7f7df0066d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:09.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df5200700 1 -- 172.21.2.105:0/2977018674 >> v1:172.21.2.115:6789/0 conn(0x7f7df0143620 legacy=0x7f7df005fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:09.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df5200700 1 -- 172.21.2.105:0/2977018674 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df00af420 con 0x7f7df0060530 2021-11-12T05:41:09.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df5200700 1 -- 172.21.2.105:0/2977018674 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f7de4001660 con 0x7f7df0060530 2021-11-12T05:41:09.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df5200700 1 -- 172.21.2.105:0/2977018674 >> v1:172.21.2.105:6789/0 conn(0x7f7df0060530 legacy=0x7f7df0066620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:09.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df5200700 1 --2- 172.21.2.105:0/2977018674 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7dd8003800 0x7f7dd8003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:09.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df5200700 1 --2- 172.21.2.105:0/2977018674 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7dd8004500 0x7f7dd8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:09.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df5200700 1 --2- 172.21.2.105:0/2977018674 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7df00b1720 0x7f7dd8004fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:09.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df5200700 1 -- 172.21.2.105:0/2977018674 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df0143ab0 con 0x7f7dd8003800 2021-11-12T05:41:09.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df5200700 1 -- 172.21.2.105:0/2977018674 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd800b910 con 0x7f7dd8004500 2021-11-12T05:41:09.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df5200700 1 -- 172.21.2.105:0/2977018674 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd800bad0 con 0x7f7df00b1720 2021-11-12T05:41:09.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df6202700 1 --2- 172.21.2.105:0/2977018674 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7dd8003800 0x7f7dd8003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:09.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df5a01700 1 --2- 172.21.2.105:0/2977018674 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7dd8004500 0x7f7dd8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:09.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df6a03700 1 --2- 172.21.2.105:0/2977018674 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7df00b1720 0x7f7dd8004fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:09.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df6202700 1 -- 172.21.2.105:0/2977018674 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7df00b1720 msgr2=0x7f7dd8004fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:09.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df6202700 1 --2- 172.21.2.105:0/2977018674 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7df00b1720 0x7f7dd8004fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:09.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df6202700 1 -- 172.21.2.105:0/2977018674 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7dd8004500 msgr2=0x7f7dd8004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:09.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df6202700 1 --2- 172.21.2.105:0/2977018674 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7dd8004500 0x7f7dd8004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:09.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df6202700 1 -- 172.21.2.105:0/2977018674 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd8003260 con 0x7f7dd8003800 2021-11-12T05:41:09.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df6a03700 1 --2- 172.21.2.105:0/2977018674 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7df00b1720 0x7f7dd8004fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:41:09.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df6202700 1 --2- 172.21.2.105:0/2977018674 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7dd8003800 0x7f7dd8003c20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f7de4001370 tx=0x7f7df00ae2e0).ready entity=mon.0 client_cookie=dd55945f45ad35a1 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:09.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df5200700 1 -- 172.21.2.105:0/2977018674 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7de40072c0 con 0x7f7dd8003800 2021-11-12T05:41:09.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df5200700 1 -- 172.21.2.105:0/2977018674 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de4007420 con 0x7f7dd8003800 2021-11-12T05:41:09.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df5200700 1 -- 172.21.2.105:0/2977018674 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7de400cae0 con 0x7f7dd8003800 2021-11-12T05:41:09.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df8466700 1 -- 172.21.2.105:0/2977018674 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7dd8003800 msgr2=0x7f7dd8003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:09.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df8466700 1 --2- 172.21.2.105:0/2977018674 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7dd8003800 0x7f7dd8003c20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f7de4001370 tx=0x7f7df00ae2e0).stop 2021-11-12T05:41:09.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df6a03700 1 -- 172.21.2.105:0/2977018674 reap_dead start 2021-11-12T05:41:09.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df8466700 1 -- 172.21.2.105:0/2977018674 shutdown_connections 2021-11-12T05:41:09.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df8466700 1 -- 172.21.2.105:0/2977018674 >> 172.21.2.105:0/2977018674 conn(0x7f7df005c490 msgr2=0x7f7df00b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:09.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df8466700 1 -- 172.21.2.105:0/2977018674 shutdown_connections 2021-11-12T05:41:09.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df8466700 1 -- 172.21.2.105:0/2977018674 wait complete. 2021-11-12T05:41:09.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df8466700 1 Processor -- start 2021-11-12T05:41:09.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df8466700 1 -- start start 2021-11-12T05:41:09.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df8466700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7dd8003800 0x7f7df013cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:09.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df8466700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7df0065000 0x7f7df014e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:09.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df8466700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7df0151da0 0x7f7df0152220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:09.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df8466700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df0152710 con 0x7f7df0065000 2021-11-12T05:41:09.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df8466700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df00a08d0 con 0x7f7df0151da0 2021-11-12T05:41:09.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df8466700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df00a03c0 con 0x7f7dd8003800 2021-11-12T05:41:09.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df5a01700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7df0065000 0x7f7df014e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:09.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df5a01700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7df0065000 0x7f7df014e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44434/0 (socket says 172.21.2.105:44434) 2021-11-12T05:41:09.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df5a01700 1 -- 172.21.2.105:0/1460096989 learned_addr learned my addr 172.21.2.105:0/1460096989 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:09.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df6a03700 1 --2- 172.21.2.105:0/1460096989 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7df0151da0 0x7f7df0152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:09.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df6202700 1 --2- 172.21.2.105:0/1460096989 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7dd8003800 0x7f7df013cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:09.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df5a01700 1 -- 172.21.2.105:0/1460096989 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7dd8003800 msgr2=0x7f7df013cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:09.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df5a01700 1 --2- 172.21.2.105:0/1460096989 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7dd8003800 0x7f7df013cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:09.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df5a01700 1 -- 172.21.2.105:0/1460096989 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7df0151da0 msgr2=0x7f7df0152220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:09.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df5a01700 1 --2- 172.21.2.105:0/1460096989 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7df0151da0 0x7f7df0152220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:09.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.974+0000 7f7df5a01700 1 -- 172.21.2.105:0/1460096989 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df00a0630 con 0x7f7df0065000 2021-11-12T05:41:09.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.978+0000 7f7df5a01700 1 --2- 172.21.2.105:0/1460096989 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7df0065000 0x7f7df014e200 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f7df00a0550 tx=0x7f7dec008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:09.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.978+0000 7f7de37fe700 1 -- 172.21.2.105:0/1460096989 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7dec013800 con 0x7f7df0065000 2021-11-12T05:41:09.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.978+0000 7f7de37fe700 1 -- 172.21.2.105:0/1460096989 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dec000e90 con 0x7f7df0065000 2021-11-12T05:41:09.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.978+0000 7f7df8466700 1 -- 172.21.2.105:0/1460096989 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7df0151900 con 0x7f7df0065000 2021-11-12T05:41:09.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.978+0000 7f7de37fe700 1 -- 172.21.2.105:0/1460096989 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7dec013b50 con 0x7f7df0065000 2021-11-12T05:41:09.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.978+0000 7f7df8466700 1 -- 172.21.2.105:0/1460096989 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7df014e6f0 con 0x7f7df0065000 2021-11-12T05:41:09.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.978+0000 7f7df8466700 1 -- 172.21.2.105:0/1460096989 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7df0151a90 con 0x7f7df0065000 2021-11-12T05:41:09.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.978+0000 7f7de37fe700 1 -- 172.21.2.105:0/1460096989 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7dec013cb0 con 0x7f7df0065000 2021-11-12T05:41:09.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.978+0000 7f7de37fe700 1 --2- 172.21.2.105:0/1460096989 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7dd00536d0 0x7f7dd0055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:09.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.978+0000 7f7de37fe700 1 -- 172.21.2.105:0/1460096989 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f7dec06bbd0 con 0x7f7df0065000 2021-11-12T05:41:09.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.978+0000 7f7df6202700 1 --2- 172.21.2.105:0/1460096989 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7dd00536d0 0x7f7dd0055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:09.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.978+0000 7f7df6202700 1 --2- 172.21.2.105:0/1460096989 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7dd00536d0 0x7f7dd0055b90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f7de401c000 tx=0x7f7de4017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:09.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:09.978+0000 7f7de37fe700 1 -- 172.21.2.105:0/1460096989 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7dec042be0 con 0x7f7df0065000 2021-11-12T05:41:10.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.062+0000 7f7df8466700 1 -- 172.21.2.105:0/1460096989 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7df0057350 con 0x7f7df0065000 2021-11-12T05:41:10.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.066+0000 7f7de37fe700 1 -- 172.21.2.105:0/1460096989 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v35) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7dec017070 con 0x7f7df0065000 2021-11-12T05:41:10.068 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:41:10.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.066+0000 7f7df8466700 1 -- 172.21.2.105:0/1460096989 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7dd00536d0 msgr2=0x7f7dd0055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:10.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.066+0000 7f7df8466700 1 --2- 172.21.2.105:0/1460096989 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7dd00536d0 0x7f7dd0055b90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f7de401c000 tx=0x7f7de4017000).stop 2021-11-12T05:41:10.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.066+0000 7f7df8466700 1 -- 172.21.2.105:0/1460096989 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7df0065000 msgr2=0x7f7df014e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:10.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.066+0000 7f7df8466700 1 --2- 172.21.2.105:0/1460096989 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7df0065000 0x7f7df014e200 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f7df00a0550 tx=0x7f7dec008040).stop 2021-11-12T05:41:10.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.066+0000 7f7df8466700 1 -- 172.21.2.105:0/1460096989 shutdown_connections 2021-11-12T05:41:10.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.066+0000 7f7df8466700 1 --2- 172.21.2.105:0/1460096989 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7dd00536d0 0x7f7dd0055b90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:10.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.066+0000 7f7df8466700 1 --2- 172.21.2.105:0/1460096989 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7df0151da0 0x7f7df0152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:10.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.066+0000 7f7df8466700 1 --2- 172.21.2.105:0/1460096989 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7df0065000 0x7f7df014e200 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:10.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.066+0000 7f7df8466700 1 --2- 172.21.2.105:0/1460096989 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7dd8003800 0x7f7df013cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:10.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.066+0000 7f7df8466700 1 -- 172.21.2.105:0/1460096989 >> 172.21.2.105:0/1460096989 conn(0x7f7df005c490 msgr2=0x7f7df00b52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:10.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.066+0000 7f7df8466700 1 -- 172.21.2.105:0/1460096989 shutdown_connections 2021-11-12T05:41:10.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.066+0000 7f7df8466700 1 -- 172.21.2.105:0/1460096989 wait complete. 2021-11-12T05:41:10.074 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-12T05:41:10.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.154+0000 7f94815a6700 1 Processor -- start 2021-11-12T05:41:10.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.154+0000 7f94815a6700 1 -- start start 2021-11-12T05:41:10.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.154+0000 7f94815a6700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f947c0626b0 0x7f947c062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:10.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.154+0000 7f94815a6700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f947c130a80 0x7f947c1474d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:10.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.154+0000 7f94815a6700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f947c0b0d50 con 0x7f947c0af750 2021-11-12T05:41:10.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.154+0000 7f94815a6700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f947c0ad380 con 0x7f947c130a80 2021-11-12T05:41:10.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.154+0000 7f94815a6700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f947c0ae190 con 0x7f947c0626b0 2021-11-12T05:41:10.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.154+0000 7f947b7fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f947c130a80 0x7f947c1474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:10.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.154+0000 7f947b7fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f947c130a80 0x7f947c1474d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44442/0 (socket says 172.21.2.105:44442) 2021-11-12T05:41:10.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.154+0000 7f947b7fe700 1 -- 172.21.2.105:0/1312589619 learned_addr learned my addr 172.21.2.105:0/1312589619 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:10.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.154+0000 7f947b7fe700 1 -- 172.21.2.105:0/1312589619 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f947c0626b0 msgr2=0x7f947c062a90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:41:10.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.154+0000 7f947b7fe700 1 --2- 172.21.2.105:0/1312589619 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f947c0626b0 0x7f947c062a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:10.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.154+0000 7f947b7fe700 1 -- 172.21.2.105:0/1312589619 >> v1:172.21.2.115:6789/0 conn(0x7f947c0af750 legacy=0x7f947c130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:10.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.154+0000 7f947b7fe700 1 -- 172.21.2.105:0/1312589619 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947c0ae2d0 con 0x7f947c130a80 2021-11-12T05:41:10.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.154+0000 7f947b7fe700 1 --2- 172.21.2.105:0/1312589619 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f947c130a80 0x7f947c1474d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f947c05d1b0 tx=0x7f9474009290).ready entity=mon.0 client_cookie=931dab6e354f7be4 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:10.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.154+0000 7f9479ffb700 1 -- 172.21.2.105:0/1312589619 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f947400b860 con 0x7f947c130a80 2021-11-12T05:41:10.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.154+0000 7f9479ffb700 1 -- 172.21.2.105:0/1312589619 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947400b9c0 con 0x7f947c130a80 2021-11-12T05:41:10.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.154+0000 7f9479ffb700 1 -- 172.21.2.105:0/1312589619 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f947400bb70 con 0x7f947c130a80 2021-11-12T05:41:10.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.154+0000 7f94815a6700 1 -- 172.21.2.105:0/1312589619 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f947c130a80 msgr2=0x7f947c1474d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:10.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.154+0000 7f94815a6700 1 --2- 172.21.2.105:0/1312589619 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f947c130a80 0x7f947c1474d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f947c05d1b0 tx=0x7f9474009290).stop 2021-11-12T05:41:10.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.154+0000 7f94815a6700 1 -- 172.21.2.105:0/1312589619 shutdown_connections 2021-11-12T05:41:10.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.154+0000 7f94815a6700 1 --2- 172.21.2.105:0/1312589619 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f947c130a80 0x7f947c1474d0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:10.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.154+0000 7f94815a6700 1 --2- 172.21.2.105:0/1312589619 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f947c0626b0 0x7f947c062a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:10.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.154+0000 7f94815a6700 1 -- 172.21.2.105:0/1312589619 >> 172.21.2.105:0/1312589619 conn(0x7f947c0b5320 msgr2=0x7f947c0b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:10.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.154+0000 7f94815a6700 1 -- 172.21.2.105:0/1312589619 shutdown_connections 2021-11-12T05:41:10.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.154+0000 7f94815a6700 1 -- 172.21.2.105:0/1312589619 wait complete. 2021-11-12T05:41:10.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.154+0000 7f94815a6700 1 Processor -- start 2021-11-12T05:41:10.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.154+0000 7f94815a6700 1 -- start start 2021-11-12T05:41:10.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.154+0000 7f94815a6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f947c0626b0 0x7f947c14aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:10.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.154+0000 7f94815a6700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f947c0af750 0x7f947c065920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:10.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.154+0000 7f94815a6700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f947c130a80 0x7f947c063200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:10.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.154+0000 7f94815a6700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947c062b30 con 0x7f947c0626b0 2021-11-12T05:41:10.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.154+0000 7f94815a6700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947c14b470 con 0x7f947c130a80 2021-11-12T05:41:10.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.154+0000 7f94815a6700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f947c131fb0 con 0x7f947c0af750 2021-11-12T05:41:10.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.154+0000 7f947affd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f947c0626b0 0x7f947c14aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:10.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.158+0000 7f947affd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f947c0626b0 0x7f947c14aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44448/0 (socket says 172.21.2.105:44448) 2021-11-12T05:41:10.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.158+0000 7f947affd700 1 -- 172.21.2.105:0/3142069800 learned_addr learned my addr 172.21.2.105:0/3142069800 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:10.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.158+0000 7f947affd700 1 -- 172.21.2.105:0/3142069800 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f947c0af750 msgr2=0x7f947c065920 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:41:10.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.158+0000 7f947affd700 1 --2- 172.21.2.105:0/3142069800 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f947c0af750 0x7f947c065920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:10.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.158+0000 7f947affd700 1 -- 172.21.2.105:0/3142069800 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f947c130a80 msgr2=0x7f947c063200 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:41:10.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.158+0000 7f947affd700 1 --2- 172.21.2.105:0/3142069800 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f947c130a80 0x7f947c063200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:10.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.158+0000 7f947affd700 1 -- 172.21.2.105:0/3142069800 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9474009530 con 0x7f947c0626b0 2021-11-12T05:41:10.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.158+0000 7f947affd700 1 --2- 172.21.2.105:0/3142069800 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f947c0626b0 0x7f947c14aca0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f946c002fb0 tx=0x7f946c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:10.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.158+0000 7f9473fff700 1 -- 172.21.2.105:0/3142069800 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f946c013460 con 0x7f947c0626b0 2021-11-12T05:41:10.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.158+0000 7f9473fff700 1 -- 172.21.2.105:0/3142069800 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f946c0135c0 con 0x7f947c0626b0 2021-11-12T05:41:10.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.158+0000 7f9473fff700 1 -- 172.21.2.105:0/3142069800 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f946c013920 con 0x7f947c0626b0 2021-11-12T05:41:10.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.158+0000 7f94815a6700 1 -- 172.21.2.105:0/3142069800 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f947c062d60 con 0x7f947c0626b0 2021-11-12T05:41:10.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.158+0000 7f94815a6700 1 -- 172.21.2.105:0/3142069800 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f947c064070 con 0x7f947c0626b0 2021-11-12T05:41:10.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.158+0000 7f94815a6700 1 -- 172.21.2.105:0/3142069800 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f947c062ef0 con 0x7f947c0626b0 2021-11-12T05:41:10.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.158+0000 7f9473fff700 1 -- 172.21.2.105:0/3142069800 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f946c00f070 con 0x7f947c0626b0 2021-11-12T05:41:10.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.158+0000 7f9473fff700 1 --2- 172.21.2.105:0/3142069800 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f94600535d0 0x7f9460055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:10.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.158+0000 7f9473fff700 1 -- 172.21.2.105:0/3142069800 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f946c06b600 con 0x7f947c0626b0 2021-11-12T05:41:10.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.158+0000 7f947a7fc700 1 --2- 172.21.2.105:0/3142069800 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f94600535d0 0x7f9460055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:10.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.158+0000 7f947a7fc700 1 --2- 172.21.2.105:0/3142069800 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f94600535d0 0x7f9460055a90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f9464002f90 tx=0x7f9464006930).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:10.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.162+0000 7f9473fff700 1 -- 172.21.2.105:0/3142069800 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f946c042500 con 0x7f947c0626b0 2021-11-12T05:41:10.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.242+0000 7f94815a6700 1 -- 172.21.2.105:0/3142069800 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f947c1479c0 con 0x7f947c0626b0 2021-11-12T05:41:10.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.242+0000 7f9473fff700 1 -- 172.21.2.105:0/3142069800 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+10 (secure 0 0 0) 0x7f946c045b20 con 0x7f947c0626b0 2021-11-12T05:41:10.246 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:41:10.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.246+0000 7f94815a6700 1 -- 172.21.2.105:0/3142069800 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f94600535d0 msgr2=0x7f9460055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:10.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.246+0000 7f94815a6700 1 --2- 172.21.2.105:0/3142069800 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f94600535d0 0x7f9460055a90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f9464002f90 tx=0x7f9464006930).stop 2021-11-12T05:41:10.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.246+0000 7f94815a6700 1 -- 172.21.2.105:0/3142069800 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f947c0626b0 msgr2=0x7f947c14aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:10.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.246+0000 7f94815a6700 1 --2- 172.21.2.105:0/3142069800 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f947c0626b0 0x7f947c14aca0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f946c002fb0 tx=0x7f946c006df0).stop 2021-11-12T05:41:10.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.246+0000 7f94815a6700 1 -- 172.21.2.105:0/3142069800 shutdown_connections 2021-11-12T05:41:10.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.246+0000 7f94815a6700 1 --2- 172.21.2.105:0/3142069800 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f94600535d0 0x7f9460055a90 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:10.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.246+0000 7f94815a6700 1 --2- 172.21.2.105:0/3142069800 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f947c130a80 0x7f947c063200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:10.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.246+0000 7f94815a6700 1 --2- 172.21.2.105:0/3142069800 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f947c0af750 0x7f947c065920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:10.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.246+0000 7f94815a6700 1 --2- 172.21.2.105:0/3142069800 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f947c0626b0 0x7f947c14aca0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:10.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.246+0000 7f94815a6700 1 -- 172.21.2.105:0/3142069800 >> 172.21.2.105:0/3142069800 conn(0x7f947c0b5320 msgr2=0x7f947c12ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:10.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.246+0000 7f94815a6700 1 -- 172.21.2.105:0/3142069800 shutdown_connections 2021-11-12T05:41:10.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.246+0000 7f94815a6700 1 -- 172.21.2.105:0/3142069800 wait complete. 2021-11-12T05:41:10.253 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-12T05:41:10.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.306+0000 7f358afeb700 1 Processor -- start 2021-11-12T05:41:10.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.306+0000 7f358afeb700 1 -- start start 2021-11-12T05:41:10.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.306+0000 7f358afeb700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f35840aca40 0x7f35840ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:10.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.306+0000 7f358afeb700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f3584144180 0x7f3584144610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:10.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.306+0000 7f358afeb700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35840b1840 con 0x7f35840b0520 2021-11-12T05:41:10.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.306+0000 7f358afeb700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35840af2b0 con 0x7f3584144180 2021-11-12T05:41:10.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.306+0000 7f358afeb700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35840b09a0 con 0x7f35840aca40 2021-11-12T05:41:10.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.306+0000 7f3583fff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f35840b0520 0x7f35841473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:54856/0 (socket says 172.21.2.105:54856) 2021-11-12T05:41:10.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.306+0000 7f3583fff700 1 -- 172.21.2.105:0/4235089885 learned_addr learned my addr 172.21.2.105:0/4235089885 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:41:10.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.306+0000 7f3589588700 1 --2- 172.21.2.105:0/4235089885 >> v2:172.21.2.105:3300/0 conn(0x7f3584144180 0x7f3584144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:10.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.306+0000 7f3589588700 1 -- 172.21.2.105:0/4235089885 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f35840aca40 msgr2=0x7f35840ace20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:41:10.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.306+0000 7f3589588700 1 --2- 172.21.2.105:0/4235089885 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f35840aca40 0x7f35840ace20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:10.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.306+0000 7f3589588700 1 -- 172.21.2.105:0/4235089885 >> v1:172.21.2.105:6789/0 conn(0x7f35840b0520 legacy=0x7f35841473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:10.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.306+0000 7f3589588700 1 -- 172.21.2.105:0/4235089885 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35840b1a70 con 0x7f3584144180 2021-11-12T05:41:10.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.306+0000 7f3589588700 1 --2- 172.21.2.105:0/4235089885 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3584144180 0x7f3584144610 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f357c0032f0 tx=0x7f357c0091d0).ready entity=mon.0 client_cookie=b6826a727e2e24ff server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:10.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.306+0000 7f35837fe700 1 -- 172.21.2.105:0/4235089885 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f357c009ea0 con 0x7f3584144180 2021-11-12T05:41:10.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.306+0000 7f35837fe700 1 -- 172.21.2.105:0/4235089885 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f357c00b8a0 con 0x7f3584144180 2021-11-12T05:41:10.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.306+0000 7f35837fe700 1 -- 172.21.2.105:0/4235089885 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f357c00ba50 con 0x7f3584144180 2021-11-12T05:41:10.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.306+0000 7f358afeb700 1 -- 172.21.2.105:0/4235089885 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3584144180 msgr2=0x7f3584144610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:10.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.306+0000 7f358afeb700 1 --2- 172.21.2.105:0/4235089885 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3584144180 0x7f3584144610 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f357c0032f0 tx=0x7f357c0091d0).stop 2021-11-12T05:41:10.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.306+0000 7f358afeb700 1 -- 172.21.2.105:0/4235089885 shutdown_connections 2021-11-12T05:41:10.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.306+0000 7f358afeb700 1 --2- 172.21.2.105:0/4235089885 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3584144180 0x7f3584144610 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:10.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.306+0000 7f358afeb700 1 --2- 172.21.2.105:0/4235089885 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f35840aca40 0x7f35840ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:10.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.306+0000 7f358afeb700 1 -- 172.21.2.105:0/4235089885 >> 172.21.2.105:0/4235089885 conn(0x7f358405c490 msgr2=0x7f35840b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:10.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.306+0000 7f358afeb700 1 -- 172.21.2.105:0/4235089885 shutdown_connections 2021-11-12T05:41:10.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.306+0000 7f358afeb700 1 -- 172.21.2.105:0/4235089885 wait complete. 2021-11-12T05:41:10.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.306+0000 7f358afeb700 1 Processor -- start 2021-11-12T05:41:10.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.306+0000 7f358afeb700 1 -- start start 2021-11-12T05:41:10.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.306+0000 7f358afeb700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f35840aca40 0x7f35840a82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:10.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.306+0000 7f358afeb700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f35840b0520 0x7f3584146f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:10.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.306+0000 7f358afeb700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3584144180 0x7f358415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:10.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.306+0000 7f358afeb700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35840a87d0 con 0x7f3584144180 2021-11-12T05:41:10.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.306+0000 7f358afeb700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3584159fb0 con 0x7f35840b0520 2021-11-12T05:41:10.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.306+0000 7f358afeb700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f358415a250 con 0x7f35840aca40 2021-11-12T05:41:10.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.306+0000 7f3589588700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3584144180 0x7f358415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:10.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.306+0000 7f3589588700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3584144180 0x7f358415a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44466/0 (socket says 172.21.2.105:44466) 2021-11-12T05:41:10.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.306+0000 7f3589588700 1 -- 172.21.2.105:0/124403577 learned_addr learned my addr 172.21.2.105:0/124403577 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:10.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.310+0000 7f3589588700 1 -- 172.21.2.105:0/124403577 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f35840aca40 msgr2=0x7f35840a82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:10.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.310+0000 7f3589588700 1 --2- 172.21.2.105:0/124403577 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f35840aca40 0x7f35840a82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:10.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.310+0000 7f3589588700 1 -- 172.21.2.105:0/124403577 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f35840b0520 msgr2=0x7f3584146f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:10.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.310+0000 7f3589588700 1 --2- 172.21.2.105:0/124403577 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f35840b0520 0x7f3584146f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:10.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.310+0000 7f3589588700 1 -- 172.21.2.105:0/124403577 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357c009470 con 0x7f3584144180 2021-11-12T05:41:10.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.310+0000 7f3589588700 1 --2- 172.21.2.105:0/124403577 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3584144180 0x7f358415a6f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f357c0032f0 tx=0x7f357c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:10.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.310+0000 7f3581ffb700 1 -- 172.21.2.105:0/124403577 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f357c009ea0 con 0x7f3584144180 2021-11-12T05:41:10.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.310+0000 7f3581ffb700 1 -- 172.21.2.105:0/124403577 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f357c0107a0 con 0x7f3584144180 2021-11-12T05:41:10.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.310+0000 7f3581ffb700 1 -- 172.21.2.105:0/124403577 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f357c010b00 con 0x7f3584144180 2021-11-12T05:41:10.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.310+0000 7f358afeb700 1 -- 172.21.2.105:0/124403577 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3584147400 con 0x7f3584144180 2021-11-12T05:41:10.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.310+0000 7f358afeb700 1 -- 172.21.2.105:0/124403577 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f358415abe0 con 0x7f3584144180 2021-11-12T05:41:10.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.310+0000 7f358afeb700 1 -- 172.21.2.105:0/124403577 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f358415a410 con 0x7f3584144180 2021-11-12T05:41:10.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.310+0000 7f3581ffb700 1 -- 172.21.2.105:0/124403577 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f357c027030 con 0x7f3584144180 2021-11-12T05:41:10.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.310+0000 7f3581ffb700 1 --2- 172.21.2.105:0/124403577 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f35680536a0 0x7f3568055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:10.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.310+0000 7f3581ffb700 1 -- 172.21.2.105:0/124403577 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f357c06cd00 con 0x7f3584144180 2021-11-12T05:41:10.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.310+0000 7f3588d87700 1 --2- 172.21.2.105:0/124403577 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f35680536a0 0x7f3568055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:10.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.310+0000 7f3588d87700 1 --2- 172.21.2.105:0/124403577 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f35680536a0 0x7f3568055b60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f3574002fb0 tx=0x7f35740069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:10.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.314+0000 7f3581ffb700 1 -- 172.21.2.105:0/124403577 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f357c043c00 con 0x7f3584144180 2021-11-12T05:41:10.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.398+0000 7f358afeb700 1 -- 172.21.2.105:0/124403577 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f35840a8910 con 0x7f3584144180 2021-11-12T05:41:10.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.398+0000 7f3581ffb700 1 -- 172.21.2.105:0/124403577 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+10 (secure 0 0 0) 0x7f357c0250a0 con 0x7f3584144180 2021-11-12T05:41:10.400 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:41:10.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.398+0000 7f358afeb700 1 -- 172.21.2.105:0/124403577 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f35680536a0 msgr2=0x7f3568055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:10.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.398+0000 7f358afeb700 1 --2- 172.21.2.105:0/124403577 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f35680536a0 0x7f3568055b60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f3574002fb0 tx=0x7f35740069b0).stop 2021-11-12T05:41:10.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.398+0000 7f358afeb700 1 -- 172.21.2.105:0/124403577 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3584144180 msgr2=0x7f358415a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:10.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.398+0000 7f358afeb700 1 --2- 172.21.2.105:0/124403577 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3584144180 0x7f358415a6f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f357c0032f0 tx=0x7f357c016000).stop 2021-11-12T05:41:10.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.398+0000 7f358afeb700 1 -- 172.21.2.105:0/124403577 shutdown_connections 2021-11-12T05:41:10.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.398+0000 7f358afeb700 1 --2- 172.21.2.105:0/124403577 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f35680536a0 0x7f3568055b60 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:10.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.398+0000 7f358afeb700 1 --2- 172.21.2.105:0/124403577 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3584144180 0x7f358415a6f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:10.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.398+0000 7f358afeb700 1 --2- 172.21.2.105:0/124403577 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f35840b0520 0x7f3584146f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:10.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.398+0000 7f358afeb700 1 --2- 172.21.2.105:0/124403577 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f35840aca40 0x7f35840a82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:10.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.398+0000 7f358afeb700 1 -- 172.21.2.105:0/124403577 >> 172.21.2.105:0/124403577 conn(0x7f358405c490 msgr2=0x7f3584142c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:10.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.398+0000 7f358afeb700 1 -- 172.21.2.105:0/124403577 shutdown_connections 2021-11-12T05:41:10.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.398+0000 7f358afeb700 1 -- 172.21.2.105:0/124403577 wait complete. 2021-11-12T05:41:10.407 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-12T05:41:10.408 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:41:10.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.458+0000 7f5d0377e700 1 Processor -- start 2021-11-12T05:41:10.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.458+0000 7f5d0377e700 1 -- start start 2021-11-12T05:41:10.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.458+0000 7f5d0377e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5cfc0b2940 0x7f5cfc142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:10.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.458+0000 7f5d0377e700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f5cfc0b0cc0 0x7f5cfc05f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:10.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.458+0000 7f5d0377e700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cfc0b2d20 con 0x7f5cfc0b0780 2021-11-12T05:41:10.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.458+0000 7f5d0377e700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cfc0b1fc0 con 0x7f5cfc0b0cc0 2021-11-12T05:41:10.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.458+0000 7f5d0377e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc0b15e0 con 0x7f5cfc0b2940 2021-11-12T05:41:10.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.458+0000 7f5d01d1b700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f5cfc0b0cc0 0x7f5cfc05f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:10.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.458+0000 7f5d0151a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5cfc0b2940 0x7f5cfc142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:10.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.458+0000 7f5d0151a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5cfc0b2940 0x7f5cfc142dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3301/0 says I am v2:172.21.2.105:35660/0 (socket says 172.21.2.105:35660) 2021-11-12T05:41:10.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.458+0000 7f5d0151a700 1 -- 172.21.2.105:0/3238130645 learned_addr learned my addr 172.21.2.105:0/3238130645 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:10.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.458+0000 7f5d01d1b700 1 -- 172.21.2.105:0/3238130645 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5cfc0b2940 msgr2=0x7f5cfc142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:10.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.458+0000 7f5d01d1b700 1 --2- 172.21.2.105:0/3238130645 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5cfc0b2940 0x7f5cfc142dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:10.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.458+0000 7f5d01d1b700 1 -- 172.21.2.105:0/3238130645 >> v1:172.21.2.115:6789/0 conn(0x7f5cfc0b0780 legacy=0x7f5cfc1432b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:10.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.458+0000 7f5d01d1b700 1 -- 172.21.2.105:0/3238130645 --> v2:172.21.2.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cfc0b1880 con 0x7f5cfc0b0cc0 2021-11-12T05:41:10.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.462+0000 7f5d01d1b700 1 --2- 172.21.2.105:0/3238130645 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5cfc0b0cc0 0x7f5cfc05f6b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f5cf40032f0 tx=0x7f5cf40091d0).ready entity=mon.1 client_cookie=b307e07d4829e19c server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:10.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.462+0000 7f5ceffff700 1 -- 172.21.2.105:0/3238130645 <== mon.1 v2:172.21.2.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cf400b6c0 con 0x7f5cfc0b0cc0 2021-11-12T05:41:10.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.462+0000 7f5ceffff700 1 -- 172.21.2.105:0/3238130645 <== mon.1 v2:172.21.2.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf400b820 con 0x7f5cfc0b0cc0 2021-11-12T05:41:10.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.462+0000 7f5ceffff700 1 -- 172.21.2.105:0/3238130645 <== mon.1 v2:172.21.2.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cf400b990 con 0x7f5cfc0b0cc0 2021-11-12T05:41:10.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.462+0000 7f5d0377e700 1 -- 172.21.2.105:0/3238130645 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5cfc0b0cc0 msgr2=0x7f5cfc05f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:10.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.462+0000 7f5d0377e700 1 --2- 172.21.2.105:0/3238130645 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5cfc0b0cc0 0x7f5cfc05f6b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f5cf40032f0 tx=0x7f5cf40091d0).stop 2021-11-12T05:41:10.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.462+0000 7f5d0377e700 1 -- 172.21.2.105:0/3238130645 shutdown_connections 2021-11-12T05:41:10.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.462+0000 7f5d0377e700 1 --2- 172.21.2.105:0/3238130645 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5cfc0b0cc0 0x7f5cfc05f6b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:10.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.462+0000 7f5d0377e700 1 --2- 172.21.2.105:0/3238130645 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5cfc0b2940 0x7f5cfc142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:10.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.462+0000 7f5d0377e700 1 -- 172.21.2.105:0/3238130645 >> 172.21.2.105:0/3238130645 conn(0x7f5cfc068440 msgr2=0x7f5cfc062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:10.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.462+0000 7f5d0377e700 1 -- 172.21.2.105:0/3238130645 shutdown_connections 2021-11-12T05:41:10.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.462+0000 7f5d0377e700 1 -- 172.21.2.105:0/3238130645 wait complete. 2021-11-12T05:41:10.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.462+0000 7f5d0377e700 1 Processor -- start 2021-11-12T05:41:10.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.462+0000 7f5d0377e700 1 -- start start 2021-11-12T05:41:10.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.462+0000 7f5d0377e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5cfc0b0780 0x7f5cfc0641a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:10.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.462+0000 7f5d0377e700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5cfc0b0cc0 0x7f5cfc143c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:10.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.462+0000 7f5d0377e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5cfc0b2940 0x7f5cfc144ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:10.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.462+0000 7f5d0377e700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc0672f0 con 0x7f5cfc0b2940 2021-11-12T05:41:10.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.462+0000 7f5d0377e700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc1418b0 con 0x7f5cfc0b0cc0 2021-11-12T05:41:10.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.462+0000 7f5d0377e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc064cf0 con 0x7f5cfc0b0780 2021-11-12T05:41:10.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.462+0000 7f5d01d1b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5cfc0b2940 0x7f5cfc144ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:10.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.462+0000 7f5d01d1b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5cfc0b2940 0x7f5cfc144ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44480/0 (socket says 172.21.2.105:44480) 2021-11-12T05:41:10.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.462+0000 7f5d01d1b700 1 -- 172.21.2.105:0/601280782 learned_addr learned my addr 172.21.2.105:0/601280782 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:10.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.462+0000 7f5d00d19700 1 --2- 172.21.2.105:0/601280782 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5cfc0b0cc0 0x7f5cfc143c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:10.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.462+0000 7f5d01d1b700 1 -- 172.21.2.105:0/601280782 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5cfc0b0780 msgr2=0x7f5cfc0641a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:10.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.462+0000 7f5d01d1b700 1 --2- 172.21.2.105:0/601280782 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5cfc0b0780 0x7f5cfc0641a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:10.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.462+0000 7f5d01d1b700 1 -- 172.21.2.105:0/601280782 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5cfc0b0cc0 msgr2=0x7f5cfc143c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:10.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.462+0000 7f5d01d1b700 1 --2- 172.21.2.105:0/601280782 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5cfc0b0cc0 0x7f5cfc143c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:10.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.462+0000 7f5d01d1b700 1 -- 172.21.2.105:0/601280782 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf4009470 con 0x7f5cfc0b2940 2021-11-12T05:41:10.474 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.462+0000 7f5d01d1b700 1 --2- 172.21.2.105:0/601280782 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5cfc0b2940 0x7f5cfc144ff0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f5cf40032f0 tx=0x7f5cf4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:10.474 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.462+0000 7f5cee7fc700 1 -- 172.21.2.105:0/601280782 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cf4021440 con 0x7f5cfc0b2940 2021-11-12T05:41:10.474 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.462+0000 7f5cee7fc700 1 -- 172.21.2.105:0/601280782 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf40215a0 con 0x7f5cfc0b2940 2021-11-12T05:41:10.474 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.462+0000 7f5d0377e700 1 -- 172.21.2.105:0/601280782 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cfc066c90 con 0x7f5cfc0b2940 2021-11-12T05:41:10.475 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.462+0000 7f5d0377e700 1 -- 172.21.2.105:0/601280782 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cfc140ed0 con 0x7f5cfc0b2940 2021-11-12T05:41:10.475 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.462+0000 7f5cee7fc700 1 -- 172.21.2.105:0/601280782 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cf4021900 con 0x7f5cfc0b2940 2021-11-12T05:41:10.475 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.466+0000 7f5d0377e700 1 -- 172.21.2.105:0/601280782 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cd8003410 con 0x7f5cfc0b2940 2021-11-12T05:41:10.475 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.466+0000 7f5cee7fc700 1 -- 172.21.2.105:0/601280782 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5cf400f070 con 0x7f5cfc0b2940 2021-11-12T05:41:10.476 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.466+0000 7f5cee7fc700 1 --2- 172.21.2.105:0/601280782 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5cdc053610 0x7f5cdc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:10.476 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.466+0000 7f5cee7fc700 1 -- 172.21.2.105:0/601280782 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f5cf406d060 con 0x7f5cfc0b2940 2021-11-12T05:41:10.476 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.466+0000 7f5d0151a700 1 --2- 172.21.2.105:0/601280782 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5cdc053610 0x7f5cdc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:10.476 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.466+0000 7f5d0151a700 1 --2- 172.21.2.105:0/601280782 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5cdc053610 0x7f5cdc055ad0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f5cf800e000 tx=0x7f5cf800f040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:10.477 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.466+0000 7f5cee7fc700 1 -- 172.21.2.105:0/601280782 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5cf4043f60 con 0x7f5cfc0b2940 2021-11-12T05:41:10.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.574+0000 7f5d0377e700 1 -- 172.21.2.105:0/601280782 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5cd8003c40 con 0x7f5cfc0b2940 2021-11-12T05:41:10.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.578+0000 7f5cee7fc700 1 -- 172.21.2.105:0/601280782 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f5cf4015020 con 0x7f5cfc0b2940 2021-11-12T05:41:10.579 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:41:10.580 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4429,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/4118304786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":4118304786},{"type":"v1","addr":"172.21.2.115:6833","nonce":4118304786}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:41:07.250137+0000","modified":"2021-11-12T05:41:08.255185+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4908},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4908":{"gid":4908,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/2626499955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":2626499955},{"type":"v1","addr":"172.21.2.105:6835","nonce":2626499955}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-11-12T05:41:10.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.578+0000 7f5d0377e700 1 -- 172.21.2.105:0/601280782 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5cdc053610 msgr2=0x7f5cdc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:10.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.578+0000 7f5d0377e700 1 --2- 172.21.2.105:0/601280782 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5cdc053610 0x7f5cdc055ad0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f5cf800e000 tx=0x7f5cf800f040).stop 2021-11-12T05:41:10.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.578+0000 7f5d0377e700 1 -- 172.21.2.105:0/601280782 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5cfc0b2940 msgr2=0x7f5cfc144ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:10.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.578+0000 7f5d0377e700 1 --2- 172.21.2.105:0/601280782 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5cfc0b2940 0x7f5cfc144ff0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f5cf40032f0 tx=0x7f5cf4016000).stop 2021-11-12T05:41:10.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.578+0000 7f5d0377e700 1 -- 172.21.2.105:0/601280782 shutdown_connections 2021-11-12T05:41:10.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.578+0000 7f5d0377e700 1 --2- 172.21.2.105:0/601280782 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5cdc053610 0x7f5cdc055ad0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:10.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.578+0000 7f5d0377e700 1 --2- 172.21.2.105:0/601280782 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5cfc0b2940 0x7f5cfc144ff0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:10.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.578+0000 7f5d0377e700 1 --2- 172.21.2.105:0/601280782 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5cfc0b0cc0 0x7f5cfc143c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:10.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.578+0000 7f5d0377e700 1 --2- 172.21.2.105:0/601280782 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5cfc0b0780 0x7f5cfc0641a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:10.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.578+0000 7f5d0377e700 1 -- 172.21.2.105:0/601280782 >> 172.21.2.105:0/601280782 conn(0x7f5cfc068440 msgr2=0x7f5cfc05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:10.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.578+0000 7f5d0377e700 1 -- 172.21.2.105:0/601280782 shutdown_connections 2021-11-12T05:41:10.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:10.578+0000 7f5d0377e700 1 -- 172.21.2.105:0/601280782 wait complete. 2021-11-12T05:41:10.584 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 10 2021-11-12T05:41:10.788 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:41:07.250137+0000', 'modified': '2021-11-12T05:41:08.255185+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4908}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4908': {'gid': 4908, 'name': 'a', 'rank': 0, 'incarnation': 9, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/2626499955', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 2626499955}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 2626499955}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:41:10.788 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:41:10.789 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:41:10.853 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":4908,"want_state":"up:active","state":"up:active","rank_uptime":3.5957203230000001,"mdsmap_epoch":10,"osdmap_epoch":35,"osdmap_epoch_barrier":34,"uptime":8.7573772299999995} 2021-11-12T05:41:10.854 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 4908, "mdsmap_epoch": 10, "osdmap_epoch": 35, "osdmap_epoch_barrier": 34, "rank_uptime": 3.595720323, "state": "up:active", "uptime": 8.75737723, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:41:10.854 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-12T05:41:10.855 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-12T05:41:10.855 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba016.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-12T05:41:10.856 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:41:10.856 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:41:10.867 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:41:10.922 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:41:10.922 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:41:10.929 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:41:10.930 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:41:10.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:41:10.931 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:41:10.935 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-12T05:41:10.935 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:41:10.981 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:41:10.990 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:41:10.990 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:41:10.995 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:41:10.996 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:41:10.997 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:41:10.997 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:41:11.018 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:2021-11-12T05:41:11.018+0000 7fba7ed49080 -1 init, newargv = 0x5584336cdbd0 newargc=9 2021-11-12T05:41:11.019 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[14058]: starting ceph client 2021-11-12T05:41:11.032 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[14058]: starting fuse 2021-11-12T05:41:12.102 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:41:12.113 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:41:12.114 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:41:12.171 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:41:12.171 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:41:12.172 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:41:12.173 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:41:12.177 INFO:teuthology.orchestra.run.gibba016.stdout:52 2021-11-12T05:41:12.177 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-12T05:41:12.178 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:41:12.178 DEBUG:teuthology.orchestra.run.gibba016:> sudo python3 -c ' 2021-11-12T05:41:12.179 DEBUG:teuthology.orchestra.run.gibba016:> import glob 2021-11-12T05:41:12.179 DEBUG:teuthology.orchestra.run.gibba016:> import re 2021-11-12T05:41:12.180 DEBUG:teuthology.orchestra.run.gibba016:> import os 2021-11-12T05:41:12.180 DEBUG:teuthology.orchestra.run.gibba016:> import subprocess 2021-11-12T05:41:12.180 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:41:12.181 DEBUG:teuthology.orchestra.run.gibba016:> def find_socket(client_name): 2021-11-12T05:41:12.181 DEBUG:teuthology.orchestra.run.gibba016:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-12T05:41:12.182 DEBUG:teuthology.orchestra.run.gibba016:> files = glob.glob(asok_path) 2021-11-12T05:41:12.182 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:41:12.183 DEBUG:teuthology.orchestra.run.gibba016:> # Given a non-glob path, it better be there 2021-11-12T05:41:12.183 DEBUG:teuthology.orchestra.run.gibba016:> if "*" not in asok_path: 2021-11-12T05:41:12.183 DEBUG:teuthology.orchestra.run.gibba016:> assert(len(files) == 1) 2021-11-12T05:41:12.184 DEBUG:teuthology.orchestra.run.gibba016:> return files[0] 2021-11-12T05:41:12.184 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:41:12.185 DEBUG:teuthology.orchestra.run.gibba016:> for f in files: 2021-11-12T05:41:12.185 DEBUG:teuthology.orchestra.run.gibba016:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-12T05:41:12.186 DEBUG:teuthology.orchestra.run.gibba016:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-12T05:41:12.186 DEBUG:teuthology.orchestra.run.gibba016:> return f 2021-11-12T05:41:12.186 DEBUG:teuthology.orchestra.run.gibba016:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-12T05:41:12.187 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:41:12.187 DEBUG:teuthology.orchestra.run.gibba016:> print(find_socket("client.0")) 2021-11-12T05:41:12.188 DEBUG:teuthology.orchestra.run.gibba016:> ' 2021-11-12T05:41:12.211 INFO:teuthology.orchestra.run.gibba016.stdout:/var/run/ceph/ceph-client.0.14058.asok 2021-11-12T05:41:12.214 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14058.asok 2021-11-12T05:41:12.215 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:41:12.215 DEBUG:teuthology.orchestra.run.gibba016:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14058.asok status 2021-11-12T05:41:12.311 INFO:teuthology.orchestra.run.gibba016.stdout:{ 2021-11-12T05:41:12.311 INFO:teuthology.orchestra.run.gibba016.stdout: "metadata": { 2021-11-12T05:41:12.311 INFO:teuthology.orchestra.run.gibba016.stdout: "ceph_sha1": "a81ee2815de5acae59ead5b8c9137b6766fc8ea8", 2021-11-12T05:41:12.311 INFO:teuthology.orchestra.run.gibba016.stdout: "ceph_version": "ceph version 15.2.15-22-ga81ee281 (a81ee2815de5acae59ead5b8c9137b6766fc8ea8) octopus (stable)", 2021-11-12T05:41:12.312 INFO:teuthology.orchestra.run.gibba016.stdout: "entity_id": "0", 2021-11-12T05:41:12.312 INFO:teuthology.orchestra.run.gibba016.stdout: "hostname": "gibba016", 2021-11-12T05:41:12.312 INFO:teuthology.orchestra.run.gibba016.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-12T05:41:12.312 INFO:teuthology.orchestra.run.gibba016.stdout: "pid": "14058", 2021-11-12T05:41:12.313 INFO:teuthology.orchestra.run.gibba016.stdout: "root": "/" 2021-11-12T05:41:12.313 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:41:12.313 INFO:teuthology.orchestra.run.gibba016.stdout: "dentry_count": 0, 2021-11-12T05:41:12.313 INFO:teuthology.orchestra.run.gibba016.stdout: "dentry_pinned_count": 0, 2021-11-12T05:41:12.313 INFO:teuthology.orchestra.run.gibba016.stdout: "id": 4382, 2021-11-12T05:41:12.314 INFO:teuthology.orchestra.run.gibba016.stdout: "inst": { 2021-11-12T05:41:12.314 INFO:teuthology.orchestra.run.gibba016.stdout: "name": { 2021-11-12T05:41:12.314 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "client", 2021-11-12T05:41:12.314 INFO:teuthology.orchestra.run.gibba016.stdout: "num": 4382 2021-11-12T05:41:12.315 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:41:12.315 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": { 2021-11-12T05:41:12.315 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "v1", 2021-11-12T05:41:12.315 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": "172.21.2.116:0", 2021-11-12T05:41:12.316 INFO:teuthology.orchestra.run.gibba016.stdout: "nonce": 3588622075 2021-11-12T05:41:12.316 INFO:teuthology.orchestra.run.gibba016.stdout: } 2021-11-12T05:41:12.316 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:41:12.316 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": { 2021-11-12T05:41:12.316 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "v1", 2021-11-12T05:41:12.317 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": "172.21.2.116:0", 2021-11-12T05:41:12.317 INFO:teuthology.orchestra.run.gibba016.stdout: "nonce": 3588622075 2021-11-12T05:41:12.317 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:41:12.317 INFO:teuthology.orchestra.run.gibba016.stdout: "inst_str": "client.4382 172.21.2.116:0/3588622075", 2021-11-12T05:41:12.318 INFO:teuthology.orchestra.run.gibba016.stdout: "addr_str": "172.21.2.116:0/3588622075", 2021-11-12T05:41:12.318 INFO:teuthology.orchestra.run.gibba016.stdout: "inode_count": 1, 2021-11-12T05:41:12.318 INFO:teuthology.orchestra.run.gibba016.stdout: "mds_epoch": 10, 2021-11-12T05:41:12.318 INFO:teuthology.orchestra.run.gibba016.stdout: "osd_epoch": 35, 2021-11-12T05:41:12.318 INFO:teuthology.orchestra.run.gibba016.stdout: "osd_epoch_barrier": 0, 2021-11-12T05:41:12.319 INFO:teuthology.orchestra.run.gibba016.stdout: "blacklisted": false, 2021-11-12T05:41:12.319 INFO:teuthology.orchestra.run.gibba016.stdout: "fs_name": "cephfs" 2021-11-12T05:41:12.319 INFO:teuthology.orchestra.run.gibba016.stdout:} 2021-11-12T05:41:12.320 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:41:12.321 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:41:12.321 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:41:12.327 INFO:teuthology.orchestra.run.gibba016.stdout:fuseblk 2021-11-12T05:41:12.327 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-12T05:41:12.327 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:41:12.328 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:41:12.336 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_min_caps_per_client 2021-11-12T05:41:12.395 INFO:teuthology.orchestra.run.gibba005.stdout:{"mds_min_caps_per_client":"100"} 2021-11-12T05:41:12.395 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_min_caps_per_client": "100" } 2021-11-12T05:41:12.396 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:41:12.396 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:41:12.397 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:41:12.403 INFO:teuthology.orchestra.run.gibba016.stdout:fuseblk 2021-11-12T05:41:12.403 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-12T05:41:12.404 DEBUG:teuthology.orchestra.run.gibba016:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-11-12T05:41:12.405 DEBUG:teuthology.orchestra.run.gibba016:> import sys 2021-11-12T05:41:12.405 DEBUG:teuthology.orchestra.run.gibba016:> import time 2021-11-12T05:41:12.405 DEBUG:teuthology.orchestra.run.gibba016:> import os 2021-11-12T05:41:12.406 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:41:12.406 DEBUG:teuthology.orchestra.run.gibba016:> n = 1000 2021-11-12T05:41:12.406 DEBUG:teuthology.orchestra.run.gibba016:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-11-12T05:41:12.407 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:41:12.407 DEBUG:teuthology.orchestra.run.gibba016:> if not os.path.exists(os.path.dirname(abs_path)): 2021-11-12T05:41:12.408 DEBUG:teuthology.orchestra.run.gibba016:> os.makedirs(os.path.dirname(abs_path)) 2021-11-12T05:41:12.408 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:41:12.408 DEBUG:teuthology.orchestra.run.gibba016:> for i in range(0, n): 2021-11-12T05:41:12.409 DEBUG:teuthology.orchestra.run.gibba016:> fname = "{0}_{1}".format(abs_path, i) 2021-11-12T05:41:12.409 DEBUG:teuthology.orchestra.run.gibba016:> with open(fname, '"'"'w'"'"') as f: 2021-11-12T05:41:12.409 DEBUG:teuthology.orchestra.run.gibba016:> f.write('"'"'content'"'"') 2021-11-12T05:41:12.410 DEBUG:teuthology.orchestra.run.gibba016:> if True: 2021-11-12T05:41:12.410 DEBUG:teuthology.orchestra.run.gibba016:> f.flush() 2021-11-12T05:41:12.411 DEBUG:teuthology.orchestra.run.gibba016:> os.fsync(f.fileno()) 2021-11-12T05:41:12.411 DEBUG:teuthology.orchestra.run.gibba016:> ' 2021-11-12T05:41:24.160 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:41:24.163 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:41:24.166 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:41:24.170 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:41:24.173 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:41:30.286 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:41:30.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.398+0000 7f6518e6e700 1 Processor -- start 2021-11-12T05:41:30.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.398+0000 7f6518e6e700 1 -- start start 2021-11-12T05:41:30.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.398+0000 7f6518e6e700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f65140ad080 0x7f65140af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:30.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.398+0000 7f6518e6e700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65140ac7b0 con 0x7f651414b2f0 2021-11-12T05:41:30.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.398+0000 7f6518e6e700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65140ac9e0 con 0x7f65140ac280 2021-11-12T05:41:30.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.398+0000 7f6518e6e700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65141488a0 con 0x7f65140ad080 2021-11-12T05:41:30.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.398+0000 7f6512d9d700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f651414b2f0 0x7f6514147a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:54888/0 (socket says 172.21.2.105:54888) 2021-11-12T05:41:30.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.398+0000 7f6512d9d700 1 -- 172.21.2.105:0/2377915735 learned_addr learned my addr 172.21.2.105:0/2377915735 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:41:30.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.398+0000 7f651259c700 1 --2- 172.21.2.105:0/2377915735 >> v2:172.21.2.105:3300/0 conn(0x7f65140ad080 0x7f65140af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:30.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.398+0000 7f651259c700 1 -- 172.21.2.105:0/2377915735 >> v1:172.21.2.115:6789/0 conn(0x7f65140ac280 legacy=0x7f651414abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:30.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.398+0000 7f651259c700 1 -- 172.21.2.105:0/2377915735 >> v1:172.21.2.105:6789/0 conn(0x7f651414b2f0 legacy=0x7f6514147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:30.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.398+0000 7f651259c700 1 -- 172.21.2.105:0/2377915735 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65140b0b30 con 0x7f65140ad080 2021-11-12T05:41:30.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.398+0000 7f651259c700 1 --2- 172.21.2.105:0/2377915735 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f65140ad080 0x7f65140af730 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f65140b0eb0 tx=0x7f6504006df0).ready entity=mon.0 client_cookie=9e65c58fdd8639a5 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:30.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.398+0000 7f651159a700 1 -- 172.21.2.105:0/2377915735 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f650400d5c0 con 0x7f65140ad080 2021-11-12T05:41:30.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.398+0000 7f651159a700 1 -- 172.21.2.105:0/2377915735 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6504000e90 con 0x7f65140ad080 2021-11-12T05:41:30.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.398+0000 7f651159a700 1 -- 172.21.2.105:0/2377915735 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f650400d910 con 0x7f65140ad080 2021-11-12T05:41:30.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.398+0000 7f6518e6e700 1 -- 172.21.2.105:0/2377915735 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f65140ad080 msgr2=0x7f65140af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:30.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.398+0000 7f6518e6e700 1 --2- 172.21.2.105:0/2377915735 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f65140ad080 0x7f65140af730 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f65140b0eb0 tx=0x7f6504006df0).stop 2021-11-12T05:41:30.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.398+0000 7f6518e6e700 1 -- 172.21.2.105:0/2377915735 shutdown_connections 2021-11-12T05:41:30.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.398+0000 7f6518e6e700 1 --2- 172.21.2.105:0/2377915735 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f65140ad080 0x7f65140af730 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:30.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.398+0000 7f6518e6e700 1 -- 172.21.2.105:0/2377915735 >> 172.21.2.105:0/2377915735 conn(0x7f65140b5370 msgr2=0x7f65140b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:30.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.398+0000 7f6518e6e700 1 -- 172.21.2.105:0/2377915735 shutdown_connections 2021-11-12T05:41:30.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.402+0000 7f6518e6e700 1 -- 172.21.2.105:0/2377915735 wait complete. 2021-11-12T05:41:30.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.402+0000 7f6518e6e700 1 Processor -- start 2021-11-12T05:41:30.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.402+0000 7f6518e6e700 1 -- start start 2021-11-12T05:41:30.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.402+0000 7f6518e6e700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f65140ac280 0x7f65140aac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:30.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.402+0000 7f6518e6e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f65140ad080 0x7f65140a9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:30.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.402+0000 7f6518e6e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f651414b2f0 0x7f65140ab3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:30.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.402+0000 7f6518e6e700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65140641f0 con 0x7f651414b2f0 2021-11-12T05:41:30.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.402+0000 7f6518e6e700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6514064490 con 0x7f65140ac280 2021-11-12T05:41:30.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.402+0000 7f6518e6e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65140a97a0 con 0x7f65140ad080 2021-11-12T05:41:30.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.402+0000 7f6512d9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f651414b2f0 0x7f65140ab3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:30.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.402+0000 7f6512d9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f651414b2f0 0x7f65140ab3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44500/0 (socket says 172.21.2.105:44500) 2021-11-12T05:41:30.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.402+0000 7f6512d9d700 1 -- 172.21.2.105:0/3406131562 learned_addr learned my addr 172.21.2.105:0/3406131562 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:30.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.402+0000 7f6512d9d700 1 -- 172.21.2.105:0/3406131562 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f65140ad080 msgr2=0x7f65140a9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:30.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.402+0000 7f6512d9d700 1 --2- 172.21.2.105:0/3406131562 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f65140ad080 0x7f65140a9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:30.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.402+0000 7f6512d9d700 1 -- 172.21.2.105:0/3406131562 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f65140ac280 msgr2=0x7f65140aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:30.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.402+0000 7f6512d9d700 1 --2- 172.21.2.105:0/3406131562 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f65140ac280 0x7f65140aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:30.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.402+0000 7f6512d9d700 1 -- 172.21.2.105:0/3406131562 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f650400b180 con 0x7f651414b2f0 2021-11-12T05:41:30.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.402+0000 7f6512d9d700 1 --2- 172.21.2.105:0/3406131562 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f651414b2f0 0x7f65140ab3b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f65140b06e0 tx=0x7f650c0013a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:30.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.402+0000 7f650b7fe700 1 -- 172.21.2.105:0/3406131562 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f650c005ba0 con 0x7f651414b2f0 2021-11-12T05:41:30.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.402+0000 7f650b7fe700 1 -- 172.21.2.105:0/3406131562 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650c005d00 con 0x7f651414b2f0 2021-11-12T05:41:30.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.402+0000 7f6518e6e700 1 -- 172.21.2.105:0/3406131562 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65140a9c40 con 0x7f651414b2f0 2021-11-12T05:41:30.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.402+0000 7f650b7fe700 1 -- 172.21.2.105:0/3406131562 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f650c0072c0 con 0x7f651414b2f0 2021-11-12T05:41:30.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.402+0000 7f6518e6e700 1 -- 172.21.2.105:0/3406131562 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6514066a90 con 0x7f651414b2f0 2021-11-12T05:41:30.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.402+0000 7f6518e6e700 1 -- 172.21.2.105:0/3406131562 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65140a9960 con 0x7f651414b2f0 2021-11-12T05:41:30.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.402+0000 7f650b7fe700 1 -- 172.21.2.105:0/3406131562 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f650c010070 con 0x7f651414b2f0 2021-11-12T05:41:30.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.402+0000 7f650b7fe700 1 --2- 172.21.2.105:0/3406131562 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f64f80536a0 0x7f64f8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:30.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.402+0000 7f650b7fe700 1 -- 172.21.2.105:0/3406131562 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f650c06b4a0 con 0x7f651414b2f0 2021-11-12T05:41:30.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.402+0000 7f651259c700 1 --2- 172.21.2.105:0/3406131562 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f64f80536a0 0x7f64f8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:30.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.402+0000 7f651259c700 1 --2- 172.21.2.105:0/3406131562 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f64f80536a0 0x7f64f8055b60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f65140b0eb0 tx=0x7f6504012000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:30.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.406+0000 7f650b7fe700 1 -- 172.21.2.105:0/3406131562 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f650c0424b0 con 0x7f651414b2f0 2021-11-12T05:41:30.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.518+0000 7f6518e6e700 1 -- 172.21.2.105:0/3406131562 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6514057350 con 0x7f651414b2f0 2021-11-12T05:41:30.520 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.518+0000 7f650b7fe700 1 -- 172.21.2.105:0/3406131562 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f650c045ad0 con 0x7f651414b2f0 2021-11-12T05:41:30.520 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:41:30.521 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4429,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/4118304786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":4118304786},{"type":"v1","addr":"172.21.2.115:6833","nonce":4118304786}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:41:07.250137+0000","modified":"2021-11-12T05:41:08.255185+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4908},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4908":{"gid":4908,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/2626499955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":2626499955},{"type":"v1","addr":"172.21.2.105:6835","nonce":2626499955}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-11-12T05:41:30.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.518+0000 7f6518e6e700 1 -- 172.21.2.105:0/3406131562 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f64f80536a0 msgr2=0x7f64f8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:30.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.518+0000 7f6518e6e700 1 --2- 172.21.2.105:0/3406131562 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f64f80536a0 0x7f64f8055b60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f65140b0eb0 tx=0x7f6504012000).stop 2021-11-12T05:41:30.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.518+0000 7f6518e6e700 1 -- 172.21.2.105:0/3406131562 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f651414b2f0 msgr2=0x7f65140ab3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:30.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.518+0000 7f6518e6e700 1 --2- 172.21.2.105:0/3406131562 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f651414b2f0 0x7f65140ab3b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f65140b06e0 tx=0x7f650c0013a0).stop 2021-11-12T05:41:30.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.518+0000 7f6518e6e700 1 -- 172.21.2.105:0/3406131562 shutdown_connections 2021-11-12T05:41:30.526 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.518+0000 7f6518e6e700 1 --2- 172.21.2.105:0/3406131562 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f64f80536a0 0x7f64f8055b60 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:30.526 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.518+0000 7f6518e6e700 1 --2- 172.21.2.105:0/3406131562 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f651414b2f0 0x7f65140ab3b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:30.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.518+0000 7f6518e6e700 1 --2- 172.21.2.105:0/3406131562 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f65140ad080 0x7f65140a9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:30.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.518+0000 7f6518e6e700 1 --2- 172.21.2.105:0/3406131562 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f65140ac280 0x7f65140aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:30.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.518+0000 7f6518e6e700 1 -- 172.21.2.105:0/3406131562 >> 172.21.2.105:0/3406131562 conn(0x7f65140b5370 msgr2=0x7f651414aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:30.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.518+0000 7f6518e6e700 1 -- 172.21.2.105:0/3406131562 shutdown_connections 2021-11-12T05:41:30.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.518+0000 7f6518e6e700 1 -- 172.21.2.105:0/3406131562 wait complete. 2021-11-12T05:41:30.529 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 10 2021-11-12T05:41:30.531 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_caps 20 2021-11-12T05:41:30.591 INFO:teuthology.orchestra.run.gibba005.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2021-11-12T05:41:30.592 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-11-12T05:41:30.592 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:41:30.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.646+0000 7f15468bc700 1 Processor -- start 2021-11-12T05:41:30.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.646+0000 7f15468bc700 1 -- start start 2021-11-12T05:41:30.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.646+0000 7f15468bc700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f15400b4d50 0x7f15400b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:30.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.646+0000 7f15468bc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f15400b3100 0x7f15400b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:30.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.646+0000 7f15468bc700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15400b2110 con 0x7f1540062010 2021-11-12T05:41:30.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.646+0000 7f15468bc700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15400b2370 con 0x7f15400b3100 2021-11-12T05:41:30.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.646+0000 7f15468bc700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15400b2610 con 0x7f15400b4d50 2021-11-12T05:41:30.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.646+0000 7f1544e59700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f15400b3100 0x7f15400b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:30.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.646+0000 7f153ffff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f1540062010 0x7f15400b4640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:54900/0 (socket says 172.21.2.105:54900) 2021-11-12T05:41:30.663 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.646+0000 7f153ffff700 1 -- 172.21.2.105:0/4273760184 learned_addr learned my addr 172.21.2.105:0/4273760184 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:41:30.663 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f1544e59700 1 -- 172.21.2.105:0/4273760184 >> v2:172.21.2.115:3300/0 conn(0x7f15400b4d50 msgr2=0x7f15400b5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:30.664 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f1544e59700 1 --2- 172.21.2.105:0/4273760184 >> v2:172.21.2.115:3300/0 conn(0x7f15400b4d50 0x7f15400b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:30.664 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f1544e59700 1 -- 172.21.2.105:0/4273760184 >> v1:172.21.2.105:6789/0 conn(0x7f1540062010 legacy=0x7f15400b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:30.665 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f1544e59700 1 -- 172.21.2.105:0/4273760184 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15400b4330 con 0x7f15400b3100 2021-11-12T05:41:30.665 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f1544e59700 1 --2- 172.21.2.105:0/4273760184 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f15400b3100 0x7f15400b2ab0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f1530001110 tx=0x7f15380091d0).ready entity=mon.0 client_cookie=517f63983ecb2dc7 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:30.666 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f153effd700 1 -- 172.21.2.105:0/4273760184 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1538009ea0 con 0x7f15400b3100 2021-11-12T05:41:30.666 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f153effd700 1 -- 172.21.2.105:0/4273760184 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153800b730 con 0x7f15400b3100 2021-11-12T05:41:30.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f153effd700 1 -- 172.21.2.105:0/4273760184 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f153800b8a0 con 0x7f15400b3100 2021-11-12T05:41:30.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f15468bc700 1 -- 172.21.2.105:0/4273760184 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f15400b3100 msgr2=0x7f15400b2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:30.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f15468bc700 1 --2- 172.21.2.105:0/4273760184 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f15400b3100 0x7f15400b2ab0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f1530001110 tx=0x7f15380091d0).stop 2021-11-12T05:41:30.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f15468bc700 1 -- 172.21.2.105:0/4273760184 shutdown_connections 2021-11-12T05:41:30.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f15468bc700 1 --2- 172.21.2.105:0/4273760184 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f15400b3100 0x7f15400b2ab0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:30.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f15468bc700 1 --2- 172.21.2.105:0/4273760184 >> v2:172.21.2.115:3300/0 conn(0x7f15400b4d50 0x7f15400b5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:30.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f15468bc700 1 -- 172.21.2.105:0/4273760184 >> 172.21.2.105:0/4273760184 conn(0x7f15400b9790 msgr2=0x7f15400b9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:30.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f15468bc700 1 -- 172.21.2.105:0/4273760184 shutdown_connections 2021-11-12T05:41:30.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f15468bc700 1 -- 172.21.2.105:0/4273760184 wait complete. 2021-11-12T05:41:30.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f15468bc700 1 Processor -- start 2021-11-12T05:41:30.671 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f15468bc700 1 -- start start 2021-11-12T05:41:30.671 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f15468bc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1540062010 0x7f15400afa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:30.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f15468bc700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f15400b3100 0x7f15400663f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:30.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f15468bc700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f15400b4d50 0x7f15400668e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:30.673 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f15468bc700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1540063710 con 0x7f1540062010 2021-11-12T05:41:30.673 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f15468bc700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1540066190 con 0x7f15400b3100 2021-11-12T05:41:30.674 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f15468bc700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1540063c80 con 0x7f15400b4d50 2021-11-12T05:41:30.674 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f153ffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1540062010 0x7f15400afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:30.675 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f153ffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1540062010 0x7f15400afa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44514/0 (socket says 172.21.2.105:44514) 2021-11-12T05:41:30.675 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f153ffff700 1 -- 172.21.2.105:0/3850874551 learned_addr learned my addr 172.21.2.105:0/3850874551 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:30.676 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f153ffff700 1 -- 172.21.2.105:0/3850874551 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f15400b4d50 msgr2=0x7f15400668e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:30.676 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f153ffff700 1 --2- 172.21.2.105:0/3850874551 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f15400b4d50 0x7f15400668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:30.677 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f153ffff700 1 -- 172.21.2.105:0/3850874551 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f15400b3100 msgr2=0x7f15400663f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:30.677 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f153ffff700 1 --2- 172.21.2.105:0/3850874551 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f15400b3100 0x7f15400663f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:30.677 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f153ffff700 1 -- 172.21.2.105:0/3850874551 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1538009470 con 0x7f1540062010 2021-11-12T05:41:30.677 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f153ffff700 1 --2- 172.21.2.105:0/3850874551 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1540062010 0x7f15400afa90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f15300011d0 tx=0x7f1530007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:30.677 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f153d7fa700 1 -- 172.21.2.105:0/3850874551 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15300072e0 con 0x7f1540062010 2021-11-12T05:41:30.678 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f153d7fa700 1 -- 172.21.2.105:0/3850874551 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1530007440 con 0x7f1540062010 2021-11-12T05:41:30.678 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f15468bc700 1 -- 172.21.2.105:0/3850874551 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15400aff80 con 0x7f1540062010 2021-11-12T05:41:30.678 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f153d7fa700 1 -- 172.21.2.105:0/3850874551 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1530005800 con 0x7f1540062010 2021-11-12T05:41:30.678 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f15468bc700 1 -- 172.21.2.105:0/3850874551 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1540066f70 con 0x7f1540062010 2021-11-12T05:41:30.679 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f15468bc700 1 -- 172.21.2.105:0/3850874551 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15400623f0 con 0x7f1540062010 2021-11-12T05:41:30.679 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f153d7fa700 1 -- 172.21.2.105:0/3850874551 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1530010070 con 0x7f1540062010 2021-11-12T05:41:30.679 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f153d7fa700 1 --2- 172.21.2.105:0/3850874551 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1524053610 0x7f1524055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:30.679 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f153d7fa700 1 -- 172.21.2.105:0/3850874551 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f153006b2a0 con 0x7f1540062010 2021-11-12T05:41:30.679 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.650+0000 7f153f7fe700 1 --2- 172.21.2.105:0/3850874551 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1524053610 0x7f1524055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:30.680 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.654+0000 7f153f7fe700 1 --2- 172.21.2.105:0/3850874551 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1524053610 0x7f1524055ad0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f1528002f70 tx=0x7f15280069e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:30.680 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.654+0000 7f153d7fa700 1 -- 172.21.2.105:0/3850874551 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f15300422b0 con 0x7f1540062010 2021-11-12T05:41:30.766 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.762+0000 7f15468bc700 1 -- 172.21.2.105:0/3850874551 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1540057350 con 0x7f1540062010 2021-11-12T05:41:30.766 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.766+0000 7f153d7fa700 1 -- 172.21.2.105:0/3850874551 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f15300458d0 con 0x7f1540062010 2021-11-12T05:41:30.767 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:41:30.767 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4429,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/4118304786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":4118304786},{"type":"v1","addr":"172.21.2.115:6833","nonce":4118304786}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:41:07.250137+0000","modified":"2021-11-12T05:41:08.255185+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4908},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4908":{"gid":4908,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/2626499955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":2626499955},{"type":"v1","addr":"172.21.2.105:6835","nonce":2626499955}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-11-12T05:41:30.768 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.766+0000 7f15468bc700 1 -- 172.21.2.105:0/3850874551 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1524053610 msgr2=0x7f1524055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:30.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.766+0000 7f15468bc700 1 --2- 172.21.2.105:0/3850874551 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1524053610 0x7f1524055ad0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f1528002f70 tx=0x7f15280069e0).stop 2021-11-12T05:41:30.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.766+0000 7f15468bc700 1 -- 172.21.2.105:0/3850874551 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1540062010 msgr2=0x7f15400afa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:30.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.766+0000 7f15468bc700 1 --2- 172.21.2.105:0/3850874551 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1540062010 0x7f15400afa90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f15300011d0 tx=0x7f1530007c00).stop 2021-11-12T05:41:30.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.766+0000 7f15468bc700 1 -- 172.21.2.105:0/3850874551 shutdown_connections 2021-11-12T05:41:30.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.766+0000 7f15468bc700 1 --2- 172.21.2.105:0/3850874551 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1524053610 0x7f1524055ad0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:30.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.766+0000 7f15468bc700 1 --2- 172.21.2.105:0/3850874551 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f15400b4d50 0x7f15400668e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:30.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.766+0000 7f15468bc700 1 --2- 172.21.2.105:0/3850874551 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f15400b3100 0x7f15400663f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:30.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.766+0000 7f15468bc700 1 --2- 172.21.2.105:0/3850874551 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1540062010 0x7f15400afa90 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:30.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.766+0000 7f15468bc700 1 -- 172.21.2.105:0/3850874551 >> 172.21.2.105:0/3850874551 conn(0x7f15400b9790 msgr2=0x7f15401415d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:30.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.766+0000 7f15468bc700 1 -- 172.21.2.105:0/3850874551 shutdown_connections 2021-11-12T05:41:30.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.766+0000 7f15468bc700 1 -- 172.21.2.105:0/3850874551 wait complete. 2021-11-12T05:41:30.771 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 10 2021-11-12T05:41:30.774 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_decay_threshold 400 2021-11-12T05:41:30.832 INFO:teuthology.orchestra.run.gibba005.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2021-11-12T05:41:30.833 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-11-12T05:41:30.833 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:41:30.884 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.882+0000 7f08f72ae700 1 Processor -- start 2021-11-12T05:41:30.885 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.882+0000 7f08f72ae700 1 -- start start 2021-11-12T05:41:30.885 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.882+0000 7f08f72ae700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f08f014b2f0 0x7f08f00af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:30.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.882+0000 7f08f72ae700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f00ac7b0 con 0x7f08f00ac280 2021-11-12T05:41:30.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.882+0000 7f08f72ae700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f00ac9e0 con 0x7f08f00ad080 2021-11-12T05:41:30.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.882+0000 7f08f72ae700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f01488a0 con 0x7f08f014b2f0 2021-11-12T05:41:30.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.882+0000 7f08f4849700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f08f00ac280 0x7f08f0147a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:54918/0 (socket says 172.21.2.105:54918) 2021-11-12T05:41:30.887 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.882+0000 7f08f4849700 1 -- 172.21.2.105:0/1939767033 learned_addr learned my addr 172.21.2.105:0/1939767033 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:41:30.892 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.882+0000 7f08e3fff700 1 -- 172.21.2.105:0/1939767033 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3478913714 0 0) 0x7f08f00ac7b0 con 0x7f08f00ac280 2021-11-12T05:41:30.893 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.882+0000 7f08e3fff700 1 -- 172.21.2.105:0/1939767033 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08d8003260 con 0x7f08f00ac280 2021-11-12T05:41:30.893 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.882+0000 7f08e3fff700 1 -- 172.21.2.105:0/1939767033 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 352792532 0 0) 0x7f08d8003260 con 0x7f08f00ac280 2021-11-12T05:41:30.893 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.882+0000 7f08e3fff700 1 -- 172.21.2.105:0/1939767033 >> v2:172.21.2.115:3300/0 conn(0x7f08f014b2f0 msgr2=0x7f08f00af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:30.893 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.882+0000 7f08e3fff700 1 --2- 172.21.2.105:0/1939767033 >> v2:172.21.2.115:3300/0 conn(0x7f08f014b2f0 0x7f08f00af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:30.893 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.882+0000 7f08e3fff700 1 -- 172.21.2.105:0/1939767033 >> v1:172.21.2.115:6789/0 conn(0x7f08f00ad080 legacy=0x7f08f014abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:30.894 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.882+0000 7f08e3fff700 1 -- 172.21.2.105:0/1939767033 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f00b0b30 con 0x7f08f00ac280 2021-11-12T05:41:30.894 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.882+0000 7f08e3fff700 1 -- 172.21.2.105:0/1939767033 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f08e4001660 con 0x7f08f00ac280 2021-11-12T05:41:30.894 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.882+0000 7f08e3fff700 1 -- 172.21.2.105:0/1939767033 >> v1:172.21.2.105:6789/0 conn(0x7f08f00ac280 legacy=0x7f08f0147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:30.894 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.882+0000 7f08e3fff700 1 --2- 172.21.2.105:0/1939767033 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f08d8003820 0x7f08d8003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:30.895 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.882+0000 7f08e3fff700 1 --2- 172.21.2.105:0/1939767033 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f08d8004500 0x7f08d8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:30.895 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.882+0000 7f08e3fff700 1 --2- 172.21.2.105:0/1939767033 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f08d8005050 0x7f08d800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:30.895 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.882+0000 7f08e3fff700 1 -- 172.21.2.105:0/1939767033 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f01488a0 con 0x7f08d8005050 2021-11-12T05:41:30.895 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.882+0000 7f08e3fff700 1 -- 172.21.2.105:0/1939767033 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d800bf40 con 0x7f08d8003820 2021-11-12T05:41:30.895 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.882+0000 7f08e3fff700 1 -- 172.21.2.105:0/1939767033 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d800c100 con 0x7f08d8004500 2021-11-12T05:41:30.896 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.882+0000 7f08f584b700 1 --2- 172.21.2.105:0/1939767033 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f08d8005050 0x7f08d800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:30.896 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.882+0000 7f08f504a700 1 --2- 172.21.2.105:0/1939767033 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f08d8003820 0x7f08d8003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:30.896 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.882+0000 7f08f584b700 1 -- 172.21.2.105:0/1939767033 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f08d8004500 msgr2=0x7f08d8004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:30.896 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.882+0000 7f08f584b700 1 --2- 172.21.2.105:0/1939767033 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f08d8004500 0x7f08d8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:30.897 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.882+0000 7f08f584b700 1 -- 172.21.2.105:0/1939767033 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f08d8003820 msgr2=0x7f08d8003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:30.897 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.882+0000 7f08f584b700 1 --2- 172.21.2.105:0/1939767033 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f08d8003820 0x7f08d8003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:30.897 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.882+0000 7f08f584b700 1 -- 172.21.2.105:0/1939767033 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d8003260 con 0x7f08d8005050 2021-11-12T05:41:30.897 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.882+0000 7f08f584b700 1 -- 172.21.2.105:0/1939767033 reap_dead start 2021-11-12T05:41:30.897 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.882+0000 7f08f584b700 1 --2- 172.21.2.105:0/1939767033 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f08d8005050 0x7f08d800b750 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f08e80032f0 tx=0x7f08e8006f90).ready entity=mon.0 client_cookie=87f2db4c126d9ef6 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:30.898 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.882+0000 7f08e3fff700 1 -- 172.21.2.105:0/1939767033 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08e800b460 con 0x7f08d8005050 2021-11-12T05:41:30.898 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.882+0000 7f08e3fff700 1 -- 172.21.2.105:0/1939767033 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e800b5c0 con 0x7f08d8005050 2021-11-12T05:41:30.898 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.882+0000 7f08e3fff700 1 -- 172.21.2.105:0/1939767033 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08e800b730 con 0x7f08d8005050 2021-11-12T05:41:30.898 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.886+0000 7f08f72ae700 1 -- 172.21.2.105:0/1939767033 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f08d8005050 msgr2=0x7f08d800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:30.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.886+0000 7f08f72ae700 1 --2- 172.21.2.105:0/1939767033 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f08d8005050 0x7f08d800b750 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f08e80032f0 tx=0x7f08e8006f90).stop 2021-11-12T05:41:30.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.886+0000 7f08f72ae700 1 -- 172.21.2.105:0/1939767033 shutdown_connections 2021-11-12T05:41:30.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.886+0000 7f08f72ae700 1 --2- 172.21.2.105:0/1939767033 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f08d8005050 0x7f08d800b750 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:30.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.886+0000 7f08f72ae700 1 -- 172.21.2.105:0/1939767033 >> 172.21.2.105:0/1939767033 conn(0x7f08f00b5370 msgr2=0x7f08f00b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:30.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.886+0000 7f08f72ae700 1 -- 172.21.2.105:0/1939767033 shutdown_connections 2021-11-12T05:41:30.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.886+0000 7f08f72ae700 1 -- 172.21.2.105:0/1939767033 wait complete. 2021-11-12T05:41:30.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.886+0000 7f08f72ae700 1 Processor -- start 2021-11-12T05:41:30.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.886+0000 7f08f72ae700 1 -- start start 2021-11-12T05:41:30.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.886+0000 7f08f72ae700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f08d8005050 0x7f08f0060390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:30.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.886+0000 7f08f72ae700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f08f00a7de0 0x7f08f014c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:30.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.886+0000 7f08f72ae700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f08f00a7020 0x7f08f014c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:30.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.886+0000 7f08f72ae700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f00a9a40 con 0x7f08f00a7020 2021-11-12T05:41:30.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.886+0000 7f08f72ae700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f0157740 con 0x7f08d8005050 2021-11-12T05:41:30.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.886+0000 7f08f72ae700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f014be20 con 0x7f08f00a7de0 2021-11-12T05:41:30.902 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.886+0000 7f08f584b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f08f00a7020 0x7f08f014c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:30.902 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.886+0000 7f08f584b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f08f00a7020 0x7f08f014c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44534/0 (socket says 172.21.2.105:44534) 2021-11-12T05:41:30.902 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.886+0000 7f08f584b700 1 -- 172.21.2.105:0/2571962419 learned_addr learned my addr 172.21.2.105:0/2571962419 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:30.902 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.886+0000 7f08f504a700 1 --2- 172.21.2.105:0/2571962419 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f08d8005050 0x7f08f0060390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:30.903 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.886+0000 7f08f4849700 1 --2- 172.21.2.105:0/2571962419 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f08f00a7de0 0x7f08f014c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:30.903 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.886+0000 7f08f584b700 1 -- 172.21.2.105:0/2571962419 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f08f00a7de0 msgr2=0x7f08f014c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:30.903 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.886+0000 7f08f584b700 1 --2- 172.21.2.105:0/2571962419 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f08f00a7de0 0x7f08f014c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:30.903 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.886+0000 7f08f584b700 1 -- 172.21.2.105:0/2571962419 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f08d8005050 msgr2=0x7f08f0060390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:30.904 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.886+0000 7f08f584b700 1 --2- 172.21.2.105:0/2571962419 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f08d8005050 0x7f08f0060390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:30.904 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.886+0000 7f08f584b700 1 -- 172.21.2.105:0/2571962419 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f00a76f0 con 0x7f08f00a7020 2021-11-12T05:41:30.904 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.886+0000 7f08f504a700 1 --2- 172.21.2.105:0/2571962419 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f08d8005050 0x7f08f0060390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:41:30.904 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.886+0000 7f08f584b700 1 --2- 172.21.2.105:0/2571962419 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f08f00a7020 0x7f08f014c7b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f08e80032f0 tx=0x7f08e8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:30.904 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.886+0000 7f08e27fc700 1 -- 172.21.2.105:0/2571962419 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08e8011ad0 con 0x7f08f00a7020 2021-11-12T05:41:30.905 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.886+0000 7f08e27fc700 1 -- 172.21.2.105:0/2571962419 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e8011c30 con 0x7f08f00a7020 2021-11-12T05:41:30.905 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.886+0000 7f08f72ae700 1 -- 172.21.2.105:0/2571962419 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f014cca0 con 0x7f08f00a7020 2021-11-12T05:41:30.905 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.886+0000 7f08e27fc700 1 -- 172.21.2.105:0/2571962419 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08e801f3d0 con 0x7f08f00a7020 2021-11-12T05:41:30.905 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.886+0000 7f08f72ae700 1 -- 172.21.2.105:0/2571962419 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f00a84b0 con 0x7f08f00a7020 2021-11-12T05:41:30.906 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.886+0000 7f08f72ae700 1 -- 172.21.2.105:0/2571962419 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f0157900 con 0x7f08f00a7020 2021-11-12T05:41:30.906 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.886+0000 7f08e27fc700 1 -- 172.21.2.105:0/2571962419 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f08e8027070 con 0x7f08f00a7020 2021-11-12T05:41:30.906 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.886+0000 7f08e27fc700 1 --2- 172.21.2.105:0/2571962419 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f08d0053580 0x7f08d0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:30.906 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.886+0000 7f08e27fc700 1 -- 172.21.2.105:0/2571962419 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f08e806c480 con 0x7f08f00a7020 2021-11-12T05:41:30.907 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.890+0000 7f08f504a700 1 --2- 172.21.2.105:0/2571962419 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f08d0053580 0x7f08d0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:30.907 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.890+0000 7f08f504a700 1 --2- 172.21.2.105:0/2571962419 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f08d0053580 0x7f08d0055a40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f08ec00d000 tx=0x7f08ec009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:30.907 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.890+0000 7f08e27fc700 1 -- 172.21.2.105:0/2571962419 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f08e8043490 con 0x7f08f00a7020 2021-11-12T05:41:31.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.998+0000 7f08f72ae700 1 -- 172.21.2.105:0/2571962419 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08f014bfe0 con 0x7f08f00a7020 2021-11-12T05:41:31.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:30.998+0000 7f08e27fc700 1 -- 172.21.2.105:0/2571962419 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f08e8015070 con 0x7f08f00a7020 2021-11-12T05:41:31.003 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:41:31.003 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4429,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/4118304786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":4118304786},{"type":"v1","addr":"172.21.2.115:6833","nonce":4118304786}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:41:07.250137+0000","modified":"2021-11-12T05:41:08.255185+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4908},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4908":{"gid":4908,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/2626499955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":2626499955},{"type":"v1","addr":"172.21.2.105:6835","nonce":2626499955}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-11-12T05:41:31.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.002+0000 7f08f72ae700 1 -- 172.21.2.105:0/2571962419 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f08d0053580 msgr2=0x7f08d0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:31.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.002+0000 7f08f72ae700 1 --2- 172.21.2.105:0/2571962419 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f08d0053580 0x7f08d0055a40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f08ec00d000 tx=0x7f08ec009040).stop 2021-11-12T05:41:31.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.002+0000 7f08f72ae700 1 -- 172.21.2.105:0/2571962419 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f08f00a7020 msgr2=0x7f08f014c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:31.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.002+0000 7f08f72ae700 1 --2- 172.21.2.105:0/2571962419 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f08f00a7020 0x7f08f014c7b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f08e80032f0 tx=0x7f08e8016000).stop 2021-11-12T05:41:31.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.002+0000 7f08f72ae700 1 -- 172.21.2.105:0/2571962419 shutdown_connections 2021-11-12T05:41:31.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.002+0000 7f08f72ae700 1 --2- 172.21.2.105:0/2571962419 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f08d0053580 0x7f08d0055a40 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:31.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.002+0000 7f08f72ae700 1 --2- 172.21.2.105:0/2571962419 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f08f00a7020 0x7f08f014c7b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:31.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.002+0000 7f08f72ae700 1 --2- 172.21.2.105:0/2571962419 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f08f00a7de0 0x7f08f014c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:31.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.002+0000 7f08f72ae700 1 --2- 172.21.2.105:0/2571962419 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f08d8005050 0x7f08f0060390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:31.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.002+0000 7f08f72ae700 1 -- 172.21.2.105:0/2571962419 >> 172.21.2.105:0/2571962419 conn(0x7f08f00b5370 msgr2=0x7f08f0145e30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:31.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.002+0000 7f08f72ae700 1 -- 172.21.2.105:0/2571962419 shutdown_connections 2021-11-12T05:41:31.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.002+0000 7f08f72ae700 1 -- 172.21.2.105:0/2571962419 wait complete. 2021-11-12T05:41:31.007 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 10 2021-11-12T05:41:31.009 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a cache drop 2021-11-12T05:41:31.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.058+0000 7f19e64a0700 1 Processor -- start 2021-11-12T05:41:31.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.058+0000 7f19e64a0700 1 -- start start 2021-11-12T05:41:31.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.058+0000 7f19e64a0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f19e00b37d0 0x7f19e0141500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:31.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.058+0000 7f19e64a0700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f19e01419f0 0x7f19e00b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:31.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.058+0000 7f19e64a0700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19e00b26e0 con 0x7f19e0060100 2021-11-12T05:41:31.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.058+0000 7f19e64a0700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19e00604e0 con 0x7f19e01419f0 2021-11-12T05:41:31.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.058+0000 7f19e64a0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e0145160 con 0x7f19e00b37d0 2021-11-12T05:41:31.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.058+0000 7f19e4a3d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f19e01419f0 0x7f19e00b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:31.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.058+0000 7f19e4a3d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f19e01419f0 0x7f19e00b3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44542/0 (socket says 172.21.2.105:44542) 2021-11-12T05:41:31.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19e4a3d700 1 -- 172.21.2.105:0/1411767539 learned_addr learned my addr 172.21.2.105:0/1411767539 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:31.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19e4a3d700 1 -- 172.21.2.105:0/1411767539 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f19e00b37d0 msgr2=0x7f19e0141500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:31.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19e4a3d700 1 --2- 172.21.2.105:0/1411767539 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f19e00b37d0 0x7f19e0141500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:31.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19e4a3d700 1 -- 172.21.2.105:0/1411767539 >> v1:172.21.2.115:6789/0 conn(0x7f19e0060100 legacy=0x7f19e00b1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:31.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19e4a3d700 1 -- 172.21.2.105:0/1411767539 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e0141060 con 0x7f19e01419f0 2021-11-12T05:41:31.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19e4a3d700 1 --2- 172.21.2.105:0/1411767539 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f19e01419f0 0x7f19e00b3f50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f19e0060db0 tx=0x7f19d8009290).ready entity=mon.0 client_cookie=da990e0a8270df40 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:31.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19deffd700 1 -- 172.21.2.105:0/1411767539 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19d800b860 con 0x7f19e01419f0 2021-11-12T05:41:31.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19deffd700 1 -- 172.21.2.105:0/1411767539 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d800b9c0 con 0x7f19e01419f0 2021-11-12T05:41:31.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19deffd700 1 -- 172.21.2.105:0/1411767539 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19d800bb70 con 0x7f19e01419f0 2021-11-12T05:41:31.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19e64a0700 1 -- 172.21.2.105:0/1411767539 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f19e01419f0 msgr2=0x7f19e00b3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:31.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19e64a0700 1 --2- 172.21.2.105:0/1411767539 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f19e01419f0 0x7f19e00b3f50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f19e0060db0 tx=0x7f19d8009290).stop 2021-11-12T05:41:31.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19e64a0700 1 -- 172.21.2.105:0/1411767539 shutdown_connections 2021-11-12T05:41:31.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19e64a0700 1 --2- 172.21.2.105:0/1411767539 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f19e01419f0 0x7f19e00b3f50 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:31.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19e64a0700 1 --2- 172.21.2.105:0/1411767539 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f19e00b37d0 0x7f19e0141500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:31.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19e64a0700 1 -- 172.21.2.105:0/1411767539 >> 172.21.2.105:0/1411767539 conn(0x7f19e00608d0 msgr2=0x7f19e005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:31.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19e64a0700 1 -- 172.21.2.105:0/1411767539 shutdown_connections 2021-11-12T05:41:31.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19e64a0700 1 -- 172.21.2.105:0/1411767539 wait complete. 2021-11-12T05:41:31.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19e64a0700 1 Processor -- start 2021-11-12T05:41:31.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19e64a0700 1 -- start start 2021-11-12T05:41:31.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19e64a0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f19e0060100 0x7f19e00b6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:31.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19e64a0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f19e00b37d0 0x7f19e00b0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:31.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19e64a0700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f19e01419f0 0x7f19e00b5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:31.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19e64a0700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e00b0f10 con 0x7f19e0060100 2021-11-12T05:41:31.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19e64a0700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e00b6dd0 con 0x7f19e01419f0 2021-11-12T05:41:31.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19e64a0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e00aff40 con 0x7f19e00b37d0 2021-11-12T05:41:31.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19dffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f19e0060100 0x7f19e00b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:31.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19dffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f19e0060100 0x7f19e00b6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44544/0 (socket says 172.21.2.105:44544) 2021-11-12T05:41:31.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19dffff700 1 -- 172.21.2.105:0/3419029391 learned_addr learned my addr 172.21.2.105:0/3419029391 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:31.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19dffff700 1 -- 172.21.2.105:0/3419029391 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f19e00b37d0 msgr2=0x7f19e00b0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:31.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19dffff700 1 --2- 172.21.2.105:0/3419029391 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f19e00b37d0 0x7f19e00b0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:31.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19dffff700 1 -- 172.21.2.105:0/3419029391 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f19e01419f0 msgr2=0x7f19e00b5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:31.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19dffff700 1 --2- 172.21.2.105:0/3419029391 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f19e01419f0 0x7f19e00b5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:31.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19dffff700 1 -- 172.21.2.105:0/3419029391 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d8009530 con 0x7f19e0060100 2021-11-12T05:41:31.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19dffff700 1 --2- 172.21.2.105:0/3419029391 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f19e0060100 0x7f19e00b6080 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f19d0002f90 tx=0x7f19d0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:31.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19dd7fa700 1 -- 172.21.2.105:0/3419029391 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19d0013460 con 0x7f19e0060100 2021-11-12T05:41:31.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19dd7fa700 1 -- 172.21.2.105:0/3419029391 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d00135c0 con 0x7f19e0060100 2021-11-12T05:41:31.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19e64a0700 1 -- 172.21.2.105:0/3419029391 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19e00b7000 con 0x7f19e0060100 2021-11-12T05:41:31.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19dd7fa700 1 -- 172.21.2.105:0/3419029391 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19d0013920 con 0x7f19e0060100 2021-11-12T05:41:31.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.062+0000 7f19e64a0700 1 -- 172.21.2.105:0/3419029391 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19e00b5d40 con 0x7f19e0060100 2021-11-12T05:41:31.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.066+0000 7f19dd7fa700 1 -- 172.21.2.105:0/3419029391 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f19d001a060 con 0x7f19e0060100 2021-11-12T05:41:31.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.066+0000 7f19dd7fa700 1 --2- 172.21.2.105:0/3419029391 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f19c4053640 0x7f19c4055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:31.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.066+0000 7f19dd7fa700 1 -- 172.21.2.105:0/3419029391 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f19d006b3c0 con 0x7f19e0060100 2021-11-12T05:41:31.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.066+0000 7f19df7fe700 1 --2- 172.21.2.105:0/3419029391 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f19c4053640 0x7f19c4055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:31.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.066+0000 7f19df7fe700 1 --2- 172.21.2.105:0/3419029391 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f19c4053640 0x7f19c4055b00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f19c8002f70 tx=0x7f19c8006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:31.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.066+0000 7f19f06e4740 1 Processor -- start 2021-11-12T05:41:31.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.066+0000 7f19f06e4740 1 -- start start 2021-11-12T05:41:31.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.066+0000 7f19f06e4740 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x1d94690 0x1d94a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:31.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.066+0000 7f19f06e4740 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x1d5af00 0x1d94f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:31.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.066+0000 7f19f06e4740 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x1d92950 0x1d8d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:31.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.066+0000 7f19f06e4740 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x1cce1f0 con 0x1d5af00 2021-11-12T05:41:31.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.066+0000 7f19f06e4740 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x1cae880 con 0x1d92950 2021-11-12T05:41:31.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.066+0000 7f19f06e4740 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x1d8e8b0 con 0x1d94690 2021-11-12T05:41:31.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.066+0000 7f19df7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x1d5af00 0x1d94f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:31.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.066+0000 7f19df7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x1d5af00 0x1d94f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44552/0 (socket says 172.21.2.105:44552) 2021-11-12T05:41:31.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.066+0000 7f19df7fe700 1 -- 172.21.2.105:0/3167171799 learned_addr learned my addr 172.21.2.105:0/3167171799 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:31.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.066+0000 7f19df7fe700 1 -- 172.21.2.105:0/3167171799 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x1d94690 msgr2=0x1d94a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:31.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.066+0000 7f19df7fe700 1 --2- 172.21.2.105:0/3167171799 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x1d94690 0x1d94a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:31.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.066+0000 7f19df7fe700 1 -- 172.21.2.105:0/3167171799 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x1d92950 msgr2=0x1d8d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:31.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.066+0000 7f19df7fe700 1 --2- 172.21.2.105:0/3167171799 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x1d92950 0x1d8d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:31.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.066+0000 7f19df7fe700 1 -- 172.21.2.105:0/3167171799 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1d06f30 con 0x1d5af00 2021-11-12T05:41:31.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.066+0000 7f19df7fe700 1 --2- 172.21.2.105:0/3167171799 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x1d5af00 0x1d94f60 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f19c8009ce0 tx=0x7f19c800f000).ready entity=mon.0 client_cookie=ef1e86c43dcd0811 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:31.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.066+0000 7f19e64a0700 1 -- 172.21.2.105:0/3167171799 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19c80158f0 con 0x1d5af00 2021-11-12T05:41:31.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.066+0000 7f19e64a0700 1 -- 172.21.2.105:0/3167171799 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c8015a50 con 0x1d5af00 2021-11-12T05:41:31.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.066+0000 7f19e64a0700 1 -- 172.21.2.105:0/3167171799 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19c8015db0 con 0x1d5af00 2021-11-12T05:41:31.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.066+0000 7f19f06e4740 1 -- 172.21.2.105:0/3167171799 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x1d5af00 msgr2=0x1d94f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:31.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.066+0000 7f19f06e4740 1 --2- 172.21.2.105:0/3167171799 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x1d5af00 0x1d94f60 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f19c8009ce0 tx=0x7f19c800f000).stop 2021-11-12T05:41:31.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.066+0000 7f19f06e4740 1 -- 172.21.2.105:0/3167171799 shutdown_connections 2021-11-12T05:41:31.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.066+0000 7f19f06e4740 1 --2- 172.21.2.105:0/3167171799 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x1d92950 0x1d8d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:31.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.066+0000 7f19f06e4740 1 --2- 172.21.2.105:0/3167171799 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x1d5af00 0x1d94f60 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:31.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.066+0000 7f19f06e4740 1 --2- 172.21.2.105:0/3167171799 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x1d94690 0x1d94a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:31.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.066+0000 7f19f06e4740 1 -- 172.21.2.105:0/3167171799 >> 172.21.2.105:0/3167171799 conn(0x1d0c5d0 msgr2=0x1d60880 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:31.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.066+0000 7f19f06e4740 1 -- 172.21.2.105:0/3167171799 shutdown_connections 2021-11-12T05:41:31.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.066+0000 7f19f06e4740 1 -- 172.21.2.105:0/3167171799 wait complete. 2021-11-12T05:41:31.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19f06e4740 1 -- start start 2021-11-12T05:41:31.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19f06e4740 1 Processor -- start 2021-11-12T05:41:31.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19f06e4740 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x1d5af00 0x1d97ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:31.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19f06e4740 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x1d92950 0x1dab730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:31.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19f06e4740 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x1d94690 0x1dabc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:31.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19f06e4740 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d987c0 con 0x1d5af00 2021-11-12T05:41:31.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19f06e4740 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d8b620 con 0x1d92950 2021-11-12T05:41:31.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19f06e4740 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x1d8b8c0 con 0x1d94690 2021-11-12T05:41:31.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19f06e4740 10 client.0 ll_register_callbacks cb 0x1d0cc00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-11-12T05:41:31.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19dffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x1d5af00 0x1d97ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:31.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19dffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x1d5af00 0x1d97ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44560/0 (socket says 172.21.2.105:44560) 2021-11-12T05:41:31.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19dffff700 1 -- 172.21.2.105:0/2219616407 learned_addr learned my addr 172.21.2.105:0/2219616407 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:31.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19df7fe700 1 --2- 172.21.2.105:0/2219616407 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x1d92950 0x1dab730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:31.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19dffff700 1 -- 172.21.2.105:0/2219616407 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x1d94690 msgr2=0x1dabc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:31.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19dffff700 1 --2- 172.21.2.105:0/2219616407 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x1d94690 0x1dabc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:31.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19dffff700 1 -- 172.21.2.105:0/2219616407 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x1d92950 msgr2=0x1dab730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:31.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19dffff700 1 --2- 172.21.2.105:0/2219616407 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x1d92950 0x1dab730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:31.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19dffff700 1 -- 172.21.2.105:0/2219616407 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c8013530 con 0x1d5af00 2021-11-12T05:41:31.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19dffff700 1 --2- 172.21.2.105:0/2219616407 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x1d5af00 0x1d97ea0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f19d006b5d0 tx=0x7f19d000f000).ready entity=mon.0 client_cookie=798c5935f439eef server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:31.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19beffd700 10 client.0 ms_handle_connect on v2:172.21.2.105:3300/0 2021-11-12T05:41:31.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19beffd700 1 -- 172.21.2.105:0/2219616407 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19d006b1e0 con 0x1d5af00 2021-11-12T05:41:31.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19beffd700 1 -- 172.21.2.105:0/2219616407 <== mon.0 v2:172.21.2.105:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f19d0013a80 con 0x1d5af00 2021-11-12T05:41:31.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19f06e4740 1 -- 172.21.2.105:0/2219616407 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1cc41d0 con 0x1d5af00 2021-11-12T05:41:31.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19beffd700 1 -- 172.21.2.105:0/2219616407 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=10) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19d0013c40 con 0x1d5af00 2021-11-12T05:41:31.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19f06e4740 10 client.5139 fetch_fsmap learned FSMap version 10 2021-11-12T05:41:31.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19f06e4740 1 -- 172.21.2.105:0/2219616407 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) v3 -- 0x1cbdab0 con 0x1d5af00 2021-11-12T05:41:31.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19beffd700 1 -- 172.21.2.105:0/2219616407 <== mon.0 v2:172.21.2.105:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1cc41d0 con 0x1d5af00 2021-11-12T05:41:31.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19beffd700 1 -- 172.21.2.105:0/2219616407 <== mon.0 v2:172.21.2.105:3300/0 5 ==== fsmap(e 10) v1 ==== 1247+0+0 (secure 0 0 0) 0x7f19d00446f0 con 0x1d5af00 2021-11-12T05:41:31.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19f06e4740 10 client.5139 fetch_fsmap finished waiting for FSMap version 10 2021-11-12T05:41:31.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19f06e4740 10 client.5139 resolve_mds: resolved ID 'a' to GID 4908 2021-11-12T05:41:31.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19f06e4740 20 client.5139 populate_metadata read hostname 'gibba005' 2021-11-12T05:41:31.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19f06e4740 1 --2- 172.21.2.105:0/2219616407 >> [v2:172.21.2.105:6834/2626499955,v1:172.21.2.105:6835/2626499955] conn(0x1d8a530 0x1d8a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:31.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19f06e4740 4 client.5139 mds_command: new command op to 4908 tid=0[{"prefix": "get_command_descriptions"}] 2021-11-12T05:41:31.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19f06e4740 1 -- 172.21.2.105:0/2219616407 --> [v2:172.21.2.105:6834/2626499955,v1:172.21.2.105:6835/2626499955] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1cbc540 con 0x1d8a530 2021-11-12T05:41:31.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19df7fe700 1 --2- 172.21.2.105:0/2219616407 >> [v2:172.21.2.105:6834/2626499955,v1:172.21.2.105:6835/2626499955] conn(0x1d8a530 0x1d8a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:31.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19beffd700 10 client.5139 ms_handle_connect on v2:172.21.2.105:6834/2626499955 2021-11-12T05:41:31.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19df7fe700 1 --2- 172.21.2.105:0/2219616407 >> [v2:172.21.2.105:6834/2626499955,v1:172.21.2.105:6835/2626499955] conn(0x1d8a530 0x1d8a910 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d228286a4c4d9658 server_cookie=f324f2f83106ef3a in_seq=0 out_seq=0 2021-11-12T05:41:31.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19beffd700 1 -- 172.21.2.105:0/2219616407 <== mds.0 v2:172.21.2.105:6834/2626499955 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x1cbc540 con 0x1d8a530 2021-11-12T05:41:31.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19beffd700 10 client.5139 handle_command_reply: tid=0 2021-11-12T05:41:31.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19f06e4740 1 client.5139 shutdown 2021-11-12T05:41:31.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19f06e4740 1 -- 172.21.2.105:0/2219616407 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x1d5af00 msgr2=0x1d97ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:31.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19f06e4740 1 --2- 172.21.2.105:0/2219616407 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x1d5af00 0x1d97ea0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f19d006b5d0 tx=0x7f19d000f000).stop 2021-11-12T05:41:31.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19f06e4740 1 -- 172.21.2.105:0/2219616407 shutdown_connections 2021-11-12T05:41:31.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19f06e4740 1 --2- 172.21.2.105:0/2219616407 >> [v2:172.21.2.105:6834/2626499955,v1:172.21.2.105:6835/2626499955] conn(0x1d8a530 0x1d8a910 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:31.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19f06e4740 1 --2- 172.21.2.105:0/2219616407 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x1d94690 0x1dabc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:31.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19f06e4740 1 --2- 172.21.2.105:0/2219616407 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x1d92950 0x1dab730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:31.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19f06e4740 1 --2- 172.21.2.105:0/2219616407 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x1d5af00 0x1d97ea0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:31.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19f06e4740 1 -- 172.21.2.105:0/2219616407 >> 172.21.2.105:0/2219616407 conn(0x1d0c5d0 msgr2=0x1d94a70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:31.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19beffd700 0 client.5139 ms_handle_reset on v2:172.21.2.105:6834/2626499955 2021-11-12T05:41:31.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19f06e4740 1 -- 172.21.2.105:0/2219616407 shutdown_connections 2021-11-12T05:41:31.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19f06e4740 1 -- 172.21.2.105:0/2219616407 wait complete. 2021-11-12T05:41:31.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.070+0000 7f19f06e4740 20 client.5139 trim_cache size 0 max 16384 2021-11-12T05:41:31.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.078+0000 7f19f06e4740 1 Processor -- start 2021-11-12T05:41:31.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.078+0000 7f19f06e4740 1 -- start start 2021-11-12T05:41:31.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.078+0000 7f19f06e4740 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x1d5af00 0x1dab380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:31.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.078+0000 7f19f06e4740 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x1d92950 0x1d5b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:31.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.078+0000 7f19f06e4740 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x1d94690 0x1d5baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:31.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.078+0000 7f19f06e4740 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x1daae60 con 0x1d5af00 2021-11-12T05:41:31.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.078+0000 7f19f06e4740 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d95180 con 0x1d92950 2021-11-12T05:41:31.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.078+0000 7f19f06e4740 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x1cbc540 con 0x1d94690 2021-11-12T05:41:31.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.078+0000 7f19dffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x1d5af00 0x1dab380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:31.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.078+0000 7f19dffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x1d5af00 0x1dab380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44570/0 (socket says 172.21.2.105:44570) 2021-11-12T05:41:31.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.078+0000 7f19dffff700 1 -- 172.21.2.105:0/1824086272 learned_addr learned my addr 172.21.2.105:0/1824086272 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:31.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.078+0000 7f19dffff700 1 -- 172.21.2.105:0/1824086272 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x1d94690 msgr2=0x1d5baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:31.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.078+0000 7f19dffff700 1 --2- 172.21.2.105:0/1824086272 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x1d94690 0x1d5baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:31.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.078+0000 7f19dffff700 1 -- 172.21.2.105:0/1824086272 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x1d92950 msgr2=0x1d5b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:31.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.078+0000 7f19dffff700 1 --2- 172.21.2.105:0/1824086272 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x1d92950 0x1d5b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:31.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.078+0000 7f19dffff700 1 -- 172.21.2.105:0/1824086272 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1cc63b0 con 0x1d5af00 2021-11-12T05:41:31.110 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.078+0000 7f19dffff700 1 --2- 172.21.2.105:0/1824086272 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x1d5af00 0x1dab380 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f19d006b5d0 tx=0x7f19d006a000).ready entity=mon.0 client_cookie=4cb8c9973c93dff1 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:31.110 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.078+0000 7f19d57fa700 1 -- 172.21.2.105:0/1824086272 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19d005a070 con 0x1d5af00 2021-11-12T05:41:31.110 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.078+0000 7f19d57fa700 1 -- 172.21.2.105:0/1824086272 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d0042160 con 0x1d5af00 2021-11-12T05:41:31.110 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.078+0000 7f19d57fa700 1 -- 172.21.2.105:0/1824086272 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19d0045200 con 0x1d5af00 2021-11-12T05:41:31.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19f06e4740 1 -- 172.21.2.105:0/1824086272 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x1d5af00 msgr2=0x1dab380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:41:31.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19f06e4740 1 --2- 172.21.2.105:0/1824086272 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x1d5af00 0x1dab380 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f19d006b5d0 tx=0x7f19d006a000).stop 2021-11-12T05:41:31.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19f06e4740 1 -- 172.21.2.105:0/1824086272 shutdown_connections 2021-11-12T05:41:31.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19f06e4740 1 --2- 172.21.2.105:0/1824086272 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x1d94690 0x1d5baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:31.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19f06e4740 1 --2- 172.21.2.105:0/1824086272 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x1d92950 0x1d5b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:31.112 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19f06e4740 1 --2- 172.21.2.105:0/1824086272 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x1d5af00 0x1dab380 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:41:31.112 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19f06e4740 1 -- 172.21.2.105:0/1824086272 >> 172.21.2.105:0/1824086272 conn(0x1d0c5d0 msgr2=0x1d94a70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:41:31.112 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19f06e4740 1 -- 172.21.2.105:0/1824086272 shutdown_connections 2021-11-12T05:41:31.112 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19f06e4740 1 -- 172.21.2.105:0/1824086272 wait complete. 2021-11-12T05:41:31.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19f06e4740 1 -- start start 2021-11-12T05:41:31.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19f06e4740 1 Processor -- start 2021-11-12T05:41:31.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19f06e4740 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x1d5af00 0x1d889d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:31.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19f06e4740 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x1d92950 0x1d5bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:31.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19f06e4740 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x1d94690 0x1dfd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:31.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19f06e4740 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x1dbab00 con 0x1d92950 2021-11-12T05:41:31.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19f06e4740 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x1dbada0 con 0x1d94690 2021-11-12T05:41:31.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19f06e4740 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x1dbb040 con 0x1d5af00 2021-11-12T05:41:31.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19f06e4740 10 client.0 ll_register_callbacks cb 0x1d97270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-11-12T05:41:31.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19df7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x1d92950 0x1d5bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:31.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19df7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x1d92950 0x1d5bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44574/0 (socket says 172.21.2.105:44574) 2021-11-12T05:41:31.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19df7fe700 1 -- 172.21.2.105:0/4293423368 learned_addr learned my addr 172.21.2.105:0/4293423368 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:41:31.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19df7fe700 1 -- 172.21.2.105:0/4293423368 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x1d5af00 msgr2=0x1d889d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:31.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19df7fe700 1 --2- 172.21.2.105:0/4293423368 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x1d5af00 0x1d889d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:31.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19df7fe700 1 -- 172.21.2.105:0/4293423368 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x1d94690 msgr2=0x1dfd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:41:31.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19df7fe700 1 --2- 172.21.2.105:0/4293423368 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x1d94690 0x1dfd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:41:31.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19df7fe700 1 -- 172.21.2.105:0/4293423368 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1cbdab0 con 0x1d92950 2021-11-12T05:41:31.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19df7fe700 1 --2- 172.21.2.105:0/4293423368 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x1d92950 0x1d5bb20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f19c8016000 tx=0x7f19c8012000).ready entity=mon.0 client_cookie=1cac918c185d572e server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:41:31.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19bffff700 10 client.0 ms_handle_connect on v2:172.21.2.105:3300/0 2021-11-12T05:41:31.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19bffff700 1 -- 172.21.2.105:0/4293423368 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19c8015dd0 con 0x1d92950 2021-11-12T05:41:31.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19bffff700 1 -- 172.21.2.105:0/4293423368 <== mon.0 v2:172.21.2.105:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f19c802c5c0 con 0x1d92950 2021-11-12T05:41:31.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19f06e4740 1 -- 172.21.2.105:0/4293423368 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f19c8015a50 con 0x1d92950 2021-11-12T05:41:31.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19bffff700 1 -- 172.21.2.105:0/4293423368 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=10) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19c802c780 con 0x1d92950 2021-11-12T05:41:31.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19f06e4740 10 client.5145 fetch_fsmap learned FSMap version 10 2021-11-12T05:41:31.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19f06e4740 1 -- 172.21.2.105:0/4293423368 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) v3 -- 0x1cc2da0 con 0x1d92950 2021-11-12T05:41:31.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19bffff700 1 -- 172.21.2.105:0/4293423368 <== mon.0 v2:172.21.2.105:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c8015a50 con 0x1d92950 2021-11-12T05:41:31.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19bffff700 1 -- 172.21.2.105:0/4293423368 <== mon.0 v2:172.21.2.105:3300/0 5 ==== fsmap(e 10) v1 ==== 1247+0+0 (secure 0 0 0) 0x7f19c8033070 con 0x1d92950 2021-11-12T05:41:31.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19f06e4740 10 client.5145 fetch_fsmap finished waiting for FSMap version 10 2021-11-12T05:41:31.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19f06e4740 10 client.5145 resolve_mds: resolved ID 'a' to GID 4908 2021-11-12T05:41:31.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19f06e4740 20 client.5145 populate_metadata read hostname 'gibba005' 2021-11-12T05:41:31.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19f06e4740 1 --2- 172.21.2.105:0/4293423368 >> [v2:172.21.2.105:6834/2626499955,v1:172.21.2.105:6835/2626499955] conn(0x1dfdba0 0x1e01b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:41:31.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19f06e4740 4 client.5145 mds_command: new command op to 4908 tid=0[{"prefix": "cache drop"}] 2021-11-12T05:41:31.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19f06e4740 1 -- 172.21.2.105:0/4293423368 --> [v2:172.21.2.105:6834/2626499955,v1:172.21.2.105:6835/2626499955] -- command(tid 0: {"prefix": "cache drop"}) v1 -- 0x1bb2590 con 0x1dfdba0 2021-11-12T05:41:31.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19dffff700 1 --2- 172.21.2.105:0/4293423368 >> [v2:172.21.2.105:6834/2626499955,v1:172.21.2.105:6835/2626499955] conn(0x1dfdba0 0x1e01b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:41:31.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19dffff700 1 --2- 172.21.2.105:0/4293423368 >> [v2:172.21.2.105:6834/2626499955,v1:172.21.2.105:6835/2626499955] conn(0x1dfdba0 0x1e01b30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=711bb6836069c8c7 server_cookie=a8836844f45a2cfd in_seq=0 out_seq=0 2021-11-12T05:41:31.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:41:31.082+0000 7f19bffff700 10 client.5145 ms_handle_connect on v2:172.21.2.105:6834/2626499955 2021-11-12T05:41:54.224 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:41:54.228 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:41:54.232 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:41:54.235 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:41:54.239 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:42:15.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.407+0000 7f19bffff700 1 -- 172.21.2.105:0/4293423368 <== mds.0 v2:172.21.2.105:6834/2626499955 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+386 (crc 0 0 0) 0x1bb2590 con 0x1dfdba0 2021-11-12T05:42:15.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.407+0000 7f19bffff700 10 client.5145 handle_command_reply: tid=0 2021-11-12T05:42:15.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.407+0000 7f19f06e4740 1 client.5145 shutdown 2021-11-12T05:42:15.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.407+0000 7f19f06e4740 1 -- 172.21.2.105:0/4293423368 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x1d92950 msgr2=0x1d5bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:15.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.407+0000 7f19f06e4740 1 --2- 172.21.2.105:0/4293423368 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x1d92950 0x1d5bb20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f19c8016000 tx=0x7f19c8012000).stop 2021-11-12T05:42:15.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.407+0000 7f19f06e4740 1 -- 172.21.2.105:0/4293423368 shutdown_connections 2021-11-12T05:42:15.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.407+0000 7f19f06e4740 1 --2- 172.21.2.105:0/4293423368 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x1d94690 0x1dfd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:15.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.407+0000 7f19f06e4740 1 --2- 172.21.2.105:0/4293423368 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x1d92950 0x1d5bb20 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:15.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.407+0000 7f19f06e4740 1 --2- 172.21.2.105:0/4293423368 >> [v2:172.21.2.105:6834/2626499955,v1:172.21.2.105:6835/2626499955] conn(0x1dfdba0 0x1e01b30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:15.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.407+0000 7f19f06e4740 1 --2- 172.21.2.105:0/4293423368 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x1d5af00 0x1d889d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:15.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.407+0000 7f19f06e4740 1 -- 172.21.2.105:0/4293423368 >> 172.21.2.105:0/4293423368 conn(0x1d0c5d0 msgr2=0x1dab380 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:15.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.407+0000 7f19bffff700 0 client.5145 ms_handle_reset on v2:172.21.2.105:6834/2626499955 2021-11-12T05:42:15.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.407+0000 7f19f06e4740 1 -- 172.21.2.105:0/4293423368 shutdown_connections 2021-11-12T05:42:15.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.407+0000 7f19f06e4740 1 -- 172.21.2.105:0/4293423368 wait complete. 2021-11-12T05:42:15.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.407+0000 7f19f06e4740 20 client.5145 trim_cache size 0 max 16384 2021-11-12T05:42:15.416 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:42:15.416 INFO:teuthology.orchestra.run.gibba005.stdout: "client_recall": { 2021-11-12T05:42:15.416 INFO:teuthology.orchestra.run.gibba005.stdout: "return_code": 0, 2021-11-12T05:42:15.416 INFO:teuthology.orchestra.run.gibba005.stdout: "message": "(0) Success", 2021-11-12T05:42:15.417 INFO:teuthology.orchestra.run.gibba005.stdout: "recalled": 920 2021-11-12T05:42:15.417 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:15.417 INFO:teuthology.orchestra.run.gibba005.stdout: "flush_journal": { 2021-11-12T05:42:15.417 INFO:teuthology.orchestra.run.gibba005.stdout: "return_code": 0, 2021-11-12T05:42:15.418 INFO:teuthology.orchestra.run.gibba005.stdout: "message": "" 2021-11-12T05:42:15.418 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:15.418 INFO:teuthology.orchestra.run.gibba005.stdout: "trim_cache": { 2021-11-12T05:42:15.418 INFO:teuthology.orchestra.run.gibba005.stdout: "trimmed": 900 2021-11-12T05:42:15.418 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:15.419 INFO:teuthology.orchestra.run.gibba005.stdout: "cache": { 2021-11-12T05:42:15.419 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": { 2021-11-12T05:42:15.419 INFO:teuthology.orchestra.run.gibba005.stdout: "items": 2489, 2021-11-12T05:42:15.419 INFO:teuthology.orchestra.run.gibba005.stdout: "bytes": 431632 2021-11-12T05:42:15.419 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:15.420 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:15.420 INFO:teuthology.orchestra.run.gibba005.stdout: "duration": 44.325543140999997 2021-11-12T05:42:15.420 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:42:15.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.407+0000 7f19e64a0700 1 -- 172.21.2.105:0/3419029391 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f19c4053640 msgr2=0x7f19c4055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:15.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.407+0000 7f19e64a0700 1 --2- 172.21.2.105:0/3419029391 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f19c4053640 0x7f19c4055b00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f19c8002f70 tx=0x7f19c8006a80).stop 2021-11-12T05:42:15.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.407+0000 7f19e64a0700 1 -- 172.21.2.105:0/3419029391 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f19e0060100 msgr2=0x7f19e00b6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:15.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.407+0000 7f19e64a0700 1 --2- 172.21.2.105:0/3419029391 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f19e0060100 0x7f19e00b6080 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f19d0002f90 tx=0x7f19d0006df0).stop 2021-11-12T05:42:15.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.407+0000 7f19e64a0700 1 -- 172.21.2.105:0/3419029391 shutdown_connections 2021-11-12T05:42:15.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.407+0000 7f19e64a0700 1 --2- 172.21.2.105:0/3419029391 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f19c4053640 0x7f19c4055b00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:15.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.407+0000 7f19e64a0700 1 --2- 172.21.2.105:0/3419029391 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f19e01419f0 0x7f19e00b5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:15.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.407+0000 7f19e64a0700 1 --2- 172.21.2.105:0/3419029391 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f19e00b37d0 0x7f19e00b0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:15.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.407+0000 7f19e64a0700 1 --2- 172.21.2.105:0/3419029391 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f19e0060100 0x7f19e00b6080 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:15.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.407+0000 7f19e64a0700 1 -- 172.21.2.105:0/3419029391 >> 172.21.2.105:0/3419029391 conn(0x7f19e00608d0 msgr2=0x7f19e0129e40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:15.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.407+0000 7f19e64a0700 1 -- 172.21.2.105:0/3419029391 shutdown_connections 2021-11-12T05:42:15.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.407+0000 7f19e64a0700 1 -- 172.21.2.105:0/3419029391 wait complete. 2021-11-12T05:42:15.424 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-12T05:42:15.425 DEBUG:teuthology.orchestra.run.gibba005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:42:15.433 DEBUG:teuthology.orchestra.run.gibba015:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:42:15.462 DEBUG:teuthology.orchestra.run.gibba016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:42:15.475 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:42:15.489 DEBUG:teuthology.orchestra.run.gibba044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:42:15.502 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-12T05:42:15.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:42:15.503 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:42:15.504 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:42:15.523 INFO:teuthology.orchestra.run.gibba016.stdout:fuseblk 2021-11-12T05:42:15.523 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-12T05:42:15.524 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba016.front.sepia.ceph.com... 2021-11-12T05:42:15.524 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-12T05:42:15.524 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:42:15.535 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[14058]: fuse finished with error 0 and tester_r 0 2021-11-12T05:42:15.536 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:42:15.537 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:42:15.537 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:42:15.542 INFO:teuthology.orchestra.run.gibba016.stdout:ext2/ext3 2021-11-12T05:42:15.542 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-12T05:42:15.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:42:15.586 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:42:15.590 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:42:15.591 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:42:15.591 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:42:15.600 INFO:teuthology.orchestra.run.gibba038.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-12T05:42:15.601 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:42:15.602 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-12T05:42:15.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:42:15.603 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:42:15.653 INFO:teuthology.orchestra.run.gibba038.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-12T05:42:15.653 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:42:15.654 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:42:15.655 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:42:15.655 DEBUG:teuthology.orchestra.run.gibba044:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:42:15.665 INFO:teuthology.orchestra.run.gibba044.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-12T05:42:15.666 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:42:15.667 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-12T05:42:15.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:42:15.668 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:42:15.676 INFO:teuthology.orchestra.run.gibba044.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-12T05:42:15.677 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:42:15.678 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-12T05:42:15.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.787+0000 7f9df199f700 1 Processor -- start 2021-11-12T05:42:15.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.787+0000 7f9df199f700 1 -- start start 2021-11-12T05:42:15.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.787+0000 7f9df199f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9dec13cab0 0x7f9dec1435d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:15.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.787+0000 7f9df199f700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f9dec13ce90 0x7f9dec1441e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:15.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.787+0000 7f9df199f700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dec0af3f0 con 0x7f9dec0aeea0 2021-11-12T05:42:15.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.787+0000 7f9df199f700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dec0ba440 con 0x7f9dec13ce90 2021-11-12T05:42:15.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.787+0000 7f9df199f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec142e90 con 0x7f9dec13cab0 2021-11-12T05:42:15.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.787+0000 7f9df099d700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9dec13cab0 0x7f9dec1435d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:15.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.787+0000 7f9df119e700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f9dec13ce90 0x7f9dec1441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:15.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.787+0000 7f9debfff700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7f9dec0aeea0 0x7f9dec0b9d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:53448/0 (socket says 172.21.2.105:53448) 2021-11-12T05:42:15.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.787+0000 7f9debfff700 1 -- 172.21.2.105:0/1969052452 learned_addr learned my addr 172.21.2.105:0/1969052452 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:42:15.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.791+0000 7f9df099d700 1 -- 172.21.2.105:0/1969052452 >> v2:172.21.2.115:3300/0 conn(0x7f9dec13ce90 msgr2=0x7f9dec1441e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:15.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.791+0000 7f9df099d700 1 --2- 172.21.2.105:0/1969052452 >> v2:172.21.2.115:3300/0 conn(0x7f9dec13ce90 0x7f9dec1441e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:15.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.791+0000 7f9df099d700 1 -- 172.21.2.105:0/1969052452 >> v1:172.21.2.115:6789/0 conn(0x7f9dec0aeea0 legacy=0x7f9dec0b9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:15.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.791+0000 7f9df099d700 1 -- 172.21.2.105:0/1969052452 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dec143130 con 0x7f9dec13cab0 2021-11-12T05:42:15.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.791+0000 7f9df099d700 1 --2- 172.21.2.105:0/1969052452 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9dec13cab0 0x7f9dec1435d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f9dd4002f70 tx=0x7f9dd4006df0).ready entity=mon.2 client_cookie=54565f7293d08bb4 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:15.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.791+0000 7f9deb7fe700 1 -- 172.21.2.105:0/1969052452 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dd400d570 con 0x7f9dec13cab0 2021-11-12T05:42:15.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.791+0000 7f9deb7fe700 1 -- 172.21.2.105:0/1969052452 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd4000e90 con 0x7f9dec13cab0 2021-11-12T05:42:15.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.791+0000 7f9deb7fe700 1 -- 172.21.2.105:0/1969052452 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dd400d8c0 con 0x7f9dec13cab0 2021-11-12T05:42:15.802 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.791+0000 7f9df199f700 1 -- 172.21.2.105:0/1969052452 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9dec13cab0 msgr2=0x7f9dec1435d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:15.802 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.791+0000 7f9df199f700 1 --2- 172.21.2.105:0/1969052452 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9dec13cab0 0x7f9dec1435d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f9dd4002f70 tx=0x7f9dd4006df0).stop 2021-11-12T05:42:15.802 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.791+0000 7f9df199f700 1 -- 172.21.2.105:0/1969052452 shutdown_connections 2021-11-12T05:42:15.802 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.791+0000 7f9df199f700 1 --2- 172.21.2.105:0/1969052452 >> v2:172.21.2.115:3300/0 conn(0x7f9dec13ce90 0x7f9dec1441e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:15.803 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.791+0000 7f9df199f700 1 --2- 172.21.2.105:0/1969052452 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9dec13cab0 0x7f9dec1435d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:15.803 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.791+0000 7f9df199f700 1 -- 172.21.2.105:0/1969052452 >> 172.21.2.105:0/1969052452 conn(0x7f9dec05c490 msgr2=0x7f9dec0b9620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:15.803 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.791+0000 7f9df199f700 1 -- 172.21.2.105:0/1969052452 shutdown_connections 2021-11-12T05:42:15.803 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.791+0000 7f9df199f700 1 -- 172.21.2.105:0/1969052452 wait complete. 2021-11-12T05:42:15.804 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.791+0000 7f9df199f700 1 Processor -- start 2021-11-12T05:42:15.804 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.791+0000 7f9df199f700 1 -- start start 2021-11-12T05:42:15.804 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.791+0000 7f9df199f700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9dec0aeea0 0x7f9dec0b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:15.804 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.791+0000 7f9df199f700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9dec13cab0 0x7f9dec13f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:15.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.791+0000 7f9df199f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9dec13ce90 0x7f9dec13f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:15.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.791+0000 7f9df199f700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec152de0 con 0x7f9dec13cab0 2021-11-12T05:42:15.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.791+0000 7f9df199f700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec0b3830 con 0x7f9dec0aeea0 2021-11-12T05:42:15.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.791+0000 7f9df199f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec140270 con 0x7f9dec13ce90 2021-11-12T05:42:15.806 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.791+0000 7f9debfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9dec13cab0 0x7f9dec13f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:15.806 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.795+0000 7f9debfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9dec13cab0 0x7f9dec13f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44592/0 (socket says 172.21.2.105:44592) 2021-11-12T05:42:15.806 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.795+0000 7f9debfff700 1 -- 172.21.2.105:0/1652271806 learned_addr learned my addr 172.21.2.105:0/1652271806 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:15.806 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.795+0000 7f9df099d700 1 --2- 172.21.2.105:0/1652271806 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9dec0aeea0 0x7f9dec0b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:15.807 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.795+0000 7f9df119e700 1 --2- 172.21.2.105:0/1652271806 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9dec13ce90 0x7f9dec13f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:15.807 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.795+0000 7f9debfff700 1 -- 172.21.2.105:0/1652271806 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9dec13ce90 msgr2=0x7f9dec13f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:15.807 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.795+0000 7f9debfff700 1 --2- 172.21.2.105:0/1652271806 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9dec13ce90 0x7f9dec13f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:15.807 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.795+0000 7f9debfff700 1 -- 172.21.2.105:0/1652271806 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9dec0aeea0 msgr2=0x7f9dec0b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:15.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.795+0000 7f9debfff700 1 --2- 172.21.2.105:0/1652271806 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9dec0aeea0 0x7f9dec0b2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:15.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.795+0000 7f9debfff700 1 -- 172.21.2.105:0/1652271806 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd400b180 con 0x7f9dec13cab0 2021-11-12T05:42:15.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.795+0000 7f9df119e700 1 --2- 172.21.2.105:0/1652271806 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9dec13ce90 0x7f9dec13f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:42:15.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.795+0000 7f9debfff700 1 --2- 172.21.2.105:0/1652271806 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9dec13cab0 0x7f9dec13f2e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f9dec0b71c0 tx=0x7f9ddc007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:15.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.795+0000 7f9de9ffb700 1 -- 172.21.2.105:0/1652271806 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ddc00ce30 con 0x7f9dec13cab0 2021-11-12T05:42:15.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.795+0000 7f9de9ffb700 1 -- 172.21.2.105:0/1652271806 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ddc0072e0 con 0x7f9dec13cab0 2021-11-12T05:42:15.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.795+0000 7f9df199f700 1 -- 172.21.2.105:0/1652271806 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dec0b3590 con 0x7f9dec13cab0 2021-11-12T05:42:15.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.795+0000 7f9de9ffb700 1 -- 172.21.2.105:0/1652271806 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ddc005800 con 0x7f9dec13cab0 2021-11-12T05:42:15.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.795+0000 7f9df199f700 1 -- 172.21.2.105:0/1652271806 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dec0b3220 con 0x7f9dec13cab0 2021-11-12T05:42:15.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.795+0000 7f9df199f700 1 -- 172.21.2.105:0/1652271806 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dec057350 con 0x7f9dec13cab0 2021-11-12T05:42:15.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.795+0000 7f9de9ffb700 1 -- 172.21.2.105:0/1652271806 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9ddc010070 con 0x7f9dec13cab0 2021-11-12T05:42:15.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.795+0000 7f9de9ffb700 1 --2- 172.21.2.105:0/1652271806 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9dd00536a0 0x7f9dd0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:15.811 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.795+0000 7f9de9ffb700 1 -- 172.21.2.105:0/1652271806 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f9ddc06b130 con 0x7f9dec13cab0 2021-11-12T05:42:15.811 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.795+0000 7f9df099d700 1 --2- 172.21.2.105:0/1652271806 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9dd00536a0 0x7f9dd0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:15.811 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.795+0000 7f9df099d700 1 --2- 172.21.2.105:0/1652271806 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9dd00536a0 0x7f9dd0055b60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f9dd4018000 tx=0x7f9dd4014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:15.812 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.799+0000 7f9de9ffb700 1 -- 172.21.2.105:0/1652271806 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9ddc042140 con 0x7f9dec13cab0 2021-11-12T05:42:15.884 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.879+0000 7f9df199f700 1 -- 172.21.2.105:0/1652271806 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f9dec152f20 con 0x7f9dec13cab0 2021-11-12T05:42:15.885 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.879+0000 7f9de9ffb700 1 -- 172.21.2.105:0/1652271806 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v35) v1 ==== 81+0+34037 (secure 0 0 0) 0x7f9ddc045760 con 0x7f9dec13cab0 2021-11-12T05:42:15.886 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:42:15.886 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:42:15.887 INFO:teuthology.orchestra.run.gibba005.stdout: "epoch": 35, 2021-11-12T05:42:15.887 INFO:teuthology.orchestra.run.gibba005.stdout: "fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", 2021-11-12T05:42:15.887 INFO:teuthology.orchestra.run.gibba005.stdout: "created": "2021-11-12T05:40:19.986390+0000", 2021-11-12T05:42:15.887 INFO:teuthology.orchestra.run.gibba005.stdout: "modified": "2021-11-12T05:41:09.267002+0000", 2021-11-12T05:42:15.887 INFO:teuthology.orchestra.run.gibba005.stdout: "last_up_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:42:15.888 INFO:teuthology.orchestra.run.gibba005.stdout: "last_in_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:42:15.888 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-12T05:42:15.888 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_num": 5799936, 2021-11-12T05:42:15.888 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_set": [ 2021-11-12T05:42:15.888 INFO:teuthology.orchestra.run.gibba005.stdout: "pglog_hardlimit", 2021-11-12T05:42:15.889 INFO:teuthology.orchestra.run.gibba005.stdout: "purged_snapdirs", 2021-11-12T05:42:15.889 INFO:teuthology.orchestra.run.gibba005.stdout: "recovery_deletes", 2021-11-12T05:42:15.889 INFO:teuthology.orchestra.run.gibba005.stdout: "sortbitwise" 2021-11-12T05:42:15.889 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:42:15.890 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_version": 5, 2021-11-12T05:42:15.890 INFO:teuthology.orchestra.run.gibba005.stdout: "full_ratio": 0.94999998807907104, 2021-11-12T05:42:15.890 INFO:teuthology.orchestra.run.gibba005.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-12T05:42:15.890 INFO:teuthology.orchestra.run.gibba005.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-12T05:42:15.890 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_snapshot": "", 2021-11-12T05:42:15.891 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_max": 6, 2021-11-12T05:42:15.891 INFO:teuthology.orchestra.run.gibba005.stdout: "max_osd": 8, 2021-11-12T05:42:15.891 INFO:teuthology.orchestra.run.gibba005.stdout: "require_min_compat_client": "jewel", 2021-11-12T05:42:15.891 INFO:teuthology.orchestra.run.gibba005.stdout: "min_compat_client": "jewel", 2021-11-12T05:42:15.891 INFO:teuthology.orchestra.run.gibba005.stdout: "require_osd_release": "octopus", 2021-11-12T05:42:15.892 INFO:teuthology.orchestra.run.gibba005.stdout: "pools": [ 2021-11-12T05:42:15.892 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:15.892 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 1, 2021-11-12T05:42:15.892 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "device_health_metrics", 2021-11-12T05:42:15.893 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:22.022116+0000", 2021-11-12T05:42:15.893 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:42:15.893 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:42:15.894 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:42:15.894 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:42:15.894 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:42:15.894 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:42:15.894 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:42:15.895 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:42:15.895 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 1, 2021-11-12T05:42:15.895 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 1, 2021-11-12T05:42:15.895 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 1, 2021-11-12T05:42:15.896 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 1, 2021-11-12T05:42:15.896 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 1, 2021-11-12T05:42:15.896 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:42:15.896 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:42:15.896 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:42:15.897 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:42:15.897 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:42:15.897 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:42:15.897 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:42:15.898 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:15.898 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "16", 2021-11-12T05:42:15.898 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:42:15.898 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:42:15.898 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:42:15.899 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:42:15.899 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:42:15.899 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:42:15.899 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:42:15.899 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:42:15.900 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:42:15.900 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:42:15.900 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:42:15.900 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:42:15.900 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:42:15.901 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:42:15.901 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:42:15.901 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:42:15.902 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:42:15.902 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:42:15.902 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:42:15.902 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:42:15.903 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:42:15.903 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:42:15.903 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:42:15.903 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:42:15.903 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:42:15.904 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:42:15.904 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:15.904 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:42:15.904 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:42:15.904 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:42:15.905 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:42:15.905 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:42:15.905 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:42:15.905 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:42:15.906 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:42:15.906 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:42:15.906 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:42:15.906 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:42:15.906 INFO:teuthology.orchestra.run.gibba005.stdout: "options": { 2021-11-12T05:42:15.907 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_min": 1 2021-11-12T05:42:15.907 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:15.907 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:42:15.907 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr_devicehealth": {} 2021-11-12T05:42:15.908 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:15.908 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:15.908 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:15.908 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 2, 2021-11-12T05:42:15.908 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "rbd", 2021-11-12T05:42:15.909 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:29.953617+0000", 2021-11-12T05:42:15.909 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:42:15.909 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:42:15.910 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:42:15.910 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:42:15.910 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:42:15.910 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:42:15.911 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:42:15.911 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:42:15.911 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:42:15.911 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:42:15.911 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:42:15.912 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:42:15.912 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:42:15.912 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:42:15.912 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:42:15.912 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:42:15.913 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:42:15.913 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:42:15.913 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:42:15.913 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:42:15.914 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:15.914 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "19", 2021-11-12T05:42:15.914 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:42:15.914 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:42:15.914 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:42:15.915 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:42:15.915 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:42:15.915 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:42:15.915 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:42:15.915 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:42:15.916 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:42:15.916 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:42:15.916 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:42:15.916 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:42:15.916 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:42:15.917 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:42:15.917 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:42:15.917 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:42:15.917 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:42:15.918 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:42:15.918 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:42:15.918 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:42:15.919 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:42:15.919 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:42:15.919 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:42:15.919 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:42:15.919 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:42:15.920 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:42:15.920 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:15.920 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:42:15.920 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:42:15.920 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:42:15.921 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:42:15.921 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:42:15.921 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:42:15.921 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:42:15.921 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:42:15.922 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:42:15.922 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:42:15.922 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:42:15.922 INFO:teuthology.orchestra.run.gibba005.stdout: "options": {}, 2021-11-12T05:42:15.923 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:42:15.923 INFO:teuthology.orchestra.run.gibba005.stdout: "rbd": {} 2021-11-12T05:42:15.923 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:15.923 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:15.923 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:15.924 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 5, 2021-11-12T05:42:15.924 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "cephfs_metadata", 2021-11-12T05:42:15.924 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:41:05.236029+0000", 2021-11-12T05:42:15.924 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:42:15.925 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:42:15.925 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:42:15.925 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:42:15.925 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:42:15.925 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:42:15.926 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:42:15.926 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:42:15.926 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:42:15.927 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:42:15.927 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:42:15.927 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:42:15.928 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:42:15.928 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:42:15.928 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:42:15.928 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:42:15.928 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:42:15.929 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:42:15.929 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:42:15.929 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:42:15.929 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:15.929 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "34", 2021-11-12T05:42:15.930 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:42:15.930 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:42:15.930 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:42:15.930 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:42:15.931 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:42:15.931 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:42:15.931 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:42:15.931 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:42:15.931 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:42:15.932 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:42:15.932 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:42:15.932 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:42:15.932 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:42:15.933 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:42:15.933 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:42:15.933 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:42:15.933 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:42:15.933 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:42:15.934 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:42:15.934 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:42:15.934 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:42:15.934 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:42:15.935 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:42:15.935 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:42:15.935 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:42:15.936 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:42:15.936 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:15.936 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:42:15.936 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:42:15.937 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:42:15.937 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:42:15.937 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:42:15.937 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:42:15.937 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:42:15.938 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:42:15.938 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:42:15.938 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:42:15.938 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:42:15.939 INFO:teuthology.orchestra.run.gibba005.stdout: "options": { 2021-11-12T05:42:15.939 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_bias": 4, 2021-11-12T05:42:15.939 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_min": 16, 2021-11-12T05:42:15.939 INFO:teuthology.orchestra.run.gibba005.stdout: "recovery_priority": 5 2021-11-12T05:42:15.939 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:15.940 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:42:15.940 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs": { 2021-11-12T05:42:15.940 INFO:teuthology.orchestra.run.gibba005.stdout: "metadata": "cephfs" 2021-11-12T05:42:15.940 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:15.940 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:15.941 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:15.941 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:15.941 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 6, 2021-11-12T05:42:15.941 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "cephfs_data", 2021-11-12T05:42:15.942 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:41:06.227573+0000", 2021-11-12T05:42:15.942 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:42:15.942 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:42:15.942 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:42:15.942 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:42:15.943 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:42:15.943 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:42:15.943 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:42:15.944 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:42:15.944 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:42:15.944 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:42:15.944 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:42:15.945 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:42:15.945 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:42:15.945 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:42:15.945 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:42:15.945 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:42:15.946 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:42:15.946 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:42:15.946 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:42:15.946 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:42:15.947 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:15.947 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "35", 2021-11-12T05:42:15.947 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:42:15.947 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:42:15.947 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:42:15.948 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:42:15.948 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:42:15.948 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:42:15.948 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:42:15.948 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:42:15.949 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:42:15.949 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:42:15.949 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:42:15.949 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:42:15.949 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:42:15.950 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:42:15.950 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:42:15.950 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:42:15.950 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:42:15.950 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:42:15.951 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:42:15.951 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:42:15.951 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:42:15.951 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:42:15.952 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:42:15.952 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:42:15.952 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:42:15.953 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:42:15.953 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:15.953 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:42:15.953 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:42:15.953 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:42:15.954 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:42:15.954 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:42:15.954 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:42:15.954 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:42:15.954 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:42:15.955 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:42:15.955 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:42:15.955 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:42:15.955 INFO:teuthology.orchestra.run.gibba005.stdout: "options": {}, 2021-11-12T05:42:15.956 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:42:15.956 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs": { 2021-11-12T05:42:15.956 INFO:teuthology.orchestra.run.gibba005.stdout: "data": "cephfs" 2021-11-12T05:42:15.956 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:15.956 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:15.957 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:15.957 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:42:15.957 INFO:teuthology.orchestra.run.gibba005.stdout: "osds": [ 2021-11-12T05:42:15.957 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:15.957 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:42:15.958 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "ee8e30a0-4819-4475-80ec-dd3ee7d01322", 2021-11-12T05:42:15.958 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:42:15.958 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:42:15.958 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:42:15.959 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:42:15.959 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:42:15.959 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:42:15.959 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:42:15.960 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 32, 2021-11-12T05:42:15.960 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:42:15.960 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:42:15.960 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:42:15.961 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:15.961 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:15.961 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:15.961 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6802", 2021-11-12T05:42:15.962 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:42:15.962 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:15.962 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:15.962 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:15.962 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6803", 2021-11-12T05:42:15.963 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:42:15.963 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:15.963 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:15.963 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:15.964 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:42:15.964 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:15.964 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:15.964 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:15.964 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6804", 2021-11-12T05:42:15.965 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:42:15.965 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:15.965 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:15.965 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:15.965 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6805", 2021-11-12T05:42:15.966 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:42:15.966 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:15.966 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:15.966 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:15.967 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:42:15.967 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:15.967 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:15.967 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:15.967 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6808", 2021-11-12T05:42:15.968 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:42:15.968 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:15.968 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:15.969 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:15.969 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6809", 2021-11-12T05:42:15.969 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:42:15.969 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:15.970 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:15.970 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:15.970 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:42:15.970 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:15.970 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:15.971 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:15.971 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6806", 2021-11-12T05:42:15.971 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:42:15.971 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:15.971 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:15.972 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:15.972 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6807", 2021-11-12T05:42:15.972 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:42:15.972 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:15.972 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:15.973 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:15.973 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6803/14874", 2021-11-12T05:42:15.973 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6805/14874", 2021-11-12T05:42:15.973 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6809/14874", 2021-11-12T05:42:15.973 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6807/14874", 2021-11-12T05:42:15.974 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:42:15.974 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:42:15.974 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:42:15.974 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:15.975 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:15.975 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:15.975 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:42:15.975 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "b1bb06c3-26d0-4d92-82f8-b3e882242785", 2021-11-12T05:42:15.975 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:42:15.976 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:42:15.976 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:42:15.976 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:42:15.977 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:42:15.977 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:42:15.977 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:42:15.977 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 33, 2021-11-12T05:42:15.978 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:42:15.978 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:42:15.978 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:42:15.978 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:15.978 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:15.979 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:15.979 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6810", 2021-11-12T05:42:15.979 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:42:15.979 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:15.979 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:15.980 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:15.980 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6811", 2021-11-12T05:42:15.980 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:42:15.980 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:15.980 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:15.981 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:15.981 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:42:15.981 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:15.981 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:15.982 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:15.982 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6812", 2021-11-12T05:42:15.982 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:42:15.982 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:15.982 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:15.983 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:15.983 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6813", 2021-11-12T05:42:15.983 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:42:15.983 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:15.983 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:15.984 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:15.984 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:42:15.984 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:15.984 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:15.984 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:15.985 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6816", 2021-11-12T05:42:15.985 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:42:15.985 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:15.986 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:15.986 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:15.986 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6817", 2021-11-12T05:42:15.986 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:42:15.987 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:15.987 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:15.987 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:15.987 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:42:15.987 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:15.988 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:15.988 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:15.988 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6814", 2021-11-12T05:42:15.988 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:42:15.988 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:15.989 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:15.989 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:15.989 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6815", 2021-11-12T05:42:15.989 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:42:15.989 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:15.990 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:15.990 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:15.990 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6811/14875", 2021-11-12T05:42:15.990 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6813/14875", 2021-11-12T05:42:15.990 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6817/14875", 2021-11-12T05:42:15.991 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6815/14875", 2021-11-12T05:42:15.991 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:42:15.991 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:42:15.991 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:42:15.992 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:15.992 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:15.992 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:15.992 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:42:15.992 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "837b2c60-c335-4382-9f47-d86543a14022", 2021-11-12T05:42:15.993 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:42:15.993 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:42:15.993 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:42:15.993 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:42:15.994 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:42:15.994 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:42:15.994 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:42:15.994 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 31, 2021-11-12T05:42:15.995 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:42:15.995 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:42:15.995 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:42:15.995 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:15.995 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:15.996 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:15.996 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6818", 2021-11-12T05:42:15.996 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:42:15.996 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:15.996 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:15.997 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:15.997 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6819", 2021-11-12T05:42:15.997 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:42:15.997 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:15.998 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:15.998 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:15.998 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:42:15.998 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:15.998 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:15.999 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:15.999 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6820", 2021-11-12T05:42:15.999 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:42:15.999 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:15.999 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.000 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:16.000 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6821", 2021-11-12T05:42:16.000 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:42:16.000 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:16.001 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:16.001 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.001 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:42:16.001 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:16.001 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.002 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:16.002 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6824", 2021-11-12T05:42:16.002 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:42:16.002 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.003 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.003 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:16.003 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6825", 2021-11-12T05:42:16.003 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:42:16.004 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:16.004 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:16.004 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.004 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:42:16.005 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:16.005 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.005 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:16.005 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6822", 2021-11-12T05:42:16.005 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:42:16.006 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.006 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.006 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:16.006 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6823", 2021-11-12T05:42:16.006 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:42:16.007 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:16.007 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:16.007 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.007 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6819/14905", 2021-11-12T05:42:16.007 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6821/14905", 2021-11-12T05:42:16.008 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6825/14905", 2021-11-12T05:42:16.008 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6823/14905", 2021-11-12T05:42:16.008 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:42:16.008 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:42:16.008 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:42:16.009 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:16.009 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.009 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.009 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:42:16.010 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "eb2b737b-dda6-444b-a306-f33cbbd51f70", 2021-11-12T05:42:16.010 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:42:16.010 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:42:16.011 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:42:16.011 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:42:16.011 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:42:16.011 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:42:16.012 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:42:16.012 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 32, 2021-11-12T05:42:16.012 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:42:16.012 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:42:16.012 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:42:16.013 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:16.013 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.013 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:16.013 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6826", 2021-11-12T05:42:16.014 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:42:16.014 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.014 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.014 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:16.015 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6827", 2021-11-12T05:42:16.015 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:42:16.015 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:16.015 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:16.015 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.016 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:42:16.016 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:16.016 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.016 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:16.017 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6828", 2021-11-12T05:42:16.017 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:42:16.017 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.017 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.018 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:16.018 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6829", 2021-11-12T05:42:16.018 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:42:16.018 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:16.018 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:16.019 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.019 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:42:16.020 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:16.020 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.020 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:16.020 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6832", 2021-11-12T05:42:16.021 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:42:16.021 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.021 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.021 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:16.021 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6833", 2021-11-12T05:42:16.022 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:42:16.022 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:16.022 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:16.022 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.022 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:42:16.023 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:16.023 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.023 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:16.023 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6830", 2021-11-12T05:42:16.023 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:42:16.024 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.024 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.024 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:16.024 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6831", 2021-11-12T05:42:16.024 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:42:16.025 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:16.025 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:16.025 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.025 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6827/14876", 2021-11-12T05:42:16.026 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6829/14876", 2021-11-12T05:42:16.026 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6833/14876", 2021-11-12T05:42:16.026 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6831/14876", 2021-11-12T05:42:16.026 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:42:16.026 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:42:16.027 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:42:16.027 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:16.027 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.027 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.028 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:42:16.028 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "721529a1-c047-486a-a7ca-ddc15d80cdde", 2021-11-12T05:42:16.028 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:42:16.029 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:42:16.029 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:42:16.029 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:42:16.029 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:42:16.029 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:42:16.030 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:42:16.030 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 32, 2021-11-12T05:42:16.030 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:42:16.030 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:42:16.030 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:42:16.031 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:16.031 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.031 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:16.031 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6800", 2021-11-12T05:42:16.031 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:42:16.032 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.032 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.032 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:16.032 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6801", 2021-11-12T05:42:16.033 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:42:16.033 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:16.033 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:16.033 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.033 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:42:16.034 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:16.034 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.034 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:16.034 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6802", 2021-11-12T05:42:16.034 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:42:16.035 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.035 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.035 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:16.035 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6803", 2021-11-12T05:42:16.035 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:42:16.036 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:16.036 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:16.037 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.037 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:42:16.037 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:16.037 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.037 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:16.038 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6806", 2021-11-12T05:42:16.038 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:42:16.038 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.038 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.038 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:16.039 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6807", 2021-11-12T05:42:16.039 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:42:16.039 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:16.039 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:16.039 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.040 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:42:16.040 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:16.040 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.040 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:16.040 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6804", 2021-11-12T05:42:16.041 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:42:16.041 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.041 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.041 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:16.041 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6805", 2021-11-12T05:42:16.042 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:42:16.042 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:16.042 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:16.042 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.043 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6801/15096", 2021-11-12T05:42:16.043 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6803/15096", 2021-11-12T05:42:16.043 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6807/15096", 2021-11-12T05:42:16.043 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6805/15096", 2021-11-12T05:42:16.043 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:42:16.044 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:42:16.044 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:42:16.044 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:16.044 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.045 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.045 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:42:16.045 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "68b72ab2-fa82-4b5c-bf33-528f002e4950", 2021-11-12T05:42:16.045 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:42:16.046 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:42:16.046 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:42:16.046 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:42:16.046 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:42:16.047 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:42:16.047 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:42:16.047 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 32, 2021-11-12T05:42:16.047 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:42:16.047 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:42:16.048 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:42:16.048 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:16.048 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.048 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:16.049 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6808", 2021-11-12T05:42:16.049 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:42:16.049 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.049 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.049 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:16.050 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6809", 2021-11-12T05:42:16.050 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:42:16.050 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:16.050 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:16.050 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.051 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:42:16.051 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:16.051 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.051 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:16.051 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6810", 2021-11-12T05:42:16.052 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:42:16.052 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.052 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.053 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:16.053 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6811", 2021-11-12T05:42:16.053 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:42:16.053 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:16.054 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:16.054 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.054 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:42:16.054 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:16.054 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.055 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:16.055 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6814", 2021-11-12T05:42:16.055 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:42:16.055 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.056 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.056 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:16.056 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6815", 2021-11-12T05:42:16.056 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:42:16.056 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:16.057 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:16.057 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.057 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:42:16.057 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:16.057 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.058 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:16.058 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6812", 2021-11-12T05:42:16.058 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:42:16.058 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.058 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.059 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:16.059 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6813", 2021-11-12T05:42:16.059 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:42:16.059 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:16.059 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:16.060 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.060 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6809/15097", 2021-11-12T05:42:16.060 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6811/15097", 2021-11-12T05:42:16.060 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6815/15097", 2021-11-12T05:42:16.061 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6813/15097", 2021-11-12T05:42:16.061 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:42:16.061 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:42:16.062 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:42:16.062 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:16.062 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.062 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.062 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:42:16.063 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "a2c83b5d-8d37-4d30-ac04-30d89a76e485", 2021-11-12T05:42:16.063 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:42:16.063 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:42:16.063 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:42:16.064 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:42:16.064 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:42:16.064 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:42:16.064 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:42:16.064 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 31, 2021-11-12T05:42:16.065 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:42:16.065 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:42:16.065 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:42:16.065 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:16.065 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.066 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:16.066 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6816", 2021-11-12T05:42:16.066 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:42:16.066 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.066 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.067 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:16.067 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6817", 2021-11-12T05:42:16.067 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:42:16.067 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:16.068 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:16.068 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.068 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:42:16.068 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:16.068 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.069 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:16.069 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6818", 2021-11-12T05:42:16.069 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:42:16.069 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.069 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.070 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:16.070 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6819", 2021-11-12T05:42:16.070 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:42:16.071 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:16.071 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:16.071 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.071 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:42:16.071 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:16.072 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.072 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:16.072 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6822", 2021-11-12T05:42:16.072 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:42:16.073 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.073 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.073 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:16.073 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6823", 2021-11-12T05:42:16.073 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:42:16.074 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:16.074 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:16.074 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.074 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:42:16.074 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:16.075 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.075 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:16.075 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6820", 2021-11-12T05:42:16.075 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:42:16.076 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.076 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.076 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:16.076 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6821", 2021-11-12T05:42:16.077 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:42:16.077 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:16.077 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:16.077 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.077 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6817/15098", 2021-11-12T05:42:16.078 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6819/15098", 2021-11-12T05:42:16.078 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6823/15098", 2021-11-12T05:42:16.078 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6821/15098", 2021-11-12T05:42:16.079 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:42:16.079 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:42:16.079 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:42:16.079 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:16.080 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.080 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.080 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:42:16.080 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "786ce966-d0fb-4181-aed4-c26e3ef61c43", 2021-11-12T05:42:16.080 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:42:16.081 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:42:16.081 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:42:16.081 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:42:16.081 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:42:16.081 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:42:16.082 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:42:16.082 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 32, 2021-11-12T05:42:16.082 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:42:16.082 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:42:16.082 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:42:16.083 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:16.083 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.083 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:16.083 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6824", 2021-11-12T05:42:16.084 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:42:16.084 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.084 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.084 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:16.084 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6825", 2021-11-12T05:42:16.085 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:42:16.085 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:16.085 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:16.085 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.085 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:42:16.086 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:16.086 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.087 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:16.087 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6826", 2021-11-12T05:42:16.087 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:42:16.087 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.087 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.088 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:16.088 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6827", 2021-11-12T05:42:16.088 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:42:16.088 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:16.089 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:16.089 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.089 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:42:16.089 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:16.089 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.090 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:16.090 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6830", 2021-11-12T05:42:16.090 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:42:16.090 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.090 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.091 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:16.091 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6831", 2021-11-12T05:42:16.091 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:42:16.091 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:16.092 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:16.092 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.092 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:42:16.092 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:16.092 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.093 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:16.093 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6828", 2021-11-12T05:42:16.093 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:42:16.093 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.093 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.094 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:16.094 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6829", 2021-11-12T05:42:16.094 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:42:16.094 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:16.094 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:16.095 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.095 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6825/15099", 2021-11-12T05:42:16.095 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6827/15099", 2021-11-12T05:42:16.096 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6831/15099", 2021-11-12T05:42:16.096 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6829/15099", 2021-11-12T05:42:16.096 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:42:16.096 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:42:16.097 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:42:16.097 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:16.097 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:16.097 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:42:16.097 INFO:teuthology.orchestra.run.gibba005.stdout: "osd_xinfo": [ 2021-11-12T05:42:16.098 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.098 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:42:16.098 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:42:16.098 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:42:16.099 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:42:16.099 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:42:16.099 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:42:16.099 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.615112+0000", 2021-11-12T05:42:16.099 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:42:16.100 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.100 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.100 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:42:16.100 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:42:16.100 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:42:16.101 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:42:16.101 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:42:16.101 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:42:16.101 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.665935+0000", 2021-11-12T05:42:16.102 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:42:16.102 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.102 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.102 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:42:16.102 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:42:16.103 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:42:16.103 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:42:16.103 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:42:16.103 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:42:16.103 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.715877+0000", 2021-11-12T05:42:16.104 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:42:16.104 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.104 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.105 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:42:16.105 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:42:16.105 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:42:16.105 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:42:16.106 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:42:16.106 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:42:16.106 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.489234+0000", 2021-11-12T05:42:16.106 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:42:16.106 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.107 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.107 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:42:16.107 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:42:16.107 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:42:16.107 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:42:16.108 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:42:16.108 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:42:16.108 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.413776+0000", 2021-11-12T05:42:16.108 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:42:16.108 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.109 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.109 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:42:16.109 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:42:16.109 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:42:16.110 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:42:16.110 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:42:16.110 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:42:16.110 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.507960+0000", 2021-11-12T05:42:16.110 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:42:16.111 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.111 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.111 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:42:16.111 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:42:16.111 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:42:16.112 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:42:16.112 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:42:16.112 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:42:16.113 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.635696+0000", 2021-11-12T05:42:16.113 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:42:16.113 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.113 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:16.114 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:42:16.114 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:42:16.114 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:42:16.114 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:42:16.114 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:42:16.115 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:42:16.115 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.746949+0000", 2021-11-12T05:42:16.115 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:42:16.115 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:16.116 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:42:16.116 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap": [], 2021-11-12T05:42:16.116 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap_items": [], 2021-11-12T05:42:16.116 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_temp": [], 2021-11-12T05:42:16.116 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_temp": [], 2021-11-12T05:42:16.117 INFO:teuthology.orchestra.run.gibba005.stdout: "blacklist": {}, 2021-11-12T05:42:16.117 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profiles": { 2021-11-12T05:42:16.117 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs_data": { 2021-11-12T05:42:16.117 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-device-class": "", 2021-11-12T05:42:16.117 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:42:16.118 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-root": "default", 2021-11-12T05:42:16.118 INFO:teuthology.orchestra.run.gibba005.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-12T05:42:16.118 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:42:16.118 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "2", 2021-11-12T05:42:16.118 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:42:16.119 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:42:16.119 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van", 2021-11-12T05:42:16.119 INFO:teuthology.orchestra.run.gibba005.stdout: "w": "8" 2021-11-12T05:42:16.119 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.119 INFO:teuthology.orchestra.run.gibba005.stdout: "default": { 2021-11-12T05:42:16.120 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:42:16.120 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:42:16.120 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "1", 2021-11-12T05:42:16.120 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:42:16.121 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:42:16.121 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van" 2021-11-12T05:42:16.121 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:16.122 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:16.122 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps_queue": [], 2021-11-12T05:42:16.122 INFO:teuthology.orchestra.run.gibba005.stdout: "new_removed_snaps": [], 2021-11-12T05:42:16.122 INFO:teuthology.orchestra.run.gibba005.stdout: "new_purged_snaps": [], 2021-11-12T05:42:16.122 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_node_flags": {}, 2021-11-12T05:42:16.123 INFO:teuthology.orchestra.run.gibba005.stdout: "device_class_flags": {} 2021-11-12T05:42:16.123 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:42:16.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.883+0000 7f9df199f700 1 -- 172.21.2.105:0/1652271806 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9dd00536a0 msgr2=0x7f9dd0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:16.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.883+0000 7f9df199f700 1 --2- 172.21.2.105:0/1652271806 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9dd00536a0 0x7f9dd0055b60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f9dd4018000 tx=0x7f9dd4014000).stop 2021-11-12T05:42:16.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.883+0000 7f9df199f700 1 -- 172.21.2.105:0/1652271806 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9dec13cab0 msgr2=0x7f9dec13f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:16.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.883+0000 7f9df199f700 1 --2- 172.21.2.105:0/1652271806 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9dec13cab0 0x7f9dec13f2e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f9dec0b71c0 tx=0x7f9ddc007c40).stop 2021-11-12T05:42:16.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.883+0000 7f9df199f700 1 -- 172.21.2.105:0/1652271806 shutdown_connections 2021-11-12T05:42:16.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.883+0000 7f9df199f700 1 --2- 172.21.2.105:0/1652271806 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9dd00536a0 0x7f9dd0055b60 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:16.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.883+0000 7f9df199f700 1 --2- 172.21.2.105:0/1652271806 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9dec13ce90 0x7f9dec13f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:16.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.883+0000 7f9df199f700 1 --2- 172.21.2.105:0/1652271806 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9dec13cab0 0x7f9dec13f2e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:16.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.883+0000 7f9df199f700 1 --2- 172.21.2.105:0/1652271806 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9dec0aeea0 0x7f9dec0b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:16.127 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.883+0000 7f9df199f700 1 -- 172.21.2.105:0/1652271806 >> 172.21.2.105:0/1652271806 conn(0x7f9dec05c490 msgr2=0x7f9dec0b8710 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:16.127 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.883+0000 7f9df199f700 1 -- 172.21.2.105:0/1652271806 shutdown_connections 2021-11-12T05:42:16.127 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:15.883+0000 7f9df199f700 1 -- 172.21.2.105:0/1652271806 wait complete. 2021-11-12T05:42:16.128 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:42:16.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.179+0000 7f4446cce700 1 Processor -- start 2021-11-12T05:42:16.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.179+0000 7f4446cce700 1 -- start start 2021-11-12T05:42:16.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.179+0000 7f4446cce700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f44400b01b0 0x7f44400b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:16.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.179+0000 7f4446cce700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44400b5ea0 con 0x7f44400b5ac0 2021-11-12T05:42:16.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.179+0000 7f4446cce700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44400b1a60 con 0x7f444005d760 2021-11-12T05:42:16.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.179+0000 7f4446cce700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44400accd0 con 0x7f44400b01b0 2021-11-12T05:42:16.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.179+0000 7f4444a6a700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f44400b5ac0 0x7f44400ae470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:54992/0 (socket says 172.21.2.105:54992) 2021-11-12T05:42:16.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.179+0000 7f4444a6a700 1 -- 172.21.2.105:0/704890525 learned_addr learned my addr 172.21.2.105:0/704890525 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:42:16.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.179+0000 7f443ffff700 1 --2- 172.21.2.105:0/704890525 >> v2:172.21.2.115:3300/0 conn(0x7f44400b01b0 0x7f44400b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:16.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.179+0000 7f443f7fe700 1 -- 172.21.2.105:0/704890525 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1823969131 0 0) 0x7f44400b5ea0 con 0x7f44400b5ac0 2021-11-12T05:42:16.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.179+0000 7f443f7fe700 1 -- 172.21.2.105:0/704890525 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f442c003260 con 0x7f44400b5ac0 2021-11-12T05:42:16.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.179+0000 7f443f7fe700 1 -- 172.21.2.105:0/704890525 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 396124303 0 0) 0x7f442c003260 con 0x7f44400b5ac0 2021-11-12T05:42:16.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.179+0000 7f443f7fe700 1 -- 172.21.2.105:0/704890525 >> v2:172.21.2.115:3300/0 conn(0x7f44400b01b0 msgr2=0x7f44400b13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:16.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.179+0000 7f443f7fe700 1 --2- 172.21.2.105:0/704890525 >> v2:172.21.2.115:3300/0 conn(0x7f44400b01b0 0x7f44400b13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:16.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.179+0000 7f443f7fe700 1 -- 172.21.2.105:0/704890525 >> v1:172.21.2.115:6789/0 conn(0x7f444005d760 legacy=0x7f44400aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:16.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.179+0000 7f443f7fe700 1 -- 172.21.2.105:0/704890525 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44400acf70 con 0x7f44400b5ac0 2021-11-12T05:42:16.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.179+0000 7f443f7fe700 1 -- 172.21.2.105:0/704890525 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f4430001660 con 0x7f44400b5ac0 2021-11-12T05:42:16.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.179+0000 7f443f7fe700 1 -- 172.21.2.105:0/704890525 >> v1:172.21.2.105:6789/0 conn(0x7f44400b5ac0 legacy=0x7f44400ae470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:16.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.179+0000 7f443f7fe700 1 --2- 172.21.2.105:0/704890525 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f442c003820 0x7f442c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:16.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.179+0000 7f443f7fe700 1 --2- 172.21.2.105:0/704890525 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f442c004500 0x7f442c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:16.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.179+0000 7f443f7fe700 1 --2- 172.21.2.105:0/704890525 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f442c004f70 0x7f442c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:16.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.179+0000 7f443f7fe700 1 -- 172.21.2.105:0/704890525 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44400accd0 con 0x7f442c003820 2021-11-12T05:42:16.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.179+0000 7f443f7fe700 1 -- 172.21.2.105:0/704890525 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442c00be50 con 0x7f442c004f70 2021-11-12T05:42:16.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.179+0000 7f443f7fe700 1 -- 172.21.2.105:0/704890525 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f442c00c010 con 0x7f442c004500 2021-11-12T05:42:16.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.179+0000 7f4444a6a700 1 --2- 172.21.2.105:0/704890525 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f442c003820 0x7f442c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:16.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.179+0000 7f4444a6a700 1 -- 172.21.2.105:0/704890525 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f442c004500 msgr2=0x7f442c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:16.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.179+0000 7f4444a6a700 1 --2- 172.21.2.105:0/704890525 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f442c004500 0x7f442c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:16.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.179+0000 7f4444a6a700 1 -- 172.21.2.105:0/704890525 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f442c004f70 msgr2=0x7f442c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:16.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.179+0000 7f4444a6a700 1 --2- 172.21.2.105:0/704890525 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f442c004f70 0x7f442c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:16.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.179+0000 7f4444a6a700 1 -- 172.21.2.105:0/704890525 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f442c003260 con 0x7f442c003820 2021-11-12T05:42:16.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.179+0000 7f444526b700 1 -- 172.21.2.105:0/704890525 reap_dead start 2021-11-12T05:42:16.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.179+0000 7f4444a6a700 1 --2- 172.21.2.105:0/704890525 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f442c003820 0x7f442c003c20 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f44400ad2f0 tx=0x7f44400ae2e0).ready entity=mon.0 client_cookie=bb3ff8405c899168 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:16.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.179+0000 7f443f7fe700 1 -- 172.21.2.105:0/704890525 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44300070d0 con 0x7f442c003820 2021-11-12T05:42:16.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.179+0000 7f443f7fe700 1 -- 172.21.2.105:0/704890525 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4430007230 con 0x7f442c003820 2021-11-12T05:42:16.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.179+0000 7f443f7fe700 1 -- 172.21.2.105:0/704890525 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f443000c8f0 con 0x7f442c003820 2021-11-12T05:42:16.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.183+0000 7f4446cce700 1 -- 172.21.2.105:0/704890525 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f442c003820 msgr2=0x7f442c003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:16.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.183+0000 7f4446cce700 1 --2- 172.21.2.105:0/704890525 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f442c003820 0x7f442c003c20 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f44400ad2f0 tx=0x7f44400ae2e0).stop 2021-11-12T05:42:16.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.183+0000 7f4446cce700 1 -- 172.21.2.105:0/704890525 shutdown_connections 2021-11-12T05:42:16.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.183+0000 7f4446cce700 1 --2- 172.21.2.105:0/704890525 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f442c003820 0x7f442c003c20 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:16.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.183+0000 7f4446cce700 1 -- 172.21.2.105:0/704890525 >> 172.21.2.105:0/704890525 conn(0x7f44400628b0 msgr2=0x7f4440062c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:16.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.183+0000 7f4446cce700 1 -- 172.21.2.105:0/704890525 shutdown_connections 2021-11-12T05:42:16.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.183+0000 7f4446cce700 1 -- 172.21.2.105:0/704890525 wait complete. 2021-11-12T05:42:16.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.183+0000 7f4446cce700 1 Processor -- start 2021-11-12T05:42:16.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.183+0000 7f4446cce700 1 -- start start 2021-11-12T05:42:16.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.183+0000 7f4446cce700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f442c003820 0x7f4440067240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:16.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.183+0000 7f4446cce700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4440132e50 0x7f44400b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:16.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.183+0000 7f4446cce700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f44401348f0 0x7f4440134da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:16.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.183+0000 7f4446cce700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4440066df0 con 0x7f4440132e50 2021-11-12T05:42:16.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.183+0000 7f4446cce700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4440066230 con 0x7f44401348f0 2021-11-12T05:42:16.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.183+0000 7f4446cce700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44400664d0 con 0x7f442c003820 2021-11-12T05:42:16.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.183+0000 7f443ffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4440132e50 0x7f44400b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:16.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.183+0000 7f443ffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4440132e50 0x7f44400b3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44608/0 (socket says 172.21.2.105:44608) 2021-11-12T05:42:16.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.183+0000 7f443ffff700 1 -- 172.21.2.105:0/3744439426 learned_addr learned my addr 172.21.2.105:0/3744439426 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:16.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.183+0000 7f443ffff700 1 -- 172.21.2.105:0/3744439426 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f442c003820 msgr2=0x7f4440067240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:16.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.183+0000 7f443ffff700 1 --2- 172.21.2.105:0/3744439426 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f442c003820 0x7f4440067240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:16.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.183+0000 7f443ffff700 1 -- 172.21.2.105:0/3744439426 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f44401348f0 msgr2=0x7f4440134da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:16.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.183+0000 7f443ffff700 1 --2- 172.21.2.105:0/3744439426 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f44401348f0 0x7f4440134da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:16.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.183+0000 7f443ffff700 1 -- 172.21.2.105:0/3744439426 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4440066770 con 0x7f4440132e50 2021-11-12T05:42:16.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.183+0000 7f443ffff700 1 --2- 172.21.2.105:0/3744439426 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4440132e50 0x7f44400b3f00 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f443400a000 tx=0x7f4434008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:16.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.183+0000 7f443dffb700 1 -- 172.21.2.105:0/3744439426 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4434016070 con 0x7f4440132e50 2021-11-12T05:42:16.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.183+0000 7f443dffb700 1 -- 172.21.2.105:0/3744439426 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4434000e90 con 0x7f4440132e50 2021-11-12T05:42:16.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.183+0000 7f4446cce700 1 -- 172.21.2.105:0/3744439426 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4440135290 con 0x7f4440132e50 2021-11-12T05:42:16.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.183+0000 7f4446cce700 1 -- 172.21.2.105:0/3744439426 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4440151a00 con 0x7f4440132e50 2021-11-12T05:42:16.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.183+0000 7f443dffb700 1 -- 172.21.2.105:0/3744439426 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4434011a40 con 0x7f4440132e50 2021-11-12T05:42:16.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.183+0000 7f4446cce700 1 -- 172.21.2.105:0/3744439426 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44400ad410 con 0x7f4440132e50 2021-11-12T05:42:16.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.183+0000 7f443dffb700 1 -- 172.21.2.105:0/3744439426 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4434011ba0 con 0x7f4440132e50 2021-11-12T05:42:16.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.183+0000 7f443dffb700 1 --2- 172.21.2.105:0/3744439426 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4420053720 0x7f4420055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:16.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.183+0000 7f443dffb700 1 -- 172.21.2.105:0/3744439426 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f443406b830 con 0x7f4440132e50 2021-11-12T05:42:16.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.183+0000 7f4444a6a700 1 --2- 172.21.2.105:0/3744439426 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4420053720 0x7f4420055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:16.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.183+0000 7f4444a6a700 1 --2- 172.21.2.105:0/3744439426 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4420053720 0x7f4420055be0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f44400ad2f0 tx=0x7f4430013000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:16.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.187+0000 7f443dffb700 1 -- 172.21.2.105:0/3744439426 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f44340427e0 con 0x7f4440132e50 2021-11-12T05:42:16.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.295+0000 7f4446cce700 1 -- 172.21.2.105:0/3744439426 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4440057350 con 0x7f4440132e50 2021-11-12T05:42:16.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.295+0000 7f443dffb700 1 -- 172.21.2.105:0/3744439426 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f4434045e00 con 0x7f4440132e50 2021-11-12T05:42:16.300 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:42:16.301 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4429,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/4118304786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":4118304786},{"type":"v1","addr":"172.21.2.115:6833","nonce":4118304786}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:41:07.250137+0000","modified":"2021-11-12T05:41:08.255185+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4908},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4908":{"gid":4908,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/2626499955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":2626499955},{"type":"v1","addr":"172.21.2.105:6835","nonce":2626499955}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-11-12T05:42:16.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.295+0000 7f4446cce700 1 -- 172.21.2.105:0/3744439426 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4420053720 msgr2=0x7f4420055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:16.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.295+0000 7f4446cce700 1 --2- 172.21.2.105:0/3744439426 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4420053720 0x7f4420055be0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f44400ad2f0 tx=0x7f4430013000).stop 2021-11-12T05:42:16.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.295+0000 7f4446cce700 1 -- 172.21.2.105:0/3744439426 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4440132e50 msgr2=0x7f44400b3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:16.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.295+0000 7f4446cce700 1 --2- 172.21.2.105:0/3744439426 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4440132e50 0x7f44400b3f00 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f443400a000 tx=0x7f4434008040).stop 2021-11-12T05:42:16.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.295+0000 7f4446cce700 1 -- 172.21.2.105:0/3744439426 shutdown_connections 2021-11-12T05:42:16.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.295+0000 7f4446cce700 1 --2- 172.21.2.105:0/3744439426 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4420053720 0x7f4420055be0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:16.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.295+0000 7f4446cce700 1 --2- 172.21.2.105:0/3744439426 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f44401348f0 0x7f4440134da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:16.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.295+0000 7f4446cce700 1 --2- 172.21.2.105:0/3744439426 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4440132e50 0x7f44400b3f00 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:16.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.295+0000 7f4446cce700 1 --2- 172.21.2.105:0/3744439426 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f442c003820 0x7f4440067240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:16.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.295+0000 7f4446cce700 1 -- 172.21.2.105:0/3744439426 >> 172.21.2.105:0/3744439426 conn(0x7f44400628b0 msgr2=0x7f444012e510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:16.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.295+0000 7f4446cce700 1 -- 172.21.2.105:0/3744439426 shutdown_connections 2021-11-12T05:42:16.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.295+0000 7f4446cce700 1 -- 172.21.2.105:0/3744439426 wait complete. 2021-11-12T05:42:16.304 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 10 2021-11-12T05:42:16.307 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-12T05:42:16.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.351+0000 7f642c355700 1 Processor -- start 2021-11-12T05:42:16.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.351+0000 7f642c355700 1 -- start start 2021-11-12T05:42:16.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.351+0000 7f642c355700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f64240626b0 0x7f6424062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:16.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.351+0000 7f642c355700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f6424130a80 0x7f64241474d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:16.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.351+0000 7f642c355700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64240b0d50 con 0x7f64240af750 2021-11-12T05:42:16.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.351+0000 7f642c355700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64240ad380 con 0x7f6424130a80 2021-11-12T05:42:16.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.351+0000 7f642c355700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64240ae190 con 0x7f64240626b0 2021-11-12T05:42:16.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.355+0000 7f642a0f1700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f64240626b0 0x7f6424062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:16.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.355+0000 7f64298f0700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7f64240af750 0x7f6424130370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:53480/0 (socket says 172.21.2.105:53480) 2021-11-12T05:42:16.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.355+0000 7f64298f0700 1 -- 172.21.2.105:0/4141591261 learned_addr learned my addr 172.21.2.105:0/4141591261 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:42:16.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.355+0000 7f642a8f2700 1 --2- 172.21.2.105:0/4141591261 >> v2:172.21.2.115:3300/0 conn(0x7f6424130a80 0x7f64241474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:16.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.355+0000 7f642a0f1700 1 -- 172.21.2.105:0/4141591261 >> v2:172.21.2.115:3300/0 conn(0x7f6424130a80 msgr2=0x7f64241474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:16.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.355+0000 7f642a0f1700 1 --2- 172.21.2.105:0/4141591261 >> v2:172.21.2.115:3300/0 conn(0x7f6424130a80 0x7f64241474d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:16.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.355+0000 7f642a0f1700 1 -- 172.21.2.105:0/4141591261 >> v1:172.21.2.115:6789/0 conn(0x7f64240af750 legacy=0x7f6424130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:16.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.355+0000 7f642a0f1700 1 -- 172.21.2.105:0/4141591261 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64240ae2d0 con 0x7f64240626b0 2021-11-12T05:42:16.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.355+0000 7f642a0f1700 1 --2- 172.21.2.105:0/4141591261 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f64240626b0 0x7f6424062a90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f6420002f70 tx=0x7f6420006df0).ready entity=mon.2 client_cookie=d0fda8f8b6cd6831 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:16.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.355+0000 7f64290ef700 1 -- 172.21.2.105:0/4141591261 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f642000d570 con 0x7f64240626b0 2021-11-12T05:42:16.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.355+0000 7f64290ef700 1 -- 172.21.2.105:0/4141591261 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6420000e90 con 0x7f64240626b0 2021-11-12T05:42:16.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.355+0000 7f64290ef700 1 -- 172.21.2.105:0/4141591261 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f642000d8c0 con 0x7f64240626b0 2021-11-12T05:42:16.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.355+0000 7f642c355700 1 -- 172.21.2.105:0/4141591261 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f64240626b0 msgr2=0x7f6424062a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:16.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.355+0000 7f642c355700 1 --2- 172.21.2.105:0/4141591261 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f64240626b0 0x7f6424062a90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f6420002f70 tx=0x7f6420006df0).stop 2021-11-12T05:42:16.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.355+0000 7f642c355700 1 -- 172.21.2.105:0/4141591261 shutdown_connections 2021-11-12T05:42:16.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.355+0000 7f642c355700 1 --2- 172.21.2.105:0/4141591261 >> v2:172.21.2.115:3300/0 conn(0x7f6424130a80 0x7f64241474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:16.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.355+0000 7f642c355700 1 --2- 172.21.2.105:0/4141591261 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f64240626b0 0x7f6424062a90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:16.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.355+0000 7f642c355700 1 -- 172.21.2.105:0/4141591261 >> 172.21.2.105:0/4141591261 conn(0x7f64240b5320 msgr2=0x7f64240b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:16.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.355+0000 7f642c355700 1 -- 172.21.2.105:0/4141591261 shutdown_connections 2021-11-12T05:42:16.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.355+0000 7f642c355700 1 -- 172.21.2.105:0/4141591261 wait complete. 2021-11-12T05:42:16.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.359+0000 7f642c355700 1 Processor -- start 2021-11-12T05:42:16.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.359+0000 7f642c355700 1 -- start start 2021-11-12T05:42:16.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.359+0000 7f642c355700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f64240626b0 0x7f642414ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:16.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.359+0000 7f642c355700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f64240af750 0x7f6424062e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:16.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.359+0000 7f642c355700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6424130a80 0x7f64241567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:16.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.359+0000 7f642c355700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6424157a20 con 0x7f6424130a80 2021-11-12T05:42:16.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.359+0000 7f642c355700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6424156ca0 con 0x7f64240af750 2021-11-12T05:42:16.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.359+0000 7f642c355700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f642414b540 con 0x7f64240626b0 2021-11-12T05:42:16.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.359+0000 7f642a8f2700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6424130a80 0x7f64241567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:16.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.359+0000 7f642a8f2700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6424130a80 0x7f64241567b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44624/0 (socket says 172.21.2.105:44624) 2021-11-12T05:42:16.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.359+0000 7f642a8f2700 1 -- 172.21.2.105:0/312711554 learned_addr learned my addr 172.21.2.105:0/312711554 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:16.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.359+0000 7f642a8f2700 1 -- 172.21.2.105:0/312711554 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f64240626b0 msgr2=0x7f642414ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:16.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.359+0000 7f642a8f2700 1 --2- 172.21.2.105:0/312711554 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f64240626b0 0x7f642414ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:16.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.359+0000 7f642a8f2700 1 -- 172.21.2.105:0/312711554 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f64240af750 msgr2=0x7f6424062e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:16.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.359+0000 7f642a8f2700 1 --2- 172.21.2.105:0/312711554 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f64240af750 0x7f6424062e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:16.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.359+0000 7f642a8f2700 1 -- 172.21.2.105:0/312711554 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f642000b180 con 0x7f6424130a80 2021-11-12T05:42:16.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.359+0000 7f642a8f2700 1 --2- 172.21.2.105:0/312711554 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6424130a80 0x7f64241567b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f641c00c000 tx=0x7f641c0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:16.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.359+0000 7f64177fe700 1 -- 172.21.2.105:0/312711554 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f641c00ee70 con 0x7f6424130a80 2021-11-12T05:42:16.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.359+0000 7f64177fe700 1 -- 172.21.2.105:0/312711554 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641c00c850 con 0x7f6424130a80 2021-11-12T05:42:16.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.359+0000 7f642c355700 1 -- 172.21.2.105:0/312711554 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f642414b7e0 con 0x7f6424130a80 2021-11-12T05:42:16.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.359+0000 7f64177fe700 1 -- 172.21.2.105:0/312711554 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f641c00cbb0 con 0x7f6424130a80 2021-11-12T05:42:16.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.359+0000 7f642c355700 1 -- 172.21.2.105:0/312711554 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6424149d10 con 0x7f6424130a80 2021-11-12T05:42:16.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.359+0000 7f642c355700 1 -- 172.21.2.105:0/312711554 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f642414b390 con 0x7f6424130a80 2021-11-12T05:42:16.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.359+0000 7f64177fe700 1 -- 172.21.2.105:0/312711554 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f641c022070 con 0x7f6424130a80 2021-11-12T05:42:16.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.359+0000 7f64177fe700 1 --2- 172.21.2.105:0/312711554 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6404053640 0x7f6404055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:16.373 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.359+0000 7f64177fe700 1 -- 172.21.2.105:0/312711554 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f641c06c260 con 0x7f6424130a80 2021-11-12T05:42:16.374 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.359+0000 7f642a0f1700 1 --2- 172.21.2.105:0/312711554 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6404053640 0x7f6404055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:16.374 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.359+0000 7f642a0f1700 1 --2- 172.21.2.105:0/312711554 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6404053640 0x7f6404055b00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f6420002f70 tx=0x7f6420014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:16.374 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.363+0000 7f64177fe700 1 -- 172.21.2.105:0/312711554 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f641c043160 con 0x7f6424130a80 2021-11-12T05:42:16.476 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.471+0000 7f642c355700 1 -- 172.21.2.105:0/312711554 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f64241479c0 con 0x7f6424130a80 2021-11-12T05:42:16.974 INFO:tasks.ceph.mon.a.gibba005.stderr:2021-11-12T05:42:16.967+0000 7fe9772b2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-12T05:42:16.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.979+0000 7f64177fe700 1 -- 172.21.2.105:0/312711554 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v11) v1 ==== 161+0+0 (secure 0 0 0) 0x7f641c016070 con 0x7f6424130a80 2021-11-12T05:42:16.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.979+0000 7f642c355700 1 -- 172.21.2.105:0/312711554 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6404053640 msgr2=0x7f6404055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:16.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.979+0000 7f642c355700 1 --2- 172.21.2.105:0/312711554 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6404053640 0x7f6404055b00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f6420002f70 tx=0x7f6420014000).stop 2021-11-12T05:42:16.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.979+0000 7f642c355700 1 -- 172.21.2.105:0/312711554 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6424130a80 msgr2=0x7f64241567b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:16.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.979+0000 7f642c355700 1 --2- 172.21.2.105:0/312711554 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6424130a80 0x7f64241567b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f641c00c000 tx=0x7f641c0091d0).stop 2021-11-12T05:42:16.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.979+0000 7f642c355700 1 -- 172.21.2.105:0/312711554 shutdown_connections 2021-11-12T05:42:16.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.979+0000 7f642c355700 1 --2- 172.21.2.105:0/312711554 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6404053640 0x7f6404055b00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:16.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.979+0000 7f642c355700 1 --2- 172.21.2.105:0/312711554 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6424130a80 0x7f64241567b0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:16.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.979+0000 7f642c355700 1 --2- 172.21.2.105:0/312711554 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f64240af750 0x7f6424062e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:16.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.979+0000 7f642c355700 1 --2- 172.21.2.105:0/312711554 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f64240626b0 0x7f642414ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:16.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.979+0000 7f642c355700 1 -- 172.21.2.105:0/312711554 >> 172.21.2.105:0/312711554 conn(0x7f64240b5320 msgr2=0x7f64240b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:16.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.983+0000 7f642c355700 1 -- 172.21.2.105:0/312711554 shutdown_connections 2021-11-12T05:42:16.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:16.983+0000 7f642c355700 1 -- 172.21.2.105:0/312711554 wait complete. 2021-11-12T05:42:16.989 INFO:teuthology.orchestra.run.gibba005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-12T05:42:16.992 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:42:17.005 INFO:tasks.ceph.mds.a.gibba005.stdout:starting mds.a at 2021-11-12T05:42:17.045 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.039+0000 7f611b2cc700 1 Processor -- start 2021-11-12T05:42:17.045 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.039+0000 7f611b2cc700 1 -- start start 2021-11-12T05:42:17.050 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.039+0000 7f611b2cc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f61140adaf0 0x7f611413fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:17.050 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.039+0000 7f611b2cc700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6114067860 con 0x7f6114143b40 2021-11-12T05:42:17.050 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.039+0000 7f611b2cc700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6114143400 con 0x7f6114143fb0 2021-11-12T05:42:17.050 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.039+0000 7f611b2cc700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61141436a0 con 0x7f61140adaf0 2021-11-12T05:42:17.051 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.039+0000 7f6118867700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f6114143b40 0x7f61140aded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:55042/0 (socket says 172.21.2.105:55042) 2021-11-12T05:42:17.051 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.039+0000 7f6118867700 1 -- 172.21.2.105:0/2232946175 learned_addr learned my addr 172.21.2.105:0/2232946175 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:42:17.051 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.039+0000 7f6119068700 1 --2- 172.21.2.105:0/2232946175 >> v2:172.21.2.105:3300/0 conn(0x7f61140adaf0 0x7f611413fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:17.052 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.039+0000 7f6103fff700 1 -- 172.21.2.105:0/2232946175 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 113153057 0 0) 0x7f6114067860 con 0x7f6114143b40 2021-11-12T05:42:17.052 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.039+0000 7f6103fff700 1 -- 172.21.2.105:0/2232946175 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60fc003260 con 0x7f6114143b40 2021-11-12T05:42:17.052 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.039+0000 7f6119068700 1 -- 172.21.2.105:0/2232946175 >> v1:172.21.2.115:6789/0 conn(0x7f6114143fb0 legacy=0x7f61140afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:17.052 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.039+0000 7f6119068700 1 -- 172.21.2.105:0/2232946175 >> v1:172.21.2.105:6789/0 conn(0x7f6114143b40 legacy=0x7f61140aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:17.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.039+0000 7f6119068700 1 -- 172.21.2.105:0/2232946175 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61140b2b40 con 0x7f61140adaf0 2021-11-12T05:42:17.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.043+0000 7f6119068700 1 --2- 172.21.2.105:0/2232946175 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f61140adaf0 0x7f611413fd90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f61140625f0 tx=0x7f6104006df0).ready entity=mon.0 client_cookie=52b994a0e0b4b4fe server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:17.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.043+0000 7f6103fff700 1 -- 172.21.2.105:0/2232946175 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f610400d5c0 con 0x7f61140adaf0 2021-11-12T05:42:17.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.043+0000 7f6103fff700 1 -- 172.21.2.105:0/2232946175 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6104000e90 con 0x7f61140adaf0 2021-11-12T05:42:17.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.043+0000 7f6103fff700 1 -- 172.21.2.105:0/2232946175 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f610400d910 con 0x7f61140adaf0 2021-11-12T05:42:17.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.043+0000 7f611b2cc700 1 -- 172.21.2.105:0/2232946175 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f61140adaf0 msgr2=0x7f611413fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:17.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.043+0000 7f611b2cc700 1 --2- 172.21.2.105:0/2232946175 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f61140adaf0 0x7f611413fd90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f61140625f0 tx=0x7f6104006df0).stop 2021-11-12T05:42:17.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.043+0000 7f611b2cc700 1 -- 172.21.2.105:0/2232946175 shutdown_connections 2021-11-12T05:42:17.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.043+0000 7f611b2cc700 1 --2- 172.21.2.105:0/2232946175 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f61140adaf0 0x7f611413fd90 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:17.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.043+0000 7f611b2cc700 1 -- 172.21.2.105:0/2232946175 >> 172.21.2.105:0/2232946175 conn(0x7f611405c490 msgr2=0x7f611405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:17.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.043+0000 7f611b2cc700 1 -- 172.21.2.105:0/2232946175 shutdown_connections 2021-11-12T05:42:17.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.043+0000 7f611b2cc700 1 -- 172.21.2.105:0/2232946175 wait complete. 2021-11-12T05:42:17.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.043+0000 7f611b2cc700 1 Processor -- start 2021-11-12T05:42:17.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.043+0000 7f611b2cc700 1 -- start start 2021-11-12T05:42:17.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.043+0000 7f611b2cc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f61140adaf0 0x7f6114063530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:17.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.043+0000 7f611b2cc700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6114143b40 0x7f6114150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:17.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.043+0000 7f611b2cc700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6114143fb0 0x7f6114150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:17.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.043+0000 7f611b2cc700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6114063a20 con 0x7f61140adaf0 2021-11-12T05:42:17.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.043+0000 7f611b2cc700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6114150d60 con 0x7f6114143b40 2021-11-12T05:42:17.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.043+0000 7f611b2cc700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6114140700 con 0x7f6114143fb0 2021-11-12T05:42:17.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.043+0000 7f6119068700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f61140adaf0 0x7f6114063530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:17.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.043+0000 7f6119068700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f61140adaf0 0x7f6114063530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44650/0 (socket says 172.21.2.105:44650) 2021-11-12T05:42:17.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.043+0000 7f6119068700 1 -- 172.21.2.105:0/3207978518 learned_addr learned my addr 172.21.2.105:0/3207978518 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:17.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.043+0000 7f6119068700 1 -- 172.21.2.105:0/3207978518 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6114143fb0 msgr2=0x7f6114150870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:17.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.043+0000 7f6119068700 1 --2- 172.21.2.105:0/3207978518 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6114143fb0 0x7f6114150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:17.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.043+0000 7f6119068700 1 -- 172.21.2.105:0/3207978518 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6114143b40 msgr2=0x7f6114150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:17.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.043+0000 7f6119068700 1 --2- 172.21.2.105:0/3207978518 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6114143b40 0x7f6114150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:17.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.043+0000 7f6119068700 1 -- 172.21.2.105:0/3207978518 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610400b180 con 0x7f61140adaf0 2021-11-12T05:42:17.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.043+0000 7f6119068700 1 --2- 172.21.2.105:0/3207978518 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f61140adaf0 0x7f6114063530 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f6114150ea0 tx=0x7f6104014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:17.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.043+0000 7f61027fc700 1 -- 172.21.2.105:0/3207978518 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6104013ba0 con 0x7f61140adaf0 2021-11-12T05:42:17.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.043+0000 7f61027fc700 1 -- 172.21.2.105:0/3207978518 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6104022070 con 0x7f61140adaf0 2021-11-12T05:42:17.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.043+0000 7f611b2cc700 1 -- 172.21.2.105:0/3207978518 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61141409a0 con 0x7f61140adaf0 2021-11-12T05:42:17.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.043+0000 7f61027fc700 1 -- 172.21.2.105:0/3207978518 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f610401e600 con 0x7f61140adaf0 2021-11-12T05:42:17.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.043+0000 7f611b2cc700 1 -- 172.21.2.105:0/3207978518 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6114151320 con 0x7f61140adaf0 2021-11-12T05:42:17.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.043+0000 7f611b2cc700 1 -- 172.21.2.105:0/3207978518 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61140afb00 con 0x7f61140adaf0 2021-11-12T05:42:17.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.043+0000 7f61027fc700 1 -- 172.21.2.105:0/3207978518 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f610400f030 con 0x7f61140adaf0 2021-11-12T05:42:17.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.043+0000 7f61027fc700 1 --2- 172.21.2.105:0/3207978518 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f60f4053660 0x7f60f4055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:17.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.043+0000 7f61027fc700 1 -- 172.21.2.105:0/3207978518 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f6104070ed0 con 0x7f61140adaf0 2021-11-12T05:42:17.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.043+0000 7f6118867700 1 --2- 172.21.2.105:0/3207978518 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f60f4053660 0x7f60f4055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:17.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.047+0000 7f6118867700 1 --2- 172.21.2.105:0/3207978518 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f60f4053660 0x7f60f4055b20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f6110001110 tx=0x7f61100076c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:17.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.047+0000 7f61027fc700 1 -- 172.21.2.105:0/3207978518 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6104047e80 con 0x7f61140adaf0 2021-11-12T05:42:17.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.159+0000 7f611b2cc700 1 -- 172.21.2.105:0/3207978518 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6114057350 con 0x7f61140adaf0 2021-11-12T05:42:17.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.159+0000 7f61027fc700 1 -- 172.21.2.105:0/3207978518 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+1776 (secure 0 0 0) 0x7f610404b4a0 con 0x7f61140adaf0 2021-11-12T05:42:17.165 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:42:17.165 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":11,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4429,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/4118304786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":4118304786},{"type":"v1","addr":"172.21.2.115:6833","nonce":4118304786}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":11,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:41:07.250137+0000","modified":"2021-11-12T05:42:16.974700+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":36,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-11-12T05:42:17.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.159+0000 7f611b2cc700 1 -- 172.21.2.105:0/3207978518 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f60f4053660 msgr2=0x7f60f4055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:17.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.159+0000 7f611b2cc700 1 --2- 172.21.2.105:0/3207978518 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f60f4053660 0x7f60f4055b20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f6110001110 tx=0x7f61100076c0).stop 2021-11-12T05:42:17.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.159+0000 7f611b2cc700 1 -- 172.21.2.105:0/3207978518 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f61140adaf0 msgr2=0x7f6114063530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:17.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.159+0000 7f611b2cc700 1 --2- 172.21.2.105:0/3207978518 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f61140adaf0 0x7f6114063530 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f6114150ea0 tx=0x7f6104014000).stop 2021-11-12T05:42:17.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.159+0000 7f611b2cc700 1 -- 172.21.2.105:0/3207978518 shutdown_connections 2021-11-12T05:42:17.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.159+0000 7f611b2cc700 1 --2- 172.21.2.105:0/3207978518 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f60f4053660 0x7f60f4055b20 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:17.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.159+0000 7f611b2cc700 1 --2- 172.21.2.105:0/3207978518 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6114143fb0 0x7f6114150870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:17.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.159+0000 7f611b2cc700 1 --2- 172.21.2.105:0/3207978518 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6114143b40 0x7f6114150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:17.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.159+0000 7f611b2cc700 1 --2- 172.21.2.105:0/3207978518 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f61140adaf0 0x7f6114063530 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:17.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.159+0000 7f611b2cc700 1 -- 172.21.2.105:0/3207978518 >> 172.21.2.105:0/3207978518 conn(0x7f611405c490 msgr2=0x7f61140afd30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:17.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.163+0000 7f611b2cc700 1 -- 172.21.2.105:0/3207978518 shutdown_connections 2021-11-12T05:42:17.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.163+0000 7f611b2cc700 1 -- 172.21.2.105:0/3207978518 wait complete. 2021-11-12T05:42:17.169 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 11 2021-11-12T05:42:17.172 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-12T05:42:17.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.259+0000 7f7557223700 1 Processor -- start 2021-11-12T05:42:17.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.259+0000 7f7557223700 1 -- start start 2021-11-12T05:42:17.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f7557223700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f75500ace20 0x7f75500b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:17.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f7557223700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75500b1840 con 0x7f75500aca40 2021-11-12T05:42:17.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f7557223700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75500af2b0 con 0x7f7550144180 2021-11-12T05:42:17.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f7557223700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75500ad2a0 con 0x7f75500ace20 2021-11-12T05:42:17.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f7554fbf700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f75500aca40 0x7f75501473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:55054/0 (socket says 172.21.2.105:55054) 2021-11-12T05:42:17.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f7554fbf700 1 -- 172.21.2.105:0/3561413334 learned_addr learned my addr 172.21.2.105:0/3561413334 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:42:17.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f754f7fe700 1 -- 172.21.2.105:0/3561413334 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3789997521 0 0) 0x7f75500b1840 con 0x7f75500aca40 2021-11-12T05:42:17.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f754f7fe700 1 -- 172.21.2.105:0/3561413334 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7530003260 con 0x7f75500aca40 2021-11-12T05:42:17.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f754f7fe700 1 -- 172.21.2.105:0/3561413334 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2493448840 0 0) 0x7f7530003260 con 0x7f75500aca40 2021-11-12T05:42:17.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f754f7fe700 1 -- 172.21.2.105:0/3561413334 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f75500ace20 msgr2=0x7f75500b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:17.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f754f7fe700 1 --2- 172.21.2.105:0/3561413334 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f75500ace20 0x7f75500b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:17.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f754f7fe700 1 -- 172.21.2.105:0/3561413334 >> v1:172.21.2.115:6789/0 conn(0x7f7550144180 legacy=0x7f7550144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:17.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f754f7fe700 1 -- 172.21.2.105:0/3561413334 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75500b1a70 con 0x7f75500aca40 2021-11-12T05:42:17.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f754f7fe700 1 -- 172.21.2.105:0/3561413334 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f7538001660 con 0x7f75500aca40 2021-11-12T05:42:17.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f754f7fe700 1 -- 172.21.2.105:0/3561413334 >> v1:172.21.2.105:6789/0 conn(0x7f75500aca40 legacy=0x7f75501473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:17.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f754f7fe700 1 --2- 172.21.2.105:0/3561413334 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7530003800 0x7f7530003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:17.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f754f7fe700 1 --2- 172.21.2.105:0/3561413334 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f75500ace20 0x7f7530004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:17.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f754f7fe700 1 --2- 172.21.2.105:0/3561413334 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7530004bf0 0x7f753000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:17.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f754f7fe700 1 -- 172.21.2.105:0/3561413334 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75300052c0 con 0x7f7530004bf0 2021-11-12T05:42:17.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f754f7fe700 1 -- 172.21.2.105:0/3561413334 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753000bc40 con 0x7f7530003800 2021-11-12T05:42:17.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f754f7fe700 1 -- 172.21.2.105:0/3561413334 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f753000bd80 con 0x7f75500ace20 2021-11-12T05:42:17.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f75557c0700 1 --2- 172.21.2.105:0/3561413334 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7530004bf0 0x7f753000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:17.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f7554fbf700 1 --2- 172.21.2.105:0/3561413334 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7530003800 0x7f7530003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:17.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f754ffff700 1 --2- 172.21.2.105:0/3561413334 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f75500ace20 0x7f7530004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:17.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f75557c0700 1 -- 172.21.2.105:0/3561413334 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f75500ace20 msgr2=0x7f7530004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:17.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f75557c0700 1 --2- 172.21.2.105:0/3561413334 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f75500ace20 0x7f7530004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:17.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f75557c0700 1 -- 172.21.2.105:0/3561413334 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7530003800 msgr2=0x7f7530003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:17.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f75557c0700 1 --2- 172.21.2.105:0/3561413334 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7530003800 0x7f7530003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:17.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f75557c0700 1 -- 172.21.2.105:0/3561413334 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7530003260 con 0x7f7530004bf0 2021-11-12T05:42:17.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f7554fbf700 1 --2- 172.21.2.105:0/3561413334 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7530003800 0x7f7530003c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:42:17.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f754ffff700 1 --2- 172.21.2.105:0/3561413334 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f75500ace20 0x7f7530004500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:42:17.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f75557c0700 1 --2- 172.21.2.105:0/3561413334 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7530004bf0 0x7f753000b750 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f7530004470 tx=0x7f7548007d80).ready entity=mon.0 client_cookie=c1d6943dd5e5a998 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:17.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f754f7fe700 1 -- 172.21.2.105:0/3561413334 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7548002510 con 0x7f7530004bf0 2021-11-12T05:42:17.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f754f7fe700 1 -- 172.21.2.105:0/3561413334 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7548006890 con 0x7f7530004bf0 2021-11-12T05:42:17.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f754f7fe700 1 -- 172.21.2.105:0/3561413334 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7548006bf0 con 0x7f7530004bf0 2021-11-12T05:42:17.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f7557223700 1 -- 172.21.2.105:0/3561413334 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7530004bf0 msgr2=0x7f753000b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:17.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f7557223700 1 --2- 172.21.2.105:0/3561413334 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7530004bf0 0x7f753000b750 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f7530004470 tx=0x7f7548007d80).stop 2021-11-12T05:42:17.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f75557c0700 1 -- 172.21.2.105:0/3561413334 reap_dead start 2021-11-12T05:42:17.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f7557223700 1 -- 172.21.2.105:0/3561413334 shutdown_connections 2021-11-12T05:42:17.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f7557223700 1 -- 172.21.2.105:0/3561413334 >> 172.21.2.105:0/3561413334 conn(0x7f755005c490 msgr2=0x7f75500b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:17.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f7557223700 1 -- 172.21.2.105:0/3561413334 shutdown_connections 2021-11-12T05:42:17.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.263+0000 7f7557223700 1 -- 172.21.2.105:0/3561413334 wait complete. 2021-11-12T05:42:17.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.267+0000 7f7557223700 1 Processor -- start 2021-11-12T05:42:17.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.267+0000 7f7557223700 1 -- start start 2021-11-12T05:42:17.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.267+0000 7f7557223700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7530004bf0 0x7f7550146160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:17.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.267+0000 7f7557223700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7550063700 0x7f755015a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:17.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.267+0000 7f7557223700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7550156910 0x7f7550156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:17.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.267+0000 7f7557223700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75501565c0 con 0x7f7550063700 2021-11-12T05:42:17.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.267+0000 7f7557223700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755015ab70 con 0x7f7530004bf0 2021-11-12T05:42:17.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.267+0000 7f7557223700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7550062a50 con 0x7f7550156910 2021-11-12T05:42:17.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.267+0000 7f754ffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7550063700 0x7f755015a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:17.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.267+0000 7f754ffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7550063700 0x7f755015a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44672/0 (socket says 172.21.2.105:44672) 2021-11-12T05:42:17.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.267+0000 7f754ffff700 1 -- 172.21.2.105:0/944767224 learned_addr learned my addr 172.21.2.105:0/944767224 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:17.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.267+0000 7f7554fbf700 1 --2- 172.21.2.105:0/944767224 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7530004bf0 0x7f7550146160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:17.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.267+0000 7f754ffff700 1 -- 172.21.2.105:0/944767224 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7550156910 msgr2=0x7f7550156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:17.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.267+0000 7f754ffff700 1 --2- 172.21.2.105:0/944767224 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7550156910 0x7f7550156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:17.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.267+0000 7f754ffff700 1 -- 172.21.2.105:0/944767224 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7530004bf0 msgr2=0x7f7550146160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:17.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.267+0000 7f754ffff700 1 --2- 172.21.2.105:0/944767224 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7530004bf0 0x7f7550146160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:17.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.267+0000 7f754ffff700 1 -- 172.21.2.105:0/944767224 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7550062cf0 con 0x7f7550063700 2021-11-12T05:42:17.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.267+0000 7f754ffff700 1 --2- 172.21.2.105:0/944767224 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7550063700 0x7f755015a680 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f755015acb0 tx=0x7f7540008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:17.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.267+0000 7f754dffb700 1 -- 172.21.2.105:0/944767224 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f754000e440 con 0x7f7550063700 2021-11-12T05:42:17.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.267+0000 7f754dffb700 1 -- 172.21.2.105:0/944767224 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754000c030 con 0x7f7550063700 2021-11-12T05:42:17.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.267+0000 7f754dffb700 1 -- 172.21.2.105:0/944767224 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f754000e790 con 0x7f7550063700 2021-11-12T05:42:17.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.267+0000 7f7557223700 1 -- 172.21.2.105:0/944767224 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7550062f90 con 0x7f7550063700 2021-11-12T05:42:17.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.267+0000 7f7557223700 1 -- 172.21.2.105:0/944767224 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7550157280 con 0x7f7550063700 2021-11-12T05:42:17.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.267+0000 7f7557223700 1 -- 172.21.2.105:0/944767224 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7550057350 con 0x7f7550063700 2021-11-12T05:42:17.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.267+0000 7f754dffb700 1 -- 172.21.2.105:0/944767224 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f754000e8f0 con 0x7f7550063700 2021-11-12T05:42:17.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.267+0000 7f754dffb700 1 --2- 172.21.2.105:0/944767224 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7534053610 0x7f7534055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:17.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.267+0000 7f754dffb700 1 -- 172.21.2.105:0/944767224 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f754006bae0 con 0x7f7550063700 2021-11-12T05:42:17.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.267+0000 7f7554fbf700 1 --2- 172.21.2.105:0/944767224 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7534053610 0x7f7534055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:17.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.267+0000 7f7554fbf700 1 --2- 172.21.2.105:0/944767224 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7534053610 0x7f7534055ad0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f7538009000 tx=0x7f7538009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:17.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.271+0000 7f754dffb700 1 -- 172.21.2.105:0/944767224 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7540042a90 con 0x7f7550063700 2021-11-12T05:42:17.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.379+0000 7f7557223700 1 -- 172.21.2.105:0/944767224 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f755005f280 con 0x7f7550063700 2021-11-12T05:42:17.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.991+0000 7f754dffb700 1 -- 172.21.2.105:0/944767224 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v12) v1 ==== 104+0+0 (secure 0 0 0) 0x7f75400460b0 con 0x7f7550063700 2021-11-12T05:42:17.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.991+0000 7f7557223700 1 -- 172.21.2.105:0/944767224 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7534053610 msgr2=0x7f7534055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:17.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.991+0000 7f7557223700 1 --2- 172.21.2.105:0/944767224 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7534053610 0x7f7534055ad0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f7538009000 tx=0x7f7538009040).stop 2021-11-12T05:42:17.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.991+0000 7f7557223700 1 -- 172.21.2.105:0/944767224 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7550063700 msgr2=0x7f755015a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:17.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.991+0000 7f7557223700 1 --2- 172.21.2.105:0/944767224 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7550063700 0x7f755015a680 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f755015acb0 tx=0x7f7540008040).stop 2021-11-12T05:42:17.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.991+0000 7f7557223700 1 -- 172.21.2.105:0/944767224 shutdown_connections 2021-11-12T05:42:17.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.991+0000 7f7557223700 1 --2- 172.21.2.105:0/944767224 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7534053610 0x7f7534055ad0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:17.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.991+0000 7f7557223700 1 --2- 172.21.2.105:0/944767224 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7550156910 0x7f7550156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:18.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.991+0000 7f7557223700 1 --2- 172.21.2.105:0/944767224 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7550063700 0x7f755015a680 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:18.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.991+0000 7f7557223700 1 --2- 172.21.2.105:0/944767224 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7530004bf0 0x7f7550146160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:18.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.991+0000 7f7557223700 1 -- 172.21.2.105:0/944767224 >> 172.21.2.105:0/944767224 conn(0x7f755005c490 msgr2=0x7f7550141490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:18.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.991+0000 7f7557223700 1 -- 172.21.2.105:0/944767224 shutdown_connections 2021-11-12T05:42:18.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:17.991+0000 7f7557223700 1 -- 172.21.2.105:0/944767224 wait complete. 2021-11-12T05:42:18.004 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-12T05:42:18.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.055+0000 7f996d9ee700 1 Processor -- start 2021-11-12T05:42:18.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.055+0000 7f996d9ee700 1 -- start start 2021-11-12T05:42:18.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.055+0000 7f996d9ee700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f99680adaf0 0x7f996813fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:18.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.055+0000 7f996d9ee700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f9968143fb0 0x7f99680afe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:18.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.055+0000 7f996d9ee700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9968067860 con 0x7f9968143b40 2021-11-12T05:42:18.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.055+0000 7f996d9ee700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9968143400 con 0x7f99680adaf0 2021-11-12T05:42:18.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.055+0000 7f996d9ee700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99681436a0 con 0x7f9968143fb0 2021-11-12T05:42:18.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.055+0000 7f9966ffd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f99680adaf0 0x7f996813fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:18.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.055+0000 7f99667fc700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f9968143b40 0x7f99680aded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:55076/0 (socket says 172.21.2.105:55076) 2021-11-12T05:42:18.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.055+0000 7f99667fc700 1 -- 172.21.2.105:0/3845941015 learned_addr learned my addr 172.21.2.105:0/3845941015 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:42:18.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.055+0000 7f9966ffd700 1 -- 172.21.2.105:0/3845941015 >> v2:172.21.2.115:3300/0 conn(0x7f9968143fb0 msgr2=0x7f99680afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:18.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.055+0000 7f9966ffd700 1 --2- 172.21.2.105:0/3845941015 >> v2:172.21.2.115:3300/0 conn(0x7f9968143fb0 0x7f99680afe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:18.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.055+0000 7f9966ffd700 1 -- 172.21.2.105:0/3845941015 >> v1:172.21.2.105:6789/0 conn(0x7f9968143b40 legacy=0x7f99680aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:18.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.055+0000 7f9966ffd700 1 -- 172.21.2.105:0/3845941015 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99680b2b40 con 0x7f99680adaf0 2021-11-12T05:42:18.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.055+0000 7f9966ffd700 1 --2- 172.21.2.105:0/3845941015 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99680adaf0 0x7f996813fd90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f9950002f70 tx=0x7f9950006e80).ready entity=mon.0 client_cookie=1ffc6f446be899c3 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:18.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.055+0000 7f9965ffb700 1 -- 172.21.2.105:0/3845941015 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f995000ba40 con 0x7f99680adaf0 2021-11-12T05:42:18.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.055+0000 7f9965ffb700 1 -- 172.21.2.105:0/3845941015 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9950000e90 con 0x7f99680adaf0 2021-11-12T05:42:18.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.055+0000 7f9965ffb700 1 -- 172.21.2.105:0/3845941015 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f995000bd90 con 0x7f99680adaf0 2021-11-12T05:42:18.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.055+0000 7f996d9ee700 1 -- 172.21.2.105:0/3845941015 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99680adaf0 msgr2=0x7f996813fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:18.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.055+0000 7f996d9ee700 1 --2- 172.21.2.105:0/3845941015 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99680adaf0 0x7f996813fd90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f9950002f70 tx=0x7f9950006e80).stop 2021-11-12T05:42:18.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.055+0000 7f996d9ee700 1 -- 172.21.2.105:0/3845941015 shutdown_connections 2021-11-12T05:42:18.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.055+0000 7f996d9ee700 1 --2- 172.21.2.105:0/3845941015 >> v2:172.21.2.115:3300/0 conn(0x7f9968143fb0 0x7f99680afe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:18.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.055+0000 7f996d9ee700 1 --2- 172.21.2.105:0/3845941015 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99680adaf0 0x7f996813fd90 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:18.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.055+0000 7f996d9ee700 1 -- 172.21.2.105:0/3845941015 >> 172.21.2.105:0/3845941015 conn(0x7f996805c490 msgr2=0x7f996805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:18.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.055+0000 7f996d9ee700 1 -- 172.21.2.105:0/3845941015 shutdown_connections 2021-11-12T05:42:18.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.055+0000 7f996d9ee700 1 -- 172.21.2.105:0/3845941015 wait complete. 2021-11-12T05:42:18.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.059+0000 7f996d9ee700 1 Processor -- start 2021-11-12T05:42:18.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.059+0000 7f996d9ee700 1 -- start start 2021-11-12T05:42:18.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.059+0000 7f996d9ee700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99680adaf0 0x7f99680ab670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:18.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.059+0000 7f996d9ee700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9968143b40 0x7f99680aa380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:18.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.059+0000 7f996d9ee700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9968143fb0 0x7f9968157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:18.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.059+0000 7f996d9ee700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99680aca60 con 0x7f99680adaf0 2021-11-12T05:42:18.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.059+0000 7f996d9ee700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9968135380 con 0x7f9968143fb0 2021-11-12T05:42:18.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.059+0000 7f996d9ee700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f996813e780 con 0x7f9968143b40 2021-11-12T05:42:18.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.059+0000 7f9966ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99680adaf0 0x7f99680ab670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:18.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.059+0000 7f9966ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99680adaf0 0x7f99680ab670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44688/0 (socket says 172.21.2.105:44688) 2021-11-12T05:42:18.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.059+0000 7f9966ffd700 1 -- 172.21.2.105:0/3254193976 learned_addr learned my addr 172.21.2.105:0/3254193976 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:18.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.059+0000 7f9966ffd700 1 -- 172.21.2.105:0/3254193976 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9968143b40 msgr2=0x7f99680aa380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:18.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.059+0000 7f9966ffd700 1 --2- 172.21.2.105:0/3254193976 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9968143b40 0x7f99680aa380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:18.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.059+0000 7f9966ffd700 1 -- 172.21.2.105:0/3254193976 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9968143fb0 msgr2=0x7f9968157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:18.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.059+0000 7f9966ffd700 1 --2- 172.21.2.105:0/3254193976 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9968143fb0 0x7f9968157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:18.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.059+0000 7f9966ffd700 1 -- 172.21.2.105:0/3254193976 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f995000d410 con 0x7f99680adaf0 2021-11-12T05:42:18.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.059+0000 7f9966ffd700 1 --2- 172.21.2.105:0/3254193976 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99680adaf0 0x7f99680ab670 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f99681354c0 tx=0x7f9950006e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:18.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.059+0000 7f995ffff700 1 -- 172.21.2.105:0/3254193976 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9950018800 con 0x7f99680adaf0 2021-11-12T05:42:18.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.059+0000 7f995ffff700 1 -- 172.21.2.105:0/3254193976 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9950018960 con 0x7f99680adaf0 2021-11-12T05:42:18.074 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.059+0000 7f995ffff700 1 -- 172.21.2.105:0/3254193976 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9950018cc0 con 0x7f99680adaf0 2021-11-12T05:42:18.074 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.059+0000 7f996d9ee700 1 -- 172.21.2.105:0/3254193976 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9968156d70 con 0x7f99680adaf0 2021-11-12T05:42:18.074 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.059+0000 7f996d9ee700 1 -- 172.21.2.105:0/3254193976 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99680abea0 con 0x7f99680adaf0 2021-11-12T05:42:18.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.059+0000 7f996d9ee700 1 -- 172.21.2.105:0/3254193976 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9968156bc0 con 0x7f99680adaf0 2021-11-12T05:42:18.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.059+0000 7f995ffff700 1 -- 172.21.2.105:0/3254193976 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9950029070 con 0x7f99680adaf0 2021-11-12T05:42:18.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.059+0000 7f995ffff700 1 --2- 172.21.2.105:0/3254193976 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f994c053580 0x7f994c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:18.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.059+0000 7f995ffff700 1 -- 172.21.2.105:0/3254193976 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f995006dca0 con 0x7f99680adaf0 2021-11-12T05:42:18.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.059+0000 7f99667fc700 1 --2- 172.21.2.105:0/3254193976 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f994c053580 0x7f994c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:18.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.059+0000 7f99667fc700 1 --2- 172.21.2.105:0/3254193976 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f994c053580 0x7f994c055a40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f99680af9a0 tx=0x7f9958007800).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:18.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.063+0000 7f995ffff700 1 -- 172.21.2.105:0/3254193976 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9950072070 con 0x7f99680adaf0 2021-11-12T05:42:18.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:18.143+0000 7f996d9ee700 1 -- 172.21.2.105:0/3254193976 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f99680afb00 con 0x7f99680adaf0 2021-11-12T05:42:19.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.007+0000 7f995ffff700 1 -- 172.21.2.105:0/3254193976 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v37) v1 ==== 185+0+0 (secure 0 0 0) 0x7f9950048680 con 0x7f99680adaf0 2021-11-12T05:42:19.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.007+0000 7f996d9ee700 1 -- 172.21.2.105:0/3254193976 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f994c053580 msgr2=0x7f994c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:19.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.007+0000 7f996d9ee700 1 --2- 172.21.2.105:0/3254193976 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f994c053580 0x7f994c055a40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f99680af9a0 tx=0x7f9958007800).stop 2021-11-12T05:42:19.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.007+0000 7f996d9ee700 1 -- 172.21.2.105:0/3254193976 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99680adaf0 msgr2=0x7f99680ab670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:19.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.007+0000 7f996d9ee700 1 --2- 172.21.2.105:0/3254193976 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99680adaf0 0x7f99680ab670 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f99681354c0 tx=0x7f9950006e80).stop 2021-11-12T05:42:19.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.007+0000 7f996d9ee700 1 -- 172.21.2.105:0/3254193976 shutdown_connections 2021-11-12T05:42:19.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.011+0000 7f996d9ee700 1 --2- 172.21.2.105:0/3254193976 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f994c053580 0x7f994c055a40 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:19.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.011+0000 7f996d9ee700 1 --2- 172.21.2.105:0/3254193976 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9968143fb0 0x7f9968157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:19.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.011+0000 7f996d9ee700 1 --2- 172.21.2.105:0/3254193976 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9968143b40 0x7f99680aa380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:19.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.011+0000 7f996d9ee700 1 --2- 172.21.2.105:0/3254193976 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99680adaf0 0x7f99680ab670 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:19.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.011+0000 7f996d9ee700 1 -- 172.21.2.105:0/3254193976 >> 172.21.2.105:0/3254193976 conn(0x7f996805c490 msgr2=0x7f9968138060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:19.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.011+0000 7f996d9ee700 1 -- 172.21.2.105:0/3254193976 shutdown_connections 2021-11-12T05:42:19.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.011+0000 7f996d9ee700 1 -- 172.21.2.105:0/3254193976 wait complete. 2021-11-12T05:42:19.020 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_metadata' removed 2021-11-12T05:42:19.021 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-12T05:42:19.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.071+0000 7f23eb119700 1 Processor -- start 2021-11-12T05:42:19.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.071+0000 7f23eb119700 1 -- start start 2021-11-12T05:42:19.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.071+0000 7f23eb119700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f23e4143b40 0x7f23e40aded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:19.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.071+0000 7f23eb119700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f23e40ae3c0 0x7f23e40afe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:19.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.071+0000 7f23eb119700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23e4067860 con 0x7f23e40adaf0 2021-11-12T05:42:19.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.071+0000 7f23eb119700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23e41404a0 con 0x7f23e4143b40 2021-11-12T05:42:19.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.071+0000 7f23eb119700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e4143400 con 0x7f23e40ae3c0 2021-11-12T05:42:19.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.071+0000 7f23e3fff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f23e4143b40 0x7f23e40aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:19.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.071+0000 7f23e3fff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f23e4143b40 0x7f23e40aded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44698/0 (socket says 172.21.2.105:44698) 2021-11-12T05:42:19.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.071+0000 7f23e3fff700 1 -- 172.21.2.105:0/2116958439 learned_addr learned my addr 172.21.2.105:0/2116958439 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:19.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.071+0000 7f23e3fff700 1 -- 172.21.2.105:0/2116958439 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f23e40ae3c0 msgr2=0x7f23e40afe10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:42:19.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.071+0000 7f23e3fff700 1 --2- 172.21.2.105:0/2116958439 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f23e40ae3c0 0x7f23e40afe10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:19.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.071+0000 7f23e3fff700 1 -- 172.21.2.105:0/2116958439 >> v1:172.21.2.115:6789/0 conn(0x7f23e40adaf0 legacy=0x7f23e413fd90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:42:19.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.071+0000 7f23e3fff700 1 -- 172.21.2.105:0/2116958439 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e41436a0 con 0x7f23e4143b40 2021-11-12T05:42:19.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.071+0000 7f23e3fff700 1 --2- 172.21.2.105:0/2116958439 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f23e4143b40 0x7f23e40aded0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f23e40625f0 tx=0x7f23d4006eb0).ready entity=mon.0 client_cookie=9ecac5cd29d7c454 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:19.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.071+0000 7f23e37fe700 1 -- 172.21.2.105:0/2116958439 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23d400d570 con 0x7f23e4143b40 2021-11-12T05:42:19.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.071+0000 7f23e37fe700 1 -- 172.21.2.105:0/2116958439 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d4000e90 con 0x7f23e4143b40 2021-11-12T05:42:19.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.071+0000 7f23e37fe700 1 -- 172.21.2.105:0/2116958439 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23d400d8c0 con 0x7f23e4143b40 2021-11-12T05:42:19.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.071+0000 7f23eb119700 1 -- 172.21.2.105:0/2116958439 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f23e4143b40 msgr2=0x7f23e40aded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:19.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.071+0000 7f23eb119700 1 --2- 172.21.2.105:0/2116958439 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f23e4143b40 0x7f23e40aded0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f23e40625f0 tx=0x7f23d4006eb0).stop 2021-11-12T05:42:19.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.071+0000 7f23eb119700 1 -- 172.21.2.105:0/2116958439 shutdown_connections 2021-11-12T05:42:19.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.071+0000 7f23eb119700 1 --2- 172.21.2.105:0/2116958439 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f23e40ae3c0 0x7f23e40afe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:19.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.071+0000 7f23eb119700 1 --2- 172.21.2.105:0/2116958439 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f23e4143b40 0x7f23e40aded0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:19.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.071+0000 7f23eb119700 1 -- 172.21.2.105:0/2116958439 >> 172.21.2.105:0/2116958439 conn(0x7f23e405c490 msgr2=0x7f23e405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:19.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.071+0000 7f23eb119700 1 -- 172.21.2.105:0/2116958439 shutdown_connections 2021-11-12T05:42:19.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.071+0000 7f23eb119700 1 -- 172.21.2.105:0/2116958439 wait complete. 2021-11-12T05:42:19.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.075+0000 7f23eb119700 1 Processor -- start 2021-11-12T05:42:19.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.075+0000 7f23eb119700 1 -- start start 2021-11-12T05:42:19.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.075+0000 7f23eb119700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f23e40adaf0 0x7f23e4142ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:19.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.075+0000 7f23eb119700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f23e40ae3c0 0x7f23e4066de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:19.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.075+0000 7f23eb119700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f23e4143b40 0x7f23e4151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:19.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.075+0000 7f23eb119700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e409e990 con 0x7f23e40adaf0 2021-11-12T05:42:19.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.075+0000 7f23eb119700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e409ec30 con 0x7f23e4143b40 2021-11-12T05:42:19.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.075+0000 7f23eb119700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e409eed0 con 0x7f23e40ae3c0 2021-11-12T05:42:19.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.075+0000 7f23e8eb5700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f23e40adaf0 0x7f23e4142ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:19.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.075+0000 7f23e8eb5700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f23e40adaf0 0x7f23e4142ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44700/0 (socket says 172.21.2.105:44700) 2021-11-12T05:42:19.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.075+0000 7f23e8eb5700 1 -- 172.21.2.105:0/4000502097 learned_addr learned my addr 172.21.2.105:0/4000502097 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:19.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.075+0000 7f23e96b6700 1 --2- 172.21.2.105:0/4000502097 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f23e4143b40 0x7f23e4151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:19.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.075+0000 7f23e8eb5700 1 -- 172.21.2.105:0/4000502097 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f23e40ae3c0 msgr2=0x7f23e4066de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:19.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.075+0000 7f23e8eb5700 1 --2- 172.21.2.105:0/4000502097 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f23e40ae3c0 0x7f23e4066de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:19.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.075+0000 7f23e8eb5700 1 -- 172.21.2.105:0/4000502097 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f23e4143b40 msgr2=0x7f23e4151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:19.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.075+0000 7f23e8eb5700 1 --2- 172.21.2.105:0/4000502097 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f23e4143b40 0x7f23e4151eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:19.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.075+0000 7f23e8eb5700 1 -- 172.21.2.105:0/4000502097 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d400b1e0 con 0x7f23e40adaf0 2021-11-12T05:42:19.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.075+0000 7f23e96b6700 1 --2- 172.21.2.105:0/4000502097 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f23e4143b40 0x7f23e4151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:42:19.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.075+0000 7f23e8eb5700 1 --2- 172.21.2.105:0/4000502097 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f23e40adaf0 0x7f23e4142ca0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f23cc002fb0 tx=0x7f23cc006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:19.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.075+0000 7f23e1ffb700 1 -- 172.21.2.105:0/4000502097 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23cc013460 con 0x7f23e40adaf0 2021-11-12T05:42:19.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.075+0000 7f23e1ffb700 1 -- 172.21.2.105:0/4000502097 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23cc0135c0 con 0x7f23e40adaf0 2021-11-12T05:42:19.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.075+0000 7f23eb119700 1 -- 172.21.2.105:0/4000502097 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23e40ac880 con 0x7f23e40adaf0 2021-11-12T05:42:19.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.075+0000 7f23e1ffb700 1 -- 172.21.2.105:0/4000502097 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23cc013920 con 0x7f23e40adaf0 2021-11-12T05:42:19.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.075+0000 7f23eb119700 1 -- 172.21.2.105:0/4000502097 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23e414e640 con 0x7f23e40adaf0 2021-11-12T05:42:19.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.075+0000 7f23eb119700 1 -- 172.21.2.105:0/4000502097 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23e40b2b40 con 0x7f23e40adaf0 2021-11-12T05:42:19.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.075+0000 7f23e1ffb700 1 -- 172.21.2.105:0/4000502097 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f23cc00f070 con 0x7f23e40adaf0 2021-11-12T05:42:19.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.075+0000 7f23e1ffb700 1 --2- 172.21.2.105:0/4000502097 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f23c8053610 0x7f23c8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:19.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.075+0000 7f23e1ffb700 1 -- 172.21.2.105:0/4000502097 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6064+0+0 (secure 0 0 0) 0x7f23cc06b4b0 con 0x7f23e40adaf0 2021-11-12T05:42:19.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.075+0000 7f23e3fff700 1 --2- 172.21.2.105:0/4000502097 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f23c8053610 0x7f23c8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:19.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.075+0000 7f23e3fff700 1 --2- 172.21.2.105:0/4000502097 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f23c8053610 0x7f23c8055ad0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f23e40625f0 tx=0x7f23d4015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:19.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.079+0000 7f23e1ffb700 1 -- 172.21.2.105:0/4000502097 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f23cc042510 con 0x7f23e40adaf0 2021-11-12T05:42:19.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:19.163+0000 7f23eb119700 1 -- 172.21.2.105:0/4000502097 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f23e4057350 con 0x7f23e40adaf0 2021-11-12T05:42:20.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.015+0000 7f23e1ffb700 1 -- 172.21.2.105:0/4000502097 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v38) v1 ==== 173+0+0 (secure 0 0 0) 0x7f23cc045b30 con 0x7f23e40adaf0 2021-11-12T05:42:20.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.015+0000 7f23eb119700 1 -- 172.21.2.105:0/4000502097 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f23c8053610 msgr2=0x7f23c8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:20.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.015+0000 7f23eb119700 1 --2- 172.21.2.105:0/4000502097 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f23c8053610 0x7f23c8055ad0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f23e40625f0 tx=0x7f23d4015000).stop 2021-11-12T05:42:20.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.015+0000 7f23eb119700 1 -- 172.21.2.105:0/4000502097 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f23e40adaf0 msgr2=0x7f23e4142ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:20.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.015+0000 7f23eb119700 1 --2- 172.21.2.105:0/4000502097 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f23e40adaf0 0x7f23e4142ca0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f23cc002fb0 tx=0x7f23cc006df0).stop 2021-11-12T05:42:20.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.015+0000 7f23eb119700 1 -- 172.21.2.105:0/4000502097 shutdown_connections 2021-11-12T05:42:20.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.015+0000 7f23eb119700 1 --2- 172.21.2.105:0/4000502097 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f23c8053610 0x7f23c8055ad0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:20.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.015+0000 7f23eb119700 1 --2- 172.21.2.105:0/4000502097 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f23e4143b40 0x7f23e4151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:20.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.019+0000 7f23eb119700 1 --2- 172.21.2.105:0/4000502097 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f23e40ae3c0 0x7f23e4066de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:20.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.019+0000 7f23eb119700 1 --2- 172.21.2.105:0/4000502097 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f23e40adaf0 0x7f23e4142ca0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:20.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.019+0000 7f23eb119700 1 -- 172.21.2.105:0/4000502097 >> 172.21.2.105:0/4000502097 conn(0x7f23e405c490 msgr2=0x7f23e40b02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:20.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.019+0000 7f23eb119700 1 -- 172.21.2.105:0/4000502097 shutdown_connections 2021-11-12T05:42:20.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.019+0000 7f23eb119700 1 -- 172.21.2.105:0/4000502097 wait complete. 2021-11-12T05:42:20.025 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_data' removed 2021-11-12T05:42:20.031 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-11-12T05:42:20.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2e520f700 1 Processor -- start 2021-11-12T05:42:20.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2e520f700 1 -- start start 2021-11-12T05:42:20.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2e520f700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fb2e00ace20 0x7fb2e00b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:20.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2e520f700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2e00b1840 con 0x7fb2e00aca40 2021-11-12T05:42:20.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2e520f700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2e00af2b0 con 0x7fb2e0144180 2021-11-12T05:42:20.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2e520f700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2e00b0a10 con 0x7fb2e00ace20 2021-11-12T05:42:20.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2ded9d700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fb2e00aca40 0x7fb2e01473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:55104/0 (socket says 172.21.2.105:55104) 2021-11-12T05:42:20.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2ded9d700 1 -- 172.21.2.105:0/1023657974 learned_addr learned my addr 172.21.2.105:0/1023657974 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:42:20.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2ddd9b700 1 -- 172.21.2.105:0/1023657974 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 930264503 0 0) 0x7fb2e00b1840 con 0x7fb2e00aca40 2021-11-12T05:42:20.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2ddd9b700 1 -- 172.21.2.105:0/1023657974 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2c0003260 con 0x7fb2e00aca40 2021-11-12T05:42:20.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2de59c700 1 --2- 172.21.2.105:0/1023657974 >> v2:172.21.2.115:3300/0 conn(0x7fb2e00ace20 0x7fb2e00b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:20.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2ddd9b700 1 -- 172.21.2.105:0/1023657974 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2391341971 0 0) 0x7fb2c0003260 con 0x7fb2e00aca40 2021-11-12T05:42:20.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2ddd9b700 1 -- 172.21.2.105:0/1023657974 >> v2:172.21.2.115:3300/0 conn(0x7fb2e00ace20 msgr2=0x7fb2e00b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:20.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2ddd9b700 1 --2- 172.21.2.105:0/1023657974 >> v2:172.21.2.115:3300/0 conn(0x7fb2e00ace20 0x7fb2e00b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:20.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2ddd9b700 1 -- 172.21.2.105:0/1023657974 >> v1:172.21.2.115:6789/0 conn(0x7fb2e0144180 legacy=0x7fb2e01445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:20.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2ddd9b700 1 -- 172.21.2.105:0/1023657974 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e00b1a70 con 0x7fb2e00aca40 2021-11-12T05:42:20.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2ddd9b700 1 -- 172.21.2.105:0/1023657974 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fb2c8001660 con 0x7fb2e00aca40 2021-11-12T05:42:20.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2ddd9b700 1 -- 172.21.2.105:0/1023657974 >> v1:172.21.2.105:6789/0 conn(0x7fb2e00aca40 legacy=0x7fb2e01473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:20.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2ddd9b700 1 --2- 172.21.2.105:0/1023657974 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb2c0003820 0x7fb2c0003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:20.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2ddd9b700 1 --2- 172.21.2.105:0/1023657974 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb2c0004500 0x7fb2c0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:20.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2ddd9b700 1 --2- 172.21.2.105:0/1023657974 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb2c0004f70 0x7fb2c000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:20.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2ddd9b700 1 -- 172.21.2.105:0/1023657974 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e00b0a10 con 0x7fb2c0003820 2021-11-12T05:42:20.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2ddd9b700 1 -- 172.21.2.105:0/1023657974 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c000be50 con 0x7fb2c0004500 2021-11-12T05:42:20.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2ddd9b700 1 -- 172.21.2.105:0/1023657974 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c000c010 con 0x7fb2c0004f70 2021-11-12T05:42:20.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2ded9d700 1 --2- 172.21.2.105:0/1023657974 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb2c0003820 0x7fb2c0003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:20.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2de59c700 1 --2- 172.21.2.105:0/1023657974 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb2c0004500 0x7fb2c0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:20.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2ded9d700 1 -- 172.21.2.105:0/1023657974 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb2c0004f70 msgr2=0x7fb2c000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:20.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2ded9d700 1 --2- 172.21.2.105:0/1023657974 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb2c0004f70 0x7fb2c000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:20.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2ded9d700 1 -- 172.21.2.105:0/1023657974 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb2c0004500 msgr2=0x7fb2c0004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:20.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2ded9d700 1 --2- 172.21.2.105:0/1023657974 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb2c0004500 0x7fb2c0004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:20.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2ded9d700 1 -- 172.21.2.105:0/1023657974 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c0003260 con 0x7fb2c0003820 2021-11-12T05:42:20.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2df59e700 1 -- 172.21.2.105:0/1023657974 reap_dead start 2021-11-12T05:42:20.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2ded9d700 1 --2- 172.21.2.105:0/1023657974 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb2c0003820 0x7fb2c0003c20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7fb2e00611e0 tx=0x7fb2e00ad870).ready entity=mon.0 client_cookie=823c4bbf803334fd server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:20.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2ddd9b700 1 -- 172.21.2.105:0/1023657974 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2c80070d0 con 0x7fb2c0003820 2021-11-12T05:42:20.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2ddd9b700 1 -- 172.21.2.105:0/1023657974 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c8007230 con 0x7fb2c0003820 2021-11-12T05:42:20.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2ddd9b700 1 -- 172.21.2.105:0/1023657974 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2c800c8f0 con 0x7fb2c0003820 2021-11-12T05:42:20.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2e520f700 1 -- 172.21.2.105:0/1023657974 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb2c0003820 msgr2=0x7fb2c0003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:20.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2e520f700 1 --2- 172.21.2.105:0/1023657974 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb2c0003820 0x7fb2c0003c20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7fb2e00611e0 tx=0x7fb2e00ad870).stop 2021-11-12T05:42:20.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2e520f700 1 -- 172.21.2.105:0/1023657974 shutdown_connections 2021-11-12T05:42:20.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2e520f700 1 --2- 172.21.2.105:0/1023657974 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb2c0003820 0x7fb2c0003c20 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:20.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2e520f700 1 -- 172.21.2.105:0/1023657974 >> 172.21.2.105:0/1023657974 conn(0x7fb2e005c490 msgr2=0x7fb2e00b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:20.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2e520f700 1 -- 172.21.2.105:0/1023657974 shutdown_connections 2021-11-12T05:42:20.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.079+0000 7fb2e520f700 1 -- 172.21.2.105:0/1023657974 wait complete. 2021-11-12T05:42:20.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.083+0000 7fb2e520f700 1 Processor -- start 2021-11-12T05:42:20.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.083+0000 7fb2e520f700 1 -- start start 2021-11-12T05:42:20.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.083+0000 7fb2e520f700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb2c0003820 0x7fb2e0062ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:20.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.083+0000 7fb2e520f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb2e0064540 0x7fb2e0066e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:20.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.083+0000 7fb2e520f700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb2e0062460 0x7fb2e0159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:20.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.083+0000 7fb2e520f700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e0159b50 con 0x7fb2e0062460 2021-11-12T05:42:20.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.083+0000 7fb2e520f700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e0065e30 con 0x7fb2c0003820 2021-11-12T05:42:20.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.083+0000 7fb2e520f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e0065b90 con 0x7fb2e0064540 2021-11-12T05:42:20.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.083+0000 7fb2df59e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb2e0062460 0x7fb2e0159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:20.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.083+0000 7fb2df59e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb2e0062460 0x7fb2e0159fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44724/0 (socket says 172.21.2.105:44724) 2021-11-12T05:42:20.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.083+0000 7fb2df59e700 1 -- 172.21.2.105:0/3614881635 learned_addr learned my addr 172.21.2.105:0/3614881635 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:20.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.083+0000 7fb2de59c700 1 --2- 172.21.2.105:0/3614881635 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb2e0064540 0x7fb2e0066e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:20.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.083+0000 7fb2ded9d700 1 --2- 172.21.2.105:0/3614881635 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb2c0003820 0x7fb2e0062ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:20.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.083+0000 7fb2df59e700 1 -- 172.21.2.105:0/3614881635 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb2e0064540 msgr2=0x7fb2e0066e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:20.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.083+0000 7fb2df59e700 1 --2- 172.21.2.105:0/3614881635 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb2e0064540 0x7fb2e0066e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:20.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.083+0000 7fb2df59e700 1 -- 172.21.2.105:0/3614881635 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb2c0003820 msgr2=0x7fb2e0062ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:20.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.083+0000 7fb2df59e700 1 --2- 172.21.2.105:0/3614881635 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb2c0003820 0x7fb2e0062ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:20.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.083+0000 7fb2df59e700 1 -- 172.21.2.105:0/3614881635 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e0148290 con 0x7fb2e0062460 2021-11-12T05:42:20.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.083+0000 7fb2ded9d700 1 --2- 172.21.2.105:0/3614881635 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb2c0003820 0x7fb2e0062ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:42:20.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.083+0000 7fb2df59e700 1 --2- 172.21.2.105:0/3614881635 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb2e0062460 0x7fb2e0159fb0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7fb2c8001110 tx=0x7fb2d8007d30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:20.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.083+0000 7fb2d7fff700 1 -- 172.21.2.105:0/3614881635 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2d800ce70 con 0x7fb2e0062460 2021-11-12T05:42:20.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.083+0000 7fb2d7fff700 1 -- 172.21.2.105:0/3614881635 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d8005880 con 0x7fb2e0062460 2021-11-12T05:42:20.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.083+0000 7fb2e520f700 1 -- 172.21.2.105:0/3614881635 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e015a4a0 con 0x7fb2e0062460 2021-11-12T05:42:20.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.083+0000 7fb2d7fff700 1 -- 172.21.2.105:0/3614881635 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2d8005c20 con 0x7fb2e0062460 2021-11-12T05:42:20.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.083+0000 7fb2e520f700 1 -- 172.21.2.105:0/3614881635 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e015a950 con 0x7fb2e0062460 2021-11-12T05:42:20.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.083+0000 7fb2e520f700 1 -- 172.21.2.105:0/3614881635 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e0148420 con 0x7fb2e0062460 2021-11-12T05:42:20.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.083+0000 7fb2d7fff700 1 -- 172.21.2.105:0/3614881635 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb2d801c070 con 0x7fb2e0062460 2021-11-12T05:42:20.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.083+0000 7fb2d7fff700 1 --2- 172.21.2.105:0/3614881635 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb2c40536a0 0x7fb2c4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:20.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.083+0000 7fb2d7fff700 1 -- 172.21.2.105:0/3614881635 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fb2d806a9d0 con 0x7fb2e0062460 2021-11-12T05:42:20.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.083+0000 7fb2ded9d700 1 --2- 172.21.2.105:0/3614881635 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb2c40536a0 0x7fb2c4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:20.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.083+0000 7fb2ded9d700 1 --2- 172.21.2.105:0/3614881635 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb2c40536a0 0x7fb2c4055b60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fb2c8017000 tx=0x7fb2c8015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:20.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.087+0000 7fb2d7fff700 1 -- 172.21.2.105:0/3614881635 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb2d8041c50 con 0x7fb2e0062460 2021-11-12T05:42:20.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.171+0000 7fb2e520f700 1 -- 172.21.2.105:0/3614881635 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb2e0057350 con 0x7fb2e0062460 2021-11-12T05:42:20.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.175+0000 7fb2d7fff700 1 -- 172.21.2.105:0/3614881635 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb2d8045270 con 0x7fb2e0062460 2021-11-12T05:42:20.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.175+0000 7fb2e520f700 1 -- 172.21.2.105:0/3614881635 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb2c40536a0 msgr2=0x7fb2c4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:20.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.175+0000 7fb2e520f700 1 --2- 172.21.2.105:0/3614881635 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb2c40536a0 0x7fb2c4055b60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fb2c8017000 tx=0x7fb2c8015000).stop 2021-11-12T05:42:20.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.175+0000 7fb2e520f700 1 -- 172.21.2.105:0/3614881635 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb2e0062460 msgr2=0x7fb2e0159fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:20.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.175+0000 7fb2e520f700 1 --2- 172.21.2.105:0/3614881635 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb2e0062460 0x7fb2e0159fb0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7fb2c8001110 tx=0x7fb2d8007d30).stop 2021-11-12T05:42:20.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.175+0000 7fb2e520f700 1 -- 172.21.2.105:0/3614881635 shutdown_connections 2021-11-12T05:42:20.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.175+0000 7fb2e520f700 1 --2- 172.21.2.105:0/3614881635 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb2c40536a0 0x7fb2c4055b60 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:20.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.175+0000 7fb2e520f700 1 --2- 172.21.2.105:0/3614881635 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb2e0062460 0x7fb2e0159fb0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:20.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.175+0000 7fb2e520f700 1 --2- 172.21.2.105:0/3614881635 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb2e0064540 0x7fb2e0066e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:20.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.175+0000 7fb2e520f700 1 --2- 172.21.2.105:0/3614881635 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb2c0003820 0x7fb2e0062ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:20.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.179+0000 7fb2e520f700 1 -- 172.21.2.105:0/3614881635 >> 172.21.2.105:0/3614881635 conn(0x7fb2e005c490 msgr2=0x7fb2e014cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:20.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.179+0000 7fb2e520f700 1 -- 172.21.2.105:0/3614881635 shutdown_connections 2021-11-12T05:42:20.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.179+0000 7fb2e520f700 1 -- 172.21.2.105:0/3614881635 wait complete. 2021-11-12T05:42:20.188 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command' 2021-11-12T05:42:20.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.235+0000 7f15b2adf700 1 Processor -- start 2021-11-12T05:42:20.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.235+0000 7f15b2adf700 1 -- start start 2021-11-12T05:42:20.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.235+0000 7f15b2adf700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f15ac0b0780 0x7f15ac1434d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:20.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.235+0000 7f15b2adf700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f15ac0b0cc0 0x7f15ac05c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:20.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.235+0000 7f15b2adf700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15ac0b2d20 con 0x7f15ac0b2940 2021-11-12T05:42:20.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.235+0000 7f15b2adf700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15ac0b1fc0 con 0x7f15ac0b0cc0 2021-11-12T05:42:20.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.235+0000 7f15b2adf700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15ac0b15e0 con 0x7f15ac0b0780 2021-11-12T05:42:20.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.235+0000 7f15b107c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f15ac0b0cc0 0x7f15ac05c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:20.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.235+0000 7f15b087b700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f15ac0b2940 0x7f15ac142dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:55124/0 (socket says 172.21.2.105:55124) 2021-11-12T05:42:20.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.235+0000 7f15b087b700 1 -- 172.21.2.105:0/2466744894 learned_addr learned my addr 172.21.2.105:0/2466744894 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:42:20.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.235+0000 7f15b107c700 1 -- 172.21.2.105:0/2466744894 >> v2:172.21.2.115:3300/0 conn(0x7f15ac0b0780 msgr2=0x7f15ac1434d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:42:20.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.235+0000 7f15b107c700 1 --2- 172.21.2.105:0/2466744894 >> v2:172.21.2.115:3300/0 conn(0x7f15ac0b0780 0x7f15ac1434d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:20.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.235+0000 7f15b107c700 1 -- 172.21.2.105:0/2466744894 >> v1:172.21.2.105:6789/0 conn(0x7f15ac0b2940 legacy=0x7f15ac142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:20.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.235+0000 7f15b107c700 1 -- 172.21.2.105:0/2466744894 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ac0b1880 con 0x7f15ac0b0cc0 2021-11-12T05:42:20.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.235+0000 7f15b107c700 1 --2- 172.21.2.105:0/2466744894 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f15ac0b0cc0 0x7f15ac05c490 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f15a40032f0 tx=0x7f15a40091d0).ready entity=mon.0 client_cookie=81694ce9cace0848 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:20.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.235+0000 7f15ab7fe700 1 -- 172.21.2.105:0/2466744894 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15a4009ea0 con 0x7f15ac0b0cc0 2021-11-12T05:42:20.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.235+0000 7f15ab7fe700 1 -- 172.21.2.105:0/2466744894 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a400b870 con 0x7f15ac0b0cc0 2021-11-12T05:42:20.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.235+0000 7f15ab7fe700 1 -- 172.21.2.105:0/2466744894 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15a400ba20 con 0x7f15ac0b0cc0 2021-11-12T05:42:20.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.235+0000 7f15b2adf700 1 -- 172.21.2.105:0/2466744894 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f15ac0b0cc0 msgr2=0x7f15ac05c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:20.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.235+0000 7f15b2adf700 1 --2- 172.21.2.105:0/2466744894 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f15ac0b0cc0 0x7f15ac05c490 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f15a40032f0 tx=0x7f15a40091d0).stop 2021-11-12T05:42:20.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.235+0000 7f15b2adf700 1 -- 172.21.2.105:0/2466744894 shutdown_connections 2021-11-12T05:42:20.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.235+0000 7f15b2adf700 1 --2- 172.21.2.105:0/2466744894 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f15ac0b0cc0 0x7f15ac05c490 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:20.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.235+0000 7f15b2adf700 1 --2- 172.21.2.105:0/2466744894 >> v2:172.21.2.115:3300/0 conn(0x7f15ac0b0780 0x7f15ac1434d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:20.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.235+0000 7f15b2adf700 1 -- 172.21.2.105:0/2466744894 >> 172.21.2.105:0/2466744894 conn(0x7f15ac068440 msgr2=0x7f15ac062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:20.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.235+0000 7f15b2adf700 1 -- 172.21.2.105:0/2466744894 shutdown_connections 2021-11-12T05:42:20.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.235+0000 7f15b2adf700 1 -- 172.21.2.105:0/2466744894 wait complete. 2021-11-12T05:42:20.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.235+0000 7f15b2adf700 1 Processor -- start 2021-11-12T05:42:20.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.235+0000 7f15b2adf700 1 -- start start 2021-11-12T05:42:20.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.239+0000 7f15b2adf700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f15ac0b0780 0x7f15ac133a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:20.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.239+0000 7f15b2adf700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f15ac0b0cc0 0x7f15ac1344a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:20.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.239+0000 7f15b2adf700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f15ac0b2940 0x7f15ac13a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:20.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.239+0000 7f15b2adf700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac066860 con 0x7f15ac0b0780 2021-11-12T05:42:20.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.239+0000 7f15b2adf700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac066a50 con 0x7f15ac0b2940 2021-11-12T05:42:20.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.239+0000 7f15b2adf700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac065580 con 0x7f15ac0b0cc0 2021-11-12T05:42:20.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.239+0000 7f15b087b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f15ac0b0780 0x7f15ac133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:20.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.239+0000 7f15b087b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f15ac0b0780 0x7f15ac133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44732/0 (socket says 172.21.2.105:44732) 2021-11-12T05:42:20.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.239+0000 7f15b087b700 1 -- 172.21.2.105:0/1868721284 learned_addr learned my addr 172.21.2.105:0/1868721284 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:20.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.239+0000 7f15b087b700 1 -- 172.21.2.105:0/1868721284 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f15ac0b0cc0 msgr2=0x7f15ac1344a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:20.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.239+0000 7f15b087b700 1 --2- 172.21.2.105:0/1868721284 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f15ac0b0cc0 0x7f15ac1344a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:20.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.239+0000 7f15b087b700 1 -- 172.21.2.105:0/1868721284 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f15ac0b2940 msgr2=0x7f15ac13a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:20.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.239+0000 7f15b087b700 1 --2- 172.21.2.105:0/1868721284 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f15ac0b2940 0x7f15ac13a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:20.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.239+0000 7f15b087b700 1 -- 172.21.2.105:0/1868721284 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a4009470 con 0x7f15ac0b0780 2021-11-12T05:42:20.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.239+0000 7f15b087b700 1 --2- 172.21.2.105:0/1868721284 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f15ac0b0780 0x7f15ac133a30 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f15ac0b1ea0 tx=0x7f1594007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:20.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.239+0000 7f15a9ffb700 1 -- 172.21.2.105:0/1868721284 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f159400ce30 con 0x7f15ac0b0780 2021-11-12T05:42:20.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.239+0000 7f15a9ffb700 1 -- 172.21.2.105:0/1868721284 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1594007320 con 0x7f15ac0b0780 2021-11-12T05:42:20.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.239+0000 7f15a9ffb700 1 -- 172.21.2.105:0/1868721284 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1594005220 con 0x7f15ac0b0780 2021-11-12T05:42:20.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.239+0000 7f15b2adf700 1 -- 172.21.2.105:0/1868721284 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15ac0671a0 con 0x7f15ac0b0780 2021-11-12T05:42:20.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.239+0000 7f15b2adf700 1 -- 172.21.2.105:0/1868721284 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15ac13ae40 con 0x7f15ac0b0780 2021-11-12T05:42:20.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.239+0000 7f15b2adf700 1 -- 172.21.2.105:0/1868721284 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15ac066ee0 con 0x7f15ac0b0780 2021-11-12T05:42:20.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.239+0000 7f15a9ffb700 1 -- 172.21.2.105:0/1868721284 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f159401b070 con 0x7f15ac0b0780 2021-11-12T05:42:20.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.239+0000 7f15a9ffb700 1 --2- 172.21.2.105:0/1868721284 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1590053580 0x7f1590055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:20.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.239+0000 7f15a9ffb700 1 -- 172.21.2.105:0/1868721284 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f159406ad40 con 0x7f15ac0b0780 2021-11-12T05:42:20.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.239+0000 7f15abfff700 1 --2- 172.21.2.105:0/1868721284 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1590053580 0x7f1590055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:20.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.239+0000 7f15abfff700 1 --2- 172.21.2.105:0/1868721284 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1590053580 0x7f1590055a40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f159c002fb0 tx=0x7f159c0069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:20.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.243+0000 7f15a9ffb700 1 -- 172.21.2.105:0/1868721284 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f15ac066ee0 con 0x7f15ac0b0780 2021-11-12T05:42:20.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:20.351+0000 7f15b2adf700 1 -- 172.21.2.105:0/1868721284 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]} v 0) v1 -- 0x7f15ac066ee0 con 0x7f15ac0b0780 2021-11-12T05:42:21.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.027+0000 7f15a9ffb700 1 -- 172.21.2.105:0/1868721284 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]}]=0 v89) v1 ==== 139+0+0 (secure 0 0 0) 0x7f15ac066ee0 con 0x7f15ac0b0780 2021-11-12T05:42:21.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.031+0000 7f15b2adf700 1 -- 172.21.2.105:0/1868721284 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1590053580 msgr2=0x7f1590055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:21.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.031+0000 7f15b2adf700 1 --2- 172.21.2.105:0/1868721284 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1590053580 0x7f1590055a40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f159c002fb0 tx=0x7f159c0069b0).stop 2021-11-12T05:42:21.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.031+0000 7f15b2adf700 1 -- 172.21.2.105:0/1868721284 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f15ac0b0780 msgr2=0x7f15ac133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:21.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.031+0000 7f15b2adf700 1 --2- 172.21.2.105:0/1868721284 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f15ac0b0780 0x7f15ac133a30 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f15ac0b1ea0 tx=0x7f1594007c60).stop 2021-11-12T05:42:21.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.031+0000 7f15b2adf700 1 -- 172.21.2.105:0/1868721284 shutdown_connections 2021-11-12T05:42:21.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.031+0000 7f15b2adf700 1 --2- 172.21.2.105:0/1868721284 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1590053580 0x7f1590055a40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:21.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.031+0000 7f15b2adf700 1 --2- 172.21.2.105:0/1868721284 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f15ac0b2940 0x7f15ac13a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:21.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.031+0000 7f15b2adf700 1 --2- 172.21.2.105:0/1868721284 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f15ac0b0cc0 0x7f15ac1344a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:21.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.031+0000 7f15b2adf700 1 --2- 172.21.2.105:0/1868721284 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f15ac0b0780 0x7f15ac133a30 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:21.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.031+0000 7f15b2adf700 1 -- 172.21.2.105:0/1868721284 >> 172.21.2.105:0/1868721284 conn(0x7f15ac068440 msgr2=0x7f15ac134ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:21.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.031+0000 7f15b2adf700 1 -- 172.21.2.105:0/1868721284 shutdown_connections 2021-11-12T05:42:21.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.031+0000 7f15b2adf700 1 -- 172.21.2.105:0/1868721284 wait complete. 2021-11-12T05:42:21.041 INFO:tasks.cephfs_test_runner:test_drop_cache_command (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-11-12T05:42:21.042 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_dead (tasks.cephfs.test_misc.TestCacheDrop) 2021-11-12T05:42:21.042 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead' 2021-11-12T05:42:21.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f0197482700 1 Processor -- start 2021-11-12T05:42:21.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f0197482700 1 -- start start 2021-11-12T05:42:21.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f0197482700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0190143b40 0x7f0190143f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:21.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f0197482700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f01900aded0 0x7f01900ae300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:21.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f0197482700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0190067860 con 0x7f01900adaf0 2021-11-12T05:42:21.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f0197482700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01901404a0 con 0x7f01900aded0 2021-11-12T05:42:21.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f0197482700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0190143400 con 0x7f0190143b40 2021-11-12T05:42:21.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f019521e700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f01900adaf0 0x7f019013fd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:55136/0 (socket says 172.21.2.105:55136) 2021-11-12T05:42:21.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f019521e700 1 -- 172.21.2.105:0/3671554788 learned_addr learned my addr 172.21.2.105:0/3671554788 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:42:21.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f0194a1d700 1 --2- 172.21.2.105:0/3671554788 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0190143b40 0x7f0190143f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:21.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f0195a1f700 1 --2- 172.21.2.105:0/3671554788 >> v2:172.21.2.115:3300/0 conn(0x7f01900aded0 0x7f01900ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:21.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f0183fff700 1 -- 172.21.2.105:0/3671554788 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3541533792 0 0) 0x7f0190067860 con 0x7f01900adaf0 2021-11-12T05:42:21.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f0183fff700 1 -- 172.21.2.105:0/3671554788 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0178003260 con 0x7f01900adaf0 2021-11-12T05:42:21.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f0183fff700 1 -- 172.21.2.105:0/3671554788 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2937821488 0 0) 0x7f0178003260 con 0x7f01900adaf0 2021-11-12T05:42:21.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f0183fff700 1 -- 172.21.2.105:0/3671554788 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0190143b40 msgr2=0x7f0190143f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:21.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f0183fff700 1 --2- 172.21.2.105:0/3671554788 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0190143b40 0x7f0190143f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:21.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f0183fff700 1 -- 172.21.2.105:0/3671554788 >> v2:172.21.2.115:3300/0 conn(0x7f01900aded0 msgr2=0x7f01900ae300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:21.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f0183fff700 1 --2- 172.21.2.105:0/3671554788 >> v2:172.21.2.115:3300/0 conn(0x7f01900aded0 0x7f01900ae300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:21.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f0183fff700 1 -- 172.21.2.105:0/3671554788 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01901436a0 con 0x7f01900adaf0 2021-11-12T05:42:21.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f0183fff700 1 -- 172.21.2.105:0/3671554788 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f018c001660 con 0x7f01900adaf0 2021-11-12T05:42:21.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f0183fff700 1 -- 172.21.2.105:0/3671554788 >> v1:172.21.2.105:6789/0 conn(0x7f01900adaf0 legacy=0x7f019013fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:21.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f0183fff700 1 --2- 172.21.2.105:0/3671554788 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0190143b40 0x7f01780037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:21.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f0183fff700 1 --2- 172.21.2.105:0/3671554788 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0178003d50 0x7f0178004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:21.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f0183fff700 1 --2- 172.21.2.105:0/3671554788 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f01780049f0 0x7f0178004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:21.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f0183fff700 1 -- 172.21.2.105:0/3671554788 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01901404a0 con 0x7f01780049f0 2021-11-12T05:42:21.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f0183fff700 1 -- 172.21.2.105:0/3671554788 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0190143400 con 0x7f0178003d50 2021-11-12T05:42:21.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f0183fff700 1 -- 172.21.2.105:0/3671554788 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f017800b780 con 0x7f0190143b40 2021-11-12T05:42:21.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f0195a1f700 1 --2- 172.21.2.105:0/3671554788 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f01780049f0 0x7f0178004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:21.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f019521e700 1 --2- 172.21.2.105:0/3671554788 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0190143b40 0x7f01780037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:21.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f0194a1d700 1 --2- 172.21.2.105:0/3671554788 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0178003d50 0x7f0178004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:21.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f0195a1f700 1 -- 172.21.2.105:0/3671554788 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0190143b40 msgr2=0x7f01780037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:21.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f0195a1f700 1 --2- 172.21.2.105:0/3671554788 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0190143b40 0x7f01780037d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:21.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f0195a1f700 1 -- 172.21.2.105:0/3671554788 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0178003d50 msgr2=0x7f0178004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:21.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f0195a1f700 1 --2- 172.21.2.105:0/3671554788 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0178003d50 0x7f0178004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:21.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f0195a1f700 1 -- 172.21.2.105:0/3671554788 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0178003260 con 0x7f01780049f0 2021-11-12T05:42:21.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f0195a1f700 1 --2- 172.21.2.105:0/3671554788 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f01780049f0 0x7f0178004e70 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f018800c000 tx=0x7f01880091d0).ready entity=mon.0 client_cookie=472a747dcbe3345f server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:21.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f0183fff700 1 -- 172.21.2.105:0/3671554788 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f018800e7e0 con 0x7f01780049f0 2021-11-12T05:42:21.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f0183fff700 1 -- 172.21.2.105:0/3671554788 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018800e940 con 0x7f01780049f0 2021-11-12T05:42:21.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.091+0000 7f0183fff700 1 -- 172.21.2.105:0/3671554788 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f018800eca0 con 0x7f01780049f0 2021-11-12T05:42:21.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.095+0000 7f0197482700 1 -- 172.21.2.105:0/3671554788 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f01780049f0 msgr2=0x7f0178004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:21.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.095+0000 7f0197482700 1 --2- 172.21.2.105:0/3671554788 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f01780049f0 0x7f0178004e70 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f018800c000 tx=0x7f01880091d0).stop 2021-11-12T05:42:21.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.095+0000 7f0195a1f700 1 -- 172.21.2.105:0/3671554788 reap_dead start 2021-11-12T05:42:21.110 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.095+0000 7f0197482700 1 -- 172.21.2.105:0/3671554788 shutdown_connections 2021-11-12T05:42:21.110 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.095+0000 7f0197482700 1 -- 172.21.2.105:0/3671554788 >> 172.21.2.105:0/3671554788 conn(0x7f019005c490 msgr2=0x7f019005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:21.110 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.095+0000 7f0197482700 1 -- 172.21.2.105:0/3671554788 shutdown_connections 2021-11-12T05:42:21.110 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.095+0000 7f0197482700 1 -- 172.21.2.105:0/3671554788 wait complete. 2021-11-12T05:42:21.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.095+0000 7f0197482700 1 Processor -- start 2021-11-12T05:42:21.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.095+0000 7f0197482700 1 -- start start 2021-11-12T05:42:21.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.095+0000 7f0197482700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f01780049f0 0x7f01900b4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:21.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.095+0000 7f0197482700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f01900ab630 0x7f01900abab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:21.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.095+0000 7f0197482700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0190063c30 0x7f01900640b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:21.112 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.095+0000 7f0197482700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01900b5590 con 0x7f0190063c30 2021-11-12T05:42:21.112 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.095+0000 7f0197482700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01900aa490 con 0x7f01780049f0 2021-11-12T05:42:21.112 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.095+0000 7f0197482700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01900aa730 con 0x7f01900ab630 2021-11-12T05:42:21.112 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.095+0000 7f0195a1f700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0190063c30 0x7f01900640b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:21.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.095+0000 7f0195a1f700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0190063c30 0x7f01900640b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44756/0 (socket says 172.21.2.105:44756) 2021-11-12T05:42:21.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.095+0000 7f0195a1f700 1 -- 172.21.2.105:0/2324673081 learned_addr learned my addr 172.21.2.105:0/2324673081 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:21.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.095+0000 7f0195a1f700 1 -- 172.21.2.105:0/2324673081 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f01900ab630 msgr2=0x7f01900abab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:21.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.095+0000 7f0195a1f700 1 --2- 172.21.2.105:0/2324673081 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f01900ab630 0x7f01900abab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:21.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.095+0000 7f0195a1f700 1 -- 172.21.2.105:0/2324673081 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f01780049f0 msgr2=0x7f01900b4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:21.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.095+0000 7f0195a1f700 1 --2- 172.21.2.105:0/2324673081 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f01780049f0 0x7f01900b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:21.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.095+0000 7f0195a1f700 1 -- 172.21.2.105:0/2324673081 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01900aa9d0 con 0x7f0190063c30 2021-11-12T05:42:21.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.095+0000 7f0195a1f700 1 --2- 172.21.2.105:0/2324673081 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0190063c30 0x7f01900640b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f01900af9a0 tx=0x7f018801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:21.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.095+0000 7f01827fc700 1 -- 172.21.2.105:0/2324673081 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0188009600 con 0x7f0190063c30 2021-11-12T05:42:21.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.095+0000 7f01827fc700 1 -- 172.21.2.105:0/2324673081 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018801b640 con 0x7f0190063c30 2021-11-12T05:42:21.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.095+0000 7f01827fc700 1 -- 172.21.2.105:0/2324673081 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f018801b9a0 con 0x7f0190063c30 2021-11-12T05:42:21.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.095+0000 7f0197482700 1 -- 172.21.2.105:0/2324673081 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01900aadf0 con 0x7f0190063c30 2021-11-12T05:42:21.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.095+0000 7f0197482700 1 -- 172.21.2.105:0/2324673081 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f019014c5a0 con 0x7f0190063c30 2021-11-12T05:42:21.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.095+0000 7f0197482700 1 -- 172.21.2.105:0/2324673081 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01900b2b40 con 0x7f0190063c30 2021-11-12T05:42:21.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.095+0000 7f01827fc700 1 -- 172.21.2.105:0/2324673081 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f018801bb00 con 0x7f0190063c30 2021-11-12T05:42:21.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.095+0000 7f01827fc700 1 --2- 172.21.2.105:0/2324673081 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f01700535d0 0x7f0170055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:21.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.095+0000 7f01827fc700 1 -- 172.21.2.105:0/2324673081 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f018806d6e0 con 0x7f0190063c30 2021-11-12T05:42:21.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.095+0000 7f019521e700 1 --2- 172.21.2.105:0/2324673081 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f01700535d0 0x7f0170055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:21.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.095+0000 7f019521e700 1 --2- 172.21.2.105:0/2324673081 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f01700535d0 0x7f0170055a90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f018c00b000 tx=0x7f0190143830).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:21.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.099+0000 7f01827fc700 1 -- 172.21.2.105:0/2324673081 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f01880448b0 con 0x7f0190063c30 2021-11-12T05:42:21.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:21.211+0000 7f0197482700 1 -- 172.21.2.105:0/2324673081 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]} v 0) v1 -- 0x7f0190057350 con 0x7f0190063c30 2021-11-12T05:42:22.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.031+0000 7f01827fc700 1 -- 172.21.2.105:0/2324673081 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]}]=0 v90) v1 ==== 147+0+0 (secure 0 0 0) 0x7f0188016020 con 0x7f0190063c30 2021-11-12T05:42:22.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.031+0000 7f0197482700 1 -- 172.21.2.105:0/2324673081 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f01700535d0 msgr2=0x7f0170055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:22.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.031+0000 7f0197482700 1 --2- 172.21.2.105:0/2324673081 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f01700535d0 0x7f0170055a90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f018c00b000 tx=0x7f0190143830).stop 2021-11-12T05:42:22.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.031+0000 7f0197482700 1 -- 172.21.2.105:0/2324673081 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0190063c30 msgr2=0x7f01900640b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:22.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.031+0000 7f0197482700 1 --2- 172.21.2.105:0/2324673081 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0190063c30 0x7f01900640b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f01900af9a0 tx=0x7f018801a000).stop 2021-11-12T05:42:22.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.031+0000 7f0197482700 1 -- 172.21.2.105:0/2324673081 shutdown_connections 2021-11-12T05:42:22.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.031+0000 7f0197482700 1 --2- 172.21.2.105:0/2324673081 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f01700535d0 0x7f0170055a90 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:22.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.031+0000 7f0197482700 1 --2- 172.21.2.105:0/2324673081 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0190063c30 0x7f01900640b0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:22.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.031+0000 7f0197482700 1 --2- 172.21.2.105:0/2324673081 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f01900ab630 0x7f01900abab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:22.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.031+0000 7f0197482700 1 --2- 172.21.2.105:0/2324673081 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f01780049f0 0x7f01900b4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:22.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.031+0000 7f0197482700 1 -- 172.21.2.105:0/2324673081 >> 172.21.2.105:0/2324673081 conn(0x7f019005c490 msgr2=0x7f019013d980 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:22.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.031+0000 7f0197482700 1 -- 172.21.2.105:0/2324673081 shutdown_connections 2021-11-12T05:42:22.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.031+0000 7f0197482700 1 -- 172.21.2.105:0/2324673081 wait complete. 2021-11-12T05:42:22.044 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-11-12T05:42:22.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.095+0000 7f0dc308f700 1 Processor -- start 2021-11-12T05:42:22.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.095+0000 7f0dc308f700 1 -- start start 2021-11-12T05:42:22.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.095+0000 7f0dc308f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0dbc05ff60 0x7f0dbc140b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:22.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.095+0000 7f0dc308f700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f0dbc0b2a40 0x7f0dbc0b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:22.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.095+0000 7f0dc308f700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f0dbc0b3d60 0x7f0dbc13a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:22.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.095+0000 7f0dc308f700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dbc0b2060 con 0x7f0dbc0b2a40 2021-11-12T05:42:22.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.095+0000 7f0dc308f700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dbc0b2300 con 0x7f0dbc0b3d60 2021-11-12T05:42:22.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.095+0000 7f0dc308f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc0b25a0 con 0x7f0dbc05ff60 2021-11-12T05:42:22.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.095+0000 7f0dc188c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f0dbc0b2a40 0x7f0dbc0b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:22.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.095+0000 7f0dc188c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f0dbc0b2a40 0x7f0dbc0b3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44762/0 (socket says 172.21.2.105:44762) 2021-11-12T05:42:22.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.095+0000 7f0dc188c700 1 -- 172.21.2.105:0/2529440301 learned_addr learned my addr 172.21.2.105:0/2529440301 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:22.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.095+0000 7f0dc188c700 1 -- 172.21.2.105:0/2529440301 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0dbc05ff60 msgr2=0x7f0dbc140b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:22.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.095+0000 7f0dc188c700 1 --2- 172.21.2.105:0/2529440301 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0dbc05ff60 0x7f0dbc140b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:22.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.095+0000 7f0dc188c700 1 -- 172.21.2.105:0/2529440301 >> v2:172.21.2.115:3300/0 conn(0x7f0dbc0b3d60 msgr2=0x7f0dbc13a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:22.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.095+0000 7f0dc188c700 1 --2- 172.21.2.105:0/2529440301 >> v2:172.21.2.115:3300/0 conn(0x7f0dbc0b3d60 0x7f0dbc13a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:22.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.095+0000 7f0dc188c700 1 -- 172.21.2.105:0/2529440301 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dbc0b2ea0 con 0x7f0dbc0b2a40 2021-11-12T05:42:22.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.095+0000 7f0dc188c700 1 --2- 172.21.2.105:0/2529440301 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0dbc0b2a40 0x7f0dbc0b3870 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f0dac002f70 tx=0x7f0dac006eb0).ready entity=mon.0 client_cookie=4101674c0245093f server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:22.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.095+0000 7f0dc108b700 1 -- 172.21.2.105:0/2529440301 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dac00d570 con 0x7f0dbc0b2a40 2021-11-12T05:42:22.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.095+0000 7f0dc108b700 1 -- 172.21.2.105:0/2529440301 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dac000e90 con 0x7f0dbc0b2a40 2021-11-12T05:42:22.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.095+0000 7f0dc108b700 1 -- 172.21.2.105:0/2529440301 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dac00d900 con 0x7f0dbc0b2a40 2021-11-12T05:42:22.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.095+0000 7f0dc308f700 1 -- 172.21.2.105:0/2529440301 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0dbc0b2a40 msgr2=0x7f0dbc0b3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:22.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.095+0000 7f0dc308f700 1 --2- 172.21.2.105:0/2529440301 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0dbc0b2a40 0x7f0dbc0b3870 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f0dac002f70 tx=0x7f0dac006eb0).stop 2021-11-12T05:42:22.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.099+0000 7f0dc308f700 1 -- 172.21.2.105:0/2529440301 shutdown_connections 2021-11-12T05:42:22.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.099+0000 7f0dc308f700 1 --2- 172.21.2.105:0/2529440301 >> v2:172.21.2.115:3300/0 conn(0x7f0dbc0b3d60 0x7f0dbc13a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:22.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.099+0000 7f0dc308f700 1 --2- 172.21.2.105:0/2529440301 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0dbc0b2a40 0x7f0dbc0b3870 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:22.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.099+0000 7f0dc308f700 1 --2- 172.21.2.105:0/2529440301 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0dbc05ff60 0x7f0dbc140b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:22.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.099+0000 7f0dc308f700 1 -- 172.21.2.105:0/2529440301 >> 172.21.2.105:0/2529440301 conn(0x7f0dbc0608d0 msgr2=0x7f0dbc05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:22.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.099+0000 7f0dc308f700 1 -- 172.21.2.105:0/2529440301 shutdown_connections 2021-11-12T05:42:22.110 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.099+0000 7f0dc308f700 1 -- 172.21.2.105:0/2529440301 wait complete. 2021-11-12T05:42:22.112 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.099+0000 7f0dc308f700 1 Processor -- start 2021-11-12T05:42:22.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.099+0000 7f0dc308f700 1 -- start start 2021-11-12T05:42:22.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.099+0000 7f0dc308f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0dbc05ff60 0x7f0dbc066650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:22.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.099+0000 7f0dc308f700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0dbc0b2a40 0x7f0dbc13fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:22.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.099+0000 7f0dc308f700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0dbc0b3d60 0x7f0dbc0ae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:22.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.099+0000 7f0dc308f700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc140280 con 0x7f0dbc0b2a40 2021-11-12T05:42:22.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.099+0000 7f0dc308f700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc0b1000 con 0x7f0dbc0b3d60 2021-11-12T05:42:22.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.099+0000 7f0dc308f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc0b1260 con 0x7f0dbc05ff60 2021-11-12T05:42:22.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.099+0000 7f0dc188c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0dbc0b2a40 0x7f0dbc13fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:22.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.099+0000 7f0dc188c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0dbc0b2a40 0x7f0dbc13fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44770/0 (socket says 172.21.2.105:44770) 2021-11-12T05:42:22.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.099+0000 7f0dc188c700 1 -- 172.21.2.105:0/116293987 learned_addr learned my addr 172.21.2.105:0/116293987 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:22.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.099+0000 7f0dc288e700 1 --2- 172.21.2.105:0/116293987 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0dbc0b3d60 0x7f0dbc0ae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:22.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.099+0000 7f0dc208d700 1 --2- 172.21.2.105:0/116293987 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0dbc05ff60 0x7f0dbc066650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:22.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.099+0000 7f0dc188c700 1 -- 172.21.2.105:0/116293987 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0dbc05ff60 msgr2=0x7f0dbc066650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:22.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.099+0000 7f0dc188c700 1 --2- 172.21.2.105:0/116293987 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0dbc05ff60 0x7f0dbc066650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:22.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.099+0000 7f0dc188c700 1 -- 172.21.2.105:0/116293987 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0dbc0b3d60 msgr2=0x7f0dbc0ae9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:22.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.099+0000 7f0dc188c700 1 --2- 172.21.2.105:0/116293987 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0dbc0b3d60 0x7f0dbc0ae9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:22.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.099+0000 7f0dc188c700 1 -- 172.21.2.105:0/116293987 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dac00b1e0 con 0x7f0dbc0b2a40 2021-11-12T05:42:22.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.099+0000 7f0dc208d700 1 --2- 172.21.2.105:0/116293987 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0dbc05ff60 0x7f0dbc066650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:42:22.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.099+0000 7f0dc188c700 1 --2- 172.21.2.105:0/116293987 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0dbc0b2a40 0x7f0dbc13fd90 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f0dac002f70 tx=0x7f0dac015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:22.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.099+0000 7f0dab7fe700 1 -- 172.21.2.105:0/116293987 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dac00de40 con 0x7f0dbc0b2a40 2021-11-12T05:42:22.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.099+0000 7f0dab7fe700 1 -- 172.21.2.105:0/116293987 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dac011ca0 con 0x7f0dbc0b2a40 2021-11-12T05:42:22.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.099+0000 7f0dab7fe700 1 -- 172.21.2.105:0/116293987 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dac01e460 con 0x7f0dbc0b2a40 2021-11-12T05:42:22.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.099+0000 7f0dc308f700 1 -- 172.21.2.105:0/116293987 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dbc0b1500 con 0x7f0dbc0b2a40 2021-11-12T05:42:22.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.099+0000 7f0dc308f700 1 -- 172.21.2.105:0/116293987 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dbc144bd0 con 0x7f0dbc0b2a40 2021-11-12T05:42:22.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.099+0000 7f0dc308f700 1 -- 172.21.2.105:0/116293987 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dbc0b1ce0 con 0x7f0dbc0b2a40 2021-11-12T05:42:22.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.099+0000 7f0dab7fe700 1 -- 172.21.2.105:0/116293987 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0dac01a040 con 0x7f0dbc0b2a40 2021-11-12T05:42:22.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.099+0000 7f0dab7fe700 1 --2- 172.21.2.105:0/116293987 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0d9c0536a0 0x7f0d9c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:22.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.099+0000 7f0dab7fe700 1 -- 172.21.2.105:0/116293987 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f0dac06c8f0 con 0x7f0dbc0b2a40 2021-11-12T05:42:22.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.099+0000 7f0dc208d700 1 --2- 172.21.2.105:0/116293987 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0d9c0536a0 0x7f0d9c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:22.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.099+0000 7f0dc208d700 1 --2- 172.21.2.105:0/116293987 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0d9c0536a0 0x7f0d9c055b60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f0db8007000 tx=0x7f0db8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:22.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.103+0000 7f0dab7fe700 1 -- 172.21.2.105:0/116293987 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0dac043ac0 con 0x7f0dbc0b2a40 2021-11-12T05:42:22.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.187+0000 7f0dc308f700 1 -- 172.21.2.105:0/116293987 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0dbc144ee0 con 0x7f0dbc0b2a40 2021-11-12T05:42:22.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.195+0000 7f0dab7fe700 1 -- 172.21.2.105:0/116293987 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v4)=0 v4) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0dac023020 con 0x7f0dbc0b2a40 2021-11-12T05:42:22.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.195+0000 7f0dc308f700 1 -- 172.21.2.105:0/116293987 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0d9c0536a0 msgr2=0x7f0d9c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:22.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.195+0000 7f0dc308f700 1 --2- 172.21.2.105:0/116293987 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0d9c0536a0 0x7f0d9c055b60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f0db8007000 tx=0x7f0db8008040).stop 2021-11-12T05:42:22.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.195+0000 7f0dc308f700 1 -- 172.21.2.105:0/116293987 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0dbc0b2a40 msgr2=0x7f0dbc13fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:22.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.195+0000 7f0dc308f700 1 --2- 172.21.2.105:0/116293987 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0dbc0b2a40 0x7f0dbc13fd90 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f0dac002f70 tx=0x7f0dac015000).stop 2021-11-12T05:42:22.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.195+0000 7f0dc308f700 1 -- 172.21.2.105:0/116293987 shutdown_connections 2021-11-12T05:42:22.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.195+0000 7f0dc308f700 1 --2- 172.21.2.105:0/116293987 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0d9c0536a0 0x7f0d9c055b60 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:22.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.195+0000 7f0dc308f700 1 --2- 172.21.2.105:0/116293987 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0dbc0b3d60 0x7f0dbc0ae9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:22.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.195+0000 7f0dc308f700 1 --2- 172.21.2.105:0/116293987 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0dbc0b2a40 0x7f0dbc13fd90 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:22.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.195+0000 7f0dc308f700 1 --2- 172.21.2.105:0/116293987 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0dbc05ff60 0x7f0dbc066650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:22.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.195+0000 7f0dc308f700 1 -- 172.21.2.105:0/116293987 >> 172.21.2.105:0/116293987 conn(0x7f0dbc0608d0 msgr2=0x7f0dbc061ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:22.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.195+0000 7f0dc308f700 1 -- 172.21.2.105:0/116293987 shutdown_connections 2021-11-12T05:42:22.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.195+0000 7f0dc308f700 1 -- 172.21.2.105:0/116293987 wait complete. 2021-11-12T05:42:22.207 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-12T05:42:22.207 DEBUG:teuthology.orchestra.run.gibba005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:42:22.215 DEBUG:teuthology.orchestra.run.gibba015:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:42:22.228 DEBUG:teuthology.orchestra.run.gibba016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:42:22.241 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:42:22.255 DEBUG:teuthology.orchestra.run.gibba044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:42:22.268 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-12T05:42:22.268 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:42:22.269 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:42:22.269 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:42:22.273 INFO:teuthology.orchestra.run.gibba016.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-12T05:42:22.274 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:42:22.275 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-11-12T05:42:22.276 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:42:22.276 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:42:22.276 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:42:22.281 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:42:22.281 INFO:teuthology.orchestra.run.gibba038.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-12T05:42:22.282 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-12T05:42:22.282 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:42:22.283 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:42:22.283 DEBUG:teuthology.orchestra.run.gibba044:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:42:22.287 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:42:22.288 INFO:teuthology.orchestra.run.gibba044.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-12T05:42:22.288 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-12T05:42:22.289 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-12T05:42:22.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.339+0000 7f17f3984700 1 Processor -- start 2021-11-12T05:42:22.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.339+0000 7f17f3984700 1 -- start start 2021-11-12T05:42:22.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.339+0000 7f17f3984700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f17ec060100 0x7f17ec062d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:22.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.339+0000 7f17f3984700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f17ec0b1ef0 0x7f17ec0b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:22.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.339+0000 7f17f3984700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17ec143370 con 0x7f17ec142ed0 2021-11-12T05:42:22.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.339+0000 7f17f3984700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17ec0604e0 con 0x7f17ec0b1ef0 2021-11-12T05:42:22.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.339+0000 7f17f3984700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17ec062610 con 0x7f17ec060100 2021-11-12T05:42:22.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.339+0000 7f17f0f1f700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f17ec142ed0 0x7f17ec146510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:55174/0 (socket says 172.21.2.105:55174) 2021-11-12T05:42:22.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.339+0000 7f17f0f1f700 1 -- 172.21.2.105:0/948136649 learned_addr learned my addr 172.21.2.105:0/948136649 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:42:22.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.339+0000 7f17f1f21700 1 --2- 172.21.2.105:0/948136649 >> v2:172.21.2.105:3300/0 conn(0x7f17ec0b1ef0 0x7f17ec0b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:22.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.339+0000 7f17f1f21700 1 -- 172.21.2.105:0/948136649 >> v2:172.21.2.115:3300/0 conn(0x7f17ec060100 msgr2=0x7f17ec062d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:22.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.339+0000 7f17f1f21700 1 --2- 172.21.2.105:0/948136649 >> v2:172.21.2.115:3300/0 conn(0x7f17ec060100 0x7f17ec062d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:22.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.339+0000 7f17f1f21700 1 -- 172.21.2.105:0/948136649 >> v1:172.21.2.105:6789/0 conn(0x7f17ec142ed0 legacy=0x7f17ec146510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:22.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.339+0000 7f17f1f21700 1 -- 172.21.2.105:0/948136649 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ec0628b0 con 0x7f17ec0b1ef0 2021-11-12T05:42:22.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.339+0000 7f17f1f21700 1 --2- 172.21.2.105:0/948136649 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f17ec0b1ef0 0x7f17ec0b3f50 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f17ec062530 tx=0x7f17e40091d0).ready entity=mon.0 client_cookie=64995b9f8e38ca0a server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:22.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.339+0000 7f17dffff700 1 -- 172.21.2.105:0/948136649 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17e4009ea0 con 0x7f17ec0b1ef0 2021-11-12T05:42:22.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.339+0000 7f17dffff700 1 -- 172.21.2.105:0/948136649 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e400b860 con 0x7f17ec0b1ef0 2021-11-12T05:42:22.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.339+0000 7f17dffff700 1 -- 172.21.2.105:0/948136649 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17e400b9d0 con 0x7f17ec0b1ef0 2021-11-12T05:42:22.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.339+0000 7f17f3984700 1 -- 172.21.2.105:0/948136649 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f17ec0b1ef0 msgr2=0x7f17ec0b3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:22.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.339+0000 7f17f3984700 1 --2- 172.21.2.105:0/948136649 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f17ec0b1ef0 0x7f17ec0b3f50 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f17ec062530 tx=0x7f17e40091d0).stop 2021-11-12T05:42:22.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.339+0000 7f17f3984700 1 -- 172.21.2.105:0/948136649 shutdown_connections 2021-11-12T05:42:22.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.339+0000 7f17f3984700 1 --2- 172.21.2.105:0/948136649 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f17ec0b1ef0 0x7f17ec0b3f50 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:22.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.339+0000 7f17f3984700 1 --2- 172.21.2.105:0/948136649 >> v2:172.21.2.115:3300/0 conn(0x7f17ec060100 0x7f17ec062d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:22.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.339+0000 7f17f3984700 1 -- 172.21.2.105:0/948136649 >> 172.21.2.105:0/948136649 conn(0x7f17ec0608d0 msgr2=0x7f17ec05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:22.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.339+0000 7f17f3984700 1 -- 172.21.2.105:0/948136649 shutdown_connections 2021-11-12T05:42:22.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.339+0000 7f17f3984700 1 -- 172.21.2.105:0/948136649 wait complete. 2021-11-12T05:42:22.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.339+0000 7f17f3984700 1 Processor -- start 2021-11-12T05:42:22.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.339+0000 7f17f3984700 1 -- start start 2021-11-12T05:42:22.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.343+0000 7f17f3984700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f17ec060100 0x7f17ec114440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:22.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.343+0000 7f17f3984700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f17ec0b1ef0 0x7f17ec1118b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:22.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.343+0000 7f17f3984700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f17ec142ed0 0x7f17ec0648c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:22.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.343+0000 7f17f3984700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec156920 con 0x7f17ec060100 2021-11-12T05:42:22.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.343+0000 7f17f3984700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec142770 con 0x7f17ec0b1ef0 2021-11-12T05:42:22.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.343+0000 7f17f3984700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec156b10 con 0x7f17ec142ed0 2021-11-12T05:42:22.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.343+0000 7f17f1720700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f17ec060100 0x7f17ec114440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:22.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.343+0000 7f17f1720700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f17ec060100 0x7f17ec114440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44782/0 (socket says 172.21.2.105:44782) 2021-11-12T05:42:22.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.343+0000 7f17f1720700 1 -- 172.21.2.105:0/3428481067 learned_addr learned my addr 172.21.2.105:0/3428481067 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:22.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.343+0000 7f17f0f1f700 1 --2- 172.21.2.105:0/3428481067 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f17ec0b1ef0 0x7f17ec1118b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:22.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.343+0000 7f17f1f21700 1 --2- 172.21.2.105:0/3428481067 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f17ec142ed0 0x7f17ec0648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:22.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.343+0000 7f17f1720700 1 -- 172.21.2.105:0/3428481067 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f17ec142ed0 msgr2=0x7f17ec0648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:22.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.343+0000 7f17f1720700 1 --2- 172.21.2.105:0/3428481067 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f17ec142ed0 0x7f17ec0648c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:22.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.343+0000 7f17f1720700 1 -- 172.21.2.105:0/3428481067 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f17ec0b1ef0 msgr2=0x7f17ec1118b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:22.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.343+0000 7f17f1720700 1 --2- 172.21.2.105:0/3428481067 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f17ec0b1ef0 0x7f17ec1118b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:22.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.343+0000 7f17f1720700 1 -- 172.21.2.105:0/3428481067 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e4009470 con 0x7f17ec060100 2021-11-12T05:42:22.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.343+0000 7f17f0f1f700 1 --2- 172.21.2.105:0/3428481067 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f17ec0b1ef0 0x7f17ec1118b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:42:22.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.343+0000 7f17f1720700 1 --2- 172.21.2.105:0/3428481067 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f17ec060100 0x7f17ec114440 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f17ec0675d0 tx=0x7f17e8006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:22.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.343+0000 7f17de7fc700 1 -- 172.21.2.105:0/3428481067 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17e8013460 con 0x7f17ec060100 2021-11-12T05:42:22.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.343+0000 7f17de7fc700 1 -- 172.21.2.105:0/3428481067 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e80135c0 con 0x7f17ec060100 2021-11-12T05:42:22.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.343+0000 7f17f3984700 1 -- 172.21.2.105:0/3428481067 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17ec156db0 con 0x7f17ec060100 2021-11-12T05:42:22.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.343+0000 7f17de7fc700 1 -- 172.21.2.105:0/3428481067 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17e8013920 con 0x7f17ec060100 2021-11-12T05:42:22.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.343+0000 7f17f3984700 1 -- 172.21.2.105:0/3428481067 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17ec1574f0 con 0x7f17ec060100 2021-11-12T05:42:22.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.343+0000 7f17f3984700 1 -- 172.21.2.105:0/3428481067 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17ec146c20 con 0x7f17ec060100 2021-11-12T05:42:22.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.343+0000 7f17de7fc700 1 -- 172.21.2.105:0/3428481067 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f17e800f070 con 0x7f17ec060100 2021-11-12T05:42:22.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.343+0000 7f17de7fc700 1 --2- 172.21.2.105:0/3428481067 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f17cc053640 0x7f17cc055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:22.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.343+0000 7f17de7fc700 1 -- 172.21.2.105:0/3428481067 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f17e806b0f0 con 0x7f17ec060100 2021-11-12T05:42:22.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.343+0000 7f17f0f1f700 1 --2- 172.21.2.105:0/3428481067 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f17cc053640 0x7f17cc055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:22.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.343+0000 7f17f0f1f700 1 --2- 172.21.2.105:0/3428481067 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f17cc053640 0x7f17cc055b00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f17e0008000 tx=0x7f17e0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:22.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.347+0000 7f17de7fc700 1 -- 172.21.2.105:0/3428481067 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f17e80423d0 con 0x7f17ec060100 2021-11-12T05:42:22.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.431+0000 7f17f3984700 1 -- 172.21.2.105:0/3428481067 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f17ec057350 con 0x7f17ec060100 2021-11-12T05:42:22.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.431+0000 7f17de7fc700 1 -- 172.21.2.105:0/3428481067 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v38) v1 ==== 81+0+29219 (secure 0 0 0) 0x7f17e80459f0 con 0x7f17ec060100 2021-11-12T05:42:22.437 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:42:22.437 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:42:22.438 INFO:teuthology.orchestra.run.gibba005.stdout: "epoch": 38, 2021-11-12T05:42:22.438 INFO:teuthology.orchestra.run.gibba005.stdout: "fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", 2021-11-12T05:42:22.438 INFO:teuthology.orchestra.run.gibba005.stdout: "created": "2021-11-12T05:40:19.986390+0000", 2021-11-12T05:42:22.438 INFO:teuthology.orchestra.run.gibba005.stdout: "modified": "2021-11-12T05:42:20.013190+0000", 2021-11-12T05:42:22.439 INFO:teuthology.orchestra.run.gibba005.stdout: "last_up_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:42:22.439 INFO:teuthology.orchestra.run.gibba005.stdout: "last_in_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:42:22.439 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-12T05:42:22.439 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_num": 5799936, 2021-11-12T05:42:22.439 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_set": [ 2021-11-12T05:42:22.440 INFO:teuthology.orchestra.run.gibba005.stdout: "pglog_hardlimit", 2021-11-12T05:42:22.440 INFO:teuthology.orchestra.run.gibba005.stdout: "purged_snapdirs", 2021-11-12T05:42:22.440 INFO:teuthology.orchestra.run.gibba005.stdout: "recovery_deletes", 2021-11-12T05:42:22.440 INFO:teuthology.orchestra.run.gibba005.stdout: "sortbitwise" 2021-11-12T05:42:22.440 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:42:22.441 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_version": 5, 2021-11-12T05:42:22.441 INFO:teuthology.orchestra.run.gibba005.stdout: "full_ratio": 0.94999998807907104, 2021-11-12T05:42:22.441 INFO:teuthology.orchestra.run.gibba005.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-12T05:42:22.441 INFO:teuthology.orchestra.run.gibba005.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-12T05:42:22.442 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_snapshot": "", 2021-11-12T05:42:22.442 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_max": 6, 2021-11-12T05:42:22.442 INFO:teuthology.orchestra.run.gibba005.stdout: "max_osd": 8, 2021-11-12T05:42:22.442 INFO:teuthology.orchestra.run.gibba005.stdout: "require_min_compat_client": "jewel", 2021-11-12T05:42:22.443 INFO:teuthology.orchestra.run.gibba005.stdout: "min_compat_client": "jewel", 2021-11-12T05:42:22.443 INFO:teuthology.orchestra.run.gibba005.stdout: "require_osd_release": "octopus", 2021-11-12T05:42:22.443 INFO:teuthology.orchestra.run.gibba005.stdout: "pools": [ 2021-11-12T05:42:22.443 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.443 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 1, 2021-11-12T05:42:22.444 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "device_health_metrics", 2021-11-12T05:42:22.444 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:22.022116+0000", 2021-11-12T05:42:22.444 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:42:22.444 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:42:22.445 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:42:22.445 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:42:22.445 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:42:22.445 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:42:22.446 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:42:22.446 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:42:22.446 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 1, 2021-11-12T05:42:22.446 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 1, 2021-11-12T05:42:22.446 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 1, 2021-11-12T05:42:22.447 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 1, 2021-11-12T05:42:22.447 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 1, 2021-11-12T05:42:22.447 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:42:22.447 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:42:22.448 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:42:22.448 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:42:22.448 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:42:22.448 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:42:22.448 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:42:22.449 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.449 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "16", 2021-11-12T05:42:22.449 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:42:22.449 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:42:22.450 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:42:22.450 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:42:22.450 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:42:22.450 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:42:22.453 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:42:22.453 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:42:22.453 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:42:22.454 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:42:22.454 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:42:22.454 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:42:22.454 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:42:22.455 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:42:22.455 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:42:22.455 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:42:22.455 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:42:22.455 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:42:22.456 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:42:22.456 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:42:22.456 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:42:22.456 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:42:22.457 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:42:22.457 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:42:22.457 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:42:22.457 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:42:22.457 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.458 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:42:22.458 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:42:22.458 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:42:22.458 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:42:22.459 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:42:22.459 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:42:22.459 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:42:22.459 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:42:22.459 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:42:22.460 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:42:22.460 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:42:22.460 INFO:teuthology.orchestra.run.gibba005.stdout: "options": { 2021-11-12T05:42:22.460 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_min": 1 2021-11-12T05:42:22.460 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.461 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:42:22.461 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr_devicehealth": {} 2021-11-12T05:42:22.461 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:22.461 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.462 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.462 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 2, 2021-11-12T05:42:22.462 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "rbd", 2021-11-12T05:42:22.462 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:29.953617+0000", 2021-11-12T05:42:22.462 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:42:22.463 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:42:22.463 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:42:22.463 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:42:22.463 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:42:22.464 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:42:22.464 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:42:22.464 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:42:22.464 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:42:22.464 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:42:22.465 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:42:22.465 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:42:22.465 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:42:22.465 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:42:22.465 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:42:22.466 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:42:22.466 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:42:22.466 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:42:22.466 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:42:22.467 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:42:22.467 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.467 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "19", 2021-11-12T05:42:22.467 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:42:22.467 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:42:22.468 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:42:22.468 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:42:22.468 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:42:22.468 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:42:22.469 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:42:22.469 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:42:22.469 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:42:22.469 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:42:22.469 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:42:22.470 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:42:22.470 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:42:22.470 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:42:22.470 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:42:22.471 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:42:22.471 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:42:22.471 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:42:22.471 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:42:22.471 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:42:22.472 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:42:22.472 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:42:22.472 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:42:22.472 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:42:22.473 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:42:22.473 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:42:22.473 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.473 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:42:22.473 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:42:22.474 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:42:22.474 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:42:22.474 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:42:22.474 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:42:22.475 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:42:22.475 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:42:22.475 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:42:22.475 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:42:22.475 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:42:22.476 INFO:teuthology.orchestra.run.gibba005.stdout: "options": {}, 2021-11-12T05:42:22.476 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:42:22.476 INFO:teuthology.orchestra.run.gibba005.stdout: "rbd": {} 2021-11-12T05:42:22.476 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:22.476 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:22.477 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:42:22.477 INFO:teuthology.orchestra.run.gibba005.stdout: "osds": [ 2021-11-12T05:42:22.477 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.477 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:42:22.478 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "ee8e30a0-4819-4475-80ec-dd3ee7d01322", 2021-11-12T05:42:22.478 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:42:22.478 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:42:22.478 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:42:22.478 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:42:22.479 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:42:22.479 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:42:22.479 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:42:22.479 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 32, 2021-11-12T05:42:22.480 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:42:22.480 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:42:22.480 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:42:22.480 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:22.480 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.481 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:22.481 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6802", 2021-11-12T05:42:22.481 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:42:22.481 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.482 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.482 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:22.482 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6803", 2021-11-12T05:42:22.482 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:42:22.482 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:22.483 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.483 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.483 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:42:22.483 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:22.484 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.484 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:22.484 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6804", 2021-11-12T05:42:22.484 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:42:22.484 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.485 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.485 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:22.485 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6805", 2021-11-12T05:42:22.485 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:42:22.486 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:22.486 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.486 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.486 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:42:22.486 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:22.487 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.487 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:22.487 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6808", 2021-11-12T05:42:22.487 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:42:22.488 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.488 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.488 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:22.488 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6809", 2021-11-12T05:42:22.489 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:42:22.489 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:22.489 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.489 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.489 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:42:22.490 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:22.490 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.490 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:22.490 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6806", 2021-11-12T05:42:22.491 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:42:22.491 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.491 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.491 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:22.491 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6807", 2021-11-12T05:42:22.492 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:42:22.492 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:22.492 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.492 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.493 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6803/14874", 2021-11-12T05:42:22.493 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6805/14874", 2021-11-12T05:42:22.493 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6809/14874", 2021-11-12T05:42:22.493 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6807/14874", 2021-11-12T05:42:22.493 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:42:22.494 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:42:22.494 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:42:22.494 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.494 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.494 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.495 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:42:22.495 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "b1bb06c3-26d0-4d92-82f8-b3e882242785", 2021-11-12T05:42:22.495 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:42:22.495 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:42:22.496 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:42:22.496 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:42:22.496 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:42:22.496 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:42:22.497 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:42:22.497 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 33, 2021-11-12T05:42:22.497 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:42:22.497 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:42:22.497 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:42:22.498 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:22.498 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.498 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:22.498 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6810", 2021-11-12T05:42:22.499 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:42:22.499 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.499 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.499 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:22.499 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6811", 2021-11-12T05:42:22.500 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:42:22.500 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:22.500 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.500 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.501 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:42:22.501 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:22.501 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.501 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:22.501 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6812", 2021-11-12T05:42:22.502 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:42:22.502 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.502 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.502 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:22.503 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6813", 2021-11-12T05:42:22.503 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:42:22.503 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:22.503 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.504 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.504 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:42:22.504 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:22.504 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.504 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:22.505 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6816", 2021-11-12T05:42:22.505 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:42:22.505 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.505 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.506 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:22.506 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6817", 2021-11-12T05:42:22.506 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:42:22.506 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:22.506 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.507 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.507 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:42:22.507 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:22.507 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.508 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:22.508 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6814", 2021-11-12T05:42:22.508 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:42:22.508 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.508 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.509 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:22.509 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6815", 2021-11-12T05:42:22.509 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:42:22.509 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:22.510 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.510 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.510 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6811/14875", 2021-11-12T05:42:22.510 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6813/14875", 2021-11-12T05:42:22.510 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6817/14875", 2021-11-12T05:42:22.511 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6815/14875", 2021-11-12T05:42:22.511 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:42:22.511 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:42:22.511 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:42:22.512 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.512 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.512 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.512 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:42:22.513 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "837b2c60-c335-4382-9f47-d86543a14022", 2021-11-12T05:42:22.513 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:42:22.513 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:42:22.513 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:42:22.513 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:42:22.514 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:42:22.514 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:42:22.514 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:42:22.514 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 31, 2021-11-12T05:42:22.515 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:42:22.515 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:42:22.515 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:42:22.515 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:22.515 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.516 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:22.516 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6818", 2021-11-12T05:42:22.516 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:42:22.516 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.517 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.517 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:22.517 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6819", 2021-11-12T05:42:22.517 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:42:22.517 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:22.518 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.518 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.518 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:42:22.518 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:22.519 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.519 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:22.519 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6820", 2021-11-12T05:42:22.519 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:42:22.519 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.520 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.520 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:22.520 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6821", 2021-11-12T05:42:22.520 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:42:22.521 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:22.521 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.521 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.521 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:42:22.521 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:22.522 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.522 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:22.522 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6824", 2021-11-12T05:42:22.522 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:42:22.523 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.523 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.523 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:22.523 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6825", 2021-11-12T05:42:22.523 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:42:22.524 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:22.524 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.524 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.524 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:42:22.525 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:22.525 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.525 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:22.525 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6822", 2021-11-12T05:42:22.525 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:42:22.526 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.526 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.526 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:22.526 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6823", 2021-11-12T05:42:22.527 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:42:22.527 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:22.527 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.527 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.527 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6819/14905", 2021-11-12T05:42:22.528 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6821/14905", 2021-11-12T05:42:22.528 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6825/14905", 2021-11-12T05:42:22.528 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6823/14905", 2021-11-12T05:42:22.528 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:42:22.529 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:42:22.529 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:42:22.529 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.529 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.529 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.530 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:42:22.530 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "eb2b737b-dda6-444b-a306-f33cbbd51f70", 2021-11-12T05:42:22.530 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:42:22.530 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:42:22.531 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:42:22.531 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:42:22.531 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:42:22.531 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:42:22.531 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:42:22.532 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 32, 2021-11-12T05:42:22.532 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:42:22.532 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:42:22.532 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:42:22.533 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:22.533 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.533 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:22.533 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6826", 2021-11-12T05:42:22.533 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:42:22.534 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.534 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.534 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:22.534 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6827", 2021-11-12T05:42:22.535 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:42:22.535 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:22.535 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.535 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.535 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:42:22.536 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:22.536 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.536 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:22.536 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6828", 2021-11-12T05:42:22.537 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:42:22.537 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.537 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.537 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:22.538 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6829", 2021-11-12T05:42:22.538 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:42:22.538 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:22.538 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.538 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.539 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:42:22.539 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:22.539 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.539 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:22.540 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6832", 2021-11-12T05:42:22.540 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:42:22.540 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.540 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.540 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:22.541 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6833", 2021-11-12T05:42:22.541 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:42:22.541 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:22.541 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.541 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.542 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:42:22.542 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:22.542 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.542 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:22.543 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6830", 2021-11-12T05:42:22.543 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:42:22.543 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.543 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.544 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:22.544 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6831", 2021-11-12T05:42:22.544 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:42:22.544 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:22.544 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.545 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.545 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6827/14876", 2021-11-12T05:42:22.545 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6829/14876", 2021-11-12T05:42:22.545 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6833/14876", 2021-11-12T05:42:22.546 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6831/14876", 2021-11-12T05:42:22.546 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:42:22.546 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:42:22.546 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:42:22.546 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.547 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.547 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.547 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:42:22.547 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "721529a1-c047-486a-a7ca-ddc15d80cdde", 2021-11-12T05:42:22.548 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:42:22.548 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:42:22.548 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:42:22.548 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:42:22.548 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:42:22.549 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:42:22.549 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:42:22.549 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 32, 2021-11-12T05:42:22.549 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:42:22.549 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:42:22.550 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:42:22.550 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:22.550 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.550 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:22.551 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6800", 2021-11-12T05:42:22.551 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:42:22.551 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.551 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.551 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:22.552 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6801", 2021-11-12T05:42:22.552 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:42:22.552 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:22.552 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.552 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.553 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:42:22.553 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:22.553 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.553 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:22.554 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6802", 2021-11-12T05:42:22.554 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:42:22.554 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.554 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.554 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:22.555 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6803", 2021-11-12T05:42:22.555 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:42:22.555 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:22.555 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.556 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.556 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:42:22.556 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:22.556 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.556 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:22.557 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6806", 2021-11-12T05:42:22.557 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:42:22.557 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.557 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.558 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:22.558 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6807", 2021-11-12T05:42:22.558 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:42:22.558 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:22.558 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.559 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.559 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:42:22.559 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:22.559 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.559 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:22.560 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6804", 2021-11-12T05:42:22.560 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:42:22.560 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.560 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.561 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:22.561 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6805", 2021-11-12T05:42:22.561 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:42:22.561 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:22.562 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.562 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.562 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6801/15096", 2021-11-12T05:42:22.562 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6803/15096", 2021-11-12T05:42:22.562 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6807/15096", 2021-11-12T05:42:22.563 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6805/15096", 2021-11-12T05:42:22.563 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:42:22.563 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:42:22.563 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:42:22.564 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.564 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.564 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.564 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:42:22.564 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "68b72ab2-fa82-4b5c-bf33-528f002e4950", 2021-11-12T05:42:22.565 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:42:22.565 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:42:22.565 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:42:22.565 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:42:22.565 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:42:22.566 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:42:22.566 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:42:22.566 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 32, 2021-11-12T05:42:22.566 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:42:22.567 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:42:22.567 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:42:22.567 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:22.567 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.567 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:22.568 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6808", 2021-11-12T05:42:22.568 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:42:22.568 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.568 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.569 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:22.569 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6809", 2021-11-12T05:42:22.569 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:42:22.569 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:22.569 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.570 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.570 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:42:22.570 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:22.570 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.571 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:22.571 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6810", 2021-11-12T05:42:22.571 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:42:22.571 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.572 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.572 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:22.572 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6811", 2021-11-12T05:42:22.572 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:42:22.572 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:22.573 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.573 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.573 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:42:22.573 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:22.574 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.574 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:22.574 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6814", 2021-11-12T05:42:22.574 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:42:22.574 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.575 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.575 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:22.575 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6815", 2021-11-12T05:42:22.575 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:42:22.576 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:22.576 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.576 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.576 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:42:22.576 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:22.577 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.577 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:22.577 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6812", 2021-11-12T05:42:22.577 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:42:22.577 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.578 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.578 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:22.578 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6813", 2021-11-12T05:42:22.578 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:42:22.579 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:22.579 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.579 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.579 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6809/15097", 2021-11-12T05:42:22.580 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6811/15097", 2021-11-12T05:42:22.580 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6815/15097", 2021-11-12T05:42:22.580 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6813/15097", 2021-11-12T05:42:22.580 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:42:22.580 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:42:22.581 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:42:22.581 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.581 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.581 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.581 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:42:22.582 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "a2c83b5d-8d37-4d30-ac04-30d89a76e485", 2021-11-12T05:42:22.582 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:42:22.582 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:42:22.582 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:42:22.583 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:42:22.583 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:42:22.583 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:42:22.583 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:42:22.583 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 31, 2021-11-12T05:42:22.584 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:42:22.584 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:42:22.584 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:42:22.584 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:22.584 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.585 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:22.585 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6816", 2021-11-12T05:42:22.585 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:42:22.585 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.585 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.586 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:22.586 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6817", 2021-11-12T05:42:22.586 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:42:22.586 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:22.586 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.587 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.587 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:42:22.587 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:22.587 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.587 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:22.588 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6818", 2021-11-12T05:42:22.588 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:42:22.588 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.588 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.589 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:22.589 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6819", 2021-11-12T05:42:22.589 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:42:22.589 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:22.589 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.590 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.590 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:42:22.590 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:22.590 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.591 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:22.591 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6822", 2021-11-12T05:42:22.591 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:42:22.591 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.591 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.592 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:22.592 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6823", 2021-11-12T05:42:22.592 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:42:22.592 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:22.592 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.593 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.593 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:42:22.593 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:22.593 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.593 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:22.594 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6820", 2021-11-12T05:42:22.594 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:42:22.594 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.594 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.594 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:22.595 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6821", 2021-11-12T05:42:22.595 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:42:22.595 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:22.595 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.595 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.596 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6817/15098", 2021-11-12T05:42:22.596 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6819/15098", 2021-11-12T05:42:22.596 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6823/15098", 2021-11-12T05:42:22.596 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6821/15098", 2021-11-12T05:42:22.596 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:42:22.596 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:42:22.597 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:42:22.597 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.597 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.597 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.598 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:42:22.598 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "786ce966-d0fb-4181-aed4-c26e3ef61c43", 2021-11-12T05:42:22.598 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:42:22.598 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:42:22.599 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:42:22.599 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:42:22.599 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:42:22.599 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:42:22.599 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:42:22.600 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 32, 2021-11-12T05:42:22.600 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:42:22.600 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:42:22.600 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:42:22.600 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:22.601 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.601 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:22.601 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6824", 2021-11-12T05:42:22.601 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:42:22.602 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.602 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.602 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:22.602 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6825", 2021-11-12T05:42:22.602 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:42:22.603 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:22.603 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.603 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.603 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:42:22.603 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:22.604 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.604 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:22.604 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6826", 2021-11-12T05:42:22.604 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:42:22.604 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.605 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.605 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:22.605 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6827", 2021-11-12T05:42:22.605 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:42:22.606 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:22.606 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.606 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.606 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:42:22.606 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:22.607 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.607 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:22.607 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6830", 2021-11-12T05:42:22.607 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:42:22.608 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.608 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.608 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:22.608 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6831", 2021-11-12T05:42:22.608 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:42:22.609 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:22.609 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.609 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.609 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:42:22.609 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:42:22.610 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.610 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:42:22.610 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6828", 2021-11-12T05:42:22.610 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:42:22.611 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.611 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.611 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:42:22.611 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6829", 2021-11-12T05:42:22.611 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:42:22.612 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:22.612 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.612 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.612 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6825/15099", 2021-11-12T05:42:22.612 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6827/15099", 2021-11-12T05:42:22.613 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6831/15099", 2021-11-12T05:42:22.613 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6829/15099", 2021-11-12T05:42:22.613 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:42:22.613 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:42:22.613 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:42:22.614 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:22.614 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:22.614 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:42:22.614 INFO:teuthology.orchestra.run.gibba005.stdout: "osd_xinfo": [ 2021-11-12T05:42:22.614 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.615 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:42:22.615 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:42:22.615 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:42:22.615 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:42:22.616 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:42:22.616 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:42:22.616 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.615112+0000", 2021-11-12T05:42:22.616 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:42:22.616 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.617 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.617 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:42:22.617 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:42:22.617 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:42:22.617 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:42:22.618 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:42:22.618 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:42:22.618 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.665935+0000", 2021-11-12T05:42:22.618 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:42:22.618 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.619 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.619 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:42:22.619 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:42:22.619 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:42:22.620 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:42:22.620 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:42:22.620 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:42:22.620 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.715877+0000", 2021-11-12T05:42:22.620 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:42:22.621 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.621 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.621 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:42:22.621 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:42:22.622 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:42:22.622 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:42:22.622 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:42:22.622 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:42:22.622 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.489234+0000", 2021-11-12T05:42:22.623 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:42:22.623 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.623 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.623 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:42:22.623 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:42:22.624 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:42:22.624 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:42:22.624 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:42:22.624 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:42:22.625 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.413776+0000", 2021-11-12T05:42:22.625 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:42:22.625 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.625 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.626 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:42:22.626 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:42:22.626 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:42:22.626 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:42:22.626 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:42:22.627 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:42:22.627 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.507960+0000", 2021-11-12T05:42:22.627 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:42:22.627 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.628 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.628 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:42:22.628 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:42:22.628 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:42:22.628 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:42:22.629 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:42:22.629 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:42:22.629 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.635696+0000", 2021-11-12T05:42:22.629 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:42:22.630 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.630 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:22.630 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:42:22.630 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:42:22.630 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:42:22.631 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:42:22.631 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:42:22.631 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:42:22.631 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.746949+0000", 2021-11-12T05:42:22.632 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:42:22.632 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:22.632 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:42:22.632 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap": [], 2021-11-12T05:42:22.632 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap_items": [], 2021-11-12T05:42:22.633 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_temp": [], 2021-11-12T05:42:22.633 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_temp": [], 2021-11-12T05:42:22.633 INFO:teuthology.orchestra.run.gibba005.stdout: "blacklist": { 2021-11-12T05:42:22.633 INFO:teuthology.orchestra.run.gibba005.stdout: "172.21.2.105:6835/2626499955": "2021-11-13T05:42:16.477573+0000", 2021-11-12T05:42:22.633 INFO:teuthology.orchestra.run.gibba005.stdout: "172.21.2.105:6834/2626499955": "2021-11-13T05:42:16.477573+0000" 2021-11-12T05:42:22.634 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.634 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profiles": { 2021-11-12T05:42:22.634 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs_data": { 2021-11-12T05:42:22.634 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-device-class": "", 2021-11-12T05:42:22.635 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:42:22.635 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-root": "default", 2021-11-12T05:42:22.635 INFO:teuthology.orchestra.run.gibba005.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-12T05:42:22.635 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:42:22.635 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "2", 2021-11-12T05:42:22.636 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:42:22.636 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:42:22.636 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van", 2021-11-12T05:42:22.636 INFO:teuthology.orchestra.run.gibba005.stdout: "w": "8" 2021-11-12T05:42:22.637 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.637 INFO:teuthology.orchestra.run.gibba005.stdout: "default": { 2021-11-12T05:42:22.637 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:42:22.637 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:42:22.637 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "1", 2021-11-12T05:42:22.638 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:42:22.638 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:42:22.638 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van" 2021-11-12T05:42:22.638 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:22.638 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:22.639 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps_queue": [], 2021-11-12T05:42:22.639 INFO:teuthology.orchestra.run.gibba005.stdout: "new_removed_snaps": [], 2021-11-12T05:42:22.639 INFO:teuthology.orchestra.run.gibba005.stdout: "new_purged_snaps": [], 2021-11-12T05:42:22.639 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_node_flags": {}, 2021-11-12T05:42:22.640 INFO:teuthology.orchestra.run.gibba005.stdout: "device_class_flags": {} 2021-11-12T05:42:22.640 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:42:22.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.431+0000 7f17f3984700 1 -- 172.21.2.105:0/3428481067 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f17cc053640 msgr2=0x7f17cc055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:22.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.431+0000 7f17f3984700 1 --2- 172.21.2.105:0/3428481067 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f17cc053640 0x7f17cc055b00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f17e0008000 tx=0x7f17e0009040).stop 2021-11-12T05:42:22.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.431+0000 7f17f3984700 1 -- 172.21.2.105:0/3428481067 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f17ec060100 msgr2=0x7f17ec114440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:22.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.431+0000 7f17f3984700 1 --2- 172.21.2.105:0/3428481067 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f17ec060100 0x7f17ec114440 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f17ec0675d0 tx=0x7f17e8006ec0).stop 2021-11-12T05:42:22.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.431+0000 7f17f3984700 1 -- 172.21.2.105:0/3428481067 shutdown_connections 2021-11-12T05:42:22.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.431+0000 7f17f3984700 1 --2- 172.21.2.105:0/3428481067 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f17cc053640 0x7f17cc055b00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:22.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.431+0000 7f17f3984700 1 --2- 172.21.2.105:0/3428481067 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f17ec142ed0 0x7f17ec0648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:22.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.431+0000 7f17f3984700 1 --2- 172.21.2.105:0/3428481067 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f17ec0b1ef0 0x7f17ec1118b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:22.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.431+0000 7f17f3984700 1 --2- 172.21.2.105:0/3428481067 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f17ec060100 0x7f17ec114440 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:22.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.431+0000 7f17f3984700 1 -- 172.21.2.105:0/3428481067 >> 172.21.2.105:0/3428481067 conn(0x7f17ec0608d0 msgr2=0x7f17ec0b4740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:22.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.431+0000 7f17f3984700 1 -- 172.21.2.105:0/3428481067 shutdown_connections 2021-11-12T05:42:22.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.431+0000 7f17f3984700 1 -- 172.21.2.105:0/3428481067 wait complete. 2021-11-12T05:42:22.645 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:42:22.703 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.695+0000 7efddfc60700 1 Processor -- start 2021-11-12T05:42:22.704 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.695+0000 7efddfc60700 1 -- start start 2021-11-12T05:42:22.704 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efddfc60700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efdd80b2940 0x7efdd8142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:22.704 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efddfc60700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7efdd80b0cc0 0x7efdd805f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:22.704 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efddfc60700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdd80b2d20 con 0x7efdd80b0780 2021-11-12T05:42:22.705 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efddfc60700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdd80b1fc0 con 0x7efdd80b0cc0 2021-11-12T05:42:22.705 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efddfc60700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd80b15e0 con 0x7efdd80b2940 2021-11-12T05:42:22.705 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efdde1fd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7efdd80b0cc0 0x7efdd805f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:22.705 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efdde1fd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7efdd80b0cc0 0x7efdd805f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44792/0 (socket says 172.21.2.105:44792) 2021-11-12T05:42:22.706 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efdde1fd700 1 -- 172.21.2.105:0/1215275418 learned_addr learned my addr 172.21.2.105:0/1215275418 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:22.706 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efdde1fd700 1 -- 172.21.2.105:0/1215275418 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efdd80b2940 msgr2=0x7efdd8142dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:42:22.706 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efdde1fd700 1 --2- 172.21.2.105:0/1215275418 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efdd80b2940 0x7efdd8142dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:22.706 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efdde1fd700 1 -- 172.21.2.105:0/1215275418 >> v1:172.21.2.115:6789/0 conn(0x7efdd80b0780 legacy=0x7efdd81432b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:42:22.706 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efdde1fd700 1 -- 172.21.2.105:0/1215275418 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd80b1880 con 0x7efdd80b0cc0 2021-11-12T05:42:22.707 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efdde1fd700 1 --2- 172.21.2.105:0/1215275418 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efdd80b0cc0 0x7efdd805f6b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7efdd8060ba0 tx=0x7efdd000b530).ready entity=mon.0 client_cookie=492d74c569e62340 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:22.707 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efddc9fa700 1 -- 172.21.2.105:0/1215275418 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdd00155e0 con 0x7efdd80b0cc0 2021-11-12T05:42:22.707 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efddc9fa700 1 -- 172.21.2.105:0/1215275418 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd0015740 con 0x7efdd80b0cc0 2021-11-12T05:42:22.707 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efddc9fa700 1 -- 172.21.2.105:0/1215275418 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdd0015ae0 con 0x7efdd80b0cc0 2021-11-12T05:42:22.708 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efddfc60700 1 -- 172.21.2.105:0/1215275418 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efdd80b0cc0 msgr2=0x7efdd805f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:22.708 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efddfc60700 1 --2- 172.21.2.105:0/1215275418 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efdd80b0cc0 0x7efdd805f6b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7efdd8060ba0 tx=0x7efdd000b530).stop 2021-11-12T05:42:22.708 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efddfc60700 1 -- 172.21.2.105:0/1215275418 shutdown_connections 2021-11-12T05:42:22.708 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efddfc60700 1 --2- 172.21.2.105:0/1215275418 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efdd80b0cc0 0x7efdd805f6b0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:22.708 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efddfc60700 1 --2- 172.21.2.105:0/1215275418 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efdd80b2940 0x7efdd8142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:22.709 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efddfc60700 1 -- 172.21.2.105:0/1215275418 >> 172.21.2.105:0/1215275418 conn(0x7efdd8068440 msgr2=0x7efdd8062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:22.709 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efddfc60700 1 -- 172.21.2.105:0/1215275418 shutdown_connections 2021-11-12T05:42:22.709 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efddfc60700 1 -- 172.21.2.105:0/1215275418 wait complete. 2021-11-12T05:42:22.711 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efddfc60700 1 Processor -- start 2021-11-12T05:42:22.711 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efddfc60700 1 -- start start 2021-11-12T05:42:22.712 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efddfc60700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efdd80b0780 0x7efdd80a7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:22.712 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efddfc60700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efdd80b0cc0 0x7efdd80a4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:22.712 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efddfc60700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efdd80b2940 0x7efdd80af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:22.712 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efddfc60700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd80a57d0 con 0x7efdd80b0cc0 2021-11-12T05:42:22.713 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efddfc60700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd80a32c0 con 0x7efdd80b2940 2021-11-12T05:42:22.713 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efddfc60700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd80a3560 con 0x7efdd80b0780 2021-11-12T05:42:22.713 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efddd1fb700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efdd80b0cc0 0x7efdd80a4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:22.713 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efddd1fb700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efdd80b0cc0 0x7efdd80a4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44794/0 (socket says 172.21.2.105:44794) 2021-11-12T05:42:22.714 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efddd1fb700 1 -- 172.21.2.105:0/943848812 learned_addr learned my addr 172.21.2.105:0/943848812 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:22.714 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efddd1fb700 1 -- 172.21.2.105:0/943848812 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efdd80b0780 msgr2=0x7efdd80a7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:22.714 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efddd1fb700 1 --2- 172.21.2.105:0/943848812 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efdd80b0780 0x7efdd80a7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:22.714 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efddd1fb700 1 -- 172.21.2.105:0/943848812 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efdd80b2940 msgr2=0x7efdd80af2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:22.714 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efddd1fb700 1 --2- 172.21.2.105:0/943848812 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efdd80b2940 0x7efdd80af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:22.715 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efddd1fb700 1 -- 172.21.2.105:0/943848812 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd000b7d0 con 0x7efdd80b0cc0 2021-11-12T05:42:22.715 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efddd1fb700 1 --2- 172.21.2.105:0/943848812 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efdd80b0cc0 0x7efdd80a4030 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7efdd4002fb0 tx=0x7efdd4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:22.715 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efdcaffd700 1 -- 172.21.2.105:0/943848812 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdd4013460 con 0x7efdd80b0cc0 2021-11-12T05:42:22.715 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efdcaffd700 1 -- 172.21.2.105:0/943848812 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd40135c0 con 0x7efdd80b0cc0 2021-11-12T05:42:22.716 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efdcaffd700 1 -- 172.21.2.105:0/943848812 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdd4013920 con 0x7efdd80b0cc0 2021-11-12T05:42:22.716 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efddfc60700 1 -- 172.21.2.105:0/943848812 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdd8156000 con 0x7efdd80b0cc0 2021-11-12T05:42:22.716 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.699+0000 7efddfc60700 1 -- 172.21.2.105:0/943848812 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd80a2dc0 con 0x7efdd80b0cc0 2021-11-12T05:42:22.716 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.703+0000 7efddfc60700 1 -- 172.21.2.105:0/943848812 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdd80a30d0 con 0x7efdd80b0cc0 2021-11-12T05:42:22.717 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.703+0000 7efdcaffd700 1 -- 172.21.2.105:0/943848812 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efdd400f070 con 0x7efdd80b0cc0 2021-11-12T05:42:22.717 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.703+0000 7efdcaffd700 1 --2- 172.21.2.105:0/943848812 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efdb8053720 0x7efdb8055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:22.717 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.703+0000 7efdcaffd700 1 -- 172.21.2.105:0/943848812 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5682+0+0 (secure 0 0 0) 0x7efdd406b1d0 con 0x7efdd80b0cc0 2021-11-12T05:42:22.717 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.703+0000 7efddd9fc700 1 --2- 172.21.2.105:0/943848812 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efdb8053720 0x7efdb8055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:22.717 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.703+0000 7efddd9fc700 1 --2- 172.21.2.105:0/943848812 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efdb8053720 0x7efdb8055be0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7efdcc000ed0 tx=0x7efdcc006930).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:22.718 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.703+0000 7efdcaffd700 1 -- 172.21.2.105:0/943848812 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efdd40424b0 con 0x7efdd80b0cc0 2021-11-12T05:42:22.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.811+0000 7efddfc60700 1 -- 172.21.2.105:0/943848812 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efdd8156190 con 0x7efdd80b0cc0 2021-11-12T05:42:22.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.811+0000 7efdcaffd700 1 -- 172.21.2.105:0/943848812 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+1208 (secure 0 0 0) 0x7efdd4045ad0 con 0x7efdd80b0cc0 2021-11-12T05:42:22.817 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:42:22.818 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4429,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/4118304786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":4118304786},{"type":"v1","addr":"172.21.2.115:6833","nonce":4118304786}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8},{"gid":5163,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.105:6835/2223670176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":2223670176},{"type":"v1","addr":"172.21.2.105:6835","nonce":2223670176}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":12}],"filesystems":[]} 2021-11-12T05:42:22.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.811+0000 7efddfc60700 1 -- 172.21.2.105:0/943848812 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efdb8053720 msgr2=0x7efdb8055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:22.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.811+0000 7efddfc60700 1 --2- 172.21.2.105:0/943848812 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efdb8053720 0x7efdb8055be0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7efdcc000ed0 tx=0x7efdcc006930).stop 2021-11-12T05:42:22.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.811+0000 7efddfc60700 1 -- 172.21.2.105:0/943848812 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efdd80b0cc0 msgr2=0x7efdd80a4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:22.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.811+0000 7efddfc60700 1 --2- 172.21.2.105:0/943848812 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efdd80b0cc0 0x7efdd80a4030 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7efdd4002fb0 tx=0x7efdd4006df0).stop 2021-11-12T05:42:22.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.811+0000 7efddfc60700 1 -- 172.21.2.105:0/943848812 shutdown_connections 2021-11-12T05:42:22.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.811+0000 7efddfc60700 1 --2- 172.21.2.105:0/943848812 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efdb8053720 0x7efdb8055be0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:22.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.811+0000 7efddfc60700 1 --2- 172.21.2.105:0/943848812 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efdd80b2940 0x7efdd80af2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:22.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.811+0000 7efddfc60700 1 --2- 172.21.2.105:0/943848812 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efdd80b0cc0 0x7efdd80a4030 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:22.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.811+0000 7efddfc60700 1 --2- 172.21.2.105:0/943848812 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efdd80b0780 0x7efdd80a7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:22.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.811+0000 7efddfc60700 1 -- 172.21.2.105:0/943848812 >> 172.21.2.105:0/943848812 conn(0x7efdd8068440 msgr2=0x7efdd81495d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:22.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.815+0000 7efddfc60700 1 -- 172.21.2.105:0/943848812 shutdown_connections 2021-11-12T05:42:22.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.815+0000 7efddfc60700 1 -- 172.21.2.105:0/943848812 wait complete. 2021-11-12T05:42:22.821 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 12 2021-11-12T05:42:22.824 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:42:22.875 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.871+0000 7f25d1051700 1 Processor -- start 2021-11-12T05:42:22.875 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.871+0000 7f25d1051700 1 -- start start 2021-11-12T05:42:22.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.871+0000 7f25d1051700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f25cc05fdc0 0x7f25cc0601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:22.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.871+0000 7f25d1051700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f25cc0ade80 0x7f25cc066730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:22.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.871+0000 7f25d1051700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25cc066150 con 0x7f25cc13a9c0 2021-11-12T05:42:22.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.871+0000 7f25d1051700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25cc141fb0 con 0x7f25cc05fdc0 2021-11-12T05:42:22.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.871+0000 7f25d1051700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25cc0663f0 con 0x7f25cc0ade80 2021-11-12T05:42:22.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.871+0000 7f25cb59e700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f25cc13a9c0 0x7f25cc141470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:55200/0 (socket says 172.21.2.105:55200) 2021-11-12T05:42:22.881 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.871+0000 7f25cb59e700 1 -- 172.21.2.105:0/3503927418 learned_addr learned my addr 172.21.2.105:0/3503927418 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:42:22.881 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.871+0000 7f25cad9d700 1 --2- 172.21.2.105:0/3503927418 >> v2:172.21.2.105:3300/0 conn(0x7f25cc05fdc0 0x7f25cc0601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:22.881 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.871+0000 7f25cad9d700 1 -- 172.21.2.105:0/3503927418 >> v2:172.21.2.115:3300/0 conn(0x7f25cc0ade80 msgr2=0x7f25cc066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:22.882 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.871+0000 7f25cad9d700 1 --2- 172.21.2.105:0/3503927418 >> v2:172.21.2.115:3300/0 conn(0x7f25cc0ade80 0x7f25cc066730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:22.882 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.871+0000 7f25cad9d700 1 -- 172.21.2.105:0/3503927418 >> v1:172.21.2.105:6789/0 conn(0x7f25cc13a9c0 legacy=0x7f25cc141470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:22.882 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.871+0000 7f25c9d9b700 1 -- 172.21.2.105:0/3503927418 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2459952805 0 0) 0x7f25cc066150 con 0x7f25cc13a9c0 2021-11-12T05:42:22.882 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.871+0000 7f25cad9d700 1 -- 172.21.2.105:0/3503927418 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25cc140fd0 con 0x7f25cc05fdc0 2021-11-12T05:42:22.882 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.871+0000 7f25cad9d700 1 --2- 172.21.2.105:0/3503927418 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f25cc05fdc0 0x7f25cc0601a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f25bc002f70 tx=0x7f25bc006df0).ready entity=mon.0 client_cookie=4d600b1e8374e6b server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:22.883 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.871+0000 7f25c9d9b700 1 -- 172.21.2.105:0/3503927418 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25bc00d5c0 con 0x7f25cc05fdc0 2021-11-12T05:42:22.883 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.871+0000 7f25c9d9b700 1 -- 172.21.2.105:0/3503927418 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25bc000e90 con 0x7f25cc05fdc0 2021-11-12T05:42:22.883 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.871+0000 7f25c9d9b700 1 -- 172.21.2.105:0/3503927418 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25bc00d910 con 0x7f25cc05fdc0 2021-11-12T05:42:22.883 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.871+0000 7f25d1051700 1 -- 172.21.2.105:0/3503927418 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f25cc05fdc0 msgr2=0x7f25cc0601a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:22.884 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.871+0000 7f25d1051700 1 --2- 172.21.2.105:0/3503927418 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f25cc05fdc0 0x7f25cc0601a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f25bc002f70 tx=0x7f25bc006df0).stop 2021-11-12T05:42:22.884 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.871+0000 7f25d1051700 1 -- 172.21.2.105:0/3503927418 shutdown_connections 2021-11-12T05:42:22.884 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.871+0000 7f25d1051700 1 --2- 172.21.2.105:0/3503927418 >> v2:172.21.2.115:3300/0 conn(0x7f25cc0ade80 0x7f25cc066730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:22.884 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.871+0000 7f25d1051700 1 --2- 172.21.2.105:0/3503927418 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f25cc05fdc0 0x7f25cc0601a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:22.884 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.871+0000 7f25d1051700 1 -- 172.21.2.105:0/3503927418 >> 172.21.2.105:0/3503927418 conn(0x7f25cc0608d0 msgr2=0x7f25cc05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:22.885 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.871+0000 7f25d1051700 1 -- 172.21.2.105:0/3503927418 shutdown_connections 2021-11-12T05:42:22.885 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.871+0000 7f25d1051700 1 -- 172.21.2.105:0/3503927418 wait complete. 2021-11-12T05:42:22.885 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.871+0000 7f25d1051700 1 Processor -- start 2021-11-12T05:42:22.885 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.871+0000 7f25d1051700 1 -- start start 2021-11-12T05:42:22.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.875+0000 7f25d1051700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f25cc05fdc0 0x7f25cc0b63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:22.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.875+0000 7f25d1051700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f25cc0ade80 0x7f25cc1471e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:22.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.875+0000 7f25d1051700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f25cc13a9c0 0x7f25cc155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:22.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.875+0000 7f25d1051700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc13fe50 con 0x7f25cc13a9c0 2021-11-12T05:42:22.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.875+0000 7f25d1051700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc0ae670 con 0x7f25cc05fdc0 2021-11-12T05:42:22.887 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.875+0000 7f25d1051700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc0ae910 con 0x7f25cc0ade80 2021-11-12T05:42:22.887 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.875+0000 7f25cb59e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f25cc13a9c0 0x7f25cc155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:22.887 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.875+0000 7f25cb59e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f25cc13a9c0 0x7f25cc155a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44812/0 (socket says 172.21.2.105:44812) 2021-11-12T05:42:22.887 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.875+0000 7f25cb59e700 1 -- 172.21.2.105:0/2249330989 learned_addr learned my addr 172.21.2.105:0/2249330989 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:22.888 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.875+0000 7f25cb59e700 1 -- 172.21.2.105:0/2249330989 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f25cc0ade80 msgr2=0x7f25cc1471e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:22.888 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.875+0000 7f25cb59e700 1 --2- 172.21.2.105:0/2249330989 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f25cc0ade80 0x7f25cc1471e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:22.888 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.875+0000 7f25cb59e700 1 -- 172.21.2.105:0/2249330989 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f25cc05fdc0 msgr2=0x7f25cc0b63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:22.888 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.875+0000 7f25cb59e700 1 --2- 172.21.2.105:0/2249330989 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f25cc05fdc0 0x7f25cc0b63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:22.888 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.875+0000 7f25cb59e700 1 -- 172.21.2.105:0/2249330989 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25bc00b180 con 0x7f25cc13a9c0 2021-11-12T05:42:22.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.875+0000 7f25cb59e700 1 --2- 172.21.2.105:0/2249330989 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f25cc13a9c0 0x7f25cc155a60 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f25c4001250 tx=0x7f25c4001360).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:22.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.875+0000 7f25c3fff700 1 -- 172.21.2.105:0/2249330989 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25c4005ba0 con 0x7f25cc13a9c0 2021-11-12T05:42:22.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.875+0000 7f25c3fff700 1 -- 172.21.2.105:0/2249330989 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25c4005d00 con 0x7f25cc13a9c0 2021-11-12T05:42:22.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.875+0000 7f25d1051700 1 -- 172.21.2.105:0/2249330989 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25cc0aebb0 con 0x7f25cc13a9c0 2021-11-12T05:42:22.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.875+0000 7f25d1051700 1 -- 172.21.2.105:0/2249330989 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25cc0b7f40 con 0x7f25cc13a9c0 2021-11-12T05:42:22.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.875+0000 7f25c3fff700 1 -- 172.21.2.105:0/2249330989 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25c4004a90 con 0x7f25cc13a9c0 2021-11-12T05:42:22.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.875+0000 7f25d1051700 1 -- 172.21.2.105:0/2249330989 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25cc057350 con 0x7f25cc13a9c0 2021-11-12T05:42:22.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.875+0000 7f25c3fff700 1 -- 172.21.2.105:0/2249330989 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f25c4004bf0 con 0x7f25cc13a9c0 2021-11-12T05:42:22.891 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.875+0000 7f25c3fff700 1 --2- 172.21.2.105:0/2249330989 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f25b00536f0 0x7f25b0055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:22.891 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.875+0000 7f25c3fff700 1 -- 172.21.2.105:0/2249330989 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f25c406b590 con 0x7f25cc13a9c0 2021-11-12T05:42:22.891 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.875+0000 7f25cad9d700 1 --2- 172.21.2.105:0/2249330989 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f25b00536f0 0x7f25b0055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:22.891 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.875+0000 7f25cad9d700 1 --2- 172.21.2.105:0/2249330989 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f25b00536f0 0x7f25b0055bb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f25bc002f70 tx=0x7f25bc014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:22.892 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.879+0000 7f25c3fff700 1 -- 172.21.2.105:0/2249330989 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f25c4042760 con 0x7f25cc13a9c0 2021-11-12T05:42:22.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.987+0000 7f25d1051700 1 -- 172.21.2.105:0/2249330989 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25cc05fba0 con 0x7f25cc13a9c0 2021-11-12T05:42:22.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.987+0000 7f25c3fff700 1 -- 172.21.2.105:0/2249330989 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+1208 (secure 0 0 0) 0x7f25c4045d80 con 0x7f25cc13a9c0 2021-11-12T05:42:22.993 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:42:22.993 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4429,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/4118304786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":4118304786},{"type":"v1","addr":"172.21.2.115:6833","nonce":4118304786}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8},{"gid":5163,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.105:6835/2223670176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":2223670176},{"type":"v1","addr":"172.21.2.105:6835","nonce":2223670176}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":12}],"filesystems":[]} 2021-11-12T05:42:22.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.987+0000 7f25d1051700 1 -- 172.21.2.105:0/2249330989 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f25b00536f0 msgr2=0x7f25b0055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:22.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.987+0000 7f25d1051700 1 --2- 172.21.2.105:0/2249330989 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f25b00536f0 0x7f25b0055bb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f25bc002f70 tx=0x7f25bc014000).stop 2021-11-12T05:42:22.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.987+0000 7f25d1051700 1 -- 172.21.2.105:0/2249330989 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f25cc13a9c0 msgr2=0x7f25cc155a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:22.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.987+0000 7f25d1051700 1 --2- 172.21.2.105:0/2249330989 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f25cc13a9c0 0x7f25cc155a60 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f25c4001250 tx=0x7f25c4001360).stop 2021-11-12T05:42:22.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.987+0000 7f25d1051700 1 -- 172.21.2.105:0/2249330989 shutdown_connections 2021-11-12T05:42:22.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.987+0000 7f25d1051700 1 --2- 172.21.2.105:0/2249330989 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f25b00536f0 0x7f25b0055bb0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:22.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.987+0000 7f25d1051700 1 --2- 172.21.2.105:0/2249330989 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f25cc13a9c0 0x7f25cc155a60 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:22.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.987+0000 7f25d1051700 1 --2- 172.21.2.105:0/2249330989 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f25cc0ade80 0x7f25cc1471e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:22.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.987+0000 7f25d1051700 1 --2- 172.21.2.105:0/2249330989 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f25cc05fdc0 0x7f25cc0b63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:22.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.987+0000 7f25d1051700 1 -- 172.21.2.105:0/2249330989 >> 172.21.2.105:0/2249330989 conn(0x7f25cc0608d0 msgr2=0x7f25cc066a40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:22.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.987+0000 7f25d1051700 1 -- 172.21.2.105:0/2249330989 shutdown_connections 2021-11-12T05:42:22.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:22.987+0000 7f25d1051700 1 -- 172.21.2.105:0/2249330989 wait complete. 2021-11-12T05:42:22.997 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 12 2021-11-12T05:42:23.000 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-12T05:42:23.000 INFO:tasks.ceph.mds.a:Stopping old one... 2021-11-12T05:42:23.001 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-12T05:42:23.001 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T05:42:23.001 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-12T05:42:23.001 INFO:tasks.ceph.mds.b:Stopping old one... 2021-11-12T05:42:23.002 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-12T05:42:23.002 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T05:42:23.006 INFO:tasks.ceph.mds.a:Stopped 2021-11-12T05:42:23.006 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-12T05:42:23.008 INFO:tasks.ceph.mds.a:Started 2021-11-12T05:42:23.009 DEBUG:teuthology.parallel:result is None 2021-11-12T05:42:23.014 INFO:tasks.ceph.mds.b:Stopped 2021-11-12T05:42:23.015 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-12T05:42:23.017 INFO:tasks.ceph.mds.b:Started 2021-11-12T05:42:23.017 DEBUG:teuthology.parallel:result is None 2021-11-12T05:42:23.018 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-11-12T05:42:23.043 INFO:tasks.ceph.mds.a.gibba005.stdout:starting mds.a at 2021-11-12T05:42:23.051 INFO:tasks.ceph.mds.b.gibba015.stdout:starting mds.b at 2021-11-12T05:42:23.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.067+0000 7f4601441700 1 Processor -- start 2021-11-12T05:42:23.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.067+0000 7f4601441700 1 -- start start 2021-11-12T05:42:23.074 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.067+0000 7f4601441700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f45fc0af750 0x7f45fc062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:23.074 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.067+0000 7f4601441700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f45fc130a80 0x7f45fc1474d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:23.074 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.067+0000 7f4601441700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45fc0b0d50 con 0x7f45fc0626b0 2021-11-12T05:42:23.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.067+0000 7f4601441700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45fc0ad380 con 0x7f45fc0af750 2021-11-12T05:42:23.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.067+0000 7f4601441700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc0ae190 con 0x7f45fc130a80 2021-11-12T05:42:23.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.067+0000 7f45fa7fc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f45fc0af750 0x7f45fc062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:23.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.067+0000 7f45fa7fc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f45fc0af750 0x7f45fc062a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44832/0 (socket says 172.21.2.105:44832) 2021-11-12T05:42:23.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.067+0000 7f45fa7fc700 1 -- 172.21.2.105:0/4070617862 learned_addr learned my addr 172.21.2.105:0/4070617862 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:23.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.067+0000 7f45fb7fe700 1 --2- 172.21.2.105:0/4070617862 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f45fc130a80 0x7f45fc1474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:23.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.067+0000 7f45fa7fc700 1 -- 172.21.2.105:0/4070617862 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f45fc130a80 msgr2=0x7f45fc1474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:23.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.067+0000 7f45fa7fc700 1 --2- 172.21.2.105:0/4070617862 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f45fc130a80 0x7f45fc1474d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:23.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.067+0000 7f45fa7fc700 1 -- 172.21.2.105:0/4070617862 >> v1:172.21.2.115:6789/0 conn(0x7f45fc0626b0 legacy=0x7f45fc130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:23.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.067+0000 7f45fa7fc700 1 -- 172.21.2.105:0/4070617862 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45fc1479c0 con 0x7f45fc0af750 2021-11-12T05:42:23.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.067+0000 7f45fa7fc700 1 --2- 172.21.2.105:0/4070617862 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f45fc0af750 0x7f45fc062a90 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f45f0002f70 tx=0x7f45f0006eb0).ready entity=mon.0 client_cookie=58e8a6dac0a3ae1a server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:23.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.071+0000 7f45f9ffb700 1 -- 172.21.2.105:0/4070617862 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45f000d570 con 0x7f45fc0af750 2021-11-12T05:42:23.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.071+0000 7f45f9ffb700 1 -- 172.21.2.105:0/4070617862 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f0000e90 con 0x7f45fc0af750 2021-11-12T05:42:23.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.071+0000 7f45f9ffb700 1 -- 172.21.2.105:0/4070617862 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45f000d900 con 0x7f45fc0af750 2021-11-12T05:42:23.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.071+0000 7f4601441700 1 -- 172.21.2.105:0/4070617862 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f45fc0af750 msgr2=0x7f45fc062a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:23.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.071+0000 7f4601441700 1 --2- 172.21.2.105:0/4070617862 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f45fc0af750 0x7f45fc062a90 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f45f0002f70 tx=0x7f45f0006eb0).stop 2021-11-12T05:42:23.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.071+0000 7f4601441700 1 -- 172.21.2.105:0/4070617862 shutdown_connections 2021-11-12T05:42:23.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.071+0000 7f4601441700 1 --2- 172.21.2.105:0/4070617862 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f45fc130a80 0x7f45fc1474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:23.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.071+0000 7f4601441700 1 --2- 172.21.2.105:0/4070617862 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f45fc0af750 0x7f45fc062a90 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:23.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.071+0000 7f4601441700 1 -- 172.21.2.105:0/4070617862 >> 172.21.2.105:0/4070617862 conn(0x7f45fc0b5320 msgr2=0x7f45fc0b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:23.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.071+0000 7f4601441700 1 -- 172.21.2.105:0/4070617862 shutdown_connections 2021-11-12T05:42:23.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.071+0000 7f4601441700 1 -- 172.21.2.105:0/4070617862 wait complete. 2021-11-12T05:42:23.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.071+0000 7f4601441700 1 Processor -- start 2021-11-12T05:42:23.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.071+0000 7f4601441700 1 -- start start 2021-11-12T05:42:23.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.071+0000 7f4601441700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f45fc0626b0 0x7f45fc0b3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:23.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.071+0000 7f4601441700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f45fc0af750 0x7f45fc0662f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:23.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.071+0000 7f4601441700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f45fc130a80 0x7f45fc0667e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:23.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.071+0000 7f4601441700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc146bd0 con 0x7f45fc130a80 2021-11-12T05:42:23.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.071+0000 7f4601441700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc0b3b70 con 0x7f45fc0626b0 2021-11-12T05:42:23.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.071+0000 7f4601441700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45fc159e30 con 0x7f45fc0af750 2021-11-12T05:42:23.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.071+0000 7f45fb7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f45fc130a80 0x7f45fc0667e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:23.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.071+0000 7f45fb7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f45fc130a80 0x7f45fc0667e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44838/0 (socket says 172.21.2.105:44838) 2021-11-12T05:42:23.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.071+0000 7f45fb7fe700 1 -- 172.21.2.105:0/2323799435 learned_addr learned my addr 172.21.2.105:0/2323799435 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:23.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.071+0000 7f45faffd700 1 --2- 172.21.2.105:0/2323799435 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f45fc0626b0 0x7f45fc0b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:23.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.071+0000 7f45fa7fc700 1 --2- 172.21.2.105:0/2323799435 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f45fc0af750 0x7f45fc0662f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:23.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.071+0000 7f45fb7fe700 1 -- 172.21.2.105:0/2323799435 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f45fc0af750 msgr2=0x7f45fc0662f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:23.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.071+0000 7f45fb7fe700 1 --2- 172.21.2.105:0/2323799435 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f45fc0af750 0x7f45fc0662f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:23.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.071+0000 7f45fb7fe700 1 -- 172.21.2.105:0/2323799435 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f45fc0626b0 msgr2=0x7f45fc0b3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:23.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.071+0000 7f45fb7fe700 1 --2- 172.21.2.105:0/2323799435 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f45fc0626b0 0x7f45fc0b3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:23.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.071+0000 7f45fb7fe700 1 -- 172.21.2.105:0/2323799435 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f000b1e0 con 0x7f45fc130a80 2021-11-12T05:42:23.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.071+0000 7f45fb7fe700 1 --2- 172.21.2.105:0/2323799435 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f45fc130a80 0x7f45fc0667e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f45f400c000 tx=0x7f45f40091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:23.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.071+0000 7f45ebfff700 1 -- 172.21.2.105:0/2323799435 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45f4012600 con 0x7f45fc130a80 2021-11-12T05:42:23.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.075+0000 7f45ebfff700 1 -- 172.21.2.105:0/2323799435 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f4012760 con 0x7f45fc130a80 2021-11-12T05:42:23.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.075+0000 7f4601441700 1 -- 172.21.2.105:0/2323799435 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45fc0644e0 con 0x7f45fc130a80 2021-11-12T05:42:23.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.075+0000 7f45ebfff700 1 -- 172.21.2.105:0/2323799435 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45f4012ac0 con 0x7f45fc130a80 2021-11-12T05:42:23.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.075+0000 7f4601441700 1 -- 172.21.2.105:0/2323799435 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45fc066e70 con 0x7f45fc130a80 2021-11-12T05:42:23.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.075+0000 7f4601441700 1 -- 172.21.2.105:0/2323799435 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45fc0646d0 con 0x7f45fc130a80 2021-11-12T05:42:23.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.075+0000 7f45ebfff700 1 -- 172.21.2.105:0/2323799435 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f45f4012c20 con 0x7f45fc130a80 2021-11-12T05:42:23.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.075+0000 7f45ebfff700 1 --2- 172.21.2.105:0/2323799435 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f45d8053610 0x7f45d8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:23.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.075+0000 7f45ebfff700 1 -- 172.21.2.105:0/2323799435 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f45f406b8d0 con 0x7f45fc130a80 2021-11-12T05:42:23.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.075+0000 7f45faffd700 1 --2- 172.21.2.105:0/2323799435 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f45d8053610 0x7f45d8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:23.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.075+0000 7f45faffd700 1 --2- 172.21.2.105:0/2323799435 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f45d8053610 0x7f45d8055ad0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f45ec00d000 tx=0x7f45ec007b50).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:23.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.075+0000 7f45ebfff700 1 -- 172.21.2.105:0/2323799435 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f45f4042bb0 con 0x7f45fc130a80 2021-11-12T05:42:23.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:23.167+0000 7f4601441700 1 -- 172.21.2.105:0/2323799435 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f45fc0648d0 con 0x7f45fc130a80 2021-11-12T05:42:24.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.079+0000 7f45ebfff700 1 -- 172.21.2.105:0/2323799435 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v40) v1 ==== 97+0+0 (secure 0 0 0) 0x7f45f4016020 con 0x7f45fc130a80 2021-11-12T05:42:24.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.087+0000 7f4601441700 1 -- 172.21.2.105:0/2323799435 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f45d8053610 msgr2=0x7f45d8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:24.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.087+0000 7f4601441700 1 --2- 172.21.2.105:0/2323799435 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f45d8053610 0x7f45d8055ad0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f45ec00d000 tx=0x7f45ec007b50).stop 2021-11-12T05:42:24.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.087+0000 7f4601441700 1 -- 172.21.2.105:0/2323799435 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f45fc130a80 msgr2=0x7f45fc0667e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:24.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.087+0000 7f4601441700 1 --2- 172.21.2.105:0/2323799435 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f45fc130a80 0x7f45fc0667e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f45f400c000 tx=0x7f45f40091d0).stop 2021-11-12T05:42:24.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.087+0000 7f4601441700 1 -- 172.21.2.105:0/2323799435 shutdown_connections 2021-11-12T05:42:24.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.087+0000 7f4601441700 1 --2- 172.21.2.105:0/2323799435 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f45d8053610 0x7f45d8055ad0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:24.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.087+0000 7f4601441700 1 --2- 172.21.2.105:0/2323799435 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f45fc130a80 0x7f45fc0667e0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:24.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.087+0000 7f4601441700 1 --2- 172.21.2.105:0/2323799435 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f45fc0af750 0x7f45fc0662f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:24.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.087+0000 7f4601441700 1 --2- 172.21.2.105:0/2323799435 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f45fc0626b0 0x7f45fc0b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:24.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.087+0000 7f4601441700 1 -- 172.21.2.105:0/2323799435 >> 172.21.2.105:0/2323799435 conn(0x7f45fc0b5320 msgr2=0x7f45fc0b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:24.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.087+0000 7f4601441700 1 -- 172.21.2.105:0/2323799435 shutdown_connections 2021-11-12T05:42:24.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.087+0000 7f4601441700 1 -- 172.21.2.105:0/2323799435 wait complete. 2021-11-12T05:42:24.094 INFO:teuthology.orchestra.run.gibba005.stderr: removed all blacklist entries 2021-11-12T05:42:24.118 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-11-12T05:42:24.119 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-11-12T05:42:24.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.227+0000 7f0d96c0a700 1 Processor -- start 2021-11-12T05:42:24.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.227+0000 7f0d96c0a700 1 -- start start 2021-11-12T05:42:24.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.227+0000 7f0d96c0a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d900626b0 0x7f0d90062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:24.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.227+0000 7f0d96c0a700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f0d90130a80 0x7f0d901474d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:24.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.227+0000 7f0d96c0a700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d900b0d50 con 0x7f0d900af750 2021-11-12T05:42:24.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.227+0000 7f0d96c0a700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d900ad380 con 0x7f0d90130a80 2021-11-12T05:42:24.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.227+0000 7f0d96c0a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d900ae190 con 0x7f0d900626b0 2021-11-12T05:42:24.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.227+0000 7f0d8ffff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f0d900af750 0x7f0d90130370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:55240/0 (socket says 172.21.2.105:55240) 2021-11-12T05:42:24.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.227+0000 7f0d8ffff700 1 -- 172.21.2.105:0/3748285679 learned_addr learned my addr 172.21.2.105:0/3748285679 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:42:24.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.227+0000 7f0d8f7fe700 1 -- 172.21.2.105:0/3748285679 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3017276806 0 0) 0x7f0d900b0d50 con 0x7f0d900af750 2021-11-12T05:42:24.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.227+0000 7f0d8f7fe700 1 -- 172.21.2.105:0/3748285679 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d70003260 con 0x7f0d900af750 2021-11-12T05:42:24.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.227+0000 7f0d949a6700 1 --2- 172.21.2.105:0/3748285679 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d900626b0 0x7f0d90062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:24.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.227+0000 7f0d951a7700 1 --2- 172.21.2.105:0/3748285679 >> v2:172.21.2.115:3300/0 conn(0x7f0d90130a80 0x7f0d901474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:24.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.227+0000 7f0d8f7fe700 1 -- 172.21.2.105:0/3748285679 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 503110336 0 0) 0x7f0d70003260 con 0x7f0d900af750 2021-11-12T05:42:24.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.227+0000 7f0d8f7fe700 1 -- 172.21.2.105:0/3748285679 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d900626b0 msgr2=0x7f0d90062a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:24.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.227+0000 7f0d8f7fe700 1 --2- 172.21.2.105:0/3748285679 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d900626b0 0x7f0d90062a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:24.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.227+0000 7f0d8f7fe700 1 -- 172.21.2.105:0/3748285679 >> v2:172.21.2.115:3300/0 conn(0x7f0d90130a80 msgr2=0x7f0d901474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:24.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.227+0000 7f0d8f7fe700 1 --2- 172.21.2.105:0/3748285679 >> v2:172.21.2.115:3300/0 conn(0x7f0d90130a80 0x7f0d901474d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:24.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.227+0000 7f0d8f7fe700 1 -- 172.21.2.105:0/3748285679 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d900ae2d0 con 0x7f0d900af750 2021-11-12T05:42:24.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.227+0000 7f0d8f7fe700 1 -- 172.21.2.105:0/3748285679 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f0d80001660 con 0x7f0d900af750 2021-11-12T05:42:24.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.227+0000 7f0d8f7fe700 1 -- 172.21.2.105:0/3748285679 >> v1:172.21.2.105:6789/0 conn(0x7f0d900af750 legacy=0x7f0d90130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:24.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.227+0000 7f0d8f7fe700 1 --2- 172.21.2.105:0/3748285679 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0d70003750 0x7f0d70003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:24.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d8f7fe700 1 --2- 172.21.2.105:0/3748285679 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d900626b0 0x7f0d70004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:24.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d8f7fe700 1 --2- 172.21.2.105:0/3748285679 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d70004b10 0x7f0d70004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:24.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d8f7fe700 1 -- 172.21.2.105:0/3748285679 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d900ad380 con 0x7f0d70004b10 2021-11-12T05:42:24.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d8f7fe700 1 -- 172.21.2.105:0/3748285679 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d900ae190 con 0x7f0d70003750 2021-11-12T05:42:24.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d8f7fe700 1 -- 172.21.2.105:0/3748285679 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7000b990 con 0x7f0d900626b0 2021-11-12T05:42:24.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d951a7700 1 --2- 172.21.2.105:0/3748285679 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d70004b10 0x7f0d70004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:24.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d951a7700 1 -- 172.21.2.105:0/3748285679 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d900626b0 msgr2=0x7f0d70004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:24.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d951a7700 1 --2- 172.21.2.105:0/3748285679 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d900626b0 0x7f0d70004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:24.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d951a7700 1 -- 172.21.2.105:0/3748285679 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0d70003750 msgr2=0x7f0d70003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:24.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d951a7700 1 --2- 172.21.2.105:0/3748285679 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0d70003750 0x7f0d70003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:24.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d951a7700 1 -- 172.21.2.105:0/3748285679 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d70003260 con 0x7f0d70004b10 2021-11-12T05:42:24.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d951a7700 1 --2- 172.21.2.105:0/3748285679 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d70004b10 0x7f0d70004f90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f0d88007000 tx=0x7f0d88008040).ready entity=mon.0 client_cookie=b36e047faa1d5098 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:24.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d8f7fe700 1 -- 172.21.2.105:0/3748285679 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d8800c640 con 0x7f0d70004b10 2021-11-12T05:42:24.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d8f7fe700 1 -- 172.21.2.105:0/3748285679 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d8800c7a0 con 0x7f0d70004b10 2021-11-12T05:42:24.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d8f7fe700 1 -- 172.21.2.105:0/3748285679 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d8800cb00 con 0x7f0d70004b10 2021-11-12T05:42:24.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d96c0a700 1 -- 172.21.2.105:0/3748285679 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d70004b10 msgr2=0x7f0d70004f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:24.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d96c0a700 1 --2- 172.21.2.105:0/3748285679 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d70004b10 0x7f0d70004f90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f0d88007000 tx=0x7f0d88008040).stop 2021-11-12T05:42:24.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d951a7700 1 -- 172.21.2.105:0/3748285679 reap_dead start 2021-11-12T05:42:24.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d96c0a700 1 -- 172.21.2.105:0/3748285679 shutdown_connections 2021-11-12T05:42:24.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d96c0a700 1 -- 172.21.2.105:0/3748285679 >> 172.21.2.105:0/3748285679 conn(0x7f0d900b5320 msgr2=0x7f0d900b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:24.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d96c0a700 1 -- 172.21.2.105:0/3748285679 shutdown_connections 2021-11-12T05:42:24.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d96c0a700 1 -- 172.21.2.105:0/3748285679 wait complete. 2021-11-12T05:42:24.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d96c0a700 1 Processor -- start 2021-11-12T05:42:24.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d96c0a700 1 -- start start 2021-11-12T05:42:24.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d96c0a700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0d70004b10 0x7f0d90131da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:24.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d96c0a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d90064970 0x7f0d90132290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:24.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d96c0a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d90063d90 0x7f0d90064240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:24.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d96c0a700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9012e0c0 con 0x7f0d90064970 2021-11-12T05:42:24.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d96c0a700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d90156480 con 0x7f0d70004b10 2021-11-12T05:42:24.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d96c0a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d90157560 con 0x7f0d90063d90 2021-11-12T05:42:24.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d8ffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d90064970 0x7f0d90132290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:24.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d8ffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d90064970 0x7f0d90132290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44860/0 (socket says 172.21.2.105:44860) 2021-11-12T05:42:24.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d8ffff700 1 -- 172.21.2.105:0/4083434199 learned_addr learned my addr 172.21.2.105:0/4083434199 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:24.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d949a6700 1 --2- 172.21.2.105:0/4083434199 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0d70004b10 0x7f0d90131da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:24.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d951a7700 1 --2- 172.21.2.105:0/4083434199 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d90063d90 0x7f0d90064240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:24.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d8ffff700 1 -- 172.21.2.105:0/4083434199 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d90063d90 msgr2=0x7f0d90064240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:24.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d8ffff700 1 --2- 172.21.2.105:0/4083434199 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d90063d90 0x7f0d90064240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:24.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d8ffff700 1 -- 172.21.2.105:0/4083434199 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0d70004b10 msgr2=0x7f0d90131da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:24.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d8ffff700 1 --2- 172.21.2.105:0/4083434199 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0d70004b10 0x7f0d90131da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:24.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d8ffff700 1 -- 172.21.2.105:0/4083434199 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d90157020 con 0x7f0d90064970 2021-11-12T05:42:24.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d8ffff700 1 --2- 172.21.2.105:0/4083434199 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d90064970 0x7f0d90132290 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f0d90131950 tx=0x7f0d80001b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:24.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d8dffb700 1 -- 172.21.2.105:0/4083434199 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d80007170 con 0x7f0d90064970 2021-11-12T05:42:24.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d8dffb700 1 -- 172.21.2.105:0/4083434199 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d800072d0 con 0x7f0d90064970 2021-11-12T05:42:24.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d96c0a700 1 -- 172.21.2.105:0/4083434199 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d901572c0 con 0x7f0d90064970 2021-11-12T05:42:24.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d8dffb700 1 -- 172.21.2.105:0/4083434199 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d80004920 con 0x7f0d90064970 2021-11-12T05:42:24.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d96c0a700 1 -- 172.21.2.105:0/4083434199 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d900b3e10 con 0x7f0d90064970 2021-11-12T05:42:24.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.231+0000 7f0d96c0a700 1 -- 172.21.2.105:0/4083434199 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d90065730 con 0x7f0d90064970 2021-11-12T05:42:24.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.235+0000 7f0d8dffb700 1 -- 172.21.2.105:0/4083434199 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0d80004a80 con 0x7f0d90064970 2021-11-12T05:42:24.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.235+0000 7f0d8dffb700 1 --2- 172.21.2.105:0/4083434199 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0d740534f0 0x7f0d740559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:24.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.235+0000 7f0d8dffb700 1 -- 172.21.2.105:0/4083434199 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f0d8006b3b0 con 0x7f0d90064970 2021-11-12T05:42:24.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.235+0000 7f0d949a6700 1 --2- 172.21.2.105:0/4083434199 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0d740534f0 0x7f0d740559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:24.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.235+0000 7f0d949a6700 1 --2- 172.21.2.105:0/4083434199 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0d740534f0 0x7f0d740559b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f0d7800b000 tx=0x7f0d78008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:24.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.235+0000 7f0d8dffb700 1 -- 172.21.2.105:0/4083434199 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0d800425e0 con 0x7f0d90064970 2021-11-12T05:42:24.290 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:42:24.293 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:42:24.296 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:42:24.299 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:42:24.302 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:42:24.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.347+0000 7f0d96c0a700 1 -- 172.21.2.105:0/4083434199 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f0d900ae2d0 con 0x7f0d90064970 2021-11-12T05:42:24.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.347+0000 7f0d8dffb700 1 -- 172.21.2.105:0/4083434199 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+4242 (secure 0 0 0) 0x7f0d900ae2d0 con 0x7f0d90064970 2021-11-12T05:42:24.352 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:42:24.352 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:42:24.353 INFO:teuthology.orchestra.run.gibba005.stdout: "auth_dump": [ 2021-11-12T05:42:24.353 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:24.353 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mds.a", 2021-11-12T05:42:24.353 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1hGVLeOhAAX2029T+USC1Um93TSzjxdA==", 2021-11-12T05:42:24.354 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:42:24.354 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:42:24.354 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:42:24.354 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:42:24.354 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:42:24.355 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:24.355 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:24.355 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:24.355 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mds.b", 2021-11-12T05:42:24.356 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hiebUAxAAGcjDAGyvecjzagGoRBX8tg==", 2021-11-12T05:42:24.356 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:42:24.356 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:42:24.356 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:42:24.356 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:42:24.357 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:42:24.357 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:24.357 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:24.357 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:24.357 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.0", 2021-11-12T05:42:24.358 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1ht05fORAAN2YrbsxBau1FQC4C8Dvb3g==", 2021-11-12T05:42:24.358 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:42:24.358 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:42:24.358 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:42:24.359 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:42:24.359 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:24.359 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:24.360 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:24.360 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.1", 2021-11-12T05:42:24.360 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAu/o1hzp1vGhAAQ6u3Npb+yNGlNOUdoHzFZA==", 2021-11-12T05:42:24.360 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:42:24.360 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:42:24.361 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:42:24.361 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:42:24.361 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:24.361 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:24.362 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:24.362 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.2", 2021-11-12T05:42:24.362 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAw/o1hHWwOOhAAx7txWG8rbch18+SBnJkfkQ==", 2021-11-12T05:42:24.362 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:42:24.362 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:42:24.363 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:42:24.363 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:42:24.363 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:24.363 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:24.364 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:24.364 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.3", 2021-11-12T05:42:24.364 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAz/o1howZpHxAAKgUVxU2tSNZbxW+6OfJF9g==", 2021-11-12T05:42:24.364 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:42:24.364 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:42:24.365 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:42:24.365 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:42:24.365 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:24.365 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:24.365 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:24.366 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.4", 2021-11-12T05:42:24.366 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA2/o1humA5KRAAVbO6UYLOBQDq3WiEkkS6xw==", 2021-11-12T05:42:24.366 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:42:24.367 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:42:24.367 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:42:24.367 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:42:24.368 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:24.368 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:24.368 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:24.368 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.5", 2021-11-12T05:42:24.368 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA5/o1hALdKDRAAR9nsaDOo9GUgpmBPHVp5HQ==", 2021-11-12T05:42:24.369 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:42:24.369 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:42:24.369 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:42:24.369 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:42:24.370 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:24.370 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:24.370 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:24.371 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.6", 2021-11-12T05:42:24.371 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA7/o1hCVP2KhAAHj5SxnJ81mKrJOg2CE2wLQ==", 2021-11-12T05:42:24.371 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:42:24.371 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:42:24.371 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:42:24.372 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:42:24.372 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:24.372 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:24.372 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:24.372 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.7", 2021-11-12T05:42:24.373 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA+/o1hWCEqEBAAv8nF9NeF2Ue5W8Ijj8Skgg==", 2021-11-12T05:42:24.373 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:42:24.373 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:42:24.373 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:42:24.374 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:42:24.374 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:24.374 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:24.374 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:24.374 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.0", 2021-11-12T05:42:24.375 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hzEzhCBAATF8giEBtrj13SAr5EJV4TA==", 2021-11-12T05:42:24.375 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:42:24.375 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:42:24.376 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow r", 2021-11-12T05:42:24.376 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-12T05:42:24.376 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:24.376 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:24.376 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:24.377 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.1", 2021-11-12T05:42:24.377 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hO6zfCxAAae1obagtpsnA9e8FlTExVA==", 2021-11-12T05:42:24.377 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:42:24.377 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:42:24.377 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow r", 2021-11-12T05:42:24.378 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-12T05:42:24.378 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:24.378 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:24.378 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:24.379 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.2", 2021-11-12T05:42:24.379 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hFYDGDhAAyz77VXKtOz86ztJ8FUIvAg==", 2021-11-12T05:42:24.379 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:42:24.379 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:42:24.379 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow r", 2021-11-12T05:42:24.380 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-12T05:42:24.380 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:24.380 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:24.380 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:24.381 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.admin", 2021-11-12T05:42:24.381 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1hwdoBHRAAUHHEU3dbyso2BnE/JppV8A==", 2021-11-12T05:42:24.381 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:42:24.381 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow *", 2021-11-12T05:42:24.381 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:42:24.382 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:42:24.382 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:42:24.382 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:24.382 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:24.383 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:24.383 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mgr.x", 2021-11-12T05:42:24.383 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1h6JBaORAAbgxQtCzGNj7MLfgwGd4cWA==", 2021-11-12T05:42:24.383 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:42:24.383 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow *", 2021-11-12T05:42:24.384 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow profile mgr", 2021-11-12T05:42:24.384 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:42:24.384 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:24.385 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:24.385 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:24.385 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mgr.y", 2021-11-12T05:42:24.385 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1hwfvvNRAASU7NmYBG/Yb6/ma1/Ew7mw==", 2021-11-12T05:42:24.386 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:42:24.386 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow *", 2021-11-12T05:42:24.386 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow profile mgr", 2021-11-12T05:42:24.386 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:42:24.386 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:24.387 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:24.387 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:42:24.387 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:42:24.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.347+0000 7f0d96c0a700 1 -- 172.21.2.105:0/4083434199 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0d740534f0 msgr2=0x7f0d740559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:24.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.347+0000 7f0d96c0a700 1 --2- 172.21.2.105:0/4083434199 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0d740534f0 0x7f0d740559b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f0d7800b000 tx=0x7f0d78008040).stop 2021-11-12T05:42:24.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.347+0000 7f0d96c0a700 1 -- 172.21.2.105:0/4083434199 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d90064970 msgr2=0x7f0d90132290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:24.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.347+0000 7f0d96c0a700 1 --2- 172.21.2.105:0/4083434199 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d90064970 0x7f0d90132290 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f0d90131950 tx=0x7f0d80001b30).stop 2021-11-12T05:42:24.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.347+0000 7f0d96c0a700 1 -- 172.21.2.105:0/4083434199 shutdown_connections 2021-11-12T05:42:24.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.347+0000 7f0d96c0a700 1 --2- 172.21.2.105:0/4083434199 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0d740534f0 0x7f0d740559b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:24.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.347+0000 7f0d96c0a700 1 --2- 172.21.2.105:0/4083434199 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d90063d90 0x7f0d90064240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:24.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.347+0000 7f0d96c0a700 1 --2- 172.21.2.105:0/4083434199 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d90064970 0x7f0d90132290 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:24.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.347+0000 7f0d96c0a700 1 --2- 172.21.2.105:0/4083434199 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0d70004b10 0x7f0d90131da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:24.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.347+0000 7f0d96c0a700 1 -- 172.21.2.105:0/4083434199 >> 172.21.2.105:0/4083434199 conn(0x7f0d900b5320 msgr2=0x7f0d9014a860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:24.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.347+0000 7f0d96c0a700 1 -- 172.21.2.105:0/4083434199 shutdown_connections 2021-11-12T05:42:24.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.347+0000 7f0d96c0a700 1 -- 172.21.2.105:0/4083434199 wait complete. 2021-11-12T05:42:24.392 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:42:24.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.507+0000 7fd1557af700 1 Processor -- start 2021-11-12T05:42:24.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.507+0000 7fd1557af700 1 -- start start 2021-11-12T05:42:24.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.507+0000 7fd1557af700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd1500b5ac0 0x7fd1500b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:24.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.507+0000 7fd1557af700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd1500b01b0 0x7fd1500ae470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:24.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.507+0000 7fd1557af700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1500b5ea0 con 0x7fd1500ae960 2021-11-12T05:42:24.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.507+0000 7fd1557af700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1500b1a60 con 0x7fd1500b01b0 2021-11-12T05:42:24.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.507+0000 7fd1557af700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1500accd0 con 0x7fd1500b5ac0 2021-11-12T05:42:24.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.507+0000 7fd14e7fc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd1500b01b0 0x7fd1500ae470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:24.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.507+0000 7fd14e7fc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd1500b01b0 0x7fd1500ae470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44868/0 (socket says 172.21.2.105:44868) 2021-11-12T05:42:24.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.507+0000 7fd14e7fc700 1 -- 172.21.2.105:0/543341517 learned_addr learned my addr 172.21.2.105:0/543341517 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:24.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.507+0000 7fd14e7fc700 1 -- 172.21.2.105:0/543341517 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd1500b5ac0 msgr2=0x7fd1500b13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:24.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.507+0000 7fd14e7fc700 1 --2- 172.21.2.105:0/543341517 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd1500b5ac0 0x7fd1500b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:24.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.507+0000 7fd14e7fc700 1 -- 172.21.2.105:0/543341517 >> v1:172.21.2.115:6789/0 conn(0x7fd1500ae960 legacy=0x7fd1500b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:24.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.507+0000 7fd14e7fc700 1 -- 172.21.2.105:0/543341517 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1500acf70 con 0x7fd1500b01b0 2021-11-12T05:42:24.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.507+0000 7fd14e7fc700 1 --2- 172.21.2.105:0/543341517 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1500b01b0 0x7fd1500ae470 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7fd1500b0810 tx=0x7fd140006f40).ready entity=mon.0 client_cookie=aa52434554367cd7 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:24.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.507+0000 7fd14dffb700 1 -- 172.21.2.105:0/543341517 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd140010070 con 0x7fd1500b01b0 2021-11-12T05:42:24.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.507+0000 7fd14dffb700 1 -- 172.21.2.105:0/543341517 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd140000e90 con 0x7fd1500b01b0 2021-11-12T05:42:24.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.507+0000 7fd14dffb700 1 -- 172.21.2.105:0/543341517 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd140008860 con 0x7fd1500b01b0 2021-11-12T05:42:24.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.507+0000 7fd1557af700 1 -- 172.21.2.105:0/543341517 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1500b01b0 msgr2=0x7fd1500ae470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:24.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.507+0000 7fd1557af700 1 --2- 172.21.2.105:0/543341517 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1500b01b0 0x7fd1500ae470 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7fd1500b0810 tx=0x7fd140006f40).stop 2021-11-12T05:42:24.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.507+0000 7fd1557af700 1 -- 172.21.2.105:0/543341517 shutdown_connections 2021-11-12T05:42:24.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.507+0000 7fd1557af700 1 --2- 172.21.2.105:0/543341517 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1500b01b0 0x7fd1500ae470 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:24.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.507+0000 7fd1557af700 1 --2- 172.21.2.105:0/543341517 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd1500b5ac0 0x7fd1500b13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:24.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.507+0000 7fd1557af700 1 -- 172.21.2.105:0/543341517 >> 172.21.2.105:0/543341517 conn(0x7fd1500628b0 msgr2=0x7fd150062c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:24.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.507+0000 7fd1557af700 1 -- 172.21.2.105:0/543341517 shutdown_connections 2021-11-12T05:42:24.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.507+0000 7fd1557af700 1 -- 172.21.2.105:0/543341517 wait complete. 2021-11-12T05:42:24.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.511+0000 7fd1557af700 1 Processor -- start 2021-11-12T05:42:24.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.511+0000 7fd1557af700 1 -- start start 2021-11-12T05:42:24.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.511+0000 7fd1557af700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd1500ae960 0x7fd150157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:24.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.511+0000 7fd1557af700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1500b01b0 0x7fd1501417c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:24.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.511+0000 7fd1557af700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd1500b5ac0 0x7fd150157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:24.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.511+0000 7fd1557af700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15013a740 con 0x7fd1500b01b0 2021-11-12T05:42:24.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.511+0000 7fd1557af700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15013c8f0 con 0x7fd1500ae960 2021-11-12T05:42:24.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.511+0000 7fd1557af700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd150063990 con 0x7fd1500b5ac0 2021-11-12T05:42:24.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.511+0000 7fd14e7fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1500b01b0 0x7fd1501417c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:24.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.511+0000 7fd14e7fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1500b01b0 0x7fd1501417c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44872/0 (socket says 172.21.2.105:44872) 2021-11-12T05:42:24.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.511+0000 7fd14e7fc700 1 -- 172.21.2.105:0/3966291608 learned_addr learned my addr 172.21.2.105:0/3966291608 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:24.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.511+0000 7fd14e7fc700 1 -- 172.21.2.105:0/3966291608 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd1500b5ac0 msgr2=0x7fd150157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:24.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.511+0000 7fd14e7fc700 1 --2- 172.21.2.105:0/3966291608 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd1500b5ac0 0x7fd150157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:24.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.511+0000 7fd14e7fc700 1 -- 172.21.2.105:0/3966291608 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd1500ae960 msgr2=0x7fd150157030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:24.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.511+0000 7fd14e7fc700 1 --2- 172.21.2.105:0/3966291608 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd1500ae960 0x7fd150157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:24.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.511+0000 7fd14e7fc700 1 -- 172.21.2.105:0/3966291608 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd140008240 con 0x7fd1500b01b0 2021-11-12T05:42:24.526 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.511+0000 7fd14e7fc700 1 --2- 172.21.2.105:0/3966291608 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1500b01b0 0x7fd1501417c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7fd1500b0810 tx=0x7fd140006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:24.526 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.511+0000 7fd13ffff700 1 -- 172.21.2.105:0/3966291608 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd14000b2d0 con 0x7fd1500b01b0 2021-11-12T05:42:24.526 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.511+0000 7fd13ffff700 1 -- 172.21.2.105:0/3966291608 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14000b430 con 0x7fd1500b01b0 2021-11-12T05:42:24.526 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.511+0000 7fd1557af700 1 -- 172.21.2.105:0/3966291608 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd15013db80 con 0x7fd1500b01b0 2021-11-12T05:42:24.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.511+0000 7fd13ffff700 1 -- 172.21.2.105:0/3966291608 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd14000b790 con 0x7fd1500b01b0 2021-11-12T05:42:24.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.511+0000 7fd1557af700 1 -- 172.21.2.105:0/3966291608 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd15013cd60 con 0x7fd1500b01b0 2021-11-12T05:42:24.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.511+0000 7fd1557af700 1 -- 172.21.2.105:0/3966291608 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd15013caf0 con 0x7fd1500b01b0 2021-11-12T05:42:24.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.511+0000 7fd13ffff700 1 -- 172.21.2.105:0/3966291608 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd140025030 con 0x7fd1500b01b0 2021-11-12T05:42:24.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.511+0000 7fd13ffff700 1 --2- 172.21.2.105:0/3966291608 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd12c053520 0x7fd12c0559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:24.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.511+0000 7fd13ffff700 1 -- 172.21.2.105:0/3966291608 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fd14006c490 con 0x7fd1500b01b0 2021-11-12T05:42:24.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.511+0000 7fd14effd700 1 --2- 172.21.2.105:0/3966291608 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd12c053520 0x7fd12c0559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:24.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.511+0000 7fd14effd700 1 --2- 172.21.2.105:0/3966291608 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd12c053520 0x7fd12c0559e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fd144002f70 tx=0x7fd1440069e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:24.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.515+0000 7fd13ffff700 1 -- 172.21.2.105:0/3966291608 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd140043850 con 0x7fd1500b01b0 2021-11-12T05:42:24.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.595+0000 7fd1557af700 1 -- 172.21.2.105:0/3966291608 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1500b1830 con 0x7fd1500b01b0 2021-11-12T05:42:24.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.599+0000 7fd13ffff700 1 -- 172.21.2.105:0/3966291608 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+13414 (secure 0 0 0) 0x7fd140046df0 con 0x7fd1500b01b0 2021-11-12T05:42:24.603 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:42:24.603 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":40,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:42:24.075287+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:42:24.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.599+0000 7fd1557af700 1 -- 172.21.2.105:0/3966291608 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd12c053520 msgr2=0x7fd12c0559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:24.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.599+0000 7fd1557af700 1 --2- 172.21.2.105:0/3966291608 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd12c053520 0x7fd12c0559e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fd144002f70 tx=0x7fd1440069e0).stop 2021-11-12T05:42:24.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.599+0000 7fd1557af700 1 -- 172.21.2.105:0/3966291608 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1500b01b0 msgr2=0x7fd1501417c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:24.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.599+0000 7fd1557af700 1 --2- 172.21.2.105:0/3966291608 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1500b01b0 0x7fd1501417c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7fd1500b0810 tx=0x7fd140006f40).stop 2021-11-12T05:42:24.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.599+0000 7fd1557af700 1 -- 172.21.2.105:0/3966291608 shutdown_connections 2021-11-12T05:42:24.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.599+0000 7fd1557af700 1 --2- 172.21.2.105:0/3966291608 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd12c053520 0x7fd12c0559e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:24.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.599+0000 7fd1557af700 1 --2- 172.21.2.105:0/3966291608 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd1500b5ac0 0x7fd150157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:24.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.599+0000 7fd1557af700 1 --2- 172.21.2.105:0/3966291608 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1500b01b0 0x7fd1501417c0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:24.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.599+0000 7fd1557af700 1 --2- 172.21.2.105:0/3966291608 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd1500ae960 0x7fd150157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:24.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.599+0000 7fd1557af700 1 -- 172.21.2.105:0/3966291608 >> 172.21.2.105:0/3966291608 conn(0x7fd1500628b0 msgr2=0x7fd15013fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:24.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.599+0000 7fd1557af700 1 -- 172.21.2.105:0/3966291608 shutdown_connections 2021-11-12T05:42:24.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.599+0000 7fd1557af700 1 -- 172.21.2.105:0/3966291608 wait complete. 2021-11-12T05:42:24.610 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-12T05:42:24.611 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:42:24.664 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.659+0000 7f0a95126700 1 Processor -- start 2021-11-12T05:42:24.664 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.659+0000 7f0a95126700 1 -- start start 2021-11-12T05:42:24.666 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.659+0000 7f0a95126700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f0a900aca40 0x7f0a900ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:24.666 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.659+0000 7f0a95126700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0a900b0520 0x7f0a901473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:24.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.659+0000 7f0a95126700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f0a901478b0 0x7f0a90144180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:24.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.659+0000 7f0a95126700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a90147d40 con 0x7f0a901478b0 2021-11-12T05:42:24.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.659+0000 7f0a95126700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a900b1840 con 0x7f0a900aca40 2021-11-12T05:42:24.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.659+0000 7f0a95126700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a900af2b0 con 0x7f0a900b0520 2021-11-12T05:42:24.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.659+0000 7f0a8f59e700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f0a901478b0 0x7f0a90144180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:24.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.659+0000 7f0a8f59e700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f0a901478b0 0x7f0a90144180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44882/0 (socket says 172.21.2.105:44882) 2021-11-12T05:42:24.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.659+0000 7f0a8f59e700 1 -- 172.21.2.105:0/1370951832 learned_addr learned my addr 172.21.2.105:0/1370951832 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:24.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.659+0000 7f0a8f59e700 1 -- 172.21.2.105:0/1370951832 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0a900b0520 msgr2=0x7f0a901473c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:42:24.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.659+0000 7f0a8f59e700 1 --2- 172.21.2.105:0/1370951832 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0a900b0520 0x7f0a901473c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:24.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.659+0000 7f0a8f59e700 1 -- 172.21.2.105:0/1370951832 >> v2:172.21.2.115:3300/0 conn(0x7f0a900aca40 msgr2=0x7f0a900ace20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:42:24.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.659+0000 7f0a8f59e700 1 --2- 172.21.2.105:0/1370951832 >> v2:172.21.2.115:3300/0 conn(0x7f0a900aca40 0x7f0a900ace20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:24.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.659+0000 7f0a8f59e700 1 -- 172.21.2.105:0/1370951832 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a900b09a0 con 0x7f0a901478b0 2021-11-12T05:42:24.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.659+0000 7f0a8f59e700 1 --2- 172.21.2.105:0/1370951832 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a901478b0 0x7f0a90144180 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f0a880032f0 tx=0x7f0a88009290).ready entity=mon.0 client_cookie=150044ffb5634932 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:24.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.659+0000 7f0a8dd9b700 1 -- 172.21.2.105:0/1370951832 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a8800b870 con 0x7f0a901478b0 2021-11-12T05:42:24.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.659+0000 7f0a8dd9b700 1 -- 172.21.2.105:0/1370951832 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8800b9d0 con 0x7f0a901478b0 2021-11-12T05:42:24.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.659+0000 7f0a8dd9b700 1 -- 172.21.2.105:0/1370951832 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a8800bb80 con 0x7f0a901478b0 2021-11-12T05:42:24.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.659+0000 7f0a95126700 1 -- 172.21.2.105:0/1370951832 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a901478b0 msgr2=0x7f0a90144180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:24.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.663+0000 7f0a95126700 1 --2- 172.21.2.105:0/1370951832 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a901478b0 0x7f0a90144180 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f0a880032f0 tx=0x7f0a88009290).stop 2021-11-12T05:42:24.671 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.663+0000 7f0a95126700 1 -- 172.21.2.105:0/1370951832 shutdown_connections 2021-11-12T05:42:24.671 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.663+0000 7f0a95126700 1 --2- 172.21.2.105:0/1370951832 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a901478b0 0x7f0a90144180 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:24.671 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.663+0000 7f0a95126700 1 --2- 172.21.2.105:0/1370951832 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0a900b0520 0x7f0a901473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:24.671 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.663+0000 7f0a95126700 1 --2- 172.21.2.105:0/1370951832 >> v2:172.21.2.115:3300/0 conn(0x7f0a900aca40 0x7f0a900ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:24.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.663+0000 7f0a95126700 1 -- 172.21.2.105:0/1370951832 >> 172.21.2.105:0/1370951832 conn(0x7f0a9005c490 msgr2=0x7f0a900b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:24.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.663+0000 7f0a95126700 1 -- 172.21.2.105:0/1370951832 shutdown_connections 2021-11-12T05:42:24.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.663+0000 7f0a95126700 1 -- 172.21.2.105:0/1370951832 wait complete. 2021-11-12T05:42:24.675 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.663+0000 7f0a95126700 1 Processor -- start 2021-11-12T05:42:24.675 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.663+0000 7f0a95126700 1 -- start start 2021-11-12T05:42:24.675 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.663+0000 7f0a95126700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a900aca40 0x7f0a90062bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:24.675 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.663+0000 7f0a95126700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0a900b0520 0x7f0a90157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:24.676 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.663+0000 7f0a95126700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0a901478b0 0x7f0a90149620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:24.676 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.663+0000 7f0a95126700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a90156930 con 0x7f0a900aca40 2021-11-12T05:42:24.676 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.663+0000 7f0a95126700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a90156bd0 con 0x7f0a901478b0 2021-11-12T05:42:24.676 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.663+0000 7f0a95126700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a90157800 con 0x7f0a900b0520 2021-11-12T05:42:24.676 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.663+0000 7f0a8ed9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a900aca40 0x7f0a90062bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:24.677 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.663+0000 7f0a8ed9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a900aca40 0x7f0a90062bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44884/0 (socket says 172.21.2.105:44884) 2021-11-12T05:42:24.677 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.663+0000 7f0a8ed9d700 1 -- 172.21.2.105:0/1786964004 learned_addr learned my addr 172.21.2.105:0/1786964004 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:24.677 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.663+0000 7f0a8ed9d700 1 -- 172.21.2.105:0/1786964004 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0a900b0520 msgr2=0x7f0a90157310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:24.677 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.663+0000 7f0a8ed9d700 1 --2- 172.21.2.105:0/1786964004 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0a900b0520 0x7f0a90157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:24.678 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.663+0000 7f0a8ed9d700 1 -- 172.21.2.105:0/1786964004 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0a901478b0 msgr2=0x7f0a90149620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:24.678 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.663+0000 7f0a8ed9d700 1 --2- 172.21.2.105:0/1786964004 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0a901478b0 0x7f0a90149620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:24.678 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.663+0000 7f0a8ed9d700 1 -- 172.21.2.105:0/1786964004 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a88009530 con 0x7f0a900aca40 2021-11-12T05:42:24.678 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.663+0000 7f0a8ed9d700 1 --2- 172.21.2.105:0/1786964004 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a900aca40 0x7f0a90062bd0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f0a78002fb0 tx=0x7f0a78006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:24.678 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.663+0000 7f0a87fff700 1 -- 172.21.2.105:0/1786964004 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a78013460 con 0x7f0a900aca40 2021-11-12T05:42:24.679 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.663+0000 7f0a87fff700 1 -- 172.21.2.105:0/1786964004 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a780135c0 con 0x7f0a900aca40 2021-11-12T05:42:24.679 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.663+0000 7f0a95126700 1 -- 172.21.2.105:0/1786964004 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a900ac280 con 0x7f0a900aca40 2021-11-12T05:42:24.679 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.663+0000 7f0a87fff700 1 -- 172.21.2.105:0/1786964004 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a78013920 con 0x7f0a900aca40 2021-11-12T05:42:24.679 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.663+0000 7f0a95126700 1 -- 172.21.2.105:0/1786964004 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a900674b0 con 0x7f0a900aca40 2021-11-12T05:42:24.680 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.663+0000 7f0a95126700 1 -- 172.21.2.105:0/1786964004 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a90057350 con 0x7f0a900aca40 2021-11-12T05:42:24.680 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.663+0000 7f0a87fff700 1 -- 172.21.2.105:0/1786964004 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0a7800f070 con 0x7f0a900aca40 2021-11-12T05:42:24.680 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.663+0000 7f0a87fff700 1 --2- 172.21.2.105:0/1786964004 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0a740536a0 0x7f0a74055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:24.680 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.663+0000 7f0a87fff700 1 -- 172.21.2.105:0/1786964004 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f0a7806b180 con 0x7f0a900aca40 2021-11-12T05:42:24.680 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.663+0000 7f0a8e59c700 1 --2- 172.21.2.105:0/1786964004 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0a740536a0 0x7f0a74055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:24.681 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.663+0000 7f0a8e59c700 1 --2- 172.21.2.105:0/1786964004 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0a740536a0 0x7f0a74055b60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f0a80002fb0 tx=0x7f0a800069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:24.681 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.667+0000 7f0a87fff700 1 -- 172.21.2.105:0/1786964004 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0a780424c0 con 0x7f0a900aca40 2021-11-12T05:42:24.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.751+0000 7f0a95126700 1 -- 172.21.2.105:0/1786964004 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0a9006a280 con 0x7f0a900aca40 2021-11-12T05:42:24.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.755+0000 7f0a87fff700 1 -- 172.21.2.105:0/1786964004 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v40) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0a78045ae0 con 0x7f0a900aca40 2021-11-12T05:42:24.759 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:42:24.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.755+0000 7f0a95126700 1 -- 172.21.2.105:0/1786964004 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0a740536a0 msgr2=0x7f0a74055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:24.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.755+0000 7f0a95126700 1 --2- 172.21.2.105:0/1786964004 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0a740536a0 0x7f0a74055b60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f0a80002fb0 tx=0x7f0a800069b0).stop 2021-11-12T05:42:24.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.755+0000 7f0a95126700 1 -- 172.21.2.105:0/1786964004 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a900aca40 msgr2=0x7f0a90062bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:24.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.755+0000 7f0a95126700 1 --2- 172.21.2.105:0/1786964004 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a900aca40 0x7f0a90062bd0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f0a78002fb0 tx=0x7f0a78006df0).stop 2021-11-12T05:42:24.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.755+0000 7f0a95126700 1 -- 172.21.2.105:0/1786964004 shutdown_connections 2021-11-12T05:42:24.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.755+0000 7f0a95126700 1 --2- 172.21.2.105:0/1786964004 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0a740536a0 0x7f0a74055b60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:24.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.755+0000 7f0a95126700 1 --2- 172.21.2.105:0/1786964004 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0a901478b0 0x7f0a90149620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:24.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.755+0000 7f0a95126700 1 --2- 172.21.2.105:0/1786964004 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0a900b0520 0x7f0a90157310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:24.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.755+0000 7f0a95126700 1 --2- 172.21.2.105:0/1786964004 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a900aca40 0x7f0a90062bd0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:24.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.755+0000 7f0a95126700 1 -- 172.21.2.105:0/1786964004 >> 172.21.2.105:0/1786964004 conn(0x7f0a9005c490 msgr2=0x7f0a9005bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:24.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.755+0000 7f0a95126700 1 -- 172.21.2.105:0/1786964004 shutdown_connections 2021-11-12T05:42:24.763 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.755+0000 7f0a95126700 1 -- 172.21.2.105:0/1786964004 wait complete. 2021-11-12T05:42:24.766 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:42:24.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.815+0000 7f5f9c542700 1 Processor -- start 2021-11-12T05:42:24.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.815+0000 7f5f9c542700 1 -- start start 2021-11-12T05:42:24.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.815+0000 7f5f9c542700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5f940b7b00 0x7f5f94140d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:24.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.815+0000 7f5f9c542700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f5f940ae090 0x7f5f940b2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:24.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.815+0000 7f5f9c542700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f940b7ee0 con 0x7f5f940b2f00 2021-11-12T05:42:24.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.815+0000 7f5f9c542700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f940b2030 con 0x7f5f940ae090 2021-11-12T05:42:24.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.815+0000 7f5f9c542700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f940b22d0 con 0x7f5f940b7b00 2021-11-12T05:42:24.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.815+0000 7f5f99add700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f5f940ae090 0x7f5f940b2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:24.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.815+0000 7f5f9a2de700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5f940b7b00 0x7f5f94140d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:24.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.815+0000 7f5f9a2de700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5f940b7b00 0x7f5f94140d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3301/0 says I am v2:172.21.2.105:36082/0 (socket says 172.21.2.105:36082) 2021-11-12T05:42:24.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.815+0000 7f5f99add700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f5f940ae090 0x7f5f940b2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3300/0 says I am v2:172.21.2.105:33838/0 (socket says 172.21.2.105:33838) 2021-11-12T05:42:24.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.815+0000 7f5f9a2de700 1 -- 172.21.2.105:0/3204597717 learned_addr learned my addr 172.21.2.105:0/3204597717 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:24.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.815+0000 7f5f9aadf700 1 --1- 172.21.2.105:0/3204597717 >> v1:172.21.2.115:6789/0 conn(0x7f5f940b2f00 0x7f5f94144390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:53758/0 (socket says 172.21.2.105:53758) 2021-11-12T05:42:24.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.815+0000 7f5f9a2de700 1 -- 172.21.2.105:0/3204597717 >> v2:172.21.2.115:3300/0 conn(0x7f5f940ae090 msgr2=0x7f5f940b2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:24.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.815+0000 7f5f9a2de700 1 --2- 172.21.2.105:0/3204597717 >> v2:172.21.2.115:3300/0 conn(0x7f5f940ae090 0x7f5f940b2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:24.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.815+0000 7f5f9a2de700 1 -- 172.21.2.105:0/3204597717 >> v1:172.21.2.115:6789/0 conn(0x7f5f940b2f00 legacy=0x7f5f94144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:24.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.815+0000 7f5f9a2de700 1 -- 172.21.2.105:0/3204597717 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f940b2570 con 0x7f5f940b7b00 2021-11-12T05:42:24.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.819+0000 7f5f9a2de700 1 --2- 172.21.2.105:0/3204597717 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5f940b7b00 0x7f5f94140d80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f5f88002f70 tx=0x7f5f88006eb0).ready entity=mon.2 client_cookie=c5e9174afc4f782d server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:24.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.819+0000 7f5f992dc700 1 -- 172.21.2.105:0/3204597717 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f8800d570 con 0x7f5f940b7b00 2021-11-12T05:42:24.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.819+0000 7f5f992dc700 1 -- 172.21.2.105:0/3204597717 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f88000e90 con 0x7f5f940b7b00 2021-11-12T05:42:24.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.819+0000 7f5f992dc700 1 -- 172.21.2.105:0/3204597717 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f8800d900 con 0x7f5f940b7b00 2021-11-12T05:42:24.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.819+0000 7f5f9c542700 1 -- 172.21.2.105:0/3204597717 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5f940b7b00 msgr2=0x7f5f94140d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:24.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.819+0000 7f5f9c542700 1 --2- 172.21.2.105:0/3204597717 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5f940b7b00 0x7f5f94140d80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f5f88002f70 tx=0x7f5f88006eb0).stop 2021-11-12T05:42:24.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.819+0000 7f5f9c542700 1 -- 172.21.2.105:0/3204597717 shutdown_connections 2021-11-12T05:42:24.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.819+0000 7f5f9c542700 1 --2- 172.21.2.105:0/3204597717 >> v2:172.21.2.115:3300/0 conn(0x7f5f940ae090 0x7f5f940b2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:24.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.819+0000 7f5f9c542700 1 --2- 172.21.2.105:0/3204597717 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5f940b7b00 0x7f5f94140d80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:24.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.819+0000 7f5f9c542700 1 -- 172.21.2.105:0/3204597717 >> 172.21.2.105:0/3204597717 conn(0x7f5f940608d0 msgr2=0x7f5f9405c490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:24.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.819+0000 7f5f9c542700 1 -- 172.21.2.105:0/3204597717 shutdown_connections 2021-11-12T05:42:24.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.819+0000 7f5f9c542700 1 -- 172.21.2.105:0/3204597717 wait complete. 2021-11-12T05:42:24.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.819+0000 7f5f9c542700 1 Processor -- start 2021-11-12T05:42:24.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.819+0000 7f5f9c542700 1 -- start start 2021-11-12T05:42:24.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.819+0000 7f5f9c542700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5f940ae090 0x7f5f94129e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:24.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.819+0000 7f5f9c542700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5f940b2f00 0x7f5f941432f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:24.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.819+0000 7f5f9c542700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5f940b7b00 0x7f5f941437e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:24.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.819+0000 7f5f9c542700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9413ddc0 con 0x7f5f940ae090 2021-11-12T05:42:24.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.819+0000 7f5f9c542700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9413e060 con 0x7f5f940b2f00 2021-11-12T05:42:24.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.819+0000 7f5f9c542700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f940b0430 con 0x7f5f940b7b00 2021-11-12T05:42:24.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.819+0000 7f5f9a2de700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5f940ae090 0x7f5f94129e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:24.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.819+0000 7f5f9a2de700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5f940ae090 0x7f5f94129e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44898/0 (socket says 172.21.2.105:44898) 2021-11-12T05:42:24.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.819+0000 7f5f9a2de700 1 -- 172.21.2.105:0/793640709 learned_addr learned my addr 172.21.2.105:0/793640709 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:24.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.819+0000 7f5f9a2de700 1 -- 172.21.2.105:0/793640709 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5f940b7b00 msgr2=0x7f5f941437e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:24.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.819+0000 7f5f9a2de700 1 --2- 172.21.2.105:0/793640709 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5f940b7b00 0x7f5f941437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:24.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.819+0000 7f5f9a2de700 1 -- 172.21.2.105:0/793640709 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5f940b2f00 msgr2=0x7f5f941432f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:24.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.819+0000 7f5f9a2de700 1 --2- 172.21.2.105:0/793640709 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5f940b2f00 0x7f5f941432f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:24.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.819+0000 7f5f9a2de700 1 -- 172.21.2.105:0/793640709 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f8800b1e0 con 0x7f5f940ae090 2021-11-12T05:42:24.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.819+0000 7f5f9a2de700 1 --2- 172.21.2.105:0/793640709 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5f940ae090 0x7f5f94129e80 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f5f88002f70 tx=0x7f5f88015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:24.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.819+0000 7f5f877fe700 1 -- 172.21.2.105:0/793640709 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f880068b0 con 0x7f5f940ae090 2021-11-12T05:42:24.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.819+0000 7f5f877fe700 1 -- 172.21.2.105:0/793640709 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8800d8f0 con 0x7f5f940ae090 2021-11-12T05:42:24.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.819+0000 7f5f9c542700 1 -- 172.21.2.105:0/793640709 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f940b06d0 con 0x7f5f940ae090 2021-11-12T05:42:24.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.819+0000 7f5f877fe700 1 -- 172.21.2.105:0/793640709 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f8801e460 con 0x7f5f940ae090 2021-11-12T05:42:24.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.819+0000 7f5f9c542700 1 -- 172.21.2.105:0/793640709 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f940aef50 con 0x7f5f940ae090 2021-11-12T05:42:24.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.823+0000 7f5f9c542700 1 -- 172.21.2.105:0/793640709 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f94057350 con 0x7f5f940ae090 2021-11-12T05:42:24.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.823+0000 7f5f877fe700 1 -- 172.21.2.105:0/793640709 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5f88025030 con 0x7f5f940ae090 2021-11-12T05:42:24.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.823+0000 7f5f877fe700 1 --2- 172.21.2.105:0/793640709 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5f740536a0 0x7f5f74055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:24.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.823+0000 7f5f877fe700 1 -- 172.21.2.105:0/793640709 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f5f8806caa0 con 0x7f5f940ae090 2021-11-12T05:42:24.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.823+0000 7f5f99add700 1 --2- 172.21.2.105:0/793640709 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5f740536a0 0x7f5f74055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:24.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.823+0000 7f5f99add700 1 --2- 172.21.2.105:0/793640709 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5f740536a0 0x7f5f74055b60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f5f9000c000 tx=0x7f5f90006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:24.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.823+0000 7f5f877fe700 1 -- 172.21.2.105:0/793640709 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5f88043cd0 con 0x7f5f940ae090 2021-11-12T05:42:24.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.907+0000 7f5f9c542700 1 -- 172.21.2.105:0/793640709 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5f9405f280 con 0x7f5f940ae090 2021-11-12T05:42:24.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.907+0000 7f5f877fe700 1 -- 172.21.2.105:0/793640709 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v40) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5f88023020 con 0x7f5f940ae090 2021-11-12T05:42:24.912 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:42:24.913 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.907+0000 7f5f9c542700 1 -- 172.21.2.105:0/793640709 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5f740536a0 msgr2=0x7f5f74055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:24.913 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.907+0000 7f5f9c542700 1 --2- 172.21.2.105:0/793640709 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5f740536a0 0x7f5f74055b60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f5f9000c000 tx=0x7f5f90006df0).stop 2021-11-12T05:42:24.913 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.907+0000 7f5f9c542700 1 -- 172.21.2.105:0/793640709 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5f940ae090 msgr2=0x7f5f94129e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:24.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.907+0000 7f5f9c542700 1 --2- 172.21.2.105:0/793640709 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5f940ae090 0x7f5f94129e80 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f5f88002f70 tx=0x7f5f88015000).stop 2021-11-12T05:42:24.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.907+0000 7f5f9c542700 1 -- 172.21.2.105:0/793640709 shutdown_connections 2021-11-12T05:42:24.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.907+0000 7f5f9c542700 1 --2- 172.21.2.105:0/793640709 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5f740536a0 0x7f5f74055b60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:24.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.907+0000 7f5f9c542700 1 --2- 172.21.2.105:0/793640709 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5f940b7b00 0x7f5f941437e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:24.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.907+0000 7f5f9c542700 1 --2- 172.21.2.105:0/793640709 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5f940b2f00 0x7f5f941432f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:24.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.907+0000 7f5f9c542700 1 --2- 172.21.2.105:0/793640709 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5f940ae090 0x7f5f94129e80 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:24.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.907+0000 7f5f9c542700 1 -- 172.21.2.105:0/793640709 >> 172.21.2.105:0/793640709 conn(0x7f5f940608d0 msgr2=0x7f5f94067200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:24.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.907+0000 7f5f9c542700 1 -- 172.21.2.105:0/793640709 shutdown_connections 2021-11-12T05:42:24.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.907+0000 7f5f9c542700 1 -- 172.21.2.105:0/793640709 wait complete. 2021-11-12T05:42:24.919 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-12T05:42:24.969 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.963+0000 7fb158739700 1 Processor -- start 2021-11-12T05:42:24.969 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.963+0000 7fb158739700 1 -- start start 2021-11-12T05:42:24.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.963+0000 7fb158739700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb1500ac280 0x7fb15014b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:24.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.963+0000 7fb158739700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb1500af730 0x7fb1500ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:24.972 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.963+0000 7fb158739700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1500ac7b0 con 0x7fb1500ad080 2021-11-12T05:42:24.972 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.963+0000 7fb158739700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1501488a0 con 0x7fb1500ac280 2021-11-12T05:42:24.972 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.963+0000 7fb158739700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1500ac9e0 con 0x7fb1500af730 2021-11-12T05:42:24.972 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.963+0000 7fb155cd4700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb1500ac280 0x7fb15014b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:24.973 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.963+0000 7fb155cd4700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb1500ac280 0x7fb15014b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44908/0 (socket says 172.21.2.105:44908) 2021-11-12T05:42:24.973 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.963+0000 7fb155cd4700 1 -- 172.21.2.105:0/2333855549 learned_addr learned my addr 172.21.2.105:0/2333855549 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:24.973 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.967+0000 7fb155cd4700 1 -- 172.21.2.105:0/2333855549 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb1500af730 msgr2=0x7fb1500ad460 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:42:24.973 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.967+0000 7fb155cd4700 1 --2- 172.21.2.105:0/2333855549 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb1500af730 0x7fb1500ad460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:24.974 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.967+0000 7fb155cd4700 1 -- 172.21.2.105:0/2333855549 >> v1:172.21.2.115:6789/0 conn(0x7fb1500ad080 legacy=0x7fb15014abe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:42:24.974 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.967+0000 7fb155cd4700 1 -- 172.21.2.105:0/2333855549 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1500b0b30 con 0x7fb1500ac280 2021-11-12T05:42:24.974 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.967+0000 7fb155cd4700 1 --2- 172.21.2.105:0/2333855549 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb1500ac280 0x7fb15014b2f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7fb1500b6060 tx=0x7fb144006eb0).ready entity=mon.0 client_cookie=9fc7127b0e02f9a3 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:24.974 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.967+0000 7fb1554d3700 1 -- 172.21.2.105:0/2333855549 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb14400d570 con 0x7fb1500ac280 2021-11-12T05:42:24.975 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.967+0000 7fb1554d3700 1 -- 172.21.2.105:0/2333855549 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb144000e90 con 0x7fb1500ac280 2021-11-12T05:42:24.975 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.967+0000 7fb1554d3700 1 -- 172.21.2.105:0/2333855549 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb14400d8c0 con 0x7fb1500ac280 2021-11-12T05:42:24.975 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.967+0000 7fb158739700 1 -- 172.21.2.105:0/2333855549 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb1500ac280 msgr2=0x7fb15014b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:24.975 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.967+0000 7fb158739700 1 --2- 172.21.2.105:0/2333855549 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb1500ac280 0x7fb15014b2f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7fb1500b6060 tx=0x7fb144006eb0).stop 2021-11-12T05:42:24.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.967+0000 7fb158739700 1 -- 172.21.2.105:0/2333855549 shutdown_connections 2021-11-12T05:42:24.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.967+0000 7fb158739700 1 --2- 172.21.2.105:0/2333855549 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb1500af730 0x7fb1500ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:24.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.967+0000 7fb158739700 1 --2- 172.21.2.105:0/2333855549 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb1500ac280 0x7fb15014b2f0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:24.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.967+0000 7fb158739700 1 -- 172.21.2.105:0/2333855549 >> 172.21.2.105:0/2333855549 conn(0x7fb1500b5370 msgr2=0x7fb1500b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:24.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.967+0000 7fb158739700 1 -- 172.21.2.105:0/2333855549 shutdown_connections 2021-11-12T05:42:24.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.967+0000 7fb158739700 1 -- 172.21.2.105:0/2333855549 wait complete. 2021-11-12T05:42:24.979 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.967+0000 7fb158739700 1 Processor -- start 2021-11-12T05:42:24.980 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.967+0000 7fb158739700 1 -- start start 2021-11-12T05:42:24.980 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.967+0000 7fb158739700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb1500ac280 0x7fb150063750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:24.980 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.967+0000 7fb158739700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb1500ad080 0x7fb150063c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:24.981 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.967+0000 7fb158739700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb1500af730 0x7fb1500668e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:24.981 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.967+0000 7fb158739700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb150064130 con 0x7fb1500ac280 2021-11-12T05:42:24.981 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.967+0000 7fb158739700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1500ab5b0 con 0x7fb1500af730 2021-11-12T05:42:24.981 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.967+0000 7fb158739700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1500ab850 con 0x7fb1500ad080 2021-11-12T05:42:24.982 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.967+0000 7fb1564d5700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb1500ac280 0x7fb150063750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:24.982 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.967+0000 7fb1564d5700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb1500ac280 0x7fb150063750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44912/0 (socket says 172.21.2.105:44912) 2021-11-12T05:42:24.982 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.967+0000 7fb1564d5700 1 -- 172.21.2.105:0/631912231 learned_addr learned my addr 172.21.2.105:0/631912231 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:24.982 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.967+0000 7fb1564d5700 1 -- 172.21.2.105:0/631912231 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb1500ad080 msgr2=0x7fb150063c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:24.982 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.967+0000 7fb1564d5700 1 --2- 172.21.2.105:0/631912231 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb1500ad080 0x7fb150063c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:24.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.967+0000 7fb1564d5700 1 -- 172.21.2.105:0/631912231 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb1500af730 msgr2=0x7fb1500668e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:24.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.967+0000 7fb1564d5700 1 --2- 172.21.2.105:0/631912231 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb1500af730 0x7fb1500668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:24.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.967+0000 7fb1564d5700 1 -- 172.21.2.105:0/631912231 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14400b1e0 con 0x7fb1500ac280 2021-11-12T05:42:24.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.967+0000 7fb1564d5700 1 --2- 172.21.2.105:0/631912231 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb1500ac280 0x7fb150063750 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7fb14c002fb0 tx=0x7fb14c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:24.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.967+0000 7fb1437fe700 1 -- 172.21.2.105:0/631912231 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb14c013460 con 0x7fb1500ac280 2021-11-12T05:42:24.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.967+0000 7fb1437fe700 1 -- 172.21.2.105:0/631912231 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb14c0135c0 con 0x7fb1500ac280 2021-11-12T05:42:24.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.967+0000 7fb158739700 1 -- 172.21.2.105:0/631912231 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1500ab2d0 con 0x7fb1500ac280 2021-11-12T05:42:24.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.967+0000 7fb1437fe700 1 -- 172.21.2.105:0/631912231 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb14c013920 con 0x7fb1500ac280 2021-11-12T05:42:24.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.967+0000 7fb158739700 1 -- 172.21.2.105:0/631912231 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1500abcf0 con 0x7fb1500ac280 2021-11-12T05:42:24.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.971+0000 7fb158739700 1 -- 172.21.2.105:0/631912231 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1500aba10 con 0x7fb1500ac280 2021-11-12T05:42:24.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.971+0000 7fb1437fe700 1 -- 172.21.2.105:0/631912231 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb14c00f070 con 0x7fb1500ac280 2021-11-12T05:42:24.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.971+0000 7fb1437fe700 1 --2- 172.21.2.105:0/631912231 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb1300536f0 0x7fb130055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:24.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.971+0000 7fb1437fe700 1 -- 172.21.2.105:0/631912231 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fb14c06b350 con 0x7fb1500ac280 2021-11-12T05:42:24.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.971+0000 7fb155cd4700 1 --2- 172.21.2.105:0/631912231 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb1300536f0 0x7fb130055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:24.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.971+0000 7fb155cd4700 1 --2- 172.21.2.105:0/631912231 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb1300536f0 0x7fb130055bb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fb1500b6060 tx=0x7fb144015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:24.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:24.971+0000 7fb1437fe700 1 -- 172.21.2.105:0/631912231 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb14c042520 con 0x7fb1500ac280 2021-11-12T05:42:25.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.059+0000 7fb158739700 1 -- 172.21.2.105:0/631912231 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb1500b1440 con 0x7fb1500ac280 2021-11-12T05:42:25.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.059+0000 7fb1437fe700 1 -- 172.21.2.105:0/631912231 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v40) v1 ==== 84+0+143 (secure 0 0 0) 0x7fb14c045b40 con 0x7fb1500ac280 2021-11-12T05:42:25.063 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:42:25.063 INFO:teuthology.orchestra.run.gibba005.stdout:[ 2021-11-12T05:42:25.064 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:25.064 INFO:teuthology.orchestra.run.gibba005.stdout: "poolnum": 1, 2021-11-12T05:42:25.064 INFO:teuthology.orchestra.run.gibba005.stdout: "poolname": "device_health_metrics" 2021-11-12T05:42:25.064 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:42:25.064 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:42:25.065 INFO:teuthology.orchestra.run.gibba005.stdout: "poolnum": 2, 2021-11-12T05:42:25.065 INFO:teuthology.orchestra.run.gibba005.stdout: "poolname": "rbd" 2021-11-12T05:42:25.065 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:42:25.065 INFO:teuthology.orchestra.run.gibba005.stdout:] 2021-11-12T05:42:25.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.059+0000 7fb158739700 1 -- 172.21.2.105:0/631912231 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb1300536f0 msgr2=0x7fb130055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:25.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.059+0000 7fb158739700 1 --2- 172.21.2.105:0/631912231 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb1300536f0 0x7fb130055bb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fb1500b6060 tx=0x7fb144015000).stop 2021-11-12T05:42:25.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.059+0000 7fb158739700 1 -- 172.21.2.105:0/631912231 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb1500ac280 msgr2=0x7fb150063750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:25.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.059+0000 7fb158739700 1 --2- 172.21.2.105:0/631912231 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb1500ac280 0x7fb150063750 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7fb14c002fb0 tx=0x7fb14c006df0).stop 2021-11-12T05:42:25.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.059+0000 7fb158739700 1 -- 172.21.2.105:0/631912231 shutdown_connections 2021-11-12T05:42:25.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.059+0000 7fb158739700 1 --2- 172.21.2.105:0/631912231 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb1300536f0 0x7fb130055bb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:25.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.059+0000 7fb158739700 1 --2- 172.21.2.105:0/631912231 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb1500af730 0x7fb1500668e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:25.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.059+0000 7fb158739700 1 --2- 172.21.2.105:0/631912231 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb1500ad080 0x7fb150063c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:25.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.059+0000 7fb158739700 1 --2- 172.21.2.105:0/631912231 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb1500ac280 0x7fb150063750 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:25.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.059+0000 7fb158739700 1 -- 172.21.2.105:0/631912231 >> 172.21.2.105:0/631912231 conn(0x7fb1500b5370 msgr2=0x7fb1500ae880 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:25.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.059+0000 7fb158739700 1 -- 172.21.2.105:0/631912231 shutdown_connections 2021-11-12T05:42:25.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.059+0000 7fb158739700 1 -- 172.21.2.105:0/631912231 wait complete. 2021-11-12T05:42:25.070 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-12T05:42:25.071 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-12T05:42:25.124 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.119+0000 7f9327ae8700 1 Processor -- start 2021-11-12T05:42:25.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.119+0000 7f9327ae8700 1 -- start start 2021-11-12T05:42:25.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.119+0000 7f9327ae8700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f93200626b0 0x7f9320062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:25.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.119+0000 7f9327ae8700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9320130a80 0x7f93201474d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:25.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.119+0000 7f9327ae8700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93200b0d50 con 0x7f93200af750 2021-11-12T05:42:25.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.119+0000 7f9327ae8700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93200ad380 con 0x7f93200626b0 2021-11-12T05:42:25.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.119+0000 7f9327ae8700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93200ae190 con 0x7f9320130a80 2021-11-12T05:42:25.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.119+0000 7f9325083700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7f93200af750 0x7f9320130370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:53786/0 (socket says 172.21.2.105:53786) 2021-11-12T05:42:25.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.119+0000 7f9326085700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9320130a80 0x7f93201474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:25.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.119+0000 7f9325083700 1 -- 172.21.2.105:0/3039898285 learned_addr learned my addr 172.21.2.105:0/3039898285 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:42:25.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.119+0000 7f9325884700 1 --2- 172.21.2.105:0/3039898285 >> v2:172.21.2.115:3300/0 conn(0x7f93200626b0 0x7f9320062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:25.129 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.123+0000 7f9326085700 1 -- 172.21.2.105:0/3039898285 >> v2:172.21.2.115:3300/0 conn(0x7f93200626b0 msgr2=0x7f9320062a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:25.129 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.123+0000 7f9326085700 1 --2- 172.21.2.105:0/3039898285 >> v2:172.21.2.115:3300/0 conn(0x7f93200626b0 0x7f9320062a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:25.129 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.123+0000 7f9326085700 1 -- 172.21.2.105:0/3039898285 >> v1:172.21.2.115:6789/0 conn(0x7f93200af750 legacy=0x7f9320130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:25.129 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.123+0000 7f9326085700 1 -- 172.21.2.105:0/3039898285 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93201479c0 con 0x7f9320130a80 2021-11-12T05:42:25.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.123+0000 7f9326085700 1 --2- 172.21.2.105:0/3039898285 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9320130a80 0x7f93201474d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f93180032f0 tx=0x7f93180091d0).ready entity=mon.2 client_cookie=fe837d7edb3fe68 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:25.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.123+0000 7f9324882700 1 -- 172.21.2.105:0/3039898285 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f931800b6c0 con 0x7f9320130a80 2021-11-12T05:42:25.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.123+0000 7f9324882700 1 -- 172.21.2.105:0/3039898285 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931800b820 con 0x7f9320130a80 2021-11-12T05:42:25.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.123+0000 7f9324882700 1 -- 172.21.2.105:0/3039898285 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f931800b990 con 0x7f9320130a80 2021-11-12T05:42:25.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.123+0000 7f9327ae8700 1 -- 172.21.2.105:0/3039898285 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9320130a80 msgr2=0x7f93201474d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:25.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.123+0000 7f9327ae8700 1 --2- 172.21.2.105:0/3039898285 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9320130a80 0x7f93201474d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f93180032f0 tx=0x7f93180091d0).stop 2021-11-12T05:42:25.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.123+0000 7f9327ae8700 1 -- 172.21.2.105:0/3039898285 shutdown_connections 2021-11-12T05:42:25.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.123+0000 7f9327ae8700 1 --2- 172.21.2.105:0/3039898285 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9320130a80 0x7f93201474d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:25.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.123+0000 7f9327ae8700 1 --2- 172.21.2.105:0/3039898285 >> v2:172.21.2.115:3300/0 conn(0x7f93200626b0 0x7f9320062a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:25.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.123+0000 7f9327ae8700 1 -- 172.21.2.105:0/3039898285 >> 172.21.2.105:0/3039898285 conn(0x7f93200b5320 msgr2=0x7f93200b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:25.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.123+0000 7f9327ae8700 1 -- 172.21.2.105:0/3039898285 shutdown_connections 2021-11-12T05:42:25.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.123+0000 7f9327ae8700 1 -- 172.21.2.105:0/3039898285 wait complete. 2021-11-12T05:42:25.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.123+0000 7f9327ae8700 1 Processor -- start 2021-11-12T05:42:25.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.123+0000 7f9327ae8700 1 -- start start 2021-11-12T05:42:25.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.123+0000 7f9327ae8700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f93200626b0 0x7f9320146690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:25.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.123+0000 7f9327ae8700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f93200af750 0x7f932014ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:25.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.123+0000 7f9327ae8700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9320130a80 0x7f9320066520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:25.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.123+0000 7f9327ae8700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932014c7c0 con 0x7f9320130a80 2021-11-12T05:42:25.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.123+0000 7f9327ae8700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932014c520 con 0x7f93200af750 2021-11-12T05:42:25.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.123+0000 7f9327ae8700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9320066080 con 0x7f93200626b0 2021-11-12T05:42:25.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.123+0000 7f9326085700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9320130a80 0x7f9320066520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:25.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.123+0000 7f9326085700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9320130a80 0x7f9320066520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44930/0 (socket says 172.21.2.105:44930) 2021-11-12T05:42:25.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.123+0000 7f9326085700 1 -- 172.21.2.105:0/1596598498 learned_addr learned my addr 172.21.2.105:0/1596598498 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:25.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.123+0000 7f9325884700 1 --2- 172.21.2.105:0/1596598498 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f93200626b0 0x7f9320146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:25.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.123+0000 7f9325083700 1 --2- 172.21.2.105:0/1596598498 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f93200af750 0x7f932014ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:25.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.123+0000 7f9326085700 1 -- 172.21.2.105:0/1596598498 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f93200626b0 msgr2=0x7f9320146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:25.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.123+0000 7f9326085700 1 --2- 172.21.2.105:0/1596598498 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f93200626b0 0x7f9320146690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:25.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.123+0000 7f9326085700 1 -- 172.21.2.105:0/1596598498 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f93200af750 msgr2=0x7f932014ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:25.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.123+0000 7f9326085700 1 --2- 172.21.2.105:0/1596598498 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f93200af750 0x7f932014ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:25.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.123+0000 7f9326085700 1 -- 172.21.2.105:0/1596598498 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9318009470 con 0x7f9320130a80 2021-11-12T05:42:25.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.123+0000 7f9326085700 1 --2- 172.21.2.105:0/1596598498 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9320130a80 0x7f9320066520 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f93180032f0 tx=0x7f9318016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:25.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.123+0000 7f9312ffd700 1 -- 172.21.2.105:0/1596598498 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f931800b6c0 con 0x7f9320130a80 2021-11-12T05:42:25.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.127+0000 7f9312ffd700 1 -- 172.21.2.105:0/1596598498 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9318011e50 con 0x7f9320130a80 2021-11-12T05:42:25.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.127+0000 7f9327ae8700 1 -- 172.21.2.105:0/1596598498 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f932014b040 con 0x7f9320130a80 2021-11-12T05:42:25.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.127+0000 7f9312ffd700 1 -- 172.21.2.105:0/1596598498 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93180107a0 con 0x7f9320130a80 2021-11-12T05:42:25.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.127+0000 7f9327ae8700 1 -- 172.21.2.105:0/1596598498 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f932014c0f0 con 0x7f9320130a80 2021-11-12T05:42:25.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.127+0000 7f9327ae8700 1 -- 172.21.2.105:0/1596598498 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9320063c00 con 0x7f9320130a80 2021-11-12T05:42:25.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.127+0000 7f9312ffd700 1 -- 172.21.2.105:0/1596598498 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f931801e070 con 0x7f9320130a80 2021-11-12T05:42:25.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.127+0000 7f9312ffd700 1 --2- 172.21.2.105:0/1596598498 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f93000536d0 0x7f9300055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:25.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.127+0000 7f9312ffd700 1 -- 172.21.2.105:0/1596598498 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f931806c750 con 0x7f9320130a80 2021-11-12T05:42:25.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.127+0000 7f9325884700 1 --2- 172.21.2.105:0/1596598498 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f93000536d0 0x7f9300055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:25.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.127+0000 7f9325884700 1 --2- 172.21.2.105:0/1596598498 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f93000536d0 0x7f9300055b90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f931c00b000 tx=0x7f931c006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:25.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.127+0000 7f9312ffd700 1 -- 172.21.2.105:0/1596598498 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9320063c00 con 0x7f9320130a80 2021-11-12T05:42:25.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:25.211+0000 7f9327ae8700 1 -- 172.21.2.105:0/1596598498 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f9320063c00 con 0x7f9320130a80 2021-11-12T05:42:26.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.063+0000 7f9312ffd700 1 -- 172.21.2.105:0/1596598498 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v41) v1 ==== 133+0+0 (secure 0 0 0) 0x7f9320063c00 con 0x7f9320130a80 2021-11-12T05:42:26.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.067+0000 7f9327ae8700 1 -- 172.21.2.105:0/1596598498 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f93000536d0 msgr2=0x7f9300055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:26.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.067+0000 7f9327ae8700 1 --2- 172.21.2.105:0/1596598498 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f93000536d0 0x7f9300055b90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f931c00b000 tx=0x7f931c006df0).stop 2021-11-12T05:42:26.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.067+0000 7f9327ae8700 1 -- 172.21.2.105:0/1596598498 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9320130a80 msgr2=0x7f9320066520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:26.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.067+0000 7f9327ae8700 1 --2- 172.21.2.105:0/1596598498 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9320130a80 0x7f9320066520 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f93180032f0 tx=0x7f9318016000).stop 2021-11-12T05:42:26.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.067+0000 7f9327ae8700 1 -- 172.21.2.105:0/1596598498 shutdown_connections 2021-11-12T05:42:26.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.067+0000 7f9327ae8700 1 --2- 172.21.2.105:0/1596598498 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f93000536d0 0x7f9300055b90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:26.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.067+0000 7f9327ae8700 1 --2- 172.21.2.105:0/1596598498 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9320130a80 0x7f9320066520 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:26.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.067+0000 7f9327ae8700 1 --2- 172.21.2.105:0/1596598498 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f93200af750 0x7f932014ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:26.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.067+0000 7f9327ae8700 1 --2- 172.21.2.105:0/1596598498 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f93200626b0 0x7f9320146690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:26.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.067+0000 7f9327ae8700 1 -- 172.21.2.105:0/1596598498 >> 172.21.2.105:0/1596598498 conn(0x7f93200b5320 msgr2=0x7f93200b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:26.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.067+0000 7f9327ae8700 1 -- 172.21.2.105:0/1596598498 shutdown_connections 2021-11-12T05:42:26.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.067+0000 7f9327ae8700 1 -- 172.21.2.105:0/1596598498 wait complete. 2021-11-12T05:42:26.074 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_metadata' created 2021-11-12T05:42:26.077 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-11-12T05:42:26.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.135+0000 7f9b1a0af700 1 Processor -- start 2021-11-12T05:42:26.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.135+0000 7f9b1a0af700 1 -- start start 2021-11-12T05:42:26.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.135+0000 7f9b1a0af700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9b140ace20 0x7f9b140b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:26.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.135+0000 7f9b1a0af700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b140b1840 con 0x7f9b140aca40 2021-11-12T05:42:26.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.135+0000 7f9b1a0af700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b140af2b0 con 0x7f9b14144180 2021-11-12T05:42:26.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.135+0000 7f9b1a0af700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b140ad2a0 con 0x7f9b140ace20 2021-11-12T05:42:26.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.135+0000 7f9b137fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f9b140aca40 0x7f9b141473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:55330/0 (socket says 172.21.2.105:55330) 2021-11-12T05:42:26.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.135+0000 7f9b137fe700 1 -- 172.21.2.105:0/4168181402 learned_addr learned my addr 172.21.2.105:0/4168181402 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:42:26.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.135+0000 7f9b127fc700 1 -- 172.21.2.105:0/4168181402 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1971498303 0 0) 0x7f9b140b1840 con 0x7f9b140aca40 2021-11-12T05:42:26.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.135+0000 7f9b127fc700 1 -- 172.21.2.105:0/4168181402 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b00003260 con 0x7f9b140aca40 2021-11-12T05:42:26.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.135+0000 7f9b12ffd700 1 --2- 172.21.2.105:0/4168181402 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9b140ace20 0x7f9b140b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:26.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.135+0000 7f9b127fc700 1 -- 172.21.2.105:0/4168181402 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1161558986 0 0) 0x7f9b00003260 con 0x7f9b140aca40 2021-11-12T05:42:26.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.135+0000 7f9b127fc700 1 -- 172.21.2.105:0/4168181402 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9b140ace20 msgr2=0x7f9b140b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:26.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.135+0000 7f9b127fc700 1 --2- 172.21.2.105:0/4168181402 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9b140ace20 0x7f9b140b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:26.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.135+0000 7f9b127fc700 1 -- 172.21.2.105:0/4168181402 >> v1:172.21.2.115:6789/0 conn(0x7f9b14144180 legacy=0x7f9b14144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:26.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.135+0000 7f9b127fc700 1 -- 172.21.2.105:0/4168181402 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b140b1a70 con 0x7f9b140aca40 2021-11-12T05:42:26.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.135+0000 7f9b127fc700 1 -- 172.21.2.105:0/4168181402 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f9b08001660 con 0x7f9b140aca40 2021-11-12T05:42:26.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.135+0000 7f9b12ffd700 1 --2- 172.21.2.105:0/4168181402 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9b140ace20 0x7f9b140b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:42:26.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.135+0000 7f9b127fc700 1 -- 172.21.2.105:0/4168181402 >> v1:172.21.2.105:6789/0 conn(0x7f9b140aca40 legacy=0x7f9b141473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:26.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.135+0000 7f9b127fc700 1 --2- 172.21.2.105:0/4168181402 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9b00003800 0x7f9b00003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:26.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.135+0000 7f9b127fc700 1 --2- 172.21.2.105:0/4168181402 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9b00004500 0x7f9b00004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:26.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.135+0000 7f9b127fc700 1 --2- 172.21.2.105:0/4168181402 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9b140ace20 0x7f9b0000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:26.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.135+0000 7f9b127fc700 1 -- 172.21.2.105:0/4168181402 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b00005260 con 0x7f9b00004500 2021-11-12T05:42:26.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.135+0000 7f9b127fc700 1 -- 172.21.2.105:0/4168181402 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b000053d0 con 0x7f9b00003800 2021-11-12T05:42:26.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.135+0000 7f9b127fc700 1 -- 172.21.2.105:0/4168181402 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0000bcc0 con 0x7f9b140ace20 2021-11-12T05:42:26.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.135+0000 7f9b12ffd700 1 --2- 172.21.2.105:0/4168181402 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9b00004500 0x7f9b00004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:26.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.135+0000 7f9b12ffd700 1 -- 172.21.2.105:0/4168181402 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9b140ace20 msgr2=0x7f9b0000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:26.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.135+0000 7f9b12ffd700 1 --2- 172.21.2.105:0/4168181402 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9b140ace20 0x7f9b0000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:26.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.135+0000 7f9b12ffd700 1 -- 172.21.2.105:0/4168181402 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9b00003800 msgr2=0x7f9b00003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:26.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.135+0000 7f9b12ffd700 1 --2- 172.21.2.105:0/4168181402 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9b00003800 0x7f9b00003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:26.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.135+0000 7f9b12ffd700 1 -- 172.21.2.105:0/4168181402 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b00003260 con 0x7f9b00004500 2021-11-12T05:42:26.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b12ffd700 1 --2- 172.21.2.105:0/4168181402 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9b00004500 0x7f9b00004980 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f9b04007000 tx=0x7f9b04008040).ready entity=mon.0 client_cookie=a0cb1d1e6a9f76cb server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:26.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b127fc700 1 -- 172.21.2.105:0/4168181402 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b04011410 con 0x7f9b00004500 2021-11-12T05:42:26.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b127fc700 1 -- 172.21.2.105:0/4168181402 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b04011570 con 0x7f9b00004500 2021-11-12T05:42:26.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b127fc700 1 -- 172.21.2.105:0/4168181402 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b040118d0 con 0x7f9b00004500 2021-11-12T05:42:26.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b1a0af700 1 -- 172.21.2.105:0/4168181402 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9b00004500 msgr2=0x7f9b00004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:26.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b1a0af700 1 --2- 172.21.2.105:0/4168181402 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9b00004500 0x7f9b00004980 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f9b04007000 tx=0x7f9b04008040).stop 2021-11-12T05:42:26.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b13fff700 1 -- 172.21.2.105:0/4168181402 reap_dead start 2021-11-12T05:42:26.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b1a0af700 1 -- 172.21.2.105:0/4168181402 shutdown_connections 2021-11-12T05:42:26.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b1a0af700 1 -- 172.21.2.105:0/4168181402 >> 172.21.2.105:0/4168181402 conn(0x7f9b1405c490 msgr2=0x7f9b140b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:26.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b1a0af700 1 -- 172.21.2.105:0/4168181402 shutdown_connections 2021-11-12T05:42:26.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b1a0af700 1 -- 172.21.2.105:0/4168181402 wait complete. 2021-11-12T05:42:26.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b1a0af700 1 Processor -- start 2021-11-12T05:42:26.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b1a0af700 1 -- start start 2021-11-12T05:42:26.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b1a0af700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9b00004500 0x7f9b14149fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:26.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b1a0af700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9b14065590 0x7f9b14065a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:26.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b1a0af700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9b14065f00 0x7f9b1414af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:26.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b1a0af700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1414d470 con 0x7f9b14065590 2021-11-12T05:42:26.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b1a0af700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1414cd00 con 0x7f9b00004500 2021-11-12T05:42:26.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b1a0af700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1414d6a0 con 0x7f9b14065f00 2021-11-12T05:42:26.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b12ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9b14065590 0x7f9b14065a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:26.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b12ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9b14065590 0x7f9b14065a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44948/0 (socket says 172.21.2.105:44948) 2021-11-12T05:42:26.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b12ffd700 1 -- 172.21.2.105:0/388077661 learned_addr learned my addr 172.21.2.105:0/388077661 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:26.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b137fe700 1 --2- 172.21.2.105:0/388077661 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9b00004500 0x7f9b14149fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:26.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b12ffd700 1 -- 172.21.2.105:0/388077661 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9b14065f00 msgr2=0x7f9b1414af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:26.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b12ffd700 1 --2- 172.21.2.105:0/388077661 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9b14065f00 0x7f9b1414af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:26.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b12ffd700 1 -- 172.21.2.105:0/388077661 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9b00004500 msgr2=0x7f9b14149fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:26.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b12ffd700 1 --2- 172.21.2.105:0/388077661 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9b00004500 0x7f9b14149fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:26.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b12ffd700 1 -- 172.21.2.105:0/388077661 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b14062cd0 con 0x7f9b14065590 2021-11-12T05:42:26.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b137fe700 1 --2- 172.21.2.105:0/388077661 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9b00004500 0x7f9b14149fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:42:26.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b12ffd700 1 --2- 172.21.2.105:0/388077661 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9b14065590 0x7f9b14065a10 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f9b04007000 tx=0x7f9b04008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:26.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b10ff9700 1 -- 172.21.2.105:0/388077661 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b04011410 con 0x7f9b14065590 2021-11-12T05:42:26.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b10ff9700 1 -- 172.21.2.105:0/388077661 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b04000e90 con 0x7f9b14065590 2021-11-12T05:42:26.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b1a0af700 1 -- 172.21.2.105:0/388077661 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b1414c780 con 0x7f9b14065590 2021-11-12T05:42:26.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b10ff9700 1 -- 172.21.2.105:0/388077661 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b04024610 con 0x7f9b14065590 2021-11-12T05:42:26.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b1a0af700 1 -- 172.21.2.105:0/388077661 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b14063340 con 0x7f9b14065590 2021-11-12T05:42:26.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b1a0af700 1 -- 172.21.2.105:0/388077661 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b140b2c90 con 0x7f9b14065590 2021-11-12T05:42:26.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b10ff9700 1 -- 172.21.2.105:0/388077661 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9b0402b070 con 0x7f9b14065590 2021-11-12T05:42:26.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b10ff9700 1 --2- 172.21.2.105:0/388077661 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9af40536a0 0x7f9af4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:26.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b10ff9700 1 -- 172.21.2.105:0/388077661 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5950+0+0 (secure 0 0 0) 0x7f9b0406c740 con 0x7f9b14065590 2021-11-12T05:42:26.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.139+0000 7f9b137fe700 1 --2- 172.21.2.105:0/388077661 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9af40536a0 0x7f9af4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:26.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.143+0000 7f9b137fe700 1 --2- 172.21.2.105:0/388077661 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9af40536a0 0x7f9af4055b60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f9b08008000 tx=0x7f9b08009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:26.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.143+0000 7f9b10ff9700 1 -- 172.21.2.105:0/388077661 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9b04043920 con 0x7f9b14065590 2021-11-12T05:42:26.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:26.227+0000 7f9b1a0af700 1 -- 172.21.2.105:0/388077661 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f9b14063340 con 0x7f9b14065590 2021-11-12T05:42:27.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.075+0000 7f9b10ff9700 1 -- 172.21.2.105:0/388077661 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v42) v1 ==== 125+0+0 (secure 0 0 0) 0x7f9b14063340 con 0x7f9b14065590 2021-11-12T05:42:27.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.079+0000 7f9b1a0af700 1 -- 172.21.2.105:0/388077661 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9af40536a0 msgr2=0x7f9af4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:27.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.079+0000 7f9b1a0af700 1 --2- 172.21.2.105:0/388077661 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9af40536a0 0x7f9af4055b60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f9b08008000 tx=0x7f9b08009040).stop 2021-11-12T05:42:27.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.079+0000 7f9b1a0af700 1 -- 172.21.2.105:0/388077661 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9b14065590 msgr2=0x7f9b14065a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:27.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.079+0000 7f9b1a0af700 1 --2- 172.21.2.105:0/388077661 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9b14065590 0x7f9b14065a10 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f9b04007000 tx=0x7f9b04008040).stop 2021-11-12T05:42:27.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.079+0000 7f9b1a0af700 1 -- 172.21.2.105:0/388077661 shutdown_connections 2021-11-12T05:42:27.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.079+0000 7f9b1a0af700 1 --2- 172.21.2.105:0/388077661 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9af40536a0 0x7f9af4055b60 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:27.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.079+0000 7f9b1a0af700 1 --2- 172.21.2.105:0/388077661 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9b14065f00 0x7f9b1414af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:27.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.079+0000 7f9b1a0af700 1 --2- 172.21.2.105:0/388077661 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9b14065590 0x7f9b14065a10 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:27.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.079+0000 7f9b1a0af700 1 --2- 172.21.2.105:0/388077661 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9b00004500 0x7f9b14149fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:27.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.079+0000 7f9b1a0af700 1 -- 172.21.2.105:0/388077661 >> 172.21.2.105:0/388077661 conn(0x7f9b1405c490 msgr2=0x7f9b140b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:27.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.079+0000 7f9b1a0af700 1 -- 172.21.2.105:0/388077661 shutdown_connections 2021-11-12T05:42:27.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.079+0000 7f9b1a0af700 1 -- 172.21.2.105:0/388077661 wait complete. 2021-11-12T05:42:27.086 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_data' created 2021-11-12T05:42:27.089 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-12T05:42:27.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.139+0000 7fbef1817700 1 Processor -- start 2021-11-12T05:42:27.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.139+0000 7fbef1817700 1 -- start start 2021-11-12T05:42:27.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.139+0000 7fbef1817700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fbeec0b2940 0x7fbeec142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:27.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.139+0000 7fbef1817700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbeec0b0780 0x7fbeec1432b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:27.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.139+0000 7fbef1817700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeec0b2d20 con 0x7fbeec0b0cc0 2021-11-12T05:42:27.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.139+0000 7fbef1817700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeec0b1fc0 con 0x7fbeec0b2940 2021-11-12T05:42:27.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.139+0000 7fbef1817700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeec0b15e0 con 0x7fbeec0b0780 2021-11-12T05:42:27.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.139+0000 7fbeeb7fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fbeec0b0cc0 0x7fbeec13fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:55350/0 (socket says 172.21.2.105:55350) 2021-11-12T05:42:27.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.139+0000 7fbeeb7fe700 1 -- 172.21.2.105:0/288310338 learned_addr learned my addr 172.21.2.105:0/288310338 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:42:27.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.139+0000 7fbee9ffb700 1 -- 172.21.2.105:0/288310338 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1664451436 0 0) 0x7fbeec0b2d20 con 0x7fbeec0b0cc0 2021-11-12T05:42:27.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.139+0000 7fbee9ffb700 1 -- 172.21.2.105:0/288310338 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbecc003260 con 0x7fbeec0b0cc0 2021-11-12T05:42:27.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbee9ffb700 1 -- 172.21.2.105:0/288310338 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3730506628 0 0) 0x7fbecc003260 con 0x7fbeec0b0cc0 2021-11-12T05:42:27.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbee9ffb700 1 -- 172.21.2.105:0/288310338 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbeec0b0780 msgr2=0x7fbeec1432b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:27.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbee9ffb700 1 --2- 172.21.2.105:0/288310338 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbeec0b0780 0x7fbeec1432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:27.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbee9ffb700 1 -- 172.21.2.105:0/288310338 >> v2:172.21.2.115:3300/0 conn(0x7fbeec0b2940 msgr2=0x7fbeec142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:27.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbee9ffb700 1 --2- 172.21.2.105:0/288310338 >> v2:172.21.2.115:3300/0 conn(0x7fbeec0b2940 0x7fbeec142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:27.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbee9ffb700 1 -- 172.21.2.105:0/288310338 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeec0b1880 con 0x7fbeec0b0cc0 2021-11-12T05:42:27.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbee9ffb700 1 -- 172.21.2.105:0/288310338 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fbee40019e0 con 0x7fbeec0b0cc0 2021-11-12T05:42:27.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbee9ffb700 1 -- 172.21.2.105:0/288310338 >> v1:172.21.2.105:6789/0 conn(0x7fbeec0b0cc0 legacy=0x7fbeec13fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:27.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbee9ffb700 1 --2- 172.21.2.105:0/288310338 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbeec0b0780 0x7fbecc0037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:27.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbee9ffb700 1 --2- 172.21.2.105:0/288310338 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbecc003ee0 0x7fbecc004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:27.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbee9ffb700 1 --2- 172.21.2.105:0/288310338 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbecc004bf0 0x7fbecc007730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:27.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbee9ffb700 1 -- 172.21.2.105:0/288310338 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeec0b1fc0 con 0x7fbecc004bf0 2021-11-12T05:42:27.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbee9ffb700 1 -- 172.21.2.105:0/288310338 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeec0b15e0 con 0x7fbecc003ee0 2021-11-12T05:42:27.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbee9ffb700 1 -- 172.21.2.105:0/288310338 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc0053a0 con 0x7fbeec0b0780 2021-11-12T05:42:27.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbeeb7fe700 1 --2- 172.21.2.105:0/288310338 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbecc004bf0 0x7fbecc007730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:27.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbeeaffd700 1 --2- 172.21.2.105:0/288310338 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbeec0b0780 0x7fbecc0037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:27.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbeea7fc700 1 --2- 172.21.2.105:0/288310338 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbecc003ee0 0x7fbecc004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:27.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbeeb7fe700 1 -- 172.21.2.105:0/288310338 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbeec0b0780 msgr2=0x7fbecc0037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:27.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbeeb7fe700 1 --2- 172.21.2.105:0/288310338 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbeec0b0780 0x7fbecc0037d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:27.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbeeb7fe700 1 -- 172.21.2.105:0/288310338 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbecc003ee0 msgr2=0x7fbecc004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:27.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbeeb7fe700 1 --2- 172.21.2.105:0/288310338 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbecc003ee0 0x7fbecc004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:27.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbeeb7fe700 1 -- 172.21.2.105:0/288310338 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbecc003260 con 0x7fbecc004bf0 2021-11-12T05:42:27.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbeeb7fe700 1 --2- 172.21.2.105:0/288310338 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbecc004bf0 0x7fbecc007730 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7fbee40016f0 tx=0x7fbeec0606c0).ready entity=mon.0 client_cookie=2d91b947bdefd735 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:27.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbee9ffb700 1 -- 172.21.2.105:0/288310338 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbee400cc70 con 0x7fbecc004bf0 2021-11-12T05:42:27.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbee9ffb700 1 -- 172.21.2.105:0/288310338 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee400cdd0 con 0x7fbecc004bf0 2021-11-12T05:42:27.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbee9ffb700 1 -- 172.21.2.105:0/288310338 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbee4005b80 con 0x7fbecc004bf0 2021-11-12T05:42:27.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbef1817700 1 -- 172.21.2.105:0/288310338 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbecc004bf0 msgr2=0x7fbecc007730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:27.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbef1817700 1 --2- 172.21.2.105:0/288310338 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbecc004bf0 0x7fbecc007730 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7fbee40016f0 tx=0x7fbeec0606c0).stop 2021-11-12T05:42:27.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbeeb7fe700 1 -- 172.21.2.105:0/288310338 reap_dead start 2021-11-12T05:42:27.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbef1817700 1 -- 172.21.2.105:0/288310338 shutdown_connections 2021-11-12T05:42:27.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbef1817700 1 -- 172.21.2.105:0/288310338 >> 172.21.2.105:0/288310338 conn(0x7fbeec068440 msgr2=0x7fbeec062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:27.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbef1817700 1 -- 172.21.2.105:0/288310338 shutdown_connections 2021-11-12T05:42:27.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbef1817700 1 -- 172.21.2.105:0/288310338 wait complete. 2021-11-12T05:42:27.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbef1817700 1 Processor -- start 2021-11-12T05:42:27.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbef1817700 1 -- start start 2021-11-12T05:42:27.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbef1817700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbecc004bf0 0x7fbeec145470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:27.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbef1817700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbeec141240 0x7fbeec144190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:27.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbef1817700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbeec140d30 0x7fbeec144680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:27.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbef1817700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeec142900 con 0x7fbecc004bf0 2021-11-12T05:42:27.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbef1817700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeec141bb0 con 0x7fbeec140d30 2021-11-12T05:42:27.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbef1817700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeec141910 con 0x7fbeec141240 2021-11-12T05:42:27.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbeeaffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbecc004bf0 0x7fbeec145470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:27.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbeeaffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbecc004bf0 0x7fbeec145470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:44966/0 (socket says 172.21.2.105:44966) 2021-11-12T05:42:27.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbeeaffd700 1 -- 172.21.2.105:0/3499952895 learned_addr learned my addr 172.21.2.105:0/3499952895 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:27.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbeeb7fe700 1 --2- 172.21.2.105:0/3499952895 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbeec140d30 0x7fbeec144680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:27.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbeea7fc700 1 --2- 172.21.2.105:0/3499952895 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbeec141240 0x7fbeec144190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:27.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbeeaffd700 1 -- 172.21.2.105:0/3499952895 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbeec141240 msgr2=0x7fbeec144190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:27.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbeeaffd700 1 --2- 172.21.2.105:0/3499952895 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbeec141240 0x7fbeec144190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:27.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbeeaffd700 1 -- 172.21.2.105:0/3499952895 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbeec140d30 msgr2=0x7fbeec144680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:27.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbeeaffd700 1 --2- 172.21.2.105:0/3499952895 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbeec140d30 0x7fbeec144680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:27.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbeeaffd700 1 -- 172.21.2.105:0/3499952895 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeec145a90 con 0x7fbecc004bf0 2021-11-12T05:42:27.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbeeb7fe700 1 --2- 172.21.2.105:0/3499952895 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbeec140d30 0x7fbeec144680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:42:27.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbeeaffd700 1 --2- 172.21.2.105:0/3499952895 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbecc004bf0 0x7fbeec145470 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fbed400a000 tx=0x7fbed4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:27.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbee3fff700 1 -- 172.21.2.105:0/3499952895 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbed40145f0 con 0x7fbecc004bf0 2021-11-12T05:42:27.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbee3fff700 1 -- 172.21.2.105:0/3499952895 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed400f040 con 0x7fbecc004bf0 2021-11-12T05:42:27.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbef1817700 1 -- 172.21.2.105:0/3499952895 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeec14e3e0 con 0x7fbecc004bf0 2021-11-12T05:42:27.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbee3fff700 1 -- 172.21.2.105:0/3499952895 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbed4014940 con 0x7fbecc004bf0 2021-11-12T05:42:27.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbef1817700 1 -- 172.21.2.105:0/3499952895 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeec144d10 con 0x7fbecc004bf0 2021-11-12T05:42:27.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.143+0000 7fbef1817700 1 -- 172.21.2.105:0/3499952895 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeec0b1b20 con 0x7fbecc004bf0 2021-11-12T05:42:27.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.147+0000 7fbee3fff700 1 -- 172.21.2.105:0/3499952895 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbed4014aa0 con 0x7fbecc004bf0 2021-11-12T05:42:27.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.147+0000 7fbee3fff700 1 --2- 172.21.2.105:0/3499952895 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbed0053610 0x7fbed0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:27.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.147+0000 7fbee3fff700 1 -- 172.21.2.105:0/3499952895 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6300+0+0 (secure 0 0 0) 0x7fbed406b770 con 0x7fbecc004bf0 2021-11-12T05:42:27.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.147+0000 7fbeea7fc700 1 --2- 172.21.2.105:0/3499952895 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbed0053610 0x7fbed0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:27.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.147+0000 7fbeea7fc700 1 --2- 172.21.2.105:0/3499952895 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbed0053610 0x7fbed0055ad0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fbedc00c000 tx=0x7fbedc008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:27.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.147+0000 7fbee3fff700 1 -- 172.21.2.105:0/3499952895 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbed40426e0 con 0x7fbecc004bf0 2021-11-12T05:42:27.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.259+0000 7fbef1817700 1 -- 172.21.2.105:0/3499952895 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fbeec057350 con 0x7fbecc004bf0 2021-11-12T05:42:27.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.263+0000 7fbee3fff700 1 -- 172.21.2.105:0/3499952895 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 7 and data pool 8 v14) v1 ==== 187+0+0 (secure 0 0 0) 0x7fbed4045d00 con 0x7fbecc004bf0 2021-11-12T05:42:27.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.267+0000 7fbef1817700 1 -- 172.21.2.105:0/3499952895 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbed0053610 msgr2=0x7fbed0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:27.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.267+0000 7fbef1817700 1 --2- 172.21.2.105:0/3499952895 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbed0053610 0x7fbed0055ad0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fbedc00c000 tx=0x7fbedc008040).stop 2021-11-12T05:42:27.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.267+0000 7fbef1817700 1 -- 172.21.2.105:0/3499952895 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbecc004bf0 msgr2=0x7fbeec145470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:27.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.267+0000 7fbef1817700 1 --2- 172.21.2.105:0/3499952895 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbecc004bf0 0x7fbeec145470 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fbed400a000 tx=0x7fbed4008040).stop 2021-11-12T05:42:27.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.267+0000 7fbef1817700 1 -- 172.21.2.105:0/3499952895 shutdown_connections 2021-11-12T05:42:27.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.267+0000 7fbef1817700 1 --2- 172.21.2.105:0/3499952895 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbed0053610 0x7fbed0055ad0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:27.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.267+0000 7fbef1817700 1 --2- 172.21.2.105:0/3499952895 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbeec140d30 0x7fbeec144680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:27.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.267+0000 7fbef1817700 1 --2- 172.21.2.105:0/3499952895 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbeec141240 0x7fbeec144190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:27.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.267+0000 7fbef1817700 1 --2- 172.21.2.105:0/3499952895 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbecc004bf0 0x7fbeec145470 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:27.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.267+0000 7fbef1817700 1 -- 172.21.2.105:0/3499952895 >> 172.21.2.105:0/3499952895 conn(0x7fbeec068440 msgr2=0x7fbeec0ae740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:27.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.267+0000 7fbef1817700 1 -- 172.21.2.105:0/3499952895 shutdown_connections 2021-11-12T05:42:27.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.267+0000 7fbef1817700 1 -- 172.21.2.105:0/3499952895 wait complete. 2021-11-12T05:42:27.274 INFO:teuthology.orchestra.run.gibba005.stderr:new fs with metadata pool 7 and data pool 8 2021-11-12T05:42:27.279 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:42:27.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.323+0000 7fe75fe37700 1 Processor -- start 2021-11-12T05:42:27.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.323+0000 7fe75fe37700 1 -- start start 2021-11-12T05:42:27.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.323+0000 7fe75fe37700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe7580ac280 0x7fe75814b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:27.336 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.323+0000 7fe75fe37700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fe7580af730 0x7fe7580ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:27.336 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.323+0000 7fe75fe37700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7580ac7b0 con 0x7fe7580ad080 2021-11-12T05:42:27.336 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.323+0000 7fe75fe37700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7581488a0 con 0x7fe7580af730 2021-11-12T05:42:27.336 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.323+0000 7fe75fe37700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7580ac9e0 con 0x7fe7580ac280 2021-11-12T05:42:27.336 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.323+0000 7fe75dbd3700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fe7580ad080 0x7fe75814abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:55380/0 (socket says 172.21.2.105:55380) 2021-11-12T05:42:27.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.323+0000 7fe75dbd3700 1 -- 172.21.2.105:0/1032414553 learned_addr learned my addr 172.21.2.105:0/1032414553 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:42:27.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.323+0000 7fe75cbd1700 1 -- 172.21.2.105:0/1032414553 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3119810360 0 0) 0x7fe7580ac7b0 con 0x7fe7580ad080 2021-11-12T05:42:27.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75cbd1700 1 -- 172.21.2.105:0/1032414553 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe740003260 con 0x7fe7580ad080 2021-11-12T05:42:27.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75cbd1700 1 -- 172.21.2.105:0/1032414553 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3821983290 0 0) 0x7fe740003260 con 0x7fe7580ad080 2021-11-12T05:42:27.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75cbd1700 1 -- 172.21.2.105:0/1032414553 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe7580ac280 msgr2=0x7fe75814b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:27.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75cbd1700 1 --2- 172.21.2.105:0/1032414553 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe7580ac280 0x7fe75814b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:27.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75cbd1700 1 -- 172.21.2.105:0/1032414553 >> v2:172.21.2.115:3300/0 conn(0x7fe7580af730 msgr2=0x7fe7580ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:27.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75cbd1700 1 --2- 172.21.2.105:0/1032414553 >> v2:172.21.2.115:3300/0 conn(0x7fe7580af730 0x7fe7580ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:27.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75cbd1700 1 -- 172.21.2.105:0/1032414553 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7580b0b30 con 0x7fe7580ad080 2021-11-12T05:42:27.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75cbd1700 1 -- 172.21.2.105:0/1032414553 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fe754001680 con 0x7fe7580ad080 2021-11-12T05:42:27.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75cbd1700 1 -- 172.21.2.105:0/1032414553 >> v1:172.21.2.105:6789/0 conn(0x7fe7580ad080 legacy=0x7fe75814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:27.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75cbd1700 1 --2- 172.21.2.105:0/1032414553 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe7400037d0 0x7fe740003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:27.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75cbd1700 1 --2- 172.21.2.105:0/1032414553 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe740004500 0x7fe740004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:27.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75cbd1700 1 --2- 172.21.2.105:0/1032414553 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe7580ac280 0x7fe74000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:27.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75cbd1700 1 -- 172.21.2.105:0/1032414553 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7581488a0 con 0x7fe7400037d0 2021-11-12T05:42:27.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75cbd1700 1 -- 172.21.2.105:0/1032414553 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7580ac9e0 con 0x7fe740004500 2021-11-12T05:42:27.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75cbd1700 1 -- 172.21.2.105:0/1032414553 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe740005300 con 0x7fe7580ac280 2021-11-12T05:42:27.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75dbd3700 1 --2- 172.21.2.105:0/1032414553 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe7400037d0 0x7fe740003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:27.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75dbd3700 1 -- 172.21.2.105:0/1032414553 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe7580ac280 msgr2=0x7fe74000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:27.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75dbd3700 1 --2- 172.21.2.105:0/1032414553 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe7580ac280 0x7fe74000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:27.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75dbd3700 1 -- 172.21.2.105:0/1032414553 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe740004500 msgr2=0x7fe740004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:27.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75dbd3700 1 --2- 172.21.2.105:0/1032414553 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe740004500 0x7fe740004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:27.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75dbd3700 1 -- 172.21.2.105:0/1032414553 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe740003260 con 0x7fe7400037d0 2021-11-12T05:42:27.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75dbd3700 1 --2- 172.21.2.105:0/1032414553 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe7400037d0 0x7fe740003bf0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7fe754001390 tx=0x7fe7580aeb90).ready entity=mon.0 client_cookie=eb52e545714c9a1c server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:27.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75cbd1700 1 -- 172.21.2.105:0/1032414553 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe754007170 con 0x7fe7400037d0 2021-11-12T05:42:27.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75cbd1700 1 -- 172.21.2.105:0/1032414553 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7540072d0 con 0x7fe7400037d0 2021-11-12T05:42:27.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75cbd1700 1 -- 172.21.2.105:0/1032414553 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe75400c8c0 con 0x7fe7400037d0 2021-11-12T05:42:27.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75fe37700 1 -- 172.21.2.105:0/1032414553 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe7400037d0 msgr2=0x7fe740003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:27.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75fe37700 1 --2- 172.21.2.105:0/1032414553 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe7400037d0 0x7fe740003bf0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7fe754001390 tx=0x7fe7580aeb90).stop 2021-11-12T05:42:27.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75e3d4700 1 -- 172.21.2.105:0/1032414553 reap_dead start 2021-11-12T05:42:27.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75fe37700 1 -- 172.21.2.105:0/1032414553 shutdown_connections 2021-11-12T05:42:27.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75fe37700 1 -- 172.21.2.105:0/1032414553 >> 172.21.2.105:0/1032414553 conn(0x7fe7580b5370 msgr2=0x7fe7580b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:27.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75fe37700 1 -- 172.21.2.105:0/1032414553 shutdown_connections 2021-11-12T05:42:27.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75fe37700 1 -- 172.21.2.105:0/1032414553 wait complete. 2021-11-12T05:42:27.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75fe37700 1 Processor -- start 2021-11-12T05:42:27.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75fe37700 1 -- start start 2021-11-12T05:42:27.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75fe37700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe7400037d0 0x7fe7580abb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:27.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75fe37700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe7580a86b0 0x7fe7580aa150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:27.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75fe37700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe7580aa640 0x7fe7580aaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:27.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75fe37700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7580a8200 con 0x7fe7580a86b0 2021-11-12T05:42:27.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75fe37700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75814e2a0 con 0x7fe7580aa640 2021-11-12T05:42:27.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75fe37700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7580a8b10 con 0x7fe7400037d0 2021-11-12T05:42:27.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75d3d2700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe7580a86b0 0x7fe7580aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:27.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75d3d2700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe7580a86b0 0x7fe7580aa150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45000/0 (socket says 172.21.2.105:45000) 2021-11-12T05:42:27.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75d3d2700 1 -- 172.21.2.105:0/4186925428 learned_addr learned my addr 172.21.2.105:0/4186925428 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:27.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75dbd3700 1 --2- 172.21.2.105:0/4186925428 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe7400037d0 0x7fe7580abb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:27.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75e3d4700 1 --2- 172.21.2.105:0/4186925428 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe7580aa640 0x7fe7580aaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:27.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75d3d2700 1 -- 172.21.2.105:0/4186925428 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe7400037d0 msgr2=0x7fe7580abb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:27.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75d3d2700 1 --2- 172.21.2.105:0/4186925428 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe7400037d0 0x7fe7580abb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:27.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75d3d2700 1 -- 172.21.2.105:0/4186925428 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe7580aa640 msgr2=0x7fe7580aaaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:27.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75d3d2700 1 --2- 172.21.2.105:0/4186925428 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe7580aa640 0x7fe7580aaaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:27.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75d3d2700 1 -- 172.21.2.105:0/4186925428 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe75814f030 con 0x7fe7580a86b0 2021-11-12T05:42:27.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75e3d4700 1 --2- 172.21.2.105:0/4186925428 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe7580aa640 0x7fe7580aaaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:42:27.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75d3d2700 1 --2- 172.21.2.105:0/4186925428 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe7580a86b0 0x7fe7580aa150 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7fe74c002f70 tx=0x7fe74c006e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:27.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe74affd700 1 -- 172.21.2.105:0/4186925428 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe74c013460 con 0x7fe7580a86b0 2021-11-12T05:42:27.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe74affd700 1 -- 172.21.2.105:0/4186925428 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74c0135c0 con 0x7fe7580a86b0 2021-11-12T05:42:27.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75fe37700 1 -- 172.21.2.105:0/4186925428 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe75814f290 con 0x7fe7580a86b0 2021-11-12T05:42:27.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe74affd700 1 -- 172.21.2.105:0/4186925428 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe74c013920 con 0x7fe7580a86b0 2021-11-12T05:42:27.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.327+0000 7fe75fe37700 1 -- 172.21.2.105:0/4186925428 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe75814ec30 con 0x7fe7580a86b0 2021-11-12T05:42:27.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.331+0000 7fe75fe37700 1 -- 172.21.2.105:0/4186925428 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7580b1440 con 0x7fe7580a86b0 2021-11-12T05:42:27.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.331+0000 7fe74affd700 1 -- 172.21.2.105:0/4186925428 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe74c01a060 con 0x7fe7580a86b0 2021-11-12T05:42:27.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.331+0000 7fe74affd700 1 --2- 172.21.2.105:0/4186925428 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe738053610 0x7fe738055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:27.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.331+0000 7fe74affd700 1 -- 172.21.2.105:0/4186925428 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fe74c06b420 con 0x7fe7580a86b0 2021-11-12T05:42:27.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.331+0000 7fe75dbd3700 1 --2- 172.21.2.105:0/4186925428 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe738053610 0x7fe738055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:27.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.331+0000 7fe75dbd3700 1 --2- 172.21.2.105:0/4186925428 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe738053610 0x7fe738055ad0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fe754019000 tx=0x7fe754015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:27.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.331+0000 7fe74affd700 1 -- 172.21.2.105:0/4186925428 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe74c042430 con 0x7fe7580a86b0 2021-11-12T05:42:27.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.415+0000 7fe75fe37700 1 -- 172.21.2.105:0/4186925428 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe758068700 con 0x7fe7580a86b0 2021-11-12T05:42:27.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.415+0000 7fe74affd700 1 -- 172.21.2.105:0/4186925428 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+16297 (secure 0 0 0) 0x7fe74c045a50 con 0x7fe7580a86b0 2021-11-12T05:42:27.422 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:42:27.422 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":44,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:42:27.265642+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:42:25.227892+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-11-12T05:42:26.242644+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:42:27.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.419+0000 7fe75fe37700 1 -- 172.21.2.105:0/4186925428 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe738053610 msgr2=0x7fe738055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:27.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.419+0000 7fe75fe37700 1 --2- 172.21.2.105:0/4186925428 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe738053610 0x7fe738055ad0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fe754019000 tx=0x7fe754015000).stop 2021-11-12T05:42:27.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.419+0000 7fe75fe37700 1 -- 172.21.2.105:0/4186925428 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe7580a86b0 msgr2=0x7fe7580aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:27.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.419+0000 7fe75fe37700 1 --2- 172.21.2.105:0/4186925428 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe7580a86b0 0x7fe7580aa150 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7fe74c002f70 tx=0x7fe74c006e50).stop 2021-11-12T05:42:27.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.419+0000 7fe75fe37700 1 -- 172.21.2.105:0/4186925428 shutdown_connections 2021-11-12T05:42:27.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.419+0000 7fe75fe37700 1 --2- 172.21.2.105:0/4186925428 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe738053610 0x7fe738055ad0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:27.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.419+0000 7fe75fe37700 1 --2- 172.21.2.105:0/4186925428 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe7580aa640 0x7fe7580aaaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:27.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.419+0000 7fe75fe37700 1 --2- 172.21.2.105:0/4186925428 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe7580a86b0 0x7fe7580aa150 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:27.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.419+0000 7fe75fe37700 1 --2- 172.21.2.105:0/4186925428 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe7400037d0 0x7fe7580abb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:27.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.419+0000 7fe75fe37700 1 -- 172.21.2.105:0/4186925428 >> 172.21.2.105:0/4186925428 conn(0x7fe7580b5370 msgr2=0x7fe758147ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:27.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.419+0000 7fe75fe37700 1 -- 172.21.2.105:0/4186925428 shutdown_connections 2021-11-12T05:42:27.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.419+0000 7fe75fe37700 1 -- 172.21.2.105:0/4186925428 wait complete. 2021-11-12T05:42:27.430 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:42:27.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.475+0000 7ff40f648700 1 Processor -- start 2021-11-12T05:42:27.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.475+0000 7ff40f648700 1 -- start start 2021-11-12T05:42:27.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.475+0000 7ff40f648700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff4080ac280 0x7ff40814b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:27.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.475+0000 7ff40f648700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff4080af730 0x7ff4080ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:27.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.475+0000 7ff40f648700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4080ac7b0 con 0x7ff4080ad080 2021-11-12T05:42:27.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.475+0000 7ff40f648700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4081488a0 con 0x7ff4080ac280 2021-11-12T05:42:27.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.475+0000 7ff40f648700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4080ac9e0 con 0x7ff4080af730 2021-11-12T05:42:27.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.475+0000 7ff40cbe3700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff4080ac280 0x7ff40814b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:27.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.475+0000 7ff40cbe3700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff4080ac280 0x7ff40814b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45008/0 (socket says 172.21.2.105:45008) 2021-11-12T05:42:27.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.475+0000 7ff40cbe3700 1 -- 172.21.2.105:0/1151988113 learned_addr learned my addr 172.21.2.105:0/1151988113 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:27.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.475+0000 7ff3fbfff700 1 -- 172.21.2.105:0/1151988113 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3501548561 0 0) 0x7ff4080ac7b0 con 0x7ff4080ad080 2021-11-12T05:42:27.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.475+0000 7ff40cbe3700 1 -- 172.21.2.105:0/1151988113 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff4080af730 msgr2=0x7ff4080ad460 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:42:27.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.475+0000 7ff40cbe3700 1 --2- 172.21.2.105:0/1151988113 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff4080af730 0x7ff4080ad460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:27.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.475+0000 7ff40cbe3700 1 -- 172.21.2.105:0/1151988113 >> v1:172.21.2.105:6789/0 conn(0x7ff4080ad080 legacy=0x7ff40814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:27.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.475+0000 7ff40cbe3700 1 -- 172.21.2.105:0/1151988113 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4080b0b30 con 0x7ff4080ac280 2021-11-12T05:42:27.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff40cbe3700 1 --2- 172.21.2.105:0/1151988113 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff4080ac280 0x7ff40814b2f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7ff404002f70 tx=0x7ff404006eb0).ready entity=mon.0 client_cookie=ceed73cad2e7be6d server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:27.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff3fbfff700 1 -- 172.21.2.105:0/1151988113 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff40400d5c0 con 0x7ff4080ac280 2021-11-12T05:42:27.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff3fbfff700 1 -- 172.21.2.105:0/1151988113 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff404000e90 con 0x7ff4080ac280 2021-11-12T05:42:27.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff3fbfff700 1 -- 172.21.2.105:0/1151988113 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff40400d910 con 0x7ff4080ac280 2021-11-12T05:42:27.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff40f648700 1 -- 172.21.2.105:0/1151988113 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff4080ac280 msgr2=0x7ff40814b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:27.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff40f648700 1 --2- 172.21.2.105:0/1151988113 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff4080ac280 0x7ff40814b2f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7ff404002f70 tx=0x7ff404006eb0).stop 2021-11-12T05:42:27.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff40f648700 1 -- 172.21.2.105:0/1151988113 shutdown_connections 2021-11-12T05:42:27.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff40f648700 1 --2- 172.21.2.105:0/1151988113 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff4080af730 0x7ff4080ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:27.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff40f648700 1 --2- 172.21.2.105:0/1151988113 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff4080ac280 0x7ff40814b2f0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:27.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff40f648700 1 -- 172.21.2.105:0/1151988113 >> 172.21.2.105:0/1151988113 conn(0x7ff4080b5370 msgr2=0x7ff4080b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:27.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff40f648700 1 -- 172.21.2.105:0/1151988113 shutdown_connections 2021-11-12T05:42:27.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff40f648700 1 -- 172.21.2.105:0/1151988113 wait complete. 2021-11-12T05:42:27.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff40f648700 1 Processor -- start 2021-11-12T05:42:27.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff40f648700 1 -- start start 2021-11-12T05:42:27.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff40f648700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff4080ac280 0x7ff4081433d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:27.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff40f648700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff4080ad080 0x7ff408148ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:27.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff40f648700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff4080af730 0x7ff408148fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:27.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff40f648700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4080a7d10 con 0x7ff4080ac280 2021-11-12T05:42:27.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff40f648700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4080abef0 con 0x7ff4080af730 2021-11-12T05:42:27.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff40f648700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff40814a9d0 con 0x7ff4080ad080 2021-11-12T05:42:27.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff40d3e4700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff4080ac280 0x7ff4081433d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:27.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff40d3e4700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff4080ac280 0x7ff4081433d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45010/0 (socket says 172.21.2.105:45010) 2021-11-12T05:42:27.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff40d3e4700 1 -- 172.21.2.105:0/999318978 learned_addr learned my addr 172.21.2.105:0/999318978 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:27.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff40d3e4700 1 -- 172.21.2.105:0/999318978 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff4080ad080 msgr2=0x7ff408148ae0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:42:27.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff40d3e4700 1 --2- 172.21.2.105:0/999318978 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff4080ad080 0x7ff408148ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:27.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff40d3e4700 1 -- 172.21.2.105:0/999318978 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff4080af730 msgr2=0x7ff408148fd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:42:27.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff40d3e4700 1 --2- 172.21.2.105:0/999318978 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff4080af730 0x7ff408148fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:27.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff40d3e4700 1 -- 172.21.2.105:0/999318978 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40400b1e0 con 0x7ff4080ac280 2021-11-12T05:42:27.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff40d3e4700 1 --2- 172.21.2.105:0/999318978 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff4080ac280 0x7ff4081433d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7ff40814b6e0 tx=0x7ff3fc007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:27.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff3fa7fc700 1 -- 172.21.2.105:0/999318978 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3fc00ce10 con 0x7ff4080ac280 2021-11-12T05:42:27.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff3fa7fc700 1 -- 172.21.2.105:0/999318978 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3fc00f470 con 0x7ff4080ac280 2021-11-12T05:42:27.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff40f648700 1 -- 172.21.2.105:0/999318978 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff40814a730 con 0x7ff4080ac280 2021-11-12T05:42:27.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff40f648700 1 -- 172.21.2.105:0/999318978 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff40814a3b0 con 0x7ff4080ac280 2021-11-12T05:42:27.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff3fa7fc700 1 -- 172.21.2.105:0/999318978 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3fc00f7d0 con 0x7ff4080ac280 2021-11-12T05:42:27.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff40f648700 1 -- 172.21.2.105:0/999318978 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4080b1440 con 0x7ff4080ac280 2021-11-12T05:42:27.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff3fa7fc700 1 -- 172.21.2.105:0/999318978 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff3fc019030 con 0x7ff4080ac280 2021-11-12T05:42:27.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff3fa7fc700 1 --2- 172.21.2.105:0/999318978 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff3e8053720 0x7ff3e8055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:27.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff3fa7fc700 1 -- 172.21.2.105:0/999318978 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6416+0+0 (secure 0 0 0) 0x7ff3fc06b040 con 0x7ff4080ac280 2021-11-12T05:42:27.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff40cbe3700 1 --2- 172.21.2.105:0/999318978 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff3e8053720 0x7ff3e8055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:27.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.479+0000 7ff40cbe3700 1 --2- 172.21.2.105:0/999318978 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff3e8053720 0x7ff3e8055be0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7ff404002f70 tx=0x7ff404015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:27.498 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.483+0000 7ff3fa7fc700 1 -- 172.21.2.105:0/999318978 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff3fc041f40 con 0x7ff4080ac280 2021-11-12T05:42:27.569 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.563+0000 7ff40f648700 1 -- 172.21.2.105:0/999318978 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff408057350 con 0x7ff4080ac280 2021-11-12T05:42:27.570 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.567+0000 7ff3fa7fc700 1 -- 172.21.2.105:0/999318978 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+16297 (secure 0 0 0) 0x7ff3fc045560 con 0x7ff4080ac280 2021-11-12T05:42:27.571 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:42:27.571 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":44,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:42:27.265642+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:42:25.227892+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-11-12T05:42:26.242644+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:42:27.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.567+0000 7ff40f648700 1 -- 172.21.2.105:0/999318978 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff3e8053720 msgr2=0x7ff3e8055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:27.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.567+0000 7ff40f648700 1 --2- 172.21.2.105:0/999318978 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff3e8053720 0x7ff3e8055be0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7ff404002f70 tx=0x7ff404015000).stop 2021-11-12T05:42:27.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.567+0000 7ff40f648700 1 -- 172.21.2.105:0/999318978 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff4080ac280 msgr2=0x7ff4081433d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:27.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.567+0000 7ff40f648700 1 --2- 172.21.2.105:0/999318978 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff4080ac280 0x7ff4081433d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7ff40814b6e0 tx=0x7ff3fc007ac0).stop 2021-11-12T05:42:27.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.567+0000 7ff40f648700 1 -- 172.21.2.105:0/999318978 shutdown_connections 2021-11-12T05:42:27.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.567+0000 7ff40f648700 1 --2- 172.21.2.105:0/999318978 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff3e8053720 0x7ff3e8055be0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:27.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.567+0000 7ff40f648700 1 --2- 172.21.2.105:0/999318978 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff4080af730 0x7ff408148fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:27.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.567+0000 7ff40f648700 1 --2- 172.21.2.105:0/999318978 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff4080ad080 0x7ff408148ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:27.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.567+0000 7ff40f648700 1 --2- 172.21.2.105:0/999318978 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff4080ac280 0x7ff4081433d0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:27.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.567+0000 7ff40f648700 1 -- 172.21.2.105:0/999318978 >> 172.21.2.105:0/999318978 conn(0x7ff4080b5370 msgr2=0x7ff4080b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:27.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.567+0000 7ff40f648700 1 -- 172.21.2.105:0/999318978 shutdown_connections 2021-11-12T05:42:27.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.567+0000 7ff40f648700 1 -- 172.21.2.105:0/999318978 wait complete. 2021-11-12T05:42:27.578 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-12T05:42:27.630 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.627+0000 7fd77488a700 1 Processor -- start 2021-11-12T05:42:27.630 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.627+0000 7fd77488a700 1 -- start start 2021-11-12T05:42:27.632 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.627+0000 7fd77488a700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd7700ace20 0x7fd7700b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:27.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.627+0000 7fd77488a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd770144180 0x7fd770144610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:27.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.627+0000 7fd77488a700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7700b1840 con 0x7fd7700aca40 2021-11-12T05:42:27.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.627+0000 7fd77488a700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7700b0a10 con 0x7fd7700ace20 2021-11-12T05:42:27.634 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.627+0000 7fd77488a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7700af2b0 con 0x7fd770144180 2021-11-12T05:42:27.634 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.627+0000 7fd76e59c700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fd7700aca40 0x7fd7701473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:55414/0 (socket says 172.21.2.105:55414) 2021-11-12T05:42:27.634 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.627+0000 7fd76e59c700 1 -- 172.21.2.105:0/643125889 learned_addr learned my addr 172.21.2.105:0/643125889 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:42:27.634 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.627+0000 7fd76dd9b700 1 --2- 172.21.2.105:0/643125889 >> v2:172.21.2.105:3300/0 conn(0x7fd7700ace20 0x7fd7700b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:27.634 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.627+0000 7fd76dd9b700 1 -- 172.21.2.105:0/643125889 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd770144180 msgr2=0x7fd770144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:27.635 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.627+0000 7fd76dd9b700 1 --2- 172.21.2.105:0/643125889 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd770144180 0x7fd770144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:27.635 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.627+0000 7fd76dd9b700 1 -- 172.21.2.105:0/643125889 >> v1:172.21.2.105:6789/0 conn(0x7fd7700aca40 legacy=0x7fd7701473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:27.635 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.627+0000 7fd76dd9b700 1 -- 172.21.2.105:0/643125889 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7700b1a70 con 0x7fd7700ace20 2021-11-12T05:42:27.636 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.627+0000 7fd76dd9b700 1 --2- 172.21.2.105:0/643125889 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd7700ace20 0x7fd7700b0520 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fd758002f70 tx=0x7fd758006df0).ready entity=mon.0 client_cookie=192740ec5b922551 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:27.636 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.627+0000 7fd76d59a700 1 -- 172.21.2.105:0/643125889 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd75800d570 con 0x7fd7700ace20 2021-11-12T05:42:27.636 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.627+0000 7fd76d59a700 1 -- 172.21.2.105:0/643125889 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd758000e90 con 0x7fd7700ace20 2021-11-12T05:42:27.636 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.627+0000 7fd76d59a700 1 -- 172.21.2.105:0/643125889 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd75800d8c0 con 0x7fd7700ace20 2021-11-12T05:42:27.636 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.627+0000 7fd77488a700 1 -- 172.21.2.105:0/643125889 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd7700ace20 msgr2=0x7fd7700b0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:27.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.627+0000 7fd77488a700 1 --2- 172.21.2.105:0/643125889 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd7700ace20 0x7fd7700b0520 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fd758002f70 tx=0x7fd758006df0).stop 2021-11-12T05:42:27.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.627+0000 7fd77488a700 1 -- 172.21.2.105:0/643125889 shutdown_connections 2021-11-12T05:42:27.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.627+0000 7fd77488a700 1 --2- 172.21.2.105:0/643125889 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd770144180 0x7fd770144610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:27.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.627+0000 7fd77488a700 1 --2- 172.21.2.105:0/643125889 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd7700ace20 0x7fd7700b0520 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:27.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.627+0000 7fd77488a700 1 -- 172.21.2.105:0/643125889 >> 172.21.2.105:0/643125889 conn(0x7fd77005c490 msgr2=0x7fd7700b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:27.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.627+0000 7fd77488a700 1 -- 172.21.2.105:0/643125889 shutdown_connections 2021-11-12T05:42:27.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.627+0000 7fd77488a700 1 -- 172.21.2.105:0/643125889 wait complete. 2021-11-12T05:42:27.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.627+0000 7fd77488a700 1 Processor -- start 2021-11-12T05:42:27.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.627+0000 7fd77488a700 1 -- start start 2021-11-12T05:42:27.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.627+0000 7fd77488a700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd7700aca40 0x7fd77014af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:27.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.627+0000 7fd77488a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd7700ace20 0x7fd7700655a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:27.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.627+0000 7fd77488a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd770144180 0x7fd770156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:27.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.627+0000 7fd77488a700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd770064170 con 0x7fd7700ace20 2021-11-12T05:42:27.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.627+0000 7fd77488a700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd770065a90 con 0x7fd7700aca40 2021-11-12T05:42:27.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.627+0000 7fd77488a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7701479a0 con 0x7fd770144180 2021-11-12T05:42:27.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.627+0000 7fd76dd9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd7700ace20 0x7fd7700655a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:27.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.627+0000 7fd76dd9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd7700ace20 0x7fd7700655a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45024/0 (socket says 172.21.2.105:45024) 2021-11-12T05:42:27.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.627+0000 7fd76dd9b700 1 -- 172.21.2.105:0/1604047860 learned_addr learned my addr 172.21.2.105:0/1604047860 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:27.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.631+0000 7fd76dd9b700 1 -- 172.21.2.105:0/1604047860 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd770144180 msgr2=0x7fd770156f40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:42:27.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.631+0000 7fd76dd9b700 1 --2- 172.21.2.105:0/1604047860 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd770144180 0x7fd770156f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:27.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.631+0000 7fd76dd9b700 1 -- 172.21.2.105:0/1604047860 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd7700aca40 msgr2=0x7fd77014af60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:42:27.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.631+0000 7fd76dd9b700 1 --2- 172.21.2.105:0/1604047860 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd7700aca40 0x7fd77014af60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:27.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.631+0000 7fd76dd9b700 1 -- 172.21.2.105:0/1604047860 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75800b180 con 0x7fd7700ace20 2021-11-12T05:42:27.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.631+0000 7fd76dd9b700 1 --2- 172.21.2.105:0/1604047860 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd7700ace20 0x7fd7700655a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fd770147b30 tx=0x7fd758015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:27.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.631+0000 7fd7677fe700 1 -- 172.21.2.105:0/1604047860 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd75800de40 con 0x7fd7700ace20 2021-11-12T05:42:27.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.631+0000 7fd7677fe700 1 -- 172.21.2.105:0/1604047860 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd758011ca0 con 0x7fd7700ace20 2021-11-12T05:42:27.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.631+0000 7fd77488a700 1 -- 172.21.2.105:0/1604047860 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd770147460 con 0x7fd7700ace20 2021-11-12T05:42:27.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.631+0000 7fd7677fe700 1 -- 172.21.2.105:0/1604047860 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd75801e460 con 0x7fd7700ace20 2021-11-12T05:42:27.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.631+0000 7fd77488a700 1 -- 172.21.2.105:0/1604047860 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7701568c0 con 0x7fd7700ace20 2021-11-12T05:42:27.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.631+0000 7fd77488a700 1 -- 172.21.2.105:0/1604047860 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd770159e30 con 0x7fd7700ace20 2021-11-12T05:42:27.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.631+0000 7fd7677fe700 1 -- 172.21.2.105:0/1604047860 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd758025030 con 0x7fd7700ace20 2021-11-12T05:42:27.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.631+0000 7fd7677fe700 1 --2- 172.21.2.105:0/1604047860 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd754053610 0x7fd754055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:27.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.631+0000 7fd7677fe700 1 -- 172.21.2.105:0/1604047860 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fd75806cdc0 con 0x7fd7700ace20 2021-11-12T05:42:27.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.631+0000 7fd76e59c700 1 --2- 172.21.2.105:0/1604047860 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd754053610 0x7fd754055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:27.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.631+0000 7fd76e59c700 1 --2- 172.21.2.105:0/1604047860 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd754053610 0x7fd754055ad0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fd770061140 tx=0x7fd760007790).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:27.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.631+0000 7fd7677fe700 1 -- 172.21.2.105:0/1604047860 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd758043dd0 con 0x7fd7700ace20 2021-11-12T05:42:27.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:27.739+0000 7fd77488a700 1 -- 172.21.2.105:0/1604047860 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd770057350 con 0x7fd7700ace20 2021-11-12T05:42:28.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.279+0000 7fd7677fe700 1 -- 172.21.2.105:0/1604047860 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd758023020 con 0x7fd7700ace20 2021-11-12T05:42:28.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.279+0000 7fd77488a700 1 -- 172.21.2.105:0/1604047860 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd754053610 msgr2=0x7fd754055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:28.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.279+0000 7fd77488a700 1 --2- 172.21.2.105:0/1604047860 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd754053610 0x7fd754055ad0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fd770061140 tx=0x7fd760007790).stop 2021-11-12T05:42:28.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.279+0000 7fd77488a700 1 -- 172.21.2.105:0/1604047860 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd7700ace20 msgr2=0x7fd7700655a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:28.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.279+0000 7fd77488a700 1 --2- 172.21.2.105:0/1604047860 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd7700ace20 0x7fd7700655a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fd770147b30 tx=0x7fd758015000).stop 2021-11-12T05:42:28.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.279+0000 7fd77488a700 1 -- 172.21.2.105:0/1604047860 shutdown_connections 2021-11-12T05:42:28.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.279+0000 7fd77488a700 1 --2- 172.21.2.105:0/1604047860 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd754053610 0x7fd754055ad0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:28.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.279+0000 7fd77488a700 1 --2- 172.21.2.105:0/1604047860 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd770144180 0x7fd770156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:28.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.279+0000 7fd77488a700 1 --2- 172.21.2.105:0/1604047860 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd7700ace20 0x7fd7700655a0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:28.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.279+0000 7fd77488a700 1 --2- 172.21.2.105:0/1604047860 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd7700aca40 0x7fd77014af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:28.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.279+0000 7fd77488a700 1 -- 172.21.2.105:0/1604047860 >> 172.21.2.105:0/1604047860 conn(0x7fd77005c490 msgr2=0x7fd770148890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:28.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.279+0000 7fd77488a700 1 -- 172.21.2.105:0/1604047860 shutdown_connections 2021-11-12T05:42:28.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.279+0000 7fd77488a700 1 -- 172.21.2.105:0/1604047860 wait complete. 2021-11-12T05:42:28.291 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:42:28.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.339+0000 7f1639606700 1 Processor -- start 2021-11-12T05:42:28.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.339+0000 7f1639606700 1 -- start start 2021-11-12T05:42:28.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.339+0000 7f1639606700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f16340ad080 0x7f16340af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:28.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.339+0000 7f1639606700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f163414b2f0 0x7f16340ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:28.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.339+0000 7f1639606700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16340ac7b0 con 0x7f16340ac280 2021-11-12T05:42:28.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.339+0000 7f1639606700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16341488a0 con 0x7f16340ad080 2021-11-12T05:42:28.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.339+0000 7f1639606700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16340ac9e0 con 0x7f163414b2f0 2021-11-12T05:42:28.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.339+0000 7f16327fc700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f16340ac280 0x7f163414abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:55430/0 (socket says 172.21.2.105:55430) 2021-11-12T05:42:28.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.339+0000 7f16327fc700 1 -- 172.21.2.105:0/1970772057 learned_addr learned my addr 172.21.2.105:0/1970772057 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:42:28.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.339+0000 7f1632ffd700 1 --2- 172.21.2.105:0/1970772057 >> v2:172.21.2.105:3300/0 conn(0x7f16340ad080 0x7f16340af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:28.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.339+0000 7f1632ffd700 1 -- 172.21.2.105:0/1970772057 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f163414b2f0 msgr2=0x7f16340ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:28.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.339+0000 7f1632ffd700 1 --2- 172.21.2.105:0/1970772057 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f163414b2f0 0x7f16340ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:28.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.339+0000 7f1632ffd700 1 -- 172.21.2.105:0/1970772057 >> v1:172.21.2.105:6789/0 conn(0x7f16340ac280 legacy=0x7f163414abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:28.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.339+0000 7f1632ffd700 1 -- 172.21.2.105:0/1970772057 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16340b0b30 con 0x7f16340ad080 2021-11-12T05:42:28.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.339+0000 7f1632ffd700 1 --2- 172.21.2.105:0/1970772057 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f16340ad080 0x7f16340af730 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f161c002f70 tx=0x7f161c006df0).ready entity=mon.0 client_cookie=8ba3413ce7956d69 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:28.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.339+0000 7f1631ffb700 1 -- 172.21.2.105:0/1970772057 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f161c00d570 con 0x7f16340ad080 2021-11-12T05:42:28.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.339+0000 7f1631ffb700 1 -- 172.21.2.105:0/1970772057 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161c000e90 con 0x7f16340ad080 2021-11-12T05:42:28.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.339+0000 7f1631ffb700 1 -- 172.21.2.105:0/1970772057 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f161c00d8c0 con 0x7f16340ad080 2021-11-12T05:42:28.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.339+0000 7f1639606700 1 -- 172.21.2.105:0/1970772057 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f16340ad080 msgr2=0x7f16340af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:28.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.339+0000 7f1639606700 1 --2- 172.21.2.105:0/1970772057 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f16340ad080 0x7f16340af730 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f161c002f70 tx=0x7f161c006df0).stop 2021-11-12T05:42:28.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.339+0000 7f1639606700 1 -- 172.21.2.105:0/1970772057 shutdown_connections 2021-11-12T05:42:28.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.339+0000 7f1639606700 1 --2- 172.21.2.105:0/1970772057 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f163414b2f0 0x7f16340ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:28.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.339+0000 7f1639606700 1 --2- 172.21.2.105:0/1970772057 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f16340ad080 0x7f16340af730 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:28.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.339+0000 7f1639606700 1 -- 172.21.2.105:0/1970772057 >> 172.21.2.105:0/1970772057 conn(0x7f16340b5370 msgr2=0x7f16340b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:28.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.343+0000 7f1639606700 1 -- 172.21.2.105:0/1970772057 shutdown_connections 2021-11-12T05:42:28.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.343+0000 7f1639606700 1 -- 172.21.2.105:0/1970772057 wait complete. 2021-11-12T05:42:28.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.343+0000 7f1639606700 1 Processor -- start 2021-11-12T05:42:28.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.343+0000 7f1639606700 1 -- start start 2021-11-12T05:42:28.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.343+0000 7f1639606700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f16340ac280 0x7f16340ab4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:28.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.343+0000 7f1639606700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f16340ad080 0x7f16340a7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:28.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.343+0000 7f1639606700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f163414b2f0 0x7f16340a7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:28.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.343+0000 7f1639606700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16340629c0 con 0x7f163414b2f0 2021-11-12T05:42:28.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.343+0000 7f1639606700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16340aaa60 con 0x7f16340ac280 2021-11-12T05:42:28.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.343+0000 7f1639606700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16340a98c0 con 0x7f16340ad080 2021-11-12T05:42:28.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.343+0000 7f16337fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f163414b2f0 0x7f16340a7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:28.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.343+0000 7f16337fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f163414b2f0 0x7f16340a7510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45042/0 (socket says 172.21.2.105:45042) 2021-11-12T05:42:28.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.343+0000 7f16337fe700 1 -- 172.21.2.105:0/3893852005 learned_addr learned my addr 172.21.2.105:0/3893852005 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:28.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.343+0000 7f16337fe700 1 -- 172.21.2.105:0/3893852005 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f16340ad080 msgr2=0x7f16340a7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:28.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.343+0000 7f16337fe700 1 --2- 172.21.2.105:0/3893852005 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f16340ad080 0x7f16340a7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:28.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.343+0000 7f16337fe700 1 -- 172.21.2.105:0/3893852005 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f16340ac280 msgr2=0x7f16340ab4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:28.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.343+0000 7f16337fe700 1 --2- 172.21.2.105:0/3893852005 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f16340ac280 0x7f16340ab4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:28.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.343+0000 7f16337fe700 1 -- 172.21.2.105:0/3893852005 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161c00b180 con 0x7f163414b2f0 2021-11-12T05:42:28.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.343+0000 7f16337fe700 1 --2- 172.21.2.105:0/3893852005 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f163414b2f0 0x7f16340a7510 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f162c0032f0 tx=0x7f162c0091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:28.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.343+0000 7f162bfff700 1 -- 172.21.2.105:0/3893852005 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f162c00d4a0 con 0x7f163414b2f0 2021-11-12T05:42:28.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.343+0000 7f162bfff700 1 -- 172.21.2.105:0/3893852005 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162c00d600 con 0x7f163414b2f0 2021-11-12T05:42:28.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.343+0000 7f162bfff700 1 -- 172.21.2.105:0/3893852005 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f162c00d960 con 0x7f163414b2f0 2021-11-12T05:42:28.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.343+0000 7f1639606700 1 -- 172.21.2.105:0/3893852005 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16340a9b60 con 0x7f163414b2f0 2021-11-12T05:42:28.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.343+0000 7f1639606700 1 -- 172.21.2.105:0/3893852005 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16340640e0 con 0x7f163414b2f0 2021-11-12T05:42:28.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.343+0000 7f1639606700 1 -- 172.21.2.105:0/3893852005 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16340b1440 con 0x7f163414b2f0 2021-11-12T05:42:28.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.343+0000 7f162bfff700 1 -- 172.21.2.105:0/3893852005 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f162c018030 con 0x7f163414b2f0 2021-11-12T05:42:28.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.343+0000 7f162bfff700 1 --2- 172.21.2.105:0/3893852005 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1618053610 0x7f1618055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:28.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.343+0000 7f162bfff700 1 -- 172.21.2.105:0/3893852005 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f162c06b2a0 con 0x7f163414b2f0 2021-11-12T05:42:28.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.343+0000 7f1632ffd700 1 --2- 172.21.2.105:0/3893852005 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1618053610 0x7f1618055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:28.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.343+0000 7f1632ffd700 1 --2- 172.21.2.105:0/3893852005 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1618053610 0x7f1618055ad0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f161c002f70 tx=0x7f161c015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:28.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.347+0000 7f162bfff700 1 -- 172.21.2.105:0/3893852005 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f162c042360 con 0x7f163414b2f0 2021-11-12T05:42:28.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.455+0000 7f1639606700 1 -- 172.21.2.105:0/3893852005 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1634057350 con 0x7f163414b2f0 2021-11-12T05:42:28.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.455+0000 7f162bfff700 1 -- 172.21.2.105:0/3893852005 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+2138 (secure 0 0 0) 0x7f162c045980 con 0x7f163414b2f0 2021-11-12T05:42:28.462 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:42:28.463 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":15,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4403,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/3185091424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":3185091424},{"type":"v1","addr":"172.21.2.115:6833","nonce":3185091424}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:42:27.265739+0000","modified":"2021-11-12T05:42:28.270769+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5250":{"gid":5250,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/3058129917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":3058129917},{"type":"v1","addr":"172.21.2.105:6835","nonce":3058129917}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-11-12T05:42:28.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.459+0000 7f1639606700 1 -- 172.21.2.105:0/3893852005 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1618053610 msgr2=0x7f1618055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:28.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.459+0000 7f1639606700 1 --2- 172.21.2.105:0/3893852005 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1618053610 0x7f1618055ad0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f161c002f70 tx=0x7f161c015000).stop 2021-11-12T05:42:28.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.459+0000 7f1639606700 1 -- 172.21.2.105:0/3893852005 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f163414b2f0 msgr2=0x7f16340a7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:28.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.459+0000 7f1639606700 1 --2- 172.21.2.105:0/3893852005 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f163414b2f0 0x7f16340a7510 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f162c0032f0 tx=0x7f162c0091a0).stop 2021-11-12T05:42:28.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.459+0000 7f1639606700 1 -- 172.21.2.105:0/3893852005 shutdown_connections 2021-11-12T05:42:28.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.459+0000 7f1639606700 1 --2- 172.21.2.105:0/3893852005 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1618053610 0x7f1618055ad0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:28.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.459+0000 7f1639606700 1 --2- 172.21.2.105:0/3893852005 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f163414b2f0 0x7f16340a7510 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:28.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.459+0000 7f1639606700 1 --2- 172.21.2.105:0/3893852005 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f16340ad080 0x7f16340a7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:28.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.459+0000 7f1639606700 1 --2- 172.21.2.105:0/3893852005 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f16340ac280 0x7f16340ab4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:28.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.459+0000 7f1639606700 1 -- 172.21.2.105:0/3893852005 >> 172.21.2.105:0/3893852005 conn(0x7f16340b5370 msgr2=0x7f163414aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:28.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.459+0000 7f1639606700 1 -- 172.21.2.105:0/3893852005 shutdown_connections 2021-11-12T05:42:28.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.459+0000 7f1639606700 1 -- 172.21.2.105:0/3893852005 wait complete. 2021-11-12T05:42:28.467 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 15 2021-11-12T05:42:28.469 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:42:28.520 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.515+0000 7fb0a592d700 1 Processor -- start 2021-11-12T05:42:28.520 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.515+0000 7fb0a592d700 1 -- start start 2021-11-12T05:42:28.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.515+0000 7fb0a592d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb0a00ad080 0x7fb0a00af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:28.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.515+0000 7fb0a592d700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fb0a00ac280 0x7fb0a00ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:28.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.515+0000 7fb0a592d700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb0a014abe0 0x7fb0a014b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:28.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.515+0000 7fb0a592d700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a01488a0 con 0x7fb0a00ad080 2021-11-12T05:42:28.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.515+0000 7fb0a592d700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a00ac7b0 con 0x7fb0a00ac280 2021-11-12T05:42:28.526 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.515+0000 7fb0a592d700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a00ac9e0 con 0x7fb0a014abe0 2021-11-12T05:42:28.526 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.515+0000 7fb09effd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb0a00ad080 0x7fb0a00af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:28.526 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.515+0000 7fb09effd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb0a00ad080 0x7fb0a00af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45046/0 (socket says 172.21.2.105:45046) 2021-11-12T05:42:28.526 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.515+0000 7fb09effd700 1 -- 172.21.2.105:0/3520964272 learned_addr learned my addr 172.21.2.105:0/3520964272 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:28.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.515+0000 7fb09effd700 1 -- 172.21.2.105:0/3520964272 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb0a014abe0 msgr2=0x7fb0a014b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:28.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.515+0000 7fb09effd700 1 --2- 172.21.2.105:0/3520964272 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb0a014abe0 0x7fb0a014b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:28.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.515+0000 7fb09effd700 1 -- 172.21.2.105:0/3520964272 >> v2:172.21.2.115:3300/0 conn(0x7fb0a00ac280 msgr2=0x7fb0a00ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:28.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.515+0000 7fb09effd700 1 --2- 172.21.2.105:0/3520964272 >> v2:172.21.2.115:3300/0 conn(0x7fb0a00ac280 0x7fb0a00ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:28.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.515+0000 7fb09effd700 1 -- 172.21.2.105:0/3520964272 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a00b0b30 con 0x7fb0a00ad080 2021-11-12T05:42:28.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.515+0000 7fb09effd700 1 --2- 172.21.2.105:0/3520964272 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb0a00ad080 0x7fb0a00af730 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fb0a00ac6a0 tx=0x7fb088006eb0).ready entity=mon.0 client_cookie=cae6523d82ac9ee4 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:28.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.515+0000 7fb09dffb700 1 -- 172.21.2.105:0/3520964272 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb08800d570 con 0x7fb0a00ad080 2021-11-12T05:42:28.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.515+0000 7fb09dffb700 1 -- 172.21.2.105:0/3520964272 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb088000e90 con 0x7fb0a00ad080 2021-11-12T05:42:28.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.515+0000 7fb09dffb700 1 -- 172.21.2.105:0/3520964272 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb08800d8c0 con 0x7fb0a00ad080 2021-11-12T05:42:28.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.515+0000 7fb0a592d700 1 -- 172.21.2.105:0/3520964272 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb0a00ad080 msgr2=0x7fb0a00af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:28.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.515+0000 7fb0a592d700 1 --2- 172.21.2.105:0/3520964272 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb0a00ad080 0x7fb0a00af730 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fb0a00ac6a0 tx=0x7fb088006eb0).stop 2021-11-12T05:42:28.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.515+0000 7fb0a592d700 1 -- 172.21.2.105:0/3520964272 shutdown_connections 2021-11-12T05:42:28.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.515+0000 7fb0a592d700 1 --2- 172.21.2.105:0/3520964272 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb0a014abe0 0x7fb0a014b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:28.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.515+0000 7fb0a592d700 1 --2- 172.21.2.105:0/3520964272 >> v2:172.21.2.115:3300/0 conn(0x7fb0a00ac280 0x7fb0a00ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:28.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.515+0000 7fb0a592d700 1 --2- 172.21.2.105:0/3520964272 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb0a00ad080 0x7fb0a00af730 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:28.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.515+0000 7fb0a592d700 1 -- 172.21.2.105:0/3520964272 >> 172.21.2.105:0/3520964272 conn(0x7fb0a00b5370 msgr2=0x7fb0a00b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:28.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.519+0000 7fb0a592d700 1 -- 172.21.2.105:0/3520964272 shutdown_connections 2021-11-12T05:42:28.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.519+0000 7fb0a592d700 1 -- 172.21.2.105:0/3520964272 wait complete. 2021-11-12T05:42:28.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.519+0000 7fb0a592d700 1 Processor -- start 2021-11-12T05:42:28.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.519+0000 7fb0a592d700 1 -- start start 2021-11-12T05:42:28.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.519+0000 7fb0a592d700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb0a00ac280 0x7fb0a0060490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:28.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.519+0000 7fb0a592d700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb0a00ad080 0x7fb0a015a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:28.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.519+0000 7fb0a592d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb0a014abe0 0x7fb0a0066b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:28.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.519+0000 7fb0a592d700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a00aa0d0 con 0x7fb0a014abe0 2021-11-12T05:42:28.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.519+0000 7fb0a592d700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a0063580 con 0x7fb0a00ad080 2021-11-12T05:42:28.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.519+0000 7fb0a592d700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a00aaa30 con 0x7fb0a00ac280 2021-11-12T05:42:28.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.519+0000 7fb09f7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb0a014abe0 0x7fb0a0066b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:28.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.519+0000 7fb09f7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb0a014abe0 0x7fb0a0066b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45052/0 (socket says 172.21.2.105:45052) 2021-11-12T05:42:28.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.519+0000 7fb09f7fe700 1 -- 172.21.2.105:0/4064579229 learned_addr learned my addr 172.21.2.105:0/4064579229 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:28.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.519+0000 7fb09e7fc700 1 --2- 172.21.2.105:0/4064579229 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb0a00ad080 0x7fb0a015a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:28.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.519+0000 7fb09f7fe700 1 -- 172.21.2.105:0/4064579229 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb0a00ac280 msgr2=0x7fb0a0060490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:28.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.519+0000 7fb09effd700 1 --2- 172.21.2.105:0/4064579229 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb0a00ac280 0x7fb0a0060490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:28.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.519+0000 7fb09f7fe700 1 --2- 172.21.2.105:0/4064579229 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb0a00ac280 0x7fb0a0060490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:28.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.519+0000 7fb09f7fe700 1 -- 172.21.2.105:0/4064579229 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb0a00ad080 msgr2=0x7fb0a015a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:28.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.519+0000 7fb09f7fe700 1 --2- 172.21.2.105:0/4064579229 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb0a00ad080 0x7fb0a015a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:28.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.519+0000 7fb09f7fe700 1 -- 172.21.2.105:0/4064579229 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08800b1e0 con 0x7fb0a014abe0 2021-11-12T05:42:28.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.519+0000 7fb09f7fe700 1 --2- 172.21.2.105:0/4064579229 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb0a014abe0 0x7fb0a0066b50 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7fb0980032f0 tx=0x7fb098009120).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:28.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.519+0000 7fb097fff700 1 -- 172.21.2.105:0/4064579229 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb09800f510 con 0x7fb0a014abe0 2021-11-12T05:42:28.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.519+0000 7fb097fff700 1 -- 172.21.2.105:0/4064579229 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09800f670 con 0x7fb0a014abe0 2021-11-12T05:42:28.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.519+0000 7fb0a592d700 1 -- 172.21.2.105:0/4064579229 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a00aacd0 con 0x7fb0a014abe0 2021-11-12T05:42:28.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.519+0000 7fb097fff700 1 -- 172.21.2.105:0/4064579229 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb09800f7e0 con 0x7fb0a014abe0 2021-11-12T05:42:28.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.519+0000 7fb0a592d700 1 -- 172.21.2.105:0/4064579229 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a00a9730 con 0x7fb0a014abe0 2021-11-12T05:42:28.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.519+0000 7fb0a592d700 1 -- 172.21.2.105:0/4064579229 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0a00abed0 con 0x7fb0a014abe0 2021-11-12T05:42:28.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.519+0000 7fb097fff700 1 -- 172.21.2.105:0/4064579229 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb09800f070 con 0x7fb0a014abe0 2021-11-12T05:42:28.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.519+0000 7fb097fff700 1 --2- 172.21.2.105:0/4064579229 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb0840536a0 0x7fb084055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:28.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.519+0000 7fb097fff700 1 -- 172.21.2.105:0/4064579229 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fb09806b600 con 0x7fb0a014abe0 2021-11-12T05:42:28.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.519+0000 7fb09effd700 1 --2- 172.21.2.105:0/4064579229 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb0840536a0 0x7fb084055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:28.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.519+0000 7fb09effd700 1 --2- 172.21.2.105:0/4064579229 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb0840536a0 0x7fb084055b60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7fb088016000 tx=0x7fb088015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:28.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.523+0000 7fb097fff700 1 -- 172.21.2.105:0/4064579229 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb0a00abed0 con 0x7fb0a014abe0 2021-11-12T05:42:28.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.607+0000 7fb0a592d700 1 -- 172.21.2.105:0/4064579229 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0a00abed0 con 0x7fb0a014abe0 2021-11-12T05:42:28.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.607+0000 7fb097fff700 1 -- 172.21.2.105:0/4064579229 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+16271 (secure 0 0 0) 0x7fb0a00abed0 con 0x7fb0a014abe0 2021-11-12T05:42:28.612 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:42:28.612 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":45,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:42:28.269153+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:42:25.227892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-11-12T05:42:26.242644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:42:28.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.607+0000 7fb0a592d700 1 -- 172.21.2.105:0/4064579229 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb0840536a0 msgr2=0x7fb084055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:28.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.607+0000 7fb0a592d700 1 --2- 172.21.2.105:0/4064579229 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb0840536a0 0x7fb084055b60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7fb088016000 tx=0x7fb088015000).stop 2021-11-12T05:42:28.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.607+0000 7fb0a592d700 1 -- 172.21.2.105:0/4064579229 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb0a014abe0 msgr2=0x7fb0a0066b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:28.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.607+0000 7fb0a592d700 1 --2- 172.21.2.105:0/4064579229 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb0a014abe0 0x7fb0a0066b50 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7fb0980032f0 tx=0x7fb098009120).stop 2021-11-12T05:42:28.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.607+0000 7fb0a592d700 1 -- 172.21.2.105:0/4064579229 shutdown_connections 2021-11-12T05:42:28.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.607+0000 7fb0a592d700 1 --2- 172.21.2.105:0/4064579229 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb0840536a0 0x7fb084055b60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:28.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.607+0000 7fb0a592d700 1 --2- 172.21.2.105:0/4064579229 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb0a014abe0 0x7fb0a0066b50 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:28.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.607+0000 7fb0a592d700 1 --2- 172.21.2.105:0/4064579229 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb0a00ad080 0x7fb0a015a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:28.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.607+0000 7fb0a592d700 1 --2- 172.21.2.105:0/4064579229 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb0a00ac280 0x7fb0a0060490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:28.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.607+0000 7fb0a592d700 1 -- 172.21.2.105:0/4064579229 >> 172.21.2.105:0/4064579229 conn(0x7fb0a00b5370 msgr2=0x7fb0a01444c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:28.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.607+0000 7fb0a592d700 1 -- 172.21.2.105:0/4064579229 shutdown_connections 2021-11-12T05:42:28.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.607+0000 7fb0a592d700 1 -- 172.21.2.105:0/4064579229 wait complete. 2021-11-12T05:42:28.620 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-12T05:42:28.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8ac49e700 1 Processor -- start 2021-11-12T05:42:28.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8ac49e700 1 -- start start 2021-11-12T05:42:28.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8ac49e700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fa8a414b2f0 0x7fa8a40af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:28.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8ac49e700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a40ac7b0 con 0x7fa8a40ac280 2021-11-12T05:42:28.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8ac49e700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a40ac9e0 con 0x7fa8a40ad080 2021-11-12T05:42:28.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8ac49e700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8a41488a0 con 0x7fa8a414b2f0 2021-11-12T05:42:28.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8a9a39700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fa8a40ac280 0x7fa8a4147a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:55456/0 (socket says 172.21.2.105:55456) 2021-11-12T05:42:28.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8a9a39700 1 -- 172.21.2.105:0/3309499361 learned_addr learned my addr 172.21.2.105:0/3309499361 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:42:28.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8a9238700 1 -- 172.21.2.105:0/3309499361 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1469725828 0 0) 0x7fa8a40ac7b0 con 0x7fa8a40ac280 2021-11-12T05:42:28.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8a9238700 1 -- 172.21.2.105:0/3309499361 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa88c003260 con 0x7fa8a40ac280 2021-11-12T05:42:28.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8a9238700 1 -- 172.21.2.105:0/3309499361 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1110076069 0 0) 0x7fa88c003260 con 0x7fa8a40ac280 2021-11-12T05:42:28.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8a9238700 1 -- 172.21.2.105:0/3309499361 >> v2:172.21.2.115:3300/0 conn(0x7fa8a414b2f0 msgr2=0x7fa8a40af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:28.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8a9238700 1 --2- 172.21.2.105:0/3309499361 >> v2:172.21.2.115:3300/0 conn(0x7fa8a414b2f0 0x7fa8a40af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:28.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8a9238700 1 -- 172.21.2.105:0/3309499361 >> v1:172.21.2.115:6789/0 conn(0x7fa8a40ad080 legacy=0x7fa8a414abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:28.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8a9238700 1 -- 172.21.2.105:0/3309499361 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a40b0b30 con 0x7fa8a40ac280 2021-11-12T05:42:28.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8a9238700 1 -- 172.21.2.105:0/3309499361 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fa894001660 con 0x7fa8a40ac280 2021-11-12T05:42:28.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8a9238700 1 -- 172.21.2.105:0/3309499361 >> v1:172.21.2.105:6789/0 conn(0x7fa8a40ac280 legacy=0x7fa8a4147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:28.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8a9238700 1 --2- 172.21.2.105:0/3309499361 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa88c003820 0x7fa88c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:28.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8a9238700 1 --2- 172.21.2.105:0/3309499361 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa88c004500 0x7fa88c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:28.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8a9238700 1 --2- 172.21.2.105:0/3309499361 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa88c005050 0x7fa88c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:28.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8a9238700 1 -- 172.21.2.105:0/3309499361 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a41488a0 con 0x7fa88c004500 2021-11-12T05:42:28.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8a9238700 1 -- 172.21.2.105:0/3309499361 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c00bf40 con 0x7fa88c005050 2021-11-12T05:42:28.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8a9238700 1 -- 172.21.2.105:0/3309499361 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c00c100 con 0x7fa88c003820 2021-11-12T05:42:28.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8a9a39700 1 --2- 172.21.2.105:0/3309499361 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa88c004500 0x7fa88c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:28.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8a9a39700 1 -- 172.21.2.105:0/3309499361 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa88c003820 msgr2=0x7fa88c003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:28.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8a9a39700 1 --2- 172.21.2.105:0/3309499361 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa88c003820 0x7fa88c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:28.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8a9a39700 1 -- 172.21.2.105:0/3309499361 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa88c005050 msgr2=0x7fa88c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:28.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8a9a39700 1 --2- 172.21.2.105:0/3309499361 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa88c005050 0x7fa88c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:28.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8a9a39700 1 -- 172.21.2.105:0/3309499361 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88c003260 con 0x7fa88c004500 2021-11-12T05:42:28.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8aaa3b700 1 -- 172.21.2.105:0/3309499361 reap_dead start 2021-11-12T05:42:28.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8a9a39700 1 --2- 172.21.2.105:0/3309499361 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa88c004500 0x7fa88c004980 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7fa8a40ac6a0 tx=0x7fa8a40ada20).ready entity=mon.0 client_cookie=9898d65b51e13105 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:28.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8a9238700 1 -- 172.21.2.105:0/3309499361 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8940070d0 con 0x7fa88c004500 2021-11-12T05:42:28.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8a9238700 1 -- 172.21.2.105:0/3309499361 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa894007230 con 0x7fa88c004500 2021-11-12T05:42:28.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8a9238700 1 -- 172.21.2.105:0/3309499361 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa89400c8f0 con 0x7fa88c004500 2021-11-12T05:42:28.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8ac49e700 1 -- 172.21.2.105:0/3309499361 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa88c004500 msgr2=0x7fa88c004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:28.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8ac49e700 1 --2- 172.21.2.105:0/3309499361 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa88c004500 0x7fa88c004980 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7fa8a40ac6a0 tx=0x7fa8a40ada20).stop 2021-11-12T05:42:28.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8ac49e700 1 -- 172.21.2.105:0/3309499361 shutdown_connections 2021-11-12T05:42:28.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8ac49e700 1 --2- 172.21.2.105:0/3309499361 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa88c004500 0x7fa88c004980 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:28.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8ac49e700 1 -- 172.21.2.105:0/3309499361 >> 172.21.2.105:0/3309499361 conn(0x7fa8a40b5370 msgr2=0x7fa8a40b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:28.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8ac49e700 1 -- 172.21.2.105:0/3309499361 shutdown_connections 2021-11-12T05:42:28.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8ac49e700 1 -- 172.21.2.105:0/3309499361 wait complete. 2021-11-12T05:42:28.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8ac49e700 1 Processor -- start 2021-11-12T05:42:28.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.683+0000 7fa8ac49e700 1 -- start start 2021-11-12T05:42:28.701 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.687+0000 7fa8ac49e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa88c004500 0x7fa8a41479a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:28.701 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.687+0000 7fa8ac49e700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa8a4156aa0 0x7fa8a40a9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:28.701 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.687+0000 7fa8ac49e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa8a40a94f0 0x7fa8a415a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:28.701 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.687+0000 7fa8ac49e700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a415a070 con 0x7fa88c004500 2021-11-12T05:42:28.701 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.687+0000 7fa8ac49e700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a4147fd0 con 0x7fa8a4156aa0 2021-11-12T05:42:28.702 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.687+0000 7fa8ac49e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a415a260 con 0x7fa8a40a94f0 2021-11-12T05:42:28.702 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.687+0000 7fa8aa23a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa88c004500 0x7fa8a41479a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:28.703 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.687+0000 7fa8aa23a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa88c004500 0x7fa8a41479a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45072/0 (socket says 172.21.2.105:45072) 2021-11-12T05:42:28.703 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.687+0000 7fa8aa23a700 1 -- 172.21.2.105:0/3566976867 learned_addr learned my addr 172.21.2.105:0/3566976867 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:28.703 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.687+0000 7fa8aa23a700 1 -- 172.21.2.105:0/3566976867 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa8a40a94f0 msgr2=0x7fa8a415a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:28.703 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.687+0000 7fa8aa23a700 1 --2- 172.21.2.105:0/3566976867 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa8a40a94f0 0x7fa8a415a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:28.704 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.687+0000 7fa8aa23a700 1 -- 172.21.2.105:0/3566976867 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa8a4156aa0 msgr2=0x7fa8a40a9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:28.704 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.687+0000 7fa8aa23a700 1 --2- 172.21.2.105:0/3566976867 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa8a4156aa0 0x7fa8a40a9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:28.704 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.687+0000 7fa8aa23a700 1 -- 172.21.2.105:0/3566976867 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a4156f00 con 0x7fa88c004500 2021-11-12T05:42:28.704 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.687+0000 7fa8aa23a700 1 --2- 172.21.2.105:0/3566976867 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa88c004500 0x7fa8a41479a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fa8a0000f70 tx=0x7fa8a0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:28.704 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.687+0000 7fa8937fe700 1 -- 172.21.2.105:0/3566976867 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8a0013460 con 0x7fa88c004500 2021-11-12T05:42:28.705 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.687+0000 7fa8937fe700 1 -- 172.21.2.105:0/3566976867 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a00135c0 con 0x7fa88c004500 2021-11-12T05:42:28.705 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.687+0000 7fa8ac49e700 1 -- 172.21.2.105:0/3566976867 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a415abf0 con 0x7fa88c004500 2021-11-12T05:42:28.705 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.687+0000 7fa8ac49e700 1 -- 172.21.2.105:0/3566976867 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a40a7fb0 con 0x7fa88c004500 2021-11-12T05:42:28.705 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.687+0000 7fa8937fe700 1 -- 172.21.2.105:0/3566976867 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8a0013920 con 0x7fa88c004500 2021-11-12T05:42:28.706 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.687+0000 7fa8ac49e700 1 -- 172.21.2.105:0/3566976867 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8a415a420 con 0x7fa88c004500 2021-11-12T05:42:28.706 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.687+0000 7fa8937fe700 1 -- 172.21.2.105:0/3566976867 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa8a001a060 con 0x7fa88c004500 2021-11-12T05:42:28.706 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.687+0000 7fa8937fe700 1 --2- 172.21.2.105:0/3566976867 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa884053720 0x7fa884055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:28.706 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.687+0000 7fa8937fe700 1 -- 172.21.2.105:0/3566976867 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fa8a006b4d0 con 0x7fa88c004500 2021-11-12T05:42:28.706 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.687+0000 7fa8a9a39700 1 --2- 172.21.2.105:0/3566976867 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa884053720 0x7fa884055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:28.707 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.687+0000 7fa8a9a39700 1 --2- 172.21.2.105:0/3566976867 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa884053720 0x7fa884055be0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fa8a40ac6a0 tx=0x7fa894015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:28.707 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.691+0000 7fa8937fe700 1 -- 172.21.2.105:0/3566976867 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa8a00423d0 con 0x7fa88c004500 2021-11-12T05:42:28.807 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.803+0000 7fa8ac49e700 1 -- 172.21.2.105:0/3566976867 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fa8a4148140 con 0x7fa88c004500 2021-11-12T05:42:28.812 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.807+0000 7fa8937fe700 1 -- 172.21.2.105:0/3566976867 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v16) v1 ==== 184+0+0 (secure 0 0 0) 0x7fa8a0018020 con 0x7fa88c004500 2021-11-12T05:42:28.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.807+0000 7fa8ac49e700 1 -- 172.21.2.105:0/3566976867 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa884053720 msgr2=0x7fa884055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:28.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.807+0000 7fa8ac49e700 1 --2- 172.21.2.105:0/3566976867 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa884053720 0x7fa884055be0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fa8a40ac6a0 tx=0x7fa894015000).stop 2021-11-12T05:42:28.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.807+0000 7fa8ac49e700 1 -- 172.21.2.105:0/3566976867 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa88c004500 msgr2=0x7fa8a41479a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:28.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.807+0000 7fa8ac49e700 1 --2- 172.21.2.105:0/3566976867 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa88c004500 0x7fa8a41479a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fa8a0000f70 tx=0x7fa8a0006df0).stop 2021-11-12T05:42:28.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.807+0000 7fa8ac49e700 1 -- 172.21.2.105:0/3566976867 shutdown_connections 2021-11-12T05:42:28.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.807+0000 7fa8ac49e700 1 --2- 172.21.2.105:0/3566976867 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa884053720 0x7fa884055be0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:28.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.807+0000 7fa8ac49e700 1 --2- 172.21.2.105:0/3566976867 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa8a40a94f0 0x7fa8a415a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:28.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.807+0000 7fa8ac49e700 1 --2- 172.21.2.105:0/3566976867 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa8a4156aa0 0x7fa8a40a9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:28.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.807+0000 7fa8ac49e700 1 --2- 172.21.2.105:0/3566976867 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa88c004500 0x7fa8a41479a0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:28.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.807+0000 7fa8ac49e700 1 -- 172.21.2.105:0/3566976867 >> 172.21.2.105:0/3566976867 conn(0x7fa8a40b5370 msgr2=0x7fa8a4143c60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:28.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.811+0000 7fa8ac49e700 1 -- 172.21.2.105:0/3566976867 shutdown_connections 2021-11-12T05:42:28.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.811+0000 7fa8ac49e700 1 -- 172.21.2.105:0/3566976867 wait complete. 2021-11-12T05:42:28.817 INFO:teuthology.orchestra.run.gibba005.stderr:updated caps for client.0 2021-11-12T05:42:28.820 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-12T05:42:28.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d7fd4700 1 Processor -- start 2021-11-12T05:42:28.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d7fd4700 1 -- start start 2021-11-12T05:42:28.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d7fd4700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7ff3d00ad080 0x7ff3d00af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:28.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d7fd4700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff3d00ac280 0x7ff3d00ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:28.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d7fd4700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff3d014abe0 0x7ff3d014b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:28.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d7fd4700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3d01488a0 con 0x7ff3d014abe0 2021-11-12T05:42:28.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d7fd4700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3d00ac7b0 con 0x7ff3d00ad080 2021-11-12T05:42:28.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d7fd4700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d00ac9e0 con 0x7ff3d00ac280 2021-11-12T05:42:28.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d6571700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff3d014abe0 0x7ff3d014b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:28.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d6571700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff3d014abe0 0x7ff3d014b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45078/0 (socket says 172.21.2.105:45078) 2021-11-12T05:42:28.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d6571700 1 -- 172.21.2.105:0/3858434663 learned_addr learned my addr 172.21.2.105:0/3858434663 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:28.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d6571700 1 -- 172.21.2.105:0/3858434663 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff3d00ac280 msgr2=0x7ff3d00ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:28.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d6571700 1 --2- 172.21.2.105:0/3858434663 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff3d00ac280 0x7ff3d00ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:28.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d6571700 1 -- 172.21.2.105:0/3858434663 >> v2:172.21.2.115:3300/0 conn(0x7ff3d00ad080 msgr2=0x7ff3d00af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:28.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d6571700 1 --2- 172.21.2.105:0/3858434663 >> v2:172.21.2.115:3300/0 conn(0x7ff3d00ad080 0x7ff3d00af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:28.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d6571700 1 -- 172.21.2.105:0/3858434663 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d00b0b30 con 0x7ff3d014abe0 2021-11-12T05:42:28.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d6571700 1 --2- 172.21.2.105:0/3858434663 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3d014abe0 0x7ff3d014b090 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7ff3d00ac6a0 tx=0x7ff3c8009290).ready entity=mon.0 client_cookie=74ad27d355707d90 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:28.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d4d6e700 1 -- 172.21.2.105:0/3858434663 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3c800b830 con 0x7ff3d014abe0 2021-11-12T05:42:28.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d4d6e700 1 -- 172.21.2.105:0/3858434663 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c800b990 con 0x7ff3d014abe0 2021-11-12T05:42:28.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d4d6e700 1 -- 172.21.2.105:0/3858434663 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3c800bb00 con 0x7ff3d014abe0 2021-11-12T05:42:28.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d7fd4700 1 -- 172.21.2.105:0/3858434663 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3d014abe0 msgr2=0x7ff3d014b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:28.881 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d7fd4700 1 --2- 172.21.2.105:0/3858434663 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3d014abe0 0x7ff3d014b090 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7ff3d00ac6a0 tx=0x7ff3c8009290).stop 2021-11-12T05:42:28.881 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d7fd4700 1 -- 172.21.2.105:0/3858434663 shutdown_connections 2021-11-12T05:42:28.881 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d7fd4700 1 --2- 172.21.2.105:0/3858434663 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3d014abe0 0x7ff3d014b090 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:28.881 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d7fd4700 1 --2- 172.21.2.105:0/3858434663 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff3d00ac280 0x7ff3d00ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:28.881 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d7fd4700 1 --2- 172.21.2.105:0/3858434663 >> v2:172.21.2.115:3300/0 conn(0x7ff3d00ad080 0x7ff3d00af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:28.882 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d7fd4700 1 -- 172.21.2.105:0/3858434663 >> 172.21.2.105:0/3858434663 conn(0x7ff3d00b5370 msgr2=0x7ff3d00b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:28.882 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d7fd4700 1 -- 172.21.2.105:0/3858434663 shutdown_connections 2021-11-12T05:42:28.882 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d7fd4700 1 -- 172.21.2.105:0/3858434663 wait complete. 2021-11-12T05:42:28.884 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d7fd4700 1 Processor -- start 2021-11-12T05:42:28.885 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d7fd4700 1 -- start start 2021-11-12T05:42:28.885 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d7fd4700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3d00ac280 0x7ff3d0156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:28.885 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d7fd4700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff3d00ad080 0x7ff3d00a94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:28.885 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d7fd4700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff3d014abe0 0x7ff3d00a8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:28.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d7fd4700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d0064220 con 0x7ff3d00ac280 2021-11-12T05:42:28.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d7fd4700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d0157110 con 0x7ff3d014abe0 2021-11-12T05:42:28.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d7fd4700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d0157330 con 0x7ff3d00ad080 2021-11-12T05:42:28.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d5d70700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3d00ac280 0x7ff3d0156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:28.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d5d70700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3d00ac280 0x7ff3d0156c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45084/0 (socket says 172.21.2.105:45084) 2021-11-12T05:42:28.887 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d5d70700 1 -- 172.21.2.105:0/3516151395 learned_addr learned my addr 172.21.2.105:0/3516151395 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:28.887 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d5d70700 1 -- 172.21.2.105:0/3516151395 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff3d00ad080 msgr2=0x7ff3d00a94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:28.887 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d5d70700 1 --2- 172.21.2.105:0/3516151395 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff3d00ad080 0x7ff3d00a94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:28.887 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d5d70700 1 -- 172.21.2.105:0/3516151395 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff3d014abe0 msgr2=0x7ff3d00a8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:28.887 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d5d70700 1 --2- 172.21.2.105:0/3516151395 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff3d014abe0 0x7ff3d00a8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:28.888 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d5d70700 1 -- 172.21.2.105:0/3516151395 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c8009530 con 0x7ff3d00ac280 2021-11-12T05:42:28.888 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.871+0000 7ff3d5d70700 1 --2- 172.21.2.105:0/3516151395 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3d00ac280 0x7ff3d0156c20 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7ff3cc002f70 tx=0x7ff3cc006e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:28.888 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.875+0000 7ff3c2ffd700 1 -- 172.21.2.105:0/3516151395 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3cc013460 con 0x7ff3d00ac280 2021-11-12T05:42:28.888 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.875+0000 7ff3c2ffd700 1 -- 172.21.2.105:0/3516151395 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3cc0135c0 con 0x7ff3d00ac280 2021-11-12T05:42:28.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.875+0000 7ff3c2ffd700 1 -- 172.21.2.105:0/3516151395 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3cc013920 con 0x7ff3d00ac280 2021-11-12T05:42:28.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.875+0000 7ff3d7fd4700 1 -- 172.21.2.105:0/3516151395 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3d0157870 con 0x7ff3d00ac280 2021-11-12T05:42:28.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.875+0000 7ff3d7fd4700 1 -- 172.21.2.105:0/3516151395 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3d0063350 con 0x7ff3d00ac280 2021-11-12T05:42:28.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.875+0000 7ff3d7fd4700 1 -- 172.21.2.105:0/3516151395 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3d0157a00 con 0x7ff3d00ac280 2021-11-12T05:42:28.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.875+0000 7ff3c2ffd700 1 -- 172.21.2.105:0/3516151395 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff3cc00f070 con 0x7ff3d00ac280 2021-11-12T05:42:28.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.875+0000 7ff3c2ffd700 1 --2- 172.21.2.105:0/3516151395 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff3b00536a0 0x7ff3b0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:28.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.875+0000 7ff3c2ffd700 1 -- 172.21.2.105:0/3516151395 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6416+0+0 (secure 0 0 0) 0x7ff3cc06b380 con 0x7ff3d00ac280 2021-11-12T05:42:28.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.875+0000 7ff3d556f700 1 --2- 172.21.2.105:0/3516151395 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff3b00536a0 0x7ff3b0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:28.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.875+0000 7ff3d556f700 1 --2- 172.21.2.105:0/3516151395 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff3b00536a0 0x7ff3b0055b60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7ff3c4002f70 tx=0x7ff3c4006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:28.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.875+0000 7ff3c2ffd700 1 -- 172.21.2.105:0/3516151395 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff3cc042390 con 0x7ff3d00ac280 2021-11-12T05:42:28.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.987+0000 7ff3d7fd4700 1 -- 172.21.2.105:0/3516151395 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7ff3d014b580 con 0x7ff3d00ac280 2021-11-12T05:42:28.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.991+0000 7ff3c2ffd700 1 -- 172.21.2.105:0/3516151395 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v17) v1 ==== 184+0+0 (secure 0 0 0) 0x7ff3cc0459b0 con 0x7ff3d00ac280 2021-11-12T05:42:28.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.995+0000 7ff3d7fd4700 1 -- 172.21.2.105:0/3516151395 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff3b00536a0 msgr2=0x7ff3b0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:28.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.995+0000 7ff3d7fd4700 1 --2- 172.21.2.105:0/3516151395 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff3b00536a0 0x7ff3b0055b60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7ff3c4002f70 tx=0x7ff3c4006a80).stop 2021-11-12T05:42:28.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.995+0000 7ff3d7fd4700 1 -- 172.21.2.105:0/3516151395 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3d00ac280 msgr2=0x7ff3d0156c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:28.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.995+0000 7ff3d7fd4700 1 --2- 172.21.2.105:0/3516151395 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3d00ac280 0x7ff3d0156c20 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7ff3cc002f70 tx=0x7ff3cc006e40).stop 2021-11-12T05:42:28.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.995+0000 7ff3d7fd4700 1 -- 172.21.2.105:0/3516151395 shutdown_connections 2021-11-12T05:42:28.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.995+0000 7ff3d7fd4700 1 --2- 172.21.2.105:0/3516151395 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff3b00536a0 0x7ff3b0055b60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:28.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.995+0000 7ff3d7fd4700 1 --2- 172.21.2.105:0/3516151395 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff3d014abe0 0x7ff3d00a8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:29.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.995+0000 7ff3d7fd4700 1 --2- 172.21.2.105:0/3516151395 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff3d00ad080 0x7ff3d00a94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:29.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.995+0000 7ff3d7fd4700 1 --2- 172.21.2.105:0/3516151395 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3d00ac280 0x7ff3d0156c20 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:29.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.995+0000 7ff3d7fd4700 1 -- 172.21.2.105:0/3516151395 >> 172.21.2.105:0/3516151395 conn(0x7ff3d00b5370 msgr2=0x7ff3d0146820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:29.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.995+0000 7ff3d7fd4700 1 -- 172.21.2.105:0/3516151395 shutdown_connections 2021-11-12T05:42:29.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:28.995+0000 7ff3d7fd4700 1 -- 172.21.2.105:0/3516151395 wait complete. 2021-11-12T05:42:29.001 INFO:teuthology.orchestra.run.gibba005.stderr:updated caps for client.1 2021-11-12T05:42:29.005 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-12T05:42:29.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.055+0000 7f4b7c341700 1 Processor -- start 2021-11-12T05:42:29.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.055+0000 7f4b7c341700 1 -- start start 2021-11-12T05:42:29.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.055+0000 7f4b7c341700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4b740ad080 0x7f4b740af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:29.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.055+0000 7f4b7c341700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b740ac7b0 con 0x7f4b7414b2f0 2021-11-12T05:42:29.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.055+0000 7f4b7c341700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b740ac9e0 con 0x7f4b740ac280 2021-11-12T05:42:29.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.055+0000 7f4b7c341700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b741488a0 con 0x7f4b740ad080 2021-11-12T05:42:29.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.055+0000 7f4b7a8de700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f4b7414b2f0 0x7f4b74147a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:55486/0 (socket says 172.21.2.105:55486) 2021-11-12T05:42:29.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.055+0000 7f4b7a8de700 1 -- 172.21.2.105:0/140531012 learned_addr learned my addr 172.21.2.105:0/140531012 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:42:29.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.055+0000 7f4b790db700 1 -- 172.21.2.105:0/140531012 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3876826094 0 0) 0x7f4b740ac7b0 con 0x7f4b7414b2f0 2021-11-12T05:42:29.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.055+0000 7f4b790db700 1 -- 172.21.2.105:0/140531012 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b5c003260 con 0x7f4b7414b2f0 2021-11-12T05:42:29.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.055+0000 7f4b790db700 1 -- 172.21.2.105:0/140531012 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3278922862 0 0) 0x7f4b5c003260 con 0x7f4b7414b2f0 2021-11-12T05:42:29.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.055+0000 7f4b790db700 1 -- 172.21.2.105:0/140531012 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4b740ad080 msgr2=0x7f4b740af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:29.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.055+0000 7f4b790db700 1 --2- 172.21.2.105:0/140531012 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4b740ad080 0x7f4b740af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:29.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.055+0000 7f4b790db700 1 -- 172.21.2.105:0/140531012 >> v1:172.21.2.115:6789/0 conn(0x7f4b740ac280 legacy=0x7f4b7414abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:29.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.055+0000 7f4b790db700 1 -- 172.21.2.105:0/140531012 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b740b0b30 con 0x7f4b7414b2f0 2021-11-12T05:42:29.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.055+0000 7f4b790db700 1 -- 172.21.2.105:0/140531012 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f4b6c0019e0 con 0x7f4b7414b2f0 2021-11-12T05:42:29.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.055+0000 7f4b790db700 1 -- 172.21.2.105:0/140531012 >> v1:172.21.2.105:6789/0 conn(0x7f4b7414b2f0 legacy=0x7f4b74147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:29.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.055+0000 7f4b790db700 1 --2- 172.21.2.105:0/140531012 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4b740ad080 0x7f4b5c003800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:29.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.055+0000 7f4b790db700 1 --2- 172.21.2.105:0/140531012 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4b5c003ef0 0x7f4b5c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:29.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.055+0000 7f4b790db700 1 --2- 172.21.2.105:0/140531012 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4b5c004bf0 0x7f4b5c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:29.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.055+0000 7f4b790db700 1 -- 172.21.2.105:0/140531012 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b741488a0 con 0x7f4b5c003ef0 2021-11-12T05:42:29.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.055+0000 7f4b790db700 1 -- 172.21.2.105:0/140531012 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c0052f0 con 0x7f4b5c004bf0 2021-11-12T05:42:29.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.055+0000 7f4b790db700 1 -- 172.21.2.105:0/140531012 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c00bc40 con 0x7f4b740ad080 2021-11-12T05:42:29.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.055+0000 7f4b798dc700 1 --2- 172.21.2.105:0/140531012 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4b5c003ef0 0x7f4b5c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:29.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.055+0000 7f4b798dc700 1 -- 172.21.2.105:0/140531012 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4b740ad080 msgr2=0x7f4b5c003800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:29.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.055+0000 7f4b798dc700 1 --2- 172.21.2.105:0/140531012 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4b740ad080 0x7f4b5c003800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:29.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.055+0000 7f4b798dc700 1 -- 172.21.2.105:0/140531012 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4b5c004bf0 msgr2=0x7f4b5c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:29.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.055+0000 7f4b798dc700 1 --2- 172.21.2.105:0/140531012 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4b5c004bf0 0x7f4b5c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:29.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.055+0000 7f4b798dc700 1 -- 172.21.2.105:0/140531012 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b5c003260 con 0x7f4b5c003ef0 2021-11-12T05:42:29.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.055+0000 7f4b798dc700 1 --2- 172.21.2.105:0/140531012 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4b5c003ef0 0x7f4b5c004500 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f4b70001fa0 tx=0x7f4b70007a00).ready entity=mon.0 client_cookie=30dd3b74d560c43e server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:29.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.055+0000 7f4b790db700 1 -- 172.21.2.105:0/140531012 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b70007d10 con 0x7f4b5c003ef0 2021-11-12T05:42:29.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.055+0000 7f4b790db700 1 -- 172.21.2.105:0/140531012 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b70007e70 con 0x7f4b5c003ef0 2021-11-12T05:42:29.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.055+0000 7f4b790db700 1 -- 172.21.2.105:0/140531012 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b70007220 con 0x7f4b5c003ef0 2021-11-12T05:42:29.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.055+0000 7f4b7c341700 1 -- 172.21.2.105:0/140531012 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4b5c003ef0 msgr2=0x7f4b5c004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:29.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.055+0000 7f4b7c341700 1 --2- 172.21.2.105:0/140531012 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4b5c003ef0 0x7f4b5c004500 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f4b70001fa0 tx=0x7f4b70007a00).stop 2021-11-12T05:42:29.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.059+0000 7f4b7a8de700 1 -- 172.21.2.105:0/140531012 reap_dead start 2021-11-12T05:42:29.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.059+0000 7f4b7c341700 1 -- 172.21.2.105:0/140531012 shutdown_connections 2021-11-12T05:42:29.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.059+0000 7f4b7c341700 1 -- 172.21.2.105:0/140531012 >> 172.21.2.105:0/140531012 conn(0x7f4b740b5370 msgr2=0x7f4b740b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:29.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.059+0000 7f4b7c341700 1 -- 172.21.2.105:0/140531012 shutdown_connections 2021-11-12T05:42:29.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.059+0000 7f4b7c341700 1 -- 172.21.2.105:0/140531012 wait complete. 2021-11-12T05:42:29.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.059+0000 7f4b7c341700 1 Processor -- start 2021-11-12T05:42:29.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.059+0000 7f4b7c341700 1 -- start start 2021-11-12T05:42:29.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.059+0000 7f4b7c341700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4b5c003ef0 0x7f4b7415a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:29.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.059+0000 7f4b7c341700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4b740a9d90 0x7f4b74144e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:29.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.059+0000 7f4b7c341700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4b740a9580 0x7f4b740aa420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:29.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.059+0000 7f4b7c341700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b74156770 con 0x7f4b740a9580 2021-11-12T05:42:29.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.059+0000 7f4b7c341700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b740ab2b0 con 0x7f4b5c003ef0 2021-11-12T05:42:29.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.059+0000 7f4b7c341700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b740ab550 con 0x7f4b740a9d90 2021-11-12T05:42:29.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.059+0000 7f4b7a8de700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4b740a9580 0x7f4b740aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:29.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.059+0000 7f4b7a8de700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4b740a9580 0x7f4b740aa420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45104/0 (socket says 172.21.2.105:45104) 2021-11-12T05:42:29.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.059+0000 7f4b7a8de700 1 -- 172.21.2.105:0/47630269 learned_addr learned my addr 172.21.2.105:0/47630269 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:29.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.059+0000 7f4b7a8de700 1 -- 172.21.2.105:0/47630269 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4b740a9d90 msgr2=0x7f4b74144e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:29.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.059+0000 7f4b7a8de700 1 --2- 172.21.2.105:0/47630269 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4b740a9d90 0x7f4b74144e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:29.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.059+0000 7f4b7a8de700 1 -- 172.21.2.105:0/47630269 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4b5c003ef0 msgr2=0x7f4b7415a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:29.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.059+0000 7f4b7a0dd700 1 --2- 172.21.2.105:0/47630269 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4b5c003ef0 0x7f4b7415a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:29.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.059+0000 7f4b7a8de700 1 --2- 172.21.2.105:0/47630269 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4b5c003ef0 0x7f4b7415a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:29.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.059+0000 7f4b7a8de700 1 -- 172.21.2.105:0/47630269 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b74145380 con 0x7f4b740a9580 2021-11-12T05:42:29.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.059+0000 7f4b7a8de700 1 --2- 172.21.2.105:0/47630269 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4b740a9580 0x7f4b740aa420 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f4b6c001490 tx=0x7f4b740b0fd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:29.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.059+0000 7f4b637fe700 1 -- 172.21.2.105:0/47630269 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b6c004ab0 con 0x7f4b740a9580 2021-11-12T05:42:29.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.059+0000 7f4b637fe700 1 -- 172.21.2.105:0/47630269 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6c004c10 con 0x7f4b740a9580 2021-11-12T05:42:29.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.059+0000 7f4b7c341700 1 -- 172.21.2.105:0/47630269 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b740aa910 con 0x7f4b740a9580 2021-11-12T05:42:29.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.059+0000 7f4b637fe700 1 -- 172.21.2.105:0/47630269 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b6c0070d0 con 0x7f4b740a9580 2021-11-12T05:42:29.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.059+0000 7f4b7c341700 1 -- 172.21.2.105:0/47630269 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b740aad90 con 0x7f4b740a9580 2021-11-12T05:42:29.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.059+0000 7f4b7c341700 1 -- 172.21.2.105:0/47630269 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b740ab710 con 0x7f4b740a9580 2021-11-12T05:42:29.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.059+0000 7f4b637fe700 1 -- 172.21.2.105:0/47630269 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4b6c01c070 con 0x7f4b740a9580 2021-11-12T05:42:29.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.059+0000 7f4b637fe700 1 --2- 172.21.2.105:0/47630269 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4b54053660 0x7f4b54055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:29.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.059+0000 7f4b637fe700 1 -- 172.21.2.105:0/47630269 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f4b6c06afe0 con 0x7f4b740a9580 2021-11-12T05:42:29.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.059+0000 7f4b7a0dd700 1 --2- 172.21.2.105:0/47630269 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4b54053660 0x7f4b54055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:29.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.059+0000 7f4b7a0dd700 1 --2- 172.21.2.105:0/47630269 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4b54053660 0x7f4b54055b20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f4b64007000 tx=0x7f4b64008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:29.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.063+0000 7f4b637fe700 1 -- 172.21.2.105:0/47630269 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4b6c041ee0 con 0x7f4b740a9580 2021-11-12T05:42:29.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.175+0000 7f4b7c341700 1 -- 172.21.2.105:0/47630269 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f4b740b1440 con 0x7f4b740a9580 2021-11-12T05:42:29.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.179+0000 7f4b637fe700 1 -- 172.21.2.105:0/47630269 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v18) v1 ==== 184+0+0 (secure 0 0 0) 0x7f4b6c045500 con 0x7f4b740a9580 2021-11-12T05:42:29.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.179+0000 7f4b7c341700 1 -- 172.21.2.105:0/47630269 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4b54053660 msgr2=0x7f4b54055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:29.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.179+0000 7f4b7c341700 1 --2- 172.21.2.105:0/47630269 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4b54053660 0x7f4b54055b20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f4b64007000 tx=0x7f4b64008040).stop 2021-11-12T05:42:29.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.183+0000 7f4b7c341700 1 -- 172.21.2.105:0/47630269 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4b740a9580 msgr2=0x7f4b740aa420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:29.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.183+0000 7f4b7c341700 1 --2- 172.21.2.105:0/47630269 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4b740a9580 0x7f4b740aa420 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f4b6c001490 tx=0x7f4b740b0fd0).stop 2021-11-12T05:42:29.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.183+0000 7f4b7c341700 1 -- 172.21.2.105:0/47630269 shutdown_connections 2021-11-12T05:42:29.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.183+0000 7f4b7c341700 1 --2- 172.21.2.105:0/47630269 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4b54053660 0x7f4b54055b20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:29.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.183+0000 7f4b7c341700 1 --2- 172.21.2.105:0/47630269 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4b740a9580 0x7f4b740aa420 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:29.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.183+0000 7f4b7c341700 1 --2- 172.21.2.105:0/47630269 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4b740a9d90 0x7f4b74144e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:29.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.183+0000 7f4b7c341700 1 --2- 172.21.2.105:0/47630269 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4b5c003ef0 0x7f4b7415a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:29.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.183+0000 7f4b7c341700 1 -- 172.21.2.105:0/47630269 >> 172.21.2.105:0/47630269 conn(0x7f4b740b5370 msgr2=0x7f4b74143a90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:29.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.183+0000 7f4b7c341700 1 -- 172.21.2.105:0/47630269 shutdown_connections 2021-11-12T05:42:29.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.183+0000 7f4b7c341700 1 -- 172.21.2.105:0/47630269 wait complete. 2021-11-12T05:42:29.189 INFO:teuthology.orchestra.run.gibba005.stderr:updated caps for client.2 2021-11-12T05:42:29.192 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:42:29.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbecbaaf700 1 Processor -- start 2021-11-12T05:42:29.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbecbaaf700 1 -- start start 2021-11-12T05:42:29.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbecbaaf700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fbec4064280 0x7fbec40b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:29.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbecbaaf700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbec40af0e0 con 0x7fbec40aed00 2021-11-12T05:42:29.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbecbaaf700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbec40638a0 con 0x7fbec40671d0 2021-11-12T05:42:29.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbecbaaf700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbec4063b40 con 0x7fbec4064280 2021-11-12T05:42:29.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbec984b700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fbec40aed00 0x7fbec4066ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:55506/0 (socket says 172.21.2.105:55506) 2021-11-12T05:42:29.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbec984b700 1 -- 172.21.2.105:0/300661037 learned_addr learned my addr 172.21.2.105:0/300661037 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:42:29.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbec8849700 1 -- 172.21.2.105:0/300661037 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3642592857 0 0) 0x7fbec40af0e0 con 0x7fbec40aed00 2021-11-12T05:42:29.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbec8849700 1 -- 172.21.2.105:0/300661037 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbeac003260 con 0x7fbec40aed00 2021-11-12T05:42:29.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbeca04c700 1 --2- 172.21.2.105:0/300661037 >> v2:172.21.2.115:3300/0 conn(0x7fbec4064280 0x7fbec40b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:29.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbec8849700 1 -- 172.21.2.105:0/300661037 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3294282703 0 0) 0x7fbeac003260 con 0x7fbec40aed00 2021-11-12T05:42:29.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbec8849700 1 -- 172.21.2.105:0/300661037 >> v2:172.21.2.115:3300/0 conn(0x7fbec4064280 msgr2=0x7fbec40b04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:29.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbec8849700 1 --2- 172.21.2.105:0/300661037 >> v2:172.21.2.115:3300/0 conn(0x7fbec4064280 0x7fbec40b04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:29.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbec8849700 1 -- 172.21.2.105:0/300661037 >> v1:172.21.2.115:6789/0 conn(0x7fbec40671d0 legacy=0x7fbec405f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:29.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbec8849700 1 -- 172.21.2.105:0/300661037 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec4063de0 con 0x7fbec40aed00 2021-11-12T05:42:29.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbec8849700 1 -- 172.21.2.105:0/300661037 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fbec0001660 con 0x7fbec40aed00 2021-11-12T05:42:29.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbec8849700 1 -- 172.21.2.105:0/300661037 >> v1:172.21.2.105:6789/0 conn(0x7fbec40aed00 legacy=0x7fbec4066ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:29.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbec8849700 1 --2- 172.21.2.105:0/300661037 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbeac003750 0x7fbeac003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:29.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbec8849700 1 --2- 172.21.2.105:0/300661037 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbeac004500 0x7fbeac004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:29.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbec8849700 1 --2- 172.21.2.105:0/300661037 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbeac004e70 0x7fbeac00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:29.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbec8849700 1 -- 172.21.2.105:0/300661037 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec4063b40 con 0x7fbeac004500 2021-11-12T05:42:29.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbec8849700 1 -- 172.21.2.105:0/300661037 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac00bd50 con 0x7fbeac003750 2021-11-12T05:42:29.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbec8849700 1 -- 172.21.2.105:0/300661037 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac00bf10 con 0x7fbeac004e70 2021-11-12T05:42:29.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbec904a700 1 --2- 172.21.2.105:0/300661037 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbeac004500 0x7fbeac004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:29.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbec984b700 1 --2- 172.21.2.105:0/300661037 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbeac003750 0x7fbeac003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:29.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbeca04c700 1 --2- 172.21.2.105:0/300661037 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbeac004e70 0x7fbeac00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:29.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbec904a700 1 -- 172.21.2.105:0/300661037 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbeac004e70 msgr2=0x7fbeac00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:29.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbec904a700 1 --2- 172.21.2.105:0/300661037 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbeac004e70 0x7fbeac00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:29.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbec904a700 1 -- 172.21.2.105:0/300661037 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbeac003750 msgr2=0x7fbeac003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:29.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbec904a700 1 --2- 172.21.2.105:0/300661037 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbeac003750 0x7fbeac003b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:29.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbec904a700 1 -- 172.21.2.105:0/300661037 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec4063de0 con 0x7fbeac004500 2021-11-12T05:42:29.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbeca04c700 1 -- 172.21.2.105:0/300661037 reap_dead start 2021-11-12T05:42:29.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbec904a700 1 --2- 172.21.2.105:0/300661037 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbeac004500 0x7fbeac004980 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7fbeb8001fa0 tx=0x7fbeb8007a00).ready entity=mon.0 client_cookie=4c5dfeabac7eb501 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:29.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbec8849700 1 -- 172.21.2.105:0/300661037 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbeb8007030 con 0x7fbeac004500 2021-11-12T05:42:29.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbec8849700 1 -- 172.21.2.105:0/300661037 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb8002e90 con 0x7fbeac004500 2021-11-12T05:42:29.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbec8849700 1 -- 172.21.2.105:0/300661037 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbeb8007380 con 0x7fbeac004500 2021-11-12T05:42:29.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbecbaaf700 1 -- 172.21.2.105:0/300661037 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbeac004500 msgr2=0x7fbeac004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:29.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbecbaaf700 1 --2- 172.21.2.105:0/300661037 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbeac004500 0x7fbeac004980 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7fbeb8001fa0 tx=0x7fbeb8007a00).stop 2021-11-12T05:42:29.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbecbaaf700 1 -- 172.21.2.105:0/300661037 shutdown_connections 2021-11-12T05:42:29.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbecbaaf700 1 --2- 172.21.2.105:0/300661037 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbeac004500 0x7fbeac004980 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:29.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbecbaaf700 1 -- 172.21.2.105:0/300661037 >> 172.21.2.105:0/300661037 conn(0x7fbec40b5370 msgr2=0x7fbec40b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:29.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbecbaaf700 1 -- 172.21.2.105:0/300661037 shutdown_connections 2021-11-12T05:42:29.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbecbaaf700 1 -- 172.21.2.105:0/300661037 wait complete. 2021-11-12T05:42:29.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbecbaaf700 1 Processor -- start 2021-11-12T05:42:29.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.239+0000 7fbecbaaf700 1 -- start start 2021-11-12T05:42:29.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.243+0000 7fbecbaaf700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbeac004500 0x7fbec4145ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:29.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.243+0000 7fbecbaaf700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbec40adf30 0x7fbec40a2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:29.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.243+0000 7fbecbaaf700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbec41524e0 0x7fbec4152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:29.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.243+0000 7fbecbaaf700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec40abeb0 con 0x7fbec41524e0 2021-11-12T05:42:29.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.243+0000 7fbecbaaf700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec41461c0 con 0x7fbec40adf30 2021-11-12T05:42:29.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.243+0000 7fbecbaaf700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec40ac0a0 con 0x7fbeac004500 2021-11-12T05:42:29.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.243+0000 7fbeca04c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbec41524e0 0x7fbec4152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:29.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.243+0000 7fbec984b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbeac004500 0x7fbec4145ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:29.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.243+0000 7fbeca04c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbec41524e0 0x7fbec4152960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45126/0 (socket says 172.21.2.105:45126) 2021-11-12T05:42:29.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.243+0000 7fbec984b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbeac004500 0x7fbec4145ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3301/0 says I am v2:172.21.2.105:36312/0 (socket says 172.21.2.105:36312) 2021-11-12T05:42:29.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.243+0000 7fbeca04c700 1 -- 172.21.2.105:0/4248307821 learned_addr learned my addr 172.21.2.105:0/4248307821 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:29.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.243+0000 7fbec904a700 1 --2- 172.21.2.105:0/4248307821 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbec40adf30 0x7fbec40a2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:29.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.243+0000 7fbeca04c700 1 -- 172.21.2.105:0/4248307821 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbeac004500 msgr2=0x7fbec4145ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:29.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.243+0000 7fbeca04c700 1 --2- 172.21.2.105:0/4248307821 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbeac004500 0x7fbec4145ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:29.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.243+0000 7fbeca04c700 1 -- 172.21.2.105:0/4248307821 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbec40adf30 msgr2=0x7fbec40a2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:29.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.243+0000 7fbeca04c700 1 --2- 172.21.2.105:0/4248307821 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbec40adf30 0x7fbec40a2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:29.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.243+0000 7fbeca04c700 1 -- 172.21.2.105:0/4248307821 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec40a6460 con 0x7fbec41524e0 2021-11-12T05:42:29.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.243+0000 7fbeca04c700 1 --2- 172.21.2.105:0/4248307821 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbec41524e0 0x7fbec4152960 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7fbebc00d000 tx=0x7fbebc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:29.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.243+0000 7fbeb6ffd700 1 -- 172.21.2.105:0/4248307821 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbebc0126d0 con 0x7fbec41524e0 2021-11-12T05:42:29.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.243+0000 7fbeb6ffd700 1 -- 172.21.2.105:0/4248307821 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbebc00c070 con 0x7fbec41524e0 2021-11-12T05:42:29.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.243+0000 7fbeb6ffd700 1 -- 172.21.2.105:0/4248307821 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbebc012a20 con 0x7fbec41524e0 2021-11-12T05:42:29.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.243+0000 7fbecbaaf700 1 -- 172.21.2.105:0/4248307821 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbec40a6180 con 0x7fbec41524e0 2021-11-12T05:42:29.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.243+0000 7fbecbaaf700 1 -- 172.21.2.105:0/4248307821 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbec40adb50 con 0x7fbec41524e0 2021-11-12T05:42:29.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.243+0000 7fbecbaaf700 1 -- 172.21.2.105:0/4248307821 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbec40a65f0 con 0x7fbec41524e0 2021-11-12T05:42:29.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.243+0000 7fbeb6ffd700 1 -- 172.21.2.105:0/4248307821 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbebc012040 con 0x7fbec41524e0 2021-11-12T05:42:29.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.243+0000 7fbeb6ffd700 1 --2- 172.21.2.105:0/4248307821 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbea4053660 0x7fbea4055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:29.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.243+0000 7fbeb6ffd700 1 -- 172.21.2.105:0/4248307821 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fbebc06bba0 con 0x7fbec41524e0 2021-11-12T05:42:29.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.243+0000 7fbec984b700 1 --2- 172.21.2.105:0/4248307821 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbea4053660 0x7fbea4055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:29.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.243+0000 7fbec984b700 1 --2- 172.21.2.105:0/4248307821 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbea4053660 0x7fbea4055b20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fbec000d000 tx=0x7fbec0007040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:29.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.247+0000 7fbeb6ffd700 1 -- 172.21.2.105:0/4248307821 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbebc042aa0 con 0x7fbec41524e0 2021-11-12T05:42:29.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.355+0000 7fbecbaaf700 1 -- 172.21.2.105:0/4248307821 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbec4057350 con 0x7fbec41524e0 2021-11-12T05:42:29.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.355+0000 7fbeb6ffd700 1 -- 172.21.2.105:0/4248307821 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+2138 (secure 0 0 0) 0x7fbebc0460c0 con 0x7fbec41524e0 2021-11-12T05:42:29.360 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:42:29.360 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":15,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4403,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/3185091424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":3185091424},{"type":"v1","addr":"172.21.2.115:6833","nonce":3185091424}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:42:27.265739+0000","modified":"2021-11-12T05:42:28.270769+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5250":{"gid":5250,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/3058129917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":3058129917},{"type":"v1","addr":"172.21.2.105:6835","nonce":3058129917}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-11-12T05:42:29.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.355+0000 7fbecbaaf700 1 -- 172.21.2.105:0/4248307821 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbea4053660 msgr2=0x7fbea4055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:29.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.355+0000 7fbecbaaf700 1 --2- 172.21.2.105:0/4248307821 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbea4053660 0x7fbea4055b20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fbec000d000 tx=0x7fbec0007040).stop 2021-11-12T05:42:29.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.355+0000 7fbecbaaf700 1 -- 172.21.2.105:0/4248307821 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbec41524e0 msgr2=0x7fbec4152960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:29.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.355+0000 7fbecbaaf700 1 --2- 172.21.2.105:0/4248307821 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbec41524e0 0x7fbec4152960 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7fbebc00d000 tx=0x7fbebc008040).stop 2021-11-12T05:42:29.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.355+0000 7fbecbaaf700 1 -- 172.21.2.105:0/4248307821 shutdown_connections 2021-11-12T05:42:29.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.355+0000 7fbecbaaf700 1 --2- 172.21.2.105:0/4248307821 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbea4053660 0x7fbea4055b20 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:29.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.355+0000 7fbecbaaf700 1 --2- 172.21.2.105:0/4248307821 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbec41524e0 0x7fbec4152960 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:29.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.355+0000 7fbecbaaf700 1 --2- 172.21.2.105:0/4248307821 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbec40adf30 0x7fbec40a2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:29.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.355+0000 7fbecbaaf700 1 --2- 172.21.2.105:0/4248307821 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbeac004500 0x7fbec4145ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:29.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.355+0000 7fbecbaaf700 1 -- 172.21.2.105:0/4248307821 >> 172.21.2.105:0/4248307821 conn(0x7fbec40b5370 msgr2=0x7fbec4065a20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:29.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.355+0000 7fbecbaaf700 1 -- 172.21.2.105:0/4248307821 shutdown_connections 2021-11-12T05:42:29.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.355+0000 7fbecbaaf700 1 -- 172.21.2.105:0/4248307821 wait complete. 2021-11-12T05:42:29.364 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 15 2021-11-12T05:42:29.569 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:42:27.265739+0000', 'modified': '2021-11-12T05:42:28.270769+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5250}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5250': {'gid': 5250, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/3058129917', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 3058129917}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 3058129917}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:42:29.570 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:42:29.570 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:42:29.634 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":5250,"want_state":"up:active","state":"up:active","rank_uptime":2.3616051730000001,"mdsmap_epoch":15,"osdmap_epoch":45,"osdmap_epoch_barrier":45,"uptime":6.5858029519999999} 2021-11-12T05:42:29.635 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 5250, "mdsmap_epoch": 15, "osdmap_epoch": 45, "osdmap_epoch_barrier": 45, "rank_uptime": 2.361605173, "state": "up:active", "uptime": 6.585802952, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:42:29.636 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:42:29.692 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.679+0000 7fef824ae700 1 Processor -- start 2021-11-12T05:42:29.692 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.679+0000 7fef824ae700 1 -- start start 2021-11-12T05:42:29.692 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.679+0000 7fef824ae700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fef7c0b2940 0x7fef7c142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:29.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.679+0000 7fef824ae700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fef7c0b0780 0x7fef7c1432b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:29.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.679+0000 7fef824ae700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef7c0b2d20 con 0x7fef7c0b0cc0 2021-11-12T05:42:29.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.679+0000 7fef824ae700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef7c0b1fc0 con 0x7fef7c0b2940 2021-11-12T05:42:29.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.679+0000 7fef824ae700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c0b15e0 con 0x7fef7c0b0780 2021-11-12T05:42:29.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef7bfff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fef7c0b2940 0x7fef7c142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:29.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef7bfff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fef7c0b2940 0x7fef7c142dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45130/0 (socket says 172.21.2.105:45130) 2021-11-12T05:42:29.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef7bfff700 1 -- 172.21.2.105:0/1332918425 learned_addr learned my addr 172.21.2.105:0/1332918425 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:29.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef7bfff700 1 -- 172.21.2.105:0/1332918425 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fef7c0b0780 msgr2=0x7fef7c1432b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:42:29.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef7bfff700 1 --2- 172.21.2.105:0/1332918425 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fef7c0b0780 0x7fef7c1432b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:29.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef7bfff700 1 -- 172.21.2.105:0/1332918425 >> v1:172.21.2.115:6789/0 conn(0x7fef7c0b0cc0 legacy=0x7fef7c13fad0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:42:29.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef7bfff700 1 -- 172.21.2.105:0/1332918425 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef7c0b1880 con 0x7fef7c0b2940 2021-11-12T05:42:29.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef7bfff700 1 --2- 172.21.2.105:0/1332918425 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fef7c0b2940 0x7fef7c142dc0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7fef7c060ba0 tx=0x7fef6c006f40).ready entity=mon.0 client_cookie=600c63251a524276 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:29.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef7affd700 1 -- 172.21.2.105:0/1332918425 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef6c00dc30 con 0x7fef7c0b2940 2021-11-12T05:42:29.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef7affd700 1 -- 172.21.2.105:0/1332918425 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6c000e90 con 0x7fef7c0b2940 2021-11-12T05:42:29.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef7affd700 1 -- 172.21.2.105:0/1332918425 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef6c00be90 con 0x7fef7c0b2940 2021-11-12T05:42:29.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef824ae700 1 -- 172.21.2.105:0/1332918425 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fef7c0b2940 msgr2=0x7fef7c142dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:29.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef824ae700 1 --2- 172.21.2.105:0/1332918425 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fef7c0b2940 0x7fef7c142dc0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7fef7c060ba0 tx=0x7fef6c006f40).stop 2021-11-12T05:42:29.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef824ae700 1 -- 172.21.2.105:0/1332918425 shutdown_connections 2021-11-12T05:42:29.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef824ae700 1 --2- 172.21.2.105:0/1332918425 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fef7c0b0780 0x7fef7c1432b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:29.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef824ae700 1 --2- 172.21.2.105:0/1332918425 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fef7c0b2940 0x7fef7c142dc0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:29.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef824ae700 1 -- 172.21.2.105:0/1332918425 >> 172.21.2.105:0/1332918425 conn(0x7fef7c068440 msgr2=0x7fef7c062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:29.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef824ae700 1 -- 172.21.2.105:0/1332918425 shutdown_connections 2021-11-12T05:42:29.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef824ae700 1 -- 172.21.2.105:0/1332918425 wait complete. 2021-11-12T05:42:29.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef824ae700 1 Processor -- start 2021-11-12T05:42:29.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef824ae700 1 -- start start 2021-11-12T05:42:29.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef824ae700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fef7c0b0780 0x7fef7c148320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:29.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef824ae700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fef7c0b0cc0 0x7fef7c140de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:29.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef824ae700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fef7c0b2940 0x7fef7c1443b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:29.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef824ae700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c1412d0 con 0x7fef7c0b2940 2021-11-12T05:42:29.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef824ae700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c1414b0 con 0x7fef7c0b0780 2021-11-12T05:42:29.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef824ae700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c143c70 con 0x7fef7c0b0cc0 2021-11-12T05:42:29.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef80a4b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fef7c0b2940 0x7fef7c1443b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:29.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef80a4b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fef7c0b2940 0x7fef7c1443b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45138/0 (socket says 172.21.2.105:45138) 2021-11-12T05:42:29.701 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef80a4b700 1 -- 172.21.2.105:0/962479203 learned_addr learned my addr 172.21.2.105:0/962479203 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:29.701 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef80a4b700 1 -- 172.21.2.105:0/962479203 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fef7c0b0cc0 msgr2=0x7fef7c140de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:29.701 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef80a4b700 1 --2- 172.21.2.105:0/962479203 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fef7c0b0cc0 0x7fef7c140de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:29.701 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef80a4b700 1 -- 172.21.2.105:0/962479203 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fef7c0b0780 msgr2=0x7fef7c148320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:29.702 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef80a4b700 1 --2- 172.21.2.105:0/962479203 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fef7c0b0780 0x7fef7c148320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:29.702 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef80a4b700 1 -- 172.21.2.105:0/962479203 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6c00b460 con 0x7fef7c0b2940 2021-11-12T05:42:29.702 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef80a4b700 1 --2- 172.21.2.105:0/962479203 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fef7c0b2940 0x7fef7c1443b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7fef74003330 tx=0x7fef740091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:29.702 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef797fa700 1 -- 172.21.2.105:0/962479203 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef74001520 con 0x7fef7c0b2940 2021-11-12T05:42:29.703 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef797fa700 1 -- 172.21.2.105:0/962479203 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef74001680 con 0x7fef7c0b2940 2021-11-12T05:42:29.703 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef797fa700 1 -- 172.21.2.105:0/962479203 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef740019e0 con 0x7fef7c0b2940 2021-11-12T05:42:29.703 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef824ae700 1 -- 172.21.2.105:0/962479203 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef7c143f10 con 0x7fef7c0b2940 2021-11-12T05:42:29.703 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.683+0000 7fef824ae700 1 -- 172.21.2.105:0/962479203 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef7c144a40 con 0x7fef7c0b2940 2021-11-12T05:42:29.704 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.687+0000 7fef824ae700 1 -- 172.21.2.105:0/962479203 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef7c1440d0 con 0x7fef7c0b2940 2021-11-12T05:42:29.704 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.687+0000 7fef797fa700 1 -- 172.21.2.105:0/962479203 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fef74018030 con 0x7fef7c0b2940 2021-11-12T05:42:29.704 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.687+0000 7fef797fa700 1 --2- 172.21.2.105:0/962479203 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fef5c0535b0 0x7fef5c055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:29.704 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.687+0000 7fef797fa700 1 -- 172.21.2.105:0/962479203 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fef7406b280 con 0x7fef7c0b2940 2021-11-12T05:42:29.704 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.687+0000 7fef7bfff700 1 --2- 172.21.2.105:0/962479203 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fef5c0535b0 0x7fef5c055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:29.705 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.687+0000 7fef7bfff700 1 --2- 172.21.2.105:0/962479203 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fef5c0535b0 0x7fef5c055a70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fef7c060ba0 tx=0x7fef7c0ae6d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:29.705 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.687+0000 7fef797fa700 1 -- 172.21.2.105:0/962479203 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fef74042340 con 0x7fef7c0b2940 2021-11-12T05:42:29.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.771+0000 7fef824ae700 1 -- 172.21.2.105:0/962479203 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef7c144a40 con 0x7fef7c0b2940 2021-11-12T05:42:29.776 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.771+0000 7fef797fa700 1 -- 172.21.2.105:0/962479203 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+16271 (secure 0 0 0) 0x7fef74023fa0 con 0x7fef7c0b2940 2021-11-12T05:42:29.777 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:42:29.777 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":45,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:42:28.269153+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:42:25.227892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-11-12T05:42:26.242644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:42:29.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.771+0000 7fef824ae700 1 -- 172.21.2.105:0/962479203 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fef5c0535b0 msgr2=0x7fef5c055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:29.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.771+0000 7fef824ae700 1 --2- 172.21.2.105:0/962479203 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fef5c0535b0 0x7fef5c055a70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fef7c060ba0 tx=0x7fef7c0ae6d0).stop 2021-11-12T05:42:29.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.771+0000 7fef824ae700 1 -- 172.21.2.105:0/962479203 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fef7c0b2940 msgr2=0x7fef7c1443b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:29.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.771+0000 7fef824ae700 1 --2- 172.21.2.105:0/962479203 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fef7c0b2940 0x7fef7c1443b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7fef74003330 tx=0x7fef740091a0).stop 2021-11-12T05:42:29.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.771+0000 7fef824ae700 1 -- 172.21.2.105:0/962479203 shutdown_connections 2021-11-12T05:42:29.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.771+0000 7fef824ae700 1 --2- 172.21.2.105:0/962479203 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fef5c0535b0 0x7fef5c055a70 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:29.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.771+0000 7fef824ae700 1 --2- 172.21.2.105:0/962479203 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fef7c0b2940 0x7fef7c1443b0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:29.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.771+0000 7fef824ae700 1 --2- 172.21.2.105:0/962479203 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fef7c0b0cc0 0x7fef7c140de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:29.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.771+0000 7fef824ae700 1 --2- 172.21.2.105:0/962479203 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fef7c0b0780 0x7fef7c148320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:29.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.771+0000 7fef824ae700 1 -- 172.21.2.105:0/962479203 >> 172.21.2.105:0/962479203 conn(0x7fef7c068440 msgr2=0x7fef7c0b5190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:29.781 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.771+0000 7fef824ae700 1 -- 172.21.2.105:0/962479203 shutdown_connections 2021-11-12T05:42:29.781 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.771+0000 7fef824ae700 1 -- 172.21.2.105:0/962479203 wait complete. 2021-11-12T05:42:29.784 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-12T05:42:25.227892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2021-11-12T05:42:26.242644+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-12T05:42:29.785 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:42:29.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.831+0000 7f63b1dfa700 1 Processor -- start 2021-11-12T05:42:29.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.831+0000 7f63b1dfa700 1 -- start start 2021-11-12T05:42:29.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.831+0000 7f63b1dfa700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f63ac0aca40 0x7f63ac0ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:29.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.831+0000 7f63b1dfa700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f63ac0b0520 0x7f63ac1473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:29.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.831+0000 7f63b1dfa700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63ac0b1840 con 0x7f63ac1478b0 2021-11-12T05:42:29.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.831+0000 7f63b1dfa700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63ac147d40 con 0x7f63ac0b0520 2021-11-12T05:42:29.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.831+0000 7f63b1dfa700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ac0af2b0 con 0x7f63ac0aca40 2021-11-12T05:42:29.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.831+0000 7f63ab7fe700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f63ac0aca40 0x7f63ac0ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:29.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.831+0000 7f63abfff700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7f63ac1478b0 0x7f63ac144180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:54012/0 (socket says 172.21.2.105:54012) 2021-11-12T05:42:29.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.831+0000 7f63aaffd700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f63ac0b0520 0x7f63ac1473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:29.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.831+0000 7f63abfff700 1 -- 172.21.2.105:0/3231960677 learned_addr learned my addr 172.21.2.105:0/3231960677 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:42:29.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.835+0000 7f63ab7fe700 1 -- 172.21.2.105:0/3231960677 >> v2:172.21.2.115:3300/0 conn(0x7f63ac0b0520 msgr2=0x7f63ac1473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:29.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.835+0000 7f63ab7fe700 1 --2- 172.21.2.105:0/3231960677 >> v2:172.21.2.115:3300/0 conn(0x7f63ac0b0520 0x7f63ac1473c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:29.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.835+0000 7f63ab7fe700 1 -- 172.21.2.105:0/3231960677 >> v1:172.21.2.115:6789/0 conn(0x7f63ac1478b0 legacy=0x7f63ac144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:29.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.835+0000 7f63ab7fe700 1 -- 172.21.2.105:0/3231960677 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ac0b09a0 con 0x7f63ac0aca40 2021-11-12T05:42:29.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.835+0000 7f63ab7fe700 1 --2- 172.21.2.105:0/3231960677 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f63ac0aca40 0x7f63ac0ace20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f6394002f70 tx=0x7f6394006df0).ready entity=mon.2 client_cookie=661fce804bdee1ff server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:29.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.835+0000 7f63aa7fc700 1 -- 172.21.2.105:0/3231960677 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f639400d570 con 0x7f63ac0aca40 2021-11-12T05:42:29.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.835+0000 7f63aa7fc700 1 -- 172.21.2.105:0/3231960677 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6394000e90 con 0x7f63ac0aca40 2021-11-12T05:42:29.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.835+0000 7f63aa7fc700 1 -- 172.21.2.105:0/3231960677 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f639400d8c0 con 0x7f63ac0aca40 2021-11-12T05:42:29.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.835+0000 7f63b1dfa700 1 -- 172.21.2.105:0/3231960677 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f63ac0aca40 msgr2=0x7f63ac0ace20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:29.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.835+0000 7f63b1dfa700 1 --2- 172.21.2.105:0/3231960677 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f63ac0aca40 0x7f63ac0ace20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f6394002f70 tx=0x7f6394006df0).stop 2021-11-12T05:42:29.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.835+0000 7f63b1dfa700 1 -- 172.21.2.105:0/3231960677 shutdown_connections 2021-11-12T05:42:29.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.835+0000 7f63b1dfa700 1 --2- 172.21.2.105:0/3231960677 >> v2:172.21.2.115:3300/0 conn(0x7f63ac0b0520 0x7f63ac1473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:29.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.835+0000 7f63b1dfa700 1 --2- 172.21.2.105:0/3231960677 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f63ac0aca40 0x7f63ac0ace20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:29.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.835+0000 7f63b1dfa700 1 -- 172.21.2.105:0/3231960677 >> 172.21.2.105:0/3231960677 conn(0x7f63ac05c490 msgr2=0x7f63ac0b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:29.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.835+0000 7f63b1dfa700 1 -- 172.21.2.105:0/3231960677 shutdown_connections 2021-11-12T05:42:29.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.835+0000 7f63b1dfa700 1 -- 172.21.2.105:0/3231960677 wait complete. 2021-11-12T05:42:29.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.835+0000 7f63b1dfa700 1 Processor -- start 2021-11-12T05:42:29.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.835+0000 7f63b1dfa700 1 -- start start 2021-11-12T05:42:29.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.835+0000 7f63b1dfa700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f63ac0aca40 0x7f63ac146250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:29.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.835+0000 7f63b1dfa700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f63ac0b0520 0x7f63ac064350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:29.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.835+0000 7f63b1dfa700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f63ac1478b0 0x7f63ac065e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:29.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.835+0000 7f63b1dfa700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ac063c80 con 0x7f63ac0b0520 2021-11-12T05:42:29.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.835+0000 7f63b1dfa700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ac063a70 con 0x7f63ac0aca40 2021-11-12T05:42:29.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.835+0000 7f63b1dfa700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ac0629e0 con 0x7f63ac1478b0 2021-11-12T05:42:29.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.839+0000 7f63aaffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f63ac0b0520 0x7f63ac064350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:29.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.839+0000 7f63aaffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f63ac0b0520 0x7f63ac064350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45152/0 (socket says 172.21.2.105:45152) 2021-11-12T05:42:29.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.839+0000 7f63aaffd700 1 -- 172.21.2.105:0/332971796 learned_addr learned my addr 172.21.2.105:0/332971796 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:29.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.839+0000 7f63abfff700 1 --2- 172.21.2.105:0/332971796 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f63ac1478b0 0x7f63ac065e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:29.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.839+0000 7f63ab7fe700 1 --2- 172.21.2.105:0/332971796 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f63ac0aca40 0x7f63ac146250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:29.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.839+0000 7f63aaffd700 1 -- 172.21.2.105:0/332971796 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f63ac1478b0 msgr2=0x7f63ac065e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:29.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.839+0000 7f63aaffd700 1 --2- 172.21.2.105:0/332971796 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f63ac1478b0 0x7f63ac065e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:29.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.839+0000 7f63aaffd700 1 -- 172.21.2.105:0/332971796 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f63ac0aca40 msgr2=0x7f63ac146250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:29.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.839+0000 7f63aaffd700 1 --2- 172.21.2.105:0/332971796 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f63ac0aca40 0x7f63ac146250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:29.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.839+0000 7f63aaffd700 1 -- 172.21.2.105:0/332971796 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f639400b180 con 0x7f63ac0b0520 2021-11-12T05:42:29.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.839+0000 7f63ab7fe700 1 --2- 172.21.2.105:0/332971796 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f63ac0aca40 0x7f63ac146250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:42:29.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.839+0000 7f63aaffd700 1 --2- 172.21.2.105:0/332971796 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f63ac0b0520 0x7f63ac064350 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f639c00c000 tx=0x7f639c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:29.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.839+0000 7f63a8ff9700 1 -- 172.21.2.105:0/332971796 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f639c010780 con 0x7f63ac0b0520 2021-11-12T05:42:29.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.839+0000 7f63a8ff9700 1 -- 172.21.2.105:0/332971796 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f639c0108e0 con 0x7f63ac0b0520 2021-11-12T05:42:29.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.839+0000 7f63a8ff9700 1 -- 172.21.2.105:0/332971796 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f639c010c40 con 0x7f63ac0b0520 2021-11-12T05:42:29.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.839+0000 7f63b1dfa700 1 -- 172.21.2.105:0/332971796 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63ac063eb0 con 0x7f63ac0b0520 2021-11-12T05:42:29.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.839+0000 7f63b1dfa700 1 -- 172.21.2.105:0/332971796 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63ac0649e0 con 0x7f63ac0b0520 2021-11-12T05:42:29.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.839+0000 7f63b1dfa700 1 -- 172.21.2.105:0/332971796 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63ac064040 con 0x7f63ac0b0520 2021-11-12T05:42:29.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.839+0000 7f63a8ff9700 1 -- 172.21.2.105:0/332971796 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f639c01c460 con 0x7f63ac0b0520 2021-11-12T05:42:29.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.839+0000 7f63a8ff9700 1 --2- 172.21.2.105:0/332971796 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6390053720 0x7f6390055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:29.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.839+0000 7f63a8ff9700 1 -- 172.21.2.105:0/332971796 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f639c06c060 con 0x7f63ac0b0520 2021-11-12T05:42:29.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.839+0000 7f63ab7fe700 1 --2- 172.21.2.105:0/332971796 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6390053720 0x7f6390055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:29.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.839+0000 7f63ab7fe700 1 --2- 172.21.2.105:0/332971796 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6390053720 0x7f6390055be0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f6394015000 tx=0x7f6394014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:29.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.843+0000 7f63a8ff9700 1 -- 172.21.2.105:0/332971796 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f639c042f00 con 0x7f63ac0b0520 2021-11-12T05:42:29.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.923+0000 7f63b1dfa700 1 -- 172.21.2.105:0/332971796 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f63ac05f280 con 0x7f63ac0b0520 2021-11-12T05:42:29.929 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.923+0000 7f63a8ff9700 1 -- 172.21.2.105:0/332971796 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v45) v1 ==== 110+0+10 (secure 0 0 0) 0x7f639c046520 con 0x7f63ac0b0520 2021-11-12T05:42:29.929 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:42:29.930 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.923+0000 7f63b1dfa700 1 -- 172.21.2.105:0/332971796 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6390053720 msgr2=0x7f6390055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:29.930 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.923+0000 7f63b1dfa700 1 --2- 172.21.2.105:0/332971796 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6390053720 0x7f6390055be0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f6394015000 tx=0x7f6394014000).stop 2021-11-12T05:42:29.930 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.923+0000 7f63b1dfa700 1 -- 172.21.2.105:0/332971796 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f63ac0b0520 msgr2=0x7f63ac064350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:29.931 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.923+0000 7f63b1dfa700 1 --2- 172.21.2.105:0/332971796 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f63ac0b0520 0x7f63ac064350 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f639c00c000 tx=0x7f639c006df0).stop 2021-11-12T05:42:29.931 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.923+0000 7f63b1dfa700 1 -- 172.21.2.105:0/332971796 shutdown_connections 2021-11-12T05:42:29.931 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.923+0000 7f63b1dfa700 1 --2- 172.21.2.105:0/332971796 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6390053720 0x7f6390055be0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:29.931 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.923+0000 7f63b1dfa700 1 --2- 172.21.2.105:0/332971796 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f63ac1478b0 0x7f63ac065e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:29.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.923+0000 7f63b1dfa700 1 --2- 172.21.2.105:0/332971796 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f63ac0b0520 0x7f63ac064350 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:29.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.923+0000 7f63b1dfa700 1 --2- 172.21.2.105:0/332971796 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f63ac0aca40 0x7f63ac146250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:29.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.923+0000 7f63b1dfa700 1 -- 172.21.2.105:0/332971796 >> 172.21.2.105:0/332971796 conn(0x7f63ac05c490 msgr2=0x7f63ac05bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:29.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.923+0000 7f63b1dfa700 1 -- 172.21.2.105:0/332971796 shutdown_connections 2021-11-12T05:42:29.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:29.923+0000 7f63b1dfa700 1 -- 172.21.2.105:0/332971796 wait complete. 2021-11-12T05:42:29.936 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:42:30.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.023+0000 7fd7a3a8a700 1 Processor -- start 2021-11-12T05:42:30.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.023+0000 7fd7a3a8a700 1 -- start start 2021-11-12T05:42:30.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.023+0000 7fd7a3a8a700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fd79c0ace20 0x7fd79c0b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:30.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.023+0000 7fd7a3a8a700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd79c144180 0x7fd79c1445f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:30.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.023+0000 7fd7a3a8a700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd79c0b1840 con 0x7fd79c0aca40 2021-11-12T05:42:30.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.023+0000 7fd7a3a8a700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd79c0b0a10 con 0x7fd79c144180 2021-11-12T05:42:30.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.023+0000 7fd7a3a8a700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd79c0af2b0 con 0x7fd79c0ace20 2021-11-12T05:42:30.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.023+0000 7fd7a1826700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fd79c0aca40 0x7fd79c1473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:55554/0 (socket says 172.21.2.105:55554) 2021-11-12T05:42:30.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.023+0000 7fd7a1826700 1 -- 172.21.2.105:0/3929281805 learned_addr learned my addr 172.21.2.105:0/3929281805 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:42:30.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.023+0000 7fd7a2027700 1 --2- 172.21.2.105:0/3929281805 >> v2:172.21.2.105:3300/0 conn(0x7fd79c144180 0x7fd79c1445f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:30.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.023+0000 7fd7a2027700 1 -- 172.21.2.105:0/3929281805 >> v2:172.21.2.115:3300/0 conn(0x7fd79c0ace20 msgr2=0x7fd79c0b0520 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:42:30.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.023+0000 7fd7a2027700 1 --2- 172.21.2.105:0/3929281805 >> v2:172.21.2.115:3300/0 conn(0x7fd79c0ace20 0x7fd79c0b0520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:30.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.023+0000 7fd7a2027700 1 -- 172.21.2.105:0/3929281805 >> v1:172.21.2.105:6789/0 conn(0x7fd79c0aca40 legacy=0x7fd79c1473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:30.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.023+0000 7fd7a2027700 1 -- 172.21.2.105:0/3929281805 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd79c0b1a70 con 0x7fd79c144180 2021-11-12T05:42:30.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.023+0000 7fd7a2027700 1 --2- 172.21.2.105:0/3929281805 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd79c144180 0x7fd79c1445f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7fd7940032f0 tx=0x7fd7940091d0).ready entity=mon.0 client_cookie=83ce9bc0536e983e server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:30.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.023+0000 7fd7a0824700 1 -- 172.21.2.105:0/3929281805 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd794009ea0 con 0x7fd79c144180 2021-11-12T05:42:30.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.023+0000 7fd7a0824700 1 -- 172.21.2.105:0/3929281805 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd79400b870 con 0x7fd79c144180 2021-11-12T05:42:30.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.023+0000 7fd7a0824700 1 -- 172.21.2.105:0/3929281805 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd79400ba20 con 0x7fd79c144180 2021-11-12T05:42:30.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.023+0000 7fd7a3a8a700 1 -- 172.21.2.105:0/3929281805 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd79c144180 msgr2=0x7fd79c1445f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:30.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.023+0000 7fd7a3a8a700 1 --2- 172.21.2.105:0/3929281805 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd79c144180 0x7fd79c1445f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7fd7940032f0 tx=0x7fd7940091d0).stop 2021-11-12T05:42:30.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.023+0000 7fd7a3a8a700 1 -- 172.21.2.105:0/3929281805 shutdown_connections 2021-11-12T05:42:30.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.023+0000 7fd7a3a8a700 1 --2- 172.21.2.105:0/3929281805 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd79c144180 0x7fd79c1445f0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:30.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.023+0000 7fd7a3a8a700 1 --2- 172.21.2.105:0/3929281805 >> v2:172.21.2.115:3300/0 conn(0x7fd79c0ace20 0x7fd79c0b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:30.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.023+0000 7fd7a3a8a700 1 -- 172.21.2.105:0/3929281805 >> 172.21.2.105:0/3929281805 conn(0x7fd79c05c490 msgr2=0x7fd79c0b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:30.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.023+0000 7fd7a3a8a700 1 -- 172.21.2.105:0/3929281805 shutdown_connections 2021-11-12T05:42:30.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.023+0000 7fd7a3a8a700 1 -- 172.21.2.105:0/3929281805 wait complete. 2021-11-12T05:42:30.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.023+0000 7fd7a3a8a700 1 Processor -- start 2021-11-12T05:42:30.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.027+0000 7fd7a3a8a700 1 -- start start 2021-11-12T05:42:30.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.027+0000 7fd7a3a8a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd79c0aca40 0x7fd79c146500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:30.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.027+0000 7fd7a3a8a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd79c0ace20 0x7fd79c144ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:30.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.027+0000 7fd7a3a8a700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd79c144180 0x7fd79c140140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:30.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.027+0000 7fd7a3a8a700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c1579c0 con 0x7fd79c0aca40 2021-11-12T05:42:30.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.027+0000 7fd7a3a8a700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c157190 con 0x7fd79c144180 2021-11-12T05:42:30.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.027+0000 7fd7a3a8a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd79c157400 con 0x7fd79c0ace20 2021-11-12T05:42:30.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.027+0000 7fd7a1826700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd79c0aca40 0x7fd79c146500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:30.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.027+0000 7fd7a1826700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd79c0aca40 0x7fd79c146500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45166/0 (socket says 172.21.2.105:45166) 2021-11-12T05:42:30.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.027+0000 7fd7a1826700 1 -- 172.21.2.105:0/1992922569 learned_addr learned my addr 172.21.2.105:0/1992922569 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:30.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.027+0000 7fd7a1826700 1 -- 172.21.2.105:0/1992922569 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd79c0ace20 msgr2=0x7fd79c144ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:30.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.027+0000 7fd7a1826700 1 --2- 172.21.2.105:0/1992922569 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd79c0ace20 0x7fd79c144ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:30.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.027+0000 7fd7a1826700 1 -- 172.21.2.105:0/1992922569 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd79c144180 msgr2=0x7fd79c140140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:30.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.027+0000 7fd7a1826700 1 --2- 172.21.2.105:0/1992922569 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd79c144180 0x7fd79c140140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:30.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.027+0000 7fd7a1826700 1 -- 172.21.2.105:0/1992922569 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd794009470 con 0x7fd79c0aca40 2021-11-12T05:42:30.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.027+0000 7fd7a1826700 1 --2- 172.21.2.105:0/1992922569 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd79c0aca40 0x7fd79c146500 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7fd79c157320 tx=0x7fd790007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:30.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.027+0000 7fd78effd700 1 -- 172.21.2.105:0/1992922569 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd79000ce20 con 0x7fd79c0aca40 2021-11-12T05:42:30.042 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.027+0000 7fd78effd700 1 -- 172.21.2.105:0/1992922569 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7900072e0 con 0x7fd79c0aca40 2021-11-12T05:42:30.042 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.027+0000 7fd78effd700 1 -- 172.21.2.105:0/1992922569 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd790005800 con 0x7fd79c0aca40 2021-11-12T05:42:30.042 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.027+0000 7fd7a3a8a700 1 -- 172.21.2.105:0/1992922569 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd79c1576a0 con 0x7fd79c0aca40 2021-11-12T05:42:30.042 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.027+0000 7fd7a3a8a700 1 -- 172.21.2.105:0/1992922569 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd79c148270 con 0x7fd79c0aca40 2021-11-12T05:42:30.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.027+0000 7fd7a3a8a700 1 -- 172.21.2.105:0/1992922569 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd79c057350 con 0x7fd79c0aca40 2021-11-12T05:42:30.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.027+0000 7fd78effd700 1 -- 172.21.2.105:0/1992922569 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd790010070 con 0x7fd79c0aca40 2021-11-12T05:42:30.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.027+0000 7fd78effd700 1 --2- 172.21.2.105:0/1992922569 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd77c053660 0x7fd77c055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:30.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.027+0000 7fd78effd700 1 -- 172.21.2.105:0/1992922569 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fd79006b210 con 0x7fd79c0aca40 2021-11-12T05:42:30.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.027+0000 7fd7a1025700 1 --2- 172.21.2.105:0/1992922569 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd77c053660 0x7fd77c055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:30.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.027+0000 7fd7a1025700 1 --2- 172.21.2.105:0/1992922569 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd77c053660 0x7fd77c055b20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7fd798002fb0 tx=0x7fd7980069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:30.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.031+0000 7fd78effd700 1 -- 172.21.2.105:0/1992922569 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd790042110 con 0x7fd79c0aca40 2021-11-12T05:42:30.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.115+0000 7fd7a3a8a700 1 -- 172.21.2.105:0/1992922569 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd79c146c90 con 0x7fd79c0aca40 2021-11-12T05:42:30.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.115+0000 7fd78effd700 1 -- 172.21.2.105:0/1992922569 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v45) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd790045730 con 0x7fd79c0aca40 2021-11-12T05:42:30.120 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:42:30.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.115+0000 7fd7a3a8a700 1 -- 172.21.2.105:0/1992922569 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd77c053660 msgr2=0x7fd77c055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:30.121 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.115+0000 7fd7a3a8a700 1 --2- 172.21.2.105:0/1992922569 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd77c053660 0x7fd77c055b20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7fd798002fb0 tx=0x7fd7980069b0).stop 2021-11-12T05:42:30.121 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.115+0000 7fd7a3a8a700 1 -- 172.21.2.105:0/1992922569 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd79c0aca40 msgr2=0x7fd79c146500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:30.121 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.115+0000 7fd7a3a8a700 1 --2- 172.21.2.105:0/1992922569 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd79c0aca40 0x7fd79c146500 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7fd79c157320 tx=0x7fd790007c40).stop 2021-11-12T05:42:30.121 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.115+0000 7fd7a3a8a700 1 -- 172.21.2.105:0/1992922569 shutdown_connections 2021-11-12T05:42:30.121 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.115+0000 7fd7a3a8a700 1 --2- 172.21.2.105:0/1992922569 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd77c053660 0x7fd77c055b20 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:30.122 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.115+0000 7fd7a3a8a700 1 --2- 172.21.2.105:0/1992922569 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd79c144180 0x7fd79c140140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:30.122 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.115+0000 7fd7a3a8a700 1 --2- 172.21.2.105:0/1992922569 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd79c0ace20 0x7fd79c144ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:30.122 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.115+0000 7fd7a3a8a700 1 --2- 172.21.2.105:0/1992922569 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd79c0aca40 0x7fd79c146500 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:30.122 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.115+0000 7fd7a3a8a700 1 -- 172.21.2.105:0/1992922569 >> 172.21.2.105:0/1992922569 conn(0x7fd79c05c490 msgr2=0x7fd79c149c80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:30.123 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.115+0000 7fd7a3a8a700 1 -- 172.21.2.105:0/1992922569 shutdown_connections 2021-11-12T05:42:30.123 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.115+0000 7fd7a3a8a700 1 -- 172.21.2.105:0/1992922569 wait complete. 2021-11-12T05:42:30.127 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-12T05:42:30.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.175+0000 7f7073172700 1 Processor -- start 2021-11-12T05:42:30.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.175+0000 7f7073172700 1 -- start start 2021-11-12T05:42:30.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.175+0000 7f7073172700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f706c0b1cd0 0x7f706c0ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:30.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.175+0000 7f7073172700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f706c0aa700 0x7f706c0ac270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:30.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.175+0000 7f7073172700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f706c0b20b0 con 0x7f706c0b0e60 2021-11-12T05:42:30.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.175+0000 7f7073172700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f706c0b2870 con 0x7f706c0aa700 2021-11-12T05:42:30.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.175+0000 7f7073172700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f706c0b13e0 con 0x7f706c0b1cd0 2021-11-12T05:42:30.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.175+0000 7f706bfff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f706c0b0e60 0x7f706c0abb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:55572/0 (socket says 172.21.2.105:55572) 2021-11-12T05:42:30.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.175+0000 7f706bfff700 1 -- 172.21.2.105:0/3098408524 learned_addr learned my addr 172.21.2.105:0/3098408524 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:42:30.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.175+0000 7f707170f700 1 --2- 172.21.2.105:0/3098408524 >> v2:172.21.2.105:3300/0 conn(0x7f706c0aa700 0x7f706c0ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:30.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.175+0000 7f706b7fe700 1 -- 172.21.2.105:0/3098408524 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2713236946 0 0) 0x7f706c0b20b0 con 0x7f706c0b0e60 2021-11-12T05:42:30.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.175+0000 7f706b7fe700 1 -- 172.21.2.105:0/3098408524 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f704c003260 con 0x7f706c0b0e60 2021-11-12T05:42:30.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.175+0000 7f707170f700 1 -- 172.21.2.105:0/3098408524 >> v2:172.21.2.115:3300/0 conn(0x7f706c0b1cd0 msgr2=0x7f706c0ad2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:30.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.175+0000 7f707170f700 1 --2- 172.21.2.105:0/3098408524 >> v2:172.21.2.115:3300/0 conn(0x7f706c0b1cd0 0x7f706c0ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:30.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.175+0000 7f707170f700 1 -- 172.21.2.105:0/3098408524 >> v1:172.21.2.105:6789/0 conn(0x7f706c0b0e60 legacy=0x7f706c0abb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:30.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.175+0000 7f707170f700 1 -- 172.21.2.105:0/3098408524 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706c0ace10 con 0x7f706c0aa700 2021-11-12T05:42:30.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.175+0000 7f707170f700 1 --2- 172.21.2.105:0/3098408524 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f706c0aa700 0x7f706c0ac270 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f70640032f0 tx=0x7f70640091d0).ready entity=mon.0 client_cookie=8372bd22b5f5a5d9 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:30.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.175+0000 7f706b7fe700 1 -- 172.21.2.105:0/3098408524 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f706400b680 con 0x7f706c0aa700 2021-11-12T05:42:30.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.175+0000 7f706b7fe700 1 -- 172.21.2.105:0/3098408524 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706400b7e0 con 0x7f706c0aa700 2021-11-12T05:42:30.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.175+0000 7f706b7fe700 1 -- 172.21.2.105:0/3098408524 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f706400b950 con 0x7f706c0aa700 2021-11-12T05:42:30.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.175+0000 7f7073172700 1 -- 172.21.2.105:0/3098408524 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f706c0aa700 msgr2=0x7f706c0ac270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:30.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.175+0000 7f7073172700 1 --2- 172.21.2.105:0/3098408524 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f706c0aa700 0x7f706c0ac270 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f70640032f0 tx=0x7f70640091d0).stop 2021-11-12T05:42:30.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.175+0000 7f7073172700 1 -- 172.21.2.105:0/3098408524 shutdown_connections 2021-11-12T05:42:30.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.175+0000 7f7073172700 1 --2- 172.21.2.105:0/3098408524 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f706c0aa700 0x7f706c0ac270 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:30.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.175+0000 7f7073172700 1 --2- 172.21.2.105:0/3098408524 >> v2:172.21.2.115:3300/0 conn(0x7f706c0b1cd0 0x7f706c0ad2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:30.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.175+0000 7f7073172700 1 -- 172.21.2.105:0/3098408524 >> 172.21.2.105:0/3098408524 conn(0x7f706c063610 msgr2=0x7f706c0639f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:30.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.175+0000 7f7073172700 1 -- 172.21.2.105:0/3098408524 shutdown_connections 2021-11-12T05:42:30.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.175+0000 7f7073172700 1 -- 172.21.2.105:0/3098408524 wait complete. 2021-11-12T05:42:30.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.179+0000 7f7073172700 1 Processor -- start 2021-11-12T05:42:30.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.179+0000 7f7073172700 1 -- start start 2021-11-12T05:42:30.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.179+0000 7f7073172700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f706c0aa700 0x7f706c09ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:30.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.179+0000 7f7073172700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f706c0b0e60 0x7f706c156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:30.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.179+0000 7f7073172700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f706c0b1cd0 0x7f706c157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:30.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.179+0000 7f7073172700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706c09f0a0 con 0x7f706c0b0e60 2021-11-12T05:42:30.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.179+0000 7f7073172700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706c09f280 con 0x7f706c0aa700 2021-11-12T05:42:30.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.179+0000 7f7073172700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f706c0668a0 con 0x7f706c0b1cd0 2021-11-12T05:42:30.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.179+0000 7f706bfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f706c0b0e60 0x7f706c156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:30.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.179+0000 7f706bfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f706c0b0e60 0x7f706c156d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45178/0 (socket says 172.21.2.105:45178) 2021-11-12T05:42:30.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.179+0000 7f706bfff700 1 -- 172.21.2.105:0/1626072048 learned_addr learned my addr 172.21.2.105:0/1626072048 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:30.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.179+0000 7f706bfff700 1 -- 172.21.2.105:0/1626072048 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f706c0b1cd0 msgr2=0x7f706c157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:30.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.179+0000 7f706bfff700 1 --2- 172.21.2.105:0/1626072048 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f706c0b1cd0 0x7f706c157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:30.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.179+0000 7f706bfff700 1 -- 172.21.2.105:0/1626072048 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f706c0aa700 msgr2=0x7f706c09ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:30.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.179+0000 7f706bfff700 1 --2- 172.21.2.105:0/1626072048 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f706c0aa700 0x7f706c09ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:30.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.179+0000 7f706bfff700 1 -- 172.21.2.105:0/1626072048 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7064009470 con 0x7f706c0b0e60 2021-11-12T05:42:30.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.179+0000 7f706bfff700 1 --2- 172.21.2.105:0/1626072048 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f706c0b0e60 0x7f706c156d60 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f705c001110 tx=0x7f705c007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:30.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.179+0000 7f7069ffb700 1 -- 172.21.2.105:0/1626072048 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f705c0072e0 con 0x7f706c0b0e60 2021-11-12T05:42:30.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.179+0000 7f7069ffb700 1 -- 172.21.2.105:0/1626072048 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705c007440 con 0x7f706c0b0e60 2021-11-12T05:42:30.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.179+0000 7f7069ffb700 1 -- 172.21.2.105:0/1626072048 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f705c005800 con 0x7f706c0b0e60 2021-11-12T05:42:30.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.179+0000 7f7073172700 1 -- 172.21.2.105:0/1626072048 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f706c157740 con 0x7f706c0b0e60 2021-11-12T05:42:30.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.179+0000 7f7073172700 1 -- 172.21.2.105:0/1626072048 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f706c066cf0 con 0x7f706c0b0e60 2021-11-12T05:42:30.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.179+0000 7f7073172700 1 -- 172.21.2.105:0/1626072048 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f706c09f440 con 0x7f706c0b0e60 2021-11-12T05:42:30.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.179+0000 7f7069ffb700 1 -- 172.21.2.105:0/1626072048 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f705c010070 con 0x7f706c0b0e60 2021-11-12T05:42:30.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.179+0000 7f7069ffb700 1 --2- 172.21.2.105:0/1626072048 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7050053640 0x7f7050055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:30.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.179+0000 7f7069ffb700 1 -- 172.21.2.105:0/1626072048 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f705c06b240 con 0x7f706c0b0e60 2021-11-12T05:42:30.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.179+0000 7f7070f0e700 1 --2- 172.21.2.105:0/1626072048 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7050053640 0x7f7050055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:30.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.179+0000 7f7070f0e700 1 --2- 172.21.2.105:0/1626072048 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7050053640 0x7f7050055b00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f7054002f70 tx=0x7f70540069e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:30.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.183+0000 7f7069ffb700 1 -- 172.21.2.105:0/1626072048 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f705c042250 con 0x7f706c0b0e60 2021-11-12T05:42:30.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.267+0000 7f7073172700 1 -- 172.21.2.105:0/1626072048 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f706c0acb50 con 0x7f706c0b0e60 2021-11-12T05:42:30.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.267+0000 7f7069ffb700 1 -- 172.21.2.105:0/1626072048 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v45) v1 ==== 104+0+10 (secure 0 0 0) 0x7f705c045870 con 0x7f706c0b0e60 2021-11-12T05:42:30.272 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:42:30.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.267+0000 7f7073172700 1 -- 172.21.2.105:0/1626072048 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7050053640 msgr2=0x7f7050055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:30.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.267+0000 7f7073172700 1 --2- 172.21.2.105:0/1626072048 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7050053640 0x7f7050055b00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f7054002f70 tx=0x7f70540069e0).stop 2021-11-12T05:42:30.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.267+0000 7f7073172700 1 -- 172.21.2.105:0/1626072048 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f706c0b0e60 msgr2=0x7f706c156d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:30.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.267+0000 7f7073172700 1 --2- 172.21.2.105:0/1626072048 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f706c0b0e60 0x7f706c156d60 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f705c001110 tx=0x7f705c007ad0).stop 2021-11-12T05:42:30.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.267+0000 7f7073172700 1 -- 172.21.2.105:0/1626072048 shutdown_connections 2021-11-12T05:42:30.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.267+0000 7f7073172700 1 --2- 172.21.2.105:0/1626072048 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7050053640 0x7f7050055b00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:30.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.267+0000 7f7073172700 1 --2- 172.21.2.105:0/1626072048 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f706c0b1cd0 0x7f706c157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:30.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.267+0000 7f7073172700 1 --2- 172.21.2.105:0/1626072048 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f706c0b0e60 0x7f706c156d60 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:30.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.267+0000 7f7073172700 1 --2- 172.21.2.105:0/1626072048 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f706c0aa700 0x7f706c09ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:30.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.267+0000 7f7073172700 1 -- 172.21.2.105:0/1626072048 >> 172.21.2.105:0/1626072048 conn(0x7f706c063610 msgr2=0x7f706c141860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:30.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.267+0000 7f7073172700 1 -- 172.21.2.105:0/1626072048 shutdown_connections 2021-11-12T05:42:30.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.267+0000 7f7073172700 1 -- 172.21.2.105:0/1626072048 wait complete. 2021-11-12T05:42:30.278 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-12T05:42:30.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe68578f700 1 Processor -- start 2021-11-12T05:42:30.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe68578f700 1 -- start start 2021-11-12T05:42:30.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe68578f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe6800ae090 0x7fe680140d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:30.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe68578f700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fe6800b3980 0x7fe6800b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:30.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe68578f700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6800b7ee0 con 0x7fe6800b7b00 2021-11-12T05:42:30.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe68578f700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6800b2030 con 0x7fe6800b3980 2021-11-12T05:42:30.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe68578f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6800b22d0 con 0x7fe6800ae090 2021-11-12T05:42:30.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe67effd700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fe6800b7b00 0x7fe6800b2a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:55582/0 (socket says 172.21.2.105:55582) 2021-11-12T05:42:30.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe67effd700 1 -- 172.21.2.105:0/3461499486 learned_addr learned my addr 172.21.2.105:0/3461499486 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:42:30.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe67dffb700 1 -- 172.21.2.105:0/3461499486 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4274323386 0 0) 0x7fe6800b7ee0 con 0x7fe6800b7b00 2021-11-12T05:42:30.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe67dffb700 1 -- 172.21.2.105:0/3461499486 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe664003260 con 0x7fe6800b7b00 2021-11-12T05:42:30.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe67dffb700 1 -- 172.21.2.105:0/3461499486 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2582282189 0 0) 0x7fe664003260 con 0x7fe6800b7b00 2021-11-12T05:42:30.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe67dffb700 1 -- 172.21.2.105:0/3461499486 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe6800ae090 msgr2=0x7fe680140d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:30.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe67dffb700 1 --2- 172.21.2.105:0/3461499486 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe6800ae090 0x7fe680140d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:30.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe67dffb700 1 -- 172.21.2.105:0/3461499486 >> v2:172.21.2.115:3300/0 conn(0x7fe6800b3980 msgr2=0x7fe6800b3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:30.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe67dffb700 1 --2- 172.21.2.105:0/3461499486 >> v2:172.21.2.115:3300/0 conn(0x7fe6800b3980 0x7fe6800b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:30.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe67dffb700 1 -- 172.21.2.105:0/3461499486 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6800b2570 con 0x7fe6800b7b00 2021-11-12T05:42:30.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe67dffb700 1 -- 172.21.2.105:0/3461499486 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fe670001660 con 0x7fe6800b7b00 2021-11-12T05:42:30.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe67dffb700 1 -- 172.21.2.105:0/3461499486 >> v1:172.21.2.105:6789/0 conn(0x7fe6800b7b00 legacy=0x7fe6800b2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:30.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe67dffb700 1 --2- 172.21.2.105:0/3461499486 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe6640037d0 0x7fe664003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:30.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe67dffb700 1 --2- 172.21.2.105:0/3461499486 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe6800ae090 0x7fe664004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:30.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe67dffb700 1 --2- 172.21.2.105:0/3461499486 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe664004bf0 0x7fe66400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:30.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe67dffb700 1 -- 172.21.2.105:0/3461499486 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6800b2030 con 0x7fe664004bf0 2021-11-12T05:42:30.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe67dffb700 1 -- 172.21.2.105:0/3461499486 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6800b22d0 con 0x7fe6640037d0 2021-11-12T05:42:30.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe67dffb700 1 -- 172.21.2.105:0/3461499486 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe664005300 con 0x7fe6800ae090 2021-11-12T05:42:30.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe67f7fe700 1 --2- 172.21.2.105:0/3461499486 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe664004bf0 0x7fe66400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:30.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe67effd700 1 --2- 172.21.2.105:0/3461499486 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe6640037d0 0x7fe664003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:30.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe67e7fc700 1 --2- 172.21.2.105:0/3461499486 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe6800ae090 0x7fe664004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:30.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe67f7fe700 1 -- 172.21.2.105:0/3461499486 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe6800ae090 msgr2=0x7fe664004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:30.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe67f7fe700 1 --2- 172.21.2.105:0/3461499486 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe6800ae090 0x7fe664004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:30.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe67f7fe700 1 -- 172.21.2.105:0/3461499486 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe6640037d0 msgr2=0x7fe664003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:30.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe67f7fe700 1 --2- 172.21.2.105:0/3461499486 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe6640037d0 0x7fe664003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:30.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe67f7fe700 1 -- 172.21.2.105:0/3461499486 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe664003260 con 0x7fe664004bf0 2021-11-12T05:42:30.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe67f7fe700 1 --2- 172.21.2.105:0/3461499486 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe664004bf0 0x7fe66400b750 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7fe6780032f0 tx=0x7fe678006f90).ready entity=mon.0 client_cookie=9b3ee4be8f3e055a server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:30.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe67dffb700 1 -- 172.21.2.105:0/3461499486 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe67800b460 con 0x7fe664004bf0 2021-11-12T05:42:30.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe67dffb700 1 -- 172.21.2.105:0/3461499486 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe67800b5c0 con 0x7fe664004bf0 2021-11-12T05:42:30.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe67dffb700 1 -- 172.21.2.105:0/3461499486 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe67800b730 con 0x7fe664004bf0 2021-11-12T05:42:30.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe68578f700 1 -- 172.21.2.105:0/3461499486 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe664004bf0 msgr2=0x7fe66400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:30.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe68578f700 1 --2- 172.21.2.105:0/3461499486 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe664004bf0 0x7fe66400b750 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7fe6780032f0 tx=0x7fe678006f90).stop 2021-11-12T05:42:30.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe67f7fe700 1 -- 172.21.2.105:0/3461499486 reap_dead start 2021-11-12T05:42:30.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe68578f700 1 -- 172.21.2.105:0/3461499486 shutdown_connections 2021-11-12T05:42:30.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe68578f700 1 -- 172.21.2.105:0/3461499486 >> 172.21.2.105:0/3461499486 conn(0x7fe6800608d0 msgr2=0x7fe68005c490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:30.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe68578f700 1 -- 172.21.2.105:0/3461499486 shutdown_connections 2021-11-12T05:42:30.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe68578f700 1 -- 172.21.2.105:0/3461499486 wait complete. 2021-11-12T05:42:30.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe68578f700 1 Processor -- start 2021-11-12T05:42:30.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.327+0000 7fe68578f700 1 -- start start 2021-11-12T05:42:30.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.331+0000 7fe68578f700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe680066590 0x7fe6800b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:30.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.331+0000 7fe68578f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe6801437b0 0x7fe6801502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:30.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.331+0000 7fe68578f700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe680067320 0x7fe68013cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:30.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.331+0000 7fe68578f700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6800af720 con 0x7fe680066590 2021-11-12T05:42:30.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.331+0000 7fe68578f700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe680144350 con 0x7fe680067320 2021-11-12T05:42:30.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.331+0000 7fe68578f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6800af220 con 0x7fe6801437b0 2021-11-12T05:42:30.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.331+0000 7fe67effd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe680066590 0x7fe6800b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:30.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.331+0000 7fe67effd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe680066590 0x7fe6800b1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45200/0 (socket says 172.21.2.105:45200) 2021-11-12T05:42:30.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.331+0000 7fe67effd700 1 -- 172.21.2.105:0/2378842066 learned_addr learned my addr 172.21.2.105:0/2378842066 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:30.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.331+0000 7fe67effd700 1 -- 172.21.2.105:0/2378842066 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe6801437b0 msgr2=0x7fe6801502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:30.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.331+0000 7fe67effd700 1 --2- 172.21.2.105:0/2378842066 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe6801437b0 0x7fe6801502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:30.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.331+0000 7fe67effd700 1 -- 172.21.2.105:0/2378842066 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe680067320 msgr2=0x7fe68013cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:30.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.331+0000 7fe67effd700 1 --2- 172.21.2.105:0/2378842066 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe680067320 0x7fe68013cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:30.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.331+0000 7fe67effd700 1 -- 172.21.2.105:0/2378842066 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6800af480 con 0x7fe680066590 2021-11-12T05:42:30.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.331+0000 7fe67effd700 1 --2- 172.21.2.105:0/2378842066 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe680066590 0x7fe6800b1080 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7fe67000b000 tx=0x7fe6800b2700).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:30.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.331+0000 7fe66ffff700 1 -- 172.21.2.105:0/2378842066 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe670010680 con 0x7fe680066590 2021-11-12T05:42:30.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.331+0000 7fe66ffff700 1 -- 172.21.2.105:0/2378842066 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe670010040 con 0x7fe680066590 2021-11-12T05:42:30.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.331+0000 7fe68578f700 1 -- 172.21.2.105:0/2378842066 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6800b0be0 con 0x7fe680066590 2021-11-12T05:42:30.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.331+0000 7fe66ffff700 1 -- 172.21.2.105:0/2378842066 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6700109d0 con 0x7fe680066590 2021-11-12T05:42:30.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.331+0000 7fe68578f700 1 -- 172.21.2.105:0/2378842066 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6800b1570 con 0x7fe680066590 2021-11-12T05:42:30.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.331+0000 7fe68578f700 1 -- 172.21.2.105:0/2378842066 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe680057350 con 0x7fe680066590 2021-11-12T05:42:30.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.331+0000 7fe66ffff700 1 -- 172.21.2.105:0/2378842066 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe670010b30 con 0x7fe680066590 2021-11-12T05:42:30.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.331+0000 7fe66ffff700 1 --2- 172.21.2.105:0/2378842066 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe65c053600 0x7fe65c055ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:30.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.331+0000 7fe66ffff700 1 -- 172.21.2.105:0/2378842066 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fe67006b810 con 0x7fe680066590 2021-11-12T05:42:30.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.331+0000 7fe67e7fc700 1 --2- 172.21.2.105:0/2378842066 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe65c053600 0x7fe65c055ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:30.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.331+0000 7fe67e7fc700 1 --2- 172.21.2.105:0/2378842066 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe65c053600 0x7fe65c055ac0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fe67400a000 tx=0x7fe674008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:30.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.335+0000 7fe66ffff700 1 -- 172.21.2.105:0/2378842066 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe670042710 con 0x7fe680066590 2021-11-12T05:42:30.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.415+0000 7fe68578f700 1 -- 172.21.2.105:0/2378842066 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe68005f280 con 0x7fe680066590 2021-11-12T05:42:30.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.419+0000 7fe66ffff700 1 -- 172.21.2.105:0/2378842066 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v45) v1 ==== 100+0+10 (secure 0 0 0) 0x7fe670045d30 con 0x7fe680066590 2021-11-12T05:42:30.423 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:42:30.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.419+0000 7fe68578f700 1 -- 172.21.2.105:0/2378842066 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe65c053600 msgr2=0x7fe65c055ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:30.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.419+0000 7fe68578f700 1 --2- 172.21.2.105:0/2378842066 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe65c053600 0x7fe65c055ac0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fe67400a000 tx=0x7fe674008040).stop 2021-11-12T05:42:30.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.419+0000 7fe68578f700 1 -- 172.21.2.105:0/2378842066 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe680066590 msgr2=0x7fe6800b1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:30.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.419+0000 7fe68578f700 1 --2- 172.21.2.105:0/2378842066 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe680066590 0x7fe6800b1080 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7fe67000b000 tx=0x7fe6800b2700).stop 2021-11-12T05:42:30.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.419+0000 7fe68578f700 1 -- 172.21.2.105:0/2378842066 shutdown_connections 2021-11-12T05:42:30.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.419+0000 7fe68578f700 1 --2- 172.21.2.105:0/2378842066 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe65c053600 0x7fe65c055ac0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:30.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.419+0000 7fe68578f700 1 --2- 172.21.2.105:0/2378842066 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe680067320 0x7fe68013cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:30.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.419+0000 7fe68578f700 1 --2- 172.21.2.105:0/2378842066 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe6801437b0 0x7fe6801502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:30.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.419+0000 7fe68578f700 1 --2- 172.21.2.105:0/2378842066 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe680066590 0x7fe6800b1080 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:30.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.419+0000 7fe68578f700 1 -- 172.21.2.105:0/2378842066 >> 172.21.2.105:0/2378842066 conn(0x7fe6800608d0 msgr2=0x7fe680144680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:30.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.419+0000 7fe68578f700 1 -- 172.21.2.105:0/2378842066 shutdown_connections 2021-11-12T05:42:30.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.419+0000 7fe68578f700 1 -- 172.21.2.105:0/2378842066 wait complete. 2021-11-12T05:42:30.430 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-12T05:42:30.431 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:42:30.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.475+0000 7f203b40c700 1 Processor -- start 2021-11-12T05:42:30.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f203b40c700 1 -- start start 2021-11-12T05:42:30.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f203b40c700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f20340ac280 0x7f203414b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:30.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f203b40c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f20340af730 0x7f20340ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:30.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f203b40c700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20340ac7b0 con 0x7f20340ad080 2021-11-12T05:42:30.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f203b40c700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20341488a0 con 0x7f20340af730 2021-11-12T05:42:30.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f203b40c700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20340ac9e0 con 0x7f20340ac280 2021-11-12T05:42:30.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f20391a8700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f20340ad080 0x7f203414abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:55602/0 (socket says 172.21.2.105:55602) 2021-11-12T05:42:30.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f20391a8700 1 -- 172.21.2.105:0/3880854469 learned_addr learned my addr 172.21.2.105:0/3880854469 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:42:30.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f20399a9700 1 --2- 172.21.2.105:0/3880854469 >> v2:172.21.2.105:3300/0 conn(0x7f20340af730 0x7f20340ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:30.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f20399a9700 1 -- 172.21.2.105:0/3880854469 >> v2:172.21.2.115:3300/0 conn(0x7f20340ac280 msgr2=0x7f203414b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:30.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f20399a9700 1 --2- 172.21.2.105:0/3880854469 >> v2:172.21.2.115:3300/0 conn(0x7f20340ac280 0x7f203414b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:30.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f2027fff700 1 -- 172.21.2.105:0/3880854469 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 274620879 0 0) 0x7f20340ac7b0 con 0x7f20340ad080 2021-11-12T05:42:30.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f20399a9700 1 -- 172.21.2.105:0/3880854469 >> v1:172.21.2.105:6789/0 conn(0x7f20340ad080 legacy=0x7f203414abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:30.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f20399a9700 1 -- 172.21.2.105:0/3880854469 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20340b0b30 con 0x7f20340af730 2021-11-12T05:42:30.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f20399a9700 1 --2- 172.21.2.105:0/3880854469 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f20340af730 0x7f20340ad460 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f20340b1000 tx=0x7f202c0091d0).ready entity=mon.0 client_cookie=73df02b59cdb6810 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:30.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f2027fff700 1 -- 172.21.2.105:0/3880854469 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f202c009ea0 con 0x7f20340af730 2021-11-12T05:42:30.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f2027fff700 1 -- 172.21.2.105:0/3880854469 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f202c00b860 con 0x7f20340af730 2021-11-12T05:42:30.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f2027fff700 1 -- 172.21.2.105:0/3880854469 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f202c00b9d0 con 0x7f20340af730 2021-11-12T05:42:30.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f203b40c700 1 -- 172.21.2.105:0/3880854469 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f20340af730 msgr2=0x7f20340ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:30.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f203b40c700 1 --2- 172.21.2.105:0/3880854469 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f20340af730 0x7f20340ad460 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f20340b1000 tx=0x7f202c0091d0).stop 2021-11-12T05:42:30.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f203b40c700 1 -- 172.21.2.105:0/3880854469 shutdown_connections 2021-11-12T05:42:30.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f203b40c700 1 --2- 172.21.2.105:0/3880854469 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f20340af730 0x7f20340ad460 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:30.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f203b40c700 1 --2- 172.21.2.105:0/3880854469 >> v2:172.21.2.115:3300/0 conn(0x7f20340ac280 0x7f203414b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:30.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f203b40c700 1 -- 172.21.2.105:0/3880854469 >> 172.21.2.105:0/3880854469 conn(0x7f20340b5370 msgr2=0x7f20340b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:30.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f203b40c700 1 -- 172.21.2.105:0/3880854469 shutdown_connections 2021-11-12T05:42:30.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f203b40c700 1 -- 172.21.2.105:0/3880854469 wait complete. 2021-11-12T05:42:30.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f203b40c700 1 Processor -- start 2021-11-12T05:42:30.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f203b40c700 1 -- start start 2021-11-12T05:42:30.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f203b40c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f20340ac280 0x7f2034148e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:30.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f203b40c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f20340ad080 0x7f2034156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:30.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f203b40c700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f20340af730 0x7f203415a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:30.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f203b40c700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20340ab1e0 con 0x7f20340ad080 2021-11-12T05:42:30.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f203b40c700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20340aaf40 con 0x7f20340af730 2021-11-12T05:42:30.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f203b40c700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203415a0f0 con 0x7f20340ac280 2021-11-12T05:42:30.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f20389a7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f20340ad080 0x7f2034156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:30.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f20389a7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f20340ad080 0x7f2034156a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45212/0 (socket says 172.21.2.105:45212) 2021-11-12T05:42:30.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f20389a7700 1 -- 172.21.2.105:0/2949602569 learned_addr learned my addr 172.21.2.105:0/2949602569 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:30.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f20389a7700 1 -- 172.21.2.105:0/2949602569 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f20340ac280 msgr2=0x7f2034148e20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:42:30.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f20389a7700 1 --2- 172.21.2.105:0/2949602569 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f20340ac280 0x7f2034148e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:30.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f20389a7700 1 -- 172.21.2.105:0/2949602569 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f20340af730 msgr2=0x7f203415a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:30.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f20389a7700 1 --2- 172.21.2.105:0/2949602569 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f20340af730 0x7f203415a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:30.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f20389a7700 1 -- 172.21.2.105:0/2949602569 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f202c009470 con 0x7f20340ad080 2021-11-12T05:42:30.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f20389a7700 1 --2- 172.21.2.105:0/2949602569 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f20340ad080 0x7f2034156a10 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f2030002f70 tx=0x7f2030006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:30.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f20267fc700 1 -- 172.21.2.105:0/2949602569 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2030013460 con 0x7f20340ad080 2021-11-12T05:42:30.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f20267fc700 1 -- 172.21.2.105:0/2949602569 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20300135c0 con 0x7f20340ad080 2021-11-12T05:42:30.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f203b40c700 1 -- 172.21.2.105:0/2949602569 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2034156f00 con 0x7f20340ad080 2021-11-12T05:42:30.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f20267fc700 1 -- 172.21.2.105:0/2949602569 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2030013920 con 0x7f20340ad080 2021-11-12T05:42:30.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.479+0000 7f203b40c700 1 -- 172.21.2.105:0/2949602569 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f203414b720 con 0x7f20340ad080 2021-11-12T05:42:30.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.483+0000 7f203b40c700 1 -- 172.21.2.105:0/2949602569 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f203415a2b0 con 0x7f20340ad080 2021-11-12T05:42:30.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.483+0000 7f20267fc700 1 -- 172.21.2.105:0/2949602569 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f203001a060 con 0x7f20340ad080 2021-11-12T05:42:30.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.483+0000 7f20267fc700 1 --2- 172.21.2.105:0/2949602569 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2014053580 0x7f2014055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:30.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.483+0000 7f20267fc700 1 -- 172.21.2.105:0/2949602569 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f203006b5d0 con 0x7f20340ad080 2021-11-12T05:42:30.498 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.483+0000 7f20391a8700 1 --2- 172.21.2.105:0/2949602569 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2014053580 0x7f2014055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:30.498 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.483+0000 7f20391a8700 1 --2- 172.21.2.105:0/2949602569 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2014053580 0x7f2014055a40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f2028000bc0 tx=0x7f2028007630).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:30.498 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.483+0000 7f20267fc700 1 -- 172.21.2.105:0/2949602569 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f20300424d0 con 0x7f20340ad080 2021-11-12T05:42:30.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.595+0000 7f203b40c700 1 -- 172.21.2.105:0/2949602569 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20340b1440 con 0x7f20340ad080 2021-11-12T05:42:30.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.595+0000 7f20267fc700 1 -- 172.21.2.105:0/2949602569 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+2138 (secure 0 0 0) 0x7f2030045af0 con 0x7f20340ad080 2021-11-12T05:42:30.600 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:42:30.600 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":15,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4403,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/3185091424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":3185091424},{"type":"v1","addr":"172.21.2.115:6833","nonce":3185091424}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:42:27.265739+0000","modified":"2021-11-12T05:42:28.270769+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5250":{"gid":5250,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/3058129917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":3058129917},{"type":"v1","addr":"172.21.2.105:6835","nonce":3058129917}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-11-12T05:42:30.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.595+0000 7f203b40c700 1 -- 172.21.2.105:0/2949602569 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2014053580 msgr2=0x7f2014055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:30.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.595+0000 7f203b40c700 1 --2- 172.21.2.105:0/2949602569 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2014053580 0x7f2014055a40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f2028000bc0 tx=0x7f2028007630).stop 2021-11-12T05:42:30.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.595+0000 7f203b40c700 1 -- 172.21.2.105:0/2949602569 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f20340ad080 msgr2=0x7f2034156a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:30.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.595+0000 7f203b40c700 1 --2- 172.21.2.105:0/2949602569 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f20340ad080 0x7f2034156a10 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f2030002f70 tx=0x7f2030006ec0).stop 2021-11-12T05:42:30.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.595+0000 7f203b40c700 1 -- 172.21.2.105:0/2949602569 shutdown_connections 2021-11-12T05:42:30.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.595+0000 7f203b40c700 1 --2- 172.21.2.105:0/2949602569 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2014053580 0x7f2014055a40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:30.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.595+0000 7f203b40c700 1 --2- 172.21.2.105:0/2949602569 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f20340af730 0x7f203415a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:30.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.595+0000 7f203b40c700 1 --2- 172.21.2.105:0/2949602569 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f20340ad080 0x7f2034156a10 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:30.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.595+0000 7f203b40c700 1 --2- 172.21.2.105:0/2949602569 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f20340ac280 0x7f2034148e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:30.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.595+0000 7f203b40c700 1 -- 172.21.2.105:0/2949602569 >> 172.21.2.105:0/2949602569 conn(0x7f20340b5370 msgr2=0x7f20340b4870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:30.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.595+0000 7f203b40c700 1 -- 172.21.2.105:0/2949602569 shutdown_connections 2021-11-12T05:42:30.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:30.595+0000 7f203b40c700 1 -- 172.21.2.105:0/2949602569 wait complete. 2021-11-12T05:42:30.604 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 15 2021-11-12T05:42:30.808 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:42:27.265739+0000', 'modified': '2021-11-12T05:42:28.270769+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5250}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5250': {'gid': 5250, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/3058129917', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 3058129917}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 3058129917}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:42:30.809 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:42:30.809 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:42:30.874 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":5250,"want_state":"up:active","state":"up:active","rank_uptime":3.6017413189999998,"mdsmap_epoch":15,"osdmap_epoch":45,"osdmap_epoch_barrier":45,"uptime":7.8259400100000001} 2021-11-12T05:42:30.875 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 5250, "mdsmap_epoch": 15, "osdmap_epoch": 45, "osdmap_epoch_barrier": 45, "rank_uptime": 3.601741319, "state": "up:active", "uptime": 7.82594001, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:42:30.876 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-12T05:42:30.876 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-12T05:42:30.876 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba016.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-12T05:42:30.877 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:42:30.877 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:42:30.888 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:42:30.939 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:42:30.940 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:42:30.946 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:42:30.946 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:42:30.947 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:42:30.948 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:42:30.951 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-12T05:42:30.952 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:42:30.995 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:42:31.005 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:42:31.005 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:42:31.010 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:42:31.011 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:42:31.012 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:42:31.012 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:42:31.034 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:2021-11-12T05:42:31.036+0000 7efda71e1080 -1 init, newargv = 0x55890685d8c0 newargc=9 2021-11-12T05:42:31.034 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[14160]: starting ceph client 2021-11-12T05:42:31.047 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[14160]: starting fuse 2021-11-12T05:42:32.117 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:42:32.130 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:42:32.131 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:42:32.179 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:42:32.180 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:42:32.181 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:42:32.182 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:42:32.186 INFO:teuthology.orchestra.run.gibba016.stdout:52 2021-11-12T05:42:32.187 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-12T05:42:32.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:42:32.188 DEBUG:teuthology.orchestra.run.gibba016:> sudo python3 -c ' 2021-11-12T05:42:32.188 DEBUG:teuthology.orchestra.run.gibba016:> import glob 2021-11-12T05:42:32.189 DEBUG:teuthology.orchestra.run.gibba016:> import re 2021-11-12T05:42:32.189 DEBUG:teuthology.orchestra.run.gibba016:> import os 2021-11-12T05:42:32.190 DEBUG:teuthology.orchestra.run.gibba016:> import subprocess 2021-11-12T05:42:32.190 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:42:32.191 DEBUG:teuthology.orchestra.run.gibba016:> def find_socket(client_name): 2021-11-12T05:42:32.191 DEBUG:teuthology.orchestra.run.gibba016:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-12T05:42:32.191 DEBUG:teuthology.orchestra.run.gibba016:> files = glob.glob(asok_path) 2021-11-12T05:42:32.192 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:42:32.192 DEBUG:teuthology.orchestra.run.gibba016:> # Given a non-glob path, it better be there 2021-11-12T05:42:32.193 DEBUG:teuthology.orchestra.run.gibba016:> if "*" not in asok_path: 2021-11-12T05:42:32.193 DEBUG:teuthology.orchestra.run.gibba016:> assert(len(files) == 1) 2021-11-12T05:42:32.193 DEBUG:teuthology.orchestra.run.gibba016:> return files[0] 2021-11-12T05:42:32.194 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:42:32.194 DEBUG:teuthology.orchestra.run.gibba016:> for f in files: 2021-11-12T05:42:32.195 DEBUG:teuthology.orchestra.run.gibba016:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-12T05:42:32.195 DEBUG:teuthology.orchestra.run.gibba016:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-12T05:42:32.196 DEBUG:teuthology.orchestra.run.gibba016:> return f 2021-11-12T05:42:32.196 DEBUG:teuthology.orchestra.run.gibba016:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-12T05:42:32.196 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:42:32.197 DEBUG:teuthology.orchestra.run.gibba016:> print(find_socket("client.0")) 2021-11-12T05:42:32.197 DEBUG:teuthology.orchestra.run.gibba016:> ' 2021-11-12T05:42:32.263 INFO:teuthology.orchestra.run.gibba016.stdout:/var/run/ceph/ceph-client.0.14160.asok 2021-11-12T05:42:32.265 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14160.asok 2021-11-12T05:42:32.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:42:32.266 DEBUG:teuthology.orchestra.run.gibba016:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14160.asok status 2021-11-12T05:42:32.313 INFO:teuthology.orchestra.run.gibba016.stdout:{ 2021-11-12T05:42:32.314 INFO:teuthology.orchestra.run.gibba016.stdout: "metadata": { 2021-11-12T05:42:32.314 INFO:teuthology.orchestra.run.gibba016.stdout: "ceph_sha1": "a81ee2815de5acae59ead5b8c9137b6766fc8ea8", 2021-11-12T05:42:32.314 INFO:teuthology.orchestra.run.gibba016.stdout: "ceph_version": "ceph version 15.2.15-22-ga81ee281 (a81ee2815de5acae59ead5b8c9137b6766fc8ea8) octopus (stable)", 2021-11-12T05:42:32.314 INFO:teuthology.orchestra.run.gibba016.stdout: "entity_id": "0", 2021-11-12T05:42:32.315 INFO:teuthology.orchestra.run.gibba016.stdout: "hostname": "gibba016", 2021-11-12T05:42:32.315 INFO:teuthology.orchestra.run.gibba016.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-12T05:42:32.315 INFO:teuthology.orchestra.run.gibba016.stdout: "pid": "14160", 2021-11-12T05:42:32.315 INFO:teuthology.orchestra.run.gibba016.stdout: "root": "/" 2021-11-12T05:42:32.316 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:42:32.316 INFO:teuthology.orchestra.run.gibba016.stdout: "dentry_count": 0, 2021-11-12T05:42:32.316 INFO:teuthology.orchestra.run.gibba016.stdout: "dentry_pinned_count": 0, 2021-11-12T05:42:32.316 INFO:teuthology.orchestra.run.gibba016.stdout: "id": 4606, 2021-11-12T05:42:32.316 INFO:teuthology.orchestra.run.gibba016.stdout: "inst": { 2021-11-12T05:42:32.317 INFO:teuthology.orchestra.run.gibba016.stdout: "name": { 2021-11-12T05:42:32.317 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "client", 2021-11-12T05:42:32.317 INFO:teuthology.orchestra.run.gibba016.stdout: "num": 4606 2021-11-12T05:42:32.317 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:42:32.318 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": { 2021-11-12T05:42:32.318 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "v1", 2021-11-12T05:42:32.318 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": "172.21.2.116:0", 2021-11-12T05:42:32.318 INFO:teuthology.orchestra.run.gibba016.stdout: "nonce": 1397016042 2021-11-12T05:42:32.319 INFO:teuthology.orchestra.run.gibba016.stdout: } 2021-11-12T05:42:32.319 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:42:32.319 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": { 2021-11-12T05:42:32.319 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "v1", 2021-11-12T05:42:32.319 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": "172.21.2.116:0", 2021-11-12T05:42:32.320 INFO:teuthology.orchestra.run.gibba016.stdout: "nonce": 1397016042 2021-11-12T05:42:32.320 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:42:32.320 INFO:teuthology.orchestra.run.gibba016.stdout: "inst_str": "client.4606 172.21.2.116:0/1397016042", 2021-11-12T05:42:32.320 INFO:teuthology.orchestra.run.gibba016.stdout: "addr_str": "172.21.2.116:0/1397016042", 2021-11-12T05:42:32.320 INFO:teuthology.orchestra.run.gibba016.stdout: "inode_count": 1, 2021-11-12T05:42:32.321 INFO:teuthology.orchestra.run.gibba016.stdout: "mds_epoch": 15, 2021-11-12T05:42:32.321 INFO:teuthology.orchestra.run.gibba016.stdout: "osd_epoch": 45, 2021-11-12T05:42:32.321 INFO:teuthology.orchestra.run.gibba016.stdout: "osd_epoch_barrier": 0, 2021-11-12T05:42:32.321 INFO:teuthology.orchestra.run.gibba016.stdout: "blacklisted": false, 2021-11-12T05:42:32.322 INFO:teuthology.orchestra.run.gibba016.stdout: "fs_name": "cephfs" 2021-11-12T05:42:32.322 INFO:teuthology.orchestra.run.gibba016.stdout:} 2021-11-12T05:42:32.323 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:42:32.324 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:42:32.324 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:42:32.332 INFO:teuthology.orchestra.run.gibba016.stdout:fuseblk 2021-11-12T05:42:32.334 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-12T05:42:32.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:42:32.335 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:42:32.392 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:42:32.393 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:42:32.393 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:42:32.399 INFO:teuthology.orchestra.run.gibba016.stdout:fuseblk 2021-11-12T05:42:32.399 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-12T05:42:32.400 DEBUG:teuthology.orchestra.run.gibba016:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-11-12T05:42:32.400 DEBUG:teuthology.orchestra.run.gibba016:> import sys 2021-11-12T05:42:32.401 DEBUG:teuthology.orchestra.run.gibba016:> import time 2021-11-12T05:42:32.401 DEBUG:teuthology.orchestra.run.gibba016:> import os 2021-11-12T05:42:32.402 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:42:32.402 DEBUG:teuthology.orchestra.run.gibba016:> n = 1000 2021-11-12T05:42:32.402 DEBUG:teuthology.orchestra.run.gibba016:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-11-12T05:42:32.403 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:42:32.403 DEBUG:teuthology.orchestra.run.gibba016:> if not os.path.exists(os.path.dirname(abs_path)): 2021-11-12T05:42:32.404 DEBUG:teuthology.orchestra.run.gibba016:> os.makedirs(os.path.dirname(abs_path)) 2021-11-12T05:42:32.404 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:42:32.404 DEBUG:teuthology.orchestra.run.gibba016:> for i in range(0, n): 2021-11-12T05:42:32.405 DEBUG:teuthology.orchestra.run.gibba016:> fname = "{0}_{1}".format(abs_path, i) 2021-11-12T05:42:32.405 DEBUG:teuthology.orchestra.run.gibba016:> with open(fname, '"'"'w'"'"') as f: 2021-11-12T05:42:32.405 DEBUG:teuthology.orchestra.run.gibba016:> f.write('"'"'content'"'"') 2021-11-12T05:42:32.406 DEBUG:teuthology.orchestra.run.gibba016:> if True: 2021-11-12T05:42:32.406 DEBUG:teuthology.orchestra.run.gibba016:> f.flush() 2021-11-12T05:42:32.407 DEBUG:teuthology.orchestra.run.gibba016:> os.fsync(f.fileno()) 2021-11-12T05:42:32.407 DEBUG:teuthology.orchestra.run.gibba016:> ' 2021-11-12T05:42:50.076 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:42:50.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.139+0000 7feb2106e700 1 Processor -- start 2021-11-12T05:42:50.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.139+0000 7feb2106e700 1 -- start start 2021-11-12T05:42:50.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.139+0000 7feb2106e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7feb1c0b01b0 0x7feb1c0b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.139+0000 7feb2106e700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb1c0b5ea0 con 0x7feb1c0b5ac0 2021-11-12T05:42:50.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.139+0000 7feb2106e700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb1c0b1a60 con 0x7feb1c0aeb80 2021-11-12T05:42:50.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.139+0000 7feb2106e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c0accd0 con 0x7feb1c0b01b0 2021-11-12T05:42:50.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.139+0000 7feb1ad9d700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7feb1c0b5ac0 0x7feb1c0ae470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:55618/0 (socket says 172.21.2.105:55618) 2021-11-12T05:42:50.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.139+0000 7feb1ad9d700 1 -- 172.21.2.105:0/1729442378 learned_addr learned my addr 172.21.2.105:0/1729442378 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:42:50.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.139+0000 7feb19d9b700 1 -- 172.21.2.105:0/1729442378 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3252358429 0 0) 0x7feb1c0b5ea0 con 0x7feb1c0b5ac0 2021-11-12T05:42:50.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.139+0000 7feb19d9b700 1 -- 172.21.2.105:0/1729442378 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feafc003260 con 0x7feb1c0b5ac0 2021-11-12T05:42:50.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.139+0000 7feb1a59c700 1 --2- 172.21.2.105:0/1729442378 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7feb1c0b01b0 0x7feb1c0b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:50.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.139+0000 7feb19d9b700 1 -- 172.21.2.105:0/1729442378 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3067996068 0 0) 0x7feafc003260 con 0x7feb1c0b5ac0 2021-11-12T05:42:50.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.139+0000 7feb19d9b700 1 -- 172.21.2.105:0/1729442378 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7feb1c0b01b0 msgr2=0x7feb1c0b13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:50.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.139+0000 7feb19d9b700 1 --2- 172.21.2.105:0/1729442378 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7feb1c0b01b0 0x7feb1c0b13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:50.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.139+0000 7feb19d9b700 1 -- 172.21.2.105:0/1729442378 >> v1:172.21.2.115:6789/0 conn(0x7feb1c0aeb80 legacy=0x7feb1c13e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:50.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.139+0000 7feb19d9b700 1 -- 172.21.2.105:0/1729442378 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb1c0acf70 con 0x7feb1c0b5ac0 2021-11-12T05:42:50.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.139+0000 7feb19d9b700 1 -- 172.21.2.105:0/1729442378 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7feb04001660 con 0x7feb1c0b5ac0 2021-11-12T05:42:50.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.139+0000 7feb19d9b700 1 -- 172.21.2.105:0/1729442378 >> v1:172.21.2.105:6789/0 conn(0x7feb1c0b5ac0 legacy=0x7feb1c0ae470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:50.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.139+0000 7feb19d9b700 1 --2- 172.21.2.105:0/1729442378 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7feb1c0b01b0 0x7feafc003800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.139+0000 7feb19d9b700 1 --2- 172.21.2.105:0/1729442378 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7feafc003d80 0x7feafc004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.139+0000 7feb19d9b700 1 --2- 172.21.2.105:0/1729442378 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7feafc004a40 0x7feafc004ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.139+0000 7feb19d9b700 1 -- 172.21.2.105:0/1729442378 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c0accd0 con 0x7feafc003d80 2021-11-12T05:42:50.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.139+0000 7feb19d9b700 1 -- 172.21.2.105:0/1729442378 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feafc00b8e0 con 0x7feafc004a40 2021-11-12T05:42:50.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.139+0000 7feb19d9b700 1 -- 172.21.2.105:0/1729442378 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feafc00ba70 con 0x7feb1c0b01b0 2021-11-12T05:42:50.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb1a59c700 1 --2- 172.21.2.105:0/1729442378 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7feafc003d80 0x7feafc004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:50.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb1b59e700 1 --2- 172.21.2.105:0/1729442378 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7feafc004a40 0x7feafc004ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:50.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb1ad9d700 1 --2- 172.21.2.105:0/1729442378 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7feb1c0b01b0 0x7feafc003800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:50.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb1a59c700 1 -- 172.21.2.105:0/1729442378 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7feb1c0b01b0 msgr2=0x7feafc003800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:50.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb1a59c700 1 --2- 172.21.2.105:0/1729442378 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7feb1c0b01b0 0x7feafc003800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:50.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb1a59c700 1 -- 172.21.2.105:0/1729442378 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7feafc004a40 msgr2=0x7feafc004ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:50.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb1a59c700 1 --2- 172.21.2.105:0/1729442378 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7feafc004a40 0x7feafc004ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:50.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb1a59c700 1 -- 172.21.2.105:0/1729442378 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feafc003260 con 0x7feafc003d80 2021-11-12T05:42:50.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb1a59c700 1 --2- 172.21.2.105:0/1729442378 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7feafc003d80 0x7feafc004500 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7feb0c00d000 tx=0x7feb0c006df0).ready entity=mon.0 client_cookie=49885da90959dfe0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:50.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb19d9b700 1 -- 172.21.2.105:0/1729442378 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb0c00e6f0 con 0x7feafc003d80 2021-11-12T05:42:50.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb19d9b700 1 -- 172.21.2.105:0/1729442378 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0c00e850 con 0x7feafc003d80 2021-11-12T05:42:50.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb19d9b700 1 -- 172.21.2.105:0/1729442378 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb0c00ebb0 con 0x7feafc003d80 2021-11-12T05:42:50.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb2106e700 1 -- 172.21.2.105:0/1729442378 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7feafc003d80 msgr2=0x7feafc004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:50.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb2106e700 1 --2- 172.21.2.105:0/1729442378 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7feafc003d80 0x7feafc004500 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7feb0c00d000 tx=0x7feb0c006df0).stop 2021-11-12T05:42:50.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb1b59e700 1 -- 172.21.2.105:0/1729442378 reap_dead start 2021-11-12T05:42:50.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb2106e700 1 -- 172.21.2.105:0/1729442378 shutdown_connections 2021-11-12T05:42:50.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb2106e700 1 -- 172.21.2.105:0/1729442378 >> 172.21.2.105:0/1729442378 conn(0x7feb1c0628b0 msgr2=0x7feb1c062c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:50.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb2106e700 1 -- 172.21.2.105:0/1729442378 shutdown_connections 2021-11-12T05:42:50.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb2106e700 1 -- 172.21.2.105:0/1729442378 wait complete. 2021-11-12T05:42:50.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb2106e700 1 Processor -- start 2021-11-12T05:42:50.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb2106e700 1 -- start start 2021-11-12T05:42:50.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb2106e700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7feafc003d80 0x7feb1c063be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb2106e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7feb1c0ac250 0x7feb1c065a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb2106e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7feb1c065f00 0x7feb1c0663b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb2106e700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c13cf70 con 0x7feb1c0ac250 2021-11-12T05:42:50.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb2106e700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c13d370 con 0x7feafc003d80 2021-11-12T05:42:50.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb2106e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c13c250 con 0x7feb1c065f00 2021-11-12T05:42:50.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb1a59c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7feb1c0ac250 0x7feb1c065a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:50.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb1a59c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7feb1c0ac250 0x7feb1c065a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45236/0 (socket says 172.21.2.105:45236) 2021-11-12T05:42:50.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb1a59c700 1 -- 172.21.2.105:0/4106750266 learned_addr learned my addr 172.21.2.105:0/4106750266 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:50.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb1ad9d700 1 --2- 172.21.2.105:0/4106750266 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7feafc003d80 0x7feb1c063be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:50.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb1b59e700 1 --2- 172.21.2.105:0/4106750266 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7feb1c065f00 0x7feb1c0663b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:50.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb1a59c700 1 -- 172.21.2.105:0/4106750266 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7feb1c065f00 msgr2=0x7feb1c0663b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:50.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb1a59c700 1 --2- 172.21.2.105:0/4106750266 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7feb1c065f00 0x7feb1c0663b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:50.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb1a59c700 1 -- 172.21.2.105:0/4106750266 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7feafc003d80 msgr2=0x7feb1c063be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:50.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb1a59c700 1 --2- 172.21.2.105:0/4106750266 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7feafc003d80 0x7feb1c063be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:50.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb1a59c700 1 -- 172.21.2.105:0/4106750266 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb1c13c4f0 con 0x7feb1c0ac250 2021-11-12T05:42:50.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb1a59c700 1 --2- 172.21.2.105:0/4106750266 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7feb1c0ac250 0x7feb1c065a10 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7feb0c00d000 tx=0x7feb0c01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:50.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb13fff700 1 -- 172.21.2.105:0/4106750266 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb0c020070 con 0x7feb1c0ac250 2021-11-12T05:42:50.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb13fff700 1 -- 172.21.2.105:0/4106750266 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0c000e90 con 0x7feb1c0ac250 2021-11-12T05:42:50.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb2106e700 1 -- 172.21.2.105:0/4106750266 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb1c13d5a0 con 0x7feb1c0ac250 2021-11-12T05:42:50.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb13fff700 1 -- 172.21.2.105:0/4106750266 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb0c01be60 con 0x7feb1c0ac250 2021-11-12T05:42:50.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb2106e700 1 -- 172.21.2.105:0/4106750266 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb1c0640d0 con 0x7feb1c0ac250 2021-11-12T05:42:50.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.143+0000 7feb2106e700 1 -- 172.21.2.105:0/4106750266 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb1c13c680 con 0x7feb1c0ac250 2021-11-12T05:42:50.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.147+0000 7feb13fff700 1 -- 172.21.2.105:0/4106750266 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7feb0c017030 con 0x7feb1c0ac250 2021-11-12T05:42:50.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.147+0000 7feb13fff700 1 --2- 172.21.2.105:0/4106750266 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7feb00053520 0x7feb000559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.147+0000 7feb13fff700 1 -- 172.21.2.105:0/4106750266 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6416+0+0 (secure 0 0 0) 0x7feb0c06cc10 con 0x7feb1c0ac250 2021-11-12T05:42:50.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.147+0000 7feb1ad9d700 1 --2- 172.21.2.105:0/4106750266 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7feb00053520 0x7feb000559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:50.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.147+0000 7feb1ad9d700 1 --2- 172.21.2.105:0/4106750266 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7feb00053520 0x7feb000559e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7feb0400d000 tx=0x7feb04009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:50.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.147+0000 7feb13fff700 1 -- 172.21.2.105:0/4106750266 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7feb0c043c20 con 0x7feb1c0ac250 2021-11-12T05:42:50.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.255+0000 7feb2106e700 1 -- 172.21.2.105:0/4106750266 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb1c0ad410 con 0x7feb1c0ac250 2021-11-12T05:42:50.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.255+0000 7feb13fff700 1 -- 172.21.2.105:0/4106750266 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+2138 (secure 0 0 0) 0x7feb0c047240 con 0x7feb1c0ac250 2021-11-12T05:42:50.263 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:42:50.263 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":15,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4403,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/3185091424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":3185091424},{"type":"v1","addr":"172.21.2.115:6833","nonce":3185091424}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:42:27.265739+0000","modified":"2021-11-12T05:42:28.270769+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5250":{"gid":5250,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/3058129917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":3058129917},{"type":"v1","addr":"172.21.2.105:6835","nonce":3058129917}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-11-12T05:42:50.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.259+0000 7feb2106e700 1 -- 172.21.2.105:0/4106750266 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7feb00053520 msgr2=0x7feb000559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:50.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.259+0000 7feb2106e700 1 --2- 172.21.2.105:0/4106750266 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7feb00053520 0x7feb000559e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7feb0400d000 tx=0x7feb04009040).stop 2021-11-12T05:42:50.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.259+0000 7feb2106e700 1 -- 172.21.2.105:0/4106750266 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7feb1c0ac250 msgr2=0x7feb1c065a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:50.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.259+0000 7feb2106e700 1 --2- 172.21.2.105:0/4106750266 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7feb1c0ac250 0x7feb1c065a10 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7feb0c00d000 tx=0x7feb0c01a000).stop 2021-11-12T05:42:50.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.259+0000 7feb2106e700 1 -- 172.21.2.105:0/4106750266 shutdown_connections 2021-11-12T05:42:50.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.259+0000 7feb2106e700 1 --2- 172.21.2.105:0/4106750266 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7feb00053520 0x7feb000559e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:50.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.259+0000 7feb2106e700 1 --2- 172.21.2.105:0/4106750266 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7feb1c065f00 0x7feb1c0663b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:50.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.259+0000 7feb2106e700 1 --2- 172.21.2.105:0/4106750266 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7feb1c0ac250 0x7feb1c065a10 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:50.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.259+0000 7feb2106e700 1 --2- 172.21.2.105:0/4106750266 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7feafc003d80 0x7feb1c063be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:50.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.259+0000 7feb2106e700 1 -- 172.21.2.105:0/4106750266 >> 172.21.2.105:0/4106750266 conn(0x7feb1c0628b0 msgr2=0x7feb1c13fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:50.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.259+0000 7feb2106e700 1 -- 172.21.2.105:0/4106750266 shutdown_connections 2021-11-12T05:42:50.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.259+0000 7feb2106e700 1 -- 172.21.2.105:0/4106750266 wait complete. 2021-11-12T05:42:50.267 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 15 2021-11-12T05:42:50.269 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_caps 20 2021-11-12T05:42:50.327 INFO:teuthology.orchestra.run.gibba005.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2021-11-12T05:42:50.327 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-11-12T05:42:50.328 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:42:50.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.375+0000 7f53129ff700 1 Processor -- start 2021-11-12T05:42:50.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.375+0000 7f53129ff700 1 -- start start 2021-11-12T05:42:50.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.375+0000 7f53129ff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f530c0626f0 0x7f530c0af590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.375+0000 7f53129ff700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f530c0ad0d0 0x7f530c142c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.375+0000 7f53129ff700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f530c0b10b0 con 0x7f530c0ad870 2021-11-12T05:42:50.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.375+0000 7f53129ff700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f530c13f5b0 con 0x7f530c0626f0 2021-11-12T05:42:50.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.375+0000 7f53129ff700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f530c062ad0 con 0x7f530c0ad0d0 2021-11-12T05:42:50.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.375+0000 7f530bfff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f530c0626f0 0x7f530c0af590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:50.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.375+0000 7f530bfff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f530c0626f0 0x7f530c0af590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45242/0 (socket says 172.21.2.105:45242) 2021-11-12T05:42:50.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.375+0000 7f530bfff700 1 -- 172.21.2.105:0/686517614 learned_addr learned my addr 172.21.2.105:0/686517614 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:50.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.375+0000 7f530bfff700 1 -- 172.21.2.105:0/686517614 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f530c0ad0d0 msgr2=0x7f530c142c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:50.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.375+0000 7f530b7fe700 1 --2- 172.21.2.105:0/686517614 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f530c0ad0d0 0x7f530c142c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:50.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.375+0000 7f530bfff700 1 --2- 172.21.2.105:0/686517614 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f530c0ad0d0 0x7f530c142c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:50.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.375+0000 7f530bfff700 1 -- 172.21.2.105:0/686517614 >> v1:172.21.2.115:6789/0 conn(0x7f530c0ad870 legacy=0x7f530c0ab9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:50.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.375+0000 7f530bfff700 1 -- 172.21.2.105:0/686517614 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f530c143160 con 0x7f530c0626f0 2021-11-12T05:42:50.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.375+0000 7f530b7fe700 1 --2- 172.21.2.105:0/686517614 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f530c0ad0d0 0x7f530c142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:42:50.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.375+0000 7f530bfff700 1 --2- 172.21.2.105:0/686517614 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f530c0626f0 0x7f530c0af590 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f530c0b62e0 tx=0x7f5300006eb0).ready entity=mon.0 client_cookie=2b2a473f9caec66e server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:50.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.375+0000 7f530affd700 1 -- 172.21.2.105:0/686517614 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f530000d570 con 0x7f530c0626f0 2021-11-12T05:42:50.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.375+0000 7f530affd700 1 -- 172.21.2.105:0/686517614 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5300000e90 con 0x7f530c0626f0 2021-11-12T05:42:50.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.375+0000 7f530affd700 1 -- 172.21.2.105:0/686517614 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f530000d8c0 con 0x7f530c0626f0 2021-11-12T05:42:50.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.375+0000 7f53129ff700 1 -- 172.21.2.105:0/686517614 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f530c0626f0 msgr2=0x7f530c0af590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:50.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.375+0000 7f53129ff700 1 --2- 172.21.2.105:0/686517614 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f530c0626f0 0x7f530c0af590 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f530c0b62e0 tx=0x7f5300006eb0).stop 2021-11-12T05:42:50.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.375+0000 7f53129ff700 1 -- 172.21.2.105:0/686517614 shutdown_connections 2021-11-12T05:42:50.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.375+0000 7f53129ff700 1 --2- 172.21.2.105:0/686517614 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f530c0ad0d0 0x7f530c142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:50.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.375+0000 7f53129ff700 1 --2- 172.21.2.105:0/686517614 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f530c0626f0 0x7f530c0af590 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:50.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.375+0000 7f53129ff700 1 -- 172.21.2.105:0/686517614 >> 172.21.2.105:0/686517614 conn(0x7f530c0b5370 msgr2=0x7f530c0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:50.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.375+0000 7f53129ff700 1 -- 172.21.2.105:0/686517614 shutdown_connections 2021-11-12T05:42:50.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.375+0000 7f53129ff700 1 -- 172.21.2.105:0/686517614 wait complete. 2021-11-12T05:42:50.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.379+0000 7f53129ff700 1 Processor -- start 2021-11-12T05:42:50.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.379+0000 7f53129ff700 1 -- start start 2021-11-12T05:42:50.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.379+0000 7f53129ff700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f530c0626f0 0x7f530c066100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.379+0000 7f53129ff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f530c0ad0d0 0x7f530c14e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.379+0000 7f53129ff700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f530c0ad870 0x7f530c14eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.379+0000 7f53129ff700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530c145900 con 0x7f530c0ad0d0 2021-11-12T05:42:50.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.379+0000 7f53129ff700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530c066a60 con 0x7f530c0ad870 2021-11-12T05:42:50.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.379+0000 7f53129ff700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f530c146a50 con 0x7f530c0626f0 2021-11-12T05:42:50.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.379+0000 7f530b7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f530c0ad0d0 0x7f530c14e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:50.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.379+0000 7f530b7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f530c0ad0d0 0x7f530c14e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45252/0 (socket says 172.21.2.105:45252) 2021-11-12T05:42:50.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.379+0000 7f530b7fe700 1 -- 172.21.2.105:0/2450297838 learned_addr learned my addr 172.21.2.105:0/2450297838 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:50.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.379+0000 7f5310f9c700 1 --2- 172.21.2.105:0/2450297838 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f530c0ad870 0x7f530c14eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:50.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.379+0000 7f530b7fe700 1 -- 172.21.2.105:0/2450297838 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f530c0626f0 msgr2=0x7f530c066100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:50.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.379+0000 7f530b7fe700 1 --2- 172.21.2.105:0/2450297838 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f530c0626f0 0x7f530c066100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:50.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.379+0000 7f530b7fe700 1 -- 172.21.2.105:0/2450297838 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f530c0ad870 msgr2=0x7f530c14eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:50.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.379+0000 7f530b7fe700 1 --2- 172.21.2.105:0/2450297838 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f530c0ad870 0x7f530c14eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:50.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.379+0000 7f530b7fe700 1 -- 172.21.2.105:0/2450297838 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f530000b1e0 con 0x7f530c0ad0d0 2021-11-12T05:42:50.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.379+0000 7f5310f9c700 1 --2- 172.21.2.105:0/2450297838 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f530c0ad870 0x7f530c14eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:42:50.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.379+0000 7f530b7fe700 1 --2- 172.21.2.105:0/2450297838 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f530c0ad0d0 0x7f530c14e610 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f530c146cf0 tx=0x7f52fc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:50.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.379+0000 7f53097fa700 1 -- 172.21.2.105:0/2450297838 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52fc010580 con 0x7f530c0ad0d0 2021-11-12T05:42:50.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.379+0000 7f53097fa700 1 -- 172.21.2.105:0/2450297838 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52fc0106e0 con 0x7f530c0ad0d0 2021-11-12T05:42:50.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.379+0000 7f53129ff700 1 -- 172.21.2.105:0/2450297838 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f530c145af0 con 0x7f530c0ad0d0 2021-11-12T05:42:50.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.379+0000 7f53097fa700 1 -- 172.21.2.105:0/2450297838 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52fc010a40 con 0x7f530c0ad0d0 2021-11-12T05:42:50.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.379+0000 7f53129ff700 1 -- 172.21.2.105:0/2450297838 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f530c144980 con 0x7f530c0ad0d0 2021-11-12T05:42:50.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.379+0000 7f53129ff700 1 -- 172.21.2.105:0/2450297838 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f530c0b12e0 con 0x7f530c0ad0d0 2021-11-12T05:42:50.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.379+0000 7f53097fa700 1 -- 172.21.2.105:0/2450297838 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f52fc010ba0 con 0x7f530c0ad0d0 2021-11-12T05:42:50.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.379+0000 7f53097fa700 1 --2- 172.21.2.105:0/2450297838 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f52ec0536a0 0x7f52ec055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.379+0000 7f53097fa700 1 -- 172.21.2.105:0/2450297838 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f52fc06bc80 con 0x7f530c0ad0d0 2021-11-12T05:42:50.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.379+0000 7f530bfff700 1 --2- 172.21.2.105:0/2450297838 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f52ec0536a0 0x7f52ec055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:50.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.379+0000 7f530bfff700 1 --2- 172.21.2.105:0/2450297838 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f52ec0536a0 0x7f52ec055b60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f530c0b62e0 tx=0x7f5300015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:50.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.383+0000 7f53097fa700 1 -- 172.21.2.105:0/2450297838 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f52fc042c30 con 0x7f530c0ad0d0 2021-11-12T05:42:50.498 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.491+0000 7f53129ff700 1 -- 172.21.2.105:0/2450297838 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f530c057350 con 0x7f530c0ad0d0 2021-11-12T05:42:50.499 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.495+0000 7f53097fa700 1 -- 172.21.2.105:0/2450297838 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+2138 (secure 0 0 0) 0x7f52fc046250 con 0x7f530c0ad0d0 2021-11-12T05:42:50.499 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:42:50.499 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":15,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4403,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/3185091424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":3185091424},{"type":"v1","addr":"172.21.2.115:6833","nonce":3185091424}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:42:27.265739+0000","modified":"2021-11-12T05:42:28.270769+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5250":{"gid":5250,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/3058129917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":3058129917},{"type":"v1","addr":"172.21.2.105:6835","nonce":3058129917}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-11-12T05:42:50.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.495+0000 7f53129ff700 1 -- 172.21.2.105:0/2450297838 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f52ec0536a0 msgr2=0x7f52ec055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:50.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.495+0000 7f53129ff700 1 --2- 172.21.2.105:0/2450297838 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f52ec0536a0 0x7f52ec055b60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f530c0b62e0 tx=0x7f5300015000).stop 2021-11-12T05:42:50.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.495+0000 7f53129ff700 1 -- 172.21.2.105:0/2450297838 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f530c0ad0d0 msgr2=0x7f530c14e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:50.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.495+0000 7f53129ff700 1 --2- 172.21.2.105:0/2450297838 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f530c0ad0d0 0x7f530c14e610 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f530c146cf0 tx=0x7f52fc008040).stop 2021-11-12T05:42:50.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.495+0000 7f53129ff700 1 -- 172.21.2.105:0/2450297838 shutdown_connections 2021-11-12T05:42:50.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.495+0000 7f53129ff700 1 --2- 172.21.2.105:0/2450297838 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f52ec0536a0 0x7f52ec055b60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:50.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.495+0000 7f53129ff700 1 --2- 172.21.2.105:0/2450297838 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f530c0ad870 0x7f530c14eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:50.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.495+0000 7f53129ff700 1 --2- 172.21.2.105:0/2450297838 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f530c0ad0d0 0x7f530c14e610 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:50.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.495+0000 7f53129ff700 1 --2- 172.21.2.105:0/2450297838 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f530c0626f0 0x7f530c066100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:50.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.495+0000 7f53129ff700 1 -- 172.21.2.105:0/2450297838 >> 172.21.2.105:0/2450297838 conn(0x7f530c0b5370 msgr2=0x7f530c0afd10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:50.503 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.495+0000 7f53129ff700 1 -- 172.21.2.105:0/2450297838 shutdown_connections 2021-11-12T05:42:50.503 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.495+0000 7f53129ff700 1 -- 172.21.2.105:0/2450297838 wait complete. 2021-11-12T05:42:50.503 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 15 2021-11-12T05:42:50.507 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_decay_threshold 400 2021-11-12T05:42:50.564 INFO:teuthology.orchestra.run.gibba005.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2021-11-12T05:42:50.565 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-11-12T05:42:50.565 INFO:tasks.cephfs.fuse_mount:Killing ceph-fuse connection on ubuntu@gibba016.front.sepia.ceph.com... 2021-11-12T05:42:50.580 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:42:50.631 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa986bbd700 1 Processor -- start 2021-11-12T05:42:50.632 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa986bbd700 1 -- start start 2021-11-12T05:42:50.632 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa986bbd700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa9800b2940 0x7fa980142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.632 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa986bbd700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fa9800b0cc0 0x7fa98005c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.632 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa986bbd700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9800b2d20 con 0x7fa9800b0780 2021-11-12T05:42:50.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa986bbd700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9800b1fc0 con 0x7fa9800b0cc0 2021-11-12T05:42:50.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa986bbd700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9800b15e0 con 0x7fa9800b2940 2021-11-12T05:42:50.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa97ffff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fa9800b0780 0x7fa9801432b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:55654/0 (socket says 172.21.2.105:55654) 2021-11-12T05:42:50.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa97ffff700 1 -- 172.21.2.105:0/2940125611 learned_addr learned my addr 172.21.2.105:0/2940125611 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:42:50.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa97f7fe700 1 -- 172.21.2.105:0/2940125611 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1525854455 0 0) 0x7fa9800b2d20 con 0x7fa9800b0780 2021-11-12T05:42:50.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa97f7fe700 1 -- 172.21.2.105:0/2940125611 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa960003260 con 0x7fa9800b0780 2021-11-12T05:42:50.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa97f7fe700 1 -- 172.21.2.105:0/2940125611 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 837488807 0 0) 0x7fa960003260 con 0x7fa9800b0780 2021-11-12T05:42:50.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa97f7fe700 1 -- 172.21.2.105:0/2940125611 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa9800b2940 msgr2=0x7fa980142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:50.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa97f7fe700 1 --2- 172.21.2.105:0/2940125611 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa9800b2940 0x7fa980142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:50.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa97f7fe700 1 -- 172.21.2.105:0/2940125611 >> v2:172.21.2.115:3300/0 conn(0x7fa9800b0cc0 msgr2=0x7fa98005c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:50.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa97f7fe700 1 --2- 172.21.2.105:0/2940125611 >> v2:172.21.2.115:3300/0 conn(0x7fa9800b0cc0 0x7fa98005c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:50.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa97f7fe700 1 -- 172.21.2.105:0/2940125611 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9800b1880 con 0x7fa9800b0780 2021-11-12T05:42:50.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa97f7fe700 1 -- 172.21.2.105:0/2940125611 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fa968001660 con 0x7fa9800b0780 2021-11-12T05:42:50.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa97f7fe700 1 -- 172.21.2.105:0/2940125611 >> v1:172.21.2.105:6789/0 conn(0x7fa9800b0780 legacy=0x7fa9801432b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:50.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa97f7fe700 1 --2- 172.21.2.105:0/2940125611 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa9800b2940 0x7fa9600037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa97f7fe700 1 --2- 172.21.2.105:0/2940125611 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa960003ee0 0x7fa960004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa97f7fe700 1 --2- 172.21.2.105:0/2940125611 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa960004bf0 0x7fa96000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa97f7fe700 1 -- 172.21.2.105:0/2940125611 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9800b1fc0 con 0x7fa960004bf0 2021-11-12T05:42:50.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa97f7fe700 1 -- 172.21.2.105:0/2940125611 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9800b15e0 con 0x7fa960003ee0 2021-11-12T05:42:50.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa97f7fe700 1 -- 172.21.2.105:0/2940125611 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9600053a0 con 0x7fa9800b2940 2021-11-12T05:42:50.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa98515a700 1 --2- 172.21.2.105:0/2940125611 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa960004bf0 0x7fa96000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:50.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa984959700 1 --2- 172.21.2.105:0/2940125611 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa9800b2940 0x7fa9600037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:50.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa98515a700 1 -- 172.21.2.105:0/2940125611 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa9800b2940 msgr2=0x7fa9600037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:50.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa98515a700 1 --2- 172.21.2.105:0/2940125611 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa9800b2940 0x7fa9600037d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:50.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa97ffff700 1 --2- 172.21.2.105:0/2940125611 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa960003ee0 0x7fa960004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:50.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa98515a700 1 -- 172.21.2.105:0/2940125611 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa960003ee0 msgr2=0x7fa960004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:50.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa98515a700 1 --2- 172.21.2.105:0/2940125611 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa960003ee0 0x7fa960004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:50.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa98515a700 1 -- 172.21.2.105:0/2940125611 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa960003260 con 0x7fa960004bf0 2021-11-12T05:42:50.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa97ffff700 1 --2- 172.21.2.105:0/2940125611 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa960003ee0 0x7fa960004500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:42:50.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa98515a700 1 --2- 172.21.2.105:0/2940125611 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa960004bf0 0x7fa96000b750 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7fa9780032f0 tx=0x7fa978006f90).ready entity=mon.0 client_cookie=c44b67a9d3db0d55 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:50.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa97f7fe700 1 -- 172.21.2.105:0/2940125611 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa97800b460 con 0x7fa960004bf0 2021-11-12T05:42:50.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa97f7fe700 1 -- 172.21.2.105:0/2940125611 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97800b5c0 con 0x7fa960004bf0 2021-11-12T05:42:50.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa97f7fe700 1 -- 172.21.2.105:0/2940125611 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa97800b730 con 0x7fa960004bf0 2021-11-12T05:42:50.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa986bbd700 1 -- 172.21.2.105:0/2940125611 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa960004bf0 msgr2=0x7fa96000b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:50.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa986bbd700 1 --2- 172.21.2.105:0/2940125611 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa960004bf0 0x7fa96000b750 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7fa9780032f0 tx=0x7fa978006f90).stop 2021-11-12T05:42:50.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa98515a700 1 -- 172.21.2.105:0/2940125611 reap_dead start 2021-11-12T05:42:50.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa986bbd700 1 -- 172.21.2.105:0/2940125611 shutdown_connections 2021-11-12T05:42:50.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa986bbd700 1 -- 172.21.2.105:0/2940125611 >> 172.21.2.105:0/2940125611 conn(0x7fa980068440 msgr2=0x7fa980062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:50.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa986bbd700 1 -- 172.21.2.105:0/2940125611 shutdown_connections 2021-11-12T05:42:50.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.627+0000 7fa986bbd700 1 -- 172.21.2.105:0/2940125611 wait complete. 2021-11-12T05:42:50.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.631+0000 7fa986bbd700 1 Processor -- start 2021-11-12T05:42:50.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.631+0000 7fa986bbd700 1 -- start start 2021-11-12T05:42:50.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.631+0000 7fa986bbd700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa960004bf0 0x7fa9800664c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.631+0000 7fa986bbd700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa980156e90 0x7fa980157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.631+0000 7fa986bbd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa980157800 0x7fa98015a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.631+0000 7fa986bbd700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa980064a00 con 0x7fa980157800 2021-11-12T05:42:50.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.631+0000 7fa986bbd700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa980065c40 con 0x7fa980156e90 2021-11-12T05:42:50.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.631+0000 7fa986bbd700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa980064760 con 0x7fa960004bf0 2021-11-12T05:42:50.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.631+0000 7fa98515a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa980157800 0x7fa98015a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:50.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.631+0000 7fa98515a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa980157800 0x7fa98015a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45270/0 (socket says 172.21.2.105:45270) 2021-11-12T05:42:50.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.631+0000 7fa98515a700 1 -- 172.21.2.105:0/2704635611 learned_addr learned my addr 172.21.2.105:0/2704635611 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:50.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.631+0000 7fa98515a700 1 -- 172.21.2.105:0/2704635611 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa960004bf0 msgr2=0x7fa9800664c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:50.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.631+0000 7fa98515a700 1 --2- 172.21.2.105:0/2704635611 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa960004bf0 0x7fa9800664c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:50.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.631+0000 7fa98515a700 1 -- 172.21.2.105:0/2704635611 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa980156e90 msgr2=0x7fa980157310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:50.650 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.631+0000 7fa98515a700 1 --2- 172.21.2.105:0/2704635611 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa980156e90 0x7fa980157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:50.650 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.631+0000 7fa98515a700 1 -- 172.21.2.105:0/2704635611 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9800659a0 con 0x7fa980157800 2021-11-12T05:42:50.650 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.631+0000 7fa98515a700 1 --2- 172.21.2.105:0/2704635611 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa980157800 0x7fa98015a3e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7fa980065dd0 tx=0x7fa978017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:50.650 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.631+0000 7fa97dffb700 1 -- 172.21.2.105:0/2704635611 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa978011a70 con 0x7fa980157800 2021-11-12T05:42:50.650 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.631+0000 7fa97dffb700 1 -- 172.21.2.105:0/2704635611 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa978011bd0 con 0x7fa980157800 2021-11-12T05:42:50.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.631+0000 7fa986bbd700 1 -- 172.21.2.105:0/2704635611 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa980065ef0 con 0x7fa980157800 2021-11-12T05:42:50.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.631+0000 7fa986bbd700 1 -- 172.21.2.105:0/2704635611 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa98013a790 con 0x7fa980157800 2021-11-12T05:42:50.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.631+0000 7fa97dffb700 1 -- 172.21.2.105:0/2704635611 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa978011d40 con 0x7fa980157800 2021-11-12T05:42:50.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.631+0000 7fa986bbd700 1 -- 172.21.2.105:0/2704635611 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9800b1b20 con 0x7fa980157800 2021-11-12T05:42:50.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.631+0000 7fa97dffb700 1 -- 172.21.2.105:0/2704635611 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa978022030 con 0x7fa980157800 2021-11-12T05:42:50.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.631+0000 7fa97dffb700 1 --2- 172.21.2.105:0/2704635611 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa964053580 0x7fa964055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.631+0000 7fa97dffb700 1 -- 172.21.2.105:0/2704635611 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fa97806c570 con 0x7fa980157800 2021-11-12T05:42:50.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.631+0000 7fa984959700 1 --2- 172.21.2.105:0/2704635611 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa964053580 0x7fa964055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:50.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.631+0000 7fa984959700 1 --2- 172.21.2.105:0/2704635611 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa964053580 0x7fa964055a40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fa970007000 tx=0x7fa970008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:50.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.635+0000 7fa97dffb700 1 -- 172.21.2.105:0/2704635611 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa9780436f0 con 0x7fa980157800 2021-11-12T05:42:50.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.747+0000 7fa986bbd700 1 -- 172.21.2.105:0/2704635611 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa980057350 con 0x7fa980157800 2021-11-12T05:42:50.752 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.747+0000 7fa97dffb700 1 -- 172.21.2.105:0/2704635611 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+2138 (secure 0 0 0) 0x7fa978020070 con 0x7fa980157800 2021-11-12T05:42:50.752 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:42:50.752 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":15,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4403,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/3185091424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":3185091424},{"type":"v1","addr":"172.21.2.115:6833","nonce":3185091424}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:42:27.265739+0000","modified":"2021-11-12T05:42:28.270769+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5250":{"gid":5250,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/3058129917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":3058129917},{"type":"v1","addr":"172.21.2.105:6835","nonce":3058129917}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-11-12T05:42:50.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.747+0000 7fa986bbd700 1 -- 172.21.2.105:0/2704635611 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa964053580 msgr2=0x7fa964055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:50.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.747+0000 7fa986bbd700 1 --2- 172.21.2.105:0/2704635611 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa964053580 0x7fa964055a40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fa970007000 tx=0x7fa970008040).stop 2021-11-12T05:42:50.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.747+0000 7fa986bbd700 1 -- 172.21.2.105:0/2704635611 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa980157800 msgr2=0x7fa98015a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:50.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.747+0000 7fa986bbd700 1 --2- 172.21.2.105:0/2704635611 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa980157800 0x7fa98015a3e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7fa980065dd0 tx=0x7fa978017000).stop 2021-11-12T05:42:50.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.747+0000 7fa986bbd700 1 -- 172.21.2.105:0/2704635611 shutdown_connections 2021-11-12T05:42:50.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.747+0000 7fa986bbd700 1 --2- 172.21.2.105:0/2704635611 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa964053580 0x7fa964055a40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:50.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.747+0000 7fa986bbd700 1 --2- 172.21.2.105:0/2704635611 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa980157800 0x7fa98015a3e0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:50.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.747+0000 7fa986bbd700 1 --2- 172.21.2.105:0/2704635611 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa980156e90 0x7fa980157310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:50.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.747+0000 7fa986bbd700 1 --2- 172.21.2.105:0/2704635611 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa960004bf0 0x7fa9800664c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:50.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.747+0000 7fa986bbd700 1 -- 172.21.2.105:0/2704635611 >> 172.21.2.105:0/2704635611 conn(0x7fa980068440 msgr2=0x7fa9800b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:50.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.747+0000 7fa986bbd700 1 -- 172.21.2.105:0/2704635611 shutdown_connections 2021-11-12T05:42:50.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.747+0000 7fa986bbd700 1 -- 172.21.2.105:0/2704635611 wait complete. 2021-11-12T05:42:50.757 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 15 2021-11-12T05:42:50.759 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a cache drop 2021-11-12T05:42:50.811 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4fa30a700 1 Processor -- start 2021-11-12T05:42:50.811 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4fa30a700 1 -- start start 2021-11-12T05:42:50.813 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4fa30a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff4f40626b0 0x7ff4f4062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4fa30a700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f40b0d50 con 0x7ff4f4130a80 2021-11-12T05:42:50.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4fa30a700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f40ad380 con 0x7ff4f40af750 2021-11-12T05:42:50.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4fa30a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f40ae190 con 0x7ff4f40626b0 2021-11-12T05:42:50.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4f88a7700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7ff4f4130a80 0x7ff4f41474d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:55672/0 (socket says 172.21.2.105:55672) 2021-11-12T05:42:50.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4f88a7700 1 -- 172.21.2.105:0/2047423697 learned_addr learned my addr 172.21.2.105:0/2047423697 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:42:50.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4f2ffd700 1 -- 172.21.2.105:0/2047423697 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1733306979 0 0) 0x7ff4f40b0d50 con 0x7ff4f4130a80 2021-11-12T05:42:50.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4f2ffd700 1 -- 172.21.2.105:0/2047423697 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4d4003260 con 0x7ff4f4130a80 2021-11-12T05:42:50.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4f2ffd700 1 -- 172.21.2.105:0/2047423697 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2934109786 0 0) 0x7ff4d4003260 con 0x7ff4f4130a80 2021-11-12T05:42:50.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4f2ffd700 1 -- 172.21.2.105:0/2047423697 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff4f40626b0 msgr2=0x7ff4f4062a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:50.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4f2ffd700 1 --2- 172.21.2.105:0/2047423697 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff4f40626b0 0x7ff4f4062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:50.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4f2ffd700 1 -- 172.21.2.105:0/2047423697 >> v1:172.21.2.115:6789/0 conn(0x7ff4f40af750 legacy=0x7ff4f4130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:50.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4f2ffd700 1 -- 172.21.2.105:0/2047423697 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f40ae2d0 con 0x7ff4f4130a80 2021-11-12T05:42:50.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4f2ffd700 1 -- 172.21.2.105:0/2047423697 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7ff4ec0019e0 con 0x7ff4f4130a80 2021-11-12T05:42:50.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4f2ffd700 1 -- 172.21.2.105:0/2047423697 >> v1:172.21.2.105:6789/0 conn(0x7ff4f4130a80 legacy=0x7ff4f41474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:50.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4f2ffd700 1 --2- 172.21.2.105:0/2047423697 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff4d4003800 0x7ff4d4003c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4f2ffd700 1 --2- 172.21.2.105:0/2047423697 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff4d4004500 0x7ff4d4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4f2ffd700 1 --2- 172.21.2.105:0/2047423697 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff4d4005070 0x7ff4d400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4f2ffd700 1 -- 172.21.2.105:0/2047423697 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f40ae190 con 0x7ff4d4004500 2021-11-12T05:42:50.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4f2ffd700 1 -- 172.21.2.105:0/2047423697 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d400bea0 con 0x7ff4d4005070 2021-11-12T05:42:50.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4f2ffd700 1 -- 172.21.2.105:0/2047423697 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d400c060 con 0x7ff4d4003800 2021-11-12T05:42:50.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4f37fe700 1 --2- 172.21.2.105:0/2047423697 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff4d4004500 0x7ff4d4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:50.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4f37fe700 1 -- 172.21.2.105:0/2047423697 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff4d4003800 msgr2=0x7ff4d4003c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:50.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4f37fe700 1 --2- 172.21.2.105:0/2047423697 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff4d4003800 0x7ff4d4003c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:50.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4f37fe700 1 -- 172.21.2.105:0/2047423697 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff4d4005070 msgr2=0x7ff4d400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:50.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4f37fe700 1 --2- 172.21.2.105:0/2047423697 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff4d4005070 0x7ff4d400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:50.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4f37fe700 1 -- 172.21.2.105:0/2047423697 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d4003260 con 0x7ff4d4004500 2021-11-12T05:42:50.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4f37fe700 1 --2- 172.21.2.105:0/2047423697 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff4d4004500 0x7ff4d4004980 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7ff4dc000f70 tx=0x7ff4dc0079e0).ready entity=mon.0 client_cookie=3a6b5f47d4cc2209 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:50.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4f2ffd700 1 -- 172.21.2.105:0/2047423697 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4dc007cf0 con 0x7ff4d4004500 2021-11-12T05:42:50.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4f2ffd700 1 -- 172.21.2.105:0/2047423697 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4dc014410 con 0x7ff4d4004500 2021-11-12T05:42:50.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4f2ffd700 1 -- 172.21.2.105:0/2047423697 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4dc014770 con 0x7ff4d4004500 2021-11-12T05:42:50.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4fa30a700 1 -- 172.21.2.105:0/2047423697 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff4d4004500 msgr2=0x7ff4d4004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:50.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4fa30a700 1 --2- 172.21.2.105:0/2047423697 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff4d4004500 0x7ff4d4004980 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7ff4dc000f70 tx=0x7ff4dc0079e0).stop 2021-11-12T05:42:50.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4f88a7700 1 -- 172.21.2.105:0/2047423697 reap_dead start 2021-11-12T05:42:50.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4fa30a700 1 -- 172.21.2.105:0/2047423697 shutdown_connections 2021-11-12T05:42:50.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4fa30a700 1 -- 172.21.2.105:0/2047423697 >> 172.21.2.105:0/2047423697 conn(0x7ff4f40b5320 msgr2=0x7ff4f40b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:50.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4fa30a700 1 -- 172.21.2.105:0/2047423697 shutdown_connections 2021-11-12T05:42:50.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.807+0000 7ff4fa30a700 1 -- 172.21.2.105:0/2047423697 wait complete. 2021-11-12T05:42:50.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff4fa30a700 1 Processor -- start 2021-11-12T05:42:50.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff4fa30a700 1 -- start start 2021-11-12T05:42:50.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff4fa30a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff4d4004500 0x7ff4f414aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff4fa30a700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff4f40647a0 0x7ff4f41568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff4fa30a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff4f415a5b0 0x7ff4f415aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff4fa30a700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f4131ce0 con 0x7ff4f415a5b0 2021-11-12T05:42:50.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff4fa30a700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f4159eb0 con 0x7ff4f40647a0 2021-11-12T05:42:50.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff4fa30a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f4131f10 con 0x7ff4d4004500 2021-11-12T05:42:50.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff4f88a7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff4f415a5b0 0x7ff4f415aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:50.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff4f88a7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff4f415a5b0 0x7ff4f415aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45290/0 (socket says 172.21.2.105:45290) 2021-11-12T05:42:50.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff4f88a7700 1 -- 172.21.2.105:0/1423688415 learned_addr learned my addr 172.21.2.105:0/1423688415 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:50.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff4f88a7700 1 -- 172.21.2.105:0/1423688415 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff4d4004500 msgr2=0x7ff4f414aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:50.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff4f88a7700 1 --2- 172.21.2.105:0/1423688415 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff4d4004500 0x7ff4f414aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:50.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff4f88a7700 1 -- 172.21.2.105:0/1423688415 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff4f40647a0 msgr2=0x7ff4f41568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:50.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff4f88a7700 1 --2- 172.21.2.105:0/1423688415 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff4f40647a0 0x7ff4f41568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:50.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff4f88a7700 1 -- 172.21.2.105:0/1423688415 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f415a110 con 0x7ff4f415a5b0 2021-11-12T05:42:50.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff4f88a7700 1 --2- 172.21.2.105:0/1423688415 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff4f415a5b0 0x7ff4f415aa30 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7ff4ec0016f0 tx=0x7ff4ec001d30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:50.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff4f17fa700 1 -- 172.21.2.105:0/1423688415 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4ec004ab0 con 0x7ff4f415a5b0 2021-11-12T05:42:50.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff4f17fa700 1 -- 172.21.2.105:0/1423688415 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ec004c10 con 0x7ff4f415a5b0 2021-11-12T05:42:50.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff4fa30a700 1 -- 172.21.2.105:0/1423688415 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f4064440 con 0x7ff4f415a5b0 2021-11-12T05:42:50.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff4fa30a700 1 -- 172.21.2.105:0/1423688415 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f4156dd0 con 0x7ff4f415a5b0 2021-11-12T05:42:50.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff4f17fa700 1 -- 172.21.2.105:0/1423688415 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4ec0070d0 con 0x7ff4f415a5b0 2021-11-12T05:42:50.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff4f17fa700 1 -- 172.21.2.105:0/1423688415 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff4ec01c070 con 0x7ff4f415a5b0 2021-11-12T05:42:50.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff4f17fa700 1 --2- 172.21.2.105:0/1423688415 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff4d80535b0 0x7ff4d8055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff4f17fa700 1 -- 172.21.2.105:0/1423688415 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6416+0+0 (secure 0 0 0) 0x7ff4ec06ad90 con 0x7ff4f415a5b0 2021-11-12T05:42:50.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff4f3fff700 1 --2- 172.21.2.105:0/1423688415 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff4d80535b0 0x7ff4d8055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:50.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff4f3fff700 1 --2- 172.21.2.105:0/1423688415 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff4d80535b0 0x7ff4d8055a70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7ff4e4002f70 tx=0x7ff4e4006a00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:50.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff50454e740 1 Processor -- start 2021-11-12T05:42:50.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff50454e740 1 -- start start 2021-11-12T05:42:50.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff50454e740 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x17a5f70 0x17a85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff50454e740 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x17aabc0 0x17e1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff50454e740 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x17d9c80 0x17da100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff50454e740 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x171b1f0 con 0x17a5f70 2021-11-12T05:42:50.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff50454e740 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x16fb880 con 0x17aabc0 2021-11-12T05:42:50.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff50454e740 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x17a9880 con 0x17d9c80 2021-11-12T05:42:50.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff4f3fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x17a5f70 0x17a85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:50.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff4f3fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x17a5f70 0x17a85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45296/0 (socket says 172.21.2.105:45296) 2021-11-12T05:42:50.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff4f3fff700 1 -- 172.21.2.105:0/2866788451 learned_addr learned my addr 172.21.2.105:0/2866788451 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:50.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff4f3fff700 1 -- 172.21.2.105:0/2866788451 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x17d9c80 msgr2=0x17da100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:50.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff4f3fff700 1 --2- 172.21.2.105:0/2866788451 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x17d9c80 0x17da100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:50.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff4f3fff700 1 -- 172.21.2.105:0/2866788451 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x17aabc0 msgr2=0x17e1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:50.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff4f3fff700 1 --2- 172.21.2.105:0/2866788451 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x17aabc0 0x17e1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:50.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.811+0000 7ff4f3fff700 1 -- 172.21.2.105:0/2866788451 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1753f30 con 0x17a5f70 2021-11-12T05:42:50.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff4f3fff700 1 --2- 172.21.2.105:0/2866788451 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x17a5f70 0x17a85b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7ff4e4009c10 tx=0x7ff4e400f000).ready entity=mon.0 client_cookie=9e607d43a8006fa8 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:50.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff4fa30a700 1 -- 172.21.2.105:0/2866788451 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4e4015310 con 0x17a5f70 2021-11-12T05:42:50.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff4fa30a700 1 -- 172.21.2.105:0/2866788451 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e4013660 con 0x17a5f70 2021-11-12T05:42:50.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff4fa30a700 1 -- 172.21.2.105:0/2866788451 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4e40139c0 con 0x17a5f70 2021-11-12T05:42:50.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 1 -- 172.21.2.105:0/2866788451 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x17a5f70 msgr2=0x17a85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:50.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 1 --2- 172.21.2.105:0/2866788451 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x17a5f70 0x17a85b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7ff4e4009c10 tx=0x7ff4e400f000).stop 2021-11-12T05:42:50.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 1 -- 172.21.2.105:0/2866788451 shutdown_connections 2021-11-12T05:42:50.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 1 --2- 172.21.2.105:0/2866788451 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x17d9c80 0x17da100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:50.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 1 --2- 172.21.2.105:0/2866788451 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x17aabc0 0x17e1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:50.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 1 --2- 172.21.2.105:0/2866788451 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x17a5f70 0x17a85b0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:50.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 1 -- 172.21.2.105:0/2866788451 >> 172.21.2.105:0/2866788451 conn(0x17595d0 msgr2=0x17ad880 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:50.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 1 -- 172.21.2.105:0/2866788451 shutdown_connections 2021-11-12T05:42:50.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 1 -- 172.21.2.105:0/2866788451 wait complete. 2021-11-12T05:42:50.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 1 -- start start 2021-11-12T05:42:50.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 1 Processor -- start 2021-11-12T05:42:50.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x17a5f70 0x17dd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x17aabc0 0x17de240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x17d9c80 0x17de730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x17dfd10 con 0x17aabc0 2021-11-12T05:42:50.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x17dff40 con 0x17d9c80 2021-11-12T05:42:50.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x17e01e0 con 0x17a5f70 2021-11-12T05:42:50.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 10 client.0 ll_register_callbacks cb 0x1759c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-11-12T05:42:50.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff4f37fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x17aabc0 0x17de240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:50.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff4f37fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x17aabc0 0x17de240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45304/0 (socket says 172.21.2.105:45304) 2021-11-12T05:42:50.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff4f37fe700 1 -- 172.21.2.105:0/1967179334 learned_addr learned my addr 172.21.2.105:0/1967179334 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:50.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff4f37fe700 1 -- 172.21.2.105:0/1967179334 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x17a5f70 msgr2=0x17dd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:50.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff4f37fe700 1 --2- 172.21.2.105:0/1967179334 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x17a5f70 0x17dd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:50.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff4f37fe700 1 -- 172.21.2.105:0/1967179334 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x17d9c80 msgr2=0x17de730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:50.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff4f37fe700 1 --2- 172.21.2.105:0/1967179334 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x17d9c80 0x17de730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:50.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff4f37fe700 1 -- 172.21.2.105:0/1967179334 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4e4015520 con 0x17aabc0 2021-11-12T05:42:50.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff4f37fe700 1 --2- 172.21.2.105:0/1967179334 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x17aabc0 0x17de240 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7ff4dc000f70 tx=0x7ff4dc015000).ready entity=mon.0 client_cookie=d78738bbff2207e9 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:50.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff4d2ffd700 10 client.0 ms_handle_connect on v2:172.21.2.105:3300/0 2021-11-12T05:42:50.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff4d2ffd700 1 -- 172.21.2.105:0/1967179334 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4dc007cf0 con 0x17aabc0 2021-11-12T05:42:50.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff4d2ffd700 1 -- 172.21.2.105:0/1967179334 <== mon.0 v2:172.21.2.105:3300/0 2 ==== osd_map(45..45 src has 1..45) v4 ==== 6416+0+0 (secure 0 0 0) 0x7ff4dc01c040 con 0x17aabc0 2021-11-12T05:42:50.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 1 -- 172.21.2.105:0/1967179334 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x17111d0 con 0x17aabc0 2021-11-12T05:42:50.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff4d2ffd700 1 -- 172.21.2.105:0/1967179334 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4dc001a60 con 0x17aabc0 2021-11-12T05:42:50.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 10 client.5442 fetch_fsmap learned FSMap version 15 2021-11-12T05:42:50.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 1 -- 172.21.2.105:0/1967179334 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x170aab0 con 0x17aabc0 2021-11-12T05:42:50.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff4d2ffd700 1 -- 172.21.2.105:0/1967179334 <== mon.0 v2:172.21.2.105:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x17111d0 con 0x17aabc0 2021-11-12T05:42:50.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff4d2ffd700 1 -- 172.21.2.105:0/1967179334 <== mon.0 v2:172.21.2.105:3300/0 5 ==== fsmap(e 15) v1 ==== 1247+0+0 (secure 0 0 0) 0x7ff4dc013d10 con 0x17aabc0 2021-11-12T05:42:50.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 10 client.5442 fetch_fsmap finished waiting for FSMap version 15 2021-11-12T05:42:50.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 10 client.5442 resolve_mds: resolved ID 'a' to GID 5250 2021-11-12T05:42:50.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 20 client.5442 populate_metadata read hostname 'gibba005' 2021-11-12T05:42:50.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 1 --2- 172.21.2.105:0/1967179334 >> [v2:172.21.2.105:6834/3058129917,v1:172.21.2.105:6835/3058129917] conn(0x17def80 0x17d7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 4 client.5442 mds_command: new command op to 5250 tid=0[{"prefix": "get_command_descriptions"}] 2021-11-12T05:42:50.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 1 -- 172.21.2.105:0/1967179334 --> [v2:172.21.2.105:6834/3058129917,v1:172.21.2.105:6835/3058129917] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1709540 con 0x17def80 2021-11-12T05:42:50.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff4f3fff700 1 --2- 172.21.2.105:0/1967179334 >> [v2:172.21.2.105:6834/3058129917,v1:172.21.2.105:6835/3058129917] conn(0x17def80 0x17d7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:50.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff4d2ffd700 10 client.5442 ms_handle_connect on v2:172.21.2.105:6834/3058129917 2021-11-12T05:42:50.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff4f3fff700 1 --2- 172.21.2.105:0/1967179334 >> [v2:172.21.2.105:6834/3058129917,v1:172.21.2.105:6835/3058129917] conn(0x17def80 0x17d7710 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=739e0158c65ead91 server_cookie=71bd450a3b0c1173 in_seq=0 out_seq=0 2021-11-12T05:42:50.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff4d2ffd700 1 -- 172.21.2.105:0/1967179334 <== mds.0 v2:172.21.2.105:6834/3058129917 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x1709540 con 0x17def80 2021-11-12T05:42:50.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff4d2ffd700 10 client.5442 handle_command_reply: tid=0 2021-11-12T05:42:50.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 1 client.5442 shutdown 2021-11-12T05:42:50.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 1 -- 172.21.2.105:0/1967179334 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x17aabc0 msgr2=0x17de240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:50.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 1 --2- 172.21.2.105:0/1967179334 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x17aabc0 0x17de240 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7ff4dc000f70 tx=0x7ff4dc015000).stop 2021-11-12T05:42:50.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 1 -- 172.21.2.105:0/1967179334 shutdown_connections 2021-11-12T05:42:50.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 1 --2- 172.21.2.105:0/1967179334 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x17d9c80 0x17de730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:50.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 1 --2- 172.21.2.105:0/1967179334 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x17aabc0 0x17de240 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:50.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 1 --2- 172.21.2.105:0/1967179334 >> [v2:172.21.2.105:6834/3058129917,v1:172.21.2.105:6835/3058129917] conn(0x17def80 0x17d7710 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:50.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 1 --2- 172.21.2.105:0/1967179334 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x17a5f70 0x17dd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:50.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 1 -- 172.21.2.105:0/1967179334 >> 172.21.2.105:0/1967179334 conn(0x17595d0 msgr2=0x17a85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:50.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff4d2ffd700 0 client.5442 ms_handle_reset on v2:172.21.2.105:6834/3058129917 2021-11-12T05:42:50.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 1 -- 172.21.2.105:0/1967179334 shutdown_connections 2021-11-12T05:42:50.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 1 -- 172.21.2.105:0/1967179334 wait complete. 2021-11-12T05:42:50.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.815+0000 7ff50454e740 20 client.5442 trim_cache size 0 max 16384 2021-11-12T05:42:50.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.823+0000 7ff50454e740 1 Processor -- start 2021-11-12T05:42:50.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.823+0000 7ff50454e740 1 -- start start 2021-11-12T05:42:50.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.823+0000 7ff50454e740 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x17a5f70 0x17d6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.823+0000 7ff50454e740 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x17aabc0 0x17de160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.823+0000 7ff50454e740 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x17d9c80 0x17e0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.823+0000 7ff50454e740 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x172a840 con 0x17d9c80 2021-11-12T05:42:50.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.823+0000 7ff50454e740 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x1709540 con 0x17a5f70 2021-11-12T05:42:50.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.823+0000 7ff50454e740 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x17684c0 con 0x17aabc0 2021-11-12T05:42:50.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.823+0000 7ff4f88a7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x17d9c80 0x17e0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:50.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.823+0000 7ff4f88a7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x17d9c80 0x17e0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45310/0 (socket says 172.21.2.105:45310) 2021-11-12T05:42:50.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.823+0000 7ff4f88a7700 1 -- 172.21.2.105:0/4185121260 learned_addr learned my addr 172.21.2.105:0/4185121260 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:50.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.823+0000 7ff4f88a7700 1 -- 172.21.2.105:0/4185121260 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x17aabc0 msgr2=0x17de160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:50.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.823+0000 7ff4f88a7700 1 --2- 172.21.2.105:0/4185121260 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x17aabc0 0x17de160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:50.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.823+0000 7ff4f88a7700 1 -- 172.21.2.105:0/4185121260 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x17a5f70 msgr2=0x17d6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:50.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.823+0000 7ff4f88a7700 1 --2- 172.21.2.105:0/4185121260 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x17a5f70 0x17d6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:50.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.823+0000 7ff4f88a7700 1 -- 172.21.2.105:0/4185121260 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x17133b0 con 0x17d9c80 2021-11-12T05:42:50.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.823+0000 7ff4f88a7700 1 --2- 172.21.2.105:0/4185121260 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x17d9c80 0x17e0480 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7ff4ec0019a0 tx=0x7ff4ec007000).ready entity=mon.0 client_cookie=605ed21de0ef801f server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:50.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.823+0000 7ff4e97fa700 1 -- 172.21.2.105:0/4185121260 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4ec045a60 con 0x17d9c80 2021-11-12T05:42:50.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.823+0000 7ff4e97fa700 1 -- 172.21.2.105:0/4185121260 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ec041850 con 0x17d9c80 2021-11-12T05:42:50.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.823+0000 7ff4e97fa700 1 -- 172.21.2.105:0/4185121260 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4ec041bf0 con 0x17d9c80 2021-11-12T05:42:50.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.823+0000 7ff50454e740 1 -- 172.21.2.105:0/4185121260 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x17d9c80 msgr2=0x17e0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:42:50.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.823+0000 7ff50454e740 1 --2- 172.21.2.105:0/4185121260 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x17d9c80 0x17e0480 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7ff4ec0019a0 tx=0x7ff4ec007000).stop 2021-11-12T05:42:50.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.823+0000 7ff50454e740 1 -- 172.21.2.105:0/4185121260 shutdown_connections 2021-11-12T05:42:50.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.823+0000 7ff50454e740 1 --2- 172.21.2.105:0/4185121260 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x17d9c80 0x17e0480 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:42:50.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.823+0000 7ff50454e740 1 --2- 172.21.2.105:0/4185121260 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x17aabc0 0x17de160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:50.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.823+0000 7ff50454e740 1 --2- 172.21.2.105:0/4185121260 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x17a5f70 0x17d6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:50.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.823+0000 7ff50454e740 1 -- 172.21.2.105:0/4185121260 >> 172.21.2.105:0/4185121260 conn(0x17595d0 msgr2=0x17dd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:42:50.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.827+0000 7ff50454e740 1 -- 172.21.2.105:0/4185121260 shutdown_connections 2021-11-12T05:42:50.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.827+0000 7ff50454e740 1 -- 172.21.2.105:0/4185121260 wait complete. 2021-11-12T05:42:50.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.827+0000 7ff50454e740 1 -- start start 2021-11-12T05:42:50.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.827+0000 7ff50454e740 1 Processor -- start 2021-11-12T05:42:50.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.827+0000 7ff50454e740 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x17a5f70 0x17d6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.827+0000 7ff50454e740 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x17aabc0 0x183cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.827+0000 7ff50454e740 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x17d9c80 0x17efe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.827+0000 7ff50454e740 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x1847460 con 0x17a5f70 2021-11-12T05:42:50.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.827+0000 7ff50454e740 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x17a8fc0 con 0x17aabc0 2021-11-12T05:42:50.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.827+0000 7ff50454e740 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x17ab270 con 0x17d9c80 2021-11-12T05:42:50.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.827+0000 7ff50454e740 10 client.0 ll_register_callbacks cb 0x17dcb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-11-12T05:42:50.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.827+0000 7ff4f3fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x17a5f70 0x17d6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:50.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.827+0000 7ff4f3fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x17a5f70 0x17d6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45314/0 (socket says 172.21.2.105:45314) 2021-11-12T05:42:50.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.827+0000 7ff4f3fff700 1 -- 172.21.2.105:0/43635927 learned_addr learned my addr 172.21.2.105:0/43635927 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:42:50.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.827+0000 7ff4f3fff700 1 -- 172.21.2.105:0/43635927 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x17d9c80 msgr2=0x17efe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:50.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.827+0000 7ff4f3fff700 1 --2- 172.21.2.105:0/43635927 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x17d9c80 0x17efe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:50.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.827+0000 7ff4f3fff700 1 -- 172.21.2.105:0/43635927 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x17aabc0 msgr2=0x183cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:42:50.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.827+0000 7ff4f3fff700 1 --2- 172.21.2.105:0/43635927 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x17aabc0 0x183cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:42:50.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.827+0000 7ff4f3fff700 1 -- 172.21.2.105:0/43635927 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f4156dd0 con 0x17a5f70 2021-11-12T05:42:50.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.827+0000 7ff4f3fff700 1 --2- 172.21.2.105:0/43635927 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x17a5f70 0x17d6b50 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x17d7bc0 tx=0x7ff4e4012000).ready entity=mon.0 client_cookie=87281ae3975c8671 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:42:50.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.827+0000 7ff4d3fff700 10 client.0 ms_handle_connect on v2:172.21.2.105:3300/0 2021-11-12T05:42:50.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.827+0000 7ff4d3fff700 1 -- 172.21.2.105:0/43635927 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4e4013ce0 con 0x17a5f70 2021-11-12T05:42:50.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.827+0000 7ff4d3fff700 1 -- 172.21.2.105:0/43635927 <== mon.0 v2:172.21.2.105:3300/0 2 ==== osd_map(45..45 src has 1..45) v4 ==== 6416+0+0 (secure 0 0 0) 0x7ff4e4013e40 con 0x17a5f70 2021-11-12T05:42:50.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.827+0000 7ff50454e740 1 -- 172.21.2.105:0/43635927 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff4e4013660 con 0x17a5f70 2021-11-12T05:42:50.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.827+0000 7ff4d3fff700 1 -- 172.21.2.105:0/43635927 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4e402b4e0 con 0x17a5f70 2021-11-12T05:42:50.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.827+0000 7ff50454e740 10 client.5448 fetch_fsmap learned FSMap version 15 2021-11-12T05:42:50.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.827+0000 7ff50454e740 1 -- 172.21.2.105:0/43635927 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x170fda0 con 0x17a5f70 2021-11-12T05:42:50.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.827+0000 7ff4d3fff700 1 -- 172.21.2.105:0/43635927 <== mon.0 v2:172.21.2.105:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e4013660 con 0x17a5f70 2021-11-12T05:42:50.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.827+0000 7ff4d3fff700 1 -- 172.21.2.105:0/43635927 <== mon.0 v2:172.21.2.105:3300/0 5 ==== fsmap(e 15) v1 ==== 1247+0+0 (secure 0 0 0) 0x7ff4e402bb90 con 0x17a5f70 2021-11-12T05:42:50.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.827+0000 7ff50454e740 10 client.5448 fetch_fsmap finished waiting for FSMap version 15 2021-11-12T05:42:50.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.827+0000 7ff50454e740 10 client.5448 resolve_mds: resolved ID 'a' to GID 5250 2021-11-12T05:42:50.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.827+0000 7ff50454e740 20 client.5448 populate_metadata read hostname 'gibba005' 2021-11-12T05:42:50.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.827+0000 7ff50454e740 1 --2- 172.21.2.105:0/43635927 >> [v2:172.21.2.105:6834/3058129917,v1:172.21.2.105:6835/3058129917] conn(0x183d0b0 0x17f0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:42:50.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.827+0000 7ff50454e740 4 client.5448 mds_command: new command op to 5250 tid=0[{"prefix": "cache drop"}] 2021-11-12T05:42:50.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.827+0000 7ff50454e740 1 -- 172.21.2.105:0/43635927 --> [v2:172.21.2.105:6834/3058129917,v1:172.21.2.105:6835/3058129917] -- command(tid 0: {"prefix": "cache drop"}) v1 -- 0x15ff590 con 0x183d0b0 2021-11-12T05:42:50.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.827+0000 7ff4f37fe700 1 --2- 172.21.2.105:0/43635927 >> [v2:172.21.2.105:6834/3058129917,v1:172.21.2.105:6835/3058129917] conn(0x183d0b0 0x17f0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:42:50.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.827+0000 7ff4f37fe700 1 --2- 172.21.2.105:0/43635927 >> [v2:172.21.2.105:6834/3058129917,v1:172.21.2.105:6835/3058129917] conn(0x183d0b0 0x17f0350 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=e09278825e051411 server_cookie=26106dfde9096fc4 in_seq=0 out_seq=0 2021-11-12T05:42:50.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:42:50.827+0000 7ff4d3fff700 10 client.5448 ms_handle_connect on v2:172.21.2.105:6834/3058129917 2021-11-12T05:42:54.346 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:42:54.351 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:42:54.354 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:42:54.357 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:42:54.361 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:43:01.919 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:01.915+0000 7ff4d3fff700 1 -- 172.21.2.105:0/43635927 <== mds.0 v2:172.21.2.105:6834/3058129917 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+380 (crc 0 0 0) 0x15ff590 con 0x183d0b0 2021-11-12T05:43:01.920 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:01.915+0000 7ff4d3fff700 10 client.5448 handle_command_reply: tid=0 2021-11-12T05:43:01.920 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:01.915+0000 7ff50454e740 1 client.5448 shutdown 2021-11-12T05:43:01.920 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:01.915+0000 7ff50454e740 1 -- 172.21.2.105:0/43635927 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x17a5f70 msgr2=0x17d6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:01.920 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:01.915+0000 7ff50454e740 1 --2- 172.21.2.105:0/43635927 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x17a5f70 0x17d6b50 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x17d7bc0 tx=0x7ff4e4012000).stop 2021-11-12T05:43:01.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:01.915+0000 7ff50454e740 1 -- 172.21.2.105:0/43635927 shutdown_connections 2021-11-12T05:43:01.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:01.915+0000 7ff50454e740 1 --2- 172.21.2.105:0/43635927 >> [v2:172.21.2.105:6834/3058129917,v1:172.21.2.105:6835/3058129917] conn(0x183d0b0 0x17f0350 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:01.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:01.915+0000 7ff50454e740 1 --2- 172.21.2.105:0/43635927 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x17d9c80 0x17efe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:01.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:01.915+0000 7ff50454e740 1 --2- 172.21.2.105:0/43635927 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x17aabc0 0x183cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:01.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:01.915+0000 7ff4d3fff700 0 client.5448 ms_handle_reset on v2:172.21.2.105:6834/3058129917 2021-11-12T05:43:01.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:01.915+0000 7ff50454e740 1 --2- 172.21.2.105:0/43635927 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x17a5f70 0x17d6b50 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:01.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:01.915+0000 7ff50454e740 1 -- 172.21.2.105:0/43635927 >> 172.21.2.105:0/43635927 conn(0x17595d0 msgr2=0x17e46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:43:01.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:01.915+0000 7ff50454e740 1 -- 172.21.2.105:0/43635927 shutdown_connections 2021-11-12T05:43:01.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:01.915+0000 7ff50454e740 1 -- 172.21.2.105:0/43635927 wait complete. 2021-11-12T05:43:01.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:01.915+0000 7ff50454e740 20 client.5448 trim_cache size 0 max 16384 2021-11-12T05:43:01.923 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:43:01.924 INFO:teuthology.orchestra.run.gibba005.stdout: "client_recall": { 2021-11-12T05:43:01.924 INFO:teuthology.orchestra.run.gibba005.stdout: "return_code": 0, 2021-11-12T05:43:01.924 INFO:teuthology.orchestra.run.gibba005.stdout: "message": "(0) Success", 2021-11-12T05:43:01.924 INFO:teuthology.orchestra.run.gibba005.stdout: "recalled": 220 2021-11-12T05:43:01.924 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:01.925 INFO:teuthology.orchestra.run.gibba005.stdout: "flush_journal": { 2021-11-12T05:43:01.925 INFO:teuthology.orchestra.run.gibba005.stdout: "return_code": 0, 2021-11-12T05:43:01.925 INFO:teuthology.orchestra.run.gibba005.stdout: "message": "" 2021-11-12T05:43:01.925 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:01.926 INFO:teuthology.orchestra.run.gibba005.stdout: "trim_cache": { 2021-11-12T05:43:01.926 INFO:teuthology.orchestra.run.gibba005.stdout: "trimmed": 0 2021-11-12T05:43:01.926 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:01.926 INFO:teuthology.orchestra.run.gibba005.stdout: "cache": { 2021-11-12T05:43:01.927 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": { 2021-11-12T05:43:01.927 INFO:teuthology.orchestra.run.gibba005.stdout: "items": 19890, 2021-11-12T05:43:01.927 INFO:teuthology.orchestra.run.gibba005.stdout: "bytes": 3092384 2021-11-12T05:43:01.927 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:01.928 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:01.928 INFO:teuthology.orchestra.run.gibba005.stdout: "duration": 11.085483712 2021-11-12T05:43:01.928 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:43:01.930 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:01.915+0000 7ff4fa30a700 1 -- 172.21.2.105:0/1423688415 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff4d80535b0 msgr2=0x7ff4d8055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:01.930 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:01.915+0000 7ff4fa30a700 1 --2- 172.21.2.105:0/1423688415 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff4d80535b0 0x7ff4d8055a70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7ff4e4002f70 tx=0x7ff4e4006a00).stop 2021-11-12T05:43:01.931 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:01.915+0000 7ff4fa30a700 1 -- 172.21.2.105:0/1423688415 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff4f415a5b0 msgr2=0x7ff4f415aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:01.931 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:01.915+0000 7ff4fa30a700 1 --2- 172.21.2.105:0/1423688415 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff4f415a5b0 0x7ff4f415aa30 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7ff4ec0016f0 tx=0x7ff4ec001d30).stop 2021-11-12T05:43:01.931 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:01.915+0000 7ff4fa30a700 1 -- 172.21.2.105:0/1423688415 shutdown_connections 2021-11-12T05:43:01.931 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:01.915+0000 7ff4fa30a700 1 --2- 172.21.2.105:0/1423688415 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff4d80535b0 0x7ff4d8055a70 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:01.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:01.915+0000 7ff4fa30a700 1 --2- 172.21.2.105:0/1423688415 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff4f415a5b0 0x7ff4f415aa30 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:01.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:01.915+0000 7ff4fa30a700 1 --2- 172.21.2.105:0/1423688415 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff4f40647a0 0x7ff4f41568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:01.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:01.915+0000 7ff4fa30a700 1 --2- 172.21.2.105:0/1423688415 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff4d4004500 0x7ff4f414aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:01.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:01.915+0000 7ff4fa30a700 1 -- 172.21.2.105:0/1423688415 >> 172.21.2.105:0/1423688415 conn(0x7ff4f40b5320 msgr2=0x7ff4f40b4950 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:43:01.933 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:01.915+0000 7ff4fa30a700 1 -- 172.21.2.105:0/1423688415 shutdown_connections 2021-11-12T05:43:01.933 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:01.915+0000 7ff4fa30a700 1 -- 172.21.2.105:0/1423688415 wait complete. 2021-11-12T05:43:01.933 INFO:tasks.cephfs.fuse_mount:Cleaning up killed ceph-fuse connection 2021-11-12T05:43:01.934 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:43:01.934 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:43:01.935 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:43:01.945 INFO:teuthology.orchestra.run.gibba016.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-11-12T05:43:01.945 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:43:01.946 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-11-12T05:43:01.947 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba016.front.sepia.ceph.com... 2021-11-12T05:43:01.947 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-12T05:43:01.948 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:43:02.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:43:02.004 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:43:02.004 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:43:02.009 INFO:teuthology.orchestra.run.gibba016.stdout:ext2/ext3 2021-11-12T05:43:02.009 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-12T05:43:02.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:43:02.010 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:43:02.015 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:43:02.123 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.119+0000 7f5a378d8700 1 Processor -- start 2021-11-12T05:43:02.123 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.119+0000 7f5a378d8700 1 -- start start 2021-11-12T05:43:02.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.119+0000 7f5a378d8700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f5a300b0cc0 0x7f5a3014a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.119+0000 7f5a378d8700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a300b2d20 con 0x7f5a300b2940 2021-11-12T05:43:02.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.119+0000 7f5a378d8700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a300b1fc0 con 0x7f5a300b0780 2021-11-12T05:43:02.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.119+0000 7f5a378d8700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a300b15e0 con 0x7f5a300b0cc0 2021-11-12T05:43:02.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.119+0000 7f5a35e75700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f5a300b0cc0 0x7f5a3014a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:02.127 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.119+0000 7f5a35674700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f5a300b2940 0x7f5a30142dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:55720/0 (socket says 172.21.2.105:55720) 2021-11-12T05:43:02.127 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.119+0000 7f5a35674700 1 -- 172.21.2.105:0/3365882618 learned_addr learned my addr 172.21.2.105:0/3365882618 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:43:02.127 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.119+0000 7f5a35e75700 1 -- 172.21.2.105:0/3365882618 >> v1:172.21.2.115:6789/0 conn(0x7f5a300b0780 legacy=0x7f5a301434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:43:02.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.119+0000 7f5a35e75700 1 -- 172.21.2.105:0/3365882618 >> v1:172.21.2.105:6789/0 conn(0x7f5a300b2940 legacy=0x7f5a30142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:02.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.119+0000 7f5a35e75700 1 -- 172.21.2.105:0/3365882618 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a300b1880 con 0x7f5a300b0cc0 2021-11-12T05:43:02.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.119+0000 7f5a35e75700 1 --2- 172.21.2.105:0/3365882618 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5a300b0cc0 0x7f5a3014a330 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f5a24001110 tx=0x7f5a280091d0).ready entity=mon.0 client_cookie=2df8cd299ae83cf3 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:02.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.119+0000 7f5a23fff700 1 -- 172.21.2.105:0/3365882618 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a28009ea0 con 0x7f5a300b0cc0 2021-11-12T05:43:02.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.119+0000 7f5a23fff700 1 -- 172.21.2.105:0/3365882618 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2800b760 con 0x7f5a300b0cc0 2021-11-12T05:43:02.129 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.119+0000 7f5a23fff700 1 -- 172.21.2.105:0/3365882618 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a2800b8d0 con 0x7f5a300b0cc0 2021-11-12T05:43:02.129 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.119+0000 7f5a378d8700 1 -- 172.21.2.105:0/3365882618 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5a300b0cc0 msgr2=0x7f5a3014a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:02.129 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.119+0000 7f5a378d8700 1 --2- 172.21.2.105:0/3365882618 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5a300b0cc0 0x7f5a3014a330 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f5a24001110 tx=0x7f5a280091d0).stop 2021-11-12T05:43:02.129 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.119+0000 7f5a378d8700 1 -- 172.21.2.105:0/3365882618 shutdown_connections 2021-11-12T05:43:02.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.119+0000 7f5a378d8700 1 --2- 172.21.2.105:0/3365882618 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5a300b0cc0 0x7f5a3014a330 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:02.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.119+0000 7f5a378d8700 1 -- 172.21.2.105:0/3365882618 >> 172.21.2.105:0/3365882618 conn(0x7f5a30068440 msgr2=0x7f5a30062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:43:02.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.119+0000 7f5a378d8700 1 -- 172.21.2.105:0/3365882618 shutdown_connections 2021-11-12T05:43:02.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.119+0000 7f5a378d8700 1 -- 172.21.2.105:0/3365882618 wait complete. 2021-11-12T05:43:02.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.119+0000 7f5a378d8700 1 Processor -- start 2021-11-12T05:43:02.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.119+0000 7f5a378d8700 1 -- start start 2021-11-12T05:43:02.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.123+0000 7f5a378d8700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5a300b0780 0x7f5a300aa130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.123+0000 7f5a378d8700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5a300b0cc0 0x7f5a3013d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.123+0000 7f5a378d8700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5a300b2940 0x7f5a3013b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.123+0000 7f5a378d8700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a300a9a60 con 0x7f5a300b2940 2021-11-12T05:43:02.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.123+0000 7f5a378d8700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a30143280 con 0x7f5a300b0780 2021-11-12T05:43:02.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.123+0000 7f5a378d8700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a301434e0 con 0x7f5a300b0cc0 2021-11-12T05:43:02.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.123+0000 7f5a35e75700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5a300b2940 0x7f5a3013b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:02.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.123+0000 7f5a35e75700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5a300b2940 0x7f5a3013b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45334/0 (socket says 172.21.2.105:45334) 2021-11-12T05:43:02.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.123+0000 7f5a35e75700 1 -- 172.21.2.105:0/3817658959 learned_addr learned my addr 172.21.2.105:0/3817658959 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:43:02.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.123+0000 7f5a35e75700 1 -- 172.21.2.105:0/3817658959 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5a300b0cc0 msgr2=0x7f5a3013d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:02.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.123+0000 7f5a35e75700 1 --2- 172.21.2.105:0/3817658959 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5a300b0cc0 0x7f5a3013d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:02.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.123+0000 7f5a35e75700 1 -- 172.21.2.105:0/3817658959 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5a300b0780 msgr2=0x7f5a300aa130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:02.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.123+0000 7f5a35e75700 1 --2- 172.21.2.105:0/3817658959 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5a300b0780 0x7f5a300aa130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:02.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.123+0000 7f5a35e75700 1 -- 172.21.2.105:0/3817658959 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a28009470 con 0x7f5a300b2940 2021-11-12T05:43:02.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.123+0000 7f5a35e75700 1 --2- 172.21.2.105:0/3817658959 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5a300b2940 0x7f5a3013b0e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f5a24001110 tx=0x7f5a28016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:02.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.123+0000 7f5a227fc700 1 -- 172.21.2.105:0/3817658959 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a280107a0 con 0x7f5a300b2940 2021-11-12T05:43:02.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.123+0000 7f5a227fc700 1 -- 172.21.2.105:0/3817658959 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a28010900 con 0x7f5a300b2940 2021-11-12T05:43:02.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.123+0000 7f5a378d8700 1 -- 172.21.2.105:0/3817658959 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a300a9c90 con 0x7f5a300b2940 2021-11-12T05:43:02.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.123+0000 7f5a227fc700 1 -- 172.21.2.105:0/3817658959 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a28010c60 con 0x7f5a300b2940 2021-11-12T05:43:02.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.123+0000 7f5a378d8700 1 -- 172.21.2.105:0/3817658959 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a300ac960 con 0x7f5a300b2940 2021-11-12T05:43:02.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.123+0000 7f5a378d8700 1 -- 172.21.2.105:0/3817658959 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a301420f0 con 0x7f5a300b2940 2021-11-12T05:43:02.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.123+0000 7f5a227fc700 1 -- 172.21.2.105:0/3817658959 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5a28027030 con 0x7f5a300b2940 2021-11-12T05:43:02.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.123+0000 7f5a227fc700 1 --2- 172.21.2.105:0/3817658959 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5a10053610 0x7f5a10055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.123+0000 7f5a227fc700 1 -- 172.21.2.105:0/3817658959 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f5a2806cca0 con 0x7f5a300b2940 2021-11-12T05:43:02.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.123+0000 7f5a35674700 1 --2- 172.21.2.105:0/3817658959 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5a10053610 0x7f5a10055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:02.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.123+0000 7f5a35674700 1 --2- 172.21.2.105:0/3817658959 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5a10053610 0x7f5a10055ad0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f5a24000bc0 tx=0x7f5a24007800).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:02.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.127+0000 7f5a227fc700 1 -- 172.21.2.105:0/3817658959 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5a301420f0 con 0x7f5a300b2940 2021-11-12T05:43:02.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.207+0000 7f5a378d8700 1 -- 172.21.2.105:0/3817658959 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a301420f0 con 0x7f5a300b2940 2021-11-12T05:43:02.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.207+0000 7f5a227fc700 1 -- 172.21.2.105:0/3817658959 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+16271 (secure 0 0 0) 0x7f5a301420f0 con 0x7f5a300b2940 2021-11-12T05:43:02.213 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:43:02.213 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":45,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:42:28.269153+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:42:25.227892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-11-12T05:42:26.242644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:43:02.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.207+0000 7f5a378d8700 1 -- 172.21.2.105:0/3817658959 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5a10053610 msgr2=0x7f5a10055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:02.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.207+0000 7f5a378d8700 1 --2- 172.21.2.105:0/3817658959 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5a10053610 0x7f5a10055ad0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f5a24000bc0 tx=0x7f5a24007800).stop 2021-11-12T05:43:02.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.207+0000 7f5a378d8700 1 -- 172.21.2.105:0/3817658959 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5a300b2940 msgr2=0x7f5a3013b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:02.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.207+0000 7f5a378d8700 1 --2- 172.21.2.105:0/3817658959 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5a300b2940 0x7f5a3013b0e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f5a24001110 tx=0x7f5a28016000).stop 2021-11-12T05:43:02.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.207+0000 7f5a378d8700 1 -- 172.21.2.105:0/3817658959 shutdown_connections 2021-11-12T05:43:02.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.207+0000 7f5a378d8700 1 --2- 172.21.2.105:0/3817658959 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5a10053610 0x7f5a10055ad0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:02.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.207+0000 7f5a378d8700 1 --2- 172.21.2.105:0/3817658959 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5a300b2940 0x7f5a3013b0e0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:02.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.207+0000 7f5a378d8700 1 --2- 172.21.2.105:0/3817658959 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5a300b0cc0 0x7f5a3013d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:02.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.207+0000 7f5a378d8700 1 --2- 172.21.2.105:0/3817658959 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5a300b0780 0x7f5a300aa130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:02.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.207+0000 7f5a378d8700 1 -- 172.21.2.105:0/3817658959 >> 172.21.2.105:0/3817658959 conn(0x7f5a30068440 msgr2=0x7f5a300b5060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:43:02.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.207+0000 7f5a378d8700 1 -- 172.21.2.105:0/3817658959 shutdown_connections 2021-11-12T05:43:02.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.207+0000 7f5a378d8700 1 -- 172.21.2.105:0/3817658959 wait complete. 2021-11-12T05:43:02.220 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-12T05:42:25.227892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2021-11-12T05:42:26.242644+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-12T05:43:02.221 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:43:02.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.267+0000 7efc5c539700 1 Processor -- start 2021-11-12T05:43:02.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.267+0000 7efc5c539700 1 -- start start 2021-11-12T05:43:02.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc5c539700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efc540b2cc0 0x7efc540b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc5c539700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc540aa0b0 con 0x7efc540b2290 2021-11-12T05:43:02.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc5c539700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc540a9b70 con 0x7efc54143da0 2021-11-12T05:43:02.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc5c539700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc540a9e10 con 0x7efc540b2cc0 2021-11-12T05:43:02.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc59ad4700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7efc540b2290 0x7efc54143690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:55736/0 (socket says 172.21.2.105:55736) 2021-11-12T05:43:02.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc59ad4700 1 -- 172.21.2.105:0/2211215519 learned_addr learned my addr 172.21.2.105:0/2211215519 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:43:02.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc592d3700 1 -- 172.21.2.105:0/2211215519 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3820361852 0 0) 0x7efc540aa0b0 con 0x7efc540b2290 2021-11-12T05:43:02.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc592d3700 1 -- 172.21.2.105:0/2211215519 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc3c003260 con 0x7efc540b2290 2021-11-12T05:43:02.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc592d3700 1 -- 172.21.2.105:0/2211215519 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3390993375 0 0) 0x7efc3c003260 con 0x7efc540b2290 2021-11-12T05:43:02.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc592d3700 1 -- 172.21.2.105:0/2211215519 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efc540b2cc0 msgr2=0x7efc540b30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:43:02.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc592d3700 1 --2- 172.21.2.105:0/2211215519 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efc540b2cc0 0x7efc540b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:02.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc592d3700 1 -- 172.21.2.105:0/2211215519 >> v1:172.21.2.115:6789/0 conn(0x7efc54143da0 legacy=0x7efc54140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:43:02.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc592d3700 1 -- 172.21.2.105:0/2211215519 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc540b0800 con 0x7efc540b2290 2021-11-12T05:43:02.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc592d3700 1 -- 172.21.2.105:0/2211215519 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7efc44001660 con 0x7efc540b2290 2021-11-12T05:43:02.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc592d3700 1 -- 172.21.2.105:0/2211215519 >> v1:172.21.2.105:6789/0 conn(0x7efc540b2290 legacy=0x7efc54143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:02.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc592d3700 1 --2- 172.21.2.105:0/2211215519 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efc3c003800 0x7efc3c003c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc592d3700 1 --2- 172.21.2.105:0/2211215519 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efc540b2cc0 0x7efc3c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc592d3700 1 --2- 172.21.2.105:0/2211215519 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efc3c004bf0 0x7efc3c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc592d3700 1 -- 172.21.2.105:0/2211215519 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc540a9e10 con 0x7efc3c003800 2021-11-12T05:43:02.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc592d3700 1 -- 172.21.2.105:0/2211215519 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c0052a0 con 0x7efc3c004bf0 2021-11-12T05:43:02.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc592d3700 1 -- 172.21.2.105:0/2211215519 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c00bc40 con 0x7efc540b2cc0 2021-11-12T05:43:02.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc5a2d5700 1 --2- 172.21.2.105:0/2211215519 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efc3c003800 0x7efc3c003c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:02.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc5a2d5700 1 -- 172.21.2.105:0/2211215519 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efc540b2cc0 msgr2=0x7efc3c004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:43:02.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc5a2d5700 1 --2- 172.21.2.105:0/2211215519 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efc540b2cc0 0x7efc3c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:02.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc5a2d5700 1 -- 172.21.2.105:0/2211215519 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efc3c004bf0 msgr2=0x7efc3c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:43:02.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc5a2d5700 1 --2- 172.21.2.105:0/2211215519 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efc3c004bf0 0x7efc3c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:02.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc5a2d5700 1 -- 172.21.2.105:0/2211215519 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3c003260 con 0x7efc3c003800 2021-11-12T05:43:02.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc5a2d5700 1 --2- 172.21.2.105:0/2211215519 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efc3c003800 0x7efc3c003c00 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7efc50002f70 tx=0x7efc50006ca0).ready entity=mon.0 client_cookie=ec95b0adfcb1e11c server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:02.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc592d3700 1 -- 172.21.2.105:0/2211215519 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc50012770 con 0x7efc3c003800 2021-11-12T05:43:02.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc592d3700 1 -- 172.21.2.105:0/2211215519 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc500128d0 con 0x7efc3c003800 2021-11-12T05:43:02.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc592d3700 1 -- 172.21.2.105:0/2211215519 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc50012c30 con 0x7efc3c003800 2021-11-12T05:43:02.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc5c539700 1 -- 172.21.2.105:0/2211215519 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efc3c003800 msgr2=0x7efc3c003c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:02.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc5c539700 1 --2- 172.21.2.105:0/2211215519 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efc3c003800 0x7efc3c003c00 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7efc50002f70 tx=0x7efc50006ca0).stop 2021-11-12T05:43:02.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc5aad6700 1 -- 172.21.2.105:0/2211215519 reap_dead start 2021-11-12T05:43:02.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc5c539700 1 -- 172.21.2.105:0/2211215519 shutdown_connections 2021-11-12T05:43:02.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc5c539700 1 -- 172.21.2.105:0/2211215519 >> 172.21.2.105:0/2211215519 conn(0x7efc5405c490 msgr2=0x7efc5405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:43:02.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc5c539700 1 -- 172.21.2.105:0/2211215519 shutdown_connections 2021-11-12T05:43:02.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc5c539700 1 -- 172.21.2.105:0/2211215519 wait complete. 2021-11-12T05:43:02.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc5c539700 1 Processor -- start 2021-11-12T05:43:02.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc5c539700 1 -- start start 2021-11-12T05:43:02.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc5c539700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efc54064590 0x7efc54064970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc5c539700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efc540ad1b0 0x7efc5414e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc5c539700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efc5414eae0 0x7efc54151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc5c539700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc54064e60 con 0x7efc54064590 2021-11-12T05:43:02.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc5c539700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc540670f0 con 0x7efc540ad1b0 2021-11-12T05:43:02.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc5c539700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc54063cc0 con 0x7efc5414eae0 2021-11-12T05:43:02.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc5a2d5700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efc54064590 0x7efc54064970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:02.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc5a2d5700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efc54064590 0x7efc54064970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45350/0 (socket says 172.21.2.105:45350) 2021-11-12T05:43:02.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.271+0000 7efc5a2d5700 1 -- 172.21.2.105:0/2454618237 learned_addr learned my addr 172.21.2.105:0/2454618237 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:43:02.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.275+0000 7efc5a2d5700 1 -- 172.21.2.105:0/2454618237 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efc5414eae0 msgr2=0x7efc54151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:02.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.275+0000 7efc5a2d5700 1 --2- 172.21.2.105:0/2454618237 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efc5414eae0 0x7efc54151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:02.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.275+0000 7efc5a2d5700 1 -- 172.21.2.105:0/2454618237 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efc540ad1b0 msgr2=0x7efc5414e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:02.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.275+0000 7efc5a2d5700 1 --2- 172.21.2.105:0/2454618237 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efc540ad1b0 0x7efc5414e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:02.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.275+0000 7efc5a2d5700 1 -- 172.21.2.105:0/2454618237 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc54063f60 con 0x7efc54064590 2021-11-12T05:43:02.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.275+0000 7efc5a2d5700 1 --2- 172.21.2.105:0/2454618237 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efc54064590 0x7efc54064970 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7efc50002f70 tx=0x7efc50019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:02.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.275+0000 7efc437fe700 1 -- 172.21.2.105:0/2454618237 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc50012770 con 0x7efc54064590 2021-11-12T05:43:02.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.275+0000 7efc437fe700 1 -- 172.21.2.105:0/2454618237 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc50000e90 con 0x7efc54064590 2021-11-12T05:43:02.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.275+0000 7efc437fe700 1 -- 172.21.2.105:0/2454618237 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc5001c670 con 0x7efc54064590 2021-11-12T05:43:02.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.275+0000 7efc5c539700 1 -- 172.21.2.105:0/2454618237 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc540acbd0 con 0x7efc54064590 2021-11-12T05:43:02.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.275+0000 7efc5c539700 1 -- 172.21.2.105:0/2454618237 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc5414ef60 con 0x7efc54064590 2021-11-12T05:43:02.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.275+0000 7efc5c539700 1 -- 172.21.2.105:0/2454618237 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc54066f60 con 0x7efc54064590 2021-11-12T05:43:02.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.275+0000 7efc437fe700 1 -- 172.21.2.105:0/2454618237 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efc5001c7d0 con 0x7efc54064590 2021-11-12T05:43:02.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.275+0000 7efc437fe700 1 --2- 172.21.2.105:0/2454618237 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efc340535b0 0x7efc34055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.275+0000 7efc437fe700 1 -- 172.21.2.105:0/2454618237 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6416+0+0 (secure 0 0 0) 0x7efc500714f0 con 0x7efc54064590 2021-11-12T05:43:02.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.275+0000 7efc59ad4700 1 --2- 172.21.2.105:0/2454618237 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efc340535b0 0x7efc34055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:02.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.275+0000 7efc59ad4700 1 --2- 172.21.2.105:0/2454618237 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efc340535b0 0x7efc34055a70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7efc54063330 tx=0x7efc540aedf0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:02.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.275+0000 7efc437fe700 1 -- 172.21.2.105:0/2454618237 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efc500483f0 con 0x7efc54064590 2021-11-12T05:43:02.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.363+0000 7efc5c539700 1 -- 172.21.2.105:0/2454618237 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7efc54144210 con 0x7efc54064590 2021-11-12T05:43:02.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.363+0000 7efc437fe700 1 -- 172.21.2.105:0/2454618237 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v45) v1 ==== 110+0+10 (secure 0 0 0) 0x7efc5004ba10 con 0x7efc54064590 2021-11-12T05:43:02.367 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:43:02.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.363+0000 7efc5c539700 1 -- 172.21.2.105:0/2454618237 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efc340535b0 msgr2=0x7efc34055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:02.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.363+0000 7efc5c539700 1 --2- 172.21.2.105:0/2454618237 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efc340535b0 0x7efc34055a70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7efc54063330 tx=0x7efc540aedf0).stop 2021-11-12T05:43:02.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.363+0000 7efc5c539700 1 -- 172.21.2.105:0/2454618237 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efc54064590 msgr2=0x7efc54064970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:02.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.363+0000 7efc5c539700 1 --2- 172.21.2.105:0/2454618237 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efc54064590 0x7efc54064970 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7efc50002f70 tx=0x7efc50019000).stop 2021-11-12T05:43:02.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.363+0000 7efc5c539700 1 -- 172.21.2.105:0/2454618237 shutdown_connections 2021-11-12T05:43:02.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.363+0000 7efc5c539700 1 --2- 172.21.2.105:0/2454618237 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efc340535b0 0x7efc34055a70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:02.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.363+0000 7efc5c539700 1 --2- 172.21.2.105:0/2454618237 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efc5414eae0 0x7efc54151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:02.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.363+0000 7efc5c539700 1 --2- 172.21.2.105:0/2454618237 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efc540ad1b0 0x7efc5414e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:02.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.363+0000 7efc5c539700 1 --2- 172.21.2.105:0/2454618237 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efc54064590 0x7efc54064970 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:02.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.363+0000 7efc5c539700 1 -- 172.21.2.105:0/2454618237 >> 172.21.2.105:0/2454618237 conn(0x7efc5405c490 msgr2=0x7efc540afca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:43:02.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.363+0000 7efc5c539700 1 -- 172.21.2.105:0/2454618237 shutdown_connections 2021-11-12T05:43:02.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.363+0000 7efc5c539700 1 -- 172.21.2.105:0/2454618237 wait complete. 2021-11-12T05:43:02.374 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:43:02.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff66760a700 1 Processor -- start 2021-11-12T05:43:02.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff66760a700 1 -- start start 2021-11-12T05:43:02.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff66760a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff6600aca40 0x7ff6600ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff66760a700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7ff660144180 0x7ff660144610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff66760a700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6600b1840 con 0x7ff6600b0520 2021-11-12T05:43:02.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff66760a700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6600af2b0 con 0x7ff660144180 2021-11-12T05:43:02.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff66760a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6600b09a0 con 0x7ff6600aca40 2021-11-12T05:43:02.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff664ba5700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7ff6600b0520 0x7ff6601473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:55758/0 (socket says 172.21.2.105:55758) 2021-11-12T05:43:02.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff664ba5700 1 -- 172.21.2.105:0/1163154151 learned_addr learned my addr 172.21.2.105:0/1163154151 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:43:02.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff653fff700 1 -- 172.21.2.105:0/1163154151 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1474474122 0 0) 0x7ff6600b1840 con 0x7ff6600b0520 2021-11-12T05:43:02.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff653fff700 1 -- 172.21.2.105:0/1163154151 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff648003260 con 0x7ff6600b0520 2021-11-12T05:43:02.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff653fff700 1 -- 172.21.2.105:0/1163154151 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3666171999 0 0) 0x7ff648003260 con 0x7ff6600b0520 2021-11-12T05:43:02.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff653fff700 1 -- 172.21.2.105:0/1163154151 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff6600aca40 msgr2=0x7ff6600ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:43:02.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff653fff700 1 --2- 172.21.2.105:0/1163154151 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff6600aca40 0x7ff6600ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:02.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff653fff700 1 -- 172.21.2.105:0/1163154151 >> v2:172.21.2.115:3300/0 conn(0x7ff660144180 msgr2=0x7ff660144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:43:02.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff653fff700 1 --2- 172.21.2.105:0/1163154151 >> v2:172.21.2.115:3300/0 conn(0x7ff660144180 0x7ff660144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:02.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff653fff700 1 -- 172.21.2.105:0/1163154151 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6600b1a70 con 0x7ff6600b0520 2021-11-12T05:43:02.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff653fff700 1 -- 172.21.2.105:0/1163154151 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7ff654001660 con 0x7ff6600b0520 2021-11-12T05:43:02.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff653fff700 1 -- 172.21.2.105:0/1163154151 >> v1:172.21.2.105:6789/0 conn(0x7ff6600b0520 legacy=0x7ff6601473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:02.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff653fff700 1 --2- 172.21.2.105:0/1163154151 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff6480037d0 0x7ff648003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff653fff700 1 --2- 172.21.2.105:0/1163154151 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff6600aca40 0x7ff648004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff653fff700 1 --2- 172.21.2.105:0/1163154151 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff648004bf0 0x7ff64800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff653fff700 1 -- 172.21.2.105:0/1163154151 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6600af2b0 con 0x7ff6480037d0 2021-11-12T05:43:02.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff653fff700 1 -- 172.21.2.105:0/1163154151 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6600b09a0 con 0x7ff648004bf0 2021-11-12T05:43:02.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff653fff700 1 -- 172.21.2.105:0/1163154151 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff648005300 con 0x7ff6600aca40 2021-11-12T05:43:02.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff6653a6700 1 --2- 172.21.2.105:0/1163154151 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff6480037d0 0x7ff648003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:02.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff6653a6700 1 -- 172.21.2.105:0/1163154151 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff6600aca40 msgr2=0x7ff648004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:43:02.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff6653a6700 1 --2- 172.21.2.105:0/1163154151 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff6600aca40 0x7ff648004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:02.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff6653a6700 1 -- 172.21.2.105:0/1163154151 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff648004bf0 msgr2=0x7ff64800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:43:02.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff6653a6700 1 --2- 172.21.2.105:0/1163154151 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff648004bf0 0x7ff64800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:02.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff6653a6700 1 -- 172.21.2.105:0/1163154151 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff648003260 con 0x7ff6480037d0 2021-11-12T05:43:02.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff6653a6700 1 --2- 172.21.2.105:0/1163154151 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff6480037d0 0x7ff648003bf0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7ff65c002f70 tx=0x7ff65c006ca0).ready entity=mon.0 client_cookie=6d05b73ef06ded49 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:02.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff653fff700 1 -- 172.21.2.105:0/1163154151 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff65c012410 con 0x7ff6480037d0 2021-11-12T05:43:02.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff653fff700 1 -- 172.21.2.105:0/1163154151 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65c012570 con 0x7ff6480037d0 2021-11-12T05:43:02.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff653fff700 1 -- 172.21.2.105:0/1163154151 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff65c0128d0 con 0x7ff6480037d0 2021-11-12T05:43:02.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff66760a700 1 -- 172.21.2.105:0/1163154151 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff6480037d0 msgr2=0x7ff648003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:02.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff66760a700 1 --2- 172.21.2.105:0/1163154151 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff6480037d0 0x7ff648003bf0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7ff65c002f70 tx=0x7ff65c006ca0).stop 2021-11-12T05:43:02.443 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff665ba7700 1 -- 172.21.2.105:0/1163154151 reap_dead start 2021-11-12T05:43:02.443 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff66760a700 1 -- 172.21.2.105:0/1163154151 shutdown_connections 2021-11-12T05:43:02.443 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff66760a700 1 -- 172.21.2.105:0/1163154151 >> 172.21.2.105:0/1163154151 conn(0x7ff66005c490 msgr2=0x7ff6600b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:43:02.443 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff66760a700 1 -- 172.21.2.105:0/1163154151 shutdown_connections 2021-11-12T05:43:02.444 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.423+0000 7ff66760a700 1 -- 172.21.2.105:0/1163154151 wait complete. 2021-11-12T05:43:02.444 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.427+0000 7ff66760a700 1 Processor -- start 2021-11-12T05:43:02.444 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.427+0000 7ff66760a700 1 -- start start 2021-11-12T05:43:02.444 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.427+0000 7ff66760a700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff6480037d0 0x7ff6601479a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.445 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.427+0000 7ff66760a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff660064350 0x7ff6601570a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.445 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.427+0000 7ff66760a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff660157590 0x7ff660159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.445 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.427+0000 7ff66760a700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6601569d0 con 0x7ff660157590 2021-11-12T05:43:02.445 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.427+0000 7ff66760a700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff660064890 con 0x7ff6480037d0 2021-11-12T05:43:02.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.427+0000 7ff66760a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6600a7220 con 0x7ff660064350 2021-11-12T05:43:02.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.427+0000 7ff665ba7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff660157590 0x7ff660159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:02.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.427+0000 7ff665ba7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff660157590 0x7ff660159e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45374/0 (socket says 172.21.2.105:45374) 2021-11-12T05:43:02.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.427+0000 7ff665ba7700 1 -- 172.21.2.105:0/586778454 learned_addr learned my addr 172.21.2.105:0/586778454 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:43:02.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.427+0000 7ff665ba7700 1 -- 172.21.2.105:0/586778454 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff660064350 msgr2=0x7ff6601570a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:02.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.427+0000 7ff664ba5700 1 --2- 172.21.2.105:0/586778454 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff660064350 0x7ff6601570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:02.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.427+0000 7ff6653a6700 1 --2- 172.21.2.105:0/586778454 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff6480037d0 0x7ff6601479a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:02.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.427+0000 7ff665ba7700 1 --2- 172.21.2.105:0/586778454 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff660064350 0x7ff6601570a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:02.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.427+0000 7ff665ba7700 1 -- 172.21.2.105:0/586778454 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff6480037d0 msgr2=0x7ff6601479a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:02.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.427+0000 7ff665ba7700 1 --2- 172.21.2.105:0/586778454 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff6480037d0 0x7ff6601479a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:02.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.427+0000 7ff665ba7700 1 -- 172.21.2.105:0/586778454 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff660156c00 con 0x7ff660157590 2021-11-12T05:43:02.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.427+0000 7ff665ba7700 1 --2- 172.21.2.105:0/586778454 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff660157590 0x7ff660159e90 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7ff654001840 tx=0x7ff65800a060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:02.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.427+0000 7ff6527fc700 1 -- 172.21.2.105:0/586778454 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff65800ce40 con 0x7ff660157590 2021-11-12T05:43:02.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.427+0000 7ff6527fc700 1 -- 172.21.2.105:0/586778454 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff658005c30 con 0x7ff660157590 2021-11-12T05:43:02.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.427+0000 7ff6527fc700 1 -- 172.21.2.105:0/586778454 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff658007070 con 0x7ff660157590 2021-11-12T05:43:02.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.427+0000 7ff66760a700 1 -- 172.21.2.105:0/586778454 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6600a74c0 con 0x7ff660157590 2021-11-12T05:43:02.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.427+0000 7ff66760a700 1 -- 172.21.2.105:0/586778454 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff66015a380 con 0x7ff660157590 2021-11-12T05:43:02.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.427+0000 7ff66760a700 1 -- 172.21.2.105:0/586778454 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff660064170 con 0x7ff660157590 2021-11-12T05:43:02.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.427+0000 7ff6527fc700 1 -- 172.21.2.105:0/586778454 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff658010030 con 0x7ff660157590 2021-11-12T05:43:02.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.427+0000 7ff6527fc700 1 --2- 172.21.2.105:0/586778454 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff640053610 0x7ff640055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.427+0000 7ff6527fc700 1 -- 172.21.2.105:0/586778454 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6416+0+0 (secure 0 0 0) 0x7ff65806b0f0 con 0x7ff660157590 2021-11-12T05:43:02.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.427+0000 7ff6653a6700 1 --2- 172.21.2.105:0/586778454 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff640053610 0x7ff640055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:02.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.427+0000 7ff6653a6700 1 --2- 172.21.2.105:0/586778454 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff640053610 0x7ff640055ad0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7ff65c014000 tx=0x7ff65c015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:02.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.431+0000 7ff6527fc700 1 -- 172.21.2.105:0/586778454 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff658041ff0 con 0x7ff660157590 2021-11-12T05:43:02.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.515+0000 7ff66760a700 1 -- 172.21.2.105:0/586778454 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff660057350 con 0x7ff660157590 2021-11-12T05:43:02.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.515+0000 7ff6527fc700 1 -- 172.21.2.105:0/586778454 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v45) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff658045610 con 0x7ff660157590 2021-11-12T05:43:02.520 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:43:02.521 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.515+0000 7ff66760a700 1 -- 172.21.2.105:0/586778454 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff640053610 msgr2=0x7ff640055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:02.521 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.515+0000 7ff66760a700 1 --2- 172.21.2.105:0/586778454 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff640053610 0x7ff640055ad0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7ff65c014000 tx=0x7ff65c015000).stop 2021-11-12T05:43:02.521 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.515+0000 7ff66760a700 1 -- 172.21.2.105:0/586778454 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff660157590 msgr2=0x7ff660159e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:02.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.515+0000 7ff66760a700 1 --2- 172.21.2.105:0/586778454 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff660157590 0x7ff660159e90 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7ff654001840 tx=0x7ff65800a060).stop 2021-11-12T05:43:02.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.515+0000 7ff66760a700 1 -- 172.21.2.105:0/586778454 shutdown_connections 2021-11-12T05:43:02.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.515+0000 7ff66760a700 1 --2- 172.21.2.105:0/586778454 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff640053610 0x7ff640055ad0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:02.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.515+0000 7ff66760a700 1 --2- 172.21.2.105:0/586778454 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff660157590 0x7ff660159e90 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:02.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.515+0000 7ff66760a700 1 --2- 172.21.2.105:0/586778454 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff660064350 0x7ff6601570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:02.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.515+0000 7ff66760a700 1 --2- 172.21.2.105:0/586778454 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff6480037d0 0x7ff6601479a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:02.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.515+0000 7ff66760a700 1 -- 172.21.2.105:0/586778454 >> 172.21.2.105:0/586778454 conn(0x7ff66005c490 msgr2=0x7ff660142c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:43:02.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.515+0000 7ff66760a700 1 -- 172.21.2.105:0/586778454 shutdown_connections 2021-11-12T05:43:02.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.515+0000 7ff66760a700 1 -- 172.21.2.105:0/586778454 wait complete. 2021-11-12T05:43:02.526 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-12T05:43:02.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.575+0000 7fb8cfc3e700 1 Processor -- start 2021-11-12T05:43:02.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.575+0000 7fb8cfc3e700 1 -- start start 2021-11-12T05:43:02.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.575+0000 7fb8cfc3e700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb8c80b1cd0 0x7fb8c80ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.575+0000 7fb8cfc3e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb8c80b0e60 0x7fb8c80abb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.575+0000 7fb8cfc3e700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c80b20b0 con 0x7fb8c80aa700 2021-11-12T05:43:02.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.575+0000 7fb8cfc3e700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8c80b2870 con 0x7fb8c80b1cd0 2021-11-12T05:43:02.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.575+0000 7fb8cfc3e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c80b13e0 con 0x7fb8c80b0e60 2021-11-12T05:43:02.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.575+0000 7fb8ce1db700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fb8c80aa700 0x7fb8c80ac050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:55774/0 (socket says 172.21.2.105:55774) 2021-11-12T05:43:02.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.575+0000 7fb8ce1db700 1 -- 172.21.2.105:0/2205679321 learned_addr learned my addr 172.21.2.105:0/2205679321 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:43:02.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.575+0000 7fb8cd9da700 1 --2- 172.21.2.105:0/2205679321 >> v2:172.21.2.105:3300/0 conn(0x7fb8c80b1cd0 0x7fb8c80ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:02.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.575+0000 7fb8cd9da700 1 -- 172.21.2.105:0/2205679321 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb8c80b0e60 msgr2=0x7fb8c80abb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:43:02.586 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.575+0000 7fb8cd9da700 1 --2- 172.21.2.105:0/2205679321 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb8c80b0e60 0x7fb8c80abb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:02.586 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.575+0000 7fb8cd9da700 1 -- 172.21.2.105:0/2205679321 >> v1:172.21.2.105:6789/0 conn(0x7fb8c80aa700 legacy=0x7fb8c80ac050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:02.586 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.575+0000 7fb8cd9da700 1 -- 172.21.2.105:0/2205679321 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c80ace10 con 0x7fb8c80b1cd0 2021-11-12T05:43:02.586 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.575+0000 7fb8cd9da700 1 --2- 172.21.2.105:0/2205679321 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb8c80b1cd0 0x7fb8c80ad2b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7fb8c4002f70 tx=0x7fb8c4006df0).ready entity=mon.0 client_cookie=9610e5fe0695dae5 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:02.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.575+0000 7fb8cc9d8700 1 -- 172.21.2.105:0/2205679321 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8c400d570 con 0x7fb8c80b1cd0 2021-11-12T05:43:02.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.575+0000 7fb8cc9d8700 1 -- 172.21.2.105:0/2205679321 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c4000e90 con 0x7fb8c80b1cd0 2021-11-12T05:43:02.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.575+0000 7fb8cc9d8700 1 -- 172.21.2.105:0/2205679321 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8c400d8c0 con 0x7fb8c80b1cd0 2021-11-12T05:43:02.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.575+0000 7fb8cfc3e700 1 -- 172.21.2.105:0/2205679321 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb8c80b1cd0 msgr2=0x7fb8c80ad2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:02.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.575+0000 7fb8cfc3e700 1 --2- 172.21.2.105:0/2205679321 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb8c80b1cd0 0x7fb8c80ad2b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7fb8c4002f70 tx=0x7fb8c4006df0).stop 2021-11-12T05:43:02.588 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.575+0000 7fb8cfc3e700 1 -- 172.21.2.105:0/2205679321 shutdown_connections 2021-11-12T05:43:02.588 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.575+0000 7fb8cfc3e700 1 --2- 172.21.2.105:0/2205679321 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb8c80b0e60 0x7fb8c80abb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:02.588 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.575+0000 7fb8cfc3e700 1 --2- 172.21.2.105:0/2205679321 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb8c80b1cd0 0x7fb8c80ad2b0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:02.588 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.575+0000 7fb8cfc3e700 1 -- 172.21.2.105:0/2205679321 >> 172.21.2.105:0/2205679321 conn(0x7fb8c8063610 msgr2=0x7fb8c80639f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:43:02.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.575+0000 7fb8cfc3e700 1 -- 172.21.2.105:0/2205679321 shutdown_connections 2021-11-12T05:43:02.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.575+0000 7fb8cfc3e700 1 -- 172.21.2.105:0/2205679321 wait complete. 2021-11-12T05:43:02.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.575+0000 7fb8cfc3e700 1 Processor -- start 2021-11-12T05:43:02.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.575+0000 7fb8cfc3e700 1 -- start start 2021-11-12T05:43:02.590 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.579+0000 7fb8cfc3e700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb8c80aa700 0x7fb8c809eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.590 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.579+0000 7fb8cfc3e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb8c80b0e60 0x7fb8c814f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.590 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.579+0000 7fb8cfc3e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb8c80b1cd0 0x7fb8c814fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.590 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.579+0000 7fb8cfc3e700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c80a4380 con 0x7fb8c80b0e60 2021-11-12T05:43:02.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.579+0000 7fb8cfc3e700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c80a1970 con 0x7fb8c80aa700 2021-11-12T05:43:02.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.579+0000 7fb8cfc3e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c80a2510 con 0x7fb8c80b1cd0 2021-11-12T05:43:02.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.579+0000 7fb8cd1d9700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb8c80b0e60 0x7fb8c814f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:02.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.579+0000 7fb8cd1d9700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb8c80b0e60 0x7fb8c814f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45388/0 (socket says 172.21.2.105:45388) 2021-11-12T05:43:02.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.579+0000 7fb8cd1d9700 1 -- 172.21.2.105:0/960083882 learned_addr learned my addr 172.21.2.105:0/960083882 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:43:02.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.579+0000 7fb8cd1d9700 1 -- 172.21.2.105:0/960083882 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb8c80b1cd0 msgr2=0x7fb8c814fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:02.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.579+0000 7fb8cd1d9700 1 --2- 172.21.2.105:0/960083882 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb8c80b1cd0 0x7fb8c814fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:02.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.579+0000 7fb8cd1d9700 1 -- 172.21.2.105:0/960083882 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb8c80aa700 msgr2=0x7fb8c809eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:02.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.579+0000 7fb8cd1d9700 1 --2- 172.21.2.105:0/960083882 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb8c80aa700 0x7fb8c809eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:02.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.579+0000 7fb8cd1d9700 1 -- 172.21.2.105:0/960083882 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c400b180 con 0x7fb8c80b0e60 2021-11-12T05:43:02.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.579+0000 7fb8cd1d9700 1 --2- 172.21.2.105:0/960083882 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb8c80b0e60 0x7fb8c814f970 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7fb8bc002f70 tx=0x7fb8bc006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:02.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.579+0000 7fb8baffd700 1 -- 172.21.2.105:0/960083882 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8bc013460 con 0x7fb8c80b0e60 2021-11-12T05:43:02.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.579+0000 7fb8baffd700 1 -- 172.21.2.105:0/960083882 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8bc0135c0 con 0x7fb8c80b0e60 2021-11-12T05:43:02.594 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.579+0000 7fb8baffd700 1 -- 172.21.2.105:0/960083882 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8bc013920 con 0x7fb8c80b0e60 2021-11-12T05:43:02.594 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.579+0000 7fb8cfc3e700 1 -- 172.21.2.105:0/960083882 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c80a27b0 con 0x7fb8c80b0e60 2021-11-12T05:43:02.594 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.579+0000 7fb8cfc3e700 1 -- 172.21.2.105:0/960083882 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c8150350 con 0x7fb8c80b0e60 2021-11-12T05:43:02.594 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.579+0000 7fb8cfc3e700 1 -- 172.21.2.105:0/960083882 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8c80a17b0 con 0x7fb8c80b0e60 2021-11-12T05:43:02.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.579+0000 7fb8baffd700 1 -- 172.21.2.105:0/960083882 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb8bc01a060 con 0x7fb8c80b0e60 2021-11-12T05:43:02.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.579+0000 7fb8baffd700 1 --2- 172.21.2.105:0/960083882 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb8a8053660 0x7fb8a8055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.579+0000 7fb8baffd700 1 -- 172.21.2.105:0/960083882 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fb8bc06b600 con 0x7fb8c80b0e60 2021-11-12T05:43:02.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.579+0000 7fb8cd9da700 1 --2- 172.21.2.105:0/960083882 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb8a8053660 0x7fb8a8055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:02.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.579+0000 7fb8cd9da700 1 --2- 172.21.2.105:0/960083882 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb8a8053660 0x7fb8a8055b20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fb8c4002f70 tx=0x7fb8c4015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:02.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.583+0000 7fb8baffd700 1 -- 172.21.2.105:0/960083882 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb8bc042500 con 0x7fb8c80b0e60 2021-11-12T05:43:02.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.663+0000 7fb8cfc3e700 1 -- 172.21.2.105:0/960083882 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb8c80a4e30 con 0x7fb8c80b0e60 2021-11-12T05:43:02.671 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.667+0000 7fb8baffd700 1 -- 172.21.2.105:0/960083882 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v45) v1 ==== 104+0+10 (secure 0 0 0) 0x7fb8bc018070 con 0x7fb8c80b0e60 2021-11-12T05:43:02.671 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:43:02.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.667+0000 7fb8cfc3e700 1 -- 172.21.2.105:0/960083882 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb8a8053660 msgr2=0x7fb8a8055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:02.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.667+0000 7fb8cfc3e700 1 --2- 172.21.2.105:0/960083882 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb8a8053660 0x7fb8a8055b20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fb8c4002f70 tx=0x7fb8c4015000).stop 2021-11-12T05:43:02.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.667+0000 7fb8cfc3e700 1 -- 172.21.2.105:0/960083882 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb8c80b0e60 msgr2=0x7fb8c814f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:02.673 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.667+0000 7fb8cfc3e700 1 --2- 172.21.2.105:0/960083882 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb8c80b0e60 0x7fb8c814f970 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7fb8bc002f70 tx=0x7fb8bc006ec0).stop 2021-11-12T05:43:02.673 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.667+0000 7fb8cfc3e700 1 -- 172.21.2.105:0/960083882 shutdown_connections 2021-11-12T05:43:02.673 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.667+0000 7fb8cfc3e700 1 --2- 172.21.2.105:0/960083882 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb8a8053660 0x7fb8a8055b20 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:02.674 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.667+0000 7fb8cfc3e700 1 --2- 172.21.2.105:0/960083882 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb8c80b1cd0 0x7fb8c814fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:02.674 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.667+0000 7fb8cfc3e700 1 --2- 172.21.2.105:0/960083882 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb8c80b0e60 0x7fb8c814f970 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:02.674 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.667+0000 7fb8cfc3e700 1 --2- 172.21.2.105:0/960083882 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb8c80aa700 0x7fb8c809eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:02.674 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.667+0000 7fb8cfc3e700 1 -- 172.21.2.105:0/960083882 >> 172.21.2.105:0/960083882 conn(0x7fb8c8063610 msgr2=0x7fb8c80afb10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:43:02.674 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.667+0000 7fb8cfc3e700 1 -- 172.21.2.105:0/960083882 shutdown_connections 2021-11-12T05:43:02.675 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.667+0000 7fb8cfc3e700 1 -- 172.21.2.105:0/960083882 wait complete. 2021-11-12T05:43:02.678 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-12T05:43:02.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa73cf700 1 Processor -- start 2021-11-12T05:43:02.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa73cf700 1 -- start start 2021-11-12T05:43:02.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa73cf700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f6fa0060100 0x7f6fa0144310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa73cf700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f6fa00ae2a0 0x7f6fa0144800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa73cf700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa00b2aa0 con 0x7f6fa00b1cf0 2021-11-12T05:43:02.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa73cf700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fa00b3170 con 0x7f6fa00ae2a0 2021-11-12T05:43:02.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa73cf700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fa00604e0 con 0x7f6fa0060100 2021-11-12T05:43:02.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa6bce700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f6fa00b1cf0 0x7f6fa0149930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:55790/0 (socket says 172.21.2.105:55790) 2021-11-12T05:43:02.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa6bce700 1 -- 172.21.2.105:0/4291747040 learned_addr learned my addr 172.21.2.105:0/4291747040 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:43:02.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa5bcc700 1 --2- 172.21.2.105:0/4291747040 >> v2:172.21.2.105:3300/0 conn(0x7f6fa00ae2a0 0x7f6fa0144800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:02.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa5bcc700 1 -- 172.21.2.105:0/4291747040 >> v2:172.21.2.115:3300/0 conn(0x7f6fa0060100 msgr2=0x7f6fa0144310 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:43:02.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa5bcc700 1 --2- 172.21.2.105:0/4291747040 >> v2:172.21.2.115:3300/0 conn(0x7f6fa0060100 0x7f6fa0144310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:02.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa5bcc700 1 -- 172.21.2.105:0/4291747040 >> v1:172.21.2.105:6789/0 conn(0x7f6fa00b1cf0 legacy=0x7f6fa0149930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:02.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa5bcc700 1 -- 172.21.2.105:0/4291747040 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa0066230 con 0x7f6fa00ae2a0 2021-11-12T05:43:02.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa5bcc700 1 --2- 172.21.2.105:0/4291747040 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6fa00ae2a0 0x7f6fa0144800 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f6f9c002f70 tx=0x7f6f9c006df0).ready entity=mon.0 client_cookie=43ebc2dc46de33dc server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:02.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa53cb700 1 -- 172.21.2.105:0/4291747040 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f9c00d5c0 con 0x7f6fa00ae2a0 2021-11-12T05:43:02.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa53cb700 1 -- 172.21.2.105:0/4291747040 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9c000e90 con 0x7f6fa00ae2a0 2021-11-12T05:43:02.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa53cb700 1 -- 172.21.2.105:0/4291747040 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f9c00d950 con 0x7f6fa00ae2a0 2021-11-12T05:43:02.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa73cf700 1 -- 172.21.2.105:0/4291747040 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6fa00ae2a0 msgr2=0x7f6fa0144800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:02.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa73cf700 1 --2- 172.21.2.105:0/4291747040 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6fa00ae2a0 0x7f6fa0144800 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f6f9c002f70 tx=0x7f6f9c006df0).stop 2021-11-12T05:43:02.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa73cf700 1 -- 172.21.2.105:0/4291747040 shutdown_connections 2021-11-12T05:43:02.738 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa73cf700 1 --2- 172.21.2.105:0/4291747040 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6fa00ae2a0 0x7f6fa0144800 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:02.738 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa73cf700 1 --2- 172.21.2.105:0/4291747040 >> v2:172.21.2.115:3300/0 conn(0x7f6fa0060100 0x7f6fa0144310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:02.738 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa73cf700 1 -- 172.21.2.105:0/4291747040 >> 172.21.2.105:0/4291747040 conn(0x7f6fa00608d0 msgr2=0x7f6fa005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:43:02.738 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa73cf700 1 -- 172.21.2.105:0/4291747040 shutdown_connections 2021-11-12T05:43:02.739 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa73cf700 1 -- 172.21.2.105:0/4291747040 wait complete. 2021-11-12T05:43:02.739 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa73cf700 1 Processor -- start 2021-11-12T05:43:02.739 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa73cf700 1 -- start start 2021-11-12T05:43:02.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa73cf700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6fa0060100 0x7f6fa014d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa73cf700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6fa00ae2a0 0x7f6fa014d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa73cf700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6fa00b1cf0 0x7f6fa0114210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa73cf700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa00b1110 con 0x7f6fa00ae2a0 2021-11-12T05:43:02.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa73cf700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa01542e0 con 0x7f6fa00b1cf0 2021-11-12T05:43:02.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa73cf700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa0154510 con 0x7f6fa0060100 2021-11-12T05:43:02.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa5bcc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6fa00ae2a0 0x7f6fa014d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:02.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa5bcc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6fa00ae2a0 0x7f6fa014d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45398/0 (socket says 172.21.2.105:45398) 2021-11-12T05:43:02.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa5bcc700 1 -- 172.21.2.105:0/670476395 learned_addr learned my addr 172.21.2.105:0/670476395 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:43:02.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa5bcc700 1 -- 172.21.2.105:0/670476395 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6fa0060100 msgr2=0x7f6fa014d450 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:43:02.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa5bcc700 1 --2- 172.21.2.105:0/670476395 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6fa0060100 0x7f6fa014d450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:02.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa5bcc700 1 -- 172.21.2.105:0/670476395 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6fa00b1cf0 msgr2=0x7f6fa0114210 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:43:02.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa5bcc700 1 --2- 172.21.2.105:0/670476395 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6fa00b1cf0 0x7f6fa0114210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:02.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa5bcc700 1 -- 172.21.2.105:0/670476395 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f9c00b180 con 0x7f6fa00ae2a0 2021-11-12T05:43:02.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa5bcc700 1 --2- 172.21.2.105:0/670476395 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6fa00ae2a0 0x7f6fa014d940 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f6f9c002f70 tx=0x7f6f9c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:02.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6f937fe700 1 -- 172.21.2.105:0/670476395 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f9c013cf0 con 0x7f6fa00ae2a0 2021-11-12T05:43:02.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6f937fe700 1 -- 172.21.2.105:0/670476395 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9c022070 con 0x7f6fa00ae2a0 2021-11-12T05:43:02.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6fa73cf700 1 -- 172.21.2.105:0/670476395 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa01547b0 con 0x7f6fa00ae2a0 2021-11-12T05:43:02.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.727+0000 7f6f937fe700 1 -- 172.21.2.105:0/670476395 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f9c01e7f0 con 0x7f6fa00ae2a0 2021-11-12T05:43:02.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.731+0000 7f6fa73cf700 1 -- 172.21.2.105:0/670476395 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa0110db0 con 0x7f6fa00ae2a0 2021-11-12T05:43:02.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.731+0000 7f6fa73cf700 1 -- 172.21.2.105:0/670476395 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa00664d0 con 0x7f6fa00ae2a0 2021-11-12T05:43:02.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.731+0000 7f6f937fe700 1 -- 172.21.2.105:0/670476395 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6f9c02e070 con 0x7f6fa00ae2a0 2021-11-12T05:43:02.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.731+0000 7f6f937fe700 1 --2- 172.21.2.105:0/670476395 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6f800536a0 0x7f6f80055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.731+0000 7f6f937fe700 1 -- 172.21.2.105:0/670476395 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f6f9c070bc0 con 0x7f6fa00ae2a0 2021-11-12T05:43:02.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.731+0000 7f6fa63cd700 1 --2- 172.21.2.105:0/670476395 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6f800536a0 0x7f6f80055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:02.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.731+0000 7f6fa63cd700 1 --2- 172.21.2.105:0/670476395 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6f800536a0 0x7f6f80055b60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f6f94002ef0 tx=0x7f6f94006890).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:02.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.731+0000 7f6f937fe700 1 -- 172.21.2.105:0/670476395 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6f9c047bd0 con 0x7f6fa00ae2a0 2021-11-12T05:43:02.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.815+0000 7f6fa73cf700 1 -- 172.21.2.105:0/670476395 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6fa0057350 con 0x7f6fa00ae2a0 2021-11-12T05:43:02.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.815+0000 7f6f937fe700 1 -- 172.21.2.105:0/670476395 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v45) v1 ==== 100+0+10 (secure 0 0 0) 0x7f6f9c04b1f0 con 0x7f6fa00ae2a0 2021-11-12T05:43:02.820 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:43:02.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.815+0000 7f6fa73cf700 1 -- 172.21.2.105:0/670476395 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6f800536a0 msgr2=0x7f6f80055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:02.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.815+0000 7f6fa73cf700 1 --2- 172.21.2.105:0/670476395 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6f800536a0 0x7f6f80055b60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f6f94002ef0 tx=0x7f6f94006890).stop 2021-11-12T05:43:02.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.815+0000 7f6fa73cf700 1 -- 172.21.2.105:0/670476395 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6fa00ae2a0 msgr2=0x7f6fa014d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:02.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.815+0000 7f6fa73cf700 1 --2- 172.21.2.105:0/670476395 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6fa00ae2a0 0x7f6fa014d940 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f6f9c002f70 tx=0x7f6f9c014000).stop 2021-11-12T05:43:02.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.815+0000 7f6fa73cf700 1 -- 172.21.2.105:0/670476395 shutdown_connections 2021-11-12T05:43:02.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.815+0000 7f6fa73cf700 1 --2- 172.21.2.105:0/670476395 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6f800536a0 0x7f6f80055b60 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:02.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.815+0000 7f6fa73cf700 1 --2- 172.21.2.105:0/670476395 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6fa00b1cf0 0x7f6fa0114210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:02.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.815+0000 7f6fa73cf700 1 --2- 172.21.2.105:0/670476395 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6fa00ae2a0 0x7f6fa014d940 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:02.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.815+0000 7f6fa73cf700 1 --2- 172.21.2.105:0/670476395 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6fa0060100 0x7f6fa014d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:02.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.815+0000 7f6fa73cf700 1 -- 172.21.2.105:0/670476395 >> 172.21.2.105:0/670476395 conn(0x7f6fa00608d0 msgr2=0x7f6fa0144220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:43:02.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.815+0000 7f6fa73cf700 1 -- 172.21.2.105:0/670476395 shutdown_connections 2021-11-12T05:43:02.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.815+0000 7f6fa73cf700 1 -- 172.21.2.105:0/670476395 wait complete. 2021-11-12T05:43:02.827 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-12T05:43:02.828 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:43:02.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.883+0000 7f4e9d61c700 1 Processor -- start 2021-11-12T05:43:02.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.883+0000 7f4e9d61c700 1 -- start start 2021-11-12T05:43:02.893 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e9d61c700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f4e980ac280 0x7f4e9814b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.893 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e9d61c700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e980ac7b0 con 0x7f4e980af730 2021-11-12T05:43:02.894 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e9d61c700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e980ac9e0 con 0x7f4e980ad080 2021-11-12T05:43:02.894 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e9d61c700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e981488a0 con 0x7f4e980ac280 2021-11-12T05:43:02.894 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e977fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f4e980af730 0x7f4e98147a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:55806/0 (socket says 172.21.2.105:55806) 2021-11-12T05:43:02.894 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e977fe700 1 -- 172.21.2.105:0/2378370987 learned_addr learned my addr 172.21.2.105:0/2378370987 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:43:02.894 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e95ffb700 1 -- 172.21.2.105:0/2378370987 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2623273338 0 0) 0x7f4e980ac7b0 con 0x7f4e980af730 2021-11-12T05:43:02.895 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e95ffb700 1 -- 172.21.2.105:0/2378370987 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e78003260 con 0x7f4e980af730 2021-11-12T05:43:02.895 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e967fc700 1 --2- 172.21.2.105:0/2378370987 >> v2:172.21.2.115:3300/0 conn(0x7f4e980ac280 0x7f4e9814b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:02.895 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e95ffb700 1 -- 172.21.2.105:0/2378370987 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4238675330 0 0) 0x7f4e78003260 con 0x7f4e980af730 2021-11-12T05:43:02.895 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e95ffb700 1 -- 172.21.2.105:0/2378370987 >> v2:172.21.2.115:3300/0 conn(0x7f4e980ac280 msgr2=0x7f4e9814b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:43:02.896 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e95ffb700 1 --2- 172.21.2.105:0/2378370987 >> v2:172.21.2.115:3300/0 conn(0x7f4e980ac280 0x7f4e9814b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:02.896 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e95ffb700 1 -- 172.21.2.105:0/2378370987 >> v1:172.21.2.115:6789/0 conn(0x7f4e980ad080 legacy=0x7f4e9814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:02.896 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e95ffb700 1 -- 172.21.2.105:0/2378370987 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e980b0b30 con 0x7f4e980af730 2021-11-12T05:43:02.896 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e95ffb700 1 -- 172.21.2.105:0/2378370987 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f4e900019e0 con 0x7f4e980af730 2021-11-12T05:43:02.897 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e95ffb700 1 -- 172.21.2.105:0/2378370987 >> v1:172.21.2.105:6789/0 conn(0x7f4e980af730 legacy=0x7f4e98147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:02.897 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e95ffb700 1 --2- 172.21.2.105:0/2378370987 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4e780037a0 0x7f4e78003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.897 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e95ffb700 1 --2- 172.21.2.105:0/2378370987 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4e78004500 0x7f4e78004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.897 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e95ffb700 1 --2- 172.21.2.105:0/2378370987 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4e78004f90 0x7f4e7800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.898 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e95ffb700 1 -- 172.21.2.105:0/2378370987 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e981488a0 con 0x7f4e78004500 2021-11-12T05:43:02.898 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e95ffb700 1 -- 172.21.2.105:0/2378370987 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7800be00 con 0x7f4e780037a0 2021-11-12T05:43:02.898 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e95ffb700 1 -- 172.21.2.105:0/2378370987 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7800bfc0 con 0x7f4e78004f90 2021-11-12T05:43:02.898 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e967fc700 1 --2- 172.21.2.105:0/2378370987 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4e78004500 0x7f4e78004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:02.898 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e967fc700 1 -- 172.21.2.105:0/2378370987 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4e78004f90 msgr2=0x7f4e7800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:43:02.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e967fc700 1 --2- 172.21.2.105:0/2378370987 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4e78004f90 0x7f4e7800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:02.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e967fc700 1 -- 172.21.2.105:0/2378370987 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4e780037a0 msgr2=0x7f4e78003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:43:02.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e967fc700 1 --2- 172.21.2.105:0/2378370987 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4e780037a0 0x7f4e78003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:02.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e977fe700 1 -- 172.21.2.105:0/2378370987 reap_dead start 2021-11-12T05:43:02.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e967fc700 1 -- 172.21.2.105:0/2378370987 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e78003260 con 0x7f4e78004500 2021-11-12T05:43:02.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e967fc700 1 --2- 172.21.2.105:0/2378370987 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4e78004500 0x7f4e78004980 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f4e8800a000 tx=0x7f4e88008040).ready entity=mon.0 client_cookie=8478805174811f7c server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:02.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e95ffb700 1 -- 172.21.2.105:0/2378370987 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e88013670 con 0x7f4e78004500 2021-11-12T05:43:02.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e95ffb700 1 -- 172.21.2.105:0/2378370987 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e880137d0 con 0x7f4e78004500 2021-11-12T05:43:02.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e95ffb700 1 -- 172.21.2.105:0/2378370987 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e88013b30 con 0x7f4e78004500 2021-11-12T05:43:02.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e9d61c700 1 -- 172.21.2.105:0/2378370987 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4e78004500 msgr2=0x7f4e78004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:02.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e9d61c700 1 --2- 172.21.2.105:0/2378370987 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4e78004500 0x7f4e78004980 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f4e8800a000 tx=0x7f4e88008040).stop 2021-11-12T05:43:02.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e9d61c700 1 -- 172.21.2.105:0/2378370987 shutdown_connections 2021-11-12T05:43:02.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e9d61c700 1 --2- 172.21.2.105:0/2378370987 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4e78004500 0x7f4e78004980 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:02.902 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e9d61c700 1 -- 172.21.2.105:0/2378370987 >> 172.21.2.105:0/2378370987 conn(0x7f4e980b5370 msgr2=0x7f4e980b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:43:02.902 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e9d61c700 1 -- 172.21.2.105:0/2378370987 shutdown_connections 2021-11-12T05:43:02.902 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e9d61c700 1 -- 172.21.2.105:0/2378370987 wait complete. 2021-11-12T05:43:02.902 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e9d61c700 1 Processor -- start 2021-11-12T05:43:02.902 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e9d61c700 1 -- start start 2021-11-12T05:43:02.905 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e9d61c700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4e78004500 0x7f4e98156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.905 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e9d61c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4e981570c0 0x7f4e980ab170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.906 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e9d61c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4e980ab660 0x7f4e980a88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.906 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e9d61c700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e98157b20 con 0x7f4e981570c0 2021-11-12T05:43:02.906 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e9d61c700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e98157880 con 0x7f4e78004500 2021-11-12T05:43:02.906 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.887+0000 7f4e9d61c700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e980a7610 con 0x7f4e980ab660 2021-11-12T05:43:02.907 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.891+0000 7f4e967fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4e981570c0 0x7f4e980ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:02.907 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.891+0000 7f4e967fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4e981570c0 0x7f4e980ab170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45420/0 (socket says 172.21.2.105:45420) 2021-11-12T05:43:02.907 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.891+0000 7f4e967fc700 1 -- 172.21.2.105:0/471823123 learned_addr learned my addr 172.21.2.105:0/471823123 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:43:02.907 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.891+0000 7f4e96ffd700 1 --2- 172.21.2.105:0/471823123 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4e78004500 0x7f4e98156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:02.907 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.891+0000 7f4e977fe700 1 --2- 172.21.2.105:0/471823123 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4e980ab660 0x7f4e980a88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:02.908 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.891+0000 7f4e967fc700 1 -- 172.21.2.105:0/471823123 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4e980ab660 msgr2=0x7f4e980a88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:02.908 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.891+0000 7f4e967fc700 1 --2- 172.21.2.105:0/471823123 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4e980ab660 0x7f4e980a88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:02.908 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.891+0000 7f4e967fc700 1 -- 172.21.2.105:0/471823123 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4e78004500 msgr2=0x7f4e98156bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:02.908 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.891+0000 7f4e967fc700 1 --2- 172.21.2.105:0/471823123 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4e78004500 0x7f4e98156bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:02.909 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.891+0000 7f4e967fc700 1 -- 172.21.2.105:0/471823123 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e98157d70 con 0x7f4e981570c0 2021-11-12T05:43:02.909 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.891+0000 7f4e967fc700 1 --2- 172.21.2.105:0/471823123 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4e981570c0 0x7f4e980ab170 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f4e8800a000 tx=0x7f4e88008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:02.909 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.891+0000 7f4e8ffff700 1 -- 172.21.2.105:0/471823123 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e88012a30 con 0x7f4e981570c0 2021-11-12T05:43:02.909 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.891+0000 7f4e8ffff700 1 -- 172.21.2.105:0/471823123 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e88012b90 con 0x7f4e981570c0 2021-11-12T05:43:02.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.891+0000 7f4e9d61c700 1 -- 172.21.2.105:0/471823123 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e9814b5d0 con 0x7f4e981570c0 2021-11-12T05:43:02.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.891+0000 7f4e8ffff700 1 -- 172.21.2.105:0/471823123 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e8801d410 con 0x7f4e981570c0 2021-11-12T05:43:02.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.891+0000 7f4e9d61c700 1 -- 172.21.2.105:0/471823123 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e980abae0 con 0x7f4e981570c0 2021-11-12T05:43:02.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.891+0000 7f4e9d61c700 1 -- 172.21.2.105:0/471823123 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e980a77d0 con 0x7f4e981570c0 2021-11-12T05:43:02.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.891+0000 7f4e8ffff700 1 -- 172.21.2.105:0/471823123 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4e8801d570 con 0x7f4e981570c0 2021-11-12T05:43:02.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.891+0000 7f4e8ffff700 1 --2- 172.21.2.105:0/471823123 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4e7c0536a0 0x7f4e7c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:02.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.891+0000 7f4e8ffff700 1 -- 172.21.2.105:0/471823123 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f4e8806d2c0 con 0x7f4e981570c0 2021-11-12T05:43:02.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.891+0000 7f4e96ffd700 1 --2- 172.21.2.105:0/471823123 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4e7c0536a0 0x7f4e7c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:02.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.891+0000 7f4e96ffd700 1 --2- 172.21.2.105:0/471823123 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4e7c0536a0 0x7f4e7c055b60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f4e8000b000 tx=0x7f4e80009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:02.912 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:02.895+0000 7f4e8ffff700 1 -- 172.21.2.105:0/471823123 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4e88044270 con 0x7f4e981570c0 2021-11-12T05:43:03.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:03.003+0000 7f4e9d61c700 1 -- 172.21.2.105:0/471823123 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e980b1440 con 0x7f4e981570c0 2021-11-12T05:43:03.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:03.003+0000 7f4e8ffff700 1 -- 172.21.2.105:0/471823123 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+2138 (secure 0 0 0) 0x7f4e88047890 con 0x7f4e981570c0 2021-11-12T05:43:03.008 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:43:03.009 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":15,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4403,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/3185091424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":3185091424},{"type":"v1","addr":"172.21.2.115:6833","nonce":3185091424}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:42:27.265739+0000","modified":"2021-11-12T05:42:28.270769+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5250":{"gid":5250,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/3058129917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":3058129917},{"type":"v1","addr":"172.21.2.105:6835","nonce":3058129917}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-11-12T05:43:03.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:03.003+0000 7f4e9d61c700 1 -- 172.21.2.105:0/471823123 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4e7c0536a0 msgr2=0x7f4e7c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:03.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:03.003+0000 7f4e9d61c700 1 --2- 172.21.2.105:0/471823123 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4e7c0536a0 0x7f4e7c055b60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f4e8000b000 tx=0x7f4e80009040).stop 2021-11-12T05:43:03.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:03.003+0000 7f4e9d61c700 1 -- 172.21.2.105:0/471823123 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4e981570c0 msgr2=0x7f4e980ab170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:03.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:03.003+0000 7f4e9d61c700 1 --2- 172.21.2.105:0/471823123 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4e981570c0 0x7f4e980ab170 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f4e8800a000 tx=0x7f4e88008040).stop 2021-11-12T05:43:03.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:03.003+0000 7f4e9d61c700 1 -- 172.21.2.105:0/471823123 shutdown_connections 2021-11-12T05:43:03.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:03.003+0000 7f4e9d61c700 1 --2- 172.21.2.105:0/471823123 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4e7c0536a0 0x7f4e7c055b60 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:03.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:03.003+0000 7f4e9d61c700 1 --2- 172.21.2.105:0/471823123 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4e980ab660 0x7f4e980a88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:03.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:03.003+0000 7f4e9d61c700 1 --2- 172.21.2.105:0/471823123 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4e981570c0 0x7f4e980ab170 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:03.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:03.003+0000 7f4e9d61c700 1 --2- 172.21.2.105:0/471823123 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4e78004500 0x7f4e98156bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:03.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:03.003+0000 7f4e9d61c700 1 -- 172.21.2.105:0/471823123 >> 172.21.2.105:0/471823123 conn(0x7f4e980b5370 msgr2=0x7f4e980b31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:43:03.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:03.003+0000 7f4e9d61c700 1 -- 172.21.2.105:0/471823123 shutdown_connections 2021-11-12T05:43:03.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:03.003+0000 7f4e9d61c700 1 -- 172.21.2.105:0/471823123 wait complete. 2021-11-12T05:43:03.012 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 15 2021-11-12T05:43:03.216 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:42:27.265739+0000', 'modified': '2021-11-12T05:42:28.270769+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5250}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5250': {'gid': 5250, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/3058129917', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 3058129917}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 3058129917}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:43:03.217 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:43:03.217 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:43:03.282 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":5250,"want_state":"up:active","state":"up:active","rank_uptime":36.008871286000002,"mdsmap_epoch":15,"osdmap_epoch":45,"osdmap_epoch_barrier":45,"uptime":40.233069874000002} 2021-11-12T05:43:03.282 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 5250, "mdsmap_epoch": 15, "osdmap_epoch": 45, "osdmap_epoch_barrier": 45, "rank_uptime": 36.008871286, "state": "up:active", "uptime": 40.233069874, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:43:03.283 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-12T05:43:03.283 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-12T05:43:03.284 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba016.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-12T05:43:03.284 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:43:03.285 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:43:03.295 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:43:03.306 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:43:03.307 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:43:03.312 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:43:03.313 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:43:03.314 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:43:03.315 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:43:03.362 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-12T05:43:03.362 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:43:03.365 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:43:03.375 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:43:03.375 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:43:03.380 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:43:03.381 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:43:03.382 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:43:03.382 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:43:03.404 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[14240]: starting ceph client 2021-11-12T05:43:03.404 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:2021-11-12T05:43:03.400+0000 7fb15f4c4080 -1 init, newargv = 0x55e9a838a4f0 newargc=9 2021-11-12T05:43:03.417 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[14240]: starting fuse 2021-11-12T05:43:04.508 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:43:04.520 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:43:04.521 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:43:04.569 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:43:04.569 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:43:04.571 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:43:04.571 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:43:04.576 INFO:teuthology.orchestra.run.gibba016.stdout:52 2021-11-12T05:43:04.577 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-12T05:43:04.577 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:43:04.578 DEBUG:teuthology.orchestra.run.gibba016:> sudo python3 -c ' 2021-11-12T05:43:04.578 DEBUG:teuthology.orchestra.run.gibba016:> import glob 2021-11-12T05:43:04.578 DEBUG:teuthology.orchestra.run.gibba016:> import re 2021-11-12T05:43:04.579 DEBUG:teuthology.orchestra.run.gibba016:> import os 2021-11-12T05:43:04.579 DEBUG:teuthology.orchestra.run.gibba016:> import subprocess 2021-11-12T05:43:04.580 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:43:04.580 DEBUG:teuthology.orchestra.run.gibba016:> def find_socket(client_name): 2021-11-12T05:43:04.580 DEBUG:teuthology.orchestra.run.gibba016:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-12T05:43:04.581 DEBUG:teuthology.orchestra.run.gibba016:> files = glob.glob(asok_path) 2021-11-12T05:43:04.581 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:43:04.581 DEBUG:teuthology.orchestra.run.gibba016:> # Given a non-glob path, it better be there 2021-11-12T05:43:04.583 DEBUG:teuthology.orchestra.run.gibba016:> if "*" not in asok_path: 2021-11-12T05:43:04.583 DEBUG:teuthology.orchestra.run.gibba016:> assert(len(files) == 1) 2021-11-12T05:43:04.584 DEBUG:teuthology.orchestra.run.gibba016:> return files[0] 2021-11-12T05:43:04.584 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:43:04.584 DEBUG:teuthology.orchestra.run.gibba016:> for f in files: 2021-11-12T05:43:04.585 DEBUG:teuthology.orchestra.run.gibba016:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-12T05:43:04.585 DEBUG:teuthology.orchestra.run.gibba016:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-12T05:43:04.586 DEBUG:teuthology.orchestra.run.gibba016:> return f 2021-11-12T05:43:04.586 DEBUG:teuthology.orchestra.run.gibba016:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-12T05:43:04.587 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:43:04.587 DEBUG:teuthology.orchestra.run.gibba016:> print(find_socket("client.0")) 2021-11-12T05:43:04.587 DEBUG:teuthology.orchestra.run.gibba016:> ' 2021-11-12T05:43:04.611 INFO:teuthology.orchestra.run.gibba016.stdout:/var/run/ceph/ceph-client.0.14240.asok 2021-11-12T05:43:04.614 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14240.asok 2021-11-12T05:43:04.614 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:43:04.615 DEBUG:teuthology.orchestra.run.gibba016:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14240.asok status 2021-11-12T05:43:04.726 INFO:teuthology.orchestra.run.gibba016.stdout:{ 2021-11-12T05:43:04.727 INFO:teuthology.orchestra.run.gibba016.stdout: "metadata": { 2021-11-12T05:43:04.727 INFO:teuthology.orchestra.run.gibba016.stdout: "ceph_sha1": "a81ee2815de5acae59ead5b8c9137b6766fc8ea8", 2021-11-12T05:43:04.728 INFO:teuthology.orchestra.run.gibba016.stdout: "ceph_version": "ceph version 15.2.15-22-ga81ee281 (a81ee2815de5acae59ead5b8c9137b6766fc8ea8) octopus (stable)", 2021-11-12T05:43:04.728 INFO:teuthology.orchestra.run.gibba016.stdout: "entity_id": "0", 2021-11-12T05:43:04.728 INFO:teuthology.orchestra.run.gibba016.stdout: "hostname": "gibba016", 2021-11-12T05:43:04.728 INFO:teuthology.orchestra.run.gibba016.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-12T05:43:04.729 INFO:teuthology.orchestra.run.gibba016.stdout: "pid": "14240", 2021-11-12T05:43:04.729 INFO:teuthology.orchestra.run.gibba016.stdout: "root": "/" 2021-11-12T05:43:04.729 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:43:04.730 INFO:teuthology.orchestra.run.gibba016.stdout: "dentry_count": 0, 2021-11-12T05:43:04.730 INFO:teuthology.orchestra.run.gibba016.stdout: "dentry_pinned_count": 0, 2021-11-12T05:43:04.730 INFO:teuthology.orchestra.run.gibba016.stdout: "id": 4624, 2021-11-12T05:43:04.730 INFO:teuthology.orchestra.run.gibba016.stdout: "inst": { 2021-11-12T05:43:04.731 INFO:teuthology.orchestra.run.gibba016.stdout: "name": { 2021-11-12T05:43:04.731 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "client", 2021-11-12T05:43:04.731 INFO:teuthology.orchestra.run.gibba016.stdout: "num": 4624 2021-11-12T05:43:04.732 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:43:04.732 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": { 2021-11-12T05:43:04.732 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "v1", 2021-11-12T05:43:04.732 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": "172.21.2.116:0", 2021-11-12T05:43:04.733 INFO:teuthology.orchestra.run.gibba016.stdout: "nonce": 3665530375 2021-11-12T05:43:04.733 INFO:teuthology.orchestra.run.gibba016.stdout: } 2021-11-12T05:43:04.733 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:43:04.733 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": { 2021-11-12T05:43:04.734 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "v1", 2021-11-12T05:43:04.734 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": "172.21.2.116:0", 2021-11-12T05:43:04.734 INFO:teuthology.orchestra.run.gibba016.stdout: "nonce": 3665530375 2021-11-12T05:43:04.734 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:43:04.734 INFO:teuthology.orchestra.run.gibba016.stdout: "inst_str": "client.4624 172.21.2.116:0/3665530375", 2021-11-12T05:43:04.735 INFO:teuthology.orchestra.run.gibba016.stdout: "addr_str": "172.21.2.116:0/3665530375", 2021-11-12T05:43:04.735 INFO:teuthology.orchestra.run.gibba016.stdout: "inode_count": 1, 2021-11-12T05:43:04.735 INFO:teuthology.orchestra.run.gibba016.stdout: "mds_epoch": 15, 2021-11-12T05:43:04.735 INFO:teuthology.orchestra.run.gibba016.stdout: "osd_epoch": 45, 2021-11-12T05:43:04.736 INFO:teuthology.orchestra.run.gibba016.stdout: "osd_epoch_barrier": 0, 2021-11-12T05:43:04.736 INFO:teuthology.orchestra.run.gibba016.stdout: "blacklisted": false, 2021-11-12T05:43:04.736 INFO:teuthology.orchestra.run.gibba016.stdout: "fs_name": "cephfs" 2021-11-12T05:43:04.736 INFO:teuthology.orchestra.run.gibba016.stdout:} 2021-11-12T05:43:04.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:43:04.738 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:43:04.739 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:43:04.746 INFO:teuthology.orchestra.run.gibba016.stdout:fuseblk 2021-11-12T05:43:04.748 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-12T05:43:04.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:43:04.749 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:43:24.429 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:43:24.433 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:43:24.437 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:43:24.440 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:43:24.444 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:43:53.091 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-12T05:43:53.091 DEBUG:teuthology.orchestra.run.gibba005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:43:53.103 DEBUG:teuthology.orchestra.run.gibba015:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:43:53.117 DEBUG:teuthology.orchestra.run.gibba016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:43:53.130 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:43:53.144 DEBUG:teuthology.orchestra.run.gibba044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:43:53.157 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-12T05:43:53.158 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:43:53.159 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:43:53.159 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:43:53.164 INFO:teuthology.orchestra.run.gibba016.stdout:fuseblk 2021-11-12T05:43:53.165 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-12T05:43:53.166 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba016.front.sepia.ceph.com... 2021-11-12T05:43:53.166 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-12T05:43:53.167 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:43:53.228 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[14240]: fuse finished with error 0 and tester_r 0 2021-11-12T05:43:53.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:43:53.231 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:43:53.231 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:43:53.240 INFO:teuthology.orchestra.run.gibba016.stdout:ext2/ext3 2021-11-12T05:43:53.241 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-12T05:43:53.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:43:53.351 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:43:53.355 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:43:53.356 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:43:53.356 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:43:53.366 INFO:teuthology.orchestra.run.gibba038.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-12T05:43:53.366 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:43:53.367 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-12T05:43:53.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:43:53.368 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:43:53.418 INFO:teuthology.orchestra.run.gibba038.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-12T05:43:53.419 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:43:53.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:43:53.421 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:43:53.421 DEBUG:teuthology.orchestra.run.gibba044:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:43:53.430 INFO:teuthology.orchestra.run.gibba044.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-12T05:43:53.431 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:43:53.432 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-12T05:43:53.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:43:53.434 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:43:53.443 INFO:teuthology.orchestra.run.gibba044.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-12T05:43:53.443 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:43:53.445 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-12T05:43:53.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.495+0000 7f27c0c0e700 1 Processor -- start 2021-11-12T05:43:53.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.495+0000 7f27c0c0e700 1 -- start start 2021-11-12T05:43:53.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.495+0000 7f27c0c0e700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f27bc0af750 0x7f27bc062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:53.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.495+0000 7f27c0c0e700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f27bc130a80 0x7f27bc1474d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:53.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.495+0000 7f27c0c0e700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27bc0b0d50 con 0x7f27bc0626b0 2021-11-12T05:43:53.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.495+0000 7f27c0c0e700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27bc0ad380 con 0x7f27bc130a80 2021-11-12T05:43:53.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.495+0000 7f27c0c0e700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27bc0ae190 con 0x7f27bc0af750 2021-11-12T05:43:53.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.495+0000 7f27bad9d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f27bc130a80 0x7f27bc1474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:53.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.495+0000 7f27ba59c700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f27bc0626b0 0x7f27bc130370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:55822/0 (socket says 172.21.2.105:55822) 2021-11-12T05:43:53.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.495+0000 7f27ba59c700 1 -- 172.21.2.105:0/3815733737 learned_addr learned my addr 172.21.2.105:0/3815733737 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:43:53.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.495+0000 7f27bad9d700 1 -- 172.21.2.105:0/3815733737 >> v2:172.21.2.115:3300/0 conn(0x7f27bc0af750 msgr2=0x7f27bc062a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:43:53.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.495+0000 7f27bad9d700 1 --2- 172.21.2.105:0/3815733737 >> v2:172.21.2.115:3300/0 conn(0x7f27bc0af750 0x7f27bc062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:53.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.495+0000 7f27bad9d700 1 -- 172.21.2.105:0/3815733737 >> v1:172.21.2.105:6789/0 conn(0x7f27bc0626b0 legacy=0x7f27bc130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:53.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.495+0000 7f27b959a700 1 -- 172.21.2.105:0/3815733737 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1988948983 0 0) 0x7f27bc0b0d50 con 0x7f27bc0626b0 2021-11-12T05:43:53.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.495+0000 7f27bad9d700 1 -- 172.21.2.105:0/3815733737 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27bc1479c0 con 0x7f27bc130a80 2021-11-12T05:43:53.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.495+0000 7f27bad9d700 1 --2- 172.21.2.105:0/3815733737 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f27bc130a80 0x7f27bc1474d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f27b40032f0 tx=0x7f27b40091d0).ready entity=mon.0 client_cookie=beeafb2fee78fce6 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:53.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.495+0000 7f27b959a700 1 -- 172.21.2.105:0/3815733737 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27b4009ea0 con 0x7f27bc130a80 2021-11-12T05:43:53.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.495+0000 7f27b959a700 1 -- 172.21.2.105:0/3815733737 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b400b870 con 0x7f27bc130a80 2021-11-12T05:43:53.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.495+0000 7f27b959a700 1 -- 172.21.2.105:0/3815733737 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27b400b9e0 con 0x7f27bc130a80 2021-11-12T05:43:53.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.495+0000 7f27c0c0e700 1 -- 172.21.2.105:0/3815733737 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f27bc130a80 msgr2=0x7f27bc1474d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:53.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.495+0000 7f27c0c0e700 1 --2- 172.21.2.105:0/3815733737 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f27bc130a80 0x7f27bc1474d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f27b40032f0 tx=0x7f27b40091d0).stop 2021-11-12T05:43:53.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.495+0000 7f27c0c0e700 1 -- 172.21.2.105:0/3815733737 shutdown_connections 2021-11-12T05:43:53.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.495+0000 7f27c0c0e700 1 --2- 172.21.2.105:0/3815733737 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f27bc130a80 0x7f27bc1474d0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:53.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.495+0000 7f27c0c0e700 1 --2- 172.21.2.105:0/3815733737 >> v2:172.21.2.115:3300/0 conn(0x7f27bc0af750 0x7f27bc062a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:53.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.495+0000 7f27c0c0e700 1 -- 172.21.2.105:0/3815733737 >> 172.21.2.105:0/3815733737 conn(0x7f27bc0b5320 msgr2=0x7f27bc0b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:43:53.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.495+0000 7f27c0c0e700 1 -- 172.21.2.105:0/3815733737 shutdown_connections 2021-11-12T05:43:53.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.495+0000 7f27c0c0e700 1 -- 172.21.2.105:0/3815733737 wait complete. 2021-11-12T05:43:53.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.499+0000 7f27c0c0e700 1 Processor -- start 2021-11-12T05:43:53.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.499+0000 7f27c0c0e700 1 -- start start 2021-11-12T05:43:53.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.499+0000 7f27c0c0e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f27bc0626b0 0x7f27bc14e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:53.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.499+0000 7f27c0c0e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f27bc0af750 0x7f27bc148850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:53.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.499+0000 7f27c0c0e700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f27bc130a80 0x7f27bc156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:53.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.499+0000 7f27c0c0e700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc0634c0 con 0x7f27bc0af750 2021-11-12T05:43:53.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.499+0000 7f27c0c0e700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc14ac80 con 0x7f27bc130a80 2021-11-12T05:43:53.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.499+0000 7f27c0c0e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27bc064c20 con 0x7f27bc0626b0 2021-11-12T05:43:53.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.499+0000 7f27b9d9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f27bc0af750 0x7f27bc148850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:53.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.499+0000 7f27b9d9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f27bc0af750 0x7f27bc148850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45434/0 (socket says 172.21.2.105:45434) 2021-11-12T05:43:53.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.499+0000 7f27b9d9b700 1 -- 172.21.2.105:0/3150585982 learned_addr learned my addr 172.21.2.105:0/3150585982 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:43:53.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.499+0000 7f27b9d9b700 1 -- 172.21.2.105:0/3150585982 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f27bc0626b0 msgr2=0x7f27bc14e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:53.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.499+0000 7f27b9d9b700 1 --2- 172.21.2.105:0/3150585982 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f27bc0626b0 0x7f27bc14e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:53.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.499+0000 7f27b9d9b700 1 -- 172.21.2.105:0/3150585982 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f27bc130a80 msgr2=0x7f27bc156d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:53.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.499+0000 7f27b9d9b700 1 --2- 172.21.2.105:0/3150585982 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f27bc130a80 0x7f27bc156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:53.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.499+0000 7f27b9d9b700 1 -- 172.21.2.105:0/3150585982 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b4009470 con 0x7f27bc0af750 2021-11-12T05:43:53.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.499+0000 7f27b9d9b700 1 --2- 172.21.2.105:0/3150585982 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f27bc0af750 0x7f27bc148850 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f27b0002f70 tx=0x7f27b0006e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:53.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.499+0000 7f27ab7fe700 1 -- 172.21.2.105:0/3150585982 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27b0013460 con 0x7f27bc0af750 2021-11-12T05:43:53.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.499+0000 7f27ab7fe700 1 -- 172.21.2.105:0/3150585982 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b00135c0 con 0x7f27bc0af750 2021-11-12T05:43:53.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.499+0000 7f27ab7fe700 1 -- 172.21.2.105:0/3150585982 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27b0013920 con 0x7f27bc0af750 2021-11-12T05:43:53.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.499+0000 7f27c0c0e700 1 -- 172.21.2.105:0/3150585982 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27bc064ec0 con 0x7f27bc0af750 2021-11-12T05:43:53.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.499+0000 7f27c0c0e700 1 -- 172.21.2.105:0/3150585982 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27bc148d40 con 0x7f27bc0af750 2021-11-12T05:43:53.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.499+0000 7f27c0c0e700 1 -- 172.21.2.105:0/3150585982 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27bc057350 con 0x7f27bc0af750 2021-11-12T05:43:53.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.499+0000 7f27ab7fe700 1 -- 172.21.2.105:0/3150585982 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f27b000f070 con 0x7f27bc0af750 2021-11-12T05:43:53.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.499+0000 7f27ab7fe700 1 --2- 172.21.2.105:0/3150585982 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2798053580 0x7f2798055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:53.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.499+0000 7f27ab7fe700 1 -- 172.21.2.105:0/3150585982 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f27b006b390 con 0x7f27bc0af750 2021-11-12T05:43:53.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.499+0000 7f27ba59c700 1 --2- 172.21.2.105:0/3150585982 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2798053580 0x7f2798055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:53.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.499+0000 7f27ba59c700 1 --2- 172.21.2.105:0/3150585982 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2798053580 0x7f2798055a40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f27ac000bc0 tx=0x7f27ac0011a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:53.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.503+0000 7f27ab7fe700 1 -- 172.21.2.105:0/3150585982 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f27b00423a0 con 0x7f27bc0af750 2021-11-12T05:43:53.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.583+0000 7f27c0c0e700 1 -- 172.21.2.105:0/3150585982 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f27bc05d9a0 con 0x7f27bc0af750 2021-11-12T05:43:53.590 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.587+0000 7f27ab7fe700 1 -- 172.21.2.105:0/3150585982 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v45) v1 ==== 81+0+34037 (secure 0 0 0) 0x7f27b00459c0 con 0x7f27bc0af750 2021-11-12T05:43:53.591 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:43:53.591 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:43:53.592 INFO:teuthology.orchestra.run.gibba005.stdout: "epoch": 45, 2021-11-12T05:43:53.592 INFO:teuthology.orchestra.run.gibba005.stdout: "fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", 2021-11-12T05:43:53.592 INFO:teuthology.orchestra.run.gibba005.stdout: "created": "2021-11-12T05:40:19.986390+0000", 2021-11-12T05:43:53.592 INFO:teuthology.orchestra.run.gibba005.stdout: "modified": "2021-11-12T05:42:28.269153+0000", 2021-11-12T05:43:53.593 INFO:teuthology.orchestra.run.gibba005.stdout: "last_up_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:43:53.593 INFO:teuthology.orchestra.run.gibba005.stdout: "last_in_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:43:53.593 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-12T05:43:53.593 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_num": 5799936, 2021-11-12T05:43:53.594 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_set": [ 2021-11-12T05:43:53.594 INFO:teuthology.orchestra.run.gibba005.stdout: "pglog_hardlimit", 2021-11-12T05:43:53.594 INFO:teuthology.orchestra.run.gibba005.stdout: "purged_snapdirs", 2021-11-12T05:43:53.594 INFO:teuthology.orchestra.run.gibba005.stdout: "recovery_deletes", 2021-11-12T05:43:53.594 INFO:teuthology.orchestra.run.gibba005.stdout: "sortbitwise" 2021-11-12T05:43:53.595 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:43:53.595 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_version": 5, 2021-11-12T05:43:53.595 INFO:teuthology.orchestra.run.gibba005.stdout: "full_ratio": 0.94999998807907104, 2021-11-12T05:43:53.595 INFO:teuthology.orchestra.run.gibba005.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-12T05:43:53.596 INFO:teuthology.orchestra.run.gibba005.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-12T05:43:53.596 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_snapshot": "", 2021-11-12T05:43:53.596 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_max": 8, 2021-11-12T05:43:53.596 INFO:teuthology.orchestra.run.gibba005.stdout: "max_osd": 8, 2021-11-12T05:43:53.597 INFO:teuthology.orchestra.run.gibba005.stdout: "require_min_compat_client": "jewel", 2021-11-12T05:43:53.597 INFO:teuthology.orchestra.run.gibba005.stdout: "min_compat_client": "jewel", 2021-11-12T05:43:53.597 INFO:teuthology.orchestra.run.gibba005.stdout: "require_osd_release": "octopus", 2021-11-12T05:43:53.597 INFO:teuthology.orchestra.run.gibba005.stdout: "pools": [ 2021-11-12T05:43:53.597 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.598 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 1, 2021-11-12T05:43:53.598 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "device_health_metrics", 2021-11-12T05:43:53.598 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:22.022116+0000", 2021-11-12T05:43:53.598 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:43:53.599 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:43:53.599 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:43:53.599 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:43:53.599 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:43:53.599 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:43:53.600 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:43:53.600 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:43:53.600 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 1, 2021-11-12T05:43:53.600 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 1, 2021-11-12T05:43:53.601 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 1, 2021-11-12T05:43:53.601 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 1, 2021-11-12T05:43:53.601 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 1, 2021-11-12T05:43:53.601 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:43:53.601 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:43:53.602 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:43:53.602 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:43:53.602 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:43:53.602 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:43:53.603 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:43:53.603 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.603 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "16", 2021-11-12T05:43:53.603 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:43:53.603 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:43:53.604 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:43:53.604 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:43:53.604 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:43:53.604 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:43:53.605 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:43:53.605 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:43:53.605 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:43:53.605 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:43:53.605 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:43:53.606 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:43:53.606 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:43:53.606 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:43:53.606 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:43:53.607 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:43:53.607 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:43:53.607 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:43:53.607 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:43:53.607 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:43:53.608 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:43:53.608 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:43:53.608 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:43:53.608 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:43:53.609 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:43:53.609 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:43:53.610 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.610 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:43:53.610 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:43:53.610 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:43:53.611 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:43:53.611 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:43:53.611 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:43:53.611 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:43:53.612 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:43:53.612 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:43:53.612 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:43:53.612 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:43:53.613 INFO:teuthology.orchestra.run.gibba005.stdout: "options": { 2021-11-12T05:43:53.613 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_min": 1 2021-11-12T05:43:53.613 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.613 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:43:53.613 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr_devicehealth": {} 2021-11-12T05:43:53.614 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.614 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.614 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.614 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 2, 2021-11-12T05:43:53.615 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "rbd", 2021-11-12T05:43:53.615 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:29.953617+0000", 2021-11-12T05:43:53.615 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:43:53.615 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:43:53.615 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:43:53.616 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:43:53.616 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:43:53.616 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:43:53.616 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:43:53.617 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:43:53.617 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:43:53.617 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:43:53.617 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:43:53.617 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:43:53.618 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:43:53.618 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:43:53.618 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:43:53.618 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:43:53.618 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:43:53.619 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:43:53.619 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:43:53.619 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:43:53.619 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.620 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "19", 2021-11-12T05:43:53.620 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:43:53.620 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:43:53.620 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:43:53.621 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:43:53.621 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:43:53.621 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:43:53.621 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:43:53.621 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:43:53.622 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:43:53.622 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:43:53.622 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:43:53.622 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:43:53.622 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:43:53.623 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:43:53.623 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:43:53.623 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:43:53.623 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:43:53.624 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:43:53.624 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:43:53.624 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:43:53.624 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:43:53.624 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:43:53.625 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:43:53.625 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:43:53.625 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:43:53.625 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:43:53.626 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.626 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:43:53.626 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:43:53.626 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:43:53.626 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:43:53.627 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:43:53.627 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:43:53.627 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:43:53.627 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:43:53.628 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:43:53.628 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:43:53.628 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:43:53.628 INFO:teuthology.orchestra.run.gibba005.stdout: "options": {}, 2021-11-12T05:43:53.628 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:43:53.629 INFO:teuthology.orchestra.run.gibba005.stdout: "rbd": {} 2021-11-12T05:43:53.629 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.629 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.629 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.629 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 7, 2021-11-12T05:43:53.630 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "cephfs_metadata", 2021-11-12T05:43:53.630 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:42:25.227892+0000", 2021-11-12T05:43:53.630 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:43:53.630 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:43:53.631 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:43:53.631 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:43:53.631 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:43:53.631 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:43:53.632 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:43:53.632 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:43:53.632 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:43:53.632 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:43:53.632 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:43:53.633 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:43:53.633 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:43:53.633 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:43:53.633 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:43:53.634 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:43:53.634 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:43:53.634 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:43:53.634 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:43:53.635 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:43:53.635 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.635 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "45", 2021-11-12T05:43:53.635 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:43:53.635 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:43:53.636 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:43:53.636 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:43:53.636 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:43:53.636 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:43:53.637 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:43:53.637 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:43:53.637 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:43:53.637 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:43:53.637 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:43:53.638 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:43:53.638 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:43:53.638 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:43:53.638 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:43:53.639 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:43:53.639 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:43:53.639 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:43:53.639 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:43:53.639 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:43:53.640 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:43:53.640 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:43:53.640 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:43:53.640 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:43:53.641 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:43:53.641 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:43:53.641 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.641 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:43:53.641 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:43:53.642 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:43:53.642 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:43:53.642 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:43:53.642 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:43:53.642 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:43:53.643 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:43:53.643 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:43:53.643 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:43:53.643 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:43:53.644 INFO:teuthology.orchestra.run.gibba005.stdout: "options": { 2021-11-12T05:43:53.644 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_bias": 4, 2021-11-12T05:43:53.644 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_min": 16, 2021-11-12T05:43:53.644 INFO:teuthology.orchestra.run.gibba005.stdout: "recovery_priority": 5 2021-11-12T05:43:53.644 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.645 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:43:53.645 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs": { 2021-11-12T05:43:53.645 INFO:teuthology.orchestra.run.gibba005.stdout: "metadata": "cephfs" 2021-11-12T05:43:53.645 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.646 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.646 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.646 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.646 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 8, 2021-11-12T05:43:53.646 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "cephfs_data", 2021-11-12T05:43:53.647 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:42:26.242644+0000", 2021-11-12T05:43:53.647 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:43:53.647 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:43:53.647 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:43:53.648 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:43:53.648 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:43:53.648 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:43:53.648 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:43:53.649 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:43:53.649 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:43:53.649 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:43:53.649 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:43:53.649 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:43:53.650 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:43:53.650 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:43:53.650 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:43:53.650 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:43:53.650 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:43:53.651 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:43:53.651 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:43:53.651 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:43:53.652 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.652 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "45", 2021-11-12T05:43:53.652 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:43:53.652 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:43:53.653 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:43:53.653 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:43:53.653 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:43:53.653 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:43:53.653 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:43:53.654 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:43:53.654 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:43:53.654 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:43:53.654 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:43:53.655 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:43:53.655 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:43:53.655 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:43:53.655 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:43:53.655 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:43:53.656 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:43:53.656 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:43:53.656 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:43:53.656 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:43:53.657 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:43:53.657 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:43:53.657 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:43:53.657 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:43:53.657 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:43:53.658 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:43:53.658 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.658 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:43:53.658 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:43:53.659 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:43:53.659 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:43:53.659 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:43:53.659 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:43:53.659 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:43:53.660 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:43:53.660 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:43:53.660 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:43:53.660 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:43:53.661 INFO:teuthology.orchestra.run.gibba005.stdout: "options": {}, 2021-11-12T05:43:53.661 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:43:53.661 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs": { 2021-11-12T05:43:53.661 INFO:teuthology.orchestra.run.gibba005.stdout: "data": "cephfs" 2021-11-12T05:43:53.661 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.662 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.662 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.662 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:43:53.662 INFO:teuthology.orchestra.run.gibba005.stdout: "osds": [ 2021-11-12T05:43:53.663 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.663 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:43:53.663 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "ee8e30a0-4819-4475-80ec-dd3ee7d01322", 2021-11-12T05:43:53.663 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:43:53.663 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:43:53.664 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:43:53.664 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:43:53.664 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:43:53.664 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:43:53.664 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:43:53.665 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 42, 2021-11-12T05:43:53.665 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:43:53.665 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:43:53.665 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:43:53.666 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:43:53.666 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.666 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:43:53.666 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6802", 2021-11-12T05:43:53.666 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:43:53.667 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.667 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.667 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:43:53.667 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6803", 2021-11-12T05:43:53.667 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:43:53.668 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.668 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.668 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.668 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:43:53.669 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:43:53.669 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.669 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:43:53.669 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6804", 2021-11-12T05:43:53.669 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:43:53.670 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.670 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.670 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:43:53.670 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6805", 2021-11-12T05:43:53.670 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:43:53.671 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.671 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.671 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.671 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:43:53.672 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:43:53.672 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.672 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:43:53.672 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6808", 2021-11-12T05:43:53.672 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:43:53.673 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.673 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.673 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:43:53.673 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6809", 2021-11-12T05:43:53.673 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:43:53.674 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.674 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.674 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.674 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:43:53.675 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:43:53.675 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.675 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:43:53.675 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6806", 2021-11-12T05:43:53.675 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:43:53.676 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.676 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.676 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:43:53.676 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6807", 2021-11-12T05:43:53.676 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:43:53.677 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.677 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.677 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.677 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6803/14874", 2021-11-12T05:43:53.678 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6805/14874", 2021-11-12T05:43:53.678 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6809/14874", 2021-11-12T05:43:53.678 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6807/14874", 2021-11-12T05:43:53.678 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:43:53.678 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:43:53.679 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:43:53.679 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.679 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.679 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.680 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:43:53.680 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "b1bb06c3-26d0-4d92-82f8-b3e882242785", 2021-11-12T05:43:53.680 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:43:53.680 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:43:53.680 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:43:53.681 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:43:53.681 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:43:53.681 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:43:53.681 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:43:53.682 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 43, 2021-11-12T05:43:53.682 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:43:53.682 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:43:53.682 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:43:53.682 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:43:53.683 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.683 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:43:53.683 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6810", 2021-11-12T05:43:53.683 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:43:53.683 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.684 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.684 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:43:53.684 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6811", 2021-11-12T05:43:53.684 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:43:53.685 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.685 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.685 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.685 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:43:53.685 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:43:53.686 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.686 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:43:53.686 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6812", 2021-11-12T05:43:53.686 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:43:53.687 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.687 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.687 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:43:53.687 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6813", 2021-11-12T05:43:53.688 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:43:53.688 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.688 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.688 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.688 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:43:53.689 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:43:53.689 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.689 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:43:53.689 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6816", 2021-11-12T05:43:53.690 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:43:53.690 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.690 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.690 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:43:53.690 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6817", 2021-11-12T05:43:53.691 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:43:53.691 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.691 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.691 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.692 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:43:53.692 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:43:53.692 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.692 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:43:53.692 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6814", 2021-11-12T05:43:53.693 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:43:53.693 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.693 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.693 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:43:53.694 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6815", 2021-11-12T05:43:53.694 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:43:53.694 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.694 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.694 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.695 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6811/14875", 2021-11-12T05:43:53.695 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6813/14875", 2021-11-12T05:43:53.695 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6817/14875", 2021-11-12T05:43:53.695 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6815/14875", 2021-11-12T05:43:53.696 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:43:53.696 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:43:53.696 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:43:53.696 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.696 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.697 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.697 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:43:53.697 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "837b2c60-c335-4382-9f47-d86543a14022", 2021-11-12T05:43:53.697 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:43:53.697 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:43:53.698 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:43:53.698 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:43:53.698 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:43:53.698 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:43:53.699 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:43:53.699 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 31, 2021-11-12T05:43:53.699 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:43:53.699 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:43:53.699 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:43:53.700 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:43:53.700 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.700 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:43:53.700 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6818", 2021-11-12T05:43:53.700 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:43:53.701 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.701 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.701 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:43:53.701 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6819", 2021-11-12T05:43:53.702 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:43:53.702 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.702 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.702 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.702 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:43:53.703 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:43:53.703 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.703 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:43:53.703 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6820", 2021-11-12T05:43:53.704 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:43:53.704 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.704 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.704 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:43:53.704 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6821", 2021-11-12T05:43:53.705 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:43:53.705 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.705 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.705 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.705 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:43:53.706 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:43:53.706 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.706 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:43:53.706 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6824", 2021-11-12T05:43:53.707 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:43:53.707 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.707 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.707 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:43:53.707 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6825", 2021-11-12T05:43:53.708 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:43:53.708 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.708 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.708 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.708 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:43:53.709 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:43:53.709 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.709 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:43:53.709 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6822", 2021-11-12T05:43:53.710 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:43:53.710 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.710 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.710 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:43:53.710 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6823", 2021-11-12T05:43:53.711 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:43:53.711 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.711 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.711 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.711 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6819/14905", 2021-11-12T05:43:53.712 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6821/14905", 2021-11-12T05:43:53.712 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6825/14905", 2021-11-12T05:43:53.712 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6823/14905", 2021-11-12T05:43:53.712 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:43:53.713 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:43:53.713 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:43:53.713 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.713 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.713 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.714 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:43:53.714 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "eb2b737b-dda6-444b-a306-f33cbbd51f70", 2021-11-12T05:43:53.714 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:43:53.714 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:43:53.715 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:43:53.715 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:43:53.715 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:43:53.715 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:43:53.716 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:43:53.716 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 42, 2021-11-12T05:43:53.716 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:43:53.716 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:43:53.716 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:43:53.717 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:43:53.717 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.717 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:43:53.717 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6826", 2021-11-12T05:43:53.717 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:43:53.718 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.718 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.718 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:43:53.718 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6827", 2021-11-12T05:43:53.719 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:43:53.719 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.719 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.719 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.719 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:43:53.720 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:43:53.720 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.720 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:43:53.720 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6828", 2021-11-12T05:43:53.721 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:43:53.721 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.721 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.721 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:43:53.721 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6829", 2021-11-12T05:43:53.722 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:43:53.722 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.722 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.722 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.722 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:43:53.723 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:43:53.723 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.723 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:43:53.723 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6832", 2021-11-12T05:43:53.724 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:43:53.724 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.724 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.724 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:43:53.724 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6833", 2021-11-12T05:43:53.725 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:43:53.725 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.725 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.725 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.726 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:43:53.726 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:43:53.726 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.726 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:43:53.726 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6830", 2021-11-12T05:43:53.727 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:43:53.727 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.727 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.727 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:43:53.728 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6831", 2021-11-12T05:43:53.728 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:43:53.728 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.728 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.728 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.729 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6827/14876", 2021-11-12T05:43:53.729 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6829/14876", 2021-11-12T05:43:53.729 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6833/14876", 2021-11-12T05:43:53.729 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6831/14876", 2021-11-12T05:43:53.729 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:43:53.730 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:43:53.730 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:43:53.730 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.730 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.731 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.731 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:43:53.731 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "721529a1-c047-486a-a7ca-ddc15d80cdde", 2021-11-12T05:43:53.731 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:43:53.731 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:43:53.732 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:43:53.732 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:43:53.732 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:43:53.732 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:43:53.732 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:43:53.733 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 42, 2021-11-12T05:43:53.733 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:43:53.733 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:43:53.733 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:43:53.734 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:43:53.734 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.734 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:43:53.734 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6800", 2021-11-12T05:43:53.734 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:43:53.735 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.735 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.735 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:43:53.735 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6801", 2021-11-12T05:43:53.736 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:43:53.736 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.736 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.736 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.736 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:43:53.737 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:43:53.737 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.737 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:43:53.737 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6802", 2021-11-12T05:43:53.737 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:43:53.738 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.738 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.738 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:43:53.738 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6803", 2021-11-12T05:43:53.739 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:43:53.739 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.739 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.739 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.739 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:43:53.740 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:43:53.740 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.740 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:43:53.740 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6806", 2021-11-12T05:43:53.740 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:43:53.741 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.741 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.741 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:43:53.741 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6807", 2021-11-12T05:43:53.742 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:43:53.742 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.742 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.742 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.742 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:43:53.743 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:43:53.743 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.743 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:43:53.743 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6804", 2021-11-12T05:43:53.744 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:43:53.744 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.744 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.744 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:43:53.744 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6805", 2021-11-12T05:43:53.745 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:43:53.745 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.745 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.745 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.745 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6801/15096", 2021-11-12T05:43:53.746 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6803/15096", 2021-11-12T05:43:53.746 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6807/15096", 2021-11-12T05:43:53.746 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6805/15096", 2021-11-12T05:43:53.746 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:43:53.747 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:43:53.747 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:43:53.747 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.747 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.747 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.748 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:43:53.748 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "68b72ab2-fa82-4b5c-bf33-528f002e4950", 2021-11-12T05:43:53.748 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:43:53.748 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:43:53.748 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:43:53.749 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:43:53.749 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:43:53.749 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:43:53.749 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:43:53.750 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 42, 2021-11-12T05:43:53.750 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:43:53.750 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:43:53.750 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:43:53.750 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:43:53.751 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.751 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:43:53.751 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6808", 2021-11-12T05:43:53.751 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:43:53.751 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.752 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.752 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:43:53.752 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6809", 2021-11-12T05:43:53.752 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:43:53.752 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.753 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.753 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.753 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:43:53.753 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:43:53.754 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.754 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:43:53.754 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6810", 2021-11-12T05:43:53.754 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:43:53.754 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.755 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.755 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:43:53.755 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6811", 2021-11-12T05:43:53.755 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:43:53.755 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.756 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.756 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.756 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:43:53.756 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:43:53.757 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.757 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:43:53.757 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6814", 2021-11-12T05:43:53.757 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:43:53.757 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.758 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.758 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:43:53.758 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6815", 2021-11-12T05:43:53.758 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:43:53.759 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.759 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.759 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.759 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:43:53.760 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:43:53.760 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.760 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:43:53.760 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6812", 2021-11-12T05:43:53.760 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:43:53.761 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.761 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.761 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:43:53.761 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6813", 2021-11-12T05:43:53.761 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:43:53.762 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.762 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.762 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.762 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6809/15097", 2021-11-12T05:43:53.763 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6811/15097", 2021-11-12T05:43:53.763 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6815/15097", 2021-11-12T05:43:53.763 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6813/15097", 2021-11-12T05:43:53.763 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:43:53.763 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:43:53.764 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:43:53.764 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.764 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.764 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.764 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:43:53.765 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "a2c83b5d-8d37-4d30-ac04-30d89a76e485", 2021-11-12T05:43:53.765 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:43:53.765 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:43:53.765 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:43:53.766 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:43:53.766 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:43:53.766 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:43:53.766 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:43:53.766 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 42, 2021-11-12T05:43:53.767 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:43:53.767 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:43:53.767 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:43:53.767 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:43:53.768 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.768 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:43:53.768 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6816", 2021-11-12T05:43:53.768 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:43:53.768 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.769 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.769 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:43:53.769 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6817", 2021-11-12T05:43:53.769 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:43:53.770 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.770 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.770 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.770 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:43:53.770 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:43:53.771 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.771 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:43:53.771 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6818", 2021-11-12T05:43:53.771 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:43:53.771 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.772 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.772 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:43:53.772 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6819", 2021-11-12T05:43:53.772 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:43:53.773 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.773 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.773 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.773 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:43:53.773 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:43:53.774 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.774 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:43:53.774 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6822", 2021-11-12T05:43:53.774 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:43:53.775 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.775 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.775 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:43:53.775 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6823", 2021-11-12T05:43:53.775 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:43:53.776 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.776 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.776 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.776 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:43:53.776 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:43:53.777 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.777 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:43:53.777 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6820", 2021-11-12T05:43:53.777 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:43:53.778 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.778 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.778 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:43:53.778 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6821", 2021-11-12T05:43:53.778 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:43:53.779 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.779 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.779 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.779 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6817/15098", 2021-11-12T05:43:53.780 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6819/15098", 2021-11-12T05:43:53.780 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6823/15098", 2021-11-12T05:43:53.780 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6821/15098", 2021-11-12T05:43:53.780 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:43:53.780 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:43:53.781 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:43:53.781 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.781 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.781 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.782 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:43:53.782 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "786ce966-d0fb-4181-aed4-c26e3ef61c43", 2021-11-12T05:43:53.782 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:43:53.782 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:43:53.782 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:43:53.783 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:43:53.783 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:43:53.783 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:43:53.783 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:43:53.783 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 41, 2021-11-12T05:43:53.784 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:43:53.784 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:43:53.784 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:43:53.784 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:43:53.785 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.785 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:43:53.785 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6824", 2021-11-12T05:43:53.785 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:43:53.785 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.786 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.786 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:43:53.786 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6825", 2021-11-12T05:43:53.786 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:43:53.787 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.787 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.787 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.787 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:43:53.787 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:43:53.788 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.788 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:43:53.788 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6826", 2021-11-12T05:43:53.788 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:43:53.788 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.789 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.789 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:43:53.789 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6827", 2021-11-12T05:43:53.789 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:43:53.790 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.790 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.790 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.790 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:43:53.790 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:43:53.791 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.791 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:43:53.791 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6830", 2021-11-12T05:43:53.791 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:43:53.792 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.792 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.792 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:43:53.792 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6831", 2021-11-12T05:43:53.792 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:43:53.793 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.793 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.793 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.793 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:43:53.794 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:43:53.794 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.794 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:43:53.794 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6828", 2021-11-12T05:43:53.794 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:43:53.795 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.795 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.795 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:43:53.795 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6829", 2021-11-12T05:43:53.796 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:43:53.796 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.796 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.796 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.796 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6825/15099", 2021-11-12T05:43:53.797 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6827/15099", 2021-11-12T05:43:53.797 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6831/15099", 2021-11-12T05:43:53.797 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6829/15099", 2021-11-12T05:43:53.797 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:43:53.797 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:43:53.798 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:43:53.798 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:43:53.798 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.798 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:43:53.799 INFO:teuthology.orchestra.run.gibba005.stdout: "osd_xinfo": [ 2021-11-12T05:43:53.799 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.799 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:43:53.799 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:43:53.799 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:43:53.800 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:43:53.800 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:43:53.800 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:43:53.800 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.615112+0000", 2021-11-12T05:43:53.801 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:43:53.801 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.801 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.801 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:43:53.801 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:43:53.802 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:43:53.802 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:43:53.802 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:43:53.802 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:43:53.803 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.665935+0000", 2021-11-12T05:43:53.803 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:43:53.803 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.803 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.803 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:43:53.804 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:43:53.804 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:43:53.804 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:43:53.804 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:43:53.804 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:43:53.805 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.715877+0000", 2021-11-12T05:43:53.805 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:43:53.805 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.805 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.806 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:43:53.806 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:43:53.806 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:43:53.806 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:43:53.806 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:43:53.807 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:43:53.807 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.489234+0000", 2021-11-12T05:43:53.807 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:43:53.807 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.808 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.808 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:43:53.808 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:43:53.808 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:43:53.808 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:43:53.809 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:43:53.809 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:43:53.809 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.413776+0000", 2021-11-12T05:43:53.809 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:43:53.809 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.810 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.810 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:43:53.810 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:43:53.810 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:43:53.811 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:43:53.811 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:43:53.811 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:43:53.811 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.507960+0000", 2021-11-12T05:43:53.811 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:43:53.812 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.812 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.812 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:43:53.812 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:43:53.812 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:43:53.813 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:43:53.813 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:43:53.813 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:43:53.813 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.635696+0000", 2021-11-12T05:43:53.814 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:43:53.814 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.814 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:43:53.814 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:43:53.814 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:43:53.815 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:43:53.815 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:43:53.815 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:43:53.815 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:43:53.816 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.746949+0000", 2021-11-12T05:43:53.816 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:43:53.816 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.816 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:43:53.816 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap": [], 2021-11-12T05:43:53.817 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap_items": [], 2021-11-12T05:43:53.817 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_temp": [], 2021-11-12T05:43:53.817 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_temp": [], 2021-11-12T05:43:53.817 INFO:teuthology.orchestra.run.gibba005.stdout: "blacklist": {}, 2021-11-12T05:43:53.818 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profiles": { 2021-11-12T05:43:53.818 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs_data": { 2021-11-12T05:43:53.818 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-device-class": "", 2021-11-12T05:43:53.818 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:43:53.818 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-root": "default", 2021-11-12T05:43:53.819 INFO:teuthology.orchestra.run.gibba005.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-12T05:43:53.819 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:43:53.819 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "2", 2021-11-12T05:43:53.819 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:43:53.819 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:43:53.820 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van", 2021-11-12T05:43:53.820 INFO:teuthology.orchestra.run.gibba005.stdout: "w": "8" 2021-11-12T05:43:53.820 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.820 INFO:teuthology.orchestra.run.gibba005.stdout: "default": { 2021-11-12T05:43:53.821 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:43:53.821 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:43:53.821 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "1", 2021-11-12T05:43:53.821 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:43:53.821 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:43:53.822 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van" 2021-11-12T05:43:53.822 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:43:53.822 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:43:53.822 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps_queue": [], 2021-11-12T05:43:53.823 INFO:teuthology.orchestra.run.gibba005.stdout: "new_removed_snaps": [], 2021-11-12T05:43:53.823 INFO:teuthology.orchestra.run.gibba005.stdout: "new_purged_snaps": [], 2021-11-12T05:43:53.823 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_node_flags": {}, 2021-11-12T05:43:53.823 INFO:teuthology.orchestra.run.gibba005.stdout: "device_class_flags": {} 2021-11-12T05:43:53.823 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:43:53.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.587+0000 7f27c0c0e700 1 -- 172.21.2.105:0/3150585982 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2798053580 msgr2=0x7f2798055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:53.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.587+0000 7f27c0c0e700 1 --2- 172.21.2.105:0/3150585982 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2798053580 0x7f2798055a40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f27ac000bc0 tx=0x7f27ac0011a0).stop 2021-11-12T05:43:53.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.587+0000 7f27c0c0e700 1 -- 172.21.2.105:0/3150585982 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f27bc0af750 msgr2=0x7f27bc148850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:53.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.587+0000 7f27c0c0e700 1 --2- 172.21.2.105:0/3150585982 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f27bc0af750 0x7f27bc148850 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f27b0002f70 tx=0x7f27b0006e90).stop 2021-11-12T05:43:53.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.587+0000 7f27c0c0e700 1 -- 172.21.2.105:0/3150585982 shutdown_connections 2021-11-12T05:43:53.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.587+0000 7f27c0c0e700 1 --2- 172.21.2.105:0/3150585982 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2798053580 0x7f2798055a40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:53.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.587+0000 7f27c0c0e700 1 --2- 172.21.2.105:0/3150585982 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f27bc130a80 0x7f27bc156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:53.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.587+0000 7f27c0c0e700 1 --2- 172.21.2.105:0/3150585982 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f27bc0af750 0x7f27bc148850 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:53.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.587+0000 7f27c0c0e700 1 --2- 172.21.2.105:0/3150585982 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f27bc0626b0 0x7f27bc14e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:53.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.587+0000 7f27c0c0e700 1 -- 172.21.2.105:0/3150585982 >> 172.21.2.105:0/3150585982 conn(0x7f27bc0b5320 msgr2=0x7f27bc0ad580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:43:53.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.587+0000 7f27c0c0e700 1 -- 172.21.2.105:0/3150585982 shutdown_connections 2021-11-12T05:43:53.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.587+0000 7f27c0c0e700 1 -- 172.21.2.105:0/3150585982 wait complete. 2021-11-12T05:43:53.829 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:43:53.884 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.879+0000 7f7b4388b700 1 Processor -- start 2021-11-12T05:43:53.884 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.879+0000 7f7b4388b700 1 -- start start 2021-11-12T05:43:53.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.879+0000 7f7b4388b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7b3c0ac280 0x7f7b3c14b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:53.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.879+0000 7f7b4388b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f7b3c0af730 0x7f7b3c0ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:53.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.879+0000 7f7b4388b700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b3c0ac7b0 con 0x7f7b3c0ad080 2021-11-12T05:43:53.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.879+0000 7f7b4388b700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b3c1488a0 con 0x7f7b3c0af730 2021-11-12T05:43:53.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.879+0000 7f7b4388b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3c0ac9e0 con 0x7f7b3c0ac280 2021-11-12T05:43:53.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.879+0000 7f7b41e28700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f7b3c0af730 0x7f7b3c0ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:53.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.879+0000 7f7b41627700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f7b3c0ad080 0x7f7b3c14abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:55836/0 (socket says 172.21.2.105:55836) 2021-11-12T05:43:53.891 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.879+0000 7f7b41627700 1 -- 172.21.2.105:0/596168967 learned_addr learned my addr 172.21.2.105:0/596168967 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:43:53.891 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.879+0000 7f7b41e28700 1 -- 172.21.2.105:0/596168967 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7b3c0ac280 msgr2=0x7f7b3c14b2f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:43:53.891 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.879+0000 7f7b41e28700 1 --2- 172.21.2.105:0/596168967 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7b3c0ac280 0x7f7b3c14b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:53.891 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.879+0000 7f7b41e28700 1 -- 172.21.2.105:0/596168967 >> v1:172.21.2.105:6789/0 conn(0x7f7b3c0ad080 legacy=0x7f7b3c14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:53.892 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.879+0000 7f7b41e28700 1 -- 172.21.2.105:0/596168967 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b3c0b0b30 con 0x7f7b3c0af730 2021-11-12T05:43:53.892 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.879+0000 7f7b2ffff700 1 -- 172.21.2.105:0/596168967 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3547113763 0 0) 0x7f7b3c0ac7b0 con 0x7f7b3c0ad080 2021-11-12T05:43:53.892 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.879+0000 7f7b41e28700 1 --2- 172.21.2.105:0/596168967 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7b3c0af730 0x7f7b3c0ad460 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f7b340032f0 tx=0x7f7b340091d0).ready entity=mon.0 client_cookie=47d4ad0198031736 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:53.892 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.879+0000 7f7b2ffff700 1 -- 172.21.2.105:0/596168967 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b34009ea0 con 0x7f7b3c0af730 2021-11-12T05:43:53.892 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.879+0000 7f7b2ffff700 1 -- 172.21.2.105:0/596168967 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3400b8a0 con 0x7f7b3c0af730 2021-11-12T05:43:53.893 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.879+0000 7f7b2ffff700 1 -- 172.21.2.105:0/596168967 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b3400ba10 con 0x7f7b3c0af730 2021-11-12T05:43:53.893 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.879+0000 7f7b4388b700 1 -- 172.21.2.105:0/596168967 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7b3c0af730 msgr2=0x7f7b3c0ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:53.893 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.879+0000 7f7b4388b700 1 --2- 172.21.2.105:0/596168967 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7b3c0af730 0x7f7b3c0ad460 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f7b340032f0 tx=0x7f7b340091d0).stop 2021-11-12T05:43:53.893 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.879+0000 7f7b4388b700 1 -- 172.21.2.105:0/596168967 shutdown_connections 2021-11-12T05:43:53.894 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.879+0000 7f7b4388b700 1 --2- 172.21.2.105:0/596168967 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7b3c0af730 0x7f7b3c0ad460 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:53.894 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.879+0000 7f7b4388b700 1 --2- 172.21.2.105:0/596168967 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7b3c0ac280 0x7f7b3c14b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:53.894 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.879+0000 7f7b4388b700 1 -- 172.21.2.105:0/596168967 >> 172.21.2.105:0/596168967 conn(0x7f7b3c0b5370 msgr2=0x7f7b3c0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:43:53.894 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.879+0000 7f7b4388b700 1 -- 172.21.2.105:0/596168967 shutdown_connections 2021-11-12T05:43:53.894 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.879+0000 7f7b4388b700 1 -- 172.21.2.105:0/596168967 wait complete. 2021-11-12T05:43:53.895 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.883+0000 7f7b4388b700 1 Processor -- start 2021-11-12T05:43:53.895 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.883+0000 7f7b4388b700 1 -- start start 2021-11-12T05:43:53.895 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.883+0000 7f7b4388b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7b3c0ac280 0x7f7b3c060040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:53.895 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.883+0000 7f7b4388b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7b3c0ad080 0x7f7b3c14bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:53.896 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.883+0000 7f7b4388b700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7b3c0af730 0x7f7b3c14c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:53.896 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.883+0000 7f7b4388b700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3c0aa0d0 con 0x7f7b3c0ad080 2021-11-12T05:43:53.896 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.883+0000 7f7b4388b700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3c14d560 con 0x7f7b3c0af730 2021-11-12T05:43:53.896 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.883+0000 7f7b4388b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3c060d40 con 0x7f7b3c0ac280 2021-11-12T05:43:53.896 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.883+0000 7f7b40e26700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7b3c0ad080 0x7f7b3c14bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:53.897 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.883+0000 7f7b40e26700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7b3c0ad080 0x7f7b3c14bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45450/0 (socket says 172.21.2.105:45450) 2021-11-12T05:43:53.897 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.883+0000 7f7b40e26700 1 -- 172.21.2.105:0/4040500133 learned_addr learned my addr 172.21.2.105:0/4040500133 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:43:53.897 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.883+0000 7f7b40e26700 1 -- 172.21.2.105:0/4040500133 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7b3c0ac280 msgr2=0x7f7b3c060040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:53.897 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.883+0000 7f7b41627700 1 --2- 172.21.2.105:0/4040500133 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7b3c0ac280 0x7f7b3c060040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:53.898 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.883+0000 7f7b40e26700 1 --2- 172.21.2.105:0/4040500133 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7b3c0ac280 0x7f7b3c060040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:53.898 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.883+0000 7f7b40e26700 1 -- 172.21.2.105:0/4040500133 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7b3c0af730 msgr2=0x7f7b3c14c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:53.898 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.883+0000 7f7b40e26700 1 --2- 172.21.2.105:0/4040500133 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7b3c0af730 0x7f7b3c14c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:53.898 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.883+0000 7f7b40e26700 1 -- 172.21.2.105:0/4040500133 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b34009470 con 0x7f7b3c0ad080 2021-11-12T05:43:53.898 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.883+0000 7f7b40e26700 1 --2- 172.21.2.105:0/4040500133 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7b3c0ad080 0x7f7b3c14bca0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f7b38002f70 tx=0x7f7b38006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:53.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.883+0000 7f7b2e7fc700 1 -- 172.21.2.105:0/4040500133 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b38013460 con 0x7f7b3c0ad080 2021-11-12T05:43:53.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.883+0000 7f7b2e7fc700 1 -- 172.21.2.105:0/4040500133 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b380135c0 con 0x7f7b3c0ad080 2021-11-12T05:43:53.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.883+0000 7f7b4388b700 1 -- 172.21.2.105:0/4040500133 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b3c14d790 con 0x7f7b3c0ad080 2021-11-12T05:43:53.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.883+0000 7f7b2e7fc700 1 -- 172.21.2.105:0/4040500133 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b38013920 con 0x7f7b3c0ad080 2021-11-12T05:43:53.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.883+0000 7f7b4388b700 1 -- 172.21.2.105:0/4040500133 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b3c14dcd0 con 0x7f7b3c0ad080 2021-11-12T05:43:53.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.883+0000 7f7b4388b700 1 -- 172.21.2.105:0/4040500133 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b3c14de90 con 0x7f7b3c0ad080 2021-11-12T05:43:53.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.883+0000 7f7b2e7fc700 1 -- 172.21.2.105:0/4040500133 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7b3801a060 con 0x7f7b3c0ad080 2021-11-12T05:43:53.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.883+0000 7f7b2e7fc700 1 --2- 172.21.2.105:0/4040500133 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7b1c0536d0 0x7f7b1c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:53.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.883+0000 7f7b2e7fc700 1 -- 172.21.2.105:0/4040500133 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f7b3806b490 con 0x7f7b3c0ad080 2021-11-12T05:43:53.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.883+0000 7f7b41627700 1 --2- 172.21.2.105:0/4040500133 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7b1c0536d0 0x7f7b1c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:53.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.883+0000 7f7b41627700 1 --2- 172.21.2.105:0/4040500133 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7b1c0536d0 0x7f7b1c055b90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f7b30008000 tx=0x7f7b30009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:53.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.887+0000 7f7b2e7fc700 1 -- 172.21.2.105:0/4040500133 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7b380424a0 con 0x7f7b3c0ad080 2021-11-12T05:43:53.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.995+0000 7f7b4388b700 1 -- 172.21.2.105:0/4040500133 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b3c057350 con 0x7f7b3c0ad080 2021-11-12T05:43:54.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.995+0000 7f7b2e7fc700 1 -- 172.21.2.105:0/4040500133 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+2138 (secure 0 0 0) 0x7f7b38018030 con 0x7f7b3c0ad080 2021-11-12T05:43:54.000 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:43:54.001 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":15,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4403,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/3185091424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":3185091424},{"type":"v1","addr":"172.21.2.115:6833","nonce":3185091424}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:42:27.265739+0000","modified":"2021-11-12T05:42:28.270769+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5250},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5250":{"gid":5250,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/3058129917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":3058129917},{"type":"v1","addr":"172.21.2.105:6835","nonce":3058129917}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-11-12T05:43:54.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.995+0000 7f7b4388b700 1 -- 172.21.2.105:0/4040500133 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7b1c0536d0 msgr2=0x7f7b1c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:54.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.995+0000 7f7b4388b700 1 --2- 172.21.2.105:0/4040500133 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7b1c0536d0 0x7f7b1c055b90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f7b30008000 tx=0x7f7b30009040).stop 2021-11-12T05:43:54.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.995+0000 7f7b4388b700 1 -- 172.21.2.105:0/4040500133 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7b3c0ad080 msgr2=0x7f7b3c14bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:54.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.995+0000 7f7b4388b700 1 --2- 172.21.2.105:0/4040500133 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7b3c0ad080 0x7f7b3c14bca0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f7b38002f70 tx=0x7f7b38006ec0).stop 2021-11-12T05:43:54.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.995+0000 7f7b4388b700 1 -- 172.21.2.105:0/4040500133 shutdown_connections 2021-11-12T05:43:54.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.995+0000 7f7b4388b700 1 --2- 172.21.2.105:0/4040500133 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7b1c0536d0 0x7f7b1c055b90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:54.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.995+0000 7f7b4388b700 1 --2- 172.21.2.105:0/4040500133 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7b3c0af730 0x7f7b3c14c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:54.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.995+0000 7f7b4388b700 1 --2- 172.21.2.105:0/4040500133 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7b3c0ad080 0x7f7b3c14bca0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:54.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.995+0000 7f7b4388b700 1 --2- 172.21.2.105:0/4040500133 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7b3c0ac280 0x7f7b3c060040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:54.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.995+0000 7f7b4388b700 1 -- 172.21.2.105:0/4040500133 >> 172.21.2.105:0/4040500133 conn(0x7f7b3c0b5370 msgr2=0x7f7b3c145b90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:43:54.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.995+0000 7f7b4388b700 1 -- 172.21.2.105:0/4040500133 shutdown_connections 2021-11-12T05:43:54.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:53.995+0000 7f7b4388b700 1 -- 172.21.2.105:0/4040500133 wait complete. 2021-11-12T05:43:54.005 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 15 2021-11-12T05:43:54.007 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-12T05:43:54.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f9162655700 1 Processor -- start 2021-11-12T05:43:54.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f9162655700 1 -- start start 2021-11-12T05:43:54.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f9162655700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f915c0b2d50 0x7f915c140550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:54.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f9162655700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f915c063a50 con 0x7f915c063670 2021-11-12T05:43:54.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f9162655700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f915c0b14e0 con 0x7f915c064df0 2021-11-12T05:43:54.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f9162655700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f915c0b0ab0 con 0x7f915c0b2d50 2021-11-12T05:43:54.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f9161653700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f915c063670 0x7f915c13fe40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:55850/0 (socket says 172.21.2.105:55850) 2021-11-12T05:43:54.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f9161653700 1 -- 172.21.2.105:0/2512153276 learned_addr learned my addr 172.21.2.105:0/2512153276 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:43:54.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f9161e54700 1 --2- 172.21.2.105:0/2512153276 >> v2:172.21.2.115:3300/0 conn(0x7f915c0b2d50 0x7f915c140550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:54.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f914ffff700 1 -- 172.21.2.105:0/2512153276 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4148006613 0 0) 0x7f915c063a50 con 0x7f915c063670 2021-11-12T05:43:54.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f914ffff700 1 -- 172.21.2.105:0/2512153276 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9144003260 con 0x7f915c063670 2021-11-12T05:43:54.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f914ffff700 1 -- 172.21.2.105:0/2512153276 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2636994282 0 0) 0x7f9144003260 con 0x7f915c063670 2021-11-12T05:43:54.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f914ffff700 1 -- 172.21.2.105:0/2512153276 >> v2:172.21.2.115:3300/0 conn(0x7f915c0b2d50 msgr2=0x7f915c140550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:43:54.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f914ffff700 1 --2- 172.21.2.105:0/2512153276 >> v2:172.21.2.115:3300/0 conn(0x7f915c0b2d50 0x7f915c140550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:54.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f914ffff700 1 -- 172.21.2.105:0/2512153276 >> v1:172.21.2.115:6789/0 conn(0x7f915c064df0 legacy=0x7f915c0b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:54.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f914ffff700 1 -- 172.21.2.105:0/2512153276 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f915c0600e0 con 0x7f915c063670 2021-11-12T05:43:54.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f914ffff700 1 -- 172.21.2.105:0/2512153276 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f9158001660 con 0x7f915c063670 2021-11-12T05:43:54.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f914ffff700 1 -- 172.21.2.105:0/2512153276 >> v1:172.21.2.105:6789/0 conn(0x7f915c063670 legacy=0x7f915c13fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:54.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f914ffff700 1 --2- 172.21.2.105:0/2512153276 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f91440037a0 0x7f9144003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:54.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f914ffff700 1 --2- 172.21.2.105:0/2512153276 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9144004500 0x7f9144004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:54.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f914ffff700 1 --2- 172.21.2.105:0/2512153276 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9144004e70 0x7f914400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:54.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f914ffff700 1 -- 172.21.2.105:0/2512153276 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914400bd70 con 0x7f9144004500 2021-11-12T05:43:54.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f914ffff700 1 -- 172.21.2.105:0/2512153276 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914400bee0 con 0x7f9144004e70 2021-11-12T05:43:54.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f914ffff700 1 -- 172.21.2.105:0/2512153276 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f914400c0a0 con 0x7f91440037a0 2021-11-12T05:43:54.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f9160e52700 1 --2- 172.21.2.105:0/2512153276 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9144004500 0x7f9144004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:54.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f9161e54700 1 --2- 172.21.2.105:0/2512153276 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9144004e70 0x7f914400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:54.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f9161653700 1 --2- 172.21.2.105:0/2512153276 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f91440037a0 0x7f9144003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:54.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f9160e52700 1 -- 172.21.2.105:0/2512153276 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f91440037a0 msgr2=0x7f9144003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:43:54.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f9160e52700 1 --2- 172.21.2.105:0/2512153276 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f91440037a0 0x7f9144003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:54.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f9160e52700 1 -- 172.21.2.105:0/2512153276 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9144004e70 msgr2=0x7f914400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:43:54.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f9160e52700 1 --2- 172.21.2.105:0/2512153276 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9144004e70 0x7f914400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:54.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f9160e52700 1 -- 172.21.2.105:0/2512153276 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9144003260 con 0x7f9144004500 2021-11-12T05:43:54.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f9161e54700 1 --2- 172.21.2.105:0/2512153276 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9144004e70 0x7f914400b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:43:54.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f9161e54700 1 -- 172.21.2.105:0/2512153276 reap_dead start 2021-11-12T05:43:54.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f9160e52700 1 --2- 172.21.2.105:0/2512153276 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9144004500 0x7f9144004980 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f915c063dd0 tx=0x7f9150007a00).ready entity=mon.0 client_cookie=7a1b706c5677ca5c server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:54.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f914ffff700 1 -- 172.21.2.105:0/2512153276 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9150007d10 con 0x7f9144004500 2021-11-12T05:43:54.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f914ffff700 1 -- 172.21.2.105:0/2512153276 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9150007030 con 0x7f9144004500 2021-11-12T05:43:54.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f914ffff700 1 -- 172.21.2.105:0/2512153276 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9150007390 con 0x7f9144004500 2021-11-12T05:43:54.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f9162655700 1 -- 172.21.2.105:0/2512153276 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9144004500 msgr2=0x7f9144004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:54.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f9162655700 1 --2- 172.21.2.105:0/2512153276 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9144004500 0x7f9144004980 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f915c063dd0 tx=0x7f9150007a00).stop 2021-11-12T05:43:54.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f9162655700 1 -- 172.21.2.105:0/2512153276 shutdown_connections 2021-11-12T05:43:54.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f9162655700 1 --2- 172.21.2.105:0/2512153276 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9144004500 0x7f9144004980 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:54.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f9162655700 1 -- 172.21.2.105:0/2512153276 >> 172.21.2.105:0/2512153276 conn(0x7f915c0613f0 msgr2=0x7f915c061800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:43:54.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f9162655700 1 -- 172.21.2.105:0/2512153276 shutdown_connections 2021-11-12T05:43:54.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f9162655700 1 -- 172.21.2.105:0/2512153276 wait complete. 2021-11-12T05:43:54.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f9162655700 1 Processor -- start 2021-11-12T05:43:54.074 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.055+0000 7f9162655700 1 -- start start 2021-11-12T05:43:54.074 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.059+0000 7f9162655700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9144004500 0x7f915c1455e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:54.074 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.059+0000 7f9162655700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f915c156b30 0x7f915c156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:54.074 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.059+0000 7f9162655700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f915c159d50 0x7f915c15a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:54.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.059+0000 7f9162655700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915c156780 con 0x7f915c159d50 2021-11-12T05:43:54.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.059+0000 7f9162655700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915c0ae640 con 0x7f9144004500 2021-11-12T05:43:54.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.059+0000 7f9162655700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f915c0ada30 con 0x7f915c156b30 2021-11-12T05:43:54.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.059+0000 7f9161e54700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f915c159d50 0x7f915c15a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:54.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.059+0000 7f9161e54700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f915c159d50 0x7f915c15a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45470/0 (socket says 172.21.2.105:45470) 2021-11-12T05:43:54.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.059+0000 7f9161e54700 1 -- 172.21.2.105:0/2603070066 learned_addr learned my addr 172.21.2.105:0/2603070066 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:43:54.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.059+0000 7f9160e52700 1 --2- 172.21.2.105:0/2603070066 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f915c156b30 0x7f915c156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:54.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.059+0000 7f9161653700 1 --2- 172.21.2.105:0/2603070066 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9144004500 0x7f915c1455e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:54.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.059+0000 7f9161e54700 1 -- 172.21.2.105:0/2603070066 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f915c156b30 msgr2=0x7f915c156f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:54.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.059+0000 7f9161e54700 1 --2- 172.21.2.105:0/2603070066 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f915c156b30 0x7f915c156f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:54.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.059+0000 7f9161e54700 1 -- 172.21.2.105:0/2603070066 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9144004500 msgr2=0x7f915c1455e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:54.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.059+0000 7f9161e54700 1 --2- 172.21.2.105:0/2603070066 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9144004500 0x7f915c1455e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:54.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.059+0000 7f9161e54700 1 -- 172.21.2.105:0/2603070066 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f915c0ad790 con 0x7f915c159d50 2021-11-12T05:43:54.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.059+0000 7f9161e54700 1 --2- 172.21.2.105:0/2603070066 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f915c159d50 0x7f915c15a1b0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f915400b000 tx=0x7f9154008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:54.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.059+0000 7f914e7fc700 1 -- 172.21.2.105:0/2603070066 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9154011ed0 con 0x7f915c159d50 2021-11-12T05:43:54.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.059+0000 7f914e7fc700 1 -- 172.21.2.105:0/2603070066 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9154013550 con 0x7f915c159d50 2021-11-12T05:43:54.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.059+0000 7f914e7fc700 1 -- 172.21.2.105:0/2603070066 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91540138b0 con 0x7f915c159d50 2021-11-12T05:43:54.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.059+0000 7f9162655700 1 -- 172.21.2.105:0/2603070066 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f915c0ae3a0 con 0x7f915c159d50 2021-11-12T05:43:54.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.059+0000 7f9162655700 1 -- 172.21.2.105:0/2603070066 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f915c0af320 con 0x7f915c159d50 2021-11-12T05:43:54.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.059+0000 7f9162655700 1 -- 172.21.2.105:0/2603070066 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f915c1568d0 con 0x7f915c159d50 2021-11-12T05:43:54.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.059+0000 7f914e7fc700 1 -- 172.21.2.105:0/2603070066 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f915401d030 con 0x7f915c159d50 2021-11-12T05:43:54.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.059+0000 7f914e7fc700 1 --2- 172.21.2.105:0/2603070066 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f913c0536f0 0x7f913c055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:54.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.059+0000 7f914e7fc700 1 -- 172.21.2.105:0/2603070066 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f915406bb10 con 0x7f915c159d50 2021-11-12T05:43:54.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.059+0000 7f9161653700 1 --2- 172.21.2.105:0/2603070066 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f913c0536f0 0x7f913c055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:54.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.059+0000 7f9161653700 1 --2- 172.21.2.105:0/2603070066 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f913c0536f0 0x7f913c055bb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f915800d000 tx=0x7f9158007040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:54.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.063+0000 7f914e7fc700 1 -- 172.21.2.105:0/2603070066 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9154042a10 con 0x7f915c159d50 2021-11-12T05:43:54.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:54.171+0000 7f9162655700 1 -- 172.21.2.105:0/2603070066 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f915c057350 con 0x7f915c159d50 2021-11-12T05:43:54.500 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:43:54.504 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:43:54.508 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:43:54.511 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:43:54.514 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:43:55.055 INFO:tasks.ceph.mon.a.gibba005.stderr:2021-11-12T05:43:55.051+0000 7fe9772b2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-12T05:43:55.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.059+0000 7f914e7fc700 1 -- 172.21.2.105:0/2603070066 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) v1 ==== 161+0+0 (secure 0 0 0) 0x7f915401b020 con 0x7f915c159d50 2021-11-12T05:43:55.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.063+0000 7f9162655700 1 -- 172.21.2.105:0/2603070066 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f913c0536f0 msgr2=0x7f913c055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:55.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.063+0000 7f9162655700 1 --2- 172.21.2.105:0/2603070066 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f913c0536f0 0x7f913c055bb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f915800d000 tx=0x7f9158007040).stop 2021-11-12T05:43:55.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.063+0000 7f9162655700 1 -- 172.21.2.105:0/2603070066 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f915c159d50 msgr2=0x7f915c15a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:55.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.063+0000 7f9162655700 1 --2- 172.21.2.105:0/2603070066 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f915c159d50 0x7f915c15a1b0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f915400b000 tx=0x7f9154008040).stop 2021-11-12T05:43:55.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.063+0000 7f9162655700 1 -- 172.21.2.105:0/2603070066 shutdown_connections 2021-11-12T05:43:55.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.063+0000 7f9162655700 1 --2- 172.21.2.105:0/2603070066 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f913c0536f0 0x7f913c055bb0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:55.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.063+0000 7f9162655700 1 --2- 172.21.2.105:0/2603070066 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f915c159d50 0x7f915c15a1b0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:55.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.063+0000 7f9162655700 1 --2- 172.21.2.105:0/2603070066 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f915c156b30 0x7f915c156f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:55.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.063+0000 7f9162655700 1 --2- 172.21.2.105:0/2603070066 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9144004500 0x7f915c1455e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:55.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.063+0000 7f9162655700 1 -- 172.21.2.105:0/2603070066 >> 172.21.2.105:0/2603070066 conn(0x7f915c0613f0 msgr2=0x7f915c0b3280 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:43:55.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.063+0000 7f9162655700 1 -- 172.21.2.105:0/2603070066 shutdown_connections 2021-11-12T05:43:55.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.063+0000 7f9162655700 1 -- 172.21.2.105:0/2603070066 wait complete. 2021-11-12T05:43:55.073 INFO:teuthology.orchestra.run.gibba005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-12T05:43:55.075 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:43:55.086 INFO:tasks.ceph.mds.a.gibba005.stdout:starting mds.a at 2021-11-12T05:43:55.129 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.123+0000 7fd9ddb3f700 1 Processor -- start 2021-11-12T05:43:55.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.123+0000 7fd9ddb3f700 1 -- start start 2021-11-12T05:43:55.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.123+0000 7fd9ddb3f700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd9d80b0cc0 0x7fd9d814a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:55.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.123+0000 7fd9ddb3f700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d80b2d20 con 0x7fd9d80b0780 2021-11-12T05:43:55.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.123+0000 7fd9ddb3f700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d80b1fc0 con 0x7fd9d80b2940 2021-11-12T05:43:55.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.123+0000 7fd9ddb3f700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d80b15e0 con 0x7fd9d80b0cc0 2021-11-12T05:43:55.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.123+0000 7fd9d7fff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd9d80b0cc0 0x7fd9d814a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:55.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.123+0000 7fd9d6ffd700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fd9d80b0780 0x7fd9d81434d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:55892/0 (socket says 172.21.2.105:55892) 2021-11-12T05:43:55.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.123+0000 7fd9d7fff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd9d80b0cc0 0x7fd9d814a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45492/0 (socket says 172.21.2.105:45492) 2021-11-12T05:43:55.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.123+0000 7fd9d6ffd700 1 -- 172.21.2.105:0/2144230750 learned_addr learned my addr 172.21.2.105:0/2144230750 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:43:55.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.123+0000 7fd9d7fff700 1 -- 172.21.2.105:0/2144230750 >> v1:172.21.2.115:6789/0 conn(0x7fd9d80b2940 legacy=0x7fd9d8142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:43:55.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.123+0000 7fd9d7fff700 1 -- 172.21.2.105:0/2144230750 >> v1:172.21.2.105:6789/0 conn(0x7fd9d80b0780 legacy=0x7fd9d81434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:55.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.123+0000 7fd9d67fc700 1 -- 172.21.2.105:0/2144230750 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3744574871 0 0) 0x7fd9d80b2d20 con 0x7fd9d80b0780 2021-11-12T05:43:55.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.123+0000 7fd9d7fff700 1 -- 172.21.2.105:0/2144230750 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d80b1880 con 0x7fd9d80b0cc0 2021-11-12T05:43:55.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9d7fff700 1 --2- 172.21.2.105:0/2144230750 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd9d80b0cc0 0x7fd9d814a330 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7fd9d80b2f60 tx=0x7fd9d000a370).ready entity=mon.0 client_cookie=b20cab39734aaef2 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:55.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9d67fc700 1 -- 172.21.2.105:0/2144230750 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9d000cc30 con 0x7fd9d80b0cc0 2021-11-12T05:43:55.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9d67fc700 1 -- 172.21.2.105:0/2144230750 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d000cd90 con 0x7fd9d80b0cc0 2021-11-12T05:43:55.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9d67fc700 1 -- 172.21.2.105:0/2144230750 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9d0010600 con 0x7fd9d80b0cc0 2021-11-12T05:43:55.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9ddb3f700 1 -- 172.21.2.105:0/2144230750 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd9d80b0cc0 msgr2=0x7fd9d814a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:55.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9ddb3f700 1 --2- 172.21.2.105:0/2144230750 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd9d80b0cc0 0x7fd9d814a330 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7fd9d80b2f60 tx=0x7fd9d000a370).stop 2021-11-12T05:43:55.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9ddb3f700 1 -- 172.21.2.105:0/2144230750 shutdown_connections 2021-11-12T05:43:55.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9ddb3f700 1 --2- 172.21.2.105:0/2144230750 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd9d80b0cc0 0x7fd9d814a330 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:55.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9ddb3f700 1 -- 172.21.2.105:0/2144230750 >> 172.21.2.105:0/2144230750 conn(0x7fd9d8068440 msgr2=0x7fd9d8062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:43:55.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9ddb3f700 1 -- 172.21.2.105:0/2144230750 shutdown_connections 2021-11-12T05:43:55.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9ddb3f700 1 -- 172.21.2.105:0/2144230750 wait complete. 2021-11-12T05:43:55.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9ddb3f700 1 Processor -- start 2021-11-12T05:43:55.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9ddb3f700 1 -- start start 2021-11-12T05:43:55.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9ddb3f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd9d80b0780 0x7fd9d80649f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:55.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9ddb3f700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd9d80b0cc0 0x7fd9d81544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:55.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9ddb3f700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd9d80b2940 0x7fd9d8142640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:55.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9ddb3f700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d80a0360 con 0x7fd9d80b2940 2021-11-12T05:43:55.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9ddb3f700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d8153db0 con 0x7fd9d80b0cc0 2021-11-12T05:43:55.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9ddb3f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d8154050 con 0x7fd9d80b0780 2021-11-12T05:43:55.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9d7fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd9d80b2940 0x7fd9d8142640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:55.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9d7fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd9d80b2940 0x7fd9d8142640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45500/0 (socket says 172.21.2.105:45500) 2021-11-12T05:43:55.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9d7fff700 1 -- 172.21.2.105:0/3060186727 learned_addr learned my addr 172.21.2.105:0/3060186727 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:43:55.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9d7fff700 1 -- 172.21.2.105:0/3060186727 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd9d80b0780 msgr2=0x7fd9d80649f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:55.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9d7fff700 1 --2- 172.21.2.105:0/3060186727 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd9d80b0780 0x7fd9d80649f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:55.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9d7fff700 1 -- 172.21.2.105:0/3060186727 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd9d80b0cc0 msgr2=0x7fd9d81544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:55.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9d7fff700 1 --2- 172.21.2.105:0/3060186727 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd9d80b0cc0 0x7fd9d81544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:55.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9d7fff700 1 -- 172.21.2.105:0/3060186727 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d000a610 con 0x7fd9d80b2940 2021-11-12T05:43:55.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9d7fff700 1 --2- 172.21.2.105:0/3060186727 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd9d80b2940 0x7fd9d8142640 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7fd9d80b2f60 tx=0x7fd9d80606c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:55.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9d4ff9700 1 -- 172.21.2.105:0/3060186727 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9d001a650 con 0x7fd9d80b2940 2021-11-12T05:43:55.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9d4ff9700 1 -- 172.21.2.105:0/3060186727 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d001a7b0 con 0x7fd9d80b2940 2021-11-12T05:43:55.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9d4ff9700 1 -- 172.21.2.105:0/3060186727 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9d001ab10 con 0x7fd9d80b2940 2021-11-12T05:43:55.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9ddb3f700 1 -- 172.21.2.105:0/3060186727 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d8063d60 con 0x7fd9d80b2940 2021-11-12T05:43:55.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9ddb3f700 1 -- 172.21.2.105:0/3060186727 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d81549e0 con 0x7fd9d80b2940 2021-11-12T05:43:55.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9ddb3f700 1 -- 172.21.2.105:0/3060186727 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9d8154210 con 0x7fd9d80b2940 2021-11-12T05:43:55.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9d4ff9700 1 -- 172.21.2.105:0/3060186727 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd9d002a070 con 0x7fd9d80b2940 2021-11-12T05:43:55.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9d4ff9700 1 --2- 172.21.2.105:0/3060186727 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd9bc053540 0x7fd9bc055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:55.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9d4ff9700 1 -- 172.21.2.105:0/3060186727 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6502+0+0 (secure 0 0 0) 0x7fd9d006dad0 con 0x7fd9d80b2940 2021-11-12T05:43:55.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9d77fe700 1 --2- 172.21.2.105:0/3060186727 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd9bc053540 0x7fd9bc055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:55.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.127+0000 7fd9d77fe700 1 --2- 172.21.2.105:0/3060186727 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd9bc053540 0x7fd9bc055a00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fd9c8002ef0 tx=0x7fd9c8006910).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:55.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.131+0000 7fd9d4ff9700 1 -- 172.21.2.105:0/3060186727 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd9d0044970 con 0x7fd9d80b2940 2021-11-12T05:43:55.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.243+0000 7fd9ddb3f700 1 -- 172.21.2.105:0/3060186727 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9d8057350 con 0x7fd9d80b2940 2021-11-12T05:43:55.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.243+0000 7fd9d4ff9700 1 -- 172.21.2.105:0/3060186727 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+1777 (secure 0 0 0) 0x7fd9d0047f90 con 0x7fd9d80b2940 2021-11-12T05:43:55.248 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:43:55.248 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4403,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/3185091424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":3185091424},{"type":"v1","addr":"172.21.2.115:6833","nonce":3185091424}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:42:27.265739+0000","modified":"2021-11-12T05:43:55.055398+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-11-12T05:43:55.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.243+0000 7fd9ddb3f700 1 -- 172.21.2.105:0/3060186727 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd9bc053540 msgr2=0x7fd9bc055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:55.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.243+0000 7fd9ddb3f700 1 --2- 172.21.2.105:0/3060186727 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd9bc053540 0x7fd9bc055a00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fd9c8002ef0 tx=0x7fd9c8006910).stop 2021-11-12T05:43:55.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.243+0000 7fd9ddb3f700 1 -- 172.21.2.105:0/3060186727 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd9d80b2940 msgr2=0x7fd9d8142640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:55.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.243+0000 7fd9ddb3f700 1 --2- 172.21.2.105:0/3060186727 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd9d80b2940 0x7fd9d8142640 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7fd9d80b2f60 tx=0x7fd9d80606c0).stop 2021-11-12T05:43:55.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.243+0000 7fd9ddb3f700 1 -- 172.21.2.105:0/3060186727 shutdown_connections 2021-11-12T05:43:55.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.243+0000 7fd9ddb3f700 1 --2- 172.21.2.105:0/3060186727 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd9bc053540 0x7fd9bc055a00 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:55.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.243+0000 7fd9ddb3f700 1 --2- 172.21.2.105:0/3060186727 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd9d80b2940 0x7fd9d8142640 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:55.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.243+0000 7fd9ddb3f700 1 --2- 172.21.2.105:0/3060186727 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd9d80b0cc0 0x7fd9d81544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:55.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.243+0000 7fd9ddb3f700 1 --2- 172.21.2.105:0/3060186727 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd9d80b0780 0x7fd9d80649f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:55.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.243+0000 7fd9ddb3f700 1 -- 172.21.2.105:0/3060186727 >> 172.21.2.105:0/3060186727 conn(0x7fd9d8068440 msgr2=0x7fd9d813f830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:43:55.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.243+0000 7fd9ddb3f700 1 -- 172.21.2.105:0/3060186727 shutdown_connections 2021-11-12T05:43:55.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.243+0000 7fd9ddb3f700 1 -- 172.21.2.105:0/3060186727 wait complete. 2021-11-12T05:43:55.252 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 16 2021-11-12T05:43:55.254 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-12T05:43:55.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.303+0000 7fe26555e700 1 Processor -- start 2021-11-12T05:43:55.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.303+0000 7fe26555e700 1 -- start start 2021-11-12T05:43:55.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.303+0000 7fe26555e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe2600b2cc0 0x7fe2600b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:55.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.303+0000 7fe26555e700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fe260143da0 0x7fe260140240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:55.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.303+0000 7fe26555e700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2600aa0b0 con 0x7fe2600b2290 2021-11-12T05:43:55.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.303+0000 7fe26555e700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2600a9b70 con 0x7fe260143da0 2021-11-12T05:43:55.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.303+0000 7fe26555e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2600a9e10 con 0x7fe2600b2cc0 2021-11-12T05:43:55.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.303+0000 7fe25effd700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe2600b2cc0 0x7fe2600b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:55.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.303+0000 7fe25effd700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe2600b2cc0 0x7fe2600b30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3301/0 says I am v2:172.21.2.105:36696/0 (socket says 172.21.2.105:36696) 2021-11-12T05:43:55.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.303+0000 7fe25effd700 1 -- 172.21.2.105:0/4229082544 learned_addr learned my addr 172.21.2.105:0/4229082544 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:43:55.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.303+0000 7fe25f7fe700 1 --2- 172.21.2.105:0/4229082544 >> v2:172.21.2.115:3300/0 conn(0x7fe260143da0 0x7fe260140240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:55.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.303+0000 7fe25e7fc700 1 --1- 172.21.2.105:0/4229082544 >> v1:172.21.2.115:6789/0 conn(0x7fe2600b2290 0x7fe260143690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:54374/0 (socket says 172.21.2.105:54374) 2021-11-12T05:43:55.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.303+0000 7fe25effd700 1 -- 172.21.2.105:0/4229082544 >> v2:172.21.2.115:3300/0 conn(0x7fe260143da0 msgr2=0x7fe260140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:43:55.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.303+0000 7fe25effd700 1 --2- 172.21.2.105:0/4229082544 >> v2:172.21.2.115:3300/0 conn(0x7fe260143da0 0x7fe260140240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:55.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.303+0000 7fe25effd700 1 -- 172.21.2.105:0/4229082544 >> v1:172.21.2.115:6789/0 conn(0x7fe2600b2290 legacy=0x7fe260143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:55.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.303+0000 7fe25effd700 1 -- 172.21.2.105:0/4229082544 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2600b0800 con 0x7fe2600b2cc0 2021-11-12T05:43:55.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.303+0000 7fe25effd700 1 --2- 172.21.2.105:0/4229082544 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe2600b2cc0 0x7fe2600b30a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fe248002f70 tx=0x7fe248006eb0).ready entity=mon.2 client_cookie=6a7b23754abed449 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:55.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe25dffb700 1 -- 172.21.2.105:0/4229082544 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe24800d570 con 0x7fe2600b2cc0 2021-11-12T05:43:55.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe25dffb700 1 -- 172.21.2.105:0/4229082544 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe248000e90 con 0x7fe2600b2cc0 2021-11-12T05:43:55.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe25dffb700 1 -- 172.21.2.105:0/4229082544 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe24800d900 con 0x7fe2600b2cc0 2021-11-12T05:43:55.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe26555e700 1 -- 172.21.2.105:0/4229082544 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe2600b2cc0 msgr2=0x7fe2600b30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:55.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe26555e700 1 --2- 172.21.2.105:0/4229082544 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe2600b2cc0 0x7fe2600b30a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fe248002f70 tx=0x7fe248006eb0).stop 2021-11-12T05:43:55.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe26555e700 1 -- 172.21.2.105:0/4229082544 shutdown_connections 2021-11-12T05:43:55.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe26555e700 1 --2- 172.21.2.105:0/4229082544 >> v2:172.21.2.115:3300/0 conn(0x7fe260143da0 0x7fe260140240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:55.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe26555e700 1 --2- 172.21.2.105:0/4229082544 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe2600b2cc0 0x7fe2600b30a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:55.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe26555e700 1 -- 172.21.2.105:0/4229082544 >> 172.21.2.105:0/4229082544 conn(0x7fe26005c490 msgr2=0x7fe26005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:43:55.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe26555e700 1 -- 172.21.2.105:0/4229082544 shutdown_connections 2021-11-12T05:43:55.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe26555e700 1 -- 172.21.2.105:0/4229082544 wait complete. 2021-11-12T05:43:55.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe26555e700 1 Processor -- start 2021-11-12T05:43:55.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe26555e700 1 -- start start 2021-11-12T05:43:55.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe26555e700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe2600b2290 0x7fe2600b5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:55.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe26555e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2600b2cc0 0x7fe26009fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:55.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe26555e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe260143da0 0x7fe260066110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:55.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe26555e700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe260065ce0 con 0x7fe2600b2cc0 2021-11-12T05:43:55.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe26555e700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe260150ce0 con 0x7fe2600b2290 2021-11-12T05:43:55.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe26555e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe260066fb0 con 0x7fe260143da0 2021-11-12T05:43:55.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe25e7fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2600b2cc0 0x7fe26009fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:55.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe25e7fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2600b2cc0 0x7fe26009fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45516/0 (socket says 172.21.2.105:45516) 2021-11-12T05:43:55.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe25e7fc700 1 -- 172.21.2.105:0/2060024223 learned_addr learned my addr 172.21.2.105:0/2060024223 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:43:55.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe25effd700 1 --2- 172.21.2.105:0/2060024223 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe2600b2290 0x7fe2600b5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:55.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe25e7fc700 1 -- 172.21.2.105:0/2060024223 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe260143da0 msgr2=0x7fe260066110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:55.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe25e7fc700 1 --2- 172.21.2.105:0/2060024223 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe260143da0 0x7fe260066110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:55.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe25e7fc700 1 -- 172.21.2.105:0/2060024223 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe2600b2290 msgr2=0x7fe2600b5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:55.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe25e7fc700 1 --2- 172.21.2.105:0/2060024223 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe2600b2290 0x7fe2600b5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:55.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe25e7fc700 1 -- 172.21.2.105:0/2060024223 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe24800b1e0 con 0x7fe2600b2cc0 2021-11-12T05:43:55.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe25e7fc700 1 --2- 172.21.2.105:0/2060024223 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2600b2cc0 0x7fe26009fce0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7fe2600afc20 tx=0x7fe250007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:55.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe257fff700 1 -- 172.21.2.105:0/2060024223 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe25000ce30 con 0x7fe2600b2cc0 2021-11-12T05:43:55.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe257fff700 1 -- 172.21.2.105:0/2060024223 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2500072e0 con 0x7fe2600b2cc0 2021-11-12T05:43:55.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe26555e700 1 -- 172.21.2.105:0/2060024223 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe260067250 con 0x7fe2600b2cc0 2021-11-12T05:43:55.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe257fff700 1 -- 172.21.2.105:0/2060024223 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe250007450 con 0x7fe2600b2cc0 2021-11-12T05:43:55.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe26555e700 1 -- 172.21.2.105:0/2060024223 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2600a0370 con 0x7fe2600b2cc0 2021-11-12T05:43:55.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe26555e700 1 -- 172.21.2.105:0/2060024223 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe260065e50 con 0x7fe2600b2cc0 2021-11-12T05:43:55.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe257fff700 1 -- 172.21.2.105:0/2060024223 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe250010070 con 0x7fe2600b2cc0 2021-11-12T05:43:55.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe257fff700 1 --2- 172.21.2.105:0/2060024223 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe244053580 0x7fe244055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:55.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe257fff700 1 -- 172.21.2.105:0/2060024223 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6502+0+0 (secure 0 0 0) 0x7fe25006b1f0 con 0x7fe2600b2cc0 2021-11-12T05:43:55.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.307+0000 7fe25effd700 1 --2- 172.21.2.105:0/2060024223 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe244053580 0x7fe244055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:55.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.311+0000 7fe25effd700 1 --2- 172.21.2.105:0/2060024223 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe244053580 0x7fe244055a40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7fe24801a000 tx=0x7fe248015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:55.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.311+0000 7fe257fff700 1 -- 172.21.2.105:0/2060024223 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe260065e50 con 0x7fe2600b2cc0 2021-11-12T05:43:55.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:55.419+0000 7fe26555e700 1 -- 172.21.2.105:0/2060024223 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe260065e20 con 0x7fe2600b2cc0 2021-11-12T05:43:56.074 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.067+0000 7fe257fff700 1 -- 172.21.2.105:0/2060024223 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe2500421a0 con 0x7fe2600b2cc0 2021-11-12T05:43:56.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.071+0000 7fe26555e700 1 -- 172.21.2.105:0/2060024223 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe244053580 msgr2=0x7fe244055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:56.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.071+0000 7fe26555e700 1 --2- 172.21.2.105:0/2060024223 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe244053580 0x7fe244055a40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7fe24801a000 tx=0x7fe248015000).stop 2021-11-12T05:43:56.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.071+0000 7fe26555e700 1 -- 172.21.2.105:0/2060024223 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2600b2cc0 msgr2=0x7fe26009fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:56.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.071+0000 7fe26555e700 1 --2- 172.21.2.105:0/2060024223 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2600b2cc0 0x7fe26009fce0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7fe2600afc20 tx=0x7fe250007c40).stop 2021-11-12T05:43:56.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.071+0000 7fe26555e700 1 -- 172.21.2.105:0/2060024223 shutdown_connections 2021-11-12T05:43:56.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.071+0000 7fe26555e700 1 --2- 172.21.2.105:0/2060024223 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe244053580 0x7fe244055a40 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:56.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.071+0000 7fe26555e700 1 --2- 172.21.2.105:0/2060024223 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe260143da0 0x7fe260066110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:56.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.071+0000 7fe26555e700 1 --2- 172.21.2.105:0/2060024223 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2600b2cc0 0x7fe26009fce0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:56.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.071+0000 7fe26555e700 1 --2- 172.21.2.105:0/2060024223 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe2600b2290 0x7fe2600b5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:56.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.071+0000 7fe26555e700 1 -- 172.21.2.105:0/2060024223 >> 172.21.2.105:0/2060024223 conn(0x7fe26005c490 msgr2=0x7fe2600b30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:43:56.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.071+0000 7fe26555e700 1 -- 172.21.2.105:0/2060024223 shutdown_connections 2021-11-12T05:43:56.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.071+0000 7fe26555e700 1 -- 172.21.2.105:0/2060024223 wait complete. 2021-11-12T05:43:56.082 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-12T05:43:56.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.131+0000 7fc794f60700 1 Processor -- start 2021-11-12T05:43:56.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.131+0000 7fc794f60700 1 -- start start 2021-11-12T05:43:56.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.131+0000 7fc794f60700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fc7900ad080 0x7fc7900af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:56.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.131+0000 7fc794f60700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fc7900ac280 0x7fc7900ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:56.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.131+0000 7fc794f60700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7900ac7b0 con 0x7fc79014abe0 2021-11-12T05:43:56.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.131+0000 7fc794f60700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7901488a0 con 0x7fc7900ac280 2021-11-12T05:43:56.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.131+0000 7fc794f60700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7900ac9e0 con 0x7fc7900ad080 2021-11-12T05:43:56.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.131+0000 7fc78dd9b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fc7900ac280 0x7fc7900ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:56.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.131+0000 7fc78dd9b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fc7900ac280 0x7fc7900ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45526/0 (socket says 172.21.2.105:45526) 2021-11-12T05:43:56.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.131+0000 7fc78dd9b700 1 -- 172.21.2.105:0/3189059407 learned_addr learned my addr 172.21.2.105:0/3189059407 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:43:56.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.131+0000 7fc78dd9b700 1 -- 172.21.2.105:0/3189059407 >> v2:172.21.2.115:3300/0 conn(0x7fc7900ad080 msgr2=0x7fc7900af730 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:43:56.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.131+0000 7fc78dd9b700 1 --2- 172.21.2.105:0/3189059407 >> v2:172.21.2.115:3300/0 conn(0x7fc7900ad080 0x7fc7900af730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:56.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.131+0000 7fc78dd9b700 1 -- 172.21.2.105:0/3189059407 >> v1:172.21.2.115:6789/0 conn(0x7fc79014abe0 legacy=0x7fc79014b090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:43:56.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.131+0000 7fc78dd9b700 1 -- 172.21.2.105:0/3189059407 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7900b0b30 con 0x7fc7900ac280 2021-11-12T05:43:56.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.131+0000 7fc78dd9b700 1 --2- 172.21.2.105:0/3189059407 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc7900ac280 0x7fc7900ad460 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7fc79014bc40 tx=0x7fc780006eb0).ready entity=mon.0 client_cookie=9cfd81d59aba7670 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:56.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.131+0000 7fc78d59a700 1 -- 172.21.2.105:0/3189059407 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc78000d5c0 con 0x7fc7900ac280 2021-11-12T05:43:56.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.131+0000 7fc78d59a700 1 -- 172.21.2.105:0/3189059407 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc780000e90 con 0x7fc7900ac280 2021-11-12T05:43:56.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.131+0000 7fc78d59a700 1 -- 172.21.2.105:0/3189059407 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc78000d910 con 0x7fc7900ac280 2021-11-12T05:43:56.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.131+0000 7fc794f60700 1 -- 172.21.2.105:0/3189059407 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc7900ac280 msgr2=0x7fc7900ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:56.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.131+0000 7fc794f60700 1 --2- 172.21.2.105:0/3189059407 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc7900ac280 0x7fc7900ad460 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7fc79014bc40 tx=0x7fc780006eb0).stop 2021-11-12T05:43:56.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.131+0000 7fc794f60700 1 -- 172.21.2.105:0/3189059407 shutdown_connections 2021-11-12T05:43:56.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.131+0000 7fc794f60700 1 --2- 172.21.2.105:0/3189059407 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc7900ac280 0x7fc7900ad460 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:56.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.131+0000 7fc794f60700 1 --2- 172.21.2.105:0/3189059407 >> v2:172.21.2.115:3300/0 conn(0x7fc7900ad080 0x7fc7900af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:56.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.131+0000 7fc794f60700 1 -- 172.21.2.105:0/3189059407 >> 172.21.2.105:0/3189059407 conn(0x7fc7900b5370 msgr2=0x7fc7900b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:43:56.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.131+0000 7fc794f60700 1 -- 172.21.2.105:0/3189059407 shutdown_connections 2021-11-12T05:43:56.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.131+0000 7fc794f60700 1 -- 172.21.2.105:0/3189059407 wait complete. 2021-11-12T05:43:56.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.135+0000 7fc794f60700 1 Processor -- start 2021-11-12T05:43:56.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.135+0000 7fc794f60700 1 -- start start 2021-11-12T05:43:56.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.135+0000 7fc794f60700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc7900ac280 0x7fc790154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:56.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.135+0000 7fc794f60700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc7900ad080 0x7fc7900a8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:56.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.135+0000 7fc794f60700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc79014abe0 0x7fc7900aac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:56.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.135+0000 7fc794f60700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7900a7220 con 0x7fc7900ad080 2021-11-12T05:43:56.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.135+0000 7fc794f60700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7901577e0 con 0x7fc79014abe0 2021-11-12T05:43:56.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.135+0000 7fc794f60700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc790157a80 con 0x7fc7900ac280 2021-11-12T05:43:56.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.135+0000 7fc78dd9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc7900ad080 0x7fc7900a8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:56.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.135+0000 7fc78dd9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc7900ad080 0x7fc7900a8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45532/0 (socket says 172.21.2.105:45532) 2021-11-12T05:43:56.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.135+0000 7fc78dd9b700 1 -- 172.21.2.105:0/2177714135 learned_addr learned my addr 172.21.2.105:0/2177714135 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:43:56.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.135+0000 7fc78dd9b700 1 -- 172.21.2.105:0/2177714135 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc7900ac280 msgr2=0x7fc790154170 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:43:56.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.135+0000 7fc78dd9b700 1 --2- 172.21.2.105:0/2177714135 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc7900ac280 0x7fc790154170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:56.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.135+0000 7fc78dd9b700 1 -- 172.21.2.105:0/2177714135 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc79014abe0 msgr2=0x7fc7900aac60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:43:56.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.135+0000 7fc78dd9b700 1 --2- 172.21.2.105:0/2177714135 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc79014abe0 0x7fc7900aac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:56.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.135+0000 7fc78dd9b700 1 -- 172.21.2.105:0/2177714135 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc78000b1e0 con 0x7fc7900ad080 2021-11-12T05:43:56.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.135+0000 7fc78dd9b700 1 --2- 172.21.2.105:0/2177714135 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc7900ad080 0x7fc7900a8c80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7fc79014bc40 tx=0x7fc780015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:56.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.135+0000 7fc7877fe700 1 -- 172.21.2.105:0/2177714135 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc780002f70 con 0x7fc7900ad080 2021-11-12T05:43:56.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.135+0000 7fc7877fe700 1 -- 172.21.2.105:0/2177714135 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78000de70 con 0x7fc7900ad080 2021-11-12T05:43:56.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.135+0000 7fc794f60700 1 -- 172.21.2.105:0/2177714135 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc790154660 con 0x7fc7900ad080 2021-11-12T05:43:56.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.135+0000 7fc794f60700 1 -- 172.21.2.105:0/2177714135 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc790142da0 con 0x7fc7900ad080 2021-11-12T05:43:56.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.135+0000 7fc7877fe700 1 -- 172.21.2.105:0/2177714135 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc78001e460 con 0x7fc7900ad080 2021-11-12T05:43:56.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.135+0000 7fc794f60700 1 -- 172.21.2.105:0/2177714135 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7900b1440 con 0x7fc7900ad080 2021-11-12T05:43:56.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.135+0000 7fc7877fe700 1 -- 172.21.2.105:0/2177714135 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc780025030 con 0x7fc7900ad080 2021-11-12T05:43:56.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.135+0000 7fc7877fe700 1 --2- 172.21.2.105:0/2177714135 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc7740536f0 0x7fc774055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:56.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.135+0000 7fc7877fe700 1 -- 172.21.2.105:0/2177714135 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6502+0+0 (secure 0 0 0) 0x7fc78006d110 con 0x7fc7900ad080 2021-11-12T05:43:56.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.135+0000 7fc78e59c700 1 --2- 172.21.2.105:0/2177714135 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc7740536f0 0x7fc774055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:56.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.135+0000 7fc78e59c700 1 --2- 172.21.2.105:0/2177714135 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc7740536f0 0x7fc774055bb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fc778002fb0 tx=0x7fc778006930).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:56.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.139+0000 7fc7877fe700 1 -- 172.21.2.105:0/2177714135 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc780043fb0 con 0x7fc7900ad080 2021-11-12T05:43:56.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:56.223+0000 7fc794f60700 1 -- 172.21.2.105:0/2177714135 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc790057350 con 0x7fc7900ad080 2021-11-12T05:43:57.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.087+0000 7fc7877fe700 1 -- 172.21.2.105:0/2177714135 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v47) v1 ==== 185+0+0 (secure 0 0 0) 0x7fc7800230e0 con 0x7fc7900ad080 2021-11-12T05:43:57.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.087+0000 7fc794f60700 1 -- 172.21.2.105:0/2177714135 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc7740536f0 msgr2=0x7fc774055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:57.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.087+0000 7fc794f60700 1 --2- 172.21.2.105:0/2177714135 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc7740536f0 0x7fc774055bb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fc778002fb0 tx=0x7fc778006930).stop 2021-11-12T05:43:57.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.087+0000 7fc794f60700 1 -- 172.21.2.105:0/2177714135 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc7900ad080 msgr2=0x7fc7900a8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:57.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.087+0000 7fc794f60700 1 --2- 172.21.2.105:0/2177714135 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc7900ad080 0x7fc7900a8c80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7fc79014bc40 tx=0x7fc780015000).stop 2021-11-12T05:43:57.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.087+0000 7fc794f60700 1 -- 172.21.2.105:0/2177714135 shutdown_connections 2021-11-12T05:43:57.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.087+0000 7fc794f60700 1 --2- 172.21.2.105:0/2177714135 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc7740536f0 0x7fc774055bb0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:57.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.087+0000 7fc794f60700 1 --2- 172.21.2.105:0/2177714135 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc79014abe0 0x7fc7900aac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:57.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.087+0000 7fc794f60700 1 --2- 172.21.2.105:0/2177714135 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc7900ad080 0x7fc7900a8c80 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:57.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.087+0000 7fc794f60700 1 --2- 172.21.2.105:0/2177714135 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc7900ac280 0x7fc790154170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:57.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.087+0000 7fc794f60700 1 -- 172.21.2.105:0/2177714135 >> 172.21.2.105:0/2177714135 conn(0x7fc7900b5370 msgr2=0x7fc79014b070 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:43:57.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.087+0000 7fc794f60700 1 -- 172.21.2.105:0/2177714135 shutdown_connections 2021-11-12T05:43:57.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.087+0000 7fc794f60700 1 -- 172.21.2.105:0/2177714135 wait complete. 2021-11-12T05:43:57.097 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_metadata' removed 2021-11-12T05:43:57.101 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-12T05:43:57.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.151+0000 7fec9cce0700 1 Processor -- start 2021-11-12T05:43:57.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.151+0000 7fec9cce0700 1 -- start start 2021-11-12T05:43:57.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.151+0000 7fec9cce0700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fec980ad080 0x7fec980af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:57.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.151+0000 7fec9cce0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fec980ac280 0x7fec980ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:57.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.151+0000 7fec9cce0700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec980ac7b0 con 0x7fec9814abe0 2021-11-12T05:43:57.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.151+0000 7fec9cce0700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec981488a0 con 0x7fec980ad080 2021-11-12T05:43:57.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.151+0000 7fec9cce0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec980ac9e0 con 0x7fec980ac280 2021-11-12T05:43:57.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.151+0000 7fec9659c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fec980ad080 0x7fec980af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:57.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.151+0000 7fec9659c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fec980ad080 0x7fec980af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45538/0 (socket says 172.21.2.105:45538) 2021-11-12T05:43:57.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.151+0000 7fec9659c700 1 -- 172.21.2.105:0/3171625012 learned_addr learned my addr 172.21.2.105:0/3171625012 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:43:57.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.151+0000 7fec9659c700 1 -- 172.21.2.105:0/3171625012 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fec980ac280 msgr2=0x7fec980ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:43:57.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.151+0000 7fec9659c700 1 --2- 172.21.2.105:0/3171625012 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fec980ac280 0x7fec980ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:57.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.151+0000 7fec9659c700 1 -- 172.21.2.105:0/3171625012 >> v1:172.21.2.115:6789/0 conn(0x7fec9814abe0 legacy=0x7fec9814b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:43:57.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.151+0000 7fec9659c700 1 -- 172.21.2.105:0/3171625012 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec980b0b30 con 0x7fec980ad080 2021-11-12T05:43:57.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.151+0000 7fec9659c700 1 --2- 172.21.2.105:0/3171625012 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fec980ad080 0x7fec980af730 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7fec980b6060 tx=0x7fec80006eb0).ready entity=mon.0 client_cookie=3ddbf3b46f4a926d server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:57.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.151+0000 7fec9559a700 1 -- 172.21.2.105:0/3171625012 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec8000d570 con 0x7fec980ad080 2021-11-12T05:43:57.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.151+0000 7fec9559a700 1 -- 172.21.2.105:0/3171625012 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec80000e90 con 0x7fec980ad080 2021-11-12T05:43:57.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.151+0000 7fec9559a700 1 -- 172.21.2.105:0/3171625012 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec8000d8c0 con 0x7fec980ad080 2021-11-12T05:43:57.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.151+0000 7fec9cce0700 1 -- 172.21.2.105:0/3171625012 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fec980ad080 msgr2=0x7fec980af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:57.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.151+0000 7fec9cce0700 1 --2- 172.21.2.105:0/3171625012 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fec980ad080 0x7fec980af730 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7fec980b6060 tx=0x7fec80006eb0).stop 2021-11-12T05:43:57.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.151+0000 7fec9cce0700 1 -- 172.21.2.105:0/3171625012 shutdown_connections 2021-11-12T05:43:57.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.151+0000 7fec9cce0700 1 --2- 172.21.2.105:0/3171625012 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fec980ac280 0x7fec980ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:57.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.151+0000 7fec9cce0700 1 --2- 172.21.2.105:0/3171625012 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fec980ad080 0x7fec980af730 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:57.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.151+0000 7fec9cce0700 1 -- 172.21.2.105:0/3171625012 >> 172.21.2.105:0/3171625012 conn(0x7fec980b5370 msgr2=0x7fec980b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:43:57.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.151+0000 7fec9cce0700 1 -- 172.21.2.105:0/3171625012 shutdown_connections 2021-11-12T05:43:57.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.151+0000 7fec9cce0700 1 -- 172.21.2.105:0/3171625012 wait complete. 2021-11-12T05:43:57.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.151+0000 7fec9cce0700 1 Processor -- start 2021-11-12T05:43:57.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.151+0000 7fec9cce0700 1 -- start start 2021-11-12T05:43:57.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.155+0000 7fec9cce0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fec980ac280 0x7fec9814e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:57.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.155+0000 7fec9cce0700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fec980ad080 0x7fec981437b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:57.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.155+0000 7fec9cce0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fec9814abe0 0x7fec98143ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:57.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.155+0000 7fec9cce0700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec98156c30 con 0x7fec980ac280 2021-11-12T05:43:57.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.155+0000 7fec9cce0700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec980abc30 con 0x7fec980ad080 2021-11-12T05:43:57.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.155+0000 7fec9cce0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec980aa720 con 0x7fec9814abe0 2021-11-12T05:43:57.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.155+0000 7fec9659c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fec980ac280 0x7fec9814e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:57.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.155+0000 7fec9659c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fec980ac280 0x7fec9814e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45542/0 (socket says 172.21.2.105:45542) 2021-11-12T05:43:57.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.155+0000 7fec9659c700 1 -- 172.21.2.105:0/3308100202 learned_addr learned my addr 172.21.2.105:0/3308100202 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:43:57.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.155+0000 7fec9659c700 1 -- 172.21.2.105:0/3308100202 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fec9814abe0 msgr2=0x7fec98143ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:57.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.155+0000 7fec9659c700 1 --2- 172.21.2.105:0/3308100202 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fec9814abe0 0x7fec98143ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:57.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.155+0000 7fec9659c700 1 -- 172.21.2.105:0/3308100202 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fec980ad080 msgr2=0x7fec981437b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:57.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.155+0000 7fec9659c700 1 --2- 172.21.2.105:0/3308100202 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fec980ad080 0x7fec981437b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:57.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.155+0000 7fec9659c700 1 -- 172.21.2.105:0/3308100202 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec8000b1e0 con 0x7fec980ac280 2021-11-12T05:43:57.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.155+0000 7fec9659c700 1 --2- 172.21.2.105:0/3308100202 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fec980ac280 0x7fec9814e7c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7fec980b6060 tx=0x7fec80015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:57.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.155+0000 7fec8f7fe700 1 -- 172.21.2.105:0/3308100202 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec80002f70 con 0x7fec980ac280 2021-11-12T05:43:57.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.155+0000 7fec8f7fe700 1 -- 172.21.2.105:0/3308100202 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec80006b80 con 0x7fec980ac280 2021-11-12T05:43:57.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.155+0000 7fec8f7fe700 1 -- 172.21.2.105:0/3308100202 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec8000de20 con 0x7fec980ac280 2021-11-12T05:43:57.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.155+0000 7fec9cce0700 1 -- 172.21.2.105:0/3308100202 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec980a7a50 con 0x7fec980ac280 2021-11-12T05:43:57.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.155+0000 7fec9cce0700 1 -- 172.21.2.105:0/3308100202 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec9814a710 con 0x7fec980ac280 2021-11-12T05:43:57.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.155+0000 7fec9cce0700 1 -- 172.21.2.105:0/3308100202 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec98144330 con 0x7fec980ac280 2021-11-12T05:43:57.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.155+0000 7fec8f7fe700 1 -- 172.21.2.105:0/3308100202 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fec80025030 con 0x7fec980ac280 2021-11-12T05:43:57.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.155+0000 7fec8f7fe700 1 --2- 172.21.2.105:0/3308100202 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fec7c053610 0x7fec7c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:57.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.155+0000 7fec8f7fe700 1 -- 172.21.2.105:0/3308100202 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6064+0+0 (secure 0 0 0) 0x7fec8006cc10 con 0x7fec980ac280 2021-11-12T05:43:57.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.155+0000 7fec95d9b700 1 --2- 172.21.2.105:0/3308100202 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fec7c053610 0x7fec7c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:57.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.155+0000 7fec95d9b700 1 --2- 172.21.2.105:0/3308100202 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fec7c053610 0x7fec7c055ad0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fec88002f70 tx=0x7fec88006aa0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:57.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.159+0000 7fec8f7fe700 1 -- 172.21.2.105:0/3308100202 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fec98144330 con 0x7fec980ac280 2021-11-12T05:43:57.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:57.243+0000 7fec9cce0700 1 -- 172.21.2.105:0/3308100202 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fec98144330 con 0x7fec980ac280 2021-11-12T05:43:58.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.095+0000 7fec8f7fe700 1 -- 172.21.2.105:0/3308100202 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v48) v1 ==== 173+0+0 (secure 0 0 0) 0x7fec98144330 con 0x7fec980ac280 2021-11-12T05:43:58.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.095+0000 7fec9cce0700 1 -- 172.21.2.105:0/3308100202 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fec7c053610 msgr2=0x7fec7c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:58.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.095+0000 7fec9cce0700 1 --2- 172.21.2.105:0/3308100202 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fec7c053610 0x7fec7c055ad0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fec88002f70 tx=0x7fec88006aa0).stop 2021-11-12T05:43:58.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.095+0000 7fec9cce0700 1 -- 172.21.2.105:0/3308100202 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fec980ac280 msgr2=0x7fec9814e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:58.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.095+0000 7fec9cce0700 1 --2- 172.21.2.105:0/3308100202 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fec980ac280 0x7fec9814e7c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7fec980b6060 tx=0x7fec80015000).stop 2021-11-12T05:43:58.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.095+0000 7fec9cce0700 1 -- 172.21.2.105:0/3308100202 shutdown_connections 2021-11-12T05:43:58.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.095+0000 7fec9cce0700 1 --2- 172.21.2.105:0/3308100202 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fec7c053610 0x7fec7c055ad0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:58.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.095+0000 7fec9cce0700 1 --2- 172.21.2.105:0/3308100202 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fec9814abe0 0x7fec98143ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:58.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.095+0000 7fec9cce0700 1 --2- 172.21.2.105:0/3308100202 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fec980ad080 0x7fec981437b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:58.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.095+0000 7fec9cce0700 1 --2- 172.21.2.105:0/3308100202 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fec980ac280 0x7fec9814e7c0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:58.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.095+0000 7fec9cce0700 1 -- 172.21.2.105:0/3308100202 >> 172.21.2.105:0/3308100202 conn(0x7fec980b5370 msgr2=0x7fec98060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:43:58.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.095+0000 7fec9cce0700 1 -- 172.21.2.105:0/3308100202 shutdown_connections 2021-11-12T05:43:58.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.095+0000 7fec9cce0700 1 -- 172.21.2.105:0/3308100202 wait complete. 2021-11-12T05:43:58.105 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_data' removed 2021-11-12T05:43:58.108 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-11-12T05:43:58.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.155+0000 7fe5c9de0700 1 Processor -- start 2021-11-12T05:43:58.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.155+0000 7fe5c9de0700 1 -- start start 2021-11-12T05:43:58.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.155+0000 7fe5c9de0700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe5c40b0520 0x7fe5c4144890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:58.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.155+0000 7fe5c9de0700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5c40b1840 con 0x7fe5c40ace20 2021-11-12T05:43:58.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.155+0000 7fe5c9de0700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5c40af2b0 con 0x7fe5c40aca40 2021-11-12T05:43:58.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.155+0000 7fe5c9de0700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5c40b0990 con 0x7fe5c40b0520 2021-11-12T05:43:58.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.155+0000 7fe5c2ffd700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fe5c40ace20 0x7fe5c4144180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:55950/0 (socket says 172.21.2.105:55950) 2021-11-12T05:43:58.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.155+0000 7fe5c2ffd700 1 -- 172.21.2.105:0/3626387326 learned_addr learned my addr 172.21.2.105:0/3626387326 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:43:58.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.155+0000 7fe5c3fff700 1 --2- 172.21.2.105:0/3626387326 >> v2:172.21.2.105:3300/0 conn(0x7fe5c40b0520 0x7fe5c4144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:58.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.155+0000 7fe5c3fff700 1 -- 172.21.2.105:0/3626387326 >> v1:172.21.2.115:6789/0 conn(0x7fe5c40aca40 legacy=0x7fe5c41473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:43:58.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.155+0000 7fe5c3fff700 1 -- 172.21.2.105:0/3626387326 >> v1:172.21.2.105:6789/0 conn(0x7fe5c40ace20 legacy=0x7fe5c4144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:58.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.155+0000 7fe5c3fff700 1 -- 172.21.2.105:0/3626387326 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c4144d80 con 0x7fe5c40b0520 2021-11-12T05:43:58.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.155+0000 7fe5c3fff700 1 --2- 172.21.2.105:0/3626387326 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe5c40b0520 0x7fe5c4144890 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7fe5c40611e0 tx=0x7fe5bc0091d0).ready entity=mon.0 client_cookie=94535c40084fce30 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:58.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.155+0000 7fe5c27fc700 1 -- 172.21.2.105:0/3626387326 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5bc009ea0 con 0x7fe5c40b0520 2021-11-12T05:43:58.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.155+0000 7fe5c27fc700 1 -- 172.21.2.105:0/3626387326 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5bc00b860 con 0x7fe5c40b0520 2021-11-12T05:43:58.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.155+0000 7fe5c27fc700 1 -- 172.21.2.105:0/3626387326 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5bc00b9d0 con 0x7fe5c40b0520 2021-11-12T05:43:58.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.155+0000 7fe5c9de0700 1 -- 172.21.2.105:0/3626387326 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe5c40b0520 msgr2=0x7fe5c4144890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:58.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.155+0000 7fe5c9de0700 1 --2- 172.21.2.105:0/3626387326 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe5c40b0520 0x7fe5c4144890 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7fe5c40611e0 tx=0x7fe5bc0091d0).stop 2021-11-12T05:43:58.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.155+0000 7fe5c9de0700 1 -- 172.21.2.105:0/3626387326 shutdown_connections 2021-11-12T05:43:58.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.155+0000 7fe5c9de0700 1 --2- 172.21.2.105:0/3626387326 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe5c40b0520 0x7fe5c4144890 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:58.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.155+0000 7fe5c9de0700 1 -- 172.21.2.105:0/3626387326 >> 172.21.2.105:0/3626387326 conn(0x7fe5c405c490 msgr2=0x7fe5c40b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:43:58.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.155+0000 7fe5c9de0700 1 -- 172.21.2.105:0/3626387326 shutdown_connections 2021-11-12T05:43:58.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.155+0000 7fe5c9de0700 1 -- 172.21.2.105:0/3626387326 wait complete. 2021-11-12T05:43:58.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.159+0000 7fe5c9de0700 1 Processor -- start 2021-11-12T05:43:58.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.159+0000 7fe5c9de0700 1 -- start start 2021-11-12T05:43:58.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.159+0000 7fe5c9de0700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe5c40aca40 0x7fe5c4147c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:58.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.159+0000 7fe5c9de0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe5c40ace20 0x7fe5c4156f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:58.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.159+0000 7fe5c9de0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe5c40b0520 0x7fe5c4159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:58.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.159+0000 7fe5c9de0700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c40a8b70 con 0x7fe5c40ace20 2021-11-12T05:43:58.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.159+0000 7fe5c9de0700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c41567c0 con 0x7fe5c40aca40 2021-11-12T05:43:58.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.159+0000 7fe5c9de0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c4156a60 con 0x7fe5c40b0520 2021-11-12T05:43:58.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.159+0000 7fe5c2ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe5c40ace20 0x7fe5c4156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:58.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.159+0000 7fe5c2ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe5c40ace20 0x7fe5c4156f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45558/0 (socket says 172.21.2.105:45558) 2021-11-12T05:43:58.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.159+0000 7fe5c2ffd700 1 -- 172.21.2.105:0/3277705206 learned_addr learned my addr 172.21.2.105:0/3277705206 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:43:58.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.159+0000 7fe5c2ffd700 1 -- 172.21.2.105:0/3277705206 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe5c40b0520 msgr2=0x7fe5c4159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:58.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.159+0000 7fe5c2ffd700 1 --2- 172.21.2.105:0/3277705206 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe5c40b0520 0x7fe5c4159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:58.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.159+0000 7fe5c2ffd700 1 -- 172.21.2.105:0/3277705206 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe5c40aca40 msgr2=0x7fe5c4147c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:58.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.159+0000 7fe5c2ffd700 1 --2- 172.21.2.105:0/3277705206 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe5c40aca40 0x7fe5c4147c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:58.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.159+0000 7fe5c2ffd700 1 -- 172.21.2.105:0/3277705206 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5bc009470 con 0x7fe5c40ace20 2021-11-12T05:43:58.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.159+0000 7fe5c2ffd700 1 --2- 172.21.2.105:0/3277705206 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe5c40ace20 0x7fe5c4156f00 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7fe5c4061140 tx=0x7fe5b8007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:58.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.159+0000 7fe5c0ff9700 1 -- 172.21.2.105:0/3277705206 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5b800ce30 con 0x7fe5c40ace20 2021-11-12T05:43:58.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.159+0000 7fe5c0ff9700 1 -- 172.21.2.105:0/3277705206 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b80072e0 con 0x7fe5c40ace20 2021-11-12T05:43:58.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.159+0000 7fe5c9de0700 1 -- 172.21.2.105:0/3277705206 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5c40a87c0 con 0x7fe5c40ace20 2021-11-12T05:43:58.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.159+0000 7fe5c0ff9700 1 -- 172.21.2.105:0/3277705206 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5b8005800 con 0x7fe5c40ace20 2021-11-12T05:43:58.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.159+0000 7fe5c9de0700 1 -- 172.21.2.105:0/3277705206 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c41573f0 con 0x7fe5c40ace20 2021-11-12T05:43:58.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.159+0000 7fe5c9de0700 1 -- 172.21.2.105:0/3277705206 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5c4064db0 con 0x7fe5c40ace20 2021-11-12T05:43:58.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.159+0000 7fe5c0ff9700 1 -- 172.21.2.105:0/3277705206 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe5b8010070 con 0x7fe5c40ace20 2021-11-12T05:43:58.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.159+0000 7fe5c0ff9700 1 --2- 172.21.2.105:0/3277705206 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe5a4053610 0x7fe5a4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:58.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.159+0000 7fe5c0ff9700 1 -- 172.21.2.105:0/3277705206 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fe5b806ae20 con 0x7fe5c40ace20 2021-11-12T05:43:58.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.159+0000 7fe5c37fe700 1 --2- 172.21.2.105:0/3277705206 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe5a4053610 0x7fe5a4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:58.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.159+0000 7fe5c37fe700 1 --2- 172.21.2.105:0/3277705206 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe5a4053610 0x7fe5a4055ad0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7fe5b4002f90 tx=0x7fe5b40069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:58.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.163+0000 7fe5c0ff9700 1 -- 172.21.2.105:0/3277705206 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe5c4064db0 con 0x7fe5c40ace20 2021-11-12T05:43:58.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.247+0000 7fe5c9de0700 1 -- 172.21.2.105:0/3277705206 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fe5c4064db0 con 0x7fe5c40ace20 2021-11-12T05:43:58.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.251+0000 7fe5c0ff9700 1 -- 172.21.2.105:0/3277705206 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe5c4064db0 con 0x7fe5c40ace20 2021-11-12T05:43:58.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.255+0000 7fe5c9de0700 1 -- 172.21.2.105:0/3277705206 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe5a4053610 msgr2=0x7fe5a4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:58.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.255+0000 7fe5c9de0700 1 --2- 172.21.2.105:0/3277705206 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe5a4053610 0x7fe5a4055ad0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7fe5b4002f90 tx=0x7fe5b40069b0).stop 2021-11-12T05:43:58.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.255+0000 7fe5c9de0700 1 -- 172.21.2.105:0/3277705206 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe5c40ace20 msgr2=0x7fe5c4156f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:58.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.255+0000 7fe5c9de0700 1 --2- 172.21.2.105:0/3277705206 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe5c40ace20 0x7fe5c4156f00 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7fe5c4061140 tx=0x7fe5b8007c40).stop 2021-11-12T05:43:58.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.255+0000 7fe5c9de0700 1 -- 172.21.2.105:0/3277705206 shutdown_connections 2021-11-12T05:43:58.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.255+0000 7fe5c9de0700 1 --2- 172.21.2.105:0/3277705206 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe5a4053610 0x7fe5a4055ad0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:58.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.255+0000 7fe5c9de0700 1 --2- 172.21.2.105:0/3277705206 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe5c40b0520 0x7fe5c4159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:58.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.255+0000 7fe5c9de0700 1 --2- 172.21.2.105:0/3277705206 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe5c40ace20 0x7fe5c4156f00 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:58.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.255+0000 7fe5c9de0700 1 --2- 172.21.2.105:0/3277705206 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe5c40aca40 0x7fe5c4147c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:58.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.255+0000 7fe5c9de0700 1 -- 172.21.2.105:0/3277705206 >> 172.21.2.105:0/3277705206 conn(0x7fe5c405c490 msgr2=0x7fe5c40b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:43:58.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.255+0000 7fe5c9de0700 1 -- 172.21.2.105:0/3277705206 shutdown_connections 2021-11-12T05:43:58.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.255+0000 7fe5c9de0700 1 -- 172.21.2.105:0/3277705206 wait complete. 2021-11-12T05:43:58.266 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead' 2021-11-12T05:43:58.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.311+0000 7f8d7286c700 1 Processor -- start 2021-11-12T05:43:58.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.311+0000 7f8d7286c700 1 -- start start 2021-11-12T05:43:58.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d7286c700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f8d6c0ad080 0x7f8d6c0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:58.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d7286c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f8d6c14b2f0 0x7f8d6c0ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:58.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d7286c700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d6c0ac7b0 con 0x7f8d6c0ac280 2021-11-12T05:43:58.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d7286c700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d6c1488a0 con 0x7f8d6c14b2f0 2021-11-12T05:43:58.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d7286c700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d6c0ac9e0 con 0x7f8d6c0ad080 2021-11-12T05:43:58.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d70e09700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f8d6c14b2f0 0x7f8d6c0ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:58.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d70e09700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f8d6c14b2f0 0x7f8d6c0ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45566/0 (socket says 172.21.2.105:45566) 2021-11-12T05:43:58.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d70e09700 1 -- 172.21.2.105:0/3985646911 learned_addr learned my addr 172.21.2.105:0/3985646911 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:43:58.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d70e09700 1 -- 172.21.2.105:0/3985646911 >> v2:172.21.2.115:3300/0 conn(0x7f8d6c0ad080 msgr2=0x7f8d6c0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:43:58.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d70e09700 1 --2- 172.21.2.105:0/3985646911 >> v2:172.21.2.115:3300/0 conn(0x7f8d6c0ad080 0x7f8d6c0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:58.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d70e09700 1 -- 172.21.2.105:0/3985646911 >> v1:172.21.2.115:6789/0 conn(0x7f8d6c0ac280 legacy=0x7f8d6c14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:43:58.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d70e09700 1 -- 172.21.2.105:0/3985646911 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d6c0b0b30 con 0x7f8d6c14b2f0 2021-11-12T05:43:58.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d70e09700 1 --2- 172.21.2.105:0/3985646911 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8d6c14b2f0 0x7f8d6c0ad460 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f8d6c0b06e0 tx=0x7f8d64009290).ready entity=mon.0 client_cookie=10c9d548a27c1354 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:58.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d6affd700 1 -- 172.21.2.105:0/3985646911 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d6400b830 con 0x7f8d6c14b2f0 2021-11-12T05:43:58.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d6affd700 1 -- 172.21.2.105:0/3985646911 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6400b990 con 0x7f8d6c14b2f0 2021-11-12T05:43:58.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d6affd700 1 -- 172.21.2.105:0/3985646911 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d6400bb40 con 0x7f8d6c14b2f0 2021-11-12T05:43:58.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d7286c700 1 -- 172.21.2.105:0/3985646911 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8d6c14b2f0 msgr2=0x7f8d6c0ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:58.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d7286c700 1 --2- 172.21.2.105:0/3985646911 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8d6c14b2f0 0x7f8d6c0ad460 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f8d6c0b06e0 tx=0x7f8d64009290).stop 2021-11-12T05:43:58.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d7286c700 1 -- 172.21.2.105:0/3985646911 shutdown_connections 2021-11-12T05:43:58.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d7286c700 1 --2- 172.21.2.105:0/3985646911 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8d6c14b2f0 0x7f8d6c0ad460 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:58.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d7286c700 1 --2- 172.21.2.105:0/3985646911 >> v2:172.21.2.115:3300/0 conn(0x7f8d6c0ad080 0x7f8d6c0af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:58.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d7286c700 1 -- 172.21.2.105:0/3985646911 >> 172.21.2.105:0/3985646911 conn(0x7f8d6c0b5370 msgr2=0x7f8d6c0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:43:58.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d7286c700 1 -- 172.21.2.105:0/3985646911 shutdown_connections 2021-11-12T05:43:58.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d7286c700 1 -- 172.21.2.105:0/3985646911 wait complete. 2021-11-12T05:43:58.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d7286c700 1 Processor -- start 2021-11-12T05:43:58.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d7286c700 1 -- start start 2021-11-12T05:43:58.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d7286c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8d6c0ac280 0x7f8d6c0a9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:58.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d7286c700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8d6c0ad080 0x7f8d6c063850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:58.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d7286c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8d6c14b2f0 0x7f8d6c142a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:58.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d7286c700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c0643b0 con 0x7f8d6c0ac280 2021-11-12T05:43:58.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d7286c700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c062a30 con 0x7f8d6c0ad080 2021-11-12T05:43:58.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d7286c700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c159b80 con 0x7f8d6c14b2f0 2021-11-12T05:43:58.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d6bfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8d6c0ac280 0x7f8d6c0a9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:58.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d6bfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8d6c0ac280 0x7f8d6c0a9ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45572/0 (socket says 172.21.2.105:45572) 2021-11-12T05:43:58.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d6bfff700 1 -- 172.21.2.105:0/161013937 learned_addr learned my addr 172.21.2.105:0/161013937 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:43:58.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d6bfff700 1 -- 172.21.2.105:0/161013937 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8d6c14b2f0 msgr2=0x7f8d6c142a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:58.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d6bfff700 1 --2- 172.21.2.105:0/161013937 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8d6c14b2f0 0x7f8d6c142a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:58.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d6bfff700 1 -- 172.21.2.105:0/161013937 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8d6c0ad080 msgr2=0x7f8d6c063850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:58.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d6bfff700 1 --2- 172.21.2.105:0/161013937 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8d6c0ad080 0x7f8d6c063850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:58.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d6bfff700 1 -- 172.21.2.105:0/161013937 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d64009530 con 0x7f8d6c0ac280 2021-11-12T05:43:58.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d6bfff700 1 --2- 172.21.2.105:0/161013937 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8d6c0ac280 0x7f8d6c0a9ab0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f8d6c159d10 tx=0x7f8d54006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:58.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d697fa700 1 -- 172.21.2.105:0/161013937 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d54013460 con 0x7f8d6c0ac280 2021-11-12T05:43:58.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d697fa700 1 -- 172.21.2.105:0/161013937 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d540135c0 con 0x7f8d6c0ac280 2021-11-12T05:43:58.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d7286c700 1 -- 172.21.2.105:0/161013937 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d6c159df0 con 0x7f8d6c0ac280 2021-11-12T05:43:58.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d697fa700 1 -- 172.21.2.105:0/161013937 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d54013920 con 0x7f8d6c0ac280 2021-11-12T05:43:58.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.315+0000 7f8d7286c700 1 -- 172.21.2.105:0/161013937 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d6c0abb60 con 0x7f8d6c0ac280 2021-11-12T05:43:58.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.319+0000 7f8d7286c700 1 -- 172.21.2.105:0/161013937 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d6c064110 con 0x7f8d6c0ac280 2021-11-12T05:43:58.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.319+0000 7f8d697fa700 1 -- 172.21.2.105:0/161013937 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8d5400f070 con 0x7f8d6c0ac280 2021-11-12T05:43:58.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.319+0000 7f8d697fa700 1 --2- 172.21.2.105:0/161013937 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8d500536a0 0x7f8d50055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:58.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.319+0000 7f8d697fa700 1 -- 172.21.2.105:0/161013937 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f8d5406b100 con 0x7f8d6c0ac280 2021-11-12T05:43:58.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.319+0000 7f8d6b7fe700 1 --2- 172.21.2.105:0/161013937 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8d500536a0 0x7f8d50055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:58.334 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.319+0000 7f8d6b7fe700 1 --2- 172.21.2.105:0/161013937 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8d500536a0 0x7f8d50055b60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f8d5c002f90 tx=0x7f8d5c0069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:58.334 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.319+0000 7f8d697fa700 1 -- 172.21.2.105:0/161013937 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8d6c064110 con 0x7f8d6c0ac280 2021-11-12T05:43:58.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:58.435+0000 7f8d7286c700 1 -- 172.21.2.105:0/161013937 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]} v 0) v1 -- 0x7f8d6c064110 con 0x7f8d6c0ac280 2021-11-12T05:43:59.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.107+0000 7f8d697fa700 1 -- 172.21.2.105:0/161013937 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]}]=0 v146) v1 ==== 144+0+0 (secure 0 0 0) 0x7f8d6c064110 con 0x7f8d6c0ac280 2021-11-12T05:43:59.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.107+0000 7f8d7286c700 1 -- 172.21.2.105:0/161013937 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8d500536a0 msgr2=0x7f8d50055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:59.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.107+0000 7f8d7286c700 1 --2- 172.21.2.105:0/161013937 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8d500536a0 0x7f8d50055b60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f8d5c002f90 tx=0x7f8d5c0069b0).stop 2021-11-12T05:43:59.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.107+0000 7f8d7286c700 1 -- 172.21.2.105:0/161013937 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8d6c0ac280 msgr2=0x7f8d6c0a9ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:59.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.107+0000 7f8d7286c700 1 --2- 172.21.2.105:0/161013937 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8d6c0ac280 0x7f8d6c0a9ab0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f8d6c159d10 tx=0x7f8d54006ec0).stop 2021-11-12T05:43:59.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.107+0000 7f8d7286c700 1 -- 172.21.2.105:0/161013937 shutdown_connections 2021-11-12T05:43:59.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.107+0000 7f8d7286c700 1 --2- 172.21.2.105:0/161013937 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8d500536a0 0x7f8d50055b60 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:59.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.107+0000 7f8d7286c700 1 --2- 172.21.2.105:0/161013937 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8d6c14b2f0 0x7f8d6c142a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:59.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.107+0000 7f8d7286c700 1 --2- 172.21.2.105:0/161013937 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8d6c0ad080 0x7f8d6c063850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:59.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.107+0000 7f8d7286c700 1 --2- 172.21.2.105:0/161013937 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8d6c0ac280 0x7f8d6c0a9ab0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:59.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.107+0000 7f8d7286c700 1 -- 172.21.2.105:0/161013937 >> 172.21.2.105:0/161013937 conn(0x7f8d6c0b5370 msgr2=0x7f8d6c14aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:43:59.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.107+0000 7f8d7286c700 1 -- 172.21.2.105:0/161013937 shutdown_connections 2021-11-12T05:43:59.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.107+0000 7f8d7286c700 1 -- 172.21.2.105:0/161013937 wait complete. 2021-11-12T05:43:59.120 INFO:tasks.cephfs_test_runner:test_drop_cache_command_dead (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-11-12T05:43:59.120 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_dead_timeout (tasks.cephfs.test_misc.TestCacheDrop) 2021-11-12T05:43:59.121 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout' 2021-11-12T05:43:59.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.167+0000 7f8b1bfff700 1 Processor -- start 2021-11-12T05:43:59.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.167+0000 7f8b1bfff700 1 -- start start 2021-11-12T05:43:59.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.167+0000 7f8b1bfff700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8b1c0b14f0 0x7f8b1c0b68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:59.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.167+0000 7f8b1bfff700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b1c13fd30 con 0x7f8b1c0ade50 2021-11-12T05:43:59.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.167+0000 7f8b1bfff700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b1c13ffd0 con 0x7f8b1c0b64d0 2021-11-12T05:43:59.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.167+0000 7f8b1bfff700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c0ae820 con 0x7f8b1c0b14f0 2021-11-12T05:43:59.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.167+0000 7f8b1a7fc700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f8b1c0ade50 0x7f8b1c1396c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:55976/0 (socket says 172.21.2.105:55976) 2021-11-12T05:43:59.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.167+0000 7f8b1a7fc700 1 -- 172.21.2.105:0/3520470012 learned_addr learned my addr 172.21.2.105:0/3520470012 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:43:59.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.167+0000 7f8b1b7fe700 1 --2- 172.21.2.105:0/3520470012 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8b1c0b14f0 0x7f8b1c0b68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:59.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.167+0000 7f8b19ffb700 1 -- 172.21.2.105:0/3520470012 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 579967543 0 0) 0x7f8b1c13fd30 con 0x7f8b1c0ade50 2021-11-12T05:43:59.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.167+0000 7f8b19ffb700 1 -- 172.21.2.105:0/3520470012 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b00003260 con 0x7f8b1c0ade50 2021-11-12T05:43:59.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.167+0000 7f8b19ffb700 1 -- 172.21.2.105:0/3520470012 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2600057705 0 0) 0x7f8b00003260 con 0x7f8b1c0ade50 2021-11-12T05:43:59.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.167+0000 7f8b19ffb700 1 -- 172.21.2.105:0/3520470012 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8b1c0b14f0 msgr2=0x7f8b1c0b68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:43:59.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.167+0000 7f8b19ffb700 1 --2- 172.21.2.105:0/3520470012 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8b1c0b14f0 0x7f8b1c0b68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:59.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.167+0000 7f8b19ffb700 1 -- 172.21.2.105:0/3520470012 >> v1:172.21.2.115:6789/0 conn(0x7f8b1c0b64d0 legacy=0x7f8b1c140470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:59.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.167+0000 7f8b19ffb700 1 -- 172.21.2.105:0/3520470012 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b1c0b1b50 con 0x7f8b1c0ade50 2021-11-12T05:43:59.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.167+0000 7f8b19ffb700 1 -- 172.21.2.105:0/3520470012 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f8b100016b0 con 0x7f8b1c0ade50 2021-11-12T05:43:59.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.167+0000 7f8b19ffb700 1 -- 172.21.2.105:0/3520470012 >> v1:172.21.2.105:6789/0 conn(0x7f8b1c0ade50 legacy=0x7f8b1c1396c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:59.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.167+0000 7f8b19ffb700 1 --2- 172.21.2.105:0/3520470012 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8b1c0b14f0 0x7f8b00003780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:59.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.167+0000 7f8b19ffb700 1 --2- 172.21.2.105:0/3520470012 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8b00003d00 0x7f8b00004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:59.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.167+0000 7f8b19ffb700 1 --2- 172.21.2.105:0/3520470012 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8b000049f0 0x7f8b00004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:59.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.167+0000 7f8b19ffb700 1 -- 172.21.2.105:0/3520470012 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c0ae820 con 0x7f8b00003d00 2021-11-12T05:43:59.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.167+0000 7f8b19ffb700 1 -- 172.21.2.105:0/3520470012 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0000b830 con 0x7f8b000049f0 2021-11-12T05:43:59.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.167+0000 7f8b19ffb700 1 -- 172.21.2.105:0/3520470012 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0000b9f0 con 0x7f8b1c0b14f0 2021-11-12T05:43:59.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.167+0000 7f8b1a7fc700 1 --2- 172.21.2.105:0/3520470012 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8b00003d00 0x7f8b00004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:59.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.167+0000 7f8b1a7fc700 1 -- 172.21.2.105:0/3520470012 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8b1c0b14f0 msgr2=0x7f8b00003780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:43:59.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.167+0000 7f8b1a7fc700 1 --2- 172.21.2.105:0/3520470012 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8b1c0b14f0 0x7f8b00003780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:59.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.167+0000 7f8b1a7fc700 1 -- 172.21.2.105:0/3520470012 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8b000049f0 msgr2=0x7f8b00004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:43:59.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.167+0000 7f8b1a7fc700 1 --2- 172.21.2.105:0/3520470012 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8b000049f0 0x7f8b00004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:43:59.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.167+0000 7f8b1a7fc700 1 -- 172.21.2.105:0/3520470012 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b00003260 con 0x7f8b00003d00 2021-11-12T05:43:59.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.167+0000 7f8b1a7fc700 1 --2- 172.21.2.105:0/3520470012 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8b00003d00 0x7f8b00004500 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f8b100013c0 tx=0x7f8b1c140160).ready entity=mon.0 client_cookie=7a72ac60135cb998 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:59.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.171+0000 7f8b19ffb700 1 -- 172.21.2.105:0/3520470012 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b100070d0 con 0x7f8b00003d00 2021-11-12T05:43:59.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.171+0000 7f8b19ffb700 1 -- 172.21.2.105:0/3520470012 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b10007230 con 0x7f8b00003d00 2021-11-12T05:43:59.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.171+0000 7f8b19ffb700 1 -- 172.21.2.105:0/3520470012 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b1000c8f0 con 0x7f8b00003d00 2021-11-12T05:43:59.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.171+0000 7f8b1bfff700 1 -- 172.21.2.105:0/3520470012 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8b00003d00 msgr2=0x7f8b00004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:59.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.171+0000 7f8b1bfff700 1 --2- 172.21.2.105:0/3520470012 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8b00003d00 0x7f8b00004500 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f8b100013c0 tx=0x7f8b1c140160).stop 2021-11-12T05:43:59.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.171+0000 7f8b1b7fe700 1 -- 172.21.2.105:0/3520470012 reap_dead start 2021-11-12T05:43:59.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.171+0000 7f8b1bfff700 1 -- 172.21.2.105:0/3520470012 shutdown_connections 2021-11-12T05:43:59.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.171+0000 7f8b1bfff700 1 -- 172.21.2.105:0/3520470012 >> 172.21.2.105:0/3520470012 conn(0x7f8b1c0613f0 msgr2=0x7f8b1c0617d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:43:59.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.171+0000 7f8b1bfff700 1 -- 172.21.2.105:0/3520470012 shutdown_connections 2021-11-12T05:43:59.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.171+0000 7f8b1bfff700 1 -- 172.21.2.105:0/3520470012 wait complete. 2021-11-12T05:43:59.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.171+0000 7f8b1bfff700 1 Processor -- start 2021-11-12T05:43:59.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.171+0000 7f8b1bfff700 1 -- start start 2021-11-12T05:43:59.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.171+0000 7f8b1bfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8b00003d00 0x7f8b1c13b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:59.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.171+0000 7f8b1bfff700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8b1c13e960 0x7f8b1c13cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:59.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.171+0000 7f8b1bfff700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8b1c064a10 0x7f8b1c064e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:59.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.171+0000 7f8b1bfff700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c13b950 con 0x7f8b00003d00 2021-11-12T05:43:59.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.171+0000 7f8b1bfff700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c13c370 con 0x7f8b1c13e960 2021-11-12T05:43:59.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.171+0000 7f8b1bfff700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c13c610 con 0x7f8b1c064a10 2021-11-12T05:43:59.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.171+0000 7f8b1affd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8b00003d00 0x7f8b1c13b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:59.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.171+0000 7f8b1affd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8b00003d00 0x7f8b1c13b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45594/0 (socket says 172.21.2.105:45594) 2021-11-12T05:43:59.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.171+0000 7f8b1affd700 1 -- 172.21.2.105:0/2971159488 learned_addr learned my addr 172.21.2.105:0/2971159488 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:43:59.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.171+0000 7f8b1b7fe700 1 --2- 172.21.2.105:0/2971159488 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8b1c064a10 0x7f8b1c064e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:59.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.171+0000 7f8b1a7fc700 1 --2- 172.21.2.105:0/2971159488 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8b1c13e960 0x7f8b1c13cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:59.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.171+0000 7f8b1affd700 1 -- 172.21.2.105:0/2971159488 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8b1c064a10 msgr2=0x7f8b1c064e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:59.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.171+0000 7f8b1affd700 1 --2- 172.21.2.105:0/2971159488 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8b1c064a10 0x7f8b1c064e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:59.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.171+0000 7f8b1affd700 1 -- 172.21.2.105:0/2971159488 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8b1c13e960 msgr2=0x7f8b1c13cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:43:59.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.171+0000 7f8b1affd700 1 --2- 172.21.2.105:0/2971159488 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8b1c13e960 0x7f8b1c13cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:43:59.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.171+0000 7f8b1affd700 1 -- 172.21.2.105:0/2971159488 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b1c065380 con 0x7f8b00003d00 2021-11-12T05:43:59.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.171+0000 7f8b1affd700 1 --2- 172.21.2.105:0/2971159488 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8b00003d00 0x7f8b1c13b320 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f8b1c0b3f50 tx=0x7f8b0c007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:59.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.171+0000 7f8b0bfff700 1 -- 172.21.2.105:0/2971159488 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b0c007030 con 0x7f8b00003d00 2021-11-12T05:43:59.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.171+0000 7f8b0bfff700 1 -- 172.21.2.105:0/2971159488 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0c007190 con 0x7f8b00003d00 2021-11-12T05:43:59.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.171+0000 7f8b1bfff700 1 -- 172.21.2.105:0/2971159488 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b1c13cfa0 con 0x7f8b00003d00 2021-11-12T05:43:59.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.171+0000 7f8b1bfff700 1 -- 172.21.2.105:0/2971159488 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b1c12bd70 con 0x7f8b00003d00 2021-11-12T05:43:59.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.171+0000 7f8b0bfff700 1 -- 172.21.2.105:0/2971159488 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b0c006510 con 0x7f8b00003d00 2021-11-12T05:43:59.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.171+0000 7f8b1bfff700 1 -- 172.21.2.105:0/2971159488 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8afc003410 con 0x7f8b00003d00 2021-11-12T05:43:59.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.171+0000 7f8b0bfff700 1 -- 172.21.2.105:0/2971159488 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8b0c010030 con 0x7f8b00003d00 2021-11-12T05:43:59.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.175+0000 7f8b0bfff700 1 --2- 172.21.2.105:0/2971159488 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8af80536a0 0x7f8af8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:43:59.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.175+0000 7f8b0bfff700 1 -- 172.21.2.105:0/2971159488 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f8b0c06b3c0 con 0x7f8b00003d00 2021-11-12T05:43:59.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.175+0000 7f8b1a7fc700 1 --2- 172.21.2.105:0/2971159488 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8af80536a0 0x7f8af8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:43:59.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.175+0000 7f8b1a7fc700 1 --2- 172.21.2.105:0/2971159488 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8af80536a0 0x7f8af8055b60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f8b1001a000 tx=0x7f8b10015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:43:59.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.175+0000 7f8b0bfff700 1 -- 172.21.2.105:0/2971159488 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8b0c0426a0 con 0x7f8b00003d00 2021-11-12T05:43:59.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:43:59.287+0000 7f8b1bfff700 1 -- 172.21.2.105:0/2971159488 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]} v 0) v1 -- 0x7f8afc0036c0 con 0x7f8b00003d00 2021-11-12T05:44:00.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.107+0000 7f8b0bfff700 1 -- 172.21.2.105:0/2971159488 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]}]=0 v147) v1 ==== 155+0+0 (secure 0 0 0) 0x7f8b0c045cc0 con 0x7f8b00003d00 2021-11-12T05:44:00.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.111+0000 7f8b1bfff700 1 -- 172.21.2.105:0/2971159488 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8af80536a0 msgr2=0x7f8af8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:00.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.111+0000 7f8b1bfff700 1 --2- 172.21.2.105:0/2971159488 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8af80536a0 0x7f8af8055b60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f8b1001a000 tx=0x7f8b10015000).stop 2021-11-12T05:44:00.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.111+0000 7f8b1bfff700 1 -- 172.21.2.105:0/2971159488 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8b00003d00 msgr2=0x7f8b1c13b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:00.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.111+0000 7f8b1bfff700 1 --2- 172.21.2.105:0/2971159488 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8b00003d00 0x7f8b1c13b320 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f8b1c0b3f50 tx=0x7f8b0c007c00).stop 2021-11-12T05:44:00.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.111+0000 7f8b1bfff700 1 -- 172.21.2.105:0/2971159488 shutdown_connections 2021-11-12T05:44:00.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.111+0000 7f8b1bfff700 1 --2- 172.21.2.105:0/2971159488 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8af80536a0 0x7f8af8055b60 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:00.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.111+0000 7f8b1bfff700 1 --2- 172.21.2.105:0/2971159488 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8b1c064a10 0x7f8b1c064e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:00.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.111+0000 7f8b1bfff700 1 --2- 172.21.2.105:0/2971159488 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8b1c13e960 0x7f8b1c13cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:00.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.111+0000 7f8b1bfff700 1 --2- 172.21.2.105:0/2971159488 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8b00003d00 0x7f8b1c13b320 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:00.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.111+0000 7f8b1bfff700 1 -- 172.21.2.105:0/2971159488 >> 172.21.2.105:0/2971159488 conn(0x7f8b1c0613f0 msgr2=0x7f8b1c0af490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:00.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.111+0000 7f8b1bfff700 1 -- 172.21.2.105:0/2971159488 shutdown_connections 2021-11-12T05:44:00.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.111+0000 7f8b1bfff700 1 -- 172.21.2.105:0/2971159488 wait complete. 2021-11-12T05:44:00.124 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-11-12T05:44:00.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.171+0000 7efe841e6700 1 Processor -- start 2021-11-12T05:44:00.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.171+0000 7efe841e6700 1 -- start start 2021-11-12T05:44:00.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.171+0000 7efe841e6700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7efe7c0aca40 0x7efe7c0ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:00.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.171+0000 7efe841e6700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efe7c0b0520 0x7efe7c1473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:00.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.171+0000 7efe841e6700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe7c0b1840 con 0x7efe7c1478b0 2021-11-12T05:44:00.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.171+0000 7efe841e6700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe7c147d40 con 0x7efe7c0aca40 2021-11-12T05:44:00.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.171+0000 7efe841e6700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c0af2b0 con 0x7efe7c0b0520 2021-11-12T05:44:00.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.171+0000 7efe81f82700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7efe7c0aca40 0x7efe7c0ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:00.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.171+0000 7efe81f82700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7efe7c0aca40 0x7efe7c0ace20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45598/0 (socket says 172.21.2.105:45598) 2021-11-12T05:44:00.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.171+0000 7efe81f82700 1 -- 172.21.2.105:0/2358087775 learned_addr learned my addr 172.21.2.105:0/2358087775 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:00.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.171+0000 7efe81f82700 1 -- 172.21.2.105:0/2358087775 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efe7c0b0520 msgr2=0x7efe7c1473c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:44:00.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.171+0000 7efe81f82700 1 --2- 172.21.2.105:0/2358087775 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efe7c0b0520 0x7efe7c1473c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:00.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.171+0000 7efe81f82700 1 -- 172.21.2.105:0/2358087775 >> v1:172.21.2.115:6789/0 conn(0x7efe7c1478b0 legacy=0x7efe7c144180 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:44:00.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.171+0000 7efe81f82700 1 -- 172.21.2.105:0/2358087775 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe7c0b09a0 con 0x7efe7c0aca40 2021-11-12T05:44:00.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.171+0000 7efe81f82700 1 --2- 172.21.2.105:0/2358087775 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe7c0aca40 0x7efe7c0ace20 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7efe7c0b00d0 tx=0x7efe78006eb0).ready entity=mon.0 client_cookie=c41003e9dea4f798 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:00.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.171+0000 7efe80f80700 1 -- 172.21.2.105:0/2358087775 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe7800d570 con 0x7efe7c0aca40 2021-11-12T05:44:00.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.171+0000 7efe80f80700 1 -- 172.21.2.105:0/2358087775 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe78000e90 con 0x7efe7c0aca40 2021-11-12T05:44:00.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.171+0000 7efe80f80700 1 -- 172.21.2.105:0/2358087775 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe7800d8c0 con 0x7efe7c0aca40 2021-11-12T05:44:00.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.175+0000 7efe841e6700 1 -- 172.21.2.105:0/2358087775 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe7c0aca40 msgr2=0x7efe7c0ace20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:00.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.175+0000 7efe841e6700 1 --2- 172.21.2.105:0/2358087775 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe7c0aca40 0x7efe7c0ace20 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7efe7c0b00d0 tx=0x7efe78006eb0).stop 2021-11-12T05:44:00.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.175+0000 7efe841e6700 1 -- 172.21.2.105:0/2358087775 shutdown_connections 2021-11-12T05:44:00.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.175+0000 7efe841e6700 1 --2- 172.21.2.105:0/2358087775 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efe7c0b0520 0x7efe7c1473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:00.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.175+0000 7efe841e6700 1 --2- 172.21.2.105:0/2358087775 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe7c0aca40 0x7efe7c0ace20 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:00.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.175+0000 7efe841e6700 1 -- 172.21.2.105:0/2358087775 >> 172.21.2.105:0/2358087775 conn(0x7efe7c05c490 msgr2=0x7efe7c0b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:00.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.175+0000 7efe841e6700 1 -- 172.21.2.105:0/2358087775 shutdown_connections 2021-11-12T05:44:00.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.175+0000 7efe841e6700 1 -- 172.21.2.105:0/2358087775 wait complete. 2021-11-12T05:44:00.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.175+0000 7efe841e6700 1 Processor -- start 2021-11-12T05:44:00.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.175+0000 7efe841e6700 1 -- start start 2021-11-12T05:44:00.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.175+0000 7efe841e6700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efe7c0aca40 0x7efe7c063730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:00.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.175+0000 7efe841e6700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efe7c0b0520 0x7efe7c0a79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:00.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.175+0000 7efe841e6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe7c1478b0 0x7efe7c15a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:00.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.175+0000 7efe841e6700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c066060 con 0x7efe7c1478b0 2021-11-12T05:44:00.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.175+0000 7efe841e6700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c066300 con 0x7efe7c0b0520 2021-11-12T05:44:00.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.175+0000 7efe841e6700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c0665a0 con 0x7efe7c0aca40 2021-11-12T05:44:00.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.175+0000 7efe82783700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe7c1478b0 0x7efe7c15a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:00.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.175+0000 7efe82783700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe7c1478b0 0x7efe7c15a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45606/0 (socket says 172.21.2.105:45606) 2021-11-12T05:44:00.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.175+0000 7efe82783700 1 -- 172.21.2.105:0/3610747815 learned_addr learned my addr 172.21.2.105:0/3610747815 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:00.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.175+0000 7efe82783700 1 -- 172.21.2.105:0/3610747815 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efe7c0aca40 msgr2=0x7efe7c063730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:00.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.175+0000 7efe82783700 1 --2- 172.21.2.105:0/3610747815 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efe7c0aca40 0x7efe7c063730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:00.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.175+0000 7efe82783700 1 -- 172.21.2.105:0/3610747815 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efe7c0b0520 msgr2=0x7efe7c0a79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:00.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.175+0000 7efe81781700 1 --2- 172.21.2.105:0/3610747815 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efe7c0b0520 0x7efe7c0a79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:00.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.175+0000 7efe82783700 1 --2- 172.21.2.105:0/3610747815 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efe7c0b0520 0x7efe7c0a79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:00.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.175+0000 7efe82783700 1 -- 172.21.2.105:0/3610747815 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe7800b1e0 con 0x7efe7c1478b0 2021-11-12T05:44:00.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.175+0000 7efe81781700 1 --2- 172.21.2.105:0/3610747815 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efe7c0b0520 0x7efe7c0a79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:44:00.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.175+0000 7efe82783700 1 --2- 172.21.2.105:0/3610747815 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe7c1478b0 0x7efe7c15a520 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7efe74001250 tx=0x7efe740090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:00.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.175+0000 7efe6effd700 1 -- 172.21.2.105:0/3610747815 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe740014e0 con 0x7efe7c1478b0 2021-11-12T05:44:00.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.175+0000 7efe6effd700 1 -- 172.21.2.105:0/3610747815 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe74001640 con 0x7efe7c1478b0 2021-11-12T05:44:00.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.175+0000 7efe6effd700 1 -- 172.21.2.105:0/3610747815 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe740019a0 con 0x7efe7c1478b0 2021-11-12T05:44:00.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.175+0000 7efe841e6700 1 -- 172.21.2.105:0/3610747815 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe7c159f00 con 0x7efe7c1478b0 2021-11-12T05:44:00.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.175+0000 7efe841e6700 1 -- 172.21.2.105:0/3610747815 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe7c067330 con 0x7efe7c1478b0 2021-11-12T05:44:00.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.179+0000 7efe841e6700 1 -- 172.21.2.105:0/3610747815 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe7c0a9270 con 0x7efe7c1478b0 2021-11-12T05:44:00.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.179+0000 7efe6effd700 1 -- 172.21.2.105:0/3610747815 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efe74018030 con 0x7efe7c1478b0 2021-11-12T05:44:00.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.179+0000 7efe6effd700 1 --2- 172.21.2.105:0/3610747815 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efe5c0536f0 0x7efe5c055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:00.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.179+0000 7efe6effd700 1 -- 172.21.2.105:0/3610747815 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5682+0+0 (secure 0 0 0) 0x7efe7406b1a0 con 0x7efe7c1478b0 2021-11-12T05:44:00.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.179+0000 7efe81f82700 1 --2- 172.21.2.105:0/3610747815 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efe5c0536f0 0x7efe5c055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:00.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.179+0000 7efe81f82700 1 --2- 172.21.2.105:0/3610747815 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efe5c0536f0 0x7efe5c055bb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7efe7c0b00d0 tx=0x7efe78015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:00.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.179+0000 7efe6effd700 1 -- 172.21.2.105:0/3610747815 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efe74042420 con 0x7efe7c1478b0 2021-11-12T05:44:00.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.263+0000 7efe841e6700 1 -- 172.21.2.105:0/3610747815 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7efe7c057350 con 0x7efe7c1478b0 2021-11-12T05:44:00.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.267+0000 7efe6effd700 1 -- 172.21.2.105:0/3610747815 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7efe74045a40 con 0x7efe7c1478b0 2021-11-12T05:44:00.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.271+0000 7efe841e6700 1 -- 172.21.2.105:0/3610747815 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efe5c0536f0 msgr2=0x7efe5c055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:00.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.271+0000 7efe841e6700 1 --2- 172.21.2.105:0/3610747815 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efe5c0536f0 0x7efe5c055bb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7efe7c0b00d0 tx=0x7efe78015000).stop 2021-11-12T05:44:00.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.271+0000 7efe841e6700 1 -- 172.21.2.105:0/3610747815 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe7c1478b0 msgr2=0x7efe7c15a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:00.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.271+0000 7efe841e6700 1 --2- 172.21.2.105:0/3610747815 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe7c1478b0 0x7efe7c15a520 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7efe74001250 tx=0x7efe740090f0).stop 2021-11-12T05:44:00.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.271+0000 7efe841e6700 1 -- 172.21.2.105:0/3610747815 shutdown_connections 2021-11-12T05:44:00.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.271+0000 7efe841e6700 1 --2- 172.21.2.105:0/3610747815 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efe5c0536f0 0x7efe5c055bb0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:00.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.271+0000 7efe841e6700 1 --2- 172.21.2.105:0/3610747815 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe7c1478b0 0x7efe7c15a520 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:00.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.271+0000 7efe841e6700 1 --2- 172.21.2.105:0/3610747815 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efe7c0b0520 0x7efe7c0a79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:00.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.271+0000 7efe841e6700 1 --2- 172.21.2.105:0/3610747815 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efe7c0aca40 0x7efe7c063730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:00.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.271+0000 7efe841e6700 1 -- 172.21.2.105:0/3610747815 >> 172.21.2.105:0/3610747815 conn(0x7efe7c05c490 msgr2=0x7efe7c144d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:00.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.271+0000 7efe841e6700 1 -- 172.21.2.105:0/3610747815 shutdown_connections 2021-11-12T05:44:00.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.271+0000 7efe841e6700 1 -- 172.21.2.105:0/3610747815 wait complete. 2021-11-12T05:44:00.281 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-12T05:44:00.281 DEBUG:teuthology.orchestra.run.gibba005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:44:00.289 DEBUG:teuthology.orchestra.run.gibba015:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:44:00.303 DEBUG:teuthology.orchestra.run.gibba016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:44:00.317 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:44:00.330 DEBUG:teuthology.orchestra.run.gibba044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:44:00.343 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-12T05:44:00.344 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:44:00.344 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:44:00.345 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:44:00.362 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:44:00.364 INFO:teuthology.orchestra.run.gibba016.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-12T05:44:00.364 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-11-12T05:44:00.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:44:00.366 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:44:00.366 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:44:00.375 INFO:teuthology.orchestra.run.gibba038.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-12T05:44:00.376 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:44:00.377 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-12T05:44:00.377 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:44:00.378 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:44:00.378 DEBUG:teuthology.orchestra.run.gibba044:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:44:00.383 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:44:00.383 INFO:teuthology.orchestra.run.gibba044.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-12T05:44:00.384 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-12T05:44:00.384 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-12T05:44:00.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.435+0000 7fb6c14b0700 1 Processor -- start 2021-11-12T05:44:00.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.435+0000 7fb6c14b0700 1 -- start start 2021-11-12T05:44:00.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.435+0000 7fb6c14b0700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb6bc0af750 0x7fb6bc062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:00.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.435+0000 7fb6c14b0700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6bc0b0d50 con 0x7fb6bc0626b0 2021-11-12T05:44:00.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.435+0000 7fb6c14b0700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6bc0ad380 con 0x7fb6bc130a80 2021-11-12T05:44:00.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.435+0000 7fb6c14b0700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6bc0ae190 con 0x7fb6bc0af750 2021-11-12T05:44:00.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.435+0000 7fb6baffd700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fb6bc0626b0 0x7fb6bc130370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:56008/0 (socket says 172.21.2.105:56008) 2021-11-12T05:44:00.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.435+0000 7fb6baffd700 1 -- 172.21.2.105:0/3709746204 learned_addr learned my addr 172.21.2.105:0/3709746204 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:44:00.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.435+0000 7fb6ba7fc700 1 --2- 172.21.2.105:0/3709746204 >> v2:172.21.2.105:3300/0 conn(0x7fb6bc0af750 0x7fb6bc062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:00.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.435+0000 7fb6ba7fc700 1 -- 172.21.2.105:0/3709746204 >> v1:172.21.2.115:6789/0 conn(0x7fb6bc130a80 legacy=0x7fb6bc1474d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:44:00.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.435+0000 7fb6ba7fc700 1 -- 172.21.2.105:0/3709746204 >> v1:172.21.2.105:6789/0 conn(0x7fb6bc0626b0 legacy=0x7fb6bc130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:00.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.435+0000 7fb6ba7fc700 1 -- 172.21.2.105:0/3709746204 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6bc0ae2d0 con 0x7fb6bc0af750 2021-11-12T05:44:00.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.435+0000 7fb6ba7fc700 1 --2- 172.21.2.105:0/3709746204 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6bc0af750 0x7fb6bc062a90 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7fb6bc05d1b0 tx=0x7fb6a4006df0).ready entity=mon.0 client_cookie=58b55ac971e2bc56 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:00.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.435+0000 7fb6b9ffb700 1 -- 172.21.2.105:0/3709746204 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6a400d5c0 con 0x7fb6bc0af750 2021-11-12T05:44:00.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.435+0000 7fb6b9ffb700 1 -- 172.21.2.105:0/3709746204 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a4000e90 con 0x7fb6bc0af750 2021-11-12T05:44:00.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.435+0000 7fb6b9ffb700 1 -- 172.21.2.105:0/3709746204 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6a400d910 con 0x7fb6bc0af750 2021-11-12T05:44:00.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.439+0000 7fb6c14b0700 1 -- 172.21.2.105:0/3709746204 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6bc0af750 msgr2=0x7fb6bc062a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:00.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.439+0000 7fb6c14b0700 1 --2- 172.21.2.105:0/3709746204 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6bc0af750 0x7fb6bc062a90 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7fb6bc05d1b0 tx=0x7fb6a4006df0).stop 2021-11-12T05:44:00.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.439+0000 7fb6c14b0700 1 -- 172.21.2.105:0/3709746204 shutdown_connections 2021-11-12T05:44:00.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.439+0000 7fb6c14b0700 1 --2- 172.21.2.105:0/3709746204 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6bc0af750 0x7fb6bc062a90 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:00.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.439+0000 7fb6c14b0700 1 -- 172.21.2.105:0/3709746204 >> 172.21.2.105:0/3709746204 conn(0x7fb6bc0b5320 msgr2=0x7fb6bc0b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:00.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.439+0000 7fb6c14b0700 1 -- 172.21.2.105:0/3709746204 shutdown_connections 2021-11-12T05:44:00.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.439+0000 7fb6c14b0700 1 -- 172.21.2.105:0/3709746204 wait complete. 2021-11-12T05:44:00.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.439+0000 7fb6c14b0700 1 Processor -- start 2021-11-12T05:44:00.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.439+0000 7fb6c14b0700 1 -- start start 2021-11-12T05:44:00.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.439+0000 7fb6c14b0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb6bc0626b0 0x7fb6bc066ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:00.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.439+0000 7fb6c14b0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6bc0af750 0x7fb6bc0654b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:00.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.439+0000 7fb6c14b0700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb6bc130a80 0x7fb6bc064390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:00.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.439+0000 7fb6c14b0700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc14b250 con 0x7fb6bc0af750 2021-11-12T05:44:00.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.439+0000 7fb6c14b0700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc064a80 con 0x7fb6bc130a80 2021-11-12T05:44:00.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.439+0000 7fb6c14b0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc064d20 con 0x7fb6bc0626b0 2021-11-12T05:44:00.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.439+0000 7fb6ba7fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6bc0af750 0x7fb6bc0654b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:00.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.439+0000 7fb6ba7fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6bc0af750 0x7fb6bc0654b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45618/0 (socket says 172.21.2.105:45618) 2021-11-12T05:44:00.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.439+0000 7fb6ba7fc700 1 -- 172.21.2.105:0/2628543227 learned_addr learned my addr 172.21.2.105:0/2628543227 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:00.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.439+0000 7fb6ba7fc700 1 -- 172.21.2.105:0/2628543227 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb6bc0626b0 msgr2=0x7fb6bc066ba0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:44:00.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.439+0000 7fb6ba7fc700 1 --2- 172.21.2.105:0/2628543227 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb6bc0626b0 0x7fb6bc066ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:00.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.439+0000 7fb6ba7fc700 1 -- 172.21.2.105:0/2628543227 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb6bc130a80 msgr2=0x7fb6bc064390 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:44:00.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.439+0000 7fb6ba7fc700 1 --2- 172.21.2.105:0/2628543227 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb6bc130a80 0x7fb6bc064390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:00.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.439+0000 7fb6ba7fc700 1 -- 172.21.2.105:0/2628543227 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a400b180 con 0x7fb6bc0af750 2021-11-12T05:44:00.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.439+0000 7fb6ba7fc700 1 --2- 172.21.2.105:0/2628543227 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6bc0af750 0x7fb6bc0654b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7fb6bc05d1b0 tx=0x7fb6a4012000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:00.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.439+0000 7fb6b3fff700 1 -- 172.21.2.105:0/2628543227 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6a4002f50 con 0x7fb6bc0af750 2021-11-12T05:44:00.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.439+0000 7fb6b3fff700 1 -- 172.21.2.105:0/2628543227 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a4013d50 con 0x7fb6bc0af750 2021-11-12T05:44:00.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.439+0000 7fb6c14b0700 1 -- 172.21.2.105:0/2628543227 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6bc1576e0 con 0x7fb6bc0af750 2021-11-12T05:44:00.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.439+0000 7fb6c14b0700 1 -- 172.21.2.105:0/2628543227 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6bc131630 con 0x7fb6bc0af750 2021-11-12T05:44:00.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.439+0000 7fb6b3fff700 1 -- 172.21.2.105:0/2628543227 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6a401f640 con 0x7fb6bc0af750 2021-11-12T05:44:00.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.439+0000 7fb6c14b0700 1 -- 172.21.2.105:0/2628543227 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6bc064ee0 con 0x7fb6bc0af750 2021-11-12T05:44:00.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.439+0000 7fb6b3fff700 1 -- 172.21.2.105:0/2628543227 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb6a401c070 con 0x7fb6bc0af750 2021-11-12T05:44:00.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.439+0000 7fb6b3fff700 1 --2- 172.21.2.105:0/2628543227 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb6a0053660 0x7fb6a0055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:00.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.439+0000 7fb6b3fff700 1 -- 172.21.2.105:0/2628543227 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fb6a406c5c0 con 0x7fb6bc0af750 2021-11-12T05:44:00.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.439+0000 7fb6baffd700 1 --2- 172.21.2.105:0/2628543227 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb6a0053660 0x7fb6a0055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:00.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.439+0000 7fb6baffd700 1 --2- 172.21.2.105:0/2628543227 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb6a0053660 0x7fb6a0055b20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fb6bc0b0690 tx=0x7fb6ac007790).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:00.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.443+0000 7fb6b3fff700 1 -- 172.21.2.105:0/2628543227 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb6a4043790 con 0x7fb6bc0af750 2021-11-12T05:44:00.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.527+0000 7fb6c14b0700 1 -- 172.21.2.105:0/2628543227 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fb6bc0ae2d0 con 0x7fb6bc0af750 2021-11-12T05:44:00.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.527+0000 7fb6b3fff700 1 -- 172.21.2.105:0/2628543227 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v48) v1 ==== 81+0+29219 (secure 0 0 0) 0x7fb6bc0ae2d0 con 0x7fb6bc0af750 2021-11-12T05:44:00.533 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:44:00.533 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:44:00.534 INFO:teuthology.orchestra.run.gibba005.stdout: "epoch": 48, 2021-11-12T05:44:00.534 INFO:teuthology.orchestra.run.gibba005.stdout: "fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", 2021-11-12T05:44:00.534 INFO:teuthology.orchestra.run.gibba005.stdout: "created": "2021-11-12T05:40:19.986390+0000", 2021-11-12T05:44:00.534 INFO:teuthology.orchestra.run.gibba005.stdout: "modified": "2021-11-12T05:43:58.090669+0000", 2021-11-12T05:44:00.535 INFO:teuthology.orchestra.run.gibba005.stdout: "last_up_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:44:00.535 INFO:teuthology.orchestra.run.gibba005.stdout: "last_in_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:44:00.535 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-12T05:44:00.535 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_num": 5799936, 2021-11-12T05:44:00.536 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_set": [ 2021-11-12T05:44:00.536 INFO:teuthology.orchestra.run.gibba005.stdout: "pglog_hardlimit", 2021-11-12T05:44:00.536 INFO:teuthology.orchestra.run.gibba005.stdout: "purged_snapdirs", 2021-11-12T05:44:00.536 INFO:teuthology.orchestra.run.gibba005.stdout: "recovery_deletes", 2021-11-12T05:44:00.536 INFO:teuthology.orchestra.run.gibba005.stdout: "sortbitwise" 2021-11-12T05:44:00.537 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:44:00.537 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_version": 5, 2021-11-12T05:44:00.537 INFO:teuthology.orchestra.run.gibba005.stdout: "full_ratio": 0.94999998807907104, 2021-11-12T05:44:00.537 INFO:teuthology.orchestra.run.gibba005.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-12T05:44:00.538 INFO:teuthology.orchestra.run.gibba005.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-12T05:44:00.538 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_snapshot": "", 2021-11-12T05:44:00.538 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_max": 8, 2021-11-12T05:44:00.538 INFO:teuthology.orchestra.run.gibba005.stdout: "max_osd": 8, 2021-11-12T05:44:00.539 INFO:teuthology.orchestra.run.gibba005.stdout: "require_min_compat_client": "jewel", 2021-11-12T05:44:00.539 INFO:teuthology.orchestra.run.gibba005.stdout: "min_compat_client": "jewel", 2021-11-12T05:44:00.539 INFO:teuthology.orchestra.run.gibba005.stdout: "require_osd_release": "octopus", 2021-11-12T05:44:00.539 INFO:teuthology.orchestra.run.gibba005.stdout: "pools": [ 2021-11-12T05:44:00.540 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.540 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 1, 2021-11-12T05:44:00.540 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "device_health_metrics", 2021-11-12T05:44:00.540 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:22.022116+0000", 2021-11-12T05:44:00.540 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:44:00.541 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:44:00.541 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:44:00.541 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:44:00.542 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:44:00.542 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:44:00.542 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:44:00.542 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:44:00.542 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 1, 2021-11-12T05:44:00.543 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 1, 2021-11-12T05:44:00.543 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 1, 2021-11-12T05:44:00.543 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 1, 2021-11-12T05:44:00.543 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 1, 2021-11-12T05:44:00.544 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:44:00.544 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:44:00.544 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:44:00.544 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:44:00.545 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:44:00.545 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:44:00.545 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:44:00.545 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.545 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "16", 2021-11-12T05:44:00.546 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:44:00.546 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:44:00.546 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:44:00.546 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:44:00.546 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:44:00.547 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:44:00.547 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:44:00.547 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:44:00.547 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:44:00.548 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:44:00.548 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:44:00.548 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:44:00.548 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:44:00.548 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:44:00.549 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:44:00.549 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:44:00.549 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:44:00.549 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:44:00.549 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:44:00.550 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:44:00.550 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:44:00.550 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:44:00.550 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:44:00.551 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:44:00.551 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:44:00.551 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:44:00.552 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.552 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:44:00.552 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:44:00.552 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:44:00.553 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:44:00.553 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:44:00.553 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:44:00.553 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:44:00.554 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:44:00.554 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:44:00.554 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:44:00.554 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:44:00.555 INFO:teuthology.orchestra.run.gibba005.stdout: "options": { 2021-11-12T05:44:00.555 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_min": 1 2021-11-12T05:44:00.555 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.555 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:44:00.555 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr_devicehealth": {} 2021-11-12T05:44:00.556 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:00.556 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.556 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.556 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 2, 2021-11-12T05:44:00.556 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "rbd", 2021-11-12T05:44:00.557 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:29.953617+0000", 2021-11-12T05:44:00.557 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:44:00.557 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:44:00.557 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:44:00.558 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:44:00.558 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:44:00.558 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:44:00.558 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:44:00.559 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:44:00.559 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:44:00.559 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:44:00.559 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:44:00.560 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:44:00.560 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:44:00.560 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:44:00.560 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:44:00.560 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:44:00.561 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:44:00.561 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:44:00.561 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:44:00.561 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:44:00.561 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.562 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "19", 2021-11-12T05:44:00.562 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:44:00.562 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:44:00.563 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:44:00.563 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:44:00.563 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:44:00.563 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:44:00.564 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:44:00.564 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:44:00.564 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:44:00.564 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:44:00.564 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:44:00.565 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:44:00.565 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:44:00.565 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:44:00.565 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:44:00.566 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:44:00.566 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:44:00.566 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:44:00.566 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:44:00.567 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:44:00.567 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:44:00.567 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:44:00.567 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:44:00.567 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:44:00.568 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:44:00.568 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:44:00.568 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.569 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:44:00.569 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:44:00.569 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:44:00.569 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:44:00.570 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:44:00.570 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:44:00.570 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:44:00.570 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:44:00.570 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:44:00.571 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:44:00.571 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:44:00.571 INFO:teuthology.orchestra.run.gibba005.stdout: "options": {}, 2021-11-12T05:44:00.571 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:44:00.572 INFO:teuthology.orchestra.run.gibba005.stdout: "rbd": {} 2021-11-12T05:44:00.572 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:00.572 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:00.573 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:44:00.573 INFO:teuthology.orchestra.run.gibba005.stdout: "osds": [ 2021-11-12T05:44:00.573 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.573 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:44:00.573 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "ee8e30a0-4819-4475-80ec-dd3ee7d01322", 2021-11-12T05:44:00.574 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:44:00.574 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:44:00.574 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:44:00.574 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:44:00.575 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:44:00.575 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:44:00.575 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:44:00.575 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 42, 2021-11-12T05:44:00.575 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:44:00.576 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:44:00.576 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:44:00.576 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:44:00.576 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.576 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:44:00.577 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6802", 2021-11-12T05:44:00.577 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:44:00.577 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.577 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.578 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:44:00.578 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6803", 2021-11-12T05:44:00.578 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:44:00.578 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:00.579 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.579 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.579 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:44:00.579 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:44:00.580 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.580 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:44:00.581 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6804", 2021-11-12T05:44:00.581 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:44:00.581 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.581 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.582 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:44:00.582 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6805", 2021-11-12T05:44:00.582 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:44:00.583 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:00.583 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.583 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.584 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:44:00.584 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:44:00.584 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.584 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:44:00.585 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6808", 2021-11-12T05:44:00.585 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:44:00.585 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.586 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.586 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:44:00.586 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6809", 2021-11-12T05:44:00.586 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:44:00.587 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:00.587 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.587 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.587 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:44:00.588 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:44:00.588 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.588 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:44:00.588 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6806", 2021-11-12T05:44:00.589 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:44:00.589 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.589 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.589 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:44:00.590 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6807", 2021-11-12T05:44:00.590 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:44:00.590 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:00.591 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.591 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.591 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6803/14874", 2021-11-12T05:44:00.592 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6805/14874", 2021-11-12T05:44:00.592 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6809/14874", 2021-11-12T05:44:00.593 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6807/14874", 2021-11-12T05:44:00.593 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:44:00.593 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:44:00.594 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:44:00.594 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.595 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.595 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.595 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:44:00.595 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "b1bb06c3-26d0-4d92-82f8-b3e882242785", 2021-11-12T05:44:00.596 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:44:00.596 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:44:00.596 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:44:00.596 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:44:00.596 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:44:00.597 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:44:00.597 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:44:00.597 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 43, 2021-11-12T05:44:00.598 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:44:00.598 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:44:00.598 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:44:00.598 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:44:00.598 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.599 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:44:00.599 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6810", 2021-11-12T05:44:00.599 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:44:00.599 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.600 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.600 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:44:00.600 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6811", 2021-11-12T05:44:00.601 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:44:00.601 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:00.601 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.601 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.602 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:44:00.602 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:44:00.602 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.602 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:44:00.603 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6812", 2021-11-12T05:44:00.603 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:44:00.603 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.603 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.604 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:44:00.604 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6813", 2021-11-12T05:44:00.604 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:44:00.605 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:00.605 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.605 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.605 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:44:00.606 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:44:00.606 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.606 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:44:00.606 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6816", 2021-11-12T05:44:00.606 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:44:00.607 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.607 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.607 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:44:00.607 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6817", 2021-11-12T05:44:00.608 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:44:00.608 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:00.608 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.608 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.608 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:44:00.609 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:44:00.609 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.609 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:44:00.609 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6814", 2021-11-12T05:44:00.610 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:44:00.610 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.610 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.610 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:44:00.610 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6815", 2021-11-12T05:44:00.611 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:44:00.611 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:00.611 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.611 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.612 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6811/14875", 2021-11-12T05:44:00.612 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6813/14875", 2021-11-12T05:44:00.612 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6817/14875", 2021-11-12T05:44:00.612 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6815/14875", 2021-11-12T05:44:00.612 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:44:00.613 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:44:00.613 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:44:00.613 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.613 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.613 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.614 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:44:00.614 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "837b2c60-c335-4382-9f47-d86543a14022", 2021-11-12T05:44:00.614 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:44:00.615 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:44:00.615 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:44:00.615 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:44:00.615 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:44:00.616 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:44:00.616 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:44:00.616 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 31, 2021-11-12T05:44:00.616 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:44:00.617 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:44:00.617 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:44:00.617 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:44:00.618 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.618 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:44:00.618 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6818", 2021-11-12T05:44:00.618 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:44:00.618 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.619 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.619 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:44:00.619 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6819", 2021-11-12T05:44:00.619 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:44:00.620 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:00.620 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.620 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.620 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:44:00.621 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:44:00.621 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.621 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:44:00.622 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6820", 2021-11-12T05:44:00.622 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:44:00.622 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.623 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.623 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:44:00.623 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6821", 2021-11-12T05:44:00.623 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:44:00.623 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:00.624 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.624 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.624 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:44:00.625 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:44:00.625 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.625 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:44:00.626 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6824", 2021-11-12T05:44:00.626 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:44:00.627 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.627 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.627 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:44:00.627 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6825", 2021-11-12T05:44:00.627 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:44:00.628 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:00.628 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.628 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.628 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:44:00.629 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:44:00.629 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.629 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:44:00.629 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6822", 2021-11-12T05:44:00.629 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:44:00.630 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.630 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.630 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:44:00.630 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6823", 2021-11-12T05:44:00.631 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:44:00.631 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:00.631 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.631 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.632 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6819/14905", 2021-11-12T05:44:00.632 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6821/14905", 2021-11-12T05:44:00.633 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6825/14905", 2021-11-12T05:44:00.633 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6823/14905", 2021-11-12T05:44:00.633 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:44:00.634 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:44:00.634 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:44:00.635 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.635 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.635 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.635 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:44:00.636 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "eb2b737b-dda6-444b-a306-f33cbbd51f70", 2021-11-12T05:44:00.636 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:44:00.636 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:44:00.636 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:44:00.637 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:44:00.637 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:44:00.637 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:44:00.637 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:44:00.638 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 42, 2021-11-12T05:44:00.638 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:44:00.638 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:44:00.638 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:44:00.639 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:44:00.639 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.639 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:44:00.639 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6826", 2021-11-12T05:44:00.640 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:44:00.640 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.640 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.640 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:44:00.640 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6827", 2021-11-12T05:44:00.641 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:44:00.641 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:00.641 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.641 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.642 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:44:00.642 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:44:00.642 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.642 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:44:00.643 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6828", 2021-11-12T05:44:00.643 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:44:00.643 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.643 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.643 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:44:00.644 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6829", 2021-11-12T05:44:00.644 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:44:00.644 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:00.644 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.644 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.645 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:44:00.645 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:44:00.645 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.645 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:44:00.646 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6832", 2021-11-12T05:44:00.646 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:44:00.646 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.647 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.647 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:44:00.647 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6833", 2021-11-12T05:44:00.648 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:44:00.648 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:00.648 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.648 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.649 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:44:00.649 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:44:00.649 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.649 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:44:00.650 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6830", 2021-11-12T05:44:00.650 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:44:00.651 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.651 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.651 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:44:00.651 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6831", 2021-11-12T05:44:00.652 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:44:00.652 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:00.652 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.652 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.652 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6827/14876", 2021-11-12T05:44:00.653 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6829/14876", 2021-11-12T05:44:00.653 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6833/14876", 2021-11-12T05:44:00.653 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6831/14876", 2021-11-12T05:44:00.653 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:44:00.654 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:44:00.654 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:44:00.654 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.654 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.655 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.655 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:44:00.655 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "721529a1-c047-486a-a7ca-ddc15d80cdde", 2021-11-12T05:44:00.655 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:44:00.656 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:44:00.656 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:44:00.656 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:44:00.657 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:44:00.657 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:44:00.657 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:44:00.658 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 42, 2021-11-12T05:44:00.658 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:44:00.659 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:44:00.659 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:44:00.659 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:44:00.660 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.660 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:44:00.660 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6800", 2021-11-12T05:44:00.660 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:44:00.660 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.661 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.661 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:44:00.661 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6801", 2021-11-12T05:44:00.661 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:44:00.662 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:00.662 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.662 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.662 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:44:00.663 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:44:00.663 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.664 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:44:00.664 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6802", 2021-11-12T05:44:00.664 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:44:00.664 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.665 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.665 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:44:00.665 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6803", 2021-11-12T05:44:00.665 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:44:00.666 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:00.666 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.666 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.667 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:44:00.667 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:44:00.667 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.667 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:44:00.668 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6806", 2021-11-12T05:44:00.668 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:44:00.668 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.668 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.669 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:44:00.669 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6807", 2021-11-12T05:44:00.669 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:44:00.670 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:00.670 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.670 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.670 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:44:00.671 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:44:00.671 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.671 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:44:00.671 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6804", 2021-11-12T05:44:00.672 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:44:00.672 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.672 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.672 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:44:00.672 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6805", 2021-11-12T05:44:00.673 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:44:00.673 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:00.673 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.673 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.674 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6801/15096", 2021-11-12T05:44:00.674 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6803/15096", 2021-11-12T05:44:00.674 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6807/15096", 2021-11-12T05:44:00.674 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6805/15096", 2021-11-12T05:44:00.675 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:44:00.675 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:44:00.675 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:44:00.675 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.676 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.676 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.676 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:44:00.676 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "68b72ab2-fa82-4b5c-bf33-528f002e4950", 2021-11-12T05:44:00.677 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:44:00.677 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:44:00.677 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:44:00.677 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:44:00.677 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:44:00.678 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:44:00.678 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:44:00.679 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 42, 2021-11-12T05:44:00.679 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:44:00.680 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:44:00.680 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:44:00.680 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:44:00.681 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.681 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:44:00.682 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6808", 2021-11-12T05:44:00.682 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:44:00.682 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.683 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.683 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:44:00.684 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6809", 2021-11-12T05:44:00.684 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:44:00.685 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:00.685 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.685 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.686 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:44:00.686 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:44:00.687 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.687 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:44:00.688 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6810", 2021-11-12T05:44:00.688 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:44:00.688 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.689 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.689 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:44:00.690 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6811", 2021-11-12T05:44:00.690 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:44:00.691 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:00.691 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.691 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.692 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:44:00.692 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:44:00.693 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.693 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:44:00.694 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6814", 2021-11-12T05:44:00.694 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:44:00.695 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.695 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.695 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:44:00.696 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6815", 2021-11-12T05:44:00.696 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:44:00.697 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:00.697 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.698 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.698 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:44:00.699 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:44:00.699 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.699 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:44:00.700 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6812", 2021-11-12T05:44:00.700 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:44:00.701 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.701 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.701 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:44:00.702 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6813", 2021-11-12T05:44:00.702 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:44:00.703 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:00.703 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.703 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.704 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6809/15097", 2021-11-12T05:44:00.704 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6811/15097", 2021-11-12T05:44:00.704 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6815/15097", 2021-11-12T05:44:00.704 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6813/15097", 2021-11-12T05:44:00.705 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:44:00.705 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:44:00.705 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:44:00.706 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.706 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.706 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.707 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:44:00.707 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "a2c83b5d-8d37-4d30-ac04-30d89a76e485", 2021-11-12T05:44:00.707 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:44:00.707 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:44:00.708 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:44:00.708 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:44:00.708 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:44:00.709 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:44:00.709 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:44:00.709 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 42, 2021-11-12T05:44:00.710 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:44:00.710 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:44:00.710 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:44:00.711 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:44:00.711 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.711 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:44:00.712 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6816", 2021-11-12T05:44:00.712 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:44:00.713 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.713 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.714 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:44:00.714 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6817", 2021-11-12T05:44:00.714 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:44:00.715 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:00.715 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.716 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.716 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:44:00.717 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:44:00.717 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.718 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:44:00.718 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6818", 2021-11-12T05:44:00.718 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:44:00.719 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.719 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.720 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:44:00.720 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6819", 2021-11-12T05:44:00.721 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:44:00.721 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:00.722 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.722 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.722 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:44:00.723 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:44:00.723 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.724 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:44:00.724 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6822", 2021-11-12T05:44:00.725 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:44:00.725 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.726 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.726 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:44:00.727 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6823", 2021-11-12T05:44:00.727 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:44:00.727 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:00.728 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.728 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.728 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:44:00.729 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:44:00.729 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.729 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:44:00.729 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6820", 2021-11-12T05:44:00.730 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:44:00.730 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.730 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.730 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:44:00.730 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6821", 2021-11-12T05:44:00.731 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:44:00.731 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:00.731 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.731 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.732 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6817/15098", 2021-11-12T05:44:00.732 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6819/15098", 2021-11-12T05:44:00.732 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6823/15098", 2021-11-12T05:44:00.732 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6821/15098", 2021-11-12T05:44:00.732 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:44:00.733 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:44:00.733 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:44:00.733 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.733 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.734 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.734 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:44:00.734 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "786ce966-d0fb-4181-aed4-c26e3ef61c43", 2021-11-12T05:44:00.734 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:44:00.734 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:44:00.735 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:44:00.735 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:44:00.735 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:44:00.735 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:44:00.736 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:44:00.736 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 41, 2021-11-12T05:44:00.736 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:44:00.736 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:44:00.736 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:44:00.737 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:44:00.737 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.737 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:44:00.737 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6824", 2021-11-12T05:44:00.738 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:44:00.738 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.738 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.738 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:44:00.738 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6825", 2021-11-12T05:44:00.739 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:44:00.739 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:00.739 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.739 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.739 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:44:00.740 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:44:00.740 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.740 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:44:00.740 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6826", 2021-11-12T05:44:00.741 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:44:00.741 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.741 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.741 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:44:00.741 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6827", 2021-11-12T05:44:00.742 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:44:00.742 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:00.742 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.742 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.742 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:44:00.743 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:44:00.743 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.743 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:44:00.743 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6830", 2021-11-12T05:44:00.744 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:44:00.744 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.744 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.744 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:44:00.744 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6831", 2021-11-12T05:44:00.745 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:44:00.745 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:00.745 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.745 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.746 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:44:00.746 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:44:00.746 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.746 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:44:00.746 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6828", 2021-11-12T05:44:00.747 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:44:00.747 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.747 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.747 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:44:00.748 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6829", 2021-11-12T05:44:00.748 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:44:00.748 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:00.748 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.748 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.749 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6825/15099", 2021-11-12T05:44:00.749 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6827/15099", 2021-11-12T05:44:00.749 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6831/15099", 2021-11-12T05:44:00.749 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6829/15099", 2021-11-12T05:44:00.750 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:44:00.750 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:44:00.750 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:44:00.750 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:00.750 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:00.751 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:44:00.751 INFO:teuthology.orchestra.run.gibba005.stdout: "osd_xinfo": [ 2021-11-12T05:44:00.751 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.751 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:44:00.752 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:44:00.752 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:44:00.752 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:44:00.752 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:44:00.752 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:44:00.753 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.615112+0000", 2021-11-12T05:44:00.753 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:44:00.753 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.753 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.753 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:44:00.754 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:44:00.754 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:44:00.754 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:44:00.754 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:44:00.755 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:44:00.755 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.665935+0000", 2021-11-12T05:44:00.755 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:44:00.755 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.755 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.756 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:44:00.756 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:44:00.756 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:44:00.756 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:44:00.756 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:44:00.757 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:44:00.757 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.715877+0000", 2021-11-12T05:44:00.757 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:44:00.757 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.758 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.758 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:44:00.758 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:44:00.758 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:44:00.758 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:44:00.759 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:44:00.759 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:44:00.759 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.489234+0000", 2021-11-12T05:44:00.759 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:44:00.759 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.760 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.760 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:44:00.760 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:44:00.760 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:44:00.761 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:44:00.761 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:44:00.761 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:44:00.761 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.413776+0000", 2021-11-12T05:44:00.761 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:44:00.762 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.762 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.762 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:44:00.762 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:44:00.762 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:44:00.763 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:44:00.763 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:44:00.763 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:44:00.763 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.507960+0000", 2021-11-12T05:44:00.764 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:44:00.764 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.764 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.764 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:44:00.764 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:44:00.765 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:44:00.765 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:44:00.765 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:44:00.765 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:44:00.766 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.635696+0000", 2021-11-12T05:44:00.766 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:44:00.766 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.766 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:00.766 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:44:00.767 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:44:00.767 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:44:00.767 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:44:00.767 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:44:00.767 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:44:00.768 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.746949+0000", 2021-11-12T05:44:00.768 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:44:00.768 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:00.768 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:44:00.769 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap": [], 2021-11-12T05:44:00.769 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap_items": [], 2021-11-12T05:44:00.769 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_temp": [], 2021-11-12T05:44:00.769 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_temp": [], 2021-11-12T05:44:00.769 INFO:teuthology.orchestra.run.gibba005.stdout: "blacklist": { 2021-11-12T05:44:00.770 INFO:teuthology.orchestra.run.gibba005.stdout: "172.21.2.105:6835/3058129917": "2021-11-13T05:43:54.177087+0000", 2021-11-12T05:44:00.770 INFO:teuthology.orchestra.run.gibba005.stdout: "172.21.2.105:6834/3058129917": "2021-11-13T05:43:54.177087+0000" 2021-11-12T05:44:00.770 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.770 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profiles": { 2021-11-12T05:44:00.771 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs_data": { 2021-11-12T05:44:00.771 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-device-class": "", 2021-11-12T05:44:00.771 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:44:00.771 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-root": "default", 2021-11-12T05:44:00.771 INFO:teuthology.orchestra.run.gibba005.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-12T05:44:00.772 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:44:00.772 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "2", 2021-11-12T05:44:00.772 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:44:00.772 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:44:00.773 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van", 2021-11-12T05:44:00.773 INFO:teuthology.orchestra.run.gibba005.stdout: "w": "8" 2021-11-12T05:44:00.773 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.773 INFO:teuthology.orchestra.run.gibba005.stdout: "default": { 2021-11-12T05:44:00.773 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:44:00.774 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:44:00.774 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "1", 2021-11-12T05:44:00.774 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:44:00.774 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:44:00.775 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van" 2021-11-12T05:44:00.775 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:00.775 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:00.775 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps_queue": [], 2021-11-12T05:44:00.775 INFO:teuthology.orchestra.run.gibba005.stdout: "new_removed_snaps": [], 2021-11-12T05:44:00.776 INFO:teuthology.orchestra.run.gibba005.stdout: "new_purged_snaps": [], 2021-11-12T05:44:00.776 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_node_flags": {}, 2021-11-12T05:44:00.776 INFO:teuthology.orchestra.run.gibba005.stdout: "device_class_flags": {} 2021-11-12T05:44:00.776 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:44:00.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.527+0000 7fb6c14b0700 1 -- 172.21.2.105:0/2628543227 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb6a0053660 msgr2=0x7fb6a0055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:00.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.527+0000 7fb6c14b0700 1 --2- 172.21.2.105:0/2628543227 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb6a0053660 0x7fb6a0055b20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fb6bc0b0690 tx=0x7fb6ac007790).stop 2021-11-12T05:44:00.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.527+0000 7fb6c14b0700 1 -- 172.21.2.105:0/2628543227 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6bc0af750 msgr2=0x7fb6bc0654b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:00.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.527+0000 7fb6c14b0700 1 --2- 172.21.2.105:0/2628543227 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6bc0af750 0x7fb6bc0654b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7fb6bc05d1b0 tx=0x7fb6a4012000).stop 2021-11-12T05:44:00.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.527+0000 7fb6c14b0700 1 -- 172.21.2.105:0/2628543227 shutdown_connections 2021-11-12T05:44:00.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.527+0000 7fb6c14b0700 1 --2- 172.21.2.105:0/2628543227 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb6a0053660 0x7fb6a0055b20 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:00.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.527+0000 7fb6c14b0700 1 --2- 172.21.2.105:0/2628543227 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb6bc130a80 0x7fb6bc064390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:00.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.527+0000 7fb6c14b0700 1 --2- 172.21.2.105:0/2628543227 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6bc0af750 0x7fb6bc0654b0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:00.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.527+0000 7fb6c14b0700 1 --2- 172.21.2.105:0/2628543227 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb6bc0626b0 0x7fb6bc066ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:00.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.527+0000 7fb6c14b0700 1 -- 172.21.2.105:0/2628543227 >> 172.21.2.105:0/2628543227 conn(0x7fb6bc0b5320 msgr2=0x7fb6bc0b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:00.781 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.527+0000 7fb6c14b0700 1 -- 172.21.2.105:0/2628543227 shutdown_connections 2021-11-12T05:44:00.781 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.527+0000 7fb6c14b0700 1 -- 172.21.2.105:0/2628543227 wait complete. 2021-11-12T05:44:00.781 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:44:00.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.831+0000 7fe026c07700 1 Processor -- start 2021-11-12T05:44:00.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.831+0000 7fe026c07700 1 -- start start 2021-11-12T05:44:00.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.831+0000 7fe026c07700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe0200b4500 0x7fe0200b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:00.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.831+0000 7fe026c07700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fe0200b4e40 0x7fe0200b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:00.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.831+0000 7fe026c07700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0200b40a0 con 0x7fe0200b97a0 2021-11-12T05:44:00.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.831+0000 7fe026c07700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0200b9b80 con 0x7fe0200b4500 2021-11-12T05:44:00.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.831+0000 7fe026c07700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe020062710 con 0x7fe0200b4e40 2021-11-12T05:44:00.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.831+0000 7fe025404700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe0200b4500 0x7fe0200b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:00.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.831+0000 7fe025404700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe0200b4500 0x7fe0200b4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45626/0 (socket says 172.21.2.105:45626) 2021-11-12T05:44:00.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.831+0000 7fe025404700 1 -- 172.21.2.105:0/2487572766 learned_addr learned my addr 172.21.2.105:0/2487572766 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:00.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.831+0000 7fe025404700 1 -- 172.21.2.105:0/2487572766 >> v2:172.21.2.115:3300/0 conn(0x7fe0200b4e40 msgr2=0x7fe0200b5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:00.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.831+0000 7fe025404700 1 --2- 172.21.2.105:0/2487572766 >> v2:172.21.2.115:3300/0 conn(0x7fe0200b4e40 0x7fe0200b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:00.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.831+0000 7fe025404700 1 -- 172.21.2.105:0/2487572766 >> v1:172.21.2.115:6789/0 conn(0x7fe0200b97a0 legacy=0x7fe020143780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:00.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.831+0000 7fe025404700 1 -- 172.21.2.105:0/2487572766 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0200629b0 con 0x7fe0200b4500 2021-11-12T05:44:00.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.835+0000 7fe025404700 1 --2- 172.21.2.105:0/2487572766 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe0200b4500 0x7fe0200b4950 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7fe020142e30 tx=0x7fe010006eb0).ready entity=mon.0 client_cookie=e17ed31194aeb0ff server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:00.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.835+0000 7fe024c03700 1 -- 172.21.2.105:0/2487572766 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe01000d5c0 con 0x7fe0200b4500 2021-11-12T05:44:00.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.835+0000 7fe024c03700 1 -- 172.21.2.105:0/2487572766 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe010000e90 con 0x7fe0200b4500 2021-11-12T05:44:00.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.835+0000 7fe024c03700 1 -- 172.21.2.105:0/2487572766 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe01000d950 con 0x7fe0200b4500 2021-11-12T05:44:00.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.835+0000 7fe026c07700 1 -- 172.21.2.105:0/2487572766 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe0200b4500 msgr2=0x7fe0200b4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:00.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.835+0000 7fe026c07700 1 --2- 172.21.2.105:0/2487572766 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe0200b4500 0x7fe0200b4950 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7fe020142e30 tx=0x7fe010006eb0).stop 2021-11-12T05:44:00.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.835+0000 7fe026c07700 1 -- 172.21.2.105:0/2487572766 shutdown_connections 2021-11-12T05:44:00.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.835+0000 7fe026c07700 1 --2- 172.21.2.105:0/2487572766 >> v2:172.21.2.115:3300/0 conn(0x7fe0200b4e40 0x7fe0200b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:00.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.835+0000 7fe026c07700 1 --2- 172.21.2.105:0/2487572766 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe0200b4500 0x7fe0200b4950 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:00.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.835+0000 7fe026c07700 1 -- 172.21.2.105:0/2487572766 >> 172.21.2.105:0/2487572766 conn(0x7fe02005c490 msgr2=0x7fe0200608d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:00.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.835+0000 7fe026c07700 1 -- 172.21.2.105:0/2487572766 shutdown_connections 2021-11-12T05:44:00.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.835+0000 7fe026c07700 1 -- 172.21.2.105:0/2487572766 wait complete. 2021-11-12T05:44:00.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.835+0000 7fe026c07700 1 Processor -- start 2021-11-12T05:44:00.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.835+0000 7fe026c07700 1 -- start start 2021-11-12T05:44:00.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.835+0000 7fe026c07700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe0200b4500 0x7fe020144cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:00.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.835+0000 7fe026c07700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe0200b4e40 0x7fe0201523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:00.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.835+0000 7fe026c07700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe0200b97a0 0x7fe020152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:00.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.835+0000 7fe026c07700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02013cf20 con 0x7fe0200b4500 2021-11-12T05:44:00.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.835+0000 7fe026c07700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0200aefb0 con 0x7fe0200b97a0 2021-11-12T05:44:00.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.835+0000 7fe026c07700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0201442d0 con 0x7fe0200b4e40 2021-11-12T05:44:00.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.835+0000 7fe025c05700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe0200b4500 0x7fe020144cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:00.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.835+0000 7fe025c05700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe0200b4500 0x7fe020144cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45630/0 (socket says 172.21.2.105:45630) 2021-11-12T05:44:00.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.835+0000 7fe025c05700 1 -- 172.21.2.105:0/3032375578 learned_addr learned my addr 172.21.2.105:0/3032375578 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:00.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.835+0000 7fe025c05700 1 -- 172.21.2.105:0/3032375578 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe0200b4e40 msgr2=0x7fe0201523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:00.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.835+0000 7fe025c05700 1 --2- 172.21.2.105:0/3032375578 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe0200b4e40 0x7fe0201523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:00.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.835+0000 7fe025c05700 1 -- 172.21.2.105:0/3032375578 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe0200b97a0 msgr2=0x7fe020152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:00.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.835+0000 7fe025c05700 1 --2- 172.21.2.105:0/3032375578 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe0200b97a0 0x7fe020152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:00.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.835+0000 7fe025c05700 1 -- 172.21.2.105:0/3032375578 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01000b1e0 con 0x7fe0200b4500 2021-11-12T05:44:00.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.835+0000 7fe025c05700 1 --2- 172.21.2.105:0/3032375578 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe0200b4500 0x7fe020144cb0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7fe01c002f10 tx=0x7fe01c006d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:00.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.835+0000 7fe00effd700 1 -- 172.21.2.105:0/3032375578 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe01c00f510 con 0x7fe0200b4500 2021-11-12T05:44:00.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.835+0000 7fe00effd700 1 -- 172.21.2.105:0/3032375578 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe01c00f670 con 0x7fe0200b4500 2021-11-12T05:44:00.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.835+0000 7fe00effd700 1 -- 172.21.2.105:0/3032375578 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe01c00f7e0 con 0x7fe0200b4500 2021-11-12T05:44:00.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.835+0000 7fe026c07700 1 -- 172.21.2.105:0/3032375578 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0200afa90 con 0x7fe0200b4500 2021-11-12T05:44:00.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.835+0000 7fe026c07700 1 -- 172.21.2.105:0/3032375578 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe020145df0 con 0x7fe0200b4500 2021-11-12T05:44:00.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.839+0000 7fe026c07700 1 -- 172.21.2.105:0/3032375578 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0200afc20 con 0x7fe0200b4500 2021-11-12T05:44:00.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.839+0000 7fe00effd700 1 -- 172.21.2.105:0/3032375578 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe01c017020 con 0x7fe0200b4500 2021-11-12T05:44:00.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.839+0000 7fe00effd700 1 --2- 172.21.2.105:0/3032375578 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe0000536f0 0x7fe000055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:00.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.839+0000 7fe00effd700 1 -- 172.21.2.105:0/3032375578 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fe01c06b060 con 0x7fe0200b4500 2021-11-12T05:44:00.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.839+0000 7fe025404700 1 --2- 172.21.2.105:0/3032375578 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe0000536f0 0x7fe000055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:00.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.839+0000 7fe025404700 1 --2- 172.21.2.105:0/3032375578 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe0000536f0 0x7fe000055bb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fe020142e30 tx=0x7fe010015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:00.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.839+0000 7fe00effd700 1 -- 172.21.2.105:0/3032375578 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe01c042230 con 0x7fe0200b4500 2021-11-12T05:44:00.951 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.947+0000 7fe026c07700 1 -- 172.21.2.105:0/3032375578 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe02013d060 con 0x7fe0200b4500 2021-11-12T05:44:00.951 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.947+0000 7fe00effd700 1 -- 172.21.2.105:0/3032375578 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+1209 (secure 0 0 0) 0x7fe01c045850 con 0x7fe0200b4500 2021-11-12T05:44:00.952 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:44:00.952 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":17,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4403,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/3185091424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":3185091424},{"type":"v1","addr":"172.21.2.115:6833","nonce":3185091424}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14},{"gid":5529,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.105:6835/2389143569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":2389143569},{"type":"v1","addr":"172.21.2.105:6835","nonce":2389143569}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17}],"filesystems":[]} 2021-11-12T05:44:00.953 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.947+0000 7fe026c07700 1 -- 172.21.2.105:0/3032375578 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe0000536f0 msgr2=0x7fe000055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:00.954 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.947+0000 7fe026c07700 1 --2- 172.21.2.105:0/3032375578 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe0000536f0 0x7fe000055bb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fe020142e30 tx=0x7fe010015000).stop 2021-11-12T05:44:00.954 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.947+0000 7fe026c07700 1 -- 172.21.2.105:0/3032375578 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe0200b4500 msgr2=0x7fe020144cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:00.954 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.947+0000 7fe026c07700 1 --2- 172.21.2.105:0/3032375578 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe0200b4500 0x7fe020144cb0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7fe01c002f10 tx=0x7fe01c006d70).stop 2021-11-12T05:44:00.954 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.947+0000 7fe026c07700 1 -- 172.21.2.105:0/3032375578 shutdown_connections 2021-11-12T05:44:00.955 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.947+0000 7fe026c07700 1 --2- 172.21.2.105:0/3032375578 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe0000536f0 0x7fe000055bb0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:00.955 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.947+0000 7fe026c07700 1 --2- 172.21.2.105:0/3032375578 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe0200b97a0 0x7fe020152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:00.955 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.947+0000 7fe026c07700 1 --2- 172.21.2.105:0/3032375578 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe0200b4e40 0x7fe0201523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:00.955 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.947+0000 7fe026c07700 1 --2- 172.21.2.105:0/3032375578 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe0200b4500 0x7fe020144cb0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:00.956 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.947+0000 7fe026c07700 1 -- 172.21.2.105:0/3032375578 >> 172.21.2.105:0/3032375578 conn(0x7fe02005c490 msgr2=0x7fe020143210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:00.956 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.947+0000 7fe026c07700 1 -- 172.21.2.105:0/3032375578 shutdown_connections 2021-11-12T05:44:00.956 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:00.947+0000 7fe026c07700 1 -- 172.21.2.105:0/3032375578 wait complete. 2021-11-12T05:44:00.956 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 17 2021-11-12T05:44:00.959 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:44:01.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.007+0000 7f31dcae7700 1 Processor -- start 2021-11-12T05:44:01.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.007+0000 7f31dcae7700 1 -- start start 2021-11-12T05:44:01.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31dcae7700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f31d805fb00 0x7f31d805fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:01.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31dcae7700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d81429a0 con 0x7f31d813f220 2021-11-12T05:44:01.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31dcae7700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d8142c40 con 0x7f31d8067180 2021-11-12T05:44:01.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31dcae7700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31d81437f0 con 0x7f31d805fb00 2021-11-12T05:44:01.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31d6d9d700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f31d813f220 0x7f31d80af100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:56038/0 (socket says 172.21.2.105:56038) 2021-11-12T05:44:01.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31d6d9d700 1 -- 172.21.2.105:0/145816195 learned_addr learned my addr 172.21.2.105:0/145816195 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:44:01.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31d659c700 1 --2- 172.21.2.105:0/145816195 >> v2:172.21.2.115:3300/0 conn(0x7f31d805fb00 0x7f31d805fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:01.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31d559a700 1 -- 172.21.2.105:0/145816195 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1242517883 0 0) 0x7f31d81429a0 con 0x7f31d813f220 2021-11-12T05:44:01.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31d559a700 1 -- 172.21.2.105:0/145816195 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31bc005470 con 0x7f31d813f220 2021-11-12T05:44:01.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31d559a700 1 -- 172.21.2.105:0/145816195 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3432042639 0 0) 0x7f31bc005470 con 0x7f31d813f220 2021-11-12T05:44:01.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31d559a700 1 -- 172.21.2.105:0/145816195 >> v2:172.21.2.115:3300/0 conn(0x7f31d805fb00 msgr2=0x7f31d805fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:01.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31d559a700 1 --2- 172.21.2.105:0/145816195 >> v2:172.21.2.115:3300/0 conn(0x7f31d805fb00 0x7f31d805fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:01.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31d559a700 1 -- 172.21.2.105:0/145816195 >> v1:172.21.2.115:6789/0 conn(0x7f31d8067180 legacy=0x7f31d81430e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:01.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31d559a700 1 -- 172.21.2.105:0/145816195 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d80b1800 con 0x7f31d813f220 2021-11-12T05:44:01.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31d559a700 1 -- 172.21.2.105:0/145816195 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f31c8004a00 con 0x7f31d813f220 2021-11-12T05:44:01.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31d559a700 1 -- 172.21.2.105:0/145816195 >> v1:172.21.2.105:6789/0 conn(0x7f31d813f220 legacy=0x7f31d80af100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:01.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31d559a700 1 --2- 172.21.2.105:0/145816195 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f31bc005960 0x7f31bc005d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:01.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31d559a700 1 --2- 172.21.2.105:0/145816195 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f31bc006710 0x7f31bc006b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:01.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31d559a700 1 --2- 172.21.2.105:0/145816195 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f31bc0070d0 0x7f31bc00d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:01.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31d559a700 1 -- 172.21.2.105:0/145816195 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d81437f0 con 0x7f31bc005960 2021-11-12T05:44:01.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31d559a700 1 -- 172.21.2.105:0/145816195 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc00dfb0 con 0x7f31bc0070d0 2021-11-12T05:44:01.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31d559a700 1 -- 172.21.2.105:0/145816195 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc00e170 con 0x7f31bc006710 2021-11-12T05:44:01.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31d659c700 1 --2- 172.21.2.105:0/145816195 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f31bc005960 0x7f31bc005d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:01.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31d659c700 1 -- 172.21.2.105:0/145816195 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f31bc006710 msgr2=0x7f31bc006b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:01.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31d659c700 1 --2- 172.21.2.105:0/145816195 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f31bc006710 0x7f31bc006b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:01.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31d659c700 1 -- 172.21.2.105:0/145816195 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f31bc0070d0 msgr2=0x7f31bc00d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:01.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31d659c700 1 --2- 172.21.2.105:0/145816195 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f31bc0070d0 0x7f31bc00d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:01.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31d659c700 1 -- 172.21.2.105:0/145816195 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31bc005470 con 0x7f31bc005960 2021-11-12T05:44:01.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31d6d9d700 1 -- 172.21.2.105:0/145816195 reap_dead start 2021-11-12T05:44:01.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31d659c700 1 --2- 172.21.2.105:0/145816195 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f31bc005960 0x7f31bc005d80 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f31d000a000 tx=0x7f31d000b330).ready entity=mon.0 client_cookie=f0e08cca08f7d99b server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:01.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31d559a700 1 -- 172.21.2.105:0/145816195 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31d000d9d0 con 0x7f31bc005960 2021-11-12T05:44:01.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31d559a700 1 -- 172.21.2.105:0/145816195 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d000db30 con 0x7f31bc005960 2021-11-12T05:44:01.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31d559a700 1 -- 172.21.2.105:0/145816195 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31d000de90 con 0x7f31bc005960 2021-11-12T05:44:01.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31dcae7700 1 -- 172.21.2.105:0/145816195 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f31bc005960 msgr2=0x7f31bc005d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:01.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31dcae7700 1 --2- 172.21.2.105:0/145816195 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f31bc005960 0x7f31bc005d80 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f31d000a000 tx=0x7f31d000b330).stop 2021-11-12T05:44:01.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31dcae7700 1 -- 172.21.2.105:0/145816195 shutdown_connections 2021-11-12T05:44:01.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31dcae7700 1 --2- 172.21.2.105:0/145816195 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f31bc005960 0x7f31bc005d80 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:01.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31dcae7700 1 -- 172.21.2.105:0/145816195 >> 172.21.2.105:0/145816195 conn(0x7f31d80b5370 msgr2=0x7f31d80b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:01.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31dcae7700 1 -- 172.21.2.105:0/145816195 shutdown_connections 2021-11-12T05:44:01.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31dcae7700 1 -- 172.21.2.105:0/145816195 wait complete. 2021-11-12T05:44:01.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31dcae7700 1 Processor -- start 2021-11-12T05:44:01.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.011+0000 7f31dcae7700 1 -- start start 2021-11-12T05:44:01.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.015+0000 7f31dcae7700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f31bc005960 0x7f31d813dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:01.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.015+0000 7f31dcae7700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f31d813b0e0 0x7f31d8139e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:01.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.015+0000 7f31dcae7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f31d813a370 0x7f31d814e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:01.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.015+0000 7f31dcae7700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d8063660 con 0x7f31d813a370 2021-11-12T05:44:01.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.015+0000 7f31dcae7700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d813c510 con 0x7f31d813b0e0 2021-11-12T05:44:01.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.015+0000 7f31dcae7700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d813eb80 con 0x7f31bc005960 2021-11-12T05:44:01.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.015+0000 7f31d6d9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f31d813a370 0x7f31d814e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:01.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.015+0000 7f31d6d9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f31d813a370 0x7f31d814e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45654/0 (socket says 172.21.2.105:45654) 2021-11-12T05:44:01.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.015+0000 7f31d6d9d700 1 -- 172.21.2.105:0/2633249144 learned_addr learned my addr 172.21.2.105:0/2633249144 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:01.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.015+0000 7f31d6d9d700 1 -- 172.21.2.105:0/2633249144 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f31bc005960 msgr2=0x7f31d813dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:01.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.015+0000 7f31d6d9d700 1 --2- 172.21.2.105:0/2633249144 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f31bc005960 0x7f31d813dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:01.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.015+0000 7f31d6d9d700 1 -- 172.21.2.105:0/2633249144 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f31d813b0e0 msgr2=0x7f31d8139e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:01.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.015+0000 7f31d5d9b700 1 --2- 172.21.2.105:0/2633249144 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f31d813b0e0 0x7f31d8139e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:01.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.015+0000 7f31d6d9d700 1 --2- 172.21.2.105:0/2633249144 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f31d813b0e0 0x7f31d8139e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:01.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.015+0000 7f31d6d9d700 1 -- 172.21.2.105:0/2633249144 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d8062900 con 0x7f31d813a370 2021-11-12T05:44:01.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.015+0000 7f31d6d9d700 1 --2- 172.21.2.105:0/2633249144 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f31d813a370 0x7f31d814e910 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f31d80af0c0 tx=0x7f31c8004a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:01.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.015+0000 7f31c77fe700 1 -- 172.21.2.105:0/2633249144 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31c8014410 con 0x7f31d813a370 2021-11-12T05:44:01.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.015+0000 7f31c77fe700 1 -- 172.21.2.105:0/2633249144 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c8014570 con 0x7f31d813a370 2021-11-12T05:44:01.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.015+0000 7f31dcae7700 1 -- 172.21.2.105:0/2633249144 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31d8062660 con 0x7f31d813a370 2021-11-12T05:44:01.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.015+0000 7f31c77fe700 1 -- 172.21.2.105:0/2633249144 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31c80148d0 con 0x7f31d813a370 2021-11-12T05:44:01.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.015+0000 7f31dcae7700 1 -- 172.21.2.105:0/2633249144 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d813c7c0 con 0x7f31d813a370 2021-11-12T05:44:01.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.015+0000 7f31dcae7700 1 -- 172.21.2.105:0/2633249144 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31d814e6b0 con 0x7f31d813a370 2021-11-12T05:44:01.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.015+0000 7f31c77fe700 1 -- 172.21.2.105:0/2633249144 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f31c801b070 con 0x7f31d813a370 2021-11-12T05:44:01.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.015+0000 7f31c77fe700 1 --2- 172.21.2.105:0/2633249144 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f31b4053610 0x7f31b4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:01.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.015+0000 7f31c77fe700 1 -- 172.21.2.105:0/2633249144 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f31c806afd0 con 0x7f31d813a370 2021-11-12T05:44:01.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.015+0000 7f31d659c700 1 --2- 172.21.2.105:0/2633249144 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f31b4053610 0x7f31b4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:01.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.015+0000 7f31d659c700 1 --2- 172.21.2.105:0/2633249144 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f31b4053610 0x7f31b4055ad0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f31d000a000 tx=0x7f31d001a000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:01.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.019+0000 7f31c77fe700 1 -- 172.21.2.105:0/2633249144 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f31c80422b0 con 0x7f31d813a370 2021-11-12T05:44:01.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.127+0000 7f31dcae7700 1 -- 172.21.2.105:0/2633249144 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31d80b0f30 con 0x7f31d813a370 2021-11-12T05:44:01.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.127+0000 7f31c77fe700 1 -- 172.21.2.105:0/2633249144 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+1209 (secure 0 0 0) 0x7f31c80458d0 con 0x7f31d813a370 2021-11-12T05:44:01.132 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:44:01.133 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":17,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4403,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/3185091424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":3185091424},{"type":"v1","addr":"172.21.2.115:6833","nonce":3185091424}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14},{"gid":5529,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.105:6835/2389143569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":2389143569},{"type":"v1","addr":"172.21.2.105:6835","nonce":2389143569}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17}],"filesystems":[]} 2021-11-12T05:44:01.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.127+0000 7f31dcae7700 1 -- 172.21.2.105:0/2633249144 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f31b4053610 msgr2=0x7f31b4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:01.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.127+0000 7f31dcae7700 1 --2- 172.21.2.105:0/2633249144 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f31b4053610 0x7f31b4055ad0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f31d000a000 tx=0x7f31d001a000).stop 2021-11-12T05:44:01.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.127+0000 7f31dcae7700 1 -- 172.21.2.105:0/2633249144 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f31d813a370 msgr2=0x7f31d814e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:01.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.127+0000 7f31dcae7700 1 --2- 172.21.2.105:0/2633249144 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f31d813a370 0x7f31d814e910 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f31d80af0c0 tx=0x7f31c8004a80).stop 2021-11-12T05:44:01.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.127+0000 7f31dcae7700 1 -- 172.21.2.105:0/2633249144 shutdown_connections 2021-11-12T05:44:01.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.127+0000 7f31dcae7700 1 --2- 172.21.2.105:0/2633249144 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f31b4053610 0x7f31b4055ad0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:01.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.127+0000 7f31dcae7700 1 --2- 172.21.2.105:0/2633249144 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f31d813a370 0x7f31d814e910 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:01.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.127+0000 7f31dcae7700 1 --2- 172.21.2.105:0/2633249144 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f31d813b0e0 0x7f31d8139e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:01.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.127+0000 7f31dcae7700 1 --2- 172.21.2.105:0/2633249144 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f31bc005960 0x7f31d813dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:01.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.127+0000 7f31dcae7700 1 -- 172.21.2.105:0/2633249144 >> 172.21.2.105:0/2633249144 conn(0x7f31d80b5370 msgr2=0x7f31d80abcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:01.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.127+0000 7f31dcae7700 1 -- 172.21.2.105:0/2633249144 shutdown_connections 2021-11-12T05:44:01.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.127+0000 7f31dcae7700 1 -- 172.21.2.105:0/2633249144 wait complete. 2021-11-12T05:44:01.137 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 17 2021-11-12T05:44:01.140 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-12T05:44:01.140 INFO:tasks.ceph.mds.a:Stopping old one... 2021-11-12T05:44:01.140 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-12T05:44:01.141 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T05:44:01.141 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-12T05:44:01.141 INFO:tasks.ceph.mds.b:Stopping old one... 2021-11-12T05:44:01.142 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-12T05:44:01.142 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T05:44:01.146 INFO:tasks.ceph.mds.a:Stopped 2021-11-12T05:44:01.147 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-12T05:44:01.148 INFO:tasks.ceph.mds.b:Stopped 2021-11-12T05:44:01.149 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-12T05:44:01.150 INFO:tasks.ceph.mds.a:Started 2021-11-12T05:44:01.151 DEBUG:teuthology.parallel:result is None 2021-11-12T05:44:01.152 INFO:tasks.ceph.mds.b:Started 2021-11-12T05:44:01.152 DEBUG:teuthology.parallel:result is None 2021-11-12T05:44:01.152 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-11-12T05:44:01.183 INFO:tasks.ceph.mds.a.gibba005.stdout:starting mds.a at 2021-11-12T05:44:01.186 INFO:tasks.ceph.mds.b.gibba015.stdout:starting mds.b at 2021-11-12T05:44:01.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faed10c0700 1 Processor -- start 2021-11-12T05:44:01.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faed10c0700 1 -- start start 2021-11-12T05:44:01.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faed10c0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7faecc060a00 0x7faecc0b0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:01.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faed10c0700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7faecc0adbc0 0x7faecc147880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:01.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faed10c0700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faecc0ae000 con 0x7faecc147d70 2021-11-12T05:44:01.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faed10c0700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faecc060de0 con 0x7faecc0adbc0 2021-11-12T05:44:01.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faed10c0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faecc0ad860 con 0x7faecc060a00 2021-11-12T05:44:01.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faecb7fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7faecc0adbc0 0x7faecc147880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:01.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faecb7fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7faecc0adbc0 0x7faecc147880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45674/0 (socket says 172.21.2.105:45674) 2021-11-12T05:44:01.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faecb7fe700 1 -- 172.21.2.105:0/2710009420 learned_addr learned my addr 172.21.2.105:0/2710009420 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:01.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faed08bf700 1 --1- 172.21.2.105:0/2710009420 >> v1:172.21.2.115:6789/0 conn(0x7faecc147d70 0x7faecc14a710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:54534/0 (socket says 172.21.2.105:54534) 2021-11-12T05:44:01.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faecbfff700 1 --2- 172.21.2.105:0/2710009420 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7faecc060a00 0x7faecc0b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:01.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faecb7fe700 1 -- 172.21.2.105:0/2710009420 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7faecc060a00 msgr2=0x7faecc0b0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:01.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faecb7fe700 1 --2- 172.21.2.105:0/2710009420 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7faecc060a00 0x7faecc0b0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:01.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faecb7fe700 1 -- 172.21.2.105:0/2710009420 >> v1:172.21.2.115:6789/0 conn(0x7faecc147d70 legacy=0x7faecc14a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:01.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faecb7fe700 1 -- 172.21.2.105:0/2710009420 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faecc1473e0 con 0x7faecc0adbc0 2021-11-12T05:44:01.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faecbfff700 1 --2- 172.21.2.105:0/2710009420 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7faecc060a00 0x7faecc0b0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-12T05:44:01.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faecb7fe700 1 --2- 172.21.2.105:0/2710009420 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faecc0adbc0 0x7faecc147880 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7faec0002f70 tx=0x7faec0006eb0).ready entity=mon.0 client_cookie=32e7ba1e4b3a1fd5 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:01.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faecaffd700 1 -- 172.21.2.105:0/2710009420 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faec000d570 con 0x7faecc0adbc0 2021-11-12T05:44:01.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faecaffd700 1 -- 172.21.2.105:0/2710009420 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec0000e90 con 0x7faecc0adbc0 2021-11-12T05:44:01.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faecaffd700 1 -- 172.21.2.105:0/2710009420 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faec000d900 con 0x7faecc0adbc0 2021-11-12T05:44:01.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faed10c0700 1 -- 172.21.2.105:0/2710009420 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faecc0adbc0 msgr2=0x7faecc147880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:01.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faed10c0700 1 --2- 172.21.2.105:0/2710009420 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faecc0adbc0 0x7faecc147880 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7faec0002f70 tx=0x7faec0006eb0).stop 2021-11-12T05:44:01.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faed10c0700 1 -- 172.21.2.105:0/2710009420 shutdown_connections 2021-11-12T05:44:01.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faed10c0700 1 --2- 172.21.2.105:0/2710009420 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faecc0adbc0 0x7faecc147880 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:01.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faed10c0700 1 --2- 172.21.2.105:0/2710009420 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7faecc060a00 0x7faecc0b0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:01.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faed10c0700 1 -- 172.21.2.105:0/2710009420 >> 172.21.2.105:0/2710009420 conn(0x7faecc0b6530 msgr2=0x7faecc0b2500 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:01.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faed10c0700 1 -- 172.21.2.105:0/2710009420 shutdown_connections 2021-11-12T05:44:01.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faed10c0700 1 -- 172.21.2.105:0/2710009420 wait complete. 2021-11-12T05:44:01.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faed10c0700 1 Processor -- start 2021-11-12T05:44:01.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faed10c0700 1 -- start start 2021-11-12T05:44:01.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faed10c0700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7faecc060a00 0x7faecc14a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:01.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faed10c0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faecc0adbc0 0x7faecc062ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:01.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faed10c0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7faecc147d70 0x7faecc141700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:01.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faed10c0700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faecc14a0c0 con 0x7faecc0adbc0 2021-11-12T05:44:01.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faed10c0700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faecc064720 con 0x7faecc060a00 2021-11-12T05:44:01.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faed10c0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faecc0649c0 con 0x7faecc147d70 2021-11-12T05:44:01.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faecb7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faecc0adbc0 0x7faecc062ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:01.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faecb7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faecc0adbc0 0x7faecc062ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45678/0 (socket says 172.21.2.105:45678) 2021-11-12T05:44:01.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faecb7fe700 1 -- 172.21.2.105:0/3616060014 learned_addr learned my addr 172.21.2.105:0/3616060014 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:01.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faecbfff700 1 --2- 172.21.2.105:0/3616060014 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7faecc060a00 0x7faecc14a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:01.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faed08bf700 1 --2- 172.21.2.105:0/3616060014 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7faecc147d70 0x7faecc141700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:01.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faecb7fe700 1 -- 172.21.2.105:0/3616060014 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7faecc147d70 msgr2=0x7faecc141700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:01.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faecb7fe700 1 --2- 172.21.2.105:0/3616060014 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7faecc147d70 0x7faecc141700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:01.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faecb7fe700 1 -- 172.21.2.105:0/3616060014 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7faecc060a00 msgr2=0x7faecc14a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:01.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faecb7fe700 1 --2- 172.21.2.105:0/3616060014 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7faecc060a00 0x7faecc14a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:01.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faecb7fe700 1 -- 172.21.2.105:0/3616060014 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec4009470 con 0x7faecc0adbc0 2021-11-12T05:44:01.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faecbfff700 1 --2- 172.21.2.105:0/3616060014 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7faecc060a00 0x7faecc14a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:44:01.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faecb7fe700 1 --2- 172.21.2.105:0/3616060014 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faecc0adbc0 0x7faecc062ab0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7faec0002f70 tx=0x7faec0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:01.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faec97fa700 1 -- 172.21.2.105:0/3616060014 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faec00068b0 con 0x7faecc0adbc0 2021-11-12T05:44:01.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faec97fa700 1 -- 172.21.2.105:0/3616060014 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec000de20 con 0x7faecc0adbc0 2021-11-12T05:44:01.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faed10c0700 1 -- 172.21.2.105:0/3616060014 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec000b1e0 con 0x7faecc0adbc0 2021-11-12T05:44:01.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faec97fa700 1 -- 172.21.2.105:0/3616060014 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faec001e460 con 0x7faecc0adbc0 2021-11-12T05:44:01.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.203+0000 7faed10c0700 1 -- 172.21.2.105:0/3616060014 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faecc062fa0 con 0x7faecc0adbc0 2021-11-12T05:44:01.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.207+0000 7faed10c0700 1 -- 172.21.2.105:0/3616060014 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faecc057350 con 0x7faecc0adbc0 2021-11-12T05:44:01.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.207+0000 7faec97fa700 1 -- 172.21.2.105:0/3616060014 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faec0025030 con 0x7faecc0adbc0 2021-11-12T05:44:01.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.207+0000 7faec97fa700 1 --2- 172.21.2.105:0/3616060014 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7faeac0536a0 0x7faeac055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:01.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.207+0000 7faec97fa700 1 -- 172.21.2.105:0/3616060014 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5682+0+0 (secure 0 0 0) 0x7faec006c910 con 0x7faecc0adbc0 2021-11-12T05:44:01.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.207+0000 7faecbfff700 1 --2- 172.21.2.105:0/3616060014 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7faeac0536a0 0x7faeac055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:01.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.207+0000 7faecbfff700 1 --2- 172.21.2.105:0/3616060014 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7faeac0536a0 0x7faeac055b60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7faec400b000 tx=0x7faec4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:01.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.207+0000 7faec97fa700 1 -- 172.21.2.105:0/3616060014 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faec0043bf0 con 0x7faecc0adbc0 2021-11-12T05:44:01.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:01.299+0000 7faed10c0700 1 -- 172.21.2.105:0/3616060014 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7faecc0b35f0 con 0x7faecc0adbc0 2021-11-12T05:44:02.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.215+0000 7faec97fa700 1 -- 172.21.2.105:0/3616060014 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v51) v1 ==== 97+0+0 (secure 0 0 0) 0x7faec0023020 con 0x7faecc0adbc0 2021-11-12T05:44:02.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.219+0000 7faed10c0700 1 -- 172.21.2.105:0/3616060014 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7faeac0536a0 msgr2=0x7faeac055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:02.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.219+0000 7faed10c0700 1 --2- 172.21.2.105:0/3616060014 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7faeac0536a0 0x7faeac055b60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7faec400b000 tx=0x7faec4008040).stop 2021-11-12T05:44:02.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.219+0000 7faed10c0700 1 -- 172.21.2.105:0/3616060014 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faecc0adbc0 msgr2=0x7faecc062ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:02.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.219+0000 7faed10c0700 1 --2- 172.21.2.105:0/3616060014 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faecc0adbc0 0x7faecc062ab0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7faec0002f70 tx=0x7faec0015000).stop 2021-11-12T05:44:02.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.219+0000 7faed10c0700 1 -- 172.21.2.105:0/3616060014 shutdown_connections 2021-11-12T05:44:02.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.219+0000 7faed10c0700 1 --2- 172.21.2.105:0/3616060014 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7faeac0536a0 0x7faeac055b60 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:02.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.219+0000 7faed10c0700 1 --2- 172.21.2.105:0/3616060014 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7faecc147d70 0x7faecc141700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:02.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.219+0000 7faed10c0700 1 --2- 172.21.2.105:0/3616060014 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faecc0adbc0 0x7faecc062ab0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:02.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.219+0000 7faed10c0700 1 --2- 172.21.2.105:0/3616060014 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7faecc060a00 0x7faecc14a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:02.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.219+0000 7faed10c0700 1 -- 172.21.2.105:0/3616060014 >> 172.21.2.105:0/3616060014 conn(0x7faecc0b6530 msgr2=0x7faecc0b3960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:02.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.219+0000 7faed10c0700 1 -- 172.21.2.105:0/3616060014 shutdown_connections 2021-11-12T05:44:02.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.219+0000 7faed10c0700 1 -- 172.21.2.105:0/3616060014 wait complete. 2021-11-12T05:44:02.228 INFO:teuthology.orchestra.run.gibba005.stderr: removed all blacklist entries 2021-11-12T05:44:02.237 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-11-12T05:44:02.238 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-11-12T05:44:02.334 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.327+0000 7f7e8dadc700 1 Processor -- start 2021-11-12T05:44:02.334 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.327+0000 7f7e8dadc700 1 -- start start 2021-11-12T05:44:02.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.327+0000 7f7e8dadc700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f7e880b37d0 0x7f7e88141500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:02.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.327+0000 7f7e8dadc700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7e881419f0 0x7f7e880b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:02.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.327+0000 7f7e8dadc700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e880b26e0 con 0x7f7e88060100 2021-11-12T05:44:02.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.327+0000 7f7e8dadc700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e880604e0 con 0x7f7e880b37d0 2021-11-12T05:44:02.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.327+0000 7f7e8dadc700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e88145160 con 0x7f7e881419f0 2021-11-12T05:44:02.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.331+0000 7f7e86ffd700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f7e880b37d0 0x7f7e88141500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:02.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.331+0000 7f7e877fe700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7f7e88060100 0x7f7e880b1fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:54550/0 (socket says 172.21.2.105:54550) 2021-11-12T05:44:02.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.331+0000 7f7e877fe700 1 -- 172.21.2.105:0/3990868373 learned_addr learned my addr 172.21.2.105:0/3990868373 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:44:02.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.331+0000 7f7e87fff700 1 --2- 172.21.2.105:0/3990868373 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7e881419f0 0x7f7e880b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:02.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.331+0000 7f7e86ffd700 1 -- 172.21.2.105:0/3990868373 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7e881419f0 msgr2=0x7f7e880b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:02.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.331+0000 7f7e86ffd700 1 --2- 172.21.2.105:0/3990868373 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7e881419f0 0x7f7e880b3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:02.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.331+0000 7f7e86ffd700 1 -- 172.21.2.105:0/3990868373 >> v1:172.21.2.115:6789/0 conn(0x7f7e88060100 legacy=0x7f7e880b1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:02.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.331+0000 7f7e86ffd700 1 -- 172.21.2.105:0/3990868373 --> v2:172.21.2.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e88141060 con 0x7f7e880b37d0 2021-11-12T05:44:02.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.331+0000 7f7e86ffd700 1 --2- 172.21.2.105:0/3990868373 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7e880b37d0 0x7f7e88141500 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f7e88065610 tx=0x7f7e70006df0).ready entity=mon.1 client_cookie=11ffc62a96575be6 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:02.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.331+0000 7f7e867fc700 1 -- 172.21.2.105:0/3990868373 <== mon.1 v2:172.21.2.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e7000d570 con 0x7f7e880b37d0 2021-11-12T05:44:02.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.331+0000 7f7e867fc700 1 -- 172.21.2.105:0/3990868373 <== mon.1 v2:172.21.2.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e70000e90 con 0x7f7e880b37d0 2021-11-12T05:44:02.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.331+0000 7f7e867fc700 1 -- 172.21.2.105:0/3990868373 <== mon.1 v2:172.21.2.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e7000d8c0 con 0x7f7e880b37d0 2021-11-12T05:44:02.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.331+0000 7f7e8dadc700 1 -- 172.21.2.105:0/3990868373 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7e880b37d0 msgr2=0x7f7e88141500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:02.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.331+0000 7f7e8dadc700 1 --2- 172.21.2.105:0/3990868373 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7e880b37d0 0x7f7e88141500 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f7e88065610 tx=0x7f7e70006df0).stop 2021-11-12T05:44:02.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.331+0000 7f7e8dadc700 1 -- 172.21.2.105:0/3990868373 shutdown_connections 2021-11-12T05:44:02.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.331+0000 7f7e8dadc700 1 --2- 172.21.2.105:0/3990868373 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7e881419f0 0x7f7e880b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:02.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.331+0000 7f7e8dadc700 1 --2- 172.21.2.105:0/3990868373 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7e880b37d0 0x7f7e88141500 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:02.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.331+0000 7f7e8dadc700 1 -- 172.21.2.105:0/3990868373 >> 172.21.2.105:0/3990868373 conn(0x7f7e880608d0 msgr2=0x7f7e8805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:02.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.331+0000 7f7e8dadc700 1 -- 172.21.2.105:0/3990868373 shutdown_connections 2021-11-12T05:44:02.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.331+0000 7f7e8dadc700 1 -- 172.21.2.105:0/3990868373 wait complete. 2021-11-12T05:44:02.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.331+0000 7f7e8dadc700 1 Processor -- start 2021-11-12T05:44:02.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.331+0000 7f7e8dadc700 1 -- start start 2021-11-12T05:44:02.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.335+0000 7f7e8dadc700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7e88060100 0x7f7e8812f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:02.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.335+0000 7f7e8dadc700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7e880b37d0 0x7f7e88062bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:02.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.335+0000 7f7e8dadc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7e881419f0 0x7f7e880b5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:02.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.335+0000 7f7e8dadc700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e88129a90 con 0x7f7e881419f0 2021-11-12T05:44:02.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.335+0000 7f7e8dadc700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e880b8050 con 0x7f7e88060100 2021-11-12T05:44:02.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.335+0000 7f7e8dadc700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8812ffa0 con 0x7f7e880b37d0 2021-11-12T05:44:02.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.335+0000 7f7e87fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7e881419f0 0x7f7e880b5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:02.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.335+0000 7f7e87fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7e881419f0 0x7f7e880b5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45696/0 (socket says 172.21.2.105:45696) 2021-11-12T05:44:02.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.335+0000 7f7e87fff700 1 -- 172.21.2.105:0/2640197683 learned_addr learned my addr 172.21.2.105:0/2640197683 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:02.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.335+0000 7f7e87fff700 1 -- 172.21.2.105:0/2640197683 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7e880b37d0 msgr2=0x7f7e88062bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:02.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.335+0000 7f7e87fff700 1 --2- 172.21.2.105:0/2640197683 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7e880b37d0 0x7f7e88062bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:02.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.335+0000 7f7e87fff700 1 -- 172.21.2.105:0/2640197683 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7e88060100 msgr2=0x7f7e8812f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:02.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.335+0000 7f7e87fff700 1 --2- 172.21.2.105:0/2640197683 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7e88060100 0x7f7e8812f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:02.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.335+0000 7f7e87fff700 1 -- 172.21.2.105:0/2640197683 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e7000b180 con 0x7f7e881419f0 2021-11-12T05:44:02.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.335+0000 7f7e87fff700 1 --2- 172.21.2.105:0/2640197683 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7e881419f0 0x7f7e880b5380 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f7e80006e00 tx=0x7f7e800091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:02.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.335+0000 7f7e84ff9700 1 -- 172.21.2.105:0/2640197683 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e8000c7f0 con 0x7f7e881419f0 2021-11-12T05:44:02.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.335+0000 7f7e84ff9700 1 -- 172.21.2.105:0/2640197683 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8000c950 con 0x7f7e881419f0 2021-11-12T05:44:02.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.335+0000 7f7e84ff9700 1 -- 172.21.2.105:0/2640197683 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e8000ccb0 con 0x7f7e881419f0 2021-11-12T05:44:02.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.335+0000 7f7e8dadc700 1 -- 172.21.2.105:0/2640197683 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e88130240 con 0x7f7e881419f0 2021-11-12T05:44:02.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.335+0000 7f7e8dadc700 1 -- 172.21.2.105:0/2640197683 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e8812f500 con 0x7f7e881419f0 2021-11-12T05:44:02.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.335+0000 7f7e8dadc700 1 -- 172.21.2.105:0/2640197683 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e88141e80 con 0x7f7e881419f0 2021-11-12T05:44:02.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.335+0000 7f7e84ff9700 1 -- 172.21.2.105:0/2640197683 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7e80022070 con 0x7f7e881419f0 2021-11-12T05:44:02.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.335+0000 7f7e84ff9700 1 --2- 172.21.2.105:0/2640197683 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7e6c053610 0x7f7e6c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:02.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.335+0000 7f7e84ff9700 1 -- 172.21.2.105:0/2640197683 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f7e8006be50 con 0x7f7e881419f0 2021-11-12T05:44:02.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.335+0000 7f7e877fe700 1 --2- 172.21.2.105:0/2640197683 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7e6c053610 0x7f7e6c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:02.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.335+0000 7f7e877fe700 1 --2- 172.21.2.105:0/2640197683 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7e6c053610 0x7f7e6c055ad0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f7e880640c0 tx=0x7f7e78007800).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:02.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.339+0000 7f7e84ff9700 1 -- 172.21.2.105:0/2640197683 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7e800430f0 con 0x7f7e881419f0 2021-11-12T05:44:02.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.451+0000 7f7e8dadc700 1 -- 172.21.2.105:0/2640197683 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7e88057350 con 0x7f7e881419f0 2021-11-12T05:44:02.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.451+0000 7f7e84ff9700 1 -- 172.21.2.105:0/2640197683 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+4242 (secure 0 0 0) 0x7f7e80016020 con 0x7f7e881419f0 2021-11-12T05:44:02.456 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:44:02.456 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:44:02.457 INFO:teuthology.orchestra.run.gibba005.stdout: "auth_dump": [ 2021-11-12T05:44:02.457 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:02.457 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mds.a", 2021-11-12T05:44:02.457 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1hGVLeOhAAX2029T+USC1Um93TSzjxdA==", 2021-11-12T05:44:02.458 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:44:02.458 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:44:02.458 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:44:02.458 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:44:02.458 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:44:02.459 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:02.459 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:02.459 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:02.459 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mds.b", 2021-11-12T05:44:02.460 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hiebUAxAAGcjDAGyvecjzagGoRBX8tg==", 2021-11-12T05:44:02.460 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:44:02.460 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:44:02.460 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:44:02.460 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:44:02.461 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:44:02.461 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:02.461 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:02.461 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:02.462 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.0", 2021-11-12T05:44:02.462 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1ht05fORAAN2YrbsxBau1FQC4C8Dvb3g==", 2021-11-12T05:44:02.462 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:44:02.462 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:44:02.463 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:44:02.463 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:44:02.463 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:02.463 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:02.463 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:02.464 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.1", 2021-11-12T05:44:02.464 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAu/o1hzp1vGhAAQ6u3Npb+yNGlNOUdoHzFZA==", 2021-11-12T05:44:02.464 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:44:02.464 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:44:02.464 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:44:02.465 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:44:02.465 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:02.465 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:02.465 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:02.466 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.2", 2021-11-12T05:44:02.466 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAw/o1hHWwOOhAAx7txWG8rbch18+SBnJkfkQ==", 2021-11-12T05:44:02.466 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:44:02.466 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:44:02.466 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:44:02.467 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:44:02.467 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:02.467 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:02.467 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:02.468 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.3", 2021-11-12T05:44:02.468 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAz/o1howZpHxAAKgUVxU2tSNZbxW+6OfJF9g==", 2021-11-12T05:44:02.468 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:44:02.468 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:44:02.468 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:44:02.469 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:44:02.469 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:02.469 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:02.469 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:02.470 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.4", 2021-11-12T05:44:02.470 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA2/o1humA5KRAAVbO6UYLOBQDq3WiEkkS6xw==", 2021-11-12T05:44:02.470 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:44:02.470 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:44:02.470 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:44:02.471 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:44:02.471 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:02.471 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:02.471 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:02.472 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.5", 2021-11-12T05:44:02.472 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA5/o1hALdKDRAAR9nsaDOo9GUgpmBPHVp5HQ==", 2021-11-12T05:44:02.472 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:44:02.472 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:44:02.473 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:44:02.473 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:44:02.473 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:02.473 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:02.473 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:02.474 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.6", 2021-11-12T05:44:02.474 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA7/o1hCVP2KhAAHj5SxnJ81mKrJOg2CE2wLQ==", 2021-11-12T05:44:02.474 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:44:02.474 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:44:02.475 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:44:02.475 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:44:02.475 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:02.475 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:02.475 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:02.476 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.7", 2021-11-12T05:44:02.476 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA+/o1hWCEqEBAAv8nF9NeF2Ue5W8Ijj8Skgg==", 2021-11-12T05:44:02.476 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:44:02.476 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:44:02.477 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:44:02.477 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:44:02.477 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:02.477 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:02.477 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:02.478 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.0", 2021-11-12T05:44:02.478 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hzEzhCBAATF8giEBtrj13SAr5EJV4TA==", 2021-11-12T05:44:02.478 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:44:02.478 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:44:02.479 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow r", 2021-11-12T05:44:02.479 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-12T05:44:02.479 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:02.479 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:02.479 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:02.480 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.1", 2021-11-12T05:44:02.480 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hO6zfCxAAae1obagtpsnA9e8FlTExVA==", 2021-11-12T05:44:02.480 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:44:02.480 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:44:02.480 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow r", 2021-11-12T05:44:02.481 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-12T05:44:02.481 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:02.481 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:02.481 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:02.482 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.2", 2021-11-12T05:44:02.482 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hFYDGDhAAyz77VXKtOz86ztJ8FUIvAg==", 2021-11-12T05:44:02.482 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:44:02.482 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:44:02.482 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow r", 2021-11-12T05:44:02.483 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-12T05:44:02.483 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:02.483 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:02.483 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:02.484 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.admin", 2021-11-12T05:44:02.484 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1hwdoBHRAAUHHEU3dbyso2BnE/JppV8A==", 2021-11-12T05:44:02.484 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:44:02.484 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow *", 2021-11-12T05:44:02.484 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:44:02.485 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:44:02.485 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:44:02.485 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:02.485 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:02.485 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:02.486 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mgr.x", 2021-11-12T05:44:02.486 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1h6JBaORAAbgxQtCzGNj7MLfgwGd4cWA==", 2021-11-12T05:44:02.486 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:44:02.487 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow *", 2021-11-12T05:44:02.487 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow profile mgr", 2021-11-12T05:44:02.487 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:44:02.487 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:02.488 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:02.488 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:02.488 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mgr.y", 2021-11-12T05:44:02.488 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1hwfvvNRAASU7NmYBG/Yb6/ma1/Ew7mw==", 2021-11-12T05:44:02.488 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:44:02.489 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow *", 2021-11-12T05:44:02.489 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow profile mgr", 2021-11-12T05:44:02.489 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:44:02.489 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:02.489 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:02.490 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:44:02.490 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:44:02.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.451+0000 7f7e8dadc700 1 -- 172.21.2.105:0/2640197683 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7e6c053610 msgr2=0x7f7e6c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:02.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.451+0000 7f7e8dadc700 1 --2- 172.21.2.105:0/2640197683 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7e6c053610 0x7f7e6c055ad0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f7e880640c0 tx=0x7f7e78007800).stop 2021-11-12T05:44:02.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.451+0000 7f7e8dadc700 1 -- 172.21.2.105:0/2640197683 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7e881419f0 msgr2=0x7f7e880b5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:02.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.451+0000 7f7e8dadc700 1 --2- 172.21.2.105:0/2640197683 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7e881419f0 0x7f7e880b5380 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f7e80006e00 tx=0x7f7e800091d0).stop 2021-11-12T05:44:02.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.451+0000 7f7e8dadc700 1 -- 172.21.2.105:0/2640197683 shutdown_connections 2021-11-12T05:44:02.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.451+0000 7f7e8dadc700 1 --2- 172.21.2.105:0/2640197683 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7e6c053610 0x7f7e6c055ad0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:02.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.451+0000 7f7e8dadc700 1 --2- 172.21.2.105:0/2640197683 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7e881419f0 0x7f7e880b5380 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:02.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.451+0000 7f7e8dadc700 1 --2- 172.21.2.105:0/2640197683 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7e880b37d0 0x7f7e88062bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:02.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.451+0000 7f7e8dadc700 1 --2- 172.21.2.105:0/2640197683 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7e88060100 0x7f7e8812f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:02.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.451+0000 7f7e8dadc700 1 -- 172.21.2.105:0/2640197683 >> 172.21.2.105:0/2640197683 conn(0x7f7e880608d0 msgr2=0x7f7e88065690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:02.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.451+0000 7f7e8dadc700 1 -- 172.21.2.105:0/2640197683 shutdown_connections 2021-11-12T05:44:02.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.451+0000 7f7e8dadc700 1 -- 172.21.2.105:0/2640197683 wait complete. 2021-11-12T05:44:02.495 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:44:02.547 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.539+0000 7fdb20270700 1 Processor -- start 2021-11-12T05:44:02.547 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb20270700 1 -- start start 2021-11-12T05:44:02.547 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb20270700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdb180ad080 0x7fdb180af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:02.547 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb20270700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fdb180ac280 0x7fdb180ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:02.548 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb20270700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb180ac7b0 con 0x7fdb1814abe0 2021-11-12T05:44:02.548 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb20270700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb181488a0 con 0x7fdb180ac280 2021-11-12T05:44:02.548 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb20270700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb180ac9e0 con 0x7fdb180ad080 2021-11-12T05:44:02.548 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb1e80d700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fdb1814abe0 0x7fdb1814b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:56096/0 (socket says 172.21.2.105:56096) 2021-11-12T05:44:02.549 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb1e80d700 1 -- 172.21.2.105:0/2557097861 learned_addr learned my addr 172.21.2.105:0/2557097861 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:44:02.549 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb1d80b700 1 --2- 172.21.2.105:0/2557097861 >> v2:172.21.2.105:3300/0 conn(0x7fdb180ac280 0x7fdb180ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:02.552 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb1d00a700 1 -- 172.21.2.105:0/2557097861 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1297198584 0 0) 0x7fdb180ac7b0 con 0x7fdb1814abe0 2021-11-12T05:44:02.552 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb1d00a700 1 -- 172.21.2.105:0/2557097861 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb00003260 con 0x7fdb1814abe0 2021-11-12T05:44:02.553 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb1d80b700 1 -- 172.21.2.105:0/2557097861 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdb180ad080 msgr2=0x7fdb180af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:02.553 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb1d80b700 1 --2- 172.21.2.105:0/2557097861 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdb180ad080 0x7fdb180af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:02.553 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb1d80b700 1 -- 172.21.2.105:0/2557097861 >> v1:172.21.2.105:6789/0 conn(0x7fdb1814abe0 legacy=0x7fdb1814b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:02.553 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb1d80b700 1 -- 172.21.2.105:0/2557097861 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb180b0b30 con 0x7fdb180ac280 2021-11-12T05:44:02.554 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb1d80b700 1 --2- 172.21.2.105:0/2557097861 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdb180ac280 0x7fdb180ad460 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7fdb0c002f70 tx=0x7fdb0c006df0).ready entity=mon.0 client_cookie=cb28f941b167f250 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:02.554 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb1d00a700 1 -- 172.21.2.105:0/2557097861 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb0c00d570 con 0x7fdb180ac280 2021-11-12T05:44:02.554 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb1d00a700 1 -- 172.21.2.105:0/2557097861 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0c000e90 con 0x7fdb180ac280 2021-11-12T05:44:02.554 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb1d00a700 1 -- 172.21.2.105:0/2557097861 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb0c00d8c0 con 0x7fdb180ac280 2021-11-12T05:44:02.554 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb20270700 1 -- 172.21.2.105:0/2557097861 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdb180ac280 msgr2=0x7fdb180ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:02.555 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb20270700 1 --2- 172.21.2.105:0/2557097861 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdb180ac280 0x7fdb180ad460 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7fdb0c002f70 tx=0x7fdb0c006df0).stop 2021-11-12T05:44:02.555 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb20270700 1 -- 172.21.2.105:0/2557097861 shutdown_connections 2021-11-12T05:44:02.555 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb20270700 1 --2- 172.21.2.105:0/2557097861 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdb180ac280 0x7fdb180ad460 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:02.555 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb20270700 1 --2- 172.21.2.105:0/2557097861 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdb180ad080 0x7fdb180af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:02.556 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb20270700 1 -- 172.21.2.105:0/2557097861 >> 172.21.2.105:0/2557097861 conn(0x7fdb180b5370 msgr2=0x7fdb180b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:02.556 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb20270700 1 -- 172.21.2.105:0/2557097861 shutdown_connections 2021-11-12T05:44:02.556 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb20270700 1 -- 172.21.2.105:0/2557097861 wait complete. 2021-11-12T05:44:02.556 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb20270700 1 Processor -- start 2021-11-12T05:44:02.556 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb20270700 1 -- start start 2021-11-12T05:44:02.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb20270700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdb180ac280 0x7fdb180a9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:02.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb20270700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdb180ad080 0x7fdb181573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:02.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb20270700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdb1814abe0 0x7fdb181578e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:02.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb20270700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1815ae10 con 0x7fdb180ac280 2021-11-12T05:44:02.558 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb20270700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb180aa670 con 0x7fdb180ad080 2021-11-12T05:44:02.558 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb20270700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1815aa40 con 0x7fdb1814abe0 2021-11-12T05:44:02.558 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb1e00c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdb180ac280 0x7fdb180a9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:02.558 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb1e00c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdb180ac280 0x7fdb180a9380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45706/0 (socket says 172.21.2.105:45706) 2021-11-12T05:44:02.558 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb1e00c700 1 -- 172.21.2.105:0/215376962 learned_addr learned my addr 172.21.2.105:0/215376962 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:02.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb1e00c700 1 -- 172.21.2.105:0/215376962 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdb1814abe0 msgr2=0x7fdb181578e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:44:02.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb1e00c700 1 --2- 172.21.2.105:0/215376962 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdb1814abe0 0x7fdb181578e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:02.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb1e00c700 1 -- 172.21.2.105:0/215376962 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdb180ad080 msgr2=0x7fdb181573f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:44:02.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.543+0000 7fdb1e00c700 1 --2- 172.21.2.105:0/215376962 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdb180ad080 0x7fdb181573f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:02.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.547+0000 7fdb1e00c700 1 -- 172.21.2.105:0/215376962 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0c00b180 con 0x7fdb180ac280 2021-11-12T05:44:02.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.547+0000 7fdb1e00c700 1 --2- 172.21.2.105:0/215376962 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdb180ac280 0x7fdb180a9380 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7fdb14002f70 tx=0x7fdb14006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:02.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.547+0000 7fdb0b7fe700 1 -- 172.21.2.105:0/215376962 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb14013460 con 0x7fdb180ac280 2021-11-12T05:44:02.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.547+0000 7fdb0b7fe700 1 -- 172.21.2.105:0/215376962 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb140135c0 con 0x7fdb180ac280 2021-11-12T05:44:02.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.547+0000 7fdb0b7fe700 1 -- 172.21.2.105:0/215376962 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb14013920 con 0x7fdb180ac280 2021-11-12T05:44:02.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.547+0000 7fdb20270700 1 -- 172.21.2.105:0/215376962 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb180b4df0 con 0x7fdb180ac280 2021-11-12T05:44:02.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.547+0000 7fdb20270700 1 -- 172.21.2.105:0/215376962 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb180b4a10 con 0x7fdb180ac280 2021-11-12T05:44:02.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.547+0000 7fdb20270700 1 -- 172.21.2.105:0/215376962 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb18156db0 con 0x7fdb180ac280 2021-11-12T05:44:02.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.547+0000 7fdb0b7fe700 1 -- 172.21.2.105:0/215376962 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdb1400f070 con 0x7fdb180ac280 2021-11-12T05:44:02.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.547+0000 7fdb0b7fe700 1 --2- 172.21.2.105:0/215376962 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdaf8053580 0x7fdaf8055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:02.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.547+0000 7fdb0b7fe700 1 -- 172.21.2.105:0/215376962 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fdb1406b150 con 0x7fdb180ac280 2021-11-12T05:44:02.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.547+0000 7fdb1d80b700 1 --2- 172.21.2.105:0/215376962 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdaf8053580 0x7fdaf8055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:02.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.547+0000 7fdb1d80b700 1 --2- 172.21.2.105:0/215376962 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdaf8053580 0x7fdaf8055a40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7fdb0c002f70 tx=0x7fdb0c014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:02.563 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.551+0000 7fdb0b7fe700 1 -- 172.21.2.105:0/215376962 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdb18156db0 con 0x7fdb180ac280 2021-11-12T05:44:02.636 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.631+0000 7fdb20270700 1 -- 172.21.2.105:0/215376962 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb180aa4d0 con 0x7fdb180ac280 2021-11-12T05:44:02.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.631+0000 7fdb0b7fe700 1 -- 172.21.2.105:0/215376962 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+13414 (secure 0 0 0) 0x7fdb180aa4d0 con 0x7fdb180ac280 2021-11-12T05:44:02.638 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:44:02.638 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":51,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:44:02.207458+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:44:02.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.631+0000 7fdb20270700 1 -- 172.21.2.105:0/215376962 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdaf8053580 msgr2=0x7fdaf8055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:02.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.631+0000 7fdb20270700 1 --2- 172.21.2.105:0/215376962 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdaf8053580 0x7fdaf8055a40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7fdb0c002f70 tx=0x7fdb0c014000).stop 2021-11-12T05:44:02.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.631+0000 7fdb20270700 1 -- 172.21.2.105:0/215376962 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdb180ac280 msgr2=0x7fdb180a9380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:02.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.631+0000 7fdb20270700 1 --2- 172.21.2.105:0/215376962 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdb180ac280 0x7fdb180a9380 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7fdb14002f70 tx=0x7fdb14006ec0).stop 2021-11-12T05:44:02.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.635+0000 7fdb20270700 1 -- 172.21.2.105:0/215376962 shutdown_connections 2021-11-12T05:44:02.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.635+0000 7fdb20270700 1 --2- 172.21.2.105:0/215376962 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdaf8053580 0x7fdaf8055a40 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:02.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.635+0000 7fdb20270700 1 --2- 172.21.2.105:0/215376962 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdb1814abe0 0x7fdb181578e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:02.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.635+0000 7fdb20270700 1 --2- 172.21.2.105:0/215376962 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdb180ad080 0x7fdb181573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:02.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.635+0000 7fdb20270700 1 --2- 172.21.2.105:0/215376962 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdb180ac280 0x7fdb180a9380 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:02.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.635+0000 7fdb20270700 1 -- 172.21.2.105:0/215376962 >> 172.21.2.105:0/215376962 conn(0x7fdb180b5370 msgr2=0x7fdb18143b90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:02.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.635+0000 7fdb20270700 1 -- 172.21.2.105:0/215376962 shutdown_connections 2021-11-12T05:44:02.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.635+0000 7fdb20270700 1 -- 172.21.2.105:0/215376962 wait complete. 2021-11-12T05:44:02.645 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-12T05:44:02.645 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:44:02.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf7f17e700 1 Processor -- start 2021-11-12T05:44:02.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf7f17e700 1 -- start start 2021-11-12T05:44:02.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf7f17e700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fbf780b2cc0 0x7fbf780b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:02.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf7f17e700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fbf78143da0 0x7fbf78140240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:02.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf7f17e700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf780aa0b0 con 0x7fbf780b2290 2021-11-12T05:44:02.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf7f17e700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf780a9b70 con 0x7fbf78143da0 2021-11-12T05:44:02.701 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf7f17e700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf780a9e10 con 0x7fbf780b2cc0 2021-11-12T05:44:02.701 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf7d71b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fbf78143da0 0x7fbf78140240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:02.701 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf77fff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fbf780b2290 0x7fbf78143690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:56110/0 (socket says 172.21.2.105:56110) 2021-11-12T05:44:02.701 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf77fff700 1 -- 172.21.2.105:0/1903164610 learned_addr learned my addr 172.21.2.105:0/1903164610 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:44:02.704 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf7d71b700 1 -- 172.21.2.105:0/1903164610 >> v2:172.21.2.115:3300/0 conn(0x7fbf780b2cc0 msgr2=0x7fbf780b30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:02.705 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf7d71b700 1 --2- 172.21.2.105:0/1903164610 >> v2:172.21.2.115:3300/0 conn(0x7fbf780b2cc0 0x7fbf780b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:02.705 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf7d71b700 1 -- 172.21.2.105:0/1903164610 >> v1:172.21.2.105:6789/0 conn(0x7fbf780b2290 legacy=0x7fbf78143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:02.705 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf7d71b700 1 -- 172.21.2.105:0/1903164610 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf780b0800 con 0x7fbf78143da0 2021-11-12T05:44:02.705 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf7d71b700 1 --2- 172.21.2.105:0/1903164610 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbf78143da0 0x7fbf78140240 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7fbf700032f0 tx=0x7fbf7000b470).ready entity=mon.0 client_cookie=83fee2d095c094b5 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:02.706 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf777fe700 1 -- 172.21.2.105:0/1903164610 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf7000ddf0 con 0x7fbf78143da0 2021-11-12T05:44:02.706 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf777fe700 1 -- 172.21.2.105:0/1903164610 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf70010470 con 0x7fbf78143da0 2021-11-12T05:44:02.706 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf777fe700 1 -- 172.21.2.105:0/1903164610 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf700107d0 con 0x7fbf78143da0 2021-11-12T05:44:02.706 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf7f17e700 1 -- 172.21.2.105:0/1903164610 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbf78143da0 msgr2=0x7fbf78140240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:02.707 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf7f17e700 1 --2- 172.21.2.105:0/1903164610 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbf78143da0 0x7fbf78140240 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7fbf700032f0 tx=0x7fbf7000b470).stop 2021-11-12T05:44:02.707 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf7f17e700 1 -- 172.21.2.105:0/1903164610 shutdown_connections 2021-11-12T05:44:02.707 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf7f17e700 1 --2- 172.21.2.105:0/1903164610 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbf78143da0 0x7fbf78140240 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:02.707 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf7f17e700 1 --2- 172.21.2.105:0/1903164610 >> v2:172.21.2.115:3300/0 conn(0x7fbf780b2cc0 0x7fbf780b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:02.708 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf7f17e700 1 -- 172.21.2.105:0/1903164610 >> 172.21.2.105:0/1903164610 conn(0x7fbf7805c490 msgr2=0x7fbf7805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:02.708 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf7f17e700 1 -- 172.21.2.105:0/1903164610 shutdown_connections 2021-11-12T05:44:02.708 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf7f17e700 1 -- 172.21.2.105:0/1903164610 wait complete. 2021-11-12T05:44:02.708 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf7f17e700 1 Processor -- start 2021-11-12T05:44:02.708 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf7f17e700 1 -- start start 2021-11-12T05:44:02.709 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf7f17e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbf780b2290 0x7fbf78064b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:02.709 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf7f17e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbf780b2cc0 0x7fbf78153900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:02.709 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf7f17e700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbf78143da0 0x7fbf780b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:02.709 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf7f17e700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf78152c80 con 0x7fbf780b2290 2021-11-12T05:44:02.709 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf7f17e700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf78152f20 con 0x7fbf78143da0 2021-11-12T05:44:02.710 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf7f17e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf781531c0 con 0x7fbf780b2cc0 2021-11-12T05:44:02.710 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf7cf1a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbf780b2290 0x7fbf78064b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:02.710 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf7cf1a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbf780b2290 0x7fbf78064b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45718/0 (socket says 172.21.2.105:45718) 2021-11-12T05:44:02.710 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf7cf1a700 1 -- 172.21.2.105:0/37744629 learned_addr learned my addr 172.21.2.105:0/37744629 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:02.711 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf7cf1a700 1 -- 172.21.2.105:0/37744629 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbf780b2cc0 msgr2=0x7fbf78153900 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:44:02.711 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf7cf1a700 1 --2- 172.21.2.105:0/37744629 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbf780b2cc0 0x7fbf78153900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:02.711 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf7cf1a700 1 -- 172.21.2.105:0/37744629 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbf78143da0 msgr2=0x7fbf780b50a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:44:02.711 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf7cf1a700 1 --2- 172.21.2.105:0/37744629 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbf78143da0 0x7fbf780b50a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:02.711 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf7cf1a700 1 -- 172.21.2.105:0/37744629 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf7000b710 con 0x7fbf780b2290 2021-11-12T05:44:02.712 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.695+0000 7fbf7cf1a700 1 --2- 172.21.2.105:0/37744629 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbf780b2290 0x7fbf78064b10 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7fbf68002f70 tx=0x7fbf68006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:02.712 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.699+0000 7fbf75ffb700 1 -- 172.21.2.105:0/37744629 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf68013460 con 0x7fbf780b2290 2021-11-12T05:44:02.712 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.699+0000 7fbf75ffb700 1 -- 172.21.2.105:0/37744629 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf680135c0 con 0x7fbf780b2290 2021-11-12T05:44:02.712 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.699+0000 7fbf75ffb700 1 -- 172.21.2.105:0/37744629 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf68013920 con 0x7fbf780b2290 2021-11-12T05:44:02.713 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.699+0000 7fbf7f17e700 1 -- 172.21.2.105:0/37744629 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf78153df0 con 0x7fbf780b2290 2021-11-12T05:44:02.713 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.699+0000 7fbf7f17e700 1 -- 172.21.2.105:0/37744629 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf780673b0 con 0x7fbf780b2290 2021-11-12T05:44:02.713 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.699+0000 7fbf7f17e700 1 -- 172.21.2.105:0/37744629 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf78153630 con 0x7fbf780b2290 2021-11-12T05:44:02.713 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.699+0000 7fbf75ffb700 1 -- 172.21.2.105:0/37744629 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbf6800f070 con 0x7fbf780b2290 2021-11-12T05:44:02.713 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.699+0000 7fbf75ffb700 1 --2- 172.21.2.105:0/37744629 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbf580536d0 0x7fbf58055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:02.714 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.699+0000 7fbf75ffb700 1 -- 172.21.2.105:0/37744629 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fbf6806b080 con 0x7fbf780b2290 2021-11-12T05:44:02.714 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.699+0000 7fbf77fff700 1 --2- 172.21.2.105:0/37744629 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbf580536d0 0x7fbf58055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:02.714 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.699+0000 7fbf77fff700 1 --2- 172.21.2.105:0/37744629 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbf580536d0 0x7fbf58055b90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fbf781433f0 tx=0x7fbf6c007790).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:02.715 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.699+0000 7fbf75ffb700 1 -- 172.21.2.105:0/37744629 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbf680423c0 con 0x7fbf780b2290 2021-11-12T05:44:02.788 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.783+0000 7fbf7f17e700 1 -- 172.21.2.105:0/37744629 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fbf78144210 con 0x7fbf780b2290 2021-11-12T05:44:02.789 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.783+0000 7fbf75ffb700 1 -- 172.21.2.105:0/37744629 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v51) v1 ==== 110+0+10 (secure 0 0 0) 0x7fbf680459e0 con 0x7fbf780b2290 2021-11-12T05:44:02.789 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:44:02.790 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.783+0000 7fbf7f17e700 1 -- 172.21.2.105:0/37744629 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbf580536d0 msgr2=0x7fbf58055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:02.790 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.783+0000 7fbf7f17e700 1 --2- 172.21.2.105:0/37744629 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbf580536d0 0x7fbf58055b90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fbf781433f0 tx=0x7fbf6c007790).stop 2021-11-12T05:44:02.790 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.783+0000 7fbf7f17e700 1 -- 172.21.2.105:0/37744629 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbf780b2290 msgr2=0x7fbf78064b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:02.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.783+0000 7fbf7f17e700 1 --2- 172.21.2.105:0/37744629 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbf780b2290 0x7fbf78064b10 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7fbf68002f70 tx=0x7fbf68006ec0).stop 2021-11-12T05:44:02.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.783+0000 7fbf7f17e700 1 -- 172.21.2.105:0/37744629 shutdown_connections 2021-11-12T05:44:02.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.783+0000 7fbf7f17e700 1 --2- 172.21.2.105:0/37744629 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbf580536d0 0x7fbf58055b90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:02.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.783+0000 7fbf7f17e700 1 --2- 172.21.2.105:0/37744629 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbf78143da0 0x7fbf780b50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:02.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.783+0000 7fbf7f17e700 1 --2- 172.21.2.105:0/37744629 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbf780b2cc0 0x7fbf78153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:02.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.783+0000 7fbf7f17e700 1 --2- 172.21.2.105:0/37744629 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbf780b2290 0x7fbf78064b10 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:02.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.783+0000 7fbf7f17e700 1 -- 172.21.2.105:0/37744629 >> 172.21.2.105:0/37744629 conn(0x7fbf7805c490 msgr2=0x7fbf78142640 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:02.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.783+0000 7fbf7f17e700 1 -- 172.21.2.105:0/37744629 shutdown_connections 2021-11-12T05:44:02.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.783+0000 7fbf7f17e700 1 -- 172.21.2.105:0/37744629 wait complete. 2021-11-12T05:44:02.796 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:44:02.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.843+0000 7fbb5f0ba700 1 Processor -- start 2021-11-12T05:44:02.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.843+0000 7fbb5f0ba700 1 -- start start 2021-11-12T05:44:02.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.843+0000 7fbb5f0ba700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbb580aca40 0x7fbb580ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:02.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.843+0000 7fbb5f0ba700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fbb580b0520 0x7fbb581473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:02.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.843+0000 7fbb5f0ba700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb580b1840 con 0x7fbb581478b0 2021-11-12T05:44:02.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.843+0000 7fbb5f0ba700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb58147d40 con 0x7fbb580b0520 2021-11-12T05:44:02.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.843+0000 7fbb5f0ba700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb580af2b0 con 0x7fbb580aca40 2021-11-12T05:44:02.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.843+0000 7fbb5d657700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7fbb581478b0 0x7fbb58144180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:54594/0 (socket says 172.21.2.105:54594) 2021-11-12T05:44:02.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.843+0000 7fbb57fff700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fbb580b0520 0x7fbb581473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:02.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.843+0000 7fbb5ce56700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbb580aca40 0x7fbb580ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:02.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.843+0000 7fbb5d657700 1 -- 172.21.2.105:0/1068692935 learned_addr learned my addr 172.21.2.105:0/1068692935 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:44:02.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.847+0000 7fbb57fff700 1 -- 172.21.2.105:0/1068692935 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbb580aca40 msgr2=0x7fbb580ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:02.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.847+0000 7fbb57fff700 1 --2- 172.21.2.105:0/1068692935 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbb580aca40 0x7fbb580ace20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:02.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.847+0000 7fbb57fff700 1 -- 172.21.2.105:0/1068692935 >> v1:172.21.2.115:6789/0 conn(0x7fbb581478b0 legacy=0x7fbb58144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:02.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.847+0000 7fbb57fff700 1 -- 172.21.2.105:0/1068692935 --> v2:172.21.2.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb580b09a0 con 0x7fbb580b0520 2021-11-12T05:44:02.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.847+0000 7fbb5ce56700 1 --2- 172.21.2.105:0/1068692935 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbb580aca40 0x7fbb580ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-12T05:44:02.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.847+0000 7fbb57fff700 1 --2- 172.21.2.105:0/1068692935 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbb580b0520 0x7fbb581473c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fbb50001490 tx=0x7fbb40006df0).ready entity=mon.1 client_cookie=55ebe75c8d9694f8 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:02.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.847+0000 7fbb577fe700 1 -- 172.21.2.105:0/1068692935 <== mon.1 v2:172.21.2.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb4000d4a0 con 0x7fbb580b0520 2021-11-12T05:44:02.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.847+0000 7fbb577fe700 1 -- 172.21.2.105:0/1068692935 <== mon.1 v2:172.21.2.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb40000e90 con 0x7fbb580b0520 2021-11-12T05:44:02.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.847+0000 7fbb577fe700 1 -- 172.21.2.105:0/1068692935 <== mon.1 v2:172.21.2.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb4000d7f0 con 0x7fbb580b0520 2021-11-12T05:44:02.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.847+0000 7fbb5f0ba700 1 -- 172.21.2.105:0/1068692935 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbb580b0520 msgr2=0x7fbb581473c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:02.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.847+0000 7fbb5f0ba700 1 --2- 172.21.2.105:0/1068692935 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbb580b0520 0x7fbb581473c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fbb50001490 tx=0x7fbb40006df0).stop 2021-11-12T05:44:02.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.847+0000 7fbb5f0ba700 1 -- 172.21.2.105:0/1068692935 shutdown_connections 2021-11-12T05:44:02.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.847+0000 7fbb5f0ba700 1 --2- 172.21.2.105:0/1068692935 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbb580b0520 0x7fbb581473c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:02.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.847+0000 7fbb5f0ba700 1 --2- 172.21.2.105:0/1068692935 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbb580aca40 0x7fbb580ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:02.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.847+0000 7fbb5f0ba700 1 -- 172.21.2.105:0/1068692935 >> 172.21.2.105:0/1068692935 conn(0x7fbb5805c490 msgr2=0x7fbb580b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:02.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.847+0000 7fbb5f0ba700 1 -- 172.21.2.105:0/1068692935 shutdown_connections 2021-11-12T05:44:02.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.847+0000 7fbb5f0ba700 1 -- 172.21.2.105:0/1068692935 wait complete. 2021-11-12T05:44:02.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.847+0000 7fbb5f0ba700 1 Processor -- start 2021-11-12T05:44:02.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.847+0000 7fbb5f0ba700 1 -- start start 2021-11-12T05:44:02.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.847+0000 7fbb5f0ba700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbb580aca40 0x7fbb5814dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:02.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.847+0000 7fbb5f0ba700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbb580b0520 0x7fbb5815a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:02.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.847+0000 7fbb5f0ba700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbb581478b0 0x7fbb5815a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:02.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.847+0000 7fbb5f0ba700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb58063be0 con 0x7fbb580aca40 2021-11-12T05:44:02.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.847+0000 7fbb5f0ba700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5815ac80 con 0x7fbb581478b0 2021-11-12T05:44:02.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.847+0000 7fbb5f0ba700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb58159e40 con 0x7fbb580b0520 2021-11-12T05:44:02.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.847+0000 7fbb5ce56700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbb580aca40 0x7fbb5814dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:02.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.847+0000 7fbb5ce56700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbb580aca40 0x7fbb5814dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45732/0 (socket says 172.21.2.105:45732) 2021-11-12T05:44:02.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.847+0000 7fbb5ce56700 1 -- 172.21.2.105:0/2779231585 learned_addr learned my addr 172.21.2.105:0/2779231585 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:02.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.847+0000 7fbb5ce56700 1 -- 172.21.2.105:0/2779231585 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbb580b0520 msgr2=0x7fbb5815a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:02.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.847+0000 7fbb5ce56700 1 --2- 172.21.2.105:0/2779231585 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbb580b0520 0x7fbb5815a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:02.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.847+0000 7fbb5ce56700 1 -- 172.21.2.105:0/2779231585 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbb581478b0 msgr2=0x7fbb5815a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:02.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.847+0000 7fbb5ce56700 1 --2- 172.21.2.105:0/2779231585 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbb581478b0 0x7fbb5815a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:02.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.847+0000 7fbb5ce56700 1 -- 172.21.2.105:0/2779231585 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb4800b180 con 0x7fbb580aca40 2021-11-12T05:44:02.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.847+0000 7fbb5ce56700 1 --2- 172.21.2.105:0/2779231585 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbb580aca40 0x7fbb5814dc80 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7fbb5815adc0 tx=0x7fbb48006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:02.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.847+0000 7fbb55ffb700 1 -- 172.21.2.105:0/2779231585 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb4800ca40 con 0x7fbb580aca40 2021-11-12T05:44:02.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.847+0000 7fbb55ffb700 1 -- 172.21.2.105:0/2779231585 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb4800cba0 con 0x7fbb580aca40 2021-11-12T05:44:02.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.847+0000 7fbb5f0ba700 1 -- 172.21.2.105:0/2779231585 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb4000b180 con 0x7fbb580aca40 2021-11-12T05:44:02.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.847+0000 7fbb55ffb700 1 -- 172.21.2.105:0/2779231585 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb480123f0 con 0x7fbb580aca40 2021-11-12T05:44:02.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.851+0000 7fbb5f0ba700 1 -- 172.21.2.105:0/2779231585 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb58063e20 con 0x7fbb580aca40 2021-11-12T05:44:02.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.851+0000 7fbb5f0ba700 1 -- 172.21.2.105:0/2779231585 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb58057350 con 0x7fbb580aca40 2021-11-12T05:44:02.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.851+0000 7fbb55ffb700 1 -- 172.21.2.105:0/2779231585 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbb48012550 con 0x7fbb580aca40 2021-11-12T05:44:02.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.851+0000 7fbb55ffb700 1 --2- 172.21.2.105:0/2779231585 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbb3c0535b0 0x7fbb3c055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:02.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.851+0000 7fbb55ffb700 1 -- 172.21.2.105:0/2779231585 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fbb4806bf00 con 0x7fbb580aca40 2021-11-12T05:44:02.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.851+0000 7fbb57fff700 1 --2- 172.21.2.105:0/2779231585 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbb3c0535b0 0x7fbb3c055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:02.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.851+0000 7fbb57fff700 1 --2- 172.21.2.105:0/2779231585 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbb3c0535b0 0x7fbb3c055a70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fbb50001490 tx=0x7fbb40014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:02.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.851+0000 7fbb55ffb700 1 -- 172.21.2.105:0/2779231585 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbb480430d0 con 0x7fbb580aca40 2021-11-12T05:44:02.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.935+0000 7fbb5f0ba700 1 -- 172.21.2.105:0/2779231585 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbb5805f280 con 0x7fbb580aca40 2021-11-12T05:44:02.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.935+0000 7fbb55ffb700 1 -- 172.21.2.105:0/2779231585 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v51) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbb480466f0 con 0x7fbb580aca40 2021-11-12T05:44:02.942 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:44:02.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.939+0000 7fbb5f0ba700 1 -- 172.21.2.105:0/2779231585 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbb3c0535b0 msgr2=0x7fbb3c055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:02.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.939+0000 7fbb5f0ba700 1 --2- 172.21.2.105:0/2779231585 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbb3c0535b0 0x7fbb3c055a70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fbb50001490 tx=0x7fbb40014000).stop 2021-11-12T05:44:02.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.939+0000 7fbb5f0ba700 1 -- 172.21.2.105:0/2779231585 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbb580aca40 msgr2=0x7fbb5814dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:02.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.939+0000 7fbb5f0ba700 1 --2- 172.21.2.105:0/2779231585 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbb580aca40 0x7fbb5814dc80 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7fbb5815adc0 tx=0x7fbb48006df0).stop 2021-11-12T05:44:02.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.939+0000 7fbb5f0ba700 1 -- 172.21.2.105:0/2779231585 shutdown_connections 2021-11-12T05:44:02.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.939+0000 7fbb5f0ba700 1 --2- 172.21.2.105:0/2779231585 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbb3c0535b0 0x7fbb3c055a70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:02.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.939+0000 7fbb5f0ba700 1 --2- 172.21.2.105:0/2779231585 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbb581478b0 0x7fbb5815a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:02.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.939+0000 7fbb5f0ba700 1 --2- 172.21.2.105:0/2779231585 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbb580b0520 0x7fbb5815a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:02.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.939+0000 7fbb5f0ba700 1 --2- 172.21.2.105:0/2779231585 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbb580aca40 0x7fbb5814dc80 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:02.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.939+0000 7fbb5f0ba700 1 -- 172.21.2.105:0/2779231585 >> 172.21.2.105:0/2779231585 conn(0x7fbb5805c490 msgr2=0x7fbb580b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:02.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.939+0000 7fbb5f0ba700 1 -- 172.21.2.105:0/2779231585 shutdown_connections 2021-11-12T05:44:02.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.939+0000 7fbb5f0ba700 1 -- 172.21.2.105:0/2779231585 wait complete. 2021-11-12T05:44:02.949 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-12T05:44:03.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78bc97a700 1 Processor -- start 2021-11-12T05:44:03.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78bc97a700 1 -- start start 2021-11-12T05:44:03.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78bc97a700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f78b80ad080 0x7f78b80af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:03.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78bc97a700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78b80ac7b0 con 0x7f78b80ac280 2021-11-12T05:44:03.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78bc97a700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78b80ac9e0 con 0x7f78b814b2f0 2021-11-12T05:44:03.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78bc97a700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78b81488a0 con 0x7f78b80ad080 2021-11-12T05:44:03.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78b5d9b700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f78b80ac280 0x7f78b814abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:56138/0 (socket says 172.21.2.105:56138) 2021-11-12T05:44:03.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78b5d9b700 1 -- 172.21.2.105:0/3867941683 learned_addr learned my addr 172.21.2.105:0/3867941683 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:44:03.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78b559a700 1 -- 172.21.2.105:0/3867941683 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4002393003 0 0) 0x7f78b80ac7b0 con 0x7f78b80ac280 2021-11-12T05:44:03.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78b559a700 1 -- 172.21.2.105:0/3867941683 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7898003260 con 0x7f78b80ac280 2021-11-12T05:44:03.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78b659c700 1 --2- 172.21.2.105:0/3867941683 >> v2:172.21.2.115:3300/0 conn(0x7f78b80ad080 0x7f78b80af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:03.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78b559a700 1 -- 172.21.2.105:0/3867941683 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3878428382 0 0) 0x7f7898003260 con 0x7f78b80ac280 2021-11-12T05:44:03.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78b559a700 1 -- 172.21.2.105:0/3867941683 >> v2:172.21.2.115:3300/0 conn(0x7f78b80ad080 msgr2=0x7f78b80af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:03.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78b559a700 1 --2- 172.21.2.105:0/3867941683 >> v2:172.21.2.115:3300/0 conn(0x7f78b80ad080 0x7f78b80af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:03.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78b559a700 1 -- 172.21.2.105:0/3867941683 >> v1:172.21.2.115:6789/0 conn(0x7f78b814b2f0 legacy=0x7f78b8147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:03.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78b559a700 1 -- 172.21.2.105:0/3867941683 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b80b0b30 con 0x7f78b80ac280 2021-11-12T05:44:03.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78b559a700 1 -- 172.21.2.105:0/3867941683 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f78a8001660 con 0x7f78b80ac280 2021-11-12T05:44:03.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78b559a700 1 -- 172.21.2.105:0/3867941683 >> v1:172.21.2.105:6789/0 conn(0x7f78b80ac280 legacy=0x7f78b814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:03.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78b559a700 1 --2- 172.21.2.105:0/3867941683 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7898003820 0x7f7898003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:03.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78b559a700 1 --2- 172.21.2.105:0/3867941683 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7898004500 0x7f7898004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:03.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78b559a700 1 --2- 172.21.2.105:0/3867941683 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7898004f70 0x7f789800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:03.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78b559a700 1 -- 172.21.2.105:0/3867941683 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b81488a0 con 0x7f7898003820 2021-11-12T05:44:03.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78b559a700 1 -- 172.21.2.105:0/3867941683 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789800be50 con 0x7f7898004500 2021-11-12T05:44:03.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78b559a700 1 -- 172.21.2.105:0/3867941683 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f789800c010 con 0x7f7898004f70 2021-11-12T05:44:03.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78b659c700 1 --2- 172.21.2.105:0/3867941683 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7898003820 0x7f7898003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:03.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78b659c700 1 -- 172.21.2.105:0/3867941683 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7898004f70 msgr2=0x7f789800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:03.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78b659c700 1 --2- 172.21.2.105:0/3867941683 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7898004f70 0x7f789800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:03.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78b659c700 1 -- 172.21.2.105:0/3867941683 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7898004500 msgr2=0x7f7898004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:03.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78b659c700 1 --2- 172.21.2.105:0/3867941683 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7898004500 0x7f7898004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:03.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78b659c700 1 -- 172.21.2.105:0/3867941683 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7898003260 con 0x7f7898003820 2021-11-12T05:44:03.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78b6d9d700 1 -- 172.21.2.105:0/3867941683 reap_dead start 2021-11-12T05:44:03.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78b659c700 1 --2- 172.21.2.105:0/3867941683 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7898003820 0x7f7898003c20 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f78a000a000 tx=0x7f78a0008040).ready entity=mon.0 client_cookie=365015de2e57e8d4 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:03.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78b559a700 1 -- 172.21.2.105:0/3867941683 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78a0013670 con 0x7f7898003820 2021-11-12T05:44:03.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78b559a700 1 -- 172.21.2.105:0/3867941683 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a00137d0 con 0x7f7898003820 2021-11-12T05:44:03.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78b559a700 1 -- 172.21.2.105:0/3867941683 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78a0013b30 con 0x7f7898003820 2021-11-12T05:44:03.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78bc97a700 1 -- 172.21.2.105:0/3867941683 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7898003820 msgr2=0x7f7898003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:03.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78bc97a700 1 --2- 172.21.2.105:0/3867941683 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7898003820 0x7f7898003c20 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f78a000a000 tx=0x7f78a0008040).stop 2021-11-12T05:44:03.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78bc97a700 1 -- 172.21.2.105:0/3867941683 shutdown_connections 2021-11-12T05:44:03.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78bc97a700 1 --2- 172.21.2.105:0/3867941683 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7898003820 0x7f7898003c20 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:03.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.995+0000 7f78bc97a700 1 -- 172.21.2.105:0/3867941683 >> 172.21.2.105:0/3867941683 conn(0x7f78b80b5370 msgr2=0x7f78b80b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:03.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.999+0000 7f78bc97a700 1 -- 172.21.2.105:0/3867941683 shutdown_connections 2021-11-12T05:44:03.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.999+0000 7f78bc97a700 1 -- 172.21.2.105:0/3867941683 wait complete. 2021-11-12T05:44:03.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.999+0000 7f78bc97a700 1 Processor -- start 2021-11-12T05:44:03.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.999+0000 7f78bc97a700 1 -- start start 2021-11-12T05:44:03.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.999+0000 7f78bc97a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7898003820 0x7f78b80608a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:03.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.999+0000 7f78bc97a700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f78b80aa860 0x7f78b8156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:03.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.999+0000 7f78bc97a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f78b8157260 0x7f78b81576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:03.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.999+0000 7f78bc97a700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b80a94e0 con 0x7f7898003820 2021-11-12T05:44:03.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.999+0000 7f78bc97a700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b80a9780 con 0x7f78b80aa860 2021-11-12T05:44:03.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.999+0000 7f78bc97a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b80a9a20 con 0x7f78b8157260 2021-11-12T05:44:03.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.999+0000 7f78b659c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7898003820 0x7f78b80608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:03.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.999+0000 7f78b659c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7898003820 0x7f78b80608a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45752/0 (socket says 172.21.2.105:45752) 2021-11-12T05:44:03.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.999+0000 7f78b659c700 1 -- 172.21.2.105:0/3323338773 learned_addr learned my addr 172.21.2.105:0/3323338773 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:03.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.999+0000 7f78b659c700 1 -- 172.21.2.105:0/3323338773 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f78b8157260 msgr2=0x7f78b81576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:03.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.999+0000 7f78b659c700 1 --2- 172.21.2.105:0/3323338773 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f78b8157260 0x7f78b81576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:03.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.999+0000 7f78b659c700 1 -- 172.21.2.105:0/3323338773 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f78b80aa860 msgr2=0x7f78b8156d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:03.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.999+0000 7f78b659c700 1 --2- 172.21.2.105:0/3323338773 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f78b80aa860 0x7f78b8156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:03.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.999+0000 7f78b659c700 1 -- 172.21.2.105:0/3323338773 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b80a9df0 con 0x7f7898003820 2021-11-12T05:44:03.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.999+0000 7f78b659c700 1 --2- 172.21.2.105:0/3323338773 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7898003820 0x7f78b80608a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f78a000a000 tx=0x7f78a0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:03.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.999+0000 7f78af7fe700 1 -- 172.21.2.105:0/3323338773 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78a0012c40 con 0x7f7898003820 2021-11-12T05:44:03.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.999+0000 7f78af7fe700 1 -- 172.21.2.105:0/3323338773 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a0000e90 con 0x7f7898003820 2021-11-12T05:44:03.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.999+0000 7f78bc97a700 1 -- 172.21.2.105:0/3323338773 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b80ab910 con 0x7f7898003820 2021-11-12T05:44:03.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.999+0000 7f78af7fe700 1 -- 172.21.2.105:0/3323338773 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78a001d410 con 0x7f7898003820 2021-11-12T05:44:03.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.999+0000 7f78bc97a700 1 -- 172.21.2.105:0/3323338773 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b815a3a0 con 0x7f7898003820 2021-11-12T05:44:03.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.999+0000 7f78bc97a700 1 -- 172.21.2.105:0/3323338773 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b80b1440 con 0x7f7898003820 2021-11-12T05:44:03.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.999+0000 7f78af7fe700 1 -- 172.21.2.105:0/3323338773 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f78a001d570 con 0x7f7898003820 2021-11-12T05:44:03.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.999+0000 7f78af7fe700 1 --2- 172.21.2.105:0/3323338773 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f789c0536d0 0x7f789c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:03.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.999+0000 7f78af7fe700 1 -- 172.21.2.105:0/3323338773 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f78a006d0f0 con 0x7f7898003820 2021-11-12T05:44:03.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.999+0000 7f78b5d9b700 1 --2- 172.21.2.105:0/3323338773 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f789c0536d0 0x7f789c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:03.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:02.999+0000 7f78b5d9b700 1 --2- 172.21.2.105:0/3323338773 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f789c0536d0 0x7f789c055b90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f78b80b0eb0 tx=0x7f78b80ada20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:03.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.003+0000 7f78af7fe700 1 -- 172.21.2.105:0/3323338773 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f78a00443d0 con 0x7f7898003820 2021-11-12T05:44:03.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.087+0000 7f78bc97a700 1 -- 172.21.2.105:0/3323338773 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f78b8057350 con 0x7f7898003820 2021-11-12T05:44:03.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.087+0000 7f78af7fe700 1 -- 172.21.2.105:0/3323338773 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v51) v1 ==== 84+0+143 (secure 0 0 0) 0x7f78a00479f0 con 0x7f7898003820 2021-11-12T05:44:03.093 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:44:03.094 INFO:teuthology.orchestra.run.gibba005.stdout:[ 2021-11-12T05:44:03.094 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:03.094 INFO:teuthology.orchestra.run.gibba005.stdout: "poolnum": 1, 2021-11-12T05:44:03.094 INFO:teuthology.orchestra.run.gibba005.stdout: "poolname": "device_health_metrics" 2021-11-12T05:44:03.094 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:03.095 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:44:03.095 INFO:teuthology.orchestra.run.gibba005.stdout: "poolnum": 2, 2021-11-12T05:44:03.095 INFO:teuthology.orchestra.run.gibba005.stdout: "poolname": "rbd" 2021-11-12T05:44:03.095 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:03.096 INFO:teuthology.orchestra.run.gibba005.stdout:] 2021-11-12T05:44:03.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.087+0000 7f78bc97a700 1 -- 172.21.2.105:0/3323338773 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f789c0536d0 msgr2=0x7f789c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:03.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.087+0000 7f78bc97a700 1 --2- 172.21.2.105:0/3323338773 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f789c0536d0 0x7f789c055b90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f78b80b0eb0 tx=0x7f78b80ada20).stop 2021-11-12T05:44:03.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.087+0000 7f78bc97a700 1 -- 172.21.2.105:0/3323338773 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7898003820 msgr2=0x7f78b80608a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:03.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.087+0000 7f78bc97a700 1 --2- 172.21.2.105:0/3323338773 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7898003820 0x7f78b80608a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f78a000a000 tx=0x7f78a0008040).stop 2021-11-12T05:44:03.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.091+0000 7f78bc97a700 1 -- 172.21.2.105:0/3323338773 shutdown_connections 2021-11-12T05:44:03.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.091+0000 7f78bc97a700 1 --2- 172.21.2.105:0/3323338773 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f789c0536d0 0x7f789c055b90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:03.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.091+0000 7f78bc97a700 1 --2- 172.21.2.105:0/3323338773 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f78b8157260 0x7f78b81576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:03.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.091+0000 7f78bc97a700 1 --2- 172.21.2.105:0/3323338773 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f78b80aa860 0x7f78b8156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:03.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.091+0000 7f78bc97a700 1 --2- 172.21.2.105:0/3323338773 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7898003820 0x7f78b80608a0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:03.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.091+0000 7f78bc97a700 1 -- 172.21.2.105:0/3323338773 >> 172.21.2.105:0/3323338773 conn(0x7f78b80b5370 msgr2=0x7f78b805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:03.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.091+0000 7f78bc97a700 1 -- 172.21.2.105:0/3323338773 shutdown_connections 2021-11-12T05:44:03.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.091+0000 7f78bc97a700 1 -- 172.21.2.105:0/3323338773 wait complete. 2021-11-12T05:44:03.100 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-12T05:44:03.101 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-12T05:44:03.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.151+0000 7fb529726700 1 Processor -- start 2021-11-12T05:44:03.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.151+0000 7fb529726700 1 -- start start 2021-11-12T05:44:03.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.151+0000 7fb529726700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb5240626b0 0x7fb524062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:03.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.151+0000 7fb529726700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fb5240af750 0x7fb524130370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:03.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.151+0000 7fb529726700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb524130860 0x7fb52414a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:03.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.151+0000 7fb529726700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb524130cf0 con 0x7fb524130860 2021-11-12T05:44:03.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.151+0000 7fb529726700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5240b0d50 con 0x7fb5240af750 2021-11-12T05:44:03.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.151+0000 7fb529726700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5240ad380 con 0x7fb5240626b0 2021-11-12T05:44:03.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.151+0000 7fb5237fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb524130860 0x7fb52414a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:03.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.151+0000 7fb5237fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb524130860 0x7fb52414a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45762/0 (socket says 172.21.2.105:45762) 2021-11-12T05:44:03.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.151+0000 7fb5237fe700 1 -- 172.21.2.105:0/3861712801 learned_addr learned my addr 172.21.2.105:0/3861712801 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:03.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.151+0000 7fb522ffd700 1 --2- 172.21.2.105:0/3861712801 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb5240626b0 0x7fb524062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:03.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.151+0000 7fb5227fc700 1 --2- 172.21.2.105:0/3861712801 >> v2:172.21.2.115:3300/0 conn(0x7fb5240af750 0x7fb524130370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:03.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.151+0000 7fb5237fe700 1 -- 172.21.2.105:0/3861712801 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb5240626b0 msgr2=0x7fb524062a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:03.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.151+0000 7fb5237fe700 1 --2- 172.21.2.105:0/3861712801 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb5240626b0 0x7fb524062a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:03.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.151+0000 7fb5237fe700 1 -- 172.21.2.105:0/3861712801 >> v2:172.21.2.115:3300/0 conn(0x7fb5240af750 msgr2=0x7fb524130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:03.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.151+0000 7fb5237fe700 1 --2- 172.21.2.105:0/3861712801 >> v2:172.21.2.115:3300/0 conn(0x7fb5240af750 0x7fb524130370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:03.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.151+0000 7fb5237fe700 1 -- 172.21.2.105:0/3861712801 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5240ae190 con 0x7fb524130860 2021-11-12T05:44:03.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.151+0000 7fb5237fe700 1 --2- 172.21.2.105:0/3861712801 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb524130860 0x7fb52414a950 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7fb51c0032f0 tx=0x7fb51c009290).ready entity=mon.0 client_cookie=a8ad145153700c9f server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:03.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.151+0000 7fb521ffb700 1 -- 172.21.2.105:0/3861712801 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb51c00b870 con 0x7fb524130860 2021-11-12T05:44:03.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.151+0000 7fb521ffb700 1 -- 172.21.2.105:0/3861712801 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51c00b9d0 con 0x7fb524130860 2021-11-12T05:44:03.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.151+0000 7fb521ffb700 1 -- 172.21.2.105:0/3861712801 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb51c00bb40 con 0x7fb524130860 2021-11-12T05:44:03.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.151+0000 7fb529726700 1 -- 172.21.2.105:0/3861712801 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb524130860 msgr2=0x7fb52414a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:03.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.151+0000 7fb529726700 1 --2- 172.21.2.105:0/3861712801 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb524130860 0x7fb52414a950 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7fb51c0032f0 tx=0x7fb51c009290).stop 2021-11-12T05:44:03.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.151+0000 7fb529726700 1 -- 172.21.2.105:0/3861712801 shutdown_connections 2021-11-12T05:44:03.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.151+0000 7fb529726700 1 --2- 172.21.2.105:0/3861712801 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb524130860 0x7fb52414a950 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:03.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.151+0000 7fb529726700 1 --2- 172.21.2.105:0/3861712801 >> v2:172.21.2.115:3300/0 conn(0x7fb5240af750 0x7fb524130370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:03.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.151+0000 7fb529726700 1 --2- 172.21.2.105:0/3861712801 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb5240626b0 0x7fb524062a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:03.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.151+0000 7fb529726700 1 -- 172.21.2.105:0/3861712801 >> 172.21.2.105:0/3861712801 conn(0x7fb5240b5320 msgr2=0x7fb5240b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:03.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.151+0000 7fb529726700 1 -- 172.21.2.105:0/3861712801 shutdown_connections 2021-11-12T05:44:03.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.151+0000 7fb529726700 1 -- 172.21.2.105:0/3861712801 wait complete. 2021-11-12T05:44:03.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.151+0000 7fb529726700 1 Processor -- start 2021-11-12T05:44:03.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.151+0000 7fb529726700 1 -- start start 2021-11-12T05:44:03.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.155+0000 7fb529726700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb5240626b0 0x7fb5240660e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:03.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.155+0000 7fb529726700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb5240af750 0x7fb5241444c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:03.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.155+0000 7fb529726700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb524130860 0x7fb5241449b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:03.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.155+0000 7fb529726700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb524063080 con 0x7fb524130860 2021-11-12T05:44:03.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.155+0000 7fb529726700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5241571f0 con 0x7fb5240626b0 2021-11-12T05:44:03.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.155+0000 7fb529726700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5240665d0 con 0x7fb5240af750 2021-11-12T05:44:03.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.155+0000 7fb5237fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb524130860 0x7fb5241449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:03.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.155+0000 7fb5237fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb524130860 0x7fb5241449b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45768/0 (socket says 172.21.2.105:45768) 2021-11-12T05:44:03.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.155+0000 7fb5237fe700 1 -- 172.21.2.105:0/385358762 learned_addr learned my addr 172.21.2.105:0/385358762 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:03.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.155+0000 7fb522ffd700 1 --2- 172.21.2.105:0/385358762 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb5240626b0 0x7fb5240660e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:03.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.155+0000 7fb5227fc700 1 --2- 172.21.2.105:0/385358762 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb5240af750 0x7fb5241444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:03.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.155+0000 7fb5237fe700 1 -- 172.21.2.105:0/385358762 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb5240af750 msgr2=0x7fb5241444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:03.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.155+0000 7fb5237fe700 1 --2- 172.21.2.105:0/385358762 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb5240af750 0x7fb5241444c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:03.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.155+0000 7fb5237fe700 1 -- 172.21.2.105:0/385358762 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb5240626b0 msgr2=0x7fb5240660e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:03.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.155+0000 7fb5237fe700 1 --2- 172.21.2.105:0/385358762 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb5240626b0 0x7fb5240660e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:03.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.155+0000 7fb5237fe700 1 -- 172.21.2.105:0/385358762 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb51c009530 con 0x7fb524130860 2021-11-12T05:44:03.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.155+0000 7fb5237fe700 1 --2- 172.21.2.105:0/385358762 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb524130860 0x7fb5241449b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7fb524064fd0 tx=0x7fb51c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:03.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.155+0000 7fb513fff700 1 -- 172.21.2.105:0/385358762 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb51c00b870 con 0x7fb524130860 2021-11-12T05:44:03.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.155+0000 7fb513fff700 1 -- 172.21.2.105:0/385358762 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51c021630 con 0x7fb524130860 2021-11-12T05:44:03.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.155+0000 7fb529726700 1 -- 172.21.2.105:0/385358762 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb524066810 con 0x7fb524130860 2021-11-12T05:44:03.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.155+0000 7fb513fff700 1 -- 172.21.2.105:0/385358762 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb51c021990 con 0x7fb524130860 2021-11-12T05:44:03.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.155+0000 7fb529726700 1 -- 172.21.2.105:0/385358762 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb52414de70 con 0x7fb524130860 2021-11-12T05:44:03.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.155+0000 7fb529726700 1 -- 172.21.2.105:0/385358762 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb52414ae40 con 0x7fb524130860 2021-11-12T05:44:03.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.155+0000 7fb513fff700 1 -- 172.21.2.105:0/385358762 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb51c00f070 con 0x7fb524130860 2021-11-12T05:44:03.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.155+0000 7fb513fff700 1 --2- 172.21.2.105:0/385358762 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb5000535b0 0x7fb500055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:03.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.155+0000 7fb513fff700 1 -- 172.21.2.105:0/385358762 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fb51c06ce80 con 0x7fb524130860 2021-11-12T05:44:03.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.155+0000 7fb522ffd700 1 --2- 172.21.2.105:0/385358762 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb5000535b0 0x7fb500055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:03.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.155+0000 7fb522ffd700 1 --2- 172.21.2.105:0/385358762 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb5000535b0 0x7fb500055a70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fb51800b000 tx=0x7fb518006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:03.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.159+0000 7fb513fff700 1 -- 172.21.2.105:0/385358762 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb51c0440b0 con 0x7fb524130860 2021-11-12T05:44:03.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:03.243+0000 7fb529726700 1 -- 172.21.2.105:0/385358762 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fb5240669a0 con 0x7fb524130860 2021-11-12T05:44:04.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.143+0000 7fb513fff700 1 -- 172.21.2.105:0/385358762 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v52) v1 ==== 133+0+0 (secure 0 0 0) 0x7fb51c015070 con 0x7fb524130860 2021-11-12T05:44:04.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.143+0000 7fb529726700 1 -- 172.21.2.105:0/385358762 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb5000535b0 msgr2=0x7fb500055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:04.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.143+0000 7fb529726700 1 --2- 172.21.2.105:0/385358762 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb5000535b0 0x7fb500055a70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fb51800b000 tx=0x7fb518006df0).stop 2021-11-12T05:44:04.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.143+0000 7fb529726700 1 -- 172.21.2.105:0/385358762 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb524130860 msgr2=0x7fb5241449b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:04.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.143+0000 7fb529726700 1 --2- 172.21.2.105:0/385358762 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb524130860 0x7fb5241449b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7fb524064fd0 tx=0x7fb51c016000).stop 2021-11-12T05:44:04.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.143+0000 7fb529726700 1 -- 172.21.2.105:0/385358762 shutdown_connections 2021-11-12T05:44:04.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.143+0000 7fb529726700 1 --2- 172.21.2.105:0/385358762 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb5000535b0 0x7fb500055a70 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:04.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.143+0000 7fb529726700 1 --2- 172.21.2.105:0/385358762 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb524130860 0x7fb5241449b0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:04.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.143+0000 7fb529726700 1 --2- 172.21.2.105:0/385358762 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb5240af750 0x7fb5241444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:04.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.143+0000 7fb529726700 1 --2- 172.21.2.105:0/385358762 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb5240626b0 0x7fb5240660e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:04.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.143+0000 7fb529726700 1 -- 172.21.2.105:0/385358762 >> 172.21.2.105:0/385358762 conn(0x7fb5240b5320 msgr2=0x7fb5240b0080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:04.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.143+0000 7fb529726700 1 -- 172.21.2.105:0/385358762 shutdown_connections 2021-11-12T05:44:04.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.143+0000 7fb529726700 1 -- 172.21.2.105:0/385358762 wait complete. 2021-11-12T05:44:04.152 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_metadata' created 2021-11-12T05:44:04.156 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-11-12T05:44:04.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.203+0000 7fb66033f700 1 Processor -- start 2021-11-12T05:44:04.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.203+0000 7fb66033f700 1 -- start start 2021-11-12T05:44:04.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.203+0000 7fb66033f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb6580ae090 0x7fb658140d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:04.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.203+0000 7fb66033f700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb6580b3980 0x7fb6580b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:04.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.203+0000 7fb66033f700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6580b7ee0 con 0x7fb6580b7b00 2021-11-12T05:44:04.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.203+0000 7fb66033f700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6580b2030 con 0x7fb6580b3980 2021-11-12T05:44:04.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.203+0000 7fb66033f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6580b22d0 con 0x7fb6580ae090 2021-11-12T05:44:04.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.203+0000 7fb65e8dc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb6580b3980 0x7fb6580b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:04.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.203+0000 7fb65e0db700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fb6580b7b00 0x7fb6580b2a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:56170/0 (socket says 172.21.2.105:56170) 2021-11-12T05:44:04.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.203+0000 7fb65e0db700 1 -- 172.21.2.105:0/246959282 learned_addr learned my addr 172.21.2.105:0/246959282 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:44:04.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.203+0000 7fb65e8dc700 1 -- 172.21.2.105:0/246959282 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb6580ae090 msgr2=0x7fb658140d80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:44:04.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.203+0000 7fb65e8dc700 1 --2- 172.21.2.105:0/246959282 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb6580ae090 0x7fb658140d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:04.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.203+0000 7fb65e8dc700 1 -- 172.21.2.105:0/246959282 >> v1:172.21.2.105:6789/0 conn(0x7fb6580b7b00 legacy=0x7fb6580b2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:04.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.203+0000 7fb65e8dc700 1 -- 172.21.2.105:0/246959282 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6580b2570 con 0x7fb6580b3980 2021-11-12T05:44:04.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.203+0000 7fb65e8dc700 1 --2- 172.21.2.105:0/246959282 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6580b3980 0x7fb6580b3e10 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7fb6500032f0 tx=0x7fb6500091d0).ready entity=mon.0 client_cookie=f31a9a7ae2c1640e server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:04.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.203+0000 7fb65d0d9700 1 -- 172.21.2.105:0/246959282 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb650009ea0 con 0x7fb6580b3980 2021-11-12T05:44:04.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.203+0000 7fb65d0d9700 1 -- 172.21.2.105:0/246959282 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65000b8a0 con 0x7fb6580b3980 2021-11-12T05:44:04.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.203+0000 7fb65d0d9700 1 -- 172.21.2.105:0/246959282 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb65000ba50 con 0x7fb6580b3980 2021-11-12T05:44:04.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.203+0000 7fb66033f700 1 -- 172.21.2.105:0/246959282 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6580b3980 msgr2=0x7fb6580b3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:04.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.203+0000 7fb66033f700 1 --2- 172.21.2.105:0/246959282 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6580b3980 0x7fb6580b3e10 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7fb6500032f0 tx=0x7fb6500091d0).stop 2021-11-12T05:44:04.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.203+0000 7fb66033f700 1 -- 172.21.2.105:0/246959282 shutdown_connections 2021-11-12T05:44:04.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.203+0000 7fb66033f700 1 --2- 172.21.2.105:0/246959282 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6580b3980 0x7fb6580b3e10 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:04.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.203+0000 7fb66033f700 1 --2- 172.21.2.105:0/246959282 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb6580ae090 0x7fb658140d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:04.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.203+0000 7fb66033f700 1 -- 172.21.2.105:0/246959282 >> 172.21.2.105:0/246959282 conn(0x7fb6580608d0 msgr2=0x7fb65805c490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:04.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.203+0000 7fb66033f700 1 -- 172.21.2.105:0/246959282 shutdown_connections 2021-11-12T05:44:04.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.203+0000 7fb66033f700 1 -- 172.21.2.105:0/246959282 wait complete. 2021-11-12T05:44:04.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.207+0000 7fb66033f700 1 Processor -- start 2021-11-12T05:44:04.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.207+0000 7fb66033f700 1 -- start start 2021-11-12T05:44:04.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.207+0000 7fb66033f700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6580ae090 0x7fb6580aec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:04.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.207+0000 7fb66033f700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb6580b3980 0x7fb658121750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:04.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.207+0000 7fb66033f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb6580b7b00 0x7fb6580b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:04.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.207+0000 7fb66033f700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb658121c40 con 0x7fb6580ae090 2021-11-12T05:44:04.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.207+0000 7fb66033f700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6580b13c0 con 0x7fb6580b3980 2021-11-12T05:44:04.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.207+0000 7fb66033f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6580b1660 con 0x7fb6580b7b00 2021-11-12T05:44:04.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.207+0000 7fb65e0db700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6580ae090 0x7fb6580aec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:04.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.207+0000 7fb65e0db700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6580ae090 0x7fb6580aec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45782/0 (socket says 172.21.2.105:45782) 2021-11-12T05:44:04.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.207+0000 7fb65e0db700 1 -- 172.21.2.105:0/619787078 learned_addr learned my addr 172.21.2.105:0/619787078 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:04.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.207+0000 7fb65e0db700 1 -- 172.21.2.105:0/619787078 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb6580b7b00 msgr2=0x7fb6580b02c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:44:04.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.207+0000 7fb65e0db700 1 --2- 172.21.2.105:0/619787078 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb6580b7b00 0x7fb6580b02c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:04.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.207+0000 7fb65e0db700 1 -- 172.21.2.105:0/619787078 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb6580b3980 msgr2=0x7fb658121750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:04.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.207+0000 7fb65e0db700 1 --2- 172.21.2.105:0/619787078 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb6580b3980 0x7fb658121750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:04.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.207+0000 7fb65e0db700 1 -- 172.21.2.105:0/619787078 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb650009470 con 0x7fb6580ae090 2021-11-12T05:44:04.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.207+0000 7fb65e0db700 1 --2- 172.21.2.105:0/619787078 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6580ae090 0x7fb6580aec50 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7fb658065530 tx=0x7fb654007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:04.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.207+0000 7fb64b7fe700 1 -- 172.21.2.105:0/619787078 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb65400ce30 con 0x7fb6580ae090 2021-11-12T05:44:04.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.207+0000 7fb64b7fe700 1 -- 172.21.2.105:0/619787078 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb654007320 con 0x7fb6580ae090 2021-11-12T05:44:04.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.207+0000 7fb66033f700 1 -- 172.21.2.105:0/619787078 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6580b1900 con 0x7fb6580ae090 2021-11-12T05:44:04.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.207+0000 7fb64b7fe700 1 -- 172.21.2.105:0/619787078 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb654005220 con 0x7fb6580ae090 2021-11-12T05:44:04.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.207+0000 7fb66033f700 1 -- 172.21.2.105:0/619787078 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb65813eea0 con 0x7fb6580ae090 2021-11-12T05:44:04.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.207+0000 7fb66033f700 1 -- 172.21.2.105:0/619787078 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb658140b70 con 0x7fb6580ae090 2021-11-12T05:44:04.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.207+0000 7fb64b7fe700 1 -- 172.21.2.105:0/619787078 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb65401b070 con 0x7fb6580ae090 2021-11-12T05:44:04.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.207+0000 7fb64b7fe700 1 --2- 172.21.2.105:0/619787078 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb638053610 0x7fb638055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:04.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.207+0000 7fb64b7fe700 1 -- 172.21.2.105:0/619787078 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5950+0+0 (secure 0 0 0) 0x7fb65406ada0 con 0x7fb6580ae090 2021-11-12T05:44:04.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.207+0000 7fb65d8da700 1 --2- 172.21.2.105:0/619787078 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb638053610 0x7fb638055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:04.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.207+0000 7fb65d8da700 1 --2- 172.21.2.105:0/619787078 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb638053610 0x7fb638055ad0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7fb64c002fb0 tx=0x7fb64c0069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:04.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.211+0000 7fb64b7fe700 1 -- 172.21.2.105:0/619787078 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb658140b70 con 0x7fb6580ae090 2021-11-12T05:44:04.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:04.295+0000 7fb66033f700 1 -- 172.21.2.105:0/619787078 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fb658140b70 con 0x7fb6580ae090 2021-11-12T05:44:05.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.155+0000 7fb64b7fe700 1 -- 172.21.2.105:0/619787078 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v53) v1 ==== 125+0+0 (secure 0 0 0) 0x7fb658140b70 con 0x7fb6580ae090 2021-11-12T05:44:05.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.155+0000 7fb66033f700 1 -- 172.21.2.105:0/619787078 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb638053610 msgr2=0x7fb638055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:05.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.155+0000 7fb66033f700 1 --2- 172.21.2.105:0/619787078 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb638053610 0x7fb638055ad0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7fb64c002fb0 tx=0x7fb64c0069b0).stop 2021-11-12T05:44:05.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.155+0000 7fb66033f700 1 -- 172.21.2.105:0/619787078 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6580ae090 msgr2=0x7fb6580aec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:05.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.155+0000 7fb66033f700 1 --2- 172.21.2.105:0/619787078 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6580ae090 0x7fb6580aec50 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7fb658065530 tx=0x7fb654007c60).stop 2021-11-12T05:44:05.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.155+0000 7fb66033f700 1 -- 172.21.2.105:0/619787078 shutdown_connections 2021-11-12T05:44:05.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.155+0000 7fb66033f700 1 --2- 172.21.2.105:0/619787078 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb638053610 0x7fb638055ad0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:05.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.155+0000 7fb66033f700 1 --2- 172.21.2.105:0/619787078 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb6580b7b00 0x7fb6580b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:05.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.155+0000 7fb66033f700 1 --2- 172.21.2.105:0/619787078 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb6580b3980 0x7fb658121750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:05.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.155+0000 7fb66033f700 1 --2- 172.21.2.105:0/619787078 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6580ae090 0x7fb6580aec50 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:05.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.155+0000 7fb66033f700 1 -- 172.21.2.105:0/619787078 >> 172.21.2.105:0/619787078 conn(0x7fb6580608d0 msgr2=0x7fb65812a020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:05.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.155+0000 7fb66033f700 1 -- 172.21.2.105:0/619787078 shutdown_connections 2021-11-12T05:44:05.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.155+0000 7fb66033f700 1 -- 172.21.2.105:0/619787078 wait complete. 2021-11-12T05:44:05.163 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_data' created 2021-11-12T05:44:05.167 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-12T05:44:05.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.215+0000 7f8187436700 1 Processor -- start 2021-11-12T05:44:05.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.215+0000 7f8187436700 1 -- start start 2021-11-12T05:44:05.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.215+0000 7f8187436700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f81800ad080 0x7f81800af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:05.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.215+0000 7f8187436700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f81800ac280 0x7f81800ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:05.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.215+0000 7f8187436700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81800ac7b0 con 0x7f818014abe0 2021-11-12T05:44:05.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.215+0000 7f8187436700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81801488a0 con 0x7f81800ac280 2021-11-12T05:44:05.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.215+0000 7f8187436700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81800ac9e0 con 0x7f81800ad080 2021-11-12T05:44:05.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.215+0000 7f81849d1700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f81800ac280 0x7f81800ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:05.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.215+0000 7f81849d1700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f81800ac280 0x7f81800ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45792/0 (socket says 172.21.2.105:45792) 2021-11-12T05:44:05.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.215+0000 7f81849d1700 1 -- 172.21.2.105:0/663216886 learned_addr learned my addr 172.21.2.105:0/663216886 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:05.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.215+0000 7f81849d1700 1 -- 172.21.2.105:0/663216886 >> v2:172.21.2.115:3300/0 conn(0x7f81800ad080 msgr2=0x7f81800af730 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:44:05.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.215+0000 7f81849d1700 1 --2- 172.21.2.105:0/663216886 >> v2:172.21.2.115:3300/0 conn(0x7f81800ad080 0x7f81800af730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:05.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.215+0000 7f81849d1700 1 -- 172.21.2.105:0/663216886 >> v1:172.21.2.115:6789/0 conn(0x7f818014abe0 legacy=0x7f818014b090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:44:05.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.215+0000 7f81849d1700 1 -- 172.21.2.105:0/663216886 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81800b0b30 con 0x7f81800ac280 2021-11-12T05:44:05.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.215+0000 7f81849d1700 1 --2- 172.21.2.105:0/663216886 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f81800ac280 0x7f81800ad460 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f818014bc40 tx=0x7f817c006eb0).ready entity=mon.0 client_cookie=854c54bd976fcb8d server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:05.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.215+0000 7f816ffff700 1 -- 172.21.2.105:0/663216886 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f817c00d5c0 con 0x7f81800ac280 2021-11-12T05:44:05.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.215+0000 7f816ffff700 1 -- 172.21.2.105:0/663216886 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817c000e90 con 0x7f81800ac280 2021-11-12T05:44:05.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.215+0000 7f816ffff700 1 -- 172.21.2.105:0/663216886 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f817c00d910 con 0x7f81800ac280 2021-11-12T05:44:05.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.215+0000 7f8187436700 1 -- 172.21.2.105:0/663216886 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f81800ac280 msgr2=0x7f81800ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:05.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.215+0000 7f8187436700 1 --2- 172.21.2.105:0/663216886 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f81800ac280 0x7f81800ad460 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f818014bc40 tx=0x7f817c006eb0).stop 2021-11-12T05:44:05.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.215+0000 7f8187436700 1 -- 172.21.2.105:0/663216886 shutdown_connections 2021-11-12T05:44:05.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.215+0000 7f8187436700 1 --2- 172.21.2.105:0/663216886 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f81800ac280 0x7f81800ad460 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:05.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.215+0000 7f8187436700 1 --2- 172.21.2.105:0/663216886 >> v2:172.21.2.115:3300/0 conn(0x7f81800ad080 0x7f81800af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:05.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.219+0000 7f8187436700 1 -- 172.21.2.105:0/663216886 >> 172.21.2.105:0/663216886 conn(0x7f81800b5370 msgr2=0x7f81800b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:05.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.219+0000 7f8187436700 1 -- 172.21.2.105:0/663216886 shutdown_connections 2021-11-12T05:44:05.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.219+0000 7f8187436700 1 -- 172.21.2.105:0/663216886 wait complete. 2021-11-12T05:44:05.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.219+0000 7f8187436700 1 Processor -- start 2021-11-12T05:44:05.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.219+0000 7f8187436700 1 -- start start 2021-11-12T05:44:05.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.219+0000 7f8187436700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f81800ac280 0x7f81800aadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:05.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.219+0000 7f8187436700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f81800ad080 0x7f818015a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:05.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.219+0000 7f8187436700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f818014abe0 0x7f818015a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:05.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.219+0000 7f8187436700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8180064070 con 0x7f818014abe0 2021-11-12T05:44:05.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.219+0000 7f8187436700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81800ab970 con 0x7f81800ad080 2021-11-12T05:44:05.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.219+0000 7f8187436700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8180063da0 con 0x7f81800ac280 2021-11-12T05:44:05.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.219+0000 7f81859d3700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f818014abe0 0x7f818015a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:05.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.219+0000 7f81859d3700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f818014abe0 0x7f818015a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45796/0 (socket says 172.21.2.105:45796) 2021-11-12T05:44:05.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.219+0000 7f81859d3700 1 -- 172.21.2.105:0/2738392558 learned_addr learned my addr 172.21.2.105:0/2738392558 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:05.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.219+0000 7f81859d3700 1 -- 172.21.2.105:0/2738392558 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f81800ac280 msgr2=0x7f81800aadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:05.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.219+0000 7f81859d3700 1 --2- 172.21.2.105:0/2738392558 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f81800ac280 0x7f81800aadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:05.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.219+0000 7f81859d3700 1 -- 172.21.2.105:0/2738392558 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f81800ad080 msgr2=0x7f818015a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:05.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.219+0000 7f81859d3700 1 --2- 172.21.2.105:0/2738392558 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f81800ad080 0x7f818015a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:05.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.219+0000 7f81859d3700 1 -- 172.21.2.105:0/2738392558 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f817c00b1e0 con 0x7f818014abe0 2021-11-12T05:44:05.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.219+0000 7f81859d3700 1 --2- 172.21.2.105:0/2738392558 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f818014abe0 0x7f818015a700 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f8178001250 tx=0x7f81780090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:05.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.219+0000 7f816e7fc700 1 -- 172.21.2.105:0/2738392558 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81780014e0 con 0x7f818014abe0 2021-11-12T05:44:05.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.219+0000 7f816e7fc700 1 -- 172.21.2.105:0/2738392558 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8178001640 con 0x7f818014abe0 2021-11-12T05:44:05.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.219+0000 7f816e7fc700 1 -- 172.21.2.105:0/2738392558 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81780019a0 con 0x7f818014abe0 2021-11-12T05:44:05.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.219+0000 7f8187436700 1 -- 172.21.2.105:0/2738392558 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81800a94b0 con 0x7f818014abe0 2021-11-12T05:44:05.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.219+0000 7f8187436700 1 -- 172.21.2.105:0/2738392558 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81800ab500 con 0x7f818014abe0 2021-11-12T05:44:05.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.219+0000 7f8187436700 1 -- 172.21.2.105:0/2738392558 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81800aaa20 con 0x7f818014abe0 2021-11-12T05:44:05.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.219+0000 7f816e7fc700 1 -- 172.21.2.105:0/2738392558 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8178018030 con 0x7f818014abe0 2021-11-12T05:44:05.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.219+0000 7f816e7fc700 1 --2- 172.21.2.105:0/2738392558 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8160053580 0x7f8160055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:05.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.219+0000 7f816e7fc700 1 -- 172.21.2.105:0/2738392558 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6300+0+0 (secure 0 0 0) 0x7f817806b4b0 con 0x7f818014abe0 2021-11-12T05:44:05.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.219+0000 7f81851d2700 1 --2- 172.21.2.105:0/2738392558 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8160053580 0x7f8160055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:05.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.219+0000 7f81851d2700 1 --2- 172.21.2.105:0/2738392558 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8160053580 0x7f8160055a40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f8170002fb0 tx=0x7f81700069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:05.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.223+0000 7f816e7fc700 1 -- 172.21.2.105:0/2738392558 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8178042450 con 0x7f818014abe0 2021-11-12T05:44:05.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.335+0000 7f8187436700 1 -- 172.21.2.105:0/2738392558 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f81800ab690 con 0x7f818014abe0 2021-11-12T05:44:05.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.339+0000 7f816e7fc700 1 -- 172.21.2.105:0/2738392558 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 9 and data pool 10 v19) v1 ==== 188+0+0 (secure 0 0 0) 0x7f8178045a70 con 0x7f818014abe0 2021-11-12T05:44:05.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.339+0000 7f8187436700 1 -- 172.21.2.105:0/2738392558 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8160053580 msgr2=0x7f8160055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:05.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.339+0000 7f8187436700 1 --2- 172.21.2.105:0/2738392558 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8160053580 0x7f8160055a40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f8170002fb0 tx=0x7f81700069b0).stop 2021-11-12T05:44:05.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.339+0000 7f8187436700 1 -- 172.21.2.105:0/2738392558 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f818014abe0 msgr2=0x7f818015a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:05.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.339+0000 7f8187436700 1 --2- 172.21.2.105:0/2738392558 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f818014abe0 0x7f818015a700 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f8178001250 tx=0x7f81780090f0).stop 2021-11-12T05:44:05.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.343+0000 7f8187436700 1 -- 172.21.2.105:0/2738392558 shutdown_connections 2021-11-12T05:44:05.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.343+0000 7f8187436700 1 --2- 172.21.2.105:0/2738392558 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8160053580 0x7f8160055a40 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:05.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.343+0000 7f8187436700 1 --2- 172.21.2.105:0/2738392558 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f818014abe0 0x7f818015a700 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:05.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.343+0000 7f8187436700 1 --2- 172.21.2.105:0/2738392558 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f81800ad080 0x7f818015a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:05.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.343+0000 7f8187436700 1 --2- 172.21.2.105:0/2738392558 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f81800ac280 0x7f81800aadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:05.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.343+0000 7f8187436700 1 -- 172.21.2.105:0/2738392558 >> 172.21.2.105:0/2738392558 conn(0x7f81800b5370 msgr2=0x7f8180143e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:05.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.343+0000 7f8187436700 1 -- 172.21.2.105:0/2738392558 shutdown_connections 2021-11-12T05:44:05.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.343+0000 7f8187436700 1 -- 172.21.2.105:0/2738392558 wait complete. 2021-11-12T05:44:05.349 INFO:teuthology.orchestra.run.gibba005.stderr:new fs with metadata pool 9 and data pool 10 2021-11-12T05:44:05.353 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:44:05.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.399+0000 7f73f4480700 1 Processor -- start 2021-11-12T05:44:05.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.399+0000 7f73f4480700 1 -- start start 2021-11-12T05:44:05.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.399+0000 7f73f4480700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f73ec0ac280 0x7f73ec14b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:05.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.399+0000 7f73f4480700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f73ec0af730 0x7f73ec0ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:05.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.399+0000 7f73f4480700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73ec0ac7b0 con 0x7f73ec0ad080 2021-11-12T05:44:05.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.399+0000 7f73f4480700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73ec1488a0 con 0x7f73ec0af730 2021-11-12T05:44:05.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.399+0000 7f73f4480700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73ec0ac9e0 con 0x7f73ec0ac280 2021-11-12T05:44:05.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.399+0000 7f73f221c700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f73ec0ad080 0x7f73ec14abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:56208/0 (socket says 172.21.2.105:56208) 2021-11-12T05:44:05.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.399+0000 7f73f221c700 1 -- 172.21.2.105:0/1266128143 learned_addr learned my addr 172.21.2.105:0/1266128143 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:44:05.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.399+0000 7f73f2a1d700 1 --2- 172.21.2.105:0/1266128143 >> v2:172.21.2.105:3300/0 conn(0x7f73ec0af730 0x7f73ec0ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:05.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.399+0000 7f73f1a1b700 1 --2- 172.21.2.105:0/1266128143 >> v2:172.21.2.115:3300/0 conn(0x7f73ec0ac280 0x7f73ec14b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:05.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.399+0000 7f73f2a1d700 1 -- 172.21.2.105:0/1266128143 >> v2:172.21.2.115:3300/0 conn(0x7f73ec0ac280 msgr2=0x7f73ec14b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:05.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.399+0000 7f73f2a1d700 1 --2- 172.21.2.105:0/1266128143 >> v2:172.21.2.115:3300/0 conn(0x7f73ec0ac280 0x7f73ec14b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:05.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.399+0000 7f73f2a1d700 1 -- 172.21.2.105:0/1266128143 >> v1:172.21.2.105:6789/0 conn(0x7f73ec0ad080 legacy=0x7f73ec14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:05.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.399+0000 7f73f2a1d700 1 -- 172.21.2.105:0/1266128143 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73ec0b0b30 con 0x7f73ec0af730 2021-11-12T05:44:05.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.399+0000 7f73f1a1b700 1 --2- 172.21.2.105:0/1266128143 >> v2:172.21.2.115:3300/0 conn(0x7f73ec0ac280 0x7f73ec14b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:44:05.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.399+0000 7f73f2a1d700 1 --2- 172.21.2.105:0/1266128143 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f73ec0af730 0x7f73ec0ad460 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f73ec0b1000 tx=0x7f73e40091d0).ready entity=mon.0 client_cookie=84ad8c5d29007d85 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:05.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.399+0000 7f73f121a700 1 -- 172.21.2.105:0/1266128143 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73e4009ea0 con 0x7f73ec0af730 2021-11-12T05:44:05.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.399+0000 7f73f121a700 1 -- 172.21.2.105:0/1266128143 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e400b860 con 0x7f73ec0af730 2021-11-12T05:44:05.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.399+0000 7f73f121a700 1 -- 172.21.2.105:0/1266128143 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73e400b9d0 con 0x7f73ec0af730 2021-11-12T05:44:05.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.403+0000 7f73f4480700 1 -- 172.21.2.105:0/1266128143 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f73ec0af730 msgr2=0x7f73ec0ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:05.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.403+0000 7f73f4480700 1 --2- 172.21.2.105:0/1266128143 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f73ec0af730 0x7f73ec0ad460 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f73ec0b1000 tx=0x7f73e40091d0).stop 2021-11-12T05:44:05.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.403+0000 7f73f4480700 1 -- 172.21.2.105:0/1266128143 shutdown_connections 2021-11-12T05:44:05.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.403+0000 7f73f4480700 1 --2- 172.21.2.105:0/1266128143 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f73ec0af730 0x7f73ec0ad460 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:05.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.403+0000 7f73f4480700 1 --2- 172.21.2.105:0/1266128143 >> v2:172.21.2.115:3300/0 conn(0x7f73ec0ac280 0x7f73ec14b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:05.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.403+0000 7f73f4480700 1 -- 172.21.2.105:0/1266128143 >> 172.21.2.105:0/1266128143 conn(0x7f73ec0b5370 msgr2=0x7f73ec0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:05.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.403+0000 7f73f4480700 1 -- 172.21.2.105:0/1266128143 shutdown_connections 2021-11-12T05:44:05.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.403+0000 7f73f4480700 1 -- 172.21.2.105:0/1266128143 wait complete. 2021-11-12T05:44:05.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.403+0000 7f73f4480700 1 Processor -- start 2021-11-12T05:44:05.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.403+0000 7f73f4480700 1 -- start start 2021-11-12T05:44:05.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.403+0000 7f73f4480700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f73ec0ac280 0x7f73ec0b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:05.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.403+0000 7f73f4480700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f73ec0ad080 0x7f73ec0aa610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:05.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.403+0000 7f73f4480700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f73ec0af730 0x7f73ec1576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:05.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.403+0000 7f73f4480700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec157be0 con 0x7f73ec0ac280 2021-11-12T05:44:05.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.403+0000 7f73f4480700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec0a9860 con 0x7f73ec0af730 2021-11-12T05:44:05.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.403+0000 7f73f4480700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec0a8130 con 0x7f73ec0ad080 2021-11-12T05:44:05.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.403+0000 7f73f221c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f73ec0ac280 0x7f73ec0b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:05.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.403+0000 7f73f221c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f73ec0ac280 0x7f73ec0b34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45818/0 (socket says 172.21.2.105:45818) 2021-11-12T05:44:05.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.403+0000 7f73f221c700 1 -- 172.21.2.105:0/3503117508 learned_addr learned my addr 172.21.2.105:0/3503117508 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:05.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.403+0000 7f73f2a1d700 1 --2- 172.21.2.105:0/3503117508 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f73ec0af730 0x7f73ec1576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:05.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.403+0000 7f73f221c700 1 -- 172.21.2.105:0/3503117508 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f73ec0ad080 msgr2=0x7f73ec0aa610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:05.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.403+0000 7f73f221c700 1 --2- 172.21.2.105:0/3503117508 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f73ec0ad080 0x7f73ec0aa610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:05.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.403+0000 7f73f221c700 1 -- 172.21.2.105:0/3503117508 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f73ec0af730 msgr2=0x7f73ec1576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:05.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.403+0000 7f73f221c700 1 --2- 172.21.2.105:0/3503117508 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f73ec0af730 0x7f73ec1576f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:05.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.403+0000 7f73f221c700 1 -- 172.21.2.105:0/3503117508 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e4009470 con 0x7f73ec0ac280 2021-11-12T05:44:05.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.403+0000 7f73f221c700 1 --2- 172.21.2.105:0/3503117508 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f73ec0ac280 0x7f73ec0b34e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f73ec0b0eb0 tx=0x7f73dc007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:05.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.403+0000 7f73db7fe700 1 -- 172.21.2.105:0/3503117508 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73dc00ce30 con 0x7f73ec0ac280 2021-11-12T05:44:05.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.403+0000 7f73db7fe700 1 -- 172.21.2.105:0/3503117508 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73dc0072e0 con 0x7f73ec0ac280 2021-11-12T05:44:05.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.403+0000 7f73f4480700 1 -- 172.21.2.105:0/3503117508 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73ec0a93c0 con 0x7f73ec0ac280 2021-11-12T05:44:05.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.403+0000 7f73db7fe700 1 -- 172.21.2.105:0/3503117508 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73dc005800 con 0x7f73ec0ac280 2021-11-12T05:44:05.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.403+0000 7f73f4480700 1 -- 172.21.2.105:0/3503117508 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73ec0a87f0 con 0x7f73ec0ac280 2021-11-12T05:44:05.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.403+0000 7f73f4480700 1 -- 172.21.2.105:0/3503117508 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73ec0b1440 con 0x7f73ec0ac280 2021-11-12T05:44:05.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.403+0000 7f73db7fe700 1 -- 172.21.2.105:0/3503117508 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f73dc010070 con 0x7f73ec0ac280 2021-11-12T05:44:05.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.403+0000 7f73db7fe700 1 --2- 172.21.2.105:0/3503117508 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f73cc053640 0x7f73cc055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:05.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.403+0000 7f73db7fe700 1 -- 172.21.2.105:0/3503117508 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f73dc06b0b0 con 0x7f73ec0ac280 2021-11-12T05:44:05.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.403+0000 7f73f1a1b700 1 --2- 172.21.2.105:0/3503117508 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f73cc053640 0x7f73cc055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:05.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.403+0000 7f73f1a1b700 1 --2- 172.21.2.105:0/3503117508 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f73cc053640 0x7f73cc055b00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f73e8007000 tx=0x7f73e8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:05.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.407+0000 7f73db7fe700 1 -- 172.21.2.105:0/3503117508 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f73dc0420c0 con 0x7f73ec0ac280 2021-11-12T05:44:05.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.491+0000 7f73f4480700 1 -- 172.21.2.105:0/3503117508 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73ec057350 con 0x7f73ec0ac280 2021-11-12T05:44:05.499 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.491+0000 7f73db7fe700 1 -- 172.21.2.105:0/3503117508 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+16286 (secure 0 0 0) 0x7f73dc0456e0 con 0x7f73ec0ac280 2021-11-12T05:44:05.500 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:44:05.500 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":54,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:44:05.340389+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:44:03.259173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-11-12T05:44:04.311731+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:44:05.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.495+0000 7f73f4480700 1 -- 172.21.2.105:0/3503117508 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f73cc053640 msgr2=0x7f73cc055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:05.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.495+0000 7f73f4480700 1 --2- 172.21.2.105:0/3503117508 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f73cc053640 0x7f73cc055b00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f73e8007000 tx=0x7f73e8008040).stop 2021-11-12T05:44:05.503 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.495+0000 7f73f4480700 1 -- 172.21.2.105:0/3503117508 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f73ec0ac280 msgr2=0x7f73ec0b34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:05.504 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.495+0000 7f73f4480700 1 --2- 172.21.2.105:0/3503117508 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f73ec0ac280 0x7f73ec0b34e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f73ec0b0eb0 tx=0x7f73dc007c40).stop 2021-11-12T05:44:05.504 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.495+0000 7f73f4480700 1 -- 172.21.2.105:0/3503117508 shutdown_connections 2021-11-12T05:44:05.505 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.495+0000 7f73f4480700 1 --2- 172.21.2.105:0/3503117508 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f73cc053640 0x7f73cc055b00 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:05.505 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.495+0000 7f73f4480700 1 --2- 172.21.2.105:0/3503117508 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f73ec0af730 0x7f73ec1576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:05.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.495+0000 7f73f4480700 1 --2- 172.21.2.105:0/3503117508 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f73ec0ad080 0x7f73ec0aa610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:05.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.495+0000 7f73f4480700 1 --2- 172.21.2.105:0/3503117508 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f73ec0ac280 0x7f73ec0b34e0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:05.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.495+0000 7f73f4480700 1 -- 172.21.2.105:0/3503117508 >> 172.21.2.105:0/3503117508 conn(0x7f73ec0b5370 msgr2=0x7f73ec143d30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:05.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.495+0000 7f73f4480700 1 -- 172.21.2.105:0/3503117508 shutdown_connections 2021-11-12T05:44:05.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.495+0000 7f73f4480700 1 -- 172.21.2.105:0/3503117508 wait complete. 2021-11-12T05:44:05.510 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:44:05.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.555+0000 7ff5d17f6700 1 Processor -- start 2021-11-12T05:44:05.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.555+0000 7ff5d17f6700 1 -- start start 2021-11-12T05:44:05.564 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5d17f6700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff5cc0ad080 0x7ff5cc0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:05.564 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5d17f6700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff5cc0ac280 0x7ff5cc0ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:05.564 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5d17f6700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5cc0ac7b0 con 0x7ff5cc14abe0 2021-11-12T05:44:05.565 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5d17f6700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5cc1488a0 con 0x7ff5cc0ac280 2021-11-12T05:44:05.565 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5d17f6700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc0ac9e0 con 0x7ff5cc0ad080 2021-11-12T05:44:05.565 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5ca7fc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff5cc0ac280 0x7ff5cc0ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:05.565 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5ca7fc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff5cc0ac280 0x7ff5cc0ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45826/0 (socket says 172.21.2.105:45826) 2021-11-12T05:44:05.565 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5ca7fc700 1 -- 172.21.2.105:0/2797448066 learned_addr learned my addr 172.21.2.105:0/2797448066 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:05.566 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5ca7fc700 1 -- 172.21.2.105:0/2797448066 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff5cc0ad080 msgr2=0x7ff5cc0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:05.566 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5ca7fc700 1 --2- 172.21.2.105:0/2797448066 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff5cc0ad080 0x7ff5cc0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:05.566 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5ca7fc700 1 -- 172.21.2.105:0/2797448066 >> v1:172.21.2.115:6789/0 conn(0x7ff5cc14abe0 legacy=0x7ff5cc14b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:05.566 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5ca7fc700 1 -- 172.21.2.105:0/2797448066 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5cc0b0b30 con 0x7ff5cc0ac280 2021-11-12T05:44:05.567 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5ca7fc700 1 --2- 172.21.2.105:0/2797448066 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff5cc0ac280 0x7ff5cc0ad460 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7ff5cc0b6060 tx=0x7ff5b4006eb0).ready entity=mon.0 client_cookie=921f61b0cc123198 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:05.567 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5c9ffb700 1 -- 172.21.2.105:0/2797448066 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5b400d570 con 0x7ff5cc0ac280 2021-11-12T05:44:05.567 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5c9ffb700 1 -- 172.21.2.105:0/2797448066 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b4000e90 con 0x7ff5cc0ac280 2021-11-12T05:44:05.567 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5c9ffb700 1 -- 172.21.2.105:0/2797448066 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5b400d8c0 con 0x7ff5cc0ac280 2021-11-12T05:44:05.567 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5d17f6700 1 -- 172.21.2.105:0/2797448066 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff5cc0ac280 msgr2=0x7ff5cc0ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:05.568 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5d17f6700 1 --2- 172.21.2.105:0/2797448066 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff5cc0ac280 0x7ff5cc0ad460 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7ff5cc0b6060 tx=0x7ff5b4006eb0).stop 2021-11-12T05:44:05.568 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5d17f6700 1 -- 172.21.2.105:0/2797448066 shutdown_connections 2021-11-12T05:44:05.568 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5d17f6700 1 --2- 172.21.2.105:0/2797448066 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff5cc0ac280 0x7ff5cc0ad460 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:05.569 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5d17f6700 1 --2- 172.21.2.105:0/2797448066 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff5cc0ad080 0x7ff5cc0af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:05.569 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5d17f6700 1 -- 172.21.2.105:0/2797448066 >> 172.21.2.105:0/2797448066 conn(0x7ff5cc0b5370 msgr2=0x7ff5cc0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:05.569 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5d17f6700 1 -- 172.21.2.105:0/2797448066 shutdown_connections 2021-11-12T05:44:05.569 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5d17f6700 1 -- 172.21.2.105:0/2797448066 wait complete. 2021-11-12T05:44:05.569 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5d17f6700 1 Processor -- start 2021-11-12T05:44:05.570 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5d17f6700 1 -- start start 2021-11-12T05:44:05.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5d17f6700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff5cc0ac280 0x7ff5cc0a9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:05.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5d17f6700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff5cc0ad080 0x7ff5cc0637c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:05.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5d17f6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff5cc14abe0 0x7ff5cc0669c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:05.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5d17f6700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc0628c0 con 0x7ff5cc14abe0 2021-11-12T05:44:05.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5d17f6700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc064280 con 0x7ff5cc0ac280 2021-11-12T05:44:05.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5d17f6700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc0aa010 con 0x7ff5cc0ad080 2021-11-12T05:44:05.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5cb7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff5cc14abe0 0x7ff5cc0669c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:05.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5cb7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff5cc14abe0 0x7ff5cc0669c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45834/0 (socket says 172.21.2.105:45834) 2021-11-12T05:44:05.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5cb7fe700 1 -- 172.21.2.105:0/3651088661 learned_addr learned my addr 172.21.2.105:0/3651088661 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:05.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5cb7fe700 1 -- 172.21.2.105:0/3651088661 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff5cc0ad080 msgr2=0x7ff5cc0637c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:05.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5cb7fe700 1 --2- 172.21.2.105:0/3651088661 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff5cc0ad080 0x7ff5cc0637c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:05.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5cb7fe700 1 -- 172.21.2.105:0/3651088661 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff5cc0ac280 msgr2=0x7ff5cc0a9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:05.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5cb7fe700 1 --2- 172.21.2.105:0/3651088661 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff5cc0ac280 0x7ff5cc0a9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:05.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5cb7fe700 1 -- 172.21.2.105:0/3651088661 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b400b1e0 con 0x7ff5cc14abe0 2021-11-12T05:44:05.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5cb7fe700 1 --2- 172.21.2.105:0/3651088661 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff5cc14abe0 0x7ff5cc0669c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7ff5c4003290 tx=0x7ff5c40090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:05.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5c3fff700 1 -- 172.21.2.105:0/3651088661 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5c400f510 con 0x7ff5cc14abe0 2021-11-12T05:44:05.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5c3fff700 1 -- 172.21.2.105:0/3651088661 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c400f670 con 0x7ff5cc14abe0 2021-11-12T05:44:05.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5c3fff700 1 -- 172.21.2.105:0/3651088661 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5c400f7e0 con 0x7ff5cc14abe0 2021-11-12T05:44:05.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5d17f6700 1 -- 172.21.2.105:0/3651088661 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5cc0aac50 con 0x7ff5cc14abe0 2021-11-12T05:44:05.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.559+0000 7ff5d17f6700 1 -- 172.21.2.105:0/3651088661 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5cc15b120 con 0x7ff5cc14abe0 2021-11-12T05:44:05.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.563+0000 7ff5d17f6700 1 -- 172.21.2.105:0/3651088661 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5cc0aaaa0 con 0x7ff5cc14abe0 2021-11-12T05:44:05.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.563+0000 7ff5c3fff700 1 -- 172.21.2.105:0/3651088661 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff5c400f070 con 0x7ff5cc14abe0 2021-11-12T05:44:05.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.563+0000 7ff5c3fff700 1 --2- 172.21.2.105:0/3651088661 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff5b00536f0 0x7ff5b0055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:05.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.563+0000 7ff5c3fff700 1 -- 172.21.2.105:0/3651088661 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6416+0+0 (secure 0 0 0) 0x7ff5c406b640 con 0x7ff5cc14abe0 2021-11-12T05:44:05.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.563+0000 7ff5caffd700 1 --2- 172.21.2.105:0/3651088661 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff5b00536f0 0x7ff5b0055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:05.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.563+0000 7ff5caffd700 1 --2- 172.21.2.105:0/3651088661 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff5b00536f0 0x7ff5b0055bb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7ff5bc002f70 tx=0x7ff5bc006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:05.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.563+0000 7ff5c3fff700 1 -- 172.21.2.105:0/3651088661 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff5c4042540 con 0x7ff5cc14abe0 2021-11-12T05:44:05.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.647+0000 7ff5d17f6700 1 -- 172.21.2.105:0/3651088661 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5cc0b1440 con 0x7ff5cc14abe0 2021-11-12T05:44:05.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.647+0000 7ff5c3fff700 1 -- 172.21.2.105:0/3651088661 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+16286 (secure 0 0 0) 0x7ff5c4045b60 con 0x7ff5cc14abe0 2021-11-12T05:44:05.654 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:44:05.654 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":54,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:44:05.340389+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:44:03.259173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-11-12T05:44:04.311731+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:44:05.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.651+0000 7ff5d17f6700 1 -- 172.21.2.105:0/3651088661 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff5b00536f0 msgr2=0x7ff5b0055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:05.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.651+0000 7ff5d17f6700 1 --2- 172.21.2.105:0/3651088661 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff5b00536f0 0x7ff5b0055bb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7ff5bc002f70 tx=0x7ff5bc006a80).stop 2021-11-12T05:44:05.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.651+0000 7ff5d17f6700 1 -- 172.21.2.105:0/3651088661 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff5cc14abe0 msgr2=0x7ff5cc0669c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:05.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.651+0000 7ff5d17f6700 1 --2- 172.21.2.105:0/3651088661 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff5cc14abe0 0x7ff5cc0669c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7ff5c4003290 tx=0x7ff5c40090f0).stop 2021-11-12T05:44:05.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.651+0000 7ff5d17f6700 1 -- 172.21.2.105:0/3651088661 shutdown_connections 2021-11-12T05:44:05.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.651+0000 7ff5d17f6700 1 --2- 172.21.2.105:0/3651088661 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff5b00536f0 0x7ff5b0055bb0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:05.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.651+0000 7ff5d17f6700 1 --2- 172.21.2.105:0/3651088661 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff5cc14abe0 0x7ff5cc0669c0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:05.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.651+0000 7ff5d17f6700 1 --2- 172.21.2.105:0/3651088661 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff5cc0ad080 0x7ff5cc0637c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:05.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.651+0000 7ff5d17f6700 1 --2- 172.21.2.105:0/3651088661 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff5cc0ac280 0x7ff5cc0a9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:05.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.651+0000 7ff5d17f6700 1 -- 172.21.2.105:0/3651088661 >> 172.21.2.105:0/3651088661 conn(0x7ff5cc0b5370 msgr2=0x7ff5cc0ae880 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:05.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.651+0000 7ff5d17f6700 1 -- 172.21.2.105:0/3651088661 shutdown_connections 2021-11-12T05:44:05.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.651+0000 7ff5d17f6700 1 -- 172.21.2.105:0/3651088661 wait complete. 2021-11-12T05:44:05.662 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-12T05:44:05.714 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.711+0000 7f6611ce9700 1 Processor -- start 2021-11-12T05:44:05.715 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.711+0000 7f6611ce9700 1 -- start start 2021-11-12T05:44:05.716 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.711+0000 7f6611ce9700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f660c0aca40 0x7f660c0ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:05.717 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.711+0000 7f6611ce9700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f660c144180 0x7f660c1445f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:05.717 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.711+0000 7f6611ce9700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f660c0b1840 con 0x7f660c0b0520 2021-11-12T05:44:05.717 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.711+0000 7f6611ce9700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f660c0b09d0 con 0x7f660c144180 2021-11-12T05:44:05.717 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.711+0000 7f6611ce9700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f660c0af2b0 con 0x7f660c0aca40 2021-11-12T05:44:05.717 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.711+0000 7f660affd700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f660c0b0520 0x7f660c1473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:56234/0 (socket says 172.21.2.105:56234) 2021-11-12T05:44:05.718 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.711+0000 7f660affd700 1 -- 172.21.2.105:0/3200527124 learned_addr learned my addr 172.21.2.105:0/3200527124 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:44:05.718 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.711+0000 7f660bfff700 1 --2- 172.21.2.105:0/3200527124 >> v2:172.21.2.105:3300/0 conn(0x7f660c144180 0x7f660c1445f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:05.718 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.711+0000 7f660a7fc700 1 -- 172.21.2.105:0/3200527124 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2834388129 0 0) 0x7f660c0b1840 con 0x7f660c0b0520 2021-11-12T05:44:05.718 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.711+0000 7f660a7fc700 1 -- 172.21.2.105:0/3200527124 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65f8003260 con 0x7f660c0b0520 2021-11-12T05:44:05.719 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.711+0000 7f660bfff700 1 -- 172.21.2.105:0/3200527124 >> v2:172.21.2.115:3300/0 conn(0x7f660c0aca40 msgr2=0x7f660c0ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:05.719 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.711+0000 7f660bfff700 1 --2- 172.21.2.105:0/3200527124 >> v2:172.21.2.115:3300/0 conn(0x7f660c0aca40 0x7f660c0ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:05.719 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.711+0000 7f660bfff700 1 -- 172.21.2.105:0/3200527124 >> v1:172.21.2.105:6789/0 conn(0x7f660c0b0520 legacy=0x7f660c1473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:05.719 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.711+0000 7f660bfff700 1 -- 172.21.2.105:0/3200527124 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f660c0b1a70 con 0x7f660c144180 2021-11-12T05:44:05.720 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.711+0000 7f660bfff700 1 --2- 172.21.2.105:0/3200527124 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f660c144180 0x7f660c1445f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f66040032f0 tx=0x7f66040091d0).ready entity=mon.0 client_cookie=9a25e24771c068d4 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:05.720 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.711+0000 7f660a7fc700 1 -- 172.21.2.105:0/3200527124 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f660400b680 con 0x7f660c144180 2021-11-12T05:44:05.720 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.711+0000 7f660a7fc700 1 -- 172.21.2.105:0/3200527124 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660400b7e0 con 0x7f660c144180 2021-11-12T05:44:05.720 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.711+0000 7f660a7fc700 1 -- 172.21.2.105:0/3200527124 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f660400b950 con 0x7f660c144180 2021-11-12T05:44:05.720 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.711+0000 7f6611ce9700 1 -- 172.21.2.105:0/3200527124 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f660c144180 msgr2=0x7f660c1445f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:05.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.711+0000 7f6611ce9700 1 --2- 172.21.2.105:0/3200527124 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f660c144180 0x7f660c1445f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f66040032f0 tx=0x7f66040091d0).stop 2021-11-12T05:44:05.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.711+0000 7f6611ce9700 1 -- 172.21.2.105:0/3200527124 shutdown_connections 2021-11-12T05:44:05.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.711+0000 7f6611ce9700 1 --2- 172.21.2.105:0/3200527124 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f660c144180 0x7f660c1445f0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:05.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.711+0000 7f6611ce9700 1 --2- 172.21.2.105:0/3200527124 >> v2:172.21.2.115:3300/0 conn(0x7f660c0aca40 0x7f660c0ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:05.722 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.711+0000 7f6611ce9700 1 -- 172.21.2.105:0/3200527124 >> 172.21.2.105:0/3200527124 conn(0x7f660c05c490 msgr2=0x7f660c0b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:05.724 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.711+0000 7f6611ce9700 1 -- 172.21.2.105:0/3200527124 shutdown_connections 2021-11-12T05:44:05.724 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.711+0000 7f6611ce9700 1 -- 172.21.2.105:0/3200527124 wait complete. 2021-11-12T05:44:05.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.711+0000 7f6611ce9700 1 Processor -- start 2021-11-12T05:44:05.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.711+0000 7f6611ce9700 1 -- start start 2021-11-12T05:44:05.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.715+0000 7f6611ce9700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f660c0aca40 0x7f660c14cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:05.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.715+0000 7f6611ce9700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f660c0b0520 0x7f660c159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:05.726 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.715+0000 7f6611ce9700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f660c144180 0x7f660c15a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:05.726 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.715+0000 7f6611ce9700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660c147e00 con 0x7f660c0aca40 2021-11-12T05:44:05.726 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.715+0000 7f6611ce9700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660c1480a0 con 0x7f660c0b0520 2021-11-12T05:44:05.726 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.715+0000 7f6611ce9700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f660c159b40 con 0x7f660c144180 2021-11-12T05:44:05.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.715+0000 7f660b7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f660c0aca40 0x7f660c14cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:05.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.715+0000 7f660b7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f660c0aca40 0x7f660c14cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45842/0 (socket says 172.21.2.105:45842) 2021-11-12T05:44:05.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.715+0000 7f660b7fe700 1 -- 172.21.2.105:0/2508067285 learned_addr learned my addr 172.21.2.105:0/2508067285 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:05.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.715+0000 7f660b7fe700 1 -- 172.21.2.105:0/2508067285 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f660c144180 msgr2=0x7f660c15a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:05.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.715+0000 7f660b7fe700 1 --2- 172.21.2.105:0/2508067285 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f660c144180 0x7f660c15a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:05.728 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.715+0000 7f660b7fe700 1 -- 172.21.2.105:0/2508067285 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f660c0b0520 msgr2=0x7f660c159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:05.728 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.715+0000 7f660b7fe700 1 --2- 172.21.2.105:0/2508067285 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f660c0b0520 0x7f660c159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:05.728 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.715+0000 7f660b7fe700 1 -- 172.21.2.105:0/2508067285 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6604009470 con 0x7f660c0aca40 2021-11-12T05:44:05.728 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.715+0000 7f660b7fe700 1 --2- 172.21.2.105:0/2508067285 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f660c0aca40 0x7f660c14cd20 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f6600002f70 tx=0x7f6600006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:05.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.715+0000 7f6608ff9700 1 -- 172.21.2.105:0/2508067285 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6600013460 con 0x7f660c0aca40 2021-11-12T05:44:05.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.715+0000 7f6608ff9700 1 -- 172.21.2.105:0/2508067285 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66000135c0 con 0x7f660c0aca40 2021-11-12T05:44:05.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.715+0000 7f6608ff9700 1 -- 172.21.2.105:0/2508067285 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6600013920 con 0x7f660c0aca40 2021-11-12T05:44:05.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.715+0000 7f6611ce9700 1 -- 172.21.2.105:0/2508067285 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f660c15a9c0 con 0x7f660c0aca40 2021-11-12T05:44:05.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.715+0000 7f6611ce9700 1 -- 172.21.2.105:0/2508067285 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f660c0b4f30 con 0x7f660c0aca40 2021-11-12T05:44:05.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.715+0000 7f6611ce9700 1 -- 172.21.2.105:0/2508067285 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f660c0b4b70 con 0x7f660c0aca40 2021-11-12T05:44:05.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.715+0000 7f6608ff9700 1 -- 172.21.2.105:0/2508067285 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f660001a060 con 0x7f660c0aca40 2021-11-12T05:44:05.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.715+0000 7f6608ff9700 1 --2- 172.21.2.105:0/2508067285 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f65ec0536f0 0x7f65ec055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:05.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.715+0000 7f6608ff9700 1 -- 172.21.2.105:0/2508067285 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f660006b6a0 con 0x7f660c0aca40 2021-11-12T05:44:05.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.715+0000 7f660affd700 1 --2- 172.21.2.105:0/2508067285 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f65ec0536f0 0x7f65ec055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:05.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.715+0000 7f660affd700 1 --2- 172.21.2.105:0/2508067285 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f65ec0536f0 0x7f65ec055bb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f65fc001110 tx=0x7f65fc0076c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:05.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.719+0000 7f6608ff9700 1 -- 172.21.2.105:0/2508067285 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f660c0b4b70 con 0x7f660c0aca40 2021-11-12T05:44:05.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:05.827+0000 7f6611ce9700 1 -- 172.21.2.105:0/2508067285 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f660c0b4b70 con 0x7f660c0aca40 2021-11-12T05:44:06.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.347+0000 7f6608ff9700 1 -- 172.21.2.105:0/2508067285 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v20) v1 ==== 118+0+0 (secure 0 0 0) 0x7f660c0b4b70 con 0x7f660c0aca40 2021-11-12T05:44:06.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.351+0000 7f6611ce9700 1 -- 172.21.2.105:0/2508067285 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f65ec0536f0 msgr2=0x7f65ec055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:06.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.351+0000 7f6611ce9700 1 --2- 172.21.2.105:0/2508067285 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f65ec0536f0 0x7f65ec055bb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f65fc001110 tx=0x7f65fc0076c0).stop 2021-11-12T05:44:06.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.351+0000 7f6611ce9700 1 -- 172.21.2.105:0/2508067285 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f660c0aca40 msgr2=0x7f660c14cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:06.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.351+0000 7f6611ce9700 1 --2- 172.21.2.105:0/2508067285 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f660c0aca40 0x7f660c14cd20 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f6600002f70 tx=0x7f6600006ec0).stop 2021-11-12T05:44:06.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.351+0000 7f6611ce9700 1 -- 172.21.2.105:0/2508067285 shutdown_connections 2021-11-12T05:44:06.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.351+0000 7f6611ce9700 1 --2- 172.21.2.105:0/2508067285 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f65ec0536f0 0x7f65ec055bb0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:06.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.351+0000 7f6611ce9700 1 --2- 172.21.2.105:0/2508067285 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f660c144180 0x7f660c15a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:06.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.351+0000 7f6611ce9700 1 --2- 172.21.2.105:0/2508067285 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f660c0b0520 0x7f660c159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:06.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.351+0000 7f6611ce9700 1 --2- 172.21.2.105:0/2508067285 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f660c0aca40 0x7f660c14cd20 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:06.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.351+0000 7f6611ce9700 1 -- 172.21.2.105:0/2508067285 >> 172.21.2.105:0/2508067285 conn(0x7f660c05c490 msgr2=0x7f660c143080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:06.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.351+0000 7f6611ce9700 1 -- 172.21.2.105:0/2508067285 shutdown_connections 2021-11-12T05:44:06.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.351+0000 7f6611ce9700 1 -- 172.21.2.105:0/2508067285 wait complete. 2021-11-12T05:44:06.362 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:44:06.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.411+0000 7f3dec0bc700 1 Processor -- start 2021-11-12T05:44:06.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.411+0000 7f3dec0bc700 1 -- start start 2021-11-12T05:44:06.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.411+0000 7f3dec0bc700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f3de40ad080 0x7f3de40af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:06.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.411+0000 7f3dec0bc700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3de40ac280 0x7f3de40ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:06.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.411+0000 7f3dec0bc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f3de414abe0 0x7f3de414b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:06.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.411+0000 7f3dec0bc700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3de41488a0 con 0x7f3de414abe0 2021-11-12T05:44:06.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.411+0000 7f3dec0bc700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3de40ac7b0 con 0x7f3de40ad080 2021-11-12T05:44:06.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.411+0000 7f3dec0bc700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de40ac9e0 con 0x7f3de40ac280 2021-11-12T05:44:06.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.411+0000 7f3dea659700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f3de414abe0 0x7f3de414b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:06.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.411+0000 7f3dea659700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f3de414abe0 0x7f3de414b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45854/0 (socket says 172.21.2.105:45854) 2021-11-12T05:44:06.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.411+0000 7f3dea659700 1 -- 172.21.2.105:0/1593121522 learned_addr learned my addr 172.21.2.105:0/1593121522 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:06.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.411+0000 7f3dea659700 1 -- 172.21.2.105:0/1593121522 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3de40ac280 msgr2=0x7f3de40ad460 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:44:06.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.411+0000 7f3dea659700 1 --2- 172.21.2.105:0/1593121522 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3de40ac280 0x7f3de40ad460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:06.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.411+0000 7f3dea659700 1 -- 172.21.2.105:0/1593121522 >> v2:172.21.2.115:3300/0 conn(0x7f3de40ad080 msgr2=0x7f3de40af730 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:44:06.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.411+0000 7f3dea659700 1 --2- 172.21.2.105:0/1593121522 >> v2:172.21.2.115:3300/0 conn(0x7f3de40ad080 0x7f3de40af730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:06.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.411+0000 7f3dea659700 1 -- 172.21.2.105:0/1593121522 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de40b0b30 con 0x7f3de414abe0 2021-11-12T05:44:06.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.411+0000 7f3dea659700 1 --2- 172.21.2.105:0/1593121522 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3de414abe0 0x7f3de414b090 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f3de40ac6a0 tx=0x7f3ddc009290).ready entity=mon.0 client_cookie=368ebc584fa47658 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:06.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.411+0000 7f3de8e56700 1 -- 172.21.2.105:0/1593121522 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ddc00b830 con 0x7f3de414abe0 2021-11-12T05:44:06.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.411+0000 7f3de8e56700 1 -- 172.21.2.105:0/1593121522 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ddc00b990 con 0x7f3de414abe0 2021-11-12T05:44:06.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.411+0000 7f3de8e56700 1 -- 172.21.2.105:0/1593121522 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ddc00bb40 con 0x7f3de414abe0 2021-11-12T05:44:06.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.411+0000 7f3dec0bc700 1 -- 172.21.2.105:0/1593121522 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3de414abe0 msgr2=0x7f3de414b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:06.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.411+0000 7f3dec0bc700 1 --2- 172.21.2.105:0/1593121522 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3de414abe0 0x7f3de414b090 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f3de40ac6a0 tx=0x7f3ddc009290).stop 2021-11-12T05:44:06.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.415+0000 7f3dec0bc700 1 -- 172.21.2.105:0/1593121522 shutdown_connections 2021-11-12T05:44:06.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.415+0000 7f3dec0bc700 1 --2- 172.21.2.105:0/1593121522 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3de414abe0 0x7f3de414b090 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:06.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.415+0000 7f3dec0bc700 1 --2- 172.21.2.105:0/1593121522 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3de40ac280 0x7f3de40ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:06.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.415+0000 7f3dec0bc700 1 --2- 172.21.2.105:0/1593121522 >> v2:172.21.2.115:3300/0 conn(0x7f3de40ad080 0x7f3de40af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:06.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.415+0000 7f3dec0bc700 1 -- 172.21.2.105:0/1593121522 >> 172.21.2.105:0/1593121522 conn(0x7f3de40b5370 msgr2=0x7f3de40b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:06.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.415+0000 7f3dec0bc700 1 -- 172.21.2.105:0/1593121522 shutdown_connections 2021-11-12T05:44:06.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.415+0000 7f3dec0bc700 1 -- 172.21.2.105:0/1593121522 wait complete. 2021-11-12T05:44:06.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.415+0000 7f3dec0bc700 1 Processor -- start 2021-11-12T05:44:06.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.415+0000 7f3dec0bc700 1 -- start start 2021-11-12T05:44:06.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.415+0000 7f3dec0bc700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3de40ac280 0x7f3de40a7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:06.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.415+0000 7f3dec0bc700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3de40ad080 0x7f3de4156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:06.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.415+0000 7f3dec0bc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3de414abe0 0x7f3de4063740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:06.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.415+0000 7f3dec0bc700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de40a96c0 con 0x7f3de414abe0 2021-11-12T05:44:06.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.415+0000 7f3dec0bc700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de40a9960 con 0x7f3de40ac280 2021-11-12T05:44:06.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.415+0000 7f3dec0bc700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de40632a0 con 0x7f3de40ad080 2021-11-12T05:44:06.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.415+0000 7f3dea659700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3de414abe0 0x7f3de4063740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:06.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.415+0000 7f3dea659700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3de414abe0 0x7f3de4063740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45856/0 (socket says 172.21.2.105:45856) 2021-11-12T05:44:06.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.415+0000 7f3dea659700 1 -- 172.21.2.105:0/3039636568 learned_addr learned my addr 172.21.2.105:0/3039636568 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:06.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.415+0000 7f3dea659700 1 -- 172.21.2.105:0/3039636568 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3de40ad080 msgr2=0x7f3de4156b90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:44:06.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.415+0000 7f3dea659700 1 --2- 172.21.2.105:0/3039636568 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3de40ad080 0x7f3de4156b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:06.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.415+0000 7f3dea659700 1 -- 172.21.2.105:0/3039636568 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3de40ac280 msgr2=0x7f3de40a7360 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:44:06.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.415+0000 7f3dea659700 1 --2- 172.21.2.105:0/3039636568 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3de40ac280 0x7f3de40a7360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:06.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.415+0000 7f3dea659700 1 -- 172.21.2.105:0/3039636568 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ddc009530 con 0x7f3de414abe0 2021-11-12T05:44:06.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.415+0000 7f3dea659700 1 --2- 172.21.2.105:0/3039636568 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3de414abe0 0x7f3de4063740 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f3de40ac6a0 tx=0x7f3ddc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:06.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.415+0000 7f3dd6ffd700 1 -- 172.21.2.105:0/3039636568 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ddc021670 con 0x7f3de414abe0 2021-11-12T05:44:06.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.415+0000 7f3dd6ffd700 1 -- 172.21.2.105:0/3039636568 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ddc0217d0 con 0x7f3de414abe0 2021-11-12T05:44:06.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.415+0000 7f3dd6ffd700 1 -- 172.21.2.105:0/3039636568 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ddc021b30 con 0x7f3de414abe0 2021-11-12T05:44:06.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.415+0000 7f3dec0bc700 1 -- 172.21.2.105:0/3039636568 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de40b5080 con 0x7f3de414abe0 2021-11-12T05:44:06.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.415+0000 7f3dec0bc700 1 -- 172.21.2.105:0/3039636568 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de40a9220 con 0x7f3de414abe0 2021-11-12T05:44:06.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.415+0000 7f3dec0bc700 1 -- 172.21.2.105:0/3039636568 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3de4063460 con 0x7f3de414abe0 2021-11-12T05:44:06.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.415+0000 7f3dd6ffd700 1 -- 172.21.2.105:0/3039636568 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3ddc00f070 con 0x7f3de414abe0 2021-11-12T05:44:06.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.415+0000 7f3dd6ffd700 1 --2- 172.21.2.105:0/3039636568 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3dc4053640 0x7f3dc4055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:06.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.415+0000 7f3dd6ffd700 1 -- 172.21.2.105:0/3039636568 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f3ddc06cf10 con 0x7f3de414abe0 2021-11-12T05:44:06.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.415+0000 7f3de9e58700 1 --2- 172.21.2.105:0/3039636568 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3dc4053640 0x7f3dc4055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:06.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.415+0000 7f3de9e58700 1 --2- 172.21.2.105:0/3039636568 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3dc4053640 0x7f3dc4055b00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f3dd8002fb0 tx=0x7f3dd8006930).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:06.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.419+0000 7f3dd6ffd700 1 -- 172.21.2.105:0/3039636568 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3ddc043e80 con 0x7f3de414abe0 2021-11-12T05:44:06.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.527+0000 7f3dec0bc700 1 -- 172.21.2.105:0/3039636568 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3de4057350 con 0x7f3de414abe0 2021-11-12T05:44:06.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.531+0000 7f3dd6ffd700 1 -- 172.21.2.105:0/3039636568 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f3ddc015070 con 0x7f3de414abe0 2021-11-12T05:44:06.535 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:44:06.535 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":20,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4478,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/1513907466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":1513907466},{"type":"v1","addr":"172.21.2.115:6833","nonce":1513907466}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":18}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:44:05.340503+0000","modified":"2021-11-12T05:44:06.343650+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5610":{"gid":5610,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/351884283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":351884283},{"type":"v1","addr":"172.21.2.105:6835","nonce":351884283}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-11-12T05:44:06.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.531+0000 7f3dec0bc700 1 -- 172.21.2.105:0/3039636568 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3dc4053640 msgr2=0x7f3dc4055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:06.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.531+0000 7f3dec0bc700 1 --2- 172.21.2.105:0/3039636568 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3dc4053640 0x7f3dc4055b00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f3dd8002fb0 tx=0x7f3dd8006930).stop 2021-11-12T05:44:06.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.531+0000 7f3dec0bc700 1 -- 172.21.2.105:0/3039636568 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3de414abe0 msgr2=0x7f3de4063740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:06.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.531+0000 7f3dec0bc700 1 --2- 172.21.2.105:0/3039636568 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3de414abe0 0x7f3de4063740 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f3de40ac6a0 tx=0x7f3ddc016000).stop 2021-11-12T05:44:06.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.531+0000 7f3dec0bc700 1 -- 172.21.2.105:0/3039636568 shutdown_connections 2021-11-12T05:44:06.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.531+0000 7f3dec0bc700 1 --2- 172.21.2.105:0/3039636568 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3dc4053640 0x7f3dc4055b00 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:06.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.531+0000 7f3dec0bc700 1 --2- 172.21.2.105:0/3039636568 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3de414abe0 0x7f3de4063740 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:06.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.531+0000 7f3dec0bc700 1 --2- 172.21.2.105:0/3039636568 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3de40ad080 0x7f3de4156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:06.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.531+0000 7f3dec0bc700 1 --2- 172.21.2.105:0/3039636568 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3de40ac280 0x7f3de40a7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:06.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.531+0000 7f3dec0bc700 1 -- 172.21.2.105:0/3039636568 >> 172.21.2.105:0/3039636568 conn(0x7f3de40b5370 msgr2=0x7f3de405fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:06.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.531+0000 7f3dec0bc700 1 -- 172.21.2.105:0/3039636568 shutdown_connections 2021-11-12T05:44:06.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.531+0000 7f3dec0bc700 1 -- 172.21.2.105:0/3039636568 wait complete. 2021-11-12T05:44:06.539 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 20 2021-11-12T05:44:06.542 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:44:06.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.587+0000 7f35cde52700 1 Processor -- start 2021-11-12T05:44:06.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.587+0000 7f35cde52700 1 -- start start 2021-11-12T05:44:06.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.587+0000 7f35cde52700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f35c80adaf0 0x7f35c813fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:06.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.587+0000 7f35cde52700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f35c8143b40 0x7f35c8143f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:06.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.587+0000 7f35cde52700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c8067860 con 0x7f35c80aded0 2021-11-12T05:44:06.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.587+0000 7f35cde52700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c8143400 con 0x7f35c80adaf0 2021-11-12T05:44:06.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.587+0000 7f35cde52700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c81436a0 con 0x7f35c8143b40 2021-11-12T05:44:06.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.587+0000 7f35c77fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f35c80adaf0 0x7f35c813fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:06.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.587+0000 7f35c77fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f35c80adaf0 0x7f35c813fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45864/0 (socket says 172.21.2.105:45864) 2021-11-12T05:44:06.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.587+0000 7f35c77fe700 1 -- 172.21.2.105:0/3175195733 learned_addr learned my addr 172.21.2.105:0/3175195733 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:06.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.587+0000 7f35c77fe700 1 -- 172.21.2.105:0/3175195733 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f35c8143b40 msgr2=0x7f35c8143f80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:44:06.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.587+0000 7f35c77fe700 1 --2- 172.21.2.105:0/3175195733 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f35c8143b40 0x7f35c8143f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:06.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.587+0000 7f35c77fe700 1 -- 172.21.2.105:0/3175195733 >> v1:172.21.2.115:6789/0 conn(0x7f35c80aded0 legacy=0x7f35c80afe10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:44:06.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35c77fe700 1 -- 172.21.2.105:0/3175195733 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c80b2b40 con 0x7f35c80adaf0 2021-11-12T05:44:06.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35c77fe700 1 --2- 172.21.2.105:0/3175195733 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f35c80adaf0 0x7f35c813fd90 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f35c80b63f0 tx=0x7f35b0006f40).ready entity=mon.0 client_cookie=26cb5713c456d13a server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:06.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35c67fc700 1 -- 172.21.2.105:0/3175195733 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35b000dc30 con 0x7f35c80adaf0 2021-11-12T05:44:06.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35c67fc700 1 -- 172.21.2.105:0/3175195733 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b0000e90 con 0x7f35c80adaf0 2021-11-12T05:44:06.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35c67fc700 1 -- 172.21.2.105:0/3175195733 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35b000be90 con 0x7f35c80adaf0 2021-11-12T05:44:06.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35cde52700 1 -- 172.21.2.105:0/3175195733 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f35c80adaf0 msgr2=0x7f35c813fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:06.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35cde52700 1 --2- 172.21.2.105:0/3175195733 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f35c80adaf0 0x7f35c813fd90 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f35c80b63f0 tx=0x7f35b0006f40).stop 2021-11-12T05:44:06.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35cde52700 1 -- 172.21.2.105:0/3175195733 shutdown_connections 2021-11-12T05:44:06.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35cde52700 1 --2- 172.21.2.105:0/3175195733 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f35c8143b40 0x7f35c8143f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:06.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35cde52700 1 --2- 172.21.2.105:0/3175195733 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f35c80adaf0 0x7f35c813fd90 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:06.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35cde52700 1 -- 172.21.2.105:0/3175195733 >> 172.21.2.105:0/3175195733 conn(0x7f35c805c490 msgr2=0x7f35c805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:06.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35cde52700 1 -- 172.21.2.105:0/3175195733 shutdown_connections 2021-11-12T05:44:06.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35cde52700 1 -- 172.21.2.105:0/3175195733 wait complete. 2021-11-12T05:44:06.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35cde52700 1 Processor -- start 2021-11-12T05:44:06.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35cde52700 1 -- start start 2021-11-12T05:44:06.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35cde52700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f35c80adaf0 0x7f35c80b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:06.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35cde52700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f35c80aded0 0x7f35c80a8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:06.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35cde52700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f35c8143b40 0x7f35c80a8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:06.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35cde52700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c80ac750 con 0x7f35c8143b40 2021-11-12T05:44:06.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35cde52700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c815ae90 con 0x7f35c80adaf0 2021-11-12T05:44:06.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35cde52700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c815b130 con 0x7f35c80aded0 2021-11-12T05:44:06.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35c7fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f35c8143b40 0x7f35c80a8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:06.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35c7fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f35c8143b40 0x7f35c80a8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45874/0 (socket says 172.21.2.105:45874) 2021-11-12T05:44:06.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35c7fff700 1 -- 172.21.2.105:0/3385556166 learned_addr learned my addr 172.21.2.105:0/3385556166 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:06.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35c7fff700 1 -- 172.21.2.105:0/3385556166 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f35c80aded0 msgr2=0x7f35c80a8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:06.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35c7fff700 1 --2- 172.21.2.105:0/3385556166 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f35c80aded0 0x7f35c80a8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:06.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35c7fff700 1 -- 172.21.2.105:0/3385556166 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f35c80adaf0 msgr2=0x7f35c80b0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:06.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35c7fff700 1 --2- 172.21.2.105:0/3385556166 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f35c80adaf0 0x7f35c80b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:06.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35c7fff700 1 -- 172.21.2.105:0/3385556166 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b000b460 con 0x7f35c8143b40 2021-11-12T05:44:06.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35c7fff700 1 --2- 172.21.2.105:0/3385556166 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f35c8143b40 0x7f35c80a8b30 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f35c0003310 tx=0x7f35c00091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:06.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35c4ff9700 1 -- 172.21.2.105:0/3385556166 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35c0001500 con 0x7f35c8143b40 2021-11-12T05:44:06.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35c4ff9700 1 -- 172.21.2.105:0/3385556166 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c0001660 con 0x7f35c8143b40 2021-11-12T05:44:06.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35cde52700 1 -- 172.21.2.105:0/3385556166 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c8156de0 con 0x7f35c8143b40 2021-11-12T05:44:06.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35c4ff9700 1 -- 172.21.2.105:0/3385556166 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35c00019c0 con 0x7f35c8143b40 2021-11-12T05:44:06.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35cde52700 1 -- 172.21.2.105:0/3385556166 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c80a7e50 con 0x7f35c8143b40 2021-11-12T05:44:06.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35cde52700 1 -- 172.21.2.105:0/3385556166 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c80a7360 con 0x7f35c8143b40 2021-11-12T05:44:06.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35c4ff9700 1 -- 172.21.2.105:0/3385556166 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f35c0018030 con 0x7f35c8143b40 2021-11-12T05:44:06.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35c4ff9700 1 --2- 172.21.2.105:0/3385556166 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f35ac053610 0x7f35ac055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:06.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35c4ff9700 1 -- 172.21.2.105:0/3385556166 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f35c006b440 con 0x7f35c8143b40 2021-11-12T05:44:06.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.591+0000 7f35c77fe700 1 --2- 172.21.2.105:0/3385556166 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f35ac053610 0x7f35ac055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:06.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.595+0000 7f35c77fe700 1 --2- 172.21.2.105:0/3385556166 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f35ac053610 0x7f35ac055ad0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f35c80b63f0 tx=0x7f35b0006f40).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:06.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.595+0000 7f35c4ff9700 1 -- 172.21.2.105:0/3385556166 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f35c80a7360 con 0x7f35c8143b40 2021-11-12T05:44:06.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.679+0000 7f35cde52700 1 -- 172.21.2.105:0/3385556166 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35c80a7360 con 0x7f35c8143b40 2021-11-12T05:44:06.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.679+0000 7f35c4ff9700 1 -- 172.21.2.105:0/3385556166 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16273 (secure 0 0 0) 0x7f35c80a7360 con 0x7f35c8143b40 2021-11-12T05:44:06.686 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:44:06.686 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":55,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:44:06.344759+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:44:03.259173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-11-12T05:44:04.311731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:44:06.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.683+0000 7f35cde52700 1 -- 172.21.2.105:0/3385556166 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f35ac053610 msgr2=0x7f35ac055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:06.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.683+0000 7f35cde52700 1 --2- 172.21.2.105:0/3385556166 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f35ac053610 0x7f35ac055ad0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f35c80b63f0 tx=0x7f35b0006f40).stop 2021-11-12T05:44:06.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.683+0000 7f35cde52700 1 -- 172.21.2.105:0/3385556166 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f35c8143b40 msgr2=0x7f35c80a8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:06.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.683+0000 7f35cde52700 1 --2- 172.21.2.105:0/3385556166 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f35c8143b40 0x7f35c80a8b30 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f35c0003310 tx=0x7f35c00091a0).stop 2021-11-12T05:44:06.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.683+0000 7f35cde52700 1 -- 172.21.2.105:0/3385556166 shutdown_connections 2021-11-12T05:44:06.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.683+0000 7f35cde52700 1 --2- 172.21.2.105:0/3385556166 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f35ac053610 0x7f35ac055ad0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:06.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.683+0000 7f35cde52700 1 --2- 172.21.2.105:0/3385556166 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f35c8143b40 0x7f35c80a8b30 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:06.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.683+0000 7f35cde52700 1 --2- 172.21.2.105:0/3385556166 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f35c80aded0 0x7f35c80a8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:06.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.683+0000 7f35cde52700 1 --2- 172.21.2.105:0/3385556166 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f35c80adaf0 0x7f35c80b0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:06.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.683+0000 7f35cde52700 1 -- 172.21.2.105:0/3385556166 >> 172.21.2.105:0/3385556166 conn(0x7f35c805c490 msgr2=0x7f35c813f990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:06.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.683+0000 7f35cde52700 1 -- 172.21.2.105:0/3385556166 shutdown_connections 2021-11-12T05:44:06.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.683+0000 7f35cde52700 1 -- 172.21.2.105:0/3385556166 wait complete. 2021-11-12T05:44:06.694 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-12T05:44:06.753 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.743+0000 7f7477a65700 1 Processor -- start 2021-11-12T05:44:06.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.743+0000 7f7477a65700 1 -- start start 2021-11-12T05:44:06.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.743+0000 7f7477a65700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f74700b2940 0x7f7470142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:06.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.743+0000 7f7477a65700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f74700b0780 0x7f74701432b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:06.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.743+0000 7f7477a65700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74700b2d20 con 0x7f74700b0cc0 2021-11-12T05:44:06.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.743+0000 7f7477a65700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74700b1fc0 con 0x7f74700b2940 2021-11-12T05:44:06.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.743+0000 7f7477a65700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74700b15e0 con 0x7f74700b0780 2021-11-12T05:44:06.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.743+0000 7f7475801700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f74700b2940 0x7f7470142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:06.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.743+0000 7f7475801700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f74700b2940 0x7f7470142dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45878/0 (socket says 172.21.2.105:45878) 2021-11-12T05:44:06.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.743+0000 7f7475801700 1 -- 172.21.2.105:0/843344627 learned_addr learned my addr 172.21.2.105:0/843344627 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:06.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.743+0000 7f7475801700 1 -- 172.21.2.105:0/843344627 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f74700b0780 msgr2=0x7f74701432b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:06.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.743+0000 7f7475801700 1 --2- 172.21.2.105:0/843344627 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f74700b0780 0x7f74701432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:06.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.743+0000 7f7475801700 1 -- 172.21.2.105:0/843344627 >> v1:172.21.2.115:6789/0 conn(0x7f74700b0cc0 legacy=0x7f747013fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:06.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.743+0000 7f7475801700 1 -- 172.21.2.105:0/843344627 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74700b1880 con 0x7f74700b2940 2021-11-12T05:44:06.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.743+0000 7f7475801700 1 --2- 172.21.2.105:0/843344627 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f74700b2940 0x7f7470142dc0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f7470060ba0 tx=0x7f7460006eb0).ready entity=mon.0 client_cookie=2625ace84e62f4a server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:06.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.743+0000 7f745ffff700 1 -- 172.21.2.105:0/843344627 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7460010810 con 0x7f74700b2940 2021-11-12T05:44:06.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.743+0000 7f745ffff700 1 -- 172.21.2.105:0/843344627 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7460000e90 con 0x7f74700b2940 2021-11-12T05:44:06.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.743+0000 7f745ffff700 1 -- 172.21.2.105:0/843344627 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7460010ba0 con 0x7f74700b2940 2021-11-12T05:44:06.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.747+0000 7f7477a65700 1 -- 172.21.2.105:0/843344627 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f74700b2940 msgr2=0x7f7470142dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:06.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.747+0000 7f7477a65700 1 --2- 172.21.2.105:0/843344627 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f74700b2940 0x7f7470142dc0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f7470060ba0 tx=0x7f7460006eb0).stop 2021-11-12T05:44:06.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.747+0000 7f7477a65700 1 -- 172.21.2.105:0/843344627 shutdown_connections 2021-11-12T05:44:06.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.747+0000 7f7477a65700 1 --2- 172.21.2.105:0/843344627 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f74700b0780 0x7f74701432b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:06.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.747+0000 7f7477a65700 1 --2- 172.21.2.105:0/843344627 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f74700b2940 0x7f7470142dc0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:06.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.747+0000 7f7477a65700 1 -- 172.21.2.105:0/843344627 >> 172.21.2.105:0/843344627 conn(0x7f7470068440 msgr2=0x7f7470062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:06.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.747+0000 7f7477a65700 1 -- 172.21.2.105:0/843344627 shutdown_connections 2021-11-12T05:44:06.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.747+0000 7f7477a65700 1 -- 172.21.2.105:0/843344627 wait complete. 2021-11-12T05:44:06.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.747+0000 7f7477a65700 1 Processor -- start 2021-11-12T05:44:06.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.747+0000 7f7477a65700 1 -- start start 2021-11-12T05:44:06.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.747+0000 7f7477a65700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f74700b0780 0x7f7470066e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:06.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.747+0000 7f7477a65700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f74700b0cc0 0x7f74701413d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:06.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.747+0000 7f7477a65700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f74700b2940 0x7f747014e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:06.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.747+0000 7f7477a65700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7470141e50 con 0x7f74700b0780 2021-11-12T05:44:06.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.747+0000 7f7477a65700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7470065ff0 con 0x7f74700b0cc0 2021-11-12T05:44:06.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.747+0000 7f7477a65700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7470067350 con 0x7f74700b2940 2021-11-12T05:44:06.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.747+0000 7f7475801700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f74700b0780 0x7f7470066e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:06.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.747+0000 7f7475801700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f74700b0780 0x7f7470066e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45884/0 (socket says 172.21.2.105:45884) 2021-11-12T05:44:06.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.747+0000 7f7475801700 1 -- 172.21.2.105:0/1681299163 learned_addr learned my addr 172.21.2.105:0/1681299163 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:06.763 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.747+0000 7f7475801700 1 -- 172.21.2.105:0/1681299163 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f74700b2940 msgr2=0x7f747014e550 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:44:06.763 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.747+0000 7f7475801700 1 --2- 172.21.2.105:0/1681299163 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f74700b2940 0x7f747014e550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:06.763 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.747+0000 7f7475801700 1 -- 172.21.2.105:0/1681299163 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f74700b0cc0 msgr2=0x7f74701413d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:06.763 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.747+0000 7f7475801700 1 --2- 172.21.2.105:0/1681299163 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f74700b0cc0 0x7f74701413d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:06.764 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.747+0000 7f7475801700 1 -- 172.21.2.105:0/1681299163 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f746000c2f0 con 0x7f74700b0780 2021-11-12T05:44:06.764 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.747+0000 7f7475801700 1 --2- 172.21.2.105:0/1681299163 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f74700b0780 0x7f7470066e60 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f74700674e0 tx=0x7f7460017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:06.764 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.747+0000 7f745e7fc700 1 -- 172.21.2.105:0/1681299163 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7460006be0 con 0x7f74700b0780 2021-11-12T05:44:06.764 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.747+0000 7f745e7fc700 1 -- 172.21.2.105:0/1681299163 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746000c030 con 0x7f74700b0780 2021-11-12T05:44:06.764 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.747+0000 7f745e7fc700 1 -- 172.21.2.105:0/1681299163 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7460023630 con 0x7f74700b0780 2021-11-12T05:44:06.765 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.747+0000 7f7477a65700 1 -- 172.21.2.105:0/1681299163 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7470141bb0 con 0x7f74700b0780 2021-11-12T05:44:06.765 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.747+0000 7f7477a65700 1 -- 172.21.2.105:0/1681299163 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7470143db0 con 0x7f74700b0780 2021-11-12T05:44:06.765 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.747+0000 7f7477a65700 1 -- 172.21.2.105:0/1681299163 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74700b1b20 con 0x7f74700b0780 2021-11-12T05:44:06.765 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.747+0000 7f745e7fc700 1 -- 172.21.2.105:0/1681299163 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f746002a070 con 0x7f74700b0780 2021-11-12T05:44:06.766 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.747+0000 7f745e7fc700 1 --2- 172.21.2.105:0/1681299163 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7450053610 0x7f7450055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:06.766 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.747+0000 7f745e7fc700 1 -- 172.21.2.105:0/1681299163 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f746006ce60 con 0x7f74700b0780 2021-11-12T05:44:06.766 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.747+0000 7f7475000700 1 --2- 172.21.2.105:0/1681299163 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7450053610 0x7f7450055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:06.766 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.747+0000 7f7475000700 1 --2- 172.21.2.105:0/1681299163 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7450053610 0x7f7450055ad0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f746c002f70 tx=0x7f746c006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:06.767 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.751+0000 7f745e7fc700 1 -- 172.21.2.105:0/1681299163 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7460043e70 con 0x7f74700b0780 2021-11-12T05:44:06.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.863+0000 7f7477a65700 1 -- 172.21.2.105:0/1681299163 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f7470057350 con 0x7f74700b0780 2021-11-12T05:44:06.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.867+0000 7f745e7fc700 1 -- 172.21.2.105:0/1681299163 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v19) v1 ==== 184+0+0 (secure 0 0 0) 0x7f7460047490 con 0x7f74700b0780 2021-11-12T05:44:06.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.867+0000 7f7477a65700 1 -- 172.21.2.105:0/1681299163 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7450053610 msgr2=0x7f7450055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:06.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.867+0000 7f7477a65700 1 --2- 172.21.2.105:0/1681299163 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7450053610 0x7f7450055ad0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f746c002f70 tx=0x7f746c006a80).stop 2021-11-12T05:44:06.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.867+0000 7f7477a65700 1 -- 172.21.2.105:0/1681299163 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f74700b0780 msgr2=0x7f7470066e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:06.875 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.867+0000 7f7477a65700 1 --2- 172.21.2.105:0/1681299163 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f74700b0780 0x7f7470066e60 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f74700674e0 tx=0x7f7460017000).stop 2021-11-12T05:44:06.875 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.867+0000 7f7477a65700 1 -- 172.21.2.105:0/1681299163 shutdown_connections 2021-11-12T05:44:06.875 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.867+0000 7f7477a65700 1 --2- 172.21.2.105:0/1681299163 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7450053610 0x7f7450055ad0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:06.875 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.867+0000 7f7477a65700 1 --2- 172.21.2.105:0/1681299163 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f74700b2940 0x7f747014e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:06.875 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.867+0000 7f7477a65700 1 --2- 172.21.2.105:0/1681299163 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f74700b0cc0 0x7f74701413d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:06.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.867+0000 7f7477a65700 1 --2- 172.21.2.105:0/1681299163 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f74700b0780 0x7f7470066e60 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:06.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.867+0000 7f7477a65700 1 -- 172.21.2.105:0/1681299163 >> 172.21.2.105:0/1681299163 conn(0x7f7470068440 msgr2=0x7f74700b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:06.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.867+0000 7f7477a65700 1 -- 172.21.2.105:0/1681299163 shutdown_connections 2021-11-12T05:44:06.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.867+0000 7f7477a65700 1 -- 172.21.2.105:0/1681299163 wait complete. 2021-11-12T05:44:06.877 INFO:teuthology.orchestra.run.gibba005.stderr:updated caps for client.0 2021-11-12T05:44:06.880 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-12T05:44:06.934 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9493dca700 1 Processor -- start 2021-11-12T05:44:06.935 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9493dca700 1 -- start start 2021-11-12T05:44:06.939 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9493dca700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f948c0ac280 0x7f948c14b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:06.939 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9493dca700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f948c0ac7b0 con 0x7f948c0af730 2021-11-12T05:44:06.939 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9493dca700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f948c0ac9e0 con 0x7f948c0ad080 2021-11-12T05:44:06.939 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9493dca700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f948c1488a0 con 0x7f948c0ac280 2021-11-12T05:44:06.940 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9492367700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f948c0af730 0x7f948c147a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:56292/0 (socket says 172.21.2.105:56292) 2021-11-12T05:44:06.940 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9492367700 1 -- 172.21.2.105:0/2429889277 learned_addr learned my addr 172.21.2.105:0/2429889277 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:44:06.940 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9490b64700 1 -- 172.21.2.105:0/2429889277 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2824598402 0 0) 0x7f948c0ac7b0 con 0x7f948c0af730 2021-11-12T05:44:06.940 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9490b64700 1 -- 172.21.2.105:0/2429889277 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9474003260 con 0x7f948c0af730 2021-11-12T05:44:06.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9491365700 1 --2- 172.21.2.105:0/2429889277 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f948c0ac280 0x7f948c14b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:06.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9490b64700 1 -- 172.21.2.105:0/2429889277 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2906437189 0 0) 0x7f9474003260 con 0x7f948c0af730 2021-11-12T05:44:06.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9490b64700 1 -- 172.21.2.105:0/2429889277 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f948c0ac280 msgr2=0x7f948c14b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:06.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9490b64700 1 --2- 172.21.2.105:0/2429889277 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f948c0ac280 0x7f948c14b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:06.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9490b64700 1 -- 172.21.2.105:0/2429889277 >> v1:172.21.2.115:6789/0 conn(0x7f948c0ad080 legacy=0x7f948c14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:06.942 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9490b64700 1 -- 172.21.2.105:0/2429889277 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948c0b0b30 con 0x7f948c0af730 2021-11-12T05:44:06.942 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9490b64700 1 -- 172.21.2.105:0/2429889277 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f94840019e0 con 0x7f948c0af730 2021-11-12T05:44:06.942 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9490b64700 1 -- 172.21.2.105:0/2429889277 >> v1:172.21.2.105:6789/0 conn(0x7f948c0af730 legacy=0x7f948c147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:06.942 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9490b64700 1 --2- 172.21.2.105:0/2429889277 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9474003780 0x7f9474003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:06.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9490b64700 1 --2- 172.21.2.105:0/2429889277 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9474004500 0x7f9474004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:06.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9490b64700 1 --2- 172.21.2.105:0/2429889277 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f948c0ac280 0x7f9474004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:06.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9490b64700 1 -- 172.21.2.105:0/2429889277 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c1488a0 con 0x7f9474003780 2021-11-12T05:44:06.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9490b64700 1 -- 172.21.2.105:0/2429889277 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947400b780 con 0x7f9474004500 2021-11-12T05:44:06.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9490b64700 1 -- 172.21.2.105:0/2429889277 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f947400b940 con 0x7f948c0ac280 2021-11-12T05:44:06.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9491b66700 1 --2- 172.21.2.105:0/2429889277 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9474003780 0x7f9474003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:06.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9492367700 1 --2- 172.21.2.105:0/2429889277 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f948c0ac280 0x7f9474004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:06.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9491365700 1 --2- 172.21.2.105:0/2429889277 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9474004500 0x7f9474004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:06.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9491b66700 1 -- 172.21.2.105:0/2429889277 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f948c0ac280 msgr2=0x7f9474004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:06.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9491b66700 1 --2- 172.21.2.105:0/2429889277 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f948c0ac280 0x7f9474004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:06.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9491b66700 1 -- 172.21.2.105:0/2429889277 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9474004500 msgr2=0x7f9474004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:06.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9491b66700 1 --2- 172.21.2.105:0/2429889277 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9474004500 0x7f9474004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:06.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9491b66700 1 -- 172.21.2.105:0/2429889277 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9474003260 con 0x7f9474003780 2021-11-12T05:44:06.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9491b66700 1 --2- 172.21.2.105:0/2429889277 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9474003780 0x7f9474003ba0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f948c0b6060 tx=0x7f9488007a00).ready entity=mon.0 client_cookie=9ac6c05c71e55a8b server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:06.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9490b64700 1 -- 172.21.2.105:0/2429889277 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9488007d10 con 0x7f9474003780 2021-11-12T05:44:06.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9490b64700 1 -- 172.21.2.105:0/2429889277 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9488007030 con 0x7f9474003780 2021-11-12T05:44:06.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9490b64700 1 -- 172.21.2.105:0/2429889277 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9488007390 con 0x7f9474003780 2021-11-12T05:44:06.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9493dca700 1 -- 172.21.2.105:0/2429889277 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9474003780 msgr2=0x7f9474003ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:06.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9493dca700 1 --2- 172.21.2.105:0/2429889277 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9474003780 0x7f9474003ba0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f948c0b6060 tx=0x7f9488007a00).stop 2021-11-12T05:44:06.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9492367700 1 -- 172.21.2.105:0/2429889277 reap_dead start 2021-11-12T05:44:06.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9493dca700 1 -- 172.21.2.105:0/2429889277 shutdown_connections 2021-11-12T05:44:06.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9493dca700 1 -- 172.21.2.105:0/2429889277 >> 172.21.2.105:0/2429889277 conn(0x7f948c0b5370 msgr2=0x7f948c0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:06.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9493dca700 1 -- 172.21.2.105:0/2429889277 shutdown_connections 2021-11-12T05:44:06.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.931+0000 7f9493dca700 1 -- 172.21.2.105:0/2429889277 wait complete. 2021-11-12T05:44:06.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.935+0000 7f9493dca700 1 Processor -- start 2021-11-12T05:44:06.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.935+0000 7f9493dca700 1 -- start start 2021-11-12T05:44:06.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.935+0000 7f9493dca700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9474003780 0x7f948c147ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:06.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.935+0000 7f9493dca700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f948c15a600 0x7f948c063a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:06.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.935+0000 7f9493dca700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f948c063ef0 0x7f948c0a7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:06.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.935+0000 7f9493dca700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c0635a0 con 0x7f948c063ef0 2021-11-12T05:44:06.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.935+0000 7f9493dca700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c0aae40 con 0x7f9474003780 2021-11-12T05:44:06.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.935+0000 7f9493dca700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f948c0aaba0 con 0x7f948c15a600 2021-11-12T05:44:06.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.935+0000 7f9491365700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f948c15a600 0x7f948c063a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:06.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.935+0000 7f9492367700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f948c063ef0 0x7f948c0a7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:06.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.935+0000 7f9491365700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f948c15a600 0x7f948c063a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3301/0 says I am v2:172.21.2.105:37094/0 (socket says 172.21.2.105:37094) 2021-11-12T05:44:06.953 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.935+0000 7f9491365700 1 -- 172.21.2.105:0/1672944268 learned_addr learned my addr 172.21.2.105:0/1672944268 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:06.953 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.935+0000 7f9491b66700 1 --2- 172.21.2.105:0/1672944268 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9474003780 0x7f948c147ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:06.953 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.935+0000 7f9492367700 1 -- 172.21.2.105:0/1672944268 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f948c15a600 msgr2=0x7f948c063a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:06.953 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.935+0000 7f9492367700 1 --2- 172.21.2.105:0/1672944268 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f948c15a600 0x7f948c063a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:06.954 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.935+0000 7f9492367700 1 -- 172.21.2.105:0/1672944268 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9474003780 msgr2=0x7f948c147ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:06.954 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.935+0000 7f9492367700 1 --2- 172.21.2.105:0/1672944268 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9474003780 0x7f948c147ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:06.954 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.935+0000 7f9492367700 1 -- 172.21.2.105:0/1672944268 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948c15aa80 con 0x7f948c063ef0 2021-11-12T05:44:06.954 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.935+0000 7f9491b66700 1 --2- 172.21.2.105:0/1672944268 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9474003780 0x7f948c147ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:44:06.954 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.935+0000 7f9492367700 1 --2- 172.21.2.105:0/1672944268 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f948c063ef0 0x7f948c0a7fb0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f9484001210 tx=0x7f948c0aeb90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:06.955 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.935+0000 7f947effd700 1 -- 172.21.2.105:0/1672944268 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94840107e0 con 0x7f948c063ef0 2021-11-12T05:44:06.955 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.935+0000 7f947effd700 1 -- 172.21.2.105:0/1672944268 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9484010940 con 0x7f948c063ef0 2021-11-12T05:44:06.955 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.935+0000 7f9493dca700 1 -- 172.21.2.105:0/1672944268 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f948c0a9ac0 con 0x7f948c063ef0 2021-11-12T05:44:06.955 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.935+0000 7f9493dca700 1 -- 172.21.2.105:0/1672944268 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f948c0a9880 con 0x7f948c063ef0 2021-11-12T05:44:06.956 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.935+0000 7f947effd700 1 -- 172.21.2.105:0/1672944268 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9484010ca0 con 0x7f948c063ef0 2021-11-12T05:44:06.956 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.935+0000 7f9493dca700 1 -- 172.21.2.105:0/1672944268 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f948c0a9c50 con 0x7f948c063ef0 2021-11-12T05:44:06.956 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.935+0000 7f947effd700 1 -- 172.21.2.105:0/1672944268 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9484014430 con 0x7f948c063ef0 2021-11-12T05:44:06.956 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.935+0000 7f947effd700 1 --2- 172.21.2.105:0/1672944268 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f946c0536f0 0x7f946c055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:06.956 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.935+0000 7f947effd700 1 -- 172.21.2.105:0/1672944268 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f948406ba60 con 0x7f948c063ef0 2021-11-12T05:44:06.957 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.935+0000 7f9491b66700 1 --2- 172.21.2.105:0/1672944268 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f946c0536f0 0x7f946c055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:06.957 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.935+0000 7f9491b66700 1 --2- 172.21.2.105:0/1672944268 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f946c0536f0 0x7f946c055bb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f9488019000 tx=0x7f9488015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:06.957 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:06.939+0000 7f947effd700 1 -- 172.21.2.105:0/1672944268 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9484042900 con 0x7f948c063ef0 2021-11-12T05:44:07.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.051+0000 7f9493dca700 1 -- 172.21.2.105:0/1672944268 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f948c0b1440 con 0x7f948c063ef0 2021-11-12T05:44:07.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.055+0000 7f947effd700 1 -- 172.21.2.105:0/1672944268 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v20) v1 ==== 184+0+0 (secure 0 0 0) 0x7f9484045f20 con 0x7f948c063ef0 2021-11-12T05:44:07.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.055+0000 7f9493dca700 1 -- 172.21.2.105:0/1672944268 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f946c0536f0 msgr2=0x7f946c055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:07.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.055+0000 7f9493dca700 1 --2- 172.21.2.105:0/1672944268 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f946c0536f0 0x7f946c055bb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f9488019000 tx=0x7f9488015000).stop 2021-11-12T05:44:07.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.055+0000 7f9493dca700 1 -- 172.21.2.105:0/1672944268 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f948c063ef0 msgr2=0x7f948c0a7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:07.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.055+0000 7f9493dca700 1 --2- 172.21.2.105:0/1672944268 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f948c063ef0 0x7f948c0a7fb0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f9484001210 tx=0x7f948c0aeb90).stop 2021-11-12T05:44:07.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.055+0000 7f9493dca700 1 -- 172.21.2.105:0/1672944268 shutdown_connections 2021-11-12T05:44:07.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.055+0000 7f9493dca700 1 --2- 172.21.2.105:0/1672944268 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f946c0536f0 0x7f946c055bb0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:07.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.055+0000 7f9493dca700 1 --2- 172.21.2.105:0/1672944268 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f948c063ef0 0x7f948c0a7fb0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:07.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.055+0000 7f9493dca700 1 --2- 172.21.2.105:0/1672944268 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f948c15a600 0x7f948c063a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:07.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.055+0000 7f9493dca700 1 --2- 172.21.2.105:0/1672944268 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9474003780 0x7f948c147ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:07.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.055+0000 7f9493dca700 1 -- 172.21.2.105:0/1672944268 >> 172.21.2.105:0/1672944268 conn(0x7f948c0b5370 msgr2=0x7f948c0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:07.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.055+0000 7f9493dca700 1 -- 172.21.2.105:0/1672944268 shutdown_connections 2021-11-12T05:44:07.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.055+0000 7f9493dca700 1 -- 172.21.2.105:0/1672944268 wait complete. 2021-11-12T05:44:07.064 INFO:teuthology.orchestra.run.gibba005.stderr:updated caps for client.1 2021-11-12T05:44:07.067 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-12T05:44:07.123 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaac34c700 1 Processor -- start 2021-11-12T05:44:07.124 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaac34c700 1 -- start start 2021-11-12T05:44:07.124 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaac34c700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fdaa40ac280 0x7fdaa414b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:07.124 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaac34c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdaa40af730 0x7fdaa40ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:07.124 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaac34c700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaa40ac7b0 con 0x7fdaa40ad080 2021-11-12T05:44:07.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaac34c700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaa41488a0 con 0x7fdaa40ac280 2021-11-12T05:44:07.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaac34c700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa40ac9e0 con 0x7fdaa40af730 2021-11-12T05:44:07.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaaa0e8700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fdaa40ad080 0x7fdaa414abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:56308/0 (socket says 172.21.2.105:56308) 2021-11-12T05:44:07.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaaa0e8700 1 -- 172.21.2.105:0/4192775684 learned_addr learned my addr 172.21.2.105:0/4192775684 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:44:07.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaa98e7700 1 --2- 172.21.2.105:0/4192775684 >> v2:172.21.2.115:3300/0 conn(0x7fdaa40ac280 0x7fdaa414b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:07.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaa90e6700 1 -- 172.21.2.105:0/4192775684 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3363137063 0 0) 0x7fdaa40ac7b0 con 0x7fdaa40ad080 2021-11-12T05:44:07.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaa90e6700 1 -- 172.21.2.105:0/4192775684 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda8c003260 con 0x7fdaa40ad080 2021-11-12T05:44:07.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaaa8e9700 1 --2- 172.21.2.105:0/4192775684 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdaa40af730 0x7fdaa40ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:07.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaa90e6700 1 -- 172.21.2.105:0/4192775684 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1443992591 0 0) 0x7fda8c003260 con 0x7fdaa40ad080 2021-11-12T05:44:07.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaa90e6700 1 -- 172.21.2.105:0/4192775684 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdaa40af730 msgr2=0x7fdaa40ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:07.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaa90e6700 1 --2- 172.21.2.105:0/4192775684 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdaa40af730 0x7fdaa40ad460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:07.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaa90e6700 1 -- 172.21.2.105:0/4192775684 >> v2:172.21.2.115:3300/0 conn(0x7fdaa40ac280 msgr2=0x7fdaa414b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:07.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaa90e6700 1 --2- 172.21.2.105:0/4192775684 >> v2:172.21.2.115:3300/0 conn(0x7fdaa40ac280 0x7fdaa414b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:07.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaa90e6700 1 -- 172.21.2.105:0/4192775684 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa40b0b30 con 0x7fdaa40ad080 2021-11-12T05:44:07.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaa98e7700 1 --2- 172.21.2.105:0/4192775684 >> v2:172.21.2.115:3300/0 conn(0x7fdaa40ac280 0x7fdaa414b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:44:07.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaa90e6700 1 -- 172.21.2.105:0/4192775684 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fdaa0001660 con 0x7fdaa40ad080 2021-11-12T05:44:07.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaa90e6700 1 -- 172.21.2.105:0/4192775684 >> v1:172.21.2.105:6789/0 conn(0x7fdaa40ad080 legacy=0x7fdaa414abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:07.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaa90e6700 1 --2- 172.21.2.105:0/4192775684 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdaa40af730 0x7fda8c003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:07.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaa90e6700 1 --2- 172.21.2.105:0/4192775684 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fda8c003cf0 0x7fda8c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:07.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaa90e6700 1 --2- 172.21.2.105:0/4192775684 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fda8c0049f0 0x7fda8c004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:07.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaa90e6700 1 -- 172.21.2.105:0/4192775684 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa41488a0 con 0x7fda8c003cf0 2021-11-12T05:44:07.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaa90e6700 1 -- 172.21.2.105:0/4192775684 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa40ac9e0 con 0x7fda8c0049f0 2021-11-12T05:44:07.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaa90e6700 1 -- 172.21.2.105:0/4192775684 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c00b780 con 0x7fdaa40af730 2021-11-12T05:44:07.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaa98e7700 1 --2- 172.21.2.105:0/4192775684 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fda8c003cf0 0x7fda8c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:07.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaaa8e9700 1 --2- 172.21.2.105:0/4192775684 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fda8c0049f0 0x7fda8c004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:07.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaaa0e8700 1 --2- 172.21.2.105:0/4192775684 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdaa40af730 0x7fda8c003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:07.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaa98e7700 1 -- 172.21.2.105:0/4192775684 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdaa40af730 msgr2=0x7fda8c003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:07.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaa98e7700 1 --2- 172.21.2.105:0/4192775684 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdaa40af730 0x7fda8c003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:07.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaa98e7700 1 -- 172.21.2.105:0/4192775684 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fda8c0049f0 msgr2=0x7fda8c004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:07.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaa98e7700 1 --2- 172.21.2.105:0/4192775684 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fda8c0049f0 0x7fda8c004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:07.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaa98e7700 1 -- 172.21.2.105:0/4192775684 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8c003260 con 0x7fda8c003cf0 2021-11-12T05:44:07.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaa98e7700 1 --2- 172.21.2.105:0/4192775684 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fda8c003cf0 0x7fda8c004500 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7fda9800a000 tx=0x7fda98008040).ready entity=mon.0 client_cookie=52db3bc6a2f73677 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:07.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaa90e6700 1 -- 172.21.2.105:0/4192775684 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda98013670 con 0x7fda8c003cf0 2021-11-12T05:44:07.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaa90e6700 1 -- 172.21.2.105:0/4192775684 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda980137d0 con 0x7fda8c003cf0 2021-11-12T05:44:07.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaa90e6700 1 -- 172.21.2.105:0/4192775684 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda98013b30 con 0x7fda8c003cf0 2021-11-12T05:44:07.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaac34c700 1 -- 172.21.2.105:0/4192775684 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fda8c003cf0 msgr2=0x7fda8c004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:07.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaac34c700 1 --2- 172.21.2.105:0/4192775684 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fda8c003cf0 0x7fda8c004500 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7fda9800a000 tx=0x7fda98008040).stop 2021-11-12T05:44:07.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.119+0000 7fdaaa8e9700 1 -- 172.21.2.105:0/4192775684 reap_dead start 2021-11-12T05:44:07.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.123+0000 7fdaac34c700 1 -- 172.21.2.105:0/4192775684 shutdown_connections 2021-11-12T05:44:07.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.123+0000 7fdaac34c700 1 -- 172.21.2.105:0/4192775684 >> 172.21.2.105:0/4192775684 conn(0x7fdaa40b5370 msgr2=0x7fdaa40b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:07.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.123+0000 7fdaac34c700 1 -- 172.21.2.105:0/4192775684 shutdown_connections 2021-11-12T05:44:07.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.123+0000 7fdaac34c700 1 -- 172.21.2.105:0/4192775684 wait complete. 2021-11-12T05:44:07.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.123+0000 7fdaac34c700 1 Processor -- start 2021-11-12T05:44:07.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.123+0000 7fdaac34c700 1 -- start start 2021-11-12T05:44:07.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.123+0000 7fdaac34c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fda8c003cf0 0x7fdaa40a90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:07.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.123+0000 7fdaac34c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdaa415a460 0x7fdaa415a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:07.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.123+0000 7fdaac34c700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdaa4156b50 0x7fdaa4156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:07.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.123+0000 7fdaac34c700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa415adb0 con 0x7fdaa415a460 2021-11-12T05:44:07.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.123+0000 7fdaac34c700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa40a95d0 con 0x7fdaa4156b50 2021-11-12T05:44:07.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.123+0000 7fdaac34c700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa40aab60 con 0x7fda8c003cf0 2021-11-12T05:44:07.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.123+0000 7fdaa98e7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdaa415a460 0x7fdaa415a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:07.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.123+0000 7fdaaa0e8700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fda8c003cf0 0x7fdaa40a90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:07.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.123+0000 7fdaa98e7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdaa415a460 0x7fdaa415a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45928/0 (socket says 172.21.2.105:45928) 2021-11-12T05:44:07.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.123+0000 7fdaa98e7700 1 -- 172.21.2.105:0/2719231828 learned_addr learned my addr 172.21.2.105:0/2719231828 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:07.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.123+0000 7fdaaa8e9700 1 --2- 172.21.2.105:0/2719231828 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdaa4156b50 0x7fdaa4156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:07.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.123+0000 7fdaa98e7700 1 -- 172.21.2.105:0/2719231828 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fda8c003cf0 msgr2=0x7fdaa40a90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:07.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.123+0000 7fdaa98e7700 1 --2- 172.21.2.105:0/2719231828 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fda8c003cf0 0x7fdaa40a90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:07.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.123+0000 7fdaa98e7700 1 -- 172.21.2.105:0/2719231828 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdaa4156b50 msgr2=0x7fdaa4156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:07.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.123+0000 7fdaa98e7700 1 --2- 172.21.2.105:0/2719231828 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdaa4156b50 0x7fdaa4156fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:07.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.123+0000 7fdaa98e7700 1 -- 172.21.2.105:0/2719231828 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa40aadb0 con 0x7fdaa415a460 2021-11-12T05:44:07.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.123+0000 7fdaa98e7700 1 --2- 172.21.2.105:0/2719231828 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdaa415a460 0x7fdaa415a8c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7fdaa40a9710 tx=0x7fda98008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:07.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.123+0000 7fda977fe700 1 -- 172.21.2.105:0/2719231828 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda98012a50 con 0x7fdaa415a460 2021-11-12T05:44:07.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.123+0000 7fda977fe700 1 -- 172.21.2.105:0/2719231828 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda98000e90 con 0x7fdaa415a460 2021-11-12T05:44:07.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.123+0000 7fda977fe700 1 -- 172.21.2.105:0/2719231828 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda98012da0 con 0x7fdaa415a460 2021-11-12T05:44:07.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.123+0000 7fdaac34c700 1 -- 172.21.2.105:0/2719231828 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa40ab050 con 0x7fdaa415a460 2021-11-12T05:44:07.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.123+0000 7fdaac34c700 1 -- 172.21.2.105:0/2719231828 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa40ab710 con 0x7fdaa415a460 2021-11-12T05:44:07.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.123+0000 7fdaac34c700 1 -- 172.21.2.105:0/2719231828 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaa40a9750 con 0x7fdaa415a460 2021-11-12T05:44:07.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.123+0000 7fda977fe700 1 -- 172.21.2.105:0/2719231828 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fda9802c070 con 0x7fdaa415a460 2021-11-12T05:44:07.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.123+0000 7fda977fe700 1 --2- 172.21.2.105:0/2719231828 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fda84053660 0x7fda84055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:07.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.123+0000 7fda977fe700 1 -- 172.21.2.105:0/2719231828 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fda9806d4b0 con 0x7fdaa415a460 2021-11-12T05:44:07.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.123+0000 7fdaaa0e8700 1 --2- 172.21.2.105:0/2719231828 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fda84053660 0x7fda84055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:07.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.123+0000 7fdaaa0e8700 1 --2- 172.21.2.105:0/2719231828 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fda84053660 0x7fda84055b20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fdaa0009000 tx=0x7fdaa0001980).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:07.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.127+0000 7fda977fe700 1 -- 172.21.2.105:0/2719231828 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fda980444c0 con 0x7fdaa415a460 2021-11-12T05:44:07.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.239+0000 7fdaac34c700 1 -- 172.21.2.105:0/2719231828 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fdaa40ab1e0 con 0x7fdaa415a460 2021-11-12T05:44:07.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.243+0000 7fda977fe700 1 -- 172.21.2.105:0/2719231828 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v21) v1 ==== 184+0+0 (secure 0 0 0) 0x7fda98047ae0 con 0x7fdaa415a460 2021-11-12T05:44:07.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.243+0000 7fdaac34c700 1 -- 172.21.2.105:0/2719231828 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fda84053660 msgr2=0x7fda84055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:07.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.243+0000 7fdaac34c700 1 --2- 172.21.2.105:0/2719231828 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fda84053660 0x7fda84055b20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fdaa0009000 tx=0x7fdaa0001980).stop 2021-11-12T05:44:07.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.243+0000 7fdaac34c700 1 -- 172.21.2.105:0/2719231828 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdaa415a460 msgr2=0x7fdaa415a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:07.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.243+0000 7fdaac34c700 1 --2- 172.21.2.105:0/2719231828 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdaa415a460 0x7fdaa415a8c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7fdaa40a9710 tx=0x7fda98008040).stop 2021-11-12T05:44:07.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.247+0000 7fdaac34c700 1 -- 172.21.2.105:0/2719231828 shutdown_connections 2021-11-12T05:44:07.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.247+0000 7fdaac34c700 1 --2- 172.21.2.105:0/2719231828 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fda84053660 0x7fda84055b20 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:07.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.247+0000 7fdaac34c700 1 --2- 172.21.2.105:0/2719231828 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdaa4156b50 0x7fdaa4156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:07.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.247+0000 7fdaac34c700 1 --2- 172.21.2.105:0/2719231828 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdaa415a460 0x7fdaa415a8c0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:07.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.247+0000 7fdaac34c700 1 --2- 172.21.2.105:0/2719231828 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fda8c003cf0 0x7fdaa40a90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:07.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.247+0000 7fdaac34c700 1 -- 172.21.2.105:0/2719231828 >> 172.21.2.105:0/2719231828 conn(0x7fdaa40b5370 msgr2=0x7fdaa4143c60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:07.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.247+0000 7fdaac34c700 1 -- 172.21.2.105:0/2719231828 shutdown_connections 2021-11-12T05:44:07.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.247+0000 7fdaac34c700 1 -- 172.21.2.105:0/2719231828 wait complete. 2021-11-12T05:44:07.253 INFO:teuthology.orchestra.run.gibba005.stderr:updated caps for client.2 2021-11-12T05:44:07.257 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:44:07.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.303+0000 7fa51da6b700 1 Processor -- start 2021-11-12T05:44:07.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.303+0000 7fa51da6b700 1 -- start start 2021-11-12T05:44:07.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.303+0000 7fa51da6b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa5180ad080 0x7fa5180af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:07.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.303+0000 7fa51da6b700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fa5180ac280 0x7fa5180ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:07.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.303+0000 7fa51da6b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa51814abe0 0x7fa51814b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:07.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.303+0000 7fa51da6b700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5181488a0 con 0x7fa5180ad080 2021-11-12T05:44:07.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.303+0000 7fa51da6b700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5180ac7b0 con 0x7fa5180ac280 2021-11-12T05:44:07.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.303+0000 7fa51da6b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5180ac9e0 con 0x7fa51814abe0 2021-11-12T05:44:07.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.303+0000 7fa5177fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa5180ad080 0x7fa5180af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:07.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.303+0000 7fa5177fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa5180ad080 0x7fa5180af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45932/0 (socket says 172.21.2.105:45932) 2021-11-12T05:44:07.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.303+0000 7fa5177fe700 1 -- 172.21.2.105:0/3806299984 learned_addr learned my addr 172.21.2.105:0/3806299984 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:07.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.303+0000 7fa5177fe700 1 -- 172.21.2.105:0/3806299984 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa51814abe0 msgr2=0x7fa51814b090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:44:07.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.303+0000 7fa5177fe700 1 --2- 172.21.2.105:0/3806299984 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa51814abe0 0x7fa51814b090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:07.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.303+0000 7fa5177fe700 1 -- 172.21.2.105:0/3806299984 >> v2:172.21.2.115:3300/0 conn(0x7fa5180ac280 msgr2=0x7fa5180ad460 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:44:07.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.303+0000 7fa5177fe700 1 --2- 172.21.2.105:0/3806299984 >> v2:172.21.2.115:3300/0 conn(0x7fa5180ac280 0x7fa5180ad460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:07.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.303+0000 7fa5177fe700 1 -- 172.21.2.105:0/3806299984 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5180b0b30 con 0x7fa5180ad080 2021-11-12T05:44:07.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.303+0000 7fa5177fe700 1 --2- 172.21.2.105:0/3806299984 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa5180ad080 0x7fa5180af730 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7fa5180ac6a0 tx=0x7fa508006eb0).ready entity=mon.0 client_cookie=3fc4fa30baf829e0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:07.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.303+0000 7fa5167fc700 1 -- 172.21.2.105:0/3806299984 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa50800d570 con 0x7fa5180ad080 2021-11-12T05:44:07.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.303+0000 7fa5167fc700 1 -- 172.21.2.105:0/3806299984 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa508000e90 con 0x7fa5180ad080 2021-11-12T05:44:07.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.303+0000 7fa5167fc700 1 -- 172.21.2.105:0/3806299984 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa50800d8c0 con 0x7fa5180ad080 2021-11-12T05:44:07.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.303+0000 7fa51da6b700 1 -- 172.21.2.105:0/3806299984 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa5180ad080 msgr2=0x7fa5180af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:07.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.303+0000 7fa51da6b700 1 --2- 172.21.2.105:0/3806299984 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa5180ad080 0x7fa5180af730 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7fa5180ac6a0 tx=0x7fa508006eb0).stop 2021-11-12T05:44:07.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.303+0000 7fa51da6b700 1 -- 172.21.2.105:0/3806299984 shutdown_connections 2021-11-12T05:44:07.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.303+0000 7fa51da6b700 1 --2- 172.21.2.105:0/3806299984 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa51814abe0 0x7fa51814b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:07.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.303+0000 7fa51da6b700 1 --2- 172.21.2.105:0/3806299984 >> v2:172.21.2.115:3300/0 conn(0x7fa5180ac280 0x7fa5180ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:07.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.303+0000 7fa51da6b700 1 --2- 172.21.2.105:0/3806299984 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa5180ad080 0x7fa5180af730 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:07.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.303+0000 7fa51da6b700 1 -- 172.21.2.105:0/3806299984 >> 172.21.2.105:0/3806299984 conn(0x7fa5180b5370 msgr2=0x7fa5180b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:07.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.303+0000 7fa51da6b700 1 -- 172.21.2.105:0/3806299984 shutdown_connections 2021-11-12T05:44:07.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.303+0000 7fa51da6b700 1 -- 172.21.2.105:0/3806299984 wait complete. 2021-11-12T05:44:07.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.307+0000 7fa51da6b700 1 Processor -- start 2021-11-12T05:44:07.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.307+0000 7fa51da6b700 1 -- start start 2021-11-12T05:44:07.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.307+0000 7fa51da6b700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa5180ac280 0x7fa5180a9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:07.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.307+0000 7fa51da6b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa5180ad080 0x7fa518140810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:07.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.307+0000 7fa51da6b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa51814abe0 0x7fa518140d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:07.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.307+0000 7fa51da6b700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5180aa0b0 con 0x7fa51814abe0 2021-11-12T05:44:07.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.307+0000 7fa51da6b700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5180a89a0 con 0x7fa5180ac280 2021-11-12T05:44:07.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.307+0000 7fa51da6b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5180a7b70 con 0x7fa5180ad080 2021-11-12T05:44:07.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.307+0000 7fa517fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa51814abe0 0x7fa518140d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:07.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.307+0000 7fa517fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa51814abe0 0x7fa518140d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45938/0 (socket says 172.21.2.105:45938) 2021-11-12T05:44:07.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.307+0000 7fa517fff700 1 -- 172.21.2.105:0/1531989296 learned_addr learned my addr 172.21.2.105:0/1531989296 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:07.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.307+0000 7fa517fff700 1 -- 172.21.2.105:0/1531989296 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa5180ad080 msgr2=0x7fa518140810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:07.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.307+0000 7fa517fff700 1 --2- 172.21.2.105:0/1531989296 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa5180ad080 0x7fa518140810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:07.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.307+0000 7fa517fff700 1 -- 172.21.2.105:0/1531989296 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa5180ac280 msgr2=0x7fa5180a9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:07.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.307+0000 7fa517fff700 1 --2- 172.21.2.105:0/1531989296 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa5180ac280 0x7fa5180a9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:07.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.307+0000 7fa517fff700 1 -- 172.21.2.105:0/1531989296 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50800b1e0 con 0x7fa51814abe0 2021-11-12T05:44:07.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.307+0000 7fa517fff700 1 --2- 172.21.2.105:0/1531989296 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa51814abe0 0x7fa518140d00 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7fa510001250 tx=0x7fa5100090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:07.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.307+0000 7fa514ff9700 1 -- 172.21.2.105:0/1531989296 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5100014e0 con 0x7fa51814abe0 2021-11-12T05:44:07.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.307+0000 7fa514ff9700 1 -- 172.21.2.105:0/1531989296 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa510001640 con 0x7fa51814abe0 2021-11-12T05:44:07.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.307+0000 7fa51da6b700 1 -- 172.21.2.105:0/1531989296 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5180a8bd0 con 0x7fa51814abe0 2021-11-12T05:44:07.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.307+0000 7fa514ff9700 1 -- 172.21.2.105:0/1531989296 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5100019a0 con 0x7fa51814abe0 2021-11-12T05:44:07.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.307+0000 7fa51da6b700 1 -- 172.21.2.105:0/1531989296 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5181411f0 con 0x7fa51814abe0 2021-11-12T05:44:07.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.307+0000 7fa51da6b700 1 -- 172.21.2.105:0/1531989296 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa51814b580 con 0x7fa51814abe0 2021-11-12T05:44:07.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.307+0000 7fa514ff9700 1 -- 172.21.2.105:0/1531989296 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa510018030 con 0x7fa51814abe0 2021-11-12T05:44:07.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.307+0000 7fa514ff9700 1 --2- 172.21.2.105:0/1531989296 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa4fc053610 0x7fa4fc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:07.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.307+0000 7fa514ff9700 1 -- 172.21.2.105:0/1531989296 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fa51006b3b0 con 0x7fa51814abe0 2021-11-12T05:44:07.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.307+0000 7fa5177fe700 1 --2- 172.21.2.105:0/1531989296 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa4fc053610 0x7fa4fc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:07.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.307+0000 7fa5177fe700 1 --2- 172.21.2.105:0/1531989296 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa4fc053610 0x7fa4fc055ad0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fa5180ac6a0 tx=0x7fa508015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:07.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.311+0000 7fa514ff9700 1 -- 172.21.2.105:0/1531989296 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa510042470 con 0x7fa51814abe0 2021-11-12T05:44:07.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.419+0000 7fa51da6b700 1 -- 172.21.2.105:0/1531989296 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa518057350 con 0x7fa51814abe0 2021-11-12T05:44:07.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.419+0000 7fa514ff9700 1 -- 172.21.2.105:0/1531989296 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+2136 (secure 0 0 0) 0x7fa510045a90 con 0x7fa51814abe0 2021-11-12T05:44:07.425 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:44:07.425 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":20,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4478,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/1513907466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":1513907466},{"type":"v1","addr":"172.21.2.115:6833","nonce":1513907466}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":18}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:44:05.340503+0000","modified":"2021-11-12T05:44:06.343650+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5610":{"gid":5610,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/351884283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":351884283},{"type":"v1","addr":"172.21.2.105:6835","nonce":351884283}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-11-12T05:44:07.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.419+0000 7fa51da6b700 1 -- 172.21.2.105:0/1531989296 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa4fc053610 msgr2=0x7fa4fc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:07.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.419+0000 7fa51da6b700 1 --2- 172.21.2.105:0/1531989296 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa4fc053610 0x7fa4fc055ad0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fa5180ac6a0 tx=0x7fa508015000).stop 2021-11-12T05:44:07.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.419+0000 7fa51da6b700 1 -- 172.21.2.105:0/1531989296 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa51814abe0 msgr2=0x7fa518140d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:07.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.419+0000 7fa51da6b700 1 --2- 172.21.2.105:0/1531989296 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa51814abe0 0x7fa518140d00 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7fa510001250 tx=0x7fa5100090f0).stop 2021-11-12T05:44:07.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.419+0000 7fa51da6b700 1 -- 172.21.2.105:0/1531989296 shutdown_connections 2021-11-12T05:44:07.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.419+0000 7fa51da6b700 1 --2- 172.21.2.105:0/1531989296 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa4fc053610 0x7fa4fc055ad0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:07.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.419+0000 7fa51da6b700 1 --2- 172.21.2.105:0/1531989296 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa51814abe0 0x7fa518140d00 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:07.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.419+0000 7fa51da6b700 1 --2- 172.21.2.105:0/1531989296 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa5180ad080 0x7fa518140810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:07.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.419+0000 7fa51da6b700 1 --2- 172.21.2.105:0/1531989296 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa5180ac280 0x7fa5180a9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:07.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.419+0000 7fa51da6b700 1 -- 172.21.2.105:0/1531989296 >> 172.21.2.105:0/1531989296 conn(0x7fa5180b5370 msgr2=0x7fa5180b49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:07.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.419+0000 7fa51da6b700 1 -- 172.21.2.105:0/1531989296 shutdown_connections 2021-11-12T05:44:07.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.423+0000 7fa51da6b700 1 -- 172.21.2.105:0/1531989296 wait complete. 2021-11-12T05:44:07.430 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 20 2021-11-12T05:44:07.634 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:44:05.340503+0000', 'modified': '2021-11-12T05:44:06.343650+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5610}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5610': {'gid': 5610, 'name': 'a', 'rank': 0, 'incarnation': 19, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/351884283', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 351884283}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 351884283}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:44:07.635 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:44:07.635 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:44:07.701 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":5610,"want_state":"up:active","state":"up:active","rank_uptime":2.3529396249999999,"mdsmap_epoch":20,"osdmap_epoch":55,"osdmap_epoch_barrier":54,"uptime":6.5117735699999999} 2021-11-12T05:44:07.702 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 5610, "mdsmap_epoch": 20, "osdmap_epoch": 55, "osdmap_epoch_barrier": 54, "rank_uptime": 2.352939625, "state": "up:active", "uptime": 6.51177357, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:44:07.703 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:44:07.753 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.747+0000 7fea014a7700 1 Processor -- start 2021-11-12T05:44:07.753 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.747+0000 7fea014a7700 1 -- start start 2021-11-12T05:44:07.753 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.747+0000 7fea014a7700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe9fc0ad080 0x7fe9fc0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:07.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.747+0000 7fea014a7700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe9fc0ac280 0x7fe9fc0ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:07.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.747+0000 7fea014a7700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fe9fc14abe0 0x7fe9fc14b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:07.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.747+0000 7fea014a7700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9fc1488a0 con 0x7fe9fc0ac280 2021-11-12T05:44:07.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.747+0000 7fea014a7700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9fc0ac7b0 con 0x7fe9fc14abe0 2021-11-12T05:44:07.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.747+0000 7fea014a7700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc0ac9e0 con 0x7fe9fc0ad080 2021-11-12T05:44:07.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.747+0000 7fe9fa7fc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe9fc0ac280 0x7fe9fc0ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:07.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.747+0000 7fe9fa7fc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe9fc0ac280 0x7fe9fc0ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45946/0 (socket says 172.21.2.105:45946) 2021-11-12T05:44:07.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.747+0000 7fe9fa7fc700 1 -- 172.21.2.105:0/543808171 learned_addr learned my addr 172.21.2.105:0/543808171 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:07.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.747+0000 7fe9fa7fc700 1 -- 172.21.2.105:0/543808171 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe9fc0ad080 msgr2=0x7fe9fc0af730 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:44:07.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.747+0000 7fe9fa7fc700 1 --2- 172.21.2.105:0/543808171 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe9fc0ad080 0x7fe9fc0af730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:07.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.747+0000 7fe9fa7fc700 1 -- 172.21.2.105:0/543808171 >> v2:172.21.2.115:3300/0 conn(0x7fe9fc14abe0 msgr2=0x7fe9fc14b090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:44:07.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.747+0000 7fe9fa7fc700 1 --2- 172.21.2.105:0/543808171 >> v2:172.21.2.115:3300/0 conn(0x7fe9fc14abe0 0x7fe9fc14b090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:07.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.747+0000 7fe9fa7fc700 1 -- 172.21.2.105:0/543808171 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9fc0b0b30 con 0x7fe9fc0ac280 2021-11-12T05:44:07.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.747+0000 7fe9fa7fc700 1 --2- 172.21.2.105:0/543808171 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9fc0ac280 0x7fe9fc0ad460 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7fe9fc0ac6a0 tx=0x7fe9ec006eb0).ready entity=mon.0 client_cookie=665d8ffaf7bac0cd server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:07.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.747+0000 7fe9f9ffb700 1 -- 172.21.2.105:0/543808171 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9ec00d570 con 0x7fe9fc0ac280 2021-11-12T05:44:07.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.747+0000 7fe9f9ffb700 1 -- 172.21.2.105:0/543808171 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ec000e90 con 0x7fe9fc0ac280 2021-11-12T05:44:07.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.747+0000 7fe9f9ffb700 1 -- 172.21.2.105:0/543808171 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9ec00d8c0 con 0x7fe9fc0ac280 2021-11-12T05:44:07.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.751+0000 7fea014a7700 1 -- 172.21.2.105:0/543808171 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9fc0ac280 msgr2=0x7fe9fc0ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:07.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.751+0000 7fea014a7700 1 --2- 172.21.2.105:0/543808171 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9fc0ac280 0x7fe9fc0ad460 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7fe9fc0ac6a0 tx=0x7fe9ec006eb0).stop 2021-11-12T05:44:07.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.751+0000 7fea014a7700 1 -- 172.21.2.105:0/543808171 shutdown_connections 2021-11-12T05:44:07.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.751+0000 7fea014a7700 1 --2- 172.21.2.105:0/543808171 >> v2:172.21.2.115:3300/0 conn(0x7fe9fc14abe0 0x7fe9fc14b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:07.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.751+0000 7fea014a7700 1 --2- 172.21.2.105:0/543808171 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9fc0ac280 0x7fe9fc0ad460 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:07.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.751+0000 7fea014a7700 1 --2- 172.21.2.105:0/543808171 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe9fc0ad080 0x7fe9fc0af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:07.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.751+0000 7fea014a7700 1 -- 172.21.2.105:0/543808171 >> 172.21.2.105:0/543808171 conn(0x7fe9fc0b5370 msgr2=0x7fe9fc0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:07.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.751+0000 7fea014a7700 1 -- 172.21.2.105:0/543808171 shutdown_connections 2021-11-12T05:44:07.763 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.751+0000 7fea014a7700 1 -- 172.21.2.105:0/543808171 wait complete. 2021-11-12T05:44:07.763 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.751+0000 7fea014a7700 1 Processor -- start 2021-11-12T05:44:07.763 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.751+0000 7fea014a7700 1 -- start start 2021-11-12T05:44:07.763 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.751+0000 7fea014a7700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe9fc0ac280 0x7fe9fc15a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:07.764 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.751+0000 7fea014a7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9fc0ad080 0x7fe9fc15a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:07.764 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.751+0000 7fea014a7700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe9fc14abe0 0x7fe9fc0a8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:07.764 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.751+0000 7fea014a7700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc0ab0b0 con 0x7fe9fc0ad080 2021-11-12T05:44:07.764 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.751+0000 7fea014a7700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc0a9bc0 con 0x7fe9fc14abe0 2021-11-12T05:44:07.764 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.751+0000 7fea014a7700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc0ab2e0 con 0x7fe9fc0ac280 2021-11-12T05:44:07.765 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.751+0000 7fe9fa7fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9fc0ad080 0x7fe9fc15a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:07.765 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.751+0000 7fe9fa7fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9fc0ad080 0x7fe9fc15a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45952/0 (socket says 172.21.2.105:45952) 2021-11-12T05:44:07.765 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.751+0000 7fe9fa7fc700 1 -- 172.21.2.105:0/1327493104 learned_addr learned my addr 172.21.2.105:0/1327493104 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:07.765 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.751+0000 7fe9fa7fc700 1 -- 172.21.2.105:0/1327493104 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe9fc0ac280 msgr2=0x7fe9fc15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:07.765 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.751+0000 7fe9fa7fc700 1 --2- 172.21.2.105:0/1327493104 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe9fc0ac280 0x7fe9fc15a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:07.766 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.751+0000 7fe9fa7fc700 1 -- 172.21.2.105:0/1327493104 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe9fc14abe0 msgr2=0x7fe9fc0a8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:07.766 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.751+0000 7fe9fa7fc700 1 --2- 172.21.2.105:0/1327493104 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe9fc14abe0 0x7fe9fc0a8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:07.766 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.751+0000 7fe9fa7fc700 1 -- 172.21.2.105:0/1327493104 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ec00b1e0 con 0x7fe9fc0ad080 2021-11-12T05:44:07.766 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.751+0000 7fe9fa7fc700 1 --2- 172.21.2.105:0/1327493104 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9fc0ad080 0x7fe9fc15a9b0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7fe9fc0ac6a0 tx=0x7fe9ec015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:07.766 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.751+0000 7fe9f3fff700 1 -- 172.21.2.105:0/1327493104 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9ec011a40 con 0x7fe9fc0ad080 2021-11-12T05:44:07.767 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.751+0000 7fe9f3fff700 1 -- 172.21.2.105:0/1327493104 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ec011ba0 con 0x7fe9fc0ad080 2021-11-12T05:44:07.767 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.751+0000 7fea014a7700 1 -- 172.21.2.105:0/1327493104 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9fc0a94a0 con 0x7fe9fc0ad080 2021-11-12T05:44:07.767 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.751+0000 7fe9f3fff700 1 -- 172.21.2.105:0/1327493104 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9ec01e460 con 0x7fe9fc0ad080 2021-11-12T05:44:07.767 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.751+0000 7fea014a7700 1 -- 172.21.2.105:0/1327493104 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9fc0a9940 con 0x7fe9fc0ad080 2021-11-12T05:44:07.768 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.751+0000 7fea014a7700 1 -- 172.21.2.105:0/1327493104 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9fc14b580 con 0x7fe9fc0ad080 2021-11-12T05:44:07.768 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.751+0000 7fe9f3fff700 1 -- 172.21.2.105:0/1327493104 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe9ec025030 con 0x7fe9fc0ad080 2021-11-12T05:44:07.768 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.755+0000 7fe9f3fff700 1 --2- 172.21.2.105:0/1327493104 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe9e0053610 0x7fe9e0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:07.768 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.755+0000 7fe9f3fff700 1 -- 172.21.2.105:0/1327493104 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fe9ec06cdc0 con 0x7fe9fc0ad080 2021-11-12T05:44:07.768 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.755+0000 7fe9faffd700 1 --2- 172.21.2.105:0/1327493104 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe9e0053610 0x7fe9e0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:07.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.755+0000 7fe9faffd700 1 --2- 172.21.2.105:0/1327493104 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe9e0053610 0x7fe9e0055ad0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fe9e4002fb0 tx=0x7fe9e40069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:07.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.755+0000 7fe9f3fff700 1 -- 172.21.2.105:0/1327493104 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe9ec043dd0 con 0x7fe9fc0ad080 2021-11-12T05:44:07.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.839+0000 7fea014a7700 1 -- 172.21.2.105:0/1327493104 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9fc057350 con 0x7fe9fc0ad080 2021-11-12T05:44:07.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.839+0000 7fe9f3fff700 1 -- 172.21.2.105:0/1327493104 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16273 (secure 0 0 0) 0x7fe9ec023070 con 0x7fe9fc0ad080 2021-11-12T05:44:07.845 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:44:07.845 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":55,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:44:06.344759+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:44:03.259173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-11-12T05:44:04.311731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:44:07.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.839+0000 7fea014a7700 1 -- 172.21.2.105:0/1327493104 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe9e0053610 msgr2=0x7fe9e0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:07.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.839+0000 7fea014a7700 1 --2- 172.21.2.105:0/1327493104 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe9e0053610 0x7fe9e0055ad0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fe9e4002fb0 tx=0x7fe9e40069b0).stop 2021-11-12T05:44:07.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.839+0000 7fea014a7700 1 -- 172.21.2.105:0/1327493104 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9fc0ad080 msgr2=0x7fe9fc15a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:07.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.839+0000 7fea014a7700 1 --2- 172.21.2.105:0/1327493104 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9fc0ad080 0x7fe9fc15a9b0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7fe9fc0ac6a0 tx=0x7fe9ec015000).stop 2021-11-12T05:44:07.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.839+0000 7fea014a7700 1 -- 172.21.2.105:0/1327493104 shutdown_connections 2021-11-12T05:44:07.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.839+0000 7fea014a7700 1 --2- 172.21.2.105:0/1327493104 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe9e0053610 0x7fe9e0055ad0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:07.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.839+0000 7fea014a7700 1 --2- 172.21.2.105:0/1327493104 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe9fc14abe0 0x7fe9fc0a8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:07.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.839+0000 7fea014a7700 1 --2- 172.21.2.105:0/1327493104 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9fc0ad080 0x7fe9fc15a9b0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:07.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.839+0000 7fea014a7700 1 --2- 172.21.2.105:0/1327493104 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe9fc0ac280 0x7fe9fc15a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:07.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.839+0000 7fea014a7700 1 -- 172.21.2.105:0/1327493104 >> 172.21.2.105:0/1327493104 conn(0x7fe9fc0b5370 msgr2=0x7fe9fc147c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:07.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.839+0000 7fea014a7700 1 -- 172.21.2.105:0/1327493104 shutdown_connections 2021-11-12T05:44:07.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.839+0000 7fea014a7700 1 -- 172.21.2.105:0/1327493104 wait complete. 2021-11-12T05:44:07.852 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-12T05:44:03.259173+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2021-11-12T05:44:04.311731+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-12T05:44:07.853 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:44:07.961 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.955+0000 7fcf1007b700 1 Processor -- start 2021-11-12T05:44:07.962 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.955+0000 7fcf1007b700 1 -- start start 2021-11-12T05:44:07.962 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.955+0000 7fcf1007b700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fcf080ace20 0x7fcf080b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:07.962 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.955+0000 7fcf1007b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcf08144180 0x7fcf08144610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:07.962 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.955+0000 7fcf1007b700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf080b1840 con 0x7fcf080aca40 2021-11-12T05:44:07.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.955+0000 7fcf1007b700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf080b0a10 con 0x7fcf080ace20 2021-11-12T05:44:07.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.955+0000 7fcf1007b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf080af2b0 con 0x7fcf08144180 2021-11-12T05:44:07.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.959+0000 7fcf0d616700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fcf080ace20 0x7fcf080b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:07.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.959+0000 7fcf0de17700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7fcf080aca40 0x7fcf081473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:54822/0 (socket says 172.21.2.105:54822) 2021-11-12T05:44:07.965 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.959+0000 7fcf0de17700 1 -- 172.21.2.105:0/2014796448 learned_addr learned my addr 172.21.2.105:0/2014796448 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:44:07.965 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.959+0000 7fcf0e618700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcf08144180 0x7fcf08144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:07.965 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.959+0000 7fcf0d616700 1 -- 172.21.2.105:0/2014796448 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcf08144180 msgr2=0x7fcf08144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:07.965 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.959+0000 7fcf0d616700 1 --2- 172.21.2.105:0/2014796448 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcf08144180 0x7fcf08144610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:07.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.959+0000 7fcf0d616700 1 -- 172.21.2.105:0/2014796448 >> v1:172.21.2.115:6789/0 conn(0x7fcf080aca40 legacy=0x7fcf081473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:07.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.959+0000 7fcf0d616700 1 -- 172.21.2.105:0/2014796448 --> v2:172.21.2.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf080b1a70 con 0x7fcf080ace20 2021-11-12T05:44:07.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.959+0000 7fcf0d616700 1 --2- 172.21.2.105:0/2014796448 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcf080ace20 0x7fcf080b0520 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fcefc002f70 tx=0x7fcefc006df0).ready entity=mon.1 client_cookie=4698303148a8502c server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:07.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.959+0000 7fcf0ce15700 1 -- 172.21.2.105:0/2014796448 <== mon.1 v2:172.21.2.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcefc00d570 con 0x7fcf080ace20 2021-11-12T05:44:07.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.959+0000 7fcf0ce15700 1 -- 172.21.2.105:0/2014796448 <== mon.1 v2:172.21.2.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcefc000e90 con 0x7fcf080ace20 2021-11-12T05:44:07.967 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.959+0000 7fcf0ce15700 1 -- 172.21.2.105:0/2014796448 <== mon.1 v2:172.21.2.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcefc00d8c0 con 0x7fcf080ace20 2021-11-12T05:44:07.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.959+0000 7fcf1007b700 1 -- 172.21.2.105:0/2014796448 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcf080ace20 msgr2=0x7fcf080b0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:07.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.959+0000 7fcf1007b700 1 --2- 172.21.2.105:0/2014796448 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcf080ace20 0x7fcf080b0520 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fcefc002f70 tx=0x7fcefc006df0).stop 2021-11-12T05:44:07.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.959+0000 7fcf1007b700 1 -- 172.21.2.105:0/2014796448 shutdown_connections 2021-11-12T05:44:07.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.959+0000 7fcf1007b700 1 --2- 172.21.2.105:0/2014796448 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcf08144180 0x7fcf08144610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:07.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.959+0000 7fcf1007b700 1 --2- 172.21.2.105:0/2014796448 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcf080ace20 0x7fcf080b0520 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:07.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.959+0000 7fcf1007b700 1 -- 172.21.2.105:0/2014796448 >> 172.21.2.105:0/2014796448 conn(0x7fcf0805c490 msgr2=0x7fcf080b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:07.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.959+0000 7fcf1007b700 1 -- 172.21.2.105:0/2014796448 shutdown_connections 2021-11-12T05:44:07.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.959+0000 7fcf1007b700 1 -- 172.21.2.105:0/2014796448 wait complete. 2021-11-12T05:44:07.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.959+0000 7fcf1007b700 1 Processor -- start 2021-11-12T05:44:07.972 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.959+0000 7fcf1007b700 1 -- start start 2021-11-12T05:44:07.972 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.963+0000 7fcf1007b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcf080aca40 0x7fcf08145740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:07.972 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.963+0000 7fcf1007b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcf080ace20 0x7fcf0815a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:07.972 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.963+0000 7fcf1007b700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcf08144180 0x7fcf0815a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:07.973 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.963+0000 7fcf1007b700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0815adf0 con 0x7fcf080aca40 2021-11-12T05:44:07.973 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.963+0000 7fcf1007b700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf08062860 con 0x7fcf08144180 2021-11-12T05:44:07.973 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.963+0000 7fcf1007b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf080662b0 con 0x7fcf080ace20 2021-11-12T05:44:07.973 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.963+0000 7fcf0de17700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcf080aca40 0x7fcf08145740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:07.973 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.963+0000 7fcf0de17700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcf080aca40 0x7fcf08145740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45964/0 (socket says 172.21.2.105:45964) 2021-11-12T05:44:07.974 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.963+0000 7fcf0de17700 1 -- 172.21.2.105:0/1438758208 learned_addr learned my addr 172.21.2.105:0/1438758208 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:07.974 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.963+0000 7fcf0de17700 1 -- 172.21.2.105:0/1438758208 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcf080ace20 msgr2=0x7fcf0815a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:07.974 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.963+0000 7fcf0de17700 1 --2- 172.21.2.105:0/1438758208 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcf080ace20 0x7fcf0815a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:07.974 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.963+0000 7fcf0de17700 1 -- 172.21.2.105:0/1438758208 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcf08144180 msgr2=0x7fcf0815a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:07.975 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.963+0000 7fcf0de17700 1 --2- 172.21.2.105:0/1438758208 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcf08144180 0x7fcf0815a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:07.975 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.963+0000 7fcf0de17700 1 -- 172.21.2.105:0/1438758208 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcefc00b180 con 0x7fcf080aca40 2021-11-12T05:44:07.975 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.963+0000 7fcf0de17700 1 --2- 172.21.2.105:0/1438758208 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcf080aca40 0x7fcf08145740 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7fcf08061140 tx=0x7fcf04007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:07.975 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.963+0000 7fcefaffd700 1 -- 172.21.2.105:0/1438758208 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf0400ce30 con 0x7fcf080aca40 2021-11-12T05:44:07.975 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.963+0000 7fcefaffd700 1 -- 172.21.2.105:0/1438758208 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf040072e0 con 0x7fcf080aca40 2021-11-12T05:44:07.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.963+0000 7fcf1007b700 1 -- 172.21.2.105:0/1438758208 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf08159f70 con 0x7fcf080aca40 2021-11-12T05:44:07.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.963+0000 7fcf1007b700 1 -- 172.21.2.105:0/1438758208 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf08067140 con 0x7fcf080aca40 2021-11-12T05:44:07.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.963+0000 7fcefaffd700 1 -- 172.21.2.105:0/1438758208 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf04005800 con 0x7fcf080aca40 2021-11-12T05:44:07.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.963+0000 7fcf1007b700 1 -- 172.21.2.105:0/1438758208 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf0815a100 con 0x7fcf080aca40 2021-11-12T05:44:07.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.963+0000 7fcefaffd700 1 -- 172.21.2.105:0/1438758208 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcf04010070 con 0x7fcf080aca40 2021-11-12T05:44:07.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.963+0000 7fcefaffd700 1 --2- 172.21.2.105:0/1438758208 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcee8053600 0x7fcee8055ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:07.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.963+0000 7fcefaffd700 1 -- 172.21.2.105:0/1438758208 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fcf0406b160 con 0x7fcf080aca40 2021-11-12T05:44:07.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.963+0000 7fcf0d616700 1 --2- 172.21.2.105:0/1438758208 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcee8053600 0x7fcee8055ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:07.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.963+0000 7fcf0d616700 1 --2- 172.21.2.105:0/1438758208 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcee8053600 0x7fcee8055ac0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fcefc002f70 tx=0x7fcefc014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:07.978 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:07.967+0000 7fcefaffd700 1 -- 172.21.2.105:0/1438758208 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcf04042170 con 0x7fcf080aca40 2021-11-12T05:44:08.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.051+0000 7fcf1007b700 1 -- 172.21.2.105:0/1438758208 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fcf08057350 con 0x7fcf080aca40 2021-11-12T05:44:08.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.051+0000 7fcefaffd700 1 -- 172.21.2.105:0/1438758208 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v55) v1 ==== 110+0+10 (secure 0 0 0) 0x7fcf04045790 con 0x7fcf080aca40 2021-11-12T05:44:08.056 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:44:08.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.051+0000 7fcf1007b700 1 -- 172.21.2.105:0/1438758208 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcee8053600 msgr2=0x7fcee8055ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:08.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.051+0000 7fcf1007b700 1 --2- 172.21.2.105:0/1438758208 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcee8053600 0x7fcee8055ac0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fcefc002f70 tx=0x7fcefc014000).stop 2021-11-12T05:44:08.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.051+0000 7fcf1007b700 1 -- 172.21.2.105:0/1438758208 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcf080aca40 msgr2=0x7fcf08145740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:08.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.051+0000 7fcf1007b700 1 --2- 172.21.2.105:0/1438758208 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcf080aca40 0x7fcf08145740 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7fcf08061140 tx=0x7fcf04007c40).stop 2021-11-12T05:44:08.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.051+0000 7fcf1007b700 1 -- 172.21.2.105:0/1438758208 shutdown_connections 2021-11-12T05:44:08.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.051+0000 7fcf1007b700 1 --2- 172.21.2.105:0/1438758208 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcee8053600 0x7fcee8055ac0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:08.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.051+0000 7fcf1007b700 1 --2- 172.21.2.105:0/1438758208 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcf08144180 0x7fcf0815a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:08.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.051+0000 7fcf1007b700 1 --2- 172.21.2.105:0/1438758208 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcf080ace20 0x7fcf0815a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:08.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.051+0000 7fcf1007b700 1 --2- 172.21.2.105:0/1438758208 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcf080aca40 0x7fcf08145740 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:08.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.051+0000 7fcf1007b700 1 -- 172.21.2.105:0/1438758208 >> 172.21.2.105:0/1438758208 conn(0x7fcf0805c490 msgr2=0x7fcf08147b50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:08.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.051+0000 7fcf1007b700 1 -- 172.21.2.105:0/1438758208 shutdown_connections 2021-11-12T05:44:08.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.051+0000 7fcf1007b700 1 -- 172.21.2.105:0/1438758208 wait complete. 2021-11-12T05:44:08.063 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:44:08.124 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.111+0000 7f2db165b700 1 Processor -- start 2021-11-12T05:44:08.124 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.111+0000 7f2db165b700 1 -- start start 2021-11-12T05:44:08.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.111+0000 7f2db165b700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f2dac0afc60 0x7f2dac0ae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:08.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.111+0000 7f2db165b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f2dac060d60 0x7f2dac143360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:08.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.111+0000 7f2db165b700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dac0b16c0 con 0x7f2dac066be0 2021-11-12T05:44:08.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.111+0000 7f2db165b700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dac0b18f0 con 0x7f2dac060d60 2021-11-12T05:44:08.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.111+0000 7f2db165b700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dac066fc0 con 0x7f2dac0afc60 2021-11-12T05:44:08.127 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.111+0000 7f2daaffd700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f2dac066be0 0x7f2dac0ad990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:56368/0 (socket says 172.21.2.105:56368) 2021-11-12T05:44:08.127 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.111+0000 7f2daaffd700 1 -- 172.21.2.105:0/2499661638 learned_addr learned my addr 172.21.2.105:0/2499661638 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:44:08.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.111+0000 7f2dab7fe700 1 --2- 172.21.2.105:0/2499661638 >> v2:172.21.2.105:3300/0 conn(0x7f2dac060d60 0x7f2dac143360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:08.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.111+0000 7f2dab7fe700 1 -- 172.21.2.105:0/2499661638 >> v2:172.21.2.115:3300/0 conn(0x7f2dac0afc60 msgr2=0x7f2dac0ae0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:08.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.111+0000 7f2dab7fe700 1 --2- 172.21.2.105:0/2499661638 >> v2:172.21.2.115:3300/0 conn(0x7f2dac0afc60 0x7f2dac0ae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:08.129 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.111+0000 7f2dab7fe700 1 -- 172.21.2.105:0/2499661638 >> v1:172.21.2.105:6789/0 conn(0x7f2dac066be0 legacy=0x7f2dac0ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:08.129 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.111+0000 7f2da9ffb700 1 -- 172.21.2.105:0/2499661638 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2895780826 0 0) 0x7f2dac0b16c0 con 0x7f2dac066be0 2021-11-12T05:44:08.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.111+0000 7f2dab7fe700 1 -- 172.21.2.105:0/2499661638 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dac0b0760 con 0x7f2dac060d60 2021-11-12T05:44:08.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.115+0000 7f2dab7fe700 1 --2- 172.21.2.105:0/2499661638 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2dac060d60 0x7f2dac143360 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f2da40032f0 tx=0x7f2da40091d0).ready entity=mon.0 client_cookie=cf4c91d99ac7da7f server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:08.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.115+0000 7f2da9ffb700 1 -- 172.21.2.105:0/2499661638 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2da4009ea0 con 0x7f2dac060d60 2021-11-12T05:44:08.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.115+0000 7f2da9ffb700 1 -- 172.21.2.105:0/2499661638 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da400b870 con 0x7f2dac060d60 2021-11-12T05:44:08.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.115+0000 7f2da9ffb700 1 -- 172.21.2.105:0/2499661638 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2da400b9e0 con 0x7f2dac060d60 2021-11-12T05:44:08.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.115+0000 7f2db165b700 1 -- 172.21.2.105:0/2499661638 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2dac060d60 msgr2=0x7f2dac143360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:08.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.115+0000 7f2db165b700 1 --2- 172.21.2.105:0/2499661638 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2dac060d60 0x7f2dac143360 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f2da40032f0 tx=0x7f2da40091d0).stop 2021-11-12T05:44:08.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.115+0000 7f2db165b700 1 -- 172.21.2.105:0/2499661638 shutdown_connections 2021-11-12T05:44:08.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.115+0000 7f2db165b700 1 --2- 172.21.2.105:0/2499661638 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2dac060d60 0x7f2dac143360 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:08.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.115+0000 7f2db165b700 1 --2- 172.21.2.105:0/2499661638 >> v2:172.21.2.115:3300/0 conn(0x7f2dac0afc60 0x7f2dac0ae0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:08.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.115+0000 7f2db165b700 1 -- 172.21.2.105:0/2499661638 >> 172.21.2.105:0/2499661638 conn(0x7f2dac05c490 msgr2=0x7f2dac0b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:08.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.115+0000 7f2db165b700 1 -- 172.21.2.105:0/2499661638 shutdown_connections 2021-11-12T05:44:08.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.115+0000 7f2db165b700 1 -- 172.21.2.105:0/2499661638 wait complete. 2021-11-12T05:44:08.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.115+0000 7f2db165b700 1 Processor -- start 2021-11-12T05:44:08.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.115+0000 7f2db165b700 1 -- start start 2021-11-12T05:44:08.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.115+0000 7f2db165b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2dac060d60 0x7f2dac146f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:08.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.115+0000 7f2db165b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2dac066be0 0x7f2dac152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:08.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.115+0000 7f2db165b700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2dac0afc60 0x7f2dac155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:08.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.115+0000 7f2db165b700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac152540 con 0x7f2dac060d60 2021-11-12T05:44:08.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.115+0000 7f2db165b700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac0a4e60 con 0x7f2dac0afc60 2021-11-12T05:44:08.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.115+0000 7f2db165b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac0a5100 con 0x7f2dac066be0 2021-11-12T05:44:08.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.115+0000 7f2daaffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2dac060d60 0x7f2dac146f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:08.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.115+0000 7f2daaffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2dac060d60 0x7f2dac146f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:45978/0 (socket says 172.21.2.105:45978) 2021-11-12T05:44:08.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.115+0000 7f2daaffd700 1 -- 172.21.2.105:0/54706467 learned_addr learned my addr 172.21.2.105:0/54706467 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:08.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.115+0000 7f2daaffd700 1 -- 172.21.2.105:0/54706467 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2dac066be0 msgr2=0x7f2dac152050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:08.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.115+0000 7f2daaffd700 1 --2- 172.21.2.105:0/54706467 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2dac066be0 0x7f2dac152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:08.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.115+0000 7f2daaffd700 1 -- 172.21.2.105:0/54706467 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2dac0afc60 msgr2=0x7f2dac155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:08.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.115+0000 7f2daaffd700 1 --2- 172.21.2.105:0/54706467 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2dac0afc60 0x7f2dac155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:08.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.115+0000 7f2daaffd700 1 -- 172.21.2.105:0/54706467 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da4009470 con 0x7f2dac060d60 2021-11-12T05:44:08.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.115+0000 7f2daaffd700 1 --2- 172.21.2.105:0/54706467 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2dac060d60 0x7f2dac146f80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f2d94000ed0 tx=0x7f2d94007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:08.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.115+0000 7f2da3fff700 1 -- 172.21.2.105:0/54706467 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d9400ce50 con 0x7f2dac060d60 2021-11-12T05:44:08.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.115+0000 7f2da3fff700 1 -- 172.21.2.105:0/54706467 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d940072e0 con 0x7f2dac060d60 2021-11-12T05:44:08.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.115+0000 7f2db165b700 1 -- 172.21.2.105:0/54706467 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dac155650 con 0x7f2dac060d60 2021-11-12T05:44:08.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.115+0000 7f2da3fff700 1 -- 172.21.2.105:0/54706467 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d94005610 con 0x7f2dac060d60 2021-11-12T05:44:08.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.115+0000 7f2db165b700 1 -- 172.21.2.105:0/54706467 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dac0a0920 con 0x7f2dac060d60 2021-11-12T05:44:08.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.115+0000 7f2db165b700 1 -- 172.21.2.105:0/54706467 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dac0a1020 con 0x7f2dac060d60 2021-11-12T05:44:08.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.115+0000 7f2da3fff700 1 -- 172.21.2.105:0/54706467 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2d9401a060 con 0x7f2dac060d60 2021-11-12T05:44:08.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.115+0000 7f2da3fff700 1 --2- 172.21.2.105:0/54706467 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2d90053610 0x7f2d90055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:08.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.119+0000 7f2da3fff700 1 -- 172.21.2.105:0/54706467 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f2d9406b3d0 con 0x7f2dac060d60 2021-11-12T05:44:08.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.119+0000 7f2daa7fc700 1 --2- 172.21.2.105:0/54706467 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2d90053610 0x7f2d90055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:08.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.119+0000 7f2daa7fc700 1 --2- 172.21.2.105:0/54706467 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2d90053610 0x7f2d90055ad0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f2d9c002f70 tx=0x7f2d9c0069e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:08.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.119+0000 7f2da3fff700 1 -- 172.21.2.105:0/54706467 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2dac0a1020 con 0x7f2dac060d60 2021-11-12T05:44:08.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.199+0000 7f2db165b700 1 -- 172.21.2.105:0/54706467 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2dac0a1020 con 0x7f2dac060d60 2021-11-12T05:44:08.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.199+0000 7f2da3fff700 1 -- 172.21.2.105:0/54706467 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v55) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2dac0a1020 con 0x7f2dac060d60 2021-11-12T05:44:08.207 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:44:08.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.203+0000 7f2db165b700 1 -- 172.21.2.105:0/54706467 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2d90053610 msgr2=0x7f2d90055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:08.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.203+0000 7f2db165b700 1 --2- 172.21.2.105:0/54706467 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2d90053610 0x7f2d90055ad0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f2d9c002f70 tx=0x7f2d9c0069e0).stop 2021-11-12T05:44:08.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.203+0000 7f2db165b700 1 -- 172.21.2.105:0/54706467 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2dac060d60 msgr2=0x7f2dac146f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:08.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.203+0000 7f2db165b700 1 --2- 172.21.2.105:0/54706467 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2dac060d60 0x7f2dac146f80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f2d94000ed0 tx=0x7f2d94007ac0).stop 2021-11-12T05:44:08.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.203+0000 7f2db165b700 1 -- 172.21.2.105:0/54706467 shutdown_connections 2021-11-12T05:44:08.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.203+0000 7f2db165b700 1 --2- 172.21.2.105:0/54706467 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2d90053610 0x7f2d90055ad0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:08.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.203+0000 7f2db165b700 1 --2- 172.21.2.105:0/54706467 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2dac0afc60 0x7f2dac155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:08.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.203+0000 7f2db165b700 1 --2- 172.21.2.105:0/54706467 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2dac066be0 0x7f2dac152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:08.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.203+0000 7f2db165b700 1 --2- 172.21.2.105:0/54706467 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2dac060d60 0x7f2dac146f80 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:08.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.203+0000 7f2db165b700 1 -- 172.21.2.105:0/54706467 >> 172.21.2.105:0/54706467 conn(0x7f2dac05c490 msgr2=0x7f2dac060040 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:08.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.203+0000 7f2db165b700 1 -- 172.21.2.105:0/54706467 shutdown_connections 2021-11-12T05:44:08.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.203+0000 7f2db165b700 1 -- 172.21.2.105:0/54706467 wait complete. 2021-11-12T05:44:08.216 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-12T05:44:08.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.263+0000 7f5494924700 1 Processor -- start 2021-11-12T05:44:08.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.263+0000 7f5494924700 1 -- start start 2021-11-12T05:44:08.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f5494924700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f54900b0e60 0x7f54900ac270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:08.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f5494924700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f54900aa700 0x7f54900ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:08.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f5494924700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54900b20b0 con 0x7f54900b1cd0 2021-11-12T05:44:08.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f5494924700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54900b2870 con 0x7f54900aa700 2021-11-12T05:44:08.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f5494924700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54900b13e0 con 0x7f54900b0e60 2021-11-12T05:44:08.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548e59c700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f54900b1cd0 0x7f54900abb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:56382/0 (socket says 172.21.2.105:56382) 2021-11-12T05:44:08.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548e59c700 1 -- 172.21.2.105:0/2178376967 learned_addr learned my addr 172.21.2.105:0/2178376967 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:44:08.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548d59a700 1 -- 172.21.2.105:0/2178376967 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 918493938 0 0) 0x7f54900b20b0 con 0x7f54900b1cd0 2021-11-12T05:44:08.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548d59a700 1 -- 172.21.2.105:0/2178376967 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5470003260 con 0x7f54900b1cd0 2021-11-12T05:44:08.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548ed9d700 1 --2- 172.21.2.105:0/2178376967 >> v2:172.21.2.115:3300/0 conn(0x7f54900aa700 0x7f54900ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:08.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548d59a700 1 -- 172.21.2.105:0/2178376967 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4095409600 0 0) 0x7f5470003260 con 0x7f54900b1cd0 2021-11-12T05:44:08.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548dd9b700 1 --2- 172.21.2.105:0/2178376967 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f54900b0e60 0x7f54900ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:08.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548d59a700 1 -- 172.21.2.105:0/2178376967 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f54900b0e60 msgr2=0x7f54900ac270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:08.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548d59a700 1 --2- 172.21.2.105:0/2178376967 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f54900b0e60 0x7f54900ac270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:08.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548d59a700 1 -- 172.21.2.105:0/2178376967 >> v2:172.21.2.115:3300/0 conn(0x7f54900aa700 msgr2=0x7f54900ad2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:08.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548d59a700 1 --2- 172.21.2.105:0/2178376967 >> v2:172.21.2.115:3300/0 conn(0x7f54900aa700 0x7f54900ad2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:08.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548d59a700 1 -- 172.21.2.105:0/2178376967 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54900ace10 con 0x7f54900b1cd0 2021-11-12T05:44:08.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548d59a700 1 -- 172.21.2.105:0/2178376967 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f5478001660 con 0x7f54900b1cd0 2021-11-12T05:44:08.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548d59a700 1 -- 172.21.2.105:0/2178376967 >> v1:172.21.2.105:6789/0 conn(0x7f54900b1cd0 legacy=0x7f54900abb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:08.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548d59a700 1 --2- 172.21.2.105:0/2178376967 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f54700037d0 0x7f5470003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:08.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548d59a700 1 --2- 172.21.2.105:0/2178376967 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5470004500 0x7f5470004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:08.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548d59a700 1 --2- 172.21.2.105:0/2178376967 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5470005070 0x7f547000d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:08.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548d59a700 1 -- 172.21.2.105:0/2178376967 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54900b13e0 con 0x7f5470005070 2021-11-12T05:44:08.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548d59a700 1 -- 172.21.2.105:0/2178376967 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547000e090 con 0x7f54700037d0 2021-11-12T05:44:08.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548d59a700 1 -- 172.21.2.105:0/2178376967 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f547000e250 con 0x7f5470004500 2021-11-12T05:44:08.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548ed9d700 1 --2- 172.21.2.105:0/2178376967 >> v2:172.21.2.115:3300/0 conn(0x7f54900aa700 0x7f54900ad2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:44:08.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548dd9b700 1 --2- 172.21.2.105:0/2178376967 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f54900b0e60 0x7f54900ac270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:44:08.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548ed9d700 1 --2- 172.21.2.105:0/2178376967 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5470005070 0x7f547000d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:08.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548ed9d700 1 -- 172.21.2.105:0/2178376967 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5470004500 msgr2=0x7f5470004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:08.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548ed9d700 1 --2- 172.21.2.105:0/2178376967 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5470004500 0x7f5470004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:08.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548ed9d700 1 -- 172.21.2.105:0/2178376967 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f54700037d0 msgr2=0x7f5470003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:08.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548ed9d700 1 --2- 172.21.2.105:0/2178376967 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f54700037d0 0x7f5470003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:08.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548ed9d700 1 -- 172.21.2.105:0/2178376967 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5470003260 con 0x7f5470005070 2021-11-12T05:44:08.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548ed9d700 1 --2- 172.21.2.105:0/2178376967 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5470005070 0x7f547000d960 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f5488007000 tx=0x7f5488008040).ready entity=mon.0 client_cookie=b021de84beaae1a8 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:08.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548d59a700 1 -- 172.21.2.105:0/2178376967 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f548800c710 con 0x7f5470005070 2021-11-12T05:44:08.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548d59a700 1 -- 172.21.2.105:0/2178376967 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548800c870 con 0x7f5470005070 2021-11-12T05:44:08.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548d59a700 1 -- 172.21.2.105:0/2178376967 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f548800c9e0 con 0x7f5470005070 2021-11-12T05:44:08.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f5494924700 1 -- 172.21.2.105:0/2178376967 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5470005070 msgr2=0x7f547000d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:08.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f5494924700 1 --2- 172.21.2.105:0/2178376967 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5470005070 0x7f547000d960 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f5488007000 tx=0x7f5488008040).stop 2021-11-12T05:44:08.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548ed9d700 1 -- 172.21.2.105:0/2178376967 reap_dead start 2021-11-12T05:44:08.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f5494924700 1 -- 172.21.2.105:0/2178376967 shutdown_connections 2021-11-12T05:44:08.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f5494924700 1 -- 172.21.2.105:0/2178376967 >> 172.21.2.105:0/2178376967 conn(0x7f5490063610 msgr2=0x7f54900639f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:08.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f5494924700 1 -- 172.21.2.105:0/2178376967 shutdown_connections 2021-11-12T05:44:08.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f5494924700 1 -- 172.21.2.105:0/2178376967 wait complete. 2021-11-12T05:44:08.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f5494924700 1 Processor -- start 2021-11-12T05:44:08.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f5494924700 1 -- start start 2021-11-12T05:44:08.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f5494924700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5470005070 0x7f5490064960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:08.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f5494924700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f54900662d0 0x7f549014efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:08.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f5494924700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5490065400 0x7f54900ad830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:08.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f5494924700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5490065120 con 0x7f54900662d0 2021-11-12T05:44:08.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f5494924700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549013e440 con 0x7f5470005070 2021-11-12T05:44:08.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f5494924700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f549014e320 con 0x7f5490065400 2021-11-12T05:44:08.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548dd9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f54900662d0 0x7f549014efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:08.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548dd9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f54900662d0 0x7f549014efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46002/0 (socket says 172.21.2.105:46002) 2021-11-12T05:44:08.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548dd9b700 1 -- 172.21.2.105:0/931577890 learned_addr learned my addr 172.21.2.105:0/931577890 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:08.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548dd9b700 1 -- 172.21.2.105:0/931577890 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5490065400 msgr2=0x7f54900ad830 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:44:08.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548dd9b700 1 --2- 172.21.2.105:0/931577890 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5490065400 0x7f54900ad830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:08.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548dd9b700 1 -- 172.21.2.105:0/931577890 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5470005070 msgr2=0x7f5490064960 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:44:08.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548dd9b700 1 --2- 172.21.2.105:0/931577890 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5470005070 0x7f5490064960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:08.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548dd9b700 1 -- 172.21.2.105:0/931577890 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549014e5c0 con 0x7f54900662d0 2021-11-12T05:44:08.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.267+0000 7f548dd9b700 1 --2- 172.21.2.105:0/931577890 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f54900662d0 0x7f549014efa0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f5480007000 tx=0x7f5480008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:08.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.271+0000 7f54877fe700 1 -- 172.21.2.105:0/931577890 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f548000f4e0 con 0x7f54900662d0 2021-11-12T05:44:08.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.271+0000 7f54877fe700 1 -- 172.21.2.105:0/931577890 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5480000e90 con 0x7f54900662d0 2021-11-12T05:44:08.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.271+0000 7f54877fe700 1 -- 172.21.2.105:0/931577890 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f548000f830 con 0x7f54900662d0 2021-11-12T05:44:08.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.271+0000 7f5494924700 1 -- 172.21.2.105:0/931577890 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f549014e860 con 0x7f54900662d0 2021-11-12T05:44:08.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.271+0000 7f5494924700 1 -- 172.21.2.105:0/931577890 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f549014f490 con 0x7f54900662d0 2021-11-12T05:44:08.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.271+0000 7f5494924700 1 -- 172.21.2.105:0/931577890 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54900acb50 con 0x7f54900662d0 2021-11-12T05:44:08.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.271+0000 7f54877fe700 1 -- 172.21.2.105:0/931577890 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f548000f990 con 0x7f54900662d0 2021-11-12T05:44:08.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.271+0000 7f54877fe700 1 --2- 172.21.2.105:0/931577890 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5474053690 0x7f5474055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:08.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.271+0000 7f54877fe700 1 -- 172.21.2.105:0/931577890 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f548006b540 con 0x7f54900662d0 2021-11-12T05:44:08.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.271+0000 7f548e59c700 1 --2- 172.21.2.105:0/931577890 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5474053690 0x7f5474055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:08.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.271+0000 7f548e59c700 1 --2- 172.21.2.105:0/931577890 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5474053690 0x7f5474055b50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f5478001370 tx=0x7f5478001570).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:08.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.271+0000 7f54877fe700 1 -- 172.21.2.105:0/931577890 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5480042550 con 0x7f54900662d0 2021-11-12T05:44:08.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.355+0000 7f5494924700 1 -- 172.21.2.105:0/931577890 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5490057350 con 0x7f54900662d0 2021-11-12T05:44:08.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.355+0000 7f54877fe700 1 -- 172.21.2.105:0/931577890 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v55) v1 ==== 104+0+10 (secure 0 0 0) 0x7f5480045b70 con 0x7f54900662d0 2021-11-12T05:44:08.362 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:44:08.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.359+0000 7f5494924700 1 -- 172.21.2.105:0/931577890 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5474053690 msgr2=0x7f5474055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:08.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.359+0000 7f5494924700 1 --2- 172.21.2.105:0/931577890 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5474053690 0x7f5474055b50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f5478001370 tx=0x7f5478001570).stop 2021-11-12T05:44:08.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.359+0000 7f5494924700 1 -- 172.21.2.105:0/931577890 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f54900662d0 msgr2=0x7f549014efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:08.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.359+0000 7f5494924700 1 --2- 172.21.2.105:0/931577890 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f54900662d0 0x7f549014efa0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f5480007000 tx=0x7f5480008040).stop 2021-11-12T05:44:08.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.359+0000 7f5494924700 1 -- 172.21.2.105:0/931577890 shutdown_connections 2021-11-12T05:44:08.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.359+0000 7f5494924700 1 --2- 172.21.2.105:0/931577890 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5474053690 0x7f5474055b50 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:08.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.359+0000 7f5494924700 1 --2- 172.21.2.105:0/931577890 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5490065400 0x7f54900ad830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:08.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.359+0000 7f5494924700 1 --2- 172.21.2.105:0/931577890 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f54900662d0 0x7f549014efa0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:08.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.359+0000 7f5494924700 1 --2- 172.21.2.105:0/931577890 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5470005070 0x7f5490064960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:08.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.359+0000 7f5494924700 1 -- 172.21.2.105:0/931577890 >> 172.21.2.105:0/931577890 conn(0x7f5490063610 msgr2=0x7f549013e910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:08.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.359+0000 7f5494924700 1 -- 172.21.2.105:0/931577890 shutdown_connections 2021-11-12T05:44:08.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.359+0000 7f5494924700 1 -- 172.21.2.105:0/931577890 wait complete. 2021-11-12T05:44:08.370 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-12T05:44:08.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.419+0000 7fd6dd824700 1 Processor -- start 2021-11-12T05:44:08.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.419+0000 7fd6dd824700 1 -- start start 2021-11-12T05:44:08.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.419+0000 7fd6dd824700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd6d80aca40 0x7fd6d80ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:08.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.419+0000 7fd6dd824700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d80b1840 con 0x7fd6d8144180 2021-11-12T05:44:08.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.419+0000 7fd6dd824700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d80b09d0 con 0x7fd6d80b0520 2021-11-12T05:44:08.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.419+0000 7fd6dd824700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d80af2b0 con 0x7fd6d80aca40 2021-11-12T05:44:08.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.419+0000 7fd6d6ffd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd6d80aca40 0x7fd6d80ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:08.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.419+0000 7fd6d77fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fd6d8144180 0x7fd6d81445f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:56402/0 (socket says 172.21.2.105:56402) 2021-11-12T05:44:08.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.419+0000 7fd6d77fe700 1 -- 172.21.2.105:0/3335082214 learned_addr learned my addr 172.21.2.105:0/3335082214 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:44:08.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.419+0000 7fd6d6ffd700 1 -- 172.21.2.105:0/3335082214 >> v1:172.21.2.115:6789/0 conn(0x7fd6d80b0520 legacy=0x7fd6d81473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:08.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.419+0000 7fd6d6ffd700 1 -- 172.21.2.105:0/3335082214 >> v1:172.21.2.105:6789/0 conn(0x7fd6d8144180 legacy=0x7fd6d81445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:08.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.419+0000 7fd6d6ffd700 1 -- 172.21.2.105:0/3335082214 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d80b1a70 con 0x7fd6d80aca40 2021-11-12T05:44:08.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.419+0000 7fd6d6ffd700 1 --2- 172.21.2.105:0/3335082214 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6d80aca40 0x7fd6d80ace20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7fd6d80611e0 tx=0x7fd6cc006df0).ready entity=mon.0 client_cookie=2b8c58c2e7fe2156 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:08.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.419+0000 7fd6d5ffb700 1 -- 172.21.2.105:0/3335082214 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6cc00d5c0 con 0x7fd6d80aca40 2021-11-12T05:44:08.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.419+0000 7fd6d5ffb700 1 -- 172.21.2.105:0/3335082214 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6cc000e90 con 0x7fd6d80aca40 2021-11-12T05:44:08.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.419+0000 7fd6d5ffb700 1 -- 172.21.2.105:0/3335082214 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6cc00d910 con 0x7fd6d80aca40 2021-11-12T05:44:08.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.419+0000 7fd6dd824700 1 -- 172.21.2.105:0/3335082214 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6d80aca40 msgr2=0x7fd6d80ace20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:08.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.419+0000 7fd6dd824700 1 --2- 172.21.2.105:0/3335082214 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6d80aca40 0x7fd6d80ace20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7fd6d80611e0 tx=0x7fd6cc006df0).stop 2021-11-12T05:44:08.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.419+0000 7fd6dd824700 1 -- 172.21.2.105:0/3335082214 shutdown_connections 2021-11-12T05:44:08.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.419+0000 7fd6dd824700 1 --2- 172.21.2.105:0/3335082214 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6d80aca40 0x7fd6d80ace20 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:08.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.419+0000 7fd6dd824700 1 -- 172.21.2.105:0/3335082214 >> 172.21.2.105:0/3335082214 conn(0x7fd6d805c490 msgr2=0x7fd6d80b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:08.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.419+0000 7fd6dd824700 1 -- 172.21.2.105:0/3335082214 shutdown_connections 2021-11-12T05:44:08.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.419+0000 7fd6dd824700 1 -- 172.21.2.105:0/3335082214 wait complete. 2021-11-12T05:44:08.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.419+0000 7fd6dd824700 1 Processor -- start 2021-11-12T05:44:08.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.419+0000 7fd6dd824700 1 -- start start 2021-11-12T05:44:08.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.419+0000 7fd6dd824700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6d80aca40 0x7fd6d8147550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:08.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.419+0000 7fd6dd824700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6d80b0520 0x7fd6d80a9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:08.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.419+0000 7fd6dd824700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd6d8144180 0x7fd6d80a7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:08.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.419+0000 7fd6dd824700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d8142300 con 0x7fd6d80b0520 2021-11-12T05:44:08.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.419+0000 7fd6dd824700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d8157710 con 0x7fd6d8144180 2021-11-12T05:44:08.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.419+0000 7fd6dd824700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d80a70c0 con 0x7fd6d80aca40 2021-11-12T05:44:08.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.419+0000 7fd6d67fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6d80b0520 0x7fd6d80a9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:08.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.419+0000 7fd6d67fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6d80b0520 0x7fd6d80a9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46014/0 (socket says 172.21.2.105:46014) 2021-11-12T05:44:08.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.419+0000 7fd6d67fc700 1 -- 172.21.2.105:0/2888760896 learned_addr learned my addr 172.21.2.105:0/2888760896 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:08.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.423+0000 7fd6d67fc700 1 -- 172.21.2.105:0/2888760896 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6d80aca40 msgr2=0x7fd6d8147550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:08.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.423+0000 7fd6d67fc700 1 --2- 172.21.2.105:0/2888760896 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6d80aca40 0x7fd6d8147550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:08.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.423+0000 7fd6d67fc700 1 -- 172.21.2.105:0/2888760896 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd6d8144180 msgr2=0x7fd6d80a7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:08.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.423+0000 7fd6d67fc700 1 --2- 172.21.2.105:0/2888760896 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd6d8144180 0x7fd6d80a7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:08.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.423+0000 7fd6d67fc700 1 -- 172.21.2.105:0/2888760896 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6cc00b180 con 0x7fd6d80b0520 2021-11-12T05:44:08.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.423+0000 7fd6d67fc700 1 --2- 172.21.2.105:0/2888760896 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6d80b0520 0x7fd6d80a9770 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7fd6c8002f90 tx=0x7fd6c8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:08.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.423+0000 7fd6c7fff700 1 -- 172.21.2.105:0/2888760896 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6c8013460 con 0x7fd6d80b0520 2021-11-12T05:44:08.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.423+0000 7fd6c7fff700 1 -- 172.21.2.105:0/2888760896 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c80135c0 con 0x7fd6d80b0520 2021-11-12T05:44:08.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.423+0000 7fd6dd824700 1 -- 172.21.2.105:0/2888760896 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d80a7360 con 0x7fd6d80b0520 2021-11-12T05:44:08.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.423+0000 7fd6dd824700 1 -- 172.21.2.105:0/2888760896 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d80a8d10 con 0x7fd6d80b0520 2021-11-12T05:44:08.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.423+0000 7fd6c7fff700 1 -- 172.21.2.105:0/2888760896 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6c8013920 con 0x7fd6d80b0520 2021-11-12T05:44:08.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.423+0000 7fd6dd824700 1 -- 172.21.2.105:0/2888760896 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d80a74f0 con 0x7fd6d80b0520 2021-11-12T05:44:08.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.423+0000 7fd6c7fff700 1 -- 172.21.2.105:0/2888760896 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd6c801a060 con 0x7fd6d80b0520 2021-11-12T05:44:08.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.423+0000 7fd6c7fff700 1 --2- 172.21.2.105:0/2888760896 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd6b4053660 0x7fd6b4055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:08.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.423+0000 7fd6c7fff700 1 -- 172.21.2.105:0/2888760896 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fd6c806b4b0 con 0x7fd6d80b0520 2021-11-12T05:44:08.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.423+0000 7fd6d6ffd700 1 --2- 172.21.2.105:0/2888760896 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd6b4053660 0x7fd6b4055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:08.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.423+0000 7fd6d6ffd700 1 --2- 172.21.2.105:0/2888760896 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd6b4053660 0x7fd6b4055b20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fd6d80611e0 tx=0x7fd6cc012000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:08.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.427+0000 7fd6c7fff700 1 -- 172.21.2.105:0/2888760896 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd6c80423b0 con 0x7fd6d80b0520 2021-11-12T05:44:08.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.507+0000 7fd6dd824700 1 -- 172.21.2.105:0/2888760896 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd6d805f280 con 0x7fd6d80b0520 2021-11-12T05:44:08.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.507+0000 7fd6c7fff700 1 -- 172.21.2.105:0/2888760896 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v55) v1 ==== 100+0+10 (secure 0 0 0) 0x7fd6c80459d0 con 0x7fd6d80b0520 2021-11-12T05:44:08.513 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:44:08.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.507+0000 7fd6dd824700 1 -- 172.21.2.105:0/2888760896 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd6b4053660 msgr2=0x7fd6b4055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:08.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.507+0000 7fd6dd824700 1 --2- 172.21.2.105:0/2888760896 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd6b4053660 0x7fd6b4055b20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fd6d80611e0 tx=0x7fd6cc012000).stop 2021-11-12T05:44:08.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.507+0000 7fd6dd824700 1 -- 172.21.2.105:0/2888760896 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6d80b0520 msgr2=0x7fd6d80a9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:08.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.507+0000 7fd6dd824700 1 --2- 172.21.2.105:0/2888760896 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6d80b0520 0x7fd6d80a9770 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7fd6c8002f90 tx=0x7fd6c8006df0).stop 2021-11-12T05:44:08.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.507+0000 7fd6dd824700 1 -- 172.21.2.105:0/2888760896 shutdown_connections 2021-11-12T05:44:08.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.507+0000 7fd6dd824700 1 --2- 172.21.2.105:0/2888760896 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd6b4053660 0x7fd6b4055b20 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:08.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.507+0000 7fd6dd824700 1 --2- 172.21.2.105:0/2888760896 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd6d8144180 0x7fd6d80a7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:08.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.507+0000 7fd6dd824700 1 --2- 172.21.2.105:0/2888760896 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6d80b0520 0x7fd6d80a9770 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:08.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.507+0000 7fd6dd824700 1 --2- 172.21.2.105:0/2888760896 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6d80aca40 0x7fd6d8147550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:08.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.507+0000 7fd6dd824700 1 -- 172.21.2.105:0/2888760896 >> 172.21.2.105:0/2888760896 conn(0x7fd6d805c490 msgr2=0x7fd6d8142c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:08.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.507+0000 7fd6dd824700 1 -- 172.21.2.105:0/2888760896 shutdown_connections 2021-11-12T05:44:08.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.507+0000 7fd6dd824700 1 -- 172.21.2.105:0/2888760896 wait complete. 2021-11-12T05:44:08.520 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-12T05:44:08.521 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:44:08.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.567+0000 7f6a9c639700 1 Processor -- start 2021-11-12T05:44:08.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.567+0000 7f6a9c639700 1 -- start start 2021-11-12T05:44:08.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.567+0000 7f6a9c639700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f6a940ade80 0x7f6a940601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:08.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.567+0000 7f6a9c639700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f6a9413a9c0 0x7f6a9413ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:08.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.567+0000 7f6a9c639700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a94066150 con 0x7f6a9405fdc0 2021-11-12T05:44:08.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.567+0000 7f6a9c639700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a94141fb0 con 0x7f6a940ade80 2021-11-12T05:44:08.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.567+0000 7f6a9c639700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a940663f0 con 0x7f6a9413a9c0 2021-11-12T05:44:08.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.567+0000 7f6a99bd4700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f6a940ade80 0x7f6a940601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:08.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.567+0000 7f6a99bd4700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f6a940ade80 0x7f6a940601a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46024/0 (socket says 172.21.2.105:46024) 2021-11-12T05:44:08.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.567+0000 7f6a99bd4700 1 -- 172.21.2.105:0/4216596343 learned_addr learned my addr 172.21.2.105:0/4216596343 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:08.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.567+0000 7f6a99bd4700 1 -- 172.21.2.105:0/4216596343 >> v2:172.21.2.115:3300/0 conn(0x7f6a9413a9c0 msgr2=0x7f6a9413ae20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:44:08.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.567+0000 7f6a99bd4700 1 --2- 172.21.2.105:0/4216596343 >> v2:172.21.2.115:3300/0 conn(0x7f6a9413a9c0 0x7f6a9413ae20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:08.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.567+0000 7f6a99bd4700 1 -- 172.21.2.105:0/4216596343 >> v1:172.21.2.115:6789/0 conn(0x7f6a9405fdc0 legacy=0x7f6a94066730 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:44:08.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.567+0000 7f6a99bd4700 1 -- 172.21.2.105:0/4216596343 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a94140fd0 con 0x7f6a940ade80 2021-11-12T05:44:08.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.567+0000 7f6a99bd4700 1 --2- 172.21.2.105:0/4216596343 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6a940ade80 0x7f6a940601a0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f6a94060e00 tx=0x7f6a84006eb0).ready entity=mon.0 client_cookie=adb7d02ec6acb852 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:08.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.567+0000 7f6a993d3700 1 -- 172.21.2.105:0/4216596343 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a8400d5c0 con 0x7f6a940ade80 2021-11-12T05:44:08.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.567+0000 7f6a993d3700 1 -- 172.21.2.105:0/4216596343 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a84000e90 con 0x7f6a940ade80 2021-11-12T05:44:08.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.567+0000 7f6a993d3700 1 -- 172.21.2.105:0/4216596343 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a8400d910 con 0x7f6a940ade80 2021-11-12T05:44:08.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.567+0000 7f6a9c639700 1 -- 172.21.2.105:0/4216596343 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6a940ade80 msgr2=0x7f6a940601a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:08.586 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.567+0000 7f6a9c639700 1 --2- 172.21.2.105:0/4216596343 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6a940ade80 0x7f6a940601a0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f6a94060e00 tx=0x7f6a84006eb0).stop 2021-11-12T05:44:08.586 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.567+0000 7f6a9c639700 1 -- 172.21.2.105:0/4216596343 shutdown_connections 2021-11-12T05:44:08.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.567+0000 7f6a9c639700 1 --2- 172.21.2.105:0/4216596343 >> v2:172.21.2.115:3300/0 conn(0x7f6a9413a9c0 0x7f6a9413ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:08.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.567+0000 7f6a9c639700 1 --2- 172.21.2.105:0/4216596343 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6a940ade80 0x7f6a940601a0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:08.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.567+0000 7f6a9c639700 1 -- 172.21.2.105:0/4216596343 >> 172.21.2.105:0/4216596343 conn(0x7f6a940608d0 msgr2=0x7f6a9405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:08.588 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.567+0000 7f6a9c639700 1 -- 172.21.2.105:0/4216596343 shutdown_connections 2021-11-12T05:44:08.588 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.567+0000 7f6a9c639700 1 -- 172.21.2.105:0/4216596343 wait complete. 2021-11-12T05:44:08.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.571+0000 7f6a9c639700 1 Processor -- start 2021-11-12T05:44:08.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.571+0000 7f6a9c639700 1 -- start start 2021-11-12T05:44:08.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.571+0000 7f6a9c639700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6a9405fdc0 0x7f6a940b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:08.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.571+0000 7f6a9c639700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6a940ade80 0x7f6a940b58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:08.590 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.571+0000 7f6a9c639700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6a9413a9c0 0x7f6a940b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:08.590 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.571+0000 7f6a9c639700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a94143640 con 0x7f6a9413a9c0 2021-11-12T05:44:08.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.571+0000 7f6a9c639700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9413ae00 con 0x7f6a9405fdc0 2021-11-12T05:44:08.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.571+0000 7f6a9c639700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a94144000 con 0x7f6a940ade80 2021-11-12T05:44:08.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.571+0000 7f6a9abd6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6a9413a9c0 0x7f6a940b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:08.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.571+0000 7f6a9abd6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6a9413a9c0 0x7f6a940b5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46028/0 (socket says 172.21.2.105:46028) 2021-11-12T05:44:08.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.571+0000 7f6a9abd6700 1 -- 172.21.2.105:0/2639748506 learned_addr learned my addr 172.21.2.105:0/2639748506 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:08.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.571+0000 7f6a9abd6700 1 -- 172.21.2.105:0/2639748506 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6a940ade80 msgr2=0x7f6a940b58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:08.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.571+0000 7f6a9abd6700 1 --2- 172.21.2.105:0/2639748506 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6a940ade80 0x7f6a940b58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:08.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.571+0000 7f6a9abd6700 1 -- 172.21.2.105:0/2639748506 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6a9405fdc0 msgr2=0x7f6a940b0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:08.594 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.571+0000 7f6a9abd6700 1 --2- 172.21.2.105:0/2639748506 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6a9405fdc0 0x7f6a940b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:08.594 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.571+0000 7f6a9abd6700 1 -- 172.21.2.105:0/2639748506 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a8400b1e0 con 0x7f6a9413a9c0 2021-11-12T05:44:08.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.571+0000 7f6a9abd6700 1 --2- 172.21.2.105:0/2639748506 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6a9413a9c0 0x7f6a940b5dd0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f6a940b6bf0 tx=0x7f6a8c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:08.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.571+0000 7f6a837fe700 1 -- 172.21.2.105:0/2639748506 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a8c0014e0 con 0x7f6a9413a9c0 2021-11-12T05:44:08.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.571+0000 7f6a837fe700 1 -- 172.21.2.105:0/2639748506 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8c001640 con 0x7f6a9413a9c0 2021-11-12T05:44:08.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.571+0000 7f6a837fe700 1 -- 172.21.2.105:0/2639748506 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a8c0019a0 con 0x7f6a9413a9c0 2021-11-12T05:44:08.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.571+0000 7f6a9c639700 1 -- 172.21.2.105:0/2639748506 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a94144230 con 0x7f6a9413a9c0 2021-11-12T05:44:08.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.571+0000 7f6a9c639700 1 -- 172.21.2.105:0/2639748506 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a94133e30 con 0x7f6a9413a9c0 2021-11-12T05:44:08.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.571+0000 7f6a9c639700 1 -- 172.21.2.105:0/2639748506 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a94144c50 con 0x7f6a9413a9c0 2021-11-12T05:44:08.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.571+0000 7f6a837fe700 1 -- 172.21.2.105:0/2639748506 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6a8c018030 con 0x7f6a9413a9c0 2021-11-12T05:44:08.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.571+0000 7f6a837fe700 1 --2- 172.21.2.105:0/2639748506 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6a74053610 0x7f6a74055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:08.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.571+0000 7f6a837fe700 1 -- 172.21.2.105:0/2639748506 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f6a8c06b4b0 con 0x7f6a9413a9c0 2021-11-12T05:44:08.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.571+0000 7f6a9a3d5700 1 --2- 172.21.2.105:0/2639748506 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6a74053610 0x7f6a74055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:08.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.571+0000 7f6a9a3d5700 1 --2- 172.21.2.105:0/2639748506 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6a74053610 0x7f6a74055ad0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f6a90002fb0 tx=0x7f6a900069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:08.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.575+0000 7f6a837fe700 1 -- 172.21.2.105:0/2639748506 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6a94144c50 con 0x7f6a9413a9c0 2021-11-12T05:44:08.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.683+0000 7f6a9c639700 1 -- 172.21.2.105:0/2639748506 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a94144c50 con 0x7f6a9413a9c0 2021-11-12T05:44:08.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.683+0000 7f6a837fe700 1 -- 172.21.2.105:0/2639748506 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f6a94144c50 con 0x7f6a9413a9c0 2021-11-12T05:44:08.688 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:44:08.688 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":20,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4478,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/1513907466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":1513907466},{"type":"v1","addr":"172.21.2.115:6833","nonce":1513907466}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":18}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:44:05.340503+0000","modified":"2021-11-12T05:44:06.343650+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5610":{"gid":5610,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/351884283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":351884283},{"type":"v1","addr":"172.21.2.105:6835","nonce":351884283}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-11-12T05:44:08.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.683+0000 7f6a9c639700 1 -- 172.21.2.105:0/2639748506 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6a74053610 msgr2=0x7f6a74055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:08.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.683+0000 7f6a9c639700 1 --2- 172.21.2.105:0/2639748506 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6a74053610 0x7f6a74055ad0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f6a90002fb0 tx=0x7f6a900069b0).stop 2021-11-12T05:44:08.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.683+0000 7f6a9c639700 1 -- 172.21.2.105:0/2639748506 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6a9413a9c0 msgr2=0x7f6a940b5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:08.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.683+0000 7f6a9c639700 1 --2- 172.21.2.105:0/2639748506 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6a9413a9c0 0x7f6a940b5dd0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f6a940b6bf0 tx=0x7f6a8c0090f0).stop 2021-11-12T05:44:08.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.683+0000 7f6a9c639700 1 -- 172.21.2.105:0/2639748506 shutdown_connections 2021-11-12T05:44:08.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.683+0000 7f6a9c639700 1 --2- 172.21.2.105:0/2639748506 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6a74053610 0x7f6a74055ad0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:08.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.683+0000 7f6a9c639700 1 --2- 172.21.2.105:0/2639748506 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6a9413a9c0 0x7f6a940b5dd0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:08.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.683+0000 7f6a9c639700 1 --2- 172.21.2.105:0/2639748506 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6a940ade80 0x7f6a940b58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:08.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.683+0000 7f6a9c639700 1 --2- 172.21.2.105:0/2639748506 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6a9405fdc0 0x7f6a940b0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:08.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.683+0000 7f6a9c639700 1 -- 172.21.2.105:0/2639748506 >> 172.21.2.105:0/2639748506 conn(0x7f6a940608d0 msgr2=0x7f6a940b38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:08.692 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.683+0000 7f6a9c639700 1 -- 172.21.2.105:0/2639748506 shutdown_connections 2021-11-12T05:44:08.692 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:08.683+0000 7f6a9c639700 1 -- 172.21.2.105:0/2639748506 wait complete. 2021-11-12T05:44:08.692 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 20 2021-11-12T05:44:08.897 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:44:05.340503+0000', 'modified': '2021-11-12T05:44:06.343650+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5610}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5610': {'gid': 5610, 'name': 'a', 'rank': 0, 'incarnation': 19, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/351884283', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 351884283}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 351884283}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:44:08.898 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:44:08.898 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:44:08.963 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":5610,"want_state":"up:active","state":"up:active","rank_uptime":3.6155074009999999,"mdsmap_epoch":20,"osdmap_epoch":55,"osdmap_epoch_barrier":54,"uptime":7.7743417309999998} 2021-11-12T05:44:08.963 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 5610, "mdsmap_epoch": 20, "osdmap_epoch": 55, "osdmap_epoch_barrier": 54, "rank_uptime": 3.615507401, "state": "up:active", "uptime": 7.774341731, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:44:08.964 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-12T05:44:08.964 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-12T05:44:08.965 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba016.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-12T05:44:08.965 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:44:08.966 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:44:08.976 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:44:09.028 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:44:09.029 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:44:09.038 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:44:09.040 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:44:09.040 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:44:09.041 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:44:09.045 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-12T05:44:09.046 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:44:09.092 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:44:09.102 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:44:09.103 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:44:09.108 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:44:09.109 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:44:09.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:44:09.110 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:44:09.131 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:2021-11-12T05:44:09.129+0000 7f0195ee6080 -1 init, newargv = 0x559887099f00 newargc=9 2021-11-12T05:44:09.131 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[14331]: starting ceph client 2021-11-12T05:44:09.146 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[14331]: starting fuse 2021-11-12T05:44:10.236 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:44:10.248 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:44:10.249 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:44:10.296 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:44:10.297 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:44:10.298 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:44:10.299 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:44:10.304 INFO:teuthology.orchestra.run.gibba016.stdout:52 2021-11-12T05:44:10.304 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-12T05:44:10.305 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:44:10.305 DEBUG:teuthology.orchestra.run.gibba016:> sudo python3 -c ' 2021-11-12T05:44:10.305 DEBUG:teuthology.orchestra.run.gibba016:> import glob 2021-11-12T05:44:10.306 DEBUG:teuthology.orchestra.run.gibba016:> import re 2021-11-12T05:44:10.306 DEBUG:teuthology.orchestra.run.gibba016:> import os 2021-11-12T05:44:10.307 DEBUG:teuthology.orchestra.run.gibba016:> import subprocess 2021-11-12T05:44:10.307 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:44:10.308 DEBUG:teuthology.orchestra.run.gibba016:> def find_socket(client_name): 2021-11-12T05:44:10.308 DEBUG:teuthology.orchestra.run.gibba016:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-12T05:44:10.308 DEBUG:teuthology.orchestra.run.gibba016:> files = glob.glob(asok_path) 2021-11-12T05:44:10.309 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:44:10.309 DEBUG:teuthology.orchestra.run.gibba016:> # Given a non-glob path, it better be there 2021-11-12T05:44:10.310 DEBUG:teuthology.orchestra.run.gibba016:> if "*" not in asok_path: 2021-11-12T05:44:10.310 DEBUG:teuthology.orchestra.run.gibba016:> assert(len(files) == 1) 2021-11-12T05:44:10.310 DEBUG:teuthology.orchestra.run.gibba016:> return files[0] 2021-11-12T05:44:10.311 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:44:10.311 DEBUG:teuthology.orchestra.run.gibba016:> for f in files: 2021-11-12T05:44:10.312 DEBUG:teuthology.orchestra.run.gibba016:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-12T05:44:10.312 DEBUG:teuthology.orchestra.run.gibba016:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-12T05:44:10.312 DEBUG:teuthology.orchestra.run.gibba016:> return f 2021-11-12T05:44:10.313 DEBUG:teuthology.orchestra.run.gibba016:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-12T05:44:10.313 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:44:10.314 DEBUG:teuthology.orchestra.run.gibba016:> print(find_socket("client.0")) 2021-11-12T05:44:10.314 DEBUG:teuthology.orchestra.run.gibba016:> ' 2021-11-12T05:44:10.380 INFO:teuthology.orchestra.run.gibba016.stdout:/var/run/ceph/ceph-client.0.14331.asok 2021-11-12T05:44:10.383 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14331.asok 2021-11-12T05:44:10.383 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:44:10.384 DEBUG:teuthology.orchestra.run.gibba016:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14331.asok status 2021-11-12T05:44:10.431 INFO:teuthology.orchestra.run.gibba016.stdout:{ 2021-11-12T05:44:10.432 INFO:teuthology.orchestra.run.gibba016.stdout: "metadata": { 2021-11-12T05:44:10.432 INFO:teuthology.orchestra.run.gibba016.stdout: "ceph_sha1": "a81ee2815de5acae59ead5b8c9137b6766fc8ea8", 2021-11-12T05:44:10.432 INFO:teuthology.orchestra.run.gibba016.stdout: "ceph_version": "ceph version 15.2.15-22-ga81ee281 (a81ee2815de5acae59ead5b8c9137b6766fc8ea8) octopus (stable)", 2021-11-12T05:44:10.433 INFO:teuthology.orchestra.run.gibba016.stdout: "entity_id": "0", 2021-11-12T05:44:10.433 INFO:teuthology.orchestra.run.gibba016.stdout: "hostname": "gibba016", 2021-11-12T05:44:10.433 INFO:teuthology.orchestra.run.gibba016.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-12T05:44:10.433 INFO:teuthology.orchestra.run.gibba016.stdout: "pid": "14331", 2021-11-12T05:44:10.433 INFO:teuthology.orchestra.run.gibba016.stdout: "root": "/" 2021-11-12T05:44:10.434 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:44:10.434 INFO:teuthology.orchestra.run.gibba016.stdout: "dentry_count": 0, 2021-11-12T05:44:10.434 INFO:teuthology.orchestra.run.gibba016.stdout: "dentry_pinned_count": 0, 2021-11-12T05:44:10.434 INFO:teuthology.orchestra.run.gibba016.stdout: "id": 4720, 2021-11-12T05:44:10.435 INFO:teuthology.orchestra.run.gibba016.stdout: "inst": { 2021-11-12T05:44:10.435 INFO:teuthology.orchestra.run.gibba016.stdout: "name": { 2021-11-12T05:44:10.435 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "client", 2021-11-12T05:44:10.435 INFO:teuthology.orchestra.run.gibba016.stdout: "num": 4720 2021-11-12T05:44:10.436 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:44:10.436 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": { 2021-11-12T05:44:10.436 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "v1", 2021-11-12T05:44:10.436 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": "172.21.2.116:0", 2021-11-12T05:44:10.437 INFO:teuthology.orchestra.run.gibba016.stdout: "nonce": 1244100209 2021-11-12T05:44:10.437 INFO:teuthology.orchestra.run.gibba016.stdout: } 2021-11-12T05:44:10.437 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:44:10.437 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": { 2021-11-12T05:44:10.438 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "v1", 2021-11-12T05:44:10.438 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": "172.21.2.116:0", 2021-11-12T05:44:10.439 INFO:teuthology.orchestra.run.gibba016.stdout: "nonce": 1244100209 2021-11-12T05:44:10.439 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:44:10.439 INFO:teuthology.orchestra.run.gibba016.stdout: "inst_str": "client.4720 172.21.2.116:0/1244100209", 2021-11-12T05:44:10.439 INFO:teuthology.orchestra.run.gibba016.stdout: "addr_str": "172.21.2.116:0/1244100209", 2021-11-12T05:44:10.440 INFO:teuthology.orchestra.run.gibba016.stdout: "inode_count": 1, 2021-11-12T05:44:10.440 INFO:teuthology.orchestra.run.gibba016.stdout: "mds_epoch": 20, 2021-11-12T05:44:10.440 INFO:teuthology.orchestra.run.gibba016.stdout: "osd_epoch": 55, 2021-11-12T05:44:10.441 INFO:teuthology.orchestra.run.gibba016.stdout: "osd_epoch_barrier": 0, 2021-11-12T05:44:10.441 INFO:teuthology.orchestra.run.gibba016.stdout: "blacklisted": false, 2021-11-12T05:44:10.441 INFO:teuthology.orchestra.run.gibba016.stdout: "fs_name": "cephfs" 2021-11-12T05:44:10.441 INFO:teuthology.orchestra.run.gibba016.stdout:} 2021-11-12T05:44:10.443 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:44:10.443 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:44:10.444 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:44:10.450 INFO:teuthology.orchestra.run.gibba016.stdout:fuseblk 2021-11-12T05:44:10.450 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-12T05:44:10.450 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:44:10.451 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:44:10.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:44:10.504 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:44:10.504 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:44:10.510 INFO:teuthology.orchestra.run.gibba016.stdout:fuseblk 2021-11-12T05:44:10.511 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-12T05:44:10.512 DEBUG:teuthology.orchestra.run.gibba016:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-11-12T05:44:10.512 DEBUG:teuthology.orchestra.run.gibba016:> import sys 2021-11-12T05:44:10.512 DEBUG:teuthology.orchestra.run.gibba016:> import time 2021-11-12T05:44:10.513 DEBUG:teuthology.orchestra.run.gibba016:> import os 2021-11-12T05:44:10.513 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:44:10.514 DEBUG:teuthology.orchestra.run.gibba016:> n = 1000 2021-11-12T05:44:10.514 DEBUG:teuthology.orchestra.run.gibba016:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-11-12T05:44:10.514 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:44:10.515 DEBUG:teuthology.orchestra.run.gibba016:> if not os.path.exists(os.path.dirname(abs_path)): 2021-11-12T05:44:10.515 DEBUG:teuthology.orchestra.run.gibba016:> os.makedirs(os.path.dirname(abs_path)) 2021-11-12T05:44:10.515 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:44:10.516 DEBUG:teuthology.orchestra.run.gibba016:> for i in range(0, n): 2021-11-12T05:44:10.516 DEBUG:teuthology.orchestra.run.gibba016:> fname = "{0}_{1}".format(abs_path, i) 2021-11-12T05:44:10.517 DEBUG:teuthology.orchestra.run.gibba016:> with open(fname, '"'"'w'"'"') as f: 2021-11-12T05:44:10.517 DEBUG:teuthology.orchestra.run.gibba016:> f.write('"'"'content'"'"') 2021-11-12T05:44:10.517 DEBUG:teuthology.orchestra.run.gibba016:> if True: 2021-11-12T05:44:10.518 DEBUG:teuthology.orchestra.run.gibba016:> f.flush() 2021-11-12T05:44:10.518 DEBUG:teuthology.orchestra.run.gibba016:> os.fsync(f.fileno()) 2021-11-12T05:44:10.518 DEBUG:teuthology.orchestra.run.gibba016:> ' 2021-11-12T05:44:24.561 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:44:24.565 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:44:24.568 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:44:24.570 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:44:24.574 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:44:28.386 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:44:28.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.495+0000 7ffb33a97700 1 Processor -- start 2021-11-12T05:44:28.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.495+0000 7ffb33a97700 1 -- start start 2021-11-12T05:44:28.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.495+0000 7ffb33a97700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ffb2c0b0780 0x7ffb2c1434d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:28.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.495+0000 7ffb33a97700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ffb2c0b0cc0 0x7ffb2c05c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:28.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.495+0000 7ffb33a97700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb2c0b2d20 con 0x7ffb2c0b2940 2021-11-12T05:44:28.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.495+0000 7ffb33a97700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb2c0b1fc0 con 0x7ffb2c0b0cc0 2021-11-12T05:44:28.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.495+0000 7ffb33a97700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c0b15e0 con 0x7ffb2c0b0780 2021-11-12T05:44:28.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.495+0000 7ffb32034700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ffb2c0b0cc0 0x7ffb2c05c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:28.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.495+0000 7ffb31833700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7ffb2c0b2940 0x7ffb2c142dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:56430/0 (socket says 172.21.2.105:56430) 2021-11-12T05:44:28.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.495+0000 7ffb31833700 1 -- 172.21.2.105:0/1035547730 learned_addr learned my addr 172.21.2.105:0/1035547730 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:44:28.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.495+0000 7ffb32034700 1 -- 172.21.2.105:0/1035547730 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ffb2c0b0780 msgr2=0x7ffb2c1434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:28.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.495+0000 7ffb32034700 1 --2- 172.21.2.105:0/1035547730 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ffb2c0b0780 0x7ffb2c1434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:28.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.495+0000 7ffb32034700 1 -- 172.21.2.105:0/1035547730 >> v1:172.21.2.105:6789/0 conn(0x7ffb2c0b2940 legacy=0x7ffb2c142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:28.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.495+0000 7ffb32034700 1 -- 172.21.2.105:0/1035547730 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb2c0b1880 con 0x7ffb2c0b0cc0 2021-11-12T05:44:28.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.495+0000 7ffb32034700 1 --2- 172.21.2.105:0/1035547730 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffb2c0b0cc0 0x7ffb2c05c490 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7ffb240032f0 tx=0x7ffb240091d0).ready entity=mon.0 client_cookie=167b2311028a2ea0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:28.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.495+0000 7ffb30831700 1 -- 172.21.2.105:0/1035547730 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb24009ea0 con 0x7ffb2c0b0cc0 2021-11-12T05:44:28.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.495+0000 7ffb30831700 1 -- 172.21.2.105:0/1035547730 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2400b8a0 con 0x7ffb2c0b0cc0 2021-11-12T05:44:28.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.495+0000 7ffb30831700 1 -- 172.21.2.105:0/1035547730 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb2400ba10 con 0x7ffb2c0b0cc0 2021-11-12T05:44:28.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.495+0000 7ffb33a97700 1 -- 172.21.2.105:0/1035547730 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffb2c0b0cc0 msgr2=0x7ffb2c05c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:28.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.495+0000 7ffb33a97700 1 --2- 172.21.2.105:0/1035547730 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffb2c0b0cc0 0x7ffb2c05c490 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7ffb240032f0 tx=0x7ffb240091d0).stop 2021-11-12T05:44:28.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.495+0000 7ffb33a97700 1 -- 172.21.2.105:0/1035547730 shutdown_connections 2021-11-12T05:44:28.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.495+0000 7ffb33a97700 1 --2- 172.21.2.105:0/1035547730 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffb2c0b0cc0 0x7ffb2c05c490 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:28.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.495+0000 7ffb33a97700 1 --2- 172.21.2.105:0/1035547730 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ffb2c0b0780 0x7ffb2c1434d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:28.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.495+0000 7ffb33a97700 1 -- 172.21.2.105:0/1035547730 >> 172.21.2.105:0/1035547730 conn(0x7ffb2c068440 msgr2=0x7ffb2c062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:28.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.495+0000 7ffb33a97700 1 -- 172.21.2.105:0/1035547730 shutdown_connections 2021-11-12T05:44:28.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.495+0000 7ffb33a97700 1 -- 172.21.2.105:0/1035547730 wait complete. 2021-11-12T05:44:28.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.495+0000 7ffb33a97700 1 Processor -- start 2021-11-12T05:44:28.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.499+0000 7ffb33a97700 1 -- start start 2021-11-12T05:44:28.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.499+0000 7ffb33a97700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ffb2c0b0780 0x7ffb2c13a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:28.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.499+0000 7ffb33a97700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffb2c0b0cc0 0x7ffb2c0ab6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:28.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.499+0000 7ffb33a97700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ffb2c0b2940 0x7ffb2c0662e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:28.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.499+0000 7ffb33a97700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c1343b0 con 0x7ffb2c0b0cc0 2021-11-12T05:44:28.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.499+0000 7ffb33a97700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c065150 con 0x7ffb2c0b0780 2021-11-12T05:44:28.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.499+0000 7ffb33a97700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c1345e0 con 0x7ffb2c0b2940 2021-11-12T05:44:28.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.499+0000 7ffb31032700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffb2c0b0cc0 0x7ffb2c0ab6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:28.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.499+0000 7ffb31032700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffb2c0b0cc0 0x7ffb2c0ab6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46044/0 (socket says 172.21.2.105:46044) 2021-11-12T05:44:28.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.499+0000 7ffb31032700 1 -- 172.21.2.105:0/4097762391 learned_addr learned my addr 172.21.2.105:0/4097762391 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:28.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.499+0000 7ffb31032700 1 -- 172.21.2.105:0/4097762391 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ffb2c0b2940 msgr2=0x7ffb2c0662e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:28.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.499+0000 7ffb31032700 1 --2- 172.21.2.105:0/4097762391 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ffb2c0b2940 0x7ffb2c0662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:28.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.499+0000 7ffb31032700 1 -- 172.21.2.105:0/4097762391 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ffb2c0b0780 msgr2=0x7ffb2c13a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:28.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.499+0000 7ffb31032700 1 --2- 172.21.2.105:0/4097762391 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ffb2c0b0780 0x7ffb2c13a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:28.520 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.499+0000 7ffb31032700 1 -- 172.21.2.105:0/4097762391 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb24009470 con 0x7ffb2c0b0cc0 2021-11-12T05:44:28.520 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.499+0000 7ffb31032700 1 --2- 172.21.2.105:0/4097762391 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffb2c0b0cc0 0x7ffb2c0ab6f0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7ffb28002f70 tx=0x7ffb28006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:28.520 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.499+0000 7ffb1effd700 1 -- 172.21.2.105:0/4097762391 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb28013460 con 0x7ffb2c0b0cc0 2021-11-12T05:44:28.520 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.499+0000 7ffb1effd700 1 -- 172.21.2.105:0/4097762391 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb280135c0 con 0x7ffb2c0b0cc0 2021-11-12T05:44:28.520 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.499+0000 7ffb1effd700 1 -- 172.21.2.105:0/4097762391 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb28013920 con 0x7ffb2c0b0cc0 2021-11-12T05:44:28.521 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.499+0000 7ffb33a97700 1 -- 172.21.2.105:0/4097762391 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb2c0653b0 con 0x7ffb2c0b0cc0 2021-11-12T05:44:28.521 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.499+0000 7ffb33a97700 1 -- 172.21.2.105:0/4097762391 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb2c13ae20 con 0x7ffb2c0b0cc0 2021-11-12T05:44:28.521 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.499+0000 7ffb33a97700 1 -- 172.21.2.105:0/4097762391 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb2c0b1b20 con 0x7ffb2c0b0cc0 2021-11-12T05:44:28.521 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.499+0000 7ffb1effd700 1 -- 172.21.2.105:0/4097762391 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ffb2800f070 con 0x7ffb2c0b0cc0 2021-11-12T05:44:28.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.499+0000 7ffb1effd700 1 --2- 172.21.2.105:0/4097762391 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ffb0c053610 0x7ffb0c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:28.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.499+0000 7ffb1effd700 1 -- 172.21.2.105:0/4097762391 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6416+0+0 (secure 0 0 0) 0x7ffb2806b3c0 con 0x7ffb2c0b0cc0 2021-11-12T05:44:28.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.499+0000 7ffb31833700 1 --2- 172.21.2.105:0/4097762391 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ffb0c053610 0x7ffb0c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:28.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.499+0000 7ffb31833700 1 --2- 172.21.2.105:0/4097762391 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ffb0c053610 0x7ffb0c055ad0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7ffb2c060ba0 tx=0x7ffb20007820).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:28.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.503+0000 7ffb1effd700 1 -- 172.21.2.105:0/4097762391 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ffb280423d0 con 0x7ffb2c0b0cc0 2021-11-12T05:44:28.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.607+0000 7ffb33a97700 1 -- 172.21.2.105:0/4097762391 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb2c057350 con 0x7ffb2c0b0cc0 2021-11-12T05:44:28.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.607+0000 7ffb1effd700 1 -- 172.21.2.105:0/4097762391 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+2136 (secure 0 0 0) 0x7ffb280459f0 con 0x7ffb2c0b0cc0 2021-11-12T05:44:28.615 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:44:28.615 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":20,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4478,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/1513907466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":1513907466},{"type":"v1","addr":"172.21.2.115:6833","nonce":1513907466}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":18}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:44:05.340503+0000","modified":"2021-11-12T05:44:06.343650+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5610":{"gid":5610,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/351884283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":351884283},{"type":"v1","addr":"172.21.2.105:6835","nonce":351884283}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-11-12T05:44:28.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.611+0000 7ffb33a97700 1 -- 172.21.2.105:0/4097762391 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ffb0c053610 msgr2=0x7ffb0c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:28.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.611+0000 7ffb33a97700 1 --2- 172.21.2.105:0/4097762391 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ffb0c053610 0x7ffb0c055ad0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7ffb2c060ba0 tx=0x7ffb20007820).stop 2021-11-12T05:44:28.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.611+0000 7ffb33a97700 1 -- 172.21.2.105:0/4097762391 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffb2c0b0cc0 msgr2=0x7ffb2c0ab6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:28.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.611+0000 7ffb33a97700 1 --2- 172.21.2.105:0/4097762391 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffb2c0b0cc0 0x7ffb2c0ab6f0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7ffb28002f70 tx=0x7ffb28006ec0).stop 2021-11-12T05:44:28.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.611+0000 7ffb33a97700 1 -- 172.21.2.105:0/4097762391 shutdown_connections 2021-11-12T05:44:28.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.611+0000 7ffb33a97700 1 --2- 172.21.2.105:0/4097762391 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ffb0c053610 0x7ffb0c055ad0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:28.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.611+0000 7ffb33a97700 1 --2- 172.21.2.105:0/4097762391 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ffb2c0b2940 0x7ffb2c0662e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:28.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.611+0000 7ffb33a97700 1 --2- 172.21.2.105:0/4097762391 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffb2c0b0cc0 0x7ffb2c0ab6f0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:28.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.611+0000 7ffb33a97700 1 --2- 172.21.2.105:0/4097762391 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ffb2c0b0780 0x7ffb2c13a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:28.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.611+0000 7ffb33a97700 1 -- 172.21.2.105:0/4097762391 >> 172.21.2.105:0/4097762391 conn(0x7ffb2c068440 msgr2=0x7ffb2c0b5200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:28.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.611+0000 7ffb33a97700 1 -- 172.21.2.105:0/4097762391 shutdown_connections 2021-11-12T05:44:28.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.611+0000 7ffb33a97700 1 -- 172.21.2.105:0/4097762391 wait complete. 2021-11-12T05:44:28.619 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 20 2021-11-12T05:44:28.622 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_caps 20 2021-11-12T05:44:28.681 INFO:teuthology.orchestra.run.gibba005.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2021-11-12T05:44:28.681 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-11-12T05:44:28.682 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:44:28.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.727+0000 7f5ecedc9700 1 Processor -- start 2021-11-12T05:44:28.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.727+0000 7f5ecedc9700 1 -- start start 2021-11-12T05:44:28.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.727+0000 7f5ecedc9700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5ec80ad080 0x7f5ec80af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:28.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.727+0000 7f5ecedc9700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f5ec80ac280 0x7f5ec80ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:28.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.727+0000 7f5ecedc9700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ec80ac7b0 con 0x7f5ec814abe0 2021-11-12T05:44:28.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.727+0000 7f5ecedc9700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ec81488a0 con 0x7f5ec80ac280 2021-11-12T05:44:28.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.727+0000 7f5ecedc9700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec80ac9e0 con 0x7f5ec80ad080 2021-11-12T05:44:28.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.727+0000 7f5ec7fff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f5ec80ac280 0x7f5ec80ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:28.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.727+0000 7f5ec7fff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f5ec80ac280 0x7f5ec80ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46052/0 (socket says 172.21.2.105:46052) 2021-11-12T05:44:28.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.727+0000 7f5ec7fff700 1 -- 172.21.2.105:0/1736223596 learned_addr learned my addr 172.21.2.105:0/1736223596 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:28.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.727+0000 7f5ec7fff700 1 -- 172.21.2.105:0/1736223596 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5ec80ad080 msgr2=0x7f5ec80af730 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:44:28.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.727+0000 7f5ec7fff700 1 --2- 172.21.2.105:0/1736223596 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5ec80ad080 0x7f5ec80af730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:28.738 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.727+0000 7f5ec7fff700 1 -- 172.21.2.105:0/1736223596 >> v1:172.21.2.115:6789/0 conn(0x7f5ec814abe0 legacy=0x7f5ec814b090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:44:28.738 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.727+0000 7f5ec7fff700 1 -- 172.21.2.105:0/1736223596 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec80b0b30 con 0x7f5ec80ac280 2021-11-12T05:44:28.738 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.727+0000 7f5ec7fff700 1 --2- 172.21.2.105:0/1736223596 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ec80ac280 0x7f5ec80ad460 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f5ec80b6060 tx=0x7f5eb0006eb0).ready entity=mon.0 client_cookie=7c2093268cb90432 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:28.738 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.727+0000 7f5ec77fe700 1 -- 172.21.2.105:0/1736223596 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5eb000d570 con 0x7f5ec80ac280 2021-11-12T05:44:28.739 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.727+0000 7f5ec77fe700 1 -- 172.21.2.105:0/1736223596 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb0000e90 con 0x7f5ec80ac280 2021-11-12T05:44:28.739 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.727+0000 7f5ec77fe700 1 -- 172.21.2.105:0/1736223596 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5eb000d8c0 con 0x7f5ec80ac280 2021-11-12T05:44:28.739 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.727+0000 7f5ecedc9700 1 -- 172.21.2.105:0/1736223596 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ec80ac280 msgr2=0x7f5ec80ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:28.739 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.727+0000 7f5ecedc9700 1 --2- 172.21.2.105:0/1736223596 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ec80ac280 0x7f5ec80ad460 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f5ec80b6060 tx=0x7f5eb0006eb0).stop 2021-11-12T05:44:28.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.727+0000 7f5ecedc9700 1 -- 172.21.2.105:0/1736223596 shutdown_connections 2021-11-12T05:44:28.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.727+0000 7f5ecedc9700 1 --2- 172.21.2.105:0/1736223596 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ec80ac280 0x7f5ec80ad460 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:28.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.727+0000 7f5ecedc9700 1 --2- 172.21.2.105:0/1736223596 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5ec80ad080 0x7f5ec80af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:28.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.727+0000 7f5ecedc9700 1 -- 172.21.2.105:0/1736223596 >> 172.21.2.105:0/1736223596 conn(0x7f5ec80b5370 msgr2=0x7f5ec80b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:28.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.727+0000 7f5ecedc9700 1 -- 172.21.2.105:0/1736223596 shutdown_connections 2021-11-12T05:44:28.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.727+0000 7f5ecedc9700 1 -- 172.21.2.105:0/1736223596 wait complete. 2021-11-12T05:44:28.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.731+0000 7f5ecedc9700 1 Processor -- start 2021-11-12T05:44:28.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.731+0000 7f5ecedc9700 1 -- start start 2021-11-12T05:44:28.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.731+0000 7f5ecedc9700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ec80ac280 0x7f5ec80a9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:28.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.731+0000 7f5ecedc9700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5ec80ad080 0x7f5ec815a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:28.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.731+0000 7f5ecedc9700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5ec814abe0 0x7f5ec80a7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:28.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.731+0000 7f5ecedc9700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec8062a60 con 0x7f5ec80ac280 2021-11-12T05:44:28.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.731+0000 7f5ecedc9700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec815ad60 con 0x7f5ec80ad080 2021-11-12T05:44:28.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.731+0000 7f5ecedc9700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec815b000 con 0x7f5ec814abe0 2021-11-12T05:44:28.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.731+0000 7f5eccb65700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ec80ac280 0x7f5ec80a9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:28.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.731+0000 7f5eccb65700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ec80ac280 0x7f5ec80a9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46054/0 (socket says 172.21.2.105:46054) 2021-11-12T05:44:28.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.731+0000 7f5eccb65700 1 -- 172.21.2.105:0/2463139183 learned_addr learned my addr 172.21.2.105:0/2463139183 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:28.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.731+0000 7f5eccb65700 1 -- 172.21.2.105:0/2463139183 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5ec814abe0 msgr2=0x7f5ec80a7c30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:44:28.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.731+0000 7f5eccb65700 1 --2- 172.21.2.105:0/2463139183 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5ec814abe0 0x7f5ec80a7c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:28.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.731+0000 7f5eccb65700 1 -- 172.21.2.105:0/2463139183 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5ec80ad080 msgr2=0x7f5ec815a580 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:44:28.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.731+0000 7f5eccb65700 1 --2- 172.21.2.105:0/2463139183 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5ec80ad080 0x7f5ec815a580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:28.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.731+0000 7f5eccb65700 1 -- 172.21.2.105:0/2463139183 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb000b1e0 con 0x7f5ec80ac280 2021-11-12T05:44:28.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.731+0000 7f5eccb65700 1 --2- 172.21.2.105:0/2463139183 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ec80ac280 0x7f5ec80a9be0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f5eb8002fb0 tx=0x7f5eb8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:28.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.731+0000 7f5ec5ffb700 1 -- 172.21.2.105:0/2463139183 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5eb8013460 con 0x7f5ec80ac280 2021-11-12T05:44:28.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.731+0000 7f5ec5ffb700 1 -- 172.21.2.105:0/2463139183 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb80135c0 con 0x7f5ec80ac280 2021-11-12T05:44:28.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.731+0000 7f5ecedc9700 1 -- 172.21.2.105:0/2463139183 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ec815ab30 con 0x7f5ec80ac280 2021-11-12T05:44:28.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.731+0000 7f5ecedc9700 1 -- 172.21.2.105:0/2463139183 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ec80aa960 con 0x7f5ec80ac280 2021-11-12T05:44:28.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.731+0000 7f5ec5ffb700 1 -- 172.21.2.105:0/2463139183 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5eb8013920 con 0x7f5ec80ac280 2021-11-12T05:44:28.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.731+0000 7f5ecedc9700 1 -- 172.21.2.105:0/2463139183 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ec80b1440 con 0x7f5ec80ac280 2021-11-12T05:44:28.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.731+0000 7f5ec5ffb700 1 -- 172.21.2.105:0/2463139183 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5eb800f070 con 0x7f5ec80ac280 2021-11-12T05:44:28.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.731+0000 7f5ec5ffb700 1 --2- 172.21.2.105:0/2463139183 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5eac0536f0 0x7f5eac055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:28.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.731+0000 7f5ec5ffb700 1 -- 172.21.2.105:0/2463139183 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f5eb806b520 con 0x7f5ec80ac280 2021-11-12T05:44:28.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.731+0000 7f5ec7fff700 1 --2- 172.21.2.105:0/2463139183 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5eac0536f0 0x7f5eac055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:28.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.731+0000 7f5ec7fff700 1 --2- 172.21.2.105:0/2463139183 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5eac0536f0 0x7f5eac055bb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f5ec80b6060 tx=0x7f5eb0015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:28.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.735+0000 7f5ec5ffb700 1 -- 172.21.2.105:0/2463139183 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5eb8042530 con 0x7f5ec80ac280 2021-11-12T05:44:28.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.847+0000 7f5ecedc9700 1 -- 172.21.2.105:0/2463139183 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ec8057350 con 0x7f5ec80ac280 2021-11-12T05:44:28.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.847+0000 7f5ec5ffb700 1 -- 172.21.2.105:0/2463139183 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f5eb8045b50 con 0x7f5ec80ac280 2021-11-12T05:44:28.853 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:44:28.853 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":20,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4478,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/1513907466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":1513907466},{"type":"v1","addr":"172.21.2.115:6833","nonce":1513907466}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":18}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:44:05.340503+0000","modified":"2021-11-12T05:44:06.343650+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5610":{"gid":5610,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/351884283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":351884283},{"type":"v1","addr":"172.21.2.105:6835","nonce":351884283}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-11-12T05:44:28.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.847+0000 7f5ecedc9700 1 -- 172.21.2.105:0/2463139183 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5eac0536f0 msgr2=0x7f5eac055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:28.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.847+0000 7f5ecedc9700 1 --2- 172.21.2.105:0/2463139183 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5eac0536f0 0x7f5eac055bb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f5ec80b6060 tx=0x7f5eb0015000).stop 2021-11-12T05:44:28.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.847+0000 7f5ecedc9700 1 -- 172.21.2.105:0/2463139183 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ec80ac280 msgr2=0x7f5ec80a9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:28.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.847+0000 7f5ecedc9700 1 --2- 172.21.2.105:0/2463139183 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ec80ac280 0x7f5ec80a9be0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f5eb8002fb0 tx=0x7f5eb8006df0).stop 2021-11-12T05:44:28.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.847+0000 7f5ecedc9700 1 -- 172.21.2.105:0/2463139183 shutdown_connections 2021-11-12T05:44:28.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.847+0000 7f5ecedc9700 1 --2- 172.21.2.105:0/2463139183 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5eac0536f0 0x7f5eac055bb0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:28.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.847+0000 7f5ecedc9700 1 --2- 172.21.2.105:0/2463139183 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5ec814abe0 0x7f5ec80a7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:28.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.847+0000 7f5ecedc9700 1 --2- 172.21.2.105:0/2463139183 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5ec80ad080 0x7f5ec815a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:28.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.847+0000 7f5ecedc9700 1 --2- 172.21.2.105:0/2463139183 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ec80ac280 0x7f5ec80a9be0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:28.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.847+0000 7f5ecedc9700 1 -- 172.21.2.105:0/2463139183 >> 172.21.2.105:0/2463139183 conn(0x7f5ec80b5370 msgr2=0x7f5ec80ae880 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:28.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.847+0000 7f5ecedc9700 1 -- 172.21.2.105:0/2463139183 shutdown_connections 2021-11-12T05:44:28.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.847+0000 7f5ecedc9700 1 -- 172.21.2.105:0/2463139183 wait complete. 2021-11-12T05:44:28.857 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 20 2021-11-12T05:44:28.860 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_decay_threshold 400 2021-11-12T05:44:28.918 INFO:teuthology.orchestra.run.gibba005.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2021-11-12T05:44:28.919 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-11-12T05:44:28.919 INFO:tasks.cephfs.fuse_mount:Killing ceph-fuse connection on ubuntu@gibba016.front.sepia.ceph.com... 2021-11-12T05:44:28.930 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:44:28.981 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.975+0000 7fee220fb700 1 Processor -- start 2021-11-12T05:44:28.982 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.975+0000 7fee220fb700 1 -- start start 2021-11-12T05:44:28.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.975+0000 7fee220fb700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fee1c0ad080 0x7fee1c0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:28.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee220fb700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fee1c0ac280 0x7fee1c0ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:28.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee220fb700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee1c0ac7b0 con 0x7fee1c14abe0 2021-11-12T05:44:28.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee220fb700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee1c1488a0 con 0x7fee1c0ad080 2021-11-12T05:44:28.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee220fb700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee1c0ac9e0 con 0x7fee1c0ac280 2021-11-12T05:44:28.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee1b7fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fee1c0ad080 0x7fee1c0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:28.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee1b7fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fee1c0ad080 0x7fee1c0af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46064/0 (socket says 172.21.2.105:46064) 2021-11-12T05:44:28.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee1b7fe700 1 -- 172.21.2.105:0/150764898 learned_addr learned my addr 172.21.2.105:0/150764898 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:28.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee1b7fe700 1 -- 172.21.2.105:0/150764898 >> v2:172.21.2.115:3300/0 conn(0x7fee1c0ac280 msgr2=0x7fee1c0ad460 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:44:28.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee1b7fe700 1 --2- 172.21.2.105:0/150764898 >> v2:172.21.2.115:3300/0 conn(0x7fee1c0ac280 0x7fee1c0ad460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:28.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee1b7fe700 1 -- 172.21.2.105:0/150764898 >> v1:172.21.2.115:6789/0 conn(0x7fee1c14abe0 legacy=0x7fee1c14b090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:44:28.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee1b7fe700 1 -- 172.21.2.105:0/150764898 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee1c0b0b30 con 0x7fee1c0ad080 2021-11-12T05:44:28.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee1b7fe700 1 --2- 172.21.2.105:0/150764898 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee1c0ad080 0x7fee1c0af730 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7fee1c14bc40 tx=0x7fee0c006eb0).ready entity=mon.0 client_cookie=d9dabfe86972e2a9 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:28.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee1a7fc700 1 -- 172.21.2.105:0/150764898 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee0c00d5c0 con 0x7fee1c0ad080 2021-11-12T05:44:28.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee1a7fc700 1 -- 172.21.2.105:0/150764898 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0c000e90 con 0x7fee1c0ad080 2021-11-12T05:44:28.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee1a7fc700 1 -- 172.21.2.105:0/150764898 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee0c00d910 con 0x7fee1c0ad080 2021-11-12T05:44:28.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee220fb700 1 -- 172.21.2.105:0/150764898 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee1c0ad080 msgr2=0x7fee1c0af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:28.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee220fb700 1 --2- 172.21.2.105:0/150764898 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee1c0ad080 0x7fee1c0af730 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7fee1c14bc40 tx=0x7fee0c006eb0).stop 2021-11-12T05:44:28.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee220fb700 1 -- 172.21.2.105:0/150764898 shutdown_connections 2021-11-12T05:44:28.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee220fb700 1 --2- 172.21.2.105:0/150764898 >> v2:172.21.2.115:3300/0 conn(0x7fee1c0ac280 0x7fee1c0ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:28.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee220fb700 1 --2- 172.21.2.105:0/150764898 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee1c0ad080 0x7fee1c0af730 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:28.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee220fb700 1 -- 172.21.2.105:0/150764898 >> 172.21.2.105:0/150764898 conn(0x7fee1c0b5370 msgr2=0x7fee1c0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:28.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee220fb700 1 -- 172.21.2.105:0/150764898 shutdown_connections 2021-11-12T05:44:28.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee220fb700 1 -- 172.21.2.105:0/150764898 wait complete. 2021-11-12T05:44:28.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee220fb700 1 Processor -- start 2021-11-12T05:44:28.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee220fb700 1 -- start start 2021-11-12T05:44:28.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee220fb700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee1c0ac280 0x7fee1c15a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:28.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee220fb700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fee1c0ad080 0x7fee1c15a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:28.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee220fb700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fee1c14abe0 0x7fee1c0a7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:28.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee220fb700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c0ab1f0 con 0x7fee1c0ac280 2021-11-12T05:44:28.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee220fb700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c0a9d10 con 0x7fee1c14abe0 2021-11-12T05:44:28.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee220fb700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c0ab410 con 0x7fee1c0ad080 2021-11-12T05:44:28.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee1b7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee1c0ac280 0x7fee1c15a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:28.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee1b7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee1c0ac280 0x7fee1c15a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46068/0 (socket says 172.21.2.105:46068) 2021-11-12T05:44:28.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee1b7fe700 1 -- 172.21.2.105:0/1183187707 learned_addr learned my addr 172.21.2.105:0/1183187707 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:28.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee1b7fe700 1 -- 172.21.2.105:0/1183187707 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fee1c0ad080 msgr2=0x7fee1c15a9c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:44:28.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee1b7fe700 1 --2- 172.21.2.105:0/1183187707 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fee1c0ad080 0x7fee1c15a9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:28.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee1b7fe700 1 -- 172.21.2.105:0/1183187707 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fee1c14abe0 msgr2=0x7fee1c0a7020 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:44:28.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee1b7fe700 1 --2- 172.21.2.105:0/1183187707 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fee1c14abe0 0x7fee1c0a7020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:28.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee1b7fe700 1 -- 172.21.2.105:0/1183187707 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0c00b1e0 con 0x7fee1c0ac280 2021-11-12T05:44:28.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee1b7fe700 1 --2- 172.21.2.105:0/1183187707 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee1c0ac280 0x7fee1c15a4d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7fee1c14bc40 tx=0x7fee0c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:28.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee18ff9700 1 -- 172.21.2.105:0/1183187707 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee0c002f70 con 0x7fee1c0ac280 2021-11-12T05:44:28.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee18ff9700 1 -- 172.21.2.105:0/1183187707 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0c00de70 con 0x7fee1c0ac280 2021-11-12T05:44:28.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee220fb700 1 -- 172.21.2.105:0/1183187707 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee1c0a9550 con 0x7fee1c0ac280 2021-11-12T05:44:28.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee220fb700 1 -- 172.21.2.105:0/1183187707 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee1c0a9a90 con 0x7fee1c0ac280 2021-11-12T05:44:28.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee18ff9700 1 -- 172.21.2.105:0/1183187707 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee0c01e460 con 0x7fee1c0ac280 2021-11-12T05:44:28.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee220fb700 1 -- 172.21.2.105:0/1183187707 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee1c0ab5d0 con 0x7fee1c0ac280 2021-11-12T05:44:28.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee18ff9700 1 -- 172.21.2.105:0/1183187707 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fee0c025030 con 0x7fee1c0ac280 2021-11-12T05:44:28.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee18ff9700 1 --2- 172.21.2.105:0/1183187707 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fee00053610 0x7fee00055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:28.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.979+0000 7fee18ff9700 1 -- 172.21.2.105:0/1183187707 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fee0c06cf20 con 0x7fee1c0ac280 2021-11-12T05:44:28.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.983+0000 7fee1affd700 1 --2- 172.21.2.105:0/1183187707 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fee00053610 0x7fee00055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:28.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.983+0000 7fee1affd700 1 --2- 172.21.2.105:0/1183187707 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fee00053610 0x7fee00055ad0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fee04002fb0 tx=0x7fee04006930).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:28.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:28.983+0000 7fee18ff9700 1 -- 172.21.2.105:0/1183187707 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fee0c043f10 con 0x7fee1c0ac280 2021-11-12T05:44:29.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.091+0000 7fee220fb700 1 -- 172.21.2.105:0/1183187707 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee1c0b1440 con 0x7fee1c0ac280 2021-11-12T05:44:29.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.091+0000 7fee18ff9700 1 -- 172.21.2.105:0/1183187707 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+2136 (secure 0 0 0) 0x7fee0c023020 con 0x7fee1c0ac280 2021-11-12T05:44:29.098 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:44:29.099 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":20,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4478,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/1513907466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":1513907466},{"type":"v1","addr":"172.21.2.115:6833","nonce":1513907466}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":18}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:44:05.340503+0000","modified":"2021-11-12T05:44:06.343650+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5610":{"gid":5610,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/351884283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":351884283},{"type":"v1","addr":"172.21.2.105:6835","nonce":351884283}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-11-12T05:44:29.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.095+0000 7fee220fb700 1 -- 172.21.2.105:0/1183187707 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fee00053610 msgr2=0x7fee00055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:29.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.095+0000 7fee220fb700 1 --2- 172.21.2.105:0/1183187707 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fee00053610 0x7fee00055ad0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fee04002fb0 tx=0x7fee04006930).stop 2021-11-12T05:44:29.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.095+0000 7fee220fb700 1 -- 172.21.2.105:0/1183187707 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee1c0ac280 msgr2=0x7fee1c15a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:29.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.095+0000 7fee220fb700 1 --2- 172.21.2.105:0/1183187707 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee1c0ac280 0x7fee1c15a4d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7fee1c14bc40 tx=0x7fee0c015000).stop 2021-11-12T05:44:29.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.095+0000 7fee220fb700 1 -- 172.21.2.105:0/1183187707 shutdown_connections 2021-11-12T05:44:29.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.095+0000 7fee220fb700 1 --2- 172.21.2.105:0/1183187707 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fee00053610 0x7fee00055ad0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:29.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.095+0000 7fee220fb700 1 --2- 172.21.2.105:0/1183187707 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fee1c14abe0 0x7fee1c0a7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:29.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.095+0000 7fee220fb700 1 --2- 172.21.2.105:0/1183187707 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fee1c0ad080 0x7fee1c15a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:29.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.095+0000 7fee220fb700 1 --2- 172.21.2.105:0/1183187707 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee1c0ac280 0x7fee1c15a4d0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:29.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.095+0000 7fee220fb700 1 -- 172.21.2.105:0/1183187707 >> 172.21.2.105:0/1183187707 conn(0x7fee1c0b5370 msgr2=0x7fee1c060640 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:29.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.095+0000 7fee220fb700 1 -- 172.21.2.105:0/1183187707 shutdown_connections 2021-11-12T05:44:29.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.095+0000 7fee220fb700 1 -- 172.21.2.105:0/1183187707 wait complete. 2021-11-12T05:44:29.102 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 20 2021-11-12T05:44:29.105 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a cache drop 5 2021-11-12T05:44:29.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.151+0000 7fa5052f7700 1 Processor -- start 2021-11-12T05:44:29.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.151+0000 7fa5052f7700 1 -- start start 2021-11-12T05:44:29.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.151+0000 7fa5052f7700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa5000aca40 0x7fa5000ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:29.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.151+0000 7fa5052f7700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fa5000b0520 0x7fa5001473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:29.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.151+0000 7fa5052f7700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5000b1840 con 0x7fa5001478b0 2021-11-12T05:44:29.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.151+0000 7fa5052f7700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa500147d20 con 0x7fa5000aca40 2021-11-12T05:44:29.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.151+0000 7fa5052f7700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5000b09d0 con 0x7fa5000b0520 2021-11-12T05:44:29.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.151+0000 7fa4ff7fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fa5001478b0 0x7fa500144180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:56472/0 (socket says 172.21.2.105:56472) 2021-11-12T05:44:29.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.151+0000 7fa4ff7fe700 1 -- 172.21.2.105:0/2925148335 learned_addr learned my addr 172.21.2.105:0/2925148335 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:44:29.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.151+0000 7fa4feffd700 1 --2- 172.21.2.105:0/2925148335 >> v2:172.21.2.105:3300/0 conn(0x7fa5000aca40 0x7fa5000ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:29.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.151+0000 7fa4feffd700 1 -- 172.21.2.105:0/2925148335 >> v2:172.21.2.115:3300/0 conn(0x7fa5000b0520 msgr2=0x7fa5001473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:29.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.151+0000 7fa4feffd700 1 --2- 172.21.2.105:0/2925148335 >> v2:172.21.2.115:3300/0 conn(0x7fa5000b0520 0x7fa5001473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:29.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.151+0000 7fa4fdffb700 1 -- 172.21.2.105:0/2925148335 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2175235895 0 0) 0x7fa5000b1840 con 0x7fa5001478b0 2021-11-12T05:44:29.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.151+0000 7fa4feffd700 1 -- 172.21.2.105:0/2925148335 >> v1:172.21.2.105:6789/0 conn(0x7fa5001478b0 legacy=0x7fa500144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:29.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.151+0000 7fa4feffd700 1 -- 172.21.2.105:0/2925148335 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5000af2b0 con 0x7fa5000aca40 2021-11-12T05:44:29.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.151+0000 7fa4feffd700 1 --2- 172.21.2.105:0/2925148335 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa5000aca40 0x7fa5000ace20 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fa4f0002f70 tx=0x7fa4f0006df0).ready entity=mon.0 client_cookie=45ee40c4220452fc server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:29.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.151+0000 7fa4fdffb700 1 -- 172.21.2.105:0/2925148335 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4f000d5c0 con 0x7fa5000aca40 2021-11-12T05:44:29.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.151+0000 7fa4fdffb700 1 -- 172.21.2.105:0/2925148335 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f0000e90 con 0x7fa5000aca40 2021-11-12T05:44:29.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.151+0000 7fa4fdffb700 1 -- 172.21.2.105:0/2925148335 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4f000d910 con 0x7fa5000aca40 2021-11-12T05:44:29.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa5052f7700 1 -- 172.21.2.105:0/2925148335 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa5000aca40 msgr2=0x7fa5000ace20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:29.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa5052f7700 1 --2- 172.21.2.105:0/2925148335 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa5000aca40 0x7fa5000ace20 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fa4f0002f70 tx=0x7fa4f0006df0).stop 2021-11-12T05:44:29.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa5052f7700 1 -- 172.21.2.105:0/2925148335 shutdown_connections 2021-11-12T05:44:29.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa5052f7700 1 --2- 172.21.2.105:0/2925148335 >> v2:172.21.2.115:3300/0 conn(0x7fa5000b0520 0x7fa5001473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:29.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa5052f7700 1 --2- 172.21.2.105:0/2925148335 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa5000aca40 0x7fa5000ace20 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:29.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa5052f7700 1 -- 172.21.2.105:0/2925148335 >> 172.21.2.105:0/2925148335 conn(0x7fa50005c490 msgr2=0x7fa5000b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:29.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa5052f7700 1 -- 172.21.2.105:0/2925148335 shutdown_connections 2021-11-12T05:44:29.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa5052f7700 1 -- 172.21.2.105:0/2925148335 wait complete. 2021-11-12T05:44:29.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa5052f7700 1 Processor -- start 2021-11-12T05:44:29.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa5052f7700 1 -- start start 2021-11-12T05:44:29.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa5052f7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa5000aca40 0x7fa5000b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:29.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa5052f7700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa5000b0520 0x7fa50013b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:29.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa5052f7700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa5001478b0 0x7fa50013b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:29.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa5052f7700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5000a8a10 con 0x7fa5000aca40 2021-11-12T05:44:29.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa5052f7700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa500066780 con 0x7fa5001478b0 2021-11-12T05:44:29.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa5052f7700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5000657e0 con 0x7fa5000b0520 2021-11-12T05:44:29.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa4feffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa5000aca40 0x7fa5000b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:29.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa4feffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa5000aca40 0x7fa5000b4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46082/0 (socket says 172.21.2.105:46082) 2021-11-12T05:44:29.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa4feffd700 1 -- 172.21.2.105:0/243779563 learned_addr learned my addr 172.21.2.105:0/243779563 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:29.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa4feffd700 1 -- 172.21.2.105:0/243779563 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa5000b0520 msgr2=0x7fa50013b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:29.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa4feffd700 1 --2- 172.21.2.105:0/243779563 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa5000b0520 0x7fa50013b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:29.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa4feffd700 1 -- 172.21.2.105:0/243779563 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa5001478b0 msgr2=0x7fa50013b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:29.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa4feffd700 1 --2- 172.21.2.105:0/243779563 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa5001478b0 0x7fa50013b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:29.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa4feffd700 1 -- 172.21.2.105:0/243779563 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f000b180 con 0x7fa5000aca40 2021-11-12T05:44:29.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa4feffd700 1 --2- 172.21.2.105:0/243779563 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa5000aca40 0x7fa5000b4e60 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7fa4f0002f70 tx=0x7fa4f0014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:29.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa4f7fff700 1 -- 172.21.2.105:0/243779563 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4f001e400 con 0x7fa5000aca40 2021-11-12T05:44:29.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa4f7fff700 1 -- 172.21.2.105:0/243779563 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f001e560 con 0x7fa5000aca40 2021-11-12T05:44:29.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa5052f7700 1 -- 172.21.2.105:0/243779563 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa500066a20 con 0x7fa5000aca40 2021-11-12T05:44:29.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa4f7fff700 1 -- 172.21.2.105:0/243779563 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4f001e8c0 con 0x7fa5000aca40 2021-11-12T05:44:29.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa5052f7700 1 -- 172.21.2.105:0/243779563 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5000643b0 con 0x7fa5000aca40 2021-11-12T05:44:29.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa4f7fff700 1 -- 172.21.2.105:0/243779563 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa4f0025030 con 0x7fa5000aca40 2021-11-12T05:44:29.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa4f7fff700 1 --2- 172.21.2.105:0/243779563 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa4e40535b0 0x7fa4e4055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:29.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa4f7fff700 1 -- 172.21.2.105:0/243779563 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fa4f006c8c0 con 0x7fa5000aca40 2021-11-12T05:44:29.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa4fe7fc700 1 --2- 172.21.2.105:0/243779563 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa4e40535b0 0x7fa4e4055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:29.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa4fe7fc700 1 --2- 172.21.2.105:0/243779563 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa4e40535b0 0x7fa4e4055a70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fa4e8002f70 tx=0x7fa4e8006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:29.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa50f53b740 1 Processor -- start 2021-11-12T05:44:29.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa50f53b740 1 -- start start 2021-11-12T05:44:29.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa50f53b740 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x1135fe0 0x1137a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:29.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa50f53b740 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x116e010 0x1137f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:29.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa50f53b740 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x1138df0 0x116cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:29.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa50f53b740 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x10a9530 con 0x1138df0 2021-11-12T05:44:29.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa50f53b740 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x10898d0 con 0x116e010 2021-11-12T05:44:29.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa50f53b740 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x11363c0 con 0x1135fe0 2021-11-12T05:44:29.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.155+0000 7fa4ff7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x1138df0 0x116cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:29.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa4ff7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x1138df0 0x116cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46094/0 (socket says 172.21.2.105:46094) 2021-11-12T05:44:29.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa4ff7fe700 1 -- 172.21.2.105:0/3461086165 learned_addr learned my addr 172.21.2.105:0/3461086165 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:29.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa4ff7fe700 1 -- 172.21.2.105:0/3461086165 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x1135fe0 msgr2=0x1137a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:29.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa4ff7fe700 1 --2- 172.21.2.105:0/3461086165 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x1135fe0 0x1137a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:29.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa4ff7fe700 1 -- 172.21.2.105:0/3461086165 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x116e010 msgr2=0x1137f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:29.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa4ff7fe700 1 --2- 172.21.2.105:0/3461086165 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x116e010 0x1137f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:29.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa4ff7fe700 1 -- 172.21.2.105:0/3461086165 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x10e1130 con 0x1138df0 2021-11-12T05:44:29.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa4ff7fe700 1 --2- 172.21.2.105:0/3461086165 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x1138df0 0x116cd30 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x116e450 tx=0x7fa4f8001360).ready entity=mon.0 client_cookie=d9d0ea7f5e667745 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:29.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa5052f7700 1 -- 172.21.2.105:0/3461086165 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4f8005ba0 con 0x1138df0 2021-11-12T05:44:29.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa5052f7700 1 -- 172.21.2.105:0/3461086165 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f8005d00 con 0x1138df0 2021-11-12T05:44:29.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa5052f7700 1 -- 172.21.2.105:0/3461086165 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4f8004a90 con 0x1138df0 2021-11-12T05:44:29.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 1 -- 172.21.2.105:0/3461086165 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x1138df0 msgr2=0x116cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:29.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 1 --2- 172.21.2.105:0/3461086165 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x1138df0 0x116cd30 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x116e450 tx=0x7fa4f8001360).stop 2021-11-12T05:44:29.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 1 -- 172.21.2.105:0/3461086165 shutdown_connections 2021-11-12T05:44:29.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 1 --2- 172.21.2.105:0/3461086165 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x1138df0 0x116cd30 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:29.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 1 --2- 172.21.2.105:0/3461086165 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x116e010 0x1137f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:29.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 1 --2- 172.21.2.105:0/3461086165 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x1135fe0 0x1137a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:29.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 1 -- 172.21.2.105:0/3461086165 >> 172.21.2.105:0/3461086165 conn(0x1171f90 msgr2=0x1172370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:29.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 1 -- 172.21.2.105:0/3461086165 shutdown_connections 2021-11-12T05:44:29.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 1 -- 172.21.2.105:0/3461086165 wait complete. 2021-11-12T05:44:29.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 1 -- start start 2021-11-12T05:44:29.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 1 Processor -- start 2021-11-12T05:44:29.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x1135fe0 0x1140730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:29.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x1138df0 0x116a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:29.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x116e010 0x116a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:29.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x1134f00 con 0x116e010 2021-11-12T05:44:29.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x113c5a0 con 0x1135fe0 2021-11-12T05:44:29.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x113c840 con 0x1138df0 2021-11-12T05:44:29.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 10 client.0 ll_register_callbacks cb 0x109cf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-11-12T05:44:29.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa4ff7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x116e010 0x116a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:29.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa4ff7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x116e010 0x116a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46098/0 (socket says 172.21.2.105:46098) 2021-11-12T05:44:29.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa4ff7fe700 1 -- 172.21.2.105:0/3398996260 learned_addr learned my addr 172.21.2.105:0/3398996260 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:29.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa4ff7fe700 1 -- 172.21.2.105:0/3398996260 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x1138df0 msgr2=0x116a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:29.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa4ff7fe700 1 --2- 172.21.2.105:0/3398996260 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x1138df0 0x116a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:29.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa4ff7fe700 1 -- 172.21.2.105:0/3398996260 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x1135fe0 msgr2=0x1140730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:29.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa4ff7fe700 1 --2- 172.21.2.105:0/3398996260 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x1135fe0 0x1140730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:29.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa4ff7fe700 1 -- 172.21.2.105:0/3398996260 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4f8001600 con 0x116e010 2021-11-12T05:44:29.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa4ff7fe700 1 --2- 172.21.2.105:0/3398996260 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x116e010 0x116a8d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x116e450 tx=0x7fa4f8015000).ready entity=mon.0 client_cookie=94ebf648cb3ef067 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:29.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa4ddffb700 10 client.0 ms_handle_connect on v2:172.21.2.105:3300/0 2021-11-12T05:44:29.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa4ddffb700 1 -- 172.21.2.105:0/3398996260 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4f8014810 con 0x116e010 2021-11-12T05:44:29.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa4ddffb700 1 -- 172.21.2.105:0/3398996260 <== mon.0 v2:172.21.2.105:3300/0 2 ==== osd_map(55..55 src has 1..55) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fa4f8021dc0 con 0x116e010 2021-11-12T05:44:29.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 1 -- 172.21.2.105:0/3398996260 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x109f510 con 0x116e010 2021-11-12T05:44:29.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa4ddffb700 1 -- 172.21.2.105:0/3398996260 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4f8007a40 con 0x116e010 2021-11-12T05:44:29.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 10 client.5814 fetch_fsmap learned FSMap version 20 2021-11-12T05:44:29.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 1 -- 172.21.2.105:0/3398996260 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x1098b00 con 0x116e010 2021-11-12T05:44:29.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa4ddffb700 1 -- 172.21.2.105:0/3398996260 <== mon.0 v2:172.21.2.105:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f8029020 con 0x116e010 2021-11-12T05:44:29.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa4ddffb700 1 -- 172.21.2.105:0/3398996260 <== mon.0 v2:172.21.2.105:3300/0 5 ==== fsmap(e 20) v1 ==== 1247+0+0 (secure 0 0 0) 0x7fa4f801f3e0 con 0x116e010 2021-11-12T05:44:29.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 10 client.5814 fetch_fsmap finished waiting for FSMap version 20 2021-11-12T05:44:29.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 10 client.5814 resolve_mds: resolved ID 'a' to GID 5610 2021-11-12T05:44:29.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 20 client.5814 populate_metadata read hostname 'gibba005' 2021-11-12T05:44:29.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 1 --2- 172.21.2.105:0/3398996260 >> [v2:172.21.2.105:6834/351884283,v1:172.21.2.105:6835/351884283] conn(0x1133820 0x1133c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:29.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 4 client.5814 mds_command: new command op to 5610 tid=0[{"prefix": "get_command_descriptions"}] 2021-11-12T05:44:29.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 1 -- 172.21.2.105:0/3398996260 --> [v2:172.21.2.105:6834/351884283,v1:172.21.2.105:6835/351884283] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1097590 con 0x1133820 2021-11-12T05:44:29.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa4feffd700 1 --2- 172.21.2.105:0/3398996260 >> [v2:172.21.2.105:6834/351884283,v1:172.21.2.105:6835/351884283] conn(0x1133820 0x1133c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:29.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa4ddffb700 10 client.5814 ms_handle_connect on v2:172.21.2.105:6834/351884283 2021-11-12T05:44:29.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa4feffd700 1 --2- 172.21.2.105:0/3398996260 >> [v2:172.21.2.105:6834/351884283,v1:172.21.2.105:6835/351884283] conn(0x1133820 0x1133c00 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=67426fabd85abc3c server_cookie=635ae10fb971ab23 in_seq=0 out_seq=0 2021-11-12T05:44:29.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa4ddffb700 1 -- 172.21.2.105:0/3398996260 <== mds.0 v2:172.21.2.105:6834/351884283 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x1097590 con 0x1133820 2021-11-12T05:44:29.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa4ddffb700 10 client.5814 handle_command_reply: tid=0 2021-11-12T05:44:29.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 1 client.5814 shutdown 2021-11-12T05:44:29.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 1 -- 172.21.2.105:0/3398996260 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x116e010 msgr2=0x116a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:29.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 1 --2- 172.21.2.105:0/3398996260 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x116e010 0x116a8d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x116e450 tx=0x7fa4f8015000).stop 2021-11-12T05:44:29.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 1 -- 172.21.2.105:0/3398996260 shutdown_connections 2021-11-12T05:44:29.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 1 --2- 172.21.2.105:0/3398996260 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x116e010 0x116a8d0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:29.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 1 --2- 172.21.2.105:0/3398996260 >> [v2:172.21.2.105:6834/351884283,v1:172.21.2.105:6835/351884283] conn(0x1133820 0x1133c00 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:29.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 1 --2- 172.21.2.105:0/3398996260 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x1138df0 0x116a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:29.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 1 --2- 172.21.2.105:0/3398996260 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x1135fe0 0x1140730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:29.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 1 -- 172.21.2.105:0/3398996260 >> 172.21.2.105:0/3398996260 conn(0x1171f90 msgr2=0x1137970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:29.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa4ddffb700 0 client.5814 ms_handle_reset on v2:172.21.2.105:6834/351884283 2021-11-12T05:44:29.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 1 -- 172.21.2.105:0/3398996260 shutdown_connections 2021-11-12T05:44:29.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 1 -- 172.21.2.105:0/3398996260 wait complete. 2021-11-12T05:44:29.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.159+0000 7fa50f53b740 20 client.5814 trim_cache size 0 max 16384 2021-11-12T05:44:29.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.167+0000 7fa50f53b740 1 Processor -- start 2021-11-12T05:44:29.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.167+0000 7fa50f53b740 1 -- start start 2021-11-12T05:44:29.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.167+0000 7fa50f53b740 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x1135fe0 0x11391d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:29.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.167+0000 7fa50f53b740 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x1138df0 0x116a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:29.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.167+0000 7fa50f53b740 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x116e010 0x116a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:29.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.167+0000 7fa50f53b740 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x113b8f0 con 0x116e010 2021-11-12T05:44:29.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.167+0000 7fa50f53b740 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x11011f0 con 0x1138df0 2021-11-12T05:44:29.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.167+0000 7fa50f53b740 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x10b7de0 con 0x1135fe0 2021-11-12T05:44:29.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.167+0000 7fa4ff7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x116e010 0x116a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:29.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.167+0000 7fa4ff7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x116e010 0x116a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46106/0 (socket says 172.21.2.105:46106) 2021-11-12T05:44:29.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.167+0000 7fa4ff7fe700 1 -- 172.21.2.105:0/3957668691 learned_addr learned my addr 172.21.2.105:0/3957668691 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:29.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.167+0000 7fa4ff7fe700 1 -- 172.21.2.105:0/3957668691 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x1135fe0 msgr2=0x11391d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:29.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.167+0000 7fa4ff7fe700 1 --2- 172.21.2.105:0/3957668691 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x1135fe0 0x11391d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:29.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.167+0000 7fa4ff7fe700 1 -- 172.21.2.105:0/3957668691 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x1138df0 msgr2=0x116a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:29.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.167+0000 7fa4ff7fe700 1 --2- 172.21.2.105:0/3957668691 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x1138df0 0x116a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:29.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.167+0000 7fa4ff7fe700 1 -- 172.21.2.105:0/3957668691 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x10a16f0 con 0x116e010 2021-11-12T05:44:29.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.167+0000 7fa4ff7fe700 1 --2- 172.21.2.105:0/3957668691 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x116e010 0x116a560 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x1137010 tx=0x7fa4f801c000).ready entity=mon.0 client_cookie=4c7c283ca47bec0a server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:29.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.167+0000 7fa4dffff700 1 -- 172.21.2.105:0/3957668691 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4f8005e70 con 0x116e010 2021-11-12T05:44:29.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.167+0000 7fa4dffff700 1 -- 172.21.2.105:0/3957668691 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f800b030 con 0x116e010 2021-11-12T05:44:29.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.167+0000 7fa4dffff700 1 -- 172.21.2.105:0/3957668691 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4f80019a0 con 0x116e010 2021-11-12T05:44:29.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.167+0000 7fa50f53b740 1 -- 172.21.2.105:0/3957668691 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x116e010 msgr2=0x116a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:29.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.167+0000 7fa50f53b740 1 --2- 172.21.2.105:0/3957668691 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x116e010 0x116a560 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x1137010 tx=0x7fa4f801c000).stop 2021-11-12T05:44:29.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.167+0000 7fa50f53b740 1 -- 172.21.2.105:0/3957668691 shutdown_connections 2021-11-12T05:44:29.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.167+0000 7fa50f53b740 1 --2- 172.21.2.105:0/3957668691 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x116e010 0x116a560 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:29.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.167+0000 7fa50f53b740 1 --2- 172.21.2.105:0/3957668691 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x1138df0 0x116a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:29.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.167+0000 7fa50f53b740 1 --2- 172.21.2.105:0/3957668691 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x1135fe0 0x11391d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:29.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.167+0000 7fa50f53b740 1 -- 172.21.2.105:0/3957668691 >> 172.21.2.105:0/3957668691 conn(0x1171f90 msgr2=0x1136500 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:29.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.171+0000 7fa50f53b740 1 -- 172.21.2.105:0/3957668691 shutdown_connections 2021-11-12T05:44:29.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.171+0000 7fa50f53b740 1 -- 172.21.2.105:0/3957668691 wait complete. 2021-11-12T05:44:29.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.171+0000 7fa50f53b740 1 -- start start 2021-11-12T05:44:29.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.171+0000 7fa50f53b740 1 Processor -- start 2021-11-12T05:44:29.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.171+0000 7fa50f53b740 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x1135fe0 0x11693a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:29.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.171+0000 7fa50f53b740 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x1138df0 0x11d0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:29.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.171+0000 7fa50f53b740 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x116e010 0x11d04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:29.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.171+0000 7fa50f53b740 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x11d09e0 con 0x116e010 2021-11-12T05:44:29.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.171+0000 7fa50f53b740 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x1139990 con 0x1135fe0 2021-11-12T05:44:29.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.171+0000 7fa50f53b740 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x1168f40 con 0x1138df0 2021-11-12T05:44:29.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.171+0000 7fa50f53b740 10 client.0 ll_register_callbacks cb 0x113fab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-11-12T05:44:29.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.171+0000 7fa4ff7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x116e010 0x11d04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:29.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.171+0000 7fa4ff7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x116e010 0x11d04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46114/0 (socket says 172.21.2.105:46114) 2021-11-12T05:44:29.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.171+0000 7fa4ff7fe700 1 -- 172.21.2.105:0/295138210 learned_addr learned my addr 172.21.2.105:0/295138210 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:29.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.171+0000 7fa4ff7fe700 1 -- 172.21.2.105:0/295138210 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x1138df0 msgr2=0x11d0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:29.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.171+0000 7fa4ff7fe700 1 --2- 172.21.2.105:0/295138210 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x1138df0 0x11d0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:29.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.171+0000 7fa4ff7fe700 1 -- 172.21.2.105:0/295138210 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x1135fe0 msgr2=0x11693a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:29.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.171+0000 7fa4ff7fe700 1 --2- 172.21.2.105:0/295138210 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x1135fe0 0x11693a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:29.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.171+0000 7fa4ff7fe700 1 -- 172.21.2.105:0/295138210 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1098b00 con 0x116e010 2021-11-12T05:44:29.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.171+0000 7fa4ff7fe700 1 --2- 172.21.2.105:0/295138210 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x116e010 0x11d04f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x1137010 tx=0x7fa4f8022040).ready entity=mon.0 client_cookie=f36ee79e9e98db27 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:29.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.171+0000 7fa4deffd700 10 client.0 ms_handle_connect on v2:172.21.2.105:3300/0 2021-11-12T05:44:29.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.171+0000 7fa4deffd700 1 -- 172.21.2.105:0/295138210 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4f801f3e0 con 0x116e010 2021-11-12T05:44:29.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.171+0000 7fa4deffd700 1 -- 172.21.2.105:0/295138210 <== mon.0 v2:172.21.2.105:3300/0 2 ==== osd_map(55..55 src has 1..55) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fa4f802a080 con 0x116e010 2021-11-12T05:44:29.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.171+0000 7fa50f53b740 1 -- 172.21.2.105:0/295138210 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa4f8005d00 con 0x116e010 2021-11-12T05:44:29.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.171+0000 7fa4deffd700 1 -- 172.21.2.105:0/295138210 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4f801f540 con 0x116e010 2021-11-12T05:44:29.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.171+0000 7fa50f53b740 10 client.5820 fetch_fsmap learned FSMap version 20 2021-11-12T05:44:29.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.171+0000 7fa50f53b740 1 -- 172.21.2.105:0/295138210 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x109e0e0 con 0x116e010 2021-11-12T05:44:29.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.171+0000 7fa4deffd700 1 -- 172.21.2.105:0/295138210 <== mon.0 v2:172.21.2.105:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f8005d00 con 0x116e010 2021-11-12T05:44:29.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.171+0000 7fa4deffd700 1 -- 172.21.2.105:0/295138210 <== mon.0 v2:172.21.2.105:3300/0 5 ==== fsmap(e 20) v1 ==== 1247+0+0 (secure 0 0 0) 0x7fa4f8036070 con 0x116e010 2021-11-12T05:44:29.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.171+0000 7fa50f53b740 10 client.5820 fetch_fsmap finished waiting for FSMap version 20 2021-11-12T05:44:29.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.171+0000 7fa50f53b740 10 client.5820 resolve_mds: resolved ID 'a' to GID 5610 2021-11-12T05:44:29.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.171+0000 7fa50f53b740 20 client.5820 populate_metadata read hostname 'gibba005' 2021-11-12T05:44:29.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.171+0000 7fa50f53b740 1 --2- 172.21.2.105:0/295138210 >> [v2:172.21.2.105:6834/351884283,v1:172.21.2.105:6835/351884283] conn(0x116e3f0 0x116e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:29.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.171+0000 7fa50f53b740 4 client.5820 mds_command: new command op to 5610 tid=0[{"prefix": "cache drop", "timeout": 5}] 2021-11-12T05:44:29.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.171+0000 7fa50f53b740 1 -- 172.21.2.105:0/295138210 --> [v2:172.21.2.105:6834/351884283,v1:172.21.2.105:6835/351884283] -- command(tid 0: {"prefix": "cache drop", "timeout": 5}) v1 -- 0xf8d5e0 con 0x116e3f0 2021-11-12T05:44:29.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.171+0000 7fa4feffd700 1 --2- 172.21.2.105:0/295138210 >> [v2:172.21.2.105:6834/351884283,v1:172.21.2.105:6835/351884283] conn(0x116e3f0 0x116e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:29.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.171+0000 7fa4feffd700 1 --2- 172.21.2.105:0/295138210 >> [v2:172.21.2.105:6834/351884283,v1:172.21.2.105:6835/351884283] conn(0x116e3f0 0x116e7d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=dc192ac8802fb20 server_cookie=f6319b210cbc8935 in_seq=0 out_seq=0 2021-11-12T05:44:29.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:29.171+0000 7fa4deffd700 10 client.5820 ms_handle_connect on v2:172.21.2.105:6834/351884283 2021-11-12T05:44:34.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.263+0000 7fa4deffd700 1 -- 172.21.2.105:0/295138210 <== mds.0 v2:172.21.2.105:6834/351884283 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+404 (crc 0 0 0) 0xf8d5e0 con 0x116e3f0 2021-11-12T05:44:34.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.263+0000 7fa4deffd700 10 client.5820 handle_command_reply: tid=0 2021-11-12T05:44:34.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.263+0000 7fa50f53b740 1 client.5820 shutdown 2021-11-12T05:44:34.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.263+0000 7fa50f53b740 1 -- 172.21.2.105:0/295138210 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x116e010 msgr2=0x11d04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:34.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.263+0000 7fa50f53b740 1 --2- 172.21.2.105:0/295138210 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x116e010 0x11d04f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x1137010 tx=0x7fa4f8022040).stop 2021-11-12T05:44:34.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.263+0000 7fa50f53b740 1 -- 172.21.2.105:0/295138210 shutdown_connections 2021-11-12T05:44:34.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.263+0000 7fa50f53b740 1 --2- 172.21.2.105:0/295138210 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x116e010 0x11d04f0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:34.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.263+0000 7fa50f53b740 1 --2- 172.21.2.105:0/295138210 >> [v2:172.21.2.105:6834/351884283,v1:172.21.2.105:6835/351884283] conn(0x116e3f0 0x116e7d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:34.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.263+0000 7fa50f53b740 1 --2- 172.21.2.105:0/295138210 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x1138df0 0x11d0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:34.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.263+0000 7fa50f53b740 1 --2- 172.21.2.105:0/295138210 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x1135fe0 0x11693a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:34.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.263+0000 7fa4deffd700 0 client.5820 ms_handle_reset on v2:172.21.2.105:6834/351884283 2021-11-12T05:44:34.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.263+0000 7fa50f53b740 1 -- 172.21.2.105:0/295138210 >> 172.21.2.105:0/295138210 conn(0x1171f90 msgr2=0x1133740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:34.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.263+0000 7fa50f53b740 1 -- 172.21.2.105:0/295138210 shutdown_connections 2021-11-12T05:44:34.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.263+0000 7fa50f53b740 1 -- 172.21.2.105:0/295138210 wait complete. 2021-11-12T05:44:34.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.263+0000 7fa50f53b740 20 client.5820 trim_cache size 0 max 16384 2021-11-12T05:44:34.271 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:44:34.272 INFO:teuthology.orchestra.run.gibba005.stdout: "client_recall": { 2021-11-12T05:44:34.272 INFO:teuthology.orchestra.run.gibba005.stdout: "return_code": -110, 2021-11-12T05:44:34.272 INFO:teuthology.orchestra.run.gibba005.stdout: "message": "(110) Connection timed out", 2021-11-12T05:44:34.272 INFO:teuthology.orchestra.run.gibba005.stdout: "recalled": 120 2021-11-12T05:44:34.273 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:34.273 INFO:teuthology.orchestra.run.gibba005.stdout: "flush_journal": { 2021-11-12T05:44:34.273 INFO:teuthology.orchestra.run.gibba005.stdout: "return_code": 0, 2021-11-12T05:44:34.273 INFO:teuthology.orchestra.run.gibba005.stdout: "message": "" 2021-11-12T05:44:34.273 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:34.274 INFO:teuthology.orchestra.run.gibba005.stdout: "trim_cache": { 2021-11-12T05:44:34.274 INFO:teuthology.orchestra.run.gibba005.stdout: "trimmed": 0 2021-11-12T05:44:34.274 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:34.274 INFO:teuthology.orchestra.run.gibba005.stdout: "cache": { 2021-11-12T05:44:34.275 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": { 2021-11-12T05:44:34.275 INFO:teuthology.orchestra.run.gibba005.stdout: "items": 19881, 2021-11-12T05:44:34.275 INFO:teuthology.orchestra.run.gibba005.stdout: "bytes": 3092704 2021-11-12T05:44:34.275 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:44:34.275 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:44:34.276 INFO:teuthology.orchestra.run.gibba005.stdout: "duration": 5.0897917789999996 2021-11-12T05:44:34.276 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:44:34.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.263+0000 7fa5052f7700 1 -- 172.21.2.105:0/243779563 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa4e40535b0 msgr2=0x7fa4e4055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:34.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.263+0000 7fa5052f7700 1 --2- 172.21.2.105:0/243779563 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa4e40535b0 0x7fa4e4055a70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fa4e8002f70 tx=0x7fa4e8006a80).stop 2021-11-12T05:44:34.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.263+0000 7fa5052f7700 1 -- 172.21.2.105:0/243779563 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa5000aca40 msgr2=0x7fa5000b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:34.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.263+0000 7fa5052f7700 1 --2- 172.21.2.105:0/243779563 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa5000aca40 0x7fa5000b4e60 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7fa4f0002f70 tx=0x7fa4f0014000).stop 2021-11-12T05:44:34.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.263+0000 7fa5052f7700 1 -- 172.21.2.105:0/243779563 shutdown_connections 2021-11-12T05:44:34.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.263+0000 7fa5052f7700 1 --2- 172.21.2.105:0/243779563 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa4e40535b0 0x7fa4e4055a70 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:34.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.263+0000 7fa5052f7700 1 --2- 172.21.2.105:0/243779563 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa5001478b0 0x7fa50013b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:34.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.263+0000 7fa5052f7700 1 --2- 172.21.2.105:0/243779563 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa5000b0520 0x7fa50013b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:34.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.263+0000 7fa5052f7700 1 --2- 172.21.2.105:0/243779563 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa5000aca40 0x7fa5000b4e60 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:34.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.263+0000 7fa5052f7700 1 -- 172.21.2.105:0/243779563 >> 172.21.2.105:0/243779563 conn(0x7fa50005c490 msgr2=0x7fa500146f80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:34.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.263+0000 7fa5052f7700 1 -- 172.21.2.105:0/243779563 shutdown_connections 2021-11-12T05:44:34.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.263+0000 7fa5052f7700 1 -- 172.21.2.105:0/243779563 wait complete. 2021-11-12T05:44:34.281 INFO:tasks.cephfs.fuse_mount:Cleaning up killed ceph-fuse connection 2021-11-12T05:44:34.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:44:34.282 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:44:34.282 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:44:34.292 INFO:teuthology.orchestra.run.gibba016.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-11-12T05:44:34.292 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:44:34.293 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-11-12T05:44:34.294 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba016.front.sepia.ceph.com... 2021-11-12T05:44:34.294 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-12T05:44:34.295 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:44:34.352 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:44:34.353 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:44:34.354 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:44:34.358 INFO:teuthology.orchestra.run.gibba016.stdout:ext2/ext3 2021-11-12T05:44:34.358 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-12T05:44:34.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:44:34.359 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:44:34.363 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:44:34.479 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba9a8ec700 1 Processor -- start 2021-11-12T05:44:34.479 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba9a8ec700 1 -- start start 2021-11-12T05:44:34.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba9a8ec700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fba940adaf0 0x7fba9413fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:34.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba9a8ec700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fba94143b40 0x7fba94143f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:34.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba9a8ec700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba94067860 con 0x7fba940aded0 2021-11-12T05:44:34.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba9a8ec700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba94143400 con 0x7fba94143b40 2021-11-12T05:44:34.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba9a8ec700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba941436a0 con 0x7fba940adaf0 2021-11-12T05:44:34.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba937fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fba94143b40 0x7fba94143f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:34.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba98e89700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fba940aded0 0x7fba940afe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:56522/0 (socket says 172.21.2.105:56522) 2021-11-12T05:44:34.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba98e89700 1 -- 172.21.2.105:0/2934029776 learned_addr learned my addr 172.21.2.105:0/2934029776 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:44:34.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba93fff700 1 --2- 172.21.2.105:0/2934029776 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fba940adaf0 0x7fba9413fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:34.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba937fe700 1 -- 172.21.2.105:0/2934029776 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fba940adaf0 msgr2=0x7fba9413fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:34.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba937fe700 1 --2- 172.21.2.105:0/2934029776 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fba940adaf0 0x7fba9413fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:34.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba937fe700 1 -- 172.21.2.105:0/2934029776 >> v1:172.21.2.105:6789/0 conn(0x7fba940aded0 legacy=0x7fba940afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:34.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba92ffd700 1 -- 172.21.2.105:0/2934029776 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1594540628 0 0) 0x7fba94067860 con 0x7fba940aded0 2021-11-12T05:44:34.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba937fe700 1 -- 172.21.2.105:0/2934029776 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba940b2b40 con 0x7fba94143b40 2021-11-12T05:44:34.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba937fe700 1 --2- 172.21.2.105:0/2934029776 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fba94143b40 0x7fba94143f80 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7fba84002f70 tx=0x7fba84006df0).ready entity=mon.0 client_cookie=e32a0b782e0abc2 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:34.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba92ffd700 1 -- 172.21.2.105:0/2934029776 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba8400d570 con 0x7fba94143b40 2021-11-12T05:44:34.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba92ffd700 1 -- 172.21.2.105:0/2934029776 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba84000e90 con 0x7fba94143b40 2021-11-12T05:44:34.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba92ffd700 1 -- 172.21.2.105:0/2934029776 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba8400d8c0 con 0x7fba94143b40 2021-11-12T05:44:34.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba9a8ec700 1 -- 172.21.2.105:0/2934029776 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fba94143b40 msgr2=0x7fba94143f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:34.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba9a8ec700 1 --2- 172.21.2.105:0/2934029776 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fba94143b40 0x7fba94143f80 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7fba84002f70 tx=0x7fba84006df0).stop 2021-11-12T05:44:34.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba9a8ec700 1 -- 172.21.2.105:0/2934029776 shutdown_connections 2021-11-12T05:44:34.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba9a8ec700 1 --2- 172.21.2.105:0/2934029776 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fba94143b40 0x7fba94143f80 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:34.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba9a8ec700 1 --2- 172.21.2.105:0/2934029776 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fba940adaf0 0x7fba9413fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:34.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba9a8ec700 1 -- 172.21.2.105:0/2934029776 >> 172.21.2.105:0/2934029776 conn(0x7fba9405c490 msgr2=0x7fba9405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:34.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba9a8ec700 1 -- 172.21.2.105:0/2934029776 shutdown_connections 2021-11-12T05:44:34.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba9a8ec700 1 -- 172.21.2.105:0/2934029776 wait complete. 2021-11-12T05:44:34.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba9a8ec700 1 Processor -- start 2021-11-12T05:44:34.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba9a8ec700 1 -- start start 2021-11-12T05:44:34.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba9a8ec700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fba940adaf0 0x7fba94063870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:34.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba9a8ec700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fba940aded0 0x7fba940b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:34.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba9a8ec700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fba94143b40 0x7fba940b66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:34.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba9a8ec700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba94064310 con 0x7fba940aded0 2021-11-12T05:44:34.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba9a8ec700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba94065c00 con 0x7fba94143b40 2021-11-12T05:44:34.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba9a8ec700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba940b6b90 con 0x7fba940adaf0 2021-11-12T05:44:34.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba937fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fba940aded0 0x7fba940b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:34.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba937fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fba940aded0 0x7fba940b61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46130/0 (socket says 172.21.2.105:46130) 2021-11-12T05:44:34.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.475+0000 7fba937fe700 1 -- 172.21.2.105:0/146298297 learned_addr learned my addr 172.21.2.105:0/146298297 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:34.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.479+0000 7fba937fe700 1 -- 172.21.2.105:0/146298297 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fba940adaf0 msgr2=0x7fba94063870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:34.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.479+0000 7fba937fe700 1 --2- 172.21.2.105:0/146298297 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fba940adaf0 0x7fba94063870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:34.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.479+0000 7fba937fe700 1 -- 172.21.2.105:0/146298297 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fba94143b40 msgr2=0x7fba940b66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:34.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.479+0000 7fba937fe700 1 --2- 172.21.2.105:0/146298297 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fba94143b40 0x7fba940b66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:34.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.479+0000 7fba937fe700 1 -- 172.21.2.105:0/146298297 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba8400b180 con 0x7fba940aded0 2021-11-12T05:44:34.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.479+0000 7fba937fe700 1 --2- 172.21.2.105:0/146298297 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fba940aded0 0x7fba940b61b0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7fba94065d40 tx=0x7fba84015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:34.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.479+0000 7fba917fa700 1 -- 172.21.2.105:0/146298297 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba84006a60 con 0x7fba940aded0 2021-11-12T05:44:34.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.479+0000 7fba917fa700 1 -- 172.21.2.105:0/146298297 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8400de60 con 0x7fba940aded0 2021-11-12T05:44:34.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.479+0000 7fba9a8ec700 1 -- 172.21.2.105:0/146298297 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba9413f800 con 0x7fba940aded0 2021-11-12T05:44:34.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.479+0000 7fba9a8ec700 1 -- 172.21.2.105:0/146298297 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba94065760 con 0x7fba940aded0 2021-11-12T05:44:34.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.479+0000 7fba917fa700 1 -- 172.21.2.105:0/146298297 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba84011e50 con 0x7fba940aded0 2021-11-12T05:44:34.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.479+0000 7fba9a8ec700 1 -- 172.21.2.105:0/146298297 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba940afb00 con 0x7fba940aded0 2021-11-12T05:44:34.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.479+0000 7fba917fa700 1 -- 172.21.2.105:0/146298297 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fba84025030 con 0x7fba940aded0 2021-11-12T05:44:34.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.479+0000 7fba917fa700 1 --2- 172.21.2.105:0/146298297 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fba780535d0 0x7fba78055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:34.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.479+0000 7fba917fa700 1 -- 172.21.2.105:0/146298297 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fba8406cf60 con 0x7fba940aded0 2021-11-12T05:44:34.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.479+0000 7fba93fff700 1 --2- 172.21.2.105:0/146298297 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fba780535d0 0x7fba78055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:34.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.479+0000 7fba93fff700 1 --2- 172.21.2.105:0/146298297 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fba780535d0 0x7fba78055a90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fba7c007000 tx=0x7fba7c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:34.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.483+0000 7fba917fa700 1 -- 172.21.2.105:0/146298297 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fba84043e60 con 0x7fba940aded0 2021-11-12T05:44:34.570 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.563+0000 7fba9a8ec700 1 -- 172.21.2.105:0/146298297 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba94057350 con 0x7fba940aded0 2021-11-12T05:44:34.570 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.567+0000 7fba917fa700 1 -- 172.21.2.105:0/146298297 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16273 (secure 0 0 0) 0x7fba84047480 con 0x7fba940aded0 2021-11-12T05:44:34.571 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:44:34.571 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":55,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:44:06.344759+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:44:03.259173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-11-12T05:44:04.311731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:44:34.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.567+0000 7fba9a8ec700 1 -- 172.21.2.105:0/146298297 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fba780535d0 msgr2=0x7fba78055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:34.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.567+0000 7fba9a8ec700 1 --2- 172.21.2.105:0/146298297 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fba780535d0 0x7fba78055a90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fba7c007000 tx=0x7fba7c008040).stop 2021-11-12T05:44:34.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.567+0000 7fba9a8ec700 1 -- 172.21.2.105:0/146298297 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fba940aded0 msgr2=0x7fba940b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:34.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.567+0000 7fba9a8ec700 1 --2- 172.21.2.105:0/146298297 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fba940aded0 0x7fba940b61b0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7fba94065d40 tx=0x7fba84015000).stop 2021-11-12T05:44:34.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.567+0000 7fba9a8ec700 1 -- 172.21.2.105:0/146298297 shutdown_connections 2021-11-12T05:44:34.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.567+0000 7fba9a8ec700 1 --2- 172.21.2.105:0/146298297 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fba780535d0 0x7fba78055a90 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:34.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.567+0000 7fba9a8ec700 1 --2- 172.21.2.105:0/146298297 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fba94143b40 0x7fba940b66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:34.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.567+0000 7fba9a8ec700 1 --2- 172.21.2.105:0/146298297 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fba940aded0 0x7fba940b61b0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:34.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.567+0000 7fba9a8ec700 1 --2- 172.21.2.105:0/146298297 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fba940adaf0 0x7fba94063870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:34.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.567+0000 7fba9a8ec700 1 -- 172.21.2.105:0/146298297 >> 172.21.2.105:0/146298297 conn(0x7fba9405c490 msgr2=0x7fba94141b70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:34.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.567+0000 7fba9a8ec700 1 -- 172.21.2.105:0/146298297 shutdown_connections 2021-11-12T05:44:34.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.567+0000 7fba9a8ec700 1 -- 172.21.2.105:0/146298297 wait complete. 2021-11-12T05:44:34.578 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-12T05:44:03.259173+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2021-11-12T05:44:04.311731+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-12T05:44:34.579 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:44:34.632 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.627+0000 7efcbc0ef700 1 Processor -- start 2021-11-12T05:44:34.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.627+0000 7efcbc0ef700 1 -- start start 2021-11-12T05:44:34.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.627+0000 7efcbc0ef700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7efcb40aca40 0x7efcb40ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:34.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.627+0000 7efcbc0ef700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efcb4144180 0x7efcb4144610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:34.634 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.627+0000 7efcbc0ef700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcb40b1840 con 0x7efcb40b0520 2021-11-12T05:44:34.634 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.627+0000 7efcbc0ef700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcb40b09d0 con 0x7efcb40aca40 2021-11-12T05:44:34.634 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.627+0000 7efcbc0ef700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb40af2b0 con 0x7efcb4144180 2021-11-12T05:44:34.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.627+0000 7efcb9e8b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7efcb40aca40 0x7efcb40ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:34.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.627+0000 7efcb9e8b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7efcb40aca40 0x7efcb40ace20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46140/0 (socket says 172.21.2.105:46140) 2021-11-12T05:44:34.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.627+0000 7efcb9e8b700 1 -- 172.21.2.105:0/1494224909 learned_addr learned my addr 172.21.2.105:0/1494224909 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:34.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.627+0000 7efcb9e8b700 1 -- 172.21.2.105:0/1494224909 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efcb4144180 msgr2=0x7efcb4144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:34.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.627+0000 7efcb9e8b700 1 --2- 172.21.2.105:0/1494224909 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efcb4144180 0x7efcb4144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:34.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.627+0000 7efcb9e8b700 1 -- 172.21.2.105:0/1494224909 >> v1:172.21.2.115:6789/0 conn(0x7efcb40b0520 legacy=0x7efcb41473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:34.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.627+0000 7efcb9e8b700 1 -- 172.21.2.105:0/1494224909 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb40b1a70 con 0x7efcb40aca40 2021-11-12T05:44:34.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.627+0000 7efcb9e8b700 1 --2- 172.21.2.105:0/1494224909 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efcb40aca40 0x7efcb40ace20 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7efcb4061140 tx=0x7efca8006eb0).ready entity=mon.0 client_cookie=899479323ef1f71e server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:34.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.627+0000 7efcb8e89700 1 -- 172.21.2.105:0/1494224909 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efca800d570 con 0x7efcb40aca40 2021-11-12T05:44:34.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.627+0000 7efcb8e89700 1 -- 172.21.2.105:0/1494224909 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca8000e90 con 0x7efcb40aca40 2021-11-12T05:44:34.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.627+0000 7efcb8e89700 1 -- 172.21.2.105:0/1494224909 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efca800d8c0 con 0x7efcb40aca40 2021-11-12T05:44:34.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.627+0000 7efcbc0ef700 1 -- 172.21.2.105:0/1494224909 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efcb40aca40 msgr2=0x7efcb40ace20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:34.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.627+0000 7efcbc0ef700 1 --2- 172.21.2.105:0/1494224909 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efcb40aca40 0x7efcb40ace20 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7efcb4061140 tx=0x7efca8006eb0).stop 2021-11-12T05:44:34.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.627+0000 7efcbc0ef700 1 -- 172.21.2.105:0/1494224909 shutdown_connections 2021-11-12T05:44:34.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.627+0000 7efcbc0ef700 1 --2- 172.21.2.105:0/1494224909 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efcb4144180 0x7efcb4144610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:34.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.627+0000 7efcbc0ef700 1 --2- 172.21.2.105:0/1494224909 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efcb40aca40 0x7efcb40ace20 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:34.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.627+0000 7efcbc0ef700 1 -- 172.21.2.105:0/1494224909 >> 172.21.2.105:0/1494224909 conn(0x7efcb405c490 msgr2=0x7efcb40b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:34.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.631+0000 7efcbc0ef700 1 -- 172.21.2.105:0/1494224909 shutdown_connections 2021-11-12T05:44:34.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.631+0000 7efcbc0ef700 1 -- 172.21.2.105:0/1494224909 wait complete. 2021-11-12T05:44:34.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.631+0000 7efcbc0ef700 1 Processor -- start 2021-11-12T05:44:34.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.631+0000 7efcbc0ef700 1 -- start start 2021-11-12T05:44:34.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.631+0000 7efcbc0ef700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efcb40aca40 0x7efcb41407e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:34.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.631+0000 7efcbc0ef700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efcb40b0520 0x7efcb4146130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:34.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.631+0000 7efcbc0ef700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efcb4144180 0x7efcb41566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:34.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.631+0000 7efcbc0ef700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb4062f50 con 0x7efcb40b0520 2021-11-12T05:44:34.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.631+0000 7efcbc0ef700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb4144fa0 con 0x7efcb4144180 2021-11-12T05:44:34.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.631+0000 7efcbc0ef700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb4144d00 con 0x7efcb40aca40 2021-11-12T05:44:34.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.631+0000 7efcb968a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efcb40b0520 0x7efcb4146130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:34.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.631+0000 7efcb968a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efcb40b0520 0x7efcb4146130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46148/0 (socket says 172.21.2.105:46148) 2021-11-12T05:44:34.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.631+0000 7efcb968a700 1 -- 172.21.2.105:0/3189293814 learned_addr learned my addr 172.21.2.105:0/3189293814 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:34.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.631+0000 7efcb968a700 1 -- 172.21.2.105:0/3189293814 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efcb40aca40 msgr2=0x7efcb41407e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:34.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.631+0000 7efcb968a700 1 --2- 172.21.2.105:0/3189293814 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efcb40aca40 0x7efcb41407e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:34.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.631+0000 7efcb968a700 1 -- 172.21.2.105:0/3189293814 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efcb4144180 msgr2=0x7efcb41566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:34.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.631+0000 7efcb968a700 1 --2- 172.21.2.105:0/3189293814 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efcb4144180 0x7efcb41566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:34.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.631+0000 7efcb968a700 1 -- 172.21.2.105:0/3189293814 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca800b1e0 con 0x7efcb40b0520 2021-11-12T05:44:34.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.631+0000 7efcb968a700 1 --2- 172.21.2.105:0/3189293814 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efcb40b0520 0x7efcb4146130 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7efcb0002f90 tx=0x7efcb0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:34.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.631+0000 7efca6ffd700 1 -- 172.21.2.105:0/3189293814 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efcb0013460 con 0x7efcb40b0520 2021-11-12T05:44:34.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.631+0000 7efca6ffd700 1 -- 172.21.2.105:0/3189293814 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb00135c0 con 0x7efcb40b0520 2021-11-12T05:44:34.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.631+0000 7efca6ffd700 1 -- 172.21.2.105:0/3189293814 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efcb0013920 con 0x7efcb40b0520 2021-11-12T05:44:34.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.631+0000 7efcbc0ef700 1 -- 172.21.2.105:0/3189293814 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb41449e0 con 0x7efcb40b0520 2021-11-12T05:44:34.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.631+0000 7efcbc0ef700 1 -- 172.21.2.105:0/3189293814 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb40b4f30 con 0x7efcb40b0520 2021-11-12T05:44:34.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.631+0000 7efcbc0ef700 1 -- 172.21.2.105:0/3189293814 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcb4148440 con 0x7efcb40b0520 2021-11-12T05:44:34.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.631+0000 7efca6ffd700 1 -- 172.21.2.105:0/3189293814 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efcb000f070 con 0x7efcb40b0520 2021-11-12T05:44:34.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.631+0000 7efca6ffd700 1 --2- 172.21.2.105:0/3189293814 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efc94053610 0x7efc94055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:34.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.631+0000 7efca6ffd700 1 -- 172.21.2.105:0/3189293814 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6416+0+0 (secure 0 0 0) 0x7efcb006b340 con 0x7efcb40b0520 2021-11-12T05:44:34.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.631+0000 7efcb9e8b700 1 --2- 172.21.2.105:0/3189293814 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efc94053610 0x7efc94055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:34.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.631+0000 7efcb9e8b700 1 --2- 172.21.2.105:0/3189293814 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efc94053610 0x7efc94055ad0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7efcb4061140 tx=0x7efca8015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:34.650 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.635+0000 7efca6ffd700 1 -- 172.21.2.105:0/3189293814 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efcb0042350 con 0x7efcb40b0520 2021-11-12T05:44:34.722 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.719+0000 7efcbc0ef700 1 -- 172.21.2.105:0/3189293814 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7efcb4057350 con 0x7efcb40b0520 2021-11-12T05:44:34.723 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.719+0000 7efca6ffd700 1 -- 172.21.2.105:0/3189293814 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v55) v1 ==== 110+0+10 (secure 0 0 0) 0x7efcb0045970 con 0x7efcb40b0520 2021-11-12T05:44:34.723 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:44:34.724 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.719+0000 7efcbc0ef700 1 -- 172.21.2.105:0/3189293814 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efc94053610 msgr2=0x7efc94055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:34.724 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.719+0000 7efcbc0ef700 1 --2- 172.21.2.105:0/3189293814 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efc94053610 0x7efc94055ad0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7efcb4061140 tx=0x7efca8015000).stop 2021-11-12T05:44:34.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.719+0000 7efcbc0ef700 1 -- 172.21.2.105:0/3189293814 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efcb40b0520 msgr2=0x7efcb4146130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:34.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.719+0000 7efcbc0ef700 1 --2- 172.21.2.105:0/3189293814 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efcb40b0520 0x7efcb4146130 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7efcb0002f90 tx=0x7efcb0006df0).stop 2021-11-12T05:44:34.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.719+0000 7efcbc0ef700 1 -- 172.21.2.105:0/3189293814 shutdown_connections 2021-11-12T05:44:34.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.719+0000 7efcbc0ef700 1 --2- 172.21.2.105:0/3189293814 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efc94053610 0x7efc94055ad0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:34.726 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.719+0000 7efcbc0ef700 1 --2- 172.21.2.105:0/3189293814 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efcb4144180 0x7efcb41566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:34.726 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.719+0000 7efcbc0ef700 1 --2- 172.21.2.105:0/3189293814 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efcb40b0520 0x7efcb4146130 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:34.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.719+0000 7efcbc0ef700 1 --2- 172.21.2.105:0/3189293814 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efcb40aca40 0x7efcb41407e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:34.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.719+0000 7efcbc0ef700 1 -- 172.21.2.105:0/3189293814 >> 172.21.2.105:0/3189293814 conn(0x7efcb405c490 msgr2=0x7efcb4148bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:34.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.719+0000 7efcbc0ef700 1 -- 172.21.2.105:0/3189293814 shutdown_connections 2021-11-12T05:44:34.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.719+0000 7efcbc0ef700 1 -- 172.21.2.105:0/3189293814 wait complete. 2021-11-12T05:44:34.730 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:44:34.783 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.779+0000 7f0c70e51700 1 Processor -- start 2021-11-12T05:44:34.783 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.779+0000 7f0c70e51700 1 -- start start 2021-11-12T05:44:34.783 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.779+0000 7f0c70e51700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0c6c0ace20 0x7f0c6c0b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:34.784 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.779+0000 7f0c70e51700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f0c6c144180 0x7f0c6c144610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:34.784 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.779+0000 7f0c70e51700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c6c0b1840 con 0x7f0c6c0aca40 2021-11-12T05:44:34.784 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.779+0000 7f0c70e51700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c6c0ad2a0 con 0x7f0c6c144180 2021-11-12T05:44:34.784 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.779+0000 7f0c70e51700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c0b0a10 con 0x7f0c6c0ace20 2021-11-12T05:44:34.785 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.779+0000 7f0c6a59c700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f0c6c0aca40 0x7f0c6c1473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:56548/0 (socket says 172.21.2.105:56548) 2021-11-12T05:44:34.785 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.779+0000 7f0c6a59c700 1 -- 172.21.2.105:0/3698203620 learned_addr learned my addr 172.21.2.105:0/3698203620 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:44:34.785 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.779+0000 7f0c6ad9d700 1 --2- 172.21.2.105:0/3698203620 >> v2:172.21.2.105:3300/0 conn(0x7f0c6c144180 0x7f0c6c144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:34.788 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.779+0000 7f0c6ad9d700 1 -- 172.21.2.105:0/3698203620 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0c6c0ace20 msgr2=0x7f0c6c0b0520 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:44:34.789 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.779+0000 7f0c6ad9d700 1 --2- 172.21.2.105:0/3698203620 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0c6c0ace20 0x7f0c6c0b0520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:34.789 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.779+0000 7f0c6ad9d700 1 -- 172.21.2.105:0/3698203620 >> v1:172.21.2.105:6789/0 conn(0x7f0c6c0aca40 legacy=0x7f0c6c1473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:34.789 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.779+0000 7f0c6959a700 1 -- 172.21.2.105:0/3698203620 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2223413 0 0) 0x7f0c6c0b1840 con 0x7f0c6c0aca40 2021-11-12T05:44:34.789 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.779+0000 7f0c6ad9d700 1 -- 172.21.2.105:0/3698203620 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6c0af2b0 con 0x7f0c6c144180 2021-11-12T05:44:34.790 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.779+0000 7f0c6ad9d700 1 --2- 172.21.2.105:0/3698203620 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0c6c144180 0x7f0c6c144610 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f0c640032f0 tx=0x7f0c640091d0).ready entity=mon.0 client_cookie=552e4f665205c51a server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:34.790 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.779+0000 7f0c6959a700 1 -- 172.21.2.105:0/3698203620 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c64009ea0 con 0x7f0c6c144180 2021-11-12T05:44:34.790 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.779+0000 7f0c6959a700 1 -- 172.21.2.105:0/3698203620 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6400b8a0 con 0x7f0c6c144180 2021-11-12T05:44:34.790 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.779+0000 7f0c6959a700 1 -- 172.21.2.105:0/3698203620 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c6400ba50 con 0x7f0c6c144180 2021-11-12T05:44:34.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.779+0000 7f0c70e51700 1 -- 172.21.2.105:0/3698203620 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0c6c144180 msgr2=0x7f0c6c144610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:34.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.779+0000 7f0c70e51700 1 --2- 172.21.2.105:0/3698203620 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0c6c144180 0x7f0c6c144610 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f0c640032f0 tx=0x7f0c640091d0).stop 2021-11-12T05:44:34.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.779+0000 7f0c70e51700 1 -- 172.21.2.105:0/3698203620 shutdown_connections 2021-11-12T05:44:34.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.779+0000 7f0c70e51700 1 --2- 172.21.2.105:0/3698203620 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0c6c144180 0x7f0c6c144610 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:34.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.779+0000 7f0c70e51700 1 --2- 172.21.2.105:0/3698203620 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0c6c0ace20 0x7f0c6c0b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:34.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.779+0000 7f0c70e51700 1 -- 172.21.2.105:0/3698203620 >> 172.21.2.105:0/3698203620 conn(0x7f0c6c05c490 msgr2=0x7f0c6c0b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:34.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.779+0000 7f0c70e51700 1 -- 172.21.2.105:0/3698203620 shutdown_connections 2021-11-12T05:44:34.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.779+0000 7f0c70e51700 1 -- 172.21.2.105:0/3698203620 wait complete. 2021-11-12T05:44:34.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.779+0000 7f0c70e51700 1 Processor -- start 2021-11-12T05:44:34.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.779+0000 7f0c70e51700 1 -- start start 2021-11-12T05:44:34.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.779+0000 7f0c70e51700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0c6c0aca40 0x7f0c6c0628a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:34.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.779+0000 7f0c70e51700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0c6c0ace20 0x7f0c6c1465d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:34.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.779+0000 7f0c70e51700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0c6c144180 0x7f0c6c15a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:34.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.779+0000 7f0c70e51700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c140ab0 con 0x7f0c6c0aca40 2021-11-12T05:44:34.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.779+0000 7f0c70e51700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c145170 con 0x7f0c6c0ace20 2021-11-12T05:44:34.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.779+0000 7f0c70e51700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c1453a0 con 0x7f0c6c144180 2021-11-12T05:44:34.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.779+0000 7f0c6a59c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0c6c0aca40 0x7f0c6c0628a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:34.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.779+0000 7f0c6a59c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0c6c0aca40 0x7f0c6c0628a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46158/0 (socket says 172.21.2.105:46158) 2021-11-12T05:44:34.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.779+0000 7f0c6a59c700 1 -- 172.21.2.105:0/1740571876 learned_addr learned my addr 172.21.2.105:0/1740571876 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:34.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.783+0000 7f0c6a59c700 1 -- 172.21.2.105:0/1740571876 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0c6c144180 msgr2=0x7f0c6c15a170 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:44:34.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.783+0000 7f0c6a59c700 1 --2- 172.21.2.105:0/1740571876 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0c6c144180 0x7f0c6c15a170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:34.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.783+0000 7f0c6a59c700 1 -- 172.21.2.105:0/1740571876 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0c6c0ace20 msgr2=0x7f0c6c1465d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:44:34.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.783+0000 7f0c6a59c700 1 --2- 172.21.2.105:0/1740571876 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0c6c0ace20 0x7f0c6c1465d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:34.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.783+0000 7f0c6a59c700 1 -- 172.21.2.105:0/1740571876 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c64009470 con 0x7f0c6c0aca40 2021-11-12T05:44:34.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.783+0000 7f0c6a59c700 1 --2- 172.21.2.105:0/1740571876 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0c6c0aca40 0x7f0c6c0628a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f0c6c147c30 tx=0x7f0c5c007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:34.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.783+0000 7f0c637fe700 1 -- 172.21.2.105:0/1740571876 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c5c00ce40 con 0x7f0c6c0aca40 2021-11-12T05:44:34.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.783+0000 7f0c637fe700 1 -- 172.21.2.105:0/1740571876 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c5c0072e0 con 0x7f0c6c0aca40 2021-11-12T05:44:34.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.783+0000 7f0c637fe700 1 -- 172.21.2.105:0/1740571876 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c5c005800 con 0x7f0c6c0aca40 2021-11-12T05:44:34.798 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.783+0000 7f0c70e51700 1 -- 172.21.2.105:0/1740571876 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c6c1456a0 con 0x7f0c6c0aca40 2021-11-12T05:44:34.798 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.783+0000 7f0c70e51700 1 -- 172.21.2.105:0/1740571876 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c6c146c60 con 0x7f0c6c0aca40 2021-11-12T05:44:34.798 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.783+0000 7f0c70e51700 1 -- 172.21.2.105:0/1740571876 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c6c062d90 con 0x7f0c6c0aca40 2021-11-12T05:44:34.798 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.783+0000 7f0c637fe700 1 -- 172.21.2.105:0/1740571876 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0c5c010070 con 0x7f0c6c0aca40 2021-11-12T05:44:34.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.783+0000 7f0c637fe700 1 --2- 172.21.2.105:0/1740571876 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0c500536a0 0x7f0c50055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:34.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.783+0000 7f0c637fe700 1 -- 172.21.2.105:0/1740571876 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f0c5c06b3a0 con 0x7f0c6c0aca40 2021-11-12T05:44:34.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.783+0000 7f0c69d9b700 1 --2- 172.21.2.105:0/1740571876 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0c500536a0 0x7f0c50055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:34.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.783+0000 7f0c69d9b700 1 --2- 172.21.2.105:0/1740571876 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0c500536a0 0x7f0c50055b60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f0c54002fb0 tx=0x7f0c54006930).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:34.800 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.787+0000 7f0c637fe700 1 -- 172.21.2.105:0/1740571876 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0c5c0422a0 con 0x7f0c6c0aca40 2021-11-12T05:44:34.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.867+0000 7f0c70e51700 1 -- 172.21.2.105:0/1740571876 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0c6c05f280 con 0x7f0c6c0aca40 2021-11-12T05:44:34.875 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.867+0000 7f0c637fe700 1 -- 172.21.2.105:0/1740571876 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v55) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0c5c0458c0 con 0x7f0c6c0aca40 2021-11-12T05:44:34.876 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:44:34.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.871+0000 7f0c70e51700 1 -- 172.21.2.105:0/1740571876 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0c500536a0 msgr2=0x7f0c50055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:34.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.871+0000 7f0c70e51700 1 --2- 172.21.2.105:0/1740571876 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0c500536a0 0x7f0c50055b60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f0c54002fb0 tx=0x7f0c54006930).stop 2021-11-12T05:44:34.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.871+0000 7f0c70e51700 1 -- 172.21.2.105:0/1740571876 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0c6c0aca40 msgr2=0x7f0c6c0628a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:34.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.871+0000 7f0c70e51700 1 --2- 172.21.2.105:0/1740571876 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0c6c0aca40 0x7f0c6c0628a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f0c6c147c30 tx=0x7f0c5c007a60).stop 2021-11-12T05:44:34.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.871+0000 7f0c70e51700 1 -- 172.21.2.105:0/1740571876 shutdown_connections 2021-11-12T05:44:34.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.871+0000 7f0c70e51700 1 --2- 172.21.2.105:0/1740571876 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0c500536a0 0x7f0c50055b60 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:34.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.871+0000 7f0c70e51700 1 --2- 172.21.2.105:0/1740571876 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0c6c144180 0x7f0c6c15a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:34.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.871+0000 7f0c70e51700 1 --2- 172.21.2.105:0/1740571876 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0c6c0ace20 0x7f0c6c1465d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:34.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.871+0000 7f0c70e51700 1 --2- 172.21.2.105:0/1740571876 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0c6c0aca40 0x7f0c6c0628a0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:34.881 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.871+0000 7f0c70e51700 1 -- 172.21.2.105:0/1740571876 >> 172.21.2.105:0/1740571876 conn(0x7f0c6c05c490 msgr2=0x7f0c6c148890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:34.881 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.871+0000 7f0c70e51700 1 -- 172.21.2.105:0/1740571876 shutdown_connections 2021-11-12T05:44:34.881 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.871+0000 7f0c70e51700 1 -- 172.21.2.105:0/1740571876 wait complete. 2021-11-12T05:44:34.883 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-12T05:44:34.936 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.931+0000 7ff1fa417700 1 Processor -- start 2021-11-12T05:44:34.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.931+0000 7ff1fa417700 1 -- start start 2021-11-12T05:44:34.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.931+0000 7ff1fa417700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7ff1f4130a80 0x7ff1f4062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:34.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.931+0000 7ff1fa417700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1f40b0d50 con 0x7ff1f40626b0 2021-11-12T05:44:34.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.931+0000 7ff1fa417700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1f40ad380 con 0x7ff1f40af750 2021-11-12T05:44:34.938 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.931+0000 7ff1fa417700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1f40ae190 con 0x7ff1f4130a80 2021-11-12T05:44:34.942 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.931+0000 7ff1f3fff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7ff1f40626b0 0x7ff1f4130370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:56562/0 (socket says 172.21.2.105:56562) 2021-11-12T05:44:34.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.931+0000 7ff1f3fff700 1 -- 172.21.2.105:0/359714684 learned_addr learned my addr 172.21.2.105:0/359714684 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:44:34.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.931+0000 7ff1f2ffd700 1 -- 172.21.2.105:0/359714684 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 500146480 0 0) 0x7ff1f40b0d50 con 0x7ff1f40626b0 2021-11-12T05:44:34.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.931+0000 7ff1f2ffd700 1 -- 172.21.2.105:0/359714684 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1d4003260 con 0x7ff1f40626b0 2021-11-12T05:44:34.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.931+0000 7ff1f2ffd700 1 -- 172.21.2.105:0/359714684 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4235776414 0 0) 0x7ff1d4003260 con 0x7ff1f40626b0 2021-11-12T05:44:34.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.931+0000 7ff1f2ffd700 1 -- 172.21.2.105:0/359714684 >> v2:172.21.2.115:3300/0 conn(0x7ff1f4130a80 msgr2=0x7ff1f4062a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:34.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.931+0000 7ff1f2ffd700 1 --2- 172.21.2.105:0/359714684 >> v2:172.21.2.115:3300/0 conn(0x7ff1f4130a80 0x7ff1f4062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:34.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.931+0000 7ff1f2ffd700 1 -- 172.21.2.105:0/359714684 >> v1:172.21.2.115:6789/0 conn(0x7ff1f40af750 legacy=0x7ff1f41474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:34.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.931+0000 7ff1f2ffd700 1 -- 172.21.2.105:0/359714684 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f40ae2d0 con 0x7ff1f40626b0 2021-11-12T05:44:34.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.931+0000 7ff1f2ffd700 1 -- 172.21.2.105:0/359714684 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7ff1dc001660 con 0x7ff1f40626b0 2021-11-12T05:44:34.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.931+0000 7ff1f2ffd700 1 -- 172.21.2.105:0/359714684 >> v1:172.21.2.105:6789/0 conn(0x7ff1f40626b0 legacy=0x7ff1f4130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:34.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.931+0000 7ff1f2ffd700 1 --2- 172.21.2.105:0/359714684 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff1d4003820 0x7ff1d4003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:34.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.931+0000 7ff1f2ffd700 1 --2- 172.21.2.105:0/359714684 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff1d4004500 0x7ff1d4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:34.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.931+0000 7ff1f2ffd700 1 --2- 172.21.2.105:0/359714684 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff1d4005050 0x7ff1d400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:34.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.931+0000 7ff1f2ffd700 1 -- 172.21.2.105:0/359714684 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f40ae190 con 0x7ff1d4004500 2021-11-12T05:44:34.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.931+0000 7ff1f2ffd700 1 -- 172.21.2.105:0/359714684 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d400bf40 con 0x7ff1d4005050 2021-11-12T05:44:34.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.931+0000 7ff1f2ffd700 1 -- 172.21.2.105:0/359714684 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d400c100 con 0x7ff1d4003820 2021-11-12T05:44:34.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.931+0000 7ff1f37fe700 1 --2- 172.21.2.105:0/359714684 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff1d4004500 0x7ff1d4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:34.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.931+0000 7ff1f37fe700 1 -- 172.21.2.105:0/359714684 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff1d4003820 msgr2=0x7ff1d4003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:34.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.931+0000 7ff1f37fe700 1 --2- 172.21.2.105:0/359714684 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff1d4003820 0x7ff1d4003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:34.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.931+0000 7ff1f37fe700 1 -- 172.21.2.105:0/359714684 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff1d4005050 msgr2=0x7ff1d400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:34.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.931+0000 7ff1f37fe700 1 --2- 172.21.2.105:0/359714684 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff1d4005050 0x7ff1d400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:34.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.931+0000 7ff1f37fe700 1 -- 172.21.2.105:0/359714684 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d4003260 con 0x7ff1d4004500 2021-11-12T05:44:34.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.931+0000 7ff1f89b4700 1 -- 172.21.2.105:0/359714684 reap_dead start 2021-11-12T05:44:34.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.931+0000 7ff1f37fe700 1 --2- 172.21.2.105:0/359714684 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff1d4004500 0x7ff1d4004980 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7ff1e4000f70 tx=0x7ff1e40079e0).ready entity=mon.0 client_cookie=82b383c2a452ef55 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:34.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.931+0000 7ff1f2ffd700 1 -- 172.21.2.105:0/359714684 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1e4007cf0 con 0x7ff1d4004500 2021-11-12T05:44:34.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.935+0000 7ff1f2ffd700 1 -- 172.21.2.105:0/359714684 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e4014410 con 0x7ff1d4004500 2021-11-12T05:44:34.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.935+0000 7ff1f2ffd700 1 -- 172.21.2.105:0/359714684 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1e4014770 con 0x7ff1d4004500 2021-11-12T05:44:34.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.935+0000 7ff1fa417700 1 -- 172.21.2.105:0/359714684 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff1d4004500 msgr2=0x7ff1d4004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:34.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.935+0000 7ff1fa417700 1 --2- 172.21.2.105:0/359714684 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff1d4004500 0x7ff1d4004980 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7ff1e4000f70 tx=0x7ff1e40079e0).stop 2021-11-12T05:44:34.950 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.935+0000 7ff1fa417700 1 -- 172.21.2.105:0/359714684 shutdown_connections 2021-11-12T05:44:34.950 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.935+0000 7ff1fa417700 1 --2- 172.21.2.105:0/359714684 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff1d4004500 0x7ff1d4004980 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:34.950 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.935+0000 7ff1fa417700 1 -- 172.21.2.105:0/359714684 >> 172.21.2.105:0/359714684 conn(0x7ff1f40b5320 msgr2=0x7ff1f40b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:34.950 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.935+0000 7ff1fa417700 1 -- 172.21.2.105:0/359714684 shutdown_connections 2021-11-12T05:44:34.951 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.935+0000 7ff1fa417700 1 -- 172.21.2.105:0/359714684 wait complete. 2021-11-12T05:44:34.951 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.935+0000 7ff1fa417700 1 Processor -- start 2021-11-12T05:44:34.951 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.935+0000 7ff1fa417700 1 -- start start 2021-11-12T05:44:34.951 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.935+0000 7ff1fa417700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff1d4004500 0x7ff1f41465c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:34.951 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.935+0000 7ff1fa417700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff1f40640e0 0x7ff1f4065200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:34.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.935+0000 7ff1fa417700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff1f4063680 0x7ff1f4063b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:34.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.935+0000 7ff1fa417700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f412e050 con 0x7ff1f40640e0 2021-11-12T05:44:34.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.935+0000 7ff1fa417700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f4062fb0 con 0x7ff1f4063680 2021-11-12T05:44:34.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.935+0000 7ff1fa417700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f41575f0 con 0x7ff1d4004500 2021-11-12T05:44:34.953 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.935+0000 7ff1f37fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff1f40640e0 0x7ff1f4065200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:34.953 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.935+0000 7ff1f37fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff1f40640e0 0x7ff1f4065200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46180/0 (socket says 172.21.2.105:46180) 2021-11-12T05:44:34.953 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.935+0000 7ff1f37fe700 1 -- 172.21.2.105:0/2557425223 learned_addr learned my addr 172.21.2.105:0/2557425223 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:34.953 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.935+0000 7ff1f89b4700 1 --2- 172.21.2.105:0/2557425223 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff1f4063680 0x7ff1f4063b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:34.953 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.935+0000 7ff1f3fff700 1 --2- 172.21.2.105:0/2557425223 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff1d4004500 0x7ff1f41465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:34.954 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.935+0000 7ff1f37fe700 1 -- 172.21.2.105:0/2557425223 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff1d4004500 msgr2=0x7ff1f41465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:34.954 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.935+0000 7ff1f37fe700 1 --2- 172.21.2.105:0/2557425223 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff1d4004500 0x7ff1f41465c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:34.954 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.935+0000 7ff1f37fe700 1 -- 172.21.2.105:0/2557425223 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff1f4063680 msgr2=0x7ff1f4063b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:34.955 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.935+0000 7ff1f37fe700 1 --2- 172.21.2.105:0/2557425223 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff1f4063680 0x7ff1f4063b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:34.955 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.935+0000 7ff1f37fe700 1 -- 172.21.2.105:0/2557425223 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f40631e0 con 0x7ff1f40640e0 2021-11-12T05:44:34.955 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.935+0000 7ff1f3fff700 1 --2- 172.21.2.105:0/2557425223 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff1d4004500 0x7ff1f41465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:44:34.955 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.935+0000 7ff1f37fe700 1 --2- 172.21.2.105:0/2557425223 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff1f40640e0 0x7ff1f4065200 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7ff1f4147bb0 tx=0x7ff1e4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:34.955 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.935+0000 7ff1f17fa700 1 -- 172.21.2.105:0/2557425223 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1e40137c0 con 0x7ff1f40640e0 2021-11-12T05:44:34.956 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.935+0000 7ff1f17fa700 1 -- 172.21.2.105:0/2557425223 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e4013920 con 0x7ff1f40640e0 2021-11-12T05:44:34.956 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.935+0000 7ff1fa417700 1 -- 172.21.2.105:0/2557425223 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1f40656f0 con 0x7ff1f40640e0 2021-11-12T05:44:34.956 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.935+0000 7ff1fa417700 1 -- 172.21.2.105:0/2557425223 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1f4064670 con 0x7ff1f40640e0 2021-11-12T05:44:34.957 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.935+0000 7ff1f17fa700 1 -- 172.21.2.105:0/2557425223 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1e4013c80 con 0x7ff1f40640e0 2021-11-12T05:44:34.957 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.935+0000 7ff1fa417700 1 -- 172.21.2.105:0/2557425223 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1f4157410 con 0x7ff1f40640e0 2021-11-12T05:44:34.957 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.935+0000 7ff1f17fa700 1 -- 172.21.2.105:0/2557425223 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff1e4022470 con 0x7ff1f40640e0 2021-11-12T05:44:34.957 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.939+0000 7ff1f17fa700 1 --2- 172.21.2.105:0/2557425223 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff1d8053570 0x7ff1d8055a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:34.958 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.939+0000 7ff1f17fa700 1 -- 172.21.2.105:0/2557425223 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6416+0+0 (secure 0 0 0) 0x7ff1e401c040 con 0x7ff1f40640e0 2021-11-12T05:44:34.958 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.939+0000 7ff1f3fff700 1 --2- 172.21.2.105:0/2557425223 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff1d8053570 0x7ff1d8055a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:34.959 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.939+0000 7ff1f3fff700 1 --2- 172.21.2.105:0/2557425223 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff1d8053570 0x7ff1d8055a30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7ff1dc008000 tx=0x7ff1dc009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:34.959 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:34.939+0000 7ff1f17fa700 1 -- 172.21.2.105:0/2557425223 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff1e4043f40 con 0x7ff1f40640e0 2021-11-12T05:44:35.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.023+0000 7ff1fa417700 1 -- 172.21.2.105:0/2557425223 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff1f4063370 con 0x7ff1f40640e0 2021-11-12T05:44:35.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.023+0000 7ff1f17fa700 1 -- 172.21.2.105:0/2557425223 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v55) v1 ==== 104+0+10 (secure 0 0 0) 0x7ff1e4047560 con 0x7ff1f40640e0 2021-11-12T05:44:35.027 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:44:35.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.023+0000 7ff1fa417700 1 -- 172.21.2.105:0/2557425223 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff1d8053570 msgr2=0x7ff1d8055a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:35.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.023+0000 7ff1fa417700 1 --2- 172.21.2.105:0/2557425223 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff1d8053570 0x7ff1d8055a30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7ff1dc008000 tx=0x7ff1dc009040).stop 2021-11-12T05:44:35.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.023+0000 7ff1fa417700 1 -- 172.21.2.105:0/2557425223 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff1f40640e0 msgr2=0x7ff1f4065200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:35.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.023+0000 7ff1fa417700 1 --2- 172.21.2.105:0/2557425223 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff1f40640e0 0x7ff1f4065200 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7ff1f4147bb0 tx=0x7ff1e4015000).stop 2021-11-12T05:44:35.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.023+0000 7ff1fa417700 1 -- 172.21.2.105:0/2557425223 shutdown_connections 2021-11-12T05:44:35.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.023+0000 7ff1fa417700 1 --2- 172.21.2.105:0/2557425223 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff1d8053570 0x7ff1d8055a30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:35.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.023+0000 7ff1fa417700 1 --2- 172.21.2.105:0/2557425223 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff1f4063680 0x7ff1f4063b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:35.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.023+0000 7ff1fa417700 1 --2- 172.21.2.105:0/2557425223 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff1f40640e0 0x7ff1f4065200 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:35.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.023+0000 7ff1fa417700 1 --2- 172.21.2.105:0/2557425223 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff1d4004500 0x7ff1f41465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:35.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.023+0000 7ff1fa417700 1 -- 172.21.2.105:0/2557425223 >> 172.21.2.105:0/2557425223 conn(0x7ff1f40b5320 msgr2=0x7ff1f412ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:35.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.023+0000 7ff1fa417700 1 -- 172.21.2.105:0/2557425223 shutdown_connections 2021-11-12T05:44:35.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.023+0000 7ff1fa417700 1 -- 172.21.2.105:0/2557425223 wait complete. 2021-11-12T05:44:35.035 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-12T05:44:35.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.084+0000 7f3998d73700 1 Processor -- start 2021-11-12T05:44:35.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.084+0000 7f3998d73700 1 -- start start 2021-11-12T05:44:35.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.084+0000 7f3998d73700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f39940aca40 0x7f39940ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:35.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.084+0000 7f3998d73700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f39940b0520 0x7f39941473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:35.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.084+0000 7f3998d73700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39940b1840 con 0x7f39941478b0 2021-11-12T05:44:35.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.084+0000 7f3998d73700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3994147d20 con 0x7f39940aca40 2021-11-12T05:44:35.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.084+0000 7f3998d73700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39940b09d0 con 0x7f39940b0520 2021-11-12T05:44:35.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.084+0000 7f399259c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f39940aca40 0x7f39940ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:35.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.084+0000 7f3992d9d700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f39941478b0 0x7f3994144180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:56582/0 (socket says 172.21.2.105:56582) 2021-11-12T05:44:35.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.084+0000 7f3992d9d700 1 -- 172.21.2.105:0/839187280 learned_addr learned my addr 172.21.2.105:0/839187280 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:44:35.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.084+0000 7f399259c700 1 -- 172.21.2.105:0/839187280 >> v2:172.21.2.115:3300/0 conn(0x7f39940b0520 msgr2=0x7f39941473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:35.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.084+0000 7f399259c700 1 --2- 172.21.2.105:0/839187280 >> v2:172.21.2.115:3300/0 conn(0x7f39940b0520 0x7f39941473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:35.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.084+0000 7f399259c700 1 -- 172.21.2.105:0/839187280 >> v1:172.21.2.105:6789/0 conn(0x7f39941478b0 legacy=0x7f3994144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:35.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.084+0000 7f399259c700 1 -- 172.21.2.105:0/839187280 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39940af2b0 con 0x7f39940aca40 2021-11-12T05:44:35.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.084+0000 7f399259c700 1 --2- 172.21.2.105:0/839187280 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f39940aca40 0x7f39940ace20 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f397c002f70 tx=0x7f397c006df0).ready entity=mon.0 client_cookie=bb7495d558625db0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:35.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.084+0000 7f399159a700 1 -- 172.21.2.105:0/839187280 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f397c00d5c0 con 0x7f39940aca40 2021-11-12T05:44:35.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.084+0000 7f399159a700 1 -- 172.21.2.105:0/839187280 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397c000e90 con 0x7f39940aca40 2021-11-12T05:44:35.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.084+0000 7f399159a700 1 -- 172.21.2.105:0/839187280 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f397c00d910 con 0x7f39940aca40 2021-11-12T05:44:35.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.084+0000 7f3998d73700 1 -- 172.21.2.105:0/839187280 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f39940aca40 msgr2=0x7f39940ace20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:35.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.084+0000 7f3998d73700 1 --2- 172.21.2.105:0/839187280 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f39940aca40 0x7f39940ace20 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f397c002f70 tx=0x7f397c006df0).stop 2021-11-12T05:44:35.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.084+0000 7f3998d73700 1 -- 172.21.2.105:0/839187280 shutdown_connections 2021-11-12T05:44:35.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.084+0000 7f3998d73700 1 --2- 172.21.2.105:0/839187280 >> v2:172.21.2.115:3300/0 conn(0x7f39940b0520 0x7f39941473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:35.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.084+0000 7f3998d73700 1 --2- 172.21.2.105:0/839187280 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f39940aca40 0x7f39940ace20 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:35.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.084+0000 7f3998d73700 1 -- 172.21.2.105:0/839187280 >> 172.21.2.105:0/839187280 conn(0x7f399405c490 msgr2=0x7f39940b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:35.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.084+0000 7f3998d73700 1 -- 172.21.2.105:0/839187280 shutdown_connections 2021-11-12T05:44:35.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.088+0000 7f3998d73700 1 -- 172.21.2.105:0/839187280 wait complete. 2021-11-12T05:44:35.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.088+0000 7f3998d73700 1 Processor -- start 2021-11-12T05:44:35.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.088+0000 7f3998d73700 1 -- start start 2021-11-12T05:44:35.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.088+0000 7f3998d73700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f39940b0520 0x7f399414e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:35.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.088+0000 7f3998d73700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f39941478b0 0x7f3994066270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:35.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.088+0000 7f3998d73700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f39940624f0 0x7f3994066760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:35.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.088+0000 7f3998d73700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399415a850 con 0x7f39940624f0 2021-11-12T05:44:35.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.088+0000 7f3998d73700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399415aa80 con 0x7f39941478b0 2021-11-12T05:44:35.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.088+0000 7f3998d73700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f399415ad20 con 0x7f39940b0520 2021-11-12T05:44:35.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.088+0000 7f3992d9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f39940624f0 0x7f3994066760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:35.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.088+0000 7f3992d9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f39940624f0 0x7f3994066760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46190/0 (socket says 172.21.2.105:46190) 2021-11-12T05:44:35.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.088+0000 7f3992d9d700 1 -- 172.21.2.105:0/2713354998 learned_addr learned my addr 172.21.2.105:0/2713354998 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:35.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.088+0000 7f3992d9d700 1 -- 172.21.2.105:0/2713354998 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f39940b0520 msgr2=0x7f399414e700 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:44:35.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.088+0000 7f3992d9d700 1 --2- 172.21.2.105:0/2713354998 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f39940b0520 0x7f399414e700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:35.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.088+0000 7f3992d9d700 1 -- 172.21.2.105:0/2713354998 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f39941478b0 msgr2=0x7f3994066270 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:44:35.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.088+0000 7f3992d9d700 1 --2- 172.21.2.105:0/2713354998 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f39941478b0 0x7f3994066270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:35.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.088+0000 7f3992d9d700 1 -- 172.21.2.105:0/2713354998 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f397c00b180 con 0x7f39940624f0 2021-11-12T05:44:35.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.088+0000 7f3992d9d700 1 --2- 172.21.2.105:0/2713354998 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f39940624f0 0x7f3994066760 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f3994061140 tx=0x7f398c007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:35.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.088+0000 7f398b7fe700 1 -- 172.21.2.105:0/2713354998 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f398c005ba0 con 0x7f39940624f0 2021-11-12T05:44:35.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.088+0000 7f398b7fe700 1 -- 172.21.2.105:0/2713354998 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398c005d00 con 0x7f39940624f0 2021-11-12T05:44:35.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.088+0000 7f398b7fe700 1 -- 172.21.2.105:0/2713354998 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f398c0072c0 con 0x7f39940624f0 2021-11-12T05:44:35.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.088+0000 7f3998d73700 1 -- 172.21.2.105:0/2713354998 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3994156a00 con 0x7f39940624f0 2021-11-12T05:44:35.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.088+0000 7f3998d73700 1 -- 172.21.2.105:0/2713354998 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3994067210 con 0x7f39940624f0 2021-11-12T05:44:35.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.088+0000 7f3998d73700 1 -- 172.21.2.105:0/2713354998 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3994065df0 con 0x7f39940624f0 2021-11-12T05:44:35.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.088+0000 7f398b7fe700 1 -- 172.21.2.105:0/2713354998 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f398c01a070 con 0x7f39940624f0 2021-11-12T05:44:35.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.088+0000 7f398b7fe700 1 --2- 172.21.2.105:0/2713354998 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3978053610 0x7f3978055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:35.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.088+0000 7f398b7fe700 1 -- 172.21.2.105:0/2713354998 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f398c06afe0 con 0x7f39940624f0 2021-11-12T05:44:35.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.088+0000 7f399259c700 1 --2- 172.21.2.105:0/2713354998 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3978053610 0x7f3978055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:35.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.088+0000 7f399259c700 1 --2- 172.21.2.105:0/2713354998 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3978053610 0x7f3978055ad0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f397c002f70 tx=0x7f397c014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:35.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.092+0000 7f398b7fe700 1 -- 172.21.2.105:0/2713354998 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f398c041ff0 con 0x7f39940624f0 2021-11-12T05:44:35.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.176+0000 7f3998d73700 1 -- 172.21.2.105:0/2713354998 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3994156b90 con 0x7f39940624f0 2021-11-12T05:44:35.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.176+0000 7f398b7fe700 1 -- 172.21.2.105:0/2713354998 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v55) v1 ==== 100+0+10 (secure 0 0 0) 0x7f398c045610 con 0x7f39940624f0 2021-11-12T05:44:35.180 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:44:35.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.176+0000 7f3998d73700 1 -- 172.21.2.105:0/2713354998 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3978053610 msgr2=0x7f3978055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:35.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.176+0000 7f3998d73700 1 --2- 172.21.2.105:0/2713354998 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3978053610 0x7f3978055ad0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f397c002f70 tx=0x7f397c014000).stop 2021-11-12T05:44:35.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.176+0000 7f3998d73700 1 -- 172.21.2.105:0/2713354998 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f39940624f0 msgr2=0x7f3994066760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:35.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.176+0000 7f3998d73700 1 --2- 172.21.2.105:0/2713354998 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f39940624f0 0x7f3994066760 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f3994061140 tx=0x7f398c007f60).stop 2021-11-12T05:44:35.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.176+0000 7f3998d73700 1 -- 172.21.2.105:0/2713354998 shutdown_connections 2021-11-12T05:44:35.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.176+0000 7f3998d73700 1 --2- 172.21.2.105:0/2713354998 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3978053610 0x7f3978055ad0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:35.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.176+0000 7f3998d73700 1 --2- 172.21.2.105:0/2713354998 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f39940624f0 0x7f3994066760 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:35.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.176+0000 7f3998d73700 1 --2- 172.21.2.105:0/2713354998 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f39941478b0 0x7f3994066270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:35.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.176+0000 7f3998d73700 1 --2- 172.21.2.105:0/2713354998 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f39940b0520 0x7f399414e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:35.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.176+0000 7f3998d73700 1 -- 172.21.2.105:0/2713354998 >> 172.21.2.105:0/2713354998 conn(0x7f399405c490 msgr2=0x7f3994145730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:35.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.176+0000 7f3998d73700 1 -- 172.21.2.105:0/2713354998 shutdown_connections 2021-11-12T05:44:35.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.176+0000 7f3998d73700 1 -- 172.21.2.105:0/2713354998 wait complete. 2021-11-12T05:44:35.187 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-12T05:44:35.188 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:44:35.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.232+0000 7ff197770700 1 Processor -- start 2021-11-12T05:44:35.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.232+0000 7ff197770700 1 -- start start 2021-11-12T05:44:35.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.236+0000 7ff197770700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7ff1900626f0 0x7ff1900af590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:35.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.236+0000 7ff197770700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff190142c70 0x7ff1900ab9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:35.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.236+0000 7ff197770700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1900b10b0 con 0x7ff1900ad0d0 2021-11-12T05:44:35.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.236+0000 7ff197770700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff19013f5b0 con 0x7ff190142c70 2021-11-12T05:44:35.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.236+0000 7ff197770700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff190062ad0 con 0x7ff1900626f0 2021-11-12T05:44:35.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.236+0000 7ff194d0b700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7ff1900ad0d0 0x7ff1900ad870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:56592/0 (socket says 172.21.2.105:56592) 2021-11-12T05:44:35.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.236+0000 7ff194d0b700 1 -- 172.21.2.105:0/615820236 learned_addr learned my addr 172.21.2.105:0/615820236 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:44:35.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.236+0000 7ff195d0d700 1 --2- 172.21.2.105:0/615820236 >> v2:172.21.2.105:3300/0 conn(0x7ff190142c70 0x7ff1900ab9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:35.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.236+0000 7ff195d0d700 1 -- 172.21.2.105:0/615820236 >> v2:172.21.2.115:3300/0 conn(0x7ff1900626f0 msgr2=0x7ff1900af590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:44:35.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.236+0000 7ff195d0d700 1 --2- 172.21.2.105:0/615820236 >> v2:172.21.2.115:3300/0 conn(0x7ff1900626f0 0x7ff1900af590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:35.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.236+0000 7ff195d0d700 1 -- 172.21.2.105:0/615820236 >> v1:172.21.2.105:6789/0 conn(0x7ff1900ad0d0 legacy=0x7ff1900ad870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:35.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.236+0000 7ff195d0d700 1 -- 172.21.2.105:0/615820236 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1900b12e0 con 0x7ff190142c70 2021-11-12T05:44:35.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.236+0000 7ff195d0d700 1 --2- 172.21.2.105:0/615820236 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff190142c70 0x7ff1900ab9b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7ff1880032f0 tx=0x7ff1880091d0).ready entity=mon.0 client_cookie=f44a395c98d2b6f4 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:35.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.236+0000 7ff183fff700 1 -- 172.21.2.105:0/615820236 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff188009ea0 con 0x7ff190142c70 2021-11-12T05:44:35.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.236+0000 7ff183fff700 1 -- 172.21.2.105:0/615820236 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff18800b870 con 0x7ff190142c70 2021-11-12T05:44:35.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.236+0000 7ff183fff700 1 -- 172.21.2.105:0/615820236 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff18800b9e0 con 0x7ff190142c70 2021-11-12T05:44:35.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.236+0000 7ff197770700 1 -- 172.21.2.105:0/615820236 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff190142c70 msgr2=0x7ff1900ab9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:35.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.236+0000 7ff197770700 1 --2- 172.21.2.105:0/615820236 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff190142c70 0x7ff1900ab9b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7ff1880032f0 tx=0x7ff1880091d0).stop 2021-11-12T05:44:35.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.236+0000 7ff197770700 1 -- 172.21.2.105:0/615820236 shutdown_connections 2021-11-12T05:44:35.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.236+0000 7ff197770700 1 --2- 172.21.2.105:0/615820236 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff190142c70 0x7ff1900ab9b0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:35.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.236+0000 7ff197770700 1 --2- 172.21.2.105:0/615820236 >> v2:172.21.2.115:3300/0 conn(0x7ff1900626f0 0x7ff1900af590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:35.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.236+0000 7ff197770700 1 -- 172.21.2.105:0/615820236 >> 172.21.2.105:0/615820236 conn(0x7ff1900b5370 msgr2=0x7ff1900b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:35.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.236+0000 7ff197770700 1 -- 172.21.2.105:0/615820236 shutdown_connections 2021-11-12T05:44:35.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.236+0000 7ff197770700 1 -- 172.21.2.105:0/615820236 wait complete. 2021-11-12T05:44:35.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.236+0000 7ff197770700 1 Processor -- start 2021-11-12T05:44:35.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.236+0000 7ff197770700 1 -- start start 2021-11-12T05:44:35.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.236+0000 7ff197770700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff1900626f0 0x7ff190064d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:35.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.236+0000 7ff197770700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff1900ad0d0 0x7ff1900668b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:35.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.236+0000 7ff197770700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff190142c70 0x7ff190141970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:35.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.236+0000 7ff197770700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19013a2d0 con 0x7ff1900626f0 2021-11-12T05:44:35.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.236+0000 7ff197770700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff190135300 con 0x7ff190142c70 2021-11-12T05:44:35.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.236+0000 7ff197770700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1900648f0 con 0x7ff1900ad0d0 2021-11-12T05:44:35.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.236+0000 7ff19550c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff1900626f0 0x7ff190064d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:35.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.236+0000 7ff19550c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff1900626f0 0x7ff190064d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46202/0 (socket says 172.21.2.105:46202) 2021-11-12T05:44:35.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.236+0000 7ff19550c700 1 -- 172.21.2.105:0/603331623 learned_addr learned my addr 172.21.2.105:0/603331623 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:44:35.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.240+0000 7ff19550c700 1 -- 172.21.2.105:0/603331623 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff1900ad0d0 msgr2=0x7ff1900668b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:44:35.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.240+0000 7ff19550c700 1 --2- 172.21.2.105:0/603331623 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff1900ad0d0 0x7ff1900668b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:35.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.240+0000 7ff19550c700 1 -- 172.21.2.105:0/603331623 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff190142c70 msgr2=0x7ff190141970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:35.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.240+0000 7ff19550c700 1 --2- 172.21.2.105:0/603331623 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff190142c70 0x7ff190141970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:35.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.240+0000 7ff19550c700 1 -- 172.21.2.105:0/603331623 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff188009470 con 0x7ff1900626f0 2021-11-12T05:44:35.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.240+0000 7ff19550c700 1 --2- 172.21.2.105:0/603331623 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff1900626f0 0x7ff190064d50 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7ff184002f70 tx=0x7ff184006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:35.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.240+0000 7ff1827fc700 1 -- 172.21.2.105:0/603331623 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff184013460 con 0x7ff1900626f0 2021-11-12T05:44:35.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.240+0000 7ff1827fc700 1 -- 172.21.2.105:0/603331623 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1840135c0 con 0x7ff1900626f0 2021-11-12T05:44:35.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.240+0000 7ff197770700 1 -- 172.21.2.105:0/603331623 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff19013a030 con 0x7ff1900626f0 2021-11-12T05:44:35.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.240+0000 7ff197770700 1 -- 172.21.2.105:0/603331623 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1900b4fa0 con 0x7ff1900626f0 2021-11-12T05:44:35.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.240+0000 7ff1827fc700 1 -- 172.21.2.105:0/603331623 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff184013920 con 0x7ff1900626f0 2021-11-12T05:44:35.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.240+0000 7ff197770700 1 -- 172.21.2.105:0/603331623 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1900b1580 con 0x7ff1900626f0 2021-11-12T05:44:35.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.240+0000 7ff1827fc700 1 -- 172.21.2.105:0/603331623 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff18401a060 con 0x7ff1900626f0 2021-11-12T05:44:35.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.240+0000 7ff1827fc700 1 --2- 172.21.2.105:0/603331623 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff170053690 0x7ff170055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:44:35.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.240+0000 7ff1827fc700 1 -- 172.21.2.105:0/603331623 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6416+0+0 (secure 0 0 0) 0x7ff18406b640 con 0x7ff1900626f0 2021-11-12T05:44:35.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.240+0000 7ff194d0b700 1 --2- 172.21.2.105:0/603331623 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff170053690 0x7ff170055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:44:35.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.240+0000 7ff194d0b700 1 --2- 172.21.2.105:0/603331623 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff170053690 0x7ff170055b50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7ff1900af430 tx=0x7ff18c0077d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:44:35.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.244+0000 7ff1827fc700 1 -- 172.21.2.105:0/603331623 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff184042550 con 0x7ff1900626f0 2021-11-12T05:44:35.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.348+0000 7ff197770700 1 -- 172.21.2.105:0/603331623 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff190064a30 con 0x7ff1900626f0 2021-11-12T05:44:35.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.348+0000 7ff1827fc700 1 -- 172.21.2.105:0/603331623 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+2136 (secure 0 0 0) 0x7ff184018030 con 0x7ff1900626f0 2021-11-12T05:44:35.354 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:44:35.354 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":20,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4478,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/1513907466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":1513907466},{"type":"v1","addr":"172.21.2.115:6833","nonce":1513907466}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":18}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:44:05.340503+0000","modified":"2021-11-12T05:44:06.343650+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5610":{"gid":5610,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/351884283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":351884283},{"type":"v1","addr":"172.21.2.105:6835","nonce":351884283}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-11-12T05:44:35.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.352+0000 7ff197770700 1 -- 172.21.2.105:0/603331623 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff170053690 msgr2=0x7ff170055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:35.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.352+0000 7ff197770700 1 --2- 172.21.2.105:0/603331623 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff170053690 0x7ff170055b50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7ff1900af430 tx=0x7ff18c0077d0).stop 2021-11-12T05:44:35.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.352+0000 7ff197770700 1 -- 172.21.2.105:0/603331623 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff1900626f0 msgr2=0x7ff190064d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:44:35.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.352+0000 7ff197770700 1 --2- 172.21.2.105:0/603331623 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff1900626f0 0x7ff190064d50 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7ff184002f70 tx=0x7ff184006ec0).stop 2021-11-12T05:44:35.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.352+0000 7ff197770700 1 -- 172.21.2.105:0/603331623 shutdown_connections 2021-11-12T05:44:35.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.352+0000 7ff197770700 1 --2- 172.21.2.105:0/603331623 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff170053690 0x7ff170055b50 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:35.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.352+0000 7ff197770700 1 --2- 172.21.2.105:0/603331623 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff190142c70 0x7ff190141970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:35.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.352+0000 7ff197770700 1 --2- 172.21.2.105:0/603331623 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff1900ad0d0 0x7ff1900668b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:44:35.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.352+0000 7ff197770700 1 --2- 172.21.2.105:0/603331623 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff1900626f0 0x7ff190064d50 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:44:35.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.352+0000 7ff197770700 1 -- 172.21.2.105:0/603331623 >> 172.21.2.105:0/603331623 conn(0x7ff1900b5370 msgr2=0x7ff19013fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:44:35.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.352+0000 7ff197770700 1 -- 172.21.2.105:0/603331623 shutdown_connections 2021-11-12T05:44:35.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:44:35.352+0000 7ff197770700 1 -- 172.21.2.105:0/603331623 wait complete. 2021-11-12T05:44:35.358 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 20 2021-11-12T05:44:35.563 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:44:05.340503+0000', 'modified': '2021-11-12T05:44:06.343650+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5610}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5610': {'gid': 5610, 'name': 'a', 'rank': 0, 'incarnation': 19, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/351884283', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 351884283}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 351884283}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:44:35.564 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:44:35.564 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:44:35.629 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":5610,"want_state":"up:active","state":"up:active","rank_uptime":30.281405277000001,"mdsmap_epoch":20,"osdmap_epoch":55,"osdmap_epoch_barrier":54,"uptime":34.440239128000002} 2021-11-12T05:44:35.629 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 5610, "mdsmap_epoch": 20, "osdmap_epoch": 55, "osdmap_epoch_barrier": 54, "rank_uptime": 30.281405277, "state": "up:active", "uptime": 34.440239128, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:44:35.630 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-12T05:44:35.630 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-12T05:44:35.631 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba016.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-12T05:44:35.631 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:44:35.631 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:44:35.643 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:44:35.655 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:44:35.655 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:44:35.661 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:44:35.662 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:44:35.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:44:35.663 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:44:35.667 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-12T05:44:35.668 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:44:35.712 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:44:35.721 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:44:35.722 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:44:35.726 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:44:35.727 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:44:35.728 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:44:35.729 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:44:35.752 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[14412]: starting ceph client 2021-11-12T05:44:35.753 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:2021-11-12T05:44:35.749+0000 7f432013a080 -1 init, newargv = 0x563cd91bda00 newargc=9 2021-11-12T05:44:35.767 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[14412]: starting fuse 2021-11-12T05:44:36.857 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:44:36.869 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:44:36.870 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:44:36.917 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:44:36.918 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:44:36.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:44:36.919 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:44:36.924 INFO:teuthology.orchestra.run.gibba016.stdout:52 2021-11-12T05:44:36.925 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-12T05:44:36.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:44:36.926 DEBUG:teuthology.orchestra.run.gibba016:> sudo python3 -c ' 2021-11-12T05:44:36.926 DEBUG:teuthology.orchestra.run.gibba016:> import glob 2021-11-12T05:44:36.926 DEBUG:teuthology.orchestra.run.gibba016:> import re 2021-11-12T05:44:36.927 DEBUG:teuthology.orchestra.run.gibba016:> import os 2021-11-12T05:44:36.927 DEBUG:teuthology.orchestra.run.gibba016:> import subprocess 2021-11-12T05:44:36.928 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:44:36.928 DEBUG:teuthology.orchestra.run.gibba016:> def find_socket(client_name): 2021-11-12T05:44:36.928 DEBUG:teuthology.orchestra.run.gibba016:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-12T05:44:36.929 DEBUG:teuthology.orchestra.run.gibba016:> files = glob.glob(asok_path) 2021-11-12T05:44:36.929 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:44:36.930 DEBUG:teuthology.orchestra.run.gibba016:> # Given a non-glob path, it better be there 2021-11-12T05:44:36.930 DEBUG:teuthology.orchestra.run.gibba016:> if "*" not in asok_path: 2021-11-12T05:44:36.930 DEBUG:teuthology.orchestra.run.gibba016:> assert(len(files) == 1) 2021-11-12T05:44:36.931 DEBUG:teuthology.orchestra.run.gibba016:> return files[0] 2021-11-12T05:44:36.931 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:44:36.932 DEBUG:teuthology.orchestra.run.gibba016:> for f in files: 2021-11-12T05:44:36.932 DEBUG:teuthology.orchestra.run.gibba016:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-12T05:44:36.933 DEBUG:teuthology.orchestra.run.gibba016:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-12T05:44:36.933 DEBUG:teuthology.orchestra.run.gibba016:> return f 2021-11-12T05:44:36.933 DEBUG:teuthology.orchestra.run.gibba016:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-12T05:44:36.934 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:44:36.934 DEBUG:teuthology.orchestra.run.gibba016:> print(find_socket("client.0")) 2021-11-12T05:44:36.934 DEBUG:teuthology.orchestra.run.gibba016:> ' 2021-11-12T05:44:36.962 INFO:teuthology.orchestra.run.gibba016.stdout:/var/run/ceph/ceph-client.0.14412.asok 2021-11-12T05:44:36.971 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14412.asok 2021-11-12T05:44:36.972 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:44:36.972 DEBUG:teuthology.orchestra.run.gibba016:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14412.asok status 2021-11-12T05:44:37.064 INFO:teuthology.orchestra.run.gibba016.stdout:{ 2021-11-12T05:44:37.064 INFO:teuthology.orchestra.run.gibba016.stdout: "metadata": { 2021-11-12T05:44:37.064 INFO:teuthology.orchestra.run.gibba016.stdout: "ceph_sha1": "a81ee2815de5acae59ead5b8c9137b6766fc8ea8", 2021-11-12T05:44:37.064 INFO:teuthology.orchestra.run.gibba016.stdout: "ceph_version": "ceph version 15.2.15-22-ga81ee281 (a81ee2815de5acae59ead5b8c9137b6766fc8ea8) octopus (stable)", 2021-11-12T05:44:37.065 INFO:teuthology.orchestra.run.gibba016.stdout: "entity_id": "0", 2021-11-12T05:44:37.065 INFO:teuthology.orchestra.run.gibba016.stdout: "hostname": "gibba016", 2021-11-12T05:44:37.065 INFO:teuthology.orchestra.run.gibba016.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-12T05:44:37.065 INFO:teuthology.orchestra.run.gibba016.stdout: "pid": "14412", 2021-11-12T05:44:37.066 INFO:teuthology.orchestra.run.gibba016.stdout: "root": "/" 2021-11-12T05:44:37.066 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:44:37.066 INFO:teuthology.orchestra.run.gibba016.stdout: "dentry_count": 0, 2021-11-12T05:44:37.066 INFO:teuthology.orchestra.run.gibba016.stdout: "dentry_pinned_count": 0, 2021-11-12T05:44:37.067 INFO:teuthology.orchestra.run.gibba016.stdout: "id": 4729, 2021-11-12T05:44:37.067 INFO:teuthology.orchestra.run.gibba016.stdout: "inst": { 2021-11-12T05:44:37.067 INFO:teuthology.orchestra.run.gibba016.stdout: "name": { 2021-11-12T05:44:37.067 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "client", 2021-11-12T05:44:37.067 INFO:teuthology.orchestra.run.gibba016.stdout: "num": 4729 2021-11-12T05:44:37.068 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:44:37.068 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": { 2021-11-12T05:44:37.068 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "v1", 2021-11-12T05:44:37.068 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": "172.21.2.116:0", 2021-11-12T05:44:37.068 INFO:teuthology.orchestra.run.gibba016.stdout: "nonce": 2283387651 2021-11-12T05:44:37.069 INFO:teuthology.orchestra.run.gibba016.stdout: } 2021-11-12T05:44:37.069 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:44:37.069 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": { 2021-11-12T05:44:37.069 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "v1", 2021-11-12T05:44:37.070 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": "172.21.2.116:0", 2021-11-12T05:44:37.070 INFO:teuthology.orchestra.run.gibba016.stdout: "nonce": 2283387651 2021-11-12T05:44:37.070 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:44:37.070 INFO:teuthology.orchestra.run.gibba016.stdout: "inst_str": "client.4729 172.21.2.116:0/2283387651", 2021-11-12T05:44:37.070 INFO:teuthology.orchestra.run.gibba016.stdout: "addr_str": "172.21.2.116:0/2283387651", 2021-11-12T05:44:37.071 INFO:teuthology.orchestra.run.gibba016.stdout: "inode_count": 1, 2021-11-12T05:44:37.071 INFO:teuthology.orchestra.run.gibba016.stdout: "mds_epoch": 20, 2021-11-12T05:44:37.072 INFO:teuthology.orchestra.run.gibba016.stdout: "osd_epoch": 55, 2021-11-12T05:44:37.072 INFO:teuthology.orchestra.run.gibba016.stdout: "osd_epoch_barrier": 0, 2021-11-12T05:44:37.072 INFO:teuthology.orchestra.run.gibba016.stdout: "blacklisted": false, 2021-11-12T05:44:37.072 INFO:teuthology.orchestra.run.gibba016.stdout: "fs_name": "cephfs" 2021-11-12T05:44:37.073 INFO:teuthology.orchestra.run.gibba016.stdout:} 2021-11-12T05:44:37.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:44:37.074 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:44:37.075 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:44:37.081 INFO:teuthology.orchestra.run.gibba016.stdout:fuseblk 2021-11-12T05:44:37.081 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-12T05:44:37.082 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:44:37.082 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:44:54.646 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:44:54.650 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:44:54.653 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:44:54.656 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:44:54.660 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:45:24.727 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:45:24.731 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:45:24.735 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:45:24.738 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:45:24.742 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:45:31.194 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-12T05:45:31.195 DEBUG:teuthology.orchestra.run.gibba005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:45:31.207 DEBUG:teuthology.orchestra.run.gibba015:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:45:31.220 DEBUG:teuthology.orchestra.run.gibba016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:45:31.233 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:45:31.247 DEBUG:teuthology.orchestra.run.gibba044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:45:31.260 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-12T05:45:31.261 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:45:31.261 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:45:31.262 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:45:31.267 INFO:teuthology.orchestra.run.gibba016.stdout:fuseblk 2021-11-12T05:45:31.268 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-12T05:45:31.269 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba016.front.sepia.ceph.com... 2021-11-12T05:45:31.269 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-12T05:45:31.269 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:45:31.278 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[14412]: fuse finished with error 0 and tester_r 0 2021-11-12T05:45:31.279 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:45:31.281 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:45:31.282 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:45:31.363 INFO:teuthology.orchestra.run.gibba016.stdout:ext2/ext3 2021-11-12T05:45:31.363 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-12T05:45:31.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:45:31.365 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:45:31.372 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:45:31.373 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:45:31.373 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:45:31.384 INFO:teuthology.orchestra.run.gibba038.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-12T05:45:31.385 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:45:31.386 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-12T05:45:31.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:45:31.387 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:45:31.395 INFO:teuthology.orchestra.run.gibba038.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-12T05:45:31.396 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:45:31.397 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:45:31.398 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:45:31.398 DEBUG:teuthology.orchestra.run.gibba044:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:45:31.408 INFO:teuthology.orchestra.run.gibba044.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-12T05:45:31.408 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:45:31.409 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-12T05:45:31.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:45:31.410 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:45:31.459 INFO:teuthology.orchestra.run.gibba044.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-12T05:45:31.460 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:45:31.461 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-12T05:45:31.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.512+0000 7f2af066b700 1 Processor -- start 2021-11-12T05:45:31.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.512+0000 7f2af066b700 1 -- start start 2021-11-12T05:45:31.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.512+0000 7f2af066b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2ae80626b0 0x7f2ae8062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:31.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.512+0000 7f2af066b700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f2ae80af750 0x7f2ae8130370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:31.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.512+0000 7f2af066b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f2ae8130860 0x7f2ae814a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:31.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.512+0000 7f2af066b700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae8130cf0 con 0x7f2ae8130860 2021-11-12T05:45:31.520 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.512+0000 7f2af066b700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae80b0d50 con 0x7f2ae80af750 2021-11-12T05:45:31.520 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.512+0000 7f2af066b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae80ad380 con 0x7f2ae80626b0 2021-11-12T05:45:31.520 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.512+0000 7f2aeec08700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f2ae8130860 0x7f2ae814a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:31.520 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.512+0000 7f2aeec08700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f2ae8130860 0x7f2ae814a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46212/0 (socket says 172.21.2.105:46212) 2021-11-12T05:45:31.521 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.512+0000 7f2aeec08700 1 -- 172.21.2.105:0/3516357830 learned_addr learned my addr 172.21.2.105:0/3516357830 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:31.521 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.512+0000 7f2aeec08700 1 -- 172.21.2.105:0/3516357830 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2ae80626b0 msgr2=0x7f2ae8062a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:31.521 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.512+0000 7f2aeec08700 1 --2- 172.21.2.105:0/3516357830 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2ae80626b0 0x7f2ae8062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:31.521 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.512+0000 7f2aeec08700 1 -- 172.21.2.105:0/3516357830 >> v2:172.21.2.115:3300/0 conn(0x7f2ae80af750 msgr2=0x7f2ae8130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:31.521 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.512+0000 7f2aeec08700 1 --2- 172.21.2.105:0/3516357830 >> v2:172.21.2.115:3300/0 conn(0x7f2ae80af750 0x7f2ae8130370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:31.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.512+0000 7f2aeec08700 1 -- 172.21.2.105:0/3516357830 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae80ae190 con 0x7f2ae8130860 2021-11-12T05:45:31.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.512+0000 7f2aeec08700 1 --2- 172.21.2.105:0/3516357830 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ae8130860 0x7f2ae814a950 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f2ae00032f0 tx=0x7f2ae0009290).ready entity=mon.0 client_cookie=840e87c71bb06786 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:31.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.512+0000 7f2aed405700 1 -- 172.21.2.105:0/3516357830 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ae000b870 con 0x7f2ae8130860 2021-11-12T05:45:31.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.512+0000 7f2aed405700 1 -- 172.21.2.105:0/3516357830 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae000b9d0 con 0x7f2ae8130860 2021-11-12T05:45:31.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.512+0000 7f2aed405700 1 -- 172.21.2.105:0/3516357830 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ae000bb40 con 0x7f2ae8130860 2021-11-12T05:45:31.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.512+0000 7f2af066b700 1 -- 172.21.2.105:0/3516357830 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ae8130860 msgr2=0x7f2ae814a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:31.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.512+0000 7f2af066b700 1 --2- 172.21.2.105:0/3516357830 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ae8130860 0x7f2ae814a950 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f2ae00032f0 tx=0x7f2ae0009290).stop 2021-11-12T05:45:31.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.512+0000 7f2af066b700 1 -- 172.21.2.105:0/3516357830 shutdown_connections 2021-11-12T05:45:31.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.512+0000 7f2af066b700 1 --2- 172.21.2.105:0/3516357830 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ae8130860 0x7f2ae814a950 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:31.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.512+0000 7f2af066b700 1 --2- 172.21.2.105:0/3516357830 >> v2:172.21.2.115:3300/0 conn(0x7f2ae80af750 0x7f2ae8130370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:31.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.512+0000 7f2af066b700 1 --2- 172.21.2.105:0/3516357830 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2ae80626b0 0x7f2ae8062a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:31.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.512+0000 7f2af066b700 1 -- 172.21.2.105:0/3516357830 >> 172.21.2.105:0/3516357830 conn(0x7f2ae80b5320 msgr2=0x7f2ae80b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:31.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.512+0000 7f2af066b700 1 -- 172.21.2.105:0/3516357830 shutdown_connections 2021-11-12T05:45:31.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.512+0000 7f2af066b700 1 -- 172.21.2.105:0/3516357830 wait complete. 2021-11-12T05:45:31.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.516+0000 7f2af066b700 1 Processor -- start 2021-11-12T05:45:31.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.516+0000 7f2af066b700 1 -- start start 2021-11-12T05:45:31.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.516+0000 7f2af066b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ae80626b0 0x7f2ae81345a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:31.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.516+0000 7f2af066b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2ae80af750 0x7f2ae8134c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:31.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.516+0000 7f2af066b700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2ae8130860 0x7f2ae8144590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:31.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.516+0000 7f2af066b700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae81570c0 con 0x7f2ae80626b0 2021-11-12T05:45:31.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.516+0000 7f2af066b700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae81572e0 con 0x7f2ae8130860 2021-11-12T05:45:31.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.516+0000 7f2af066b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae8157580 con 0x7f2ae80af750 2021-11-12T05:45:31.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.516+0000 7f2aee407700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ae80626b0 0x7f2ae81345a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:31.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.516+0000 7f2aee407700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ae80626b0 0x7f2ae81345a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46216/0 (socket says 172.21.2.105:46216) 2021-11-12T05:45:31.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.516+0000 7f2aee407700 1 -- 172.21.2.105:0/3110723110 learned_addr learned my addr 172.21.2.105:0/3110723110 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:31.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.516+0000 7f2aee407700 1 -- 172.21.2.105:0/3110723110 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2ae80af750 msgr2=0x7f2ae8134c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:31.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.516+0000 7f2aee407700 1 --2- 172.21.2.105:0/3110723110 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2ae80af750 0x7f2ae8134c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:31.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.516+0000 7f2aee407700 1 -- 172.21.2.105:0/3110723110 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2ae8130860 msgr2=0x7f2ae8144590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:31.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.516+0000 7f2aee407700 1 --2- 172.21.2.105:0/3110723110 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2ae8130860 0x7f2ae8144590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:31.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.516+0000 7f2aee407700 1 -- 172.21.2.105:0/3110723110 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae0009530 con 0x7f2ae80626b0 2021-11-12T05:45:31.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.516+0000 7f2aee407700 1 --2- 172.21.2.105:0/3110723110 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ae80626b0 0x7f2ae81345a0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f2ae4002f70 tx=0x7f2ae4006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:31.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.516+0000 7f2adb7fe700 1 -- 172.21.2.105:0/3110723110 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ae4013460 con 0x7f2ae80626b0 2021-11-12T05:45:31.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.516+0000 7f2adb7fe700 1 -- 172.21.2.105:0/3110723110 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae40135c0 con 0x7f2ae80626b0 2021-11-12T05:45:31.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.516+0000 7f2adb7fe700 1 -- 172.21.2.105:0/3110723110 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ae4013920 con 0x7f2ae80626b0 2021-11-12T05:45:31.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.516+0000 7f2af066b700 1 -- 172.21.2.105:0/3110723110 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ae80668a0 con 0x7f2ae80626b0 2021-11-12T05:45:31.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.516+0000 7f2af066b700 1 -- 172.21.2.105:0/3110723110 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae81312f0 con 0x7f2ae80626b0 2021-11-12T05:45:31.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.516+0000 7f2af066b700 1 -- 172.21.2.105:0/3110723110 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ae8157740 con 0x7f2ae80626b0 2021-11-12T05:45:31.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.516+0000 7f2adb7fe700 1 -- 172.21.2.105:0/3110723110 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2ae401a060 con 0x7f2ae80626b0 2021-11-12T05:45:31.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.516+0000 7f2adb7fe700 1 --2- 172.21.2.105:0/3110723110 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2ac80536f0 0x7f2ac8055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:31.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.516+0000 7f2adb7fe700 1 -- 172.21.2.105:0/3110723110 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f2ae406b600 con 0x7f2ae80626b0 2021-11-12T05:45:31.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.516+0000 7f2aedc06700 1 --2- 172.21.2.105:0/3110723110 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2ac80536f0 0x7f2ac8055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:31.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.516+0000 7f2aedc06700 1 --2- 172.21.2.105:0/3110723110 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2ac80536f0 0x7f2ac8055bb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f2adc002f70 tx=0x7f2adc006a00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:31.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.520+0000 7f2adb7fe700 1 -- 172.21.2.105:0/3110723110 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2ae4042500 con 0x7f2ae80626b0 2021-11-12T05:45:31.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.600+0000 7f2af066b700 1 -- 172.21.2.105:0/3110723110 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f2ae814ae40 con 0x7f2ae80626b0 2021-11-12T05:45:31.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.604+0000 7f2adb7fe700 1 -- 172.21.2.105:0/3110723110 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v55) v1 ==== 81+0+34039 (secure 0 0 0) 0x7f2ae4018030 con 0x7f2ae80626b0 2021-11-12T05:45:31.607 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:45:31.608 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:45:31.608 INFO:teuthology.orchestra.run.gibba005.stdout: "epoch": 55, 2021-11-12T05:45:31.608 INFO:teuthology.orchestra.run.gibba005.stdout: "fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", 2021-11-12T05:45:31.608 INFO:teuthology.orchestra.run.gibba005.stdout: "created": "2021-11-12T05:40:19.986390+0000", 2021-11-12T05:45:31.609 INFO:teuthology.orchestra.run.gibba005.stdout: "modified": "2021-11-12T05:44:06.344759+0000", 2021-11-12T05:45:31.609 INFO:teuthology.orchestra.run.gibba005.stdout: "last_up_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:45:31.609 INFO:teuthology.orchestra.run.gibba005.stdout: "last_in_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:45:31.609 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-12T05:45:31.610 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_num": 5799936, 2021-11-12T05:45:31.610 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_set": [ 2021-11-12T05:45:31.610 INFO:teuthology.orchestra.run.gibba005.stdout: "pglog_hardlimit", 2021-11-12T05:45:31.610 INFO:teuthology.orchestra.run.gibba005.stdout: "purged_snapdirs", 2021-11-12T05:45:31.611 INFO:teuthology.orchestra.run.gibba005.stdout: "recovery_deletes", 2021-11-12T05:45:31.611 INFO:teuthology.orchestra.run.gibba005.stdout: "sortbitwise" 2021-11-12T05:45:31.611 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:45:31.611 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_version": 5, 2021-11-12T05:45:31.612 INFO:teuthology.orchestra.run.gibba005.stdout: "full_ratio": 0.94999998807907104, 2021-11-12T05:45:31.612 INFO:teuthology.orchestra.run.gibba005.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-12T05:45:31.612 INFO:teuthology.orchestra.run.gibba005.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-12T05:45:31.612 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_snapshot": "", 2021-11-12T05:45:31.612 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_max": 10, 2021-11-12T05:45:31.613 INFO:teuthology.orchestra.run.gibba005.stdout: "max_osd": 8, 2021-11-12T05:45:31.613 INFO:teuthology.orchestra.run.gibba005.stdout: "require_min_compat_client": "jewel", 2021-11-12T05:45:31.613 INFO:teuthology.orchestra.run.gibba005.stdout: "min_compat_client": "jewel", 2021-11-12T05:45:31.613 INFO:teuthology.orchestra.run.gibba005.stdout: "require_osd_release": "octopus", 2021-11-12T05:45:31.614 INFO:teuthology.orchestra.run.gibba005.stdout: "pools": [ 2021-11-12T05:45:31.614 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.614 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 1, 2021-11-12T05:45:31.614 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "device_health_metrics", 2021-11-12T05:45:31.615 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:22.022116+0000", 2021-11-12T05:45:31.615 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:45:31.615 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:45:31.615 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:45:31.616 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:45:31.616 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:45:31.616 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:45:31.616 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:45:31.616 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:45:31.617 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 1, 2021-11-12T05:45:31.617 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 1, 2021-11-12T05:45:31.617 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 1, 2021-11-12T05:45:31.617 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 1, 2021-11-12T05:45:31.618 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 1, 2021-11-12T05:45:31.618 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:45:31.618 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:45:31.618 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:45:31.618 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:45:31.619 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:45:31.619 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:45:31.619 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:45:31.619 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.620 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "16", 2021-11-12T05:45:31.620 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:45:31.620 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:45:31.620 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:45:31.620 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:45:31.621 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:45:31.621 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:45:31.621 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:45:31.621 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:45:31.622 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:45:31.622 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:45:31.622 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:45:31.622 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:45:31.622 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:45:31.623 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:45:31.623 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:45:31.623 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:45:31.623 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:45:31.624 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:45:31.624 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:45:31.624 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:45:31.624 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:45:31.624 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:45:31.625 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:45:31.625 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:45:31.625 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:45:31.625 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:45:31.625 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.626 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:45:31.626 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:45:31.626 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:45:31.626 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:45:31.627 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:45:31.627 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:45:31.627 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:45:31.627 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:45:31.628 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:45:31.628 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:45:31.628 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:45:31.628 INFO:teuthology.orchestra.run.gibba005.stdout: "options": { 2021-11-12T05:45:31.628 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_min": 1 2021-11-12T05:45:31.629 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.629 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:45:31.629 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr_devicehealth": {} 2021-11-12T05:45:31.629 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.629 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.630 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.630 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 2, 2021-11-12T05:45:31.630 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "rbd", 2021-11-12T05:45:31.630 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:29.953617+0000", 2021-11-12T05:45:31.631 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:45:31.631 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:45:31.631 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:45:31.631 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:45:31.631 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:45:31.632 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:45:31.632 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:45:31.632 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:45:31.632 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:45:31.633 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:45:31.633 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:45:31.633 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:45:31.633 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:45:31.633 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:45:31.634 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:45:31.634 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:45:31.634 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:45:31.634 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:45:31.635 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:45:31.635 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:45:31.635 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.635 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "19", 2021-11-12T05:45:31.635 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:45:31.636 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:45:31.636 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:45:31.636 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:45:31.636 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:45:31.637 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:45:31.637 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:45:31.637 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:45:31.637 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:45:31.638 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:45:31.638 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:45:31.638 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:45:31.638 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:45:31.638 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:45:31.639 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:45:31.639 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:45:31.639 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:45:31.639 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:45:31.640 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:45:31.640 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:45:31.640 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:45:31.640 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:45:31.644 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:45:31.644 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:45:31.645 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:45:31.645 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:45:31.645 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.645 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:45:31.646 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:45:31.646 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:45:31.646 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:45:31.646 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:45:31.647 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:45:31.647 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:45:31.647 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:45:31.647 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:45:31.648 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:45:31.648 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:45:31.648 INFO:teuthology.orchestra.run.gibba005.stdout: "options": {}, 2021-11-12T05:45:31.648 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:45:31.649 INFO:teuthology.orchestra.run.gibba005.stdout: "rbd": {} 2021-11-12T05:45:31.649 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.649 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.650 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.650 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 9, 2021-11-12T05:45:31.650 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "cephfs_metadata", 2021-11-12T05:45:31.650 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:44:03.259173+0000", 2021-11-12T05:45:31.651 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:45:31.651 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:45:31.651 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:45:31.651 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:45:31.652 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:45:31.652 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:45:31.652 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:45:31.652 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:45:31.652 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:45:31.653 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:45:31.653 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:45:31.653 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:45:31.653 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:45:31.654 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:45:31.654 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:45:31.654 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:45:31.654 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:45:31.655 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:45:31.655 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:45:31.655 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:45:31.655 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.656 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "54", 2021-11-12T05:45:31.656 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:45:31.656 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:45:31.656 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:45:31.657 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:45:31.657 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:45:31.657 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:45:31.657 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:45:31.657 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:45:31.658 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:45:31.658 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:45:31.658 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:45:31.658 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:45:31.658 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:45:31.659 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:45:31.659 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:45:31.659 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:45:31.660 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:45:31.660 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:45:31.660 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:45:31.660 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:45:31.661 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:45:31.661 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:45:31.661 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:45:31.661 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:45:31.661 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:45:31.662 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:45:31.662 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.662 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:45:31.663 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:45:31.663 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:45:31.663 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:45:31.663 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:45:31.663 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:45:31.664 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:45:31.664 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:45:31.664 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:45:31.664 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:45:31.665 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:45:31.665 INFO:teuthology.orchestra.run.gibba005.stdout: "options": { 2021-11-12T05:45:31.665 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_bias": 4, 2021-11-12T05:45:31.665 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_min": 16, 2021-11-12T05:45:31.665 INFO:teuthology.orchestra.run.gibba005.stdout: "recovery_priority": 5 2021-11-12T05:45:31.666 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.666 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:45:31.666 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs": { 2021-11-12T05:45:31.666 INFO:teuthology.orchestra.run.gibba005.stdout: "metadata": "cephfs" 2021-11-12T05:45:31.667 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.667 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.667 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.667 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.668 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 10, 2021-11-12T05:45:31.668 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "cephfs_data", 2021-11-12T05:45:31.668 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:44:04.311731+0000", 2021-11-12T05:45:31.668 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:45:31.668 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:45:31.669 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:45:31.669 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:45:31.669 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:45:31.669 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:45:31.669 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:45:31.670 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:45:31.670 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:45:31.670 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:45:31.670 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:45:31.671 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:45:31.671 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:45:31.671 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:45:31.671 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:45:31.671 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:45:31.672 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:45:31.672 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:45:31.672 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:45:31.672 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:45:31.673 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.673 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "55", 2021-11-12T05:45:31.673 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:45:31.673 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:45:31.673 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:45:31.674 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:45:31.674 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:45:31.674 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:45:31.674 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:45:31.674 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:45:31.675 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:45:31.675 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:45:31.675 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:45:31.675 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:45:31.676 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:45:31.676 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:45:31.676 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:45:31.676 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:45:31.676 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:45:31.677 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:45:31.677 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:45:31.677 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:45:31.678 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:45:31.678 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:45:31.678 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:45:31.678 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:45:31.679 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:45:31.679 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:45:31.679 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.679 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:45:31.679 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:45:31.680 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:45:31.680 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:45:31.680 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:45:31.681 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:45:31.681 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:45:31.681 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:45:31.681 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:45:31.681 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:45:31.682 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:45:31.682 INFO:teuthology.orchestra.run.gibba005.stdout: "options": {}, 2021-11-12T05:45:31.682 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:45:31.682 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs": { 2021-11-12T05:45:31.683 INFO:teuthology.orchestra.run.gibba005.stdout: "data": "cephfs" 2021-11-12T05:45:31.683 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.683 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.683 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.684 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:45:31.684 INFO:teuthology.orchestra.run.gibba005.stdout: "osds": [ 2021-11-12T05:45:31.684 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.684 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:45:31.684 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "ee8e30a0-4819-4475-80ec-dd3ee7d01322", 2021-11-12T05:45:31.685 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:45:31.685 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:45:31.685 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:45:31.685 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:45:31.686 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:45:31.686 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:45:31.686 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:45:31.686 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 53, 2021-11-12T05:45:31.687 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:45:31.687 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:45:31.687 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:45:31.687 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:31.688 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.688 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:31.688 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6802", 2021-11-12T05:45:31.688 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:45:31.689 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.689 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.689 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:31.689 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6803", 2021-11-12T05:45:31.690 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:45:31.690 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.690 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.691 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.691 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:45:31.691 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:31.691 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.692 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:31.692 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6804", 2021-11-12T05:45:31.692 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:45:31.692 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.693 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.693 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:31.693 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6805", 2021-11-12T05:45:31.693 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:45:31.694 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.694 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.694 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.694 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:45:31.695 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:31.695 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.695 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:31.695 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6808", 2021-11-12T05:45:31.696 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:45:31.696 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.696 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.696 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:31.697 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6809", 2021-11-12T05:45:31.697 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:45:31.697 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.698 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.698 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.698 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:45:31.699 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:31.699 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.699 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:31.699 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6806", 2021-11-12T05:45:31.700 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:45:31.700 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.700 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.700 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:31.700 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6807", 2021-11-12T05:45:31.701 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:45:31.701 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.701 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.701 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.702 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6803/14874", 2021-11-12T05:45:31.702 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6805/14874", 2021-11-12T05:45:31.702 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6809/14874", 2021-11-12T05:45:31.702 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6807/14874", 2021-11-12T05:45:31.702 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:45:31.703 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:45:31.703 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:45:31.703 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.703 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.703 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.704 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:45:31.704 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "b1bb06c3-26d0-4d92-82f8-b3e882242785", 2021-11-12T05:45:31.704 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:45:31.704 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:45:31.704 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:45:31.705 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:45:31.705 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:45:31.705 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:45:31.705 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:45:31.706 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 53, 2021-11-12T05:45:31.706 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:45:31.706 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:45:31.706 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:45:31.706 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:31.707 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.707 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:31.707 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6810", 2021-11-12T05:45:31.707 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:45:31.707 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.708 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.708 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:31.708 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6811", 2021-11-12T05:45:31.708 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:45:31.708 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.709 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.709 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.709 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:45:31.709 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:31.710 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.710 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:31.710 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6812", 2021-11-12T05:45:31.710 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:45:31.711 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.711 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.711 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:31.711 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6813", 2021-11-12T05:45:31.711 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:45:31.712 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.712 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.712 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.712 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:45:31.712 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:31.713 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.713 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:31.713 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6816", 2021-11-12T05:45:31.713 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:45:31.713 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.714 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.714 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:31.714 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6817", 2021-11-12T05:45:31.714 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:45:31.714 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.715 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.715 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.715 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:45:31.715 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:31.716 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.716 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:31.716 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6814", 2021-11-12T05:45:31.716 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:45:31.716 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.717 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.717 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:31.717 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6815", 2021-11-12T05:45:31.717 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:45:31.717 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.718 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.718 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.718 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6811/14875", 2021-11-12T05:45:31.718 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6813/14875", 2021-11-12T05:45:31.719 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6817/14875", 2021-11-12T05:45:31.719 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6815/14875", 2021-11-12T05:45:31.719 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:45:31.719 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:45:31.719 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:45:31.720 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.720 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.720 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.720 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:45:31.720 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "837b2c60-c335-4382-9f47-d86543a14022", 2021-11-12T05:45:31.721 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:45:31.721 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:45:31.721 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:45:31.721 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:45:31.721 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:45:31.722 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:45:31.722 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:45:31.722 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 53, 2021-11-12T05:45:31.722 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:45:31.723 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:45:31.723 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:45:31.723 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:31.723 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.723 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:31.724 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6818", 2021-11-12T05:45:31.724 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:45:31.724 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.724 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.724 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:31.725 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6819", 2021-11-12T05:45:31.725 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:45:31.725 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.725 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.726 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.726 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:45:31.726 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:31.726 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.726 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:31.727 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6820", 2021-11-12T05:45:31.727 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:45:31.727 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.727 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.727 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:31.728 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6821", 2021-11-12T05:45:31.728 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:45:31.728 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.728 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.729 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.729 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:45:31.729 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:31.729 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.729 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:31.730 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6824", 2021-11-12T05:45:31.730 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:45:31.730 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.730 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.730 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:31.731 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6825", 2021-11-12T05:45:31.731 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:45:31.731 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.731 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.731 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.732 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:45:31.732 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:31.732 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.732 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:31.733 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6822", 2021-11-12T05:45:31.733 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:45:31.733 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.733 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.733 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:31.734 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6823", 2021-11-12T05:45:31.734 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:45:31.734 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.734 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.734 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.735 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6819/14905", 2021-11-12T05:45:31.735 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6821/14905", 2021-11-12T05:45:31.735 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6825/14905", 2021-11-12T05:45:31.735 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6823/14905", 2021-11-12T05:45:31.736 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:45:31.736 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:45:31.736 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:45:31.736 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.736 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.737 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.737 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:45:31.737 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "eb2b737b-dda6-444b-a306-f33cbbd51f70", 2021-11-12T05:45:31.737 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:45:31.737 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:45:31.738 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:45:31.738 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:45:31.738 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:45:31.738 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:45:31.738 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:45:31.739 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 52, 2021-11-12T05:45:31.739 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:45:31.739 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:45:31.739 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:45:31.740 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:31.740 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.740 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:31.740 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6826", 2021-11-12T05:45:31.740 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:45:31.741 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.741 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.741 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:31.741 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6827", 2021-11-12T05:45:31.741 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:45:31.742 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.742 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.742 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.742 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:45:31.742 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:31.743 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.743 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:31.743 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6828", 2021-11-12T05:45:31.743 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:45:31.744 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.744 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.744 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:31.744 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6829", 2021-11-12T05:45:31.744 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:45:31.745 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.745 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.745 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.745 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:45:31.745 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:31.746 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.746 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:31.746 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6832", 2021-11-12T05:45:31.746 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:45:31.746 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.747 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.747 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:31.747 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6833", 2021-11-12T05:45:31.747 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:45:31.747 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.748 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.748 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.748 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:45:31.748 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:31.749 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.749 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:31.749 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6830", 2021-11-12T05:45:31.749 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:45:31.750 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.750 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.750 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:31.750 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6831", 2021-11-12T05:45:31.750 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:45:31.751 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.751 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.751 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.751 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6827/14876", 2021-11-12T05:45:31.751 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6829/14876", 2021-11-12T05:45:31.752 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6833/14876", 2021-11-12T05:45:31.752 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6831/14876", 2021-11-12T05:45:31.752 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:45:31.752 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:45:31.753 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:45:31.753 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.753 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.753 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.753 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:45:31.754 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "721529a1-c047-486a-a7ca-ddc15d80cdde", 2021-11-12T05:45:31.754 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:45:31.754 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:45:31.754 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:45:31.755 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:45:31.755 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:45:31.755 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:45:31.755 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:45:31.755 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 53, 2021-11-12T05:45:31.756 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:45:31.756 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:45:31.756 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:45:31.756 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:31.756 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.757 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:31.757 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6800", 2021-11-12T05:45:31.757 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:45:31.757 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.757 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.758 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:31.758 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6801", 2021-11-12T05:45:31.758 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:45:31.758 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.758 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.759 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.759 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:45:31.759 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:31.759 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.760 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:31.760 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6802", 2021-11-12T05:45:31.760 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:45:31.760 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.760 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.761 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:31.761 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6803", 2021-11-12T05:45:31.761 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:45:31.761 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.761 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.762 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.762 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:45:31.762 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:31.762 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.763 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:31.763 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6806", 2021-11-12T05:45:31.763 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:45:31.763 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.763 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.764 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:31.764 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6807", 2021-11-12T05:45:31.764 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:45:31.764 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.764 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.765 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.765 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:45:31.765 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:31.765 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.765 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:31.766 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6804", 2021-11-12T05:45:31.766 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:45:31.766 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.766 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.767 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:31.767 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6805", 2021-11-12T05:45:31.767 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:45:31.767 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.767 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.768 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.768 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6801/15096", 2021-11-12T05:45:31.768 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6803/15096", 2021-11-12T05:45:31.768 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6807/15096", 2021-11-12T05:45:31.768 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6805/15096", 2021-11-12T05:45:31.769 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:45:31.769 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:45:31.769 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:45:31.769 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.769 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.770 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.770 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:45:31.770 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "68b72ab2-fa82-4b5c-bf33-528f002e4950", 2021-11-12T05:45:31.770 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:45:31.770 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:45:31.771 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:45:31.771 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:45:31.771 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:45:31.771 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:45:31.772 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:45:31.772 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 53, 2021-11-12T05:45:31.772 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:45:31.772 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:45:31.772 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:45:31.773 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:31.773 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.773 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:31.773 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6808", 2021-11-12T05:45:31.773 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:45:31.774 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.774 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.774 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:31.774 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6809", 2021-11-12T05:45:31.775 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:45:31.775 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.775 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.775 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.775 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:45:31.776 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:31.776 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.776 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:31.776 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6810", 2021-11-12T05:45:31.776 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:45:31.777 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.777 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.777 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:31.777 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6811", 2021-11-12T05:45:31.777 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:45:31.778 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.778 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.778 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.778 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:45:31.779 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:31.779 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.779 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:31.780 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6814", 2021-11-12T05:45:31.780 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:45:31.780 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.780 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.780 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:31.781 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6815", 2021-11-12T05:45:31.781 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:45:31.781 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.781 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.781 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.782 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:45:31.782 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:31.782 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.782 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:31.783 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6812", 2021-11-12T05:45:31.783 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:45:31.783 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.783 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.783 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:31.784 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6813", 2021-11-12T05:45:31.784 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:45:31.784 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.784 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.785 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.785 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6809/15097", 2021-11-12T05:45:31.785 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6811/15097", 2021-11-12T05:45:31.785 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6815/15097", 2021-11-12T05:45:31.785 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6813/15097", 2021-11-12T05:45:31.786 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:45:31.786 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:45:31.786 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:45:31.786 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.787 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.787 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.787 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:45:31.787 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "a2c83b5d-8d37-4d30-ac04-30d89a76e485", 2021-11-12T05:45:31.787 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:45:31.788 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:45:31.788 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:45:31.788 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:45:31.788 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:45:31.788 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:45:31.789 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:45:31.789 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 53, 2021-11-12T05:45:31.789 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:45:31.789 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:45:31.789 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:45:31.790 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:31.790 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.790 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:31.790 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6816", 2021-11-12T05:45:31.791 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:45:31.791 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.791 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.791 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:31.791 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6817", 2021-11-12T05:45:31.792 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:45:31.792 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.792 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.792 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.792 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:45:31.793 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:31.793 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.793 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:31.793 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6818", 2021-11-12T05:45:31.793 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:45:31.794 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.794 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.794 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:31.794 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6819", 2021-11-12T05:45:31.795 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:45:31.795 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.795 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.795 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.795 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:45:31.796 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:31.796 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.796 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:31.796 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6822", 2021-11-12T05:45:31.796 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:45:31.797 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.797 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.797 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:31.797 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6823", 2021-11-12T05:45:31.798 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:45:31.798 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.798 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.798 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.798 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:45:31.799 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:31.799 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.799 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:31.799 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6820", 2021-11-12T05:45:31.799 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:45:31.800 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.800 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.800 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:31.800 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6821", 2021-11-12T05:45:31.800 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:45:31.801 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.801 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.801 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.801 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6817/15098", 2021-11-12T05:45:31.802 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6819/15098", 2021-11-12T05:45:31.802 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6823/15098", 2021-11-12T05:45:31.802 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6821/15098", 2021-11-12T05:45:31.802 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:45:31.802 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:45:31.803 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:45:31.803 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.803 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.803 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.803 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:45:31.804 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "786ce966-d0fb-4181-aed4-c26e3ef61c43", 2021-11-12T05:45:31.804 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:45:31.804 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:45:31.804 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:45:31.804 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:45:31.805 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:45:31.805 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:45:31.805 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:45:31.805 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 52, 2021-11-12T05:45:31.805 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:45:31.806 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:45:31.806 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:45:31.806 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:31.806 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.807 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:31.807 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6824", 2021-11-12T05:45:31.807 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:45:31.807 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.807 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.808 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:31.808 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6825", 2021-11-12T05:45:31.808 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:45:31.808 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.808 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.809 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.809 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:45:31.809 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:31.809 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.809 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:31.810 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6826", 2021-11-12T05:45:31.810 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:45:31.810 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.810 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.811 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:31.811 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6827", 2021-11-12T05:45:31.811 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:45:31.811 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.811 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.812 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.812 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:45:31.812 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:31.812 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.812 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:31.813 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6830", 2021-11-12T05:45:31.813 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:45:31.813 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.813 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.813 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:31.814 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6831", 2021-11-12T05:45:31.814 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:45:31.814 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.814 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.815 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.815 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:45:31.815 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:31.815 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.815 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:31.816 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6828", 2021-11-12T05:45:31.816 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:45:31.816 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.816 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.817 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:31.817 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6829", 2021-11-12T05:45:31.817 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:45:31.817 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.817 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.818 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.818 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6825/15099", 2021-11-12T05:45:31.818 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6827/15099", 2021-11-12T05:45:31.818 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6831/15099", 2021-11-12T05:45:31.818 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6829/15099", 2021-11-12T05:45:31.819 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:45:31.819 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:45:31.819 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:45:31.819 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:31.820 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.820 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:45:31.820 INFO:teuthology.orchestra.run.gibba005.stdout: "osd_xinfo": [ 2021-11-12T05:45:31.820 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.820 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:45:31.821 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:45:31.821 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:45:31.821 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:45:31.821 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:45:31.822 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:45:31.822 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.615112+0000", 2021-11-12T05:45:31.822 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:45:31.822 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.823 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.823 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:45:31.823 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:45:31.823 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:45:31.823 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:45:31.824 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:45:31.824 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:45:31.824 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.665935+0000", 2021-11-12T05:45:31.824 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:45:31.824 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.825 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.825 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:45:31.825 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:45:31.825 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:45:31.825 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:45:31.826 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:45:31.826 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:45:31.826 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.715877+0000", 2021-11-12T05:45:31.826 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:45:31.826 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.827 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.827 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:45:31.827 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:45:31.827 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:45:31.827 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:45:31.828 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:45:31.828 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:45:31.828 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.489234+0000", 2021-11-12T05:45:31.828 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:45:31.828 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.829 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.829 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:45:31.829 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:45:31.829 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:45:31.829 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:45:31.830 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:45:31.830 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:45:31.830 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.413776+0000", 2021-11-12T05:45:31.830 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:45:31.831 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.831 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.831 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:45:31.831 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:45:31.831 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:45:31.832 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:45:31.832 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:45:31.832 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:45:31.832 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.507960+0000", 2021-11-12T05:45:31.832 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:45:31.833 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.833 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.833 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:45:31.833 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:45:31.834 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:45:31.834 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:45:31.834 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:45:31.834 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:45:31.834 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.635696+0000", 2021-11-12T05:45:31.835 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:45:31.835 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.835 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:31.835 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:45:31.836 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:45:31.836 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:45:31.836 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:45:31.836 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:45:31.837 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:45:31.837 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.746949+0000", 2021-11-12T05:45:31.837 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:45:31.837 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.837 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:45:31.838 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap": [], 2021-11-12T05:45:31.838 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap_items": [], 2021-11-12T05:45:31.838 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_temp": [], 2021-11-12T05:45:31.838 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_temp": [], 2021-11-12T05:45:31.838 INFO:teuthology.orchestra.run.gibba005.stdout: "blacklist": {}, 2021-11-12T05:45:31.839 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profiles": { 2021-11-12T05:45:31.839 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs_data": { 2021-11-12T05:45:31.839 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-device-class": "", 2021-11-12T05:45:31.839 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:45:31.840 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-root": "default", 2021-11-12T05:45:31.840 INFO:teuthology.orchestra.run.gibba005.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-12T05:45:31.840 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:45:31.840 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "2", 2021-11-12T05:45:31.841 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:45:31.841 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:45:31.841 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van", 2021-11-12T05:45:31.841 INFO:teuthology.orchestra.run.gibba005.stdout: "w": "8" 2021-11-12T05:45:31.841 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.842 INFO:teuthology.orchestra.run.gibba005.stdout: "default": { 2021-11-12T05:45:31.842 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:45:31.842 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:45:31.842 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "1", 2021-11-12T05:45:31.842 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:45:31.843 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:45:31.843 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van" 2021-11-12T05:45:31.843 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:31.843 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:31.843 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps_queue": [], 2021-11-12T05:45:31.844 INFO:teuthology.orchestra.run.gibba005.stdout: "new_removed_snaps": [], 2021-11-12T05:45:31.844 INFO:teuthology.orchestra.run.gibba005.stdout: "new_purged_snaps": [], 2021-11-12T05:45:31.844 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_node_flags": {}, 2021-11-12T05:45:31.844 INFO:teuthology.orchestra.run.gibba005.stdout: "device_class_flags": {} 2021-11-12T05:45:31.844 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:45:31.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.604+0000 7f2af066b700 1 -- 172.21.2.105:0/3110723110 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2ac80536f0 msgr2=0x7f2ac8055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:31.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.604+0000 7f2af066b700 1 --2- 172.21.2.105:0/3110723110 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2ac80536f0 0x7f2ac8055bb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f2adc002f70 tx=0x7f2adc006a00).stop 2021-11-12T05:45:31.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.604+0000 7f2af066b700 1 -- 172.21.2.105:0/3110723110 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ae80626b0 msgr2=0x7f2ae81345a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:31.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.604+0000 7f2af066b700 1 --2- 172.21.2.105:0/3110723110 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ae80626b0 0x7f2ae81345a0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f2ae4002f70 tx=0x7f2ae4006ec0).stop 2021-11-12T05:45:31.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.604+0000 7f2af066b700 1 -- 172.21.2.105:0/3110723110 shutdown_connections 2021-11-12T05:45:31.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.604+0000 7f2af066b700 1 --2- 172.21.2.105:0/3110723110 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2ac80536f0 0x7f2ac8055bb0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:31.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.604+0000 7f2af066b700 1 --2- 172.21.2.105:0/3110723110 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2ae8130860 0x7f2ae8144590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:31.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.604+0000 7f2af066b700 1 --2- 172.21.2.105:0/3110723110 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2ae80af750 0x7f2ae8134c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:31.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.604+0000 7f2af066b700 1 --2- 172.21.2.105:0/3110723110 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ae80626b0 0x7f2ae81345a0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:31.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.604+0000 7f2af066b700 1 -- 172.21.2.105:0/3110723110 >> 172.21.2.105:0/3110723110 conn(0x7f2ae80b5320 msgr2=0x7f2ae805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:31.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.604+0000 7f2af066b700 1 -- 172.21.2.105:0/3110723110 shutdown_connections 2021-11-12T05:45:31.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.604+0000 7f2af066b700 1 -- 172.21.2.105:0/3110723110 wait complete. 2021-11-12T05:45:31.849 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:45:31.906 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.900+0000 7f50e0a30700 1 Processor -- start 2021-11-12T05:45:31.906 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.900+0000 7f50e0a30700 1 -- start start 2021-11-12T05:45:31.909 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50e0a30700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f50dc0ad080 0x7f50dc0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:31.909 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50e0a30700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50dc0ac7b0 con 0x7f50dc14b2f0 2021-11-12T05:45:31.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50e0a30700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50dc0ac9e0 con 0x7f50dc0ac280 2021-11-12T05:45:31.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50e0a30700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc1488a0 con 0x7f50dc0ad080 2021-11-12T05:45:31.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50dad9d700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f50dc14b2f0 0x7f50dc147a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:56620/0 (socket says 172.21.2.105:56620) 2021-11-12T05:45:31.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50dad9d700 1 -- 172.21.2.105:0/2967812471 learned_addr learned my addr 172.21.2.105:0/2967812471 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:45:31.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50d959a700 1 -- 172.21.2.105:0/2967812471 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3547379283 0 0) 0x7f50dc0ac7b0 con 0x7f50dc14b2f0 2021-11-12T05:45:31.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50d959a700 1 -- 172.21.2.105:0/2967812471 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50bc003260 con 0x7f50dc14b2f0 2021-11-12T05:45:31.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50d959a700 1 -- 172.21.2.105:0/2967812471 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1132760875 0 0) 0x7f50bc003260 con 0x7f50dc14b2f0 2021-11-12T05:45:31.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50d959a700 1 -- 172.21.2.105:0/2967812471 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f50dc0ad080 msgr2=0x7f50dc0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:31.912 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50d959a700 1 --2- 172.21.2.105:0/2967812471 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f50dc0ad080 0x7f50dc0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:31.912 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50d959a700 1 -- 172.21.2.105:0/2967812471 >> v1:172.21.2.115:6789/0 conn(0x7f50dc0ac280 legacy=0x7f50dc14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:31.912 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50d959a700 1 -- 172.21.2.105:0/2967812471 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50dc0b0b30 con 0x7f50dc14b2f0 2021-11-12T05:45:31.912 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50d959a700 1 -- 172.21.2.105:0/2967812471 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f50d40019e0 con 0x7f50dc14b2f0 2021-11-12T05:45:31.912 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50d959a700 1 -- 172.21.2.105:0/2967812471 >> v1:172.21.2.105:6789/0 conn(0x7f50dc14b2f0 legacy=0x7f50dc147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:31.913 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50d959a700 1 --2- 172.21.2.105:0/2967812471 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f50dc0ad080 0x7f50bc003800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:31.913 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50d959a700 1 --2- 172.21.2.105:0/2967812471 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f50bc003ef0 0x7f50bc004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:31.913 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50d959a700 1 --2- 172.21.2.105:0/2967812471 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f50bc004bf0 0x7f50bc00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:31.913 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50d959a700 1 -- 172.21.2.105:0/2967812471 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc1488a0 con 0x7f50bc004bf0 2021-11-12T05:45:31.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50d959a700 1 -- 172.21.2.105:0/2967812471 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc0052f0 con 0x7f50bc003ef0 2021-11-12T05:45:31.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50d959a700 1 -- 172.21.2.105:0/2967812471 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc00bc40 con 0x7f50dc0ad080 2021-11-12T05:45:31.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50dad9d700 1 --2- 172.21.2.105:0/2967812471 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f50bc004bf0 0x7f50bc00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:31.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50dad9d700 1 -- 172.21.2.105:0/2967812471 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f50dc0ad080 msgr2=0x7f50bc003800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:31.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50dad9d700 1 --2- 172.21.2.105:0/2967812471 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f50dc0ad080 0x7f50bc003800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:31.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50dad9d700 1 -- 172.21.2.105:0/2967812471 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f50bc003ef0 msgr2=0x7f50bc004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:31.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50dad9d700 1 --2- 172.21.2.105:0/2967812471 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f50bc003ef0 0x7f50bc004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:31.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50dad9d700 1 -- 172.21.2.105:0/2967812471 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50bc003260 con 0x7f50bc004bf0 2021-11-12T05:45:31.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50dad9d700 1 --2- 172.21.2.105:0/2967812471 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f50bc004bf0 0x7f50bc00b750 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f50dc0b6060 tx=0x7f50dc0b0fd0).ready entity=mon.0 client_cookie=39f137072ee37d67 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:31.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50d959a700 1 -- 172.21.2.105:0/2967812471 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50d400cba0 con 0x7f50bc004bf0 2021-11-12T05:45:31.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50d959a700 1 -- 172.21.2.105:0/2967812471 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d400cd00 con 0x7f50bc004bf0 2021-11-12T05:45:31.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50d959a700 1 -- 172.21.2.105:0/2967812471 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50d4005b80 con 0x7f50bc004bf0 2021-11-12T05:45:31.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50e0a30700 1 -- 172.21.2.105:0/2967812471 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f50bc004bf0 msgr2=0x7f50bc00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:31.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50e0a30700 1 --2- 172.21.2.105:0/2967812471 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f50bc004bf0 0x7f50bc00b750 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f50dc0b6060 tx=0x7f50dc0b0fd0).stop 2021-11-12T05:45:31.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50dad9d700 1 -- 172.21.2.105:0/2967812471 reap_dead start 2021-11-12T05:45:31.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50e0a30700 1 -- 172.21.2.105:0/2967812471 shutdown_connections 2021-11-12T05:45:31.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50e0a30700 1 -- 172.21.2.105:0/2967812471 >> 172.21.2.105:0/2967812471 conn(0x7f50dc0b5370 msgr2=0x7f50dc0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:31.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50e0a30700 1 -- 172.21.2.105:0/2967812471 shutdown_connections 2021-11-12T05:45:31.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50e0a30700 1 -- 172.21.2.105:0/2967812471 wait complete. 2021-11-12T05:45:31.920 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50e0a30700 1 Processor -- start 2021-11-12T05:45:31.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.904+0000 7f50e0a30700 1 -- start start 2021-11-12T05:45:31.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.908+0000 7f50e0a30700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f50bc004bf0 0x7f50dc1449b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:31.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.908+0000 7f50e0a30700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f50dc0abb10 0x7f50dc15a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:31.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.908+0000 7f50e0a30700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f50dc15a5d0 0x7f50dc15aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:31.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.908+0000 7f50e0a30700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc15af70 con 0x7f50dc0abb10 2021-11-12T05:45:31.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.908+0000 7f50e0a30700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc0a7d10 con 0x7f50dc15a5d0 2021-11-12T05:45:31.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.908+0000 7f50e0a30700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc0ab330 con 0x7f50bc004bf0 2021-11-12T05:45:31.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.908+0000 7f50d9d9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f50dc0abb10 0x7f50dc15a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:31.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.908+0000 7f50d9d9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f50dc0abb10 0x7f50dc15a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46236/0 (socket says 172.21.2.105:46236) 2021-11-12T05:45:31.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.908+0000 7f50d9d9b700 1 -- 172.21.2.105:0/161395102 learned_addr learned my addr 172.21.2.105:0/161395102 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:31.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.908+0000 7f50dad9d700 1 --2- 172.21.2.105:0/161395102 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f50dc15a5d0 0x7f50dc15aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:31.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.908+0000 7f50da59c700 1 --2- 172.21.2.105:0/161395102 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f50bc004bf0 0x7f50dc1449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:31.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.908+0000 7f50d9d9b700 1 -- 172.21.2.105:0/161395102 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f50bc004bf0 msgr2=0x7f50dc1449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:31.924 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.908+0000 7f50d9d9b700 1 --2- 172.21.2.105:0/161395102 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f50bc004bf0 0x7f50dc1449b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:31.924 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.908+0000 7f50d9d9b700 1 -- 172.21.2.105:0/161395102 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f50dc15a5d0 msgr2=0x7f50dc15aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:31.924 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.908+0000 7f50d9d9b700 1 --2- 172.21.2.105:0/161395102 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f50dc15a5d0 0x7f50dc15aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:31.924 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.908+0000 7f50d9d9b700 1 -- 172.21.2.105:0/161395102 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50dc0a75d0 con 0x7f50dc0abb10 2021-11-12T05:45:31.925 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.908+0000 7f50dad9d700 1 --2- 172.21.2.105:0/161395102 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f50dc15a5d0 0x7f50dc15aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:45:31.925 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.908+0000 7f50d9d9b700 1 --2- 172.21.2.105:0/161395102 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f50dc0abb10 0x7f50dc15a0e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f50dc0a7e50 tx=0x7f50c4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:31.925 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.908+0000 7f50d37fe700 1 -- 172.21.2.105:0/161395102 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50c4013460 con 0x7f50dc0abb10 2021-11-12T05:45:31.925 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.908+0000 7f50d37fe700 1 -- 172.21.2.105:0/161395102 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c40135c0 con 0x7f50dc0abb10 2021-11-12T05:45:31.925 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.908+0000 7f50d37fe700 1 -- 172.21.2.105:0/161395102 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50c4013920 con 0x7f50dc0abb10 2021-11-12T05:45:31.926 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.908+0000 7f50e0a30700 1 -- 172.21.2.105:0/161395102 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50dc0a7870 con 0x7f50dc0abb10 2021-11-12T05:45:31.926 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.908+0000 7f50e0a30700 1 -- 172.21.2.105:0/161395102 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50dc0a7140 con 0x7f50dc0abb10 2021-11-12T05:45:31.926 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.908+0000 7f50e0a30700 1 -- 172.21.2.105:0/161395102 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50dc0ab150 con 0x7f50dc0abb10 2021-11-12T05:45:31.926 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.908+0000 7f50d37fe700 1 -- 172.21.2.105:0/161395102 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f50c400f070 con 0x7f50dc0abb10 2021-11-12T05:45:31.926 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.908+0000 7f50d37fe700 1 --2- 172.21.2.105:0/161395102 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f50c0053640 0x7f50c0055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:31.927 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.908+0000 7f50d37fe700 1 -- 172.21.2.105:0/161395102 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f50c406b1d0 con 0x7f50dc0abb10 2021-11-12T05:45:31.927 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.908+0000 7f50da59c700 1 --2- 172.21.2.105:0/161395102 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f50c0053640 0x7f50c0055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:31.927 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.908+0000 7f50da59c700 1 --2- 172.21.2.105:0/161395102 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f50c0053640 0x7f50c0055b00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f50cc007000 tx=0x7f50cc008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:31.927 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:31.912+0000 7f50d37fe700 1 -- 172.21.2.105:0/161395102 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f50c40421e0 con 0x7f50dc0abb10 2021-11-12T05:45:32.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.016+0000 7f50e0a30700 1 -- 172.21.2.105:0/161395102 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50dc0b1440 con 0x7f50dc0abb10 2021-11-12T05:45:32.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.016+0000 7f50d37fe700 1 -- 172.21.2.105:0/161395102 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f50c4045800 con 0x7f50dc0abb10 2021-11-12T05:45:32.023 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:45:32.023 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":20,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4478,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/1513907466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":1513907466},{"type":"v1","addr":"172.21.2.115:6833","nonce":1513907466}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":18}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:44:05.340503+0000","modified":"2021-11-12T05:44:06.343650+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5610":{"gid":5610,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/351884283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":351884283},{"type":"v1","addr":"172.21.2.105:6835","nonce":351884283}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-11-12T05:45:32.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.020+0000 7f50e0a30700 1 -- 172.21.2.105:0/161395102 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f50c0053640 msgr2=0x7f50c0055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:32.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.020+0000 7f50e0a30700 1 --2- 172.21.2.105:0/161395102 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f50c0053640 0x7f50c0055b00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f50cc007000 tx=0x7f50cc008040).stop 2021-11-12T05:45:32.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.020+0000 7f50e0a30700 1 -- 172.21.2.105:0/161395102 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f50dc0abb10 msgr2=0x7f50dc15a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:32.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.020+0000 7f50e0a30700 1 --2- 172.21.2.105:0/161395102 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f50dc0abb10 0x7f50dc15a0e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f50dc0a7e50 tx=0x7f50c4006df0).stop 2021-11-12T05:45:32.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.020+0000 7f50e0a30700 1 -- 172.21.2.105:0/161395102 shutdown_connections 2021-11-12T05:45:32.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.020+0000 7f50e0a30700 1 --2- 172.21.2.105:0/161395102 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f50c0053640 0x7f50c0055b00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:32.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.020+0000 7f50e0a30700 1 --2- 172.21.2.105:0/161395102 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f50dc15a5d0 0x7f50dc15aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:32.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.020+0000 7f50e0a30700 1 --2- 172.21.2.105:0/161395102 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f50dc0abb10 0x7f50dc15a0e0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:32.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.020+0000 7f50e0a30700 1 --2- 172.21.2.105:0/161395102 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f50bc004bf0 0x7f50dc1449b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:32.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.020+0000 7f50e0a30700 1 -- 172.21.2.105:0/161395102 >> 172.21.2.105:0/161395102 conn(0x7f50dc0b5370 msgr2=0x7f50dc14aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:32.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.020+0000 7f50e0a30700 1 -- 172.21.2.105:0/161395102 shutdown_connections 2021-11-12T05:45:32.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.020+0000 7f50e0a30700 1 -- 172.21.2.105:0/161395102 wait complete. 2021-11-12T05:45:32.027 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 20 2021-11-12T05:45:32.030 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-12T05:45:32.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.076+0000 7ff170e93700 1 Processor -- start 2021-11-12T05:45:32.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.076+0000 7ff170e93700 1 -- start start 2021-11-12T05:45:32.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.076+0000 7ff170e93700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff16c0634b0 0x7ff16c128980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:32.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff170e93700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7ff16c0ad270 0x7ff16c128e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:32.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff170e93700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff16c140870 con 0x7ff16c143240 2021-11-12T05:45:32.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff170e93700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff16c140cd0 con 0x7ff16c0ad270 2021-11-12T05:45:32.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff170e93700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff16c067630 con 0x7ff16c0634b0 2021-11-12T05:45:32.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff16ad9d700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7ff16c143240 0x7ff16c1436f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:56644/0 (socket says 172.21.2.105:56644) 2021-11-12T05:45:32.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff16ad9d700 1 -- 172.21.2.105:0/19891071 learned_addr learned my addr 172.21.2.105:0/19891071 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:45:32.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff169d9b700 1 --2- 172.21.2.105:0/19891071 >> v2:172.21.2.115:3300/0 conn(0x7ff16c0ad270 0x7ff16c128e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:32.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff16959a700 1 -- 172.21.2.105:0/19891071 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 460818047 0 0) 0x7ff16c140870 con 0x7ff16c143240 2021-11-12T05:45:32.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff16959a700 1 -- 172.21.2.105:0/19891071 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff14c003260 con 0x7ff16c143240 2021-11-12T05:45:32.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff16a59c700 1 --2- 172.21.2.105:0/19891071 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff16c0634b0 0x7ff16c128980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:32.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff16959a700 1 -- 172.21.2.105:0/19891071 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3810401557 0 0) 0x7ff14c003260 con 0x7ff16c143240 2021-11-12T05:45:32.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff16959a700 1 -- 172.21.2.105:0/19891071 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff16c0634b0 msgr2=0x7ff16c128980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:32.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff16959a700 1 --2- 172.21.2.105:0/19891071 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff16c0634b0 0x7ff16c128980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:32.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff16959a700 1 -- 172.21.2.105:0/19891071 >> v2:172.21.2.115:3300/0 conn(0x7ff16c0ad270 msgr2=0x7ff16c128e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:32.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff16959a700 1 --2- 172.21.2.105:0/19891071 >> v2:172.21.2.115:3300/0 conn(0x7ff16c0ad270 0x7ff16c128e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:32.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff16959a700 1 -- 172.21.2.105:0/19891071 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16c05fcc0 con 0x7ff16c143240 2021-11-12T05:45:32.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff16959a700 1 -- 172.21.2.105:0/19891071 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7ff1640019e0 con 0x7ff16c143240 2021-11-12T05:45:32.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff16959a700 1 -- 172.21.2.105:0/19891071 >> v1:172.21.2.105:6789/0 conn(0x7ff16c143240 legacy=0x7ff16c1436f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:32.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff16959a700 1 --2- 172.21.2.105:0/19891071 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff14c003750 0x7ff14c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:32.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff16959a700 1 --2- 172.21.2.105:0/19891071 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff16c0634b0 0x7ff14c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:32.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff16959a700 1 --2- 172.21.2.105:0/19891071 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff14c0049f0 0x7ff14c004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:32.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff16959a700 1 -- 172.21.2.105:0/19891071 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c00b750 con 0x7ff14c0049f0 2021-11-12T05:45:32.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff16959a700 1 -- 172.21.2.105:0/19891071 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c00b890 con 0x7ff14c003750 2021-11-12T05:45:32.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff16959a700 1 -- 172.21.2.105:0/19891071 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c00ba20 con 0x7ff16c0634b0 2021-11-12T05:45:32.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff16ad9d700 1 --2- 172.21.2.105:0/19891071 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff14c0049f0 0x7ff14c004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:32.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff16ad9d700 1 -- 172.21.2.105:0/19891071 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff16c0634b0 msgr2=0x7ff14c004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:32.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff16ad9d700 1 --2- 172.21.2.105:0/19891071 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff16c0634b0 0x7ff14c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:32.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff16ad9d700 1 -- 172.21.2.105:0/19891071 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff14c003750 msgr2=0x7ff14c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:32.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff16ad9d700 1 --2- 172.21.2.105:0/19891071 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff14c003750 0x7ff14c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:32.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff16ad9d700 1 -- 172.21.2.105:0/19891071 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14c003260 con 0x7ff14c0049f0 2021-11-12T05:45:32.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff16ad9d700 1 --2- 172.21.2.105:0/19891071 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff14c0049f0 0x7ff14c004e70 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7ff1640016f0 tx=0x7ff16c13fc70).ready entity=mon.0 client_cookie=9a60030741502090 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:32.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff16959a700 1 -- 172.21.2.105:0/19891071 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff16400cc50 con 0x7ff14c0049f0 2021-11-12T05:45:32.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff16959a700 1 -- 172.21.2.105:0/19891071 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff16400cdb0 con 0x7ff14c0049f0 2021-11-12T05:45:32.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff16959a700 1 -- 172.21.2.105:0/19891071 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff164005b80 con 0x7ff14c0049f0 2021-11-12T05:45:32.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff170e93700 1 -- 172.21.2.105:0/19891071 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff14c0049f0 msgr2=0x7ff14c004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:32.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff170e93700 1 --2- 172.21.2.105:0/19891071 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff14c0049f0 0x7ff14c004e70 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7ff1640016f0 tx=0x7ff16c13fc70).stop 2021-11-12T05:45:32.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff16ad9d700 1 -- 172.21.2.105:0/19891071 reap_dead start 2021-11-12T05:45:32.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff170e93700 1 -- 172.21.2.105:0/19891071 shutdown_connections 2021-11-12T05:45:32.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff170e93700 1 -- 172.21.2.105:0/19891071 >> 172.21.2.105:0/19891071 conn(0x7ff16c0b5320 msgr2=0x7ff16c0b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:32.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff170e93700 1 -- 172.21.2.105:0/19891071 shutdown_connections 2021-11-12T05:45:32.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff170e93700 1 -- 172.21.2.105:0/19891071 wait complete. 2021-11-12T05:45:32.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff170e93700 1 Processor -- start 2021-11-12T05:45:32.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff170e93700 1 -- start start 2021-11-12T05:45:32.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff170e93700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff14c0049f0 0x7ff16c1598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:32.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff170e93700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff16c132390 0x7ff16c15a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:32.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff170e93700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff16c0b1a60 0x7ff16c134110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:32.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff170e93700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16c0650a0 con 0x7ff16c132390 2021-11-12T05:45:32.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff170e93700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16c065340 con 0x7ff16c0b1a60 2021-11-12T05:45:32.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff170e93700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff16c0655e0 con 0x7ff14c0049f0 2021-11-12T05:45:32.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff169d9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff16c132390 0x7ff16c15a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:32.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff169d9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff16c132390 0x7ff16c15a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46258/0 (socket says 172.21.2.105:46258) 2021-11-12T05:45:32.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff169d9b700 1 -- 172.21.2.105:0/620386761 learned_addr learned my addr 172.21.2.105:0/620386761 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:32.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff169d9b700 1 -- 172.21.2.105:0/620386761 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff14c0049f0 msgr2=0x7ff16c1598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:32.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff169d9b700 1 --2- 172.21.2.105:0/620386761 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff14c0049f0 0x7ff16c1598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:32.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff169d9b700 1 -- 172.21.2.105:0/620386761 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff16c0b1a60 msgr2=0x7ff16c134110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:32.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff169d9b700 1 --2- 172.21.2.105:0/620386761 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff16c0b1a60 0x7ff16c134110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:32.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff169d9b700 1 -- 172.21.2.105:0/620386761 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16c133c40 con 0x7ff16c132390 2021-11-12T05:45:32.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff169d9b700 1 --2- 172.21.2.105:0/620386761 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff16c132390 0x7ff16c15a1f0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7ff15400a000 tx=0x7ff154008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:32.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff1637fe700 1 -- 172.21.2.105:0/620386761 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff15400de70 con 0x7ff16c132390 2021-11-12T05:45:32.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff1637fe700 1 -- 172.21.2.105:0/620386761 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff154000e90 con 0x7ff16c132390 2021-11-12T05:45:32.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff170e93700 1 -- 172.21.2.105:0/620386761 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff16c15a6e0 con 0x7ff16c132390 2021-11-12T05:45:32.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff1637fe700 1 -- 172.21.2.105:0/620386761 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1540116f0 con 0x7ff16c132390 2021-11-12T05:45:32.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.080+0000 7ff170e93700 1 -- 172.21.2.105:0/620386761 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff16c0668f0 con 0x7ff16c132390 2021-11-12T05:45:32.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.084+0000 7ff170e93700 1 -- 172.21.2.105:0/620386761 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff16c057350 con 0x7ff16c132390 2021-11-12T05:45:32.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.084+0000 7ff1637fe700 1 -- 172.21.2.105:0/620386761 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff154019020 con 0x7ff16c132390 2021-11-12T05:45:32.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.084+0000 7ff1637fe700 1 --2- 172.21.2.105:0/620386761 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff1500536f0 0x7ff150055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:32.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.084+0000 7ff1637fe700 1 -- 172.21.2.105:0/620386761 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6416+0+0 (secure 0 0 0) 0x7ff15406b210 con 0x7ff16c132390 2021-11-12T05:45:32.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.084+0000 7ff16a59c700 1 --2- 172.21.2.105:0/620386761 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff1500536f0 0x7ff150055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:32.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.084+0000 7ff16a59c700 1 --2- 172.21.2.105:0/620386761 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff1500536f0 0x7ff150055bb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7ff15c00e000 tx=0x7ff15c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:32.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.084+0000 7ff1637fe700 1 -- 172.21.2.105:0/620386761 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff1540421a0 con 0x7ff16c132390 2021-11-12T05:45:32.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:32.196+0000 7ff170e93700 1 -- 172.21.2.105:0/620386761 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff16c05d9a0 con 0x7ff16c132390 2021-11-12T05:45:33.081 INFO:tasks.ceph.mon.a.gibba005.stderr:2021-11-12T05:45:33.076+0000 7fe9772b2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-12T05:45:33.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.088+0000 7ff1637fe700 1 -- 172.21.2.105:0/620386761 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff1540457c0 con 0x7ff16c132390 2021-11-12T05:45:33.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.092+0000 7ff170e93700 1 -- 172.21.2.105:0/620386761 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff1500536f0 msgr2=0x7ff150055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:33.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.092+0000 7ff170e93700 1 --2- 172.21.2.105:0/620386761 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff1500536f0 0x7ff150055bb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7ff15c00e000 tx=0x7ff15c008040).stop 2021-11-12T05:45:33.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.092+0000 7ff170e93700 1 -- 172.21.2.105:0/620386761 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff16c132390 msgr2=0x7ff16c15a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:33.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.092+0000 7ff170e93700 1 --2- 172.21.2.105:0/620386761 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff16c132390 0x7ff16c15a1f0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7ff15400a000 tx=0x7ff154008040).stop 2021-11-12T05:45:33.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.092+0000 7ff170e93700 1 -- 172.21.2.105:0/620386761 shutdown_connections 2021-11-12T05:45:33.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.092+0000 7ff170e93700 1 --2- 172.21.2.105:0/620386761 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff1500536f0 0x7ff150055bb0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:33.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.092+0000 7ff170e93700 1 --2- 172.21.2.105:0/620386761 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff16c0b1a60 0x7ff16c134110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:33.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.092+0000 7ff170e93700 1 --2- 172.21.2.105:0/620386761 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff16c132390 0x7ff16c15a1f0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:33.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.092+0000 7ff170e93700 1 --2- 172.21.2.105:0/620386761 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff14c0049f0 0x7ff16c1598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:33.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.092+0000 7ff170e93700 1 -- 172.21.2.105:0/620386761 >> 172.21.2.105:0/620386761 conn(0x7ff16c0b5320 msgr2=0x7ff16c0aded0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:33.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.092+0000 7ff170e93700 1 -- 172.21.2.105:0/620386761 shutdown_connections 2021-11-12T05:45:33.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.092+0000 7ff170e93700 1 -- 172.21.2.105:0/620386761 wait complete. 2021-11-12T05:45:33.098 INFO:teuthology.orchestra.run.gibba005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-12T05:45:33.102 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:45:33.115 INFO:tasks.ceph.mds.a.gibba005.stdout:starting mds.a at 2021-11-12T05:45:33.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.148+0000 7fa6b632c700 1 Processor -- start 2021-11-12T05:45:33.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.148+0000 7fa6b632c700 1 -- start start 2021-11-12T05:45:33.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6b632c700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fa6b005f9f0 0x7fa6b00601b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:33.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6b632c700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6b00af7f0 con 0x7fa6b00b3b90 2021-11-12T05:45:33.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6b632c700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6b005fdd0 con 0x7fa6b00b26d0 2021-11-12T05:45:33.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6b632c700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b00af340 con 0x7fa6b005f9f0 2021-11-12T05:45:33.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6b48c9700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fa6b00b3b90 0x7fa6b0142560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:56676/0 (socket says 172.21.2.105:56676) 2021-11-12T05:45:33.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6b48c9700 1 -- 172.21.2.105:0/1375505027 learned_addr learned my addr 172.21.2.105:0/1375505027 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:45:33.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6aeffd700 1 -- 172.21.2.105:0/1375505027 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2980578314 0 0) 0x7fa6b00af7f0 con 0x7fa6b00b3b90 2021-11-12T05:45:33.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6aeffd700 1 -- 172.21.2.105:0/1375505027 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa690003260 con 0x7fa6b00b3b90 2021-11-12T05:45:33.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6affff700 1 --2- 172.21.2.105:0/1375505027 >> v2:172.21.2.115:3300/0 conn(0x7fa6b005f9f0 0x7fa6b00601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:33.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6aeffd700 1 -- 172.21.2.105:0/1375505027 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 718471644 0 0) 0x7fa690003260 con 0x7fa6b00b3b90 2021-11-12T05:45:33.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6aeffd700 1 -- 172.21.2.105:0/1375505027 >> v2:172.21.2.115:3300/0 conn(0x7fa6b005f9f0 msgr2=0x7fa6b00601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:33.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6aeffd700 1 --2- 172.21.2.105:0/1375505027 >> v2:172.21.2.115:3300/0 conn(0x7fa6b005f9f0 0x7fa6b00601b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:33.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6aeffd700 1 -- 172.21.2.105:0/1375505027 >> v1:172.21.2.115:6789/0 conn(0x7fa6b00b26d0 legacy=0x7fa6b00b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:33.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6aeffd700 1 -- 172.21.2.105:0/1375505027 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b005d110 con 0x7fa6b00b3b90 2021-11-12T05:45:33.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6aeffd700 1 -- 172.21.2.105:0/1375505027 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fa6a80019e0 con 0x7fa6b00b3b90 2021-11-12T05:45:33.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6aeffd700 1 -- 172.21.2.105:0/1375505027 >> v1:172.21.2.105:6789/0 conn(0x7fa6b00b3b90 legacy=0x7fa6b0142560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:33.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6aeffd700 1 --2- 172.21.2.105:0/1375505027 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa690003750 0x7fa690003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:33.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6aeffd700 1 --2- 172.21.2.105:0/1375505027 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa690004500 0x7fa690004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:33.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6aeffd700 1 --2- 172.21.2.105:0/1375505027 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa690004f90 0x7fa69000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:33.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6aeffd700 1 -- 172.21.2.105:0/1375505027 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b00af340 con 0x7fa690003750 2021-11-12T05:45:33.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6aeffd700 1 -- 172.21.2.105:0/1375505027 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69000be30 con 0x7fa690004f90 2021-11-12T05:45:33.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6aeffd700 1 -- 172.21.2.105:0/1375505027 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa69000bff0 con 0x7fa690004500 2021-11-12T05:45:33.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6affff700 1 --2- 172.21.2.105:0/1375505027 >> v2:172.21.2.115:3300/0 conn(0x7fa6b005f9f0 0x7fa6b00601b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:45:33.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6affff700 1 --2- 172.21.2.105:0/1375505027 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa690003750 0x7fa690003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:33.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6affff700 1 -- 172.21.2.105:0/1375505027 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa690004500 msgr2=0x7fa690004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:33.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6affff700 1 --2- 172.21.2.105:0/1375505027 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa690004500 0x7fa690004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:33.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6affff700 1 -- 172.21.2.105:0/1375505027 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa690004f90 msgr2=0x7fa69000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:33.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6affff700 1 --2- 172.21.2.105:0/1375505027 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa690004f90 0x7fa69000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:33.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6affff700 1 -- 172.21.2.105:0/1375505027 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b005d110 con 0x7fa690003750 2021-11-12T05:45:33.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6b48c9700 1 -- 172.21.2.105:0/1375505027 reap_dead start 2021-11-12T05:45:33.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6affff700 1 --2- 172.21.2.105:0/1375505027 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa690003750 0x7fa690003b50 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7fa6a0007000 tx=0x7fa6a0008040).ready entity=mon.0 client_cookie=8fb0dbb689904530 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:33.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6aeffd700 1 -- 172.21.2.105:0/1375505027 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6a0015070 con 0x7fa690003750 2021-11-12T05:45:33.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6aeffd700 1 -- 172.21.2.105:0/1375505027 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a0011410 con 0x7fa690003750 2021-11-12T05:45:33.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6aeffd700 1 -- 172.21.2.105:0/1375505027 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6a0011770 con 0x7fa690003750 2021-11-12T05:45:33.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6b632c700 1 -- 172.21.2.105:0/1375505027 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa690003750 msgr2=0x7fa690003b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:33.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6b632c700 1 --2- 172.21.2.105:0/1375505027 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa690003750 0x7fa690003b50 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7fa6a0007000 tx=0x7fa6a0008040).stop 2021-11-12T05:45:33.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6b632c700 1 -- 172.21.2.105:0/1375505027 shutdown_connections 2021-11-12T05:45:33.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6b632c700 1 --2- 172.21.2.105:0/1375505027 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa690003750 0x7fa690003b50 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:33.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6b632c700 1 -- 172.21.2.105:0/1375505027 >> 172.21.2.105:0/1375505027 conn(0x7fa6b005c490 msgr2=0x7fa6b005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:33.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6b632c700 1 -- 172.21.2.105:0/1375505027 shutdown_connections 2021-11-12T05:45:33.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6b632c700 1 -- 172.21.2.105:0/1375505027 wait complete. 2021-11-12T05:45:33.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6b632c700 1 Processor -- start 2021-11-12T05:45:33.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6b632c700 1 -- start start 2021-11-12T05:45:33.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6b632c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa690003750 0x7fa6b00a2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:33.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6b632c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa6b00a3450 0x7fa6b0155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:33.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6b632c700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa6b0156290 0x7fa6b0156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:33.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6b632c700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b0064c90 con 0x7fa690003750 2021-11-12T05:45:33.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6b632c700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b0156c30 con 0x7fa6b0156290 2021-11-12T05:45:33.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6b632c700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b00640b0 con 0x7fa6b00a3450 2021-11-12T05:45:33.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6affff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa690003750 0x7fa6b00a2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:33.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6affff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa690003750 0x7fa6b00a2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46288/0 (socket says 172.21.2.105:46288) 2021-11-12T05:45:33.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.152+0000 7fa6affff700 1 -- 172.21.2.105:0/3807795697 learned_addr learned my addr 172.21.2.105:0/3807795697 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:33.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.156+0000 7fa6affff700 1 -- 172.21.2.105:0/3807795697 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa6b00a3450 msgr2=0x7fa6b0155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:33.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.156+0000 7fa6affff700 1 --2- 172.21.2.105:0/3807795697 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa6b00a3450 0x7fa6b0155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:33.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.156+0000 7fa6affff700 1 -- 172.21.2.105:0/3807795697 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa6b0156290 msgr2=0x7fa6b0156740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:33.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.156+0000 7fa6affff700 1 --2- 172.21.2.105:0/3807795697 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa6b0156290 0x7fa6b0156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:33.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.156+0000 7fa6affff700 1 -- 172.21.2.105:0/3807795697 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b01471c0 con 0x7fa690003750 2021-11-12T05:45:33.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.156+0000 7fa6affff700 1 --2- 172.21.2.105:0/3807795697 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa690003750 0x7fa6b00a2f60 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7fa6b0156d70 tx=0x7fa6a0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:33.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.156+0000 7fa6ad7fa700 1 -- 172.21.2.105:0/3807795697 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6a0006e70 con 0x7fa690003750 2021-11-12T05:45:33.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.156+0000 7fa6ad7fa700 1 -- 172.21.2.105:0/3807795697 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a0000e90 con 0x7fa690003750 2021-11-12T05:45:33.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.156+0000 7fa6b632c700 1 -- 172.21.2.105:0/3807795697 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b0065fe0 con 0x7fa690003750 2021-11-12T05:45:33.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.156+0000 7fa6ad7fa700 1 -- 172.21.2.105:0/3807795697 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6a001c620 con 0x7fa690003750 2021-11-12T05:45:33.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.156+0000 7fa6b632c700 1 -- 172.21.2.105:0/3807795697 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b0063d10 con 0x7fa690003750 2021-11-12T05:45:33.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.156+0000 7fa6b632c700 1 -- 172.21.2.105:0/3807795697 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6b0064f60 con 0x7fa690003750 2021-11-12T05:45:33.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.156+0000 7fa6ad7fa700 1 -- 172.21.2.105:0/3807795697 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa6a001c780 con 0x7fa690003750 2021-11-12T05:45:33.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.156+0000 7fa6ad7fa700 1 --2- 172.21.2.105:0/3807795697 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa6940536a0 0x7fa694055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:33.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.156+0000 7fa6ad7fa700 1 -- 172.21.2.105:0/3807795697 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6502+0+0 (secure 0 0 0) 0x7fa6a006d4a0 con 0x7fa690003750 2021-11-12T05:45:33.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.156+0000 7fa6af7fe700 1 --2- 172.21.2.105:0/3807795697 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa6940536a0 0x7fa694055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:33.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.156+0000 7fa6af7fe700 1 --2- 172.21.2.105:0/3807795697 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa6940536a0 0x7fa694055b60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7fa698001fa0 tx=0x7fa6980077f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:33.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.160+0000 7fa6ad7fa700 1 -- 172.21.2.105:0/3807795697 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa6a0044320 con 0x7fa690003750 2021-11-12T05:45:33.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.268+0000 7fa6b632c700 1 -- 172.21.2.105:0/3807795697 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6b00af550 con 0x7fa690003750 2021-11-12T05:45:33.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.268+0000 7fa6ad7fa700 1 -- 172.21.2.105:0/3807795697 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+1778 (secure 0 0 0) 0x7fa6a0047900 con 0x7fa690003750 2021-11-12T05:45:33.274 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:45:33.274 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":21,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4478,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/1513907466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":1513907466},{"type":"v1","addr":"172.21.2.115:6833","nonce":1513907466}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:44:05.340503+0000","modified":"2021-11-12T05:45:33.081643+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":56,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-11-12T05:45:33.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.272+0000 7fa6b632c700 1 -- 172.21.2.105:0/3807795697 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa6940536a0 msgr2=0x7fa694055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:33.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.272+0000 7fa6b632c700 1 --2- 172.21.2.105:0/3807795697 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa6940536a0 0x7fa694055b60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7fa698001fa0 tx=0x7fa6980077f0).stop 2021-11-12T05:45:33.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.272+0000 7fa6b632c700 1 -- 172.21.2.105:0/3807795697 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa690003750 msgr2=0x7fa6b00a2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:33.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.272+0000 7fa6b632c700 1 --2- 172.21.2.105:0/3807795697 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa690003750 0x7fa6b00a2f60 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7fa6b0156d70 tx=0x7fa6a0008040).stop 2021-11-12T05:45:33.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.272+0000 7fa6b632c700 1 -- 172.21.2.105:0/3807795697 shutdown_connections 2021-11-12T05:45:33.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.272+0000 7fa6b632c700 1 --2- 172.21.2.105:0/3807795697 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa6940536a0 0x7fa694055b60 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:33.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.272+0000 7fa6b632c700 1 --2- 172.21.2.105:0/3807795697 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa6b0156290 0x7fa6b0156740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:33.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.272+0000 7fa6b632c700 1 --2- 172.21.2.105:0/3807795697 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa6b00a3450 0x7fa6b0155da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:33.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.272+0000 7fa6b632c700 1 --2- 172.21.2.105:0/3807795697 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa690003750 0x7fa6b00a2f60 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:33.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.272+0000 7fa6b632c700 1 -- 172.21.2.105:0/3807795697 >> 172.21.2.105:0/3807795697 conn(0x7fa6b005c490 msgr2=0x7fa6b00b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:33.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.272+0000 7fa6b632c700 1 -- 172.21.2.105:0/3807795697 shutdown_connections 2021-11-12T05:45:33.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.272+0000 7fa6b632c700 1 -- 172.21.2.105:0/3807795697 wait complete. 2021-11-12T05:45:33.278 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 21 2021-11-12T05:45:33.281 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-12T05:45:33.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.372+0000 7f622a7cb700 1 Processor -- start 2021-11-12T05:45:33.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.372+0000 7f622a7cb700 1 -- start start 2021-11-12T05:45:33.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.372+0000 7f622a7cb700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f62240b76d0 0x7f62240b7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:33.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.372+0000 7f622a7cb700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62240b2590 con 0x7f6224142fc0 2021-11-12T05:45:33.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.372+0000 7f622a7cb700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62240b2830 con 0x7f62240b2f70 2021-11-12T05:45:33.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.372+0000 7f622a7cb700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62240b2ad0 con 0x7f62240b76d0 2021-11-12T05:45:33.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.372+0000 7f6228d68700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f6224142fc0 0x7f6224062340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:56694/0 (socket says 172.21.2.105:56694) 2021-11-12T05:45:33.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.372+0000 7f6228d68700 1 -- 172.21.2.105:0/3522016418 learned_addr learned my addr 172.21.2.105:0/3522016418 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:45:33.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.372+0000 7f6222ffd700 1 -- 172.21.2.105:0/3522016418 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2137983501 0 0) 0x7f62240b2590 con 0x7f6224142fc0 2021-11-12T05:45:33.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.372+0000 7f6222ffd700 1 -- 172.21.2.105:0/3522016418 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6204003260 con 0x7f6224142fc0 2021-11-12T05:45:33.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.372+0000 7f6223fff700 1 --2- 172.21.2.105:0/3522016418 >> v2:172.21.2.115:3300/0 conn(0x7f62240b76d0 0x7f62240b7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:33.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.372+0000 7f6222ffd700 1 -- 172.21.2.105:0/3522016418 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2083444740 0 0) 0x7f6204003260 con 0x7f6224142fc0 2021-11-12T05:45:33.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.372+0000 7f6222ffd700 1 -- 172.21.2.105:0/3522016418 >> v2:172.21.2.115:3300/0 conn(0x7f62240b76d0 msgr2=0x7f62240b7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:33.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.372+0000 7f6222ffd700 1 --2- 172.21.2.105:0/3522016418 >> v2:172.21.2.115:3300/0 conn(0x7f62240b76d0 0x7f62240b7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:33.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.372+0000 7f6222ffd700 1 -- 172.21.2.105:0/3522016418 >> v1:172.21.2.115:6789/0 conn(0x7f62240b2f70 legacy=0x7f622413cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:33.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.372+0000 7f6222ffd700 1 -- 172.21.2.105:0/3522016418 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622413d460 con 0x7f6224142fc0 2021-11-12T05:45:33.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.372+0000 7f6222ffd700 1 -- 172.21.2.105:0/3522016418 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f621c0019e0 con 0x7f6224142fc0 2021-11-12T05:45:33.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.372+0000 7f6222ffd700 1 -- 172.21.2.105:0/3522016418 >> v1:172.21.2.105:6789/0 conn(0x7f6224142fc0 legacy=0x7f6224062340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:33.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.372+0000 7f6222ffd700 1 --2- 172.21.2.105:0/3522016418 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6204003750 0x7f6204003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:33.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.372+0000 7f6222ffd700 1 --2- 172.21.2.105:0/3522016418 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6204004500 0x7f6204004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:33.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.372+0000 7f6222ffd700 1 --2- 172.21.2.105:0/3522016418 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6204004ec0 0x7f620400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:33.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.372+0000 7f6222ffd700 1 -- 172.21.2.105:0/3522016418 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62240b2ad0 con 0x7f6204003750 2021-11-12T05:45:33.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.372+0000 7f6222ffd700 1 -- 172.21.2.105:0/3522016418 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f620400bd80 con 0x7f6204004ec0 2021-11-12T05:45:33.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.372+0000 7f6222ffd700 1 -- 172.21.2.105:0/3522016418 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f620400bf40 con 0x7f6204004500 2021-11-12T05:45:33.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.372+0000 7f6223fff700 1 --2- 172.21.2.105:0/3522016418 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6204003750 0x7f6204003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:33.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.372+0000 7f6228d68700 1 --2- 172.21.2.105:0/3522016418 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6204004ec0 0x7f620400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:33.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.372+0000 7f6223fff700 1 -- 172.21.2.105:0/3522016418 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6204004500 msgr2=0x7f6204004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:33.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.372+0000 7f6223fff700 1 --2- 172.21.2.105:0/3522016418 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6204004500 0x7f6204004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:33.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.372+0000 7f6223fff700 1 -- 172.21.2.105:0/3522016418 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6204004ec0 msgr2=0x7f620400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:33.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.372+0000 7f6223fff700 1 --2- 172.21.2.105:0/3522016418 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6204004ec0 0x7f620400b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:33.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.372+0000 7f6223fff700 1 -- 172.21.2.105:0/3522016418 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6204003260 con 0x7f6204003750 2021-11-12T05:45:33.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.372+0000 7f6228d68700 1 -- 172.21.2.105:0/3522016418 reap_dead start 2021-11-12T05:45:33.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.372+0000 7f6223fff700 1 --2- 172.21.2.105:0/3522016418 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6204003750 0x7f6204003b50 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7f621400a000 tx=0x7f6214008040).ready entity=mon.0 client_cookie=3f6feefd1da79226 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:33.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.372+0000 7f6222ffd700 1 -- 172.21.2.105:0/3522016418 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6214013670 con 0x7f6204003750 2021-11-12T05:45:33.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.372+0000 7f6222ffd700 1 -- 172.21.2.105:0/3522016418 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62140137d0 con 0x7f6204003750 2021-11-12T05:45:33.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.372+0000 7f6222ffd700 1 -- 172.21.2.105:0/3522016418 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6214013b30 con 0x7f6204003750 2021-11-12T05:45:33.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.376+0000 7f622a7cb700 1 -- 172.21.2.105:0/3522016418 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6204003750 msgr2=0x7f6204003b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:33.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.376+0000 7f622a7cb700 1 --2- 172.21.2.105:0/3522016418 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6204003750 0x7f6204003b50 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7f621400a000 tx=0x7f6214008040).stop 2021-11-12T05:45:33.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.376+0000 7f622a7cb700 1 -- 172.21.2.105:0/3522016418 shutdown_connections 2021-11-12T05:45:33.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.376+0000 7f622a7cb700 1 --2- 172.21.2.105:0/3522016418 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6204003750 0x7f6204003b50 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:33.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.376+0000 7f622a7cb700 1 -- 172.21.2.105:0/3522016418 >> 172.21.2.105:0/3522016418 conn(0x7f62240608d0 msgr2=0x7f622405c490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:33.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.376+0000 7f622a7cb700 1 -- 172.21.2.105:0/3522016418 shutdown_connections 2021-11-12T05:45:33.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.376+0000 7f622a7cb700 1 -- 172.21.2.105:0/3522016418 wait complete. 2021-11-12T05:45:33.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.376+0000 7f622a7cb700 1 Processor -- start 2021-11-12T05:45:33.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.376+0000 7f622a7cb700 1 -- start start 2021-11-12T05:45:33.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.376+0000 7f622a7cb700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6204003750 0x7f6224146d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:33.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.376+0000 7f622a7cb700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6224144fa0 0x7f6224139490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:33.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.376+0000 7f622a7cb700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6224139980 0x7f6224066430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:33.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.376+0000 7f622a7cb700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62241462b0 con 0x7f6204003750 2021-11-12T05:45:33.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.376+0000 7f622a7cb700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6224145400 con 0x7f6224139980 2021-11-12T05:45:33.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.376+0000 7f622a7cb700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62240afd00 con 0x7f6224144fa0 2021-11-12T05:45:33.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.376+0000 7f6223fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6204003750 0x7f6224146d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:33.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.376+0000 7f6223fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6204003750 0x7f6224146d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46308/0 (socket says 172.21.2.105:46308) 2021-11-12T05:45:33.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.376+0000 7f6223fff700 1 -- 172.21.2.105:0/4267969734 learned_addr learned my addr 172.21.2.105:0/4267969734 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:33.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.376+0000 7f6223fff700 1 -- 172.21.2.105:0/4267969734 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6224144fa0 msgr2=0x7f6224139490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:33.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.376+0000 7f6223fff700 1 --2- 172.21.2.105:0/4267969734 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6224144fa0 0x7f6224139490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:33.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.376+0000 7f6223fff700 1 -- 172.21.2.105:0/4267969734 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6224139980 msgr2=0x7f6224066430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:33.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.376+0000 7f6223fff700 1 --2- 172.21.2.105:0/4267969734 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6224139980 0x7f6224066430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:33.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.376+0000 7f6223fff700 1 -- 172.21.2.105:0/4267969734 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6224139e00 con 0x7f6204003750 2021-11-12T05:45:33.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.376+0000 7f6223fff700 1 --2- 172.21.2.105:0/4267969734 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6204003750 0x7f6224146d60 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f621400a000 tx=0x7f6214008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:33.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.376+0000 7f62217fa700 1 -- 172.21.2.105:0/4267969734 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6214012d00 con 0x7f6204003750 2021-11-12T05:45:33.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.376+0000 7f62217fa700 1 -- 172.21.2.105:0/4267969734 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6214000e90 con 0x7f6204003750 2021-11-12T05:45:33.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.376+0000 7f622a7cb700 1 -- 172.21.2.105:0/4267969734 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6224144490 con 0x7f6204003750 2021-11-12T05:45:33.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.376+0000 7f62217fa700 1 -- 172.21.2.105:0/4267969734 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f621401d600 con 0x7f6204003750 2021-11-12T05:45:33.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.376+0000 7f622a7cb700 1 -- 172.21.2.105:0/4267969734 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6224066ac0 con 0x7f6204003750 2021-11-12T05:45:33.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.376+0000 7f622a7cb700 1 -- 172.21.2.105:0/4267969734 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6224146420 con 0x7f6204003750 2021-11-12T05:45:33.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.376+0000 7f62217fa700 1 -- 172.21.2.105:0/4267969734 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f621401d760 con 0x7f6204003750 2021-11-12T05:45:33.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.376+0000 7f62217fa700 1 --2- 172.21.2.105:0/4267969734 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6208053580 0x7f6208055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:33.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.376+0000 7f62217fa700 1 -- 172.21.2.105:0/4267969734 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f621406d3a0 con 0x7f6204003750 2021-11-12T05:45:33.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.376+0000 7f62237fe700 1 --2- 172.21.2.105:0/4267969734 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6208053580 0x7f6208055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:33.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.376+0000 7f62237fe700 1 --2- 172.21.2.105:0/4267969734 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6208053580 0x7f6208055a40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f620c001fa0 tx=0x7f620c0077f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:33.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.380+0000 7f62217fa700 1 -- 172.21.2.105:0/4267969734 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6224146420 con 0x7f6204003750 2021-11-12T05:45:33.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:33.488+0000 7f622a7cb700 1 -- 172.21.2.105:0/4267969734 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6224139ff0 con 0x7f6204003750 2021-11-12T05:45:34.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.100+0000 7f62217fa700 1 -- 172.21.2.105:0/4267969734 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v22) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6214044350 con 0x7f6204003750 2021-11-12T05:45:34.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.104+0000 7f622a7cb700 1 -- 172.21.2.105:0/4267969734 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6208053580 msgr2=0x7f6208055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:34.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.104+0000 7f622a7cb700 1 --2- 172.21.2.105:0/4267969734 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6208053580 0x7f6208055a40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f620c001fa0 tx=0x7f620c0077f0).stop 2021-11-12T05:45:34.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.104+0000 7f622a7cb700 1 -- 172.21.2.105:0/4267969734 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6204003750 msgr2=0x7f6224146d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:34.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.104+0000 7f622a7cb700 1 --2- 172.21.2.105:0/4267969734 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6204003750 0x7f6224146d60 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f621400a000 tx=0x7f6214008040).stop 2021-11-12T05:45:34.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.104+0000 7f622a7cb700 1 -- 172.21.2.105:0/4267969734 shutdown_connections 2021-11-12T05:45:34.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.104+0000 7f622a7cb700 1 --2- 172.21.2.105:0/4267969734 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6208053580 0x7f6208055a40 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:34.110 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.104+0000 7f622a7cb700 1 --2- 172.21.2.105:0/4267969734 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6224139980 0x7f6224066430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:34.110 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.104+0000 7f622a7cb700 1 --2- 172.21.2.105:0/4267969734 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6224144fa0 0x7f6224139490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:34.110 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.104+0000 7f622a7cb700 1 --2- 172.21.2.105:0/4267969734 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6204003750 0x7f6224146d60 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:34.110 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.104+0000 7f622a7cb700 1 -- 172.21.2.105:0/4267969734 >> 172.21.2.105:0/4267969734 conn(0x7f62240608d0 msgr2=0x7f622413c940 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:34.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.104+0000 7f622a7cb700 1 -- 172.21.2.105:0/4267969734 shutdown_connections 2021-11-12T05:45:34.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.104+0000 7f622a7cb700 1 -- 172.21.2.105:0/4267969734 wait complete. 2021-11-12T05:45:34.114 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-12T05:45:34.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9d0f21700 1 Processor -- start 2021-11-12T05:45:34.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9d0f21700 1 -- start start 2021-11-12T05:45:34.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9d0f21700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fc9cc0b2940 0x7fc9cc142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:34.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9d0f21700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9cc0b2d20 con 0x7fc9cc0b0cc0 2021-11-12T05:45:34.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9d0f21700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9cc0b1fc0 con 0x7fc9cc0b0780 2021-11-12T05:45:34.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9d0f21700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9cc0b15e0 con 0x7fc9cc0b2940 2021-11-12T05:45:34.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9cad9d700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fc9cc0b0cc0 0x7fc9cc05f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:56714/0 (socket says 172.21.2.105:56714) 2021-11-12T05:45:34.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9cad9d700 1 -- 172.21.2.105:0/4051397238 learned_addr learned my addr 172.21.2.105:0/4051397238 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:45:34.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9c959a700 1 -- 172.21.2.105:0/4051397238 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2820124581 0 0) 0x7fc9cc0b2d20 con 0x7fc9cc0b0cc0 2021-11-12T05:45:34.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9c959a700 1 -- 172.21.2.105:0/4051397238 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9ac003260 con 0x7fc9cc0b0cc0 2021-11-12T05:45:34.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9ca59c700 1 --2- 172.21.2.105:0/4051397238 >> v2:172.21.2.115:3300/0 conn(0x7fc9cc0b2940 0x7fc9cc142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:34.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9c959a700 1 -- 172.21.2.105:0/4051397238 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3309009993 0 0) 0x7fc9ac003260 con 0x7fc9cc0b0cc0 2021-11-12T05:45:34.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9c959a700 1 -- 172.21.2.105:0/4051397238 >> v2:172.21.2.115:3300/0 conn(0x7fc9cc0b2940 msgr2=0x7fc9cc142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:34.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9c959a700 1 --2- 172.21.2.105:0/4051397238 >> v2:172.21.2.115:3300/0 conn(0x7fc9cc0b2940 0x7fc9cc142dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:34.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9c959a700 1 -- 172.21.2.105:0/4051397238 >> v1:172.21.2.115:6789/0 conn(0x7fc9cc0b0780 legacy=0x7fc9cc1432b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:34.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9c959a700 1 -- 172.21.2.105:0/4051397238 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9cc0b1880 con 0x7fc9cc0b0cc0 2021-11-12T05:45:34.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9c959a700 1 -- 172.21.2.105:0/4051397238 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fc9c40019e0 con 0x7fc9cc0b0cc0 2021-11-12T05:45:34.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9c959a700 1 -- 172.21.2.105:0/4051397238 >> v1:172.21.2.105:6789/0 conn(0x7fc9cc0b0cc0 legacy=0x7fc9cc05f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:34.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9c959a700 1 --2- 172.21.2.105:0/4051397238 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc9ac003750 0x7fc9ac003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:34.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9c959a700 1 --2- 172.21.2.105:0/4051397238 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc9ac004500 0x7fc9ac004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:34.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9c959a700 1 --2- 172.21.2.105:0/4051397238 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc9ac004e70 0x7fc9ac00c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:34.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9c959a700 1 -- 172.21.2.105:0/4051397238 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc0b15e0 con 0x7fc9ac003750 2021-11-12T05:45:34.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9c959a700 1 -- 172.21.2.105:0/4051397238 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac00ce30 con 0x7fc9ac004e70 2021-11-12T05:45:34.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9c959a700 1 -- 172.21.2.105:0/4051397238 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac00cff0 con 0x7fc9ac004500 2021-11-12T05:45:34.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9ca59c700 1 --2- 172.21.2.105:0/4051397238 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc9ac003750 0x7fc9ac003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:34.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9cad9d700 1 --2- 172.21.2.105:0/4051397238 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc9ac004e70 0x7fc9ac00c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:34.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9c9d9b700 1 --2- 172.21.2.105:0/4051397238 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc9ac004500 0x7fc9ac004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:34.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9ca59c700 1 -- 172.21.2.105:0/4051397238 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc9ac004500 msgr2=0x7fc9ac004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:34.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9ca59c700 1 --2- 172.21.2.105:0/4051397238 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc9ac004500 0x7fc9ac004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:34.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9ca59c700 1 -- 172.21.2.105:0/4051397238 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc9ac004e70 msgr2=0x7fc9ac00c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:34.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9ca59c700 1 --2- 172.21.2.105:0/4051397238 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc9ac004e70 0x7fc9ac00c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:34.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9ca59c700 1 -- 172.21.2.105:0/4051397238 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ac003260 con 0x7fc9ac003750 2021-11-12T05:45:34.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9c9d9b700 1 --2- 172.21.2.105:0/4051397238 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc9ac004500 0x7fc9ac004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:45:34.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9cad9d700 1 -- 172.21.2.105:0/4051397238 reap_dead start 2021-11-12T05:45:34.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9ca59c700 1 --2- 172.21.2.105:0/4051397238 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc9ac003750 0x7fc9ac003b70 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7fc9b400c000 tx=0x7fc9b4006df0).ready entity=mon.0 client_cookie=8e8dfce45d766552 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:34.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9c959a700 1 -- 172.21.2.105:0/4051397238 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9b400e830 con 0x7fc9ac003750 2021-11-12T05:45:34.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9c959a700 1 -- 172.21.2.105:0/4051397238 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b400e990 con 0x7fc9ac003750 2021-11-12T05:45:34.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9c959a700 1 -- 172.21.2.105:0/4051397238 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9b400ecf0 con 0x7fc9ac003750 2021-11-12T05:45:34.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9d0f21700 1 -- 172.21.2.105:0/4051397238 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc9ac003750 msgr2=0x7fc9ac003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:34.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9d0f21700 1 --2- 172.21.2.105:0/4051397238 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc9ac003750 0x7fc9ac003b70 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7fc9b400c000 tx=0x7fc9b4006df0).stop 2021-11-12T05:45:34.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9d0f21700 1 -- 172.21.2.105:0/4051397238 shutdown_connections 2021-11-12T05:45:34.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9d0f21700 1 --2- 172.21.2.105:0/4051397238 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc9ac003750 0x7fc9ac003b70 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:34.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9d0f21700 1 -- 172.21.2.105:0/4051397238 >> 172.21.2.105:0/4051397238 conn(0x7fc9cc068440 msgr2=0x7fc9cc062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:34.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9d0f21700 1 -- 172.21.2.105:0/4051397238 shutdown_connections 2021-11-12T05:45:34.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.168+0000 7fc9d0f21700 1 -- 172.21.2.105:0/4051397238 wait complete. 2021-11-12T05:45:34.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.172+0000 7fc9d0f21700 1 Processor -- start 2021-11-12T05:45:34.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.172+0000 7fc9d0f21700 1 -- start start 2021-11-12T05:45:34.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.172+0000 7fc9d0f21700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc9ac003750 0x7fc9cc1419a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:34.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.172+0000 7fc9d0f21700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc9cc067010 0x7fc9cc150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:34.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.172+0000 7fc9d0f21700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc9cc1457e0 0x7fc9cc1511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:34.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.172+0000 7fc9d0f21700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc142ee0 con 0x7fc9cc1457e0 2021-11-12T05:45:34.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.172+0000 7fc9d0f21700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc142c40 con 0x7fc9cc067010 2021-11-12T05:45:34.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.172+0000 7fc9d0f21700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc144430 con 0x7fc9ac003750 2021-11-12T05:45:34.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.172+0000 7fc9cad9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc9cc1457e0 0x7fc9cc1511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:34.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.172+0000 7fc9cad9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc9cc1457e0 0x7fc9cc1511f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46332/0 (socket says 172.21.2.105:46332) 2021-11-12T05:45:34.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.172+0000 7fc9cad9d700 1 -- 172.21.2.105:0/674771869 learned_addr learned my addr 172.21.2.105:0/674771869 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:34.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.172+0000 7fc9c9d9b700 1 --2- 172.21.2.105:0/674771869 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc9cc067010 0x7fc9cc150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:34.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.172+0000 7fc9ca59c700 1 --2- 172.21.2.105:0/674771869 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc9ac003750 0x7fc9cc1419a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:34.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.172+0000 7fc9cad9d700 1 -- 172.21.2.105:0/674771869 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc9ac003750 msgr2=0x7fc9cc1419a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:34.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.172+0000 7fc9cad9d700 1 --2- 172.21.2.105:0/674771869 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc9ac003750 0x7fc9cc1419a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:34.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.172+0000 7fc9cad9d700 1 -- 172.21.2.105:0/674771869 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc9cc067010 msgr2=0x7fc9cc150870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:34.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.172+0000 7fc9cad9d700 1 --2- 172.21.2.105:0/674771869 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc9cc067010 0x7fc9cc150870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:34.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.172+0000 7fc9cad9d700 1 -- 172.21.2.105:0/674771869 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9cc140f40 con 0x7fc9cc1457e0 2021-11-12T05:45:34.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.172+0000 7fc9cad9d700 1 --2- 172.21.2.105:0/674771869 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc9cc1457e0 0x7fc9cc1511f0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7fc9c4001490 tx=0x7fc9cc0b1a10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:34.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.172+0000 7fc9c37fe700 1 -- 172.21.2.105:0/674771869 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9c400fa90 con 0x7fc9cc1457e0 2021-11-12T05:45:34.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.172+0000 7fc9c37fe700 1 -- 172.21.2.105:0/674771869 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c400fbf0 con 0x7fc9cc1457e0 2021-11-12T05:45:34.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.172+0000 7fc9d0f21700 1 -- 172.21.2.105:0/674771869 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9cc1516e0 con 0x7fc9cc1457e0 2021-11-12T05:45:34.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.172+0000 7fc9c37fe700 1 -- 172.21.2.105:0/674771869 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9c4012350 con 0x7fc9cc1457e0 2021-11-12T05:45:34.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.172+0000 7fc9d0f21700 1 -- 172.21.2.105:0/674771869 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9cc1448d0 con 0x7fc9cc1457e0 2021-11-12T05:45:34.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.172+0000 7fc9d0f21700 1 -- 172.21.2.105:0/674771869 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9cc0b1b20 con 0x7fc9cc1457e0 2021-11-12T05:45:34.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.172+0000 7fc9c37fe700 1 -- 172.21.2.105:0/674771869 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc9c401b030 con 0x7fc9cc1457e0 2021-11-12T05:45:34.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.172+0000 7fc9c37fe700 1 --2- 172.21.2.105:0/674771869 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc9b0053720 0x7fc9b0055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:34.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.172+0000 7fc9c37fe700 1 -- 172.21.2.105:0/674771869 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6502+0+0 (secure 0 0 0) 0x7fc9c406b8d0 con 0x7fc9cc1457e0 2021-11-12T05:45:34.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.172+0000 7fc9ca59c700 1 --2- 172.21.2.105:0/674771869 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc9b0053720 0x7fc9b0055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:34.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.172+0000 7fc9ca59c700 1 --2- 172.21.2.105:0/674771869 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc9b0053720 0x7fc9b0055be0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fc9b401c000 tx=0x7fc9b4019000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:34.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.176+0000 7fc9c37fe700 1 -- 172.21.2.105:0/674771869 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc9c4042770 con 0x7fc9cc1457e0 2021-11-12T05:45:34.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:34.260+0000 7fc9d0f21700 1 -- 172.21.2.105:0/674771869 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc9cc057350 con 0x7fc9cc1457e0 2021-11-12T05:45:35.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.112+0000 7fc9c37fe700 1 -- 172.21.2.105:0/674771869 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v57) v1 ==== 185+0+0 (secure 0 0 0) 0x7fc9c4019030 con 0x7fc9cc1457e0 2021-11-12T05:45:35.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.112+0000 7fc9d0f21700 1 -- 172.21.2.105:0/674771869 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc9b0053720 msgr2=0x7fc9b0055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:35.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.112+0000 7fc9d0f21700 1 --2- 172.21.2.105:0/674771869 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc9b0053720 0x7fc9b0055be0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fc9b401c000 tx=0x7fc9b4019000).stop 2021-11-12T05:45:35.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.112+0000 7fc9d0f21700 1 -- 172.21.2.105:0/674771869 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc9cc1457e0 msgr2=0x7fc9cc1511f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:35.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.112+0000 7fc9d0f21700 1 --2- 172.21.2.105:0/674771869 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc9cc1457e0 0x7fc9cc1511f0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7fc9c4001490 tx=0x7fc9cc0b1a10).stop 2021-11-12T05:45:35.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.112+0000 7fc9d0f21700 1 -- 172.21.2.105:0/674771869 shutdown_connections 2021-11-12T05:45:35.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.112+0000 7fc9d0f21700 1 --2- 172.21.2.105:0/674771869 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc9b0053720 0x7fc9b0055be0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:35.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.112+0000 7fc9d0f21700 1 --2- 172.21.2.105:0/674771869 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc9cc1457e0 0x7fc9cc1511f0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:35.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.112+0000 7fc9d0f21700 1 --2- 172.21.2.105:0/674771869 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc9cc067010 0x7fc9cc150870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:35.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.112+0000 7fc9d0f21700 1 --2- 172.21.2.105:0/674771869 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc9ac003750 0x7fc9cc1419a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:35.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.112+0000 7fc9d0f21700 1 -- 172.21.2.105:0/674771869 >> 172.21.2.105:0/674771869 conn(0x7fc9cc068440 msgr2=0x7fc9cc0ac3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:35.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.112+0000 7fc9d0f21700 1 -- 172.21.2.105:0/674771869 shutdown_connections 2021-11-12T05:45:35.121 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.112+0000 7fc9d0f21700 1 -- 172.21.2.105:0/674771869 wait complete. 2021-11-12T05:45:35.121 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_metadata' removed 2021-11-12T05:45:35.128 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-12T05:45:35.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.176+0000 7f05cec25700 1 Processor -- start 2021-11-12T05:45:35.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.176+0000 7f05cec25700 1 -- start start 2021-11-12T05:45:35.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.176+0000 7f05cec25700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f05c80ad080 0x7f05c80af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:35.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.176+0000 7f05cec25700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f05c814b2f0 0x7f05c80ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:35.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.176+0000 7f05cec25700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05c80ac7b0 con 0x7f05c80ac280 2021-11-12T05:45:35.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.176+0000 7f05cec25700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c81488a0 con 0x7f05c814b2f0 2021-11-12T05:45:35.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.176+0000 7f05cec25700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c80ac9e0 con 0x7f05c80ad080 2021-11-12T05:45:35.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05cd1c2700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f05c814b2f0 0x7f05c80ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:35.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05cd1c2700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f05c814b2f0 0x7f05c80ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46338/0 (socket says 172.21.2.105:46338) 2021-11-12T05:45:35.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05cd1c2700 1 -- 172.21.2.105:0/1297595737 learned_addr learned my addr 172.21.2.105:0/1297595737 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:35.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05cd1c2700 1 -- 172.21.2.105:0/1297595737 >> v2:172.21.2.115:3300/0 conn(0x7f05c80ad080 msgr2=0x7f05c80af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:35.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05cd1c2700 1 --2- 172.21.2.105:0/1297595737 >> v2:172.21.2.115:3300/0 conn(0x7f05c80ad080 0x7f05c80af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:35.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05cd1c2700 1 -- 172.21.2.105:0/1297595737 >> v1:172.21.2.115:6789/0 conn(0x7f05c80ac280 legacy=0x7f05c814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:35.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05cd1c2700 1 -- 172.21.2.105:0/1297595737 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c80b0b30 con 0x7f05c814b2f0 2021-11-12T05:45:35.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05cd1c2700 1 --2- 172.21.2.105:0/1297595737 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f05c814b2f0 0x7f05c80ad460 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f05c80b06e0 tx=0x7f05c0009290).ready entity=mon.0 client_cookie=66cc6e42d3859869 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:35.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05c77fe700 1 -- 172.21.2.105:0/1297595737 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05c000b830 con 0x7f05c814b2f0 2021-11-12T05:45:35.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05c77fe700 1 -- 172.21.2.105:0/1297595737 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c000b990 con 0x7f05c814b2f0 2021-11-12T05:45:35.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05c77fe700 1 -- 172.21.2.105:0/1297595737 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05c000bb40 con 0x7f05c814b2f0 2021-11-12T05:45:35.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05cec25700 1 -- 172.21.2.105:0/1297595737 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f05c814b2f0 msgr2=0x7f05c80ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:35.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05cec25700 1 --2- 172.21.2.105:0/1297595737 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f05c814b2f0 0x7f05c80ad460 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f05c80b06e0 tx=0x7f05c0009290).stop 2021-11-12T05:45:35.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05cec25700 1 -- 172.21.2.105:0/1297595737 shutdown_connections 2021-11-12T05:45:35.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05cec25700 1 --2- 172.21.2.105:0/1297595737 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f05c814b2f0 0x7f05c80ad460 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:35.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05cec25700 1 --2- 172.21.2.105:0/1297595737 >> v2:172.21.2.115:3300/0 conn(0x7f05c80ad080 0x7f05c80af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:35.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05cec25700 1 -- 172.21.2.105:0/1297595737 >> 172.21.2.105:0/1297595737 conn(0x7f05c80b5370 msgr2=0x7f05c80b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:35.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05cec25700 1 -- 172.21.2.105:0/1297595737 shutdown_connections 2021-11-12T05:45:35.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05cec25700 1 -- 172.21.2.105:0/1297595737 wait complete. 2021-11-12T05:45:35.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05cec25700 1 Processor -- start 2021-11-12T05:45:35.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05cec25700 1 -- start start 2021-11-12T05:45:35.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05cec25700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f05c80ac280 0x7f05c80a9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:35.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05cec25700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f05c80ad080 0x7f05c8063850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:35.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05cec25700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f05c814b2f0 0x7f05c8142a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:35.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05cec25700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c80643b0 con 0x7f05c80ac280 2021-11-12T05:45:35.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05cec25700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c8062a30 con 0x7f05c80ad080 2021-11-12T05:45:35.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05cec25700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c8159b80 con 0x7f05c814b2f0 2021-11-12T05:45:35.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05cc9c1700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f05c80ac280 0x7f05c80a9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:35.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05cc9c1700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f05c80ac280 0x7f05c80a9ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46344/0 (socket says 172.21.2.105:46344) 2021-11-12T05:45:35.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05cc9c1700 1 -- 172.21.2.105:0/3180414656 learned_addr learned my addr 172.21.2.105:0/3180414656 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:35.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05cc9c1700 1 -- 172.21.2.105:0/3180414656 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f05c814b2f0 msgr2=0x7f05c8142a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:35.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05cc9c1700 1 --2- 172.21.2.105:0/3180414656 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f05c814b2f0 0x7f05c8142a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:35.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05cc9c1700 1 -- 172.21.2.105:0/3180414656 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f05c80ad080 msgr2=0x7f05c8063850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:35.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05cc9c1700 1 --2- 172.21.2.105:0/3180414656 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f05c80ad080 0x7f05c8063850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:35.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05cc9c1700 1 -- 172.21.2.105:0/3180414656 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c0009530 con 0x7f05c80ac280 2021-11-12T05:45:35.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05cc9c1700 1 --2- 172.21.2.105:0/3180414656 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f05c80ac280 0x7f05c80a9ab0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f05c8159d10 tx=0x7f05bc006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:35.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05c5ffb700 1 -- 172.21.2.105:0/3180414656 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05bc013460 con 0x7f05c80ac280 2021-11-12T05:45:35.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05c5ffb700 1 -- 172.21.2.105:0/3180414656 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05bc0135c0 con 0x7f05c80ac280 2021-11-12T05:45:35.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05c5ffb700 1 -- 172.21.2.105:0/3180414656 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05bc013920 con 0x7f05c80ac280 2021-11-12T05:45:35.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05cec25700 1 -- 172.21.2.105:0/3180414656 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c8159df0 con 0x7f05c80ac280 2021-11-12T05:45:35.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.180+0000 7f05cec25700 1 -- 172.21.2.105:0/3180414656 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c80abb60 con 0x7f05c80ac280 2021-11-12T05:45:35.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.184+0000 7f05cec25700 1 -- 172.21.2.105:0/3180414656 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c8064110 con 0x7f05c80ac280 2021-11-12T05:45:35.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.184+0000 7f05c5ffb700 1 -- 172.21.2.105:0/3180414656 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f05bc01a060 con 0x7f05c80ac280 2021-11-12T05:45:35.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.184+0000 7f05c5ffb700 1 --2- 172.21.2.105:0/3180414656 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f05a80536f0 0x7f05a8055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:35.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.184+0000 7f05c5ffb700 1 -- 172.21.2.105:0/3180414656 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6064+0+0 (secure 0 0 0) 0x7f05bc06b4d0 con 0x7f05c80ac280 2021-11-12T05:45:35.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.184+0000 7f05c7fff700 1 --2- 172.21.2.105:0/3180414656 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f05a80536f0 0x7f05a8055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:35.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.184+0000 7f05c7fff700 1 --2- 172.21.2.105:0/3180414656 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f05a80536f0 0x7f05a8055bb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f05b8002f90 tx=0x7f05b80069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:35.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.184+0000 7f05c5ffb700 1 -- 172.21.2.105:0/3180414656 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f05c8064110 con 0x7f05c80ac280 2021-11-12T05:45:35.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:35.268+0000 7f05cec25700 1 -- 172.21.2.105:0/3180414656 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f05c8064110 con 0x7f05c80ac280 2021-11-12T05:45:36.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.112+0000 7f05c5ffb700 1 -- 172.21.2.105:0/3180414656 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v58) v1 ==== 173+0+0 (secure 0 0 0) 0x7f05c8064110 con 0x7f05c80ac280 2021-11-12T05:45:36.121 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.116+0000 7f05cec25700 1 -- 172.21.2.105:0/3180414656 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f05a80536f0 msgr2=0x7f05a8055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:36.122 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.116+0000 7f05cec25700 1 --2- 172.21.2.105:0/3180414656 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f05a80536f0 0x7f05a8055bb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f05b8002f90 tx=0x7f05b80069b0).stop 2021-11-12T05:45:36.122 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.116+0000 7f05cec25700 1 -- 172.21.2.105:0/3180414656 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f05c80ac280 msgr2=0x7f05c80a9ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:36.122 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.116+0000 7f05cec25700 1 --2- 172.21.2.105:0/3180414656 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f05c80ac280 0x7f05c80a9ab0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f05c8159d10 tx=0x7f05bc006ec0).stop 2021-11-12T05:45:36.122 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.116+0000 7f05cec25700 1 -- 172.21.2.105:0/3180414656 shutdown_connections 2021-11-12T05:45:36.123 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.116+0000 7f05cec25700 1 --2- 172.21.2.105:0/3180414656 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f05a80536f0 0x7f05a8055bb0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:36.123 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.116+0000 7f05cec25700 1 --2- 172.21.2.105:0/3180414656 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f05c814b2f0 0x7f05c8142a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:36.123 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.116+0000 7f05cec25700 1 --2- 172.21.2.105:0/3180414656 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f05c80ad080 0x7f05c8063850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:36.123 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.116+0000 7f05cec25700 1 --2- 172.21.2.105:0/3180414656 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f05c80ac280 0x7f05c80a9ab0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:36.124 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.116+0000 7f05cec25700 1 -- 172.21.2.105:0/3180414656 >> 172.21.2.105:0/3180414656 conn(0x7f05c80b5370 msgr2=0x7f05c814aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:36.124 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.116+0000 7f05cec25700 1 -- 172.21.2.105:0/3180414656 shutdown_connections 2021-11-12T05:45:36.124 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.116+0000 7f05cec25700 1 -- 172.21.2.105:0/3180414656 wait complete. 2021-11-12T05:45:36.124 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_data' removed 2021-11-12T05:45:36.133 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-11-12T05:45:36.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.180+0000 7f66ed75f700 1 Processor -- start 2021-11-12T05:45:36.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.180+0000 7f66ed75f700 1 -- start start 2021-11-12T05:45:36.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.180+0000 7f66ed75f700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f66e80b0520 0x7f66e8144890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:36.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.180+0000 7f66ed75f700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66e80b1840 con 0x7f66e80ace20 2021-11-12T05:45:36.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.180+0000 7f66ed75f700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66e80af2b0 con 0x7f66e80aca40 2021-11-12T05:45:36.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.180+0000 7f66ed75f700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66e80b0990 con 0x7f66e80b0520 2021-11-12T05:45:36.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.180+0000 7f66e67fc700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f66e80ace20 0x7f66e8144180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:56748/0 (socket says 172.21.2.105:56748) 2021-11-12T05:45:36.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.180+0000 7f66e67fc700 1 -- 172.21.2.105:0/849571458 learned_addr learned my addr 172.21.2.105:0/849571458 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:45:36.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.180+0000 7f66e77fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f66e80b0520 0x7f66e8144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:36.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.184+0000 7f66e77fe700 1 -- 172.21.2.105:0/849571458 >> v1:172.21.2.115:6789/0 conn(0x7f66e80aca40 legacy=0x7f66e81473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:36.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.184+0000 7f66e77fe700 1 -- 172.21.2.105:0/849571458 >> v1:172.21.2.105:6789/0 conn(0x7f66e80ace20 legacy=0x7f66e8144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:36.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.184+0000 7f66e77fe700 1 -- 172.21.2.105:0/849571458 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e8144d80 con 0x7f66e80b0520 2021-11-12T05:45:36.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.184+0000 7f66e77fe700 1 --2- 172.21.2.105:0/849571458 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66e80b0520 0x7f66e8144890 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7f66e80611e0 tx=0x7f66e00091d0).ready entity=mon.0 client_cookie=268225a63ae37ec8 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:36.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.184+0000 7f66e5ffb700 1 -- 172.21.2.105:0/849571458 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66e0009ea0 con 0x7f66e80b0520 2021-11-12T05:45:36.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.184+0000 7f66e5ffb700 1 -- 172.21.2.105:0/849571458 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e000b860 con 0x7f66e80b0520 2021-11-12T05:45:36.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.184+0000 7f66e5ffb700 1 -- 172.21.2.105:0/849571458 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66e000b9d0 con 0x7f66e80b0520 2021-11-12T05:45:36.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.184+0000 7f66ed75f700 1 -- 172.21.2.105:0/849571458 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66e80b0520 msgr2=0x7f66e8144890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:36.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.184+0000 7f66ed75f700 1 --2- 172.21.2.105:0/849571458 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66e80b0520 0x7f66e8144890 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7f66e80611e0 tx=0x7f66e00091d0).stop 2021-11-12T05:45:36.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.184+0000 7f66ed75f700 1 -- 172.21.2.105:0/849571458 shutdown_connections 2021-11-12T05:45:36.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.184+0000 7f66ed75f700 1 --2- 172.21.2.105:0/849571458 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66e80b0520 0x7f66e8144890 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:36.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.184+0000 7f66ed75f700 1 -- 172.21.2.105:0/849571458 >> 172.21.2.105:0/849571458 conn(0x7f66e805c490 msgr2=0x7f66e80b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:36.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.184+0000 7f66ed75f700 1 -- 172.21.2.105:0/849571458 shutdown_connections 2021-11-12T05:45:36.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.184+0000 7f66ed75f700 1 -- 172.21.2.105:0/849571458 wait complete. 2021-11-12T05:45:36.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.184+0000 7f66ed75f700 1 Processor -- start 2021-11-12T05:45:36.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.184+0000 7f66ed75f700 1 -- start start 2021-11-12T05:45:36.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.184+0000 7f66ed75f700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f66e80aca40 0x7f66e8147c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:36.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.184+0000 7f66ed75f700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66e80ace20 0x7f66e8156f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:36.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.184+0000 7f66ed75f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66e80b0520 0x7f66e8159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:36.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.184+0000 7f66ed75f700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e80a8b70 con 0x7f66e80ace20 2021-11-12T05:45:36.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.184+0000 7f66ed75f700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e81567c0 con 0x7f66e80aca40 2021-11-12T05:45:36.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.184+0000 7f66ed75f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e8156a60 con 0x7f66e80b0520 2021-11-12T05:45:36.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.184+0000 7f66e67fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66e80ace20 0x7f66e8156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:36.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.184+0000 7f66e67fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66e80ace20 0x7f66e8156f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46360/0 (socket says 172.21.2.105:46360) 2021-11-12T05:45:36.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.184+0000 7f66e67fc700 1 -- 172.21.2.105:0/916814353 learned_addr learned my addr 172.21.2.105:0/916814353 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:36.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.184+0000 7f66e67fc700 1 -- 172.21.2.105:0/916814353 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66e80b0520 msgr2=0x7f66e8159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:36.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.184+0000 7f66e67fc700 1 --2- 172.21.2.105:0/916814353 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66e80b0520 0x7f66e8159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:36.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.184+0000 7f66e67fc700 1 -- 172.21.2.105:0/916814353 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f66e80aca40 msgr2=0x7f66e8147c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:36.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.184+0000 7f66e67fc700 1 --2- 172.21.2.105:0/916814353 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f66e80aca40 0x7f66e8147c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:36.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.184+0000 7f66e67fc700 1 -- 172.21.2.105:0/916814353 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e0009470 con 0x7f66e80ace20 2021-11-12T05:45:36.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.184+0000 7f66e67fc700 1 --2- 172.21.2.105:0/916814353 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66e80ace20 0x7f66e8156f00 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f66e8061140 tx=0x7f66d8007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:36.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.184+0000 7f66dffff700 1 -- 172.21.2.105:0/916814353 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66d800ce30 con 0x7f66e80ace20 2021-11-12T05:45:36.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.184+0000 7f66dffff700 1 -- 172.21.2.105:0/916814353 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d80072e0 con 0x7f66e80ace20 2021-11-12T05:45:36.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.184+0000 7f66dffff700 1 -- 172.21.2.105:0/916814353 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66d8005800 con 0x7f66e80ace20 2021-11-12T05:45:36.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.184+0000 7f66ed75f700 1 -- 172.21.2.105:0/916814353 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66e80a87c0 con 0x7f66e80ace20 2021-11-12T05:45:36.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.184+0000 7f66ed75f700 1 -- 172.21.2.105:0/916814353 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e81573f0 con 0x7f66e80ace20 2021-11-12T05:45:36.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.184+0000 7f66ed75f700 1 -- 172.21.2.105:0/916814353 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66e8156c20 con 0x7f66e80ace20 2021-11-12T05:45:36.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.184+0000 7f66dffff700 1 -- 172.21.2.105:0/916814353 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f66d8010070 con 0x7f66e80ace20 2021-11-12T05:45:36.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.188+0000 7f66dffff700 1 --2- 172.21.2.105:0/916814353 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f66cc053660 0x7f66cc055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:36.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.188+0000 7f66dffff700 1 -- 172.21.2.105:0/916814353 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f66d806afc0 con 0x7f66e80ace20 2021-11-12T05:45:36.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.188+0000 7f66e6ffd700 1 --2- 172.21.2.105:0/916814353 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f66cc053660 0x7f66cc055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:36.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.188+0000 7f66e6ffd700 1 --2- 172.21.2.105:0/916814353 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f66cc053660 0x7f66cc055b20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f66d0002f90 tx=0x7f66d00069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:36.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.188+0000 7f66dffff700 1 -- 172.21.2.105:0/916814353 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f66d8042190 con 0x7f66e80ace20 2021-11-12T05:45:36.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.272+0000 7f66ed75f700 1 -- 172.21.2.105:0/916814353 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f66e8065760 con 0x7f66e80ace20 2021-11-12T05:45:36.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.280+0000 7f66dffff700 1 -- 172.21.2.105:0/916814353 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7f66d80457b0 con 0x7f66e80ace20 2021-11-12T05:45:36.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.280+0000 7f66ed75f700 1 -- 172.21.2.105:0/916814353 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f66cc053660 msgr2=0x7f66cc055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:36.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.280+0000 7f66ed75f700 1 --2- 172.21.2.105:0/916814353 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f66cc053660 0x7f66cc055b20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f66d0002f90 tx=0x7f66d00069b0).stop 2021-11-12T05:45:36.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.280+0000 7f66ed75f700 1 -- 172.21.2.105:0/916814353 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66e80ace20 msgr2=0x7f66e8156f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:36.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.280+0000 7f66ed75f700 1 --2- 172.21.2.105:0/916814353 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66e80ace20 0x7f66e8156f00 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f66e8061140 tx=0x7f66d8007c40).stop 2021-11-12T05:45:36.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.280+0000 7f66ed75f700 1 -- 172.21.2.105:0/916814353 shutdown_connections 2021-11-12T05:45:36.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.280+0000 7f66ed75f700 1 --2- 172.21.2.105:0/916814353 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f66cc053660 0x7f66cc055b20 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:36.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.280+0000 7f66ed75f700 1 --2- 172.21.2.105:0/916814353 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66e80b0520 0x7f66e8159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:36.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.280+0000 7f66ed75f700 1 --2- 172.21.2.105:0/916814353 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66e80ace20 0x7f66e8156f00 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:36.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.280+0000 7f66ed75f700 1 --2- 172.21.2.105:0/916814353 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f66e80aca40 0x7f66e8147c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:36.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.280+0000 7f66ed75f700 1 -- 172.21.2.105:0/916814353 >> 172.21.2.105:0/916814353 conn(0x7f66e805c490 msgr2=0x7f66e80b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:36.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.280+0000 7f66ed75f700 1 -- 172.21.2.105:0/916814353 shutdown_connections 2021-11-12T05:45:36.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.280+0000 7f66ed75f700 1 -- 172.21.2.105:0/916814353 wait complete. 2021-11-12T05:45:36.291 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout' 2021-11-12T05:45:36.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.336+0000 7f5c30b24700 1 Processor -- start 2021-11-12T05:45:36.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.336+0000 7f5c30b24700 1 -- start start 2021-11-12T05:45:36.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c30b24700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f5c2c05d760 0x7f5c2c0b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:36.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c30b24700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c2c0b5ea0 con 0x7f5c2c0b5ac0 2021-11-12T05:45:36.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c30b24700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c2c0b1a60 con 0x7f5c2c0b01b0 2021-11-12T05:45:36.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c30b24700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c2c0accd0 con 0x7f5c2c05d760 2021-11-12T05:45:36.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c2a59c700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f5c2c0b5ac0 0x7f5c2c0ae470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:56760/0 (socket says 172.21.2.105:56760) 2021-11-12T05:45:36.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c2a59c700 1 -- 172.21.2.105:0/3614885760 learned_addr learned my addr 172.21.2.105:0/3614885760 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:45:36.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c2ad9d700 1 --2- 172.21.2.105:0/3614885760 >> v2:172.21.2.105:3300/0 conn(0x7f5c2c05d760 0x7f5c2c0b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:36.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c2ad9d700 1 -- 172.21.2.105:0/3614885760 >> v1:172.21.2.115:6789/0 conn(0x7f5c2c0b01b0 legacy=0x7f5c2c0aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:36.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c2ad9d700 1 -- 172.21.2.105:0/3614885760 >> v1:172.21.2.105:6789/0 conn(0x7f5c2c0b5ac0 legacy=0x7f5c2c0ae470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:36.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c2ad9d700 1 -- 172.21.2.105:0/3614885760 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c2c0acf70 con 0x7f5c2c05d760 2021-11-12T05:45:36.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c2ad9d700 1 --2- 172.21.2.105:0/3614885760 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c2c05d760 0x7f5c2c0b13c0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f5c2c0ad2f0 tx=0x7f5c240091d0).ready entity=mon.0 client_cookie=ae0bceddda4825e4 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:36.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c2959a700 1 -- 172.21.2.105:0/3614885760 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c24009ea0 con 0x7f5c2c05d760 2021-11-12T05:45:36.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c2959a700 1 -- 172.21.2.105:0/3614885760 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2400b860 con 0x7f5c2c05d760 2021-11-12T05:45:36.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c2959a700 1 -- 172.21.2.105:0/3614885760 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c2400b9d0 con 0x7f5c2c05d760 2021-11-12T05:45:36.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c30b24700 1 -- 172.21.2.105:0/3614885760 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c2c05d760 msgr2=0x7f5c2c0b13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:36.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c30b24700 1 --2- 172.21.2.105:0/3614885760 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c2c05d760 0x7f5c2c0b13c0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f5c2c0ad2f0 tx=0x7f5c240091d0).stop 2021-11-12T05:45:36.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c30b24700 1 -- 172.21.2.105:0/3614885760 shutdown_connections 2021-11-12T05:45:36.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c30b24700 1 --2- 172.21.2.105:0/3614885760 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c2c05d760 0x7f5c2c0b13c0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:36.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c30b24700 1 -- 172.21.2.105:0/3614885760 >> 172.21.2.105:0/3614885760 conn(0x7f5c2c0628b0 msgr2=0x7f5c2c062c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:36.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c30b24700 1 -- 172.21.2.105:0/3614885760 shutdown_connections 2021-11-12T05:45:36.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c30b24700 1 -- 172.21.2.105:0/3614885760 wait complete. 2021-11-12T05:45:36.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c30b24700 1 Processor -- start 2021-11-12T05:45:36.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c30b24700 1 -- start start 2021-11-12T05:45:36.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c30b24700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c2c05d760 0x7f5c2c147e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:36.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c30b24700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5c2c0b01b0 0x7f5c2c12d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:36.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c30b24700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5c2c0b5ac0 0x7f5c2c12da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:36.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c30b24700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2c149af0 con 0x7f5c2c05d760 2021-11-12T05:45:36.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c30b24700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2c066c40 con 0x7f5c2c0b5ac0 2021-11-12T05:45:36.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c30b24700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2c156af0 con 0x7f5c2c0b01b0 2021-11-12T05:45:36.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c2a59c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c2c05d760 0x7f5c2c147e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:36.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c2a59c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c2c05d760 0x7f5c2c147e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46370/0 (socket says 172.21.2.105:46370) 2021-11-12T05:45:36.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c2a59c700 1 -- 172.21.2.105:0/2457412303 learned_addr learned my addr 172.21.2.105:0/2457412303 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:36.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c2a59c700 1 -- 172.21.2.105:0/2457412303 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5c2c0b01b0 msgr2=0x7f5c2c12d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:36.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c2a59c700 1 --2- 172.21.2.105:0/2457412303 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5c2c0b01b0 0x7f5c2c12d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:36.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c2a59c700 1 -- 172.21.2.105:0/2457412303 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5c2c0b5ac0 msgr2=0x7f5c2c12da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:36.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c2a59c700 1 --2- 172.21.2.105:0/2457412303 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5c2c0b5ac0 0x7f5c2c12da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:36.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c2a59c700 1 -- 172.21.2.105:0/2457412303 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c24009470 con 0x7f5c2c05d760 2021-11-12T05:45:36.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c2a59c700 1 --2- 172.21.2.105:0/2457412303 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c2c05d760 0x7f5c2c147e30 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f5c2c0b6470 tx=0x7f5c1c007ca0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:36.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c237fe700 1 -- 172.21.2.105:0/2457412303 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c1c00ce30 con 0x7f5c2c05d760 2021-11-12T05:45:36.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c237fe700 1 -- 172.21.2.105:0/2457412303 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c1c0072e0 con 0x7f5c2c05d760 2021-11-12T05:45:36.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c30b24700 1 -- 172.21.2.105:0/2457412303 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c2c147770 con 0x7f5c2c05d760 2021-11-12T05:45:36.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c30b24700 1 -- 172.21.2.105:0/2457412303 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c2c12df20 con 0x7f5c2c05d760 2021-11-12T05:45:36.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c237fe700 1 -- 172.21.2.105:0/2457412303 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c1c005800 con 0x7f5c2c05d760 2021-11-12T05:45:36.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.340+0000 7f5c30b24700 1 -- 172.21.2.105:0/2457412303 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c2c066e40 con 0x7f5c2c05d760 2021-11-12T05:45:36.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.344+0000 7f5c237fe700 1 -- 172.21.2.105:0/2457412303 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5c1c01a060 con 0x7f5c2c05d760 2021-11-12T05:45:36.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.344+0000 7f5c237fe700 1 --2- 172.21.2.105:0/2457412303 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5c10053540 0x7f5c10055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:36.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.344+0000 7f5c237fe700 1 -- 172.21.2.105:0/2457412303 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f5c1c06acc0 con 0x7f5c2c05d760 2021-11-12T05:45:36.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.344+0000 7f5c29d9b700 1 --2- 172.21.2.105:0/2457412303 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5c10053540 0x7f5c10055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:36.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.344+0000 7f5c29d9b700 1 --2- 172.21.2.105:0/2457412303 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5c10053540 0x7f5c10055a00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f5c14002f90 tx=0x7f5c140069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:36.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.344+0000 7f5c237fe700 1 -- 172.21.2.105:0/2457412303 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5c1c041e90 con 0x7f5c2c05d760 2021-11-12T05:45:36.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:36.460+0000 7f5c30b24700 1 -- 172.21.2.105:0/2457412303 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]} v 0) v1 -- 0x7f5c2c0ad410 con 0x7f5c2c05d760 2021-11-12T05:45:37.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.116+0000 7f5c237fe700 1 -- 172.21.2.105:0/2457412303 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]}]=0 v204) v1 ==== 152+0+0 (secure 0 0 0) 0x7f5c1c018020 con 0x7f5c2c05d760 2021-11-12T05:45:37.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.116+0000 7f5c30b24700 1 -- 172.21.2.105:0/2457412303 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5c10053540 msgr2=0x7f5c10055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:37.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.116+0000 7f5c30b24700 1 --2- 172.21.2.105:0/2457412303 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5c10053540 0x7f5c10055a00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f5c14002f90 tx=0x7f5c140069b0).stop 2021-11-12T05:45:37.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.116+0000 7f5c30b24700 1 -- 172.21.2.105:0/2457412303 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c2c05d760 msgr2=0x7f5c2c147e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:37.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.116+0000 7f5c30b24700 1 --2- 172.21.2.105:0/2457412303 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c2c05d760 0x7f5c2c147e30 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f5c2c0b6470 tx=0x7f5c1c007ca0).stop 2021-11-12T05:45:37.121 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.116+0000 7f5c30b24700 1 -- 172.21.2.105:0/2457412303 shutdown_connections 2021-11-12T05:45:37.121 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.116+0000 7f5c30b24700 1 --2- 172.21.2.105:0/2457412303 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5c10053540 0x7f5c10055a00 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:37.121 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.116+0000 7f5c30b24700 1 --2- 172.21.2.105:0/2457412303 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5c2c0b5ac0 0x7f5c2c12da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:37.121 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.116+0000 7f5c30b24700 1 --2- 172.21.2.105:0/2457412303 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5c2c0b01b0 0x7f5c2c12d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:37.121 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.116+0000 7f5c30b24700 1 --2- 172.21.2.105:0/2457412303 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c2c05d760 0x7f5c2c147e30 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:37.122 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.116+0000 7f5c30b24700 1 -- 172.21.2.105:0/2457412303 >> 172.21.2.105:0/2457412303 conn(0x7f5c2c0628b0 msgr2=0x7f5c2c0ae900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:37.122 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.116+0000 7f5c30b24700 1 -- 172.21.2.105:0/2457412303 shutdown_connections 2021-11-12T05:45:37.122 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.116+0000 7f5c30b24700 1 -- 172.21.2.105:0/2457412303 wait complete. 2021-11-12T05:45:37.127 INFO:tasks.cephfs_test_runner:test_drop_cache_command_dead_timeout (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-11-12T05:45:37.127 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_timeout (tasks.cephfs.test_misc.TestCacheDrop) 2021-11-12T05:45:37.128 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout' 2021-11-12T05:45:37.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.180+0000 7f03bfacc700 1 Processor -- start 2021-11-12T05:45:37.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.180+0000 7f03bfacc700 1 -- start start 2021-11-12T05:45:37.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.180+0000 7f03bfacc700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f03b805fdc0 0x7f03b80601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:37.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.180+0000 7f03bfacc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f03b80ade80 0x7f03b8066730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:37.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.180+0000 7f03bfacc700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f03b813a9c0 0x7f03b813ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:37.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.180+0000 7f03bfacc700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03b8141fb0 con 0x7f03b80ade80 2021-11-12T05:45:37.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.180+0000 7f03bfacc700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03b8066150 con 0x7f03b813a9c0 2021-11-12T05:45:37.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.180+0000 7f03bfacc700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b80663f0 con 0x7f03b805fdc0 2021-11-12T05:45:37.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.180+0000 7f03bd067700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f03b80ade80 0x7f03b8066730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:37.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.180+0000 7f03bd067700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f03b80ade80 0x7f03b8066730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46382/0 (socket says 172.21.2.105:46382) 2021-11-12T05:45:37.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.180+0000 7f03bd067700 1 -- 172.21.2.105:0/1677962511 learned_addr learned my addr 172.21.2.105:0/1677962511 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:37.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.180+0000 7f03bd067700 1 -- 172.21.2.105:0/1677962511 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f03b805fdc0 msgr2=0x7f03b80601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:37.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.180+0000 7f03bd067700 1 --2- 172.21.2.105:0/1677962511 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f03b805fdc0 0x7f03b80601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:37.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.180+0000 7f03bd067700 1 -- 172.21.2.105:0/1677962511 >> v2:172.21.2.115:3300/0 conn(0x7f03b813a9c0 msgr2=0x7f03b813ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:37.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.180+0000 7f03bd067700 1 --2- 172.21.2.105:0/1677962511 >> v2:172.21.2.115:3300/0 conn(0x7f03b813a9c0 0x7f03b813ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:37.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.180+0000 7f03bd067700 1 -- 172.21.2.105:0/1677962511 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b8140fd0 con 0x7f03b80ade80 2021-11-12T05:45:37.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.180+0000 7f03bd067700 1 --2- 172.21.2.105:0/1677962511 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f03b80ade80 0x7f03b8066730 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f03ac002f70 tx=0x7f03ac006eb0).ready entity=mon.0 client_cookie=1128eb52e63fd23f server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:37.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.180+0000 7f03bc866700 1 -- 172.21.2.105:0/1677962511 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03ac010b60 con 0x7f03b80ade80 2021-11-12T05:45:37.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.180+0000 7f03bc866700 1 -- 172.21.2.105:0/1677962511 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ac000e90 con 0x7f03b80ade80 2021-11-12T05:45:37.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.180+0000 7f03bc866700 1 -- 172.21.2.105:0/1677962511 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03ac0183d0 con 0x7f03b80ade80 2021-11-12T05:45:37.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.180+0000 7f03bfacc700 1 -- 172.21.2.105:0/1677962511 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f03b80ade80 msgr2=0x7f03b8066730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:37.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.180+0000 7f03bfacc700 1 --2- 172.21.2.105:0/1677962511 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f03b80ade80 0x7f03b8066730 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f03ac002f70 tx=0x7f03ac006eb0).stop 2021-11-12T05:45:37.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.180+0000 7f03bfacc700 1 -- 172.21.2.105:0/1677962511 shutdown_connections 2021-11-12T05:45:37.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.180+0000 7f03bfacc700 1 --2- 172.21.2.105:0/1677962511 >> v2:172.21.2.115:3300/0 conn(0x7f03b813a9c0 0x7f03b813ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:37.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.180+0000 7f03bfacc700 1 --2- 172.21.2.105:0/1677962511 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f03b80ade80 0x7f03b8066730 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:37.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.180+0000 7f03bfacc700 1 --2- 172.21.2.105:0/1677962511 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f03b805fdc0 0x7f03b80601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:37.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.180+0000 7f03bfacc700 1 -- 172.21.2.105:0/1677962511 >> 172.21.2.105:0/1677962511 conn(0x7f03b80608d0 msgr2=0x7f03b805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:37.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.180+0000 7f03bfacc700 1 -- 172.21.2.105:0/1677962511 shutdown_connections 2021-11-12T05:45:37.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.180+0000 7f03bfacc700 1 -- 172.21.2.105:0/1677962511 wait complete. 2021-11-12T05:45:37.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.180+0000 7f03bfacc700 1 Processor -- start 2021-11-12T05:45:37.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.180+0000 7f03bfacc700 1 -- start start 2021-11-12T05:45:37.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.184+0000 7f03bfacc700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f03b805fdc0 0x7f03b8144d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:37.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.184+0000 7f03bfacc700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f03b80ade80 0x7f03b8139da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:37.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.184+0000 7f03bfacc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f03b813a9c0 0x7f03b813a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:37.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.184+0000 7f03bfacc700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b81431f0 con 0x7f03b813a9c0 2021-11-12T05:45:37.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.184+0000 7f03bfacc700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b8143490 con 0x7f03b805fdc0 2021-11-12T05:45:37.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.184+0000 7f03bfacc700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b814df00 con 0x7f03b80ade80 2021-11-12T05:45:37.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.184+0000 7f03be069700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f03b813a9c0 0x7f03b813a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:37.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.184+0000 7f03be069700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f03b813a9c0 0x7f03b813a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46388/0 (socket says 172.21.2.105:46388) 2021-11-12T05:45:37.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.184+0000 7f03be069700 1 -- 172.21.2.105:0/2527303668 learned_addr learned my addr 172.21.2.105:0/2527303668 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:37.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.184+0000 7f03bd868700 1 --2- 172.21.2.105:0/2527303668 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f03b805fdc0 0x7f03b8144d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:37.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.184+0000 7f03bd067700 1 --2- 172.21.2.105:0/2527303668 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f03b80ade80 0x7f03b8139da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:37.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.184+0000 7f03be069700 1 -- 172.21.2.105:0/2527303668 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f03b80ade80 msgr2=0x7f03b8139da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:37.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.184+0000 7f03be069700 1 --2- 172.21.2.105:0/2527303668 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f03b80ade80 0x7f03b8139da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:37.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.184+0000 7f03be069700 1 -- 172.21.2.105:0/2527303668 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f03b805fdc0 msgr2=0x7f03b8144d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:37.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.184+0000 7f03be069700 1 --2- 172.21.2.105:0/2527303668 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f03b805fdc0 0x7f03b8144d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:37.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.184+0000 7f03be069700 1 -- 172.21.2.105:0/2527303668 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ac00b1e0 con 0x7f03b813a9c0 2021-11-12T05:45:37.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.184+0000 7f03bd868700 1 --2- 172.21.2.105:0/2527303668 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f03b805fdc0 0x7f03b8144d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:45:37.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.184+0000 7f03be069700 1 --2- 172.21.2.105:0/2527303668 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f03b813a9c0 0x7f03b813a290 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f03b0002f70 tx=0x7f03b0006d30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:37.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.184+0000 7f03b6ffd700 1 -- 172.21.2.105:0/2527303668 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03b0011400 con 0x7f03b813a9c0 2021-11-12T05:45:37.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.184+0000 7f03b6ffd700 1 -- 172.21.2.105:0/2527303668 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b0011560 con 0x7f03b813a9c0 2021-11-12T05:45:37.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.184+0000 7f03b6ffd700 1 -- 172.21.2.105:0/2527303668 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03b00116d0 con 0x7f03b813a9c0 2021-11-12T05:45:37.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.184+0000 7f03bfacc700 1 -- 172.21.2.105:0/2527303668 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03b8142f10 con 0x7f03b813a9c0 2021-11-12T05:45:37.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.184+0000 7f03bfacc700 1 -- 172.21.2.105:0/2527303668 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03b80b5360 con 0x7f03b813a9c0 2021-11-12T05:45:37.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.184+0000 7f03bfacc700 1 -- 172.21.2.105:0/2527303668 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03b814e0c0 con 0x7f03b813a9c0 2021-11-12T05:45:37.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.184+0000 7f03b6ffd700 1 -- 172.21.2.105:0/2527303668 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f03b000f070 con 0x7f03b813a9c0 2021-11-12T05:45:37.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.184+0000 7f03b6ffd700 1 --2- 172.21.2.105:0/2527303668 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0398053610 0x7f0398055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:37.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.184+0000 7f03b6ffd700 1 -- 172.21.2.105:0/2527303668 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f03b006afd0 con 0x7f03b813a9c0 2021-11-12T05:45:37.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.184+0000 7f03bd868700 1 --2- 172.21.2.105:0/2527303668 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0398053610 0x7f0398055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:37.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.184+0000 7f03bd868700 1 --2- 172.21.2.105:0/2527303668 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0398053610 0x7f0398055ad0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f03a8007000 tx=0x7f03a8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:37.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.188+0000 7f03b6ffd700 1 -- 172.21.2.105:0/2527303668 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f03b00422b0 con 0x7f03b813a9c0 2021-11-12T05:45:37.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:37.300+0000 7f03bfacc700 1 -- 172.21.2.105:0/2527303668 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]} v 0) v1 -- 0x7f03b8057350 con 0x7f03b813a9c0 2021-11-12T05:45:38.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.124+0000 7f03b6ffd700 1 -- 172.21.2.105:0/2527303668 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]}]=0 v205) v1 ==== 150+0+0 (secure 0 0 0) 0x7f03b00458d0 con 0x7f03b813a9c0 2021-11-12T05:45:38.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.124+0000 7f03bfacc700 1 -- 172.21.2.105:0/2527303668 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0398053610 msgr2=0x7f0398055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:38.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.124+0000 7f03bfacc700 1 --2- 172.21.2.105:0/2527303668 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0398053610 0x7f0398055ad0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f03a8007000 tx=0x7f03a8008040).stop 2021-11-12T05:45:38.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.124+0000 7f03bfacc700 1 -- 172.21.2.105:0/2527303668 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f03b813a9c0 msgr2=0x7f03b813a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:38.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.124+0000 7f03bfacc700 1 --2- 172.21.2.105:0/2527303668 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f03b813a9c0 0x7f03b813a290 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f03b0002f70 tx=0x7f03b0006d30).stop 2021-11-12T05:45:38.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.124+0000 7f03bfacc700 1 -- 172.21.2.105:0/2527303668 shutdown_connections 2021-11-12T05:45:38.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.124+0000 7f03bfacc700 1 --2- 172.21.2.105:0/2527303668 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0398053610 0x7f0398055ad0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:38.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.124+0000 7f03bfacc700 1 --2- 172.21.2.105:0/2527303668 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f03b813a9c0 0x7f03b813a290 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:38.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.124+0000 7f03bfacc700 1 --2- 172.21.2.105:0/2527303668 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f03b80ade80 0x7f03b8139da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:38.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.124+0000 7f03bfacc700 1 --2- 172.21.2.105:0/2527303668 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f03b805fdc0 0x7f03b8144d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:38.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.124+0000 7f03bfacc700 1 -- 172.21.2.105:0/2527303668 >> 172.21.2.105:0/2527303668 conn(0x7f03b80608d0 msgr2=0x7f03b80b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:38.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.124+0000 7f03bfacc700 1 -- 172.21.2.105:0/2527303668 shutdown_connections 2021-11-12T05:45:38.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.124+0000 7f03bfacc700 1 -- 172.21.2.105:0/2527303668 wait complete. 2021-11-12T05:45:38.137 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-11-12T05:45:38.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.188+0000 7f4db2649700 1 Processor -- start 2021-11-12T05:45:38.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.188+0000 7f4db2649700 1 -- start start 2021-11-12T05:45:38.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.188+0000 7f4db2649700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f4dac0b2e20 0x7f4dac0b1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:38.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.188+0000 7f4db2649700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f4dac05c490 0x7f4dac13ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:38.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.188+0000 7f4db2649700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dac0ad400 con 0x7f4dac05c900 2021-11-12T05:45:38.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.188+0000 7f4db2649700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dac0b3200 con 0x7f4dac05c490 2021-11-12T05:45:38.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.188+0000 7f4db2649700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dac0ad660 con 0x7f4dac0b2e20 2021-11-12T05:45:38.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.188+0000 7f4dab7fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f4dac05c490 0x7f4dac13ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:38.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4dab7fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f4dac05c490 0x7f4dac13ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46396/0 (socket says 172.21.2.105:46396) 2021-11-12T05:45:38.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4dab7fe700 1 -- 172.21.2.105:0/1853132625 learned_addr learned my addr 172.21.2.105:0/1853132625 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:38.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4dab7fe700 1 -- 172.21.2.105:0/1853132625 >> v2:172.21.2.115:3300/0 conn(0x7f4dac0b2e20 msgr2=0x7f4dac0b1060 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:45:38.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4dab7fe700 1 --2- 172.21.2.105:0/1853132625 >> v2:172.21.2.115:3300/0 conn(0x7f4dac0b2e20 0x7f4dac0b1060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:38.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4dab7fe700 1 -- 172.21.2.105:0/1853132625 >> v1:172.21.2.115:6789/0 conn(0x7f4dac05c900 legacy=0x7f4dac13ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:38.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4dab7fe700 1 -- 172.21.2.105:0/1853132625 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dac0ad900 con 0x7f4dac05c490 2021-11-12T05:45:38.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4dab7fe700 1 --2- 172.21.2.105:0/1853132625 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4dac05c490 0x7f4dac13ea50 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7f4dac0b3520 tx=0x7f4da0006eb0).ready entity=mon.0 client_cookie=1558aeff0d2f6a42 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:38.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4daaffd700 1 -- 172.21.2.105:0/1853132625 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4da000d5c0 con 0x7f4dac05c490 2021-11-12T05:45:38.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4daaffd700 1 -- 172.21.2.105:0/1853132625 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da0000e90 con 0x7f4dac05c490 2021-11-12T05:45:38.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4daaffd700 1 -- 172.21.2.105:0/1853132625 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4da000d910 con 0x7f4dac05c490 2021-11-12T05:45:38.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4db2649700 1 -- 172.21.2.105:0/1853132625 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4dac05c490 msgr2=0x7f4dac13ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:38.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4db2649700 1 --2- 172.21.2.105:0/1853132625 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4dac05c490 0x7f4dac13ea50 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7f4dac0b3520 tx=0x7f4da0006eb0).stop 2021-11-12T05:45:38.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4db2649700 1 -- 172.21.2.105:0/1853132625 shutdown_connections 2021-11-12T05:45:38.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4db2649700 1 --2- 172.21.2.105:0/1853132625 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4dac05c490 0x7f4dac13ea50 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:38.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4db2649700 1 --2- 172.21.2.105:0/1853132625 >> v2:172.21.2.115:3300/0 conn(0x7f4dac0b2e20 0x7f4dac0b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:38.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4db2649700 1 -- 172.21.2.105:0/1853132625 >> 172.21.2.105:0/1853132625 conn(0x7f4dac062f60 msgr2=0x7f4dac063370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:38.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4db2649700 1 -- 172.21.2.105:0/1853132625 shutdown_connections 2021-11-12T05:45:38.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4db2649700 1 -- 172.21.2.105:0/1853132625 wait complete. 2021-11-12T05:45:38.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4db2649700 1 Processor -- start 2021-11-12T05:45:38.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4db2649700 1 -- start start 2021-11-12T05:45:38.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4db2649700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4dac05c490 0x7f4dac1382e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:38.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4db2649700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4dac05c900 0x7f4dac15a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:38.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4db2649700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4dac0b2e20 0x7f4dac15a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:38.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4db2649700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac066570 con 0x7f4dac05c900 2021-11-12T05:45:38.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4db2649700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac064680 con 0x7f4dac05c490 2021-11-12T05:45:38.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4db2649700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac064920 con 0x7f4dac0b2e20 2021-11-12T05:45:38.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4dab7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4dac05c900 0x7f4dac15a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:38.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4dab7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4dac05c900 0x7f4dac15a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46400/0 (socket says 172.21.2.105:46400) 2021-11-12T05:45:38.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4dab7fe700 1 -- 172.21.2.105:0/2140041311 learned_addr learned my addr 172.21.2.105:0/2140041311 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:38.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4dab7fe700 1 -- 172.21.2.105:0/2140041311 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4dac0b2e20 msgr2=0x7f4dac15a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:38.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4dab7fe700 1 --2- 172.21.2.105:0/2140041311 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4dac0b2e20 0x7f4dac15a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:38.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4dab7fe700 1 -- 172.21.2.105:0/2140041311 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4dac05c490 msgr2=0x7f4dac1382e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:38.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4dab7fe700 1 --2- 172.21.2.105:0/2140041311 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4dac05c490 0x7f4dac1382e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:38.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4dab7fe700 1 -- 172.21.2.105:0/2140041311 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da000b1e0 con 0x7f4dac05c900 2021-11-12T05:45:38.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4dab7fe700 1 --2- 172.21.2.105:0/2140041311 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4dac05c900 0x7f4dac15a3a0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f4dac0b3520 tx=0x7f4da0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:38.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4da97fa700 1 -- 172.21.2.105:0/2140041311 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4da000de90 con 0x7f4dac05c900 2021-11-12T05:45:38.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4da97fa700 1 -- 172.21.2.105:0/2140041311 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da0002f70 con 0x7f4dac05c900 2021-11-12T05:45:38.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4db2649700 1 -- 172.21.2.105:0/2140041311 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dac064bc0 con 0x7f4dac05c900 2021-11-12T05:45:38.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4da97fa700 1 -- 172.21.2.105:0/2140041311 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4da001e460 con 0x7f4dac05c900 2021-11-12T05:45:38.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.192+0000 7f4db2649700 1 -- 172.21.2.105:0/2140041311 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dac138ce0 con 0x7f4dac05c900 2021-11-12T05:45:38.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.196+0000 7f4db2649700 1 -- 172.21.2.105:0/2140041311 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dac064d80 con 0x7f4dac05c900 2021-11-12T05:45:38.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.196+0000 7f4da97fa700 1 -- 172.21.2.105:0/2140041311 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4da0025030 con 0x7f4dac05c900 2021-11-12T05:45:38.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.196+0000 7f4da97fa700 1 --2- 172.21.2.105:0/2140041311 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4d8c0534f0 0x7f4d8c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:38.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.196+0000 7f4da97fa700 1 -- 172.21.2.105:0/2140041311 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f4da006cb30 con 0x7f4dac05c900 2021-11-12T05:45:38.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.196+0000 7f4dabfff700 1 --2- 172.21.2.105:0/2140041311 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4d8c0534f0 0x7f4d8c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:38.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.196+0000 7f4dabfff700 1 --2- 172.21.2.105:0/2140041311 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4d8c0534f0 0x7f4d8c0559b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f4d9c000ed0 tx=0x7f4d9c006930).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:38.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.196+0000 7f4da97fa700 1 -- 172.21.2.105:0/2140041311 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4da0043da0 con 0x7f4dac05c900 2021-11-12T05:45:38.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.280+0000 7f4db2649700 1 -- 172.21.2.105:0/2140041311 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4dac066740 con 0x7f4dac05c900 2021-11-12T05:45:38.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.288+0000 7f4da97fa700 1 -- 172.21.2.105:0/2140041311 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v8)=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4dac066740 con 0x7f4dac05c900 2021-11-12T05:45:38.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.288+0000 7f4db2649700 1 -- 172.21.2.105:0/2140041311 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4d8c0534f0 msgr2=0x7f4d8c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:38.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.288+0000 7f4db2649700 1 --2- 172.21.2.105:0/2140041311 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4d8c0534f0 0x7f4d8c0559b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f4d9c000ed0 tx=0x7f4d9c006930).stop 2021-11-12T05:45:38.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.288+0000 7f4db2649700 1 -- 172.21.2.105:0/2140041311 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4dac05c900 msgr2=0x7f4dac15a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:38.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.288+0000 7f4db2649700 1 --2- 172.21.2.105:0/2140041311 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4dac05c900 0x7f4dac15a3a0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f4dac0b3520 tx=0x7f4da0015000).stop 2021-11-12T05:45:38.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.288+0000 7f4db2649700 1 -- 172.21.2.105:0/2140041311 shutdown_connections 2021-11-12T05:45:38.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.288+0000 7f4db2649700 1 --2- 172.21.2.105:0/2140041311 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4d8c0534f0 0x7f4d8c0559b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:38.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.288+0000 7f4db2649700 1 --2- 172.21.2.105:0/2140041311 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4dac0b2e20 0x7f4dac15a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:38.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.288+0000 7f4db2649700 1 --2- 172.21.2.105:0/2140041311 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4dac05c900 0x7f4dac15a3a0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:38.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.288+0000 7f4db2649700 1 --2- 172.21.2.105:0/2140041311 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4dac05c490 0x7f4dac1382e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:38.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.288+0000 7f4db2649700 1 -- 172.21.2.105:0/2140041311 >> 172.21.2.105:0/2140041311 conn(0x7f4dac062f60 msgr2=0x7f4dac0a9030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:38.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.288+0000 7f4db2649700 1 -- 172.21.2.105:0/2140041311 shutdown_connections 2021-11-12T05:45:38.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.288+0000 7f4db2649700 1 -- 172.21.2.105:0/2140041311 wait complete. 2021-11-12T05:45:38.299 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-12T05:45:38.300 DEBUG:teuthology.orchestra.run.gibba005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:45:38.307 DEBUG:teuthology.orchestra.run.gibba015:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:45:38.315 DEBUG:teuthology.orchestra.run.gibba016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:45:38.329 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:45:38.342 DEBUG:teuthology.orchestra.run.gibba044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:45:38.355 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-12T05:45:38.356 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:45:38.356 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:45:38.357 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:45:38.374 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:45:38.375 INFO:teuthology.orchestra.run.gibba016.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-12T05:45:38.375 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-11-12T05:45:38.376 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:45:38.376 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:45:38.376 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:45:38.381 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:45:38.382 INFO:teuthology.orchestra.run.gibba038.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-12T05:45:38.382 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-12T05:45:38.383 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:45:38.383 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:45:38.384 DEBUG:teuthology.orchestra.run.gibba044:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:45:38.388 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:45:38.389 INFO:teuthology.orchestra.run.gibba044.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-12T05:45:38.389 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-12T05:45:38.390 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-12T05:45:38.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6ebeab0700 1 Processor -- start 2021-11-12T05:45:38.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6ebeab0700 1 -- start start 2021-11-12T05:45:38.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6ebeab0700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f6eb8144fb0 0x7f6eb813deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:38.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6ebeab0700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb81416e0 con 0x7f6eb80b7b50 2021-11-12T05:45:38.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6ebeab0700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb8142220 con 0x7f6eb80ad270 2021-11-12T05:45:38.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6ebeab0700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb80b7f30 con 0x7f6eb8144fb0 2021-11-12T05:45:38.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6ebc84c700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f6eb80b7b50 0x7f6eb8140fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:56802/0 (socket says 172.21.2.105:56802) 2021-11-12T05:45:38.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6ebc84c700 1 -- 172.21.2.105:0/1516918022 learned_addr learned my addr 172.21.2.105:0/1516918022 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:45:38.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6eb77fe700 1 -- 172.21.2.105:0/1516918022 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2646773938 0 0) 0x7f6eb81416e0 con 0x7f6eb80b7b50 2021-11-12T05:45:38.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6eb77fe700 1 -- 172.21.2.105:0/1516918022 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e98003260 con 0x7f6eb80b7b50 2021-11-12T05:45:38.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6eb77fe700 1 -- 172.21.2.105:0/1516918022 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2518561672 0 0) 0x7f6e98003260 con 0x7f6eb80b7b50 2021-11-12T05:45:38.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6ebd04d700 1 --2- 172.21.2.105:0/1516918022 >> v2:172.21.2.115:3300/0 conn(0x7f6eb8144fb0 0x7f6eb813deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:38.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6eb77fe700 1 -- 172.21.2.105:0/1516918022 >> v2:172.21.2.115:3300/0 conn(0x7f6eb8144fb0 msgr2=0x7f6eb813deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:38.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6eb77fe700 1 --2- 172.21.2.105:0/1516918022 >> v2:172.21.2.115:3300/0 conn(0x7f6eb8144fb0 0x7f6eb813deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:38.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6eb77fe700 1 -- 172.21.2.105:0/1516918022 >> v1:172.21.2.115:6789/0 conn(0x7f6eb80ad270 legacy=0x7f6eb8066f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:38.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6eb77fe700 1 -- 172.21.2.105:0/1516918022 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb80b2fe0 con 0x7f6eb80b7b50 2021-11-12T05:45:38.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6eb77fe700 1 -- 172.21.2.105:0/1516918022 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f6ea8001660 con 0x7f6eb80b7b50 2021-11-12T05:45:38.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6eb77fe700 1 -- 172.21.2.105:0/1516918022 >> v1:172.21.2.105:6789/0 conn(0x7f6eb80b7b50 legacy=0x7f6eb8140fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:38.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6eb77fe700 1 --2- 172.21.2.105:0/1516918022 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6e98003820 0x7f6e98003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:38.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6eb77fe700 1 --2- 172.21.2.105:0/1516918022 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6e98004500 0x7f6e98004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:38.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6eb77fe700 1 --2- 172.21.2.105:0/1516918022 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6e98005050 0x7f6e9800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:38.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6eb77fe700 1 -- 172.21.2.105:0/1516918022 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb80b7f30 con 0x7f6e98005050 2021-11-12T05:45:38.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6eb77fe700 1 -- 172.21.2.105:0/1516918022 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9800bf40 con 0x7f6e98003820 2021-11-12T05:45:38.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6eb77fe700 1 -- 172.21.2.105:0/1516918022 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9800c100 con 0x7f6e98004500 2021-11-12T05:45:38.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6ebd04d700 1 --2- 172.21.2.105:0/1516918022 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6e98005050 0x7f6e9800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:38.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6ebc84c700 1 --2- 172.21.2.105:0/1516918022 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6e98003820 0x7f6e98003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:38.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6ebd04d700 1 -- 172.21.2.105:0/1516918022 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6e98004500 msgr2=0x7f6e98004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:38.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6ebd04d700 1 --2- 172.21.2.105:0/1516918022 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6e98004500 0x7f6e98004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:38.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6ebd04d700 1 -- 172.21.2.105:0/1516918022 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6e98003820 msgr2=0x7f6e98003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:38.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6ebd04d700 1 --2- 172.21.2.105:0/1516918022 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6e98003820 0x7f6e98003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:38.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6ebd04d700 1 -- 172.21.2.105:0/1516918022 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e98003260 con 0x7f6e98005050 2021-11-12T05:45:38.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6ebc84c700 1 --2- 172.21.2.105:0/1516918022 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6e98003820 0x7f6e98003c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:45:38.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6ebd04d700 1 -- 172.21.2.105:0/1516918022 reap_dead start 2021-11-12T05:45:38.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6ebd04d700 1 --2- 172.21.2.105:0/1516918022 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6e98005050 0x7f6e9800b750 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f6eb0007000 tx=0x7f6eb0008040).ready entity=mon.0 client_cookie=d0c79e7c7fd0ec22 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:38.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6eb77fe700 1 -- 172.21.2.105:0/1516918022 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6eb0015070 con 0x7f6e98005050 2021-11-12T05:45:38.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6eb77fe700 1 -- 172.21.2.105:0/1516918022 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb000c640 con 0x7f6e98005050 2021-11-12T05:45:38.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6eb77fe700 1 -- 172.21.2.105:0/1516918022 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6eb000a4a0 con 0x7f6e98005050 2021-11-12T05:45:38.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6ebeab0700 1 -- 172.21.2.105:0/1516918022 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6e98005050 msgr2=0x7f6e9800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:38.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6ebeab0700 1 --2- 172.21.2.105:0/1516918022 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6e98005050 0x7f6e9800b750 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f6eb0007000 tx=0x7f6eb0008040).stop 2021-11-12T05:45:38.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6ebeab0700 1 -- 172.21.2.105:0/1516918022 shutdown_connections 2021-11-12T05:45:38.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6ebeab0700 1 --2- 172.21.2.105:0/1516918022 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6e98005050 0x7f6e9800b750 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:38.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.448+0000 7f6ebeab0700 1 -- 172.21.2.105:0/1516918022 >> 172.21.2.105:0/1516918022 conn(0x7f6eb8060ba0 msgr2=0x7f6eb805c490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:38.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.452+0000 7f6ebeab0700 1 -- 172.21.2.105:0/1516918022 shutdown_connections 2021-11-12T05:45:38.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.452+0000 7f6ebeab0700 1 -- 172.21.2.105:0/1516918022 wait complete. 2021-11-12T05:45:38.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.452+0000 7f6ebeab0700 1 Processor -- start 2021-11-12T05:45:38.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.452+0000 7f6ebeab0700 1 -- start start 2021-11-12T05:45:38.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.452+0000 7f6ebeab0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6e98005050 0x7f6eb8152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:38.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.452+0000 7f6ebeab0700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6eb8062f90 0x7f6eb80b54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:38.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.452+0000 7f6ebeab0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6eb80b59a0 0x7f6eb81135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:38.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.452+0000 7f6ebeab0700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb81523c0 con 0x7f6e98005050 2021-11-12T05:45:38.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.452+0000 7f6ebeab0700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb81525b0 con 0x7f6eb8062f90 2021-11-12T05:45:38.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.452+0000 7f6ebeab0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb8152850 con 0x7f6eb80b59a0 2021-11-12T05:45:38.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.452+0000 7f6ebc84c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6e98005050 0x7f6eb8152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:38.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.452+0000 7f6ebc84c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6e98005050 0x7f6eb8152f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46420/0 (socket says 172.21.2.105:46420) 2021-11-12T05:45:38.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.452+0000 7f6ebc84c700 1 -- 172.21.2.105:0/2318720115 learned_addr learned my addr 172.21.2.105:0/2318720115 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:38.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.452+0000 7f6ebc84c700 1 -- 172.21.2.105:0/2318720115 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6eb80b59a0 msgr2=0x7f6eb81135b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:45:38.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.452+0000 7f6ebc84c700 1 --2- 172.21.2.105:0/2318720115 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6eb80b59a0 0x7f6eb81135b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:38.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.452+0000 7f6ebc84c700 1 -- 172.21.2.105:0/2318720115 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6eb8062f90 msgr2=0x7f6eb80b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:38.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.452+0000 7f6ebc84c700 1 --2- 172.21.2.105:0/2318720115 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6eb8062f90 0x7f6eb80b54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:38.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.452+0000 7f6ebc84c700 1 -- 172.21.2.105:0/2318720115 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb8152af0 con 0x7f6e98005050 2021-11-12T05:45:38.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.452+0000 7f6ebc84c700 1 --2- 172.21.2.105:0/2318720115 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6e98005050 0x7f6eb8152f90 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f6ea8008000 tx=0x7f6ea8009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:38.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.452+0000 7f6eb5ffb700 1 -- 172.21.2.105:0/2318720115 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ea8007170 con 0x7f6e98005050 2021-11-12T05:45:38.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.452+0000 7f6eb5ffb700 1 -- 172.21.2.105:0/2318720115 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea80072d0 con 0x7f6e98005050 2021-11-12T05:45:38.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.452+0000 7f6ebeab0700 1 -- 172.21.2.105:0/2318720115 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb8113aa0 con 0x7f6e98005050 2021-11-12T05:45:38.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.452+0000 7f6ebeab0700 1 -- 172.21.2.105:0/2318720115 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb8113070 con 0x7f6e98005050 2021-11-12T05:45:38.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.452+0000 7f6eb5ffb700 1 -- 172.21.2.105:0/2318720115 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ea8004920 con 0x7f6e98005050 2021-11-12T05:45:38.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.452+0000 7f6ebeab0700 1 -- 172.21.2.105:0/2318720115 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb80b3280 con 0x7f6e98005050 2021-11-12T05:45:38.474 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.452+0000 7f6eb5ffb700 1 -- 172.21.2.105:0/2318720115 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6ea8004a80 con 0x7f6e98005050 2021-11-12T05:45:38.474 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.452+0000 7f6eb5ffb700 1 --2- 172.21.2.105:0/2318720115 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6e9c053540 0x7f6e9c055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:38.474 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.452+0000 7f6eb5ffb700 1 -- 172.21.2.105:0/2318720115 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f6ea806b850 con 0x7f6e98005050 2021-11-12T05:45:38.474 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.452+0000 7f6eb7fff700 1 --2- 172.21.2.105:0/2318720115 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6e9c053540 0x7f6e9c055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:38.475 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.452+0000 7f6eb7fff700 1 --2- 172.21.2.105:0/2318720115 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6e9c053540 0x7f6e9c055a00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f6ea0001fa0 tx=0x7f6ea00077f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:38.475 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.456+0000 7f6eb5ffb700 1 -- 172.21.2.105:0/2318720115 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6ea8042a20 con 0x7f6e98005050 2021-11-12T05:45:38.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.540+0000 7f6ebeab0700 1 -- 172.21.2.105:0/2318720115 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f6eb8057350 con 0x7f6e98005050 2021-11-12T05:45:38.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.540+0000 7f6eb5ffb700 1 -- 172.21.2.105:0/2318720115 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v58) v1 ==== 81+0+29218 (secure 0 0 0) 0x7f6ea8046040 con 0x7f6e98005050 2021-11-12T05:45:38.544 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:45:38.545 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:45:38.545 INFO:teuthology.orchestra.run.gibba005.stdout: "epoch": 58, 2021-11-12T05:45:38.545 INFO:teuthology.orchestra.run.gibba005.stdout: "fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", 2021-11-12T05:45:38.545 INFO:teuthology.orchestra.run.gibba005.stdout: "created": "2021-11-12T05:40:19.986390+0000", 2021-11-12T05:45:38.546 INFO:teuthology.orchestra.run.gibba005.stdout: "modified": "2021-11-12T05:45:36.112303+0000", 2021-11-12T05:45:38.546 INFO:teuthology.orchestra.run.gibba005.stdout: "last_up_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:45:38.546 INFO:teuthology.orchestra.run.gibba005.stdout: "last_in_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:45:38.546 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-12T05:45:38.547 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_num": 5799936, 2021-11-12T05:45:38.547 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_set": [ 2021-11-12T05:45:38.547 INFO:teuthology.orchestra.run.gibba005.stdout: "pglog_hardlimit", 2021-11-12T05:45:38.547 INFO:teuthology.orchestra.run.gibba005.stdout: "purged_snapdirs", 2021-11-12T05:45:38.547 INFO:teuthology.orchestra.run.gibba005.stdout: "recovery_deletes", 2021-11-12T05:45:38.548 INFO:teuthology.orchestra.run.gibba005.stdout: "sortbitwise" 2021-11-12T05:45:38.548 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:45:38.548 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_version": 5, 2021-11-12T05:45:38.549 INFO:teuthology.orchestra.run.gibba005.stdout: "full_ratio": 0.94999998807907104, 2021-11-12T05:45:38.549 INFO:teuthology.orchestra.run.gibba005.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-12T05:45:38.549 INFO:teuthology.orchestra.run.gibba005.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-12T05:45:38.549 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_snapshot": "", 2021-11-12T05:45:38.550 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_max": 10, 2021-11-12T05:45:38.550 INFO:teuthology.orchestra.run.gibba005.stdout: "max_osd": 8, 2021-11-12T05:45:38.550 INFO:teuthology.orchestra.run.gibba005.stdout: "require_min_compat_client": "jewel", 2021-11-12T05:45:38.550 INFO:teuthology.orchestra.run.gibba005.stdout: "min_compat_client": "jewel", 2021-11-12T05:45:38.550 INFO:teuthology.orchestra.run.gibba005.stdout: "require_osd_release": "octopus", 2021-11-12T05:45:38.551 INFO:teuthology.orchestra.run.gibba005.stdout: "pools": [ 2021-11-12T05:45:38.551 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.551 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 1, 2021-11-12T05:45:38.551 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "device_health_metrics", 2021-11-12T05:45:38.552 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:22.022116+0000", 2021-11-12T05:45:38.552 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:45:38.552 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:45:38.552 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:45:38.552 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:45:38.553 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:45:38.553 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:45:38.553 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:45:38.553 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:45:38.554 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 1, 2021-11-12T05:45:38.554 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 1, 2021-11-12T05:45:38.554 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 1, 2021-11-12T05:45:38.554 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 1, 2021-11-12T05:45:38.554 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 1, 2021-11-12T05:45:38.555 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:45:38.555 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:45:38.555 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:45:38.555 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:45:38.556 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:45:38.556 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:45:38.556 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:45:38.556 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.556 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "16", 2021-11-12T05:45:38.557 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:45:38.557 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:45:38.557 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:45:38.557 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:45:38.558 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:45:38.558 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:45:38.558 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:45:38.558 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:45:38.559 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:45:38.559 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:45:38.559 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:45:38.559 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:45:38.559 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:45:38.560 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:45:38.560 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:45:38.560 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:45:38.560 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:45:38.561 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:45:38.561 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:45:38.561 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:45:38.561 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:45:38.562 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:45:38.562 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:45:38.562 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:45:38.562 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:45:38.562 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:45:38.563 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.563 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:45:38.563 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:45:38.563 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:45:38.564 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:45:38.564 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:45:38.564 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:45:38.564 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:45:38.564 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:45:38.565 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:45:38.565 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:45:38.565 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:45:38.565 INFO:teuthology.orchestra.run.gibba005.stdout: "options": { 2021-11-12T05:45:38.566 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_min": 1 2021-11-12T05:45:38.566 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.566 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:45:38.566 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr_devicehealth": {} 2021-11-12T05:45:38.567 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:38.567 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.567 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.567 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 2, 2021-11-12T05:45:38.567 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "rbd", 2021-11-12T05:45:38.568 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:29.953617+0000", 2021-11-12T05:45:38.568 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:45:38.568 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:45:38.568 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:45:38.568 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:45:38.569 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:45:38.569 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:45:38.569 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:45:38.569 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:45:38.570 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:45:38.570 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:45:38.570 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:45:38.570 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:45:38.570 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:45:38.571 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:45:38.571 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:45:38.571 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:45:38.571 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:45:38.572 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:45:38.572 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:45:38.572 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:45:38.572 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.572 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "19", 2021-11-12T05:45:38.573 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:45:38.573 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:45:38.573 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:45:38.573 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:45:38.573 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:45:38.574 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:45:38.574 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:45:38.574 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:45:38.574 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:45:38.575 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:45:38.575 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:45:38.575 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:45:38.575 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:45:38.575 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:45:38.576 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:45:38.576 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:45:38.576 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:45:38.576 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:45:38.577 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:45:38.577 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:45:38.577 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:45:38.577 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:45:38.577 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:45:38.578 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:45:38.578 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:45:38.578 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:45:38.578 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.579 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:45:38.579 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:45:38.579 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:45:38.579 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:45:38.579 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:45:38.580 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:45:38.580 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:45:38.580 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:45:38.580 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:45:38.581 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:45:38.581 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:45:38.581 INFO:teuthology.orchestra.run.gibba005.stdout: "options": {}, 2021-11-12T05:45:38.581 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:45:38.581 INFO:teuthology.orchestra.run.gibba005.stdout: "rbd": {} 2021-11-12T05:45:38.582 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:38.582 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:38.582 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:45:38.582 INFO:teuthology.orchestra.run.gibba005.stdout: "osds": [ 2021-11-12T05:45:38.583 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.583 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:45:38.583 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "ee8e30a0-4819-4475-80ec-dd3ee7d01322", 2021-11-12T05:45:38.583 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:45:38.584 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:45:38.584 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:45:38.584 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:45:38.584 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:45:38.584 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:45:38.585 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:45:38.585 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 53, 2021-11-12T05:45:38.585 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:45:38.585 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:45:38.586 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:45:38.586 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:38.586 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.586 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:38.587 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6802", 2021-11-12T05:45:38.587 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:45:38.587 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.587 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.588 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:38.588 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6803", 2021-11-12T05:45:38.588 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:45:38.588 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:38.588 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.589 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.589 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:45:38.589 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:38.590 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.590 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:38.590 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6804", 2021-11-12T05:45:38.590 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:45:38.591 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.591 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.591 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:38.591 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6805", 2021-11-12T05:45:38.591 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:45:38.592 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:38.592 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.592 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.592 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:45:38.593 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:38.593 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.593 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:38.593 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6808", 2021-11-12T05:45:38.594 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:45:38.594 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.594 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.594 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:38.594 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6809", 2021-11-12T05:45:38.595 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:45:38.595 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:38.595 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.595 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.596 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:45:38.596 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:38.596 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.596 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:38.596 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6806", 2021-11-12T05:45:38.597 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:45:38.597 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.597 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.597 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:38.598 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6807", 2021-11-12T05:45:38.598 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:45:38.598 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:38.598 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.598 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.599 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6803/14874", 2021-11-12T05:45:38.599 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6805/14874", 2021-11-12T05:45:38.599 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6809/14874", 2021-11-12T05:45:38.599 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6807/14874", 2021-11-12T05:45:38.600 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:45:38.600 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:45:38.600 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:45:38.600 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.600 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.601 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.601 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:45:38.601 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "b1bb06c3-26d0-4d92-82f8-b3e882242785", 2021-11-12T05:45:38.601 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:45:38.602 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:45:38.602 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:45:38.602 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:45:38.602 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:45:38.603 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:45:38.603 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:45:38.603 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 53, 2021-11-12T05:45:38.603 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:45:38.604 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:45:38.604 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:45:38.604 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:38.604 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.605 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:38.605 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6810", 2021-11-12T05:45:38.605 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:45:38.605 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.606 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.606 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:38.606 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6811", 2021-11-12T05:45:38.606 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:45:38.606 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:38.607 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.607 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.607 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:45:38.607 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:38.608 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.608 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:38.608 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6812", 2021-11-12T05:45:38.609 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:45:38.609 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.609 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.609 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:38.609 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6813", 2021-11-12T05:45:38.610 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:45:38.610 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:38.610 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.610 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.611 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:45:38.611 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:38.611 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.611 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:38.612 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6816", 2021-11-12T05:45:38.612 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:45:38.612 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.612 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.612 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:38.613 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6817", 2021-11-12T05:45:38.613 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:45:38.613 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:38.613 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.614 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.614 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:45:38.614 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:38.614 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.615 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:38.615 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6814", 2021-11-12T05:45:38.615 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:45:38.615 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.615 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.616 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:38.616 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6815", 2021-11-12T05:45:38.616 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:45:38.616 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:38.617 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.617 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.617 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6811/14875", 2021-11-12T05:45:38.617 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6813/14875", 2021-11-12T05:45:38.617 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6817/14875", 2021-11-12T05:45:38.618 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6815/14875", 2021-11-12T05:45:38.618 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:45:38.618 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:45:38.618 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:45:38.619 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.619 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.619 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.619 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:45:38.619 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "837b2c60-c335-4382-9f47-d86543a14022", 2021-11-12T05:45:38.620 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:45:38.620 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:45:38.620 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:45:38.620 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:45:38.621 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:45:38.621 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:45:38.621 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:45:38.621 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 53, 2021-11-12T05:45:38.621 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:45:38.622 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:45:38.622 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:45:38.622 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:38.622 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.623 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:38.623 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6818", 2021-11-12T05:45:38.623 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:45:38.623 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.623 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.624 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:38.624 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6819", 2021-11-12T05:45:38.624 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:45:38.624 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:38.625 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.625 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.625 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:45:38.625 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:38.625 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.626 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:38.626 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6820", 2021-11-12T05:45:38.626 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:45:38.626 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.627 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.627 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:38.627 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6821", 2021-11-12T05:45:38.627 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:45:38.627 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:38.628 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.628 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.628 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:45:38.628 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:38.628 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.629 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:38.629 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6824", 2021-11-12T05:45:38.629 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:45:38.629 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.630 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.630 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:38.630 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6825", 2021-11-12T05:45:38.630 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:45:38.631 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:38.631 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.631 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.631 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:45:38.631 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:38.632 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.632 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:38.632 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6822", 2021-11-12T05:45:38.632 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:45:38.632 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.633 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.633 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:38.633 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6823", 2021-11-12T05:45:38.633 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:45:38.634 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:38.634 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.634 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.634 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6819/14905", 2021-11-12T05:45:38.635 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6821/14905", 2021-11-12T05:45:38.635 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6825/14905", 2021-11-12T05:45:38.635 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6823/14905", 2021-11-12T05:45:38.635 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:45:38.635 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:45:38.636 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:45:38.636 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.636 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.636 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.637 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:45:38.637 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "eb2b737b-dda6-444b-a306-f33cbbd51f70", 2021-11-12T05:45:38.637 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:45:38.637 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:45:38.637 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:45:38.638 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:45:38.638 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:45:38.638 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:45:38.638 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:45:38.639 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 52, 2021-11-12T05:45:38.639 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:45:38.639 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:45:38.639 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:45:38.639 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:38.640 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.640 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:38.640 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6826", 2021-11-12T05:45:38.640 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:45:38.641 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.641 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.641 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:38.641 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6827", 2021-11-12T05:45:38.641 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:45:38.642 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:38.642 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.642 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.642 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:45:38.643 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:38.643 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.643 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:38.643 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6828", 2021-11-12T05:45:38.643 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:45:38.644 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.644 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.644 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:38.644 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6829", 2021-11-12T05:45:38.644 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:45:38.645 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:38.645 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.645 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.645 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:45:38.646 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:38.646 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.646 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:38.646 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6832", 2021-11-12T05:45:38.647 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:45:38.647 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.647 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.647 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:38.648 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6833", 2021-11-12T05:45:38.648 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:45:38.648 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:38.648 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.648 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.649 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:45:38.649 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:38.649 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.649 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:38.650 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6830", 2021-11-12T05:45:38.650 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:45:38.650 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.650 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.651 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:38.651 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6831", 2021-11-12T05:45:38.651 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:45:38.651 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:38.651 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.652 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.652 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6827/14876", 2021-11-12T05:45:38.652 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6829/14876", 2021-11-12T05:45:38.652 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6833/14876", 2021-11-12T05:45:38.652 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6831/14876", 2021-11-12T05:45:38.653 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:45:38.653 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:45:38.653 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:45:38.653 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.654 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.654 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.654 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:45:38.654 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "721529a1-c047-486a-a7ca-ddc15d80cdde", 2021-11-12T05:45:38.654 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:45:38.655 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:45:38.655 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:45:38.655 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:45:38.655 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:45:38.656 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:45:38.656 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:45:38.656 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 53, 2021-11-12T05:45:38.656 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:45:38.657 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:45:38.657 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:45:38.657 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:38.657 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.657 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:38.658 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6800", 2021-11-12T05:45:38.658 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:45:38.658 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.658 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.658 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:38.659 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6801", 2021-11-12T05:45:38.659 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:45:38.659 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:38.659 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.660 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.660 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:45:38.660 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:38.660 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.660 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:38.661 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6802", 2021-11-12T05:45:38.661 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:45:38.661 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.661 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.662 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:38.662 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6803", 2021-11-12T05:45:38.662 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:45:38.662 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:38.662 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.663 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.663 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:45:38.663 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:38.663 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.663 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:38.664 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6806", 2021-11-12T05:45:38.664 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:45:38.664 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.664 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.665 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:38.665 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6807", 2021-11-12T05:45:38.665 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:45:38.665 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:38.665 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.666 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.666 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:45:38.666 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:38.666 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.667 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:38.667 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6804", 2021-11-12T05:45:38.667 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:45:38.667 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.667 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.668 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:38.668 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6805", 2021-11-12T05:45:38.668 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:45:38.668 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:38.669 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.669 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.669 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6801/15096", 2021-11-12T05:45:38.669 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6803/15096", 2021-11-12T05:45:38.669 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6807/15096", 2021-11-12T05:45:38.670 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6805/15096", 2021-11-12T05:45:38.670 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:45:38.670 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:45:38.670 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:45:38.671 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.671 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.671 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.671 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:45:38.671 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "68b72ab2-fa82-4b5c-bf33-528f002e4950", 2021-11-12T05:45:38.672 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:45:38.672 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:45:38.672 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:45:38.672 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:45:38.672 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:45:38.673 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:45:38.673 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:45:38.673 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 53, 2021-11-12T05:45:38.673 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:45:38.674 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:45:38.674 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:45:38.674 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:38.674 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.674 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:38.675 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6808", 2021-11-12T05:45:38.675 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:45:38.675 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.675 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.675 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:38.676 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6809", 2021-11-12T05:45:38.676 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:45:38.676 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:38.676 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.677 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.677 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:45:38.677 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:38.677 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.677 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:38.678 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6810", 2021-11-12T05:45:38.678 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:45:38.678 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.678 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.678 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:38.679 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6811", 2021-11-12T05:45:38.679 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:45:38.679 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:38.679 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.680 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.680 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:45:38.680 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:38.680 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.680 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:38.681 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6814", 2021-11-12T05:45:38.681 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:45:38.681 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.681 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.681 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:38.682 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6815", 2021-11-12T05:45:38.682 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:45:38.682 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:38.682 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.683 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.683 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:45:38.683 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:38.683 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.683 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:38.684 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6812", 2021-11-12T05:45:38.684 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:45:38.684 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.684 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.685 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:38.685 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6813", 2021-11-12T05:45:38.685 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:45:38.685 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:38.685 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.686 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.686 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6809/15097", 2021-11-12T05:45:38.686 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6811/15097", 2021-11-12T05:45:38.686 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6815/15097", 2021-11-12T05:45:38.686 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6813/15097", 2021-11-12T05:45:38.687 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:45:38.687 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:45:38.687 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:45:38.687 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.688 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.688 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.688 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:45:38.688 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "a2c83b5d-8d37-4d30-ac04-30d89a76e485", 2021-11-12T05:45:38.688 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:45:38.689 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:45:38.689 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:45:38.689 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:45:38.689 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:45:38.690 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:45:38.690 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:45:38.690 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 53, 2021-11-12T05:45:38.690 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:45:38.690 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:45:38.691 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:45:38.691 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:38.691 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.691 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:38.692 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6816", 2021-11-12T05:45:38.692 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:45:38.692 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.692 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.692 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:38.693 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6817", 2021-11-12T05:45:38.693 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:45:38.693 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:38.693 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.693 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.694 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:45:38.694 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:38.694 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.694 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:38.695 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6818", 2021-11-12T05:45:38.695 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:45:38.695 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.695 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.695 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:38.696 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6819", 2021-11-12T05:45:38.696 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:45:38.696 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:38.696 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.696 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.697 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:45:38.697 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:38.697 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.697 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:38.698 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6822", 2021-11-12T05:45:38.698 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:45:38.698 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.698 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.698 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:38.699 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6823", 2021-11-12T05:45:38.699 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:45:38.699 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:38.699 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.699 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.700 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:45:38.700 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:38.700 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.700 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:38.701 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6820", 2021-11-12T05:45:38.701 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:45:38.701 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.701 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.702 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:38.702 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6821", 2021-11-12T05:45:38.702 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:45:38.702 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:38.702 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.703 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.703 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6817/15098", 2021-11-12T05:45:38.703 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6819/15098", 2021-11-12T05:45:38.703 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6823/15098", 2021-11-12T05:45:38.704 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6821/15098", 2021-11-12T05:45:38.704 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:45:38.704 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:45:38.704 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:45:38.704 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.705 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.705 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.705 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:45:38.705 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "786ce966-d0fb-4181-aed4-c26e3ef61c43", 2021-11-12T05:45:38.706 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:45:38.706 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:45:38.706 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:45:38.706 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:45:38.707 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:45:38.707 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:45:38.707 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:45:38.707 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 52, 2021-11-12T05:45:38.707 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:45:38.708 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:45:38.708 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:45:38.708 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:38.708 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.709 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:38.709 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6824", 2021-11-12T05:45:38.709 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:45:38.709 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.709 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.710 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:38.710 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6825", 2021-11-12T05:45:38.710 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:45:38.710 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:38.711 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.711 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.711 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:45:38.711 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:38.711 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.712 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:38.712 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6826", 2021-11-12T05:45:38.712 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:45:38.712 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.712 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.713 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:38.713 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6827", 2021-11-12T05:45:38.713 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:45:38.713 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:38.713 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.714 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.714 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:45:38.714 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:38.714 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.715 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:38.715 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6830", 2021-11-12T05:45:38.715 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:45:38.715 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.715 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.716 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:38.716 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6831", 2021-11-12T05:45:38.716 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:45:38.716 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:38.717 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.717 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.717 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:45:38.717 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:45:38.717 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.718 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:45:38.718 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6828", 2021-11-12T05:45:38.718 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:45:38.718 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.719 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.719 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:45:38.719 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6829", 2021-11-12T05:45:38.719 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:45:38.719 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:38.720 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.720 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.720 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6825/15099", 2021-11-12T05:45:38.720 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6827/15099", 2021-11-12T05:45:38.720 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6831/15099", 2021-11-12T05:45:38.721 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6829/15099", 2021-11-12T05:45:38.721 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:45:38.721 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:45:38.721 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:45:38.722 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:38.722 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:38.722 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:45:38.722 INFO:teuthology.orchestra.run.gibba005.stdout: "osd_xinfo": [ 2021-11-12T05:45:38.723 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.723 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:45:38.723 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:45:38.723 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:45:38.723 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:45:38.724 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:45:38.724 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:45:38.724 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.615112+0000", 2021-11-12T05:45:38.724 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:45:38.724 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.725 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.725 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:45:38.725 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:45:38.725 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:45:38.726 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:45:38.726 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:45:38.726 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:45:38.726 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.665935+0000", 2021-11-12T05:45:38.726 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:45:38.727 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.727 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.727 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:45:38.727 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:45:38.728 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:45:38.728 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:45:38.728 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:45:38.728 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:45:38.728 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.715877+0000", 2021-11-12T05:45:38.729 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:45:38.729 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.729 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.729 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:45:38.729 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:45:38.730 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:45:38.730 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:45:38.730 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:45:38.730 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:45:38.731 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.489234+0000", 2021-11-12T05:45:38.731 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:45:38.731 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.731 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.732 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:45:38.732 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:45:38.732 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:45:38.732 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:45:38.732 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:45:38.733 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:45:38.733 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.413776+0000", 2021-11-12T05:45:38.733 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:45:38.733 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.734 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.734 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:45:38.734 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:45:38.734 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:45:38.735 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:45:38.735 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:45:38.735 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:45:38.735 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.507960+0000", 2021-11-12T05:45:38.736 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:45:38.736 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.736 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.736 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:45:38.736 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:45:38.737 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:45:38.737 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:45:38.737 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:45:38.737 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:45:38.738 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.635696+0000", 2021-11-12T05:45:38.738 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:45:38.738 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.738 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:38.738 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:45:38.739 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:45:38.739 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:45:38.739 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:45:38.739 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:45:38.740 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:45:38.740 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.746949+0000", 2021-11-12T05:45:38.740 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:45:38.740 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:38.740 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:45:38.741 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap": [], 2021-11-12T05:45:38.741 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap_items": [], 2021-11-12T05:45:38.741 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_temp": [], 2021-11-12T05:45:38.741 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_temp": [], 2021-11-12T05:45:38.741 INFO:teuthology.orchestra.run.gibba005.stdout: "blacklist": { 2021-11-12T05:45:38.742 INFO:teuthology.orchestra.run.gibba005.stdout: "172.21.2.105:6835/351884283": "2021-11-13T05:45:32.199666+0000", 2021-11-12T05:45:38.742 INFO:teuthology.orchestra.run.gibba005.stdout: "172.21.2.105:6834/351884283": "2021-11-13T05:45:32.199666+0000" 2021-11-12T05:45:38.742 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.742 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profiles": { 2021-11-12T05:45:38.743 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs_data": { 2021-11-12T05:45:38.743 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-device-class": "", 2021-11-12T05:45:38.743 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:45:38.743 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-root": "default", 2021-11-12T05:45:38.744 INFO:teuthology.orchestra.run.gibba005.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-12T05:45:38.744 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:45:38.744 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "2", 2021-11-12T05:45:38.744 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:45:38.744 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:45:38.745 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van", 2021-11-12T05:45:38.745 INFO:teuthology.orchestra.run.gibba005.stdout: "w": "8" 2021-11-12T05:45:38.745 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.745 INFO:teuthology.orchestra.run.gibba005.stdout: "default": { 2021-11-12T05:45:38.745 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:45:38.746 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:45:38.746 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "1", 2021-11-12T05:45:38.746 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:45:38.746 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:45:38.747 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van" 2021-11-12T05:45:38.747 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:38.747 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:38.747 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps_queue": [], 2021-11-12T05:45:38.747 INFO:teuthology.orchestra.run.gibba005.stdout: "new_removed_snaps": [], 2021-11-12T05:45:38.748 INFO:teuthology.orchestra.run.gibba005.stdout: "new_purged_snaps": [], 2021-11-12T05:45:38.748 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_node_flags": {}, 2021-11-12T05:45:38.748 INFO:teuthology.orchestra.run.gibba005.stdout: "device_class_flags": {} 2021-11-12T05:45:38.748 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:45:38.750 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.540+0000 7f6ebeab0700 1 -- 172.21.2.105:0/2318720115 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6e9c053540 msgr2=0x7f6e9c055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:38.750 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.540+0000 7f6ebeab0700 1 --2- 172.21.2.105:0/2318720115 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6e9c053540 0x7f6e9c055a00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f6ea0001fa0 tx=0x7f6ea00077f0).stop 2021-11-12T05:45:38.750 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.540+0000 7f6ebeab0700 1 -- 172.21.2.105:0/2318720115 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6e98005050 msgr2=0x7f6eb8152f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:38.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.540+0000 7f6ebeab0700 1 --2- 172.21.2.105:0/2318720115 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6e98005050 0x7f6eb8152f90 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f6ea8008000 tx=0x7f6ea8009040).stop 2021-11-12T05:45:38.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.540+0000 7f6ebeab0700 1 -- 172.21.2.105:0/2318720115 shutdown_connections 2021-11-12T05:45:38.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.540+0000 7f6ebeab0700 1 --2- 172.21.2.105:0/2318720115 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6e9c053540 0x7f6e9c055a00 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:38.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.540+0000 7f6ebeab0700 1 --2- 172.21.2.105:0/2318720115 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6eb80b59a0 0x7f6eb81135b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:38.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.540+0000 7f6ebeab0700 1 --2- 172.21.2.105:0/2318720115 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6eb8062f90 0x7f6eb80b54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:38.752 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.540+0000 7f6ebeab0700 1 --2- 172.21.2.105:0/2318720115 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6e98005050 0x7f6eb8152f90 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:38.752 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.540+0000 7f6ebeab0700 1 -- 172.21.2.105:0/2318720115 >> 172.21.2.105:0/2318720115 conn(0x7f6eb8060ba0 msgr2=0x7f6eb813c220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:38.752 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.540+0000 7f6ebeab0700 1 -- 172.21.2.105:0/2318720115 shutdown_connections 2021-11-12T05:45:38.752 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.540+0000 7f6ebeab0700 1 -- 172.21.2.105:0/2318720115 wait complete. 2021-11-12T05:45:38.753 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:45:38.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.804+0000 7fe610cd2700 1 Processor -- start 2021-11-12T05:45:38.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.804+0000 7fe610cd2700 1 -- start start 2021-11-12T05:45:38.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.804+0000 7fe610cd2700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe60c0b5ac0 0x7fe60c0af100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:38.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.804+0000 7fe610cd2700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fe60c0afd00 0x7fe60c1456c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:38.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.804+0000 7fe610cd2700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe60c0b5ea0 con 0x7fe60c0b01b0 2021-11-12T05:45:38.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.804+0000 7fe610cd2700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe60c0b17d0 con 0x7fe60c0afd00 2021-11-12T05:45:38.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.804+0000 7fe610cd2700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe60c0aeda0 con 0x7fe60c0b5ac0 2021-11-12T05:45:38.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.804+0000 7fe609d9b700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fe60c0b01b0 0x7fe60c0af5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:56822/0 (socket says 172.21.2.105:56822) 2021-11-12T05:45:38.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.804+0000 7fe609d9b700 1 -- 172.21.2.105:0/1215636040 learned_addr learned my addr 172.21.2.105:0/1215636040 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:45:38.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.804+0000 7fe60959a700 1 -- 172.21.2.105:0/1215636040 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2967050574 0 0) 0x7fe60c0b5ea0 con 0x7fe60c0b01b0 2021-11-12T05:45:38.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.804+0000 7fe60959a700 1 -- 172.21.2.105:0/1215636040 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5ec003260 con 0x7fe60c0b01b0 2021-11-12T05:45:38.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.804+0000 7fe60a59c700 1 --2- 172.21.2.105:0/1215636040 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe60c0b5ac0 0x7fe60c0af100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:38.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.804+0000 7fe60ad9d700 1 --2- 172.21.2.105:0/1215636040 >> v2:172.21.2.115:3300/0 conn(0x7fe60c0afd00 0x7fe60c1456c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:38.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.804+0000 7fe60959a700 1 -- 172.21.2.105:0/1215636040 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4188452307 0 0) 0x7fe5ec003260 con 0x7fe60c0b01b0 2021-11-12T05:45:38.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.804+0000 7fe60959a700 1 -- 172.21.2.105:0/1215636040 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe60c0b5ac0 msgr2=0x7fe60c0af100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:38.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.804+0000 7fe60959a700 1 --2- 172.21.2.105:0/1215636040 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe60c0b5ac0 0x7fe60c0af100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:38.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.804+0000 7fe60959a700 1 -- 172.21.2.105:0/1215636040 >> v2:172.21.2.115:3300/0 conn(0x7fe60c0afd00 msgr2=0x7fe60c1456c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:38.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.804+0000 7fe60959a700 1 --2- 172.21.2.105:0/1215636040 >> v2:172.21.2.115:3300/0 conn(0x7fe60c0afd00 0x7fe60c1456c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:38.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.804+0000 7fe60959a700 1 -- 172.21.2.105:0/1215636040 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe60c0b6310 con 0x7fe60c0b01b0 2021-11-12T05:45:38.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.804+0000 7fe60959a700 1 -- 172.21.2.105:0/1215636040 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fe5f4001660 con 0x7fe60c0b01b0 2021-11-12T05:45:38.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.804+0000 7fe60ad9d700 1 --2- 172.21.2.105:0/1215636040 >> v2:172.21.2.115:3300/0 conn(0x7fe60c0afd00 0x7fe60c1456c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:45:38.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.804+0000 7fe60959a700 1 -- 172.21.2.105:0/1215636040 >> v1:172.21.2.105:6789/0 conn(0x7fe60c0b01b0 legacy=0x7fe60c0af5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:38.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.804+0000 7fe60959a700 1 --2- 172.21.2.105:0/1215636040 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe5ec0037d0 0x7fe5ec003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:38.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.804+0000 7fe60959a700 1 --2- 172.21.2.105:0/1215636040 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe5ec004500 0x7fe5ec004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:38.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.804+0000 7fe60959a700 1 --2- 172.21.2.105:0/1215636040 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe60c0b5ac0 0x7fe5ec00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:38.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.804+0000 7fe60959a700 1 -- 172.21.2.105:0/1215636040 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60c0b17d0 con 0x7fe5ec0037d0 2021-11-12T05:45:38.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.804+0000 7fe60959a700 1 -- 172.21.2.105:0/1215636040 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60c0aeda0 con 0x7fe5ec004500 2021-11-12T05:45:38.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.804+0000 7fe60959a700 1 -- 172.21.2.105:0/1215636040 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec005330 con 0x7fe60c0b5ac0 2021-11-12T05:45:38.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.804+0000 7fe60a59c700 1 --2- 172.21.2.105:0/1215636040 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe5ec0037d0 0x7fe5ec003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:38.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.804+0000 7fe60a59c700 1 -- 172.21.2.105:0/1215636040 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe60c0b5ac0 msgr2=0x7fe5ec00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:38.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.804+0000 7fe60a59c700 1 --2- 172.21.2.105:0/1215636040 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe60c0b5ac0 0x7fe5ec00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:38.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.804+0000 7fe60a59c700 1 -- 172.21.2.105:0/1215636040 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe5ec004500 msgr2=0x7fe5ec004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:38.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.804+0000 7fe60a59c700 1 --2- 172.21.2.105:0/1215636040 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe5ec004500 0x7fe5ec004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:38.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.804+0000 7fe60a59c700 1 -- 172.21.2.105:0/1215636040 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe60c0b6310 con 0x7fe5ec0037d0 2021-11-12T05:45:38.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.808+0000 7fe60a59c700 1 --2- 172.21.2.105:0/1215636040 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe5ec0037d0 0x7fe5ec003bf0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7fe5fc007000 tx=0x7fe5fc008040).ready entity=mon.0 client_cookie=728fb1712557db6b server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:38.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.808+0000 7fe60959a700 1 -- 172.21.2.105:0/1215636040 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5fc012470 con 0x7fe5ec0037d0 2021-11-12T05:45:38.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.808+0000 7fe60959a700 1 -- 172.21.2.105:0/1215636040 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5fc00c030 con 0x7fe5ec0037d0 2021-11-12T05:45:38.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.808+0000 7fe60959a700 1 -- 172.21.2.105:0/1215636040 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5fc0127c0 con 0x7fe5ec0037d0 2021-11-12T05:45:38.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.808+0000 7fe610cd2700 1 -- 172.21.2.105:0/1215636040 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe5ec0037d0 msgr2=0x7fe5ec003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:38.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.808+0000 7fe610cd2700 1 --2- 172.21.2.105:0/1215636040 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe5ec0037d0 0x7fe5ec003bf0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7fe5fc007000 tx=0x7fe5fc008040).stop 2021-11-12T05:45:38.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.808+0000 7fe60ad9d700 1 -- 172.21.2.105:0/1215636040 reap_dead start 2021-11-12T05:45:38.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.808+0000 7fe610cd2700 1 -- 172.21.2.105:0/1215636040 shutdown_connections 2021-11-12T05:45:38.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.808+0000 7fe610cd2700 1 -- 172.21.2.105:0/1215636040 >> 172.21.2.105:0/1215636040 conn(0x7fe60c0628b0 msgr2=0x7fe60c062c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:38.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.808+0000 7fe610cd2700 1 -- 172.21.2.105:0/1215636040 shutdown_connections 2021-11-12T05:45:38.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.808+0000 7fe610cd2700 1 -- 172.21.2.105:0/1215636040 wait complete. 2021-11-12T05:45:38.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.808+0000 7fe610cd2700 1 Processor -- start 2021-11-12T05:45:38.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.808+0000 7fe610cd2700 1 -- start start 2021-11-12T05:45:38.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.808+0000 7fe610cd2700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe5ec0037d0 0x7fe60c067280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:38.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.808+0000 7fe610cd2700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe60c0a0b30 0x7fe60c153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:38.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.808+0000 7fe610cd2700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe60c156a40 0x7fe60c153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:38.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.808+0000 7fe610cd2700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60c0a0220 con 0x7fe60c156a40 2021-11-12T05:45:38.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.808+0000 7fe610cd2700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60c154490 con 0x7fe5ec0037d0 2021-11-12T05:45:38.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.808+0000 7fe610cd2700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe60c0a0450 con 0x7fe60c0a0b30 2021-11-12T05:45:38.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.808+0000 7fe60ad9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe60c156a40 0x7fe60c153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:38.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.808+0000 7fe60ad9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe60c156a40 0x7fe60c153fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46436/0 (socket says 172.21.2.105:46436) 2021-11-12T05:45:38.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.808+0000 7fe60ad9d700 1 -- 172.21.2.105:0/1866226928 learned_addr learned my addr 172.21.2.105:0/1866226928 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:38.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.808+0000 7fe60ad9d700 1 -- 172.21.2.105:0/1866226928 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe60c0a0b30 msgr2=0x7fe60c153ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:38.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.808+0000 7fe60ad9d700 1 --2- 172.21.2.105:0/1866226928 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe60c0a0b30 0x7fe60c153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:38.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.808+0000 7fe60ad9d700 1 -- 172.21.2.105:0/1866226928 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe5ec0037d0 msgr2=0x7fe60c067280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:38.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.808+0000 7fe60ad9d700 1 --2- 172.21.2.105:0/1866226928 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe5ec0037d0 0x7fe60c067280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:38.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.808+0000 7fe60ad9d700 1 -- 172.21.2.105:0/1866226928 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe60c0a06f0 con 0x7fe60c156a40 2021-11-12T05:45:38.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.808+0000 7fe60ad9d700 1 --2- 172.21.2.105:0/1866226928 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe60c156a40 0x7fe60c153fa0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7fe5f40017c0 tx=0x7fe604008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:38.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.808+0000 7fe6037fe700 1 -- 172.21.2.105:0/1866226928 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe604010580 con 0x7fe60c156a40 2021-11-12T05:45:38.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.808+0000 7fe6037fe700 1 -- 172.21.2.105:0/1866226928 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6040106e0 con 0x7fe60c156a40 2021-11-12T05:45:38.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.808+0000 7fe610cd2700 1 -- 172.21.2.105:0/1866226928 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe60c067770 con 0x7fe60c156a40 2021-11-12T05:45:38.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.808+0000 7fe6037fe700 1 -- 172.21.2.105:0/1866226928 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe604010a80 con 0x7fe60c156a40 2021-11-12T05:45:38.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.808+0000 7fe610cd2700 1 -- 172.21.2.105:0/1866226928 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe60c0a26c0 con 0x7fe60c156a40 2021-11-12T05:45:38.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.808+0000 7fe610cd2700 1 -- 172.21.2.105:0/1866226928 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe60c0b65b0 con 0x7fe60c156a40 2021-11-12T05:45:38.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.808+0000 7fe6037fe700 1 -- 172.21.2.105:0/1866226928 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe604010be0 con 0x7fe60c156a40 2021-11-12T05:45:38.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.808+0000 7fe6037fe700 1 --2- 172.21.2.105:0/1866226928 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe5f00535b0 0x7fe5f0055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:38.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.808+0000 7fe6037fe700 1 -- 172.21.2.105:0/1866226928 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fe60406b7d0 con 0x7fe60c156a40 2021-11-12T05:45:38.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.808+0000 7fe60a59c700 1 --2- 172.21.2.105:0/1866226928 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe5f00535b0 0x7fe5f0055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:38.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.812+0000 7fe60a59c700 1 --2- 172.21.2.105:0/1866226928 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe5f00535b0 0x7fe5f0055a70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fe5fc007000 tx=0x7fe5fc008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:38.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.812+0000 7fe6037fe700 1 -- 172.21.2.105:0/1866226928 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe604042a50 con 0x7fe60c156a40 2021-11-12T05:45:38.924 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.920+0000 7fe610cd2700 1 -- 172.21.2.105:0/1866226928 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe60c057350 con 0x7fe60c156a40 2021-11-12T05:45:38.924 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.920+0000 7fe6037fe700 1 -- 172.21.2.105:0/1866226928 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+1209 (secure 0 0 0) 0x7fe604046070 con 0x7fe60c156a40 2021-11-12T05:45:38.925 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:45:38.925 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":22,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4478,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/1513907466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":1513907466},{"type":"v1","addr":"172.21.2.115:6833","nonce":1513907466}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":18},{"gid":5892,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.105:6835/3367863941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":3367863941},{"type":"v1","addr":"172.21.2.105:6835","nonce":3367863941}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22}],"filesystems":[]} 2021-11-12T05:45:38.926 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.920+0000 7fe610cd2700 1 -- 172.21.2.105:0/1866226928 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe5f00535b0 msgr2=0x7fe5f0055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:38.927 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.920+0000 7fe610cd2700 1 --2- 172.21.2.105:0/1866226928 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe5f00535b0 0x7fe5f0055a70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fe5fc007000 tx=0x7fe5fc008040).stop 2021-11-12T05:45:38.927 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.920+0000 7fe610cd2700 1 -- 172.21.2.105:0/1866226928 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe60c156a40 msgr2=0x7fe60c153fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:38.927 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.920+0000 7fe610cd2700 1 --2- 172.21.2.105:0/1866226928 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe60c156a40 0x7fe60c153fa0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7fe5f40017c0 tx=0x7fe604008040).stop 2021-11-12T05:45:38.927 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.920+0000 7fe610cd2700 1 -- 172.21.2.105:0/1866226928 shutdown_connections 2021-11-12T05:45:38.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.920+0000 7fe610cd2700 1 --2- 172.21.2.105:0/1866226928 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe5f00535b0 0x7fe5f0055a70 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:38.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.920+0000 7fe610cd2700 1 --2- 172.21.2.105:0/1866226928 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe60c156a40 0x7fe60c153fa0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:38.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.920+0000 7fe610cd2700 1 --2- 172.21.2.105:0/1866226928 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe60c0a0b30 0x7fe60c153ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:38.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.920+0000 7fe610cd2700 1 --2- 172.21.2.105:0/1866226928 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe5ec0037d0 0x7fe60c067280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:38.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.920+0000 7fe610cd2700 1 -- 172.21.2.105:0/1866226928 >> 172.21.2.105:0/1866226928 conn(0x7fe60c0628b0 msgr2=0x7fe60c146e30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:38.929 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.920+0000 7fe610cd2700 1 -- 172.21.2.105:0/1866226928 shutdown_connections 2021-11-12T05:45:38.929 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.920+0000 7fe610cd2700 1 -- 172.21.2.105:0/1866226928 wait complete. 2021-11-12T05:45:38.929 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 22 2021-11-12T05:45:38.932 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:45:38.982 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b8083700 1 Processor -- start 2021-11-12T05:45:38.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b8083700 1 -- start start 2021-11-12T05:45:38.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b8083700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff8b00601a0 0x7ff8b0141470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:38.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b8083700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b0066150 con 0x7ff8b00ade80 2021-11-12T05:45:38.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b8083700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b00663f0 con 0x7ff8b005fdc0 2021-11-12T05:45:38.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b8083700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b0141fb0 con 0x7ff8b00601a0 2021-11-12T05:45:38.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b561e700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7ff8b00ade80 0x7ff8b013a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:56844/0 (socket says 172.21.2.105:56844) 2021-11-12T05:45:38.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b561e700 1 -- 172.21.2.105:0/1048037993 learned_addr learned my addr 172.21.2.105:0/1048037993 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:45:38.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b4e1d700 1 -- 172.21.2.105:0/1048037993 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4290776003 0 0) 0x7ff8b0066150 con 0x7ff8b00ade80 2021-11-12T05:45:38.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b4e1d700 1 -- 172.21.2.105:0/1048037993 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff898003260 con 0x7ff8b00ade80 2021-11-12T05:45:38.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b4e1d700 1 -- 172.21.2.105:0/1048037993 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2879409728 0 0) 0x7ff898003260 con 0x7ff8b00ade80 2021-11-12T05:45:38.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b4e1d700 1 -- 172.21.2.105:0/1048037993 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff8b00601a0 msgr2=0x7ff8b0141470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:38.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b4e1d700 1 --2- 172.21.2.105:0/1048037993 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff8b00601a0 0x7ff8b0141470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:38.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b4e1d700 1 -- 172.21.2.105:0/1048037993 >> v1:172.21.2.115:6789/0 conn(0x7ff8b005fdc0 legacy=0x7ff8b0066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:38.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b4e1d700 1 -- 172.21.2.105:0/1048037993 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b0140fd0 con 0x7ff8b00ade80 2021-11-12T05:45:38.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b4e1d700 1 -- 172.21.2.105:0/1048037993 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7ff8a0001680 con 0x7ff8b00ade80 2021-11-12T05:45:38.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b4e1d700 1 -- 172.21.2.105:0/1048037993 >> v1:172.21.2.105:6789/0 conn(0x7ff8b00ade80 legacy=0x7ff8b013a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:38.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b4e1d700 1 --2- 172.21.2.105:0/1048037993 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff898003800 0x7ff898003c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:38.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b4e1d700 1 --2- 172.21.2.105:0/1048037993 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff898004500 0x7ff898004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:38.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b4e1d700 1 --2- 172.21.2.105:0/1048037993 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff8b00601a0 0x7ff89800fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:38.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b4e1d700 1 -- 172.21.2.105:0/1048037993 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8980052b0 con 0x7ff898004500 2021-11-12T05:45:38.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b4e1d700 1 -- 172.21.2.105:0/1048037993 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff898010050 con 0x7ff898003800 2021-11-12T05:45:38.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b4e1d700 1 -- 172.21.2.105:0/1048037993 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff898010190 con 0x7ff8b00601a0 2021-11-12T05:45:38.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b561e700 1 --2- 172.21.2.105:0/1048037993 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff898004500 0x7ff898004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:38.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b561e700 1 -- 172.21.2.105:0/1048037993 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff8b00601a0 msgr2=0x7ff89800fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:38.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b561e700 1 --2- 172.21.2.105:0/1048037993 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff8b00601a0 0x7ff89800fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:38.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b561e700 1 -- 172.21.2.105:0/1048037993 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff898003800 msgr2=0x7ff898003c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:38.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b561e700 1 --2- 172.21.2.105:0/1048037993 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff898003800 0x7ff898003c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:38.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b561e700 1 -- 172.21.2.105:0/1048037993 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b0140fd0 con 0x7ff898004500 2021-11-12T05:45:38.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b561e700 1 --2- 172.21.2.105:0/1048037993 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff898004500 0x7ff898004980 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7ff8a0001040 tx=0x7ff8a0001e40).ready entity=mon.0 client_cookie=29121c0923956307 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:38.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b4e1d700 1 -- 172.21.2.105:0/1048037993 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8a0007170 con 0x7ff898004500 2021-11-12T05:45:38.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b4e1d700 1 -- 172.21.2.105:0/1048037993 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a00072d0 con 0x7ff898004500 2021-11-12T05:45:38.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b4e1d700 1 -- 172.21.2.105:0/1048037993 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8a000c990 con 0x7ff898004500 2021-11-12T05:45:38.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b8083700 1 -- 172.21.2.105:0/1048037993 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff898004500 msgr2=0x7ff898004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:38.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b8083700 1 --2- 172.21.2.105:0/1048037993 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff898004500 0x7ff898004980 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7ff8a0001040 tx=0x7ff8a0001e40).stop 2021-11-12T05:45:38.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b6620700 1 -- 172.21.2.105:0/1048037993 reap_dead start 2021-11-12T05:45:38.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b8083700 1 -- 172.21.2.105:0/1048037993 shutdown_connections 2021-11-12T05:45:38.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b8083700 1 -- 172.21.2.105:0/1048037993 >> 172.21.2.105:0/1048037993 conn(0x7ff8b00608d0 msgr2=0x7ff8b005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:38.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b8083700 1 -- 172.21.2.105:0/1048037993 shutdown_connections 2021-11-12T05:45:38.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b8083700 1 -- 172.21.2.105:0/1048037993 wait complete. 2021-11-12T05:45:38.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b8083700 1 Processor -- start 2021-11-12T05:45:38.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.980+0000 7ff8b8083700 1 -- start start 2021-11-12T05:45:38.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.984+0000 7ff8b8083700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff898004500 0x7ff8b00b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:38.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.984+0000 7ff8b8083700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff8b0144d40 0x7ff8b00af940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:38.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.984+0000 7ff8b8083700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff8b013aef0 0x7ff8b013b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:38.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.984+0000 7ff8b8083700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b0144340 con 0x7ff8b0144d40 2021-11-12T05:45:38.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.984+0000 7ff8b8083700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b01448a0 con 0x7ff8b013aef0 2021-11-12T05:45:38.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.984+0000 7ff8b8083700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b01445e0 con 0x7ff898004500 2021-11-12T05:45:38.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.984+0000 7ff8b561e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff8b0144d40 0x7ff8b00af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:38.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.984+0000 7ff8b561e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff8b0144d40 0x7ff8b00af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46460/0 (socket says 172.21.2.105:46460) 2021-11-12T05:45:38.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.984+0000 7ff8b561e700 1 -- 172.21.2.105:0/2376373227 learned_addr learned my addr 172.21.2.105:0/2376373227 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:38.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.984+0000 7ff8b561e700 1 -- 172.21.2.105:0/2376373227 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff898004500 msgr2=0x7ff8b00b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:38.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.984+0000 7ff8b561e700 1 --2- 172.21.2.105:0/2376373227 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff898004500 0x7ff8b00b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:38.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.984+0000 7ff8b561e700 1 -- 172.21.2.105:0/2376373227 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff8b013aef0 msgr2=0x7ff8b013b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:39.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.984+0000 7ff8b561e700 1 --2- 172.21.2.105:0/2376373227 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff8b013aef0 0x7ff8b013b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:39.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.984+0000 7ff8b561e700 1 -- 172.21.2.105:0/2376373227 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b013b850 con 0x7ff8b0144d40 2021-11-12T05:45:39.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.984+0000 7ff8b561e700 1 --2- 172.21.2.105:0/2376373227 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff8b0144d40 0x7ff8b00af940 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7ff8a0001040 tx=0x7ff8a0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:39.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.984+0000 7ff89effd700 1 -- 172.21.2.105:0/2376373227 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8a0004920 con 0x7ff8b0144d40 2021-11-12T05:45:39.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.984+0000 7ff89effd700 1 -- 172.21.2.105:0/2376373227 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a0004a80 con 0x7ff8b0144d40 2021-11-12T05:45:39.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.984+0000 7ff8b8083700 1 -- 172.21.2.105:0/2376373227 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b0143fd0 con 0x7ff8b0144d40 2021-11-12T05:45:39.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.984+0000 7ff89effd700 1 -- 172.21.2.105:0/2376373227 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8a0004de0 con 0x7ff8b0144d40 2021-11-12T05:45:39.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.984+0000 7ff8b8083700 1 -- 172.21.2.105:0/2376373227 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b00b6bd0 con 0x7ff8b0144d40 2021-11-12T05:45:39.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.984+0000 7ff8b8083700 1 -- 172.21.2.105:0/2376373227 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8b0057350 con 0x7ff8b0144d40 2021-11-12T05:45:39.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.984+0000 7ff89effd700 1 -- 172.21.2.105:0/2376373227 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff8a001d070 con 0x7ff8b0144d40 2021-11-12T05:45:39.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.984+0000 7ff89effd700 1 --2- 172.21.2.105:0/2376373227 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff890053640 0x7ff890055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:39.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.984+0000 7ff89effd700 1 -- 172.21.2.105:0/2376373227 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5682+0+0 (secure 0 0 0) 0x7ff8a006c6c0 con 0x7ff8b0144d40 2021-11-12T05:45:39.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.984+0000 7ff8b5e1f700 1 --2- 172.21.2.105:0/2376373227 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff890053640 0x7ff890055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:39.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.984+0000 7ff8b5e1f700 1 --2- 172.21.2.105:0/2376373227 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff890053640 0x7ff890055b00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7ff8ac000f70 tx=0x7ff8ac0069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:39.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:38.988+0000 7ff89effd700 1 -- 172.21.2.105:0/2376373227 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff8a00439a0 con 0x7ff8b0144d40 2021-11-12T05:45:39.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.096+0000 7ff8b8083700 1 -- 172.21.2.105:0/2376373227 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8b0144a10 con 0x7ff8b0144d40 2021-11-12T05:45:39.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.096+0000 7ff89effd700 1 -- 172.21.2.105:0/2376373227 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+1209 (secure 0 0 0) 0x7ff8a0046fc0 con 0x7ff8b0144d40 2021-11-12T05:45:39.101 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:45:39.101 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":22,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4478,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/1513907466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":1513907466},{"type":"v1","addr":"172.21.2.115:6833","nonce":1513907466}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":18},{"gid":5892,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.105:6835/3367863941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":3367863941},{"type":"v1","addr":"172.21.2.105:6835","nonce":3367863941}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22}],"filesystems":[]} 2021-11-12T05:45:39.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.096+0000 7ff8b8083700 1 -- 172.21.2.105:0/2376373227 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff890053640 msgr2=0x7ff890055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:39.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.096+0000 7ff8b8083700 1 --2- 172.21.2.105:0/2376373227 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff890053640 0x7ff890055b00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7ff8ac000f70 tx=0x7ff8ac0069b0).stop 2021-11-12T05:45:39.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.096+0000 7ff8b8083700 1 -- 172.21.2.105:0/2376373227 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff8b0144d40 msgr2=0x7ff8b00af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:39.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.096+0000 7ff8b8083700 1 --2- 172.21.2.105:0/2376373227 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff8b0144d40 0x7ff8b00af940 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7ff8a0001040 tx=0x7ff8a0015000).stop 2021-11-12T05:45:39.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.096+0000 7ff8b8083700 1 -- 172.21.2.105:0/2376373227 shutdown_connections 2021-11-12T05:45:39.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.096+0000 7ff8b8083700 1 --2- 172.21.2.105:0/2376373227 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff890053640 0x7ff890055b00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:39.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.096+0000 7ff8b8083700 1 --2- 172.21.2.105:0/2376373227 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff8b013aef0 0x7ff8b013b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:39.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.096+0000 7ff8b8083700 1 --2- 172.21.2.105:0/2376373227 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff8b0144d40 0x7ff8b00af940 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:39.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.096+0000 7ff8b8083700 1 --2- 172.21.2.105:0/2376373227 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff898004500 0x7ff8b00b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:39.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.096+0000 7ff8b8083700 1 -- 172.21.2.105:0/2376373227 >> 172.21.2.105:0/2376373227 conn(0x7ff8b00608d0 msgr2=0x7ff8b00b0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:39.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.096+0000 7ff8b8083700 1 -- 172.21.2.105:0/2376373227 shutdown_connections 2021-11-12T05:45:39.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.096+0000 7ff8b8083700 1 -- 172.21.2.105:0/2376373227 wait complete. 2021-11-12T05:45:39.105 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 22 2021-11-12T05:45:39.109 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-12T05:45:39.109 INFO:tasks.ceph.mds.a:Stopping old one... 2021-11-12T05:45:39.109 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-12T05:45:39.110 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T05:45:39.110 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-12T05:45:39.110 INFO:tasks.ceph.mds.b:Stopping old one... 2021-11-12T05:45:39.111 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-12T05:45:39.111 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T05:45:39.115 INFO:tasks.ceph.mds.a:Stopped 2021-11-12T05:45:39.116 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-12T05:45:39.117 INFO:tasks.ceph.mds.a:Started 2021-11-12T05:45:39.118 DEBUG:teuthology.parallel:result is None 2021-11-12T05:45:39.123 INFO:tasks.ceph.mds.b:Stopped 2021-11-12T05:45:39.124 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-12T05:45:39.125 INFO:tasks.ceph.mds.b:Started 2021-11-12T05:45:39.126 DEBUG:teuthology.parallel:result is None 2021-11-12T05:45:39.126 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-11-12T05:45:39.152 INFO:tasks.ceph.mds.a.gibba005.stdout:starting mds.a at 2021-11-12T05:45:39.160 INFO:tasks.ceph.mds.b.gibba015.stdout:starting mds.b at 2021-11-12T05:45:39.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.176+0000 7f1f4e944700 1 Processor -- start 2021-11-12T05:45:39.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.176+0000 7f1f4e944700 1 -- start start 2021-11-12T05:45:39.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.176+0000 7f1f4e944700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f1f480626b0 0x7f1f48062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:39.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.176+0000 7f1f4e944700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f1f48130a80 0x7f1f481474d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:39.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.176+0000 7f1f4e944700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f480b0d50 con 0x7f1f480af750 2021-11-12T05:45:39.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.176+0000 7f1f4e944700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f480ad380 con 0x7f1f480626b0 2021-11-12T05:45:39.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.176+0000 7f1f4e944700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f480ae190 con 0x7f1f48130a80 2021-11-12T05:45:39.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.176+0000 7f1f477fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f1f480af750 0x7f1f48130370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:56872/0 (socket says 172.21.2.105:56872) 2021-11-12T05:45:39.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.176+0000 7f1f477fe700 1 -- 172.21.2.105:0/1845515751 learned_addr learned my addr 172.21.2.105:0/1845515751 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:45:39.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.176+0000 7f1f47fff700 1 --2- 172.21.2.105:0/1845515751 >> v2:172.21.2.105:3300/0 conn(0x7f1f480626b0 0x7f1f48062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:39.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.176+0000 7f1f4cee1700 1 --2- 172.21.2.105:0/1845515751 >> v2:172.21.2.115:3300/0 conn(0x7f1f48130a80 0x7f1f481474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:39.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.176+0000 7f1f47fff700 1 -- 172.21.2.105:0/1845515751 >> v2:172.21.2.115:3300/0 conn(0x7f1f48130a80 msgr2=0x7f1f481474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:39.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.176+0000 7f1f47fff700 1 --2- 172.21.2.105:0/1845515751 >> v2:172.21.2.115:3300/0 conn(0x7f1f48130a80 0x7f1f481474d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:39.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.176+0000 7f1f47fff700 1 -- 172.21.2.105:0/1845515751 >> v1:172.21.2.105:6789/0 conn(0x7f1f480af750 legacy=0x7f1f48130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:39.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.180+0000 7f1f46ffd700 1 -- 172.21.2.105:0/1845515751 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1836990534 0 0) 0x7f1f480b0d50 con 0x7f1f480af750 2021-11-12T05:45:39.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.180+0000 7f1f47fff700 1 -- 172.21.2.105:0/1845515751 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f481479c0 con 0x7f1f480626b0 2021-11-12T05:45:39.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.180+0000 7f1f47fff700 1 --2- 172.21.2.105:0/1845515751 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1f480626b0 0x7f1f48062a90 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f1f38002f70 tx=0x7f1f38006df0).ready entity=mon.0 client_cookie=b2f91d68b6120020 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:39.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.180+0000 7f1f46ffd700 1 -- 172.21.2.105:0/1845515751 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f3800d5c0 con 0x7f1f480626b0 2021-11-12T05:45:39.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.180+0000 7f1f46ffd700 1 -- 172.21.2.105:0/1845515751 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f38000e90 con 0x7f1f480626b0 2021-11-12T05:45:39.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.180+0000 7f1f46ffd700 1 -- 172.21.2.105:0/1845515751 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f3800d910 con 0x7f1f480626b0 2021-11-12T05:45:39.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.180+0000 7f1f4e944700 1 -- 172.21.2.105:0/1845515751 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1f480626b0 msgr2=0x7f1f48062a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:39.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.180+0000 7f1f4e944700 1 --2- 172.21.2.105:0/1845515751 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1f480626b0 0x7f1f48062a90 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f1f38002f70 tx=0x7f1f38006df0).stop 2021-11-12T05:45:39.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.180+0000 7f1f4e944700 1 -- 172.21.2.105:0/1845515751 shutdown_connections 2021-11-12T05:45:39.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.180+0000 7f1f4e944700 1 --2- 172.21.2.105:0/1845515751 >> v2:172.21.2.115:3300/0 conn(0x7f1f48130a80 0x7f1f481474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:39.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.180+0000 7f1f4e944700 1 --2- 172.21.2.105:0/1845515751 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1f480626b0 0x7f1f48062a90 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:39.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.180+0000 7f1f4e944700 1 -- 172.21.2.105:0/1845515751 >> 172.21.2.105:0/1845515751 conn(0x7f1f480b5320 msgr2=0x7f1f480b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:39.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.180+0000 7f1f4e944700 1 -- 172.21.2.105:0/1845515751 shutdown_connections 2021-11-12T05:45:39.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.180+0000 7f1f4e944700 1 -- 172.21.2.105:0/1845515751 wait complete. 2021-11-12T05:45:39.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.180+0000 7f1f4e944700 1 Processor -- start 2021-11-12T05:45:39.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.180+0000 7f1f4e944700 1 -- start start 2021-11-12T05:45:39.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.180+0000 7f1f4e944700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1f480626b0 0x7f1f48145bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:39.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.180+0000 7f1f4e944700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1f480af750 0x7f1f480639f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:39.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.180+0000 7f1f4e944700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1f48130a80 0x7f1f480666b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:39.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.180+0000 7f1f4e944700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f48063ee0 con 0x7f1f48130a80 2021-11-12T05:45:39.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.180+0000 7f1f4e944700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f48159ce0 con 0x7f1f480626b0 2021-11-12T05:45:39.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.180+0000 7f1f4e944700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f48066210 con 0x7f1f480af750 2021-11-12T05:45:39.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.180+0000 7f1f4cee1700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1f48130a80 0x7f1f480666b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:39.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.180+0000 7f1f4cee1700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1f48130a80 0x7f1f480666b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46484/0 (socket says 172.21.2.105:46484) 2021-11-12T05:45:39.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.180+0000 7f1f4cee1700 1 -- 172.21.2.105:0/4067917785 learned_addr learned my addr 172.21.2.105:0/4067917785 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:39.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.180+0000 7f1f47fff700 1 --2- 172.21.2.105:0/4067917785 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1f480626b0 0x7f1f48145bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:39.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.180+0000 7f1f477fe700 1 --2- 172.21.2.105:0/4067917785 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1f480af750 0x7f1f480639f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:39.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.180+0000 7f1f4cee1700 1 -- 172.21.2.105:0/4067917785 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1f480af750 msgr2=0x7f1f480639f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:39.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.180+0000 7f1f4cee1700 1 --2- 172.21.2.105:0/4067917785 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1f480af750 0x7f1f480639f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:39.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.180+0000 7f1f4cee1700 1 -- 172.21.2.105:0/4067917785 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1f480626b0 msgr2=0x7f1f48145bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:39.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.180+0000 7f1f4cee1700 1 --2- 172.21.2.105:0/4067917785 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1f480626b0 0x7f1f48145bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:39.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.180+0000 7f1f4cee1700 1 -- 172.21.2.105:0/4067917785 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3800b180 con 0x7f1f48130a80 2021-11-12T05:45:39.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.180+0000 7f1f4cee1700 1 --2- 172.21.2.105:0/4067917785 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1f48130a80 0x7f1f480666b0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7f1f4000a000 tx=0x7f1f40008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:39.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.184+0000 7f1f457fa700 1 -- 172.21.2.105:0/4067917785 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f4000f710 con 0x7f1f48130a80 2021-11-12T05:45:39.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.184+0000 7f1f457fa700 1 -- 172.21.2.105:0/4067917785 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4000f870 con 0x7f1f48130a80 2021-11-12T05:45:39.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.184+0000 7f1f4e944700 1 -- 172.21.2.105:0/4067917785 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f48063020 con 0x7f1f48130a80 2021-11-12T05:45:39.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.184+0000 7f1f457fa700 1 -- 172.21.2.105:0/4067917785 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f4000fbd0 con 0x7f1f48130a80 2021-11-12T05:45:39.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.184+0000 7f1f4e944700 1 -- 172.21.2.105:0/4067917785 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f4814a240 con 0x7f1f48130a80 2021-11-12T05:45:39.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.184+0000 7f1f4e944700 1 -- 172.21.2.105:0/4067917785 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f4814a7a0 con 0x7f1f48130a80 2021-11-12T05:45:39.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.184+0000 7f1f457fa700 1 -- 172.21.2.105:0/4067917785 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1f4001a030 con 0x7f1f48130a80 2021-11-12T05:45:39.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.184+0000 7f1f457fa700 1 --2- 172.21.2.105:0/4067917785 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1f2c053580 0x7f1f2c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:39.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.184+0000 7f1f457fa700 1 -- 172.21.2.105:0/4067917785 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f1f4006b5d0 con 0x7f1f48130a80 2021-11-12T05:45:39.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.184+0000 7f1f47fff700 1 --2- 172.21.2.105:0/4067917785 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1f2c053580 0x7f1f2c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:39.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.184+0000 7f1f47fff700 1 --2- 172.21.2.105:0/4067917785 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1f2c053580 0x7f1f2c055a40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f1f3801a000 tx=0x7f1f38014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:39.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.188+0000 7f1f457fa700 1 -- 172.21.2.105:0/4067917785 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1f40042850 con 0x7f1f48130a80 2021-11-12T05:45:39.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:39.280+0000 7f1f4e944700 1 -- 172.21.2.105:0/4067917785 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f1f48057350 con 0x7f1f48130a80 2021-11-12T05:45:40.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.192+0000 7f1f457fa700 1 -- 172.21.2.105:0/4067917785 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v61) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1f40045e70 con 0x7f1f48130a80 2021-11-12T05:45:40.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.196+0000 7f1f4e944700 1 -- 172.21.2.105:0/4067917785 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1f2c053580 msgr2=0x7f1f2c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:40.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.196+0000 7f1f4e944700 1 --2- 172.21.2.105:0/4067917785 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1f2c053580 0x7f1f2c055a40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f1f3801a000 tx=0x7f1f38014000).stop 2021-11-12T05:45:40.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.196+0000 7f1f4e944700 1 -- 172.21.2.105:0/4067917785 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1f48130a80 msgr2=0x7f1f480666b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:40.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.196+0000 7f1f4e944700 1 --2- 172.21.2.105:0/4067917785 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1f48130a80 0x7f1f480666b0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7f1f4000a000 tx=0x7f1f40008040).stop 2021-11-12T05:45:40.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.196+0000 7f1f4e944700 1 -- 172.21.2.105:0/4067917785 shutdown_connections 2021-11-12T05:45:40.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.196+0000 7f1f4e944700 1 --2- 172.21.2.105:0/4067917785 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1f2c053580 0x7f1f2c055a40 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:40.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.196+0000 7f1f4e944700 1 --2- 172.21.2.105:0/4067917785 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1f48130a80 0x7f1f480666b0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:40.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.196+0000 7f1f4e944700 1 --2- 172.21.2.105:0/4067917785 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1f480af750 0x7f1f480639f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:40.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.196+0000 7f1f4e944700 1 --2- 172.21.2.105:0/4067917785 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1f480626b0 0x7f1f48145bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:40.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.196+0000 7f1f4e944700 1 -- 172.21.2.105:0/4067917785 >> 172.21.2.105:0/4067917785 conn(0x7f1f480b5320 msgr2=0x7f1f480b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:40.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.196+0000 7f1f4e944700 1 -- 172.21.2.105:0/4067917785 shutdown_connections 2021-11-12T05:45:40.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.196+0000 7f1f4e944700 1 -- 172.21.2.105:0/4067917785 wait complete. 2021-11-12T05:45:40.203 INFO:teuthology.orchestra.run.gibba005.stderr: removed all blacklist entries 2021-11-12T05:45:40.227 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-11-12T05:45:40.228 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-11-12T05:45:40.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ef9b6700 1 Processor -- start 2021-11-12T05:45:40.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ef9b6700 1 -- start start 2021-11-12T05:45:40.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ef9b6700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f12e80626b0 0x7f12e8062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:40.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ef9b6700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f12e8130a80 0x7f12e81474d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:40.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ef9b6700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12e80b0d50 con 0x7f12e80af750 2021-11-12T05:45:40.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ef9b6700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12e80ad380 con 0x7f12e80626b0 2021-11-12T05:45:40.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ef9b6700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12e80ae190 con 0x7f12e8130a80 2021-11-12T05:45:40.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ecf51700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f12e80af750 0x7f12e8130370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:56890/0 (socket says 172.21.2.105:56890) 2021-11-12T05:45:40.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ecf51700 1 -- 172.21.2.105:0/4014514982 learned_addr learned my addr 172.21.2.105:0/4014514982 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:45:40.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ed752700 1 --2- 172.21.2.105:0/4014514982 >> v2:172.21.2.105:3300/0 conn(0x7f12e80626b0 0x7f12e8062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:40.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ed752700 1 -- 172.21.2.105:0/4014514982 >> v2:172.21.2.115:3300/0 conn(0x7f12e8130a80 msgr2=0x7f12e81474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:40.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ed752700 1 --2- 172.21.2.105:0/4014514982 >> v2:172.21.2.115:3300/0 conn(0x7f12e8130a80 0x7f12e81474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:40.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ed752700 1 -- 172.21.2.105:0/4014514982 >> v1:172.21.2.105:6789/0 conn(0x7f12e80af750 legacy=0x7f12e8130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:40.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ed752700 1 -- 172.21.2.105:0/4014514982 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e81479c0 con 0x7f12e80626b0 2021-11-12T05:45:40.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ed752700 1 --2- 172.21.2.105:0/4014514982 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f12e80626b0 0x7f12e8062a90 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f12dc002f70 tx=0x7f12dc006df0).ready entity=mon.0 client_cookie=b44862ee278f28e9 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:40.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12dbfff700 1 -- 172.21.2.105:0/4014514982 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12dc00d5c0 con 0x7f12e80626b0 2021-11-12T05:45:40.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12dbfff700 1 -- 172.21.2.105:0/4014514982 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12dc000e90 con 0x7f12e80626b0 2021-11-12T05:45:40.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12dbfff700 1 -- 172.21.2.105:0/4014514982 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12dc00d950 con 0x7f12e80626b0 2021-11-12T05:45:40.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ef9b6700 1 -- 172.21.2.105:0/4014514982 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f12e80626b0 msgr2=0x7f12e8062a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:40.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ef9b6700 1 --2- 172.21.2.105:0/4014514982 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f12e80626b0 0x7f12e8062a90 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f12dc002f70 tx=0x7f12dc006df0).stop 2021-11-12T05:45:40.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ef9b6700 1 -- 172.21.2.105:0/4014514982 shutdown_connections 2021-11-12T05:45:40.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ef9b6700 1 --2- 172.21.2.105:0/4014514982 >> v2:172.21.2.115:3300/0 conn(0x7f12e8130a80 0x7f12e81474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:40.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ef9b6700 1 --2- 172.21.2.105:0/4014514982 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f12e80626b0 0x7f12e8062a90 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:40.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ef9b6700 1 -- 172.21.2.105:0/4014514982 >> 172.21.2.105:0/4014514982 conn(0x7f12e80b5320 msgr2=0x7f12e80b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:40.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ef9b6700 1 -- 172.21.2.105:0/4014514982 shutdown_connections 2021-11-12T05:45:40.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ef9b6700 1 -- 172.21.2.105:0/4014514982 wait complete. 2021-11-12T05:45:40.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ef9b6700 1 Processor -- start 2021-11-12T05:45:40.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ef9b6700 1 -- start start 2021-11-12T05:45:40.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ef9b6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f12e80626b0 0x7f12e814bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:40.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ef9b6700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f12e80af750 0x7f12e81452f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:40.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ef9b6700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f12e8130a80 0x7f12e81457e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:40.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ef9b6700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e81569f0 con 0x7f12e80626b0 2021-11-12T05:45:40.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ef9b6700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e8144800 con 0x7f12e8130a80 2021-11-12T05:45:40.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ef9b6700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e8144a90 con 0x7f12e80af750 2021-11-12T05:45:40.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ed752700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f12e80626b0 0x7f12e814bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:40.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ed752700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f12e80626b0 0x7f12e814bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46496/0 (socket says 172.21.2.105:46496) 2021-11-12T05:45:40.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ed752700 1 -- 172.21.2.105:0/2928382044 learned_addr learned my addr 172.21.2.105:0/2928382044 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:40.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ed752700 1 -- 172.21.2.105:0/2928382044 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f12e80af750 msgr2=0x7f12e81452f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:40.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ed752700 1 --2- 172.21.2.105:0/2928382044 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f12e80af750 0x7f12e81452f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:40.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ed752700 1 -- 172.21.2.105:0/2928382044 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f12e8130a80 msgr2=0x7f12e81457e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:40.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ed752700 1 --2- 172.21.2.105:0/2928382044 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f12e8130a80 0x7f12e81457e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:40.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.340+0000 7f12ed752700 1 -- 172.21.2.105:0/2928382044 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12dc00b180 con 0x7f12e80626b0 2021-11-12T05:45:40.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.344+0000 7f12ed752700 1 --2- 172.21.2.105:0/2928382044 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f12e80626b0 0x7f12e814bea0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f12dc002f70 tx=0x7f12dc014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:40.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.344+0000 7f12da7fc700 1 -- 172.21.2.105:0/2928382044 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12dc016070 con 0x7f12e80626b0 2021-11-12T05:45:40.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.344+0000 7f12da7fc700 1 -- 172.21.2.105:0/2928382044 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12dc00de50 con 0x7f12e80626b0 2021-11-12T05:45:40.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.344+0000 7f12da7fc700 1 -- 172.21.2.105:0/2928382044 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12dc006b20 con 0x7f12e80626b0 2021-11-12T05:45:40.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.344+0000 7f12ef9b6700 1 -- 172.21.2.105:0/2928382044 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12e8144d30 con 0x7f12e80626b0 2021-11-12T05:45:40.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.344+0000 7f12ef9b6700 1 -- 172.21.2.105:0/2928382044 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e8147210 con 0x7f12e80626b0 2021-11-12T05:45:40.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.344+0000 7f12ef9b6700 1 -- 172.21.2.105:0/2928382044 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12e8057350 con 0x7f12e80626b0 2021-11-12T05:45:40.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.344+0000 7f12da7fc700 1 -- 172.21.2.105:0/2928382044 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f12dc025030 con 0x7f12e80626b0 2021-11-12T05:45:40.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.344+0000 7f12da7fc700 1 --2- 172.21.2.105:0/2928382044 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f12c8053640 0x7f12c8055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:40.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.344+0000 7f12da7fc700 1 -- 172.21.2.105:0/2928382044 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f12dc06c920 con 0x7f12e80626b0 2021-11-12T05:45:40.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.344+0000 7f12ecf51700 1 --2- 172.21.2.105:0/2928382044 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f12c8053640 0x7f12c8055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:40.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.344+0000 7f12ecf51700 1 --2- 172.21.2.105:0/2928382044 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f12c8053640 0x7f12c8055b00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f12e80b0690 tx=0x7f12e4007800).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:40.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.344+0000 7f12da7fc700 1 -- 172.21.2.105:0/2928382044 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f12dc043c60 con 0x7f12e80626b0 2021-11-12T05:45:40.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.456+0000 7f12ef9b6700 1 -- 172.21.2.105:0/2928382044 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f12e814a860 con 0x7f12e80626b0 2021-11-12T05:45:40.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.460+0000 7f12da7fc700 1 -- 172.21.2.105:0/2928382044 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) v1 ==== 80+0+4242 (secure 0 0 0) 0x7f12dc023090 con 0x7f12e80626b0 2021-11-12T05:45:40.463 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:45:40.464 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:45:40.464 INFO:teuthology.orchestra.run.gibba005.stdout: "auth_dump": [ 2021-11-12T05:45:40.464 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:40.464 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mds.a", 2021-11-12T05:45:40.465 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1hGVLeOhAAX2029T+USC1Um93TSzjxdA==", 2021-11-12T05:45:40.465 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:45:40.465 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:45:40.465 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:45:40.466 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:45:40.466 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:45:40.466 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:40.467 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:40.467 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:40.467 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mds.b", 2021-11-12T05:45:40.467 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hiebUAxAAGcjDAGyvecjzagGoRBX8tg==", 2021-11-12T05:45:40.467 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:45:40.468 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:45:40.468 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:45:40.469 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:45:40.469 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:45:40.469 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:40.469 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:40.469 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:40.470 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.0", 2021-11-12T05:45:40.470 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1ht05fORAAN2YrbsxBau1FQC4C8Dvb3g==", 2021-11-12T05:45:40.470 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:45:40.470 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:45:40.471 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:45:40.471 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:45:40.471 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:40.471 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:40.471 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:40.472 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.1", 2021-11-12T05:45:40.472 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAu/o1hzp1vGhAAQ6u3Npb+yNGlNOUdoHzFZA==", 2021-11-12T05:45:40.472 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:45:40.472 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:45:40.472 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:45:40.473 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:45:40.473 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:40.473 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:40.473 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:40.474 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.2", 2021-11-12T05:45:40.474 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAw/o1hHWwOOhAAx7txWG8rbch18+SBnJkfkQ==", 2021-11-12T05:45:40.474 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:45:40.474 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:45:40.474 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:45:40.475 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:45:40.475 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:40.476 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:40.476 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:40.476 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.3", 2021-11-12T05:45:40.476 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAz/o1howZpHxAAKgUVxU2tSNZbxW+6OfJF9g==", 2021-11-12T05:45:40.477 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:45:40.477 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:45:40.477 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:45:40.477 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:45:40.477 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:40.478 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:40.478 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:40.478 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.4", 2021-11-12T05:45:40.478 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA2/o1humA5KRAAVbO6UYLOBQDq3WiEkkS6xw==", 2021-11-12T05:45:40.479 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:45:40.479 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:45:40.479 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:45:40.480 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:45:40.480 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:40.480 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:40.480 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:40.481 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.5", 2021-11-12T05:45:40.481 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA5/o1hALdKDRAAR9nsaDOo9GUgpmBPHVp5HQ==", 2021-11-12T05:45:40.481 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:45:40.481 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:45:40.482 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:45:40.482 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:45:40.482 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:40.482 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:40.482 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:40.483 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.6", 2021-11-12T05:45:40.483 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA7/o1hCVP2KhAAHj5SxnJ81mKrJOg2CE2wLQ==", 2021-11-12T05:45:40.483 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:45:40.483 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:45:40.484 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:45:40.484 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:45:40.484 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:40.484 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:40.484 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:40.485 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.7", 2021-11-12T05:45:40.485 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA+/o1hWCEqEBAAv8nF9NeF2Ue5W8Ijj8Skgg==", 2021-11-12T05:45:40.485 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:45:40.485 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:45:40.486 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:45:40.486 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:45:40.486 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:40.487 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:40.487 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:40.487 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.0", 2021-11-12T05:45:40.488 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hzEzhCBAATF8giEBtrj13SAr5EJV4TA==", 2021-11-12T05:45:40.488 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:45:40.488 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:45:40.488 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow r", 2021-11-12T05:45:40.488 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-12T05:45:40.489 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:40.489 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:40.489 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:40.489 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.1", 2021-11-12T05:45:40.490 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hO6zfCxAAae1obagtpsnA9e8FlTExVA==", 2021-11-12T05:45:40.490 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:45:40.490 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:45:40.490 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow r", 2021-11-12T05:45:40.491 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-12T05:45:40.491 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:40.491 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:40.491 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:40.492 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.2", 2021-11-12T05:45:40.492 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hFYDGDhAAyz77VXKtOz86ztJ8FUIvAg==", 2021-11-12T05:45:40.492 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:45:40.492 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:45:40.492 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow r", 2021-11-12T05:45:40.493 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-12T05:45:40.493 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:40.493 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:40.493 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:40.493 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.admin", 2021-11-12T05:45:40.494 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1hwdoBHRAAUHHEU3dbyso2BnE/JppV8A==", 2021-11-12T05:45:40.494 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:45:40.494 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow *", 2021-11-12T05:45:40.494 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:45:40.494 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:45:40.495 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:45:40.495 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:40.495 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:40.495 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:40.496 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mgr.x", 2021-11-12T05:45:40.496 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1h6JBaORAAbgxQtCzGNj7MLfgwGd4cWA==", 2021-11-12T05:45:40.496 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:45:40.496 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow *", 2021-11-12T05:45:40.496 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow profile mgr", 2021-11-12T05:45:40.496 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:45:40.497 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:40.497 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:40.497 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:40.497 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mgr.y", 2021-11-12T05:45:40.498 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1hwfvvNRAASU7NmYBG/Yb6/ma1/Ew7mw==", 2021-11-12T05:45:40.498 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:45:40.498 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow *", 2021-11-12T05:45:40.498 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow profile mgr", 2021-11-12T05:45:40.498 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:45:40.499 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:40.499 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:40.499 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:45:40.499 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:45:40.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.460+0000 7f12ef9b6700 1 -- 172.21.2.105:0/2928382044 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f12c8053640 msgr2=0x7f12c8055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:40.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.460+0000 7f12ef9b6700 1 --2- 172.21.2.105:0/2928382044 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f12c8053640 0x7f12c8055b00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f12e80b0690 tx=0x7f12e4007800).stop 2021-11-12T05:45:40.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.460+0000 7f12ef9b6700 1 -- 172.21.2.105:0/2928382044 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f12e80626b0 msgr2=0x7f12e814bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:40.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.460+0000 7f12ef9b6700 1 --2- 172.21.2.105:0/2928382044 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f12e80626b0 0x7f12e814bea0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f12dc002f70 tx=0x7f12dc014000).stop 2021-11-12T05:45:40.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.460+0000 7f12ef9b6700 1 -- 172.21.2.105:0/2928382044 shutdown_connections 2021-11-12T05:45:40.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.460+0000 7f12ef9b6700 1 --2- 172.21.2.105:0/2928382044 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f12c8053640 0x7f12c8055b00 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:40.503 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.460+0000 7f12ef9b6700 1 --2- 172.21.2.105:0/2928382044 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f12e8130a80 0x7f12e81457e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:40.503 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.460+0000 7f12ef9b6700 1 --2- 172.21.2.105:0/2928382044 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f12e80af750 0x7f12e81452f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:40.503 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.460+0000 7f12ef9b6700 1 --2- 172.21.2.105:0/2928382044 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f12e80626b0 0x7f12e814bea0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:40.503 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.460+0000 7f12ef9b6700 1 -- 172.21.2.105:0/2928382044 >> 172.21.2.105:0/2928382044 conn(0x7f12e80b5320 msgr2=0x7f12e80ae590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:40.504 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.460+0000 7f12ef9b6700 1 -- 172.21.2.105:0/2928382044 shutdown_connections 2021-11-12T05:45:40.504 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.460+0000 7f12ef9b6700 1 -- 172.21.2.105:0/2928382044 wait complete. 2021-11-12T05:45:40.505 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:45:40.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.552+0000 7fa3325c9700 1 Processor -- start 2021-11-12T05:45:40.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.552+0000 7fa3325c9700 1 -- start start 2021-11-12T05:45:40.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.552+0000 7fa3325c9700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa32c0b2940 0x7fa32c142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:40.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.552+0000 7fa3325c9700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fa32c0b0780 0x7fa32c1432b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:40.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.552+0000 7fa3325c9700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa32c0b0cc0 0x7fa32c1437a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:40.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.552+0000 7fa3325c9700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa32c0b2d20 con 0x7fa32c0b2940 2021-11-12T05:45:40.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.552+0000 7fa3325c9700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa32c0b1fc0 con 0x7fa32c0b0780 2021-11-12T05:45:40.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.552+0000 7fa3325c9700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c0b15e0 con 0x7fa32c0b0cc0 2021-11-12T05:45:40.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.552+0000 7fa32bfff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa32c0b2940 0x7fa32c142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:40.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.552+0000 7fa32bfff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa32c0b2940 0x7fa32c142dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46504/0 (socket says 172.21.2.105:46504) 2021-11-12T05:45:40.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.552+0000 7fa32bfff700 1 -- 172.21.2.105:0/3533000492 learned_addr learned my addr 172.21.2.105:0/3533000492 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:40.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.552+0000 7fa32bfff700 1 -- 172.21.2.105:0/3533000492 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa32c0b0cc0 msgr2=0x7fa32c1437a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:40.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.552+0000 7fa32bfff700 1 --2- 172.21.2.105:0/3533000492 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa32c0b0cc0 0x7fa32c1437a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:40.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.552+0000 7fa32bfff700 1 -- 172.21.2.105:0/3533000492 >> v2:172.21.2.115:3300/0 conn(0x7fa32c0b0780 msgr2=0x7fa32c1432b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:40.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.552+0000 7fa32bfff700 1 --2- 172.21.2.105:0/3533000492 >> v2:172.21.2.115:3300/0 conn(0x7fa32c0b0780 0x7fa32c1432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:40.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.552+0000 7fa32bfff700 1 -- 172.21.2.105:0/3533000492 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa32c0b1880 con 0x7fa32c0b2940 2021-11-12T05:45:40.563 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.552+0000 7fa32bfff700 1 --2- 172.21.2.105:0/3533000492 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa32c0b2940 0x7fa32c142dc0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7fa314002f70 tx=0x7fa314006eb0).ready entity=mon.0 client_cookie=4a2cf9e474e17c3c server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:40.563 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.552+0000 7fa32affd700 1 -- 172.21.2.105:0/3533000492 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa31400d570 con 0x7fa32c0b2940 2021-11-12T05:45:40.563 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.552+0000 7fa32affd700 1 -- 172.21.2.105:0/3533000492 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa314000e90 con 0x7fa32c0b2940 2021-11-12T05:45:40.564 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.552+0000 7fa32affd700 1 -- 172.21.2.105:0/3533000492 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa31400d900 con 0x7fa32c0b2940 2021-11-12T05:45:40.564 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa3325c9700 1 -- 172.21.2.105:0/3533000492 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa32c0b2940 msgr2=0x7fa32c142dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:40.565 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa3325c9700 1 --2- 172.21.2.105:0/3533000492 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa32c0b2940 0x7fa32c142dc0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7fa314002f70 tx=0x7fa314006eb0).stop 2021-11-12T05:45:40.565 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa3325c9700 1 -- 172.21.2.105:0/3533000492 shutdown_connections 2021-11-12T05:45:40.566 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa3325c9700 1 --2- 172.21.2.105:0/3533000492 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa32c0b0cc0 0x7fa32c1437a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:40.566 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa3325c9700 1 --2- 172.21.2.105:0/3533000492 >> v2:172.21.2.115:3300/0 conn(0x7fa32c0b0780 0x7fa32c1432b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:40.566 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa3325c9700 1 --2- 172.21.2.105:0/3533000492 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa32c0b2940 0x7fa32c142dc0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:40.567 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa3325c9700 1 -- 172.21.2.105:0/3533000492 >> 172.21.2.105:0/3533000492 conn(0x7fa32c068440 msgr2=0x7fa32c062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:40.567 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa3325c9700 1 -- 172.21.2.105:0/3533000492 shutdown_connections 2021-11-12T05:45:40.568 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa3325c9700 1 -- 172.21.2.105:0/3533000492 wait complete. 2021-11-12T05:45:40.571 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa3325c9700 1 Processor -- start 2021-11-12T05:45:40.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa3325c9700 1 -- start start 2021-11-12T05:45:40.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa3325c9700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa32c0b0780 0x7fa32c138310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:40.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa3325c9700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa32c0b0cc0 0x7fa32c133d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:40.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa3325c9700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa32c0b2940 0x7fa32c134240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:40.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa3325c9700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c0abb40 con 0x7fa32c0b0cc0 2021-11-12T05:45:40.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa3325c9700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c0ab8a0 con 0x7fa32c0b2940 2021-11-12T05:45:40.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa3325c9700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c0ab570 con 0x7fa32c0b0780 2021-11-12T05:45:40.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa32b7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa32c0b0cc0 0x7fa32c133d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:40.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa32b7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa32c0b0cc0 0x7fa32c133d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46510/0 (socket says 172.21.2.105:46510) 2021-11-12T05:45:40.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa32b7fe700 1 -- 172.21.2.105:0/1586541767 learned_addr learned my addr 172.21.2.105:0/1586541767 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:40.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa32b7fe700 1 -- 172.21.2.105:0/1586541767 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa32c0b0780 msgr2=0x7fa32c138310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:40.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa32bfff700 1 --2- 172.21.2.105:0/1586541767 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa32c0b0780 0x7fa32c138310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:40.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa32b7fe700 1 --2- 172.21.2.105:0/1586541767 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa32c0b0780 0x7fa32c138310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:40.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa32b7fe700 1 -- 172.21.2.105:0/1586541767 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa32c0b2940 msgr2=0x7fa32c134240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:40.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa330b66700 1 --2- 172.21.2.105:0/1586541767 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa32c0b2940 0x7fa32c134240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:40.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa32b7fe700 1 --2- 172.21.2.105:0/1586541767 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa32c0b2940 0x7fa32c134240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:40.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa32b7fe700 1 -- 172.21.2.105:0/1586541767 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa31400b1e0 con 0x7fa32c0b0cc0 2021-11-12T05:45:40.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa330b66700 1 --2- 172.21.2.105:0/1586541767 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa32c0b2940 0x7fa32c134240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:45:40.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa32b7fe700 1 --2- 172.21.2.105:0/1586541767 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa32c0b0cc0 0x7fa32c133d50 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7fa31c002f70 tx=0x7fa31c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:40.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa3297fa700 1 -- 172.21.2.105:0/1586541767 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa31c013460 con 0x7fa32c0b0cc0 2021-11-12T05:45:40.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa3297fa700 1 -- 172.21.2.105:0/1586541767 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31c0135c0 con 0x7fa32c0b0cc0 2021-11-12T05:45:40.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa3325c9700 1 -- 172.21.2.105:0/1586541767 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa32c134730 con 0x7fa32c0b0cc0 2021-11-12T05:45:40.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa3297fa700 1 -- 172.21.2.105:0/1586541767 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa31c013920 con 0x7fa32c0b0cc0 2021-11-12T05:45:40.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa3325c9700 1 -- 172.21.2.105:0/1586541767 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa32c067170 con 0x7fa32c0b0cc0 2021-11-12T05:45:40.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa3325c9700 1 -- 172.21.2.105:0/1586541767 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa32c0662f0 con 0x7fa32c0b0cc0 2021-11-12T05:45:40.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa3297fa700 1 -- 172.21.2.105:0/1586541767 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa31c01a060 con 0x7fa32c0b0cc0 2021-11-12T05:45:40.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa3297fa700 1 --2- 172.21.2.105:0/1586541767 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa310053580 0x7fa310055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:40.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa3297fa700 1 -- 172.21.2.105:0/1586541767 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fa31c06b0e0 con 0x7fa32c0b0cc0 2021-11-12T05:45:40.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.556+0000 7fa32bfff700 1 --2- 172.21.2.105:0/1586541767 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa310053580 0x7fa310055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:40.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.560+0000 7fa32bfff700 1 --2- 172.21.2.105:0/1586541767 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa310053580 0x7fa310055a40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7fa314017000 tx=0x7fa314015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:40.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.560+0000 7fa3297fa700 1 -- 172.21.2.105:0/1586541767 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa31c042420 con 0x7fa32c0b0cc0 2021-11-12T05:45:40.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.644+0000 7fa3325c9700 1 -- 172.21.2.105:0/1586541767 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa32c0b1b20 con 0x7fa32c0b0cc0 2021-11-12T05:45:40.650 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.644+0000 7fa3297fa700 1 -- 172.21.2.105:0/1586541767 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+13415 (secure 0 0 0) 0x7fa31c045a40 con 0x7fa32c0b0cc0 2021-11-12T05:45:40.650 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:45:40.650 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":61,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:45:40.188384+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:45:40.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.648+0000 7fa3325c9700 1 -- 172.21.2.105:0/1586541767 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa310053580 msgr2=0x7fa310055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:40.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.648+0000 7fa3325c9700 1 --2- 172.21.2.105:0/1586541767 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa310053580 0x7fa310055a40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7fa314017000 tx=0x7fa314015000).stop 2021-11-12T05:45:40.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.648+0000 7fa3325c9700 1 -- 172.21.2.105:0/1586541767 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa32c0b0cc0 msgr2=0x7fa32c133d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:40.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.648+0000 7fa3325c9700 1 --2- 172.21.2.105:0/1586541767 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa32c0b0cc0 0x7fa32c133d50 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7fa31c002f70 tx=0x7fa31c006df0).stop 2021-11-12T05:45:40.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.648+0000 7fa3325c9700 1 -- 172.21.2.105:0/1586541767 shutdown_connections 2021-11-12T05:45:40.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.648+0000 7fa3325c9700 1 --2- 172.21.2.105:0/1586541767 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa310053580 0x7fa310055a40 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:40.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.648+0000 7fa3325c9700 1 --2- 172.21.2.105:0/1586541767 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa32c0b2940 0x7fa32c134240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:40.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.648+0000 7fa3325c9700 1 --2- 172.21.2.105:0/1586541767 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa32c0b0cc0 0x7fa32c133d50 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:40.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.648+0000 7fa3325c9700 1 --2- 172.21.2.105:0/1586541767 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa32c0b0780 0x7fa32c138310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:40.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.648+0000 7fa3325c9700 1 -- 172.21.2.105:0/1586541767 >> 172.21.2.105:0/1586541767 conn(0x7fa32c068440 msgr2=0x7fa32c0ae5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:40.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.648+0000 7fa3325c9700 1 -- 172.21.2.105:0/1586541767 shutdown_connections 2021-11-12T05:45:40.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.648+0000 7fa3325c9700 1 -- 172.21.2.105:0/1586541767 wait complete. 2021-11-12T05:45:40.657 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-12T05:45:40.658 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:45:40.711 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.708+0000 7f609ff2e700 1 Processor -- start 2021-11-12T05:45:40.712 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.708+0000 7f609ff2e700 1 -- start start 2021-11-12T05:45:40.716 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.708+0000 7f609ff2e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60980b2e20 0x7f60980b1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:40.717 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.708+0000 7f609ff2e700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60980ad400 con 0x7f609813ea50 2021-11-12T05:45:40.717 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.708+0000 7f609ff2e700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60980b3200 con 0x7f6098142c50 2021-11-12T05:45:40.717 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.708+0000 7f609ff2e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60980ad660 con 0x7f60980b2e20 2021-11-12T05:45:40.717 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.708+0000 7f609d4c9700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f609813ea50 0x7f609813ee90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:56914/0 (socket says 172.21.2.105:56914) 2021-11-12T05:45:40.718 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.708+0000 7f609d4c9700 1 -- 172.21.2.105:0/2268420213 learned_addr learned my addr 172.21.2.105:0/2268420213 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:45:40.718 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.708+0000 7f609ccc8700 1 -- 172.21.2.105:0/2268420213 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3288711802 0 0) 0x7f60980ad400 con 0x7f609813ea50 2021-11-12T05:45:40.718 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.708+0000 7f609ccc8700 1 -- 172.21.2.105:0/2268420213 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6080003260 con 0x7f609813ea50 2021-11-12T05:45:40.718 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.708+0000 7f609ccc8700 1 -- 172.21.2.105:0/2268420213 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1976065243 0 0) 0x7f6080003260 con 0x7f609813ea50 2021-11-12T05:45:40.719 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.708+0000 7f609dcca700 1 --2- 172.21.2.105:0/2268420213 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60980b2e20 0x7f60980b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:40.719 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.708+0000 7f609ccc8700 1 -- 172.21.2.105:0/2268420213 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60980b2e20 msgr2=0x7f60980b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:40.719 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.708+0000 7f609ccc8700 1 --2- 172.21.2.105:0/2268420213 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60980b2e20 0x7f60980b1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:40.719 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.708+0000 7f609ccc8700 1 -- 172.21.2.105:0/2268420213 >> v1:172.21.2.115:6789/0 conn(0x7f6098142c50 legacy=0x7f60981430c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:40.719 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.708+0000 7f609ccc8700 1 -- 172.21.2.105:0/2268420213 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60980ad900 con 0x7f609813ea50 2021-11-12T05:45:40.720 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.708+0000 7f609ccc8700 1 -- 172.21.2.105:0/2268420213 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f6094001680 con 0x7f609813ea50 2021-11-12T05:45:40.720 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.708+0000 7f609ccc8700 1 -- 172.21.2.105:0/2268420213 >> v1:172.21.2.105:6789/0 conn(0x7f609813ea50 legacy=0x7f609813ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:40.720 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.708+0000 7f609ccc8700 1 --2- 172.21.2.105:0/2268420213 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60980b2e20 0x7f6080003800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:40.720 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.708+0000 7f609ccc8700 1 --2- 172.21.2.105:0/2268420213 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6080003ef0 0x7f6080004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:40.720 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.708+0000 7f609ccc8700 1 --2- 172.21.2.105:0/2268420213 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6080004bf0 0x7f608000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:40.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.708+0000 7f609ccc8700 1 -- 172.21.2.105:0/2268420213 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60980ad660 con 0x7f6080003ef0 2021-11-12T05:45:40.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.708+0000 7f609ccc8700 1 -- 172.21.2.105:0/2268420213 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60800052f0 con 0x7f6080004bf0 2021-11-12T05:45:40.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.708+0000 7f609ccc8700 1 -- 172.21.2.105:0/2268420213 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608000bc40 con 0x7f60980b2e20 2021-11-12T05:45:40.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.708+0000 7f609d4c9700 1 --2- 172.21.2.105:0/2268420213 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6080003ef0 0x7f6080004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:40.722 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.708+0000 7f609d4c9700 1 -- 172.21.2.105:0/2268420213 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60980b2e20 msgr2=0x7f6080003800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:40.722 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.708+0000 7f609d4c9700 1 --2- 172.21.2.105:0/2268420213 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60980b2e20 0x7f6080003800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:40.722 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.708+0000 7f609d4c9700 1 -- 172.21.2.105:0/2268420213 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6080004bf0 msgr2=0x7f608000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:40.722 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.708+0000 7f609d4c9700 1 --2- 172.21.2.105:0/2268420213 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6080004bf0 0x7f608000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:40.722 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.708+0000 7f609d4c9700 1 -- 172.21.2.105:0/2268420213 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6080003260 con 0x7f6080003ef0 2021-11-12T05:45:40.723 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.708+0000 7f609d4c9700 1 --2- 172.21.2.105:0/2268420213 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6080003ef0 0x7f6080004500 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f60980b3520 tx=0x7f6094001e10).ready entity=mon.0 client_cookie=48aeaa5363a747ca server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:40.723 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.708+0000 7f609ccc8700 1 -- 172.21.2.105:0/2268420213 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f609400db90 con 0x7f6080003ef0 2021-11-12T05:45:40.723 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.708+0000 7f609ccc8700 1 -- 172.21.2.105:0/2268420213 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609400dcf0 con 0x7f6080003ef0 2021-11-12T05:45:40.723 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.708+0000 7f609ccc8700 1 -- 172.21.2.105:0/2268420213 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6094014a70 con 0x7f6080003ef0 2021-11-12T05:45:40.724 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.708+0000 7f609ff2e700 1 -- 172.21.2.105:0/2268420213 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6080003ef0 msgr2=0x7f6080004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:40.724 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.708+0000 7f609ff2e700 1 --2- 172.21.2.105:0/2268420213 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6080003ef0 0x7f6080004500 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f60980b3520 tx=0x7f6094001e10).stop 2021-11-12T05:45:40.724 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.708+0000 7f609e4cb700 1 -- 172.21.2.105:0/2268420213 reap_dead start 2021-11-12T05:45:40.724 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.712+0000 7f609ff2e700 1 -- 172.21.2.105:0/2268420213 shutdown_connections 2021-11-12T05:45:40.724 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.712+0000 7f609ff2e700 1 -- 172.21.2.105:0/2268420213 >> 172.21.2.105:0/2268420213 conn(0x7f6098062f60 msgr2=0x7f6098063370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:40.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.712+0000 7f609ff2e700 1 -- 172.21.2.105:0/2268420213 shutdown_connections 2021-11-12T05:45:40.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.712+0000 7f609ff2e700 1 -- 172.21.2.105:0/2268420213 wait complete. 2021-11-12T05:45:40.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.712+0000 7f609ff2e700 1 Processor -- start 2021-11-12T05:45:40.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.712+0000 7f609ff2e700 1 -- start start 2021-11-12T05:45:40.726 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.712+0000 7f609ff2e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f609813d8a0 0x7f60980aa140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:40.726 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.712+0000 7f609ff2e700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f60980b3960 0x7f60980aab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:40.726 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.712+0000 7f609ff2e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60980ab020 0x7f6098137b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:40.726 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.712+0000 7f609ff2e700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60980648d0 con 0x7f60980ab020 2021-11-12T05:45:40.726 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.712+0000 7f609ff2e700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609813dc80 con 0x7f60980b3960 2021-11-12T05:45:40.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.712+0000 7f609ff2e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60980aa6b0 con 0x7f609813d8a0 2021-11-12T05:45:40.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.712+0000 7f609e4cb700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60980ab020 0x7f6098137b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:40.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.712+0000 7f609e4cb700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60980ab020 0x7f6098137b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46532/0 (socket says 172.21.2.105:46532) 2021-11-12T05:45:40.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.712+0000 7f609e4cb700 1 -- 172.21.2.105:0/1301229836 learned_addr learned my addr 172.21.2.105:0/1301229836 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:40.728 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.712+0000 7f609d4c9700 1 --2- 172.21.2.105:0/1301229836 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f60980b3960 0x7f60980aab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:40.728 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.712+0000 7f609dcca700 1 --2- 172.21.2.105:0/1301229836 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f609813d8a0 0x7f60980aa140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:40.728 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.712+0000 7f609e4cb700 1 -- 172.21.2.105:0/1301229836 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f609813d8a0 msgr2=0x7f60980aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:40.728 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.712+0000 7f609e4cb700 1 --2- 172.21.2.105:0/1301229836 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f609813d8a0 0x7f60980aa140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:40.728 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.712+0000 7f609e4cb700 1 -- 172.21.2.105:0/1301229836 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f60980b3960 msgr2=0x7f60980aab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:40.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.712+0000 7f609e4cb700 1 --2- 172.21.2.105:0/1301229836 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f60980b3960 0x7f60980aab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:40.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.712+0000 7f609e4cb700 1 -- 172.21.2.105:0/1301229836 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60980b5010 con 0x7f60980ab020 2021-11-12T05:45:40.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.712+0000 7f609e4cb700 1 --2- 172.21.2.105:0/1301229836 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60980ab020 0x7f6098137b30 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f60980aaa10 tx=0x7f6090007e70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:40.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.712+0000 7f608affd700 1 -- 172.21.2.105:0/1301229836 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6090005880 con 0x7f60980ab020 2021-11-12T05:45:40.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.712+0000 7f608affd700 1 -- 172.21.2.105:0/1301229836 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60900059e0 con 0x7f60980ab020 2021-11-12T05:45:40.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.712+0000 7f608affd700 1 -- 172.21.2.105:0/1301229836 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6090005d40 con 0x7f60980ab020 2021-11-12T05:45:40.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.712+0000 7f609ff2e700 1 -- 172.21.2.105:0/1301229836 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60980b52b0 con 0x7f60980ab020 2021-11-12T05:45:40.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.712+0000 7f609ff2e700 1 -- 172.21.2.105:0/1301229836 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60980b4d00 con 0x7f60980ab020 2021-11-12T05:45:40.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.712+0000 7f609ff2e700 1 -- 172.21.2.105:0/1301229836 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60980aa870 con 0x7f60980ab020 2021-11-12T05:45:40.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.712+0000 7f608affd700 1 -- 172.21.2.105:0/1301229836 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f609001b070 con 0x7f60980ab020 2021-11-12T05:45:40.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.712+0000 7f608affd700 1 --2- 172.21.2.105:0/1301229836 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6078053660 0x7f6078055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:40.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.712+0000 7f608affd700 1 -- 172.21.2.105:0/1301229836 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f609006a840 con 0x7f60980ab020 2021-11-12T05:45:40.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.712+0000 7f609dcca700 1 --2- 172.21.2.105:0/1301229836 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6078053660 0x7f6078055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:40.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.712+0000 7f609dcca700 1 --2- 172.21.2.105:0/1301229836 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6078053660 0x7f6078055b20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f608c00b000 tx=0x7f608c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:40.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.716+0000 7f608affd700 1 -- 172.21.2.105:0/1301229836 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f60980aa870 con 0x7f60980ab020 2021-11-12T05:45:40.803 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.800+0000 7f609ff2e700 1 -- 172.21.2.105:0/1301229836 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f60980aa870 con 0x7f60980ab020 2021-11-12T05:45:40.803 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.800+0000 7f608affd700 1 -- 172.21.2.105:0/1301229836 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v61) v1 ==== 110+0+10 (secure 0 0 0) 0x7f60980aa870 con 0x7f60980ab020 2021-11-12T05:45:40.804 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:45:40.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.800+0000 7f609ff2e700 1 -- 172.21.2.105:0/1301229836 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6078053660 msgr2=0x7f6078055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:40.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.800+0000 7f609ff2e700 1 --2- 172.21.2.105:0/1301229836 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6078053660 0x7f6078055b20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f608c00b000 tx=0x7f608c008040).stop 2021-11-12T05:45:40.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.800+0000 7f609ff2e700 1 -- 172.21.2.105:0/1301229836 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60980ab020 msgr2=0x7f6098137b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:40.806 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.800+0000 7f609ff2e700 1 --2- 172.21.2.105:0/1301229836 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60980ab020 0x7f6098137b30 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f60980aaa10 tx=0x7f6090007e70).stop 2021-11-12T05:45:40.806 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.800+0000 7f609ff2e700 1 -- 172.21.2.105:0/1301229836 shutdown_connections 2021-11-12T05:45:40.806 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.800+0000 7f609ff2e700 1 --2- 172.21.2.105:0/1301229836 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6078053660 0x7f6078055b20 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:40.806 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.800+0000 7f609ff2e700 1 --2- 172.21.2.105:0/1301229836 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60980ab020 0x7f6098137b30 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:40.806 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.800+0000 7f609ff2e700 1 --2- 172.21.2.105:0/1301229836 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f60980b3960 0x7f60980aab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:40.807 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.800+0000 7f609ff2e700 1 --2- 172.21.2.105:0/1301229836 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f609813d8a0 0x7f60980aa140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:40.807 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.800+0000 7f609ff2e700 1 -- 172.21.2.105:0/1301229836 >> 172.21.2.105:0/1301229836 conn(0x7f6098062f60 msgr2=0x7f60980aeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:40.807 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.800+0000 7f609ff2e700 1 -- 172.21.2.105:0/1301229836 shutdown_connections 2021-11-12T05:45:40.807 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.800+0000 7f609ff2e700 1 -- 172.21.2.105:0/1301229836 wait complete. 2021-11-12T05:45:40.810 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:45:40.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.860+0000 7f8936c31700 1 Processor -- start 2021-11-12T05:45:40.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.860+0000 7f8936c31700 1 -- start start 2021-11-12T05:45:40.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.860+0000 7f8936c31700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f89300ae090 0x7f8930140d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:40.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.860+0000 7f8936c31700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f89300b3980 0x7f89300b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:40.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.860+0000 7f8936c31700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89300b7ee0 con 0x7f89300b7b00 2021-11-12T05:45:40.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.860+0000 7f8936c31700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89300b2030 con 0x7f89300b3980 2021-11-12T05:45:40.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.860+0000 7f8936c31700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89300b22d0 con 0x7f89300ae090 2021-11-12T05:45:40.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.860+0000 7f89351ce700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f89300b3980 0x7f89300b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:40.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.860+0000 7f89351ce700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f89300b3980 0x7f89300b3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3300/0 says I am v2:172.21.2.105:35482/0 (socket says 172.21.2.105:35482) 2021-11-12T05:45:40.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.860+0000 7f89351ce700 1 -- 172.21.2.105:0/550715627 learned_addr learned my addr 172.21.2.105:0/550715627 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:40.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.860+0000 7f892ffff700 1 --2- 172.21.2.105:0/550715627 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f89300ae090 0x7f8930140d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:40.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.860+0000 7f89351ce700 1 -- 172.21.2.105:0/550715627 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f89300ae090 msgr2=0x7f8930140d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:40.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.860+0000 7f89351ce700 1 --2- 172.21.2.105:0/550715627 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f89300ae090 0x7f8930140d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:40.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.860+0000 7f89351ce700 1 -- 172.21.2.105:0/550715627 >> v1:172.21.2.115:6789/0 conn(0x7f89300b7b00 legacy=0x7f89300b2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:40.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.860+0000 7f89351ce700 1 -- 172.21.2.105:0/550715627 --> v2:172.21.2.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89300b2570 con 0x7f89300b3980 2021-11-12T05:45:40.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.864+0000 7f89351ce700 1 --2- 172.21.2.105:0/550715627 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f89300b3980 0x7f89300b3e10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f89280032f0 tx=0x7f8928009290).ready entity=mon.1 client_cookie=2a7485af66182214 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:40.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.864+0000 7f892f7fe700 1 -- 172.21.2.105:0/550715627 <== mon.1 v2:172.21.2.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f892800b8a0 con 0x7f89300b3980 2021-11-12T05:45:40.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.864+0000 7f892f7fe700 1 -- 172.21.2.105:0/550715627 <== mon.1 v2:172.21.2.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892800ba00 con 0x7f89300b3980 2021-11-12T05:45:40.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.864+0000 7f892f7fe700 1 -- 172.21.2.105:0/550715627 <== mon.1 v2:172.21.2.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f892800bb70 con 0x7f89300b3980 2021-11-12T05:45:40.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.864+0000 7f8936c31700 1 -- 172.21.2.105:0/550715627 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f89300b3980 msgr2=0x7f89300b3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:40.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.864+0000 7f8936c31700 1 --2- 172.21.2.105:0/550715627 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f89300b3980 0x7f89300b3e10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f89280032f0 tx=0x7f8928009290).stop 2021-11-12T05:45:40.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.864+0000 7f8936c31700 1 -- 172.21.2.105:0/550715627 shutdown_connections 2021-11-12T05:45:40.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.864+0000 7f8936c31700 1 --2- 172.21.2.105:0/550715627 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f89300b3980 0x7f89300b3e10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:40.873 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.864+0000 7f8936c31700 1 --2- 172.21.2.105:0/550715627 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f89300ae090 0x7f8930140d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:40.873 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.864+0000 7f8936c31700 1 -- 172.21.2.105:0/550715627 >> 172.21.2.105:0/550715627 conn(0x7f89300608d0 msgr2=0x7f893005c490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:40.873 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.864+0000 7f8936c31700 1 -- 172.21.2.105:0/550715627 shutdown_connections 2021-11-12T05:45:40.873 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.864+0000 7f8936c31700 1 -- 172.21.2.105:0/550715627 wait complete. 2021-11-12T05:45:40.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.864+0000 7f8936c31700 1 Processor -- start 2021-11-12T05:45:40.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.864+0000 7f8936c31700 1 -- start start 2021-11-12T05:45:40.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.864+0000 7f8936c31700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f89300ae090 0x7f893014a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:40.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.864+0000 7f8936c31700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f89300b3980 0x7f893013fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:40.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.864+0000 7f8936c31700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89300b7b00 0x7f8930143520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:40.875 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.864+0000 7f8936c31700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8930142a40 con 0x7f89300b7b00 2021-11-12T05:45:40.875 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.864+0000 7f8936c31700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8930144530 con 0x7f89300ae090 2021-11-12T05:45:40.875 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.864+0000 7f8936c31700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89301403f0 con 0x7f89300b3980 2021-11-12T05:45:40.875 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.864+0000 7f89351ce700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89300b7b00 0x7f8930143520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:40.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.864+0000 7f89351ce700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89300b7b00 0x7f8930143520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46546/0 (socket says 172.21.2.105:46546) 2021-11-12T05:45:40.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.864+0000 7f89351ce700 1 -- 172.21.2.105:0/2097504932 learned_addr learned my addr 172.21.2.105:0/2097504932 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:40.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.864+0000 7f89351ce700 1 -- 172.21.2.105:0/2097504932 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f89300b3980 msgr2=0x7f893013fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:40.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.864+0000 7f89351ce700 1 --2- 172.21.2.105:0/2097504932 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f89300b3980 0x7f893013fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:40.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.864+0000 7f89351ce700 1 -- 172.21.2.105:0/2097504932 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f89300ae090 msgr2=0x7f893014a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:40.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.864+0000 7f89351ce700 1 --2- 172.21.2.105:0/2097504932 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f89300ae090 0x7f893014a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:40.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.864+0000 7f89351ce700 1 -- 172.21.2.105:0/2097504932 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8928009530 con 0x7f89300b7b00 2021-11-12T05:45:40.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.864+0000 7f89351ce700 1 --2- 172.21.2.105:0/2097504932 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89300b7b00 0x7f8930143520 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f89301433c0 tx=0x7f8928016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:40.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.864+0000 7f892dffb700 1 -- 172.21.2.105:0/2097504932 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f892800b8a0 con 0x7f89300b7b00 2021-11-12T05:45:40.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.864+0000 7f892dffb700 1 -- 172.21.2.105:0/2097504932 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8928021630 con 0x7f89300b7b00 2021-11-12T05:45:40.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.864+0000 7f8936c31700 1 -- 172.21.2.105:0/2097504932 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8930140690 con 0x7f89300b7b00 2021-11-12T05:45:40.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.864+0000 7f892dffb700 1 -- 172.21.2.105:0/2097504932 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8928021990 con 0x7f89300b7b00 2021-11-12T05:45:40.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.864+0000 7f8936c31700 1 -- 172.21.2.105:0/2097504932 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f893013f680 con 0x7f89300b7b00 2021-11-12T05:45:40.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.864+0000 7f8936c31700 1 -- 172.21.2.105:0/2097504932 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8930140240 con 0x7f89300b7b00 2021-11-12T05:45:40.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.864+0000 7f892dffb700 1 -- 172.21.2.105:0/2097504932 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f892800f070 con 0x7f89300b7b00 2021-11-12T05:45:40.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.868+0000 7f892dffb700 1 --2- 172.21.2.105:0/2097504932 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8910053610 0x7f8910055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:40.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.868+0000 7f892dffb700 1 -- 172.21.2.105:0/2097504932 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f892806cf30 con 0x7f89300b7b00 2021-11-12T05:45:40.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.868+0000 7f89349cd700 1 --2- 172.21.2.105:0/2097504932 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8910053610 0x7f8910055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:40.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.868+0000 7f89349cd700 1 --2- 172.21.2.105:0/2097504932 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8910053610 0x7f8910055ad0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f8930065530 tx=0x7f8924007810).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:40.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.868+0000 7f892dffb700 1 -- 172.21.2.105:0/2097504932 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8928044270 con 0x7f89300b7b00 2021-11-12T05:45:40.955 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.952+0000 7f8936c31700 1 -- 172.21.2.105:0/2097504932 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8930057350 con 0x7f89300b7b00 2021-11-12T05:45:40.956 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.952+0000 7f892dffb700 1 -- 172.21.2.105:0/2097504932 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v61) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8928015070 con 0x7f89300b7b00 2021-11-12T05:45:40.957 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:45:40.958 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.952+0000 7f8936c31700 1 -- 172.21.2.105:0/2097504932 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8910053610 msgr2=0x7f8910055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:40.958 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.952+0000 7f8936c31700 1 --2- 172.21.2.105:0/2097504932 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8910053610 0x7f8910055ad0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f8930065530 tx=0x7f8924007810).stop 2021-11-12T05:45:40.958 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.952+0000 7f8936c31700 1 -- 172.21.2.105:0/2097504932 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89300b7b00 msgr2=0x7f8930143520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:40.958 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.952+0000 7f8936c31700 1 --2- 172.21.2.105:0/2097504932 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89300b7b00 0x7f8930143520 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f89301433c0 tx=0x7f8928016000).stop 2021-11-12T05:45:40.959 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.952+0000 7f8936c31700 1 -- 172.21.2.105:0/2097504932 shutdown_connections 2021-11-12T05:45:40.959 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.952+0000 7f8936c31700 1 --2- 172.21.2.105:0/2097504932 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8910053610 0x7f8910055ad0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:40.959 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.952+0000 7f8936c31700 1 --2- 172.21.2.105:0/2097504932 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89300b7b00 0x7f8930143520 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:40.959 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.952+0000 7f8936c31700 1 --2- 172.21.2.105:0/2097504932 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f89300b3980 0x7f893013fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:40.959 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.952+0000 7f8936c31700 1 --2- 172.21.2.105:0/2097504932 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f89300ae090 0x7f893014a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:40.960 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.952+0000 7f8936c31700 1 -- 172.21.2.105:0/2097504932 >> 172.21.2.105:0/2097504932 conn(0x7f89300608d0 msgr2=0x7f89300b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:40.960 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.952+0000 7f8936c31700 1 -- 172.21.2.105:0/2097504932 shutdown_connections 2021-11-12T05:45:40.960 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:40.952+0000 7f8936c31700 1 -- 172.21.2.105:0/2097504932 wait complete. 2021-11-12T05:45:40.964 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-12T05:45:41.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.008+0000 7fc28fd5f700 1 Processor -- start 2021-11-12T05:45:41.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.008+0000 7fc28fd5f700 1 -- start start 2021-11-12T05:45:41.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28fd5f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc2880b1160 0x7fc288062620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:41.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28fd5f700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fc2880ac7b0 0x7fc288062b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:41.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28fd5f700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fc2880accc0 0x7fc288063000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:41.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28fd5f700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2880ad3d0 con 0x7fc2880ac7b0 2021-11-12T05:45:41.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28fd5f700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2880b1540 con 0x7fc2880accc0 2021-11-12T05:45:41.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28fd5f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2880abab0 con 0x7fc2880b1160 2021-11-12T05:45:41.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28d2fa700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fc2880ac7b0 0x7fc288062b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:41.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28d2fa700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fc2880ac7b0 0x7fc288062b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46554/0 (socket says 172.21.2.105:46554) 2021-11-12T05:45:41.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28d2fa700 1 -- 172.21.2.105:0/1362452571 learned_addr learned my addr 172.21.2.105:0/1362452571 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:41.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28d2fa700 1 -- 172.21.2.105:0/1362452571 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc2880b1160 msgr2=0x7fc288062620 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:45:41.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28d2fa700 1 --2- 172.21.2.105:0/1362452571 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc2880b1160 0x7fc288062620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:41.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28d2fa700 1 -- 172.21.2.105:0/1362452571 >> v2:172.21.2.115:3300/0 conn(0x7fc2880accc0 msgr2=0x7fc288063000 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:45:41.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28d2fa700 1 --2- 172.21.2.105:0/1362452571 >> v2:172.21.2.115:3300/0 conn(0x7fc2880accc0 0x7fc288063000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:41.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28d2fa700 1 -- 172.21.2.105:0/1362452571 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2880abd50 con 0x7fc2880ac7b0 2021-11-12T05:45:41.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28d2fa700 1 --2- 172.21.2.105:0/1362452571 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc2880ac7b0 0x7fc288062b10 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7fc278002f70 tx=0x7fc278006eb0).ready entity=mon.0 client_cookie=6cfd3b2f967e2245 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:41.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28caf9700 1 -- 172.21.2.105:0/1362452571 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc27800d570 con 0x7fc2880ac7b0 2021-11-12T05:45:41.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28caf9700 1 -- 172.21.2.105:0/1362452571 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc278000e90 con 0x7fc2880ac7b0 2021-11-12T05:45:41.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28caf9700 1 -- 172.21.2.105:0/1362452571 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc27800d900 con 0x7fc2880ac7b0 2021-11-12T05:45:41.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28fd5f700 1 -- 172.21.2.105:0/1362452571 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc2880ac7b0 msgr2=0x7fc288062b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:41.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28fd5f700 1 --2- 172.21.2.105:0/1362452571 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc2880ac7b0 0x7fc288062b10 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7fc278002f70 tx=0x7fc278006eb0).stop 2021-11-12T05:45:41.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28fd5f700 1 -- 172.21.2.105:0/1362452571 shutdown_connections 2021-11-12T05:45:41.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28fd5f700 1 --2- 172.21.2.105:0/1362452571 >> v2:172.21.2.115:3300/0 conn(0x7fc2880accc0 0x7fc288063000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:41.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28fd5f700 1 --2- 172.21.2.105:0/1362452571 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc2880ac7b0 0x7fc288062b10 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:41.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28fd5f700 1 --2- 172.21.2.105:0/1362452571 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc2880b1160 0x7fc288062620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:41.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28fd5f700 1 -- 172.21.2.105:0/1362452571 >> 172.21.2.105:0/1362452571 conn(0x7fc2880b5370 msgr2=0x7fc2880b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:41.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28fd5f700 1 -- 172.21.2.105:0/1362452571 shutdown_connections 2021-11-12T05:45:41.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28fd5f700 1 -- 172.21.2.105:0/1362452571 wait complete. 2021-11-12T05:45:41.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28fd5f700 1 Processor -- start 2021-11-12T05:45:41.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28fd5f700 1 -- start start 2021-11-12T05:45:41.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28fd5f700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc2880ac7b0 0x7fc28813eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:41.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28fd5f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc2880accc0 0x7fc288065980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:41.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28fd5f700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc2880b1160 0x7fc28813d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:41.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28fd5f700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc288140200 con 0x7fc2880ac7b0 2021-11-12T05:45:41.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28fd5f700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28813d9b0 con 0x7fc2880b1160 2021-11-12T05:45:41.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28fd5f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc28813ff60 con 0x7fc2880accc0 2021-11-12T05:45:41.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28dafb700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc2880ac7b0 0x7fc28813eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:41.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28dafb700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc2880ac7b0 0x7fc28813eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46556/0 (socket says 172.21.2.105:46556) 2021-11-12T05:45:41.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28dafb700 1 -- 172.21.2.105:0/660204931 learned_addr learned my addr 172.21.2.105:0/660204931 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:41.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28dafb700 1 -- 172.21.2.105:0/660204931 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc2880accc0 msgr2=0x7fc288065980 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:45:41.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28dafb700 1 --2- 172.21.2.105:0/660204931 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc2880accc0 0x7fc288065980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:41.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28dafb700 1 -- 172.21.2.105:0/660204931 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc2880b1160 msgr2=0x7fc28813d4c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:45:41.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28dafb700 1 --2- 172.21.2.105:0/660204931 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc2880b1160 0x7fc28813d4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:41.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28dafb700 1 -- 172.21.2.105:0/660204931 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27800b1e0 con 0x7fc2880ac7b0 2021-11-12T05:45:41.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28dafb700 1 --2- 172.21.2.105:0/660204931 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc2880ac7b0 0x7fc28813eed0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7fc284002ef0 tx=0x7fc284006d50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:41.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc276ffd700 1 -- 172.21.2.105:0/660204931 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc284012410 con 0x7fc2880ac7b0 2021-11-12T05:45:41.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc276ffd700 1 -- 172.21.2.105:0/660204931 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc284012570 con 0x7fc2880ac7b0 2021-11-12T05:45:41.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc276ffd700 1 -- 172.21.2.105:0/660204931 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2840128d0 con 0x7fc2880ac7b0 2021-11-12T05:45:41.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28fd5f700 1 -- 172.21.2.105:0/660204931 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc28815a710 con 0x7fc2880ac7b0 2021-11-12T05:45:41.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.012+0000 7fc28fd5f700 1 -- 172.21.2.105:0/660204931 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2880a02a0 con 0x7fc2880ac7b0 2021-11-12T05:45:41.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.016+0000 7fc28fd5f700 1 -- 172.21.2.105:0/660204931 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2880abff0 con 0x7fc2880ac7b0 2021-11-12T05:45:41.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.016+0000 7fc276ffd700 1 -- 172.21.2.105:0/660204931 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc28400f030 con 0x7fc2880ac7b0 2021-11-12T05:45:41.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.016+0000 7fc276ffd700 1 --2- 172.21.2.105:0/660204931 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc268053660 0x7fc268055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:41.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.016+0000 7fc276ffd700 1 -- 172.21.2.105:0/660204931 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fc28406b5d0 con 0x7fc2880ac7b0 2021-11-12T05:45:41.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.016+0000 7fc28d2fa700 1 --2- 172.21.2.105:0/660204931 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc268053660 0x7fc268055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:41.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.016+0000 7fc28d2fa700 1 --2- 172.21.2.105:0/660204931 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc268053660 0x7fc268055b20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7fc278002f70 tx=0x7fc278015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:41.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.016+0000 7fc276ffd700 1 -- 172.21.2.105:0/660204931 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc284042800 con 0x7fc2880ac7b0 2021-11-12T05:45:41.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.100+0000 7fc28fd5f700 1 -- 172.21.2.105:0/660204931 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc288057350 con 0x7fc2880ac7b0 2021-11-12T05:45:41.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.100+0000 7fc276ffd700 1 -- 172.21.2.105:0/660204931 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v61) v1 ==== 84+0+143 (secure 0 0 0) 0x7fc284045e20 con 0x7fc2880ac7b0 2021-11-12T05:45:41.106 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:45:41.106 INFO:teuthology.orchestra.run.gibba005.stdout:[ 2021-11-12T05:45:41.106 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:41.107 INFO:teuthology.orchestra.run.gibba005.stdout: "poolnum": 1, 2021-11-12T05:45:41.107 INFO:teuthology.orchestra.run.gibba005.stdout: "poolname": "device_health_metrics" 2021-11-12T05:45:41.107 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:45:41.107 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:45:41.108 INFO:teuthology.orchestra.run.gibba005.stdout: "poolnum": 2, 2021-11-12T05:45:41.108 INFO:teuthology.orchestra.run.gibba005.stdout: "poolname": "rbd" 2021-11-12T05:45:41.108 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:45:41.108 INFO:teuthology.orchestra.run.gibba005.stdout:] 2021-11-12T05:45:41.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.100+0000 7fc28fd5f700 1 -- 172.21.2.105:0/660204931 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc268053660 msgr2=0x7fc268055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:41.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.100+0000 7fc28fd5f700 1 --2- 172.21.2.105:0/660204931 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc268053660 0x7fc268055b20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7fc278002f70 tx=0x7fc278015000).stop 2021-11-12T05:45:41.110 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.100+0000 7fc28fd5f700 1 -- 172.21.2.105:0/660204931 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc2880ac7b0 msgr2=0x7fc28813eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:41.110 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.100+0000 7fc28fd5f700 1 --2- 172.21.2.105:0/660204931 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc2880ac7b0 0x7fc28813eed0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7fc284002ef0 tx=0x7fc284006d50).stop 2021-11-12T05:45:41.110 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.104+0000 7fc28fd5f700 1 -- 172.21.2.105:0/660204931 shutdown_connections 2021-11-12T05:45:41.110 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.104+0000 7fc28fd5f700 1 --2- 172.21.2.105:0/660204931 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc268053660 0x7fc268055b20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:41.110 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.104+0000 7fc28fd5f700 1 --2- 172.21.2.105:0/660204931 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc2880b1160 0x7fc28813d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:41.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.104+0000 7fc28fd5f700 1 --2- 172.21.2.105:0/660204931 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc2880accc0 0x7fc288065980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:41.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.104+0000 7fc28fd5f700 1 --2- 172.21.2.105:0/660204931 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc2880ac7b0 0x7fc28813eed0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:41.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.104+0000 7fc28fd5f700 1 -- 172.21.2.105:0/660204931 >> 172.21.2.105:0/660204931 conn(0x7fc2880b5370 msgr2=0x7fc2880b1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:41.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.104+0000 7fc28fd5f700 1 -- 172.21.2.105:0/660204931 shutdown_connections 2021-11-12T05:45:41.112 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.104+0000 7fc28fd5f700 1 -- 172.21.2.105:0/660204931 wait complete. 2021-11-12T05:45:41.113 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-12T05:45:41.113 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-12T05:45:41.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.164+0000 7f49c3478700 1 Processor -- start 2021-11-12T05:45:41.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.164+0000 7f49c3478700 1 -- start start 2021-11-12T05:45:41.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.164+0000 7f49c3478700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f49bc0626b0 0x7f49bc062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:41.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.164+0000 7f49c3478700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f49bc130a80 0x7f49bc1474d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:41.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.164+0000 7f49c3478700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49bc0b0d50 con 0x7f49bc0af750 2021-11-12T05:45:41.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.164+0000 7f49c3478700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49bc0ad380 con 0x7f49bc0626b0 2021-11-12T05:45:41.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.164+0000 7f49c3478700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49bc0ae190 con 0x7f49bc130a80 2021-11-12T05:45:41.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.164+0000 7f49c1214700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f49bc0626b0 0x7f49bc062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:41.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.164+0000 7f49c1214700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f49bc0626b0 0x7f49bc062a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46564/0 (socket says 172.21.2.105:46564) 2021-11-12T05:45:41.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.164+0000 7f49c1214700 1 -- 172.21.2.105:0/3456189633 learned_addr learned my addr 172.21.2.105:0/3456189633 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:41.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.164+0000 7f49c1214700 1 -- 172.21.2.105:0/3456189633 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f49bc130a80 msgr2=0x7f49bc1474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:41.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.164+0000 7f49c1214700 1 --2- 172.21.2.105:0/3456189633 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f49bc130a80 0x7f49bc1474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:41.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.164+0000 7f49c1214700 1 -- 172.21.2.105:0/3456189633 >> v1:172.21.2.115:6789/0 conn(0x7f49bc0af750 legacy=0x7f49bc130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:41.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.164+0000 7f49c1214700 1 -- 172.21.2.105:0/3456189633 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49bc1479c0 con 0x7f49bc0626b0 2021-11-12T05:45:41.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.164+0000 7f49c1214700 1 --2- 172.21.2.105:0/3456189633 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f49bc0626b0 0x7f49bc062a90 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7f49bc05d1b0 tx=0x7f49b8006eb0).ready entity=mon.0 client_cookie=58d97830f75f32e6 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:41.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.164+0000 7f49abfff700 1 -- 172.21.2.105:0/3456189633 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49b800d570 con 0x7f49bc0626b0 2021-11-12T05:45:41.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.164+0000 7f49abfff700 1 -- 172.21.2.105:0/3456189633 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b8000e90 con 0x7f49bc0626b0 2021-11-12T05:45:41.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.164+0000 7f49abfff700 1 -- 172.21.2.105:0/3456189633 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49b800d8c0 con 0x7f49bc0626b0 2021-11-12T05:45:41.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.164+0000 7f49c3478700 1 -- 172.21.2.105:0/3456189633 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f49bc0626b0 msgr2=0x7f49bc062a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:41.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.164+0000 7f49c3478700 1 --2- 172.21.2.105:0/3456189633 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f49bc0626b0 0x7f49bc062a90 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7f49bc05d1b0 tx=0x7f49b8006eb0).stop 2021-11-12T05:45:41.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.164+0000 7f49c3478700 1 -- 172.21.2.105:0/3456189633 shutdown_connections 2021-11-12T05:45:41.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.164+0000 7f49c3478700 1 --2- 172.21.2.105:0/3456189633 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f49bc130a80 0x7f49bc1474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:41.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.164+0000 7f49c3478700 1 --2- 172.21.2.105:0/3456189633 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f49bc0626b0 0x7f49bc062a90 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:41.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.164+0000 7f49c3478700 1 -- 172.21.2.105:0/3456189633 >> 172.21.2.105:0/3456189633 conn(0x7f49bc0b5320 msgr2=0x7f49bc0b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:41.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.164+0000 7f49c3478700 1 -- 172.21.2.105:0/3456189633 shutdown_connections 2021-11-12T05:45:41.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.164+0000 7f49c3478700 1 -- 172.21.2.105:0/3456189633 wait complete. 2021-11-12T05:45:41.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.164+0000 7f49c3478700 1 Processor -- start 2021-11-12T05:45:41.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.168+0000 7f49c3478700 1 -- start start 2021-11-12T05:45:41.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.168+0000 7f49c3478700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f49bc0626b0 0x7f49bc14bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:41.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.168+0000 7f49c3478700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f49bc0af750 0x7f49bc15a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:41.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.168+0000 7f49c3478700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f49bc130a80 0x7f49bc15a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:41.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.168+0000 7f49c3478700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49bc066ea0 con 0x7f49bc0626b0 2021-11-12T05:45:41.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.168+0000 7f49c3478700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49bc146470 con 0x7f49bc130a80 2021-11-12T05:45:41.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.168+0000 7f49c3478700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49bc066bc0 con 0x7f49bc0af750 2021-11-12T05:45:41.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.168+0000 7f49c1214700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f49bc0626b0 0x7f49bc14bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:41.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.168+0000 7f49c1214700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f49bc0626b0 0x7f49bc14bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46570/0 (socket says 172.21.2.105:46570) 2021-11-12T05:45:41.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.168+0000 7f49c1214700 1 -- 172.21.2.105:0/403034057 learned_addr learned my addr 172.21.2.105:0/403034057 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:41.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.168+0000 7f49c1a15700 1 --2- 172.21.2.105:0/403034057 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f49bc130a80 0x7f49bc15a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:41.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.168+0000 7f49c0a13700 1 --2- 172.21.2.105:0/403034057 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f49bc0af750 0x7f49bc15a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:41.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.168+0000 7f49c1214700 1 -- 172.21.2.105:0/403034057 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f49bc0af750 msgr2=0x7f49bc15a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:41.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.168+0000 7f49c1214700 1 --2- 172.21.2.105:0/403034057 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f49bc0af750 0x7f49bc15a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:41.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.168+0000 7f49c1214700 1 -- 172.21.2.105:0/403034057 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f49bc130a80 msgr2=0x7f49bc15a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:41.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.168+0000 7f49c1214700 1 --2- 172.21.2.105:0/403034057 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f49bc130a80 0x7f49bc15a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:41.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.168+0000 7f49c1214700 1 -- 172.21.2.105:0/403034057 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b800b1e0 con 0x7f49bc0626b0 2021-11-12T05:45:41.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.168+0000 7f49c1214700 1 --2- 172.21.2.105:0/403034057 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f49bc0626b0 0x7f49bc14bf10 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f49bc05d1b0 tx=0x7f49b8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:41.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.168+0000 7f49aa7fc700 1 -- 172.21.2.105:0/403034057 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49b80118e0 con 0x7f49bc0626b0 2021-11-12T05:45:41.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.168+0000 7f49aa7fc700 1 -- 172.21.2.105:0/403034057 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b8011a40 con 0x7f49bc0626b0 2021-11-12T05:45:41.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.168+0000 7f49c3478700 1 -- 172.21.2.105:0/403034057 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49bc15aa90 con 0x7f49bc0626b0 2021-11-12T05:45:41.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.168+0000 7f49c3478700 1 -- 172.21.2.105:0/403034057 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49bc063ee0 con 0x7f49bc0626b0 2021-11-12T05:45:41.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.168+0000 7f49aa7fc700 1 -- 172.21.2.105:0/403034057 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49b8011da0 con 0x7f49bc0626b0 2021-11-12T05:45:41.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.168+0000 7f49c3478700 1 -- 172.21.2.105:0/403034057 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49bc147220 con 0x7f49bc0626b0 2021-11-12T05:45:41.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.168+0000 7f49aa7fc700 1 -- 172.21.2.105:0/403034057 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f49b8025030 con 0x7f49bc0626b0 2021-11-12T05:45:41.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.168+0000 7f49aa7fc700 1 --2- 172.21.2.105:0/403034057 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f499c053690 0x7f499c055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:41.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.168+0000 7f49aa7fc700 1 -- 172.21.2.105:0/403034057 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f49b806cb90 con 0x7f49bc0626b0 2021-11-12T05:45:41.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.168+0000 7f49c0a13700 1 --2- 172.21.2.105:0/403034057 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f499c053690 0x7f499c055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:41.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.168+0000 7f49c0a13700 1 --2- 172.21.2.105:0/403034057 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f499c053690 0x7f499c055b50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f49ac00a000 tx=0x7f49ac008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:41.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.172+0000 7f49aa7fc700 1 -- 172.21.2.105:0/403034057 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f49b8043ed0 con 0x7f49bc0626b0 2021-11-12T05:45:41.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:41.256+0000 7f49c3478700 1 -- 172.21.2.105:0/403034057 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f49bc057350 con 0x7f49bc0626b0 2021-11-12T05:45:42.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.152+0000 7f49aa7fc700 1 -- 172.21.2.105:0/403034057 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v62) v1 ==== 133+0+0 (secure 0 0 0) 0x7f49b80474f0 con 0x7f49bc0626b0 2021-11-12T05:45:42.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.152+0000 7f49c3478700 1 -- 172.21.2.105:0/403034057 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f499c053690 msgr2=0x7f499c055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:42.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.152+0000 7f49c3478700 1 --2- 172.21.2.105:0/403034057 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f499c053690 0x7f499c055b50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f49ac00a000 tx=0x7f49ac008040).stop 2021-11-12T05:45:42.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.152+0000 7f49c3478700 1 -- 172.21.2.105:0/403034057 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f49bc0626b0 msgr2=0x7f49bc14bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:42.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.152+0000 7f49c3478700 1 --2- 172.21.2.105:0/403034057 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f49bc0626b0 0x7f49bc14bf10 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f49bc05d1b0 tx=0x7f49b8015000).stop 2021-11-12T05:45:42.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.152+0000 7f49c3478700 1 -- 172.21.2.105:0/403034057 shutdown_connections 2021-11-12T05:45:42.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.152+0000 7f49c3478700 1 --2- 172.21.2.105:0/403034057 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f499c053690 0x7f499c055b50 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:42.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.152+0000 7f49c3478700 1 --2- 172.21.2.105:0/403034057 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f49bc130a80 0x7f49bc15a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:42.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.152+0000 7f49c3478700 1 --2- 172.21.2.105:0/403034057 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f49bc0af750 0x7f49bc15a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:42.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.152+0000 7f49c3478700 1 --2- 172.21.2.105:0/403034057 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f49bc0626b0 0x7f49bc14bf10 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:42.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.152+0000 7f49c3478700 1 -- 172.21.2.105:0/403034057 >> 172.21.2.105:0/403034057 conn(0x7f49bc0b5320 msgr2=0x7f49bc0b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:42.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.152+0000 7f49c3478700 1 -- 172.21.2.105:0/403034057 shutdown_connections 2021-11-12T05:45:42.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.152+0000 7f49c3478700 1 -- 172.21.2.105:0/403034057 wait complete. 2021-11-12T05:45:42.161 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_metadata' created 2021-11-12T05:45:42.164 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-11-12T05:45:42.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.212+0000 7fe19fcf9700 1 Processor -- start 2021-11-12T05:45:42.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.212+0000 7fe19fcf9700 1 -- start start 2021-11-12T05:45:42.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.212+0000 7fe19fcf9700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe1980aca40 0x7fe1980ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:42.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.212+0000 7fe19fcf9700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1980b1840 con 0x7fe198144180 2021-11-12T05:45:42.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.212+0000 7fe19fcf9700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1980af2b0 con 0x7fe1980b0520 2021-11-12T05:45:42.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.212+0000 7fe19fcf9700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1980b09a0 con 0x7fe1980aca40 2021-11-12T05:45:42.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.212+0000 7fe19e296700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fe198144180 0x7fe198144610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:56978/0 (socket says 172.21.2.105:56978) 2021-11-12T05:45:42.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.212+0000 7fe19e296700 1 -- 172.21.2.105:0/2763207287 learned_addr learned my addr 172.21.2.105:0/2763207287 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:45:42.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.212+0000 7fe19da95700 1 --2- 172.21.2.105:0/2763207287 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe1980aca40 0x7fe1980ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:42.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.212+0000 7fe19ca93700 1 -- 172.21.2.105:0/2763207287 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1567763015 0 0) 0x7fe1980b1840 con 0x7fe198144180 2021-11-12T05:45:42.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.212+0000 7fe19ca93700 1 -- 172.21.2.105:0/2763207287 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe180003260 con 0x7fe198144180 2021-11-12T05:45:42.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19ca93700 1 -- 172.21.2.105:0/2763207287 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 121396777 0 0) 0x7fe180003260 con 0x7fe198144180 2021-11-12T05:45:42.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19ca93700 1 -- 172.21.2.105:0/2763207287 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe1980aca40 msgr2=0x7fe1980ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:42.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19ca93700 1 --2- 172.21.2.105:0/2763207287 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe1980aca40 0x7fe1980ace20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:42.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19ca93700 1 -- 172.21.2.105:0/2763207287 >> v1:172.21.2.115:6789/0 conn(0x7fe1980b0520 legacy=0x7fe1981473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:42.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19ca93700 1 -- 172.21.2.105:0/2763207287 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1980b1a70 con 0x7fe198144180 2021-11-12T05:45:42.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19ca93700 1 -- 172.21.2.105:0/2763207287 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fe1900019e0 con 0x7fe198144180 2021-11-12T05:45:42.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19ca93700 1 -- 172.21.2.105:0/2763207287 >> v1:172.21.2.105:6789/0 conn(0x7fe198144180 legacy=0x7fe198144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:42.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19ca93700 1 --2- 172.21.2.105:0/2763207287 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe180003780 0x7fe180003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:42.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19ca93700 1 --2- 172.21.2.105:0/2763207287 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe180004500 0x7fe180004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:42.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19ca93700 1 --2- 172.21.2.105:0/2763207287 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe180004e70 0x7fe18000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:42.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19ca93700 1 -- 172.21.2.105:0/2763207287 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1980b09a0 con 0x7fe180003780 2021-11-12T05:45:42.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19ca93700 1 -- 172.21.2.105:0/2763207287 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18000bd20 con 0x7fe180004e70 2021-11-12T05:45:42.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19ca93700 1 -- 172.21.2.105:0/2763207287 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe18000bee0 con 0x7fe180004500 2021-11-12T05:45:42.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19da95700 1 --2- 172.21.2.105:0/2763207287 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe1980aca40 0x7fe1980ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:45:42.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19da95700 1 --2- 172.21.2.105:0/2763207287 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe180003780 0x7fe180003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:42.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19e296700 1 --2- 172.21.2.105:0/2763207287 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe180004e70 0x7fe18000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:42.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19d294700 1 --2- 172.21.2.105:0/2763207287 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe180004500 0x7fe180004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:42.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19da95700 1 -- 172.21.2.105:0/2763207287 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe180004500 msgr2=0x7fe180004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:42.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19da95700 1 --2- 172.21.2.105:0/2763207287 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe180004500 0x7fe180004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:42.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19da95700 1 -- 172.21.2.105:0/2763207287 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe180004e70 msgr2=0x7fe18000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:42.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19da95700 1 --2- 172.21.2.105:0/2763207287 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe180004e70 0x7fe18000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:42.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19da95700 1 -- 172.21.2.105:0/2763207287 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe180003260 con 0x7fe180003780 2021-11-12T05:45:42.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19da95700 1 --2- 172.21.2.105:0/2763207287 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe180003780 0x7fe180003bc0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7fe19400a000 tx=0x7fe194008040).ready entity=mon.0 client_cookie=322d30ee211aa590 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:42.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19ca93700 1 -- 172.21.2.105:0/2763207287 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe194013670 con 0x7fe180003780 2021-11-12T05:45:42.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19ca93700 1 -- 172.21.2.105:0/2763207287 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1940137d0 con 0x7fe180003780 2021-11-12T05:45:42.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19ca93700 1 -- 172.21.2.105:0/2763207287 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe194013b30 con 0x7fe180003780 2021-11-12T05:45:42.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19fcf9700 1 -- 172.21.2.105:0/2763207287 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe180003780 msgr2=0x7fe180003bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:42.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19fcf9700 1 --2- 172.21.2.105:0/2763207287 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe180003780 0x7fe180003bc0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7fe19400a000 tx=0x7fe194008040).stop 2021-11-12T05:45:42.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19e296700 1 -- 172.21.2.105:0/2763207287 reap_dead start 2021-11-12T05:45:42.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19fcf9700 1 -- 172.21.2.105:0/2763207287 shutdown_connections 2021-11-12T05:45:42.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19fcf9700 1 -- 172.21.2.105:0/2763207287 >> 172.21.2.105:0/2763207287 conn(0x7fe19805c490 msgr2=0x7fe1980b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:42.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19fcf9700 1 -- 172.21.2.105:0/2763207287 shutdown_connections 2021-11-12T05:45:42.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19fcf9700 1 -- 172.21.2.105:0/2763207287 wait complete. 2021-11-12T05:45:42.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19fcf9700 1 Processor -- start 2021-11-12T05:45:42.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19fcf9700 1 -- start start 2021-11-12T05:45:42.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19fcf9700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe180003780 0x7fe1980a7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:42.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19fcf9700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe1980a7510 0x7fe1980a7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:42.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19fcf9700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe19814ecd0 0x7fe1980a7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:42.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19fcf9700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1980a9bb0 con 0x7fe1980a7510 2021-11-12T05:45:42.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19fcf9700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1980a9e50 con 0x7fe180003780 2021-11-12T05:45:42.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19fcf9700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1980a84d0 con 0x7fe19814ecd0 2021-11-12T05:45:42.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19d294700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe1980a7510 0x7fe1980a7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:42.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19d294700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe1980a7510 0x7fe1980a7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46592/0 (socket says 172.21.2.105:46592) 2021-11-12T05:45:42.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19d294700 1 -- 172.21.2.105:0/2401923284 learned_addr learned my addr 172.21.2.105:0/2401923284 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:42.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19da95700 1 --2- 172.21.2.105:0/2401923284 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe180003780 0x7fe1980a7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:42.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19d294700 1 -- 172.21.2.105:0/2401923284 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe19814ecd0 msgr2=0x7fe1980a7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:42.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19e296700 1 --2- 172.21.2.105:0/2401923284 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe19814ecd0 0x7fe1980a7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:42.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19d294700 1 --2- 172.21.2.105:0/2401923284 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe19814ecd0 0x7fe1980a7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:42.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19d294700 1 -- 172.21.2.105:0/2401923284 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe180003780 msgr2=0x7fe1980a7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:42.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19d294700 1 --2- 172.21.2.105:0/2401923284 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe180003780 0x7fe1980a7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:42.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19d294700 1 -- 172.21.2.105:0/2401923284 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19814e510 con 0x7fe1980a7510 2021-11-12T05:45:42.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19e296700 1 --2- 172.21.2.105:0/2401923284 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe19814ecd0 0x7fe1980a7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:45:42.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19d294700 1 --2- 172.21.2.105:0/2401923284 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe1980a7510 0x7fe1980a7af0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7fe18c00b000 tx=0x7fe18c009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:42.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe18affd700 1 -- 172.21.2.105:0/2401923284 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe18c010640 con 0x7fe1980a7510 2021-11-12T05:45:42.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe18affd700 1 -- 172.21.2.105:0/2401923284 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18c0107a0 con 0x7fe1980a7510 2021-11-12T05:45:42.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe18affd700 1 -- 172.21.2.105:0/2401923284 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe18c010b00 con 0x7fe1980a7510 2021-11-12T05:45:42.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19fcf9700 1 -- 172.21.2.105:0/2401923284 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe198159d60 con 0x7fe1980a7510 2021-11-12T05:45:42.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19fcf9700 1 -- 172.21.2.105:0/2401923284 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe19815a210 con 0x7fe1980a7510 2021-11-12T05:45:42.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe19fcf9700 1 -- 172.21.2.105:0/2401923284 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1980a9a00 con 0x7fe1980a7510 2021-11-12T05:45:42.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe18affd700 1 -- 172.21.2.105:0/2401923284 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe18c010c60 con 0x7fe1980a7510 2021-11-12T05:45:42.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe18affd700 1 --2- 172.21.2.105:0/2401923284 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe1780535b0 0x7fe178055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:42.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.216+0000 7fe18affd700 1 -- 172.21.2.105:0/2401923284 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5950+0+0 (secure 0 0 0) 0x7fe18c06b900 con 0x7fe1980a7510 2021-11-12T05:45:42.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.220+0000 7fe19da95700 1 --2- 172.21.2.105:0/2401923284 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe1780535b0 0x7fe178055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:42.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.220+0000 7fe19da95700 1 --2- 172.21.2.105:0/2401923284 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe1780535b0 0x7fe178055a70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7fe194019000 tx=0x7fe194008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:42.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.220+0000 7fe18affd700 1 -- 172.21.2.105:0/2401923284 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe18c042970 con 0x7fe1980a7510 2021-11-12T05:45:42.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:42.304+0000 7fe19fcf9700 1 -- 172.21.2.105:0/2401923284 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fe198057350 con 0x7fe1980a7510 2021-11-12T05:45:43.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.164+0000 7fe18affd700 1 -- 172.21.2.105:0/2401923284 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v63) v1 ==== 125+0+0 (secure 0 0 0) 0x7fe18c045f90 con 0x7fe1980a7510 2021-11-12T05:45:43.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.164+0000 7fe19fcf9700 1 -- 172.21.2.105:0/2401923284 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe1780535b0 msgr2=0x7fe178055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:43.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.164+0000 7fe19fcf9700 1 --2- 172.21.2.105:0/2401923284 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe1780535b0 0x7fe178055a70 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7fe194019000 tx=0x7fe194008040).stop 2021-11-12T05:45:43.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.164+0000 7fe19fcf9700 1 -- 172.21.2.105:0/2401923284 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe1980a7510 msgr2=0x7fe1980a7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:43.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.164+0000 7fe19fcf9700 1 --2- 172.21.2.105:0/2401923284 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe1980a7510 0x7fe1980a7af0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7fe18c00b000 tx=0x7fe18c009040).stop 2021-11-12T05:45:43.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.164+0000 7fe19fcf9700 1 -- 172.21.2.105:0/2401923284 shutdown_connections 2021-11-12T05:45:43.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.164+0000 7fe19fcf9700 1 --2- 172.21.2.105:0/2401923284 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe1780535b0 0x7fe178055a70 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:43.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.164+0000 7fe19fcf9700 1 --2- 172.21.2.105:0/2401923284 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe19814ecd0 0x7fe1980a7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:43.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.164+0000 7fe19fcf9700 1 --2- 172.21.2.105:0/2401923284 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe1980a7510 0x7fe1980a7af0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:43.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.164+0000 7fe19fcf9700 1 --2- 172.21.2.105:0/2401923284 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe180003780 0x7fe1980a7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:43.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.164+0000 7fe19fcf9700 1 -- 172.21.2.105:0/2401923284 >> 172.21.2.105:0/2401923284 conn(0x7fe19805c490 msgr2=0x7fe1980b2450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:43.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.164+0000 7fe19fcf9700 1 -- 172.21.2.105:0/2401923284 shutdown_connections 2021-11-12T05:45:43.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.164+0000 7fe19fcf9700 1 -- 172.21.2.105:0/2401923284 wait complete. 2021-11-12T05:45:43.173 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_data' created 2021-11-12T05:45:43.176 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-12T05:45:43.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.228+0000 7fdb79c65700 1 Processor -- start 2021-11-12T05:45:43.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.228+0000 7fdb79c65700 1 -- start start 2021-11-12T05:45:43.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.228+0000 7fdb79c65700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fdb740ad080 0x7fdb740af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:43.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.228+0000 7fdb79c65700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fdb7414b2f0 0x7fdb740ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:43.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.228+0000 7fdb79c65700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb740ac7b0 con 0x7fdb740ac280 2021-11-12T05:45:43.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.228+0000 7fdb79c65700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb741488a0 con 0x7fdb740ad080 2021-11-12T05:45:43.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.228+0000 7fdb79c65700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb740ac9e0 con 0x7fdb7414b2f0 2021-11-12T05:45:43.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.228+0000 7fdb737fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fdb740ad080 0x7fdb740af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:43.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.228+0000 7fdb737fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fdb740ad080 0x7fdb740af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46598/0 (socket says 172.21.2.105:46598) 2021-11-12T05:45:43.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.228+0000 7fdb737fe700 1 -- 172.21.2.105:0/3551524155 learned_addr learned my addr 172.21.2.105:0/3551524155 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:43.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.228+0000 7fdb737fe700 1 -- 172.21.2.105:0/3551524155 >> v2:172.21.2.115:3300/0 conn(0x7fdb7414b2f0 msgr2=0x7fdb740ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:43.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.228+0000 7fdb737fe700 1 --2- 172.21.2.105:0/3551524155 >> v2:172.21.2.115:3300/0 conn(0x7fdb7414b2f0 0x7fdb740ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:43.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.228+0000 7fdb737fe700 1 -- 172.21.2.105:0/3551524155 >> v1:172.21.2.115:6789/0 conn(0x7fdb740ac280 legacy=0x7fdb7414abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:43.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.228+0000 7fdb737fe700 1 -- 172.21.2.105:0/3551524155 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb740b0b30 con 0x7fdb740ad080 2021-11-12T05:45:43.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.228+0000 7fdb737fe700 1 --2- 172.21.2.105:0/3551524155 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdb740ad080 0x7fdb740af730 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7fdb740b06e0 tx=0x7fdb64006eb0).ready entity=mon.0 client_cookie=cd52be17b1345c64 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:43.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.228+0000 7fdb727fc700 1 -- 172.21.2.105:0/3551524155 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb6400d5c0 con 0x7fdb740ad080 2021-11-12T05:45:43.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.228+0000 7fdb727fc700 1 -- 172.21.2.105:0/3551524155 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb64000e90 con 0x7fdb740ad080 2021-11-12T05:45:43.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.228+0000 7fdb727fc700 1 -- 172.21.2.105:0/3551524155 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb6400d910 con 0x7fdb740ad080 2021-11-12T05:45:43.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.232+0000 7fdb79c65700 1 -- 172.21.2.105:0/3551524155 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdb740ad080 msgr2=0x7fdb740af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:43.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.232+0000 7fdb79c65700 1 --2- 172.21.2.105:0/3551524155 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdb740ad080 0x7fdb740af730 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7fdb740b06e0 tx=0x7fdb64006eb0).stop 2021-11-12T05:45:43.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.232+0000 7fdb79c65700 1 -- 172.21.2.105:0/3551524155 shutdown_connections 2021-11-12T05:45:43.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.232+0000 7fdb79c65700 1 --2- 172.21.2.105:0/3551524155 >> v2:172.21.2.115:3300/0 conn(0x7fdb7414b2f0 0x7fdb740ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:43.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.232+0000 7fdb79c65700 1 --2- 172.21.2.105:0/3551524155 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdb740ad080 0x7fdb740af730 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:43.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.232+0000 7fdb79c65700 1 -- 172.21.2.105:0/3551524155 >> 172.21.2.105:0/3551524155 conn(0x7fdb740b5370 msgr2=0x7fdb740b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:43.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.232+0000 7fdb79c65700 1 -- 172.21.2.105:0/3551524155 shutdown_connections 2021-11-12T05:45:43.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.232+0000 7fdb79c65700 1 -- 172.21.2.105:0/3551524155 wait complete. 2021-11-12T05:45:43.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.232+0000 7fdb79c65700 1 Processor -- start 2021-11-12T05:45:43.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.232+0000 7fdb79c65700 1 -- start start 2021-11-12T05:45:43.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.232+0000 7fdb79c65700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdb740ac280 0x7fdb740ab640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:43.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.232+0000 7fdb79c65700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdb740ad080 0x7fdb74066b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:43.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.232+0000 7fdb79c65700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdb7414b2f0 0x7fdb74067000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:43.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.232+0000 7fdb79c65700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb740674f0 con 0x7fdb740ad080 2021-11-12T05:45:43.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.232+0000 7fdb79c65700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb740a9ba0 con 0x7fdb7414b2f0 2021-11-12T05:45:43.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.232+0000 7fdb79c65700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb740a9d20 con 0x7fdb740ac280 2021-11-12T05:45:43.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.232+0000 7fdb72ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdb740ad080 0x7fdb74066b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:43.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.232+0000 7fdb72ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdb740ad080 0x7fdb74066b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46606/0 (socket says 172.21.2.105:46606) 2021-11-12T05:45:43.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.232+0000 7fdb72ffd700 1 -- 172.21.2.105:0/436363005 learned_addr learned my addr 172.21.2.105:0/436363005 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:43.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.232+0000 7fdb72ffd700 1 -- 172.21.2.105:0/436363005 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdb740ac280 msgr2=0x7fdb740ab640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:43.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.232+0000 7fdb72ffd700 1 --2- 172.21.2.105:0/436363005 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdb740ac280 0x7fdb740ab640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:43.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.232+0000 7fdb72ffd700 1 -- 172.21.2.105:0/436363005 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdb7414b2f0 msgr2=0x7fdb74067000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:43.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.232+0000 7fdb73fff700 1 --2- 172.21.2.105:0/436363005 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdb7414b2f0 0x7fdb74067000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:43.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.232+0000 7fdb72ffd700 1 --2- 172.21.2.105:0/436363005 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdb7414b2f0 0x7fdb74067000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:43.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.232+0000 7fdb72ffd700 1 -- 172.21.2.105:0/436363005 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb6400b1e0 con 0x7fdb740ad080 2021-11-12T05:45:43.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.232+0000 7fdb72ffd700 1 --2- 172.21.2.105:0/436363005 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdb740ad080 0x7fdb74066b10 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7fdb5c002f90 tx=0x7fdb5c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:43.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.232+0000 7fdb70ff9700 1 -- 172.21.2.105:0/436363005 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb5c013460 con 0x7fdb740ad080 2021-11-12T05:45:43.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.232+0000 7fdb70ff9700 1 -- 172.21.2.105:0/436363005 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5c0135c0 con 0x7fdb740ad080 2021-11-12T05:45:43.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.232+0000 7fdb79c65700 1 -- 172.21.2.105:0/436363005 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb74063620 con 0x7fdb740ad080 2021-11-12T05:45:43.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.232+0000 7fdb79c65700 1 -- 172.21.2.105:0/436363005 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb740aaa30 con 0x7fdb740ad080 2021-11-12T05:45:43.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.232+0000 7fdb70ff9700 1 -- 172.21.2.105:0/436363005 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb5c013920 con 0x7fdb740ad080 2021-11-12T05:45:43.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.232+0000 7fdb79c65700 1 -- 172.21.2.105:0/436363005 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb4c003410 con 0x7fdb740ad080 2021-11-12T05:45:43.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.232+0000 7fdb70ff9700 1 -- 172.21.2.105:0/436363005 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdb5c01a060 con 0x7fdb740ad080 2021-11-12T05:45:43.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.232+0000 7fdb70ff9700 1 --2- 172.21.2.105:0/436363005 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdb58053690 0x7fdb58055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:43.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.232+0000 7fdb70ff9700 1 -- 172.21.2.105:0/436363005 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6300+0+0 (secure 0 0 0) 0x7fdb5c06b400 con 0x7fdb740ad080 2021-11-12T05:45:43.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.236+0000 7fdb737fe700 1 --2- 172.21.2.105:0/436363005 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdb58053690 0x7fdb58055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:43.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.236+0000 7fdb737fe700 1 --2- 172.21.2.105:0/436363005 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdb58053690 0x7fdb58055b50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7fdb740b06e0 tx=0x7fdb64015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:43.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.236+0000 7fdb70ff9700 1 -- 172.21.2.105:0/436363005 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdb5c042310 con 0x7fdb740ad080 2021-11-12T05:45:43.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.344+0000 7fdb79c65700 1 -- 172.21.2.105:0/436363005 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fdb4c003c40 con 0x7fdb740ad080 2021-11-12T05:45:43.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.352+0000 7fdb70ff9700 1 -- 172.21.2.105:0/436363005 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 11 and data pool 12 v24) v1 ==== 189+0+0 (secure 0 0 0) 0x7fdb5c0180d0 con 0x7fdb740ad080 2021-11-12T05:45:43.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.352+0000 7fdb79c65700 1 -- 172.21.2.105:0/436363005 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdb58053690 msgr2=0x7fdb58055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:43.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.352+0000 7fdb79c65700 1 --2- 172.21.2.105:0/436363005 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdb58053690 0x7fdb58055b50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7fdb740b06e0 tx=0x7fdb64015000).stop 2021-11-12T05:45:43.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.352+0000 7fdb79c65700 1 -- 172.21.2.105:0/436363005 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdb740ad080 msgr2=0x7fdb74066b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:43.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.352+0000 7fdb79c65700 1 --2- 172.21.2.105:0/436363005 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdb740ad080 0x7fdb74066b10 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7fdb5c002f90 tx=0x7fdb5c006df0).stop 2021-11-12T05:45:43.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.352+0000 7fdb79c65700 1 -- 172.21.2.105:0/436363005 shutdown_connections 2021-11-12T05:45:43.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.352+0000 7fdb79c65700 1 --2- 172.21.2.105:0/436363005 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdb58053690 0x7fdb58055b50 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:43.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.352+0000 7fdb79c65700 1 --2- 172.21.2.105:0/436363005 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdb7414b2f0 0x7fdb74067000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:43.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.352+0000 7fdb79c65700 1 --2- 172.21.2.105:0/436363005 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdb740ad080 0x7fdb74066b10 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:43.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.352+0000 7fdb79c65700 1 --2- 172.21.2.105:0/436363005 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdb740ac280 0x7fdb740ab640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:43.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.352+0000 7fdb79c65700 1 -- 172.21.2.105:0/436363005 >> 172.21.2.105:0/436363005 conn(0x7fdb740b5370 msgr2=0x7fdb7414aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:43.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.352+0000 7fdb79c65700 1 -- 172.21.2.105:0/436363005 shutdown_connections 2021-11-12T05:45:43.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.352+0000 7fdb79c65700 1 -- 172.21.2.105:0/436363005 wait complete. 2021-11-12T05:45:43.360 INFO:teuthology.orchestra.run.gibba005.stderr:new fs with metadata pool 11 and data pool 12 2021-11-12T05:45:43.364 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:45:43.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.408+0000 7f4f93e6a700 1 Processor -- start 2021-11-12T05:45:43.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.408+0000 7f4f93e6a700 1 -- start start 2021-11-12T05:45:43.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f93e6a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4f8c0ad080 0x7f4f8c0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:43.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f93e6a700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f4f8c14b2f0 0x7f4f8c0ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:43.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f93e6a700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f8c0ac7b0 con 0x7f4f8c0ac280 2021-11-12T05:45:43.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f93e6a700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f8c1488a0 con 0x7f4f8c14b2f0 2021-11-12T05:45:43.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f93e6a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c0ac9e0 con 0x7f4f8c0ad080 2021-11-12T05:45:43.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f91405700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f4f8c0ac280 0x7f4f8c14abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57020/0 (socket says 172.21.2.105:57020) 2021-11-12T05:45:43.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f91405700 1 -- 172.21.2.105:0/1589722207 learned_addr learned my addr 172.21.2.105:0/1589722207 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:45:43.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f92407700 1 --2- 172.21.2.105:0/1589722207 >> v2:172.21.2.105:3300/0 conn(0x7f4f8c14b2f0 0x7f4f8c0ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:43.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f90c04700 1 -- 172.21.2.105:0/1589722207 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2992495769 0 0) 0x7f4f8c0ac7b0 con 0x7f4f8c0ac280 2021-11-12T05:45:43.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f90c04700 1 -- 172.21.2.105:0/1589722207 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f70003260 con 0x7f4f8c0ac280 2021-11-12T05:45:43.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f92407700 1 -- 172.21.2.105:0/1589722207 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4f8c0ad080 msgr2=0x7f4f8c0af730 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:45:43.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f92407700 1 --2- 172.21.2.105:0/1589722207 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4f8c0ad080 0x7f4f8c0af730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:43.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f92407700 1 -- 172.21.2.105:0/1589722207 >> v1:172.21.2.105:6789/0 conn(0x7f4f8c0ac280 legacy=0x7f4f8c14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:43.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f92407700 1 -- 172.21.2.105:0/1589722207 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f8c0b0b30 con 0x7f4f8c14b2f0 2021-11-12T05:45:43.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f92407700 1 --2- 172.21.2.105:0/1589722207 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4f8c14b2f0 0x7f4f8c0ad460 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f4f8c0ac6a0 tx=0x7f4f840091d0).ready entity=mon.0 client_cookie=36083caad56dc527 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:43.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f90c04700 1 -- 172.21.2.105:0/1589722207 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f8400b680 con 0x7f4f8c14b2f0 2021-11-12T05:45:43.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f90c04700 1 -- 172.21.2.105:0/1589722207 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8400b7e0 con 0x7f4f8c14b2f0 2021-11-12T05:45:43.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f90c04700 1 -- 172.21.2.105:0/1589722207 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f8400b990 con 0x7f4f8c14b2f0 2021-11-12T05:45:43.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f93e6a700 1 -- 172.21.2.105:0/1589722207 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4f8c14b2f0 msgr2=0x7f4f8c0ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:43.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f93e6a700 1 --2- 172.21.2.105:0/1589722207 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4f8c14b2f0 0x7f4f8c0ad460 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f4f8c0ac6a0 tx=0x7f4f840091d0).stop 2021-11-12T05:45:43.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f93e6a700 1 -- 172.21.2.105:0/1589722207 shutdown_connections 2021-11-12T05:45:43.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f93e6a700 1 --2- 172.21.2.105:0/1589722207 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4f8c14b2f0 0x7f4f8c0ad460 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:43.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f93e6a700 1 --2- 172.21.2.105:0/1589722207 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4f8c0ad080 0x7f4f8c0af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:43.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f93e6a700 1 -- 172.21.2.105:0/1589722207 >> 172.21.2.105:0/1589722207 conn(0x7f4f8c0b5370 msgr2=0x7f4f8c0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:43.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f93e6a700 1 -- 172.21.2.105:0/1589722207 shutdown_connections 2021-11-12T05:45:43.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f93e6a700 1 -- 172.21.2.105:0/1589722207 wait complete. 2021-11-12T05:45:43.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f93e6a700 1 Processor -- start 2021-11-12T05:45:43.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f93e6a700 1 -- start start 2021-11-12T05:45:43.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f93e6a700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4f8c0ac280 0x7f4f8c15aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:43.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f93e6a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4f8c0ad080 0x7f4f8c0a9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:43.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f93e6a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4f8c14b2f0 0x7f4f8c156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:43.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f93e6a700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c15a390 con 0x7f4f8c0ad080 2021-11-12T05:45:43.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f93e6a700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c15a630 con 0x7f4f8c0ac280 2021-11-12T05:45:43.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f93e6a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c060d70 con 0x7f4f8c14b2f0 2021-11-12T05:45:43.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f91405700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4f8c0ad080 0x7f4f8c0a9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:43.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f91405700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4f8c0ad080 0x7f4f8c0a9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46630/0 (socket says 172.21.2.105:46630) 2021-11-12T05:45:43.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f91405700 1 -- 172.21.2.105:0/2333787471 learned_addr learned my addr 172.21.2.105:0/2333787471 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:43.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f91405700 1 -- 172.21.2.105:0/2333787471 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4f8c14b2f0 msgr2=0x7f4f8c156c10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:45:43.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f91405700 1 --2- 172.21.2.105:0/2333787471 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4f8c14b2f0 0x7f4f8c156c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:43.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f91405700 1 -- 172.21.2.105:0/2333787471 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4f8c0ac280 msgr2=0x7f4f8c15aad0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:45:43.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f91405700 1 --2- 172.21.2.105:0/2333787471 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4f8c0ac280 0x7f4f8c15aad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:43.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f91405700 1 -- 172.21.2.105:0/2333787471 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f84009470 con 0x7f4f8c0ad080 2021-11-12T05:45:43.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f91405700 1 --2- 172.21.2.105:0/2333787471 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4f8c0ad080 0x7f4f8c0a9180 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f4f80001110 tx=0x7f4f80007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:43.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f7effd700 1 -- 172.21.2.105:0/2333787471 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f800072e0 con 0x7f4f8c0ad080 2021-11-12T05:45:43.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f7effd700 1 -- 172.21.2.105:0/2333787471 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f80007440 con 0x7f4f8c0ad080 2021-11-12T05:45:43.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f93e6a700 1 -- 172.21.2.105:0/2333787471 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f8c15afc0 con 0x7f4f8c0ad080 2021-11-12T05:45:43.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f93e6a700 1 -- 172.21.2.105:0/2333787471 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f8c0a9890 con 0x7f4f8c0ad080 2021-11-12T05:45:43.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.412+0000 7f4f7effd700 1 -- 172.21.2.105:0/2333787471 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f80005800 con 0x7f4f8c0ad080 2021-11-12T05:45:43.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.416+0000 7f4f93e6a700 1 -- 172.21.2.105:0/2333787471 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f68003410 con 0x7f4f8c0ad080 2021-11-12T05:45:43.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.416+0000 7f4f7effd700 1 -- 172.21.2.105:0/2333787471 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4f8001a060 con 0x7f4f8c0ad080 2021-11-12T05:45:43.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.416+0000 7f4f7effd700 1 --2- 172.21.2.105:0/2333787471 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4f74053720 0x7f4f74055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:43.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.416+0000 7f4f7effd700 1 -- 172.21.2.105:0/2333787471 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f4f8006b2e0 con 0x7f4f8c0ad080 2021-11-12T05:45:43.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.416+0000 7f4f91c06700 1 --2- 172.21.2.105:0/2333787471 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4f74053720 0x7f4f74055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:43.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.416+0000 7f4f91c06700 1 --2- 172.21.2.105:0/2333787471 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4f74053720 0x7f4f74055be0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f4f88002fb0 tx=0x7f4f88006930).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:43.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.416+0000 7f4f7effd700 1 -- 172.21.2.105:0/2333787471 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4f800422f0 con 0x7f4f8c0ad080 2021-11-12T05:45:43.505 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.500+0000 7f4f93e6a700 1 -- 172.21.2.105:0/2333787471 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f680036c0 con 0x7f4f8c0ad080 2021-11-12T05:45:43.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.500+0000 7f4f7effd700 1 -- 172.21.2.105:0/2333787471 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16287 (secure 0 0 0) 0x7f4f80018070 con 0x7f4f8c0ad080 2021-11-12T05:45:43.507 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:45:43.507 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":64,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:45:43.349784+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:45:41.270040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2021-11-12T05:45:42.319352+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:45:43.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.504+0000 7f4f93e6a700 1 -- 172.21.2.105:0/2333787471 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4f74053720 msgr2=0x7f4f74055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:43.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.504+0000 7f4f93e6a700 1 --2- 172.21.2.105:0/2333787471 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4f74053720 0x7f4f74055be0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f4f88002fb0 tx=0x7f4f88006930).stop 2021-11-12T05:45:43.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.504+0000 7f4f93e6a700 1 -- 172.21.2.105:0/2333787471 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4f8c0ad080 msgr2=0x7f4f8c0a9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:43.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.504+0000 7f4f93e6a700 1 --2- 172.21.2.105:0/2333787471 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4f8c0ad080 0x7f4f8c0a9180 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f4f80001110 tx=0x7f4f80007ad0).stop 2021-11-12T05:45:43.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.504+0000 7f4f93e6a700 1 -- 172.21.2.105:0/2333787471 shutdown_connections 2021-11-12T05:45:43.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.504+0000 7f4f93e6a700 1 --2- 172.21.2.105:0/2333787471 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4f74053720 0x7f4f74055be0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:43.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.504+0000 7f4f93e6a700 1 --2- 172.21.2.105:0/2333787471 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4f8c14b2f0 0x7f4f8c156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:43.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.504+0000 7f4f93e6a700 1 --2- 172.21.2.105:0/2333787471 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4f8c0ad080 0x7f4f8c0a9180 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:43.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.504+0000 7f4f93e6a700 1 --2- 172.21.2.105:0/2333787471 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4f8c0ac280 0x7f4f8c15aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:43.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.504+0000 7f4f93e6a700 1 -- 172.21.2.105:0/2333787471 >> 172.21.2.105:0/2333787471 conn(0x7f4f8c0b5370 msgr2=0x7f4f8c0aec00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:43.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.504+0000 7f4f93e6a700 1 -- 172.21.2.105:0/2333787471 shutdown_connections 2021-11-12T05:45:43.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.504+0000 7f4f93e6a700 1 -- 172.21.2.105:0/2333787471 wait complete. 2021-11-12T05:45:43.514 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:45:43.565 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.560+0000 7f5c8da69700 1 Processor -- start 2021-11-12T05:45:43.566 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.560+0000 7f5c8da69700 1 -- start start 2021-11-12T05:45:43.571 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.560+0000 7f5c8da69700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5c880b2940 0x7f5c88142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:43.571 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.560+0000 7f5c8da69700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c880b2d20 con 0x7f5c880b0cc0 2021-11-12T05:45:43.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.560+0000 7f5c8da69700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c880b1fc0 con 0x7f5c880b0780 2021-11-12T05:45:43.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.560+0000 7f5c8da69700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8805cba0 con 0x7f5c880b2940 2021-11-12T05:45:43.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.560+0000 7f5c87fff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f5c880b0cc0 0x7f5c8805c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57034/0 (socket says 172.21.2.105:57034) 2021-11-12T05:45:43.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.560+0000 7f5c87fff700 1 -- 172.21.2.105:0/2576174583 learned_addr learned my addr 172.21.2.105:0/2576174583 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:45:43.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.560+0000 7f5c867fc700 1 -- 172.21.2.105:0/2576174583 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1964243914 0 0) 0x7f5c880b2d20 con 0x7f5c880b0cc0 2021-11-12T05:45:43.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.560+0000 7f5c867fc700 1 -- 172.21.2.105:0/2576174583 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c68003260 con 0x7f5c880b0cc0 2021-11-12T05:45:43.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c877fe700 1 --2- 172.21.2.105:0/2576174583 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5c880b2940 0x7f5c88142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:43.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c867fc700 1 -- 172.21.2.105:0/2576174583 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 748019641 0 0) 0x7f5c68003260 con 0x7f5c880b0cc0 2021-11-12T05:45:43.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c867fc700 1 -- 172.21.2.105:0/2576174583 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5c880b2940 msgr2=0x7f5c88142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:43.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c867fc700 1 --2- 172.21.2.105:0/2576174583 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5c880b2940 0x7f5c88142dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:43.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c867fc700 1 -- 172.21.2.105:0/2576174583 >> v1:172.21.2.115:6789/0 conn(0x7f5c880b0780 legacy=0x7f5c881432b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:43.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c867fc700 1 -- 172.21.2.105:0/2576174583 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c880b15e0 con 0x7f5c880b0cc0 2021-11-12T05:45:43.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c867fc700 1 -- 172.21.2.105:0/2576174583 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f5c800019e0 con 0x7f5c880b0cc0 2021-11-12T05:45:43.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c867fc700 1 -- 172.21.2.105:0/2576174583 >> v1:172.21.2.105:6789/0 conn(0x7f5c880b0cc0 legacy=0x7f5c8805c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:43.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c867fc700 1 --2- 172.21.2.105:0/2576174583 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5c68003780 0x7f5c68003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:43.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c867fc700 1 --2- 172.21.2.105:0/2576174583 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c68004500 0x7f5c68004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:43.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c867fc700 1 --2- 172.21.2.105:0/2576174583 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5c880b2940 0x7f5c68004f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:43.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c867fc700 1 -- 172.21.2.105:0/2576174583 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8805cba0 con 0x7f5c68004500 2021-11-12T05:45:43.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c867fc700 1 -- 172.21.2.105:0/2576174583 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6800b830 con 0x7f5c68003780 2021-11-12T05:45:43.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c867fc700 1 -- 172.21.2.105:0/2576174583 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6800b9f0 con 0x7f5c880b2940 2021-11-12T05:45:43.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c86ffd700 1 --2- 172.21.2.105:0/2576174583 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c68004500 0x7f5c68004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:43.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c86ffd700 1 -- 172.21.2.105:0/2576174583 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5c880b2940 msgr2=0x7f5c68004f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:43.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c86ffd700 1 --2- 172.21.2.105:0/2576174583 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5c880b2940 0x7f5c68004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:43.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c86ffd700 1 -- 172.21.2.105:0/2576174583 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5c68003780 msgr2=0x7f5c68003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:43.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c86ffd700 1 --2- 172.21.2.105:0/2576174583 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5c68003780 0x7f5c68003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:43.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c86ffd700 1 -- 172.21.2.105:0/2576174583 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c68003260 con 0x7f5c68004500 2021-11-12T05:45:43.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c86ffd700 1 --2- 172.21.2.105:0/2576174583 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c68004500 0x7f5c68004980 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f5c78001fa0 tx=0x7f5c78007a00).ready entity=mon.0 client_cookie=7b4fbf24f3def66d server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:43.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c867fc700 1 -- 172.21.2.105:0/2576174583 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c78007070 con 0x7f5c68004500 2021-11-12T05:45:43.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c867fc700 1 -- 172.21.2.105:0/2576174583 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c780071d0 con 0x7f5c68004500 2021-11-12T05:45:43.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c867fc700 1 -- 172.21.2.105:0/2576174583 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c78006510 con 0x7f5c68004500 2021-11-12T05:45:43.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c8da69700 1 -- 172.21.2.105:0/2576174583 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c68004500 msgr2=0x7f5c68004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:43.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c8da69700 1 --2- 172.21.2.105:0/2576174583 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c68004500 0x7f5c68004980 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f5c78001fa0 tx=0x7f5c78007a00).stop 2021-11-12T05:45:43.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c87fff700 1 -- 172.21.2.105:0/2576174583 reap_dead start 2021-11-12T05:45:43.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c8da69700 1 -- 172.21.2.105:0/2576174583 shutdown_connections 2021-11-12T05:45:43.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c8da69700 1 -- 172.21.2.105:0/2576174583 >> 172.21.2.105:0/2576174583 conn(0x7f5c88068440 msgr2=0x7f5c88062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:43.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c8da69700 1 -- 172.21.2.105:0/2576174583 shutdown_connections 2021-11-12T05:45:43.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c8da69700 1 -- 172.21.2.105:0/2576174583 wait complete. 2021-11-12T05:45:43.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c8da69700 1 Processor -- start 2021-11-12T05:45:43.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c8da69700 1 -- start start 2021-11-12T05:45:43.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c8da69700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c68004500 0x7f5c880aee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:43.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c8da69700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5c88140310 0x7f5c88153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:43.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c8da69700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5c88153fe0 0x7f5c88064d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:43.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c8da69700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8813c120 con 0x7f5c68004500 2021-11-12T05:45:43.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c8da69700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c88066800 con 0x7f5c88140310 2021-11-12T05:45:43.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c8da69700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c88140790 con 0x7f5c88153fe0 2021-11-12T05:45:43.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c877fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c68004500 0x7f5c880aee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:43.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c877fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c68004500 0x7f5c880aee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46650/0 (socket says 172.21.2.105:46650) 2021-11-12T05:45:43.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c877fe700 1 -- 172.21.2.105:0/3177746699 learned_addr learned my addr 172.21.2.105:0/3177746699 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:43.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c87fff700 1 --2- 172.21.2.105:0/3177746699 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5c88153fe0 0x7f5c88064d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:43.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c86ffd700 1 --2- 172.21.2.105:0/3177746699 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5c88140310 0x7f5c88153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:43.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c877fe700 1 -- 172.21.2.105:0/3177746699 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5c88153fe0 msgr2=0x7f5c88064d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:43.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c877fe700 1 --2- 172.21.2.105:0/3177746699 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5c88153fe0 0x7f5c88064d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:43.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c877fe700 1 -- 172.21.2.105:0/3177746699 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5c88140310 msgr2=0x7f5c88153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:43.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c877fe700 1 --2- 172.21.2.105:0/3177746699 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5c88140310 0x7f5c88153af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:43.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c877fe700 1 -- 172.21.2.105:0/3177746699 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c88154470 con 0x7f5c68004500 2021-11-12T05:45:43.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c86ffd700 1 --2- 172.21.2.105:0/3177746699 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5c88140310 0x7f5c88153af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:45:43.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c87fff700 1 --2- 172.21.2.105:0/3177746699 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5c88153fe0 0x7f5c88064d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:45:43.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c877fe700 1 --2- 172.21.2.105:0/3177746699 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c68004500 0x7f5c880aee80 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7f5c8814c410 tx=0x7f5c70008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:43.586 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c84ff9700 1 -- 172.21.2.105:0/3177746699 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c70016070 con 0x7f5c68004500 2021-11-12T05:45:43.586 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c84ff9700 1 -- 172.21.2.105:0/3177746699 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c70000e90 con 0x7f5c68004500 2021-11-12T05:45:43.586 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c8da69700 1 -- 172.21.2.105:0/3177746699 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c88066a30 con 0x7f5c68004500 2021-11-12T05:45:43.586 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c8da69700 1 -- 172.21.2.105:0/3177746699 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c8813d940 con 0x7f5c68004500 2021-11-12T05:45:43.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.564+0000 7f5c84ff9700 1 -- 172.21.2.105:0/3177746699 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c70011970 con 0x7f5c68004500 2021-11-12T05:45:43.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.568+0000 7f5c8da69700 1 -- 172.21.2.105:0/3177746699 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c880b1880 con 0x7f5c68004500 2021-11-12T05:45:43.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.568+0000 7f5c84ff9700 1 -- 172.21.2.105:0/3177746699 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5c70011ad0 con 0x7f5c68004500 2021-11-12T05:45:43.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.568+0000 7f5c84ff9700 1 --2- 172.21.2.105:0/3177746699 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5c6c0536f0 0x7f5c6c055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:43.588 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.568+0000 7f5c84ff9700 1 -- 172.21.2.105:0/3177746699 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f5c7006b870 con 0x7f5c68004500 2021-11-12T05:45:43.588 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.568+0000 7f5c86ffd700 1 --2- 172.21.2.105:0/3177746699 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5c6c0536f0 0x7f5c6c055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:43.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.568+0000 7f5c86ffd700 1 --2- 172.21.2.105:0/3177746699 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5c6c0536f0 0x7f5c6c055bb0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f5c78016000 tx=0x7f5c78015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:43.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.568+0000 7f5c84ff9700 1 -- 172.21.2.105:0/3177746699 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5c70042710 con 0x7f5c68004500 2021-11-12T05:45:43.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.652+0000 7f5c8da69700 1 -- 172.21.2.105:0/3177746699 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5c88057350 con 0x7f5c68004500 2021-11-12T05:45:43.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.652+0000 7f5c84ff9700 1 -- 172.21.2.105:0/3177746699 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16287 (secure 0 0 0) 0x7f5c70045d30 con 0x7f5c68004500 2021-11-12T05:45:43.658 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:45:43.659 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":64,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:45:43.349784+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:45:41.270040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2021-11-12T05:45:42.319352+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:45:43.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.656+0000 7f5c8da69700 1 -- 172.21.2.105:0/3177746699 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5c6c0536f0 msgr2=0x7f5c6c055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:43.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.656+0000 7f5c8da69700 1 --2- 172.21.2.105:0/3177746699 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5c6c0536f0 0x7f5c6c055bb0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f5c78016000 tx=0x7f5c78015000).stop 2021-11-12T05:45:43.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.656+0000 7f5c8da69700 1 -- 172.21.2.105:0/3177746699 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c68004500 msgr2=0x7f5c880aee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:43.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.656+0000 7f5c8da69700 1 --2- 172.21.2.105:0/3177746699 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c68004500 0x7f5c880aee80 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7f5c8814c410 tx=0x7f5c70008040).stop 2021-11-12T05:45:43.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.656+0000 7f5c8da69700 1 -- 172.21.2.105:0/3177746699 shutdown_connections 2021-11-12T05:45:43.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.656+0000 7f5c8da69700 1 --2- 172.21.2.105:0/3177746699 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5c6c0536f0 0x7f5c6c055bb0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:43.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.656+0000 7f5c8da69700 1 --2- 172.21.2.105:0/3177746699 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5c88153fe0 0x7f5c88064d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:43.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.656+0000 7f5c8da69700 1 --2- 172.21.2.105:0/3177746699 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5c88140310 0x7f5c88153af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:43.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.656+0000 7f5c8da69700 1 --2- 172.21.2.105:0/3177746699 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c68004500 0x7f5c880aee80 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:43.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.656+0000 7f5c8da69700 1 -- 172.21.2.105:0/3177746699 >> 172.21.2.105:0/3177746699 conn(0x7f5c88068440 msgr2=0x7f5c880b40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:43.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.656+0000 7f5c8da69700 1 -- 172.21.2.105:0/3177746699 shutdown_connections 2021-11-12T05:45:43.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.656+0000 7f5c8da69700 1 -- 172.21.2.105:0/3177746699 wait complete. 2021-11-12T05:45:43.666 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-12T05:45:43.720 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.716+0000 7fd1ac824700 1 Processor -- start 2021-11-12T05:45:43.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.716+0000 7fd1ac824700 1 -- start start 2021-11-12T05:45:43.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.716+0000 7fd1ac824700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fd1a80aca40 0x7fd1a80ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:43.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.716+0000 7fd1ac824700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd1a8144180 0x7fd1a81445f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:43.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.716+0000 7fd1ac824700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a80b1840 con 0x7fd1a80b0520 2021-11-12T05:45:43.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.716+0000 7fd1ac824700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1a80b09d0 con 0x7fd1a8144180 2021-11-12T05:45:43.722 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.716+0000 7fd1ac824700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1a80af2b0 con 0x7fd1a80aca40 2021-11-12T05:45:43.722 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.716+0000 7fd1a6d9d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd1a8144180 0x7fd1a81445f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:43.722 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.716+0000 7fd1a6d9d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd1a8144180 0x7fd1a81445f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46660/0 (socket says 172.21.2.105:46660) 2021-11-12T05:45:43.722 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.716+0000 7fd1a6d9d700 1 -- 172.21.2.105:0/109241589 learned_addr learned my addr 172.21.2.105:0/109241589 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:43.723 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.716+0000 7fd1a6d9d700 1 -- 172.21.2.105:0/109241589 >> v2:172.21.2.115:3300/0 conn(0x7fd1a80aca40 msgr2=0x7fd1a80ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:43.723 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.716+0000 7fd1a6d9d700 1 --2- 172.21.2.105:0/109241589 >> v2:172.21.2.115:3300/0 conn(0x7fd1a80aca40 0x7fd1a80ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:43.723 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.716+0000 7fd1a6d9d700 1 -- 172.21.2.105:0/109241589 >> v1:172.21.2.115:6789/0 conn(0x7fd1a80b0520 legacy=0x7fd1a81473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:43.723 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.716+0000 7fd1a6d9d700 1 -- 172.21.2.105:0/109241589 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a80b1a70 con 0x7fd1a8144180 2021-11-12T05:45:43.724 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.716+0000 7fd1a6d9d700 1 --2- 172.21.2.105:0/109241589 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1a8144180 0x7fd1a81445f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7fd1a8061140 tx=0x7fd1a0009290).ready entity=mon.0 client_cookie=cb6bb7276bdf8911 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:43.724 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.716+0000 7fd1a559a700 1 -- 172.21.2.105:0/109241589 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1a000b830 con 0x7fd1a8144180 2021-11-12T05:45:43.724 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.716+0000 7fd1a559a700 1 -- 172.21.2.105:0/109241589 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a000b990 con 0x7fd1a8144180 2021-11-12T05:45:43.724 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.716+0000 7fd1a559a700 1 -- 172.21.2.105:0/109241589 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1a000bb40 con 0x7fd1a8144180 2021-11-12T05:45:43.728 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.716+0000 7fd1ac824700 1 -- 172.21.2.105:0/109241589 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1a8144180 msgr2=0x7fd1a81445f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:43.728 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.716+0000 7fd1ac824700 1 --2- 172.21.2.105:0/109241589 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1a8144180 0x7fd1a81445f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7fd1a8061140 tx=0x7fd1a0009290).stop 2021-11-12T05:45:43.728 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.716+0000 7fd1ac824700 1 -- 172.21.2.105:0/109241589 shutdown_connections 2021-11-12T05:45:43.728 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.716+0000 7fd1ac824700 1 --2- 172.21.2.105:0/109241589 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1a8144180 0x7fd1a81445f0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:43.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.716+0000 7fd1ac824700 1 --2- 172.21.2.105:0/109241589 >> v2:172.21.2.115:3300/0 conn(0x7fd1a80aca40 0x7fd1a80ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:43.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.716+0000 7fd1ac824700 1 -- 172.21.2.105:0/109241589 >> 172.21.2.105:0/109241589 conn(0x7fd1a805c490 msgr2=0x7fd1a80b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:43.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.716+0000 7fd1ac824700 1 -- 172.21.2.105:0/109241589 shutdown_connections 2021-11-12T05:45:43.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.716+0000 7fd1ac824700 1 -- 172.21.2.105:0/109241589 wait complete. 2021-11-12T05:45:43.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.716+0000 7fd1ac824700 1 Processor -- start 2021-11-12T05:45:43.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.716+0000 7fd1ac824700 1 -- start start 2021-11-12T05:45:43.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.716+0000 7fd1ac824700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd1a80aca40 0x7fd1a81469e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:43.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.716+0000 7fd1ac824700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1a80b0520 0x7fd1a815a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:43.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.716+0000 7fd1ac824700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd1a8144180 0x7fd1a815a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:43.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.716+0000 7fd1ac824700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a8157640 con 0x7fd1a80b0520 2021-11-12T05:45:43.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.716+0000 7fd1ac824700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a8159c70 con 0x7fd1a80aca40 2021-11-12T05:45:43.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.716+0000 7fd1ac824700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a8066df0 con 0x7fd1a8144180 2021-11-12T05:45:43.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.720+0000 7fd1a5d9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1a80b0520 0x7fd1a815a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:43.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.720+0000 7fd1a5d9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1a80b0520 0x7fd1a815a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46664/0 (socket says 172.21.2.105:46664) 2021-11-12T05:45:43.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.720+0000 7fd1a5d9b700 1 -- 172.21.2.105:0/495152203 learned_addr learned my addr 172.21.2.105:0/495152203 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:43.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.720+0000 7fd1a5d9b700 1 -- 172.21.2.105:0/495152203 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd1a8144180 msgr2=0x7fd1a815a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:43.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.720+0000 7fd1a5d9b700 1 --2- 172.21.2.105:0/495152203 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd1a8144180 0x7fd1a815a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:43.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.720+0000 7fd1a5d9b700 1 -- 172.21.2.105:0/495152203 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd1a80aca40 msgr2=0x7fd1a81469e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:43.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.720+0000 7fd1a5d9b700 1 --2- 172.21.2.105:0/495152203 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd1a80aca40 0x7fd1a81469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:43.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.720+0000 7fd1a5d9b700 1 -- 172.21.2.105:0/495152203 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a0009530 con 0x7fd1a80b0520 2021-11-12T05:45:43.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.720+0000 7fd1a5d9b700 1 --2- 172.21.2.105:0/495152203 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1a80b0520 0x7fd1a815a0a0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7fd190002f90 tx=0x7fd190006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:43.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.720+0000 7fd19f7fe700 1 -- 172.21.2.105:0/495152203 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd190013460 con 0x7fd1a80b0520 2021-11-12T05:45:43.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.720+0000 7fd19f7fe700 1 -- 172.21.2.105:0/495152203 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1900135c0 con 0x7fd1a80b0520 2021-11-12T05:45:43.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.720+0000 7fd19f7fe700 1 -- 172.21.2.105:0/495152203 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd190013920 con 0x7fd1a80b0520 2021-11-12T05:45:43.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.720+0000 7fd1ac824700 1 -- 172.21.2.105:0/495152203 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a8066b10 con 0x7fd1a80b0520 2021-11-12T05:45:43.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.720+0000 7fd1ac824700 1 -- 172.21.2.105:0/495152203 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a8062da0 con 0x7fd1a80b0520 2021-11-12T05:45:43.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.720+0000 7fd1ac824700 1 -- 172.21.2.105:0/495152203 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a8057350 con 0x7fd1a80b0520 2021-11-12T05:45:43.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.720+0000 7fd19f7fe700 1 -- 172.21.2.105:0/495152203 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd19001a060 con 0x7fd1a80b0520 2021-11-12T05:45:43.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.720+0000 7fd19f7fe700 1 --2- 172.21.2.105:0/495152203 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd18c0536f0 0x7fd18c055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:43.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.720+0000 7fd19f7fe700 1 -- 172.21.2.105:0/495152203 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fd19006b500 con 0x7fd1a80b0520 2021-11-12T05:45:43.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.720+0000 7fd1a659c700 1 --2- 172.21.2.105:0/495152203 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd18c0536f0 0x7fd18c055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:43.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.720+0000 7fd1a659c700 1 --2- 172.21.2.105:0/495152203 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd18c0536f0 0x7fd18c055bb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fd198002f70 tx=0x7fd198006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:43.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.724+0000 7fd19f7fe700 1 -- 172.21.2.105:0/495152203 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd190042400 con 0x7fd1a80b0520 2021-11-12T05:45:43.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:43.832+0000 7fd1ac824700 1 -- 172.21.2.105:0/495152203 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd1a805f280 con 0x7fd1a80b0520 2021-11-12T05:45:44.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.356+0000 7fd19f7fe700 1 -- 172.21.2.105:0/495152203 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v25) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd190045a20 con 0x7fd1a80b0520 2021-11-12T05:45:44.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.360+0000 7fd1ac824700 1 -- 172.21.2.105:0/495152203 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd18c0536f0 msgr2=0x7fd18c055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:44.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.360+0000 7fd1ac824700 1 --2- 172.21.2.105:0/495152203 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd18c0536f0 0x7fd18c055bb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fd198002f70 tx=0x7fd198006a80).stop 2021-11-12T05:45:44.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.360+0000 7fd1ac824700 1 -- 172.21.2.105:0/495152203 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1a80b0520 msgr2=0x7fd1a815a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:44.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.360+0000 7fd1ac824700 1 --2- 172.21.2.105:0/495152203 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1a80b0520 0x7fd1a815a0a0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7fd190002f90 tx=0x7fd190006df0).stop 2021-11-12T05:45:44.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.360+0000 7fd1ac824700 1 -- 172.21.2.105:0/495152203 shutdown_connections 2021-11-12T05:45:44.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.360+0000 7fd1ac824700 1 --2- 172.21.2.105:0/495152203 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd18c0536f0 0x7fd18c055bb0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:44.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.360+0000 7fd1ac824700 1 --2- 172.21.2.105:0/495152203 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd1a8144180 0x7fd1a815a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:44.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.360+0000 7fd1ac824700 1 --2- 172.21.2.105:0/495152203 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1a80b0520 0x7fd1a815a0a0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:44.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.360+0000 7fd1ac824700 1 --2- 172.21.2.105:0/495152203 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd1a80aca40 0x7fd1a81469e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:44.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.360+0000 7fd1ac824700 1 -- 172.21.2.105:0/495152203 >> 172.21.2.105:0/495152203 conn(0x7fd1a805c490 msgr2=0x7fd1a814b180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:44.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.360+0000 7fd1ac824700 1 -- 172.21.2.105:0/495152203 shutdown_connections 2021-11-12T05:45:44.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.360+0000 7fd1ac824700 1 -- 172.21.2.105:0/495152203 wait complete. 2021-11-12T05:45:44.372 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:45:44.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75b26ff700 1 Processor -- start 2021-11-12T05:45:44.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75b26ff700 1 -- start start 2021-11-12T05:45:44.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75b26ff700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f75ac143b40 0x7f75ac0aded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:44.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75b26ff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f75ac0ae3c0 0x7f75ac0afe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:44.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75b26ff700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75ac067860 con 0x7f75ac0adaf0 2021-11-12T05:45:44.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75b26ff700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75ac1404a0 con 0x7f75ac0ae3c0 2021-11-12T05:45:44.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75b26ff700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75ac143400 con 0x7f75ac143b40 2021-11-12T05:45:44.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75b0c9c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f75ac0ae3c0 0x7f75ac0afe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:44.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75abfff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f75ac0adaf0 0x7f75ac13fd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57070/0 (socket says 172.21.2.105:57070) 2021-11-12T05:45:44.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75abfff700 1 -- 172.21.2.105:0/2769535559 learned_addr learned my addr 172.21.2.105:0/2769535559 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:45:44.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75b0c9c700 1 -- 172.21.2.105:0/2769535559 >> v2:172.21.2.115:3300/0 conn(0x7f75ac143b40 msgr2=0x7f75ac0aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:44.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75b0c9c700 1 --2- 172.21.2.105:0/2769535559 >> v2:172.21.2.115:3300/0 conn(0x7f75ac143b40 0x7f75ac0aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:44.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75b0c9c700 1 -- 172.21.2.105:0/2769535559 >> v1:172.21.2.105:6789/0 conn(0x7f75ac0adaf0 legacy=0x7f75ac13fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:44.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75b0c9c700 1 -- 172.21.2.105:0/2769535559 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ac1436a0 con 0x7f75ac0ae3c0 2021-11-12T05:45:44.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75b0c9c700 1 --2- 172.21.2.105:0/2769535559 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75ac0ae3c0 0x7f75ac0afe10 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f7594001110 tx=0x7f75a400b470).ready entity=mon.0 client_cookie=fcee6a539d578ddd server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:44.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75aaffd700 1 -- 172.21.2.105:0/2769535559 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75a400dcb0 con 0x7f75ac0ae3c0 2021-11-12T05:45:44.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75aaffd700 1 -- 172.21.2.105:0/2769535559 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a400de10 con 0x7f75ac0ae3c0 2021-11-12T05:45:44.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75aaffd700 1 -- 172.21.2.105:0/2769535559 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75a4010660 con 0x7f75ac0ae3c0 2021-11-12T05:45:44.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75b26ff700 1 -- 172.21.2.105:0/2769535559 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75ac0ae3c0 msgr2=0x7f75ac0afe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:44.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75b26ff700 1 --2- 172.21.2.105:0/2769535559 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75ac0ae3c0 0x7f75ac0afe10 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f7594001110 tx=0x7f75a400b470).stop 2021-11-12T05:45:44.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75b26ff700 1 -- 172.21.2.105:0/2769535559 shutdown_connections 2021-11-12T05:45:44.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75b26ff700 1 --2- 172.21.2.105:0/2769535559 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75ac0ae3c0 0x7f75ac0afe10 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:44.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75b26ff700 1 --2- 172.21.2.105:0/2769535559 >> v2:172.21.2.115:3300/0 conn(0x7f75ac143b40 0x7f75ac0aded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:44.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75b26ff700 1 -- 172.21.2.105:0/2769535559 >> 172.21.2.105:0/2769535559 conn(0x7f75ac05c490 msgr2=0x7f75ac05c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:44.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75b26ff700 1 -- 172.21.2.105:0/2769535559 shutdown_connections 2021-11-12T05:45:44.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75b26ff700 1 -- 172.21.2.105:0/2769535559 wait complete. 2021-11-12T05:45:44.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75b26ff700 1 Processor -- start 2021-11-12T05:45:44.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75b26ff700 1 -- start start 2021-11-12T05:45:44.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75b26ff700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f75ac0adaf0 0x7f75ac0acf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:44.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75b26ff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75ac0ae3c0 0x7f75ac063870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:44.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75b26ff700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f75ac143b40 0x7f75ac063e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:44.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75b26ff700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac064340 con 0x7f75ac0ae3c0 2021-11-12T05:45:44.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75b26ff700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac0abf10 con 0x7f75ac0adaf0 2021-11-12T05:45:44.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75b26ff700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac0ac1b0 con 0x7f75ac143b40 2021-11-12T05:45:44.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75ab7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75ac0ae3c0 0x7f75ac063870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:44.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75ab7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75ac0ae3c0 0x7f75ac063870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46678/0 (socket says 172.21.2.105:46678) 2021-11-12T05:45:44.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75ab7fe700 1 -- 172.21.2.105:0/1740153140 learned_addr learned my addr 172.21.2.105:0/1740153140 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:44.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75ab7fe700 1 -- 172.21.2.105:0/1740153140 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f75ac143b40 msgr2=0x7f75ac063e50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:45:44.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75ab7fe700 1 --2- 172.21.2.105:0/1740153140 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f75ac143b40 0x7f75ac063e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:44.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75ab7fe700 1 -- 172.21.2.105:0/1740153140 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f75ac0adaf0 msgr2=0x7f75ac0acf90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:45:44.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75ab7fe700 1 --2- 172.21.2.105:0/1740153140 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f75ac0adaf0 0x7f75ac0acf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:44.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.420+0000 7f75ab7fe700 1 -- 172.21.2.105:0/1740153140 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a400b710 con 0x7f75ac0ae3c0 2021-11-12T05:45:44.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.424+0000 7f75ab7fe700 1 --2- 172.21.2.105:0/1740153140 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75ac0ae3c0 0x7f75ac063870 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f759c002f70 tx=0x7f759c006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:44.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.424+0000 7f75a97fa700 1 -- 172.21.2.105:0/1740153140 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f759c013460 con 0x7f75ac0ae3c0 2021-11-12T05:45:44.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.424+0000 7f75a97fa700 1 -- 172.21.2.105:0/1740153140 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759c0135c0 con 0x7f75ac0ae3c0 2021-11-12T05:45:44.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.424+0000 7f75b26ff700 1 -- 172.21.2.105:0/1740153140 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75ac064520 con 0x7f75ac0ae3c0 2021-11-12T05:45:44.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.424+0000 7f75b26ff700 1 -- 172.21.2.105:0/1740153140 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75ac065ba0 con 0x7f75ac0ae3c0 2021-11-12T05:45:44.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.424+0000 7f75a97fa700 1 -- 172.21.2.105:0/1740153140 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f759c013920 con 0x7f75ac0ae3c0 2021-11-12T05:45:44.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.424+0000 7f75b26ff700 1 -- 172.21.2.105:0/1740153140 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75ac0ac370 con 0x7f75ac0ae3c0 2021-11-12T05:45:44.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.424+0000 7f75a97fa700 1 -- 172.21.2.105:0/1740153140 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f759c01a060 con 0x7f75ac0ae3c0 2021-11-12T05:45:44.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.424+0000 7f75a97fa700 1 --2- 172.21.2.105:0/1740153140 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7590053640 0x7f7590055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:44.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.424+0000 7f75a97fa700 1 -- 172.21.2.105:0/1740153140 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f759c06b510 con 0x7f75ac0ae3c0 2021-11-12T05:45:44.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.424+0000 7f75abfff700 1 --2- 172.21.2.105:0/1740153140 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7590053640 0x7f7590055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:44.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.424+0000 7f75abfff700 1 --2- 172.21.2.105:0/1740153140 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7590053640 0x7f7590055b00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f75940011d0 tx=0x7f7594007770).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:44.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.424+0000 7f75a97fa700 1 -- 172.21.2.105:0/1740153140 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f759c042410 con 0x7f75ac0ae3c0 2021-11-12T05:45:44.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.536+0000 7f75b26ff700 1 -- 172.21.2.105:0/1740153140 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75ac0b2b40 con 0x7f75ac0ae3c0 2021-11-12T05:45:44.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.536+0000 7f75a97fa700 1 -- 172.21.2.105:0/1740153140 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+2134 (secure 0 0 0) 0x7f759c045a30 con 0x7f75ac0ae3c0 2021-11-12T05:45:44.540 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:45:44.540 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":25,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/37307717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":37307717},{"type":"v1","addr":"172.21.2.115:6833","nonce":37307717}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":23}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:45:43.349890+0000","modified":"2021-11-12T05:45:44.353136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5973},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5973":{"gid":5973,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/1667092126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":1667092126},{"type":"v1","addr":"172.21.2.105:6835","nonce":1667092126}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-11-12T05:45:44.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.536+0000 7f75b26ff700 1 -- 172.21.2.105:0/1740153140 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7590053640 msgr2=0x7f7590055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:44.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.536+0000 7f75b26ff700 1 --2- 172.21.2.105:0/1740153140 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7590053640 0x7f7590055b00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f75940011d0 tx=0x7f7594007770).stop 2021-11-12T05:45:44.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.536+0000 7f75b26ff700 1 -- 172.21.2.105:0/1740153140 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75ac0ae3c0 msgr2=0x7f75ac063870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:44.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.536+0000 7f75b26ff700 1 --2- 172.21.2.105:0/1740153140 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75ac0ae3c0 0x7f75ac063870 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f759c002f70 tx=0x7f759c006e20).stop 2021-11-12T05:45:44.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.536+0000 7f75b26ff700 1 -- 172.21.2.105:0/1740153140 shutdown_connections 2021-11-12T05:45:44.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.536+0000 7f75b26ff700 1 --2- 172.21.2.105:0/1740153140 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7590053640 0x7f7590055b00 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:44.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.536+0000 7f75b26ff700 1 --2- 172.21.2.105:0/1740153140 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f75ac143b40 0x7f75ac063e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:44.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.536+0000 7f75b26ff700 1 --2- 172.21.2.105:0/1740153140 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75ac0ae3c0 0x7f75ac063870 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:44.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.536+0000 7f75b26ff700 1 --2- 172.21.2.105:0/1740153140 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f75ac0adaf0 0x7f75ac0acf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:44.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.536+0000 7f75b26ff700 1 -- 172.21.2.105:0/1740153140 >> 172.21.2.105:0/1740153140 conn(0x7f75ac05c490 msgr2=0x7f75ac05f740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:44.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.536+0000 7f75b26ff700 1 -- 172.21.2.105:0/1740153140 shutdown_connections 2021-11-12T05:45:44.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.536+0000 7f75b26ff700 1 -- 172.21.2.105:0/1740153140 wait complete. 2021-11-12T05:45:44.544 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 25 2021-11-12T05:45:44.546 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:45:44.636 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.632+0000 7efd85f9e700 1 Processor -- start 2021-11-12T05:45:44.636 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.632+0000 7efd85f9e700 1 -- start start 2021-11-12T05:45:44.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.632+0000 7efd85f9e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efd800adaf0 0x7efd8013fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:44.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.632+0000 7efd85f9e700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7efd80143f80 0x7efd800afe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:44.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.632+0000 7efd85f9e700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd80067860 con 0x7efd80143b40 2021-11-12T05:45:44.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.632+0000 7efd85f9e700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd80143400 con 0x7efd80143f80 2021-11-12T05:45:44.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.632+0000 7efd85f9e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd801436a0 con 0x7efd800adaf0 2021-11-12T05:45:44.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.632+0000 7efd7f7fe700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efd800adaf0 0x7efd8013fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:44.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.632+0000 7efd7ffff700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7efd80143f80 0x7efd800afe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:44.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.632+0000 7efd7effd700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7efd80143b40 0x7efd800aded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:55550/0 (socket says 172.21.2.105:55550) 2021-11-12T05:45:44.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.632+0000 7efd7effd700 1 -- 172.21.2.105:0/4190958931 learned_addr learned my addr 172.21.2.105:0/4190958931 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:45:44.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.632+0000 7efd7ffff700 1 -- 172.21.2.105:0/4190958931 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efd800adaf0 msgr2=0x7efd8013fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:44.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.632+0000 7efd7ffff700 1 --2- 172.21.2.105:0/4190958931 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efd800adaf0 0x7efd8013fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:44.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.632+0000 7efd7ffff700 1 -- 172.21.2.105:0/4190958931 >> v1:172.21.2.115:6789/0 conn(0x7efd80143b40 legacy=0x7efd800aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:44.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.632+0000 7efd7ffff700 1 -- 172.21.2.105:0/4190958931 --> v2:172.21.2.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd800b2b40 con 0x7efd80143f80 2021-11-12T05:45:44.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.632+0000 7efd7ffff700 1 --2- 172.21.2.105:0/4190958931 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efd80143f80 0x7efd800afe10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7efd780032f0 tx=0x7efd780091d0).ready entity=mon.1 client_cookie=f446bf7fd075a7b4 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:44.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.636+0000 7efd7e7fc700 1 -- 172.21.2.105:0/4190958931 <== mon.1 v2:172.21.2.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd7800b6c0 con 0x7efd80143f80 2021-11-12T05:45:44.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.636+0000 7efd7e7fc700 1 -- 172.21.2.105:0/4190958931 <== mon.1 v2:172.21.2.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7800b820 con 0x7efd80143f80 2021-11-12T05:45:44.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.636+0000 7efd7e7fc700 1 -- 172.21.2.105:0/4190958931 <== mon.1 v2:172.21.2.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd7800b990 con 0x7efd80143f80 2021-11-12T05:45:44.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.636+0000 7efd85f9e700 1 -- 172.21.2.105:0/4190958931 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efd80143f80 msgr2=0x7efd800afe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:44.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.636+0000 7efd85f9e700 1 --2- 172.21.2.105:0/4190958931 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efd80143f80 0x7efd800afe10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7efd780032f0 tx=0x7efd780091d0).stop 2021-11-12T05:45:44.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.636+0000 7efd85f9e700 1 -- 172.21.2.105:0/4190958931 shutdown_connections 2021-11-12T05:45:44.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.636+0000 7efd85f9e700 1 --2- 172.21.2.105:0/4190958931 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efd80143f80 0x7efd800afe10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:44.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.636+0000 7efd85f9e700 1 --2- 172.21.2.105:0/4190958931 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efd800adaf0 0x7efd8013fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:44.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.636+0000 7efd85f9e700 1 -- 172.21.2.105:0/4190958931 >> 172.21.2.105:0/4190958931 conn(0x7efd8005c490 msgr2=0x7efd8005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:44.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.636+0000 7efd85f9e700 1 -- 172.21.2.105:0/4190958931 shutdown_connections 2021-11-12T05:45:44.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.636+0000 7efd85f9e700 1 -- 172.21.2.105:0/4190958931 wait complete. 2021-11-12T05:45:44.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.636+0000 7efd85f9e700 1 Processor -- start 2021-11-12T05:45:44.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.636+0000 7efd85f9e700 1 -- start start 2021-11-12T05:45:44.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.636+0000 7efd85f9e700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efd800adaf0 0x7efd800636d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:44.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.636+0000 7efd85f9e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efd80143b40 0x7efd8013d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:44.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.636+0000 7efd85f9e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efd80143f80 0x7efd800aad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:44.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.636+0000 7efd85f9e700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd80063fa0 con 0x7efd80143b40 2021-11-12T05:45:44.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.636+0000 7efd85f9e700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd800acfa0 con 0x7efd800adaf0 2021-11-12T05:45:44.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.636+0000 7efd85f9e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd800ac2d0 con 0x7efd80143f80 2021-11-12T05:45:44.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.636+0000 7efd7effd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efd80143b40 0x7efd8013d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:44.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.636+0000 7efd7effd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efd80143b40 0x7efd8013d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46692/0 (socket says 172.21.2.105:46692) 2021-11-12T05:45:44.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.636+0000 7efd7effd700 1 -- 172.21.2.105:0/734408783 learned_addr learned my addr 172.21.2.105:0/734408783 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:44.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.636+0000 7efd7ffff700 1 --2- 172.21.2.105:0/734408783 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efd80143f80 0x7efd800aad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:44.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.636+0000 7efd7f7fe700 1 --2- 172.21.2.105:0/734408783 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efd800adaf0 0x7efd800636d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:44.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.636+0000 7efd7effd700 1 -- 172.21.2.105:0/734408783 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efd80143f80 msgr2=0x7efd800aad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:44.650 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.636+0000 7efd7effd700 1 --2- 172.21.2.105:0/734408783 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efd80143f80 0x7efd800aad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:44.650 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.636+0000 7efd7effd700 1 -- 172.21.2.105:0/734408783 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efd800adaf0 msgr2=0x7efd800636d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:44.650 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.636+0000 7efd7effd700 1 --2- 172.21.2.105:0/734408783 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efd800adaf0 0x7efd800636d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:44.650 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.636+0000 7efd7effd700 1 -- 172.21.2.105:0/734408783 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd78009470 con 0x7efd80143b40 2021-11-12T05:45:44.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.636+0000 7efd7effd700 1 --2- 172.21.2.105:0/734408783 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efd80143b40 0x7efd8013d980 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7efd800b63f0 tx=0x7efd74007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:44.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.636+0000 7efd7cff9700 1 -- 172.21.2.105:0/734408783 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd7400ce30 con 0x7efd80143b40 2021-11-12T05:45:44.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.636+0000 7efd85f9e700 1 -- 172.21.2.105:0/734408783 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd80063bc0 con 0x7efd80143b40 2021-11-12T05:45:44.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.636+0000 7efd7cff9700 1 -- 172.21.2.105:0/734408783 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd740072e0 con 0x7efd80143b40 2021-11-12T05:45:44.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.636+0000 7efd7cff9700 1 -- 172.21.2.105:0/734408783 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd74005800 con 0x7efd80143b40 2021-11-12T05:45:44.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.636+0000 7efd85f9e700 1 -- 172.21.2.105:0/734408783 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd80066b70 con 0x7efd80143b40 2021-11-12T05:45:44.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.636+0000 7efd85f9e700 1 -- 172.21.2.105:0/734408783 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd800afb00 con 0x7efd80143b40 2021-11-12T05:45:44.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.640+0000 7efd7cff9700 1 -- 172.21.2.105:0/734408783 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efd74010070 con 0x7efd80143b40 2021-11-12T05:45:44.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.640+0000 7efd7cff9700 1 --2- 172.21.2.105:0/734408783 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efd600534f0 0x7efd600559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:44.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.640+0000 7efd7cff9700 1 -- 172.21.2.105:0/734408783 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6416+0+0 (secure 0 0 0) 0x7efd7406b160 con 0x7efd80143b40 2021-11-12T05:45:44.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.640+0000 7efd7f7fe700 1 --2- 172.21.2.105:0/734408783 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efd600534f0 0x7efd600559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:44.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.640+0000 7efd7f7fe700 1 --2- 172.21.2.105:0/734408783 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efd600534f0 0x7efd600559b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7efd70008000 tx=0x7efd70008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:44.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.640+0000 7efd7cff9700 1 -- 172.21.2.105:0/734408783 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efd740420d0 con 0x7efd80143b40 2021-11-12T05:45:44.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.724+0000 7efd85f9e700 1 -- 172.21.2.105:0/734408783 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd80057350 con 0x7efd80143b40 2021-11-12T05:45:44.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.724+0000 7efd7cff9700 1 -- 172.21.2.105:0/734408783 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+16274 (secure 0 0 0) 0x7efd74018070 con 0x7efd80143b40 2021-11-12T05:45:44.730 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:45:44.731 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":65,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:45:44.354326+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:45:41.270040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2021-11-12T05:45:42.319352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:45:44.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.728+0000 7efd85f9e700 1 -- 172.21.2.105:0/734408783 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efd600534f0 msgr2=0x7efd600559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:44.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.728+0000 7efd85f9e700 1 --2- 172.21.2.105:0/734408783 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efd600534f0 0x7efd600559b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7efd70008000 tx=0x7efd70008040).stop 2021-11-12T05:45:44.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.728+0000 7efd85f9e700 1 -- 172.21.2.105:0/734408783 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efd80143b40 msgr2=0x7efd8013d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:44.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.728+0000 7efd85f9e700 1 --2- 172.21.2.105:0/734408783 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efd80143b40 0x7efd8013d980 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7efd800b63f0 tx=0x7efd74007c40).stop 2021-11-12T05:45:44.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.728+0000 7efd85f9e700 1 -- 172.21.2.105:0/734408783 shutdown_connections 2021-11-12T05:45:44.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.728+0000 7efd85f9e700 1 --2- 172.21.2.105:0/734408783 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efd600534f0 0x7efd600559b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:44.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.728+0000 7efd85f9e700 1 --2- 172.21.2.105:0/734408783 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efd80143f80 0x7efd800aad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:44.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.728+0000 7efd85f9e700 1 --2- 172.21.2.105:0/734408783 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efd80143b40 0x7efd8013d980 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:44.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.728+0000 7efd85f9e700 1 --2- 172.21.2.105:0/734408783 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efd800adaf0 0x7efd800636d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:44.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.728+0000 7efd85f9e700 1 -- 172.21.2.105:0/734408783 >> 172.21.2.105:0/734408783 conn(0x7efd8005c490 msgr2=0x7efd800afd50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:44.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.728+0000 7efd85f9e700 1 -- 172.21.2.105:0/734408783 shutdown_connections 2021-11-12T05:45:44.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.728+0000 7efd85f9e700 1 -- 172.21.2.105:0/734408783 wait complete. 2021-11-12T05:45:44.738 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-12T05:45:44.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.788+0000 7f1f6f071700 1 Processor -- start 2021-11-12T05:45:44.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.788+0000 7f1f6f071700 1 -- start start 2021-11-12T05:45:44.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.788+0000 7f1f6f071700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f1f680adaf0 0x7f1f6813fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:44.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.788+0000 7f1f6f071700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f1f68143b40 0x7f1f680aded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:44.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.788+0000 7f1f6f071700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f68067860 con 0x7f1f680ae3c0 2021-11-12T05:45:44.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.788+0000 7f1f6f071700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f68143400 con 0x7f1f680adaf0 2021-11-12T05:45:44.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.788+0000 7f1f6f071700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f681436a0 con 0x7f1f68143b40 2021-11-12T05:45:44.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.788+0000 7f1f6d60e700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f1f680ae3c0 0x7f1f680afe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57098/0 (socket says 172.21.2.105:57098) 2021-11-12T05:45:44.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.788+0000 7f1f6d60e700 1 -- 172.21.2.105:0/2646767388 learned_addr learned my addr 172.21.2.105:0/2646767388 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:45:44.798 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.788+0000 7f1f6ce0d700 1 --2- 172.21.2.105:0/2646767388 >> v2:172.21.2.105:3300/0 conn(0x7f1f680adaf0 0x7f1f6813fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:44.798 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.788+0000 7f1f6ce0d700 1 -- 172.21.2.105:0/2646767388 >> v2:172.21.2.115:3300/0 conn(0x7f1f68143b40 msgr2=0x7f1f680aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:44.798 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.788+0000 7f1f6ce0d700 1 --2- 172.21.2.105:0/2646767388 >> v2:172.21.2.115:3300/0 conn(0x7f1f68143b40 0x7f1f680aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:44.798 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.788+0000 7f1f6ce0d700 1 -- 172.21.2.105:0/2646767388 >> v1:172.21.2.105:6789/0 conn(0x7f1f680ae3c0 legacy=0x7f1f680afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:44.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.788+0000 7f1f6ce0d700 1 -- 172.21.2.105:0/2646767388 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f680b2b40 con 0x7f1f680adaf0 2021-11-12T05:45:44.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.788+0000 7f1f677fe700 1 -- 172.21.2.105:0/2646767388 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2670704487 0 0) 0x7f1f68067860 con 0x7f1f680ae3c0 2021-11-12T05:45:44.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f6ce0d700 1 --2- 172.21.2.105:0/2646767388 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1f680adaf0 0x7f1f6813fd90 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f1f50002f70 tx=0x7f1f50006df0).ready entity=mon.0 client_cookie=9ded831bb0c1a7a2 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:44.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f677fe700 1 -- 172.21.2.105:0/2646767388 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f5000d5c0 con 0x7f1f680adaf0 2021-11-12T05:45:44.800 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f677fe700 1 -- 172.21.2.105:0/2646767388 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f50000e90 con 0x7f1f680adaf0 2021-11-12T05:45:44.800 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f677fe700 1 -- 172.21.2.105:0/2646767388 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f5000d910 con 0x7f1f680adaf0 2021-11-12T05:45:44.800 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f6f071700 1 -- 172.21.2.105:0/2646767388 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1f680adaf0 msgr2=0x7f1f6813fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:44.800 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f6f071700 1 --2- 172.21.2.105:0/2646767388 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1f680adaf0 0x7f1f6813fd90 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f1f50002f70 tx=0x7f1f50006df0).stop 2021-11-12T05:45:44.800 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f6f071700 1 -- 172.21.2.105:0/2646767388 shutdown_connections 2021-11-12T05:45:44.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f6f071700 1 --2- 172.21.2.105:0/2646767388 >> v2:172.21.2.115:3300/0 conn(0x7f1f68143b40 0x7f1f680aded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:44.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f6f071700 1 --2- 172.21.2.105:0/2646767388 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1f680adaf0 0x7f1f6813fd90 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:44.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f6f071700 1 -- 172.21.2.105:0/2646767388 >> 172.21.2.105:0/2646767388 conn(0x7f1f6805c490 msgr2=0x7f1f6805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:44.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f6f071700 1 -- 172.21.2.105:0/2646767388 shutdown_connections 2021-11-12T05:45:44.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f6f071700 1 -- 172.21.2.105:0/2646767388 wait complete. 2021-11-12T05:45:44.802 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f6f071700 1 Processor -- start 2021-11-12T05:45:44.802 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f6f071700 1 -- start start 2021-11-12T05:45:44.802 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f6f071700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1f680adaf0 0x7f1f680a2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:44.802 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f6f071700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1f680ae3c0 0x7f1f6809e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:44.803 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f6f071700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1f68143b40 0x7f1f681526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:44.803 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f6f071700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6809eeb0 con 0x7f1f68143b40 2021-11-12T05:45:44.803 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f6f071700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6809f150 con 0x7f1f680ae3c0 2021-11-12T05:45:44.803 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f6f071700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f68155c90 con 0x7f1f680adaf0 2021-11-12T05:45:44.803 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f6d60e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1f68143b40 0x7f1f681526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:44.804 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f6d60e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1f68143b40 0x7f1f681526e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46706/0 (socket says 172.21.2.105:46706) 2021-11-12T05:45:44.804 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f6d60e700 1 -- 172.21.2.105:0/873106746 learned_addr learned my addr 172.21.2.105:0/873106746 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:44.806 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f6d60e700 1 -- 172.21.2.105:0/873106746 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1f680adaf0 msgr2=0x7f1f680a2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:44.806 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f6d60e700 1 --2- 172.21.2.105:0/873106746 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1f680adaf0 0x7f1f680a2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:44.806 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f6d60e700 1 -- 172.21.2.105:0/873106746 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1f680ae3c0 msgr2=0x7f1f6809e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:44.806 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f6d60e700 1 --2- 172.21.2.105:0/873106746 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1f680ae3c0 0x7f1f6809e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:44.807 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f6d60e700 1 -- 172.21.2.105:0/873106746 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f5000b180 con 0x7f1f68143b40 2021-11-12T05:45:44.807 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f6d60e700 1 --2- 172.21.2.105:0/873106746 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1f68143b40 0x7f1f681526e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f1f60001250 tx=0x7f1f60007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:44.807 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f65ffb700 1 -- 172.21.2.105:0/873106746 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f60005c70 con 0x7f1f68143b40 2021-11-12T05:45:44.807 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f65ffb700 1 -- 172.21.2.105:0/873106746 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f60005dd0 con 0x7f1f68143b40 2021-11-12T05:45:44.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f6f071700 1 -- 172.21.2.105:0/873106746 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f680b1480 con 0x7f1f68143b40 2021-11-12T05:45:44.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f65ffb700 1 -- 172.21.2.105:0/873106746 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f60004a90 con 0x7f1f68143b40 2021-11-12T05:45:44.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f6f071700 1 -- 172.21.2.105:0/873106746 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f680b1970 con 0x7f1f68143b40 2021-11-12T05:45:44.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f6f071700 1 -- 172.21.2.105:0/873106746 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f6809ed00 con 0x7f1f68143b40 2021-11-12T05:45:44.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f65ffb700 1 -- 172.21.2.105:0/873106746 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1f60004bf0 con 0x7f1f68143b40 2021-11-12T05:45:44.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f65ffb700 1 --2- 172.21.2.105:0/873106746 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1f4c053580 0x7f1f4c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:44.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f65ffb700 1 -- 172.21.2.105:0/873106746 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f1f6006b7e0 con 0x7f1f68143b40 2021-11-12T05:45:44.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.792+0000 7f1f6ce0d700 1 --2- 172.21.2.105:0/873106746 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1f4c053580 0x7f1f4c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:44.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.796+0000 7f1f6ce0d700 1 --2- 172.21.2.105:0/873106746 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1f4c053580 0x7f1f4c055a40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f1f50002f70 tx=0x7f1f50014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:44.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.796+0000 7f1f65ffb700 1 -- 172.21.2.105:0/873106746 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1f600427f0 con 0x7f1f68143b40 2021-11-12T05:45:44.912 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.908+0000 7f1f6f071700 1 -- 172.21.2.105:0/873106746 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f1f68155e50 con 0x7f1f68143b40 2021-11-12T05:45:44.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.912+0000 7f1f65ffb700 1 -- 172.21.2.105:0/873106746 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v22) v1 ==== 184+0+0 (secure 0 0 0) 0x7f1f60045e10 con 0x7f1f68143b40 2021-11-12T05:45:44.919 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.912+0000 7f1f6f071700 1 -- 172.21.2.105:0/873106746 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1f4c053580 msgr2=0x7f1f4c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:44.919 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.912+0000 7f1f6f071700 1 --2- 172.21.2.105:0/873106746 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1f4c053580 0x7f1f4c055a40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f1f50002f70 tx=0x7f1f50014000).stop 2021-11-12T05:45:44.919 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.912+0000 7f1f6f071700 1 -- 172.21.2.105:0/873106746 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1f68143b40 msgr2=0x7f1f681526e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:44.920 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.912+0000 7f1f6f071700 1 --2- 172.21.2.105:0/873106746 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1f68143b40 0x7f1f681526e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f1f60001250 tx=0x7f1f60007dc0).stop 2021-11-12T05:45:44.920 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.912+0000 7f1f6f071700 1 -- 172.21.2.105:0/873106746 shutdown_connections 2021-11-12T05:45:44.920 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.912+0000 7f1f6f071700 1 --2- 172.21.2.105:0/873106746 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1f4c053580 0x7f1f4c055a40 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:44.920 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.912+0000 7f1f6f071700 1 --2- 172.21.2.105:0/873106746 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1f68143b40 0x7f1f681526e0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:44.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.912+0000 7f1f6f071700 1 --2- 172.21.2.105:0/873106746 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1f680ae3c0 0x7f1f6809e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:44.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.912+0000 7f1f6f071700 1 --2- 172.21.2.105:0/873106746 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1f680adaf0 0x7f1f680a2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:44.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.912+0000 7f1f6f071700 1 -- 172.21.2.105:0/873106746 >> 172.21.2.105:0/873106746 conn(0x7f1f6805c490 msgr2=0x7f1f68142c00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:44.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.912+0000 7f1f6f071700 1 -- 172.21.2.105:0/873106746 shutdown_connections 2021-11-12T05:45:44.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.912+0000 7f1f6f071700 1 -- 172.21.2.105:0/873106746 wait complete. 2021-11-12T05:45:44.922 INFO:teuthology.orchestra.run.gibba005.stderr:updated caps for client.0 2021-11-12T05:45:44.924 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-12T05:45:44.982 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.972+0000 7fde2e337700 1 Processor -- start 2021-11-12T05:45:44.982 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.972+0000 7fde2e337700 1 -- start start 2021-11-12T05:45:44.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde2e337700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fde280b0cb0 0x7fde280ac6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:44.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde2e337700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde280b2ad0 con 0x7fde280b1530 2021-11-12T05:45:44.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde2e337700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde28061020 con 0x7fde280b26f0 2021-11-12T05:45:44.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde2e337700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde280ad2c0 con 0x7fde280b0cb0 2021-11-12T05:45:44.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde2db36700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fde280b1530 0x7fde280acbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57114/0 (socket says 172.21.2.105:57114) 2021-11-12T05:45:44.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde2db36700 1 -- 172.21.2.105:0/106409379 learned_addr learned my addr 172.21.2.105:0/106409379 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:45:44.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde2cb34700 1 --2- 172.21.2.105:0/106409379 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fde280b0cb0 0x7fde280ac6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:44.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde17fff700 1 -- 172.21.2.105:0/106409379 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2701068913 0 0) 0x7fde280b2ad0 con 0x7fde280b1530 2021-11-12T05:45:44.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde17fff700 1 -- 172.21.2.105:0/106409379 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde10003260 con 0x7fde280b1530 2021-11-12T05:45:44.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde17fff700 1 -- 172.21.2.105:0/106409379 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1776258251 0 0) 0x7fde10003260 con 0x7fde280b1530 2021-11-12T05:45:44.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde17fff700 1 -- 172.21.2.105:0/106409379 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fde280b0cb0 msgr2=0x7fde280ac6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:44.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde17fff700 1 --2- 172.21.2.105:0/106409379 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fde280b0cb0 0x7fde280ac6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:44.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde17fff700 1 -- 172.21.2.105:0/106409379 >> v1:172.21.2.115:6789/0 conn(0x7fde280b26f0 legacy=0x7fde2813f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:44.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde17fff700 1 -- 172.21.2.105:0/106409379 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde280ac0d0 con 0x7fde280b1530 2021-11-12T05:45:44.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde17fff700 1 -- 172.21.2.105:0/106409379 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fde200019e0 con 0x7fde280b1530 2021-11-12T05:45:44.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde17fff700 1 -- 172.21.2.105:0/106409379 >> v1:172.21.2.105:6789/0 conn(0x7fde280b1530 legacy=0x7fde280acbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:44.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde17fff700 1 --2- 172.21.2.105:0/106409379 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fde10003780 0x7fde10003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:44.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde17fff700 1 --2- 172.21.2.105:0/106409379 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde10004500 0x7fde10004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:44.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde17fff700 1 --2- 172.21.2.105:0/106409379 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fde280b0cb0 0x7fde10004eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:44.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde17fff700 1 -- 172.21.2.105:0/106409379 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde280ad2c0 con 0x7fde10004500 2021-11-12T05:45:44.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde17fff700 1 -- 172.21.2.105:0/106409379 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1000b800 con 0x7fde10003780 2021-11-12T05:45:44.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde17fff700 1 -- 172.21.2.105:0/106409379 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde1000b9c0 con 0x7fde280b0cb0 2021-11-12T05:45:44.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde2d335700 1 --2- 172.21.2.105:0/106409379 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fde10003780 0x7fde10003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:44.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde2cb34700 1 --2- 172.21.2.105:0/106409379 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde10004500 0x7fde10004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:44.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde2db36700 1 --2- 172.21.2.105:0/106409379 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fde280b0cb0 0x7fde10004eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:44.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde2d335700 1 -- 172.21.2.105:0/106409379 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fde280b0cb0 msgr2=0x7fde10004eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:44.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde2d335700 1 --2- 172.21.2.105:0/106409379 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fde280b0cb0 0x7fde10004eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:44.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde2d335700 1 -- 172.21.2.105:0/106409379 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde10004500 msgr2=0x7fde10004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:44.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde2d335700 1 --2- 172.21.2.105:0/106409379 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde10004500 0x7fde10004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:44.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde2d335700 1 -- 172.21.2.105:0/106409379 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde10003260 con 0x7fde10003780 2021-11-12T05:45:44.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde2d335700 1 --2- 172.21.2.105:0/106409379 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fde10003780 0x7fde10003ba0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fde28140a70 tx=0x7fde24007a00).ready entity=mon.1 client_cookie=921298a7bd8079f1 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:44.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde17fff700 1 -- 172.21.2.105:0/106409379 <== mon.1 v2:172.21.2.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde24007d10 con 0x7fde10003780 2021-11-12T05:45:44.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde17fff700 1 -- 172.21.2.105:0/106409379 <== mon.1 v2:172.21.2.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde24007030 con 0x7fde10003780 2021-11-12T05:45:44.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde17fff700 1 -- 172.21.2.105:0/106409379 <== mon.1 v2:172.21.2.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde24007390 con 0x7fde10003780 2021-11-12T05:45:44.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde2e337700 1 -- 172.21.2.105:0/106409379 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fde10003780 msgr2=0x7fde10003ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:44.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde2e337700 1 --2- 172.21.2.105:0/106409379 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fde10003780 0x7fde10003ba0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fde28140a70 tx=0x7fde24007a00).stop 2021-11-12T05:45:44.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde2db36700 1 -- 172.21.2.105:0/106409379 reap_dead start 2021-11-12T05:45:44.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde2e337700 1 -- 172.21.2.105:0/106409379 shutdown_connections 2021-11-12T05:45:44.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde2e337700 1 -- 172.21.2.105:0/106409379 >> 172.21.2.105:0/106409379 conn(0x7fde280b5c50 msgr2=0x7fde280b1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:44.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde2e337700 1 -- 172.21.2.105:0/106409379 shutdown_connections 2021-11-12T05:45:44.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde2e337700 1 -- 172.21.2.105:0/106409379 wait complete. 2021-11-12T05:45:44.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.976+0000 7fde2e337700 1 Processor -- start 2021-11-12T05:45:44.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.980+0000 7fde2e337700 1 -- start start 2021-11-12T05:45:44.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.980+0000 7fde2e337700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fde10003780 0x7fde280622d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:44.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.980+0000 7fde2e337700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde280a7020 0x7fde2813ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:44.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.980+0000 7fde2e337700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fde2813ba90 0x7fde28063d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:44.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.980+0000 7fde2e337700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde28156430 con 0x7fde280a7020 2021-11-12T05:45:44.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.980+0000 7fde2e337700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde28063300 con 0x7fde2813ba90 2021-11-12T05:45:44.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.980+0000 7fde2e337700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde280635a0 con 0x7fde10003780 2021-11-12T05:45:44.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.980+0000 7fde2cb34700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde280a7020 0x7fde2813ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:44.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.980+0000 7fde2cb34700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde280a7020 0x7fde2813ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46726/0 (socket says 172.21.2.105:46726) 2021-11-12T05:45:44.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.980+0000 7fde2cb34700 1 -- 172.21.2.105:0/1128274801 learned_addr learned my addr 172.21.2.105:0/1128274801 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:44.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.980+0000 7fde2db36700 1 --2- 172.21.2.105:0/1128274801 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fde2813ba90 0x7fde28063d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:44.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.980+0000 7fde2d335700 1 --2- 172.21.2.105:0/1128274801 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fde10003780 0x7fde280622d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:44.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.980+0000 7fde2cb34700 1 -- 172.21.2.105:0/1128274801 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fde10003780 msgr2=0x7fde280622d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:44.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.980+0000 7fde2cb34700 1 --2- 172.21.2.105:0/1128274801 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fde10003780 0x7fde280622d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:45.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.980+0000 7fde2cb34700 1 -- 172.21.2.105:0/1128274801 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fde2813ba90 msgr2=0x7fde28063d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:45.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.980+0000 7fde2cb34700 1 --2- 172.21.2.105:0/1128274801 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fde2813ba90 0x7fde28063d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:45.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.980+0000 7fde2cb34700 1 -- 172.21.2.105:0/1128274801 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde2813c6f0 con 0x7fde280a7020 2021-11-12T05:45:45.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.980+0000 7fde2cb34700 1 --2- 172.21.2.105:0/1128274801 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde280a7020 0x7fde2813ca40 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7fde1800b000 tx=0x7fde18006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:45.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.980+0000 7fde167fc700 1 -- 172.21.2.105:0/1128274801 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde1800f940 con 0x7fde280a7020 2021-11-12T05:45:45.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.980+0000 7fde167fc700 1 -- 172.21.2.105:0/1128274801 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1800faa0 con 0x7fde280a7020 2021-11-12T05:45:45.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.980+0000 7fde2e337700 1 -- 172.21.2.105:0/1128274801 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde28063840 con 0x7fde280a7020 2021-11-12T05:45:45.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.980+0000 7fde167fc700 1 -- 172.21.2.105:0/1128274801 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde1800fe40 con 0x7fde280a7020 2021-11-12T05:45:45.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.980+0000 7fde2e337700 1 -- 172.21.2.105:0/1128274801 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde280644a0 con 0x7fde280a7020 2021-11-12T05:45:45.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.980+0000 7fde2e337700 1 -- 172.21.2.105:0/1128274801 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde2813be70 con 0x7fde280a7020 2021-11-12T05:45:45.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.980+0000 7fde167fc700 1 -- 172.21.2.105:0/1128274801 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fde18014440 con 0x7fde280a7020 2021-11-12T05:45:45.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.980+0000 7fde167fc700 1 --2- 172.21.2.105:0/1128274801 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fde080535b0 0x7fde08055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:45.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.980+0000 7fde167fc700 1 -- 172.21.2.105:0/1128274801 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fde1806c510 con 0x7fde280a7020 2021-11-12T05:45:45.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.980+0000 7fde2d335700 1 --2- 172.21.2.105:0/1128274801 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fde080535b0 0x7fde08055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:45.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.980+0000 7fde2d335700 1 --2- 172.21.2.105:0/1128274801 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fde080535b0 0x7fde08055a70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fde24019000 tx=0x7fde24015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:45.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:44.984+0000 7fde167fc700 1 -- 172.21.2.105:0/1128274801 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fde180434c0 con 0x7fde280a7020 2021-11-12T05:45:45.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.096+0000 7fde2e337700 1 -- 172.21.2.105:0/1128274801 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fde280ac370 con 0x7fde280a7020 2021-11-12T05:45:45.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.100+0000 7fde167fc700 1 -- 172.21.2.105:0/1128274801 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v23) v1 ==== 184+0+0 (secure 0 0 0) 0x7fde18046ae0 con 0x7fde280a7020 2021-11-12T05:45:45.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.104+0000 7fde2e337700 1 -- 172.21.2.105:0/1128274801 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fde080535b0 msgr2=0x7fde08055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:45.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.104+0000 7fde2e337700 1 --2- 172.21.2.105:0/1128274801 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fde080535b0 0x7fde08055a70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fde24019000 tx=0x7fde24015000).stop 2021-11-12T05:45:45.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.104+0000 7fde2e337700 1 -- 172.21.2.105:0/1128274801 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde280a7020 msgr2=0x7fde2813ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:45.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.104+0000 7fde2e337700 1 --2- 172.21.2.105:0/1128274801 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde280a7020 0x7fde2813ca40 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7fde1800b000 tx=0x7fde18006df0).stop 2021-11-12T05:45:45.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.104+0000 7fde2e337700 1 -- 172.21.2.105:0/1128274801 shutdown_connections 2021-11-12T05:45:45.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.104+0000 7fde2e337700 1 --2- 172.21.2.105:0/1128274801 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fde080535b0 0x7fde08055a70 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:45.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.104+0000 7fde2e337700 1 --2- 172.21.2.105:0/1128274801 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fde2813ba90 0x7fde28063d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:45.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.104+0000 7fde2e337700 1 --2- 172.21.2.105:0/1128274801 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde280a7020 0x7fde2813ca40 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:45.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.104+0000 7fde2e337700 1 --2- 172.21.2.105:0/1128274801 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fde10003780 0x7fde280622d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:45.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.104+0000 7fde2e337700 1 -- 172.21.2.105:0/1128274801 >> 172.21.2.105:0/1128274801 conn(0x7fde280b5c50 msgr2=0x7fde280ac6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:45.110 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.104+0000 7fde2e337700 1 -- 172.21.2.105:0/1128274801 shutdown_connections 2021-11-12T05:45:45.110 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.104+0000 7fde2e337700 1 -- 172.21.2.105:0/1128274801 wait complete. 2021-11-12T05:45:45.110 INFO:teuthology.orchestra.run.gibba005.stderr:updated caps for client.1 2021-11-12T05:45:45.114 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-12T05:45:45.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.164+0000 7f4ef0fae700 1 Processor -- start 2021-11-12T05:45:45.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.164+0000 7f4ef0fae700 1 -- start start 2021-11-12T05:45:45.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.164+0000 7f4ef0fae700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f4eec0ac280 0x7f4eec14b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:45.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.164+0000 7f4ef0fae700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4eec0af730 0x7f4eec0ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:45.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.164+0000 7f4ef0fae700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eec0ac7b0 con 0x7f4eec0ad080 2021-11-12T05:45:45.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.164+0000 7f4ef0fae700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eec1488a0 con 0x7f4eec0ac280 2021-11-12T05:45:45.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.164+0000 7f4ef0fae700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec0ac9e0 con 0x7f4eec0af730 2021-11-12T05:45:45.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.164+0000 7f4eea59c700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f4eec0ad080 0x7f4eec14abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57130/0 (socket says 172.21.2.105:57130) 2021-11-12T05:45:45.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.164+0000 7f4eea59c700 1 -- 172.21.2.105:0/1258585377 learned_addr learned my addr 172.21.2.105:0/1258585377 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:45:45.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.164+0000 7f4ee959a700 1 -- 172.21.2.105:0/1258585377 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3768062599 0 0) 0x7f4eec0ac7b0 con 0x7f4eec0ad080 2021-11-12T05:45:45.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.164+0000 7f4ee959a700 1 -- 172.21.2.105:0/1258585377 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ed0003260 con 0x7f4eec0ad080 2021-11-12T05:45:45.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.164+0000 7f4ee959a700 1 -- 172.21.2.105:0/1258585377 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1567691131 0 0) 0x7f4ed0003260 con 0x7f4eec0ad080 2021-11-12T05:45:45.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.164+0000 7f4ee959a700 1 -- 172.21.2.105:0/1258585377 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4eec0af730 msgr2=0x7f4eec0ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:45.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.164+0000 7f4ee959a700 1 --2- 172.21.2.105:0/1258585377 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4eec0af730 0x7f4eec0ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:45.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.164+0000 7f4ee959a700 1 -- 172.21.2.105:0/1258585377 >> v2:172.21.2.115:3300/0 conn(0x7f4eec0ac280 msgr2=0x7f4eec14b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:45.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.164+0000 7f4ee959a700 1 --2- 172.21.2.105:0/1258585377 >> v2:172.21.2.115:3300/0 conn(0x7f4eec0ac280 0x7f4eec14b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:45.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.164+0000 7f4ee959a700 1 -- 172.21.2.105:0/1258585377 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eec0b0b30 con 0x7f4eec0ad080 2021-11-12T05:45:45.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.164+0000 7f4ee959a700 1 -- 172.21.2.105:0/1258585377 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f4ee0001660 con 0x7f4eec0ad080 2021-11-12T05:45:45.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.164+0000 7f4ee959a700 1 -- 172.21.2.105:0/1258585377 >> v1:172.21.2.105:6789/0 conn(0x7f4eec0ad080 legacy=0x7f4eec14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:45.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.164+0000 7f4ee959a700 1 --2- 172.21.2.105:0/1258585377 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4ed00037d0 0x7f4ed0003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:45.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.164+0000 7f4ee959a700 1 --2- 172.21.2.105:0/1258585377 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4ed0004500 0x7f4ed0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:45.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.164+0000 7f4ee959a700 1 --2- 172.21.2.105:0/1258585377 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4eec0af730 0x7f4ed000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:45.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.164+0000 7f4ee959a700 1 -- 172.21.2.105:0/1258585377 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec1488a0 con 0x7f4ed0004500 2021-11-12T05:45:45.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.164+0000 7f4ee959a700 1 -- 172.21.2.105:0/1258585377 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec0ac9e0 con 0x7f4ed00037d0 2021-11-12T05:45:45.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.164+0000 7f4ee959a700 1 -- 172.21.2.105:0/1258585377 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed0005330 con 0x7f4eec0af730 2021-11-12T05:45:45.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.164+0000 7f4ee9d9b700 1 --2- 172.21.2.105:0/1258585377 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4ed0004500 0x7f4ed0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:45.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.164+0000 7f4eea59c700 1 --2- 172.21.2.105:0/1258585377 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4ed00037d0 0x7f4ed0003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:45.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.164+0000 7f4ee9d9b700 1 -- 172.21.2.105:0/1258585377 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4eec0af730 msgr2=0x7f4ed000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:45.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.164+0000 7f4ee9d9b700 1 --2- 172.21.2.105:0/1258585377 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4eec0af730 0x7f4ed000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:45.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.164+0000 7f4ee9d9b700 1 -- 172.21.2.105:0/1258585377 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4ed00037d0 msgr2=0x7f4ed0003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:45.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.164+0000 7f4ee9d9b700 1 --2- 172.21.2.105:0/1258585377 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4ed00037d0 0x7f4ed0003bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:45.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.164+0000 7f4ee9d9b700 1 -- 172.21.2.105:0/1258585377 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed0003260 con 0x7f4ed0004500 2021-11-12T05:45:45.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.164+0000 7f4ee9d9b700 1 --2- 172.21.2.105:0/1258585377 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4ed0004500 0x7f4ed0004980 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7f4edc002f70 tx=0x7f4edc006ca0).ready entity=mon.0 client_cookie=2bbadcf24314641b server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:45.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.164+0000 7f4ee959a700 1 -- 172.21.2.105:0/1258585377 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4edc012410 con 0x7f4ed0004500 2021-11-12T05:45:45.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.164+0000 7f4ee959a700 1 -- 172.21.2.105:0/1258585377 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4edc012570 con 0x7f4ed0004500 2021-11-12T05:45:45.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.164+0000 7f4ee959a700 1 -- 172.21.2.105:0/1258585377 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4edc0128d0 con 0x7f4ed0004500 2021-11-12T05:45:45.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.168+0000 7f4ef0fae700 1 -- 172.21.2.105:0/1258585377 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4ed0004500 msgr2=0x7f4ed0004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:45.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.168+0000 7f4ef0fae700 1 --2- 172.21.2.105:0/1258585377 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4ed0004500 0x7f4ed0004980 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7f4edc002f70 tx=0x7f4edc006ca0).stop 2021-11-12T05:45:45.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.168+0000 7f4eead9d700 1 -- 172.21.2.105:0/1258585377 reap_dead start 2021-11-12T05:45:45.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.168+0000 7f4ef0fae700 1 -- 172.21.2.105:0/1258585377 shutdown_connections 2021-11-12T05:45:45.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.168+0000 7f4ef0fae700 1 -- 172.21.2.105:0/1258585377 >> 172.21.2.105:0/1258585377 conn(0x7f4eec0b5370 msgr2=0x7f4eec0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:45.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.168+0000 7f4ef0fae700 1 -- 172.21.2.105:0/1258585377 shutdown_connections 2021-11-12T05:45:45.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.168+0000 7f4ef0fae700 1 -- 172.21.2.105:0/1258585377 wait complete. 2021-11-12T05:45:45.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.168+0000 7f4ef0fae700 1 Processor -- start 2021-11-12T05:45:45.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.168+0000 7f4ef0fae700 1 -- start start 2021-11-12T05:45:45.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.168+0000 7f4ef0fae700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4ed0004500 0x7f4eec0aaa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:45.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.168+0000 7f4ef0fae700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4eec0ab2e0 0x7f4eec157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:45.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.168+0000 7f4ef0fae700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4eec0a7020 0x7f4eec0a74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:45.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.168+0000 7f4ef0fae700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec0629b0 con 0x7f4eec0a7020 2021-11-12T05:45:45.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.168+0000 7f4ef0fae700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec0ab740 con 0x7f4eec0ab2e0 2021-11-12T05:45:45.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.168+0000 7f4ef0fae700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec0a7990 con 0x7f4ed0004500 2021-11-12T05:45:45.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.168+0000 7f4eead9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4eec0a7020 0x7f4eec0a74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:45.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.168+0000 7f4eead9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4eec0a7020 0x7f4eec0a74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46750/0 (socket says 172.21.2.105:46750) 2021-11-12T05:45:45.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.168+0000 7f4eead9d700 1 -- 172.21.2.105:0/3740893202 learned_addr learned my addr 172.21.2.105:0/3740893202 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:45.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.168+0000 7f4eead9d700 1 -- 172.21.2.105:0/3740893202 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4ed0004500 msgr2=0x7f4eec0aaa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:45.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.168+0000 7f4eead9d700 1 --2- 172.21.2.105:0/3740893202 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4ed0004500 0x7f4eec0aaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:45.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.168+0000 7f4eead9d700 1 -- 172.21.2.105:0/3740893202 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4eec0ab2e0 msgr2=0x7f4eec157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:45.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.168+0000 7f4eead9d700 1 --2- 172.21.2.105:0/3740893202 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4eec0ab2e0 0x7f4eec157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:45.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.168+0000 7f4eead9d700 1 -- 172.21.2.105:0/3740893202 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eec157e60 con 0x7f4eec0a7020 2021-11-12T05:45:45.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.168+0000 7f4eead9d700 1 --2- 172.21.2.105:0/3740893202 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4eec0a7020 0x7f4eec0a74a0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f4eec157850 tx=0x7f4ee4007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:45.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.168+0000 7f4edb7fe700 1 -- 172.21.2.105:0/3740893202 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ee4005a20 con 0x7f4eec0a7020 2021-11-12T05:45:45.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.168+0000 7f4ef0fae700 1 -- 172.21.2.105:0/3740893202 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eec156f90 con 0x7f4eec0a7020 2021-11-12T05:45:45.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.168+0000 7f4ef0fae700 1 -- 172.21.2.105:0/3740893202 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eec0a9e60 con 0x7f4eec0a7020 2021-11-12T05:45:45.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.168+0000 7f4edb7fe700 1 -- 172.21.2.105:0/3740893202 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee4005b80 con 0x7f4eec0a7020 2021-11-12T05:45:45.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.168+0000 7f4edb7fe700 1 -- 172.21.2.105:0/3740893202 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ee4007110 con 0x7f4eec0a7020 2021-11-12T05:45:45.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.168+0000 7f4ef0fae700 1 -- 172.21.2.105:0/3740893202 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ec4003410 con 0x7f4eec0a7020 2021-11-12T05:45:45.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.168+0000 7f4edb7fe700 1 -- 172.21.2.105:0/3740893202 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4ee401b060 con 0x7f4eec0a7020 2021-11-12T05:45:45.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.168+0000 7f4edb7fe700 1 --2- 172.21.2.105:0/3740893202 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4ec80536a0 0x7f4ec8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:45.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.168+0000 7f4edb7fe700 1 -- 172.21.2.105:0/3740893202 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f4ee406b200 con 0x7f4eec0a7020 2021-11-12T05:45:45.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.168+0000 7f4eea59c700 1 --2- 172.21.2.105:0/3740893202 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4ec80536a0 0x7f4ec8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:45.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.168+0000 7f4eea59c700 1 --2- 172.21.2.105:0/3740893202 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4ec80536a0 0x7f4ec8055b60 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f4ee0008000 tx=0x7f4ee0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:45.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.172+0000 7f4edb7fe700 1 -- 172.21.2.105:0/3740893202 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4ee40420a0 con 0x7f4eec0a7020 2021-11-12T05:45:45.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.284+0000 7f4ef0fae700 1 -- 172.21.2.105:0/3740893202 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f4ec40036c0 con 0x7f4eec0a7020 2021-11-12T05:45:45.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.288+0000 7f4edb7fe700 1 -- 172.21.2.105:0/3740893202 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v24) v1 ==== 184+0+0 (secure 0 0 0) 0x7f4ee4019020 con 0x7f4eec0a7020 2021-11-12T05:45:45.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.292+0000 7f4ef0fae700 1 -- 172.21.2.105:0/3740893202 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4ec80536a0 msgr2=0x7f4ec8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:45.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.292+0000 7f4ef0fae700 1 --2- 172.21.2.105:0/3740893202 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4ec80536a0 0x7f4ec8055b60 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f4ee0008000 tx=0x7f4ee0009040).stop 2021-11-12T05:45:45.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.292+0000 7f4ef0fae700 1 -- 172.21.2.105:0/3740893202 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4eec0a7020 msgr2=0x7f4eec0a74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:45.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.292+0000 7f4ef0fae700 1 --2- 172.21.2.105:0/3740893202 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4eec0a7020 0x7f4eec0a74a0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f4eec157850 tx=0x7f4ee4007f40).stop 2021-11-12T05:45:45.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.292+0000 7f4ef0fae700 1 -- 172.21.2.105:0/3740893202 shutdown_connections 2021-11-12T05:45:45.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.292+0000 7f4ef0fae700 1 --2- 172.21.2.105:0/3740893202 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4ec80536a0 0x7f4ec8055b60 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:45.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.292+0000 7f4ef0fae700 1 --2- 172.21.2.105:0/3740893202 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4eec0a7020 0x7f4eec0a74a0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:45.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.292+0000 7f4ef0fae700 1 --2- 172.21.2.105:0/3740893202 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4eec0ab2e0 0x7f4eec157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:45.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.292+0000 7f4ef0fae700 1 --2- 172.21.2.105:0/3740893202 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4ed0004500 0x7f4eec0aaa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:45.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.292+0000 7f4ef0fae700 1 -- 172.21.2.105:0/3740893202 >> 172.21.2.105:0/3740893202 conn(0x7f4eec0b5370 msgr2=0x7f4eec143f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:45.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.292+0000 7f4ef0fae700 1 -- 172.21.2.105:0/3740893202 shutdown_connections 2021-11-12T05:45:45.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.292+0000 7f4ef0fae700 1 -- 172.21.2.105:0/3740893202 wait complete. 2021-11-12T05:45:45.298 INFO:teuthology.orchestra.run.gibba005.stderr:updated caps for client.2 2021-11-12T05:45:45.301 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:45:45.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.348+0000 7f41cced6700 1 Processor -- start 2021-11-12T05:45:45.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.348+0000 7f41cced6700 1 -- start start 2021-11-12T05:45:45.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.348+0000 7f41cced6700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f41c80ad080 0x7f41c80af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:45.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.348+0000 7f41cced6700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f41c80ac280 0x7f41c80ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:45.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.348+0000 7f41cced6700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f41c814abe0 0x7f41c814b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:45.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.348+0000 7f41cced6700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41c81488a0 con 0x7f41c814abe0 2021-11-12T05:45:45.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.348+0000 7f41cced6700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41c80ac7b0 con 0x7f41c80ad080 2021-11-12T05:45:45.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.348+0000 7f41cced6700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c80ac9e0 con 0x7f41c80ac280 2021-11-12T05:45:45.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.348+0000 7f41c6d9d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f41c814abe0 0x7f41c814b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:45.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.348+0000 7f41c6d9d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f41c814abe0 0x7f41c814b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46754/0 (socket says 172.21.2.105:46754) 2021-11-12T05:45:45.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.348+0000 7f41c6d9d700 1 -- 172.21.2.105:0/3100776049 learned_addr learned my addr 172.21.2.105:0/3100776049 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:45.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.348+0000 7f41c6d9d700 1 -- 172.21.2.105:0/3100776049 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f41c80ac280 msgr2=0x7f41c80ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:45.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.348+0000 7f41c6d9d700 1 --2- 172.21.2.105:0/3100776049 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f41c80ac280 0x7f41c80ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:45.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.348+0000 7f41c6d9d700 1 -- 172.21.2.105:0/3100776049 >> v2:172.21.2.115:3300/0 conn(0x7f41c80ad080 msgr2=0x7f41c80af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:45.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.348+0000 7f41c6d9d700 1 --2- 172.21.2.105:0/3100776049 >> v2:172.21.2.115:3300/0 conn(0x7f41c80ad080 0x7f41c80af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:45.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.348+0000 7f41c6d9d700 1 -- 172.21.2.105:0/3100776049 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c80b0b30 con 0x7f41c814abe0 2021-11-12T05:45:45.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.348+0000 7f41c6d9d700 1 --2- 172.21.2.105:0/3100776049 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f41c814abe0 0x7f41c814b090 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7f41c80ac6a0 tx=0x7f41c0009290).ready entity=mon.0 client_cookie=f257bd147321f025 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:45.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.348+0000 7f41c559a700 1 -- 172.21.2.105:0/3100776049 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41c000b830 con 0x7f41c814abe0 2021-11-12T05:45:45.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.348+0000 7f41c559a700 1 -- 172.21.2.105:0/3100776049 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c000b990 con 0x7f41c814abe0 2021-11-12T05:45:45.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.348+0000 7f41c559a700 1 -- 172.21.2.105:0/3100776049 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41c000bb00 con 0x7f41c814abe0 2021-11-12T05:45:45.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.348+0000 7f41cced6700 1 -- 172.21.2.105:0/3100776049 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f41c814abe0 msgr2=0x7f41c814b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:45.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.348+0000 7f41cced6700 1 --2- 172.21.2.105:0/3100776049 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f41c814abe0 0x7f41c814b090 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7f41c80ac6a0 tx=0x7f41c0009290).stop 2021-11-12T05:45:45.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.348+0000 7f41cced6700 1 -- 172.21.2.105:0/3100776049 shutdown_connections 2021-11-12T05:45:45.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.348+0000 7f41cced6700 1 --2- 172.21.2.105:0/3100776049 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f41c814abe0 0x7f41c814b090 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:45.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.348+0000 7f41cced6700 1 --2- 172.21.2.105:0/3100776049 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f41c80ac280 0x7f41c80ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:45.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.348+0000 7f41cced6700 1 --2- 172.21.2.105:0/3100776049 >> v2:172.21.2.115:3300/0 conn(0x7f41c80ad080 0x7f41c80af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:45.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.348+0000 7f41cced6700 1 -- 172.21.2.105:0/3100776049 >> 172.21.2.105:0/3100776049 conn(0x7f41c80b5370 msgr2=0x7f41c80b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:45.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.348+0000 7f41cced6700 1 -- 172.21.2.105:0/3100776049 shutdown_connections 2021-11-12T05:45:45.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.348+0000 7f41cced6700 1 -- 172.21.2.105:0/3100776049 wait complete. 2021-11-12T05:45:45.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.352+0000 7f41cced6700 1 Processor -- start 2021-11-12T05:45:45.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.352+0000 7f41cced6700 1 -- start start 2021-11-12T05:45:45.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.352+0000 7f41cced6700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f41c80ac280 0x7f41c8156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:45.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.352+0000 7f41cced6700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f41c80ad080 0x7f41c80a7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:45.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.352+0000 7f41cced6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f41c814abe0 0x7f41c80aacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:45.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.352+0000 7f41cced6700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c80a9660 con 0x7f41c814abe0 2021-11-12T05:45:45.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.352+0000 7f41cced6700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c815ac80 con 0x7f41c80ad080 2021-11-12T05:45:45.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.352+0000 7f41cced6700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c815af20 con 0x7f41c80ac280 2021-11-12T05:45:45.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.352+0000 7f41c6d9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f41c814abe0 0x7f41c80aacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:45.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.352+0000 7f41c6d9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f41c814abe0 0x7f41c80aacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46762/0 (socket says 172.21.2.105:46762) 2021-11-12T05:45:45.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.352+0000 7f41c6d9d700 1 -- 172.21.2.105:0/2106279092 learned_addr learned my addr 172.21.2.105:0/2106279092 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:45.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.352+0000 7f41c5d9b700 1 --2- 172.21.2.105:0/2106279092 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f41c80ad080 0x7f41c80a7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:45.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.352+0000 7f41c6d9d700 1 -- 172.21.2.105:0/2106279092 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f41c80ac280 msgr2=0x7f41c8156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:45.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.352+0000 7f41c6d9d700 1 --2- 172.21.2.105:0/2106279092 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f41c80ac280 0x7f41c8156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:45.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.352+0000 7f41c6d9d700 1 -- 172.21.2.105:0/2106279092 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f41c80ad080 msgr2=0x7f41c80a7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:45.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.352+0000 7f41c6d9d700 1 --2- 172.21.2.105:0/2106279092 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f41c80ad080 0x7f41c80a7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:45.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.352+0000 7f41c6d9d700 1 -- 172.21.2.105:0/2106279092 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c0009530 con 0x7f41c814abe0 2021-11-12T05:45:45.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.352+0000 7f41c5d9b700 1 --2- 172.21.2.105:0/2106279092 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f41c80ad080 0x7f41c80a7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:45:45.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.352+0000 7f41c6d9d700 1 --2- 172.21.2.105:0/2106279092 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f41c814abe0 0x7f41c80aacc0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7f41c80ac6a0 tx=0x7f41c0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:45.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.352+0000 7f41bf7fe700 1 -- 172.21.2.105:0/2106279092 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41c000bb00 con 0x7f41c814abe0 2021-11-12T05:45:45.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.352+0000 7f41bf7fe700 1 -- 172.21.2.105:0/2106279092 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c001f420 con 0x7f41c814abe0 2021-11-12T05:45:45.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.352+0000 7f41bf7fe700 1 -- 172.21.2.105:0/2106279092 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41c001f780 con 0x7f41c814abe0 2021-11-12T05:45:45.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.352+0000 7f41cced6700 1 -- 172.21.2.105:0/2106279092 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41c8157d30 con 0x7f41c814abe0 2021-11-12T05:45:45.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.352+0000 7f41cced6700 1 -- 172.21.2.105:0/2106279092 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41c80a9260 con 0x7f41c814abe0 2021-11-12T05:45:45.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.352+0000 7f41cced6700 1 -- 172.21.2.105:0/2106279092 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41c815b0e0 con 0x7f41c814abe0 2021-11-12T05:45:45.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.352+0000 7f41bf7fe700 1 -- 172.21.2.105:0/2106279092 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f41c0026030 con 0x7f41c814abe0 2021-11-12T05:45:45.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.352+0000 7f41bf7fe700 1 --2- 172.21.2.105:0/2106279092 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f41ac053660 0x7f41ac055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:45.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.352+0000 7f41bf7fe700 1 -- 172.21.2.105:0/2106279092 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f41c006c700 con 0x7f41c814abe0 2021-11-12T05:45:45.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.352+0000 7f41c659c700 1 --2- 172.21.2.105:0/2106279092 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f41ac053660 0x7f41ac055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:45.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.352+0000 7f41c659c700 1 --2- 172.21.2.105:0/2106279092 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f41ac053660 0x7f41ac055b20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f41b0002f70 tx=0x7f41b0006a00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:45.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.356+0000 7f41bf7fe700 1 -- 172.21.2.105:0/2106279092 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f41c0043710 con 0x7f41c814abe0 2021-11-12T05:45:45.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.468+0000 7f41cced6700 1 -- 172.21.2.105:0/2106279092 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f41c814b580 con 0x7f41c814abe0 2021-11-12T05:45:45.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.468+0000 7f41bf7fe700 1 -- 172.21.2.105:0/2106279092 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+2134 (secure 0 0 0) 0x7f41c0024870 con 0x7f41c814abe0 2021-11-12T05:45:45.473 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:45:45.473 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":25,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/37307717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":37307717},{"type":"v1","addr":"172.21.2.115:6833","nonce":37307717}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":23}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:45:43.349890+0000","modified":"2021-11-12T05:45:44.353136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5973},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5973":{"gid":5973,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/1667092126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":1667092126},{"type":"v1","addr":"172.21.2.105:6835","nonce":1667092126}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-11-12T05:45:45.474 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.468+0000 7f41cced6700 1 -- 172.21.2.105:0/2106279092 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f41ac053660 msgr2=0x7f41ac055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:45.474 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.468+0000 7f41cced6700 1 --2- 172.21.2.105:0/2106279092 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f41ac053660 0x7f41ac055b20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f41b0002f70 tx=0x7f41b0006a00).stop 2021-11-12T05:45:45.475 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.468+0000 7f41cced6700 1 -- 172.21.2.105:0/2106279092 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f41c814abe0 msgr2=0x7f41c80aacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:45.475 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.468+0000 7f41cced6700 1 --2- 172.21.2.105:0/2106279092 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f41c814abe0 0x7f41c80aacc0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7f41c80ac6a0 tx=0x7f41c0016000).stop 2021-11-12T05:45:45.475 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.468+0000 7f41cced6700 1 -- 172.21.2.105:0/2106279092 shutdown_connections 2021-11-12T05:45:45.475 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.468+0000 7f41cced6700 1 --2- 172.21.2.105:0/2106279092 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f41ac053660 0x7f41ac055b20 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:45.475 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.468+0000 7f41cced6700 1 --2- 172.21.2.105:0/2106279092 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f41c814abe0 0x7f41c80aacc0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:45.476 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.468+0000 7f41cced6700 1 --2- 172.21.2.105:0/2106279092 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f41c80ad080 0x7f41c80a7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:45.476 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.468+0000 7f41cced6700 1 --2- 172.21.2.105:0/2106279092 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f41c80ac280 0x7f41c8156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:45.476 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.468+0000 7f41cced6700 1 -- 172.21.2.105:0/2106279092 >> 172.21.2.105:0/2106279092 conn(0x7f41c80b5370 msgr2=0x7f41c81443c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:45.476 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.468+0000 7f41cced6700 1 -- 172.21.2.105:0/2106279092 shutdown_connections 2021-11-12T05:45:45.477 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.468+0000 7f41cced6700 1 -- 172.21.2.105:0/2106279092 wait complete. 2021-11-12T05:45:45.477 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 25 2021-11-12T05:45:45.682 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:45:43.349890+0000', 'modified': '2021-11-12T05:45:44.353136+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5973}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5973': {'gid': 5973, 'name': 'a', 'rank': 0, 'incarnation': 24, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/1667092126', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 1667092126}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 1667092126}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:45:45.683 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:45:45.683 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:45:45.747 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":5973,"want_state":"up:active","state":"up:active","rank_uptime":2.3907791889999999,"mdsmap_epoch":25,"osdmap_epoch":65,"osdmap_epoch_barrier":64,"uptime":6.5901152209999996} 2021-11-12T05:45:45.748 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 5973, "mdsmap_epoch": 25, "osdmap_epoch": 65, "osdmap_epoch_barrier": 64, "rank_uptime": 2.390779189, "state": "up:active", "uptime": 6.590115221, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:45:45.749 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:45:45.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6bc5dd700 1 Processor -- start 2021-11-12T05:45:45.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6bc5dd700 1 -- start start 2021-11-12T05:45:45.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6bc5dd700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fb6b40601a0 0x7fb6b4141470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:45.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6bc5dd700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6b4066150 con 0x7fb6b40ade80 2021-11-12T05:45:45.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6bc5dd700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6b40663f0 con 0x7fb6b405fdc0 2021-11-12T05:45:45.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6bc5dd700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6b4141fb0 con 0x7fb6b40601a0 2021-11-12T05:45:45.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6b9b78700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fb6b40ade80 0x7fb6b413a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57166/0 (socket says 172.21.2.105:57166) 2021-11-12T05:45:45.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6b9b78700 1 -- 172.21.2.105:0/2547819451 learned_addr learned my addr 172.21.2.105:0/2547819451 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:45:45.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6b9377700 1 -- 172.21.2.105:0/2547819451 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1829031464 0 0) 0x7fb6b4066150 con 0x7fb6b40ade80 2021-11-12T05:45:45.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6b9377700 1 -- 172.21.2.105:0/2547819451 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb69c003260 con 0x7fb6b40ade80 2021-11-12T05:45:45.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6bab7a700 1 --2- 172.21.2.105:0/2547819451 >> v2:172.21.2.115:3300/0 conn(0x7fb6b40601a0 0x7fb6b4141470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:45.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6b9377700 1 -- 172.21.2.105:0/2547819451 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1160978515 0 0) 0x7fb69c003260 con 0x7fb6b40ade80 2021-11-12T05:45:45.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6b9377700 1 -- 172.21.2.105:0/2547819451 >> v2:172.21.2.115:3300/0 conn(0x7fb6b40601a0 msgr2=0x7fb6b4141470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:45.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6b9377700 1 --2- 172.21.2.105:0/2547819451 >> v2:172.21.2.115:3300/0 conn(0x7fb6b40601a0 0x7fb6b4141470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:45.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6b9377700 1 -- 172.21.2.105:0/2547819451 >> v1:172.21.2.115:6789/0 conn(0x7fb6b405fdc0 legacy=0x7fb6b4066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:45.811 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6b9377700 1 -- 172.21.2.105:0/2547819451 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b4140fd0 con 0x7fb6b40ade80 2021-11-12T05:45:45.811 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6b9377700 1 -- 172.21.2.105:0/2547819451 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fb6a4001660 con 0x7fb6b40ade80 2021-11-12T05:45:45.811 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6b9377700 1 -- 172.21.2.105:0/2547819451 >> v1:172.21.2.105:6789/0 conn(0x7fb6b40ade80 legacy=0x7fb6b413a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:45.811 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6b9377700 1 --2- 172.21.2.105:0/2547819451 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb69c003820 0x7fb69c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:45.812 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6b9377700 1 --2- 172.21.2.105:0/2547819451 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb69c004500 0x7fb69c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:45.812 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6b9377700 1 --2- 172.21.2.105:0/2547819451 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb69c004f70 0x7fb69c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:45.812 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6b9377700 1 -- 172.21.2.105:0/2547819451 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69c00be20 con 0x7fb69c004500 2021-11-12T05:45:45.812 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6b9377700 1 -- 172.21.2.105:0/2547819451 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69c00bf90 con 0x7fb69c003820 2021-11-12T05:45:45.812 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6b9377700 1 -- 172.21.2.105:0/2547819451 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb69c00c150 con 0x7fb69c004f70 2021-11-12T05:45:45.813 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6b9b78700 1 --2- 172.21.2.105:0/2547819451 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb69c004500 0x7fb69c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:45.813 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6b9b78700 1 -- 172.21.2.105:0/2547819451 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb69c004f70 msgr2=0x7fb69c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:45.813 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6b9b78700 1 --2- 172.21.2.105:0/2547819451 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb69c004f70 0x7fb69c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:45.813 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6b9b78700 1 -- 172.21.2.105:0/2547819451 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb69c003820 msgr2=0x7fb69c003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:45.813 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6b9b78700 1 --2- 172.21.2.105:0/2547819451 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb69c003820 0x7fb69c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:45.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6b9b78700 1 -- 172.21.2.105:0/2547819451 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb69c003260 con 0x7fb69c004500 2021-11-12T05:45:45.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6bab7a700 1 -- 172.21.2.105:0/2547819451 reap_dead start 2021-11-12T05:45:45.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6b9b78700 1 --2- 172.21.2.105:0/2547819451 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb69c004500 0x7fb69c004980 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7fb6b4060ea0 tx=0x7fb6b40662e0).ready entity=mon.0 client_cookie=80e94a9ba49f7339 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:45.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6b9377700 1 -- 172.21.2.105:0/2547819451 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6a40070d0 con 0x7fb69c004500 2021-11-12T05:45:45.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6b9377700 1 -- 172.21.2.105:0/2547819451 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a4007230 con 0x7fb69c004500 2021-11-12T05:45:45.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6b9377700 1 -- 172.21.2.105:0/2547819451 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6a400c8f0 con 0x7fb69c004500 2021-11-12T05:45:45.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6bc5dd700 1 -- 172.21.2.105:0/2547819451 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb69c004500 msgr2=0x7fb69c004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:45.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6bc5dd700 1 --2- 172.21.2.105:0/2547819451 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb69c004500 0x7fb69c004980 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7fb6b4060ea0 tx=0x7fb6b40662e0).stop 2021-11-12T05:45:45.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6bc5dd700 1 -- 172.21.2.105:0/2547819451 shutdown_connections 2021-11-12T05:45:45.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6bc5dd700 1 --2- 172.21.2.105:0/2547819451 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb69c004500 0x7fb69c004980 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:45.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6bc5dd700 1 -- 172.21.2.105:0/2547819451 >> 172.21.2.105:0/2547819451 conn(0x7fb6b40608d0 msgr2=0x7fb6b405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:45.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6bc5dd700 1 -- 172.21.2.105:0/2547819451 shutdown_connections 2021-11-12T05:45:45.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.796+0000 7fb6bc5dd700 1 -- 172.21.2.105:0/2547819451 wait complete. 2021-11-12T05:45:45.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.800+0000 7fb6bc5dd700 1 Processor -- start 2021-11-12T05:45:45.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.800+0000 7fb6bc5dd700 1 -- start start 2021-11-12T05:45:45.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.800+0000 7fb6bc5dd700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb69c004500 0x7fb6b41310e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:45.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.800+0000 7fb6bc5dd700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb6b40afa80 0x7fb6b4159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:45.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.800+0000 7fb6bc5dd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6b40aff00 0x7fb6b4159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:45.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.800+0000 7fb6bc5dd700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b41597f0 con 0x7fb6b40aff00 2021-11-12T05:45:45.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.800+0000 7fb6bc5dd700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b40b0c40 con 0x7fb6b40afa80 2021-11-12T05:45:45.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.800+0000 7fb6bc5dd700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b40b0ee0 con 0x7fb69c004500 2021-11-12T05:45:45.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.800+0000 7fb6bab7a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6b40aff00 0x7fb6b4159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:45.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.800+0000 7fb6bab7a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6b40aff00 0x7fb6b4159fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46782/0 (socket says 172.21.2.105:46782) 2021-11-12T05:45:45.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.800+0000 7fb6bab7a700 1 -- 172.21.2.105:0/1934478420 learned_addr learned my addr 172.21.2.105:0/1934478420 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:45.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.800+0000 7fb6bab7a700 1 -- 172.21.2.105:0/1934478420 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb69c004500 msgr2=0x7fb6b41310e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:45.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.800+0000 7fb6bab7a700 1 --2- 172.21.2.105:0/1934478420 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb69c004500 0x7fb6b41310e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:45.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.800+0000 7fb6bab7a700 1 -- 172.21.2.105:0/1934478420 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb6b40afa80 msgr2=0x7fb6b4159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:45.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.800+0000 7fb6bab7a700 1 --2- 172.21.2.105:0/1934478420 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb6b40afa80 0x7fb6b4159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:45.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.800+0000 7fb6bab7a700 1 -- 172.21.2.105:0/1934478420 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b40b1180 con 0x7fb6b40aff00 2021-11-12T05:45:45.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.800+0000 7fb6bab7a700 1 --2- 172.21.2.105:0/1934478420 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6b40aff00 0x7fb6b4159fb0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7fb6ac000b60 tx=0x7fb6ac008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:45.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.800+0000 7fb6a37fe700 1 -- 172.21.2.105:0/1934478420 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6ac00c070 con 0x7fb6b40aff00 2021-11-12T05:45:45.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.800+0000 7fb6a37fe700 1 -- 172.21.2.105:0/1934478420 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ac0135e0 con 0x7fb6b40aff00 2021-11-12T05:45:45.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.800+0000 7fb6bc5dd700 1 -- 172.21.2.105:0/1934478420 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6b41317c0 con 0x7fb6b40aff00 2021-11-12T05:45:45.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.800+0000 7fb6a37fe700 1 -- 172.21.2.105:0/1934478420 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6ac013940 con 0x7fb6b40aff00 2021-11-12T05:45:45.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.800+0000 7fb6bc5dd700 1 -- 172.21.2.105:0/1934478420 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6b415a6c0 con 0x7fb6b40aff00 2021-11-12T05:45:45.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.800+0000 7fb6bc5dd700 1 -- 172.21.2.105:0/1934478420 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6b40b1310 con 0x7fb6b40aff00 2021-11-12T05:45:45.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.800+0000 7fb6a37fe700 1 -- 172.21.2.105:0/1934478420 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb6ac01b030 con 0x7fb6b40aff00 2021-11-12T05:45:45.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.800+0000 7fb6a37fe700 1 --2- 172.21.2.105:0/1934478420 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb6940536a0 0x7fb694055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:45.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.800+0000 7fb6a37fe700 1 -- 172.21.2.105:0/1934478420 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fb6ac06af50 con 0x7fb6b40aff00 2021-11-12T05:45:45.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.800+0000 7fb6ba379700 1 --2- 172.21.2.105:0/1934478420 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb6940536a0 0x7fb694055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:45.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.800+0000 7fb6ba379700 1 --2- 172.21.2.105:0/1934478420 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb6940536a0 0x7fb694055b60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7fb6b0001fa0 tx=0x7fb6b00077f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:45.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.804+0000 7fb6a37fe700 1 -- 172.21.2.105:0/1934478420 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb6ac041f60 con 0x7fb6b40aff00 2021-11-12T05:45:45.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.888+0000 7fb6bc5dd700 1 -- 172.21.2.105:0/1934478420 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6b4057350 con 0x7fb6b40aff00 2021-11-12T05:45:45.892 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.888+0000 7fb6a37fe700 1 -- 172.21.2.105:0/1934478420 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+16274 (secure 0 0 0) 0x7fb6ac045580 con 0x7fb6b40aff00 2021-11-12T05:45:45.892 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:45:45.893 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":65,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:45:44.354326+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:45:41.270040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2021-11-12T05:45:42.319352+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:45:45.894 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.888+0000 7fb6bc5dd700 1 -- 172.21.2.105:0/1934478420 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb6940536a0 msgr2=0x7fb694055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:45.894 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.888+0000 7fb6bc5dd700 1 --2- 172.21.2.105:0/1934478420 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb6940536a0 0x7fb694055b60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7fb6b0001fa0 tx=0x7fb6b00077f0).stop 2021-11-12T05:45:45.895 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.888+0000 7fb6bc5dd700 1 -- 172.21.2.105:0/1934478420 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6b40aff00 msgr2=0x7fb6b4159fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:45.895 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.888+0000 7fb6bc5dd700 1 --2- 172.21.2.105:0/1934478420 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6b40aff00 0x7fb6b4159fb0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7fb6ac000b60 tx=0x7fb6ac008040).stop 2021-11-12T05:45:45.895 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.888+0000 7fb6bc5dd700 1 -- 172.21.2.105:0/1934478420 shutdown_connections 2021-11-12T05:45:45.895 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.888+0000 7fb6bc5dd700 1 --2- 172.21.2.105:0/1934478420 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb6940536a0 0x7fb694055b60 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:45.896 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.888+0000 7fb6bc5dd700 1 --2- 172.21.2.105:0/1934478420 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6b40aff00 0x7fb6b4159fb0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:45.896 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.888+0000 7fb6bc5dd700 1 --2- 172.21.2.105:0/1934478420 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb6b40afa80 0x7fb6b4159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:45.896 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.888+0000 7fb6bc5dd700 1 --2- 172.21.2.105:0/1934478420 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb69c004500 0x7fb6b41310e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:45.896 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.888+0000 7fb6bc5dd700 1 -- 172.21.2.105:0/1934478420 >> 172.21.2.105:0/1934478420 conn(0x7fb6b40608d0 msgr2=0x7fb6b4141390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:45.896 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.888+0000 7fb6bc5dd700 1 -- 172.21.2.105:0/1934478420 shutdown_connections 2021-11-12T05:45:45.897 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.888+0000 7fb6bc5dd700 1 -- 172.21.2.105:0/1934478420 wait complete. 2021-11-12T05:45:45.899 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-12T05:45:41.270040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2021-11-12T05:45:42.319352+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-12T05:45:45.900 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:45:45.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.948+0000 7fdc0f3f6700 1 Processor -- start 2021-11-12T05:45:45.953 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.948+0000 7fdc0f3f6700 1 -- start start 2021-11-12T05:45:45.955 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.948+0000 7fdc0f3f6700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fdc080b2e20 0x7fdc080b1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:45.955 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.948+0000 7fdc0f3f6700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc080ad400 con 0x7fdc0813ea50 2021-11-12T05:45:45.955 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.948+0000 7fdc0f3f6700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc080b3200 con 0x7fdc08142c50 2021-11-12T05:45:45.956 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.948+0000 7fdc0f3f6700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc080ad660 con 0x7fdc080b2e20 2021-11-12T05:45:45.956 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.948+0000 7fdc0c991700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fdc0813ea50 0x7fdc0813eec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57186/0 (socket says 172.21.2.105:57186) 2021-11-12T05:45:45.956 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.948+0000 7fdc0c991700 1 -- 172.21.2.105:0/2061673149 learned_addr learned my addr 172.21.2.105:0/2061673149 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:45:45.956 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.948+0000 7fdc0d192700 1 --2- 172.21.2.105:0/2061673149 >> v2:172.21.2.105:3300/0 conn(0x7fdc080b2e20 0x7fdc080b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:45.957 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.948+0000 7fdc0d192700 1 -- 172.21.2.105:0/2061673149 >> v1:172.21.2.115:6789/0 conn(0x7fdc08142c50 legacy=0x7fdc08143070 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:45:45.957 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.948+0000 7fdc0d192700 1 -- 172.21.2.105:0/2061673149 >> v1:172.21.2.105:6789/0 conn(0x7fdc0813ea50 legacy=0x7fdc0813eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:45.957 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.948+0000 7fdc0d192700 1 -- 172.21.2.105:0/2061673149 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc080ad900 con 0x7fdc080b2e20 2021-11-12T05:45:45.957 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.948+0000 7fdc0d192700 1 --2- 172.21.2.105:0/2061673149 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdc080b2e20 0x7fdc080b1060 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7fdc080b35c0 tx=0x7fdbfc007e90).ready entity=mon.0 client_cookie=f8b403f00210c49e server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:45.957 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.948+0000 7fdbfbfff700 1 -- 172.21.2.105:0/2061673149 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbfc00bb80 con 0x7fdc080b2e20 2021-11-12T05:45:45.958 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.948+0000 7fdbfbfff700 1 -- 172.21.2.105:0/2061673149 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbfc000e90 con 0x7fdc080b2e20 2021-11-12T05:45:45.958 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.948+0000 7fdbfbfff700 1 -- 172.21.2.105:0/2061673149 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbfc010460 con 0x7fdc080b2e20 2021-11-12T05:45:45.958 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.948+0000 7fdc0f3f6700 1 -- 172.21.2.105:0/2061673149 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdc080b2e20 msgr2=0x7fdc080b1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:45.958 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.948+0000 7fdc0f3f6700 1 --2- 172.21.2.105:0/2061673149 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdc080b2e20 0x7fdc080b1060 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7fdc080b35c0 tx=0x7fdbfc007e90).stop 2021-11-12T05:45:45.959 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.948+0000 7fdc0f3f6700 1 -- 172.21.2.105:0/2061673149 shutdown_connections 2021-11-12T05:45:45.959 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.948+0000 7fdc0f3f6700 1 --2- 172.21.2.105:0/2061673149 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdc080b2e20 0x7fdc080b1060 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:45.959 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.948+0000 7fdc0f3f6700 1 -- 172.21.2.105:0/2061673149 >> 172.21.2.105:0/2061673149 conn(0x7fdc08062f60 msgr2=0x7fdc08063370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:45.959 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.952+0000 7fdc0f3f6700 1 -- 172.21.2.105:0/2061673149 shutdown_connections 2021-11-12T05:45:45.960 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.952+0000 7fdc0f3f6700 1 -- 172.21.2.105:0/2061673149 wait complete. 2021-11-12T05:45:45.960 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.952+0000 7fdc0f3f6700 1 Processor -- start 2021-11-12T05:45:45.960 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.952+0000 7fdc0f3f6700 1 -- start start 2021-11-12T05:45:45.962 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.952+0000 7fdc0f3f6700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdc080b2e20 0x7fdc0813dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:45.962 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.952+0000 7fdc0f3f6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdc0813ea50 0x7fdc080a9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:45.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.952+0000 7fdc0f3f6700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdc08142c50 0x7fdc080a8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:45.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.952+0000 7fdc0f3f6700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc080ac6c0 con 0x7fdc0813ea50 2021-11-12T05:45:45.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.952+0000 7fdc0f3f6700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc080a9380 con 0x7fdc08142c50 2021-11-12T05:45:45.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.952+0000 7fdc0f3f6700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc080ac8f0 con 0x7fdc080b2e20 2021-11-12T05:45:45.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.952+0000 7fdc0c991700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdc0813ea50 0x7fdc080a9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:45.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.952+0000 7fdc0c991700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdc0813ea50 0x7fdc080a9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46794/0 (socket says 172.21.2.105:46794) 2021-11-12T05:45:45.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.952+0000 7fdc0c991700 1 -- 172.21.2.105:0/976977345 learned_addr learned my addr 172.21.2.105:0/976977345 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:45.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.952+0000 7fdc0c991700 1 -- 172.21.2.105:0/976977345 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdc080b2e20 msgr2=0x7fdc0813dd00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:45:45.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.952+0000 7fdc0c991700 1 --2- 172.21.2.105:0/976977345 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdc080b2e20 0x7fdc0813dd00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:45.965 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.952+0000 7fdc0c991700 1 -- 172.21.2.105:0/976977345 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdc08142c50 msgr2=0x7fdc080a8e90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:45:45.965 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.952+0000 7fdc0c991700 1 --2- 172.21.2.105:0/976977345 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdc08142c50 0x7fdc080a8e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:45.965 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.952+0000 7fdc0c991700 1 -- 172.21.2.105:0/976977345 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbfc00d3c0 con 0x7fdc0813ea50 2021-11-12T05:45:45.965 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.952+0000 7fdc0c991700 1 --2- 172.21.2.105:0/976977345 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdc0813ea50 0x7fdc080a9ed0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7fdc080b3520 tx=0x7fdc04007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:45.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.952+0000 7fdbfa7fc700 1 -- 172.21.2.105:0/976977345 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc0400ce30 con 0x7fdc0813ea50 2021-11-12T05:45:45.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.952+0000 7fdbfa7fc700 1 -- 172.21.2.105:0/976977345 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc040072e0 con 0x7fdc0813ea50 2021-11-12T05:45:45.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.952+0000 7fdc0f3f6700 1 -- 172.21.2.105:0/976977345 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc080a8760 con 0x7fdc0813ea50 2021-11-12T05:45:45.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.952+0000 7fdbfa7fc700 1 -- 172.21.2.105:0/976977345 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc040057c0 con 0x7fdc0813ea50 2021-11-12T05:45:45.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.952+0000 7fdc0f3f6700 1 -- 172.21.2.105:0/976977345 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc080ac2f0 con 0x7fdc0813ea50 2021-11-12T05:45:45.967 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.952+0000 7fdc0f3f6700 1 -- 172.21.2.105:0/976977345 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc080b2060 con 0x7fdc0813ea50 2021-11-12T05:45:45.967 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.952+0000 7fdbfa7fc700 1 -- 172.21.2.105:0/976977345 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdc04010070 con 0x7fdc0813ea50 2021-11-12T05:45:45.967 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.952+0000 7fdbfa7fc700 1 --2- 172.21.2.105:0/976977345 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdbe8053520 0x7fdbe80559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:45.967 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.952+0000 7fdbfa7fc700 1 -- 172.21.2.105:0/976977345 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fdc0406b1a0 con 0x7fdc0813ea50 2021-11-12T05:45:45.968 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.952+0000 7fdc0d192700 1 --2- 172.21.2.105:0/976977345 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdbe8053520 0x7fdbe80559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:45.968 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.952+0000 7fdc0d192700 1 --2- 172.21.2.105:0/976977345 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdbe8053520 0x7fdbe80559e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7fdc080b35c0 tx=0x7fdc080ada90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:45.968 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:45.956+0000 7fdbfa7fc700 1 -- 172.21.2.105:0/976977345 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdc040420a0 con 0x7fdc0813ea50 2021-11-12T05:45:46.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.040+0000 7fdc0f3f6700 1 -- 172.21.2.105:0/976977345 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fdc08057350 con 0x7fdc0813ea50 2021-11-12T05:45:46.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.040+0000 7fdbfa7fc700 1 -- 172.21.2.105:0/976977345 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v65) v1 ==== 110+0+10 (secure 0 0 0) 0x7fdc040456c0 con 0x7fdc0813ea50 2021-11-12T05:45:46.044 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:45:46.045 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.040+0000 7fdc0f3f6700 1 -- 172.21.2.105:0/976977345 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdbe8053520 msgr2=0x7fdbe80559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:46.045 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.040+0000 7fdc0f3f6700 1 --2- 172.21.2.105:0/976977345 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdbe8053520 0x7fdbe80559e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7fdc080b35c0 tx=0x7fdc080ada90).stop 2021-11-12T05:45:46.046 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.040+0000 7fdc0f3f6700 1 -- 172.21.2.105:0/976977345 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdc0813ea50 msgr2=0x7fdc080a9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:46.046 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.040+0000 7fdc0f3f6700 1 --2- 172.21.2.105:0/976977345 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdc0813ea50 0x7fdc080a9ed0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7fdc080b3520 tx=0x7fdc04007c30).stop 2021-11-12T05:45:46.046 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.040+0000 7fdc0f3f6700 1 -- 172.21.2.105:0/976977345 shutdown_connections 2021-11-12T05:45:46.046 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.040+0000 7fdc0f3f6700 1 --2- 172.21.2.105:0/976977345 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdbe8053520 0x7fdbe80559e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:46.047 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.040+0000 7fdc0f3f6700 1 --2- 172.21.2.105:0/976977345 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdc08142c50 0x7fdc080a8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:46.047 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.040+0000 7fdc0f3f6700 1 --2- 172.21.2.105:0/976977345 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdc0813ea50 0x7fdc080a9ed0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:46.047 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.040+0000 7fdc0f3f6700 1 --2- 172.21.2.105:0/976977345 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdc080b2e20 0x7fdc0813dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:46.047 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.040+0000 7fdc0f3f6700 1 -- 172.21.2.105:0/976977345 >> 172.21.2.105:0/976977345 conn(0x7fdc08062f60 msgr2=0x7fdc0813fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:46.047 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.040+0000 7fdc0f3f6700 1 -- 172.21.2.105:0/976977345 shutdown_connections 2021-11-12T05:45:46.048 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.040+0000 7fdc0f3f6700 1 -- 172.21.2.105:0/976977345 wait complete. 2021-11-12T05:45:46.051 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:45:46.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.100+0000 7fd6f74e4700 1 Processor -- start 2021-11-12T05:45:46.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.100+0000 7fd6f74e4700 1 -- start start 2021-11-12T05:45:46.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.100+0000 7fd6f74e4700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd6f00b2e20 0x7fd6f00b1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:46.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.100+0000 7fd6f74e4700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fd6f0142c50 0x7fd6f0143070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:46.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.100+0000 7fd6f74e4700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f00ad400 con 0x7fd6f013ea50 2021-11-12T05:45:46.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.100+0000 7fd6f74e4700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f00b3200 con 0x7fd6f00b2e20 2021-11-12T05:45:46.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.100+0000 7fd6f74e4700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f00ad660 con 0x7fd6f0142c50 2021-11-12T05:45:46.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.100+0000 7fd6f5280700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd6f00b2e20 0x7fd6f00b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:46.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.100+0000 7fd6f5280700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd6f00b2e20 0x7fd6f00b1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46800/0 (socket says 172.21.2.105:46800) 2021-11-12T05:45:46.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.100+0000 7fd6f5280700 1 -- 172.21.2.105:0/2858141290 learned_addr learned my addr 172.21.2.105:0/2858141290 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:46.110 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.100+0000 7fd6f5280700 1 -- 172.21.2.105:0/2858141290 >> v2:172.21.2.115:3300/0 conn(0x7fd6f0142c50 msgr2=0x7fd6f0143070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:46.110 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.100+0000 7fd6f5280700 1 --2- 172.21.2.105:0/2858141290 >> v2:172.21.2.115:3300/0 conn(0x7fd6f0142c50 0x7fd6f0143070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:46.110 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.100+0000 7fd6f5280700 1 -- 172.21.2.105:0/2858141290 >> v1:172.21.2.115:6789/0 conn(0x7fd6f013ea50 legacy=0x7fd6f013eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:46.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.100+0000 7fd6f5280700 1 -- 172.21.2.105:0/2858141290 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f00ad900 con 0x7fd6f00b2e20 2021-11-12T05:45:46.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.100+0000 7fd6f5280700 1 --2- 172.21.2.105:0/2858141290 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6f00b2e20 0x7fd6f00b1060 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7fd6f00b3520 tx=0x7fd6ec006e40).ready entity=mon.0 client_cookie=523cc934e089a346 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:46.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.100+0000 7fd6e3fff700 1 -- 172.21.2.105:0/2858141290 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6ec00bcb0 con 0x7fd6f00b2e20 2021-11-12T05:45:46.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.100+0000 7fd6e3fff700 1 -- 172.21.2.105:0/2858141290 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ec000e90 con 0x7fd6f00b2e20 2021-11-12T05:45:46.112 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.100+0000 7fd6e3fff700 1 -- 172.21.2.105:0/2858141290 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6ec0153f0 con 0x7fd6f00b2e20 2021-11-12T05:45:46.112 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.104+0000 7fd6f74e4700 1 -- 172.21.2.105:0/2858141290 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6f00b2e20 msgr2=0x7fd6f00b1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:46.112 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.104+0000 7fd6f74e4700 1 --2- 172.21.2.105:0/2858141290 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6f00b2e20 0x7fd6f00b1060 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7fd6f00b3520 tx=0x7fd6ec006e40).stop 2021-11-12T05:45:46.112 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.104+0000 7fd6f74e4700 1 -- 172.21.2.105:0/2858141290 shutdown_connections 2021-11-12T05:45:46.112 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.104+0000 7fd6f74e4700 1 --2- 172.21.2.105:0/2858141290 >> v2:172.21.2.115:3300/0 conn(0x7fd6f0142c50 0x7fd6f0143070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:46.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.104+0000 7fd6f74e4700 1 --2- 172.21.2.105:0/2858141290 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6f00b2e20 0x7fd6f00b1060 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:46.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.104+0000 7fd6f74e4700 1 -- 172.21.2.105:0/2858141290 >> 172.21.2.105:0/2858141290 conn(0x7fd6f0062f60 msgr2=0x7fd6f0063370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:46.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.104+0000 7fd6f74e4700 1 -- 172.21.2.105:0/2858141290 shutdown_connections 2021-11-12T05:45:46.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.104+0000 7fd6f74e4700 1 -- 172.21.2.105:0/2858141290 wait complete. 2021-11-12T05:45:46.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.104+0000 7fd6f74e4700 1 Processor -- start 2021-11-12T05:45:46.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.104+0000 7fd6f74e4700 1 -- start start 2021-11-12T05:45:46.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.104+0000 7fd6f74e4700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6f00b2e20 0x7fd6f0063f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:46.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.104+0000 7fd6f74e4700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd6f013ea50 0x7fd6f01566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:46.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.104+0000 7fd6f74e4700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6f0142c50 0x7fd6f01528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:46.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.104+0000 7fd6f74e4700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f0064b50 con 0x7fd6f00b2e20 2021-11-12T05:45:46.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.104+0000 7fd6f74e4700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f0153ae0 con 0x7fd6f013ea50 2021-11-12T05:45:46.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.104+0000 7fd6f74e4700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f0155fa0 con 0x7fd6f0142c50 2021-11-12T05:45:46.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.104+0000 7fd6f5280700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6f00b2e20 0x7fd6f0063f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:46.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.104+0000 7fd6f5280700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6f00b2e20 0x7fd6f0063f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46806/0 (socket says 172.21.2.105:46806) 2021-11-12T05:45:46.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.104+0000 7fd6f5280700 1 -- 172.21.2.105:0/2451178915 learned_addr learned my addr 172.21.2.105:0/2451178915 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:46.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.104+0000 7fd6f5280700 1 -- 172.21.2.105:0/2451178915 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6f0142c50 msgr2=0x7fd6f01528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:46.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.104+0000 7fd6f5280700 1 --2- 172.21.2.105:0/2451178915 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6f0142c50 0x7fd6f01528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:46.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.104+0000 7fd6f5280700 1 -- 172.21.2.105:0/2451178915 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd6f013ea50 msgr2=0x7fd6f01566e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:46.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.104+0000 7fd6f5280700 1 --2- 172.21.2.105:0/2451178915 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd6f013ea50 0x7fd6f01566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:46.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.104+0000 7fd6f5280700 1 -- 172.21.2.105:0/2451178915 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ec00d4d0 con 0x7fd6f00b2e20 2021-11-12T05:45:46.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.104+0000 7fd6f5280700 1 --2- 172.21.2.105:0/2451178915 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6f00b2e20 0x7fd6f0063f70 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7fd6f00b3520 tx=0x7fd6ec018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:46.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.104+0000 7fd6e27fc700 1 -- 172.21.2.105:0/2451178915 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6ec00b040 con 0x7fd6f00b2e20 2021-11-12T05:45:46.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.104+0000 7fd6e27fc700 1 -- 172.21.2.105:0/2451178915 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ec015cb0 con 0x7fd6f00b2e20 2021-11-12T05:45:46.121 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.104+0000 7fd6f74e4700 1 -- 172.21.2.105:0/2451178915 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f0156240 con 0x7fd6f00b2e20 2021-11-12T05:45:46.121 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.104+0000 7fd6e27fc700 1 -- 172.21.2.105:0/2451178915 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6ec01f630 con 0x7fd6f00b2e20 2021-11-12T05:45:46.121 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.104+0000 7fd6f74e4700 1 -- 172.21.2.105:0/2451178915 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f0064460 con 0x7fd6f00b2e20 2021-11-12T05:45:46.121 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.104+0000 7fd6f74e4700 1 -- 172.21.2.105:0/2451178915 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6f01563d0 con 0x7fd6f00b2e20 2021-11-12T05:45:46.122 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.104+0000 7fd6e27fc700 1 -- 172.21.2.105:0/2451178915 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd6ec025020 con 0x7fd6f00b2e20 2021-11-12T05:45:46.122 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.108+0000 7fd6e27fc700 1 --2- 172.21.2.105:0/2451178915 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd6d0053640 0x7fd6d0055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:46.122 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.108+0000 7fd6e27fc700 1 -- 172.21.2.105:0/2451178915 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fd6ec06cc20 con 0x7fd6f00b2e20 2021-11-12T05:45:46.122 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.108+0000 7fd6f4a7f700 1 --2- 172.21.2.105:0/2451178915 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd6d0053640 0x7fd6d0055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:46.122 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.108+0000 7fd6f4a7f700 1 --2- 172.21.2.105:0/2451178915 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd6d0053640 0x7fd6d0055b00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7fd6e4002f90 tx=0x7fd6e40069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:46.123 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.108+0000 7fd6e27fc700 1 -- 172.21.2.105:0/2451178915 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd6ec043c30 con 0x7fd6f00b2e20 2021-11-12T05:45:46.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.192+0000 7fd6f74e4700 1 -- 172.21.2.105:0/2451178915 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd6f01563d0 con 0x7fd6f00b2e20 2021-11-12T05:45:46.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.192+0000 7fd6e27fc700 1 -- 172.21.2.105:0/2451178915 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v65) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd6ec047250 con 0x7fd6f00b2e20 2021-11-12T05:45:46.196 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:45:46.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.192+0000 7fd6f74e4700 1 -- 172.21.2.105:0/2451178915 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd6d0053640 msgr2=0x7fd6d0055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:46.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.192+0000 7fd6f74e4700 1 --2- 172.21.2.105:0/2451178915 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd6d0053640 0x7fd6d0055b00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7fd6e4002f90 tx=0x7fd6e40069b0).stop 2021-11-12T05:45:46.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.192+0000 7fd6f74e4700 1 -- 172.21.2.105:0/2451178915 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6f00b2e20 msgr2=0x7fd6f0063f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:46.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.192+0000 7fd6f74e4700 1 --2- 172.21.2.105:0/2451178915 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6f00b2e20 0x7fd6f0063f70 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7fd6f00b3520 tx=0x7fd6ec018000).stop 2021-11-12T05:45:46.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.192+0000 7fd6f74e4700 1 -- 172.21.2.105:0/2451178915 shutdown_connections 2021-11-12T05:45:46.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.192+0000 7fd6f74e4700 1 --2- 172.21.2.105:0/2451178915 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd6d0053640 0x7fd6d0055b00 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:46.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.192+0000 7fd6f74e4700 1 --2- 172.21.2.105:0/2451178915 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6f0142c50 0x7fd6f01528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:46.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.192+0000 7fd6f74e4700 1 --2- 172.21.2.105:0/2451178915 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd6f013ea50 0x7fd6f01566e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:46.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.192+0000 7fd6f74e4700 1 --2- 172.21.2.105:0/2451178915 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6f00b2e20 0x7fd6f0063f70 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:46.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.192+0000 7fd6f74e4700 1 -- 172.21.2.105:0/2451178915 >> 172.21.2.105:0/2451178915 conn(0x7fd6f0062f60 msgr2=0x7fd6f00b4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:46.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.192+0000 7fd6f74e4700 1 -- 172.21.2.105:0/2451178915 shutdown_connections 2021-11-12T05:45:46.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.192+0000 7fd6f74e4700 1 -- 172.21.2.105:0/2451178915 wait complete. 2021-11-12T05:45:46.203 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-12T05:45:46.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38ba449700 1 Processor -- start 2021-11-12T05:45:46.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38ba449700 1 -- start start 2021-11-12T05:45:46.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38ba449700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f38b40626b0 0x7f38b4062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:46.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38ba449700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f38b40af750 0x7f38b4130370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:46.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38ba449700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38b4130cf0 con 0x7f38b4130860 2021-11-12T05:45:46.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38ba449700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38b40b0d50 con 0x7f38b40af750 2021-11-12T05:45:46.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38ba449700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b40ad380 con 0x7f38b40626b0 2021-11-12T05:45:46.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38b89e6700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f38b4130860 0x7f38b414a950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57212/0 (socket says 172.21.2.105:57212) 2021-11-12T05:45:46.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38b89e6700 1 -- 172.21.2.105:0/1718538209 learned_addr learned my addr 172.21.2.105:0/1718538209 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:45:46.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38b2ffd700 1 -- 172.21.2.105:0/1718538209 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 980362385 0 0) 0x7f38b4130cf0 con 0x7f38b4130860 2021-11-12T05:45:46.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38b2ffd700 1 -- 172.21.2.105:0/1718538209 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3894003260 con 0x7f38b4130860 2021-11-12T05:45:46.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38b37fe700 1 --2- 172.21.2.105:0/1718538209 >> v2:172.21.2.115:3300/0 conn(0x7f38b40af750 0x7f38b4130370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:46.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38b2ffd700 1 -- 172.21.2.105:0/1718538209 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 317854963 0 0) 0x7f3894003260 con 0x7f38b4130860 2021-11-12T05:45:46.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38b2ffd700 1 -- 172.21.2.105:0/1718538209 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f38b40626b0 msgr2=0x7f38b4062a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:46.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38b2ffd700 1 --2- 172.21.2.105:0/1718538209 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f38b40626b0 0x7f38b4062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:46.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38b2ffd700 1 -- 172.21.2.105:0/1718538209 >> v2:172.21.2.115:3300/0 conn(0x7f38b40af750 msgr2=0x7f38b4130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:46.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38b2ffd700 1 --2- 172.21.2.105:0/1718538209 >> v2:172.21.2.115:3300/0 conn(0x7f38b40af750 0x7f38b4130370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:46.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38b2ffd700 1 -- 172.21.2.105:0/1718538209 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b40ae190 con 0x7f38b4130860 2021-11-12T05:45:46.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38b2ffd700 1 -- 172.21.2.105:0/1718538209 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f38ac0019e0 con 0x7f38b4130860 2021-11-12T05:45:46.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38b2ffd700 1 -- 172.21.2.105:0/1718538209 >> v1:172.21.2.105:6789/0 conn(0x7f38b4130860 legacy=0x7f38b414a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:46.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38b2ffd700 1 --2- 172.21.2.105:0/1718538209 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f38b40626b0 0x7f38940037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:46.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38b2ffd700 1 --2- 172.21.2.105:0/1718538209 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3894003ee0 0x7f3894004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:46.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38b2ffd700 1 --2- 172.21.2.105:0/1718538209 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3894004bf0 0x7f389400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:46.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38b2ffd700 1 -- 172.21.2.105:0/1718538209 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b40b0d50 con 0x7f3894004bf0 2021-11-12T05:45:46.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38b2ffd700 1 -- 172.21.2.105:0/1718538209 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b40ad380 con 0x7f3894003ee0 2021-11-12T05:45:46.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38b2ffd700 1 -- 172.21.2.105:0/1718538209 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38940053a0 con 0x7f38b40626b0 2021-11-12T05:45:46.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38b89e6700 1 --2- 172.21.2.105:0/1718538209 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3894004bf0 0x7f389400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:46.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38b89e6700 1 -- 172.21.2.105:0/1718538209 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f38b40626b0 msgr2=0x7f38940037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:46.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38b89e6700 1 --2- 172.21.2.105:0/1718538209 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f38b40626b0 0x7f38940037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:46.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38b89e6700 1 -- 172.21.2.105:0/1718538209 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3894003ee0 msgr2=0x7f3894004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:46.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38b89e6700 1 --2- 172.21.2.105:0/1718538209 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3894003ee0 0x7f3894004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:46.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38b89e6700 1 -- 172.21.2.105:0/1718538209 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3894003260 con 0x7f3894004bf0 2021-11-12T05:45:46.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38b89e6700 1 --2- 172.21.2.105:0/1718538209 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3894004bf0 0x7f389400b750 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7f38ac0016f0 tx=0x7f38ac002100).ready entity=mon.0 client_cookie=d4e6fda83e95f715 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:46.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38b2ffd700 1 -- 172.21.2.105:0/1718538209 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38ac00cbb0 con 0x7f3894004bf0 2021-11-12T05:45:46.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38b2ffd700 1 -- 172.21.2.105:0/1718538209 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38ac00cd10 con 0x7f3894004bf0 2021-11-12T05:45:46.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38b2ffd700 1 -- 172.21.2.105:0/1718538209 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38ac005b80 con 0x7f3894004bf0 2021-11-12T05:45:46.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38ba449700 1 -- 172.21.2.105:0/1718538209 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3894004bf0 msgr2=0x7f389400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:46.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38ba449700 1 --2- 172.21.2.105:0/1718538209 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3894004bf0 0x7f389400b750 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7f38ac0016f0 tx=0x7f38ac002100).stop 2021-11-12T05:45:46.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38b89e6700 1 -- 172.21.2.105:0/1718538209 reap_dead start 2021-11-12T05:45:46.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38ba449700 1 -- 172.21.2.105:0/1718538209 shutdown_connections 2021-11-12T05:45:46.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38ba449700 1 -- 172.21.2.105:0/1718538209 >> 172.21.2.105:0/1718538209 conn(0x7f38b40b5320 msgr2=0x7f38b40b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:46.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38ba449700 1 -- 172.21.2.105:0/1718538209 shutdown_connections 2021-11-12T05:45:46.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.252+0000 7f38ba449700 1 -- 172.21.2.105:0/1718538209 wait complete. 2021-11-12T05:45:46.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.256+0000 7f38ba449700 1 Processor -- start 2021-11-12T05:45:46.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.256+0000 7f38ba449700 1 -- start start 2021-11-12T05:45:46.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.256+0000 7f38ba449700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3894004bf0 0x7f38b40b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:46.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.256+0000 7f38ba449700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f38b41565c0 0x7f38b4066480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:46.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.256+0000 7f38ba449700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f38b4066970 0x7f38b41452f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:46.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.256+0000 7f38ba449700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b4064ac0 con 0x7f38b41565c0 2021-11-12T05:45:46.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.256+0000 7f38ba449700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b4064d60 con 0x7f38b4066970 2021-11-12T05:45:46.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.256+0000 7f38ba449700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b4147170 con 0x7f3894004bf0 2021-11-12T05:45:46.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.256+0000 7f38b37fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f38b41565c0 0x7f38b4066480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:46.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.256+0000 7f38b37fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f38b41565c0 0x7f38b4066480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46826/0 (socket says 172.21.2.105:46826) 2021-11-12T05:45:46.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.256+0000 7f38b37fe700 1 -- 172.21.2.105:0/2873104943 learned_addr learned my addr 172.21.2.105:0/2873104943 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:46.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.256+0000 7f38b3fff700 1 --2- 172.21.2.105:0/2873104943 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3894004bf0 0x7f38b40b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:46.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.256+0000 7f38b89e6700 1 --2- 172.21.2.105:0/2873104943 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f38b4066970 0x7f38b41452f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:46.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.256+0000 7f38b37fe700 1 -- 172.21.2.105:0/2873104943 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3894004bf0 msgr2=0x7f38b40b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:46.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.256+0000 7f38b37fe700 1 --2- 172.21.2.105:0/2873104943 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3894004bf0 0x7f38b40b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:46.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.256+0000 7f38b37fe700 1 -- 172.21.2.105:0/2873104943 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f38b4066970 msgr2=0x7f38b41452f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:46.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.256+0000 7f38b37fe700 1 --2- 172.21.2.105:0/2873104943 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f38b4066970 0x7f38b41452f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:46.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.256+0000 7f38b37fe700 1 -- 172.21.2.105:0/2873104943 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b4146540 con 0x7f38b41565c0 2021-11-12T05:45:46.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.256+0000 7f38b3fff700 1 --2- 172.21.2.105:0/2873104943 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3894004bf0 0x7f38b40b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:45:46.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.256+0000 7f38b37fe700 1 --2- 172.21.2.105:0/2873104943 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f38b41565c0 0x7f38b4066480 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f389c007000 tx=0x7f389c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:46.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.256+0000 7f38b17fa700 1 -- 172.21.2.105:0/2873104943 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f389c00f4e0 con 0x7f38b41565c0 2021-11-12T05:45:46.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.256+0000 7f38b17fa700 1 -- 172.21.2.105:0/2873104943 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389c000e90 con 0x7f38b41565c0 2021-11-12T05:45:46.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.256+0000 7f38ba449700 1 -- 172.21.2.105:0/2873104943 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38b4062a90 con 0x7f38b41565c0 2021-11-12T05:45:46.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.256+0000 7f38b17fa700 1 -- 172.21.2.105:0/2873104943 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f389c00f830 con 0x7f38b41565c0 2021-11-12T05:45:46.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.256+0000 7f38ba449700 1 -- 172.21.2.105:0/2873104943 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38b4064720 con 0x7f38b41565c0 2021-11-12T05:45:46.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.256+0000 7f38ba449700 1 -- 172.21.2.105:0/2873104943 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38b40648e0 con 0x7f38b41565c0 2021-11-12T05:45:46.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.256+0000 7f38b17fa700 1 -- 172.21.2.105:0/2873104943 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f389c00f990 con 0x7f38b41565c0 2021-11-12T05:45:46.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.256+0000 7f38b17fa700 1 --2- 172.21.2.105:0/2873104943 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3898053610 0x7f3898055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:46.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.256+0000 7f38b17fa700 1 -- 172.21.2.105:0/2873104943 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f389c06b590 con 0x7f38b41565c0 2021-11-12T05:45:46.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.256+0000 7f38b3fff700 1 --2- 172.21.2.105:0/2873104943 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3898053610 0x7f3898055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:46.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.256+0000 7f38b3fff700 1 --2- 172.21.2.105:0/2873104943 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3898053610 0x7f3898055ad0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f38a4007000 tx=0x7f38a4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:46.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.260+0000 7f38b17fa700 1 -- 172.21.2.105:0/2873104943 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f389c0425a0 con 0x7f38b41565c0 2021-11-12T05:45:46.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.344+0000 7f38ba449700 1 -- 172.21.2.105:0/2873104943 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f38b4057350 con 0x7f38b41565c0 2021-11-12T05:45:46.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.344+0000 7f38b17fa700 1 -- 172.21.2.105:0/2873104943 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v65) v1 ==== 104+0+10 (secure 0 0 0) 0x7f389c045bc0 con 0x7f38b41565c0 2021-11-12T05:45:46.348 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:45:46.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.344+0000 7f38ba449700 1 -- 172.21.2.105:0/2873104943 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3898053610 msgr2=0x7f3898055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:46.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.344+0000 7f38ba449700 1 --2- 172.21.2.105:0/2873104943 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3898053610 0x7f3898055ad0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f38a4007000 tx=0x7f38a4008040).stop 2021-11-12T05:45:46.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.344+0000 7f38ba449700 1 -- 172.21.2.105:0/2873104943 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f38b41565c0 msgr2=0x7f38b4066480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:46.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.344+0000 7f38ba449700 1 --2- 172.21.2.105:0/2873104943 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f38b41565c0 0x7f38b4066480 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f389c007000 tx=0x7f389c008040).stop 2021-11-12T05:45:46.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.344+0000 7f38ba449700 1 -- 172.21.2.105:0/2873104943 shutdown_connections 2021-11-12T05:45:46.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.344+0000 7f38ba449700 1 --2- 172.21.2.105:0/2873104943 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3898053610 0x7f3898055ad0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:46.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.344+0000 7f38ba449700 1 --2- 172.21.2.105:0/2873104943 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f38b4066970 0x7f38b41452f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:46.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.344+0000 7f38ba449700 1 --2- 172.21.2.105:0/2873104943 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f38b41565c0 0x7f38b4066480 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:46.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.344+0000 7f38ba449700 1 --2- 172.21.2.105:0/2873104943 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3894004bf0 0x7f38b40b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:46.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.344+0000 7f38ba449700 1 -- 172.21.2.105:0/2873104943 >> 172.21.2.105:0/2873104943 conn(0x7f38b40b5320 msgr2=0x7f38b414cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:46.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.344+0000 7f38ba449700 1 -- 172.21.2.105:0/2873104943 shutdown_connections 2021-11-12T05:45:46.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.344+0000 7f38ba449700 1 -- 172.21.2.105:0/2873104943 wait complete. 2021-11-12T05:45:46.355 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-12T05:45:46.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.404+0000 7f976b11b700 1 Processor -- start 2021-11-12T05:45:46.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.404+0000 7f976b11b700 1 -- start start 2021-11-12T05:45:46.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.404+0000 7f976b11b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f97640aca40 0x7f97640ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:46.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.404+0000 7f976b11b700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f97640b0520 0x7f97641473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:46.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.404+0000 7f976b11b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f97641478b0 0x7f9764144180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:46.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.404+0000 7f976b11b700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9764147d40 con 0x7f97640aca40 2021-11-12T05:45:46.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.404+0000 7f976b11b700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97640b1840 con 0x7f97640b0520 2021-11-12T05:45:46.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.404+0000 7f976b11b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97640b09d0 con 0x7f97641478b0 2021-11-12T05:45:46.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.404+0000 7f9768eb7700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f97640aca40 0x7f97640ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:46.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.404+0000 7f9768eb7700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f97640aca40 0x7f97640ace20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46836/0 (socket says 172.21.2.105:46836) 2021-11-12T05:45:46.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.404+0000 7f9768eb7700 1 -- 172.21.2.105:0/4076645510 learned_addr learned my addr 172.21.2.105:0/4076645510 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:46.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.404+0000 7f9763fff700 1 --2- 172.21.2.105:0/4076645510 >> v2:172.21.2.115:3300/0 conn(0x7f97640b0520 0x7f97641473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:46.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.404+0000 7f97696b8700 1 --2- 172.21.2.105:0/4076645510 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f97641478b0 0x7f9764144180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:46.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.404+0000 7f9768eb7700 1 -- 172.21.2.105:0/4076645510 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f97641478b0 msgr2=0x7f9764144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:46.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.404+0000 7f9768eb7700 1 --2- 172.21.2.105:0/4076645510 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f97641478b0 0x7f9764144180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:46.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.404+0000 7f9768eb7700 1 -- 172.21.2.105:0/4076645510 >> v2:172.21.2.115:3300/0 conn(0x7f97640b0520 msgr2=0x7f97641473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:45:46.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.404+0000 7f9768eb7700 1 --2- 172.21.2.105:0/4076645510 >> v2:172.21.2.115:3300/0 conn(0x7f97640b0520 0x7f97641473c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:46.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.404+0000 7f9768eb7700 1 -- 172.21.2.105:0/4076645510 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97640af2b0 con 0x7f97640aca40 2021-11-12T05:45:46.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.404+0000 7f97696b8700 1 --2- 172.21.2.105:0/4076645510 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f97641478b0 0x7f9764144180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:45:46.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.408+0000 7f9768eb7700 1 --2- 172.21.2.105:0/4076645510 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f97640aca40 0x7f97640ace20 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7f97640ae6a0 tx=0x7f974c006eb0).ready entity=mon.0 client_cookie=f854da70345286e2 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:46.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.408+0000 7f97637fe700 1 -- 172.21.2.105:0/4076645510 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f974c00d570 con 0x7f97640aca40 2021-11-12T05:45:46.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.408+0000 7f97637fe700 1 -- 172.21.2.105:0/4076645510 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974c000e90 con 0x7f97640aca40 2021-11-12T05:45:46.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.408+0000 7f97637fe700 1 -- 172.21.2.105:0/4076645510 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f974c00d8c0 con 0x7f97640aca40 2021-11-12T05:45:46.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.408+0000 7f976b11b700 1 -- 172.21.2.105:0/4076645510 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f97640aca40 msgr2=0x7f97640ace20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:46.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.408+0000 7f976b11b700 1 --2- 172.21.2.105:0/4076645510 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f97640aca40 0x7f97640ace20 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7f97640ae6a0 tx=0x7f974c006eb0).stop 2021-11-12T05:45:46.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.408+0000 7f976b11b700 1 -- 172.21.2.105:0/4076645510 shutdown_connections 2021-11-12T05:45:46.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.408+0000 7f976b11b700 1 --2- 172.21.2.105:0/4076645510 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f97641478b0 0x7f9764144180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:46.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.408+0000 7f976b11b700 1 --2- 172.21.2.105:0/4076645510 >> v2:172.21.2.115:3300/0 conn(0x7f97640b0520 0x7f97641473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:46.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.408+0000 7f976b11b700 1 --2- 172.21.2.105:0/4076645510 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f97640aca40 0x7f97640ace20 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:46.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.408+0000 7f976b11b700 1 -- 172.21.2.105:0/4076645510 >> 172.21.2.105:0/4076645510 conn(0x7f976405c490 msgr2=0x7f97640b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:46.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.408+0000 7f976b11b700 1 -- 172.21.2.105:0/4076645510 shutdown_connections 2021-11-12T05:45:46.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.408+0000 7f976b11b700 1 -- 172.21.2.105:0/4076645510 wait complete. 2021-11-12T05:45:46.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.408+0000 7f976b11b700 1 Processor -- start 2021-11-12T05:45:46.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.408+0000 7f976b11b700 1 -- start start 2021-11-12T05:45:46.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.408+0000 7f976b11b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f97640aca40 0x7f976414aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:46.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.408+0000 7f976b11b700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f97640b0520 0x7f97640a7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:46.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.408+0000 7f976b11b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f97641478b0 0x7f97640a7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:46.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.408+0000 7f976b11b700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97640ac5a0 con 0x7f97640aca40 2021-11-12T05:45:46.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.408+0000 7f976b11b700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97640645e0 con 0x7f97640b0520 2021-11-12T05:45:46.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.408+0000 7f976b11b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9764065530 con 0x7f97641478b0 2021-11-12T05:45:46.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.408+0000 7f9768eb7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f97640aca40 0x7f976414aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:46.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.408+0000 7f9768eb7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f97640aca40 0x7f976414aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46840/0 (socket says 172.21.2.105:46840) 2021-11-12T05:45:46.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.408+0000 7f9768eb7700 1 -- 172.21.2.105:0/77447416 learned_addr learned my addr 172.21.2.105:0/77447416 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:46.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.408+0000 7f9763fff700 1 --2- 172.21.2.105:0/77447416 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f97640b0520 0x7f97640a7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:46.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.408+0000 7f97696b8700 1 --2- 172.21.2.105:0/77447416 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f97641478b0 0x7f97640a7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:46.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.408+0000 7f9768eb7700 1 -- 172.21.2.105:0/77447416 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f97641478b0 msgr2=0x7f97640a7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:46.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.408+0000 7f9768eb7700 1 --2- 172.21.2.105:0/77447416 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f97641478b0 0x7f97640a7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:46.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.408+0000 7f9768eb7700 1 -- 172.21.2.105:0/77447416 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f97640b0520 msgr2=0x7f97640a7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:46.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.408+0000 7f9768eb7700 1 --2- 172.21.2.105:0/77447416 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f97640b0520 0x7f97640a7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:46.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.408+0000 7f9768eb7700 1 -- 172.21.2.105:0/77447416 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f974c00b1e0 con 0x7f97640aca40 2021-11-12T05:45:46.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.408+0000 7f9768eb7700 1 --2- 172.21.2.105:0/77447416 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f97640aca40 0x7f976414aea0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f97640ae6a0 tx=0x7f974c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:46.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.408+0000 7f9761ffb700 1 -- 172.21.2.105:0/77447416 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f974c021070 con 0x7f97640aca40 2021-11-12T05:45:46.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.408+0000 7f9761ffb700 1 -- 172.21.2.105:0/77447416 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974c011860 con 0x7f97640aca40 2021-11-12T05:45:46.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.408+0000 7f976b11b700 1 -- 172.21.2.105:0/77447416 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9764064810 con 0x7f97640aca40 2021-11-12T05:45:46.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.408+0000 7f9761ffb700 1 -- 172.21.2.105:0/77447416 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f974c011bc0 con 0x7f97640aca40 2021-11-12T05:45:46.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.408+0000 7f976b11b700 1 -- 172.21.2.105:0/77447416 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9764144800 con 0x7f97640aca40 2021-11-12T05:45:46.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.408+0000 7f976b11b700 1 -- 172.21.2.105:0/77447416 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9764065b30 con 0x7f97640aca40 2021-11-12T05:45:46.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.412+0000 7f9761ffb700 1 -- 172.21.2.105:0/77447416 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f974c00f070 con 0x7f97640aca40 2021-11-12T05:45:46.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.412+0000 7f9761ffb700 1 --2- 172.21.2.105:0/77447416 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9748053690 0x7f9748055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:46.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.412+0000 7f9761ffb700 1 -- 172.21.2.105:0/77447416 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f974c06d0a0 con 0x7f97640aca40 2021-11-12T05:45:46.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.412+0000 7f9763fff700 1 --2- 172.21.2.105:0/77447416 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9748053690 0x7f9748055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:46.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.412+0000 7f9763fff700 1 --2- 172.21.2.105:0/77447416 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9748053690 0x7f9748055b50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f975400c000 tx=0x7f9754008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:46.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.412+0000 7f9761ffb700 1 -- 172.21.2.105:0/77447416 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f974c043fa0 con 0x7f97640aca40 2021-11-12T05:45:46.499 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.496+0000 7f976b11b700 1 -- 172.21.2.105:0/77447416 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9764057350 con 0x7f97640aca40 2021-11-12T05:45:46.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.496+0000 7f9761ffb700 1 -- 172.21.2.105:0/77447416 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v65) v1 ==== 100+0+10 (secure 0 0 0) 0x7f974c006a40 con 0x7f97640aca40 2021-11-12T05:45:46.501 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:45:46.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.496+0000 7f976b11b700 1 -- 172.21.2.105:0/77447416 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9748053690 msgr2=0x7f9748055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:46.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.496+0000 7f976b11b700 1 --2- 172.21.2.105:0/77447416 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9748053690 0x7f9748055b50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f975400c000 tx=0x7f9754008040).stop 2021-11-12T05:45:46.503 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.496+0000 7f976b11b700 1 -- 172.21.2.105:0/77447416 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f97640aca40 msgr2=0x7f976414aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:46.503 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.496+0000 7f976b11b700 1 --2- 172.21.2.105:0/77447416 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f97640aca40 0x7f976414aea0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f97640ae6a0 tx=0x7f974c015000).stop 2021-11-12T05:45:46.504 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.496+0000 7f976b11b700 1 -- 172.21.2.105:0/77447416 shutdown_connections 2021-11-12T05:45:46.504 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.496+0000 7f976b11b700 1 --2- 172.21.2.105:0/77447416 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9748053690 0x7f9748055b50 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:46.504 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.496+0000 7f976b11b700 1 --2- 172.21.2.105:0/77447416 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f97641478b0 0x7f97640a7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:46.504 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.496+0000 7f976b11b700 1 --2- 172.21.2.105:0/77447416 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f97640b0520 0x7f97640a7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:46.505 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.496+0000 7f976b11b700 1 --2- 172.21.2.105:0/77447416 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f97640aca40 0x7f976414aea0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:46.505 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.496+0000 7f976b11b700 1 -- 172.21.2.105:0/77447416 >> 172.21.2.105:0/77447416 conn(0x7f976405c490 msgr2=0x7f976405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:46.505 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.496+0000 7f976b11b700 1 -- 172.21.2.105:0/77447416 shutdown_connections 2021-11-12T05:45:46.505 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.496+0000 7f976b11b700 1 -- 172.21.2.105:0/77447416 wait complete. 2021-11-12T05:45:46.508 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-12T05:45:46.508 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:45:46.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.556+0000 7efe40831700 1 Processor -- start 2021-11-12T05:45:46.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.556+0000 7efe40831700 1 -- start start 2021-11-12T05:45:46.564 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.556+0000 7efe40831700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7efe3c062010 0x7efe3c0b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:46.564 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.556+0000 7efe40831700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7efe3c0b4d50 0x7efe3c0b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:46.565 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.556+0000 7efe40831700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe3c0b2110 con 0x7efe3c0b3100 2021-11-12T05:45:46.565 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.556+0000 7efe40831700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe3c0b2370 con 0x7efe3c062010 2021-11-12T05:45:46.565 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.556+0000 7efe40831700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe3c0b2610 con 0x7efe3c0b4d50 2021-11-12T05:45:46.565 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.556+0000 7efe3a59c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7efe3c062010 0x7efe3c0b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:46.565 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.556+0000 7efe3a59c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7efe3c062010 0x7efe3c0b5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46850/0 (socket says 172.21.2.105:46850) 2021-11-12T05:45:46.566 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.556+0000 7efe3a59c700 1 -- 172.21.2.105:0/644224679 learned_addr learned my addr 172.21.2.105:0/644224679 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:46.566 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.556+0000 7efe3a59c700 1 -- 172.21.2.105:0/644224679 >> v2:172.21.2.115:3300/0 conn(0x7efe3c0b4d50 msgr2=0x7efe3c0b2ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:45:46.566 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.556+0000 7efe3a59c700 1 --2- 172.21.2.105:0/644224679 >> v2:172.21.2.115:3300/0 conn(0x7efe3c0b4d50 0x7efe3c0b2ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:46.566 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.556+0000 7efe3a59c700 1 -- 172.21.2.105:0/644224679 >> v1:172.21.2.115:6789/0 conn(0x7efe3c0b3100 legacy=0x7efe3c0b4640 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:45:46.567 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.556+0000 7efe3a59c700 1 -- 172.21.2.105:0/644224679 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe3c0b4330 con 0x7efe3c062010 2021-11-12T05:45:46.567 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.556+0000 7efe3a59c700 1 --2- 172.21.2.105:0/644224679 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe3c062010 0x7efe3c0b5b00 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7efe3c0b1fb0 tx=0x7efe2c006eb0).ready entity=mon.0 client_cookie=5673044dd87487d2 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:46.567 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.556+0000 7efe3959a700 1 -- 172.21.2.105:0/644224679 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe2c00d5c0 con 0x7efe3c062010 2021-11-12T05:45:46.568 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.556+0000 7efe3959a700 1 -- 172.21.2.105:0/644224679 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2c000e90 con 0x7efe3c062010 2021-11-12T05:45:46.568 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.556+0000 7efe3959a700 1 -- 172.21.2.105:0/644224679 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe2c00d910 con 0x7efe3c062010 2021-11-12T05:45:46.568 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.556+0000 7efe40831700 1 -- 172.21.2.105:0/644224679 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe3c062010 msgr2=0x7efe3c0b5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:46.568 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.556+0000 7efe40831700 1 --2- 172.21.2.105:0/644224679 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe3c062010 0x7efe3c0b5b00 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7efe3c0b1fb0 tx=0x7efe2c006eb0).stop 2021-11-12T05:45:46.568 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.556+0000 7efe40831700 1 -- 172.21.2.105:0/644224679 shutdown_connections 2021-11-12T05:45:46.569 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.556+0000 7efe40831700 1 --2- 172.21.2.105:0/644224679 >> v2:172.21.2.115:3300/0 conn(0x7efe3c0b4d50 0x7efe3c0b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:46.569 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.556+0000 7efe40831700 1 --2- 172.21.2.105:0/644224679 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe3c062010 0x7efe3c0b5b00 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:46.569 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.556+0000 7efe40831700 1 -- 172.21.2.105:0/644224679 >> 172.21.2.105:0/644224679 conn(0x7efe3c0b9790 msgr2=0x7efe3c0b9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:46.569 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.556+0000 7efe40831700 1 -- 172.21.2.105:0/644224679 shutdown_connections 2021-11-12T05:45:46.570 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.556+0000 7efe40831700 1 -- 172.21.2.105:0/644224679 wait complete. 2021-11-12T05:45:46.570 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.556+0000 7efe40831700 1 Processor -- start 2021-11-12T05:45:46.570 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.556+0000 7efe40831700 1 -- start start 2021-11-12T05:45:46.571 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.560+0000 7efe40831700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efe3c062010 0x7efe3c140910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:46.571 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.560+0000 7efe40831700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efe3c0b3100 0x7efe3c152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:46.571 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.560+0000 7efe40831700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe3c0b4d50 0x7efe3c112cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:46.571 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.560+0000 7efe40831700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c152e60 con 0x7efe3c0b4d50 2021-11-12T05:45:46.571 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.560+0000 7efe40831700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c0b0220 con 0x7efe3c0b3100 2021-11-12T05:45:46.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.560+0000 7efe40831700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c0add90 con 0x7efe3c062010 2021-11-12T05:45:46.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.560+0000 7efe3ad9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe3c0b4d50 0x7efe3c112cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:46.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.560+0000 7efe3ad9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe3c0b4d50 0x7efe3c112cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46854/0 (socket says 172.21.2.105:46854) 2021-11-12T05:45:46.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.560+0000 7efe3ad9d700 1 -- 172.21.2.105:0/1306002758 learned_addr learned my addr 172.21.2.105:0/1306002758 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:45:46.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.560+0000 7efe3ad9d700 1 -- 172.21.2.105:0/1306002758 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efe3c062010 msgr2=0x7efe3c140910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:46.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.560+0000 7efe3ad9d700 1 --2- 172.21.2.105:0/1306002758 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efe3c062010 0x7efe3c140910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:46.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.560+0000 7efe3ad9d700 1 -- 172.21.2.105:0/1306002758 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efe3c0b3100 msgr2=0x7efe3c152970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:46.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.560+0000 7efe3ad9d700 1 --2- 172.21.2.105:0/1306002758 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efe3c0b3100 0x7efe3c152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:46.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.560+0000 7efe3ad9d700 1 -- 172.21.2.105:0/1306002758 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2c00b1e0 con 0x7efe3c0b4d50 2021-11-12T05:45:46.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.560+0000 7efe3ad9d700 1 --2- 172.21.2.105:0/1306002758 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe3c0b4d50 0x7efe3c112cc0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7efe34001250 tx=0x7efe340090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:46.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.560+0000 7efe337fe700 1 -- 172.21.2.105:0/1306002758 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe340014e0 con 0x7efe3c0b4d50 2021-11-12T05:45:46.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.560+0000 7efe337fe700 1 -- 172.21.2.105:0/1306002758 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe34001640 con 0x7efe3c0b4d50 2021-11-12T05:45:46.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.560+0000 7efe40831700 1 -- 172.21.2.105:0/1306002758 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe3c0ae030 con 0x7efe3c0b4d50 2021-11-12T05:45:46.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.560+0000 7efe40831700 1 -- 172.21.2.105:0/1306002758 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe3c0aec10 con 0x7efe3c0b4d50 2021-11-12T05:45:46.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.560+0000 7efe337fe700 1 -- 172.21.2.105:0/1306002758 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe340019a0 con 0x7efe3c0b4d50 2021-11-12T05:45:46.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.560+0000 7efe40831700 1 -- 172.21.2.105:0/1306002758 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe3c0ae1c0 con 0x7efe3c0b4d50 2021-11-12T05:45:46.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.560+0000 7efe337fe700 1 -- 172.21.2.105:0/1306002758 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efe34018030 con 0x7efe3c0b4d50 2021-11-12T05:45:46.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.560+0000 7efe337fe700 1 --2- 172.21.2.105:0/1306002758 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efe200534f0 0x7efe200559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:45:46.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.560+0000 7efe337fe700 1 -- 172.21.2.105:0/1306002758 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6416+0+0 (secure 0 0 0) 0x7efe3406b320 con 0x7efe3c0b4d50 2021-11-12T05:45:46.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.560+0000 7efe3a59c700 1 --2- 172.21.2.105:0/1306002758 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efe200534f0 0x7efe200559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:45:46.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.560+0000 7efe3a59c700 1 --2- 172.21.2.105:0/1306002758 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efe200534f0 0x7efe200559b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7efe3c0b1fb0 tx=0x7efe2c015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:45:46.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.564+0000 7efe337fe700 1 -- 172.21.2.105:0/1306002758 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efe340423e0 con 0x7efe3c0b4d50 2021-11-12T05:45:46.676 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.672+0000 7efe40831700 1 -- 172.21.2.105:0/1306002758 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe3c0623f0 con 0x7efe3c0b4d50 2021-11-12T05:45:46.677 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.672+0000 7efe337fe700 1 -- 172.21.2.105:0/1306002758 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+2134 (secure 0 0 0) 0x7efe34045a00 con 0x7efe3c0b4d50 2021-11-12T05:45:46.677 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:45:46.678 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":25,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/37307717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":37307717},{"type":"v1","addr":"172.21.2.115:6833","nonce":37307717}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":23}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:45:43.349890+0000","modified":"2021-11-12T05:45:44.353136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5973},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5973":{"gid":5973,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/1667092126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":1667092126},{"type":"v1","addr":"172.21.2.105:6835","nonce":1667092126}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-11-12T05:45:46.679 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.672+0000 7efe40831700 1 -- 172.21.2.105:0/1306002758 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efe200534f0 msgr2=0x7efe200559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:46.679 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.672+0000 7efe40831700 1 --2- 172.21.2.105:0/1306002758 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efe200534f0 0x7efe200559b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7efe3c0b1fb0 tx=0x7efe2c015000).stop 2021-11-12T05:45:46.679 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.672+0000 7efe40831700 1 -- 172.21.2.105:0/1306002758 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe3c0b4d50 msgr2=0x7efe3c112cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:45:46.679 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.672+0000 7efe40831700 1 --2- 172.21.2.105:0/1306002758 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe3c0b4d50 0x7efe3c112cc0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7efe34001250 tx=0x7efe340090f0).stop 2021-11-12T05:45:46.680 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.672+0000 7efe40831700 1 -- 172.21.2.105:0/1306002758 shutdown_connections 2021-11-12T05:45:46.680 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.672+0000 7efe40831700 1 --2- 172.21.2.105:0/1306002758 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efe200534f0 0x7efe200559b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:46.680 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.672+0000 7efe40831700 1 --2- 172.21.2.105:0/1306002758 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe3c0b4d50 0x7efe3c112cc0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:45:46.680 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.672+0000 7efe40831700 1 --2- 172.21.2.105:0/1306002758 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efe3c0b3100 0x7efe3c152970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:46.680 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.672+0000 7efe40831700 1 --2- 172.21.2.105:0/1306002758 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efe3c062010 0x7efe3c140910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:45:46.681 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.672+0000 7efe40831700 1 -- 172.21.2.105:0/1306002758 >> 172.21.2.105:0/1306002758 conn(0x7efe3c0b9790 msgr2=0x7efe3c141d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:45:46.681 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.672+0000 7efe40831700 1 -- 172.21.2.105:0/1306002758 shutdown_connections 2021-11-12T05:45:46.681 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:45:46.672+0000 7efe40831700 1 -- 172.21.2.105:0/1306002758 wait complete. 2021-11-12T05:45:46.681 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 25 2021-11-12T05:45:46.886 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:45:43.349890+0000', 'modified': '2021-11-12T05:45:44.353136+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5973}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5973': {'gid': 5973, 'name': 'a', 'rank': 0, 'incarnation': 24, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/1667092126', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 1667092126}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 1667092126}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:45:46.886 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:45:46.887 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:45:46.952 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":5973,"want_state":"up:active","state":"up:active","rank_uptime":3.5948154130000001,"mdsmap_epoch":25,"osdmap_epoch":65,"osdmap_epoch_barrier":64,"uptime":7.7941517200000003} 2021-11-12T05:45:46.952 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 5973, "mdsmap_epoch": 25, "osdmap_epoch": 65, "osdmap_epoch_barrier": 64, "rank_uptime": 3.594815413, "state": "up:active", "uptime": 7.79415172, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:45:46.953 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-12T05:45:46.953 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-12T05:45:46.954 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba016.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-12T05:45:46.954 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:45:46.955 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:45:46.965 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:45:47.017 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:45:47.017 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:45:47.023 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:45:47.024 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:45:47.025 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:45:47.025 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:45:47.030 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-12T05:45:47.030 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:45:47.072 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:45:47.081 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:45:47.082 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:45:47.086 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:45:47.087 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:45:47.088 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:45:47.088 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:45:47.110 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:2021-11-12T05:45:47.109+0000 7f83158e4080 -1 init, newargv = 0x55608ed5fb20 newargc=9 2021-11-12T05:45:47.111 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[14514]: starting ceph client 2021-11-12T05:45:47.125 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[14514]: starting fuse 2021-11-12T05:45:48.193 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:45:48.205 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:45:48.206 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:45:48.253 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:45:48.254 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:45:48.255 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:45:48.256 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:45:48.261 INFO:teuthology.orchestra.run.gibba016.stdout:52 2021-11-12T05:45:48.261 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-12T05:45:48.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:45:48.262 DEBUG:teuthology.orchestra.run.gibba016:> sudo python3 -c ' 2021-11-12T05:45:48.263 DEBUG:teuthology.orchestra.run.gibba016:> import glob 2021-11-12T05:45:48.263 DEBUG:teuthology.orchestra.run.gibba016:> import re 2021-11-12T05:45:48.263 DEBUG:teuthology.orchestra.run.gibba016:> import os 2021-11-12T05:45:48.264 DEBUG:teuthology.orchestra.run.gibba016:> import subprocess 2021-11-12T05:45:48.264 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:45:48.265 DEBUG:teuthology.orchestra.run.gibba016:> def find_socket(client_name): 2021-11-12T05:45:48.265 DEBUG:teuthology.orchestra.run.gibba016:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-12T05:45:48.265 DEBUG:teuthology.orchestra.run.gibba016:> files = glob.glob(asok_path) 2021-11-12T05:45:48.266 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:45:48.266 DEBUG:teuthology.orchestra.run.gibba016:> # Given a non-glob path, it better be there 2021-11-12T05:45:48.267 DEBUG:teuthology.orchestra.run.gibba016:> if "*" not in asok_path: 2021-11-12T05:45:48.267 DEBUG:teuthology.orchestra.run.gibba016:> assert(len(files) == 1) 2021-11-12T05:45:48.268 DEBUG:teuthology.orchestra.run.gibba016:> return files[0] 2021-11-12T05:45:48.268 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:45:48.268 DEBUG:teuthology.orchestra.run.gibba016:> for f in files: 2021-11-12T05:45:48.269 DEBUG:teuthology.orchestra.run.gibba016:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-12T05:45:48.269 DEBUG:teuthology.orchestra.run.gibba016:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-12T05:45:48.270 DEBUG:teuthology.orchestra.run.gibba016:> return f 2021-11-12T05:45:48.270 DEBUG:teuthology.orchestra.run.gibba016:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-12T05:45:48.270 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:45:48.271 DEBUG:teuthology.orchestra.run.gibba016:> print(find_socket("client.0")) 2021-11-12T05:45:48.271 DEBUG:teuthology.orchestra.run.gibba016:> ' 2021-11-12T05:45:48.325 INFO:teuthology.orchestra.run.gibba016.stdout:/var/run/ceph/ceph-client.0.14514.asok 2021-11-12T05:45:48.328 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14514.asok 2021-11-12T05:45:48.328 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:45:48.329 DEBUG:teuthology.orchestra.run.gibba016:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14514.asok status 2021-11-12T05:45:48.376 INFO:teuthology.orchestra.run.gibba016.stdout:{ 2021-11-12T05:45:48.377 INFO:teuthology.orchestra.run.gibba016.stdout: "metadata": { 2021-11-12T05:45:48.377 INFO:teuthology.orchestra.run.gibba016.stdout: "ceph_sha1": "a81ee2815de5acae59ead5b8c9137b6766fc8ea8", 2021-11-12T05:45:48.377 INFO:teuthology.orchestra.run.gibba016.stdout: "ceph_version": "ceph version 15.2.15-22-ga81ee281 (a81ee2815de5acae59ead5b8c9137b6766fc8ea8) octopus (stable)", 2021-11-12T05:45:48.378 INFO:teuthology.orchestra.run.gibba016.stdout: "entity_id": "0", 2021-11-12T05:45:48.378 INFO:teuthology.orchestra.run.gibba016.stdout: "hostname": "gibba016", 2021-11-12T05:45:48.378 INFO:teuthology.orchestra.run.gibba016.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-12T05:45:48.378 INFO:teuthology.orchestra.run.gibba016.stdout: "pid": "14514", 2021-11-12T05:45:48.378 INFO:teuthology.orchestra.run.gibba016.stdout: "root": "/" 2021-11-12T05:45:48.379 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:45:48.379 INFO:teuthology.orchestra.run.gibba016.stdout: "dentry_count": 0, 2021-11-12T05:45:48.379 INFO:teuthology.orchestra.run.gibba016.stdout: "dentry_pinned_count": 0, 2021-11-12T05:45:48.379 INFO:teuthology.orchestra.run.gibba016.stdout: "id": 4577, 2021-11-12T05:45:48.380 INFO:teuthology.orchestra.run.gibba016.stdout: "inst": { 2021-11-12T05:45:48.380 INFO:teuthology.orchestra.run.gibba016.stdout: "name": { 2021-11-12T05:45:48.380 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "client", 2021-11-12T05:45:48.380 INFO:teuthology.orchestra.run.gibba016.stdout: "num": 4577 2021-11-12T05:45:48.381 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:45:48.381 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": { 2021-11-12T05:45:48.381 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "v1", 2021-11-12T05:45:48.381 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": "172.21.2.116:0", 2021-11-12T05:45:48.382 INFO:teuthology.orchestra.run.gibba016.stdout: "nonce": 1640018257 2021-11-12T05:45:48.382 INFO:teuthology.orchestra.run.gibba016.stdout: } 2021-11-12T05:45:48.382 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:45:48.382 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": { 2021-11-12T05:45:48.383 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "v1", 2021-11-12T05:45:48.383 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": "172.21.2.116:0", 2021-11-12T05:45:48.383 INFO:teuthology.orchestra.run.gibba016.stdout: "nonce": 1640018257 2021-11-12T05:45:48.383 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:45:48.384 INFO:teuthology.orchestra.run.gibba016.stdout: "inst_str": "client.4577 172.21.2.116:0/1640018257", 2021-11-12T05:45:48.384 INFO:teuthology.orchestra.run.gibba016.stdout: "addr_str": "172.21.2.116:0/1640018257", 2021-11-12T05:45:48.384 INFO:teuthology.orchestra.run.gibba016.stdout: "inode_count": 1, 2021-11-12T05:45:48.385 INFO:teuthology.orchestra.run.gibba016.stdout: "mds_epoch": 25, 2021-11-12T05:45:48.385 INFO:teuthology.orchestra.run.gibba016.stdout: "osd_epoch": 65, 2021-11-12T05:45:48.385 INFO:teuthology.orchestra.run.gibba016.stdout: "osd_epoch_barrier": 0, 2021-11-12T05:45:48.385 INFO:teuthology.orchestra.run.gibba016.stdout: "blacklisted": false, 2021-11-12T05:45:48.385 INFO:teuthology.orchestra.run.gibba016.stdout: "fs_name": "cephfs" 2021-11-12T05:45:48.386 INFO:teuthology.orchestra.run.gibba016.stdout:} 2021-11-12T05:45:48.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:45:48.387 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:45:48.388 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:45:48.393 INFO:teuthology.orchestra.run.gibba016.stdout:fuseblk 2021-11-12T05:45:48.393 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-12T05:45:48.394 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:45:48.394 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:45:48.443 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:45:48.443 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:45:48.444 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:45:48.449 INFO:teuthology.orchestra.run.gibba016.stdout:fuseblk 2021-11-12T05:45:48.450 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-12T05:45:48.451 DEBUG:teuthology.orchestra.run.gibba016:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-11-12T05:45:48.451 DEBUG:teuthology.orchestra.run.gibba016:> import sys 2021-11-12T05:45:48.451 DEBUG:teuthology.orchestra.run.gibba016:> import time 2021-11-12T05:45:48.452 DEBUG:teuthology.orchestra.run.gibba016:> import os 2021-11-12T05:45:48.452 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:45:48.453 DEBUG:teuthology.orchestra.run.gibba016:> n = 1000 2021-11-12T05:45:48.453 DEBUG:teuthology.orchestra.run.gibba016:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-11-12T05:45:48.453 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:45:48.454 DEBUG:teuthology.orchestra.run.gibba016:> if not os.path.exists(os.path.dirname(abs_path)): 2021-11-12T05:45:48.454 DEBUG:teuthology.orchestra.run.gibba016:> os.makedirs(os.path.dirname(abs_path)) 2021-11-12T05:45:48.455 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:45:48.455 DEBUG:teuthology.orchestra.run.gibba016:> for i in range(0, n): 2021-11-12T05:45:48.455 DEBUG:teuthology.orchestra.run.gibba016:> fname = "{0}_{1}".format(abs_path, i) 2021-11-12T05:45:48.456 DEBUG:teuthology.orchestra.run.gibba016:> with open(fname, '"'"'w'"'"') as f: 2021-11-12T05:45:48.456 DEBUG:teuthology.orchestra.run.gibba016:> f.write('"'"'content'"'"') 2021-11-12T05:45:48.456 DEBUG:teuthology.orchestra.run.gibba016:> if True: 2021-11-12T05:45:48.457 DEBUG:teuthology.orchestra.run.gibba016:> f.flush() 2021-11-12T05:45:48.457 DEBUG:teuthology.orchestra.run.gibba016:> os.fsync(f.fileno()) 2021-11-12T05:45:48.459 DEBUG:teuthology.orchestra.run.gibba016:> ' 2021-11-12T05:45:54.790 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:45:54.793 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:45:54.796 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:45:54.799 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:45:54.802 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:46:06.354 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:46:06.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.400+0000 7fcfba005700 1 Processor -- start 2021-11-12T05:46:06.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.400+0000 7fcfba005700 1 -- start start 2021-11-12T05:46:06.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.400+0000 7fcfba005700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fcfb40b26f0 0x7fcfb414b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:06.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.400+0000 7fcfba005700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcfb4147b10 0x7fcfb4144210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:06.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.400+0000 7fcfba005700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb414b7b0 con 0x7fcfb4060be0 2021-11-12T05:46:06.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.400+0000 7fcfba005700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb40ac440 con 0x7fcfb40b26f0 2021-11-12T05:46:06.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.400+0000 7fcfba005700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb40acdd0 con 0x7fcfb4147b10 2021-11-12T05:46:06.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.400+0000 7fcfb9003700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fcfb40b26f0 0x7fcfb414b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:06.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.400+0000 7fcfb9003700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fcfb40b26f0 0x7fcfb414b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46862/0 (socket says 172.21.2.105:46862) 2021-11-12T05:46:06.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.400+0000 7fcfb9003700 1 -- 172.21.2.105:0/930473766 learned_addr learned my addr 172.21.2.105:0/930473766 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:06.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.400+0000 7fcfb9003700 1 -- 172.21.2.105:0/930473766 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcfb4147b10 msgr2=0x7fcfb4144210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:06.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.400+0000 7fcfb9003700 1 --2- 172.21.2.105:0/930473766 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcfb4147b10 0x7fcfb4144210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:06.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.400+0000 7fcfb9003700 1 -- 172.21.2.105:0/930473766 >> v1:172.21.2.115:6789/0 conn(0x7fcfb4060be0 legacy=0x7fcfb40ac6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:06.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.400+0000 7fcfb9003700 1 -- 172.21.2.105:0/930473766 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb40b2ad0 con 0x7fcfb40b26f0 2021-11-12T05:46:06.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.400+0000 7fcfb9003700 1 --2- 172.21.2.105:0/930473766 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcfb40b26f0 0x7fcfb414b1f0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7fcfb40b50d0 tx=0x7fcfa8006eb0).ready entity=mon.0 client_cookie=aa90ef4178566995 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:06.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.400+0000 7fcfa7fff700 1 -- 172.21.2.105:0/930473766 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcfa800d570 con 0x7fcfb40b26f0 2021-11-12T05:46:06.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.400+0000 7fcfa7fff700 1 -- 172.21.2.105:0/930473766 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa8000e90 con 0x7fcfb40b26f0 2021-11-12T05:46:06.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.400+0000 7fcfa7fff700 1 -- 172.21.2.105:0/930473766 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcfa800d8c0 con 0x7fcfb40b26f0 2021-11-12T05:46:06.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.400+0000 7fcfba005700 1 -- 172.21.2.105:0/930473766 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcfb40b26f0 msgr2=0x7fcfb414b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:06.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.400+0000 7fcfba005700 1 --2- 172.21.2.105:0/930473766 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcfb40b26f0 0x7fcfb414b1f0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7fcfb40b50d0 tx=0x7fcfa8006eb0).stop 2021-11-12T05:46:06.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.400+0000 7fcfba005700 1 -- 172.21.2.105:0/930473766 shutdown_connections 2021-11-12T05:46:06.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.400+0000 7fcfba005700 1 --2- 172.21.2.105:0/930473766 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcfb4147b10 0x7fcfb4144210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:06.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.400+0000 7fcfba005700 1 --2- 172.21.2.105:0/930473766 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcfb40b26f0 0x7fcfb414b1f0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:06.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.400+0000 7fcfba005700 1 -- 172.21.2.105:0/930473766 >> 172.21.2.105:0/930473766 conn(0x7fcfb40b5c50 msgr2=0x7fcfb40b1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:06.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.400+0000 7fcfba005700 1 -- 172.21.2.105:0/930473766 shutdown_connections 2021-11-12T05:46:06.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.400+0000 7fcfba005700 1 -- 172.21.2.105:0/930473766 wait complete. 2021-11-12T05:46:06.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.404+0000 7fcfba005700 1 Processor -- start 2021-11-12T05:46:06.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.404+0000 7fcfba005700 1 -- start start 2021-11-12T05:46:06.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.404+0000 7fcfba005700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcfb4060be0 0x7fcfb40a9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:06.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.404+0000 7fcfba005700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcfb40b26f0 0x7fcfb40ab080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:06.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.404+0000 7fcfba005700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcfb4147b10 0x7fcfb40ab570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:06.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.404+0000 7fcfba005700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb41497d0 con 0x7fcfb40b26f0 2021-11-12T05:46:06.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.404+0000 7fcfba005700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb4149a70 con 0x7fcfb4147b10 2021-11-12T05:46:06.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.404+0000 7fcfba005700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb40a8f90 con 0x7fcfb4060be0 2021-11-12T05:46:06.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.404+0000 7fcfb8802700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcfb40b26f0 0x7fcfb40ab080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:06.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.404+0000 7fcfb8802700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcfb40b26f0 0x7fcfb40ab080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46870/0 (socket says 172.21.2.105:46870) 2021-11-12T05:46:06.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.404+0000 7fcfb8802700 1 -- 172.21.2.105:0/4143756027 learned_addr learned my addr 172.21.2.105:0/4143756027 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:06.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.404+0000 7fcfb8802700 1 -- 172.21.2.105:0/4143756027 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcfb4060be0 msgr2=0x7fcfb40a9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:06.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.404+0000 7fcfb8802700 1 --2- 172.21.2.105:0/4143756027 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcfb4060be0 0x7fcfb40a9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:06.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.404+0000 7fcfb8802700 1 -- 172.21.2.105:0/4143756027 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcfb4147b10 msgr2=0x7fcfb40ab570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:06.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.404+0000 7fcfb8802700 1 --2- 172.21.2.105:0/4143756027 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcfb4147b10 0x7fcfb40ab570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:06.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.404+0000 7fcfb8802700 1 -- 172.21.2.105:0/4143756027 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa800b1e0 con 0x7fcfb40b26f0 2021-11-12T05:46:06.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.404+0000 7fcfb8802700 1 --2- 172.21.2.105:0/4143756027 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcfb40b26f0 0x7fcfb40ab080 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7fcfb0002ef0 tx=0x7fcfb0006d50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:06.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.404+0000 7fcfa67fc700 1 -- 172.21.2.105:0/4143756027 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcfb0012410 con 0x7fcfb40b26f0 2021-11-12T05:46:06.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.404+0000 7fcfa67fc700 1 -- 172.21.2.105:0/4143756027 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb0012570 con 0x7fcfb40b26f0 2021-11-12T05:46:06.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.404+0000 7fcfa67fc700 1 -- 172.21.2.105:0/4143756027 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcfb00128d0 con 0x7fcfb40b26f0 2021-11-12T05:46:06.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.404+0000 7fcfba005700 1 -- 172.21.2.105:0/4143756027 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb414a610 con 0x7fcfb40b26f0 2021-11-12T05:46:06.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.404+0000 7fcfba005700 1 -- 172.21.2.105:0/4143756027 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb4144730 con 0x7fcfb40b26f0 2021-11-12T05:46:06.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.404+0000 7fcfba005700 1 -- 172.21.2.105:0/4143756027 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb4057350 con 0x7fcfb40b26f0 2021-11-12T05:46:06.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.404+0000 7fcfa67fc700 1 -- 172.21.2.105:0/4143756027 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcfb000f030 con 0x7fcfb40b26f0 2021-11-12T05:46:06.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.404+0000 7fcfa67fc700 1 --2- 172.21.2.105:0/4143756027 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcf94053660 0x7fcf94055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:06.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.404+0000 7fcfa67fc700 1 -- 172.21.2.105:0/4143756027 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fcfb006b640 con 0x7fcfb40b26f0 2021-11-12T05:46:06.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.404+0000 7fcfb9003700 1 --2- 172.21.2.105:0/4143756027 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcf94053660 0x7fcf94055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:06.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.404+0000 7fcfb9003700 1 --2- 172.21.2.105:0/4143756027 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcf94053660 0x7fcf94055b20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7fcfb40b50d0 tx=0x7fcfa8015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:06.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.408+0000 7fcfa67fc700 1 -- 172.21.2.105:0/4143756027 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcfb0042650 con 0x7fcfb40b26f0 2021-11-12T05:46:06.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.516+0000 7fcfba005700 1 -- 172.21.2.105:0/4143756027 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcfb4144730 con 0x7fcfb40b26f0 2021-11-12T05:46:06.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.516+0000 7fcfa67fc700 1 -- 172.21.2.105:0/4143756027 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+2134 (secure 0 0 0) 0x7fcfb4144730 con 0x7fcfb40b26f0 2021-11-12T05:46:06.520 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:46:06.520 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":25,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/37307717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":37307717},{"type":"v1","addr":"172.21.2.115:6833","nonce":37307717}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":23}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:45:43.349890+0000","modified":"2021-11-12T05:45:44.353136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5973},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5973":{"gid":5973,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/1667092126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":1667092126},{"type":"v1","addr":"172.21.2.105:6835","nonce":1667092126}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-11-12T05:46:06.521 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.516+0000 7fcfba005700 1 -- 172.21.2.105:0/4143756027 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcf94053660 msgr2=0x7fcf94055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:06.521 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.516+0000 7fcfba005700 1 --2- 172.21.2.105:0/4143756027 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcf94053660 0x7fcf94055b20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7fcfb40b50d0 tx=0x7fcfa8015000).stop 2021-11-12T05:46:06.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.516+0000 7fcfba005700 1 -- 172.21.2.105:0/4143756027 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcfb40b26f0 msgr2=0x7fcfb40ab080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:06.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.516+0000 7fcfba005700 1 --2- 172.21.2.105:0/4143756027 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcfb40b26f0 0x7fcfb40ab080 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7fcfb0002ef0 tx=0x7fcfb0006d50).stop 2021-11-12T05:46:06.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.516+0000 7fcfba005700 1 -- 172.21.2.105:0/4143756027 shutdown_connections 2021-11-12T05:46:06.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.516+0000 7fcfba005700 1 --2- 172.21.2.105:0/4143756027 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcf94053660 0x7fcf94055b20 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:06.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.516+0000 7fcfba005700 1 --2- 172.21.2.105:0/4143756027 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcfb4147b10 0x7fcfb40ab570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:06.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.516+0000 7fcfba005700 1 --2- 172.21.2.105:0/4143756027 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcfb40b26f0 0x7fcfb40ab080 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:06.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.516+0000 7fcfba005700 1 --2- 172.21.2.105:0/4143756027 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcfb4060be0 0x7fcfb40a9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:06.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.516+0000 7fcfba005700 1 -- 172.21.2.105:0/4143756027 >> 172.21.2.105:0/4143756027 conn(0x7fcfb40b5c50 msgr2=0x7fcfb4146760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:06.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.516+0000 7fcfba005700 1 -- 172.21.2.105:0/4143756027 shutdown_connections 2021-11-12T05:46:06.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.516+0000 7fcfba005700 1 -- 172.21.2.105:0/4143756027 wait complete. 2021-11-12T05:46:06.524 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 25 2021-11-12T05:46:06.527 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_caps 20 2021-11-12T05:46:06.584 INFO:teuthology.orchestra.run.gibba005.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2021-11-12T05:46:06.585 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-11-12T05:46:06.585 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:46:06.636 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.632+0000 7f8928e9b700 1 Processor -- start 2021-11-12T05:46:06.636 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.632+0000 7f8928e9b700 1 -- start start 2021-11-12T05:46:06.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.632+0000 7f8928e9b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f89240ad080 0x7f89240af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:06.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.632+0000 7f8928e9b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f89240ac280 0x7f89240ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:06.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.632+0000 7f8928e9b700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f892414abe0 0x7f892414b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:06.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.632+0000 7f8928e9b700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89241488a0 con 0x7f89240ac280 2021-11-12T05:46:06.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.632+0000 7f8928e9b700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89240ac7b0 con 0x7f892414abe0 2021-11-12T05:46:06.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.632+0000 7f8928e9b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89240ac9e0 con 0x7f89240ad080 2021-11-12T05:46:06.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.632+0000 7f8921d9b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f89240ac280 0x7f89240ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:06.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.632+0000 7f8921d9b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f89240ac280 0x7f89240ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46880/0 (socket says 172.21.2.105:46880) 2021-11-12T05:46:06.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.632+0000 7f8921d9b700 1 -- 172.21.2.105:0/937277960 learned_addr learned my addr 172.21.2.105:0/937277960 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:06.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.632+0000 7f8921d9b700 1 -- 172.21.2.105:0/937277960 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f89240ad080 msgr2=0x7f89240af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:06.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.632+0000 7f8921d9b700 1 --2- 172.21.2.105:0/937277960 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f89240ad080 0x7f89240af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:06.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.632+0000 7f8921d9b700 1 -- 172.21.2.105:0/937277960 >> v2:172.21.2.115:3300/0 conn(0x7f892414abe0 msgr2=0x7f892414b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:06.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.632+0000 7f8921d9b700 1 --2- 172.21.2.105:0/937277960 >> v2:172.21.2.115:3300/0 conn(0x7f892414abe0 0x7f892414b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:06.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.632+0000 7f8921d9b700 1 -- 172.21.2.105:0/937277960 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89240b0b30 con 0x7f89240ac280 2021-11-12T05:46:06.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.632+0000 7f8921d9b700 1 --2- 172.21.2.105:0/937277960 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89240ac280 0x7f89240ad460 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7f89240ac6a0 tx=0x7f8914006eb0).ready entity=mon.0 client_cookie=eb31812c516c9e1a server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:06.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.632+0000 7f892159a700 1 -- 172.21.2.105:0/937277960 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f891400d570 con 0x7f89240ac280 2021-11-12T05:46:06.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.632+0000 7f892159a700 1 -- 172.21.2.105:0/937277960 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8914000e90 con 0x7f89240ac280 2021-11-12T05:46:06.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.632+0000 7f892159a700 1 -- 172.21.2.105:0/937277960 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f891400d8c0 con 0x7f89240ac280 2021-11-12T05:46:06.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.632+0000 7f8928e9b700 1 -- 172.21.2.105:0/937277960 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89240ac280 msgr2=0x7f89240ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:06.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.632+0000 7f8928e9b700 1 --2- 172.21.2.105:0/937277960 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89240ac280 0x7f89240ad460 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7f89240ac6a0 tx=0x7f8914006eb0).stop 2021-11-12T05:46:06.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.632+0000 7f8928e9b700 1 -- 172.21.2.105:0/937277960 shutdown_connections 2021-11-12T05:46:06.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.632+0000 7f8928e9b700 1 --2- 172.21.2.105:0/937277960 >> v2:172.21.2.115:3300/0 conn(0x7f892414abe0 0x7f892414b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:06.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.632+0000 7f8928e9b700 1 --2- 172.21.2.105:0/937277960 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89240ac280 0x7f89240ad460 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:06.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.632+0000 7f8928e9b700 1 --2- 172.21.2.105:0/937277960 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f89240ad080 0x7f89240af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:06.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.632+0000 7f8928e9b700 1 -- 172.21.2.105:0/937277960 >> 172.21.2.105:0/937277960 conn(0x7f89240b5370 msgr2=0x7f89240b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:06.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.632+0000 7f8928e9b700 1 -- 172.21.2.105:0/937277960 shutdown_connections 2021-11-12T05:46:06.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.632+0000 7f8928e9b700 1 -- 172.21.2.105:0/937277960 wait complete. 2021-11-12T05:46:06.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.632+0000 7f8928e9b700 1 Processor -- start 2021-11-12T05:46:06.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.636+0000 7f8928e9b700 1 -- start start 2021-11-12T05:46:06.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.636+0000 7f8928e9b700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f89240ac280 0x7f8924063870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:06.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.636+0000 7f8928e9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89240ad080 0x7f8924066a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:06.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.636+0000 7f8928e9b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f892414abe0 0x7f8924066ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:06.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.636+0000 7f8928e9b700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89240aa120 con 0x7f89240ad080 2021-11-12T05:46:06.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.636+0000 7f8928e9b700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89240aade0 con 0x7f89240ac280 2021-11-12T05:46:06.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.636+0000 7f8928e9b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8924064140 con 0x7f892414abe0 2021-11-12T05:46:06.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.636+0000 7f8921d9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89240ad080 0x7f8924066a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:06.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.636+0000 7f8921d9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89240ad080 0x7f8924066a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46886/0 (socket says 172.21.2.105:46886) 2021-11-12T05:46:06.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.636+0000 7f8921d9b700 1 -- 172.21.2.105:0/650508166 learned_addr learned my addr 172.21.2.105:0/650508166 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:06.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.636+0000 7f8921d9b700 1 -- 172.21.2.105:0/650508166 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f892414abe0 msgr2=0x7f8924066ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:06.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.636+0000 7f8921d9b700 1 --2- 172.21.2.105:0/650508166 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f892414abe0 0x7f8924066ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:06.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.636+0000 7f8921d9b700 1 -- 172.21.2.105:0/650508166 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f89240ac280 msgr2=0x7f8924063870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:06.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.636+0000 7f8921d9b700 1 --2- 172.21.2.105:0/650508166 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f89240ac280 0x7f8924063870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:06.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.636+0000 7f8921d9b700 1 -- 172.21.2.105:0/650508166 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f891400b1e0 con 0x7f89240ad080 2021-11-12T05:46:06.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.636+0000 7f8921d9b700 1 --2- 172.21.2.105:0/650508166 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89240ad080 0x7f8924066a00 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7f89240ac6a0 tx=0x7f8914015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:06.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.636+0000 7f891b7fe700 1 -- 172.21.2.105:0/650508166 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8914002f70 con 0x7f89240ad080 2021-11-12T05:46:06.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.636+0000 7f891b7fe700 1 -- 172.21.2.105:0/650508166 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8914006b60 con 0x7f89240ad080 2021-11-12T05:46:06.650 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.636+0000 7f8928e9b700 1 -- 172.21.2.105:0/650508166 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89240abd20 con 0x7f89240ad080 2021-11-12T05:46:06.650 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.636+0000 7f8928e9b700 1 -- 172.21.2.105:0/650508166 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89240673e0 con 0x7f89240ad080 2021-11-12T05:46:06.650 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.636+0000 7f891b7fe700 1 -- 172.21.2.105:0/650508166 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f891400de20 con 0x7f89240ad080 2021-11-12T05:46:06.650 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.636+0000 7f8928e9b700 1 -- 172.21.2.105:0/650508166 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89240aba30 con 0x7f89240ad080 2021-11-12T05:46:06.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.636+0000 7f891b7fe700 1 -- 172.21.2.105:0/650508166 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8914025030 con 0x7f89240ad080 2021-11-12T05:46:06.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.636+0000 7f891b7fe700 1 --2- 172.21.2.105:0/650508166 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8908053720 0x7f8908055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:06.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.636+0000 7f891b7fe700 1 -- 172.21.2.105:0/650508166 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f891406cec0 con 0x7f89240ad080 2021-11-12T05:46:06.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.636+0000 7f892259c700 1 --2- 172.21.2.105:0/650508166 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8908053720 0x7f8908055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:06.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.636+0000 7f892259c700 1 --2- 172.21.2.105:0/650508166 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8908053720 0x7f8908055be0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f890c002f70 tx=0x7f890c006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:06.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.640+0000 7f891b7fe700 1 -- 172.21.2.105:0/650508166 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8914043dc0 con 0x7f89240ad080 2021-11-12T05:46:06.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.752+0000 7f8928e9b700 1 -- 172.21.2.105:0/650508166 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f89240aac00 con 0x7f89240ad080 2021-11-12T05:46:06.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.752+0000 7f891b7fe700 1 -- 172.21.2.105:0/650508166 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+2134 (secure 0 0 0) 0x7f8914023070 con 0x7f89240ad080 2021-11-12T05:46:06.756 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:46:06.756 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":25,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/37307717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":37307717},{"type":"v1","addr":"172.21.2.115:6833","nonce":37307717}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":23}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:45:43.349890+0000","modified":"2021-11-12T05:45:44.353136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5973},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5973":{"gid":5973,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/1667092126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":1667092126},{"type":"v1","addr":"172.21.2.105:6835","nonce":1667092126}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-11-12T05:46:06.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.752+0000 7f8928e9b700 1 -- 172.21.2.105:0/650508166 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8908053720 msgr2=0x7f8908055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:06.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.752+0000 7f8928e9b700 1 --2- 172.21.2.105:0/650508166 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8908053720 0x7f8908055be0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f890c002f70 tx=0x7f890c006a80).stop 2021-11-12T05:46:06.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.752+0000 7f8928e9b700 1 -- 172.21.2.105:0/650508166 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89240ad080 msgr2=0x7f8924066a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:06.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.752+0000 7f8928e9b700 1 --2- 172.21.2.105:0/650508166 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89240ad080 0x7f8924066a00 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7f89240ac6a0 tx=0x7f8914015000).stop 2021-11-12T05:46:06.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.752+0000 7f8928e9b700 1 -- 172.21.2.105:0/650508166 shutdown_connections 2021-11-12T05:46:06.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.752+0000 7f8928e9b700 1 --2- 172.21.2.105:0/650508166 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8908053720 0x7f8908055be0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:06.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.752+0000 7f8928e9b700 1 --2- 172.21.2.105:0/650508166 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f892414abe0 0x7f8924066ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:06.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.752+0000 7f8928e9b700 1 --2- 172.21.2.105:0/650508166 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89240ad080 0x7f8924066a00 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:06.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.752+0000 7f8928e9b700 1 --2- 172.21.2.105:0/650508166 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f89240ac280 0x7f8924063870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:06.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.752+0000 7f8928e9b700 1 -- 172.21.2.105:0/650508166 >> 172.21.2.105:0/650508166 conn(0x7f89240b5370 msgr2=0x7f8924147bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:06.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.752+0000 7f8928e9b700 1 -- 172.21.2.105:0/650508166 shutdown_connections 2021-11-12T05:46:06.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.752+0000 7f8928e9b700 1 -- 172.21.2.105:0/650508166 wait complete. 2021-11-12T05:46:06.760 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 25 2021-11-12T05:46:06.763 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_decay_threshold 400 2021-11-12T05:46:06.820 INFO:teuthology.orchestra.run.gibba005.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2021-11-12T05:46:06.820 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-11-12T05:46:06.821 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:46:06.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.868+0000 7faa2dc36700 1 Processor -- start 2021-11-12T05:46:06.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.868+0000 7faa2dc36700 1 -- start start 2021-11-12T05:46:06.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.868+0000 7faa2dc36700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7faa280ac280 0x7faa2814b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:06.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.868+0000 7faa2dc36700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7faa280af730 0x7faa280ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:06.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.868+0000 7faa2dc36700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa280ac7b0 con 0x7faa280ad080 2021-11-12T05:46:06.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.868+0000 7faa2dc36700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa281488a0 con 0x7faa280af730 2021-11-12T05:46:06.875 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.868+0000 7faa2dc36700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa280ac9e0 con 0x7faa280ac280 2021-11-12T05:46:06.875 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.868+0000 7faa27fff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7faa280af730 0x7faa280ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:06.875 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.868+0000 7faa27fff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7faa280af730 0x7faa280ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46894/0 (socket says 172.21.2.105:46894) 2021-11-12T05:46:06.875 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.868+0000 7faa27fff700 1 -- 172.21.2.105:0/4085898278 learned_addr learned my addr 172.21.2.105:0/4085898278 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:06.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.868+0000 7faa277fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7faa280ad080 0x7faa2814abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57286/0 (socket says 172.21.2.105:57286) 2021-11-12T05:46:06.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.868+0000 7faa27fff700 1 -- 172.21.2.105:0/4085898278 >> v2:172.21.2.115:3300/0 conn(0x7faa280ac280 msgr2=0x7faa2814b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:06.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.868+0000 7faa27fff700 1 --2- 172.21.2.105:0/4085898278 >> v2:172.21.2.115:3300/0 conn(0x7faa280ac280 0x7faa2814b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:06.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.868+0000 7faa27fff700 1 -- 172.21.2.105:0/4085898278 >> v1:172.21.2.105:6789/0 conn(0x7faa280ad080 legacy=0x7faa2814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:06.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.868+0000 7faa267fc700 1 -- 172.21.2.105:0/4085898278 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4072465830 0 0) 0x7faa280ac7b0 con 0x7faa280ad080 2021-11-12T05:46:06.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.868+0000 7faa27fff700 1 -- 172.21.2.105:0/4085898278 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa280b0b30 con 0x7faa280af730 2021-11-12T05:46:06.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.868+0000 7faa27fff700 1 --2- 172.21.2.105:0/4085898278 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faa280af730 0x7faa280ad460 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7faa280b1000 tx=0x7faa20009290).ready entity=mon.0 client_cookie=a54fd2baa1eb102b server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:06.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.868+0000 7faa267fc700 1 -- 172.21.2.105:0/4085898278 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa2000b860 con 0x7faa280af730 2021-11-12T05:46:06.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.868+0000 7faa267fc700 1 -- 172.21.2.105:0/4085898278 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2000b9c0 con 0x7faa280af730 2021-11-12T05:46:06.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.868+0000 7faa267fc700 1 -- 172.21.2.105:0/4085898278 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa2000bb30 con 0x7faa280af730 2021-11-12T05:46:06.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.868+0000 7faa2dc36700 1 -- 172.21.2.105:0/4085898278 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faa280af730 msgr2=0x7faa280ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:06.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.868+0000 7faa2dc36700 1 --2- 172.21.2.105:0/4085898278 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faa280af730 0x7faa280ad460 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7faa280b1000 tx=0x7faa20009290).stop 2021-11-12T05:46:06.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.868+0000 7faa2dc36700 1 -- 172.21.2.105:0/4085898278 shutdown_connections 2021-11-12T05:46:06.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.868+0000 7faa2dc36700 1 --2- 172.21.2.105:0/4085898278 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faa280af730 0x7faa280ad460 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:06.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.868+0000 7faa2dc36700 1 --2- 172.21.2.105:0/4085898278 >> v2:172.21.2.115:3300/0 conn(0x7faa280ac280 0x7faa2814b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:06.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.868+0000 7faa2dc36700 1 -- 172.21.2.105:0/4085898278 >> 172.21.2.105:0/4085898278 conn(0x7faa280b5370 msgr2=0x7faa280b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:06.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.868+0000 7faa2dc36700 1 -- 172.21.2.105:0/4085898278 shutdown_connections 2021-11-12T05:46:06.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.868+0000 7faa2dc36700 1 -- 172.21.2.105:0/4085898278 wait complete. 2021-11-12T05:46:06.881 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.872+0000 7faa2dc36700 1 Processor -- start 2021-11-12T05:46:06.881 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.872+0000 7faa2dc36700 1 -- start start 2021-11-12T05:46:06.882 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.872+0000 7faa2dc36700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7faa280ac280 0x7faa28060980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:06.882 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.872+0000 7faa2dc36700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faa280ad080 0x7faa28062f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:06.882 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.872+0000 7faa2dc36700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7faa280af730 0x7faa28063420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:06.882 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.872+0000 7faa2dc36700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa280ab550 con 0x7faa280ad080 2021-11-12T05:46:06.883 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.872+0000 7faa2dc36700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa280a9e60 con 0x7faa280af730 2021-11-12T05:46:06.883 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.872+0000 7faa2dc36700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa280aa100 con 0x7faa280ac280 2021-11-12T05:46:06.883 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.872+0000 7faa26ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faa280ad080 0x7faa28062f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:06.883 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.872+0000 7faa26ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faa280ad080 0x7faa28062f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46898/0 (socket says 172.21.2.105:46898) 2021-11-12T05:46:06.884 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.872+0000 7faa26ffd700 1 -- 172.21.2.105:0/2832311212 learned_addr learned my addr 172.21.2.105:0/2832311212 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:06.884 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.872+0000 7faa26ffd700 1 -- 172.21.2.105:0/2832311212 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7faa280ac280 msgr2=0x7faa28060980 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:46:06.884 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.872+0000 7faa26ffd700 1 --2- 172.21.2.105:0/2832311212 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7faa280ac280 0x7faa28060980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:06.884 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.872+0000 7faa26ffd700 1 -- 172.21.2.105:0/2832311212 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7faa280af730 msgr2=0x7faa28063420 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:46:06.884 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.872+0000 7faa26ffd700 1 --2- 172.21.2.105:0/2832311212 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7faa280af730 0x7faa28063420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:06.885 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.872+0000 7faa26ffd700 1 -- 172.21.2.105:0/2832311212 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa20009530 con 0x7faa280ad080 2021-11-12T05:46:06.885 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.872+0000 7faa26ffd700 1 --2- 172.21.2.105:0/2832311212 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faa280ad080 0x7faa28062f30 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7faa18002f70 tx=0x7faa18006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:06.885 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.872+0000 7faa24ff9700 1 -- 172.21.2.105:0/2832311212 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa18013460 con 0x7faa280ad080 2021-11-12T05:46:06.885 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.872+0000 7faa24ff9700 1 -- 172.21.2.105:0/2832311212 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa180135c0 con 0x7faa280ad080 2021-11-12T05:46:06.885 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.872+0000 7faa2dc36700 1 -- 172.21.2.105:0/2832311212 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa28063910 con 0x7faa280ad080 2021-11-12T05:46:06.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.872+0000 7faa24ff9700 1 -- 172.21.2.105:0/2832311212 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa18013920 con 0x7faa280ad080 2021-11-12T05:46:06.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.872+0000 7faa2dc36700 1 -- 172.21.2.105:0/2832311212 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa280a8f00 con 0x7faa280ad080 2021-11-12T05:46:06.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.872+0000 7faa2dc36700 1 -- 172.21.2.105:0/2832311212 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa280a9640 con 0x7faa280ad080 2021-11-12T05:46:06.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.872+0000 7faa24ff9700 1 -- 172.21.2.105:0/2832311212 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faa1800f070 con 0x7faa280ad080 2021-11-12T05:46:06.887 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.872+0000 7faa24ff9700 1 --2- 172.21.2.105:0/2832311212 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7faa0c0536d0 0x7faa0c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:06.887 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.872+0000 7faa24ff9700 1 -- 172.21.2.105:0/2832311212 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6416+0+0 (secure 0 0 0) 0x7faa1806b3b0 con 0x7faa280ad080 2021-11-12T05:46:06.887 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.872+0000 7faa277fe700 1 --2- 172.21.2.105:0/2832311212 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7faa0c0536d0 0x7faa0c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:06.887 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.872+0000 7faa277fe700 1 --2- 172.21.2.105:0/2832311212 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7faa0c0536d0 0x7faa0c055b90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7faa10000ed0 tx=0x7faa10007600).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:06.887 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.876+0000 7faa24ff9700 1 -- 172.21.2.105:0/2832311212 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faa180423c0 con 0x7faa280ad080 2021-11-12T05:46:06.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.988+0000 7faa2dc36700 1 -- 172.21.2.105:0/2832311212 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa280b1440 con 0x7faa280ad080 2021-11-12T05:46:06.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.988+0000 7faa24ff9700 1 -- 172.21.2.105:0/2832311212 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+2134 (secure 0 0 0) 0x7faa180459e0 con 0x7faa280ad080 2021-11-12T05:46:06.992 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:46:06.992 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":25,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/37307717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":37307717},{"type":"v1","addr":"172.21.2.115:6833","nonce":37307717}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":23}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:45:43.349890+0000","modified":"2021-11-12T05:45:44.353136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5973},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5973":{"gid":5973,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/1667092126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":1667092126},{"type":"v1","addr":"172.21.2.105:6835","nonce":1667092126}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-11-12T05:46:06.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.988+0000 7faa2dc36700 1 -- 172.21.2.105:0/2832311212 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7faa0c0536d0 msgr2=0x7faa0c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:06.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.988+0000 7faa2dc36700 1 --2- 172.21.2.105:0/2832311212 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7faa0c0536d0 0x7faa0c055b90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7faa10000ed0 tx=0x7faa10007600).stop 2021-11-12T05:46:06.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.988+0000 7faa2dc36700 1 -- 172.21.2.105:0/2832311212 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faa280ad080 msgr2=0x7faa28062f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:06.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.988+0000 7faa2dc36700 1 --2- 172.21.2.105:0/2832311212 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faa280ad080 0x7faa28062f30 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7faa18002f70 tx=0x7faa18006ec0).stop 2021-11-12T05:46:06.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.988+0000 7faa2dc36700 1 -- 172.21.2.105:0/2832311212 shutdown_connections 2021-11-12T05:46:06.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.988+0000 7faa2dc36700 1 --2- 172.21.2.105:0/2832311212 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7faa0c0536d0 0x7faa0c055b90 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:06.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.988+0000 7faa2dc36700 1 --2- 172.21.2.105:0/2832311212 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7faa280af730 0x7faa28063420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:06.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.988+0000 7faa2dc36700 1 --2- 172.21.2.105:0/2832311212 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faa280ad080 0x7faa28062f30 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:06.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.988+0000 7faa2dc36700 1 --2- 172.21.2.105:0/2832311212 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7faa280ac280 0x7faa28060980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:06.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.988+0000 7faa2dc36700 1 -- 172.21.2.105:0/2832311212 >> 172.21.2.105:0/2832311212 conn(0x7faa280b5370 msgr2=0x7faa28143b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:06.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.988+0000 7faa2dc36700 1 -- 172.21.2.105:0/2832311212 shutdown_connections 2021-11-12T05:46:06.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:06.988+0000 7faa2dc36700 1 -- 172.21.2.105:0/2832311212 wait complete. 2021-11-12T05:46:06.995 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 25 2021-11-12T05:46:06.999 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a cache drop 10 2021-11-12T05:46:07.051 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.048+0000 7faa3771a700 1 Processor -- start 2021-11-12T05:46:07.051 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.048+0000 7faa3771a700 1 -- start start 2021-11-12T05:46:07.052 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.048+0000 7faa3771a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7faa300b6430 0x7faa30143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:07.052 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.048+0000 7faa3771a700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7faa301473d0 0x7faa30140040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:07.052 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.048+0000 7faa3771a700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa300b6810 con 0x7faa300b4060 2021-11-12T05:46:07.052 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.048+0000 7faa3771a700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa300b6d60 con 0x7faa301473d0 2021-11-12T05:46:07.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.048+0000 7faa3771a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa30146820 con 0x7faa300b6430 2021-11-12T05:46:07.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.048+0000 7faa34cb5700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7faa300b4060 0x7faa30146cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:55768/0 (socket says 172.21.2.105:55768) 2021-11-12T05:46:07.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.048+0000 7faa34cb5700 1 -- 172.21.2.105:0/2985169100 learned_addr learned my addr 172.21.2.105:0/2985169100 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:46:07.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.048+0000 7faa354b6700 1 --2- 172.21.2.105:0/2985169100 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7faa300b6430 0x7faa30143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:07.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.048+0000 7faa35cb7700 1 --2- 172.21.2.105:0/2985169100 >> v2:172.21.2.115:3300/0 conn(0x7faa301473d0 0x7faa30140040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:07.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.048+0000 7faa35cb7700 1 -- 172.21.2.105:0/2985169100 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7faa300b6430 msgr2=0x7faa30143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:07.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.048+0000 7faa35cb7700 1 --2- 172.21.2.105:0/2985169100 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7faa300b6430 0x7faa30143090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:07.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.048+0000 7faa35cb7700 1 -- 172.21.2.105:0/2985169100 >> v1:172.21.2.115:6789/0 conn(0x7faa300b4060 legacy=0x7faa30146cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:07.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.048+0000 7faa35cb7700 1 -- 172.21.2.105:0/2985169100 --> v2:172.21.2.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa30143580 con 0x7faa301473d0 2021-11-12T05:46:07.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.052+0000 7faa35cb7700 1 --2- 172.21.2.105:0/2985169100 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7faa301473d0 0x7faa30140040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7faa280032f0 tx=0x7faa280091d0).ready entity=mon.1 client_cookie=70919fd40ee36afe server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:07.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.052+0000 7faa23fff700 1 -- 172.21.2.105:0/2985169100 <== mon.1 v2:172.21.2.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa2800b6c0 con 0x7faa301473d0 2021-11-12T05:46:07.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.052+0000 7faa23fff700 1 -- 172.21.2.105:0/2985169100 <== mon.1 v2:172.21.2.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2800b820 con 0x7faa301473d0 2021-11-12T05:46:07.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.052+0000 7faa23fff700 1 -- 172.21.2.105:0/2985169100 <== mon.1 v2:172.21.2.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa2800b990 con 0x7faa301473d0 2021-11-12T05:46:07.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.052+0000 7faa3771a700 1 -- 172.21.2.105:0/2985169100 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7faa301473d0 msgr2=0x7faa30140040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:07.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.052+0000 7faa3771a700 1 --2- 172.21.2.105:0/2985169100 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7faa301473d0 0x7faa30140040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7faa280032f0 tx=0x7faa280091d0).stop 2021-11-12T05:46:07.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.052+0000 7faa3771a700 1 -- 172.21.2.105:0/2985169100 shutdown_connections 2021-11-12T05:46:07.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.052+0000 7faa3771a700 1 --2- 172.21.2.105:0/2985169100 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7faa301473d0 0x7faa30140040 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:07.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.052+0000 7faa3771a700 1 --2- 172.21.2.105:0/2985169100 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7faa300b6430 0x7faa30143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:07.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.052+0000 7faa3771a700 1 -- 172.21.2.105:0/2985169100 >> 172.21.2.105:0/2985169100 conn(0x7faa30062030 msgr2=0x7faa30062440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:07.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.052+0000 7faa3771a700 1 -- 172.21.2.105:0/2985169100 shutdown_connections 2021-11-12T05:46:07.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.052+0000 7faa3771a700 1 -- 172.21.2.105:0/2985169100 wait complete. 2021-11-12T05:46:07.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.052+0000 7faa3771a700 1 Processor -- start 2021-11-12T05:46:07.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.052+0000 7faa3771a700 1 -- start start 2021-11-12T05:46:07.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.052+0000 7faa3771a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faa300b4060 0x7faa300b2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:07.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.052+0000 7faa3771a700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7faa300b6430 0x7faa300b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:07.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.052+0000 7faa3771a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7faa301473d0 0x7faa301135d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:07.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.052+0000 7faa3771a700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa301400f0 con 0x7faa300b4060 2021-11-12T05:46:07.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.052+0000 7faa3771a700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa30140390 con 0x7faa300b6430 2021-11-12T05:46:07.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.052+0000 7faa3771a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa300b3010 con 0x7faa301473d0 2021-11-12T05:46:07.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.052+0000 7faa354b6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faa300b4060 0x7faa300b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:07.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.052+0000 7faa354b6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faa300b4060 0x7faa300b2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46910/0 (socket says 172.21.2.105:46910) 2021-11-12T05:46:07.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.052+0000 7faa354b6700 1 -- 172.21.2.105:0/1218299238 learned_addr learned my addr 172.21.2.105:0/1218299238 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:07.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.052+0000 7faa354b6700 1 -- 172.21.2.105:0/1218299238 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7faa301473d0 msgr2=0x7faa301135d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:07.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.052+0000 7faa354b6700 1 --2- 172.21.2.105:0/1218299238 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7faa301473d0 0x7faa301135d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:07.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.052+0000 7faa354b6700 1 -- 172.21.2.105:0/1218299238 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7faa300b6430 msgr2=0x7faa300b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:07.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.052+0000 7faa354b6700 1 --2- 172.21.2.105:0/1218299238 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7faa300b6430 0x7faa300b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:07.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.052+0000 7faa354b6700 1 -- 172.21.2.105:0/1218299238 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa28009470 con 0x7faa300b4060 2021-11-12T05:46:07.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.052+0000 7faa354b6700 1 --2- 172.21.2.105:0/1218299238 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faa300b4060 0x7faa300b2630 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7faa2c00c000 tx=0x7faa2c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:07.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.052+0000 7faa227fc700 1 -- 172.21.2.105:0/1218299238 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa2c010780 con 0x7faa300b4060 2021-11-12T05:46:07.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.052+0000 7faa227fc700 1 -- 172.21.2.105:0/1218299238 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2c0108e0 con 0x7faa300b4060 2021-11-12T05:46:07.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.052+0000 7faa227fc700 1 -- 172.21.2.105:0/1218299238 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa2c010c40 con 0x7faa300b4060 2021-11-12T05:46:07.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.052+0000 7faa3771a700 1 -- 172.21.2.105:0/1218299238 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa30140b60 con 0x7faa300b4060 2021-11-12T05:46:07.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.052+0000 7faa3771a700 1 -- 172.21.2.105:0/1218299238 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa301530b0 con 0x7faa300b4060 2021-11-12T05:46:07.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa227fc700 1 -- 172.21.2.105:0/1218299238 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faa2c01c460 con 0x7faa300b4060 2021-11-12T05:46:07.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa227fc700 1 --2- 172.21.2.105:0/1218299238 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7faa10053610 0x7faa10055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:07.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa227fc700 1 -- 172.21.2.105:0/1218299238 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6416+0+0 (secure 0 0 0) 0x7faa2c06c0e0 con 0x7faa300b4060 2021-11-12T05:46:07.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa34cb5700 1 --2- 172.21.2.105:0/1218299238 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7faa10053610 0x7faa10055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:07.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa34cb5700 1 --2- 172.21.2.105:0/1218299238 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7faa10053610 0x7faa10055ad0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7faa30061c60 tx=0x7faa24007800).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:07.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa4195e740 1 Processor -- start 2021-11-12T05:46:07.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa4195e740 1 -- start start 2021-11-12T05:46:07.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa4195e740 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x2ab5fe0 0x2ab80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:07.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa4195e740 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x2abb1e0 0x2ab3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:07.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa4195e740 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x2af2a80 0x2ab4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:07.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa4195e740 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a29530 con 0x2ab5fe0 2021-11-12T05:46:07.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa4195e740 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a098d0 con 0x2abb1e0 2021-11-12T05:46:07.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa4195e740 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x2aee760 con 0x2af2a80 2021-11-12T05:46:07.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa354b6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x2ab5fe0 0x2ab80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:07.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa354b6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x2ab5fe0 0x2ab80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46920/0 (socket says 172.21.2.105:46920) 2021-11-12T05:46:07.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa354b6700 1 -- 172.21.2.105:0/2060289560 learned_addr learned my addr 172.21.2.105:0/2060289560 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:07.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa354b6700 1 -- 172.21.2.105:0/2060289560 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x2af2a80 msgr2=0x2ab4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:07.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa354b6700 1 --2- 172.21.2.105:0/2060289560 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x2af2a80 0x2ab4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:07.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa354b6700 1 -- 172.21.2.105:0/2060289560 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x2abb1e0 msgr2=0x2ab3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:07.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa354b6700 1 --2- 172.21.2.105:0/2060289560 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x2abb1e0 0x2ab3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:07.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa354b6700 1 -- 172.21.2.105:0/2060289560 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2a61130 con 0x2ab5fe0 2021-11-12T05:46:07.074 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa354b6700 1 --2- 172.21.2.105:0/2060289560 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x2ab5fe0 0x2ab80f0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7faa2c06c2f0 tx=0x7faa2c014000).ready entity=mon.0 client_cookie=72053afe22b4c49f server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:07.074 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa3771a700 1 -- 172.21.2.105:0/2060289560 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa2c044e50 con 0x2ab5fe0 2021-11-12T05:46:07.074 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa3771a700 1 -- 172.21.2.105:0/2060289560 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2c044fe0 con 0x2ab5fe0 2021-11-12T05:46:07.074 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa3771a700 1 -- 172.21.2.105:0/2060289560 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa2c043350 con 0x2ab5fe0 2021-11-12T05:46:07.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa4195e740 1 -- 172.21.2.105:0/2060289560 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x2ab5fe0 msgr2=0x2ab80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:07.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa4195e740 1 --2- 172.21.2.105:0/2060289560 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x2ab5fe0 0x2ab80f0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7faa2c06c2f0 tx=0x7faa2c014000).stop 2021-11-12T05:46:07.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa4195e740 1 -- 172.21.2.105:0/2060289560 shutdown_connections 2021-11-12T05:46:07.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa4195e740 1 --2- 172.21.2.105:0/2060289560 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x2af2a80 0x2ab4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:07.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa4195e740 1 --2- 172.21.2.105:0/2060289560 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x2abb1e0 0x2ab3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:07.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa4195e740 1 --2- 172.21.2.105:0/2060289560 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x2ab5fe0 0x2ab80f0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:07.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa4195e740 1 -- 172.21.2.105:0/2060289560 >> 172.21.2.105:0/2060289560 conn(0x2af1f90 msgr2=0x2af2370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:07.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa4195e740 1 -- 172.21.2.105:0/2060289560 shutdown_connections 2021-11-12T05:46:07.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa4195e740 1 -- 172.21.2.105:0/2060289560 wait complete. 2021-11-12T05:46:07.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa4195e740 1 -- start start 2021-11-12T05:46:07.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa4195e740 1 Processor -- start 2021-11-12T05:46:07.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa4195e740 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x2ab5fe0 0x2aec8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:07.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa4195e740 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x2abb1e0 0x2aea0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:07.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa4195e740 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x2af2a80 0x2ae90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:07.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa4195e740 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x2aec1d0 con 0x2abb1e0 2021-11-12T05:46:07.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa4195e740 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ae8580 con 0x2ab5fe0 2021-11-12T05:46:07.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa4195e740 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x2aec430 con 0x2af2a80 2021-11-12T05:46:07.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa4195e740 10 client.0 ll_register_callbacks cb 0x2a1cf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-11-12T05:46:07.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa34cb5700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x2abb1e0 0x2aea0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:07.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa34cb5700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x2abb1e0 0x2aea0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46926/0 (socket says 172.21.2.105:46926) 2021-11-12T05:46:07.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa34cb5700 1 -- 172.21.2.105:0/2620764849 learned_addr learned my addr 172.21.2.105:0/2620764849 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:07.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa34cb5700 1 -- 172.21.2.105:0/2620764849 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x2af2a80 msgr2=0x2ae90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:07.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa34cb5700 1 --2- 172.21.2.105:0/2620764849 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x2af2a80 0x2ae90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:07.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa34cb5700 1 -- 172.21.2.105:0/2620764849 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x2ab5fe0 msgr2=0x2aec8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:07.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa34cb5700 1 --2- 172.21.2.105:0/2620764849 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x2ab5fe0 0x2aec8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:07.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa34cb5700 1 -- 172.21.2.105:0/2620764849 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa301530b0 con 0x2abb1e0 2021-11-12T05:46:07.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa34cb5700 1 --2- 172.21.2.105:0/2620764849 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x2abb1e0 0x2aea0a0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7faa24001af0 tx=0x7faa24007000).ready entity=mon.0 client_cookie=e66d794e20bbb90b server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:07.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa0c7f8700 10 client.0 ms_handle_connect on v2:172.21.2.105:3300/0 2021-11-12T05:46:07.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa0c7f8700 1 -- 172.21.2.105:0/2620764849 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa24016bf0 con 0x2abb1e0 2021-11-12T05:46:07.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa0c7f8700 1 -- 172.21.2.105:0/2620764849 <== mon.0 v2:172.21.2.105:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6416+0+0 (secure 0 0 0) 0x7faa24016d50 con 0x2abb1e0 2021-11-12T05:46:07.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa4195e740 1 -- 172.21.2.105:0/2620764849 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2a1f510 con 0x2abb1e0 2021-11-12T05:46:07.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa0c7f8700 1 -- 172.21.2.105:0/2620764849 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa24017400 con 0x2abb1e0 2021-11-12T05:46:07.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa4195e740 10 client.6174 fetch_fsmap learned FSMap version 25 2021-11-12T05:46:07.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.056+0000 7faa4195e740 1 -- 172.21.2.105:0/2620764849 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x2a18b00 con 0x2abb1e0 2021-11-12T05:46:07.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.060+0000 7faa0c7f8700 1 -- 172.21.2.105:0/2620764849 <== mon.0 v2:172.21.2.105:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2a1f510 con 0x2abb1e0 2021-11-12T05:46:07.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.060+0000 7faa0c7f8700 1 -- 172.21.2.105:0/2620764849 <== mon.0 v2:172.21.2.105:3300/0 5 ==== fsmap(e 25) v1 ==== 1247+0+0 (secure 0 0 0) 0x7faa2401e020 con 0x2abb1e0 2021-11-12T05:46:07.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.060+0000 7faa4195e740 10 client.6174 fetch_fsmap finished waiting for FSMap version 25 2021-11-12T05:46:07.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.060+0000 7faa4195e740 10 client.6174 resolve_mds: resolved ID 'a' to GID 5973 2021-11-12T05:46:07.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.060+0000 7faa4195e740 20 client.6174 populate_metadata read hostname 'gibba005' 2021-11-12T05:46:07.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.060+0000 7faa4195e740 1 --2- 172.21.2.105:0/2620764849 >> [v2:172.21.2.105:6834/1667092126,v1:172.21.2.105:6835/1667092126] conn(0x2b05e80 0x2b06260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:07.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.060+0000 7faa4195e740 4 client.6174 mds_command: new command op to 5973 tid=0[{"prefix": "get_command_descriptions"}] 2021-11-12T05:46:07.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.060+0000 7faa4195e740 1 -- 172.21.2.105:0/2620764849 --> [v2:172.21.2.105:6834/1667092126,v1:172.21.2.105:6835/1667092126] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2a17590 con 0x2b05e80 2021-11-12T05:46:07.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.060+0000 7faa354b6700 1 --2- 172.21.2.105:0/2620764849 >> [v2:172.21.2.105:6834/1667092126,v1:172.21.2.105:6835/1667092126] conn(0x2b05e80 0x2b06260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:07.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.060+0000 7faa0c7f8700 10 client.6174 ms_handle_connect on v2:172.21.2.105:6834/1667092126 2021-11-12T05:46:07.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.060+0000 7faa354b6700 1 --2- 172.21.2.105:0/2620764849 >> [v2:172.21.2.105:6834/1667092126,v1:172.21.2.105:6835/1667092126] conn(0x2b05e80 0x2b06260 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=dd966319823225a7 server_cookie=12e5cff90fdade03 in_seq=0 out_seq=0 2021-11-12T05:46:07.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.060+0000 7faa0c7f8700 1 -- 172.21.2.105:0/2620764849 <== mds.0 v2:172.21.2.105:6834/1667092126 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x2a17590 con 0x2b05e80 2021-11-12T05:46:07.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.060+0000 7faa0c7f8700 10 client.6174 handle_command_reply: tid=0 2021-11-12T05:46:07.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.060+0000 7faa4195e740 1 client.6174 shutdown 2021-11-12T05:46:07.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.060+0000 7faa4195e740 1 -- 172.21.2.105:0/2620764849 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x2abb1e0 msgr2=0x2aea0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:07.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.060+0000 7faa4195e740 1 --2- 172.21.2.105:0/2620764849 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x2abb1e0 0x2aea0a0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7faa24001af0 tx=0x7faa24007000).stop 2021-11-12T05:46:07.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.060+0000 7faa4195e740 1 -- 172.21.2.105:0/2620764849 shutdown_connections 2021-11-12T05:46:07.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.060+0000 7faa4195e740 1 --2- 172.21.2.105:0/2620764849 >> [v2:172.21.2.105:6834/1667092126,v1:172.21.2.105:6835/1667092126] conn(0x2b05e80 0x2b06260 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:07.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.060+0000 7faa4195e740 1 --2- 172.21.2.105:0/2620764849 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x2af2a80 0x2ae90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:07.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.060+0000 7faa4195e740 1 --2- 172.21.2.105:0/2620764849 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x2abb1e0 0x2aea0a0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:07.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.060+0000 7faa4195e740 1 --2- 172.21.2.105:0/2620764849 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x2ab5fe0 0x2aec8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:07.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.060+0000 7faa4195e740 1 -- 172.21.2.105:0/2620764849 >> 172.21.2.105:0/2620764849 conn(0x2af1f90 msgr2=0x2af2370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:07.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.060+0000 7faa0c7f8700 0 client.6174 ms_handle_reset on v2:172.21.2.105:6834/1667092126 2021-11-12T05:46:07.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.060+0000 7faa4195e740 1 -- 172.21.2.105:0/2620764849 shutdown_connections 2021-11-12T05:46:07.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.060+0000 7faa4195e740 1 -- 172.21.2.105:0/2620764849 wait complete. 2021-11-12T05:46:07.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.060+0000 7faa4195e740 20 client.6174 trim_cache size 0 max 16384 2021-11-12T05:46:07.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.064+0000 7faa4195e740 1 Processor -- start 2021-11-12T05:46:07.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa4195e740 1 -- start start 2021-11-12T05:46:07.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa4195e740 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x2ab5fe0 0x2aea750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:07.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa4195e740 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x2abb1e0 0x2b069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:07.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa4195e740 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x2af2a80 0x2ab65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:07.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa4195e740 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a17590 con 0x2ab5fe0 2021-11-12T05:46:07.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa4195e740 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a811f0 con 0x2af2a80 2021-11-12T05:46:07.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa4195e740 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x2ab53a0 con 0x2abb1e0 2021-11-12T05:46:07.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa354b6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x2ab5fe0 0x2aea750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:07.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa354b6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x2ab5fe0 0x2aea750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46932/0 (socket says 172.21.2.105:46932) 2021-11-12T05:46:07.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa354b6700 1 -- 172.21.2.105:0/3419718837 learned_addr learned my addr 172.21.2.105:0/3419718837 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:07.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa354b6700 1 -- 172.21.2.105:0/3419718837 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x2abb1e0 msgr2=0x2b069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:07.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa354b6700 1 --2- 172.21.2.105:0/3419718837 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x2abb1e0 0x2b069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:07.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa354b6700 1 -- 172.21.2.105:0/3419718837 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x2af2a80 msgr2=0x2ab65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:07.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa354b6700 1 --2- 172.21.2.105:0/3419718837 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x2af2a80 0x2ab65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:07.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa354b6700 1 -- 172.21.2.105:0/3419718837 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2a216f0 con 0x2ab5fe0 2021-11-12T05:46:07.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa354b6700 1 --2- 172.21.2.105:0/3419718837 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x2ab5fe0 0x2aea750 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x2ab7080 tx=0x7faa2c024000).ready entity=mon.0 client_cookie=47212c4b8942bfe2 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:07.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa0e7fc700 1 -- 172.21.2.105:0/3419718837 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa2c00fd50 con 0x2ab5fe0 2021-11-12T05:46:07.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa0e7fc700 1 -- 172.21.2.105:0/3419718837 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2c043350 con 0x2ab5fe0 2021-11-12T05:46:07.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa0e7fc700 1 -- 172.21.2.105:0/3419718837 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa2c046320 con 0x2ab5fe0 2021-11-12T05:46:07.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa4195e740 1 -- 172.21.2.105:0/3419718837 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x2ab5fe0 msgr2=0x2aea750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:07.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa4195e740 1 --2- 172.21.2.105:0/3419718837 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x2ab5fe0 0x2aea750 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x2ab7080 tx=0x7faa2c024000).stop 2021-11-12T05:46:07.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa4195e740 1 -- 172.21.2.105:0/3419718837 shutdown_connections 2021-11-12T05:46:07.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa4195e740 1 --2- 172.21.2.105:0/3419718837 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x2af2a80 0x2ab65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:07.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa4195e740 1 --2- 172.21.2.105:0/3419718837 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x2abb1e0 0x2b069e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:07.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa4195e740 1 --2- 172.21.2.105:0/3419718837 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x2ab5fe0 0x2aea750 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:07.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa4195e740 1 -- 172.21.2.105:0/3419718837 >> 172.21.2.105:0/3419718837 conn(0x2af1f90 msgr2=0x2af2370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:07.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa4195e740 1 -- 172.21.2.105:0/3419718837 shutdown_connections 2021-11-12T05:46:07.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa4195e740 1 -- 172.21.2.105:0/3419718837 wait complete. 2021-11-12T05:46:07.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa4195e740 1 -- start start 2021-11-12T05:46:07.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa4195e740 1 Processor -- start 2021-11-12T05:46:07.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa4195e740 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x2ab5fe0 0x2b5c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:07.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa4195e740 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x2abb1e0 0x2b5cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:07.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa4195e740 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x2af2a80 0x2b58390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:07.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa4195e740 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b05b50 con 0x2ab5fe0 2021-11-12T05:46:07.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa4195e740 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b16390 con 0x2af2a80 2021-11-12T05:46:07.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa4195e740 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x2ab82f0 con 0x2abb1e0 2021-11-12T05:46:07.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa4195e740 10 client.0 ll_register_callbacks cb 0x2ab5840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-11-12T05:46:07.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa354b6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x2ab5fe0 0x2b5c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:07.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa354b6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x2ab5fe0 0x2b5c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46938/0 (socket says 172.21.2.105:46938) 2021-11-12T05:46:07.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa354b6700 1 -- 172.21.2.105:0/1246711871 learned_addr learned my addr 172.21.2.105:0/1246711871 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:07.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa34cb5700 1 --2- 172.21.2.105:0/1246711871 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x2abb1e0 0x2b5cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:07.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa35cb7700 1 --2- 172.21.2.105:0/1246711871 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x2af2a80 0x2b58390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:07.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa354b6700 1 -- 172.21.2.105:0/1246711871 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x2abb1e0 msgr2=0x2b5cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:07.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa354b6700 1 --2- 172.21.2.105:0/1246711871 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x2abb1e0 0x2b5cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:07.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa354b6700 1 -- 172.21.2.105:0/1246711871 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x2af2a80 msgr2=0x2b58390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:07.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa354b6700 1 --2- 172.21.2.105:0/1246711871 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x2af2a80 0x2b58390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:07.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa354b6700 1 -- 172.21.2.105:0/1246711871 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x2a61130 con 0x2ab5fe0 2021-11-12T05:46:07.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa354b6700 1 --2- 172.21.2.105:0/1246711871 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x2ab5fe0 0x2b5c640 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x2ab7080 tx=0x7faa2c032000).ready entity=mon.0 client_cookie=2508ac5da4b654d0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:07.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa0d7fa700 10 client.0 ms_handle_connect on v2:172.21.2.105:3300/0 2021-11-12T05:46:07.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa0d7fa700 1 -- 172.21.2.105:0/1246711871 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa2c038070 con 0x2ab5fe0 2021-11-12T05:46:07.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa0d7fa700 1 -- 172.21.2.105:0/1246711871 <== mon.0 v2:172.21.2.105:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6416+0+0 (secure 0 0 0) 0x7faa2c046130 con 0x2ab5fe0 2021-11-12T05:46:07.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa4195e740 1 -- 172.21.2.105:0/1246711871 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faa2c044fe0 con 0x2ab5fe0 2021-11-12T05:46:07.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa0d7fa700 1 -- 172.21.2.105:0/1246711871 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa2c0462f0 con 0x2ab5fe0 2021-11-12T05:46:07.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa4195e740 10 client.6180 fetch_fsmap learned FSMap version 25 2021-11-12T05:46:07.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa4195e740 1 -- 172.21.2.105:0/1246711871 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x2a1e0e0 con 0x2ab5fe0 2021-11-12T05:46:07.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa0d7fa700 1 -- 172.21.2.105:0/1246711871 <== mon.0 v2:172.21.2.105:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2c044fe0 con 0x2ab5fe0 2021-11-12T05:46:07.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa0d7fa700 1 -- 172.21.2.105:0/1246711871 <== mon.0 v2:172.21.2.105:3300/0 5 ==== fsmap(e 25) v1 ==== 1247+0+0 (secure 0 0 0) 0x7faa2c042a30 con 0x2ab5fe0 2021-11-12T05:46:07.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa4195e740 10 client.6180 fetch_fsmap finished waiting for FSMap version 25 2021-11-12T05:46:07.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa4195e740 10 client.6180 resolve_mds: resolved ID 'a' to GID 5973 2021-11-12T05:46:07.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa4195e740 20 client.6180 populate_metadata read hostname 'gibba005' 2021-11-12T05:46:07.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa4195e740 1 --2- 172.21.2.105:0/1246711871 >> [v2:172.21.2.105:6834/1667092126,v1:172.21.2.105:6835/1667092126] conn(0x2b58880 0x2b58c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:07.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa4195e740 4 client.6180 mds_command: new command op to 5973 tid=0[{"prefix": "cache drop", "timeout": 10}] 2021-11-12T05:46:07.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.068+0000 7faa4195e740 1 -- 172.21.2.105:0/1246711871 --> [v2:172.21.2.105:6834/1667092126,v1:172.21.2.105:6835/1667092126] -- command(tid 0: {"prefix": "cache drop", "timeout": 10}) v1 -- 0x290d5e0 con 0x2b58880 2021-11-12T05:46:07.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.072+0000 7faa34cb5700 1 --2- 172.21.2.105:0/1246711871 >> [v2:172.21.2.105:6834/1667092126,v1:172.21.2.105:6835/1667092126] conn(0x2b58880 0x2b58c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:07.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.072+0000 7faa34cb5700 1 --2- 172.21.2.105:0/1246711871 >> [v2:172.21.2.105:6834/1667092126,v1:172.21.2.105:6835/1667092126] conn(0x2b58880 0x2b58c60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=2b01afb54b6718bb server_cookie=762ae6899c60c1b3 in_seq=0 out_seq=0 2021-11-12T05:46:07.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:07.072+0000 7faa0d7fa700 10 client.6180 ms_handle_connect on v2:172.21.2.105:6834/1667092126 2021-11-12T05:46:17.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.252+0000 7faa0d7fa700 1 -- 172.21.2.105:0/1246711871 <== mds.0 v2:172.21.2.105:6834/1667092126 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+406 (crc 0 0 0) 0x290d5e0 con 0x2b58880 2021-11-12T05:46:17.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.252+0000 7faa0d7fa700 10 client.6180 handle_command_reply: tid=0 2021-11-12T05:46:17.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.252+0000 7faa4195e740 1 client.6180 shutdown 2021-11-12T05:46:17.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.252+0000 7faa4195e740 1 -- 172.21.2.105:0/1246711871 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x2ab5fe0 msgr2=0x2b5c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:17.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.252+0000 7faa4195e740 1 --2- 172.21.2.105:0/1246711871 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x2ab5fe0 0x2b5c640 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x2ab7080 tx=0x7faa2c032000).stop 2021-11-12T05:46:17.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.252+0000 7faa4195e740 1 -- 172.21.2.105:0/1246711871 shutdown_connections 2021-11-12T05:46:17.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.252+0000 7faa4195e740 1 --2- 172.21.2.105:0/1246711871 >> [v2:172.21.2.105:6834/1667092126,v1:172.21.2.105:6835/1667092126] conn(0x2b58880 0x2b58c60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:17.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.252+0000 7faa4195e740 1 --2- 172.21.2.105:0/1246711871 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x2af2a80 0x2b58390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:17.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.252+0000 7faa4195e740 1 --2- 172.21.2.105:0/1246711871 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x2abb1e0 0x2b5cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:17.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.252+0000 7faa4195e740 1 --2- 172.21.2.105:0/1246711871 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x2ab5fe0 0x2b5c640 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:17.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.252+0000 7faa4195e740 1 -- 172.21.2.105:0/1246711871 >> 172.21.2.105:0/1246711871 conn(0x2af1f90 msgr2=0x2af2370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:17.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.252+0000 7faa0d7fa700 0 client.6180 ms_handle_reset on v2:172.21.2.105:6834/1667092126 2021-11-12T05:46:17.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.252+0000 7faa4195e740 1 -- 172.21.2.105:0/1246711871 shutdown_connections 2021-11-12T05:46:17.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.252+0000 7faa4195e740 1 -- 172.21.2.105:0/1246711871 wait complete. 2021-11-12T05:46:17.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.252+0000 7faa4195e740 20 client.6180 trim_cache size 0 max 16384 2021-11-12T05:46:17.261 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:46:17.261 INFO:teuthology.orchestra.run.gibba005.stdout: "client_recall": { 2021-11-12T05:46:17.262 INFO:teuthology.orchestra.run.gibba005.stdout: "return_code": -110, 2021-11-12T05:46:17.262 INFO:teuthology.orchestra.run.gibba005.stdout: "message": "(110) Connection timed out", 2021-11-12T05:46:17.262 INFO:teuthology.orchestra.run.gibba005.stdout: "recalled": 240 2021-11-12T05:46:17.262 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.263 INFO:teuthology.orchestra.run.gibba005.stdout: "flush_journal": { 2021-11-12T05:46:17.263 INFO:teuthology.orchestra.run.gibba005.stdout: "return_code": 0, 2021-11-12T05:46:17.263 INFO:teuthology.orchestra.run.gibba005.stdout: "message": "" 2021-11-12T05:46:17.263 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.264 INFO:teuthology.orchestra.run.gibba005.stdout: "trim_cache": { 2021-11-12T05:46:17.264 INFO:teuthology.orchestra.run.gibba005.stdout: "trimmed": 220 2021-11-12T05:46:17.264 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.264 INFO:teuthology.orchestra.run.gibba005.stdout: "cache": { 2021-11-12T05:46:17.264 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": { 2021-11-12T05:46:17.265 INFO:teuthology.orchestra.run.gibba005.stdout: "items": 15430, 2021-11-12T05:46:17.265 INFO:teuthology.orchestra.run.gibba005.stdout: "bytes": 2428320 2021-11-12T05:46:17.265 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.265 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.266 INFO:teuthology.orchestra.run.gibba005.stdout: "duration": 10.181592870999999 2021-11-12T05:46:17.266 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:46:17.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.252+0000 7faa3771a700 1 -- 172.21.2.105:0/1218299238 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7faa10053610 msgr2=0x7faa10055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:17.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.252+0000 7faa3771a700 1 --2- 172.21.2.105:0/1218299238 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7faa10053610 0x7faa10055ad0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7faa30061c60 tx=0x7faa24007800).stop 2021-11-12T05:46:17.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.252+0000 7faa3771a700 1 -- 172.21.2.105:0/1218299238 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faa300b4060 msgr2=0x7faa300b2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:17.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.252+0000 7faa3771a700 1 --2- 172.21.2.105:0/1218299238 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faa300b4060 0x7faa300b2630 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7faa2c00c000 tx=0x7faa2c006df0).stop 2021-11-12T05:46:17.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.252+0000 7faa3771a700 1 -- 172.21.2.105:0/1218299238 shutdown_connections 2021-11-12T05:46:17.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.252+0000 7faa3771a700 1 --2- 172.21.2.105:0/1218299238 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7faa10053610 0x7faa10055ad0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:17.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.252+0000 7faa3771a700 1 --2- 172.21.2.105:0/1218299238 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7faa301473d0 0x7faa301135d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:17.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.252+0000 7faa3771a700 1 --2- 172.21.2.105:0/1218299238 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7faa300b6430 0x7faa300b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:17.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.252+0000 7faa3771a700 1 --2- 172.21.2.105:0/1218299238 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faa300b4060 0x7faa300b2630 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:17.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.252+0000 7faa3771a700 1 -- 172.21.2.105:0/1218299238 >> 172.21.2.105:0/1218299238 conn(0x7faa30062030 msgr2=0x7faa30062410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:17.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.252+0000 7faa3771a700 1 -- 172.21.2.105:0/1218299238 shutdown_connections 2021-11-12T05:46:17.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.252+0000 7faa3771a700 1 -- 172.21.2.105:0/1218299238 wait complete. 2021-11-12T05:46:17.271 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-12T05:46:17.271 DEBUG:teuthology.orchestra.run.gibba005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:46:17.281 DEBUG:teuthology.orchestra.run.gibba015:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:46:17.289 DEBUG:teuthology.orchestra.run.gibba016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:46:17.298 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:46:17.311 DEBUG:teuthology.orchestra.run.gibba044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:46:17.325 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-12T05:46:17.326 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:46:17.326 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:46:17.327 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:46:17.338 INFO:teuthology.orchestra.run.gibba016.stdout:fuseblk 2021-11-12T05:46:17.339 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-12T05:46:17.340 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba016.front.sepia.ceph.com... 2021-11-12T05:46:17.340 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-12T05:46:17.340 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:46:17.354 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[14514]: fuse finished with error 0 and tester_r 0 2021-11-12T05:46:17.355 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:46:17.356 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:46:17.356 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:46:17.360 INFO:teuthology.orchestra.run.gibba016.stdout:ext2/ext3 2021-11-12T05:46:17.360 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-12T05:46:17.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:46:17.471 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:46:17.476 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:46:17.476 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:46:17.477 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:46:17.486 INFO:teuthology.orchestra.run.gibba038.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-12T05:46:17.487 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:46:17.488 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-12T05:46:17.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:46:17.489 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:46:17.497 INFO:teuthology.orchestra.run.gibba038.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-12T05:46:17.498 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:46:17.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:46:17.500 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:46:17.500 DEBUG:teuthology.orchestra.run.gibba044:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:46:17.509 INFO:teuthology.orchestra.run.gibba044.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-12T05:46:17.510 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:46:17.511 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-12T05:46:17.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:46:17.512 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:46:17.521 INFO:teuthology.orchestra.run.gibba044.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-12T05:46:17.521 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:46:17.522 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-12T05:46:17.634 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.628+0000 7f316ce1e700 1 Processor -- start 2021-11-12T05:46:17.634 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.628+0000 7f316ce1e700 1 -- start start 2021-11-12T05:46:17.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f316ce1e700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f31680b6380 0x7f31680b6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:17.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f316ce1e700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f31681390a0 0x7f31681394a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:17.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f316ce1e700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f316813fab0 con 0x7f3168142900 2021-11-12T05:46:17.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f316ce1e700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31680afeb0 con 0x7f31681390a0 2021-11-12T05:46:17.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f316ce1e700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f316813fd50 con 0x7f31680b6380 2021-11-12T05:46:17.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f3165d9b700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f3168142900 0x7f316813f300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57346/0 (socket says 172.21.2.105:57346) 2021-11-12T05:46:17.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f3165d9b700 1 -- 172.21.2.105:0/703764611 learned_addr learned my addr 172.21.2.105:0/703764611 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:46:17.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f3166d9d700 1 --2- 172.21.2.105:0/703764611 >> v2:172.21.2.105:3300/0 conn(0x7f31681390a0 0x7f31681394a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:17.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f316559a700 1 -- 172.21.2.105:0/703764611 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3622528916 0 0) 0x7f316813fab0 con 0x7f3168142900 2021-11-12T05:46:17.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f316559a700 1 -- 172.21.2.105:0/703764611 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3148003260 con 0x7f3168142900 2021-11-12T05:46:17.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f3166d9d700 1 -- 172.21.2.105:0/703764611 >> v2:172.21.2.115:3300/0 conn(0x7f31680b6380 msgr2=0x7f31680b6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:17.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f3166d9d700 1 --2- 172.21.2.105:0/703764611 >> v2:172.21.2.115:3300/0 conn(0x7f31680b6380 0x7f31680b6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:17.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f3166d9d700 1 -- 172.21.2.105:0/703764611 >> v1:172.21.2.105:6789/0 conn(0x7f3168142900 legacy=0x7f316813f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:17.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f3166d9d700 1 -- 172.21.2.105:0/703764611 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316813fff0 con 0x7f31681390a0 2021-11-12T05:46:17.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f3166d9d700 1 --2- 172.21.2.105:0/703764611 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f31681390a0 0x7f31681394a0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7f31600032f0 tx=0x7f31600091d0).ready entity=mon.0 client_cookie=ddadb8f3f9dfc668 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:17.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f316559a700 1 -- 172.21.2.105:0/703764611 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f316000b680 con 0x7f31681390a0 2021-11-12T05:46:17.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f316559a700 1 -- 172.21.2.105:0/703764611 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f316000b7e0 con 0x7f31681390a0 2021-11-12T05:46:17.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f316559a700 1 -- 172.21.2.105:0/703764611 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f316000b950 con 0x7f31681390a0 2021-11-12T05:46:17.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f316ce1e700 1 -- 172.21.2.105:0/703764611 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f31681390a0 msgr2=0x7f31681394a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:17.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f316ce1e700 1 --2- 172.21.2.105:0/703764611 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f31681390a0 0x7f31681394a0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7f31600032f0 tx=0x7f31600091d0).stop 2021-11-12T05:46:17.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f316ce1e700 1 -- 172.21.2.105:0/703764611 shutdown_connections 2021-11-12T05:46:17.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f316ce1e700 1 --2- 172.21.2.105:0/703764611 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f31681390a0 0x7f31681394a0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:17.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f316ce1e700 1 --2- 172.21.2.105:0/703764611 >> v2:172.21.2.115:3300/0 conn(0x7f31680b6380 0x7f31680b6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:17.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f316ce1e700 1 -- 172.21.2.105:0/703764611 >> 172.21.2.105:0/703764611 conn(0x7f3168063810 msgr2=0x7f31680b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:17.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f316ce1e700 1 -- 172.21.2.105:0/703764611 shutdown_connections 2021-11-12T05:46:17.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f316ce1e700 1 -- 172.21.2.105:0/703764611 wait complete. 2021-11-12T05:46:17.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f316ce1e700 1 Processor -- start 2021-11-12T05:46:17.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f316ce1e700 1 -- start start 2021-11-12T05:46:17.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f316ce1e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f31680b6380 0x7f3168159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:17.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f316ce1e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f31681390a0 0x7f31680b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:17.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f316ce1e700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3168142900 0x7f31681411e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:17.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f316ce1e700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31680b5810 con 0x7f31680b6380 2021-11-12T05:46:17.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f316ce1e700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31681423d0 con 0x7f3168142900 2021-11-12T05:46:17.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f316ce1e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3168156600 con 0x7f31681390a0 2021-11-12T05:46:17.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f316659c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f31680b6380 0x7f3168159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:17.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f316659c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f31680b6380 0x7f3168159a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46954/0 (socket says 172.21.2.105:46954) 2021-11-12T05:46:17.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f316659c700 1 -- 172.21.2.105:0/3911100380 learned_addr learned my addr 172.21.2.105:0/3911100380 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:17.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f316659c700 1 -- 172.21.2.105:0/3911100380 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f31681390a0 msgr2=0x7f31680b4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:17.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f316659c700 1 --2- 172.21.2.105:0/3911100380 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f31681390a0 0x7f31680b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:17.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f316659c700 1 -- 172.21.2.105:0/3911100380 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3168142900 msgr2=0x7f31681411e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:17.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f316659c700 1 --2- 172.21.2.105:0/3911100380 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3168142900 0x7f31681411e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:17.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.632+0000 7f316659c700 1 -- 172.21.2.105:0/3911100380 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3160009470 con 0x7f31680b6380 2021-11-12T05:46:17.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.636+0000 7f316659c700 1 --2- 172.21.2.105:0/3911100380 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f31680b6380 0x7f3168159a80 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7f3158002f70 tx=0x7f3158006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:17.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.636+0000 7f315f7fe700 1 -- 172.21.2.105:0/3911100380 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3158013460 con 0x7f31680b6380 2021-11-12T05:46:17.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.636+0000 7f315f7fe700 1 -- 172.21.2.105:0/3911100380 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31580135c0 con 0x7f31680b6380 2021-11-12T05:46:17.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.636+0000 7f316ce1e700 1 -- 172.21.2.105:0/3911100380 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31681416d0 con 0x7f31680b6380 2021-11-12T05:46:17.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.636+0000 7f315f7fe700 1 -- 172.21.2.105:0/3911100380 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3158013920 con 0x7f31680b6380 2021-11-12T05:46:17.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.636+0000 7f316ce1e700 1 -- 172.21.2.105:0/3911100380 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3168141fa0 con 0x7f31680b6380 2021-11-12T05:46:17.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.636+0000 7f316ce1e700 1 -- 172.21.2.105:0/3911100380 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31681567c0 con 0x7f31680b6380 2021-11-12T05:46:17.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.636+0000 7f315f7fe700 1 -- 172.21.2.105:0/3911100380 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f315801a060 con 0x7f31680b6380 2021-11-12T05:46:17.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.636+0000 7f315f7fe700 1 --2- 172.21.2.105:0/3911100380 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f314c0536a0 0x7f314c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:17.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.636+0000 7f315f7fe700 1 -- 172.21.2.105:0/3911100380 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f315806b480 con 0x7f31680b6380 2021-11-12T05:46:17.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.636+0000 7f3165d9b700 1 --2- 172.21.2.105:0/3911100380 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f314c0536a0 0x7f314c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:17.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.636+0000 7f3165d9b700 1 --2- 172.21.2.105:0/3911100380 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f314c0536a0 0x7f314c055b60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f3150001110 tx=0x7f31500076c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:17.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.640+0000 7f315f7fe700 1 -- 172.21.2.105:0/3911100380 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3158042490 con 0x7f31680b6380 2021-11-12T05:46:17.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.720+0000 7f316ce1e700 1 -- 172.21.2.105:0/3911100380 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f3168057350 con 0x7f31680b6380 2021-11-12T05:46:17.726 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.720+0000 7f315f7fe700 1 -- 172.21.2.105:0/3911100380 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v65) v1 ==== 81+0+34040 (secure 0 0 0) 0x7f3158018030 con 0x7f31680b6380 2021-11-12T05:46:17.727 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:46:17.727 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:46:17.728 INFO:teuthology.orchestra.run.gibba005.stdout: "epoch": 65, 2021-11-12T05:46:17.728 INFO:teuthology.orchestra.run.gibba005.stdout: "fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", 2021-11-12T05:46:17.728 INFO:teuthology.orchestra.run.gibba005.stdout: "created": "2021-11-12T05:40:19.986390+0000", 2021-11-12T05:46:17.728 INFO:teuthology.orchestra.run.gibba005.stdout: "modified": "2021-11-12T05:45:44.354326+0000", 2021-11-12T05:46:17.729 INFO:teuthology.orchestra.run.gibba005.stdout: "last_up_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:46:17.729 INFO:teuthology.orchestra.run.gibba005.stdout: "last_in_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:46:17.729 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-12T05:46:17.729 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_num": 5799936, 2021-11-12T05:46:17.730 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_set": [ 2021-11-12T05:46:17.730 INFO:teuthology.orchestra.run.gibba005.stdout: "pglog_hardlimit", 2021-11-12T05:46:17.730 INFO:teuthology.orchestra.run.gibba005.stdout: "purged_snapdirs", 2021-11-12T05:46:17.730 INFO:teuthology.orchestra.run.gibba005.stdout: "recovery_deletes", 2021-11-12T05:46:17.730 INFO:teuthology.orchestra.run.gibba005.stdout: "sortbitwise" 2021-11-12T05:46:17.731 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:46:17.731 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_version": 5, 2021-11-12T05:46:17.731 INFO:teuthology.orchestra.run.gibba005.stdout: "full_ratio": 0.94999998807907104, 2021-11-12T05:46:17.731 INFO:teuthology.orchestra.run.gibba005.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-12T05:46:17.732 INFO:teuthology.orchestra.run.gibba005.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-12T05:46:17.732 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_snapshot": "", 2021-11-12T05:46:17.732 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_max": 12, 2021-11-12T05:46:17.732 INFO:teuthology.orchestra.run.gibba005.stdout: "max_osd": 8, 2021-11-12T05:46:17.733 INFO:teuthology.orchestra.run.gibba005.stdout: "require_min_compat_client": "jewel", 2021-11-12T05:46:17.733 INFO:teuthology.orchestra.run.gibba005.stdout: "min_compat_client": "jewel", 2021-11-12T05:46:17.733 INFO:teuthology.orchestra.run.gibba005.stdout: "require_osd_release": "octopus", 2021-11-12T05:46:17.733 INFO:teuthology.orchestra.run.gibba005.stdout: "pools": [ 2021-11-12T05:46:17.733 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.734 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 1, 2021-11-12T05:46:17.734 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "device_health_metrics", 2021-11-12T05:46:17.734 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:22.022116+0000", 2021-11-12T05:46:17.734 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:46:17.735 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:46:17.735 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:46:17.735 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:46:17.735 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:46:17.735 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:46:17.736 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:46:17.736 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:46:17.736 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 1, 2021-11-12T05:46:17.736 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 1, 2021-11-12T05:46:17.737 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 1, 2021-11-12T05:46:17.737 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 1, 2021-11-12T05:46:17.737 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 1, 2021-11-12T05:46:17.737 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:46:17.738 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:46:17.738 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:46:17.738 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:46:17.738 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:46:17.738 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:46:17.739 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:46:17.739 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.739 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "16", 2021-11-12T05:46:17.739 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:46:17.739 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:46:17.740 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:46:17.740 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:46:17.740 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:46:17.740 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:46:17.741 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:46:17.741 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:46:17.741 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:46:17.741 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:46:17.741 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:46:17.742 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:46:17.742 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:46:17.742 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:46:17.742 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:46:17.743 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:46:17.743 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:46:17.743 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:46:17.743 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:46:17.743 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:46:17.744 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:46:17.744 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:46:17.744 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:46:17.744 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:46:17.745 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:46:17.745 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:46:17.745 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.745 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:46:17.745 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:46:17.746 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:46:17.746 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:46:17.746 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:46:17.746 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:46:17.747 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:46:17.747 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:46:17.747 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:46:17.747 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:46:17.747 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:46:17.748 INFO:teuthology.orchestra.run.gibba005.stdout: "options": { 2021-11-12T05:46:17.748 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_min": 1 2021-11-12T05:46:17.748 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.749 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:46:17.749 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr_devicehealth": {} 2021-11-12T05:46:17.749 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.749 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.750 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.750 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 2, 2021-11-12T05:46:17.750 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "rbd", 2021-11-12T05:46:17.750 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:29.953617+0000", 2021-11-12T05:46:17.750 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:46:17.751 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:46:17.751 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:46:17.751 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:46:17.751 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:46:17.752 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:46:17.752 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:46:17.752 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:46:17.752 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:46:17.752 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:46:17.753 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:46:17.753 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:46:17.753 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:46:17.753 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:46:17.754 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:46:17.754 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:46:17.754 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:46:17.754 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:46:17.755 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:46:17.755 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:46:17.755 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.755 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "19", 2021-11-12T05:46:17.755 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:46:17.756 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:46:17.756 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:46:17.756 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:46:17.756 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:46:17.757 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:46:17.757 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:46:17.757 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:46:17.757 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:46:17.757 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:46:17.758 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:46:17.758 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:46:17.758 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:46:17.758 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:46:17.759 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:46:17.759 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:46:17.759 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:46:17.759 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:46:17.759 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:46:17.760 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:46:17.760 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:46:17.760 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:46:17.760 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:46:17.761 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:46:17.761 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:46:17.761 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:46:17.761 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.761 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:46:17.762 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:46:17.762 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:46:17.762 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:46:17.762 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:46:17.763 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:46:17.763 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:46:17.763 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:46:17.763 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:46:17.764 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:46:17.764 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:46:17.764 INFO:teuthology.orchestra.run.gibba005.stdout: "options": {}, 2021-11-12T05:46:17.764 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:46:17.764 INFO:teuthology.orchestra.run.gibba005.stdout: "rbd": {} 2021-11-12T05:46:17.765 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.765 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.765 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.765 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 11, 2021-11-12T05:46:17.765 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "cephfs_metadata", 2021-11-12T05:46:17.766 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:45:41.270040+0000", 2021-11-12T05:46:17.766 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:46:17.766 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:46:17.766 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:46:17.767 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:46:17.767 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:46:17.767 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:46:17.767 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:46:17.767 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:46:17.768 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:46:17.768 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:46:17.768 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:46:17.768 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:46:17.769 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:46:17.769 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:46:17.769 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:46:17.769 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:46:17.769 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:46:17.770 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:46:17.770 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:46:17.770 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:46:17.770 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.771 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "64", 2021-11-12T05:46:17.771 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:46:17.771 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:46:17.771 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:46:17.772 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:46:17.772 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:46:17.772 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:46:17.772 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:46:17.772 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:46:17.773 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:46:17.773 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:46:17.773 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:46:17.773 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:46:17.773 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:46:17.774 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:46:17.774 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:46:17.774 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:46:17.774 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:46:17.775 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:46:17.775 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:46:17.775 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:46:17.775 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:46:17.775 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:46:17.775 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:46:17.776 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:46:17.776 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:46:17.776 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:46:17.776 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.777 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:46:17.777 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:46:17.777 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:46:17.777 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:46:17.777 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:46:17.778 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:46:17.778 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:46:17.778 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:46:17.778 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:46:17.779 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:46:17.779 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:46:17.779 INFO:teuthology.orchestra.run.gibba005.stdout: "options": { 2021-11-12T05:46:17.779 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_bias": 4, 2021-11-12T05:46:17.779 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_min": 16, 2021-11-12T05:46:17.780 INFO:teuthology.orchestra.run.gibba005.stdout: "recovery_priority": 5 2021-11-12T05:46:17.780 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.780 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:46:17.781 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs": { 2021-11-12T05:46:17.781 INFO:teuthology.orchestra.run.gibba005.stdout: "metadata": "cephfs" 2021-11-12T05:46:17.781 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.781 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.782 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.782 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.782 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 12, 2021-11-12T05:46:17.782 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "cephfs_data", 2021-11-12T05:46:17.783 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:45:42.319352+0000", 2021-11-12T05:46:17.783 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:46:17.783 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:46:17.783 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:46:17.784 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:46:17.784 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:46:17.784 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:46:17.784 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:46:17.785 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:46:17.785 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:46:17.785 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:46:17.785 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:46:17.785 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:46:17.786 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:46:17.786 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:46:17.786 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:46:17.786 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:46:17.787 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:46:17.787 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:46:17.787 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:46:17.787 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:46:17.787 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.788 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "65", 2021-11-12T05:46:17.788 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:46:17.788 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:46:17.788 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:46:17.789 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:46:17.789 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:46:17.789 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:46:17.789 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:46:17.789 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:46:17.790 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:46:17.790 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:46:17.790 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:46:17.790 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:46:17.790 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:46:17.791 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:46:17.791 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:46:17.791 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:46:17.791 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:46:17.792 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:46:17.792 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:46:17.792 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:46:17.792 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:46:17.792 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:46:17.793 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:46:17.793 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:46:17.793 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:46:17.793 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:46:17.794 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.794 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:46:17.794 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:46:17.794 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:46:17.795 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:46:17.795 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:46:17.795 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:46:17.795 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:46:17.795 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:46:17.796 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:46:17.796 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:46:17.796 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:46:17.796 INFO:teuthology.orchestra.run.gibba005.stdout: "options": {}, 2021-11-12T05:46:17.797 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:46:17.797 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs": { 2021-11-12T05:46:17.797 INFO:teuthology.orchestra.run.gibba005.stdout: "data": "cephfs" 2021-11-12T05:46:17.797 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.797 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.798 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.798 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:46:17.798 INFO:teuthology.orchestra.run.gibba005.stdout: "osds": [ 2021-11-12T05:46:17.798 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.799 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:46:17.799 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "ee8e30a0-4819-4475-80ec-dd3ee7d01322", 2021-11-12T05:46:17.799 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:46:17.799 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:46:17.799 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:46:17.800 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:46:17.800 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:46:17.800 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:46:17.800 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:46:17.800 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 63, 2021-11-12T05:46:17.801 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:46:17.801 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:46:17.801 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:46:17.801 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:17.802 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.802 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:17.802 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6802", 2021-11-12T05:46:17.802 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:46:17.803 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.803 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.803 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:17.803 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6803", 2021-11-12T05:46:17.803 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:46:17.804 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.804 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.804 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.804 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:46:17.804 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:17.805 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.805 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:17.805 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6804", 2021-11-12T05:46:17.805 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:46:17.806 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.806 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.806 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:17.806 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6805", 2021-11-12T05:46:17.806 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:46:17.807 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.807 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.807 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.807 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:46:17.808 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:17.808 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.808 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:17.808 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6808", 2021-11-12T05:46:17.808 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:46:17.809 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.809 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.809 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:17.809 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6809", 2021-11-12T05:46:17.810 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:46:17.810 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.810 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.810 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.810 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:46:17.811 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:17.811 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.811 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:17.811 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6806", 2021-11-12T05:46:17.812 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:46:17.812 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.812 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.812 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:17.812 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6807", 2021-11-12T05:46:17.813 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:46:17.813 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.813 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.813 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.814 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6803/14874", 2021-11-12T05:46:17.814 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6805/14874", 2021-11-12T05:46:17.814 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6809/14874", 2021-11-12T05:46:17.814 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6807/14874", 2021-11-12T05:46:17.814 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:46:17.815 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:46:17.815 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:46:17.815 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.815 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.816 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.816 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:46:17.816 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "b1bb06c3-26d0-4d92-82f8-b3e882242785", 2021-11-12T05:46:17.816 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:46:17.816 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:46:17.817 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:46:17.817 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:46:17.817 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:46:17.817 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:46:17.817 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:46:17.818 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 63, 2021-11-12T05:46:17.818 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:46:17.818 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:46:17.818 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:46:17.819 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:17.819 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.819 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:17.819 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6810", 2021-11-12T05:46:17.820 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:46:17.820 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.820 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.820 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:17.820 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6811", 2021-11-12T05:46:17.821 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:46:17.821 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.821 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.821 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.821 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:46:17.822 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:17.822 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.822 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:17.822 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6812", 2021-11-12T05:46:17.823 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:46:17.823 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.823 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.823 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:17.823 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6813", 2021-11-12T05:46:17.824 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:46:17.824 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.824 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.824 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.824 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:46:17.825 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:17.825 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.825 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:17.825 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6816", 2021-11-12T05:46:17.826 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:46:17.826 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.826 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.826 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:17.826 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6817", 2021-11-12T05:46:17.827 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:46:17.827 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.827 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.827 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.828 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:46:17.828 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:17.828 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.828 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:17.828 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6814", 2021-11-12T05:46:17.829 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:46:17.829 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.829 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.829 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:17.830 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6815", 2021-11-12T05:46:17.830 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:46:17.830 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.830 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.830 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.831 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6811/14875", 2021-11-12T05:46:17.831 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6813/14875", 2021-11-12T05:46:17.831 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6817/14875", 2021-11-12T05:46:17.831 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6815/14875", 2021-11-12T05:46:17.832 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:46:17.832 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:46:17.832 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:46:17.832 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.832 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.833 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.833 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:46:17.833 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "837b2c60-c335-4382-9f47-d86543a14022", 2021-11-12T05:46:17.833 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:46:17.834 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:46:17.834 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:46:17.834 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:46:17.834 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:46:17.834 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:46:17.835 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:46:17.835 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 62, 2021-11-12T05:46:17.835 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:46:17.835 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:46:17.836 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:46:17.836 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:17.836 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.836 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:17.836 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6818", 2021-11-12T05:46:17.837 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:46:17.837 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.837 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.837 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:17.838 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6819", 2021-11-12T05:46:17.838 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:46:17.838 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.838 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.839 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.839 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:46:17.839 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:17.839 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.839 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:17.840 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6820", 2021-11-12T05:46:17.840 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:46:17.840 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.840 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.841 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:17.841 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6821", 2021-11-12T05:46:17.841 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:46:17.841 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.842 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.842 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.842 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:46:17.842 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:17.843 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.843 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:17.843 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6824", 2021-11-12T05:46:17.843 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:46:17.844 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.844 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.844 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:17.844 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6825", 2021-11-12T05:46:17.844 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:46:17.845 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.845 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.845 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.845 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:46:17.846 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:17.846 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.846 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:17.846 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6822", 2021-11-12T05:46:17.847 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:46:17.847 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.847 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.847 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:17.847 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6823", 2021-11-12T05:46:17.848 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:46:17.848 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.848 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.848 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.848 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6819/14905", 2021-11-12T05:46:17.849 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6821/14905", 2021-11-12T05:46:17.849 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6825/14905", 2021-11-12T05:46:17.849 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6823/14905", 2021-11-12T05:46:17.849 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:46:17.850 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:46:17.850 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:46:17.850 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.850 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.851 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.851 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:46:17.851 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "eb2b737b-dda6-444b-a306-f33cbbd51f70", 2021-11-12T05:46:17.851 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:46:17.851 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:46:17.852 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:46:17.852 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:46:17.852 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:46:17.852 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:46:17.853 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:46:17.853 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 52, 2021-11-12T05:46:17.853 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:46:17.853 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:46:17.853 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:46:17.854 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:17.854 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.854 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:17.854 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6826", 2021-11-12T05:46:17.855 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:46:17.855 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.855 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.855 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:17.855 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6827", 2021-11-12T05:46:17.856 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:46:17.856 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.856 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.856 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.857 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:46:17.857 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:17.857 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.857 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:17.857 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6828", 2021-11-12T05:46:17.858 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:46:17.858 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.858 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.858 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:17.859 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6829", 2021-11-12T05:46:17.859 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:46:17.859 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.859 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.859 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.860 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:46:17.860 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:17.860 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.860 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:17.861 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6832", 2021-11-12T05:46:17.861 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:46:17.861 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.861 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.861 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:17.862 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6833", 2021-11-12T05:46:17.862 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:46:17.862 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.862 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.863 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.863 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:46:17.863 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:17.863 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.863 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:17.864 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6830", 2021-11-12T05:46:17.864 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:46:17.864 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.864 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.865 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:17.865 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6831", 2021-11-12T05:46:17.865 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:46:17.865 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.865 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.866 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.866 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6827/14876", 2021-11-12T05:46:17.866 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6829/14876", 2021-11-12T05:46:17.866 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6833/14876", 2021-11-12T05:46:17.867 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6831/14876", 2021-11-12T05:46:17.867 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:46:17.867 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:46:17.867 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:46:17.867 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.868 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.868 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.868 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:46:17.868 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "721529a1-c047-486a-a7ca-ddc15d80cdde", 2021-11-12T05:46:17.869 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:46:17.869 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:46:17.869 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:46:17.869 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:46:17.869 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:46:17.870 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:46:17.870 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:46:17.870 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 63, 2021-11-12T05:46:17.870 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:46:17.871 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:46:17.871 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:46:17.871 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:17.871 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.871 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:17.872 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6800", 2021-11-12T05:46:17.872 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:46:17.872 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.872 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.873 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:17.873 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6801", 2021-11-12T05:46:17.873 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:46:17.873 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.873 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.874 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.874 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:46:17.874 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:17.874 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.875 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:17.875 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6802", 2021-11-12T05:46:17.875 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:46:17.875 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.875 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.876 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:17.876 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6803", 2021-11-12T05:46:17.876 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:46:17.876 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.877 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.877 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.877 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:46:17.877 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:17.877 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.878 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:17.878 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6806", 2021-11-12T05:46:17.878 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:46:17.878 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.879 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.879 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:17.879 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6807", 2021-11-12T05:46:17.879 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:46:17.879 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.880 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.880 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.880 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:46:17.880 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:17.881 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.881 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:17.881 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6804", 2021-11-12T05:46:17.881 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:46:17.881 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.882 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.882 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:17.882 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6805", 2021-11-12T05:46:17.882 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:46:17.882 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.883 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.883 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.883 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6801/15096", 2021-11-12T05:46:17.883 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6803/15096", 2021-11-12T05:46:17.884 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6807/15096", 2021-11-12T05:46:17.884 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6805/15096", 2021-11-12T05:46:17.884 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:46:17.884 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:46:17.885 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:46:17.885 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.885 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.885 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.885 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:46:17.886 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "68b72ab2-fa82-4b5c-bf33-528f002e4950", 2021-11-12T05:46:17.886 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:46:17.886 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:46:17.886 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:46:17.886 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:46:17.887 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:46:17.887 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:46:17.887 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:46:17.887 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 62, 2021-11-12T05:46:17.888 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:46:17.888 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:46:17.888 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:46:17.888 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:17.888 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.889 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:17.889 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6808", 2021-11-12T05:46:17.889 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:46:17.889 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.889 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.890 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:17.890 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6809", 2021-11-12T05:46:17.890 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:46:17.890 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.891 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.891 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.891 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:46:17.891 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:17.891 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.892 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:17.892 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6810", 2021-11-12T05:46:17.892 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:46:17.892 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.893 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.893 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:17.893 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6811", 2021-11-12T05:46:17.893 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:46:17.893 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.894 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.894 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.894 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:46:17.894 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:17.895 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.895 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:17.895 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6814", 2021-11-12T05:46:17.895 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:46:17.896 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.896 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.896 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:17.896 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6815", 2021-11-12T05:46:17.896 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:46:17.897 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.897 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.897 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.897 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:46:17.898 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:17.898 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.898 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:17.898 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6812", 2021-11-12T05:46:17.898 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:46:17.899 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.899 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.899 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:17.899 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6813", 2021-11-12T05:46:17.900 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:46:17.900 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.900 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.900 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.900 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6809/15097", 2021-11-12T05:46:17.901 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6811/15097", 2021-11-12T05:46:17.901 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6815/15097", 2021-11-12T05:46:17.901 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6813/15097", 2021-11-12T05:46:17.901 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:46:17.902 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:46:17.902 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:46:17.902 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.902 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.902 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.903 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:46:17.903 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "a2c83b5d-8d37-4d30-ac04-30d89a76e485", 2021-11-12T05:46:17.903 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:46:17.903 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:46:17.904 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:46:17.904 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:46:17.904 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:46:17.904 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:46:17.904 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:46:17.905 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 63, 2021-11-12T05:46:17.905 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:46:17.905 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:46:17.905 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:46:17.906 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:17.906 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.906 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:17.906 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6816", 2021-11-12T05:46:17.906 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:46:17.907 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.907 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.907 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:17.907 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6817", 2021-11-12T05:46:17.908 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:46:17.908 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.908 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.908 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.908 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:46:17.909 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:17.909 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.909 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:17.909 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6818", 2021-11-12T05:46:17.910 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:46:17.910 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.910 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.910 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:17.910 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6819", 2021-11-12T05:46:17.911 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:46:17.911 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.911 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.911 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.912 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:46:17.912 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:17.912 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.912 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:17.912 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6822", 2021-11-12T05:46:17.913 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:46:17.913 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.913 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.913 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:17.913 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6823", 2021-11-12T05:46:17.914 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:46:17.914 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.914 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.914 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.915 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:46:17.915 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:17.915 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.915 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:17.915 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6820", 2021-11-12T05:46:17.916 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:46:17.916 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.916 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.916 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:17.917 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6821", 2021-11-12T05:46:17.917 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:46:17.917 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.917 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.917 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.918 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6817/15098", 2021-11-12T05:46:17.918 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6819/15098", 2021-11-12T05:46:17.918 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6823/15098", 2021-11-12T05:46:17.918 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6821/15098", 2021-11-12T05:46:17.919 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:46:17.919 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:46:17.919 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:46:17.919 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.919 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.920 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.920 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:46:17.920 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "786ce966-d0fb-4181-aed4-c26e3ef61c43", 2021-11-12T05:46:17.920 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:46:17.921 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:46:17.921 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:46:17.921 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:46:17.921 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:46:17.921 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:46:17.922 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:46:17.922 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 62, 2021-11-12T05:46:17.922 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:46:17.922 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:46:17.923 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:46:17.923 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:17.923 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.923 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:17.923 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6824", 2021-11-12T05:46:17.924 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:46:17.924 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.924 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.924 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:17.925 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6825", 2021-11-12T05:46:17.925 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:46:17.925 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.925 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.925 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.926 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:46:17.926 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:17.926 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.926 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:17.927 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6826", 2021-11-12T05:46:17.927 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:46:17.927 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.927 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.927 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:17.928 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6827", 2021-11-12T05:46:17.928 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:46:17.928 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.928 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.929 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.929 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:46:17.929 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:17.929 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.929 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:17.930 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6830", 2021-11-12T05:46:17.930 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:46:17.930 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.930 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.931 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:17.931 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6831", 2021-11-12T05:46:17.931 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:46:17.931 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.931 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.932 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.932 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:46:17.932 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:17.932 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.932 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:17.933 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6828", 2021-11-12T05:46:17.933 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:46:17.933 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.933 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.933 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:17.934 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6829", 2021-11-12T05:46:17.934 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:46:17.934 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.934 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.935 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.935 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6825/15099", 2021-11-12T05:46:17.935 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6827/15099", 2021-11-12T05:46:17.935 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6831/15099", 2021-11-12T05:46:17.935 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6829/15099", 2021-11-12T05:46:17.936 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:46:17.936 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:46:17.936 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:46:17.936 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:17.937 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.937 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:46:17.937 INFO:teuthology.orchestra.run.gibba005.stdout: "osd_xinfo": [ 2021-11-12T05:46:17.937 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.937 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:46:17.938 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:46:17.938 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:46:17.938 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:46:17.938 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:46:17.939 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:46:17.939 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.615112+0000", 2021-11-12T05:46:17.939 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:46:17.939 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.939 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.940 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:46:17.940 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:46:17.940 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:46:17.940 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:46:17.941 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:46:17.941 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:46:17.941 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.665935+0000", 2021-11-12T05:46:17.941 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:46:17.941 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.942 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.942 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:46:17.942 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:46:17.942 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:46:17.943 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:46:17.943 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:46:17.943 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:46:17.943 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.715877+0000", 2021-11-12T05:46:17.944 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:46:17.944 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.944 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.944 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:46:17.944 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:46:17.945 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:46:17.945 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:46:17.945 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:46:17.945 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:46:17.945 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.489234+0000", 2021-11-12T05:46:17.946 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:46:17.946 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.946 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.946 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:46:17.947 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:46:17.947 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:46:17.947 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:46:17.947 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:46:17.947 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:46:17.948 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.413776+0000", 2021-11-12T05:46:17.948 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:46:17.948 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.948 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.949 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:46:17.949 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:46:17.949 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:46:17.949 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:46:17.949 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:46:17.950 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:46:17.950 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.507960+0000", 2021-11-12T05:46:17.950 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:46:17.950 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.951 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.951 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:46:17.951 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:46:17.951 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:46:17.951 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:46:17.952 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:46:17.952 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:46:17.952 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.635696+0000", 2021-11-12T05:46:17.952 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:46:17.953 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.953 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:17.953 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:46:17.953 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:46:17.953 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:46:17.954 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:46:17.954 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:46:17.954 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:46:17.954 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.746949+0000", 2021-11-12T05:46:17.955 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:46:17.955 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.955 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:46:17.955 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap": [], 2021-11-12T05:46:17.955 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap_items": [], 2021-11-12T05:46:17.956 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_temp": [], 2021-11-12T05:46:17.956 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_temp": [], 2021-11-12T05:46:17.956 INFO:teuthology.orchestra.run.gibba005.stdout: "blacklist": {}, 2021-11-12T05:46:17.956 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profiles": { 2021-11-12T05:46:17.957 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs_data": { 2021-11-12T05:46:17.957 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-device-class": "", 2021-11-12T05:46:17.957 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:46:17.957 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-root": "default", 2021-11-12T05:46:17.957 INFO:teuthology.orchestra.run.gibba005.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-12T05:46:17.958 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:46:17.958 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "2", 2021-11-12T05:46:17.958 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:46:17.958 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:46:17.959 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van", 2021-11-12T05:46:17.959 INFO:teuthology.orchestra.run.gibba005.stdout: "w": "8" 2021-11-12T05:46:17.959 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.959 INFO:teuthology.orchestra.run.gibba005.stdout: "default": { 2021-11-12T05:46:17.959 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:46:17.960 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:46:17.960 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "1", 2021-11-12T05:46:17.960 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:46:17.960 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:46:17.960 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van" 2021-11-12T05:46:17.961 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:17.961 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:17.961 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps_queue": [], 2021-11-12T05:46:17.961 INFO:teuthology.orchestra.run.gibba005.stdout: "new_removed_snaps": [], 2021-11-12T05:46:17.962 INFO:teuthology.orchestra.run.gibba005.stdout: "new_purged_snaps": [], 2021-11-12T05:46:17.962 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_node_flags": {}, 2021-11-12T05:46:17.962 INFO:teuthology.orchestra.run.gibba005.stdout: "device_class_flags": {} 2021-11-12T05:46:17.962 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:46:17.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.724+0000 7f316ce1e700 1 -- 172.21.2.105:0/3911100380 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f314c0536a0 msgr2=0x7f314c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:17.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.724+0000 7f316ce1e700 1 --2- 172.21.2.105:0/3911100380 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f314c0536a0 0x7f314c055b60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f3150001110 tx=0x7f31500076c0).stop 2021-11-12T05:46:17.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.724+0000 7f316ce1e700 1 -- 172.21.2.105:0/3911100380 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f31680b6380 msgr2=0x7f3168159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:17.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.724+0000 7f316ce1e700 1 --2- 172.21.2.105:0/3911100380 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f31680b6380 0x7f3168159a80 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7f3158002f70 tx=0x7f3158006ec0).stop 2021-11-12T05:46:17.965 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.724+0000 7f316ce1e700 1 -- 172.21.2.105:0/3911100380 shutdown_connections 2021-11-12T05:46:17.965 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.724+0000 7f316ce1e700 1 --2- 172.21.2.105:0/3911100380 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f314c0536a0 0x7f314c055b60 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:17.965 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.724+0000 7f316ce1e700 1 --2- 172.21.2.105:0/3911100380 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3168142900 0x7f31681411e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:17.965 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.724+0000 7f316ce1e700 1 --2- 172.21.2.105:0/3911100380 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f31681390a0 0x7f31680b4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:17.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.724+0000 7f316ce1e700 1 --2- 172.21.2.105:0/3911100380 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f31680b6380 0x7f3168159a80 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:17.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.724+0000 7f316ce1e700 1 -- 172.21.2.105:0/3911100380 >> 172.21.2.105:0/3911100380 conn(0x7f3168063810 msgr2=0x7f3168149c30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:17.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.724+0000 7f316ce1e700 1 -- 172.21.2.105:0/3911100380 shutdown_connections 2021-11-12T05:46:17.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:17.724+0000 7f316ce1e700 1 -- 172.21.2.105:0/3911100380 wait complete. 2021-11-12T05:46:17.967 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:46:18.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.016+0000 7fe6f24ec700 1 Processor -- start 2021-11-12T05:46:18.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.016+0000 7fe6f24ec700 1 -- start start 2021-11-12T05:46:18.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f24ec700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe6ec0b26f0 0x7fe6ec14b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:18.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f24ec700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fe6ec060be0 0x7fe6ec0ac6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:18.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f24ec700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe6ec147b10 0x7fe6ec144210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:18.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f24ec700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6ec14b7b0 con 0x7fe6ec147b10 2021-11-12T05:46:18.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f24ec700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6ec0ac440 con 0x7fe6ec060be0 2021-11-12T05:46:18.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f24ec700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ec0b2ad0 con 0x7fe6ec0b26f0 2021-11-12T05:46:18.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f1ceb700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe6ec147b10 0x7fe6ec144210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:18.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f1ceb700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe6ec147b10 0x7fe6ec144210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46964/0 (socket says 172.21.2.105:46964) 2021-11-12T05:46:18.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f1ceb700 1 -- 172.21.2.105:0/3210214284 learned_addr learned my addr 172.21.2.105:0/3210214284 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:18.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f1ceb700 1 -- 172.21.2.105:0/3210214284 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe6ec0b26f0 msgr2=0x7fe6ec14b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:18.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f1ceb700 1 --2- 172.21.2.105:0/3210214284 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe6ec0b26f0 0x7fe6ec14b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:18.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f1ceb700 1 -- 172.21.2.105:0/3210214284 >> v2:172.21.2.115:3300/0 conn(0x7fe6ec060be0 msgr2=0x7fe6ec0ac6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:18.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f1ceb700 1 --2- 172.21.2.105:0/3210214284 >> v2:172.21.2.115:3300/0 conn(0x7fe6ec060be0 0x7fe6ec0ac6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:18.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f1ceb700 1 -- 172.21.2.105:0/3210214284 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ec1473d0 con 0x7fe6ec147b10 2021-11-12T05:46:18.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f1ceb700 1 --2- 172.21.2.105:0/3210214284 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe6ec147b10 0x7fe6ec144210 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7fe6e40032f0 tx=0x7fe6e4009290).ready entity=mon.0 client_cookie=d147fb76547fbaea server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:18.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6dbfff700 1 -- 172.21.2.105:0/3210214284 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6e400b870 con 0x7fe6ec147b10 2021-11-12T05:46:18.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6dbfff700 1 -- 172.21.2.105:0/3210214284 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e400b9d0 con 0x7fe6ec147b10 2021-11-12T05:46:18.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6dbfff700 1 -- 172.21.2.105:0/3210214284 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6e400bb40 con 0x7fe6ec147b10 2021-11-12T05:46:18.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f24ec700 1 -- 172.21.2.105:0/3210214284 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe6ec147b10 msgr2=0x7fe6ec144210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:18.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f24ec700 1 --2- 172.21.2.105:0/3210214284 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe6ec147b10 0x7fe6ec144210 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7fe6e40032f0 tx=0x7fe6e4009290).stop 2021-11-12T05:46:18.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f24ec700 1 -- 172.21.2.105:0/3210214284 shutdown_connections 2021-11-12T05:46:18.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f24ec700 1 --2- 172.21.2.105:0/3210214284 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe6ec147b10 0x7fe6ec144210 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:18.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f24ec700 1 --2- 172.21.2.105:0/3210214284 >> v2:172.21.2.115:3300/0 conn(0x7fe6ec060be0 0x7fe6ec0ac6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:18.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f24ec700 1 --2- 172.21.2.105:0/3210214284 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe6ec0b26f0 0x7fe6ec14b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:18.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f24ec700 1 -- 172.21.2.105:0/3210214284 >> 172.21.2.105:0/3210214284 conn(0x7fe6ec0b5c50 msgr2=0x7fe6ec0b1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:18.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f24ec700 1 -- 172.21.2.105:0/3210214284 shutdown_connections 2021-11-12T05:46:18.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f24ec700 1 -- 172.21.2.105:0/3210214284 wait complete. 2021-11-12T05:46:18.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f24ec700 1 Processor -- start 2021-11-12T05:46:18.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f24ec700 1 -- start start 2021-11-12T05:46:18.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f24ec700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe6ec060be0 0x7fe6ec156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:18.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f24ec700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe6ec0b26f0 0x7fe6ec149ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:18.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f24ec700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe6ec147b10 0x7fe6ec063300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:18.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f24ec700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ec0abca0 con 0x7fe6ec147b10 2021-11-12T05:46:18.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f24ec700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ec067370 con 0x7fe6ec0b26f0 2021-11-12T05:46:18.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f24ec700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6ec1460a0 con 0x7fe6ec060be0 2021-11-12T05:46:18.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f1ceb700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe6ec147b10 0x7fe6ec063300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:18.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f1ceb700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe6ec147b10 0x7fe6ec063300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46970/0 (socket says 172.21.2.105:46970) 2021-11-12T05:46:18.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f1ceb700 1 -- 172.21.2.105:0/3910277122 learned_addr learned my addr 172.21.2.105:0/3910277122 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:18.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f1ceb700 1 -- 172.21.2.105:0/3910277122 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe6ec060be0 msgr2=0x7fe6ec156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:18.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f1ceb700 1 --2- 172.21.2.105:0/3910277122 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe6ec060be0 0x7fe6ec156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:18.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f1ceb700 1 -- 172.21.2.105:0/3910277122 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe6ec0b26f0 msgr2=0x7fe6ec149ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:18.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f1ceb700 1 --2- 172.21.2.105:0/3910277122 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe6ec0b26f0 0x7fe6ec149ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:18.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f1ceb700 1 -- 172.21.2.105:0/3910277122 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e4009530 con 0x7fe6ec147b10 2021-11-12T05:46:18.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f1ceb700 1 --2- 172.21.2.105:0/3910277122 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe6ec147b10 0x7fe6ec063300 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7fe6e40032f0 tx=0x7fe6e4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:18.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6da7fc700 1 -- 172.21.2.105:0/3910277122 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6e400b870 con 0x7fe6ec147b10 2021-11-12T05:46:18.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6da7fc700 1 -- 172.21.2.105:0/3910277122 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e4020660 con 0x7fe6ec147b10 2021-11-12T05:46:18.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6f24ec700 1 -- 172.21.2.105:0/3910277122 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6ec0a9240 con 0x7fe6ec147b10 2021-11-12T05:46:18.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.020+0000 7fe6da7fc700 1 -- 172.21.2.105:0/3910277122 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6e40209c0 con 0x7fe6ec147b10 2021-11-12T05:46:18.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.024+0000 7fe6f24ec700 1 -- 172.21.2.105:0/3910277122 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6ec0a8d30 con 0x7fe6ec147b10 2021-11-12T05:46:18.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.024+0000 7fe6f24ec700 1 -- 172.21.2.105:0/3910277122 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6ec159b10 con 0x7fe6ec147b10 2021-11-12T05:46:18.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.024+0000 7fe6da7fc700 1 -- 172.21.2.105:0/3910277122 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe6e400f070 con 0x7fe6ec147b10 2021-11-12T05:46:18.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.024+0000 7fe6da7fc700 1 --2- 172.21.2.105:0/3910277122 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe6cc053580 0x7fe6cc055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:18.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.024+0000 7fe6da7fc700 1 -- 172.21.2.105:0/3910277122 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fe6e406c6a0 con 0x7fe6ec147b10 2021-11-12T05:46:18.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.024+0000 7fe6f14ea700 1 --2- 172.21.2.105:0/3910277122 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe6cc053580 0x7fe6cc055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:18.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.024+0000 7fe6f14ea700 1 --2- 172.21.2.105:0/3910277122 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe6cc053580 0x7fe6cc055a40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7fe6dc002f70 tx=0x7fe6dc006a00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:18.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.024+0000 7fe6da7fc700 1 -- 172.21.2.105:0/3910277122 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe6e4043760 con 0x7fe6ec147b10 2021-11-12T05:46:18.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.132+0000 7fe6f24ec700 1 -- 172.21.2.105:0/3910277122 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6ec057350 con 0x7fe6ec147b10 2021-11-12T05:46:18.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.132+0000 7fe6da7fc700 1 -- 172.21.2.105:0/3910277122 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+2134 (secure 0 0 0) 0x7fe6e4025870 con 0x7fe6ec147b10 2021-11-12T05:46:18.139 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:46:18.139 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":25,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/37307717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":37307717},{"type":"v1","addr":"172.21.2.115:6833","nonce":37307717}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":23}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:45:43.349890+0000","modified":"2021-11-12T05:45:44.353136+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5973},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5973":{"gid":5973,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/1667092126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":1667092126},{"type":"v1","addr":"172.21.2.105:6835","nonce":1667092126}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-11-12T05:46:18.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.136+0000 7fe6f24ec700 1 -- 172.21.2.105:0/3910277122 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe6cc053580 msgr2=0x7fe6cc055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:18.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.136+0000 7fe6f24ec700 1 --2- 172.21.2.105:0/3910277122 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe6cc053580 0x7fe6cc055a40 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7fe6dc002f70 tx=0x7fe6dc006a00).stop 2021-11-12T05:46:18.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.136+0000 7fe6f24ec700 1 -- 172.21.2.105:0/3910277122 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe6ec147b10 msgr2=0x7fe6ec063300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:18.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.136+0000 7fe6f24ec700 1 --2- 172.21.2.105:0/3910277122 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe6ec147b10 0x7fe6ec063300 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7fe6e40032f0 tx=0x7fe6e4016000).stop 2021-11-12T05:46:18.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.136+0000 7fe6f24ec700 1 -- 172.21.2.105:0/3910277122 shutdown_connections 2021-11-12T05:46:18.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.136+0000 7fe6f24ec700 1 --2- 172.21.2.105:0/3910277122 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe6cc053580 0x7fe6cc055a40 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:18.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.136+0000 7fe6f24ec700 1 --2- 172.21.2.105:0/3910277122 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe6ec147b10 0x7fe6ec063300 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:18.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.136+0000 7fe6f24ec700 1 --2- 172.21.2.105:0/3910277122 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe6ec0b26f0 0x7fe6ec149ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:18.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.136+0000 7fe6f24ec700 1 --2- 172.21.2.105:0/3910277122 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe6ec060be0 0x7fe6ec156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:18.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.136+0000 7fe6f24ec700 1 -- 172.21.2.105:0/3910277122 >> 172.21.2.105:0/3910277122 conn(0x7fe6ec0b5c50 msgr2=0x7fe6ec0affe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:18.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.136+0000 7fe6f24ec700 1 -- 172.21.2.105:0/3910277122 shutdown_connections 2021-11-12T05:46:18.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.136+0000 7fe6f24ec700 1 -- 172.21.2.105:0/3910277122 wait complete. 2021-11-12T05:46:18.143 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 25 2021-11-12T05:46:18.146 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-12T05:46:18.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.192+0000 7f646cc15700 1 Processor -- start 2021-11-12T05:46:18.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.192+0000 7f646cc15700 1 -- start start 2021-11-12T05:46:18.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.192+0000 7f646cc15700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f64680af750 0x7f6468062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:18.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.192+0000 7f646cc15700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64680b0d50 con 0x7f6468130a80 2021-11-12T05:46:18.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.192+0000 7f646cc15700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64680ad380 con 0x7f64680626b0 2021-11-12T05:46:18.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.192+0000 7f646cc15700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64680ae190 con 0x7f64680af750 2021-11-12T05:46:18.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f6466d9d700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f6468130a80 0x7f64681474d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57372/0 (socket says 172.21.2.105:57372) 2021-11-12T05:46:18.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f6466d9d700 1 -- 172.21.2.105:0/1132045655 learned_addr learned my addr 172.21.2.105:0/1132045655 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:46:18.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646559a700 1 -- 172.21.2.105:0/1132045655 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1990505840 0 0) 0x7f64680b0d50 con 0x7f6468130a80 2021-11-12T05:46:18.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646559a700 1 -- 172.21.2.105:0/1132045655 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6448003260 con 0x7f6468130a80 2021-11-12T05:46:18.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646559a700 1 -- 172.21.2.105:0/1132045655 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3545928852 0 0) 0x7f6448003260 con 0x7f6468130a80 2021-11-12T05:46:18.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646559a700 1 -- 172.21.2.105:0/1132045655 >> v2:172.21.2.115:3300/0 conn(0x7f64680af750 msgr2=0x7f6468062a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:18.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646559a700 1 --2- 172.21.2.105:0/1132045655 >> v2:172.21.2.115:3300/0 conn(0x7f64680af750 0x7f6468062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:18.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646559a700 1 -- 172.21.2.105:0/1132045655 >> v1:172.21.2.115:6789/0 conn(0x7f64680626b0 legacy=0x7f6468130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:18.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646559a700 1 -- 172.21.2.105:0/1132045655 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64680ae2d0 con 0x7f6468130a80 2021-11-12T05:46:18.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646559a700 1 -- 172.21.2.105:0/1132045655 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f64600019e0 con 0x7f6468130a80 2021-11-12T05:46:18.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646559a700 1 -- 172.21.2.105:0/1132045655 >> v1:172.21.2.105:6789/0 conn(0x7f6468130a80 legacy=0x7f64681474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:18.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646559a700 1 --2- 172.21.2.105:0/1132045655 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6448003820 0x7f6448003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:18.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646559a700 1 --2- 172.21.2.105:0/1132045655 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6448004500 0x7f6448004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:18.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646559a700 1 --2- 172.21.2.105:0/1132045655 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6448005050 0x7f644800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:18.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646559a700 1 -- 172.21.2.105:0/1132045655 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64680ae190 con 0x7f6448004500 2021-11-12T05:46:18.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646559a700 1 -- 172.21.2.105:0/1132045655 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644800bf40 con 0x7f6448005050 2021-11-12T05:46:18.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646559a700 1 -- 172.21.2.105:0/1132045655 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f644800c100 con 0x7f6448003820 2021-11-12T05:46:18.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f6465d9b700 1 --2- 172.21.2.105:0/1132045655 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6448004500 0x7f6448004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:18.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f6465d9b700 1 -- 172.21.2.105:0/1132045655 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6448003820 msgr2=0x7f6448003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:18.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f6465d9b700 1 --2- 172.21.2.105:0/1132045655 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6448003820 0x7f6448003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:18.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f6465d9b700 1 -- 172.21.2.105:0/1132045655 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6448005050 msgr2=0x7f644800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:18.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f6465d9b700 1 --2- 172.21.2.105:0/1132045655 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6448005050 0x7f644800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:18.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f6465d9b700 1 -- 172.21.2.105:0/1132045655 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6448003260 con 0x7f6448004500 2021-11-12T05:46:18.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f6466d9d700 1 -- 172.21.2.105:0/1132045655 reap_dead start 2021-11-12T05:46:18.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f6465d9b700 1 --2- 172.21.2.105:0/1132045655 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6448004500 0x7f6448004980 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7f6450002f70 tx=0x7f6450006ca0).ready entity=mon.0 client_cookie=2e1a1e1c30f5baae server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:18.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646559a700 1 -- 172.21.2.105:0/1132045655 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6450012410 con 0x7f6448004500 2021-11-12T05:46:18.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646559a700 1 -- 172.21.2.105:0/1132045655 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6450012570 con 0x7f6448004500 2021-11-12T05:46:18.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646559a700 1 -- 172.21.2.105:0/1132045655 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64500128d0 con 0x7f6448004500 2021-11-12T05:46:18.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646cc15700 1 -- 172.21.2.105:0/1132045655 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6448004500 msgr2=0x7f6448004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:18.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646cc15700 1 --2- 172.21.2.105:0/1132045655 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6448004500 0x7f6448004980 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7f6450002f70 tx=0x7f6450006ca0).stop 2021-11-12T05:46:18.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646cc15700 1 -- 172.21.2.105:0/1132045655 shutdown_connections 2021-11-12T05:46:18.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646cc15700 1 --2- 172.21.2.105:0/1132045655 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6448004500 0x7f6448004980 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:18.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646cc15700 1 -- 172.21.2.105:0/1132045655 >> 172.21.2.105:0/1132045655 conn(0x7f64680b5320 msgr2=0x7f64680b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:18.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646cc15700 1 -- 172.21.2.105:0/1132045655 shutdown_connections 2021-11-12T05:46:18.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646cc15700 1 -- 172.21.2.105:0/1132045655 wait complete. 2021-11-12T05:46:18.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646cc15700 1 Processor -- start 2021-11-12T05:46:18.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646cc15700 1 -- start start 2021-11-12T05:46:18.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646cc15700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6448004500 0x7f6468064bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:18.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646cc15700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6468062fb0 0x7f646814ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:18.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646cc15700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f64680637f0 0x7f6468063ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:18.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646cc15700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6468132ef0 con 0x7f6448004500 2021-11-12T05:46:18.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646cc15700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6468064190 con 0x7f64680637f0 2021-11-12T05:46:18.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646cc15700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6468132c50 con 0x7f6468062fb0 2021-11-12T05:46:18.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646659c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6448004500 0x7f6468064bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:18.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646659c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6448004500 0x7f6468064bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:46988/0 (socket says 172.21.2.105:46988) 2021-11-12T05:46:18.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646659c700 1 -- 172.21.2.105:0/2653468851 learned_addr learned my addr 172.21.2.105:0/2653468851 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:18.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646659c700 1 -- 172.21.2.105:0/2653468851 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6468062fb0 msgr2=0x7f646814ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:18.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646659c700 1 --2- 172.21.2.105:0/2653468851 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6468062fb0 0x7f646814ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:18.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646659c700 1 -- 172.21.2.105:0/2653468851 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f64680637f0 msgr2=0x7f6468063ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:18.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646659c700 1 --2- 172.21.2.105:0/2653468851 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f64680637f0 0x7f6468063ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:18.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646659c700 1 -- 172.21.2.105:0/2653468851 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646814aff0 con 0x7f6448004500 2021-11-12T05:46:18.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646659c700 1 --2- 172.21.2.105:0/2653468851 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6448004500 0x7f6468064bf0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7f6458000f70 tx=0x7f6458006d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:18.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f645f7fe700 1 -- 172.21.2.105:0/2653468851 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6458012410 con 0x7f6448004500 2021-11-12T05:46:18.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f645f7fe700 1 -- 172.21.2.105:0/2653468851 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6458012570 con 0x7f6448004500 2021-11-12T05:46:18.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f645f7fe700 1 -- 172.21.2.105:0/2653468851 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64580128d0 con 0x7f6448004500 2021-11-12T05:46:18.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646cc15700 1 -- 172.21.2.105:0/2653468851 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6468064550 con 0x7f6448004500 2021-11-12T05:46:18.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.196+0000 7f646cc15700 1 -- 172.21.2.105:0/2653468851 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f646815a2a0 con 0x7f6448004500 2021-11-12T05:46:18.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.200+0000 7f646cc15700 1 -- 172.21.2.105:0/2653468851 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6468159f90 con 0x7f6448004500 2021-11-12T05:46:18.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.200+0000 7f645f7fe700 1 -- 172.21.2.105:0/2653468851 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f645800f030 con 0x7f6448004500 2021-11-12T05:46:18.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.200+0000 7f645f7fe700 1 --2- 172.21.2.105:0/2653468851 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f644c0535d0 0x7f644c055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:18.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.200+0000 7f645f7fe700 1 -- 172.21.2.105:0/2653468851 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f645806b720 con 0x7f6448004500 2021-11-12T05:46:18.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.200+0000 7f6465d9b700 1 --2- 172.21.2.105:0/2653468851 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f644c0535d0 0x7f644c055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:18.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.200+0000 7f6465d9b700 1 --2- 172.21.2.105:0/2653468851 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f644c0535d0 0x7f644c055a90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f6450002f70 tx=0x7f6450015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:18.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.200+0000 7f645f7fe700 1 -- 172.21.2.105:0/2653468851 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6458042620 con 0x7f6448004500 2021-11-12T05:46:18.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:18.308+0000 7f646cc15700 1 -- 172.21.2.105:0/2653468851 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6468062a90 con 0x7f6448004500 2021-11-12T05:46:19.079 INFO:tasks.ceph.mon.a.gibba005.stderr:2021-11-12T05:46:19.076+0000 7fe9772b2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-12T05:46:19.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.088+0000 7f645f7fe700 1 -- 172.21.2.105:0/2653468851 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6458045c40 con 0x7f6448004500 2021-11-12T05:46:19.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.088+0000 7f646cc15700 1 -- 172.21.2.105:0/2653468851 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f644c0535d0 msgr2=0x7f644c055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:19.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.088+0000 7f646cc15700 1 --2- 172.21.2.105:0/2653468851 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f644c0535d0 0x7f644c055a90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f6450002f70 tx=0x7f6450015000).stop 2021-11-12T05:46:19.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.088+0000 7f646cc15700 1 -- 172.21.2.105:0/2653468851 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6448004500 msgr2=0x7f6468064bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:19.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.088+0000 7f646cc15700 1 --2- 172.21.2.105:0/2653468851 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6448004500 0x7f6468064bf0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7f6458000f70 tx=0x7f6458006d10).stop 2021-11-12T05:46:19.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.088+0000 7f646cc15700 1 -- 172.21.2.105:0/2653468851 shutdown_connections 2021-11-12T05:46:19.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.088+0000 7f646cc15700 1 --2- 172.21.2.105:0/2653468851 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f644c0535d0 0x7f644c055a90 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:19.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.088+0000 7f646cc15700 1 --2- 172.21.2.105:0/2653468851 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f64680637f0 0x7f6468063ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:19.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.088+0000 7f646cc15700 1 --2- 172.21.2.105:0/2653468851 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6468062fb0 0x7f646814ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:19.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.088+0000 7f646cc15700 1 --2- 172.21.2.105:0/2653468851 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6448004500 0x7f6468064bf0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:19.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.088+0000 7f646cc15700 1 -- 172.21.2.105:0/2653468851 >> 172.21.2.105:0/2653468851 conn(0x7f64680b5320 msgr2=0x7f64680afd60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:19.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.088+0000 7f646cc15700 1 -- 172.21.2.105:0/2653468851 shutdown_connections 2021-11-12T05:46:19.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.088+0000 7f646cc15700 1 -- 172.21.2.105:0/2653468851 wait complete. 2021-11-12T05:46:19.097 INFO:teuthology.orchestra.run.gibba005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-12T05:46:19.101 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:46:19.112 INFO:tasks.ceph.mds.a.gibba005.stdout:starting mds.a at 2021-11-12T05:46:19.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.148+0000 7f515e8d9700 1 Processor -- start 2021-11-12T05:46:19.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.148+0000 7f515e8d9700 1 -- start start 2021-11-12T05:46:19.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.148+0000 7f515e8d9700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f51580ac280 0x7f515814b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:19.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.148+0000 7f515e8d9700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f51580af730 0x7f51580ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:19.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.148+0000 7f515e8d9700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51580ac7b0 con 0x7f51580ad080 2021-11-12T05:46:19.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.148+0000 7f515e8d9700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51581488a0 con 0x7f51580af730 2021-11-12T05:46:19.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.148+0000 7f515e8d9700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51580ac9e0 con 0x7f51580ac280 2021-11-12T05:46:19.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.148+0000 7f515ce76700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f51580af730 0x7f51580ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:19.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.148+0000 7f515ce76700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f51580af730 0x7f51580ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47010/0 (socket says 172.21.2.105:47010) 2021-11-12T05:46:19.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.148+0000 7f515ce76700 1 -- 172.21.2.105:0/2105675434 learned_addr learned my addr 172.21.2.105:0/2105675434 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:19.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.148+0000 7f515ce76700 1 -- 172.21.2.105:0/2105675434 >> v2:172.21.2.115:3300/0 conn(0x7f51580ac280 msgr2=0x7f515814b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:19.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.148+0000 7f515ce76700 1 --2- 172.21.2.105:0/2105675434 >> v2:172.21.2.115:3300/0 conn(0x7f51580ac280 0x7f515814b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:19.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.148+0000 7f515ce76700 1 -- 172.21.2.105:0/2105675434 >> v1:172.21.2.115:6789/0 conn(0x7f51580ad080 legacy=0x7f515814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:19.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.148+0000 7f515ce76700 1 -- 172.21.2.105:0/2105675434 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51580b0b30 con 0x7f51580af730 2021-11-12T05:46:19.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.148+0000 7f515ce76700 1 --2- 172.21.2.105:0/2105675434 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f51580af730 0x7f51580ad460 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f51580b0eb0 tx=0x7f5150009290).ready entity=mon.0 client_cookie=a77b66db0f50854a server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:19.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.148+0000 7f5156ffd700 1 -- 172.21.2.105:0/2105675434 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f515000b820 con 0x7f51580af730 2021-11-12T05:46:19.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.148+0000 7f5156ffd700 1 -- 172.21.2.105:0/2105675434 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f515000b980 con 0x7f51580af730 2021-11-12T05:46:19.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.148+0000 7f5156ffd700 1 -- 172.21.2.105:0/2105675434 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f515000bb30 con 0x7f51580af730 2021-11-12T05:46:19.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.148+0000 7f515e8d9700 1 -- 172.21.2.105:0/2105675434 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f51580af730 msgr2=0x7f51580ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:19.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.148+0000 7f515e8d9700 1 --2- 172.21.2.105:0/2105675434 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f51580af730 0x7f51580ad460 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f51580b0eb0 tx=0x7f5150009290).stop 2021-11-12T05:46:19.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.148+0000 7f515e8d9700 1 -- 172.21.2.105:0/2105675434 shutdown_connections 2021-11-12T05:46:19.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.148+0000 7f515e8d9700 1 --2- 172.21.2.105:0/2105675434 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f51580af730 0x7f51580ad460 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:19.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.148+0000 7f515e8d9700 1 --2- 172.21.2.105:0/2105675434 >> v2:172.21.2.115:3300/0 conn(0x7f51580ac280 0x7f515814b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:19.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.148+0000 7f515e8d9700 1 -- 172.21.2.105:0/2105675434 >> 172.21.2.105:0/2105675434 conn(0x7f51580b5370 msgr2=0x7f51580b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:19.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.148+0000 7f515e8d9700 1 -- 172.21.2.105:0/2105675434 shutdown_connections 2021-11-12T05:46:19.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.148+0000 7f515e8d9700 1 -- 172.21.2.105:0/2105675434 wait complete. 2021-11-12T05:46:19.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.152+0000 7f515e8d9700 1 Processor -- start 2021-11-12T05:46:19.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.152+0000 7f515e8d9700 1 -- start start 2021-11-12T05:46:19.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.152+0000 7f515e8d9700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f51580ac280 0x7f51580a9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:19.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.152+0000 7f515e8d9700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f51580ad080 0x7f5158157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:19.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.152+0000 7f515e8d9700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f51580af730 0x7f515815a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:19.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.152+0000 7f515e8d9700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5158157ef0 con 0x7f51580ad080 2021-11-12T05:46:19.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.152+0000 7f515e8d9700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51580aaaa0 con 0x7f51580af730 2021-11-12T05:46:19.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.152+0000 7f515e8d9700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f515815ae30 con 0x7f51580ac280 2021-11-12T05:46:19.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.152+0000 7f51577fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f51580ad080 0x7f5158157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:19.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.152+0000 7f51577fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f51580ad080 0x7f5158157a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47014/0 (socket says 172.21.2.105:47014) 2021-11-12T05:46:19.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.152+0000 7f51577fe700 1 -- 172.21.2.105:0/1028473862 learned_addr learned my addr 172.21.2.105:0/1028473862 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:19.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.152+0000 7f51577fe700 1 -- 172.21.2.105:0/1028473862 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f51580ac280 msgr2=0x7f51580a9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:19.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.152+0000 7f51577fe700 1 --2- 172.21.2.105:0/1028473862 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f51580ac280 0x7f51580a9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:19.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.152+0000 7f515ce76700 1 --2- 172.21.2.105:0/1028473862 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f51580af730 0x7f515815a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:19.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.152+0000 7f51577fe700 1 -- 172.21.2.105:0/1028473862 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f51580af730 msgr2=0x7f515815a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:19.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.152+0000 7f51577fe700 1 --2- 172.21.2.105:0/1028473862 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f51580af730 0x7f515815a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:19.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.152+0000 7f51577fe700 1 -- 172.21.2.105:0/1028473862 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5150009530 con 0x7f51580ad080 2021-11-12T05:46:19.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.152+0000 7f51577fe700 1 --2- 172.21.2.105:0/1028473862 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f51580ad080 0x7f5158157a00 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f5148002f70 tx=0x7f5148006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:19.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.152+0000 7f51557fa700 1 -- 172.21.2.105:0/1028473862 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5148013460 con 0x7f51580ad080 2021-11-12T05:46:19.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.152+0000 7f51557fa700 1 -- 172.21.2.105:0/1028473862 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51480135c0 con 0x7f51580ad080 2021-11-12T05:46:19.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.152+0000 7f51557fa700 1 -- 172.21.2.105:0/1028473862 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5148013920 con 0x7f51580ad080 2021-11-12T05:46:19.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.152+0000 7f515e8d9700 1 -- 172.21.2.105:0/1028473862 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f515815ab40 con 0x7f51580ad080 2021-11-12T05:46:19.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.152+0000 7f515e8d9700 1 -- 172.21.2.105:0/1028473862 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51580a9540 con 0x7f51580ad080 2021-11-12T05:46:19.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.152+0000 7f515e8d9700 1 -- 172.21.2.105:0/1028473862 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51580aa8e0 con 0x7f51580ad080 2021-11-12T05:46:19.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.152+0000 7f51557fa700 1 -- 172.21.2.105:0/1028473862 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f514800f070 con 0x7f51580ad080 2021-11-12T05:46:19.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.152+0000 7f51557fa700 1 --2- 172.21.2.105:0/1028473862 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f513c0536a0 0x7f513c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:19.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.152+0000 7f51557fa700 1 -- 172.21.2.105:0/1028473862 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f514806b5d0 con 0x7f51580ad080 2021-11-12T05:46:19.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.152+0000 7f5157fff700 1 --2- 172.21.2.105:0/1028473862 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f513c0536a0 0x7f513c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:19.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.152+0000 7f5157fff700 1 --2- 172.21.2.105:0/1028473862 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f513c0536a0 0x7f513c055b60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f5140002f90 tx=0x7f51400069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:19.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.156+0000 7f51557fa700 1 -- 172.21.2.105:0/1028473862 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5148042470 con 0x7f51580ad080 2021-11-12T05:46:19.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.264+0000 7f515e8d9700 1 -- 172.21.2.105:0/1028473862 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51580b1440 con 0x7f51580ad080 2021-11-12T05:46:19.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.264+0000 7f51557fa700 1 -- 172.21.2.105:0/1028473862 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+1773 (secure 0 0 0) 0x7f5148045a90 con 0x7f51580ad080 2021-11-12T05:46:19.270 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:46:19.270 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":26,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/37307717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":37307717},{"type":"v1","addr":"172.21.2.115:6833","nonce":37307717}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":23}],"filesystems":[{"mdsmap":{"epoch":26,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:45:43.349890+0000","modified":"2021-11-12T05:46:19.080078+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":66,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-11-12T05:46:19.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.264+0000 7f515e8d9700 1 -- 172.21.2.105:0/1028473862 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f513c0536a0 msgr2=0x7f513c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:19.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.264+0000 7f515e8d9700 1 --2- 172.21.2.105:0/1028473862 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f513c0536a0 0x7f513c055b60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f5140002f90 tx=0x7f51400069b0).stop 2021-11-12T05:46:19.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.264+0000 7f515e8d9700 1 -- 172.21.2.105:0/1028473862 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f51580ad080 msgr2=0x7f5158157a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:19.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.264+0000 7f515e8d9700 1 --2- 172.21.2.105:0/1028473862 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f51580ad080 0x7f5158157a00 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f5148002f70 tx=0x7f5148006ec0).stop 2021-11-12T05:46:19.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.268+0000 7f515e8d9700 1 -- 172.21.2.105:0/1028473862 shutdown_connections 2021-11-12T05:46:19.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.268+0000 7f515e8d9700 1 --2- 172.21.2.105:0/1028473862 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f513c0536a0 0x7f513c055b60 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:19.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.268+0000 7f515e8d9700 1 --2- 172.21.2.105:0/1028473862 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f51580af730 0x7f515815a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:19.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.268+0000 7f515e8d9700 1 --2- 172.21.2.105:0/1028473862 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f51580ad080 0x7f5158157a00 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:19.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.268+0000 7f515e8d9700 1 --2- 172.21.2.105:0/1028473862 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f51580ac280 0x7f51580a9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:19.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.268+0000 7f515e8d9700 1 -- 172.21.2.105:0/1028473862 >> 172.21.2.105:0/1028473862 conn(0x7f51580b5370 msgr2=0x7f51580b31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:19.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.268+0000 7f515e8d9700 1 -- 172.21.2.105:0/1028473862 shutdown_connections 2021-11-12T05:46:19.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.268+0000 7f515e8d9700 1 -- 172.21.2.105:0/1028473862 wait complete. 2021-11-12T05:46:19.274 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 26 2021-11-12T05:46:19.277 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-12T05:46:19.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.380+0000 7fd88cb63700 1 Processor -- start 2021-11-12T05:46:19.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.380+0000 7fd88cb63700 1 -- start start 2021-11-12T05:46:19.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.380+0000 7fd88cb63700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fd8880b1060 0x7fd88813f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:19.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd88cb63700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8880ad400 con 0x7fd888142c50 2021-11-12T05:46:19.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd88cb63700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8880b3200 con 0x7fd8880b2e20 2021-11-12T05:46:19.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd88cb63700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8880ad660 con 0x7fd8880b1060 2021-11-12T05:46:19.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd886d9d700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fd888142c50 0x7fd8881430a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57422/0 (socket says 172.21.2.105:57422) 2021-11-12T05:46:19.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd886d9d700 1 -- 172.21.2.105:0/2924594857 learned_addr learned my addr 172.21.2.105:0/2924594857 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:46:19.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd88559a700 1 -- 172.21.2.105:0/2924594857 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1074357616 0 0) 0x7fd8880ad400 con 0x7fd888142c50 2021-11-12T05:46:19.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd88559a700 1 -- 172.21.2.105:0/2924594857 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd868003260 con 0x7fd888142c50 2021-11-12T05:46:19.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd885d9b700 1 --2- 172.21.2.105:0/2924594857 >> v2:172.21.2.115:3300/0 conn(0x7fd8880b1060 0x7fd88813f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:19.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd88559a700 1 -- 172.21.2.105:0/2924594857 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 148950059 0 0) 0x7fd868003260 con 0x7fd888142c50 2021-11-12T05:46:19.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd88559a700 1 -- 172.21.2.105:0/2924594857 >> v2:172.21.2.115:3300/0 conn(0x7fd8880b1060 msgr2=0x7fd88813f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:19.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd88559a700 1 --2- 172.21.2.105:0/2924594857 >> v2:172.21.2.115:3300/0 conn(0x7fd8880b1060 0x7fd88813f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:19.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd88559a700 1 -- 172.21.2.105:0/2924594857 >> v1:172.21.2.115:6789/0 conn(0x7fd8880b2e20 legacy=0x7fd88813ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:19.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd88559a700 1 -- 172.21.2.105:0/2924594857 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8880ad900 con 0x7fd888142c50 2021-11-12T05:46:19.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd88559a700 1 -- 172.21.2.105:0/2924594857 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fd880001a00 con 0x7fd888142c50 2021-11-12T05:46:19.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd88559a700 1 -- 172.21.2.105:0/2924594857 >> v1:172.21.2.105:6789/0 conn(0x7fd888142c50 legacy=0x7fd8881430a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:19.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd88559a700 1 --2- 172.21.2.105:0/2924594857 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd868003820 0x7fd868003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:19.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd88559a700 1 --2- 172.21.2.105:0/2924594857 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd868004500 0x7fd868004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:19.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd88559a700 1 --2- 172.21.2.105:0/2924594857 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd868004f70 0x7fd86800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:19.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd88559a700 1 -- 172.21.2.105:0/2924594857 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8880ad660 con 0x7fd868003820 2021-11-12T05:46:19.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd88559a700 1 -- 172.21.2.105:0/2924594857 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86800be50 con 0x7fd868004f70 2021-11-12T05:46:19.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd88559a700 1 -- 172.21.2.105:0/2924594857 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86800c010 con 0x7fd868004500 2021-11-12T05:46:19.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd88659c700 1 --2- 172.21.2.105:0/2924594857 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd868003820 0x7fd868003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:19.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd886d9d700 1 --2- 172.21.2.105:0/2924594857 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd868004f70 0x7fd86800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:19.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd885d9b700 1 --2- 172.21.2.105:0/2924594857 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd868004500 0x7fd868004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:19.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd88659c700 1 -- 172.21.2.105:0/2924594857 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd868004500 msgr2=0x7fd868004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:19.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd88659c700 1 --2- 172.21.2.105:0/2924594857 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd868004500 0x7fd868004980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:19.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd88659c700 1 -- 172.21.2.105:0/2924594857 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd868004f70 msgr2=0x7fd86800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:19.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd88659c700 1 --2- 172.21.2.105:0/2924594857 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd868004f70 0x7fd86800b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:19.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd88659c700 1 -- 172.21.2.105:0/2924594857 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd868003260 con 0x7fd868003820 2021-11-12T05:46:19.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd886d9d700 1 -- 172.21.2.105:0/2924594857 reap_dead start 2021-11-12T05:46:19.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd88659c700 1 --2- 172.21.2.105:0/2924594857 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd868003820 0x7fd868003c20 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7fd878001fa0 tx=0x7fd878007a00).ready entity=mon.0 client_cookie=93586488d30358e server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:19.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd88559a700 1 -- 172.21.2.105:0/2924594857 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd878007070 con 0x7fd868003820 2021-11-12T05:46:19.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd88559a700 1 -- 172.21.2.105:0/2924594857 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8780071d0 con 0x7fd868003820 2021-11-12T05:46:19.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd88559a700 1 -- 172.21.2.105:0/2924594857 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd878006510 con 0x7fd868003820 2021-11-12T05:46:19.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd88cb63700 1 -- 172.21.2.105:0/2924594857 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd868003820 msgr2=0x7fd868003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:19.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd88cb63700 1 --2- 172.21.2.105:0/2924594857 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd868003820 0x7fd868003c20 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7fd878001fa0 tx=0x7fd878007a00).stop 2021-11-12T05:46:19.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd88cb63700 1 -- 172.21.2.105:0/2924594857 shutdown_connections 2021-11-12T05:46:19.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd88cb63700 1 --2- 172.21.2.105:0/2924594857 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd868003820 0x7fd868003c20 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:19.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd88cb63700 1 -- 172.21.2.105:0/2924594857 >> 172.21.2.105:0/2924594857 conn(0x7fd888062f60 msgr2=0x7fd888063370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:19.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd88cb63700 1 -- 172.21.2.105:0/2924594857 shutdown_connections 2021-11-12T05:46:19.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd88cb63700 1 -- 172.21.2.105:0/2924594857 wait complete. 2021-11-12T05:46:19.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd88cb63700 1 Processor -- start 2021-11-12T05:46:19.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.384+0000 7fd88cb63700 1 -- start start 2021-11-12T05:46:19.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.388+0000 7fd88cb63700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd868003820 0x7fd888156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:19.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.388+0000 7fd88cb63700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd8880b4a60 0x7fd88815a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:19.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.388+0000 7fd88cb63700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd88815a960 0x7fd88814b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:19.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.388+0000 7fd88cb63700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd888156e10 con 0x7fd868003820 2021-11-12T05:46:19.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.388+0000 7fd88cb63700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88815ade0 con 0x7fd88815a960 2021-11-12T05:46:19.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.388+0000 7fd88cb63700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8880a9f10 con 0x7fd8880b4a60 2021-11-12T05:46:19.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.388+0000 7fd88659c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd868003820 0x7fd888156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:19.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.388+0000 7fd88659c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd868003820 0x7fd888156920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47038/0 (socket says 172.21.2.105:47038) 2021-11-12T05:46:19.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.388+0000 7fd88659c700 1 -- 172.21.2.105:0/1936522558 learned_addr learned my addr 172.21.2.105:0/1936522558 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:19.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.388+0000 7fd88659c700 1 -- 172.21.2.105:0/1936522558 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd8880b4a60 msgr2=0x7fd88815a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:19.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.388+0000 7fd885d9b700 1 --2- 172.21.2.105:0/1936522558 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd8880b4a60 0x7fd88815a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:19.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.388+0000 7fd886d9d700 1 --2- 172.21.2.105:0/1936522558 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd88815a960 0x7fd88814b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:19.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.388+0000 7fd88659c700 1 --2- 172.21.2.105:0/1936522558 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd8880b4a60 0x7fd88815a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:19.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.388+0000 7fd88659c700 1 -- 172.21.2.105:0/1936522558 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd88815a960 msgr2=0x7fd88814b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:19.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.388+0000 7fd88659c700 1 --2- 172.21.2.105:0/1936522558 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd88815a960 0x7fd88814b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:19.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.388+0000 7fd88659c700 1 -- 172.21.2.105:0/1936522558 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8880aa1b0 con 0x7fd868003820 2021-11-12T05:46:19.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.388+0000 7fd885d9b700 1 --2- 172.21.2.105:0/1936522558 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd8880b4a60 0x7fd88815a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:46:19.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.388+0000 7fd886d9d700 1 --2- 172.21.2.105:0/1936522558 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd88815a960 0x7fd88814b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:46:19.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.388+0000 7fd88659c700 1 --2- 172.21.2.105:0/1936522558 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd868003820 0x7fd888156920 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7fd878001fa0 tx=0x7fd878015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:19.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.388+0000 7fd87f7fe700 1 -- 172.21.2.105:0/1936522558 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd878021650 con 0x7fd868003820 2021-11-12T05:46:19.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.388+0000 7fd87f7fe700 1 -- 172.21.2.105:0/1936522558 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd878000e90 con 0x7fd868003820 2021-11-12T05:46:19.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.388+0000 7fd88cb63700 1 -- 172.21.2.105:0/1936522558 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd888159fd0 con 0x7fd868003820 2021-11-12T05:46:19.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.388+0000 7fd87f7fe700 1 -- 172.21.2.105:0/1936522558 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8780219a0 con 0x7fd868003820 2021-11-12T05:46:19.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.388+0000 7fd88cb63700 1 -- 172.21.2.105:0/1936522558 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8880b4ee0 con 0x7fd868003820 2021-11-12T05:46:19.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.388+0000 7fd88cb63700 1 -- 172.21.2.105:0/1936522558 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8880a9d30 con 0x7fd868003820 2021-11-12T05:46:19.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.388+0000 7fd87f7fe700 1 -- 172.21.2.105:0/1936522558 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd87801d070 con 0x7fd868003820 2021-11-12T05:46:19.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.388+0000 7fd87f7fe700 1 --2- 172.21.2.105:0/1936522558 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd86c053640 0x7fd86c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:19.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.388+0000 7fd87f7fe700 1 -- 172.21.2.105:0/1936522558 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6502+0+0 (secure 0 0 0) 0x7fd87806caa0 con 0x7fd868003820 2021-11-12T05:46:19.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.388+0000 7fd885d9b700 1 --2- 172.21.2.105:0/1936522558 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd86c053640 0x7fd86c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:19.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.388+0000 7fd885d9b700 1 --2- 172.21.2.105:0/1936522558 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd86c053640 0x7fd86c055b00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7fd870009000 tx=0x7fd870008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:19.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.392+0000 7fd87f7fe700 1 -- 172.21.2.105:0/1936522558 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd878043a50 con 0x7fd868003820 2021-11-12T05:46:19.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:19.504+0000 7fd88cb63700 1 -- 172.21.2.105:0/1936522558 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd888156e10 con 0x7fd868003820 2021-11-12T05:46:20.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.100+0000 7fd87f7fe700 1 -- 172.21.2.105:0/1936522558 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd878047070 con 0x7fd868003820 2021-11-12T05:46:20.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.100+0000 7fd88cb63700 1 -- 172.21.2.105:0/1936522558 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd86c053640 msgr2=0x7fd86c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:20.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.100+0000 7fd88cb63700 1 --2- 172.21.2.105:0/1936522558 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd86c053640 0x7fd86c055b00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7fd870009000 tx=0x7fd870008040).stop 2021-11-12T05:46:20.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.100+0000 7fd88cb63700 1 -- 172.21.2.105:0/1936522558 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd868003820 msgr2=0x7fd888156920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:20.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.100+0000 7fd88cb63700 1 --2- 172.21.2.105:0/1936522558 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd868003820 0x7fd888156920 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7fd878001fa0 tx=0x7fd878015000).stop 2021-11-12T05:46:20.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.100+0000 7fd88cb63700 1 -- 172.21.2.105:0/1936522558 shutdown_connections 2021-11-12T05:46:20.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.100+0000 7fd88cb63700 1 --2- 172.21.2.105:0/1936522558 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd86c053640 0x7fd86c055b00 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:20.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.100+0000 7fd88cb63700 1 --2- 172.21.2.105:0/1936522558 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd88815a960 0x7fd88814b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:20.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.100+0000 7fd88cb63700 1 --2- 172.21.2.105:0/1936522558 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd8880b4a60 0x7fd88815a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:20.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.100+0000 7fd88cb63700 1 --2- 172.21.2.105:0/1936522558 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd868003820 0x7fd888156920 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:20.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.100+0000 7fd88cb63700 1 -- 172.21.2.105:0/1936522558 >> 172.21.2.105:0/1936522558 conn(0x7fd888062f60 msgr2=0x7fd888063340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:20.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.100+0000 7fd88cb63700 1 -- 172.21.2.105:0/1936522558 shutdown_connections 2021-11-12T05:46:20.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.100+0000 7fd88cb63700 1 -- 172.21.2.105:0/1936522558 wait complete. 2021-11-12T05:46:20.114 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-12T05:46:20.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.168+0000 7f79bc36a700 1 Processor -- start 2021-11-12T05:46:20.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.168+0000 7f79bc36a700 1 -- start start 2021-11-12T05:46:20.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79bc36a700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f79b40ac280 0x7f79b414b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:20.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79bc36a700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b40ac7b0 con 0x7f79b40af730 2021-11-12T05:46:20.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79bc36a700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b40ac9e0 con 0x7f79b40ad080 2021-11-12T05:46:20.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79bc36a700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b41488a0 con 0x7f79b40ac280 2021-11-12T05:46:20.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79ba907700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f79b40af730 0x7f79b4147a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57440/0 (socket says 172.21.2.105:57440) 2021-11-12T05:46:20.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79ba907700 1 -- 172.21.2.105:0/289362737 learned_addr learned my addr 172.21.2.105:0/289362737 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:46:20.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79b9905700 1 --2- 172.21.2.105:0/289362737 >> v2:172.21.2.105:3300/0 conn(0x7f79b40ac280 0x7f79b414b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:20.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79b9104700 1 -- 172.21.2.105:0/289362737 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522995387 0 0) 0x7f79b40ac7b0 con 0x7f79b40af730 2021-11-12T05:46:20.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79b9905700 1 -- 172.21.2.105:0/289362737 >> v1:172.21.2.115:6789/0 conn(0x7f79b40ad080 legacy=0x7f79b414abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:20.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79b9905700 1 -- 172.21.2.105:0/289362737 >> v1:172.21.2.105:6789/0 conn(0x7f79b40af730 legacy=0x7f79b4147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:20.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79b9905700 1 -- 172.21.2.105:0/289362737 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b40b0b30 con 0x7f79b40ac280 2021-11-12T05:46:20.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79b9905700 1 --2- 172.21.2.105:0/289362737 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f79b40ac280 0x7f79b414b2f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7f79b40ac6a0 tx=0x7f79b0006df0).ready entity=mon.0 client_cookie=750d0db703cc5c35 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:20.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79b9104700 1 -- 172.21.2.105:0/289362737 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79b000d5c0 con 0x7f79b40ac280 2021-11-12T05:46:20.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79b9104700 1 -- 172.21.2.105:0/289362737 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b0000e90 con 0x7f79b40ac280 2021-11-12T05:46:20.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79b9104700 1 -- 172.21.2.105:0/289362737 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79b000d910 con 0x7f79b40ac280 2021-11-12T05:46:20.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79bc36a700 1 -- 172.21.2.105:0/289362737 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f79b40ac280 msgr2=0x7f79b414b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:20.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79bc36a700 1 --2- 172.21.2.105:0/289362737 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f79b40ac280 0x7f79b414b2f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7f79b40ac6a0 tx=0x7f79b0006df0).stop 2021-11-12T05:46:20.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79bc36a700 1 -- 172.21.2.105:0/289362737 shutdown_connections 2021-11-12T05:46:20.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79bc36a700 1 --2- 172.21.2.105:0/289362737 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f79b40ac280 0x7f79b414b2f0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:20.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79bc36a700 1 -- 172.21.2.105:0/289362737 >> 172.21.2.105:0/289362737 conn(0x7f79b40b5370 msgr2=0x7f79b40b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:20.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79bc36a700 1 -- 172.21.2.105:0/289362737 shutdown_connections 2021-11-12T05:46:20.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79bc36a700 1 -- 172.21.2.105:0/289362737 wait complete. 2021-11-12T05:46:20.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79bc36a700 1 Processor -- start 2021-11-12T05:46:20.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79bc36a700 1 -- start start 2021-11-12T05:46:20.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79bc36a700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f79b40ac280 0x7f79b4147b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:20.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79bc36a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f79b40ad080 0x7f79b415a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:20.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79bc36a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f79b40af730 0x7f79b4156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:20.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79bc36a700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b4154610 con 0x7f79b40ad080 2021-11-12T05:46:20.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79bc36a700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b415a280 con 0x7f79b40ac280 2021-11-12T05:46:20.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79bc36a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b415a520 con 0x7f79b40af730 2021-11-12T05:46:20.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79b9905700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f79b40ad080 0x7f79b415a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:20.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79b9905700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f79b40ad080 0x7f79b415a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47050/0 (socket says 172.21.2.105:47050) 2021-11-12T05:46:20.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79b9905700 1 -- 172.21.2.105:0/3363106381 learned_addr learned my addr 172.21.2.105:0/3363106381 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:20.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79b9905700 1 -- 172.21.2.105:0/3363106381 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f79b40af730 msgr2=0x7f79b4156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:20.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79b9905700 1 --2- 172.21.2.105:0/3363106381 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f79b40af730 0x7f79b4156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:20.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79b9905700 1 -- 172.21.2.105:0/3363106381 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f79b40ac280 msgr2=0x7f79b4147b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:20.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79b9905700 1 --2- 172.21.2.105:0/3363106381 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f79b40ac280 0x7f79b4147b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:20.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79b9905700 1 -- 172.21.2.105:0/3363106381 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b000b180 con 0x7f79b40ad080 2021-11-12T05:46:20.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79b9905700 1 --2- 172.21.2.105:0/3363106381 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f79b40ad080 0x7f79b415a9c0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7f79b40ac6a0 tx=0x7f79b0012000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:20.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79a77fe700 1 -- 172.21.2.105:0/3363106381 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79b0002f50 con 0x7f79b40ad080 2021-11-12T05:46:20.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.172+0000 7f79a77fe700 1 -- 172.21.2.105:0/3363106381 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b0013d50 con 0x7f79b40ad080 2021-11-12T05:46:20.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.176+0000 7f79bc36a700 1 -- 172.21.2.105:0/3363106381 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b40a9590 con 0x7f79b40ad080 2021-11-12T05:46:20.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.176+0000 7f79a77fe700 1 -- 172.21.2.105:0/3363106381 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79b001f640 con 0x7f79b40ad080 2021-11-12T05:46:20.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.176+0000 7f79bc36a700 1 -- 172.21.2.105:0/3363106381 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b4157020 con 0x7f79b40ad080 2021-11-12T05:46:20.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.176+0000 7f79bc36a700 1 -- 172.21.2.105:0/3363106381 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79b40b1440 con 0x7f79b40ad080 2021-11-12T05:46:20.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.176+0000 7f79a77fe700 1 -- 172.21.2.105:0/3363106381 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f79b001c070 con 0x7f79b40ad080 2021-11-12T05:46:20.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.176+0000 7f79a77fe700 1 --2- 172.21.2.105:0/3363106381 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f79940536d0 0x7f7994055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:20.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.176+0000 7f79a77fe700 1 -- 172.21.2.105:0/3363106381 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f79b006c880 con 0x7f79b40ad080 2021-11-12T05:46:20.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.176+0000 7f79ba106700 1 --2- 172.21.2.105:0/3363106381 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f79940536d0 0x7f7994055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:20.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.176+0000 7f79ba106700 1 --2- 172.21.2.105:0/3363106381 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f79940536d0 0x7f7994055b90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f79a8002f90 tx=0x7f79a80069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:20.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.176+0000 7f79a77fe700 1 -- 172.21.2.105:0/3363106381 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f79b0043830 con 0x7f79b40ad080 2021-11-12T05:46:20.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:20.260+0000 7f79bc36a700 1 -- 172.21.2.105:0/3363106381 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f79b4057350 con 0x7f79b40ad080 2021-11-12T05:46:21.112 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.108+0000 7f79a77fe700 1 -- 172.21.2.105:0/3363106381 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v67) v1 ==== 185+0+0 (secure 0 0 0) 0x7f79b0046e50 con 0x7f79b40ad080 2021-11-12T05:46:21.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.108+0000 7f79bc36a700 1 -- 172.21.2.105:0/3363106381 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f79940536d0 msgr2=0x7f7994055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:21.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.108+0000 7f79bc36a700 1 --2- 172.21.2.105:0/3363106381 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f79940536d0 0x7f7994055b90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f79a8002f90 tx=0x7f79a80069b0).stop 2021-11-12T05:46:21.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.108+0000 7f79bc36a700 1 -- 172.21.2.105:0/3363106381 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f79b40ad080 msgr2=0x7f79b415a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:21.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.108+0000 7f79bc36a700 1 --2- 172.21.2.105:0/3363106381 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f79b40ad080 0x7f79b415a9c0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7f79b40ac6a0 tx=0x7f79b0012000).stop 2021-11-12T05:46:21.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.108+0000 7f79bc36a700 1 -- 172.21.2.105:0/3363106381 shutdown_connections 2021-11-12T05:46:21.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.108+0000 7f79bc36a700 1 --2- 172.21.2.105:0/3363106381 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f79940536d0 0x7f7994055b90 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:21.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.108+0000 7f79bc36a700 1 --2- 172.21.2.105:0/3363106381 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f79b40af730 0x7f79b4156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:21.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.108+0000 7f79bc36a700 1 --2- 172.21.2.105:0/3363106381 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f79b40ad080 0x7f79b415a9c0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:21.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.108+0000 7f79bc36a700 1 --2- 172.21.2.105:0/3363106381 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f79b40ac280 0x7f79b4147b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:21.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.108+0000 7f79bc36a700 1 -- 172.21.2.105:0/3363106381 >> 172.21.2.105:0/3363106381 conn(0x7f79b40b5370 msgr2=0x7f79b4143bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:21.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.108+0000 7f79bc36a700 1 -- 172.21.2.105:0/3363106381 shutdown_connections 2021-11-12T05:46:21.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.108+0000 7f79bc36a700 1 -- 172.21.2.105:0/3363106381 wait complete. 2021-11-12T05:46:21.117 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_metadata' removed 2021-11-12T05:46:21.121 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-12T05:46:21.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.168+0000 7ff695649700 1 Processor -- start 2021-11-12T05:46:21.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.168+0000 7ff695649700 1 -- start start 2021-11-12T05:46:21.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.168+0000 7ff695649700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff69014b2f0 0x7ff6900af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:21.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.168+0000 7ff695649700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6900ac7b0 con 0x7ff6900ac280 2021-11-12T05:46:21.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.168+0000 7ff695649700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6900ac9e0 con 0x7ff6900ad080 2021-11-12T05:46:21.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.168+0000 7ff695649700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6901488a0 con 0x7ff69014b2f0 2021-11-12T05:46:21.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.168+0000 7ff68f7fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff69014b2f0 0x7ff6900af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:21.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.168+0000 7ff68e7fc700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7ff6900ac280 0x7ff690147a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57456/0 (socket says 172.21.2.105:57456) 2021-11-12T05:46:21.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.168+0000 7ff68e7fc700 1 -- 172.21.2.105:0/3557732987 learned_addr learned my addr 172.21.2.105:0/3557732987 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:46:21.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.168+0000 7ff68f7fe700 1 -- 172.21.2.105:0/3557732987 >> v1:172.21.2.115:6789/0 conn(0x7ff6900ad080 legacy=0x7ff69014abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:21.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.168+0000 7ff68f7fe700 1 -- 172.21.2.105:0/3557732987 >> v1:172.21.2.105:6789/0 conn(0x7ff6900ac280 legacy=0x7ff690147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:21.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.168+0000 7ff68f7fe700 1 -- 172.21.2.105:0/3557732987 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6900b0b30 con 0x7ff69014b2f0 2021-11-12T05:46:21.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.168+0000 7ff68f7fe700 1 --2- 172.21.2.105:0/3557732987 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff69014b2f0 0x7ff6900af730 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7ff6900ac6a0 tx=0x7ff6880091d0).ready entity=mon.0 client_cookie=b659137b4aba9c6f server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:21.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.168+0000 7ff68dffb700 1 -- 172.21.2.105:0/3557732987 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff688009ea0 con 0x7ff69014b2f0 2021-11-12T05:46:21.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.168+0000 7ff68dffb700 1 -- 172.21.2.105:0/3557732987 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68800b860 con 0x7ff69014b2f0 2021-11-12T05:46:21.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.168+0000 7ff68dffb700 1 -- 172.21.2.105:0/3557732987 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff68800b9d0 con 0x7ff69014b2f0 2021-11-12T05:46:21.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.172+0000 7ff695649700 1 -- 172.21.2.105:0/3557732987 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff69014b2f0 msgr2=0x7ff6900af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:21.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.172+0000 7ff695649700 1 --2- 172.21.2.105:0/3557732987 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff69014b2f0 0x7ff6900af730 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7ff6900ac6a0 tx=0x7ff6880091d0).stop 2021-11-12T05:46:21.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.172+0000 7ff695649700 1 -- 172.21.2.105:0/3557732987 shutdown_connections 2021-11-12T05:46:21.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.172+0000 7ff695649700 1 --2- 172.21.2.105:0/3557732987 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff69014b2f0 0x7ff6900af730 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:21.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.172+0000 7ff695649700 1 -- 172.21.2.105:0/3557732987 >> 172.21.2.105:0/3557732987 conn(0x7ff6900b5370 msgr2=0x7ff6900b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:21.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.172+0000 7ff695649700 1 -- 172.21.2.105:0/3557732987 shutdown_connections 2021-11-12T05:46:21.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.172+0000 7ff695649700 1 -- 172.21.2.105:0/3557732987 wait complete. 2021-11-12T05:46:21.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.172+0000 7ff695649700 1 Processor -- start 2021-11-12T05:46:21.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.172+0000 7ff695649700 1 -- start start 2021-11-12T05:46:21.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.172+0000 7ff695649700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff6900ac280 0x7ff6900aa6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:21.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.172+0000 7ff695649700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff6900ad080 0x7ff690060930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:21.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.172+0000 7ff695649700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff69014b2f0 0x7ff6900a8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:21.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.172+0000 7ff695649700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6901433e0 con 0x7ff6900ac280 2021-11-12T05:46:21.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.172+0000 7ff695649700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff690157c30 con 0x7ff69014b2f0 2021-11-12T05:46:21.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.172+0000 7ff695649700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff690157990 con 0x7ff6900ad080 2021-11-12T05:46:21.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.172+0000 7ff68effd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff6900ac280 0x7ff6900aa6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:21.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.172+0000 7ff68effd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff6900ac280 0x7ff6900aa6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47064/0 (socket says 172.21.2.105:47064) 2021-11-12T05:46:21.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.172+0000 7ff68effd700 1 -- 172.21.2.105:0/1672576008 learned_addr learned my addr 172.21.2.105:0/1672576008 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:21.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.172+0000 7ff68effd700 1 -- 172.21.2.105:0/1672576008 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff6900ad080 msgr2=0x7ff690060930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:21.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.172+0000 7ff68effd700 1 --2- 172.21.2.105:0/1672576008 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff6900ad080 0x7ff690060930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:21.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.172+0000 7ff68effd700 1 -- 172.21.2.105:0/1672576008 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff69014b2f0 msgr2=0x7ff6900a8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:21.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.172+0000 7ff68effd700 1 --2- 172.21.2.105:0/1672576008 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff69014b2f0 0x7ff6900a8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:21.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.172+0000 7ff68effd700 1 -- 172.21.2.105:0/1672576008 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff688009470 con 0x7ff6900ac280 2021-11-12T05:46:21.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.172+0000 7ff68effd700 1 --2- 172.21.2.105:0/1672576008 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff6900ac280 0x7ff6900aa6a0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7ff680002f90 tx=0x7ff680006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:21.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.172+0000 7ff67ffff700 1 -- 172.21.2.105:0/1672576008 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff680013460 con 0x7ff6900ac280 2021-11-12T05:46:21.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.172+0000 7ff67ffff700 1 -- 172.21.2.105:0/1672576008 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6800135c0 con 0x7ff6900ac280 2021-11-12T05:46:21.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.172+0000 7ff695649700 1 -- 172.21.2.105:0/1672576008 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6900a80c0 con 0x7ff6900ac280 2021-11-12T05:46:21.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.172+0000 7ff67ffff700 1 -- 172.21.2.105:0/1672576008 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff680013920 con 0x7ff6900ac280 2021-11-12T05:46:21.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.172+0000 7ff695649700 1 -- 172.21.2.105:0/1672576008 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6900a9ad0 con 0x7ff6900ac280 2021-11-12T05:46:21.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.172+0000 7ff695649700 1 -- 172.21.2.105:0/1672576008 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6900a9700 con 0x7ff6900ac280 2021-11-12T05:46:21.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.172+0000 7ff67ffff700 1 -- 172.21.2.105:0/1672576008 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff68001a060 con 0x7ff6900ac280 2021-11-12T05:46:21.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.172+0000 7ff67ffff700 1 --2- 172.21.2.105:0/1672576008 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff66c0536f0 0x7ff66c055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:21.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.172+0000 7ff67ffff700 1 -- 172.21.2.105:0/1672576008 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6064+0+0 (secure 0 0 0) 0x7ff68006b250 con 0x7ff6900ac280 2021-11-12T05:46:21.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.172+0000 7ff68e7fc700 1 --2- 172.21.2.105:0/1672576008 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff66c0536f0 0x7ff66c055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:21.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.172+0000 7ff68e7fc700 1 --2- 172.21.2.105:0/1672576008 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff66c0536f0 0x7ff66c055bb0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7ff6900b0eb0 tx=0x7ff684007800).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:21.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.176+0000 7ff67ffff700 1 -- 172.21.2.105:0/1672576008 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff6900a9700 con 0x7ff6900ac280 2021-11-12T05:46:21.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:21.260+0000 7ff695649700 1 -- 172.21.2.105:0/1672576008 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff6900a9700 con 0x7ff6900ac280 2021-11-12T05:46:22.123 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.120+0000 7ff67ffff700 1 -- 172.21.2.105:0/1672576008 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v68) v1 ==== 173+0+0 (secure 0 0 0) 0x7ff6900a9700 con 0x7ff6900ac280 2021-11-12T05:46:22.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.120+0000 7ff695649700 1 -- 172.21.2.105:0/1672576008 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff66c0536f0 msgr2=0x7ff66c055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:22.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.120+0000 7ff695649700 1 --2- 172.21.2.105:0/1672576008 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff66c0536f0 0x7ff66c055bb0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7ff6900b0eb0 tx=0x7ff684007800).stop 2021-11-12T05:46:22.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.120+0000 7ff695649700 1 -- 172.21.2.105:0/1672576008 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff6900ac280 msgr2=0x7ff6900aa6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:22.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.120+0000 7ff695649700 1 --2- 172.21.2.105:0/1672576008 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff6900ac280 0x7ff6900aa6a0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7ff680002f90 tx=0x7ff680006df0).stop 2021-11-12T05:46:22.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.120+0000 7ff695649700 1 -- 172.21.2.105:0/1672576008 shutdown_connections 2021-11-12T05:46:22.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.120+0000 7ff695649700 1 --2- 172.21.2.105:0/1672576008 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff66c0536f0 0x7ff66c055bb0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:22.127 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.120+0000 7ff695649700 1 --2- 172.21.2.105:0/1672576008 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff69014b2f0 0x7ff6900a8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:22.127 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.120+0000 7ff695649700 1 --2- 172.21.2.105:0/1672576008 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff6900ad080 0x7ff690060930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:22.127 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.120+0000 7ff695649700 1 --2- 172.21.2.105:0/1672576008 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff6900ac280 0x7ff6900aa6a0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:22.127 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.120+0000 7ff695649700 1 -- 172.21.2.105:0/1672576008 >> 172.21.2.105:0/1672576008 conn(0x7ff6900b5370 msgr2=0x7ff690144410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:22.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.120+0000 7ff695649700 1 -- 172.21.2.105:0/1672576008 shutdown_connections 2021-11-12T05:46:22.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.120+0000 7ff695649700 1 -- 172.21.2.105:0/1672576008 wait complete. 2021-11-12T05:46:22.128 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_data' removed 2021-11-12T05:46:22.131 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-11-12T05:46:22.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.180+0000 7f200a9fd700 1 Processor -- start 2021-11-12T05:46:22.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.180+0000 7f200a9fd700 1 -- start start 2021-11-12T05:46:22.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.180+0000 7f200a9fd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f20040ace20 0x7f20040b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:22.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.180+0000 7f200a9fd700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20040b1840 con 0x7f2004144180 2021-11-12T05:46:22.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.180+0000 7f200a9fd700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20040af2b0 con 0x7f20040aca40 2021-11-12T05:46:22.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.180+0000 7f200a9fd700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20040b0a10 con 0x7f20040ace20 2021-11-12T05:46:22.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.180+0000 7f20037fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f20040ace20 0x7f20040b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:22.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.180+0000 7f2008f9a700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f2004144180 0x7f20041445f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57468/0 (socket says 172.21.2.105:57468) 2021-11-12T05:46:22.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.180+0000 7f2008f9a700 1 -- 172.21.2.105:0/813650888 learned_addr learned my addr 172.21.2.105:0/813650888 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:46:22.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.180+0000 7f20037fe700 1 -- 172.21.2.105:0/813650888 >> v1:172.21.2.115:6789/0 conn(0x7f20040aca40 legacy=0x7f20041473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:22.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.180+0000 7f20037fe700 1 -- 172.21.2.105:0/813650888 >> v1:172.21.2.105:6789/0 conn(0x7f2004144180 legacy=0x7f20041445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:22.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.180+0000 7f20037fe700 1 -- 172.21.2.105:0/813650888 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20040b1a70 con 0x7f20040ace20 2021-11-12T05:46:22.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.180+0000 7f20037fe700 1 --2- 172.21.2.105:0/813650888 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f20040ace20 0x7f20040b0520 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f20040611e0 tx=0x7f1ff4006df0).ready entity=mon.0 client_cookie=1a649c139cf3b682 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:22.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.180+0000 7f2002ffd700 1 -- 172.21.2.105:0/813650888 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ff400d5c0 con 0x7f20040ace20 2021-11-12T05:46:22.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.180+0000 7f2002ffd700 1 -- 172.21.2.105:0/813650888 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff4000e90 con 0x7f20040ace20 2021-11-12T05:46:22.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.180+0000 7f2002ffd700 1 -- 172.21.2.105:0/813650888 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ff400d910 con 0x7f20040ace20 2021-11-12T05:46:22.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.184+0000 7f200a9fd700 1 -- 172.21.2.105:0/813650888 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f20040ace20 msgr2=0x7f20040b0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:22.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.184+0000 7f200a9fd700 1 --2- 172.21.2.105:0/813650888 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f20040ace20 0x7f20040b0520 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f20040611e0 tx=0x7f1ff4006df0).stop 2021-11-12T05:46:22.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.184+0000 7f200a9fd700 1 -- 172.21.2.105:0/813650888 shutdown_connections 2021-11-12T05:46:22.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.184+0000 7f200a9fd700 1 --2- 172.21.2.105:0/813650888 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f20040ace20 0x7f20040b0520 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:22.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.184+0000 7f200a9fd700 1 -- 172.21.2.105:0/813650888 >> 172.21.2.105:0/813650888 conn(0x7f200405c490 msgr2=0x7f20040b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:22.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.184+0000 7f200a9fd700 1 -- 172.21.2.105:0/813650888 shutdown_connections 2021-11-12T05:46:22.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.184+0000 7f200a9fd700 1 -- 172.21.2.105:0/813650888 wait complete. 2021-11-12T05:46:22.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.184+0000 7f200a9fd700 1 Processor -- start 2021-11-12T05:46:22.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.184+0000 7f200a9fd700 1 -- start start 2021-11-12T05:46:22.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.184+0000 7f200a9fd700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f20040aca40 0x7f2004146450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:22.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.184+0000 7f200a9fd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f20040ace20 0x7f20041404a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:22.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.184+0000 7f200a9fd700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2004144180 0x7f2004140990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:22.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.184+0000 7f200a9fd700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2004065580 con 0x7f20040ace20 2021-11-12T05:46:22.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.184+0000 7f200a9fd700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2004062ed0 con 0x7f2004144180 2021-11-12T05:46:22.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.184+0000 7f200a9fd700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2004063ae0 con 0x7f20040aca40 2021-11-12T05:46:22.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.184+0000 7f20037fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f20040ace20 0x7f20041404a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:22.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.184+0000 7f20037fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f20040ace20 0x7f20041404a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47076/0 (socket says 172.21.2.105:47076) 2021-11-12T05:46:22.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.184+0000 7f20037fe700 1 -- 172.21.2.105:0/1868964151 learned_addr learned my addr 172.21.2.105:0/1868964151 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:22.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.184+0000 7f20037fe700 1 -- 172.21.2.105:0/1868964151 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f20040aca40 msgr2=0x7f2004146450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:22.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.184+0000 7f2008f9a700 1 --2- 172.21.2.105:0/1868964151 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2004144180 0x7f2004140990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:22.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.184+0000 7f2003fff700 1 --2- 172.21.2.105:0/1868964151 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f20040aca40 0x7f2004146450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:22.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.184+0000 7f20037fe700 1 --2- 172.21.2.105:0/1868964151 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f20040aca40 0x7f2004146450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:22.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.184+0000 7f20037fe700 1 -- 172.21.2.105:0/1868964151 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2004144180 msgr2=0x7f2004140990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:22.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.184+0000 7f20037fe700 1 --2- 172.21.2.105:0/1868964151 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2004144180 0x7f2004140990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:22.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.184+0000 7f20037fe700 1 -- 172.21.2.105:0/1868964151 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff400b180 con 0x7f20040ace20 2021-11-12T05:46:22.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.184+0000 7f2008f9a700 1 --2- 172.21.2.105:0/1868964151 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2004144180 0x7f2004140990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:46:22.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.184+0000 7f2003fff700 1 --2- 172.21.2.105:0/1868964151 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f20040aca40 0x7f2004146450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:46:22.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.184+0000 7f20037fe700 1 --2- 172.21.2.105:0/1868964151 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f20040ace20 0x7f20041404a0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f20040611e0 tx=0x7f1ff4012000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:22.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.184+0000 7f20017fa700 1 -- 172.21.2.105:0/1868964151 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ff4002f50 con 0x7f20040ace20 2021-11-12T05:46:22.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.184+0000 7f20017fa700 1 -- 172.21.2.105:0/1868964151 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff4013d50 con 0x7f20040ace20 2021-11-12T05:46:22.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.184+0000 7f200a9fd700 1 -- 172.21.2.105:0/1868964151 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2004063100 con 0x7f20040ace20 2021-11-12T05:46:22.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.184+0000 7f20017fa700 1 -- 172.21.2.105:0/1868964151 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ff401f640 con 0x7f20040ace20 2021-11-12T05:46:22.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.184+0000 7f200a9fd700 1 -- 172.21.2.105:0/1868964151 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2004140e80 con 0x7f20040ace20 2021-11-12T05:46:22.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.184+0000 7f200a9fd700 1 -- 172.21.2.105:0/1868964151 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2004057350 con 0x7f20040ace20 2021-11-12T05:46:22.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.184+0000 7f20017fa700 1 -- 172.21.2.105:0/1868964151 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1ff4026070 con 0x7f20040ace20 2021-11-12T05:46:22.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.188+0000 7f20017fa700 1 --2- 172.21.2.105:0/1868964151 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1fe80536a0 0x7f1fe8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:22.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.188+0000 7f20017fa700 1 -- 172.21.2.105:0/1868964151 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f1ff406bf70 con 0x7f20040ace20 2021-11-12T05:46:22.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.188+0000 7f2003fff700 1 --2- 172.21.2.105:0/1868964151 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1fe80536a0 0x7f1fe8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:22.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.188+0000 7f2003fff700 1 --2- 172.21.2.105:0/1868964151 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1fe80536a0 0x7f1fe8055b60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f1fec008000 tx=0x7f1fec009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:22.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.188+0000 7f20017fa700 1 -- 172.21.2.105:0/1868964151 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1ff4043250 con 0x7f20040ace20 2021-11-12T05:46:22.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.272+0000 7f200a9fd700 1 -- 172.21.2.105:0/1868964151 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f200405f280 con 0x7f20040ace20 2021-11-12T05:46:22.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.280+0000 7f20017fa700 1 -- 172.21.2.105:0/1868964151 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1ff4046870 con 0x7f20040ace20 2021-11-12T05:46:22.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.280+0000 7f200a9fd700 1 -- 172.21.2.105:0/1868964151 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1fe80536a0 msgr2=0x7f1fe8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:22.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.280+0000 7f200a9fd700 1 --2- 172.21.2.105:0/1868964151 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1fe80536a0 0x7f1fe8055b60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f1fec008000 tx=0x7f1fec009040).stop 2021-11-12T05:46:22.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.280+0000 7f200a9fd700 1 -- 172.21.2.105:0/1868964151 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f20040ace20 msgr2=0x7f20041404a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:22.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.280+0000 7f200a9fd700 1 --2- 172.21.2.105:0/1868964151 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f20040ace20 0x7f20041404a0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f20040611e0 tx=0x7f1ff4012000).stop 2021-11-12T05:46:22.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.280+0000 7f200a9fd700 1 -- 172.21.2.105:0/1868964151 shutdown_connections 2021-11-12T05:46:22.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.280+0000 7f200a9fd700 1 --2- 172.21.2.105:0/1868964151 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1fe80536a0 0x7f1fe8055b60 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:22.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.280+0000 7f200a9fd700 1 --2- 172.21.2.105:0/1868964151 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2004144180 0x7f2004140990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:22.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.280+0000 7f200a9fd700 1 --2- 172.21.2.105:0/1868964151 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f20040ace20 0x7f20041404a0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:22.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.280+0000 7f200a9fd700 1 --2- 172.21.2.105:0/1868964151 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f20040aca40 0x7f2004146450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:22.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.280+0000 7f200a9fd700 1 -- 172.21.2.105:0/1868964151 >> 172.21.2.105:0/1868964151 conn(0x7f200405c490 msgr2=0x7f20041415f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:22.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.280+0000 7f200a9fd700 1 -- 172.21.2.105:0/1868964151 shutdown_connections 2021-11-12T05:46:22.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.280+0000 7f200a9fd700 1 -- 172.21.2.105:0/1868964151 wait complete. 2021-11-12T05:46:22.291 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout' 2021-11-12T05:46:22.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.336+0000 7f7c1d1be700 1 Processor -- start 2021-11-12T05:46:22.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.336+0000 7f7c1d1be700 1 -- start start 2021-11-12T05:46:22.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c1d1be700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7c18066be0 0x7f7c18142670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:22.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c1d1be700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f7c180acd20 0x7f7c180adf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:22.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c1d1be700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c180acaf0 con 0x7f7c180b1380 2021-11-12T05:46:22.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c1d1be700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c18143270 con 0x7f7c180acd20 2021-11-12T05:46:22.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c1d1be700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c180afa90 con 0x7f7c18066be0 2021-11-12T05:46:22.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c1659c700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f7c180b1380 0x7f7c18142b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57480/0 (socket says 172.21.2.105:57480) 2021-11-12T05:46:22.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c1659c700 1 -- 172.21.2.105:0/1204273806 learned_addr learned my addr 172.21.2.105:0/1204273806 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:46:22.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c15d9b700 1 -- 172.21.2.105:0/1204273806 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 727749711 0 0) 0x7f7c180acaf0 con 0x7f7c180b1380 2021-11-12T05:46:22.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c15d9b700 1 -- 172.21.2.105:0/1204273806 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bf8003260 con 0x7f7c180b1380 2021-11-12T05:46:22.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c1759e700 1 --2- 172.21.2.105:0/1204273806 >> v2:172.21.2.115:3300/0 conn(0x7f7c180acd20 0x7f7c180adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:22.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c16d9d700 1 --2- 172.21.2.105:0/1204273806 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7c18066be0 0x7f7c18142670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:22.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c15d9b700 1 -- 172.21.2.105:0/1204273806 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3373985853 0 0) 0x7f7bf8003260 con 0x7f7c180b1380 2021-11-12T05:46:22.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c15d9b700 1 -- 172.21.2.105:0/1204273806 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7c18066be0 msgr2=0x7f7c18142670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:22.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c15d9b700 1 --2- 172.21.2.105:0/1204273806 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7c18066be0 0x7f7c18142670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:22.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c15d9b700 1 -- 172.21.2.105:0/1204273806 >> v2:172.21.2.115:3300/0 conn(0x7f7c180acd20 msgr2=0x7f7c180adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:22.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c15d9b700 1 --2- 172.21.2.105:0/1204273806 >> v2:172.21.2.115:3300/0 conn(0x7f7c180acd20 0x7f7c180adf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:22.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c15d9b700 1 -- 172.21.2.105:0/1204273806 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c18066fc0 con 0x7f7c180b1380 2021-11-12T05:46:22.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c15d9b700 1 -- 172.21.2.105:0/1204273806 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f7c08001660 con 0x7f7c180b1380 2021-11-12T05:46:22.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c15d9b700 1 -- 172.21.2.105:0/1204273806 >> v1:172.21.2.105:6789/0 conn(0x7f7c180b1380 legacy=0x7f7c18142b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:22.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c15d9b700 1 --2- 172.21.2.105:0/1204273806 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7c18066be0 0x7f7bf8003800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:22.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c15d9b700 1 --2- 172.21.2.105:0/1204273806 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7bf8003e30 0x7f7bf8004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:22.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c15d9b700 1 --2- 172.21.2.105:0/1204273806 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7bf80049f0 0x7f7bf8004e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:22.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c15d9b700 1 -- 172.21.2.105:0/1204273806 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c18143270 con 0x7f7bf8003e30 2021-11-12T05:46:22.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c15d9b700 1 -- 172.21.2.105:0/1204273806 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c180afa90 con 0x7f7bf80049f0 2021-11-12T05:46:22.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c15d9b700 1 -- 172.21.2.105:0/1204273806 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf800b900 con 0x7f7c18066be0 2021-11-12T05:46:22.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c1659c700 1 --2- 172.21.2.105:0/1204273806 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7bf8003e30 0x7f7bf8004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:22.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c1659c700 1 -- 172.21.2.105:0/1204273806 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7c18066be0 msgr2=0x7f7bf8003800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:22.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c1659c700 1 --2- 172.21.2.105:0/1204273806 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7c18066be0 0x7f7bf8003800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:22.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c1659c700 1 -- 172.21.2.105:0/1204273806 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7bf80049f0 msgr2=0x7f7bf8004e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:22.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c1659c700 1 --2- 172.21.2.105:0/1204273806 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7bf80049f0 0x7f7bf8004e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:22.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c1659c700 1 -- 172.21.2.105:0/1204273806 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf8003260 con 0x7f7bf8003e30 2021-11-12T05:46:22.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c1659c700 1 --2- 172.21.2.105:0/1204273806 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7bf8003e30 0x7f7bf8004500 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7f7c180afbd0 tx=0x7f7c08001d40).ready entity=mon.0 client_cookie=4db09e78d6271044 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:22.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c15d9b700 1 -- 172.21.2.105:0/1204273806 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c080070d0 con 0x7f7bf8003e30 2021-11-12T05:46:22.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c15d9b700 1 -- 172.21.2.105:0/1204273806 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c08007230 con 0x7f7bf8003e30 2021-11-12T05:46:22.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c15d9b700 1 -- 172.21.2.105:0/1204273806 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c0800c8f0 con 0x7f7bf8003e30 2021-11-12T05:46:22.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c1d1be700 1 -- 172.21.2.105:0/1204273806 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7bf8003e30 msgr2=0x7f7bf8004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:22.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c1d1be700 1 --2- 172.21.2.105:0/1204273806 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7bf8003e30 0x7f7bf8004500 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7f7c180afbd0 tx=0x7f7c08001d40).stop 2021-11-12T05:46:22.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c1759e700 1 -- 172.21.2.105:0/1204273806 reap_dead start 2021-11-12T05:46:22.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c1d1be700 1 -- 172.21.2.105:0/1204273806 shutdown_connections 2021-11-12T05:46:22.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c1d1be700 1 -- 172.21.2.105:0/1204273806 >> 172.21.2.105:0/1204273806 conn(0x7f7c180b5370 msgr2=0x7f7c180b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:22.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c1d1be700 1 -- 172.21.2.105:0/1204273806 shutdown_connections 2021-11-12T05:46:22.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c1d1be700 1 -- 172.21.2.105:0/1204273806 wait complete. 2021-11-12T05:46:22.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c1d1be700 1 Processor -- start 2021-11-12T05:46:22.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.340+0000 7f7c1d1be700 1 -- start start 2021-11-12T05:46:22.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.344+0000 7f7c1d1be700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7bf8003e30 0x7f7c1809eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:22.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.344+0000 7f7c1d1be700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7c1809f040 0x7f7c18152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:22.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.344+0000 7f7c1d1be700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7c18152b00 0x7f7c18155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:22.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.344+0000 7f7c1d1be700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c181464c0 con 0x7f7c1809f040 2021-11-12T05:46:22.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.344+0000 7f7c1d1be700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c180a1700 con 0x7f7bf8003e30 2021-11-12T05:46:22.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.344+0000 7f7c1d1be700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c180a11e0 con 0x7f7c18152b00 2021-11-12T05:46:22.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.344+0000 7f7c1659c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7c1809f040 0x7f7c18152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:22.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.344+0000 7f7c1659c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7c1809f040 0x7f7c18152610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47098/0 (socket says 172.21.2.105:47098) 2021-11-12T05:46:22.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.344+0000 7f7c1659c700 1 -- 172.21.2.105:0/3040068759 learned_addr learned my addr 172.21.2.105:0/3040068759 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:22.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.344+0000 7f7c1659c700 1 -- 172.21.2.105:0/3040068759 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7c18152b00 msgr2=0x7f7c18155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:22.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.344+0000 7f7c1659c700 1 --2- 172.21.2.105:0/3040068759 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7c18152b00 0x7f7c18155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:22.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.344+0000 7f7c1659c700 1 -- 172.21.2.105:0/3040068759 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7bf8003e30 msgr2=0x7f7c1809eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:22.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.344+0000 7f7c16d9d700 1 --2- 172.21.2.105:0/3040068759 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7bf8003e30 0x7f7c1809eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:22.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.344+0000 7f7c1659c700 1 --2- 172.21.2.105:0/3040068759 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7bf8003e30 0x7f7c1809eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:22.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.344+0000 7f7c1659c700 1 -- 172.21.2.105:0/3040068759 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c180a1460 con 0x7f7c1809f040 2021-11-12T05:46:22.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.344+0000 7f7c1659c700 1 --2- 172.21.2.105:0/3040068759 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7c1809f040 0x7f7c18152610 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7f7c180afbd0 tx=0x7f7c08015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:22.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.344+0000 7f7c0ffff700 1 -- 172.21.2.105:0/3040068759 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c08004920 con 0x7f7c1809f040 2021-11-12T05:46:22.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.344+0000 7f7c0ffff700 1 -- 172.21.2.105:0/3040068759 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c08004a80 con 0x7f7c1809f040 2021-11-12T05:46:22.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.344+0000 7f7c1d1be700 1 -- 172.21.2.105:0/3040068759 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c18147250 con 0x7f7c1809f040 2021-11-12T05:46:22.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.344+0000 7f7c0ffff700 1 -- 172.21.2.105:0/3040068759 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c08004de0 con 0x7f7c1809f040 2021-11-12T05:46:22.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.344+0000 7f7c1d1be700 1 -- 172.21.2.105:0/3040068759 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c18148740 con 0x7f7c1809f040 2021-11-12T05:46:22.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.344+0000 7f7c1d1be700 1 -- 172.21.2.105:0/3040068759 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c181476a0 con 0x7f7c1809f040 2021-11-12T05:46:22.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.344+0000 7f7c0ffff700 1 -- 172.21.2.105:0/3040068759 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7c08010070 con 0x7f7c1809f040 2021-11-12T05:46:22.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.344+0000 7f7c0ffff700 1 --2- 172.21.2.105:0/3040068759 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7bfc053690 0x7f7bfc055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:22.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.344+0000 7f7c0ffff700 1 -- 172.21.2.105:0/3040068759 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f7c0806c5d0 con 0x7f7c1809f040 2021-11-12T05:46:22.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.344+0000 7f7c16d9d700 1 --2- 172.21.2.105:0/3040068759 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7bfc053690 0x7f7bfc055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:22.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.344+0000 7f7c16d9d700 1 --2- 172.21.2.105:0/3040068759 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7bfc053690 0x7f7bfc055b50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f7c00008000 tx=0x7f7c00008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:22.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.348+0000 7f7c0ffff700 1 -- 172.21.2.105:0/3040068759 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7c181476a0 con 0x7f7c1809f040 2021-11-12T05:46:22.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:22.460+0000 7f7c1d1be700 1 -- 172.21.2.105:0/3040068759 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]} v 0) v1 -- 0x7f7c181473e0 con 0x7f7c1809f040 2021-11-12T05:46:23.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.132+0000 7f7c0ffff700 1 -- 172.21.2.105:0/3040068759 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]}]=0 v235) v1 ==== 147+0+0 (secure 0 0 0) 0x7f7c080438b0 con 0x7f7c1809f040 2021-11-12T05:46:23.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.132+0000 7f7c1d1be700 1 -- 172.21.2.105:0/3040068759 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7bfc053690 msgr2=0x7f7bfc055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:23.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.132+0000 7f7c1d1be700 1 --2- 172.21.2.105:0/3040068759 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7bfc053690 0x7f7bfc055b50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f7c00008000 tx=0x7f7c00008040).stop 2021-11-12T05:46:23.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.132+0000 7f7c1d1be700 1 -- 172.21.2.105:0/3040068759 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7c1809f040 msgr2=0x7f7c18152610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:23.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.132+0000 7f7c1d1be700 1 --2- 172.21.2.105:0/3040068759 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7c1809f040 0x7f7c18152610 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7f7c180afbd0 tx=0x7f7c08015000).stop 2021-11-12T05:46:23.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.132+0000 7f7c1d1be700 1 -- 172.21.2.105:0/3040068759 shutdown_connections 2021-11-12T05:46:23.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.132+0000 7f7c1d1be700 1 --2- 172.21.2.105:0/3040068759 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7bfc053690 0x7f7bfc055b50 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:23.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.132+0000 7f7c1d1be700 1 --2- 172.21.2.105:0/3040068759 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7c18152b00 0x7f7c18155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:23.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.132+0000 7f7c1d1be700 1 --2- 172.21.2.105:0/3040068759 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7c1809f040 0x7f7c18152610 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:23.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.132+0000 7f7c1d1be700 1 --2- 172.21.2.105:0/3040068759 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7bf8003e30 0x7f7c1809eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:23.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.132+0000 7f7c1d1be700 1 -- 172.21.2.105:0/3040068759 >> 172.21.2.105:0/3040068759 conn(0x7f7c180b5370 msgr2=0x7f7c18149610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:23.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.132+0000 7f7c1d1be700 1 -- 172.21.2.105:0/3040068759 shutdown_connections 2021-11-12T05:46:23.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.132+0000 7f7c1d1be700 1 -- 172.21.2.105:0/3040068759 wait complete. 2021-11-12T05:46:23.144 INFO:tasks.cephfs_test_runner:test_drop_cache_command_timeout (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-11-12T05:46:23.145 INFO:tasks.cephfs_test_runner:Starting test: test_cap_revoke_nonresponder (tasks.cephfs.test_misc.TestMisc) 2021-11-12T05:46:23.145 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder' 2021-11-12T05:46:23.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.196+0000 7fe79a262700 1 Processor -- start 2021-11-12T05:46:23.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.196+0000 7fe79a262700 1 -- start start 2021-11-12T05:46:23.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.196+0000 7fe79a262700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe7940ab430 0x7fe7940acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:23.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.196+0000 7fe79a262700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fe79414a9b0 0x7fe7941466d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:23.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.196+0000 7fe79a262700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7940b08d0 con 0x7fe7940b04f0 2021-11-12T05:46:23.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.196+0000 7fe79a262700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7940ad230 con 0x7fe7940ab430 2021-11-12T05:46:23.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.196+0000 7fe79a262700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7940ad450 con 0x7fe79414a9b0 2021-11-12T05:46:23.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.196+0000 7fe792ffd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe7940ab430 0x7fe7940acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:23.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.196+0000 7fe7937fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fe7940b04f0 0x7fe794147a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57498/0 (socket says 172.21.2.105:57498) 2021-11-12T05:46:23.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.196+0000 7fe7937fe700 1 -- 172.21.2.105:0/1896072971 learned_addr learned my addr 172.21.2.105:0/1896072971 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:46:23.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.196+0000 7fe792ffd700 1 -- 172.21.2.105:0/1896072971 >> v2:172.21.2.115:3300/0 conn(0x7fe79414a9b0 msgr2=0x7fe7941466d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:23.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.196+0000 7fe792ffd700 1 --2- 172.21.2.105:0/1896072971 >> v2:172.21.2.115:3300/0 conn(0x7fe79414a9b0 0x7fe7941466d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:23.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.196+0000 7fe792ffd700 1 -- 172.21.2.105:0/1896072971 >> v1:172.21.2.105:6789/0 conn(0x7fe7940b04f0 legacy=0x7fe794147a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:23.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.196+0000 7fe792ffd700 1 -- 172.21.2.105:0/1896072971 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7941475f0 con 0x7fe7940ab430 2021-11-12T05:46:23.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.196+0000 7fe792ffd700 1 --2- 172.21.2.105:0/1896072971 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe7940ab430 0x7fe7940acd40 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7fe788002f70 tx=0x7fe788006df0).ready entity=mon.0 client_cookie=d665d7b696d62aa9 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:23.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.196+0000 7fe7927fc700 1 -- 172.21.2.105:0/1896072971 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe78800d5c0 con 0x7fe7940ab430 2021-11-12T05:46:23.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.196+0000 7fe7927fc700 1 -- 172.21.2.105:0/1896072971 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe788000e90 con 0x7fe7940ab430 2021-11-12T05:46:23.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.196+0000 7fe7927fc700 1 -- 172.21.2.105:0/1896072971 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe78800d910 con 0x7fe7940ab430 2021-11-12T05:46:23.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.196+0000 7fe79a262700 1 -- 172.21.2.105:0/1896072971 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe7940ab430 msgr2=0x7fe7940acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:23.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.196+0000 7fe79a262700 1 --2- 172.21.2.105:0/1896072971 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe7940ab430 0x7fe7940acd40 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7fe788002f70 tx=0x7fe788006df0).stop 2021-11-12T05:46:23.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.196+0000 7fe79a262700 1 -- 172.21.2.105:0/1896072971 shutdown_connections 2021-11-12T05:46:23.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.196+0000 7fe79a262700 1 --2- 172.21.2.105:0/1896072971 >> v2:172.21.2.115:3300/0 conn(0x7fe79414a9b0 0x7fe7941466d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:23.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.196+0000 7fe79a262700 1 --2- 172.21.2.105:0/1896072971 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe7940ab430 0x7fe7940acd40 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:23.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.196+0000 7fe79a262700 1 -- 172.21.2.105:0/1896072971 >> 172.21.2.105:0/1896072971 conn(0x7fe7940628b0 msgr2=0x7fe794062c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:23.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.196+0000 7fe79a262700 1 -- 172.21.2.105:0/1896072971 shutdown_connections 2021-11-12T05:46:23.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.196+0000 7fe79a262700 1 -- 172.21.2.105:0/1896072971 wait complete. 2021-11-12T05:46:23.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.196+0000 7fe79a262700 1 Processor -- start 2021-11-12T05:46:23.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.196+0000 7fe79a262700 1 -- start start 2021-11-12T05:46:23.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.196+0000 7fe79a262700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe7940ab430 0x7fe794063810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:23.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.196+0000 7fe79a262700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe7940b04f0 0x7fe794149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:23.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.196+0000 7fe79a262700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe79414a9b0 0x7fe794144e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:23.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.196+0000 7fe79a262700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe794067050 con 0x7fe7940ab430 2021-11-12T05:46:23.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.196+0000 7fe79a262700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79409eb90 con 0x7fe79414a9b0 2021-11-12T05:46:23.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.196+0000 7fe79a262700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe794067280 con 0x7fe7940b04f0 2021-11-12T05:46:23.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.196+0000 7fe7937fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe7940ab430 0x7fe794063810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:23.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.200+0000 7fe7937fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe7940ab430 0x7fe794063810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47110/0 (socket says 172.21.2.105:47110) 2021-11-12T05:46:23.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.200+0000 7fe7937fe700 1 -- 172.21.2.105:0/815447396 learned_addr learned my addr 172.21.2.105:0/815447396 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:23.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.200+0000 7fe7937fe700 1 -- 172.21.2.105:0/815447396 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe7940b04f0 msgr2=0x7fe794149df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:23.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.200+0000 7fe7937fe700 1 --2- 172.21.2.105:0/815447396 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe7940b04f0 0x7fe794149df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:23.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.200+0000 7fe7937fe700 1 -- 172.21.2.105:0/815447396 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe79414a9b0 msgr2=0x7fe794144e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:23.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.200+0000 7fe7937fe700 1 --2- 172.21.2.105:0/815447396 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe79414a9b0 0x7fe794144e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:23.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.200+0000 7fe7937fe700 1 -- 172.21.2.105:0/815447396 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe78800b180 con 0x7fe7940ab430 2021-11-12T05:46:23.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.200+0000 7fe7937fe700 1 --2- 172.21.2.105:0/815447396 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe7940ab430 0x7fe794063810 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7fe79406b160 tx=0x7fe784007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:23.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.200+0000 7fe790ff9700 1 -- 172.21.2.105:0/815447396 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe78400ce30 con 0x7fe7940ab430 2021-11-12T05:46:23.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.200+0000 7fe790ff9700 1 -- 172.21.2.105:0/815447396 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7840072e0 con 0x7fe7940ab430 2021-11-12T05:46:23.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.200+0000 7fe79a262700 1 -- 172.21.2.105:0/815447396 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe794067720 con 0x7fe7940ab430 2021-11-12T05:46:23.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.200+0000 7fe790ff9700 1 -- 172.21.2.105:0/815447396 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe784005800 con 0x7fe7940ab430 2021-11-12T05:46:23.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.200+0000 7fe79a262700 1 -- 172.21.2.105:0/815447396 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe794063fb0 con 0x7fe7940ab430 2021-11-12T05:46:23.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.200+0000 7fe79a262700 1 -- 172.21.2.105:0/815447396 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe794067440 con 0x7fe7940ab430 2021-11-12T05:46:23.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.200+0000 7fe790ff9700 1 -- 172.21.2.105:0/815447396 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe784010070 con 0x7fe7940ab430 2021-11-12T05:46:23.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.200+0000 7fe790ff9700 1 --2- 172.21.2.105:0/815447396 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe774053610 0x7fe774055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:23.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.200+0000 7fe790ff9700 1 -- 172.21.2.105:0/815447396 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fe78406b9c0 con 0x7fe7940ab430 2021-11-12T05:46:23.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.200+0000 7fe792ffd700 1 --2- 172.21.2.105:0/815447396 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe774053610 0x7fe774055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:23.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.200+0000 7fe792ffd700 1 --2- 172.21.2.105:0/815447396 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe774053610 0x7fe774055ad0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7fe788002f70 tx=0x7fe788014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:23.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.200+0000 7fe790ff9700 1 -- 172.21.2.105:0/815447396 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe784042170 con 0x7fe7940ab430 2021-11-12T05:46:23.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:23.316+0000 7fe79a262700 1 -- 172.21.2.105:0/815447396 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]} v 0) v1 -- 0x7fe79414ae40 con 0x7fe7940ab430 2021-11-12T05:46:24.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.136+0000 7fe790ff9700 1 -- 172.21.2.105:0/815447396 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]}]=0 v236) v1 ==== 142+0+0 (secure 0 0 0) 0x7fe784018020 con 0x7fe7940ab430 2021-11-12T05:46:24.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.136+0000 7fe79a262700 1 -- 172.21.2.105:0/815447396 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe774053610 msgr2=0x7fe774055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:24.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.136+0000 7fe79a262700 1 --2- 172.21.2.105:0/815447396 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe774053610 0x7fe774055ad0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7fe788002f70 tx=0x7fe788014000).stop 2021-11-12T05:46:24.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.136+0000 7fe79a262700 1 -- 172.21.2.105:0/815447396 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe7940ab430 msgr2=0x7fe794063810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:24.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.136+0000 7fe79a262700 1 --2- 172.21.2.105:0/815447396 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe7940ab430 0x7fe794063810 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7fe79406b160 tx=0x7fe784007c40).stop 2021-11-12T05:46:24.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.136+0000 7fe79a262700 1 -- 172.21.2.105:0/815447396 shutdown_connections 2021-11-12T05:46:24.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.136+0000 7fe79a262700 1 --2- 172.21.2.105:0/815447396 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe774053610 0x7fe774055ad0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:24.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.136+0000 7fe79a262700 1 --2- 172.21.2.105:0/815447396 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe79414a9b0 0x7fe794144e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:24.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.136+0000 7fe79a262700 1 --2- 172.21.2.105:0/815447396 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe7940b04f0 0x7fe794149df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:24.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.136+0000 7fe79a262700 1 --2- 172.21.2.105:0/815447396 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe7940ab430 0x7fe794063810 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:24.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.136+0000 7fe79a262700 1 -- 172.21.2.105:0/815447396 >> 172.21.2.105:0/815447396 conn(0x7fe7940628b0 msgr2=0x7fe794145e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:24.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.136+0000 7fe79a262700 1 -- 172.21.2.105:0/815447396 shutdown_connections 2021-11-12T05:46:24.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.136+0000 7fe79a262700 1 -- 172.21.2.105:0/815447396 wait complete. 2021-11-12T05:46:24.148 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-11-12T05:46:24.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.200+0000 7f74fdef9700 1 Processor -- start 2021-11-12T05:46:24.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.200+0000 7f74fdef9700 1 -- start start 2021-11-12T05:46:24.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74fdef9700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f74f80ace20 0x7f74f80b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:24.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74fdef9700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f74f8144180 0x7f74f81445f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:24.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74fdef9700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74f80b1840 con 0x7f74f80aca40 2021-11-12T05:46:24.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74fdef9700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74f80b0a10 con 0x7f74f8144180 2021-11-12T05:46:24.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74fdef9700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74f80af2b0 con 0x7f74f80ace20 2021-11-12T05:46:24.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74f77fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f74f80aca40 0x7f74f81473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57514/0 (socket says 172.21.2.105:57514) 2021-11-12T05:46:24.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74f77fe700 1 -- 172.21.2.105:0/3435529124 learned_addr learned my addr 172.21.2.105:0/3435529124 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:46:24.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74f7fff700 1 --2- 172.21.2.105:0/3435529124 >> v2:172.21.2.105:3300/0 conn(0x7f74f8144180 0x7f74f81445f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:24.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74f7fff700 1 -- 172.21.2.105:0/3435529124 >> v2:172.21.2.115:3300/0 conn(0x7f74f80ace20 msgr2=0x7f74f80b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:24.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74f7fff700 1 --2- 172.21.2.105:0/3435529124 >> v2:172.21.2.115:3300/0 conn(0x7f74f80ace20 0x7f74f80b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:24.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74f7fff700 1 -- 172.21.2.105:0/3435529124 >> v1:172.21.2.105:6789/0 conn(0x7f74f80aca40 legacy=0x7f74f81473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:24.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74f7fff700 1 -- 172.21.2.105:0/3435529124 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f80b1a70 con 0x7f74f8144180 2021-11-12T05:46:24.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74f7fff700 1 --2- 172.21.2.105:0/3435529124 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f74f8144180 0x7f74f81445f0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7f74e0001110 tx=0x7f74f00091d0).ready entity=mon.0 client_cookie=7d2cc611984e3fd9 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:24.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74f67fc700 1 -- 172.21.2.105:0/3435529124 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74f0009ea0 con 0x7f74f8144180 2021-11-12T05:46:24.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74f67fc700 1 -- 172.21.2.105:0/3435529124 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f000b730 con 0x7f74f8144180 2021-11-12T05:46:24.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74f67fc700 1 -- 172.21.2.105:0/3435529124 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74f000b8a0 con 0x7f74f8144180 2021-11-12T05:46:24.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74fdef9700 1 -- 172.21.2.105:0/3435529124 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f74f8144180 msgr2=0x7f74f81445f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:24.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74fdef9700 1 --2- 172.21.2.105:0/3435529124 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f74f8144180 0x7f74f81445f0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7f74e0001110 tx=0x7f74f00091d0).stop 2021-11-12T05:46:24.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74fdef9700 1 -- 172.21.2.105:0/3435529124 shutdown_connections 2021-11-12T05:46:24.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74fdef9700 1 --2- 172.21.2.105:0/3435529124 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f74f8144180 0x7f74f81445f0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:24.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74fdef9700 1 --2- 172.21.2.105:0/3435529124 >> v2:172.21.2.115:3300/0 conn(0x7f74f80ace20 0x7f74f80b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:24.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74fdef9700 1 -- 172.21.2.105:0/3435529124 >> 172.21.2.105:0/3435529124 conn(0x7f74f805c490 msgr2=0x7f74f80b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:24.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74fdef9700 1 -- 172.21.2.105:0/3435529124 shutdown_connections 2021-11-12T05:46:24.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74fdef9700 1 -- 172.21.2.105:0/3435529124 wait complete. 2021-11-12T05:46:24.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74fdef9700 1 Processor -- start 2021-11-12T05:46:24.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74fdef9700 1 -- start start 2021-11-12T05:46:24.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74fdef9700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f74f80aca40 0x7f74f8062890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:24.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74fdef9700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f74f80ace20 0x7f74f8159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:24.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74fdef9700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f74f8144180 0x7f74f815a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:24.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74fdef9700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f8065730 con 0x7f74f80ace20 2021-11-12T05:46:24.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74fdef9700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f8062d80 con 0x7f74f8144180 2021-11-12T05:46:24.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74fdef9700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74f8066e30 con 0x7f74f80aca40 2021-11-12T05:46:24.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74f6ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f74f80ace20 0x7f74f8159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:24.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74f6ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f74f80ace20 0x7f74f8159f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47128/0 (socket says 172.21.2.105:47128) 2021-11-12T05:46:24.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74f6ffd700 1 -- 172.21.2.105:0/2398327622 learned_addr learned my addr 172.21.2.105:0/2398327622 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:24.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74f6ffd700 1 -- 172.21.2.105:0/2398327622 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f74f80aca40 msgr2=0x7f74f8062890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:24.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74f6ffd700 1 --2- 172.21.2.105:0/2398327622 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f74f80aca40 0x7f74f8062890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:24.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74f6ffd700 1 -- 172.21.2.105:0/2398327622 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f74f8144180 msgr2=0x7f74f815a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:24.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74f6ffd700 1 --2- 172.21.2.105:0/2398327622 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f74f8144180 0x7f74f815a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:24.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74f6ffd700 1 -- 172.21.2.105:0/2398327622 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f0009470 con 0x7f74f80ace20 2021-11-12T05:46:24.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74f6ffd700 1 --2- 172.21.2.105:0/2398327622 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f74f80ace20 0x7f74f8159f00 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7f74f8062ec0 tx=0x7f74e8006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:24.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74f4ff9700 1 -- 172.21.2.105:0/2398327622 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74e8013460 con 0x7f74f80ace20 2021-11-12T05:46:24.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74f4ff9700 1 -- 172.21.2.105:0/2398327622 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e80135c0 con 0x7f74f80ace20 2021-11-12T05:46:24.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74f4ff9700 1 -- 172.21.2.105:0/2398327622 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74e8013920 con 0x7f74f80ace20 2021-11-12T05:46:24.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74fdef9700 1 -- 172.21.2.105:0/2398327622 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74f80670d0 con 0x7f74f80ace20 2021-11-12T05:46:24.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.204+0000 7f74fdef9700 1 -- 172.21.2.105:0/2398327622 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74f81475b0 con 0x7f74f80ace20 2021-11-12T05:46:24.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.208+0000 7f74fdef9700 1 -- 172.21.2.105:0/2398327622 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74f8067260 con 0x7f74f80ace20 2021-11-12T05:46:24.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.208+0000 7f74f4ff9700 1 -- 172.21.2.105:0/2398327622 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f74e800f070 con 0x7f74f80ace20 2021-11-12T05:46:24.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.208+0000 7f74f4ff9700 1 --2- 172.21.2.105:0/2398327622 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f74dc053610 0x7f74dc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:24.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.208+0000 7f74f4ff9700 1 -- 172.21.2.105:0/2398327622 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f74e806b2a0 con 0x7f74f80ace20 2021-11-12T05:46:24.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.208+0000 7f74f77fe700 1 --2- 172.21.2.105:0/2398327622 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f74dc053610 0x7f74dc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:24.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.208+0000 7f74f77fe700 1 --2- 172.21.2.105:0/2398327622 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f74dc053610 0x7f74dc055ad0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f74e00011d0 tx=0x7f74e00077d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:24.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.208+0000 7f74f4ff9700 1 -- 172.21.2.105:0/2398327622 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f74e8042470 con 0x7f74f80ace20 2021-11-12T05:46:24.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.292+0000 7f74fdef9700 1 -- 172.21.2.105:0/2398327622 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f74f8057350 con 0x7f74f80ace20 2021-11-12T05:46:24.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.300+0000 7f74f4ff9700 1 -- 172.21.2.105:0/2398327622 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f74e8045a90 con 0x7f74f80ace20 2021-11-12T05:46:24.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.300+0000 7f74fdef9700 1 -- 172.21.2.105:0/2398327622 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f74dc053610 msgr2=0x7f74dc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:24.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.300+0000 7f74fdef9700 1 --2- 172.21.2.105:0/2398327622 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f74dc053610 0x7f74dc055ad0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f74e00011d0 tx=0x7f74e00077d0).stop 2021-11-12T05:46:24.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.300+0000 7f74fdef9700 1 -- 172.21.2.105:0/2398327622 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f74f80ace20 msgr2=0x7f74f8159f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:24.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.300+0000 7f74fdef9700 1 --2- 172.21.2.105:0/2398327622 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f74f80ace20 0x7f74f8159f00 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7f74f8062ec0 tx=0x7f74e8006ec0).stop 2021-11-12T05:46:24.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.300+0000 7f74fdef9700 1 -- 172.21.2.105:0/2398327622 shutdown_connections 2021-11-12T05:46:24.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.300+0000 7f74fdef9700 1 --2- 172.21.2.105:0/2398327622 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f74dc053610 0x7f74dc055ad0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:24.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.300+0000 7f74fdef9700 1 --2- 172.21.2.105:0/2398327622 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f74f8144180 0x7f74f815a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:24.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.300+0000 7f74fdef9700 1 --2- 172.21.2.105:0/2398327622 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f74f80ace20 0x7f74f8159f00 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:24.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.300+0000 7f74fdef9700 1 --2- 172.21.2.105:0/2398327622 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f74f80aca40 0x7f74f8062890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:24.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.300+0000 7f74fdef9700 1 -- 172.21.2.105:0/2398327622 >> 172.21.2.105:0/2398327622 conn(0x7f74f805c490 msgr2=0x7f74f8141490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:24.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.300+0000 7f74fdef9700 1 -- 172.21.2.105:0/2398327622 shutdown_connections 2021-11-12T05:46:24.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.300+0000 7f74fdef9700 1 -- 172.21.2.105:0/2398327622 wait complete. 2021-11-12T05:46:24.311 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-12T05:46:24.312 DEBUG:teuthology.orchestra.run.gibba005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:46:24.319 DEBUG:teuthology.orchestra.run.gibba015:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:46:24.327 DEBUG:teuthology.orchestra.run.gibba016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:46:24.340 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:46:24.353 DEBUG:teuthology.orchestra.run.gibba044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:46:24.366 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-12T05:46:24.367 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:46:24.367 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:46:24.367 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:46:24.372 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:46:24.373 INFO:teuthology.orchestra.run.gibba016.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-12T05:46:24.373 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-11-12T05:46:24.374 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:46:24.374 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:46:24.375 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:46:24.379 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:46:24.380 INFO:teuthology.orchestra.run.gibba038.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-12T05:46:24.380 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-12T05:46:24.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:46:24.381 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:46:24.382 DEBUG:teuthology.orchestra.run.gibba044:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:46:24.411 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:46:24.412 INFO:teuthology.orchestra.run.gibba044.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-12T05:46:24.412 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-12T05:46:24.413 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-12T05:46:24.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.480+0000 7ff8b412d700 1 Processor -- start 2021-11-12T05:46:24.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.480+0000 7ff8b412d700 1 -- start start 2021-11-12T05:46:24.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.480+0000 7ff8b412d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff8ac062ac0 0x7ff8ac0b6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:24.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.480+0000 7ff8b412d700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff8ac0b0130 0x7ff8ac138c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:24.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.480+0000 7ff8b412d700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8ac0b6570 con 0x7ff8ac13ef20 2021-11-12T05:46:24.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.480+0000 7ff8b412d700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8ac0b56a0 con 0x7ff8ac062ac0 2021-11-12T05:46:24.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.480+0000 7ff8b412d700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac0b5940 con 0x7ff8ac0b0130 2021-11-12T05:46:24.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.480+0000 7ff8b1ec9700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff8ac062ac0 0x7ff8ac0b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:24.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.480+0000 7ff8b26ca700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7ff8ac13ef20 0x7ff8ac0ae740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57528/0 (socket says 172.21.2.105:57528) 2021-11-12T05:46:24.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.480+0000 7ff8b26ca700 1 -- 172.21.2.105:0/3485947814 learned_addr learned my addr 172.21.2.105:0/3485947814 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:46:24.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.484+0000 7ff8b1ec9700 1 -- 172.21.2.105:0/3485947814 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff8ac0b0130 msgr2=0x7ff8ac138c20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:46:24.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.484+0000 7ff8b1ec9700 1 --2- 172.21.2.105:0/3485947814 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff8ac0b0130 0x7ff8ac138c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:24.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.484+0000 7ff8b1ec9700 1 -- 172.21.2.105:0/3485947814 >> v1:172.21.2.105:6789/0 conn(0x7ff8ac13ef20 legacy=0x7ff8ac0ae740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:24.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.484+0000 7ff8b1ec9700 1 -- 172.21.2.105:0/3485947814 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ac0b5be0 con 0x7ff8ac062ac0 2021-11-12T05:46:24.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.484+0000 7ff8b1ec9700 1 --2- 172.21.2.105:0/3485947814 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff8ac062ac0 0x7ff8ac0b6080 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7ff8a8002f70 tx=0x7ff8a8006df0).ready entity=mon.0 client_cookie=e98ccb900ee14953 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:24.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.484+0000 7ff8b0ec7700 1 -- 172.21.2.105:0/3485947814 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8a800f970 con 0x7ff8ac062ac0 2021-11-12T05:46:24.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.484+0000 7ff8b0ec7700 1 -- 172.21.2.105:0/3485947814 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a8000e90 con 0x7ff8ac062ac0 2021-11-12T05:46:24.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.484+0000 7ff8b0ec7700 1 -- 172.21.2.105:0/3485947814 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8a800fd00 con 0x7ff8ac062ac0 2021-11-12T05:46:24.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.484+0000 7ff8b412d700 1 -- 172.21.2.105:0/3485947814 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff8ac062ac0 msgr2=0x7ff8ac0b6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:24.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.484+0000 7ff8b412d700 1 --2- 172.21.2.105:0/3485947814 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff8ac062ac0 0x7ff8ac0b6080 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7ff8a8002f70 tx=0x7ff8a8006df0).stop 2021-11-12T05:46:24.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.484+0000 7ff8b412d700 1 -- 172.21.2.105:0/3485947814 shutdown_connections 2021-11-12T05:46:24.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.484+0000 7ff8b412d700 1 --2- 172.21.2.105:0/3485947814 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff8ac0b0130 0x7ff8ac138c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:24.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.484+0000 7ff8b412d700 1 --2- 172.21.2.105:0/3485947814 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff8ac062ac0 0x7ff8ac0b6080 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:24.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.484+0000 7ff8b412d700 1 -- 172.21.2.105:0/3485947814 >> 172.21.2.105:0/3485947814 conn(0x7ff8ac05c490 msgr2=0x7ff8ac05c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:24.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.484+0000 7ff8b412d700 1 -- 172.21.2.105:0/3485947814 shutdown_connections 2021-11-12T05:46:24.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.484+0000 7ff8b412d700 1 -- 172.21.2.105:0/3485947814 wait complete. 2021-11-12T05:46:24.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.484+0000 7ff8b412d700 1 Processor -- start 2021-11-12T05:46:24.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.484+0000 7ff8b412d700 1 -- start start 2021-11-12T05:46:24.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.484+0000 7ff8b412d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff8ac062ac0 0x7ff8ac13d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:24.498 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.484+0000 7ff8b412d700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff8ac0b0130 0x7ff8ac13b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:24.498 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.484+0000 7ff8b412d700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff8ac13ef20 0x7ff8ac13b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:24.498 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.484+0000 7ff8b412d700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac141bc0 con 0x7ff8ac062ac0 2021-11-12T05:46:24.498 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.484+0000 7ff8b412d700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac141e60 con 0x7ff8ac0b0130 2021-11-12T05:46:24.499 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.484+0000 7ff8b412d700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ac13e5e0 con 0x7ff8ac13ef20 2021-11-12T05:46:24.499 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.484+0000 7ff8b1ec9700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff8ac062ac0 0x7ff8ac13d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:24.499 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.484+0000 7ff8b1ec9700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff8ac062ac0 0x7ff8ac13d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47140/0 (socket says 172.21.2.105:47140) 2021-11-12T05:46:24.499 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.484+0000 7ff8b1ec9700 1 -- 172.21.2.105:0/3476582394 learned_addr learned my addr 172.21.2.105:0/3476582394 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:24.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.484+0000 7ff8b1ec9700 1 -- 172.21.2.105:0/3476582394 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff8ac13ef20 msgr2=0x7ff8ac13b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:24.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.484+0000 7ff8b1ec9700 1 --2- 172.21.2.105:0/3476582394 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff8ac13ef20 0x7ff8ac13b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:24.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.484+0000 7ff8b1ec9700 1 -- 172.21.2.105:0/3476582394 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff8ac0b0130 msgr2=0x7ff8ac13b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:24.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.484+0000 7ff8b1ec9700 1 --2- 172.21.2.105:0/3476582394 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff8ac0b0130 0x7ff8ac13b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:24.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.484+0000 7ff8b1ec9700 1 -- 172.21.2.105:0/3476582394 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a800b180 con 0x7ff8ac062ac0 2021-11-12T05:46:24.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.484+0000 7ff8b1ec9700 1 --2- 172.21.2.105:0/3476582394 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff8ac062ac0 0x7ff8ac13d960 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7ff8a8002f70 tx=0x7ff8a8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:24.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.484+0000 7ff89effd700 1 -- 172.21.2.105:0/3476582394 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8a800e1d0 con 0x7ff8ac062ac0 2021-11-12T05:46:24.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.484+0000 7ff89effd700 1 -- 172.21.2.105:0/3476582394 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a8018400 con 0x7ff8ac062ac0 2021-11-12T05:46:24.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.484+0000 7ff89effd700 1 -- 172.21.2.105:0/3476582394 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8a8018760 con 0x7ff8ac062ac0 2021-11-12T05:46:24.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.484+0000 7ff8b412d700 1 -- 172.21.2.105:0/3476582394 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8ac142100 con 0x7ff8ac062ac0 2021-11-12T05:46:24.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.484+0000 7ff8b412d700 1 -- 172.21.2.105:0/3476582394 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8ac142bd0 con 0x7ff8ac062ac0 2021-11-12T05:46:24.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.488+0000 7ff8b412d700 1 -- 172.21.2.105:0/3476582394 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8ac145570 con 0x7ff8ac062ac0 2021-11-12T05:46:24.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.488+0000 7ff89effd700 1 -- 172.21.2.105:0/3476582394 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff8a80188c0 con 0x7ff8ac062ac0 2021-11-12T05:46:24.503 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.488+0000 7ff89effd700 1 --2- 172.21.2.105:0/3476582394 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff88c0536f0 0x7ff88c055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:24.503 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.488+0000 7ff89effd700 1 -- 172.21.2.105:0/3476582394 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5682+0+0 (secure 0 0 0) 0x7ff8a806d460 con 0x7ff8ac062ac0 2021-11-12T05:46:24.503 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.488+0000 7ff8b16c8700 1 --2- 172.21.2.105:0/3476582394 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff88c0536f0 0x7ff88c055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:24.503 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.488+0000 7ff8b16c8700 1 --2- 172.21.2.105:0/3476582394 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff88c0536f0 0x7ff88c055bb0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7ff8a0002fb0 tx=0x7ff8a00069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:24.504 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.488+0000 7ff89effd700 1 -- 172.21.2.105:0/3476582394 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff8a8044610 con 0x7ff8ac062ac0 2021-11-12T05:46:24.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.572+0000 7ff8b412d700 1 -- 172.21.2.105:0/3476582394 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ff8ac0b3050 con 0x7ff8ac062ac0 2021-11-12T05:46:24.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.576+0000 7ff89effd700 1 -- 172.21.2.105:0/3476582394 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v68) v1 ==== 81+0+29220 (secure 0 0 0) 0x7ff8a8029020 con 0x7ff8ac062ac0 2021-11-12T05:46:24.579 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:46:24.580 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:46:24.580 INFO:teuthology.orchestra.run.gibba005.stdout: "epoch": 68, 2021-11-12T05:46:24.580 INFO:teuthology.orchestra.run.gibba005.stdout: "fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", 2021-11-12T05:46:24.580 INFO:teuthology.orchestra.run.gibba005.stdout: "created": "2021-11-12T05:40:19.986390+0000", 2021-11-12T05:46:24.581 INFO:teuthology.orchestra.run.gibba005.stdout: "modified": "2021-11-12T05:46:22.112191+0000", 2021-11-12T05:46:24.581 INFO:teuthology.orchestra.run.gibba005.stdout: "last_up_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:46:24.581 INFO:teuthology.orchestra.run.gibba005.stdout: "last_in_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:46:24.581 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-12T05:46:24.582 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_num": 5799936, 2021-11-12T05:46:24.582 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_set": [ 2021-11-12T05:46:24.582 INFO:teuthology.orchestra.run.gibba005.stdout: "pglog_hardlimit", 2021-11-12T05:46:24.582 INFO:teuthology.orchestra.run.gibba005.stdout: "purged_snapdirs", 2021-11-12T05:46:24.583 INFO:teuthology.orchestra.run.gibba005.stdout: "recovery_deletes", 2021-11-12T05:46:24.583 INFO:teuthology.orchestra.run.gibba005.stdout: "sortbitwise" 2021-11-12T05:46:24.583 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:46:24.583 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_version": 5, 2021-11-12T05:46:24.584 INFO:teuthology.orchestra.run.gibba005.stdout: "full_ratio": 0.94999998807907104, 2021-11-12T05:46:24.584 INFO:teuthology.orchestra.run.gibba005.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-12T05:46:24.584 INFO:teuthology.orchestra.run.gibba005.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-12T05:46:24.584 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_snapshot": "", 2021-11-12T05:46:24.585 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_max": 12, 2021-11-12T05:46:24.585 INFO:teuthology.orchestra.run.gibba005.stdout: "max_osd": 8, 2021-11-12T05:46:24.585 INFO:teuthology.orchestra.run.gibba005.stdout: "require_min_compat_client": "jewel", 2021-11-12T05:46:24.586 INFO:teuthology.orchestra.run.gibba005.stdout: "min_compat_client": "jewel", 2021-11-12T05:46:24.586 INFO:teuthology.orchestra.run.gibba005.stdout: "require_osd_release": "octopus", 2021-11-12T05:46:24.586 INFO:teuthology.orchestra.run.gibba005.stdout: "pools": [ 2021-11-12T05:46:24.586 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.587 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 1, 2021-11-12T05:46:24.587 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "device_health_metrics", 2021-11-12T05:46:24.587 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:22.022116+0000", 2021-11-12T05:46:24.587 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:46:24.587 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:46:24.588 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:46:24.588 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:46:24.588 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:46:24.588 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:46:24.588 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:46:24.589 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:46:24.589 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 1, 2021-11-12T05:46:24.589 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 1, 2021-11-12T05:46:24.589 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 1, 2021-11-12T05:46:24.590 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 1, 2021-11-12T05:46:24.590 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 1, 2021-11-12T05:46:24.590 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:46:24.590 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:46:24.591 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:46:24.591 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:46:24.591 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:46:24.591 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:46:24.592 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:46:24.592 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.592 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "16", 2021-11-12T05:46:24.592 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:46:24.592 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:46:24.593 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:46:24.593 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:46:24.593 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:46:24.593 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:46:24.594 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:46:24.594 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:46:24.594 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:46:24.594 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:46:24.595 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:46:24.595 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:46:24.595 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:46:24.595 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:46:24.595 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:46:24.596 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:46:24.596 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:46:24.596 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:46:24.596 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:46:24.597 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:46:24.597 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:46:24.597 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:46:24.597 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:46:24.597 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:46:24.598 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:46:24.598 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:46:24.598 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.598 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:46:24.599 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:46:24.599 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:46:24.599 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:46:24.599 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:46:24.600 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:46:24.600 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:46:24.600 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:46:24.600 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:46:24.601 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:46:24.601 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:46:24.601 INFO:teuthology.orchestra.run.gibba005.stdout: "options": { 2021-11-12T05:46:24.601 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_min": 1 2021-11-12T05:46:24.601 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.602 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:46:24.602 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr_devicehealth": {} 2021-11-12T05:46:24.602 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:24.602 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.603 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.603 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 2, 2021-11-12T05:46:24.603 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "rbd", 2021-11-12T05:46:24.603 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:29.953617+0000", 2021-11-12T05:46:24.604 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:46:24.604 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:46:24.604 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:46:24.604 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:46:24.604 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:46:24.605 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:46:24.605 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:46:24.605 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:46:24.605 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:46:24.606 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:46:24.606 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:46:24.606 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:46:24.606 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:46:24.607 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:46:24.607 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:46:24.607 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:46:24.607 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:46:24.607 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:46:24.608 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:46:24.608 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:46:24.608 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.608 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "19", 2021-11-12T05:46:24.609 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:46:24.609 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:46:24.609 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:46:24.609 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:46:24.610 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:46:24.610 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:46:24.610 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:46:24.610 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:46:24.611 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:46:24.611 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:46:24.611 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:46:24.611 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:46:24.612 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:46:24.612 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:46:24.612 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:46:24.612 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:46:24.612 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:46:24.613 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:46:24.613 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:46:24.613 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:46:24.613 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:46:24.614 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:46:24.614 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:46:24.614 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:46:24.614 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:46:24.615 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:46:24.615 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.615 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:46:24.615 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:46:24.616 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:46:24.616 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:46:24.616 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:46:24.616 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:46:24.616 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:46:24.617 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:46:24.617 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:46:24.617 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:46:24.617 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:46:24.617 INFO:teuthology.orchestra.run.gibba005.stdout: "options": {}, 2021-11-12T05:46:24.618 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:46:24.618 INFO:teuthology.orchestra.run.gibba005.stdout: "rbd": {} 2021-11-12T05:46:24.618 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:24.618 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:24.619 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:46:24.619 INFO:teuthology.orchestra.run.gibba005.stdout: "osds": [ 2021-11-12T05:46:24.619 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.619 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:46:24.620 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "ee8e30a0-4819-4475-80ec-dd3ee7d01322", 2021-11-12T05:46:24.620 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:46:24.620 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:46:24.620 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:46:24.620 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:46:24.621 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:46:24.621 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:46:24.621 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:46:24.621 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 63, 2021-11-12T05:46:24.622 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:46:24.622 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:46:24.622 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:46:24.622 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:24.623 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.623 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:24.623 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6802", 2021-11-12T05:46:24.623 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:46:24.623 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.624 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.624 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:24.624 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6803", 2021-11-12T05:46:24.624 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:46:24.625 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:24.625 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.625 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.625 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:46:24.626 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:24.626 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.626 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:24.626 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6804", 2021-11-12T05:46:24.627 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:46:24.627 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.627 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.627 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:24.628 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6805", 2021-11-12T05:46:24.628 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:46:24.628 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:24.628 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.628 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.629 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:46:24.629 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:24.629 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.629 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:24.630 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6808", 2021-11-12T05:46:24.630 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:46:24.630 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.630 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.631 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:24.631 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6809", 2021-11-12T05:46:24.631 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:46:24.631 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:24.631 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.632 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.632 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:46:24.632 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:24.632 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.633 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:24.633 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6806", 2021-11-12T05:46:24.633 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:46:24.633 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.634 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.634 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:24.634 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6807", 2021-11-12T05:46:24.634 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:46:24.635 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:24.635 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.635 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.635 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6803/14874", 2021-11-12T05:46:24.635 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6805/14874", 2021-11-12T05:46:24.636 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6809/14874", 2021-11-12T05:46:24.636 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6807/14874", 2021-11-12T05:46:24.636 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:46:24.636 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:46:24.636 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:46:24.637 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.637 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.637 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.637 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:46:24.637 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "b1bb06c3-26d0-4d92-82f8-b3e882242785", 2021-11-12T05:46:24.638 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:46:24.638 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:46:24.638 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:46:24.638 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:46:24.639 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:46:24.639 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:46:24.639 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:46:24.639 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 63, 2021-11-12T05:46:24.639 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:46:24.640 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:46:24.640 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:46:24.640 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:24.640 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.641 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:24.641 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6810", 2021-11-12T05:46:24.641 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:46:24.641 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.641 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.642 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:24.642 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6811", 2021-11-12T05:46:24.642 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:46:24.642 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:24.643 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.643 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.643 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:46:24.643 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:24.644 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.644 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:24.644 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6812", 2021-11-12T05:46:24.644 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:46:24.644 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.645 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.645 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:24.645 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6813", 2021-11-12T05:46:24.645 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:46:24.646 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:24.646 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.646 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.646 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:46:24.646 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:24.647 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.647 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:24.647 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6816", 2021-11-12T05:46:24.647 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:46:24.648 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.648 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.648 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:24.648 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6817", 2021-11-12T05:46:24.648 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:46:24.649 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:24.649 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.649 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.649 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:46:24.650 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:24.650 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.650 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:24.650 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6814", 2021-11-12T05:46:24.650 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:46:24.651 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.651 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.651 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:24.651 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6815", 2021-11-12T05:46:24.652 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:46:24.652 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:24.652 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.652 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.652 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6811/14875", 2021-11-12T05:46:24.653 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6813/14875", 2021-11-12T05:46:24.653 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6817/14875", 2021-11-12T05:46:24.653 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6815/14875", 2021-11-12T05:46:24.653 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:46:24.654 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:46:24.654 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:46:24.654 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.654 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.654 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.655 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:46:24.655 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "837b2c60-c335-4382-9f47-d86543a14022", 2021-11-12T05:46:24.655 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:46:24.655 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:46:24.656 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:46:24.656 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:46:24.656 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:46:24.656 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:46:24.656 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:46:24.657 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 62, 2021-11-12T05:46:24.657 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:46:24.657 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:46:24.657 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:46:24.658 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:24.658 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.658 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:24.658 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6818", 2021-11-12T05:46:24.659 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:46:24.659 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.659 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.660 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:24.660 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6819", 2021-11-12T05:46:24.660 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:46:24.660 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:24.660 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.661 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.661 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:46:24.661 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:24.661 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.662 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:24.662 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6820", 2021-11-12T05:46:24.662 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:46:24.662 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.663 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.663 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:24.663 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6821", 2021-11-12T05:46:24.663 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:46:24.664 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:24.664 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.664 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.664 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:46:24.664 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:24.665 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.665 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:24.665 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6824", 2021-11-12T05:46:24.665 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:46:24.666 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.666 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.666 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:24.666 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6825", 2021-11-12T05:46:24.667 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:46:24.667 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:24.667 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.667 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.668 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:46:24.668 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:24.668 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.668 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:24.669 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6822", 2021-11-12T05:46:24.669 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:46:24.669 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.669 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.669 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:24.670 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6823", 2021-11-12T05:46:24.670 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:46:24.670 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:24.670 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.671 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.671 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6819/14905", 2021-11-12T05:46:24.671 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6821/14905", 2021-11-12T05:46:24.671 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6825/14905", 2021-11-12T05:46:24.671 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6823/14905", 2021-11-12T05:46:24.672 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:46:24.672 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:46:24.672 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:46:24.672 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.673 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.673 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.673 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:46:24.673 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "eb2b737b-dda6-444b-a306-f33cbbd51f70", 2021-11-12T05:46:24.674 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:46:24.674 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:46:24.674 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:46:24.674 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:46:24.675 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:46:24.675 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:46:24.675 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:46:24.675 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 52, 2021-11-12T05:46:24.675 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:46:24.676 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:46:24.676 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:46:24.676 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:24.676 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.676 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:24.677 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6826", 2021-11-12T05:46:24.677 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:46:24.677 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.677 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.678 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:24.678 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6827", 2021-11-12T05:46:24.678 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:46:24.678 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:24.678 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.679 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.679 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:46:24.679 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:24.679 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.680 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:24.680 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6828", 2021-11-12T05:46:24.680 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:46:24.680 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.681 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.681 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:24.681 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6829", 2021-11-12T05:46:24.681 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:46:24.682 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:24.682 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.682 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.682 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:46:24.683 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:24.683 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.683 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:24.683 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6832", 2021-11-12T05:46:24.684 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:46:24.684 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.684 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.684 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:24.685 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6833", 2021-11-12T05:46:24.685 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:46:24.685 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:24.685 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.686 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.686 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:46:24.686 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:24.686 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.686 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:24.687 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6830", 2021-11-12T05:46:24.687 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:46:24.687 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.687 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.688 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:24.688 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6831", 2021-11-12T05:46:24.688 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:46:24.688 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:24.688 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.689 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.689 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6827/14876", 2021-11-12T05:46:24.689 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6829/14876", 2021-11-12T05:46:24.689 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6833/14876", 2021-11-12T05:46:24.690 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6831/14876", 2021-11-12T05:46:24.690 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:46:24.690 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:46:24.690 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:46:24.691 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.691 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.691 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.691 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:46:24.691 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "721529a1-c047-486a-a7ca-ddc15d80cdde", 2021-11-12T05:46:24.692 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:46:24.692 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:46:24.692 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:46:24.692 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:46:24.693 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:46:24.693 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:46:24.693 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:46:24.693 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 63, 2021-11-12T05:46:24.693 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:46:24.694 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:46:24.694 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:46:24.694 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:24.694 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.695 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:24.695 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6800", 2021-11-12T05:46:24.695 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:46:24.695 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.696 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.696 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:24.696 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6801", 2021-11-12T05:46:24.696 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:46:24.696 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:24.697 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.697 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.697 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:46:24.697 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:24.698 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.698 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:24.698 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6802", 2021-11-12T05:46:24.698 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:46:24.698 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.699 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.699 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:24.699 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6803", 2021-11-12T05:46:24.699 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:46:24.700 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:24.700 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.700 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.700 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:46:24.701 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:24.701 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.701 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:24.701 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6806", 2021-11-12T05:46:24.701 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:46:24.702 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.702 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.702 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:24.702 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6807", 2021-11-12T05:46:24.703 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:46:24.703 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:24.703 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.703 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.704 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:46:24.704 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:24.704 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.704 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:24.705 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6804", 2021-11-12T05:46:24.705 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:46:24.705 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.705 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.706 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:24.706 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6805", 2021-11-12T05:46:24.706 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:46:24.706 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:24.707 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.707 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.707 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6801/15096", 2021-11-12T05:46:24.707 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6803/15096", 2021-11-12T05:46:24.708 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6807/15096", 2021-11-12T05:46:24.708 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6805/15096", 2021-11-12T05:46:24.708 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:46:24.708 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:46:24.708 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:46:24.709 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.709 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.709 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.709 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:46:24.710 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "68b72ab2-fa82-4b5c-bf33-528f002e4950", 2021-11-12T05:46:24.710 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:46:24.710 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:46:24.710 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:46:24.711 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:46:24.711 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:46:24.711 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:46:24.711 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:46:24.711 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 62, 2021-11-12T05:46:24.712 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:46:24.712 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:46:24.712 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:46:24.712 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:24.713 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.713 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:24.713 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6808", 2021-11-12T05:46:24.713 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:46:24.714 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.714 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.714 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:24.714 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6809", 2021-11-12T05:46:24.714 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:46:24.715 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:24.715 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.715 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.715 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:46:24.716 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:24.716 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.716 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:24.716 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6810", 2021-11-12T05:46:24.716 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:46:24.717 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.717 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.717 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:24.717 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6811", 2021-11-12T05:46:24.718 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:46:24.718 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:24.718 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.718 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.719 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:46:24.719 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:24.719 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.719 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:24.720 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6814", 2021-11-12T05:46:24.720 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:46:24.720 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.720 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.720 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:24.721 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6815", 2021-11-12T05:46:24.721 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:46:24.721 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:24.721 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.722 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.722 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:46:24.722 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:24.722 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.723 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:24.723 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6812", 2021-11-12T05:46:24.723 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:46:24.723 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.723 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.724 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:24.724 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6813", 2021-11-12T05:46:24.724 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:46:24.724 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:24.725 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.725 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.725 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6809/15097", 2021-11-12T05:46:24.725 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6811/15097", 2021-11-12T05:46:24.726 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6815/15097", 2021-11-12T05:46:24.726 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6813/15097", 2021-11-12T05:46:24.726 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:46:24.726 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:46:24.726 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:46:24.727 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.727 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.727 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.728 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:46:24.728 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "a2c83b5d-8d37-4d30-ac04-30d89a76e485", 2021-11-12T05:46:24.728 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:46:24.728 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:46:24.728 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:46:24.729 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:46:24.729 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:46:24.729 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:46:24.729 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:46:24.730 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 63, 2021-11-12T05:46:24.730 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:46:24.730 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:46:24.730 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:46:24.731 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:24.731 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.731 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:24.731 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6816", 2021-11-12T05:46:24.732 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:46:24.732 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.732 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.732 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:24.732 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6817", 2021-11-12T05:46:24.733 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:46:24.733 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:24.733 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.733 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.734 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:46:24.734 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:24.734 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.734 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:24.735 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6818", 2021-11-12T05:46:24.735 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:46:24.735 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.735 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.736 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:24.736 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6819", 2021-11-12T05:46:24.736 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:46:24.737 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:24.737 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.737 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.737 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:46:24.737 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:24.738 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.738 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:24.738 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6822", 2021-11-12T05:46:24.738 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:46:24.739 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.739 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.739 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:24.739 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6823", 2021-11-12T05:46:24.740 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:46:24.740 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:24.740 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.740 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.740 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:46:24.741 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:24.741 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.741 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:24.741 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6820", 2021-11-12T05:46:24.741 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:46:24.742 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.742 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.742 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:24.742 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6821", 2021-11-12T05:46:24.743 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:46:24.743 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:24.743 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.743 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.744 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6817/15098", 2021-11-12T05:46:24.744 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6819/15098", 2021-11-12T05:46:24.744 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6823/15098", 2021-11-12T05:46:24.744 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6821/15098", 2021-11-12T05:46:24.744 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:46:24.745 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:46:24.745 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:46:24.745 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.745 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.746 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.746 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:46:24.746 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "786ce966-d0fb-4181-aed4-c26e3ef61c43", 2021-11-12T05:46:24.746 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:46:24.747 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:46:24.747 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:46:24.747 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:46:24.747 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:46:24.748 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:46:24.748 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:46:24.748 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 62, 2021-11-12T05:46:24.748 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:46:24.749 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:46:24.749 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:46:24.749 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:24.749 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.749 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:24.750 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6824", 2021-11-12T05:46:24.750 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:46:24.750 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.750 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.751 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:24.751 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6825", 2021-11-12T05:46:24.751 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:46:24.752 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:24.752 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.752 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.752 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:46:24.752 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:24.753 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.753 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:24.753 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6826", 2021-11-12T05:46:24.753 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:46:24.754 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.754 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.754 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:24.754 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6827", 2021-11-12T05:46:24.755 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:46:24.755 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:24.755 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.755 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.755 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:46:24.756 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:24.756 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.756 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:24.756 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6830", 2021-11-12T05:46:24.757 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:46:24.757 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.758 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.758 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:24.758 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6831", 2021-11-12T05:46:24.758 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:46:24.759 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:24.759 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.759 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.759 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:46:24.760 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:46:24.760 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.760 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:46:24.760 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6828", 2021-11-12T05:46:24.761 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:46:24.761 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.761 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.761 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:46:24.761 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6829", 2021-11-12T05:46:24.762 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:46:24.762 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:24.762 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.762 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.763 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6825/15099", 2021-11-12T05:46:24.763 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6827/15099", 2021-11-12T05:46:24.763 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6831/15099", 2021-11-12T05:46:24.763 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6829/15099", 2021-11-12T05:46:24.763 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:46:24.764 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:46:24.764 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:46:24.764 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:24.764 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:24.765 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:46:24.765 INFO:teuthology.orchestra.run.gibba005.stdout: "osd_xinfo": [ 2021-11-12T05:46:24.765 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.765 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:46:24.765 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:46:24.766 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:46:24.766 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:46:24.766 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:46:24.767 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:46:24.767 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.615112+0000", 2021-11-12T05:46:24.767 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:46:24.767 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.768 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.768 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:46:24.768 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:46:24.768 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:46:24.769 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:46:24.769 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:46:24.769 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:46:24.769 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.665935+0000", 2021-11-12T05:46:24.769 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:46:24.770 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.770 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.770 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:46:24.770 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:46:24.771 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:46:24.771 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:46:24.771 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:46:24.771 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:46:24.772 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.715877+0000", 2021-11-12T05:46:24.772 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:46:24.772 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.772 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.772 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:46:24.773 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:46:24.773 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:46:24.773 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:46:24.773 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:46:24.774 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:46:24.774 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.489234+0000", 2021-11-12T05:46:24.774 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:46:24.774 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.775 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.775 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:46:24.775 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:46:24.775 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:46:24.775 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:46:24.776 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:46:24.776 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:46:24.776 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.413776+0000", 2021-11-12T05:46:24.777 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:46:24.777 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.777 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.777 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:46:24.777 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:46:24.778 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:46:24.778 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:46:24.778 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:46:24.778 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:46:24.778 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.507960+0000", 2021-11-12T05:46:24.779 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:46:24.779 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.779 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.779 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:46:24.780 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:46:24.780 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:46:24.780 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:46:24.780 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:46:24.780 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:46:24.781 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.635696+0000", 2021-11-12T05:46:24.781 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:46:24.781 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.781 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:24.782 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:46:24.782 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:46:24.782 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:46:24.782 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:46:24.783 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:46:24.783 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:46:24.783 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.746949+0000", 2021-11-12T05:46:24.783 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:46:24.783 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:24.784 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:46:24.784 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap": [], 2021-11-12T05:46:24.784 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap_items": [], 2021-11-12T05:46:24.784 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_temp": [], 2021-11-12T05:46:24.785 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_temp": [], 2021-11-12T05:46:24.785 INFO:teuthology.orchestra.run.gibba005.stdout: "blacklist": { 2021-11-12T05:46:24.785 INFO:teuthology.orchestra.run.gibba005.stdout: "172.21.2.105:6835/1667092126": "2021-11-13T05:46:18.314900+0000", 2021-11-12T05:46:24.786 INFO:teuthology.orchestra.run.gibba005.stdout: "172.21.2.105:6834/1667092126": "2021-11-13T05:46:18.314900+0000" 2021-11-12T05:46:24.786 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.786 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profiles": { 2021-11-12T05:46:24.786 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs_data": { 2021-11-12T05:46:24.786 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-device-class": "", 2021-11-12T05:46:24.787 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:46:24.787 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-root": "default", 2021-11-12T05:46:24.787 INFO:teuthology.orchestra.run.gibba005.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-12T05:46:24.788 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:46:24.788 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "2", 2021-11-12T05:46:24.788 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:46:24.788 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:46:24.788 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van", 2021-11-12T05:46:24.789 INFO:teuthology.orchestra.run.gibba005.stdout: "w": "8" 2021-11-12T05:46:24.789 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.789 INFO:teuthology.orchestra.run.gibba005.stdout: "default": { 2021-11-12T05:46:24.789 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:46:24.789 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:46:24.790 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "1", 2021-11-12T05:46:24.790 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:46:24.790 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:46:24.790 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van" 2021-11-12T05:46:24.790 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:24.791 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:24.791 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps_queue": [], 2021-11-12T05:46:24.791 INFO:teuthology.orchestra.run.gibba005.stdout: "new_removed_snaps": [], 2021-11-12T05:46:24.791 INFO:teuthology.orchestra.run.gibba005.stdout: "new_purged_snaps": [], 2021-11-12T05:46:24.791 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_node_flags": {}, 2021-11-12T05:46:24.792 INFO:teuthology.orchestra.run.gibba005.stdout: "device_class_flags": {} 2021-11-12T05:46:24.792 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:46:24.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.576+0000 7ff8b412d700 1 -- 172.21.2.105:0/3476582394 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff88c0536f0 msgr2=0x7ff88c055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:24.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.576+0000 7ff8b412d700 1 --2- 172.21.2.105:0/3476582394 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff88c0536f0 0x7ff88c055bb0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7ff8a0002fb0 tx=0x7ff8a00069b0).stop 2021-11-12T05:46:24.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.576+0000 7ff8b412d700 1 -- 172.21.2.105:0/3476582394 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff8ac062ac0 msgr2=0x7ff8ac13d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:24.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.576+0000 7ff8b412d700 1 --2- 172.21.2.105:0/3476582394 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff8ac062ac0 0x7ff8ac13d960 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7ff8a8002f70 tx=0x7ff8a8017000).stop 2021-11-12T05:46:24.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.576+0000 7ff8b412d700 1 -- 172.21.2.105:0/3476582394 shutdown_connections 2021-11-12T05:46:24.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.576+0000 7ff8b412d700 1 --2- 172.21.2.105:0/3476582394 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff88c0536f0 0x7ff88c055bb0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:24.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.576+0000 7ff8b412d700 1 --2- 172.21.2.105:0/3476582394 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff8ac13ef20 0x7ff8ac13b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:24.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.576+0000 7ff8b412d700 1 --2- 172.21.2.105:0/3476582394 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff8ac0b0130 0x7ff8ac13b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:24.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.576+0000 7ff8b412d700 1 --2- 172.21.2.105:0/3476582394 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff8ac062ac0 0x7ff8ac13d960 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:24.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.576+0000 7ff8b412d700 1 -- 172.21.2.105:0/3476582394 >> 172.21.2.105:0/3476582394 conn(0x7ff8ac05c490 msgr2=0x7ff8ac0b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:24.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.576+0000 7ff8b412d700 1 -- 172.21.2.105:0/3476582394 shutdown_connections 2021-11-12T05:46:24.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.576+0000 7ff8b412d700 1 -- 172.21.2.105:0/3476582394 wait complete. 2021-11-12T05:46:24.797 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:46:24.842 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:46:24.844 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:46:24.847 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:46:24.850 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:46:24.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.848+0000 7faa66161700 1 Processor -- start 2021-11-12T05:46:24.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.848+0000 7faa66161700 1 -- start start 2021-11-12T05:46:24.854 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:46:24.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.848+0000 7faa66161700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7faa600b97a0 0x7faa60143780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:24.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.848+0000 7faa66161700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7faa600b5d00 0x7faa600b6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:24.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.848+0000 7faa66161700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa600b40a0 con 0x7faa600b4500 2021-11-12T05:46:24.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.848+0000 7faa66161700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa600b9b80 con 0x7faa600b97a0 2021-11-12T05:46:24.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.848+0000 7faa66161700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa600b5060 con 0x7faa600b5d00 2021-11-12T05:46:24.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.848+0000 7faa6515f700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7faa600b97a0 0x7faa60143780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:24.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.848+0000 7faa6495e700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7faa600b4500 0x7faa600b4950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57542/0 (socket says 172.21.2.105:57542) 2021-11-12T05:46:24.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.848+0000 7faa6495e700 1 -- 172.21.2.105:0/2875436967 learned_addr learned my addr 172.21.2.105:0/2875436967 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:46:24.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.848+0000 7faa65960700 1 --2- 172.21.2.105:0/2875436967 >> v2:172.21.2.115:3300/0 conn(0x7faa600b5d00 0x7faa600b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:24.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa6515f700 1 -- 172.21.2.105:0/2875436967 >> v2:172.21.2.115:3300/0 conn(0x7faa600b5d00 msgr2=0x7faa600b6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:24.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa6515f700 1 --2- 172.21.2.105:0/2875436967 >> v2:172.21.2.115:3300/0 conn(0x7faa600b5d00 0x7faa600b6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:24.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa6515f700 1 -- 172.21.2.105:0/2875436967 >> v1:172.21.2.105:6789/0 conn(0x7faa600b4500 legacy=0x7faa600b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:24.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa6515f700 1 -- 172.21.2.105:0/2875436967 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa60062710 con 0x7faa600b97a0 2021-11-12T05:46:24.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa4ffff700 1 -- 172.21.2.105:0/2875436967 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2347608256 0 0) 0x7faa600b40a0 con 0x7faa600b4500 2021-11-12T05:46:24.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa6515f700 1 --2- 172.21.2.105:0/2875436967 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faa600b97a0 0x7faa60143780 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7faa50002f70 tx=0x7faa50006df0).ready entity=mon.0 client_cookie=da0e2191c346da5d server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:24.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa4ffff700 1 -- 172.21.2.105:0/2875436967 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa5000d5c0 con 0x7faa600b97a0 2021-11-12T05:46:24.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa4ffff700 1 -- 172.21.2.105:0/2875436967 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa50000e90 con 0x7faa600b97a0 2021-11-12T05:46:24.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa4ffff700 1 -- 172.21.2.105:0/2875436967 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa5000d910 con 0x7faa600b97a0 2021-11-12T05:46:24.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa66161700 1 -- 172.21.2.105:0/2875436967 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faa600b97a0 msgr2=0x7faa60143780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:24.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa66161700 1 --2- 172.21.2.105:0/2875436967 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faa600b97a0 0x7faa60143780 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7faa50002f70 tx=0x7faa50006df0).stop 2021-11-12T05:46:24.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa66161700 1 -- 172.21.2.105:0/2875436967 shutdown_connections 2021-11-12T05:46:24.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa66161700 1 --2- 172.21.2.105:0/2875436967 >> v2:172.21.2.115:3300/0 conn(0x7faa600b5d00 0x7faa600b6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:24.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa66161700 1 --2- 172.21.2.105:0/2875436967 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faa600b97a0 0x7faa60143780 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:24.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa66161700 1 -- 172.21.2.105:0/2875436967 >> 172.21.2.105:0/2875436967 conn(0x7faa6005c490 msgr2=0x7faa600608d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:24.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa66161700 1 -- 172.21.2.105:0/2875436967 shutdown_connections 2021-11-12T05:46:24.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa66161700 1 -- 172.21.2.105:0/2875436967 wait complete. 2021-11-12T05:46:24.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa66161700 1 Processor -- start 2021-11-12T05:46:24.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa66161700 1 -- start start 2021-11-12T05:46:24.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa66161700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7faa600b4500 0x7faa60155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:24.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa66161700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7faa600b5d00 0x7faa6013f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:24.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa66161700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faa600b97a0 0x7faa6013fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:24.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa66161700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa60155d80 con 0x7faa600b97a0 2021-11-12T05:46:24.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa66161700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa601401b0 con 0x7faa600b5d00 2021-11-12T05:46:24.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa66161700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa601531a0 con 0x7faa600b4500 2021-11-12T05:46:24.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa65960700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faa600b97a0 0x7faa6013fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:24.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa65960700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faa600b97a0 0x7faa6013fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47154/0 (socket says 172.21.2.105:47154) 2021-11-12T05:46:24.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa65960700 1 -- 172.21.2.105:0/3510551999 learned_addr learned my addr 172.21.2.105:0/3510551999 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:24.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa65960700 1 -- 172.21.2.105:0/3510551999 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7faa600b4500 msgr2=0x7faa60155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:24.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa65960700 1 --2- 172.21.2.105:0/3510551999 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7faa600b4500 0x7faa60155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:24.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa65960700 1 -- 172.21.2.105:0/3510551999 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7faa600b5d00 msgr2=0x7faa6013f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:24.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa65960700 1 --2- 172.21.2.105:0/3510551999 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7faa600b5d00 0x7faa6013f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:24.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa65960700 1 -- 172.21.2.105:0/3510551999 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa5000b180 con 0x7faa600b97a0 2021-11-12T05:46:24.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa65960700 1 --2- 172.21.2.105:0/3510551999 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faa600b97a0 0x7faa6013fcc0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7faa5800a000 tx=0x7faa58008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:24.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa4e7fc700 1 -- 172.21.2.105:0/3510551999 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa58013620 con 0x7faa600b97a0 2021-11-12T05:46:24.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa4e7fc700 1 -- 172.21.2.105:0/3510551999 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa58013780 con 0x7faa600b97a0 2021-11-12T05:46:24.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa66161700 1 -- 172.21.2.105:0/3510551999 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa60155fc0 con 0x7faa600b97a0 2021-11-12T05:46:24.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa4e7fc700 1 -- 172.21.2.105:0/3510551999 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa58013ae0 con 0x7faa600b97a0 2021-11-12T05:46:24.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa66161700 1 -- 172.21.2.105:0/3510551999 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa60145d00 con 0x7faa600b97a0 2021-11-12T05:46:24.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa66161700 1 -- 172.21.2.105:0/3510551999 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa600ad730 con 0x7faa600b97a0 2021-11-12T05:46:24.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa4e7fc700 1 -- 172.21.2.105:0/3510551999 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faa58013c40 con 0x7faa600b97a0 2021-11-12T05:46:24.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.852+0000 7faa4e7fc700 1 --2- 172.21.2.105:0/3510551999 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7faa40053610 0x7faa40055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:24.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.856+0000 7faa4e7fc700 1 -- 172.21.2.105:0/3510551999 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5682+0+0 (secure 0 0 0) 0x7faa5806b9f0 con 0x7faa600b97a0 2021-11-12T05:46:24.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.856+0000 7faa6515f700 1 --2- 172.21.2.105:0/3510551999 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7faa40053610 0x7faa40055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:24.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.856+0000 7faa6515f700 1 --2- 172.21.2.105:0/3510551999 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7faa40053610 0x7faa40055ad0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7faa50002f70 tx=0x7faa50014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:24.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.856+0000 7faa4e7fc700 1 -- 172.21.2.105:0/3510551999 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faa5806de60 con 0x7faa600b97a0 2021-11-12T05:46:24.969 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.964+0000 7faa66161700 1 -- 172.21.2.105:0/3510551999 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa600629b0 con 0x7faa600b97a0 2021-11-12T05:46:24.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.964+0000 7faa4e7fc700 1 -- 172.21.2.105:0/3510551999 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+1203 (secure 0 0 0) 0x7faa58042c70 con 0x7faa600b97a0 2021-11-12T05:46:24.970 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:46:24.970 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":28,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/37307717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":37307717},{"type":"v1","addr":"172.21.2.115:6833","nonce":37307717}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":23},{"gid":6210,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.105:6835/1568719690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":1568719690},{"type":"v1","addr":"172.21.2.105:6835","nonce":1568719690}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":28}],"filesystems":[]} 2021-11-12T05:46:24.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.968+0000 7faa66161700 1 -- 172.21.2.105:0/3510551999 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7faa40053610 msgr2=0x7faa40055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:24.972 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.968+0000 7faa66161700 1 --2- 172.21.2.105:0/3510551999 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7faa40053610 0x7faa40055ad0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7faa50002f70 tx=0x7faa50014000).stop 2021-11-12T05:46:24.972 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.968+0000 7faa66161700 1 -- 172.21.2.105:0/3510551999 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faa600b97a0 msgr2=0x7faa6013fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:24.972 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.968+0000 7faa66161700 1 --2- 172.21.2.105:0/3510551999 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faa600b97a0 0x7faa6013fcc0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7faa5800a000 tx=0x7faa58008040).stop 2021-11-12T05:46:24.972 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.968+0000 7faa66161700 1 -- 172.21.2.105:0/3510551999 shutdown_connections 2021-11-12T05:46:24.972 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.968+0000 7faa66161700 1 --2- 172.21.2.105:0/3510551999 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7faa40053610 0x7faa40055ad0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:24.973 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.968+0000 7faa66161700 1 --2- 172.21.2.105:0/3510551999 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faa600b97a0 0x7faa6013fcc0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:24.973 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.968+0000 7faa66161700 1 --2- 172.21.2.105:0/3510551999 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7faa600b5d00 0x7faa6013f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:24.973 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.968+0000 7faa66161700 1 --2- 172.21.2.105:0/3510551999 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7faa600b4500 0x7faa60155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:24.973 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.968+0000 7faa66161700 1 -- 172.21.2.105:0/3510551999 >> 172.21.2.105:0/3510551999 conn(0x7faa6005c490 msgr2=0x7faa600b2680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:24.973 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.968+0000 7faa66161700 1 -- 172.21.2.105:0/3510551999 shutdown_connections 2021-11-12T05:46:24.974 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:24.968+0000 7faa66161700 1 -- 172.21.2.105:0/3510551999 wait complete. 2021-11-12T05:46:24.974 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 28 2021-11-12T05:46:24.977 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:46:25.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.024+0000 7ff8007a1700 1 Processor -- start 2021-11-12T05:46:25.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.024+0000 7ff8007a1700 1 -- start start 2021-11-12T05:46:25.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.024+0000 7ff8007a1700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff7f805fdc0 0x7ff7f80601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:25.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.024+0000 7ff8007a1700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7ff7f813a9c0 0x7ff7f813ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:25.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.024+0000 7ff8007a1700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f8066150 con 0x7ff7f80ade80 2021-11-12T05:46:25.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.024+0000 7ff8007a1700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7f8141fb0 con 0x7ff7f805fdc0 2021-11-12T05:46:25.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.024+0000 7ff8007a1700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7f80663f0 con 0x7ff7f813a9c0 2021-11-12T05:46:25.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.024+0000 7ff7fdd3c700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7ff7f80ade80 0x7ff7f8066730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57560/0 (socket says 172.21.2.105:57560) 2021-11-12T05:46:25.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.024+0000 7ff7fdd3c700 1 -- 172.21.2.105:0/2186896792 learned_addr learned my addr 172.21.2.105:0/2186896792 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:46:25.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.024+0000 7ff7fe53d700 1 --2- 172.21.2.105:0/2186896792 >> v2:172.21.2.105:3300/0 conn(0x7ff7f805fdc0 0x7ff7f80601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:25.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.024+0000 7ff7fe53d700 1 -- 172.21.2.105:0/2186896792 >> v2:172.21.2.115:3300/0 conn(0x7ff7f813a9c0 msgr2=0x7ff7f813ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:25.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.024+0000 7ff7fe53d700 1 --2- 172.21.2.105:0/2186896792 >> v2:172.21.2.115:3300/0 conn(0x7ff7f813a9c0 0x7ff7f813ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:25.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.024+0000 7ff7fe53d700 1 -- 172.21.2.105:0/2186896792 >> v1:172.21.2.105:6789/0 conn(0x7ff7f80ade80 legacy=0x7ff7f8066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:25.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.024+0000 7ff7fe53d700 1 -- 172.21.2.105:0/2186896792 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f8140fd0 con 0x7ff7f805fdc0 2021-11-12T05:46:25.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.024+0000 7ff7fe53d700 1 --2- 172.21.2.105:0/2186896792 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff7f805fdc0 0x7ff7f80601a0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7ff7f4002f70 tx=0x7ff7f4006df0).ready entity=mon.0 client_cookie=f69ec0ab867f432e server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:25.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.024+0000 7ff7fd53b700 1 -- 172.21.2.105:0/2186896792 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7f400d5c0 con 0x7ff7f805fdc0 2021-11-12T05:46:25.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.024+0000 7ff7fd53b700 1 -- 172.21.2.105:0/2186896792 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f4000e90 con 0x7ff7f805fdc0 2021-11-12T05:46:25.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.024+0000 7ff7fd53b700 1 -- 172.21.2.105:0/2186896792 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7f400d910 con 0x7ff7f805fdc0 2021-11-12T05:46:25.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.024+0000 7ff8007a1700 1 -- 172.21.2.105:0/2186896792 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff7f805fdc0 msgr2=0x7ff7f80601a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:25.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.024+0000 7ff8007a1700 1 --2- 172.21.2.105:0/2186896792 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff7f805fdc0 0x7ff7f80601a0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7ff7f4002f70 tx=0x7ff7f4006df0).stop 2021-11-12T05:46:25.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.024+0000 7ff8007a1700 1 -- 172.21.2.105:0/2186896792 shutdown_connections 2021-11-12T05:46:25.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.024+0000 7ff8007a1700 1 --2- 172.21.2.105:0/2186896792 >> v2:172.21.2.115:3300/0 conn(0x7ff7f813a9c0 0x7ff7f813ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:25.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.024+0000 7ff8007a1700 1 --2- 172.21.2.105:0/2186896792 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff7f805fdc0 0x7ff7f80601a0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:25.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.024+0000 7ff8007a1700 1 -- 172.21.2.105:0/2186896792 >> 172.21.2.105:0/2186896792 conn(0x7ff7f80608d0 msgr2=0x7ff7f805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:25.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.024+0000 7ff8007a1700 1 -- 172.21.2.105:0/2186896792 shutdown_connections 2021-11-12T05:46:25.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.024+0000 7ff8007a1700 1 -- 172.21.2.105:0/2186896792 wait complete. 2021-11-12T05:46:25.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.028+0000 7ff8007a1700 1 Processor -- start 2021-11-12T05:46:25.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.028+0000 7ff8007a1700 1 -- start start 2021-11-12T05:46:25.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.028+0000 7ff8007a1700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff7f805fdc0 0x7ff7f80afd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:25.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.028+0000 7ff8007a1700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff7f80ade80 0x7ff7f813fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:25.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.028+0000 7ff8007a1700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff7f813a9c0 0x7ff7f80b7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:25.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.028+0000 7ff8007a1700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f812fb80 con 0x7ff7f805fdc0 2021-11-12T05:46:25.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.028+0000 7ff8007a1700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f80b0e60 con 0x7ff7f813a9c0 2021-11-12T05:46:25.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.028+0000 7ff8007a1700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f80b0720 con 0x7ff7f80ade80 2021-11-12T05:46:25.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.028+0000 7ff7fe53d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff7f805fdc0 0x7ff7f80afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:25.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.028+0000 7ff7fe53d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff7f805fdc0 0x7ff7f80afd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47166/0 (socket says 172.21.2.105:47166) 2021-11-12T05:46:25.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.028+0000 7ff7fe53d700 1 -- 172.21.2.105:0/3468688440 learned_addr learned my addr 172.21.2.105:0/3468688440 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:25.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.028+0000 7ff7fe53d700 1 -- 172.21.2.105:0/3468688440 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff7f80ade80 msgr2=0x7ff7f813fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:25.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.028+0000 7ff7fe53d700 1 --2- 172.21.2.105:0/3468688440 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff7f80ade80 0x7ff7f813fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:25.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.028+0000 7ff7fe53d700 1 -- 172.21.2.105:0/3468688440 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff7f813a9c0 msgr2=0x7ff7f80b7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:25.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.028+0000 7ff7fe53d700 1 --2- 172.21.2.105:0/3468688440 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff7f813a9c0 0x7ff7f80b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:25.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.028+0000 7ff7fe53d700 1 -- 172.21.2.105:0/3468688440 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f400b180 con 0x7ff7f805fdc0 2021-11-12T05:46:25.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.028+0000 7ff7fe53d700 1 --2- 172.21.2.105:0/3468688440 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff7f805fdc0 0x7ff7f80afd60 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7ff7f4002f70 tx=0x7ff7f4014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:25.042 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.028+0000 7ff7e77fe700 1 -- 172.21.2.105:0/3468688440 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7f401e400 con 0x7ff7f805fdc0 2021-11-12T05:46:25.042 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.028+0000 7ff7e77fe700 1 -- 172.21.2.105:0/3468688440 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f401e560 con 0x7ff7f805fdc0 2021-11-12T05:46:25.042 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.028+0000 7ff8007a1700 1 -- 172.21.2.105:0/3468688440 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f812fd80 con 0x7ff7f805fdc0 2021-11-12T05:46:25.042 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.028+0000 7ff8007a1700 1 -- 172.21.2.105:0/3468688440 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f80b8270 con 0x7ff7f805fdc0 2021-11-12T05:46:25.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.028+0000 7ff7e77fe700 1 -- 172.21.2.105:0/3468688440 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7f401e8c0 con 0x7ff7f805fdc0 2021-11-12T05:46:25.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.028+0000 7ff8007a1700 1 -- 172.21.2.105:0/3468688440 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7f80b08e0 con 0x7ff7f805fdc0 2021-11-12T05:46:25.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.028+0000 7ff7e77fe700 1 -- 172.21.2.105:0/3468688440 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff7f4025030 con 0x7ff7f805fdc0 2021-11-12T05:46:25.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.028+0000 7ff7e77fe700 1 --2- 172.21.2.105:0/3468688440 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff7d80536a0 0x7ff7d8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:25.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.028+0000 7ff7e77fe700 1 -- 172.21.2.105:0/3468688440 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5682+0+0 (secure 0 0 0) 0x7ff7f406c880 con 0x7ff7f805fdc0 2021-11-12T05:46:25.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.028+0000 7ff7fdd3c700 1 --2- 172.21.2.105:0/3468688440 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff7d80536a0 0x7ff7d8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:25.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.028+0000 7ff7fdd3c700 1 --2- 172.21.2.105:0/3468688440 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff7d80536a0 0x7ff7d8055b60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7ff7f8060e00 tx=0x7ff7e8007800).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:25.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.032+0000 7ff7e77fe700 1 -- 172.21.2.105:0/3468688440 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff7f4043a90 con 0x7ff7f805fdc0 2021-11-12T05:46:25.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.140+0000 7ff8007a1700 1 -- 172.21.2.105:0/3468688440 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7f8057350 con 0x7ff7f805fdc0 2021-11-12T05:46:25.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.140+0000 7ff7e77fe700 1 -- 172.21.2.105:0/3468688440 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+1203 (secure 0 0 0) 0x7ff7f4023090 con 0x7ff7f805fdc0 2021-11-12T05:46:25.145 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:46:25.145 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":28,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/37307717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":37307717},{"type":"v1","addr":"172.21.2.115:6833","nonce":37307717}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":23},{"gid":6210,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.105:6835/1568719690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":1568719690},{"type":"v1","addr":"172.21.2.105:6835","nonce":1568719690}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":28}],"filesystems":[]} 2021-11-12T05:46:25.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.140+0000 7ff8007a1700 1 -- 172.21.2.105:0/3468688440 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff7d80536a0 msgr2=0x7ff7d8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:25.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.140+0000 7ff8007a1700 1 --2- 172.21.2.105:0/3468688440 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff7d80536a0 0x7ff7d8055b60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7ff7f8060e00 tx=0x7ff7e8007800).stop 2021-11-12T05:46:25.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.140+0000 7ff8007a1700 1 -- 172.21.2.105:0/3468688440 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff7f805fdc0 msgr2=0x7ff7f80afd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:25.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.140+0000 7ff8007a1700 1 --2- 172.21.2.105:0/3468688440 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff7f805fdc0 0x7ff7f80afd60 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7ff7f4002f70 tx=0x7ff7f4014000).stop 2021-11-12T05:46:25.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.140+0000 7ff8007a1700 1 -- 172.21.2.105:0/3468688440 shutdown_connections 2021-11-12T05:46:25.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.140+0000 7ff8007a1700 1 --2- 172.21.2.105:0/3468688440 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff7d80536a0 0x7ff7d8055b60 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:25.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.140+0000 7ff8007a1700 1 --2- 172.21.2.105:0/3468688440 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff7f813a9c0 0x7ff7f80b7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:25.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.140+0000 7ff8007a1700 1 --2- 172.21.2.105:0/3468688440 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff7f80ade80 0x7ff7f813fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:25.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.140+0000 7ff8007a1700 1 --2- 172.21.2.105:0/3468688440 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff7f805fdc0 0x7ff7f80afd60 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:25.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.140+0000 7ff8007a1700 1 -- 172.21.2.105:0/3468688440 >> 172.21.2.105:0/3468688440 conn(0x7ff7f80608d0 msgr2=0x7ff7f8066730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:25.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.140+0000 7ff8007a1700 1 -- 172.21.2.105:0/3468688440 shutdown_connections 2021-11-12T05:46:25.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.140+0000 7ff8007a1700 1 -- 172.21.2.105:0/3468688440 wait complete. 2021-11-12T05:46:25.149 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 28 2021-11-12T05:46:25.152 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-12T05:46:25.152 INFO:tasks.ceph.mds.a:Stopping old one... 2021-11-12T05:46:25.153 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-12T05:46:25.153 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T05:46:25.153 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-12T05:46:25.154 INFO:tasks.ceph.mds.b:Stopping old one... 2021-11-12T05:46:25.154 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-12T05:46:25.154 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T05:46:25.158 INFO:tasks.ceph.mds.a:Stopped 2021-11-12T05:46:25.159 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-12T05:46:25.160 INFO:tasks.ceph.mds.b:Stopped 2021-11-12T05:46:25.160 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-12T05:46:25.162 INFO:tasks.ceph.mds.a:Started 2021-11-12T05:46:25.162 DEBUG:teuthology.parallel:result is None 2021-11-12T05:46:25.163 INFO:tasks.ceph.mds.b:Started 2021-11-12T05:46:25.163 DEBUG:teuthology.parallel:result is None 2021-11-12T05:46:25.164 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-11-12T05:46:25.195 INFO:tasks.ceph.mds.a.gibba005.stdout:starting mds.a at 2021-11-12T05:46:25.197 INFO:tasks.ceph.mds.b.gibba015.stdout:starting mds.b at 2021-11-12T05:46:25.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e14135700 1 Processor -- start 2021-11-12T05:46:25.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e14135700 1 -- start start 2021-11-12T05:46:25.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e14135700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f7e0c0b37d0 0x7f7e0c141500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:25.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e14135700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e0c0b26e0 con 0x7f7e0c060100 2021-11-12T05:46:25.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e14135700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e0c0604e0 con 0x7f7e0c1419f0 2021-11-12T05:46:25.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e14135700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e0c145160 con 0x7f7e0c0b37d0 2021-11-12T05:46:25.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e11ed1700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f7e0c060100 0x7f7e0c0b1fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57582/0 (socket says 172.21.2.105:57582) 2021-11-12T05:46:25.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e11ed1700 1 -- 172.21.2.105:0/2239213689 learned_addr learned my addr 172.21.2.105:0/2239213689 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:46:25.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e10ecf700 1 -- 172.21.2.105:0/2239213689 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3628066851 0 0) 0x7f7e0c0b26e0 con 0x7f7e0c060100 2021-11-12T05:46:25.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e10ecf700 1 -- 172.21.2.105:0/2239213689 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7df4003260 con 0x7f7e0c060100 2021-11-12T05:46:25.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e116d0700 1 --2- 172.21.2.105:0/2239213689 >> v2:172.21.2.115:3300/0 conn(0x7f7e0c0b37d0 0x7f7e0c141500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:25.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e10ecf700 1 -- 172.21.2.105:0/2239213689 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1862421171 0 0) 0x7f7df4003260 con 0x7f7e0c060100 2021-11-12T05:46:25.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e10ecf700 1 -- 172.21.2.105:0/2239213689 >> v2:172.21.2.115:3300/0 conn(0x7f7e0c0b37d0 msgr2=0x7f7e0c141500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:25.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e10ecf700 1 --2- 172.21.2.105:0/2239213689 >> v2:172.21.2.115:3300/0 conn(0x7f7e0c0b37d0 0x7f7e0c141500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:25.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e10ecf700 1 -- 172.21.2.105:0/2239213689 >> v1:172.21.2.115:6789/0 conn(0x7f7e0c1419f0 legacy=0x7f7e0c0b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:25.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e10ecf700 1 -- 172.21.2.105:0/2239213689 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0c141060 con 0x7f7e0c060100 2021-11-12T05:46:25.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e10ecf700 1 -- 172.21.2.105:0/2239213689 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f7e08001660 con 0x7f7e0c060100 2021-11-12T05:46:25.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e10ecf700 1 -- 172.21.2.105:0/2239213689 >> v1:172.21.2.105:6789/0 conn(0x7f7e0c060100 legacy=0x7f7e0c0b1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:25.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e10ecf700 1 --2- 172.21.2.105:0/2239213689 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7df4003800 0x7f7df4003c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:25.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e10ecf700 1 --2- 172.21.2.105:0/2239213689 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7df4004500 0x7f7df4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:25.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e10ecf700 1 --2- 172.21.2.105:0/2239213689 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7df4004f90 0x7f7df400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:25.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e10ecf700 1 -- 172.21.2.105:0/2239213689 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c145160 con 0x7f7df4003800 2021-11-12T05:46:25.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e10ecf700 1 -- 172.21.2.105:0/2239213689 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df4010240 con 0x7f7df4004500 2021-11-12T05:46:25.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e10ecf700 1 -- 172.21.2.105:0/2239213689 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df4010400 con 0x7f7df4004f90 2021-11-12T05:46:25.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e11ed1700 1 --2- 172.21.2.105:0/2239213689 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7df4003800 0x7f7df4003c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:25.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e11ed1700 1 -- 172.21.2.105:0/2239213689 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7df4004f90 msgr2=0x7f7df400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:25.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e11ed1700 1 --2- 172.21.2.105:0/2239213689 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7df4004f90 0x7f7df400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:25.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e11ed1700 1 -- 172.21.2.105:0/2239213689 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7df4004500 msgr2=0x7f7df4004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:25.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e11ed1700 1 --2- 172.21.2.105:0/2239213689 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7df4004500 0x7f7df4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:25.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e11ed1700 1 -- 172.21.2.105:0/2239213689 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0c141060 con 0x7f7df4003800 2021-11-12T05:46:25.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e126d2700 1 -- 172.21.2.105:0/2239213689 reap_dead start 2021-11-12T05:46:25.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e11ed1700 1 --2- 172.21.2.105:0/2239213689 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7df4003800 0x7f7df4003c00 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7f7e08001020 tx=0x7f7e08001e20).ready entity=mon.0 client_cookie=25f14b97f16f4c28 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:25.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e10ecf700 1 -- 172.21.2.105:0/2239213689 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e080070d0 con 0x7f7df4003800 2021-11-12T05:46:25.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e10ecf700 1 -- 172.21.2.105:0/2239213689 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e08007230 con 0x7f7df4003800 2021-11-12T05:46:25.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e10ecf700 1 -- 172.21.2.105:0/2239213689 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e0800c9c0 con 0x7f7df4003800 2021-11-12T05:46:25.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e14135700 1 -- 172.21.2.105:0/2239213689 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7df4003800 msgr2=0x7f7df4003c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:25.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e14135700 1 --2- 172.21.2.105:0/2239213689 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7df4003800 0x7f7df4003c00 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7f7e08001020 tx=0x7f7e08001e20).stop 2021-11-12T05:46:25.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e14135700 1 -- 172.21.2.105:0/2239213689 shutdown_connections 2021-11-12T05:46:25.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e14135700 1 --2- 172.21.2.105:0/2239213689 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7df4003800 0x7f7df4003c00 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:25.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e14135700 1 -- 172.21.2.105:0/2239213689 >> 172.21.2.105:0/2239213689 conn(0x7f7e0c0608d0 msgr2=0x7f7e0c05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:25.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e14135700 1 -- 172.21.2.105:0/2239213689 shutdown_connections 2021-11-12T05:46:25.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.212+0000 7f7e14135700 1 -- 172.21.2.105:0/2239213689 wait complete. 2021-11-12T05:46:25.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.216+0000 7f7e14135700 1 Processor -- start 2021-11-12T05:46:25.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.216+0000 7f7e14135700 1 -- start start 2021-11-12T05:46:25.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.216+0000 7f7e14135700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7df4003800 0x7f7e0c127aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:25.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.216+0000 7f7e14135700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7e0c143d30 0x7f7e0c0b0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:25.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.216+0000 7f7e14135700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7e0c144360 0x7f7e0c1570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:25.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.216+0000 7f7e14135700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c156790 con 0x7f7e0c143d30 2021-11-12T05:46:25.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.216+0000 7f7e14135700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c128710 con 0x7f7e0c144360 2021-11-12T05:46:25.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.216+0000 7f7e14135700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c156980 con 0x7f7df4003800 2021-11-12T05:46:25.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.216+0000 7f7e116d0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7e0c143d30 0x7f7e0c0b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:25.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.216+0000 7f7e116d0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7e0c143d30 0x7f7e0c0b0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47200/0 (socket says 172.21.2.105:47200) 2021-11-12T05:46:25.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.216+0000 7f7e116d0700 1 -- 172.21.2.105:0/1000170202 learned_addr learned my addr 172.21.2.105:0/1000170202 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:25.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.216+0000 7f7e11ed1700 1 --2- 172.21.2.105:0/1000170202 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7df4003800 0x7f7e0c127aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:25.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.216+0000 7f7e116d0700 1 -- 172.21.2.105:0/1000170202 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7df4003800 msgr2=0x7f7e0c127aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:25.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.216+0000 7f7e116d0700 1 --2- 172.21.2.105:0/1000170202 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7df4003800 0x7f7e0c127aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:25.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.216+0000 7f7e116d0700 1 -- 172.21.2.105:0/1000170202 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7e0c144360 msgr2=0x7f7e0c1570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:25.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.216+0000 7f7e116d0700 1 --2- 172.21.2.105:0/1000170202 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7e0c144360 0x7f7e0c1570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:25.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.216+0000 7f7e116d0700 1 -- 172.21.2.105:0/1000170202 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0c156c20 con 0x7f7e0c143d30 2021-11-12T05:46:25.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.216+0000 7f7e116d0700 1 --2- 172.21.2.105:0/1000170202 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7e0c143d30 0x7f7e0c0b0100 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7f7e0000a000 tx=0x7f7e00008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:25.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.216+0000 7f7dfeffd700 1 -- 172.21.2.105:0/1000170202 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e00016070 con 0x7f7e0c143d30 2021-11-12T05:46:25.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.216+0000 7f7dfeffd700 1 -- 172.21.2.105:0/1000170202 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e00000e90 con 0x7f7e0c143d30 2021-11-12T05:46:25.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.216+0000 7f7e14135700 1 -- 172.21.2.105:0/1000170202 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e0c0b05f0 con 0x7f7e0c143d30 2021-11-12T05:46:25.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.216+0000 7f7dfeffd700 1 -- 172.21.2.105:0/1000170202 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e00011a40 con 0x7f7e0c143d30 2021-11-12T05:46:25.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.216+0000 7f7e14135700 1 -- 172.21.2.105:0/1000170202 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e0c157750 con 0x7f7e0c143d30 2021-11-12T05:46:25.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.216+0000 7f7e14135700 1 -- 172.21.2.105:0/1000170202 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e0c156de0 con 0x7f7e0c143d30 2021-11-12T05:46:25.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.216+0000 7f7dfeffd700 1 -- 172.21.2.105:0/1000170202 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7e00011ba0 con 0x7f7e0c143d30 2021-11-12T05:46:25.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.216+0000 7f7dfeffd700 1 --2- 172.21.2.105:0/1000170202 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7dec0536d0 0x7f7dec055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:25.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.216+0000 7f7dfeffd700 1 -- 172.21.2.105:0/1000170202 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f7e0006b460 con 0x7f7e0c143d30 2021-11-12T05:46:25.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.216+0000 7f7e11ed1700 1 --2- 172.21.2.105:0/1000170202 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7dec0536d0 0x7f7dec055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:25.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.216+0000 7f7e11ed1700 1 --2- 172.21.2.105:0/1000170202 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7dec0536d0 0x7f7dec055b90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f7e08006000 tx=0x7f7e08015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:25.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.220+0000 7f7dfeffd700 1 -- 172.21.2.105:0/1000170202 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7e00042740 con 0x7f7e0c143d30 2021-11-12T05:46:25.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:25.312+0000 7f7e14135700 1 -- 172.21.2.105:0/1000170202 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f7e0c141e80 con 0x7f7e0c143d30 2021-11-12T05:46:26.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.232+0000 7f7dfeffd700 1 -- 172.21.2.105:0/1000170202 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v70) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7e00045d60 con 0x7f7e0c143d30 2021-11-12T05:46:26.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.236+0000 7f7e14135700 1 -- 172.21.2.105:0/1000170202 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7dec0536d0 msgr2=0x7f7dec055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:26.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.236+0000 7f7e14135700 1 --2- 172.21.2.105:0/1000170202 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7dec0536d0 0x7f7dec055b90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f7e08006000 tx=0x7f7e08015000).stop 2021-11-12T05:46:26.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.236+0000 7f7e14135700 1 -- 172.21.2.105:0/1000170202 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7e0c143d30 msgr2=0x7f7e0c0b0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:26.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.236+0000 7f7e14135700 1 --2- 172.21.2.105:0/1000170202 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7e0c143d30 0x7f7e0c0b0100 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7f7e0000a000 tx=0x7f7e00008040).stop 2021-11-12T05:46:26.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.236+0000 7f7e14135700 1 -- 172.21.2.105:0/1000170202 shutdown_connections 2021-11-12T05:46:26.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.236+0000 7f7e14135700 1 --2- 172.21.2.105:0/1000170202 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7dec0536d0 0x7f7dec055b90 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:26.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.236+0000 7f7e14135700 1 --2- 172.21.2.105:0/1000170202 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7e0c144360 0x7f7e0c1570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:26.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.236+0000 7f7e14135700 1 --2- 172.21.2.105:0/1000170202 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7e0c143d30 0x7f7e0c0b0100 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:26.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.236+0000 7f7e14135700 1 --2- 172.21.2.105:0/1000170202 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7df4003800 0x7f7e0c127aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:26.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.236+0000 7f7e14135700 1 -- 172.21.2.105:0/1000170202 >> 172.21.2.105:0/1000170202 conn(0x7f7e0c0608d0 msgr2=0x7f7e0c05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:26.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.236+0000 7f7e14135700 1 -- 172.21.2.105:0/1000170202 shutdown_connections 2021-11-12T05:46:26.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.236+0000 7f7e14135700 1 -- 172.21.2.105:0/1000170202 wait complete. 2021-11-12T05:46:26.245 INFO:teuthology.orchestra.run.gibba005.stderr: removed all blacklist entries 2021-11-12T05:46:26.251 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-11-12T05:46:26.252 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-11-12T05:46:26.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.344+0000 7fcb3dc0a700 1 Processor -- start 2021-11-12T05:46:26.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.344+0000 7fcb3dc0a700 1 -- start start 2021-11-12T05:46:26.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.344+0000 7fcb3dc0a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcb380626b0 0x7fcb38062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:26.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.344+0000 7fcb3dc0a700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fcb380af750 0x7fcb38130370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:26.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.344+0000 7fcb3dc0a700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb38130cf0 con 0x7fcb38130860 2021-11-12T05:46:26.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.344+0000 7fcb3dc0a700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb380b0d50 con 0x7fcb380af750 2021-11-12T05:46:26.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.344+0000 7fcb3dc0a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb380ad380 con 0x7fcb380626b0 2021-11-12T05:46:26.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.344+0000 7fcb377fe700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcb380626b0 0x7fcb38062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:26.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.344+0000 7fcb377fe700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcb380626b0 0x7fcb38062a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3301/0 says I am v2:172.21.2.105:38398/0 (socket says 172.21.2.105:38398) 2021-11-12T05:46:26.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.344+0000 7fcb377fe700 1 -- 172.21.2.105:0/306816744 learned_addr learned my addr 172.21.2.105:0/306816744 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:26.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.344+0000 7fcb36ffd700 1 --2- 172.21.2.105:0/306816744 >> v2:172.21.2.115:3300/0 conn(0x7fcb380af750 0x7fcb38130370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:26.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.348+0000 7fcb377fe700 1 -- 172.21.2.105:0/306816744 >> v2:172.21.2.115:3300/0 conn(0x7fcb380af750 msgr2=0x7fcb38130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:26.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.348+0000 7fcb377fe700 1 --2- 172.21.2.105:0/306816744 >> v2:172.21.2.115:3300/0 conn(0x7fcb380af750 0x7fcb38130370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:26.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.348+0000 7fcb377fe700 1 -- 172.21.2.105:0/306816744 >> v1:172.21.2.115:6789/0 conn(0x7fcb38130860 legacy=0x7fcb3814a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:26.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.348+0000 7fcb377fe700 1 -- 172.21.2.105:0/306816744 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb380ae190 con 0x7fcb380626b0 2021-11-12T05:46:26.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.348+0000 7fcb377fe700 1 --2- 172.21.2.105:0/306816744 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcb380626b0 0x7fcb38062a90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fcb20002f70 tx=0x7fcb20006eb0).ready entity=mon.2 client_cookie=c9474927290d7939 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:26.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.348+0000 7fcb367fc700 1 -- 172.21.2.105:0/306816744 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb2000d570 con 0x7fcb380626b0 2021-11-12T05:46:26.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.348+0000 7fcb367fc700 1 -- 172.21.2.105:0/306816744 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb20000e90 con 0x7fcb380626b0 2021-11-12T05:46:26.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.348+0000 7fcb367fc700 1 -- 172.21.2.105:0/306816744 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb2000d900 con 0x7fcb380626b0 2021-11-12T05:46:26.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.348+0000 7fcb3dc0a700 1 -- 172.21.2.105:0/306816744 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcb380626b0 msgr2=0x7fcb38062a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:26.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.348+0000 7fcb3dc0a700 1 --2- 172.21.2.105:0/306816744 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcb380626b0 0x7fcb38062a90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fcb20002f70 tx=0x7fcb20006eb0).stop 2021-11-12T05:46:26.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.348+0000 7fcb3dc0a700 1 -- 172.21.2.105:0/306816744 shutdown_connections 2021-11-12T05:46:26.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.348+0000 7fcb3dc0a700 1 --2- 172.21.2.105:0/306816744 >> v2:172.21.2.115:3300/0 conn(0x7fcb380af750 0x7fcb38130370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:26.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.348+0000 7fcb3dc0a700 1 --2- 172.21.2.105:0/306816744 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcb380626b0 0x7fcb38062a90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:26.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.348+0000 7fcb3dc0a700 1 -- 172.21.2.105:0/306816744 >> 172.21.2.105:0/306816744 conn(0x7fcb380b5320 msgr2=0x7fcb380b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:26.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.348+0000 7fcb3dc0a700 1 -- 172.21.2.105:0/306816744 shutdown_connections 2021-11-12T05:46:26.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.348+0000 7fcb3dc0a700 1 -- 172.21.2.105:0/306816744 wait complete. 2021-11-12T05:46:26.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.348+0000 7fcb3dc0a700 1 Processor -- start 2021-11-12T05:46:26.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.348+0000 7fcb3dc0a700 1 -- start start 2021-11-12T05:46:26.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.348+0000 7fcb3dc0a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcb380626b0 0x7fcb38065f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:26.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.348+0000 7fcb3dc0a700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcb380af750 0x7fcb3815a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:26.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.348+0000 7fcb3dc0a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcb38130860 0x7fcb38156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:26.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.348+0000 7fcb3dc0a700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb38066af0 con 0x7fcb38130860 2021-11-12T05:46:26.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.348+0000 7fcb3dc0a700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3815ac80 con 0x7fcb380af750 2021-11-12T05:46:26.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.348+0000 7fcb3dc0a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb380665b0 con 0x7fcb380626b0 2021-11-12T05:46:26.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.348+0000 7fcb37fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcb38130860 0x7fcb38156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:26.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.348+0000 7fcb37fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcb38130860 0x7fcb38156820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47214/0 (socket says 172.21.2.105:47214) 2021-11-12T05:46:26.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.348+0000 7fcb37fff700 1 -- 172.21.2.105:0/2038704392 learned_addr learned my addr 172.21.2.105:0/2038704392 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:26.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.348+0000 7fcb37fff700 1 -- 172.21.2.105:0/2038704392 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcb380626b0 msgr2=0x7fcb38065f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:26.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.348+0000 7fcb37fff700 1 --2- 172.21.2.105:0/2038704392 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcb380626b0 0x7fcb38065f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:26.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.348+0000 7fcb37fff700 1 -- 172.21.2.105:0/2038704392 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcb380af750 msgr2=0x7fcb3815a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:26.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.348+0000 7fcb37fff700 1 --2- 172.21.2.105:0/2038704392 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcb380af750 0x7fcb3815a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:26.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.348+0000 7fcb37fff700 1 -- 172.21.2.105:0/2038704392 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb2000b1e0 con 0x7fcb38130860 2021-11-12T05:46:26.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.352+0000 7fcb37fff700 1 --2- 172.21.2.105:0/2038704392 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcb38130860 0x7fcb38156820 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7fcb3805d1b0 tx=0x7fcb30007f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:26.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.352+0000 7fcb34ff9700 1 -- 172.21.2.105:0/2038704392 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb3000f470 con 0x7fcb38130860 2021-11-12T05:46:26.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.352+0000 7fcb34ff9700 1 -- 172.21.2.105:0/2038704392 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3000f5d0 con 0x7fcb38130860 2021-11-12T05:46:26.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.352+0000 7fcb34ff9700 1 -- 172.21.2.105:0/2038704392 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb3000f930 con 0x7fcb38130860 2021-11-12T05:46:26.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.352+0000 7fcb3dc0a700 1 -- 172.21.2.105:0/2038704392 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb38066850 con 0x7fcb38130860 2021-11-12T05:46:26.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.352+0000 7fcb3dc0a700 1 -- 172.21.2.105:0/2038704392 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb3814ef60 con 0x7fcb38130860 2021-11-12T05:46:26.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.352+0000 7fcb3dc0a700 1 -- 172.21.2.105:0/2038704392 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb38057350 con 0x7fcb38130860 2021-11-12T05:46:26.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.352+0000 7fcb34ff9700 1 -- 172.21.2.105:0/2038704392 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcb30019030 con 0x7fcb38130860 2021-11-12T05:46:26.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.352+0000 7fcb34ff9700 1 --2- 172.21.2.105:0/2038704392 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcb1c0536a0 0x7fcb1c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:26.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.352+0000 7fcb34ff9700 1 -- 172.21.2.105:0/2038704392 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fcb3006ae90 con 0x7fcb38130860 2021-11-12T05:46:26.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.352+0000 7fcb377fe700 1 --2- 172.21.2.105:0/2038704392 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcb1c0536a0 0x7fcb1c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:26.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.352+0000 7fcb377fe700 1 --2- 172.21.2.105:0/2038704392 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcb1c0536a0 0x7fcb1c055b60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7fcb20002f70 tx=0x7fcb20015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:26.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.352+0000 7fcb34ff9700 1 -- 172.21.2.105:0/2038704392 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcb300420c0 con 0x7fcb38130860 2021-11-12T05:46:26.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.464+0000 7fcb3dc0a700 1 -- 172.21.2.105:0/2038704392 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fcb3814e9c0 con 0x7fcb38130860 2021-11-12T05:46:26.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.464+0000 7fcb34ff9700 1 -- 172.21.2.105:0/2038704392 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v24) v1 ==== 80+0+4242 (secure 0 0 0) 0x7fcb300456e0 con 0x7fcb38130860 2021-11-12T05:46:26.471 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:46:26.471 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:46:26.471 INFO:teuthology.orchestra.run.gibba005.stdout: "auth_dump": [ 2021-11-12T05:46:26.471 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:26.472 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mds.a", 2021-11-12T05:46:26.472 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1hGVLeOhAAX2029T+USC1Um93TSzjxdA==", 2021-11-12T05:46:26.472 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:46:26.472 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:46:26.472 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:46:26.473 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:46:26.473 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:46:26.473 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:26.473 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:26.474 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:26.474 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mds.b", 2021-11-12T05:46:26.474 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hiebUAxAAGcjDAGyvecjzagGoRBX8tg==", 2021-11-12T05:46:26.474 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:46:26.474 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:46:26.475 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:46:26.475 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:46:26.475 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:46:26.475 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:26.476 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:26.476 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:26.476 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.0", 2021-11-12T05:46:26.476 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1ht05fORAAN2YrbsxBau1FQC4C8Dvb3g==", 2021-11-12T05:46:26.476 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:46:26.477 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:46:26.477 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:46:26.477 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:46:26.477 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:26.478 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:26.478 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:26.478 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.1", 2021-11-12T05:46:26.479 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAu/o1hzp1vGhAAQ6u3Npb+yNGlNOUdoHzFZA==", 2021-11-12T05:46:26.479 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:46:26.479 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:46:26.479 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:46:26.480 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:46:26.480 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:26.480 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:26.480 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:26.480 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.2", 2021-11-12T05:46:26.481 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAw/o1hHWwOOhAAx7txWG8rbch18+SBnJkfkQ==", 2021-11-12T05:46:26.481 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:46:26.481 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:46:26.481 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:46:26.481 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:46:26.482 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:26.482 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:26.482 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:26.482 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.3", 2021-11-12T05:46:26.482 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAz/o1howZpHxAAKgUVxU2tSNZbxW+6OfJF9g==", 2021-11-12T05:46:26.483 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:46:26.483 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:46:26.483 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:46:26.483 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:46:26.483 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:26.485 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:26.485 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:26.485 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.4", 2021-11-12T05:46:26.485 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA2/o1humA5KRAAVbO6UYLOBQDq3WiEkkS6xw==", 2021-11-12T05:46:26.486 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:46:26.486 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:46:26.486 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:46:26.486 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:46:26.487 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:26.487 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:26.487 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:26.487 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.5", 2021-11-12T05:46:26.488 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA5/o1hALdKDRAAR9nsaDOo9GUgpmBPHVp5HQ==", 2021-11-12T05:46:26.488 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:46:26.488 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:46:26.488 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:46:26.488 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:46:26.489 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:26.489 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:26.489 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:26.489 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.6", 2021-11-12T05:46:26.489 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA7/o1hCVP2KhAAHj5SxnJ81mKrJOg2CE2wLQ==", 2021-11-12T05:46:26.490 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:46:26.490 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:46:26.490 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:46:26.490 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:46:26.491 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:26.491 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:26.491 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:26.491 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.7", 2021-11-12T05:46:26.492 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA+/o1hWCEqEBAAv8nF9NeF2Ue5W8Ijj8Skgg==", 2021-11-12T05:46:26.492 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:46:26.492 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:46:26.492 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:46:26.492 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:46:26.493 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:26.493 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:26.493 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:26.493 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.0", 2021-11-12T05:46:26.494 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hzEzhCBAATF8giEBtrj13SAr5EJV4TA==", 2021-11-12T05:46:26.494 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:46:26.494 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:46:26.494 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow r", 2021-11-12T05:46:26.494 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-12T05:46:26.495 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:26.495 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:26.495 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:26.495 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.1", 2021-11-12T05:46:26.496 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hO6zfCxAAae1obagtpsnA9e8FlTExVA==", 2021-11-12T05:46:26.496 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:46:26.496 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:46:26.496 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow r", 2021-11-12T05:46:26.496 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-12T05:46:26.497 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:26.497 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:26.497 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:26.497 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.2", 2021-11-12T05:46:26.497 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hFYDGDhAAyz77VXKtOz86ztJ8FUIvAg==", 2021-11-12T05:46:26.498 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:46:26.498 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:46:26.498 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow r", 2021-11-12T05:46:26.498 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-12T05:46:26.498 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:26.499 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:26.499 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:26.499 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.admin", 2021-11-12T05:46:26.499 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1hwdoBHRAAUHHEU3dbyso2BnE/JppV8A==", 2021-11-12T05:46:26.500 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:46:26.500 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow *", 2021-11-12T05:46:26.500 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:46:26.500 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:46:26.500 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:46:26.501 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:26.501 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:26.501 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:26.501 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mgr.x", 2021-11-12T05:46:26.501 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1h6JBaORAAbgxQtCzGNj7MLfgwGd4cWA==", 2021-11-12T05:46:26.502 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:46:26.502 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow *", 2021-11-12T05:46:26.502 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow profile mgr", 2021-11-12T05:46:26.502 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:46:26.503 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:26.503 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:26.503 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:26.503 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mgr.y", 2021-11-12T05:46:26.503 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1hwfvvNRAASU7NmYBG/Yb6/ma1/Ew7mw==", 2021-11-12T05:46:26.504 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:46:26.504 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow *", 2021-11-12T05:46:26.504 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow profile mgr", 2021-11-12T05:46:26.504 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:46:26.505 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:26.505 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:26.505 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:46:26.505 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:46:26.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.468+0000 7fcb3dc0a700 1 -- 172.21.2.105:0/2038704392 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcb1c0536a0 msgr2=0x7fcb1c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:26.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.468+0000 7fcb3dc0a700 1 --2- 172.21.2.105:0/2038704392 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcb1c0536a0 0x7fcb1c055b60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7fcb20002f70 tx=0x7fcb20015000).stop 2021-11-12T05:46:26.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.468+0000 7fcb3dc0a700 1 -- 172.21.2.105:0/2038704392 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcb38130860 msgr2=0x7fcb38156820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:26.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.468+0000 7fcb3dc0a700 1 --2- 172.21.2.105:0/2038704392 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcb38130860 0x7fcb38156820 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7fcb3805d1b0 tx=0x7fcb30007f50).stop 2021-11-12T05:46:26.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.468+0000 7fcb3dc0a700 1 -- 172.21.2.105:0/2038704392 shutdown_connections 2021-11-12T05:46:26.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.468+0000 7fcb3dc0a700 1 --2- 172.21.2.105:0/2038704392 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcb1c0536a0 0x7fcb1c055b60 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:26.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.468+0000 7fcb3dc0a700 1 --2- 172.21.2.105:0/2038704392 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcb38130860 0x7fcb38156820 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:26.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.468+0000 7fcb3dc0a700 1 --2- 172.21.2.105:0/2038704392 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcb380af750 0x7fcb3815a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:26.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.468+0000 7fcb3dc0a700 1 --2- 172.21.2.105:0/2038704392 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcb380626b0 0x7fcb38065f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:26.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.468+0000 7fcb3dc0a700 1 -- 172.21.2.105:0/2038704392 >> 172.21.2.105:0/2038704392 conn(0x7fcb380b5320 msgr2=0x7fcb380b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:26.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.468+0000 7fcb3dc0a700 1 -- 172.21.2.105:0/2038704392 shutdown_connections 2021-11-12T05:46:26.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.468+0000 7fcb3dc0a700 1 -- 172.21.2.105:0/2038704392 wait complete. 2021-11-12T05:46:26.510 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:46:26.563 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe74c2ab700 1 Processor -- start 2021-11-12T05:46:26.563 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe74c2ab700 1 -- start start 2021-11-12T05:46:26.568 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe74c2ab700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe7440b3100 0x7fe7440b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:26.569 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe74c2ab700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7440b2110 con 0x7fe744062010 2021-11-12T05:46:26.569 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe74c2ab700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7440b2370 con 0x7fe7440b4d50 2021-11-12T05:46:26.569 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe74c2ab700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7440b2610 con 0x7fe7440b3100 2021-11-12T05:46:26.569 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe74a047700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fe744062010 0x7fe7440b4640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57618/0 (socket says 172.21.2.105:57618) 2021-11-12T05:46:26.570 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe74a047700 1 -- 172.21.2.105:0/1453019166 learned_addr learned my addr 172.21.2.105:0/1453019166 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:46:26.570 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe749045700 1 -- 172.21.2.105:0/1453019166 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1860592214 0 0) 0x7fe7440b2110 con 0x7fe744062010 2021-11-12T05:46:26.570 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe749045700 1 -- 172.21.2.105:0/1453019166 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe72c003260 con 0x7fe744062010 2021-11-12T05:46:26.570 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe74a848700 1 --2- 172.21.2.105:0/1453019166 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe7440b3100 0x7fe7440b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:26.570 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe749045700 1 -- 172.21.2.105:0/1453019166 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4142928952 0 0) 0x7fe72c003260 con 0x7fe744062010 2021-11-12T05:46:26.571 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe749045700 1 -- 172.21.2.105:0/1453019166 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe7440b3100 msgr2=0x7fe7440b5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:26.571 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe749045700 1 --2- 172.21.2.105:0/1453019166 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe7440b3100 0x7fe7440b5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:26.571 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe749045700 1 -- 172.21.2.105:0/1453019166 >> v1:172.21.2.115:6789/0 conn(0x7fe7440b4d50 legacy=0x7fe744141e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:26.571 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe749045700 1 -- 172.21.2.105:0/1453019166 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7440b4330 con 0x7fe744062010 2021-11-12T05:46:26.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe749045700 1 -- 172.21.2.105:0/1453019166 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fe738001660 con 0x7fe744062010 2021-11-12T05:46:26.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe749045700 1 -- 172.21.2.105:0/1453019166 >> v1:172.21.2.105:6789/0 conn(0x7fe744062010 legacy=0x7fe7440b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:26.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe749045700 1 --2- 172.21.2.105:0/1453019166 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe72c003800 0x7fe72c003c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:26.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe749045700 1 --2- 172.21.2.105:0/1453019166 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe72c004500 0x7fe72c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:26.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe749045700 1 --2- 172.21.2.105:0/1453019166 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe7440b3100 0x7fe72c004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:26.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe749045700 1 -- 172.21.2.105:0/1453019166 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7440b2610 con 0x7fe72c004500 2021-11-12T05:46:26.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe749045700 1 -- 172.21.2.105:0/1453019166 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72c00b910 con 0x7fe72c003800 2021-11-12T05:46:26.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe749045700 1 -- 172.21.2.105:0/1453019166 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe72c00bad0 con 0x7fe7440b3100 2021-11-12T05:46:26.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe749846700 1 --2- 172.21.2.105:0/1453019166 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe72c004500 0x7fe72c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:26.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe749846700 1 -- 172.21.2.105:0/1453019166 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe7440b3100 msgr2=0x7fe72c004ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:26.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe749846700 1 --2- 172.21.2.105:0/1453019166 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe7440b3100 0x7fe72c004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:26.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe749846700 1 -- 172.21.2.105:0/1453019166 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe72c003800 msgr2=0x7fe72c003c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:26.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe749846700 1 --2- 172.21.2.105:0/1453019166 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe72c003800 0x7fe72c003c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:26.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe749846700 1 -- 172.21.2.105:0/1453019166 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe72c003260 con 0x7fe72c004500 2021-11-12T05:46:26.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe749846700 1 --2- 172.21.2.105:0/1453019166 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe72c004500 0x7fe72c004980 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7fe740001fa0 tx=0x7fe740007a00).ready entity=mon.0 client_cookie=e6a343a5b6d2fd0d server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:26.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe749045700 1 -- 172.21.2.105:0/1453019166 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe740007070 con 0x7fe72c004500 2021-11-12T05:46:26.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe749045700 1 -- 172.21.2.105:0/1453019166 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7400071d0 con 0x7fe72c004500 2021-11-12T05:46:26.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe749045700 1 -- 172.21.2.105:0/1453019166 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe740006510 con 0x7fe72c004500 2021-11-12T05:46:26.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe74c2ab700 1 -- 172.21.2.105:0/1453019166 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe72c004500 msgr2=0x7fe72c004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:26.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe74c2ab700 1 --2- 172.21.2.105:0/1453019166 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe72c004500 0x7fe72c004980 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7fe740001fa0 tx=0x7fe740007a00).stop 2021-11-12T05:46:26.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe74a848700 1 -- 172.21.2.105:0/1453019166 reap_dead start 2021-11-12T05:46:26.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe74c2ab700 1 -- 172.21.2.105:0/1453019166 shutdown_connections 2021-11-12T05:46:26.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe74c2ab700 1 -- 172.21.2.105:0/1453019166 >> 172.21.2.105:0/1453019166 conn(0x7fe7440b9790 msgr2=0x7fe7440b9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:26.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe74c2ab700 1 -- 172.21.2.105:0/1453019166 shutdown_connections 2021-11-12T05:46:26.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.560+0000 7fe74c2ab700 1 -- 172.21.2.105:0/1453019166 wait complete. 2021-11-12T05:46:26.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.564+0000 7fe74c2ab700 1 Processor -- start 2021-11-12T05:46:26.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.564+0000 7fe74c2ab700 1 -- start start 2021-11-12T05:46:26.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.564+0000 7fe74c2ab700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe72c004500 0x7fe744113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:26.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.564+0000 7fe74c2ab700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe744115790 0x7fe744112b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:26.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.564+0000 7fe74c2ab700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe744152ec0 0x7fe744153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:26.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.564+0000 7fe74c2ab700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe744114b60 con 0x7fe744152ec0 2021-11-12T05:46:26.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.564+0000 7fe74c2ab700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7441527f0 con 0x7fe744115790 2021-11-12T05:46:26.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.564+0000 7fe74c2ab700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7441138c0 con 0x7fe72c004500 2021-11-12T05:46:26.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.564+0000 7fe74a848700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe744152ec0 0x7fe744153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:26.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.564+0000 7fe74a848700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe744152ec0 0x7fe744153340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47236/0 (socket says 172.21.2.105:47236) 2021-11-12T05:46:26.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.564+0000 7fe74a848700 1 -- 172.21.2.105:0/953454581 learned_addr learned my addr 172.21.2.105:0/953454581 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:26.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.564+0000 7fe74a047700 1 --2- 172.21.2.105:0/953454581 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe72c004500 0x7fe744113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:26.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.564+0000 7fe74a848700 1 -- 172.21.2.105:0/953454581 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe72c004500 msgr2=0x7fe744113b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:26.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.564+0000 7fe74a848700 1 --2- 172.21.2.105:0/953454581 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe72c004500 0x7fe744113b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:26.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.564+0000 7fe74a848700 1 -- 172.21.2.105:0/953454581 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe744115790 msgr2=0x7fe744112b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:26.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.564+0000 7fe74a848700 1 --2- 172.21.2.105:0/953454581 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe744115790 0x7fe744112b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:26.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.564+0000 7fe74a848700 1 -- 172.21.2.105:0/953454581 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe744119a60 con 0x7fe744152ec0 2021-11-12T05:46:26.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.564+0000 7fe74a848700 1 --2- 172.21.2.105:0/953454581 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe744152ec0 0x7fe744153340 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7fe744117ec0 tx=0x7fe73c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:26.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.564+0000 7fe7377fe700 1 -- 172.21.2.105:0/953454581 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe73c00c070 con 0x7fe744152ec0 2021-11-12T05:46:26.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.564+0000 7fe7377fe700 1 -- 172.21.2.105:0/953454581 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73c0133f0 con 0x7fe744152ec0 2021-11-12T05:46:26.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.564+0000 7fe74c2ab700 1 -- 172.21.2.105:0/953454581 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe744152a20 con 0x7fe744152ec0 2021-11-12T05:46:26.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.564+0000 7fe7377fe700 1 -- 172.21.2.105:0/953454581 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe73c013750 con 0x7fe744152ec0 2021-11-12T05:46:26.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.564+0000 7fe74c2ab700 1 -- 172.21.2.105:0/953454581 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe744113010 con 0x7fe744152ec0 2021-11-12T05:46:26.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.564+0000 7fe74c2ab700 1 -- 172.21.2.105:0/953454581 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe744152bb0 con 0x7fe744152ec0 2021-11-12T05:46:26.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.564+0000 7fe7377fe700 1 -- 172.21.2.105:0/953454581 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe73c0138b0 con 0x7fe744152ec0 2021-11-12T05:46:26.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.564+0000 7fe7377fe700 1 --2- 172.21.2.105:0/953454581 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe724053610 0x7fe724055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:26.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.564+0000 7fe7377fe700 1 -- 172.21.2.105:0/953454581 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fe73c06b310 con 0x7fe744152ec0 2021-11-12T05:46:26.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.564+0000 7fe74a047700 1 --2- 172.21.2.105:0/953454581 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe724053610 0x7fe724055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:26.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.564+0000 7fe74a047700 1 --2- 172.21.2.105:0/953454581 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe724053610 0x7fe724055ad0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fe738008000 tx=0x7fe738009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:26.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.568+0000 7fe7377fe700 1 -- 172.21.2.105:0/953454581 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe73c042650 con 0x7fe744152ec0 2021-11-12T05:46:26.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.652+0000 7fe74c2ab700 1 -- 172.21.2.105:0/953454581 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe744119bf0 con 0x7fe744152ec0 2021-11-12T05:46:26.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.652+0000 7fe7377fe700 1 -- 172.21.2.105:0/953454581 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+13415 (secure 0 0 0) 0x7fe73c045c70 con 0x7fe744152ec0 2021-11-12T05:46:26.656 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:46:26.656 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":70,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:46:26.227756+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:46:26.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.652+0000 7fe74c2ab700 1 -- 172.21.2.105:0/953454581 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe724053610 msgr2=0x7fe724055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:26.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.652+0000 7fe74c2ab700 1 --2- 172.21.2.105:0/953454581 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe724053610 0x7fe724055ad0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fe738008000 tx=0x7fe738009040).stop 2021-11-12T05:46:26.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.652+0000 7fe74c2ab700 1 -- 172.21.2.105:0/953454581 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe744152ec0 msgr2=0x7fe744153340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:26.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.652+0000 7fe74c2ab700 1 --2- 172.21.2.105:0/953454581 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe744152ec0 0x7fe744153340 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7fe744117ec0 tx=0x7fe73c008040).stop 2021-11-12T05:46:26.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.652+0000 7fe74c2ab700 1 -- 172.21.2.105:0/953454581 shutdown_connections 2021-11-12T05:46:26.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.652+0000 7fe74c2ab700 1 --2- 172.21.2.105:0/953454581 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe724053610 0x7fe724055ad0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:26.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.652+0000 7fe74c2ab700 1 --2- 172.21.2.105:0/953454581 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe744152ec0 0x7fe744153340 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:26.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.652+0000 7fe74c2ab700 1 --2- 172.21.2.105:0/953454581 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe744115790 0x7fe744112b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:26.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.652+0000 7fe74c2ab700 1 --2- 172.21.2.105:0/953454581 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe72c004500 0x7fe744113b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:26.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.652+0000 7fe74c2ab700 1 -- 172.21.2.105:0/953454581 >> 172.21.2.105:0/953454581 conn(0x7fe7440b9790 msgr2=0x7fe744141630 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:26.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.652+0000 7fe74c2ab700 1 -- 172.21.2.105:0/953454581 shutdown_connections 2021-11-12T05:46:26.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.652+0000 7fe74c2ab700 1 -- 172.21.2.105:0/953454581 wait complete. 2021-11-12T05:46:26.663 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-12T05:46:26.664 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:46:26.716 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.712+0000 7f93b3cf8700 1 Processor -- start 2021-11-12T05:46:26.717 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.712+0000 7f93b3cf8700 1 -- start start 2021-11-12T05:46:26.717 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.712+0000 7f93b3cf8700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f93ac0ace20 0x7f93ac0b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:26.717 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.712+0000 7f93b3cf8700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93ac0b1840 con 0x7f93ac0aca40 2021-11-12T05:46:26.717 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.712+0000 7f93b3cf8700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93ac0af2b0 con 0x7f93ac144180 2021-11-12T05:46:26.718 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.712+0000 7f93b3cf8700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93ac0b0a10 con 0x7f93ac0ace20 2021-11-12T05:46:26.720 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.712+0000 7f93b1a94700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f93ac0aca40 0x7f93ac1473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57638/0 (socket says 172.21.2.105:57638) 2021-11-12T05:46:26.720 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.712+0000 7f93b1a94700 1 -- 172.21.2.105:0/3169835485 learned_addr learned my addr 172.21.2.105:0/3169835485 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:46:26.720 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.712+0000 7f93b0a92700 1 -- 172.21.2.105:0/3169835485 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2769600821 0 0) 0x7f93ac0b1840 con 0x7f93ac0aca40 2021-11-12T05:46:26.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.712+0000 7f93b0a92700 1 -- 172.21.2.105:0/3169835485 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9394003260 con 0x7f93ac0aca40 2021-11-12T05:46:26.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.712+0000 7f93b0a92700 1 -- 172.21.2.105:0/3169835485 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3314485148 0 0) 0x7f9394003260 con 0x7f93ac0aca40 2021-11-12T05:46:26.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.712+0000 7f93b0a92700 1 -- 172.21.2.105:0/3169835485 >> v2:172.21.2.115:3300/0 conn(0x7f93ac0ace20 msgr2=0x7f93ac0b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:26.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.712+0000 7f93b0a92700 1 --2- 172.21.2.105:0/3169835485 >> v2:172.21.2.115:3300/0 conn(0x7f93ac0ace20 0x7f93ac0b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:26.722 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.712+0000 7f93b0a92700 1 -- 172.21.2.105:0/3169835485 >> v1:172.21.2.115:6789/0 conn(0x7f93ac144180 legacy=0x7f93ac1445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:26.722 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.712+0000 7f93b0a92700 1 -- 172.21.2.105:0/3169835485 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ac0b1a70 con 0x7f93ac0aca40 2021-11-12T05:46:26.722 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.712+0000 7f93b0a92700 1 -- 172.21.2.105:0/3169835485 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f93a8001660 con 0x7f93ac0aca40 2021-11-12T05:46:26.722 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.712+0000 7f93b0a92700 1 -- 172.21.2.105:0/3169835485 >> v1:172.21.2.105:6789/0 conn(0x7f93ac0aca40 legacy=0x7f93ac1473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:26.722 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.712+0000 7f93b0a92700 1 --2- 172.21.2.105:0/3169835485 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9394003820 0x7f9394003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:26.723 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.712+0000 7f93b0a92700 1 --2- 172.21.2.105:0/3169835485 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9394004500 0x7f9394004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:26.723 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.712+0000 7f93b0a92700 1 --2- 172.21.2.105:0/3169835485 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9394005050 0x7f939400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:26.723 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.712+0000 7f93b0a92700 1 -- 172.21.2.105:0/3169835485 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac0b0a10 con 0x7f9394003820 2021-11-12T05:46:26.723 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.712+0000 7f93b0a92700 1 -- 172.21.2.105:0/3169835485 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f939400bf40 con 0x7f9394004500 2021-11-12T05:46:26.723 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.712+0000 7f93b0a92700 1 -- 172.21.2.105:0/3169835485 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f939400c100 con 0x7f9394005050 2021-11-12T05:46:26.724 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.712+0000 7f93b1a94700 1 --2- 172.21.2.105:0/3169835485 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9394003820 0x7f9394003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:26.724 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.712+0000 7f93b1a94700 1 -- 172.21.2.105:0/3169835485 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9394005050 msgr2=0x7f939400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:26.724 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.712+0000 7f93b1a94700 1 --2- 172.21.2.105:0/3169835485 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9394005050 0x7f939400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:26.724 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.712+0000 7f93b1a94700 1 -- 172.21.2.105:0/3169835485 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9394004500 msgr2=0x7f9394004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:26.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.712+0000 7f93b1a94700 1 --2- 172.21.2.105:0/3169835485 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9394004500 0x7f9394004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:26.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.712+0000 7f93b1a94700 1 -- 172.21.2.105:0/3169835485 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9394003260 con 0x7f9394003820 2021-11-12T05:46:26.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.712+0000 7f93b2295700 1 -- 172.21.2.105:0/3169835485 reap_dead start 2021-11-12T05:46:26.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.716+0000 7f93b1a94700 1 --2- 172.21.2.105:0/3169835485 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9394003820 0x7f9394003c20 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7f93ac0611e0 tx=0x7f93ac0ad870).ready entity=mon.0 client_cookie=fcab8ca15291207f server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:26.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.716+0000 7f93b0a92700 1 -- 172.21.2.105:0/3169835485 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93a80070d0 con 0x7f9394003820 2021-11-12T05:46:26.726 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.716+0000 7f93b0a92700 1 -- 172.21.2.105:0/3169835485 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a8007230 con 0x7f9394003820 2021-11-12T05:46:26.726 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.716+0000 7f93b0a92700 1 -- 172.21.2.105:0/3169835485 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93a800c8f0 con 0x7f9394003820 2021-11-12T05:46:26.726 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.716+0000 7f93b3cf8700 1 -- 172.21.2.105:0/3169835485 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9394003820 msgr2=0x7f9394003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:26.726 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.716+0000 7f93b3cf8700 1 --2- 172.21.2.105:0/3169835485 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9394003820 0x7f9394003c20 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7f93ac0611e0 tx=0x7f93ac0ad870).stop 2021-11-12T05:46:26.726 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.716+0000 7f93b3cf8700 1 -- 172.21.2.105:0/3169835485 shutdown_connections 2021-11-12T05:46:26.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.716+0000 7f93b3cf8700 1 --2- 172.21.2.105:0/3169835485 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9394003820 0x7f9394003c20 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:26.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.716+0000 7f93b3cf8700 1 -- 172.21.2.105:0/3169835485 >> 172.21.2.105:0/3169835485 conn(0x7f93ac05c490 msgr2=0x7f93ac0b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:26.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.716+0000 7f93b3cf8700 1 -- 172.21.2.105:0/3169835485 shutdown_connections 2021-11-12T05:46:26.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.716+0000 7f93b3cf8700 1 -- 172.21.2.105:0/3169835485 wait complete. 2021-11-12T05:46:26.728 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.716+0000 7f93b3cf8700 1 Processor -- start 2021-11-12T05:46:26.728 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.716+0000 7f93b3cf8700 1 -- start start 2021-11-12T05:46:26.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.716+0000 7f93b3cf8700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9394003820 0x7f93ac1478d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:26.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.716+0000 7f93b3cf8700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f93ac0a9a70 0x7f93ac159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:26.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.716+0000 7f93b3cf8700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f93ac0a8a50 0x7f93ac0629a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:26.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.716+0000 7f93b3cf8700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac062570 con 0x7f93ac0a8a50 2021-11-12T05:46:26.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.716+0000 7f93b3cf8700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac0a9fb0 con 0x7f93ac0a9a70 2021-11-12T05:46:26.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.716+0000 7f93b3cf8700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac0aa250 con 0x7f9394003820 2021-11-12T05:46:26.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.716+0000 7f93b2295700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f93ac0a8a50 0x7f93ac0629a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:26.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.716+0000 7f93b2295700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f93ac0a8a50 0x7f93ac0629a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47258/0 (socket says 172.21.2.105:47258) 2021-11-12T05:46:26.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.716+0000 7f93b2295700 1 -- 172.21.2.105:0/1416130525 learned_addr learned my addr 172.21.2.105:0/1416130525 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:26.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.716+0000 7f93b2295700 1 -- 172.21.2.105:0/1416130525 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9394003820 msgr2=0x7f93ac1478d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:26.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.716+0000 7f93b2295700 1 --2- 172.21.2.105:0/1416130525 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9394003820 0x7f93ac1478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:26.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.716+0000 7f93b2295700 1 -- 172.21.2.105:0/1416130525 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f93ac0a9a70 msgr2=0x7f93ac159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:26.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.716+0000 7f93b1293700 1 --2- 172.21.2.105:0/1416130525 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f93ac0a9a70 0x7f93ac159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:26.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.716+0000 7f93b2295700 1 --2- 172.21.2.105:0/1416130525 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f93ac0a9a70 0x7f93ac159ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:26.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.716+0000 7f93b2295700 1 -- 172.21.2.105:0/1416130525 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ac0a8770 con 0x7f93ac0a8a50 2021-11-12T05:46:26.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.716+0000 7f93b2295700 1 --2- 172.21.2.105:0/1416130525 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f93ac0a8a50 0x7f93ac0629a0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7f93a8001110 tx=0x7f93a4007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:26.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.716+0000 7f939effd700 1 -- 172.21.2.105:0/1416130525 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93a4004850 con 0x7f93ac0a8a50 2021-11-12T05:46:26.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.716+0000 7f939effd700 1 -- 172.21.2.105:0/1416130525 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a40049b0 con 0x7f93ac0a8a50 2021-11-12T05:46:26.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.716+0000 7f93b3cf8700 1 -- 172.21.2.105:0/1416130525 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93ac062e90 con 0x7f93ac0a8a50 2021-11-12T05:46:26.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.716+0000 7f939effd700 1 -- 172.21.2.105:0/1416130525 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93a4004d50 con 0x7f93ac0a8a50 2021-11-12T05:46:26.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.716+0000 7f93b3cf8700 1 -- 172.21.2.105:0/1416130525 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93ac0a7020 con 0x7f93ac0a8a50 2021-11-12T05:46:26.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.716+0000 7f93b3cf8700 1 -- 172.21.2.105:0/1416130525 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93ac0626e0 con 0x7f93ac0a8a50 2021-11-12T05:46:26.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.720+0000 7f939effd700 1 -- 172.21.2.105:0/1416130525 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f93a401b070 con 0x7f93ac0a8a50 2021-11-12T05:46:26.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.720+0000 7f939effd700 1 --2- 172.21.2.105:0/1416130525 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f938c0536a0 0x7f938c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:26.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.720+0000 7f939effd700 1 -- 172.21.2.105:0/1416130525 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f93a406aa90 con 0x7f93ac0a8a50 2021-11-12T05:46:26.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.720+0000 7f93b1a94700 1 --2- 172.21.2.105:0/1416130525 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f938c0536a0 0x7f938c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:26.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.720+0000 7f93b1a94700 1 --2- 172.21.2.105:0/1416130525 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f938c0536a0 0x7f938c055b60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f93ac0611e0 tx=0x7f93a8015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:26.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.720+0000 7f939effd700 1 -- 172.21.2.105:0/1416130525 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f93ac0626e0 con 0x7f93ac0a8a50 2021-11-12T05:46:26.807 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.804+0000 7f93b3cf8700 1 -- 172.21.2.105:0/1416130525 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f93ac0626b0 con 0x7f93ac0a8a50 2021-11-12T05:46:26.807 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.804+0000 7f939effd700 1 -- 172.21.2.105:0/1416130525 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v70) v1 ==== 110+0+10 (secure 0 0 0) 0x7f93a4041dd0 con 0x7f93ac0a8a50 2021-11-12T05:46:26.808 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:46:26.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.804+0000 7f93b3cf8700 1 -- 172.21.2.105:0/1416130525 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f938c0536a0 msgr2=0x7f938c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:26.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.804+0000 7f93b3cf8700 1 --2- 172.21.2.105:0/1416130525 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f938c0536a0 0x7f938c055b60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f93ac0611e0 tx=0x7f93a8015000).stop 2021-11-12T05:46:26.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.804+0000 7f93b3cf8700 1 -- 172.21.2.105:0/1416130525 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f93ac0a8a50 msgr2=0x7f93ac0629a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:26.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.804+0000 7f93b3cf8700 1 --2- 172.21.2.105:0/1416130525 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f93ac0a8a50 0x7f93ac0629a0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7f93a8001110 tx=0x7f93a4007e50).stop 2021-11-12T05:46:26.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.804+0000 7f93b3cf8700 1 -- 172.21.2.105:0/1416130525 shutdown_connections 2021-11-12T05:46:26.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.804+0000 7f93b3cf8700 1 --2- 172.21.2.105:0/1416130525 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f938c0536a0 0x7f938c055b60 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:26.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.804+0000 7f93b3cf8700 1 --2- 172.21.2.105:0/1416130525 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f93ac0a8a50 0x7f93ac0629a0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:26.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.804+0000 7f93b3cf8700 1 --2- 172.21.2.105:0/1416130525 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f93ac0a9a70 0x7f93ac159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:26.811 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.804+0000 7f93b3cf8700 1 --2- 172.21.2.105:0/1416130525 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9394003820 0x7f93ac1478d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:26.811 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.804+0000 7f93b3cf8700 1 -- 172.21.2.105:0/1416130525 >> 172.21.2.105:0/1416130525 conn(0x7f93ac05c490 msgr2=0x7f93ac1437b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:26.811 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.804+0000 7f93b3cf8700 1 -- 172.21.2.105:0/1416130525 shutdown_connections 2021-11-12T05:46:26.811 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.804+0000 7f93b3cf8700 1 -- 172.21.2.105:0/1416130525 wait complete. 2021-11-12T05:46:26.815 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:46:26.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe323028700 1 Processor -- start 2021-11-12T05:46:26.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe323028700 1 -- start start 2021-11-12T05:46:26.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe323028700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fe31c0b0520 0x7fe31c144890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:26.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe323028700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe31c0b1840 con 0x7fe31c0aca40 2021-11-12T05:46:26.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe323028700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe31c0af2b0 con 0x7fe31c0ace20 2021-11-12T05:46:26.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe323028700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe31c0b0990 con 0x7fe31c0b0520 2021-11-12T05:46:26.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe320dc4700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fe31c0aca40 0x7fe31c1473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57658/0 (socket says 172.21.2.105:57658) 2021-11-12T05:46:26.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe320dc4700 1 -- 172.21.2.105:0/1159882258 learned_addr learned my addr 172.21.2.105:0/1159882258 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:46:26.873 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe31b7fe700 1 -- 172.21.2.105:0/1159882258 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2959580369 0 0) 0x7fe31c0b1840 con 0x7fe31c0aca40 2021-11-12T05:46:26.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe31b7fe700 1 -- 172.21.2.105:0/1159882258 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2fc003260 con 0x7fe31c0aca40 2021-11-12T05:46:26.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe31b7fe700 1 -- 172.21.2.105:0/1159882258 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1231467975 0 0) 0x7fe2fc003260 con 0x7fe31c0aca40 2021-11-12T05:46:26.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe31b7fe700 1 -- 172.21.2.105:0/1159882258 >> v2:172.21.2.115:3300/0 conn(0x7fe31c0b0520 msgr2=0x7fe31c144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:26.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe31b7fe700 1 --2- 172.21.2.105:0/1159882258 >> v2:172.21.2.115:3300/0 conn(0x7fe31c0b0520 0x7fe31c144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:26.875 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe31b7fe700 1 -- 172.21.2.105:0/1159882258 >> v1:172.21.2.115:6789/0 conn(0x7fe31c0ace20 legacy=0x7fe31c144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:26.875 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe31b7fe700 1 -- 172.21.2.105:0/1159882258 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31c144d80 con 0x7fe31c0aca40 2021-11-12T05:46:26.875 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe31b7fe700 1 -- 172.21.2.105:0/1159882258 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fe30c001660 con 0x7fe31c0aca40 2021-11-12T05:46:26.875 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe31b7fe700 1 -- 172.21.2.105:0/1159882258 >> v1:172.21.2.105:6789/0 conn(0x7fe31c0aca40 legacy=0x7fe31c1473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:26.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe31b7fe700 1 --2- 172.21.2.105:0/1159882258 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2fc003820 0x7fe2fc003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:26.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe31b7fe700 1 --2- 172.21.2.105:0/1159882258 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe2fc004500 0x7fe2fc004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:26.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe31b7fe700 1 --2- 172.21.2.105:0/1159882258 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe2fc005050 0x7fe2fc00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:26.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe31b7fe700 1 -- 172.21.2.105:0/1159882258 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c0b0990 con 0x7fe2fc003820 2021-11-12T05:46:26.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe31b7fe700 1 -- 172.21.2.105:0/1159882258 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2fc00bf40 con 0x7fe2fc005050 2021-11-12T05:46:26.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe31b7fe700 1 -- 172.21.2.105:0/1159882258 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2fc00c100 con 0x7fe2fc004500 2021-11-12T05:46:26.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe320dc4700 1 --2- 172.21.2.105:0/1159882258 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2fc003820 0x7fe2fc003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:26.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe320dc4700 1 -- 172.21.2.105:0/1159882258 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe2fc004500 msgr2=0x7fe2fc004980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:46:26.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe320dc4700 1 --2- 172.21.2.105:0/1159882258 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe2fc004500 0x7fe2fc004980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:26.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe320dc4700 1 -- 172.21.2.105:0/1159882258 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe2fc005050 msgr2=0x7fe2fc00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:26.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe320dc4700 1 --2- 172.21.2.105:0/1159882258 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe2fc005050 0x7fe2fc00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:26.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe320dc4700 1 -- 172.21.2.105:0/1159882258 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2fc003260 con 0x7fe2fc003820 2021-11-12T05:46:26.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe3215c5700 1 -- 172.21.2.105:0/1159882258 reap_dead start 2021-11-12T05:46:26.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe320dc4700 1 --2- 172.21.2.105:0/1159882258 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2fc003820 0x7fe2fc003c20 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7fe31c0611e0 tx=0x7fe31c0ad870).ready entity=mon.0 client_cookie=71c4727be96048c9 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:26.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe31b7fe700 1 -- 172.21.2.105:0/1159882258 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe30c0070d0 con 0x7fe2fc003820 2021-11-12T05:46:26.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe31b7fe700 1 -- 172.21.2.105:0/1159882258 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30c007230 con 0x7fe2fc003820 2021-11-12T05:46:26.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe31b7fe700 1 -- 172.21.2.105:0/1159882258 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe30c00c8f0 con 0x7fe2fc003820 2021-11-12T05:46:26.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe323028700 1 -- 172.21.2.105:0/1159882258 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2fc003820 msgr2=0x7fe2fc003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:26.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe323028700 1 --2- 172.21.2.105:0/1159882258 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2fc003820 0x7fe2fc003c20 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7fe31c0611e0 tx=0x7fe31c0ad870).stop 2021-11-12T05:46:26.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe323028700 1 -- 172.21.2.105:0/1159882258 shutdown_connections 2021-11-12T05:46:26.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe323028700 1 --2- 172.21.2.105:0/1159882258 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2fc003820 0x7fe2fc003c20 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:26.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe323028700 1 -- 172.21.2.105:0/1159882258 >> 172.21.2.105:0/1159882258 conn(0x7fe31c05c490 msgr2=0x7fe31c0b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:26.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe323028700 1 -- 172.21.2.105:0/1159882258 shutdown_connections 2021-11-12T05:46:26.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.864+0000 7fe323028700 1 -- 172.21.2.105:0/1159882258 wait complete. 2021-11-12T05:46:26.881 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.868+0000 7fe323028700 1 Processor -- start 2021-11-12T05:46:26.881 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.868+0000 7fe323028700 1 -- start start 2021-11-12T05:46:26.881 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.868+0000 7fe323028700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2fc003820 0x7fe31c0a9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:26.881 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.868+0000 7fe323028700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe31c1478f0 0x7fe31c15a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:26.882 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.868+0000 7fe323028700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe31c1564f0 0x7fe31c156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:26.882 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.868+0000 7fe323028700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c064030 con 0x7fe2fc003820 2021-11-12T05:46:26.882 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.868+0000 7fe323028700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c159c10 con 0x7fe31c1478f0 2021-11-12T05:46:26.882 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.868+0000 7fe323028700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c159eb0 con 0x7fe31c1564f0 2021-11-12T05:46:26.882 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.868+0000 7fe320dc4700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2fc003820 0x7fe31c0a9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:26.883 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.868+0000 7fe320dc4700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2fc003820 0x7fe31c0a9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47276/0 (socket says 172.21.2.105:47276) 2021-11-12T05:46:26.883 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.868+0000 7fe320dc4700 1 -- 172.21.2.105:0/1617446068 learned_addr learned my addr 172.21.2.105:0/1617446068 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:26.883 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.868+0000 7fe320dc4700 1 -- 172.21.2.105:0/1617446068 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe31c1564f0 msgr2=0x7fe31c156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:26.883 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.868+0000 7fe320dc4700 1 --2- 172.21.2.105:0/1617446068 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe31c1564f0 0x7fe31c156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:26.884 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.868+0000 7fe320dc4700 1 -- 172.21.2.105:0/1617446068 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe31c1478f0 msgr2=0x7fe31c15a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:26.884 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.868+0000 7fe320dc4700 1 --2- 172.21.2.105:0/1617446068 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe31c1478f0 0x7fe31c15a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:26.884 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.868+0000 7fe320dc4700 1 -- 172.21.2.105:0/1617446068 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31c0a9d40 con 0x7fe2fc003820 2021-11-12T05:46:26.884 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.868+0000 7fe320dc4700 1 --2- 172.21.2.105:0/1617446068 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2fc003820 0x7fe31c0a9600 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7fe31c0611e0 tx=0x7fe30c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:26.884 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.868+0000 7fe319ffb700 1 -- 172.21.2.105:0/1617446068 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe30c0070d0 con 0x7fe2fc003820 2021-11-12T05:46:26.885 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.868+0000 7fe319ffb700 1 -- 172.21.2.105:0/1617446068 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30c004920 con 0x7fe2fc003820 2021-11-12T05:46:26.885 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.868+0000 7fe323028700 1 -- 172.21.2.105:0/1617446068 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe31c147d30 con 0x7fe2fc003820 2021-11-12T05:46:26.885 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.868+0000 7fe323028700 1 -- 172.21.2.105:0/1617446068 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe31c15aa60 con 0x7fe2fc003820 2021-11-12T05:46:26.885 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.868+0000 7fe319ffb700 1 -- 172.21.2.105:0/1617446068 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe30c004c80 con 0x7fe2fc003820 2021-11-12T05:46:26.885 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.868+0000 7fe323028700 1 -- 172.21.2.105:0/1617446068 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe31c057350 con 0x7fe2fc003820 2021-11-12T05:46:26.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.868+0000 7fe319ffb700 1 -- 172.21.2.105:0/1617446068 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe30c010070 con 0x7fe2fc003820 2021-11-12T05:46:26.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.868+0000 7fe319ffb700 1 --2- 172.21.2.105:0/1617446068 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe300053610 0x7fe300055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:26.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.868+0000 7fe319ffb700 1 -- 172.21.2.105:0/1617446068 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fe30c06c740 con 0x7fe2fc003820 2021-11-12T05:46:26.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.868+0000 7fe31bfff700 1 --2- 172.21.2.105:0/1617446068 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe300053610 0x7fe300055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:26.887 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.868+0000 7fe31bfff700 1 --2- 172.21.2.105:0/1617446068 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe300053610 0x7fe300055ad0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7fe304002f90 tx=0x7fe304006930).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:26.887 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.872+0000 7fe319ffb700 1 -- 172.21.2.105:0/1617446068 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe30c043970 con 0x7fe2fc003820 2021-11-12T05:46:26.960 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.956+0000 7fe323028700 1 -- 172.21.2.105:0/1617446068 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe31c057350 con 0x7fe2fc003820 2021-11-12T05:46:26.961 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.956+0000 7fe319ffb700 1 -- 172.21.2.105:0/1617446068 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v70) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe30c046f90 con 0x7fe2fc003820 2021-11-12T05:46:26.961 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:46:26.962 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.956+0000 7fe323028700 1 -- 172.21.2.105:0/1617446068 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe300053610 msgr2=0x7fe300055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:26.962 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.956+0000 7fe323028700 1 --2- 172.21.2.105:0/1617446068 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe300053610 0x7fe300055ad0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7fe304002f90 tx=0x7fe304006930).stop 2021-11-12T05:46:26.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.956+0000 7fe323028700 1 -- 172.21.2.105:0/1617446068 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2fc003820 msgr2=0x7fe31c0a9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:26.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.956+0000 7fe323028700 1 --2- 172.21.2.105:0/1617446068 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2fc003820 0x7fe31c0a9600 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7fe31c0611e0 tx=0x7fe30c015000).stop 2021-11-12T05:46:26.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.956+0000 7fe323028700 1 -- 172.21.2.105:0/1617446068 shutdown_connections 2021-11-12T05:46:26.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.956+0000 7fe323028700 1 --2- 172.21.2.105:0/1617446068 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe300053610 0x7fe300055ad0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:26.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.956+0000 7fe323028700 1 --2- 172.21.2.105:0/1617446068 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe31c1564f0 0x7fe31c156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:26.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.956+0000 7fe323028700 1 --2- 172.21.2.105:0/1617446068 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe31c1478f0 0x7fe31c15a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:26.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.956+0000 7fe323028700 1 --2- 172.21.2.105:0/1617446068 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2fc003820 0x7fe31c0a9600 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:26.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.956+0000 7fe323028700 1 -- 172.21.2.105:0/1617446068 >> 172.21.2.105:0/1617446068 conn(0x7fe31c05c490 msgr2=0x7fe31c144390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:26.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.956+0000 7fe323028700 1 -- 172.21.2.105:0/1617446068 shutdown_connections 2021-11-12T05:46:26.965 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:26.956+0000 7fe323028700 1 -- 172.21.2.105:0/1617446068 wait complete. 2021-11-12T05:46:26.968 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-12T05:46:27.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.016+0000 7ff75bd5c700 1 Processor -- start 2021-11-12T05:46:27.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.016+0000 7ff75bd5c700 1 -- start start 2021-11-12T05:46:27.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.016+0000 7ff75bd5c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff7540ade80 0x7ff7540601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:27.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.016+0000 7ff75bd5c700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff754066150 con 0x7ff75413a9c0 2021-11-12T05:46:27.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.016+0000 7ff75bd5c700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7540663f0 con 0x7ff75405fdc0 2021-11-12T05:46:27.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.016+0000 7ff75bd5c700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff754141fb0 con 0x7ff7540ade80 2021-11-12T05:46:27.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.016+0000 7ff75a2f9700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7ff75413a9c0 0x7ff754141470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57682/0 (socket says 172.21.2.105:57682) 2021-11-12T05:46:27.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.016+0000 7ff75a2f9700 1 -- 172.21.2.105:0/2858335710 learned_addr learned my addr 172.21.2.105:0/2858335710 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:46:27.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.016+0000 7ff7592f7700 1 --2- 172.21.2.105:0/2858335710 >> v2:172.21.2.105:3300/0 conn(0x7ff7540ade80 0x7ff7540601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:27.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.016+0000 7ff7592f7700 1 -- 172.21.2.105:0/2858335710 >> v1:172.21.2.115:6789/0 conn(0x7ff75405fdc0 legacy=0x7ff754066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:27.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.016+0000 7ff7592f7700 1 -- 172.21.2.105:0/2858335710 >> v1:172.21.2.105:6789/0 conn(0x7ff75413a9c0 legacy=0x7ff754141470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:27.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.016+0000 7ff7592f7700 1 -- 172.21.2.105:0/2858335710 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff754140fd0 con 0x7ff7540ade80 2021-11-12T05:46:27.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.016+0000 7ff7592f7700 1 --2- 172.21.2.105:0/2858335710 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff7540ade80 0x7ff7540601a0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7ff754060ea0 tx=0x7ff744006df0).ready entity=mon.0 client_cookie=44162d2687850d11 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:27.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.016+0000 7ff758af6700 1 -- 172.21.2.105:0/2858335710 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff74400d5c0 con 0x7ff7540ade80 2021-11-12T05:46:27.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.016+0000 7ff758af6700 1 -- 172.21.2.105:0/2858335710 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff744000e90 con 0x7ff7540ade80 2021-11-12T05:46:27.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.016+0000 7ff758af6700 1 -- 172.21.2.105:0/2858335710 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff74400d910 con 0x7ff7540ade80 2021-11-12T05:46:27.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.016+0000 7ff75bd5c700 1 -- 172.21.2.105:0/2858335710 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff7540ade80 msgr2=0x7ff7540601a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:27.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.016+0000 7ff75bd5c700 1 --2- 172.21.2.105:0/2858335710 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff7540ade80 0x7ff7540601a0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7ff754060ea0 tx=0x7ff744006df0).stop 2021-11-12T05:46:27.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.016+0000 7ff75bd5c700 1 -- 172.21.2.105:0/2858335710 shutdown_connections 2021-11-12T05:46:27.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.016+0000 7ff75bd5c700 1 --2- 172.21.2.105:0/2858335710 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff7540ade80 0x7ff7540601a0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:27.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.016+0000 7ff75bd5c700 1 -- 172.21.2.105:0/2858335710 >> 172.21.2.105:0/2858335710 conn(0x7ff7540608d0 msgr2=0x7ff75405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:27.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.016+0000 7ff75bd5c700 1 -- 172.21.2.105:0/2858335710 shutdown_connections 2021-11-12T05:46:27.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.016+0000 7ff75bd5c700 1 -- 172.21.2.105:0/2858335710 wait complete. 2021-11-12T05:46:27.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.016+0000 7ff75bd5c700 1 Processor -- start 2021-11-12T05:46:27.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.016+0000 7ff75bd5c700 1 -- start start 2021-11-12T05:46:27.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.016+0000 7ff75bd5c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff75405fdc0 0x7ff7540b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:27.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.016+0000 7ff75bd5c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff7540ade80 0x7ff754157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:27.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.016+0000 7ff75bd5c700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff75413a9c0 0x7ff75413ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:27.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.016+0000 7ff75bd5c700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7541444c0 con 0x7ff75405fdc0 2021-11-12T05:46:27.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.020+0000 7ff75bd5c700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff754144760 con 0x7ff75413a9c0 2021-11-12T05:46:27.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.020+0000 7ff75bd5c700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff754145020 con 0x7ff7540ade80 2021-11-12T05:46:27.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.020+0000 7ff759af8700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff75405fdc0 0x7ff7540b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:27.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.020+0000 7ff759af8700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff75405fdc0 0x7ff7540b56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47288/0 (socket says 172.21.2.105:47288) 2021-11-12T05:46:27.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.020+0000 7ff759af8700 1 -- 172.21.2.105:0/1042772755 learned_addr learned my addr 172.21.2.105:0/1042772755 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:27.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.020+0000 7ff759af8700 1 -- 172.21.2.105:0/1042772755 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff7540ade80 msgr2=0x7ff754157220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:27.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.020+0000 7ff759af8700 1 --2- 172.21.2.105:0/1042772755 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff7540ade80 0x7ff754157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:27.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.020+0000 7ff759af8700 1 -- 172.21.2.105:0/1042772755 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff75413a9c0 msgr2=0x7ff75413ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:27.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.020+0000 7ff759af8700 1 --2- 172.21.2.105:0/1042772755 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff75413a9c0 0x7ff75413ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:27.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.020+0000 7ff759af8700 1 -- 172.21.2.105:0/1042772755 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff74400b180 con 0x7ff75405fdc0 2021-11-12T05:46:27.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.020+0000 7ff759af8700 1 --2- 172.21.2.105:0/1042772755 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff75405fdc0 0x7ff7540b56a0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7ff74c003310 tx=0x7ff74c0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:27.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.020+0000 7ff742ffd700 1 -- 172.21.2.105:0/1042772755 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff74c0016f0 con 0x7ff75405fdc0 2021-11-12T05:46:27.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.020+0000 7ff742ffd700 1 -- 172.21.2.105:0/1042772755 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff74c001850 con 0x7ff75405fdc0 2021-11-12T05:46:27.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.020+0000 7ff742ffd700 1 -- 172.21.2.105:0/1042772755 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff74c001bb0 con 0x7ff75405fdc0 2021-11-12T05:46:27.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.020+0000 7ff75bd5c700 1 -- 172.21.2.105:0/1042772755 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff754157710 con 0x7ff75405fdc0 2021-11-12T05:46:27.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.020+0000 7ff75bd5c700 1 -- 172.21.2.105:0/1042772755 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff75413b4b0 con 0x7ff75405fdc0 2021-11-12T05:46:27.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.020+0000 7ff75bd5c700 1 -- 172.21.2.105:0/1042772755 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff754144920 con 0x7ff75405fdc0 2021-11-12T05:46:27.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.020+0000 7ff742ffd700 1 -- 172.21.2.105:0/1042772755 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff74c018030 con 0x7ff75405fdc0 2021-11-12T05:46:27.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.020+0000 7ff742ffd700 1 --2- 172.21.2.105:0/1042772755 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff734053660 0x7ff734055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:27.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.020+0000 7ff742ffd700 1 -- 172.21.2.105:0/1042772755 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5596+0+0 (secure 0 0 0) 0x7ff74c06e290 con 0x7ff75405fdc0 2021-11-12T05:46:27.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.020+0000 7ff7592f7700 1 --2- 172.21.2.105:0/1042772755 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff734053660 0x7ff734055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:27.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.020+0000 7ff7592f7700 1 --2- 172.21.2.105:0/1042772755 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff734053660 0x7ff734055b20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7ff754060ea0 tx=0x7ff744012000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:27.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.024+0000 7ff742ffd700 1 -- 172.21.2.105:0/1042772755 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff74c041e90 con 0x7ff75405fdc0 2021-11-12T05:46:27.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.108+0000 7ff75bd5c700 1 -- 172.21.2.105:0/1042772755 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff754057350 con 0x7ff75405fdc0 2021-11-12T05:46:27.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.108+0000 7ff742ffd700 1 -- 172.21.2.105:0/1042772755 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v70) v1 ==== 84+0+143 (secure 0 0 0) 0x7ff74c042a10 con 0x7ff75405fdc0 2021-11-12T05:46:27.112 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:46:27.112 INFO:teuthology.orchestra.run.gibba005.stdout:[ 2021-11-12T05:46:27.112 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:27.113 INFO:teuthology.orchestra.run.gibba005.stdout: "poolnum": 1, 2021-11-12T05:46:27.113 INFO:teuthology.orchestra.run.gibba005.stdout: "poolname": "device_health_metrics" 2021-11-12T05:46:27.113 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:46:27.113 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:46:27.113 INFO:teuthology.orchestra.run.gibba005.stdout: "poolnum": 2, 2021-11-12T05:46:27.114 INFO:teuthology.orchestra.run.gibba005.stdout: "poolname": "rbd" 2021-11-12T05:46:27.114 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:46:27.114 INFO:teuthology.orchestra.run.gibba005.stdout:] 2021-11-12T05:46:27.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.108+0000 7ff75bd5c700 1 -- 172.21.2.105:0/1042772755 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff734053660 msgr2=0x7ff734055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:27.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.108+0000 7ff75bd5c700 1 --2- 172.21.2.105:0/1042772755 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff734053660 0x7ff734055b20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7ff754060ea0 tx=0x7ff744012000).stop 2021-11-12T05:46:27.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.108+0000 7ff75bd5c700 1 -- 172.21.2.105:0/1042772755 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff75405fdc0 msgr2=0x7ff7540b56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:27.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.108+0000 7ff75bd5c700 1 --2- 172.21.2.105:0/1042772755 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff75405fdc0 0x7ff7540b56a0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7ff74c003310 tx=0x7ff74c0091d0).stop 2021-11-12T05:46:27.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.108+0000 7ff75bd5c700 1 -- 172.21.2.105:0/1042772755 shutdown_connections 2021-11-12T05:46:27.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.108+0000 7ff75bd5c700 1 --2- 172.21.2.105:0/1042772755 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff734053660 0x7ff734055b20 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:27.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.108+0000 7ff75bd5c700 1 --2- 172.21.2.105:0/1042772755 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff75413a9c0 0x7ff75413ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:27.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.108+0000 7ff75bd5c700 1 --2- 172.21.2.105:0/1042772755 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff7540ade80 0x7ff754157220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:27.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.108+0000 7ff75bd5c700 1 --2- 172.21.2.105:0/1042772755 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff75405fdc0 0x7ff7540b56a0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:27.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.108+0000 7ff75bd5c700 1 -- 172.21.2.105:0/1042772755 >> 172.21.2.105:0/1042772755 conn(0x7ff7540608d0 msgr2=0x7ff7540613f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:27.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.108+0000 7ff75bd5c700 1 -- 172.21.2.105:0/1042772755 shutdown_connections 2021-11-12T05:46:27.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.108+0000 7ff75bd5c700 1 -- 172.21.2.105:0/1042772755 wait complete. 2021-11-12T05:46:27.120 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-12T05:46:27.121 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-12T05:46:27.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.168+0000 7f88a3365700 1 Processor -- start 2021-11-12T05:46:27.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.168+0000 7f88a3365700 1 -- start start 2021-11-12T05:46:27.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f88a3365700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f889c130a80 0x7f889c062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:27.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f88a3365700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f889c0b0d50 con 0x7f889c0af750 2021-11-12T05:46:27.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f88a3365700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f889c0ad380 con 0x7f889c0626b0 2021-11-12T05:46:27.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f88a3365700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f889c0ae190 con 0x7f889c130a80 2021-11-12T05:46:27.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f88a0900700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f889c0af750 0x7f889c1474d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57692/0 (socket says 172.21.2.105:57692) 2021-11-12T05:46:27.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f88a0900700 1 -- 172.21.2.105:0/2996194831 learned_addr learned my addr 172.21.2.105:0/2996194831 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:46:27.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f88a1902700 1 --2- 172.21.2.105:0/2996194831 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f889c130a80 0x7f889c062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:27.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f8893fff700 1 -- 172.21.2.105:0/2996194831 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4170846377 0 0) 0x7f889c0b0d50 con 0x7f889c0af750 2021-11-12T05:46:27.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f8893fff700 1 -- 172.21.2.105:0/2996194831 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8880003260 con 0x7f889c0af750 2021-11-12T05:46:27.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f8893fff700 1 -- 172.21.2.105:0/2996194831 <== mon.1 v1:172.21.2.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2090883098 0 0) 0x7f889c0ad380 con 0x7f889c0626b0 2021-11-12T05:46:27.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f8893fff700 1 -- 172.21.2.105:0/2996194831 --> v1:172.21.2.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f889c0b0d50 con 0x7f889c0626b0 2021-11-12T05:46:27.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f88a1902700 1 -- 172.21.2.105:0/2996194831 >> v1:172.21.2.115:6789/0 conn(0x7f889c0626b0 legacy=0x7f889c130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:27.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f88a1902700 1 -- 172.21.2.105:0/2996194831 >> v1:172.21.2.105:6789/0 conn(0x7f889c0af750 legacy=0x7f889c1474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:27.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f8893fff700 1 -- 172.21.2.105:0/2996194831 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2832496115 0 0) 0x7f8880003260 con 0x7f889c0af750 2021-11-12T05:46:27.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f88a1902700 1 -- 172.21.2.105:0/2996194831 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f889c0ae2d0 con 0x7f889c130a80 2021-11-12T05:46:27.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f88a1902700 1 --2- 172.21.2.105:0/2996194831 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f889c130a80 0x7f889c062a90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f888c001820 tx=0x7f88940091d0).ready entity=mon.2 client_cookie=7c46aa261580aa5a server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:27.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f8893fff700 1 -- 172.21.2.105:0/2996194831 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f888c001680 con 0x7f889c130a80 2021-11-12T05:46:27.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f8893fff700 1 -- 172.21.2.105:0/2996194831 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889400f510 con 0x7f889c130a80 2021-11-12T05:46:27.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f8893fff700 1 -- 172.21.2.105:0/2996194831 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f889400f680 con 0x7f889c130a80 2021-11-12T05:46:27.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f88a3365700 1 -- 172.21.2.105:0/2996194831 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f889c130a80 msgr2=0x7f889c062a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:27.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f88a3365700 1 --2- 172.21.2.105:0/2996194831 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f889c130a80 0x7f889c062a90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f888c001820 tx=0x7f88940091d0).stop 2021-11-12T05:46:27.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f88a3365700 1 -- 172.21.2.105:0/2996194831 shutdown_connections 2021-11-12T05:46:27.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f88a3365700 1 --2- 172.21.2.105:0/2996194831 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f889c130a80 0x7f889c062a90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:27.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f88a3365700 1 -- 172.21.2.105:0/2996194831 >> 172.21.2.105:0/2996194831 conn(0x7f889c0b5320 msgr2=0x7f889c0b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:27.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f88a3365700 1 -- 172.21.2.105:0/2996194831 shutdown_connections 2021-11-12T05:46:27.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f88a3365700 1 -- 172.21.2.105:0/2996194831 wait complete. 2021-11-12T05:46:27.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f88a3365700 1 Processor -- start 2021-11-12T05:46:27.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f88a3365700 1 -- start start 2021-11-12T05:46:27.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f88a3365700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f889c0626b0 0x7f889c14e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:27.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f88a3365700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f889c0af750 0x7f889c065ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:27.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f88a3365700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f889c130a80 0x7f889c1565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:27.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f88a3365700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889c066db0 con 0x7f889c130a80 2021-11-12T05:46:27.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f88a3365700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889c146ba0 con 0x7f889c0af750 2021-11-12T05:46:27.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f88a3365700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f889c146e40 con 0x7f889c0626b0 2021-11-12T05:46:27.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f88a1902700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f889c130a80 0x7f889c1565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:27.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f88a1902700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f889c130a80 0x7f889c1565c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47300/0 (socket says 172.21.2.105:47300) 2021-11-12T05:46:27.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f88a1902700 1 -- 172.21.2.105:0/110874 learned_addr learned my addr 172.21.2.105:0/110874 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:27.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f88a0900700 1 --2- 172.21.2.105:0/110874 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f889c0af750 0x7f889c065ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:27.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f88a1101700 1 --2- 172.21.2.105:0/110874 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f889c0626b0 0x7f889c14e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:27.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f88a1902700 1 -- 172.21.2.105:0/110874 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f889c0626b0 msgr2=0x7f889c14e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:27.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f88a1902700 1 --2- 172.21.2.105:0/110874 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f889c0626b0 0x7f889c14e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:27.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f88a1902700 1 -- 172.21.2.105:0/110874 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f889c0af750 msgr2=0x7f889c065ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:27.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f88a1902700 1 --2- 172.21.2.105:0/110874 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f889c0af750 0x7f889c065ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:27.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.172+0000 7f88a1902700 1 -- 172.21.2.105:0/110874 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8894009470 con 0x7f889c130a80 2021-11-12T05:46:27.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.176+0000 7f88a1902700 1 --2- 172.21.2.105:0/110874 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f889c130a80 0x7f889c1565c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7f888c001820 tx=0x7f8894016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:27.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.176+0000 7f88927fc700 1 -- 172.21.2.105:0/110874 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f889400fe90 con 0x7f889c130a80 2021-11-12T05:46:27.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.176+0000 7f88927fc700 1 -- 172.21.2.105:0/110874 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88940032d0 con 0x7f889c130a80 2021-11-12T05:46:27.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.176+0000 7f88a3365700 1 -- 172.21.2.105:0/110874 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f889c065390 con 0x7f889c130a80 2021-11-12T05:46:27.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.176+0000 7f88927fc700 1 -- 172.21.2.105:0/110874 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8894011d70 con 0x7f889c130a80 2021-11-12T05:46:27.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.176+0000 7f88a3365700 1 -- 172.21.2.105:0/110874 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f889c145a80 con 0x7f889c130a80 2021-11-12T05:46:27.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.176+0000 7f88a3365700 1 -- 172.21.2.105:0/110874 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f889c147be0 con 0x7f889c130a80 2021-11-12T05:46:27.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.176+0000 7f88927fc700 1 -- 172.21.2.105:0/110874 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8894027030 con 0x7f889c130a80 2021-11-12T05:46:27.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.176+0000 7f88927fc700 1 --2- 172.21.2.105:0/110874 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8884053580 0x7f8884055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:27.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.176+0000 7f88927fc700 1 -- 172.21.2.105:0/110874 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f889406c120 con 0x7f889c130a80 2021-11-12T05:46:27.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.176+0000 7f88a1101700 1 --2- 172.21.2.105:0/110874 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8884053580 0x7f8884055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:27.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.176+0000 7f88a1101700 1 --2- 172.21.2.105:0/110874 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8884053580 0x7f8884055a40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f889800d000 tx=0x7f8898007a20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:27.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.176+0000 7f88927fc700 1 -- 172.21.2.105:0/110874 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8894043460 con 0x7f889c130a80 2021-11-12T05:46:27.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:27.260+0000 7f88a3365700 1 -- 172.21.2.105:0/110874 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f889c0ae2d0 con 0x7f889c130a80 2021-11-12T05:46:28.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.172+0000 7f88927fc700 1 -- 172.21.2.105:0/110874 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v71) v1 ==== 133+0+0 (secure 0 0 0) 0x7f889c0ae2d0 con 0x7f889c130a80 2021-11-12T05:46:28.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.172+0000 7f88a3365700 1 -- 172.21.2.105:0/110874 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8884053580 msgr2=0x7f8884055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:28.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.172+0000 7f88a3365700 1 --2- 172.21.2.105:0/110874 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8884053580 0x7f8884055a40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f889800d000 tx=0x7f8898007a20).stop 2021-11-12T05:46:28.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.172+0000 7f88a3365700 1 -- 172.21.2.105:0/110874 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f889c130a80 msgr2=0x7f889c1565c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:28.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.172+0000 7f88a3365700 1 --2- 172.21.2.105:0/110874 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f889c130a80 0x7f889c1565c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7f888c001820 tx=0x7f8894016000).stop 2021-11-12T05:46:28.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.172+0000 7f88a3365700 1 -- 172.21.2.105:0/110874 shutdown_connections 2021-11-12T05:46:28.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.172+0000 7f88a3365700 1 --2- 172.21.2.105:0/110874 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8884053580 0x7f8884055a40 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:28.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.172+0000 7f88a3365700 1 --2- 172.21.2.105:0/110874 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f889c130a80 0x7f889c1565c0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:28.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.172+0000 7f88a3365700 1 --2- 172.21.2.105:0/110874 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f889c0af750 0x7f889c065ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:28.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.172+0000 7f88a3365700 1 --2- 172.21.2.105:0/110874 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f889c0626b0 0x7f889c14e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:28.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.172+0000 7f88a3365700 1 -- 172.21.2.105:0/110874 >> 172.21.2.105:0/110874 conn(0x7f889c0b5320 msgr2=0x7f889c0b3650 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:28.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.172+0000 7f88a3365700 1 -- 172.21.2.105:0/110874 shutdown_connections 2021-11-12T05:46:28.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.172+0000 7f88a3365700 1 -- 172.21.2.105:0/110874 wait complete. 2021-11-12T05:46:28.179 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_metadata' created 2021-11-12T05:46:28.182 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-11-12T05:46:28.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796ce8d700 1 Processor -- start 2021-11-12T05:46:28.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796ce8d700 1 -- start start 2021-11-12T05:46:28.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796ce8d700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f79680b30a0 0x7f7968140240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:28.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796ce8d700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79680aa0b0 con 0x7f79680b2cc0 2021-11-12T05:46:28.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796ce8d700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79680a9b70 con 0x7f79680b2290 2021-11-12T05:46:28.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796ce8d700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79680a9e10 con 0x7f79680b30a0 2021-11-12T05:46:28.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796659c700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f79680b2cc0 0x7f7968143690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57704/0 (socket says 172.21.2.105:57704) 2021-11-12T05:46:28.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796659c700 1 -- 172.21.2.105:0/3611396789 learned_addr learned my addr 172.21.2.105:0/3611396789 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:46:28.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796559a700 1 -- 172.21.2.105:0/3611396789 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2639883453 0 0) 0x7f79680aa0b0 con 0x7f79680b2cc0 2021-11-12T05:46:28.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796559a700 1 -- 172.21.2.105:0/3611396789 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7948003260 con 0x7f79680b2cc0 2021-11-12T05:46:28.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f7966d9d700 1 --2- 172.21.2.105:0/3611396789 >> v2:172.21.2.115:3300/0 conn(0x7f79680b30a0 0x7f7968140240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:28.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796559a700 1 -- 172.21.2.105:0/3611396789 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2268798244 0 0) 0x7f7948003260 con 0x7f79680b2cc0 2021-11-12T05:46:28.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796559a700 1 -- 172.21.2.105:0/3611396789 >> v2:172.21.2.115:3300/0 conn(0x7f79680b30a0 msgr2=0x7f7968140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:28.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796559a700 1 --2- 172.21.2.105:0/3611396789 >> v2:172.21.2.115:3300/0 conn(0x7f79680b30a0 0x7f7968140240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:28.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796559a700 1 -- 172.21.2.105:0/3611396789 >> v1:172.21.2.115:6789/0 conn(0x7f79680b2290 legacy=0x7f7968143da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:28.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796559a700 1 -- 172.21.2.105:0/3611396789 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79680b0800 con 0x7f79680b2cc0 2021-11-12T05:46:28.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796559a700 1 -- 172.21.2.105:0/3611396789 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f7950001660 con 0x7f79680b2cc0 2021-11-12T05:46:28.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796559a700 1 -- 172.21.2.105:0/3611396789 >> v1:172.21.2.105:6789/0 conn(0x7f79680b2cc0 legacy=0x7f7968143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:28.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796559a700 1 --2- 172.21.2.105:0/3611396789 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7948003820 0x7f7948003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:28.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796559a700 1 --2- 172.21.2.105:0/3611396789 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7948004500 0x7f7948004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:28.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796559a700 1 --2- 172.21.2.105:0/3611396789 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7948004f70 0x7f794800fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:28.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796559a700 1 -- 172.21.2.105:0/3611396789 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79680a9e10 con 0x7f7948003820 2021-11-12T05:46:28.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796559a700 1 -- 172.21.2.105:0/3611396789 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7948010260 con 0x7f7948004f70 2021-11-12T05:46:28.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796559a700 1 -- 172.21.2.105:0/3611396789 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7948010420 con 0x7f7948004500 2021-11-12T05:46:28.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796659c700 1 --2- 172.21.2.105:0/3611396789 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7948003820 0x7f7948003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:28.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f7966d9d700 1 --2- 172.21.2.105:0/3611396789 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7948004f70 0x7f794800fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:28.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796659c700 1 -- 172.21.2.105:0/3611396789 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7948004500 msgr2=0x7f7948004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:28.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f7965d9b700 1 --2- 172.21.2.105:0/3611396789 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7948004500 0x7f7948004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:28.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796659c700 1 --2- 172.21.2.105:0/3611396789 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7948004500 0x7f7948004980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:28.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796659c700 1 -- 172.21.2.105:0/3611396789 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7948004f70 msgr2=0x7f794800fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:28.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796659c700 1 --2- 172.21.2.105:0/3611396789 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7948004f70 0x7f794800fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:28.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796659c700 1 -- 172.21.2.105:0/3611396789 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7948003260 con 0x7f7948003820 2021-11-12T05:46:28.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f7966d9d700 1 -- 172.21.2.105:0/3611396789 reap_dead start 2021-11-12T05:46:28.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796659c700 1 --2- 172.21.2.105:0/3611396789 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7948003820 0x7f7948003c20 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7f79680b3840 tx=0x7f79680a9d00).ready entity=mon.0 client_cookie=fb21a599cf7b8040 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:28.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796559a700 1 -- 172.21.2.105:0/3611396789 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79500070d0 con 0x7f7948003820 2021-11-12T05:46:28.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796559a700 1 -- 172.21.2.105:0/3611396789 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7950007230 con 0x7f7948003820 2021-11-12T05:46:28.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796559a700 1 -- 172.21.2.105:0/3611396789 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f795000c8f0 con 0x7f7948003820 2021-11-12T05:46:28.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796ce8d700 1 -- 172.21.2.105:0/3611396789 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7948003820 msgr2=0x7f7948003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:28.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796ce8d700 1 --2- 172.21.2.105:0/3611396789 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7948003820 0x7f7948003c20 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7f79680b3840 tx=0x7f79680a9d00).stop 2021-11-12T05:46:28.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796ce8d700 1 -- 172.21.2.105:0/3611396789 shutdown_connections 2021-11-12T05:46:28.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796ce8d700 1 --2- 172.21.2.105:0/3611396789 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7948003820 0x7f7948003c20 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:28.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796ce8d700 1 -- 172.21.2.105:0/3611396789 >> 172.21.2.105:0/3611396789 conn(0x7f796805c490 msgr2=0x7f796805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:28.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796ce8d700 1 -- 172.21.2.105:0/3611396789 shutdown_connections 2021-11-12T05:46:28.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.232+0000 7f796ce8d700 1 -- 172.21.2.105:0/3611396789 wait complete. 2021-11-12T05:46:28.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.236+0000 7f796ce8d700 1 Processor -- start 2021-11-12T05:46:28.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.236+0000 7f796ce8d700 1 -- start start 2021-11-12T05:46:28.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.236+0000 7f796ce8d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7948003820 0x7f79680a81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:28.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.236+0000 7f796ce8d700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f79680aac90 0x7f79680acb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:28.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.236+0000 7f796ce8d700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7968156980 0x7f7968156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:28.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.236+0000 7f796ce8d700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79680ac440 con 0x7f7948003820 2021-11-12T05:46:28.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.236+0000 7f796ce8d700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79680a9150 con 0x7f7968156980 2021-11-12T05:46:28.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.236+0000 7f796ce8d700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79680ac670 con 0x7f79680aac90 2021-11-12T05:46:28.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.236+0000 7f796659c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7948003820 0x7f79680a81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:28.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.236+0000 7f796659c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7948003820 0x7f79680a81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47322/0 (socket says 172.21.2.105:47322) 2021-11-12T05:46:28.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.236+0000 7f796659c700 1 -- 172.21.2.105:0/2131106071 learned_addr learned my addr 172.21.2.105:0/2131106071 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:28.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.236+0000 7f796659c700 1 -- 172.21.2.105:0/2131106071 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f79680aac90 msgr2=0x7f79680acb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:28.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.236+0000 7f796659c700 1 --2- 172.21.2.105:0/2131106071 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f79680aac90 0x7f79680acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:28.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.236+0000 7f796659c700 1 -- 172.21.2.105:0/2131106071 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7968156980 msgr2=0x7f7968156e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:28.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.236+0000 7f796659c700 1 --2- 172.21.2.105:0/2131106071 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7968156980 0x7f7968156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:28.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.236+0000 7f796659c700 1 -- 172.21.2.105:0/2131106071 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79680a93f0 con 0x7f7948003820 2021-11-12T05:46:28.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.236+0000 7f796659c700 1 --2- 172.21.2.105:0/2131106071 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7948003820 0x7f79680a81b0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7f79680b3840 tx=0x7f7950015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:28.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.236+0000 7f795f7fe700 1 -- 172.21.2.105:0/2131106071 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7950001b20 con 0x7f7948003820 2021-11-12T05:46:28.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.236+0000 7f795f7fe700 1 -- 172.21.2.105:0/2131106071 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7950004920 con 0x7f7948003820 2021-11-12T05:46:28.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.236+0000 7f795f7fe700 1 -- 172.21.2.105:0/2131106071 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7950004c80 con 0x7f7948003820 2021-11-12T05:46:28.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.236+0000 7f796ce8d700 1 -- 172.21.2.105:0/2131106071 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79680a7320 con 0x7f7948003820 2021-11-12T05:46:28.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.236+0000 7f796ce8d700 1 -- 172.21.2.105:0/2131106071 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79680ad000 con 0x7f7948003820 2021-11-12T05:46:28.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.236+0000 7f795f7fe700 1 -- 172.21.2.105:0/2131106071 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f795001d070 con 0x7f7948003820 2021-11-12T05:46:28.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.236+0000 7f796ce8d700 1 -- 172.21.2.105:0/2131106071 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79680ad830 con 0x7f7948003820 2021-11-12T05:46:28.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.236+0000 7f795f7fe700 1 --2- 172.21.2.105:0/2131106071 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f794c053600 0x7f794c055ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:28.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.236+0000 7f795f7fe700 1 -- 172.21.2.105:0/2131106071 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5950+0+0 (secure 0 0 0) 0x7f795006c750 con 0x7f7948003820 2021-11-12T05:46:28.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.236+0000 7f7965d9b700 1 --2- 172.21.2.105:0/2131106071 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f794c053600 0x7f794c055ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:28.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.236+0000 7f7965d9b700 1 --2- 172.21.2.105:0/2131106071 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f794c053600 0x7f794c055ac0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f7958008000 tx=0x7f7958009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:28.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.240+0000 7f795f7fe700 1 -- 172.21.2.105:0/2131106071 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7950043820 con 0x7f7948003820 2021-11-12T05:46:28.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:28.320+0000 7f796ce8d700 1 -- 172.21.2.105:0/2131106071 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f7968057350 con 0x7f7948003820 2021-11-12T05:46:29.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.184+0000 7f795f7fe700 1 -- 172.21.2.105:0/2131106071 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v72) v1 ==== 125+0+0 (secure 0 0 0) 0x7f7950046e40 con 0x7f7948003820 2021-11-12T05:46:29.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.184+0000 7f796ce8d700 1 -- 172.21.2.105:0/2131106071 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f794c053600 msgr2=0x7f794c055ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:29.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.184+0000 7f796ce8d700 1 --2- 172.21.2.105:0/2131106071 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f794c053600 0x7f794c055ac0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f7958008000 tx=0x7f7958009040).stop 2021-11-12T05:46:29.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.184+0000 7f796ce8d700 1 -- 172.21.2.105:0/2131106071 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7948003820 msgr2=0x7f79680a81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:29.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.184+0000 7f796ce8d700 1 --2- 172.21.2.105:0/2131106071 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7948003820 0x7f79680a81b0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7f79680b3840 tx=0x7f7950015000).stop 2021-11-12T05:46:29.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.184+0000 7f796ce8d700 1 -- 172.21.2.105:0/2131106071 shutdown_connections 2021-11-12T05:46:29.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.184+0000 7f796ce8d700 1 --2- 172.21.2.105:0/2131106071 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f794c053600 0x7f794c055ac0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:29.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.184+0000 7f796ce8d700 1 --2- 172.21.2.105:0/2131106071 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7968156980 0x7f7968156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:29.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.184+0000 7f796ce8d700 1 --2- 172.21.2.105:0/2131106071 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f79680aac90 0x7f79680acb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:29.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.184+0000 7f796ce8d700 1 --2- 172.21.2.105:0/2131106071 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7948003820 0x7f79680a81b0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:29.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.184+0000 7f796ce8d700 1 -- 172.21.2.105:0/2131106071 >> 172.21.2.105:0/2131106071 conn(0x7f796805c490 msgr2=0x7f7968142a60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:29.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.184+0000 7f796ce8d700 1 -- 172.21.2.105:0/2131106071 shutdown_connections 2021-11-12T05:46:29.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.184+0000 7f796ce8d700 1 -- 172.21.2.105:0/2131106071 wait complete. 2021-11-12T05:46:29.194 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_data' created 2021-11-12T05:46:29.196 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-12T05:46:29.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.248+0000 7f2f1fa69700 1 Processor -- start 2021-11-12T05:46:29.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.248+0000 7f2f1fa69700 1 -- start start 2021-11-12T05:46:29.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.248+0000 7f2f1fa69700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f2f180b3100 0x7f2f180b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:29.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.248+0000 7f2f1fa69700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f180b2110 con 0x7f2f18062010 2021-11-12T05:46:29.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.248+0000 7f2f1fa69700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f180b2370 con 0x7f2f180b4d50 2021-11-12T05:46:29.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.248+0000 7f2f1fa69700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f180b2610 con 0x7f2f180b3100 2021-11-12T05:46:29.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.248+0000 7f2f1e006700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f2f180b3100 0x7f2f180b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:29.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.248+0000 7f2f1e006700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f2f180b3100 0x7f2f180b5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47332/0 (socket says 172.21.2.105:47332) 2021-11-12T05:46:29.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.248+0000 7f2f1e006700 1 -- 172.21.2.105:0/3607849993 learned_addr learned my addr 172.21.2.105:0/3607849993 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:29.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.248+0000 7f2f1e006700 1 -- 172.21.2.105:0/3607849993 >> v1:172.21.2.115:6789/0 conn(0x7f2f180b4d50 legacy=0x7f2f18141e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:29.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.248+0000 7f2f1e006700 1 -- 172.21.2.105:0/3607849993 >> v1:172.21.2.105:6789/0 conn(0x7f2f18062010 legacy=0x7f2f180b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:29.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.248+0000 7f2f1e006700 1 -- 172.21.2.105:0/3607849993 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f180b4330 con 0x7f2f180b3100 2021-11-12T05:46:29.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.248+0000 7f2f1e006700 1 --2- 172.21.2.105:0/3607849993 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2f180b3100 0x7f2f180b5b00 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f2f180b0ac0 tx=0x7f2f08006eb0).ready entity=mon.0 client_cookie=452ef49006b9af30 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:29.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.248+0000 7f2f1c803700 1 -- 172.21.2.105:0/3607849993 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f0800d610 con 0x7f2f180b3100 2021-11-12T05:46:29.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.248+0000 7f2f1c803700 1 -- 172.21.2.105:0/3607849993 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f08000e90 con 0x7f2f180b3100 2021-11-12T05:46:29.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.248+0000 7f2f1c803700 1 -- 172.21.2.105:0/3607849993 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f0800d960 con 0x7f2f180b3100 2021-11-12T05:46:29.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.248+0000 7f2f1fa69700 1 -- 172.21.2.105:0/3607849993 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2f180b3100 msgr2=0x7f2f180b5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:29.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.248+0000 7f2f1fa69700 1 --2- 172.21.2.105:0/3607849993 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2f180b3100 0x7f2f180b5b00 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f2f180b0ac0 tx=0x7f2f08006eb0).stop 2021-11-12T05:46:29.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.248+0000 7f2f1fa69700 1 -- 172.21.2.105:0/3607849993 shutdown_connections 2021-11-12T05:46:29.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.248+0000 7f2f1fa69700 1 --2- 172.21.2.105:0/3607849993 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2f180b3100 0x7f2f180b5b00 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:29.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.248+0000 7f2f1fa69700 1 -- 172.21.2.105:0/3607849993 >> 172.21.2.105:0/3607849993 conn(0x7f2f180b9790 msgr2=0x7f2f180b9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:29.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.248+0000 7f2f1fa69700 1 -- 172.21.2.105:0/3607849993 shutdown_connections 2021-11-12T05:46:29.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.248+0000 7f2f1fa69700 1 -- 172.21.2.105:0/3607849993 wait complete. 2021-11-12T05:46:29.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.252+0000 7f2f1fa69700 1 Processor -- start 2021-11-12T05:46:29.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.252+0000 7f2f1fa69700 1 -- start start 2021-11-12T05:46:29.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.252+0000 7f2f1fa69700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2f18062010 0x7f2f18144bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:29.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.252+0000 7f2f1fa69700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2f180b3100 0x7f2f18145db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:29.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.252+0000 7f2f1fa69700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2f180b4d50 0x7f2f181462a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:29.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.252+0000 7f2f1fa69700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f18153570 con 0x7f2f180b3100 2021-11-12T05:46:29.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.252+0000 7f2f1fa69700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f18152b90 con 0x7f2f180b4d50 2021-11-12T05:46:29.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.252+0000 7f2f1fa69700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f18152e30 con 0x7f2f18062010 2021-11-12T05:46:29.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.252+0000 7f2f1d004700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2f180b3100 0x7f2f18145db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:29.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.252+0000 7f2f1d004700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2f180b3100 0x7f2f18145db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47336/0 (socket says 172.21.2.105:47336) 2021-11-12T05:46:29.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.252+0000 7f2f1d004700 1 -- 172.21.2.105:0/220924795 learned_addr learned my addr 172.21.2.105:0/220924795 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:29.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.252+0000 7f2f1d004700 1 -- 172.21.2.105:0/220924795 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2f18062010 msgr2=0x7f2f18144bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:29.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.252+0000 7f2f1d004700 1 --2- 172.21.2.105:0/220924795 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2f18062010 0x7f2f18144bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:29.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.252+0000 7f2f1d004700 1 -- 172.21.2.105:0/220924795 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2f180b4d50 msgr2=0x7f2f181462a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:29.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.252+0000 7f2f1d004700 1 --2- 172.21.2.105:0/220924795 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2f180b4d50 0x7f2f181462a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:29.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.252+0000 7f2f1d004700 1 -- 172.21.2.105:0/220924795 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0800b1e0 con 0x7f2f180b3100 2021-11-12T05:46:29.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.252+0000 7f2f1d004700 1 --2- 172.21.2.105:0/220924795 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2f180b3100 0x7f2f18145db0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7f2f100032b0 tx=0x7f2f100091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:29.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.252+0000 7f2f16ffd700 1 -- 172.21.2.105:0/220924795 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f1000d4a0 con 0x7f2f180b3100 2021-11-12T05:46:29.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.252+0000 7f2f16ffd700 1 -- 172.21.2.105:0/220924795 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1000d600 con 0x7f2f180b3100 2021-11-12T05:46:29.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.252+0000 7f2f1fa69700 1 -- 172.21.2.105:0/220924795 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f181530d0 con 0x7f2f180b3100 2021-11-12T05:46:29.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.252+0000 7f2f1fa69700 1 -- 172.21.2.105:0/220924795 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f181453d0 con 0x7f2f180b3100 2021-11-12T05:46:29.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.252+0000 7f2f16ffd700 1 -- 172.21.2.105:0/220924795 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f1000d960 con 0x7f2f180b3100 2021-11-12T05:46:29.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.252+0000 7f2f1fa69700 1 -- 172.21.2.105:0/220924795 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f18153260 con 0x7f2f180b3100 2021-11-12T05:46:29.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.252+0000 7f2f16ffd700 1 -- 172.21.2.105:0/220924795 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2f10018030 con 0x7f2f180b3100 2021-11-12T05:46:29.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.252+0000 7f2f16ffd700 1 --2- 172.21.2.105:0/220924795 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2ef8053720 0x7f2ef8055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:29.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.252+0000 7f2f16ffd700 1 -- 172.21.2.105:0/220924795 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6300+0+0 (secure 0 0 0) 0x7f2f1006b480 con 0x7f2f180b3100 2021-11-12T05:46:29.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.252+0000 7f2f1d805700 1 --2- 172.21.2.105:0/220924795 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2ef8053720 0x7f2ef8055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:29.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.252+0000 7f2f1d805700 1 --2- 172.21.2.105:0/220924795 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2ef8053720 0x7f2ef8055be0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f2f180b1fb0 tx=0x7f2f0c007810).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:29.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.256+0000 7f2f16ffd700 1 -- 172.21.2.105:0/220924795 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2f10042500 con 0x7f2f180b3100 2021-11-12T05:46:29.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.368+0000 7f2f1fa69700 1 -- 172.21.2.105:0/220924795 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f2f18152980 con 0x7f2f180b3100 2021-11-12T05:46:29.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.372+0000 7f2f16ffd700 1 -- 172.21.2.105:0/220924795 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 13 and data pool 14 v30) v1 ==== 189+0+0 (secure 0 0 0) 0x7f2f10045b20 con 0x7f2f180b3100 2021-11-12T05:46:29.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.372+0000 7f2f1fa69700 1 -- 172.21.2.105:0/220924795 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2ef8053720 msgr2=0x7f2ef8055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:29.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.372+0000 7f2f1fa69700 1 --2- 172.21.2.105:0/220924795 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2ef8053720 0x7f2ef8055be0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f2f180b1fb0 tx=0x7f2f0c007810).stop 2021-11-12T05:46:29.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.372+0000 7f2f1fa69700 1 -- 172.21.2.105:0/220924795 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2f180b3100 msgr2=0x7f2f18145db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:29.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.372+0000 7f2f1fa69700 1 --2- 172.21.2.105:0/220924795 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2f180b3100 0x7f2f18145db0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7f2f100032b0 tx=0x7f2f100091a0).stop 2021-11-12T05:46:29.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.372+0000 7f2f1fa69700 1 -- 172.21.2.105:0/220924795 shutdown_connections 2021-11-12T05:46:29.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.372+0000 7f2f1fa69700 1 --2- 172.21.2.105:0/220924795 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2ef8053720 0x7f2ef8055be0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:29.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.372+0000 7f2f1fa69700 1 --2- 172.21.2.105:0/220924795 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2f180b4d50 0x7f2f181462a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:29.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.372+0000 7f2f1fa69700 1 --2- 172.21.2.105:0/220924795 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2f180b3100 0x7f2f18145db0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:29.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.372+0000 7f2f1fa69700 1 --2- 172.21.2.105:0/220924795 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2f18062010 0x7f2f18144bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:29.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.372+0000 7f2f1fa69700 1 -- 172.21.2.105:0/220924795 >> 172.21.2.105:0/220924795 conn(0x7f2f180b9790 msgr2=0x7f2f180b9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:29.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.372+0000 7f2f1fa69700 1 -- 172.21.2.105:0/220924795 shutdown_connections 2021-11-12T05:46:29.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.372+0000 7f2f1fa69700 1 -- 172.21.2.105:0/220924795 wait complete. 2021-11-12T05:46:29.381 INFO:teuthology.orchestra.run.gibba005.stderr:new fs with metadata pool 13 and data pool 14 2021-11-12T05:46:29.384 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:46:29.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff597095700 1 Processor -- start 2021-11-12T05:46:29.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff597095700 1 -- start start 2021-11-12T05:46:29.443 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff597095700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7ff5900ad080 0x7ff5900af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:29.443 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff597095700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff59014b2f0 0x7ff5900ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:29.443 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff597095700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5900ac7b0 con 0x7ff5900ac280 2021-11-12T05:46:29.443 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff597095700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5901488a0 con 0x7ff5900ad080 2021-11-12T05:46:29.444 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff597095700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5900ac9e0 con 0x7ff59014b2f0 2021-11-12T05:46:29.444 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff58ffff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7ff5900ac280 0x7ff59014abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57752/0 (socket says 172.21.2.105:57752) 2021-11-12T05:46:29.444 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff58ffff700 1 -- 172.21.2.105:0/1108449037 learned_addr learned my addr 172.21.2.105:0/1108449037 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:46:29.444 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff58f7fe700 1 -- 172.21.2.105:0/1108449037 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3329932583 0 0) 0x7ff5900ac7b0 con 0x7ff5900ac280 2021-11-12T05:46:29.445 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff58f7fe700 1 -- 172.21.2.105:0/1108449037 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff570003260 con 0x7ff5900ac280 2021-11-12T05:46:29.445 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff594e31700 1 --2- 172.21.2.105:0/1108449037 >> v2:172.21.2.115:3300/0 conn(0x7ff5900ad080 0x7ff5900af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:29.445 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff595632700 1 --2- 172.21.2.105:0/1108449037 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff59014b2f0 0x7ff5900ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:29.445 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff58f7fe700 1 -- 172.21.2.105:0/1108449037 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 446441240 0 0) 0x7ff570003260 con 0x7ff5900ac280 2021-11-12T05:46:29.445 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff58f7fe700 1 -- 172.21.2.105:0/1108449037 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff59014b2f0 msgr2=0x7ff5900ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:29.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff58f7fe700 1 --2- 172.21.2.105:0/1108449037 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff59014b2f0 0x7ff5900ad460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:29.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff58f7fe700 1 -- 172.21.2.105:0/1108449037 >> v2:172.21.2.115:3300/0 conn(0x7ff5900ad080 msgr2=0x7ff5900af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:29.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff58f7fe700 1 --2- 172.21.2.105:0/1108449037 >> v2:172.21.2.115:3300/0 conn(0x7ff5900ad080 0x7ff5900af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:29.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff58f7fe700 1 -- 172.21.2.105:0/1108449037 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5900b0b30 con 0x7ff5900ac280 2021-11-12T05:46:29.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff58f7fe700 1 -- 172.21.2.105:0/1108449037 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7ff578001660 con 0x7ff5900ac280 2021-11-12T05:46:29.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff58f7fe700 1 -- 172.21.2.105:0/1108449037 >> v1:172.21.2.105:6789/0 conn(0x7ff5900ac280 legacy=0x7ff59014abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:29.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff58f7fe700 1 --2- 172.21.2.105:0/1108449037 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff5700037d0 0x7ff570003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:29.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff58f7fe700 1 --2- 172.21.2.105:0/1108449037 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff570004500 0x7ff570004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:29.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff58f7fe700 1 --2- 172.21.2.105:0/1108449037 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff59014b2f0 0x7ff570004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:29.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff58f7fe700 1 -- 172.21.2.105:0/1108449037 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5901488a0 con 0x7ff570004500 2021-11-12T05:46:29.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff58f7fe700 1 -- 172.21.2.105:0/1108449037 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5900ac9e0 con 0x7ff5700037d0 2021-11-12T05:46:29.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff58f7fe700 1 -- 172.21.2.105:0/1108449037 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff57000b850 con 0x7ff59014b2f0 2021-11-12T05:46:29.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff58ffff700 1 --2- 172.21.2.105:0/1108449037 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff570004500 0x7ff570004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:29.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff594e31700 1 --2- 172.21.2.105:0/1108449037 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff5700037d0 0x7ff570003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:29.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff58ffff700 1 -- 172.21.2.105:0/1108449037 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff59014b2f0 msgr2=0x7ff570004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:29.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff58ffff700 1 --2- 172.21.2.105:0/1108449037 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff59014b2f0 0x7ff570004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:29.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff58ffff700 1 -- 172.21.2.105:0/1108449037 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff5700037d0 msgr2=0x7ff570003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:29.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff58ffff700 1 --2- 172.21.2.105:0/1108449037 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff5700037d0 0x7ff570003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:29.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff58ffff700 1 -- 172.21.2.105:0/1108449037 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5900b0b30 con 0x7ff570004500 2021-11-12T05:46:29.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff594e31700 1 --2- 172.21.2.105:0/1108449037 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff5700037d0 0x7ff570003bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:46:29.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff58ffff700 1 --2- 172.21.2.105:0/1108449037 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff570004500 0x7ff570004980 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7ff578001370 tx=0x7ff578001e40).ready entity=mon.0 client_cookie=7c790289e74921d0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:29.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff58f7fe700 1 -- 172.21.2.105:0/1108449037 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5780070d0 con 0x7ff570004500 2021-11-12T05:46:29.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff58f7fe700 1 -- 172.21.2.105:0/1108449037 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff578007230 con 0x7ff570004500 2021-11-12T05:46:29.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff58f7fe700 1 -- 172.21.2.105:0/1108449037 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff57800c980 con 0x7ff570004500 2021-11-12T05:46:29.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff597095700 1 -- 172.21.2.105:0/1108449037 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff570004500 msgr2=0x7ff570004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:29.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff597095700 1 --2- 172.21.2.105:0/1108449037 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff570004500 0x7ff570004980 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7ff578001370 tx=0x7ff578001e40).stop 2021-11-12T05:46:29.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff595632700 1 -- 172.21.2.105:0/1108449037 reap_dead start 2021-11-12T05:46:29.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff597095700 1 -- 172.21.2.105:0/1108449037 shutdown_connections 2021-11-12T05:46:29.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff597095700 1 -- 172.21.2.105:0/1108449037 >> 172.21.2.105:0/1108449037 conn(0x7ff5900b5370 msgr2=0x7ff5900b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:29.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff597095700 1 -- 172.21.2.105:0/1108449037 shutdown_connections 2021-11-12T05:46:29.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.432+0000 7ff597095700 1 -- 172.21.2.105:0/1108449037 wait complete. 2021-11-12T05:46:29.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.436+0000 7ff597095700 1 Processor -- start 2021-11-12T05:46:29.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.436+0000 7ff597095700 1 -- start start 2021-11-12T05:46:29.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.436+0000 7ff597095700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff570004500 0x7ff590147190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:29.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.436+0000 7ff597095700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff5900a7020 0x7ff5900aa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:29.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.436+0000 7ff597095700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff59014a9b0 0x7ff5900ab680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:29.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.436+0000 7ff597095700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5900a7ca0 con 0x7ff5900a7020 2021-11-12T05:46:29.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.436+0000 7ff597095700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5900a7f40 con 0x7ff570004500 2021-11-12T05:46:29.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.436+0000 7ff597095700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5900a8c40 con 0x7ff59014a9b0 2021-11-12T05:46:29.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.436+0000 7ff58ffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff5900a7020 0x7ff5900aa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:29.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.436+0000 7ff58ffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff5900a7020 0x7ff5900aa3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47364/0 (socket says 172.21.2.105:47364) 2021-11-12T05:46:29.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.436+0000 7ff58ffff700 1 -- 172.21.2.105:0/869901557 learned_addr learned my addr 172.21.2.105:0/869901557 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:29.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.436+0000 7ff594e31700 1 --2- 172.21.2.105:0/869901557 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff570004500 0x7ff590147190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:29.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.436+0000 7ff595632700 1 --2- 172.21.2.105:0/869901557 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff59014a9b0 0x7ff5900ab680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:29.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.436+0000 7ff58ffff700 1 -- 172.21.2.105:0/869901557 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff59014a9b0 msgr2=0x7ff5900ab680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:29.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.436+0000 7ff58ffff700 1 --2- 172.21.2.105:0/869901557 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff59014a9b0 0x7ff5900ab680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:29.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.436+0000 7ff58ffff700 1 -- 172.21.2.105:0/869901557 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff570004500 msgr2=0x7ff590147190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:29.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.436+0000 7ff58ffff700 1 --2- 172.21.2.105:0/869901557 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff570004500 0x7ff590147190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:29.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.436+0000 7ff58ffff700 1 -- 172.21.2.105:0/869901557 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5900aa8c0 con 0x7ff5900a7020 2021-11-12T05:46:29.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.436+0000 7ff58ffff700 1 --2- 172.21.2.105:0/869901557 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff5900a7020 0x7ff5900aa3d0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7ff578001370 tx=0x7ff578015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:29.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.436+0000 7ff58dffb700 1 -- 172.21.2.105:0/869901557 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff578017070 con 0x7ff5900a7020 2021-11-12T05:46:29.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.436+0000 7ff58dffb700 1 -- 172.21.2.105:0/869901557 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff578004730 con 0x7ff5900a7020 2021-11-12T05:46:29.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.436+0000 7ff597095700 1 -- 172.21.2.105:0/869901557 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5900a8ee0 con 0x7ff5900a7020 2021-11-12T05:46:29.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.436+0000 7ff58dffb700 1 -- 172.21.2.105:0/869901557 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5780070d0 con 0x7ff5900a7020 2021-11-12T05:46:29.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.436+0000 7ff597095700 1 -- 172.21.2.105:0/869901557 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5900abd10 con 0x7ff5900a7020 2021-11-12T05:46:29.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.436+0000 7ff597095700 1 -- 172.21.2.105:0/869901557 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5900b1440 con 0x7ff5900a7020 2021-11-12T05:46:29.458 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.436+0000 7ff58dffb700 1 -- 172.21.2.105:0/869901557 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff578010070 con 0x7ff5900a7020 2021-11-12T05:46:29.458 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.436+0000 7ff58dffb700 1 --2- 172.21.2.105:0/869901557 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff5740536a0 0x7ff574055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:29.458 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.436+0000 7ff58dffb700 1 -- 172.21.2.105:0/869901557 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6416+0+0 (secure 0 0 0) 0x7ff57806c270 con 0x7ff5900a7020 2021-11-12T05:46:29.458 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.436+0000 7ff594e31700 1 --2- 172.21.2.105:0/869901557 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff5740536a0 0x7ff574055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:29.458 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.436+0000 7ff594e31700 1 --2- 172.21.2.105:0/869901557 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff5740536a0 0x7ff574055b60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7ff580009000 tx=0x7ff580008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:29.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.440+0000 7ff58dffb700 1 -- 172.21.2.105:0/869901557 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff578069e90 con 0x7ff5900a7020 2021-11-12T05:46:29.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.524+0000 7ff597095700 1 -- 172.21.2.105:0/869901557 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff590057350 con 0x7ff5900a7020 2021-11-12T05:46:29.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.524+0000 7ff58dffb700 1 -- 172.21.2.105:0/869901557 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+16287 (secure 0 0 0) 0x7ff578023030 con 0x7ff5900a7020 2021-11-12T05:46:29.529 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:46:29.529 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":74,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:46:29.372124+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:46:27.277471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-11-12T05:46:28.337063+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:46:29.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.524+0000 7ff597095700 1 -- 172.21.2.105:0/869901557 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff5740536a0 msgr2=0x7ff574055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:29.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.524+0000 7ff597095700 1 --2- 172.21.2.105:0/869901557 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff5740536a0 0x7ff574055b60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7ff580009000 tx=0x7ff580008040).stop 2021-11-12T05:46:29.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.524+0000 7ff597095700 1 -- 172.21.2.105:0/869901557 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff5900a7020 msgr2=0x7ff5900aa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:29.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.524+0000 7ff597095700 1 --2- 172.21.2.105:0/869901557 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff5900a7020 0x7ff5900aa3d0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7ff578001370 tx=0x7ff578015000).stop 2021-11-12T05:46:29.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.524+0000 7ff597095700 1 -- 172.21.2.105:0/869901557 shutdown_connections 2021-11-12T05:46:29.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.524+0000 7ff597095700 1 --2- 172.21.2.105:0/869901557 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff5740536a0 0x7ff574055b60 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:29.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.524+0000 7ff597095700 1 --2- 172.21.2.105:0/869901557 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff59014a9b0 0x7ff5900ab680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:29.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.524+0000 7ff597095700 1 --2- 172.21.2.105:0/869901557 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff5900a7020 0x7ff5900aa3d0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:29.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.524+0000 7ff597095700 1 --2- 172.21.2.105:0/869901557 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff570004500 0x7ff590147190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:29.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.524+0000 7ff597095700 1 -- 172.21.2.105:0/869901557 >> 172.21.2.105:0/869901557 conn(0x7ff5900b5370 msgr2=0x7ff59005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:29.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.524+0000 7ff597095700 1 -- 172.21.2.105:0/869901557 shutdown_connections 2021-11-12T05:46:29.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.524+0000 7ff597095700 1 -- 172.21.2.105:0/869901557 wait complete. 2021-11-12T05:46:29.537 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:46:29.588 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.584+0000 7fd1bd3b0700 1 Processor -- start 2021-11-12T05:46:29.588 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.584+0000 7fd1bd3b0700 1 -- start start 2021-11-12T05:46:29.590 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.584+0000 7fd1bd3b0700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd1b80ac280 0x7fd1b814b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:29.590 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.584+0000 7fd1bd3b0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd1b80af730 0x7fd1b80ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:29.590 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.584+0000 7fd1bd3b0700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1b80ac7b0 con 0x7fd1b80ad080 2021-11-12T05:46:29.590 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.584+0000 7fd1bd3b0700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1b81488a0 con 0x7fd1b80ac280 2021-11-12T05:46:29.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.584+0000 7fd1bd3b0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b80ac9e0 con 0x7fd1b80af730 2021-11-12T05:46:29.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.584+0000 7fd1b67fc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd1b80ac280 0x7fd1b814b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:29.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.584+0000 7fd1b67fc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd1b80ac280 0x7fd1b814b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47374/0 (socket says 172.21.2.105:47374) 2021-11-12T05:46:29.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.584+0000 7fd1b67fc700 1 -- 172.21.2.105:0/1128055479 learned_addr learned my addr 172.21.2.105:0/1128055479 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:29.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.584+0000 7fd1b67fc700 1 -- 172.21.2.105:0/1128055479 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd1b80af730 msgr2=0x7fd1b80ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:29.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.584+0000 7fd1b67fc700 1 --2- 172.21.2.105:0/1128055479 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd1b80af730 0x7fd1b80ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:29.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.584+0000 7fd1b67fc700 1 -- 172.21.2.105:0/1128055479 >> v1:172.21.2.115:6789/0 conn(0x7fd1b80ad080 legacy=0x7fd1b814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:29.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.584+0000 7fd1b67fc700 1 -- 172.21.2.105:0/1128055479 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b80b0b30 con 0x7fd1b80ac280 2021-11-12T05:46:29.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.584+0000 7fd1b67fc700 1 --2- 172.21.2.105:0/1128055479 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1b80ac280 0x7fd1b814b2f0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7fd1b80b6060 tx=0x7fd1ac006eb0).ready entity=mon.0 client_cookie=ee63f1b88d990f7f server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:29.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.584+0000 7fd1b5ffb700 1 -- 172.21.2.105:0/1128055479 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1ac00d570 con 0x7fd1b80ac280 2021-11-12T05:46:29.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.584+0000 7fd1b5ffb700 1 -- 172.21.2.105:0/1128055479 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ac000e90 con 0x7fd1b80ac280 2021-11-12T05:46:29.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.584+0000 7fd1b5ffb700 1 -- 172.21.2.105:0/1128055479 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1ac00d8c0 con 0x7fd1b80ac280 2021-11-12T05:46:29.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.584+0000 7fd1bd3b0700 1 -- 172.21.2.105:0/1128055479 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1b80ac280 msgr2=0x7fd1b814b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:29.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.584+0000 7fd1bd3b0700 1 --2- 172.21.2.105:0/1128055479 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1b80ac280 0x7fd1b814b2f0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7fd1b80b6060 tx=0x7fd1ac006eb0).stop 2021-11-12T05:46:29.594 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.584+0000 7fd1bd3b0700 1 -- 172.21.2.105:0/1128055479 shutdown_connections 2021-11-12T05:46:29.594 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.584+0000 7fd1bd3b0700 1 --2- 172.21.2.105:0/1128055479 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd1b80af730 0x7fd1b80ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:29.594 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.584+0000 7fd1bd3b0700 1 --2- 172.21.2.105:0/1128055479 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1b80ac280 0x7fd1b814b2f0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:29.594 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.584+0000 7fd1bd3b0700 1 -- 172.21.2.105:0/1128055479 >> 172.21.2.105:0/1128055479 conn(0x7fd1b80b5370 msgr2=0x7fd1b80b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:29.594 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.584+0000 7fd1bd3b0700 1 -- 172.21.2.105:0/1128055479 shutdown_connections 2021-11-12T05:46:29.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.584+0000 7fd1bd3b0700 1 -- 172.21.2.105:0/1128055479 wait complete. 2021-11-12T05:46:29.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.588+0000 7fd1bd3b0700 1 Processor -- start 2021-11-12T05:46:29.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.588+0000 7fd1bd3b0700 1 -- start start 2021-11-12T05:46:29.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.588+0000 7fd1bd3b0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1b80ac280 0x7fd1b8156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:29.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.588+0000 7fd1bd3b0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd1b80ad080 0x7fd1b80ab640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:29.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.588+0000 7fd1bd3b0700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd1b80af730 0x7fd1b80a9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:29.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.588+0000 7fd1bd3b0700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b81433e0 con 0x7fd1b80ac280 2021-11-12T05:46:29.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.588+0000 7fd1bd3b0700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b80aac60 con 0x7fd1b80af730 2021-11-12T05:46:29.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.588+0000 7fd1bd3b0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b80aaf00 con 0x7fd1b80ad080 2021-11-12T05:46:29.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.588+0000 7fd1b6ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1b80ac280 0x7fd1b8156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:29.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.588+0000 7fd1b6ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1b80ac280 0x7fd1b8156bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47378/0 (socket says 172.21.2.105:47378) 2021-11-12T05:46:29.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.588+0000 7fd1b6ffd700 1 -- 172.21.2.105:0/182950647 learned_addr learned my addr 172.21.2.105:0/182950647 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:29.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.588+0000 7fd1b6ffd700 1 -- 172.21.2.105:0/182950647 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd1b80ad080 msgr2=0x7fd1b80ab640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:29.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.588+0000 7fd1b6ffd700 1 --2- 172.21.2.105:0/182950647 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd1b80ad080 0x7fd1b80ab640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:29.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.588+0000 7fd1b6ffd700 1 -- 172.21.2.105:0/182950647 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd1b80af730 msgr2=0x7fd1b80a9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:29.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.588+0000 7fd1b6ffd700 1 --2- 172.21.2.105:0/182950647 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd1b80af730 0x7fd1b80a9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:29.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.588+0000 7fd1b6ffd700 1 -- 172.21.2.105:0/182950647 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ac00b1e0 con 0x7fd1b80ac280 2021-11-12T05:46:29.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.588+0000 7fd1b6ffd700 1 --2- 172.21.2.105:0/182950647 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1b80ac280 0x7fd1b8156bf0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7fd1a8002f90 tx=0x7fd1a8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:29.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.588+0000 7fd1a7fff700 1 -- 172.21.2.105:0/182950647 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1a8013460 con 0x7fd1b80ac280 2021-11-12T05:46:29.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.588+0000 7fd1a7fff700 1 -- 172.21.2.105:0/182950647 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a80135c0 con 0x7fd1b80ac280 2021-11-12T05:46:29.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.588+0000 7fd1a7fff700 1 -- 172.21.2.105:0/182950647 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1a8013920 con 0x7fd1b80ac280 2021-11-12T05:46:29.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.588+0000 7fd1bd3b0700 1 -- 172.21.2.105:0/182950647 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b80ab1a0 con 0x7fd1b80ac280 2021-11-12T05:46:29.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.588+0000 7fd1bd3b0700 1 -- 172.21.2.105:0/182950647 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1b80aa7e0 con 0x7fd1b80ac280 2021-11-12T05:46:29.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.588+0000 7fd1bd3b0700 1 -- 172.21.2.105:0/182950647 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1b80ab330 con 0x7fd1b80ac280 2021-11-12T05:46:29.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.588+0000 7fd1a7fff700 1 -- 172.21.2.105:0/182950647 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd1a800f070 con 0x7fd1b80ac280 2021-11-12T05:46:29.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.588+0000 7fd1a7fff700 1 --2- 172.21.2.105:0/182950647 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd1940536a0 0x7fd194055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:29.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.588+0000 7fd1a7fff700 1 -- 172.21.2.105:0/182950647 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fd1a806b260 con 0x7fd1b80ac280 2021-11-12T05:46:29.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.588+0000 7fd1b67fc700 1 --2- 172.21.2.105:0/182950647 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd1940536a0 0x7fd194055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:29.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.588+0000 7fd1b67fc700 1 --2- 172.21.2.105:0/182950647 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd1940536a0 0x7fd194055b60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7fd1b80b6060 tx=0x7fd1ac015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:29.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.592+0000 7fd1a7fff700 1 -- 172.21.2.105:0/182950647 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd1a8042270 con 0x7fd1b80ac280 2021-11-12T05:46:29.679 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.676+0000 7fd1bd3b0700 1 -- 172.21.2.105:0/182950647 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1b80b1440 con 0x7fd1b80ac280 2021-11-12T05:46:29.679 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.676+0000 7fd1a7fff700 1 -- 172.21.2.105:0/182950647 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+16287 (secure 0 0 0) 0x7fd1a8045890 con 0x7fd1b80ac280 2021-11-12T05:46:29.680 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:46:29.680 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":74,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:46:29.372124+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:46:27.277471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-11-12T05:46:28.337063+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:46:29.681 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.676+0000 7fd1bd3b0700 1 -- 172.21.2.105:0/182950647 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd1940536a0 msgr2=0x7fd194055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:29.681 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.676+0000 7fd1bd3b0700 1 --2- 172.21.2.105:0/182950647 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd1940536a0 0x7fd194055b60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7fd1b80b6060 tx=0x7fd1ac015000).stop 2021-11-12T05:46:29.681 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.676+0000 7fd1bd3b0700 1 -- 172.21.2.105:0/182950647 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1b80ac280 msgr2=0x7fd1b8156bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:29.682 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.676+0000 7fd1bd3b0700 1 --2- 172.21.2.105:0/182950647 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1b80ac280 0x7fd1b8156bf0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7fd1a8002f90 tx=0x7fd1a8006df0).stop 2021-11-12T05:46:29.682 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.676+0000 7fd1bd3b0700 1 -- 172.21.2.105:0/182950647 shutdown_connections 2021-11-12T05:46:29.682 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.676+0000 7fd1bd3b0700 1 --2- 172.21.2.105:0/182950647 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd1940536a0 0x7fd194055b60 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:29.682 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.676+0000 7fd1bd3b0700 1 --2- 172.21.2.105:0/182950647 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd1b80af730 0x7fd1b80a9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:29.683 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.676+0000 7fd1bd3b0700 1 --2- 172.21.2.105:0/182950647 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd1b80ad080 0x7fd1b80ab640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:29.683 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.676+0000 7fd1bd3b0700 1 --2- 172.21.2.105:0/182950647 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd1b80ac280 0x7fd1b8156bf0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:29.683 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.676+0000 7fd1bd3b0700 1 -- 172.21.2.105:0/182950647 >> 172.21.2.105:0/182950647 conn(0x7fd1b80b5370 msgr2=0x7fd1b80b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:29.683 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.676+0000 7fd1bd3b0700 1 -- 172.21.2.105:0/182950647 shutdown_connections 2021-11-12T05:46:29.683 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.676+0000 7fd1bd3b0700 1 -- 172.21.2.105:0/182950647 wait complete. 2021-11-12T05:46:29.687 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-12T05:46:29.739 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f0ddfe700 1 Processor -- start 2021-11-12T05:46:29.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f0ddfe700 1 -- start start 2021-11-12T05:46:29.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f0ddfe700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8f080b2e20 0x7f8f080b1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:29.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f0ddfe700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f080ad400 con 0x7f8f08142c50 2021-11-12T05:46:29.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f0ddfe700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f080b3200 con 0x7f8f0813ea50 2021-11-12T05:46:29.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f0ddfe700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f080ad660 con 0x7f8f080b2e20 2021-11-12T05:46:29.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f07fff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f8f08142c50 0x7f8f081430c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57784/0 (socket says 172.21.2.105:57784) 2021-11-12T05:46:29.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f07fff700 1 -- 172.21.2.105:0/2681046422 learned_addr learned my addr 172.21.2.105:0/2681046422 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:46:29.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f067fc700 1 -- 172.21.2.105:0/2681046422 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1630164465 0 0) 0x7f8f080ad400 con 0x7f8f08142c50 2021-11-12T05:46:29.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f067fc700 1 -- 172.21.2.105:0/2681046422 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ee8003260 con 0x7f8f08142c50 2021-11-12T05:46:29.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f077fe700 1 --2- 172.21.2.105:0/2681046422 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8f080b2e20 0x7f8f080b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:29.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f067fc700 1 -- 172.21.2.105:0/2681046422 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2617684998 0 0) 0x7f8ee8003260 con 0x7f8f08142c50 2021-11-12T05:46:29.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f067fc700 1 -- 172.21.2.105:0/2681046422 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8f080b2e20 msgr2=0x7f8f080b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:29.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f067fc700 1 --2- 172.21.2.105:0/2681046422 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8f080b2e20 0x7f8f080b1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:29.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f067fc700 1 -- 172.21.2.105:0/2681046422 >> v1:172.21.2.115:6789/0 conn(0x7f8f0813ea50 legacy=0x7f8f0813ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:29.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f067fc700 1 -- 172.21.2.105:0/2681046422 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f080ad900 con 0x7f8f08142c50 2021-11-12T05:46:29.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f067fc700 1 -- 172.21.2.105:0/2681046422 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f8f00001a00 con 0x7f8f08142c50 2021-11-12T05:46:29.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f067fc700 1 -- 172.21.2.105:0/2681046422 >> v1:172.21.2.105:6789/0 conn(0x7f8f08142c50 legacy=0x7f8f081430c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:29.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f067fc700 1 --2- 172.21.2.105:0/2681046422 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8ee8003800 0x7f8ee8003c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:29.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f067fc700 1 --2- 172.21.2.105:0/2681046422 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8ee8004500 0x7f8ee8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:29.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f067fc700 1 --2- 172.21.2.105:0/2681046422 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8f080b2e20 0x7f8ee800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:29.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f067fc700 1 -- 172.21.2.105:0/2681046422 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f080ad660 con 0x7f8ee8004500 2021-11-12T05:46:29.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f067fc700 1 -- 172.21.2.105:0/2681046422 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee8005290 con 0x7f8ee8003800 2021-11-12T05:46:29.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f067fc700 1 -- 172.21.2.105:0/2681046422 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee800bc40 con 0x7f8f080b2e20 2021-11-12T05:46:29.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f06ffd700 1 --2- 172.21.2.105:0/2681046422 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8ee8004500 0x7f8ee8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:29.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f077fe700 1 --2- 172.21.2.105:0/2681046422 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8ee8003800 0x7f8ee8003c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:29.750 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f07fff700 1 --2- 172.21.2.105:0/2681046422 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8f080b2e20 0x7f8ee800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:29.750 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f06ffd700 1 -- 172.21.2.105:0/2681046422 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8f080b2e20 msgr2=0x7f8ee800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:29.750 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f06ffd700 1 --2- 172.21.2.105:0/2681046422 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8f080b2e20 0x7f8ee800b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:29.750 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f06ffd700 1 -- 172.21.2.105:0/2681046422 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8ee8003800 msgr2=0x7f8ee8003c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:29.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f06ffd700 1 --2- 172.21.2.105:0/2681046422 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8ee8003800 0x7f8ee8003c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:29.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f06ffd700 1 -- 172.21.2.105:0/2681046422 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee8003260 con 0x7f8ee8004500 2021-11-12T05:46:29.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f07fff700 1 --2- 172.21.2.105:0/2681046422 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8f080b2e20 0x7f8ee800b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:46:29.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f077fe700 1 --2- 172.21.2.105:0/2681046422 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8ee8003800 0x7f8ee8003c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:46:29.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f06ffd700 1 --2- 172.21.2.105:0/2681046422 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8ee8004500 0x7f8ee8004980 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7f8ef0001fa0 tx=0x7f8ef0007a00).ready entity=mon.0 client_cookie=63cd9ab00f98757e server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:29.752 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f067fc700 1 -- 172.21.2.105:0/2681046422 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ef0007070 con 0x7f8ee8004500 2021-11-12T05:46:29.752 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f067fc700 1 -- 172.21.2.105:0/2681046422 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef00071d0 con 0x7f8ee8004500 2021-11-12T05:46:29.752 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f067fc700 1 -- 172.21.2.105:0/2681046422 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ef0006510 con 0x7f8ee8004500 2021-11-12T05:46:29.752 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f0ddfe700 1 -- 172.21.2.105:0/2681046422 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8ee8004500 msgr2=0x7f8ee8004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:29.753 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f0ddfe700 1 --2- 172.21.2.105:0/2681046422 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8ee8004500 0x7f8ee8004980 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7f8ef0001fa0 tx=0x7f8ef0007a00).stop 2021-11-12T05:46:29.753 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f07fff700 1 -- 172.21.2.105:0/2681046422 reap_dead start 2021-11-12T05:46:29.753 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f0ddfe700 1 -- 172.21.2.105:0/2681046422 shutdown_connections 2021-11-12T05:46:29.753 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f0ddfe700 1 -- 172.21.2.105:0/2681046422 >> 172.21.2.105:0/2681046422 conn(0x7f8f08062f60 msgr2=0x7f8f08063370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:29.753 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f0ddfe700 1 -- 172.21.2.105:0/2681046422 shutdown_connections 2021-11-12T05:46:29.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.736+0000 7f8f0ddfe700 1 -- 172.21.2.105:0/2681046422 wait complete. 2021-11-12T05:46:29.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.740+0000 7f8f0ddfe700 1 Processor -- start 2021-11-12T05:46:29.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.740+0000 7f8f0ddfe700 1 -- start start 2021-11-12T05:46:29.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.740+0000 7f8f0ddfe700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8f080b5e30 0x7f8f080b5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:29.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.740+0000 7f8f0ddfe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8f080657e0 0x7f8f08067150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:29.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.740+0000 7f8f0ddfe700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8f08067640 0x7f8f08151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:29.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.740+0000 7f8f0ddfe700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f080b6560 con 0x7f8f080657e0 2021-11-12T05:46:29.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.740+0000 7f8f0ddfe700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f080b4080 con 0x7f8f08067640 2021-11-12T05:46:29.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.740+0000 7f8f0ddfe700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f080b6800 con 0x7f8f080b5e30 2021-11-12T05:46:29.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.740+0000 7f8f06ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8f080657e0 0x7f8f08067150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:29.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.740+0000 7f8f06ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8f080657e0 0x7f8f08067150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47396/0 (socket says 172.21.2.105:47396) 2021-11-12T05:46:29.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.740+0000 7f8f06ffd700 1 -- 172.21.2.105:0/2584480413 learned_addr learned my addr 172.21.2.105:0/2584480413 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:29.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.740+0000 7f8f07fff700 1 --2- 172.21.2.105:0/2584480413 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8f08067640 0x7f8f08151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:29.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.740+0000 7f8f077fe700 1 --2- 172.21.2.105:0/2584480413 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8f080b5e30 0x7f8f080b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:29.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.740+0000 7f8f06ffd700 1 -- 172.21.2.105:0/2584480413 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8f080b5e30 msgr2=0x7f8f080b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:29.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.740+0000 7f8f06ffd700 1 --2- 172.21.2.105:0/2584480413 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8f080b5e30 0x7f8f080b5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:29.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.740+0000 7f8f06ffd700 1 -- 172.21.2.105:0/2584480413 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8f08067640 msgr2=0x7f8f08151670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:29.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.740+0000 7f8f06ffd700 1 --2- 172.21.2.105:0/2584480413 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8f08067640 0x7f8f08151670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:29.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.740+0000 7f8f06ffd700 1 -- 172.21.2.105:0/2584480413 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f080b6210 con 0x7f8f080657e0 2021-11-12T05:46:29.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.740+0000 7f8f06ffd700 1 --2- 172.21.2.105:0/2584480413 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8f080657e0 0x7f8f08067150 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7f8ef0001fa0 tx=0x7f8ef0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:29.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.740+0000 7f8f04ff9700 1 -- 172.21.2.105:0/2584480413 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ef0007070 con 0x7f8f080657e0 2021-11-12T05:46:29.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.740+0000 7f8f04ff9700 1 -- 172.21.2.105:0/2584480413 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef0000e90 con 0x7f8f080657e0 2021-11-12T05:46:29.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.740+0000 7f8f04ff9700 1 -- 172.21.2.105:0/2584480413 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ef0014600 con 0x7f8f080657e0 2021-11-12T05:46:29.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.740+0000 7f8f0ddfe700 1 -- 172.21.2.105:0/2584480413 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f080b6560 con 0x7f8f080657e0 2021-11-12T05:46:29.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.740+0000 7f8f0ddfe700 1 -- 172.21.2.105:0/2584480413 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f08151b60 con 0x7f8f080657e0 2021-11-12T05:46:29.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.740+0000 7f8f0ddfe700 1 -- 172.21.2.105:0/2584480413 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f080b2060 con 0x7f8f080657e0 2021-11-12T05:46:29.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.740+0000 7f8f04ff9700 1 -- 172.21.2.105:0/2584480413 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8ef0014760 con 0x7f8f080657e0 2021-11-12T05:46:29.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.740+0000 7f8f04ff9700 1 --2- 172.21.2.105:0/2584480413 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8eec053610 0x7f8eec055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:29.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.740+0000 7f8f04ff9700 1 -- 172.21.2.105:0/2584480413 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f8ef006f240 con 0x7f8f080657e0 2021-11-12T05:46:29.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.740+0000 7f8f077fe700 1 --2- 172.21.2.105:0/2584480413 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8eec053610 0x7f8eec055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:29.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.740+0000 7f8f077fe700 1 --2- 172.21.2.105:0/2584480413 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8eec053610 0x7f8eec055ad0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f8ef800c000 tx=0x7f8ef8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:29.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.744+0000 7f8f04ff9700 1 -- 172.21.2.105:0/2584480413 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8ef0046250 con 0x7f8f080657e0 2021-11-12T05:46:29.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:29.852+0000 7f8f0ddfe700 1 -- 172.21.2.105:0/2584480413 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8f08057350 con 0x7f8f080657e0 2021-11-12T05:46:30.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.380+0000 7f8f04ff9700 1 -- 172.21.2.105:0/2584480413 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8ef0049870 con 0x7f8f080657e0 2021-11-12T05:46:30.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.388+0000 7f8f0ddfe700 1 -- 172.21.2.105:0/2584480413 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8eec053610 msgr2=0x7f8eec055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:30.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.388+0000 7f8f0ddfe700 1 --2- 172.21.2.105:0/2584480413 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8eec053610 0x7f8eec055ad0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f8ef800c000 tx=0x7f8ef8008040).stop 2021-11-12T05:46:30.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.388+0000 7f8f0ddfe700 1 -- 172.21.2.105:0/2584480413 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8f080657e0 msgr2=0x7f8f08067150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:30.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.388+0000 7f8f0ddfe700 1 --2- 172.21.2.105:0/2584480413 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8f080657e0 0x7f8f08067150 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7f8ef0001fa0 tx=0x7f8ef0015000).stop 2021-11-12T05:46:30.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.388+0000 7f8f0ddfe700 1 -- 172.21.2.105:0/2584480413 shutdown_connections 2021-11-12T05:46:30.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.388+0000 7f8f0ddfe700 1 --2- 172.21.2.105:0/2584480413 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8eec053610 0x7f8eec055ad0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:30.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.388+0000 7f8f0ddfe700 1 --2- 172.21.2.105:0/2584480413 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8f08067640 0x7f8f08151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:30.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.388+0000 7f8f0ddfe700 1 --2- 172.21.2.105:0/2584480413 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8f080657e0 0x7f8f08067150 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:30.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.388+0000 7f8f0ddfe700 1 --2- 172.21.2.105:0/2584480413 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8f080b5e30 0x7f8f080b5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:30.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.388+0000 7f8f0ddfe700 1 -- 172.21.2.105:0/2584480413 >> 172.21.2.105:0/2584480413 conn(0x7f8f08062f60 msgr2=0x7f8f0813ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:30.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.388+0000 7f8f0ddfe700 1 -- 172.21.2.105:0/2584480413 shutdown_connections 2021-11-12T05:46:30.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.388+0000 7f8f0ddfe700 1 -- 172.21.2.105:0/2584480413 wait complete. 2021-11-12T05:46:30.404 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:46:30.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.452+0000 7fb727720700 1 Processor -- start 2021-11-12T05:46:30.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.452+0000 7fb727720700 1 -- start start 2021-11-12T05:46:30.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.452+0000 7fb727720700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fb7200b2940 0x7fb720142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:30.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.452+0000 7fb727720700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb7200b0cc0 0x7fb72005c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:30.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.452+0000 7fb727720700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7200b2d20 con 0x7fb7200b0780 2021-11-12T05:46:30.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.452+0000 7fb727720700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7200b1fc0 con 0x7fb7200b2940 2021-11-12T05:46:30.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.452+0000 7fb727720700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7200b15e0 con 0x7fb7200b0cc0 2021-11-12T05:46:30.458 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.452+0000 7fb725cbd700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb7200b0cc0 0x7fb72005c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:30.458 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.452+0000 7fb7254bc700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fb7200b2940 0x7fb720142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:30.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.452+0000 7fb725cbd700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb7200b0cc0 0x7fb72005c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3301/0 says I am v2:172.21.2.105:38594/0 (socket says 172.21.2.105:38594) 2021-11-12T05:46:30.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.452+0000 7fb7254bc700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fb7200b2940 0x7fb720142dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3300/0 says I am v2:172.21.2.105:36346/0 (socket says 172.21.2.105:36346) 2021-11-12T05:46:30.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.452+0000 7fb725cbd700 1 -- 172.21.2.105:0/144637079 learned_addr learned my addr 172.21.2.105:0/144637079 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:30.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.452+0000 7fb724cbb700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7fb7200b0780 0x7fb7201432b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:56268/0 (socket says 172.21.2.105:56268) 2021-11-12T05:46:30.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.452+0000 7fb725cbd700 1 -- 172.21.2.105:0/144637079 >> v2:172.21.2.115:3300/0 conn(0x7fb7200b2940 msgr2=0x7fb720142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:30.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.452+0000 7fb725cbd700 1 --2- 172.21.2.105:0/144637079 >> v2:172.21.2.115:3300/0 conn(0x7fb7200b2940 0x7fb720142dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:30.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.452+0000 7fb725cbd700 1 -- 172.21.2.105:0/144637079 >> v1:172.21.2.115:6789/0 conn(0x7fb7200b0780 legacy=0x7fb7201432b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:30.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.452+0000 7fb725cbd700 1 -- 172.21.2.105:0/144637079 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7200b1880 con 0x7fb7200b0cc0 2021-11-12T05:46:30.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.452+0000 7fb725cbd700 1 --2- 172.21.2.105:0/144637079 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb7200b0cc0 0x7fb72005c490 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fb7180032f0 tx=0x7fb718009290).ready entity=mon.2 client_cookie=4f0dbec2e299cf0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:30.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.452+0000 7fb713fff700 1 -- 172.21.2.105:0/144637079 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb71800b8a0 con 0x7fb7200b0cc0 2021-11-12T05:46:30.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.452+0000 7fb713fff700 1 -- 172.21.2.105:0/144637079 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71800ba00 con 0x7fb7200b0cc0 2021-11-12T05:46:30.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.452+0000 7fb713fff700 1 -- 172.21.2.105:0/144637079 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb71800bb70 con 0x7fb7200b0cc0 2021-11-12T05:46:30.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.456+0000 7fb727720700 1 -- 172.21.2.105:0/144637079 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb7200b0cc0 msgr2=0x7fb72005c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:30.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.456+0000 7fb727720700 1 --2- 172.21.2.105:0/144637079 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb7200b0cc0 0x7fb72005c490 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fb7180032f0 tx=0x7fb718009290).stop 2021-11-12T05:46:30.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.456+0000 7fb727720700 1 -- 172.21.2.105:0/144637079 shutdown_connections 2021-11-12T05:46:30.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.456+0000 7fb727720700 1 --2- 172.21.2.105:0/144637079 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb7200b0cc0 0x7fb72005c490 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:30.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.456+0000 7fb727720700 1 --2- 172.21.2.105:0/144637079 >> v2:172.21.2.115:3300/0 conn(0x7fb7200b2940 0x7fb720142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:30.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.456+0000 7fb727720700 1 -- 172.21.2.105:0/144637079 >> 172.21.2.105:0/144637079 conn(0x7fb720068440 msgr2=0x7fb720062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:30.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.456+0000 7fb727720700 1 -- 172.21.2.105:0/144637079 shutdown_connections 2021-11-12T05:46:30.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.456+0000 7fb727720700 1 -- 172.21.2.105:0/144637079 wait complete. 2021-11-12T05:46:30.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.456+0000 7fb727720700 1 Processor -- start 2021-11-12T05:46:30.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.456+0000 7fb727720700 1 -- start start 2021-11-12T05:46:30.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.456+0000 7fb727720700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb7200b0780 0x7fb72013bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:30.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.456+0000 7fb727720700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb7200b0cc0 0x7fb72013f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:30.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.456+0000 7fb727720700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb7200b2940 0x7fb72013fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:30.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.456+0000 7fb727720700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb720153a70 con 0x7fb7200b0780 2021-11-12T05:46:30.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.456+0000 7fb727720700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb720156ce0 con 0x7fb7200b2940 2021-11-12T05:46:30.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.456+0000 7fb727720700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb72013c460 con 0x7fb7200b0cc0 2021-11-12T05:46:30.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.456+0000 7fb7254bc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb7200b0780 0x7fb72013bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:30.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.456+0000 7fb7254bc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb7200b0780 0x7fb72013bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47410/0 (socket says 172.21.2.105:47410) 2021-11-12T05:46:30.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.456+0000 7fb7254bc700 1 -- 172.21.2.105:0/1886984392 learned_addr learned my addr 172.21.2.105:0/1886984392 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:30.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.456+0000 7fb724cbb700 1 --2- 172.21.2.105:0/1886984392 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb7200b0cc0 0x7fb72013f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:30.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.456+0000 7fb725cbd700 1 --2- 172.21.2.105:0/1886984392 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb7200b2940 0x7fb72013fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:30.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.456+0000 7fb7254bc700 1 -- 172.21.2.105:0/1886984392 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb7200b0cc0 msgr2=0x7fb72013f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:30.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.456+0000 7fb7254bc700 1 --2- 172.21.2.105:0/1886984392 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb7200b0cc0 0x7fb72013f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:30.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.456+0000 7fb7254bc700 1 -- 172.21.2.105:0/1886984392 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb7200b2940 msgr2=0x7fb72013fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:30.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.456+0000 7fb7254bc700 1 --2- 172.21.2.105:0/1886984392 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb7200b2940 0x7fb72013fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:30.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.456+0000 7fb7254bc700 1 -- 172.21.2.105:0/1886984392 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb718009530 con 0x7fb7200b0780 2021-11-12T05:46:30.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.456+0000 7fb7254bc700 1 --2- 172.21.2.105:0/1886984392 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb7200b0780 0x7fb72013bae0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7fb71400c000 tx=0x7fb714006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:30.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.456+0000 7fb7127fc700 1 -- 172.21.2.105:0/1886984392 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb714010780 con 0x7fb7200b0780 2021-11-12T05:46:30.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.456+0000 7fb7127fc700 1 -- 172.21.2.105:0/1886984392 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7140108e0 con 0x7fb7200b0780 2021-11-12T05:46:30.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.456+0000 7fb7127fc700 1 -- 172.21.2.105:0/1886984392 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb714010c40 con 0x7fb7200b0780 2021-11-12T05:46:30.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.456+0000 7fb727720700 1 -- 172.21.2.105:0/1886984392 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb720156910 con 0x7fb7200b0780 2021-11-12T05:46:30.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.456+0000 7fb727720700 1 -- 172.21.2.105:0/1886984392 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb72013c1f0 con 0x7fb7200b0780 2021-11-12T05:46:30.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.456+0000 7fb727720700 1 -- 172.21.2.105:0/1886984392 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb720156b30 con 0x7fb7200b0780 2021-11-12T05:46:30.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.456+0000 7fb7127fc700 1 -- 172.21.2.105:0/1886984392 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb71401c460 con 0x7fb7200b0780 2021-11-12T05:46:30.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.456+0000 7fb7127fc700 1 --2- 172.21.2.105:0/1886984392 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb700053580 0x7fb700055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:30.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.456+0000 7fb7127fc700 1 -- 172.21.2.105:0/1886984392 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fb71406bee0 con 0x7fb7200b0780 2021-11-12T05:46:30.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.456+0000 7fb724cbb700 1 --2- 172.21.2.105:0/1886984392 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb700053580 0x7fb700055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:30.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.456+0000 7fb724cbb700 1 --2- 172.21.2.105:0/1886984392 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb700053580 0x7fb700055a40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7fb71c00b000 tx=0x7fb71c007160).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:30.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.460+0000 7fb7127fc700 1 -- 172.21.2.105:0/1886984392 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb714042e90 con 0x7fb7200b0780 2021-11-12T05:46:30.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.572+0000 7fb727720700 1 -- 172.21.2.105:0/1886984392 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb72013c620 con 0x7fb7200b0780 2021-11-12T05:46:30.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.572+0000 7fb7127fc700 1 -- 172.21.2.105:0/1886984392 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+2140 (secure 0 0 0) 0x7fb7140464b0 con 0x7fb7200b0780 2021-11-12T05:46:30.576 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:46:30.576 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":31,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/1423088351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":1423088351},{"type":"v1","addr":"172.21.2.115:6833","nonce":1423088351}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:46:29.372216+0000","modified":"2021-11-12T05:46:30.375936+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6309":{"gid":6309,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/1837795491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":1837795491},{"type":"v1","addr":"172.21.2.105:6835","nonce":1837795491}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-11-12T05:46:30.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.572+0000 7fb727720700 1 -- 172.21.2.105:0/1886984392 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb700053580 msgr2=0x7fb700055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:30.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.572+0000 7fb727720700 1 --2- 172.21.2.105:0/1886984392 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb700053580 0x7fb700055a40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7fb71c00b000 tx=0x7fb71c007160).stop 2021-11-12T05:46:30.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.572+0000 7fb727720700 1 -- 172.21.2.105:0/1886984392 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb7200b0780 msgr2=0x7fb72013bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:30.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.572+0000 7fb727720700 1 --2- 172.21.2.105:0/1886984392 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb7200b0780 0x7fb72013bae0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7fb71400c000 tx=0x7fb714006df0).stop 2021-11-12T05:46:30.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.572+0000 7fb727720700 1 -- 172.21.2.105:0/1886984392 shutdown_connections 2021-11-12T05:46:30.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.572+0000 7fb727720700 1 --2- 172.21.2.105:0/1886984392 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb700053580 0x7fb700055a40 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:30.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.572+0000 7fb727720700 1 --2- 172.21.2.105:0/1886984392 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb7200b2940 0x7fb72013fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:30.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.572+0000 7fb727720700 1 --2- 172.21.2.105:0/1886984392 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb7200b0cc0 0x7fb72013f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:30.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.572+0000 7fb727720700 1 --2- 172.21.2.105:0/1886984392 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb7200b0780 0x7fb72013bae0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:30.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.572+0000 7fb727720700 1 -- 172.21.2.105:0/1886984392 >> 172.21.2.105:0/1886984392 conn(0x7fb720068440 msgr2=0x7fb7200b48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:30.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.572+0000 7fb727720700 1 -- 172.21.2.105:0/1886984392 shutdown_connections 2021-11-12T05:46:30.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.572+0000 7fb727720700 1 -- 172.21.2.105:0/1886984392 wait complete. 2021-11-12T05:46:30.580 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 31 2021-11-12T05:46:30.583 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:46:30.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.628+0000 7f761e544700 1 Processor -- start 2021-11-12T05:46:30.634 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.628+0000 7f761e544700 1 -- start start 2021-11-12T05:46:30.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.628+0000 7f761e544700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f761814b2f0 0x7f76180af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:30.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.628+0000 7f761e544700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76180ac7b0 con 0x7f76180ad080 2021-11-12T05:46:30.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.628+0000 7f761e544700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76180ac9e0 con 0x7f76180ac280 2021-11-12T05:46:30.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.628+0000 7f761e544700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76181488a0 con 0x7f761814b2f0 2021-11-12T05:46:30.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.628+0000 7f7617fff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f76180ad080 0x7f761814abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57814/0 (socket says 172.21.2.105:57814) 2021-11-12T05:46:30.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.628+0000 7f7617fff700 1 -- 172.21.2.105:0/3657092826 learned_addr learned my addr 172.21.2.105:0/3657092826 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:46:30.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f7616ffd700 1 -- 172.21.2.105:0/3657092826 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3555796196 0 0) 0x7f76180ac7b0 con 0x7f76180ad080 2021-11-12T05:46:30.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f7616ffd700 1 -- 172.21.2.105:0/3657092826 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75f8003260 con 0x7f76180ad080 2021-11-12T05:46:30.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f7616ffd700 1 -- 172.21.2.105:0/3657092826 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3232950176 0 0) 0x7f75f8003260 con 0x7f76180ad080 2021-11-12T05:46:30.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f761cae1700 1 --2- 172.21.2.105:0/3657092826 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f761814b2f0 0x7f76180af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:30.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f7616ffd700 1 -- 172.21.2.105:0/3657092826 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f761814b2f0 msgr2=0x7f76180af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:30.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f7616ffd700 1 --2- 172.21.2.105:0/3657092826 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f761814b2f0 0x7f76180af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:30.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f7616ffd700 1 -- 172.21.2.105:0/3657092826 >> v1:172.21.2.115:6789/0 conn(0x7f76180ac280 legacy=0x7f7618147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:30.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f7616ffd700 1 -- 172.21.2.105:0/3657092826 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76180b0b30 con 0x7f76180ad080 2021-11-12T05:46:30.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f7616ffd700 1 -- 172.21.2.105:0/3657092826 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f7600001660 con 0x7f76180ad080 2021-11-12T05:46:30.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f761cae1700 1 --2- 172.21.2.105:0/3657092826 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f761814b2f0 0x7f76180af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:46:30.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f7616ffd700 1 -- 172.21.2.105:0/3657092826 >> v1:172.21.2.105:6789/0 conn(0x7f76180ad080 legacy=0x7f761814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:30.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f7616ffd700 1 --2- 172.21.2.105:0/3657092826 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f75f8003800 0x7f75f8003c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:30.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f7616ffd700 1 --2- 172.21.2.105:0/3657092826 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f761814b2f0 0x7f75f8004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:30.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f7616ffd700 1 --2- 172.21.2.105:0/3657092826 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75f8004bf0 0x7f75f800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:30.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f7616ffd700 1 -- 172.21.2.105:0/3657092826 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76181488a0 con 0x7f75f8004bf0 2021-11-12T05:46:30.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f7616ffd700 1 -- 172.21.2.105:0/3657092826 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f80052a0 con 0x7f75f8003800 2021-11-12T05:46:30.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f7616ffd700 1 -- 172.21.2.105:0/3657092826 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f800bc40 con 0x7f761814b2f0 2021-11-12T05:46:30.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f761cae1700 1 --2- 172.21.2.105:0/3657092826 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75f8004bf0 0x7f75f800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:30.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f7617fff700 1 --2- 172.21.2.105:0/3657092826 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f75f8003800 0x7f75f8003c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:30.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f76177fe700 1 --2- 172.21.2.105:0/3657092826 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f761814b2f0 0x7f75f8004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:30.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f761cae1700 1 -- 172.21.2.105:0/3657092826 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f761814b2f0 msgr2=0x7f75f8004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:30.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f761cae1700 1 --2- 172.21.2.105:0/3657092826 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f761814b2f0 0x7f75f8004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:30.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f761cae1700 1 -- 172.21.2.105:0/3657092826 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f75f8003800 msgr2=0x7f75f8003c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:30.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f761cae1700 1 --2- 172.21.2.105:0/3657092826 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f75f8003800 0x7f75f8003c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:30.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f761cae1700 1 -- 172.21.2.105:0/3657092826 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f8003260 con 0x7f75f8004bf0 2021-11-12T05:46:30.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f76177fe700 1 --2- 172.21.2.105:0/3657092826 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f761814b2f0 0x7f75f8004500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:46:30.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f761cae1700 1 --2- 172.21.2.105:0/3657092826 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75f8004bf0 0x7f75f800b750 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7f7610007000 tx=0x7f7610008040).ready entity=mon.0 client_cookie=2380bd3d240d9259 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:30.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f7616ffd700 1 -- 172.21.2.105:0/3657092826 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f761000c710 con 0x7f75f8004bf0 2021-11-12T05:46:30.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f7616ffd700 1 -- 172.21.2.105:0/3657092826 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f761000c870 con 0x7f75f8004bf0 2021-11-12T05:46:30.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f7616ffd700 1 -- 172.21.2.105:0/3657092826 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f761000c9e0 con 0x7f75f8004bf0 2021-11-12T05:46:30.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f761e544700 1 -- 172.21.2.105:0/3657092826 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75f8004bf0 msgr2=0x7f75f800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:30.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f761e544700 1 --2- 172.21.2.105:0/3657092826 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75f8004bf0 0x7f75f800b750 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7f7610007000 tx=0x7f7610008040).stop 2021-11-12T05:46:30.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f761cae1700 1 -- 172.21.2.105:0/3657092826 reap_dead start 2021-11-12T05:46:30.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f761e544700 1 -- 172.21.2.105:0/3657092826 shutdown_connections 2021-11-12T05:46:30.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f761e544700 1 -- 172.21.2.105:0/3657092826 >> 172.21.2.105:0/3657092826 conn(0x7f76180b5370 msgr2=0x7f76180b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:30.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f761e544700 1 -- 172.21.2.105:0/3657092826 shutdown_connections 2021-11-12T05:46:30.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f761e544700 1 -- 172.21.2.105:0/3657092826 wait complete. 2021-11-12T05:46:30.650 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f761e544700 1 Processor -- start 2021-11-12T05:46:30.650 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f761e544700 1 -- start start 2021-11-12T05:46:30.650 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f761e544700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f75f8004bf0 0x7f7618147fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:30.650 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f761e544700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f76180a8fa0 0x7f761815a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:30.650 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f761e544700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f76180aa8e0 0x7f761815a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:30.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f761e544700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76180a9670 con 0x7f76180a8fa0 2021-11-12T05:46:30.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f761e544700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761815a050 con 0x7f75f8004bf0 2021-11-12T05:46:30.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f761e544700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76180aae60 con 0x7f76180aa8e0 2021-11-12T05:46:30.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f76177fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f76180a8fa0 0x7f761815a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:30.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f76177fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f76180a8fa0 0x7f761815a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47434/0 (socket says 172.21.2.105:47434) 2021-11-12T05:46:30.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.632+0000 7f76177fe700 1 -- 172.21.2.105:0/3764098081 learned_addr learned my addr 172.21.2.105:0/3764098081 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:30.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.636+0000 7f76177fe700 1 -- 172.21.2.105:0/3764098081 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f76180aa8e0 msgr2=0x7f761815a930 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:46:30.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.636+0000 7f76177fe700 1 --2- 172.21.2.105:0/3764098081 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f76180aa8e0 0x7f761815a930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:30.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.636+0000 7f76177fe700 1 -- 172.21.2.105:0/3764098081 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f75f8004bf0 msgr2=0x7f7618147fa0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:46:30.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.636+0000 7f76177fe700 1 --2- 172.21.2.105:0/3764098081 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f75f8004bf0 0x7f7618147fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:30.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.636+0000 7f76177fe700 1 -- 172.21.2.105:0/3764098081 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76180ab100 con 0x7f76180a8fa0 2021-11-12T05:46:30.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.636+0000 7f76177fe700 1 --2- 172.21.2.105:0/3764098081 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f76180a8fa0 0x7f761815a440 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7f7608008000 tx=0x7f7608009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:30.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.636+0000 7f76157fa700 1 -- 172.21.2.105:0/3764098081 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7608007e60 con 0x7f76180a8fa0 2021-11-12T05:46:30.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.636+0000 7f76157fa700 1 -- 172.21.2.105:0/3764098081 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7608000e90 con 0x7f76180a8fa0 2021-11-12T05:46:30.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.636+0000 7f761e544700 1 -- 172.21.2.105:0/3764098081 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76180ab3a0 con 0x7f76180a8fa0 2021-11-12T05:46:30.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.636+0000 7f761e544700 1 -- 172.21.2.105:0/3764098081 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76180630b0 con 0x7f76180a8fa0 2021-11-12T05:46:30.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.636+0000 7f76157fa700 1 -- 172.21.2.105:0/3764098081 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76080106d0 con 0x7f76180a8fa0 2021-11-12T05:46:30.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.636+0000 7f761e544700 1 -- 172.21.2.105:0/3764098081 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76180ab530 con 0x7f76180a8fa0 2021-11-12T05:46:30.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.636+0000 7f76157fa700 1 -- 172.21.2.105:0/3764098081 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7608019030 con 0x7f76180a8fa0 2021-11-12T05:46:30.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.636+0000 7f76157fa700 1 --2- 172.21.2.105:0/3764098081 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f75fc053660 0x7f75fc055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:30.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.636+0000 7f76157fa700 1 -- 172.21.2.105:0/3764098081 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f760806b110 con 0x7f76180a8fa0 2021-11-12T05:46:30.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.636+0000 7f7617fff700 1 --2- 172.21.2.105:0/3764098081 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f75fc053660 0x7f75fc055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:30.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.636+0000 7f7617fff700 1 --2- 172.21.2.105:0/3764098081 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f75fc053660 0x7f75fc055b20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f760000b000 tx=0x7f7600000f80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:30.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.640+0000 7f76157fa700 1 -- 172.21.2.105:0/3764098081 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7608042010 con 0x7f76180a8fa0 2021-11-12T05:46:30.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.720+0000 7f761e544700 1 -- 172.21.2.105:0/3764098081 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76180ab720 con 0x7f76180a8fa0 2021-11-12T05:46:30.726 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.720+0000 7f76157fa700 1 -- 172.21.2.105:0/3764098081 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16274 (secure 0 0 0) 0x7f7608045630 con 0x7f76180a8fa0 2021-11-12T05:46:30.726 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:46:30.727 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":75,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:46:30.377067+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:46:27.277471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-11-12T05:46:28.337063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:46:30.728 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.724+0000 7f761e544700 1 -- 172.21.2.105:0/3764098081 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f75fc053660 msgr2=0x7f75fc055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:30.728 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.724+0000 7f761e544700 1 --2- 172.21.2.105:0/3764098081 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f75fc053660 0x7f75fc055b20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f760000b000 tx=0x7f7600000f80).stop 2021-11-12T05:46:30.728 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.724+0000 7f761e544700 1 -- 172.21.2.105:0/3764098081 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f76180a8fa0 msgr2=0x7f761815a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:30.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.724+0000 7f761e544700 1 --2- 172.21.2.105:0/3764098081 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f76180a8fa0 0x7f761815a440 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7f7608008000 tx=0x7f7608009040).stop 2021-11-12T05:46:30.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.724+0000 7f761e544700 1 -- 172.21.2.105:0/3764098081 shutdown_connections 2021-11-12T05:46:30.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.724+0000 7f761e544700 1 --2- 172.21.2.105:0/3764098081 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f75fc053660 0x7f75fc055b20 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:30.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.724+0000 7f761e544700 1 --2- 172.21.2.105:0/3764098081 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f76180aa8e0 0x7f761815a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:30.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.724+0000 7f761e544700 1 --2- 172.21.2.105:0/3764098081 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f76180a8fa0 0x7f761815a440 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:30.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.724+0000 7f761e544700 1 --2- 172.21.2.105:0/3764098081 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f75f8004bf0 0x7f7618147fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:30.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.724+0000 7f761e544700 1 -- 172.21.2.105:0/3764098081 >> 172.21.2.105:0/3764098081 conn(0x7f76180b5370 msgr2=0x7f7618143c60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:30.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.724+0000 7f761e544700 1 -- 172.21.2.105:0/3764098081 shutdown_connections 2021-11-12T05:46:30.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.724+0000 7f761e544700 1 -- 172.21.2.105:0/3764098081 wait complete. 2021-11-12T05:46:30.734 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-12T05:46:30.789 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.784+0000 7f27294e8700 1 Processor -- start 2021-11-12T05:46:30.790 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.784+0000 7f27294e8700 1 -- start start 2021-11-12T05:46:30.790 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.784+0000 7f27294e8700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f27240b5ac0 0x7f27240b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:30.790 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.784+0000 7f27294e8700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f27240b01b0 0x7f27240ae470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:30.790 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.784+0000 7f27294e8700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f27240ae960 0x7f27240aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:30.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.784+0000 7f27294e8700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27240b5ea0 con 0x7f27240b5ac0 2021-11-12T05:46:30.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.784+0000 7f27294e8700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27240b1a60 con 0x7f27240ae960 2021-11-12T05:46:30.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.784+0000 7f27294e8700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27240accd0 con 0x7f27240b01b0 2021-11-12T05:46:30.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.784+0000 7f2722ffd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f27240b5ac0 0x7f27240b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:30.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.784+0000 7f2722ffd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f27240b5ac0 0x7f27240b13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47438/0 (socket says 172.21.2.105:47438) 2021-11-12T05:46:30.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.784+0000 7f2722ffd700 1 -- 172.21.2.105:0/3087882683 learned_addr learned my addr 172.21.2.105:0/3087882683 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:30.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.784+0000 7f2722ffd700 1 -- 172.21.2.105:0/3087882683 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f27240b01b0 msgr2=0x7f27240ae470 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:46:30.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.784+0000 7f2722ffd700 1 --2- 172.21.2.105:0/3087882683 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f27240b01b0 0x7f27240ae470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:30.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.784+0000 7f2722ffd700 1 -- 172.21.2.105:0/3087882683 >> v2:172.21.2.115:3300/0 conn(0x7f27240ae960 msgr2=0x7f27240aedf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:46:30.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.784+0000 7f2722ffd700 1 --2- 172.21.2.105:0/3087882683 >> v2:172.21.2.115:3300/0 conn(0x7f27240ae960 0x7f27240aedf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:30.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.784+0000 7f2722ffd700 1 -- 172.21.2.105:0/3087882683 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27240acf70 con 0x7f27240b5ac0 2021-11-12T05:46:30.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.784+0000 7f2722ffd700 1 --2- 172.21.2.105:0/3087882683 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f27240b5ac0 0x7f27240b13c0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7f2714002f70 tx=0x7f2714006f40).ready entity=mon.0 client_cookie=9a5a73bee7629c15 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:30.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.784+0000 7f2721ffb700 1 -- 172.21.2.105:0/3087882683 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27140129a0 con 0x7f27240b5ac0 2021-11-12T05:46:30.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.784+0000 7f2721ffb700 1 -- 172.21.2.105:0/3087882683 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2714000e90 con 0x7f27240b5ac0 2021-11-12T05:46:30.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.784+0000 7f2721ffb700 1 -- 172.21.2.105:0/3087882683 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2714012d30 con 0x7f27240b5ac0 2021-11-12T05:46:30.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.788+0000 7f27294e8700 1 -- 172.21.2.105:0/3087882683 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f27240b5ac0 msgr2=0x7f27240b13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:30.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.788+0000 7f27294e8700 1 --2- 172.21.2.105:0/3087882683 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f27240b5ac0 0x7f27240b13c0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7f2714002f70 tx=0x7f2714006f40).stop 2021-11-12T05:46:30.798 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.788+0000 7f27294e8700 1 -- 172.21.2.105:0/3087882683 shutdown_connections 2021-11-12T05:46:30.798 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.788+0000 7f27294e8700 1 --2- 172.21.2.105:0/3087882683 >> v2:172.21.2.115:3300/0 conn(0x7f27240ae960 0x7f27240aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:30.798 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.788+0000 7f27294e8700 1 --2- 172.21.2.105:0/3087882683 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f27240b01b0 0x7f27240ae470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:30.798 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.788+0000 7f27294e8700 1 --2- 172.21.2.105:0/3087882683 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f27240b5ac0 0x7f27240b13c0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:30.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.788+0000 7f27294e8700 1 -- 172.21.2.105:0/3087882683 >> 172.21.2.105:0/3087882683 conn(0x7f27240628b0 msgr2=0x7f2724062c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:30.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.788+0000 7f27294e8700 1 -- 172.21.2.105:0/3087882683 shutdown_connections 2021-11-12T05:46:30.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.788+0000 7f27294e8700 1 -- 172.21.2.105:0/3087882683 wait complete. 2021-11-12T05:46:30.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.788+0000 7f27294e8700 1 Processor -- start 2021-11-12T05:46:30.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.788+0000 7f27294e8700 1 -- start start 2021-11-12T05:46:30.800 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.788+0000 7f27294e8700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f27240ae960 0x7f27240b3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:30.800 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.788+0000 7f27294e8700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f27240b01b0 0x7f2724064e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:30.800 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.788+0000 7f27294e8700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f27240b5ac0 0x7f272414e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:30.800 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.788+0000 7f27294e8700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272413cd40 con 0x7f27240ae960 2021-11-12T05:46:30.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.788+0000 7f27294e8700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2724064740 con 0x7f27240b5ac0 2021-11-12T05:46:30.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.788+0000 7f27294e8700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27240649e0 con 0x7f27240b01b0 2021-11-12T05:46:30.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.788+0000 7f2722ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f27240ae960 0x7f27240b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:30.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.788+0000 7f2722ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f27240ae960 0x7f27240b3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47444/0 (socket says 172.21.2.105:47444) 2021-11-12T05:46:30.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.788+0000 7f2722ffd700 1 -- 172.21.2.105:0/1319301131 learned_addr learned my addr 172.21.2.105:0/1319301131 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:30.802 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.788+0000 7f2722ffd700 1 -- 172.21.2.105:0/1319301131 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f27240b01b0 msgr2=0x7f2724064e80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:46:30.802 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.788+0000 7f2722ffd700 1 --2- 172.21.2.105:0/1319301131 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f27240b01b0 0x7f2724064e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:30.802 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.788+0000 7f2722ffd700 1 -- 172.21.2.105:0/1319301131 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f27240b5ac0 msgr2=0x7f272414e280 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:46:30.802 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.788+0000 7f2722ffd700 1 --2- 172.21.2.105:0/1319301131 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f27240b5ac0 0x7f272414e280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:30.802 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.788+0000 7f2722ffd700 1 -- 172.21.2.105:0/1319301131 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2714008240 con 0x7f27240ae960 2021-11-12T05:46:30.803 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.788+0000 7f2722ffd700 1 --2- 172.21.2.105:0/1319301131 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f27240ae960 0x7f27240b3960 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7f2714002f70 tx=0x7f2714018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:30.803 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.788+0000 7f271bfff700 1 -- 172.21.2.105:0/1319301131 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f271400b9d0 con 0x7f27240ae960 2021-11-12T05:46:30.803 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.788+0000 7f271bfff700 1 -- 172.21.2.105:0/1319301131 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2714025400 con 0x7f27240ae960 2021-11-12T05:46:30.804 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.788+0000 7f271bfff700 1 -- 172.21.2.105:0/1319301131 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2714025760 con 0x7f27240ae960 2021-11-12T05:46:30.804 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.788+0000 7f27294e8700 1 -- 172.21.2.105:0/1319301131 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2724065370 con 0x7f27240ae960 2021-11-12T05:46:30.804 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.788+0000 7f27294e8700 1 -- 172.21.2.105:0/1319301131 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27240b5230 con 0x7f27240ae960 2021-11-12T05:46:30.804 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.788+0000 7f27294e8700 1 -- 172.21.2.105:0/1319301131 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2724064ba0 con 0x7f27240ae960 2021-11-12T05:46:30.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.788+0000 7f271bfff700 1 -- 172.21.2.105:0/1319301131 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2714023070 con 0x7f27240ae960 2021-11-12T05:46:30.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.788+0000 7f271bfff700 1 --2- 172.21.2.105:0/1319301131 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2708053690 0x7f2708055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:30.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.788+0000 7f271bfff700 1 -- 172.21.2.105:0/1319301131 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f2714070a90 con 0x7f27240ae960 2021-11-12T05:46:30.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.788+0000 7f27227fc700 1 --2- 172.21.2.105:0/1319301131 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2708053690 0x7f2708055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:30.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.788+0000 7f27227fc700 1 --2- 172.21.2.105:0/1319301131 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2708053690 0x7f2708055b50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f270c002fb0 tx=0x7f270c006930).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:30.806 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.792+0000 7f271bfff700 1 -- 172.21.2.105:0/1319301131 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2714047990 con 0x7f27240ae960 2021-11-12T05:46:30.908 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.904+0000 7f27294e8700 1 -- 172.21.2.105:0/1319301131 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f27240ad410 con 0x7f27240ae960 2021-11-12T05:46:30.913 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.908+0000 7f271bfff700 1 -- 172.21.2.105:0/1319301131 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v25) v1 ==== 184+0+0 (secure 0 0 0) 0x7f271404afb0 con 0x7f27240ae960 2021-11-12T05:46:30.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.908+0000 7f27294e8700 1 -- 172.21.2.105:0/1319301131 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2708053690 msgr2=0x7f2708055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:30.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.908+0000 7f27294e8700 1 --2- 172.21.2.105:0/1319301131 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2708053690 0x7f2708055b50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f270c002fb0 tx=0x7f270c006930).stop 2021-11-12T05:46:30.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.908+0000 7f27294e8700 1 -- 172.21.2.105:0/1319301131 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f27240ae960 msgr2=0x7f27240b3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:30.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.908+0000 7f27294e8700 1 --2- 172.21.2.105:0/1319301131 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f27240ae960 0x7f27240b3960 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7f2714002f70 tx=0x7f2714018000).stop 2021-11-12T05:46:30.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.912+0000 7f27294e8700 1 -- 172.21.2.105:0/1319301131 shutdown_connections 2021-11-12T05:46:30.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.912+0000 7f27294e8700 1 --2- 172.21.2.105:0/1319301131 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2708053690 0x7f2708055b50 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:30.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.912+0000 7f27294e8700 1 --2- 172.21.2.105:0/1319301131 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f27240b5ac0 0x7f272414e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:30.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.912+0000 7f27294e8700 1 --2- 172.21.2.105:0/1319301131 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f27240b01b0 0x7f2724064e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:30.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.912+0000 7f27294e8700 1 --2- 172.21.2.105:0/1319301131 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f27240ae960 0x7f27240b3960 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:30.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.912+0000 7f27294e8700 1 -- 172.21.2.105:0/1319301131 >> 172.21.2.105:0/1319301131 conn(0x7f27240628b0 msgr2=0x7f272413fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:30.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.912+0000 7f27294e8700 1 -- 172.21.2.105:0/1319301131 shutdown_connections 2021-11-12T05:46:30.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.912+0000 7f27294e8700 1 -- 172.21.2.105:0/1319301131 wait complete. 2021-11-12T05:46:30.918 INFO:teuthology.orchestra.run.gibba005.stderr:updated caps for client.0 2021-11-12T05:46:30.921 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-12T05:46:30.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.972+0000 7f1da1954700 1 Processor -- start 2021-11-12T05:46:30.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.972+0000 7f1da1954700 1 -- start start 2021-11-12T05:46:30.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.972+0000 7f1da1954700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f1d9c0ad080 0x7f1d9c0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:30.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.972+0000 7f1da1954700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1d9c14b2f0 0x7f1d9c0ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:30.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.972+0000 7f1da1954700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d9c0ac7b0 con 0x7f1d9c0ac280 2021-11-12T05:46:30.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.972+0000 7f1da1954700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d9c1488a0 con 0x7f1d9c0ad080 2021-11-12T05:46:30.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.972+0000 7f1da1954700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c0ac9e0 con 0x7f1d9c14b2f0 2021-11-12T05:46:30.980 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.972+0000 7f1d9affd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f1d9c0ad080 0x7f1d9c0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:30.980 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.972+0000 7f1d9affd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f1d9c0ad080 0x7f1d9c0af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47452/0 (socket says 172.21.2.105:47452) 2021-11-12T05:46:30.981 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.972+0000 7f1d9affd700 1 -- 172.21.2.105:0/828390836 learned_addr learned my addr 172.21.2.105:0/828390836 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:30.981 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.972+0000 7f1d9affd700 1 -- 172.21.2.105:0/828390836 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1d9c14b2f0 msgr2=0x7f1d9c0ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:30.981 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.972+0000 7f1d9affd700 1 --2- 172.21.2.105:0/828390836 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1d9c14b2f0 0x7f1d9c0ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:30.982 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.972+0000 7f1d9affd700 1 -- 172.21.2.105:0/828390836 >> v1:172.21.2.115:6789/0 conn(0x7f1d9c0ac280 legacy=0x7f1d9c14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:30.982 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.972+0000 7f1d9affd700 1 -- 172.21.2.105:0/828390836 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d9c0b0b30 con 0x7f1d9c0ad080 2021-11-12T05:46:30.982 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.972+0000 7f1d9affd700 1 --2- 172.21.2.105:0/828390836 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1d9c0ad080 0x7f1d9c0af730 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7f1d9c0b6060 tx=0x7f1d8c006eb0).ready entity=mon.0 client_cookie=4327896c24c148b3 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:30.982 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.972+0000 7f1d99ffb700 1 -- 172.21.2.105:0/828390836 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d8c00d570 con 0x7f1d9c0ad080 2021-11-12T05:46:30.982 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.972+0000 7f1d99ffb700 1 -- 172.21.2.105:0/828390836 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8c000e90 con 0x7f1d9c0ad080 2021-11-12T05:46:30.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.972+0000 7f1d99ffb700 1 -- 172.21.2.105:0/828390836 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d8c00d8c0 con 0x7f1d9c0ad080 2021-11-12T05:46:30.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.972+0000 7f1da1954700 1 -- 172.21.2.105:0/828390836 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1d9c0ad080 msgr2=0x7f1d9c0af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:30.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.972+0000 7f1da1954700 1 --2- 172.21.2.105:0/828390836 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1d9c0ad080 0x7f1d9c0af730 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7f1d9c0b6060 tx=0x7f1d8c006eb0).stop 2021-11-12T05:46:30.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.972+0000 7f1da1954700 1 -- 172.21.2.105:0/828390836 shutdown_connections 2021-11-12T05:46:30.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.972+0000 7f1da1954700 1 --2- 172.21.2.105:0/828390836 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1d9c14b2f0 0x7f1d9c0ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:30.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.972+0000 7f1da1954700 1 --2- 172.21.2.105:0/828390836 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1d9c0ad080 0x7f1d9c0af730 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:30.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.972+0000 7f1da1954700 1 -- 172.21.2.105:0/828390836 >> 172.21.2.105:0/828390836 conn(0x7f1d9c0b5370 msgr2=0x7f1d9c0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:30.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.972+0000 7f1da1954700 1 -- 172.21.2.105:0/828390836 shutdown_connections 2021-11-12T05:46:30.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.972+0000 7f1da1954700 1 -- 172.21.2.105:0/828390836 wait complete. 2021-11-12T05:46:30.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.976+0000 7f1da1954700 1 Processor -- start 2021-11-12T05:46:30.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.976+0000 7f1da1954700 1 -- start start 2021-11-12T05:46:30.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.976+0000 7f1da1954700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1d9c0ac280 0x7f1d9c157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:30.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.976+0000 7f1da1954700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1d9c0ad080 0x7f1d9c0ab580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:30.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.976+0000 7f1da1954700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1d9c14b2f0 0x7f1d9c0aba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:30.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.976+0000 7f1da1954700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c0a96a0 con 0x7f1d9c14b2f0 2021-11-12T05:46:30.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.976+0000 7f1da1954700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c0aac50 con 0x7f1d9c0ac280 2021-11-12T05:46:30.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.976+0000 7f1da1954700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c0aaef0 con 0x7f1d9c0ad080 2021-11-12T05:46:30.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.976+0000 7f1d9b7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1d9c14b2f0 0x7f1d9c0aba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:30.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.976+0000 7f1d9b7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1d9c14b2f0 0x7f1d9c0aba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47460/0 (socket says 172.21.2.105:47460) 2021-11-12T05:46:30.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.976+0000 7f1d9b7fe700 1 -- 172.21.2.105:0/2111276453 learned_addr learned my addr 172.21.2.105:0/2111276453 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:30.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.976+0000 7f1d9b7fe700 1 -- 172.21.2.105:0/2111276453 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1d9c0ad080 msgr2=0x7f1d9c0ab580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:30.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.976+0000 7f1d9b7fe700 1 --2- 172.21.2.105:0/2111276453 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1d9c0ad080 0x7f1d9c0ab580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:30.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.976+0000 7f1d9b7fe700 1 -- 172.21.2.105:0/2111276453 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1d9c0ac280 msgr2=0x7f1d9c157ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:30.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.976+0000 7f1d9b7fe700 1 --2- 172.21.2.105:0/2111276453 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1d9c0ac280 0x7f1d9c157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:30.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.976+0000 7f1d9b7fe700 1 -- 172.21.2.105:0/2111276453 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8c00b1e0 con 0x7f1d9c14b2f0 2021-11-12T05:46:30.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.976+0000 7f1d9b7fe700 1 --2- 172.21.2.105:0/2111276453 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1d9c14b2f0 0x7f1d9c0aba70 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7f1d940032f0 tx=0x7f1d940091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:30.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.976+0000 7f1d8bfff700 1 -- 172.21.2.105:0/2111276453 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d9400f510 con 0x7f1d9c14b2f0 2021-11-12T05:46:30.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.976+0000 7f1d8bfff700 1 -- 172.21.2.105:0/2111276453 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9400f670 con 0x7f1d9c14b2f0 2021-11-12T05:46:30.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.976+0000 7f1d8bfff700 1 -- 172.21.2.105:0/2111276453 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d9400f7e0 con 0x7f1d9c14b2f0 2021-11-12T05:46:30.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.976+0000 7f1da1954700 1 -- 172.21.2.105:0/2111276453 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d9c0a9ad0 con 0x7f1d9c14b2f0 2021-11-12T05:46:30.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.976+0000 7f1da1954700 1 -- 172.21.2.105:0/2111276453 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d9c142c30 con 0x7f1d9c14b2f0 2021-11-12T05:46:30.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.976+0000 7f1da1954700 1 -- 172.21.2.105:0/2111276453 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d9c0b1440 con 0x7f1d9c14b2f0 2021-11-12T05:46:30.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.976+0000 7f1d8bfff700 1 -- 172.21.2.105:0/2111276453 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1d9400f070 con 0x7f1d9c14b2f0 2021-11-12T05:46:30.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.976+0000 7f1d8bfff700 1 --2- 172.21.2.105:0/2111276453 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1d78053640 0x7f1d78055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:30.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.976+0000 7f1d8bfff700 1 -- 172.21.2.105:0/2111276453 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f1d9406b6b0 con 0x7f1d9c14b2f0 2021-11-12T05:46:30.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.976+0000 7f1d9affd700 1 --2- 172.21.2.105:0/2111276453 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1d78053640 0x7f1d78055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:30.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.976+0000 7f1d9affd700 1 --2- 172.21.2.105:0/2111276453 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1d78053640 0x7f1d78055b00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f1d9c0b6060 tx=0x7f1d8c015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:30.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:30.980+0000 7f1d8bfff700 1 -- 172.21.2.105:0/2111276453 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1d940426c0 con 0x7f1d9c14b2f0 2021-11-12T05:46:31.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.092+0000 7f1da1954700 1 -- 172.21.2.105:0/2111276453 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f1d9c057350 con 0x7f1d9c14b2f0 2021-11-12T05:46:31.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.100+0000 7f1d8bfff700 1 -- 172.21.2.105:0/2111276453 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v26) v1 ==== 184+0+0 (secure 0 0 0) 0x7f1d94045ce0 con 0x7f1d9c14b2f0 2021-11-12T05:46:31.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.100+0000 7f1da1954700 1 -- 172.21.2.105:0/2111276453 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1d78053640 msgr2=0x7f1d78055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:31.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.100+0000 7f1da1954700 1 --2- 172.21.2.105:0/2111276453 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1d78053640 0x7f1d78055b00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f1d9c0b6060 tx=0x7f1d8c015000).stop 2021-11-12T05:46:31.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.100+0000 7f1da1954700 1 -- 172.21.2.105:0/2111276453 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1d9c14b2f0 msgr2=0x7f1d9c0aba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:31.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.100+0000 7f1da1954700 1 --2- 172.21.2.105:0/2111276453 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1d9c14b2f0 0x7f1d9c0aba70 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7f1d940032f0 tx=0x7f1d940091a0).stop 2021-11-12T05:46:31.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.100+0000 7f1da1954700 1 -- 172.21.2.105:0/2111276453 shutdown_connections 2021-11-12T05:46:31.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.100+0000 7f1da1954700 1 --2- 172.21.2.105:0/2111276453 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1d78053640 0x7f1d78055b00 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:31.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.100+0000 7f1da1954700 1 --2- 172.21.2.105:0/2111276453 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1d9c14b2f0 0x7f1d9c0aba70 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:31.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.100+0000 7f1da1954700 1 --2- 172.21.2.105:0/2111276453 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1d9c0ad080 0x7f1d9c0ab580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:31.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.100+0000 7f1da1954700 1 --2- 172.21.2.105:0/2111276453 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1d9c0ac280 0x7f1d9c157ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:31.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.100+0000 7f1da1954700 1 -- 172.21.2.105:0/2111276453 >> 172.21.2.105:0/2111276453 conn(0x7f1d9c0b5370 msgr2=0x7f1d9c143e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:31.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.100+0000 7f1da1954700 1 -- 172.21.2.105:0/2111276453 shutdown_connections 2021-11-12T05:46:31.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.100+0000 7f1da1954700 1 -- 172.21.2.105:0/2111276453 wait complete. 2021-11-12T05:46:31.109 INFO:teuthology.orchestra.run.gibba005.stderr:updated caps for client.1 2021-11-12T05:46:31.117 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-12T05:46:31.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.180+0000 7f51adf5e700 1 Processor -- start 2021-11-12T05:46:31.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.180+0000 7f51adf5e700 1 -- start start 2021-11-12T05:46:31.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51adf5e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f51a80ad080 0x7f51a80af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:31.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51adf5e700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f51a814b2f0 0x7f51a80ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:31.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51adf5e700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51a80ac7b0 con 0x7f51a80ac280 2021-11-12T05:46:31.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51adf5e700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51a81488a0 con 0x7f51a814b2f0 2021-11-12T05:46:31.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51adf5e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a80ac9e0 con 0x7f51a80ad080 2021-11-12T05:46:31.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51a6ffd700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f51a80ac280 0x7f51a814abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57860/0 (socket says 172.21.2.105:57860) 2021-11-12T05:46:31.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51a6ffd700 1 -- 172.21.2.105:0/3316289106 learned_addr learned my addr 172.21.2.105:0/3316289106 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:46:31.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51a67fc700 1 -- 172.21.2.105:0/3316289106 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1945957181 0 0) 0x7f51a80ac7b0 con 0x7f51a80ac280 2021-11-12T05:46:31.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51a67fc700 1 -- 172.21.2.105:0/3316289106 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5194003260 con 0x7f51a80ac280 2021-11-12T05:46:31.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51a7fff700 1 --2- 172.21.2.105:0/3316289106 >> v2:172.21.2.115:3300/0 conn(0x7f51a814b2f0 0x7f51a80ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:31.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51a67fc700 1 -- 172.21.2.105:0/3316289106 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 703428708 0 0) 0x7f5194003260 con 0x7f51a80ac280 2021-11-12T05:46:31.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51a67fc700 1 -- 172.21.2.105:0/3316289106 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f51a80ad080 msgr2=0x7f51a80af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:31.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51a77fe700 1 --2- 172.21.2.105:0/3316289106 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f51a80ad080 0x7f51a80af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:31.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51a67fc700 1 --2- 172.21.2.105:0/3316289106 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f51a80ad080 0x7f51a80af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:31.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51a67fc700 1 -- 172.21.2.105:0/3316289106 >> v2:172.21.2.115:3300/0 conn(0x7f51a814b2f0 msgr2=0x7f51a80ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:31.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51a67fc700 1 --2- 172.21.2.105:0/3316289106 >> v2:172.21.2.115:3300/0 conn(0x7f51a814b2f0 0x7f51a80ad460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:31.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51a67fc700 1 -- 172.21.2.105:0/3316289106 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a80b0b30 con 0x7f51a80ac280 2021-11-12T05:46:31.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51a67fc700 1 -- 172.21.2.105:0/3316289106 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f519c001660 con 0x7f51a80ac280 2021-11-12T05:46:31.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51a67fc700 1 -- 172.21.2.105:0/3316289106 >> v1:172.21.2.105:6789/0 conn(0x7f51a80ac280 legacy=0x7f51a814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:31.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51a67fc700 1 --2- 172.21.2.105:0/3316289106 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5194003750 0x7f5194003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:31.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51a67fc700 1 --2- 172.21.2.105:0/3316289106 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5194004500 0x7f5194004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:31.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51a67fc700 1 --2- 172.21.2.105:0/3316289106 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5194004f90 0x7f519400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:31.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51a67fc700 1 -- 172.21.2.105:0/3316289106 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a81488a0 con 0x7f5194004f90 2021-11-12T05:46:31.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51a67fc700 1 -- 172.21.2.105:0/3316289106 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a80ac9e0 con 0x7f5194004500 2021-11-12T05:46:31.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51a67fc700 1 -- 172.21.2.105:0/3316289106 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f519400be50 con 0x7f5194003750 2021-11-12T05:46:31.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51a7fff700 1 --2- 172.21.2.105:0/3316289106 >> v2:172.21.2.115:3300/0 conn(0x7f51a814b2f0 0x7f51a80ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:46:31.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51a77fe700 1 --2- 172.21.2.105:0/3316289106 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f51a80ad080 0x7f51a80af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:46:31.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51a7fff700 1 --2- 172.21.2.105:0/3316289106 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5194004f90 0x7f519400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:31.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51a6ffd700 1 --2- 172.21.2.105:0/3316289106 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5194004500 0x7f5194004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:31.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51a7fff700 1 -- 172.21.2.105:0/3316289106 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5194003750 msgr2=0x7f5194003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:31.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51a7fff700 1 --2- 172.21.2.105:0/3316289106 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5194003750 0x7f5194003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:31.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51a7fff700 1 -- 172.21.2.105:0/3316289106 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5194004500 msgr2=0x7f5194004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:31.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51a7fff700 1 --2- 172.21.2.105:0/3316289106 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5194004500 0x7f5194004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:31.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51a7fff700 1 -- 172.21.2.105:0/3316289106 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5194003260 con 0x7f5194004f90 2021-11-12T05:46:31.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51a6ffd700 1 --2- 172.21.2.105:0/3316289106 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5194004500 0x7f5194004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:46:31.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51a7fff700 1 --2- 172.21.2.105:0/3316289106 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5194004f90 0x7f519400b750 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7f51a0007000 tx=0x7f51a0008040).ready entity=mon.0 client_cookie=b750f025e84ba636 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:31.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51a67fc700 1 -- 172.21.2.105:0/3316289106 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51a000c640 con 0x7f5194004f90 2021-11-12T05:46:31.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51a67fc700 1 -- 172.21.2.105:0/3316289106 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a000c7a0 con 0x7f5194004f90 2021-11-12T05:46:31.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51a67fc700 1 -- 172.21.2.105:0/3316289106 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51a000cb00 con 0x7f5194004f90 2021-11-12T05:46:31.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51adf5e700 1 -- 172.21.2.105:0/3316289106 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5194004f90 msgr2=0x7f519400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:31.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51adf5e700 1 --2- 172.21.2.105:0/3316289106 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5194004f90 0x7f519400b750 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7f51a0007000 tx=0x7f51a0008040).stop 2021-11-12T05:46:31.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51a7fff700 1 -- 172.21.2.105:0/3316289106 reap_dead start 2021-11-12T05:46:31.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51adf5e700 1 -- 172.21.2.105:0/3316289106 shutdown_connections 2021-11-12T05:46:31.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51adf5e700 1 -- 172.21.2.105:0/3316289106 >> 172.21.2.105:0/3316289106 conn(0x7f51a80b5370 msgr2=0x7f51a80b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:31.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51adf5e700 1 -- 172.21.2.105:0/3316289106 shutdown_connections 2021-11-12T05:46:31.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51adf5e700 1 -- 172.21.2.105:0/3316289106 wait complete. 2021-11-12T05:46:31.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51adf5e700 1 Processor -- start 2021-11-12T05:46:31.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.184+0000 7f51adf5e700 1 -- start start 2021-11-12T05:46:31.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.188+0000 7f51adf5e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5194004f90 0x7f51a8144b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:31.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.188+0000 7f51adf5e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f51a80a9510 0x7f51a80aaa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:31.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.188+0000 7f51adf5e700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f51a8157370 0x7f51a8063400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:31.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.188+0000 7f51adf5e700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a8064320 con 0x7f51a80a9510 2021-11-12T05:46:31.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.188+0000 7f51adf5e700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a8156c30 con 0x7f51a8157370 2021-11-12T05:46:31.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.188+0000 7f51adf5e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a8156ed0 con 0x7f5194004f90 2021-11-12T05:46:31.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.188+0000 7f51a6ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f51a80a9510 0x7f51a80aaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:31.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.188+0000 7f51a6ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f51a80a9510 0x7f51a80aaa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47480/0 (socket says 172.21.2.105:47480) 2021-11-12T05:46:31.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.188+0000 7f51a6ffd700 1 -- 172.21.2.105:0/2355636808 learned_addr learned my addr 172.21.2.105:0/2355636808 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:31.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.188+0000 7f51a6ffd700 1 -- 172.21.2.105:0/2355636808 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5194004f90 msgr2=0x7f51a8144b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:31.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.188+0000 7f51a6ffd700 1 --2- 172.21.2.105:0/2355636808 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5194004f90 0x7f51a8144b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:31.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.188+0000 7f51a6ffd700 1 -- 172.21.2.105:0/2355636808 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f51a8157370 msgr2=0x7f51a8063400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:31.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.188+0000 7f51a6ffd700 1 --2- 172.21.2.105:0/2355636808 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f51a8157370 0x7f51a8063400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:31.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.188+0000 7f51a6ffd700 1 -- 172.21.2.105:0/2355636808 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a8144ff0 con 0x7f51a80a9510 2021-11-12T05:46:31.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.188+0000 7f51a6ffd700 1 --2- 172.21.2.105:0/2355636808 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f51a80a9510 0x7f51a80aaa20 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7f519c008000 tx=0x7f519c009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:31.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.188+0000 7f51a4ff9700 1 -- 172.21.2.105:0/2355636808 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f519c007170 con 0x7f51a80a9510 2021-11-12T05:46:31.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.188+0000 7f51a4ff9700 1 -- 172.21.2.105:0/2355636808 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519c0072d0 con 0x7f51a80a9510 2021-11-12T05:46:31.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.188+0000 7f51adf5e700 1 -- 172.21.2.105:0/2355636808 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51a80a9ec0 con 0x7f51a80a9510 2021-11-12T05:46:31.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.188+0000 7f51a4ff9700 1 -- 172.21.2.105:0/2355636808 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f519c004920 con 0x7f51a80a9510 2021-11-12T05:46:31.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.188+0000 7f51adf5e700 1 -- 172.21.2.105:0/2355636808 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51a80ab130 con 0x7f51a80a9510 2021-11-12T05:46:31.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.188+0000 7f51adf5e700 1 -- 172.21.2.105:0/2355636808 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51a80b1440 con 0x7f51a80a9510 2021-11-12T05:46:31.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.188+0000 7f51a4ff9700 1 -- 172.21.2.105:0/2355636808 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f519c004a80 con 0x7f51a80a9510 2021-11-12T05:46:31.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.188+0000 7f51a4ff9700 1 --2- 172.21.2.105:0/2355636808 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f51880536f0 0x7f5188055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:31.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.188+0000 7f51a4ff9700 1 -- 172.21.2.105:0/2355636808 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f519c06c030 con 0x7f51a80a9510 2021-11-12T05:46:31.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.188+0000 7f51a77fe700 1 --2- 172.21.2.105:0/2355636808 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f51880536f0 0x7f5188055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:31.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.188+0000 7f51a77fe700 1 --2- 172.21.2.105:0/2355636808 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f51880536f0 0x7f5188055bb0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f5198007000 tx=0x7f5198008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:31.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.192+0000 7f51a4ff9700 1 -- 172.21.2.105:0/2355636808 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f519c042f30 con 0x7f51a80a9510 2021-11-12T05:46:31.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.300+0000 7f51adf5e700 1 -- 172.21.2.105:0/2355636808 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f51a8057350 con 0x7f51a80a9510 2021-11-12T05:46:31.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.308+0000 7f51a4ff9700 1 -- 172.21.2.105:0/2355636808 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v27) v1 ==== 184+0+0 (secure 0 0 0) 0x7f519c046550 con 0x7f51a80a9510 2021-11-12T05:46:31.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.308+0000 7f51adf5e700 1 -- 172.21.2.105:0/2355636808 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f51880536f0 msgr2=0x7f5188055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:31.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.308+0000 7f51adf5e700 1 --2- 172.21.2.105:0/2355636808 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f51880536f0 0x7f5188055bb0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f5198007000 tx=0x7f5198008040).stop 2021-11-12T05:46:31.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.308+0000 7f51adf5e700 1 -- 172.21.2.105:0/2355636808 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f51a80a9510 msgr2=0x7f51a80aaa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:31.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.308+0000 7f51adf5e700 1 --2- 172.21.2.105:0/2355636808 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f51a80a9510 0x7f51a80aaa20 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7f519c008000 tx=0x7f519c009040).stop 2021-11-12T05:46:31.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.308+0000 7f51adf5e700 1 -- 172.21.2.105:0/2355636808 shutdown_connections 2021-11-12T05:46:31.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.308+0000 7f51adf5e700 1 --2- 172.21.2.105:0/2355636808 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f51880536f0 0x7f5188055bb0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:31.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.308+0000 7f51adf5e700 1 --2- 172.21.2.105:0/2355636808 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f51a8157370 0x7f51a8063400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:31.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.308+0000 7f51adf5e700 1 --2- 172.21.2.105:0/2355636808 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f51a80a9510 0x7f51a80aaa20 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:31.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.308+0000 7f51adf5e700 1 --2- 172.21.2.105:0/2355636808 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5194004f90 0x7f51a8144b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:31.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.308+0000 7f51adf5e700 1 -- 172.21.2.105:0/2355636808 >> 172.21.2.105:0/2355636808 conn(0x7f51a80b5370 msgr2=0x7f51a8145d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:31.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.308+0000 7f51adf5e700 1 -- 172.21.2.105:0/2355636808 shutdown_connections 2021-11-12T05:46:31.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.308+0000 7f51adf5e700 1 -- 172.21.2.105:0/2355636808 wait complete. 2021-11-12T05:46:31.316 INFO:teuthology.orchestra.run.gibba005.stderr:updated caps for client.2 2021-11-12T05:46:31.319 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:46:31.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.364+0000 7fa16833a700 1 Processor -- start 2021-11-12T05:46:31.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.364+0000 7fa16833a700 1 -- start start 2021-11-12T05:46:31.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.364+0000 7fa16833a700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa1600ade80 0x7fa1600601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:31.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.364+0000 7fa16833a700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa160066150 con 0x7fa16005fdc0 2021-11-12T05:46:31.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.364+0000 7fa16833a700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1600663f0 con 0x7fa16013a9c0 2021-11-12T05:46:31.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.364+0000 7fa16833a700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa160141fb0 con 0x7fa1600ade80 2021-11-12T05:46:31.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.364+0000 7fa1658d5700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa1600ade80 0x7fa1600601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:31.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.364+0000 7fa1660d6700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fa16005fdc0 0x7fa160066730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57880/0 (socket says 172.21.2.105:57880) 2021-11-12T05:46:31.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.364+0000 7fa1660d6700 1 -- 172.21.2.105:0/3939845135 learned_addr learned my addr 172.21.2.105:0/3939845135 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:46:31.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.364+0000 7fa1658d5700 1 -- 172.21.2.105:0/3939845135 >> v1:172.21.2.115:6789/0 conn(0x7fa16013a9c0 legacy=0x7fa160141470 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:46:31.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.364+0000 7fa1658d5700 1 -- 172.21.2.105:0/3939845135 >> v1:172.21.2.105:6789/0 conn(0x7fa16005fdc0 legacy=0x7fa160066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:31.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.364+0000 7fa1658d5700 1 -- 172.21.2.105:0/3939845135 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa160140fd0 con 0x7fa1600ade80 2021-11-12T05:46:31.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.364+0000 7fa1658d5700 1 --2- 172.21.2.105:0/3939845135 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1600ade80 0x7fa1600601a0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7fa160060ea0 tx=0x7fa150006df0).ready entity=mon.0 client_cookie=8ac699cabe1d6ded server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:31.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.364+0000 7fa1650d4700 1 -- 172.21.2.105:0/3939845135 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa15000d5c0 con 0x7fa1600ade80 2021-11-12T05:46:31.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.364+0000 7fa1650d4700 1 -- 172.21.2.105:0/3939845135 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa150000e90 con 0x7fa1600ade80 2021-11-12T05:46:31.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.364+0000 7fa1650d4700 1 -- 172.21.2.105:0/3939845135 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa15000d910 con 0x7fa1600ade80 2021-11-12T05:46:31.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.368+0000 7fa16833a700 1 -- 172.21.2.105:0/3939845135 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1600ade80 msgr2=0x7fa1600601a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:31.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.368+0000 7fa16833a700 1 --2- 172.21.2.105:0/3939845135 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1600ade80 0x7fa1600601a0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7fa160060ea0 tx=0x7fa150006df0).stop 2021-11-12T05:46:31.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.368+0000 7fa16833a700 1 -- 172.21.2.105:0/3939845135 shutdown_connections 2021-11-12T05:46:31.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.368+0000 7fa16833a700 1 --2- 172.21.2.105:0/3939845135 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1600ade80 0x7fa1600601a0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:31.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.368+0000 7fa16833a700 1 -- 172.21.2.105:0/3939845135 >> 172.21.2.105:0/3939845135 conn(0x7fa1600608d0 msgr2=0x7fa16005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:31.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.368+0000 7fa16833a700 1 -- 172.21.2.105:0/3939845135 shutdown_connections 2021-11-12T05:46:31.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.368+0000 7fa16833a700 1 -- 172.21.2.105:0/3939845135 wait complete. 2021-11-12T05:46:31.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.368+0000 7fa16833a700 1 Processor -- start 2021-11-12T05:46:31.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.368+0000 7fa16833a700 1 -- start start 2021-11-12T05:46:31.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.368+0000 7fa16833a700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa16005fdc0 0x7fa1600b0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:31.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.368+0000 7fa16833a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1600ade80 0x7fa1601400f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:31.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.368+0000 7fa16833a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa16013a9c0 0x7fa1601444b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:31.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.368+0000 7fa16833a700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1600b1080 con 0x7fa1600ade80 2021-11-12T05:46:31.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.368+0000 7fa16833a700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1600b80f0 con 0x7fa16005fdc0 2021-11-12T05:46:31.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.368+0000 7fa16833a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1600b12b0 con 0x7fa16013a9c0 2021-11-12T05:46:31.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.368+0000 7fa1658d5700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1600ade80 0x7fa1601400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:31.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.368+0000 7fa1658d5700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1600ade80 0x7fa1601400f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47492/0 (socket says 172.21.2.105:47492) 2021-11-12T05:46:31.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.368+0000 7fa1658d5700 1 -- 172.21.2.105:0/2831565934 learned_addr learned my addr 172.21.2.105:0/2831565934 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:31.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.368+0000 7fa1658d5700 1 -- 172.21.2.105:0/2831565934 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa16013a9c0 msgr2=0x7fa1601444b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:31.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.368+0000 7fa1658d5700 1 --2- 172.21.2.105:0/2831565934 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa16013a9c0 0x7fa1601444b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:31.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.368+0000 7fa1658d5700 1 -- 172.21.2.105:0/2831565934 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa16005fdc0 msgr2=0x7fa1600b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:31.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.368+0000 7fa1658d5700 1 --2- 172.21.2.105:0/2831565934 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa16005fdc0 0x7fa1600b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:31.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.368+0000 7fa1658d5700 1 -- 172.21.2.105:0/2831565934 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa15000b180 con 0x7fa1600ade80 2021-11-12T05:46:31.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.368+0000 7fa1658d5700 1 --2- 172.21.2.105:0/2831565934 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1600ade80 0x7fa1601400f0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7fa160060ea0 tx=0x7fa150012000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:31.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.368+0000 7fa14f7fe700 1 -- 172.21.2.105:0/2831565934 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa150002f50 con 0x7fa1600ade80 2021-11-12T05:46:31.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.368+0000 7fa14f7fe700 1 -- 172.21.2.105:0/2831565934 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa150013d50 con 0x7fa1600ade80 2021-11-12T05:46:31.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.368+0000 7fa16833a700 1 -- 172.21.2.105:0/2831565934 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1600b0540 con 0x7fa1600ade80 2021-11-12T05:46:31.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.368+0000 7fa14f7fe700 1 -- 172.21.2.105:0/2831565934 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa15001f640 con 0x7fa1600ade80 2021-11-12T05:46:31.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.368+0000 7fa16833a700 1 -- 172.21.2.105:0/2831565934 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa16013a6b0 con 0x7fa1600ade80 2021-11-12T05:46:31.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.368+0000 7fa16833a700 1 -- 172.21.2.105:0/2831565934 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1600b8430 con 0x7fa1600ade80 2021-11-12T05:46:31.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.368+0000 7fa14f7fe700 1 -- 172.21.2.105:0/2831565934 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa150026070 con 0x7fa1600ade80 2021-11-12T05:46:31.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.368+0000 7fa14f7fe700 1 --2- 172.21.2.105:0/2831565934 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa140053640 0x7fa140055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:31.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.368+0000 7fa14f7fe700 1 -- 172.21.2.105:0/2831565934 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fa15006c190 con 0x7fa1600ade80 2021-11-12T05:46:31.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.368+0000 7fa1660d6700 1 --2- 172.21.2.105:0/2831565934 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa140053640 0x7fa140055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:31.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.372+0000 7fa1660d6700 1 --2- 172.21.2.105:0/2831565934 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa140053640 0x7fa140055b00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7fa160060e00 tx=0x7fa15c007800).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:31.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.372+0000 7fa14f7fe700 1 -- 172.21.2.105:0/2831565934 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa1500431a0 con 0x7fa1600ade80 2021-11-12T05:46:31.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.480+0000 7fa16833a700 1 -- 172.21.2.105:0/2831565934 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa160057350 con 0x7fa1600ade80 2021-11-12T05:46:31.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.484+0000 7fa14f7fe700 1 -- 172.21.2.105:0/2831565934 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+2140 (secure 0 0 0) 0x7fa1500467c0 con 0x7fa1600ade80 2021-11-12T05:46:31.487 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:46:31.488 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":31,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/1423088351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":1423088351},{"type":"v1","addr":"172.21.2.115:6833","nonce":1423088351}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:46:29.372216+0000","modified":"2021-11-12T05:46:30.375936+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6309":{"gid":6309,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/1837795491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":1837795491},{"type":"v1","addr":"172.21.2.105:6835","nonce":1837795491}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-11-12T05:46:31.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.484+0000 7fa16833a700 1 -- 172.21.2.105:0/2831565934 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa140053640 msgr2=0x7fa140055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:31.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.484+0000 7fa16833a700 1 --2- 172.21.2.105:0/2831565934 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa140053640 0x7fa140055b00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7fa160060e00 tx=0x7fa15c007800).stop 2021-11-12T05:46:31.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.484+0000 7fa16833a700 1 -- 172.21.2.105:0/2831565934 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1600ade80 msgr2=0x7fa1601400f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:31.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.484+0000 7fa16833a700 1 --2- 172.21.2.105:0/2831565934 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1600ade80 0x7fa1601400f0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7fa160060ea0 tx=0x7fa150012000).stop 2021-11-12T05:46:31.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.484+0000 7fa16833a700 1 -- 172.21.2.105:0/2831565934 shutdown_connections 2021-11-12T05:46:31.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.484+0000 7fa16833a700 1 --2- 172.21.2.105:0/2831565934 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa140053640 0x7fa140055b00 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:31.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.484+0000 7fa16833a700 1 --2- 172.21.2.105:0/2831565934 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa16013a9c0 0x7fa1601444b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:31.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.484+0000 7fa16833a700 1 --2- 172.21.2.105:0/2831565934 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1600ade80 0x7fa1601400f0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:31.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.484+0000 7fa16833a700 1 --2- 172.21.2.105:0/2831565934 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa16005fdc0 0x7fa1600b0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:31.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.484+0000 7fa16833a700 1 -- 172.21.2.105:0/2831565934 >> 172.21.2.105:0/2831565934 conn(0x7fa1600608d0 msgr2=0x7fa1600b3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:31.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.484+0000 7fa16833a700 1 -- 172.21.2.105:0/2831565934 shutdown_connections 2021-11-12T05:46:31.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.484+0000 7fa16833a700 1 -- 172.21.2.105:0/2831565934 wait complete. 2021-11-12T05:46:31.492 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 31 2021-11-12T05:46:31.696 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 31, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:46:29.372216+0000', 'modified': '2021-11-12T05:46:30.375936+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6309}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6309': {'gid': 6309, 'name': 'a', 'rank': 0, 'incarnation': 30, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/1837795491', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 1837795491}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 1837795491}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:46:31.697 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:46:31.697 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:46:31.777 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":6309,"want_state":"up:active","state":"up:active","rank_uptime":2.3978115940000002,"mdsmap_epoch":31,"osdmap_epoch":75,"osdmap_epoch_barrier":74,"uptime":6.5772203019999997} 2021-11-12T05:46:31.778 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 6309, "mdsmap_epoch": 31, "osdmap_epoch": 75, "osdmap_epoch_barrier": 74, "rank_uptime": 2.397811594, "state": "up:active", "uptime": 6.577220302, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:46:31.779 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:46:31.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.824+0000 7fcf638a3700 1 Processor -- start 2021-11-12T05:46:31.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.824+0000 7fcf638a3700 1 -- start start 2021-11-12T05:46:31.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf638a3700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fcf5c0ac280 0x7fcf5c14b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:31.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf638a3700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf5c0ac7b0 con 0x7fcf5c0af730 2021-11-12T05:46:31.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf638a3700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf5c0ac9e0 con 0x7fcf5c0ad080 2021-11-12T05:46:31.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf638a3700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf5c1488a0 con 0x7fcf5c0ac280 2021-11-12T05:46:31.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf60e3e700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fcf5c0ac280 0x7fcf5c14b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:31.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf61e40700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fcf5c0af730 0x7fcf5c147a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57898/0 (socket says 172.21.2.105:57898) 2021-11-12T05:46:31.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf61e40700 1 -- 172.21.2.105:0/2012423993 learned_addr learned my addr 172.21.2.105:0/2012423993 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:46:31.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf60e3e700 1 -- 172.21.2.105:0/2012423993 >> v1:172.21.2.115:6789/0 conn(0x7fcf5c0ad080 legacy=0x7fcf5c14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:31.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf60e3e700 1 -- 172.21.2.105:0/2012423993 >> v1:172.21.2.105:6789/0 conn(0x7fcf5c0af730 legacy=0x7fcf5c147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:31.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf60e3e700 1 -- 172.21.2.105:0/2012423993 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5c0b0b30 con 0x7fcf5c0ac280 2021-11-12T05:46:31.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf60e3e700 1 --2- 172.21.2.105:0/2012423993 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcf5c0ac280 0x7fcf5c14b2f0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7fcf5c0ac6a0 tx=0x7fcf58006df0).ready entity=mon.0 client_cookie=fb2c3d9ebe5600bd server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:31.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf4ffff700 1 -- 172.21.2.105:0/2012423993 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf5800d5c0 con 0x7fcf5c0ac280 2021-11-12T05:46:31.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf4ffff700 1 -- 172.21.2.105:0/2012423993 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf58000e90 con 0x7fcf5c0ac280 2021-11-12T05:46:31.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf4ffff700 1 -- 172.21.2.105:0/2012423993 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf5800d910 con 0x7fcf5c0ac280 2021-11-12T05:46:31.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf638a3700 1 -- 172.21.2.105:0/2012423993 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcf5c0ac280 msgr2=0x7fcf5c14b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:31.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf638a3700 1 --2- 172.21.2.105:0/2012423993 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcf5c0ac280 0x7fcf5c14b2f0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7fcf5c0ac6a0 tx=0x7fcf58006df0).stop 2021-11-12T05:46:31.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf638a3700 1 -- 172.21.2.105:0/2012423993 shutdown_connections 2021-11-12T05:46:31.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf638a3700 1 --2- 172.21.2.105:0/2012423993 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcf5c0ac280 0x7fcf5c14b2f0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:31.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf638a3700 1 -- 172.21.2.105:0/2012423993 >> 172.21.2.105:0/2012423993 conn(0x7fcf5c0b5370 msgr2=0x7fcf5c0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:31.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf638a3700 1 -- 172.21.2.105:0/2012423993 shutdown_connections 2021-11-12T05:46:31.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf638a3700 1 -- 172.21.2.105:0/2012423993 wait complete. 2021-11-12T05:46:31.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf638a3700 1 Processor -- start 2021-11-12T05:46:31.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf638a3700 1 -- start start 2021-11-12T05:46:31.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf638a3700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcf5c0ac280 0x7fcf5c0637b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:31.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf638a3700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcf5c0ad080 0x7fcf5c063ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:31.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf638a3700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcf5c0af730 0x7fcf5c156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:31.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf638a3700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c1433e0 con 0x7fcf5c0ad080 2021-11-12T05:46:31.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf638a3700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c157fc0 con 0x7fcf5c0af730 2021-11-12T05:46:31.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf638a3700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c0a9eb0 con 0x7fcf5c0ac280 2021-11-12T05:46:31.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf60e3e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcf5c0ad080 0x7fcf5c063ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:31.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf60e3e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcf5c0ad080 0x7fcf5c063ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47508/0 (socket says 172.21.2.105:47508) 2021-11-12T05:46:31.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf60e3e700 1 -- 172.21.2.105:0/2708122937 learned_addr learned my addr 172.21.2.105:0/2708122937 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:31.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf60e3e700 1 -- 172.21.2.105:0/2708122937 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcf5c0ac280 msgr2=0x7fcf5c0637b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:31.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf60e3e700 1 --2- 172.21.2.105:0/2708122937 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcf5c0ac280 0x7fcf5c0637b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:31.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf60e3e700 1 -- 172.21.2.105:0/2708122937 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcf5c0af730 msgr2=0x7fcf5c156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:31.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf60e3e700 1 --2- 172.21.2.105:0/2708122937 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcf5c0af730 0x7fcf5c156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:31.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf60e3e700 1 -- 172.21.2.105:0/2708122937 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5800b180 con 0x7fcf5c0ad080 2021-11-12T05:46:31.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf60e3e700 1 --2- 172.21.2.105:0/2708122937 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcf5c0ad080 0x7fcf5c063ca0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7fcf5c0a9ff0 tx=0x7fcf58012000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:31.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf4e7fc700 1 -- 172.21.2.105:0/2708122937 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf58016070 con 0x7fcf5c0ad080 2021-11-12T05:46:31.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf4e7fc700 1 -- 172.21.2.105:0/2708122937 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf58002f50 con 0x7fcf5c0ad080 2021-11-12T05:46:31.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf4e7fc700 1 -- 172.21.2.105:0/2708122937 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf58013f00 con 0x7fcf5c0ad080 2021-11-12T05:46:31.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf638a3700 1 -- 172.21.2.105:0/2708122937 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf5c0a8790 con 0x7fcf5c0ad080 2021-11-12T05:46:31.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.828+0000 7fcf638a3700 1 -- 172.21.2.105:0/2708122937 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf5c0a9a10 con 0x7fcf5c0ad080 2021-11-12T05:46:31.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.832+0000 7fcf638a3700 1 -- 172.21.2.105:0/2708122937 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf5c157c60 con 0x7fcf5c0ad080 2021-11-12T05:46:31.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.832+0000 7fcf4e7fc700 1 -- 172.21.2.105:0/2708122937 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcf58025030 con 0x7fcf5c0ad080 2021-11-12T05:46:31.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.832+0000 7fcf4e7fc700 1 --2- 172.21.2.105:0/2708122937 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcf3c0536a0 0x7fcf3c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:31.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.832+0000 7fcf4e7fc700 1 -- 172.21.2.105:0/2708122937 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fcf5806cc00 con 0x7fcf5c0ad080 2021-11-12T05:46:31.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.832+0000 7fcf6163f700 1 --2- 172.21.2.105:0/2708122937 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcf3c0536a0 0x7fcf3c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:31.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.832+0000 7fcf6163f700 1 --2- 172.21.2.105:0/2708122937 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcf3c0536a0 0x7fcf3c055b60 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7fcf50002f90 tx=0x7fcf500069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:31.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.832+0000 7fcf4e7fc700 1 -- 172.21.2.105:0/2708122937 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcf58072020 con 0x7fcf5c0ad080 2021-11-12T05:46:31.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.916+0000 7fcf638a3700 1 -- 172.21.2.105:0/2708122937 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf5c0a9bd0 con 0x7fcf5c0ad080 2021-11-12T05:46:31.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.916+0000 7fcf4e7fc700 1 -- 172.21.2.105:0/2708122937 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16274 (secure 0 0 0) 0x7fcf58023090 con 0x7fcf5c0ad080 2021-11-12T05:46:31.922 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:46:31.922 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":75,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:46:30.377067+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:46:27.277471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-11-12T05:46:28.337063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:46:31.924 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.920+0000 7fcf638a3700 1 -- 172.21.2.105:0/2708122937 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcf3c0536a0 msgr2=0x7fcf3c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:31.924 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.920+0000 7fcf638a3700 1 --2- 172.21.2.105:0/2708122937 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcf3c0536a0 0x7fcf3c055b60 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7fcf50002f90 tx=0x7fcf500069b0).stop 2021-11-12T05:46:31.924 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.920+0000 7fcf638a3700 1 -- 172.21.2.105:0/2708122937 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcf5c0ad080 msgr2=0x7fcf5c063ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:31.924 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.920+0000 7fcf638a3700 1 --2- 172.21.2.105:0/2708122937 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcf5c0ad080 0x7fcf5c063ca0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7fcf5c0a9ff0 tx=0x7fcf58012000).stop 2021-11-12T05:46:31.924 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.920+0000 7fcf638a3700 1 -- 172.21.2.105:0/2708122937 shutdown_connections 2021-11-12T05:46:31.925 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.920+0000 7fcf638a3700 1 --2- 172.21.2.105:0/2708122937 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcf3c0536a0 0x7fcf3c055b60 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:31.925 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.920+0000 7fcf638a3700 1 --2- 172.21.2.105:0/2708122937 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcf5c0af730 0x7fcf5c156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:31.925 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.920+0000 7fcf638a3700 1 --2- 172.21.2.105:0/2708122937 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcf5c0ad080 0x7fcf5c063ca0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:31.926 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.920+0000 7fcf638a3700 1 --2- 172.21.2.105:0/2708122937 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcf5c0ac280 0x7fcf5c0637b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:31.926 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.920+0000 7fcf638a3700 1 -- 172.21.2.105:0/2708122937 >> 172.21.2.105:0/2708122937 conn(0x7fcf5c0b5370 msgr2=0x7fcf5c143da0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:31.926 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.920+0000 7fcf638a3700 1 -- 172.21.2.105:0/2708122937 shutdown_connections 2021-11-12T05:46:31.926 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.920+0000 7fcf638a3700 1 -- 172.21.2.105:0/2708122937 wait complete. 2021-11-12T05:46:31.930 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-12T05:46:27.277471+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2021-11-12T05:46:28.337063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-12T05:46:31.930 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:46:31.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.980+0000 7f04fe057700 1 Processor -- start 2021-11-12T05:46:31.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.980+0000 7f04fe057700 1 -- start start 2021-11-12T05:46:31.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.980+0000 7f04fe057700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f04f80ace20 0x7f04f80b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:31.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.980+0000 7f04fe057700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04f80b1840 con 0x7f04f80aca40 2021-11-12T05:46:31.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.980+0000 7f04fe057700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04f80af2b0 con 0x7f04f8144180 2021-11-12T05:46:31.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.980+0000 7f04fe057700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f80b0a10 con 0x7f04f80ace20 2021-11-12T05:46:31.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.980+0000 7f04f6ffd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f04f80ace20 0x7f04f80b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:31.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.980+0000 7f04f77fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f04f80aca40 0x7f04f81473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57910/0 (socket says 172.21.2.105:57910) 2021-11-12T05:46:31.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.980+0000 7f04f77fe700 1 -- 172.21.2.105:0/2152363190 learned_addr learned my addr 172.21.2.105:0/2152363190 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:46:31.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.980+0000 7f04f6ffd700 1 -- 172.21.2.105:0/2152363190 >> v1:172.21.2.115:6789/0 conn(0x7f04f8144180 legacy=0x7f04f81445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:31.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.980+0000 7f04f6ffd700 1 -- 172.21.2.105:0/2152363190 >> v1:172.21.2.105:6789/0 conn(0x7f04f80aca40 legacy=0x7f04f81473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:31.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.980+0000 7f04f6ffd700 1 -- 172.21.2.105:0/2152363190 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f80b1a70 con 0x7f04f80ace20 2021-11-12T05:46:31.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.980+0000 7f04f6ffd700 1 --2- 172.21.2.105:0/2152363190 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04f80ace20 0x7f04f80b0520 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7f04f80611e0 tx=0x7f04e8006df0).ready entity=mon.0 client_cookie=8bb62d1c9bc0fa97 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:31.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.980+0000 7f04f67fc700 1 -- 172.21.2.105:0/2152363190 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04e800d5c0 con 0x7f04f80ace20 2021-11-12T05:46:31.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.980+0000 7f04f67fc700 1 -- 172.21.2.105:0/2152363190 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e8000e90 con 0x7f04f80ace20 2021-11-12T05:46:31.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.980+0000 7f04f67fc700 1 -- 172.21.2.105:0/2152363190 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04e800d910 con 0x7f04f80ace20 2021-11-12T05:46:31.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.980+0000 7f04fe057700 1 -- 172.21.2.105:0/2152363190 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04f80ace20 msgr2=0x7f04f80b0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:31.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.980+0000 7f04fe057700 1 --2- 172.21.2.105:0/2152363190 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04f80ace20 0x7f04f80b0520 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7f04f80611e0 tx=0x7f04e8006df0).stop 2021-11-12T05:46:31.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.980+0000 7f04fe057700 1 -- 172.21.2.105:0/2152363190 shutdown_connections 2021-11-12T05:46:31.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.980+0000 7f04fe057700 1 --2- 172.21.2.105:0/2152363190 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04f80ace20 0x7f04f80b0520 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:31.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.980+0000 7f04fe057700 1 -- 172.21.2.105:0/2152363190 >> 172.21.2.105:0/2152363190 conn(0x7f04f805c490 msgr2=0x7f04f80b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:31.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.980+0000 7f04fe057700 1 -- 172.21.2.105:0/2152363190 shutdown_connections 2021-11-12T05:46:31.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.980+0000 7f04fe057700 1 -- 172.21.2.105:0/2152363190 wait complete. 2021-11-12T05:46:31.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.980+0000 7f04fe057700 1 Processor -- start 2021-11-12T05:46:31.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.980+0000 7f04fe057700 1 -- start start 2021-11-12T05:46:31.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.984+0000 7f04fe057700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f04f80aca40 0x7f04f8153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:31.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.984+0000 7f04fe057700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f04f80ace20 0x7f04f8153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:31.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.984+0000 7f04fe057700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04f8144180 0x7f04f80a81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:31.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.984+0000 7f04fe057700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f8154230 con 0x7f04f8144180 2021-11-12T05:46:31.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.984+0000 7f04fe057700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f8157240 con 0x7f04f80ace20 2021-11-12T05:46:31.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.984+0000 7f04fe057700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f81574e0 con 0x7f04f80aca40 2021-11-12T05:46:31.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.984+0000 7f04f7fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04f8144180 0x7f04f80a81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:31.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.984+0000 7f04f7fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04f8144180 0x7f04f80a81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47522/0 (socket says 172.21.2.105:47522) 2021-11-12T05:46:31.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.984+0000 7f04f7fff700 1 -- 172.21.2.105:0/176533921 learned_addr learned my addr 172.21.2.105:0/176533921 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:31.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.984+0000 7f04f7fff700 1 -- 172.21.2.105:0/176533921 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f04f80aca40 msgr2=0x7f04f8153850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:31.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.984+0000 7f04f7fff700 1 --2- 172.21.2.105:0/176533921 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f04f80aca40 0x7f04f8153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:31.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.984+0000 7f04f7fff700 1 -- 172.21.2.105:0/176533921 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f04f80ace20 msgr2=0x7f04f8153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:31.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.984+0000 7f04f7fff700 1 --2- 172.21.2.105:0/176533921 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f04f80ace20 0x7f04f8153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:31.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.984+0000 7f04f7fff700 1 -- 172.21.2.105:0/176533921 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e800b180 con 0x7f04f8144180 2021-11-12T05:46:31.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.984+0000 7f04f7fff700 1 --2- 172.21.2.105:0/176533921 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04f8144180 0x7f04f80a81c0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7f04f00032b0 tx=0x7f04f00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:31.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.984+0000 7f04f4ff9700 1 -- 172.21.2.105:0/176533921 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04f000d4a0 con 0x7f04f8144180 2021-11-12T05:46:31.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.984+0000 7f04f4ff9700 1 -- 172.21.2.105:0/176533921 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f000d600 con 0x7f04f8144180 2021-11-12T05:46:31.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.984+0000 7f04f4ff9700 1 -- 172.21.2.105:0/176533921 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04f000d960 con 0x7f04f8144180 2021-11-12T05:46:31.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.984+0000 7f04fe057700 1 -- 172.21.2.105:0/176533921 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f8064090 con 0x7f04f8144180 2021-11-12T05:46:31.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.984+0000 7f04fe057700 1 -- 172.21.2.105:0/176533921 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f8064d90 con 0x7f04f8144180 2021-11-12T05:46:31.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.984+0000 7f04fe057700 1 -- 172.21.2.105:0/176533921 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f81570a0 con 0x7f04f8144180 2021-11-12T05:46:31.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.984+0000 7f04f4ff9700 1 -- 172.21.2.105:0/176533921 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f04f0018030 con 0x7f04f8144180 2021-11-12T05:46:31.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.984+0000 7f04f4ff9700 1 --2- 172.21.2.105:0/176533921 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f04dc0536a0 0x7f04dc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:31.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.984+0000 7f04f4ff9700 1 -- 172.21.2.105:0/176533921 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f04f006b120 con 0x7f04f8144180 2021-11-12T05:46:31.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.984+0000 7f04f77fe700 1 --2- 172.21.2.105:0/176533921 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f04dc0536a0 0x7f04dc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:31.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.984+0000 7f04f77fe700 1 --2- 172.21.2.105:0/176533921 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f04dc0536a0 0x7f04dc055b60 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f04f8061140 tx=0x7f04e0007800).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:31.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:31.988+0000 7f04f4ff9700 1 -- 172.21.2.105:0/176533921 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f04f81570a0 con 0x7f04f8144180 2021-11-12T05:46:32.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.072+0000 7f04fe057700 1 -- 172.21.2.105:0/176533921 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f04f8064d90 con 0x7f04f8144180 2021-11-12T05:46:32.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.072+0000 7f04f4ff9700 1 -- 172.21.2.105:0/176533921 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v75) v1 ==== 110+0+10 (secure 0 0 0) 0x7f04f8064d90 con 0x7f04f8144180 2021-11-12T05:46:32.076 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:46:32.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.072+0000 7f04fe057700 1 -- 172.21.2.105:0/176533921 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f04dc0536a0 msgr2=0x7f04dc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:32.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.072+0000 7f04fe057700 1 --2- 172.21.2.105:0/176533921 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f04dc0536a0 0x7f04dc055b60 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f04f8061140 tx=0x7f04e0007800).stop 2021-11-12T05:46:32.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.072+0000 7f04fe057700 1 -- 172.21.2.105:0/176533921 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04f8144180 msgr2=0x7f04f80a81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:32.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.072+0000 7f04fe057700 1 --2- 172.21.2.105:0/176533921 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04f8144180 0x7f04f80a81c0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7f04f00032b0 tx=0x7f04f00090f0).stop 2021-11-12T05:46:32.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.072+0000 7f04fe057700 1 -- 172.21.2.105:0/176533921 shutdown_connections 2021-11-12T05:46:32.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.072+0000 7f04fe057700 1 --2- 172.21.2.105:0/176533921 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f04dc0536a0 0x7f04dc055b60 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:32.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.072+0000 7f04fe057700 1 --2- 172.21.2.105:0/176533921 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04f8144180 0x7f04f80a81c0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:32.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.072+0000 7f04fe057700 1 --2- 172.21.2.105:0/176533921 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f04f80ace20 0x7f04f8153d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:32.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.072+0000 7f04fe057700 1 --2- 172.21.2.105:0/176533921 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f04f80aca40 0x7f04f8153850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:32.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.072+0000 7f04fe057700 1 -- 172.21.2.105:0/176533921 >> 172.21.2.105:0/176533921 conn(0x7f04f805c490 msgr2=0x7f04f80b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:32.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.072+0000 7f04fe057700 1 -- 172.21.2.105:0/176533921 shutdown_connections 2021-11-12T05:46:32.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.072+0000 7f04fe057700 1 -- 172.21.2.105:0/176533921 wait complete. 2021-11-12T05:46:32.083 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:46:32.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.132+0000 7f07a1d23700 1 Processor -- start 2021-11-12T05:46:32.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.132+0000 7f07a1d23700 1 -- start start 2021-11-12T05:46:32.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.132+0000 7f07a1d23700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f079c05fdc0 0x7f079c0b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:32.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.132+0000 7f07a1d23700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f079c0601a0 0x7f079c13e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:32.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.132+0000 7f07a1d23700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f079c0ae9e0 con 0x7f079c0b06e0 2021-11-12T05:46:32.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.132+0000 7f07a1d23700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f079c0b31f0 con 0x7f079c0601a0 2021-11-12T05:46:32.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.132+0000 7f07a1d23700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f079c0af7c0 con 0x7f079c05fdc0 2021-11-12T05:46:32.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.132+0000 7f079affd700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f079c0b06e0 0x7f079c0af0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57924/0 (socket says 172.21.2.105:57924) 2021-11-12T05:46:32.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.132+0000 7f079affd700 1 -- 172.21.2.105:0/3023808535 learned_addr learned my addr 172.21.2.105:0/3023808535 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:46:32.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.132+0000 7f079bfff700 1 --2- 172.21.2.105:0/3023808535 >> v2:172.21.2.105:3300/0 conn(0x7f079c0601a0 0x7f079c13e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:32.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.132+0000 7f079bfff700 1 -- 172.21.2.105:0/3023808535 >> v2:172.21.2.115:3300/0 conn(0x7f079c05fdc0 msgr2=0x7f079c0b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:32.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.132+0000 7f079bfff700 1 --2- 172.21.2.105:0/3023808535 >> v2:172.21.2.115:3300/0 conn(0x7f079c05fdc0 0x7f079c0b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:32.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.132+0000 7f079bfff700 1 -- 172.21.2.105:0/3023808535 >> v1:172.21.2.105:6789/0 conn(0x7f079c0b06e0 legacy=0x7f079c0af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:32.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.132+0000 7f079bfff700 1 -- 172.21.2.105:0/3023808535 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f079c067cb0 con 0x7f079c0601a0 2021-11-12T05:46:32.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.132+0000 7f079bfff700 1 --2- 172.21.2.105:0/3023808535 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f079c0601a0 0x7f079c13e610 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7f079c0b3330 tx=0x7f079400b470).ready entity=mon.0 client_cookie=9d5f2435ad0a8694 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:32.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.132+0000 7f079a7fc700 1 -- 172.21.2.105:0/3023808535 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f079400ddb0 con 0x7f079c0601a0 2021-11-12T05:46:32.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.132+0000 7f079a7fc700 1 -- 172.21.2.105:0/3023808535 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0794010470 con 0x7f079c0601a0 2021-11-12T05:46:32.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.132+0000 7f079a7fc700 1 -- 172.21.2.105:0/3023808535 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07940107d0 con 0x7f079c0601a0 2021-11-12T05:46:32.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.132+0000 7f07a1d23700 1 -- 172.21.2.105:0/3023808535 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f079c0601a0 msgr2=0x7f079c13e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:32.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.132+0000 7f07a1d23700 1 --2- 172.21.2.105:0/3023808535 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f079c0601a0 0x7f079c13e610 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7f079c0b3330 tx=0x7f079400b470).stop 2021-11-12T05:46:32.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.132+0000 7f07a1d23700 1 -- 172.21.2.105:0/3023808535 shutdown_connections 2021-11-12T05:46:32.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.132+0000 7f07a1d23700 1 --2- 172.21.2.105:0/3023808535 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f079c0601a0 0x7f079c13e610 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:32.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.132+0000 7f07a1d23700 1 --2- 172.21.2.105:0/3023808535 >> v2:172.21.2.115:3300/0 conn(0x7f079c05fdc0 0x7f079c0b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:32.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.132+0000 7f07a1d23700 1 -- 172.21.2.105:0/3023808535 >> 172.21.2.105:0/3023808535 conn(0x7f079c0632b0 msgr2=0x7f079c05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:32.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.132+0000 7f07a1d23700 1 -- 172.21.2.105:0/3023808535 shutdown_connections 2021-11-12T05:46:32.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.132+0000 7f07a1d23700 1 -- 172.21.2.105:0/3023808535 wait complete. 2021-11-12T05:46:32.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.136+0000 7f07a1d23700 1 Processor -- start 2021-11-12T05:46:32.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.136+0000 7f07a1d23700 1 -- start start 2021-11-12T05:46:32.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.136+0000 7f07a1d23700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f079c05fdc0 0x7f079c0a9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:32.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.136+0000 7f07a1d23700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f079c0601a0 0x7f079c13eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:32.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.136+0000 7f07a1d23700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f079c0b06e0 0x7f079c13f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:32.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.136+0000 7f07a1d23700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079c156b60 con 0x7f079c05fdc0 2021-11-12T05:46:32.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.136+0000 7f07a1d23700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079c144e40 con 0x7f079c0601a0 2021-11-12T05:46:32.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.136+0000 7f07a1d23700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f079c0a7410 con 0x7f079c0b06e0 2021-11-12T05:46:32.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.136+0000 7f079b7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f079c05fdc0 0x7f079c0a9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:32.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.136+0000 7f079b7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f079c05fdc0 0x7f079c0a9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47532/0 (socket says 172.21.2.105:47532) 2021-11-12T05:46:32.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.136+0000 7f079b7fe700 1 -- 172.21.2.105:0/644081521 learned_addr learned my addr 172.21.2.105:0/644081521 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:32.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.136+0000 7f079b7fe700 1 -- 172.21.2.105:0/644081521 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f079c0b06e0 msgr2=0x7f079c13f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:32.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.136+0000 7f079b7fe700 1 --2- 172.21.2.105:0/644081521 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f079c0b06e0 0x7f079c13f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:32.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.136+0000 7f079b7fe700 1 -- 172.21.2.105:0/644081521 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f079c0601a0 msgr2=0x7f079c13eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:32.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.136+0000 7f079b7fe700 1 --2- 172.21.2.105:0/644081521 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f079c0601a0 0x7f079c13eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:32.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.136+0000 7f079b7fe700 1 -- 172.21.2.105:0/644081521 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f079400b710 con 0x7f079c05fdc0 2021-11-12T05:46:32.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.136+0000 7f079b7fe700 1 --2- 172.21.2.105:0/644081521 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f079c05fdc0 0x7f079c0a9100 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7f078c002f70 tx=0x7f078c006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:32.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.136+0000 7f0798ff9700 1 -- 172.21.2.105:0/644081521 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f078c013460 con 0x7f079c05fdc0 2021-11-12T05:46:32.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.136+0000 7f0798ff9700 1 -- 172.21.2.105:0/644081521 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078c0135c0 con 0x7f079c05fdc0 2021-11-12T05:46:32.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.136+0000 7f0798ff9700 1 -- 172.21.2.105:0/644081521 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f078c013920 con 0x7f079c05fdc0 2021-11-12T05:46:32.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.136+0000 7f07a1d23700 1 -- 172.21.2.105:0/644081521 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f079c0a76b0 con 0x7f079c05fdc0 2021-11-12T05:46:32.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.136+0000 7f07a1d23700 1 -- 172.21.2.105:0/644081521 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f079c13f880 con 0x7f079c05fdc0 2021-11-12T05:46:32.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.136+0000 7f07a1d23700 1 -- 172.21.2.105:0/644081521 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f079c0b0bf0 con 0x7f079c05fdc0 2021-11-12T05:46:32.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.136+0000 7f0798ff9700 1 -- 172.21.2.105:0/644081521 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f078c01a060 con 0x7f079c05fdc0 2021-11-12T05:46:32.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.136+0000 7f0798ff9700 1 --2- 172.21.2.105:0/644081521 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f077c0535d0 0x7f077c055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:32.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.136+0000 7f0798ff9700 1 -- 172.21.2.105:0/644081521 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f078c06b660 con 0x7f079c05fdc0 2021-11-12T05:46:32.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.136+0000 7f079affd700 1 --2- 172.21.2.105:0/644081521 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f077c0535d0 0x7f077c055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:32.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.136+0000 7f079affd700 1 --2- 172.21.2.105:0/644081521 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f077c0535d0 0x7f077c055a90 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f079c0ae880 tx=0x7f0790007860).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:32.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.140+0000 7f0798ff9700 1 -- 172.21.2.105:0/644081521 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f078c042560 con 0x7f079c05fdc0 2021-11-12T05:46:32.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.220+0000 7f07a1d23700 1 -- 172.21.2.105:0/644081521 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f079c057350 con 0x7f079c05fdc0 2021-11-12T05:46:32.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.224+0000 7f0798ff9700 1 -- 172.21.2.105:0/644081521 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v75) v1 ==== 92+0+10 (secure 0 0 0) 0x7f078c018070 con 0x7f079c05fdc0 2021-11-12T05:46:32.228 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:46:32.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.224+0000 7f07a1d23700 1 -- 172.21.2.105:0/644081521 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f077c0535d0 msgr2=0x7f077c055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:32.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.224+0000 7f07a1d23700 1 --2- 172.21.2.105:0/644081521 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f077c0535d0 0x7f077c055a90 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f079c0ae880 tx=0x7f0790007860).stop 2021-11-12T05:46:32.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.224+0000 7f07a1d23700 1 -- 172.21.2.105:0/644081521 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f079c05fdc0 msgr2=0x7f079c0a9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:32.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.224+0000 7f07a1d23700 1 --2- 172.21.2.105:0/644081521 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f079c05fdc0 0x7f079c0a9100 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7f078c002f70 tx=0x7f078c006ec0).stop 2021-11-12T05:46:32.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.224+0000 7f07a1d23700 1 -- 172.21.2.105:0/644081521 shutdown_connections 2021-11-12T05:46:32.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.224+0000 7f07a1d23700 1 --2- 172.21.2.105:0/644081521 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f077c0535d0 0x7f077c055a90 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:32.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.224+0000 7f07a1d23700 1 --2- 172.21.2.105:0/644081521 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f079c0b06e0 0x7f079c13f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:32.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.224+0000 7f07a1d23700 1 --2- 172.21.2.105:0/644081521 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f079c0601a0 0x7f079c13eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:32.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.224+0000 7f07a1d23700 1 --2- 172.21.2.105:0/644081521 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f079c05fdc0 0x7f079c0a9100 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:32.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.224+0000 7f07a1d23700 1 -- 172.21.2.105:0/644081521 >> 172.21.2.105:0/644081521 conn(0x7f079c0632b0 msgr2=0x7f079c066f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:32.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.224+0000 7f07a1d23700 1 -- 172.21.2.105:0/644081521 shutdown_connections 2021-11-12T05:46:32.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.224+0000 7f07a1d23700 1 -- 172.21.2.105:0/644081521 wait complete. 2021-11-12T05:46:32.235 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-12T05:46:32.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.284+0000 7fbd44b46700 1 Processor -- start 2021-11-12T05:46:32.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.284+0000 7fbd44b46700 1 -- start start 2021-11-12T05:46:32.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.284+0000 7fbd44b46700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbd400626b0 0x7fbd40062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:32.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.284+0000 7fbd44b46700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd400b0d50 con 0x7fbd40130a80 2021-11-12T05:46:32.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.284+0000 7fbd44b46700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd400ad380 con 0x7fbd400af750 2021-11-12T05:46:32.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.284+0000 7fbd44b46700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd400ae190 con 0x7fbd400626b0 2021-11-12T05:46:32.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.284+0000 7fbd3ed9d700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fbd40130a80 0x7fbd401474d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57936/0 (socket says 172.21.2.105:57936) 2021-11-12T05:46:32.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.284+0000 7fbd3ed9d700 1 -- 172.21.2.105:0/3103440543 learned_addr learned my addr 172.21.2.105:0/3103440543 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:46:32.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.284+0000 7fbd3d59a700 1 -- 172.21.2.105:0/3103440543 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1009252803 0 0) 0x7fbd400b0d50 con 0x7fbd40130a80 2021-11-12T05:46:32.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.284+0000 7fbd3d59a700 1 -- 172.21.2.105:0/3103440543 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd24003260 con 0x7fbd40130a80 2021-11-12T05:46:32.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.284+0000 7fbd3d59a700 1 -- 172.21.2.105:0/3103440543 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1706268727 0 0) 0x7fbd24003260 con 0x7fbd40130a80 2021-11-12T05:46:32.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.284+0000 7fbd3d59a700 1 -- 172.21.2.105:0/3103440543 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbd400626b0 msgr2=0x7fbd40062a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:32.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.284+0000 7fbd3d59a700 1 --2- 172.21.2.105:0/3103440543 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbd400626b0 0x7fbd40062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:32.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.284+0000 7fbd3d59a700 1 -- 172.21.2.105:0/3103440543 >> v1:172.21.2.115:6789/0 conn(0x7fbd400af750 legacy=0x7fbd40130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:32.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.284+0000 7fbd3d59a700 1 -- 172.21.2.105:0/3103440543 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd400ae2d0 con 0x7fbd40130a80 2021-11-12T05:46:32.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.284+0000 7fbd3d59a700 1 -- 172.21.2.105:0/3103440543 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fbd380019e0 con 0x7fbd40130a80 2021-11-12T05:46:32.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.284+0000 7fbd3d59a700 1 -- 172.21.2.105:0/3103440543 >> v1:172.21.2.105:6789/0 conn(0x7fbd40130a80 legacy=0x7fbd401474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:32.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.284+0000 7fbd3d59a700 1 --2- 172.21.2.105:0/3103440543 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbd400626b0 0x7fbd24003780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:32.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.284+0000 7fbd3d59a700 1 --2- 172.21.2.105:0/3103440543 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbd24003e20 0x7fbd24004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:32.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.284+0000 7fbd3d59a700 1 --2- 172.21.2.105:0/3103440543 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbd24004b10 0x7fbd24004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:32.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.284+0000 7fbd3d59a700 1 -- 172.21.2.105:0/3103440543 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd400ae190 con 0x7fbd24004b10 2021-11-12T05:46:32.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.284+0000 7fbd3d59a700 1 -- 172.21.2.105:0/3103440543 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2400b960 con 0x7fbd24003e20 2021-11-12T05:46:32.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.284+0000 7fbd3d59a700 1 -- 172.21.2.105:0/3103440543 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2400bb20 con 0x7fbd400626b0 2021-11-12T05:46:32.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.284+0000 7fbd3ed9d700 1 --2- 172.21.2.105:0/3103440543 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbd24004b10 0x7fbd24004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:32.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.284+0000 7fbd3ed9d700 1 -- 172.21.2.105:0/3103440543 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbd400626b0 msgr2=0x7fbd24003780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:32.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.284+0000 7fbd3ed9d700 1 --2- 172.21.2.105:0/3103440543 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbd400626b0 0x7fbd24003780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:32.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.284+0000 7fbd3ed9d700 1 -- 172.21.2.105:0/3103440543 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbd24003e20 msgr2=0x7fbd24004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:32.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.284+0000 7fbd3ed9d700 1 --2- 172.21.2.105:0/3103440543 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbd24003e20 0x7fbd24004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:32.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.284+0000 7fbd3ed9d700 1 -- 172.21.2.105:0/3103440543 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd24003260 con 0x7fbd24004b10 2021-11-12T05:46:32.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.284+0000 7fbd3ed9d700 1 --2- 172.21.2.105:0/3103440543 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbd24004b10 0x7fbd24004f90 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7fbd4005d1f0 tx=0x7fbd380021b0).ready entity=mon.0 client_cookie=b8bd71c657fe4191 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:32.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.284+0000 7fbd3d59a700 1 -- 172.21.2.105:0/3103440543 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd3800cc70 con 0x7fbd24004b10 2021-11-12T05:46:32.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.284+0000 7fbd3d59a700 1 -- 172.21.2.105:0/3103440543 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3800cdd0 con 0x7fbd24004b10 2021-11-12T05:46:32.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.284+0000 7fbd3d59a700 1 -- 172.21.2.105:0/3103440543 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd38005b80 con 0x7fbd24004b10 2021-11-12T05:46:32.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.288+0000 7fbd44b46700 1 -- 172.21.2.105:0/3103440543 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbd24004b10 msgr2=0x7fbd24004f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:32.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.288+0000 7fbd44b46700 1 --2- 172.21.2.105:0/3103440543 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbd24004b10 0x7fbd24004f90 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7fbd4005d1f0 tx=0x7fbd380021b0).stop 2021-11-12T05:46:32.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.288+0000 7fbd3ed9d700 1 -- 172.21.2.105:0/3103440543 reap_dead start 2021-11-12T05:46:32.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.288+0000 7fbd44b46700 1 -- 172.21.2.105:0/3103440543 shutdown_connections 2021-11-12T05:46:32.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.288+0000 7fbd44b46700 1 -- 172.21.2.105:0/3103440543 >> 172.21.2.105:0/3103440543 conn(0x7fbd400b5320 msgr2=0x7fbd400b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:32.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.288+0000 7fbd44b46700 1 -- 172.21.2.105:0/3103440543 shutdown_connections 2021-11-12T05:46:32.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.288+0000 7fbd44b46700 1 -- 172.21.2.105:0/3103440543 wait complete. 2021-11-12T05:46:32.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.288+0000 7fbd44b46700 1 Processor -- start 2021-11-12T05:46:32.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.288+0000 7fbd44b46700 1 -- start start 2021-11-12T05:46:32.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.288+0000 7fbd44b46700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbd24004b10 0x7fbd40146e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:32.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.288+0000 7fbd44b46700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbd4012df30 0x7fbd40157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:32.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.288+0000 7fbd44b46700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbd401452f0 0x7fbd40159b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:32.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.288+0000 7fbd44b46700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4014a000 con 0x7fbd4012df30 2021-11-12T05:46:32.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.288+0000 7fbd44b46700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd401569b0 con 0x7fbd401452f0 2021-11-12T05:46:32.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.288+0000 7fbd44b46700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd40156c50 con 0x7fbd24004b10 2021-11-12T05:46:32.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.288+0000 7fbd3dd9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbd4012df30 0x7fbd40157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:32.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.288+0000 7fbd3dd9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbd4012df30 0x7fbd40157390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47552/0 (socket says 172.21.2.105:47552) 2021-11-12T05:46:32.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.288+0000 7fbd3dd9b700 1 -- 172.21.2.105:0/3083707947 learned_addr learned my addr 172.21.2.105:0/3083707947 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:32.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.288+0000 7fbd3dd9b700 1 -- 172.21.2.105:0/3083707947 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbd24004b10 msgr2=0x7fbd40146e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:32.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.288+0000 7fbd3dd9b700 1 --2- 172.21.2.105:0/3083707947 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbd24004b10 0x7fbd40146e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:32.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.288+0000 7fbd3dd9b700 1 -- 172.21.2.105:0/3083707947 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbd401452f0 msgr2=0x7fbd40159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:32.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.288+0000 7fbd3dd9b700 1 --2- 172.21.2.105:0/3083707947 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbd401452f0 0x7fbd40159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:32.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.288+0000 7fbd3dd9b700 1 -- 172.21.2.105:0/3083707947 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd40156ef0 con 0x7fbd4012df30 2021-11-12T05:46:32.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.288+0000 7fbd3dd9b700 1 --2- 172.21.2.105:0/3083707947 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbd4012df30 0x7fbd40157390 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7fbd34000f70 tx=0x7fbd34006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:32.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.288+0000 7fbd2f7fe700 1 -- 172.21.2.105:0/3083707947 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd34013460 con 0x7fbd4012df30 2021-11-12T05:46:32.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.288+0000 7fbd2f7fe700 1 -- 172.21.2.105:0/3083707947 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd340135c0 con 0x7fbd4012df30 2021-11-12T05:46:32.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.288+0000 7fbd44b46700 1 -- 172.21.2.105:0/3083707947 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd401565c0 con 0x7fbd4012df30 2021-11-12T05:46:32.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.288+0000 7fbd44b46700 1 -- 172.21.2.105:0/3083707947 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd401459c0 con 0x7fbd4012df30 2021-11-12T05:46:32.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.288+0000 7fbd2f7fe700 1 -- 172.21.2.105:0/3083707947 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd34013920 con 0x7fbd4012df30 2021-11-12T05:46:32.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.288+0000 7fbd44b46700 1 -- 172.21.2.105:0/3083707947 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd18003410 con 0x7fbd4012df30 2021-11-12T05:46:32.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.288+0000 7fbd2f7fe700 1 -- 172.21.2.105:0/3083707947 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbd3401a060 con 0x7fbd4012df30 2021-11-12T05:46:32.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.288+0000 7fbd2f7fe700 1 --2- 172.21.2.105:0/3083707947 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbd1c0535d0 0x7fbd1c055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:32.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.288+0000 7fbd2f7fe700 1 -- 172.21.2.105:0/3083707947 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fbd3406b480 con 0x7fbd4012df30 2021-11-12T05:46:32.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.288+0000 7fbd3e59c700 1 --2- 172.21.2.105:0/3083707947 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbd1c0535d0 0x7fbd1c055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:32.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.288+0000 7fbd3e59c700 1 --2- 172.21.2.105:0/3083707947 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbd1c0535d0 0x7fbd1c055a90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7fbd30002f70 tx=0x7fbd30006a10).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:32.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.292+0000 7fbd2f7fe700 1 -- 172.21.2.105:0/3083707947 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbd34042380 con 0x7fbd4012df30 2021-11-12T05:46:32.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.376+0000 7fbd44b46700 1 -- 172.21.2.105:0/3083707947 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbd18003c40 con 0x7fbd4012df30 2021-11-12T05:46:32.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.376+0000 7fbd2f7fe700 1 -- 172.21.2.105:0/3083707947 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) v1 ==== 104+0+10 (secure 0 0 0) 0x7fbd340180a0 con 0x7fbd4012df30 2021-11-12T05:46:32.381 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:46:32.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.376+0000 7fbd44b46700 1 -- 172.21.2.105:0/3083707947 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbd1c0535d0 msgr2=0x7fbd1c055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:32.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.376+0000 7fbd44b46700 1 --2- 172.21.2.105:0/3083707947 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbd1c0535d0 0x7fbd1c055a90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7fbd30002f70 tx=0x7fbd30006a10).stop 2021-11-12T05:46:32.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.376+0000 7fbd44b46700 1 -- 172.21.2.105:0/3083707947 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbd4012df30 msgr2=0x7fbd40157390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:32.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.376+0000 7fbd44b46700 1 --2- 172.21.2.105:0/3083707947 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbd4012df30 0x7fbd40157390 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7fbd34000f70 tx=0x7fbd34006df0).stop 2021-11-12T05:46:32.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.376+0000 7fbd44b46700 1 -- 172.21.2.105:0/3083707947 shutdown_connections 2021-11-12T05:46:32.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.376+0000 7fbd44b46700 1 --2- 172.21.2.105:0/3083707947 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbd1c0535d0 0x7fbd1c055a90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:32.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.376+0000 7fbd44b46700 1 --2- 172.21.2.105:0/3083707947 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbd401452f0 0x7fbd40159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:32.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.376+0000 7fbd44b46700 1 --2- 172.21.2.105:0/3083707947 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbd4012df30 0x7fbd40157390 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:32.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.376+0000 7fbd44b46700 1 --2- 172.21.2.105:0/3083707947 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbd24004b10 0x7fbd40146e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:32.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.376+0000 7fbd44b46700 1 -- 172.21.2.105:0/3083707947 >> 172.21.2.105:0/3083707947 conn(0x7fbd400b5320 msgr2=0x7fbd4014cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:32.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.376+0000 7fbd44b46700 1 -- 172.21.2.105:0/3083707947 shutdown_connections 2021-11-12T05:46:32.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.376+0000 7fbd44b46700 1 -- 172.21.2.105:0/3083707947 wait complete. 2021-11-12T05:46:32.388 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-12T05:46:32.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.436+0000 7f0d9d735700 1 Processor -- start 2021-11-12T05:46:32.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.436+0000 7f0d9d735700 1 -- start start 2021-11-12T05:46:32.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.436+0000 7f0d9d735700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f0d980b1060 0x7f0d9813f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:32.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.436+0000 7f0d9d735700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d980ad400 con 0x7f0d980b2e20 2021-11-12T05:46:32.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.436+0000 7f0d9d735700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d980b3200 con 0x7f0d98142c50 2021-11-12T05:46:32.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.436+0000 7f0d9d735700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d980ad660 con 0x7f0d980b1060 2021-11-12T05:46:32.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.436+0000 7f0d96ffd700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f0d980b2e20 0x7f0d9813ea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57956/0 (socket says 172.21.2.105:57956) 2021-11-12T05:46:32.443 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.436+0000 7f0d96ffd700 1 -- 172.21.2.105:0/2226624797 learned_addr learned my addr 172.21.2.105:0/2226624797 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:46:32.443 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.436+0000 7f0d967fc700 1 --2- 172.21.2.105:0/2226624797 >> v2:172.21.2.105:3300/0 conn(0x7f0d980b1060 0x7f0d9813f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:32.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.436+0000 7f0d967fc700 1 -- 172.21.2.105:0/2226624797 >> v1:172.21.2.115:6789/0 conn(0x7f0d98142c50 legacy=0x7f0d981430a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:32.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.436+0000 7f0d967fc700 1 -- 172.21.2.105:0/2226624797 >> v1:172.21.2.105:6789/0 conn(0x7f0d980b2e20 legacy=0x7f0d9813ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:32.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.436+0000 7f0d967fc700 1 -- 172.21.2.105:0/2226624797 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d980ad900 con 0x7f0d980b1060 2021-11-12T05:46:32.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.436+0000 7f0d967fc700 1 --2- 172.21.2.105:0/2226624797 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d980b1060 0x7f0d9813f160 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f0d980b35c0 tx=0x7f0d88006e80).ready entity=mon.0 client_cookie=fb7808d31d3a9bb8 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:32.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.436+0000 7f0d95ffb700 1 -- 172.21.2.105:0/2226624797 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d8800f940 con 0x7f0d980b1060 2021-11-12T05:46:32.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.436+0000 7f0d95ffb700 1 -- 172.21.2.105:0/2226624797 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d88000e90 con 0x7f0d980b1060 2021-11-12T05:46:32.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.436+0000 7f0d95ffb700 1 -- 172.21.2.105:0/2226624797 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d8800fc90 con 0x7f0d980b1060 2021-11-12T05:46:32.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.436+0000 7f0d9d735700 1 -- 172.21.2.105:0/2226624797 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d980b1060 msgr2=0x7f0d9813f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:32.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.436+0000 7f0d9d735700 1 --2- 172.21.2.105:0/2226624797 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d980b1060 0x7f0d9813f160 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f0d980b35c0 tx=0x7f0d88006e80).stop 2021-11-12T05:46:32.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.436+0000 7f0d9d735700 1 -- 172.21.2.105:0/2226624797 shutdown_connections 2021-11-12T05:46:32.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.436+0000 7f0d9d735700 1 --2- 172.21.2.105:0/2226624797 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d980b1060 0x7f0d9813f160 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:32.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.436+0000 7f0d9d735700 1 -- 172.21.2.105:0/2226624797 >> 172.21.2.105:0/2226624797 conn(0x7f0d98062f60 msgr2=0x7f0d98063370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:32.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.436+0000 7f0d9d735700 1 -- 172.21.2.105:0/2226624797 shutdown_connections 2021-11-12T05:46:32.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.436+0000 7f0d9d735700 1 -- 172.21.2.105:0/2226624797 wait complete. 2021-11-12T05:46:32.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.440+0000 7f0d9d735700 1 Processor -- start 2021-11-12T05:46:32.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.440+0000 7f0d9d735700 1 -- start start 2021-11-12T05:46:32.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.440+0000 7f0d9d735700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d980b1060 0x7f0d98136460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:32.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.440+0000 7f0d9d735700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0d980b2e20 0x7f0d98140a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:32.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.440+0000 7f0d9d735700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d98142c50 0x7f0d98140f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:32.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.440+0000 7f0d9d735700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d980aa2a0 con 0x7f0d980b1060 2021-11-12T05:46:32.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.440+0000 7f0d9d735700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d980650a0 con 0x7f0d980b2e20 2021-11-12T05:46:32.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.440+0000 7f0d9d735700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d980a9ca0 con 0x7f0d98142c50 2021-11-12T05:46:32.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.440+0000 7f0d96ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d980b1060 0x7f0d98136460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:32.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.440+0000 7f0d96ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d980b1060 0x7f0d98136460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47564/0 (socket says 172.21.2.105:47564) 2021-11-12T05:46:32.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.440+0000 7f0d96ffd700 1 -- 172.21.2.105:0/3271583373 learned_addr learned my addr 172.21.2.105:0/3271583373 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:32.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.440+0000 7f0d96ffd700 1 -- 172.21.2.105:0/3271583373 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d98142c50 msgr2=0x7f0d98140f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:32.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.440+0000 7f0d96ffd700 1 --2- 172.21.2.105:0/3271583373 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d98142c50 0x7f0d98140f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:32.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.440+0000 7f0d96ffd700 1 -- 172.21.2.105:0/3271583373 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0d980b2e20 msgr2=0x7f0d98140a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:32.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.440+0000 7f0d96ffd700 1 --2- 172.21.2.105:0/3271583373 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0d980b2e20 0x7f0d98140a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:32.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.440+0000 7f0d96ffd700 1 -- 172.21.2.105:0/3271583373 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8800c310 con 0x7f0d980b1060 2021-11-12T05:46:32.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.440+0000 7f0d96ffd700 1 --2- 172.21.2.105:0/3271583373 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d980b1060 0x7f0d98136460 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f0d980b3520 tx=0x7f0d80007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:32.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.440+0000 7f0d8ffff700 1 -- 172.21.2.105:0/3271583373 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d8000ce30 con 0x7f0d980b1060 2021-11-12T05:46:32.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.440+0000 7f0d8ffff700 1 -- 172.21.2.105:0/3271583373 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d800072e0 con 0x7f0d980b1060 2021-11-12T05:46:32.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.440+0000 7f0d8ffff700 1 -- 172.21.2.105:0/3271583373 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d800057e0 con 0x7f0d980b1060 2021-11-12T05:46:32.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.440+0000 7f0d9d735700 1 -- 172.21.2.105:0/3271583373 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d980a9f40 con 0x7f0d980b1060 2021-11-12T05:46:32.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.440+0000 7f0d9d735700 1 -- 172.21.2.105:0/3271583373 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d98141d60 con 0x7f0d980b1060 2021-11-12T05:46:32.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.440+0000 7f0d9d735700 1 -- 172.21.2.105:0/3271583373 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d98065210 con 0x7f0d980b1060 2021-11-12T05:46:32.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.440+0000 7f0d8ffff700 1 -- 172.21.2.105:0/3271583373 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0d80010070 con 0x7f0d980b1060 2021-11-12T05:46:32.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.440+0000 7f0d8ffff700 1 --2- 172.21.2.105:0/3271583373 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0d7c0535b0 0x7f0d7c055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:32.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.440+0000 7f0d8ffff700 1 -- 172.21.2.105:0/3271583373 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f0d8006b110 con 0x7f0d980b1060 2021-11-12T05:46:32.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.440+0000 7f0d967fc700 1 --2- 172.21.2.105:0/3271583373 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0d7c0535b0 0x7f0d7c055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:32.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.440+0000 7f0d967fc700 1 --2- 172.21.2.105:0/3271583373 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0d7c0535b0 0x7f0d7c055a70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f0d980b35c0 tx=0x7f0d88018000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:32.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.444+0000 7f0d8ffff700 1 -- 172.21.2.105:0/3271583373 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0d80042010 con 0x7f0d980b1060 2021-11-12T05:46:32.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.528+0000 7f0d9d735700 1 -- 172.21.2.105:0/3271583373 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0d980b2060 con 0x7f0d980b1060 2021-11-12T05:46:32.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.528+0000 7f0d8ffff700 1 -- 172.21.2.105:0/3271583373 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) v1 ==== 100+0+10 (secure 0 0 0) 0x7f0d80018070 con 0x7f0d980b1060 2021-11-12T05:46:32.533 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:46:32.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.528+0000 7f0d9d735700 1 -- 172.21.2.105:0/3271583373 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0d7c0535b0 msgr2=0x7f0d7c055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:32.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.528+0000 7f0d9d735700 1 --2- 172.21.2.105:0/3271583373 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0d7c0535b0 0x7f0d7c055a70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f0d980b35c0 tx=0x7f0d88018000).stop 2021-11-12T05:46:32.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.528+0000 7f0d9d735700 1 -- 172.21.2.105:0/3271583373 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d980b1060 msgr2=0x7f0d98136460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:32.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.528+0000 7f0d9d735700 1 --2- 172.21.2.105:0/3271583373 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d980b1060 0x7f0d98136460 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f0d980b3520 tx=0x7f0d80007c00).stop 2021-11-12T05:46:32.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.528+0000 7f0d9d735700 1 -- 172.21.2.105:0/3271583373 shutdown_connections 2021-11-12T05:46:32.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.528+0000 7f0d9d735700 1 --2- 172.21.2.105:0/3271583373 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0d7c0535b0 0x7f0d7c055a70 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:32.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.528+0000 7f0d9d735700 1 --2- 172.21.2.105:0/3271583373 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d98142c50 0x7f0d98140f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:32.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.528+0000 7f0d9d735700 1 --2- 172.21.2.105:0/3271583373 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0d980b2e20 0x7f0d98140a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:32.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.528+0000 7f0d9d735700 1 --2- 172.21.2.105:0/3271583373 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d980b1060 0x7f0d98136460 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:32.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.528+0000 7f0d9d735700 1 -- 172.21.2.105:0/3271583373 >> 172.21.2.105:0/3271583373 conn(0x7f0d98062f60 msgr2=0x7f0d9805fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:32.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.528+0000 7f0d9d735700 1 -- 172.21.2.105:0/3271583373 shutdown_connections 2021-11-12T05:46:32.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.528+0000 7f0d9d735700 1 -- 172.21.2.105:0/3271583373 wait complete. 2021-11-12T05:46:32.540 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-12T05:46:32.540 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:46:32.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.588+0000 7f85ee07a700 1 Processor -- start 2021-11-12T05:46:32.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.588+0000 7f85ee07a700 1 -- start start 2021-11-12T05:46:32.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.588+0000 7f85ee07a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f85e80ac280 0x7f85e814b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:32.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.588+0000 7f85ee07a700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f85e80af730 0x7f85e80ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:32.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.588+0000 7f85ee07a700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e80ac7b0 con 0x7f85e80ad080 2021-11-12T05:46:32.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.588+0000 7f85ee07a700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e81488a0 con 0x7f85e80af730 2021-11-12T05:46:32.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.588+0000 7f85ee07a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e80ac9e0 con 0x7f85e80ac280 2021-11-12T05:46:32.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.588+0000 7f85e6ffd700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f85e80ac280 0x7f85e814b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:32.594 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.588+0000 7f85e77fe700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7f85e80ad080 0x7f85e814abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:56436/0 (socket says 172.21.2.105:56436) 2021-11-12T05:46:32.594 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.588+0000 7f85e77fe700 1 -- 172.21.2.105:0/203700688 learned_addr learned my addr 172.21.2.105:0/203700688 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:46:32.594 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.588+0000 7f85e7fff700 1 --2- 172.21.2.105:0/203700688 >> v2:172.21.2.115:3300/0 conn(0x7f85e80af730 0x7f85e80ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:32.594 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.588+0000 7f85e6ffd700 1 -- 172.21.2.105:0/203700688 >> v2:172.21.2.115:3300/0 conn(0x7f85e80af730 msgr2=0x7f85e80ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:32.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.588+0000 7f85e6ffd700 1 --2- 172.21.2.105:0/203700688 >> v2:172.21.2.115:3300/0 conn(0x7f85e80af730 0x7f85e80ad460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:32.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.588+0000 7f85e6ffd700 1 -- 172.21.2.105:0/203700688 >> v1:172.21.2.115:6789/0 conn(0x7f85e80ad080 legacy=0x7f85e814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:32.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.588+0000 7f85e6ffd700 1 -- 172.21.2.105:0/203700688 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e80b0b30 con 0x7f85e80ac280 2021-11-12T05:46:32.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.588+0000 7f85e6ffd700 1 --2- 172.21.2.105:0/203700688 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f85e80ac280 0x7f85e814b2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f85dc002f70 tx=0x7f85dc006df0).ready entity=mon.2 client_cookie=e7409e6be9c2ce90 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:32.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.592+0000 7f85e67fc700 1 -- 172.21.2.105:0/203700688 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85dc00d570 con 0x7f85e80ac280 2021-11-12T05:46:32.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.592+0000 7f85e67fc700 1 -- 172.21.2.105:0/203700688 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85dc000e90 con 0x7f85e80ac280 2021-11-12T05:46:32.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.592+0000 7f85e67fc700 1 -- 172.21.2.105:0/203700688 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85dc00d8c0 con 0x7f85e80ac280 2021-11-12T05:46:32.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.592+0000 7f85ee07a700 1 -- 172.21.2.105:0/203700688 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f85e80ac280 msgr2=0x7f85e814b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:32.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.592+0000 7f85ee07a700 1 --2- 172.21.2.105:0/203700688 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f85e80ac280 0x7f85e814b2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f85dc002f70 tx=0x7f85dc006df0).stop 2021-11-12T05:46:32.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.592+0000 7f85ee07a700 1 -- 172.21.2.105:0/203700688 shutdown_connections 2021-11-12T05:46:32.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.592+0000 7f85ee07a700 1 --2- 172.21.2.105:0/203700688 >> v2:172.21.2.115:3300/0 conn(0x7f85e80af730 0x7f85e80ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:32.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.592+0000 7f85ee07a700 1 --2- 172.21.2.105:0/203700688 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f85e80ac280 0x7f85e814b2f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:32.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.592+0000 7f85ee07a700 1 -- 172.21.2.105:0/203700688 >> 172.21.2.105:0/203700688 conn(0x7f85e80b5370 msgr2=0x7f85e80b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:32.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.592+0000 7f85ee07a700 1 -- 172.21.2.105:0/203700688 shutdown_connections 2021-11-12T05:46:32.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.592+0000 7f85ee07a700 1 -- 172.21.2.105:0/203700688 wait complete. 2021-11-12T05:46:32.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.592+0000 7f85ee07a700 1 Processor -- start 2021-11-12T05:46:32.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.592+0000 7f85ee07a700 1 -- start start 2021-11-12T05:46:32.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.592+0000 7f85ee07a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f85e80ac280 0x7f85e8063690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:32.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.592+0000 7f85ee07a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85e80ad080 0x7f85e80a8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:32.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.592+0000 7f85ee07a700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f85e80af730 0x7f85e80a8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:32.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.592+0000 7f85ee07a700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e8063b80 con 0x7f85e80ad080 2021-11-12T05:46:32.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.592+0000 7f85ee07a700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e8063dc0 con 0x7f85e80af730 2021-11-12T05:46:32.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.592+0000 7f85ee07a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e8157910 con 0x7f85e80ac280 2021-11-12T05:46:32.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.592+0000 7f85e6ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85e80ad080 0x7f85e80a8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:32.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.592+0000 7f85e6ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85e80ad080 0x7f85e80a8030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47580/0 (socket says 172.21.2.105:47580) 2021-11-12T05:46:32.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.592+0000 7f85e6ffd700 1 -- 172.21.2.105:0/2501218771 learned_addr learned my addr 172.21.2.105:0/2501218771 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:32.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.592+0000 7f85e6ffd700 1 -- 172.21.2.105:0/2501218771 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f85e80ac280 msgr2=0x7f85e8063690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:32.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.592+0000 7f85e6ffd700 1 --2- 172.21.2.105:0/2501218771 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f85e80ac280 0x7f85e8063690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:32.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.592+0000 7f85e6ffd700 1 -- 172.21.2.105:0/2501218771 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f85e80af730 msgr2=0x7f85e80a8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:32.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.592+0000 7f85e6ffd700 1 --2- 172.21.2.105:0/2501218771 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f85e80af730 0x7f85e80a8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:32.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.592+0000 7f85e6ffd700 1 -- 172.21.2.105:0/2501218771 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85dc00b180 con 0x7f85e80ad080 2021-11-12T05:46:32.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.592+0000 7f85e6ffd700 1 --2- 172.21.2.105:0/2501218771 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85e80ad080 0x7f85e80a8030 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7f85dc002f70 tx=0x7f85dc014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:32.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.592+0000 7f85e4ff9700 1 -- 172.21.2.105:0/2501218771 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85dc00dea0 con 0x7f85e80ad080 2021-11-12T05:46:32.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.592+0000 7f85e4ff9700 1 -- 172.21.2.105:0/2501218771 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85dc01e400 con 0x7f85e80ad080 2021-11-12T05:46:32.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.592+0000 7f85ee07a700 1 -- 172.21.2.105:0/2501218771 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e8157eb0 con 0x7f85e80ad080 2021-11-12T05:46:32.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.592+0000 7f85e4ff9700 1 -- 172.21.2.105:0/2501218771 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85dc01e760 con 0x7f85e80ad080 2021-11-12T05:46:32.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.592+0000 7f85ee07a700 1 -- 172.21.2.105:0/2501218771 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e80a9390 con 0x7f85e80ad080 2021-11-12T05:46:32.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.592+0000 7f85ee07a700 1 -- 172.21.2.105:0/2501218771 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85e8157750 con 0x7f85e80ad080 2021-11-12T05:46:32.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.592+0000 7f85e4ff9700 1 -- 172.21.2.105:0/2501218771 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f85dc01c070 con 0x7f85e80ad080 2021-11-12T05:46:32.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.592+0000 7f85e4ff9700 1 --2- 172.21.2.105:0/2501218771 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f85c80536a0 0x7f85c8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:32.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.592+0000 7f85e4ff9700 1 -- 172.21.2.105:0/2501218771 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f85dc06c6f0 con 0x7f85e80ad080 2021-11-12T05:46:32.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.592+0000 7f85e77fe700 1 --2- 172.21.2.105:0/2501218771 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f85c80536a0 0x7f85c8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:32.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.596+0000 7f85e77fe700 1 --2- 172.21.2.105:0/2501218771 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f85c80536a0 0x7f85c8055b60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f85e814bc40 tx=0x7f85d8007820).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:32.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.596+0000 7f85e4ff9700 1 -- 172.21.2.105:0/2501218771 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f85dc0435f0 con 0x7f85e80ad080 2021-11-12T05:46:32.708 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.704+0000 7f85ee07a700 1 -- 172.21.2.105:0/2501218771 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85e80b1440 con 0x7f85e80ad080 2021-11-12T05:46:32.709 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.704+0000 7f85e4ff9700 1 -- 172.21.2.105:0/2501218771 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f85dc023020 con 0x7f85e80ad080 2021-11-12T05:46:32.709 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:46:32.709 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":31,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/1423088351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":1423088351},{"type":"v1","addr":"172.21.2.115:6833","nonce":1423088351}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:46:29.372216+0000","modified":"2021-11-12T05:46:30.375936+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6309":{"gid":6309,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/1837795491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":1837795491},{"type":"v1","addr":"172.21.2.105:6835","nonce":1837795491}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-11-12T05:46:32.710 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.704+0000 7f85ee07a700 1 -- 172.21.2.105:0/2501218771 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f85c80536a0 msgr2=0x7f85c8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:32.711 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.704+0000 7f85ee07a700 1 --2- 172.21.2.105:0/2501218771 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f85c80536a0 0x7f85c8055b60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f85e814bc40 tx=0x7f85d8007820).stop 2021-11-12T05:46:32.711 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.704+0000 7f85ee07a700 1 -- 172.21.2.105:0/2501218771 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85e80ad080 msgr2=0x7f85e80a8030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:32.711 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.704+0000 7f85ee07a700 1 --2- 172.21.2.105:0/2501218771 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85e80ad080 0x7f85e80a8030 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7f85dc002f70 tx=0x7f85dc014000).stop 2021-11-12T05:46:32.711 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.704+0000 7f85ee07a700 1 -- 172.21.2.105:0/2501218771 shutdown_connections 2021-11-12T05:46:32.712 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.704+0000 7f85ee07a700 1 --2- 172.21.2.105:0/2501218771 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f85c80536a0 0x7f85c8055b60 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:32.712 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.704+0000 7f85ee07a700 1 --2- 172.21.2.105:0/2501218771 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f85e80af730 0x7f85e80a8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:32.712 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.704+0000 7f85ee07a700 1 --2- 172.21.2.105:0/2501218771 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85e80ad080 0x7f85e80a8030 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:32.712 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.704+0000 7f85ee07a700 1 --2- 172.21.2.105:0/2501218771 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f85e80ac280 0x7f85e8063690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:32.713 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.704+0000 7f85ee07a700 1 -- 172.21.2.105:0/2501218771 >> 172.21.2.105:0/2501218771 conn(0x7f85e80b5370 msgr2=0x7f85e80b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:32.713 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.704+0000 7f85ee07a700 1 -- 172.21.2.105:0/2501218771 shutdown_connections 2021-11-12T05:46:32.713 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:32.704+0000 7f85ee07a700 1 -- 172.21.2.105:0/2501218771 wait complete. 2021-11-12T05:46:32.713 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 31 2021-11-12T05:46:32.918 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 31, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:46:29.372216+0000', 'modified': '2021-11-12T05:46:30.375936+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6309}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6309': {'gid': 6309, 'name': 'a', 'rank': 0, 'incarnation': 30, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/1837795491', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 1837795491}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 1837795491}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:46:32.918 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:46:32.919 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:46:32.997 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":6309,"want_state":"up:active","state":"up:active","rank_uptime":3.6176849170000001,"mdsmap_epoch":31,"osdmap_epoch":75,"osdmap_epoch_barrier":74,"uptime":7.7970939230000003} 2021-11-12T05:46:32.998 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 6309, "mdsmap_epoch": 31, "osdmap_epoch": 75, "osdmap_epoch_barrier": 74, "rank_uptime": 3.617684917, "state": "up:active", "uptime": 7.797093923, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:46:32.999 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-12T05:46:32.999 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-12T05:46:32.999 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba016.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-12T05:46:33.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:46:33.000 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:46:33.011 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:46:33.065 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:46:33.066 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:46:33.072 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:46:33.072 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:46:33.073 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:46:33.074 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:46:33.079 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-12T05:46:33.079 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:46:33.125 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:46:33.134 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:46:33.134 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:46:33.139 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:46:33.140 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:46:33.141 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:46:33.141 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:46:33.163 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:2021-11-12T05:46:33.161+0000 7f7d81007080 -1 init, newargv = 0x563812628730 newargc=9 2021-11-12T05:46:33.163 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[14612]: starting ceph client 2021-11-12T05:46:33.176 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[14612]: starting fuse 2021-11-12T05:46:34.268 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:46:34.280 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:46:34.281 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:46:34.329 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:46:34.330 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:46:34.332 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:46:34.332 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:46:34.339 INFO:teuthology.orchestra.run.gibba016.stdout:52 2021-11-12T05:46:34.339 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-12T05:46:34.339 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:46:34.340 DEBUG:teuthology.orchestra.run.gibba016:> sudo python3 -c ' 2021-11-12T05:46:34.340 DEBUG:teuthology.orchestra.run.gibba016:> import glob 2021-11-12T05:46:34.341 DEBUG:teuthology.orchestra.run.gibba016:> import re 2021-11-12T05:46:34.341 DEBUG:teuthology.orchestra.run.gibba016:> import os 2021-11-12T05:46:34.342 DEBUG:teuthology.orchestra.run.gibba016:> import subprocess 2021-11-12T05:46:34.342 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:46:34.342 DEBUG:teuthology.orchestra.run.gibba016:> def find_socket(client_name): 2021-11-12T05:46:34.343 DEBUG:teuthology.orchestra.run.gibba016:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-12T05:46:34.343 DEBUG:teuthology.orchestra.run.gibba016:> files = glob.glob(asok_path) 2021-11-12T05:46:34.344 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:46:34.344 DEBUG:teuthology.orchestra.run.gibba016:> # Given a non-glob path, it better be there 2021-11-12T05:46:34.344 DEBUG:teuthology.orchestra.run.gibba016:> if "*" not in asok_path: 2021-11-12T05:46:34.345 DEBUG:teuthology.orchestra.run.gibba016:> assert(len(files) == 1) 2021-11-12T05:46:34.346 DEBUG:teuthology.orchestra.run.gibba016:> return files[0] 2021-11-12T05:46:34.346 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:46:34.347 DEBUG:teuthology.orchestra.run.gibba016:> for f in files: 2021-11-12T05:46:34.348 DEBUG:teuthology.orchestra.run.gibba016:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-12T05:46:34.348 DEBUG:teuthology.orchestra.run.gibba016:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-12T05:46:34.349 DEBUG:teuthology.orchestra.run.gibba016:> return f 2021-11-12T05:46:34.350 DEBUG:teuthology.orchestra.run.gibba016:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-12T05:46:34.351 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:46:34.351 DEBUG:teuthology.orchestra.run.gibba016:> print(find_socket("client.0")) 2021-11-12T05:46:34.352 DEBUG:teuthology.orchestra.run.gibba016:> ' 2021-11-12T05:46:34.418 INFO:teuthology.orchestra.run.gibba016.stdout:/var/run/ceph/ceph-client.0.14612.asok 2021-11-12T05:46:34.420 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14612.asok 2021-11-12T05:46:34.421 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:46:34.421 DEBUG:teuthology.orchestra.run.gibba016:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14612.asok status 2021-11-12T05:46:34.469 INFO:teuthology.orchestra.run.gibba016.stdout:{ 2021-11-12T05:46:34.470 INFO:teuthology.orchestra.run.gibba016.stdout: "metadata": { 2021-11-12T05:46:34.470 INFO:teuthology.orchestra.run.gibba016.stdout: "ceph_sha1": "a81ee2815de5acae59ead5b8c9137b6766fc8ea8", 2021-11-12T05:46:34.471 INFO:teuthology.orchestra.run.gibba016.stdout: "ceph_version": "ceph version 15.2.15-22-ga81ee281 (a81ee2815de5acae59ead5b8c9137b6766fc8ea8) octopus (stable)", 2021-11-12T05:46:34.471 INFO:teuthology.orchestra.run.gibba016.stdout: "entity_id": "0", 2021-11-12T05:46:34.471 INFO:teuthology.orchestra.run.gibba016.stdout: "hostname": "gibba016", 2021-11-12T05:46:34.472 INFO:teuthology.orchestra.run.gibba016.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-12T05:46:34.472 INFO:teuthology.orchestra.run.gibba016.stdout: "pid": "14612", 2021-11-12T05:46:34.472 INFO:teuthology.orchestra.run.gibba016.stdout: "root": "/" 2021-11-12T05:46:34.473 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:46:34.473 INFO:teuthology.orchestra.run.gibba016.stdout: "dentry_count": 0, 2021-11-12T05:46:34.474 INFO:teuthology.orchestra.run.gibba016.stdout: "dentry_pinned_count": 0, 2021-11-12T05:46:34.474 INFO:teuthology.orchestra.run.gibba016.stdout: "id": 4888, 2021-11-12T05:46:34.474 INFO:teuthology.orchestra.run.gibba016.stdout: "inst": { 2021-11-12T05:46:34.474 INFO:teuthology.orchestra.run.gibba016.stdout: "name": { 2021-11-12T05:46:34.475 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "client", 2021-11-12T05:46:34.475 INFO:teuthology.orchestra.run.gibba016.stdout: "num": 4888 2021-11-12T05:46:34.475 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:46:34.475 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": { 2021-11-12T05:46:34.476 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "v1", 2021-11-12T05:46:34.476 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": "172.21.2.116:0", 2021-11-12T05:46:34.476 INFO:teuthology.orchestra.run.gibba016.stdout: "nonce": 3516388082 2021-11-12T05:46:34.476 INFO:teuthology.orchestra.run.gibba016.stdout: } 2021-11-12T05:46:34.476 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:46:34.477 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": { 2021-11-12T05:46:34.477 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "v1", 2021-11-12T05:46:34.477 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": "172.21.2.116:0", 2021-11-12T05:46:34.477 INFO:teuthology.orchestra.run.gibba016.stdout: "nonce": 3516388082 2021-11-12T05:46:34.478 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:46:34.478 INFO:teuthology.orchestra.run.gibba016.stdout: "inst_str": "client.4888 172.21.2.116:0/3516388082", 2021-11-12T05:46:34.478 INFO:teuthology.orchestra.run.gibba016.stdout: "addr_str": "172.21.2.116:0/3516388082", 2021-11-12T05:46:34.478 INFO:teuthology.orchestra.run.gibba016.stdout: "inode_count": 1, 2021-11-12T05:46:34.478 INFO:teuthology.orchestra.run.gibba016.stdout: "mds_epoch": 31, 2021-11-12T05:46:34.479 INFO:teuthology.orchestra.run.gibba016.stdout: "osd_epoch": 75, 2021-11-12T05:46:34.479 INFO:teuthology.orchestra.run.gibba016.stdout: "osd_epoch_barrier": 0, 2021-11-12T05:46:34.479 INFO:teuthology.orchestra.run.gibba016.stdout: "blacklisted": false, 2021-11-12T05:46:34.479 INFO:teuthology.orchestra.run.gibba016.stdout: "fs_name": "cephfs" 2021-11-12T05:46:34.480 INFO:teuthology.orchestra.run.gibba016.stdout:} 2021-11-12T05:46:34.481 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:46:34.481 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:46:34.482 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:46:34.489 INFO:teuthology.orchestra.run.gibba016.stdout:fuseblk 2021-11-12T05:46:34.490 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-12T05:46:34.490 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:46:34.491 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:46:34.548 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:46:34.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.600+0000 7f0026bbd700 1 Processor -- start 2021-11-12T05:46:34.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.600+0000 7f0026bbd700 1 -- start start 2021-11-12T05:46:34.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.600+0000 7f0026bbd700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f002005fdc0 0x7f00200601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:34.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.600+0000 7f0026bbd700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f00200ade80 0x7f0020066730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:34.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.600+0000 7f0026bbd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f002013a9c0 0x7f002013ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:34.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.600+0000 7f0026bbd700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0020141fb0 con 0x7f002013a9c0 2021-11-12T05:46:34.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.600+0000 7f0026bbd700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0020066150 con 0x7f00200ade80 2021-11-12T05:46:34.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.600+0000 7f0026bbd700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00200663f0 con 0x7f002005fdc0 2021-11-12T05:46:34.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.600+0000 7f002515a700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f002013a9c0 0x7f002013ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:34.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.600+0000 7f002515a700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f002013a9c0 0x7f002013ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47586/0 (socket says 172.21.2.105:47586) 2021-11-12T05:46:34.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.600+0000 7f002515a700 1 -- 172.21.2.105:0/672116265 learned_addr learned my addr 172.21.2.105:0/672116265 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:34.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.600+0000 7f002515a700 1 -- 172.21.2.105:0/672116265 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f002005fdc0 msgr2=0x7f00200601a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:46:34.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.600+0000 7f002515a700 1 --2- 172.21.2.105:0/672116265 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f002005fdc0 0x7f00200601a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:34.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.600+0000 7f002515a700 1 -- 172.21.2.105:0/672116265 >> v2:172.21.2.115:3300/0 conn(0x7f00200ade80 msgr2=0x7f0020066730 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:46:34.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.600+0000 7f002515a700 1 --2- 172.21.2.105:0/672116265 >> v2:172.21.2.115:3300/0 conn(0x7f00200ade80 0x7f0020066730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:34.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.600+0000 7f002515a700 1 -- 172.21.2.105:0/672116265 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0020140fd0 con 0x7f002013a9c0 2021-11-12T05:46:34.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.600+0000 7f002515a700 1 --2- 172.21.2.105:0/672116265 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f002013a9c0 0x7f002013ae50 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7f00180032f0 tx=0x7f0018009290).ready entity=mon.0 client_cookie=5f67174a54b9437e server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:34.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.600+0000 7f001f7fe700 1 -- 172.21.2.105:0/672116265 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f001800b870 con 0x7f002013a9c0 2021-11-12T05:46:34.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.600+0000 7f001f7fe700 1 -- 172.21.2.105:0/672116265 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001800b9d0 con 0x7f002013a9c0 2021-11-12T05:46:34.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.600+0000 7f001f7fe700 1 -- 172.21.2.105:0/672116265 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f001800bb80 con 0x7f002013a9c0 2021-11-12T05:46:34.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.600+0000 7f0026bbd700 1 -- 172.21.2.105:0/672116265 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f002013a9c0 msgr2=0x7f002013ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:34.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.600+0000 7f0026bbd700 1 --2- 172.21.2.105:0/672116265 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f002013a9c0 0x7f002013ae50 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7f00180032f0 tx=0x7f0018009290).stop 2021-11-12T05:46:34.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.600+0000 7f0026bbd700 1 -- 172.21.2.105:0/672116265 shutdown_connections 2021-11-12T05:46:34.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.600+0000 7f0026bbd700 1 --2- 172.21.2.105:0/672116265 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f002013a9c0 0x7f002013ae50 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:34.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.600+0000 7f0026bbd700 1 --2- 172.21.2.105:0/672116265 >> v2:172.21.2.115:3300/0 conn(0x7f00200ade80 0x7f0020066730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:34.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.600+0000 7f0026bbd700 1 --2- 172.21.2.105:0/672116265 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f002005fdc0 0x7f00200601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:34.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.600+0000 7f0026bbd700 1 -- 172.21.2.105:0/672116265 >> 172.21.2.105:0/672116265 conn(0x7f00200608d0 msgr2=0x7f002005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:34.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.604+0000 7f0026bbd700 1 -- 172.21.2.105:0/672116265 shutdown_connections 2021-11-12T05:46:34.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.604+0000 7f0026bbd700 1 -- 172.21.2.105:0/672116265 wait complete. 2021-11-12T05:46:34.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.604+0000 7f0026bbd700 1 Processor -- start 2021-11-12T05:46:34.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.604+0000 7f0026bbd700 1 -- start start 2021-11-12T05:46:34.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.604+0000 7f0026bbd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f002005fdc0 0x7f0020144dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:34.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.604+0000 7f0026bbd700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f00200ade80 0x7f002013ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:34.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.604+0000 7f0026bbd700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f002013a9c0 0x7f0020139300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:34.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.604+0000 7f0026bbd700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00200afe20 con 0x7f002005fdc0 2021-11-12T05:46:34.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.604+0000 7f0026bbd700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00200b00c0 con 0x7f00200ade80 2021-11-12T05:46:34.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.604+0000 7f0026bbd700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00200b0360 con 0x7f002013a9c0 2021-11-12T05:46:34.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.604+0000 7f0024959700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f002005fdc0 0x7f0020144dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:34.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.604+0000 7f0024959700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f002005fdc0 0x7f0020144dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47592/0 (socket says 172.21.2.105:47592) 2021-11-12T05:46:34.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.604+0000 7f0024959700 1 -- 172.21.2.105:0/2417065281 learned_addr learned my addr 172.21.2.105:0/2417065281 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:34.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.604+0000 7f0024959700 1 -- 172.21.2.105:0/2417065281 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f002013a9c0 msgr2=0x7f0020139300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:34.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.604+0000 7f0024959700 1 --2- 172.21.2.105:0/2417065281 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f002013a9c0 0x7f0020139300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:34.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.604+0000 7f0024959700 1 -- 172.21.2.105:0/2417065281 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f00200ade80 msgr2=0x7f002013ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:34.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.604+0000 7f0024959700 1 --2- 172.21.2.105:0/2417065281 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f00200ade80 0x7f002013ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:34.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.604+0000 7f0024959700 1 -- 172.21.2.105:0/2417065281 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0018009530 con 0x7f002005fdc0 2021-11-12T05:46:34.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.604+0000 7f0024959700 1 --2- 172.21.2.105:0/2417065281 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f002005fdc0 0x7f0020144dc0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7f0010002fb0 tx=0x7f0010006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:34.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.604+0000 7f001dffb700 1 -- 172.21.2.105:0/2417065281 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0010013460 con 0x7f002005fdc0 2021-11-12T05:46:34.621 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.604+0000 7f001dffb700 1 -- 172.21.2.105:0/2417065281 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00100135c0 con 0x7f002005fdc0 2021-11-12T05:46:34.621 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.604+0000 7f0026bbd700 1 -- 172.21.2.105:0/2417065281 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00200b0800 con 0x7f002005fdc0 2021-11-12T05:46:34.621 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.604+0000 7f001dffb700 1 -- 172.21.2.105:0/2417065281 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0010013920 con 0x7f002005fdc0 2021-11-12T05:46:34.621 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.604+0000 7f0026bbd700 1 -- 172.21.2.105:0/2417065281 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00200ae810 con 0x7f002005fdc0 2021-11-12T05:46:34.621 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.604+0000 7f0026bbd700 1 -- 172.21.2.105:0/2417065281 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00200b0520 con 0x7f002005fdc0 2021-11-12T05:46:34.622 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.604+0000 7f001dffb700 1 -- 172.21.2.105:0/2417065281 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f001001b030 con 0x7f002005fdc0 2021-11-12T05:46:34.622 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.604+0000 7f001dffb700 1 --2- 172.21.2.105:0/2417065281 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f00040536a0 0x7f0004055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:34.622 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.604+0000 7f001dffb700 1 -- 172.21.2.105:0/2417065281 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f001006b7e0 con 0x7f002005fdc0 2021-11-12T05:46:34.622 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.604+0000 7f001ffff700 1 --2- 172.21.2.105:0/2417065281 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f00040536a0 0x7f0004055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:34.623 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.604+0000 7f001ffff700 1 --2- 172.21.2.105:0/2417065281 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f00040536a0 0x7f0004055b60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f0008002fb0 tx=0x7f00080069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:34.623 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.608+0000 7f001dffb700 1 -- 172.21.2.105:0/2417065281 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f00100427f0 con 0x7f002005fdc0 2021-11-12T05:46:34.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.688+0000 7f0026bbd700 1 -- 172.21.2.105:0/2417065281 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0020057350 con 0x7f002005fdc0 2021-11-12T05:46:34.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.692+0000 7f001dffb700 1 -- 172.21.2.105:0/2417065281 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16274 (secure 0 0 0) 0x7f0010045e10 con 0x7f002005fdc0 2021-11-12T05:46:34.695 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:46:34.696 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":75,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:46:30.377067+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:46:27.277471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-11-12T05:46:28.337063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:46:34.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.692+0000 7f0026bbd700 1 -- 172.21.2.105:0/2417065281 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f00040536a0 msgr2=0x7f0004055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:34.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.692+0000 7f0026bbd700 1 --2- 172.21.2.105:0/2417065281 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f00040536a0 0x7f0004055b60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f0008002fb0 tx=0x7f00080069b0).stop 2021-11-12T05:46:34.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.692+0000 7f0026bbd700 1 -- 172.21.2.105:0/2417065281 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f002005fdc0 msgr2=0x7f0020144dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:34.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.692+0000 7f0026bbd700 1 --2- 172.21.2.105:0/2417065281 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f002005fdc0 0x7f0020144dc0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7f0010002fb0 tx=0x7f0010006df0).stop 2021-11-12T05:46:34.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.692+0000 7f0026bbd700 1 -- 172.21.2.105:0/2417065281 shutdown_connections 2021-11-12T05:46:34.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.692+0000 7f0026bbd700 1 --2- 172.21.2.105:0/2417065281 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f00040536a0 0x7f0004055b60 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:34.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.692+0000 7f0026bbd700 1 --2- 172.21.2.105:0/2417065281 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f002013a9c0 0x7f0020139300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:34.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.692+0000 7f0026bbd700 1 --2- 172.21.2.105:0/2417065281 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f00200ade80 0x7f002013ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:34.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.692+0000 7f0026bbd700 1 --2- 172.21.2.105:0/2417065281 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f002005fdc0 0x7f0020144dc0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:34.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.692+0000 7f0026bbd700 1 -- 172.21.2.105:0/2417065281 >> 172.21.2.105:0/2417065281 conn(0x7f00200608d0 msgr2=0x7f0020061650 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:34.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.692+0000 7f0026bbd700 1 -- 172.21.2.105:0/2417065281 shutdown_connections 2021-11-12T05:46:34.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.692+0000 7f0026bbd700 1 -- 172.21.2.105:0/2417065281 wait complete. 2021-11-12T05:46:34.703 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-12T05:46:27.277471+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2021-11-12T05:46:28.337063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-12T05:46:34.704 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:46:34.811 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2613fd5700 1 Processor -- start 2021-11-12T05:46:34.811 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2613fd5700 1 -- start start 2021-11-12T05:46:34.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2613fd5700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f260c0b1060 0x7f260c13f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:34.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2613fd5700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f260c0ad400 con 0x7f260c142c50 2021-11-12T05:46:34.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2613fd5700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f260c0b3200 con 0x7f260c0b2e20 2021-11-12T05:46:34.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2613fd5700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f260c0ad660 con 0x7f260c0b1060 2021-11-12T05:46:34.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2612572700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f260c142c50 0x7f260c1430a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:57996/0 (socket says 172.21.2.105:57996) 2021-11-12T05:46:34.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2612572700 1 -- 172.21.2.105:0/1595744314 learned_addr learned my addr 172.21.2.105:0/1595744314 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:46:34.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2610d6f700 1 -- 172.21.2.105:0/1595744314 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2964774131 0 0) 0x7f260c0ad400 con 0x7f260c142c50 2021-11-12T05:46:34.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2610d6f700 1 -- 172.21.2.105:0/1595744314 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25f4003260 con 0x7f260c142c50 2021-11-12T05:46:34.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2611570700 1 --2- 172.21.2.105:0/1595744314 >> v2:172.21.2.115:3300/0 conn(0x7f260c0b1060 0x7f260c13f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:34.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2610d6f700 1 -- 172.21.2.105:0/1595744314 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1062650780 0 0) 0x7f25f4003260 con 0x7f260c142c50 2021-11-12T05:46:34.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2610d6f700 1 -- 172.21.2.105:0/1595744314 >> v2:172.21.2.115:3300/0 conn(0x7f260c0b1060 msgr2=0x7f260c13f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:34.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2610d6f700 1 --2- 172.21.2.105:0/1595744314 >> v2:172.21.2.115:3300/0 conn(0x7f260c0b1060 0x7f260c13f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:34.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2610d6f700 1 -- 172.21.2.105:0/1595744314 >> v1:172.21.2.115:6789/0 conn(0x7f260c0b2e20 legacy=0x7f260c13ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:34.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2610d6f700 1 -- 172.21.2.105:0/1595744314 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c0ad900 con 0x7f260c142c50 2021-11-12T05:46:34.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2610d6f700 1 -- 172.21.2.105:0/1595744314 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f2604001a00 con 0x7f260c142c50 2021-11-12T05:46:34.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2610d6f700 1 -- 172.21.2.105:0/1595744314 >> v1:172.21.2.105:6789/0 conn(0x7f260c142c50 legacy=0x7f260c1430a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:34.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2610d6f700 1 --2- 172.21.2.105:0/1595744314 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f25f40037d0 0x7f25f4003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:34.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2610d6f700 1 --2- 172.21.2.105:0/1595744314 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f25f4004500 0x7f25f4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:34.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2610d6f700 1 --2- 172.21.2.105:0/1595744314 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f25f4004f90 0x7f25f400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:34.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2610d6f700 1 -- 172.21.2.105:0/1595744314 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260c0ad660 con 0x7f25f4004500 2021-11-12T05:46:34.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2610d6f700 1 -- 172.21.2.105:0/1595744314 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f400be00 con 0x7f25f4004f90 2021-11-12T05:46:34.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2610d6f700 1 -- 172.21.2.105:0/1595744314 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f400bfc0 con 0x7f25f40037d0 2021-11-12T05:46:34.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2611570700 1 --2- 172.21.2.105:0/1595744314 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f25f4004500 0x7f25f4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:34.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2611570700 1 -- 172.21.2.105:0/1595744314 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f25f40037d0 msgr2=0x7f25f4003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:34.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2611570700 1 --2- 172.21.2.105:0/1595744314 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f25f40037d0 0x7f25f4003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:34.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2611570700 1 -- 172.21.2.105:0/1595744314 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f25f4004f90 msgr2=0x7f25f400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:34.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2611570700 1 --2- 172.21.2.105:0/1595744314 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f25f4004f90 0x7f25f400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:34.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2611570700 1 -- 172.21.2.105:0/1595744314 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c0ad900 con 0x7f25f4004500 2021-11-12T05:46:34.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2612572700 1 -- 172.21.2.105:0/1595744314 reap_dead start 2021-11-12T05:46:34.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2611570700 1 --2- 172.21.2.105:0/1595744314 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f25f4004500 0x7f25f4004980 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7f260000a000 tx=0x7f2600008040).ready entity=mon.0 client_cookie=df602b56c7fd81c4 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:34.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2610d6f700 1 -- 172.21.2.105:0/1595744314 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2600013670 con 0x7f25f4004500 2021-11-12T05:46:34.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2610d6f700 1 -- 172.21.2.105:0/1595744314 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26000137d0 con 0x7f25f4004500 2021-11-12T05:46:34.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2610d6f700 1 -- 172.21.2.105:0/1595744314 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2600013b30 con 0x7f25f4004500 2021-11-12T05:46:34.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2613fd5700 1 -- 172.21.2.105:0/1595744314 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f25f4004500 msgr2=0x7f25f4004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:34.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2613fd5700 1 --2- 172.21.2.105:0/1595744314 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f25f4004500 0x7f25f4004980 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7f260000a000 tx=0x7f2600008040).stop 2021-11-12T05:46:34.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2613fd5700 1 -- 172.21.2.105:0/1595744314 shutdown_connections 2021-11-12T05:46:34.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2613fd5700 1 --2- 172.21.2.105:0/1595744314 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f25f4004500 0x7f25f4004980 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:34.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2613fd5700 1 -- 172.21.2.105:0/1595744314 >> 172.21.2.105:0/1595744314 conn(0x7f260c062f60 msgr2=0x7f260c063370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:34.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2613fd5700 1 -- 172.21.2.105:0/1595744314 shutdown_connections 2021-11-12T05:46:34.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.808+0000 7f2613fd5700 1 -- 172.21.2.105:0/1595744314 wait complete. 2021-11-12T05:46:34.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.812+0000 7f2613fd5700 1 Processor -- start 2021-11-12T05:46:34.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.812+0000 7f2613fd5700 1 -- start start 2021-11-12T05:46:34.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.812+0000 7f2613fd5700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f25f4004500 0x7f260c137220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:34.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.812+0000 7f2613fd5700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f260c0aab20 0x7f260c135da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:34.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.812+0000 7f2613fd5700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f260c136290 0x7f260c1527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:34.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.812+0000 7f2613fd5700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260c064400 con 0x7f260c136290 2021-11-12T05:46:34.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.812+0000 7f2613fd5700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260c067ac0 con 0x7f260c0aab20 2021-11-12T05:46:34.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.812+0000 7f2613fd5700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260c065c70 con 0x7f25f4004500 2021-11-12T05:46:34.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.812+0000 7f2612572700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f260c136290 0x7f260c1527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:34.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.812+0000 7f2612572700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f260c136290 0x7f260c1527c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47614/0 (socket says 172.21.2.105:47614) 2021-11-12T05:46:34.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.812+0000 7f2612572700 1 -- 172.21.2.105:0/545560294 learned_addr learned my addr 172.21.2.105:0/545560294 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:34.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.812+0000 7f2612572700 1 -- 172.21.2.105:0/545560294 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f25f4004500 msgr2=0x7f260c137220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:34.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.812+0000 7f2612572700 1 --2- 172.21.2.105:0/545560294 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f25f4004500 0x7f260c137220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:34.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.812+0000 7f2612572700 1 -- 172.21.2.105:0/545560294 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f260c0aab20 msgr2=0x7f260c135da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:34.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.812+0000 7f2612572700 1 --2- 172.21.2.105:0/545560294 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f260c0aab20 0x7f260c135da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:34.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.812+0000 7f2612572700 1 -- 172.21.2.105:0/545560294 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c065f10 con 0x7f260c136290 2021-11-12T05:46:34.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.812+0000 7f2612572700 1 --2- 172.21.2.105:0/545560294 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f260c136290 0x7f260c1527c0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7f260c0b5af0 tx=0x7f2604001b40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:34.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.812+0000 7f25feffd700 1 -- 172.21.2.105:0/545560294 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2604004ab0 con 0x7f260c136290 2021-11-12T05:46:34.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.812+0000 7f25feffd700 1 -- 172.21.2.105:0/545560294 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2604004c10 con 0x7f260c136290 2021-11-12T05:46:34.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.812+0000 7f25feffd700 1 -- 172.21.2.105:0/545560294 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2604007030 con 0x7f260c136290 2021-11-12T05:46:34.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.812+0000 7f2613fd5700 1 -- 172.21.2.105:0/545560294 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f260c0677b0 con 0x7f260c136290 2021-11-12T05:46:34.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.812+0000 7f2613fd5700 1 -- 172.21.2.105:0/545560294 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f260c136710 con 0x7f260c136290 2021-11-12T05:46:34.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.812+0000 7f2613fd5700 1 -- 172.21.2.105:0/545560294 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f260c0b2060 con 0x7f260c136290 2021-11-12T05:46:34.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.812+0000 7f25feffd700 1 -- 172.21.2.105:0/545560294 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2604010070 con 0x7f260c136290 2021-11-12T05:46:34.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.812+0000 7f25feffd700 1 --2- 172.21.2.105:0/545560294 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f25ec0536d0 0x7f25ec055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:34.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.812+0000 7f25feffd700 1 -- 172.21.2.105:0/545560294 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f260406ac50 con 0x7f260c136290 2021-11-12T05:46:34.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.812+0000 7f2611d71700 1 --2- 172.21.2.105:0/545560294 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f25ec0536d0 0x7f25ec055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:34.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.812+0000 7f2611d71700 1 --2- 172.21.2.105:0/545560294 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f25ec0536d0 0x7f25ec055b90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f2608001fa0 tx=0x7f26080077f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:34.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.816+0000 7f25feffd700 1 -- 172.21.2.105:0/545560294 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2604041c60 con 0x7f260c136290 2021-11-12T05:46:34.906 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.900+0000 7f2613fd5700 1 -- 172.21.2.105:0/545560294 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f260c057350 con 0x7f260c136290 2021-11-12T05:46:34.906 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.900+0000 7f25feffd700 1 -- 172.21.2.105:0/545560294 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v75) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2604045280 con 0x7f260c136290 2021-11-12T05:46:34.907 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:46:34.908 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.904+0000 7f2613fd5700 1 -- 172.21.2.105:0/545560294 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f25ec0536d0 msgr2=0x7f25ec055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:34.908 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.904+0000 7f2613fd5700 1 --2- 172.21.2.105:0/545560294 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f25ec0536d0 0x7f25ec055b90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f2608001fa0 tx=0x7f26080077f0).stop 2021-11-12T05:46:34.908 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.904+0000 7f2613fd5700 1 -- 172.21.2.105:0/545560294 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f260c136290 msgr2=0x7f260c1527c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:34.908 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.904+0000 7f2613fd5700 1 --2- 172.21.2.105:0/545560294 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f260c136290 0x7f260c1527c0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7f260c0b5af0 tx=0x7f2604001b40).stop 2021-11-12T05:46:34.909 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.904+0000 7f2613fd5700 1 -- 172.21.2.105:0/545560294 shutdown_connections 2021-11-12T05:46:34.909 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.904+0000 7f2613fd5700 1 --2- 172.21.2.105:0/545560294 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f25ec0536d0 0x7f25ec055b90 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:34.909 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.904+0000 7f2613fd5700 1 --2- 172.21.2.105:0/545560294 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f260c136290 0x7f260c1527c0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:34.909 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.904+0000 7f2613fd5700 1 --2- 172.21.2.105:0/545560294 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f260c0aab20 0x7f260c135da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:34.909 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.904+0000 7f2613fd5700 1 --2- 172.21.2.105:0/545560294 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f25f4004500 0x7f260c137220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:34.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.904+0000 7f2613fd5700 1 -- 172.21.2.105:0/545560294 >> 172.21.2.105:0/545560294 conn(0x7f260c062f60 msgr2=0x7f260c13e820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:34.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.904+0000 7f2613fd5700 1 -- 172.21.2.105:0/545560294 shutdown_connections 2021-11-12T05:46:34.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.904+0000 7f2613fd5700 1 -- 172.21.2.105:0/545560294 wait complete. 2021-11-12T05:46:34.914 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:46:34.967 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78e094f700 1 Processor -- start 2021-11-12T05:46:34.967 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78e094f700 1 -- start start 2021-11-12T05:46:34.967 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78e094f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f78dc0b7b00 0x7f78dc140d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:34.968 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78e094f700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f78dc0b3980 0x7f78dc0b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:34.968 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78e094f700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78dc0b7ee0 con 0x7f78dc0ae090 2021-11-12T05:46:34.968 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78e094f700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78dc0b2030 con 0x7f78dc0b3980 2021-11-12T05:46:34.968 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78e094f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78dc0b22d0 con 0x7f78dc0b7b00 2021-11-12T05:46:34.972 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78d9d9b700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f78dc0ae090 0x7f78dc0b2a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:58014/0 (socket says 172.21.2.105:58014) 2021-11-12T05:46:34.973 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78d9d9b700 1 -- 172.21.2.105:0/2981813046 learned_addr learned my addr 172.21.2.105:0/2981813046 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:46:34.973 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78dad9d700 1 --2- 172.21.2.105:0/2981813046 >> v2:172.21.2.105:3300/0 conn(0x7f78dc0b3980 0x7f78dc0b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:34.973 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78d959a700 1 -- 172.21.2.105:0/2981813046 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4061837187 0 0) 0x7f78dc0b7ee0 con 0x7f78dc0ae090 2021-11-12T05:46:34.973 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78d959a700 1 -- 172.21.2.105:0/2981813046 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78c0003260 con 0x7f78dc0ae090 2021-11-12T05:46:34.974 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78dad9d700 1 -- 172.21.2.105:0/2981813046 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f78dc0b7b00 msgr2=0x7f78dc140d80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:46:34.974 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78dad9d700 1 --2- 172.21.2.105:0/2981813046 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f78dc0b7b00 0x7f78dc140d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:34.974 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78dad9d700 1 -- 172.21.2.105:0/2981813046 >> v1:172.21.2.105:6789/0 conn(0x7f78dc0ae090 legacy=0x7f78dc0b2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:34.974 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78dad9d700 1 -- 172.21.2.105:0/2981813046 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78dc0b2570 con 0x7f78dc0b3980 2021-11-12T05:46:34.974 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78dad9d700 1 --2- 172.21.2.105:0/2981813046 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f78dc0b3980 0x7f78dc0b3df0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f78d4002f70 tx=0x7f78d4006df0).ready entity=mon.0 client_cookie=501f208196a302b7 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:34.975 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78d959a700 1 -- 172.21.2.105:0/2981813046 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78d400d570 con 0x7f78dc0b3980 2021-11-12T05:46:34.975 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78d959a700 1 -- 172.21.2.105:0/2981813046 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d4000e90 con 0x7f78dc0b3980 2021-11-12T05:46:34.975 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78d959a700 1 -- 172.21.2.105:0/2981813046 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78d400d900 con 0x7f78dc0b3980 2021-11-12T05:46:34.975 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78e094f700 1 -- 172.21.2.105:0/2981813046 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f78dc0b3980 msgr2=0x7f78dc0b3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:34.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78e094f700 1 --2- 172.21.2.105:0/2981813046 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f78dc0b3980 0x7f78dc0b3df0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f78d4002f70 tx=0x7f78d4006df0).stop 2021-11-12T05:46:34.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78e094f700 1 -- 172.21.2.105:0/2981813046 shutdown_connections 2021-11-12T05:46:34.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78e094f700 1 --2- 172.21.2.105:0/2981813046 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f78dc0b3980 0x7f78dc0b3df0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:34.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78e094f700 1 --2- 172.21.2.105:0/2981813046 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f78dc0b7b00 0x7f78dc140d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:34.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78e094f700 1 -- 172.21.2.105:0/2981813046 >> 172.21.2.105:0/2981813046 conn(0x7f78dc0608d0 msgr2=0x7f78dc05c490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:34.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78e094f700 1 -- 172.21.2.105:0/2981813046 shutdown_connections 2021-11-12T05:46:34.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78e094f700 1 -- 172.21.2.105:0/2981813046 wait complete. 2021-11-12T05:46:34.978 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78e094f700 1 Processor -- start 2021-11-12T05:46:34.978 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78e094f700 1 -- start start 2021-11-12T05:46:34.978 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78e094f700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f78dc0ae090 0x7f78dc066610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:34.978 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78e094f700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f78dc0b3980 0x7f78dc144aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:34.978 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78e094f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f78dc0b7b00 0x7f78dc125830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:34.979 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78e094f700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78dc0b03c0 con 0x7f78dc0ae090 2021-11-12T05:46:34.979 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78e094f700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78dc13dfa0 con 0x7f78dc0b3980 2021-11-12T05:46:34.979 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78e094f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78dc066b00 con 0x7f78dc0b7b00 2021-11-12T05:46:34.979 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78da59c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f78dc0ae090 0x7f78dc066610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:34.980 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78da59c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f78dc0ae090 0x7f78dc066610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47626/0 (socket says 172.21.2.105:47626) 2021-11-12T05:46:34.980 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78da59c700 1 -- 172.21.2.105:0/1652937325 learned_addr learned my addr 172.21.2.105:0/1652937325 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:34.980 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78da59c700 1 -- 172.21.2.105:0/1652937325 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f78dc0b7b00 msgr2=0x7f78dc125830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:34.980 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78da59c700 1 --2- 172.21.2.105:0/1652937325 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f78dc0b7b00 0x7f78dc125830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:34.981 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78da59c700 1 -- 172.21.2.105:0/1652937325 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f78dc0b3980 msgr2=0x7f78dc144aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:34.981 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78da59c700 1 --2- 172.21.2.105:0/1652937325 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f78dc0b3980 0x7f78dc144aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:34.981 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78da59c700 1 -- 172.21.2.105:0/1652937325 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d400b180 con 0x7f78dc0ae090 2021-11-12T05:46:34.981 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.964+0000 7f78da59c700 1 --2- 172.21.2.105:0/1652937325 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f78dc0ae090 0x7f78dc066610 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7f78cc003270 tx=0x7f78cc006f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:34.982 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.968+0000 7f78cb7fe700 1 -- 172.21.2.105:0/1652937325 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78cc00d4a0 con 0x7f78dc0ae090 2021-11-12T05:46:34.982 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.968+0000 7f78cb7fe700 1 -- 172.21.2.105:0/1652937325 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78cc00d600 con 0x7f78dc0ae090 2021-11-12T05:46:34.982 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.968+0000 7f78e094f700 1 -- 172.21.2.105:0/1652937325 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78dc0af800 con 0x7f78dc0ae090 2021-11-12T05:46:34.982 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.968+0000 7f78e094f700 1 -- 172.21.2.105:0/1652937325 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78dc065a20 con 0x7f78dc0ae090 2021-11-12T05:46:34.982 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.968+0000 7f78cb7fe700 1 -- 172.21.2.105:0/1652937325 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78cc00d9a0 con 0x7f78dc0ae090 2021-11-12T05:46:34.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.968+0000 7f78e094f700 1 -- 172.21.2.105:0/1652937325 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78dc13dd90 con 0x7f78dc0ae090 2021-11-12T05:46:34.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.968+0000 7f78cb7fe700 1 -- 172.21.2.105:0/1652937325 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f78cc018030 con 0x7f78dc0ae090 2021-11-12T05:46:34.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.968+0000 7f78cb7fe700 1 --2- 172.21.2.105:0/1652937325 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f78b80536a0 0x7f78b8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:34.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.968+0000 7f78cb7fe700 1 -- 172.21.2.105:0/1652937325 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f78cc06b2d0 con 0x7f78dc0ae090 2021-11-12T05:46:34.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.968+0000 7f78d9d9b700 1 --2- 172.21.2.105:0/1652937325 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f78b80536a0 0x7f78b8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:34.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.968+0000 7f78d9d9b700 1 --2- 172.21.2.105:0/1652937325 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f78b80536a0 0x7f78b8055b60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f78d0001110 tx=0x7f78d00076c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:34.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:34.968+0000 7f78cb7fe700 1 -- 172.21.2.105:0/1652937325 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f78cc042390 con 0x7f78dc0ae090 2021-11-12T05:46:35.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.052+0000 7f78e094f700 1 -- 172.21.2.105:0/1652937325 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f78dc057350 con 0x7f78dc0ae090 2021-11-12T05:46:35.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.052+0000 7f78cb7fe700 1 -- 172.21.2.105:0/1652937325 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v75) v1 ==== 92+0+10 (secure 0 0 0) 0x7f78cc0459b0 con 0x7f78dc0ae090 2021-11-12T05:46:35.059 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:46:35.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.056+0000 7f78e094f700 1 -- 172.21.2.105:0/1652937325 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f78b80536a0 msgr2=0x7f78b8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:35.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.056+0000 7f78e094f700 1 --2- 172.21.2.105:0/1652937325 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f78b80536a0 0x7f78b8055b60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f78d0001110 tx=0x7f78d00076c0).stop 2021-11-12T05:46:35.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.056+0000 7f78e094f700 1 -- 172.21.2.105:0/1652937325 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f78dc0ae090 msgr2=0x7f78dc066610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:35.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.056+0000 7f78e094f700 1 --2- 172.21.2.105:0/1652937325 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f78dc0ae090 0x7f78dc066610 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7f78cc003270 tx=0x7f78cc006f90).stop 2021-11-12T05:46:35.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.056+0000 7f78e094f700 1 -- 172.21.2.105:0/1652937325 shutdown_connections 2021-11-12T05:46:35.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.056+0000 7f78e094f700 1 --2- 172.21.2.105:0/1652937325 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f78b80536a0 0x7f78b8055b60 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:35.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.056+0000 7f78e094f700 1 --2- 172.21.2.105:0/1652937325 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f78dc0b7b00 0x7f78dc125830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:35.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.056+0000 7f78e094f700 1 --2- 172.21.2.105:0/1652937325 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f78dc0b3980 0x7f78dc144aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:35.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.056+0000 7f78e094f700 1 --2- 172.21.2.105:0/1652937325 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f78dc0ae090 0x7f78dc066610 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:35.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.056+0000 7f78e094f700 1 -- 172.21.2.105:0/1652937325 >> 172.21.2.105:0/1652937325 conn(0x7f78dc0608d0 msgr2=0x7f78dc0628a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:35.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.056+0000 7f78e094f700 1 -- 172.21.2.105:0/1652937325 shutdown_connections 2021-11-12T05:46:35.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.056+0000 7f78e094f700 1 -- 172.21.2.105:0/1652937325 wait complete. 2021-11-12T05:46:35.066 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-12T05:46:35.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d97f18700 1 Processor -- start 2021-11-12T05:46:35.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d97f18700 1 -- start start 2021-11-12T05:46:35.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d97f18700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d900af750 0x7f0d90062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:35.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d97f18700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f0d90130a80 0x7f0d901474d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:35.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d97f18700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d900b0d50 con 0x7f0d900626b0 2021-11-12T05:46:35.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d97f18700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d900ad380 con 0x7f0d90130a80 2021-11-12T05:46:35.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d97f18700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d900ae190 con 0x7f0d900af750 2021-11-12T05:46:35.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d95cb4700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f0d900626b0 0x7f0d90130370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:58028/0 (socket says 172.21.2.105:58028) 2021-11-12T05:46:35.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d95cb4700 1 -- 172.21.2.105:0/3445553337 learned_addr learned my addr 172.21.2.105:0/3445553337 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:46:35.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d94cb2700 1 -- 172.21.2.105:0/3445553337 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3986669983 0 0) 0x7f0d900b0d50 con 0x7f0d900626b0 2021-11-12T05:46:35.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d94cb2700 1 -- 172.21.2.105:0/3445553337 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d78003260 con 0x7f0d900626b0 2021-11-12T05:46:35.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d94cb2700 1 -- 172.21.2.105:0/3445553337 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1678720156 0 0) 0x7f0d78003260 con 0x7f0d900626b0 2021-11-12T05:46:35.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d94cb2700 1 -- 172.21.2.105:0/3445553337 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d900af750 msgr2=0x7f0d90062a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:35.127 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d94cb2700 1 --2- 172.21.2.105:0/3445553337 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d900af750 0x7f0d90062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:35.127 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d94cb2700 1 -- 172.21.2.105:0/3445553337 >> v2:172.21.2.115:3300/0 conn(0x7f0d90130a80 msgr2=0x7f0d901474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:35.127 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d94cb2700 1 --2- 172.21.2.105:0/3445553337 >> v2:172.21.2.115:3300/0 conn(0x7f0d90130a80 0x7f0d901474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:35.127 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d94cb2700 1 -- 172.21.2.105:0/3445553337 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d901479c0 con 0x7f0d900626b0 2021-11-12T05:46:35.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d94cb2700 1 -- 172.21.2.105:0/3445553337 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f0d84001660 con 0x7f0d900626b0 2021-11-12T05:46:35.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d94cb2700 1 -- 172.21.2.105:0/3445553337 >> v1:172.21.2.105:6789/0 conn(0x7f0d900626b0 legacy=0x7f0d90130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:35.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d94cb2700 1 --2- 172.21.2.105:0/3445553337 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0d78003750 0x7f0d78003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:35.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d94cb2700 1 --2- 172.21.2.105:0/3445553337 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d900af750 0x7f0d78004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:35.129 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d94cb2700 1 --2- 172.21.2.105:0/3445553337 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d78004b10 0x7f0d78004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:35.129 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d94cb2700 1 -- 172.21.2.105:0/3445553337 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d900ad380 con 0x7f0d78004b10 2021-11-12T05:46:35.129 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d94cb2700 1 -- 172.21.2.105:0/3445553337 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d900ae190 con 0x7f0d78003750 2021-11-12T05:46:35.129 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d94cb2700 1 -- 172.21.2.105:0/3445553337 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7800b990 con 0x7f0d900af750 2021-11-12T05:46:35.129 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d964b5700 1 --2- 172.21.2.105:0/3445553337 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d78004b10 0x7f0d78004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:35.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d95cb4700 1 --2- 172.21.2.105:0/3445553337 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0d78003750 0x7f0d78003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:35.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d964b5700 1 -- 172.21.2.105:0/3445553337 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d900af750 msgr2=0x7f0d78004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:35.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d964b5700 1 --2- 172.21.2.105:0/3445553337 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d900af750 0x7f0d78004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:35.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d964b5700 1 -- 172.21.2.105:0/3445553337 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0d78003750 msgr2=0x7f0d78003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:35.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d964b5700 1 --2- 172.21.2.105:0/3445553337 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0d78003750 0x7f0d78003b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:35.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d964b5700 1 -- 172.21.2.105:0/3445553337 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d78003260 con 0x7f0d78004b10 2021-11-12T05:46:35.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d964b5700 1 --2- 172.21.2.105:0/3445553337 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d78004b10 0x7f0d78004f90 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7f0d880032f0 tx=0x7f0d88006f90).ready entity=mon.0 client_cookie=4897f5e53ec29441 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:35.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d94cb2700 1 -- 172.21.2.105:0/3445553337 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d8800b460 con 0x7f0d78004b10 2021-11-12T05:46:35.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d94cb2700 1 -- 172.21.2.105:0/3445553337 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d8800b5c0 con 0x7f0d78004b10 2021-11-12T05:46:35.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d94cb2700 1 -- 172.21.2.105:0/3445553337 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d8800b730 con 0x7f0d78004b10 2021-11-12T05:46:35.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d97f18700 1 -- 172.21.2.105:0/3445553337 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d78004b10 msgr2=0x7f0d78004f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:35.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d97f18700 1 --2- 172.21.2.105:0/3445553337 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d78004b10 0x7f0d78004f90 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7f0d880032f0 tx=0x7f0d88006f90).stop 2021-11-12T05:46:35.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d964b5700 1 -- 172.21.2.105:0/3445553337 reap_dead start 2021-11-12T05:46:35.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d97f18700 1 -- 172.21.2.105:0/3445553337 shutdown_connections 2021-11-12T05:46:35.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d97f18700 1 -- 172.21.2.105:0/3445553337 >> 172.21.2.105:0/3445553337 conn(0x7f0d900b5320 msgr2=0x7f0d900b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:35.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d97f18700 1 -- 172.21.2.105:0/3445553337 shutdown_connections 2021-11-12T05:46:35.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d97f18700 1 -- 172.21.2.105:0/3445553337 wait complete. 2021-11-12T05:46:35.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d97f18700 1 Processor -- start 2021-11-12T05:46:35.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.116+0000 7f0d97f18700 1 -- start start 2021-11-12T05:46:35.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.120+0000 7f0d97f18700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d78004b10 0x7f0d90146850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:35.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.120+0000 7f0d97f18700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d9015a4b0 0x7f0d9015a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:35.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.120+0000 7f0d97f18700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0d9014a860 0x7f0d9014ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:35.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.120+0000 7f0d97f18700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9015ae00 con 0x7f0d9015a4b0 2021-11-12T05:46:35.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.120+0000 7f0d97f18700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d90063130 con 0x7f0d9014a860 2021-11-12T05:46:35.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.120+0000 7f0d97f18700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9015a010 con 0x7f0d78004b10 2021-11-12T05:46:35.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.120+0000 7f0d954b3700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d9015a4b0 0x7f0d9015a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:35.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.120+0000 7f0d954b3700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d9015a4b0 0x7f0d9015a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47644/0 (socket says 172.21.2.105:47644) 2021-11-12T05:46:35.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.120+0000 7f0d954b3700 1 -- 172.21.2.105:0/1644075665 learned_addr learned my addr 172.21.2.105:0/1644075665 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:35.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.120+0000 7f0d95cb4700 1 --2- 172.21.2.105:0/1644075665 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d78004b10 0x7f0d90146850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:35.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.120+0000 7f0d964b5700 1 --2- 172.21.2.105:0/1644075665 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0d9014a860 0x7f0d9014ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:35.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.120+0000 7f0d954b3700 1 -- 172.21.2.105:0/1644075665 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d78004b10 msgr2=0x7f0d90146850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:35.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.120+0000 7f0d954b3700 1 --2- 172.21.2.105:0/1644075665 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d78004b10 0x7f0d90146850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:35.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.120+0000 7f0d954b3700 1 -- 172.21.2.105:0/1644075665 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0d9014a860 msgr2=0x7f0d9014ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:35.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.120+0000 7f0d954b3700 1 --2- 172.21.2.105:0/1644075665 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0d9014a860 0x7f0d9014ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:35.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.120+0000 7f0d954b3700 1 -- 172.21.2.105:0/1644075665 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d90063b90 con 0x7f0d9015a4b0 2021-11-12T05:46:35.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.120+0000 7f0d95cb4700 1 --2- 172.21.2.105:0/1644075665 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d78004b10 0x7f0d90146850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:46:35.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.120+0000 7f0d954b3700 1 --2- 172.21.2.105:0/1644075665 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d9015a4b0 0x7f0d9015a910 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7f0d8c002f70 tx=0x7f0d8c006e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:35.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.120+0000 7f0d82ffd700 1 -- 172.21.2.105:0/1644075665 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d8c00e470 con 0x7f0d9015a4b0 2021-11-12T05:46:35.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.120+0000 7f0d82ffd700 1 -- 172.21.2.105:0/1644075665 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d8c000e90 con 0x7f0d9015a4b0 2021-11-12T05:46:35.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.120+0000 7f0d82ffd700 1 -- 172.21.2.105:0/1644075665 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d8c00e7c0 con 0x7f0d9015a4b0 2021-11-12T05:46:35.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.120+0000 7f0d97f18700 1 -- 172.21.2.105:0/1644075665 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d90144eb0 con 0x7f0d9015a4b0 2021-11-12T05:46:35.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.120+0000 7f0d97f18700 1 -- 172.21.2.105:0/1644075665 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d900638a0 con 0x7f0d9015a4b0 2021-11-12T05:46:35.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.120+0000 7f0d97f18700 1 -- 172.21.2.105:0/1644075665 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d90057350 con 0x7f0d9015a4b0 2021-11-12T05:46:35.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.120+0000 7f0d82ffd700 1 -- 172.21.2.105:0/1644075665 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0d8c00f070 con 0x7f0d9015a4b0 2021-11-12T05:46:35.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.120+0000 7f0d82ffd700 1 --2- 172.21.2.105:0/1644075665 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0d700534f0 0x7f0d700559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:35.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.120+0000 7f0d82ffd700 1 -- 172.21.2.105:0/1644075665 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f0d8c06af60 con 0x7f0d9015a4b0 2021-11-12T05:46:35.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.120+0000 7f0d95cb4700 1 --2- 172.21.2.105:0/1644075665 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0d700534f0 0x7f0d700559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:35.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.120+0000 7f0d95cb4700 1 --2- 172.21.2.105:0/1644075665 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0d700534f0 0x7f0d700559b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f0d84009000 tx=0x7f0d84009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:35.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.124+0000 7f0d82ffd700 1 -- 172.21.2.105:0/1644075665 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0d8c041e60 con 0x7f0d9015a4b0 2021-11-12T05:46:35.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.204+0000 7f0d97f18700 1 -- 172.21.2.105:0/1644075665 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0d90147780 con 0x7f0d9015a4b0 2021-11-12T05:46:35.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.204+0000 7f0d82ffd700 1 -- 172.21.2.105:0/1644075665 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) v1 ==== 104+0+10 (secure 0 0 0) 0x7f0d8c045480 con 0x7f0d9015a4b0 2021-11-12T05:46:35.211 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:46:35.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.208+0000 7f0d97f18700 1 -- 172.21.2.105:0/1644075665 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0d700534f0 msgr2=0x7f0d700559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:35.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.208+0000 7f0d97f18700 1 --2- 172.21.2.105:0/1644075665 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0d700534f0 0x7f0d700559b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f0d84009000 tx=0x7f0d84009040).stop 2021-11-12T05:46:35.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.208+0000 7f0d97f18700 1 -- 172.21.2.105:0/1644075665 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d9015a4b0 msgr2=0x7f0d9015a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:35.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.208+0000 7f0d97f18700 1 --2- 172.21.2.105:0/1644075665 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d9015a4b0 0x7f0d9015a910 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7f0d8c002f70 tx=0x7f0d8c006e40).stop 2021-11-12T05:46:35.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.208+0000 7f0d97f18700 1 -- 172.21.2.105:0/1644075665 shutdown_connections 2021-11-12T05:46:35.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.208+0000 7f0d97f18700 1 --2- 172.21.2.105:0/1644075665 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0d700534f0 0x7f0d700559b0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:35.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.208+0000 7f0d97f18700 1 --2- 172.21.2.105:0/1644075665 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0d9014a860 0x7f0d9014ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:35.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.208+0000 7f0d97f18700 1 --2- 172.21.2.105:0/1644075665 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d9015a4b0 0x7f0d9015a910 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:35.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.208+0000 7f0d97f18700 1 --2- 172.21.2.105:0/1644075665 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d78004b10 0x7f0d90146850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:35.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.208+0000 7f0d97f18700 1 -- 172.21.2.105:0/1644075665 >> 172.21.2.105:0/1644075665 conn(0x7f0d900b5320 msgr2=0x7f0d900b36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:35.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.208+0000 7f0d97f18700 1 -- 172.21.2.105:0/1644075665 shutdown_connections 2021-11-12T05:46:35.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.208+0000 7f0d97f18700 1 -- 172.21.2.105:0/1644075665 wait complete. 2021-11-12T05:46:35.218 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-12T05:46:35.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6f04dd3700 1 Processor -- start 2021-11-12T05:46:35.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6f04dd3700 1 -- start start 2021-11-12T05:46:35.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6f04dd3700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6f000aca40 0x7f6f000ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:35.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6f04dd3700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f6f00144180 0x7f6f00144610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:35.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6f04dd3700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f000b1840 con 0x7f6f000b0520 2021-11-12T05:46:35.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6f04dd3700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f000af2b0 con 0x7f6f00144180 2021-11-12T05:46:35.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6f04dd3700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f000b09a0 con 0x7f6f000aca40 2021-11-12T05:46:35.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6efdd9b700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f6f000b0520 0x7f6f001473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:58048/0 (socket says 172.21.2.105:58048) 2021-11-12T05:46:35.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6efdd9b700 1 -- 172.21.2.105:0/2818356649 learned_addr learned my addr 172.21.2.105:0/2818356649 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:46:35.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6efd59a700 1 -- 172.21.2.105:0/2818356649 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4195971957 0 0) 0x7f6f000b1840 con 0x7f6f000b0520 2021-11-12T05:46:35.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6efd59a700 1 -- 172.21.2.105:0/2818356649 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ee0003260 con 0x7f6f000b0520 2021-11-12T05:46:35.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6efe59c700 1 --2- 172.21.2.105:0/2818356649 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6f000aca40 0x7f6f000ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:35.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6efed9d700 1 --2- 172.21.2.105:0/2818356649 >> v2:172.21.2.115:3300/0 conn(0x7f6f00144180 0x7f6f00144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:35.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6efd59a700 1 -- 172.21.2.105:0/2818356649 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 698434906 0 0) 0x7f6ee0003260 con 0x7f6f000b0520 2021-11-12T05:46:35.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6efd59a700 1 -- 172.21.2.105:0/2818356649 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6f000aca40 msgr2=0x7f6f000ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:35.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6efd59a700 1 --2- 172.21.2.105:0/2818356649 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6f000aca40 0x7f6f000ace20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:35.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6efd59a700 1 -- 172.21.2.105:0/2818356649 >> v2:172.21.2.115:3300/0 conn(0x7f6f00144180 msgr2=0x7f6f00144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:35.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6efd59a700 1 --2- 172.21.2.105:0/2818356649 >> v2:172.21.2.115:3300/0 conn(0x7f6f00144180 0x7f6f00144610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:35.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6efd59a700 1 -- 172.21.2.105:0/2818356649 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f000b1a70 con 0x7f6f000b0520 2021-11-12T05:46:35.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6efd59a700 1 -- 172.21.2.105:0/2818356649 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f6ef0001660 con 0x7f6f000b0520 2021-11-12T05:46:35.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6efd59a700 1 -- 172.21.2.105:0/2818356649 >> v1:172.21.2.105:6789/0 conn(0x7f6f000b0520 legacy=0x7f6f001473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:35.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6efd59a700 1 --2- 172.21.2.105:0/2818356649 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6ee00037d0 0x7f6ee0003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:35.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6efd59a700 1 --2- 172.21.2.105:0/2818356649 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6ee0004500 0x7f6ee0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:35.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6efd59a700 1 --2- 172.21.2.105:0/2818356649 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6f000aca40 0x7f6ee0004ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:35.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6efd59a700 1 -- 172.21.2.105:0/2818356649 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f000af2b0 con 0x7f6ee0004500 2021-11-12T05:46:35.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6efd59a700 1 -- 172.21.2.105:0/2818356649 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f000b09a0 con 0x7f6ee00037d0 2021-11-12T05:46:35.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6efd59a700 1 -- 172.21.2.105:0/2818356649 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee000b8d0 con 0x7f6f000aca40 2021-11-12T05:46:35.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6efdd9b700 1 --2- 172.21.2.105:0/2818356649 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6ee0004500 0x7f6ee0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:35.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6efdd9b700 1 -- 172.21.2.105:0/2818356649 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6f000aca40 msgr2=0x7f6ee0004ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:35.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6efdd9b700 1 --2- 172.21.2.105:0/2818356649 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6f000aca40 0x7f6ee0004ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:35.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6efdd9b700 1 -- 172.21.2.105:0/2818356649 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6ee00037d0 msgr2=0x7f6ee0003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:35.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6efdd9b700 1 --2- 172.21.2.105:0/2818356649 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6ee00037d0 0x7f6ee0003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:35.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6efdd9b700 1 -- 172.21.2.105:0/2818356649 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee0003260 con 0x7f6ee0004500 2021-11-12T05:46:35.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6efdd9b700 1 --2- 172.21.2.105:0/2818356649 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6ee0004500 0x7f6ee0004980 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7f6ef0001370 tx=0x7f6ef0001d80).ready entity=mon.0 client_cookie=5d7556e48f63b3a9 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:35.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6efd59a700 1 -- 172.21.2.105:0/2818356649 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ef00070d0 con 0x7f6ee0004500 2021-11-12T05:46:35.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6efd59a700 1 -- 172.21.2.105:0/2818356649 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef0007230 con 0x7f6ee0004500 2021-11-12T05:46:35.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6efd59a700 1 -- 172.21.2.105:0/2818356649 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ef000c8f0 con 0x7f6ee0004500 2021-11-12T05:46:35.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6f04dd3700 1 -- 172.21.2.105:0/2818356649 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6ee0004500 msgr2=0x7f6ee0004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:35.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6f04dd3700 1 --2- 172.21.2.105:0/2818356649 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6ee0004500 0x7f6ee0004980 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7f6ef0001370 tx=0x7f6ef0001d80).stop 2021-11-12T05:46:35.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6efed9d700 1 -- 172.21.2.105:0/2818356649 reap_dead start 2021-11-12T05:46:35.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6f04dd3700 1 -- 172.21.2.105:0/2818356649 shutdown_connections 2021-11-12T05:46:35.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6f04dd3700 1 -- 172.21.2.105:0/2818356649 >> 172.21.2.105:0/2818356649 conn(0x7f6f0005c490 msgr2=0x7f6f000b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:35.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6f04dd3700 1 -- 172.21.2.105:0/2818356649 shutdown_connections 2021-11-12T05:46:35.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.268+0000 7f6f04dd3700 1 -- 172.21.2.105:0/2818356649 wait complete. 2021-11-12T05:46:35.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.272+0000 7f6f04dd3700 1 Processor -- start 2021-11-12T05:46:35.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.272+0000 7f6f04dd3700 1 -- start start 2021-11-12T05:46:35.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.272+0000 7f6f04dd3700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6ee0004500 0x7f6f001434c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:35.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.272+0000 7f6f04dd3700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6f000a7cc0 0x7f6f000ab880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:35.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.272+0000 7f6f04dd3700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6f000a8be0 0x7f6f000aa380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:35.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.272+0000 7f6f04dd3700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f000a7020 con 0x7f6f000a7cc0 2021-11-12T05:46:35.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.272+0000 7f6f04dd3700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f000a72c0 con 0x7f6ee0004500 2021-11-12T05:46:35.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.272+0000 7f6f04dd3700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f000a7560 con 0x7f6f000a8be0 2021-11-12T05:46:35.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.272+0000 7f6efdd9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6f000a7cc0 0x7f6f000ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:35.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.272+0000 7f6efdd9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6f000a7cc0 0x7f6f000ab880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47664/0 (socket says 172.21.2.105:47664) 2021-11-12T05:46:35.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.272+0000 7f6efdd9b700 1 -- 172.21.2.105:0/1061027301 learned_addr learned my addr 172.21.2.105:0/1061027301 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:35.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.272+0000 7f6efdd9b700 1 -- 172.21.2.105:0/1061027301 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6f000a8be0 msgr2=0x7f6f000aa380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:35.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.272+0000 7f6efdd9b700 1 --2- 172.21.2.105:0/1061027301 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6f000a8be0 0x7f6f000aa380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:35.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.272+0000 7f6efdd9b700 1 -- 172.21.2.105:0/1061027301 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6ee0004500 msgr2=0x7f6f001434c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:35.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.272+0000 7f6efdd9b700 1 --2- 172.21.2.105:0/1061027301 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6ee0004500 0x7f6f001434c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:35.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.272+0000 7f6efdd9b700 1 -- 172.21.2.105:0/1061027301 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f000ab3e0 con 0x7f6f000a7cc0 2021-11-12T05:46:35.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.272+0000 7f6efdd9b700 1 --2- 172.21.2.105:0/1061027301 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6f000a7cc0 0x7f6f000ab880 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7f6ef0001370 tx=0x7f6ef0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:35.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.272+0000 7f6ef77fe700 1 -- 172.21.2.105:0/1061027301 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ef0004920 con 0x7f6f000a7cc0 2021-11-12T05:46:35.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.272+0000 7f6ef77fe700 1 -- 172.21.2.105:0/1061027301 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef000ced0 con 0x7f6f000a7cc0 2021-11-12T05:46:35.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.272+0000 7f6f04dd3700 1 -- 172.21.2.105:0/1061027301 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f000abd70 con 0x7f6f000a7cc0 2021-11-12T05:46:35.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.272+0000 7f6ef77fe700 1 -- 172.21.2.105:0/1061027301 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ef0004c70 con 0x7f6f000a7cc0 2021-11-12T05:46:35.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.272+0000 7f6f04dd3700 1 -- 172.21.2.105:0/1061027301 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f000aaa90 con 0x7f6f000a7cc0 2021-11-12T05:46:35.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.272+0000 7f6f04dd3700 1 -- 172.21.2.105:0/1061027301 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f00057350 con 0x7f6f000a7cc0 2021-11-12T05:46:35.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.272+0000 7f6ef77fe700 1 -- 172.21.2.105:0/1061027301 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6ef0027070 con 0x7f6f000a7cc0 2021-11-12T05:46:35.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.272+0000 7f6ef77fe700 1 --2- 172.21.2.105:0/1061027301 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6ee4053720 0x7f6ee4055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:35.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.272+0000 7f6ef77fe700 1 -- 172.21.2.105:0/1061027301 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f6ef006c600 con 0x7f6f000a7cc0 2021-11-12T05:46:35.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.272+0000 7f6efe59c700 1 --2- 172.21.2.105:0/1061027301 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6ee4053720 0x7f6ee4055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:35.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.272+0000 7f6efe59c700 1 --2- 172.21.2.105:0/1061027301 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6ee4053720 0x7f6ee4055be0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f6ee800a000 tx=0x7f6ee8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:35.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.276+0000 7f6ef77fe700 1 -- 172.21.2.105:0/1061027301 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6ef0043610 con 0x7f6f000a7cc0 2021-11-12T05:46:35.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.360+0000 7f6f04dd3700 1 -- 172.21.2.105:0/1061027301 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6f0005f280 con 0x7f6f000a7cc0 2021-11-12T05:46:35.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.360+0000 7f6ef77fe700 1 -- 172.21.2.105:0/1061027301 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) v1 ==== 100+0+10 (secure 0 0 0) 0x7f6ef0046c30 con 0x7f6f000a7cc0 2021-11-12T05:46:35.364 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:46:35.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.360+0000 7f6f04dd3700 1 -- 172.21.2.105:0/1061027301 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6ee4053720 msgr2=0x7f6ee4055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:35.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.360+0000 7f6f04dd3700 1 --2- 172.21.2.105:0/1061027301 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6ee4053720 0x7f6ee4055be0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f6ee800a000 tx=0x7f6ee8008040).stop 2021-11-12T05:46:35.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.360+0000 7f6f04dd3700 1 -- 172.21.2.105:0/1061027301 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6f000a7cc0 msgr2=0x7f6f000ab880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:35.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.360+0000 7f6f04dd3700 1 --2- 172.21.2.105:0/1061027301 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6f000a7cc0 0x7f6f000ab880 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7f6ef0001370 tx=0x7f6ef0015000).stop 2021-11-12T05:46:35.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.360+0000 7f6f04dd3700 1 -- 172.21.2.105:0/1061027301 shutdown_connections 2021-11-12T05:46:35.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.360+0000 7f6f04dd3700 1 --2- 172.21.2.105:0/1061027301 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6ee4053720 0x7f6ee4055be0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:35.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.360+0000 7f6f04dd3700 1 --2- 172.21.2.105:0/1061027301 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6f000a8be0 0x7f6f000aa380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:35.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.360+0000 7f6f04dd3700 1 --2- 172.21.2.105:0/1061027301 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6f000a7cc0 0x7f6f000ab880 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:35.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.360+0000 7f6f04dd3700 1 --2- 172.21.2.105:0/1061027301 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6ee0004500 0x7f6f001434c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:35.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.360+0000 7f6f04dd3700 1 -- 172.21.2.105:0/1061027301 >> 172.21.2.105:0/1061027301 conn(0x7f6f0005c490 msgr2=0x7f6f000b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:35.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.360+0000 7f6f04dd3700 1 -- 172.21.2.105:0/1061027301 shutdown_connections 2021-11-12T05:46:35.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.360+0000 7f6f04dd3700 1 -- 172.21.2.105:0/1061027301 wait complete. 2021-11-12T05:46:35.371 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-12T05:46:35.372 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:46:35.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba4b04f700 1 Processor -- start 2021-11-12T05:46:35.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba4b04f700 1 -- start start 2021-11-12T05:46:35.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba4b04f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fba440601a0 0x7fba44141470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:35.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba4b04f700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba44066150 con 0x7fba440ade80 2021-11-12T05:46:35.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba4b04f700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba440663f0 con 0x7fba4405fdc0 2021-11-12T05:46:35.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba4b04f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba44141fb0 con 0x7fba440601a0 2021-11-12T05:46:35.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba43fff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fba440ade80 0x7fba4413a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:58072/0 (socket says 172.21.2.105:58072) 2021-11-12T05:46:35.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba43fff700 1 -- 172.21.2.105:0/1170247394 learned_addr learned my addr 172.21.2.105:0/1170247394 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:46:35.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba437fe700 1 -- 172.21.2.105:0/1170247394 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3556505566 0 0) 0x7fba44066150 con 0x7fba440ade80 2021-11-12T05:46:35.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba437fe700 1 -- 172.21.2.105:0/1170247394 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba24003260 con 0x7fba440ade80 2021-11-12T05:46:35.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba437fe700 1 -- 172.21.2.105:0/1170247394 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 637007885 0 0) 0x7fba24003260 con 0x7fba440ade80 2021-11-12T05:46:35.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba437fe700 1 -- 172.21.2.105:0/1170247394 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fba440601a0 msgr2=0x7fba44141470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:35.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba437fe700 1 --2- 172.21.2.105:0/1170247394 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fba440601a0 0x7fba44141470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:35.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba437fe700 1 -- 172.21.2.105:0/1170247394 >> v1:172.21.2.115:6789/0 conn(0x7fba4405fdc0 legacy=0x7fba44066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:35.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba437fe700 1 -- 172.21.2.105:0/1170247394 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba44140fd0 con 0x7fba440ade80 2021-11-12T05:46:35.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba437fe700 1 -- 172.21.2.105:0/1170247394 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fba34001680 con 0x7fba440ade80 2021-11-12T05:46:35.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba437fe700 1 -- 172.21.2.105:0/1170247394 >> v1:172.21.2.105:6789/0 conn(0x7fba440ade80 legacy=0x7fba4413a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:35.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba437fe700 1 --2- 172.21.2.105:0/1170247394 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fba440601a0 0x7fba24003780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:35.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba437fe700 1 --2- 172.21.2.105:0/1170247394 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fba24003e20 0x7fba24004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:35.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba437fe700 1 --2- 172.21.2.105:0/1170247394 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fba24004b10 0x7fba24004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:35.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba437fe700 1 -- 172.21.2.105:0/1170247394 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2400b930 con 0x7fba24004b10 2021-11-12T05:46:35.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba437fe700 1 -- 172.21.2.105:0/1170247394 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2400baa0 con 0x7fba24003e20 2021-11-12T05:46:35.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba437fe700 1 -- 172.21.2.105:0/1170247394 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba2400bc60 con 0x7fba440601a0 2021-11-12T05:46:35.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba495ec700 1 --2- 172.21.2.105:0/1170247394 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fba24004b10 0x7fba24004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:35.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba43fff700 1 --2- 172.21.2.105:0/1170247394 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fba24003e20 0x7fba24004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:35.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba48deb700 1 --2- 172.21.2.105:0/1170247394 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fba440601a0 0x7fba24003780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:35.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba495ec700 1 -- 172.21.2.105:0/1170247394 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fba440601a0 msgr2=0x7fba24003780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:35.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba495ec700 1 --2- 172.21.2.105:0/1170247394 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fba440601a0 0x7fba24003780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:35.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba495ec700 1 -- 172.21.2.105:0/1170247394 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fba24003e20 msgr2=0x7fba24004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:35.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba495ec700 1 --2- 172.21.2.105:0/1170247394 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fba24003e20 0x7fba24004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:35.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba495ec700 1 -- 172.21.2.105:0/1170247394 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba24003260 con 0x7fba24004b10 2021-11-12T05:46:35.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba43fff700 1 --2- 172.21.2.105:0/1170247394 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fba24003e20 0x7fba24004500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-12T05:46:35.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba495ec700 1 --2- 172.21.2.105:0/1170247394 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fba24004b10 0x7fba24004f90 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7fba3c0032f0 tx=0x7fba3c006f90).ready entity=mon.0 client_cookie=c0cb100c23ec1db7 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:35.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba437fe700 1 -- 172.21.2.105:0/1170247394 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba3c00b460 con 0x7fba24004b10 2021-11-12T05:46:35.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba437fe700 1 -- 172.21.2.105:0/1170247394 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba3c00b5c0 con 0x7fba24004b10 2021-11-12T05:46:35.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba437fe700 1 -- 172.21.2.105:0/1170247394 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba3c00b920 con 0x7fba24004b10 2021-11-12T05:46:35.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba4b04f700 1 -- 172.21.2.105:0/1170247394 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fba24004b10 msgr2=0x7fba24004f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:35.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba4b04f700 1 --2- 172.21.2.105:0/1170247394 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fba24004b10 0x7fba24004f90 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7fba3c0032f0 tx=0x7fba3c006f90).stop 2021-11-12T05:46:35.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba495ec700 1 -- 172.21.2.105:0/1170247394 reap_dead start 2021-11-12T05:46:35.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba4b04f700 1 -- 172.21.2.105:0/1170247394 shutdown_connections 2021-11-12T05:46:35.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba4b04f700 1 -- 172.21.2.105:0/1170247394 >> 172.21.2.105:0/1170247394 conn(0x7fba440608d0 msgr2=0x7fba4405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:35.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba4b04f700 1 -- 172.21.2.105:0/1170247394 shutdown_connections 2021-11-12T05:46:35.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.420+0000 7fba4b04f700 1 -- 172.21.2.105:0/1170247394 wait complete. 2021-11-12T05:46:35.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.424+0000 7fba4b04f700 1 Processor -- start 2021-11-12T05:46:35.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.424+0000 7fba4b04f700 1 -- start start 2021-11-12T05:46:35.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.424+0000 7fba4b04f700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fba4413a540 0x7fba440aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:35.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.424+0000 7fba4b04f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fba44139310 0x7fba440aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:35.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.424+0000 7fba4b04f700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fba440af490 0x7fba441559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:35.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.424+0000 7fba4b04f700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba44142200 con 0x7fba4413a540 2021-11-12T05:46:35.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.424+0000 7fba4b04f700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4413a920 con 0x7fba440af490 2021-11-12T05:46:35.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.424+0000 7fba4b04f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba441423f0 con 0x7fba44139310 2021-11-12T05:46:35.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.424+0000 7fba48deb700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fba4413a540 0x7fba440aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:35.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.424+0000 7fba48deb700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fba4413a540 0x7fba440aeab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47684/0 (socket says 172.21.2.105:47684) 2021-11-12T05:46:35.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.424+0000 7fba48deb700 1 -- 172.21.2.105:0/935578474 learned_addr learned my addr 172.21.2.105:0/935578474 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:35.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.424+0000 7fba495ec700 1 --2- 172.21.2.105:0/935578474 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fba440af490 0x7fba441559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:35.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.424+0000 7fba43fff700 1 --2- 172.21.2.105:0/935578474 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fba44139310 0x7fba440aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:35.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.424+0000 7fba48deb700 1 -- 172.21.2.105:0/935578474 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fba44139310 msgr2=0x7fba440aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:35.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.424+0000 7fba48deb700 1 --2- 172.21.2.105:0/935578474 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fba44139310 0x7fba440aefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:35.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.424+0000 7fba48deb700 1 -- 172.21.2.105:0/935578474 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fba440af490 msgr2=0x7fba441559b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:35.443 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.424+0000 7fba48deb700 1 --2- 172.21.2.105:0/935578474 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fba440af490 0x7fba441559b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:35.444 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.424+0000 7fba48deb700 1 -- 172.21.2.105:0/935578474 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba440626a0 con 0x7fba4413a540 2021-11-12T05:46:35.444 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.424+0000 7fba43fff700 1 --2- 172.21.2.105:0/935578474 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fba44139310 0x7fba440aefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:46:35.444 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.424+0000 7fba48deb700 1 --2- 172.21.2.105:0/935578474 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fba4413a540 0x7fba440aeab0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7fba2c00d000 tx=0x7fba2c0079e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:35.444 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.424+0000 7fba41ffb700 1 -- 172.21.2.105:0/935578474 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba2c0116b0 con 0x7fba4413a540 2021-11-12T05:46:35.445 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.424+0000 7fba41ffb700 1 -- 172.21.2.105:0/935578474 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba2c011810 con 0x7fba4413a540 2021-11-12T05:46:35.445 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.424+0000 7fba41ffb700 1 -- 172.21.2.105:0/935578474 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba2c011b70 con 0x7fba4413a540 2021-11-12T05:46:35.445 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.424+0000 7fba4b04f700 1 -- 172.21.2.105:0/935578474 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba4413b0e0 con 0x7fba4413a540 2021-11-12T05:46:35.445 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.424+0000 7fba4b04f700 1 -- 172.21.2.105:0/935578474 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba44063240 con 0x7fba4413a540 2021-11-12T05:46:35.445 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.424+0000 7fba4b04f700 1 -- 172.21.2.105:0/935578474 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba44062df0 con 0x7fba4413a540 2021-11-12T05:46:35.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.424+0000 7fba41ffb700 1 -- 172.21.2.105:0/935578474 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fba2c01a030 con 0x7fba4413a540 2021-11-12T05:46:35.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.424+0000 7fba41ffb700 1 --2- 172.21.2.105:0/935578474 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fba280535d0 0x7fba28055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:35.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.424+0000 7fba41ffb700 1 -- 172.21.2.105:0/935578474 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fba2c06b4a0 con 0x7fba4413a540 2021-11-12T05:46:35.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.424+0000 7fba43fff700 1 --2- 172.21.2.105:0/935578474 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fba280535d0 0x7fba28055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:35.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.424+0000 7fba43fff700 1 --2- 172.21.2.105:0/935578474 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fba280535d0 0x7fba28055a90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7fba34005000 tx=0x7fba34009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:35.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.428+0000 7fba41ffb700 1 -- 172.21.2.105:0/935578474 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fba2c0424b0 con 0x7fba4413a540 2021-11-12T05:46:35.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.536+0000 7fba4b04f700 1 -- 172.21.2.105:0/935578474 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba44057350 con 0x7fba4413a540 2021-11-12T05:46:35.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.536+0000 7fba41ffb700 1 -- 172.21.2.105:0/935578474 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+2140 (secure 0 0 0) 0x7fba2c045ad0 con 0x7fba4413a540 2021-11-12T05:46:35.540 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:46:35.541 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":31,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/1423088351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":1423088351},{"type":"v1","addr":"172.21.2.115:6833","nonce":1423088351}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:46:29.372216+0000","modified":"2021-11-12T05:46:30.375936+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6309":{"gid":6309,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/1837795491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":1837795491},{"type":"v1","addr":"172.21.2.105:6835","nonce":1837795491}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-11-12T05:46:35.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.536+0000 7fba4b04f700 1 -- 172.21.2.105:0/935578474 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fba280535d0 msgr2=0x7fba28055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:35.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.536+0000 7fba4b04f700 1 --2- 172.21.2.105:0/935578474 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fba280535d0 0x7fba28055a90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7fba34005000 tx=0x7fba34009040).stop 2021-11-12T05:46:35.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.536+0000 7fba4b04f700 1 -- 172.21.2.105:0/935578474 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fba4413a540 msgr2=0x7fba440aeab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:35.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.536+0000 7fba4b04f700 1 --2- 172.21.2.105:0/935578474 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fba4413a540 0x7fba440aeab0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7fba2c00d000 tx=0x7fba2c0079e0).stop 2021-11-12T05:46:35.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.536+0000 7fba4b04f700 1 -- 172.21.2.105:0/935578474 shutdown_connections 2021-11-12T05:46:35.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.536+0000 7fba4b04f700 1 --2- 172.21.2.105:0/935578474 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fba280535d0 0x7fba28055a90 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:35.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.536+0000 7fba4b04f700 1 --2- 172.21.2.105:0/935578474 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fba440af490 0x7fba441559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:35.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.536+0000 7fba4b04f700 1 --2- 172.21.2.105:0/935578474 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fba44139310 0x7fba440aefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:35.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.536+0000 7fba4b04f700 1 --2- 172.21.2.105:0/935578474 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fba4413a540 0x7fba440aeab0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:35.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.536+0000 7fba4b04f700 1 -- 172.21.2.105:0/935578474 >> 172.21.2.105:0/935578474 conn(0x7fba440608d0 msgr2=0x7fba440b3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:35.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.536+0000 7fba4b04f700 1 -- 172.21.2.105:0/935578474 shutdown_connections 2021-11-12T05:46:35.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:35.536+0000 7fba4b04f700 1 -- 172.21.2.105:0/935578474 wait complete. 2021-11-12T05:46:35.545 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 31 2021-11-12T05:46:35.749 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 31, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:46:29.372216+0000', 'modified': '2021-11-12T05:46:30.375936+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6309}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6309': {'gid': 6309, 'name': 'a', 'rank': 0, 'incarnation': 30, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/1837795491', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 1837795491}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 1837795491}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:46:35.750 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:46:35.750 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:46:35.870 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":6309,"want_state":"up:active","state":"up:active","rank_uptime":6.4903020519999997,"mdsmap_epoch":31,"osdmap_epoch":75,"osdmap_epoch_barrier":74,"uptime":10.669710824999999} 2021-11-12T05:46:35.871 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 6309, "mdsmap_epoch": 31, "osdmap_epoch": 75, "osdmap_epoch_barrier": 74, "rank_uptime": 6.490302052, "state": "up:active", "uptime": 10.669710825, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:46:35.871 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-12T05:46:35.872 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-11-12T05:46:35.872 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@gibba038.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-11-12T05:46:35.872 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:46:35.873 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:46:35.884 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-12T05:46:35.896 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:46:35.896 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:46:35.948 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:46:35.948 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:46:35.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:46:35.950 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-12T05:46:35.955 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-12T05:46:35.955 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:46:35.958 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-12T05:46:35.968 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:46:35.969 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:46:35.998 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:ceph-fuse[14153]: starting ceph client 2021-11-12T05:46:35.998 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:2021-11-12T05:46:35.996+0000 7f14a1c00080 -1 init, newargv = 0x5588b2112ad0 newargc=9 2021-11-12T05:46:36.003 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:46:36.004 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:46:36.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:46:36.005 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-12T05:46:36.012 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:ceph-fuse[14153]: starting fuse 2021-11-12T05:46:36.020 INFO:teuthology.orchestra.run.gibba038.stdout:52 2021-11-12T05:46:36.020 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-12T05:46:36.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:46:36.021 DEBUG:teuthology.orchestra.run.gibba038:> sudo python3 -c ' 2021-11-12T05:46:36.022 DEBUG:teuthology.orchestra.run.gibba038:> import glob 2021-11-12T05:46:36.022 DEBUG:teuthology.orchestra.run.gibba038:> import re 2021-11-12T05:46:36.023 DEBUG:teuthology.orchestra.run.gibba038:> import os 2021-11-12T05:46:36.023 DEBUG:teuthology.orchestra.run.gibba038:> import subprocess 2021-11-12T05:46:36.024 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:46:36.024 DEBUG:teuthology.orchestra.run.gibba038:> def find_socket(client_name): 2021-11-12T05:46:36.025 DEBUG:teuthology.orchestra.run.gibba038:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-11-12T05:46:36.025 DEBUG:teuthology.orchestra.run.gibba038:> files = glob.glob(asok_path) 2021-11-12T05:46:36.025 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:46:36.026 DEBUG:teuthology.orchestra.run.gibba038:> # Given a non-glob path, it better be there 2021-11-12T05:46:36.026 DEBUG:teuthology.orchestra.run.gibba038:> if "*" not in asok_path: 2021-11-12T05:46:36.027 DEBUG:teuthology.orchestra.run.gibba038:> assert(len(files) == 1) 2021-11-12T05:46:36.027 DEBUG:teuthology.orchestra.run.gibba038:> return files[0] 2021-11-12T05:46:36.028 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:46:36.028 DEBUG:teuthology.orchestra.run.gibba038:> for f in files: 2021-11-12T05:46:36.028 DEBUG:teuthology.orchestra.run.gibba038:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-12T05:46:36.029 DEBUG:teuthology.orchestra.run.gibba038:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-12T05:46:36.029 DEBUG:teuthology.orchestra.run.gibba038:> return f 2021-11-12T05:46:36.030 DEBUG:teuthology.orchestra.run.gibba038:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-12T05:46:36.030 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:46:36.030 DEBUG:teuthology.orchestra.run.gibba038:> print(find_socket("client.1")) 2021-11-12T05:46:36.031 DEBUG:teuthology.orchestra.run.gibba038:> ' 2021-11-12T05:46:36.099 INFO:teuthology.orchestra.run.gibba038.stdout:/var/run/ceph/ceph-client.1.14153.asok 2021-11-12T05:46:36.101 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14153.asok 2021-11-12T05:46:36.102 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:46:36.102 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14153.asok status 2021-11-12T05:46:36.150 INFO:teuthology.orchestra.run.gibba038.stdout:{ 2021-11-12T05:46:36.151 INFO:teuthology.orchestra.run.gibba038.stdout: "metadata": { 2021-11-12T05:46:36.151 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_sha1": "a81ee2815de5acae59ead5b8c9137b6766fc8ea8", 2021-11-12T05:46:36.151 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_version": "ceph version 15.2.15-22-ga81ee281 (a81ee2815de5acae59ead5b8c9137b6766fc8ea8) octopus (stable)", 2021-11-12T05:46:36.151 INFO:teuthology.orchestra.run.gibba038.stdout: "entity_id": "1", 2021-11-12T05:46:36.152 INFO:teuthology.orchestra.run.gibba038.stdout: "hostname": "gibba038", 2021-11-12T05:46:36.152 INFO:teuthology.orchestra.run.gibba038.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-11-12T05:46:36.152 INFO:teuthology.orchestra.run.gibba038.stdout: "pid": "14153", 2021-11-12T05:46:36.152 INFO:teuthology.orchestra.run.gibba038.stdout: "root": "/" 2021-11-12T05:46:36.152 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:46:36.153 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_count": 0, 2021-11-12T05:46:36.153 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_pinned_count": 0, 2021-11-12T05:46:36.153 INFO:teuthology.orchestra.run.gibba038.stdout: "id": 4643, 2021-11-12T05:46:36.153 INFO:teuthology.orchestra.run.gibba038.stdout: "inst": { 2021-11-12T05:46:36.154 INFO:teuthology.orchestra.run.gibba038.stdout: "name": { 2021-11-12T05:46:36.155 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "client", 2021-11-12T05:46:36.155 INFO:teuthology.orchestra.run.gibba038.stdout: "num": 4643 2021-11-12T05:46:36.155 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:46:36.155 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-12T05:46:36.156 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-12T05:46:36.156 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-12T05:46:36.156 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 3993661957 2021-11-12T05:46:36.156 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-11-12T05:46:36.157 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:46:36.157 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-12T05:46:36.157 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-12T05:46:36.157 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-12T05:46:36.158 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 3993661957 2021-11-12T05:46:36.158 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:46:36.158 INFO:teuthology.orchestra.run.gibba038.stdout: "inst_str": "client.4643 172.21.2.138:0/3993661957", 2021-11-12T05:46:36.158 INFO:teuthology.orchestra.run.gibba038.stdout: "addr_str": "172.21.2.138:0/3993661957", 2021-11-12T05:46:36.158 INFO:teuthology.orchestra.run.gibba038.stdout: "inode_count": 1, 2021-11-12T05:46:36.159 INFO:teuthology.orchestra.run.gibba038.stdout: "mds_epoch": 31, 2021-11-12T05:46:36.159 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch": 75, 2021-11-12T05:46:36.159 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch_barrier": 0, 2021-11-12T05:46:36.159 INFO:teuthology.orchestra.run.gibba038.stdout: "blacklisted": false, 2021-11-12T05:46:36.160 INFO:teuthology.orchestra.run.gibba038.stdout: "fs_name": "cephfs" 2021-11-12T05:46:36.160 INFO:teuthology.orchestra.run.gibba038.stdout:} 2021-11-12T05:46:36.161 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:46:36.162 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:46:36.162 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:46:36.168 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-12T05:46:36.168 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-12T05:46:36.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:46:36.169 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:46:36.221 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:46:36.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.272+0000 7feef17bd700 1 Processor -- start 2021-11-12T05:46:36.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.272+0000 7feef17bd700 1 -- start start 2021-11-12T05:46:36.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.272+0000 7feef17bd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7feeec060be0 0x7feeec144210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:36.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.272+0000 7feef17bd700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeec14b7b0 con 0x7feeec14b1f0 2021-11-12T05:46:36.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.272+0000 7feef17bd700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeec0ac440 con 0x7feeec0b26f0 2021-11-12T05:46:36.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.272+0000 7feef17bd700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeec0acdd0 con 0x7feeec060be0 2021-11-12T05:46:36.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.272+0000 7feeeb7fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7feeec14b1f0 0x7feeec147b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:58090/0 (socket says 172.21.2.105:58090) 2021-11-12T05:46:36.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.272+0000 7feeeb7fe700 1 -- 172.21.2.105:0/511737824 learned_addr learned my addr 172.21.2.105:0/511737824 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:46:36.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.272+0000 7feef0fbc700 1 --2- 172.21.2.105:0/511737824 >> v2:172.21.2.105:3300/0 conn(0x7feeec060be0 0x7feeec144210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:36.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.272+0000 7feef0fbc700 1 -- 172.21.2.105:0/511737824 >> v1:172.21.2.115:6789/0 conn(0x7feeec0b26f0 legacy=0x7feeec0ac6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:36.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.272+0000 7feef0fbc700 1 -- 172.21.2.105:0/511737824 >> v1:172.21.2.105:6789/0 conn(0x7feeec14b1f0 legacy=0x7feeec147b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:36.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.272+0000 7feef0fbc700 1 -- 172.21.2.105:0/511737824 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeec148220 con 0x7feeec060be0 2021-11-12T05:46:36.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.272+0000 7feef0fbc700 1 --2- 172.21.2.105:0/511737824 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7feeec060be0 0x7feeec144210 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7feeec061ff0 tx=0x7feee40091d0).ready entity=mon.0 client_cookie=beaa98eee99552da server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:36.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.272+0000 7feeeaffd700 1 -- 172.21.2.105:0/511737824 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feee4009ea0 con 0x7feeec060be0 2021-11-12T05:46:36.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.272+0000 7feeeaffd700 1 -- 172.21.2.105:0/511737824 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee400b860 con 0x7feeec060be0 2021-11-12T05:46:36.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.272+0000 7feeeaffd700 1 -- 172.21.2.105:0/511737824 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feee400b9d0 con 0x7feeec060be0 2021-11-12T05:46:36.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.272+0000 7feef17bd700 1 -- 172.21.2.105:0/511737824 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7feeec060be0 msgr2=0x7feeec144210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:36.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.272+0000 7feef17bd700 1 --2- 172.21.2.105:0/511737824 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7feeec060be0 0x7feeec144210 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7feeec061ff0 tx=0x7feee40091d0).stop 2021-11-12T05:46:36.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.272+0000 7feef17bd700 1 -- 172.21.2.105:0/511737824 shutdown_connections 2021-11-12T05:46:36.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.272+0000 7feef17bd700 1 --2- 172.21.2.105:0/511737824 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7feeec060be0 0x7feeec144210 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:36.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.272+0000 7feef17bd700 1 -- 172.21.2.105:0/511737824 >> 172.21.2.105:0/511737824 conn(0x7feeec0b5c50 msgr2=0x7feeec0b1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:36.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.276+0000 7feef17bd700 1 -- 172.21.2.105:0/511737824 shutdown_connections 2021-11-12T05:46:36.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.276+0000 7feef17bd700 1 -- 172.21.2.105:0/511737824 wait complete. 2021-11-12T05:46:36.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.276+0000 7feef17bd700 1 Processor -- start 2021-11-12T05:46:36.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.276+0000 7feef17bd700 1 -- start start 2021-11-12T05:46:36.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.276+0000 7feef17bd700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7feeec060be0 0x7feeec14cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:36.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.276+0000 7feef17bd700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7feeec0b26f0 0x7feeec064860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:36.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.276+0000 7feef17bd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7feeec14b1f0 0x7feeec064d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:36.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.276+0000 7feef17bd700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeec067130 con 0x7feeec14b1f0 2021-11-12T05:46:36.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.276+0000 7feef17bd700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeec0641d0 con 0x7feeec0b26f0 2021-11-12T05:46:36.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.276+0000 7feef17bd700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeec065240 con 0x7feeec060be0 2021-11-12T05:46:36.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.276+0000 7feef0fbc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7feeec14b1f0 0x7feeec064d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:36.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.276+0000 7feef0fbc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7feeec14b1f0 0x7feeec064d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47702/0 (socket says 172.21.2.105:47702) 2021-11-12T05:46:36.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.276+0000 7feef0fbc700 1 -- 172.21.2.105:0/1298966907 learned_addr learned my addr 172.21.2.105:0/1298966907 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:36.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.276+0000 7feef0fbc700 1 -- 172.21.2.105:0/1298966907 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7feeec060be0 msgr2=0x7feeec14cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:36.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.276+0000 7feef0fbc700 1 --2- 172.21.2.105:0/1298966907 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7feeec060be0 0x7feeec14cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:36.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.276+0000 7feef0fbc700 1 -- 172.21.2.105:0/1298966907 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7feeec0b26f0 msgr2=0x7feeec064860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:36.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.276+0000 7feef0fbc700 1 --2- 172.21.2.105:0/1298966907 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7feeec0b26f0 0x7feeec064860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:36.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.276+0000 7feef0fbc700 1 -- 172.21.2.105:0/1298966907 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee4009470 con 0x7feeec14b1f0 2021-11-12T05:46:36.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.276+0000 7feef0fbc700 1 --2- 172.21.2.105:0/1298966907 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7feeec14b1f0 0x7feeec064d50 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7feeec061ff0 tx=0x7feee4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:36.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.276+0000 7feee97fa700 1 -- 172.21.2.105:0/1298966907 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feee4009ea0 con 0x7feeec14b1f0 2021-11-12T05:46:36.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.276+0000 7feee97fa700 1 -- 172.21.2.105:0/1298966907 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee401f5e0 con 0x7feeec14b1f0 2021-11-12T05:46:36.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.276+0000 7feef17bd700 1 -- 172.21.2.105:0/1298966907 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeec14d150 con 0x7feeec14b1f0 2021-11-12T05:46:36.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.276+0000 7feee97fa700 1 -- 172.21.2.105:0/1298966907 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feee401f940 con 0x7feeec14b1f0 2021-11-12T05:46:36.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.276+0000 7feef17bd700 1 -- 172.21.2.105:0/1298966907 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeec1444f0 con 0x7feeec14b1f0 2021-11-12T05:46:36.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.276+0000 7feef17bd700 1 -- 172.21.2.105:0/1298966907 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeec14e820 con 0x7feeec14b1f0 2021-11-12T05:46:36.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.276+0000 7feee97fa700 1 -- 172.21.2.105:0/1298966907 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7feee4026030 con 0x7feeec14b1f0 2021-11-12T05:46:36.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.276+0000 7feee97fa700 1 --2- 172.21.2.105:0/1298966907 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7feecc0536a0 0x7feecc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:36.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.276+0000 7feee97fa700 1 -- 172.21.2.105:0/1298966907 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6416+0+0 (secure 0 0 0) 0x7feee406c7a0 con 0x7feeec14b1f0 2021-11-12T05:46:36.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.276+0000 7feeebfff700 1 --2- 172.21.2.105:0/1298966907 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7feecc0536a0 0x7feecc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:36.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.280+0000 7feeebfff700 1 --2- 172.21.2.105:0/1298966907 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7feecc0536a0 0x7feecc055b60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7feedc002f90 tx=0x7feedc0069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:36.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.280+0000 7feee97fa700 1 -- 172.21.2.105:0/1298966907 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7feee40437b0 con 0x7feeec14b1f0 2021-11-12T05:46:36.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.388+0000 7feef17bd700 1 -- 172.21.2.105:0/1298966907 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feeec064340 con 0x7feeec14b1f0 2021-11-12T05:46:36.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.392+0000 7feee97fa700 1 -- 172.21.2.105:0/1298966907 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+2140 (secure 0 0 0) 0x7feee4015870 con 0x7feeec14b1f0 2021-11-12T05:46:36.396 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:46:36.396 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":31,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/1423088351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":1423088351},{"type":"v1","addr":"172.21.2.115:6833","nonce":1423088351}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:46:29.372216+0000","modified":"2021-11-12T05:46:30.375936+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6309":{"gid":6309,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/1837795491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":1837795491},{"type":"v1","addr":"172.21.2.105:6835","nonce":1837795491}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-11-12T05:46:36.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.392+0000 7feef17bd700 1 -- 172.21.2.105:0/1298966907 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7feecc0536a0 msgr2=0x7feecc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:36.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.392+0000 7feef17bd700 1 --2- 172.21.2.105:0/1298966907 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7feecc0536a0 0x7feecc055b60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7feedc002f90 tx=0x7feedc0069b0).stop 2021-11-12T05:46:36.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.392+0000 7feef17bd700 1 -- 172.21.2.105:0/1298966907 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7feeec14b1f0 msgr2=0x7feeec064d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:36.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.392+0000 7feef17bd700 1 --2- 172.21.2.105:0/1298966907 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7feeec14b1f0 0x7feeec064d50 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7feeec061ff0 tx=0x7feee4016000).stop 2021-11-12T05:46:36.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.392+0000 7feef17bd700 1 -- 172.21.2.105:0/1298966907 shutdown_connections 2021-11-12T05:46:36.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.392+0000 7feef17bd700 1 --2- 172.21.2.105:0/1298966907 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7feecc0536a0 0x7feecc055b60 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:36.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.392+0000 7feef17bd700 1 --2- 172.21.2.105:0/1298966907 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7feeec14b1f0 0x7feeec064d50 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:36.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.392+0000 7feef17bd700 1 --2- 172.21.2.105:0/1298966907 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7feeec0b26f0 0x7feeec064860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:36.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.392+0000 7feef17bd700 1 --2- 172.21.2.105:0/1298966907 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7feeec060be0 0x7feeec14cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:36.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.392+0000 7feef17bd700 1 -- 172.21.2.105:0/1298966907 >> 172.21.2.105:0/1298966907 conn(0x7feeec0b5c50 msgr2=0x7feeec146760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:36.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.392+0000 7feef17bd700 1 -- 172.21.2.105:0/1298966907 shutdown_connections 2021-11-12T05:46:36.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.392+0000 7feef17bd700 1 -- 172.21.2.105:0/1298966907 wait complete. 2021-11-12T05:46:36.400 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 31 2021-11-12T05:46:36.403 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:46:36.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa88926c700 1 Processor -- start 2021-11-12T05:46:36.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa88926c700 1 -- start start 2021-11-12T05:46:36.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa88926c700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fa8840ad080 0x7fa8840af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:36.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa88926c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa88414b2f0 0x7fa8840ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:36.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa88926c700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8840ac7b0 con 0x7fa8840ac280 2021-11-12T05:46:36.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa88926c700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8841488a0 con 0x7fa88414b2f0 2021-11-12T05:46:36.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa88926c700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8840ac9e0 con 0x7fa8840ad080 2021-11-12T05:46:36.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa8827fc700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fa8840ac280 0x7fa88414abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:58104/0 (socket says 172.21.2.105:58104) 2021-11-12T05:46:36.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa8827fc700 1 -- 172.21.2.105:0/2624060626 learned_addr learned my addr 172.21.2.105:0/2624060626 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:46:36.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa8837fe700 1 --2- 172.21.2.105:0/2624060626 >> v2:172.21.2.105:3300/0 conn(0x7fa88414b2f0 0x7fa8840ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:36.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa8837fe700 1 -- 172.21.2.105:0/2624060626 >> v2:172.21.2.115:3300/0 conn(0x7fa8840ad080 msgr2=0x7fa8840af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:46:36.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa8837fe700 1 --2- 172.21.2.105:0/2624060626 >> v2:172.21.2.115:3300/0 conn(0x7fa8840ad080 0x7fa8840af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:36.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa8837fe700 1 -- 172.21.2.105:0/2624060626 >> v1:172.21.2.105:6789/0 conn(0x7fa8840ac280 legacy=0x7fa88414abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:36.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa8837fe700 1 -- 172.21.2.105:0/2624060626 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8840b0b30 con 0x7fa88414b2f0 2021-11-12T05:46:36.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa8837fe700 1 --2- 172.21.2.105:0/2624060626 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa88414b2f0 0x7fa8840ad460 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7fa87c0032f0 tx=0x7fa87c0091d0).ready entity=mon.0 client_cookie=a4fa4d62c5f67c63 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:36.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa881ffb700 1 -- 172.21.2.105:0/2624060626 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa87c009ea0 con 0x7fa88414b2f0 2021-11-12T05:46:36.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa881ffb700 1 -- 172.21.2.105:0/2624060626 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87c00b870 con 0x7fa88414b2f0 2021-11-12T05:46:36.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa881ffb700 1 -- 172.21.2.105:0/2624060626 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa87c00b9e0 con 0x7fa88414b2f0 2021-11-12T05:46:36.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa88926c700 1 -- 172.21.2.105:0/2624060626 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa88414b2f0 msgr2=0x7fa8840ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:36.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa88926c700 1 --2- 172.21.2.105:0/2624060626 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa88414b2f0 0x7fa8840ad460 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7fa87c0032f0 tx=0x7fa87c0091d0).stop 2021-11-12T05:46:36.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa88926c700 1 -- 172.21.2.105:0/2624060626 shutdown_connections 2021-11-12T05:46:36.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa88926c700 1 --2- 172.21.2.105:0/2624060626 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa88414b2f0 0x7fa8840ad460 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:36.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa88926c700 1 --2- 172.21.2.105:0/2624060626 >> v2:172.21.2.115:3300/0 conn(0x7fa8840ad080 0x7fa8840af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:36.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa88926c700 1 -- 172.21.2.105:0/2624060626 >> 172.21.2.105:0/2624060626 conn(0x7fa8840b5370 msgr2=0x7fa8840b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:36.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa88926c700 1 -- 172.21.2.105:0/2624060626 shutdown_connections 2021-11-12T05:46:36.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa88926c700 1 -- 172.21.2.105:0/2624060626 wait complete. 2021-11-12T05:46:36.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa88926c700 1 Processor -- start 2021-11-12T05:46:36.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa88926c700 1 -- start start 2021-11-12T05:46:36.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa88926c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa8840ac280 0x7fa8840aac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:36.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa88926c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa8840ad080 0x7fa88415a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:36.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa88926c700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa88414b2f0 0x7fa88415a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:36.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa88926c700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa884064050 con 0x7fa8840ac280 2021-11-12T05:46:36.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa88926c700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa884063670 con 0x7fa88414b2f0 2021-11-12T05:46:36.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa88926c700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa884063910 con 0x7fa8840ad080 2021-11-12T05:46:36.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa882ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa8840ac280 0x7fa8840aac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:36.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa882ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa8840ac280 0x7fa8840aac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47712/0 (socket says 172.21.2.105:47712) 2021-11-12T05:46:36.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa882ffd700 1 -- 172.21.2.105:0/980051495 learned_addr learned my addr 172.21.2.105:0/980051495 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:46:36.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa882ffd700 1 -- 172.21.2.105:0/980051495 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa8840ad080 msgr2=0x7fa88415a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:36.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa882ffd700 1 --2- 172.21.2.105:0/980051495 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa8840ad080 0x7fa88415a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:36.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa882ffd700 1 -- 172.21.2.105:0/980051495 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa88414b2f0 msgr2=0x7fa88415a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:36.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa882ffd700 1 --2- 172.21.2.105:0/980051495 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa88414b2f0 0x7fa88415a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:36.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.452+0000 7fa882ffd700 1 -- 172.21.2.105:0/980051495 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87c009470 con 0x7fa8840ac280 2021-11-12T05:46:36.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.456+0000 7fa882ffd700 1 --2- 172.21.2.105:0/980051495 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa8840ac280 0x7fa8840aac60 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7fa874002f70 tx=0x7fa874006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:36.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.456+0000 7fa873fff700 1 -- 172.21.2.105:0/980051495 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa874013460 con 0x7fa8840ac280 2021-11-12T05:46:36.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.456+0000 7fa873fff700 1 -- 172.21.2.105:0/980051495 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8740135c0 con 0x7fa8840ac280 2021-11-12T05:46:36.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.456+0000 7fa88926c700 1 -- 172.21.2.105:0/980051495 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa884063bb0 con 0x7fa8840ac280 2021-11-12T05:46:36.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.456+0000 7fa88926c700 1 -- 172.21.2.105:0/980051495 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8840ab150 con 0x7fa8840ac280 2021-11-12T05:46:36.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.456+0000 7fa873fff700 1 -- 172.21.2.105:0/980051495 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa874013920 con 0x7fa8840ac280 2021-11-12T05:46:36.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.456+0000 7fa88926c700 1 -- 172.21.2.105:0/980051495 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8840634e0 con 0x7fa8840ac280 2021-11-12T05:46:36.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.456+0000 7fa873fff700 1 -- 172.21.2.105:0/980051495 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa87401a060 con 0x7fa8840ac280 2021-11-12T05:46:36.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.456+0000 7fa873fff700 1 --2- 172.21.2.105:0/980051495 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa860053660 0x7fa860055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:46:36.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.456+0000 7fa873fff700 1 -- 172.21.2.105:0/980051495 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fa87406b650 con 0x7fa8840ac280 2021-11-12T05:46:36.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.456+0000 7fa8827fc700 1 --2- 172.21.2.105:0/980051495 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa860053660 0x7fa860055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:46:36.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.456+0000 7fa8827fc700 1 --2- 172.21.2.105:0/980051495 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa860053660 0x7fa860055b20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7fa8840b06e0 tx=0x7fa878007800).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:46:36.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.456+0000 7fa873fff700 1 -- 172.21.2.105:0/980051495 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa874042550 con 0x7fa8840ac280 2021-11-12T05:46:36.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.568+0000 7fa88926c700 1 -- 172.21.2.105:0/980051495 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa884063d40 con 0x7fa8840ac280 2021-11-12T05:46:36.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.568+0000 7fa873fff700 1 -- 172.21.2.105:0/980051495 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+2140 (secure 0 0 0) 0x7fa874018030 con 0x7fa8840ac280 2021-11-12T05:46:36.573 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:46:36.573 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":31,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/1423088351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":1423088351},{"type":"v1","addr":"172.21.2.115:6833","nonce":1423088351}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:46:29.372216+0000","modified":"2021-11-12T05:46:30.375936+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6309":{"gid":6309,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/1837795491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":1837795491},{"type":"v1","addr":"172.21.2.105:6835","nonce":1837795491}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-11-12T05:46:36.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.568+0000 7fa88926c700 1 -- 172.21.2.105:0/980051495 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa860053660 msgr2=0x7fa860055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:36.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.568+0000 7fa88926c700 1 --2- 172.21.2.105:0/980051495 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa860053660 0x7fa860055b20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7fa8840b06e0 tx=0x7fa878007800).stop 2021-11-12T05:46:36.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.568+0000 7fa88926c700 1 -- 172.21.2.105:0/980051495 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa8840ac280 msgr2=0x7fa8840aac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:46:36.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.568+0000 7fa88926c700 1 --2- 172.21.2.105:0/980051495 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa8840ac280 0x7fa8840aac60 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7fa874002f70 tx=0x7fa874006ec0).stop 2021-11-12T05:46:36.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.568+0000 7fa88926c700 1 -- 172.21.2.105:0/980051495 shutdown_connections 2021-11-12T05:46:36.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.568+0000 7fa88926c700 1 --2- 172.21.2.105:0/980051495 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa860053660 0x7fa860055b20 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:36.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.568+0000 7fa88926c700 1 --2- 172.21.2.105:0/980051495 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa88414b2f0 0x7fa88415a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:36.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.568+0000 7fa88926c700 1 --2- 172.21.2.105:0/980051495 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa8840ad080 0x7fa88415a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:46:36.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.568+0000 7fa88926c700 1 --2- 172.21.2.105:0/980051495 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa8840ac280 0x7fa8840aac60 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:46:36.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.568+0000 7fa88926c700 1 -- 172.21.2.105:0/980051495 >> 172.21.2.105:0/980051495 conn(0x7fa8840b5370 msgr2=0x7fa884145cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:46:36.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.568+0000 7fa88926c700 1 -- 172.21.2.105:0/980051495 shutdown_connections 2021-11-12T05:46:36.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:46:36.568+0000 7fa88926c700 1 -- 172.21.2.105:0/980051495 wait complete. 2021-11-12T05:46:36.577 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 31 2021-11-12T05:46:36.580 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_cap_revoke_eviction_timeout 30.0 2021-11-12T05:46:36.638 INFO:teuthology.orchestra.run.gibba005.stdout:{"success":"mds_cap_revoke_eviction_timeout = '30.000000' "} 2021-11-12T05:46:36.639 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_cap_revoke_eviction_timeout = '30.000000' " } 2021-11-12T05:46:36.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:46:36.640 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:46:36.640 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:46:36.652 INFO:teuthology.orchestra.run.gibba016.stdout:fuseblk 2021-11-12T05:46:36.654 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-12T05:46:36.656 DEBUG:teuthology.orchestra.run.gibba016:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-11-12T05:46:36.657 DEBUG:teuthology.orchestra.run.gibba016:> import time 2021-11-12T05:46:36.657 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:46:36.658 DEBUG:teuthology.orchestra.run.gibba016:> with open("/home/ubuntu/cephtest/mnt.0/background_file", '"'"'w'"'"') as f: 2021-11-12T05:46:36.659 DEBUG:teuthology.orchestra.run.gibba016:> f.write('"'"'content'"'"') 2021-11-12T05:46:36.659 DEBUG:teuthology.orchestra.run.gibba016:> f.flush() 2021-11-12T05:46:36.660 DEBUG:teuthology.orchestra.run.gibba016:> f.write('"'"'content2'"'"') 2021-11-12T05:46:36.661 DEBUG:teuthology.orchestra.run.gibba016:> while True: 2021-11-12T05:46:36.661 DEBUG:teuthology.orchestra.run.gibba016:> time.sleep(1) 2021-11-12T05:46:36.662 DEBUG:teuthology.orchestra.run.gibba016:> ' 2021-11-12T05:46:36.697 DEBUG:teuthology.orchestra.run.gibba016:> sudo ls /home/ubuntu/cephtest/mnt.0/background_file 2021-11-12T05:46:36.710 INFO:teuthology.orchestra.run.gibba016.stderr:ls: cannot access '/home/ubuntu/cephtest/mnt.0/background_file': No such file or directory 2021-11-12T05:46:36.711 DEBUG:teuthology.orchestra.run:got remote process result: 2 2021-11-12T05:46:37.713 DEBUG:teuthology.orchestra.run.gibba016:> sudo ls /home/ubuntu/cephtest/mnt.0/background_file 2021-11-12T05:46:37.725 INFO:teuthology.orchestra.run.gibba016.stdout:/home/ubuntu/cephtest/mnt.0/background_file 2021-11-12T05:46:37.726 DEBUG:tasks.cephfs.mount:File background_file became visible from 0 after 1s 2021-11-12T05:46:37.727 DEBUG:teuthology.orchestra.run.gibba038:> sudo ls /home/ubuntu/cephtest/mnt.1/background_file 2021-11-12T05:46:37.775 INFO:teuthology.orchestra.run.gibba038.stdout:/home/ubuntu/cephtest/mnt.1/background_file 2021-11-12T05:46:37.777 DEBUG:tasks.cephfs.mount:File background_file became visible from 1 after 0s 2021-11-12T05:46:37.778 INFO:tasks.cephfs.fuse_mount:Killing ceph-fuse connection on ubuntu@gibba016.front.sepia.ceph.com... 2021-11-12T05:46:37.786 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:46:37.786 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:46:37.787 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:46:37.798 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-12T05:46:37.799 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-12T05:46:37.800 DEBUG:teuthology.orchestra.run.gibba038:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-11-12T05:46:37.800 DEBUG:teuthology.orchestra.run.gibba038:> import os 2021-11-12T05:46:37.801 DEBUG:teuthology.orchestra.run.gibba038:> import time 2021-11-12T05:46:37.801 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:46:37.801 DEBUG:teuthology.orchestra.run.gibba038:> fd = os.open("/home/ubuntu/cephtest/mnt.1/background_file", os.O_RDWR | os.O_CREAT, 0o644) 2021-11-12T05:46:37.802 DEBUG:teuthology.orchestra.run.gibba038:> try: 2021-11-12T05:46:37.802 DEBUG:teuthology.orchestra.run.gibba038:> while True: 2021-11-12T05:46:37.803 DEBUG:teuthology.orchestra.run.gibba038:> os.write(fd, b'"'"'content'"'"') 2021-11-12T05:46:37.803 DEBUG:teuthology.orchestra.run.gibba038:> time.sleep(1) 2021-11-12T05:46:37.804 DEBUG:teuthology.orchestra.run.gibba038:> if not False: 2021-11-12T05:46:37.804 DEBUG:teuthology.orchestra.run.gibba038:> break 2021-11-12T05:46:37.804 DEBUG:teuthology.orchestra.run.gibba038:> except IOError as e: 2021-11-12T05:46:37.805 DEBUG:teuthology.orchestra.run.gibba038:> pass 2021-11-12T05:46:37.805 DEBUG:teuthology.orchestra.run.gibba038:> os.close(fd) 2021-11-12T05:46:37.806 DEBUG:teuthology.orchestra.run.gibba038:> ' 2021-11-12T05:46:54.916 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:46:54.920 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:46:54.924 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:46:54.928 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:46:54.932 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:47:16.395 INFO:tasks.cephfs.test_misc:cap_waiter waited 38.54875588417053s 2021-11-12T05:47:16.396 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist ls --format=json 2021-11-12T05:47:16.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.452+0000 7ffb9f7bc700 1 Processor -- start 2021-11-12T05:47:16.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.452+0000 7ffb9f7bc700 1 -- start start 2021-11-12T05:47:16.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.452+0000 7ffb9f7bc700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7ffb980ad080 0x7ffb980af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:16.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.452+0000 7ffb9f7bc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ffb9814b2f0 0x7ffb980ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:16.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.452+0000 7ffb9f7bc700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb980ac7b0 con 0x7ffb980ac280 2021-11-12T05:47:16.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.452+0000 7ffb9f7bc700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb981488a0 con 0x7ffb9814b2f0 2021-11-12T05:47:16.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.452+0000 7ffb9f7bc700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb980ac9e0 con 0x7ffb980ad080 2021-11-12T05:47:16.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.452+0000 7ffb9dd59700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ffb9814b2f0 0x7ffb980ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:16.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.452+0000 7ffb9dd59700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ffb9814b2f0 0x7ffb980ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47726/0 (socket says 172.21.2.105:47726) 2021-11-12T05:47:16.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.452+0000 7ffb9dd59700 1 -- 172.21.2.105:0/464790443 learned_addr learned my addr 172.21.2.105:0/464790443 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:16.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.452+0000 7ffb9dd59700 1 -- 172.21.2.105:0/464790443 >> v2:172.21.2.115:3300/0 conn(0x7ffb980ad080 msgr2=0x7ffb980af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:16.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.452+0000 7ffb9dd59700 1 --2- 172.21.2.105:0/464790443 >> v2:172.21.2.115:3300/0 conn(0x7ffb980ad080 0x7ffb980af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:16.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.452+0000 7ffb9dd59700 1 -- 172.21.2.105:0/464790443 >> v1:172.21.2.115:6789/0 conn(0x7ffb980ac280 legacy=0x7ffb9814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:16.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.452+0000 7ffb9dd59700 1 -- 172.21.2.105:0/464790443 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb980b0b30 con 0x7ffb9814b2f0 2021-11-12T05:47:16.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.452+0000 7ffb9dd59700 1 --2- 172.21.2.105:0/464790443 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffb9814b2f0 0x7ffb980ad460 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7ffb980b06e0 tx=0x7ffb90009290).ready entity=mon.0 client_cookie=9d2d3ae11436d674 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:16.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.452+0000 7ffb8bfff700 1 -- 172.21.2.105:0/464790443 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb9000b830 con 0x7ffb9814b2f0 2021-11-12T05:47:16.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.452+0000 7ffb8bfff700 1 -- 172.21.2.105:0/464790443 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb9000b990 con 0x7ffb9814b2f0 2021-11-12T05:47:16.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.456+0000 7ffb8bfff700 1 -- 172.21.2.105:0/464790443 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb9000bb40 con 0x7ffb9814b2f0 2021-11-12T05:47:16.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.456+0000 7ffb9f7bc700 1 -- 172.21.2.105:0/464790443 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffb9814b2f0 msgr2=0x7ffb980ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:16.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.456+0000 7ffb9f7bc700 1 --2- 172.21.2.105:0/464790443 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffb9814b2f0 0x7ffb980ad460 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7ffb980b06e0 tx=0x7ffb90009290).stop 2021-11-12T05:47:16.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.456+0000 7ffb9f7bc700 1 -- 172.21.2.105:0/464790443 shutdown_connections 2021-11-12T05:47:16.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.456+0000 7ffb9f7bc700 1 --2- 172.21.2.105:0/464790443 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffb9814b2f0 0x7ffb980ad460 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:16.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.456+0000 7ffb9f7bc700 1 --2- 172.21.2.105:0/464790443 >> v2:172.21.2.115:3300/0 conn(0x7ffb980ad080 0x7ffb980af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:16.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.456+0000 7ffb9f7bc700 1 -- 172.21.2.105:0/464790443 >> 172.21.2.105:0/464790443 conn(0x7ffb980b5370 msgr2=0x7ffb980b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:16.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.456+0000 7ffb9f7bc700 1 -- 172.21.2.105:0/464790443 shutdown_connections 2021-11-12T05:47:16.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.456+0000 7ffb9f7bc700 1 -- 172.21.2.105:0/464790443 wait complete. 2021-11-12T05:47:16.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.456+0000 7ffb9f7bc700 1 Processor -- start 2021-11-12T05:47:16.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.456+0000 7ffb9f7bc700 1 -- start start 2021-11-12T05:47:16.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.456+0000 7ffb9f7bc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffb980ac280 0x7ffb980a86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:16.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.456+0000 7ffb9f7bc700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ffb980ad080 0x7ffb980aac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:16.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.456+0000 7ffb9f7bc700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ffb9814b2f0 0x7ffb9815a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:16.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.456+0000 7ffb9f7bc700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb980ab630 con 0x7ffb980ac280 2021-11-12T05:47:16.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.456+0000 7ffb9f7bc700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb981433c0 con 0x7ffb980ad080 2021-11-12T05:47:16.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.456+0000 7ffb9f7bc700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb980640e0 con 0x7ffb9814b2f0 2021-11-12T05:47:16.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.456+0000 7ffb9d558700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffb980ac280 0x7ffb980a86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:16.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.456+0000 7ffb9d558700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffb980ac280 0x7ffb980a86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47728/0 (socket says 172.21.2.105:47728) 2021-11-12T05:47:16.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.456+0000 7ffb9d558700 1 -- 172.21.2.105:0/4133855746 learned_addr learned my addr 172.21.2.105:0/4133855746 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:16.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.456+0000 7ffb9d558700 1 -- 172.21.2.105:0/4133855746 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ffb9814b2f0 msgr2=0x7ffb9815a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:16.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.456+0000 7ffb9d558700 1 --2- 172.21.2.105:0/4133855746 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ffb9814b2f0 0x7ffb9815a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:16.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.456+0000 7ffb9d558700 1 -- 172.21.2.105:0/4133855746 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ffb980ad080 msgr2=0x7ffb980aac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:16.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.456+0000 7ffb9d558700 1 --2- 172.21.2.105:0/4133855746 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ffb980ad080 0x7ffb980aac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:16.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.456+0000 7ffb9d558700 1 -- 172.21.2.105:0/4133855746 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb90009530 con 0x7ffb980ac280 2021-11-12T05:47:16.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.456+0000 7ffb9d558700 1 --2- 172.21.2.105:0/4133855746 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffb980ac280 0x7ffb980a86e0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7ffb8c002f70 tx=0x7ffb8c006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:16.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.456+0000 7ffb8a7fc700 1 -- 172.21.2.105:0/4133855746 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb8c013460 con 0x7ffb980ac280 2021-11-12T05:47:16.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.456+0000 7ffb8a7fc700 1 -- 172.21.2.105:0/4133855746 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb8c0135c0 con 0x7ffb980ac280 2021-11-12T05:47:16.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.456+0000 7ffb9f7bc700 1 -- 172.21.2.105:0/4133855746 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb980a9430 con 0x7ffb980ac280 2021-11-12T05:47:16.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.456+0000 7ffb8a7fc700 1 -- 172.21.2.105:0/4133855746 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb8c013920 con 0x7ffb980ac280 2021-11-12T05:47:16.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.456+0000 7ffb9f7bc700 1 -- 172.21.2.105:0/4133855746 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb98157c60 con 0x7ffb980ac280 2021-11-12T05:47:16.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.456+0000 7ffb9f7bc700 1 -- 172.21.2.105:0/4133855746 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb980b1440 con 0x7ffb980ac280 2021-11-12T05:47:16.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.456+0000 7ffb8a7fc700 1 -- 172.21.2.105:0/4133855746 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ffb8c01a060 con 0x7ffb980ac280 2021-11-12T05:47:16.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.456+0000 7ffb8a7fc700 1 --2- 172.21.2.105:0/4133855746 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ffb780536a0 0x7ffb78055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:16.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.456+0000 7ffb8a7fc700 1 -- 172.21.2.105:0/4133855746 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6459+0+0 (secure 0 0 0) 0x7ffb8c06b510 con 0x7ffb980ac280 2021-11-12T05:47:16.474 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.456+0000 7ffb9cd57700 1 --2- 172.21.2.105:0/4133855746 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ffb780536a0 0x7ffb78055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:16.474 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.456+0000 7ffb9cd57700 1 --2- 172.21.2.105:0/4133855746 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ffb780536a0 0x7ffb78055b60 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7ffb94002f90 tx=0x7ffb940069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:16.474 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.460+0000 7ffb8a7fc700 1 -- 172.21.2.105:0/4133855746 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ffb8c0424f0 con 0x7ffb980ac280 2021-11-12T05:47:16.554 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.548+0000 7ffb9f7bc700 1 -- 172.21.2.105:0/4133855746 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd blacklist ls", "format": "json"} v 0) v1 -- 0x7ffb98057350 con 0x7ffb980ac280 2021-11-12T05:47:16.554 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.548+0000 7ffb8a7fc700 1 -- 172.21.2.105:0/4133855746 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist ls", "format": "json"}]=0 listed 1 entries v76) v1 ==== 98+0+80 (secure 0 0 0) 0x7ffb8c045b10 con 0x7ffb980ac280 2021-11-12T05:47:16.555 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:16.556 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.552+0000 7ffb9f7bc700 1 -- 172.21.2.105:0/4133855746 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ffb780536a0 msgr2=0x7ffb78055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:16.556 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.552+0000 7ffb9f7bc700 1 --2- 172.21.2.105:0/4133855746 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ffb780536a0 0x7ffb78055b60 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7ffb94002f90 tx=0x7ffb940069b0).stop 2021-11-12T05:47:16.556 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.552+0000 7ffb9f7bc700 1 -- 172.21.2.105:0/4133855746 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffb980ac280 msgr2=0x7ffb980a86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:16.556 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.552+0000 7ffb9f7bc700 1 --2- 172.21.2.105:0/4133855746 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffb980ac280 0x7ffb980a86e0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7ffb8c002f70 tx=0x7ffb8c006ec0).stop 2021-11-12T05:47:16.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.552+0000 7ffb9f7bc700 1 -- 172.21.2.105:0/4133855746 shutdown_connections 2021-11-12T05:47:16.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.552+0000 7ffb9f7bc700 1 --2- 172.21.2.105:0/4133855746 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ffb780536a0 0x7ffb78055b60 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:16.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.552+0000 7ffb9f7bc700 1 --2- 172.21.2.105:0/4133855746 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ffb9814b2f0 0x7ffb9815a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:16.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.552+0000 7ffb9f7bc700 1 --2- 172.21.2.105:0/4133855746 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ffb980ad080 0x7ffb980aac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:16.558 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.552+0000 7ffb9f7bc700 1 --2- 172.21.2.105:0/4133855746 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffb980ac280 0x7ffb980a86e0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:16.558 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.552+0000 7ffb9f7bc700 1 -- 172.21.2.105:0/4133855746 >> 172.21.2.105:0/4133855746 conn(0x7ffb980b5370 msgr2=0x7ffb9814aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:16.558 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.552+0000 7ffb9f7bc700 1 -- 172.21.2.105:0/4133855746 shutdown_connections 2021-11-12T05:47:16.558 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.552+0000 7ffb9f7bc700 1 -- 172.21.2.105:0/4133855746 wait complete. 2021-11-12T05:47:16.559 INFO:teuthology.orchestra.run.gibba005.stderr:listed 1 entries 2021-11-12T05:47:16.561 INFO:teuthology.orchestra.run.gibba005.stdout:[{"addr":"172.21.2.116:0/3516388082","until":"2021-11-12T06:47:10.201211+0000"}] 2021-11-12T05:47:16.573 INFO:tasks.cephfs.fuse_mount:Cleaning up killed ceph-fuse connection 2021-11-12T05:47:16.573 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:16.574 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:47:16.574 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:47:16.578 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:47:16.579 INFO:teuthology.orchestra.run.gibba016.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-11-12T05:47:16.579 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-11-12T05:47:16.580 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba016.front.sepia.ceph.com... 2021-11-12T05:47:16.580 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-12T05:47:16.580 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:47:16.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:16.588 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:47:16.588 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:47:16.635 INFO:teuthology.orchestra.run.gibba016.stdout:ext2/ext3 2021-11-12T05:47:16.637 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-12T05:47:16.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:47:16.637 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:47:16.644 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:47:16.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.692+0000 7fbfc1d46700 1 Processor -- start 2021-11-12T05:47:16.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.692+0000 7fbfc1d46700 1 -- start start 2021-11-12T05:47:16.705 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfc1d46700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbfbc0ad080 0x7fbfbc0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:16.705 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfc1d46700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfbc0ac7b0 con 0x7fbfbc14b2f0 2021-11-12T05:47:16.705 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfc1d46700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfbc0ac9e0 con 0x7fbfbc0ac280 2021-11-12T05:47:16.705 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfc1d46700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc1488a0 con 0x7fbfbc0ad080 2021-11-12T05:47:16.706 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfbbfff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fbfbc14b2f0 0x7fbfbc147a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:58136/0 (socket says 172.21.2.105:58136) 2021-11-12T05:47:16.706 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfbbfff700 1 -- 172.21.2.105:0/584932884 learned_addr learned my addr 172.21.2.105:0/584932884 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:16.706 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfba7fc700 1 -- 172.21.2.105:0/584932884 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3231992245 0 0) 0x7fbfbc0ac7b0 con 0x7fbfbc14b2f0 2021-11-12T05:47:16.706 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfba7fc700 1 -- 172.21.2.105:0/584932884 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf9c003260 con 0x7fbfbc14b2f0 2021-11-12T05:47:16.707 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfbb7fe700 1 --2- 172.21.2.105:0/584932884 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbfbc0ad080 0x7fbfbc0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:16.707 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfba7fc700 1 -- 172.21.2.105:0/584932884 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 504857389 0 0) 0x7fbf9c003260 con 0x7fbfbc14b2f0 2021-11-12T05:47:16.707 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfba7fc700 1 -- 172.21.2.105:0/584932884 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbfbc0ad080 msgr2=0x7fbfbc0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:16.707 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfba7fc700 1 --2- 172.21.2.105:0/584932884 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbfbc0ad080 0x7fbfbc0af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:16.708 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfba7fc700 1 -- 172.21.2.105:0/584932884 >> v1:172.21.2.115:6789/0 conn(0x7fbfbc0ac280 legacy=0x7fbfbc14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:16.708 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfba7fc700 1 -- 172.21.2.105:0/584932884 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfbc0b0b30 con 0x7fbfbc14b2f0 2021-11-12T05:47:16.708 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfba7fc700 1 -- 172.21.2.105:0/584932884 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fbfb40019e0 con 0x7fbfbc14b2f0 2021-11-12T05:47:16.708 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfba7fc700 1 -- 172.21.2.105:0/584932884 >> v1:172.21.2.105:6789/0 conn(0x7fbfbc14b2f0 legacy=0x7fbfbc147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:16.708 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfba7fc700 1 --2- 172.21.2.105:0/584932884 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbf9c003800 0x7fbf9c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:16.709 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfba7fc700 1 --2- 172.21.2.105:0/584932884 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbfbc0ad080 0x7fbf9c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:16.709 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfba7fc700 1 --2- 172.21.2.105:0/584932884 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbf9c004b10 0x7fbf9c004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:16.709 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfba7fc700 1 -- 172.21.2.105:0/584932884 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc1488a0 con 0x7fbf9c003800 2021-11-12T05:47:16.709 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfba7fc700 1 -- 172.21.2.105:0/584932884 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9c00b930 con 0x7fbf9c004b10 2021-11-12T05:47:16.710 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfba7fc700 1 -- 172.21.2.105:0/584932884 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9c00baf0 con 0x7fbfbc0ad080 2021-11-12T05:47:16.710 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfbb7fe700 1 --2- 172.21.2.105:0/584932884 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbf9c003800 0x7fbf9c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:16.710 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfbbfff700 1 --2- 172.21.2.105:0/584932884 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbf9c004b10 0x7fbf9c004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:16.710 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfbaffd700 1 --2- 172.21.2.105:0/584932884 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbfbc0ad080 0x7fbf9c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:16.710 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfbb7fe700 1 -- 172.21.2.105:0/584932884 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbfbc0ad080 msgr2=0x7fbf9c004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:16.711 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfbb7fe700 1 --2- 172.21.2.105:0/584932884 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbfbc0ad080 0x7fbf9c004500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:16.711 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfbb7fe700 1 -- 172.21.2.105:0/584932884 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbf9c004b10 msgr2=0x7fbf9c004f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:16.711 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfbb7fe700 1 --2- 172.21.2.105:0/584932884 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbf9c004b10 0x7fbf9c004f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:16.711 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfbb7fe700 1 -- 172.21.2.105:0/584932884 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf9c003260 con 0x7fbf9c003800 2021-11-12T05:47:16.712 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfbb7fe700 1 --2- 172.21.2.105:0/584932884 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbf9c003800 0x7fbf9c003c20 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7fbfa400a000 tx=0x7fbfa4008040).ready entity=mon.0 client_cookie=683cc320b96bbc0f server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:16.712 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfba7fc700 1 -- 172.21.2.105:0/584932884 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfa4013670 con 0x7fbf9c003800 2021-11-12T05:47:16.712 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfba7fc700 1 -- 172.21.2.105:0/584932884 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa40137d0 con 0x7fbf9c003800 2021-11-12T05:47:16.712 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfba7fc700 1 -- 172.21.2.105:0/584932884 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfa4013b30 con 0x7fbf9c003800 2021-11-12T05:47:16.712 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfc1d46700 1 -- 172.21.2.105:0/584932884 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbf9c003800 msgr2=0x7fbf9c003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:16.713 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfc1d46700 1 --2- 172.21.2.105:0/584932884 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbf9c003800 0x7fbf9c003c20 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7fbfa400a000 tx=0x7fbfa4008040).stop 2021-11-12T05:47:16.713 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfbbfff700 1 -- 172.21.2.105:0/584932884 reap_dead start 2021-11-12T05:47:16.713 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfc1d46700 1 -- 172.21.2.105:0/584932884 shutdown_connections 2021-11-12T05:47:16.713 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfc1d46700 1 -- 172.21.2.105:0/584932884 >> 172.21.2.105:0/584932884 conn(0x7fbfbc0b5370 msgr2=0x7fbfbc0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:16.714 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfc1d46700 1 -- 172.21.2.105:0/584932884 shutdown_connections 2021-11-12T05:47:16.714 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfc1d46700 1 -- 172.21.2.105:0/584932884 wait complete. 2021-11-12T05:47:16.714 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfc1d46700 1 Processor -- start 2021-11-12T05:47:16.714 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.696+0000 7fbfc1d46700 1 -- start start 2021-11-12T05:47:16.714 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.700+0000 7fbfc1d46700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbf9c003800 0x7fbfbc0637e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:16.715 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.700+0000 7fbfc1d46700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbfbc063cd0 0x7fbfbc0a8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:16.715 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.700+0000 7fbfc1d46700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbfbc0a8520 0x7fbfbc15a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:16.715 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.700+0000 7fbfc1d46700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc1579d0 con 0x7fbfbc063cd0 2021-11-12T05:47:16.715 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.700+0000 7fbfc1d46700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc1576f0 con 0x7fbf9c003800 2021-11-12T05:47:16.716 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.700+0000 7fbfc1d46700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc0a89a0 con 0x7fbfbc0a8520 2021-11-12T05:47:16.716 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.700+0000 7fbfbaffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbfbc063cd0 0x7fbfbc0a8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:16.716 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.700+0000 7fbfbaffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbfbc063cd0 0x7fbfbc0a8030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47750/0 (socket says 172.21.2.105:47750) 2021-11-12T05:47:16.716 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.700+0000 7fbfbaffd700 1 -- 172.21.2.105:0/3267792967 learned_addr learned my addr 172.21.2.105:0/3267792967 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:16.716 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.700+0000 7fbfbb7fe700 1 --2- 172.21.2.105:0/3267792967 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbf9c003800 0x7fbfbc0637e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:16.717 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.700+0000 7fbfbaffd700 1 -- 172.21.2.105:0/3267792967 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbfbc0a8520 msgr2=0x7fbfbc15a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:16.717 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.700+0000 7fbfbbfff700 1 --2- 172.21.2.105:0/3267792967 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbfbc0a8520 0x7fbfbc15a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:16.717 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.700+0000 7fbfbaffd700 1 --2- 172.21.2.105:0/3267792967 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbfbc0a8520 0x7fbfbc15a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:16.717 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.700+0000 7fbfbaffd700 1 -- 172.21.2.105:0/3267792967 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbf9c003800 msgr2=0x7fbfbc0637e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:16.717 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.700+0000 7fbfbaffd700 1 --2- 172.21.2.105:0/3267792967 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbf9c003800 0x7fbfbc0637e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:16.718 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.700+0000 7fbfbaffd700 1 -- 172.21.2.105:0/3267792967 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfbc0a9500 con 0x7fbfbc063cd0 2021-11-12T05:47:16.718 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.700+0000 7fbfbbfff700 1 --2- 172.21.2.105:0/3267792967 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbfbc0a8520 0x7fbfbc15a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:47:16.718 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.700+0000 7fbfbb7fe700 1 --2- 172.21.2.105:0/3267792967 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbf9c003800 0x7fbfbc0637e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:47:16.718 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.700+0000 7fbfbaffd700 1 --2- 172.21.2.105:0/3267792967 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbfbc063cd0 0x7fbfbc0a8030 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7fbfac008000 tx=0x7fbfac009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:16.719 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.700+0000 7fbfb8ff9700 1 -- 172.21.2.105:0/3267792967 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfac00dea0 con 0x7fbfbc063cd0 2021-11-12T05:47:16.719 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.700+0000 7fbfb8ff9700 1 -- 172.21.2.105:0/3267792967 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfac0104e0 con 0x7fbfbc063cd0 2021-11-12T05:47:16.719 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.700+0000 7fbfc1d46700 1 -- 172.21.2.105:0/3267792967 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfbc0a9d30 con 0x7fbfbc063cd0 2021-11-12T05:47:16.719 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.700+0000 7fbfc1d46700 1 -- 172.21.2.105:0/3267792967 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfbc15a910 con 0x7fbfbc063cd0 2021-11-12T05:47:16.719 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.700+0000 7fbfb8ff9700 1 -- 172.21.2.105:0/3267792967 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfac010840 con 0x7fbfbc063cd0 2021-11-12T05:47:16.720 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.700+0000 7fbfc1d46700 1 -- 172.21.2.105:0/3267792967 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf94003410 con 0x7fbfbc063cd0 2021-11-12T05:47:16.720 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.700+0000 7fbfb8ff9700 1 -- 172.21.2.105:0/3267792967 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbfac01a030 con 0x7fbfbc063cd0 2021-11-12T05:47:16.720 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.700+0000 7fbfb8ff9700 1 --2- 172.21.2.105:0/3267792967 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbfa00536a0 0x7fbfa0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:16.720 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.700+0000 7fbfb8ff9700 1 -- 172.21.2.105:0/3267792967 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6459+0+0 (secure 0 0 0) 0x7fbfac06b440 con 0x7fbfbc063cd0 2021-11-12T05:47:16.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.700+0000 7fbfbb7fe700 1 --2- 172.21.2.105:0/3267792967 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbfa00536a0 0x7fbfa0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:16.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.700+0000 7fbfbb7fe700 1 --2- 172.21.2.105:0/3267792967 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbfa00536a0 0x7fbfa0055b60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7fbfa4019000 tx=0x7fbfa4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:16.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.704+0000 7fbfb8ff9700 1 -- 172.21.2.105:0/3267792967 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbfac0423c0 con 0x7fbfbc063cd0 2021-11-12T05:47:16.790 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.784+0000 7fbfc1d46700 1 -- 172.21.2.105:0/3267792967 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf940036c0 con 0x7fbfbc063cd0 2021-11-12T05:47:16.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.784+0000 7fbfb8ff9700 1 -- 172.21.2.105:0/3267792967 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16335 (secure 0 0 0) 0x7fbfac025fe0 con 0x7fbfbc063cd0 2021-11-12T05:47:16.791 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:16.791 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":76,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:47:11.107473+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:46:27.277471+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-11-12T05:46:28.337063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.2.116:0/3516388082":"2021-11-12T06:47:10.201211+0000"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:47:16.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.788+0000 7fbfc1d46700 1 -- 172.21.2.105:0/3267792967 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbfa00536a0 msgr2=0x7fbfa0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:16.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.788+0000 7fbfc1d46700 1 --2- 172.21.2.105:0/3267792967 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbfa00536a0 0x7fbfa0055b60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7fbfa4019000 tx=0x7fbfa4008040).stop 2021-11-12T05:47:16.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.788+0000 7fbfc1d46700 1 -- 172.21.2.105:0/3267792967 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbfbc063cd0 msgr2=0x7fbfbc0a8030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:16.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.788+0000 7fbfc1d46700 1 --2- 172.21.2.105:0/3267792967 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbfbc063cd0 0x7fbfbc0a8030 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7fbfac008000 tx=0x7fbfac009040).stop 2021-11-12T05:47:16.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.788+0000 7fbfc1d46700 1 -- 172.21.2.105:0/3267792967 shutdown_connections 2021-11-12T05:47:16.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.788+0000 7fbfc1d46700 1 --2- 172.21.2.105:0/3267792967 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbfa00536a0 0x7fbfa0055b60 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:16.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.788+0000 7fbfc1d46700 1 --2- 172.21.2.105:0/3267792967 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbfbc0a8520 0x7fbfbc15a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:16.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.788+0000 7fbfc1d46700 1 --2- 172.21.2.105:0/3267792967 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbfbc063cd0 0x7fbfbc0a8030 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:16.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.788+0000 7fbfc1d46700 1 --2- 172.21.2.105:0/3267792967 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbf9c003800 0x7fbfbc0637e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:16.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.788+0000 7fbfc1d46700 1 -- 172.21.2.105:0/3267792967 >> 172.21.2.105:0/3267792967 conn(0x7fbfbc0b5370 msgr2=0x7fbfbc14aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:16.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.788+0000 7fbfc1d46700 1 -- 172.21.2.105:0/3267792967 shutdown_connections 2021-11-12T05:47:16.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.788+0000 7fbfc1d46700 1 -- 172.21.2.105:0/3267792967 wait complete. 2021-11-12T05:47:16.798 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-12T05:46:27.277471+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2021-11-12T05:46:28.337063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-12T05:47:16.799 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:47:16.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.848+0000 7f6a3e223700 1 Processor -- start 2021-11-12T05:47:16.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.848+0000 7f6a3e223700 1 -- start start 2021-11-12T05:47:16.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.848+0000 7f6a3e223700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6a380ace20 0x7f6a380b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:16.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.848+0000 7f6a3e223700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a380b1840 con 0x7f6a38144180 2021-11-12T05:47:16.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.848+0000 7f6a3e223700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a380af2b0 con 0x7f6a380aca40 2021-11-12T05:47:16.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.848+0000 7f6a3e223700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a380ad2a0 con 0x7f6a380ace20 2021-11-12T05:47:16.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.848+0000 7f6a37fff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f6a38144180 0x7f6a38144610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:58154/0 (socket says 172.21.2.105:58154) 2021-11-12T05:47:16.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.848+0000 7f6a37fff700 1 -- 172.21.2.105:0/3280956835 learned_addr learned my addr 172.21.2.105:0/3280956835 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:16.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.848+0000 7f6a367fc700 1 -- 172.21.2.105:0/3280956835 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3130000105 0 0) 0x7f6a380b1840 con 0x7f6a38144180 2021-11-12T05:47:16.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.848+0000 7f6a367fc700 1 -- 172.21.2.105:0/3280956835 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a18003260 con 0x7f6a38144180 2021-11-12T05:47:16.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.848+0000 7f6a36ffd700 1 --2- 172.21.2.105:0/3280956835 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6a380ace20 0x7f6a380b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:16.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.848+0000 7f6a367fc700 1 -- 172.21.2.105:0/3280956835 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2653054670 0 0) 0x7f6a18003260 con 0x7f6a38144180 2021-11-12T05:47:16.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.848+0000 7f6a367fc700 1 -- 172.21.2.105:0/3280956835 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6a380ace20 msgr2=0x7f6a380b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:16.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.848+0000 7f6a367fc700 1 --2- 172.21.2.105:0/3280956835 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6a380ace20 0x7f6a380b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:16.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.848+0000 7f6a367fc700 1 -- 172.21.2.105:0/3280956835 >> v1:172.21.2.115:6789/0 conn(0x7f6a380aca40 legacy=0x7f6a381473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:16.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.848+0000 7f6a367fc700 1 -- 172.21.2.105:0/3280956835 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a380b1a70 con 0x7f6a38144180 2021-11-12T05:47:16.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.848+0000 7f6a367fc700 1 -- 172.21.2.105:0/3280956835 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f6a300019e0 con 0x7f6a38144180 2021-11-12T05:47:16.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.848+0000 7f6a367fc700 1 -- 172.21.2.105:0/3280956835 >> v1:172.21.2.105:6789/0 conn(0x7f6a38144180 legacy=0x7f6a38144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:16.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.848+0000 7f6a367fc700 1 --2- 172.21.2.105:0/3280956835 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6a18003780 0x7f6a18003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:16.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.848+0000 7f6a367fc700 1 --2- 172.21.2.105:0/3280956835 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6a380ace20 0x7f6a18004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:16.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.848+0000 7f6a367fc700 1 --2- 172.21.2.105:0/3280956835 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6a18004a60 0x7f6a18004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:16.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.848+0000 7f6a367fc700 1 -- 172.21.2.105:0/3280956835 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1800b8e0 con 0x7f6a18004a60 2021-11-12T05:47:16.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.848+0000 7f6a367fc700 1 -- 172.21.2.105:0/3280956835 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1800ba20 con 0x7f6a18003780 2021-11-12T05:47:16.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.848+0000 7f6a367fc700 1 -- 172.21.2.105:0/3280956835 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1800bbb0 con 0x7f6a380ace20 2021-11-12T05:47:16.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.848+0000 7f6a37fff700 1 --2- 172.21.2.105:0/3280956835 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6a18004a60 0x7f6a18004ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:16.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a37fff700 1 -- 172.21.2.105:0/3280956835 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6a380ace20 msgr2=0x7f6a18004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:16.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a37fff700 1 --2- 172.21.2.105:0/3280956835 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6a380ace20 0x7f6a18004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:16.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a37fff700 1 -- 172.21.2.105:0/3280956835 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6a18003780 msgr2=0x7f6a18003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:16.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a37fff700 1 --2- 172.21.2.105:0/3280956835 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6a18003780 0x7f6a18003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:16.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a37fff700 1 -- 172.21.2.105:0/3280956835 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a18003260 con 0x7f6a18004a60 2021-11-12T05:47:16.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a37fff700 1 --2- 172.21.2.105:0/3280956835 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6a18004a60 0x7f6a18004ee0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f6a300016f0 tx=0x7f6a300020c0).ready entity=mon.0 client_cookie=7950e97af8df333d server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:16.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a367fc700 1 -- 172.21.2.105:0/3280956835 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a3000cc80 con 0x7f6a18004a60 2021-11-12T05:47:16.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a367fc700 1 -- 172.21.2.105:0/3280956835 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3000cde0 con 0x7f6a18004a60 2021-11-12T05:47:16.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a367fc700 1 -- 172.21.2.105:0/3280956835 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a30005b80 con 0x7f6a18004a60 2021-11-12T05:47:16.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a3e223700 1 -- 172.21.2.105:0/3280956835 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6a18004a60 msgr2=0x7f6a18004ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:16.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a3e223700 1 --2- 172.21.2.105:0/3280956835 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6a18004a60 0x7f6a18004ee0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f6a300016f0 tx=0x7f6a300020c0).stop 2021-11-12T05:47:16.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a37fff700 1 -- 172.21.2.105:0/3280956835 reap_dead start 2021-11-12T05:47:16.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a3e223700 1 -- 172.21.2.105:0/3280956835 shutdown_connections 2021-11-12T05:47:16.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a3e223700 1 -- 172.21.2.105:0/3280956835 >> 172.21.2.105:0/3280956835 conn(0x7f6a3805c490 msgr2=0x7f6a380b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:16.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a3e223700 1 -- 172.21.2.105:0/3280956835 shutdown_connections 2021-11-12T05:47:16.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a3e223700 1 -- 172.21.2.105:0/3280956835 wait complete. 2021-11-12T05:47:16.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a3e223700 1 Processor -- start 2021-11-12T05:47:16.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a3e223700 1 -- start start 2021-11-12T05:47:16.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a3e223700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6a18004a60 0x7f6a380a8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:16.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a3e223700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6a380a8670 0x7f6a381564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:16.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a3e223700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6a381569e0 0x7f6a38159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:16.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a3e223700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a38157500 con 0x7f6a380a8670 2021-11-12T05:47:16.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a3e223700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a38157260 con 0x7f6a18004a60 2021-11-12T05:47:16.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a3e223700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a380a8ad0 con 0x7f6a381569e0 2021-11-12T05:47:16.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a36ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6a380a8670 0x7f6a381564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:16.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a36ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6a380a8670 0x7f6a381564f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47770/0 (socket says 172.21.2.105:47770) 2021-11-12T05:47:16.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a36ffd700 1 -- 172.21.2.105:0/180585429 learned_addr learned my addr 172.21.2.105:0/180585429 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:16.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a37fff700 1 --2- 172.21.2.105:0/180585429 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6a381569e0 0x7f6a38159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:16.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a36ffd700 1 -- 172.21.2.105:0/180585429 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6a381569e0 msgr2=0x7f6a38159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:16.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a36ffd700 1 --2- 172.21.2.105:0/180585429 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6a381569e0 0x7f6a38159b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:16.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a36ffd700 1 -- 172.21.2.105:0/180585429 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6a18004a60 msgr2=0x7f6a380a8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:16.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a36ffd700 1 --2- 172.21.2.105:0/180585429 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6a18004a60 0x7f6a380a8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:16.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a36ffd700 1 -- 172.21.2.105:0/180585429 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a38064af0 con 0x7f6a380a8670 2021-11-12T05:47:16.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a36ffd700 1 --2- 172.21.2.105:0/180585429 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6a380a8670 0x7f6a381564f0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7f6a2000a000 tx=0x7f6a20008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:16.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a34ff9700 1 -- 172.21.2.105:0/180585429 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a20016070 con 0x7f6a380a8670 2021-11-12T05:47:16.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a34ff9700 1 -- 172.21.2.105:0/180585429 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a20000e90 con 0x7f6a380a8670 2021-11-12T05:47:16.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a3e223700 1 -- 172.21.2.105:0/180585429 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a38156e60 con 0x7f6a380a8670 2021-11-12T05:47:16.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a3e223700 1 -- 172.21.2.105:0/180585429 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a380657b0 con 0x7f6a380a8670 2021-11-12T05:47:16.873 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a34ff9700 1 -- 172.21.2.105:0/180585429 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a20011970 con 0x7f6a380a8670 2021-11-12T05:47:16.873 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a3e223700 1 -- 172.21.2.105:0/180585429 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a38057350 con 0x7f6a380a8670 2021-11-12T05:47:16.873 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a34ff9700 1 -- 172.21.2.105:0/180585429 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6a20011ad0 con 0x7f6a380a8670 2021-11-12T05:47:16.873 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a34ff9700 1 --2- 172.21.2.105:0/180585429 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6a1c053660 0x7f6a1c055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:16.873 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a34ff9700 1 -- 172.21.2.105:0/180585429 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6459+0+0 (secure 0 0 0) 0x7f6a2006b920 con 0x7f6a380a8670 2021-11-12T05:47:16.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a377fe700 1 --2- 172.21.2.105:0/180585429 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6a1c053660 0x7f6a1c055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:16.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.852+0000 7f6a377fe700 1 --2- 172.21.2.105:0/180585429 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6a1c053660 0x7f6a1c055b20 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f6a380af5f0 tx=0x7f6a28007810).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:16.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.856+0000 7f6a34ff9700 1 -- 172.21.2.105:0/180585429 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6a200428a0 con 0x7f6a380a8670 2021-11-12T05:47:16.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.940+0000 7f6a3e223700 1 -- 172.21.2.105:0/180585429 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6a3805f280 con 0x7f6a380a8670 2021-11-12T05:47:16.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.940+0000 7f6a34ff9700 1 -- 172.21.2.105:0/180585429 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v76) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6a20045ec0 con 0x7f6a380a8670 2021-11-12T05:47:16.946 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:47:16.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.940+0000 7f6a3e223700 1 -- 172.21.2.105:0/180585429 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6a1c053660 msgr2=0x7f6a1c055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:16.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.940+0000 7f6a3e223700 1 --2- 172.21.2.105:0/180585429 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6a1c053660 0x7f6a1c055b20 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f6a380af5f0 tx=0x7f6a28007810).stop 2021-11-12T05:47:16.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.940+0000 7f6a3e223700 1 -- 172.21.2.105:0/180585429 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6a380a8670 msgr2=0x7f6a381564f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:16.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.940+0000 7f6a3e223700 1 --2- 172.21.2.105:0/180585429 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6a380a8670 0x7f6a381564f0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7f6a2000a000 tx=0x7f6a20008040).stop 2021-11-12T05:47:16.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.940+0000 7f6a3e223700 1 -- 172.21.2.105:0/180585429 shutdown_connections 2021-11-12T05:47:16.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.940+0000 7f6a3e223700 1 --2- 172.21.2.105:0/180585429 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6a1c053660 0x7f6a1c055b20 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:16.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.940+0000 7f6a3e223700 1 --2- 172.21.2.105:0/180585429 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6a381569e0 0x7f6a38159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:16.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.940+0000 7f6a3e223700 1 --2- 172.21.2.105:0/180585429 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6a380a8670 0x7f6a381564f0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:16.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.940+0000 7f6a3e223700 1 --2- 172.21.2.105:0/180585429 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6a18004a60 0x7f6a380a8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:16.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.940+0000 7f6a3e223700 1 -- 172.21.2.105:0/180585429 >> 172.21.2.105:0/180585429 conn(0x7f6a3805c490 msgr2=0x7f6a381413e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:16.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.940+0000 7f6a3e223700 1 -- 172.21.2.105:0/180585429 shutdown_connections 2021-11-12T05:47:16.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:16.940+0000 7f6a3e223700 1 -- 172.21.2.105:0/180585429 wait complete. 2021-11-12T05:47:16.953 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:47:17.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.000+0000 7f7f09bdc700 1 Processor -- start 2021-11-12T05:47:17.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.000+0000 7f7f09bdc700 1 -- start start 2021-11-12T05:47:17.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f09bdc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f7f040b2cc0 0x7f7f040b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:17.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f09bdc700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7f040b2290 0x7f7f04143690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:17.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f09bdc700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f040aa0b0 con 0x7f7f04143b80 2021-11-12T05:47:17.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f09bdc700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f040a9b70 con 0x7f7f040b2cc0 2021-11-12T05:47:17.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f09bdc700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f040a9e10 con 0x7f7f040b2290 2021-11-12T05:47:17.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f03fff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f7f04143b80 0x7f7f0413f230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:58174/0 (socket says 172.21.2.105:58174) 2021-11-12T05:47:17.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f03fff700 1 -- 172.21.2.105:0/3768460853 learned_addr learned my addr 172.21.2.105:0/3768460853 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:17.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f037fe700 1 --2- 172.21.2.105:0/3768460853 >> v2:172.21.2.105:3300/0 conn(0x7f7f040b2cc0 0x7f7f040b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:17.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f037fe700 1 -- 172.21.2.105:0/3768460853 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7f040b2290 msgr2=0x7f7f04143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:17.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f037fe700 1 --2- 172.21.2.105:0/3768460853 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7f040b2290 0x7f7f04143690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:17.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f037fe700 1 -- 172.21.2.105:0/3768460853 >> v1:172.21.2.105:6789/0 conn(0x7f7f04143b80 legacy=0x7f7f0413f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:17.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f037fe700 1 -- 172.21.2.105:0/3768460853 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f040b0800 con 0x7f7f040b2cc0 2021-11-12T05:47:17.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f037fe700 1 --2- 172.21.2.105:0/3768460853 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7f040b2cc0 0x7f7f040b30a0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f7ef4002f70 tx=0x7f7ef4006df0).ready entity=mon.0 client_cookie=417fcc79d4949167 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:17.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f027fc700 1 -- 172.21.2.105:0/3768460853 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ef400d570 con 0x7f7f040b2cc0 2021-11-12T05:47:17.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f027fc700 1 -- 172.21.2.105:0/3768460853 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef4000e90 con 0x7f7f040b2cc0 2021-11-12T05:47:17.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f027fc700 1 -- 172.21.2.105:0/3768460853 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ef400d8c0 con 0x7f7f040b2cc0 2021-11-12T05:47:17.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f09bdc700 1 -- 172.21.2.105:0/3768460853 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7f040b2cc0 msgr2=0x7f7f040b30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:17.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f09bdc700 1 --2- 172.21.2.105:0/3768460853 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7f040b2cc0 0x7f7f040b30a0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f7ef4002f70 tx=0x7f7ef4006df0).stop 2021-11-12T05:47:17.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f09bdc700 1 -- 172.21.2.105:0/3768460853 shutdown_connections 2021-11-12T05:47:17.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f09bdc700 1 --2- 172.21.2.105:0/3768460853 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7f040b2290 0x7f7f04143690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:17.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f09bdc700 1 --2- 172.21.2.105:0/3768460853 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7f040b2cc0 0x7f7f040b30a0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:17.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f09bdc700 1 -- 172.21.2.105:0/3768460853 >> 172.21.2.105:0/3768460853 conn(0x7f7f0405c490 msgr2=0x7f7f0405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:17.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f09bdc700 1 -- 172.21.2.105:0/3768460853 shutdown_connections 2021-11-12T05:47:17.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f09bdc700 1 -- 172.21.2.105:0/3768460853 wait complete. 2021-11-12T05:47:17.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f09bdc700 1 Processor -- start 2021-11-12T05:47:17.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f09bdc700 1 -- start start 2021-11-12T05:47:17.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f09bdc700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7f040b2290 0x7f7f040a8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:17.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f09bdc700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7f040b2cc0 0x7f7f040a2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:17.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f09bdc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7f04143b80 0x7f7f040a3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:17.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f09bdc700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f040a5170 con 0x7f7f04143b80 2021-11-12T05:47:17.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f09bdc700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f04067180 con 0x7f7f040b2cc0 2021-11-12T05:47:17.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f09bdc700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f04066550 con 0x7f7f040b2290 2021-11-12T05:47:17.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f03fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7f04143b80 0x7f7f040a3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:17.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f03fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7f04143b80 0x7f7f040a3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47786/0 (socket says 172.21.2.105:47786) 2021-11-12T05:47:17.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f03fff700 1 -- 172.21.2.105:0/1500610473 learned_addr learned my addr 172.21.2.105:0/1500610473 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:17.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f03fff700 1 -- 172.21.2.105:0/1500610473 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7f040b2290 msgr2=0x7f7f040a8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:17.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f03fff700 1 --2- 172.21.2.105:0/1500610473 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7f040b2290 0x7f7f040a8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:17.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f03fff700 1 -- 172.21.2.105:0/1500610473 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7f040b2cc0 msgr2=0x7f7f040a2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:17.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f03fff700 1 --2- 172.21.2.105:0/1500610473 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7f040b2cc0 0x7f7f040a2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:17.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f03fff700 1 -- 172.21.2.105:0/1500610473 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef400b180 con 0x7f7f04143b80 2021-11-12T05:47:17.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.004+0000 7f7f03fff700 1 --2- 172.21.2.105:0/1500610473 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7f04143b80 0x7f7f040a3110 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7f7f04063330 tx=0x7f7efc0013a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:17.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.008+0000 7f7f00ff9700 1 -- 172.21.2.105:0/1500610473 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7efc005ba0 con 0x7f7f04143b80 2021-11-12T05:47:17.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.008+0000 7f7f00ff9700 1 -- 172.21.2.105:0/1500610473 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7efc005d00 con 0x7f7f04143b80 2021-11-12T05:47:17.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.008+0000 7f7f09bdc700 1 -- 172.21.2.105:0/1500610473 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f04065510 con 0x7f7f04143b80 2021-11-12T05:47:17.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.008+0000 7f7f00ff9700 1 -- 172.21.2.105:0/1500610473 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7efc0072c0 con 0x7f7f04143b80 2021-11-12T05:47:17.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.008+0000 7f7f09bdc700 1 -- 172.21.2.105:0/1500610473 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f04065ff0 con 0x7f7f04143b80 2021-11-12T05:47:17.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.008+0000 7f7f09bdc700 1 -- 172.21.2.105:0/1500610473 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f04067380 con 0x7f7f04143b80 2021-11-12T05:47:17.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.008+0000 7f7f00ff9700 1 -- 172.21.2.105:0/1500610473 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7efc01a060 con 0x7f7f04143b80 2021-11-12T05:47:17.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.008+0000 7f7f00ff9700 1 --2- 172.21.2.105:0/1500610473 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7ee8053580 0x7f7ee8055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:17.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.008+0000 7f7f00ff9700 1 -- 172.21.2.105:0/1500610473 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6459+0+0 (secure 0 0 0) 0x7f7efc06b600 con 0x7f7f04143b80 2021-11-12T05:47:17.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.008+0000 7f7f037fe700 1 --2- 172.21.2.105:0/1500610473 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7ee8053580 0x7f7ee8055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:17.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.008+0000 7f7f037fe700 1 --2- 172.21.2.105:0/1500610473 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7ee8053580 0x7f7ee8055a40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f7ef4002f70 tx=0x7f7ef4015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:17.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.012+0000 7f7f00ff9700 1 -- 172.21.2.105:0/1500610473 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7efc0424d0 con 0x7f7f04143b80 2021-11-12T05:47:17.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.092+0000 7f7f09bdc700 1 -- 172.21.2.105:0/1500610473 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7f04057350 con 0x7f7f04143b80 2021-11-12T05:47:17.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.092+0000 7f7f00ff9700 1 -- 172.21.2.105:0/1500610473 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v76) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7efc018020 con 0x7f7f04143b80 2021-11-12T05:47:17.099 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:47:17.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.092+0000 7f7f09bdc700 1 -- 172.21.2.105:0/1500610473 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7ee8053580 msgr2=0x7f7ee8055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:17.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.092+0000 7f7f09bdc700 1 --2- 172.21.2.105:0/1500610473 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7ee8053580 0x7f7ee8055a40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f7ef4002f70 tx=0x7f7ef4015000).stop 2021-11-12T05:47:17.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.092+0000 7f7f09bdc700 1 -- 172.21.2.105:0/1500610473 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7f04143b80 msgr2=0x7f7f040a3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:17.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.092+0000 7f7f09bdc700 1 --2- 172.21.2.105:0/1500610473 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7f04143b80 0x7f7f040a3110 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7f7f04063330 tx=0x7f7efc0013a0).stop 2021-11-12T05:47:17.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.096+0000 7f7f09bdc700 1 -- 172.21.2.105:0/1500610473 shutdown_connections 2021-11-12T05:47:17.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.096+0000 7f7f09bdc700 1 --2- 172.21.2.105:0/1500610473 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7ee8053580 0x7f7ee8055a40 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:17.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.096+0000 7f7f09bdc700 1 --2- 172.21.2.105:0/1500610473 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7f04143b80 0x7f7f040a3110 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:17.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.096+0000 7f7f09bdc700 1 --2- 172.21.2.105:0/1500610473 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7f040b2cc0 0x7f7f040a2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:17.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.096+0000 7f7f09bdc700 1 --2- 172.21.2.105:0/1500610473 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7f040b2290 0x7f7f040a8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:17.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.096+0000 7f7f09bdc700 1 -- 172.21.2.105:0/1500610473 >> 172.21.2.105:0/1500610473 conn(0x7f7f0405c490 msgr2=0x7f7f04142c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:17.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.096+0000 7f7f09bdc700 1 -- 172.21.2.105:0/1500610473 shutdown_connections 2021-11-12T05:47:17.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.096+0000 7f7f09bdc700 1 -- 172.21.2.105:0/1500610473 wait complete. 2021-11-12T05:47:17.107 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-12T05:47:17.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.168+0000 7fa8320ec700 1 Processor -- start 2021-11-12T05:47:17.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.168+0000 7fa8320ec700 1 -- start start 2021-11-12T05:47:17.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.168+0000 7fa8320ec700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fa82c0626b0 0x7fa82c062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:17.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.168+0000 7fa8320ec700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa82c130a80 0x7fa82c1474d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:17.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.168+0000 7fa8320ec700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa82c0b0d50 con 0x7fa82c0af750 2021-11-12T05:47:17.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.168+0000 7fa8320ec700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa82c0ad380 con 0x7fa82c0626b0 2021-11-12T05:47:17.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.168+0000 7fa8320ec700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c0ae190 con 0x7fa82c130a80 2021-11-12T05:47:17.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.168+0000 7fa82b7fe700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fa82c0626b0 0x7fa82c062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:17.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.168+0000 7fa82b7fe700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fa82c0626b0 0x7fa82c062a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3300/0 says I am v2:172.21.2.105:36732/0 (socket says 172.21.2.105:36732) 2021-11-12T05:47:17.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.168+0000 7fa82b7fe700 1 -- 172.21.2.105:0/780579322 learned_addr learned my addr 172.21.2.105:0/780579322 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:17.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.168+0000 7fa82bfff700 1 --2- 172.21.2.105:0/780579322 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa82c130a80 0x7fa82c1474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:17.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.168+0000 7fa82b7fe700 1 -- 172.21.2.105:0/780579322 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa82c130a80 msgr2=0x7fa82c1474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:17.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.168+0000 7fa82b7fe700 1 --2- 172.21.2.105:0/780579322 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa82c130a80 0x7fa82c1474d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:17.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.168+0000 7fa82b7fe700 1 -- 172.21.2.105:0/780579322 >> v1:172.21.2.115:6789/0 conn(0x7fa82c0af750 legacy=0x7fa82c130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:17.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.168+0000 7fa82b7fe700 1 -- 172.21.2.105:0/780579322 --> v2:172.21.2.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa82c1479c0 con 0x7fa82c0626b0 2021-11-12T05:47:17.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.168+0000 7fa82b7fe700 1 --2- 172.21.2.105:0/780579322 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa82c0626b0 0x7fa82c062a90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fa81c002f70 tx=0x7fa81c006eb0).ready entity=mon.1 client_cookie=af2b4a9949b2ddbe server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:17.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.168+0000 7fa82a7fc700 1 -- 172.21.2.105:0/780579322 <== mon.1 v2:172.21.2.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa81c00d570 con 0x7fa82c0626b0 2021-11-12T05:47:17.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.168+0000 7fa82a7fc700 1 -- 172.21.2.105:0/780579322 <== mon.1 v2:172.21.2.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81c000e90 con 0x7fa82c0626b0 2021-11-12T05:47:17.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.168+0000 7fa82a7fc700 1 -- 172.21.2.105:0/780579322 <== mon.1 v2:172.21.2.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa81c00d900 con 0x7fa82c0626b0 2021-11-12T05:47:17.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.172+0000 7fa8320ec700 1 -- 172.21.2.105:0/780579322 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa82c0626b0 msgr2=0x7fa82c062a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:17.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.172+0000 7fa8320ec700 1 --2- 172.21.2.105:0/780579322 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa82c0626b0 0x7fa82c062a90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fa81c002f70 tx=0x7fa81c006eb0).stop 2021-11-12T05:47:17.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.172+0000 7fa8320ec700 1 -- 172.21.2.105:0/780579322 shutdown_connections 2021-11-12T05:47:17.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.172+0000 7fa8320ec700 1 --2- 172.21.2.105:0/780579322 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa82c130a80 0x7fa82c1474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:17.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.172+0000 7fa8320ec700 1 --2- 172.21.2.105:0/780579322 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa82c0626b0 0x7fa82c062a90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:17.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.172+0000 7fa8320ec700 1 -- 172.21.2.105:0/780579322 >> 172.21.2.105:0/780579322 conn(0x7fa82c0b5320 msgr2=0x7fa82c0b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:17.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.172+0000 7fa8320ec700 1 -- 172.21.2.105:0/780579322 shutdown_connections 2021-11-12T05:47:17.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.172+0000 7fa8320ec700 1 -- 172.21.2.105:0/780579322 wait complete. 2021-11-12T05:47:17.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.172+0000 7fa8320ec700 1 Processor -- start 2021-11-12T05:47:17.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.172+0000 7fa8320ec700 1 -- start start 2021-11-12T05:47:17.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.172+0000 7fa8320ec700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa82c0626b0 0x7fa82c14d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:17.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.172+0000 7fa8320ec700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa82c0af750 0x7fa82c1445d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:17.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.172+0000 7fa8320ec700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa82c130a80 0x7fa82c144ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:17.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.172+0000 7fa8320ec700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c065950 con 0x7fa82c0af750 2021-11-12T05:47:17.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.172+0000 7fa8320ec700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c063e70 con 0x7fa82c0626b0 2021-11-12T05:47:17.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.172+0000 7fa8320ec700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c064e10 con 0x7fa82c130a80 2021-11-12T05:47:17.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.172+0000 7fa82affd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa82c0af750 0x7fa82c1445d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:17.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.172+0000 7fa82affd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa82c0af750 0x7fa82c1445d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47800/0 (socket says 172.21.2.105:47800) 2021-11-12T05:47:17.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.172+0000 7fa82affd700 1 -- 172.21.2.105:0/688405902 learned_addr learned my addr 172.21.2.105:0/688405902 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:17.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.172+0000 7fa82b7fe700 1 --2- 172.21.2.105:0/688405902 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa82c0626b0 0x7fa82c14d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:17.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.172+0000 7fa82bfff700 1 --2- 172.21.2.105:0/688405902 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa82c130a80 0x7fa82c144ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:17.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.172+0000 7fa82affd700 1 -- 172.21.2.105:0/688405902 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa82c130a80 msgr2=0x7fa82c144ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:17.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.172+0000 7fa82affd700 1 --2- 172.21.2.105:0/688405902 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa82c130a80 0x7fa82c144ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:17.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.172+0000 7fa82affd700 1 -- 172.21.2.105:0/688405902 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa82c0626b0 msgr2=0x7fa82c14d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:17.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.172+0000 7fa82affd700 1 --2- 172.21.2.105:0/688405902 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa82c0626b0 0x7fa82c14d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:17.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.172+0000 7fa82affd700 1 -- 172.21.2.105:0/688405902 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c00b1e0 con 0x7fa82c0af750 2021-11-12T05:47:17.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.172+0000 7fa82affd700 1 --2- 172.21.2.105:0/688405902 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa82c0af750 0x7fa82c1445d0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7fa82c05d1b0 tx=0x7fa814007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:17.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.172+0000 7fa828ff9700 1 -- 172.21.2.105:0/688405902 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa814007030 con 0x7fa82c0af750 2021-11-12T05:47:17.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.172+0000 7fa828ff9700 1 -- 172.21.2.105:0/688405902 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa814007190 con 0x7fa82c0af750 2021-11-12T05:47:17.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.172+0000 7fa8320ec700 1 -- 172.21.2.105:0/688405902 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa82c14d950 con 0x7fa82c0af750 2021-11-12T05:47:17.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.172+0000 7fa828ff9700 1 -- 172.21.2.105:0/688405902 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa814006510 con 0x7fa82c0af750 2021-11-12T05:47:17.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.172+0000 7fa8320ec700 1 -- 172.21.2.105:0/688405902 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa82c144fb0 con 0x7fa82c0af750 2021-11-12T05:47:17.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.172+0000 7fa8320ec700 1 -- 172.21.2.105:0/688405902 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa82c064070 con 0x7fa82c0af750 2021-11-12T05:47:17.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.172+0000 7fa828ff9700 1 -- 172.21.2.105:0/688405902 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa814006670 con 0x7fa82c0af750 2021-11-12T05:47:17.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.172+0000 7fa828ff9700 1 --2- 172.21.2.105:0/688405902 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa8100535b0 0x7fa810055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:17.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.172+0000 7fa828ff9700 1 -- 172.21.2.105:0/688405902 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6459+0+0 (secure 0 0 0) 0x7fa81406b3f0 con 0x7fa82c0af750 2021-11-12T05:47:17.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.172+0000 7fa82b7fe700 1 --2- 172.21.2.105:0/688405902 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa8100535b0 0x7fa810055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:17.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.176+0000 7fa82b7fe700 1 --2- 172.21.2.105:0/688405902 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa8100535b0 0x7fa810055a70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7fa81c01c000 tx=0x7fa81c015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:17.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.176+0000 7fa828ff9700 1 -- 172.21.2.105:0/688405902 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa814042260 con 0x7fa82c0af750 2021-11-12T05:47:17.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.260+0000 7fa8320ec700 1 -- 172.21.2.105:0/688405902 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa82c057350 con 0x7fa82c0af750 2021-11-12T05:47:17.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.260+0000 7fa828ff9700 1 -- 172.21.2.105:0/688405902 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v76) v1 ==== 104+0+10 (secure 0 0 0) 0x7fa814045880 con 0x7fa82c0af750 2021-11-12T05:47:17.266 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:47:17.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.260+0000 7fa8320ec700 1 -- 172.21.2.105:0/688405902 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa8100535b0 msgr2=0x7fa810055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:17.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.260+0000 7fa8320ec700 1 --2- 172.21.2.105:0/688405902 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa8100535b0 0x7fa810055a70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7fa81c01c000 tx=0x7fa81c015000).stop 2021-11-12T05:47:17.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.260+0000 7fa8320ec700 1 -- 172.21.2.105:0/688405902 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa82c0af750 msgr2=0x7fa82c1445d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:17.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.260+0000 7fa8320ec700 1 --2- 172.21.2.105:0/688405902 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa82c0af750 0x7fa82c1445d0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7fa82c05d1b0 tx=0x7fa814007bb0).stop 2021-11-12T05:47:17.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.264+0000 7fa8320ec700 1 -- 172.21.2.105:0/688405902 shutdown_connections 2021-11-12T05:47:17.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.264+0000 7fa8320ec700 1 --2- 172.21.2.105:0/688405902 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa8100535b0 0x7fa810055a70 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:17.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.264+0000 7fa8320ec700 1 --2- 172.21.2.105:0/688405902 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa82c130a80 0x7fa82c144ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:17.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.264+0000 7fa8320ec700 1 --2- 172.21.2.105:0/688405902 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa82c0af750 0x7fa82c1445d0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:17.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.264+0000 7fa8320ec700 1 --2- 172.21.2.105:0/688405902 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa82c0626b0 0x7fa82c14d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:17.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.264+0000 7fa8320ec700 1 -- 172.21.2.105:0/688405902 >> 172.21.2.105:0/688405902 conn(0x7fa82c0b5320 msgr2=0x7fa82c0b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:17.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.264+0000 7fa8320ec700 1 -- 172.21.2.105:0/688405902 shutdown_connections 2021-11-12T05:47:17.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.264+0000 7fa8320ec700 1 -- 172.21.2.105:0/688405902 wait complete. 2021-11-12T05:47:17.273 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-12T05:47:17.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.320+0000 7fbc4c6e9700 1 Processor -- start 2021-11-12T05:47:17.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.320+0000 7fbc4c6e9700 1 -- start start 2021-11-12T05:47:17.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.320+0000 7fbc4c6e9700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fbc440aca40 0x7fbc440ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:17.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.320+0000 7fbc4c6e9700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fbc440b0520 0x7fbc441473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:17.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.320+0000 7fbc4c6e9700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc440b1840 con 0x7fbc441478b0 2021-11-12T05:47:17.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.320+0000 7fbc4c6e9700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc44147d20 con 0x7fbc440aca40 2021-11-12T05:47:17.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.320+0000 7fbc4c6e9700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc440b09d0 con 0x7fbc440b0520 2021-11-12T05:47:17.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc4ac86700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fbc441478b0 0x7fbc44144180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:58200/0 (socket says 172.21.2.105:58200) 2021-11-12T05:47:17.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc4ac86700 1 -- 172.21.2.105:0/496212171 learned_addr learned my addr 172.21.2.105:0/496212171 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:17.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc4a485700 1 --2- 172.21.2.105:0/496212171 >> v2:172.21.2.105:3300/0 conn(0x7fbc440aca40 0x7fbc440ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:17.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc4a485700 1 -- 172.21.2.105:0/496212171 >> v2:172.21.2.115:3300/0 conn(0x7fbc440b0520 msgr2=0x7fbc441473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:17.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc4a485700 1 --2- 172.21.2.105:0/496212171 >> v2:172.21.2.115:3300/0 conn(0x7fbc440b0520 0x7fbc441473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:17.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc4a485700 1 -- 172.21.2.105:0/496212171 >> v1:172.21.2.105:6789/0 conn(0x7fbc441478b0 legacy=0x7fbc44144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:17.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc4a485700 1 -- 172.21.2.105:0/496212171 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc440af2b0 con 0x7fbc440aca40 2021-11-12T05:47:17.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc4a485700 1 --2- 172.21.2.105:0/496212171 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbc440aca40 0x7fbc440ace20 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7fbc34002f70 tx=0x7fbc34006df0).ready entity=mon.0 client_cookie=a6fa77686f83b62d server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:17.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc49483700 1 -- 172.21.2.105:0/496212171 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc3400d5c0 con 0x7fbc440aca40 2021-11-12T05:47:17.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc49483700 1 -- 172.21.2.105:0/496212171 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc34000e90 con 0x7fbc440aca40 2021-11-12T05:47:17.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc49483700 1 -- 172.21.2.105:0/496212171 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc3400d910 con 0x7fbc440aca40 2021-11-12T05:47:17.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc4c6e9700 1 -- 172.21.2.105:0/496212171 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbc440aca40 msgr2=0x7fbc440ace20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:17.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc4c6e9700 1 --2- 172.21.2.105:0/496212171 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbc440aca40 0x7fbc440ace20 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7fbc34002f70 tx=0x7fbc34006df0).stop 2021-11-12T05:47:17.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc4c6e9700 1 -- 172.21.2.105:0/496212171 shutdown_connections 2021-11-12T05:47:17.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc4c6e9700 1 --2- 172.21.2.105:0/496212171 >> v2:172.21.2.115:3300/0 conn(0x7fbc440b0520 0x7fbc441473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:17.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc4c6e9700 1 --2- 172.21.2.105:0/496212171 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbc440aca40 0x7fbc440ace20 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:17.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc4c6e9700 1 -- 172.21.2.105:0/496212171 >> 172.21.2.105:0/496212171 conn(0x7fbc4405c490 msgr2=0x7fbc440b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:17.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc4c6e9700 1 -- 172.21.2.105:0/496212171 shutdown_connections 2021-11-12T05:47:17.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc4c6e9700 1 -- 172.21.2.105:0/496212171 wait complete. 2021-11-12T05:47:17.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc4c6e9700 1 Processor -- start 2021-11-12T05:47:17.336 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc4c6e9700 1 -- start start 2021-11-12T05:47:17.336 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc4c6e9700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbc440aca40 0x7fbc440629a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:17.336 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc4c6e9700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbc440b0520 0x7fbc44149620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:17.336 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc4c6e9700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbc441478b0 0x7fbc44157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:17.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc4c6e9700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc44156be0 con 0x7fbc440aca40 2021-11-12T05:47:17.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc4c6e9700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc44156e80 con 0x7fbc440b0520 2021-11-12T05:47:17.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc4c6e9700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc440ac3d0 con 0x7fbc441478b0 2021-11-12T05:47:17.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc4a485700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbc440aca40 0x7fbc440629a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:17.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc4a485700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbc440aca40 0x7fbc440629a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47810/0 (socket says 172.21.2.105:47810) 2021-11-12T05:47:17.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc4a485700 1 -- 172.21.2.105:0/1266900688 learned_addr learned my addr 172.21.2.105:0/1266900688 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:17.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc4a485700 1 -- 172.21.2.105:0/1266900688 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbc441478b0 msgr2=0x7fbc44157320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:17.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc4a485700 1 --2- 172.21.2.105:0/1266900688 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbc441478b0 0x7fbc44157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:17.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc4a485700 1 -- 172.21.2.105:0/1266900688 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbc440b0520 msgr2=0x7fbc44149620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:17.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc4a485700 1 --2- 172.21.2.105:0/1266900688 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbc440b0520 0x7fbc44149620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:17.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc4a485700 1 -- 172.21.2.105:0/1266900688 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3400b180 con 0x7fbc440aca40 2021-11-12T05:47:17.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc4a485700 1 --2- 172.21.2.105:0/1266900688 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbc440aca40 0x7fbc440629a0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7fbc34002f70 tx=0x7fbc34014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:17.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc337fe700 1 -- 172.21.2.105:0/1266900688 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc34016070 con 0x7fbc440aca40 2021-11-12T05:47:17.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc337fe700 1 -- 172.21.2.105:0/1266900688 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3400de90 con 0x7fbc440aca40 2021-11-12T05:47:17.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc4c6e9700 1 -- 172.21.2.105:0/1266900688 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc44156910 con 0x7fbc440aca40 2021-11-12T05:47:17.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc4c6e9700 1 -- 172.21.2.105:0/1266900688 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc44066ae0 con 0x7fbc440aca40 2021-11-12T05:47:17.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.324+0000 7fbc337fe700 1 -- 172.21.2.105:0/1266900688 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc3401e450 con 0x7fbc440aca40 2021-11-12T05:47:17.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.328+0000 7fbc4c6e9700 1 -- 172.21.2.105:0/1266900688 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc44157040 con 0x7fbc440aca40 2021-11-12T05:47:17.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.328+0000 7fbc337fe700 1 -- 172.21.2.105:0/1266900688 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbc34025030 con 0x7fbc440aca40 2021-11-12T05:47:17.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.328+0000 7fbc337fe700 1 --2- 172.21.2.105:0/1266900688 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbc240536d0 0x7fbc24055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:17.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.328+0000 7fbc337fe700 1 -- 172.21.2.105:0/1266900688 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6459+0+0 (secure 0 0 0) 0x7fbc3406cae0 con 0x7fbc440aca40 2021-11-12T05:47:17.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.328+0000 7fbc49c84700 1 --2- 172.21.2.105:0/1266900688 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbc240536d0 0x7fbc24055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:17.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.328+0000 7fbc49c84700 1 --2- 172.21.2.105:0/1266900688 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbc240536d0 0x7fbc24055b90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7fbc40002f70 tx=0x7fbc40006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:17.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.328+0000 7fbc337fe700 1 -- 172.21.2.105:0/1266900688 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbc34043ac0 con 0x7fbc440aca40 2021-11-12T05:47:17.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.412+0000 7fbc4c6e9700 1 -- 172.21.2.105:0/1266900688 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbc44057350 con 0x7fbc440aca40 2021-11-12T05:47:17.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.412+0000 7fbc337fe700 1 -- 172.21.2.105:0/1266900688 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v76) v1 ==== 100+0+10 (secure 0 0 0) 0x7fbc34023020 con 0x7fbc440aca40 2021-11-12T05:47:17.416 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:47:17.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.412+0000 7fbc4c6e9700 1 -- 172.21.2.105:0/1266900688 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbc240536d0 msgr2=0x7fbc24055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:17.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.412+0000 7fbc4c6e9700 1 --2- 172.21.2.105:0/1266900688 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbc240536d0 0x7fbc24055b90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7fbc40002f70 tx=0x7fbc40006a80).stop 2021-11-12T05:47:17.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.412+0000 7fbc4c6e9700 1 -- 172.21.2.105:0/1266900688 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbc440aca40 msgr2=0x7fbc440629a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:17.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.412+0000 7fbc4c6e9700 1 --2- 172.21.2.105:0/1266900688 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbc440aca40 0x7fbc440629a0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7fbc34002f70 tx=0x7fbc34014000).stop 2021-11-12T05:47:17.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.412+0000 7fbc4c6e9700 1 -- 172.21.2.105:0/1266900688 shutdown_connections 2021-11-12T05:47:17.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.412+0000 7fbc4c6e9700 1 --2- 172.21.2.105:0/1266900688 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbc240536d0 0x7fbc24055b90 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:17.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.412+0000 7fbc4c6e9700 1 --2- 172.21.2.105:0/1266900688 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbc441478b0 0x7fbc44157320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:17.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.412+0000 7fbc4c6e9700 1 --2- 172.21.2.105:0/1266900688 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbc440b0520 0x7fbc44149620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:17.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.412+0000 7fbc4c6e9700 1 --2- 172.21.2.105:0/1266900688 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbc440aca40 0x7fbc440629a0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:17.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.412+0000 7fbc4c6e9700 1 -- 172.21.2.105:0/1266900688 >> 172.21.2.105:0/1266900688 conn(0x7fbc4405c490 msgr2=0x7fbc4405fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:17.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.412+0000 7fbc4c6e9700 1 -- 172.21.2.105:0/1266900688 shutdown_connections 2021-11-12T05:47:17.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.412+0000 7fbc4c6e9700 1 -- 172.21.2.105:0/1266900688 wait complete. 2021-11-12T05:47:17.423 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-12T05:47:17.424 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:47:17.474 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.468+0000 7f2ff911a700 1 Processor -- start 2021-11-12T05:47:17.475 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.468+0000 7f2ff911a700 1 -- start start 2021-11-12T05:47:17.478 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff911a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2ff40ad0d0 0x7f2ff40af590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:17.478 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff911a700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f2ff4142c70 0x7f2ff40ab9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:17.478 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff911a700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ff40b10b0 con 0x7f2ff40626f0 2021-11-12T05:47:17.478 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff911a700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ff413f5b0 con 0x7f2ff4142c70 2021-11-12T05:47:17.479 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff911a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff4062ad0 con 0x7f2ff40ad0d0 2021-11-12T05:47:17.479 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff2d9d700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f2ff40626f0 0x7f2ff40ad870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:58214/0 (socket says 172.21.2.105:58214) 2021-11-12T05:47:17.479 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff2d9d700 1 -- 172.21.2.105:0/4125983986 learned_addr learned my addr 172.21.2.105:0/4125983986 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:17.479 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff359e700 1 --2- 172.21.2.105:0/4125983986 >> v2:172.21.2.115:3300/0 conn(0x7f2ff4142c70 0x7f2ff40ab9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:17.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff1d9b700 1 -- 172.21.2.105:0/4125983986 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2000856264 0 0) 0x7f2ff40b10b0 con 0x7f2ff40626f0 2021-11-12T05:47:17.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff259c700 1 --2- 172.21.2.105:0/4125983986 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2ff40ad0d0 0x7f2ff40af590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:17.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff1d9b700 1 -- 172.21.2.105:0/4125983986 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fd4003260 con 0x7f2ff40626f0 2021-11-12T05:47:17.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff1d9b700 1 -- 172.21.2.105:0/4125983986 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3307683955 0 0) 0x7f2fd4003260 con 0x7f2ff40626f0 2021-11-12T05:47:17.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff1d9b700 1 -- 172.21.2.105:0/4125983986 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2ff40ad0d0 msgr2=0x7f2ff40af590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:17.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff1d9b700 1 --2- 172.21.2.105:0/4125983986 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2ff40ad0d0 0x7f2ff40af590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:17.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff1d9b700 1 -- 172.21.2.105:0/4125983986 >> v2:172.21.2.115:3300/0 conn(0x7f2ff4142c70 msgr2=0x7f2ff40ab9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:17.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff1d9b700 1 --2- 172.21.2.105:0/4125983986 >> v2:172.21.2.115:3300/0 conn(0x7f2ff4142c70 0x7f2ff40ab9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:17.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff1d9b700 1 -- 172.21.2.105:0/4125983986 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff40b12e0 con 0x7f2ff40626f0 2021-11-12T05:47:17.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff1d9b700 1 -- 172.21.2.105:0/4125983986 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f2fe4001660 con 0x7f2ff40626f0 2021-11-12T05:47:17.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff1d9b700 1 -- 172.21.2.105:0/4125983986 >> v1:172.21.2.105:6789/0 conn(0x7f2ff40626f0 legacy=0x7f2ff40ad870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:17.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff1d9b700 1 --2- 172.21.2.105:0/4125983986 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2fd40037d0 0x7f2fd4003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:17.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff1d9b700 1 --2- 172.21.2.105:0/4125983986 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2ff40ad0d0 0x7f2fd4004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:17.483 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff1d9b700 1 --2- 172.21.2.105:0/4125983986 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2fd40049f0 0x7f2fd4004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:17.483 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff1d9b700 1 -- 172.21.2.105:0/4125983986 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff413f5b0 con 0x7f2fd40037d0 2021-11-12T05:47:17.483 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff1d9b700 1 -- 172.21.2.105:0/4125983986 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff4062ad0 con 0x7f2fd40049f0 2021-11-12T05:47:17.483 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff1d9b700 1 -- 172.21.2.105:0/4125983986 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd400b800 con 0x7f2ff40ad0d0 2021-11-12T05:47:17.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff2d9d700 1 --2- 172.21.2.105:0/4125983986 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2fd40037d0 0x7f2fd4003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:17.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff2d9d700 1 -- 172.21.2.105:0/4125983986 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2ff40ad0d0 msgr2=0x7f2fd4004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:17.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff2d9d700 1 --2- 172.21.2.105:0/4125983986 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2ff40ad0d0 0x7f2fd4004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:17.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff2d9d700 1 -- 172.21.2.105:0/4125983986 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2fd40049f0 msgr2=0x7f2fd4004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:17.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff2d9d700 1 --2- 172.21.2.105:0/4125983986 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2fd40049f0 0x7f2fd4004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:17.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff2d9d700 1 -- 172.21.2.105:0/4125983986 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd4003260 con 0x7f2fd40037d0 2021-11-12T05:47:17.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff2d9d700 1 --2- 172.21.2.105:0/4125983986 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2fd40037d0 0x7f2fd4003bf0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7f2fe4001370 tx=0x7f2fe4001d80).ready entity=mon.0 client_cookie=6b33d7d584705a6c server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:17.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff1d9b700 1 -- 172.21.2.105:0/4125983986 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fe40070d0 con 0x7f2fd40037d0 2021-11-12T05:47:17.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff1d9b700 1 -- 172.21.2.105:0/4125983986 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe4007230 con 0x7f2fd40037d0 2021-11-12T05:47:17.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff1d9b700 1 -- 172.21.2.105:0/4125983986 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fe400c8f0 con 0x7f2fd40037d0 2021-11-12T05:47:17.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff911a700 1 -- 172.21.2.105:0/4125983986 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2fd40037d0 msgr2=0x7f2fd4003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:17.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff911a700 1 --2- 172.21.2.105:0/4125983986 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2fd40037d0 0x7f2fd4003bf0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7f2fe4001370 tx=0x7f2fe4001d80).stop 2021-11-12T05:47:17.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff359e700 1 -- 172.21.2.105:0/4125983986 reap_dead start 2021-11-12T05:47:17.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff911a700 1 -- 172.21.2.105:0/4125983986 shutdown_connections 2021-11-12T05:47:17.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff911a700 1 -- 172.21.2.105:0/4125983986 >> 172.21.2.105:0/4125983986 conn(0x7f2ff40b5370 msgr2=0x7f2ff40b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:17.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff911a700 1 -- 172.21.2.105:0/4125983986 shutdown_connections 2021-11-12T05:47:17.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff911a700 1 -- 172.21.2.105:0/4125983986 wait complete. 2021-11-12T05:47:17.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff911a700 1 Processor -- start 2021-11-12T05:47:17.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff911a700 1 -- start start 2021-11-12T05:47:17.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff911a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2fd40037d0 0x7f2ff40ab600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:17.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.472+0000 7f2ff911a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ff40ac2d0 0x7f2ff40abaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:17.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.476+0000 7f2ff911a700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2ff40a7c50 0x7f2ff415a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:17.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.476+0000 7f2ff911a700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff40a7860 con 0x7f2ff40ac2d0 2021-11-12T05:47:17.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.476+0000 7f2ff911a700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff4157770 con 0x7f2ff40a7c50 2021-11-12T05:47:17.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.476+0000 7f2ff911a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff4157a10 con 0x7f2fd40037d0 2021-11-12T05:47:17.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.476+0000 7f2ff259c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ff40ac2d0 0x7f2ff40abaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:17.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.476+0000 7f2ff259c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ff40ac2d0 0x7f2ff40abaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47830/0 (socket says 172.21.2.105:47830) 2021-11-12T05:47:17.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.476+0000 7f2ff259c700 1 -- 172.21.2.105:0/50234615 learned_addr learned my addr 172.21.2.105:0/50234615 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:17.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.476+0000 7f2ff259c700 1 -- 172.21.2.105:0/50234615 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2fd40037d0 msgr2=0x7f2ff40ab600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:17.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.476+0000 7f2ff259c700 1 --2- 172.21.2.105:0/50234615 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2fd40037d0 0x7f2ff40ab600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:17.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.476+0000 7f2ff259c700 1 -- 172.21.2.105:0/50234615 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2ff40a7c50 msgr2=0x7f2ff415a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:17.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.476+0000 7f2ff259c700 1 --2- 172.21.2.105:0/50234615 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2ff40a7c50 0x7f2ff415a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:17.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.476+0000 7f2ff259c700 1 -- 172.21.2.105:0/50234615 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff4064cc0 con 0x7f2ff40ac2d0 2021-11-12T05:47:17.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.476+0000 7f2ff259c700 1 --2- 172.21.2.105:0/50234615 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ff40ac2d0 0x7f2ff40abaf0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7f2fdc00a000 tx=0x7f2fdc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:17.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.476+0000 7f2febfff700 1 -- 172.21.2.105:0/50234615 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fdc016070 con 0x7f2ff40ac2d0 2021-11-12T05:47:17.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.476+0000 7f2febfff700 1 -- 172.21.2.105:0/50234615 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fdc000e90 con 0x7f2ff40ac2d0 2021-11-12T05:47:17.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.476+0000 7f2ff911a700 1 -- 172.21.2.105:0/50234615 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ff415a710 con 0x7f2ff40ac2d0 2021-11-12T05:47:17.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.476+0000 7f2ff911a700 1 -- 172.21.2.105:0/50234615 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ff415ab90 con 0x7f2ff40ac2d0 2021-11-12T05:47:17.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.476+0000 7f2febfff700 1 -- 172.21.2.105:0/50234615 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fdc011970 con 0x7f2ff40ac2d0 2021-11-12T05:47:17.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.476+0000 7f2ff911a700 1 -- 172.21.2.105:0/50234615 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ff41575e0 con 0x7f2ff40ac2d0 2021-11-12T05:47:17.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.476+0000 7f2febfff700 1 -- 172.21.2.105:0/50234615 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2fdc011ad0 con 0x7f2ff40ac2d0 2021-11-12T05:47:17.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.476+0000 7f2febfff700 1 --2- 172.21.2.105:0/50234615 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2fd8053570 0x7f2fd8055a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:17.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.476+0000 7f2febfff700 1 -- 172.21.2.105:0/50234615 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6459+0+0 (secure 0 0 0) 0x7f2fdc06bc30 con 0x7f2ff40ac2d0 2021-11-12T05:47:17.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.476+0000 7f2ff2d9d700 1 --2- 172.21.2.105:0/50234615 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2fd8053570 0x7f2fd8055a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:17.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.476+0000 7f2ff2d9d700 1 --2- 172.21.2.105:0/50234615 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2fd8053570 0x7f2fd8055a30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f2fe4001370 tx=0x7f2fe4015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:17.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.480+0000 7f2febfff700 1 -- 172.21.2.105:0/50234615 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2fdc042b00 con 0x7f2ff40ac2d0 2021-11-12T05:47:17.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.592+0000 7f2ff911a700 1 -- 172.21.2.105:0/50234615 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ff4157bd0 con 0x7f2ff40ac2d0 2021-11-12T05:47:17.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.592+0000 7f2febfff700 1 -- 172.21.2.105:0/50234615 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f2fdc046120 con 0x7f2ff40ac2d0 2021-11-12T05:47:17.597 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:17.597 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":31,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/1423088351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":1423088351},{"type":"v1","addr":"172.21.2.115:6833","nonce":1423088351}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:46:29.372216+0000","modified":"2021-11-12T05:46:30.375936+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6309":{"gid":6309,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/1837795491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":1837795491},{"type":"v1","addr":"172.21.2.105:6835","nonce":1837795491}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-11-12T05:47:17.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.592+0000 7f2ff911a700 1 -- 172.21.2.105:0/50234615 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2fd8053570 msgr2=0x7f2fd8055a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:17.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.592+0000 7f2ff911a700 1 --2- 172.21.2.105:0/50234615 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2fd8053570 0x7f2fd8055a30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f2fe4001370 tx=0x7f2fe4015000).stop 2021-11-12T05:47:17.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.592+0000 7f2ff911a700 1 -- 172.21.2.105:0/50234615 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ff40ac2d0 msgr2=0x7f2ff40abaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:17.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.592+0000 7f2ff911a700 1 --2- 172.21.2.105:0/50234615 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ff40ac2d0 0x7f2ff40abaf0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7f2fdc00a000 tx=0x7f2fdc008040).stop 2021-11-12T05:47:17.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.592+0000 7f2ff911a700 1 -- 172.21.2.105:0/50234615 shutdown_connections 2021-11-12T05:47:17.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.592+0000 7f2ff911a700 1 --2- 172.21.2.105:0/50234615 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2fd8053570 0x7f2fd8055a30 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:17.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.592+0000 7f2ff911a700 1 --2- 172.21.2.105:0/50234615 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2ff40a7c50 0x7f2ff415a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:17.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.592+0000 7f2ff911a700 1 --2- 172.21.2.105:0/50234615 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ff40ac2d0 0x7f2ff40abaf0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:17.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.592+0000 7f2ff911a700 1 --2- 172.21.2.105:0/50234615 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2fd40037d0 0x7f2ff40ab600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:17.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.592+0000 7f2ff911a700 1 -- 172.21.2.105:0/50234615 >> 172.21.2.105:0/50234615 conn(0x7f2ff40b5370 msgr2=0x7f2ff40b31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:17.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.592+0000 7f2ff911a700 1 -- 172.21.2.105:0/50234615 shutdown_connections 2021-11-12T05:47:17.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:17.592+0000 7f2ff911a700 1 -- 172.21.2.105:0/50234615 wait complete. 2021-11-12T05:47:17.603 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 31 2021-11-12T05:47:17.806 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 31, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:46:29.372216+0000', 'modified': '2021-11-12T05:46:30.375936+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6309}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6309': {'gid': 6309, 'name': 'a', 'rank': 0, 'incarnation': 30, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/1837795491', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 1837795491}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 1837795491}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:47:17.806 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:47:17.807 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:47:17.871 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":6309,"want_state":"up:active","state":"up:active","rank_uptime":48.491144603999999,"mdsmap_epoch":31,"osdmap_epoch":76,"osdmap_epoch_barrier":76,"uptime":52.670554897999999} 2021-11-12T05:47:17.871 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 6309, "mdsmap_epoch": 31, "osdmap_epoch": 76, "osdmap_epoch_barrier": 76, "rank_uptime": 48.491144604, "state": "up:active", "uptime": 52.670554898, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:47:17.872 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-12T05:47:17.873 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-12T05:47:17.873 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba016.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-12T05:47:17.874 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:17.875 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:47:17.885 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:47:17.896 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:47:17.897 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:47:17.946 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:47:17.947 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:47:17.948 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:17.948 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:47:17.953 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-12T05:47:17.953 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:47:17.997 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:47:18.009 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:47:18.010 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:47:18.015 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:47:18.015 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:47:18.016 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:18.017 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:47:18.038 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:2021-11-12T05:47:18.033+0000 7f316ab25080 -1 init, newargv = 0x55b42b18fe50 newargc=9 2021-11-12T05:47:18.039 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[14697]: starting ceph client 2021-11-12T05:47:18.054 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[14697]: starting fuse 2021-11-12T05:47:19.122 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:47:19.134 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:47:19.135 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:47:19.182 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:47:19.183 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:47:19.183 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:19.184 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:47:19.189 INFO:teuthology.orchestra.run.gibba016.stdout:52 2021-11-12T05:47:19.189 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-12T05:47:19.190 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:19.190 DEBUG:teuthology.orchestra.run.gibba016:> sudo python3 -c ' 2021-11-12T05:47:19.191 DEBUG:teuthology.orchestra.run.gibba016:> import glob 2021-11-12T05:47:19.191 DEBUG:teuthology.orchestra.run.gibba016:> import re 2021-11-12T05:47:19.191 DEBUG:teuthology.orchestra.run.gibba016:> import os 2021-11-12T05:47:19.192 DEBUG:teuthology.orchestra.run.gibba016:> import subprocess 2021-11-12T05:47:19.192 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:47:19.192 DEBUG:teuthology.orchestra.run.gibba016:> def find_socket(client_name): 2021-11-12T05:47:19.193 DEBUG:teuthology.orchestra.run.gibba016:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-12T05:47:19.193 DEBUG:teuthology.orchestra.run.gibba016:> files = glob.glob(asok_path) 2021-11-12T05:47:19.194 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:47:19.194 DEBUG:teuthology.orchestra.run.gibba016:> # Given a non-glob path, it better be there 2021-11-12T05:47:19.194 DEBUG:teuthology.orchestra.run.gibba016:> if "*" not in asok_path: 2021-11-12T05:47:19.195 DEBUG:teuthology.orchestra.run.gibba016:> assert(len(files) == 1) 2021-11-12T05:47:19.195 DEBUG:teuthology.orchestra.run.gibba016:> return files[0] 2021-11-12T05:47:19.195 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:47:19.196 DEBUG:teuthology.orchestra.run.gibba016:> for f in files: 2021-11-12T05:47:19.196 DEBUG:teuthology.orchestra.run.gibba016:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-12T05:47:19.197 DEBUG:teuthology.orchestra.run.gibba016:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-12T05:47:19.197 DEBUG:teuthology.orchestra.run.gibba016:> return f 2021-11-12T05:47:19.197 DEBUG:teuthology.orchestra.run.gibba016:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-12T05:47:19.198 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:47:19.198 DEBUG:teuthology.orchestra.run.gibba016:> print(find_socket("client.0")) 2021-11-12T05:47:19.199 DEBUG:teuthology.orchestra.run.gibba016:> ' 2021-11-12T05:47:19.255 INFO:teuthology.orchestra.run.gibba016.stdout:/var/run/ceph/ceph-client.0.14697.asok 2021-11-12T05:47:19.257 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14697.asok 2021-11-12T05:47:19.258 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:19.258 DEBUG:teuthology.orchestra.run.gibba016:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14697.asok status 2021-11-12T05:47:19.308 INFO:teuthology.orchestra.run.gibba016.stdout:{ 2021-11-12T05:47:19.308 INFO:teuthology.orchestra.run.gibba016.stdout: "metadata": { 2021-11-12T05:47:19.309 INFO:teuthology.orchestra.run.gibba016.stdout: "ceph_sha1": "a81ee2815de5acae59ead5b8c9137b6766fc8ea8", 2021-11-12T05:47:19.309 INFO:teuthology.orchestra.run.gibba016.stdout: "ceph_version": "ceph version 15.2.15-22-ga81ee281 (a81ee2815de5acae59ead5b8c9137b6766fc8ea8) octopus (stable)", 2021-11-12T05:47:19.309 INFO:teuthology.orchestra.run.gibba016.stdout: "entity_id": "0", 2021-11-12T05:47:19.309 INFO:teuthology.orchestra.run.gibba016.stdout: "hostname": "gibba016", 2021-11-12T05:47:19.310 INFO:teuthology.orchestra.run.gibba016.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-12T05:47:19.310 INFO:teuthology.orchestra.run.gibba016.stdout: "pid": "14697", 2021-11-12T05:47:19.310 INFO:teuthology.orchestra.run.gibba016.stdout: "root": "/" 2021-11-12T05:47:19.310 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:47:19.310 INFO:teuthology.orchestra.run.gibba016.stdout: "dentry_count": 0, 2021-11-12T05:47:19.311 INFO:teuthology.orchestra.run.gibba016.stdout: "dentry_pinned_count": 0, 2021-11-12T05:47:19.311 INFO:teuthology.orchestra.run.gibba016.stdout: "id": 4930, 2021-11-12T05:47:19.311 INFO:teuthology.orchestra.run.gibba016.stdout: "inst": { 2021-11-12T05:47:19.311 INFO:teuthology.orchestra.run.gibba016.stdout: "name": { 2021-11-12T05:47:19.311 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "client", 2021-11-12T05:47:19.312 INFO:teuthology.orchestra.run.gibba016.stdout: "num": 4930 2021-11-12T05:47:19.312 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:47:19.312 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": { 2021-11-12T05:47:19.312 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "v1", 2021-11-12T05:47:19.313 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": "172.21.2.116:0", 2021-11-12T05:47:19.313 INFO:teuthology.orchestra.run.gibba016.stdout: "nonce": 332215202 2021-11-12T05:47:19.313 INFO:teuthology.orchestra.run.gibba016.stdout: } 2021-11-12T05:47:19.313 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:47:19.313 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": { 2021-11-12T05:47:19.314 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "v1", 2021-11-12T05:47:19.314 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": "172.21.2.116:0", 2021-11-12T05:47:19.314 INFO:teuthology.orchestra.run.gibba016.stdout: "nonce": 332215202 2021-11-12T05:47:19.314 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:47:19.314 INFO:teuthology.orchestra.run.gibba016.stdout: "inst_str": "client.4930 172.21.2.116:0/332215202", 2021-11-12T05:47:19.315 INFO:teuthology.orchestra.run.gibba016.stdout: "addr_str": "172.21.2.116:0/332215202", 2021-11-12T05:47:19.315 INFO:teuthology.orchestra.run.gibba016.stdout: "inode_count": 1, 2021-11-12T05:47:19.315 INFO:teuthology.orchestra.run.gibba016.stdout: "mds_epoch": 31, 2021-11-12T05:47:19.315 INFO:teuthology.orchestra.run.gibba016.stdout: "osd_epoch": 76, 2021-11-12T05:47:19.316 INFO:teuthology.orchestra.run.gibba016.stdout: "osd_epoch_barrier": 0, 2021-11-12T05:47:19.316 INFO:teuthology.orchestra.run.gibba016.stdout: "blacklisted": false, 2021-11-12T05:47:19.316 INFO:teuthology.orchestra.run.gibba016.stdout: "fs_name": "cephfs" 2021-11-12T05:47:19.316 INFO:teuthology.orchestra.run.gibba016.stdout:} 2021-11-12T05:47:19.317 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:19.318 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:47:19.318 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:47:19.324 INFO:teuthology.orchestra.run.gibba016.stdout:fuseblk 2021-11-12T05:47:19.324 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-12T05:47:19.324 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:19.325 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:47:19.377 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-12T05:47:19.377 DEBUG:teuthology.orchestra.run.gibba005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:47:19.389 DEBUG:teuthology.orchestra.run.gibba015:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:47:19.402 DEBUG:teuthology.orchestra.run.gibba016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:47:19.413 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:47:19.427 DEBUG:teuthology.orchestra.run.gibba044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:47:19.440 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-12T05:47:19.441 INFO:tasks.cephfs.mount:Terminating background process 2021-11-12T05:47:19.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:19.442 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:47:19.442 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:47:19.448 INFO:teuthology.orchestra.run.gibba016.stdout:fuseblk 2021-11-12T05:47:19.449 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-12T05:47:19.449 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba016.front.sepia.ceph.com... 2021-11-12T05:47:19.449 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-12T05:47:19.450 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:47:19.510 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[14697]: fuse finished with error 0 and tester_r 0 2021-11-12T05:47:19.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:19.513 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:47:19.513 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:47:19.522 INFO:teuthology.orchestra.run.gibba016.stdout:ext2/ext3 2021-11-12T05:47:19.524 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-12T05:47:19.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:47:19.633 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:47:19.679 INFO:tasks.cephfs.mount:Terminating background process 2021-11-12T05:47:19.679 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:19.680 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:47:19.680 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:47:19.691 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-12T05:47:19.693 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-12T05:47:19.693 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba038.front.sepia.ceph.com... 2021-11-12T05:47:19.693 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-12T05:47:19.694 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:47:19.707 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:ceph-fuse[14153]: fuse finished with error 0 and tester_r 0 2021-11-12T05:47:19.708 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:19.709 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:47:19.709 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:47:19.713 INFO:teuthology.orchestra.run.gibba038.stdout:ext2/ext3 2021-11-12T05:47:19.714 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-12T05:47:19.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:47:19.826 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:47:19.871 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:19.872 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:47:19.872 DEBUG:teuthology.orchestra.run.gibba044:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:47:19.882 INFO:teuthology.orchestra.run.gibba044.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-12T05:47:19.882 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:47:19.883 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-12T05:47:19.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:47:19.884 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:47:19.893 INFO:teuthology.orchestra.run.gibba044.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-12T05:47:19.893 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:47:19.894 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-12T05:47:19.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.944+0000 7fbd5dd92700 1 Processor -- start 2021-11-12T05:47:19.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.944+0000 7fbd5dd92700 1 -- start start 2021-11-12T05:47:19.950 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.944+0000 7fbd5dd92700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fbd5813cab0 0x7fbd581435d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:19.950 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.944+0000 7fbd5dd92700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbd580aeea0 0x7fbd580b9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:19.950 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.944+0000 7fbd5dd92700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd580af3f0 con 0x7fbd580ba220 2021-11-12T05:47:19.951 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.944+0000 7fbd5dd92700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd58142e90 con 0x7fbd5813cab0 2021-11-12T05:47:19.951 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.944+0000 7fbd5dd92700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd58143130 con 0x7fbd580aeea0 2021-11-12T05:47:19.951 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.948+0000 7fbd57fff700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbd580aeea0 0x7fbd580b9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:19.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.948+0000 7fbd5cd90700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fbd5813cab0 0x7fbd581435d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:19.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.948+0000 7fbd5d591700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7fbd580ba220 0x7fbd581441e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:56706/0 (socket says 172.21.2.105:56706) 2021-11-12T05:47:19.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.948+0000 7fbd5d591700 1 -- 172.21.2.105:0/3340064046 learned_addr learned my addr 172.21.2.105:0/3340064046 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:19.953 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.948+0000 7fbd57fff700 1 -- 172.21.2.105:0/3340064046 >> v2:172.21.2.115:3300/0 conn(0x7fbd5813cab0 msgr2=0x7fbd581435d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:19.953 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.948+0000 7fbd57fff700 1 --2- 172.21.2.105:0/3340064046 >> v2:172.21.2.115:3300/0 conn(0x7fbd5813cab0 0x7fbd581435d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:19.953 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.948+0000 7fbd57fff700 1 -- 172.21.2.105:0/3340064046 >> v1:172.21.2.115:6789/0 conn(0x7fbd580ba220 legacy=0x7fbd581441e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:19.954 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.948+0000 7fbd57fff700 1 -- 172.21.2.105:0/3340064046 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd581448f0 con 0x7fbd580aeea0 2021-11-12T05:47:19.954 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.948+0000 7fbd5cd90700 1 --2- 172.21.2.105:0/3340064046 >> v2:172.21.2.115:3300/0 conn(0x7fbd5813cab0 0x7fbd581435d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-12T05:47:19.954 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.948+0000 7fbd57fff700 1 --2- 172.21.2.105:0/3340064046 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbd580aeea0 0x7fbd580b9d30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fbd4c002f70 tx=0x7fbd4c006df0).ready entity=mon.2 client_cookie=a68bf1acc121d963 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:19.957 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.948+0000 7fbd577fe700 1 -- 172.21.2.105:0/3340064046 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd4c00d570 con 0x7fbd580aeea0 2021-11-12T05:47:19.957 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.948+0000 7fbd577fe700 1 -- 172.21.2.105:0/3340064046 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4c000e90 con 0x7fbd580aeea0 2021-11-12T05:47:19.957 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.948+0000 7fbd577fe700 1 -- 172.21.2.105:0/3340064046 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd4c00d8c0 con 0x7fbd580aeea0 2021-11-12T05:47:19.957 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.948+0000 7fbd5dd92700 1 -- 172.21.2.105:0/3340064046 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbd580aeea0 msgr2=0x7fbd580b9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:19.958 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.948+0000 7fbd5dd92700 1 --2- 172.21.2.105:0/3340064046 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbd580aeea0 0x7fbd580b9d30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fbd4c002f70 tx=0x7fbd4c006df0).stop 2021-11-12T05:47:19.958 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.948+0000 7fbd5dd92700 1 -- 172.21.2.105:0/3340064046 shutdown_connections 2021-11-12T05:47:19.958 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.948+0000 7fbd5dd92700 1 --2- 172.21.2.105:0/3340064046 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbd580aeea0 0x7fbd580b9d30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:19.958 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.948+0000 7fbd5dd92700 1 --2- 172.21.2.105:0/3340064046 >> v2:172.21.2.115:3300/0 conn(0x7fbd5813cab0 0x7fbd581435d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:19.959 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.948+0000 7fbd5dd92700 1 -- 172.21.2.105:0/3340064046 >> 172.21.2.105:0/3340064046 conn(0x7fbd5805c490 msgr2=0x7fbd580b9620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:19.959 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.948+0000 7fbd5dd92700 1 -- 172.21.2.105:0/3340064046 shutdown_connections 2021-11-12T05:47:19.959 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.948+0000 7fbd5dd92700 1 -- 172.21.2.105:0/3340064046 wait complete. 2021-11-12T05:47:19.959 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.952+0000 7fbd5dd92700 1 Processor -- start 2021-11-12T05:47:19.959 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.952+0000 7fbd5dd92700 1 -- start start 2021-11-12T05:47:19.960 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.952+0000 7fbd5dd92700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbd580aeea0 0x7fbd58063800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:19.960 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.952+0000 7fbd5dd92700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbd580ba220 0x7fbd58156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:19.960 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.952+0000 7fbd5dd92700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbd5813cab0 0x7fbd58156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:19.960 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.952+0000 7fbd5dd92700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5813f5d0 con 0x7fbd580aeea0 2021-11-12T05:47:19.961 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.952+0000 7fbd5dd92700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5813f9e0 con 0x7fbd5813cab0 2021-11-12T05:47:19.961 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.952+0000 7fbd5dd92700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd58067350 con 0x7fbd580ba220 2021-11-12T05:47:19.961 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.952+0000 7fbd5cd90700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbd580aeea0 0x7fbd58063800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:19.961 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.952+0000 7fbd5cd90700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbd580aeea0 0x7fbd58063800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47846/0 (socket says 172.21.2.105:47846) 2021-11-12T05:47:19.961 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.952+0000 7fbd5cd90700 1 -- 172.21.2.105:0/2520986143 learned_addr learned my addr 172.21.2.105:0/2520986143 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:19.962 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.952+0000 7fbd5d591700 1 --2- 172.21.2.105:0/2520986143 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbd5813cab0 0x7fbd58156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:19.962 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.952+0000 7fbd57fff700 1 --2- 172.21.2.105:0/2520986143 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbd580ba220 0x7fbd58156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:19.962 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.952+0000 7fbd5cd90700 1 -- 172.21.2.105:0/2520986143 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbd580ba220 msgr2=0x7fbd58156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:19.962 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.952+0000 7fbd5cd90700 1 --2- 172.21.2.105:0/2520986143 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbd580ba220 0x7fbd58156a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:19.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.952+0000 7fbd5cd90700 1 -- 172.21.2.105:0/2520986143 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbd5813cab0 msgr2=0x7fbd58156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:19.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.952+0000 7fbd5cd90700 1 --2- 172.21.2.105:0/2520986143 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbd5813cab0 0x7fbd58156f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:19.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.952+0000 7fbd5cd90700 1 -- 172.21.2.105:0/2520986143 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4800b180 con 0x7fbd580aeea0 2021-11-12T05:47:19.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.952+0000 7fbd5cd90700 1 --2- 172.21.2.105:0/2520986143 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbd580aeea0 0x7fbd58063800 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7fbd4800c000 tx=0x7fbd48006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:19.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.952+0000 7fbd55ffb700 1 -- 172.21.2.105:0/2520986143 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd4800c860 con 0x7fbd580aeea0 2021-11-12T05:47:19.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.952+0000 7fbd55ffb700 1 -- 172.21.2.105:0/2520986143 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4800c9c0 con 0x7fbd580aeea0 2021-11-12T05:47:19.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.952+0000 7fbd5dd92700 1 -- 172.21.2.105:0/2520986143 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd4c00b180 con 0x7fbd580aeea0 2021-11-12T05:47:19.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.952+0000 7fbd5dd92700 1 -- 172.21.2.105:0/2520986143 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd58063d70 con 0x7fbd580aeea0 2021-11-12T05:47:19.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.952+0000 7fbd55ffb700 1 -- 172.21.2.105:0/2520986143 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd4800cd20 con 0x7fbd580aeea0 2021-11-12T05:47:19.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.952+0000 7fbd5dd92700 1 -- 172.21.2.105:0/2520986143 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd58057350 con 0x7fbd580aeea0 2021-11-12T05:47:19.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.952+0000 7fbd55ffb700 1 -- 172.21.2.105:0/2520986143 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbd4801c460 con 0x7fbd580aeea0 2021-11-12T05:47:19.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.952+0000 7fbd55ffb700 1 --2- 172.21.2.105:0/2520986143 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbd38053660 0x7fbd38055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:19.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.952+0000 7fbd55ffb700 1 -- 172.21.2.105:0/2520986143 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6459+0+0 (secure 0 0 0) 0x7fbd4806c0d0 con 0x7fbd580aeea0 2021-11-12T05:47:19.967 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.952+0000 7fbd57fff700 1 --2- 172.21.2.105:0/2520986143 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbd38053660 0x7fbd38055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:19.967 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.952+0000 7fbd57fff700 1 --2- 172.21.2.105:0/2520986143 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbd38053660 0x7fbd38055b20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7fbd4c018000 tx=0x7fbd4c014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:19.967 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:19.956+0000 7fbd55ffb700 1 -- 172.21.2.105:0/2520986143 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbd48043050 con 0x7fbd580aeea0 2021-11-12T05:47:20.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.040+0000 7fbd5dd92700 1 -- 172.21.2.105:0/2520986143 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fbd5813c890 con 0x7fbd580aeea0 2021-11-12T05:47:20.045 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.040+0000 7fbd55ffb700 1 -- 172.21.2.105:0/2520986143 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v76) v1 ==== 81+0+34116 (secure 0 0 0) 0x7fbd48046670 con 0x7fbd580aeea0 2021-11-12T05:47:20.046 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:20.046 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:47:20.046 INFO:teuthology.orchestra.run.gibba005.stdout: "epoch": 76, 2021-11-12T05:47:20.047 INFO:teuthology.orchestra.run.gibba005.stdout: "fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", 2021-11-12T05:47:20.047 INFO:teuthology.orchestra.run.gibba005.stdout: "created": "2021-11-12T05:40:19.986390+0000", 2021-11-12T05:47:20.047 INFO:teuthology.orchestra.run.gibba005.stdout: "modified": "2021-11-12T05:47:11.107473+0000", 2021-11-12T05:47:20.047 INFO:teuthology.orchestra.run.gibba005.stdout: "last_up_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:47:20.047 INFO:teuthology.orchestra.run.gibba005.stdout: "last_in_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:47:20.048 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-12T05:47:20.048 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_num": 5799936, 2021-11-12T05:47:20.048 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_set": [ 2021-11-12T05:47:20.048 INFO:teuthology.orchestra.run.gibba005.stdout: "pglog_hardlimit", 2021-11-12T05:47:20.049 INFO:teuthology.orchestra.run.gibba005.stdout: "purged_snapdirs", 2021-11-12T05:47:20.049 INFO:teuthology.orchestra.run.gibba005.stdout: "recovery_deletes", 2021-11-12T05:47:20.049 INFO:teuthology.orchestra.run.gibba005.stdout: "sortbitwise" 2021-11-12T05:47:20.049 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:47:20.050 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_version": 5, 2021-11-12T05:47:20.050 INFO:teuthology.orchestra.run.gibba005.stdout: "full_ratio": 0.94999998807907104, 2021-11-12T05:47:20.050 INFO:teuthology.orchestra.run.gibba005.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-12T05:47:20.050 INFO:teuthology.orchestra.run.gibba005.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-12T05:47:20.050 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_snapshot": "", 2021-11-12T05:47:20.051 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_max": 14, 2021-11-12T05:47:20.051 INFO:teuthology.orchestra.run.gibba005.stdout: "max_osd": 8, 2021-11-12T05:47:20.051 INFO:teuthology.orchestra.run.gibba005.stdout: "require_min_compat_client": "jewel", 2021-11-12T05:47:20.051 INFO:teuthology.orchestra.run.gibba005.stdout: "min_compat_client": "jewel", 2021-11-12T05:47:20.052 INFO:teuthology.orchestra.run.gibba005.stdout: "require_osd_release": "octopus", 2021-11-12T05:47:20.052 INFO:teuthology.orchestra.run.gibba005.stdout: "pools": [ 2021-11-12T05:47:20.052 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.052 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 1, 2021-11-12T05:47:20.052 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "device_health_metrics", 2021-11-12T05:47:20.053 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:22.022116+0000", 2021-11-12T05:47:20.053 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:47:20.053 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:47:20.053 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:47:20.054 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:47:20.054 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:47:20.054 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:47:20.054 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:47:20.054 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:47:20.055 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 1, 2021-11-12T05:47:20.055 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 1, 2021-11-12T05:47:20.055 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 1, 2021-11-12T05:47:20.055 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 1, 2021-11-12T05:47:20.055 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 1, 2021-11-12T05:47:20.056 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:47:20.056 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:47:20.056 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:47:20.056 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:47:20.057 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:47:20.057 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:47:20.057 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:47:20.057 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.057 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "16", 2021-11-12T05:47:20.058 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:47:20.058 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:47:20.058 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:47:20.058 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:47:20.059 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:47:20.059 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:47:20.059 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:47:20.059 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:47:20.059 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:47:20.060 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:47:20.060 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:47:20.060 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:47:20.060 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:47:20.060 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:47:20.061 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:47:20.061 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:47:20.061 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:47:20.061 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:47:20.062 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:47:20.062 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:47:20.062 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:47:20.062 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:47:20.062 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:47:20.063 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:47:20.063 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:47:20.063 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:47:20.063 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.064 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:47:20.064 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:47:20.064 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:47:20.064 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:47:20.064 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:47:20.065 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:47:20.065 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:47:20.065 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:47:20.065 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:47:20.065 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:47:20.066 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:47:20.066 INFO:teuthology.orchestra.run.gibba005.stdout: "options": { 2021-11-12T05:47:20.066 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_min": 1 2021-11-12T05:47:20.066 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.067 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:47:20.067 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr_devicehealth": {} 2021-11-12T05:47:20.067 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.067 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.067 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.068 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 2, 2021-11-12T05:47:20.068 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "rbd", 2021-11-12T05:47:20.068 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:29.953617+0000", 2021-11-12T05:47:20.068 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:47:20.069 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:47:20.069 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:47:20.069 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:47:20.069 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:47:20.069 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:47:20.070 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:47:20.070 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:47:20.070 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:47:20.070 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:47:20.071 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:47:20.071 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:47:20.071 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:47:20.071 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:47:20.071 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:47:20.072 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:47:20.072 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:47:20.072 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:47:20.072 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:47:20.073 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:47:20.073 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.073 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "19", 2021-11-12T05:47:20.073 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:47:20.073 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:47:20.074 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:47:20.074 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:47:20.074 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:47:20.074 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:47:20.075 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:47:20.075 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:47:20.075 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:47:20.075 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:47:20.076 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:47:20.076 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:47:20.076 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:47:20.076 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:47:20.076 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:47:20.077 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:47:20.077 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:47:20.077 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:47:20.077 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:47:20.077 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:47:20.078 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:47:20.078 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:47:20.078 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:47:20.078 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:47:20.079 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:47:20.079 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:47:20.079 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.079 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:47:20.079 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:47:20.080 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:47:20.080 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:47:20.080 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:47:20.080 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:47:20.081 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:47:20.081 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:47:20.081 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:47:20.081 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:47:20.081 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:47:20.082 INFO:teuthology.orchestra.run.gibba005.stdout: "options": {}, 2021-11-12T05:47:20.082 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:47:20.082 INFO:teuthology.orchestra.run.gibba005.stdout: "rbd": {} 2021-11-12T05:47:20.082 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.082 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.083 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.083 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 13, 2021-11-12T05:47:20.083 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "cephfs_metadata", 2021-11-12T05:47:20.083 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:46:27.277471+0000", 2021-11-12T05:47:20.084 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:47:20.084 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:47:20.084 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:47:20.084 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:47:20.084 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:47:20.085 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:47:20.085 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:47:20.085 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:47:20.085 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:47:20.086 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:47:20.086 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:47:20.086 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:47:20.086 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:47:20.086 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:47:20.087 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:47:20.087 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:47:20.087 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:47:20.087 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:47:20.088 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:47:20.088 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:47:20.088 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.088 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "74", 2021-11-12T05:47:20.088 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:47:20.089 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:47:20.089 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:47:20.089 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:47:20.089 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:47:20.089 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:47:20.090 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:47:20.090 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:47:20.090 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:47:20.090 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:47:20.091 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:47:20.091 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:47:20.091 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:47:20.091 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:47:20.091 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:47:20.092 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:47:20.092 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:47:20.092 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:47:20.092 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:47:20.093 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:47:20.093 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:47:20.093 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:47:20.093 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:47:20.093 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:47:20.094 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:47:20.094 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:47:20.094 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.094 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:47:20.095 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:47:20.095 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:47:20.095 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:47:20.095 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:47:20.095 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:47:20.096 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:47:20.096 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:47:20.096 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:47:20.096 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:47:20.097 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:47:20.097 INFO:teuthology.orchestra.run.gibba005.stdout: "options": { 2021-11-12T05:47:20.097 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_bias": 4, 2021-11-12T05:47:20.097 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_min": 16, 2021-11-12T05:47:20.097 INFO:teuthology.orchestra.run.gibba005.stdout: "recovery_priority": 5 2021-11-12T05:47:20.098 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.098 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:47:20.098 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs": { 2021-11-12T05:47:20.098 INFO:teuthology.orchestra.run.gibba005.stdout: "metadata": "cephfs" 2021-11-12T05:47:20.099 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.099 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.099 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.099 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.099 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 14, 2021-11-12T05:47:20.100 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "cephfs_data", 2021-11-12T05:47:20.100 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:46:28.337063+0000", 2021-11-12T05:47:20.100 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:47:20.100 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:47:20.101 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:47:20.101 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:47:20.101 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:47:20.101 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:47:20.101 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:47:20.102 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:47:20.102 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:47:20.102 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:47:20.102 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:47:20.103 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:47:20.103 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:47:20.103 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:47:20.103 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:47:20.103 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:47:20.104 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:47:20.104 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:47:20.104 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:47:20.104 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:47:20.105 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.105 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "75", 2021-11-12T05:47:20.105 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:47:20.105 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:47:20.105 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:47:20.106 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:47:20.106 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:47:20.106 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:47:20.106 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:47:20.107 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:47:20.107 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:47:20.107 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:47:20.107 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:47:20.107 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:47:20.108 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:47:20.108 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:47:20.108 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:47:20.108 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:47:20.108 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:47:20.109 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:47:20.109 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:47:20.109 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:47:20.109 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:47:20.110 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:47:20.110 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:47:20.110 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:47:20.110 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:47:20.110 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:47:20.111 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.111 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:47:20.111 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:47:20.111 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:47:20.111 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:47:20.112 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:47:20.112 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:47:20.112 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:47:20.112 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:47:20.113 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:47:20.113 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:47:20.113 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:47:20.113 INFO:teuthology.orchestra.run.gibba005.stdout: "options": {}, 2021-11-12T05:47:20.113 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:47:20.114 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs": { 2021-11-12T05:47:20.114 INFO:teuthology.orchestra.run.gibba005.stdout: "data": "cephfs" 2021-11-12T05:47:20.114 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.114 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.115 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.115 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:47:20.115 INFO:teuthology.orchestra.run.gibba005.stdout: "osds": [ 2021-11-12T05:47:20.115 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.115 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:47:20.116 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "ee8e30a0-4819-4475-80ec-dd3ee7d01322", 2021-11-12T05:47:20.116 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:20.116 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:20.116 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:20.116 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:20.117 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:20.117 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:20.117 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:20.117 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 72, 2021-11-12T05:47:20.118 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:20.118 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:20.118 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:20.118 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:20.119 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.119 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:20.119 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6802", 2021-11-12T05:47:20.119 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:20.120 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.120 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.120 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:20.120 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6803", 2021-11-12T05:47:20.121 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:20.121 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.121 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.121 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.122 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:20.122 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:20.122 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.122 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:20.122 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6804", 2021-11-12T05:47:20.123 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:20.123 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.123 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.123 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:20.123 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6805", 2021-11-12T05:47:20.124 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:20.124 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.124 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.124 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.125 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:20.125 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:20.125 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.125 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:20.125 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6808", 2021-11-12T05:47:20.126 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:20.126 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.126 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.126 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:20.127 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6809", 2021-11-12T05:47:20.127 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:20.127 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.127 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.127 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.128 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:20.128 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:20.128 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.128 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:20.129 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6806", 2021-11-12T05:47:20.129 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:20.129 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.129 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.129 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:20.130 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6807", 2021-11-12T05:47:20.130 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:20.130 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.130 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.131 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.131 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6803/14874", 2021-11-12T05:47:20.131 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6805/14874", 2021-11-12T05:47:20.131 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6809/14874", 2021-11-12T05:47:20.132 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6807/14874", 2021-11-12T05:47:20.132 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:20.132 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:20.133 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:20.133 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.133 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.133 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.134 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:47:20.134 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "b1bb06c3-26d0-4d92-82f8-b3e882242785", 2021-11-12T05:47:20.134 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:20.134 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:20.135 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:20.135 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:20.135 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:20.135 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:20.135 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:20.136 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 63, 2021-11-12T05:47:20.136 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:20.136 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:20.136 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:20.137 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:20.137 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.137 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:20.137 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6810", 2021-11-12T05:47:20.137 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:20.138 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.138 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.138 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:20.138 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6811", 2021-11-12T05:47:20.139 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:20.139 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.139 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.139 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.140 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:20.140 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:20.140 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.140 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:20.140 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6812", 2021-11-12T05:47:20.141 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:20.141 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.141 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.141 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:20.142 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6813", 2021-11-12T05:47:20.142 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:20.142 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.142 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.142 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.143 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:20.143 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:20.143 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.143 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:20.144 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6816", 2021-11-12T05:47:20.144 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:20.144 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.144 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.144 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:20.145 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6817", 2021-11-12T05:47:20.145 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:20.145 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.145 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.146 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.146 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:20.146 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:20.146 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.146 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:20.147 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6814", 2021-11-12T05:47:20.147 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:20.147 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.147 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.148 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:20.148 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6815", 2021-11-12T05:47:20.148 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:20.148 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.148 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.149 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.149 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6811/14875", 2021-11-12T05:47:20.149 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6813/14875", 2021-11-12T05:47:20.149 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6817/14875", 2021-11-12T05:47:20.150 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6815/14875", 2021-11-12T05:47:20.150 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:20.150 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:20.150 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:20.150 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.151 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.151 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.151 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:47:20.151 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "837b2c60-c335-4382-9f47-d86543a14022", 2021-11-12T05:47:20.152 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:20.152 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:20.152 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:20.152 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:20.152 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:20.153 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:20.153 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:20.153 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 72, 2021-11-12T05:47:20.153 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:20.154 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:20.154 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:20.154 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:20.154 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.154 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:20.155 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6818", 2021-11-12T05:47:20.155 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:20.155 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.155 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.155 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:20.156 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6819", 2021-11-12T05:47:20.156 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:20.156 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.156 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.157 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.157 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:20.157 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:20.157 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.158 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:20.158 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6820", 2021-11-12T05:47:20.158 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:20.158 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.158 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.159 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:20.159 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6821", 2021-11-12T05:47:20.159 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:20.159 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.160 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.160 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.160 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:20.160 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:20.160 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.161 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:20.161 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6824", 2021-11-12T05:47:20.161 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:20.161 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.162 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.162 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:20.162 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6825", 2021-11-12T05:47:20.162 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:20.162 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.163 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.163 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.163 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:20.163 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:20.164 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.164 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:20.164 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6822", 2021-11-12T05:47:20.164 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:20.165 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.165 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.165 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:20.165 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6823", 2021-11-12T05:47:20.165 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:20.166 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.166 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.166 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.166 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6819/14905", 2021-11-12T05:47:20.167 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6821/14905", 2021-11-12T05:47:20.167 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6825/14905", 2021-11-12T05:47:20.167 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6823/14905", 2021-11-12T05:47:20.167 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:20.167 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:20.168 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:20.168 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.168 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.168 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.168 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:47:20.169 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "eb2b737b-dda6-444b-a306-f33cbbd51f70", 2021-11-12T05:47:20.169 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:20.169 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:20.169 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:20.170 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:20.170 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:20.170 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:20.170 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:20.170 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 72, 2021-11-12T05:47:20.171 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:20.171 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:20.171 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:20.171 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:20.172 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.172 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:20.172 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6826", 2021-11-12T05:47:20.172 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:20.172 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.173 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.173 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:20.173 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6827", 2021-11-12T05:47:20.173 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:20.174 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.174 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.174 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.174 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:20.175 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:20.175 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.175 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:20.175 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6828", 2021-11-12T05:47:20.175 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:20.176 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.176 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.176 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:20.176 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6829", 2021-11-12T05:47:20.177 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:20.177 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.177 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.177 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.177 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:20.178 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:20.178 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.178 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:20.178 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6832", 2021-11-12T05:47:20.179 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:20.179 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.179 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.179 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:20.180 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6833", 2021-11-12T05:47:20.180 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:20.180 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.180 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.180 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.181 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:20.181 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:20.181 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.181 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:20.182 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6830", 2021-11-12T05:47:20.182 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:20.182 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.182 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.183 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:20.183 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6831", 2021-11-12T05:47:20.183 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:20.183 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.183 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.184 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.184 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6827/14876", 2021-11-12T05:47:20.184 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6829/14876", 2021-11-12T05:47:20.184 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6833/14876", 2021-11-12T05:47:20.184 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6831/14876", 2021-11-12T05:47:20.185 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:20.185 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:20.185 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:20.185 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.186 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.186 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.186 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:47:20.186 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "721529a1-c047-486a-a7ca-ddc15d80cdde", 2021-11-12T05:47:20.186 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:20.187 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:20.187 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:20.187 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:20.187 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:20.188 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:20.188 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:20.188 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 71, 2021-11-12T05:47:20.188 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:20.188 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:20.189 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:20.189 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:20.189 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.189 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:20.190 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6800", 2021-11-12T05:47:20.190 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:20.190 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.190 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.190 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:20.191 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6801", 2021-11-12T05:47:20.191 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:20.191 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.191 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.192 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.192 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:20.192 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:20.192 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.192 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:20.193 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6802", 2021-11-12T05:47:20.193 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:20.193 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.193 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.194 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:20.194 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6803", 2021-11-12T05:47:20.194 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:20.194 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.194 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.195 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.195 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:20.195 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:20.195 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.196 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:20.196 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6806", 2021-11-12T05:47:20.196 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:20.196 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.196 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.197 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:20.197 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6807", 2021-11-12T05:47:20.197 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:20.197 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.197 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.198 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.198 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:20.198 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:20.198 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.199 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:20.199 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6804", 2021-11-12T05:47:20.199 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:20.199 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.199 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.200 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:20.200 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6805", 2021-11-12T05:47:20.200 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:20.200 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.201 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.201 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.201 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6801/15096", 2021-11-12T05:47:20.201 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6803/15096", 2021-11-12T05:47:20.201 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6807/15096", 2021-11-12T05:47:20.202 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6805/15096", 2021-11-12T05:47:20.202 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:20.202 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:20.202 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:20.203 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.203 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.203 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.203 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:47:20.203 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "68b72ab2-fa82-4b5c-bf33-528f002e4950", 2021-11-12T05:47:20.204 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:20.204 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:20.204 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:20.204 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:20.204 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:20.205 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:20.205 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:20.205 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 72, 2021-11-12T05:47:20.205 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:20.206 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:20.206 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:20.206 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:20.206 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.206 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:20.207 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6808", 2021-11-12T05:47:20.207 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:20.207 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.207 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.207 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:20.208 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6809", 2021-11-12T05:47:20.208 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:20.208 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.208 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.209 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.209 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:20.209 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:20.209 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.209 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:20.210 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6810", 2021-11-12T05:47:20.210 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:20.210 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.210 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.210 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:20.211 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6811", 2021-11-12T05:47:20.211 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:20.211 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.211 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.212 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.212 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:20.212 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:20.212 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.212 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:20.213 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6814", 2021-11-12T05:47:20.213 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:20.213 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.213 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.214 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:20.214 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6815", 2021-11-12T05:47:20.214 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:20.214 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.214 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.215 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.215 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:20.215 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:20.215 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.216 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:20.216 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6812", 2021-11-12T05:47:20.216 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:20.216 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.216 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.217 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:20.217 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6813", 2021-11-12T05:47:20.217 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:20.217 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.217 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.218 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.218 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6809/15097", 2021-11-12T05:47:20.218 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6811/15097", 2021-11-12T05:47:20.218 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6815/15097", 2021-11-12T05:47:20.219 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6813/15097", 2021-11-12T05:47:20.219 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:20.219 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:20.219 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:20.220 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.220 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.220 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.220 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:47:20.220 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "a2c83b5d-8d37-4d30-ac04-30d89a76e485", 2021-11-12T05:47:20.221 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:20.221 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:20.221 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:20.221 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:20.221 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:20.222 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:20.222 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:20.222 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 72, 2021-11-12T05:47:20.222 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:20.223 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:20.223 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:20.223 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:20.223 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.224 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:20.224 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6816", 2021-11-12T05:47:20.224 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:20.224 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.224 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.225 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:20.225 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6817", 2021-11-12T05:47:20.225 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:20.225 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.226 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.226 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.226 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:20.226 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:20.227 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.227 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:20.227 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6818", 2021-11-12T05:47:20.227 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:20.228 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.228 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.228 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:20.228 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6819", 2021-11-12T05:47:20.228 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:20.229 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.229 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.229 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.229 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:20.229 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:20.230 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.230 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:20.230 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6822", 2021-11-12T05:47:20.230 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:20.231 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.231 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.231 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:20.231 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6823", 2021-11-12T05:47:20.231 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:20.232 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.232 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.232 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.232 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:20.233 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:20.233 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.233 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:20.233 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6820", 2021-11-12T05:47:20.233 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:20.234 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.234 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.234 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:20.234 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6821", 2021-11-12T05:47:20.235 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:20.235 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.235 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.235 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.235 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6817/15098", 2021-11-12T05:47:20.236 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6819/15098", 2021-11-12T05:47:20.236 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6823/15098", 2021-11-12T05:47:20.236 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6821/15098", 2021-11-12T05:47:20.236 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:20.236 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:20.237 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:20.237 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.237 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.237 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.238 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:47:20.238 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "786ce966-d0fb-4181-aed4-c26e3ef61c43", 2021-11-12T05:47:20.238 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:20.238 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:20.239 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:20.239 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:20.239 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:20.239 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:20.240 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:20.240 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 71, 2021-11-12T05:47:20.240 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:20.240 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:20.240 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:20.241 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:20.241 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.241 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:20.241 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6824", 2021-11-12T05:47:20.242 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:20.242 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.242 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.242 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:20.243 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6825", 2021-11-12T05:47:20.243 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:20.243 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.243 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.243 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.244 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:20.244 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:20.244 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.244 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:20.245 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6826", 2021-11-12T05:47:20.245 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:20.245 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.245 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.245 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:20.246 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6827", 2021-11-12T05:47:20.246 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:20.246 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.246 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.247 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.247 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:20.247 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:20.247 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.247 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:20.248 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6830", 2021-11-12T05:47:20.248 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:20.248 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.248 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.248 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:20.249 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6831", 2021-11-12T05:47:20.249 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:20.249 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.249 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.250 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.250 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:20.250 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:20.250 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.250 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:20.251 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6828", 2021-11-12T05:47:20.251 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:20.251 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.251 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.252 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:20.252 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6829", 2021-11-12T05:47:20.252 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:20.252 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.252 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.253 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.253 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6825/15099", 2021-11-12T05:47:20.253 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6827/15099", 2021-11-12T05:47:20.253 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6831/15099", 2021-11-12T05:47:20.254 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6829/15099", 2021-11-12T05:47:20.254 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:20.254 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:20.254 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:20.255 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:20.255 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.255 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:47:20.255 INFO:teuthology.orchestra.run.gibba005.stdout: "osd_xinfo": [ 2021-11-12T05:47:20.255 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.256 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:47:20.256 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:20.256 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:20.256 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:20.256 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:20.257 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:20.257 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.615112+0000", 2021-11-12T05:47:20.257 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:20.257 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.258 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.258 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:47:20.258 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:20.258 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:20.258 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:20.259 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:20.259 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:20.259 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.665935+0000", 2021-11-12T05:47:20.259 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:20.260 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.260 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.260 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:47:20.260 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:20.260 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:20.261 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:20.261 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:20.261 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:20.261 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.715877+0000", 2021-11-12T05:47:20.262 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:20.262 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.262 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.262 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:47:20.262 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:20.263 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:20.263 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:20.263 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:20.263 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:20.264 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.489234+0000", 2021-11-12T05:47:20.264 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:20.264 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.264 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.264 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:47:20.265 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:20.265 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:20.265 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:20.265 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:20.266 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:20.266 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.413776+0000", 2021-11-12T05:47:20.266 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:20.266 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.266 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.267 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:47:20.267 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:20.267 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:20.267 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:20.268 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:20.268 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:20.268 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.507960+0000", 2021-11-12T05:47:20.268 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:20.268 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.269 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.269 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:47:20.269 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:20.269 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:20.270 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:20.270 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:20.270 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:20.270 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.635696+0000", 2021-11-12T05:47:20.270 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:20.271 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.271 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:20.271 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:47:20.271 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:20.272 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:20.272 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:20.272 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:20.272 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:20.272 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.746949+0000", 2021-11-12T05:47:20.273 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:20.273 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.273 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:47:20.273 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap": [], 2021-11-12T05:47:20.274 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap_items": [], 2021-11-12T05:47:20.274 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_temp": [], 2021-11-12T05:47:20.274 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_temp": [], 2021-11-12T05:47:20.274 INFO:teuthology.orchestra.run.gibba005.stdout: "blacklist": { 2021-11-12T05:47:20.274 INFO:teuthology.orchestra.run.gibba005.stdout: "172.21.2.116:0/3516388082": "2021-11-12T06:47:10.201211+0000" 2021-11-12T05:47:20.275 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.275 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profiles": { 2021-11-12T05:47:20.275 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs_data": { 2021-11-12T05:47:20.275 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-device-class": "", 2021-11-12T05:47:20.276 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:47:20.276 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-root": "default", 2021-11-12T05:47:20.276 INFO:teuthology.orchestra.run.gibba005.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-12T05:47:20.276 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:47:20.276 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "2", 2021-11-12T05:47:20.277 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:47:20.277 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:47:20.277 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van", 2021-11-12T05:47:20.277 INFO:teuthology.orchestra.run.gibba005.stdout: "w": "8" 2021-11-12T05:47:20.278 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.278 INFO:teuthology.orchestra.run.gibba005.stdout: "default": { 2021-11-12T05:47:20.278 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:47:20.278 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:47:20.278 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "1", 2021-11-12T05:47:20.279 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:47:20.279 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:47:20.279 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van" 2021-11-12T05:47:20.279 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:20.280 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:20.280 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps_queue": [], 2021-11-12T05:47:20.280 INFO:teuthology.orchestra.run.gibba005.stdout: "new_removed_snaps": [], 2021-11-12T05:47:20.280 INFO:teuthology.orchestra.run.gibba005.stdout: "new_purged_snaps": [], 2021-11-12T05:47:20.280 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_node_flags": {}, 2021-11-12T05:47:20.281 INFO:teuthology.orchestra.run.gibba005.stdout: "device_class_flags": {} 2021-11-12T05:47:20.281 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:47:20.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.040+0000 7fbd5dd92700 1 -- 172.21.2.105:0/2520986143 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbd38053660 msgr2=0x7fbd38055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:20.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.040+0000 7fbd5dd92700 1 --2- 172.21.2.105:0/2520986143 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbd38053660 0x7fbd38055b20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7fbd4c018000 tx=0x7fbd4c014000).stop 2021-11-12T05:47:20.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.040+0000 7fbd5dd92700 1 -- 172.21.2.105:0/2520986143 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbd580aeea0 msgr2=0x7fbd58063800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:20.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.040+0000 7fbd5dd92700 1 --2- 172.21.2.105:0/2520986143 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbd580aeea0 0x7fbd58063800 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7fbd4800c000 tx=0x7fbd48006df0).stop 2021-11-12T05:47:20.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.040+0000 7fbd5dd92700 1 -- 172.21.2.105:0/2520986143 shutdown_connections 2021-11-12T05:47:20.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.040+0000 7fbd5dd92700 1 --2- 172.21.2.105:0/2520986143 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbd38053660 0x7fbd38055b20 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:20.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.040+0000 7fbd5dd92700 1 --2- 172.21.2.105:0/2520986143 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbd5813cab0 0x7fbd58156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:20.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.040+0000 7fbd5dd92700 1 --2- 172.21.2.105:0/2520986143 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbd580ba220 0x7fbd58156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:20.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.040+0000 7fbd5dd92700 1 --2- 172.21.2.105:0/2520986143 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbd580aeea0 0x7fbd58063800 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:20.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.040+0000 7fbd5dd92700 1 -- 172.21.2.105:0/2520986143 >> 172.21.2.105:0/2520986143 conn(0x7fbd5805c490 msgr2=0x7fbd581441e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:20.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.040+0000 7fbd5dd92700 1 -- 172.21.2.105:0/2520986143 shutdown_connections 2021-11-12T05:47:20.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.040+0000 7fbd5dd92700 1 -- 172.21.2.105:0/2520986143 wait complete. 2021-11-12T05:47:20.286 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:47:20.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.336+0000 7f5c36b44700 1 Processor -- start 2021-11-12T05:47:20.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.336+0000 7f5c36b44700 1 -- start start 2021-11-12T05:47:20.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.336+0000 7f5c36b44700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f5c300ad080 0x7f5c300af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:20.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.336+0000 7f5c36b44700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f5c300ac280 0x7f5c300ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:20.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.336+0000 7f5c36b44700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5c3014abe0 0x7f5c3014b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:20.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.336+0000 7f5c36b44700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c301488a0 con 0x7f5c300ad080 2021-11-12T05:47:20.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.336+0000 7f5c36b44700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c300ac7b0 con 0x7f5c300ac280 2021-11-12T05:47:20.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.336+0000 7f5c36b44700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c300ac9e0 con 0x7f5c3014abe0 2021-11-12T05:47:20.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.336+0000 7f5c348e0700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f5c300ad080 0x7f5c300af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:20.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.336+0000 7f5c348e0700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f5c300ad080 0x7f5c300af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47850/0 (socket says 172.21.2.105:47850) 2021-11-12T05:47:20.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.336+0000 7f5c348e0700 1 -- 172.21.2.105:0/3443014513 learned_addr learned my addr 172.21.2.105:0/3443014513 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:20.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.336+0000 7f5c348e0700 1 -- 172.21.2.105:0/3443014513 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5c3014abe0 msgr2=0x7f5c3014b090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:47:20.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.336+0000 7f5c348e0700 1 --2- 172.21.2.105:0/3443014513 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5c3014abe0 0x7f5c3014b090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:20.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.336+0000 7f5c348e0700 1 -- 172.21.2.105:0/3443014513 >> v2:172.21.2.115:3300/0 conn(0x7f5c300ac280 msgr2=0x7f5c300ad460 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:47:20.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.336+0000 7f5c348e0700 1 --2- 172.21.2.105:0/3443014513 >> v2:172.21.2.115:3300/0 conn(0x7f5c300ac280 0x7f5c300ad460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:20.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.340+0000 7f5c348e0700 1 -- 172.21.2.105:0/3443014513 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c300b0b30 con 0x7f5c300ad080 2021-11-12T05:47:20.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.340+0000 7f5c348e0700 1 --2- 172.21.2.105:0/3443014513 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c300ad080 0x7f5c300af730 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7f5c300ac6a0 tx=0x7f5c18006eb0).ready entity=mon.0 client_cookie=988becf132b47a54 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:20.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.340+0000 7f5c2f7fe700 1 -- 172.21.2.105:0/3443014513 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c1800d570 con 0x7f5c300ad080 2021-11-12T05:47:20.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.340+0000 7f5c2f7fe700 1 -- 172.21.2.105:0/3443014513 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c18000e90 con 0x7f5c300ad080 2021-11-12T05:47:20.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.340+0000 7f5c2f7fe700 1 -- 172.21.2.105:0/3443014513 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c1800d8c0 con 0x7f5c300ad080 2021-11-12T05:47:20.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.340+0000 7f5c36b44700 1 -- 172.21.2.105:0/3443014513 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c300ad080 msgr2=0x7f5c300af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:20.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.340+0000 7f5c36b44700 1 --2- 172.21.2.105:0/3443014513 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c300ad080 0x7f5c300af730 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7f5c300ac6a0 tx=0x7f5c18006eb0).stop 2021-11-12T05:47:20.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.340+0000 7f5c36b44700 1 -- 172.21.2.105:0/3443014513 shutdown_connections 2021-11-12T05:47:20.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.340+0000 7f5c36b44700 1 --2- 172.21.2.105:0/3443014513 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5c3014abe0 0x7f5c3014b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:20.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.340+0000 7f5c36b44700 1 --2- 172.21.2.105:0/3443014513 >> v2:172.21.2.115:3300/0 conn(0x7f5c300ac280 0x7f5c300ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:20.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.340+0000 7f5c36b44700 1 --2- 172.21.2.105:0/3443014513 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c300ad080 0x7f5c300af730 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:20.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.340+0000 7f5c36b44700 1 -- 172.21.2.105:0/3443014513 >> 172.21.2.105:0/3443014513 conn(0x7f5c300b5370 msgr2=0x7f5c300b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:20.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.340+0000 7f5c36b44700 1 -- 172.21.2.105:0/3443014513 shutdown_connections 2021-11-12T05:47:20.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.340+0000 7f5c36b44700 1 -- 172.21.2.105:0/3443014513 wait complete. 2021-11-12T05:47:20.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.340+0000 7f5c36b44700 1 Processor -- start 2021-11-12T05:47:20.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.340+0000 7f5c36b44700 1 -- start start 2021-11-12T05:47:20.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.340+0000 7f5c36b44700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5c300ac280 0x7f5c300a9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:20.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.340+0000 7f5c36b44700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5c300ad080 0x7f5c30140810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:20.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.340+0000 7f5c36b44700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c3014abe0 0x7f5c30140d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:20.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.340+0000 7f5c36b44700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c300aa0b0 con 0x7f5c3014abe0 2021-11-12T05:47:20.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.340+0000 7f5c36b44700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c300a89a0 con 0x7f5c300ad080 2021-11-12T05:47:20.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.340+0000 7f5c36b44700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c300a7b70 con 0x7f5c300ac280 2021-11-12T05:47:20.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.340+0000 7f5c350e1700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c3014abe0 0x7f5c30140d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:20.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.340+0000 7f5c350e1700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c3014abe0 0x7f5c30140d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47860/0 (socket says 172.21.2.105:47860) 2021-11-12T05:47:20.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.340+0000 7f5c350e1700 1 -- 172.21.2.105:0/1946328382 learned_addr learned my addr 172.21.2.105:0/1946328382 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:20.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.340+0000 7f5c350e1700 1 -- 172.21.2.105:0/1946328382 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5c300ac280 msgr2=0x7f5c300a9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:20.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.340+0000 7f5c350e1700 1 --2- 172.21.2.105:0/1946328382 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5c300ac280 0x7f5c300a9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:20.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.340+0000 7f5c350e1700 1 -- 172.21.2.105:0/1946328382 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5c300ad080 msgr2=0x7f5c30140810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:20.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.340+0000 7f5c350e1700 1 --2- 172.21.2.105:0/1946328382 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5c300ad080 0x7f5c30140810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:20.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.340+0000 7f5c350e1700 1 -- 172.21.2.105:0/1946328382 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c1800b1e0 con 0x7f5c3014abe0 2021-11-12T05:47:20.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.340+0000 7f5c350e1700 1 --2- 172.21.2.105:0/1946328382 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c3014abe0 0x7f5c30140d00 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7f5c28001250 tx=0x7f5c280090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:20.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.340+0000 7f5c2dffb700 1 -- 172.21.2.105:0/1946328382 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c280014e0 con 0x7f5c3014abe0 2021-11-12T05:47:20.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.340+0000 7f5c2dffb700 1 -- 172.21.2.105:0/1946328382 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c28001640 con 0x7f5c3014abe0 2021-11-12T05:47:20.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.340+0000 7f5c36b44700 1 -- 172.21.2.105:0/1946328382 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c300a8bd0 con 0x7f5c3014abe0 2021-11-12T05:47:20.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.340+0000 7f5c2dffb700 1 -- 172.21.2.105:0/1946328382 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c280019a0 con 0x7f5c3014abe0 2021-11-12T05:47:20.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.340+0000 7f5c36b44700 1 -- 172.21.2.105:0/1946328382 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c301411f0 con 0x7f5c3014abe0 2021-11-12T05:47:20.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.340+0000 7f5c36b44700 1 -- 172.21.2.105:0/1946328382 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c3014b580 con 0x7f5c3014abe0 2021-11-12T05:47:20.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.344+0000 7f5c2dffb700 1 -- 172.21.2.105:0/1946328382 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5c28018030 con 0x7f5c3014abe0 2021-11-12T05:47:20.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.344+0000 7f5c2dffb700 1 --2- 172.21.2.105:0/1946328382 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5c14053610 0x7f5c14055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:20.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.344+0000 7f5c2dffb700 1 -- 172.21.2.105:0/1946328382 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6459+0+0 (secure 0 0 0) 0x7f5c2806b530 con 0x7f5c3014abe0 2021-11-12T05:47:20.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.344+0000 7f5c348e0700 1 --2- 172.21.2.105:0/1946328382 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5c14053610 0x7f5c14055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:20.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.344+0000 7f5c348e0700 1 --2- 172.21.2.105:0/1946328382 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5c14053610 0x7f5c14055ad0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f5c300ac6a0 tx=0x7f5c18015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:20.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.344+0000 7f5c2dffb700 1 -- 172.21.2.105:0/1946328382 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5c280424b0 con 0x7f5c3014abe0 2021-11-12T05:47:20.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.452+0000 7f5c36b44700 1 -- 172.21.2.105:0/1946328382 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c30057350 con 0x7f5c3014abe0 2021-11-12T05:47:20.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.452+0000 7f5c2dffb700 1 -- 172.21.2.105:0/1946328382 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f5c28045ad0 con 0x7f5c3014abe0 2021-11-12T05:47:20.458 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:20.458 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":31,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/1423088351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":1423088351},{"type":"v1","addr":"172.21.2.115:6833","nonce":1423088351}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:46:29.372216+0000","modified":"2021-11-12T05:46:30.375936+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6309":{"gid":6309,"name":"a","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/1837795491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":1837795491},{"type":"v1","addr":"172.21.2.105:6835","nonce":1837795491}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-11-12T05:47:20.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.452+0000 7f5c36b44700 1 -- 172.21.2.105:0/1946328382 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5c14053610 msgr2=0x7f5c14055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:20.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.452+0000 7f5c36b44700 1 --2- 172.21.2.105:0/1946328382 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5c14053610 0x7f5c14055ad0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f5c300ac6a0 tx=0x7f5c18015000).stop 2021-11-12T05:47:20.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.452+0000 7f5c36b44700 1 -- 172.21.2.105:0/1946328382 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c3014abe0 msgr2=0x7f5c30140d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:20.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.452+0000 7f5c36b44700 1 --2- 172.21.2.105:0/1946328382 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c3014abe0 0x7f5c30140d00 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7f5c28001250 tx=0x7f5c280090f0).stop 2021-11-12T05:47:20.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.452+0000 7f5c36b44700 1 -- 172.21.2.105:0/1946328382 shutdown_connections 2021-11-12T05:47:20.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.452+0000 7f5c36b44700 1 --2- 172.21.2.105:0/1946328382 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5c14053610 0x7f5c14055ad0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:20.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.452+0000 7f5c36b44700 1 --2- 172.21.2.105:0/1946328382 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c3014abe0 0x7f5c30140d00 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:20.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.452+0000 7f5c36b44700 1 --2- 172.21.2.105:0/1946328382 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5c300ad080 0x7f5c30140810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:20.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.452+0000 7f5c36b44700 1 --2- 172.21.2.105:0/1946328382 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5c300ac280 0x7f5c300a9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:20.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.452+0000 7f5c36b44700 1 -- 172.21.2.105:0/1946328382 >> 172.21.2.105:0/1946328382 conn(0x7f5c300b5370 msgr2=0x7f5c300b49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:20.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.452+0000 7f5c36b44700 1 -- 172.21.2.105:0/1946328382 shutdown_connections 2021-11-12T05:47:20.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.452+0000 7f5c36b44700 1 -- 172.21.2.105:0/1946328382 wait complete. 2021-11-12T05:47:20.462 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 31 2021-11-12T05:47:20.465 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-12T05:47:20.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60e743b700 1 Processor -- start 2021-11-12T05:47:20.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60e743b700 1 -- start start 2021-11-12T05:47:20.521 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60e743b700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f60e0062b10 0x7f60e00b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:20.521 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60e743b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60e0140d70 0x7f60e01411c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:20.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60e743b700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e0064fd0 con 0x7f60e00b1230 2021-11-12T05:47:20.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60e743b700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e0063450 con 0x7f60e0062b10 2021-11-12T05:47:20.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60e743b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e00b0a80 con 0x7f60e0140d70 2021-11-12T05:47:20.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60e51d7700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f60e00b1230 0x7f60e013aa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:58260/0 (socket says 172.21.2.105:58260) 2021-11-12T05:47:20.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60e51d7700 1 -- 172.21.2.105:0/4205871872 learned_addr learned my addr 172.21.2.105:0/4205871872 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:20.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60d3fff700 1 -- 172.21.2.105:0/4205871872 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 823895962 0 0) 0x7f60e0064fd0 con 0x7f60e00b1230 2021-11-12T05:47:20.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60d3fff700 1 -- 172.21.2.105:0/4205871872 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60c8003260 con 0x7f60e00b1230 2021-11-12T05:47:20.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60d3fff700 1 -- 172.21.2.105:0/4205871872 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2534674673 0 0) 0x7f60c8003260 con 0x7f60e00b1230 2021-11-12T05:47:20.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60d3fff700 1 -- 172.21.2.105:0/4205871872 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60e0140d70 msgr2=0x7f60e01411c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:20.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60e59d8700 1 --2- 172.21.2.105:0/4205871872 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60e0140d70 0x7f60e01411c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:20.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60e49d6700 1 --2- 172.21.2.105:0/4205871872 >> v2:172.21.2.115:3300/0 conn(0x7f60e0062b10 0x7f60e00b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:20.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60d3fff700 1 --2- 172.21.2.105:0/4205871872 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60e0140d70 0x7f60e01411c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:20.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60d3fff700 1 -- 172.21.2.105:0/4205871872 >> v2:172.21.2.115:3300/0 conn(0x7f60e0062b10 msgr2=0x7f60e00b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:20.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60d3fff700 1 --2- 172.21.2.105:0/4205871872 >> v2:172.21.2.115:3300/0 conn(0x7f60e0062b10 0x7f60e00b1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:20.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60d3fff700 1 -- 172.21.2.105:0/4205871872 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e00b1b00 con 0x7f60e00b1230 2021-11-12T05:47:20.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60d3fff700 1 -- 172.21.2.105:0/4205871872 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f60d4001660 con 0x7f60e00b1230 2021-11-12T05:47:20.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60d3fff700 1 -- 172.21.2.105:0/4205871872 >> v1:172.21.2.105:6789/0 conn(0x7f60e00b1230 legacy=0x7f60e013aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:20.526 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60d3fff700 1 --2- 172.21.2.105:0/4205871872 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f60c80037d0 0x7f60c8003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:20.526 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60d3fff700 1 --2- 172.21.2.105:0/4205871872 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60c8004500 0x7f60c8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:20.526 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60d3fff700 1 --2- 172.21.2.105:0/4205871872 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60c8004f90 0x7f60c800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:20.526 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60d3fff700 1 -- 172.21.2.105:0/4205871872 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e0063450 con 0x7f60c8004f90 2021-11-12T05:47:20.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60d3fff700 1 -- 172.21.2.105:0/4205871872 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e00b0a80 con 0x7f60c80037d0 2021-11-12T05:47:20.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60d3fff700 1 -- 172.21.2.105:0/4205871872 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c800bed0 con 0x7f60c8004500 2021-11-12T05:47:20.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60e59d8700 1 --2- 172.21.2.105:0/4205871872 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60e0140d70 0x7f60e01411c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:47:20.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60e59d8700 1 --2- 172.21.2.105:0/4205871872 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60c8004f90 0x7f60c800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:20.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60e59d8700 1 -- 172.21.2.105:0/4205871872 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60c8004500 msgr2=0x7f60c8004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:20.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60e59d8700 1 --2- 172.21.2.105:0/4205871872 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60c8004500 0x7f60c8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:20.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60e59d8700 1 -- 172.21.2.105:0/4205871872 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f60c80037d0 msgr2=0x7f60c8003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:20.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60e59d8700 1 --2- 172.21.2.105:0/4205871872 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f60c80037d0 0x7f60c8003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:20.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60e59d8700 1 -- 172.21.2.105:0/4205871872 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e00b1b00 con 0x7f60c8004f90 2021-11-12T05:47:20.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60e59d8700 1 --2- 172.21.2.105:0/4205871872 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60c8004f90 0x7f60c800b750 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f60d8007000 tx=0x7f60d8008040).ready entity=mon.0 client_cookie=f6149f81af997022 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:20.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60d3fff700 1 -- 172.21.2.105:0/4205871872 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60d8015070 con 0x7f60c8004f90 2021-11-12T05:47:20.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60d3fff700 1 -- 172.21.2.105:0/4205871872 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d800c420 con 0x7f60c8004f90 2021-11-12T05:47:20.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60d3fff700 1 -- 172.21.2.105:0/4205871872 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60d800c780 con 0x7f60c8004f90 2021-11-12T05:47:20.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60e743b700 1 -- 172.21.2.105:0/4205871872 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60c8004f90 msgr2=0x7f60c800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:20.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60e743b700 1 --2- 172.21.2.105:0/4205871872 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60c8004f90 0x7f60c800b750 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f60d8007000 tx=0x7f60d8008040).stop 2021-11-12T05:47:20.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60e59d8700 1 -- 172.21.2.105:0/4205871872 reap_dead start 2021-11-12T05:47:20.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60e743b700 1 -- 172.21.2.105:0/4205871872 shutdown_connections 2021-11-12T05:47:20.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60e743b700 1 -- 172.21.2.105:0/4205871872 >> 172.21.2.105:0/4205871872 conn(0x7f60e00b5320 msgr2=0x7f60e00b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:20.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60e743b700 1 -- 172.21.2.105:0/4205871872 shutdown_connections 2021-11-12T05:47:20.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.512+0000 7f60e743b700 1 -- 172.21.2.105:0/4205871872 wait complete. 2021-11-12T05:47:20.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.516+0000 7f60e743b700 1 Processor -- start 2021-11-12T05:47:20.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.516+0000 7f60e743b700 1 -- start start 2021-11-12T05:47:20.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.516+0000 7f60e743b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60c8004f90 0x7f60e00b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:20.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.516+0000 7f60e743b700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f60e013c640 0x7f60e0155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:20.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.516+0000 7f60e743b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60e0156060 0x7f60e00ad270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:20.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.516+0000 7f60e743b700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e013d8f0 con 0x7f60c8004f90 2021-11-12T05:47:20.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.516+0000 7f60e743b700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e013b480 con 0x7f60e013c640 2021-11-12T05:47:20.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.516+0000 7f60e743b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e013d610 con 0x7f60e0156060 2021-11-12T05:47:20.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.516+0000 7f60e51d7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60c8004f90 0x7f60e00b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:20.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.516+0000 7f60e51d7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60c8004f90 0x7f60e00b3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47876/0 (socket says 172.21.2.105:47876) 2021-11-12T05:47:20.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.516+0000 7f60e51d7700 1 -- 172.21.2.105:0/2819277649 learned_addr learned my addr 172.21.2.105:0/2819277649 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:20.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.516+0000 7f60e51d7700 1 -- 172.21.2.105:0/2819277649 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60e0156060 msgr2=0x7f60e00ad270 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:47:20.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.516+0000 7f60e51d7700 1 --2- 172.21.2.105:0/2819277649 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60e0156060 0x7f60e00ad270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:20.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.516+0000 7f60e51d7700 1 -- 172.21.2.105:0/2819277649 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f60e013c640 msgr2=0x7f60e0155b70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:47:20.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.516+0000 7f60e51d7700 1 --2- 172.21.2.105:0/2819277649 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f60e013c640 0x7f60e0155b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:20.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.516+0000 7f60e51d7700 1 -- 172.21.2.105:0/2819277649 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e013bd20 con 0x7f60c8004f90 2021-11-12T05:47:20.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.516+0000 7f60e51d7700 1 --2- 172.21.2.105:0/2819277649 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60c8004f90 0x7f60e00b3e80 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7f60d4001370 tx=0x7f60d4001b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:20.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.516+0000 7f60d27fc700 1 -- 172.21.2.105:0/2819277649 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60d4007170 con 0x7f60c8004f90 2021-11-12T05:47:20.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.516+0000 7f60d27fc700 1 -- 172.21.2.105:0/2819277649 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d40072d0 con 0x7f60c8004f90 2021-11-12T05:47:20.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.516+0000 7f60d27fc700 1 -- 172.21.2.105:0/2819277649 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60d4004920 con 0x7f60c8004f90 2021-11-12T05:47:20.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.516+0000 7f60e743b700 1 -- 172.21.2.105:0/2819277649 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e013b920 con 0x7f60c8004f90 2021-11-12T05:47:20.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.516+0000 7f60e743b700 1 -- 172.21.2.105:0/2819277649 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e013c3b0 con 0x7f60c8004f90 2021-11-12T05:47:20.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.516+0000 7f60e743b700 1 -- 172.21.2.105:0/2819277649 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e0156850 con 0x7f60c8004f90 2021-11-12T05:47:20.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.516+0000 7f60d27fc700 1 -- 172.21.2.105:0/2819277649 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f60d4010070 con 0x7f60c8004f90 2021-11-12T05:47:20.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.516+0000 7f60d27fc700 1 --2- 172.21.2.105:0/2819277649 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f60c0053690 0x7f60c0055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:20.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.516+0000 7f60d27fc700 1 -- 172.21.2.105:0/2819277649 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6459+0+0 (secure 0 0 0) 0x7f60d406b970 con 0x7f60c8004f90 2021-11-12T05:47:20.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.516+0000 7f60e49d6700 1 --2- 172.21.2.105:0/2819277649 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f60c0053690 0x7f60c0055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:20.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.516+0000 7f60e49d6700 1 --2- 172.21.2.105:0/2819277649 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f60c0053690 0x7f60c0055b50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f60dc007000 tx=0x7f60dc008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:20.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.520+0000 7f60d27fc700 1 -- 172.21.2.105:0/2819277649 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f60d4042840 con 0x7f60c8004f90 2021-11-12T05:47:20.630 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:20.624+0000 7f60e743b700 1 -- 172.21.2.105:0/2819277649 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f60e013b640 con 0x7f60c8004f90 2021-11-12T05:47:21.117 INFO:tasks.ceph.mon.a.gibba005.stderr:2021-11-12T05:47:21.112+0000 7fe9772b2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-12T05:47:21.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.124+0000 7f60d27fc700 1 -- 172.21.2.105:0/2819277649 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v32) v1 ==== 161+0+0 (secure 0 0 0) 0x7f60d4045e60 con 0x7f60c8004f90 2021-11-12T05:47:21.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.128+0000 7f60e743b700 1 -- 172.21.2.105:0/2819277649 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f60c0053690 msgr2=0x7f60c0055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:21.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.128+0000 7f60e743b700 1 --2- 172.21.2.105:0/2819277649 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f60c0053690 0x7f60c0055b50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f60dc007000 tx=0x7f60dc008040).stop 2021-11-12T05:47:21.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.128+0000 7f60e743b700 1 -- 172.21.2.105:0/2819277649 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60c8004f90 msgr2=0x7f60e00b3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:21.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.128+0000 7f60e743b700 1 --2- 172.21.2.105:0/2819277649 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60c8004f90 0x7f60e00b3e80 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7f60d4001370 tx=0x7f60d4001b50).stop 2021-11-12T05:47:21.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.128+0000 7f60e743b700 1 -- 172.21.2.105:0/2819277649 shutdown_connections 2021-11-12T05:47:21.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.128+0000 7f60e743b700 1 --2- 172.21.2.105:0/2819277649 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f60c0053690 0x7f60c0055b50 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:21.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.128+0000 7f60e743b700 1 --2- 172.21.2.105:0/2819277649 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60e0156060 0x7f60e00ad270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:21.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.128+0000 7f60e743b700 1 --2- 172.21.2.105:0/2819277649 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f60e013c640 0x7f60e0155b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:21.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.128+0000 7f60e743b700 1 --2- 172.21.2.105:0/2819277649 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60c8004f90 0x7f60e00b3e80 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:21.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.128+0000 7f60e743b700 1 -- 172.21.2.105:0/2819277649 >> 172.21.2.105:0/2819277649 conn(0x7f60e00b5320 msgr2=0x7f60e01389c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:21.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.128+0000 7f60e743b700 1 -- 172.21.2.105:0/2819277649 shutdown_connections 2021-11-12T05:47:21.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.128+0000 7f60e743b700 1 -- 172.21.2.105:0/2819277649 wait complete. 2021-11-12T05:47:21.134 INFO:teuthology.orchestra.run.gibba005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-12T05:47:21.138 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:47:21.146 INFO:tasks.ceph.mds.a.gibba005.stdout:starting mds.a at 2021-11-12T05:47:21.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.184+0000 7f811e2ed700 1 Processor -- start 2021-11-12T05:47:21.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.184+0000 7f811e2ed700 1 -- start start 2021-11-12T05:47:21.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.184+0000 7f811e2ed700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f8118060100 0x7f8118144310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:21.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.184+0000 7f811e2ed700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81180b2aa0 con 0x7f8118144f10 2021-11-12T05:47:21.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.184+0000 7f811e2ed700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81180b3170 con 0x7f81180ae2a0 2021-11-12T05:47:21.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.184+0000 7f811e2ed700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81180604e0 con 0x7f8118060100 2021-11-12T05:47:21.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.184+0000 7f811daec700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f8118144f10 0x7f811814a940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:58292/0 (socket says 172.21.2.105:58292) 2021-11-12T05:47:21.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.184+0000 7f811daec700 1 -- 172.21.2.105:0/2565633172 learned_addr learned my addr 172.21.2.105:0/2565633172 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:21.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.184+0000 7f8107fff700 1 -- 172.21.2.105:0/2565633172 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 455278454 0 0) 0x7f81180b2aa0 con 0x7f8118144f10 2021-11-12T05:47:21.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.184+0000 7f8107fff700 1 -- 172.21.2.105:0/2565633172 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8100003260 con 0x7f8118144f10 2021-11-12T05:47:21.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.184+0000 7f811d2eb700 1 --2- 172.21.2.105:0/2565633172 >> v2:172.21.2.115:3300/0 conn(0x7f8118060100 0x7f8118144310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:21.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.184+0000 7f8107fff700 1 -- 172.21.2.105:0/2565633172 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2812510003 0 0) 0x7f8100003260 con 0x7f8118144f10 2021-11-12T05:47:21.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.184+0000 7f8107fff700 1 -- 172.21.2.105:0/2565633172 >> v2:172.21.2.115:3300/0 conn(0x7f8118060100 msgr2=0x7f8118144310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:21.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.184+0000 7f8107fff700 1 --2- 172.21.2.105:0/2565633172 >> v2:172.21.2.115:3300/0 conn(0x7f8118060100 0x7f8118144310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:21.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.184+0000 7f8107fff700 1 -- 172.21.2.105:0/2565633172 >> v1:172.21.2.115:6789/0 conn(0x7f81180ae2a0 legacy=0x7f8118144800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:21.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.184+0000 7f8107fff700 1 -- 172.21.2.105:0/2565633172 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8118066230 con 0x7f8118144f10 2021-11-12T05:47:21.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.184+0000 7f8107fff700 1 -- 172.21.2.105:0/2565633172 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f81100019e0 con 0x7f8118144f10 2021-11-12T05:47:21.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.184+0000 7f8107fff700 1 -- 172.21.2.105:0/2565633172 >> v1:172.21.2.105:6789/0 conn(0x7f8118144f10 legacy=0x7f811814a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:21.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.184+0000 7f8107fff700 1 --2- 172.21.2.105:0/2565633172 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8100003750 0x7f8100003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:21.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.184+0000 7f8107fff700 1 --2- 172.21.2.105:0/2565633172 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8100004500 0x7f8100004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:21.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.184+0000 7f8107fff700 1 --2- 172.21.2.105:0/2565633172 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8100004ec0 0x7f810000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:21.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.184+0000 7f8107fff700 1 -- 172.21.2.105:0/2565633172 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81180604e0 con 0x7f8100004500 2021-11-12T05:47:21.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.184+0000 7f8107fff700 1 -- 172.21.2.105:0/2565633172 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810000bd80 con 0x7f8100003750 2021-11-12T05:47:21.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.184+0000 7f8107fff700 1 -- 172.21.2.105:0/2565633172 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810000bf40 con 0x7f8100004ec0 2021-11-12T05:47:21.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.184+0000 7f811caea700 1 --2- 172.21.2.105:0/2565633172 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8100004500 0x7f8100004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:21.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f811caea700 1 -- 172.21.2.105:0/2565633172 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8100004ec0 msgr2=0x7f810000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:21.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f811caea700 1 --2- 172.21.2.105:0/2565633172 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8100004ec0 0x7f810000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:21.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f811caea700 1 -- 172.21.2.105:0/2565633172 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8100003750 msgr2=0x7f8100003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:21.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f811caea700 1 --2- 172.21.2.105:0/2565633172 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8100003750 0x7f8100003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:21.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f811daec700 1 -- 172.21.2.105:0/2565633172 reap_dead start 2021-11-12T05:47:21.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f811caea700 1 -- 172.21.2.105:0/2565633172 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8100003260 con 0x7f8100004500 2021-11-12T05:47:21.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f811caea700 1 --2- 172.21.2.105:0/2565633172 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8100004500 0x7f8100004980 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7f8108001fa0 tx=0x7f8108007a00).ready entity=mon.0 client_cookie=d1ea1c447a26a11c server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:21.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f8107fff700 1 -- 172.21.2.105:0/2565633172 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8108007070 con 0x7f8100004500 2021-11-12T05:47:21.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f8107fff700 1 -- 172.21.2.105:0/2565633172 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81080071d0 con 0x7f8100004500 2021-11-12T05:47:21.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f8107fff700 1 -- 172.21.2.105:0/2565633172 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8108006510 con 0x7f8100004500 2021-11-12T05:47:21.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f811e2ed700 1 -- 172.21.2.105:0/2565633172 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8100004500 msgr2=0x7f8100004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:21.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f811e2ed700 1 --2- 172.21.2.105:0/2565633172 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8100004500 0x7f8100004980 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7f8108001fa0 tx=0x7f8108007a00).stop 2021-11-12T05:47:21.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f811e2ed700 1 -- 172.21.2.105:0/2565633172 shutdown_connections 2021-11-12T05:47:21.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f811e2ed700 1 --2- 172.21.2.105:0/2565633172 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8100004500 0x7f8100004980 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:21.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f811e2ed700 1 -- 172.21.2.105:0/2565633172 >> 172.21.2.105:0/2565633172 conn(0x7f81180608d0 msgr2=0x7f811805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:21.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f811e2ed700 1 -- 172.21.2.105:0/2565633172 shutdown_connections 2021-11-12T05:47:21.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f811e2ed700 1 -- 172.21.2.105:0/2565633172 wait complete. 2021-11-12T05:47:21.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f811e2ed700 1 Processor -- start 2021-11-12T05:47:21.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f811e2ed700 1 -- start start 2021-11-12T05:47:21.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f811e2ed700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8100004500 0x7f8118145b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:21.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f811e2ed700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f81181441b0 0x7f811814ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:21.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f811e2ed700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f81180ae7d0 0x7f81181539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:21.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f811e2ed700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8118153590 con 0x7f8100004500 2021-11-12T05:47:21.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f811e2ed700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8118111180 con 0x7f81181441b0 2021-11-12T05:47:21.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f811e2ed700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8118111420 con 0x7f81180ae7d0 2021-11-12T05:47:21.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f811d2eb700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8100004500 0x7f8118145b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:21.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f811d2eb700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8100004500 0x7f8118145b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47908/0 (socket says 172.21.2.105:47908) 2021-11-12T05:47:21.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f811d2eb700 1 -- 172.21.2.105:0/2163099892 learned_addr learned my addr 172.21.2.105:0/2163099892 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:21.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f811caea700 1 --2- 172.21.2.105:0/2163099892 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f81181441b0 0x7f811814ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:21.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f811daec700 1 --2- 172.21.2.105:0/2163099892 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f81180ae7d0 0x7f81181539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:21.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f811d2eb700 1 -- 172.21.2.105:0/2163099892 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f81180ae7d0 msgr2=0x7f81181539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:21.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f811d2eb700 1 --2- 172.21.2.105:0/2163099892 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f81180ae7d0 0x7f81181539c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:21.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f811d2eb700 1 -- 172.21.2.105:0/2163099892 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f81181441b0 msgr2=0x7f811814ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:21.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f811d2eb700 1 --2- 172.21.2.105:0/2163099892 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f81181441b0 0x7f811814ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:21.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f811d2eb700 1 -- 172.21.2.105:0/2163099892 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81181436d0 con 0x7f8100004500 2021-11-12T05:47:21.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f811caea700 1 --2- 172.21.2.105:0/2163099892 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f81181441b0 0x7f811814ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:47:21.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f811d2eb700 1 --2- 172.21.2.105:0/2163099892 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8100004500 0x7f8118145b70 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7f811400a000 tx=0x7f8114008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:21.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f81067fc700 1 -- 172.21.2.105:0/2163099892 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8114016070 con 0x7f8100004500 2021-11-12T05:47:21.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f81067fc700 1 -- 172.21.2.105:0/2163099892 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8114000e90 con 0x7f8100004500 2021-11-12T05:47:21.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f811e2ed700 1 -- 172.21.2.105:0/2163099892 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8118153eb0 con 0x7f8100004500 2021-11-12T05:47:21.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f811e2ed700 1 -- 172.21.2.105:0/2163099892 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8118154300 con 0x7f8100004500 2021-11-12T05:47:21.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.188+0000 7f81067fc700 1 -- 172.21.2.105:0/2163099892 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8114011970 con 0x7f8100004500 2021-11-12T05:47:21.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.192+0000 7f811e2ed700 1 -- 172.21.2.105:0/2163099892 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8118153700 con 0x7f8100004500 2021-11-12T05:47:21.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.192+0000 7f81067fc700 1 -- 172.21.2.105:0/2163099892 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8114011ad0 con 0x7f8100004500 2021-11-12T05:47:21.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.192+0000 7f81067fc700 1 --2- 172.21.2.105:0/2163099892 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f80f8053720 0x7f80f8055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:21.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.192+0000 7f81067fc700 1 -- 172.21.2.105:0/2163099892 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f811406b7c0 con 0x7f8100004500 2021-11-12T05:47:21.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.192+0000 7f811caea700 1 --2- 172.21.2.105:0/2163099892 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f80f8053720 0x7f80f8055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:21.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.192+0000 7f811caea700 1 --2- 172.21.2.105:0/2163099892 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f80f8053720 0x7f80f8055be0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f8108016000 tx=0x7f8108015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:21.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.192+0000 7f81067fc700 1 -- 172.21.2.105:0/2163099892 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8118153700 con 0x7f8100004500 2021-11-12T05:47:21.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.304+0000 7f811e2ed700 1 -- 172.21.2.105:0/2163099892 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81181536d0 con 0x7f8100004500 2021-11-12T05:47:21.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.304+0000 7f81067fc700 1 -- 172.21.2.105:0/2163099892 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+1779 (secure 0 0 0) 0x7f8114042630 con 0x7f8100004500 2021-11-12T05:47:21.310 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:21.311 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":32,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/1423088351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":1423088351},{"type":"v1","addr":"172.21.2.115:6833","nonce":1423088351}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":32,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:46:29.372216+0000","modified":"2021-11-12T05:47:21.117582+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-11-12T05:47:21.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.308+0000 7f811e2ed700 1 -- 172.21.2.105:0/2163099892 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f80f8053720 msgr2=0x7f80f8055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:21.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.308+0000 7f811e2ed700 1 --2- 172.21.2.105:0/2163099892 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f80f8053720 0x7f80f8055be0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f8108016000 tx=0x7f8108015000).stop 2021-11-12T05:47:21.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.308+0000 7f811e2ed700 1 -- 172.21.2.105:0/2163099892 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8100004500 msgr2=0x7f8118145b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:21.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.308+0000 7f811e2ed700 1 --2- 172.21.2.105:0/2163099892 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8100004500 0x7f8118145b70 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7f811400a000 tx=0x7f8114008040).stop 2021-11-12T05:47:21.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.308+0000 7f811e2ed700 1 -- 172.21.2.105:0/2163099892 shutdown_connections 2021-11-12T05:47:21.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.308+0000 7f811e2ed700 1 --2- 172.21.2.105:0/2163099892 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f80f8053720 0x7f80f8055be0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:21.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.308+0000 7f811e2ed700 1 --2- 172.21.2.105:0/2163099892 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f81180ae7d0 0x7f81181539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:21.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.308+0000 7f811e2ed700 1 --2- 172.21.2.105:0/2163099892 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f81181441b0 0x7f811814ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:21.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.308+0000 7f811e2ed700 1 --2- 172.21.2.105:0/2163099892 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8100004500 0x7f8118145b70 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:21.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.308+0000 7f811e2ed700 1 -- 172.21.2.105:0/2163099892 >> 172.21.2.105:0/2163099892 conn(0x7f81180608d0 msgr2=0x7f81180b5160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:21.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.308+0000 7f811e2ed700 1 -- 172.21.2.105:0/2163099892 shutdown_connections 2021-11-12T05:47:21.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.308+0000 7f811e2ed700 1 -- 172.21.2.105:0/2163099892 wait complete. 2021-11-12T05:47:21.314 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 32 2021-11-12T05:47:21.317 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-12T05:47:21.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.404+0000 7f9e60280700 1 Processor -- start 2021-11-12T05:47:21.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.404+0000 7f9e60280700 1 -- start start 2021-11-12T05:47:21.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e60280700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9e580ace20 0x7f9e580b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:21.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e60280700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f9e58144180 0x7f9e58144610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:21.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e60280700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e580b1840 con 0x7f9e580aca40 2021-11-12T05:47:21.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e60280700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e580ad2a0 con 0x7f9e58144180 2021-11-12T05:47:21.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e60280700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e580b0a10 con 0x7f9e580ace20 2021-11-12T05:47:21.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e5e01c700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f9e580aca40 0x7f9e581473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:58312/0 (socket says 172.21.2.105:58312) 2021-11-12T05:47:21.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e5e01c700 1 -- 172.21.2.105:0/2091781209 learned_addr learned my addr 172.21.2.105:0/2091781209 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:21.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e5d01a700 1 -- 172.21.2.105:0/2091781209 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3947257707 0 0) 0x7f9e580b1840 con 0x7f9e580aca40 2021-11-12T05:47:21.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e5d01a700 1 -- 172.21.2.105:0/2091781209 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e40003260 con 0x7f9e580aca40 2021-11-12T05:47:21.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e5d01a700 1 -- 172.21.2.105:0/2091781209 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1542386314 0 0) 0x7f9e40003260 con 0x7f9e580aca40 2021-11-12T05:47:21.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e5e81d700 1 --2- 172.21.2.105:0/2091781209 >> v2:172.21.2.115:3300/0 conn(0x7f9e58144180 0x7f9e58144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:21.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e5d01a700 1 -- 172.21.2.105:0/2091781209 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9e580ace20 msgr2=0x7f9e580b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:21.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e5d01a700 1 --2- 172.21.2.105:0/2091781209 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9e580ace20 0x7f9e580b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:21.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e5d01a700 1 -- 172.21.2.105:0/2091781209 >> v2:172.21.2.115:3300/0 conn(0x7f9e58144180 msgr2=0x7f9e58144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:21.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e5d01a700 1 --2- 172.21.2.105:0/2091781209 >> v2:172.21.2.115:3300/0 conn(0x7f9e58144180 0x7f9e58144610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:21.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e5d01a700 1 -- 172.21.2.105:0/2091781209 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e580af2b0 con 0x7f9e580aca40 2021-11-12T05:47:21.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e5d01a700 1 -- 172.21.2.105:0/2091781209 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f9e4c001660 con 0x7f9e580aca40 2021-11-12T05:47:21.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e5d01a700 1 -- 172.21.2.105:0/2091781209 >> v1:172.21.2.105:6789/0 conn(0x7f9e580aca40 legacy=0x7f9e581473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:21.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e5d01a700 1 --2- 172.21.2.105:0/2091781209 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9e400037d0 0x7f9e40003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:21.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e5d01a700 1 --2- 172.21.2.105:0/2091781209 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9e40004500 0x7f9e40004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:21.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e5d01a700 1 --2- 172.21.2.105:0/2091781209 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9e580ace20 0x7f9e4000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:21.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e5d01a700 1 -- 172.21.2.105:0/2091781209 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e580b0a10 con 0x7f9e400037d0 2021-11-12T05:47:21.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e5d01a700 1 -- 172.21.2.105:0/2091781209 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e400052b0 con 0x7f9e40004500 2021-11-12T05:47:21.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e5d01a700 1 -- 172.21.2.105:0/2091781209 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4000bc40 con 0x7f9e580ace20 2021-11-12T05:47:21.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e5e81d700 1 --2- 172.21.2.105:0/2091781209 >> v2:172.21.2.115:3300/0 conn(0x7f9e58144180 0x7f9e58144610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:47:21.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e5e01c700 1 --2- 172.21.2.105:0/2091781209 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9e400037d0 0x7f9e40003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:21.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e5e01c700 1 -- 172.21.2.105:0/2091781209 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9e580ace20 msgr2=0x7f9e4000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:21.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e5e01c700 1 --2- 172.21.2.105:0/2091781209 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9e580ace20 0x7f9e4000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:21.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e5e01c700 1 -- 172.21.2.105:0/2091781209 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9e40004500 msgr2=0x7f9e40004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:21.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e5e01c700 1 --2- 172.21.2.105:0/2091781209 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9e40004500 0x7f9e40004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:21.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e5e01c700 1 -- 172.21.2.105:0/2091781209 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e40003260 con 0x7f9e400037d0 2021-11-12T05:47:21.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e5e01c700 1 --2- 172.21.2.105:0/2091781209 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9e400037d0 0x7f9e40003bf0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7f9e4c001370 tx=0x7f9e4c001d80).ready entity=mon.0 client_cookie=497c23934417d377 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:21.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e5d01a700 1 -- 172.21.2.105:0/2091781209 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e4c0070d0 con 0x7f9e400037d0 2021-11-12T05:47:21.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e5d01a700 1 -- 172.21.2.105:0/2091781209 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4c007230 con 0x7f9e400037d0 2021-11-12T05:47:21.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e5d01a700 1 -- 172.21.2.105:0/2091781209 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e4c00c8f0 con 0x7f9e400037d0 2021-11-12T05:47:21.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e60280700 1 -- 172.21.2.105:0/2091781209 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9e400037d0 msgr2=0x7f9e40003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:21.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e60280700 1 --2- 172.21.2.105:0/2091781209 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9e400037d0 0x7f9e40003bf0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7f9e4c001370 tx=0x7f9e4c001d80).stop 2021-11-12T05:47:21.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e5e81d700 1 -- 172.21.2.105:0/2091781209 reap_dead start 2021-11-12T05:47:21.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e60280700 1 -- 172.21.2.105:0/2091781209 shutdown_connections 2021-11-12T05:47:21.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e60280700 1 -- 172.21.2.105:0/2091781209 >> 172.21.2.105:0/2091781209 conn(0x7f9e5805c490 msgr2=0x7f9e580b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:21.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e60280700 1 -- 172.21.2.105:0/2091781209 shutdown_connections 2021-11-12T05:47:21.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e60280700 1 -- 172.21.2.105:0/2091781209 wait complete. 2021-11-12T05:47:21.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e60280700 1 Processor -- start 2021-11-12T05:47:21.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.408+0000 7f9e60280700 1 -- start start 2021-11-12T05:47:21.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.412+0000 7f9e60280700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9e400037d0 0x7f9e580a7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:21.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.412+0000 7f9e60280700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9e580a7020 0x7f9e580ab840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:21.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.412+0000 7f9e60280700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9e580a7530 0x7f9e5815a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:21.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.412+0000 7f9e60280700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e58159c90 con 0x7f9e400037d0 2021-11-12T05:47:21.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.412+0000 7f9e60280700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e580aa830 con 0x7f9e580a7020 2021-11-12T05:47:21.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.412+0000 7f9e60280700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e580aa590 con 0x7f9e580a7530 2021-11-12T05:47:21.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.412+0000 7f9e5e01c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9e400037d0 0x7f9e580a7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:21.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.412+0000 7f9e5e01c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9e400037d0 0x7f9e580a7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47932/0 (socket says 172.21.2.105:47932) 2021-11-12T05:47:21.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.412+0000 7f9e5e01c700 1 -- 172.21.2.105:0/2706359198 learned_addr learned my addr 172.21.2.105:0/2706359198 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:21.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.412+0000 7f9e5e01c700 1 -- 172.21.2.105:0/2706359198 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9e580a7530 msgr2=0x7f9e5815a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:21.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.412+0000 7f9e5e01c700 1 --2- 172.21.2.105:0/2706359198 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9e580a7530 0x7f9e5815a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:21.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.412+0000 7f9e5e01c700 1 -- 172.21.2.105:0/2706359198 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9e580a7020 msgr2=0x7f9e580ab840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:21.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.412+0000 7f9e5e01c700 1 --2- 172.21.2.105:0/2706359198 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9e580a7020 0x7f9e580ab840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:21.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.412+0000 7f9e5e01c700 1 -- 172.21.2.105:0/2706359198 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e58146580 con 0x7f9e400037d0 2021-11-12T05:47:21.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.412+0000 7f9e5e01c700 1 --2- 172.21.2.105:0/2706359198 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9e400037d0 0x7f9e580a7bb0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7f9e4c001370 tx=0x7f9e4c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:21.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.412+0000 7f9e4b7fe700 1 -- 172.21.2.105:0/2706359198 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e4c018030 con 0x7f9e400037d0 2021-11-12T05:47:21.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.412+0000 7f9e4b7fe700 1 -- 172.21.2.105:0/2706359198 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4c007720 con 0x7f9e400037d0 2021-11-12T05:47:21.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.412+0000 7f9e60280700 1 -- 172.21.2.105:0/2706359198 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e5815a5e0 con 0x7f9e400037d0 2021-11-12T05:47:21.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.412+0000 7f9e4b7fe700 1 -- 172.21.2.105:0/2706359198 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e4c004710 con 0x7f9e400037d0 2021-11-12T05:47:21.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.412+0000 7f9e60280700 1 -- 172.21.2.105:0/2706359198 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e5815aa90 con 0x7f9e400037d0 2021-11-12T05:47:21.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.412+0000 7f9e60280700 1 -- 172.21.2.105:0/2706359198 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e58057350 con 0x7f9e400037d0 2021-11-12T05:47:21.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.412+0000 7f9e4b7fe700 1 -- 172.21.2.105:0/2706359198 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9e4c026070 con 0x7f9e400037d0 2021-11-12T05:47:21.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.412+0000 7f9e4b7fe700 1 --2- 172.21.2.105:0/2706359198 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9e38053610 0x7f9e38055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:21.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.412+0000 7f9e4b7fe700 1 -- 172.21.2.105:0/2706359198 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6545+0+0 (secure 0 0 0) 0x7f9e4c06c1a0 con 0x7f9e400037d0 2021-11-12T05:47:21.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.412+0000 7f9e5d81b700 1 --2- 172.21.2.105:0/2706359198 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9e38053610 0x7f9e38055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:21.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.412+0000 7f9e5d81b700 1 --2- 172.21.2.105:0/2706359198 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9e38053610 0x7f9e38055ad0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f9e54002f70 tx=0x7f9e54006a00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:21.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.416+0000 7f9e4b7fe700 1 -- 172.21.2.105:0/2706359198 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9e4c043120 con 0x7f9e400037d0 2021-11-12T05:47:21.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:21.524+0000 7f9e60280700 1 -- 172.21.2.105:0/2706359198 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9e5805f280 con 0x7f9e400037d0 2021-11-12T05:47:22.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.132+0000 7f9e4b7fe700 1 -- 172.21.2.105:0/2706359198 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v33) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9e4c046740 con 0x7f9e400037d0 2021-11-12T05:47:22.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.140+0000 7f9e60280700 1 -- 172.21.2.105:0/2706359198 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9e38053610 msgr2=0x7f9e38055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:22.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.140+0000 7f9e60280700 1 --2- 172.21.2.105:0/2706359198 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9e38053610 0x7f9e38055ad0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f9e54002f70 tx=0x7f9e54006a00).stop 2021-11-12T05:47:22.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.140+0000 7f9e60280700 1 -- 172.21.2.105:0/2706359198 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9e400037d0 msgr2=0x7f9e580a7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:22.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.140+0000 7f9e60280700 1 --2- 172.21.2.105:0/2706359198 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9e400037d0 0x7f9e580a7bb0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7f9e4c001370 tx=0x7f9e4c015000).stop 2021-11-12T05:47:22.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.140+0000 7f9e60280700 1 -- 172.21.2.105:0/2706359198 shutdown_connections 2021-11-12T05:47:22.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.140+0000 7f9e60280700 1 --2- 172.21.2.105:0/2706359198 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9e38053610 0x7f9e38055ad0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:22.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.140+0000 7f9e60280700 1 --2- 172.21.2.105:0/2706359198 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9e580a7530 0x7f9e5815a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:22.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.140+0000 7f9e60280700 1 --2- 172.21.2.105:0/2706359198 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9e580a7020 0x7f9e580ab840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:22.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.140+0000 7f9e60280700 1 --2- 172.21.2.105:0/2706359198 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9e400037d0 0x7f9e580a7bb0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:22.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.140+0000 7f9e60280700 1 -- 172.21.2.105:0/2706359198 >> 172.21.2.105:0/2706359198 conn(0x7f9e5805c490 msgr2=0x7f9e580b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:22.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.140+0000 7f9e60280700 1 -- 172.21.2.105:0/2706359198 shutdown_connections 2021-11-12T05:47:22.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.140+0000 7f9e60280700 1 -- 172.21.2.105:0/2706359198 wait complete. 2021-11-12T05:47:22.156 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-12T05:47:22.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.204+0000 7fcaef931700 1 Processor -- start 2021-11-12T05:47:22.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.204+0000 7fcaef931700 1 -- start start 2021-11-12T05:47:22.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.204+0000 7fcaef931700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fcae80adaf0 0x7fcae813fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:22.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.204+0000 7fcaef931700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fcae8143fb0 0x7fcae80afe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:22.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.204+0000 7fcaef931700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcae8067860 con 0x7fcae8143b40 2021-11-12T05:47:22.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.204+0000 7fcaef931700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcae8143400 con 0x7fcae8143fb0 2021-11-12T05:47:22.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.204+0000 7fcaef931700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcae81436a0 con 0x7fcae80adaf0 2021-11-12T05:47:22.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.204+0000 7fcaececc700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fcae8143b40 0x7fcae80aded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:58336/0 (socket says 172.21.2.105:58336) 2021-11-12T05:47:22.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.204+0000 7fcaececc700 1 -- 172.21.2.105:0/796391471 learned_addr learned my addr 172.21.2.105:0/796391471 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:22.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.204+0000 7fcaedece700 1 --2- 172.21.2.105:0/796391471 >> v2:172.21.2.105:3300/0 conn(0x7fcae8143fb0 0x7fcae80afe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:22.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.204+0000 7fcaedece700 1 -- 172.21.2.105:0/796391471 >> v2:172.21.2.115:3300/0 conn(0x7fcae80adaf0 msgr2=0x7fcae813fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:22.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.204+0000 7fcaedece700 1 --2- 172.21.2.105:0/796391471 >> v2:172.21.2.115:3300/0 conn(0x7fcae80adaf0 0x7fcae813fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:22.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.204+0000 7fcaedece700 1 -- 172.21.2.105:0/796391471 >> v1:172.21.2.105:6789/0 conn(0x7fcae8143b40 legacy=0x7fcae80aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:22.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.204+0000 7fcad7fff700 1 -- 172.21.2.105:0/796391471 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3436009505 0 0) 0x7fcae8067860 con 0x7fcae8143b40 2021-11-12T05:47:22.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.204+0000 7fcaedece700 1 -- 172.21.2.105:0/796391471 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae80b2b40 con 0x7fcae8143fb0 2021-11-12T05:47:22.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.208+0000 7fcaedece700 1 --2- 172.21.2.105:0/796391471 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcae8143fb0 0x7fcae80afe10 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7fcae00032f0 tx=0x7fcae000b470).ready entity=mon.0 client_cookie=d3079b39e4a5791 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:22.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.208+0000 7fcad7fff700 1 -- 172.21.2.105:0/796391471 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcae000ddf0 con 0x7fcae8143fb0 2021-11-12T05:47:22.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.208+0000 7fcad7fff700 1 -- 172.21.2.105:0/796391471 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae0010470 con 0x7fcae8143fb0 2021-11-12T05:47:22.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.208+0000 7fcad7fff700 1 -- 172.21.2.105:0/796391471 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcae00107d0 con 0x7fcae8143fb0 2021-11-12T05:47:22.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.208+0000 7fcaef931700 1 -- 172.21.2.105:0/796391471 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcae8143fb0 msgr2=0x7fcae80afe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:22.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.208+0000 7fcaef931700 1 --2- 172.21.2.105:0/796391471 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcae8143fb0 0x7fcae80afe10 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7fcae00032f0 tx=0x7fcae000b470).stop 2021-11-12T05:47:22.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.208+0000 7fcaef931700 1 -- 172.21.2.105:0/796391471 shutdown_connections 2021-11-12T05:47:22.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.208+0000 7fcaef931700 1 --2- 172.21.2.105:0/796391471 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcae8143fb0 0x7fcae80afe10 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:22.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.208+0000 7fcaef931700 1 --2- 172.21.2.105:0/796391471 >> v2:172.21.2.115:3300/0 conn(0x7fcae80adaf0 0x7fcae813fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:22.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.208+0000 7fcaef931700 1 -- 172.21.2.105:0/796391471 >> 172.21.2.105:0/796391471 conn(0x7fcae805c490 msgr2=0x7fcae805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:22.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.208+0000 7fcaef931700 1 -- 172.21.2.105:0/796391471 shutdown_connections 2021-11-12T05:47:22.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.208+0000 7fcaef931700 1 -- 172.21.2.105:0/796391471 wait complete. 2021-11-12T05:47:22.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.208+0000 7fcaef931700 1 Processor -- start 2021-11-12T05:47:22.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.208+0000 7fcaef931700 1 -- start start 2021-11-12T05:47:22.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.208+0000 7fcaef931700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcae80adaf0 0x7fcae814e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:22.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.208+0000 7fcaef931700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcae8143b40 0x7fcae813bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:22.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.208+0000 7fcaef931700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcae8143fb0 0x7fcae813e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:22.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.208+0000 7fcaef931700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae813da20 con 0x7fcae8143b40 2021-11-12T05:47:22.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.208+0000 7fcaef931700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae813dcc0 con 0x7fcae80adaf0 2021-11-12T05:47:22.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.208+0000 7fcaef931700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae813df60 con 0x7fcae8143fb0 2021-11-12T05:47:22.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.208+0000 7fcaececc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcae8143b40 0x7fcae813bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:22.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.208+0000 7fcaececc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcae8143b40 0x7fcae813bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47944/0 (socket says 172.21.2.105:47944) 2021-11-12T05:47:22.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.208+0000 7fcaececc700 1 -- 172.21.2.105:0/2658334707 learned_addr learned my addr 172.21.2.105:0/2658334707 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:22.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.208+0000 7fcaed6cd700 1 --2- 172.21.2.105:0/2658334707 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcae80adaf0 0x7fcae814e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:22.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.208+0000 7fcaedece700 1 --2- 172.21.2.105:0/2658334707 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcae8143fb0 0x7fcae813e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:22.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.208+0000 7fcaececc700 1 -- 172.21.2.105:0/2658334707 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcae8143fb0 msgr2=0x7fcae813e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:22.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.208+0000 7fcaececc700 1 --2- 172.21.2.105:0/2658334707 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcae8143fb0 0x7fcae813e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:22.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.208+0000 7fcaececc700 1 -- 172.21.2.105:0/2658334707 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcae80adaf0 msgr2=0x7fcae814e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:22.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.208+0000 7fcaececc700 1 --2- 172.21.2.105:0/2658334707 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcae80adaf0 0x7fcae814e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:22.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.208+0000 7fcaececc700 1 -- 172.21.2.105:0/2658334707 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae000b710 con 0x7fcae8143b40 2021-11-12T05:47:22.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.208+0000 7fcaececc700 1 --2- 172.21.2.105:0/2658334707 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcae8143b40 0x7fcae813bbc0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7fcad8000bc0 tx=0x7fcad8007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:22.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.208+0000 7fcad67fc700 1 -- 172.21.2.105:0/2658334707 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcad80070d0 con 0x7fcae8143b40 2021-11-12T05:47:22.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.208+0000 7fcad67fc700 1 -- 172.21.2.105:0/2658334707 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad8007230 con 0x7fcae8143b40 2021-11-12T05:47:22.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.208+0000 7fcad67fc700 1 -- 172.21.2.105:0/2658334707 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcad8005610 con 0x7fcae8143b40 2021-11-12T05:47:22.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.208+0000 7fcaef931700 1 -- 172.21.2.105:0/2658334707 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae80ad130 con 0x7fcae8143b40 2021-11-12T05:47:22.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.208+0000 7fcaef931700 1 -- 172.21.2.105:0/2658334707 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae813ea90 con 0x7fcae8143b40 2021-11-12T05:47:22.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.208+0000 7fcaef931700 1 -- 172.21.2.105:0/2658334707 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcae80afb00 con 0x7fcae8143b40 2021-11-12T05:47:22.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.208+0000 7fcad67fc700 1 -- 172.21.2.105:0/2658334707 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcad8010070 con 0x7fcae8143b40 2021-11-12T05:47:22.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.212+0000 7fcad67fc700 1 --2- 172.21.2.105:0/2658334707 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcac80534f0 0x7fcac80559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:22.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.212+0000 7fcad67fc700 1 -- 172.21.2.105:0/2658334707 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6545+0+0 (secure 0 0 0) 0x7fcad806b3b0 con 0x7fcae8143b40 2021-11-12T05:47:22.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.212+0000 7fcaed6cd700 1 --2- 172.21.2.105:0/2658334707 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcac80534f0 0x7fcac80559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:22.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.212+0000 7fcaed6cd700 1 --2- 172.21.2.105:0/2658334707 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcac80534f0 0x7fcac80559b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7fcae400a000 tx=0x7fcae4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:22.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.212+0000 7fcad67fc700 1 -- 172.21.2.105:0/2658334707 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcad8042220 con 0x7fcae8143b40 2021-11-12T05:47:22.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:22.296+0000 7fcaef931700 1 -- 172.21.2.105:0/2658334707 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcae8057350 con 0x7fcae8143b40 2021-11-12T05:47:23.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.136+0000 7fcad67fc700 1 -- 172.21.2.105:0/2658334707 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v78) v1 ==== 185+0+0 (secure 0 0 0) 0x7fcad8045840 con 0x7fcae8143b40 2021-11-12T05:47:23.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.136+0000 7fcaef931700 1 -- 172.21.2.105:0/2658334707 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcac80534f0 msgr2=0x7fcac80559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:23.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.136+0000 7fcaef931700 1 --2- 172.21.2.105:0/2658334707 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcac80534f0 0x7fcac80559b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7fcae400a000 tx=0x7fcae4008040).stop 2021-11-12T05:47:23.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.136+0000 7fcaef931700 1 -- 172.21.2.105:0/2658334707 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcae8143b40 msgr2=0x7fcae813bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:23.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.136+0000 7fcaef931700 1 --2- 172.21.2.105:0/2658334707 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcae8143b40 0x7fcae813bbc0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7fcad8000bc0 tx=0x7fcad8007a60).stop 2021-11-12T05:47:23.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.136+0000 7fcaef931700 1 -- 172.21.2.105:0/2658334707 shutdown_connections 2021-11-12T05:47:23.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.136+0000 7fcaef931700 1 --2- 172.21.2.105:0/2658334707 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcac80534f0 0x7fcac80559b0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:23.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.136+0000 7fcaef931700 1 --2- 172.21.2.105:0/2658334707 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcae8143fb0 0x7fcae813e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:23.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.136+0000 7fcaef931700 1 --2- 172.21.2.105:0/2658334707 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcae8143b40 0x7fcae813bbc0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:23.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.136+0000 7fcaef931700 1 --2- 172.21.2.105:0/2658334707 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcae80adaf0 0x7fcae814e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:23.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.136+0000 7fcaef931700 1 -- 172.21.2.105:0/2658334707 >> 172.21.2.105:0/2658334707 conn(0x7fcae805c490 msgr2=0x7fcae80b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:23.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.136+0000 7fcaef931700 1 -- 172.21.2.105:0/2658334707 shutdown_connections 2021-11-12T05:47:23.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.136+0000 7fcaef931700 1 -- 172.21.2.105:0/2658334707 wait complete. 2021-11-12T05:47:23.145 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_metadata' removed 2021-11-12T05:47:23.147 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-12T05:47:23.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.200+0000 7f4d75545700 1 Processor -- start 2021-11-12T05:47:23.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.200+0000 7f4d75545700 1 -- start start 2021-11-12T05:47:23.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.200+0000 7f4d75545700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4d700ad080 0x7f4d700af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:23.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.200+0000 7f4d75545700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f4d700ac280 0x7f4d700ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:23.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.200+0000 7f4d75545700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d700ac7b0 con 0x7f4d7014abe0 2021-11-12T05:47:23.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.200+0000 7f4d75545700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d701488a0 con 0x7f4d700ac280 2021-11-12T05:47:23.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.200+0000 7f4d75545700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d700ac9e0 con 0x7f4d700ad080 2021-11-12T05:47:23.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.200+0000 7f4d6e7fc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f4d700ac280 0x7f4d700ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:23.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.200+0000 7f4d6e7fc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f4d700ac280 0x7f4d700ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47952/0 (socket says 172.21.2.105:47952) 2021-11-12T05:47:23.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.200+0000 7f4d6e7fc700 1 -- 172.21.2.105:0/2927828037 learned_addr learned my addr 172.21.2.105:0/2927828037 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:23.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.200+0000 7f4d6e7fc700 1 -- 172.21.2.105:0/2927828037 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4d700ad080 msgr2=0x7f4d700af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:23.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.200+0000 7f4d6e7fc700 1 --2- 172.21.2.105:0/2927828037 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4d700ad080 0x7f4d700af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:23.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.200+0000 7f4d6e7fc700 1 -- 172.21.2.105:0/2927828037 >> v1:172.21.2.115:6789/0 conn(0x7f4d7014abe0 legacy=0x7f4d7014b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:23.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.200+0000 7f4d6e7fc700 1 -- 172.21.2.105:0/2927828037 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d700b0b30 con 0x7f4d700ac280 2021-11-12T05:47:23.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.200+0000 7f4d6e7fc700 1 --2- 172.21.2.105:0/2927828037 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4d700ac280 0x7f4d700ad460 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7f4d700b6060 tx=0x7f4d60006eb0).ready entity=mon.0 client_cookie=6c9314d0262c2bbd server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:23.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.200+0000 7f4d6dffb700 1 -- 172.21.2.105:0/2927828037 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d6000d570 con 0x7f4d700ac280 2021-11-12T05:47:23.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.200+0000 7f4d6dffb700 1 -- 172.21.2.105:0/2927828037 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d60000e90 con 0x7f4d700ac280 2021-11-12T05:47:23.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.200+0000 7f4d6dffb700 1 -- 172.21.2.105:0/2927828037 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d6000d8c0 con 0x7f4d700ac280 2021-11-12T05:47:23.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.200+0000 7f4d75545700 1 -- 172.21.2.105:0/2927828037 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4d700ac280 msgr2=0x7f4d700ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:23.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.200+0000 7f4d75545700 1 --2- 172.21.2.105:0/2927828037 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4d700ac280 0x7f4d700ad460 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7f4d700b6060 tx=0x7f4d60006eb0).stop 2021-11-12T05:47:23.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.200+0000 7f4d75545700 1 -- 172.21.2.105:0/2927828037 shutdown_connections 2021-11-12T05:47:23.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.200+0000 7f4d75545700 1 --2- 172.21.2.105:0/2927828037 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4d700ac280 0x7f4d700ad460 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:23.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.200+0000 7f4d75545700 1 --2- 172.21.2.105:0/2927828037 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4d700ad080 0x7f4d700af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:23.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.200+0000 7f4d75545700 1 -- 172.21.2.105:0/2927828037 >> 172.21.2.105:0/2927828037 conn(0x7f4d700b5370 msgr2=0x7f4d700b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:23.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.200+0000 7f4d75545700 1 -- 172.21.2.105:0/2927828037 shutdown_connections 2021-11-12T05:47:23.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.200+0000 7f4d75545700 1 -- 172.21.2.105:0/2927828037 wait complete. 2021-11-12T05:47:23.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.200+0000 7f4d75545700 1 Processor -- start 2021-11-12T05:47:23.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.200+0000 7f4d75545700 1 -- start start 2021-11-12T05:47:23.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.204+0000 7f4d75545700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4d700ac280 0x7f4d700ab400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:23.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.204+0000 7f4d75545700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4d700ad080 0x7f4d700ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:23.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.204+0000 7f4d75545700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4d7014abe0 0x7f4d70156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:23.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.204+0000 7f4d75545700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d700aa920 con 0x7f4d700ad080 2021-11-12T05:47:23.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.204+0000 7f4d75545700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d70063eb0 con 0x7f4d7014abe0 2021-11-12T05:47:23.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.204+0000 7f4d75545700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d70064150 con 0x7f4d700ac280 2021-11-12T05:47:23.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.204+0000 7f4d6e7fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4d700ad080 0x7f4d700ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:23.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.204+0000 7f4d6e7fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4d700ad080 0x7f4d700ab8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47960/0 (socket says 172.21.2.105:47960) 2021-11-12T05:47:23.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.204+0000 7f4d6e7fc700 1 -- 172.21.2.105:0/2066353217 learned_addr learned my addr 172.21.2.105:0/2066353217 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:23.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.204+0000 7f4d6e7fc700 1 -- 172.21.2.105:0/2066353217 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4d700ac280 msgr2=0x7f4d700ab400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:23.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.204+0000 7f4d6e7fc700 1 --2- 172.21.2.105:0/2066353217 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4d700ac280 0x7f4d700ab400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:23.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.204+0000 7f4d6e7fc700 1 -- 172.21.2.105:0/2066353217 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4d7014abe0 msgr2=0x7f4d70156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:23.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.204+0000 7f4d6e7fc700 1 --2- 172.21.2.105:0/2066353217 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4d7014abe0 0x7f4d70156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:23.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.204+0000 7f4d6e7fc700 1 -- 172.21.2.105:0/2066353217 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d6000b1e0 con 0x7f4d700ad080 2021-11-12T05:47:23.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.204+0000 7f4d6e7fc700 1 --2- 172.21.2.105:0/2066353217 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4d700ad080 0x7f4d700ab8f0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7f4d700b6060 tx=0x7f4d60015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:23.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.204+0000 7f4d5ffff700 1 -- 172.21.2.105:0/2066353217 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d60006b80 con 0x7f4d700ad080 2021-11-12T05:47:23.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.204+0000 7f4d5ffff700 1 -- 172.21.2.105:0/2066353217 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6000d8f0 con 0x7f4d700ad080 2021-11-12T05:47:23.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.204+0000 7f4d75545700 1 -- 172.21.2.105:0/2066353217 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d700a9e40 con 0x7f4d700ad080 2021-11-12T05:47:23.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.204+0000 7f4d5ffff700 1 -- 172.21.2.105:0/2066353217 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d6001e460 con 0x7f4d700ad080 2021-11-12T05:47:23.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.204+0000 7f4d75545700 1 -- 172.21.2.105:0/2066353217 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d700a9500 con 0x7f4d700ad080 2021-11-12T05:47:23.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.204+0000 7f4d75545700 1 -- 172.21.2.105:0/2066353217 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d700b1440 con 0x7f4d700ad080 2021-11-12T05:47:23.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.204+0000 7f4d5ffff700 1 -- 172.21.2.105:0/2066353217 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4d6001a040 con 0x7f4d700ad080 2021-11-12T05:47:23.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.204+0000 7f4d5ffff700 1 --2- 172.21.2.105:0/2066353217 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4d4c0536a0 0x7f4d4c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:23.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.204+0000 7f4d5ffff700 1 -- 172.21.2.105:0/2066353217 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6107+0+0 (secure 0 0 0) 0x7f4d6006c920 con 0x7f4d700ad080 2021-11-12T05:47:23.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.204+0000 7f4d6effd700 1 --2- 172.21.2.105:0/2066353217 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4d4c0536a0 0x7f4d4c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:23.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.204+0000 7f4d6effd700 1 --2- 172.21.2.105:0/2066353217 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4d4c0536a0 0x7f4d4c055b60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f4d64002f70 tx=0x7f4d64006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:23.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.208+0000 7f4d5ffff700 1 -- 172.21.2.105:0/2066353217 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4d60043ae0 con 0x7f4d700ad080 2021-11-12T05:47:23.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:23.292+0000 7f4d75545700 1 -- 172.21.2.105:0/2066353217 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4d70057350 con 0x7f4d700ad080 2021-11-12T05:47:24.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.140+0000 7f4d5ffff700 1 -- 172.21.2.105:0/2066353217 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v79) v1 ==== 173+0+0 (secure 0 0 0) 0x7f4d60047080 con 0x7f4d700ad080 2021-11-12T05:47:24.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.140+0000 7f4d75545700 1 -- 172.21.2.105:0/2066353217 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4d4c0536a0 msgr2=0x7f4d4c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:24.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.140+0000 7f4d75545700 1 --2- 172.21.2.105:0/2066353217 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4d4c0536a0 0x7f4d4c055b60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f4d64002f70 tx=0x7f4d64006a80).stop 2021-11-12T05:47:24.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.140+0000 7f4d75545700 1 -- 172.21.2.105:0/2066353217 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4d700ad080 msgr2=0x7f4d700ab8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:24.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.140+0000 7f4d75545700 1 --2- 172.21.2.105:0/2066353217 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4d700ad080 0x7f4d700ab8f0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7f4d700b6060 tx=0x7f4d60015000).stop 2021-11-12T05:47:24.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.140+0000 7f4d75545700 1 -- 172.21.2.105:0/2066353217 shutdown_connections 2021-11-12T05:47:24.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.140+0000 7f4d75545700 1 --2- 172.21.2.105:0/2066353217 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4d4c0536a0 0x7f4d4c055b60 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:24.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.140+0000 7f4d75545700 1 --2- 172.21.2.105:0/2066353217 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4d7014abe0 0x7f4d70156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:24.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.140+0000 7f4d75545700 1 --2- 172.21.2.105:0/2066353217 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4d700ad080 0x7f4d700ab8f0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:24.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.140+0000 7f4d75545700 1 --2- 172.21.2.105:0/2066353217 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4d700ac280 0x7f4d700ab400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:24.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.140+0000 7f4d75545700 1 -- 172.21.2.105:0/2066353217 >> 172.21.2.105:0/2066353217 conn(0x7f4d700b5370 msgr2=0x7f4d700ae880 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:24.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.140+0000 7f4d75545700 1 -- 172.21.2.105:0/2066353217 shutdown_connections 2021-11-12T05:47:24.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.140+0000 7f4d75545700 1 -- 172.21.2.105:0/2066353217 wait complete. 2021-11-12T05:47:24.150 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_data' removed 2021-11-12T05:47:24.152 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-11-12T05:47:24.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.204+0000 7f67e266d700 1 Processor -- start 2021-11-12T05:47:24.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.204+0000 7f67e266d700 1 -- start start 2021-11-12T05:47:24.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.204+0000 7f67e266d700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f67dc0b7b00 0x7f67dc140d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:24.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.204+0000 7f67e266d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f67dc0b3980 0x7f67dc0b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:24.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.204+0000 7f67e266d700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67dc0b7ee0 con 0x7f67dc0ae090 2021-11-12T05:47:24.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.204+0000 7f67e266d700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67dc0b2030 con 0x7f67dc0b3980 2021-11-12T05:47:24.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.204+0000 7f67e266d700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67dc0b22d0 con 0x7f67dc0b7b00 2021-11-12T05:47:24.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.204+0000 7f67e0c0a700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f67dc0b3980 0x7f67dc0b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:24.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.204+0000 7f67e0c0a700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f67dc0b3980 0x7f67dc0b3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47966/0 (socket says 172.21.2.105:47966) 2021-11-12T05:47:24.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.204+0000 7f67e0c0a700 1 -- 172.21.2.105:0/3087366968 learned_addr learned my addr 172.21.2.105:0/3087366968 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:24.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.204+0000 7f67e0c0a700 1 -- 172.21.2.105:0/3087366968 >> v2:172.21.2.115:3300/0 conn(0x7f67dc0b7b00 msgr2=0x7f67dc140d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:24.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.204+0000 7f67e0c0a700 1 --2- 172.21.2.105:0/3087366968 >> v2:172.21.2.115:3300/0 conn(0x7f67dc0b7b00 0x7f67dc140d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:24.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.204+0000 7f67e0c0a700 1 -- 172.21.2.105:0/3087366968 >> v1:172.21.2.115:6789/0 conn(0x7f67dc0ae090 legacy=0x7f67dc0b2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:24.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.204+0000 7f67e0c0a700 1 -- 172.21.2.105:0/3087366968 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67dc0b2570 con 0x7f67dc0b3980 2021-11-12T05:47:24.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.204+0000 7f67e0c0a700 1 --2- 172.21.2.105:0/3087366968 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f67dc0b3980 0x7f67dc0b3df0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7f67dc0b76d0 tx=0x7f67d4009290).ready entity=mon.0 client_cookie=faed087d53e0804d server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:24.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.204+0000 7f67daffd700 1 -- 172.21.2.105:0/3087366968 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67d400b830 con 0x7f67dc0b3980 2021-11-12T05:47:24.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.204+0000 7f67daffd700 1 -- 172.21.2.105:0/3087366968 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d400b990 con 0x7f67dc0b3980 2021-11-12T05:47:24.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.204+0000 7f67daffd700 1 -- 172.21.2.105:0/3087366968 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67d400bb40 con 0x7f67dc0b3980 2021-11-12T05:47:24.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.204+0000 7f67e266d700 1 -- 172.21.2.105:0/3087366968 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f67dc0b3980 msgr2=0x7f67dc0b3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:24.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.204+0000 7f67e266d700 1 --2- 172.21.2.105:0/3087366968 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f67dc0b3980 0x7f67dc0b3df0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7f67dc0b76d0 tx=0x7f67d4009290).stop 2021-11-12T05:47:24.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.208+0000 7f67e266d700 1 -- 172.21.2.105:0/3087366968 shutdown_connections 2021-11-12T05:47:24.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.208+0000 7f67e266d700 1 --2- 172.21.2.105:0/3087366968 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f67dc0b3980 0x7f67dc0b3df0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:24.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.208+0000 7f67e266d700 1 --2- 172.21.2.105:0/3087366968 >> v2:172.21.2.115:3300/0 conn(0x7f67dc0b7b00 0x7f67dc140d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:24.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.208+0000 7f67e266d700 1 -- 172.21.2.105:0/3087366968 >> 172.21.2.105:0/3087366968 conn(0x7f67dc0608d0 msgr2=0x7f67dc05c490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:24.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.208+0000 7f67e266d700 1 -- 172.21.2.105:0/3087366968 shutdown_connections 2021-11-12T05:47:24.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.208+0000 7f67e266d700 1 -- 172.21.2.105:0/3087366968 wait complete. 2021-11-12T05:47:24.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.208+0000 7f67e266d700 1 Processor -- start 2021-11-12T05:47:24.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.208+0000 7f67e266d700 1 -- start start 2021-11-12T05:47:24.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.208+0000 7f67e266d700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f67dc0ae090 0x7f67dc155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:24.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.208+0000 7f67e266d700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f67dc0b3980 0x7f67dc13f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:24.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.208+0000 7f67e266d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f67dc0b7b00 0x7f67dc13ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:24.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.208+0000 7f67e266d700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc0b0d00 con 0x7f67dc0b7b00 2021-11-12T05:47:24.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.208+0000 7f67e266d700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc156570 con 0x7f67dc0ae090 2021-11-12T05:47:24.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.208+0000 7f67e266d700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc067190 con 0x7f67dc0b3980 2021-11-12T05:47:24.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.208+0000 7f67e0c0a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f67dc0b7b00 0x7f67dc13ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:24.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.208+0000 7f67e0c0a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f67dc0b7b00 0x7f67dc13ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47972/0 (socket says 172.21.2.105:47972) 2021-11-12T05:47:24.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.208+0000 7f67e0c0a700 1 -- 172.21.2.105:0/549461636 learned_addr learned my addr 172.21.2.105:0/549461636 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:24.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.208+0000 7f67e0c0a700 1 -- 172.21.2.105:0/549461636 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f67dc0b3980 msgr2=0x7f67dc13f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:24.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.208+0000 7f67e0c0a700 1 --2- 172.21.2.105:0/549461636 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f67dc0b3980 0x7f67dc13f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:24.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.208+0000 7f67e0c0a700 1 -- 172.21.2.105:0/549461636 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f67dc0ae090 msgr2=0x7f67dc155d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:24.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.208+0000 7f67e0c0a700 1 --2- 172.21.2.105:0/549461636 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f67dc0ae090 0x7f67dc155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:24.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.208+0000 7f67e0c0a700 1 -- 172.21.2.105:0/549461636 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d4009530 con 0x7f67dc0b7b00 2021-11-12T05:47:24.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.208+0000 7f67e0c0a700 1 --2- 172.21.2.105:0/549461636 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f67dc0b7b00 0x7f67dc13ed20 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7f67dc0b76d0 tx=0x7f67d4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:24.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.208+0000 7f67d97fa700 1 -- 172.21.2.105:0/549461636 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67d400b830 con 0x7f67dc0b7b00 2021-11-12T05:47:24.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.208+0000 7f67d97fa700 1 -- 172.21.2.105:0/549461636 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d4020660 con 0x7f67dc0b7b00 2021-11-12T05:47:24.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.208+0000 7f67d97fa700 1 -- 172.21.2.105:0/549461636 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67d40209c0 con 0x7f67dc0b7b00 2021-11-12T05:47:24.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.208+0000 7f67e266d700 1 -- 172.21.2.105:0/549461636 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67dc156210 con 0x7f67dc0b7b00 2021-11-12T05:47:24.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.208+0000 7f67e266d700 1 -- 172.21.2.105:0/549461636 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67dc13f210 con 0x7f67dc0b7b00 2021-11-12T05:47:24.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.208+0000 7f67e266d700 1 -- 172.21.2.105:0/549461636 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67dc057350 con 0x7f67dc0b7b00 2021-11-12T05:47:24.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.208+0000 7f67d97fa700 1 -- 172.21.2.105:0/549461636 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f67d4027070 con 0x7f67dc0b7b00 2021-11-12T05:47:24.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.208+0000 7f67d97fa700 1 --2- 172.21.2.105:0/549461636 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f67bc0534f0 0x7f67bc0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:24.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.208+0000 7f67d97fa700 1 -- 172.21.2.105:0/549461636 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5725+0+0 (secure 0 0 0) 0x7f67d406c1e0 con 0x7f67dc0b7b00 2021-11-12T05:47:24.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.208+0000 7f67dbfff700 1 --2- 172.21.2.105:0/549461636 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f67bc0534f0 0x7f67bc0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:24.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.208+0000 7f67dbfff700 1 --2- 172.21.2.105:0/549461636 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f67bc0534f0 0x7f67bc0559b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f67cc002f70 tx=0x7f67cc0069e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:24.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.212+0000 7f67d97fa700 1 -- 172.21.2.105:0/549461636 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f67d40434e0 con 0x7f67dc0b7b00 2021-11-12T05:47:24.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.300+0000 7f67e266d700 1 -- 172.21.2.105:0/549461636 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f67dc05f280 con 0x7f67dc0b7b00 2021-11-12T05:47:24.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.304+0000 7f67d97fa700 1 -- 172.21.2.105:0/549461636 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f67d40150a0 con 0x7f67dc0b7b00 2021-11-12T05:47:24.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.304+0000 7f67e266d700 1 -- 172.21.2.105:0/549461636 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f67bc0534f0 msgr2=0x7f67bc0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:24.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.304+0000 7f67e266d700 1 --2- 172.21.2.105:0/549461636 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f67bc0534f0 0x7f67bc0559b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f67cc002f70 tx=0x7f67cc0069e0).stop 2021-11-12T05:47:24.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.304+0000 7f67e266d700 1 -- 172.21.2.105:0/549461636 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f67dc0b7b00 msgr2=0x7f67dc13ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:24.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.304+0000 7f67e266d700 1 --2- 172.21.2.105:0/549461636 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f67dc0b7b00 0x7f67dc13ed20 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7f67dc0b76d0 tx=0x7f67d4016000).stop 2021-11-12T05:47:24.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.304+0000 7f67e266d700 1 -- 172.21.2.105:0/549461636 shutdown_connections 2021-11-12T05:47:24.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.304+0000 7f67e266d700 1 --2- 172.21.2.105:0/549461636 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f67bc0534f0 0x7f67bc0559b0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:24.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.304+0000 7f67e266d700 1 --2- 172.21.2.105:0/549461636 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f67dc0b7b00 0x7f67dc13ed20 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:24.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.304+0000 7f67e266d700 1 --2- 172.21.2.105:0/549461636 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f67dc0b3980 0x7f67dc13f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:24.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.304+0000 7f67e266d700 1 --2- 172.21.2.105:0/549461636 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f67dc0ae090 0x7f67dc155d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:24.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.304+0000 7f67e266d700 1 -- 172.21.2.105:0/549461636 >> 172.21.2.105:0/549461636 conn(0x7f67dc0608d0 msgr2=0x7f67dc0613f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:24.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.304+0000 7f67e266d700 1 -- 172.21.2.105:0/549461636 shutdown_connections 2021-11-12T05:47:24.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.304+0000 7f67e266d700 1 -- 172.21.2.105:0/549461636 wait complete. 2021-11-12T05:47:24.316 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder' 2021-11-12T05:47:24.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.364+0000 7f6e79d3a700 1 Processor -- start 2021-11-12T05:47:24.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.364+0000 7f6e79d3a700 1 -- start start 2021-11-12T05:47:24.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.364+0000 7f6e79d3a700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f6e740ad080 0x7f6e740af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:24.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.364+0000 7f6e79d3a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6e740ac280 0x7f6e740ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:24.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.364+0000 7f6e79d3a700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e740ac7b0 con 0x7f6e7414abe0 2021-11-12T05:47:24.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.364+0000 7f6e79d3a700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e741488a0 con 0x7f6e740ad080 2021-11-12T05:47:24.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.364+0000 7f6e79d3a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e740ac9e0 con 0x7f6e740ac280 2021-11-12T05:47:24.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.364+0000 7f6e73fff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f6e7414abe0 0x7f6e7414b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:58378/0 (socket says 172.21.2.105:58378) 2021-11-12T05:47:24.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.364+0000 7f6e73fff700 1 -- 172.21.2.105:0/3155736535 learned_addr learned my addr 172.21.2.105:0/3155736535 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:24.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.364+0000 7f6e737fe700 1 --2- 172.21.2.105:0/3155736535 >> v2:172.21.2.105:3300/0 conn(0x7f6e740ad080 0x7f6e740af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:24.374 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.364+0000 7f6e737fe700 1 -- 172.21.2.105:0/3155736535 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6e740ac280 msgr2=0x7f6e740ad460 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:47:24.374 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.364+0000 7f6e737fe700 1 --2- 172.21.2.105:0/3155736535 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6e740ac280 0x7f6e740ad460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:24.374 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.364+0000 7f6e737fe700 1 -- 172.21.2.105:0/3155736535 >> v1:172.21.2.105:6789/0 conn(0x7f6e7414abe0 legacy=0x7f6e7414b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:24.375 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.364+0000 7f6e737fe700 1 -- 172.21.2.105:0/3155736535 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e740b0b30 con 0x7f6e740ad080 2021-11-12T05:47:24.375 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.364+0000 7f6e737fe700 1 --2- 172.21.2.105:0/3155736535 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6e740ad080 0x7f6e740af730 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7f6e64002f70 tx=0x7f6e64006df0).ready entity=mon.0 client_cookie=6ba342ca2860630b server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:24.375 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.364+0000 7f6e727fc700 1 -- 172.21.2.105:0/3155736535 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e6400d570 con 0x7f6e740ad080 2021-11-12T05:47:24.375 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.364+0000 7f6e727fc700 1 -- 172.21.2.105:0/3155736535 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e64000e90 con 0x7f6e740ad080 2021-11-12T05:47:24.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.364+0000 7f6e727fc700 1 -- 172.21.2.105:0/3155736535 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e6400d900 con 0x7f6e740ad080 2021-11-12T05:47:24.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.364+0000 7f6e79d3a700 1 -- 172.21.2.105:0/3155736535 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6e740ad080 msgr2=0x7f6e740af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:24.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.364+0000 7f6e79d3a700 1 --2- 172.21.2.105:0/3155736535 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6e740ad080 0x7f6e740af730 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7f6e64002f70 tx=0x7f6e64006df0).stop 2021-11-12T05:47:24.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.364+0000 7f6e79d3a700 1 -- 172.21.2.105:0/3155736535 shutdown_connections 2021-11-12T05:47:24.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.364+0000 7f6e79d3a700 1 --2- 172.21.2.105:0/3155736535 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6e740ac280 0x7f6e740ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:24.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.364+0000 7f6e79d3a700 1 --2- 172.21.2.105:0/3155736535 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6e740ad080 0x7f6e740af730 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:24.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.364+0000 7f6e79d3a700 1 -- 172.21.2.105:0/3155736535 >> 172.21.2.105:0/3155736535 conn(0x7f6e740b5370 msgr2=0x7f6e740b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:24.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.364+0000 7f6e79d3a700 1 -- 172.21.2.105:0/3155736535 shutdown_connections 2021-11-12T05:47:24.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.364+0000 7f6e79d3a700 1 -- 172.21.2.105:0/3155736535 wait complete. 2021-11-12T05:47:24.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.364+0000 7f6e79d3a700 1 Processor -- start 2021-11-12T05:47:24.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.364+0000 7f6e79d3a700 1 -- start start 2021-11-12T05:47:24.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.364+0000 7f6e79d3a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6e740ac280 0x7f6e74064050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:24.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.364+0000 7f6e79d3a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6e740ad080 0x7f6e740ab270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:24.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.364+0000 7f6e79d3a700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6e7414abe0 0x7f6e74066a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:24.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.364+0000 7f6e79d3a700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e740aa170 con 0x7f6e740ad080 2021-11-12T05:47:24.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.364+0000 7f6e79d3a700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e740a9650 con 0x7f6e7414abe0 2021-11-12T05:47:24.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.364+0000 7f6e79d3a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e740aba60 con 0x7f6e740ac280 2021-11-12T05:47:24.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.364+0000 7f6e72ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6e740ad080 0x7f6e740ab270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:24.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.364+0000 7f6e72ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6e740ad080 0x7f6e740ab270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47988/0 (socket says 172.21.2.105:47988) 2021-11-12T05:47:24.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.364+0000 7f6e72ffd700 1 -- 172.21.2.105:0/2103791403 learned_addr learned my addr 172.21.2.105:0/2103791403 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:24.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.368+0000 7f6e72ffd700 1 -- 172.21.2.105:0/2103791403 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6e740ac280 msgr2=0x7f6e74064050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:24.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.368+0000 7f6e72ffd700 1 --2- 172.21.2.105:0/2103791403 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6e740ac280 0x7f6e74064050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:24.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.368+0000 7f6e72ffd700 1 -- 172.21.2.105:0/2103791403 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6e7414abe0 msgr2=0x7f6e74066a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:24.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.368+0000 7f6e72ffd700 1 --2- 172.21.2.105:0/2103791403 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6e7414abe0 0x7f6e74066a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:24.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.368+0000 7f6e72ffd700 1 -- 172.21.2.105:0/2103791403 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e6400b180 con 0x7f6e740ad080 2021-11-12T05:47:24.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.368+0000 7f6e72ffd700 1 --2- 172.21.2.105:0/2103791403 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6e740ad080 0x7f6e740ab270 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7f6e68002fb0 tx=0x7f6e68006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:24.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.368+0000 7f6e70ff9700 1 -- 172.21.2.105:0/2103791403 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e68013460 con 0x7f6e740ad080 2021-11-12T05:47:24.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.368+0000 7f6e70ff9700 1 -- 172.21.2.105:0/2103791403 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e680135c0 con 0x7f6e740ad080 2021-11-12T05:47:24.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.368+0000 7f6e79d3a700 1 -- 172.21.2.105:0/2103791403 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e740abd00 con 0x7f6e740ad080 2021-11-12T05:47:24.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.368+0000 7f6e79d3a700 1 -- 172.21.2.105:0/2103791403 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e740a9b00 con 0x7f6e740ad080 2021-11-12T05:47:24.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.368+0000 7f6e70ff9700 1 -- 172.21.2.105:0/2103791403 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e68013920 con 0x7f6e740ad080 2021-11-12T05:47:24.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.368+0000 7f6e79d3a700 1 -- 172.21.2.105:0/2103791403 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e4c003410 con 0x7f6e740ad080 2021-11-12T05:47:24.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.368+0000 7f6e70ff9700 1 -- 172.21.2.105:0/2103791403 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6e6800f070 con 0x7f6e740ad080 2021-11-12T05:47:24.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.368+0000 7f6e70ff9700 1 --2- 172.21.2.105:0/2103791403 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6e540536f0 0x7f6e54055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:24.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.368+0000 7f6e70ff9700 1 -- 172.21.2.105:0/2103791403 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5725+0+0 (secure 0 0 0) 0x7f6e6806b2c0 con 0x7f6e740ad080 2021-11-12T05:47:24.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.368+0000 7f6e737fe700 1 --2- 172.21.2.105:0/2103791403 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6e540536f0 0x7f6e54055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:24.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.368+0000 7f6e737fe700 1 --2- 172.21.2.105:0/2103791403 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6e540536f0 0x7f6e54055bb0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f6e64002f70 tx=0x7f6e64015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:24.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.368+0000 7f6e70ff9700 1 -- 172.21.2.105:0/2103791403 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6e68042470 con 0x7f6e740ad080 2021-11-12T05:47:24.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:24.484+0000 7f6e79d3a700 1 -- 172.21.2.105:0/2103791403 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]} v 0) v1 -- 0x7f6e4c003c40 con 0x7f6e740ad080 2021-11-12T05:47:24.976 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:47:24.979 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:47:24.983 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:47:24.986 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:47:24.990 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:47:25.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.148+0000 7f6e70ff9700 1 -- 172.21.2.105:0/2103791403 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]}]=0 v276) v1 ==== 139+0+0 (secure 0 0 0) 0x7f6e68045a90 con 0x7f6e740ad080 2021-11-12T05:47:25.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.152+0000 7f6e79d3a700 1 -- 172.21.2.105:0/2103791403 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6e540536f0 msgr2=0x7f6e54055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:25.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.152+0000 7f6e79d3a700 1 --2- 172.21.2.105:0/2103791403 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6e540536f0 0x7f6e54055bb0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f6e64002f70 tx=0x7f6e64015000).stop 2021-11-12T05:47:25.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.152+0000 7f6e79d3a700 1 -- 172.21.2.105:0/2103791403 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6e740ad080 msgr2=0x7f6e740ab270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:25.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.152+0000 7f6e79d3a700 1 --2- 172.21.2.105:0/2103791403 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6e740ad080 0x7f6e740ab270 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7f6e68002fb0 tx=0x7f6e68006df0).stop 2021-11-12T05:47:25.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.152+0000 7f6e79d3a700 1 -- 172.21.2.105:0/2103791403 shutdown_connections 2021-11-12T05:47:25.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.152+0000 7f6e79d3a700 1 --2- 172.21.2.105:0/2103791403 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6e540536f0 0x7f6e54055bb0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:25.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.152+0000 7f6e79d3a700 1 --2- 172.21.2.105:0/2103791403 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6e7414abe0 0x7f6e74066a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:25.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.152+0000 7f6e79d3a700 1 --2- 172.21.2.105:0/2103791403 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6e740ad080 0x7f6e740ab270 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:25.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.152+0000 7f6e79d3a700 1 --2- 172.21.2.105:0/2103791403 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6e740ac280 0x7f6e74064050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:25.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.152+0000 7f6e79d3a700 1 -- 172.21.2.105:0/2103791403 >> 172.21.2.105:0/2103791403 conn(0x7f6e740b5370 msgr2=0x7f6e740ae880 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:25.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.152+0000 7f6e79d3a700 1 -- 172.21.2.105:0/2103791403 shutdown_connections 2021-11-12T05:47:25.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.152+0000 7f6e79d3a700 1 -- 172.21.2.105:0/2103791403 wait complete. 2021-11-12T05:47:25.166 INFO:tasks.cephfs_test_runner:test_cap_revoke_nonresponder (tasks.cephfs.test_misc.TestMisc) ... ok 2021-11-12T05:47:25.167 INFO:tasks.cephfs_test_runner:Starting test: test_dump_inode (tasks.cephfs.test_misc.TestMisc) 2021-11-12T05:47:25.167 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode' 2021-11-12T05:47:25.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6547589700 1 Processor -- start 2021-11-12T05:47:25.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6547589700 1 -- start start 2021-11-12T05:47:25.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6547589700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f65400626b0 0x7f6540062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:25.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6547589700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f65400af750 0x7f6540130370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:25.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6547589700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6540130cf0 con 0x7f6540130860 2021-11-12T05:47:25.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6547589700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65400b0d50 con 0x7f65400626b0 2021-11-12T05:47:25.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6547589700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65400ad380 con 0x7f65400af750 2021-11-12T05:47:25.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6545325700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f65400626b0 0x7f6540062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:25.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6545325700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f65400626b0 0x7f6540062a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:47992/0 (socket says 172.21.2.105:47992) 2021-11-12T05:47:25.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6545325700 1 -- 172.21.2.105:0/2080645278 learned_addr learned my addr 172.21.2.105:0/2080645278 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:25.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6545325700 1 -- 172.21.2.105:0/2080645278 >> v2:172.21.2.115:3300/0 conn(0x7f65400af750 msgr2=0x7f6540130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:25.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6545325700 1 --2- 172.21.2.105:0/2080645278 >> v2:172.21.2.115:3300/0 conn(0x7f65400af750 0x7f6540130370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:25.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6545325700 1 -- 172.21.2.105:0/2080645278 >> v1:172.21.2.115:6789/0 conn(0x7f6540130860 legacy=0x7f654014a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:25.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6545325700 1 -- 172.21.2.105:0/2080645278 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65400ae190 con 0x7f65400626b0 2021-11-12T05:47:25.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6545325700 1 --2- 172.21.2.105:0/2080645278 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f65400626b0 0x7f6540062a90 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7f65400b0690 tx=0x7f6534006eb0).ready entity=mon.0 client_cookie=6ede7e09e6d146dc server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:25.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6533fff700 1 -- 172.21.2.105:0/2080645278 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f653400d5c0 con 0x7f65400626b0 2021-11-12T05:47:25.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6533fff700 1 -- 172.21.2.105:0/2080645278 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6534000e90 con 0x7f65400626b0 2021-11-12T05:47:25.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6533fff700 1 -- 172.21.2.105:0/2080645278 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f653400d910 con 0x7f65400626b0 2021-11-12T05:47:25.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6547589700 1 -- 172.21.2.105:0/2080645278 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f65400626b0 msgr2=0x7f6540062a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:25.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6547589700 1 --2- 172.21.2.105:0/2080645278 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f65400626b0 0x7f6540062a90 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7f65400b0690 tx=0x7f6534006eb0).stop 2021-11-12T05:47:25.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6547589700 1 -- 172.21.2.105:0/2080645278 shutdown_connections 2021-11-12T05:47:25.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6547589700 1 --2- 172.21.2.105:0/2080645278 >> v2:172.21.2.115:3300/0 conn(0x7f65400af750 0x7f6540130370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:25.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6547589700 1 --2- 172.21.2.105:0/2080645278 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f65400626b0 0x7f6540062a90 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:25.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6547589700 1 -- 172.21.2.105:0/2080645278 >> 172.21.2.105:0/2080645278 conn(0x7f65400b5320 msgr2=0x7f65400b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:25.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6547589700 1 -- 172.21.2.105:0/2080645278 shutdown_connections 2021-11-12T05:47:25.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6547589700 1 -- 172.21.2.105:0/2080645278 wait complete. 2021-11-12T05:47:25.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6547589700 1 Processor -- start 2021-11-12T05:47:25.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6547589700 1 -- start start 2021-11-12T05:47:25.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6547589700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f65400626b0 0x7f6540064270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:25.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6547589700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f65400af750 0x7f65401569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:25.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6547589700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6540130860 0x7f6540156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:25.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6547589700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6540064760 con 0x7f65400af750 2021-11-12T05:47:25.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6547589700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6540066c90 con 0x7f6540130860 2021-11-12T05:47:25.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6547589700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6540064ba0 con 0x7f65400626b0 2021-11-12T05:47:25.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6544b24700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f65400af750 0x7f65401569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:25.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6544b24700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f65400af750 0x7f65401569b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48000/0 (socket says 172.21.2.105:48000) 2021-11-12T05:47:25.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6544b24700 1 -- 172.21.2.105:0/2460058133 learned_addr learned my addr 172.21.2.105:0/2460058133 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:25.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6545325700 1 --2- 172.21.2.105:0/2460058133 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f65400626b0 0x7f6540064270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:25.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6545b26700 1 --2- 172.21.2.105:0/2460058133 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6540130860 0x7f6540156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:25.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6544b24700 1 -- 172.21.2.105:0/2460058133 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f65400626b0 msgr2=0x7f6540064270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:25.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6544b24700 1 --2- 172.21.2.105:0/2460058133 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f65400626b0 0x7f6540064270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:25.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6544b24700 1 -- 172.21.2.105:0/2460058133 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6540130860 msgr2=0x7f6540156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:25.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6544b24700 1 --2- 172.21.2.105:0/2460058133 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6540130860 0x7f6540156ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:25.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6544b24700 1 -- 172.21.2.105:0/2460058133 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f653400b1e0 con 0x7f65400af750 2021-11-12T05:47:25.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6545325700 1 --2- 172.21.2.105:0/2460058133 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f65400626b0 0x7f6540064270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:47:25.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.216+0000 7f6544b24700 1 --2- 172.21.2.105:0/2460058133 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f65400af750 0x7f65401569b0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7f653c002f70 tx=0x7f653c006e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:25.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.220+0000 7f65327fc700 1 -- 172.21.2.105:0/2460058133 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f653c013460 con 0x7f65400af750 2021-11-12T05:47:25.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.220+0000 7f65327fc700 1 -- 172.21.2.105:0/2460058133 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f653c0135c0 con 0x7f65400af750 2021-11-12T05:47:25.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.220+0000 7f65327fc700 1 -- 172.21.2.105:0/2460058133 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f653c013920 con 0x7f65400af750 2021-11-12T05:47:25.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.220+0000 7f6547589700 1 -- 172.21.2.105:0/2460058133 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f654014e920 con 0x7f65400af750 2021-11-12T05:47:25.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.220+0000 7f6547589700 1 -- 172.21.2.105:0/2460058133 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f654014eee0 con 0x7f65400af750 2021-11-12T05:47:25.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.220+0000 7f6547589700 1 -- 172.21.2.105:0/2460058133 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6540057350 con 0x7f65400af750 2021-11-12T05:47:25.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.220+0000 7f65327fc700 1 -- 172.21.2.105:0/2460058133 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f653c01a060 con 0x7f65400af750 2021-11-12T05:47:25.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.220+0000 7f65327fc700 1 --2- 172.21.2.105:0/2460058133 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f65200536f0 0x7f6520055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:25.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.220+0000 7f65327fc700 1 -- 172.21.2.105:0/2460058133 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5725+0+0 (secure 0 0 0) 0x7f653c06b3c0 con 0x7f65400af750 2021-11-12T05:47:25.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.220+0000 7f6545325700 1 --2- 172.21.2.105:0/2460058133 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f65200536f0 0x7f6520055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:25.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.220+0000 7f6545325700 1 --2- 172.21.2.105:0/2460058133 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f65200536f0 0x7f6520055bb0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f653401a000 tx=0x7f6534015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:25.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.220+0000 7f65327fc700 1 -- 172.21.2.105:0/2460058133 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f653c042570 con 0x7f65400af750 2021-11-12T05:47:25.336 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:25.332+0000 7f6547589700 1 -- 172.21.2.105:0/2460058133 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]} v 0) v1 -- 0x7f6540064900 con 0x7f65400af750 2021-11-12T05:47:26.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.160+0000 7f65327fc700 1 -- 172.21.2.105:0/2460058133 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]}]=0 v277) v1 ==== 129+0+0 (secure 0 0 0) 0x7f653c045b90 con 0x7f65400af750 2021-11-12T05:47:26.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.160+0000 7f6547589700 1 -- 172.21.2.105:0/2460058133 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f65200536f0 msgr2=0x7f6520055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:26.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.160+0000 7f6547589700 1 --2- 172.21.2.105:0/2460058133 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f65200536f0 0x7f6520055bb0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f653401a000 tx=0x7f6534015000).stop 2021-11-12T05:47:26.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.160+0000 7f6547589700 1 -- 172.21.2.105:0/2460058133 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f65400af750 msgr2=0x7f65401569b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:26.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.160+0000 7f6547589700 1 --2- 172.21.2.105:0/2460058133 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f65400af750 0x7f65401569b0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7f653c002f70 tx=0x7f653c006e90).stop 2021-11-12T05:47:26.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.160+0000 7f6547589700 1 -- 172.21.2.105:0/2460058133 shutdown_connections 2021-11-12T05:47:26.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.160+0000 7f6547589700 1 --2- 172.21.2.105:0/2460058133 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f65200536f0 0x7f6520055bb0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:26.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.160+0000 7f6547589700 1 --2- 172.21.2.105:0/2460058133 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6540130860 0x7f6540156ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:26.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.160+0000 7f6547589700 1 --2- 172.21.2.105:0/2460058133 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f65400af750 0x7f65401569b0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:26.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.160+0000 7f6547589700 1 --2- 172.21.2.105:0/2460058133 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f65400626b0 0x7f6540064270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:26.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.160+0000 7f6547589700 1 -- 172.21.2.105:0/2460058133 >> 172.21.2.105:0/2460058133 conn(0x7f65400b5320 msgr2=0x7f654014a860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:26.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.160+0000 7f6547589700 1 -- 172.21.2.105:0/2460058133 shutdown_connections 2021-11-12T05:47:26.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.160+0000 7f6547589700 1 -- 172.21.2.105:0/2460058133 wait complete. 2021-11-12T05:47:26.173 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-11-12T05:47:26.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.224+0000 7f0092c44700 1 Processor -- start 2021-11-12T05:47:26.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.224+0000 7f0092c44700 1 -- start start 2021-11-12T05:47:26.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.224+0000 7f0092c44700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f008c0aca40 0x7f008c0ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:26.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.224+0000 7f0092c44700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f008c144180 0x7f008c144610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:26.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.224+0000 7f0092c44700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f008c0b1840 con 0x7f008c0b0520 2021-11-12T05:47:26.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.224+0000 7f0092c44700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f008c0b09d0 con 0x7f008c0aca40 2021-11-12T05:47:26.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.224+0000 7f0092c44700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f008c0af2b0 con 0x7f008c144180 2021-11-12T05:47:26.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.224+0000 7f008bfff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f008c0b0520 0x7f008c1473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:58406/0 (socket says 172.21.2.105:58406) 2021-11-12T05:47:26.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.224+0000 7f008bfff700 1 -- 172.21.2.105:0/3126406545 learned_addr learned my addr 172.21.2.105:0/3126406545 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:26.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.224+0000 7f008b7fe700 1 -- 172.21.2.105:0/3126406545 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3841150146 0 0) 0x7f008c0b1840 con 0x7f008c0b0520 2021-11-12T05:47:26.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.224+0000 7f008b7fe700 1 -- 172.21.2.105:0/3126406545 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f006c003260 con 0x7f008c0b0520 2021-11-12T05:47:26.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f00909e0700 1 --2- 172.21.2.105:0/3126406545 >> v2:172.21.2.115:3300/0 conn(0x7f008c0aca40 0x7f008c0ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:26.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f008b7fe700 1 -- 172.21.2.105:0/3126406545 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1591784699 0 0) 0x7f006c003260 con 0x7f008c0b0520 2021-11-12T05:47:26.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f008b7fe700 1 -- 172.21.2.105:0/3126406545 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f008c144180 msgr2=0x7f008c144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:26.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f008b7fe700 1 --2- 172.21.2.105:0/3126406545 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f008c144180 0x7f008c144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:26.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f008b7fe700 1 -- 172.21.2.105:0/3126406545 >> v2:172.21.2.115:3300/0 conn(0x7f008c0aca40 msgr2=0x7f008c0ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:26.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f008b7fe700 1 --2- 172.21.2.105:0/3126406545 >> v2:172.21.2.115:3300/0 conn(0x7f008c0aca40 0x7f008c0ace20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:26.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f008b7fe700 1 -- 172.21.2.105:0/3126406545 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f008c0b1a70 con 0x7f008c0b0520 2021-11-12T05:47:26.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f008b7fe700 1 -- 172.21.2.105:0/3126406545 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f007c001660 con 0x7f008c0b0520 2021-11-12T05:47:26.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f008b7fe700 1 -- 172.21.2.105:0/3126406545 >> v1:172.21.2.105:6789/0 conn(0x7f008c0b0520 legacy=0x7f008c1473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:26.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f008b7fe700 1 --2- 172.21.2.105:0/3126406545 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f006c0037d0 0x7f006c003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:26.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f008b7fe700 1 --2- 172.21.2.105:0/3126406545 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f008c144180 0x7f006c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:26.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f008b7fe700 1 --2- 172.21.2.105:0/3126406545 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f006c004bf0 0x7f006c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:26.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f008b7fe700 1 -- 172.21.2.105:0/3126406545 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008c0b09d0 con 0x7f006c0037d0 2021-11-12T05:47:26.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f008b7fe700 1 -- 172.21.2.105:0/3126406545 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008c0af2b0 con 0x7f006c004bf0 2021-11-12T05:47:26.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f008b7fe700 1 -- 172.21.2.105:0/3126406545 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f006c005300 con 0x7f008c144180 2021-11-12T05:47:26.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f00909e0700 1 --2- 172.21.2.105:0/3126406545 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f006c0037d0 0x7f006c003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:26.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f00911e1700 1 --2- 172.21.2.105:0/3126406545 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f006c004bf0 0x7f006c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:26.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f00909e0700 1 -- 172.21.2.105:0/3126406545 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f008c144180 msgr2=0x7f006c004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:26.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f00909e0700 1 --2- 172.21.2.105:0/3126406545 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f008c144180 0x7f006c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:26.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f00909e0700 1 -- 172.21.2.105:0/3126406545 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f006c004bf0 msgr2=0x7f006c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:26.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f00909e0700 1 --2- 172.21.2.105:0/3126406545 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f006c004bf0 0x7f006c00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:26.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f00909e0700 1 -- 172.21.2.105:0/3126406545 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006c003260 con 0x7f006c0037d0 2021-11-12T05:47:26.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f00909e0700 1 --2- 172.21.2.105:0/3126406545 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f006c0037d0 0x7f006c003bf0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7f0074007000 tx=0x7f0074008040).ready entity=mon.0 client_cookie=1bbc56b3e4cf8a22 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:26.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f008b7fe700 1 -- 172.21.2.105:0/3126406545 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0074012470 con 0x7f006c0037d0 2021-11-12T05:47:26.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f008b7fe700 1 -- 172.21.2.105:0/3126406545 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007400c030 con 0x7f006c0037d0 2021-11-12T05:47:26.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f008b7fe700 1 -- 172.21.2.105:0/3126406545 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00740127c0 con 0x7f006c0037d0 2021-11-12T05:47:26.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f0092c44700 1 -- 172.21.2.105:0/3126406545 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f006c0037d0 msgr2=0x7f006c003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:26.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f0092c44700 1 --2- 172.21.2.105:0/3126406545 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f006c0037d0 0x7f006c003bf0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7f0074007000 tx=0x7f0074008040).stop 2021-11-12T05:47:26.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f00911e1700 1 -- 172.21.2.105:0/3126406545 reap_dead start 2021-11-12T05:47:26.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f0092c44700 1 -- 172.21.2.105:0/3126406545 shutdown_connections 2021-11-12T05:47:26.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f0092c44700 1 -- 172.21.2.105:0/3126406545 >> 172.21.2.105:0/3126406545 conn(0x7f008c05c490 msgr2=0x7f008c0b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:26.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f0092c44700 1 -- 172.21.2.105:0/3126406545 shutdown_connections 2021-11-12T05:47:26.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f0092c44700 1 -- 172.21.2.105:0/3126406545 wait complete. 2021-11-12T05:47:26.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f0092c44700 1 Processor -- start 2021-11-12T05:47:26.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f0092c44700 1 -- start start 2021-11-12T05:47:26.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f0092c44700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f006c0037d0 0x7f008c0662f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:26.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f0092c44700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f008c157490 0x7f008c066bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:26.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f0092c44700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f008c0670b0 0x7f008c062500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:26.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f0092c44700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008c064fe0 con 0x7f008c157490 2021-11-12T05:47:26.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f0092c44700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008c065210 con 0x7f008c0670b0 2021-11-12T05:47:26.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f0092c44700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f008c0654b0 con 0x7f006c0037d0 2021-11-12T05:47:26.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f008bfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f008c157490 0x7f008c066bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:26.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f008bfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f008c157490 0x7f008c066bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48022/0 (socket says 172.21.2.105:48022) 2021-11-12T05:47:26.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f008bfff700 1 -- 172.21.2.105:0/459032617 learned_addr learned my addr 172.21.2.105:0/459032617 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:26.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f008bfff700 1 -- 172.21.2.105:0/459032617 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f006c0037d0 msgr2=0x7f008c0662f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:26.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f008bfff700 1 --2- 172.21.2.105:0/459032617 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f006c0037d0 0x7f008c0662f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:26.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f008bfff700 1 -- 172.21.2.105:0/459032617 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f008c0670b0 msgr2=0x7f008c062500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:26.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f008bfff700 1 --2- 172.21.2.105:0/459032617 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f008c0670b0 0x7f008c062500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:26.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f008bfff700 1 -- 172.21.2.105:0/459032617 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f008c0629f0 con 0x7f008c157490 2021-11-12T05:47:26.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f008bfff700 1 --2- 172.21.2.105:0/459032617 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f008c157490 0x7f008c066bc0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7f007c001370 tx=0x7f007c001b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:26.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f0089ffb700 1 -- 172.21.2.105:0/459032617 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f007c007170 con 0x7f008c157490 2021-11-12T05:47:26.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f0089ffb700 1 -- 172.21.2.105:0/459032617 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007c0072d0 con 0x7f008c157490 2021-11-12T05:47:26.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f0092c44700 1 -- 172.21.2.105:0/459032617 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f008c062ca0 con 0x7f008c157490 2021-11-12T05:47:26.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f0089ffb700 1 -- 172.21.2.105:0/459032617 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f007c004920 con 0x7f008c157490 2021-11-12T05:47:26.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.228+0000 7f0092c44700 1 -- 172.21.2.105:0/459032617 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f008c159e00 con 0x7f008c157490 2021-11-12T05:47:26.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.232+0000 7f0092c44700 1 -- 172.21.2.105:0/459032617 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f008c065670 con 0x7f008c157490 2021-11-12T05:47:26.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.232+0000 7f0089ffb700 1 -- 172.21.2.105:0/459032617 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f007c004a80 con 0x7f008c157490 2021-11-12T05:47:26.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.232+0000 7f0089ffb700 1 --2- 172.21.2.105:0/459032617 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0070053570 0x7f0070055a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:26.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.232+0000 7f0089ffb700 1 -- 172.21.2.105:0/459032617 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5725+0+0 (secure 0 0 0) 0x7f007c06b5b0 con 0x7f008c157490 2021-11-12T05:47:26.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.232+0000 7f00909e0700 1 --2- 172.21.2.105:0/459032617 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0070053570 0x7f0070055a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:26.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.232+0000 7f00909e0700 1 --2- 172.21.2.105:0/459032617 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0070053570 0x7f0070055a30 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f0074007000 tx=0x7f0074008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:26.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.232+0000 7f0089ffb700 1 -- 172.21.2.105:0/459032617 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f007c042760 con 0x7f008c157490 2021-11-12T05:47:26.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.316+0000 7f0092c44700 1 -- 172.21.2.105:0/459032617 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f008c057350 con 0x7f008c157490 2021-11-12T05:47:26.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.320+0000 7f0089ffb700 1 -- 172.21.2.105:0/459032617 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f007c045d80 con 0x7f008c157490 2021-11-12T05:47:26.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.324+0000 7f0092c44700 1 -- 172.21.2.105:0/459032617 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0070053570 msgr2=0x7f0070055a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:26.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.324+0000 7f0092c44700 1 --2- 172.21.2.105:0/459032617 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0070053570 0x7f0070055a30 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f0074007000 tx=0x7f0074008040).stop 2021-11-12T05:47:26.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.324+0000 7f0092c44700 1 -- 172.21.2.105:0/459032617 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f008c157490 msgr2=0x7f008c066bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:26.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.324+0000 7f0092c44700 1 --2- 172.21.2.105:0/459032617 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f008c157490 0x7f008c066bc0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7f007c001370 tx=0x7f007c001b30).stop 2021-11-12T05:47:26.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.324+0000 7f0092c44700 1 -- 172.21.2.105:0/459032617 shutdown_connections 2021-11-12T05:47:26.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.324+0000 7f0092c44700 1 --2- 172.21.2.105:0/459032617 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0070053570 0x7f0070055a30 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:26.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.324+0000 7f0092c44700 1 --2- 172.21.2.105:0/459032617 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f008c0670b0 0x7f008c062500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:26.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.324+0000 7f0092c44700 1 --2- 172.21.2.105:0/459032617 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f008c157490 0x7f008c066bc0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:26.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.324+0000 7f0092c44700 1 --2- 172.21.2.105:0/459032617 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f006c0037d0 0x7f008c0662f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:26.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.324+0000 7f0092c44700 1 -- 172.21.2.105:0/459032617 >> 172.21.2.105:0/459032617 conn(0x7f008c05c490 msgr2=0x7f008c149070 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:26.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.324+0000 7f0092c44700 1 -- 172.21.2.105:0/459032617 shutdown_connections 2021-11-12T05:47:26.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.324+0000 7f0092c44700 1 -- 172.21.2.105:0/459032617 wait complete. 2021-11-12T05:47:26.334 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-12T05:47:26.335 DEBUG:teuthology.orchestra.run.gibba005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:47:26.342 DEBUG:teuthology.orchestra.run.gibba015:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:47:26.371 DEBUG:teuthology.orchestra.run.gibba016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:47:26.385 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:47:26.398 DEBUG:teuthology.orchestra.run.gibba044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:47:26.410 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-12T05:47:26.411 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:26.411 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:47:26.411 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:47:26.416 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:47:26.417 INFO:teuthology.orchestra.run.gibba016.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-12T05:47:26.417 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-11-12T05:47:26.418 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:26.418 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:47:26.418 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:47:26.443 INFO:teuthology.orchestra.run.gibba038.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-12T05:47:26.444 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:47:26.445 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-12T05:47:26.445 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:26.446 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:47:26.446 DEBUG:teuthology.orchestra.run.gibba044:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:47:26.460 INFO:teuthology.orchestra.run.gibba044.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-12T05:47:26.461 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:47:26.462 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-12T05:47:26.462 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-12T05:47:26.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.512+0000 7f00684c0700 1 Processor -- start 2021-11-12T05:47:26.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.512+0000 7f00684c0700 1 -- start start 2021-11-12T05:47:26.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.512+0000 7f00684c0700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f00600b6760 0x7f0060149ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:26.520 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f00684c0700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f006013fab0 con 0x7f0060142900 2021-11-12T05:47:26.520 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f00684c0700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f006013fd50 con 0x7f00600b6380 2021-11-12T05:47:26.520 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f00684c0700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00600afeb0 con 0x7f00600b6760 2021-11-12T05:47:26.520 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f0065a5b700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f0060142900 0x7f00601390a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:58426/0 (socket says 172.21.2.105:58426) 2021-11-12T05:47:26.521 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f0065a5b700 1 -- 172.21.2.105:0/1643445244 learned_addr learned my addr 172.21.2.105:0/1643445244 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:26.526 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f006525a700 1 -- 172.21.2.105:0/1643445244 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2829502356 0 0) 0x7f006013fab0 con 0x7f0060142900 2021-11-12T05:47:26.526 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f006525a700 1 -- 172.21.2.105:0/1643445244 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0048003260 con 0x7f0060142900 2021-11-12T05:47:26.526 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f0066a5d700 1 --2- 172.21.2.105:0/1643445244 >> v2:172.21.2.115:3300/0 conn(0x7f00600b6760 0x7f0060149ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:26.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f006525a700 1 -- 172.21.2.105:0/1643445244 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1383445949 0 0) 0x7f0048003260 con 0x7f0060142900 2021-11-12T05:47:26.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f006525a700 1 -- 172.21.2.105:0/1643445244 >> v2:172.21.2.115:3300/0 conn(0x7f00600b6760 msgr2=0x7f0060149ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:26.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f006525a700 1 --2- 172.21.2.105:0/1643445244 >> v2:172.21.2.115:3300/0 conn(0x7f00600b6760 0x7f0060149ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:26.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f006525a700 1 -- 172.21.2.105:0/1643445244 >> v1:172.21.2.115:6789/0 conn(0x7f00600b6380 legacy=0x7f006013f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:26.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f006525a700 1 -- 172.21.2.105:0/1643445244 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006013fff0 con 0x7f0060142900 2021-11-12T05:47:26.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f006525a700 1 -- 172.21.2.105:0/1643445244 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f0050001660 con 0x7f0060142900 2021-11-12T05:47:26.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f006525a700 1 -- 172.21.2.105:0/1643445244 >> v1:172.21.2.105:6789/0 conn(0x7f0060142900 legacy=0x7f00601390a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:26.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f006525a700 1 --2- 172.21.2.105:0/1643445244 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0048003820 0x7f0048003c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:26.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f006525a700 1 --2- 172.21.2.105:0/1643445244 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0048004500 0x7f0048004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:26.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f006525a700 1 --2- 172.21.2.105:0/1643445244 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0048004f90 0x7f004800fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:26.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f006525a700 1 -- 172.21.2.105:0/1643445244 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00600afeb0 con 0x7f0048004500 2021-11-12T05:47:26.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f006525a700 1 -- 172.21.2.105:0/1643445244 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0048010290 con 0x7f0048003820 2021-11-12T05:47:26.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f006525a700 1 -- 172.21.2.105:0/1643445244 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0048010450 con 0x7f0048004f90 2021-11-12T05:47:26.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f0065a5b700 1 --2- 172.21.2.105:0/1643445244 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0048004500 0x7f0048004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:26.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f0066a5d700 1 --2- 172.21.2.105:0/1643445244 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0048004f90 0x7f004800fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:26.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f006625c700 1 --2- 172.21.2.105:0/1643445244 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0048003820 0x7f0048003c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:26.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f0065a5b700 1 -- 172.21.2.105:0/1643445244 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0048004f90 msgr2=0x7f004800fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:26.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f0065a5b700 1 --2- 172.21.2.105:0/1643445244 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0048004f90 0x7f004800fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:26.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f0065a5b700 1 -- 172.21.2.105:0/1643445244 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0048003820 msgr2=0x7f0048003c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:26.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f0065a5b700 1 --2- 172.21.2.105:0/1643445244 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0048003820 0x7f0048003c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:26.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f0065a5b700 1 -- 172.21.2.105:0/1643445244 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0048003260 con 0x7f0048004500 2021-11-12T05:47:26.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f0066a5d700 1 -- 172.21.2.105:0/1643445244 reap_dead start 2021-11-12T05:47:26.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f006625c700 1 --2- 172.21.2.105:0/1643445244 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0048003820 0x7f0048003c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:47:26.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f0065a5b700 1 --2- 172.21.2.105:0/1643445244 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0048004500 0x7f0048004980 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f00600b37a0 tx=0x7f006013fc40).ready entity=mon.0 client_cookie=486a915977302140 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:26.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f006525a700 1 -- 172.21.2.105:0/1643445244 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00500070d0 con 0x7f0048004500 2021-11-12T05:47:26.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f006525a700 1 -- 172.21.2.105:0/1643445244 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0050007230 con 0x7f0048004500 2021-11-12T05:47:26.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f006525a700 1 -- 172.21.2.105:0/1643445244 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f005000c8b0 con 0x7f0048004500 2021-11-12T05:47:26.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f00684c0700 1 -- 172.21.2.105:0/1643445244 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0048004500 msgr2=0x7f0048004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:26.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f00684c0700 1 --2- 172.21.2.105:0/1643445244 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0048004500 0x7f0048004980 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f00600b37a0 tx=0x7f006013fc40).stop 2021-11-12T05:47:26.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f00684c0700 1 -- 172.21.2.105:0/1643445244 shutdown_connections 2021-11-12T05:47:26.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f00684c0700 1 --2- 172.21.2.105:0/1643445244 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0048004500 0x7f0048004980 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:26.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f00684c0700 1 -- 172.21.2.105:0/1643445244 >> 172.21.2.105:0/1643445244 conn(0x7f0060063810 msgr2=0x7f00600b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:26.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f00684c0700 1 -- 172.21.2.105:0/1643445244 shutdown_connections 2021-11-12T05:47:26.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f00684c0700 1 -- 172.21.2.105:0/1643445244 wait complete. 2021-11-12T05:47:26.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f00684c0700 1 Processor -- start 2021-11-12T05:47:26.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.516+0000 7f00684c0700 1 -- start start 2021-11-12T05:47:26.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.520+0000 7f00684c0700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0048004500 0x7f0060067610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:26.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.520+0000 7f00684c0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0060064060 0x7f006013c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:26.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.520+0000 7f00684c0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0060139a40 0x7f0060151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:26.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.520+0000 7f00684c0700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0060139ec0 con 0x7f0060139a40 2021-11-12T05:47:26.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.520+0000 7f00684c0700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0060066b80 con 0x7f0048004500 2021-11-12T05:47:26.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.520+0000 7f00684c0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0060066e20 con 0x7f0060064060 2021-11-12T05:47:26.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.520+0000 7f0066a5d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0060139a40 0x7f0060151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:26.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.520+0000 7f0066a5d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0060139a40 0x7f0060151850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48042/0 (socket says 172.21.2.105:48042) 2021-11-12T05:47:26.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.520+0000 7f0066a5d700 1 -- 172.21.2.105:0/2844317155 learned_addr learned my addr 172.21.2.105:0/2844317155 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:26.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.520+0000 7f0066a5d700 1 -- 172.21.2.105:0/2844317155 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0060064060 msgr2=0x7f006013c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:26.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.520+0000 7f0066a5d700 1 --2- 172.21.2.105:0/2844317155 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0060064060 0x7f006013c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:26.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.520+0000 7f0066a5d700 1 -- 172.21.2.105:0/2844317155 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0048004500 msgr2=0x7f0060067610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:26.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.520+0000 7f0066a5d700 1 --2- 172.21.2.105:0/2844317155 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0048004500 0x7f0060067610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:26.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.520+0000 7f0066a5d700 1 -- 172.21.2.105:0/2844317155 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00601513b0 con 0x7f0060139a40 2021-11-12T05:47:26.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.520+0000 7f0066a5d700 1 --2- 172.21.2.105:0/2844317155 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0060139a40 0x7f0060151850 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7f0058001210 tx=0x7f0058008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:26.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.520+0000 7f004f7fe700 1 -- 172.21.2.105:0/2844317155 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f005800fee0 con 0x7f0060139a40 2021-11-12T05:47:26.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.520+0000 7f004f7fe700 1 -- 172.21.2.105:0/2844317155 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005800c030 con 0x7f0060139a40 2021-11-12T05:47:26.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.520+0000 7f004f7fe700 1 -- 172.21.2.105:0/2844317155 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0058013800 con 0x7f0060139a40 2021-11-12T05:47:26.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.520+0000 7f00684c0700 1 -- 172.21.2.105:0/2844317155 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0060151d40 con 0x7f0060139a40 2021-11-12T05:47:26.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.520+0000 7f00684c0700 1 -- 172.21.2.105:0/2844317155 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0060136070 con 0x7f0060139a40 2021-11-12T05:47:26.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.520+0000 7f00684c0700 1 -- 172.21.2.105:0/2844317155 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0060151540 con 0x7f0060139a40 2021-11-12T05:47:26.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.520+0000 7f004f7fe700 1 -- 172.21.2.105:0/2844317155 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0058013960 con 0x7f0060139a40 2021-11-12T05:47:26.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.520+0000 7f004f7fe700 1 --2- 172.21.2.105:0/2844317155 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0040053720 0x7f0040055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:26.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.520+0000 7f004f7fe700 1 -- 172.21.2.105:0/2844317155 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5725+0+0 (secure 0 0 0) 0x7f005806b580 con 0x7f0060139a40 2021-11-12T05:47:26.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.520+0000 7f006625c700 1 --2- 172.21.2.105:0/2844317155 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0040053720 0x7f0040055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:26.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.520+0000 7f006625c700 1 --2- 172.21.2.105:0/2844317155 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0040053720 0x7f0040055be0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f005c008000 tx=0x7f005c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:26.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.524+0000 7f004f7fe700 1 -- 172.21.2.105:0/2844317155 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0058042730 con 0x7f0060139a40 2021-11-12T05:47:26.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.604+0000 7f00684c0700 1 -- 172.21.2.105:0/2844317155 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f006013f300 con 0x7f0060139a40 2021-11-12T05:47:26.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.604+0000 7f004f7fe700 1 -- 172.21.2.105:0/2844317155 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v79) v1 ==== 81+0+29292 (secure 0 0 0) 0x7f0058017020 con 0x7f0060139a40 2021-11-12T05:47:26.611 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:26.611 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:47:26.611 INFO:teuthology.orchestra.run.gibba005.stdout: "epoch": 79, 2021-11-12T05:47:26.612 INFO:teuthology.orchestra.run.gibba005.stdout: "fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", 2021-11-12T05:47:26.612 INFO:teuthology.orchestra.run.gibba005.stdout: "created": "2021-11-12T05:40:19.986390+0000", 2021-11-12T05:47:26.612 INFO:teuthology.orchestra.run.gibba005.stdout: "modified": "2021-11-12T05:47:24.141939+0000", 2021-11-12T05:47:26.613 INFO:teuthology.orchestra.run.gibba005.stdout: "last_up_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:47:26.613 INFO:teuthology.orchestra.run.gibba005.stdout: "last_in_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:47:26.613 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-12T05:47:26.614 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_num": 5799936, 2021-11-12T05:47:26.614 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_set": [ 2021-11-12T05:47:26.614 INFO:teuthology.orchestra.run.gibba005.stdout: "pglog_hardlimit", 2021-11-12T05:47:26.615 INFO:teuthology.orchestra.run.gibba005.stdout: "purged_snapdirs", 2021-11-12T05:47:26.615 INFO:teuthology.orchestra.run.gibba005.stdout: "recovery_deletes", 2021-11-12T05:47:26.615 INFO:teuthology.orchestra.run.gibba005.stdout: "sortbitwise" 2021-11-12T05:47:26.615 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:47:26.616 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_version": 5, 2021-11-12T05:47:26.616 INFO:teuthology.orchestra.run.gibba005.stdout: "full_ratio": 0.94999998807907104, 2021-11-12T05:47:26.616 INFO:teuthology.orchestra.run.gibba005.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-12T05:47:26.617 INFO:teuthology.orchestra.run.gibba005.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-12T05:47:26.617 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_snapshot": "", 2021-11-12T05:47:26.617 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_max": 14, 2021-11-12T05:47:26.618 INFO:teuthology.orchestra.run.gibba005.stdout: "max_osd": 8, 2021-11-12T05:47:26.618 INFO:teuthology.orchestra.run.gibba005.stdout: "require_min_compat_client": "jewel", 2021-11-12T05:47:26.618 INFO:teuthology.orchestra.run.gibba005.stdout: "min_compat_client": "jewel", 2021-11-12T05:47:26.618 INFO:teuthology.orchestra.run.gibba005.stdout: "require_osd_release": "octopus", 2021-11-12T05:47:26.619 INFO:teuthology.orchestra.run.gibba005.stdout: "pools": [ 2021-11-12T05:47:26.619 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.619 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 1, 2021-11-12T05:47:26.619 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "device_health_metrics", 2021-11-12T05:47:26.620 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:22.022116+0000", 2021-11-12T05:47:26.620 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:47:26.620 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:47:26.620 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:47:26.621 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:47:26.621 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:47:26.621 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:47:26.622 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:47:26.622 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:47:26.622 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 1, 2021-11-12T05:47:26.622 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 1, 2021-11-12T05:47:26.623 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 1, 2021-11-12T05:47:26.623 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 1, 2021-11-12T05:47:26.623 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 1, 2021-11-12T05:47:26.624 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:47:26.624 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:47:26.624 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:47:26.624 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:47:26.625 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:47:26.625 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:47:26.625 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:47:26.625 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.626 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "16", 2021-11-12T05:47:26.626 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:47:26.626 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:47:26.626 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:47:26.627 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:47:26.627 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:47:26.627 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:47:26.627 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:47:26.627 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:47:26.628 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:47:26.628 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:47:26.628 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:47:26.628 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:47:26.629 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:47:26.629 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:47:26.629 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:47:26.630 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:47:26.630 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:47:26.630 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:47:26.630 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:47:26.631 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:47:26.631 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:47:26.631 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:47:26.632 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:47:26.632 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:47:26.632 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:47:26.633 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:47:26.633 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.633 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:47:26.633 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:47:26.634 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:47:26.634 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:47:26.634 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:47:26.635 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:47:26.635 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:47:26.635 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:47:26.635 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:47:26.636 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:47:26.636 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:47:26.636 INFO:teuthology.orchestra.run.gibba005.stdout: "options": { 2021-11-12T05:47:26.636 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_min": 1 2021-11-12T05:47:26.636 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.637 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:47:26.637 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr_devicehealth": {} 2021-11-12T05:47:26.637 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:26.637 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.638 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.638 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 2, 2021-11-12T05:47:26.638 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "rbd", 2021-11-12T05:47:26.638 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:29.953617+0000", 2021-11-12T05:47:26.639 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:47:26.639 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:47:26.639 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:47:26.639 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:47:26.639 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:47:26.640 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:47:26.640 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:47:26.640 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:47:26.640 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:47:26.641 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:47:26.641 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:47:26.641 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:47:26.641 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:47:26.642 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:47:26.642 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:47:26.642 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:47:26.642 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:47:26.642 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:47:26.643 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:47:26.643 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:47:26.643 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.644 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "19", 2021-11-12T05:47:26.644 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:47:26.644 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:47:26.644 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:47:26.644 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:47:26.645 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:47:26.645 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:47:26.645 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:47:26.646 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:47:26.646 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:47:26.646 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:47:26.647 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:47:26.647 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:47:26.647 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:47:26.648 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:47:26.648 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:47:26.648 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:47:26.648 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:47:26.649 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:47:26.649 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:47:26.649 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:47:26.649 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:47:26.650 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:47:26.650 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:47:26.650 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:47:26.650 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:47:26.650 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:47:26.651 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.651 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:47:26.651 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:47:26.651 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:47:26.652 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:47:26.652 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:47:26.652 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:47:26.653 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:47:26.653 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:47:26.653 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:47:26.653 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:47:26.654 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:47:26.654 INFO:teuthology.orchestra.run.gibba005.stdout: "options": {}, 2021-11-12T05:47:26.654 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:47:26.654 INFO:teuthology.orchestra.run.gibba005.stdout: "rbd": {} 2021-11-12T05:47:26.655 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:26.655 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:26.655 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:47:26.655 INFO:teuthology.orchestra.run.gibba005.stdout: "osds": [ 2021-11-12T05:47:26.656 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.656 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:47:26.656 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "ee8e30a0-4819-4475-80ec-dd3ee7d01322", 2021-11-12T05:47:26.656 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:26.657 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:26.657 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:26.657 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:26.657 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:26.658 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:26.658 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:26.658 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 72, 2021-11-12T05:47:26.658 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:26.659 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:26.659 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:26.659 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:26.659 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.659 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:26.660 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6802", 2021-11-12T05:47:26.660 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:26.660 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.660 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.661 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:26.661 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6803", 2021-11-12T05:47:26.661 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:26.661 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:26.662 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.662 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.662 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:26.662 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:26.662 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.663 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:26.663 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6804", 2021-11-12T05:47:26.663 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:26.663 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.664 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.664 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:26.664 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6805", 2021-11-12T05:47:26.664 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:26.664 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:26.665 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.665 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.665 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:26.665 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:26.666 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.666 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:26.666 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6808", 2021-11-12T05:47:26.666 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:26.666 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.667 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.667 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:26.667 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6809", 2021-11-12T05:47:26.667 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:26.668 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:26.668 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.668 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.668 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:26.669 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:26.669 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.669 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:26.669 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6806", 2021-11-12T05:47:26.669 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:26.670 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.670 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.670 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:26.670 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6807", 2021-11-12T05:47:26.671 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:26.671 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:26.671 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.671 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.671 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6803/14874", 2021-11-12T05:47:26.672 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6805/14874", 2021-11-12T05:47:26.672 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6809/14874", 2021-11-12T05:47:26.672 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6807/14874", 2021-11-12T05:47:26.672 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:26.673 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:26.673 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:26.673 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.673 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.673 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.674 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:47:26.674 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "b1bb06c3-26d0-4d92-82f8-b3e882242785", 2021-11-12T05:47:26.674 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:26.674 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:26.675 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:26.675 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:26.675 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:26.675 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:26.676 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:26.676 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 63, 2021-11-12T05:47:26.676 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:26.676 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:26.676 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:26.677 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:26.677 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.677 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:26.677 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6810", 2021-11-12T05:47:26.678 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:26.678 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.678 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.678 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:26.678 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6811", 2021-11-12T05:47:26.679 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:26.679 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:26.679 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.679 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.680 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:26.680 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:26.680 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.680 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:26.681 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6812", 2021-11-12T05:47:26.681 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:26.681 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.681 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.681 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:26.682 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6813", 2021-11-12T05:47:26.682 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:26.682 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:26.682 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.683 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.683 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:26.683 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:26.683 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.683 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:26.684 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6816", 2021-11-12T05:47:26.684 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:26.684 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.684 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.685 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:26.685 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6817", 2021-11-12T05:47:26.685 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:26.685 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:26.685 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.686 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.686 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:26.686 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:26.686 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.687 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:26.687 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6814", 2021-11-12T05:47:26.687 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:26.687 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.687 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.688 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:26.688 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6815", 2021-11-12T05:47:26.688 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:26.688 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:26.689 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.689 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.689 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6811/14875", 2021-11-12T05:47:26.689 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6813/14875", 2021-11-12T05:47:26.689 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6817/14875", 2021-11-12T05:47:26.690 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6815/14875", 2021-11-12T05:47:26.690 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:26.690 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:26.690 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:26.690 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.691 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.691 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.691 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:47:26.691 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "837b2c60-c335-4382-9f47-d86543a14022", 2021-11-12T05:47:26.692 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:26.692 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:26.692 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:26.692 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:26.692 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:26.693 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:26.693 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:26.693 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 72, 2021-11-12T05:47:26.693 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:26.694 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:26.694 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:26.694 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:26.694 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.694 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:26.695 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6818", 2021-11-12T05:47:26.695 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:26.695 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.695 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.696 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:26.696 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6819", 2021-11-12T05:47:26.696 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:26.696 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:26.696 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.697 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.697 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:26.697 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:26.697 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.698 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:26.698 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6820", 2021-11-12T05:47:26.698 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:26.698 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.698 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.699 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:26.699 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6821", 2021-11-12T05:47:26.699 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:26.699 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:26.700 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.700 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.700 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:26.700 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:26.701 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.701 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:26.701 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6824", 2021-11-12T05:47:26.701 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:26.701 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.702 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.702 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:26.702 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6825", 2021-11-12T05:47:26.702 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:26.703 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:26.703 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.703 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.703 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:26.704 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:26.704 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.704 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:26.705 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6822", 2021-11-12T05:47:26.705 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:26.705 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.705 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.706 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:26.706 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6823", 2021-11-12T05:47:26.706 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:26.706 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:26.706 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.707 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.707 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6819/14905", 2021-11-12T05:47:26.707 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6821/14905", 2021-11-12T05:47:26.708 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6825/14905", 2021-11-12T05:47:26.708 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6823/14905", 2021-11-12T05:47:26.708 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:26.708 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:26.709 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:26.709 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.709 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.709 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.710 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:47:26.710 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "eb2b737b-dda6-444b-a306-f33cbbd51f70", 2021-11-12T05:47:26.710 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:26.711 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:26.711 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:26.711 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:26.712 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:26.712 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:26.712 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:26.713 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 72, 2021-11-12T05:47:26.713 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:26.713 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:26.713 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:26.714 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:26.714 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.714 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:26.714 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6826", 2021-11-12T05:47:26.714 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:26.715 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.715 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.715 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:26.715 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6827", 2021-11-12T05:47:26.716 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:26.716 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:26.716 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.716 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.716 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:26.717 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:26.717 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.717 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:26.717 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6828", 2021-11-12T05:47:26.717 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:26.718 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.718 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.718 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:26.718 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6829", 2021-11-12T05:47:26.719 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:26.719 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:26.719 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.719 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.719 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:26.720 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:26.720 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.720 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:26.720 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6832", 2021-11-12T05:47:26.721 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:26.721 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.721 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.721 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:26.722 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6833", 2021-11-12T05:47:26.722 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:26.722 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:26.722 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.723 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.723 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:26.723 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:26.723 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.724 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:26.724 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6830", 2021-11-12T05:47:26.724 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:26.724 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.724 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.725 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:26.725 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6831", 2021-11-12T05:47:26.725 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:26.725 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:26.726 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.726 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.726 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6827/14876", 2021-11-12T05:47:26.726 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6829/14876", 2021-11-12T05:47:26.726 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6833/14876", 2021-11-12T05:47:26.727 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6831/14876", 2021-11-12T05:47:26.727 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:26.727 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:26.727 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:26.728 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.728 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.728 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.728 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:47:26.728 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "721529a1-c047-486a-a7ca-ddc15d80cdde", 2021-11-12T05:47:26.729 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:26.729 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:26.729 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:26.729 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:26.730 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:26.730 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:26.730 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:26.730 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 71, 2021-11-12T05:47:26.730 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:26.731 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:26.731 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:26.731 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:26.731 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.732 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:26.732 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6800", 2021-11-12T05:47:26.732 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:26.732 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.732 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.733 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:26.733 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6801", 2021-11-12T05:47:26.733 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:26.733 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:26.734 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.734 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.734 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:26.734 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:26.734 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.735 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:26.735 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6802", 2021-11-12T05:47:26.735 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:26.735 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.736 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.736 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:26.736 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6803", 2021-11-12T05:47:26.737 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:26.737 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:26.737 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.737 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.738 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:26.738 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:26.738 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.739 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:26.739 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6806", 2021-11-12T05:47:26.739 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:26.739 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.740 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.740 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:26.740 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6807", 2021-11-12T05:47:26.740 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:26.741 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:26.741 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.741 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.741 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:26.741 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:26.742 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.742 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:26.742 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6804", 2021-11-12T05:47:26.742 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:26.743 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.743 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.743 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:26.743 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6805", 2021-11-12T05:47:26.743 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:26.744 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:26.744 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.744 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.744 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6801/15096", 2021-11-12T05:47:26.745 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6803/15096", 2021-11-12T05:47:26.745 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6807/15096", 2021-11-12T05:47:26.745 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6805/15096", 2021-11-12T05:47:26.745 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:26.746 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:26.746 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:26.746 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.747 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.747 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.747 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:47:26.747 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "68b72ab2-fa82-4b5c-bf33-528f002e4950", 2021-11-12T05:47:26.748 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:26.748 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:26.748 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:26.748 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:26.749 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:26.749 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:26.749 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:26.749 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 72, 2021-11-12T05:47:26.750 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:26.750 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:26.750 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:26.750 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:26.751 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.751 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:26.751 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6808", 2021-11-12T05:47:26.751 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:26.752 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.752 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.752 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:26.752 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6809", 2021-11-12T05:47:26.752 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:26.753 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:26.753 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.753 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.753 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:26.754 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:26.754 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.754 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:26.754 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6810", 2021-11-12T05:47:26.754 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:26.755 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.755 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.755 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:26.755 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6811", 2021-11-12T05:47:26.756 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:26.756 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:26.756 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.756 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.756 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:26.757 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:26.757 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.757 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:26.757 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6814", 2021-11-12T05:47:26.758 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:26.758 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.758 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.758 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:26.759 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6815", 2021-11-12T05:47:26.759 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:26.759 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:26.759 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.759 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.760 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:26.760 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:26.760 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.760 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:26.760 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6812", 2021-11-12T05:47:26.761 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:26.761 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.761 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.761 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:26.762 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6813", 2021-11-12T05:47:26.762 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:26.762 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:26.762 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.763 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.763 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6809/15097", 2021-11-12T05:47:26.763 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6811/15097", 2021-11-12T05:47:26.763 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6815/15097", 2021-11-12T05:47:26.763 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6813/15097", 2021-11-12T05:47:26.764 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:26.764 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:26.764 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:26.764 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.765 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.765 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.765 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:47:26.765 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "a2c83b5d-8d37-4d30-ac04-30d89a76e485", 2021-11-12T05:47:26.766 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:26.766 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:26.766 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:26.766 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:26.767 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:26.767 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:26.767 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:26.767 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 72, 2021-11-12T05:47:26.768 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:26.768 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:26.768 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:26.768 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:26.768 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.769 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:26.769 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6816", 2021-11-12T05:47:26.769 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:26.769 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.770 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.770 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:26.770 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6817", 2021-11-12T05:47:26.770 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:26.771 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:26.771 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.771 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.771 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:26.771 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:26.772 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.772 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:26.772 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6818", 2021-11-12T05:47:26.772 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:26.773 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.773 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.773 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:26.773 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6819", 2021-11-12T05:47:26.773 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:26.774 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:26.774 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.774 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.774 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:26.775 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:26.775 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.775 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:26.775 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6822", 2021-11-12T05:47:26.775 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:26.776 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.776 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.776 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:26.776 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6823", 2021-11-12T05:47:26.777 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:26.777 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:26.777 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.777 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.777 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:26.778 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:26.778 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.778 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:26.778 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6820", 2021-11-12T05:47:26.779 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:26.779 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.779 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.779 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:26.779 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6821", 2021-11-12T05:47:26.780 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:26.780 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:26.780 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.781 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.781 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6817/15098", 2021-11-12T05:47:26.781 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6819/15098", 2021-11-12T05:47:26.781 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6823/15098", 2021-11-12T05:47:26.781 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6821/15098", 2021-11-12T05:47:26.782 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:26.782 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:26.782 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:26.782 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.783 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.783 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.783 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:47:26.783 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "786ce966-d0fb-4181-aed4-c26e3ef61c43", 2021-11-12T05:47:26.783 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:26.784 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:26.784 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:26.784 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:26.784 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:26.785 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:26.785 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:26.785 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 71, 2021-11-12T05:47:26.786 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:26.786 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:26.786 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:26.786 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:26.787 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.787 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:26.787 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6824", 2021-11-12T05:47:26.788 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:26.788 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.788 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.788 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:26.789 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6825", 2021-11-12T05:47:26.789 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:26.789 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:26.789 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.790 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.790 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:26.790 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:26.790 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.791 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:26.791 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6826", 2021-11-12T05:47:26.791 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:26.791 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.791 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.792 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:26.792 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6827", 2021-11-12T05:47:26.792 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:26.792 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:26.792 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.793 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.793 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:26.793 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:26.793 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.794 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:26.794 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6830", 2021-11-12T05:47:26.794 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:26.794 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.795 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.795 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:26.795 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6831", 2021-11-12T05:47:26.796 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:26.796 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:26.796 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.796 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.797 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:26.797 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:26.797 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.797 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:26.797 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6828", 2021-11-12T05:47:26.798 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:26.798 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.798 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.798 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:26.799 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6829", 2021-11-12T05:47:26.799 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:26.799 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:26.799 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.799 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.800 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6825/15099", 2021-11-12T05:47:26.800 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6827/15099", 2021-11-12T05:47:26.800 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6831/15099", 2021-11-12T05:47:26.800 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6829/15099", 2021-11-12T05:47:26.801 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:26.801 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:26.801 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:26.801 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:26.801 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:26.802 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:47:26.802 INFO:teuthology.orchestra.run.gibba005.stdout: "osd_xinfo": [ 2021-11-12T05:47:26.802 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.802 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:47:26.803 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:26.803 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:26.803 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:26.803 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:26.803 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:26.804 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.615112+0000", 2021-11-12T05:47:26.804 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:26.804 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.804 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.804 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:47:26.805 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:26.805 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:26.805 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:26.805 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:26.806 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:26.806 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.665935+0000", 2021-11-12T05:47:26.806 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:26.806 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.806 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.807 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:47:26.807 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:26.807 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:26.807 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:26.808 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:26.808 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:26.808 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.715877+0000", 2021-11-12T05:47:26.808 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:26.809 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.809 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.809 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:47:26.809 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:26.810 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:26.810 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:26.810 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:26.810 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:26.811 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.489234+0000", 2021-11-12T05:47:26.811 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:26.811 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.811 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.812 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:47:26.812 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:26.812 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:26.812 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:26.813 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:26.813 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:26.813 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.413776+0000", 2021-11-12T05:47:26.814 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:26.814 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.814 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.815 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:47:26.815 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:26.815 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:26.815 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:26.816 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:26.816 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:26.816 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.507960+0000", 2021-11-12T05:47:26.817 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:26.817 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.817 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.818 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:47:26.818 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:26.818 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:26.818 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:26.819 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:26.819 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:26.819 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.635696+0000", 2021-11-12T05:47:26.819 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:26.820 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.820 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:26.820 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:47:26.820 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:26.821 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:26.821 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:26.821 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:26.822 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:26.822 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.746949+0000", 2021-11-12T05:47:26.822 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:26.822 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:26.823 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:47:26.823 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap": [], 2021-11-12T05:47:26.823 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap_items": [], 2021-11-12T05:47:26.823 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_temp": [], 2021-11-12T05:47:26.824 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_temp": [], 2021-11-12T05:47:26.824 INFO:teuthology.orchestra.run.gibba005.stdout: "blacklist": { 2021-11-12T05:47:26.824 INFO:teuthology.orchestra.run.gibba005.stdout: "172.21.2.105:6835/1837795491": "2021-11-13T05:47:20.630716+0000", 2021-11-12T05:47:26.824 INFO:teuthology.orchestra.run.gibba005.stdout: "172.21.2.105:6834/1837795491": "2021-11-13T05:47:20.630716+0000", 2021-11-12T05:47:26.824 INFO:teuthology.orchestra.run.gibba005.stdout: "172.21.2.116:0/3516388082": "2021-11-12T06:47:10.201211+0000" 2021-11-12T05:47:26.825 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.825 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profiles": { 2021-11-12T05:47:26.825 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs_data": { 2021-11-12T05:47:26.825 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-device-class": "", 2021-11-12T05:47:26.826 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:47:26.826 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-root": "default", 2021-11-12T05:47:26.826 INFO:teuthology.orchestra.run.gibba005.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-12T05:47:26.826 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:47:26.826 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "2", 2021-11-12T05:47:26.827 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:47:26.827 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:47:26.827 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van", 2021-11-12T05:47:26.827 INFO:teuthology.orchestra.run.gibba005.stdout: "w": "8" 2021-11-12T05:47:26.828 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.828 INFO:teuthology.orchestra.run.gibba005.stdout: "default": { 2021-11-12T05:47:26.828 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:47:26.828 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:47:26.828 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "1", 2021-11-12T05:47:26.829 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:47:26.829 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:47:26.829 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van" 2021-11-12T05:47:26.829 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:26.830 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:26.830 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps_queue": [], 2021-11-12T05:47:26.830 INFO:teuthology.orchestra.run.gibba005.stdout: "new_removed_snaps": [], 2021-11-12T05:47:26.830 INFO:teuthology.orchestra.run.gibba005.stdout: "new_purged_snaps": [], 2021-11-12T05:47:26.831 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_node_flags": {}, 2021-11-12T05:47:26.831 INFO:teuthology.orchestra.run.gibba005.stdout: "device_class_flags": {} 2021-11-12T05:47:26.831 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:47:26.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.604+0000 7f00684c0700 1 -- 172.21.2.105:0/2844317155 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0040053720 msgr2=0x7f0040055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:26.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.604+0000 7f00684c0700 1 --2- 172.21.2.105:0/2844317155 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0040053720 0x7f0040055be0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f005c008000 tx=0x7f005c009040).stop 2021-11-12T05:47:26.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.604+0000 7f00684c0700 1 -- 172.21.2.105:0/2844317155 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0060139a40 msgr2=0x7f0060151850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:26.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.604+0000 7f00684c0700 1 --2- 172.21.2.105:0/2844317155 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0060139a40 0x7f0060151850 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7f0058001210 tx=0x7f0058008040).stop 2021-11-12T05:47:26.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.604+0000 7f00684c0700 1 -- 172.21.2.105:0/2844317155 shutdown_connections 2021-11-12T05:47:26.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.604+0000 7f00684c0700 1 --2- 172.21.2.105:0/2844317155 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0040053720 0x7f0040055be0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:26.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.604+0000 7f00684c0700 1 --2- 172.21.2.105:0/2844317155 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0060139a40 0x7f0060151850 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:26.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.604+0000 7f00684c0700 1 --2- 172.21.2.105:0/2844317155 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0060064060 0x7f006013c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:26.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.604+0000 7f00684c0700 1 --2- 172.21.2.105:0/2844317155 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0048004500 0x7f0060067610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:26.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.608+0000 7f00684c0700 1 -- 172.21.2.105:0/2844317155 >> 172.21.2.105:0/2844317155 conn(0x7f0060063810 msgr2=0x7f00601382a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:26.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.608+0000 7f00684c0700 1 -- 172.21.2.105:0/2844317155 shutdown_connections 2021-11-12T05:47:26.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.608+0000 7f00684c0700 1 -- 172.21.2.105:0/2844317155 wait complete. 2021-11-12T05:47:26.836 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:47:26.907 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.900+0000 7f830a91d700 1 Processor -- start 2021-11-12T05:47:26.907 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.900+0000 7f830a91d700 1 -- start start 2021-11-12T05:47:26.908 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.904+0000 7f830a91d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f83040b5ac0 0x7f83040b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:26.908 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.904+0000 7f830a91d700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f83040aeb80 0x7f830413e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:26.908 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.904+0000 7f830a91d700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83040b5ea0 con 0x7f83040b01b0 2021-11-12T05:47:26.908 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.904+0000 7f830a91d700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83040b1a60 con 0x7f83040b5ac0 2021-11-12T05:47:26.909 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.904+0000 7f830a91d700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83040accd0 con 0x7f83040aeb80 2021-11-12T05:47:26.909 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.904+0000 7f8303fff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f83040b5ac0 0x7f83040b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:26.909 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.904+0000 7f8303fff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f83040b5ac0 0x7f83040b13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48048/0 (socket says 172.21.2.105:48048) 2021-11-12T05:47:26.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.904+0000 7f8303fff700 1 -- 172.21.2.105:0/25995665 learned_addr learned my addr 172.21.2.105:0/25995665 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:26.913 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.904+0000 7f8303fff700 1 -- 172.21.2.105:0/25995665 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f83040aeb80 msgr2=0x7f830413e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:26.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.904+0000 7f8303fff700 1 --2- 172.21.2.105:0/25995665 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f83040aeb80 0x7f830413e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:26.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.904+0000 7f8303fff700 1 -- 172.21.2.105:0/25995665 >> v1:172.21.2.115:6789/0 conn(0x7f83040b01b0 legacy=0x7f83040ae470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:26.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.904+0000 7f8303fff700 1 -- 172.21.2.105:0/25995665 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83040acf70 con 0x7f83040b5ac0 2021-11-12T05:47:26.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.904+0000 7f8303fff700 1 --2- 172.21.2.105:0/25995665 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f83040b5ac0 0x7f83040b13c0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7f830405d0f0 tx=0x7f82ec006f40).ready entity=mon.0 client_cookie=263fcf3c357e45e0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:26.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.904+0000 7f8302ffd700 1 -- 172.21.2.105:0/25995665 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82ec010070 con 0x7f83040b5ac0 2021-11-12T05:47:26.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.904+0000 7f8302ffd700 1 -- 172.21.2.105:0/25995665 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82ec000e90 con 0x7f83040b5ac0 2021-11-12T05:47:26.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.904+0000 7f8302ffd700 1 -- 172.21.2.105:0/25995665 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82ec008860 con 0x7f83040b5ac0 2021-11-12T05:47:26.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.904+0000 7f830a91d700 1 -- 172.21.2.105:0/25995665 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f83040b5ac0 msgr2=0x7f83040b13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:26.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.904+0000 7f830a91d700 1 --2- 172.21.2.105:0/25995665 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f83040b5ac0 0x7f83040b13c0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7f830405d0f0 tx=0x7f82ec006f40).stop 2021-11-12T05:47:26.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.904+0000 7f830a91d700 1 -- 172.21.2.105:0/25995665 shutdown_connections 2021-11-12T05:47:26.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.904+0000 7f830a91d700 1 --2- 172.21.2.105:0/25995665 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f83040aeb80 0x7f830413e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:26.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.904+0000 7f830a91d700 1 --2- 172.21.2.105:0/25995665 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f83040b5ac0 0x7f83040b13c0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:26.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.904+0000 7f830a91d700 1 -- 172.21.2.105:0/25995665 >> 172.21.2.105:0/25995665 conn(0x7f83040628b0 msgr2=0x7f8304062c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:26.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.904+0000 7f830a91d700 1 -- 172.21.2.105:0/25995665 shutdown_connections 2021-11-12T05:47:26.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.904+0000 7f830a91d700 1 -- 172.21.2.105:0/25995665 wait complete. 2021-11-12T05:47:26.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.904+0000 7f830a91d700 1 Processor -- start 2021-11-12T05:47:26.918 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.904+0000 7f830a91d700 1 -- start start 2021-11-12T05:47:26.918 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.904+0000 7f830a91d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f83040aeb80 0x7f830414e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:26.918 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.904+0000 7f830a91d700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f83040b01b0 0x7f830413d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:26.918 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.904+0000 7f830a91d700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f83040b5ac0 0x7f8304140990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:26.918 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.904+0000 7f830a91d700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83040654d0 con 0x7f83040aeb80 2021-11-12T05:47:26.919 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.904+0000 7f830a91d700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8304065770 con 0x7f83040b01b0 2021-11-12T05:47:26.919 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.904+0000 7f830a91d700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83041404f0 con 0x7f83040b5ac0 2021-11-12T05:47:26.919 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.904+0000 7f8303fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f83040aeb80 0x7f830414e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:26.919 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.904+0000 7f8303fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f83040aeb80 0x7f830414e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48052/0 (socket says 172.21.2.105:48052) 2021-11-12T05:47:26.920 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.904+0000 7f8303fff700 1 -- 172.21.2.105:0/2731483092 learned_addr learned my addr 172.21.2.105:0/2731483092 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:26.920 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.904+0000 7f8303fff700 1 -- 172.21.2.105:0/2731483092 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f83040b5ac0 msgr2=0x7f8304140990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:26.920 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.904+0000 7f8303fff700 1 --2- 172.21.2.105:0/2731483092 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f83040b5ac0 0x7f8304140990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:26.920 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.908+0000 7f8303fff700 1 -- 172.21.2.105:0/2731483092 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f83040b01b0 msgr2=0x7f830413d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:26.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.908+0000 7f8303fff700 1 --2- 172.21.2.105:0/2731483092 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f83040b01b0 0x7f830413d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:26.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.908+0000 7f8303fff700 1 -- 172.21.2.105:0/2731483092 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ec008240 con 0x7f83040aeb80 2021-11-12T05:47:26.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.908+0000 7f8303fff700 1 --2- 172.21.2.105:0/2731483092 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f83040aeb80 0x7f830414e2e0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7f830405d0f0 tx=0x7f82ec006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:26.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.908+0000 7f83017fa700 1 -- 172.21.2.105:0/2731483092 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82ec015e20 con 0x7f83040aeb80 2021-11-12T05:47:26.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.908+0000 7f83017fa700 1 -- 172.21.2.105:0/2731483092 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82ec01f430 con 0x7f83040aeb80 2021-11-12T05:47:26.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.908+0000 7f830a91d700 1 -- 172.21.2.105:0/2731483092 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8304142640 con 0x7f83040aeb80 2021-11-12T05:47:26.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.908+0000 7f83017fa700 1 -- 172.21.2.105:0/2731483092 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82ec01f790 con 0x7f83040aeb80 2021-11-12T05:47:26.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.908+0000 7f830a91d700 1 -- 172.21.2.105:0/2731483092 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8304141ea0 con 0x7f83040aeb80 2021-11-12T05:47:26.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.908+0000 7f830a91d700 1 -- 172.21.2.105:0/2731483092 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8304142400 con 0x7f83040aeb80 2021-11-12T05:47:26.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.908+0000 7f83017fa700 1 -- 172.21.2.105:0/2731483092 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f82ec02e070 con 0x7f83040aeb80 2021-11-12T05:47:26.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.908+0000 7f83017fa700 1 --2- 172.21.2.105:0/2731483092 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f82e80536d0 0x7f82e8055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:26.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.908+0000 7f83017fa700 1 -- 172.21.2.105:0/2731483092 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5725+0+0 (secure 0 0 0) 0x7f82ec06f5c0 con 0x7f83040aeb80 2021-11-12T05:47:26.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.908+0000 7f83037fe700 1 --2- 172.21.2.105:0/2731483092 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f82e80536d0 0x7f82e8055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:26.924 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.908+0000 7f83037fe700 1 --2- 172.21.2.105:0/2731483092 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f82e80536d0 0x7f82e8055b90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f82f4002f90 tx=0x7f82f40069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:26.924 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:26.912+0000 7f83017fa700 1 -- 172.21.2.105:0/2731483092 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8304142400 con 0x7f83040aeb80 2021-11-12T05:47:27.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.016+0000 7f830a91d700 1 -- 172.21.2.105:0/2731483092 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8304142400 con 0x7f83040aeb80 2021-11-12T05:47:27.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.016+0000 7f83017fa700 1 -- 172.21.2.105:0/2731483092 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+1209 (secure 0 0 0) 0x7f8304142400 con 0x7f83040aeb80 2021-11-12T05:47:27.021 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:27.021 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":34,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/1423088351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":1423088351},{"type":"v1","addr":"172.21.2.115:6833","nonce":1423088351}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30},{"gid":6612,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.105:6835/1338677059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":1338677059},{"type":"v1","addr":"172.21.2.105:6835","nonce":1338677059}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":34}],"filesystems":[]} 2021-11-12T05:47:27.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.016+0000 7f830a91d700 1 -- 172.21.2.105:0/2731483092 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f82e80536d0 msgr2=0x7f82e8055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:27.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.016+0000 7f830a91d700 1 --2- 172.21.2.105:0/2731483092 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f82e80536d0 0x7f82e8055b90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f82f4002f90 tx=0x7f82f40069b0).stop 2021-11-12T05:47:27.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.016+0000 7f830a91d700 1 -- 172.21.2.105:0/2731483092 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f83040aeb80 msgr2=0x7f830414e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:27.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.016+0000 7f830a91d700 1 --2- 172.21.2.105:0/2731483092 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f83040aeb80 0x7f830414e2e0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7f830405d0f0 tx=0x7f82ec006f40).stop 2021-11-12T05:47:27.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.016+0000 7f830a91d700 1 -- 172.21.2.105:0/2731483092 shutdown_connections 2021-11-12T05:47:27.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.016+0000 7f830a91d700 1 --2- 172.21.2.105:0/2731483092 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f82e80536d0 0x7f82e8055b90 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:27.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.016+0000 7f830a91d700 1 --2- 172.21.2.105:0/2731483092 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f83040b5ac0 0x7f8304140990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:27.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.016+0000 7f830a91d700 1 --2- 172.21.2.105:0/2731483092 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f83040b01b0 0x7f830413d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:27.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.016+0000 7f830a91d700 1 --2- 172.21.2.105:0/2731483092 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f83040aeb80 0x7f830414e2e0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:27.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.016+0000 7f830a91d700 1 -- 172.21.2.105:0/2731483092 >> 172.21.2.105:0/2731483092 conn(0x7f83040628b0 msgr2=0x7f83040b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:27.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.016+0000 7f830a91d700 1 -- 172.21.2.105:0/2731483092 shutdown_connections 2021-11-12T05:47:27.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.016+0000 7f830a91d700 1 -- 172.21.2.105:0/2731483092 wait complete. 2021-11-12T05:47:27.025 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 34 2021-11-12T05:47:27.028 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:47:27.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.072+0000 7fe2ffe00700 1 Processor -- start 2021-11-12T05:47:27.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.072+0000 7fe2ffe00700 1 -- start start 2021-11-12T05:47:27.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.072+0000 7fe2ffe00700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fe2f80b2940 0x7fe2f8142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:27.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.072+0000 7fe2ffe00700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe2f80b0cc0 0x7fe2f805f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:27.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.072+0000 7fe2ffe00700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f80b2d20 con 0x7fe2f80b0780 2021-11-12T05:47:27.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.072+0000 7fe2ffe00700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2f80b1fc0 con 0x7fe2f80b0cc0 2021-11-12T05:47:27.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.072+0000 7fe2ffe00700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2f80b15e0 con 0x7fe2f80b2940 2021-11-12T05:47:27.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2fd39b700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fe2f80b0780 0x7fe2f81432b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:58460/0 (socket says 172.21.2.105:58460) 2021-11-12T05:47:27.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2fd39b700 1 -- 172.21.2.105:0/2908185587 learned_addr learned my addr 172.21.2.105:0/2908185587 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:27.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2fe39d700 1 --2- 172.21.2.105:0/2908185587 >> v2:172.21.2.105:3300/0 conn(0x7fe2f80b0cc0 0x7fe2f805f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:27.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2fdb9c700 1 --2- 172.21.2.105:0/2908185587 >> v2:172.21.2.115:3300/0 conn(0x7fe2f80b2940 0x7fe2f8142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:27.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2fcb9a700 1 -- 172.21.2.105:0/2908185587 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 8090801 0 0) 0x7fe2f80b2d20 con 0x7fe2f80b0780 2021-11-12T05:47:27.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2fcb9a700 1 -- 172.21.2.105:0/2908185587 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2e0003260 con 0x7fe2f80b0780 2021-11-12T05:47:27.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2fe39d700 1 -- 172.21.2.105:0/2908185587 >> v2:172.21.2.115:3300/0 conn(0x7fe2f80b2940 msgr2=0x7fe2f8142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:27.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2fe39d700 1 --2- 172.21.2.105:0/2908185587 >> v2:172.21.2.115:3300/0 conn(0x7fe2f80b2940 0x7fe2f8142dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:27.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2fe39d700 1 -- 172.21.2.105:0/2908185587 >> v1:172.21.2.105:6789/0 conn(0x7fe2f80b0780 legacy=0x7fe2f81432b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:27.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2fe39d700 1 -- 172.21.2.105:0/2908185587 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f80b1880 con 0x7fe2f80b0cc0 2021-11-12T05:47:27.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2fe39d700 1 --2- 172.21.2.105:0/2908185587 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2f80b0cc0 0x7fe2f805f6b0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7fe2f00032f0 tx=0x7fe2f00091d0).ready entity=mon.0 client_cookie=fe63e0022483df4d server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:27.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2fcb9a700 1 -- 172.21.2.105:0/2908185587 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2f000b680 con 0x7fe2f80b0cc0 2021-11-12T05:47:27.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2fcb9a700 1 -- 172.21.2.105:0/2908185587 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f000b7e0 con 0x7fe2f80b0cc0 2021-11-12T05:47:27.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2fcb9a700 1 -- 172.21.2.105:0/2908185587 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2f000b950 con 0x7fe2f80b0cc0 2021-11-12T05:47:27.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2ffe00700 1 -- 172.21.2.105:0/2908185587 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2f80b0cc0 msgr2=0x7fe2f805f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:27.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2ffe00700 1 --2- 172.21.2.105:0/2908185587 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2f80b0cc0 0x7fe2f805f6b0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7fe2f00032f0 tx=0x7fe2f00091d0).stop 2021-11-12T05:47:27.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2ffe00700 1 -- 172.21.2.105:0/2908185587 shutdown_connections 2021-11-12T05:47:27.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2ffe00700 1 --2- 172.21.2.105:0/2908185587 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2f80b0cc0 0x7fe2f805f6b0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:27.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2ffe00700 1 --2- 172.21.2.105:0/2908185587 >> v2:172.21.2.115:3300/0 conn(0x7fe2f80b2940 0x7fe2f8142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:27.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2ffe00700 1 -- 172.21.2.105:0/2908185587 >> 172.21.2.105:0/2908185587 conn(0x7fe2f8068440 msgr2=0x7fe2f8062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:27.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2ffe00700 1 -- 172.21.2.105:0/2908185587 shutdown_connections 2021-11-12T05:47:27.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2ffe00700 1 -- 172.21.2.105:0/2908185587 wait complete. 2021-11-12T05:47:27.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2ffe00700 1 Processor -- start 2021-11-12T05:47:27.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2ffe00700 1 -- start start 2021-11-12T05:47:27.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2ffe00700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe2f80b0780 0x7fe2f80b4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:27.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2ffe00700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2f80b0cc0 0x7fe2f813fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:27.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2ffe00700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe2f80b2940 0x7fe2f8140090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:27.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2ffe00700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f813c410 con 0x7fe2f80b0cc0 2021-11-12T05:47:27.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2ffe00700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f813c6b0 con 0x7fe2f80b2940 2021-11-12T05:47:27.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2ffe00700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f813c950 con 0x7fe2f80b0780 2021-11-12T05:47:27.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2fd39b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2f80b0cc0 0x7fe2f813fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:27.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2fd39b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2f80b0cc0 0x7fe2f813fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48066/0 (socket says 172.21.2.105:48066) 2021-11-12T05:47:27.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2fd39b700 1 -- 172.21.2.105:0/1910427928 learned_addr learned my addr 172.21.2.105:0/1910427928 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:27.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2fd39b700 1 -- 172.21.2.105:0/1910427928 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe2f80b0780 msgr2=0x7fe2f80b4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:27.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2fd39b700 1 --2- 172.21.2.105:0/1910427928 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe2f80b0780 0x7fe2f80b4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:27.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2fd39b700 1 -- 172.21.2.105:0/1910427928 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe2f80b2940 msgr2=0x7fe2f8140090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:27.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2fd39b700 1 --2- 172.21.2.105:0/1910427928 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe2f80b2940 0x7fe2f8140090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:27.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2fd39b700 1 -- 172.21.2.105:0/1910427928 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f0009470 con 0x7fe2f80b0cc0 2021-11-12T05:47:27.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2fd39b700 1 --2- 172.21.2.105:0/1910427928 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2f80b0cc0 0x7fe2f813fba0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 rx=0x7fe2f4001110 tx=0x7fe2f4007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:27.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2e6ffd700 1 -- 172.21.2.105:0/1910427928 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2f400ce00 con 0x7fe2f80b0cc0 2021-11-12T05:47:27.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2e6ffd700 1 -- 172.21.2.105:0/1910427928 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f40072e0 con 0x7fe2f80b0cc0 2021-11-12T05:47:27.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2ffe00700 1 -- 172.21.2.105:0/1910427928 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f8066850 con 0x7fe2f80b0cc0 2021-11-12T05:47:27.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2e6ffd700 1 -- 172.21.2.105:0/1910427928 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2f4005800 con 0x7fe2f80b0cc0 2021-11-12T05:47:27.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.076+0000 7fe2ffe00700 1 -- 172.21.2.105:0/1910427928 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f8065010 con 0x7fe2f80b0cc0 2021-11-12T05:47:27.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.080+0000 7fe2ffe00700 1 -- 172.21.2.105:0/1910427928 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f813cb10 con 0x7fe2f80b0cc0 2021-11-12T05:47:27.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.080+0000 7fe2e6ffd700 1 -- 172.21.2.105:0/1910427928 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe2f401a060 con 0x7fe2f80b0cc0 2021-11-12T05:47:27.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.080+0000 7fe2e6ffd700 1 --2- 172.21.2.105:0/1910427928 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe2d80536a0 0x7fe2d8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:27.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.080+0000 7fe2e6ffd700 1 -- 172.21.2.105:0/1910427928 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5725+0+0 (secure 0 0 0) 0x7fe2f406ac20 con 0x7fe2f80b0cc0 2021-11-12T05:47:27.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.080+0000 7fe2fdb9c700 1 --2- 172.21.2.105:0/1910427928 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe2d80536a0 0x7fe2d8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:27.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.080+0000 7fe2fdb9c700 1 --2- 172.21.2.105:0/1910427928 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe2d80536a0 0x7fe2d8055b60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7fe2e800a000 tx=0x7fe2e8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:27.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.080+0000 7fe2e6ffd700 1 -- 172.21.2.105:0/1910427928 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe2f4041ee0 con 0x7fe2f80b0cc0 2021-11-12T05:47:27.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.192+0000 7fe2ffe00700 1 -- 172.21.2.105:0/1910427928 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2f8057350 con 0x7fe2f80b0cc0 2021-11-12T05:47:27.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.192+0000 7fe2e6ffd700 1 -- 172.21.2.105:0/1910427928 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+1209 (secure 0 0 0) 0x7fe2f4018070 con 0x7fe2f80b0cc0 2021-11-12T05:47:27.196 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:27.196 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":34,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4840,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/1423088351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":1423088351},{"type":"v1","addr":"172.21.2.115:6833","nonce":1423088351}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30},{"gid":6612,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.105:6835/1338677059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":1338677059},{"type":"v1","addr":"172.21.2.105:6835","nonce":1338677059}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":34}],"filesystems":[]} 2021-11-12T05:47:27.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.192+0000 7fe2ffe00700 1 -- 172.21.2.105:0/1910427928 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe2d80536a0 msgr2=0x7fe2d8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:27.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.192+0000 7fe2ffe00700 1 --2- 172.21.2.105:0/1910427928 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe2d80536a0 0x7fe2d8055b60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7fe2e800a000 tx=0x7fe2e8008040).stop 2021-11-12T05:47:27.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.192+0000 7fe2ffe00700 1 -- 172.21.2.105:0/1910427928 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2f80b0cc0 msgr2=0x7fe2f813fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:27.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.192+0000 7fe2ffe00700 1 --2- 172.21.2.105:0/1910427928 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2f80b0cc0 0x7fe2f813fba0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 rx=0x7fe2f4001110 tx=0x7fe2f4007aa0).stop 2021-11-12T05:47:27.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.192+0000 7fe2ffe00700 1 -- 172.21.2.105:0/1910427928 shutdown_connections 2021-11-12T05:47:27.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.192+0000 7fe2ffe00700 1 --2- 172.21.2.105:0/1910427928 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe2d80536a0 0x7fe2d8055b60 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:27.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.192+0000 7fe2ffe00700 1 --2- 172.21.2.105:0/1910427928 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe2f80b2940 0x7fe2f8140090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:27.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.192+0000 7fe2ffe00700 1 --2- 172.21.2.105:0/1910427928 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2f80b0cc0 0x7fe2f813fba0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:27.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.192+0000 7fe2ffe00700 1 --2- 172.21.2.105:0/1910427928 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe2f80b0780 0x7fe2f80b4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:27.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.192+0000 7fe2ffe00700 1 -- 172.21.2.105:0/1910427928 >> 172.21.2.105:0/1910427928 conn(0x7fe2f8068440 msgr2=0x7fe2f80ae740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:27.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.192+0000 7fe2ffe00700 1 -- 172.21.2.105:0/1910427928 shutdown_connections 2021-11-12T05:47:27.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.192+0000 7fe2ffe00700 1 -- 172.21.2.105:0/1910427928 wait complete. 2021-11-12T05:47:27.200 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 34 2021-11-12T05:47:27.203 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-12T05:47:27.204 INFO:tasks.ceph.mds.a:Stopping old one... 2021-11-12T05:47:27.204 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-12T05:47:27.204 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T05:47:27.205 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-12T05:47:27.205 INFO:tasks.ceph.mds.b:Stopping old one... 2021-11-12T05:47:27.205 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-12T05:47:27.205 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T05:47:27.209 INFO:tasks.ceph.mds.a:Stopped 2021-11-12T05:47:27.210 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-12T05:47:27.212 INFO:tasks.ceph.mds.a:Started 2021-11-12T05:47:27.212 DEBUG:teuthology.parallel:result is None 2021-11-12T05:47:27.213 INFO:tasks.ceph.mds.b:Stopped 2021-11-12T05:47:27.214 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-12T05:47:27.243 INFO:tasks.ceph.mds.a.gibba005.stdout:starting mds.a at 2021-11-12T05:47:27.260 INFO:tasks.ceph.mds.b:Started 2021-11-12T05:47:27.261 DEBUG:teuthology.parallel:result is None 2021-11-12T05:47:27.261 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-11-12T05:47:27.297 INFO:tasks.ceph.mds.b.gibba015.stdout:starting mds.b at 2021-11-12T05:47:27.334 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.328+0000 7fb77b510700 1 Processor -- start 2021-11-12T05:47:27.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.328+0000 7fb77b510700 1 -- start start 2021-11-12T05:47:27.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb77b510700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb77413ef20 0x7fb7740b6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:27.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb77b510700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7740b6570 con 0x7fb774062ac0 2021-11-12T05:47:27.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb77b510700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7740b56a0 con 0x7fb7740b0130 2021-11-12T05:47:27.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb77b510700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7740b5940 con 0x7fb77413ef20 2021-11-12T05:47:27.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb7792ac700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fb774062ac0 0x7fb774138c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:58482/0 (socket says 172.21.2.105:58482) 2021-11-12T05:47:27.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb7792ac700 1 -- 172.21.2.105:0/3079616773 learned_addr learned my addr 172.21.2.105:0/3079616773 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:27.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb779aad700 1 --2- 172.21.2.105:0/3079616773 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb77413ef20 0x7fb7740b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:27.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb767fff700 1 -- 172.21.2.105:0/3079616773 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2703062740 0 0) 0x7fb7740b6570 con 0x7fb774062ac0 2021-11-12T05:47:27.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb767fff700 1 -- 172.21.2.105:0/3079616773 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb758003260 con 0x7fb774062ac0 2021-11-12T05:47:27.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb767fff700 1 -- 172.21.2.105:0/3079616773 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3559998674 0 0) 0x7fb758003260 con 0x7fb774062ac0 2021-11-12T05:47:27.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb767fff700 1 -- 172.21.2.105:0/3079616773 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb77413ef20 msgr2=0x7fb7740b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:27.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb767fff700 1 --2- 172.21.2.105:0/3079616773 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb77413ef20 0x7fb7740b6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:27.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb767fff700 1 -- 172.21.2.105:0/3079616773 >> v1:172.21.2.115:6789/0 conn(0x7fb7740b0130 legacy=0x7fb7740ae740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:27.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb767fff700 1 -- 172.21.2.105:0/3079616773 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7740b5be0 con 0x7fb774062ac0 2021-11-12T05:47:27.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb767fff700 1 -- 172.21.2.105:0/3079616773 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fb770001660 con 0x7fb774062ac0 2021-11-12T05:47:27.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb767fff700 1 -- 172.21.2.105:0/3079616773 >> v1:172.21.2.105:6789/0 conn(0x7fb774062ac0 legacy=0x7fb774138c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:27.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb767fff700 1 --2- 172.21.2.105:0/3079616773 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb77413ef20 0x7fb758003780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:27.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb767fff700 1 --2- 172.21.2.105:0/3079616773 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb758003cb0 0x7fb758004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:27.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb767fff700 1 --2- 172.21.2.105:0/3079616773 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb7580049f0 0x7fb758004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:27.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb767fff700 1 -- 172.21.2.105:0/3079616773 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7740b5940 con 0x7fb758003cb0 2021-11-12T05:47:27.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb767fff700 1 -- 172.21.2.105:0/3079616773 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75800c910 con 0x7fb7580049f0 2021-11-12T05:47:27.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb767fff700 1 -- 172.21.2.105:0/3079616773 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb75800cad0 con 0x7fb77413ef20 2021-11-12T05:47:27.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb7792ac700 1 --2- 172.21.2.105:0/3079616773 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb77413ef20 0x7fb758003780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:27.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb778aab700 1 --2- 172.21.2.105:0/3079616773 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb758003cb0 0x7fb758004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:27.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb779aad700 1 --2- 172.21.2.105:0/3079616773 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb7580049f0 0x7fb758004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:27.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb778aab700 1 -- 172.21.2.105:0/3079616773 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb77413ef20 msgr2=0x7fb758003780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:27.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb778aab700 1 --2- 172.21.2.105:0/3079616773 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb77413ef20 0x7fb758003780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:27.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb778aab700 1 -- 172.21.2.105:0/3079616773 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb7580049f0 msgr2=0x7fb758004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:27.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb778aab700 1 --2- 172.21.2.105:0/3079616773 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb7580049f0 0x7fb758004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:27.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb778aab700 1 -- 172.21.2.105:0/3079616773 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb758003260 con 0x7fb758003cb0 2021-11-12T05:47:27.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb778aab700 1 --2- 172.21.2.105:0/3079616773 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb758003cb0 0x7fb758004500 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 rx=0x7fb7740b3580 tx=0x7fb768007a00).ready entity=mon.0 client_cookie=69a6fe9b7e90e011 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:27.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb767fff700 1 -- 172.21.2.105:0/3079616773 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb768007d10 con 0x7fb758003cb0 2021-11-12T05:47:27.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb767fff700 1 -- 172.21.2.105:0/3079616773 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb768007030 con 0x7fb758003cb0 2021-11-12T05:47:27.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb767fff700 1 -- 172.21.2.105:0/3079616773 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb768007390 con 0x7fb758003cb0 2021-11-12T05:47:27.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb77b510700 1 -- 172.21.2.105:0/3079616773 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb758003cb0 msgr2=0x7fb758004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:27.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb77b510700 1 --2- 172.21.2.105:0/3079616773 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb758003cb0 0x7fb758004500 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 rx=0x7fb7740b3580 tx=0x7fb768007a00).stop 2021-11-12T05:47:27.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb779aad700 1 -- 172.21.2.105:0/3079616773 reap_dead start 2021-11-12T05:47:27.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb77b510700 1 -- 172.21.2.105:0/3079616773 shutdown_connections 2021-11-12T05:47:27.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb77b510700 1 -- 172.21.2.105:0/3079616773 >> 172.21.2.105:0/3079616773 conn(0x7fb77405c490 msgr2=0x7fb77405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:27.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb77b510700 1 -- 172.21.2.105:0/3079616773 shutdown_connections 2021-11-12T05:47:27.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb77b510700 1 -- 172.21.2.105:0/3079616773 wait complete. 2021-11-12T05:47:27.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb77b510700 1 Processor -- start 2021-11-12T05:47:27.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.332+0000 7fb77b510700 1 -- start start 2021-11-12T05:47:27.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.336+0000 7fb77b510700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb758003cb0 0x7fb7741429a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:27.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.336+0000 7fb77b510700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb7740637a0 0x7fb774156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:27.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.336+0000 7fb77b510700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb774063c20 0x7fb774157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:27.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.336+0000 7fb77b510700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb774067520 con 0x7fb774063c20 2021-11-12T05:47:27.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.336+0000 7fb77b510700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb774064b40 con 0x7fb7740637a0 2021-11-12T05:47:27.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.336+0000 7fb77b510700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7740671f0 con 0x7fb758003cb0 2021-11-12T05:47:27.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.336+0000 7fb779aad700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb774063c20 0x7fb774157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:27.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.336+0000 7fb779aad700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb774063c20 0x7fb774157030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48102/0 (socket says 172.21.2.105:48102) 2021-11-12T05:47:27.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.336+0000 7fb779aad700 1 -- 172.21.2.105:0/1429823981 learned_addr learned my addr 172.21.2.105:0/1429823981 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:27.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.336+0000 7fb778aab700 1 --2- 172.21.2.105:0/1429823981 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb7740637a0 0x7fb774156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:27.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.336+0000 7fb7792ac700 1 --2- 172.21.2.105:0/1429823981 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb758003cb0 0x7fb7741429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:27.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.336+0000 7fb779aad700 1 -- 172.21.2.105:0/1429823981 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb758003cb0 msgr2=0x7fb7741429a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:27.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.336+0000 7fb779aad700 1 --2- 172.21.2.105:0/1429823981 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb758003cb0 0x7fb7741429a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:27.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.336+0000 7fb779aad700 1 -- 172.21.2.105:0/1429823981 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb7740637a0 msgr2=0x7fb774156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:27.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.336+0000 7fb779aad700 1 --2- 172.21.2.105:0/1429823981 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb7740637a0 0x7fb774156b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:27.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.336+0000 7fb779aad700 1 -- 172.21.2.105:0/1429823981 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb774064020 con 0x7fb774063c20 2021-11-12T05:47:27.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.336+0000 7fb779aad700 1 --2- 172.21.2.105:0/1429823981 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb774063c20 0x7fb774157030 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7fb76c00b000 tx=0x7fb76c0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:27.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.336+0000 7fb7667fc700 1 -- 172.21.2.105:0/1429823981 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb76c019070 con 0x7fb774063c20 2021-11-12T05:47:27.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.336+0000 7fb7667fc700 1 -- 172.21.2.105:0/1429823981 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76c00f830 con 0x7fb774063c20 2021-11-12T05:47:27.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.336+0000 7fb7667fc700 1 -- 172.21.2.105:0/1429823981 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb76c00fb90 con 0x7fb774063c20 2021-11-12T05:47:27.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.336+0000 7fb77b510700 1 -- 172.21.2.105:0/1429823981 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb774064270 con 0x7fb774063c20 2021-11-12T05:47:27.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.336+0000 7fb77b510700 1 -- 172.21.2.105:0/1429823981 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb774064720 con 0x7fb774063c20 2021-11-12T05:47:27.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.336+0000 7fb77b510700 1 -- 172.21.2.105:0/1429823981 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb774064d00 con 0x7fb774063c20 2021-11-12T05:47:27.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.336+0000 7fb7667fc700 1 -- 172.21.2.105:0/1429823981 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb76c00fcf0 con 0x7fb774063c20 2021-11-12T05:47:27.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.336+0000 7fb7667fc700 1 --2- 172.21.2.105:0/1429823981 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb75c0536a0 0x7fb75c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:27.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.336+0000 7fb7667fc700 1 -- 172.21.2.105:0/1429823981 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5725+0+0 (secure 0 0 0) 0x7fb76c06c2b0 con 0x7fb774063c20 2021-11-12T05:47:27.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.336+0000 7fb7792ac700 1 --2- 172.21.2.105:0/1429823981 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb75c0536a0 0x7fb75c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:27.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.336+0000 7fb7792ac700 1 --2- 172.21.2.105:0/1429823981 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb75c0536a0 0x7fb75c055b60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7fb770005000 tx=0x7fb7740b5d70).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:27.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.340+0000 7fb7667fc700 1 -- 172.21.2.105:0/1429823981 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb76c043510 con 0x7fb774063c20 2021-11-12T05:47:27.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:27.432+0000 7fb77b510700 1 -- 172.21.2.105:0/1429823981 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fb7740b3050 con 0x7fb774063c20 2021-11-12T05:47:28.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.176+0000 7fb7667fc700 1 -- 172.21.2.105:0/1429823981 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v80) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb76c046b30 con 0x7fb774063c20 2021-11-12T05:47:28.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.180+0000 7fb77b510700 1 -- 172.21.2.105:0/1429823981 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb75c0536a0 msgr2=0x7fb75c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:28.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.180+0000 7fb77b510700 1 --2- 172.21.2.105:0/1429823981 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb75c0536a0 0x7fb75c055b60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7fb770005000 tx=0x7fb7740b5d70).stop 2021-11-12T05:47:28.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.180+0000 7fb77b510700 1 -- 172.21.2.105:0/1429823981 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb774063c20 msgr2=0x7fb774157030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:28.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.180+0000 7fb77b510700 1 --2- 172.21.2.105:0/1429823981 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb774063c20 0x7fb774157030 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7fb76c00b000 tx=0x7fb76c0091d0).stop 2021-11-12T05:47:28.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.180+0000 7fb77b510700 1 -- 172.21.2.105:0/1429823981 shutdown_connections 2021-11-12T05:47:28.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.180+0000 7fb77b510700 1 --2- 172.21.2.105:0/1429823981 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb75c0536a0 0x7fb75c055b60 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:28.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.180+0000 7fb77b510700 1 --2- 172.21.2.105:0/1429823981 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb774063c20 0x7fb774157030 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:28.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.180+0000 7fb77b510700 1 --2- 172.21.2.105:0/1429823981 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb7740637a0 0x7fb774156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:28.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.180+0000 7fb77b510700 1 --2- 172.21.2.105:0/1429823981 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb758003cb0 0x7fb7741429a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:28.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.180+0000 7fb77b510700 1 -- 172.21.2.105:0/1429823981 >> 172.21.2.105:0/1429823981 conn(0x7fb77405c490 msgr2=0x7fb774138730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:28.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.180+0000 7fb77b510700 1 -- 172.21.2.105:0/1429823981 shutdown_connections 2021-11-12T05:47:28.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.180+0000 7fb77b510700 1 -- 172.21.2.105:0/1429823981 wait complete. 2021-11-12T05:47:28.187 INFO:teuthology.orchestra.run.gibba005.stderr: removed all blacklist entries 2021-11-12T05:47:28.190 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-11-12T05:47:28.190 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-11-12T05:47:28.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.240+0000 7f8615db2700 1 Processor -- start 2021-11-12T05:47:28.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.240+0000 7f8615db2700 1 -- start start 2021-11-12T05:47:28.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.240+0000 7f8615db2700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f86100626b0 0x7f8610062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:28.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.240+0000 7f8615db2700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f86100af750 0x7f8610130370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:28.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.240+0000 7f8615db2700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8610130cf0 con 0x7f8610130860 2021-11-12T05:47:28.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.240+0000 7f8615db2700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86100b0d50 con 0x7f86100af750 2021-11-12T05:47:28.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.240+0000 7f8615db2700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86100ad380 con 0x7f86100626b0 2021-11-12T05:47:28.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.240+0000 7f860effd700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f86100af750 0x7f8610130370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:28.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.240+0000 7f860effd700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f86100af750 0x7f8610130370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3300/0 says I am v2:172.21.2.105:37048/0 (socket says 172.21.2.105:37048) 2021-11-12T05:47:28.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.240+0000 7f860effd700 1 -- 172.21.2.105:0/1358360339 learned_addr learned my addr 172.21.2.105:0/1358360339 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:28.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.240+0000 7f860f7fe700 1 --2- 172.21.2.105:0/1358360339 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f86100626b0 0x7f8610062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:28.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.244+0000 7f860effd700 1 -- 172.21.2.105:0/1358360339 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f86100626b0 msgr2=0x7f8610062a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:28.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.244+0000 7f860effd700 1 --2- 172.21.2.105:0/1358360339 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f86100626b0 0x7f8610062a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:28.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.244+0000 7f860effd700 1 -- 172.21.2.105:0/1358360339 >> v1:172.21.2.115:6789/0 conn(0x7f8610130860 legacy=0x7f861014a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:28.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.244+0000 7f860effd700 1 -- 172.21.2.105:0/1358360339 --> v2:172.21.2.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86100ae190 con 0x7f86100af750 2021-11-12T05:47:28.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.244+0000 7f860effd700 1 --2- 172.21.2.105:0/1358360339 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f86100af750 0x7f8610130370 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f8604002f70 tx=0x7f8604006eb0).ready entity=mon.1 client_cookie=fe0f2533306df220 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:28.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.244+0000 7f860e7fc700 1 -- 172.21.2.105:0/1358360339 <== mon.1 v2:172.21.2.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f860400d570 con 0x7f86100af750 2021-11-12T05:47:28.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.244+0000 7f860e7fc700 1 -- 172.21.2.105:0/1358360339 <== mon.1 v2:172.21.2.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8604000e90 con 0x7f86100af750 2021-11-12T05:47:28.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.244+0000 7f860e7fc700 1 -- 172.21.2.105:0/1358360339 <== mon.1 v2:172.21.2.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f860400d900 con 0x7f86100af750 2021-11-12T05:47:28.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.244+0000 7f8615db2700 1 -- 172.21.2.105:0/1358360339 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f86100af750 msgr2=0x7f8610130370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:28.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.244+0000 7f8615db2700 1 --2- 172.21.2.105:0/1358360339 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f86100af750 0x7f8610130370 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f8604002f70 tx=0x7f8604006eb0).stop 2021-11-12T05:47:28.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.244+0000 7f8615db2700 1 -- 172.21.2.105:0/1358360339 shutdown_connections 2021-11-12T05:47:28.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.244+0000 7f8615db2700 1 --2- 172.21.2.105:0/1358360339 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f86100af750 0x7f8610130370 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:28.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.244+0000 7f8615db2700 1 --2- 172.21.2.105:0/1358360339 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f86100626b0 0x7f8610062a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:28.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.244+0000 7f8615db2700 1 -- 172.21.2.105:0/1358360339 >> 172.21.2.105:0/1358360339 conn(0x7f86100b5320 msgr2=0x7f86100b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:28.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.244+0000 7f8615db2700 1 -- 172.21.2.105:0/1358360339 shutdown_connections 2021-11-12T05:47:28.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.244+0000 7f8615db2700 1 -- 172.21.2.105:0/1358360339 wait complete. 2021-11-12T05:47:28.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.244+0000 7f8615db2700 1 Processor -- start 2021-11-12T05:47:28.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.244+0000 7f8615db2700 1 -- start start 2021-11-12T05:47:28.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.244+0000 7f8615db2700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f86100626b0 0x7f8610063e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:28.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.244+0000 7f8615db2700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f86100af750 0x7f8610159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:28.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.244+0000 7f8615db2700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8610130860 0x7f8610146390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:28.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.244+0000 7f8615db2700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8610062fe0 con 0x7f86100626b0 2021-11-12T05:47:28.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.244+0000 7f8615db2700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8610063280 con 0x7f8610130860 2021-11-12T05:47:28.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.244+0000 7f8615db2700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8610064d70 con 0x7f86100af750 2021-11-12T05:47:28.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.244+0000 7f860f7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f86100626b0 0x7f8610063e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:28.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.244+0000 7f860f7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f86100626b0 0x7f8610063e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48112/0 (socket says 172.21.2.105:48112) 2021-11-12T05:47:28.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.244+0000 7f860f7fe700 1 -- 172.21.2.105:0/2353296151 learned_addr learned my addr 172.21.2.105:0/2353296151 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:28.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.244+0000 7f860f7fe700 1 -- 172.21.2.105:0/2353296151 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f86100af750 msgr2=0x7f8610159f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:28.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.244+0000 7f860f7fe700 1 --2- 172.21.2.105:0/2353296151 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f86100af750 0x7f8610159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:28.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.244+0000 7f860f7fe700 1 -- 172.21.2.105:0/2353296151 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8610130860 msgr2=0x7f8610146390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:28.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.244+0000 7f860f7fe700 1 --2- 172.21.2.105:0/2353296151 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8610130860 0x7f8610146390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:28.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.244+0000 7f860f7fe700 1 -- 172.21.2.105:0/2353296151 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860400b1e0 con 0x7f86100626b0 2021-11-12T05:47:28.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.244+0000 7f860f7fe700 1 --2- 172.21.2.105:0/2353296151 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f86100626b0 0x7f8610063e10 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 rx=0x7f860000c000 tx=0x7f8600006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:28.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.244+0000 7f860cff9700 1 -- 172.21.2.105:0/2353296151 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8600010780 con 0x7f86100626b0 2021-11-12T05:47:28.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.244+0000 7f860cff9700 1 -- 172.21.2.105:0/2353296151 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86000108e0 con 0x7f86100626b0 2021-11-12T05:47:28.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.244+0000 7f8615db2700 1 -- 172.21.2.105:0/2353296151 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8610062c60 con 0x7f86100626b0 2021-11-12T05:47:28.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.244+0000 7f860cff9700 1 -- 172.21.2.105:0/2353296151 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8600010c40 con 0x7f86100626b0 2021-11-12T05:47:28.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.248+0000 7f8615db2700 1 -- 172.21.2.105:0/2353296151 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8610066820 con 0x7f86100626b0 2021-11-12T05:47:28.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.248+0000 7f8615db2700 1 -- 172.21.2.105:0/2353296151 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8610062e50 con 0x7f86100626b0 2021-11-12T05:47:28.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.248+0000 7f860cff9700 1 -- 172.21.2.105:0/2353296151 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f860001c460 con 0x7f86100626b0 2021-11-12T05:47:28.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.248+0000 7f860cff9700 1 --2- 172.21.2.105:0/2353296151 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f85f0053640 0x7f85f0055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:28.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.248+0000 7f860cff9700 1 -- 172.21.2.105:0/2353296151 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f860006bc90 con 0x7f86100626b0 2021-11-12T05:47:28.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.248+0000 7f860effd700 1 --2- 172.21.2.105:0/2353296151 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f85f0053640 0x7f85f0055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:28.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.248+0000 7f860effd700 1 --2- 172.21.2.105:0/2353296151 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f85f0053640 0x7f85f0055b00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f8604002f70 tx=0x7f8604015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:28.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.248+0000 7f860cff9700 1 -- 172.21.2.105:0/2353296151 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8600046e60 con 0x7f86100626b0 2021-11-12T05:47:28.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.360+0000 7f8615db2700 1 -- 172.21.2.105:0/2353296151 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8610063440 con 0x7f86100626b0 2021-11-12T05:47:28.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.360+0000 7f860cff9700 1 -- 172.21.2.105:0/2353296151 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v27) v1 ==== 80+0+4242 (secure 0 0 0) 0x7f8600042f70 con 0x7f86100626b0 2021-11-12T05:47:28.365 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:28.366 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:47:28.366 INFO:teuthology.orchestra.run.gibba005.stdout: "auth_dump": [ 2021-11-12T05:47:28.366 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:28.367 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mds.a", 2021-11-12T05:47:28.367 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1hGVLeOhAAX2029T+USC1Um93TSzjxdA==", 2021-11-12T05:47:28.367 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:47:28.367 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:47:28.367 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:47:28.368 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:47:28.368 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:47:28.368 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:28.368 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:28.369 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:28.369 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mds.b", 2021-11-12T05:47:28.369 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hiebUAxAAGcjDAGyvecjzagGoRBX8tg==", 2021-11-12T05:47:28.369 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:47:28.369 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:47:28.370 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:47:28.370 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:47:28.370 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:47:28.370 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:28.370 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:28.371 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:28.371 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.0", 2021-11-12T05:47:28.371 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1ht05fORAAN2YrbsxBau1FQC4C8Dvb3g==", 2021-11-12T05:47:28.371 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:47:28.372 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:47:28.372 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:47:28.372 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:47:28.372 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:28.372 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:28.373 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:28.373 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.1", 2021-11-12T05:47:28.373 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAu/o1hzp1vGhAAQ6u3Npb+yNGlNOUdoHzFZA==", 2021-11-12T05:47:28.373 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:47:28.374 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:47:28.374 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:47:28.374 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:47:28.374 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:28.374 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:28.375 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:28.375 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.2", 2021-11-12T05:47:28.375 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAw/o1hHWwOOhAAx7txWG8rbch18+SBnJkfkQ==", 2021-11-12T05:47:28.375 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:47:28.376 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:47:28.376 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:47:28.376 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:47:28.376 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:28.376 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:28.377 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:28.377 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.3", 2021-11-12T05:47:28.377 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAz/o1howZpHxAAKgUVxU2tSNZbxW+6OfJF9g==", 2021-11-12T05:47:28.377 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:47:28.378 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:47:28.378 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:47:28.378 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:47:28.378 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:28.378 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:28.379 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:28.379 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.4", 2021-11-12T05:47:28.379 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA2/o1humA5KRAAVbO6UYLOBQDq3WiEkkS6xw==", 2021-11-12T05:47:28.379 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:47:28.380 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:47:28.380 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:47:28.380 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:47:28.380 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:28.381 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:28.381 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:28.381 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.5", 2021-11-12T05:47:28.381 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA5/o1hALdKDRAAR9nsaDOo9GUgpmBPHVp5HQ==", 2021-11-12T05:47:28.381 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:47:28.382 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:47:28.382 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:47:28.382 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:47:28.382 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:28.383 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:28.383 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:28.383 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.6", 2021-11-12T05:47:28.383 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA7/o1hCVP2KhAAHj5SxnJ81mKrJOg2CE2wLQ==", 2021-11-12T05:47:28.384 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:47:28.384 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:47:28.384 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:47:28.384 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:47:28.384 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:28.385 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:28.385 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:28.385 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.7", 2021-11-12T05:47:28.385 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA+/o1hWCEqEBAAv8nF9NeF2Ue5W8Ijj8Skgg==", 2021-11-12T05:47:28.386 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:47:28.386 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:47:28.386 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:47:28.386 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:47:28.387 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:28.387 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:28.387 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:28.387 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.0", 2021-11-12T05:47:28.387 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hzEzhCBAATF8giEBtrj13SAr5EJV4TA==", 2021-11-12T05:47:28.388 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:47:28.388 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:47:28.388 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow r", 2021-11-12T05:47:28.388 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-12T05:47:28.389 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:28.389 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:28.389 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:28.389 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.1", 2021-11-12T05:47:28.389 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hO6zfCxAAae1obagtpsnA9e8FlTExVA==", 2021-11-12T05:47:28.390 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:47:28.390 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:47:28.390 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow r", 2021-11-12T05:47:28.390 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-12T05:47:28.391 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:28.391 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:28.391 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:28.391 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.2", 2021-11-12T05:47:28.392 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hFYDGDhAAyz77VXKtOz86ztJ8FUIvAg==", 2021-11-12T05:47:28.392 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:47:28.392 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:47:28.392 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow r", 2021-11-12T05:47:28.392 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-12T05:47:28.393 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:28.393 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:28.393 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:28.393 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.admin", 2021-11-12T05:47:28.394 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1hwdoBHRAAUHHEU3dbyso2BnE/JppV8A==", 2021-11-12T05:47:28.394 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:47:28.394 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow *", 2021-11-12T05:47:28.394 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:47:28.395 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:47:28.395 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:47:28.395 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:28.395 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:28.395 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:28.396 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mgr.x", 2021-11-12T05:47:28.396 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1h6JBaORAAbgxQtCzGNj7MLfgwGd4cWA==", 2021-11-12T05:47:28.396 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:47:28.396 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow *", 2021-11-12T05:47:28.397 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow profile mgr", 2021-11-12T05:47:28.397 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:47:28.397 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:28.397 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:28.398 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:28.398 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mgr.y", 2021-11-12T05:47:28.398 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1hwfvvNRAASU7NmYBG/Yb6/ma1/Ew7mw==", 2021-11-12T05:47:28.398 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:47:28.399 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow *", 2021-11-12T05:47:28.399 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow profile mgr", 2021-11-12T05:47:28.399 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:47:28.399 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:28.399 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:28.400 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:28.400 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:47:28.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.360+0000 7f8615db2700 1 -- 172.21.2.105:0/2353296151 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f85f0053640 msgr2=0x7f85f0055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:28.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.360+0000 7f8615db2700 1 --2- 172.21.2.105:0/2353296151 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f85f0053640 0x7f85f0055b00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f8604002f70 tx=0x7f8604015000).stop 2021-11-12T05:47:28.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.360+0000 7f8615db2700 1 -- 172.21.2.105:0/2353296151 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f86100626b0 msgr2=0x7f8610063e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:28.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.360+0000 7f8615db2700 1 --2- 172.21.2.105:0/2353296151 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f86100626b0 0x7f8610063e10 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 rx=0x7f860000c000 tx=0x7f8600006df0).stop 2021-11-12T05:47:28.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.360+0000 7f8615db2700 1 -- 172.21.2.105:0/2353296151 shutdown_connections 2021-11-12T05:47:28.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.360+0000 7f8615db2700 1 --2- 172.21.2.105:0/2353296151 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f85f0053640 0x7f85f0055b00 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:28.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.360+0000 7f8615db2700 1 --2- 172.21.2.105:0/2353296151 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8610130860 0x7f8610146390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:28.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.360+0000 7f8615db2700 1 --2- 172.21.2.105:0/2353296151 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f86100af750 0x7f8610159f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:28.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.360+0000 7f8615db2700 1 --2- 172.21.2.105:0/2353296151 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f86100626b0 0x7f8610063e10 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:28.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.360+0000 7f8615db2700 1 -- 172.21.2.105:0/2353296151 >> 172.21.2.105:0/2353296151 conn(0x7f86100b5320 msgr2=0x7f8610130140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:28.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.360+0000 7f8615db2700 1 -- 172.21.2.105:0/2353296151 shutdown_connections 2021-11-12T05:47:28.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.360+0000 7f8615db2700 1 -- 172.21.2.105:0/2353296151 wait complete. 2021-11-12T05:47:28.405 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:47:28.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.452+0000 7f0d62f2d700 1 Processor -- start 2021-11-12T05:47:28.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.452+0000 7f0d62f2d700 1 -- start start 2021-11-12T05:47:28.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.452+0000 7f0d62f2d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f0d5c0ac280 0x7f0d5c14b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:28.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.452+0000 7f0d62f2d700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d5c0af730 0x7f0d5c0ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:28.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.452+0000 7f0d62f2d700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d5c0ac7b0 con 0x7f0d5c0ad080 2021-11-12T05:47:28.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.452+0000 7f0d62f2d700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d5c1488a0 con 0x7f0d5c0ac280 2021-11-12T05:47:28.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.452+0000 7f0d62f2d700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c0ac9e0 con 0x7f0d5c0af730 2021-11-12T05:47:28.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.452+0000 7f0d5bfff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f0d5c0ac280 0x7f0d5c14b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:28.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.452+0000 7f0d5bfff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f0d5c0ac280 0x7f0d5c14b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48120/0 (socket says 172.21.2.105:48120) 2021-11-12T05:47:28.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.452+0000 7f0d5bfff700 1 -- 172.21.2.105:0/2716039038 learned_addr learned my addr 172.21.2.105:0/2716039038 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:28.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.452+0000 7f0d5bfff700 1 -- 172.21.2.105:0/2716039038 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d5c0af730 msgr2=0x7f0d5c0ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:28.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.452+0000 7f0d5bfff700 1 --2- 172.21.2.105:0/2716039038 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d5c0af730 0x7f0d5c0ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:28.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.452+0000 7f0d5bfff700 1 -- 172.21.2.105:0/2716039038 >> v1:172.21.2.115:6789/0 conn(0x7f0d5c0ad080 legacy=0x7f0d5c14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:28.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.452+0000 7f0d5bfff700 1 -- 172.21.2.105:0/2716039038 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5c0b0b30 con 0x7f0d5c0ac280 2021-11-12T05:47:28.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.452+0000 7f0d5bfff700 1 --2- 172.21.2.105:0/2716039038 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d5c0ac280 0x7f0d5c14b2f0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7f0d5c0b6060 tx=0x7f0d4c006eb0).ready entity=mon.0 client_cookie=cf726a238365fc7 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:28.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.452+0000 7f0d5b7fe700 1 -- 172.21.2.105:0/2716039038 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d4c00d570 con 0x7f0d5c0ac280 2021-11-12T05:47:28.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.452+0000 7f0d5b7fe700 1 -- 172.21.2.105:0/2716039038 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4c000e90 con 0x7f0d5c0ac280 2021-11-12T05:47:28.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.452+0000 7f0d5b7fe700 1 -- 172.21.2.105:0/2716039038 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d4c00d8c0 con 0x7f0d5c0ac280 2021-11-12T05:47:28.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.452+0000 7f0d62f2d700 1 -- 172.21.2.105:0/2716039038 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d5c0ac280 msgr2=0x7f0d5c14b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:28.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.452+0000 7f0d62f2d700 1 --2- 172.21.2.105:0/2716039038 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d5c0ac280 0x7f0d5c14b2f0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7f0d5c0b6060 tx=0x7f0d4c006eb0).stop 2021-11-12T05:47:28.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.452+0000 7f0d62f2d700 1 -- 172.21.2.105:0/2716039038 shutdown_connections 2021-11-12T05:47:28.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.452+0000 7f0d62f2d700 1 --2- 172.21.2.105:0/2716039038 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d5c0af730 0x7f0d5c0ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:28.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.452+0000 7f0d62f2d700 1 --2- 172.21.2.105:0/2716039038 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d5c0ac280 0x7f0d5c14b2f0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:28.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.452+0000 7f0d62f2d700 1 -- 172.21.2.105:0/2716039038 >> 172.21.2.105:0/2716039038 conn(0x7f0d5c0b5370 msgr2=0x7f0d5c0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:28.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.452+0000 7f0d62f2d700 1 -- 172.21.2.105:0/2716039038 shutdown_connections 2021-11-12T05:47:28.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.452+0000 7f0d62f2d700 1 -- 172.21.2.105:0/2716039038 wait complete. 2021-11-12T05:47:28.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.456+0000 7f0d62f2d700 1 Processor -- start 2021-11-12T05:47:28.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.456+0000 7f0d62f2d700 1 -- start start 2021-11-12T05:47:28.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.456+0000 7f0d62f2d700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0d5c0ac280 0x7f0d5c0ab290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:28.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.456+0000 7f0d62f2d700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d5c0ad080 0x7f0d5c0ab780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:28.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.456+0000 7f0d62f2d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d5c0af730 0x7f0d5c15a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:28.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.456+0000 7f0d62f2d700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c0aa210 con 0x7f0d5c0af730 2021-11-12T05:47:28.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.456+0000 7f0d62f2d700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c0641c0 con 0x7f0d5c0ac280 2021-11-12T05:47:28.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.456+0000 7f0d62f2d700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c064460 con 0x7f0d5c0ad080 2021-11-12T05:47:28.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.456+0000 7f0d614ca700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d5c0af730 0x7f0d5c15a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:28.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.456+0000 7f0d614ca700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d5c0af730 0x7f0d5c15a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48128/0 (socket says 172.21.2.105:48128) 2021-11-12T05:47:28.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.456+0000 7f0d614ca700 1 -- 172.21.2.105:0/2342087657 learned_addr learned my addr 172.21.2.105:0/2342087657 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:28.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.456+0000 7f0d60cc9700 1 --2- 172.21.2.105:0/2342087657 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0d5c0ac280 0x7f0d5c0ab290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:28.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.456+0000 7f0d5bfff700 1 --2- 172.21.2.105:0/2342087657 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d5c0ad080 0x7f0d5c0ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:28.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.456+0000 7f0d614ca700 1 -- 172.21.2.105:0/2342087657 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d5c0ad080 msgr2=0x7f0d5c0ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:28.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.456+0000 7f0d614ca700 1 --2- 172.21.2.105:0/2342087657 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d5c0ad080 0x7f0d5c0ab780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:28.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.456+0000 7f0d614ca700 1 -- 172.21.2.105:0/2342087657 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0d5c0ac280 msgr2=0x7f0d5c0ab290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:28.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.456+0000 7f0d614ca700 1 --2- 172.21.2.105:0/2342087657 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0d5c0ac280 0x7f0d5c0ab290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:28.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.456+0000 7f0d614ca700 1 -- 172.21.2.105:0/2342087657 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d4c00b1e0 con 0x7f0d5c0af730 2021-11-12T05:47:28.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.456+0000 7f0d5bfff700 1 --2- 172.21.2.105:0/2342087657 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d5c0ad080 0x7f0d5c0ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:47:28.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.456+0000 7f0d60cc9700 1 --2- 172.21.2.105:0/2342087657 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0d5c0ac280 0x7f0d5c0ab290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:47:28.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.456+0000 7f0d614ca700 1 --2- 172.21.2.105:0/2342087657 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d5c0af730 0x7f0d5c15a420 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7f0d540032f0 tx=0x7f0d540091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:28.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.456+0000 7f0d59ffb700 1 -- 172.21.2.105:0/2342087657 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d5400d4a0 con 0x7f0d5c0af730 2021-11-12T05:47:28.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.456+0000 7f0d59ffb700 1 -- 172.21.2.105:0/2342087657 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5400d600 con 0x7f0d5c0af730 2021-11-12T05:47:28.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.456+0000 7f0d62f2d700 1 -- 172.21.2.105:0/2342087657 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d5c0a96f0 con 0x7f0d5c0af730 2021-11-12T05:47:28.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.456+0000 7f0d59ffb700 1 -- 172.21.2.105:0/2342087657 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d5400d960 con 0x7f0d5c0af730 2021-11-12T05:47:28.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.456+0000 7f0d62f2d700 1 -- 172.21.2.105:0/2342087657 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d5c0abe10 con 0x7f0d5c0af730 2021-11-12T05:47:28.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.456+0000 7f0d62f2d700 1 -- 172.21.2.105:0/2342087657 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d5c0a9880 con 0x7f0d5c0af730 2021-11-12T05:47:28.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.456+0000 7f0d59ffb700 1 -- 172.21.2.105:0/2342087657 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0d54018030 con 0x7f0d5c0af730 2021-11-12T05:47:28.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.456+0000 7f0d59ffb700 1 --2- 172.21.2.105:0/2342087657 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0d40053610 0x7f0d40055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:28.474 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.456+0000 7f0d59ffb700 1 -- 172.21.2.105:0/2342087657 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f0d5406b1c0 con 0x7f0d5c0af730 2021-11-12T05:47:28.474 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.456+0000 7f0d60cc9700 1 --2- 172.21.2.105:0/2342087657 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0d40053610 0x7f0d40055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:28.474 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.456+0000 7f0d60cc9700 1 --2- 172.21.2.105:0/2342087657 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0d40053610 0x7f0d40055ad0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f0d4400a000 tx=0x7f0d44008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:28.474 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.460+0000 7f0d59ffb700 1 -- 172.21.2.105:0/2342087657 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0d54042500 con 0x7f0d5c0af730 2021-11-12T05:47:28.546 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.540+0000 7f0d62f2d700 1 -- 172.21.2.105:0/2342087657 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d5c057350 con 0x7f0d5c0af730 2021-11-12T05:47:28.546 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.540+0000 7f0d59ffb700 1 -- 172.21.2.105:0/2342087657 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+13415 (secure 0 0 0) 0x7f0d54045b20 con 0x7f0d5c0af730 2021-11-12T05:47:28.547 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:28.547 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":80,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:47:28.168532+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:47:28.549 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.544+0000 7f0d62f2d700 1 -- 172.21.2.105:0/2342087657 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0d40053610 msgr2=0x7f0d40055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:28.549 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.544+0000 7f0d62f2d700 1 --2- 172.21.2.105:0/2342087657 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0d40053610 0x7f0d40055ad0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f0d4400a000 tx=0x7f0d44008040).stop 2021-11-12T05:47:28.549 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.544+0000 7f0d62f2d700 1 -- 172.21.2.105:0/2342087657 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d5c0af730 msgr2=0x7f0d5c15a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:28.549 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.544+0000 7f0d62f2d700 1 --2- 172.21.2.105:0/2342087657 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d5c0af730 0x7f0d5c15a420 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7f0d540032f0 tx=0x7f0d540091a0).stop 2021-11-12T05:47:28.549 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.544+0000 7f0d62f2d700 1 -- 172.21.2.105:0/2342087657 shutdown_connections 2021-11-12T05:47:28.550 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.544+0000 7f0d62f2d700 1 --2- 172.21.2.105:0/2342087657 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0d40053610 0x7f0d40055ad0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:28.550 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.544+0000 7f0d62f2d700 1 --2- 172.21.2.105:0/2342087657 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0d5c0af730 0x7f0d5c15a420 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:28.550 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.544+0000 7f0d62f2d700 1 --2- 172.21.2.105:0/2342087657 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0d5c0ad080 0x7f0d5c0ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:28.551 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.544+0000 7f0d62f2d700 1 --2- 172.21.2.105:0/2342087657 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0d5c0ac280 0x7f0d5c0ab290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:28.551 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.544+0000 7f0d62f2d700 1 -- 172.21.2.105:0/2342087657 >> 172.21.2.105:0/2342087657 conn(0x7f0d5c0b5370 msgr2=0x7f0d5c145dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:28.551 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.544+0000 7f0d62f2d700 1 -- 172.21.2.105:0/2342087657 shutdown_connections 2021-11-12T05:47:28.551 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.544+0000 7f0d62f2d700 1 -- 172.21.2.105:0/2342087657 wait complete. 2021-11-12T05:47:28.554 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-12T05:47:28.555 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:47:28.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.604+0000 7f4fc66f9700 1 Processor -- start 2021-11-12T05:47:28.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.604+0000 7f4fc66f9700 1 -- start start 2021-11-12T05:47:28.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.604+0000 7f4fc66f9700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f4fc00b0520 0x7f4fc0144890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:28.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.604+0000 7f4fc66f9700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc00b1840 con 0x7f4fc00ace20 2021-11-12T05:47:28.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.604+0000 7f4fc66f9700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc00af2b0 con 0x7f4fc00aca40 2021-11-12T05:47:28.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.604+0000 7f4fc66f9700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc00b0990 con 0x7f4fc00b0520 2021-11-12T05:47:28.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.604+0000 7f4fbf7fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f4fc00ace20 0x7f4fc0144180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:58530/0 (socket says 172.21.2.105:58530) 2021-11-12T05:47:28.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.604+0000 7f4fbf7fe700 1 -- 172.21.2.105:0/272436757 learned_addr learned my addr 172.21.2.105:0/272436757 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:28.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.604+0000 7f4fbeffd700 1 -- 172.21.2.105:0/272436757 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1436831337 0 0) 0x7f4fc00b1840 con 0x7f4fc00ace20 2021-11-12T05:47:28.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.604+0000 7f4fbeffd700 1 -- 172.21.2.105:0/272436757 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fa0003260 con 0x7f4fc00ace20 2021-11-12T05:47:28.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.604+0000 7f4fbeffd700 1 -- 172.21.2.105:0/272436757 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1271621157 0 0) 0x7f4fa0003260 con 0x7f4fc00ace20 2021-11-12T05:47:28.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.604+0000 7f4fbeffd700 1 -- 172.21.2.105:0/272436757 >> v2:172.21.2.115:3300/0 conn(0x7f4fc00b0520 msgr2=0x7f4fc0144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:28.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.604+0000 7f4fbeffd700 1 --2- 172.21.2.105:0/272436757 >> v2:172.21.2.115:3300/0 conn(0x7f4fc00b0520 0x7f4fc0144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:28.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.604+0000 7f4fbeffd700 1 -- 172.21.2.105:0/272436757 >> v1:172.21.2.115:6789/0 conn(0x7f4fc00aca40 legacy=0x7f4fc01473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:28.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.604+0000 7f4fbeffd700 1 -- 172.21.2.105:0/272436757 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc0144d80 con 0x7f4fc00ace20 2021-11-12T05:47:28.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.604+0000 7f4fbeffd700 1 -- 172.21.2.105:0/272436757 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f4fb0001660 con 0x7f4fc00ace20 2021-11-12T05:47:28.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.604+0000 7f4fbeffd700 1 -- 172.21.2.105:0/272436757 >> v1:172.21.2.105:6789/0 conn(0x7f4fc00ace20 legacy=0x7f4fc0144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:28.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.604+0000 7f4fbeffd700 1 --2- 172.21.2.105:0/272436757 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4fa00037d0 0x7f4fa0003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:28.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.604+0000 7f4fbeffd700 1 --2- 172.21.2.105:0/272436757 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4fa0004500 0x7f4fa0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:28.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.604+0000 7f4fbeffd700 1 --2- 172.21.2.105:0/272436757 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4fa0005070 0x7f4fa000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:28.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.604+0000 7f4fbeffd700 1 -- 172.21.2.105:0/272436757 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc00b0990 con 0x7f4fa0005070 2021-11-12T05:47:28.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.604+0000 7f4fbeffd700 1 -- 172.21.2.105:0/272436757 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa000bef0 con 0x7f4fa0004500 2021-11-12T05:47:28.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.604+0000 7f4fbeffd700 1 -- 172.21.2.105:0/272436757 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa000c0b0 con 0x7f4fa00037d0 2021-11-12T05:47:28.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.604+0000 7f4fc4c96700 1 --2- 172.21.2.105:0/272436757 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4fa0005070 0x7f4fa000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:28.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.604+0000 7f4fbf7fe700 1 --2- 172.21.2.105:0/272436757 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4fa0004500 0x7f4fa0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:28.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.604+0000 7f4fc4c96700 1 -- 172.21.2.105:0/272436757 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4fa00037d0 msgr2=0x7f4fa0003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:28.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.604+0000 7f4fc4c96700 1 --2- 172.21.2.105:0/272436757 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4fa00037d0 0x7f4fa0003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:28.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.604+0000 7f4fc4c96700 1 -- 172.21.2.105:0/272436757 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4fa0004500 msgr2=0x7f4fa0004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:28.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.604+0000 7f4fc4c96700 1 --2- 172.21.2.105:0/272436757 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4fa0004500 0x7f4fa0004980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:28.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.604+0000 7f4fc4c96700 1 -- 172.21.2.105:0/272436757 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc0144d80 con 0x7f4fa0005070 2021-11-12T05:47:28.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.604+0000 7f4fc4c96700 1 -- 172.21.2.105:0/272436757 reap_dead start 2021-11-12T05:47:28.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.604+0000 7f4fc4c96700 1 --2- 172.21.2.105:0/272436757 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4fa0005070 0x7f4fa000b750 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7f4fb80032f0 tx=0x7f4fb8006f90).ready entity=mon.0 client_cookie=4745a26bbc3f4547 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:28.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.604+0000 7f4fbeffd700 1 -- 172.21.2.105:0/272436757 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fb800b460 con 0x7f4fa0005070 2021-11-12T05:47:28.622 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.604+0000 7f4fbeffd700 1 -- 172.21.2.105:0/272436757 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb800b5c0 con 0x7f4fa0005070 2021-11-12T05:47:28.623 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.604+0000 7f4fbeffd700 1 -- 172.21.2.105:0/272436757 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fb800b730 con 0x7f4fa0005070 2021-11-12T05:47:28.623 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.604+0000 7f4fc66f9700 1 -- 172.21.2.105:0/272436757 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4fa0005070 msgr2=0x7f4fa000b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:28.623 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.604+0000 7f4fc66f9700 1 --2- 172.21.2.105:0/272436757 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4fa0005070 0x7f4fa000b750 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7f4fb80032f0 tx=0x7f4fb8006f90).stop 2021-11-12T05:47:28.623 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.608+0000 7f4fc66f9700 1 -- 172.21.2.105:0/272436757 shutdown_connections 2021-11-12T05:47:28.623 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.608+0000 7f4fc66f9700 1 --2- 172.21.2.105:0/272436757 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4fa0005070 0x7f4fa000b750 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:28.624 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.608+0000 7f4fc66f9700 1 -- 172.21.2.105:0/272436757 >> 172.21.2.105:0/272436757 conn(0x7f4fc005c490 msgr2=0x7f4fc00b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:28.624 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.608+0000 7f4fc66f9700 1 -- 172.21.2.105:0/272436757 shutdown_connections 2021-11-12T05:47:28.624 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.608+0000 7f4fc66f9700 1 -- 172.21.2.105:0/272436757 wait complete. 2021-11-12T05:47:28.627 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.608+0000 7f4fc66f9700 1 Processor -- start 2021-11-12T05:47:28.627 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.608+0000 7f4fc66f9700 1 -- start start 2021-11-12T05:47:28.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.608+0000 7f4fc66f9700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4fa0005070 0x7f4fc0147c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:28.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.608+0000 7f4fc66f9700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4fc0145c80 0x7f4fc0146b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:28.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.608+0000 7f4fc66f9700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4fc0157180 0x7f4fc014ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:28.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.608+0000 7f4fc66f9700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc0145a30 con 0x7f4fa0005070 2021-11-12T05:47:28.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.608+0000 7f4fc66f9700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc0156a40 con 0x7f4fc0157180 2021-11-12T05:47:28.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.608+0000 7f4fc66f9700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc0156ce0 con 0x7f4fc0145c80 2021-11-12T05:47:28.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.608+0000 7f4fbffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4fa0005070 0x7f4fc0147c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:28.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.608+0000 7f4fbffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4fa0005070 0x7f4fc0147c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48144/0 (socket says 172.21.2.105:48144) 2021-11-12T05:47:28.630 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.608+0000 7f4fbffff700 1 -- 172.21.2.105:0/4235440054 learned_addr learned my addr 172.21.2.105:0/4235440054 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:28.630 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.608+0000 7f4fbffff700 1 -- 172.21.2.105:0/4235440054 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4fc0145c80 msgr2=0x7f4fc0146b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:28.630 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.608+0000 7f4fbffff700 1 --2- 172.21.2.105:0/4235440054 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4fc0145c80 0x7f4fc0146b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:28.630 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.608+0000 7f4fbffff700 1 -- 172.21.2.105:0/4235440054 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4fc0157180 msgr2=0x7f4fc014ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:28.631 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.608+0000 7f4fbffff700 1 --2- 172.21.2.105:0/4235440054 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4fc0157180 0x7f4fc014ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:28.631 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.608+0000 7f4fbffff700 1 -- 172.21.2.105:0/4235440054 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc0156730 con 0x7f4fa0005070 2021-11-12T05:47:28.631 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.608+0000 7f4fbffff700 1 --2- 172.21.2.105:0/4235440054 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4fa0005070 0x7f4fc0147c00 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f4fa8000f70 tx=0x7f4fa8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:28.631 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.608+0000 7f4fbd7fa700 1 -- 172.21.2.105:0/4235440054 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fa8013460 con 0x7f4fa0005070 2021-11-12T05:47:28.632 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.608+0000 7f4fbd7fa700 1 -- 172.21.2.105:0/4235440054 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa80135c0 con 0x7f4fa0005070 2021-11-12T05:47:28.632 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.608+0000 7f4fc66f9700 1 -- 172.21.2.105:0/4235440054 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc0157630 con 0x7f4fa0005070 2021-11-12T05:47:28.632 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.608+0000 7f4fc66f9700 1 -- 172.21.2.105:0/4235440054 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc014d0d0 con 0x7f4fa0005070 2021-11-12T05:47:28.632 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.608+0000 7f4fbd7fa700 1 -- 172.21.2.105:0/4235440054 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fa8013920 con 0x7f4fa0005070 2021-11-12T05:47:28.632 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.608+0000 7f4fc66f9700 1 -- 172.21.2.105:0/4235440054 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc0156ea0 con 0x7f4fa0005070 2021-11-12T05:47:28.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.608+0000 7f4fbd7fa700 1 -- 172.21.2.105:0/4235440054 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4fa801a060 con 0x7f4fa0005070 2021-11-12T05:47:28.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.608+0000 7f4fbd7fa700 1 --2- 172.21.2.105:0/4235440054 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4fa4053690 0x7f4fa4055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:28.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.608+0000 7f4fbd7fa700 1 -- 172.21.2.105:0/4235440054 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f4fa806b0d0 con 0x7f4fa0005070 2021-11-12T05:47:28.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.608+0000 7f4fbf7fe700 1 --2- 172.21.2.105:0/4235440054 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4fa4053690 0x7f4fa4055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:28.634 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.612+0000 7f4fbf7fe700 1 --2- 172.21.2.105:0/4235440054 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4fa4053690 0x7f4fa4055b50 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f4fb0008000 tx=0x7f4fb0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:28.634 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.612+0000 7f4fbd7fa700 1 -- 172.21.2.105:0/4235440054 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4fa8042410 con 0x7f4fa0005070 2021-11-12T05:47:28.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.692+0000 7f4fc66f9700 1 -- 172.21.2.105:0/4235440054 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4fc0057350 con 0x7f4fa0005070 2021-11-12T05:47:28.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.692+0000 7f4fbd7fa700 1 -- 172.21.2.105:0/4235440054 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v80) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4fa8018070 con 0x7f4fa0005070 2021-11-12T05:47:28.699 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:47:28.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.696+0000 7f4fc66f9700 1 -- 172.21.2.105:0/4235440054 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4fa4053690 msgr2=0x7f4fa4055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:28.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.696+0000 7f4fc66f9700 1 --2- 172.21.2.105:0/4235440054 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4fa4053690 0x7f4fa4055b50 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f4fb0008000 tx=0x7f4fb0009040).stop 2021-11-12T05:47:28.701 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.696+0000 7f4fc66f9700 1 -- 172.21.2.105:0/4235440054 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4fa0005070 msgr2=0x7f4fc0147c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:28.701 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.696+0000 7f4fc66f9700 1 --2- 172.21.2.105:0/4235440054 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4fa0005070 0x7f4fc0147c00 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f4fa8000f70 tx=0x7f4fa8006df0).stop 2021-11-12T05:47:28.701 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.696+0000 7f4fc66f9700 1 -- 172.21.2.105:0/4235440054 shutdown_connections 2021-11-12T05:47:28.701 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.696+0000 7f4fc66f9700 1 --2- 172.21.2.105:0/4235440054 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4fa4053690 0x7f4fa4055b50 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:28.702 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.696+0000 7f4fc66f9700 1 --2- 172.21.2.105:0/4235440054 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4fc0157180 0x7f4fc014ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:28.702 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.696+0000 7f4fc66f9700 1 --2- 172.21.2.105:0/4235440054 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4fc0145c80 0x7f4fc0146b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:28.702 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.696+0000 7f4fc66f9700 1 --2- 172.21.2.105:0/4235440054 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4fa0005070 0x7f4fc0147c00 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:28.702 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.696+0000 7f4fc66f9700 1 -- 172.21.2.105:0/4235440054 >> 172.21.2.105:0/4235440054 conn(0x7f4fc005c490 msgr2=0x7f4fc00b19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:28.703 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.696+0000 7f4fc66f9700 1 -- 172.21.2.105:0/4235440054 shutdown_connections 2021-11-12T05:47:28.703 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.696+0000 7f4fc66f9700 1 -- 172.21.2.105:0/4235440054 wait complete. 2021-11-12T05:47:28.706 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:47:28.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.756+0000 7f815d89d700 1 Processor -- start 2021-11-12T05:47:28.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.756+0000 7f815d89d700 1 -- start start 2021-11-12T05:47:28.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.756+0000 7f815d89d700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f81580ace20 0x7f81580b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:28.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.756+0000 7f815d89d700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8158144180 0x7f8158144610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:28.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.756+0000 7f815d89d700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81580b1840 con 0x7f81580aca40 2021-11-12T05:47:28.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.756+0000 7f815d89d700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81580b0a10 con 0x7f81580ace20 2021-11-12T05:47:28.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.756+0000 7f815d89d700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81580af2b0 con 0x7f8158144180 2021-11-12T05:47:28.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.756+0000 7f81577fe700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8158144180 0x7f8158144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:28.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.756+0000 7f81567fc700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f81580ace20 0x7f81580b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:28.763 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.756+0000 7f81567fc700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f81580ace20 0x7f81580b0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3300/0 says I am v2:172.21.2.105:37096/0 (socket says 172.21.2.105:37096) 2021-11-12T05:47:28.763 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.756+0000 7f81567fc700 1 -- 172.21.2.105:0/2758479661 learned_addr learned my addr 172.21.2.105:0/2758479661 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:28.763 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.756+0000 7f81577fe700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8158144180 0x7f8158144610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3301/0 says I am v2:172.21.2.105:39344/0 (socket says 172.21.2.105:39344) 2021-11-12T05:47:28.763 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.756+0000 7f81577fe700 1 -- 172.21.2.105:0/2758479661 >> v2:172.21.2.115:3300/0 conn(0x7f81580ace20 msgr2=0x7f81580b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:28.764 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.756+0000 7f81577fe700 1 --2- 172.21.2.105:0/2758479661 >> v2:172.21.2.115:3300/0 conn(0x7f81580ace20 0x7f81580b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:28.764 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.756+0000 7f81577fe700 1 -- 172.21.2.105:0/2758479661 >> v1:172.21.2.115:6789/0 conn(0x7f81580aca40 legacy=0x7f81581473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:28.764 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.756+0000 7f81577fe700 1 -- 172.21.2.105:0/2758479661 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81580b1a70 con 0x7f8158144180 2021-11-12T05:47:28.764 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.756+0000 7f81577fe700 1 --2- 172.21.2.105:0/2758479661 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8158144180 0x7f8158144610 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f81500032f0 tx=0x7f81500091d0).ready entity=mon.2 client_cookie=91b1ae67099d7fc3 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:28.767 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.760+0000 7f8155ffb700 1 -- 172.21.2.105:0/2758479661 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f815000b6c0 con 0x7f8158144180 2021-11-12T05:47:28.767 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.760+0000 7f8155ffb700 1 -- 172.21.2.105:0/2758479661 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f815000b820 con 0x7f8158144180 2021-11-12T05:47:28.768 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.760+0000 7f8155ffb700 1 -- 172.21.2.105:0/2758479661 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f815000b990 con 0x7f8158144180 2021-11-12T05:47:28.768 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.760+0000 7f815d89d700 1 -- 172.21.2.105:0/2758479661 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8158144180 msgr2=0x7f8158144610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:28.768 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.760+0000 7f815d89d700 1 --2- 172.21.2.105:0/2758479661 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8158144180 0x7f8158144610 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f81500032f0 tx=0x7f81500091d0).stop 2021-11-12T05:47:28.768 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.760+0000 7f815d89d700 1 -- 172.21.2.105:0/2758479661 shutdown_connections 2021-11-12T05:47:28.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.760+0000 7f815d89d700 1 --2- 172.21.2.105:0/2758479661 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8158144180 0x7f8158144610 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:28.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.760+0000 7f815d89d700 1 --2- 172.21.2.105:0/2758479661 >> v2:172.21.2.115:3300/0 conn(0x7f81580ace20 0x7f81580b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:28.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.760+0000 7f815d89d700 1 -- 172.21.2.105:0/2758479661 >> 172.21.2.105:0/2758479661 conn(0x7f815805c490 msgr2=0x7f81580b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:28.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.760+0000 7f815d89d700 1 -- 172.21.2.105:0/2758479661 shutdown_connections 2021-11-12T05:47:28.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.760+0000 7f815d89d700 1 -- 172.21.2.105:0/2758479661 wait complete. 2021-11-12T05:47:28.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.760+0000 7f815d89d700 1 Processor -- start 2021-11-12T05:47:28.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.760+0000 7f815d89d700 1 -- start start 2021-11-12T05:47:28.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.760+0000 7f815d89d700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f81580aca40 0x7f815814ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:28.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.760+0000 7f815d89d700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f81580ace20 0x7f8158065480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:28.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.760+0000 7f815d89d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8158144180 0x7f8158156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:28.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.760+0000 7f815d89d700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8158063810 con 0x7f8158144180 2021-11-12T05:47:28.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.760+0000 7f815d89d700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8158064d40 con 0x7f81580ace20 2021-11-12T05:47:28.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.760+0000 7f815d89d700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8158064fe0 con 0x7f81580aca40 2021-11-12T05:47:28.772 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.760+0000 7f81577fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8158144180 0x7f8158156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:28.772 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.760+0000 7f81577fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8158144180 0x7f8158156660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48162/0 (socket says 172.21.2.105:48162) 2021-11-12T05:47:28.772 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.760+0000 7f81577fe700 1 -- 172.21.2.105:0/1613909278 learned_addr learned my addr 172.21.2.105:0/1613909278 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:28.772 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.760+0000 7f81577fe700 1 -- 172.21.2.105:0/1613909278 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f81580aca40 msgr2=0x7f815814ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:28.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.760+0000 7f81577fe700 1 --2- 172.21.2.105:0/1613909278 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f81580aca40 0x7f815814ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:28.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.760+0000 7f81577fe700 1 -- 172.21.2.105:0/1613909278 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f81580ace20 msgr2=0x7f8158065480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:28.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.760+0000 7f81577fe700 1 --2- 172.21.2.105:0/1613909278 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f81580ace20 0x7f8158065480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:28.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.760+0000 7f81577fe700 1 -- 172.21.2.105:0/1613909278 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8150009470 con 0x7f8158144180 2021-11-12T05:47:28.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.760+0000 7f81577fe700 1 --2- 172.21.2.105:0/1613909278 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8158144180 0x7f8158156660 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7f81500032f0 tx=0x7f8150016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:28.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.760+0000 7f814ffff700 1 -- 172.21.2.105:0/1613909278 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f815000b6c0 con 0x7f8158144180 2021-11-12T05:47:28.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.760+0000 7f814ffff700 1 -- 172.21.2.105:0/1613909278 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8150011e50 con 0x7f8158144180 2021-11-12T05:47:28.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.760+0000 7f815d89d700 1 -- 172.21.2.105:0/1613909278 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f815814e3c0 con 0x7f8158144180 2021-11-12T05:47:28.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.760+0000 7f815d89d700 1 -- 172.21.2.105:0/1613909278 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8158065970 con 0x7f8158144180 2021-11-12T05:47:28.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.760+0000 7f814ffff700 1 -- 172.21.2.105:0/1613909278 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81500107a0 con 0x7f8158144180 2021-11-12T05:47:28.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.760+0000 7f815d89d700 1 -- 172.21.2.105:0/1613909278 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8158057350 con 0x7f8158144180 2021-11-12T05:47:28.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.764+0000 7f814ffff700 1 -- 172.21.2.105:0/1613909278 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f815001e070 con 0x7f8158144180 2021-11-12T05:47:28.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.764+0000 7f814ffff700 1 --2- 172.21.2.105:0/1613909278 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f813c053660 0x7f813c055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:28.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.764+0000 7f814ffff700 1 -- 172.21.2.105:0/1613909278 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f815006c860 con 0x7f8158144180 2021-11-12T05:47:28.776 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.764+0000 7f8156ffd700 1 --2- 172.21.2.105:0/1613909278 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f813c053660 0x7f813c055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:28.776 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.764+0000 7f8156ffd700 1 --2- 172.21.2.105:0/1613909278 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f813c053660 0x7f813c055b20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f8158061140 tx=0x7f81480077d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:28.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.764+0000 7f814ffff700 1 -- 172.21.2.105:0/1613909278 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8150043a70 con 0x7f8158144180 2021-11-12T05:47:28.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.848+0000 7f815d89d700 1 -- 172.21.2.105:0/1613909278 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f815805f280 con 0x7f8158144180 2021-11-12T05:47:28.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.848+0000 7f814ffff700 1 -- 172.21.2.105:0/1613909278 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v80) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8150015070 con 0x7f8158144180 2021-11-12T05:47:28.852 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:47:28.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.848+0000 7f815d89d700 1 -- 172.21.2.105:0/1613909278 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f813c053660 msgr2=0x7f813c055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:28.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.848+0000 7f815d89d700 1 --2- 172.21.2.105:0/1613909278 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f813c053660 0x7f813c055b20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f8158061140 tx=0x7f81480077d0).stop 2021-11-12T05:47:28.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.848+0000 7f815d89d700 1 -- 172.21.2.105:0/1613909278 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8158144180 msgr2=0x7f8158156660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:28.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.848+0000 7f815d89d700 1 --2- 172.21.2.105:0/1613909278 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8158144180 0x7f8158156660 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7f81500032f0 tx=0x7f8150016000).stop 2021-11-12T05:47:28.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.848+0000 7f815d89d700 1 -- 172.21.2.105:0/1613909278 shutdown_connections 2021-11-12T05:47:28.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.848+0000 7f815d89d700 1 --2- 172.21.2.105:0/1613909278 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f813c053660 0x7f813c055b20 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:28.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.848+0000 7f815d89d700 1 --2- 172.21.2.105:0/1613909278 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8158144180 0x7f8158156660 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:28.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.848+0000 7f815d89d700 1 --2- 172.21.2.105:0/1613909278 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f81580ace20 0x7f8158065480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:28.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.848+0000 7f815d89d700 1 --2- 172.21.2.105:0/1613909278 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f81580aca40 0x7f815814ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:28.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.848+0000 7f815d89d700 1 -- 172.21.2.105:0/1613909278 >> 172.21.2.105:0/1613909278 conn(0x7f815805c490 msgr2=0x7f81580b2700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:28.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.848+0000 7f815d89d700 1 -- 172.21.2.105:0/1613909278 shutdown_connections 2021-11-12T05:47:28.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.848+0000 7f815d89d700 1 -- 172.21.2.105:0/1613909278 wait complete. 2021-11-12T05:47:28.859 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-12T05:47:28.909 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.904+0000 7f06aa684700 1 Processor -- start 2021-11-12T05:47:28.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.904+0000 7f06aa684700 1 -- start start 2021-11-12T05:47:28.912 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.904+0000 7f06aa684700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f06a40ad080 0x7f06a40af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:28.912 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.904+0000 7f06aa684700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f06a414b2f0 0x7f06a40ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:28.912 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.904+0000 7f06aa684700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06a40ac7b0 con 0x7f06a40ac280 2021-11-12T05:47:28.913 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.904+0000 7f06aa684700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06a41488a0 con 0x7f06a414b2f0 2021-11-12T05:47:28.913 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.904+0000 7f06aa684700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06a40ac9e0 con 0x7f06a40ad080 2021-11-12T05:47:28.913 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.904+0000 7f06a8c21700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f06a414b2f0 0x7f06a40ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:28.913 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.904+0000 7f06a8c21700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f06a414b2f0 0x7f06a40ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48170/0 (socket says 172.21.2.105:48170) 2021-11-12T05:47:28.913 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.904+0000 7f06a8c21700 1 -- 172.21.2.105:0/12750119 learned_addr learned my addr 172.21.2.105:0/12750119 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:28.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06a8c21700 1 -- 172.21.2.105:0/12750119 >> v2:172.21.2.115:3300/0 conn(0x7f06a40ad080 msgr2=0x7f06a40af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:28.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06a8c21700 1 --2- 172.21.2.105:0/12750119 >> v2:172.21.2.115:3300/0 conn(0x7f06a40ad080 0x7f06a40af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:28.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06a8c21700 1 -- 172.21.2.105:0/12750119 >> v1:172.21.2.115:6789/0 conn(0x7f06a40ac280 legacy=0x7f06a414abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:28.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06a8c21700 1 -- 172.21.2.105:0/12750119 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a40b0b30 con 0x7f06a414b2f0 2021-11-12T05:47:28.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06a8c21700 1 --2- 172.21.2.105:0/12750119 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06a414b2f0 0x7f06a40ad460 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7f06a40b06e0 tx=0x7f069c009290).ready entity=mon.0 client_cookie=875ab0d908b8801c server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:28.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06a2ffd700 1 -- 172.21.2.105:0/12750119 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f069c00b830 con 0x7f06a414b2f0 2021-11-12T05:47:28.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06a2ffd700 1 -- 172.21.2.105:0/12750119 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069c00b990 con 0x7f06a414b2f0 2021-11-12T05:47:28.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06a2ffd700 1 -- 172.21.2.105:0/12750119 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f069c00bb40 con 0x7f06a414b2f0 2021-11-12T05:47:28.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06aa684700 1 -- 172.21.2.105:0/12750119 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06a414b2f0 msgr2=0x7f06a40ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:28.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06aa684700 1 --2- 172.21.2.105:0/12750119 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06a414b2f0 0x7f06a40ad460 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7f06a40b06e0 tx=0x7f069c009290).stop 2021-11-12T05:47:28.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06aa684700 1 -- 172.21.2.105:0/12750119 shutdown_connections 2021-11-12T05:47:28.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06aa684700 1 --2- 172.21.2.105:0/12750119 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06a414b2f0 0x7f06a40ad460 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:28.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06aa684700 1 --2- 172.21.2.105:0/12750119 >> v2:172.21.2.115:3300/0 conn(0x7f06a40ad080 0x7f06a40af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:28.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06aa684700 1 -- 172.21.2.105:0/12750119 >> 172.21.2.105:0/12750119 conn(0x7f06a40b5370 msgr2=0x7f06a40b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:28.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06aa684700 1 -- 172.21.2.105:0/12750119 shutdown_connections 2021-11-12T05:47:28.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06aa684700 1 -- 172.21.2.105:0/12750119 wait complete. 2021-11-12T05:47:28.920 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06aa684700 1 Processor -- start 2021-11-12T05:47:28.920 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06aa684700 1 -- start start 2021-11-12T05:47:28.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06aa684700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f06a40ac280 0x7f06a40a9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:28.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06aa684700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06a40ad080 0x7f06a4063850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:28.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06aa684700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f06a414b2f0 0x7f06a4142a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:28.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06aa684700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a40643b0 con 0x7f06a40ad080 2021-11-12T05:47:28.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06aa684700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a4062a30 con 0x7f06a40ac280 2021-11-12T05:47:28.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06aa684700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a4159b80 con 0x7f06a414b2f0 2021-11-12T05:47:28.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06a37fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06a40ad080 0x7f06a4063850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:28.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06a37fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06a40ad080 0x7f06a4063850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48174/0 (socket says 172.21.2.105:48174) 2021-11-12T05:47:28.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06a37fe700 1 -- 172.21.2.105:0/41692744 learned_addr learned my addr 172.21.2.105:0/41692744 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:28.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06a37fe700 1 -- 172.21.2.105:0/41692744 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f06a414b2f0 msgr2=0x7f06a4142a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:28.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06a37fe700 1 --2- 172.21.2.105:0/41692744 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f06a414b2f0 0x7f06a4142a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:28.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06a37fe700 1 -- 172.21.2.105:0/41692744 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f06a40ac280 msgr2=0x7f06a40a9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:28.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06a3fff700 1 --2- 172.21.2.105:0/41692744 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f06a40ac280 0x7f06a40a9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:28.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06a37fe700 1 --2- 172.21.2.105:0/41692744 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f06a40ac280 0x7f06a40a9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:28.924 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06a37fe700 1 -- 172.21.2.105:0/41692744 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069c009530 con 0x7f06a40ad080 2021-11-12T05:47:28.924 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06a3fff700 1 --2- 172.21.2.105:0/41692744 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f06a40ac280 0x7f06a40a9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:47:28.924 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06a37fe700 1 --2- 172.21.2.105:0/41692744 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06a40ad080 0x7f06a4063850 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7f06a4159d10 tx=0x7f0694006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:28.924 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06a17fa700 1 -- 172.21.2.105:0/41692744 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0694013460 con 0x7f06a40ad080 2021-11-12T05:47:28.924 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06a17fa700 1 -- 172.21.2.105:0/41692744 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06940135c0 con 0x7f06a40ad080 2021-11-12T05:47:28.925 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06aa684700 1 -- 172.21.2.105:0/41692744 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06a4159df0 con 0x7f06a40ad080 2021-11-12T05:47:28.925 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06a17fa700 1 -- 172.21.2.105:0/41692744 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0694013920 con 0x7f06a40ad080 2021-11-12T05:47:28.925 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.908+0000 7f06aa684700 1 -- 172.21.2.105:0/41692744 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06a40abb60 con 0x7f06a40ad080 2021-11-12T05:47:28.925 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.912+0000 7f06aa684700 1 -- 172.21.2.105:0/41692744 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06a4063d40 con 0x7f06a40ad080 2021-11-12T05:47:28.926 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.912+0000 7f06a17fa700 1 -- 172.21.2.105:0/41692744 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f069401a060 con 0x7f06a40ad080 2021-11-12T05:47:28.926 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.912+0000 7f06a17fa700 1 --2- 172.21.2.105:0/41692744 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f06880536a0 0x7f0688055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:28.926 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.912+0000 7f06a17fa700 1 -- 172.21.2.105:0/41692744 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f069406afd0 con 0x7f06a40ad080 2021-11-12T05:47:28.926 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.912+0000 7f06a3fff700 1 --2- 172.21.2.105:0/41692744 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f06880536a0 0x7f0688055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:28.926 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.912+0000 7f06a3fff700 1 --2- 172.21.2.105:0/41692744 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f06880536a0 0x7f0688055b60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f068c007000 tx=0x7f068c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:28.927 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.912+0000 7f06a17fa700 1 -- 172.21.2.105:0/41692744 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0694042310 con 0x7f06a40ad080 2021-11-12T05:47:28.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.996+0000 7f06aa684700 1 -- 172.21.2.105:0/41692744 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f06a4159f80 con 0x7f06a40ad080 2021-11-12T05:47:29.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.996+0000 7f06a17fa700 1 -- 172.21.2.105:0/41692744 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v80) v1 ==== 84+0+143 (secure 0 0 0) 0x7f0694045930 con 0x7f06a40ad080 2021-11-12T05:47:29.000 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:29.001 INFO:teuthology.orchestra.run.gibba005.stdout:[ 2021-11-12T05:47:29.001 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:29.001 INFO:teuthology.orchestra.run.gibba005.stdout: "poolnum": 1, 2021-11-12T05:47:29.001 INFO:teuthology.orchestra.run.gibba005.stdout: "poolname": "device_health_metrics" 2021-11-12T05:47:29.002 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:29.002 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:29.002 INFO:teuthology.orchestra.run.gibba005.stdout: "poolnum": 2, 2021-11-12T05:47:29.002 INFO:teuthology.orchestra.run.gibba005.stdout: "poolname": "rbd" 2021-11-12T05:47:29.003 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:29.003 INFO:teuthology.orchestra.run.gibba005.stdout:] 2021-11-12T05:47:29.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.996+0000 7f06aa684700 1 -- 172.21.2.105:0/41692744 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f06880536a0 msgr2=0x7f0688055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:29.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.996+0000 7f06aa684700 1 --2- 172.21.2.105:0/41692744 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f06880536a0 0x7f0688055b60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f068c007000 tx=0x7f068c008040).stop 2021-11-12T05:47:29.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.996+0000 7f06aa684700 1 -- 172.21.2.105:0/41692744 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06a40ad080 msgr2=0x7f06a4063850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:29.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.996+0000 7f06aa684700 1 --2- 172.21.2.105:0/41692744 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06a40ad080 0x7f06a4063850 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7f06a4159d10 tx=0x7f0694006df0).stop 2021-11-12T05:47:29.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.996+0000 7f06aa684700 1 -- 172.21.2.105:0/41692744 shutdown_connections 2021-11-12T05:47:29.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.996+0000 7f06aa684700 1 --2- 172.21.2.105:0/41692744 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f06880536a0 0x7f0688055b60 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:29.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.996+0000 7f06aa684700 1 --2- 172.21.2.105:0/41692744 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f06a414b2f0 0x7f06a4142a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:29.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.996+0000 7f06aa684700 1 --2- 172.21.2.105:0/41692744 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06a40ad080 0x7f06a4063850 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:29.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.996+0000 7f06aa684700 1 --2- 172.21.2.105:0/41692744 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f06a40ac280 0x7f06a40a9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:29.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.996+0000 7f06aa684700 1 -- 172.21.2.105:0/41692744 >> 172.21.2.105:0/41692744 conn(0x7f06a40b5370 msgr2=0x7f06a414aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:29.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.996+0000 7f06aa684700 1 -- 172.21.2.105:0/41692744 shutdown_connections 2021-11-12T05:47:29.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:28.996+0000 7f06aa684700 1 -- 172.21.2.105:0/41692744 wait complete. 2021-11-12T05:47:29.008 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-12T05:47:29.008 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-12T05:47:29.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.056+0000 7f813f366700 1 Processor -- start 2021-11-12T05:47:29.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.056+0000 7f813f366700 1 -- start start 2021-11-12T05:47:29.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.056+0000 7f813f366700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f8138130a80 0x7f8138062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:29.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.056+0000 7f813f366700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81380b0d50 con 0x7f81380af750 2021-11-12T05:47:29.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.056+0000 7f813f366700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81380ad380 con 0x7f81380626b0 2021-11-12T05:47:29.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.056+0000 7f813f366700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81380ae190 con 0x7f8138130a80 2021-11-12T05:47:29.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.056+0000 7f813c901700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f81380af750 0x7f81381474d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:58580/0 (socket says 172.21.2.105:58580) 2021-11-12T05:47:29.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.056+0000 7f813c901700 1 -- 172.21.2.105:0/1945345231 learned_addr learned my addr 172.21.2.105:0/1945345231 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:29.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.056+0000 7f8127fff700 1 -- 172.21.2.105:0/1945345231 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1131679962 0 0) 0x7f81380b0d50 con 0x7f81380af750 2021-11-12T05:47:29.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.056+0000 7f8127fff700 1 -- 172.21.2.105:0/1945345231 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8120003260 con 0x7f81380af750 2021-11-12T05:47:29.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.056+0000 7f8127fff700 1 -- 172.21.2.105:0/1945345231 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 535933037 0 0) 0x7f8120003260 con 0x7f81380af750 2021-11-12T05:47:29.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.056+0000 7f8127fff700 1 -- 172.21.2.105:0/1945345231 >> v2:172.21.2.115:3300/0 conn(0x7f8138130a80 msgr2=0x7f8138062a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:29.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.056+0000 7f8127fff700 1 --2- 172.21.2.105:0/1945345231 >> v2:172.21.2.115:3300/0 conn(0x7f8138130a80 0x7f8138062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:29.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.056+0000 7f8127fff700 1 -- 172.21.2.105:0/1945345231 >> v1:172.21.2.115:6789/0 conn(0x7f81380626b0 legacy=0x7f8138130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:29.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.056+0000 7f8127fff700 1 -- 172.21.2.105:0/1945345231 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81380ae2d0 con 0x7f81380af750 2021-11-12T05:47:29.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.056+0000 7f8127fff700 1 -- 172.21.2.105:0/1945345231 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f8134001660 con 0x7f81380af750 2021-11-12T05:47:29.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.056+0000 7f8127fff700 1 -- 172.21.2.105:0/1945345231 >> v1:172.21.2.105:6789/0 conn(0x7f81380af750 legacy=0x7f81381474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:29.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.056+0000 7f8127fff700 1 --2- 172.21.2.105:0/1945345231 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8120003820 0x7f8120003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:29.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.056+0000 7f8127fff700 1 --2- 172.21.2.105:0/1945345231 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8120004500 0x7f8120004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:29.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.056+0000 7f8127fff700 1 --2- 172.21.2.105:0/1945345231 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8120005050 0x7f812000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:29.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.056+0000 7f8127fff700 1 -- 172.21.2.105:0/1945345231 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81380ae190 con 0x7f8120003820 2021-11-12T05:47:29.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.056+0000 7f8127fff700 1 -- 172.21.2.105:0/1945345231 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812000bf40 con 0x7f8120004500 2021-11-12T05:47:29.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.056+0000 7f8127fff700 1 -- 172.21.2.105:0/1945345231 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f812000c100 con 0x7f8120005050 2021-11-12T05:47:29.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.056+0000 7f813d102700 1 --2- 172.21.2.105:0/1945345231 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8120003820 0x7f8120003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:29.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.056+0000 7f813c901700 1 --2- 172.21.2.105:0/1945345231 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8120004500 0x7f8120004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:29.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.056+0000 7f813d102700 1 -- 172.21.2.105:0/1945345231 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8120005050 msgr2=0x7f812000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:29.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.056+0000 7f813d102700 1 --2- 172.21.2.105:0/1945345231 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8120005050 0x7f812000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:29.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.056+0000 7f813d102700 1 -- 172.21.2.105:0/1945345231 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8120004500 msgr2=0x7f8120004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:29.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.056+0000 7f813d102700 1 --2- 172.21.2.105:0/1945345231 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8120004500 0x7f8120004980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:29.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.056+0000 7f813d102700 1 -- 172.21.2.105:0/1945345231 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8120003260 con 0x7f8120003820 2021-11-12T05:47:29.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.056+0000 7f813d903700 1 -- 172.21.2.105:0/1945345231 reap_dead start 2021-11-12T05:47:29.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.056+0000 7f813d102700 1 --2- 172.21.2.105:0/1945345231 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8120003820 0x7f8120003c20 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7f8128000f70 tx=0x7f81280079e0).ready entity=mon.0 client_cookie=93617c54fccfd24a server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:29.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.056+0000 7f8127fff700 1 -- 172.21.2.105:0/1945345231 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8128007cf0 con 0x7f8120003820 2021-11-12T05:47:29.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.056+0000 7f8127fff700 1 -- 172.21.2.105:0/1945345231 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8128014410 con 0x7f8120003820 2021-11-12T05:47:29.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.056+0000 7f8127fff700 1 -- 172.21.2.105:0/1945345231 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8128014770 con 0x7f8120003820 2021-11-12T05:47:29.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.060+0000 7f813f366700 1 -- 172.21.2.105:0/1945345231 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8120003820 msgr2=0x7f8120003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:29.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.060+0000 7f813f366700 1 --2- 172.21.2.105:0/1945345231 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8120003820 0x7f8120003c20 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7f8128000f70 tx=0x7f81280079e0).stop 2021-11-12T05:47:29.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.060+0000 7f813f366700 1 -- 172.21.2.105:0/1945345231 shutdown_connections 2021-11-12T05:47:29.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.060+0000 7f813f366700 1 --2- 172.21.2.105:0/1945345231 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8120003820 0x7f8120003c20 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:29.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.060+0000 7f813f366700 1 -- 172.21.2.105:0/1945345231 >> 172.21.2.105:0/1945345231 conn(0x7f81380b5320 msgr2=0x7f81380b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:29.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.060+0000 7f813f366700 1 -- 172.21.2.105:0/1945345231 shutdown_connections 2021-11-12T05:47:29.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.060+0000 7f813f366700 1 -- 172.21.2.105:0/1945345231 wait complete. 2021-11-12T05:47:29.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.060+0000 7f813f366700 1 Processor -- start 2021-11-12T05:47:29.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.060+0000 7f813f366700 1 -- start start 2021-11-12T05:47:29.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.060+0000 7f813f366700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8120003820 0x7f81381465c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:29.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.060+0000 7f813f366700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8138066c10 0x7f8138156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:29.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.060+0000 7f813f366700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8138065b20 0x7f8138156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:29.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.060+0000 7f813f366700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8138064950 con 0x7f8138066c10 2021-11-12T05:47:29.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.060+0000 7f813f366700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813812e280 con 0x7f8138065b20 2021-11-12T05:47:29.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.060+0000 7f813f366700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8138062fb0 con 0x7f8120003820 2021-11-12T05:47:29.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.060+0000 7f813c901700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8138066c10 0x7f8138156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:29.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.060+0000 7f813c901700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8138066c10 0x7f8138156810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48192/0 (socket says 172.21.2.105:48192) 2021-11-12T05:47:29.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.060+0000 7f813c901700 1 -- 172.21.2.105:0/1586277023 learned_addr learned my addr 172.21.2.105:0/1586277023 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:29.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.060+0000 7f813c901700 1 -- 172.21.2.105:0/1586277023 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8120003820 msgr2=0x7f81381465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:29.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.060+0000 7f813c901700 1 --2- 172.21.2.105:0/1586277023 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8120003820 0x7f81381465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:29.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.060+0000 7f813c901700 1 -- 172.21.2.105:0/1586277023 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8138065b20 msgr2=0x7f8138156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:29.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.060+0000 7f813c901700 1 --2- 172.21.2.105:0/1586277023 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8138065b20 0x7f8138156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:29.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.060+0000 7f813c901700 1 -- 172.21.2.105:0/1586277023 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8138064b80 con 0x7f8138066c10 2021-11-12T05:47:29.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.060+0000 7f813c901700 1 --2- 172.21.2.105:0/1586277023 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8138066c10 0x7f8138156810 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 rx=0x7f8134008000 tx=0x7f8134009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:29.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.060+0000 7f81267fc700 1 -- 172.21.2.105:0/1586277023 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8134007170 con 0x7f8138066c10 2021-11-12T05:47:29.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.060+0000 7f81267fc700 1 -- 172.21.2.105:0/1586277023 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81340072d0 con 0x7f8138066c10 2021-11-12T05:47:29.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.060+0000 7f813f366700 1 -- 172.21.2.105:0/1586277023 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8138064e20 con 0x7f8138066c10 2021-11-12T05:47:29.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.060+0000 7f813f366700 1 -- 172.21.2.105:0/1586277023 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81381571f0 con 0x7f8138066c10 2021-11-12T05:47:29.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.060+0000 7f81267fc700 1 -- 172.21.2.105:0/1586277023 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8134004920 con 0x7f8138066c10 2021-11-12T05:47:29.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.060+0000 7f813f366700 1 -- 172.21.2.105:0/1586277023 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8138064fb0 con 0x7f8138066c10 2021-11-12T05:47:29.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.060+0000 7f81267fc700 1 -- 172.21.2.105:0/1586277023 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8134004a80 con 0x7f8138066c10 2021-11-12T05:47:29.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.060+0000 7f81267fc700 1 --2- 172.21.2.105:0/1586277023 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8118053540 0x7f8118055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:29.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.060+0000 7f81267fc700 1 -- 172.21.2.105:0/1586277023 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f813406bb30 con 0x7f8138066c10 2021-11-12T05:47:29.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.060+0000 7f813d102700 1 --2- 172.21.2.105:0/1586277023 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8118053540 0x7f8118055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:29.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.064+0000 7f813d102700 1 --2- 172.21.2.105:0/1586277023 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8118053540 0x7f8118055a00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f8128000f70 tx=0x7f8128015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:29.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.064+0000 7f81267fc700 1 -- 172.21.2.105:0/1586277023 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8134042d00 con 0x7f8138066c10 2021-11-12T05:47:29.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.148+0000 7f813f366700 1 -- 172.21.2.105:0/1586277023 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f81380ae2d0 con 0x7f8138066c10 2021-11-12T05:47:29.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.188+0000 7f81267fc700 1 -- 172.21.2.105:0/1586277023 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v81) v1 ==== 133+0+0 (secure 0 0 0) 0x7f81380ae2d0 con 0x7f8138066c10 2021-11-12T05:47:29.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.192+0000 7f813f366700 1 -- 172.21.2.105:0/1586277023 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8118053540 msgr2=0x7f8118055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:29.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.192+0000 7f813f366700 1 --2- 172.21.2.105:0/1586277023 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8118053540 0x7f8118055a00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f8128000f70 tx=0x7f8128015000).stop 2021-11-12T05:47:29.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.192+0000 7f813f366700 1 -- 172.21.2.105:0/1586277023 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8138066c10 msgr2=0x7f8138156810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:29.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.192+0000 7f813f366700 1 --2- 172.21.2.105:0/1586277023 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8138066c10 0x7f8138156810 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 rx=0x7f8134008000 tx=0x7f8134009040).stop 2021-11-12T05:47:29.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.192+0000 7f813f366700 1 -- 172.21.2.105:0/1586277023 shutdown_connections 2021-11-12T05:47:29.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.192+0000 7f813f366700 1 --2- 172.21.2.105:0/1586277023 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8118053540 0x7f8118055a00 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:29.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.192+0000 7f813f366700 1 --2- 172.21.2.105:0/1586277023 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8138065b20 0x7f8138156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:29.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.192+0000 7f813f366700 1 --2- 172.21.2.105:0/1586277023 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8138066c10 0x7f8138156810 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:29.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.192+0000 7f813f366700 1 --2- 172.21.2.105:0/1586277023 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8120003820 0x7f81381465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:29.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.192+0000 7f813f366700 1 -- 172.21.2.105:0/1586277023 >> 172.21.2.105:0/1586277023 conn(0x7f81380b5320 msgr2=0x7f81380b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:29.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.192+0000 7f813f366700 1 -- 172.21.2.105:0/1586277023 shutdown_connections 2021-11-12T05:47:29.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.192+0000 7f813f366700 1 -- 172.21.2.105:0/1586277023 wait complete. 2021-11-12T05:47:29.199 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_metadata' created 2021-11-12T05:47:29.202 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-11-12T05:47:29.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.252+0000 7fdd0ec18700 1 Processor -- start 2021-11-12T05:47:29.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.252+0000 7fdd0ec18700 1 -- start start 2021-11-12T05:47:29.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.252+0000 7fdd0ec18700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fdd080ace20 0x7fdd080b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:29.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.252+0000 7fdd0ec18700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd080b1840 con 0x7fdd08144180 2021-11-12T05:47:29.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.252+0000 7fdd0ec18700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd080af2b0 con 0x7fdd080aca40 2021-11-12T05:47:29.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.252+0000 7fdd0ec18700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd080b0a10 con 0x7fdd080ace20 2021-11-12T05:47:29.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.252+0000 7fdd0d1b5700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fdd08144180 0x7fdd081445f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:58598/0 (socket says 172.21.2.105:58598) 2021-11-12T05:47:29.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.252+0000 7fdd07fff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fdd080ace20 0x7fdd080b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:29.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.252+0000 7fdd0d1b5700 1 -- 172.21.2.105:0/4171666333 learned_addr learned my addr 172.21.2.105:0/4171666333 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:29.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.252+0000 7fdd07fff700 1 -- 172.21.2.105:0/4171666333 >> v1:172.21.2.115:6789/0 conn(0x7fdd080aca40 legacy=0x7fdd081473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:29.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.252+0000 7fdd077fe700 1 -- 172.21.2.105:0/4171666333 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 658900906 0 0) 0x7fdd080b1840 con 0x7fdd08144180 2021-11-12T05:47:29.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.252+0000 7fdd07fff700 1 -- 172.21.2.105:0/4171666333 >> v1:172.21.2.105:6789/0 conn(0x7fdd08144180 legacy=0x7fdd081445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:29.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.252+0000 7fdd07fff700 1 -- 172.21.2.105:0/4171666333 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd080b1a70 con 0x7fdd080ace20 2021-11-12T05:47:29.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd07fff700 1 --2- 172.21.2.105:0/4171666333 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdd080ace20 0x7fdd080b0520 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7fdd080611e0 tx=0x7fdcf8006df0).ready entity=mon.0 client_cookie=37a502d906289a1a server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:29.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd077fe700 1 -- 172.21.2.105:0/4171666333 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcf800d5c0 con 0x7fdd080ace20 2021-11-12T05:47:29.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd077fe700 1 -- 172.21.2.105:0/4171666333 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf8000e90 con 0x7fdd080ace20 2021-11-12T05:47:29.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd077fe700 1 -- 172.21.2.105:0/4171666333 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcf800d910 con 0x7fdd080ace20 2021-11-12T05:47:29.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd0ec18700 1 -- 172.21.2.105:0/4171666333 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdd080ace20 msgr2=0x7fdd080b0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:29.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd0ec18700 1 --2- 172.21.2.105:0/4171666333 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdd080ace20 0x7fdd080b0520 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7fdd080611e0 tx=0x7fdcf8006df0).stop 2021-11-12T05:47:29.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd0ec18700 1 -- 172.21.2.105:0/4171666333 shutdown_connections 2021-11-12T05:47:29.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd0ec18700 1 --2- 172.21.2.105:0/4171666333 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdd080ace20 0x7fdd080b0520 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:29.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd0ec18700 1 -- 172.21.2.105:0/4171666333 >> 172.21.2.105:0/4171666333 conn(0x7fdd0805c490 msgr2=0x7fdd080b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:29.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd0ec18700 1 -- 172.21.2.105:0/4171666333 shutdown_connections 2021-11-12T05:47:29.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd0ec18700 1 -- 172.21.2.105:0/4171666333 wait complete. 2021-11-12T05:47:29.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd0ec18700 1 Processor -- start 2021-11-12T05:47:29.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd0ec18700 1 -- start start 2021-11-12T05:47:29.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd0ec18700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdd080aca40 0x7fdd08063850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:29.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd0ec18700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdd080ace20 0x7fdd08066b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:29.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd0ec18700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdd08144180 0x7fdd08159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:29.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd0ec18700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd080674c0 con 0x7fdd08144180 2021-11-12T05:47:29.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd0ec18700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd08064850 con 0x7fdd080aca40 2021-11-12T05:47:29.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd0ec18700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd08064af0 con 0x7fdd080ace20 2021-11-12T05:47:29.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd0d1b5700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdd08144180 0x7fdd08159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:29.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd0d1b5700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdd08144180 0x7fdd08159c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48210/0 (socket says 172.21.2.105:48210) 2021-11-12T05:47:29.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd0d1b5700 1 -- 172.21.2.105:0/384449104 learned_addr learned my addr 172.21.2.105:0/384449104 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:29.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd0c9b4700 1 --2- 172.21.2.105:0/384449104 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdd080aca40 0x7fdd08063850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:29.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd0d1b5700 1 -- 172.21.2.105:0/384449104 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdd080ace20 msgr2=0x7fdd08066b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:29.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd07fff700 1 --2- 172.21.2.105:0/384449104 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdd080ace20 0x7fdd08066b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:29.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd0d1b5700 1 --2- 172.21.2.105:0/384449104 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdd080ace20 0x7fdd08066b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:29.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd0d1b5700 1 -- 172.21.2.105:0/384449104 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdd080aca40 msgr2=0x7fdd08063850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:29.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd0d1b5700 1 --2- 172.21.2.105:0/384449104 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdd080aca40 0x7fdd08063850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:29.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd0d1b5700 1 -- 172.21.2.105:0/384449104 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf800b180 con 0x7fdd08144180 2021-11-12T05:47:29.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd07fff700 1 --2- 172.21.2.105:0/384449104 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdd080ace20 0x7fdd08066b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:47:29.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd0d1b5700 1 --2- 172.21.2.105:0/384449104 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdd08144180 0x7fdd08159c80 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7fdd00001250 tx=0x7fdd00001380).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:29.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd05ffb700 1 -- 172.21.2.105:0/384449104 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd00005ba0 con 0x7fdd08144180 2021-11-12T05:47:29.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd05ffb700 1 -- 172.21.2.105:0/384449104 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd00005d00 con 0x7fdd08144180 2021-11-12T05:47:29.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd05ffb700 1 -- 172.21.2.105:0/384449104 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd00004a90 con 0x7fdd08144180 2021-11-12T05:47:29.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd0ec18700 1 -- 172.21.2.105:0/384449104 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd08067060 con 0x7fdd08144180 2021-11-12T05:47:29.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd0ec18700 1 -- 172.21.2.105:0/384449104 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd080a71c0 con 0x7fdd08144180 2021-11-12T05:47:29.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd0ec18700 1 -- 172.21.2.105:0/384449104 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd08057350 con 0x7fdd08144180 2021-11-12T05:47:29.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd05ffb700 1 -- 172.21.2.105:0/384449104 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdd0001b070 con 0x7fdd08144180 2021-11-12T05:47:29.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd05ffb700 1 --2- 172.21.2.105:0/384449104 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdcec0535b0 0x7fdcec055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:29.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd05ffb700 1 -- 172.21.2.105:0/384449104 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5950+0+0 (secure 0 0 0) 0x7fdd0006b1b0 con 0x7fdd08144180 2021-11-12T05:47:29.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.256+0000 7fdd0c9b4700 1 --2- 172.21.2.105:0/384449104 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdcec0535b0 0x7fdcec055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:29.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.260+0000 7fdd0c9b4700 1 --2- 172.21.2.105:0/384449104 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdcec0535b0 0x7fdcec055a70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7fdcf000a000 tx=0x7fdcf0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:29.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.260+0000 7fdd05ffb700 1 -- 172.21.2.105:0/384449104 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdd00042390 con 0x7fdd08144180 2021-11-12T05:47:29.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:29.344+0000 7fdd0ec18700 1 -- 172.21.2.105:0/384449104 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fdd0805f280 con 0x7fdd08144180 2021-11-12T05:47:30.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.200+0000 7fdd05ffb700 1 -- 172.21.2.105:0/384449104 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v82) v1 ==== 125+0+0 (secure 0 0 0) 0x7fdd000459b0 con 0x7fdd08144180 2021-11-12T05:47:30.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.204+0000 7fdd0ec18700 1 -- 172.21.2.105:0/384449104 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdcec0535b0 msgr2=0x7fdcec055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:30.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.204+0000 7fdd0ec18700 1 --2- 172.21.2.105:0/384449104 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdcec0535b0 0x7fdcec055a70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7fdcf000a000 tx=0x7fdcf0008040).stop 2021-11-12T05:47:30.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.204+0000 7fdd0ec18700 1 -- 172.21.2.105:0/384449104 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdd08144180 msgr2=0x7fdd08159c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:30.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.204+0000 7fdd0ec18700 1 --2- 172.21.2.105:0/384449104 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdd08144180 0x7fdd08159c80 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7fdd00001250 tx=0x7fdd00001380).stop 2021-11-12T05:47:30.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.204+0000 7fdd0ec18700 1 -- 172.21.2.105:0/384449104 shutdown_connections 2021-11-12T05:47:30.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.204+0000 7fdd0ec18700 1 --2- 172.21.2.105:0/384449104 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdcec0535b0 0x7fdcec055a70 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:30.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.204+0000 7fdd0ec18700 1 --2- 172.21.2.105:0/384449104 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdd08144180 0x7fdd08159c80 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:30.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.204+0000 7fdd0ec18700 1 --2- 172.21.2.105:0/384449104 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdd080ace20 0x7fdd08066b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:30.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.204+0000 7fdd0ec18700 1 --2- 172.21.2.105:0/384449104 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdd080aca40 0x7fdd08063850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:30.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.204+0000 7fdd0ec18700 1 -- 172.21.2.105:0/384449104 >> 172.21.2.105:0/384449104 conn(0x7fdd0805c490 msgr2=0x7fdd081423a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:30.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.204+0000 7fdd0ec18700 1 -- 172.21.2.105:0/384449104 shutdown_connections 2021-11-12T05:47:30.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.204+0000 7fdd0ec18700 1 -- 172.21.2.105:0/384449104 wait complete. 2021-11-12T05:47:30.210 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_data' created 2021-11-12T05:47:30.214 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-12T05:47:30.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.264+0000 7f854536d700 1 Processor -- start 2021-11-12T05:47:30.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.264+0000 7f854536d700 1 -- start start 2021-11-12T05:47:30.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.264+0000 7f854536d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f85400ac280 0x7f854014b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:30.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.264+0000 7f854536d700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f85400af730 0x7f85400ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:30.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.264+0000 7f854536d700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85400ac7b0 con 0x7f85400ad080 2021-11-12T05:47:30.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.264+0000 7f854536d700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85401488a0 con 0x7f85400ac280 2021-11-12T05:47:30.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.264+0000 7f854536d700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85400ac9e0 con 0x7f85400af730 2021-11-12T05:47:30.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.264+0000 7f853effd700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f85400ad080 0x7f854014abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:58610/0 (socket says 172.21.2.105:58610) 2021-11-12T05:47:30.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.264+0000 7f853effd700 1 -- 172.21.2.105:0/1322194165 learned_addr learned my addr 172.21.2.105:0/1322194165 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:30.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.264+0000 7f853e7fc700 1 --2- 172.21.2.105:0/1322194165 >> v2:172.21.2.105:3300/0 conn(0x7f85400ac280 0x7f854014b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:30.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.264+0000 7f853e7fc700 1 -- 172.21.2.105:0/1322194165 >> v2:172.21.2.115:3300/0 conn(0x7f85400af730 msgr2=0x7f85400ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:30.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.264+0000 7f853e7fc700 1 --2- 172.21.2.105:0/1322194165 >> v2:172.21.2.115:3300/0 conn(0x7f85400af730 0x7f85400ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:30.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.264+0000 7f853e7fc700 1 -- 172.21.2.105:0/1322194165 >> v1:172.21.2.105:6789/0 conn(0x7f85400ad080 legacy=0x7f854014abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:30.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.264+0000 7f853e7fc700 1 -- 172.21.2.105:0/1322194165 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85400b0b30 con 0x7f85400ac280 2021-11-12T05:47:30.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.264+0000 7f853dffb700 1 -- 172.21.2.105:0/1322194165 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193910715 0 0) 0x7f85400ac7b0 con 0x7f85400ad080 2021-11-12T05:47:30.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.264+0000 7f853e7fc700 1 --2- 172.21.2.105:0/1322194165 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85400ac280 0x7f854014b2f0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7f85400b1000 tx=0x7f8528006df0).ready entity=mon.0 client_cookie=8b81d8d3457f00a2 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:30.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f853dffb700 1 -- 172.21.2.105:0/1322194165 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f852800d5c0 con 0x7f85400ac280 2021-11-12T05:47:30.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f853dffb700 1 -- 172.21.2.105:0/1322194165 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8528000e90 con 0x7f85400ac280 2021-11-12T05:47:30.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f853dffb700 1 -- 172.21.2.105:0/1322194165 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f852800d910 con 0x7f85400ac280 2021-11-12T05:47:30.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f854536d700 1 -- 172.21.2.105:0/1322194165 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85400ac280 msgr2=0x7f854014b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:30.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f854536d700 1 --2- 172.21.2.105:0/1322194165 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85400ac280 0x7f854014b2f0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7f85400b1000 tx=0x7f8528006df0).stop 2021-11-12T05:47:30.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f854536d700 1 -- 172.21.2.105:0/1322194165 shutdown_connections 2021-11-12T05:47:30.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f854536d700 1 --2- 172.21.2.105:0/1322194165 >> v2:172.21.2.115:3300/0 conn(0x7f85400af730 0x7f85400ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:30.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f854536d700 1 --2- 172.21.2.105:0/1322194165 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85400ac280 0x7f854014b2f0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:30.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f854536d700 1 -- 172.21.2.105:0/1322194165 >> 172.21.2.105:0/1322194165 conn(0x7f85400b5370 msgr2=0x7f85400b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:30.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f854536d700 1 -- 172.21.2.105:0/1322194165 shutdown_connections 2021-11-12T05:47:30.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f854536d700 1 -- 172.21.2.105:0/1322194165 wait complete. 2021-11-12T05:47:30.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f854536d700 1 Processor -- start 2021-11-12T05:47:30.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f854536d700 1 -- start start 2021-11-12T05:47:30.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f854536d700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f85400ac280 0x7f85400a7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:30.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f854536d700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f85400ad080 0x7f85400aa810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:30.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f854536d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85400af730 0x7f85400a7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:30.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f854536d700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85400aad00 con 0x7f85400af730 2021-11-12T05:47:30.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f854536d700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85401575a0 con 0x7f85400ad080 2021-11-12T05:47:30.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f854536d700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8540157840 con 0x7f85400ac280 2021-11-12T05:47:30.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f853f7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85400af730 0x7f85400a7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:30.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f853f7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85400af730 0x7f85400a7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48224/0 (socket says 172.21.2.105:48224) 2021-11-12T05:47:30.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f853f7fe700 1 -- 172.21.2.105:0/3254696148 learned_addr learned my addr 172.21.2.105:0/3254696148 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:30.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f853effd700 1 --2- 172.21.2.105:0/3254696148 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f85400ac280 0x7f85400a7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:30.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f853f7fe700 1 -- 172.21.2.105:0/3254696148 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f85400ac280 msgr2=0x7f85400a7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:30.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f853e7fc700 1 --2- 172.21.2.105:0/3254696148 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f85400ad080 0x7f85400aa810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:30.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f853f7fe700 1 --2- 172.21.2.105:0/3254696148 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f85400ac280 0x7f85400a7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:30.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f853f7fe700 1 -- 172.21.2.105:0/3254696148 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f85400ad080 msgr2=0x7f85400aa810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:30.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f853f7fe700 1 --2- 172.21.2.105:0/3254696148 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f85400ad080 0x7f85400aa810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:30.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f853f7fe700 1 -- 172.21.2.105:0/3254696148 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f852800b180 con 0x7f85400af730 2021-11-12T05:47:30.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f853effd700 1 --2- 172.21.2.105:0/3254696148 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f85400ac280 0x7f85400a7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:47:30.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f853e7fc700 1 --2- 172.21.2.105:0/3254696148 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f85400ad080 0x7f85400aa810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:47:30.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f853f7fe700 1 --2- 172.21.2.105:0/3254696148 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85400af730 0x7f85400a7020 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7f85380032f0 tx=0x7f85380091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:30.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f8537fff700 1 -- 172.21.2.105:0/3254696148 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f853800f510 con 0x7f85400af730 2021-11-12T05:47:30.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f8537fff700 1 -- 172.21.2.105:0/3254696148 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853800f670 con 0x7f85400af730 2021-11-12T05:47:30.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f854536d700 1 -- 172.21.2.105:0/3254696148 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85400a8fb0 con 0x7f85400af730 2021-11-12T05:47:30.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f8537fff700 1 -- 172.21.2.105:0/3254696148 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f853800f7e0 con 0x7f85400af730 2021-11-12T05:47:30.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f854536d700 1 -- 172.21.2.105:0/3254696148 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85400ab190 con 0x7f85400af730 2021-11-12T05:47:30.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f854536d700 1 -- 172.21.2.105:0/3254696148 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85400aaed0 con 0x7f85400af730 2021-11-12T05:47:30.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f8537fff700 1 -- 172.21.2.105:0/3254696148 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f853800f070 con 0x7f85400af730 2021-11-12T05:47:30.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.268+0000 7f8537fff700 1 --2- 172.21.2.105:0/3254696148 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f85240536d0 0x7f8524055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:30.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.272+0000 7f8537fff700 1 -- 172.21.2.105:0/3254696148 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6300+0+0 (secure 0 0 0) 0x7f853806b720 con 0x7f85400af730 2021-11-12T05:47:30.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.272+0000 7f853effd700 1 --2- 172.21.2.105:0/3254696148 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f85240536d0 0x7f8524055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:30.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.272+0000 7f853effd700 1 --2- 172.21.2.105:0/3254696148 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f85240536d0 0x7f8524055b90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f8530008000 tx=0x7f8530009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:30.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.272+0000 7f8537fff700 1 -- 172.21.2.105:0/3254696148 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f85400aaed0 con 0x7f85400af730 2021-11-12T05:47:30.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.380+0000 7f854536d700 1 -- 172.21.2.105:0/3254696148 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f85400aaed0 con 0x7f85400af730 2021-11-12T05:47:30.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.388+0000 7f8537fff700 1 -- 172.21.2.105:0/3254696148 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 15 and data pool 16 v35) v1 ==== 189+0+0 (secure 0 0 0) 0x7f85400aaed0 con 0x7f85400af730 2021-11-12T05:47:30.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.388+0000 7f854536d700 1 -- 172.21.2.105:0/3254696148 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f85240536d0 msgr2=0x7f8524055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:30.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.388+0000 7f854536d700 1 --2- 172.21.2.105:0/3254696148 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f85240536d0 0x7f8524055b90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f8530008000 tx=0x7f8530009040).stop 2021-11-12T05:47:30.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.388+0000 7f854536d700 1 -- 172.21.2.105:0/3254696148 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85400af730 msgr2=0x7f85400a7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:30.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.388+0000 7f854536d700 1 --2- 172.21.2.105:0/3254696148 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85400af730 0x7f85400a7020 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7f85380032f0 tx=0x7f85380091a0).stop 2021-11-12T05:47:30.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.388+0000 7f854536d700 1 -- 172.21.2.105:0/3254696148 shutdown_connections 2021-11-12T05:47:30.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.388+0000 7f854536d700 1 --2- 172.21.2.105:0/3254696148 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f85240536d0 0x7f8524055b90 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:30.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.388+0000 7f854536d700 1 --2- 172.21.2.105:0/3254696148 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f85400af730 0x7f85400a7020 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:30.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.388+0000 7f854536d700 1 --2- 172.21.2.105:0/3254696148 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f85400ad080 0x7f85400aa810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:30.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.388+0000 7f854536d700 1 --2- 172.21.2.105:0/3254696148 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f85400ac280 0x7f85400a7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:30.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.388+0000 7f854536d700 1 -- 172.21.2.105:0/3254696148 >> 172.21.2.105:0/3254696148 conn(0x7f85400b5370 msgr2=0x7f8540145c80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:30.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.388+0000 7f854536d700 1 -- 172.21.2.105:0/3254696148 shutdown_connections 2021-11-12T05:47:30.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.388+0000 7f854536d700 1 -- 172.21.2.105:0/3254696148 wait complete. 2021-11-12T05:47:30.397 INFO:teuthology.orchestra.run.gibba005.stderr:new fs with metadata pool 15 and data pool 16 2021-11-12T05:47:30.400 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:47:30.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe512639700 1 Processor -- start 2021-11-12T05:47:30.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe512639700 1 -- start start 2021-11-12T05:47:30.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe512639700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fe50c0ad080 0x7fe50c0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:30.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe512639700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe50c14b2f0 0x7fe50c0ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:30.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe512639700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe50c0ac7b0 con 0x7fe50c0ac280 2021-11-12T05:47:30.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe512639700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe50c1488a0 con 0x7fe50c14b2f0 2021-11-12T05:47:30.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe512639700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe50c0ac9e0 con 0x7fe50c0ad080 2021-11-12T05:47:30.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe510bd6700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe50c14b2f0 0x7fe50c0ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:30.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe510bd6700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe50c14b2f0 0x7fe50c0ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48230/0 (socket says 172.21.2.105:48230) 2021-11-12T05:47:30.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe510bd6700 1 -- 172.21.2.105:0/3686346696 learned_addr learned my addr 172.21.2.105:0/3686346696 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:30.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe510bd6700 1 -- 172.21.2.105:0/3686346696 >> v2:172.21.2.115:3300/0 conn(0x7fe50c0ad080 msgr2=0x7fe50c0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:30.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe510bd6700 1 --2- 172.21.2.105:0/3686346696 >> v2:172.21.2.115:3300/0 conn(0x7fe50c0ad080 0x7fe50c0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:30.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe510bd6700 1 -- 172.21.2.105:0/3686346696 >> v1:172.21.2.115:6789/0 conn(0x7fe50c0ac280 legacy=0x7fe50c14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:30.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe510bd6700 1 -- 172.21.2.105:0/3686346696 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe50c0b0b30 con 0x7fe50c14b2f0 2021-11-12T05:47:30.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe510bd6700 1 --2- 172.21.2.105:0/3686346696 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe50c14b2f0 0x7fe50c0ad460 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7fe50c0b06e0 tx=0x7fe4f4006eb0).ready entity=mon.0 client_cookie=5fc7ae6f5dfce393 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:30.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe50affd700 1 -- 172.21.2.105:0/3686346696 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4f400d5c0 con 0x7fe50c14b2f0 2021-11-12T05:47:30.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe50affd700 1 -- 172.21.2.105:0/3686346696 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f4000e90 con 0x7fe50c14b2f0 2021-11-12T05:47:30.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe50affd700 1 -- 172.21.2.105:0/3686346696 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4f400d910 con 0x7fe50c14b2f0 2021-11-12T05:47:30.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe512639700 1 -- 172.21.2.105:0/3686346696 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe50c14b2f0 msgr2=0x7fe50c0ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:30.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe512639700 1 --2- 172.21.2.105:0/3686346696 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe50c14b2f0 0x7fe50c0ad460 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7fe50c0b06e0 tx=0x7fe4f4006eb0).stop 2021-11-12T05:47:30.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe512639700 1 -- 172.21.2.105:0/3686346696 shutdown_connections 2021-11-12T05:47:30.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe512639700 1 --2- 172.21.2.105:0/3686346696 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe50c14b2f0 0x7fe50c0ad460 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:30.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe512639700 1 --2- 172.21.2.105:0/3686346696 >> v2:172.21.2.115:3300/0 conn(0x7fe50c0ad080 0x7fe50c0af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:30.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe512639700 1 -- 172.21.2.105:0/3686346696 >> 172.21.2.105:0/3686346696 conn(0x7fe50c0b5370 msgr2=0x7fe50c0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:30.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe512639700 1 -- 172.21.2.105:0/3686346696 shutdown_connections 2021-11-12T05:47:30.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe512639700 1 -- 172.21.2.105:0/3686346696 wait complete. 2021-11-12T05:47:30.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe512639700 1 Processor -- start 2021-11-12T05:47:30.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe512639700 1 -- start start 2021-11-12T05:47:30.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe512639700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe50c0ac280 0x7fe50c0ab2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:30.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe512639700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe50c0ad080 0x7fe50c15a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:30.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe512639700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe50c14b2f0 0x7fe50c15a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:30.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe512639700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c063f20 con 0x7fe50c0ac280 2021-11-12T05:47:30.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe512639700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c0641c0 con 0x7fe50c0ad080 2021-11-12T05:47:30.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe512639700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c0a9840 con 0x7fe50c14b2f0 2021-11-12T05:47:30.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe50bfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe50c0ac280 0x7fe50c0ab2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:30.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe50bfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe50c0ac280 0x7fe50c0ab2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48236/0 (socket says 172.21.2.105:48236) 2021-11-12T05:47:30.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe50bfff700 1 -- 172.21.2.105:0/1903556011 learned_addr learned my addr 172.21.2.105:0/1903556011 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:30.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe50bfff700 1 -- 172.21.2.105:0/1903556011 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe50c14b2f0 msgr2=0x7fe50c15a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:30.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe50bfff700 1 --2- 172.21.2.105:0/1903556011 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe50c14b2f0 0x7fe50c15a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:30.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe50bfff700 1 -- 172.21.2.105:0/1903556011 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe50c0ad080 msgr2=0x7fe50c15a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:30.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe50bfff700 1 --2- 172.21.2.105:0/1903556011 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe50c0ad080 0x7fe50c15a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:30.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe50bfff700 1 -- 172.21.2.105:0/1903556011 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f400b1e0 con 0x7fe50c0ac280 2021-11-12T05:47:30.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe50bfff700 1 --2- 172.21.2.105:0/1903556011 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe50c0ac280 0x7fe50c0ab2b0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 rx=0x7fe5040032f0 tx=0x7fe5040092b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:30.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.448+0000 7fe5097fa700 1 -- 172.21.2.105:0/1903556011 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe50400d7f0 con 0x7fe50c0ac280 2021-11-12T05:47:30.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.452+0000 7fe5097fa700 1 -- 172.21.2.105:0/1903556011 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50400d950 con 0x7fe50c0ac280 2021-11-12T05:47:30.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.452+0000 7fe512639700 1 -- 172.21.2.105:0/1903556011 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe50c0a9520 con 0x7fe50c0ac280 2021-11-12T05:47:30.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.452+0000 7fe512639700 1 -- 172.21.2.105:0/1903556011 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe50c0ab7a0 con 0x7fe50c0ac280 2021-11-12T05:47:30.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.452+0000 7fe5097fa700 1 -- 172.21.2.105:0/1903556011 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe50400dcb0 con 0x7fe50c0ac280 2021-11-12T05:47:30.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.452+0000 7fe512639700 1 -- 172.21.2.105:0/1903556011 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe50c0a9a00 con 0x7fe50c0ac280 2021-11-12T05:47:30.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.452+0000 7fe5097fa700 1 -- 172.21.2.105:0/1903556011 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe504019460 con 0x7fe50c0ac280 2021-11-12T05:47:30.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.452+0000 7fe5097fa700 1 --2- 172.21.2.105:0/1903556011 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe4f00536a0 0x7fe4f0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:30.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.452+0000 7fe5097fa700 1 -- 172.21.2.105:0/1903556011 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fe50406c1e0 con 0x7fe50c0ac280 2021-11-12T05:47:30.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.452+0000 7fe50b7fe700 1 --2- 172.21.2.105:0/1903556011 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe4f00536a0 0x7fe4f0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:30.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.452+0000 7fe50b7fe700 1 --2- 172.21.2.105:0/1903556011 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe4f00536a0 0x7fe4f0055b60 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7fe4fc002f90 tx=0x7fe4fc0069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:30.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.452+0000 7fe5097fa700 1 -- 172.21.2.105:0/1903556011 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe504043080 con 0x7fe50c0ac280 2021-11-12T05:47:30.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.536+0000 7fe512639700 1 -- 172.21.2.105:0/1903556011 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe50c057350 con 0x7fe50c0ac280 2021-11-12T05:47:30.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.540+0000 7fe5097fa700 1 -- 172.21.2.105:0/1903556011 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+16300 (secure 0 0 0) 0x7fe5040466a0 con 0x7fe50c0ac280 2021-11-12T05:47:30.543 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:30.543 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":83,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:47:30.387380+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:47:29.162904+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-11-12T05:47:29.359218+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:47:30.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.540+0000 7fe512639700 1 -- 172.21.2.105:0/1903556011 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe4f00536a0 msgr2=0x7fe4f0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:30.545 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.540+0000 7fe512639700 1 --2- 172.21.2.105:0/1903556011 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe4f00536a0 0x7fe4f0055b60 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7fe4fc002f90 tx=0x7fe4fc0069b0).stop 2021-11-12T05:47:30.545 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.540+0000 7fe512639700 1 -- 172.21.2.105:0/1903556011 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe50c0ac280 msgr2=0x7fe50c0ab2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:30.545 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.540+0000 7fe512639700 1 --2- 172.21.2.105:0/1903556011 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe50c0ac280 0x7fe50c0ab2b0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 rx=0x7fe5040032f0 tx=0x7fe5040092b0).stop 2021-11-12T05:47:30.545 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.540+0000 7fe512639700 1 -- 172.21.2.105:0/1903556011 shutdown_connections 2021-11-12T05:47:30.546 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.540+0000 7fe512639700 1 --2- 172.21.2.105:0/1903556011 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe4f00536a0 0x7fe4f0055b60 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:30.546 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.540+0000 7fe512639700 1 --2- 172.21.2.105:0/1903556011 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe50c14b2f0 0x7fe50c15a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:30.546 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.540+0000 7fe512639700 1 --2- 172.21.2.105:0/1903556011 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe50c0ad080 0x7fe50c15a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:30.546 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.540+0000 7fe512639700 1 --2- 172.21.2.105:0/1903556011 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe50c0ac280 0x7fe50c0ab2b0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:30.547 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.540+0000 7fe512639700 1 -- 172.21.2.105:0/1903556011 >> 172.21.2.105:0/1903556011 conn(0x7fe50c0b5370 msgr2=0x7fe50c14aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:30.547 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.540+0000 7fe512639700 1 -- 172.21.2.105:0/1903556011 shutdown_connections 2021-11-12T05:47:30.547 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.540+0000 7fe512639700 1 -- 172.21.2.105:0/1903556011 wait complete. 2021-11-12T05:47:30.551 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:47:30.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.596+0000 7fc121a98700 1 Processor -- start 2021-11-12T05:47:30.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.596+0000 7fc121a98700 1 -- start start 2021-11-12T05:47:30.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc121a98700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc11c0ad080 0x7fc11c0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:30.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc121a98700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc11c0ac7b0 con 0x7fc11c14b2f0 2021-11-12T05:47:30.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc121a98700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc11c0ac9e0 con 0x7fc11c0ac280 2021-11-12T05:47:30.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc121a98700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c1488a0 con 0x7fc11c0ad080 2021-11-12T05:47:30.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc11bfff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fc11c14b2f0 0x7fc11c147a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:58640/0 (socket says 172.21.2.105:58640) 2021-11-12T05:47:30.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc11bfff700 1 -- 172.21.2.105:0/4191175313 learned_addr learned my addr 172.21.2.105:0/4191175313 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:30.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc11a7fc700 1 -- 172.21.2.105:0/4191175313 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3704685173 0 0) 0x7fc11c0ac7b0 con 0x7fc11c14b2f0 2021-11-12T05:47:30.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc11a7fc700 1 -- 172.21.2.105:0/4191175313 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0fc003260 con 0x7fc11c14b2f0 2021-11-12T05:47:30.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc11a7fc700 1 -- 172.21.2.105:0/4191175313 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3385202799 0 0) 0x7fc0fc003260 con 0x7fc11c14b2f0 2021-11-12T05:47:30.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc11a7fc700 1 -- 172.21.2.105:0/4191175313 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc11c0ad080 msgr2=0x7fc11c0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:30.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc11a7fc700 1 --2- 172.21.2.105:0/4191175313 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc11c0ad080 0x7fc11c0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:30.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc11a7fc700 1 -- 172.21.2.105:0/4191175313 >> v1:172.21.2.115:6789/0 conn(0x7fc11c0ac280 legacy=0x7fc11c14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:30.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc11a7fc700 1 -- 172.21.2.105:0/4191175313 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11c0b0b30 con 0x7fc11c14b2f0 2021-11-12T05:47:30.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc11a7fc700 1 -- 172.21.2.105:0/4191175313 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fc1140019e0 con 0x7fc11c14b2f0 2021-11-12T05:47:30.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc11a7fc700 1 -- 172.21.2.105:0/4191175313 >> v1:172.21.2.105:6789/0 conn(0x7fc11c14b2f0 legacy=0x7fc11c147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:30.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc11a7fc700 1 --2- 172.21.2.105:0/4191175313 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc0fc003800 0x7fc0fc003c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:30.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc11a7fc700 1 --2- 172.21.2.105:0/4191175313 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc11c0ad080 0x7fc0fc004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:30.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc11a7fc700 1 --2- 172.21.2.105:0/4191175313 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc0fc004bf0 0x7fc0fc00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:30.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc11a7fc700 1 -- 172.21.2.105:0/4191175313 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c1488a0 con 0x7fc0fc004bf0 2021-11-12T05:47:30.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc11a7fc700 1 -- 172.21.2.105:0/4191175313 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0fc0052a0 con 0x7fc0fc003800 2021-11-12T05:47:30.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc11a7fc700 1 -- 172.21.2.105:0/4191175313 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0fc00bc40 con 0x7fc11c0ad080 2021-11-12T05:47:30.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc11bfff700 1 --2- 172.21.2.105:0/4191175313 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc0fc004bf0 0x7fc0fc00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:30.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc11bfff700 1 -- 172.21.2.105:0/4191175313 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc11c0ad080 msgr2=0x7fc0fc004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:30.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc11bfff700 1 --2- 172.21.2.105:0/4191175313 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc11c0ad080 0x7fc0fc004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:30.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc11bfff700 1 -- 172.21.2.105:0/4191175313 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc0fc003800 msgr2=0x7fc0fc003c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:30.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc11bfff700 1 --2- 172.21.2.105:0/4191175313 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc0fc003800 0x7fc0fc003c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:30.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc11bfff700 1 -- 172.21.2.105:0/4191175313 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0fc003260 con 0x7fc0fc004bf0 2021-11-12T05:47:30.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc11bfff700 1 --2- 172.21.2.105:0/4191175313 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc0fc004bf0 0x7fc0fc00b750 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7fc11c0b6060 tx=0x7fc11c0b0fd0).ready entity=mon.0 client_cookie=c5cfcd42041d7679 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:30.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc11a7fc700 1 -- 172.21.2.105:0/4191175313 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc11400cc60 con 0x7fc0fc004bf0 2021-11-12T05:47:30.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc11a7fc700 1 -- 172.21.2.105:0/4191175313 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11400cdc0 con 0x7fc0fc004bf0 2021-11-12T05:47:30.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc11a7fc700 1 -- 172.21.2.105:0/4191175313 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc114005b80 con 0x7fc0fc004bf0 2021-11-12T05:47:30.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc121a98700 1 -- 172.21.2.105:0/4191175313 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc0fc004bf0 msgr2=0x7fc0fc00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:30.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc121a98700 1 --2- 172.21.2.105:0/4191175313 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc0fc004bf0 0x7fc0fc00b750 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7fc11c0b6060 tx=0x7fc11c0b0fd0).stop 2021-11-12T05:47:30.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc11bfff700 1 -- 172.21.2.105:0/4191175313 reap_dead start 2021-11-12T05:47:30.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc121a98700 1 -- 172.21.2.105:0/4191175313 shutdown_connections 2021-11-12T05:47:30.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc121a98700 1 -- 172.21.2.105:0/4191175313 >> 172.21.2.105:0/4191175313 conn(0x7fc11c0b5370 msgr2=0x7fc11c0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:30.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc121a98700 1 -- 172.21.2.105:0/4191175313 shutdown_connections 2021-11-12T05:47:30.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc121a98700 1 -- 172.21.2.105:0/4191175313 wait complete. 2021-11-12T05:47:30.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc121a98700 1 Processor -- start 2021-11-12T05:47:30.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc121a98700 1 -- start start 2021-11-12T05:47:30.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc121a98700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc0fc004bf0 0x7fc11c05fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:30.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc121a98700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc11c0a9450 0x7fc11c15a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:30.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc121a98700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc11c1567b0 0x7fc11c156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:30.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc121a98700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c063e80 con 0x7fc11c1567b0 2021-11-12T05:47:30.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc121a98700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c159f50 con 0x7fc11c0a9450 2021-11-12T05:47:30.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc121a98700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c15a1f0 con 0x7fc0fc004bf0 2021-11-12T05:47:30.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc11bfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc11c1567b0 0x7fc11c156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:30.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc11bfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc11c1567b0 0x7fc11c156c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48256/0 (socket says 172.21.2.105:48256) 2021-11-12T05:47:30.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc11bfff700 1 -- 172.21.2.105:0/1621255129 learned_addr learned my addr 172.21.2.105:0/1621255129 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:30.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc11bfff700 1 -- 172.21.2.105:0/1621255129 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc0fc004bf0 msgr2=0x7fc11c05fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:30.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc11bfff700 1 --2- 172.21.2.105:0/1621255129 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc0fc004bf0 0x7fc11c05fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:30.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc11bfff700 1 -- 172.21.2.105:0/1621255129 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc11c0a9450 msgr2=0x7fc11c15a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:30.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc11bfff700 1 --2- 172.21.2.105:0/1621255129 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc11c0a9450 0x7fc11c15a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:30.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc11bfff700 1 -- 172.21.2.105:0/1621255129 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11c0a9120 con 0x7fc11c1567b0 2021-11-12T05:47:30.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc11bfff700 1 --2- 172.21.2.105:0/1621255129 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc11c1567b0 0x7fc11c156c30 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7fc11c062420 tx=0x7fc114015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:30.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.600+0000 7fc118ff9700 1 -- 172.21.2.105:0/1621255129 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc114017070 con 0x7fc11c1567b0 2021-11-12T05:47:30.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.604+0000 7fc118ff9700 1 -- 172.21.2.105:0/1621255129 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc114001ec0 con 0x7fc11c1567b0 2021-11-12T05:47:30.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.604+0000 7fc118ff9700 1 -- 172.21.2.105:0/1621255129 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1140072e0 con 0x7fc11c1567b0 2021-11-12T05:47:30.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.604+0000 7fc121a98700 1 -- 172.21.2.105:0/1621255129 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc11c15ab80 con 0x7fc11c1567b0 2021-11-12T05:47:30.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.604+0000 7fc121a98700 1 -- 172.21.2.105:0/1621255129 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc11c063100 con 0x7fc11c1567b0 2021-11-12T05:47:30.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.604+0000 7fc121a98700 1 -- 172.21.2.105:0/1621255129 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc11c0a92b0 con 0x7fc11c1567b0 2021-11-12T05:47:30.621 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.604+0000 7fc118ff9700 1 -- 172.21.2.105:0/1621255129 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc114025030 con 0x7fc11c1567b0 2021-11-12T05:47:30.621 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.604+0000 7fc118ff9700 1 --2- 172.21.2.105:0/1621255129 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc100053580 0x7fc100055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:30.621 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.604+0000 7fc118ff9700 1 -- 172.21.2.105:0/1621255129 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fc11406c6d0 con 0x7fc11c1567b0 2021-11-12T05:47:30.622 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.604+0000 7fc11b7fe700 1 --2- 172.21.2.105:0/1621255129 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc100053580 0x7fc100055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:30.622 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.604+0000 7fc11b7fe700 1 --2- 172.21.2.105:0/1621255129 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc100053580 0x7fc100055a40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7fc10c002f70 tx=0x7fc10c006a10).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:30.622 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.604+0000 7fc118ff9700 1 -- 172.21.2.105:0/1621255129 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc11c0a92b0 con 0x7fc11c1567b0 2021-11-12T05:47:30.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.688+0000 7fc121a98700 1 -- 172.21.2.105:0/1621255129 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc11c0a92b0 con 0x7fc11c1567b0 2021-11-12T05:47:30.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.688+0000 7fc118ff9700 1 -- 172.21.2.105:0/1621255129 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+16300 (secure 0 0 0) 0x7fc11c0a92b0 con 0x7fc11c1567b0 2021-11-12T05:47:30.695 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:30.695 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":83,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:47:30.387380+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:47:29.162904+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-11-12T05:47:29.359218+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:47:30.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.692+0000 7fc121a98700 1 -- 172.21.2.105:0/1621255129 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc100053580 msgr2=0x7fc100055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:30.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.692+0000 7fc121a98700 1 --2- 172.21.2.105:0/1621255129 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc100053580 0x7fc100055a40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7fc10c002f70 tx=0x7fc10c006a10).stop 2021-11-12T05:47:30.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.692+0000 7fc121a98700 1 -- 172.21.2.105:0/1621255129 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc11c1567b0 msgr2=0x7fc11c156c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:30.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.692+0000 7fc121a98700 1 --2- 172.21.2.105:0/1621255129 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc11c1567b0 0x7fc11c156c30 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7fc11c062420 tx=0x7fc114015000).stop 2021-11-12T05:47:30.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.692+0000 7fc121a98700 1 -- 172.21.2.105:0/1621255129 shutdown_connections 2021-11-12T05:47:30.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.692+0000 7fc121a98700 1 --2- 172.21.2.105:0/1621255129 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc100053580 0x7fc100055a40 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:30.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.692+0000 7fc121a98700 1 --2- 172.21.2.105:0/1621255129 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc11c1567b0 0x7fc11c156c30 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:30.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.692+0000 7fc121a98700 1 --2- 172.21.2.105:0/1621255129 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc11c0a9450 0x7fc11c15a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:30.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.692+0000 7fc121a98700 1 --2- 172.21.2.105:0/1621255129 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc0fc004bf0 0x7fc11c05fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:30.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.692+0000 7fc121a98700 1 -- 172.21.2.105:0/1621255129 >> 172.21.2.105:0/1621255129 conn(0x7fc11c0b5370 msgr2=0x7fc11c14aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:30.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.692+0000 7fc121a98700 1 -- 172.21.2.105:0/1621255129 shutdown_connections 2021-11-12T05:47:30.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.692+0000 7fc121a98700 1 -- 172.21.2.105:0/1621255129 wait complete. 2021-11-12T05:47:30.703 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-12T05:47:30.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.752+0000 7f1c2bf49700 1 Processor -- start 2021-11-12T05:47:30.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.752+0000 7f1c2bf49700 1 -- start start 2021-11-12T05:47:30.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.752+0000 7f1c2bf49700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f1c240ace20 0x7f1c240b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:30.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.752+0000 7f1c2bf49700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1c24144180 0x7f1c24144610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:30.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.752+0000 7f1c2bf49700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c240b1840 con 0x7f1c240aca40 2021-11-12T05:47:30.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.752+0000 7f1c2bf49700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c240b0a10 con 0x7f1c240ace20 2021-11-12T05:47:30.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.752+0000 7f1c2bf49700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c240af2b0 con 0x7f1c24144180 2021-11-12T05:47:30.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.752+0000 7f1c29ce5700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f1c240aca40 0x7f1c241473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:58656/0 (socket says 172.21.2.105:58656) 2021-11-12T05:47:30.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.752+0000 7f1c29ce5700 1 -- 172.21.2.105:0/2132972729 learned_addr learned my addr 172.21.2.105:0/2132972729 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:30.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.752+0000 7f1c28ce3700 1 -- 172.21.2.105:0/2132972729 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2339255463 0 0) 0x7f1c240b1840 con 0x7f1c240aca40 2021-11-12T05:47:30.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.752+0000 7f1c28ce3700 1 -- 172.21.2.105:0/2132972729 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c0c003260 con 0x7f1c240aca40 2021-11-12T05:47:30.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.752+0000 7f1c294e4700 1 --2- 172.21.2.105:0/2132972729 >> v2:172.21.2.115:3300/0 conn(0x7f1c240ace20 0x7f1c240b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:30.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.752+0000 7f1c2a4e6700 1 --2- 172.21.2.105:0/2132972729 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1c24144180 0x7f1c24144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:30.763 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.752+0000 7f1c28ce3700 1 -- 172.21.2.105:0/2132972729 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 64455001 0 0) 0x7f1c0c003260 con 0x7f1c240aca40 2021-11-12T05:47:30.763 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.752+0000 7f1c28ce3700 1 -- 172.21.2.105:0/2132972729 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1c24144180 msgr2=0x7f1c24144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:30.763 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.752+0000 7f1c28ce3700 1 --2- 172.21.2.105:0/2132972729 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1c24144180 0x7f1c24144610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:30.764 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.752+0000 7f1c28ce3700 1 -- 172.21.2.105:0/2132972729 >> v2:172.21.2.115:3300/0 conn(0x7f1c240ace20 msgr2=0x7f1c240b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:30.764 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.752+0000 7f1c28ce3700 1 --2- 172.21.2.105:0/2132972729 >> v2:172.21.2.115:3300/0 conn(0x7f1c240ace20 0x7f1c240b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:30.764 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.752+0000 7f1c28ce3700 1 -- 172.21.2.105:0/2132972729 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c240b1a70 con 0x7f1c240aca40 2021-11-12T05:47:30.764 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.752+0000 7f1c28ce3700 1 -- 172.21.2.105:0/2132972729 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f1c20001660 con 0x7f1c240aca40 2021-11-12T05:47:30.765 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.752+0000 7f1c28ce3700 1 -- 172.21.2.105:0/2132972729 >> v1:172.21.2.105:6789/0 conn(0x7f1c240aca40 legacy=0x7f1c241473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:30.765 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.752+0000 7f1c28ce3700 1 --2- 172.21.2.105:0/2132972729 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1c0c0037d0 0x7f1c0c003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:30.765 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.752+0000 7f1c28ce3700 1 --2- 172.21.2.105:0/2132972729 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1c0c004500 0x7f1c0c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:30.765 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.752+0000 7f1c28ce3700 1 --2- 172.21.2.105:0/2132972729 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1c0c004e70 0x7f1c0c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:30.766 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.752+0000 7f1c28ce3700 1 -- 172.21.2.105:0/2132972729 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c240b0a10 con 0x7f1c0c004e70 2021-11-12T05:47:30.766 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.752+0000 7f1c28ce3700 1 -- 172.21.2.105:0/2132972729 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c240af2b0 con 0x7f1c0c0037d0 2021-11-12T05:47:30.766 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.752+0000 7f1c28ce3700 1 -- 172.21.2.105:0/2132972729 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c00bd20 con 0x7f1c0c004500 2021-11-12T05:47:30.766 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.752+0000 7f1c2a4e6700 1 --2- 172.21.2.105:0/2132972729 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1c0c004e70 0x7f1c0c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:30.767 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.752+0000 7f1c2a4e6700 1 -- 172.21.2.105:0/2132972729 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1c0c004500 msgr2=0x7f1c0c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:30.767 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c2a4e6700 1 --2- 172.21.2.105:0/2132972729 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1c0c004500 0x7f1c0c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:30.767 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c2a4e6700 1 -- 172.21.2.105:0/2132972729 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1c0c0037d0 msgr2=0x7f1c0c003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:30.767 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c2a4e6700 1 --2- 172.21.2.105:0/2132972729 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1c0c0037d0 0x7f1c0c003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:30.768 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c2a4e6700 1 -- 172.21.2.105:0/2132972729 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c240b1a70 con 0x7f1c0c004e70 2021-11-12T05:47:30.768 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c2a4e6700 1 --2- 172.21.2.105:0/2132972729 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1c0c004e70 0x7f1c0c00b750 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7f1c1c00a000 tx=0x7f1c1c008040).ready entity=mon.0 client_cookie=d7a1df382a07dd82 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:30.768 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c28ce3700 1 -- 172.21.2.105:0/2132972729 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c1c00c070 con 0x7f1c0c004e70 2021-11-12T05:47:30.768 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c28ce3700 1 -- 172.21.2.105:0/2132972729 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1c00e4d0 con 0x7f1c0c004e70 2021-11-12T05:47:30.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c28ce3700 1 -- 172.21.2.105:0/2132972729 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c1c00e830 con 0x7f1c0c004e70 2021-11-12T05:47:30.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c2bf49700 1 -- 172.21.2.105:0/2132972729 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1c0c004e70 msgr2=0x7f1c0c00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:30.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c2bf49700 1 --2- 172.21.2.105:0/2132972729 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1c0c004e70 0x7f1c0c00b750 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7f1c1c00a000 tx=0x7f1c1c008040).stop 2021-11-12T05:47:30.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c2a4e6700 1 -- 172.21.2.105:0/2132972729 reap_dead start 2021-11-12T05:47:30.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c2bf49700 1 -- 172.21.2.105:0/2132972729 shutdown_connections 2021-11-12T05:47:30.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c2bf49700 1 -- 172.21.2.105:0/2132972729 >> 172.21.2.105:0/2132972729 conn(0x7f1c2405c490 msgr2=0x7f1c240b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:30.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c2bf49700 1 -- 172.21.2.105:0/2132972729 shutdown_connections 2021-11-12T05:47:30.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c2bf49700 1 -- 172.21.2.105:0/2132972729 wait complete. 2021-11-12T05:47:30.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c2bf49700 1 Processor -- start 2021-11-12T05:47:30.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c2bf49700 1 -- start start 2021-11-12T05:47:30.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c2bf49700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1c0c004e70 0x7f1c24144c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:30.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c2bf49700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1c240626e0 0x7f1c241569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:30.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c2bf49700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1c24156ed0 0x7f1c24145ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:30.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c2bf49700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c24066b80 con 0x7f1c24156ed0 2021-11-12T05:47:30.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c2bf49700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c24145890 con 0x7f1c240626e0 2021-11-12T05:47:30.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c2bf49700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c240668e0 con 0x7f1c0c004e70 2021-11-12T05:47:30.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c2a4e6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1c24156ed0 0x7f1c24145ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:30.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c2a4e6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1c24156ed0 0x7f1c24145ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48276/0 (socket says 172.21.2.105:48276) 2021-11-12T05:47:30.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c2a4e6700 1 -- 172.21.2.105:0/1279110766 learned_addr learned my addr 172.21.2.105:0/1279110766 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:30.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c2a4e6700 1 -- 172.21.2.105:0/1279110766 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1c0c004e70 msgr2=0x7f1c24144c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:30.776 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c2a4e6700 1 --2- 172.21.2.105:0/1279110766 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1c0c004e70 0x7f1c24144c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:30.776 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c2a4e6700 1 -- 172.21.2.105:0/1279110766 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1c240626e0 msgr2=0x7f1c241569e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:30.776 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c2a4e6700 1 --2- 172.21.2.105:0/1279110766 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1c240626e0 0x7f1c241569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:30.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c2a4e6700 1 -- 172.21.2.105:0/1279110766 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c240671a0 con 0x7f1c24156ed0 2021-11-12T05:47:30.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c2a4e6700 1 --2- 172.21.2.105:0/1279110766 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1c24156ed0 0x7f1c24145ba0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7f1c2405cd40 tx=0x7f1c1c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:30.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c12ffd700 1 -- 172.21.2.105:0/1279110766 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c1c021070 con 0x7f1c24156ed0 2021-11-12T05:47:30.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c12ffd700 1 -- 172.21.2.105:0/1279110766 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1c0032f0 con 0x7f1c24156ed0 2021-11-12T05:47:30.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c12ffd700 1 -- 172.21.2.105:0/1279110766 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c1c01d630 con 0x7f1c24156ed0 2021-11-12T05:47:30.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c2bf49700 1 -- 172.21.2.105:0/1279110766 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c24067390 con 0x7f1c24156ed0 2021-11-12T05:47:30.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c2bf49700 1 -- 172.21.2.105:0/1279110766 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c241574f0 con 0x7f1c24156ed0 2021-11-12T05:47:30.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c2bf49700 1 -- 172.21.2.105:0/1279110766 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c24057350 con 0x7f1c24156ed0 2021-11-12T05:47:30.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c12ffd700 1 -- 172.21.2.105:0/1279110766 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1c1c01d790 con 0x7f1c24156ed0 2021-11-12T05:47:30.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c12ffd700 1 --2- 172.21.2.105:0/1279110766 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1c04053540 0x7f1c04055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:30.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c12ffd700 1 -- 172.21.2.105:0/1279110766 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f1c1c06c390 con 0x7f1c24156ed0 2021-11-12T05:47:30.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.756+0000 7f1c29ce5700 1 --2- 172.21.2.105:0/1279110766 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1c04053540 0x7f1c04055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:30.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.760+0000 7f1c29ce5700 1 --2- 172.21.2.105:0/1279110766 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1c04053540 0x7f1c04055a00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f1c20001370 tx=0x7f1c200015b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:30.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.760+0000 7f1c12ffd700 1 -- 172.21.2.105:0/1279110766 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1c1c043340 con 0x7f1c24156ed0 2021-11-12T05:47:30.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:30.872+0000 7f1c2bf49700 1 -- 172.21.2.105:0/1279110766 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1c2405f280 con 0x7f1c24156ed0 2021-11-12T05:47:31.391 INFO:tasks.ceph.mon.a.gibba005.stderr:2021-11-12T05:47:31.388+0000 7fe9772b2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-12T05:47:31.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.396+0000 7f1c12ffd700 1 -- 172.21.2.105:0/1279110766 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v36) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1c1c046960 con 0x7f1c24156ed0 2021-11-12T05:47:31.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.404+0000 7f1c2bf49700 1 -- 172.21.2.105:0/1279110766 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1c04053540 msgr2=0x7f1c04055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:31.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.404+0000 7f1c2bf49700 1 --2- 172.21.2.105:0/1279110766 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1c04053540 0x7f1c04055a00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f1c20001370 tx=0x7f1c200015b0).stop 2021-11-12T05:47:31.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.404+0000 7f1c2bf49700 1 -- 172.21.2.105:0/1279110766 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1c24156ed0 msgr2=0x7f1c24145ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:31.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.404+0000 7f1c2bf49700 1 --2- 172.21.2.105:0/1279110766 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1c24156ed0 0x7f1c24145ba0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7f1c2405cd40 tx=0x7f1c1c008040).stop 2021-11-12T05:47:31.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.404+0000 7f1c2bf49700 1 -- 172.21.2.105:0/1279110766 shutdown_connections 2021-11-12T05:47:31.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.404+0000 7f1c2bf49700 1 --2- 172.21.2.105:0/1279110766 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1c04053540 0x7f1c04055a00 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:31.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.404+0000 7f1c2bf49700 1 --2- 172.21.2.105:0/1279110766 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1c24156ed0 0x7f1c24145ba0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:31.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.404+0000 7f1c2bf49700 1 --2- 172.21.2.105:0/1279110766 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1c240626e0 0x7f1c241569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:31.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.404+0000 7f1c2bf49700 1 --2- 172.21.2.105:0/1279110766 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1c0c004e70 0x7f1c24144c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:31.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.404+0000 7f1c2bf49700 1 -- 172.21.2.105:0/1279110766 >> 172.21.2.105:0/1279110766 conn(0x7f1c2405c490 msgr2=0x7f1c240b44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:31.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.404+0000 7f1c2bf49700 1 -- 172.21.2.105:0/1279110766 shutdown_connections 2021-11-12T05:47:31.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.404+0000 7f1c2bf49700 1 -- 172.21.2.105:0/1279110766 wait complete. 2021-11-12T05:47:31.419 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:47:31.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.464+0000 7f0c5aab7700 1 Processor -- start 2021-11-12T05:47:31.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.464+0000 7f0c5aab7700 1 -- start start 2021-11-12T05:47:31.475 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.464+0000 7f0c5aab7700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f0c540ac280 0x7f0c5414b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:31.475 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.464+0000 7f0c5aab7700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c540ac7b0 con 0x7f0c540ad080 2021-11-12T05:47:31.475 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.464+0000 7f0c5aab7700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c540ac9e0 con 0x7f0c540af730 2021-11-12T05:47:31.476 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.464+0000 7f0c5aab7700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c541488a0 con 0x7f0c540ac280 2021-11-12T05:47:31.476 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.464+0000 7f0c53fff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f0c540ac280 0x7f0c5414b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:31.476 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.464+0000 7f0c58853700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f0c540ad080 0x7f0c5414abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:58688/0 (socket says 172.21.2.105:58688) 2021-11-12T05:47:31.476 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.464+0000 7f0c58853700 1 -- 172.21.2.105:0/513196392 learned_addr learned my addr 172.21.2.105:0/513196392 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:31.477 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.464+0000 7f0c537fe700 1 -- 172.21.2.105:0/513196392 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2093498654 0 0) 0x7f0c540ac7b0 con 0x7f0c540ad080 2021-11-12T05:47:31.477 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c537fe700 1 -- 172.21.2.105:0/513196392 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c34003260 con 0x7f0c540ad080 2021-11-12T05:47:31.477 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c53fff700 1 -- 172.21.2.105:0/513196392 >> v1:172.21.2.115:6789/0 conn(0x7f0c540af730 legacy=0x7f0c54147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:31.477 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c53fff700 1 -- 172.21.2.105:0/513196392 >> v1:172.21.2.105:6789/0 conn(0x7f0c540ad080 legacy=0x7f0c5414abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:31.477 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c53fff700 1 -- 172.21.2.105:0/513196392 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c540b0b30 con 0x7f0c540ac280 2021-11-12T05:47:31.478 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c53fff700 1 --2- 172.21.2.105:0/513196392 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0c540ac280 0x7f0c5414b2f0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7f0c540ac6a0 tx=0x7f0c44006df0).ready entity=mon.0 client_cookie=bff683632280b75c server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:31.478 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c537fe700 1 -- 172.21.2.105:0/513196392 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c4400d5c0 con 0x7f0c540ac280 2021-11-12T05:47:31.478 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c537fe700 1 -- 172.21.2.105:0/513196392 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c44000e90 con 0x7f0c540ac280 2021-11-12T05:47:31.478 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c537fe700 1 -- 172.21.2.105:0/513196392 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c4400d910 con 0x7f0c540ac280 2021-11-12T05:47:31.479 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c5aab7700 1 -- 172.21.2.105:0/513196392 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0c540ac280 msgr2=0x7f0c5414b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:31.479 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c5aab7700 1 --2- 172.21.2.105:0/513196392 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0c540ac280 0x7f0c5414b2f0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7f0c540ac6a0 tx=0x7f0c44006df0).stop 2021-11-12T05:47:31.479 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c5aab7700 1 -- 172.21.2.105:0/513196392 shutdown_connections 2021-11-12T05:47:31.479 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c5aab7700 1 --2- 172.21.2.105:0/513196392 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0c540ac280 0x7f0c5414b2f0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:31.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c5aab7700 1 -- 172.21.2.105:0/513196392 >> 172.21.2.105:0/513196392 conn(0x7f0c540b5370 msgr2=0x7f0c540b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:31.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c5aab7700 1 -- 172.21.2.105:0/513196392 shutdown_connections 2021-11-12T05:47:31.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c5aab7700 1 -- 172.21.2.105:0/513196392 wait complete. 2021-11-12T05:47:31.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c5aab7700 1 Processor -- start 2021-11-12T05:47:31.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c5aab7700 1 -- start start 2021-11-12T05:47:31.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c5aab7700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0c540ac280 0x7f0c54156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:31.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c5aab7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0c540ad080 0x7f0c540a9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:31.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c5aab7700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0c540af730 0x7f0c54064130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:31.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c5aab7700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c541570f0 con 0x7f0c540ad080 2021-11-12T05:47:31.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c5aab7700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c54066b20 con 0x7f0c540af730 2021-11-12T05:47:31.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c5aab7700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c54066dc0 con 0x7f0c540ac280 2021-11-12T05:47:31.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c53fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0c540ad080 0x7f0c540a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:31.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c53fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0c540ad080 0x7f0c540a9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48298/0 (socket says 172.21.2.105:48298) 2021-11-12T05:47:31.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c53fff700 1 -- 172.21.2.105:0/1273149948 learned_addr learned my addr 172.21.2.105:0/1273149948 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:31.483 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c53fff700 1 -- 172.21.2.105:0/1273149948 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0c540ac280 msgr2=0x7f0c54156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:31.483 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c53fff700 1 --2- 172.21.2.105:0/1273149948 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0c540ac280 0x7f0c54156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:31.483 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c53fff700 1 -- 172.21.2.105:0/1273149948 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0c540af730 msgr2=0x7f0c54064130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:31.483 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c53fff700 1 --2- 172.21.2.105:0/1273149948 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0c540af730 0x7f0c54064130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:31.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c53fff700 1 -- 172.21.2.105:0/1273149948 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c4400b180 con 0x7f0c540ad080 2021-11-12T05:47:31.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c53fff700 1 --2- 172.21.2.105:0/1273149948 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0c540ad080 0x7f0c540a9680 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7f0c540ac6a0 tx=0x7f0c44014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:31.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c51ffb700 1 -- 172.21.2.105:0/1273149948 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c44016070 con 0x7f0c540ad080 2021-11-12T05:47:31.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c51ffb700 1 -- 172.21.2.105:0/1273149948 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c44002f70 con 0x7f0c540ad080 2021-11-12T05:47:31.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c5aab7700 1 -- 172.21.2.105:0/1273149948 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c5415a200 con 0x7f0c540ad080 2021-11-12T05:47:31.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c51ffb700 1 -- 172.21.2.105:0/1273149948 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c4400de70 con 0x7f0c540ad080 2021-11-12T05:47:31.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c5aab7700 1 -- 172.21.2.105:0/1273149948 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c54157d60 con 0x7f0c540ad080 2021-11-12T05:47:31.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c5aab7700 1 -- 172.21.2.105:0/1273149948 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c5415a390 con 0x7f0c540ad080 2021-11-12T05:47:31.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c51ffb700 1 -- 172.21.2.105:0/1273149948 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0c44025030 con 0x7f0c540ad080 2021-11-12T05:47:31.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c51ffb700 1 --2- 172.21.2.105:0/1273149948 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0c380535d0 0x7f0c38055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:31.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.468+0000 7f0c51ffb700 1 -- 172.21.2.105:0/1273149948 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f0c4406cb80 con 0x7f0c540ad080 2021-11-12T05:47:31.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.472+0000 7f0c58853700 1 --2- 172.21.2.105:0/1273149948 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0c380535d0 0x7f0c38055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:31.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.472+0000 7f0c58853700 1 --2- 172.21.2.105:0/1273149948 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0c380535d0 0x7f0c38055a90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f0c3c001110 tx=0x7f0c3c0076c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:31.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.472+0000 7f0c51ffb700 1 -- 172.21.2.105:0/1273149948 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0c44043b30 con 0x7f0c540ad080 2021-11-12T05:47:31.588 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.584+0000 7f0c5aab7700 1 -- 172.21.2.105:0/1273149948 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c54057350 con 0x7f0c540ad080 2021-11-12T05:47:31.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.584+0000 7f0c51ffb700 1 -- 172.21.2.105:0/1273149948 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f0c44023020 con 0x7f0c540ad080 2021-11-12T05:47:31.589 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:31.589 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":37,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4960,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/157622236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":157622236},{"type":"v1","addr":"172.21.2.115:6833","nonce":157622236}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:47:30.387487+0000","modified":"2021-11-12T05:47:31.402774+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6693},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6693":{"gid":6693,"name":"a","rank":0,"incarnation":37,"state":"up:creating","state_seq":2,"addr":"172.21.2.105:6835/1429326547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":1429326547},{"type":"v1","addr":"172.21.2.105:6835","nonce":1429326547}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-11-12T05:47:31.590 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.584+0000 7f0c5aab7700 1 -- 172.21.2.105:0/1273149948 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0c380535d0 msgr2=0x7f0c38055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:31.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.584+0000 7f0c5aab7700 1 --2- 172.21.2.105:0/1273149948 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0c380535d0 0x7f0c38055a90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f0c3c001110 tx=0x7f0c3c0076c0).stop 2021-11-12T05:47:31.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.584+0000 7f0c5aab7700 1 -- 172.21.2.105:0/1273149948 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0c540ad080 msgr2=0x7f0c540a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:31.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.584+0000 7f0c5aab7700 1 --2- 172.21.2.105:0/1273149948 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0c540ad080 0x7f0c540a9680 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7f0c540ac6a0 tx=0x7f0c44014000).stop 2021-11-12T05:47:31.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.584+0000 7f0c5aab7700 1 -- 172.21.2.105:0/1273149948 shutdown_connections 2021-11-12T05:47:31.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.584+0000 7f0c5aab7700 1 --2- 172.21.2.105:0/1273149948 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0c380535d0 0x7f0c38055a90 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:31.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.584+0000 7f0c5aab7700 1 --2- 172.21.2.105:0/1273149948 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0c540af730 0x7f0c54064130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:31.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.584+0000 7f0c5aab7700 1 --2- 172.21.2.105:0/1273149948 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0c540ad080 0x7f0c540a9680 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:31.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.584+0000 7f0c5aab7700 1 --2- 172.21.2.105:0/1273149948 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0c540ac280 0x7f0c54156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:31.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.584+0000 7f0c5aab7700 1 -- 172.21.2.105:0/1273149948 >> 172.21.2.105:0/1273149948 conn(0x7f0c540b5370 msgr2=0x7f0c540b47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:31.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.584+0000 7f0c5aab7700 1 -- 172.21.2.105:0/1273149948 shutdown_connections 2021-11-12T05:47:31.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.584+0000 7f0c5aab7700 1 -- 172.21.2.105:0/1273149948 wait complete. 2021-11-12T05:47:31.593 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 37 2021-11-12T05:47:31.596 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:47:31.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.652+0000 7fea39009700 1 Processor -- start 2021-11-12T05:47:31.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.652+0000 7fea39009700 1 -- start start 2021-11-12T05:47:31.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.652+0000 7fea39009700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fea340adaf0 0x7fea3413fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:31.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.652+0000 7fea39009700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fea34143fb0 0x7fea340afe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:31.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.652+0000 7fea39009700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea34067860 con 0x7fea34143b40 2021-11-12T05:47:31.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.652+0000 7fea39009700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea34143400 con 0x7fea340adaf0 2021-11-12T05:47:31.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.652+0000 7fea39009700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea341436a0 con 0x7fea34143fb0 2021-11-12T05:47:31.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.656+0000 7fea32d9d700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fea340adaf0 0x7fea3413fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:31.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.656+0000 7fea3259c700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7fea34143b40 0x7fea340aded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:57170/0 (socket says 172.21.2.105:57170) 2021-11-12T05:47:31.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.656+0000 7fea3359e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fea34143fb0 0x7fea340afe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:31.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.656+0000 7fea3259c700 1 -- 172.21.2.105:0/949650283 learned_addr learned my addr 172.21.2.105:0/949650283 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:31.663 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.656+0000 7fea3359e700 1 -- 172.21.2.105:0/949650283 >> v2:172.21.2.115:3300/0 conn(0x7fea340adaf0 msgr2=0x7fea3413fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:31.663 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.656+0000 7fea3359e700 1 --2- 172.21.2.105:0/949650283 >> v2:172.21.2.115:3300/0 conn(0x7fea340adaf0 0x7fea3413fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:31.663 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.656+0000 7fea3359e700 1 -- 172.21.2.105:0/949650283 >> v1:172.21.2.115:6789/0 conn(0x7fea34143b40 legacy=0x7fea340aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:31.664 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.656+0000 7fea3359e700 1 -- 172.21.2.105:0/949650283 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea340b2b40 con 0x7fea34143fb0 2021-11-12T05:47:31.664 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.656+0000 7fea32d9d700 1 --2- 172.21.2.105:0/949650283 >> v2:172.21.2.115:3300/0 conn(0x7fea340adaf0 0x7fea3413fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-12T05:47:31.664 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.656+0000 7fea3359e700 1 --2- 172.21.2.105:0/949650283 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fea34143fb0 0x7fea340afe10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fea2c0032f0 tx=0x7fea2c00d670).ready entity=mon.2 client_cookie=3cbe37a765778e86 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:31.664 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.656+0000 7fea31d9b700 1 -- 172.21.2.105:0/949650283 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea2c012070 con 0x7fea34143fb0 2021-11-12T05:47:31.665 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.656+0000 7fea31d9b700 1 -- 172.21.2.105:0/949650283 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2c00fb80 con 0x7fea34143fb0 2021-11-12T05:47:31.665 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.656+0000 7fea31d9b700 1 -- 172.21.2.105:0/949650283 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea2c00de80 con 0x7fea34143fb0 2021-11-12T05:47:31.665 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.656+0000 7fea39009700 1 -- 172.21.2.105:0/949650283 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fea34143fb0 msgr2=0x7fea340afe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:31.665 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.656+0000 7fea39009700 1 --2- 172.21.2.105:0/949650283 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fea34143fb0 0x7fea340afe10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fea2c0032f0 tx=0x7fea2c00d670).stop 2021-11-12T05:47:31.665 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.656+0000 7fea39009700 1 -- 172.21.2.105:0/949650283 shutdown_connections 2021-11-12T05:47:31.666 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.656+0000 7fea39009700 1 --2- 172.21.2.105:0/949650283 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fea34143fb0 0x7fea340afe10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:31.666 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.656+0000 7fea39009700 1 --2- 172.21.2.105:0/949650283 >> v2:172.21.2.115:3300/0 conn(0x7fea340adaf0 0x7fea3413fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:31.666 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.656+0000 7fea39009700 1 -- 172.21.2.105:0/949650283 >> 172.21.2.105:0/949650283 conn(0x7fea3405c490 msgr2=0x7fea3405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:31.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.656+0000 7fea39009700 1 -- 172.21.2.105:0/949650283 shutdown_connections 2021-11-12T05:47:31.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.656+0000 7fea39009700 1 -- 172.21.2.105:0/949650283 wait complete. 2021-11-12T05:47:31.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.660+0000 7fea39009700 1 Processor -- start 2021-11-12T05:47:31.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.660+0000 7fea39009700 1 -- start start 2021-11-12T05:47:31.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.660+0000 7fea39009700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fea340adaf0 0x7fea340b4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:31.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.660+0000 7fea39009700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fea34143b40 0x7fea34066cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:31.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.660+0000 7fea39009700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fea34143fb0 0x7fea341519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:31.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.660+0000 7fea39009700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3413e4a0 con 0x7fea340adaf0 2021-11-12T05:47:31.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.660+0000 7fea39009700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3413e740 con 0x7fea34143b40 2021-11-12T05:47:31.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.660+0000 7fea39009700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea3413e9e0 con 0x7fea34143fb0 2021-11-12T05:47:31.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.660+0000 7fea32d9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fea340adaf0 0x7fea340b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:31.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.660+0000 7fea32d9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fea340adaf0 0x7fea340b4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48312/0 (socket says 172.21.2.105:48312) 2021-11-12T05:47:31.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.660+0000 7fea32d9d700 1 -- 172.21.2.105:0/1556366562 learned_addr learned my addr 172.21.2.105:0/1556366562 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:31.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.660+0000 7fea32d9d700 1 -- 172.21.2.105:0/1556366562 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fea34143fb0 msgr2=0x7fea341519f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:31.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.660+0000 7fea32d9d700 1 --2- 172.21.2.105:0/1556366562 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fea34143fb0 0x7fea341519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:31.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.660+0000 7fea32d9d700 1 -- 172.21.2.105:0/1556366562 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fea34143b40 msgr2=0x7fea34066cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:31.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.660+0000 7fea32d9d700 1 --2- 172.21.2.105:0/1556366562 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fea34143b40 0x7fea34066cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:31.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.660+0000 7fea32d9d700 1 -- 172.21.2.105:0/1556366562 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1c00b180 con 0x7fea340adaf0 2021-11-12T05:47:31.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.660+0000 7fea32d9d700 1 --2- 172.21.2.105:0/1556366562 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fea340adaf0 0x7fea340b4420 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7fea1c00c000 tx=0x7fea1c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:31.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.660+0000 7fea2bfff700 1 -- 172.21.2.105:0/1556366562 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea1c00ca40 con 0x7fea340adaf0 2021-11-12T05:47:31.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.660+0000 7fea2bfff700 1 -- 172.21.2.105:0/1556366562 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1c00cba0 con 0x7fea340adaf0 2021-11-12T05:47:31.673 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.660+0000 7fea2bfff700 1 -- 172.21.2.105:0/1556366562 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea1c0123f0 con 0x7fea340adaf0 2021-11-12T05:47:31.673 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.660+0000 7fea39009700 1 -- 172.21.2.105:0/1556366562 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea2c00d910 con 0x7fea340adaf0 2021-11-12T05:47:31.673 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.660+0000 7fea39009700 1 -- 172.21.2.105:0/1556366562 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea340671e0 con 0x7fea340adaf0 2021-11-12T05:47:31.673 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.660+0000 7fea39009700 1 -- 172.21.2.105:0/1556366562 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea340afb00 con 0x7fea340adaf0 2021-11-12T05:47:31.673 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.660+0000 7fea2bfff700 1 -- 172.21.2.105:0/1556366562 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fea1c012550 con 0x7fea340adaf0 2021-11-12T05:47:31.674 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.660+0000 7fea2bfff700 1 --2- 172.21.2.105:0/1556366562 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fea180535d0 0x7fea18055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:31.674 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.660+0000 7fea2bfff700 1 -- 172.21.2.105:0/1556366562 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6502+0+0 (secure 0 0 0) 0x7fea1c06c2d0 con 0x7fea340adaf0 2021-11-12T05:47:31.674 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.660+0000 7fea3259c700 1 --2- 172.21.2.105:0/1556366562 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fea180535d0 0x7fea18055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:31.674 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.660+0000 7fea3259c700 1 --2- 172.21.2.105:0/1556366562 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fea180535d0 0x7fea18055a90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7fea340625f0 tx=0x7fea24007820).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:31.675 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.664+0000 7fea2bfff700 1 -- 172.21.2.105:0/1556366562 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fea1c043110 con 0x7fea340adaf0 2021-11-12T05:47:31.750 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.744+0000 7fea39009700 1 -- 172.21.2.105:0/1556366562 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea34057350 con 0x7fea340adaf0 2021-11-12T05:47:31.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.748+0000 7fea2bfff700 1 -- 172.21.2.105:0/1556366562 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+16416 (secure 0 0 0) 0x7fea1c046730 con 0x7fea340adaf0 2021-11-12T05:47:31.751 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:31.751 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":85,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:47:31.339929+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:47:29.162904+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-11-12T05:47:29.359218+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.2.105:6835/1338677059":"2021-11-13T05:47:31.284551+0000","172.21.2.105:6834/1338677059":"2021-11-13T05:47:31.284551+0000"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:47:31.752 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.748+0000 7fea39009700 1 -- 172.21.2.105:0/1556366562 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fea180535d0 msgr2=0x7fea18055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:31.753 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.748+0000 7fea39009700 1 --2- 172.21.2.105:0/1556366562 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fea180535d0 0x7fea18055a90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7fea340625f0 tx=0x7fea24007820).stop 2021-11-12T05:47:31.753 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.748+0000 7fea39009700 1 -- 172.21.2.105:0/1556366562 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fea340adaf0 msgr2=0x7fea340b4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:31.753 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.748+0000 7fea39009700 1 --2- 172.21.2.105:0/1556366562 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fea340adaf0 0x7fea340b4420 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7fea1c00c000 tx=0x7fea1c006df0).stop 2021-11-12T05:47:31.753 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.748+0000 7fea39009700 1 -- 172.21.2.105:0/1556366562 shutdown_connections 2021-11-12T05:47:31.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.748+0000 7fea39009700 1 --2- 172.21.2.105:0/1556366562 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fea180535d0 0x7fea18055a90 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:31.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.748+0000 7fea39009700 1 --2- 172.21.2.105:0/1556366562 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fea34143fb0 0x7fea341519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:31.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.748+0000 7fea39009700 1 --2- 172.21.2.105:0/1556366562 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fea34143b40 0x7fea34066cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:31.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.748+0000 7fea39009700 1 --2- 172.21.2.105:0/1556366562 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fea340adaf0 0x7fea340b4420 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:31.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.748+0000 7fea39009700 1 -- 172.21.2.105:0/1556366562 >> 172.21.2.105:0/1556366562 conn(0x7fea3405c490 msgr2=0x7fea340b1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:31.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.748+0000 7fea39009700 1 -- 172.21.2.105:0/1556366562 shutdown_connections 2021-11-12T05:47:31.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.748+0000 7fea39009700 1 -- 172.21.2.105:0/1556366562 wait complete. 2021-11-12T05:47:31.759 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-12T05:47:31.813 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.808+0000 7f896b1cc700 1 Processor -- start 2021-11-12T05:47:31.813 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.808+0000 7f896b1cc700 1 -- start start 2021-11-12T05:47:31.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.808+0000 7f896b1cc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f89640ad080 0x7f89640af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:31.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.808+0000 7f896b1cc700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f89640ac280 0x7f89640ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:31.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.808+0000 7f896b1cc700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89640ac7b0 con 0x7f896414abe0 2021-11-12T05:47:31.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.808+0000 7f896b1cc700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89641488a0 con 0x7f89640ad080 2021-11-12T05:47:31.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.808+0000 7f896b1cc700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89640ac9e0 con 0x7f89640ac280 2021-11-12T05:47:31.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.808+0000 7f8968f68700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f89640ad080 0x7f89640af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:31.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.808+0000 7f8968f68700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f89640ad080 0x7f89640af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48322/0 (socket says 172.21.2.105:48322) 2021-11-12T05:47:31.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.808+0000 7f8968f68700 1 -- 172.21.2.105:0/4283819411 learned_addr learned my addr 172.21.2.105:0/4283819411 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:31.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.808+0000 7f8968f68700 1 -- 172.21.2.105:0/4283819411 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f89640ac280 msgr2=0x7f89640ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:31.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.808+0000 7f8968f68700 1 --2- 172.21.2.105:0/4283819411 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f89640ac280 0x7f89640ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:31.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.808+0000 7f8968f68700 1 -- 172.21.2.105:0/4283819411 >> v1:172.21.2.115:6789/0 conn(0x7f896414abe0 legacy=0x7f896414b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:31.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.808+0000 7f8968f68700 1 -- 172.21.2.105:0/4283819411 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89640b0b30 con 0x7f89640ad080 2021-11-12T05:47:31.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.808+0000 7f8968f68700 1 --2- 172.21.2.105:0/4283819411 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89640ad080 0x7f89640af730 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7f89640b6060 tx=0x7f8954006eb0).ready entity=mon.0 client_cookie=6037bb23d4e0edb3 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:31.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.808+0000 7f89637fe700 1 -- 172.21.2.105:0/4283819411 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f895400d570 con 0x7f89640ad080 2021-11-12T05:47:31.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.808+0000 7f89637fe700 1 -- 172.21.2.105:0/4283819411 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8954000e90 con 0x7f89640ad080 2021-11-12T05:47:31.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.808+0000 7f89637fe700 1 -- 172.21.2.105:0/4283819411 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f895400d8c0 con 0x7f89640ad080 2021-11-12T05:47:31.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.812+0000 7f896b1cc700 1 -- 172.21.2.105:0/4283819411 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89640ad080 msgr2=0x7f89640af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:31.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.812+0000 7f896b1cc700 1 --2- 172.21.2.105:0/4283819411 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89640ad080 0x7f89640af730 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7f89640b6060 tx=0x7f8954006eb0).stop 2021-11-12T05:47:31.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.812+0000 7f896b1cc700 1 -- 172.21.2.105:0/4283819411 shutdown_connections 2021-11-12T05:47:31.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.812+0000 7f896b1cc700 1 --2- 172.21.2.105:0/4283819411 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f89640ac280 0x7f89640ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:31.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.812+0000 7f896b1cc700 1 --2- 172.21.2.105:0/4283819411 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89640ad080 0x7f89640af730 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:31.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.812+0000 7f896b1cc700 1 -- 172.21.2.105:0/4283819411 >> 172.21.2.105:0/4283819411 conn(0x7f89640b5370 msgr2=0x7f89640b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:31.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.812+0000 7f896b1cc700 1 -- 172.21.2.105:0/4283819411 shutdown_connections 2021-11-12T05:47:31.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.812+0000 7f896b1cc700 1 -- 172.21.2.105:0/4283819411 wait complete. 2021-11-12T05:47:31.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.812+0000 7f896b1cc700 1 Processor -- start 2021-11-12T05:47:31.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.812+0000 7f896b1cc700 1 -- start start 2021-11-12T05:47:31.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.812+0000 7f896b1cc700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f89640ac280 0x7f89640ab9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:31.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.812+0000 7f896b1cc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89640ad080 0x7f89640a97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:31.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.812+0000 7f896b1cc700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f896414abe0 0x7f89640a9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:31.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.812+0000 7f896b1cc700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8964063850 con 0x7f89640ad080 2021-11-12T05:47:31.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.812+0000 7f896b1cc700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8964063af0 con 0x7f896414abe0 2021-11-12T05:47:31.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.812+0000 7f896b1cc700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8964063d90 con 0x7f89640ac280 2021-11-12T05:47:31.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.812+0000 7f8963fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89640ad080 0x7f89640a97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:31.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.812+0000 7f8963fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89640ad080 0x7f89640a97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48326/0 (socket says 172.21.2.105:48326) 2021-11-12T05:47:31.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.812+0000 7f8963fff700 1 -- 172.21.2.105:0/3377549834 learned_addr learned my addr 172.21.2.105:0/3377549834 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:31.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.812+0000 7f8963fff700 1 -- 172.21.2.105:0/3377549834 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f89640ac280 msgr2=0x7f89640ab9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:31.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.812+0000 7f8963fff700 1 --2- 172.21.2.105:0/3377549834 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f89640ac280 0x7f89640ab9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:31.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.812+0000 7f8963fff700 1 -- 172.21.2.105:0/3377549834 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f896414abe0 msgr2=0x7f89640a9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:31.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.812+0000 7f8963fff700 1 --2- 172.21.2.105:0/3377549834 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f896414abe0 0x7f89640a9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:31.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.812+0000 7f8963fff700 1 -- 172.21.2.105:0/3377549834 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895400b1e0 con 0x7f89640ad080 2021-11-12T05:47:31.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.812+0000 7f8963fff700 1 --2- 172.21.2.105:0/3377549834 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89640ad080 0x7f89640a97b0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7f894c002f70 tx=0x7f894c006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:31.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.812+0000 7f8961ffb700 1 -- 172.21.2.105:0/3377549834 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f894c013460 con 0x7f89640ad080 2021-11-12T05:47:31.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.812+0000 7f8961ffb700 1 -- 172.21.2.105:0/3377549834 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894c0135c0 con 0x7f89640ad080 2021-11-12T05:47:31.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.812+0000 7f8961ffb700 1 -- 172.21.2.105:0/3377549834 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f894c013920 con 0x7f89640ad080 2021-11-12T05:47:31.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.812+0000 7f896b1cc700 1 -- 172.21.2.105:0/3377549834 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8964063580 con 0x7f89640ad080 2021-11-12T05:47:31.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.812+0000 7f896b1cc700 1 -- 172.21.2.105:0/3377549834 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8964142a10 con 0x7f89640ad080 2021-11-12T05:47:31.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.812+0000 7f896b1cc700 1 -- 172.21.2.105:0/3377549834 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89640b1440 con 0x7f89640ad080 2021-11-12T05:47:31.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.812+0000 7f8961ffb700 1 -- 172.21.2.105:0/3377549834 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f894c00f070 con 0x7f89640ad080 2021-11-12T05:47:31.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.812+0000 7f8961ffb700 1 --2- 172.21.2.105:0/3377549834 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8948053610 0x7f8948055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:31.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.812+0000 7f8961ffb700 1 -- 172.21.2.105:0/3377549834 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f894c06b4c0 con 0x7f89640ad080 2021-11-12T05:47:31.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.812+0000 7f8968f68700 1 --2- 172.21.2.105:0/3377549834 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8948053610 0x7f8948055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:31.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.812+0000 7f8968f68700 1 --2- 172.21.2.105:0/3377549834 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8948053610 0x7f8948055ad0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f89640b6060 tx=0x7f8954015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:31.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.816+0000 7f8961ffb700 1 -- 172.21.2.105:0/3377549834 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f894c042470 con 0x7f89640ad080 2021-11-12T05:47:31.930 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.924+0000 7f896b1cc700 1 -- 172.21.2.105:0/3377549834 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f8964057350 con 0x7f89640ad080 2021-11-12T05:47:31.935 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.932+0000 7f8961ffb700 1 -- 172.21.2.105:0/3377549834 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v28) v1 ==== 184+0+0 (secure 0 0 0) 0x7f894c045a90 con 0x7f89640ad080 2021-11-12T05:47:31.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.932+0000 7f896b1cc700 1 -- 172.21.2.105:0/3377549834 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8948053610 msgr2=0x7f8948055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:31.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.932+0000 7f896b1cc700 1 --2- 172.21.2.105:0/3377549834 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8948053610 0x7f8948055ad0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f89640b6060 tx=0x7f8954015000).stop 2021-11-12T05:47:31.938 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.932+0000 7f896b1cc700 1 -- 172.21.2.105:0/3377549834 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89640ad080 msgr2=0x7f89640a97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:31.938 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.932+0000 7f896b1cc700 1 --2- 172.21.2.105:0/3377549834 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89640ad080 0x7f89640a97b0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7f894c002f70 tx=0x7f894c006ec0).stop 2021-11-12T05:47:31.938 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.932+0000 7f896b1cc700 1 -- 172.21.2.105:0/3377549834 shutdown_connections 2021-11-12T05:47:31.938 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.932+0000 7f896b1cc700 1 --2- 172.21.2.105:0/3377549834 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8948053610 0x7f8948055ad0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:31.939 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.932+0000 7f896b1cc700 1 --2- 172.21.2.105:0/3377549834 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f896414abe0 0x7f89640a9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:31.939 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.932+0000 7f896b1cc700 1 --2- 172.21.2.105:0/3377549834 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89640ad080 0x7f89640a97b0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:31.939 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.932+0000 7f896b1cc700 1 --2- 172.21.2.105:0/3377549834 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f89640ac280 0x7f89640ab9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:31.939 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.932+0000 7f896b1cc700 1 -- 172.21.2.105:0/3377549834 >> 172.21.2.105:0/3377549834 conn(0x7f89640b5370 msgr2=0x7f8964143cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:31.939 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.932+0000 7f896b1cc700 1 -- 172.21.2.105:0/3377549834 shutdown_connections 2021-11-12T05:47:31.940 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.932+0000 7f896b1cc700 1 -- 172.21.2.105:0/3377549834 wait complete. 2021-11-12T05:47:31.940 INFO:teuthology.orchestra.run.gibba005.stderr:updated caps for client.0 2021-11-12T05:47:31.943 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-12T05:47:31.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.992+0000 7fe54d6da700 1 Processor -- start 2021-11-12T05:47:31.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.992+0000 7fe54d6da700 1 -- start start 2021-11-12T05:47:32.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.992+0000 7fe54d6da700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe5480ad080 0x7fe5480af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:32.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.992+0000 7fe54d6da700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5480ac7b0 con 0x7fe54814b2f0 2021-11-12T05:47:32.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.992+0000 7fe54d6da700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5480ac9e0 con 0x7fe5480ac280 2021-11-12T05:47:32.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.992+0000 7fe54d6da700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5481488a0 con 0x7fe5480ad080 2021-11-12T05:47:32.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.992+0000 7fe5477fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fe54814b2f0 0x7fe548147a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:58734/0 (socket says 172.21.2.105:58734) 2021-11-12T05:47:32.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.992+0000 7fe5477fe700 1 -- 172.21.2.105:0/3384117187 learned_addr learned my addr 172.21.2.105:0/3384117187 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:32.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.992+0000 7fe546ffd700 1 --2- 172.21.2.105:0/3384117187 >> v2:172.21.2.105:3300/0 conn(0x7fe5480ad080 0x7fe5480af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:32.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.992+0000 7fe545ffb700 1 -- 172.21.2.105:0/3384117187 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3266318071 0 0) 0x7fe5480ac7b0 con 0x7fe54814b2f0 2021-11-12T05:47:32.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.992+0000 7fe545ffb700 1 -- 172.21.2.105:0/3384117187 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe528003260 con 0x7fe54814b2f0 2021-11-12T05:47:32.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.992+0000 7fe546ffd700 1 -- 172.21.2.105:0/3384117187 >> v1:172.21.2.115:6789/0 conn(0x7fe5480ac280 legacy=0x7fe54814abe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:47:32.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.992+0000 7fe546ffd700 1 -- 172.21.2.105:0/3384117187 >> v1:172.21.2.105:6789/0 conn(0x7fe54814b2f0 legacy=0x7fe548147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:32.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.992+0000 7fe546ffd700 1 -- 172.21.2.105:0/3384117187 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5480b0b30 con 0x7fe5480ad080 2021-11-12T05:47:32.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.996+0000 7fe546ffd700 1 --2- 172.21.2.105:0/3384117187 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe5480ad080 0x7fe5480af730 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7fe5480b0eb0 tx=0x7fe530006df0).ready entity=mon.0 client_cookie=2240c2d08a69a834 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:32.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.996+0000 7fe545ffb700 1 -- 172.21.2.105:0/3384117187 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe53000d5c0 con 0x7fe5480ad080 2021-11-12T05:47:32.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.996+0000 7fe545ffb700 1 -- 172.21.2.105:0/3384117187 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe530000e90 con 0x7fe5480ad080 2021-11-12T05:47:32.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.996+0000 7fe545ffb700 1 -- 172.21.2.105:0/3384117187 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe53000d910 con 0x7fe5480ad080 2021-11-12T05:47:32.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.996+0000 7fe54d6da700 1 -- 172.21.2.105:0/3384117187 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe5480ad080 msgr2=0x7fe5480af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:32.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.996+0000 7fe54d6da700 1 --2- 172.21.2.105:0/3384117187 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe5480ad080 0x7fe5480af730 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7fe5480b0eb0 tx=0x7fe530006df0).stop 2021-11-12T05:47:32.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.996+0000 7fe54d6da700 1 -- 172.21.2.105:0/3384117187 shutdown_connections 2021-11-12T05:47:32.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.996+0000 7fe54d6da700 1 --2- 172.21.2.105:0/3384117187 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe5480ad080 0x7fe5480af730 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:32.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.996+0000 7fe54d6da700 1 -- 172.21.2.105:0/3384117187 >> 172.21.2.105:0/3384117187 conn(0x7fe5480b5370 msgr2=0x7fe5480b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:32.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.996+0000 7fe54d6da700 1 -- 172.21.2.105:0/3384117187 shutdown_connections 2021-11-12T05:47:32.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.996+0000 7fe54d6da700 1 -- 172.21.2.105:0/3384117187 wait complete. 2021-11-12T05:47:32.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.996+0000 7fe54d6da700 1 Processor -- start 2021-11-12T05:47:32.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.996+0000 7fe54d6da700 1 -- start start 2021-11-12T05:47:32.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.996+0000 7fe54d6da700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe5480ac280 0x7fe548157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:32.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.996+0000 7fe54d6da700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe5480ad080 0x7fe5480abb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:32.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.996+0000 7fe54d6da700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe54814b2f0 0x7fe5481570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:32.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.996+0000 7fe54d6da700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5480ab600 con 0x7fe5480ac280 2021-11-12T05:47:32.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.996+0000 7fe54d6da700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5480a7250 con 0x7fe54814b2f0 2021-11-12T05:47:32.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.996+0000 7fe54d6da700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5480ab0c0 con 0x7fe5480ad080 2021-11-12T05:47:32.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.996+0000 7fe546ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe5480ac280 0x7fe548157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:32.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.996+0000 7fe546ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe5480ac280 0x7fe548157940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48340/0 (socket says 172.21.2.105:48340) 2021-11-12T05:47:32.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.996+0000 7fe546ffd700 1 -- 172.21.2.105:0/2924058073 learned_addr learned my addr 172.21.2.105:0/2924058073 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:32.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.996+0000 7fe546ffd700 1 -- 172.21.2.105:0/2924058073 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe5480ad080 msgr2=0x7fe5480abb00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:47:32.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.996+0000 7fe546ffd700 1 --2- 172.21.2.105:0/2924058073 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe5480ad080 0x7fe5480abb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:32.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.996+0000 7fe546ffd700 1 -- 172.21.2.105:0/2924058073 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe54814b2f0 msgr2=0x7fe5481570f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:32.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.996+0000 7fe546ffd700 1 --2- 172.21.2.105:0/2924058073 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe54814b2f0 0x7fe5481570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:32.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.996+0000 7fe546ffd700 1 -- 172.21.2.105:0/2924058073 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe53000b180 con 0x7fe5480ac280 2021-11-12T05:47:32.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.996+0000 7fe546ffd700 1 --2- 172.21.2.105:0/2924058073 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe5480ac280 0x7fe548157940 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7fe5480b0eb0 tx=0x7fe530014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:32.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.996+0000 7fe53ffff700 1 -- 172.21.2.105:0/2924058073 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe530002f70 con 0x7fe5480ac280 2021-11-12T05:47:32.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.996+0000 7fe53ffff700 1 -- 172.21.2.105:0/2924058073 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53001e400 con 0x7fe5480ac280 2021-11-12T05:47:32.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.996+0000 7fe53ffff700 1 -- 172.21.2.105:0/2924058073 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe53001e760 con 0x7fe5480ac280 2021-11-12T05:47:32.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.996+0000 7fe54d6da700 1 -- 172.21.2.105:0/2924058073 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5480ab360 con 0x7fe5480ac280 2021-11-12T05:47:32.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.996+0000 7fe54d6da700 1 -- 172.21.2.105:0/2924058073 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe54814b070 con 0x7fe5480ac280 2021-11-12T05:47:32.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.996+0000 7fe54d6da700 1 -- 172.21.2.105:0/2924058073 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5480b1440 con 0x7fe5480ac280 2021-11-12T05:47:32.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.996+0000 7fe53ffff700 1 -- 172.21.2.105:0/2924058073 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe53001c070 con 0x7fe5480ac280 2021-11-12T05:47:32.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.996+0000 7fe53ffff700 1 --2- 172.21.2.105:0/2924058073 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe52c0536a0 0x7fe52c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:32.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:31.996+0000 7fe53ffff700 1 -- 172.21.2.105:0/2924058073 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6502+0+0 (secure 0 0 0) 0x7fe53006c6f0 con 0x7fe5480ac280 2021-11-12T05:47:32.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.000+0000 7fe5467fc700 1 --2- 172.21.2.105:0/2924058073 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe52c0536a0 0x7fe52c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:32.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.000+0000 7fe5467fc700 1 --2- 172.21.2.105:0/2924058073 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe52c0536a0 0x7fe52c055b60 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7fe538002fb0 tx=0x7fe538006930).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:32.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.000+0000 7fe53ffff700 1 -- 172.21.2.105:0/2924058073 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe530043590 con 0x7fe5480ac280 2021-11-12T05:47:32.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.112+0000 7fe54d6da700 1 -- 172.21.2.105:0/2924058073 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fe5480b4d70 con 0x7fe5480ac280 2021-11-12T05:47:32.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.116+0000 7fe53ffff700 1 -- 172.21.2.105:0/2924058073 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v29) v1 ==== 184+0+0 (secure 0 0 0) 0x7fe530023020 con 0x7fe5480ac280 2021-11-12T05:47:32.121 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.116+0000 7fe54d6da700 1 -- 172.21.2.105:0/2924058073 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe52c0536a0 msgr2=0x7fe52c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:32.122 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.116+0000 7fe54d6da700 1 --2- 172.21.2.105:0/2924058073 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe52c0536a0 0x7fe52c055b60 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7fe538002fb0 tx=0x7fe538006930).stop 2021-11-12T05:47:32.122 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.116+0000 7fe54d6da700 1 -- 172.21.2.105:0/2924058073 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe5480ac280 msgr2=0x7fe548157940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:32.122 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.116+0000 7fe54d6da700 1 --2- 172.21.2.105:0/2924058073 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe5480ac280 0x7fe548157940 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7fe5480b0eb0 tx=0x7fe530014000).stop 2021-11-12T05:47:32.122 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.116+0000 7fe54d6da700 1 -- 172.21.2.105:0/2924058073 shutdown_connections 2021-11-12T05:47:32.123 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.116+0000 7fe54d6da700 1 --2- 172.21.2.105:0/2924058073 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe52c0536a0 0x7fe52c055b60 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:32.123 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.116+0000 7fe54d6da700 1 --2- 172.21.2.105:0/2924058073 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe54814b2f0 0x7fe5481570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:32.123 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.116+0000 7fe54d6da700 1 --2- 172.21.2.105:0/2924058073 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe5480ad080 0x7fe5480abb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:32.124 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.116+0000 7fe54d6da700 1 --2- 172.21.2.105:0/2924058073 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe5480ac280 0x7fe548157940 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:32.124 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.116+0000 7fe54d6da700 1 -- 172.21.2.105:0/2924058073 >> 172.21.2.105:0/2924058073 conn(0x7fe5480b5370 msgr2=0x7fe548144780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:32.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.116+0000 7fe54d6da700 1 -- 172.21.2.105:0/2924058073 shutdown_connections 2021-11-12T05:47:32.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.116+0000 7fe54d6da700 1 -- 172.21.2.105:0/2924058073 wait complete. 2021-11-12T05:47:32.126 INFO:teuthology.orchestra.run.gibba005.stderr:updated caps for client.1 2021-11-12T05:47:32.129 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-12T05:47:32.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.180+0000 7ff402aab700 1 Processor -- start 2021-11-12T05:47:32.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.180+0000 7ff402aab700 1 -- start start 2021-11-12T05:47:32.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.180+0000 7ff402aab700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff3fc143b40 0x7ff3fc0aded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:32.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.180+0000 7ff402aab700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3fc067860 con 0x7ff3fc0adaf0 2021-11-12T05:47:32.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.180+0000 7ff402aab700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3fc1404a0 con 0x7ff3fc0ae3c0 2021-11-12T05:47:32.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.180+0000 7ff402aab700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3fc143400 con 0x7ff3fc143b40 2021-11-12T05:47:32.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.180+0000 7ff400847700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7ff3fc0adaf0 0x7ff3fc13fd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:58746/0 (socket says 172.21.2.105:58746) 2021-11-12T05:47:32.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.180+0000 7ff400847700 1 -- 172.21.2.105:0/904548846 learned_addr learned my addr 172.21.2.105:0/904548846 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:32.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.180+0000 7ff3fbfff700 1 --2- 172.21.2.105:0/904548846 >> v2:172.21.2.105:3300/0 conn(0x7ff3fc143b40 0x7ff3fc0aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:32.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.180+0000 7ff3fbfff700 1 -- 172.21.2.105:0/904548846 >> v1:172.21.2.115:6789/0 conn(0x7ff3fc0ae3c0 legacy=0x7ff3fc0afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:32.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.180+0000 7ff3fbfff700 1 -- 172.21.2.105:0/904548846 >> v1:172.21.2.105:6789/0 conn(0x7ff3fc0adaf0 legacy=0x7ff3fc13fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:32.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.180+0000 7ff3fbfff700 1 -- 172.21.2.105:0/904548846 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3fc1436a0 con 0x7ff3fc143b40 2021-11-12T05:47:32.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.180+0000 7ff3fbfff700 1 --2- 172.21.2.105:0/904548846 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3fc143b40 0x7ff3fc0aded0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 rx=0x7ff3fc0625f0 tx=0x7ff3ec006df0).ready entity=mon.0 client_cookie=5dd8fcfc2a2fbd5a server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:32.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.180+0000 7ff3fb7fe700 1 -- 172.21.2.105:0/904548846 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3ec00d5c0 con 0x7ff3fc143b40 2021-11-12T05:47:32.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.180+0000 7ff3fb7fe700 1 -- 172.21.2.105:0/904548846 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3ec000e90 con 0x7ff3fc143b40 2021-11-12T05:47:32.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.180+0000 7ff3fb7fe700 1 -- 172.21.2.105:0/904548846 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3ec00d910 con 0x7ff3fc143b40 2021-11-12T05:47:32.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.180+0000 7ff402aab700 1 -- 172.21.2.105:0/904548846 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3fc143b40 msgr2=0x7ff3fc0aded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:32.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.180+0000 7ff402aab700 1 --2- 172.21.2.105:0/904548846 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3fc143b40 0x7ff3fc0aded0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 rx=0x7ff3fc0625f0 tx=0x7ff3ec006df0).stop 2021-11-12T05:47:32.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.180+0000 7ff402aab700 1 -- 172.21.2.105:0/904548846 shutdown_connections 2021-11-12T05:47:32.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.180+0000 7ff402aab700 1 --2- 172.21.2.105:0/904548846 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3fc143b40 0x7ff3fc0aded0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:32.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.180+0000 7ff402aab700 1 -- 172.21.2.105:0/904548846 >> 172.21.2.105:0/904548846 conn(0x7ff3fc05c490 msgr2=0x7ff3fc05c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:32.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.180+0000 7ff402aab700 1 -- 172.21.2.105:0/904548846 shutdown_connections 2021-11-12T05:47:32.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.180+0000 7ff402aab700 1 -- 172.21.2.105:0/904548846 wait complete. 2021-11-12T05:47:32.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.180+0000 7ff402aab700 1 Processor -- start 2021-11-12T05:47:32.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.180+0000 7ff402aab700 1 -- start start 2021-11-12T05:47:32.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.184+0000 7ff402aab700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff3fc0adaf0 0x7ff3fc05f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:32.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.184+0000 7ff402aab700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3fc0ae3c0 0x7ff3fc0a8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:32.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.184+0000 7ff402aab700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff3fc143b40 0x7ff3fc0a93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:32.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.184+0000 7ff402aab700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc151830 con 0x7ff3fc0ae3c0 2021-11-12T05:47:32.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.184+0000 7ff402aab700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc09ee80 con 0x7ff3fc0adaf0 2021-11-12T05:47:32.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.184+0000 7ff402aab700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc1505b0 con 0x7ff3fc143b40 2021-11-12T05:47:32.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.184+0000 7ff3fbfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3fc0ae3c0 0x7ff3fc0a8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:32.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.184+0000 7ff3fbfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3fc0ae3c0 0x7ff3fc0a8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48356/0 (socket says 172.21.2.105:48356) 2021-11-12T05:47:32.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.184+0000 7ff3fbfff700 1 -- 172.21.2.105:0/3151153448 learned_addr learned my addr 172.21.2.105:0/3151153448 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:32.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.184+0000 7ff3fbfff700 1 -- 172.21.2.105:0/3151153448 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff3fc143b40 msgr2=0x7ff3fc0a93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:32.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.184+0000 7ff3fbfff700 1 --2- 172.21.2.105:0/3151153448 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff3fc143b40 0x7ff3fc0a93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:32.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.184+0000 7ff3fbfff700 1 -- 172.21.2.105:0/3151153448 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff3fc0adaf0 msgr2=0x7ff3fc05f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:32.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.184+0000 7ff3fbfff700 1 --2- 172.21.2.105:0/3151153448 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff3fc0adaf0 0x7ff3fc05f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:32.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.184+0000 7ff3fbfff700 1 -- 172.21.2.105:0/3151153448 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3ec00b180 con 0x7ff3fc0ae3c0 2021-11-12T05:47:32.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.184+0000 7ff3fbfff700 1 --2- 172.21.2.105:0/3151153448 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3fc0ae3c0 0x7ff3fc0a8ec0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7ff3fc0625f0 tx=0x7ff3ec012000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:32.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.184+0000 7ff3f9ffb700 1 -- 172.21.2.105:0/3151153448 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3ec016070 con 0x7ff3fc0ae3c0 2021-11-12T05:47:32.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.184+0000 7ff3f9ffb700 1 -- 172.21.2.105:0/3151153448 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3ec002f50 con 0x7ff3fc0ae3c0 2021-11-12T05:47:32.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.184+0000 7ff402aab700 1 -- 172.21.2.105:0/3151153448 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3fc09fdc0 con 0x7ff3fc0ae3c0 2021-11-12T05:47:32.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.184+0000 7ff402aab700 1 -- 172.21.2.105:0/3151153448 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3fc0a98a0 con 0x7ff3fc0ae3c0 2021-11-12T05:47:32.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.184+0000 7ff3f9ffb700 1 -- 172.21.2.105:0/3151153448 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3ec01e450 con 0x7ff3fc0ae3c0 2021-11-12T05:47:32.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.184+0000 7ff402aab700 1 -- 172.21.2.105:0/3151153448 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3fc060600 con 0x7ff3fc0ae3c0 2021-11-12T05:47:32.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.184+0000 7ff3f9ffb700 1 -- 172.21.2.105:0/3151153448 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff3ec025030 con 0x7ff3fc0ae3c0 2021-11-12T05:47:32.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.184+0000 7ff3f9ffb700 1 --2- 172.21.2.105:0/3151153448 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff3e0053540 0x7ff3e0055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:32.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.184+0000 7ff3f9ffb700 1 -- 172.21.2.105:0/3151153448 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6502+0+0 (secure 0 0 0) 0x7ff3ec06ceb0 con 0x7ff3fc0ae3c0 2021-11-12T05:47:32.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.184+0000 7ff400847700 1 --2- 172.21.2.105:0/3151153448 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff3e0053540 0x7ff3e0055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:32.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.184+0000 7ff400847700 1 --2- 172.21.2.105:0/3151153448 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff3e0053540 0x7ff3e0055a00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7ff3fc0af9a0 tx=0x7ff3e4007800).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:32.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.188+0000 7ff3f9ffb700 1 -- 172.21.2.105:0/3151153448 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff3ec043d90 con 0x7ff3fc0ae3c0 2021-11-12T05:47:32.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.300+0000 7ff402aab700 1 -- 172.21.2.105:0/3151153448 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7ff3fc09ff50 con 0x7ff3fc0ae3c0 2021-11-12T05:47:32.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.304+0000 7ff3f9ffb700 1 -- 172.21.2.105:0/3151153448 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v30) v1 ==== 184+0+0 (secure 0 0 0) 0x7ff3ec023020 con 0x7ff3fc0ae3c0 2021-11-12T05:47:32.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.308+0000 7ff402aab700 1 -- 172.21.2.105:0/3151153448 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff3e0053540 msgr2=0x7ff3e0055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:32.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.308+0000 7ff402aab700 1 --2- 172.21.2.105:0/3151153448 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff3e0053540 0x7ff3e0055a00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7ff3fc0af9a0 tx=0x7ff3e4007800).stop 2021-11-12T05:47:32.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.308+0000 7ff402aab700 1 -- 172.21.2.105:0/3151153448 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3fc0ae3c0 msgr2=0x7ff3fc0a8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:32.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.308+0000 7ff402aab700 1 --2- 172.21.2.105:0/3151153448 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3fc0ae3c0 0x7ff3fc0a8ec0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7ff3fc0625f0 tx=0x7ff3ec012000).stop 2021-11-12T05:47:32.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.308+0000 7ff402aab700 1 -- 172.21.2.105:0/3151153448 shutdown_connections 2021-11-12T05:47:32.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.308+0000 7ff402aab700 1 --2- 172.21.2.105:0/3151153448 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff3e0053540 0x7ff3e0055a00 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:32.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.308+0000 7ff402aab700 1 --2- 172.21.2.105:0/3151153448 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff3fc143b40 0x7ff3fc0a93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:32.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.308+0000 7ff402aab700 1 --2- 172.21.2.105:0/3151153448 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3fc0ae3c0 0x7ff3fc0a8ec0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:32.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.308+0000 7ff402aab700 1 --2- 172.21.2.105:0/3151153448 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff3fc0adaf0 0x7ff3fc05f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:32.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.308+0000 7ff402aab700 1 -- 172.21.2.105:0/3151153448 >> 172.21.2.105:0/3151153448 conn(0x7ff3fc05c490 msgr2=0x7ff3fc0b03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:32.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.308+0000 7ff402aab700 1 -- 172.21.2.105:0/3151153448 shutdown_connections 2021-11-12T05:47:32.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.308+0000 7ff402aab700 1 -- 172.21.2.105:0/3151153448 wait complete. 2021-11-12T05:47:32.316 INFO:teuthology.orchestra.run.gibba005.stderr:updated caps for client.2 2021-11-12T05:47:32.318 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:47:32.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.364+0000 7fb7d9013700 1 Processor -- start 2021-11-12T05:47:32.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.364+0000 7fb7d9013700 1 -- start start 2021-11-12T05:47:32.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.364+0000 7fb7d9013700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb7d40adaf0 0x7fb7d413fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:32.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.364+0000 7fb7d9013700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fb7d4143fb0 0x7fb7d40afe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:32.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.364+0000 7fb7d9013700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7d4067860 con 0x7fb7d4143b40 2021-11-12T05:47:32.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.364+0000 7fb7d9013700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7d4143400 con 0x7fb7d40adaf0 2021-11-12T05:47:32.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.364+0000 7fb7d9013700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7d41436a0 con 0x7fb7d4143fb0 2021-11-12T05:47:32.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.364+0000 7fb7d2d9d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb7d40adaf0 0x7fb7d413fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:32.373 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.364+0000 7fb7d2d9d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb7d40adaf0 0x7fb7d413fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48362/0 (socket says 172.21.2.105:48362) 2021-11-12T05:47:32.373 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.364+0000 7fb7d2d9d700 1 -- 172.21.2.105:0/386540377 learned_addr learned my addr 172.21.2.105:0/386540377 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:32.373 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.364+0000 7fb7d2d9d700 1 -- 172.21.2.105:0/386540377 >> v2:172.21.2.115:3300/0 conn(0x7fb7d4143fb0 msgr2=0x7fb7d40afe10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:47:32.373 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.364+0000 7fb7d2d9d700 1 --2- 172.21.2.105:0/386540377 >> v2:172.21.2.115:3300/0 conn(0x7fb7d4143fb0 0x7fb7d40afe10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:32.374 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.364+0000 7fb7d2d9d700 1 -- 172.21.2.105:0/386540377 >> v1:172.21.2.115:6789/0 conn(0x7fb7d4143b40 legacy=0x7fb7d40aded0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:47:32.374 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.364+0000 7fb7d2d9d700 1 -- 172.21.2.105:0/386540377 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d40b2b40 con 0x7fb7d40adaf0 2021-11-12T05:47:32.374 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.364+0000 7fb7d2d9d700 1 --2- 172.21.2.105:0/386540377 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb7d40adaf0 0x7fb7d413fd90 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7fb7d40af9a0 tx=0x7fb7bc006eb0).ready entity=mon.0 client_cookie=67583674835f0d6d server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:32.375 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.364+0000 7fb7d1d9b700 1 -- 172.21.2.105:0/386540377 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7bc00d5c0 con 0x7fb7d40adaf0 2021-11-12T05:47:32.375 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.364+0000 7fb7d1d9b700 1 -- 172.21.2.105:0/386540377 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7bc000e90 con 0x7fb7d40adaf0 2021-11-12T05:47:32.375 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.364+0000 7fb7d1d9b700 1 -- 172.21.2.105:0/386540377 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7bc00d910 con 0x7fb7d40adaf0 2021-11-12T05:47:32.375 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.368+0000 7fb7d9013700 1 -- 172.21.2.105:0/386540377 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb7d40adaf0 msgr2=0x7fb7d413fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:32.375 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.368+0000 7fb7d9013700 1 --2- 172.21.2.105:0/386540377 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb7d40adaf0 0x7fb7d413fd90 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7fb7d40af9a0 tx=0x7fb7bc006eb0).stop 2021-11-12T05:47:32.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.368+0000 7fb7d9013700 1 -- 172.21.2.105:0/386540377 shutdown_connections 2021-11-12T05:47:32.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.368+0000 7fb7d9013700 1 --2- 172.21.2.105:0/386540377 >> v2:172.21.2.115:3300/0 conn(0x7fb7d4143fb0 0x7fb7d40afe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:32.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.368+0000 7fb7d9013700 1 --2- 172.21.2.105:0/386540377 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb7d40adaf0 0x7fb7d413fd90 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:32.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.368+0000 7fb7d9013700 1 -- 172.21.2.105:0/386540377 >> 172.21.2.105:0/386540377 conn(0x7fb7d405c490 msgr2=0x7fb7d405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:32.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.368+0000 7fb7d9013700 1 -- 172.21.2.105:0/386540377 shutdown_connections 2021-11-12T05:47:32.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.368+0000 7fb7d9013700 1 -- 172.21.2.105:0/386540377 wait complete. 2021-11-12T05:47:32.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.368+0000 7fb7d9013700 1 Processor -- start 2021-11-12T05:47:32.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.368+0000 7fb7d9013700 1 -- start start 2021-11-12T05:47:32.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.368+0000 7fb7d9013700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb7d40adaf0 0x7fb7d405fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:32.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.368+0000 7fb7d9013700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb7d4143b40 0x7fb7d40aa620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:32.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.368+0000 7fb7d9013700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb7d4143fb0 0x7fb7d40aab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:32.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.368+0000 7fb7d9013700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d413f550 con 0x7fb7d4143fb0 2021-11-12T05:47:32.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.368+0000 7fb7d9013700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d4067210 con 0x7fb7d4143b40 2021-11-12T05:47:32.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.368+0000 7fb7d9013700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d40674b0 con 0x7fb7d40adaf0 2021-11-12T05:47:32.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.368+0000 7fb7d359e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb7d4143fb0 0x7fb7d40aab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:32.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.368+0000 7fb7d359e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb7d4143fb0 0x7fb7d40aab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48370/0 (socket says 172.21.2.105:48370) 2021-11-12T05:47:32.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.368+0000 7fb7d359e700 1 -- 172.21.2.105:0/1274024678 learned_addr learned my addr 172.21.2.105:0/1274024678 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:32.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.368+0000 7fb7d359e700 1 -- 172.21.2.105:0/1274024678 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb7d40adaf0 msgr2=0x7fb7d405fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:32.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.368+0000 7fb7d359e700 1 --2- 172.21.2.105:0/1274024678 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb7d40adaf0 0x7fb7d405fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:32.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.368+0000 7fb7d359e700 1 -- 172.21.2.105:0/1274024678 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb7d4143b40 msgr2=0x7fb7d40aa620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:32.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.368+0000 7fb7d359e700 1 --2- 172.21.2.105:0/1274024678 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb7d4143b40 0x7fb7d40aa620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:32.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.368+0000 7fb7d359e700 1 -- 172.21.2.105:0/1274024678 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7bc00b1e0 con 0x7fb7d4143fb0 2021-11-12T05:47:32.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.368+0000 7fb7d359e700 1 --2- 172.21.2.105:0/1274024678 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb7d4143fb0 0x7fb7d40aab10 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7fb7c4001250 tx=0x7fb7c40090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:32.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.368+0000 7fb7cbfff700 1 -- 172.21.2.105:0/1274024678 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7c40014e0 con 0x7fb7d4143fb0 2021-11-12T05:47:32.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.368+0000 7fb7cbfff700 1 -- 172.21.2.105:0/1274024678 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c4001640 con 0x7fb7d4143fb0 2021-11-12T05:47:32.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.368+0000 7fb7cbfff700 1 -- 172.21.2.105:0/1274024678 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7c40019a0 con 0x7fb7d4143fb0 2021-11-12T05:47:32.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.368+0000 7fb7d9013700 1 -- 172.21.2.105:0/1274024678 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7d41404e0 con 0x7fb7d4143fb0 2021-11-12T05:47:32.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.368+0000 7fb7d9013700 1 -- 172.21.2.105:0/1274024678 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7d40ab000 con 0x7fb7d4143fb0 2021-11-12T05:47:32.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.368+0000 7fb7d9013700 1 -- 172.21.2.105:0/1274024678 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7d40afb00 con 0x7fb7d4143fb0 2021-11-12T05:47:32.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.368+0000 7fb7cbfff700 1 -- 172.21.2.105:0/1274024678 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb7c4018030 con 0x7fb7d4143fb0 2021-11-12T05:47:32.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.368+0000 7fb7cbfff700 1 --2- 172.21.2.105:0/1274024678 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb7b80534f0 0x7fb7b80559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:32.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.368+0000 7fb7cbfff700 1 -- 172.21.2.105:0/1274024678 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6502+0+0 (secure 0 0 0) 0x7fb7c406b400 con 0x7fb7d4143fb0 2021-11-12T05:47:32.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.368+0000 7fb7d2d9d700 1 --2- 172.21.2.105:0/1274024678 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb7b80534f0 0x7fb7b80559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:32.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.372+0000 7fb7d2d9d700 1 --2- 172.21.2.105:0/1274024678 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb7b80534f0 0x7fb7b80559b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7fb7d40af9a0 tx=0x7fb7bc015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:32.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.372+0000 7fb7cbfff700 1 -- 172.21.2.105:0/1274024678 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb7c4042460 con 0x7fb7d4143fb0 2021-11-12T05:47:32.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.480+0000 7fb7d9013700 1 -- 172.21.2.105:0/1274024678 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7d4057350 con 0x7fb7d4143fb0 2021-11-12T05:47:32.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.480+0000 7fb7cbfff700 1 -- 172.21.2.105:0/1274024678 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2138 (secure 0 0 0) 0x7fb7c4045a80 con 0x7fb7d4143fb0 2021-11-12T05:47:32.488 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:32.489 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":38,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4960,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/157622236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":157622236},{"type":"v1","addr":"172.21.2.115:6833","nonce":157622236}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:47:30.387487+0000","modified":"2021-11-12T05:47:32.407052+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6693},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6693":{"gid":6693,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/1429326547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":1429326547},{"type":"v1","addr":"172.21.2.105:6835","nonce":1429326547}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-11-12T05:47:32.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.484+0000 7fb7d9013700 1 -- 172.21.2.105:0/1274024678 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb7b80534f0 msgr2=0x7fb7b80559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:32.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.484+0000 7fb7d9013700 1 --2- 172.21.2.105:0/1274024678 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb7b80534f0 0x7fb7b80559b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7fb7d40af9a0 tx=0x7fb7bc015000).stop 2021-11-12T05:47:32.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.484+0000 7fb7d9013700 1 -- 172.21.2.105:0/1274024678 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb7d4143fb0 msgr2=0x7fb7d40aab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:32.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.484+0000 7fb7d9013700 1 --2- 172.21.2.105:0/1274024678 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb7d4143fb0 0x7fb7d40aab10 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7fb7c4001250 tx=0x7fb7c40090f0).stop 2021-11-12T05:47:32.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.484+0000 7fb7d9013700 1 -- 172.21.2.105:0/1274024678 shutdown_connections 2021-11-12T05:47:32.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.484+0000 7fb7d9013700 1 --2- 172.21.2.105:0/1274024678 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb7b80534f0 0x7fb7b80559b0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:32.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.484+0000 7fb7d9013700 1 --2- 172.21.2.105:0/1274024678 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb7d4143fb0 0x7fb7d40aab10 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:32.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.484+0000 7fb7d9013700 1 --2- 172.21.2.105:0/1274024678 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb7d4143b40 0x7fb7d40aa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:32.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.484+0000 7fb7d9013700 1 --2- 172.21.2.105:0/1274024678 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb7d40adaf0 0x7fb7d405fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:32.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.484+0000 7fb7d9013700 1 -- 172.21.2.105:0/1274024678 >> 172.21.2.105:0/1274024678 conn(0x7fb7d405c490 msgr2=0x7fb7d4141260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:32.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.484+0000 7fb7d9013700 1 -- 172.21.2.105:0/1274024678 shutdown_connections 2021-11-12T05:47:32.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.484+0000 7fb7d9013700 1 -- 172.21.2.105:0/1274024678 wait complete. 2021-11-12T05:47:32.497 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 38 2021-11-12T05:47:32.700 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:47:30.387487+0000', 'modified': '2021-11-12T05:47:32.407052+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 84, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6693}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6693': {'gid': 6693, 'name': 'a', 'rank': 0, 'incarnation': 37, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/1429326547', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 1429326547}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 1429326547}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:47:32.701 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:47:32.702 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:47:32.766 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":6693,"want_state":"up:active","state":"up:active","rank_uptime":1.349089545,"mdsmap_epoch":38,"osdmap_epoch":86,"osdmap_epoch_barrier":85,"uptime":5.517428518} 2021-11-12T05:47:32.767 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 6693, "mdsmap_epoch": 38, "osdmap_epoch": 86, "osdmap_epoch_barrier": 85, "rank_uptime": 1.349089545, "state": "up:active", "uptime": 5.517428518, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:47:32.768 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:47:32.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.812+0000 7fd56e9a6700 1 Processor -- start 2021-11-12T05:47:32.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.812+0000 7fd56e9a6700 1 -- start start 2021-11-12T05:47:32.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.812+0000 7fd56e9a6700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd5680b1380 0x7fd568142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:32.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.812+0000 7fd56e9a6700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd5680acd20 0x7fd5680adf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:32.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.812+0000 7fd56e9a6700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5680ac7b0 con 0x7fd568066be0 2021-11-12T05:47:32.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.812+0000 7fd56e9a6700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5680b0140 con 0x7fd5680b1380 2021-11-12T05:47:32.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.812+0000 7fd56e9a6700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd568066fc0 con 0x7fd5680acd20 2021-11-12T05:47:32.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd567fff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fd568066be0 0x7fd5681426b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:58772/0 (socket says 172.21.2.105:58772) 2021-11-12T05:47:32.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd5677fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd5680b1380 0x7fd568142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:32.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd567fff700 1 -- 172.21.2.105:0/3827579659 learned_addr learned my addr 172.21.2.105:0/3827579659 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:32.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd5677fe700 1 -- 172.21.2.105:0/3827579659 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd5680acd20 msgr2=0x7fd5680adf20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:47:32.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd5677fe700 1 --2- 172.21.2.105:0/3827579659 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd5680acd20 0x7fd5680adf20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:32.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd5677fe700 1 -- 172.21.2.105:0/3827579659 >> v1:172.21.2.105:6789/0 conn(0x7fd568066be0 legacy=0x7fd5681426b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:32.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd5677fe700 1 -- 172.21.2.105:0/3827579659 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5680afd10 con 0x7fd5680b1380 2021-11-12T05:47:32.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd5677fe700 1 --2- 172.21.2.105:0/3827579659 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd5680b1380 0x7fd568142dc0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7fd560002f70 tx=0x7fd560006df0).ready entity=mon.0 client_cookie=b2dceab0bff72ed3 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:32.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd566ffd700 1 -- 172.21.2.105:0/3827579659 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd56000d570 con 0x7fd5680b1380 2021-11-12T05:47:32.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd566ffd700 1 -- 172.21.2.105:0/3827579659 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd560000e90 con 0x7fd5680b1380 2021-11-12T05:47:32.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd566ffd700 1 -- 172.21.2.105:0/3827579659 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd56000d900 con 0x7fd5680b1380 2021-11-12T05:47:32.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd56e9a6700 1 -- 172.21.2.105:0/3827579659 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd5680b1380 msgr2=0x7fd568142dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:32.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd56e9a6700 1 --2- 172.21.2.105:0/3827579659 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd5680b1380 0x7fd568142dc0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7fd560002f70 tx=0x7fd560006df0).stop 2021-11-12T05:47:32.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd56e9a6700 1 -- 172.21.2.105:0/3827579659 shutdown_connections 2021-11-12T05:47:32.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd56e9a6700 1 --2- 172.21.2.105:0/3827579659 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd5680acd20 0x7fd5680adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:32.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd56e9a6700 1 --2- 172.21.2.105:0/3827579659 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd5680b1380 0x7fd568142dc0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:32.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd56e9a6700 1 -- 172.21.2.105:0/3827579659 >> 172.21.2.105:0/3827579659 conn(0x7fd5680b5370 msgr2=0x7fd5680b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:32.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd56e9a6700 1 -- 172.21.2.105:0/3827579659 shutdown_connections 2021-11-12T05:47:32.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd56e9a6700 1 -- 172.21.2.105:0/3827579659 wait complete. 2021-11-12T05:47:32.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd56e9a6700 1 Processor -- start 2021-11-12T05:47:32.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd56e9a6700 1 -- start start 2021-11-12T05:47:32.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd56e9a6700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd568066be0 0x7fd568156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:32.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd56e9a6700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd5680acd20 0x7fd568149150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:32.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd56e9a6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd5680b1380 0x7fd5680aae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:32.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd56e9a6700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5680666f0 con 0x7fd5680b1380 2021-11-12T05:47:32.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd56e9a6700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd568062fb0 con 0x7fd568066be0 2021-11-12T05:47:32.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd56e9a6700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5680631e0 con 0x7fd5680acd20 2021-11-12T05:47:32.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd56cf43700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd5680b1380 0x7fd5680aae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:32.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd56cf43700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd5680b1380 0x7fd5680aae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48386/0 (socket says 172.21.2.105:48386) 2021-11-12T05:47:32.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd56cf43700 1 -- 172.21.2.105:0/3051591100 learned_addr learned my addr 172.21.2.105:0/3051591100 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:32.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd56cf43700 1 -- 172.21.2.105:0/3051591100 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd5680acd20 msgr2=0x7fd568149150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:32.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd56cf43700 1 --2- 172.21.2.105:0/3051591100 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd5680acd20 0x7fd568149150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:32.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd56cf43700 1 -- 172.21.2.105:0/3051591100 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd568066be0 msgr2=0x7fd568156a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:32.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd56cf43700 1 --2- 172.21.2.105:0/3051591100 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd568066be0 0x7fd568156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:32.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd56cf43700 1 -- 172.21.2.105:0/3051591100 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd56000b180 con 0x7fd5680b1380 2021-11-12T05:47:32.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd56cf43700 1 --2- 172.21.2.105:0/3051591100 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd5680b1380 0x7fd5680aae30 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7fd558003330 tx=0x7fd5580091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:32.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd5657fa700 1 -- 172.21.2.105:0/3051591100 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd558001520 con 0x7fd5680b1380 2021-11-12T05:47:32.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd5657fa700 1 -- 172.21.2.105:0/3051591100 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd558001680 con 0x7fd5680b1380 2021-11-12T05:47:32.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd5657fa700 1 -- 172.21.2.105:0/3051591100 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5580019e0 con 0x7fd5680b1380 2021-11-12T05:47:32.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd56e9a6700 1 -- 172.21.2.105:0/3051591100 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd56815aac0 con 0x7fd5680b1380 2021-11-12T05:47:32.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.816+0000 7fd56e9a6700 1 -- 172.21.2.105:0/3051591100 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd568149640 con 0x7fd5680b1380 2021-11-12T05:47:32.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.820+0000 7fd56e9a6700 1 -- 172.21.2.105:0/3051591100 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5680ac9e0 con 0x7fd5680b1380 2021-11-12T05:47:32.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.820+0000 7fd5657fa700 1 -- 172.21.2.105:0/3051591100 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd558018030 con 0x7fd5680b1380 2021-11-12T05:47:32.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.820+0000 7fd5657fa700 1 --2- 172.21.2.105:0/3051591100 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd54c0535d0 0x7fd54c055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:32.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.820+0000 7fd5657fa700 1 -- 172.21.2.105:0/3051591100 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6502+0+0 (secure 0 0 0) 0x7fd55806b550 con 0x7fd5680b1380 2021-11-12T05:47:32.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.820+0000 7fd567fff700 1 --2- 172.21.2.105:0/3051591100 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd54c0535d0 0x7fd54c055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:32.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.820+0000 7fd567fff700 1 --2- 172.21.2.105:0/3051591100 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd54c0535d0 0x7fd54c055a90 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7fd5680b2f10 tx=0x7fd550007820).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:32.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.820+0000 7fd5657fa700 1 -- 172.21.2.105:0/3051591100 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd5580425b0 con 0x7fd5680b1380 2021-11-12T05:47:32.908 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.904+0000 7fd56e9a6700 1 -- 172.21.2.105:0/3051591100 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd568068700 con 0x7fd5680b1380 2021-11-12T05:47:32.909 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.904+0000 7fd5657fa700 1 -- 172.21.2.105:0/3051591100 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+16403 (secure 0 0 0) 0x7fd558045bd0 con 0x7fd5680b1380 2021-11-12T05:47:32.909 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:32.910 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":86,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:47:32.407560+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:47:29.162904+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-11-12T05:47:29.359218+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.2.105:6835/1338677059":"2021-11-13T05:47:31.284551+0000","172.21.2.105:6834/1338677059":"2021-11-13T05:47:31.284551+0000"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:47:32.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.904+0000 7fd56e9a6700 1 -- 172.21.2.105:0/3051591100 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd54c0535d0 msgr2=0x7fd54c055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:32.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.904+0000 7fd56e9a6700 1 --2- 172.21.2.105:0/3051591100 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd54c0535d0 0x7fd54c055a90 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7fd5680b2f10 tx=0x7fd550007820).stop 2021-11-12T05:47:32.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.904+0000 7fd56e9a6700 1 -- 172.21.2.105:0/3051591100 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd5680b1380 msgr2=0x7fd5680aae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:32.912 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.904+0000 7fd56e9a6700 1 --2- 172.21.2.105:0/3051591100 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd5680b1380 0x7fd5680aae30 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7fd558003330 tx=0x7fd5580091a0).stop 2021-11-12T05:47:32.912 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.904+0000 7fd56e9a6700 1 -- 172.21.2.105:0/3051591100 shutdown_connections 2021-11-12T05:47:32.912 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.904+0000 7fd56e9a6700 1 --2- 172.21.2.105:0/3051591100 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd54c0535d0 0x7fd54c055a90 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:32.912 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.904+0000 7fd56e9a6700 1 --2- 172.21.2.105:0/3051591100 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd5680b1380 0x7fd5680aae30 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:32.913 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.904+0000 7fd56e9a6700 1 --2- 172.21.2.105:0/3051591100 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd5680acd20 0x7fd568149150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:32.913 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.904+0000 7fd56e9a6700 1 --2- 172.21.2.105:0/3051591100 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd568066be0 0x7fd568156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:32.913 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.904+0000 7fd56e9a6700 1 -- 172.21.2.105:0/3051591100 >> 172.21.2.105:0/3051591100 conn(0x7fd5680b5370 msgr2=0x7fd5680aef60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:32.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.904+0000 7fd56e9a6700 1 -- 172.21.2.105:0/3051591100 shutdown_connections 2021-11-12T05:47:32.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.904+0000 7fd56e9a6700 1 -- 172.21.2.105:0/3051591100 wait complete. 2021-11-12T05:47:32.916 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-12T05:47:29.162904+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2021-11-12T05:47:29.359218+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-12T05:47:32.917 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:47:32.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.964+0000 7efde5bbc700 1 Processor -- start 2021-11-12T05:47:32.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.964+0000 7efde5bbc700 1 -- start start 2021-11-12T05:47:32.975 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efde5bbc700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efde00b7b00 0x7efde0140d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:32.975 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efde5bbc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7efde00b3980 0x7efde00b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:32.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efde5bbc700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde00b7ee0 con 0x7efde00ae090 2021-11-12T05:47:32.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efde5bbc700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde00b2030 con 0x7efde00b3980 2021-11-12T05:47:32.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efde5bbc700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde00b22d0 con 0x7efde00b7b00 2021-11-12T05:47:32.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efddffff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7efde00b3980 0x7efde00b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:32.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efddffff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7efde00b3980 0x7efde00b3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48394/0 (socket says 172.21.2.105:48394) 2021-11-12T05:47:32.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efddffff700 1 -- 172.21.2.105:0/1084886313 learned_addr learned my addr 172.21.2.105:0/1084886313 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:32.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efddffff700 1 -- 172.21.2.105:0/1084886313 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efde00b7b00 msgr2=0x7efde0140d80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:47:32.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efddffff700 1 --2- 172.21.2.105:0/1084886313 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efde00b7b00 0x7efde0140d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:32.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efddffff700 1 -- 172.21.2.105:0/1084886313 >> v1:172.21.2.115:6789/0 conn(0x7efde00ae090 legacy=0x7efde00b2a10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:47:32.978 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efddffff700 1 -- 172.21.2.105:0/1084886313 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde00b2570 con 0x7efde00b3980 2021-11-12T05:47:32.978 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efddffff700 1 --2- 172.21.2.105:0/1084886313 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efde00b3980 0x7efde00b3df0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7efde00ad790 tx=0x7efdd8009290).ready entity=mon.0 client_cookie=eb1cd779b89d38ec server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:32.978 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efdde7fc700 1 -- 172.21.2.105:0/1084886313 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdd800b860 con 0x7efde00b3980 2021-11-12T05:47:32.978 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efdde7fc700 1 -- 172.21.2.105:0/1084886313 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd800b9c0 con 0x7efde00b3980 2021-11-12T05:47:32.979 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efdde7fc700 1 -- 172.21.2.105:0/1084886313 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdd800bb70 con 0x7efde00b3980 2021-11-12T05:47:32.979 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efde5bbc700 1 -- 172.21.2.105:0/1084886313 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efde00b3980 msgr2=0x7efde00b3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:32.979 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efde5bbc700 1 --2- 172.21.2.105:0/1084886313 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efde00b3980 0x7efde00b3df0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7efde00ad790 tx=0x7efdd8009290).stop 2021-11-12T05:47:32.979 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efde5bbc700 1 -- 172.21.2.105:0/1084886313 shutdown_connections 2021-11-12T05:47:32.979 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efde5bbc700 1 --2- 172.21.2.105:0/1084886313 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efde00b3980 0x7efde00b3df0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:32.980 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efde5bbc700 1 --2- 172.21.2.105:0/1084886313 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efde00b7b00 0x7efde0140d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:32.980 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efde5bbc700 1 -- 172.21.2.105:0/1084886313 >> 172.21.2.105:0/1084886313 conn(0x7efde00608d0 msgr2=0x7efde005c490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:32.980 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efde5bbc700 1 -- 172.21.2.105:0/1084886313 shutdown_connections 2021-11-12T05:47:32.980 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efde5bbc700 1 -- 172.21.2.105:0/1084886313 wait complete. 2021-11-12T05:47:32.980 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efde5bbc700 1 Processor -- start 2021-11-12T05:47:32.981 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efde5bbc700 1 -- start start 2021-11-12T05:47:32.981 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efde5bbc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efde00ae090 0x7efde0143410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:32.981 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efde5bbc700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efde00b3980 0x7efde0155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:32.981 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efde5bbc700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efde00b7b00 0x7efde01562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:32.982 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efde5bbc700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde00af140 con 0x7efde00ae090 2021-11-12T05:47:32.982 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efde5bbc700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde01567d0 con 0x7efde00b7b00 2021-11-12T05:47:32.982 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efde5bbc700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde00af3a0 con 0x7efde00b3980 2021-11-12T05:47:32.982 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efddf7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efde00ae090 0x7efde0143410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:32.982 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efddf7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efde00ae090 0x7efde0143410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48396/0 (socket says 172.21.2.105:48396) 2021-11-12T05:47:32.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efddf7fe700 1 -- 172.21.2.105:0/3747931996 learned_addr learned my addr 172.21.2.105:0/3747931996 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:32.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efddf7fe700 1 -- 172.21.2.105:0/3747931996 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efde00b3980 msgr2=0x7efde0155c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:32.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efddf7fe700 1 --2- 172.21.2.105:0/3747931996 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efde00b3980 0x7efde0155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:32.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efddf7fe700 1 -- 172.21.2.105:0/3747931996 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efde00b7b00 msgr2=0x7efde01562e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:32.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efddf7fe700 1 --2- 172.21.2.105:0/3747931996 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efde00b7b00 0x7efde01562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:32.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efddf7fe700 1 -- 172.21.2.105:0/3747931996 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd8009530 con 0x7efde00ae090 2021-11-12T05:47:32.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efddf7fe700 1 --2- 172.21.2.105:0/3747931996 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efde00ae090 0x7efde0143410 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7efdc8000ed0 tx=0x7efdc8006d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:32.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efddcff9700 1 -- 172.21.2.105:0/3747931996 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdc8012410 con 0x7efde00ae090 2021-11-12T05:47:32.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efddcff9700 1 -- 172.21.2.105:0/3747931996 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc8012570 con 0x7efde00ae090 2021-11-12T05:47:32.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efde5bbc700 1 -- 172.21.2.105:0/3747931996 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efde00af640 con 0x7efde00ae090 2021-11-12T05:47:32.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efddcff9700 1 -- 172.21.2.105:0/3747931996 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdc80128d0 con 0x7efde00ae090 2021-11-12T05:47:32.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.968+0000 7efde5bbc700 1 -- 172.21.2.105:0/3747931996 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde00b0360 con 0x7efde00ae090 2021-11-12T05:47:32.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.972+0000 7efde5bbc700 1 -- 172.21.2.105:0/3747931996 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efde0057350 con 0x7efde00ae090 2021-11-12T05:47:32.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.972+0000 7efddcff9700 1 -- 172.21.2.105:0/3747931996 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efdc800f030 con 0x7efde00ae090 2021-11-12T05:47:32.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.972+0000 7efddcff9700 1 --2- 172.21.2.105:0/3747931996 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efdc4053610 0x7efdc4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:32.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.972+0000 7efddcff9700 1 -- 172.21.2.105:0/3747931996 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6502+0+0 (secure 0 0 0) 0x7efdc806b7e0 con 0x7efde00ae090 2021-11-12T05:47:32.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.972+0000 7efddeffd700 1 --2- 172.21.2.105:0/3747931996 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efdc4053610 0x7efdc4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:32.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.972+0000 7efddeffd700 1 --2- 172.21.2.105:0/3747931996 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efdc4053610 0x7efdc4055ad0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7efdd0002fb0 tx=0x7efdd00069f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:32.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:32.972+0000 7efddcff9700 1 -- 172.21.2.105:0/3747931996 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efdc8042680 con 0x7efde00ae090 2021-11-12T05:47:33.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.056+0000 7efde5bbc700 1 -- 172.21.2.105:0/3747931996 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7efde005f280 con 0x7efde00ae090 2021-11-12T05:47:33.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.056+0000 7efddcff9700 1 -- 172.21.2.105:0/3747931996 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v86) v1 ==== 110+0+10 (secure 0 0 0) 0x7efdc8045ca0 con 0x7efde00ae090 2021-11-12T05:47:33.062 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:47:33.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.060+0000 7efde5bbc700 1 -- 172.21.2.105:0/3747931996 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efdc4053610 msgr2=0x7efdc4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:33.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.060+0000 7efde5bbc700 1 --2- 172.21.2.105:0/3747931996 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efdc4053610 0x7efdc4055ad0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7efdd0002fb0 tx=0x7efdd00069f0).stop 2021-11-12T05:47:33.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.060+0000 7efde5bbc700 1 -- 172.21.2.105:0/3747931996 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efde00ae090 msgr2=0x7efde0143410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:33.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.060+0000 7efde5bbc700 1 --2- 172.21.2.105:0/3747931996 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efde00ae090 0x7efde0143410 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7efdc8000ed0 tx=0x7efdc8006d70).stop 2021-11-12T05:47:33.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.060+0000 7efde5bbc700 1 -- 172.21.2.105:0/3747931996 shutdown_connections 2021-11-12T05:47:33.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.060+0000 7efde5bbc700 1 --2- 172.21.2.105:0/3747931996 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efdc4053610 0x7efdc4055ad0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:33.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.060+0000 7efde5bbc700 1 --2- 172.21.2.105:0/3747931996 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efde00b7b00 0x7efde01562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:33.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.060+0000 7efde5bbc700 1 --2- 172.21.2.105:0/3747931996 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efde00b3980 0x7efde0155c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:33.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.060+0000 7efde5bbc700 1 --2- 172.21.2.105:0/3747931996 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efde00ae090 0x7efde0143410 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:33.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.060+0000 7efde5bbc700 1 -- 172.21.2.105:0/3747931996 >> 172.21.2.105:0/3747931996 conn(0x7efde00608d0 msgr2=0x7efde0140720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:33.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.060+0000 7efde5bbc700 1 -- 172.21.2.105:0/3747931996 shutdown_connections 2021-11-12T05:47:33.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.060+0000 7efde5bbc700 1 -- 172.21.2.105:0/3747931996 wait complete. 2021-11-12T05:47:33.069 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:47:33.122 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.116+0000 7f34fdf3a700 1 Processor -- start 2021-11-12T05:47:33.122 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.116+0000 7f34fdf3a700 1 -- start start 2021-11-12T05:47:33.123 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34fdf3a700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f34f80b2f70 0x7f34f80b7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:33.124 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34fdf3a700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f34f8142fc0 0x7f34f8062340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:33.124 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34fdf3a700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34f80b2590 con 0x7f34f80b76d0 2021-11-12T05:47:33.124 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34fdf3a700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f80b2830 con 0x7f34f8142fc0 2021-11-12T05:47:33.124 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34fdf3a700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f80b2ad0 con 0x7f34f80b2f70 2021-11-12T05:47:33.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34f7fff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f34f8142fc0 0x7f34f8062340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:33.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34f7fff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f34f8142fc0 0x7f34f8062340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48408/0 (socket says 172.21.2.105:48408) 2021-11-12T05:47:33.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34f7fff700 1 -- 172.21.2.105:0/3875363881 learned_addr learned my addr 172.21.2.105:0/3875363881 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:33.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34f7fff700 1 -- 172.21.2.105:0/3875363881 >> v2:172.21.2.115:3300/0 conn(0x7f34f80b2f70 msgr2=0x7f34f80b7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:33.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34f7fff700 1 --2- 172.21.2.105:0/3875363881 >> v2:172.21.2.115:3300/0 conn(0x7f34f80b2f70 0x7f34f80b7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:33.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34f7fff700 1 -- 172.21.2.105:0/3875363881 >> v1:172.21.2.115:6789/0 conn(0x7f34f80b76d0 legacy=0x7f34f813cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:33.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34f7fff700 1 -- 172.21.2.105:0/3875363881 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f813d460 con 0x7f34f8142fc0 2021-11-12T05:47:33.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34f7fff700 1 --2- 172.21.2.105:0/3875363881 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f34f8142fc0 0x7f34f8062340 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 rx=0x7f34f80b7420 tx=0x7f34f0009290).ready entity=mon.0 client_cookie=1a92b56a413e4d32 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:33.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34f67fc700 1 -- 172.21.2.105:0/3875363881 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34f000b830 con 0x7f34f8142fc0 2021-11-12T05:47:33.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34f67fc700 1 -- 172.21.2.105:0/3875363881 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f000b990 con 0x7f34f8142fc0 2021-11-12T05:47:33.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34f67fc700 1 -- 172.21.2.105:0/3875363881 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34f000bb40 con 0x7f34f8142fc0 2021-11-12T05:47:33.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34fdf3a700 1 -- 172.21.2.105:0/3875363881 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f34f8142fc0 msgr2=0x7f34f8062340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:33.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34fdf3a700 1 --2- 172.21.2.105:0/3875363881 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f34f8142fc0 0x7f34f8062340 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 rx=0x7f34f80b7420 tx=0x7f34f0009290).stop 2021-11-12T05:47:33.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34fdf3a700 1 -- 172.21.2.105:0/3875363881 shutdown_connections 2021-11-12T05:47:33.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34fdf3a700 1 --2- 172.21.2.105:0/3875363881 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f34f8142fc0 0x7f34f8062340 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:33.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34fdf3a700 1 --2- 172.21.2.105:0/3875363881 >> v2:172.21.2.115:3300/0 conn(0x7f34f80b2f70 0x7f34f80b7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:33.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34fdf3a700 1 -- 172.21.2.105:0/3875363881 >> 172.21.2.105:0/3875363881 conn(0x7f34f80608d0 msgr2=0x7f34f805c490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:33.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34fdf3a700 1 -- 172.21.2.105:0/3875363881 shutdown_connections 2021-11-12T05:47:33.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34fdf3a700 1 -- 172.21.2.105:0/3875363881 wait complete. 2021-11-12T05:47:33.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34fdf3a700 1 Processor -- start 2021-11-12T05:47:33.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34fdf3a700 1 -- start start 2021-11-12T05:47:33.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34fdf3a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f34f80b2f70 0x7f34f8153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:33.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34fdf3a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f34f80b76d0 0x7f34f8147540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:33.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34fdf3a700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f34f8142fc0 0x7f34f8155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:33.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34fdf3a700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f813cc40 con 0x7f34f80b76d0 2021-11-12T05:47:33.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34fdf3a700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f81563e0 con 0x7f34f8142fc0 2021-11-12T05:47:33.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34fdf3a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f8156680 con 0x7f34f80b2f70 2021-11-12T05:47:33.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34f6ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f34f80b76d0 0x7f34f8147540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:33.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34f6ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f34f80b76d0 0x7f34f8147540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48412/0 (socket says 172.21.2.105:48412) 2021-11-12T05:47:33.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34f6ffd700 1 -- 172.21.2.105:0/3418621254 learned_addr learned my addr 172.21.2.105:0/3418621254 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:33.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34f6ffd700 1 -- 172.21.2.105:0/3418621254 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f34f80b2f70 msgr2=0x7f34f8153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:33.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34f6ffd700 1 --2- 172.21.2.105:0/3418621254 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f34f80b2f70 0x7f34f8153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:33.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34f6ffd700 1 -- 172.21.2.105:0/3418621254 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f34f8142fc0 msgr2=0x7f34f8155d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:33.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34f6ffd700 1 --2- 172.21.2.105:0/3418621254 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f34f8142fc0 0x7f34f8155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:33.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34f6ffd700 1 -- 172.21.2.105:0/3418621254 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f0009530 con 0x7f34f80b76d0 2021-11-12T05:47:33.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.120+0000 7f34f6ffd700 1 --2- 172.21.2.105:0/3418621254 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f34f80b76d0 0x7f34f8147540 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7f34ec002f70 tx=0x7f34ec006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:33.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.124+0000 7f34f4ff9700 1 -- 172.21.2.105:0/3418621254 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34ec013460 con 0x7f34f80b76d0 2021-11-12T05:47:33.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.124+0000 7f34f4ff9700 1 -- 172.21.2.105:0/3418621254 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34ec0135c0 con 0x7f34f80b76d0 2021-11-12T05:47:33.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.124+0000 7f34fdf3a700 1 -- 172.21.2.105:0/3418621254 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f8147f90 con 0x7f34f80b76d0 2021-11-12T05:47:33.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.124+0000 7f34fdf3a700 1 -- 172.21.2.105:0/3418621254 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f813b2c0 con 0x7f34f80b76d0 2021-11-12T05:47:33.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.124+0000 7f34f4ff9700 1 -- 172.21.2.105:0/3418621254 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34ec013920 con 0x7f34f80b76d0 2021-11-12T05:47:33.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.124+0000 7f34fdf3a700 1 -- 172.21.2.105:0/3418621254 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f8156840 con 0x7f34f80b76d0 2021-11-12T05:47:33.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.124+0000 7f34f4ff9700 1 -- 172.21.2.105:0/3418621254 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f34ec01a060 con 0x7f34f80b76d0 2021-11-12T05:47:33.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.124+0000 7f34f4ff9700 1 --2- 172.21.2.105:0/3418621254 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f34d8053610 0x7f34d8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:33.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.124+0000 7f34f4ff9700 1 -- 172.21.2.105:0/3418621254 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f34ec06b5a0 con 0x7f34f80b76d0 2021-11-12T05:47:33.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.124+0000 7f34f77fe700 1 --2- 172.21.2.105:0/3418621254 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f34d8053610 0x7f34d8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:33.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.124+0000 7f34f77fe700 1 --2- 172.21.2.105:0/3418621254 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f34d8053610 0x7f34d8055ad0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f34e8002f90 tx=0x7f34e80069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:33.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.128+0000 7f34f4ff9700 1 -- 172.21.2.105:0/3418621254 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f34ec042550 con 0x7f34f80b76d0 2021-11-12T05:47:33.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.208+0000 7f34fdf3a700 1 -- 172.21.2.105:0/3418621254 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f34f80b2210 con 0x7f34f80b76d0 2021-11-12T05:47:33.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.208+0000 7f34f4ff9700 1 -- 172.21.2.105:0/3418621254 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v86) v1 ==== 92+0+10 (secure 0 0 0) 0x7f34ec018030 con 0x7f34f80b76d0 2021-11-12T05:47:33.214 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:47:33.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.208+0000 7f34fdf3a700 1 -- 172.21.2.105:0/3418621254 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f34d8053610 msgr2=0x7f34d8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:33.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.208+0000 7f34fdf3a700 1 --2- 172.21.2.105:0/3418621254 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f34d8053610 0x7f34d8055ad0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f34e8002f90 tx=0x7f34e80069b0).stop 2021-11-12T05:47:33.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.208+0000 7f34fdf3a700 1 -- 172.21.2.105:0/3418621254 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f34f80b76d0 msgr2=0x7f34f8147540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:33.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.208+0000 7f34fdf3a700 1 --2- 172.21.2.105:0/3418621254 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f34f80b76d0 0x7f34f8147540 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7f34ec002f70 tx=0x7f34ec006ec0).stop 2021-11-12T05:47:33.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.208+0000 7f34fdf3a700 1 -- 172.21.2.105:0/3418621254 shutdown_connections 2021-11-12T05:47:33.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.208+0000 7f34fdf3a700 1 --2- 172.21.2.105:0/3418621254 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f34d8053610 0x7f34d8055ad0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:33.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.208+0000 7f34fdf3a700 1 --2- 172.21.2.105:0/3418621254 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f34f8142fc0 0x7f34f8155d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:33.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.208+0000 7f34fdf3a700 1 --2- 172.21.2.105:0/3418621254 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f34f80b76d0 0x7f34f8147540 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:33.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.208+0000 7f34fdf3a700 1 --2- 172.21.2.105:0/3418621254 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f34f80b2f70 0x7f34f8153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:33.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.208+0000 7f34fdf3a700 1 -- 172.21.2.105:0/3418621254 >> 172.21.2.105:0/3418621254 conn(0x7f34f80608d0 msgr2=0x7f34f8148910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:33.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.208+0000 7f34fdf3a700 1 -- 172.21.2.105:0/3418621254 shutdown_connections 2021-11-12T05:47:33.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.208+0000 7f34fdf3a700 1 -- 172.21.2.105:0/3418621254 wait complete. 2021-11-12T05:47:33.221 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-12T05:47:33.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.268+0000 7f48d6f74700 1 Processor -- start 2021-11-12T05:47:33.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.268+0000 7f48d6f74700 1 -- start start 2021-11-12T05:47:33.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.268+0000 7f48d6f74700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f48d00626b0 0x7f48d0062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:33.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.268+0000 7f48d6f74700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f48d00af750 0x7f48d0130370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:33.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.268+0000 7f48d6f74700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48d0130cf0 con 0x7f48d0130860 2021-11-12T05:47:33.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.268+0000 7f48d6f74700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48d00b0d50 con 0x7f48d00af750 2021-11-12T05:47:33.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.268+0000 7f48d6f74700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48d00ad380 con 0x7f48d00626b0 2021-11-12T05:47:33.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.268+0000 7f48cffff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f48d00af750 0x7f48d0130370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:33.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.268+0000 7f48cffff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f48d00af750 0x7f48d0130370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48422/0 (socket says 172.21.2.105:48422) 2021-11-12T05:47:33.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.268+0000 7f48cffff700 1 -- 172.21.2.105:0/3848004026 learned_addr learned my addr 172.21.2.105:0/3848004026 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:33.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.268+0000 7f48cffff700 1 -- 172.21.2.105:0/3848004026 >> v2:172.21.2.115:3300/0 conn(0x7f48d00626b0 msgr2=0x7f48d0062a90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:47:33.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.268+0000 7f48cffff700 1 --2- 172.21.2.105:0/3848004026 >> v2:172.21.2.115:3300/0 conn(0x7f48d00626b0 0x7f48d0062a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:33.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.268+0000 7f48cffff700 1 -- 172.21.2.105:0/3848004026 >> v1:172.21.2.115:6789/0 conn(0x7f48d0130860 legacy=0x7f48d014a950 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:47:33.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.268+0000 7f48cffff700 1 -- 172.21.2.105:0/3848004026 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d00ae190 con 0x7f48d00af750 2021-11-12T05:47:33.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.268+0000 7f48cffff700 1 --2- 172.21.2.105:0/3848004026 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f48d00af750 0x7f48d0130370 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7f48d00b0690 tx=0x7f48b8006eb0).ready entity=mon.0 client_cookie=ac566faf8c25d532 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:33.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.268+0000 7f48cf7fe700 1 -- 172.21.2.105:0/3848004026 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48b800d5c0 con 0x7f48d00af750 2021-11-12T05:47:33.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.268+0000 7f48cf7fe700 1 -- 172.21.2.105:0/3848004026 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b8000e90 con 0x7f48d00af750 2021-11-12T05:47:33.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.268+0000 7f48cf7fe700 1 -- 172.21.2.105:0/3848004026 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48b800d910 con 0x7f48d00af750 2021-11-12T05:47:33.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.272+0000 7f48d6f74700 1 -- 172.21.2.105:0/3848004026 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f48d00af750 msgr2=0x7f48d0130370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:33.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.272+0000 7f48d6f74700 1 --2- 172.21.2.105:0/3848004026 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f48d00af750 0x7f48d0130370 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7f48d00b0690 tx=0x7f48b8006eb0).stop 2021-11-12T05:47:33.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.272+0000 7f48d6f74700 1 -- 172.21.2.105:0/3848004026 shutdown_connections 2021-11-12T05:47:33.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.272+0000 7f48d6f74700 1 --2- 172.21.2.105:0/3848004026 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f48d00af750 0x7f48d0130370 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:33.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.272+0000 7f48d6f74700 1 --2- 172.21.2.105:0/3848004026 >> v2:172.21.2.115:3300/0 conn(0x7f48d00626b0 0x7f48d0062a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:33.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.272+0000 7f48d6f74700 1 -- 172.21.2.105:0/3848004026 >> 172.21.2.105:0/3848004026 conn(0x7f48d00b5320 msgr2=0x7f48d00b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:33.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.272+0000 7f48d6f74700 1 -- 172.21.2.105:0/3848004026 shutdown_connections 2021-11-12T05:47:33.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.272+0000 7f48d6f74700 1 -- 172.21.2.105:0/3848004026 wait complete. 2021-11-12T05:47:33.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.272+0000 7f48d6f74700 1 Processor -- start 2021-11-12T05:47:33.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.272+0000 7f48d6f74700 1 -- start start 2021-11-12T05:47:33.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.272+0000 7f48d6f74700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f48d00626b0 0x7f48d014ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:33.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.272+0000 7f48d6f74700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f48d00af750 0x7f48d012f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:33.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.272+0000 7f48d6f74700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f48d0130860 0x7f48d012f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:33.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.272+0000 7f48d6f74700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d00655e0 con 0x7f48d0130860 2021-11-12T05:47:33.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.272+0000 7f48d6f74700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d0064c60 con 0x7f48d00af750 2021-11-12T05:47:33.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.272+0000 7f48d6f74700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48d014dfe0 con 0x7f48d00626b0 2021-11-12T05:47:33.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.272+0000 7f48d5511700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f48d0130860 0x7f48d012f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:33.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.272+0000 7f48d5511700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f48d0130860 0x7f48d012f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48426/0 (socket says 172.21.2.105:48426) 2021-11-12T05:47:33.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.272+0000 7f48d5511700 1 -- 172.21.2.105:0/1158428240 learned_addr learned my addr 172.21.2.105:0/1158428240 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:33.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.272+0000 7f48d5511700 1 -- 172.21.2.105:0/1158428240 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f48d00626b0 msgr2=0x7f48d014ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:33.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.272+0000 7f48d5511700 1 --2- 172.21.2.105:0/1158428240 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f48d00626b0 0x7f48d014ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:33.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.272+0000 7f48d5511700 1 -- 172.21.2.105:0/1158428240 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f48d00af750 msgr2=0x7f48d012f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:33.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.272+0000 7f48d5511700 1 --2- 172.21.2.105:0/1158428240 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f48d00af750 0x7f48d012f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:33.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.272+0000 7f48d5511700 1 -- 172.21.2.105:0/1158428240 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b800b1e0 con 0x7f48d0130860 2021-11-12T05:47:33.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.272+0000 7f48d5511700 1 --2- 172.21.2.105:0/1158428240 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f48d0130860 0x7f48d012f7f0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7f48d0065f30 tx=0x7f48c80090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:33.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.272+0000 7f48cdffb700 1 -- 172.21.2.105:0/1158428240 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48c80014e0 con 0x7f48d0130860 2021-11-12T05:47:33.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.272+0000 7f48cdffb700 1 -- 172.21.2.105:0/1158428240 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c8001640 con 0x7f48d0130860 2021-11-12T05:47:33.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.272+0000 7f48d6f74700 1 -- 172.21.2.105:0/1158428240 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48d0063e10 con 0x7f48d0130860 2021-11-12T05:47:33.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.272+0000 7f48d6f74700 1 -- 172.21.2.105:0/1158428240 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48d0063b70 con 0x7f48d0130860 2021-11-12T05:47:33.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.272+0000 7f48cdffb700 1 -- 172.21.2.105:0/1158428240 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48c80019a0 con 0x7f48d0130860 2021-11-12T05:47:33.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.272+0000 7f48d6f74700 1 -- 172.21.2.105:0/1158428240 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48d0063140 con 0x7f48d0130860 2021-11-12T05:47:33.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.272+0000 7f48cdffb700 1 -- 172.21.2.105:0/1158428240 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f48c8018030 con 0x7f48d0130860 2021-11-12T05:47:33.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.272+0000 7f48cdffb700 1 --2- 172.21.2.105:0/1158428240 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f48b4053660 0x7f48b4055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:33.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.272+0000 7f48cdffb700 1 -- 172.21.2.105:0/1158428240 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f48c806b560 con 0x7f48d0130860 2021-11-12T05:47:33.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.272+0000 7f48d4d10700 1 --2- 172.21.2.105:0/1158428240 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f48b4053660 0x7f48b4055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:33.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.272+0000 7f48d4d10700 1 --2- 172.21.2.105:0/1158428240 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f48b4053660 0x7f48b4055b20 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f48c0002fb0 tx=0x7f48c00069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:33.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.276+0000 7f48cdffb700 1 -- 172.21.2.105:0/1158428240 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f48c80424b0 con 0x7f48d0130860 2021-11-12T05:47:33.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.360+0000 7f48d6f74700 1 -- 172.21.2.105:0/1158428240 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f48d0057350 con 0x7f48d0130860 2021-11-12T05:47:33.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.360+0000 7f48cdffb700 1 -- 172.21.2.105:0/1158428240 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+10 (secure 0 0 0) 0x7f48c8045ad0 con 0x7f48d0130860 2021-11-12T05:47:33.365 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:47:33.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.360+0000 7f48d6f74700 1 -- 172.21.2.105:0/1158428240 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f48b4053660 msgr2=0x7f48b4055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:33.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.360+0000 7f48d6f74700 1 --2- 172.21.2.105:0/1158428240 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f48b4053660 0x7f48b4055b20 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f48c0002fb0 tx=0x7f48c00069b0).stop 2021-11-12T05:47:33.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.360+0000 7f48d6f74700 1 -- 172.21.2.105:0/1158428240 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f48d0130860 msgr2=0x7f48d012f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:33.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.360+0000 7f48d6f74700 1 --2- 172.21.2.105:0/1158428240 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f48d0130860 0x7f48d012f7f0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7f48d0065f30 tx=0x7f48c80090f0).stop 2021-11-12T05:47:33.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.360+0000 7f48d6f74700 1 -- 172.21.2.105:0/1158428240 shutdown_connections 2021-11-12T05:47:33.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.360+0000 7f48d6f74700 1 --2- 172.21.2.105:0/1158428240 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f48b4053660 0x7f48b4055b20 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:33.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.360+0000 7f48d6f74700 1 --2- 172.21.2.105:0/1158428240 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f48d0130860 0x7f48d012f7f0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:33.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.360+0000 7f48d6f74700 1 --2- 172.21.2.105:0/1158428240 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f48d00af750 0x7f48d012f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:33.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.360+0000 7f48d6f74700 1 --2- 172.21.2.105:0/1158428240 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f48d00626b0 0x7f48d014ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:33.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.360+0000 7f48d6f74700 1 -- 172.21.2.105:0/1158428240 >> 172.21.2.105:0/1158428240 conn(0x7f48d00b5320 msgr2=0x7f48d0130140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:33.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.360+0000 7f48d6f74700 1 -- 172.21.2.105:0/1158428240 shutdown_connections 2021-11-12T05:47:33.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.360+0000 7f48d6f74700 1 -- 172.21.2.105:0/1158428240 wait complete. 2021-11-12T05:47:33.371 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-12T05:47:33.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.420+0000 7f1cc9cb8700 1 Processor -- start 2021-11-12T05:47:33.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.420+0000 7f1cc9cb8700 1 -- start start 2021-11-12T05:47:33.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.420+0000 7f1cc9cb8700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f1cc40ace20 0x7f1cc40b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:33.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.420+0000 7f1cc9cb8700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1cc4144180 0x7f1cc4144610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:33.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.420+0000 7f1cc9cb8700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc40b1840 con 0x7f1cc40aca40 2021-11-12T05:47:33.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.420+0000 7f1cc9cb8700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc40b0a10 con 0x7f1cc40ace20 2021-11-12T05:47:33.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.420+0000 7f1cc9cb8700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc40af2b0 con 0x7f1cc4144180 2021-11-12T05:47:33.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.420+0000 7f1cc2ffd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f1cc40ace20 0x7f1cc40b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:33.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.420+0000 7f1cc2ffd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f1cc40ace20 0x7f1cc40b0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48434/0 (socket says 172.21.2.105:48434) 2021-11-12T05:47:33.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.420+0000 7f1cc2ffd700 1 -- 172.21.2.105:0/1960124932 learned_addr learned my addr 172.21.2.105:0/1960124932 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:33.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.420+0000 7f1cc2ffd700 1 -- 172.21.2.105:0/1960124932 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1cc4144180 msgr2=0x7f1cc4144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:33.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.420+0000 7f1cc2ffd700 1 --2- 172.21.2.105:0/1960124932 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1cc4144180 0x7f1cc4144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:33.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.420+0000 7f1cc2ffd700 1 -- 172.21.2.105:0/1960124932 >> v1:172.21.2.115:6789/0 conn(0x7f1cc40aca40 legacy=0x7f1cc41473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:33.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.420+0000 7f1cc2ffd700 1 -- 172.21.2.105:0/1960124932 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc40b1a70 con 0x7f1cc40ace20 2021-11-12T05:47:33.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.420+0000 7f1cc2ffd700 1 --2- 172.21.2.105:0/1960124932 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1cc40ace20 0x7f1cc40b0520 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7f1cc4061140 tx=0x7f1cb4006eb0).ready entity=mon.0 client_cookie=52a080ec845fa537 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:33.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.420+0000 7f1cc27fc700 1 -- 172.21.2.105:0/1960124932 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cb400d570 con 0x7f1cc40ace20 2021-11-12T05:47:33.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.420+0000 7f1cc27fc700 1 -- 172.21.2.105:0/1960124932 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb4000e90 con 0x7f1cc40ace20 2021-11-12T05:47:33.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.420+0000 7f1cc27fc700 1 -- 172.21.2.105:0/1960124932 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cb400d8c0 con 0x7f1cc40ace20 2021-11-12T05:47:33.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.420+0000 7f1cc9cb8700 1 -- 172.21.2.105:0/1960124932 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1cc40ace20 msgr2=0x7f1cc40b0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:33.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.420+0000 7f1cc9cb8700 1 --2- 172.21.2.105:0/1960124932 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1cc40ace20 0x7f1cc40b0520 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7f1cc4061140 tx=0x7f1cb4006eb0).stop 2021-11-12T05:47:33.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.420+0000 7f1cc9cb8700 1 -- 172.21.2.105:0/1960124932 shutdown_connections 2021-11-12T05:47:33.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.420+0000 7f1cc9cb8700 1 --2- 172.21.2.105:0/1960124932 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1cc4144180 0x7f1cc4144610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:33.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.420+0000 7f1cc9cb8700 1 --2- 172.21.2.105:0/1960124932 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1cc40ace20 0x7f1cc40b0520 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:33.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.420+0000 7f1cc9cb8700 1 -- 172.21.2.105:0/1960124932 >> 172.21.2.105:0/1960124932 conn(0x7f1cc405c490 msgr2=0x7f1cc40b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:33.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.420+0000 7f1cc9cb8700 1 -- 172.21.2.105:0/1960124932 shutdown_connections 2021-11-12T05:47:33.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.420+0000 7f1cc9cb8700 1 -- 172.21.2.105:0/1960124932 wait complete. 2021-11-12T05:47:33.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.424+0000 7f1cc9cb8700 1 Processor -- start 2021-11-12T05:47:33.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.424+0000 7f1cc9cb8700 1 -- start start 2021-11-12T05:47:33.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.424+0000 7f1cc9cb8700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1cc40aca40 0x7f1cc4147eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:33.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.424+0000 7f1cc9cb8700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1cc40ace20 0x7f1cc41566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:33.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.424+0000 7f1cc9cb8700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1cc4144180 0x7f1cc4062ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:33.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.424+0000 7f1cc9cb8700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc4065a50 con 0x7f1cc4144180 2021-11-12T05:47:33.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.424+0000 7f1cc9cb8700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc40657b0 con 0x7f1cc40aca40 2021-11-12T05:47:33.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.424+0000 7f1cc9cb8700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc40627a0 con 0x7f1cc40ace20 2021-11-12T05:47:33.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.424+0000 7f1cc3fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1cc4144180 0x7f1cc4062ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:33.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.424+0000 7f1cc3fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1cc4144180 0x7f1cc4062ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48442/0 (socket says 172.21.2.105:48442) 2021-11-12T05:47:33.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.424+0000 7f1cc3fff700 1 -- 172.21.2.105:0/2642101476 learned_addr learned my addr 172.21.2.105:0/2642101476 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:33.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.424+0000 7f1cc3fff700 1 -- 172.21.2.105:0/2642101476 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1cc40ace20 msgr2=0x7f1cc41566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:33.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.424+0000 7f1cc3fff700 1 --2- 172.21.2.105:0/2642101476 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1cc40ace20 0x7f1cc41566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:33.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.424+0000 7f1cc3fff700 1 -- 172.21.2.105:0/2642101476 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1cc40aca40 msgr2=0x7f1cc4147eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:33.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.424+0000 7f1cc3fff700 1 --2- 172.21.2.105:0/2642101476 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1cc40aca40 0x7f1cc4147eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:33.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.424+0000 7f1cc3fff700 1 -- 172.21.2.105:0/2642101476 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb400b1e0 con 0x7f1cc4144180 2021-11-12T05:47:33.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.424+0000 7f1cc3fff700 1 --2- 172.21.2.105:0/2642101476 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1cc4144180 0x7f1cc4062ce0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7f1cbc0032f0 tx=0x7f1cbc0091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:33.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.424+0000 7f1cc0ff9700 1 -- 172.21.2.105:0/2642101476 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cbc00f510 con 0x7f1cc4144180 2021-11-12T05:47:33.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.424+0000 7f1cc0ff9700 1 -- 172.21.2.105:0/2642101476 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cbc00f670 con 0x7f1cc4144180 2021-11-12T05:47:33.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.424+0000 7f1cc9cb8700 1 -- 172.21.2.105:0/2642101476 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc41483a0 con 0x7f1cc4144180 2021-11-12T05:47:33.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.424+0000 7f1cc9cb8700 1 -- 172.21.2.105:0/2642101476 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc40ac280 con 0x7f1cc4144180 2021-11-12T05:47:33.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.424+0000 7f1cc0ff9700 1 -- 172.21.2.105:0/2642101476 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cbc00f7e0 con 0x7f1cc4144180 2021-11-12T05:47:33.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.424+0000 7f1cc9cb8700 1 -- 172.21.2.105:0/2642101476 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc4057350 con 0x7f1cc4144180 2021-11-12T05:47:33.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.424+0000 7f1cc0ff9700 1 -- 172.21.2.105:0/2642101476 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1cbc00f070 con 0x7f1cc4144180 2021-11-12T05:47:33.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.424+0000 7f1cc0ff9700 1 --2- 172.21.2.105:0/2642101476 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1ca40536f0 0x7f1ca4055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:33.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.424+0000 7f1cc0ff9700 1 -- 172.21.2.105:0/2642101476 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f1cbc06b7f0 con 0x7f1cc4144180 2021-11-12T05:47:33.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.424+0000 7f1cc37fe700 1 --2- 172.21.2.105:0/2642101476 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1ca40536f0 0x7f1ca4055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:33.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.424+0000 7f1cc37fe700 1 --2- 172.21.2.105:0/2642101476 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1ca40536f0 0x7f1ca4055bb0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f1cb8002f90 tx=0x7f1cb80069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:33.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.428+0000 7f1cc0ff9700 1 -- 172.21.2.105:0/2642101476 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1cbc042690 con 0x7f1cc4144180 2021-11-12T05:47:33.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.512+0000 7f1cc9cb8700 1 -- 172.21.2.105:0/2642101476 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1cc405f280 con 0x7f1cc4144180 2021-11-12T05:47:33.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.512+0000 7f1cc0ff9700 1 -- 172.21.2.105:0/2642101476 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+10 (secure 0 0 0) 0x7f1cbc045cb0 con 0x7f1cc4144180 2021-11-12T05:47:33.517 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:47:33.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.512+0000 7f1cc9cb8700 1 -- 172.21.2.105:0/2642101476 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1ca40536f0 msgr2=0x7f1ca4055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:33.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.512+0000 7f1cc9cb8700 1 --2- 172.21.2.105:0/2642101476 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1ca40536f0 0x7f1ca4055bb0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f1cb8002f90 tx=0x7f1cb80069b0).stop 2021-11-12T05:47:33.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.512+0000 7f1cc9cb8700 1 -- 172.21.2.105:0/2642101476 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1cc4144180 msgr2=0x7f1cc4062ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:33.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.512+0000 7f1cc9cb8700 1 --2- 172.21.2.105:0/2642101476 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1cc4144180 0x7f1cc4062ce0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7f1cbc0032f0 tx=0x7f1cbc0091a0).stop 2021-11-12T05:47:33.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.512+0000 7f1cc9cb8700 1 -- 172.21.2.105:0/2642101476 shutdown_connections 2021-11-12T05:47:33.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.512+0000 7f1cc9cb8700 1 --2- 172.21.2.105:0/2642101476 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1ca40536f0 0x7f1ca4055bb0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:33.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.512+0000 7f1cc9cb8700 1 --2- 172.21.2.105:0/2642101476 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1cc4144180 0x7f1cc4062ce0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:33.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.512+0000 7f1cc9cb8700 1 --2- 172.21.2.105:0/2642101476 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1cc40ace20 0x7f1cc41566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:33.520 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.512+0000 7f1cc9cb8700 1 --2- 172.21.2.105:0/2642101476 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1cc40aca40 0x7f1cc4147eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:33.520 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.512+0000 7f1cc9cb8700 1 -- 172.21.2.105:0/2642101476 >> 172.21.2.105:0/2642101476 conn(0x7f1cc405c490 msgr2=0x7f1cc40b5030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:33.520 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.512+0000 7f1cc9cb8700 1 -- 172.21.2.105:0/2642101476 shutdown_connections 2021-11-12T05:47:33.520 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.512+0000 7f1cc9cb8700 1 -- 172.21.2.105:0/2642101476 wait complete. 2021-11-12T05:47:33.524 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-12T05:47:33.524 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:47:33.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a592a8700 1 Processor -- start 2021-11-12T05:47:33.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a592a8700 1 -- start start 2021-11-12T05:47:33.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a592a8700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7a540ac280 0x7f7a5414b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:33.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a592a8700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a540ac7b0 con 0x7f7a540ad080 2021-11-12T05:47:33.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a592a8700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a540ac9e0 con 0x7f7a540af730 2021-11-12T05:47:33.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a592a8700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a541488a0 con 0x7f7a540ac280 2021-11-12T05:47:33.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a52ffd700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f7a540ad080 0x7f7a5414abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:58842/0 (socket says 172.21.2.105:58842) 2021-11-12T05:47:33.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a52ffd700 1 -- 172.21.2.105:0/1433620392 learned_addr learned my addr 172.21.2.105:0/1433620392 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:33.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a51ffb700 1 -- 172.21.2.105:0/1433620392 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2655511320 0 0) 0x7f7a540ac7b0 con 0x7f7a540ad080 2021-11-12T05:47:33.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a51ffb700 1 -- 172.21.2.105:0/1433620392 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a34003260 con 0x7f7a540ad080 2021-11-12T05:47:33.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a527fc700 1 --2- 172.21.2.105:0/1433620392 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7a540ac280 0x7f7a5414b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:33.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a51ffb700 1 -- 172.21.2.105:0/1433620392 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2884052969 0 0) 0x7f7a34003260 con 0x7f7a540ad080 2021-11-12T05:47:33.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a51ffb700 1 -- 172.21.2.105:0/1433620392 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7a540ac280 msgr2=0x7f7a5414b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:33.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a51ffb700 1 --2- 172.21.2.105:0/1433620392 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7a540ac280 0x7f7a5414b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:33.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a51ffb700 1 -- 172.21.2.105:0/1433620392 >> v1:172.21.2.115:6789/0 conn(0x7f7a540af730 legacy=0x7f7a54147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:33.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a51ffb700 1 -- 172.21.2.105:0/1433620392 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a540b0b30 con 0x7f7a540ad080 2021-11-12T05:47:33.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a51ffb700 1 -- 172.21.2.105:0/1433620392 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f7a3c001660 con 0x7f7a540ad080 2021-11-12T05:47:33.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a51ffb700 1 -- 172.21.2.105:0/1433620392 >> v1:172.21.2.105:6789/0 conn(0x7f7a540ad080 legacy=0x7f7a5414abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:33.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a51ffb700 1 --2- 172.21.2.105:0/1433620392 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7a540ac280 0x7f7a34003780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:33.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a51ffb700 1 --2- 172.21.2.105:0/1433620392 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7a34003db0 0x7f7a34004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:33.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a51ffb700 1 --2- 172.21.2.105:0/1433620392 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7a34004a40 0x7f7a34004ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:33.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a51ffb700 1 -- 172.21.2.105:0/1433620392 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a541488a0 con 0x7f7a34004a40 2021-11-12T05:47:33.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a51ffb700 1 -- 172.21.2.105:0/1433620392 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3400b910 con 0x7f7a34003db0 2021-11-12T05:47:33.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a51ffb700 1 -- 172.21.2.105:0/1433620392 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3400bad0 con 0x7f7a540ac280 2021-11-12T05:47:33.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a537fe700 1 --2- 172.21.2.105:0/1433620392 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7a34004a40 0x7f7a34004ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:33.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a537fe700 1 -- 172.21.2.105:0/1433620392 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7a540ac280 msgr2=0x7f7a34003780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:33.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a537fe700 1 --2- 172.21.2.105:0/1433620392 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7a540ac280 0x7f7a34003780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:33.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a537fe700 1 -- 172.21.2.105:0/1433620392 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7a34003db0 msgr2=0x7f7a34004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:33.586 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a537fe700 1 --2- 172.21.2.105:0/1433620392 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7a34003db0 0x7f7a34004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:33.586 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a537fe700 1 -- 172.21.2.105:0/1433620392 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a34003260 con 0x7f7a34004a40 2021-11-12T05:47:33.586 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a537fe700 1 --2- 172.21.2.105:0/1433620392 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7a34004a40 0x7f7a34004ec0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7f7a540b6060 tx=0x7f7a4c007d80).ready entity=mon.0 client_cookie=ca5a47dc30e1b9a5 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:33.586 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a51ffb700 1 -- 172.21.2.105:0/1433620392 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a4c001620 con 0x7f7a34004a40 2021-11-12T05:47:33.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a51ffb700 1 -- 172.21.2.105:0/1433620392 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4c006890 con 0x7f7a34004a40 2021-11-12T05:47:33.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a51ffb700 1 -- 172.21.2.105:0/1433620392 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a4c006bf0 con 0x7f7a34004a40 2021-11-12T05:47:33.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a592a8700 1 -- 172.21.2.105:0/1433620392 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7a34004a40 msgr2=0x7f7a34004ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:33.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a592a8700 1 --2- 172.21.2.105:0/1433620392 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7a34004a40 0x7f7a34004ec0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7f7a540b6060 tx=0x7f7a4c007d80).stop 2021-11-12T05:47:33.588 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a537fe700 1 -- 172.21.2.105:0/1433620392 reap_dead start 2021-11-12T05:47:33.588 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a592a8700 1 -- 172.21.2.105:0/1433620392 shutdown_connections 2021-11-12T05:47:33.588 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a592a8700 1 -- 172.21.2.105:0/1433620392 >> 172.21.2.105:0/1433620392 conn(0x7f7a540b5370 msgr2=0x7f7a540b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:33.588 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a592a8700 1 -- 172.21.2.105:0/1433620392 shutdown_connections 2021-11-12T05:47:33.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.572+0000 7f7a592a8700 1 -- 172.21.2.105:0/1433620392 wait complete. 2021-11-12T05:47:33.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.576+0000 7f7a592a8700 1 Processor -- start 2021-11-12T05:47:33.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.576+0000 7f7a592a8700 1 -- start start 2021-11-12T05:47:33.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.576+0000 7f7a592a8700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7a34004a40 0x7f7a540636c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:33.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.576+0000 7f7a592a8700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7a54157d20 0x7f7a540a9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:33.590 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.576+0000 7f7a592a8700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7a54066bf0 0x7f7a540aad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:33.590 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.576+0000 7f7a592a8700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a54062c40 con 0x7f7a54066bf0 2021-11-12T05:47:33.590 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.576+0000 7f7a592a8700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a54157340 con 0x7f7a34004a40 2021-11-12T05:47:33.590 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.576+0000 7f7a592a8700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a541575e0 con 0x7f7a54157d20 2021-11-12T05:47:33.590 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.576+0000 7f7a537fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7a54066bf0 0x7f7a540aad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:33.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.576+0000 7f7a537fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7a54066bf0 0x7f7a540aad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48462/0 (socket says 172.21.2.105:48462) 2021-11-12T05:47:33.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.576+0000 7f7a537fe700 1 -- 172.21.2.105:0/1961280884 learned_addr learned my addr 172.21.2.105:0/1961280884 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:33.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.576+0000 7f7a52ffd700 1 --2- 172.21.2.105:0/1961280884 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7a34004a40 0x7f7a540636c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:33.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.576+0000 7f7a537fe700 1 -- 172.21.2.105:0/1961280884 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7a54157d20 msgr2=0x7f7a540a9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:33.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.576+0000 7f7a537fe700 1 --2- 172.21.2.105:0/1961280884 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7a54157d20 0x7f7a540a9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:33.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.576+0000 7f7a537fe700 1 -- 172.21.2.105:0/1961280884 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7a34004a40 msgr2=0x7f7a540636c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:33.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.576+0000 7f7a537fe700 1 --2- 172.21.2.105:0/1961280884 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7a34004a40 0x7f7a540636c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:33.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.576+0000 7f7a537fe700 1 -- 172.21.2.105:0/1961280884 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a54157880 con 0x7f7a54066bf0 2021-11-12T05:47:33.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.576+0000 7f7a537fe700 1 --2- 172.21.2.105:0/1961280884 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7a54066bf0 0x7f7a540aad90 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7f7a54062420 tx=0x7f7a4c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:33.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.576+0000 7f7a4bfff700 1 -- 172.21.2.105:0/1961280884 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a4c001620 con 0x7f7a54066bf0 2021-11-12T05:47:33.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.576+0000 7f7a4bfff700 1 -- 172.21.2.105:0/1961280884 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4c013810 con 0x7f7a54066bf0 2021-11-12T05:47:33.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.576+0000 7f7a592a8700 1 -- 172.21.2.105:0/1961280884 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a540a9f20 con 0x7f7a54066bf0 2021-11-12T05:47:33.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.576+0000 7f7a592a8700 1 -- 172.21.2.105:0/1961280884 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a540aa1f0 con 0x7f7a54066bf0 2021-11-12T05:47:33.594 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.576+0000 7f7a4bfff700 1 -- 172.21.2.105:0/1961280884 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a4c013b70 con 0x7f7a54066bf0 2021-11-12T05:47:33.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.576+0000 7f7a592a8700 1 -- 172.21.2.105:0/1961280884 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a2c003410 con 0x7f7a54066bf0 2021-11-12T05:47:33.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.576+0000 7f7a4bfff700 1 -- 172.21.2.105:0/1961280884 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7a4c010030 con 0x7f7a54066bf0 2021-11-12T05:47:33.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.576+0000 7f7a4bfff700 1 --2- 172.21.2.105:0/1961280884 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7a380536f0 0x7f7a38055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:33.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.576+0000 7f7a4bfff700 1 -- 172.21.2.105:0/1961280884 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f7a4c06cf40 con 0x7f7a54066bf0 2021-11-12T05:47:33.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.576+0000 7f7a52ffd700 1 --2- 172.21.2.105:0/1961280884 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7a380536f0 0x7f7a38055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:33.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.576+0000 7f7a52ffd700 1 --2- 172.21.2.105:0/1961280884 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7a380536f0 0x7f7a38055bb0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f7a3c008000 tx=0x7f7a3c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:33.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.580+0000 7f7a4bfff700 1 -- 172.21.2.105:0/1961280884 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7a4c043d80 con 0x7f7a54066bf0 2021-11-12T05:47:33.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.688+0000 7f7a592a8700 1 -- 172.21.2.105:0/1961280884 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7a2c003c40 con 0x7f7a54066bf0 2021-11-12T05:47:33.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.688+0000 7f7a4bfff700 1 -- 172.21.2.105:0/1961280884 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2138 (secure 0 0 0) 0x7f7a4c0473a0 con 0x7f7a54066bf0 2021-11-12T05:47:33.694 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:33.695 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":38,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4960,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/157622236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":157622236},{"type":"v1","addr":"172.21.2.115:6833","nonce":157622236}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:47:30.387487+0000","modified":"2021-11-12T05:47:32.407052+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6693},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6693":{"gid":6693,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/1429326547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":1429326547},{"type":"v1","addr":"172.21.2.105:6835","nonce":1429326547}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-11-12T05:47:33.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.692+0000 7f7a592a8700 1 -- 172.21.2.105:0/1961280884 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7a380536f0 msgr2=0x7f7a38055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:33.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.692+0000 7f7a592a8700 1 --2- 172.21.2.105:0/1961280884 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7a380536f0 0x7f7a38055bb0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f7a3c008000 tx=0x7f7a3c009040).stop 2021-11-12T05:47:33.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.692+0000 7f7a592a8700 1 -- 172.21.2.105:0/1961280884 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7a54066bf0 msgr2=0x7f7a540aad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:33.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.692+0000 7f7a592a8700 1 --2- 172.21.2.105:0/1961280884 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7a54066bf0 0x7f7a540aad90 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7f7a54062420 tx=0x7f7a4c016000).stop 2021-11-12T05:47:33.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.692+0000 7f7a592a8700 1 -- 172.21.2.105:0/1961280884 shutdown_connections 2021-11-12T05:47:33.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.692+0000 7f7a592a8700 1 --2- 172.21.2.105:0/1961280884 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7a380536f0 0x7f7a38055bb0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:33.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.692+0000 7f7a592a8700 1 --2- 172.21.2.105:0/1961280884 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7a54066bf0 0x7f7a540aad90 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:33.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.692+0000 7f7a592a8700 1 --2- 172.21.2.105:0/1961280884 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7a54157d20 0x7f7a540a9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:33.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.692+0000 7f7a592a8700 1 --2- 172.21.2.105:0/1961280884 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7a34004a40 0x7f7a540636c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:33.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.692+0000 7f7a592a8700 1 -- 172.21.2.105:0/1961280884 >> 172.21.2.105:0/1961280884 conn(0x7f7a540b5370 msgr2=0x7f7a5414aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:33.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.692+0000 7f7a592a8700 1 -- 172.21.2.105:0/1961280884 shutdown_connections 2021-11-12T05:47:33.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:33.692+0000 7f7a592a8700 1 -- 172.21.2.105:0/1961280884 wait complete. 2021-11-12T05:47:33.699 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 38 2021-11-12T05:47:33.903 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:47:30.387487+0000', 'modified': '2021-11-12T05:47:32.407052+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 84, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6693}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6693': {'gid': 6693, 'name': 'a', 'rank': 0, 'incarnation': 37, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/1429326547', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 1429326547}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 1429326547}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:47:33.903 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:47:33.904 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:47:33.968 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":6693,"want_state":"up:active","state":"up:active","rank_uptime":2.5512082880000002,"mdsmap_epoch":38,"osdmap_epoch":86,"osdmap_epoch_barrier":85,"uptime":6.7195476090000001} 2021-11-12T05:47:33.969 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 6693, "mdsmap_epoch": 38, "osdmap_epoch": 86, "osdmap_epoch_barrier": 85, "rank_uptime": 2.551208288, "state": "up:active", "uptime": 6.719547609, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:47:33.969 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-12T05:47:33.970 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-12T05:47:33.970 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba016.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-12T05:47:33.970 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:33.971 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:47:33.981 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:47:33.993 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:47:33.994 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:47:33.999 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:47:34.000 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:47:34.001 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:34.001 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:47:34.047 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-12T05:47:34.047 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:47:34.050 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:47:34.059 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:47:34.059 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:47:34.064 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:47:34.065 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:47:34.066 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:34.066 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:47:34.088 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:2021-11-12T05:47:34.085+0000 7fe1179f3080 -1 init, newargv = 0x55b01143ce60 newargc=9 2021-11-12T05:47:34.088 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[14780]: starting ceph client 2021-11-12T05:47:34.102 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[14780]: starting fuse 2021-11-12T05:47:35.192 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:47:35.204 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:47:35.205 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:47:35.254 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:47:35.255 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:47:35.256 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:35.257 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:47:35.261 INFO:teuthology.orchestra.run.gibba016.stdout:52 2021-11-12T05:47:35.262 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-12T05:47:35.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:35.263 DEBUG:teuthology.orchestra.run.gibba016:> sudo python3 -c ' 2021-11-12T05:47:35.263 DEBUG:teuthology.orchestra.run.gibba016:> import glob 2021-11-12T05:47:35.264 DEBUG:teuthology.orchestra.run.gibba016:> import re 2021-11-12T05:47:35.264 DEBUG:teuthology.orchestra.run.gibba016:> import os 2021-11-12T05:47:35.264 DEBUG:teuthology.orchestra.run.gibba016:> import subprocess 2021-11-12T05:47:35.265 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:47:35.265 DEBUG:teuthology.orchestra.run.gibba016:> def find_socket(client_name): 2021-11-12T05:47:35.266 DEBUG:teuthology.orchestra.run.gibba016:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-12T05:47:35.266 DEBUG:teuthology.orchestra.run.gibba016:> files = glob.glob(asok_path) 2021-11-12T05:47:35.266 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:47:35.267 DEBUG:teuthology.orchestra.run.gibba016:> # Given a non-glob path, it better be there 2021-11-12T05:47:35.267 DEBUG:teuthology.orchestra.run.gibba016:> if "*" not in asok_path: 2021-11-12T05:47:35.268 DEBUG:teuthology.orchestra.run.gibba016:> assert(len(files) == 1) 2021-11-12T05:47:35.268 DEBUG:teuthology.orchestra.run.gibba016:> return files[0] 2021-11-12T05:47:35.269 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:47:35.269 DEBUG:teuthology.orchestra.run.gibba016:> for f in files: 2021-11-12T05:47:35.269 DEBUG:teuthology.orchestra.run.gibba016:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-12T05:47:35.270 DEBUG:teuthology.orchestra.run.gibba016:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-12T05:47:35.270 DEBUG:teuthology.orchestra.run.gibba016:> return f 2021-11-12T05:47:35.271 DEBUG:teuthology.orchestra.run.gibba016:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-12T05:47:35.271 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:47:35.271 DEBUG:teuthology.orchestra.run.gibba016:> print(find_socket("client.0")) 2021-11-12T05:47:35.272 DEBUG:teuthology.orchestra.run.gibba016:> ' 2021-11-12T05:47:35.337 INFO:teuthology.orchestra.run.gibba016.stdout:/var/run/ceph/ceph-client.0.14780.asok 2021-11-12T05:47:35.340 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14780.asok 2021-11-12T05:47:35.340 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:35.341 DEBUG:teuthology.orchestra.run.gibba016:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14780.asok status 2021-11-12T05:47:35.388 INFO:teuthology.orchestra.run.gibba016.stdout:{ 2021-11-12T05:47:35.388 INFO:teuthology.orchestra.run.gibba016.stdout: "metadata": { 2021-11-12T05:47:35.388 INFO:teuthology.orchestra.run.gibba016.stdout: "ceph_sha1": "a81ee2815de5acae59ead5b8c9137b6766fc8ea8", 2021-11-12T05:47:35.388 INFO:teuthology.orchestra.run.gibba016.stdout: "ceph_version": "ceph version 15.2.15-22-ga81ee281 (a81ee2815de5acae59ead5b8c9137b6766fc8ea8) octopus (stable)", 2021-11-12T05:47:35.389 INFO:teuthology.orchestra.run.gibba016.stdout: "entity_id": "0", 2021-11-12T05:47:35.389 INFO:teuthology.orchestra.run.gibba016.stdout: "hostname": "gibba016", 2021-11-12T05:47:35.389 INFO:teuthology.orchestra.run.gibba016.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-12T05:47:35.389 INFO:teuthology.orchestra.run.gibba016.stdout: "pid": "14780", 2021-11-12T05:47:35.389 INFO:teuthology.orchestra.run.gibba016.stdout: "root": "/" 2021-11-12T05:47:35.390 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:47:35.390 INFO:teuthology.orchestra.run.gibba016.stdout: "dentry_count": 0, 2021-11-12T05:47:35.390 INFO:teuthology.orchestra.run.gibba016.stdout: "dentry_pinned_count": 0, 2021-11-12T05:47:35.390 INFO:teuthology.orchestra.run.gibba016.stdout: "id": 6861, 2021-11-12T05:47:35.391 INFO:teuthology.orchestra.run.gibba016.stdout: "inst": { 2021-11-12T05:47:35.391 INFO:teuthology.orchestra.run.gibba016.stdout: "name": { 2021-11-12T05:47:35.391 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "client", 2021-11-12T05:47:35.391 INFO:teuthology.orchestra.run.gibba016.stdout: "num": 6861 2021-11-12T05:47:35.391 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:47:35.392 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": { 2021-11-12T05:47:35.392 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "v1", 2021-11-12T05:47:35.392 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": "172.21.2.116:0", 2021-11-12T05:47:35.392 INFO:teuthology.orchestra.run.gibba016.stdout: "nonce": 2664565728 2021-11-12T05:47:35.392 INFO:teuthology.orchestra.run.gibba016.stdout: } 2021-11-12T05:47:35.393 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:47:35.393 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": { 2021-11-12T05:47:35.393 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "v1", 2021-11-12T05:47:35.393 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": "172.21.2.116:0", 2021-11-12T05:47:35.393 INFO:teuthology.orchestra.run.gibba016.stdout: "nonce": 2664565728 2021-11-12T05:47:35.394 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:47:35.394 INFO:teuthology.orchestra.run.gibba016.stdout: "inst_str": "client.6861 172.21.2.116:0/2664565728", 2021-11-12T05:47:35.394 INFO:teuthology.orchestra.run.gibba016.stdout: "addr_str": "172.21.2.116:0/2664565728", 2021-11-12T05:47:35.394 INFO:teuthology.orchestra.run.gibba016.stdout: "inode_count": 1, 2021-11-12T05:47:35.394 INFO:teuthology.orchestra.run.gibba016.stdout: "mds_epoch": 38, 2021-11-12T05:47:35.395 INFO:teuthology.orchestra.run.gibba016.stdout: "osd_epoch": 86, 2021-11-12T05:47:35.395 INFO:teuthology.orchestra.run.gibba016.stdout: "osd_epoch_barrier": 0, 2021-11-12T05:47:35.395 INFO:teuthology.orchestra.run.gibba016.stdout: "blacklisted": false, 2021-11-12T05:47:35.395 INFO:teuthology.orchestra.run.gibba016.stdout: "fs_name": "cephfs" 2021-11-12T05:47:35.395 INFO:teuthology.orchestra.run.gibba016.stdout:} 2021-11-12T05:47:35.396 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:35.397 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:47:35.397 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:47:35.403 INFO:teuthology.orchestra.run.gibba016.stdout:fuseblk 2021-11-12T05:47:35.403 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-12T05:47:35.404 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:35.404 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:47:35.456 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:47:35.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.524+0000 7f2962246700 1 Processor -- start 2021-11-12T05:47:35.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.524+0000 7f2962246700 1 -- start start 2021-11-12T05:47:35.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.524+0000 7f2962246700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f295c0ad080 0x7f295c0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:35.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.524+0000 7f2962246700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f295c14b2f0 0x7f295c0ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:35.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.524+0000 7f2962246700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f295c0ac7b0 con 0x7f295c0ac280 2021-11-12T05:47:35.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.524+0000 7f2962246700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f295c1488a0 con 0x7f295c0ad080 2021-11-12T05:47:35.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.524+0000 7f2962246700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f295c0ac9e0 con 0x7f295c14b2f0 2021-11-12T05:47:35.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.524+0000 7f295bfff700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f295c14b2f0 0x7f295c0ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:35.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.524+0000 7f295b7fe700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f295c0ad080 0x7f295c0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:35.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.524+0000 7f295affd700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7f295c0ac280 0x7f295c14abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:57332/0 (socket says 172.21.2.105:57332) 2021-11-12T05:47:35.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.524+0000 7f295affd700 1 -- 172.21.2.105:0/1976911388 learned_addr learned my addr 172.21.2.105:0/1976911388 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:35.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.528+0000 7f295b7fe700 1 -- 172.21.2.105:0/1976911388 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f295c14b2f0 msgr2=0x7f295c0ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:35.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.528+0000 7f295b7fe700 1 --2- 172.21.2.105:0/1976911388 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f295c14b2f0 0x7f295c0ad460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:35.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.528+0000 7f295b7fe700 1 -- 172.21.2.105:0/1976911388 >> v1:172.21.2.115:6789/0 conn(0x7f295c0ac280 legacy=0x7f295c14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:35.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.528+0000 7f295b7fe700 1 -- 172.21.2.105:0/1976911388 --> v2:172.21.2.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f295c0b0b30 con 0x7f295c0ad080 2021-11-12T05:47:35.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.528+0000 7f295bfff700 1 --2- 172.21.2.105:0/1976911388 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f295c14b2f0 0x7f295c0ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-12T05:47:35.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.528+0000 7f295b7fe700 1 --2- 172.21.2.105:0/1976911388 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f295c0ad080 0x7f295c0af730 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f294c002f70 tx=0x7f294c006df0).ready entity=mon.1 client_cookie=f8c8fb19c29ab4d8 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:35.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.528+0000 7f295a7fc700 1 -- 172.21.2.105:0/1976911388 <== mon.1 v2:172.21.2.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f294c00d570 con 0x7f295c0ad080 2021-11-12T05:47:35.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.528+0000 7f295a7fc700 1 -- 172.21.2.105:0/1976911388 <== mon.1 v2:172.21.2.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294c000e90 con 0x7f295c0ad080 2021-11-12T05:47:35.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.528+0000 7f295a7fc700 1 -- 172.21.2.105:0/1976911388 <== mon.1 v2:172.21.2.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f294c00d8c0 con 0x7f295c0ad080 2021-11-12T05:47:35.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.528+0000 7f2962246700 1 -- 172.21.2.105:0/1976911388 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f295c0ad080 msgr2=0x7f295c0af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:35.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.528+0000 7f2962246700 1 --2- 172.21.2.105:0/1976911388 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f295c0ad080 0x7f295c0af730 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f294c002f70 tx=0x7f294c006df0).stop 2021-11-12T05:47:35.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.528+0000 7f2962246700 1 -- 172.21.2.105:0/1976911388 shutdown_connections 2021-11-12T05:47:35.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.528+0000 7f2962246700 1 --2- 172.21.2.105:0/1976911388 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f295c14b2f0 0x7f295c0ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:35.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.528+0000 7f2962246700 1 --2- 172.21.2.105:0/1976911388 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f295c0ad080 0x7f295c0af730 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:35.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.528+0000 7f2962246700 1 -- 172.21.2.105:0/1976911388 >> 172.21.2.105:0/1976911388 conn(0x7f295c0b5370 msgr2=0x7f295c0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:35.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.528+0000 7f2962246700 1 -- 172.21.2.105:0/1976911388 shutdown_connections 2021-11-12T05:47:35.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.528+0000 7f2962246700 1 -- 172.21.2.105:0/1976911388 wait complete. 2021-11-12T05:47:35.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.528+0000 7f2962246700 1 Processor -- start 2021-11-12T05:47:35.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.528+0000 7f2962246700 1 -- start start 2021-11-12T05:47:35.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.528+0000 7f2962246700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f295c0ac280 0x7f295c0a95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:35.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.528+0000 7f2962246700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f295c0ad080 0x7f295c0ab480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:35.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.528+0000 7f2962246700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f295c14b2f0 0x7f295c0a8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:35.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.528+0000 7f2962246700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295c1433e0 con 0x7f295c0ac280 2021-11-12T05:47:35.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.528+0000 7f2962246700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295c063460 con 0x7f295c0ad080 2021-11-12T05:47:35.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.528+0000 7f2962246700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f295c063700 con 0x7f295c14b2f0 2021-11-12T05:47:35.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.528+0000 7f295b7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f295c0ac280 0x7f295c0a95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:35.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.528+0000 7f295b7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f295c0ac280 0x7f295c0a95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48472/0 (socket says 172.21.2.105:48472) 2021-11-12T05:47:35.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.528+0000 7f295b7fe700 1 -- 172.21.2.105:0/2177450446 learned_addr learned my addr 172.21.2.105:0/2177450446 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:35.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.532+0000 7f295b7fe700 1 -- 172.21.2.105:0/2177450446 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f295c14b2f0 msgr2=0x7f295c0a8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:35.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.532+0000 7f295b7fe700 1 --2- 172.21.2.105:0/2177450446 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f295c14b2f0 0x7f295c0a8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:35.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.532+0000 7f295b7fe700 1 -- 172.21.2.105:0/2177450446 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f295c0ad080 msgr2=0x7f295c0ab480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:35.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.532+0000 7f295b7fe700 1 --2- 172.21.2.105:0/2177450446 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f295c0ad080 0x7f295c0ab480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:35.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.532+0000 7f295b7fe700 1 -- 172.21.2.105:0/2177450446 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2954009470 con 0x7f295c0ac280 2021-11-12T05:47:35.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.532+0000 7f295b7fe700 1 --2- 172.21.2.105:0/2177450446 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f295c0ac280 0x7f295c0a95f0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7f294c002f70 tx=0x7f294c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:35.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.532+0000 7f2958ff9700 1 -- 172.21.2.105:0/2177450446 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f294c00dea0 con 0x7f295c0ac280 2021-11-12T05:47:35.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.532+0000 7f2958ff9700 1 -- 172.21.2.105:0/2177450446 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294c01e400 con 0x7f295c0ac280 2021-11-12T05:47:35.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.532+0000 7f2958ff9700 1 -- 172.21.2.105:0/2177450446 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f294c01e760 con 0x7f295c0ac280 2021-11-12T05:47:35.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.532+0000 7f2962246700 1 -- 172.21.2.105:0/2177450446 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f294c00b180 con 0x7f295c0ac280 2021-11-12T05:47:35.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.532+0000 7f2962246700 1 -- 172.21.2.105:0/2177450446 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f295c063e40 con 0x7f295c0ac280 2021-11-12T05:47:35.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.532+0000 7f2962246700 1 -- 172.21.2.105:0/2177450446 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f295c0b1440 con 0x7f295c0ac280 2021-11-12T05:47:35.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.532+0000 7f2958ff9700 1 -- 172.21.2.105:0/2177450446 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f294c025030 con 0x7f295c0ac280 2021-11-12T05:47:35.545 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.532+0000 7f2958ff9700 1 --2- 172.21.2.105:0/2177450446 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2940053660 0x7f2940055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:35.545 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.532+0000 7f2958ff9700 1 -- 172.21.2.105:0/2177450446 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f294c06cae0 con 0x7f295c0ac280 2021-11-12T05:47:35.545 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.532+0000 7f295affd700 1 --2- 172.21.2.105:0/2177450446 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2940053660 0x7f2940055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:35.545 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.532+0000 7f295affd700 1 --2- 172.21.2.105:0/2177450446 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2940053660 0x7f2940055b20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f295c0b6060 tx=0x7f2944007800).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:35.546 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.536+0000 7f2958ff9700 1 -- 172.21.2.105:0/2177450446 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f294c043980 con 0x7f295c0ac280 2021-11-12T05:47:35.621 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.616+0000 7f2962246700 1 -- 172.21.2.105:0/2177450446 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f295c057350 con 0x7f295c0ac280 2021-11-12T05:47:35.622 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.616+0000 7f2958ff9700 1 -- 172.21.2.105:0/2177450446 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+16403 (secure 0 0 0) 0x7f294c023090 con 0x7f295c0ac280 2021-11-12T05:47:35.623 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:35.623 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":86,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:47:32.407560+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:47:29.162904+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-11-12T05:47:29.359218+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.2.105:6835/1338677059":"2021-11-13T05:47:31.284551+0000","172.21.2.105:6834/1338677059":"2021-11-13T05:47:31.284551+0000"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:47:35.624 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.620+0000 7f2962246700 1 -- 172.21.2.105:0/2177450446 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2940053660 msgr2=0x7f2940055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:35.624 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.620+0000 7f2962246700 1 --2- 172.21.2.105:0/2177450446 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2940053660 0x7f2940055b20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f295c0b6060 tx=0x7f2944007800).stop 2021-11-12T05:47:35.624 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.620+0000 7f2962246700 1 -- 172.21.2.105:0/2177450446 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f295c0ac280 msgr2=0x7f295c0a95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:35.625 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.620+0000 7f2962246700 1 --2- 172.21.2.105:0/2177450446 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f295c0ac280 0x7f295c0a95f0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7f294c002f70 tx=0x7f294c014000).stop 2021-11-12T05:47:35.625 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.620+0000 7f2962246700 1 -- 172.21.2.105:0/2177450446 shutdown_connections 2021-11-12T05:47:35.625 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.620+0000 7f2962246700 1 --2- 172.21.2.105:0/2177450446 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2940053660 0x7f2940055b20 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:35.625 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.620+0000 7f2962246700 1 --2- 172.21.2.105:0/2177450446 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f295c14b2f0 0x7f295c0a8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:35.625 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.620+0000 7f2962246700 1 --2- 172.21.2.105:0/2177450446 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f295c0ad080 0x7f295c0ab480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:35.626 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.620+0000 7f2962246700 1 --2- 172.21.2.105:0/2177450446 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f295c0ac280 0x7f295c0a95f0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:35.626 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.620+0000 7f2962246700 1 -- 172.21.2.105:0/2177450446 >> 172.21.2.105:0/2177450446 conn(0x7f295c0b5370 msgr2=0x7f295c143da0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:35.626 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.620+0000 7f2962246700 1 -- 172.21.2.105:0/2177450446 shutdown_connections 2021-11-12T05:47:35.626 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.620+0000 7f2962246700 1 -- 172.21.2.105:0/2177450446 wait complete. 2021-11-12T05:47:35.630 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-12T05:47:29.162904+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2021-11-12T05:47:29.359218+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-12T05:47:35.631 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:47:35.683 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.680+0000 7f98ca247700 1 Processor -- start 2021-11-12T05:47:35.684 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.680+0000 7f98ca247700 1 -- start start 2021-11-12T05:47:35.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.680+0000 7f98ca247700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f98c40aca40 0x7f98c40ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:35.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.680+0000 7f98ca247700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f98c40b0520 0x7f98c41473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:35.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.680+0000 7f98ca247700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f98c41478b0 0x7f98c4144180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:35.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.680+0000 7f98ca247700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c4147d40 con 0x7f98c41478b0 2021-11-12T05:47:35.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.680+0000 7f98ca247700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c40b1840 con 0x7f98c40b0520 2021-11-12T05:47:35.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.680+0000 7f98ca247700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c40af2b0 con 0x7f98c40aca40 2021-11-12T05:47:35.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.680+0000 7f98c3fff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f98c41478b0 0x7f98c4144180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:35.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.680+0000 7f98c3fff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f98c41478b0 0x7f98c4144180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48484/0 (socket says 172.21.2.105:48484) 2021-11-12T05:47:35.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.680+0000 7f98c3fff700 1 -- 172.21.2.105:0/2127577004 learned_addr learned my addr 172.21.2.105:0/2127577004 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:35.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.680+0000 7f98c3fff700 1 -- 172.21.2.105:0/2127577004 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f98c40aca40 msgr2=0x7f98c40ace20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:47:35.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.680+0000 7f98c3fff700 1 --2- 172.21.2.105:0/2127577004 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f98c40aca40 0x7f98c40ace20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:35.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.680+0000 7f98c3fff700 1 -- 172.21.2.105:0/2127577004 >> v2:172.21.2.115:3300/0 conn(0x7f98c40b0520 msgr2=0x7f98c41473c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:47:35.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.680+0000 7f98c3fff700 1 --2- 172.21.2.105:0/2127577004 >> v2:172.21.2.115:3300/0 conn(0x7f98c40b0520 0x7f98c41473c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:35.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.680+0000 7f98c3fff700 1 -- 172.21.2.105:0/2127577004 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c40b09a0 con 0x7f98c41478b0 2021-11-12T05:47:35.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.680+0000 7f98c3fff700 1 --2- 172.21.2.105:0/2127577004 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98c41478b0 0x7f98c4144180 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7f98bc0032f0 tx=0x7f98bc009290).ready entity=mon.0 client_cookie=4c87f39ab0f5cf42 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:35.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.680+0000 7f98c27fc700 1 -- 172.21.2.105:0/2127577004 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98bc00b870 con 0x7f98c41478b0 2021-11-12T05:47:35.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.680+0000 7f98c27fc700 1 -- 172.21.2.105:0/2127577004 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98bc00b9d0 con 0x7f98c41478b0 2021-11-12T05:47:35.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.680+0000 7f98c27fc700 1 -- 172.21.2.105:0/2127577004 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98bc00bb80 con 0x7f98c41478b0 2021-11-12T05:47:35.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.680+0000 7f98ca247700 1 -- 172.21.2.105:0/2127577004 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98c41478b0 msgr2=0x7f98c4144180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:35.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.680+0000 7f98ca247700 1 --2- 172.21.2.105:0/2127577004 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98c41478b0 0x7f98c4144180 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7f98bc0032f0 tx=0x7f98bc009290).stop 2021-11-12T05:47:35.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.680+0000 7f98ca247700 1 -- 172.21.2.105:0/2127577004 shutdown_connections 2021-11-12T05:47:35.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.680+0000 7f98ca247700 1 --2- 172.21.2.105:0/2127577004 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98c41478b0 0x7f98c4144180 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:35.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.680+0000 7f98ca247700 1 --2- 172.21.2.105:0/2127577004 >> v2:172.21.2.115:3300/0 conn(0x7f98c40b0520 0x7f98c41473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:35.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.680+0000 7f98ca247700 1 --2- 172.21.2.105:0/2127577004 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f98c40aca40 0x7f98c40ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:35.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.680+0000 7f98ca247700 1 -- 172.21.2.105:0/2127577004 >> 172.21.2.105:0/2127577004 conn(0x7f98c405c490 msgr2=0x7f98c40b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:35.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.680+0000 7f98ca247700 1 -- 172.21.2.105:0/2127577004 shutdown_connections 2021-11-12T05:47:35.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.680+0000 7f98ca247700 1 -- 172.21.2.105:0/2127577004 wait complete. 2021-11-12T05:47:35.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.680+0000 7f98ca247700 1 Processor -- start 2021-11-12T05:47:35.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.680+0000 7f98ca247700 1 -- start start 2021-11-12T05:47:35.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.684+0000 7f98ca247700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98c40aca40 0x7f98c4065ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:35.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.684+0000 7f98ca247700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f98c40b0520 0x7f98c40a7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:35.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.684+0000 7f98ca247700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f98c41478b0 0x7f98c40a7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:35.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.684+0000 7f98ca247700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c41577d0 con 0x7f98c40aca40 2021-11-12T05:47:35.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.684+0000 7f98ca247700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c4157290 con 0x7f98c40b0520 2021-11-12T05:47:35.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.684+0000 7f98ca247700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c4157530 con 0x7f98c41478b0 2021-11-12T05:47:35.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.684+0000 7f98c37fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98c40aca40 0x7f98c4065ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:35.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.684+0000 7f98c37fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98c40aca40 0x7f98c4065ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48486/0 (socket says 172.21.2.105:48486) 2021-11-12T05:47:35.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.684+0000 7f98c37fe700 1 -- 172.21.2.105:0/623854641 learned_addr learned my addr 172.21.2.105:0/623854641 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:35.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.684+0000 7f98c37fe700 1 -- 172.21.2.105:0/623854641 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f98c41478b0 msgr2=0x7f98c40a7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:35.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.684+0000 7f98c37fe700 1 --2- 172.21.2.105:0/623854641 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f98c41478b0 0x7f98c40a7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:35.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.684+0000 7f98c37fe700 1 -- 172.21.2.105:0/623854641 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f98c40b0520 msgr2=0x7f98c40a7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:35.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.684+0000 7f98c37fe700 1 --2- 172.21.2.105:0/623854641 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f98c40b0520 0x7f98c40a7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:35.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.684+0000 7f98c37fe700 1 -- 172.21.2.105:0/623854641 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98bc009530 con 0x7f98c40aca40 2021-11-12T05:47:35.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.684+0000 7f98c37fe700 1 --2- 172.21.2.105:0/623854641 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98c40aca40 0x7f98c4065ca0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7f98b4002fb0 tx=0x7f98b4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:35.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.684+0000 7f98c0ff9700 1 -- 172.21.2.105:0/623854641 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98b4009e00 con 0x7f98c40aca40 2021-11-12T05:47:35.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.684+0000 7f98c0ff9700 1 -- 172.21.2.105:0/623854641 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b4013460 con 0x7f98c40aca40 2021-11-12T05:47:35.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.684+0000 7f98c0ff9700 1 -- 172.21.2.105:0/623854641 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98b40137c0 con 0x7f98c40aca40 2021-11-12T05:47:35.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.684+0000 7f98ca247700 1 -- 172.21.2.105:0/623854641 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98c40b48a0 con 0x7f98c40aca40 2021-11-12T05:47:35.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.684+0000 7f98ca247700 1 -- 172.21.2.105:0/623854641 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c4066d70 con 0x7f98c40aca40 2021-11-12T05:47:35.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.684+0000 7f98ca247700 1 -- 172.21.2.105:0/623854641 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98c4057350 con 0x7f98c40aca40 2021-11-12T05:47:35.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.684+0000 7f98c0ff9700 1 -- 172.21.2.105:0/623854641 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f98b400f070 con 0x7f98c40aca40 2021-11-12T05:47:35.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.684+0000 7f98c0ff9700 1 --2- 172.21.2.105:0/623854641 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f98a80536a0 0x7f98a8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:35.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.684+0000 7f98c0ff9700 1 -- 172.21.2.105:0/623854641 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f98b406b140 con 0x7f98c40aca40 2021-11-12T05:47:35.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.684+0000 7f98c2ffd700 1 --2- 172.21.2.105:0/623854641 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f98a80536a0 0x7f98a8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:35.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.684+0000 7f98c2ffd700 1 --2- 172.21.2.105:0/623854641 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f98a80536a0 0x7f98a8055b60 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f98ac002fb0 tx=0x7f98ac0069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:35.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.688+0000 7f98c0ff9700 1 -- 172.21.2.105:0/623854641 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f98b40420f0 con 0x7f98c40aca40 2021-11-12T05:47:35.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.768+0000 7f98ca247700 1 -- 172.21.2.105:0/623854641 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f98c406a280 con 0x7f98c40aca40 2021-11-12T05:47:35.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.772+0000 7f98c0ff9700 1 -- 172.21.2.105:0/623854641 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v86) v1 ==== 110+0+10 (secure 0 0 0) 0x7f98b4018030 con 0x7f98c40aca40 2021-11-12T05:47:35.775 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:47:35.776 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.772+0000 7f98ca247700 1 -- 172.21.2.105:0/623854641 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f98a80536a0 msgr2=0x7f98a8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:35.776 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.772+0000 7f98ca247700 1 --2- 172.21.2.105:0/623854641 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f98a80536a0 0x7f98a8055b60 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f98ac002fb0 tx=0x7f98ac0069b0).stop 2021-11-12T05:47:35.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.772+0000 7f98ca247700 1 -- 172.21.2.105:0/623854641 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98c40aca40 msgr2=0x7f98c4065ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:35.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.772+0000 7f98ca247700 1 --2- 172.21.2.105:0/623854641 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98c40aca40 0x7f98c4065ca0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7f98b4002fb0 tx=0x7f98b4006df0).stop 2021-11-12T05:47:35.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.772+0000 7f98ca247700 1 -- 172.21.2.105:0/623854641 shutdown_connections 2021-11-12T05:47:35.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.772+0000 7f98ca247700 1 --2- 172.21.2.105:0/623854641 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f98a80536a0 0x7f98a8055b60 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:35.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.772+0000 7f98ca247700 1 --2- 172.21.2.105:0/623854641 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f98c41478b0 0x7f98c40a7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:35.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.772+0000 7f98ca247700 1 --2- 172.21.2.105:0/623854641 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f98c40b0520 0x7f98c40a7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:35.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.772+0000 7f98ca247700 1 --2- 172.21.2.105:0/623854641 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98c40aca40 0x7f98c4065ca0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:35.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.772+0000 7f98ca247700 1 -- 172.21.2.105:0/623854641 >> 172.21.2.105:0/623854641 conn(0x7f98c405c490 msgr2=0x7f98c40b1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:35.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.772+0000 7f98ca247700 1 -- 172.21.2.105:0/623854641 shutdown_connections 2021-11-12T05:47:35.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.772+0000 7f98ca247700 1 -- 172.21.2.105:0/623854641 wait complete. 2021-11-12T05:47:35.782 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:47:35.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f621688d700 1 Processor -- start 2021-11-12T05:47:35.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f621688d700 1 -- start start 2021-11-12T05:47:35.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f621688d700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f62100ace20 0x7f62100b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:35.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f621688d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f6210144180 0x7f62101445f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:35.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f621688d700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62100b1840 con 0x7f62100aca40 2021-11-12T05:47:35.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f621688d700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62100b0a10 con 0x7f6210144180 2021-11-12T05:47:35.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f621688d700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62100af2b0 con 0x7f62100ace20 2021-11-12T05:47:35.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f6214e2a700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f6210144180 0x7f62101445f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:35.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f6214e2a700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f6210144180 0x7f62101445f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48496/0 (socket says 172.21.2.105:48496) 2021-11-12T05:47:35.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f6214e2a700 1 -- 172.21.2.105:0/3808639371 learned_addr learned my addr 172.21.2.105:0/3808639371 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:35.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f6214e2a700 1 -- 172.21.2.105:0/3808639371 >> v2:172.21.2.115:3300/0 conn(0x7f62100ace20 msgr2=0x7f62100b0520 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:47:35.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f6214e2a700 1 --2- 172.21.2.105:0/3808639371 >> v2:172.21.2.115:3300/0 conn(0x7f62100ace20 0x7f62100b0520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:35.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f6214e2a700 1 -- 172.21.2.105:0/3808639371 >> v1:172.21.2.105:6789/0 conn(0x7f62100aca40 legacy=0x7f62101473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:35.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f6214e2a700 1 -- 172.21.2.105:0/3808639371 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62100b1a70 con 0x7f6210144180 2021-11-12T05:47:35.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f6214e2a700 1 --2- 172.21.2.105:0/3808639371 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6210144180 0x7f62101445f0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7f62080032f0 tx=0x7f6208009290).ready entity=mon.0 client_cookie=bde2b5b46686b3a4 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:35.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f620effd700 1 -- 172.21.2.105:0/3808639371 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f620800b870 con 0x7f6210144180 2021-11-12T05:47:35.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f620effd700 1 -- 172.21.2.105:0/3808639371 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f620800b9d0 con 0x7f6210144180 2021-11-12T05:47:35.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f620effd700 1 -- 172.21.2.105:0/3808639371 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f620800bb80 con 0x7f6210144180 2021-11-12T05:47:35.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f621688d700 1 -- 172.21.2.105:0/3808639371 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6210144180 msgr2=0x7f62101445f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:35.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f621688d700 1 --2- 172.21.2.105:0/3808639371 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6210144180 0x7f62101445f0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7f62080032f0 tx=0x7f6208009290).stop 2021-11-12T05:47:35.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f621688d700 1 -- 172.21.2.105:0/3808639371 shutdown_connections 2021-11-12T05:47:35.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f621688d700 1 --2- 172.21.2.105:0/3808639371 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6210144180 0x7f62101445f0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:35.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f621688d700 1 --2- 172.21.2.105:0/3808639371 >> v2:172.21.2.115:3300/0 conn(0x7f62100ace20 0x7f62100b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:35.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f621688d700 1 -- 172.21.2.105:0/3808639371 >> 172.21.2.105:0/3808639371 conn(0x7f621005c490 msgr2=0x7f62100b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:35.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f621688d700 1 -- 172.21.2.105:0/3808639371 shutdown_connections 2021-11-12T05:47:35.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f621688d700 1 -- 172.21.2.105:0/3808639371 wait complete. 2021-11-12T05:47:35.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f621688d700 1 Processor -- start 2021-11-12T05:47:35.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f621688d700 1 -- start start 2021-11-12T05:47:35.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f621688d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f62100aca40 0x7f6210146c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:35.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f621688d700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f62100ace20 0x7f6210144cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:35.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f621688d700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6210144180 0x7f6210145910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:35.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f621688d700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6210146550 con 0x7f62100aca40 2021-11-12T05:47:35.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f621688d700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62101467f0 con 0x7f62100ace20 2021-11-12T05:47:35.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f621688d700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6210146290 con 0x7f6210144180 2021-11-12T05:47:35.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f620ffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f62100aca40 0x7f6210146c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:35.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f620ffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f62100aca40 0x7f6210146c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48500/0 (socket says 172.21.2.105:48500) 2021-11-12T05:47:35.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f620ffff700 1 -- 172.21.2.105:0/3731220940 learned_addr learned my addr 172.21.2.105:0/3731220940 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:35.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f620ffff700 1 -- 172.21.2.105:0/3731220940 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6210144180 msgr2=0x7f6210145910 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:47:35.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f620ffff700 1 --2- 172.21.2.105:0/3731220940 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6210144180 0x7f6210145910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:35.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f620ffff700 1 -- 172.21.2.105:0/3731220940 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f62100ace20 msgr2=0x7f6210144cc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:47:35.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f620ffff700 1 --2- 172.21.2.105:0/3731220940 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f62100ace20 0x7f6210144cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:35.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f620ffff700 1 -- 172.21.2.105:0/3731220940 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6208009530 con 0x7f62100aca40 2021-11-12T05:47:35.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f620ffff700 1 --2- 172.21.2.105:0/3731220940 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f62100aca40 0x7f6210146c90 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 rx=0x7f6210061140 tx=0x7f6200007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:35.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f620d7fa700 1 -- 172.21.2.105:0/3731220940 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f620000ce30 con 0x7f62100aca40 2021-11-12T05:47:35.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f620d7fa700 1 -- 172.21.2.105:0/3731220940 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6200007240 con 0x7f62100aca40 2021-11-12T05:47:35.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f620d7fa700 1 -- 172.21.2.105:0/3731220940 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6200006700 con 0x7f62100aca40 2021-11-12T05:47:35.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f621688d700 1 -- 172.21.2.105:0/3731220940 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62101451b0 con 0x7f62100aca40 2021-11-12T05:47:35.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.832+0000 7f621688d700 1 -- 172.21.2.105:0/3731220940 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6210146020 con 0x7f62100aca40 2021-11-12T05:47:35.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.836+0000 7f621688d700 1 -- 172.21.2.105:0/3731220940 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6210057350 con 0x7f62100aca40 2021-11-12T05:47:35.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.836+0000 7f620d7fa700 1 -- 172.21.2.105:0/3731220940 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6200010030 con 0x7f62100aca40 2021-11-12T05:47:35.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.836+0000 7f620d7fa700 1 --2- 172.21.2.105:0/3731220940 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f61f4053610 0x7f61f4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:35.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.836+0000 7f620d7fa700 1 -- 172.21.2.105:0/3731220940 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f620006b8a0 con 0x7f62100aca40 2021-11-12T05:47:35.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.836+0000 7f620f7fe700 1 --2- 172.21.2.105:0/3731220940 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f61f4053610 0x7f61f4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:35.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.836+0000 7f620f7fe700 1 --2- 172.21.2.105:0/3731220940 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f61f4053610 0x7f61f4055ad0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f61f8002fb0 tx=0x7f61f8006930).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:35.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.836+0000 7f620d7fa700 1 -- 172.21.2.105:0/3731220940 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6200042740 con 0x7f62100aca40 2021-11-12T05:47:35.924 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.920+0000 7f621688d700 1 -- 172.21.2.105:0/3731220940 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f621005f280 con 0x7f62100aca40 2021-11-12T05:47:35.925 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.920+0000 7f620d7fa700 1 -- 172.21.2.105:0/3731220940 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v86) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6200045d60 con 0x7f62100aca40 2021-11-12T05:47:35.925 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:47:35.926 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.920+0000 7f621688d700 1 -- 172.21.2.105:0/3731220940 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f61f4053610 msgr2=0x7f61f4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:35.926 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.920+0000 7f621688d700 1 --2- 172.21.2.105:0/3731220940 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f61f4053610 0x7f61f4055ad0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f61f8002fb0 tx=0x7f61f8006930).stop 2021-11-12T05:47:35.927 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.920+0000 7f621688d700 1 -- 172.21.2.105:0/3731220940 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f62100aca40 msgr2=0x7f6210146c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:35.927 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.920+0000 7f621688d700 1 --2- 172.21.2.105:0/3731220940 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f62100aca40 0x7f6210146c90 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 rx=0x7f6210061140 tx=0x7f6200007c10).stop 2021-11-12T05:47:35.927 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.920+0000 7f621688d700 1 -- 172.21.2.105:0/3731220940 shutdown_connections 2021-11-12T05:47:35.927 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.920+0000 7f621688d700 1 --2- 172.21.2.105:0/3731220940 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f61f4053610 0x7f61f4055ad0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:35.927 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.920+0000 7f621688d700 1 --2- 172.21.2.105:0/3731220940 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6210144180 0x7f6210145910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:35.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.920+0000 7f621688d700 1 --2- 172.21.2.105:0/3731220940 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f62100ace20 0x7f6210144cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:35.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.920+0000 7f621688d700 1 --2- 172.21.2.105:0/3731220940 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f62100aca40 0x7f6210146c90 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:35.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.920+0000 7f621688d700 1 -- 172.21.2.105:0/3731220940 >> 172.21.2.105:0/3731220940 conn(0x7f621005c490 msgr2=0x7f6210148990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:35.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.920+0000 7f621688d700 1 -- 172.21.2.105:0/3731220940 shutdown_connections 2021-11-12T05:47:35.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.920+0000 7f621688d700 1 -- 172.21.2.105:0/3731220940 wait complete. 2021-11-12T05:47:35.932 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-12T05:47:35.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.980+0000 7f77394ff700 1 Processor -- start 2021-11-12T05:47:35.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.980+0000 7f77394ff700 1 -- start start 2021-11-12T05:47:35.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.980+0000 7f77394ff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f77340af750 0x7f7734062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:35.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.980+0000 7f77394ff700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f7734130a80 0x7f77341474d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:35.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.980+0000 7f77394ff700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77340b0d50 con 0x7f77340626b0 2021-11-12T05:47:35.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.980+0000 7f77394ff700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77340ad380 con 0x7f77340af750 2021-11-12T05:47:35.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.980+0000 7f77394ff700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77340ae190 con 0x7f7734130a80 2021-11-12T05:47:35.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.980+0000 7f77327fc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f77340af750 0x7f7734062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:35.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.980+0000 7f77327fc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f77340af750 0x7f7734062a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48508/0 (socket says 172.21.2.105:48508) 2021-11-12T05:47:35.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.980+0000 7f77327fc700 1 -- 172.21.2.105:0/101800565 learned_addr learned my addr 172.21.2.105:0/101800565 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:35.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.980+0000 7f77327fc700 1 -- 172.21.2.105:0/101800565 >> v2:172.21.2.115:3300/0 conn(0x7f7734130a80 msgr2=0x7f77341474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:35.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.980+0000 7f77327fc700 1 --2- 172.21.2.105:0/101800565 >> v2:172.21.2.115:3300/0 conn(0x7f7734130a80 0x7f77341474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:35.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.980+0000 7f77327fc700 1 -- 172.21.2.105:0/101800565 >> v1:172.21.2.115:6789/0 conn(0x7f77340626b0 legacy=0x7f7734130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:35.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.980+0000 7f77327fc700 1 -- 172.21.2.105:0/101800565 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77341479c0 con 0x7f77340af750 2021-11-12T05:47:35.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.980+0000 7f77327fc700 1 --2- 172.21.2.105:0/101800565 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f77340af750 0x7f7734062a90 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7f77340b0690 tx=0x7f7724006eb0).ready entity=mon.0 client_cookie=4104589a8499f573 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:35.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.980+0000 7f7731ffb700 1 -- 172.21.2.105:0/101800565 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f772400d5c0 con 0x7f77340af750 2021-11-12T05:47:35.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.980+0000 7f7731ffb700 1 -- 172.21.2.105:0/101800565 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7724000e90 con 0x7f77340af750 2021-11-12T05:47:35.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.980+0000 7f7731ffb700 1 -- 172.21.2.105:0/101800565 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f772400d910 con 0x7f77340af750 2021-11-12T05:47:35.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.980+0000 7f77394ff700 1 -- 172.21.2.105:0/101800565 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f77340af750 msgr2=0x7f7734062a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:35.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.980+0000 7f77394ff700 1 --2- 172.21.2.105:0/101800565 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f77340af750 0x7f7734062a90 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7f77340b0690 tx=0x7f7724006eb0).stop 2021-11-12T05:47:35.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.980+0000 7f77394ff700 1 -- 172.21.2.105:0/101800565 shutdown_connections 2021-11-12T05:47:35.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.980+0000 7f77394ff700 1 --2- 172.21.2.105:0/101800565 >> v2:172.21.2.115:3300/0 conn(0x7f7734130a80 0x7f77341474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:35.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.980+0000 7f77394ff700 1 --2- 172.21.2.105:0/101800565 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f77340af750 0x7f7734062a90 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:35.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.980+0000 7f77394ff700 1 -- 172.21.2.105:0/101800565 >> 172.21.2.105:0/101800565 conn(0x7f77340b5320 msgr2=0x7f77340b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:35.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.980+0000 7f77394ff700 1 -- 172.21.2.105:0/101800565 shutdown_connections 2021-11-12T05:47:35.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.980+0000 7f77394ff700 1 -- 172.21.2.105:0/101800565 wait complete. 2021-11-12T05:47:35.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.984+0000 7f77394ff700 1 Processor -- start 2021-11-12T05:47:35.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.984+0000 7f77394ff700 1 -- start start 2021-11-12T05:47:35.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.984+0000 7f77394ff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f77340626b0 0x7f773414ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:35.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.984+0000 7f77394ff700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f77340af750 0x7f7734148850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:35.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.984+0000 7f77394ff700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7734130a80 0x7f7734157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:35.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.984+0000 7f77394ff700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773412e490 con 0x7f77340626b0 2021-11-12T05:47:35.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.984+0000 7f77394ff700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773414b130 con 0x7f77340af750 2021-11-12T05:47:35.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.984+0000 7f77394ff700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7734156a00 con 0x7f7734130a80 2021-11-12T05:47:35.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.984+0000 7f7732ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f77340626b0 0x7f773414ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:35.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.984+0000 7f7732ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f77340626b0 0x7f773414ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48518/0 (socket says 172.21.2.105:48518) 2021-11-12T05:47:35.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.984+0000 7f7732ffd700 1 -- 172.21.2.105:0/2063422777 learned_addr learned my addr 172.21.2.105:0/2063422777 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:35.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.984+0000 7f77327fc700 1 --2- 172.21.2.105:0/2063422777 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f77340af750 0x7f7734148850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:35.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.984+0000 7f7732ffd700 1 -- 172.21.2.105:0/2063422777 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7734130a80 msgr2=0x7f7734157140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:35.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.984+0000 7f7732ffd700 1 --2- 172.21.2.105:0/2063422777 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7734130a80 0x7f7734157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:35.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.984+0000 7f7732ffd700 1 -- 172.21.2.105:0/2063422777 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f77340af750 msgr2=0x7f7734148850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:35.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.984+0000 7f7732ffd700 1 --2- 172.21.2.105:0/2063422777 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f77340af750 0x7f7734148850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:35.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.984+0000 7f7732ffd700 1 -- 172.21.2.105:0/2063422777 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f772400b1e0 con 0x7f77340626b0 2021-11-12T05:47:35.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.984+0000 7f77327fc700 1 --2- 172.21.2.105:0/2063422777 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f77340af750 0x7f7734148850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:47:35.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.984+0000 7f7732ffd700 1 --2- 172.21.2.105:0/2063422777 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f77340626b0 0x7f773414ac40 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7f7728002f90 tx=0x7f7728006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:35.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.984+0000 7f7723fff700 1 -- 172.21.2.105:0/2063422777 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7728013460 con 0x7f77340626b0 2021-11-12T05:47:35.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.984+0000 7f7723fff700 1 -- 172.21.2.105:0/2063422777 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77280135c0 con 0x7f77340626b0 2021-11-12T05:47:35.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.984+0000 7f7723fff700 1 -- 172.21.2.105:0/2063422777 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7728013920 con 0x7f77340626b0 2021-11-12T05:47:35.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.984+0000 7f77394ff700 1 -- 172.21.2.105:0/2063422777 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7734156ca0 con 0x7f77340626b0 2021-11-12T05:47:35.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.984+0000 7f77394ff700 1 -- 172.21.2.105:0/2063422777 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f773412f870 con 0x7f77340626b0 2021-11-12T05:47:35.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.984+0000 7f77394ff700 1 -- 172.21.2.105:0/2063422777 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f773412e2b0 con 0x7f77340626b0 2021-11-12T05:47:35.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.984+0000 7f7723fff700 1 -- 172.21.2.105:0/2063422777 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f772801a060 con 0x7f77340626b0 2021-11-12T05:47:35.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.984+0000 7f7723fff700 1 --2- 172.21.2.105:0/2063422777 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7710053660 0x7f7710055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:35.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.984+0000 7f7723fff700 1 -- 172.21.2.105:0/2063422777 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f772806b5a0 con 0x7f77340626b0 2021-11-12T05:47:35.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.984+0000 7f77327fc700 1 --2- 172.21.2.105:0/2063422777 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7710053660 0x7f7710055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:35.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.984+0000 7f77327fc700 1 --2- 172.21.2.105:0/2063422777 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7710053660 0x7f7710055b20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f7724017000 tx=0x7f7724015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:36.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:35.988+0000 7f7723fff700 1 -- 172.21.2.105:0/2063422777 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7728042440 con 0x7f77340626b0 2021-11-12T05:47:36.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.072+0000 7f77394ff700 1 -- 172.21.2.105:0/2063422777 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7734057350 con 0x7f77340626b0 2021-11-12T05:47:36.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.072+0000 7f7723fff700 1 -- 172.21.2.105:0/2063422777 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+10 (secure 0 0 0) 0x7f77280180a0 con 0x7f77340626b0 2021-11-12T05:47:36.078 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:47:36.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.072+0000 7f77394ff700 1 -- 172.21.2.105:0/2063422777 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7710053660 msgr2=0x7f7710055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:36.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.072+0000 7f77394ff700 1 --2- 172.21.2.105:0/2063422777 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7710053660 0x7f7710055b20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f7724017000 tx=0x7f7724015000).stop 2021-11-12T05:47:36.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.072+0000 7f77394ff700 1 -- 172.21.2.105:0/2063422777 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f77340626b0 msgr2=0x7f773414ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:36.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.072+0000 7f77394ff700 1 --2- 172.21.2.105:0/2063422777 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f77340626b0 0x7f773414ac40 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7f7728002f90 tx=0x7f7728006df0).stop 2021-11-12T05:47:36.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.072+0000 7f77394ff700 1 -- 172.21.2.105:0/2063422777 shutdown_connections 2021-11-12T05:47:36.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.072+0000 7f77394ff700 1 --2- 172.21.2.105:0/2063422777 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7710053660 0x7f7710055b20 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:36.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.072+0000 7f77394ff700 1 --2- 172.21.2.105:0/2063422777 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7734130a80 0x7f7734157140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:36.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.072+0000 7f77394ff700 1 --2- 172.21.2.105:0/2063422777 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f77340af750 0x7f7734148850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:36.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.072+0000 7f77394ff700 1 --2- 172.21.2.105:0/2063422777 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f77340626b0 0x7f773414ac40 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:36.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.072+0000 7f77394ff700 1 -- 172.21.2.105:0/2063422777 >> 172.21.2.105:0/2063422777 conn(0x7f77340b5320 msgr2=0x7f77340b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:36.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.076+0000 7f77394ff700 1 -- 172.21.2.105:0/2063422777 shutdown_connections 2021-11-12T05:47:36.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.076+0000 7f77394ff700 1 -- 172.21.2.105:0/2063422777 wait complete. 2021-11-12T05:47:36.085 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-12T05:47:36.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.132+0000 7f07930b7700 1 Processor -- start 2021-11-12T05:47:36.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.132+0000 7f07930b7700 1 -- start start 2021-11-12T05:47:36.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.132+0000 7f07930b7700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f078c0ace20 0x7f078c0b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:36.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.132+0000 7f07930b7700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f078c0b1840 con 0x7f078c144180 2021-11-12T05:47:36.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.132+0000 7f07930b7700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f078c0af2b0 con 0x7f078c0aca40 2021-11-12T05:47:36.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.132+0000 7f07930b7700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f078c0ad2a0 con 0x7f078c0ace20 2021-11-12T05:47:36.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.132+0000 7f0791654700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f078c144180 0x7f078c144610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:58922/0 (socket says 172.21.2.105:58922) 2021-11-12T05:47:36.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.132+0000 7f0791654700 1 -- 172.21.2.105:0/478386396 learned_addr learned my addr 172.21.2.105:0/478386396 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:36.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.132+0000 7f078b7fe700 1 -- 172.21.2.105:0/478386396 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 97823953 0 0) 0x7f078c0b1840 con 0x7f078c144180 2021-11-12T05:47:36.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.132+0000 7f078b7fe700 1 -- 172.21.2.105:0/478386396 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f076c003260 con 0x7f078c144180 2021-11-12T05:47:36.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.132+0000 7f078bfff700 1 --2- 172.21.2.105:0/478386396 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f078c0ace20 0x7f078c0b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:36.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.132+0000 7f078b7fe700 1 -- 172.21.2.105:0/478386396 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 476149192 0 0) 0x7f076c003260 con 0x7f078c144180 2021-11-12T05:47:36.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.132+0000 7f078b7fe700 1 -- 172.21.2.105:0/478386396 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f078c0ace20 msgr2=0x7f078c0b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:36.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.132+0000 7f078b7fe700 1 --2- 172.21.2.105:0/478386396 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f078c0ace20 0x7f078c0b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:36.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.132+0000 7f078b7fe700 1 -- 172.21.2.105:0/478386396 >> v1:172.21.2.115:6789/0 conn(0x7f078c0aca40 legacy=0x7f078c1473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:36.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.132+0000 7f078b7fe700 1 -- 172.21.2.105:0/478386396 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f078c0b1a70 con 0x7f078c144180 2021-11-12T05:47:36.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.132+0000 7f078b7fe700 1 -- 172.21.2.105:0/478386396 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f07840019e0 con 0x7f078c144180 2021-11-12T05:47:36.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f078b7fe700 1 -- 172.21.2.105:0/478386396 >> v1:172.21.2.105:6789/0 conn(0x7f078c144180 legacy=0x7f078c144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:36.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f078b7fe700 1 --2- 172.21.2.105:0/478386396 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f076c003780 0x7f076c003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:36.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f078b7fe700 1 --2- 172.21.2.105:0/478386396 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f076c004500 0x7f076c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:36.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f078b7fe700 1 --2- 172.21.2.105:0/478386396 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f078c0ace20 0x7f076c004f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:36.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f078b7fe700 1 -- 172.21.2.105:0/478386396 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076c00b800 con 0x7f076c004500 2021-11-12T05:47:36.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f078b7fe700 1 -- 172.21.2.105:0/478386396 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076c00b970 con 0x7f076c003780 2021-11-12T05:47:36.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f078b7fe700 1 -- 172.21.2.105:0/478386396 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f076c00bb30 con 0x7f078c0ace20 2021-11-12T05:47:36.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f078bfff700 1 --2- 172.21.2.105:0/478386396 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f076c004500 0x7f076c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:36.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f0791654700 1 --2- 172.21.2.105:0/478386396 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f078c0ace20 0x7f076c004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:36.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f0790e53700 1 --2- 172.21.2.105:0/478386396 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f076c003780 0x7f076c003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:36.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f078bfff700 1 -- 172.21.2.105:0/478386396 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f078c0ace20 msgr2=0x7f076c004f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:36.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f078bfff700 1 --2- 172.21.2.105:0/478386396 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f078c0ace20 0x7f076c004f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:36.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f078bfff700 1 -- 172.21.2.105:0/478386396 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f076c003780 msgr2=0x7f076c003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:36.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f078bfff700 1 --2- 172.21.2.105:0/478386396 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f076c003780 0x7f076c003ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:36.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f078bfff700 1 -- 172.21.2.105:0/478386396 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076c003260 con 0x7f076c004500 2021-11-12T05:47:36.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f078bfff700 1 --2- 172.21.2.105:0/478386396 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f076c004500 0x7f076c004980 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7f077400a000 tx=0x7f0774008040).ready entity=mon.0 client_cookie=e54f157240d9464d server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:36.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f078b7fe700 1 -- 172.21.2.105:0/478386396 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0774013670 con 0x7f076c004500 2021-11-12T05:47:36.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f078b7fe700 1 -- 172.21.2.105:0/478386396 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07740137d0 con 0x7f076c004500 2021-11-12T05:47:36.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f078b7fe700 1 -- 172.21.2.105:0/478386396 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0774013b30 con 0x7f076c004500 2021-11-12T05:47:36.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f07930b7700 1 -- 172.21.2.105:0/478386396 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f076c004500 msgr2=0x7f076c004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:36.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f07930b7700 1 --2- 172.21.2.105:0/478386396 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f076c004500 0x7f076c004980 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7f077400a000 tx=0x7f0774008040).stop 2021-11-12T05:47:36.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f0791654700 1 -- 172.21.2.105:0/478386396 reap_dead start 2021-11-12T05:47:36.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f07930b7700 1 -- 172.21.2.105:0/478386396 shutdown_connections 2021-11-12T05:47:36.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f07930b7700 1 -- 172.21.2.105:0/478386396 >> 172.21.2.105:0/478386396 conn(0x7f078c05c490 msgr2=0x7f078c0b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:36.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f07930b7700 1 -- 172.21.2.105:0/478386396 shutdown_connections 2021-11-12T05:47:36.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f07930b7700 1 -- 172.21.2.105:0/478386396 wait complete. 2021-11-12T05:47:36.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f07930b7700 1 Processor -- start 2021-11-12T05:47:36.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f07930b7700 1 -- start start 2021-11-12T05:47:36.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f07930b7700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f076c004500 0x7f078c1462e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:36.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f07930b7700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f078c147b60 0x7f078c0627a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:36.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f07930b7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f078c063ea0 0x7f078c064320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:36.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f07930b7700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078c0633c0 con 0x7f078c063ea0 2021-11-12T05:47:36.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f07930b7700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078c0b4200 con 0x7f076c004500 2021-11-12T05:47:36.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f07930b7700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f078c0b44a0 con 0x7f078c147b60 2021-11-12T05:47:36.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f0790e53700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f076c004500 0x7f078c1462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:36.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f078bfff700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f078c147b60 0x7f078c0627a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:36.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f0790e53700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f076c004500 0x7f078c1462e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3300/0 says I am v2:172.21.2.105:37478/0 (socket says 172.21.2.105:37478) 2021-11-12T05:47:36.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f0790e53700 1 -- 172.21.2.105:0/1323891012 learned_addr learned my addr 172.21.2.105:0/1323891012 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:36.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f0791654700 1 --2- 172.21.2.105:0/1323891012 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f078c063ea0 0x7f078c064320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:36.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f078bfff700 1 -- 172.21.2.105:0/1323891012 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f076c004500 msgr2=0x7f078c1462e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:36.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f078bfff700 1 --2- 172.21.2.105:0/1323891012 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f076c004500 0x7f078c1462e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:36.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f078bfff700 1 -- 172.21.2.105:0/1323891012 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f078c063ea0 msgr2=0x7f078c064320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:36.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f078bfff700 1 --2- 172.21.2.105:0/1323891012 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f078c063ea0 0x7f078c064320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:36.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f078bfff700 1 -- 172.21.2.105:0/1323891012 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f078c0b4740 con 0x7f078c147b60 2021-11-12T05:47:36.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f0790e53700 1 --2- 172.21.2.105:0/1323891012 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f076c004500 0x7f078c1462e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-12T05:47:36.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f0791654700 1 --2- 172.21.2.105:0/1323891012 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f078c063ea0 0x7f078c064320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-12T05:47:36.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f078bfff700 1 --2- 172.21.2.105:0/1323891012 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f078c147b60 0x7f078c0627a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f077400a000 tx=0x7f0774008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:36.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f0789ffb700 1 -- 172.21.2.105:0/1323891012 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0774012c50 con 0x7f078c147b60 2021-11-12T05:47:36.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f0789ffb700 1 -- 172.21.2.105:0/1323891012 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0774000e90 con 0x7f078c147b60 2021-11-12T05:47:36.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f0789ffb700 1 -- 172.21.2.105:0/1323891012 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0774013e60 con 0x7f078c147b60 2021-11-12T05:47:36.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f07930b7700 1 -- 172.21.2.105:0/1323891012 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f078c064810 con 0x7f078c147b60 2021-11-12T05:47:36.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.136+0000 7f07930b7700 1 -- 172.21.2.105:0/1323891012 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f078c159880 con 0x7f078c147b60 2021-11-12T05:47:36.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.140+0000 7f07930b7700 1 -- 172.21.2.105:0/1323891012 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f078c0b48d0 con 0x7f078c147b60 2021-11-12T05:47:36.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.140+0000 7f0789ffb700 1 -- 172.21.2.105:0/1323891012 <== mon.2 v2:172.21.2.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f077403d080 con 0x7f078c147b60 2021-11-12T05:47:36.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.140+0000 7f0789ffb700 1 --2- 172.21.2.105:0/1323891012 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0770053720 0x7f0770055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:36.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.140+0000 7f0789ffb700 1 -- 172.21.2.105:0/1323891012 <== mon.2 v2:172.21.2.115:3301/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f077406cd80 con 0x7f078c147b60 2021-11-12T05:47:36.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.140+0000 7f0790e53700 1 --2- 172.21.2.105:0/1323891012 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0770053720 0x7f0770055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:36.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.140+0000 7f0790e53700 1 --2- 172.21.2.105:0/1323891012 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0770053720 0x7f0770055be0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f077c00d000 tx=0x7f077c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:36.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.144+0000 7f0789ffb700 1 -- 172.21.2.105:0/1323891012 <== mon.2 v2:172.21.2.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0774043d30 con 0x7f078c147b60 2021-11-12T05:47:36.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.224+0000 7f07930b7700 1 -- 172.21.2.105:0/1323891012 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f078c057350 con 0x7f078c147b60 2021-11-12T05:47:36.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.228+0000 7f0789ffb700 1 -- 172.21.2.105:0/1323891012 <== mon.2 v2:172.21.2.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+10 (secure 0 0 0) 0x7f0774047350 con 0x7f078c147b60 2021-11-12T05:47:36.231 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:47:36.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.228+0000 7f07930b7700 1 -- 172.21.2.105:0/1323891012 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0770053720 msgr2=0x7f0770055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:36.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.228+0000 7f07930b7700 1 --2- 172.21.2.105:0/1323891012 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0770053720 0x7f0770055be0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f077c00d000 tx=0x7f077c009040).stop 2021-11-12T05:47:36.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.228+0000 7f07930b7700 1 -- 172.21.2.105:0/1323891012 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f078c147b60 msgr2=0x7f078c0627a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:36.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.228+0000 7f07930b7700 1 --2- 172.21.2.105:0/1323891012 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f078c147b60 0x7f078c0627a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f077400a000 tx=0x7f0774008040).stop 2021-11-12T05:47:36.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.228+0000 7f07930b7700 1 -- 172.21.2.105:0/1323891012 shutdown_connections 2021-11-12T05:47:36.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.228+0000 7f07930b7700 1 --2- 172.21.2.105:0/1323891012 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0770053720 0x7f0770055be0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:36.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.228+0000 7f07930b7700 1 --2- 172.21.2.105:0/1323891012 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f078c063ea0 0x7f078c064320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:36.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.228+0000 7f07930b7700 1 --2- 172.21.2.105:0/1323891012 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f078c147b60 0x7f078c0627a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:36.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.228+0000 7f07930b7700 1 --2- 172.21.2.105:0/1323891012 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f076c004500 0x7f078c1462e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:36.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.228+0000 7f07930b7700 1 -- 172.21.2.105:0/1323891012 >> 172.21.2.105:0/1323891012 conn(0x7f078c05c490 msgr2=0x7f078c143750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:36.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.228+0000 7f07930b7700 1 -- 172.21.2.105:0/1323891012 shutdown_connections 2021-11-12T05:47:36.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.228+0000 7f07930b7700 1 -- 172.21.2.105:0/1323891012 wait complete. 2021-11-12T05:47:36.239 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-12T05:47:36.240 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:47:36.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e9f81700 1 Processor -- start 2021-11-12T05:47:36.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e9f81700 1 -- start start 2021-11-12T05:47:36.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e9f81700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa9e40ad080 0x7fa9e40af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:36.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e9f81700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa9e40ac280 0x7fa9e40ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:36.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e9f81700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fa9e414abe0 0x7fa9e414b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:36.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e9f81700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e41488a0 con 0x7fa9e40ad080 2021-11-12T05:47:36.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e9f81700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e40ac7b0 con 0x7fa9e414abe0 2021-11-12T05:47:36.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e9f81700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e40ac9e0 con 0x7fa9e40ac280 2021-11-12T05:47:36.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e37fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa9e40ad080 0x7fa9e40af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:36.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e37fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa9e40ad080 0x7fa9e40af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48542/0 (socket says 172.21.2.105:48542) 2021-11-12T05:47:36.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e37fe700 1 -- 172.21.2.105:0/2279491725 learned_addr learned my addr 172.21.2.105:0/2279491725 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:36.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e37fe700 1 -- 172.21.2.105:0/2279491725 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa9e40ac280 msgr2=0x7fa9e40ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:36.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e37fe700 1 --2- 172.21.2.105:0/2279491725 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa9e40ac280 0x7fa9e40ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:36.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e37fe700 1 -- 172.21.2.105:0/2279491725 >> v2:172.21.2.115:3300/0 conn(0x7fa9e414abe0 msgr2=0x7fa9e414b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:36.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e37fe700 1 --2- 172.21.2.105:0/2279491725 >> v2:172.21.2.115:3300/0 conn(0x7fa9e414abe0 0x7fa9e414b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:36.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e37fe700 1 -- 172.21.2.105:0/2279491725 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e40b0b30 con 0x7fa9e40ad080 2021-11-12T05:47:36.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e37fe700 1 --2- 172.21.2.105:0/2279491725 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa9e40ad080 0x7fa9e40af730 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7fa9e40ac6a0 tx=0x7fa9d4006eb0).ready entity=mon.0 client_cookie=bad75532b2da8696 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:36.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e27fc700 1 -- 172.21.2.105:0/2279491725 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9d400d570 con 0x7fa9e40ad080 2021-11-12T05:47:36.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e27fc700 1 -- 172.21.2.105:0/2279491725 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d4000e90 con 0x7fa9e40ad080 2021-11-12T05:47:36.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e27fc700 1 -- 172.21.2.105:0/2279491725 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9d400d8c0 con 0x7fa9e40ad080 2021-11-12T05:47:36.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e9f81700 1 -- 172.21.2.105:0/2279491725 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa9e40ad080 msgr2=0x7fa9e40af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:36.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e9f81700 1 --2- 172.21.2.105:0/2279491725 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa9e40ad080 0x7fa9e40af730 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7fa9e40ac6a0 tx=0x7fa9d4006eb0).stop 2021-11-12T05:47:36.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e9f81700 1 -- 172.21.2.105:0/2279491725 shutdown_connections 2021-11-12T05:47:36.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e9f81700 1 --2- 172.21.2.105:0/2279491725 >> v2:172.21.2.115:3300/0 conn(0x7fa9e414abe0 0x7fa9e414b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:36.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e9f81700 1 --2- 172.21.2.105:0/2279491725 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa9e40ac280 0x7fa9e40ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:36.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e9f81700 1 --2- 172.21.2.105:0/2279491725 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa9e40ad080 0x7fa9e40af730 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:36.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e9f81700 1 -- 172.21.2.105:0/2279491725 >> 172.21.2.105:0/2279491725 conn(0x7fa9e40b5370 msgr2=0x7fa9e40b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:36.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e9f81700 1 -- 172.21.2.105:0/2279491725 shutdown_connections 2021-11-12T05:47:36.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e9f81700 1 -- 172.21.2.105:0/2279491725 wait complete. 2021-11-12T05:47:36.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e9f81700 1 Processor -- start 2021-11-12T05:47:36.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e9f81700 1 -- start start 2021-11-12T05:47:36.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e9f81700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa9e40ac280 0x7fa9e40b4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:36.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e9f81700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa9e40ad080 0x7fa9e4156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:36.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e9f81700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa9e414abe0 0x7fa9e40aad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:36.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e9f81700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e4063240 con 0x7fa9e414abe0 2021-11-12T05:47:36.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e9f81700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e41570e0 con 0x7fa9e40ad080 2021-11-12T05:47:36.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e9f81700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e40a9260 con 0x7fa9e40ac280 2021-11-12T05:47:36.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e3fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa9e414abe0 0x7fa9e40aad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:36.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e3fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa9e414abe0 0x7fa9e40aad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48552/0 (socket says 172.21.2.105:48552) 2021-11-12T05:47:36.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e3fff700 1 -- 172.21.2.105:0/91742901 learned_addr learned my addr 172.21.2.105:0/91742901 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:36.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e3fff700 1 -- 172.21.2.105:0/91742901 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa9e40ac280 msgr2=0x7fa9e40b4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:36.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e3fff700 1 --2- 172.21.2.105:0/91742901 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa9e40ac280 0x7fa9e40b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:36.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e3fff700 1 -- 172.21.2.105:0/91742901 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa9e40ad080 msgr2=0x7fa9e4156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:36.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e2ffd700 1 --2- 172.21.2.105:0/91742901 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa9e40ad080 0x7fa9e4156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:36.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e3fff700 1 --2- 172.21.2.105:0/91742901 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa9e40ad080 0x7fa9e4156bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:36.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e3fff700 1 -- 172.21.2.105:0/91742901 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d400b1e0 con 0x7fa9e414abe0 2021-11-12T05:47:36.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.288+0000 7fa9e3fff700 1 --2- 172.21.2.105:0/91742901 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa9e414abe0 0x7fa9e40aad60 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 rx=0x7fa9dc0032f0 tx=0x7fa9dc009120).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:36.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.292+0000 7fa9e0ff9700 1 -- 172.21.2.105:0/91742901 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9dc00f510 con 0x7fa9e414abe0 2021-11-12T05:47:36.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.292+0000 7fa9e0ff9700 1 -- 172.21.2.105:0/91742901 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9dc00f670 con 0x7fa9e414abe0 2021-11-12T05:47:36.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.292+0000 7fa9e9f81700 1 -- 172.21.2.105:0/91742901 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9e40a9500 con 0x7fa9e414abe0 2021-11-12T05:47:36.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.292+0000 7fa9e0ff9700 1 -- 172.21.2.105:0/91742901 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9dc00f7e0 con 0x7fa9e414abe0 2021-11-12T05:47:36.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.292+0000 7fa9e9f81700 1 -- 172.21.2.105:0/91742901 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9e40a7690 con 0x7fa9e414abe0 2021-11-12T05:47:36.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.292+0000 7fa9e9f81700 1 -- 172.21.2.105:0/91742901 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9e414b580 con 0x7fa9e414abe0 2021-11-12T05:47:36.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.292+0000 7fa9e0ff9700 1 -- 172.21.2.105:0/91742901 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa9dc00f070 con 0x7fa9e414abe0 2021-11-12T05:47:36.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.292+0000 7fa9e0ff9700 1 --2- 172.21.2.105:0/91742901 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa9c80536a0 0x7fa9c8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:36.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.292+0000 7fa9e0ff9700 1 -- 172.21.2.105:0/91742901 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6502+0+0 (secure 0 0 0) 0x7fa9dc06b660 con 0x7fa9e414abe0 2021-11-12T05:47:36.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.292+0000 7fa9e37fe700 1 --2- 172.21.2.105:0/91742901 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa9c80536a0 0x7fa9c8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:36.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.292+0000 7fa9e37fe700 1 --2- 172.21.2.105:0/91742901 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa9c80536a0 0x7fa9c8055b60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7fa9e40ac6a0 tx=0x7fa9d4015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:36.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.292+0000 7fa9e0ff9700 1 -- 172.21.2.105:0/91742901 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa9dc042610 con 0x7fa9e414abe0 2021-11-12T05:47:36.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.400+0000 7fa9e9f81700 1 -- 172.21.2.105:0/91742901 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9e4057350 con 0x7fa9e414abe0 2021-11-12T05:47:36.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.404+0000 7fa9e0ff9700 1 -- 172.21.2.105:0/91742901 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2138 (secure 0 0 0) 0x7fa9dc045c30 con 0x7fa9e414abe0 2021-11-12T05:47:36.408 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:36.408 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":38,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4960,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/157622236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":157622236},{"type":"v1","addr":"172.21.2.115:6833","nonce":157622236}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:47:30.387487+0000","modified":"2021-11-12T05:47:32.407052+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6693},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6693":{"gid":6693,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/1429326547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":1429326547},{"type":"v1","addr":"172.21.2.105:6835","nonce":1429326547}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-11-12T05:47:36.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.404+0000 7fa9e9f81700 1 -- 172.21.2.105:0/91742901 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa9c80536a0 msgr2=0x7fa9c8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:36.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.404+0000 7fa9e9f81700 1 --2- 172.21.2.105:0/91742901 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa9c80536a0 0x7fa9c8055b60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7fa9e40ac6a0 tx=0x7fa9d4015000).stop 2021-11-12T05:47:36.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.404+0000 7fa9e9f81700 1 -- 172.21.2.105:0/91742901 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa9e414abe0 msgr2=0x7fa9e40aad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:36.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.404+0000 7fa9e9f81700 1 --2- 172.21.2.105:0/91742901 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa9e414abe0 0x7fa9e40aad60 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 rx=0x7fa9dc0032f0 tx=0x7fa9dc009120).stop 2021-11-12T05:47:36.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.404+0000 7fa9e9f81700 1 -- 172.21.2.105:0/91742901 shutdown_connections 2021-11-12T05:47:36.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.404+0000 7fa9e9f81700 1 --2- 172.21.2.105:0/91742901 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa9c80536a0 0x7fa9c8055b60 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:36.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.404+0000 7fa9e9f81700 1 --2- 172.21.2.105:0/91742901 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa9e414abe0 0x7fa9e40aad60 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:36.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.404+0000 7fa9e9f81700 1 --2- 172.21.2.105:0/91742901 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa9e40ad080 0x7fa9e4156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:36.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.404+0000 7fa9e9f81700 1 --2- 172.21.2.105:0/91742901 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa9e40ac280 0x7fa9e40b4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:36.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.404+0000 7fa9e9f81700 1 -- 172.21.2.105:0/91742901 >> 172.21.2.105:0/91742901 conn(0x7fa9e40b5370 msgr2=0x7fa9e4143c60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:36.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.404+0000 7fa9e9f81700 1 -- 172.21.2.105:0/91742901 shutdown_connections 2021-11-12T05:47:36.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:36.404+0000 7fa9e9f81700 1 -- 172.21.2.105:0/91742901 wait complete. 2021-11-12T05:47:36.411 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 38 2021-11-12T05:47:36.615 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:47:30.387487+0000', 'modified': '2021-11-12T05:47:32.407052+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 84, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6693}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6693': {'gid': 6693, 'name': 'a', 'rank': 0, 'incarnation': 37, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/1429326547', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 1429326547}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 1429326547}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:47:36.616 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:47:36.617 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:47:36.681 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":6693,"want_state":"up:active","state":"up:active","rank_uptime":5.2635086170000003,"mdsmap_epoch":38,"osdmap_epoch":86,"osdmap_epoch_barrier":85,"uptime":9.4318479929999999} 2021-11-12T05:47:36.681 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 6693, "mdsmap_epoch": 38, "osdmap_epoch": 86, "osdmap_epoch_barrier": 85, "rank_uptime": 5.263508617, "state": "up:active", "uptime": 9.431847993, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:47:36.682 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-12T05:47:36.682 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-11-12T05:47:36.683 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@gibba038.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-11-12T05:47:36.686 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:36.687 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:47:36.698 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-12T05:47:36.750 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:47:36.751 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:47:36.756 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:47:36.757 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:47:36.758 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:36.759 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-12T05:47:36.763 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-12T05:47:36.764 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:47:36.809 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-12T05:47:36.819 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:47:36.820 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:47:36.825 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:47:36.825 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:47:36.826 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:36.827 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-12T05:47:36.849 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:2021-11-12T05:47:36.848+0000 7f377ca5d080 -1 init, newargv = 0x558757e7d700 newargc=9 2021-11-12T05:47:36.849 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:ceph-fuse[14247]: starting ceph client 2021-11-12T05:47:36.862 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:ceph-fuse[14247]: starting fuse 2021-11-12T05:47:37.954 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-12T05:47:37.966 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:47:37.966 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:47:38.015 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:47:38.016 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:47:38.017 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:38.018 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-12T05:47:38.023 INFO:teuthology.orchestra.run.gibba038.stdout:52 2021-11-12T05:47:38.023 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-12T05:47:38.024 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:38.024 DEBUG:teuthology.orchestra.run.gibba038:> sudo python3 -c ' 2021-11-12T05:47:38.025 DEBUG:teuthology.orchestra.run.gibba038:> import glob 2021-11-12T05:47:38.025 DEBUG:teuthology.orchestra.run.gibba038:> import re 2021-11-12T05:47:38.025 DEBUG:teuthology.orchestra.run.gibba038:> import os 2021-11-12T05:47:38.026 DEBUG:teuthology.orchestra.run.gibba038:> import subprocess 2021-11-12T05:47:38.026 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:47:38.027 DEBUG:teuthology.orchestra.run.gibba038:> def find_socket(client_name): 2021-11-12T05:47:38.027 DEBUG:teuthology.orchestra.run.gibba038:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-11-12T05:47:38.028 DEBUG:teuthology.orchestra.run.gibba038:> files = glob.glob(asok_path) 2021-11-12T05:47:38.028 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:47:38.028 DEBUG:teuthology.orchestra.run.gibba038:> # Given a non-glob path, it better be there 2021-11-12T05:47:38.029 DEBUG:teuthology.orchestra.run.gibba038:> if "*" not in asok_path: 2021-11-12T05:47:38.029 DEBUG:teuthology.orchestra.run.gibba038:> assert(len(files) == 1) 2021-11-12T05:47:38.030 DEBUG:teuthology.orchestra.run.gibba038:> return files[0] 2021-11-12T05:47:38.030 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:47:38.030 DEBUG:teuthology.orchestra.run.gibba038:> for f in files: 2021-11-12T05:47:38.031 DEBUG:teuthology.orchestra.run.gibba038:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-12T05:47:38.031 DEBUG:teuthology.orchestra.run.gibba038:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-12T05:47:38.032 DEBUG:teuthology.orchestra.run.gibba038:> return f 2021-11-12T05:47:38.032 DEBUG:teuthology.orchestra.run.gibba038:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-12T05:47:38.032 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:47:38.033 DEBUG:teuthology.orchestra.run.gibba038:> print(find_socket("client.1")) 2021-11-12T05:47:38.033 DEBUG:teuthology.orchestra.run.gibba038:> ' 2021-11-12T05:47:38.067 INFO:teuthology.orchestra.run.gibba038.stdout:/var/run/ceph/ceph-client.1.14247.asok 2021-11-12T05:47:38.070 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14247.asok 2021-11-12T05:47:38.070 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:38.071 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14247.asok status 2021-11-12T05:47:38.161 INFO:teuthology.orchestra.run.gibba038.stdout:{ 2021-11-12T05:47:38.161 INFO:teuthology.orchestra.run.gibba038.stdout: "metadata": { 2021-11-12T05:47:38.161 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_sha1": "a81ee2815de5acae59ead5b8c9137b6766fc8ea8", 2021-11-12T05:47:38.162 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_version": "ceph version 15.2.15-22-ga81ee281 (a81ee2815de5acae59ead5b8c9137b6766fc8ea8) octopus (stable)", 2021-11-12T05:47:38.162 INFO:teuthology.orchestra.run.gibba038.stdout: "entity_id": "1", 2021-11-12T05:47:38.162 INFO:teuthology.orchestra.run.gibba038.stdout: "hostname": "gibba038", 2021-11-12T05:47:38.162 INFO:teuthology.orchestra.run.gibba038.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-11-12T05:47:38.163 INFO:teuthology.orchestra.run.gibba038.stdout: "pid": "14247", 2021-11-12T05:47:38.163 INFO:teuthology.orchestra.run.gibba038.stdout: "root": "/" 2021-11-12T05:47:38.163 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:47:38.163 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_count": 0, 2021-11-12T05:47:38.163 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_pinned_count": 0, 2021-11-12T05:47:38.164 INFO:teuthology.orchestra.run.gibba038.stdout: "id": 5014, 2021-11-12T05:47:38.164 INFO:teuthology.orchestra.run.gibba038.stdout: "inst": { 2021-11-12T05:47:38.164 INFO:teuthology.orchestra.run.gibba038.stdout: "name": { 2021-11-12T05:47:38.164 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "client", 2021-11-12T05:47:38.164 INFO:teuthology.orchestra.run.gibba038.stdout: "num": 5014 2021-11-12T05:47:38.165 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:47:38.165 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-12T05:47:38.165 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-12T05:47:38.165 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-12T05:47:38.166 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 1951909538 2021-11-12T05:47:38.166 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-11-12T05:47:38.166 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:47:38.166 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-12T05:47:38.166 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-12T05:47:38.167 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-12T05:47:38.167 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 1951909538 2021-11-12T05:47:38.167 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:47:38.167 INFO:teuthology.orchestra.run.gibba038.stdout: "inst_str": "client.5014 172.21.2.138:0/1951909538", 2021-11-12T05:47:38.167 INFO:teuthology.orchestra.run.gibba038.stdout: "addr_str": "172.21.2.138:0/1951909538", 2021-11-12T05:47:38.168 INFO:teuthology.orchestra.run.gibba038.stdout: "inode_count": 1, 2021-11-12T05:47:38.168 INFO:teuthology.orchestra.run.gibba038.stdout: "mds_epoch": 38, 2021-11-12T05:47:38.168 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch": 86, 2021-11-12T05:47:38.168 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch_barrier": 0, 2021-11-12T05:47:38.168 INFO:teuthology.orchestra.run.gibba038.stdout: "blacklisted": false, 2021-11-12T05:47:38.169 INFO:teuthology.orchestra.run.gibba038.stdout: "fs_name": "cephfs" 2021-11-12T05:47:38.169 INFO:teuthology.orchestra.run.gibba038.stdout:} 2021-11-12T05:47:38.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:38.171 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:47:38.171 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:47:38.182 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-12T05:47:38.183 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-12T05:47:38.183 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:38.184 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:47:38.201 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:47:38.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.252+0000 7fe9d5a5b700 1 Processor -- start 2021-11-12T05:47:38.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.252+0000 7fe9d5a5b700 1 -- start start 2021-11-12T05:47:38.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.252+0000 7fe9d5a5b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe9d00ad080 0x7fe9d00af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:38.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.252+0000 7fe9d5a5b700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fe9d014b2f0 0x7fe9d00ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:38.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.252+0000 7fe9d5a5b700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9d00ac7b0 con 0x7fe9d00ac280 2021-11-12T05:47:38.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.252+0000 7fe9d5a5b700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d01488a0 con 0x7fe9d014b2f0 2021-11-12T05:47:38.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.252+0000 7fe9d5a5b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d00ac9e0 con 0x7fe9d00ad080 2021-11-12T05:47:38.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.252+0000 7fe9ce7fc700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fe9d00ac280 0x7fe9d014abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:58954/0 (socket says 172.21.2.105:58954) 2021-11-12T05:47:38.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.252+0000 7fe9ce7fc700 1 -- 172.21.2.105:0/986403803 learned_addr learned my addr 172.21.2.105:0/986403803 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:38.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.252+0000 7fe9cdffb700 1 -- 172.21.2.105:0/986403803 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1878018576 0 0) 0x7fe9d00ac7b0 con 0x7fe9d00ac280 2021-11-12T05:47:38.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.252+0000 7fe9cdffb700 1 -- 172.21.2.105:0/986403803 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9b0003260 con 0x7fe9d00ac280 2021-11-12T05:47:38.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.252+0000 7fe9ceffd700 1 --2- 172.21.2.105:0/986403803 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe9d00ad080 0x7fe9d00af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:38.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.252+0000 7fe9cf7fe700 1 --2- 172.21.2.105:0/986403803 >> v2:172.21.2.115:3300/0 conn(0x7fe9d014b2f0 0x7fe9d00ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:38.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9cdffb700 1 -- 172.21.2.105:0/986403803 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2044068970 0 0) 0x7fe9b0003260 con 0x7fe9d00ac280 2021-11-12T05:47:38.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9cdffb700 1 -- 172.21.2.105:0/986403803 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe9d00ad080 msgr2=0x7fe9d00af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:38.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9cdffb700 1 --2- 172.21.2.105:0/986403803 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe9d00ad080 0x7fe9d00af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:38.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9cdffb700 1 -- 172.21.2.105:0/986403803 >> v2:172.21.2.115:3300/0 conn(0x7fe9d014b2f0 msgr2=0x7fe9d00ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:38.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9cdffb700 1 --2- 172.21.2.105:0/986403803 >> v2:172.21.2.115:3300/0 conn(0x7fe9d014b2f0 0x7fe9d00ad460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:38.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9cdffb700 1 -- 172.21.2.105:0/986403803 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d00b0b30 con 0x7fe9d00ac280 2021-11-12T05:47:38.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9cdffb700 1 -- 172.21.2.105:0/986403803 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fe9b8001660 con 0x7fe9d00ac280 2021-11-12T05:47:38.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9cdffb700 1 -- 172.21.2.105:0/986403803 >> v1:172.21.2.105:6789/0 conn(0x7fe9d00ac280 legacy=0x7fe9d014abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:38.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9cdffb700 1 --2- 172.21.2.105:0/986403803 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9b00037d0 0x7fe9b0003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:38.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9cdffb700 1 --2- 172.21.2.105:0/986403803 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe9b0004500 0x7fe9b0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:38.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9cdffb700 1 --2- 172.21.2.105:0/986403803 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe9d00ad080 0x7fe9b0004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:38.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9cdffb700 1 -- 172.21.2.105:0/986403803 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d01488a0 con 0x7fe9b00037d0 2021-11-12T05:47:38.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9cdffb700 1 -- 172.21.2.105:0/986403803 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d00ac9e0 con 0x7fe9b0004500 2021-11-12T05:47:38.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9cdffb700 1 -- 172.21.2.105:0/986403803 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b000b7d0 con 0x7fe9d00ad080 2021-11-12T05:47:38.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9ceffd700 1 --2- 172.21.2.105:0/986403803 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9b00037d0 0x7fe9b0003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:38.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9cf7fe700 1 --2- 172.21.2.105:0/986403803 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe9d00ad080 0x7fe9b0004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:38.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9ceffd700 1 -- 172.21.2.105:0/986403803 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe9d00ad080 msgr2=0x7fe9b0004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:38.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9ceffd700 1 --2- 172.21.2.105:0/986403803 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe9d00ad080 0x7fe9b0004e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:38.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9ceffd700 1 -- 172.21.2.105:0/986403803 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe9b0004500 msgr2=0x7fe9b0004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:38.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9ceffd700 1 --2- 172.21.2.105:0/986403803 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe9b0004500 0x7fe9b0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:38.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9ceffd700 1 -- 172.21.2.105:0/986403803 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b0003260 con 0x7fe9b00037d0 2021-11-12T05:47:38.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9ceffd700 1 --2- 172.21.2.105:0/986403803 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9b00037d0 0x7fe9b0003bf0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7fe9c000c000 tx=0x7fe9c0006df0).ready entity=mon.0 client_cookie=51be9ccf2b589b48 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:38.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9cdffb700 1 -- 172.21.2.105:0/986403803 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9c000e830 con 0x7fe9b00037d0 2021-11-12T05:47:38.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9cdffb700 1 -- 172.21.2.105:0/986403803 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c000e990 con 0x7fe9b00037d0 2021-11-12T05:47:38.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9cdffb700 1 -- 172.21.2.105:0/986403803 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9c000ecf0 con 0x7fe9b00037d0 2021-11-12T05:47:38.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9d5a5b700 1 -- 172.21.2.105:0/986403803 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9b00037d0 msgr2=0x7fe9b0003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:38.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9d5a5b700 1 --2- 172.21.2.105:0/986403803 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9b00037d0 0x7fe9b0003bf0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7fe9c000c000 tx=0x7fe9c0006df0).stop 2021-11-12T05:47:38.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9cf7fe700 1 -- 172.21.2.105:0/986403803 reap_dead start 2021-11-12T05:47:38.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9d5a5b700 1 -- 172.21.2.105:0/986403803 shutdown_connections 2021-11-12T05:47:38.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9d5a5b700 1 -- 172.21.2.105:0/986403803 >> 172.21.2.105:0/986403803 conn(0x7fe9d00b5370 msgr2=0x7fe9d00b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:38.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9d5a5b700 1 -- 172.21.2.105:0/986403803 shutdown_connections 2021-11-12T05:47:38.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9d5a5b700 1 -- 172.21.2.105:0/986403803 wait complete. 2021-11-12T05:47:38.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9d5a5b700 1 Processor -- start 2021-11-12T05:47:38.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9d5a5b700 1 -- start start 2021-11-12T05:47:38.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9d5a5b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe9b00037d0 0x7fe9d0063eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:38.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9d5a5b700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe9d00ab3e0 0x7fe9d015a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:38.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9d5a5b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9d015a760 0x7fe9d015abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:38.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9d5a5b700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d00a9ae0 con 0x7fe9d015a760 2021-11-12T05:47:38.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9d5a5b700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d0062a30 con 0x7fe9d00ab3e0 2021-11-12T05:47:38.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9d5a5b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d01433e0 con 0x7fe9b00037d0 2021-11-12T05:47:38.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9cf7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9d015a760 0x7fe9d015abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:38.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9cf7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9d015a760 0x7fe9d015abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48572/0 (socket says 172.21.2.105:48572) 2021-11-12T05:47:38.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9cf7fe700 1 -- 172.21.2.105:0/2342869935 learned_addr learned my addr 172.21.2.105:0/2342869935 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:38.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9cf7fe700 1 -- 172.21.2.105:0/2342869935 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe9b00037d0 msgr2=0x7fe9d0063eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:38.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9cf7fe700 1 --2- 172.21.2.105:0/2342869935 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe9b00037d0 0x7fe9d0063eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:38.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9cf7fe700 1 -- 172.21.2.105:0/2342869935 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe9d00ab3e0 msgr2=0x7fe9d015a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:38.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9cf7fe700 1 --2- 172.21.2.105:0/2342869935 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe9d00ab3e0 0x7fe9d015a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:38.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9cf7fe700 1 -- 172.21.2.105:0/2342869935 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d015b0d0 con 0x7fe9d015a760 2021-11-12T05:47:38.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9cf7fe700 1 --2- 172.21.2.105:0/2342869935 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9d015a760 0x7fe9d015abe0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7fe9d00aae80 tx=0x7fe9c8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:38.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9c7fff700 1 -- 172.21.2.105:0/2342869935 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9c80135f0 con 0x7fe9d015a760 2021-11-12T05:47:38.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9c7fff700 1 -- 172.21.2.105:0/2342869935 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c800c070 con 0x7fe9d015a760 2021-11-12T05:47:38.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9d5a5b700 1 -- 172.21.2.105:0/2342869935 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d00a8c80 con 0x7fe9d015a760 2021-11-12T05:47:38.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9c7fff700 1 -- 172.21.2.105:0/2342869935 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9c8013940 con 0x7fe9d015a760 2021-11-12T05:47:38.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.256+0000 7fe9d5a5b700 1 -- 172.21.2.105:0/2342869935 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d00a9cd0 con 0x7fe9d015a760 2021-11-12T05:47:38.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.260+0000 7fe9d5a5b700 1 -- 172.21.2.105:0/2342869935 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9d00b1440 con 0x7fe9d015a760 2021-11-12T05:47:38.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.260+0000 7fe9c7fff700 1 -- 172.21.2.105:0/2342869935 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe9c8013aa0 con 0x7fe9d015a760 2021-11-12T05:47:38.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.260+0000 7fe9c7fff700 1 --2- 172.21.2.105:0/2342869935 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe9b4053610 0x7fe9b4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:38.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.260+0000 7fe9c7fff700 1 -- 172.21.2.105:0/2342869935 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6502+0+0 (secure 0 0 0) 0x7fe9c806bca0 con 0x7fe9d015a760 2021-11-12T05:47:38.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.260+0000 7fe9ceffd700 1 --2- 172.21.2.105:0/2342869935 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe9b4053610 0x7fe9b4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:38.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.260+0000 7fe9ceffd700 1 --2- 172.21.2.105:0/2342869935 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe9b4053610 0x7fe9b4055ad0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7fe9c000c000 tx=0x7fe9c0019000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:38.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.260+0000 7fe9c7fff700 1 -- 172.21.2.105:0/2342869935 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe9c8070070 con 0x7fe9d015a760 2021-11-12T05:47:38.374 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.368+0000 7fe9d5a5b700 1 -- 172.21.2.105:0/2342869935 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9d0057350 con 0x7fe9d015a760 2021-11-12T05:47:38.374 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.368+0000 7fe9c7fff700 1 -- 172.21.2.105:0/2342869935 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2138 (secure 0 0 0) 0x7fe9c8042c50 con 0x7fe9d015a760 2021-11-12T05:47:38.375 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:38.375 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":38,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4960,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/157622236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":157622236},{"type":"v1","addr":"172.21.2.115:6833","nonce":157622236}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:47:30.387487+0000","modified":"2021-11-12T05:47:32.407052+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6693},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6693":{"gid":6693,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/1429326547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":1429326547},{"type":"v1","addr":"172.21.2.105:6835","nonce":1429326547}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-11-12T05:47:38.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.372+0000 7fe9d5a5b700 1 -- 172.21.2.105:0/2342869935 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe9b4053610 msgr2=0x7fe9b4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:38.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.372+0000 7fe9d5a5b700 1 --2- 172.21.2.105:0/2342869935 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe9b4053610 0x7fe9b4055ad0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7fe9c000c000 tx=0x7fe9c0019000).stop 2021-11-12T05:47:38.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.372+0000 7fe9d5a5b700 1 -- 172.21.2.105:0/2342869935 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9d015a760 msgr2=0x7fe9d015abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:38.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.372+0000 7fe9d5a5b700 1 --2- 172.21.2.105:0/2342869935 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9d015a760 0x7fe9d015abe0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7fe9d00aae80 tx=0x7fe9c8008040).stop 2021-11-12T05:47:38.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.372+0000 7fe9d5a5b700 1 -- 172.21.2.105:0/2342869935 shutdown_connections 2021-11-12T05:47:38.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.372+0000 7fe9d5a5b700 1 --2- 172.21.2.105:0/2342869935 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe9b4053610 0x7fe9b4055ad0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:38.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.372+0000 7fe9d5a5b700 1 --2- 172.21.2.105:0/2342869935 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9d015a760 0x7fe9d015abe0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:38.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.372+0000 7fe9d5a5b700 1 --2- 172.21.2.105:0/2342869935 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe9d00ab3e0 0x7fe9d015a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:38.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.372+0000 7fe9d5a5b700 1 --2- 172.21.2.105:0/2342869935 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe9b00037d0 0x7fe9d0063eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:38.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.372+0000 7fe9d5a5b700 1 -- 172.21.2.105:0/2342869935 >> 172.21.2.105:0/2342869935 conn(0x7fe9d00b5370 msgr2=0x7fe9d0143ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:38.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.372+0000 7fe9d5a5b700 1 -- 172.21.2.105:0/2342869935 shutdown_connections 2021-11-12T05:47:38.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.372+0000 7fe9d5a5b700 1 -- 172.21.2.105:0/2342869935 wait complete. 2021-11-12T05:47:38.379 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 38 2021-11-12T05:47:38.382 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1 2021-11-12T05:47:38.439 INFO:teuthology.orchestra.run.gibba005.stdout:{"path":"/","ino":1,"rdev":0,"ctime":"2021-11-12T05:47:35.454875+0000","btime":"2021-11-12T05:47:31.413748+0000","mode":17407,"uid":0,"gid":0,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":4194304,"stripe_count":1,"object_size":4194304,"pool_id":16,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":0,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2021-11-12T05:47:31.413748+0000","atime":"0.000000","time_warp_seq":0,"change_attr":1,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"2021-11-12T05:47:35.454875+0000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"2021-11-12T05:47:31.413748+0000"},"version":3,"file_data_version":0,"xattr_version":1,"backtrace_version":3,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":2,"is_frozen":false,"is_freezing":false,"pins":{"request":1,"lock":3,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1,"authpin":1},"nref":9,"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":1,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"xlockdone","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":1,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{"gather_set":[],"state":"sync","is_leased":false,"num_rdlocks":1,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"nestlock":{},"flocklock":{},"policylock":{},"states":["auth","dirty","dirtyparent"],"client_caps":[{"client_id":5014,"pending":"pLsXsFs","issued":"pLsXsFs","wanted":"-","last_sent":2},{"client_id":6861,"pending":"pLsXsFs","issued":"pLsXsFs","wanted":"-","last_sent":2}],"loner":-1,"want_loner":-1,"mds_caps_wanted":[]} 2021-11-12T05:47:38.440 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "2021-11-12T05:47:31.413748+0000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "0.000000", "auth_pins": 2, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 1, "state": "xlockdone", "xlock_by": {} }, "backtrace_version": 3, "btime": "2021-11-12T05:47:31.413748+0000", "change_attr": 1, "client_caps": [ { "client_id": 5014, "issued": "pLsXsFs", "last_sent": 2, "pending": "pLsXsFs", "wanted": "-" }, { "client_id": 6861, "issued": "pLsXsFs", "last_sent": 2, "pending": "pLsXsFs", "wanted": "-" } ], "client_ranges": [], "ctime": "2021-11-12T05:47:35.454875+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 0, "ino": 1, "is_auth": true, "is_freezing": false, "is_frozen": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 4194304, "pool_id": 16, "pool_ns": "", "stripe_count": 1, "stripe_unit": 4194304 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 17407, "mtime": "2021-11-12T05:47:31.413748+0000", "nestlock": {}, "nlink": 1, "nref": 9, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/", "pins": { "authpin": 1, "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "lock": 3, "request": 1 }, "policylock": {}, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "2021-11-12T05:47:35.454875+0000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": { "gather_set": [], "is_leased": false, "num_rdlocks": 1, "num_wrlocks": 0, "num_xlocks": 0, "state": "sync", "xlock_by": {} }, "states": [ "auth", "dirty", "dirtyparent" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "uid": 0, "version": 3, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 1, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2021-11-12T05:47:38.441 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-12T05:47:38.441 DEBUG:teuthology.orchestra.run.gibba005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:47:38.449 DEBUG:teuthology.orchestra.run.gibba015:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:47:38.478 DEBUG:teuthology.orchestra.run.gibba016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:47:38.491 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:47:38.505 DEBUG:teuthology.orchestra.run.gibba044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:47:38.518 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-12T05:47:38.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:38.519 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:47:38.519 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:47:38.525 INFO:teuthology.orchestra.run.gibba016.stdout:fuseblk 2021-11-12T05:47:38.526 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-12T05:47:38.526 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba016.front.sepia.ceph.com... 2021-11-12T05:47:38.527 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-12T05:47:38.527 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:47:38.580 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[14780]: fuse finished with error 0 and tester_r 0 2021-11-12T05:47:38.581 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:38.581 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:47:38.582 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:47:38.586 INFO:teuthology.orchestra.run.gibba016.stdout:ext2/ext3 2021-11-12T05:47:38.586 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-12T05:47:38.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:47:38.697 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:47:38.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:38.744 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:47:38.744 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:47:38.756 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-12T05:47:38.757 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-12T05:47:38.757 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba038.front.sepia.ceph.com... 2021-11-12T05:47:38.758 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-12T05:47:38.758 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:47:38.812 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:ceph-fuse[14247]: fuse finished with error 0 and tester_r 0 2021-11-12T05:47:38.813 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:38.814 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:47:38.814 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:47:38.818 INFO:teuthology.orchestra.run.gibba038.stdout:ext2/ext3 2021-11-12T05:47:38.818 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-12T05:47:38.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:47:38.860 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:47:38.870 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:38.871 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:47:38.871 DEBUG:teuthology.orchestra.run.gibba044:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:47:38.880 INFO:teuthology.orchestra.run.gibba044.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-12T05:47:38.881 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:47:38.882 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-12T05:47:38.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:47:38.883 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:47:38.932 INFO:teuthology.orchestra.run.gibba044.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-12T05:47:38.933 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:47:38.934 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-12T05:47:38.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.984+0000 7f909098c700 1 Processor -- start 2021-11-12T05:47:38.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.984+0000 7f909098c700 1 -- start start 2021-11-12T05:47:38.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.984+0000 7f909098c700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f908c0af750 0x7f908c062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:38.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.984+0000 7f909098c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f908c130a80 0x7f908c1474d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:38.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.984+0000 7f909098c700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f908c0b0d50 con 0x7f908c0626b0 2021-11-12T05:47:38.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.984+0000 7f909098c700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f908c0ad380 con 0x7f908c0af750 2021-11-12T05:47:38.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.984+0000 7f909098c700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f908c0ae190 con 0x7f908c130a80 2021-11-12T05:47:38.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.984+0000 7f908a59c700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f908c0626b0 0x7f908c130370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:58972/0 (socket says 172.21.2.105:58972) 2021-11-12T05:47:38.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.984+0000 7f908a59c700 1 -- 172.21.2.105:0/513607452 learned_addr learned my addr 172.21.2.105:0/513607452 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:38.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.984+0000 7f908959a700 1 -- 172.21.2.105:0/513607452 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3510391351 0 0) 0x7f908c0b0d50 con 0x7f908c0626b0 2021-11-12T05:47:38.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.984+0000 7f908959a700 1 -- 172.21.2.105:0/513607452 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f906c003260 con 0x7f908c0626b0 2021-11-12T05:47:38.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f9089d9b700 1 --2- 172.21.2.105:0/513607452 >> v2:172.21.2.115:3300/0 conn(0x7f908c0af750 0x7f908c062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:38.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f908959a700 1 -- 172.21.2.105:0/513607452 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3252807392 0 0) 0x7f906c003260 con 0x7f908c0626b0 2021-11-12T05:47:38.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f908959a700 1 -- 172.21.2.105:0/513607452 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f908c130a80 msgr2=0x7f908c1474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:38.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f908959a700 1 --2- 172.21.2.105:0/513607452 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f908c130a80 0x7f908c1474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:38.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f908959a700 1 -- 172.21.2.105:0/513607452 >> v2:172.21.2.115:3300/0 conn(0x7f908c0af750 msgr2=0x7f908c062a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:38.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f908959a700 1 --2- 172.21.2.105:0/513607452 >> v2:172.21.2.115:3300/0 conn(0x7f908c0af750 0x7f908c062a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:38.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f908959a700 1 -- 172.21.2.105:0/513607452 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f908c1479c0 con 0x7f908c0626b0 2021-11-12T05:47:38.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f908959a700 1 -- 172.21.2.105:0/513607452 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f907c001680 con 0x7f908c0626b0 2021-11-12T05:47:38.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f908959a700 1 -- 172.21.2.105:0/513607452 >> v1:172.21.2.105:6789/0 conn(0x7f908c0626b0 legacy=0x7f908c130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:38.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f908959a700 1 --2- 172.21.2.105:0/513607452 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f906c0037d0 0x7f906c003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:38.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f908959a700 1 --2- 172.21.2.105:0/513607452 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f906c004500 0x7f906c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:38.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f908959a700 1 --2- 172.21.2.105:0/513607452 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f908c130a80 0x7f906c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:38.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f908959a700 1 -- 172.21.2.105:0/513607452 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908c0ad380 con 0x7f906c004500 2021-11-12T05:47:38.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f908959a700 1 -- 172.21.2.105:0/513607452 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908c0ae190 con 0x7f906c0037d0 2021-11-12T05:47:38.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f908959a700 1 -- 172.21.2.105:0/513607452 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f906c005330 con 0x7f908c130a80 2021-11-12T05:47:38.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f9089d9b700 1 --2- 172.21.2.105:0/513607452 >> v2:172.21.2.115:3300/0 conn(0x7f908c0af750 0x7f908c062a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:47:38.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f9089d9b700 1 --2- 172.21.2.105:0/513607452 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f906c004500 0x7f906c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:38.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f908a59c700 1 --2- 172.21.2.105:0/513607452 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f906c0037d0 0x7f906c003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:38.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f908ad9d700 1 --2- 172.21.2.105:0/513607452 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f908c130a80 0x7f906c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:39.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f9089d9b700 1 -- 172.21.2.105:0/513607452 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f908c130a80 msgr2=0x7f906c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:39.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f9089d9b700 1 --2- 172.21.2.105:0/513607452 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f908c130a80 0x7f906c00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:39.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f9089d9b700 1 -- 172.21.2.105:0/513607452 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f906c0037d0 msgr2=0x7f906c003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:39.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f9089d9b700 1 --2- 172.21.2.105:0/513607452 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f906c0037d0 0x7f906c003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:39.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f9089d9b700 1 -- 172.21.2.105:0/513607452 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f908c1479c0 con 0x7f906c004500 2021-11-12T05:47:39.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f9089d9b700 1 --2- 172.21.2.105:0/513607452 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f906c004500 0x7f906c004980 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7f9074007000 tx=0x7f9074008040).ready entity=mon.0 client_cookie=40b72d30f1142a7f server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:39.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f908959a700 1 -- 172.21.2.105:0/513607452 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9074011410 con 0x7f906c004500 2021-11-12T05:47:39.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f908959a700 1 -- 172.21.2.105:0/513607452 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9074011570 con 0x7f906c004500 2021-11-12T05:47:39.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f908959a700 1 -- 172.21.2.105:0/513607452 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90740118d0 con 0x7f906c004500 2021-11-12T05:47:39.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f909098c700 1 -- 172.21.2.105:0/513607452 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f906c004500 msgr2=0x7f906c004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:39.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f909098c700 1 --2- 172.21.2.105:0/513607452 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f906c004500 0x7f906c004980 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7f9074007000 tx=0x7f9074008040).stop 2021-11-12T05:47:39.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f908ad9d700 1 -- 172.21.2.105:0/513607452 reap_dead start 2021-11-12T05:47:39.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f909098c700 1 -- 172.21.2.105:0/513607452 shutdown_connections 2021-11-12T05:47:39.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f909098c700 1 -- 172.21.2.105:0/513607452 >> 172.21.2.105:0/513607452 conn(0x7f908c0b5320 msgr2=0x7f908c0b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:39.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f909098c700 1 -- 172.21.2.105:0/513607452 shutdown_connections 2021-11-12T05:47:39.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f909098c700 1 -- 172.21.2.105:0/513607452 wait complete. 2021-11-12T05:47:39.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f909098c700 1 Processor -- start 2021-11-12T05:47:39.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f909098c700 1 -- start start 2021-11-12T05:47:39.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f909098c700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f906c004500 0x7f908c14b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:39.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f909098c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f908c14a840 0x7f908c12b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:39.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f909098c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f908c149bd0 0x7f908c12ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:39.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f909098c700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908c064d00 con 0x7f908c14a840 2021-11-12T05:47:39.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f909098c700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908c064f30 con 0x7f906c004500 2021-11-12T05:47:39.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f909098c700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f908c12c6b0 con 0x7f908c149bd0 2021-11-12T05:47:39.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f9089d9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f908c14a840 0x7f908c12b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:39.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f9089d9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f908c14a840 0x7f908c12b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48590/0 (socket says 172.21.2.105:48590) 2021-11-12T05:47:39.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f9089d9b700 1 -- 172.21.2.105:0/1490733415 learned_addr learned my addr 172.21.2.105:0/1490733415 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:39.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f9089d9b700 1 -- 172.21.2.105:0/1490733415 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f908c149bd0 msgr2=0x7f908c12ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:39.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f9089d9b700 1 --2- 172.21.2.105:0/1490733415 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f908c149bd0 0x7f908c12ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:39.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f9089d9b700 1 -- 172.21.2.105:0/1490733415 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f906c004500 msgr2=0x7f908c14b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:39.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f9089d9b700 1 --2- 172.21.2.105:0/1490733415 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f906c004500 0x7f908c14b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:39.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.988+0000 7f9089d9b700 1 -- 172.21.2.105:0/1490733415 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f908c0652e0 con 0x7f908c14a840 2021-11-12T05:47:39.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.992+0000 7f9089d9b700 1 --2- 172.21.2.105:0/1490733415 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f908c14a840 0x7f908c12b580 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7f9074007000 tx=0x7f9074008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:39.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.992+0000 7f90837fe700 1 -- 172.21.2.105:0/1490733415 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9074006e90 con 0x7f908c14a840 2021-11-12T05:47:39.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.992+0000 7f90837fe700 1 -- 172.21.2.105:0/1490733415 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9074000e90 con 0x7f908c14a840 2021-11-12T05:47:39.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.992+0000 7f909098c700 1 -- 172.21.2.105:0/1490733415 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f908c149640 con 0x7f908c14a840 2021-11-12T05:47:39.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.992+0000 7f90837fe700 1 -- 172.21.2.105:0/1490733415 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90740235e0 con 0x7f908c14a840 2021-11-12T05:47:39.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.992+0000 7f909098c700 1 -- 172.21.2.105:0/1490733415 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f908c149940 con 0x7f908c14a840 2021-11-12T05:47:39.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.992+0000 7f909098c700 1 -- 172.21.2.105:0/1490733415 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f908c0650a0 con 0x7f908c14a840 2021-11-12T05:47:39.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.992+0000 7f90837fe700 1 -- 172.21.2.105:0/1490733415 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9074023740 con 0x7f908c14a840 2021-11-12T05:47:39.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.992+0000 7f90837fe700 1 --2- 172.21.2.105:0/1490733415 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9070053520 0x7f90700559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:39.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.992+0000 7f90837fe700 1 -- 172.21.2.105:0/1490733415 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f907406d010 con 0x7f908c14a840 2021-11-12T05:47:39.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.992+0000 7f908a59c700 1 --2- 172.21.2.105:0/1490733415 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9070053520 0x7f90700559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:39.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.992+0000 7f908a59c700 1 --2- 172.21.2.105:0/1490733415 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9070053520 0x7f90700559e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f907c00b000 tx=0x7f907c000fe0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:39.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:38.992+0000 7f90837fe700 1 -- 172.21.2.105:0/1490733415 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9074047880 con 0x7f908c14a840 2021-11-12T05:47:39.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.080+0000 7f909098c700 1 -- 172.21.2.105:0/1490733415 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f908c057350 con 0x7f908c14a840 2021-11-12T05:47:39.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.080+0000 7f90837fe700 1 -- 172.21.2.105:0/1490733415 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v86) v1 ==== 81+0+34194 (secure 0 0 0) 0x7f9074047470 con 0x7f908c14a840 2021-11-12T05:47:39.085 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:39.085 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:47:39.085 INFO:teuthology.orchestra.run.gibba005.stdout: "epoch": 86, 2021-11-12T05:47:39.086 INFO:teuthology.orchestra.run.gibba005.stdout: "fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", 2021-11-12T05:47:39.086 INFO:teuthology.orchestra.run.gibba005.stdout: "created": "2021-11-12T05:40:19.986390+0000", 2021-11-12T05:47:39.086 INFO:teuthology.orchestra.run.gibba005.stdout: "modified": "2021-11-12T05:47:32.407560+0000", 2021-11-12T05:47:39.086 INFO:teuthology.orchestra.run.gibba005.stdout: "last_up_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:47:39.087 INFO:teuthology.orchestra.run.gibba005.stdout: "last_in_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:47:39.087 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-12T05:47:39.087 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_num": 5799936, 2021-11-12T05:47:39.087 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_set": [ 2021-11-12T05:47:39.087 INFO:teuthology.orchestra.run.gibba005.stdout: "pglog_hardlimit", 2021-11-12T05:47:39.088 INFO:teuthology.orchestra.run.gibba005.stdout: "purged_snapdirs", 2021-11-12T05:47:39.088 INFO:teuthology.orchestra.run.gibba005.stdout: "recovery_deletes", 2021-11-12T05:47:39.088 INFO:teuthology.orchestra.run.gibba005.stdout: "sortbitwise" 2021-11-12T05:47:39.088 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:47:39.089 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_version": 5, 2021-11-12T05:47:39.089 INFO:teuthology.orchestra.run.gibba005.stdout: "full_ratio": 0.94999998807907104, 2021-11-12T05:47:39.089 INFO:teuthology.orchestra.run.gibba005.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-12T05:47:39.089 INFO:teuthology.orchestra.run.gibba005.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-12T05:47:39.090 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_snapshot": "", 2021-11-12T05:47:39.090 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_max": 16, 2021-11-12T05:47:39.090 INFO:teuthology.orchestra.run.gibba005.stdout: "max_osd": 8, 2021-11-12T05:47:39.091 INFO:teuthology.orchestra.run.gibba005.stdout: "require_min_compat_client": "jewel", 2021-11-12T05:47:39.091 INFO:teuthology.orchestra.run.gibba005.stdout: "min_compat_client": "jewel", 2021-11-12T05:47:39.091 INFO:teuthology.orchestra.run.gibba005.stdout: "require_osd_release": "octopus", 2021-11-12T05:47:39.091 INFO:teuthology.orchestra.run.gibba005.stdout: "pools": [ 2021-11-12T05:47:39.092 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.092 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 1, 2021-11-12T05:47:39.092 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "device_health_metrics", 2021-11-12T05:47:39.092 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:22.022116+0000", 2021-11-12T05:47:39.092 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:47:39.093 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:47:39.093 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:47:39.093 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:47:39.093 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:47:39.094 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:47:39.094 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:47:39.094 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:47:39.094 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 1, 2021-11-12T05:47:39.095 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 1, 2021-11-12T05:47:39.095 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 1, 2021-11-12T05:47:39.095 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 1, 2021-11-12T05:47:39.095 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 1, 2021-11-12T05:47:39.095 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:47:39.096 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:47:39.096 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:47:39.096 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:47:39.096 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:47:39.096 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:47:39.097 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:47:39.097 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.097 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "16", 2021-11-12T05:47:39.097 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:47:39.098 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:47:39.098 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:47:39.098 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:47:39.098 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:47:39.098 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:47:39.099 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:47:39.099 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:47:39.099 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:47:39.099 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:47:39.100 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:47:39.100 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:47:39.100 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:47:39.100 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:47:39.101 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:47:39.101 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:47:39.101 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:47:39.101 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:47:39.101 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:47:39.102 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:47:39.102 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:47:39.102 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:47:39.102 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:47:39.103 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:47:39.103 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:47:39.103 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:47:39.103 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.104 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:47:39.104 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:47:39.104 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:47:39.104 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:47:39.104 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:47:39.105 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:47:39.105 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:47:39.105 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:47:39.105 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:47:39.106 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:47:39.106 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:47:39.106 INFO:teuthology.orchestra.run.gibba005.stdout: "options": { 2021-11-12T05:47:39.106 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_min": 1 2021-11-12T05:47:39.107 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.107 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:47:39.107 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr_devicehealth": {} 2021-11-12T05:47:39.107 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.107 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.108 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.108 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 2, 2021-11-12T05:47:39.108 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "rbd", 2021-11-12T05:47:39.108 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:29.953617+0000", 2021-11-12T05:47:39.108 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:47:39.109 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:47:39.109 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:47:39.109 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:47:39.109 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:47:39.110 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:47:39.110 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:47:39.110 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:47:39.110 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:47:39.110 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:47:39.111 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:47:39.111 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:47:39.111 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:47:39.111 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:47:39.112 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:47:39.112 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:47:39.112 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:47:39.112 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:47:39.112 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:47:39.113 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:47:39.113 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.113 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "19", 2021-11-12T05:47:39.113 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:47:39.114 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:47:39.114 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:47:39.114 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:47:39.114 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:47:39.114 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:47:39.115 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:47:39.115 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:47:39.115 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:47:39.115 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:47:39.116 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:47:39.116 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:47:39.116 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:47:39.116 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:47:39.117 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:47:39.118 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:47:39.118 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:47:39.118 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:47:39.118 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:47:39.118 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:47:39.119 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:47:39.119 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:47:39.119 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:47:39.119 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:47:39.120 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:47:39.120 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:47:39.120 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.120 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:47:39.121 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:47:39.121 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:47:39.121 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:47:39.121 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:47:39.121 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:47:39.122 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:47:39.122 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:47:39.122 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:47:39.122 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:47:39.123 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:47:39.123 INFO:teuthology.orchestra.run.gibba005.stdout: "options": {}, 2021-11-12T05:47:39.123 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:47:39.123 INFO:teuthology.orchestra.run.gibba005.stdout: "rbd": {} 2021-11-12T05:47:39.124 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.124 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.124 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.124 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 15, 2021-11-12T05:47:39.124 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "cephfs_metadata", 2021-11-12T05:47:39.125 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:47:29.162904+0000", 2021-11-12T05:47:39.125 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:47:39.125 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:47:39.125 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:47:39.125 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:47:39.126 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:47:39.126 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:47:39.126 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:47:39.126 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:47:39.127 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:47:39.127 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:47:39.127 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:47:39.127 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:47:39.128 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:47:39.128 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:47:39.128 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:47:39.128 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:47:39.128 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:47:39.129 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:47:39.129 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:47:39.129 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:47:39.129 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.129 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "84", 2021-11-12T05:47:39.130 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:47:39.130 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:47:39.130 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:47:39.130 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:47:39.131 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:47:39.131 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:47:39.131 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:47:39.131 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:47:39.131 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:47:39.132 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:47:39.132 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:47:39.132 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:47:39.132 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:47:39.132 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:47:39.133 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:47:39.133 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:47:39.133 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:47:39.133 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:47:39.133 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:47:39.134 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:47:39.134 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:47:39.134 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:47:39.134 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:47:39.134 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:47:39.135 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:47:39.135 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:47:39.135 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.135 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:47:39.136 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:47:39.136 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:47:39.136 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:47:39.136 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:47:39.136 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:47:39.137 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:47:39.137 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:47:39.137 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:47:39.137 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:47:39.138 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:47:39.138 INFO:teuthology.orchestra.run.gibba005.stdout: "options": { 2021-11-12T05:47:39.138 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_bias": 4, 2021-11-12T05:47:39.138 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_min": 16, 2021-11-12T05:47:39.138 INFO:teuthology.orchestra.run.gibba005.stdout: "recovery_priority": 5 2021-11-12T05:47:39.139 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.139 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:47:39.139 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs": { 2021-11-12T05:47:39.139 INFO:teuthology.orchestra.run.gibba005.stdout: "metadata": "cephfs" 2021-11-12T05:47:39.140 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.140 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.140 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.140 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.140 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 16, 2021-11-12T05:47:39.141 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "cephfs_data", 2021-11-12T05:47:39.141 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:47:29.359218+0000", 2021-11-12T05:47:39.141 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:47:39.141 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:47:39.142 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:47:39.142 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:47:39.142 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:47:39.142 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:47:39.142 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:47:39.143 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:47:39.143 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:47:39.143 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:47:39.143 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:47:39.144 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:47:39.144 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:47:39.144 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:47:39.144 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:47:39.144 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:47:39.145 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:47:39.145 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:47:39.145 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:47:39.145 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:47:39.146 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.146 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "86", 2021-11-12T05:47:39.146 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:47:39.146 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:47:39.147 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:47:39.147 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:47:39.147 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:47:39.147 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:47:39.148 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:47:39.148 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:47:39.148 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:47:39.148 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:47:39.148 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:47:39.149 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:47:39.149 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:47:39.149 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:47:39.149 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:47:39.149 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:47:39.150 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:47:39.150 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:47:39.150 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:47:39.150 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:47:39.150 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:47:39.151 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:47:39.151 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:47:39.151 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:47:39.151 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:47:39.152 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:47:39.152 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.152 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:47:39.152 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:47:39.152 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:47:39.153 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:47:39.153 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:47:39.153 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:47:39.153 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:47:39.154 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:47:39.154 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:47:39.156 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:47:39.157 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:47:39.157 INFO:teuthology.orchestra.run.gibba005.stdout: "options": {}, 2021-11-12T05:47:39.157 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:47:39.157 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs": { 2021-11-12T05:47:39.157 INFO:teuthology.orchestra.run.gibba005.stdout: "data": "cephfs" 2021-11-12T05:47:39.158 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.158 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.158 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.158 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:47:39.159 INFO:teuthology.orchestra.run.gibba005.stdout: "osds": [ 2021-11-12T05:47:39.159 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.159 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:47:39.159 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "ee8e30a0-4819-4475-80ec-dd3ee7d01322", 2021-11-12T05:47:39.160 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:39.160 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:39.160 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:39.160 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:39.161 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:39.161 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:39.161 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:39.161 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 82, 2021-11-12T05:47:39.162 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:39.162 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:39.162 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:39.162 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:39.162 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.163 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:39.163 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6802", 2021-11-12T05:47:39.163 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:39.163 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.164 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.164 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:39.164 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6803", 2021-11-12T05:47:39.164 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:39.165 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.165 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.165 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.165 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:39.165 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:39.166 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.166 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:39.166 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6804", 2021-11-12T05:47:39.166 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:39.166 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.167 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.167 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:39.167 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6805", 2021-11-12T05:47:39.167 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:39.168 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.168 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.168 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.168 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:39.168 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:39.169 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.169 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:39.169 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6808", 2021-11-12T05:47:39.169 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:39.169 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.170 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.170 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:39.170 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6809", 2021-11-12T05:47:39.170 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:39.171 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.171 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.171 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.171 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:39.171 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:39.172 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.172 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:39.172 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6806", 2021-11-12T05:47:39.172 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:39.173 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.173 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.173 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:39.173 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6807", 2021-11-12T05:47:39.173 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:39.174 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.174 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.174 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.174 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6803/14874", 2021-11-12T05:47:39.174 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6805/14874", 2021-11-12T05:47:39.175 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6809/14874", 2021-11-12T05:47:39.175 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6807/14874", 2021-11-12T05:47:39.175 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:39.175 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:39.176 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:39.176 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.176 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.176 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.176 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:47:39.177 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "b1bb06c3-26d0-4d92-82f8-b3e882242785", 2021-11-12T05:47:39.177 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:39.177 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:39.177 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:39.177 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:39.178 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:39.178 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:39.178 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:39.178 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 81, 2021-11-12T05:47:39.179 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:39.179 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:39.179 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:39.179 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:39.179 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.180 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:39.180 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6810", 2021-11-12T05:47:39.180 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:39.180 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.181 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.181 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:39.181 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6811", 2021-11-12T05:47:39.181 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:39.181 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.182 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.182 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.182 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:39.182 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:39.183 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.183 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:39.183 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6812", 2021-11-12T05:47:39.183 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:39.183 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.184 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.184 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:39.184 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6813", 2021-11-12T05:47:39.184 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:39.185 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.185 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.185 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.185 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:39.185 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:39.186 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.186 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:39.186 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6816", 2021-11-12T05:47:39.186 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:39.186 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.187 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.187 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:39.187 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6817", 2021-11-12T05:47:39.187 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:39.187 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.188 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.188 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.188 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:39.188 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:39.189 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.189 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:39.189 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6814", 2021-11-12T05:47:39.189 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:39.189 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.190 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.190 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:39.190 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6815", 2021-11-12T05:47:39.190 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:39.190 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.191 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.191 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.191 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6811/14875", 2021-11-12T05:47:39.191 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6813/14875", 2021-11-12T05:47:39.191 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6817/14875", 2021-11-12T05:47:39.192 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6815/14875", 2021-11-12T05:47:39.192 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:39.192 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:39.192 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:39.193 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.193 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.193 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.193 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:47:39.193 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "837b2c60-c335-4382-9f47-d86543a14022", 2021-11-12T05:47:39.194 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:39.194 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:39.194 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:39.194 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:39.194 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:39.195 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:39.195 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:39.195 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 82, 2021-11-12T05:47:39.195 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:39.195 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:39.196 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:39.196 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:39.196 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.196 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:39.197 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6818", 2021-11-12T05:47:39.197 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:39.197 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.197 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.197 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:39.198 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6819", 2021-11-12T05:47:39.198 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:39.198 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.198 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.198 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.199 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:39.199 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:39.199 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.199 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:39.199 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6820", 2021-11-12T05:47:39.200 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:39.200 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.200 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.200 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:39.201 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6821", 2021-11-12T05:47:39.201 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:39.201 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.201 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.201 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.202 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:39.202 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:39.202 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.202 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:39.203 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6824", 2021-11-12T05:47:39.203 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:39.203 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.203 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.203 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:39.204 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6825", 2021-11-12T05:47:39.204 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:39.204 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.204 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.204 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.205 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:39.205 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:39.205 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.205 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:39.206 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6822", 2021-11-12T05:47:39.206 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:39.206 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.206 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.206 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:39.207 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6823", 2021-11-12T05:47:39.207 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:39.207 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.207 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.208 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.208 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6819/14905", 2021-11-12T05:47:39.208 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6821/14905", 2021-11-12T05:47:39.208 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6825/14905", 2021-11-12T05:47:39.208 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6823/14905", 2021-11-12T05:47:39.209 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:39.209 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:39.209 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:39.209 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.209 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.210 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.210 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:47:39.210 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "eb2b737b-dda6-444b-a306-f33cbbd51f70", 2021-11-12T05:47:39.210 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:39.211 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:39.211 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:39.211 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:39.211 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:39.211 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:39.212 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:39.212 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 83, 2021-11-12T05:47:39.212 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:39.212 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:39.212 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:39.213 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:39.213 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.213 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:39.213 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6826", 2021-11-12T05:47:39.213 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:39.214 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.214 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.214 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:39.214 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6827", 2021-11-12T05:47:39.215 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:39.215 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.215 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.215 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.215 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:39.216 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:39.216 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.216 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:39.216 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6828", 2021-11-12T05:47:39.216 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:39.217 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.217 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.217 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:39.217 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6829", 2021-11-12T05:47:39.217 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:39.218 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.218 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.218 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.218 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:39.219 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:39.219 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.219 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:39.219 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6832", 2021-11-12T05:47:39.219 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:39.220 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.220 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.220 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:39.220 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6833", 2021-11-12T05:47:39.221 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:39.221 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.221 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.221 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.221 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:39.222 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:39.222 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.222 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:39.222 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6830", 2021-11-12T05:47:39.223 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:39.223 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.223 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.223 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:39.223 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6831", 2021-11-12T05:47:39.224 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:39.224 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.224 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.224 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.224 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6827/14876", 2021-11-12T05:47:39.225 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6829/14876", 2021-11-12T05:47:39.225 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6833/14876", 2021-11-12T05:47:39.225 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6831/14876", 2021-11-12T05:47:39.225 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:39.226 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:39.226 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:39.226 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.226 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.226 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.227 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:47:39.227 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "721529a1-c047-486a-a7ca-ddc15d80cdde", 2021-11-12T05:47:39.227 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:39.227 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:39.227 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:39.228 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:39.228 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:39.228 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:39.228 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:39.229 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 82, 2021-11-12T05:47:39.229 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:39.229 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:39.229 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:39.229 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:39.230 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.230 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:39.230 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6800", 2021-11-12T05:47:39.230 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:39.231 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.231 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.231 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:39.231 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6801", 2021-11-12T05:47:39.231 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:39.232 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.232 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.232 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.232 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:39.232 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:39.233 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.233 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:39.233 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6802", 2021-11-12T05:47:39.233 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:39.234 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.234 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.234 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:39.234 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6803", 2021-11-12T05:47:39.234 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:39.235 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.235 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.235 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.235 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:39.236 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:39.236 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.236 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:39.236 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6806", 2021-11-12T05:47:39.236 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:39.237 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.237 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.237 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:39.237 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6807", 2021-11-12T05:47:39.237 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:39.238 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.238 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.238 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.238 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:39.238 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:39.239 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.239 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:39.239 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6804", 2021-11-12T05:47:39.239 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:39.240 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.240 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.240 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:39.240 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6805", 2021-11-12T05:47:39.240 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:39.241 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.241 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.241 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.241 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6801/15096", 2021-11-12T05:47:39.242 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6803/15096", 2021-11-12T05:47:39.242 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6807/15096", 2021-11-12T05:47:39.242 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6805/15096", 2021-11-12T05:47:39.242 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:39.243 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:39.243 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:39.243 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.243 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.243 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.244 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:47:39.244 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "68b72ab2-fa82-4b5c-bf33-528f002e4950", 2021-11-12T05:47:39.244 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:39.244 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:39.245 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:39.245 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:39.245 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:39.245 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:39.246 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:39.246 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 82, 2021-11-12T05:47:39.246 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:39.246 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:39.247 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:39.247 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:39.247 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.247 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:39.247 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6808", 2021-11-12T05:47:39.248 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:39.248 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.248 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.248 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:39.248 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6809", 2021-11-12T05:47:39.249 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:39.249 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.249 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.249 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.250 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:39.250 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:39.250 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.250 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:39.250 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6810", 2021-11-12T05:47:39.251 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:39.251 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.251 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.251 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:39.251 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6811", 2021-11-12T05:47:39.252 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:39.252 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.252 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.252 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.253 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:39.253 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:39.253 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.253 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:39.254 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6814", 2021-11-12T05:47:39.254 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:39.254 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.254 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.255 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:39.255 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6815", 2021-11-12T05:47:39.255 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:39.255 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.255 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.256 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.256 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:39.256 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:39.256 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.256 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:39.257 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6812", 2021-11-12T05:47:39.257 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:39.257 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.257 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.257 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:39.258 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6813", 2021-11-12T05:47:39.258 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:39.258 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.258 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.259 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.259 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6809/15097", 2021-11-12T05:47:39.259 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6811/15097", 2021-11-12T05:47:39.259 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6815/15097", 2021-11-12T05:47:39.259 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6813/15097", 2021-11-12T05:47:39.260 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:39.260 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:39.260 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:39.260 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.261 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.261 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.261 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:47:39.261 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "a2c83b5d-8d37-4d30-ac04-30d89a76e485", 2021-11-12T05:47:39.261 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:39.262 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:39.262 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:39.262 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:39.262 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:39.262 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:39.263 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:39.263 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 82, 2021-11-12T05:47:39.263 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:39.263 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:39.264 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:39.264 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:39.264 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.264 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:39.264 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6816", 2021-11-12T05:47:39.265 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:39.265 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.265 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.265 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:39.265 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6817", 2021-11-12T05:47:39.266 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:39.266 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.266 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.266 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.267 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:39.267 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:39.267 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.267 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:39.267 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6818", 2021-11-12T05:47:39.268 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:39.268 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.268 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.268 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:39.269 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6819", 2021-11-12T05:47:39.269 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:39.269 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.269 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.270 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.270 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:39.270 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:39.270 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.271 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:39.271 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6822", 2021-11-12T05:47:39.271 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:39.271 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.271 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.272 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:39.272 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6823", 2021-11-12T05:47:39.272 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:39.272 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.273 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.273 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.273 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:39.273 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:39.273 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.274 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:39.274 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6820", 2021-11-12T05:47:39.274 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:39.274 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.274 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.275 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:39.275 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6821", 2021-11-12T05:47:39.275 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:39.275 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.275 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.276 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.276 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6817/15098", 2021-11-12T05:47:39.276 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6819/15098", 2021-11-12T05:47:39.276 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6823/15098", 2021-11-12T05:47:39.277 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6821/15098", 2021-11-12T05:47:39.277 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:39.277 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:39.277 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:39.278 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.278 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.278 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.278 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:47:39.278 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "786ce966-d0fb-4181-aed4-c26e3ef61c43", 2021-11-12T05:47:39.279 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:39.279 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:39.279 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:39.279 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:39.280 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:39.280 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:39.280 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:39.280 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 71, 2021-11-12T05:47:39.280 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:39.281 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:39.281 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:39.281 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:39.281 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.281 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:39.282 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6824", 2021-11-12T05:47:39.282 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:39.282 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.282 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.282 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:39.283 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6825", 2021-11-12T05:47:39.283 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:39.283 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.283 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.284 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.284 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:39.284 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:39.284 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.284 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:39.285 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6826", 2021-11-12T05:47:39.285 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:39.285 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.285 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.285 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:39.286 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6827", 2021-11-12T05:47:39.286 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:39.286 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.286 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.287 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.287 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:39.287 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:39.287 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.287 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:39.288 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6830", 2021-11-12T05:47:39.288 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:39.288 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.288 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.289 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:39.289 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6831", 2021-11-12T05:47:39.289 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:39.289 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.289 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.290 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.290 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:39.290 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:39.290 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.290 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:39.291 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6828", 2021-11-12T05:47:39.291 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:39.291 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.291 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.292 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:39.292 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6829", 2021-11-12T05:47:39.292 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:39.292 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.293 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.293 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.293 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6825/15099", 2021-11-12T05:47:39.293 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6827/15099", 2021-11-12T05:47:39.293 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6831/15099", 2021-11-12T05:47:39.294 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6829/15099", 2021-11-12T05:47:39.294 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:39.294 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:39.294 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:39.295 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:39.295 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.295 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:47:39.295 INFO:teuthology.orchestra.run.gibba005.stdout: "osd_xinfo": [ 2021-11-12T05:47:39.296 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.296 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:47:39.296 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:39.296 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:39.296 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:39.297 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:39.297 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:39.297 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.615112+0000", 2021-11-12T05:47:39.297 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:39.297 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.298 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.298 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:47:39.298 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:39.298 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:39.299 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:39.299 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:39.299 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:39.299 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.665935+0000", 2021-11-12T05:47:39.299 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:39.300 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.300 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.300 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:47:39.300 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:39.301 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:39.301 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:39.301 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:39.301 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:39.301 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.715877+0000", 2021-11-12T05:47:39.302 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:39.302 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.302 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.302 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:47:39.303 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:39.303 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:39.303 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:39.303 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:39.303 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:39.304 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.489234+0000", 2021-11-12T05:47:39.304 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:39.304 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.304 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.305 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:47:39.305 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:39.305 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:39.305 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:39.305 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:39.306 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:39.306 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.413776+0000", 2021-11-12T05:47:39.306 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:39.306 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.306 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.307 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:47:39.307 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:39.307 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:39.307 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:39.308 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:39.308 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:39.308 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.507960+0000", 2021-11-12T05:47:39.308 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:39.308 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.309 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.309 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:47:39.309 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:39.309 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:39.310 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:39.310 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:39.310 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:39.310 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.635696+0000", 2021-11-12T05:47:39.311 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:39.311 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.311 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:39.311 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:47:39.312 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:39.312 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:39.312 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:39.312 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:39.312 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:39.313 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.746949+0000", 2021-11-12T05:47:39.313 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:39.313 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.313 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:47:39.313 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap": [], 2021-11-12T05:47:39.314 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap_items": [], 2021-11-12T05:47:39.314 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_temp": [], 2021-11-12T05:47:39.314 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_temp": [], 2021-11-12T05:47:39.314 INFO:teuthology.orchestra.run.gibba005.stdout: "blacklist": { 2021-11-12T05:47:39.315 INFO:teuthology.orchestra.run.gibba005.stdout: "172.21.2.105:6835/1338677059": "2021-11-13T05:47:31.284551+0000", 2021-11-12T05:47:39.315 INFO:teuthology.orchestra.run.gibba005.stdout: "172.21.2.105:6834/1338677059": "2021-11-13T05:47:31.284551+0000" 2021-11-12T05:47:39.315 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.315 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profiles": { 2021-11-12T05:47:39.315 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs_data": { 2021-11-12T05:47:39.316 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-device-class": "", 2021-11-12T05:47:39.316 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:47:39.316 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-root": "default", 2021-11-12T05:47:39.316 INFO:teuthology.orchestra.run.gibba005.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-12T05:47:39.317 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:47:39.317 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "2", 2021-11-12T05:47:39.317 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:47:39.317 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:47:39.317 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van", 2021-11-12T05:47:39.318 INFO:teuthology.orchestra.run.gibba005.stdout: "w": "8" 2021-11-12T05:47:39.318 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.318 INFO:teuthology.orchestra.run.gibba005.stdout: "default": { 2021-11-12T05:47:39.318 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:47:39.318 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:47:39.319 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "1", 2021-11-12T05:47:39.319 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:47:39.319 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:47:39.319 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van" 2021-11-12T05:47:39.320 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:39.320 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:39.320 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps_queue": [], 2021-11-12T05:47:39.320 INFO:teuthology.orchestra.run.gibba005.stdout: "new_removed_snaps": [], 2021-11-12T05:47:39.320 INFO:teuthology.orchestra.run.gibba005.stdout: "new_purged_snaps": [], 2021-11-12T05:47:39.321 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_node_flags": {}, 2021-11-12T05:47:39.321 INFO:teuthology.orchestra.run.gibba005.stdout: "device_class_flags": {} 2021-11-12T05:47:39.321 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:47:39.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.080+0000 7f909098c700 1 -- 172.21.2.105:0/1490733415 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9070053520 msgr2=0x7f90700559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:39.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.080+0000 7f909098c700 1 --2- 172.21.2.105:0/1490733415 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9070053520 0x7f90700559e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f907c00b000 tx=0x7f907c000fe0).stop 2021-11-12T05:47:39.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.080+0000 7f909098c700 1 -- 172.21.2.105:0/1490733415 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f908c14a840 msgr2=0x7f908c12b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:39.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.080+0000 7f909098c700 1 --2- 172.21.2.105:0/1490733415 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f908c14a840 0x7f908c12b580 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7f9074007000 tx=0x7f9074008040).stop 2021-11-12T05:47:39.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.080+0000 7f909098c700 1 -- 172.21.2.105:0/1490733415 shutdown_connections 2021-11-12T05:47:39.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.080+0000 7f909098c700 1 --2- 172.21.2.105:0/1490733415 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9070053520 0x7f90700559e0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:39.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.080+0000 7f909098c700 1 --2- 172.21.2.105:0/1490733415 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f908c149bd0 0x7f908c12ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:39.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.080+0000 7f909098c700 1 --2- 172.21.2.105:0/1490733415 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f908c14a840 0x7f908c12b580 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:39.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.080+0000 7f909098c700 1 --2- 172.21.2.105:0/1490733415 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f906c004500 0x7f908c14b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:39.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.080+0000 7f909098c700 1 -- 172.21.2.105:0/1490733415 >> 172.21.2.105:0/1490733415 conn(0x7f908c0b5320 msgr2=0x7f908c0b4bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:39.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.080+0000 7f909098c700 1 -- 172.21.2.105:0/1490733415 shutdown_connections 2021-11-12T05:47:39.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.080+0000 7f909098c700 1 -- 172.21.2.105:0/1490733415 wait complete. 2021-11-12T05:47:39.326 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:47:39.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.376+0000 7f10cec46700 1 Processor -- start 2021-11-12T05:47:39.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.376+0000 7f10cec46700 1 -- start start 2021-11-12T05:47:39.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.376+0000 7f10cec46700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f10c8141290 0x7f10c80b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:39.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.376+0000 7f10cec46700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10c81416b0 con 0x7f10c80adc70 2021-11-12T05:47:39.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.376+0000 7f10cec46700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10c80b2f40 con 0x7f10c8060100 2021-11-12T05:47:39.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.376+0000 7f10cec46700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c8147180 con 0x7f10c8141290 2021-11-12T05:47:39.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.376+0000 7f10cd443700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f10c80adc70 0x7f10c814a7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:58992/0 (socket says 172.21.2.105:58992) 2021-11-12T05:47:39.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.376+0000 7f10cd443700 1 -- 172.21.2.105:0/2269636501 learned_addr learned my addr 172.21.2.105:0/2269636501 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:39.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.376+0000 7f10ccc42700 1 -- 172.21.2.105:0/2269636501 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 93923890 0 0) 0x7f10c81416b0 con 0x7f10c80adc70 2021-11-12T05:47:39.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.376+0000 7f10ccc42700 1 -- 172.21.2.105:0/2269636501 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10b0003260 con 0x7f10c80adc70 2021-11-12T05:47:39.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10ccc42700 1 -- 172.21.2.105:0/2269636501 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3544148651 0 0) 0x7f10b0003260 con 0x7f10c80adc70 2021-11-12T05:47:39.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10ccc42700 1 -- 172.21.2.105:0/2269636501 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f10c8141290 msgr2=0x7f10c80b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:39.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10ccc42700 1 --2- 172.21.2.105:0/2269636501 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f10c8141290 0x7f10c80b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:39.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10ccc42700 1 -- 172.21.2.105:0/2269636501 >> v1:172.21.2.115:6789/0 conn(0x7f10c8060100 legacy=0x7f10c8140b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:39.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10ccc42700 1 -- 172.21.2.105:0/2269636501 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c80604e0 con 0x7f10c80adc70 2021-11-12T05:47:39.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10ccc42700 1 -- 172.21.2.105:0/2269636501 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f10bc001680 con 0x7f10c80adc70 2021-11-12T05:47:39.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10ccc42700 1 -- 172.21.2.105:0/2269636501 >> v1:172.21.2.105:6789/0 conn(0x7f10c80adc70 legacy=0x7f10c814a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:39.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10ccc42700 1 --2- 172.21.2.105:0/2269636501 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f10c8141290 0x7f10b0003800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:39.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10ccc42700 1 --2- 172.21.2.105:0/2269636501 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f10b0003ef0 0x7f10b0004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:39.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10ccc42700 1 --2- 172.21.2.105:0/2269636501 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f10b0004bf0 0x7f10b000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:39.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10ccc42700 1 -- 172.21.2.105:0/2269636501 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b00052c0 con 0x7f10b0004bf0 2021-11-12T05:47:39.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10ccc42700 1 -- 172.21.2.105:0/2269636501 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b000bc40 con 0x7f10b0003ef0 2021-11-12T05:47:39.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10ccc42700 1 -- 172.21.2.105:0/2269636501 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b000bd80 con 0x7f10c8141290 2021-11-12T05:47:39.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10ce445700 1 --2- 172.21.2.105:0/2269636501 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f10b0004bf0 0x7f10b000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:39.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10ce445700 1 -- 172.21.2.105:0/2269636501 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f10c8141290 msgr2=0x7f10b0003800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:39.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10ce445700 1 --2- 172.21.2.105:0/2269636501 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f10c8141290 0x7f10b0003800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:39.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10ce445700 1 -- 172.21.2.105:0/2269636501 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f10b0003ef0 msgr2=0x7f10b0004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:39.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10cd443700 1 --2- 172.21.2.105:0/2269636501 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f10b0003ef0 0x7f10b0004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:39.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10ce445700 1 --2- 172.21.2.105:0/2269636501 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f10b0003ef0 0x7f10b0004500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:39.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10ce445700 1 -- 172.21.2.105:0/2269636501 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b0003260 con 0x7f10b0004bf0 2021-11-12T05:47:39.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10ce445700 1 --2- 172.21.2.105:0/2269636501 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f10b0004bf0 0x7f10b000b750 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7f10c00032f0 tx=0x7f10c0006f90).ready entity=mon.0 client_cookie=3a404d8dbe46d419 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:39.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10ccc42700 1 -- 172.21.2.105:0/2269636501 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10c0011400 con 0x7f10b0004bf0 2021-11-12T05:47:39.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10ccc42700 1 -- 172.21.2.105:0/2269636501 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c0011560 con 0x7f10b0004bf0 2021-11-12T05:47:39.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10ccc42700 1 -- 172.21.2.105:0/2269636501 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10c00116d0 con 0x7f10b0004bf0 2021-11-12T05:47:39.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10cec46700 1 -- 172.21.2.105:0/2269636501 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f10b0004bf0 msgr2=0x7f10b000b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:39.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10cec46700 1 --2- 172.21.2.105:0/2269636501 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f10b0004bf0 0x7f10b000b750 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7f10c00032f0 tx=0x7f10c0006f90).stop 2021-11-12T05:47:39.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10ce445700 1 -- 172.21.2.105:0/2269636501 reap_dead start 2021-11-12T05:47:39.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10cec46700 1 -- 172.21.2.105:0/2269636501 shutdown_connections 2021-11-12T05:47:39.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10cec46700 1 -- 172.21.2.105:0/2269636501 >> 172.21.2.105:0/2269636501 conn(0x7f10c80608d0 msgr2=0x7f10c805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:39.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10cec46700 1 -- 172.21.2.105:0/2269636501 shutdown_connections 2021-11-12T05:47:39.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10cec46700 1 -- 172.21.2.105:0/2269636501 wait complete. 2021-11-12T05:47:39.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10cec46700 1 Processor -- start 2021-11-12T05:47:39.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10cec46700 1 -- start start 2021-11-12T05:47:39.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10cec46700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f10b0004bf0 0x7f10c8148ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:39.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10cec46700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f10c81562f0 0x7f10c81599c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:39.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10cec46700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f10c8159eb0 0x7f10c815a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:39.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10cec46700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c80b8030 con 0x7f10b0004bf0 2021-11-12T05:47:39.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10cec46700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c815a820 con 0x7f10c8159eb0 2021-11-12T05:47:39.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10cec46700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c8156b70 con 0x7f10c81562f0 2021-11-12T05:47:39.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10cdc44700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f10b0004bf0 0x7f10c8148ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:39.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10cdc44700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f10b0004bf0 0x7f10c8148ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48608/0 (socket says 172.21.2.105:48608) 2021-11-12T05:47:39.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10cdc44700 1 -- 172.21.2.105:0/2297981287 learned_addr learned my addr 172.21.2.105:0/2297981287 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:39.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10ce445700 1 --2- 172.21.2.105:0/2297981287 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f10c8159eb0 0x7f10c815a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:39.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10cd443700 1 --2- 172.21.2.105:0/2297981287 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f10c81562f0 0x7f10c81599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:39.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10cdc44700 1 -- 172.21.2.105:0/2297981287 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f10c81562f0 msgr2=0x7f10c81599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:39.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10cdc44700 1 --2- 172.21.2.105:0/2297981287 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f10c81562f0 0x7f10c81599c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:39.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10cdc44700 1 -- 172.21.2.105:0/2297981287 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f10c8159eb0 msgr2=0x7f10c815a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:39.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10cdc44700 1 --2- 172.21.2.105:0/2297981287 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f10c8159eb0 0x7f10c815a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:39.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10cdc44700 1 -- 172.21.2.105:0/2297981287 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c8156e10 con 0x7f10b0004bf0 2021-11-12T05:47:39.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10ce445700 1 --2- 172.21.2.105:0/2297981287 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f10c8159eb0 0x7f10c815a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:47:39.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10cdc44700 1 --2- 172.21.2.105:0/2297981287 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f10b0004bf0 0x7f10c8148ca0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7f10c81488c0 tx=0x7f10c4007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:39.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10baffd700 1 -- 172.21.2.105:0/2297981287 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10c400ce70 con 0x7f10b0004bf0 2021-11-12T05:47:39.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10baffd700 1 -- 172.21.2.105:0/2297981287 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c4000e90 con 0x7f10b0004bf0 2021-11-12T05:47:39.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10baffd700 1 -- 172.21.2.105:0/2297981287 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10c4007430 con 0x7f10b0004bf0 2021-11-12T05:47:39.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10cec46700 1 -- 172.21.2.105:0/2297981287 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10c81570b0 con 0x7f10b0004bf0 2021-11-12T05:47:39.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.380+0000 7f10cec46700 1 -- 172.21.2.105:0/2297981287 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c8156770 con 0x7f10b0004bf0 2021-11-12T05:47:39.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.384+0000 7f10cec46700 1 -- 172.21.2.105:0/2297981287 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10c8157240 con 0x7f10b0004bf0 2021-11-12T05:47:39.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.384+0000 7f10baffd700 1 -- 172.21.2.105:0/2297981287 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f10c4010030 con 0x7f10b0004bf0 2021-11-12T05:47:39.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.384+0000 7f10baffd700 1 --2- 172.21.2.105:0/2297981287 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f10a8053640 0x7f10a8055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:39.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.384+0000 7f10baffd700 1 -- 172.21.2.105:0/2297981287 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f10c406b300 con 0x7f10b0004bf0 2021-11-12T05:47:39.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.384+0000 7f10cd443700 1 --2- 172.21.2.105:0/2297981287 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f10a8053640 0x7f10a8055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:39.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.384+0000 7f10cd443700 1 --2- 172.21.2.105:0/2297981287 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f10a8053640 0x7f10a8055b00 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f10bc009000 tx=0x7f10bc009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:39.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.384+0000 7f10baffd700 1 -- 172.21.2.105:0/2297981287 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f10c40421a0 con 0x7f10b0004bf0 2021-11-12T05:47:39.499 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.496+0000 7f10cec46700 1 -- 172.21.2.105:0/2297981287 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f10c80b3450 con 0x7f10b0004bf0 2021-11-12T05:47:39.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.496+0000 7f10baffd700 1 -- 172.21.2.105:0/2297981287 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2138 (secure 0 0 0) 0x7f10c40457c0 con 0x7f10b0004bf0 2021-11-12T05:47:39.500 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:39.501 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":38,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4960,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/157622236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":157622236},{"type":"v1","addr":"172.21.2.115:6833","nonce":157622236}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:47:30.387487+0000","modified":"2021-11-12T05:47:32.407052+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6693},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6693":{"gid":6693,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/1429326547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":1429326547},{"type":"v1","addr":"172.21.2.105:6835","nonce":1429326547}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-11-12T05:47:39.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.496+0000 7f10cec46700 1 -- 172.21.2.105:0/2297981287 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f10a8053640 msgr2=0x7f10a8055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:39.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.496+0000 7f10cec46700 1 --2- 172.21.2.105:0/2297981287 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f10a8053640 0x7f10a8055b00 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f10bc009000 tx=0x7f10bc009040).stop 2021-11-12T05:47:39.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.496+0000 7f10cec46700 1 -- 172.21.2.105:0/2297981287 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f10b0004bf0 msgr2=0x7f10c8148ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:39.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.496+0000 7f10cec46700 1 --2- 172.21.2.105:0/2297981287 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f10b0004bf0 0x7f10c8148ca0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7f10c81488c0 tx=0x7f10c4007c30).stop 2021-11-12T05:47:39.503 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.496+0000 7f10cec46700 1 -- 172.21.2.105:0/2297981287 shutdown_connections 2021-11-12T05:47:39.503 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.496+0000 7f10cec46700 1 --2- 172.21.2.105:0/2297981287 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f10a8053640 0x7f10a8055b00 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:39.503 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.496+0000 7f10cec46700 1 --2- 172.21.2.105:0/2297981287 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f10c8159eb0 0x7f10c815a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:39.503 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.496+0000 7f10cec46700 1 --2- 172.21.2.105:0/2297981287 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f10c81562f0 0x7f10c81599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:39.503 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.496+0000 7f10cec46700 1 --2- 172.21.2.105:0/2297981287 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f10b0004bf0 0x7f10c8148ca0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:39.504 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.496+0000 7f10cec46700 1 -- 172.21.2.105:0/2297981287 >> 172.21.2.105:0/2297981287 conn(0x7f10c80608d0 msgr2=0x7f10c813e440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:39.504 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.496+0000 7f10cec46700 1 -- 172.21.2.105:0/2297981287 shutdown_connections 2021-11-12T05:47:39.504 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.496+0000 7f10cec46700 1 -- 172.21.2.105:0/2297981287 wait complete. 2021-11-12T05:47:39.504 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 38 2021-11-12T05:47:39.507 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-12T05:47:39.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.552+0000 7fb2c00e8700 1 Processor -- start 2021-11-12T05:47:39.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.552+0000 7fb2c00e8700 1 -- start start 2021-11-12T05:47:39.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.552+0000 7fb2c00e8700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb2b8130a80 0x7fb2b8062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:39.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.552+0000 7fb2c00e8700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b80b0d50 con 0x7fb2b80626b0 2021-11-12T05:47:39.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.552+0000 7fb2c00e8700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b80ad380 con 0x7fb2b80af750 2021-11-12T05:47:39.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.552+0000 7fb2c00e8700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2b80ae190 con 0x7fb2b8130a80 2021-11-12T05:47:39.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.552+0000 7fb2bde84700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fb2b80626b0 0x7fb2b8130370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:59012/0 (socket says 172.21.2.105:59012) 2021-11-12T05:47:39.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.552+0000 7fb2bde84700 1 -- 172.21.2.105:0/1048756614 learned_addr learned my addr 172.21.2.105:0/1048756614 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:39.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.552+0000 7fb2be685700 1 --2- 172.21.2.105:0/1048756614 >> v2:172.21.2.105:3300/0 conn(0x7fb2b8130a80 0x7fb2b8062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:39.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.556+0000 7fb2be685700 1 -- 172.21.2.105:0/1048756614 >> v1:172.21.2.115:6789/0 conn(0x7fb2b80af750 legacy=0x7fb2b81474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:39.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.556+0000 7fb2be685700 1 -- 172.21.2.105:0/1048756614 >> v1:172.21.2.105:6789/0 conn(0x7fb2b80626b0 legacy=0x7fb2b8130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:39.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.556+0000 7fb2be685700 1 -- 172.21.2.105:0/1048756614 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b80ae2d0 con 0x7fb2b8130a80 2021-11-12T05:47:39.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.556+0000 7fb2be685700 1 --2- 172.21.2.105:0/1048756614 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb2b8130a80 0x7fb2b8062a90 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7fb2b805d1f0 tx=0x7fb2a8006df0).ready entity=mon.0 client_cookie=46286c3f7715176b server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:39.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.556+0000 7fb2bce82700 1 -- 172.21.2.105:0/1048756614 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2a800d5c0 con 0x7fb2b8130a80 2021-11-12T05:47:39.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.556+0000 7fb2bce82700 1 -- 172.21.2.105:0/1048756614 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a8000e90 con 0x7fb2b8130a80 2021-11-12T05:47:39.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.556+0000 7fb2bce82700 1 -- 172.21.2.105:0/1048756614 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2a800d910 con 0x7fb2b8130a80 2021-11-12T05:47:39.566 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.556+0000 7fb2c00e8700 1 -- 172.21.2.105:0/1048756614 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb2b8130a80 msgr2=0x7fb2b8062a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:39.566 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.556+0000 7fb2c00e8700 1 --2- 172.21.2.105:0/1048756614 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb2b8130a80 0x7fb2b8062a90 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7fb2b805d1f0 tx=0x7fb2a8006df0).stop 2021-11-12T05:47:39.566 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.556+0000 7fb2c00e8700 1 -- 172.21.2.105:0/1048756614 shutdown_connections 2021-11-12T05:47:39.567 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.556+0000 7fb2c00e8700 1 --2- 172.21.2.105:0/1048756614 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb2b8130a80 0x7fb2b8062a90 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:39.567 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.556+0000 7fb2c00e8700 1 -- 172.21.2.105:0/1048756614 >> 172.21.2.105:0/1048756614 conn(0x7fb2b80b5320 msgr2=0x7fb2b80b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:39.567 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.556+0000 7fb2c00e8700 1 -- 172.21.2.105:0/1048756614 shutdown_connections 2021-11-12T05:47:39.567 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.556+0000 7fb2c00e8700 1 -- 172.21.2.105:0/1048756614 wait complete. 2021-11-12T05:47:39.568 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.556+0000 7fb2c00e8700 1 Processor -- start 2021-11-12T05:47:39.568 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.556+0000 7fb2c00e8700 1 -- start start 2021-11-12T05:47:39.568 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.556+0000 7fb2c00e8700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb2b80626b0 0x7fb2b8064410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:39.568 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.556+0000 7fb2c00e8700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb2b80af750 0x7fb2b8159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:39.569 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.556+0000 7fb2c00e8700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb2b8130a80 0x7fb2b815a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:39.569 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.556+0000 7fb2c00e8700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b81543c0 con 0x7fb2b80af750 2021-11-12T05:47:39.569 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.556+0000 7fb2c00e8700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b80b3700 con 0x7fb2b8130a80 2021-11-12T05:47:39.569 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.556+0000 7fb2c00e8700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b8063330 con 0x7fb2b80626b0 2021-11-12T05:47:39.570 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.556+0000 7fb2bd683700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb2b80af750 0x7fb2b8159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:39.570 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.556+0000 7fb2bd683700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb2b80af750 0x7fb2b8159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48624/0 (socket says 172.21.2.105:48624) 2021-11-12T05:47:39.570 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.556+0000 7fb2bd683700 1 -- 172.21.2.105:0/3633564160 learned_addr learned my addr 172.21.2.105:0/3633564160 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:39.570 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.556+0000 7fb2bd683700 1 -- 172.21.2.105:0/3633564160 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb2b80626b0 msgr2=0x7fb2b8064410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:39.571 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.556+0000 7fb2bd683700 1 --2- 172.21.2.105:0/3633564160 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb2b80626b0 0x7fb2b8064410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:39.571 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.556+0000 7fb2bd683700 1 -- 172.21.2.105:0/3633564160 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb2b8130a80 msgr2=0x7fb2b815a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:39.571 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.556+0000 7fb2bd683700 1 --2- 172.21.2.105:0/3633564160 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb2b8130a80 0x7fb2b815a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:39.571 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.556+0000 7fb2bd683700 1 -- 172.21.2.105:0/3633564160 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a800b180 con 0x7fb2b80af750 2021-11-12T05:47:39.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.556+0000 7fb2bd683700 1 --2- 172.21.2.105:0/3633564160 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb2b80af750 0x7fb2b8159ec0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 rx=0x7fb2b0003310 tx=0x7fb2b00091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:39.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.556+0000 7fb2b6ffd700 1 -- 172.21.2.105:0/3633564160 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2b00016f0 con 0x7fb2b80af750 2021-11-12T05:47:39.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.556+0000 7fb2b6ffd700 1 -- 172.21.2.105:0/3633564160 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b0001850 con 0x7fb2b80af750 2021-11-12T05:47:39.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.556+0000 7fb2c00e8700 1 -- 172.21.2.105:0/3633564160 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b80635d0 con 0x7fb2b80af750 2021-11-12T05:47:39.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.556+0000 7fb2c00e8700 1 -- 172.21.2.105:0/3633564160 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b815a8a0 con 0x7fb2b80af750 2021-11-12T05:47:39.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.556+0000 7fb2b6ffd700 1 -- 172.21.2.105:0/3633564160 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2b0001bb0 con 0x7fb2b80af750 2021-11-12T05:47:39.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.560+0000 7fb2c00e8700 1 -- 172.21.2.105:0/3633564160 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b8147be0 con 0x7fb2b80af750 2021-11-12T05:47:39.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.560+0000 7fb2b6ffd700 1 -- 172.21.2.105:0/3633564160 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb2b0018030 con 0x7fb2b80af750 2021-11-12T05:47:39.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.560+0000 7fb2b6ffd700 1 --2- 172.21.2.105:0/3633564160 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb298053720 0x7fb298055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:39.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.560+0000 7fb2b6ffd700 1 -- 172.21.2.105:0/3633564160 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6502+0+0 (secure 0 0 0) 0x7fb2b006b940 con 0x7fb2b80af750 2021-11-12T05:47:39.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.560+0000 7fb2bde84700 1 --2- 172.21.2.105:0/3633564160 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb298053720 0x7fb298055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:39.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.560+0000 7fb2bde84700 1 --2- 172.21.2.105:0/3633564160 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb298053720 0x7fb298055be0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7fb2b805d1b0 tx=0x7fb2ac007800).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:39.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.560+0000 7fb2b6ffd700 1 -- 172.21.2.105:0/3633564160 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb2b0041e90 con 0x7fb2b80af750 2021-11-12T05:47:39.674 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:39.668+0000 7fb2c00e8700 1 -- 172.21.2.105:0/3633564160 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb2b8057350 con 0x7fb2b80af750 2021-11-12T05:47:40.130 INFO:tasks.ceph.mon.a.gibba005.stderr:2021-11-12T05:47:40.124+0000 7fe9772b2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-12T05:47:40.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.140+0000 7fb2b6ffd700 1 -- 172.21.2.105:0/3633564160 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v39) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb2b00463d0 con 0x7fb2b80af750 2021-11-12T05:47:40.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.140+0000 7fb2c00e8700 1 -- 172.21.2.105:0/3633564160 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb298053720 msgr2=0x7fb298055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:40.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.140+0000 7fb2c00e8700 1 --2- 172.21.2.105:0/3633564160 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb298053720 0x7fb298055be0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7fb2b805d1b0 tx=0x7fb2ac007800).stop 2021-11-12T05:47:40.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.140+0000 7fb2c00e8700 1 -- 172.21.2.105:0/3633564160 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb2b80af750 msgr2=0x7fb2b8159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:40.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.140+0000 7fb2c00e8700 1 --2- 172.21.2.105:0/3633564160 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb2b80af750 0x7fb2b8159ec0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 rx=0x7fb2b0003310 tx=0x7fb2b00091d0).stop 2021-11-12T05:47:40.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.140+0000 7fb2c00e8700 1 -- 172.21.2.105:0/3633564160 shutdown_connections 2021-11-12T05:47:40.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.140+0000 7fb2c00e8700 1 --2- 172.21.2.105:0/3633564160 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb298053720 0x7fb298055be0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:40.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.140+0000 7fb2c00e8700 1 --2- 172.21.2.105:0/3633564160 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb2b8130a80 0x7fb2b815a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:40.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.140+0000 7fb2c00e8700 1 --2- 172.21.2.105:0/3633564160 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb2b80af750 0x7fb2b8159ec0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:40.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.140+0000 7fb2c00e8700 1 --2- 172.21.2.105:0/3633564160 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb2b80626b0 0x7fb2b8064410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:40.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.140+0000 7fb2c00e8700 1 -- 172.21.2.105:0/3633564160 >> 172.21.2.105:0/3633564160 conn(0x7fb2b80b5320 msgr2=0x7fb2b80ad890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:40.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.140+0000 7fb2c00e8700 1 -- 172.21.2.105:0/3633564160 shutdown_connections 2021-11-12T05:47:40.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.140+0000 7fb2c00e8700 1 -- 172.21.2.105:0/3633564160 wait complete. 2021-11-12T05:47:40.149 INFO:teuthology.orchestra.run.gibba005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-12T05:47:40.153 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:47:40.158 INFO:tasks.ceph.mds.a.gibba005.stdout:starting mds.a at 2021-11-12T05:47:40.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.200+0000 7ff14689a700 1 Processor -- start 2021-11-12T05:47:40.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.200+0000 7ff14689a700 1 -- start start 2021-11-12T05:47:40.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.200+0000 7ff14689a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff1400b2940 0x7ff140142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:40.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.200+0000 7ff14689a700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff1400b0780 0x7ff14005c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:40.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.200+0000 7ff14689a700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1400b2d20 con 0x7ff1400b0cc0 2021-11-12T05:47:40.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.200+0000 7ff14689a700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1400b1fc0 con 0x7ff1400b0780 2021-11-12T05:47:40.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.200+0000 7ff14689a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1400b15e0 con 0x7ff1400b2940 2021-11-12T05:47:40.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff13f7fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff1400b0780 0x7ff14005c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:40.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff144e37700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7ff1400b0cc0 0x7ff1401432b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:59040/0 (socket says 172.21.2.105:59040) 2021-11-12T05:47:40.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff144e37700 1 -- 172.21.2.105:0/2713393589 learned_addr learned my addr 172.21.2.105:0/2713393589 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:40.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff13f7fe700 1 -- 172.21.2.105:0/2713393589 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff1400b2940 msgr2=0x7ff140142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:40.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff13f7fe700 1 --2- 172.21.2.105:0/2713393589 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff1400b2940 0x7ff140142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:40.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff13f7fe700 1 -- 172.21.2.105:0/2713393589 >> v1:172.21.2.105:6789/0 conn(0x7ff1400b0cc0 legacy=0x7ff1401432b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:40.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff13f7fe700 1 -- 172.21.2.105:0/2713393589 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1400b1880 con 0x7ff1400b0780 2021-11-12T05:47:40.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff13f7fe700 1 --2- 172.21.2.105:0/2713393589 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff1400b0780 0x7ff14005c490 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7ff128002f70 tx=0x7ff128006df0).ready entity=mon.0 client_cookie=bcd1dbb47819ae8c server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:40.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff13effd700 1 -- 172.21.2.105:0/2713393589 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff12800d570 con 0x7ff1400b0780 2021-11-12T05:47:40.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff13effd700 1 -- 172.21.2.105:0/2713393589 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff128000e90 con 0x7ff1400b0780 2021-11-12T05:47:40.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff13effd700 1 -- 172.21.2.105:0/2713393589 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff12800d8c0 con 0x7ff1400b0780 2021-11-12T05:47:40.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff14689a700 1 -- 172.21.2.105:0/2713393589 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff1400b0780 msgr2=0x7ff14005c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:40.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff14689a700 1 --2- 172.21.2.105:0/2713393589 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff1400b0780 0x7ff14005c490 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7ff128002f70 tx=0x7ff128006df0).stop 2021-11-12T05:47:40.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff14689a700 1 -- 172.21.2.105:0/2713393589 shutdown_connections 2021-11-12T05:47:40.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff14689a700 1 --2- 172.21.2.105:0/2713393589 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff1400b0780 0x7ff14005c490 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:40.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff14689a700 1 --2- 172.21.2.105:0/2713393589 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff1400b2940 0x7ff140142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:40.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff14689a700 1 -- 172.21.2.105:0/2713393589 >> 172.21.2.105:0/2713393589 conn(0x7ff140068440 msgr2=0x7ff140062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:40.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff14689a700 1 -- 172.21.2.105:0/2713393589 shutdown_connections 2021-11-12T05:47:40.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff14689a700 1 -- 172.21.2.105:0/2713393589 wait complete. 2021-11-12T05:47:40.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff14689a700 1 Processor -- start 2021-11-12T05:47:40.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff14689a700 1 -- start start 2021-11-12T05:47:40.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff14689a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff1400b0780 0x7ff14013e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:40.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff14689a700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff1400b0cc0 0x7ff140148410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:40.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff14689a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff1400b2940 0x7ff140148900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:40.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff14689a700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff140139ba0 con 0x7ff1400b0780 2021-11-12T05:47:40.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff14689a700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14013dc80 con 0x7ff1400b0cc0 2021-11-12T05:47:40.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff14689a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff140140970 con 0x7ff1400b2940 2021-11-12T05:47:40.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff13ffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff1400b0780 0x7ff14013e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:40.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff13ffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff1400b0780 0x7ff14013e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48648/0 (socket says 172.21.2.105:48648) 2021-11-12T05:47:40.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff13ffff700 1 -- 172.21.2.105:0/1555213528 learned_addr learned my addr 172.21.2.105:0/1555213528 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:40.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff13ffff700 1 -- 172.21.2.105:0/1555213528 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff1400b2940 msgr2=0x7ff140148900 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:47:40.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff13ffff700 1 --2- 172.21.2.105:0/1555213528 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff1400b2940 0x7ff140148900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:40.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff13ffff700 1 -- 172.21.2.105:0/1555213528 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff1400b0cc0 msgr2=0x7ff140148410 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:47:40.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff13ffff700 1 --2- 172.21.2.105:0/1555213528 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff1400b0cc0 0x7ff140148410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:40.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff13ffff700 1 -- 172.21.2.105:0/1555213528 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff12800b180 con 0x7ff1400b0780 2021-11-12T05:47:40.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff13ffff700 1 --2- 172.21.2.105:0/1555213528 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff1400b0780 0x7ff14013e250 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7ff140139ce0 tx=0x7ff130006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:40.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff13d7fa700 1 -- 172.21.2.105:0/1555213528 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff130013460 con 0x7ff1400b0780 2021-11-12T05:47:40.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff13d7fa700 1 -- 172.21.2.105:0/1555213528 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1300135c0 con 0x7ff1400b0780 2021-11-12T05:47:40.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff14689a700 1 -- 172.21.2.105:0/1555213528 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff14013d9e0 con 0x7ff1400b0780 2021-11-12T05:47:40.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff14689a700 1 -- 172.21.2.105:0/1555213528 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff140065860 con 0x7ff1400b0780 2021-11-12T05:47:40.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff13d7fa700 1 -- 172.21.2.105:0/1555213528 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff130013920 con 0x7ff1400b0780 2021-11-12T05:47:40.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff14689a700 1 -- 172.21.2.105:0/1555213528 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1400b1b20 con 0x7ff1400b0780 2021-11-12T05:47:40.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.204+0000 7ff13d7fa700 1 -- 172.21.2.105:0/1555213528 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff13001a060 con 0x7ff1400b0780 2021-11-12T05:47:40.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.208+0000 7ff13d7fa700 1 --2- 172.21.2.105:0/1555213528 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff1240536f0 0x7ff124055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:40.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.208+0000 7ff13d7fa700 1 -- 172.21.2.105:0/1555213528 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6588+0+0 (secure 0 0 0) 0x7ff13006b640 con 0x7ff1400b0780 2021-11-12T05:47:40.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.208+0000 7ff13f7fe700 1 --2- 172.21.2.105:0/1555213528 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff1240536f0 0x7ff124055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:40.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.208+0000 7ff13f7fe700 1 --2- 172.21.2.105:0/1555213528 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff1240536f0 0x7ff124055bb0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7ff128002f70 tx=0x7ff128015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:40.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.208+0000 7ff13d7fa700 1 -- 172.21.2.105:0/1555213528 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff130042490 con 0x7ff1400b0780 2021-11-12T05:47:40.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.320+0000 7ff14689a700 1 -- 172.21.2.105:0/1555213528 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff140057350 con 0x7ff1400b0780 2021-11-12T05:47:40.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.320+0000 7ff13d7fa700 1 -- 172.21.2.105:0/1555213528 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+1776 (secure 0 0 0) 0x7ff130045ab0 con 0x7ff1400b0780 2021-11-12T05:47:40.324 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:40.324 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":39,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4960,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/157622236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":157622236},{"type":"v1","addr":"172.21.2.115:6833","nonce":157622236}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":39,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:47:30.387487+0000","modified":"2021-11-12T05:47:40.130207+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-11-12T05:47:40.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.320+0000 7ff14689a700 1 -- 172.21.2.105:0/1555213528 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff1240536f0 msgr2=0x7ff124055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:40.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.320+0000 7ff14689a700 1 --2- 172.21.2.105:0/1555213528 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff1240536f0 0x7ff124055bb0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7ff128002f70 tx=0x7ff128015000).stop 2021-11-12T05:47:40.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.320+0000 7ff14689a700 1 -- 172.21.2.105:0/1555213528 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff1400b0780 msgr2=0x7ff14013e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:40.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.320+0000 7ff14689a700 1 --2- 172.21.2.105:0/1555213528 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff1400b0780 0x7ff14013e250 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7ff140139ce0 tx=0x7ff130006e20).stop 2021-11-12T05:47:40.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.320+0000 7ff14689a700 1 -- 172.21.2.105:0/1555213528 shutdown_connections 2021-11-12T05:47:40.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.320+0000 7ff14689a700 1 --2- 172.21.2.105:0/1555213528 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff1240536f0 0x7ff124055bb0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:40.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.320+0000 7ff14689a700 1 --2- 172.21.2.105:0/1555213528 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff1400b2940 0x7ff140148900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:40.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.320+0000 7ff14689a700 1 --2- 172.21.2.105:0/1555213528 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff1400b0cc0 0x7ff140148410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:40.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.320+0000 7ff14689a700 1 --2- 172.21.2.105:0/1555213528 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff1400b0780 0x7ff14013e250 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:40.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.320+0000 7ff14689a700 1 -- 172.21.2.105:0/1555213528 >> 172.21.2.105:0/1555213528 conn(0x7ff140068440 msgr2=0x7ff14013cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:40.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.320+0000 7ff14689a700 1 -- 172.21.2.105:0/1555213528 shutdown_connections 2021-11-12T05:47:40.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.320+0000 7ff14689a700 1 -- 172.21.2.105:0/1555213528 wait complete. 2021-11-12T05:47:40.328 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 39 2021-11-12T05:47:40.331 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-12T05:47:40.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.380+0000 7ff02437f700 1 Processor -- start 2021-11-12T05:47:40.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.380+0000 7ff02437f700 1 -- start start 2021-11-12T05:47:40.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.380+0000 7ff02437f700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7ff01c0aca40 0x7ff01c0ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:40.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.380+0000 7ff02437f700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff01c144180 0x7ff01c1445f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:40.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.380+0000 7ff02437f700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff01c0b1840 con 0x7ff01c0b0520 2021-11-12T05:47:40.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.380+0000 7ff02437f700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff01c0b09d0 con 0x7ff01c144180 2021-11-12T05:47:40.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.380+0000 7ff02437f700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff01c0af2b0 con 0x7ff01c0aca40 2021-11-12T05:47:40.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.380+0000 7ff02291c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff01c144180 0x7ff01c1445f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:40.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.380+0000 7ff02291c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff01c144180 0x7ff01c1445f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48658/0 (socket says 172.21.2.105:48658) 2021-11-12T05:47:40.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.380+0000 7ff02291c700 1 -- 172.21.2.105:0/3763636375 learned_addr learned my addr 172.21.2.105:0/3763636375 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:40.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.380+0000 7ff02291c700 1 -- 172.21.2.105:0/3763636375 >> v2:172.21.2.115:3300/0 conn(0x7ff01c0aca40 msgr2=0x7ff01c0ace20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:47:40.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.380+0000 7ff02291c700 1 --2- 172.21.2.105:0/3763636375 >> v2:172.21.2.115:3300/0 conn(0x7ff01c0aca40 0x7ff01c0ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:40.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.380+0000 7ff02291c700 1 -- 172.21.2.105:0/3763636375 >> v1:172.21.2.115:6789/0 conn(0x7ff01c0b0520 legacy=0x7ff01c1473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:40.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.380+0000 7ff02291c700 1 -- 172.21.2.105:0/3763636375 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01c0b1a70 con 0x7ff01c144180 2021-11-12T05:47:40.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.380+0000 7ff02291c700 1 --2- 172.21.2.105:0/3763636375 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff01c144180 0x7ff01c1445f0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7ff01c061140 tx=0x7ff014009290).ready entity=mon.0 client_cookie=7595dce2ad5bc37a server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:40.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.380+0000 7ff021119700 1 -- 172.21.2.105:0/3763636375 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff01400b830 con 0x7ff01c144180 2021-11-12T05:47:40.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.380+0000 7ff021119700 1 -- 172.21.2.105:0/3763636375 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01400b990 con 0x7ff01c144180 2021-11-12T05:47:40.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.380+0000 7ff021119700 1 -- 172.21.2.105:0/3763636375 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff01400bb40 con 0x7ff01c144180 2021-11-12T05:47:40.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.380+0000 7ff02437f700 1 -- 172.21.2.105:0/3763636375 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff01c144180 msgr2=0x7ff01c1445f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:40.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.380+0000 7ff02437f700 1 --2- 172.21.2.105:0/3763636375 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff01c144180 0x7ff01c1445f0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7ff01c061140 tx=0x7ff014009290).stop 2021-11-12T05:47:40.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.380+0000 7ff02437f700 1 -- 172.21.2.105:0/3763636375 shutdown_connections 2021-11-12T05:47:40.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.380+0000 7ff02437f700 1 --2- 172.21.2.105:0/3763636375 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff01c144180 0x7ff01c1445f0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:40.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.380+0000 7ff02437f700 1 --2- 172.21.2.105:0/3763636375 >> v2:172.21.2.115:3300/0 conn(0x7ff01c0aca40 0x7ff01c0ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:40.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.380+0000 7ff02437f700 1 -- 172.21.2.105:0/3763636375 >> 172.21.2.105:0/3763636375 conn(0x7ff01c05c490 msgr2=0x7ff01c0b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:40.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.380+0000 7ff02437f700 1 -- 172.21.2.105:0/3763636375 shutdown_connections 2021-11-12T05:47:40.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.380+0000 7ff02437f700 1 -- 172.21.2.105:0/3763636375 wait complete. 2021-11-12T05:47:40.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.380+0000 7ff02437f700 1 Processor -- start 2021-11-12T05:47:40.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.380+0000 7ff02437f700 1 -- start start 2021-11-12T05:47:40.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.380+0000 7ff02437f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff01c0aca40 0x7ff01c156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:40.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.380+0000 7ff02437f700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff01c0b0520 0x7ff01c15a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:40.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.380+0000 7ff02437f700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff01c144180 0x7ff01c140e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:40.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.380+0000 7ff02437f700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c159d90 con 0x7ff01c144180 2021-11-12T05:47:40.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.380+0000 7ff02437f700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c144990 con 0x7ff01c0b0520 2021-11-12T05:47:40.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.380+0000 7ff02437f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c159fc0 con 0x7ff01c0aca40 2021-11-12T05:47:40.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.380+0000 7ff02291c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff01c144180 0x7ff01c140e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:40.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.380+0000 7ff02291c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff01c144180 0x7ff01c140e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48666/0 (socket says 172.21.2.105:48666) 2021-11-12T05:47:40.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.380+0000 7ff02291c700 1 -- 172.21.2.105:0/3724596950 learned_addr learned my addr 172.21.2.105:0/3724596950 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:40.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.384+0000 7ff02291c700 1 -- 172.21.2.105:0/3724596950 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff01c0aca40 msgr2=0x7ff01c156760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:40.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.384+0000 7ff02291c700 1 --2- 172.21.2.105:0/3724596950 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff01c0aca40 0x7ff01c156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:40.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.384+0000 7ff02291c700 1 -- 172.21.2.105:0/3724596950 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff01c0b0520 msgr2=0x7ff01c15a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:40.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.384+0000 7ff02291c700 1 --2- 172.21.2.105:0/3724596950 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff01c0b0520 0x7ff01c15a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:40.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.384+0000 7ff02291c700 1 -- 172.21.2.105:0/3724596950 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff014009530 con 0x7ff01c144180 2021-11-12T05:47:40.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.384+0000 7ff02291c700 1 --2- 172.21.2.105:0/3724596950 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff01c144180 0x7ff01c140e20 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7ff01c061140 tx=0x7ff014016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:40.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.384+0000 7ff00b7fe700 1 -- 172.21.2.105:0/3724596950 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff01400bdb0 con 0x7ff01c144180 2021-11-12T05:47:40.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.384+0000 7ff00b7fe700 1 -- 172.21.2.105:0/3724596950 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01401f420 con 0x7ff01c144180 2021-11-12T05:47:40.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.384+0000 7ff00b7fe700 1 -- 172.21.2.105:0/3724596950 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff01401f780 con 0x7ff01c144180 2021-11-12T05:47:40.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.384+0000 7ff02437f700 1 -- 172.21.2.105:0/3724596950 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff01c144f80 con 0x7ff01c144180 2021-11-12T05:47:40.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.384+0000 7ff02437f700 1 -- 172.21.2.105:0/3724596950 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff01c062e70 con 0x7ff01c144180 2021-11-12T05:47:40.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.384+0000 7ff02437f700 1 -- 172.21.2.105:0/3724596950 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff01c15a180 con 0x7ff01c144180 2021-11-12T05:47:40.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.384+0000 7ff00b7fe700 1 -- 172.21.2.105:0/3724596950 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff014026030 con 0x7ff01c144180 2021-11-12T05:47:40.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.384+0000 7ff00b7fe700 1 --2- 172.21.2.105:0/3724596950 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7feffc0536d0 0x7feffc055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:40.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.384+0000 7ff00b7fe700 1 -- 172.21.2.105:0/3724596950 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6588+0+0 (secure 0 0 0) 0x7ff01406c7a0 con 0x7ff01c144180 2021-11-12T05:47:40.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.384+0000 7ff02211b700 1 --2- 172.21.2.105:0/3724596950 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7feffc0536d0 0x7feffc055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:40.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.384+0000 7ff02211b700 1 --2- 172.21.2.105:0/3724596950 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7feffc0536d0 0x7feffc055b90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7ff018002f70 tx=0x7ff018006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:40.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.388+0000 7ff00b7fe700 1 -- 172.21.2.105:0/3724596950 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff0140435f0 con 0x7ff01c144180 2021-11-12T05:47:40.499 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:40.496+0000 7ff02437f700 1 -- 172.21.2.105:0/3724596950 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff01c057350 con 0x7ff01c144180 2021-11-12T05:47:41.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.148+0000 7ff00b7fe700 1 -- 172.21.2.105:0/3724596950 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v40) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff014046c10 con 0x7ff01c144180 2021-11-12T05:47:41.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.148+0000 7ff02437f700 1 -- 172.21.2.105:0/3724596950 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7feffc0536d0 msgr2=0x7feffc055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:41.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.148+0000 7ff02437f700 1 --2- 172.21.2.105:0/3724596950 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7feffc0536d0 0x7feffc055b90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7ff018002f70 tx=0x7ff018006a80).stop 2021-11-12T05:47:41.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.148+0000 7ff02437f700 1 -- 172.21.2.105:0/3724596950 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff01c144180 msgr2=0x7ff01c140e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:41.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.148+0000 7ff02437f700 1 --2- 172.21.2.105:0/3724596950 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff01c144180 0x7ff01c140e20 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7ff01c061140 tx=0x7ff014016000).stop 2021-11-12T05:47:41.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.148+0000 7ff02437f700 1 -- 172.21.2.105:0/3724596950 shutdown_connections 2021-11-12T05:47:41.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.148+0000 7ff02437f700 1 --2- 172.21.2.105:0/3724596950 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7feffc0536d0 0x7feffc055b90 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:41.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.148+0000 7ff02437f700 1 --2- 172.21.2.105:0/3724596950 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff01c144180 0x7ff01c140e20 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:41.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.148+0000 7ff02437f700 1 --2- 172.21.2.105:0/3724596950 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff01c0b0520 0x7ff01c15a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:41.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.148+0000 7ff02437f700 1 --2- 172.21.2.105:0/3724596950 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff01c0aca40 0x7ff01c156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:41.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.148+0000 7ff02437f700 1 -- 172.21.2.105:0/3724596950 >> 172.21.2.105:0/3724596950 conn(0x7ff01c05c490 msgr2=0x7ff01c148cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:41.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.148+0000 7ff02437f700 1 -- 172.21.2.105:0/3724596950 shutdown_connections 2021-11-12T05:47:41.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.148+0000 7ff02437f700 1 -- 172.21.2.105:0/3724596950 wait complete. 2021-11-12T05:47:41.159 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-12T05:47:41.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.208+0000 7fa13ca66700 1 Processor -- start 2021-11-12T05:47:41.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.208+0000 7fa13ca66700 1 -- start start 2021-11-12T05:47:41.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.208+0000 7fa13ca66700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1380ac280 0x7fa13814b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:41.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.208+0000 7fa13ca66700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa1380af730 0x7fa1380ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:41.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.208+0000 7fa13ca66700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1380ac7b0 con 0x7fa1380ad080 2021-11-12T05:47:41.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.208+0000 7fa13ca66700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1381488a0 con 0x7fa1380af730 2021-11-12T05:47:41.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.208+0000 7fa13ca66700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1380ac9e0 con 0x7fa1380ac280 2021-11-12T05:47:41.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.208+0000 7fa13659c700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fa1380ad080 0x7fa13814abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:59066/0 (socket says 172.21.2.105:59066) 2021-11-12T05:47:41.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.208+0000 7fa13659c700 1 -- 172.21.2.105:0/3316869496 learned_addr learned my addr 172.21.2.105:0/3316869496 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:41.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.208+0000 7fa136d9d700 1 --2- 172.21.2.105:0/3316869496 >> v2:172.21.2.105:3300/0 conn(0x7fa1380af730 0x7fa1380ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:41.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.208+0000 7fa136d9d700 1 -- 172.21.2.105:0/3316869496 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1380ac280 msgr2=0x7fa13814b2f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:47:41.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.208+0000 7fa136d9d700 1 --2- 172.21.2.105:0/3316869496 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1380ac280 0x7fa13814b2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:41.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.208+0000 7fa136d9d700 1 -- 172.21.2.105:0/3316869496 >> v1:172.21.2.105:6789/0 conn(0x7fa1380ad080 legacy=0x7fa13814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:41.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.208+0000 7fa136d9d700 1 -- 172.21.2.105:0/3316869496 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1380b0b30 con 0x7fa1380af730 2021-11-12T05:47:41.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.208+0000 7fa136d9d700 1 --2- 172.21.2.105:0/3316869496 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1380af730 0x7fa1380ad460 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 rx=0x7fa1300032f0 tx=0x7fa1300091d0).ready entity=mon.0 client_cookie=607e8123a0a829fc server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:41.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.208+0000 7fa13559a700 1 -- 172.21.2.105:0/3316869496 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa130009ea0 con 0x7fa1380af730 2021-11-12T05:47:41.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.208+0000 7fa13559a700 1 -- 172.21.2.105:0/3316869496 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa13000b8a0 con 0x7fa1380af730 2021-11-12T05:47:41.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.208+0000 7fa13559a700 1 -- 172.21.2.105:0/3316869496 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa13000ba50 con 0x7fa1380af730 2021-11-12T05:47:41.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.208+0000 7fa13ca66700 1 -- 172.21.2.105:0/3316869496 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1380af730 msgr2=0x7fa1380ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:41.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.208+0000 7fa13ca66700 1 --2- 172.21.2.105:0/3316869496 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1380af730 0x7fa1380ad460 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 rx=0x7fa1300032f0 tx=0x7fa1300091d0).stop 2021-11-12T05:47:41.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.208+0000 7fa13ca66700 1 -- 172.21.2.105:0/3316869496 shutdown_connections 2021-11-12T05:47:41.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.208+0000 7fa13ca66700 1 --2- 172.21.2.105:0/3316869496 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1380af730 0x7fa1380ad460 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:41.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.208+0000 7fa13ca66700 1 --2- 172.21.2.105:0/3316869496 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1380ac280 0x7fa13814b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:41.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.208+0000 7fa13ca66700 1 -- 172.21.2.105:0/3316869496 >> 172.21.2.105:0/3316869496 conn(0x7fa1380b5370 msgr2=0x7fa1380b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:41.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.208+0000 7fa13ca66700 1 -- 172.21.2.105:0/3316869496 shutdown_connections 2021-11-12T05:47:41.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.208+0000 7fa13ca66700 1 -- 172.21.2.105:0/3316869496 wait complete. 2021-11-12T05:47:41.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.208+0000 7fa13ca66700 1 Processor -- start 2021-11-12T05:47:41.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.208+0000 7fa13ca66700 1 -- start start 2021-11-12T05:47:41.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.212+0000 7fa13ca66700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa1380ac280 0x7fa1380a7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:41.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.212+0000 7fa13ca66700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1380ad080 0x7fa138063c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:41.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.212+0000 7fa13ca66700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1380af730 0x7fa138157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:41.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.212+0000 7fa13ca66700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa138064150 con 0x7fa1380ad080 2021-11-12T05:47:41.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.212+0000 7fa13ca66700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa138156cd0 con 0x7fa1380ac280 2021-11-12T05:47:41.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.212+0000 7fa13ca66700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1380a9650 con 0x7fa1380af730 2021-11-12T05:47:41.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.212+0000 7fa135d9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1380ad080 0x7fa138063c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:41.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.212+0000 7fa135d9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1380ad080 0x7fa138063c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48678/0 (socket says 172.21.2.105:48678) 2021-11-12T05:47:41.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.212+0000 7fa135d9b700 1 -- 172.21.2.105:0/4015531667 learned_addr learned my addr 172.21.2.105:0/4015531667 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:41.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.212+0000 7fa135d9b700 1 -- 172.21.2.105:0/4015531667 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1380af730 msgr2=0x7fa138157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:41.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.212+0000 7fa135d9b700 1 --2- 172.21.2.105:0/4015531667 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1380af730 0x7fa138157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:41.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.212+0000 7fa135d9b700 1 -- 172.21.2.105:0/4015531667 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa1380ac280 msgr2=0x7fa1380a7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:41.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.212+0000 7fa135d9b700 1 --2- 172.21.2.105:0/4015531667 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa1380ac280 0x7fa1380a7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:41.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.212+0000 7fa135d9b700 1 -- 172.21.2.105:0/4015531667 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa130009470 con 0x7fa1380ad080 2021-11-12T05:47:41.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.212+0000 7fa135d9b700 1 --2- 172.21.2.105:0/4015531667 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1380ad080 0x7fa138063c60 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7fa128002fb0 tx=0x7fa128006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:41.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.212+0000 7fa12f7fe700 1 -- 172.21.2.105:0/4015531667 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa128013460 con 0x7fa1380ad080 2021-11-12T05:47:41.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.212+0000 7fa12f7fe700 1 -- 172.21.2.105:0/4015531667 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1280135c0 con 0x7fa1380ad080 2021-11-12T05:47:41.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.212+0000 7fa12f7fe700 1 -- 172.21.2.105:0/4015531667 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa128013920 con 0x7fa1380ad080 2021-11-12T05:47:41.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.212+0000 7fa13ca66700 1 -- 172.21.2.105:0/4015531667 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa138157d60 con 0x7fa1380ad080 2021-11-12T05:47:41.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.212+0000 7fa13ca66700 1 -- 172.21.2.105:0/4015531667 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1380a92d0 con 0x7fa1380ad080 2021-11-12T05:47:41.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.212+0000 7fa13ca66700 1 -- 172.21.2.105:0/4015531667 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa138156e40 con 0x7fa1380ad080 2021-11-12T05:47:41.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.212+0000 7fa12f7fe700 1 -- 172.21.2.105:0/4015531667 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa12800f070 con 0x7fa1380ad080 2021-11-12T05:47:41.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.212+0000 7fa12f7fe700 1 --2- 172.21.2.105:0/4015531667 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa11c053720 0x7fa11c055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:41.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.212+0000 7fa12f7fe700 1 -- 172.21.2.105:0/4015531667 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6588+0+0 (secure 0 0 0) 0x7fa12806b6c0 con 0x7fa1380ad080 2021-11-12T05:47:41.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.212+0000 7fa13659c700 1 --2- 172.21.2.105:0/4015531667 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa11c053720 0x7fa11c055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:41.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.212+0000 7fa13659c700 1 --2- 172.21.2.105:0/4015531667 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa11c053720 0x7fa11c055be0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7fa13814bc40 tx=0x7fa1200077f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:41.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.216+0000 7fa12f7fe700 1 -- 172.21.2.105:0/4015531667 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa138156e40 con 0x7fa1380ad080 2021-11-12T05:47:41.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:41.296+0000 7fa13ca66700 1 -- 172.21.2.105:0/4015531667 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa138156e40 con 0x7fa1380ad080 2021-11-12T05:47:42.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.152+0000 7fa12f7fe700 1 -- 172.21.2.105:0/4015531667 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v88) v1 ==== 185+0+0 (secure 0 0 0) 0x7fa138156e40 con 0x7fa1380ad080 2021-11-12T05:47:42.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.152+0000 7fa13ca66700 1 -- 172.21.2.105:0/4015531667 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa11c053720 msgr2=0x7fa11c055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:42.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.152+0000 7fa13ca66700 1 --2- 172.21.2.105:0/4015531667 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa11c053720 0x7fa11c055be0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7fa13814bc40 tx=0x7fa1200077f0).stop 2021-11-12T05:47:42.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.152+0000 7fa13ca66700 1 -- 172.21.2.105:0/4015531667 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1380ad080 msgr2=0x7fa138063c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:42.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.152+0000 7fa13ca66700 1 --2- 172.21.2.105:0/4015531667 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1380ad080 0x7fa138063c60 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7fa128002fb0 tx=0x7fa128006df0).stop 2021-11-12T05:47:42.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.152+0000 7fa13ca66700 1 -- 172.21.2.105:0/4015531667 shutdown_connections 2021-11-12T05:47:42.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.152+0000 7fa13ca66700 1 --2- 172.21.2.105:0/4015531667 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa11c053720 0x7fa11c055be0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:42.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.152+0000 7fa13ca66700 1 --2- 172.21.2.105:0/4015531667 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1380af730 0x7fa138157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:42.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.152+0000 7fa13ca66700 1 --2- 172.21.2.105:0/4015531667 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1380ad080 0x7fa138063c60 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:42.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.152+0000 7fa13ca66700 1 --2- 172.21.2.105:0/4015531667 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa1380ac280 0x7fa1380a7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:42.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.152+0000 7fa13ca66700 1 -- 172.21.2.105:0/4015531667 >> 172.21.2.105:0/4015531667 conn(0x7fa1380b5370 msgr2=0x7fa138143d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:42.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.152+0000 7fa13ca66700 1 -- 172.21.2.105:0/4015531667 shutdown_connections 2021-11-12T05:47:42.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.152+0000 7fa13ca66700 1 -- 172.21.2.105:0/4015531667 wait complete. 2021-11-12T05:47:42.159 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_metadata' removed 2021-11-12T05:47:42.163 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-12T05:47:42.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.232+0000 7f924790f700 1 Processor -- start 2021-11-12T05:47:42.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.232+0000 7f924790f700 1 -- start start 2021-11-12T05:47:42.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.232+0000 7f924790f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f92400ade80 0x7f92400601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:42.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.232+0000 7f924790f700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f924013a9c0 0x7f924013ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:42.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.232+0000 7f924790f700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9240066150 con 0x7f924005fdc0 2021-11-12T05:47:42.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.232+0000 7f924790f700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9240141fb0 con 0x7f924013a9c0 2021-11-12T05:47:42.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.232+0000 7f924790f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92400663f0 con 0x7f92400ade80 2021-11-12T05:47:42.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.232+0000 7f92456ab700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f924005fdc0 0x7f9240066730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:59080/0 (socket says 172.21.2.105:59080) 2021-11-12T05:47:42.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.232+0000 7f92456ab700 1 -- 172.21.2.105:0/2378104870 learned_addr learned my addr 172.21.2.105:0/2378104870 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:42.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.232+0000 7f9233fff700 1 -- 172.21.2.105:0/2378104870 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3328704638 0 0) 0x7f9240066150 con 0x7f924005fdc0 2021-11-12T05:47:42.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.232+0000 7f9233fff700 1 -- 172.21.2.105:0/2378104870 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9228003260 con 0x7f924005fdc0 2021-11-12T05:47:42.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.232+0000 7f9233fff700 1 -- 172.21.2.105:0/2378104870 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2095421724 0 0) 0x7f9228003260 con 0x7f924005fdc0 2021-11-12T05:47:42.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.232+0000 7f9233fff700 1 -- 172.21.2.105:0/2378104870 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f92400ade80 msgr2=0x7f92400601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:42.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.232+0000 7f9233fff700 1 --2- 172.21.2.105:0/2378104870 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f92400ade80 0x7f92400601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:42.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.232+0000 7f9233fff700 1 -- 172.21.2.105:0/2378104870 >> v2:172.21.2.115:3300/0 conn(0x7f924013a9c0 msgr2=0x7f924013ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:42.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.232+0000 7f9233fff700 1 --2- 172.21.2.105:0/2378104870 >> v2:172.21.2.115:3300/0 conn(0x7f924013a9c0 0x7f924013ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:42.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.232+0000 7f9233fff700 1 -- 172.21.2.105:0/2378104870 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9240140fd0 con 0x7f924005fdc0 2021-11-12T05:47:42.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.232+0000 7f9233fff700 1 -- 172.21.2.105:0/2378104870 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f923c001680 con 0x7f924005fdc0 2021-11-12T05:47:42.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.232+0000 7f9233fff700 1 -- 172.21.2.105:0/2378104870 >> v1:172.21.2.105:6789/0 conn(0x7f924005fdc0 legacy=0x7f9240066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:42.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.232+0000 7f9233fff700 1 --2- 172.21.2.105:0/2378104870 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9228003750 0x7f9228003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:42.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.232+0000 7f9233fff700 1 --2- 172.21.2.105:0/2378104870 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f92400ade80 0x7f9228004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:42.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.232+0000 7f9233fff700 1 --2- 172.21.2.105:0/2378104870 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9228004b10 0x7f9228004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:42.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.232+0000 7f9233fff700 1 -- 172.21.2.105:0/2378104870 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92400663f0 con 0x7f9228003750 2021-11-12T05:47:42.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.232+0000 7f9233fff700 1 -- 172.21.2.105:0/2378104870 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922800fd20 con 0x7f9228004b10 2021-11-12T05:47:42.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.232+0000 7f9233fff700 1 -- 172.21.2.105:0/2378104870 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f922800fee0 con 0x7f92400ade80 2021-11-12T05:47:42.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.232+0000 7f92456ab700 1 --2- 172.21.2.105:0/2378104870 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9228003750 0x7f9228003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:42.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f92456ab700 1 -- 172.21.2.105:0/2378104870 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f92400ade80 msgr2=0x7f9228004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:42.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f92456ab700 1 --2- 172.21.2.105:0/2378104870 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f92400ade80 0x7f9228004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:42.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f92456ab700 1 -- 172.21.2.105:0/2378104870 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9228004b10 msgr2=0x7f9228004f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:42.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f92456ab700 1 --2- 172.21.2.105:0/2378104870 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9228004b10 0x7f9228004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:42.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f92456ab700 1 -- 172.21.2.105:0/2378104870 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9228003260 con 0x7f9228003750 2021-11-12T05:47:42.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f92456ab700 1 --2- 172.21.2.105:0/2378104870 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9228003750 0x7f9228003b70 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7f923c001390 tx=0x7f92400662e0).ready entity=mon.0 client_cookie=52913504ac1bfc17 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:42.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f9233fff700 1 -- 172.21.2.105:0/2378104870 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f923c007170 con 0x7f9228003750 2021-11-12T05:47:42.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f9233fff700 1 -- 172.21.2.105:0/2378104870 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f923c0072d0 con 0x7f9228003750 2021-11-12T05:47:42.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f9233fff700 1 -- 172.21.2.105:0/2378104870 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f923c00c9c0 con 0x7f9228003750 2021-11-12T05:47:42.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f924790f700 1 -- 172.21.2.105:0/2378104870 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9228003750 msgr2=0x7f9228003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:42.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f924790f700 1 --2- 172.21.2.105:0/2378104870 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9228003750 0x7f9228003b70 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7f923c001390 tx=0x7f92400662e0).stop 2021-11-12T05:47:42.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f9245eac700 1 -- 172.21.2.105:0/2378104870 reap_dead start 2021-11-12T05:47:42.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f924790f700 1 -- 172.21.2.105:0/2378104870 shutdown_connections 2021-11-12T05:47:42.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f924790f700 1 -- 172.21.2.105:0/2378104870 >> 172.21.2.105:0/2378104870 conn(0x7f92400608d0 msgr2=0x7f924005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:42.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f924790f700 1 -- 172.21.2.105:0/2378104870 shutdown_connections 2021-11-12T05:47:42.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f924790f700 1 -- 172.21.2.105:0/2378104870 wait complete. 2021-11-12T05:47:42.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f924790f700 1 Processor -- start 2021-11-12T05:47:42.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f924790f700 1 -- start start 2021-11-12T05:47:42.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f924790f700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9228003750 0x7f9240136cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:42.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f924790f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f92400b0ef0 0x7f9240151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:42.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f924790f700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f92400b3e50 0x7f92400b7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:42.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f924790f700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92400b75d0 con 0x7f9228003750 2021-11-12T05:47:42.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f924790f700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92400b0040 con 0x7f92400b3e50 2021-11-12T05:47:42.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f924790f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92400b02e0 con 0x7f92400b0ef0 2021-11-12T05:47:42.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f92456ab700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9228003750 0x7f9240136cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:42.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f92456ab700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9228003750 0x7f9240136cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48698/0 (socket says 172.21.2.105:48698) 2021-11-12T05:47:42.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f92456ab700 1 -- 172.21.2.105:0/4292212004 learned_addr learned my addr 172.21.2.105:0/4292212004 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:42.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f92456ab700 1 -- 172.21.2.105:0/4292212004 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f92400b0ef0 msgr2=0x7f9240151590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:42.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f92456ab700 1 --2- 172.21.2.105:0/4292212004 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f92400b0ef0 0x7f9240151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:42.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f92456ab700 1 -- 172.21.2.105:0/4292212004 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f92400b3e50 msgr2=0x7f92400b7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:42.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f92456ab700 1 --2- 172.21.2.105:0/4292212004 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f92400b3e50 0x7f92400b7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:42.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f92456ab700 1 -- 172.21.2.105:0/4292212004 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92400b4b70 con 0x7f9228003750 2021-11-12T05:47:42.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f92456ab700 1 --2- 172.21.2.105:0/4292212004 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9228003750 0x7f9240136cc0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7f923c001390 tx=0x7f923c013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:42.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f92327fc700 1 -- 172.21.2.105:0/4292212004 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f923c007170 con 0x7f9228003750 2021-11-12T05:47:42.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f92327fc700 1 -- 172.21.2.105:0/4292212004 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f923c00cec0 con 0x7f9228003750 2021-11-12T05:47:42.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f92327fc700 1 -- 172.21.2.105:0/4292212004 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f923c007860 con 0x7f9228003750 2021-11-12T05:47:42.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f924790f700 1 -- 172.21.2.105:0/4292212004 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92400afcc0 con 0x7f9228003750 2021-11-12T05:47:42.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f924790f700 1 -- 172.21.2.105:0/4292212004 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92400b44f0 con 0x7f9228003750 2021-11-12T05:47:42.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.236+0000 7f924790f700 1 -- 172.21.2.105:0/4292212004 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92400b7710 con 0x7f9228003750 2021-11-12T05:47:42.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.240+0000 7f92327fc700 1 -- 172.21.2.105:0/4292212004 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f923c027070 con 0x7f9228003750 2021-11-12T05:47:42.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.240+0000 7f92327fc700 1 --2- 172.21.2.105:0/4292212004 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f92200536a0 0x7f9220055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:42.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.240+0000 7f92327fc700 1 -- 172.21.2.105:0/4292212004 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f923c06c0c0 con 0x7f9228003750 2021-11-12T05:47:42.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.240+0000 7f9244eaa700 1 --2- 172.21.2.105:0/4292212004 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f92200536a0 0x7f9220055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:42.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.240+0000 7f9244eaa700 1 --2- 172.21.2.105:0/4292212004 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f92200536a0 0x7f9220055b60 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f9234002f70 tx=0x7f9234006a10).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:42.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.240+0000 7f92327fc700 1 -- 172.21.2.105:0/4292212004 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f923c0431d0 con 0x7f9228003750 2021-11-12T05:47:42.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:42.324+0000 7f924790f700 1 -- 172.21.2.105:0/4292212004 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9240057350 con 0x7f9228003750 2021-11-12T05:47:43.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.156+0000 7f92327fc700 1 -- 172.21.2.105:0/4292212004 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v89) v1 ==== 173+0+0 (secure 0 0 0) 0x7f923c0467f0 con 0x7f9228003750 2021-11-12T05:47:43.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.160+0000 7f924790f700 1 -- 172.21.2.105:0/4292212004 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f92200536a0 msgr2=0x7f9220055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:43.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.160+0000 7f924790f700 1 --2- 172.21.2.105:0/4292212004 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f92200536a0 0x7f9220055b60 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f9234002f70 tx=0x7f9234006a10).stop 2021-11-12T05:47:43.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.160+0000 7f924790f700 1 -- 172.21.2.105:0/4292212004 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9228003750 msgr2=0x7f9240136cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:43.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.160+0000 7f924790f700 1 --2- 172.21.2.105:0/4292212004 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9228003750 0x7f9240136cc0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7f923c001390 tx=0x7f923c013000).stop 2021-11-12T05:47:43.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.160+0000 7f924790f700 1 -- 172.21.2.105:0/4292212004 shutdown_connections 2021-11-12T05:47:43.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.160+0000 7f924790f700 1 --2- 172.21.2.105:0/4292212004 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f92200536a0 0x7f9220055b60 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:43.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.160+0000 7f924790f700 1 --2- 172.21.2.105:0/4292212004 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f92400b3e50 0x7f92400b7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:43.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.160+0000 7f924790f700 1 --2- 172.21.2.105:0/4292212004 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f92400b0ef0 0x7f9240151590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:43.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.160+0000 7f924790f700 1 --2- 172.21.2.105:0/4292212004 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9228003750 0x7f9240136cc0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:43.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.160+0000 7f924790f700 1 -- 172.21.2.105:0/4292212004 >> 172.21.2.105:0/4292212004 conn(0x7f92400608d0 msgr2=0x7f9240141390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:43.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.160+0000 7f924790f700 1 -- 172.21.2.105:0/4292212004 shutdown_connections 2021-11-12T05:47:43.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.160+0000 7f924790f700 1 -- 172.21.2.105:0/4292212004 wait complete. 2021-11-12T05:47:43.166 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_data' removed 2021-11-12T05:47:43.169 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-11-12T05:47:43.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.216+0000 7f545460c700 1 Processor -- start 2021-11-12T05:47:43.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.216+0000 7f545460c700 1 -- start start 2021-11-12T05:47:43.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.216+0000 7f545460c700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f544c0b7c80 0x7f544c067170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:43.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.216+0000 7f545460c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f544c140f90 0x7f544c1413b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:43.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.216+0000 7f545460c700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f544c0b8060 con 0x7f544c064900 2021-11-12T05:47:43.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.216+0000 7f545460c700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f544c067d80 con 0x7f544c0b7c80 2021-11-12T05:47:43.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.216+0000 7f545460c700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f544c067660 con 0x7f544c140f90 2021-11-12T05:47:43.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.220+0000 7f5452ba9700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f544c140f90 0x7f544c1413b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:43.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.220+0000 7f5452ba9700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f544c140f90 0x7f544c1413b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3301/0 says I am v2:172.21.2.105:39898/0 (socket says 172.21.2.105:39898) 2021-11-12T05:47:43.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.220+0000 7f5452ba9700 1 -- 172.21.2.105:0/4053138234 learned_addr learned my addr 172.21.2.105:0/4053138234 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:43.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.220+0000 7f54523a8700 1 --2- 172.21.2.105:0/4053138234 >> v2:172.21.2.115:3300/0 conn(0x7f544c0b7c80 0x7f544c067170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:43.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.220+0000 7f5452ba9700 1 -- 172.21.2.105:0/4053138234 >> v2:172.21.2.115:3300/0 conn(0x7f544c0b7c80 msgr2=0x7f544c067170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:43.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.220+0000 7f5452ba9700 1 --2- 172.21.2.105:0/4053138234 >> v2:172.21.2.115:3300/0 conn(0x7f544c0b7c80 0x7f544c067170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:43.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.220+0000 7f5452ba9700 1 -- 172.21.2.105:0/4053138234 >> v1:172.21.2.115:6789/0 conn(0x7f544c064900 legacy=0x7f544c064d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:43.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.220+0000 7f5452ba9700 1 -- 172.21.2.105:0/4053138234 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f544c067840 con 0x7f544c140f90 2021-11-12T05:47:43.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.220+0000 7f54523a8700 1 --2- 172.21.2.105:0/4053138234 >> v2:172.21.2.115:3300/0 conn(0x7f544c0b7c80 0x7f544c067170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-12T05:47:43.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.220+0000 7f5452ba9700 1 --2- 172.21.2.105:0/4053138234 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f544c140f90 0x7f544c1413b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f54440032f0 tx=0x7f5444009290).ready entity=mon.2 client_cookie=295a7647bead74e2 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:43.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.220+0000 7f54513a6700 1 -- 172.21.2.105:0/4053138234 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f544400b8a0 con 0x7f544c140f90 2021-11-12T05:47:43.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.220+0000 7f54513a6700 1 -- 172.21.2.105:0/4053138234 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544400ba00 con 0x7f544c140f90 2021-11-12T05:47:43.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.220+0000 7f54513a6700 1 -- 172.21.2.105:0/4053138234 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f544400bb70 con 0x7f544c140f90 2021-11-12T05:47:43.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.220+0000 7f545460c700 1 -- 172.21.2.105:0/4053138234 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f544c140f90 msgr2=0x7f544c1413b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:43.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.220+0000 7f545460c700 1 --2- 172.21.2.105:0/4053138234 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f544c140f90 0x7f544c1413b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f54440032f0 tx=0x7f5444009290).stop 2021-11-12T05:47:43.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.220+0000 7f545460c700 1 -- 172.21.2.105:0/4053138234 shutdown_connections 2021-11-12T05:47:43.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.220+0000 7f545460c700 1 --2- 172.21.2.105:0/4053138234 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f544c140f90 0x7f544c1413b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:43.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.220+0000 7f545460c700 1 --2- 172.21.2.105:0/4053138234 >> v2:172.21.2.115:3300/0 conn(0x7f544c0b7c80 0x7f544c067170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:43.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.220+0000 7f545460c700 1 -- 172.21.2.105:0/4053138234 >> 172.21.2.105:0/4053138234 conn(0x7f544c05c860 msgr2=0x7f544c0608d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:43.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.220+0000 7f545460c700 1 -- 172.21.2.105:0/4053138234 shutdown_connections 2021-11-12T05:47:43.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.220+0000 7f545460c700 1 -- 172.21.2.105:0/4053138234 wait complete. 2021-11-12T05:47:43.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.220+0000 7f545460c700 1 Processor -- start 2021-11-12T05:47:43.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.220+0000 7f545460c700 1 -- start start 2021-11-12T05:47:43.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.220+0000 7f545460c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f544c064900 0x7f544c0ae760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:43.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.220+0000 7f545460c700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f544c0b7c80 0x7f544c0ad600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:43.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.220+0000 7f545460c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f544c140f90 0x7f544c13f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:43.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.220+0000 7f545460c700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544c140950 con 0x7f544c140f90 2021-11-12T05:47:43.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.220+0000 7f545460c700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544c0b10d0 con 0x7f544c0b7c80 2021-11-12T05:47:43.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.220+0000 7f545460c700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f544c0b1240 con 0x7f544c064900 2021-11-12T05:47:43.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.220+0000 7f5452ba9700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f544c140f90 0x7f544c13f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:43.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.220+0000 7f5452ba9700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f544c140f90 0x7f544c13f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48714/0 (socket says 172.21.2.105:48714) 2021-11-12T05:47:43.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.220+0000 7f5452ba9700 1 -- 172.21.2.105:0/4108867920 learned_addr learned my addr 172.21.2.105:0/4108867920 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:43.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.224+0000 7f5452ba9700 1 -- 172.21.2.105:0/4108867920 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f544c064900 msgr2=0x7f544c0ae760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:43.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.224+0000 7f5452ba9700 1 --2- 172.21.2.105:0/4108867920 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f544c064900 0x7f544c0ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:43.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.224+0000 7f5452ba9700 1 -- 172.21.2.105:0/4108867920 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f544c0b7c80 msgr2=0x7f544c0ad600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:43.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.224+0000 7f5451ba7700 1 --2- 172.21.2.105:0/4108867920 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f544c0b7c80 0x7f544c0ad600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:43.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.224+0000 7f5452ba9700 1 --2- 172.21.2.105:0/4108867920 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f544c0b7c80 0x7f544c0ad600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:43.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.224+0000 7f5452ba9700 1 -- 172.21.2.105:0/4108867920 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f544800b180 con 0x7f544c140f90 2021-11-12T05:47:43.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.224+0000 7f5452ba9700 1 --2- 172.21.2.105:0/4108867920 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f544c140f90 0x7f544c13f910 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 rx=0x7f54440032f0 tx=0x7f5444016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:43.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.224+0000 7f543f7fe700 1 -- 172.21.2.105:0/4108867920 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f544400b8a0 con 0x7f544c140f90 2021-11-12T05:47:43.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.224+0000 7f543f7fe700 1 -- 172.21.2.105:0/4108867920 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5444021630 con 0x7f544c140f90 2021-11-12T05:47:43.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.224+0000 7f545460c700 1 -- 172.21.2.105:0/4108867920 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5444009530 con 0x7f544c140f90 2021-11-12T05:47:43.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.224+0000 7f545460c700 1 -- 172.21.2.105:0/4108867920 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f544c0adc90 con 0x7f544c140f90 2021-11-12T05:47:43.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.224+0000 7f543f7fe700 1 -- 172.21.2.105:0/4108867920 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5444021990 con 0x7f544c140f90 2021-11-12T05:47:43.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.224+0000 7f545460c700 1 -- 172.21.2.105:0/4108867920 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f544c067ae0 con 0x7f544c140f90 2021-11-12T05:47:43.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.224+0000 7f543f7fe700 1 -- 172.21.2.105:0/4108867920 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5444027020 con 0x7f544c140f90 2021-11-12T05:47:43.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.224+0000 7f543f7fe700 1 --2- 172.21.2.105:0/4108867920 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f542c053690 0x7f542c055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:43.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.224+0000 7f543f7fe700 1 -- 172.21.2.105:0/4108867920 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5768+0+0 (secure 0 0 0) 0x7f544406cc40 con 0x7f544c140f90 2021-11-12T05:47:43.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.224+0000 7f54523a8700 1 --2- 172.21.2.105:0/4108867920 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f542c053690 0x7f542c055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:43.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.224+0000 7f54523a8700 1 --2- 172.21.2.105:0/4108867920 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f542c053690 0x7f542c055b50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f544800c000 tx=0x7f5448006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:43.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.228+0000 7f543f7fe700 1 -- 172.21.2.105:0/4108867920 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5444043e00 con 0x7f544c140f90 2021-11-12T05:47:43.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.312+0000 7f545460c700 1 -- 172.21.2.105:0/4108867920 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f544c057350 con 0x7f544c140f90 2021-11-12T05:47:43.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.316+0000 7f543f7fe700 1 -- 172.21.2.105:0/4108867920 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f54440150a0 con 0x7f544c140f90 2021-11-12T05:47:43.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.316+0000 7f545460c700 1 -- 172.21.2.105:0/4108867920 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f542c053690 msgr2=0x7f542c055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:43.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.316+0000 7f545460c700 1 --2- 172.21.2.105:0/4108867920 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f542c053690 0x7f542c055b50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f544800c000 tx=0x7f5448006df0).stop 2021-11-12T05:47:43.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.316+0000 7f545460c700 1 -- 172.21.2.105:0/4108867920 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f544c140f90 msgr2=0x7f544c13f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:43.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.316+0000 7f545460c700 1 --2- 172.21.2.105:0/4108867920 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f544c140f90 0x7f544c13f910 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 rx=0x7f54440032f0 tx=0x7f5444016000).stop 2021-11-12T05:47:43.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.316+0000 7f545460c700 1 -- 172.21.2.105:0/4108867920 shutdown_connections 2021-11-12T05:47:43.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.316+0000 7f545460c700 1 --2- 172.21.2.105:0/4108867920 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f542c053690 0x7f542c055b50 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:43.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.316+0000 7f545460c700 1 --2- 172.21.2.105:0/4108867920 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f544c140f90 0x7f544c13f910 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:43.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.316+0000 7f545460c700 1 --2- 172.21.2.105:0/4108867920 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f544c0b7c80 0x7f544c0ad600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:43.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.316+0000 7f545460c700 1 --2- 172.21.2.105:0/4108867920 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f544c064900 0x7f544c0ae760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:43.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.316+0000 7f545460c700 1 -- 172.21.2.105:0/4108867920 >> 172.21.2.105:0/4108867920 conn(0x7f544c05c860 msgr2=0x7f544c0654e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:43.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.316+0000 7f545460c700 1 -- 172.21.2.105:0/4108867920 shutdown_connections 2021-11-12T05:47:43.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.316+0000 7f545460c700 1 -- 172.21.2.105:0/4108867920 wait complete. 2021-11-12T05:47:43.328 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode' 2021-11-12T05:47:43.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.372+0000 7f87460ff700 1 Processor -- start 2021-11-12T05:47:43.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.372+0000 7f87460ff700 1 -- start start 2021-11-12T05:47:43.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f87460ff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f87400626b0 0x7f8740062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:43.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f87460ff700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f87400af750 0x7f8740130370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:43.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f87460ff700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8740130d10 con 0x7f8740130860 2021-11-12T05:47:43.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f87460ff700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87400b0d50 con 0x7f87400626b0 2021-11-12T05:47:43.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f87460ff700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87400ad380 con 0x7f87400af750 2021-11-12T05:47:43.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f873f7fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f87400626b0 0x7f8740062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:43.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f873f7fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f87400626b0 0x7f8740062a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48718/0 (socket says 172.21.2.105:48718) 2021-11-12T05:47:43.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f873f7fe700 1 -- 172.21.2.105:0/1284376109 learned_addr learned my addr 172.21.2.105:0/1284376109 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:43.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f873f7fe700 1 -- 172.21.2.105:0/1284376109 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f87400af750 msgr2=0x7f8740130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:43.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f873f7fe700 1 --2- 172.21.2.105:0/1284376109 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f87400af750 0x7f8740130370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:43.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f873f7fe700 1 -- 172.21.2.105:0/1284376109 >> v1:172.21.2.115:6789/0 conn(0x7f8740130860 legacy=0x7f874014a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:43.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f873f7fe700 1 -- 172.21.2.105:0/1284376109 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87400ae190 con 0x7f87400626b0 2021-11-12T05:47:43.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f873f7fe700 1 --2- 172.21.2.105:0/1284376109 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f87400626b0 0x7f8740062a90 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7f87400af1d0 tx=0x7f8730006eb0).ready entity=mon.0 client_cookie=de8f24e295444766 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:43.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f873e7fc700 1 -- 172.21.2.105:0/1284376109 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f873000d570 con 0x7f87400626b0 2021-11-12T05:47:43.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f873e7fc700 1 -- 172.21.2.105:0/1284376109 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8730000e90 con 0x7f87400626b0 2021-11-12T05:47:43.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f873e7fc700 1 -- 172.21.2.105:0/1284376109 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f873000d8c0 con 0x7f87400626b0 2021-11-12T05:47:43.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f87460ff700 1 -- 172.21.2.105:0/1284376109 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f87400626b0 msgr2=0x7f8740062a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:43.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f87460ff700 1 --2- 172.21.2.105:0/1284376109 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f87400626b0 0x7f8740062a90 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7f87400af1d0 tx=0x7f8730006eb0).stop 2021-11-12T05:47:43.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f87460ff700 1 -- 172.21.2.105:0/1284376109 shutdown_connections 2021-11-12T05:47:43.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f87460ff700 1 --2- 172.21.2.105:0/1284376109 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f87400af750 0x7f8740130370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:43.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f87460ff700 1 --2- 172.21.2.105:0/1284376109 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f87400626b0 0x7f8740062a90 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:43.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f87460ff700 1 -- 172.21.2.105:0/1284376109 >> 172.21.2.105:0/1284376109 conn(0x7f87400b5320 msgr2=0x7f87400b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:43.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f87460ff700 1 -- 172.21.2.105:0/1284376109 shutdown_connections 2021-11-12T05:47:43.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f87460ff700 1 -- 172.21.2.105:0/1284376109 wait complete. 2021-11-12T05:47:43.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f87460ff700 1 Processor -- start 2021-11-12T05:47:43.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f87460ff700 1 -- start start 2021-11-12T05:47:43.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f87460ff700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f87400626b0 0x7f874015a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:43.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f87460ff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f87400af750 0x7f8740145490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:43.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f87460ff700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8740130860 0x7f8740157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:43.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f87460ff700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8740156c20 con 0x7f87400af750 2021-11-12T05:47:43.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f87460ff700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8740134950 con 0x7f87400626b0 2021-11-12T05:47:43.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f87460ff700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8740066360 con 0x7f8740130860 2021-11-12T05:47:43.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f873effd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f87400af750 0x7f8740145490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:43.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f873effd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f87400af750 0x7f8740145490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48728/0 (socket says 172.21.2.105:48728) 2021-11-12T05:47:43.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f873effd700 1 -- 172.21.2.105:0/1300235262 learned_addr learned my addr 172.21.2.105:0/1300235262 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:43.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f873effd700 1 -- 172.21.2.105:0/1300235262 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8740130860 msgr2=0x7f8740157270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:43.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f873effd700 1 --2- 172.21.2.105:0/1300235262 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8740130860 0x7f8740157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:43.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f873effd700 1 -- 172.21.2.105:0/1300235262 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f87400626b0 msgr2=0x7f874015a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:43.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f873effd700 1 --2- 172.21.2.105:0/1300235262 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f87400626b0 0x7f874015a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:43.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f873effd700 1 -- 172.21.2.105:0/1300235262 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873000b1e0 con 0x7f87400af750 2021-11-12T05:47:43.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f873effd700 1 --2- 172.21.2.105:0/1300235262 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f87400af750 0x7f8740145490 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7f8728002f70 tx=0x7f8728006e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:43.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f873cff9700 1 -- 172.21.2.105:0/1300235262 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8728013460 con 0x7f87400af750 2021-11-12T05:47:43.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f873cff9700 1 -- 172.21.2.105:0/1300235262 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87280135c0 con 0x7f87400af750 2021-11-12T05:47:43.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f87460ff700 1 -- 172.21.2.105:0/1300235262 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8740156e10 con 0x7f87400af750 2021-11-12T05:47:43.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f873cff9700 1 -- 172.21.2.105:0/1300235262 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8728013920 con 0x7f87400af750 2021-11-12T05:47:43.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.376+0000 7f87460ff700 1 -- 172.21.2.105:0/1300235262 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f874015a740 con 0x7f87400af750 2021-11-12T05:47:43.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.380+0000 7f87460ff700 1 -- 172.21.2.105:0/1300235262 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8740057350 con 0x7f87400af750 2021-11-12T05:47:43.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.380+0000 7f873cff9700 1 -- 172.21.2.105:0/1300235262 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f872801a060 con 0x7f87400af750 2021-11-12T05:47:43.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.380+0000 7f873cff9700 1 --2- 172.21.2.105:0/1300235262 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f87240536d0 0x7f8724055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:43.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.380+0000 7f873cff9700 1 -- 172.21.2.105:0/1300235262 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5768+0+0 (secure 0 0 0) 0x7f872806b0f0 con 0x7f87400af750 2021-11-12T05:47:43.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.380+0000 7f873f7fe700 1 --2- 172.21.2.105:0/1300235262 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f87240536d0 0x7f8724055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:43.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.380+0000 7f873f7fe700 1 --2- 172.21.2.105:0/1300235262 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f87240536d0 0x7f8724055b90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f87400af1d0 tx=0x7f8730015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:43.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.380+0000 7f873cff9700 1 -- 172.21.2.105:0/1300235262 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8728042380 con 0x7f87400af750 2021-11-12T05:47:43.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:43.492+0000 7f87460ff700 1 -- 172.21.2.105:0/1300235262 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]} v 0) v1 -- 0x7f8740156fa0 con 0x7f87400af750 2021-11-12T05:47:44.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.164+0000 7f873cff9700 1 -- 172.21.2.105:0/1300235262 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]}]=0 v294) v1 ==== 126+0+0 (secure 0 0 0) 0x7f87280459a0 con 0x7f87400af750 2021-11-12T05:47:44.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.168+0000 7f87460ff700 1 -- 172.21.2.105:0/1300235262 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f87240536d0 msgr2=0x7f8724055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:44.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.168+0000 7f87460ff700 1 --2- 172.21.2.105:0/1300235262 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f87240536d0 0x7f8724055b90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f87400af1d0 tx=0x7f8730015000).stop 2021-11-12T05:47:44.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.168+0000 7f87460ff700 1 -- 172.21.2.105:0/1300235262 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f87400af750 msgr2=0x7f8740145490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:44.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.168+0000 7f87460ff700 1 --2- 172.21.2.105:0/1300235262 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f87400af750 0x7f8740145490 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7f8728002f70 tx=0x7f8728006e90).stop 2021-11-12T05:47:44.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.168+0000 7f87460ff700 1 -- 172.21.2.105:0/1300235262 shutdown_connections 2021-11-12T05:47:44.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.168+0000 7f87460ff700 1 --2- 172.21.2.105:0/1300235262 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f87240536d0 0x7f8724055b90 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:44.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.168+0000 7f87460ff700 1 --2- 172.21.2.105:0/1300235262 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8740130860 0x7f8740157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:44.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.168+0000 7f87460ff700 1 --2- 172.21.2.105:0/1300235262 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f87400af750 0x7f8740145490 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:44.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.168+0000 7f87460ff700 1 --2- 172.21.2.105:0/1300235262 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f87400626b0 0x7f874015a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:44.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.168+0000 7f87460ff700 1 -- 172.21.2.105:0/1300235262 >> 172.21.2.105:0/1300235262 conn(0x7f87400b5320 msgr2=0x7f874014a860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:44.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.168+0000 7f87460ff700 1 -- 172.21.2.105:0/1300235262 shutdown_connections 2021-11-12T05:47:44.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.168+0000 7f87460ff700 1 -- 172.21.2.105:0/1300235262 wait complete. 2021-11-12T05:47:44.179 INFO:tasks.cephfs_test_runner:test_dump_inode (tasks.cephfs.test_misc.TestMisc) ... ok 2021-11-12T05:47:44.179 INFO:tasks.cephfs_test_runner:Starting test: test_dump_inode_hexademical (tasks.cephfs.test_misc.TestMisc) 2021-11-12T05:47:44.180 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical' 2021-11-12T05:47:44.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.228+0000 7fbea2309700 1 Processor -- start 2021-11-12T05:47:44.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.228+0000 7fbea2309700 1 -- start start 2021-11-12T05:47:44.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.228+0000 7fbea2309700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbe9c0ac280 0x7fbe9c14b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:44.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.228+0000 7fbea2309700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe9c0ac7b0 con 0x7fbe9c0ad080 2021-11-12T05:47:44.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.228+0000 7fbea2309700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe9c0ac9e0 con 0x7fbe9c0af730 2021-11-12T05:47:44.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.228+0000 7fbea2309700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c1488a0 con 0x7fbe9c0ac280 2021-11-12T05:47:44.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.228+0000 7fbe9bfff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fbe9c0ad080 0x7fbe9c14abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:59128/0 (socket says 172.21.2.105:59128) 2021-11-12T05:47:44.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.228+0000 7fbe9bfff700 1 -- 172.21.2.105:0/1181651856 learned_addr learned my addr 172.21.2.105:0/1181651856 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:44.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.228+0000 7fbe9affd700 1 -- 172.21.2.105:0/1181651856 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1900286235 0 0) 0x7fbe9c0ac7b0 con 0x7fbe9c0ad080 2021-11-12T05:47:44.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.228+0000 7fbe9affd700 1 -- 172.21.2.105:0/1181651856 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe7c003260 con 0x7fbe9c0ad080 2021-11-12T05:47:44.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.228+0000 7fbe9b7fe700 1 --2- 172.21.2.105:0/1181651856 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbe9c0ac280 0x7fbe9c14b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:44.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.228+0000 7fbe9affd700 1 -- 172.21.2.105:0/1181651856 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4275080379 0 0) 0x7fbe7c003260 con 0x7fbe9c0ad080 2021-11-12T05:47:44.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.228+0000 7fbe9affd700 1 -- 172.21.2.105:0/1181651856 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbe9c0ac280 msgr2=0x7fbe9c14b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:44.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.228+0000 7fbe9affd700 1 --2- 172.21.2.105:0/1181651856 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbe9c0ac280 0x7fbe9c14b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:44.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.228+0000 7fbe9affd700 1 -- 172.21.2.105:0/1181651856 >> v1:172.21.2.115:6789/0 conn(0x7fbe9c0af730 legacy=0x7fbe9c147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:44.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.228+0000 7fbe9affd700 1 -- 172.21.2.105:0/1181651856 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9c0b0b30 con 0x7fbe9c0ad080 2021-11-12T05:47:44.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.228+0000 7fbe9affd700 1 -- 172.21.2.105:0/1181651856 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fbe8c001660 con 0x7fbe9c0ad080 2021-11-12T05:47:44.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.228+0000 7fbe9b7fe700 1 --2- 172.21.2.105:0/1181651856 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbe9c0ac280 0x7fbe9c14b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:47:44.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.228+0000 7fbe9affd700 1 -- 172.21.2.105:0/1181651856 >> v1:172.21.2.105:6789/0 conn(0x7fbe9c0ad080 legacy=0x7fbe9c14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:44.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.228+0000 7fbe9affd700 1 --2- 172.21.2.105:0/1181651856 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbe7c003780 0x7fbe7c003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:44.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.228+0000 7fbe9affd700 1 --2- 172.21.2.105:0/1181651856 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbe7c004500 0x7fbe7c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:44.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.228+0000 7fbe9affd700 1 --2- 172.21.2.105:0/1181651856 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbe9c0ac280 0x7fbe7c004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:44.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.228+0000 7fbe9affd700 1 -- 172.21.2.105:0/1181651856 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c1488a0 con 0x7fbe7c004500 2021-11-12T05:47:44.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.228+0000 7fbe9affd700 1 -- 172.21.2.105:0/1181651856 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c00b830 con 0x7fbe7c003780 2021-11-12T05:47:44.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.228+0000 7fbe9affd700 1 -- 172.21.2.105:0/1181651856 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c00b9f0 con 0x7fbe9c0ac280 2021-11-12T05:47:44.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.228+0000 7fbe9b7fe700 1 --2- 172.21.2.105:0/1181651856 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbe7c004500 0x7fbe7c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:44.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbe9b7fe700 1 -- 172.21.2.105:0/1181651856 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbe9c0ac280 msgr2=0x7fbe7c004ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:44.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbe9b7fe700 1 --2- 172.21.2.105:0/1181651856 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbe9c0ac280 0x7fbe7c004ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:44.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbe9b7fe700 1 -- 172.21.2.105:0/1181651856 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbe7c003780 msgr2=0x7fbe7c003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:44.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbe9b7fe700 1 --2- 172.21.2.105:0/1181651856 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbe7c003780 0x7fbe7c003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:44.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbe9b7fe700 1 -- 172.21.2.105:0/1181651856 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7c003260 con 0x7fbe7c004500 2021-11-12T05:47:44.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbe9b7fe700 1 --2- 172.21.2.105:0/1181651856 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbe7c004500 0x7fbe7c004980 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7fbe8400a000 tx=0x7fbe84008040).ready entity=mon.0 client_cookie=c2cc1d66c2119a5 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:44.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbe9affd700 1 -- 172.21.2.105:0/1181651856 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe84012610 con 0x7fbe7c004500 2021-11-12T05:47:44.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbe9affd700 1 -- 172.21.2.105:0/1181651856 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe84012770 con 0x7fbe7c004500 2021-11-12T05:47:44.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbe9affd700 1 -- 172.21.2.105:0/1181651856 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe84012ad0 con 0x7fbe7c004500 2021-11-12T05:47:44.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbea2309700 1 -- 172.21.2.105:0/1181651856 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbe7c004500 msgr2=0x7fbe7c004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:44.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbea2309700 1 --2- 172.21.2.105:0/1181651856 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbe7c004500 0x7fbe7c004980 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7fbe8400a000 tx=0x7fbe84008040).stop 2021-11-12T05:47:44.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbea08a6700 1 -- 172.21.2.105:0/1181651856 reap_dead start 2021-11-12T05:47:44.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbea2309700 1 -- 172.21.2.105:0/1181651856 shutdown_connections 2021-11-12T05:47:44.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbea2309700 1 -- 172.21.2.105:0/1181651856 >> 172.21.2.105:0/1181651856 conn(0x7fbe9c0b5370 msgr2=0x7fbe9c0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:44.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbea2309700 1 -- 172.21.2.105:0/1181651856 shutdown_connections 2021-11-12T05:47:44.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbea2309700 1 -- 172.21.2.105:0/1181651856 wait complete. 2021-11-12T05:47:44.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbea2309700 1 Processor -- start 2021-11-12T05:47:44.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbea2309700 1 -- start start 2021-11-12T05:47:44.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbea2309700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbe7c004500 0x7fbe9c1475e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:44.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbea2309700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbe9c156b00 0x7fbe9c063cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:44.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbea2309700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbe9c0a9470 0x7fbe9c157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:44.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbea2309700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c0a99f0 con 0x7fbe9c156b00 2021-11-12T05:47:44.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbea2309700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c0a9c90 con 0x7fbe7c004500 2021-11-12T05:47:44.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbea2309700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9c157810 con 0x7fbe9c0a9470 2021-11-12T05:47:44.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbe9b7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbe9c156b00 0x7fbe9c063cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:44.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbe9b7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbe9c156b00 0x7fbe9c063cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48746/0 (socket says 172.21.2.105:48746) 2021-11-12T05:47:44.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbe9b7fe700 1 -- 172.21.2.105:0/1711038729 learned_addr learned my addr 172.21.2.105:0/1711038729 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:44.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbe9bfff700 1 --2- 172.21.2.105:0/1711038729 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbe7c004500 0x7fbe9c1475e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:44.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbea08a6700 1 --2- 172.21.2.105:0/1711038729 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbe9c0a9470 0x7fbe9c157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:44.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbe9b7fe700 1 -- 172.21.2.105:0/1711038729 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbe9c0a9470 msgr2=0x7fbe9c157320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:44.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbe9b7fe700 1 --2- 172.21.2.105:0/1711038729 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbe9c0a9470 0x7fbe9c157320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:44.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbe9b7fe700 1 -- 172.21.2.105:0/1711038729 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbe7c004500 msgr2=0x7fbe9c1475e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:44.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbe9b7fe700 1 --2- 172.21.2.105:0/1711038729 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbe7c004500 0x7fbe9c1475e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:44.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbe9b7fe700 1 -- 172.21.2.105:0/1711038729 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9c1579d0 con 0x7fbe9c156b00 2021-11-12T05:47:44.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbe9b7fe700 1 --2- 172.21.2.105:0/1711038729 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbe9c156b00 0x7fbe9c063cb0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 rx=0x7fbe8400a000 tx=0x7fbe84008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:44.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbe997fa700 1 -- 172.21.2.105:0/1711038729 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe84006510 con 0x7fbe9c156b00 2021-11-12T05:47:44.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbe997fa700 1 -- 172.21.2.105:0/1711038729 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe84000e90 con 0x7fbe9c156b00 2021-11-12T05:47:44.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbe997fa700 1 -- 172.21.2.105:0/1711038729 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe840058e0 con 0x7fbe9c156b00 2021-11-12T05:47:44.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbea2309700 1 -- 172.21.2.105:0/1711038729 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe9c157b60 con 0x7fbe9c156b00 2021-11-12T05:47:44.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbea2309700 1 -- 172.21.2.105:0/1711038729 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe9c15a5b0 con 0x7fbe9c156b00 2021-11-12T05:47:44.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.232+0000 7fbea2309700 1 -- 172.21.2.105:0/1711038729 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe9c0a9850 con 0x7fbe9c156b00 2021-11-12T05:47:44.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.236+0000 7fbe997fa700 1 -- 172.21.2.105:0/1711038729 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbe8402c070 con 0x7fbe9c156b00 2021-11-12T05:47:44.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.236+0000 7fbe997fa700 1 --2- 172.21.2.105:0/1711038729 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbe800536a0 0x7fbe80055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:44.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.236+0000 7fbe997fa700 1 -- 172.21.2.105:0/1711038729 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5768+0+0 (secure 0 0 0) 0x7fbe8406ceb0 con 0x7fbe9c156b00 2021-11-12T05:47:44.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.236+0000 7fbe9bfff700 1 --2- 172.21.2.105:0/1711038729 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbe800536a0 0x7fbe80055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:44.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.236+0000 7fbe9bfff700 1 --2- 172.21.2.105:0/1711038729 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbe800536a0 0x7fbe80055b60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7fbe8c00b000 tx=0x7fbe9c0aeb90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:44.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.236+0000 7fbe997fa700 1 -- 172.21.2.105:0/1711038729 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbe9c0a9850 con 0x7fbe9c156b00 2021-11-12T05:47:44.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:44.348+0000 7fbea2309700 1 -- 172.21.2.105:0/1711038729 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]} v 0) v1 -- 0x7fbe9c0a9850 con 0x7fbe9c156b00 2021-11-12T05:47:45.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.168+0000 7fbe997fa700 1 -- 172.21.2.105:0/1711038729 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]}]=0 v295) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbe9c0a9850 con 0x7fbe9c156b00 2021-11-12T05:47:45.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.172+0000 7fbea2309700 1 -- 172.21.2.105:0/1711038729 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbe800536a0 msgr2=0x7fbe80055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:45.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.172+0000 7fbea2309700 1 --2- 172.21.2.105:0/1711038729 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbe800536a0 0x7fbe80055b60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7fbe8c00b000 tx=0x7fbe9c0aeb90).stop 2021-11-12T05:47:45.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.172+0000 7fbea2309700 1 -- 172.21.2.105:0/1711038729 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbe9c156b00 msgr2=0x7fbe9c063cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:45.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.172+0000 7fbea2309700 1 --2- 172.21.2.105:0/1711038729 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbe9c156b00 0x7fbe9c063cb0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 rx=0x7fbe8400a000 tx=0x7fbe84008040).stop 2021-11-12T05:47:45.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.172+0000 7fbea2309700 1 -- 172.21.2.105:0/1711038729 shutdown_connections 2021-11-12T05:47:45.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.172+0000 7fbea2309700 1 --2- 172.21.2.105:0/1711038729 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbe800536a0 0x7fbe80055b60 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:45.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.172+0000 7fbea2309700 1 --2- 172.21.2.105:0/1711038729 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbe9c0a9470 0x7fbe9c157320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:45.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.172+0000 7fbea2309700 1 --2- 172.21.2.105:0/1711038729 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbe9c156b00 0x7fbe9c063cb0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:45.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.172+0000 7fbea2309700 1 --2- 172.21.2.105:0/1711038729 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbe7c004500 0x7fbe9c1475e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:45.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.172+0000 7fbea2309700 1 -- 172.21.2.105:0/1711038729 >> 172.21.2.105:0/1711038729 conn(0x7fbe9c0b5370 msgr2=0x7fbe9c0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:45.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.172+0000 7fbea2309700 1 -- 172.21.2.105:0/1711038729 shutdown_connections 2021-11-12T05:47:45.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.172+0000 7fbea2309700 1 -- 172.21.2.105:0/1711038729 wait complete. 2021-11-12T05:47:45.182 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-11-12T05:47:45.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.236+0000 7f9191d5d700 1 Processor -- start 2021-11-12T05:47:45.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.236+0000 7f9191d5d700 1 -- start start 2021-11-12T05:47:45.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.236+0000 7f9191d5d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f918c0b30a0 0x7f918c140240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:45.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.236+0000 7f9191d5d700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f918c0aa0b0 con 0x7f918c0b2cc0 2021-11-12T05:47:45.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.236+0000 7f9191d5d700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f918c0a9b70 con 0x7f918c0b2290 2021-11-12T05:47:45.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.236+0000 7f9191d5d700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f918c0a9e10 con 0x7f918c0b30a0 2021-11-12T05:47:45.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.236+0000 7f918b7fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f918c0b2cc0 0x7f918c143690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:59150/0 (socket says 172.21.2.105:59150) 2021-11-12T05:47:45.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.236+0000 7f918b7fe700 1 -- 172.21.2.105:0/2477852855 learned_addr learned my addr 172.21.2.105:0/2477852855 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:45.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.236+0000 7f918bfff700 1 --2- 172.21.2.105:0/2477852855 >> v2:172.21.2.105:3300/0 conn(0x7f918c0b30a0 0x7f918c140240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:45.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.236+0000 7f918bfff700 1 -- 172.21.2.105:0/2477852855 >> v1:172.21.2.115:6789/0 conn(0x7f918c0b2290 legacy=0x7f918c143da0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:47:45.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.236+0000 7f918bfff700 1 -- 172.21.2.105:0/2477852855 >> v1:172.21.2.105:6789/0 conn(0x7f918c0b2cc0 legacy=0x7f918c143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:45.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.240+0000 7f918bfff700 1 -- 172.21.2.105:0/2477852855 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f918c0b0800 con 0x7f918c0b30a0 2021-11-12T05:47:45.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.236+0000 7f918a7fc700 1 -- 172.21.2.105:0/2477852855 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 326923965 0 0) 0x7f918c0aa0b0 con 0x7f918c0b2cc0 2021-11-12T05:47:45.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.240+0000 7f918bfff700 1 --2- 172.21.2.105:0/2477852855 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f918c0b30a0 0x7f918c140240 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7f918c0afc20 tx=0x7f91840091d0).ready entity=mon.0 client_cookie=2da4b46ff9f22a7e server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:45.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.240+0000 7f918a7fc700 1 -- 172.21.2.105:0/2477852855 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f918400b820 con 0x7f918c0b30a0 2021-11-12T05:47:45.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.240+0000 7f918a7fc700 1 -- 172.21.2.105:0/2477852855 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f918400b980 con 0x7f918c0b30a0 2021-11-12T05:47:45.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.240+0000 7f918a7fc700 1 -- 172.21.2.105:0/2477852855 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f918400baf0 con 0x7f918c0b30a0 2021-11-12T05:47:45.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.240+0000 7f9191d5d700 1 -- 172.21.2.105:0/2477852855 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f918c0b30a0 msgr2=0x7f918c140240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:45.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.240+0000 7f9191d5d700 1 --2- 172.21.2.105:0/2477852855 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f918c0b30a0 0x7f918c140240 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7f918c0afc20 tx=0x7f91840091d0).stop 2021-11-12T05:47:45.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.240+0000 7f9191d5d700 1 -- 172.21.2.105:0/2477852855 shutdown_connections 2021-11-12T05:47:45.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.240+0000 7f9191d5d700 1 --2- 172.21.2.105:0/2477852855 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f918c0b30a0 0x7f918c140240 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:45.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.240+0000 7f9191d5d700 1 -- 172.21.2.105:0/2477852855 >> 172.21.2.105:0/2477852855 conn(0x7f918c05c490 msgr2=0x7f918c05c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:45.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.240+0000 7f9191d5d700 1 -- 172.21.2.105:0/2477852855 shutdown_connections 2021-11-12T05:47:45.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.240+0000 7f9191d5d700 1 -- 172.21.2.105:0/2477852855 wait complete. 2021-11-12T05:47:45.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.240+0000 7f9191d5d700 1 Processor -- start 2021-11-12T05:47:45.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.240+0000 7f9191d5d700 1 -- start start 2021-11-12T05:47:45.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.240+0000 7f9191d5d700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f918c0b2290 0x7f918c145080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:45.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.240+0000 7f9191d5d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f918c0b2cc0 0x7f918c142390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:45.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.240+0000 7f9191d5d700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f918c0b30a0 0x7f918c13a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:45.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.240+0000 7f9191d5d700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918c0aa510 con 0x7f918c0b2cc0 2021-11-12T05:47:45.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.240+0000 7f9191d5d700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918c144a30 con 0x7f918c0b30a0 2021-11-12T05:47:45.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.240+0000 7f9191d5d700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f918c143430 con 0x7f918c0b2290 2021-11-12T05:47:45.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.240+0000 7f918affd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f918c0b2cc0 0x7f918c142390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:45.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.240+0000 7f918affd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f918c0b2cc0 0x7f918c142390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48762/0 (socket says 172.21.2.105:48762) 2021-11-12T05:47:45.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.240+0000 7f918affd700 1 -- 172.21.2.105:0/1116859255 learned_addr learned my addr 172.21.2.105:0/1116859255 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:45.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.240+0000 7f918affd700 1 -- 172.21.2.105:0/1116859255 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f918c0b2290 msgr2=0x7f918c145080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:45.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.240+0000 7f918affd700 1 --2- 172.21.2.105:0/1116859255 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f918c0b2290 0x7f918c145080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:45.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.240+0000 7f918affd700 1 -- 172.21.2.105:0/1116859255 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f918c0b30a0 msgr2=0x7f918c13a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:45.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.240+0000 7f918affd700 1 --2- 172.21.2.105:0/1116859255 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f918c0b30a0 0x7f918c13a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:45.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.240+0000 7f918affd700 1 -- 172.21.2.105:0/1116859255 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9184009470 con 0x7f918c0b2cc0 2021-11-12T05:47:45.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.240+0000 7f918affd700 1 --2- 172.21.2.105:0/1116859255 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f918c0b2cc0 0x7f918c142390 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 rx=0x7f917c002fb0 tx=0x7f917c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:45.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.240+0000 7f9188ff9700 1 -- 172.21.2.105:0/1116859255 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f917c013460 con 0x7f918c0b2cc0 2021-11-12T05:47:45.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.240+0000 7f9188ff9700 1 -- 172.21.2.105:0/1116859255 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f917c0135c0 con 0x7f918c0b2cc0 2021-11-12T05:47:45.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.240+0000 7f9191d5d700 1 -- 172.21.2.105:0/1116859255 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f918c1436d0 con 0x7f918c0b2cc0 2021-11-12T05:47:45.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.240+0000 7f9191d5d700 1 -- 172.21.2.105:0/1116859255 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f918c0b53d0 con 0x7f918c0b2cc0 2021-11-12T05:47:45.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.240+0000 7f9188ff9700 1 -- 172.21.2.105:0/1116859255 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f917c013920 con 0x7f918c0b2cc0 2021-11-12T05:47:45.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.240+0000 7f9191d5d700 1 -- 172.21.2.105:0/1116859255 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f918c057350 con 0x7f918c0b2cc0 2021-11-12T05:47:45.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.240+0000 7f9188ff9700 1 -- 172.21.2.105:0/1116859255 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f917c00f070 con 0x7f918c0b2cc0 2021-11-12T05:47:45.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.244+0000 7f9188ff9700 1 --2- 172.21.2.105:0/1116859255 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f91700536f0 0x7f9170055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:45.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.244+0000 7f9188ff9700 1 -- 172.21.2.105:0/1116859255 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5768+0+0 (secure 0 0 0) 0x7f917c06b260 con 0x7f918c0b2cc0 2021-11-12T05:47:45.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.244+0000 7f918b7fe700 1 --2- 172.21.2.105:0/1116859255 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f91700536f0 0x7f9170055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:45.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.244+0000 7f918b7fe700 1 --2- 172.21.2.105:0/1116859255 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f91700536f0 0x7f9170055bb0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f9174000ed0 tx=0x7f91740076c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:45.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.244+0000 7f9188ff9700 1 -- 172.21.2.105:0/1116859255 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f917c0424f0 con 0x7f918c0b2cc0 2021-11-12T05:47:45.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.328+0000 7f9191d5d700 1 -- 172.21.2.105:0/1116859255 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f918c0ad810 con 0x7f918c0b2cc0 2021-11-12T05:47:45.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.336+0000 7f9188ff9700 1 -- 172.21.2.105:0/1116859255 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f917c045b10 con 0x7f918c0b2cc0 2021-11-12T05:47:45.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.340+0000 7f9191d5d700 1 -- 172.21.2.105:0/1116859255 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f91700536f0 msgr2=0x7f9170055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:45.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.340+0000 7f9191d5d700 1 --2- 172.21.2.105:0/1116859255 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f91700536f0 0x7f9170055bb0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f9174000ed0 tx=0x7f91740076c0).stop 2021-11-12T05:47:45.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.340+0000 7f9191d5d700 1 -- 172.21.2.105:0/1116859255 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f918c0b2cc0 msgr2=0x7f918c142390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:45.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.340+0000 7f9191d5d700 1 --2- 172.21.2.105:0/1116859255 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f918c0b2cc0 0x7f918c142390 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 rx=0x7f917c002fb0 tx=0x7f917c006df0).stop 2021-11-12T05:47:45.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.340+0000 7f9191d5d700 1 -- 172.21.2.105:0/1116859255 shutdown_connections 2021-11-12T05:47:45.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.340+0000 7f9191d5d700 1 --2- 172.21.2.105:0/1116859255 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f91700536f0 0x7f9170055bb0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:45.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.340+0000 7f9191d5d700 1 --2- 172.21.2.105:0/1116859255 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f918c0b30a0 0x7f918c13a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:45.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.340+0000 7f9191d5d700 1 --2- 172.21.2.105:0/1116859255 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f918c0b2cc0 0x7f918c142390 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:45.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.340+0000 7f9191d5d700 1 --2- 172.21.2.105:0/1116859255 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f918c0b2290 0x7f918c145080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:45.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.340+0000 7f9191d5d700 1 -- 172.21.2.105:0/1116859255 >> 172.21.2.105:0/1116859255 conn(0x7f918c05c490 msgr2=0x7f918c13feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:45.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.340+0000 7f9191d5d700 1 -- 172.21.2.105:0/1116859255 shutdown_connections 2021-11-12T05:47:45.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.340+0000 7f9191d5d700 1 -- 172.21.2.105:0/1116859255 wait complete. 2021-11-12T05:47:45.355 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-12T05:47:45.356 DEBUG:teuthology.orchestra.run.gibba005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:47:45.366 DEBUG:teuthology.orchestra.run.gibba015:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:47:45.375 DEBUG:teuthology.orchestra.run.gibba016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:47:45.388 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:47:45.402 DEBUG:teuthology.orchestra.run.gibba044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:47:45.415 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-12T05:47:45.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:45.416 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:47:45.416 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:47:45.435 INFO:teuthology.orchestra.run.gibba016.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-12T05:47:45.436 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:47:45.437 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-11-12T05:47:45.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:45.438 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:47:45.438 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:47:45.447 INFO:teuthology.orchestra.run.gibba038.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-12T05:47:45.447 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:47:45.448 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-12T05:47:45.449 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:45.449 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:47:45.449 DEBUG:teuthology.orchestra.run.gibba044:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:47:45.460 INFO:teuthology.orchestra.run.gibba044.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-12T05:47:45.460 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:47:45.462 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-12T05:47:45.462 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-12T05:47:45.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.512+0000 7fa3f0cdb700 1 Processor -- start 2021-11-12T05:47:45.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.512+0000 7fa3f0cdb700 1 -- start start 2021-11-12T05:47:45.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.512+0000 7fa3f0cdb700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa3ec0626b0 0x7fa3ec062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:45.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.512+0000 7fa3f0cdb700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fa3ec130a80 0x7fa3ec1474d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:45.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.512+0000 7fa3f0cdb700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3ec0b0d50 con 0x7fa3ec0af750 2021-11-12T05:47:45.520 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.512+0000 7fa3f0cdb700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3ec0ad380 con 0x7fa3ec130a80 2021-11-12T05:47:45.520 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.512+0000 7fa3f0cdb700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec0ae190 con 0x7fa3ec0626b0 2021-11-12T05:47:45.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.516+0000 7fa3ea59c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa3ec0626b0 0x7fa3ec062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:45.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.516+0000 7fa3ead9d700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fa3ec130a80 0x7fa3ec1474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:45.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.516+0000 7fa3e9d9b700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7fa3ec0af750 0x7fa3ec130370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:57634/0 (socket says 172.21.2.105:57634) 2021-11-12T05:47:45.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.516+0000 7fa3e9d9b700 1 -- 172.21.2.105:0/2559791310 learned_addr learned my addr 172.21.2.105:0/2559791310 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:45.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.516+0000 7fa3ea59c700 1 -- 172.21.2.105:0/2559791310 >> v2:172.21.2.115:3300/0 conn(0x7fa3ec130a80 msgr2=0x7fa3ec1474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:45.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.516+0000 7fa3ea59c700 1 --2- 172.21.2.105:0/2559791310 >> v2:172.21.2.115:3300/0 conn(0x7fa3ec130a80 0x7fa3ec1474d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:45.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.516+0000 7fa3ea59c700 1 -- 172.21.2.105:0/2559791310 >> v1:172.21.2.115:6789/0 conn(0x7fa3ec0af750 legacy=0x7fa3ec130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:45.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.516+0000 7fa3ea59c700 1 -- 172.21.2.105:0/2559791310 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ec0ae2d0 con 0x7fa3ec0626b0 2021-11-12T05:47:45.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.516+0000 7fa3ea59c700 1 --2- 172.21.2.105:0/2559791310 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa3ec0626b0 0x7fa3ec062a90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fa3dc002f70 tx=0x7fa3dc006df0).ready entity=mon.2 client_cookie=bd83b391acf86dca server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:45.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.516+0000 7fa3e959a700 1 -- 172.21.2.105:0/2559791310 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3dc00d570 con 0x7fa3ec0626b0 2021-11-12T05:47:45.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.516+0000 7fa3e959a700 1 -- 172.21.2.105:0/2559791310 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3dc000e90 con 0x7fa3ec0626b0 2021-11-12T05:47:45.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.516+0000 7fa3e959a700 1 -- 172.21.2.105:0/2559791310 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3dc00d8c0 con 0x7fa3ec0626b0 2021-11-12T05:47:45.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.516+0000 7fa3f0cdb700 1 -- 172.21.2.105:0/2559791310 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa3ec0626b0 msgr2=0x7fa3ec062a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:45.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.516+0000 7fa3f0cdb700 1 --2- 172.21.2.105:0/2559791310 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa3ec0626b0 0x7fa3ec062a90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fa3dc002f70 tx=0x7fa3dc006df0).stop 2021-11-12T05:47:45.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.516+0000 7fa3f0cdb700 1 -- 172.21.2.105:0/2559791310 shutdown_connections 2021-11-12T05:47:45.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.516+0000 7fa3f0cdb700 1 --2- 172.21.2.105:0/2559791310 >> v2:172.21.2.115:3300/0 conn(0x7fa3ec130a80 0x7fa3ec1474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:45.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.516+0000 7fa3f0cdb700 1 --2- 172.21.2.105:0/2559791310 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa3ec0626b0 0x7fa3ec062a90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:45.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.516+0000 7fa3f0cdb700 1 -- 172.21.2.105:0/2559791310 >> 172.21.2.105:0/2559791310 conn(0x7fa3ec0b5320 msgr2=0x7fa3ec0b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:45.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.516+0000 7fa3f0cdb700 1 -- 172.21.2.105:0/2559791310 shutdown_connections 2021-11-12T05:47:45.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.516+0000 7fa3f0cdb700 1 -- 172.21.2.105:0/2559791310 wait complete. 2021-11-12T05:47:45.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.520+0000 7fa3f0cdb700 1 Processor -- start 2021-11-12T05:47:45.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.520+0000 7fa3f0cdb700 1 -- start start 2021-11-12T05:47:45.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.520+0000 7fa3f0cdb700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa3ec0626b0 0x7fa3ec065c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:45.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.520+0000 7fa3f0cdb700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa3ec0af750 0x7fa3ec1575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:45.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.520+0000 7fa3f0cdb700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa3ec130a80 0x7fa3ec15a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:45.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.520+0000 7fa3f0cdb700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec066580 con 0x7fa3ec0626b0 2021-11-12T05:47:45.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.520+0000 7fa3f0cdb700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec14b2a0 con 0x7fa3ec0af750 2021-11-12T05:47:45.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.520+0000 7fa3f0cdb700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec14b540 con 0x7fa3ec130a80 2021-11-12T05:47:45.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.520+0000 7fa3ea59c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa3ec0626b0 0x7fa3ec065c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:45.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.520+0000 7fa3ea59c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa3ec0626b0 0x7fa3ec065c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48776/0 (socket says 172.21.2.105:48776) 2021-11-12T05:47:45.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.520+0000 7fa3ea59c700 1 -- 172.21.2.105:0/71694897 learned_addr learned my addr 172.21.2.105:0/71694897 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:45.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.520+0000 7fa3ea59c700 1 -- 172.21.2.105:0/71694897 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa3ec130a80 msgr2=0x7fa3ec15a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:45.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.520+0000 7fa3ea59c700 1 --2- 172.21.2.105:0/71694897 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa3ec130a80 0x7fa3ec15a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:45.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.520+0000 7fa3ea59c700 1 -- 172.21.2.105:0/71694897 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa3ec0af750 msgr2=0x7fa3ec1575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:45.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.520+0000 7fa3ea59c700 1 --2- 172.21.2.105:0/71694897 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa3ec0af750 0x7fa3ec1575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:45.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.520+0000 7fa3ea59c700 1 -- 172.21.2.105:0/71694897 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3dc00b180 con 0x7fa3ec0626b0 2021-11-12T05:47:45.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.520+0000 7fa3ea59c700 1 --2- 172.21.2.105:0/71694897 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa3ec0626b0 0x7fa3ec065c20 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7fa3dc002f70 tx=0x7fa3dc014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:45.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.520+0000 7fa3e37fe700 1 -- 172.21.2.105:0/71694897 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3dc016070 con 0x7fa3ec0626b0 2021-11-12T05:47:45.545 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.520+0000 7fa3e37fe700 1 -- 172.21.2.105:0/71694897 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3dc00de40 con 0x7fa3ec0626b0 2021-11-12T05:47:45.546 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.520+0000 7fa3e37fe700 1 -- 172.21.2.105:0/71694897 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3dc01e450 con 0x7fa3ec0626b0 2021-11-12T05:47:45.546 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.520+0000 7fa3f0cdb700 1 -- 172.21.2.105:0/71694897 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3ec14ae70 con 0x7fa3ec0626b0 2021-11-12T05:47:45.546 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.520+0000 7fa3f0cdb700 1 -- 172.21.2.105:0/71694897 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3ec062a90 con 0x7fa3ec0626b0 2021-11-12T05:47:45.547 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.520+0000 7fa3f0cdb700 1 -- 172.21.2.105:0/71694897 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3ec14b700 con 0x7fa3ec0626b0 2021-11-12T05:47:45.547 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.520+0000 7fa3e37fe700 1 -- 172.21.2.105:0/71694897 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa3dc025030 con 0x7fa3ec0626b0 2021-11-12T05:47:45.548 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.520+0000 7fa3e37fe700 1 --2- 172.21.2.105:0/71694897 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa3d0053610 0x7fa3d0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:45.548 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.520+0000 7fa3e37fe700 1 -- 172.21.2.105:0/71694897 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5768+0+0 (secure 0 0 0) 0x7fa3dc06c790 con 0x7fa3ec0626b0 2021-11-12T05:47:45.549 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.520+0000 7fa3e9d9b700 1 --2- 172.21.2.105:0/71694897 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa3d0053610 0x7fa3d0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:45.549 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.520+0000 7fa3e9d9b700 1 --2- 172.21.2.105:0/71694897 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa3d0053610 0x7fa3d0055ad0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7fa3ec05d1b0 tx=0x7fa3d4007820).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:45.550 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.524+0000 7fa3e37fe700 1 -- 172.21.2.105:0/71694897 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa3dc043a20 con 0x7fa3ec0626b0 2021-11-12T05:47:45.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.604+0000 7fa3f0cdb700 1 -- 172.21.2.105:0/71694897 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa3ec0ae2d0 con 0x7fa3ec0626b0 2021-11-12T05:47:45.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.604+0000 7fa3e37fe700 1 -- 172.21.2.105:0/71694897 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v89) v1 ==== 81+0+29370 (secure 0 0 0) 0x7fa3ec0ae2d0 con 0x7fa3ec0626b0 2021-11-12T05:47:45.611 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:45.611 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:47:45.611 INFO:teuthology.orchestra.run.gibba005.stdout: "epoch": 89, 2021-11-12T05:47:45.612 INFO:teuthology.orchestra.run.gibba005.stdout: "fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", 2021-11-12T05:47:45.612 INFO:teuthology.orchestra.run.gibba005.stdout: "created": "2021-11-12T05:40:19.986390+0000", 2021-11-12T05:47:45.612 INFO:teuthology.orchestra.run.gibba005.stdout: "modified": "2021-11-12T05:47:43.155740+0000", 2021-11-12T05:47:45.612 INFO:teuthology.orchestra.run.gibba005.stdout: "last_up_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:47:45.612 INFO:teuthology.orchestra.run.gibba005.stdout: "last_in_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:47:45.613 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-12T05:47:45.613 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_num": 5799936, 2021-11-12T05:47:45.613 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_set": [ 2021-11-12T05:47:45.613 INFO:teuthology.orchestra.run.gibba005.stdout: "pglog_hardlimit", 2021-11-12T05:47:45.614 INFO:teuthology.orchestra.run.gibba005.stdout: "purged_snapdirs", 2021-11-12T05:47:45.614 INFO:teuthology.orchestra.run.gibba005.stdout: "recovery_deletes", 2021-11-12T05:47:45.614 INFO:teuthology.orchestra.run.gibba005.stdout: "sortbitwise" 2021-11-12T05:47:45.614 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:47:45.614 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_version": 5, 2021-11-12T05:47:45.615 INFO:teuthology.orchestra.run.gibba005.stdout: "full_ratio": 0.94999998807907104, 2021-11-12T05:47:45.615 INFO:teuthology.orchestra.run.gibba005.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-12T05:47:45.615 INFO:teuthology.orchestra.run.gibba005.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-12T05:47:45.615 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_snapshot": "", 2021-11-12T05:47:45.616 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_max": 16, 2021-11-12T05:47:45.616 INFO:teuthology.orchestra.run.gibba005.stdout: "max_osd": 8, 2021-11-12T05:47:45.616 INFO:teuthology.orchestra.run.gibba005.stdout: "require_min_compat_client": "jewel", 2021-11-12T05:47:45.616 INFO:teuthology.orchestra.run.gibba005.stdout: "min_compat_client": "jewel", 2021-11-12T05:47:45.616 INFO:teuthology.orchestra.run.gibba005.stdout: "require_osd_release": "octopus", 2021-11-12T05:47:45.617 INFO:teuthology.orchestra.run.gibba005.stdout: "pools": [ 2021-11-12T05:47:45.617 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.617 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 1, 2021-11-12T05:47:45.617 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "device_health_metrics", 2021-11-12T05:47:45.617 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:22.022116+0000", 2021-11-12T05:47:45.618 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:47:45.618 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:47:45.618 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:47:45.618 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:47:45.619 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:47:45.619 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:47:45.619 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:47:45.619 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:47:45.619 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 1, 2021-11-12T05:47:45.620 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 1, 2021-11-12T05:47:45.620 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 1, 2021-11-12T05:47:45.620 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 1, 2021-11-12T05:47:45.620 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 1, 2021-11-12T05:47:45.620 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:47:45.621 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:47:45.621 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:47:45.621 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:47:45.621 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:47:45.622 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:47:45.622 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:47:45.622 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.622 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "16", 2021-11-12T05:47:45.622 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:47:45.623 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:47:45.623 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:47:45.623 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:47:45.623 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:47:45.624 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:47:45.624 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:47:45.624 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:47:45.624 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:47:45.624 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:47:45.625 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:47:45.625 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:47:45.625 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:47:45.625 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:47:45.626 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:47:45.626 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:47:45.626 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:47:45.626 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:47:45.626 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:47:45.627 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:47:45.627 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:47:45.627 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:47:45.627 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:47:45.628 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:47:45.628 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:47:45.628 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:47:45.628 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.628 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:47:45.629 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:47:45.629 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:47:45.629 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:47:45.629 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:47:45.629 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:47:45.630 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:47:45.630 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:47:45.630 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:47:45.630 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:47:45.631 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:47:45.631 INFO:teuthology.orchestra.run.gibba005.stdout: "options": { 2021-11-12T05:47:45.631 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_min": 1 2021-11-12T05:47:45.631 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.631 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:47:45.632 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr_devicehealth": {} 2021-11-12T05:47:45.632 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:45.632 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.632 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.632 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 2, 2021-11-12T05:47:45.633 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "rbd", 2021-11-12T05:47:45.633 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:29.953617+0000", 2021-11-12T05:47:45.633 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:47:45.633 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:47:45.633 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:47:45.634 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:47:45.634 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:47:45.634 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:47:45.634 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:47:45.634 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:47:45.635 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:47:45.635 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:47:45.635 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:47:45.635 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:47:45.636 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:47:45.636 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:47:45.636 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:47:45.636 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:47:45.636 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:47:45.637 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:47:45.637 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:47:45.637 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:47:45.637 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.637 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "19", 2021-11-12T05:47:45.638 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:47:45.638 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:47:45.638 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:47:45.638 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:47:45.638 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:47:45.639 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:47:45.639 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:47:45.639 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:47:45.639 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:47:45.639 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:47:45.640 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:47:45.640 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:47:45.640 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:47:45.640 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:47:45.641 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:47:45.641 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:47:45.641 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:47:45.641 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:47:45.641 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:47:45.642 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:47:45.642 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:47:45.642 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:47:45.642 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:47:45.642 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:47:45.643 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:47:45.643 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:47:45.643 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.643 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:47:45.643 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:47:45.644 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:47:45.644 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:47:45.644 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:47:45.644 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:47:45.644 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:47:45.645 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:47:45.645 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:47:45.645 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:47:45.645 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:47:45.646 INFO:teuthology.orchestra.run.gibba005.stdout: "options": {}, 2021-11-12T05:47:45.646 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:47:45.646 INFO:teuthology.orchestra.run.gibba005.stdout: "rbd": {} 2021-11-12T05:47:45.646 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:45.646 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:45.647 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:47:45.647 INFO:teuthology.orchestra.run.gibba005.stdout: "osds": [ 2021-11-12T05:47:45.647 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.647 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:47:45.648 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "ee8e30a0-4819-4475-80ec-dd3ee7d01322", 2021-11-12T05:47:45.648 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:45.648 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:45.648 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:45.648 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:45.649 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:45.649 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:45.649 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:45.649 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 82, 2021-11-12T05:47:45.650 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:45.650 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:45.650 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:45.650 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:45.650 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.651 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:45.651 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6802", 2021-11-12T05:47:45.651 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:45.651 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.651 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.652 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:45.652 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6803", 2021-11-12T05:47:45.652 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:45.652 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:45.652 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.653 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.653 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:45.653 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:45.653 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.654 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:45.654 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6804", 2021-11-12T05:47:45.654 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:45.654 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.654 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.655 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:45.655 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6805", 2021-11-12T05:47:45.655 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:45.655 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:45.655 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.656 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.656 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:45.656 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:45.656 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.657 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:45.657 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6808", 2021-11-12T05:47:45.657 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:45.657 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.657 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.658 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:45.658 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6809", 2021-11-12T05:47:45.658 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:45.658 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:45.658 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.659 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.659 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:45.659 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:45.659 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.659 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:45.660 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6806", 2021-11-12T05:47:45.660 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:45.660 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.661 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.661 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:45.661 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6807", 2021-11-12T05:47:45.661 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:45.661 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:45.662 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.662 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.662 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6803/14874", 2021-11-12T05:47:45.662 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6805/14874", 2021-11-12T05:47:45.662 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6809/14874", 2021-11-12T05:47:45.663 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6807/14874", 2021-11-12T05:47:45.663 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:45.663 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:45.663 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:45.663 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.664 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.664 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.664 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:47:45.664 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "b1bb06c3-26d0-4d92-82f8-b3e882242785", 2021-11-12T05:47:45.665 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:45.665 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:45.665 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:45.665 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:45.665 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:45.666 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:45.666 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:45.666 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 81, 2021-11-12T05:47:45.666 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:45.666 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:45.667 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:45.667 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:45.667 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.667 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:45.668 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6810", 2021-11-12T05:47:45.668 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:45.668 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.668 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.669 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:45.669 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6811", 2021-11-12T05:47:45.669 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:45.669 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:45.669 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.670 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.670 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:45.670 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:45.670 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.671 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:45.671 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6812", 2021-11-12T05:47:45.671 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:45.671 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.671 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.672 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:45.672 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6813", 2021-11-12T05:47:45.672 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:45.672 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:45.673 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.673 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.673 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:45.673 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:45.673 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.674 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:45.674 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6816", 2021-11-12T05:47:45.674 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:45.674 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.675 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.675 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:45.675 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6817", 2021-11-12T05:47:45.675 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:45.675 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:45.676 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.676 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.676 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:45.676 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:45.676 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.677 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:45.677 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6814", 2021-11-12T05:47:45.677 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:45.677 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.677 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.678 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:45.678 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6815", 2021-11-12T05:47:45.678 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:45.678 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:45.679 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.679 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.679 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6811/14875", 2021-11-12T05:47:45.679 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6813/14875", 2021-11-12T05:47:45.679 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6817/14875", 2021-11-12T05:47:45.680 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6815/14875", 2021-11-12T05:47:45.680 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:45.680 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:45.680 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:45.681 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.681 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.681 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.681 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:47:45.681 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "837b2c60-c335-4382-9f47-d86543a14022", 2021-11-12T05:47:45.682 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:45.682 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:45.682 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:45.682 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:45.682 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:45.683 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:45.683 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:45.683 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 82, 2021-11-12T05:47:45.683 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:45.683 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:45.684 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:45.684 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:45.684 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.684 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:45.684 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6818", 2021-11-12T05:47:45.685 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:45.685 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.685 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.685 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:45.686 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6819", 2021-11-12T05:47:45.686 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:45.686 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:45.686 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.686 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.687 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:45.687 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:45.687 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.687 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:45.687 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6820", 2021-11-12T05:47:45.688 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:45.688 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.688 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.688 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:45.688 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6821", 2021-11-12T05:47:45.689 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:45.689 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:45.689 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.689 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.690 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:45.690 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:45.690 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.690 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:45.690 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6824", 2021-11-12T05:47:45.691 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:45.691 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.691 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.691 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:45.691 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6825", 2021-11-12T05:47:45.692 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:45.692 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:45.692 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.692 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.693 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:45.693 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:45.693 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.693 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:45.693 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6822", 2021-11-12T05:47:45.694 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:45.694 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.694 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.694 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:45.694 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6823", 2021-11-12T05:47:45.695 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:45.695 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:45.695 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.695 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.696 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6819/14905", 2021-11-12T05:47:45.696 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6821/14905", 2021-11-12T05:47:45.696 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6825/14905", 2021-11-12T05:47:45.696 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6823/14905", 2021-11-12T05:47:45.696 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:45.697 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:45.697 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:45.697 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.697 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.697 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.698 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:47:45.698 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "eb2b737b-dda6-444b-a306-f33cbbd51f70", 2021-11-12T05:47:45.698 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:45.698 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:45.699 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:45.699 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:45.699 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:45.699 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:45.699 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:45.700 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 83, 2021-11-12T05:47:45.700 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:45.700 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:45.700 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:45.700 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:45.701 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.701 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:45.701 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6826", 2021-11-12T05:47:45.701 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:45.701 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.702 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.702 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:45.702 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6827", 2021-11-12T05:47:45.702 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:45.702 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:45.703 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.703 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.703 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:45.703 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:45.704 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.704 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:45.704 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6828", 2021-11-12T05:47:45.704 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:45.704 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.705 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.705 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:45.705 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6829", 2021-11-12T05:47:45.705 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:45.705 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:45.706 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.706 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.706 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:45.706 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:45.706 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.707 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:45.707 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6832", 2021-11-12T05:47:45.707 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:45.707 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.707 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.708 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:45.708 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6833", 2021-11-12T05:47:45.708 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:45.708 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:45.709 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.709 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.709 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:45.709 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:45.709 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.710 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:45.710 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6830", 2021-11-12T05:47:45.710 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:45.710 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.710 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.711 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:45.711 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6831", 2021-11-12T05:47:45.711 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:45.711 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:45.712 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.712 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.712 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6827/14876", 2021-11-12T05:47:45.712 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6829/14876", 2021-11-12T05:47:45.712 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6833/14876", 2021-11-12T05:47:45.713 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6831/14876", 2021-11-12T05:47:45.713 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:45.713 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:45.713 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:45.713 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.714 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.714 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.714 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:47:45.714 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "721529a1-c047-486a-a7ca-ddc15d80cdde", 2021-11-12T05:47:45.715 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:45.715 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:45.715 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:45.715 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:45.715 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:45.716 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:45.716 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:45.716 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 82, 2021-11-12T05:47:45.716 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:45.716 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:45.717 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:45.717 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:45.717 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.717 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:45.718 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6800", 2021-11-12T05:47:45.718 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:45.718 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.718 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.718 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:45.719 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6801", 2021-11-12T05:47:45.719 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:45.719 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:45.719 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.719 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.720 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:45.720 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:45.720 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.720 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:45.721 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6802", 2021-11-12T05:47:45.721 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:45.721 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.721 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.722 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:45.722 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6803", 2021-11-12T05:47:45.722 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:45.722 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:45.722 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.723 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.723 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:45.723 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:45.723 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.724 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:45.724 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6806", 2021-11-12T05:47:45.724 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:45.724 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.724 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.725 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:45.725 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6807", 2021-11-12T05:47:45.725 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:45.725 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:45.725 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.726 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.726 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:45.726 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:45.726 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.727 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:45.727 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6804", 2021-11-12T05:47:45.727 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:45.727 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.727 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.728 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:45.728 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6805", 2021-11-12T05:47:45.728 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:45.728 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:45.728 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.729 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.729 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6801/15096", 2021-11-12T05:47:45.729 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6803/15096", 2021-11-12T05:47:45.729 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6807/15096", 2021-11-12T05:47:45.729 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6805/15096", 2021-11-12T05:47:45.730 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:45.730 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:45.730 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:45.730 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.731 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.731 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.731 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:47:45.731 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "68b72ab2-fa82-4b5c-bf33-528f002e4950", 2021-11-12T05:47:45.731 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:45.732 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:45.732 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:45.732 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:45.732 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:45.732 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:45.733 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:45.733 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 82, 2021-11-12T05:47:45.733 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:45.733 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:45.733 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:45.734 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:45.734 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.734 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:45.734 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6808", 2021-11-12T05:47:45.735 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:45.735 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.735 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.735 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:45.736 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6809", 2021-11-12T05:47:45.736 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:45.736 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:45.736 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.736 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.737 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:45.737 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:45.737 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.737 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:45.737 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6810", 2021-11-12T05:47:45.738 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:45.738 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.738 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.738 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:45.738 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6811", 2021-11-12T05:47:45.739 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:45.739 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:45.739 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.739 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.740 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:45.740 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:45.740 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.740 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:45.740 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6814", 2021-11-12T05:47:45.741 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:45.741 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.741 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.741 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:45.741 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6815", 2021-11-12T05:47:45.742 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:45.742 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:45.742 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.742 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.743 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:45.743 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:45.743 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.743 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:45.743 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6812", 2021-11-12T05:47:45.744 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:45.744 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.744 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.744 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:45.744 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6813", 2021-11-12T05:47:45.745 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:45.745 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:45.745 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.745 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.745 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6809/15097", 2021-11-12T05:47:45.746 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6811/15097", 2021-11-12T05:47:45.746 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6815/15097", 2021-11-12T05:47:45.746 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6813/15097", 2021-11-12T05:47:45.746 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:45.747 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:45.747 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:45.747 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.747 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.747 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.748 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:47:45.748 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "a2c83b5d-8d37-4d30-ac04-30d89a76e485", 2021-11-12T05:47:45.748 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:45.748 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:45.748 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:45.749 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:45.749 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:45.749 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:45.749 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:45.749 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 82, 2021-11-12T05:47:45.750 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:45.750 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:45.750 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:45.750 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:45.750 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.751 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:45.751 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6816", 2021-11-12T05:47:45.751 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:45.751 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.751 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.752 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:45.752 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6817", 2021-11-12T05:47:45.752 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:45.752 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:45.753 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.753 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.753 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:45.753 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:45.753 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.754 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:45.754 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6818", 2021-11-12T05:47:45.754 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:45.754 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.754 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.755 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:45.755 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6819", 2021-11-12T05:47:45.755 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:45.755 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:45.756 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.756 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.756 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:45.756 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:45.756 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.757 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:45.757 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6822", 2021-11-12T05:47:45.757 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:45.757 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.757 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.758 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:45.758 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6823", 2021-11-12T05:47:45.758 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:45.758 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:45.758 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.759 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.759 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:45.759 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:45.759 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.760 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:45.760 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6820", 2021-11-12T05:47:45.760 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:45.760 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.760 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.761 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:45.761 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6821", 2021-11-12T05:47:45.761 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:45.761 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:45.761 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.762 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.762 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6817/15098", 2021-11-12T05:47:45.762 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6819/15098", 2021-11-12T05:47:45.762 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6823/15098", 2021-11-12T05:47:45.763 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6821/15098", 2021-11-12T05:47:45.763 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:45.763 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:45.763 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:45.763 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.764 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.764 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.764 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:47:45.764 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "786ce966-d0fb-4181-aed4-c26e3ef61c43", 2021-11-12T05:47:45.764 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:45.765 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:45.765 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:45.765 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:45.765 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:45.765 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:45.766 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:45.766 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 71, 2021-11-12T05:47:45.766 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:45.766 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:45.767 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:45.767 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:45.767 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.767 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:45.767 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6824", 2021-11-12T05:47:45.768 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:45.768 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.768 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.768 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:45.768 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6825", 2021-11-12T05:47:45.769 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:45.769 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:45.769 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.769 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.769 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:45.770 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:45.770 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.770 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:45.770 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6826", 2021-11-12T05:47:45.770 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:45.771 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.771 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.771 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:45.771 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6827", 2021-11-12T05:47:45.771 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:45.772 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:45.772 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.772 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.772 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:45.773 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:45.773 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.773 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:45.773 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6830", 2021-11-12T05:47:45.773 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:45.774 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.774 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.774 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:45.774 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6831", 2021-11-12T05:47:45.774 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:45.775 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:45.775 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.775 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.775 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:45.775 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:45.776 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.776 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:45.776 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6828", 2021-11-12T05:47:45.776 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:45.777 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.777 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.777 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:45.777 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6829", 2021-11-12T05:47:45.777 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:45.778 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:45.778 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.778 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.778 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6825/15099", 2021-11-12T05:47:45.778 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6827/15099", 2021-11-12T05:47:45.779 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6831/15099", 2021-11-12T05:47:45.779 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6829/15099", 2021-11-12T05:47:45.779 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:45.779 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:45.780 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:45.780 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:45.780 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:45.780 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:47:45.780 INFO:teuthology.orchestra.run.gibba005.stdout: "osd_xinfo": [ 2021-11-12T05:47:45.781 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.781 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:47:45.781 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:45.781 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:45.781 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:45.782 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:45.782 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:45.782 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.615112+0000", 2021-11-12T05:47:45.782 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:45.783 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.783 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.783 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:47:45.783 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:45.783 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:45.784 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:45.784 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:45.784 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:45.784 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.665935+0000", 2021-11-12T05:47:45.784 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:45.785 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.785 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.785 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:47:45.785 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:45.786 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:45.786 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:45.786 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:45.786 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:45.786 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.715877+0000", 2021-11-12T05:47:45.787 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:45.787 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.787 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.787 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:47:45.787 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:45.788 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:45.788 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:45.788 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:45.788 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:45.789 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.489234+0000", 2021-11-12T05:47:45.789 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:45.789 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.789 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.790 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:47:45.790 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:45.790 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:45.790 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:45.790 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:45.791 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:45.791 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.413776+0000", 2021-11-12T05:47:45.791 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:45.791 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.791 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.792 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:47:45.792 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:45.792 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:45.792 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:45.793 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:45.793 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:45.793 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.507960+0000", 2021-11-12T05:47:45.793 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:45.793 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.794 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.794 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:47:45.794 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:45.794 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:45.794 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:45.795 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:45.795 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:45.795 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.635696+0000", 2021-11-12T05:47:45.795 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:45.795 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.796 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:45.796 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:47:45.796 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:45.796 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:45.797 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:45.797 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:45.797 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:45.797 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.746949+0000", 2021-11-12T05:47:45.797 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:45.798 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:45.798 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:47:45.798 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap": [], 2021-11-12T05:47:45.798 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap_items": [], 2021-11-12T05:47:45.798 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_temp": [], 2021-11-12T05:47:45.799 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_temp": [], 2021-11-12T05:47:45.799 INFO:teuthology.orchestra.run.gibba005.stdout: "blacklist": { 2021-11-12T05:47:45.799 INFO:teuthology.orchestra.run.gibba005.stdout: "172.21.2.105:6835/1429326547": "2021-11-13T05:47:39.674707+0000", 2021-11-12T05:47:45.799 INFO:teuthology.orchestra.run.gibba005.stdout: "172.21.2.105:6834/1429326547": "2021-11-13T05:47:39.674707+0000", 2021-11-12T05:47:45.800 INFO:teuthology.orchestra.run.gibba005.stdout: "172.21.2.105:6835/1338677059": "2021-11-13T05:47:31.284551+0000", 2021-11-12T05:47:45.800 INFO:teuthology.orchestra.run.gibba005.stdout: "172.21.2.105:6834/1338677059": "2021-11-13T05:47:31.284551+0000" 2021-11-12T05:47:45.800 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.800 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profiles": { 2021-11-12T05:47:45.800 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs_data": { 2021-11-12T05:47:45.801 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-device-class": "", 2021-11-12T05:47:45.801 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:47:45.801 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-root": "default", 2021-11-12T05:47:45.801 INFO:teuthology.orchestra.run.gibba005.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-12T05:47:45.802 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:47:45.802 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "2", 2021-11-12T05:47:45.802 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:47:45.802 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:47:45.803 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van", 2021-11-12T05:47:45.803 INFO:teuthology.orchestra.run.gibba005.stdout: "w": "8" 2021-11-12T05:47:45.803 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.803 INFO:teuthology.orchestra.run.gibba005.stdout: "default": { 2021-11-12T05:47:45.804 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:47:45.804 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:47:45.804 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "1", 2021-11-12T05:47:45.804 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:47:45.804 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:47:45.805 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van" 2021-11-12T05:47:45.805 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:45.805 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:45.805 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps_queue": [], 2021-11-12T05:47:45.805 INFO:teuthology.orchestra.run.gibba005.stdout: "new_removed_snaps": [], 2021-11-12T05:47:45.806 INFO:teuthology.orchestra.run.gibba005.stdout: "new_purged_snaps": [], 2021-11-12T05:47:45.806 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_node_flags": {}, 2021-11-12T05:47:45.806 INFO:teuthology.orchestra.run.gibba005.stdout: "device_class_flags": {} 2021-11-12T05:47:45.806 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:47:45.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.608+0000 7fa3f0cdb700 1 -- 172.21.2.105:0/71694897 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa3d0053610 msgr2=0x7fa3d0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:45.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.608+0000 7fa3f0cdb700 1 --2- 172.21.2.105:0/71694897 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa3d0053610 0x7fa3d0055ad0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7fa3ec05d1b0 tx=0x7fa3d4007820).stop 2021-11-12T05:47:45.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.608+0000 7fa3f0cdb700 1 -- 172.21.2.105:0/71694897 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa3ec0626b0 msgr2=0x7fa3ec065c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:45.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.608+0000 7fa3f0cdb700 1 --2- 172.21.2.105:0/71694897 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa3ec0626b0 0x7fa3ec065c20 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7fa3dc002f70 tx=0x7fa3dc014000).stop 2021-11-12T05:47:45.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.608+0000 7fa3f0cdb700 1 -- 172.21.2.105:0/71694897 shutdown_connections 2021-11-12T05:47:45.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.608+0000 7fa3f0cdb700 1 --2- 172.21.2.105:0/71694897 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa3d0053610 0x7fa3d0055ad0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:45.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.608+0000 7fa3f0cdb700 1 --2- 172.21.2.105:0/71694897 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa3ec130a80 0x7fa3ec15a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:45.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.608+0000 7fa3f0cdb700 1 --2- 172.21.2.105:0/71694897 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa3ec0af750 0x7fa3ec1575f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:45.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.608+0000 7fa3f0cdb700 1 --2- 172.21.2.105:0/71694897 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa3ec0626b0 0x7fa3ec065c20 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:45.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.608+0000 7fa3f0cdb700 1 -- 172.21.2.105:0/71694897 >> 172.21.2.105:0/71694897 conn(0x7fa3ec0b5320 msgr2=0x7fa3ec060860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:45.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.608+0000 7fa3f0cdb700 1 -- 172.21.2.105:0/71694897 shutdown_connections 2021-11-12T05:47:45.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.608+0000 7fa3f0cdb700 1 -- 172.21.2.105:0/71694897 wait complete. 2021-11-12T05:47:45.811 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:47:45.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.860+0000 7f1b628c5700 1 Processor -- start 2021-11-12T05:47:45.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.860+0000 7f1b628c5700 1 -- start start 2021-11-12T05:47:45.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b628c5700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1b5c0ad080 0x7f1b5c0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:45.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b628c5700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f1b5c0ac280 0x7f1b5c0ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:45.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b628c5700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f1b5c14abe0 0x7f1b5c14b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:45.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b628c5700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b5c1488a0 con 0x7f1b5c14abe0 2021-11-12T05:47:45.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b628c5700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b5c0ac7b0 con 0x7f1b5c0ac280 2021-11-12T05:47:45.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b628c5700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5c0ac9e0 con 0x7f1b5c0ad080 2021-11-12T05:47:45.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b60e62700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f1b5c14abe0 0x7f1b5c14b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:45.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b60e62700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f1b5c14abe0 0x7f1b5c14b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48786/0 (socket says 172.21.2.105:48786) 2021-11-12T05:47:45.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b60e62700 1 -- 172.21.2.105:0/250359653 learned_addr learned my addr 172.21.2.105:0/250359653 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:45.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b60e62700 1 -- 172.21.2.105:0/250359653 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1b5c0ad080 msgr2=0x7f1b5c0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:45.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b60e62700 1 --2- 172.21.2.105:0/250359653 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1b5c0ad080 0x7f1b5c0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:45.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b60e62700 1 -- 172.21.2.105:0/250359653 >> v2:172.21.2.115:3300/0 conn(0x7f1b5c0ac280 msgr2=0x7f1b5c0ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:45.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b60e62700 1 --2- 172.21.2.105:0/250359653 >> v2:172.21.2.115:3300/0 conn(0x7f1b5c0ac280 0x7f1b5c0ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:45.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b60e62700 1 -- 172.21.2.105:0/250359653 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5c0b0b30 con 0x7f1b5c14abe0 2021-11-12T05:47:45.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b60e62700 1 --2- 172.21.2.105:0/250359653 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1b5c14abe0 0x7f1b5c14b090 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 rx=0x7f1b5c0ac6a0 tx=0x7f1b54009290).ready entity=mon.0 client_cookie=1a1278217cd03a94 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:45.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b5affd700 1 -- 172.21.2.105:0/250359653 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b5400b830 con 0x7f1b5c14abe0 2021-11-12T05:47:45.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b5affd700 1 -- 172.21.2.105:0/250359653 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5400b990 con 0x7f1b5c14abe0 2021-11-12T05:47:45.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b5affd700 1 -- 172.21.2.105:0/250359653 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b5400bb00 con 0x7f1b5c14abe0 2021-11-12T05:47:45.873 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b628c5700 1 -- 172.21.2.105:0/250359653 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1b5c14abe0 msgr2=0x7f1b5c14b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:45.873 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b628c5700 1 --2- 172.21.2.105:0/250359653 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1b5c14abe0 0x7f1b5c14b090 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 rx=0x7f1b5c0ac6a0 tx=0x7f1b54009290).stop 2021-11-12T05:47:45.873 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b628c5700 1 -- 172.21.2.105:0/250359653 shutdown_connections 2021-11-12T05:47:45.873 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b628c5700 1 --2- 172.21.2.105:0/250359653 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1b5c14abe0 0x7f1b5c14b090 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:45.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b628c5700 1 --2- 172.21.2.105:0/250359653 >> v2:172.21.2.115:3300/0 conn(0x7f1b5c0ac280 0x7f1b5c0ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:45.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b628c5700 1 --2- 172.21.2.105:0/250359653 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1b5c0ad080 0x7f1b5c0af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:45.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b628c5700 1 -- 172.21.2.105:0/250359653 >> 172.21.2.105:0/250359653 conn(0x7f1b5c0b5370 msgr2=0x7f1b5c0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:45.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b628c5700 1 -- 172.21.2.105:0/250359653 shutdown_connections 2021-11-12T05:47:45.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b628c5700 1 -- 172.21.2.105:0/250359653 wait complete. 2021-11-12T05:47:45.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b628c5700 1 Processor -- start 2021-11-12T05:47:45.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b628c5700 1 -- start start 2021-11-12T05:47:45.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b628c5700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1b5c0ac280 0x7f1b5c0a8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:45.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b628c5700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1b5c0ad080 0x7f1b5c0a90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:45.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b628c5700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1b5c14abe0 0x7f1b5c156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:45.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b628c5700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5c0a7fa0 con 0x7f1b5c0ad080 2021-11-12T05:47:45.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b628c5700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5c15adc0 con 0x7f1b5c0ac280 2021-11-12T05:47:45.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b628c5700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5c15b060 con 0x7f1b5c14abe0 2021-11-12T05:47:45.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b5b7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1b5c0ad080 0x7f1b5c0a90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:45.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b5b7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1b5c0ad080 0x7f1b5c0a90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48792/0 (socket says 172.21.2.105:48792) 2021-11-12T05:47:45.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b5b7fe700 1 -- 172.21.2.105:0/1532548484 learned_addr learned my addr 172.21.2.105:0/1532548484 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:45.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b5b7fe700 1 -- 172.21.2.105:0/1532548484 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1b5c14abe0 msgr2=0x7f1b5c156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:45.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b5b7fe700 1 --2- 172.21.2.105:0/1532548484 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1b5c14abe0 0x7f1b5c156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:45.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b5b7fe700 1 -- 172.21.2.105:0/1532548484 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1b5c0ac280 msgr2=0x7f1b5c0a8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:45.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b5b7fe700 1 --2- 172.21.2.105:0/1532548484 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1b5c0ac280 0x7f1b5c0a8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:45.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b5b7fe700 1 -- 172.21.2.105:0/1532548484 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b54009530 con 0x7f1b5c0ad080 2021-11-12T05:47:45.881 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.864+0000 7f1b5b7fe700 1 --2- 172.21.2.105:0/1532548484 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1b5c0ad080 0x7f1b5c0a90f0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 rx=0x7f1b50002f70 tx=0x7f1b50006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:45.881 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.868+0000 7f1b597fa700 1 -- 172.21.2.105:0/1532548484 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b50013460 con 0x7f1b5c0ad080 2021-11-12T05:47:45.881 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.868+0000 7f1b597fa700 1 -- 172.21.2.105:0/1532548484 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b500135c0 con 0x7f1b5c0ad080 2021-11-12T05:47:45.881 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.868+0000 7f1b628c5700 1 -- 172.21.2.105:0/1532548484 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b5c0a78c0 con 0x7f1b5c0ad080 2021-11-12T05:47:45.882 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.868+0000 7f1b597fa700 1 -- 172.21.2.105:0/1532548484 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b50013920 con 0x7f1b5c0ad080 2021-11-12T05:47:45.882 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.868+0000 7f1b628c5700 1 -- 172.21.2.105:0/1532548484 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b5c0a9800 con 0x7f1b5c0ad080 2021-11-12T05:47:45.882 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.868+0000 7f1b628c5700 1 -- 172.21.2.105:0/1532548484 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b5c14b580 con 0x7f1b5c0ad080 2021-11-12T05:47:45.882 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.868+0000 7f1b597fa700 1 -- 172.21.2.105:0/1532548484 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1b5000f070 con 0x7f1b5c0ad080 2021-11-12T05:47:45.883 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.868+0000 7f1b597fa700 1 --2- 172.21.2.105:0/1532548484 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1b3c0536d0 0x7f1b3c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:45.883 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.868+0000 7f1b597fa700 1 -- 172.21.2.105:0/1532548484 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5768+0+0 (secure 0 0 0) 0x7f1b5006b180 con 0x7f1b5c0ad080 2021-11-12T05:47:45.883 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.868+0000 7f1b5bfff700 1 --2- 172.21.2.105:0/1532548484 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1b3c0536d0 0x7f1b3c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:45.883 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.868+0000 7f1b5bfff700 1 --2- 172.21.2.105:0/1532548484 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1b3c0536d0 0x7f1b3c055b90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f1b4c002f70 tx=0x7f1b4c006a00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:45.883 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.868+0000 7f1b597fa700 1 -- 172.21.2.105:0/1532548484 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1b50042410 con 0x7f1b5c0ad080 2021-11-12T05:47:45.981 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.976+0000 7f1b628c5700 1 -- 172.21.2.105:0/1532548484 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b5c15b220 con 0x7f1b5c0ad080 2021-11-12T05:47:45.981 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.976+0000 7f1b597fa700 1 -- 172.21.2.105:0/1532548484 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+1206 (secure 0 0 0) 0x7f1b50045a30 con 0x7f1b5c0ad080 2021-11-12T05:47:45.982 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:45.982 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":41,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4960,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/157622236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":157622236},{"type":"v1","addr":"172.21.2.115:6833","nonce":157622236}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36},{"gid":6939,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.105:6835/4227362619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":4227362619},{"type":"v1","addr":"172.21.2.105:6835","nonce":4227362619}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41}],"filesystems":[]} 2021-11-12T05:47:45.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.976+0000 7f1b628c5700 1 -- 172.21.2.105:0/1532548484 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1b3c0536d0 msgr2=0x7f1b3c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:45.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.976+0000 7f1b628c5700 1 --2- 172.21.2.105:0/1532548484 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1b3c0536d0 0x7f1b3c055b90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f1b4c002f70 tx=0x7f1b4c006a00).stop 2021-11-12T05:47:45.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.976+0000 7f1b628c5700 1 -- 172.21.2.105:0/1532548484 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1b5c0ad080 msgr2=0x7f1b5c0a90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:45.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.976+0000 7f1b628c5700 1 --2- 172.21.2.105:0/1532548484 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1b5c0ad080 0x7f1b5c0a90f0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 rx=0x7f1b50002f70 tx=0x7f1b50006ec0).stop 2021-11-12T05:47:45.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.976+0000 7f1b628c5700 1 -- 172.21.2.105:0/1532548484 shutdown_connections 2021-11-12T05:47:45.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.976+0000 7f1b628c5700 1 --2- 172.21.2.105:0/1532548484 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1b3c0536d0 0x7f1b3c055b90 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:45.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.976+0000 7f1b628c5700 1 --2- 172.21.2.105:0/1532548484 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1b5c14abe0 0x7f1b5c156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:45.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.976+0000 7f1b628c5700 1 --2- 172.21.2.105:0/1532548484 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1b5c0ad080 0x7f1b5c0a90f0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:45.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.976+0000 7f1b628c5700 1 --2- 172.21.2.105:0/1532548484 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1b5c0ac280 0x7f1b5c0a8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:45.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.976+0000 7f1b628c5700 1 -- 172.21.2.105:0/1532548484 >> 172.21.2.105:0/1532548484 conn(0x7f1b5c0b5370 msgr2=0x7f1b5c05fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:45.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.976+0000 7f1b628c5700 1 -- 172.21.2.105:0/1532548484 shutdown_connections 2021-11-12T05:47:45.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:45.976+0000 7f1b628c5700 1 -- 172.21.2.105:0/1532548484 wait complete. 2021-11-12T05:47:45.986 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 41 2021-11-12T05:47:45.989 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:47:46.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.036+0000 7fd8e0034700 1 Processor -- start 2021-11-12T05:47:46.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.036+0000 7fd8e0034700 1 -- start start 2021-11-12T05:47:46.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.036+0000 7fd8e0034700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd8d80af7d0 0x7fd8d80b0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:46.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.036+0000 7fd8e0034700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8d80b0020 con 0x7fd8d80a95c0 2021-11-12T05:47:46.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.036+0000 7fd8e0034700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8d80aeb60 con 0x7fd8d80b1a60 2021-11-12T05:47:46.042 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.036+0000 7fd8e0034700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d80b2e10 con 0x7fd8d80af7d0 2021-11-12T05:47:46.042 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.036+0000 7fd8dddd0700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd8d80af7d0 0x7fd8d80b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:46.042 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.036+0000 7fd8dddd0700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd8d80af7d0 0x7fd8d80b0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48796/0 (socket says 172.21.2.105:48796) 2021-11-12T05:47:46.042 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.036+0000 7fd8de5d1700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fd8d80a95c0 0x7fd8d814daf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:59196/0 (socket says 172.21.2.105:59196) 2021-11-12T05:47:46.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.036+0000 7fd8dddd0700 1 -- 172.21.2.105:0/1851708902 learned_addr learned my addr 172.21.2.105:0/1851708902 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:46.046 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.036+0000 7fd8dddd0700 1 -- 172.21.2.105:0/1851708902 >> v1:172.21.2.115:6789/0 conn(0x7fd8d80b1a60 legacy=0x7fd8d80a8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:46.046 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.036+0000 7fd8dddd0700 1 -- 172.21.2.105:0/1851708902 >> v1:172.21.2.105:6789/0 conn(0x7fd8d80a95c0 legacy=0x7fd8d814daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:46.047 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.036+0000 7fd8dddd0700 1 -- 172.21.2.105:0/1851708902 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d80b1670 con 0x7fd8d80af7d0 2021-11-12T05:47:46.047 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.036+0000 7fd8dddd0700 1 --2- 172.21.2.105:0/1851708902 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd8d80af7d0 0x7fd8d80b0570 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 rx=0x7fd8d805c4c0 tx=0x7fd8cc006eb0).ready entity=mon.0 client_cookie=3cb0f314978ac4a0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:46.047 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.036+0000 7fd8dcdce700 1 -- 172.21.2.105:0/1851708902 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8cc00d5c0 con 0x7fd8d80af7d0 2021-11-12T05:47:46.047 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.036+0000 7fd8dcdce700 1 -- 172.21.2.105:0/1851708902 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8cc000e90 con 0x7fd8d80af7d0 2021-11-12T05:47:46.048 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.036+0000 7fd8dcdce700 1 -- 172.21.2.105:0/1851708902 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8cc00d950 con 0x7fd8d80af7d0 2021-11-12T05:47:46.048 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.036+0000 7fd8e0034700 1 -- 172.21.2.105:0/1851708902 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd8d80af7d0 msgr2=0x7fd8d80b0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:46.048 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.036+0000 7fd8e0034700 1 --2- 172.21.2.105:0/1851708902 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd8d80af7d0 0x7fd8d80b0570 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 rx=0x7fd8d805c4c0 tx=0x7fd8cc006eb0).stop 2021-11-12T05:47:46.048 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.036+0000 7fd8e0034700 1 -- 172.21.2.105:0/1851708902 shutdown_connections 2021-11-12T05:47:46.048 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.036+0000 7fd8e0034700 1 --2- 172.21.2.105:0/1851708902 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd8d80af7d0 0x7fd8d80b0570 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:46.049 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.036+0000 7fd8e0034700 1 -- 172.21.2.105:0/1851708902 >> 172.21.2.105:0/1851708902 conn(0x7fd8d8068440 msgr2=0x7fd8d8062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:46.049 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.036+0000 7fd8e0034700 1 -- 172.21.2.105:0/1851708902 shutdown_connections 2021-11-12T05:47:46.049 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.036+0000 7fd8e0034700 1 -- 172.21.2.105:0/1851708902 wait complete. 2021-11-12T05:47:46.049 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.036+0000 7fd8e0034700 1 Processor -- start 2021-11-12T05:47:46.050 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.036+0000 7fd8e0034700 1 -- start start 2021-11-12T05:47:46.050 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.040+0000 7fd8e0034700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd8d80a95c0 0x7fd8d80a2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:46.050 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.040+0000 7fd8e0034700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd8d80af7d0 0x7fd8d8153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:46.050 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.040+0000 7fd8e0034700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd8d80b1a60 0x7fd8d80ab070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:46.050 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.040+0000 7fd8e0034700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d8153a00 con 0x7fd8d80b1a60 2021-11-12T05:47:46.051 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.040+0000 7fd8e0034700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d8152b30 con 0x7fd8d80af7d0 2021-11-12T05:47:46.051 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.040+0000 7fd8e0034700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d8152dd0 con 0x7fd8d80a95c0 2021-11-12T05:47:46.051 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.040+0000 7fd8de5d1700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd8d80b1a60 0x7fd8d80ab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:46.051 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.040+0000 7fd8de5d1700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd8d80b1a60 0x7fd8d80ab070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48806/0 (socket says 172.21.2.105:48806) 2021-11-12T05:47:46.052 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.040+0000 7fd8de5d1700 1 -- 172.21.2.105:0/2757556062 learned_addr learned my addr 172.21.2.105:0/2757556062 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:46.052 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.040+0000 7fd8de5d1700 1 -- 172.21.2.105:0/2757556062 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd8d80a95c0 msgr2=0x7fd8d80a2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:46.052 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.040+0000 7fd8de5d1700 1 --2- 172.21.2.105:0/2757556062 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd8d80a95c0 0x7fd8d80a2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:46.052 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.040+0000 7fd8de5d1700 1 -- 172.21.2.105:0/2757556062 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd8d80af7d0 msgr2=0x7fd8d8153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:46.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.040+0000 7fd8de5d1700 1 --2- 172.21.2.105:0/2757556062 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd8d80af7d0 0x7fd8d8153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:46.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.040+0000 7fd8de5d1700 1 -- 172.21.2.105:0/2757556062 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8cc00b1e0 con 0x7fd8d80b1a60 2021-11-12T05:47:46.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.040+0000 7fd8de5d1700 1 --2- 172.21.2.105:0/2757556062 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd8d80b1a60 0x7fd8d80ab070 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7fd8d80acda0 tx=0x7fd8d0007ed0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:46.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.040+0000 7fd8caffd700 1 -- 172.21.2.105:0/2757556062 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8d0005ae0 con 0x7fd8d80b1a60 2021-11-12T05:47:46.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.040+0000 7fd8caffd700 1 -- 172.21.2.105:0/2757556062 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d0005c40 con 0x7fd8d80b1a60 2021-11-12T05:47:46.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.040+0000 7fd8e0034700 1 -- 172.21.2.105:0/2757556062 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d8153070 con 0x7fd8d80b1a60 2021-11-12T05:47:46.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.040+0000 7fd8caffd700 1 -- 172.21.2.105:0/2757556062 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8d0007110 con 0x7fd8d80b1a60 2021-11-12T05:47:46.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.040+0000 7fd8e0034700 1 -- 172.21.2.105:0/2757556062 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d8064bf0 con 0x7fd8d80b1a60 2021-11-12T05:47:46.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.040+0000 7fd8e0034700 1 -- 172.21.2.105:0/2757556062 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8d8065330 con 0x7fd8d80b1a60 2021-11-12T05:47:46.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.040+0000 7fd8caffd700 1 -- 172.21.2.105:0/2757556062 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd8d0010030 con 0x7fd8d80b1a60 2021-11-12T05:47:46.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.040+0000 7fd8caffd700 1 --2- 172.21.2.105:0/2757556062 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd8b8053610 0x7fd8b8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:46.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.040+0000 7fd8caffd700 1 -- 172.21.2.105:0/2757556062 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5768+0+0 (secure 0 0 0) 0x7fd8d006b800 con 0x7fd8d80b1a60 2021-11-12T05:47:46.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.040+0000 7fd8dddd0700 1 --2- 172.21.2.105:0/2757556062 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd8b8053610 0x7fd8b8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:46.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.040+0000 7fd8dddd0700 1 --2- 172.21.2.105:0/2757556062 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd8b8053610 0x7fd8b8055ad0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7fd8d805c4c0 tx=0x7fd8cc015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:46.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.044+0000 7fd8caffd700 1 -- 172.21.2.105:0/2757556062 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd8d8065330 con 0x7fd8d80b1a60 2021-11-12T05:47:46.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.152+0000 7fd8e0034700 1 -- 172.21.2.105:0/2757556062 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8d8065330 con 0x7fd8d80b1a60 2021-11-12T05:47:46.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.152+0000 7fd8caffd700 1 -- 172.21.2.105:0/2757556062 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+1206 (secure 0 0 0) 0x7fd8d8065330 con 0x7fd8d80b1a60 2021-11-12T05:47:46.156 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:46.157 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":41,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4960,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/157622236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":157622236},{"type":"v1","addr":"172.21.2.115:6833","nonce":157622236}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36},{"gid":6939,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.105:6835/4227362619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":4227362619},{"type":"v1","addr":"172.21.2.105:6835","nonce":4227362619}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41}],"filesystems":[]} 2021-11-12T05:47:46.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.152+0000 7fd8e0034700 1 -- 172.21.2.105:0/2757556062 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd8b8053610 msgr2=0x7fd8b8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:46.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.152+0000 7fd8e0034700 1 --2- 172.21.2.105:0/2757556062 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd8b8053610 0x7fd8b8055ad0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7fd8d805c4c0 tx=0x7fd8cc015000).stop 2021-11-12T05:47:46.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.152+0000 7fd8e0034700 1 -- 172.21.2.105:0/2757556062 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd8d80b1a60 msgr2=0x7fd8d80ab070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:46.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.152+0000 7fd8e0034700 1 --2- 172.21.2.105:0/2757556062 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd8d80b1a60 0x7fd8d80ab070 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7fd8d80acda0 tx=0x7fd8d0007ed0).stop 2021-11-12T05:47:46.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.152+0000 7fd8e0034700 1 -- 172.21.2.105:0/2757556062 shutdown_connections 2021-11-12T05:47:46.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.152+0000 7fd8e0034700 1 --2- 172.21.2.105:0/2757556062 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd8b8053610 0x7fd8b8055ad0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:46.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.152+0000 7fd8e0034700 1 --2- 172.21.2.105:0/2757556062 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd8d80b1a60 0x7fd8d80ab070 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:46.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.152+0000 7fd8e0034700 1 --2- 172.21.2.105:0/2757556062 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd8d80af7d0 0x7fd8d8153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:46.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.152+0000 7fd8e0034700 1 --2- 172.21.2.105:0/2757556062 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd8d80a95c0 0x7fd8d80a2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:46.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.152+0000 7fd8e0034700 1 -- 172.21.2.105:0/2757556062 >> 172.21.2.105:0/2757556062 conn(0x7fd8d8068440 msgr2=0x7fd8d80b5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:46.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.152+0000 7fd8e0034700 1 -- 172.21.2.105:0/2757556062 shutdown_connections 2021-11-12T05:47:46.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.152+0000 7fd8e0034700 1 -- 172.21.2.105:0/2757556062 wait complete. 2021-11-12T05:47:46.160 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 41 2021-11-12T05:47:46.163 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-12T05:47:46.164 INFO:tasks.ceph.mds.a:Stopping old one... 2021-11-12T05:47:46.164 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-12T05:47:46.164 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T05:47:46.165 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-12T05:47:46.165 INFO:tasks.ceph.mds.b:Stopping old one... 2021-11-12T05:47:46.165 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-12T05:47:46.166 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T05:47:46.170 INFO:tasks.ceph.mds.a:Stopped 2021-11-12T05:47:46.170 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-12T05:47:46.172 INFO:tasks.ceph.mds.a:Started 2021-11-12T05:47:46.172 DEBUG:teuthology.parallel:result is None 2021-11-12T05:47:46.178 INFO:tasks.ceph.mds.b:Stopped 2021-11-12T05:47:46.178 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-12T05:47:46.180 INFO:tasks.ceph.mds.b:Started 2021-11-12T05:47:46.181 DEBUG:teuthology.parallel:result is None 2021-11-12T05:47:46.181 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-11-12T05:47:46.205 INFO:tasks.ceph.mds.a.gibba005.stdout:starting mds.a at 2021-11-12T05:47:46.214 INFO:tasks.ceph.mds.b.gibba015.stdout:starting mds.b at 2021-11-12T05:47:46.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.232+0000 7fb4e017a700 1 Processor -- start 2021-11-12T05:47:46.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.232+0000 7fb4e017a700 1 -- start start 2021-11-12T05:47:46.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.232+0000 7fb4e017a700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb4d80626b0 0x7fb4d8062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:46.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.232+0000 7fb4e017a700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fb4d8130a80 0x7fb4d81474d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:46.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.232+0000 7fb4e017a700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4d80b0d50 con 0x7fb4d80af750 2021-11-12T05:47:46.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.232+0000 7fb4e017a700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4d80ad380 con 0x7fb4d80626b0 2021-11-12T05:47:46.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.232+0000 7fb4e017a700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4d80ae190 con 0x7fb4d8130a80 2021-11-12T05:47:46.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.232+0000 7fb4dd715700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fb4d80af750 0x7fb4d8130370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:59218/0 (socket says 172.21.2.105:59218) 2021-11-12T05:47:46.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.232+0000 7fb4dd715700 1 -- 172.21.2.105:0/2392774307 learned_addr learned my addr 172.21.2.105:0/2392774307 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:46.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.232+0000 7fb4ddf16700 1 --2- 172.21.2.105:0/2392774307 >> v2:172.21.2.105:3300/0 conn(0x7fb4d80626b0 0x7fb4d8062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:46.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.232+0000 7fb4ddf16700 1 -- 172.21.2.105:0/2392774307 >> v2:172.21.2.115:3300/0 conn(0x7fb4d8130a80 msgr2=0x7fb4d81474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:46.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.232+0000 7fb4ddf16700 1 --2- 172.21.2.105:0/2392774307 >> v2:172.21.2.115:3300/0 conn(0x7fb4d8130a80 0x7fb4d81474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:46.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.232+0000 7fb4ddf16700 1 -- 172.21.2.105:0/2392774307 >> v1:172.21.2.105:6789/0 conn(0x7fb4d80af750 legacy=0x7fb4d8130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:46.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.232+0000 7fb4ddf16700 1 -- 172.21.2.105:0/2392774307 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d81479c0 con 0x7fb4d80626b0 2021-11-12T05:47:46.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.232+0000 7fb4ddf16700 1 --2- 172.21.2.105:0/2392774307 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb4d80626b0 0x7fb4d8062a90 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7fb4d4002f70 tx=0x7fb4d4006df0).ready entity=mon.0 client_cookie=2544984c5fc3937e server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:46.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.232+0000 7fb4dcf14700 1 -- 172.21.2.105:0/2392774307 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4d400d5c0 con 0x7fb4d80626b0 2021-11-12T05:47:46.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.232+0000 7fb4dcf14700 1 -- 172.21.2.105:0/2392774307 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d4000e90 con 0x7fb4d80626b0 2021-11-12T05:47:46.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.232+0000 7fb4dcf14700 1 -- 172.21.2.105:0/2392774307 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4d400d950 con 0x7fb4d80626b0 2021-11-12T05:47:46.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.232+0000 7fb4e017a700 1 -- 172.21.2.105:0/2392774307 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb4d80626b0 msgr2=0x7fb4d8062a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:46.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.232+0000 7fb4e017a700 1 --2- 172.21.2.105:0/2392774307 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb4d80626b0 0x7fb4d8062a90 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7fb4d4002f70 tx=0x7fb4d4006df0).stop 2021-11-12T05:47:46.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.232+0000 7fb4e017a700 1 -- 172.21.2.105:0/2392774307 shutdown_connections 2021-11-12T05:47:46.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.232+0000 7fb4e017a700 1 --2- 172.21.2.105:0/2392774307 >> v2:172.21.2.115:3300/0 conn(0x7fb4d8130a80 0x7fb4d81474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:46.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.232+0000 7fb4e017a700 1 --2- 172.21.2.105:0/2392774307 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb4d80626b0 0x7fb4d8062a90 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:46.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.232+0000 7fb4e017a700 1 -- 172.21.2.105:0/2392774307 >> 172.21.2.105:0/2392774307 conn(0x7fb4d80b5320 msgr2=0x7fb4d80b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:46.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.232+0000 7fb4e017a700 1 -- 172.21.2.105:0/2392774307 shutdown_connections 2021-11-12T05:47:46.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.232+0000 7fb4e017a700 1 -- 172.21.2.105:0/2392774307 wait complete. 2021-11-12T05:47:46.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.232+0000 7fb4e017a700 1 Processor -- start 2021-11-12T05:47:46.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.232+0000 7fb4e017a700 1 -- start start 2021-11-12T05:47:46.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.232+0000 7fb4e017a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb4d80626b0 0x7fb4d8148a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:46.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.232+0000 7fb4e017a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb4d80af750 0x7fb4d812cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:46.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.232+0000 7fb4e017a700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb4d8130a80 0x7fb4d814ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:46.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.232+0000 7fb4e017a700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d814c500 con 0x7fb4d80af750 2021-11-12T05:47:46.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.232+0000 7fb4e017a700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d814c7a0 con 0x7fb4d8130a80 2021-11-12T05:47:46.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.232+0000 7fb4e017a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d814a920 con 0x7fb4d80626b0 2021-11-12T05:47:46.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.232+0000 7fb4dd715700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb4d80af750 0x7fb4d812cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:46.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.232+0000 7fb4dd715700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb4d80af750 0x7fb4d812cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48828/0 (socket says 172.21.2.105:48828) 2021-11-12T05:47:46.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.232+0000 7fb4dd715700 1 -- 172.21.2.105:0/4061954789 learned_addr learned my addr 172.21.2.105:0/4061954789 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:46.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.236+0000 7fb4dd715700 1 -- 172.21.2.105:0/4061954789 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb4d80626b0 msgr2=0x7fb4d8148a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:46.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.236+0000 7fb4dd715700 1 --2- 172.21.2.105:0/4061954789 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb4d80626b0 0x7fb4d8148a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:46.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.236+0000 7fb4dd715700 1 -- 172.21.2.105:0/4061954789 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb4d8130a80 msgr2=0x7fb4d814ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:46.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.236+0000 7fb4dd715700 1 --2- 172.21.2.105:0/4061954789 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb4d8130a80 0x7fb4d814ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:46.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.236+0000 7fb4dd715700 1 -- 172.21.2.105:0/4061954789 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d400b180 con 0x7fb4d80af750 2021-11-12T05:47:46.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.236+0000 7fb4dd715700 1 --2- 172.21.2.105:0/4061954789 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb4d80af750 0x7fb4d812cc50 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 rx=0x7fb4d80b0690 tx=0x7fb4c8007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:46.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.236+0000 7fb4c6ffd700 1 -- 172.21.2.105:0/4061954789 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4c800ce30 con 0x7fb4d80af750 2021-11-12T05:47:46.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.236+0000 7fb4c6ffd700 1 -- 172.21.2.105:0/4061954789 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c80072e0 con 0x7fb4d80af750 2021-11-12T05:47:46.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.236+0000 7fb4e017a700 1 -- 172.21.2.105:0/4061954789 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4d812d140 con 0x7fb4d80af750 2021-11-12T05:47:46.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.236+0000 7fb4e017a700 1 -- 172.21.2.105:0/4061954789 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4d8149630 con 0x7fb4d80af750 2021-11-12T05:47:46.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.236+0000 7fb4c6ffd700 1 -- 172.21.2.105:0/4061954789 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4c8005800 con 0x7fb4d80af750 2021-11-12T05:47:46.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.236+0000 7fb4e017a700 1 -- 172.21.2.105:0/4061954789 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4d8149940 con 0x7fb4d80af750 2021-11-12T05:47:46.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.236+0000 7fb4c6ffd700 1 -- 172.21.2.105:0/4061954789 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb4c8010070 con 0x7fb4d80af750 2021-11-12T05:47:46.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.236+0000 7fb4c6ffd700 1 --2- 172.21.2.105:0/4061954789 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb4b8053660 0x7fb4b8055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:46.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.236+0000 7fb4c6ffd700 1 -- 172.21.2.105:0/4061954789 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5768+0+0 (secure 0 0 0) 0x7fb4c806aff0 con 0x7fb4d80af750 2021-11-12T05:47:46.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.236+0000 7fb4ddf16700 1 --2- 172.21.2.105:0/4061954789 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb4b8053660 0x7fb4b8055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:46.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.236+0000 7fb4ddf16700 1 --2- 172.21.2.105:0/4061954789 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb4b8053660 0x7fb4b8055b20 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7fb4d4002f70 tx=0x7fb4d4014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:46.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.240+0000 7fb4c6ffd700 1 -- 172.21.2.105:0/4061954789 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb4c8042110 con 0x7fb4d80af750 2021-11-12T05:47:46.334 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:46.328+0000 7fb4e017a700 1 -- 172.21.2.105:0/4061954789 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fb4d8057350 con 0x7fb4d80af750 2021-11-12T05:47:47.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.216+0000 7fb4c6ffd700 1 -- 172.21.2.105:0/4061954789 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v91) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb4c8045730 con 0x7fb4d80af750 2021-11-12T05:47:47.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.220+0000 7fb4e017a700 1 -- 172.21.2.105:0/4061954789 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb4b8053660 msgr2=0x7fb4b8055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:47.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.220+0000 7fb4e017a700 1 --2- 172.21.2.105:0/4061954789 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb4b8053660 0x7fb4b8055b20 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7fb4d4002f70 tx=0x7fb4d4014000).stop 2021-11-12T05:47:47.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.220+0000 7fb4e017a700 1 -- 172.21.2.105:0/4061954789 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb4d80af750 msgr2=0x7fb4d812cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:47.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.220+0000 7fb4e017a700 1 --2- 172.21.2.105:0/4061954789 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb4d80af750 0x7fb4d812cc50 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 rx=0x7fb4d80b0690 tx=0x7fb4c8007c10).stop 2021-11-12T05:47:47.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.220+0000 7fb4e017a700 1 -- 172.21.2.105:0/4061954789 shutdown_connections 2021-11-12T05:47:47.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.220+0000 7fb4e017a700 1 --2- 172.21.2.105:0/4061954789 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb4b8053660 0x7fb4b8055b20 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:47.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.220+0000 7fb4e017a700 1 --2- 172.21.2.105:0/4061954789 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb4d8130a80 0x7fb4d814ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:47.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.220+0000 7fb4e017a700 1 --2- 172.21.2.105:0/4061954789 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb4d80af750 0x7fb4d812cc50 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:47.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.220+0000 7fb4e017a700 1 --2- 172.21.2.105:0/4061954789 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb4d80626b0 0x7fb4d8148a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:47.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.220+0000 7fb4e017a700 1 -- 172.21.2.105:0/4061954789 >> 172.21.2.105:0/4061954789 conn(0x7fb4d80b5320 msgr2=0x7fb4d80b46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:47.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.220+0000 7fb4e017a700 1 -- 172.21.2.105:0/4061954789 shutdown_connections 2021-11-12T05:47:47.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.220+0000 7fb4e017a700 1 -- 172.21.2.105:0/4061954789 wait complete. 2021-11-12T05:47:47.227 INFO:teuthology.orchestra.run.gibba005.stderr: removed all blacklist entries 2021-11-12T05:47:47.231 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-11-12T05:47:47.231 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-11-12T05:47:47.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f79075f6700 1 Processor -- start 2021-11-12T05:47:47.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f79075f6700 1 -- start start 2021-11-12T05:47:47.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f79075f6700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7900144fb0 0x7f790013deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:47.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f79075f6700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79001416e0 con 0x7f79000b7b50 2021-11-12T05:47:47.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f79075f6700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7900142220 con 0x7f79000ad270 2021-11-12T05:47:47.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f79075f6700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79000b7f30 con 0x7f7900144fb0 2021-11-12T05:47:47.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f7905392700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f79000b7b50 0x7f7900140fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:59232/0 (socket says 172.21.2.105:59232) 2021-11-12T05:47:47.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f7905392700 1 -- 172.21.2.105:0/551951147 learned_addr learned my addr 172.21.2.105:0/551951147 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:47.334 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f78effff700 1 -- 172.21.2.105:0/551951147 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 501251843 0 0) 0x7f79001416e0 con 0x7f79000b7b50 2021-11-12T05:47:47.334 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f78effff700 1 -- 172.21.2.105:0/551951147 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78e8003260 con 0x7f79000b7b50 2021-11-12T05:47:47.334 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f7905b93700 1 --2- 172.21.2.105:0/551951147 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7900144fb0 0x7f790013deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:47.334 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f78effff700 1 -- 172.21.2.105:0/551951147 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1528200969 0 0) 0x7f78e8003260 con 0x7f79000b7b50 2021-11-12T05:47:47.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f78effff700 1 -- 172.21.2.105:0/551951147 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7900144fb0 msgr2=0x7f790013deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:47.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f78effff700 1 --2- 172.21.2.105:0/551951147 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7900144fb0 0x7f790013deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:47.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f78effff700 1 -- 172.21.2.105:0/551951147 >> v1:172.21.2.115:6789/0 conn(0x7f79000ad270 legacy=0x7f7900066f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:47.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f78effff700 1 -- 172.21.2.105:0/551951147 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79000b2fe0 con 0x7f79000b7b50 2021-11-12T05:47:47.336 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f78effff700 1 -- 172.21.2.105:0/551951147 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f78fc001660 con 0x7f79000b7b50 2021-11-12T05:47:47.336 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f78effff700 1 -- 172.21.2.105:0/551951147 >> v1:172.21.2.105:6789/0 conn(0x7f79000b7b50 legacy=0x7f7900140fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:47.336 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f78effff700 1 --2- 172.21.2.105:0/551951147 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7900144fb0 0x7f78e8003780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:47.336 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f78effff700 1 --2- 172.21.2.105:0/551951147 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f78e8003d60 0x7f78e8004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:47.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f78effff700 1 --2- 172.21.2.105:0/551951147 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f78e80049f0 0x7f78e8004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:47.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f78effff700 1 -- 172.21.2.105:0/551951147 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79000b7f30 con 0x7f78e8003d60 2021-11-12T05:47:47.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f78effff700 1 -- 172.21.2.105:0/551951147 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e800b900 con 0x7f78e80049f0 2021-11-12T05:47:47.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f78effff700 1 -- 172.21.2.105:0/551951147 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e800bac0 con 0x7f7900144fb0 2021-11-12T05:47:47.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f7904b91700 1 --2- 172.21.2.105:0/551951147 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f78e8003d60 0x7f78e8004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:47.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f7904b91700 1 -- 172.21.2.105:0/551951147 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7900144fb0 msgr2=0x7f78e8003780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:47.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f7904b91700 1 --2- 172.21.2.105:0/551951147 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7900144fb0 0x7f78e8003780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:47.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f7904b91700 1 -- 172.21.2.105:0/551951147 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f78e80049f0 msgr2=0x7f78e8004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:47.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f7904b91700 1 --2- 172.21.2.105:0/551951147 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f78e80049f0 0x7f78e8004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:47.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f7904b91700 1 -- 172.21.2.105:0/551951147 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e8003260 con 0x7f78e8003d60 2021-11-12T05:47:47.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f7904b91700 1 --2- 172.21.2.105:0/551951147 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f78e8003d60 0x7f78e8004500 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7f79000b5130 tx=0x7f78f0007a00).ready entity=mon.0 client_cookie=4fd65cadc5652cca server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:47.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f78effff700 1 -- 172.21.2.105:0/551951147 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78f0007d10 con 0x7f78e8003d60 2021-11-12T05:47:47.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f78effff700 1 -- 172.21.2.105:0/551951147 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f0007030 con 0x7f78e8003d60 2021-11-12T05:47:47.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f78effff700 1 -- 172.21.2.105:0/551951147 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78f0007390 con 0x7f78e8003d60 2021-11-12T05:47:47.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f79075f6700 1 -- 172.21.2.105:0/551951147 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f78e8003d60 msgr2=0x7f78e8004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:47.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f79075f6700 1 --2- 172.21.2.105:0/551951147 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f78e8003d60 0x7f78e8004500 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7f79000b5130 tx=0x7f78f0007a00).stop 2021-11-12T05:47:47.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f7905b93700 1 -- 172.21.2.105:0/551951147 reap_dead start 2021-11-12T05:47:47.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f79075f6700 1 -- 172.21.2.105:0/551951147 shutdown_connections 2021-11-12T05:47:47.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f79075f6700 1 -- 172.21.2.105:0/551951147 >> 172.21.2.105:0/551951147 conn(0x7f7900060ba0 msgr2=0x7f790005c490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:47.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f79075f6700 1 -- 172.21.2.105:0/551951147 shutdown_connections 2021-11-12T05:47:47.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.324+0000 7f79075f6700 1 -- 172.21.2.105:0/551951147 wait complete. 2021-11-12T05:47:47.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.328+0000 7f79075f6700 1 Processor -- start 2021-11-12T05:47:47.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.328+0000 7f79075f6700 1 -- start start 2021-11-12T05:47:47.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.328+0000 7f79075f6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f78e8003d60 0x7f7900154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:47.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.328+0000 7f79075f6700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f79000aed80 0x7f7900064bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:47.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.328+0000 7f79075f6700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f79000650b0 0x7f79000b0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:47.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.328+0000 7f79075f6700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7900150360 con 0x7f78e8003d60 2021-11-12T05:47:47.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.328+0000 7f79075f6700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79000af4c0 con 0x7f79000650b0 2021-11-12T05:47:47.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.328+0000 7f79075f6700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79000af760 con 0x7f79000aed80 2021-11-12T05:47:47.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.328+0000 7f7905392700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f78e8003d60 0x7f7900154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:47.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.328+0000 7f7905392700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f78e8003d60 0x7f7900154500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48848/0 (socket says 172.21.2.105:48848) 2021-11-12T05:47:47.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.328+0000 7f7905392700 1 -- 172.21.2.105:0/1473986900 learned_addr learned my addr 172.21.2.105:0/1473986900 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:47.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.328+0000 7f7905392700 1 -- 172.21.2.105:0/1473986900 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f79000aed80 msgr2=0x7f7900064bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:47.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.328+0000 7f7905392700 1 --2- 172.21.2.105:0/1473986900 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f79000aed80 0x7f7900064bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:47.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.328+0000 7f7905392700 1 -- 172.21.2.105:0/1473986900 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f79000650b0 msgr2=0x7f79000b0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:47.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.328+0000 7f7905392700 1 --2- 172.21.2.105:0/1473986900 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f79000650b0 0x7f79000b0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:47.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.328+0000 7f7905392700 1 -- 172.21.2.105:0/1473986900 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79000b0300 con 0x7f78e8003d60 2021-11-12T05:47:47.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.328+0000 7f7905392700 1 --2- 172.21.2.105:0/1473986900 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f78e8003d60 0x7f7900154500 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7f78fc001370 tx=0x7f78fc0017d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:47.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.328+0000 7f78ee7fc700 1 -- 172.21.2.105:0/1473986900 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78fc007170 con 0x7f78e8003d60 2021-11-12T05:47:47.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.328+0000 7f78ee7fc700 1 -- 172.21.2.105:0/1473986900 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78fc0072d0 con 0x7f78e8003d60 2021-11-12T05:47:47.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.328+0000 7f78ee7fc700 1 -- 172.21.2.105:0/1473986900 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78fc004920 con 0x7f78e8003d60 2021-11-12T05:47:47.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.328+0000 7f79075f6700 1 -- 172.21.2.105:0/1473986900 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79000b0f10 con 0x7f78e8003d60 2021-11-12T05:47:47.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.328+0000 7f79075f6700 1 -- 172.21.2.105:0/1473986900 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79000b13c0 con 0x7f78e8003d60 2021-11-12T05:47:47.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.328+0000 7f79075f6700 1 -- 172.21.2.105:0/1473986900 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79000af920 con 0x7f78e8003d60 2021-11-12T05:47:47.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.328+0000 7f78ee7fc700 1 -- 172.21.2.105:0/1473986900 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f78fc01b060 con 0x7f78e8003d60 2021-11-12T05:47:47.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.328+0000 7f78ee7fc700 1 --2- 172.21.2.105:0/1473986900 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f78e0053690 0x7f78e0055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:47.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.328+0000 7f78ee7fc700 1 -- 172.21.2.105:0/1473986900 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f78fc06b4d0 con 0x7f78e8003d60 2021-11-12T05:47:47.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.328+0000 7f7904b91700 1 --2- 172.21.2.105:0/1473986900 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f78e0053690 0x7f78e0055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:47.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.328+0000 7f7904b91700 1 --2- 172.21.2.105:0/1473986900 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f78e0053690 0x7f78e0055b50 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f79000b5130 tx=0x7f78f0015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:47.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.332+0000 7f78ee7fc700 1 -- 172.21.2.105:0/1473986900 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f78fc042700 con 0x7f78e8003d60 2021-11-12T05:47:47.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.444+0000 7f79075f6700 1 -- 172.21.2.105:0/1473986900 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f79000b3280 con 0x7f78e8003d60 2021-11-12T05:47:47.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.444+0000 7f78ee7fc700 1 -- 172.21.2.105:0/1473986900 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v30) v1 ==== 80+0+4242 (secure 0 0 0) 0x7f78fc019070 con 0x7f78e8003d60 2021-11-12T05:47:47.449 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:47.449 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:47:47.449 INFO:teuthology.orchestra.run.gibba005.stdout: "auth_dump": [ 2021-11-12T05:47:47.450 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:47.450 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mds.a", 2021-11-12T05:47:47.450 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1hGVLeOhAAX2029T+USC1Um93TSzjxdA==", 2021-11-12T05:47:47.450 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:47:47.451 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:47:47.451 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:47:47.451 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:47:47.451 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:47:47.451 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:47.452 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:47.452 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:47.452 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mds.b", 2021-11-12T05:47:47.452 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hiebUAxAAGcjDAGyvecjzagGoRBX8tg==", 2021-11-12T05:47:47.453 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:47:47.453 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:47:47.453 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:47:47.453 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:47:47.454 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:47:47.454 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:47.454 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:47.454 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:47.455 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.0", 2021-11-12T05:47:47.455 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1ht05fORAAN2YrbsxBau1FQC4C8Dvb3g==", 2021-11-12T05:47:47.455 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:47:47.455 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:47:47.455 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:47:47.456 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:47:47.456 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:47.456 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:47.456 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:47.457 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.1", 2021-11-12T05:47:47.457 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAu/o1hzp1vGhAAQ6u3Npb+yNGlNOUdoHzFZA==", 2021-11-12T05:47:47.457 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:47:47.457 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:47:47.458 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:47:47.458 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:47:47.458 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:47.458 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:47.458 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:47.459 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.2", 2021-11-12T05:47:47.459 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAw/o1hHWwOOhAAx7txWG8rbch18+SBnJkfkQ==", 2021-11-12T05:47:47.459 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:47:47.460 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:47:47.460 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:47:47.460 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:47:47.460 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:47.461 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:47.461 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:47.461 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.3", 2021-11-12T05:47:47.461 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAz/o1howZpHxAAKgUVxU2tSNZbxW+6OfJF9g==", 2021-11-12T05:47:47.461 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:47:47.462 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:47:47.462 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:47:47.462 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:47:47.462 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:47.463 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:47.463 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:47.463 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.4", 2021-11-12T05:47:47.463 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA2/o1humA5KRAAVbO6UYLOBQDq3WiEkkS6xw==", 2021-11-12T05:47:47.463 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:47:47.464 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:47:47.464 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:47:47.464 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:47:47.464 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:47.465 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:47.465 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:47.465 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.5", 2021-11-12T05:47:47.465 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA5/o1hALdKDRAAR9nsaDOo9GUgpmBPHVp5HQ==", 2021-11-12T05:47:47.466 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:47:47.466 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:47:47.466 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:47:47.466 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:47:47.466 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:47.467 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:47.467 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:47.467 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.6", 2021-11-12T05:47:47.467 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA7/o1hCVP2KhAAHj5SxnJ81mKrJOg2CE2wLQ==", 2021-11-12T05:47:47.467 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:47:47.468 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:47:47.468 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:47:47.468 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:47:47.468 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:47.469 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:47.469 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:47.469 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.7", 2021-11-12T05:47:47.469 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA+/o1hWCEqEBAAv8nF9NeF2Ue5W8Ijj8Skgg==", 2021-11-12T05:47:47.470 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:47:47.470 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:47:47.470 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:47:47.470 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:47:47.471 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:47.471 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:47.471 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:47.471 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.0", 2021-11-12T05:47:47.472 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hzEzhCBAATF8giEBtrj13SAr5EJV4TA==", 2021-11-12T05:47:47.472 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:47:47.472 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:47:47.472 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow r", 2021-11-12T05:47:47.473 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-12T05:47:47.473 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:47.473 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:47.473 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:47.473 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.1", 2021-11-12T05:47:47.474 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hO6zfCxAAae1obagtpsnA9e8FlTExVA==", 2021-11-12T05:47:47.474 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:47:47.474 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:47:47.474 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow r", 2021-11-12T05:47:47.475 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-12T05:47:47.475 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:47.475 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:47.475 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:47.476 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.2", 2021-11-12T05:47:47.476 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hFYDGDhAAyz77VXKtOz86ztJ8FUIvAg==", 2021-11-12T05:47:47.476 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:47:47.476 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:47:47.476 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow r", 2021-11-12T05:47:47.477 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-12T05:47:47.477 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:47.477 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:47.477 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:47.478 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.admin", 2021-11-12T05:47:47.478 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1hwdoBHRAAUHHEU3dbyso2BnE/JppV8A==", 2021-11-12T05:47:47.478 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:47:47.478 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow *", 2021-11-12T05:47:47.479 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:47:47.479 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:47:47.479 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:47:47.479 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:47.480 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:47.480 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:47.480 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mgr.x", 2021-11-12T05:47:47.480 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1h6JBaORAAbgxQtCzGNj7MLfgwGd4cWA==", 2021-11-12T05:47:47.481 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:47:47.481 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow *", 2021-11-12T05:47:47.481 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow profile mgr", 2021-11-12T05:47:47.481 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:47:47.481 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:47.482 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:47.482 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:47.482 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mgr.y", 2021-11-12T05:47:47.482 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1hwfvvNRAASU7NmYBG/Yb6/ma1/Ew7mw==", 2021-11-12T05:47:47.483 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:47:47.483 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow *", 2021-11-12T05:47:47.483 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow profile mgr", 2021-11-12T05:47:47.483 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:47:47.483 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:47.484 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:47.484 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:47.484 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:47:47.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.444+0000 7f79075f6700 1 -- 172.21.2.105:0/1473986900 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f78e0053690 msgr2=0x7f78e0055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:47.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.444+0000 7f79075f6700 1 --2- 172.21.2.105:0/1473986900 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f78e0053690 0x7f78e0055b50 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f79000b5130 tx=0x7f78f0015000).stop 2021-11-12T05:47:47.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.444+0000 7f79075f6700 1 -- 172.21.2.105:0/1473986900 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f78e8003d60 msgr2=0x7f7900154500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:47.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.444+0000 7f79075f6700 1 --2- 172.21.2.105:0/1473986900 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f78e8003d60 0x7f7900154500 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7f78fc001370 tx=0x7f78fc0017d0).stop 2021-11-12T05:47:47.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.444+0000 7f79075f6700 1 -- 172.21.2.105:0/1473986900 shutdown_connections 2021-11-12T05:47:47.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.444+0000 7f79075f6700 1 --2- 172.21.2.105:0/1473986900 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f78e0053690 0x7f78e0055b50 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:47.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.444+0000 7f79075f6700 1 --2- 172.21.2.105:0/1473986900 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f79000650b0 0x7f79000b0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:47.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.444+0000 7f79075f6700 1 --2- 172.21.2.105:0/1473986900 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f79000aed80 0x7f7900064bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:47.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.444+0000 7f79075f6700 1 --2- 172.21.2.105:0/1473986900 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f78e8003d60 0x7f7900154500 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:47.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.444+0000 7f79075f6700 1 -- 172.21.2.105:0/1473986900 >> 172.21.2.105:0/1473986900 conn(0x7f7900060ba0 msgr2=0x7f79000b6680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:47.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.444+0000 7f79075f6700 1 -- 172.21.2.105:0/1473986900 shutdown_connections 2021-11-12T05:47:47.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.444+0000 7f79075f6700 1 -- 172.21.2.105:0/1473986900 wait complete. 2021-11-12T05:47:47.489 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:47:47.547 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.544+0000 7f509d1b3700 1 Processor -- start 2021-11-12T05:47:47.548 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.544+0000 7f509d1b3700 1 -- start start 2021-11-12T05:47:47.552 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.544+0000 7f509d1b3700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f50980b6380 0x7f50980b6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:47.553 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.544+0000 7f509d1b3700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5098143240 0x7f509805c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:47.553 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.544+0000 7f509d1b3700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f509813f640 con 0x7f50980ad850 2021-11-12T05:47:47.553 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.544+0000 7f509d1b3700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f509813f8e0 con 0x7f50980b6380 2021-11-12T05:47:47.553 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.544+0000 7f509d1b3700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50981436d0 con 0x7f5098143240 2021-11-12T05:47:47.554 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.544+0000 7f5096d9d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f50980b6380 0x7f50980b6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:47.554 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.544+0000 7f509659c700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f50980ad850 0x7f509813fd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:59252/0 (socket says 172.21.2.105:59252) 2021-11-12T05:47:47.554 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.544+0000 7f509659c700 1 -- 172.21.2.105:0/3387300649 learned_addr learned my addr 172.21.2.105:0/3387300649 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:47.554 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.544+0000 7f5096d9d700 1 -- 172.21.2.105:0/3387300649 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5098143240 msgr2=0x7f509805c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:47.555 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.544+0000 7f5096d9d700 1 --2- 172.21.2.105:0/3387300649 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5098143240 0x7f509805c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:47.555 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.544+0000 7f5096d9d700 1 -- 172.21.2.105:0/3387300649 >> v1:172.21.2.105:6789/0 conn(0x7f50980ad850 legacy=0x7f509813fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:47.555 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.544+0000 7f5096d9d700 1 -- 172.21.2.105:0/3387300649 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509813f2e0 con 0x7f50980b6380 2021-11-12T05:47:47.555 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.544+0000 7f5096d9d700 1 --2- 172.21.2.105:0/3387300649 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f50980b6380 0x7f50980b6760 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7f5080002f70 tx=0x7f5080006df0).ready entity=mon.0 client_cookie=97ea2414ba279471 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:47.556 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.544+0000 7f5095d9b700 1 -- 172.21.2.105:0/3387300649 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f508000d570 con 0x7f50980b6380 2021-11-12T05:47:47.556 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.544+0000 7f5095d9b700 1 -- 172.21.2.105:0/3387300649 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5080000e90 con 0x7f50980b6380 2021-11-12T05:47:47.556 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.544+0000 7f5095d9b700 1 -- 172.21.2.105:0/3387300649 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f508000d8c0 con 0x7f50980b6380 2021-11-12T05:47:47.556 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.544+0000 7f509d1b3700 1 -- 172.21.2.105:0/3387300649 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f50980b6380 msgr2=0x7f50980b6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:47.556 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.544+0000 7f509d1b3700 1 --2- 172.21.2.105:0/3387300649 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f50980b6380 0x7f50980b6760 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7f5080002f70 tx=0x7f5080006df0).stop 2021-11-12T05:47:47.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.544+0000 7f509d1b3700 1 -- 172.21.2.105:0/3387300649 shutdown_connections 2021-11-12T05:47:47.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.544+0000 7f509d1b3700 1 --2- 172.21.2.105:0/3387300649 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5098143240 0x7f509805c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:47.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.544+0000 7f509d1b3700 1 --2- 172.21.2.105:0/3387300649 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f50980b6380 0x7f50980b6760 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:47.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.544+0000 7f509d1b3700 1 -- 172.21.2.105:0/3387300649 >> 172.21.2.105:0/3387300649 conn(0x7f50980637d0 msgr2=0x7f50980b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:47.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.544+0000 7f509d1b3700 1 -- 172.21.2.105:0/3387300649 shutdown_connections 2021-11-12T05:47:47.558 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.544+0000 7f509d1b3700 1 -- 172.21.2.105:0/3387300649 wait complete. 2021-11-12T05:47:47.558 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.544+0000 7f509d1b3700 1 Processor -- start 2021-11-12T05:47:47.558 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.544+0000 7f509d1b3700 1 -- start start 2021-11-12T05:47:47.558 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.544+0000 7f509d1b3700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f50980ad850 0x7f50980b29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:47.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.544+0000 7f509d1b3700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f50980b6380 0x7f509813a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:47.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.544+0000 7f509d1b3700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5098143240 0x7f509813d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:47.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.544+0000 7f509d1b3700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5098142670 con 0x7f5098143240 2021-11-12T05:47:47.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.544+0000 7f509d1b3700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50981419d0 con 0x7f50980ad850 2021-11-12T05:47:47.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.544+0000 7f509d1b3700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5098141c70 con 0x7f50980b6380 2021-11-12T05:47:47.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.544+0000 7f509759e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5098143240 0x7f509813d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:47.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.544+0000 7f509759e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5098143240 0x7f509813d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48866/0 (socket says 172.21.2.105:48866) 2021-11-12T05:47:47.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.544+0000 7f509759e700 1 -- 172.21.2.105:0/2021202045 learned_addr learned my addr 172.21.2.105:0/2021202045 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:47.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.548+0000 7f509759e700 1 -- 172.21.2.105:0/2021202045 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f50980b6380 msgr2=0x7f509813a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:47.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.548+0000 7f509759e700 1 --2- 172.21.2.105:0/2021202045 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f50980b6380 0x7f509813a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:47.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.548+0000 7f509759e700 1 -- 172.21.2.105:0/2021202045 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f50980ad850 msgr2=0x7f50980b29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:47.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.548+0000 7f509759e700 1 --2- 172.21.2.105:0/2021202045 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f50980ad850 0x7f50980b29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:47.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.548+0000 7f509759e700 1 -- 172.21.2.105:0/2021202045 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508000b180 con 0x7f5098143240 2021-11-12T05:47:47.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.548+0000 7f509759e700 1 --2- 172.21.2.105:0/2021202045 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5098143240 0x7f509813d950 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7f50900032f0 tx=0x7f50900091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:47.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.548+0000 7f508ffff700 1 -- 172.21.2.105:0/2021202045 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f509000d4a0 con 0x7f5098143240 2021-11-12T05:47:47.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.548+0000 7f508ffff700 1 -- 172.21.2.105:0/2021202045 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509000d600 con 0x7f5098143240 2021-11-12T05:47:47.563 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.548+0000 7f508ffff700 1 -- 172.21.2.105:0/2021202045 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f509000d960 con 0x7f5098143240 2021-11-12T05:47:47.563 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.548+0000 7f509d1b3700 1 -- 172.21.2.105:0/2021202045 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50980b2ec0 con 0x7f5098143240 2021-11-12T05:47:47.563 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.548+0000 7f509d1b3700 1 -- 172.21.2.105:0/2021202045 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f509812b690 con 0x7f5098143240 2021-11-12T05:47:47.563 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.548+0000 7f509d1b3700 1 -- 172.21.2.105:0/2021202045 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50980b1010 con 0x7f5098143240 2021-11-12T05:47:47.564 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.548+0000 7f508ffff700 1 -- 172.21.2.105:0/2021202045 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5090018030 con 0x7f5098143240 2021-11-12T05:47:47.564 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.548+0000 7f508ffff700 1 --2- 172.21.2.105:0/2021202045 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f507c0536a0 0x7f507c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:47.564 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.548+0000 7f508ffff700 1 -- 172.21.2.105:0/2021202045 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f509006b070 con 0x7f5098143240 2021-11-12T05:47:47.564 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.548+0000 7f5096d9d700 1 --2- 172.21.2.105:0/2021202045 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f507c0536a0 0x7f507c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:47.565 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.548+0000 7f5096d9d700 1 --2- 172.21.2.105:0/2021202045 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f507c0536a0 0x7f507c055b60 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f5080002f70 tx=0x7f5080015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:47.565 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.552+0000 7f508ffff700 1 -- 172.21.2.105:0/2021202045 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5090042460 con 0x7f5098143240 2021-11-12T05:47:47.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.632+0000 7f509d1b3700 1 -- 172.21.2.105:0/2021202045 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5098141e30 con 0x7f5098143240 2021-11-12T05:47:47.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.636+0000 7f508ffff700 1 -- 172.21.2.105:0/2021202045 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+13415 (secure 0 0 0) 0x7f5090023480 con 0x7f5098143240 2021-11-12T05:47:47.640 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:47.640 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":91,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:47:47.212987+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:47:47.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.636+0000 7f509d1b3700 1 -- 172.21.2.105:0/2021202045 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f507c0536a0 msgr2=0x7f507c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:47.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.636+0000 7f509d1b3700 1 --2- 172.21.2.105:0/2021202045 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f507c0536a0 0x7f507c055b60 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f5080002f70 tx=0x7f5080015000).stop 2021-11-12T05:47:47.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.636+0000 7f509d1b3700 1 -- 172.21.2.105:0/2021202045 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5098143240 msgr2=0x7f509813d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:47.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.636+0000 7f509d1b3700 1 --2- 172.21.2.105:0/2021202045 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5098143240 0x7f509813d950 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7f50900032f0 tx=0x7f50900091a0).stop 2021-11-12T05:47:47.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.636+0000 7f509d1b3700 1 -- 172.21.2.105:0/2021202045 shutdown_connections 2021-11-12T05:47:47.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.636+0000 7f509d1b3700 1 --2- 172.21.2.105:0/2021202045 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f507c0536a0 0x7f507c055b60 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:47.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.636+0000 7f509d1b3700 1 --2- 172.21.2.105:0/2021202045 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5098143240 0x7f509813d950 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:47.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.636+0000 7f509d1b3700 1 --2- 172.21.2.105:0/2021202045 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f50980b6380 0x7f509813a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:47.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.636+0000 7f509d1b3700 1 --2- 172.21.2.105:0/2021202045 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f50980ad850 0x7f50980b29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:47.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.636+0000 7f509d1b3700 1 -- 172.21.2.105:0/2021202045 >> 172.21.2.105:0/2021202045 conn(0x7f50980637d0 msgr2=0x7f50980b4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:47.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.636+0000 7f509d1b3700 1 -- 172.21.2.105:0/2021202045 shutdown_connections 2021-11-12T05:47:47.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.636+0000 7f509d1b3700 1 -- 172.21.2.105:0/2021202045 wait complete. 2021-11-12T05:47:47.647 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-12T05:47:47.648 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:47:47.701 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.696+0000 7f28b6abc700 1 Processor -- start 2021-11-12T05:47:47.701 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.696+0000 7f28b6abc700 1 -- start start 2021-11-12T05:47:47.705 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.696+0000 7f28b6abc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f28b00aec50 0x7f28b0145120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:47.706 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.696+0000 7f28b6abc700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f28b00b12a0 0x7f28b00669c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:47.706 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.696+0000 7f28b6abc700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28b00b1770 con 0x7f28b0060d80 2021-11-12T05:47:47.707 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.696+0000 7f28b6abc700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28b0142320 con 0x7f28b00aec50 2021-11-12T05:47:47.707 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.696+0000 7f28b6abc700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28b0062a70 con 0x7f28b00b12a0 2021-11-12T05:47:47.707 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.696+0000 7f28b4858700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f28b00aec50 0x7f28b0145120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:47.708 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.696+0000 7f28b4858700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f28b00aec50 0x7f28b0145120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48870/0 (socket says 172.21.2.105:48870) 2021-11-12T05:47:47.708 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.696+0000 7f28b4858700 1 -- 172.21.2.105:0/2372313063 learned_addr learned my addr 172.21.2.105:0/2372313063 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:47.708 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.696+0000 7f28b4858700 1 -- 172.21.2.105:0/2372313063 >> v2:172.21.2.115:3300/0 conn(0x7f28b00b12a0 msgr2=0x7f28b00669c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:47:47.708 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.696+0000 7f28b4858700 1 --2- 172.21.2.105:0/2372313063 >> v2:172.21.2.115:3300/0 conn(0x7f28b00b12a0 0x7f28b00669c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:47.708 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.696+0000 7f28b4858700 1 -- 172.21.2.105:0/2372313063 >> v1:172.21.2.115:6789/0 conn(0x7f28b0060d80 legacy=0x7f28b0142530 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:47:47.709 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.696+0000 7f28b4858700 1 -- 172.21.2.105:0/2372313063 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b00b0380 con 0x7f28b00aec50 2021-11-12T05:47:47.709 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.696+0000 7f28b4858700 1 --2- 172.21.2.105:0/2372313063 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f28b00aec50 0x7f28b0145120 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 rx=0x7f28b00af390 tx=0x7f28a0006eb0).ready entity=mon.0 client_cookie=56fa2c9ba92618e9 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:47.709 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.696+0000 7f28af7fe700 1 -- 172.21.2.105:0/2372313063 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28a000d5c0 con 0x7f28b00aec50 2021-11-12T05:47:47.709 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.696+0000 7f28af7fe700 1 -- 172.21.2.105:0/2372313063 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a0000e90 con 0x7f28b00aec50 2021-11-12T05:47:47.710 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.696+0000 7f28af7fe700 1 -- 172.21.2.105:0/2372313063 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28a000d910 con 0x7f28b00aec50 2021-11-12T05:47:47.710 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.696+0000 7f28b6abc700 1 -- 172.21.2.105:0/2372313063 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f28b00aec50 msgr2=0x7f28b0145120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:47.710 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.696+0000 7f28b6abc700 1 --2- 172.21.2.105:0/2372313063 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f28b00aec50 0x7f28b0145120 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 rx=0x7f28b00af390 tx=0x7f28a0006eb0).stop 2021-11-12T05:47:47.710 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.700+0000 7f28b6abc700 1 -- 172.21.2.105:0/2372313063 shutdown_connections 2021-11-12T05:47:47.711 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.700+0000 7f28b6abc700 1 --2- 172.21.2.105:0/2372313063 >> v2:172.21.2.115:3300/0 conn(0x7f28b00b12a0 0x7f28b00669c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:47.711 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.700+0000 7f28b6abc700 1 --2- 172.21.2.105:0/2372313063 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f28b00aec50 0x7f28b0145120 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:47.711 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.700+0000 7f28b6abc700 1 -- 172.21.2.105:0/2372313063 >> 172.21.2.105:0/2372313063 conn(0x7f28b005c490 msgr2=0x7f28b00b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:47.711 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.700+0000 7f28b6abc700 1 -- 172.21.2.105:0/2372313063 shutdown_connections 2021-11-12T05:47:47.711 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.700+0000 7f28b6abc700 1 -- 172.21.2.105:0/2372313063 wait complete. 2021-11-12T05:47:47.712 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.700+0000 7f28b6abc700 1 Processor -- start 2021-11-12T05:47:47.712 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.700+0000 7f28b6abc700 1 -- start start 2021-11-12T05:47:47.712 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.700+0000 7f28b6abc700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f28b0060d80 0x7f28b00656c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:47.712 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.700+0000 7f28b6abc700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f28b00aec50 0x7f28b0136710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:47.712 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.700+0000 7f28b6abc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f28b00b12a0 0x7f28b0136c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:47.713 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.700+0000 7f28b6abc700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b0065ff0 con 0x7f28b00b12a0 2021-11-12T05:47:47.713 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.700+0000 7f28b6abc700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b0063f50 con 0x7f28b00aec50 2021-11-12T05:47:47.713 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.700+0000 7f28b6abc700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b00641f0 con 0x7f28b0060d80 2021-11-12T05:47:47.713 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.700+0000 7f28b5059700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f28b00b12a0 0x7f28b0136c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:47.714 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.700+0000 7f28b5059700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f28b00b12a0 0x7f28b0136c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48876/0 (socket says 172.21.2.105:48876) 2021-11-12T05:47:47.714 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.700+0000 7f28b5059700 1 -- 172.21.2.105:0/1582967427 learned_addr learned my addr 172.21.2.105:0/1582967427 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:47.714 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.700+0000 7f28b5059700 1 -- 172.21.2.105:0/1582967427 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f28b0060d80 msgr2=0x7f28b00656c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:47.714 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.700+0000 7f28b5059700 1 --2- 172.21.2.105:0/1582967427 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f28b0060d80 0x7f28b00656c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:47.715 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.700+0000 7f28b5059700 1 -- 172.21.2.105:0/1582967427 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f28b00aec50 msgr2=0x7f28b0136710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:47.715 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.700+0000 7f28b5059700 1 --2- 172.21.2.105:0/1582967427 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f28b00aec50 0x7f28b0136710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:47.715 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.700+0000 7f28b5059700 1 -- 172.21.2.105:0/1582967427 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a000b1e0 con 0x7f28b00b12a0 2021-11-12T05:47:47.715 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.700+0000 7f28b5059700 1 --2- 172.21.2.105:0/1582967427 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f28b00b12a0 0x7f28b0136c00 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7f28a8001250 tx=0x7f28a80090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:47.715 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.700+0000 7f28adffb700 1 -- 172.21.2.105:0/1582967427 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28a80014e0 con 0x7f28b00b12a0 2021-11-12T05:47:47.716 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.700+0000 7f28adffb700 1 -- 172.21.2.105:0/1582967427 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a8001640 con 0x7f28b00b12a0 2021-11-12T05:47:47.716 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.700+0000 7f28adffb700 1 -- 172.21.2.105:0/1582967427 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28a80019a0 con 0x7f28b00b12a0 2021-11-12T05:47:47.716 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.700+0000 7f28b6abc700 1 -- 172.21.2.105:0/1582967427 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28b0063ab0 con 0x7f28b00b12a0 2021-11-12T05:47:47.716 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.700+0000 7f28b6abc700 1 -- 172.21.2.105:0/1582967427 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28b0065d50 con 0x7f28b00b12a0 2021-11-12T05:47:47.717 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.700+0000 7f28b6abc700 1 -- 172.21.2.105:0/1582967427 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28b00643b0 con 0x7f28b00b12a0 2021-11-12T05:47:47.718 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.700+0000 7f28adffb700 1 -- 172.21.2.105:0/1582967427 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f28a8018030 con 0x7f28b00b12a0 2021-11-12T05:47:47.718 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.700+0000 7f28adffb700 1 --2- 172.21.2.105:0/1582967427 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2894053610 0x7f2894055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:47.718 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.700+0000 7f28adffb700 1 -- 172.21.2.105:0/1582967427 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f28a806b140 con 0x7f28b00b12a0 2021-11-12T05:47:47.719 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.700+0000 7f28b4858700 1 --2- 172.21.2.105:0/1582967427 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2894053610 0x7f2894055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:47.719 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.704+0000 7f28b4858700 1 --2- 172.21.2.105:0/1582967427 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2894053610 0x7f2894055ad0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f28b00af390 tx=0x7f28a0015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:47.722 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.704+0000 7f28adffb700 1 -- 172.21.2.105:0/1582967427 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f28a8042420 con 0x7f28b00b12a0 2021-11-12T05:47:47.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.788+0000 7f28b6abc700 1 -- 172.21.2.105:0/1582967427 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f28b0057350 con 0x7f28b00b12a0 2021-11-12T05:47:47.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.788+0000 7f28adffb700 1 -- 172.21.2.105:0/1582967427 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v91) v1 ==== 110+0+10 (secure 0 0 0) 0x7f28a8045a40 con 0x7f28b00b12a0 2021-11-12T05:47:47.792 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:47:47.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.788+0000 7f28b6abc700 1 -- 172.21.2.105:0/1582967427 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2894053610 msgr2=0x7f2894055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:47.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.788+0000 7f28b6abc700 1 --2- 172.21.2.105:0/1582967427 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2894053610 0x7f2894055ad0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f28b00af390 tx=0x7f28a0015000).stop 2021-11-12T05:47:47.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.788+0000 7f28b6abc700 1 -- 172.21.2.105:0/1582967427 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f28b00b12a0 msgr2=0x7f28b0136c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:47.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.788+0000 7f28b6abc700 1 --2- 172.21.2.105:0/1582967427 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f28b00b12a0 0x7f28b0136c00 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7f28a8001250 tx=0x7f28a80090f0).stop 2021-11-12T05:47:47.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.788+0000 7f28b6abc700 1 -- 172.21.2.105:0/1582967427 shutdown_connections 2021-11-12T05:47:47.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.788+0000 7f28b6abc700 1 --2- 172.21.2.105:0/1582967427 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2894053610 0x7f2894055ad0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:47.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.788+0000 7f28b6abc700 1 --2- 172.21.2.105:0/1582967427 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f28b00b12a0 0x7f28b0136c00 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:47.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.788+0000 7f28b6abc700 1 --2- 172.21.2.105:0/1582967427 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f28b00aec50 0x7f28b0136710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:47.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.788+0000 7f28b6abc700 1 --2- 172.21.2.105:0/1582967427 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f28b0060d80 0x7f28b00656c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:47.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.788+0000 7f28b6abc700 1 -- 172.21.2.105:0/1582967427 >> 172.21.2.105:0/1582967427 conn(0x7f28b005c490 msgr2=0x7f28b00b4850 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:47.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.788+0000 7f28b6abc700 1 -- 172.21.2.105:0/1582967427 shutdown_connections 2021-11-12T05:47:47.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.788+0000 7f28b6abc700 1 -- 172.21.2.105:0/1582967427 wait complete. 2021-11-12T05:47:47.799 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:47:47.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.848+0000 7f851c285700 1 Processor -- start 2021-11-12T05:47:47.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.848+0000 7f851c285700 1 -- start start 2021-11-12T05:47:47.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.848+0000 7f851c285700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f8514140d80 0x7f85140b4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:47.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.848+0000 7f851c285700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85140b7ee0 con 0x7f85140b7b00 2021-11-12T05:47:47.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.848+0000 7f851c285700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85140b2030 con 0x7f85140ae090 2021-11-12T05:47:47.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.848+0000 7f851c285700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85140b22d0 con 0x7f8514140d80 2021-11-12T05:47:47.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.848+0000 7f851a021700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f85140b7b00 0x7f85140b2a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:59278/0 (socket says 172.21.2.105:59278) 2021-11-12T05:47:47.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.848+0000 7f851a021700 1 -- 172.21.2.105:0/3531681722 learned_addr learned my addr 172.21.2.105:0/3531681722 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:47.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.848+0000 7f851901f700 1 -- 172.21.2.105:0/3531681722 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3420738829 0 0) 0x7f85140b7ee0 con 0x7f85140b7b00 2021-11-12T05:47:47.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.848+0000 7f851901f700 1 -- 172.21.2.105:0/3531681722 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84fc003260 con 0x7f85140b7b00 2021-11-12T05:47:47.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.848+0000 7f851a822700 1 --2- 172.21.2.105:0/3531681722 >> v2:172.21.2.115:3300/0 conn(0x7f8514140d80 0x7f85140b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:47.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.848+0000 7f851901f700 1 -- 172.21.2.105:0/3531681722 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 678832288 0 0) 0x7f84fc003260 con 0x7f85140b7b00 2021-11-12T05:47:47.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.848+0000 7f851901f700 1 -- 172.21.2.105:0/3531681722 >> v2:172.21.2.115:3300/0 conn(0x7f8514140d80 msgr2=0x7f85140b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:47.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.848+0000 7f851901f700 1 --2- 172.21.2.105:0/3531681722 >> v2:172.21.2.115:3300/0 conn(0x7f8514140d80 0x7f85140b4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:47.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.848+0000 7f851901f700 1 -- 172.21.2.105:0/3531681722 >> v1:172.21.2.115:6789/0 conn(0x7f85140ae090 legacy=0x7f85140b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:47.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.848+0000 7f851901f700 1 -- 172.21.2.105:0/3531681722 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85140b2570 con 0x7f85140b7b00 2021-11-12T05:47:47.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.848+0000 7f851901f700 1 -- 172.21.2.105:0/3531681722 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f8508001660 con 0x7f85140b7b00 2021-11-12T05:47:47.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.848+0000 7f851901f700 1 -- 172.21.2.105:0/3531681722 >> v1:172.21.2.105:6789/0 conn(0x7f85140b7b00 legacy=0x7f85140b2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:47.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.848+0000 7f851901f700 1 --2- 172.21.2.105:0/3531681722 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f84fc0037d0 0x7f84fc003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:47.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.848+0000 7f851901f700 1 --2- 172.21.2.105:0/3531681722 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f84fc004500 0x7f84fc004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:47.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.848+0000 7f851901f700 1 --2- 172.21.2.105:0/3531681722 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f84fc004e70 0x7f84fc014350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:47.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.848+0000 7f851901f700 1 -- 172.21.2.105:0/3531681722 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85140b22d0 con 0x7f84fc004e70 2021-11-12T05:47:47.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.848+0000 7f851901f700 1 -- 172.21.2.105:0/3531681722 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc014840 con 0x7f84fc004500 2021-11-12T05:47:47.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.848+0000 7f851901f700 1 -- 172.21.2.105:0/3531681722 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc014980 con 0x7f84fc0037d0 2021-11-12T05:47:47.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.848+0000 7f851a822700 1 --2- 172.21.2.105:0/3531681722 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f84fc004e70 0x7f84fc014350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:47.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.848+0000 7f851a021700 1 --2- 172.21.2.105:0/3531681722 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f84fc0037d0 0x7f84fc003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:47.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.848+0000 7f8519820700 1 --2- 172.21.2.105:0/3531681722 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f84fc004500 0x7f84fc004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:47.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.848+0000 7f851a822700 1 -- 172.21.2.105:0/3531681722 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f84fc0037d0 msgr2=0x7f84fc003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:47.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.848+0000 7f851a822700 1 --2- 172.21.2.105:0/3531681722 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f84fc0037d0 0x7f84fc003bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:47.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.848+0000 7f851a822700 1 -- 172.21.2.105:0/3531681722 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f84fc004500 msgr2=0x7f84fc004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:47.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.848+0000 7f851a822700 1 --2- 172.21.2.105:0/3531681722 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f84fc004500 0x7f84fc004980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:47.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.848+0000 7f851a822700 1 -- 172.21.2.105:0/3531681722 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85140b2570 con 0x7f84fc004e70 2021-11-12T05:47:47.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.848+0000 7f851a021700 1 --2- 172.21.2.105:0/3531681722 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f84fc0037d0 0x7f84fc003bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:47:47.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.848+0000 7f851a822700 1 -- 172.21.2.105:0/3531681722 reap_dead start 2021-11-12T05:47:47.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.848+0000 7f851a822700 1 --2- 172.21.2.105:0/3531681722 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f84fc004e70 0x7f84fc014350 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 rx=0x7f850c007000 tx=0x7f850c008040).ready entity=mon.0 client_cookie=35611adf1ed29b83 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:47.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.848+0000 7f851901f700 1 -- 172.21.2.105:0/3531681722 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f850c015070 con 0x7f84fc004e70 2021-11-12T05:47:47.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.848+0000 7f851901f700 1 -- 172.21.2.105:0/3531681722 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850c00c640 con 0x7f84fc004e70 2021-11-12T05:47:47.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.848+0000 7f851901f700 1 -- 172.21.2.105:0/3531681722 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f850c00a4a0 con 0x7f84fc004e70 2021-11-12T05:47:47.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.852+0000 7f851c285700 1 -- 172.21.2.105:0/3531681722 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f84fc004e70 msgr2=0x7f84fc014350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:47.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.852+0000 7f851c285700 1 --2- 172.21.2.105:0/3531681722 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f84fc004e70 0x7f84fc014350 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 rx=0x7f850c007000 tx=0x7f850c008040).stop 2021-11-12T05:47:47.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.852+0000 7f851c285700 1 -- 172.21.2.105:0/3531681722 shutdown_connections 2021-11-12T05:47:47.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.852+0000 7f851c285700 1 --2- 172.21.2.105:0/3531681722 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f84fc004e70 0x7f84fc014350 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:47.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.852+0000 7f851c285700 1 -- 172.21.2.105:0/3531681722 >> 172.21.2.105:0/3531681722 conn(0x7f85140608d0 msgr2=0x7f851405c490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:47.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.852+0000 7f851c285700 1 -- 172.21.2.105:0/3531681722 shutdown_connections 2021-11-12T05:47:47.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.852+0000 7f851c285700 1 -- 172.21.2.105:0/3531681722 wait complete. 2021-11-12T05:47:47.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.852+0000 7f851c285700 1 Processor -- start 2021-11-12T05:47:47.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.852+0000 7f851c285700 1 -- start start 2021-11-12T05:47:47.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.852+0000 7f851c285700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f84fc004e70 0x7f8514151740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:47.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.852+0000 7f851c285700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8514151e10 0x7f8514143590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:47.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.852+0000 7f851c285700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8514143a80 0x7f851413ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:47.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.852+0000 7f851c285700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85141441b0 con 0x7f8514151e10 2021-11-12T05:47:47.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.852+0000 7f851c285700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8514129a10 con 0x7f8514143a80 2021-11-12T05:47:47.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.852+0000 7f851c285700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85140ae910 con 0x7f84fc004e70 2021-11-12T05:47:47.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.852+0000 7f8519820700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8514151e10 0x7f8514143590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:47.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.852+0000 7f8519820700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8514151e10 0x7f8514143590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48894/0 (socket says 172.21.2.105:48894) 2021-11-12T05:47:47.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.852+0000 7f8519820700 1 -- 172.21.2.105:0/853146283 learned_addr learned my addr 172.21.2.105:0/853146283 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:47.873 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.852+0000 7f8519820700 1 -- 172.21.2.105:0/853146283 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f84fc004e70 msgr2=0x7f8514151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:47.873 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.852+0000 7f8519820700 1 --2- 172.21.2.105:0/853146283 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f84fc004e70 0x7f8514151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:47.873 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.852+0000 7f8519820700 1 -- 172.21.2.105:0/853146283 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8514143a80 msgr2=0x7f851413ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:47.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.852+0000 7f8519820700 1 --2- 172.21.2.105:0/853146283 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8514143a80 0x7f851413ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:47.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.852+0000 7f8519820700 1 -- 172.21.2.105:0/853146283 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851414f000 con 0x7f8514151e10 2021-11-12T05:47:47.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.852+0000 7f8519820700 1 --2- 172.21.2.105:0/853146283 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8514151e10 0x7f8514143590 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7f8510008000 tx=0x7f8510009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:47.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.852+0000 7f85077fe700 1 -- 172.21.2.105:0/853146283 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8510007e60 con 0x7f8514151e10 2021-11-12T05:47:47.875 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.852+0000 7f85077fe700 1 -- 172.21.2.105:0/853146283 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8510000e90 con 0x7f8514151e10 2021-11-12T05:47:47.875 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.852+0000 7f851c285700 1 -- 172.21.2.105:0/853146283 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8514142410 con 0x7f8514151e10 2021-11-12T05:47:47.875 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.852+0000 7f85077fe700 1 -- 172.21.2.105:0/853146283 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85100106d0 con 0x7f8514151e10 2021-11-12T05:47:47.875 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.852+0000 7f851c285700 1 -- 172.21.2.105:0/853146283 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8514152270 con 0x7f8514151e10 2021-11-12T05:47:47.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.852+0000 7f851c285700 1 -- 172.21.2.105:0/853146283 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8514057350 con 0x7f8514151e10 2021-11-12T05:47:47.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.852+0000 7f85077fe700 1 -- 172.21.2.105:0/853146283 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8510010830 con 0x7f8514151e10 2021-11-12T05:47:47.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.852+0000 7f85077fe700 1 --2- 172.21.2.105:0/853146283 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f84f4053660 0x7f84f4055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:47.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.852+0000 7f85077fe700 1 -- 172.21.2.105:0/853146283 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f851006b670 con 0x7f8514151e10 2021-11-12T05:47:47.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.852+0000 7f851a021700 1 --2- 172.21.2.105:0/853146283 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f84f4053660 0x7f84f4055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:47.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.856+0000 7f851a021700 1 --2- 172.21.2.105:0/853146283 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f84f4053660 0x7f84f4055b20 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f8508008000 tx=0x7f8508009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:47.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.856+0000 7f85077fe700 1 -- 172.21.2.105:0/853146283 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f85100428a0 con 0x7f8514151e10 2021-11-12T05:47:47.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.940+0000 7f851c285700 1 -- 172.21.2.105:0/853146283 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f85140b33d0 con 0x7f8514151e10 2021-11-12T05:47:47.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.940+0000 7f85077fe700 1 -- 172.21.2.105:0/853146283 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v91) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8510045ec0 con 0x7f8514151e10 2021-11-12T05:47:47.945 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:47:47.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.940+0000 7f851c285700 1 -- 172.21.2.105:0/853146283 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f84f4053660 msgr2=0x7f84f4055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:47.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.940+0000 7f851c285700 1 --2- 172.21.2.105:0/853146283 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f84f4053660 0x7f84f4055b20 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f8508008000 tx=0x7f8508009040).stop 2021-11-12T05:47:47.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.940+0000 7f851c285700 1 -- 172.21.2.105:0/853146283 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8514151e10 msgr2=0x7f8514143590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:47.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.940+0000 7f851c285700 1 --2- 172.21.2.105:0/853146283 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8514151e10 0x7f8514143590 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7f8510008000 tx=0x7f8510009040).stop 2021-11-12T05:47:47.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.940+0000 7f851c285700 1 -- 172.21.2.105:0/853146283 shutdown_connections 2021-11-12T05:47:47.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.940+0000 7f851c285700 1 --2- 172.21.2.105:0/853146283 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f84f4053660 0x7f84f4055b20 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:47.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.940+0000 7f851c285700 1 --2- 172.21.2.105:0/853146283 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8514143a80 0x7f851413ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:47.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.940+0000 7f851c285700 1 --2- 172.21.2.105:0/853146283 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8514151e10 0x7f8514143590 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:47.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.940+0000 7f851c285700 1 --2- 172.21.2.105:0/853146283 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f84fc004e70 0x7f8514151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:47.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.940+0000 7f851c285700 1 -- 172.21.2.105:0/853146283 >> 172.21.2.105:0/853146283 conn(0x7f85140608d0 msgr2=0x7f8514061d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:47.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.940+0000 7f851c285700 1 -- 172.21.2.105:0/853146283 shutdown_connections 2021-11-12T05:47:47.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.940+0000 7f851c285700 1 -- 172.21.2.105:0/853146283 wait complete. 2021-11-12T05:47:47.952 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-12T05:47:48.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.996+0000 7f981da32700 1 Processor -- start 2021-11-12T05:47:48.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:47.996+0000 7f981da32700 1 -- start start 2021-11-12T05:47:48.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f981da32700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f9818066be0 0x7f98180adf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:48.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f981da32700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9818066fc0 con 0x7f98180b13f0 2021-11-12T05:47:48.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f981da32700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98180b0740 con 0x7f98180ac7b0 2021-11-12T05:47:48.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f981da32700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98180b09e0 con 0x7f9818066be0 2021-11-12T05:47:48.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f98167fc700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f98180b13f0 0x7f98180ae440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:59298/0 (socket says 172.21.2.105:59298) 2021-11-12T05:47:48.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f98167fc700 1 -- 172.21.2.105:0/1101277725 learned_addr learned my addr 172.21.2.105:0/1101277725 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:48.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f9815ffb700 1 -- 172.21.2.105:0/1101277725 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3947376078 0 0) 0x7f9818066fc0 con 0x7f98180b13f0 2021-11-12T05:47:48.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f9815ffb700 1 -- 172.21.2.105:0/1101277725 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97f8003260 con 0x7f98180b13f0 2021-11-12T05:47:48.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f9816ffd700 1 --2- 172.21.2.105:0/1101277725 >> v2:172.21.2.115:3300/0 conn(0x7f9818066be0 0x7f98180adf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:48.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f9815ffb700 1 -- 172.21.2.105:0/1101277725 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1790771159 0 0) 0x7f97f8003260 con 0x7f98180b13f0 2021-11-12T05:47:48.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f9815ffb700 1 -- 172.21.2.105:0/1101277725 >> v2:172.21.2.115:3300/0 conn(0x7f9818066be0 msgr2=0x7f98180adf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:48.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f9815ffb700 1 --2- 172.21.2.105:0/1101277725 >> v2:172.21.2.115:3300/0 conn(0x7f9818066be0 0x7f98180adf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:48.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f9815ffb700 1 -- 172.21.2.105:0/1101277725 >> v1:172.21.2.115:6789/0 conn(0x7f98180ac7b0 legacy=0x7f9818142210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:48.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f9815ffb700 1 -- 172.21.2.105:0/1101277725 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98180afdb0 con 0x7f98180b13f0 2021-11-12T05:47:48.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f9815ffb700 1 -- 172.21.2.105:0/1101277725 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f9808001660 con 0x7f98180b13f0 2021-11-12T05:47:48.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f9815ffb700 1 -- 172.21.2.105:0/1101277725 >> v1:172.21.2.105:6789/0 conn(0x7f98180b13f0 legacy=0x7f98180ae440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:48.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f9815ffb700 1 --2- 172.21.2.105:0/1101277725 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f97f8003820 0x7f97f8003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:48.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f9815ffb700 1 --2- 172.21.2.105:0/1101277725 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f97f8004500 0x7f97f8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:48.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f9815ffb700 1 --2- 172.21.2.105:0/1101277725 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f97f8004f70 0x7f97f800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:48.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f9815ffb700 1 -- 172.21.2.105:0/1101277725 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98180b09e0 con 0x7f97f8004500 2021-11-12T05:47:48.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f9815ffb700 1 -- 172.21.2.105:0/1101277725 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f800be50 con 0x7f97f8004f70 2021-11-12T05:47:48.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f9815ffb700 1 -- 172.21.2.105:0/1101277725 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f800c010 con 0x7f97f8003820 2021-11-12T05:47:48.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f98167fc700 1 --2- 172.21.2.105:0/1101277725 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f97f8004500 0x7f97f8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:48.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f98167fc700 1 -- 172.21.2.105:0/1101277725 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f97f8003820 msgr2=0x7f97f8003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:48.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f98167fc700 1 --2- 172.21.2.105:0/1101277725 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f97f8003820 0x7f97f8003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:48.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f98167fc700 1 -- 172.21.2.105:0/1101277725 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f97f8004f70 msgr2=0x7f97f800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:48.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f98167fc700 1 --2- 172.21.2.105:0/1101277725 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f97f8004f70 0x7f97f800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:48.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f98167fc700 1 -- 172.21.2.105:0/1101277725 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f8003260 con 0x7f97f8004500 2021-11-12T05:47:48.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f98177fe700 1 -- 172.21.2.105:0/1101277725 reap_dead start 2021-11-12T05:47:48.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f98167fc700 1 --2- 172.21.2.105:0/1101277725 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f97f8004500 0x7f97f8004980 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7f98180611f0 tx=0x7f98180b1b90).ready entity=mon.0 client_cookie=42ea23b6a7f6017d server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:48.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f9815ffb700 1 -- 172.21.2.105:0/1101277725 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98080070d0 con 0x7f97f8004500 2021-11-12T05:47:48.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f9815ffb700 1 -- 172.21.2.105:0/1101277725 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9808007230 con 0x7f97f8004500 2021-11-12T05:47:48.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f9815ffb700 1 -- 172.21.2.105:0/1101277725 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f980800c8f0 con 0x7f97f8004500 2021-11-12T05:47:48.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f981da32700 1 -- 172.21.2.105:0/1101277725 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f97f8004500 msgr2=0x7f97f8004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:48.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f981da32700 1 --2- 172.21.2.105:0/1101277725 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f97f8004500 0x7f97f8004980 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7f98180611f0 tx=0x7f98180b1b90).stop 2021-11-12T05:47:48.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f981da32700 1 -- 172.21.2.105:0/1101277725 shutdown_connections 2021-11-12T05:47:48.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f981da32700 1 --2- 172.21.2.105:0/1101277725 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f97f8004500 0x7f97f8004980 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:48.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f981da32700 1 -- 172.21.2.105:0/1101277725 >> 172.21.2.105:0/1101277725 conn(0x7f98180b5370 msgr2=0x7f98180b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:48.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f981da32700 1 -- 172.21.2.105:0/1101277725 shutdown_connections 2021-11-12T05:47:48.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f981da32700 1 -- 172.21.2.105:0/1101277725 wait complete. 2021-11-12T05:47:48.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f981da32700 1 Processor -- start 2021-11-12T05:47:48.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f981da32700 1 -- start start 2021-11-12T05:47:48.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f981da32700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f97f8004500 0x7f98181525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:48.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f981da32700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f98180a1550 0x7f9818145ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:48.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f981da32700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98180aaf40 0x7f98180ab3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:48.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f981da32700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98180a0900 con 0x7f98180aaf40 2021-11-12T05:47:48.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f981da32700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9818146850 con 0x7f98180a1550 2021-11-12T05:47:48.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f981da32700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98180a03c0 con 0x7f97f8004500 2021-11-12T05:47:48.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f98177fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98180aaf40 0x7f98180ab3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:48.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f98177fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98180aaf40 0x7f98180ab3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48916/0 (socket says 172.21.2.105:48916) 2021-11-12T05:47:48.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.000+0000 7f98177fe700 1 -- 172.21.2.105:0/1388055457 learned_addr learned my addr 172.21.2.105:0/1388055457 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:48.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.004+0000 7f98177fe700 1 -- 172.21.2.105:0/1388055457 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f97f8004500 msgr2=0x7f98181525f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:48.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.004+0000 7f98177fe700 1 --2- 172.21.2.105:0/1388055457 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f97f8004500 0x7f98181525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:48.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.004+0000 7f98177fe700 1 -- 172.21.2.105:0/1388055457 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f98180a1550 msgr2=0x7f9818145ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:48.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.004+0000 7f98177fe700 1 --2- 172.21.2.105:0/1388055457 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f98180a1550 0x7f9818145ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:48.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.004+0000 7f98177fe700 1 -- 172.21.2.105:0/1388055457 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98180a0660 con 0x7f98180aaf40 2021-11-12T05:47:48.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.004+0000 7f98177fe700 1 --2- 172.21.2.105:0/1388055457 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98180aaf40 0x7f98180ab3c0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7f98180ac6a0 tx=0x7f9810007da0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:48.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.004+0000 7f980ffff700 1 -- 172.21.2.105:0/1388055457 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9810005880 con 0x7f98180aaf40 2021-11-12T05:47:48.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.004+0000 7f980ffff700 1 -- 172.21.2.105:0/1388055457 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98100059e0 con 0x7f98180aaf40 2021-11-12T05:47:48.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.004+0000 7f981da32700 1 -- 172.21.2.105:0/1388055457 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9818145fc0 con 0x7f98180aaf40 2021-11-12T05:47:48.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.004+0000 7f980ffff700 1 -- 172.21.2.105:0/1388055457 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9810005d40 con 0x7f98180aaf40 2021-11-12T05:47:48.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.004+0000 7f981da32700 1 -- 172.21.2.105:0/1388055457 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98180ab8b0 con 0x7f98180aaf40 2021-11-12T05:47:48.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.004+0000 7f981da32700 1 -- 172.21.2.105:0/1388055457 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98180a3d10 con 0x7f98180aaf40 2021-11-12T05:47:48.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.004+0000 7f980ffff700 1 -- 172.21.2.105:0/1388055457 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f981001c070 con 0x7f98180aaf40 2021-11-12T05:47:48.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.004+0000 7f980ffff700 1 --2- 172.21.2.105:0/1388055457 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f97fc0536d0 0x7f97fc055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:48.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.004+0000 7f980ffff700 1 -- 172.21.2.105:0/1388055457 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f981006aae0 con 0x7f98180aaf40 2021-11-12T05:47:48.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.004+0000 7f9816ffd700 1 --2- 172.21.2.105:0/1388055457 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f97fc0536d0 0x7f97fc055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:48.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.004+0000 7f9816ffd700 1 --2- 172.21.2.105:0/1388055457 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f97fc0536d0 0x7f97fc055b90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f980000a000 tx=0x7f9800008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:48.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.008+0000 7f980ffff700 1 -- 172.21.2.105:0/1388055457 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9810041d10 con 0x7f98180aaf40 2021-11-12T05:47:48.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.088+0000 7f981da32700 1 -- 172.21.2.105:0/1388055457 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f98180adf50 con 0x7f98180aaf40 2021-11-12T05:47:48.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.092+0000 7f980ffff700 1 -- 172.21.2.105:0/1388055457 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v91) v1 ==== 84+0+143 (secure 0 0 0) 0x7f9810045330 con 0x7f98180aaf40 2021-11-12T05:47:48.095 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:48.096 INFO:teuthology.orchestra.run.gibba005.stdout:[ 2021-11-12T05:47:48.096 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:48.096 INFO:teuthology.orchestra.run.gibba005.stdout: "poolnum": 1, 2021-11-12T05:47:48.096 INFO:teuthology.orchestra.run.gibba005.stdout: "poolname": "device_health_metrics" 2021-11-12T05:47:48.097 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:48.097 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:48.097 INFO:teuthology.orchestra.run.gibba005.stdout: "poolnum": 2, 2021-11-12T05:47:48.097 INFO:teuthology.orchestra.run.gibba005.stdout: "poolname": "rbd" 2021-11-12T05:47:48.097 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:48.098 INFO:teuthology.orchestra.run.gibba005.stdout:] 2021-11-12T05:47:48.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.092+0000 7f981da32700 1 -- 172.21.2.105:0/1388055457 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f97fc0536d0 msgr2=0x7f97fc055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:48.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.092+0000 7f981da32700 1 --2- 172.21.2.105:0/1388055457 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f97fc0536d0 0x7f97fc055b90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f980000a000 tx=0x7f9800008040).stop 2021-11-12T05:47:48.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.092+0000 7f981da32700 1 -- 172.21.2.105:0/1388055457 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98180aaf40 msgr2=0x7f98180ab3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:48.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.092+0000 7f981da32700 1 --2- 172.21.2.105:0/1388055457 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98180aaf40 0x7f98180ab3c0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7f98180ac6a0 tx=0x7f9810007da0).stop 2021-11-12T05:47:48.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.092+0000 7f981da32700 1 -- 172.21.2.105:0/1388055457 shutdown_connections 2021-11-12T05:47:48.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.092+0000 7f981da32700 1 --2- 172.21.2.105:0/1388055457 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f97fc0536d0 0x7f97fc055b90 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:48.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.092+0000 7f981da32700 1 --2- 172.21.2.105:0/1388055457 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98180aaf40 0x7f98180ab3c0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:48.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.092+0000 7f981da32700 1 --2- 172.21.2.105:0/1388055457 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f98180a1550 0x7f9818145ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:48.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.092+0000 7f981da32700 1 --2- 172.21.2.105:0/1388055457 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f97f8004500 0x7f98181525f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:48.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.092+0000 7f981da32700 1 -- 172.21.2.105:0/1388055457 >> 172.21.2.105:0/1388055457 conn(0x7f98180b5370 msgr2=0x7f98180b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:48.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.092+0000 7f981da32700 1 -- 172.21.2.105:0/1388055457 shutdown_connections 2021-11-12T05:47:48.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.092+0000 7f981da32700 1 -- 172.21.2.105:0/1388055457 wait complete. 2021-11-12T05:47:48.102 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-12T05:47:48.103 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-12T05:47:48.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.152+0000 7f1c0a051700 1 Processor -- start 2021-11-12T05:47:48.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.152+0000 7f1c0a051700 1 -- start start 2021-11-12T05:47:48.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.152+0000 7f1c0a051700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1c04142900 0x7f1c040b6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:48.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.152+0000 7f1c0a051700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f1c0405c490 0x7f1c041390a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:48.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.152+0000 7f1c0a051700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c0413fab0 con 0x7f1c040b6380 2021-11-12T05:47:48.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.152+0000 7f1c0a051700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c040afeb0 con 0x7f1c0405c490 2021-11-12T05:47:48.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.152+0000 7f1c0a051700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0413fd50 con 0x7f1c04142900 2021-11-12T05:47:48.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.152+0000 7f1c037fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f1c040b6380 0x7f1c0413f300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:59318/0 (socket says 172.21.2.105:59318) 2021-11-12T05:47:48.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.152+0000 7f1c037fe700 1 -- 172.21.2.105:0/2721703295 learned_addr learned my addr 172.21.2.105:0/2721703295 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:48.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.152+0000 7f1c03fff700 1 --2- 172.21.2.105:0/2721703295 >> v2:172.21.2.105:3300/0 conn(0x7f1c0405c490 0x7f1c041390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:48.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.152+0000 7f1c027fc700 1 -- 172.21.2.105:0/2721703295 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2611423279 0 0) 0x7f1c0413fab0 con 0x7f1c040b6380 2021-11-12T05:47:48.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.152+0000 7f1c03fff700 1 -- 172.21.2.105:0/2721703295 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1c04142900 msgr2=0x7f1c040b6760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:47:48.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.152+0000 7f1c03fff700 1 --2- 172.21.2.105:0/2721703295 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1c04142900 0x7f1c040b6760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:48.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.152+0000 7f1c03fff700 1 -- 172.21.2.105:0/2721703295 >> v1:172.21.2.105:6789/0 conn(0x7f1c040b6380 legacy=0x7f1c0413f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:48.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.152+0000 7f1c03fff700 1 -- 172.21.2.105:0/2721703295 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0413fff0 con 0x7f1c0405c490 2021-11-12T05:47:48.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.152+0000 7f1c03fff700 1 --2- 172.21.2.105:0/2721703295 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1c0405c490 0x7f1c041390a0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 rx=0x7f1bfc0032f0 tx=0x7f1bfc0091d0).ready entity=mon.0 client_cookie=956bde05e3cda48c server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:48.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.152+0000 7f1c027fc700 1 -- 172.21.2.105:0/2721703295 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bfc009ea0 con 0x7f1c0405c490 2021-11-12T05:47:48.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.152+0000 7f1c027fc700 1 -- 172.21.2.105:0/2721703295 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bfc00b8a0 con 0x7f1c0405c490 2021-11-12T05:47:48.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.152+0000 7f1c027fc700 1 -- 172.21.2.105:0/2721703295 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bfc00ba50 con 0x7f1c0405c490 2021-11-12T05:47:48.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.152+0000 7f1c0a051700 1 -- 172.21.2.105:0/2721703295 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1c0405c490 msgr2=0x7f1c041390a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:48.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.152+0000 7f1c0a051700 1 --2- 172.21.2.105:0/2721703295 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1c0405c490 0x7f1c041390a0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 rx=0x7f1bfc0032f0 tx=0x7f1bfc0091d0).stop 2021-11-12T05:47:48.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.152+0000 7f1c0a051700 1 -- 172.21.2.105:0/2721703295 shutdown_connections 2021-11-12T05:47:48.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.152+0000 7f1c0a051700 1 --2- 172.21.2.105:0/2721703295 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1c0405c490 0x7f1c041390a0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:48.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.152+0000 7f1c0a051700 1 --2- 172.21.2.105:0/2721703295 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1c04142900 0x7f1c040b6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:48.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.152+0000 7f1c0a051700 1 -- 172.21.2.105:0/2721703295 >> 172.21.2.105:0/2721703295 conn(0x7f1c04063810 msgr2=0x7f1c040b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:48.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.152+0000 7f1c0a051700 1 -- 172.21.2.105:0/2721703295 shutdown_connections 2021-11-12T05:47:48.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.152+0000 7f1c0a051700 1 -- 172.21.2.105:0/2721703295 wait complete. 2021-11-12T05:47:48.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.156+0000 7f1c0a051700 1 Processor -- start 2021-11-12T05:47:48.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.156+0000 7f1c0a051700 1 -- start start 2021-11-12T05:47:48.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.156+0000 7f1c0a051700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1c0405c490 0x7f1c04141200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:48.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.156+0000 7f1c0a051700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1c040b6380 0x7f1c0413cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:48.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.156+0000 7f1c0a051700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1c04142900 0x7f1c0413af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:48.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.156+0000 7f1c0a051700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0413a570 con 0x7f1c040b6380 2021-11-12T05:47:48.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.156+0000 7f1c0a051700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c04139a40 con 0x7f1c0405c490 2021-11-12T05:47:48.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.156+0000 7f1c0a051700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c04067ae0 con 0x7f1c04142900 2021-11-12T05:47:48.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.156+0000 7f1c02ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1c040b6380 0x7f1c0413cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:48.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.156+0000 7f1c02ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1c040b6380 0x7f1c0413cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48930/0 (socket says 172.21.2.105:48930) 2021-11-12T05:47:48.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.156+0000 7f1c02ffd700 1 -- 172.21.2.105:0/3921519952 learned_addr learned my addr 172.21.2.105:0/3921519952 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:48.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.156+0000 7f1c02ffd700 1 -- 172.21.2.105:0/3921519952 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1c04142900 msgr2=0x7f1c0413af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:48.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.156+0000 7f1c02ffd700 1 --2- 172.21.2.105:0/3921519952 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1c04142900 0x7f1c0413af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:48.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.156+0000 7f1c02ffd700 1 -- 172.21.2.105:0/3921519952 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1c0405c490 msgr2=0x7f1c04141200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:48.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.156+0000 7f1c02ffd700 1 --2- 172.21.2.105:0/3921519952 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1c0405c490 0x7f1c04141200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:48.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.156+0000 7f1c02ffd700 1 -- 172.21.2.105:0/3921519952 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bfc009470 con 0x7f1c040b6380 2021-11-12T05:47:48.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.156+0000 7f1c02ffd700 1 --2- 172.21.2.105:0/3921519952 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1c040b6380 0x7f1c0413cd10 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7f1bec000ed0 tx=0x7f1bec006d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:48.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.156+0000 7f1c00ff9700 1 -- 172.21.2.105:0/3921519952 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bec012410 con 0x7f1c040b6380 2021-11-12T05:47:48.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.156+0000 7f1c00ff9700 1 -- 172.21.2.105:0/3921519952 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bec012570 con 0x7f1c040b6380 2021-11-12T05:47:48.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.156+0000 7f1c0a051700 1 -- 172.21.2.105:0/3921519952 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c04139f50 con 0x7f1c040b6380 2021-11-12T05:47:48.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.156+0000 7f1c00ff9700 1 -- 172.21.2.105:0/3921519952 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bec0128d0 con 0x7f1c040b6380 2021-11-12T05:47:48.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.156+0000 7f1c0a051700 1 -- 172.21.2.105:0/3921519952 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c0413b590 con 0x7f1c040b6380 2021-11-12T05:47:48.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.156+0000 7f1c0a051700 1 -- 172.21.2.105:0/3921519952 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c04057350 con 0x7f1c040b6380 2021-11-12T05:47:48.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.156+0000 7f1c00ff9700 1 -- 172.21.2.105:0/3921519952 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1bec00f030 con 0x7f1c040b6380 2021-11-12T05:47:48.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.156+0000 7f1c00ff9700 1 --2- 172.21.2.105:0/3921519952 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1be8053600 0x7f1be8055ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:48.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.156+0000 7f1c00ff9700 1 -- 172.21.2.105:0/3921519952 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f1bec06b3d0 con 0x7f1c040b6380 2021-11-12T05:47:48.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.156+0000 7f1c037fe700 1 --2- 172.21.2.105:0/3921519952 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1be8053600 0x7f1be8055ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:48.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.156+0000 7f1c037fe700 1 --2- 172.21.2.105:0/3921519952 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1be8053600 0x7f1be8055ac0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f1bf4000bc0 tx=0x7f1bf40011a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:48.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.160+0000 7f1c00ff9700 1 -- 172.21.2.105:0/3921519952 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1bec042600 con 0x7f1c040b6380 2021-11-12T05:47:48.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:48.244+0000 7f1c0a051700 1 -- 172.21.2.105:0/3921519952 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f1c0413a6b0 con 0x7f1c040b6380 2021-11-12T05:47:49.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.228+0000 7f1c00ff9700 1 -- 172.21.2.105:0/3921519952 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v92) v1 ==== 133+0+0 (secure 0 0 0) 0x7f1bec045c20 con 0x7f1c040b6380 2021-11-12T05:47:49.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.232+0000 7f1c0a051700 1 -- 172.21.2.105:0/3921519952 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1be8053600 msgr2=0x7f1be8055ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:49.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.232+0000 7f1c0a051700 1 --2- 172.21.2.105:0/3921519952 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1be8053600 0x7f1be8055ac0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f1bf4000bc0 tx=0x7f1bf40011a0).stop 2021-11-12T05:47:49.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.232+0000 7f1c0a051700 1 -- 172.21.2.105:0/3921519952 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1c040b6380 msgr2=0x7f1c0413cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:49.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.232+0000 7f1c0a051700 1 --2- 172.21.2.105:0/3921519952 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1c040b6380 0x7f1c0413cd10 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7f1bec000ed0 tx=0x7f1bec006d70).stop 2021-11-12T05:47:49.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.232+0000 7f1c0a051700 1 -- 172.21.2.105:0/3921519952 shutdown_connections 2021-11-12T05:47:49.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.232+0000 7f1c0a051700 1 --2- 172.21.2.105:0/3921519952 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1be8053600 0x7f1be8055ac0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:49.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.232+0000 7f1c0a051700 1 --2- 172.21.2.105:0/3921519952 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1c04142900 0x7f1c0413af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:49.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.232+0000 7f1c0a051700 1 --2- 172.21.2.105:0/3921519952 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1c040b6380 0x7f1c0413cd10 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:49.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.232+0000 7f1c0a051700 1 --2- 172.21.2.105:0/3921519952 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1c0405c490 0x7f1c04141200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:49.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.232+0000 7f1c0a051700 1 -- 172.21.2.105:0/3921519952 >> 172.21.2.105:0/3921519952 conn(0x7f1c04063810 msgr2=0x7f1c040b4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:49.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.232+0000 7f1c0a051700 1 -- 172.21.2.105:0/3921519952 shutdown_connections 2021-11-12T05:47:49.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.232+0000 7f1c0a051700 1 -- 172.21.2.105:0/3921519952 wait complete. 2021-11-12T05:47:49.239 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_metadata' created 2021-11-12T05:47:49.243 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-11-12T05:47:49.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f478e850700 1 Processor -- start 2021-11-12T05:47:49.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f478e850700 1 -- start start 2021-11-12T05:47:49.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f478e850700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f47880b2cc0 0x7f47880b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:49.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f478e850700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f47880b2290 0x7f4788143690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:49.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f478e850700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47880aa0b0 con 0x7f4788143b80 2021-11-12T05:47:49.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f478e850700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47880a9b70 con 0x7f47880b2cc0 2021-11-12T05:47:49.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f478e850700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47880a9e10 con 0x7f47880b2290 2021-11-12T05:47:49.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f478cded700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f4788143b80 0x7f478805f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:59336/0 (socket says 172.21.2.105:59336) 2021-11-12T05:47:49.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f478cded700 1 -- 172.21.2.105:0/2928746029 learned_addr learned my addr 172.21.2.105:0/2928746029 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:49.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f4786ffd700 1 -- 172.21.2.105:0/2928746029 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1081791726 0 0) 0x7f47880aa0b0 con 0x7f4788143b80 2021-11-12T05:47:49.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f47877fe700 1 --2- 172.21.2.105:0/2928746029 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f47880b2290 0x7f4788143690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:49.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f4787fff700 1 --2- 172.21.2.105:0/2928746029 >> v2:172.21.2.115:3300/0 conn(0x7f47880b2cc0 0x7f47880b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:49.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f4786ffd700 1 -- 172.21.2.105:0/2928746029 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4768003260 con 0x7f4788143b80 2021-11-12T05:47:49.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f4786ffd700 1 -- 172.21.2.105:0/2928746029 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1717045347 0 0) 0x7f4768003260 con 0x7f4788143b80 2021-11-12T05:47:49.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f4786ffd700 1 -- 172.21.2.105:0/2928746029 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f47880b2290 msgr2=0x7f4788143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:49.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f4786ffd700 1 --2- 172.21.2.105:0/2928746029 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f47880b2290 0x7f4788143690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:49.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f4786ffd700 1 -- 172.21.2.105:0/2928746029 >> v2:172.21.2.115:3300/0 conn(0x7f47880b2cc0 msgr2=0x7f47880b30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:49.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f4786ffd700 1 --2- 172.21.2.105:0/2928746029 >> v2:172.21.2.115:3300/0 conn(0x7f47880b2cc0 0x7f47880b30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:49.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f4786ffd700 1 -- 172.21.2.105:0/2928746029 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47880b0800 con 0x7f4788143b80 2021-11-12T05:47:49.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f4786ffd700 1 -- 172.21.2.105:0/2928746029 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f47800019e0 con 0x7f4788143b80 2021-11-12T05:47:49.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f4786ffd700 1 -- 172.21.2.105:0/2928746029 >> v1:172.21.2.105:6789/0 conn(0x7f4788143b80 legacy=0x7f478805f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:49.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f4786ffd700 1 --2- 172.21.2.105:0/2928746029 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f47680037d0 0x7f4768003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:49.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f4786ffd700 1 --2- 172.21.2.105:0/2928746029 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f47880b2290 0x7f4768004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:49.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f4786ffd700 1 --2- 172.21.2.105:0/2928746029 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f47680049f0 0x7f4768004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:49.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f4786ffd700 1 -- 172.21.2.105:0/2928746029 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47880a9b70 con 0x7f47680037d0 2021-11-12T05:47:49.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f4786ffd700 1 -- 172.21.2.105:0/2928746029 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47880a9e10 con 0x7f47680049f0 2021-11-12T05:47:49.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f4786ffd700 1 -- 172.21.2.105:0/2928746029 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f476800b750 con 0x7f47880b2290 2021-11-12T05:47:49.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f4787fff700 1 --2- 172.21.2.105:0/2928746029 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f47680037d0 0x7f4768003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:49.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f47877fe700 1 --2- 172.21.2.105:0/2928746029 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f47880b2290 0x7f4768004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:49.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f4787fff700 1 -- 172.21.2.105:0/2928746029 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f47880b2290 msgr2=0x7f4768004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:49.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f4787fff700 1 --2- 172.21.2.105:0/2928746029 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f47880b2290 0x7f4768004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:49.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f4787fff700 1 -- 172.21.2.105:0/2928746029 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f47680049f0 msgr2=0x7f4768004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:49.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f4787fff700 1 --2- 172.21.2.105:0/2928746029 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f47680049f0 0x7f4768004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:49.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f4787fff700 1 -- 172.21.2.105:0/2928746029 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4768003260 con 0x7f47680037d0 2021-11-12T05:47:49.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f47877fe700 1 --2- 172.21.2.105:0/2928746029 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f47880b2290 0x7f4768004500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:47:49.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f4787fff700 1 --2- 172.21.2.105:0/2928746029 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f47680037d0 0x7f4768003bf0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7f477800c000 tx=0x7f4778006df0).ready entity=mon.0 client_cookie=b881d878475106c8 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:49.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f4786ffd700 1 -- 172.21.2.105:0/2928746029 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f477800e830 con 0x7f47680037d0 2021-11-12T05:47:49.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f4786ffd700 1 -- 172.21.2.105:0/2928746029 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477800e990 con 0x7f47680037d0 2021-11-12T05:47:49.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f4786ffd700 1 -- 172.21.2.105:0/2928746029 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f477800ecf0 con 0x7f47680037d0 2021-11-12T05:47:49.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f478e850700 1 -- 172.21.2.105:0/2928746029 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f47680037d0 msgr2=0x7f4768003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:49.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f478e850700 1 --2- 172.21.2.105:0/2928746029 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f47680037d0 0x7f4768003bf0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7f477800c000 tx=0x7f4778006df0).stop 2021-11-12T05:47:49.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f478cded700 1 -- 172.21.2.105:0/2928746029 reap_dead start 2021-11-12T05:47:49.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f478e850700 1 -- 172.21.2.105:0/2928746029 shutdown_connections 2021-11-12T05:47:49.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f478e850700 1 -- 172.21.2.105:0/2928746029 >> 172.21.2.105:0/2928746029 conn(0x7f478805c490 msgr2=0x7f478805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:49.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f478e850700 1 -- 172.21.2.105:0/2928746029 shutdown_connections 2021-11-12T05:47:49.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.292+0000 7f478e850700 1 -- 172.21.2.105:0/2928746029 wait complete. 2021-11-12T05:47:49.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.296+0000 7f478e850700 1 Processor -- start 2021-11-12T05:47:49.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.296+0000 7f478e850700 1 -- start start 2021-11-12T05:47:49.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.296+0000 7f478e850700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f47680037d0 0x7f47880abbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:49.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.296+0000 7f478e850700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f47880670f0 0x7f47880aa4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:49.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.296+0000 7f478e850700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4788156cf0 0x7f4788157180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:49.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.296+0000 7f478e850700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47880aafc0 con 0x7f47680037d0 2021-11-12T05:47:49.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.296+0000 7f478e850700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4788157670 con 0x7f47880670f0 2021-11-12T05:47:49.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.296+0000 7f478e850700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47880ab1f0 con 0x7f4788156cf0 2021-11-12T05:47:49.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.296+0000 7f4787fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f47680037d0 0x7f47880abbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:49.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.296+0000 7f4787fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f47680037d0 0x7f47880abbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48950/0 (socket says 172.21.2.105:48950) 2021-11-12T05:47:49.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.296+0000 7f4787fff700 1 -- 172.21.2.105:0/625979933 learned_addr learned my addr 172.21.2.105:0/625979933 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:49.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.296+0000 7f4787fff700 1 -- 172.21.2.105:0/625979933 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4788156cf0 msgr2=0x7f4788157180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:49.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.296+0000 7f4787fff700 1 --2- 172.21.2.105:0/625979933 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4788156cf0 0x7f4788157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:49.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.296+0000 7f4787fff700 1 -- 172.21.2.105:0/625979933 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f47880670f0 msgr2=0x7f47880aa4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:49.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.296+0000 7f4787fff700 1 --2- 172.21.2.105:0/625979933 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f47880670f0 0x7f47880aa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:49.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.296+0000 7f4787fff700 1 -- 172.21.2.105:0/625979933 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47880ab490 con 0x7f47680037d0 2021-11-12T05:47:49.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.296+0000 7f4787fff700 1 --2- 172.21.2.105:0/625979933 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f47680037d0 0x7f47880abbd0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7f477800c000 tx=0x7f4778019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:49.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.296+0000 7f47857fa700 1 -- 172.21.2.105:0/625979933 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f477801b820 con 0x7f47680037d0 2021-11-12T05:47:49.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.296+0000 7f47857fa700 1 -- 172.21.2.105:0/625979933 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4778000e90 con 0x7f47680037d0 2021-11-12T05:47:49.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.296+0000 7f47857fa700 1 -- 172.21.2.105:0/625979933 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f477801bb70 con 0x7f47680037d0 2021-11-12T05:47:49.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.296+0000 7f478e850700 1 -- 172.21.2.105:0/625979933 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47880ab730 con 0x7f47680037d0 2021-11-12T05:47:49.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.296+0000 7f478e850700 1 -- 172.21.2.105:0/625979933 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47880638b0 con 0x7f47680037d0 2021-11-12T05:47:49.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.296+0000 7f478e850700 1 -- 172.21.2.105:0/625979933 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47880ac0c0 con 0x7f47680037d0 2021-11-12T05:47:49.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.296+0000 7f47857fa700 1 -- 172.21.2.105:0/625979933 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f477801bcd0 con 0x7f47680037d0 2021-11-12T05:47:49.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.296+0000 7f47857fa700 1 --2- 172.21.2.105:0/625979933 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f476c0536f0 0x7f476c055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:49.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.296+0000 7f47857fa700 1 -- 172.21.2.105:0/625979933 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5950+0+0 (secure 0 0 0) 0x7f477806ce80 con 0x7f47680037d0 2021-11-12T05:47:49.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.296+0000 7f47877fe700 1 --2- 172.21.2.105:0/625979933 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f476c0536f0 0x7f476c055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:49.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.296+0000 7f47877fe700 1 --2- 172.21.2.105:0/625979933 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f476c0536f0 0x7f476c055bb0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f477000b000 tx=0x7f4770008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:49.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.300+0000 7f47857fa700 1 -- 172.21.2.105:0/625979933 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4778044050 con 0x7f47680037d0 2021-11-12T05:47:49.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:49.384+0000 7f478e850700 1 -- 172.21.2.105:0/625979933 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f47880ab8c0 con 0x7f47680037d0 2021-11-12T05:47:50.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.240+0000 7f47857fa700 1 -- 172.21.2.105:0/625979933 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v93) v1 ==== 125+0+0 (secure 0 0 0) 0x7f4778047570 con 0x7f47680037d0 2021-11-12T05:47:50.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.244+0000 7f478e850700 1 -- 172.21.2.105:0/625979933 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f476c0536f0 msgr2=0x7f476c055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:50.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.244+0000 7f478e850700 1 --2- 172.21.2.105:0/625979933 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f476c0536f0 0x7f476c055bb0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f477000b000 tx=0x7f4770008040).stop 2021-11-12T05:47:50.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.244+0000 7f478e850700 1 -- 172.21.2.105:0/625979933 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f47680037d0 msgr2=0x7f47880abbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:50.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.244+0000 7f478e850700 1 --2- 172.21.2.105:0/625979933 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f47680037d0 0x7f47880abbd0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7f477800c000 tx=0x7f4778019000).stop 2021-11-12T05:47:50.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.244+0000 7f478e850700 1 -- 172.21.2.105:0/625979933 shutdown_connections 2021-11-12T05:47:50.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.244+0000 7f478e850700 1 --2- 172.21.2.105:0/625979933 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f476c0536f0 0x7f476c055bb0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:50.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.244+0000 7f478e850700 1 --2- 172.21.2.105:0/625979933 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4788156cf0 0x7f4788157180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:50.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.244+0000 7f478e850700 1 --2- 172.21.2.105:0/625979933 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f47880670f0 0x7f47880aa4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:50.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.244+0000 7f478e850700 1 --2- 172.21.2.105:0/625979933 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f47680037d0 0x7f47880abbd0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:50.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.244+0000 7f478e850700 1 -- 172.21.2.105:0/625979933 >> 172.21.2.105:0/625979933 conn(0x7f478805c490 msgr2=0x7f47880afca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:50.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.244+0000 7f478e850700 1 -- 172.21.2.105:0/625979933 shutdown_connections 2021-11-12T05:47:50.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.244+0000 7f478e850700 1 -- 172.21.2.105:0/625979933 wait complete. 2021-11-12T05:47:50.250 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_data' created 2021-11-12T05:47:50.254 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-12T05:47:50.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.304+0000 7f0414861700 1 Processor -- start 2021-11-12T05:47:50.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.304+0000 7f0414861700 1 -- start start 2021-11-12T05:47:50.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f0414861700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f04100ac280 0x7f041014b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:50.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f0414861700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f04100af730 0x7f04100ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:50.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f0414861700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04100ac7b0 con 0x7f04100ad080 2021-11-12T05:47:50.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f0414861700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04101488a0 con 0x7f04100af730 2021-11-12T05:47:50.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f0414861700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04100ac9e0 con 0x7f04100ac280 2021-11-12T05:47:50.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f040ed9d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f04100af730 0x7f04100ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:50.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f040ed9d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f04100af730 0x7f04100ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48960/0 (socket says 172.21.2.105:48960) 2021-11-12T05:47:50.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f040ed9d700 1 -- 172.21.2.105:0/2666213912 learned_addr learned my addr 172.21.2.105:0/2666213912 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:50.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f040ed9d700 1 -- 172.21.2.105:0/2666213912 >> v2:172.21.2.115:3300/0 conn(0x7f04100ac280 msgr2=0x7f041014b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:50.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f040ed9d700 1 --2- 172.21.2.105:0/2666213912 >> v2:172.21.2.115:3300/0 conn(0x7f04100ac280 0x7f041014b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:50.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f040ed9d700 1 -- 172.21.2.105:0/2666213912 >> v1:172.21.2.115:6789/0 conn(0x7f04100ad080 legacy=0x7f041014abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:50.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f040ed9d700 1 -- 172.21.2.105:0/2666213912 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04100b0b30 con 0x7f04100af730 2021-11-12T05:47:50.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f040ed9d700 1 --2- 172.21.2.105:0/2666213912 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04100af730 0x7f04100ad460 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7f04100b0eb0 tx=0x7f0408009290).ready entity=mon.0 client_cookie=485c1bac0ccb5b3 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:50.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f040d59a700 1 -- 172.21.2.105:0/2666213912 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f040800b820 con 0x7f04100af730 2021-11-12T05:47:50.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f040d59a700 1 -- 172.21.2.105:0/2666213912 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040800b980 con 0x7f04100af730 2021-11-12T05:47:50.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f040d59a700 1 -- 172.21.2.105:0/2666213912 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f040800bb30 con 0x7f04100af730 2021-11-12T05:47:50.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f0414861700 1 -- 172.21.2.105:0/2666213912 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04100af730 msgr2=0x7f04100ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:50.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f0414861700 1 --2- 172.21.2.105:0/2666213912 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04100af730 0x7f04100ad460 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7f04100b0eb0 tx=0x7f0408009290).stop 2021-11-12T05:47:50.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f0414861700 1 -- 172.21.2.105:0/2666213912 shutdown_connections 2021-11-12T05:47:50.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f0414861700 1 --2- 172.21.2.105:0/2666213912 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04100af730 0x7f04100ad460 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:50.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f0414861700 1 --2- 172.21.2.105:0/2666213912 >> v2:172.21.2.115:3300/0 conn(0x7f04100ac280 0x7f041014b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:50.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f0414861700 1 -- 172.21.2.105:0/2666213912 >> 172.21.2.105:0/2666213912 conn(0x7f04100b5370 msgr2=0x7f04100b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:50.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f0414861700 1 -- 172.21.2.105:0/2666213912 shutdown_connections 2021-11-12T05:47:50.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f0414861700 1 -- 172.21.2.105:0/2666213912 wait complete. 2021-11-12T05:47:50.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f0414861700 1 Processor -- start 2021-11-12T05:47:50.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f0414861700 1 -- start start 2021-11-12T05:47:50.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f0414861700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f04100ac280 0x7f041015a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:50.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f0414861700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f04100ad080 0x7f041015aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:50.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f0414861700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04100af730 0x7f04100a7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:50.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f0414861700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04100a9b40 con 0x7f04100af730 2021-11-12T05:47:50.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f0414861700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04100a98a0 con 0x7f04100ad080 2021-11-12T05:47:50.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f0414861700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04100ab2e0 con 0x7f04100ac280 2021-11-12T05:47:50.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f040ed9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04100af730 0x7f04100a7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:50.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f040ed9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04100af730 0x7f04100a7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48966/0 (socket says 172.21.2.105:48966) 2021-11-12T05:47:50.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f040ed9d700 1 -- 172.21.2.105:0/4119861664 learned_addr learned my addr 172.21.2.105:0/4119861664 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:50.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f040ed9d700 1 -- 172.21.2.105:0/4119861664 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f04100ac280 msgr2=0x7f041015a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:50.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f040ed9d700 1 --2- 172.21.2.105:0/4119861664 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f04100ac280 0x7f041015a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:50.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f040ed9d700 1 -- 172.21.2.105:0/4119861664 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f04100ad080 msgr2=0x7f041015aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:50.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f040ed9d700 1 --2- 172.21.2.105:0/4119861664 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f04100ad080 0x7f041015aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:50.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f040ed9d700 1 -- 172.21.2.105:0/4119861664 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0408009530 con 0x7f04100af730 2021-11-12T05:47:50.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f040ed9d700 1 --2- 172.21.2.105:0/4119861664 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04100af730 0x7f04100a7020 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7f04100b0eb0 tx=0x7f0408016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:50.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f04077fe700 1 -- 172.21.2.105:0/4119861664 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f040800bda0 con 0x7f04100af730 2021-11-12T05:47:50.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f04077fe700 1 -- 172.21.2.105:0/4119861664 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0408020430 con 0x7f04100af730 2021-11-12T05:47:50.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f04077fe700 1 -- 172.21.2.105:0/4119861664 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0408020790 con 0x7f04100af730 2021-11-12T05:47:50.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f0414861700 1 -- 172.21.2.105:0/4119861664 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0410157d50 con 0x7f04100af730 2021-11-12T05:47:50.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f0414861700 1 -- 172.21.2.105:0/4119861664 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04100ab780 con 0x7f04100af730 2021-11-12T05:47:50.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.308+0000 7f0414861700 1 -- 172.21.2.105:0/4119861664 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04100ab4a0 con 0x7f04100af730 2021-11-12T05:47:50.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.312+0000 7f04077fe700 1 -- 172.21.2.105:0/4119861664 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0408026020 con 0x7f04100af730 2021-11-12T05:47:50.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.312+0000 7f04077fe700 1 --2- 172.21.2.105:0/4119861664 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f03f40536f0 0x7f03f4055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:50.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.312+0000 7f04077fe700 1 -- 172.21.2.105:0/4119861664 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6300+0+0 (secure 0 0 0) 0x7f040806ca30 con 0x7f04100af730 2021-11-12T05:47:50.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.312+0000 7f040e59c700 1 --2- 172.21.2.105:0/4119861664 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f03f40536f0 0x7f03f4055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:50.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.312+0000 7f040e59c700 1 --2- 172.21.2.105:0/4119861664 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f03f40536f0 0x7f03f4055bb0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f03f8002f90 tx=0x7f03f80069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:50.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.312+0000 7f04077fe700 1 -- 172.21.2.105:0/4119861664 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f04080439a0 con 0x7f04100af730 2021-11-12T05:47:50.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.424+0000 7f0414861700 1 -- 172.21.2.105:0/4119861664 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f04100b1440 con 0x7f04100af730 2021-11-12T05:47:50.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.428+0000 7f04077fe700 1 -- 172.21.2.105:0/4119861664 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 17 and data pool 18 v43) v1 ==== 189+0+0 (secure 0 0 0) 0x7f0408015020 con 0x7f04100af730 2021-11-12T05:47:50.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.428+0000 7f0414861700 1 -- 172.21.2.105:0/4119861664 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f03f40536f0 msgr2=0x7f03f4055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:50.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.428+0000 7f0414861700 1 --2- 172.21.2.105:0/4119861664 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f03f40536f0 0x7f03f4055bb0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f03f8002f90 tx=0x7f03f80069b0).stop 2021-11-12T05:47:50.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.428+0000 7f0414861700 1 -- 172.21.2.105:0/4119861664 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04100af730 msgr2=0x7f04100a7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:50.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.428+0000 7f0414861700 1 --2- 172.21.2.105:0/4119861664 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04100af730 0x7f04100a7020 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7f04100b0eb0 tx=0x7f0408016000).stop 2021-11-12T05:47:50.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.428+0000 7f0414861700 1 -- 172.21.2.105:0/4119861664 shutdown_connections 2021-11-12T05:47:50.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.428+0000 7f0414861700 1 --2- 172.21.2.105:0/4119861664 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f03f40536f0 0x7f03f4055bb0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:50.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.428+0000 7f0414861700 1 --2- 172.21.2.105:0/4119861664 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04100af730 0x7f04100a7020 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:50.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.428+0000 7f0414861700 1 --2- 172.21.2.105:0/4119861664 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f04100ad080 0x7f041015aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:50.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.428+0000 7f0414861700 1 --2- 172.21.2.105:0/4119861664 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f04100ac280 0x7f041015a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:50.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.428+0000 7f0414861700 1 -- 172.21.2.105:0/4119861664 >> 172.21.2.105:0/4119861664 conn(0x7f04100b5370 msgr2=0x7f0410143cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:50.443 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.428+0000 7f0414861700 1 -- 172.21.2.105:0/4119861664 shutdown_connections 2021-11-12T05:47:50.445 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.428+0000 7f0414861700 1 -- 172.21.2.105:0/4119861664 wait complete. 2021-11-12T05:47:50.445 INFO:teuthology.orchestra.run.gibba005.stderr:new fs with metadata pool 17 and data pool 18 2021-11-12T05:47:50.449 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:47:50.503 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.500+0000 7fe02f429700 1 Processor -- start 2021-11-12T05:47:50.504 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.500+0000 7fe02f429700 1 -- start start 2021-11-12T05:47:50.505 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.500+0000 7fe02f429700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe0280b0780 0x7fe0281434d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:50.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.500+0000 7fe02f429700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fe0280b0cc0 0x7fe02805c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:50.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.500+0000 7fe02f429700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0280b2d20 con 0x7fe0280b2940 2021-11-12T05:47:50.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.500+0000 7fe02f429700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0280b1fc0 con 0x7fe0280b0780 2021-11-12T05:47:50.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.500+0000 7fe02f429700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0280b15e0 con 0x7fe0280b0cc0 2021-11-12T05:47:50.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.500+0000 7fe02c9c4700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe0280b0780 0x7fe0281434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:50.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.500+0000 7fe02c9c4700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe0280b0780 0x7fe0281434d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48980/0 (socket says 172.21.2.105:48980) 2021-11-12T05:47:50.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.500+0000 7fe02c9c4700 1 -- 172.21.2.105:0/446409408 learned_addr learned my addr 172.21.2.105:0/446409408 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:50.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.500+0000 7fe02c9c4700 1 -- 172.21.2.105:0/446409408 >> v2:172.21.2.115:3300/0 conn(0x7fe0280b0cc0 msgr2=0x7fe02805c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:50.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.500+0000 7fe02c9c4700 1 --2- 172.21.2.105:0/446409408 >> v2:172.21.2.115:3300/0 conn(0x7fe0280b0cc0 0x7fe02805c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:50.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.500+0000 7fe02c9c4700 1 -- 172.21.2.105:0/446409408 >> v1:172.21.2.115:6789/0 conn(0x7fe0280b2940 legacy=0x7fe028142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:50.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.500+0000 7fe02c9c4700 1 -- 172.21.2.105:0/446409408 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0280b1880 con 0x7fe0280b0780 2021-11-12T05:47:50.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.500+0000 7fe02c9c4700 1 --2- 172.21.2.105:0/446409408 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe0280b0780 0x7fe0281434d0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 rx=0x7fe0280b1ea0 tx=0x7fe018006eb0).ready entity=mon.0 client_cookie=500f1d89607d3ef7 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:50.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.500+0000 7fe017fff700 1 -- 172.21.2.105:0/446409408 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe01800d5c0 con 0x7fe0280b0780 2021-11-12T05:47:50.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.500+0000 7fe017fff700 1 -- 172.21.2.105:0/446409408 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe018000e90 con 0x7fe0280b0780 2021-11-12T05:47:50.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.500+0000 7fe017fff700 1 -- 172.21.2.105:0/446409408 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe01800d910 con 0x7fe0280b0780 2021-11-12T05:47:50.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.500+0000 7fe02f429700 1 -- 172.21.2.105:0/446409408 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe0280b0780 msgr2=0x7fe0281434d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:50.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.500+0000 7fe02f429700 1 --2- 172.21.2.105:0/446409408 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe0280b0780 0x7fe0281434d0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 rx=0x7fe0280b1ea0 tx=0x7fe018006eb0).stop 2021-11-12T05:47:50.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.500+0000 7fe02f429700 1 -- 172.21.2.105:0/446409408 shutdown_connections 2021-11-12T05:47:50.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.500+0000 7fe02f429700 1 --2- 172.21.2.105:0/446409408 >> v2:172.21.2.115:3300/0 conn(0x7fe0280b0cc0 0x7fe02805c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:50.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.500+0000 7fe02f429700 1 --2- 172.21.2.105:0/446409408 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe0280b0780 0x7fe0281434d0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:50.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.500+0000 7fe02f429700 1 -- 172.21.2.105:0/446409408 >> 172.21.2.105:0/446409408 conn(0x7fe028068440 msgr2=0x7fe028062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:50.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.500+0000 7fe02f429700 1 -- 172.21.2.105:0/446409408 shutdown_connections 2021-11-12T05:47:50.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.500+0000 7fe02f429700 1 -- 172.21.2.105:0/446409408 wait complete. 2021-11-12T05:47:50.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.500+0000 7fe02f429700 1 Processor -- start 2021-11-12T05:47:50.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.500+0000 7fe02f429700 1 -- start start 2021-11-12T05:47:50.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.504+0000 7fe02f429700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe0280b0780 0x7fe0280ac760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:50.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.504+0000 7fe02f429700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe0280b0cc0 0x7fe02813afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:50.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.504+0000 7fe02f429700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe0280b2940 0x7fe0280644b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:50.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.504+0000 7fe02f429700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe028139f70 con 0x7fe0280b0cc0 2021-11-12T05:47:50.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.504+0000 7fe02f429700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe028065670 con 0x7fe0280b0780 2021-11-12T05:47:50.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.504+0000 7fe02f429700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe028063db0 con 0x7fe0280b2940 2021-11-12T05:47:50.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.504+0000 7fe02c9c4700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe0280b0cc0 0x7fe02813afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:50.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.504+0000 7fe02c9c4700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe0280b0cc0 0x7fe02813afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48988/0 (socket says 172.21.2.105:48988) 2021-11-12T05:47:50.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.504+0000 7fe02c9c4700 1 -- 172.21.2.105:0/4261164906 learned_addr learned my addr 172.21.2.105:0/4261164906 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:50.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.504+0000 7fe02c9c4700 1 -- 172.21.2.105:0/4261164906 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe0280b2940 msgr2=0x7fe0280644b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:50.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.504+0000 7fe02c9c4700 1 --2- 172.21.2.105:0/4261164906 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe0280b2940 0x7fe0280644b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:50.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.504+0000 7fe02c9c4700 1 -- 172.21.2.105:0/4261164906 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe0280b0780 msgr2=0x7fe0280ac760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:50.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.504+0000 7fe02c9c4700 1 --2- 172.21.2.105:0/4261164906 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe0280b0780 0x7fe0280ac760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:50.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.504+0000 7fe02c9c4700 1 -- 172.21.2.105:0/4261164906 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01800b1e0 con 0x7fe0280b0cc0 2021-11-12T05:47:50.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.504+0000 7fe02c9c4700 1 --2- 172.21.2.105:0/4261164906 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe0280b0cc0 0x7fe02813afe0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7fe0280b1ea0 tx=0x7fe018015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:50.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.504+0000 7fe0167fc700 1 -- 172.21.2.105:0/4261164906 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe018006be0 con 0x7fe0280b0cc0 2021-11-12T05:47:50.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.504+0000 7fe0167fc700 1 -- 172.21.2.105:0/4261164906 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe018002f70 con 0x7fe0280b0cc0 2021-11-12T05:47:50.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.504+0000 7fe02f429700 1 -- 172.21.2.105:0/4261164906 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0280658a0 con 0x7fe0280b0cc0 2021-11-12T05:47:50.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.504+0000 7fe0167fc700 1 -- 172.21.2.105:0/4261164906 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe01800de70 con 0x7fe0280b0cc0 2021-11-12T05:47:50.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.504+0000 7fe02f429700 1 -- 172.21.2.105:0/4261164906 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0281407a0 con 0x7fe0280b0cc0 2021-11-12T05:47:50.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.504+0000 7fe02f429700 1 -- 172.21.2.105:0/4261164906 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe02813b670 con 0x7fe0280b0cc0 2021-11-12T05:47:50.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.504+0000 7fe0167fc700 1 -- 172.21.2.105:0/4261164906 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe018025030 con 0x7fe0280b0cc0 2021-11-12T05:47:50.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.504+0000 7fe0167fc700 1 --2- 172.21.2.105:0/4261164906 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe008053660 0x7fe008055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:50.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.504+0000 7fe0167fc700 1 -- 172.21.2.105:0/4261164906 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fe01806ce00 con 0x7fe0280b0cc0 2021-11-12T05:47:50.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.504+0000 7fe02d1c5700 1 --2- 172.21.2.105:0/4261164906 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe008053660 0x7fe008055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:50.520 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.504+0000 7fe02d1c5700 1 --2- 172.21.2.105:0/4261164906 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe008053660 0x7fe008055b20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7fe024002f10 tx=0x7fe024006930).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:50.520 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.508+0000 7fe0167fc700 1 -- 172.21.2.105:0/4261164906 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe018043e10 con 0x7fe0280b0cc0 2021-11-12T05:47:50.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.592+0000 7fe02f429700 1 -- 172.21.2.105:0/4261164906 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0280b1b20 con 0x7fe0280b0cc0 2021-11-12T05:47:50.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.592+0000 7fe0167fc700 1 -- 172.21.2.105:0/4261164906 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+16300 (secure 0 0 0) 0x7fe01806e090 con 0x7fe0280b0cc0 2021-11-12T05:47:50.598 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:50.598 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":95,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:47:50.427497+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:47:48.259327+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-11-12T05:47:49.399624+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:47:50.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.592+0000 7fe02f429700 1 -- 172.21.2.105:0/4261164906 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe008053660 msgr2=0x7fe008055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:50.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.592+0000 7fe02f429700 1 --2- 172.21.2.105:0/4261164906 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe008053660 0x7fe008055b20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7fe024002f10 tx=0x7fe024006930).stop 2021-11-12T05:47:50.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.592+0000 7fe02f429700 1 -- 172.21.2.105:0/4261164906 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe0280b0cc0 msgr2=0x7fe02813afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:50.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.592+0000 7fe02f429700 1 --2- 172.21.2.105:0/4261164906 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe0280b0cc0 0x7fe02813afe0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7fe0280b1ea0 tx=0x7fe018015000).stop 2021-11-12T05:47:50.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.592+0000 7fe02f429700 1 -- 172.21.2.105:0/4261164906 shutdown_connections 2021-11-12T05:47:50.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.592+0000 7fe02f429700 1 --2- 172.21.2.105:0/4261164906 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe008053660 0x7fe008055b20 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:50.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.592+0000 7fe02f429700 1 --2- 172.21.2.105:0/4261164906 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe0280b2940 0x7fe0280644b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:50.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.592+0000 7fe02f429700 1 --2- 172.21.2.105:0/4261164906 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe0280b0cc0 0x7fe02813afe0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:50.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.592+0000 7fe02f429700 1 --2- 172.21.2.105:0/4261164906 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe0280b0780 0x7fe0280ac760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:50.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.592+0000 7fe02f429700 1 -- 172.21.2.105:0/4261164906 >> 172.21.2.105:0/4261164906 conn(0x7fe028068440 msgr2=0x7fe0280af000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:50.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.592+0000 7fe02f429700 1 -- 172.21.2.105:0/4261164906 shutdown_connections 2021-11-12T05:47:50.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.592+0000 7fe02f429700 1 -- 172.21.2.105:0/4261164906 wait complete. 2021-11-12T05:47:50.605 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:47:50.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.652+0000 7ff2fdfae700 1 Processor -- start 2021-11-12T05:47:50.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.652+0000 7ff2fdfae700 1 -- start start 2021-11-12T05:47:50.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.652+0000 7ff2fdfae700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7ff2f80b0780 0x7ff2f81434d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:50.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.652+0000 7ff2fdfae700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff2f80b0cc0 0x7ff2f805f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:50.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.652+0000 7ff2fdfae700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f80b2d20 con 0x7ff2f80b2940 2021-11-12T05:47:50.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.652+0000 7ff2fdfae700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2f80b1fc0 con 0x7ff2f80b0cc0 2021-11-12T05:47:50.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.652+0000 7ff2fdfae700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2f80b15e0 con 0x7ff2f80b0780 2021-11-12T05:47:50.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.652+0000 7ff2f7fff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff2f80b0cc0 0x7ff2f805f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:50.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.652+0000 7ff2f7fff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff2f80b0cc0 0x7ff2f805f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:48994/0 (socket says 172.21.2.105:48994) 2021-11-12T05:47:50.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.652+0000 7ff2f7fff700 1 -- 172.21.2.105:0/3441826128 learned_addr learned my addr 172.21.2.105:0/3441826128 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:50.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.652+0000 7ff2f7fff700 1 -- 172.21.2.105:0/3441826128 >> v2:172.21.2.115:3300/0 conn(0x7ff2f80b0780 msgr2=0x7ff2f81434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:50.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.652+0000 7ff2f7fff700 1 --2- 172.21.2.105:0/3441826128 >> v2:172.21.2.115:3300/0 conn(0x7ff2f80b0780 0x7ff2f81434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:50.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.652+0000 7ff2f7fff700 1 -- 172.21.2.105:0/3441826128 >> v1:172.21.2.115:6789/0 conn(0x7ff2f80b2940 legacy=0x7ff2f8142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:50.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.652+0000 7ff2f7fff700 1 -- 172.21.2.105:0/3441826128 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f80b1880 con 0x7ff2f80b0cc0 2021-11-12T05:47:50.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.652+0000 7ff2f7fff700 1 --2- 172.21.2.105:0/3441826128 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff2f80b0cc0 0x7ff2f805f6b0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7ff2f80b1ea0 tx=0x7ff2f000b530).ready entity=mon.0 client_cookie=493b9cc6ac763698 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:50.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.652+0000 7ff2f67fc700 1 -- 172.21.2.105:0/3441826128 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2f00155e0 con 0x7ff2f80b0cc0 2021-11-12T05:47:50.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.652+0000 7ff2f67fc700 1 -- 172.21.2.105:0/3441826128 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f0015740 con 0x7ff2f80b0cc0 2021-11-12T05:47:50.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.652+0000 7ff2f67fc700 1 -- 172.21.2.105:0/3441826128 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2f0015aa0 con 0x7ff2f80b0cc0 2021-11-12T05:47:50.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.652+0000 7ff2fdfae700 1 -- 172.21.2.105:0/3441826128 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff2f80b0cc0 msgr2=0x7ff2f805f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:50.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.652+0000 7ff2fdfae700 1 --2- 172.21.2.105:0/3441826128 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff2f80b0cc0 0x7ff2f805f6b0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7ff2f80b1ea0 tx=0x7ff2f000b530).stop 2021-11-12T05:47:50.663 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.652+0000 7ff2fdfae700 1 -- 172.21.2.105:0/3441826128 shutdown_connections 2021-11-12T05:47:50.663 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.652+0000 7ff2fdfae700 1 --2- 172.21.2.105:0/3441826128 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff2f80b0cc0 0x7ff2f805f6b0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:50.663 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.652+0000 7ff2fdfae700 1 --2- 172.21.2.105:0/3441826128 >> v2:172.21.2.115:3300/0 conn(0x7ff2f80b0780 0x7ff2f81434d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:50.663 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.652+0000 7ff2fdfae700 1 -- 172.21.2.105:0/3441826128 >> 172.21.2.105:0/3441826128 conn(0x7ff2f8068440 msgr2=0x7ff2f8062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:50.664 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.652+0000 7ff2fdfae700 1 -- 172.21.2.105:0/3441826128 shutdown_connections 2021-11-12T05:47:50.664 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.652+0000 7ff2fdfae700 1 -- 172.21.2.105:0/3441826128 wait complete. 2021-11-12T05:47:50.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.656+0000 7ff2fdfae700 1 Processor -- start 2021-11-12T05:47:50.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.656+0000 7ff2fdfae700 1 -- start start 2021-11-12T05:47:50.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.656+0000 7ff2fdfae700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff2f80b0780 0x7ff2f8142ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:50.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.656+0000 7ff2fdfae700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff2f80b0cc0 0x7ff2f80ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:50.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.656+0000 7ff2fdfae700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff2f80b2940 0x7ff2f814eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:50.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.656+0000 7ff2fdfae700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f8064ee0 con 0x7ff2f80b0cc0 2021-11-12T05:47:50.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.656+0000 7ff2fdfae700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f8065180 con 0x7ff2f80b0780 2021-11-12T05:47:50.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.656+0000 7ff2fdfae700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f8065420 con 0x7ff2f80b2940 2021-11-12T05:47:50.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.656+0000 7ff2f6ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff2f80b0cc0 0x7ff2f80ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:50.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.656+0000 7ff2f6ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff2f80b0cc0 0x7ff2f80ab8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49000/0 (socket says 172.21.2.105:49000) 2021-11-12T05:47:50.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.656+0000 7ff2f6ffd700 1 -- 172.21.2.105:0/3883185521 learned_addr learned my addr 172.21.2.105:0/3883185521 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:50.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.656+0000 7ff2f6ffd700 1 -- 172.21.2.105:0/3883185521 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff2f80b2940 msgr2=0x7ff2f814eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:50.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.656+0000 7ff2f6ffd700 1 --2- 172.21.2.105:0/3883185521 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff2f80b2940 0x7ff2f814eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:50.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.656+0000 7ff2f6ffd700 1 -- 172.21.2.105:0/3883185521 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff2f80b0780 msgr2=0x7ff2f8142ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:50.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.656+0000 7ff2f6ffd700 1 --2- 172.21.2.105:0/3883185521 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff2f80b0780 0x7ff2f8142ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:50.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.656+0000 7ff2f6ffd700 1 -- 172.21.2.105:0/3883185521 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f000b7d0 con 0x7ff2f80b0cc0 2021-11-12T05:47:50.671 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.656+0000 7ff2f6ffd700 1 --2- 172.21.2.105:0/3883185521 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff2f80b0cc0 0x7ff2f80ab8f0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 rx=0x7ff2e0002f70 tx=0x7ff2e0006e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:50.671 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.656+0000 7ff2f4ff9700 1 -- 172.21.2.105:0/3883185521 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2e0013460 con 0x7ff2f80b0cc0 2021-11-12T05:47:50.671 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.656+0000 7ff2f4ff9700 1 -- 172.21.2.105:0/3883185521 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e00135c0 con 0x7ff2f80b0cc0 2021-11-12T05:47:50.671 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.656+0000 7ff2f4ff9700 1 -- 172.21.2.105:0/3883185521 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2e0013920 con 0x7ff2f80b0cc0 2021-11-12T05:47:50.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.656+0000 7ff2fdfae700 1 -- 172.21.2.105:0/3883185521 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f814e680 con 0x7ff2f80b0cc0 2021-11-12T05:47:50.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.656+0000 7ff2fdfae700 1 -- 172.21.2.105:0/3883185521 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f814f020 con 0x7ff2f80b0cc0 2021-11-12T05:47:50.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.656+0000 7ff2fdfae700 1 -- 172.21.2.105:0/3883185521 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f80655e0 con 0x7ff2f80b0cc0 2021-11-12T05:47:50.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.656+0000 7ff2f4ff9700 1 -- 172.21.2.105:0/3883185521 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff2e000f070 con 0x7ff2f80b0cc0 2021-11-12T05:47:50.673 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.656+0000 7ff2f4ff9700 1 --2- 172.21.2.105:0/3883185521 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff2dc053640 0x7ff2dc055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:50.673 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.656+0000 7ff2f4ff9700 1 -- 172.21.2.105:0/3883185521 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6416+0+0 (secure 0 0 0) 0x7ff2e006b470 con 0x7ff2f80b0cc0 2021-11-12T05:47:50.673 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.656+0000 7ff2f77fe700 1 --2- 172.21.2.105:0/3883185521 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff2dc053640 0x7ff2dc055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:50.673 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.656+0000 7ff2f77fe700 1 --2- 172.21.2.105:0/3883185521 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff2dc053640 0x7ff2dc055b00 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7ff2e8002f10 tx=0x7ff2e8006930).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:50.673 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.660+0000 7ff2f4ff9700 1 -- 172.21.2.105:0/3883185521 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff2e0042370 con 0x7ff2f80b0cc0 2021-11-12T05:47:50.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.740+0000 7ff2fdfae700 1 -- 172.21.2.105:0/3883185521 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2f814e870 con 0x7ff2f80b0cc0 2021-11-12T05:47:50.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.744+0000 7ff2f4ff9700 1 -- 172.21.2.105:0/3883185521 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+16300 (secure 0 0 0) 0x7ff2f814e870 con 0x7ff2f80b0cc0 2021-11-12T05:47:50.747 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:50.748 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":95,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:47:50.427497+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:47:48.259327+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-11-12T05:47:49.399624+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:47:50.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.744+0000 7ff2fdfae700 1 -- 172.21.2.105:0/3883185521 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff2dc053640 msgr2=0x7ff2dc055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:50.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.744+0000 7ff2fdfae700 1 --2- 172.21.2.105:0/3883185521 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff2dc053640 0x7ff2dc055b00 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7ff2e8002f10 tx=0x7ff2e8006930).stop 2021-11-12T05:47:50.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.744+0000 7ff2fdfae700 1 -- 172.21.2.105:0/3883185521 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff2f80b0cc0 msgr2=0x7ff2f80ab8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:50.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.744+0000 7ff2fdfae700 1 --2- 172.21.2.105:0/3883185521 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff2f80b0cc0 0x7ff2f80ab8f0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 rx=0x7ff2e0002f70 tx=0x7ff2e0006e90).stop 2021-11-12T05:47:50.750 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.744+0000 7ff2fdfae700 1 -- 172.21.2.105:0/3883185521 shutdown_connections 2021-11-12T05:47:50.750 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.744+0000 7ff2fdfae700 1 --2- 172.21.2.105:0/3883185521 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff2dc053640 0x7ff2dc055b00 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:50.750 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.744+0000 7ff2fdfae700 1 --2- 172.21.2.105:0/3883185521 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff2f80b2940 0x7ff2f814eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:50.750 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.744+0000 7ff2fdfae700 1 --2- 172.21.2.105:0/3883185521 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff2f80b0cc0 0x7ff2f80ab8f0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:50.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.744+0000 7ff2fdfae700 1 --2- 172.21.2.105:0/3883185521 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff2f80b0780 0x7ff2f8142ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:50.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.744+0000 7ff2fdfae700 1 -- 172.21.2.105:0/3883185521 >> 172.21.2.105:0/3883185521 conn(0x7ff2f8068440 msgr2=0x7ff2f8062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:50.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.744+0000 7ff2fdfae700 1 -- 172.21.2.105:0/3883185521 shutdown_connections 2021-11-12T05:47:50.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.744+0000 7ff2fdfae700 1 -- 172.21.2.105:0/3883185521 wait complete. 2021-11-12T05:47:50.755 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-12T05:47:50.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.804+0000 7f7122b1e700 1 Processor -- start 2021-11-12T05:47:50.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.804+0000 7f7122b1e700 1 -- start start 2021-11-12T05:47:50.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.804+0000 7f7122b1e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f711c0aca40 0x7f711c0ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:50.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.804+0000 7f7122b1e700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f711c0b0520 0x7f711c1473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:50.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.804+0000 7f7122b1e700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f711c1478b0 0x7f711c144180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:50.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.804+0000 7f7122b1e700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f711c147d40 con 0x7f711c0b0520 2021-11-12T05:47:50.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.804+0000 7f7122b1e700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f711c0b1840 con 0x7f711c1478b0 2021-11-12T05:47:50.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.804+0000 7f7122b1e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711c0af2b0 con 0x7f711c0aca40 2021-11-12T05:47:50.812 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.804+0000 7f711bfff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f711c0b0520 0x7f711c1473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:50.812 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.804+0000 7f711bfff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f711c0b0520 0x7f711c1473c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49008/0 (socket says 172.21.2.105:49008) 2021-11-12T05:47:50.812 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.804+0000 7f711bfff700 1 -- 172.21.2.105:0/404359785 learned_addr learned my addr 172.21.2.105:0/404359785 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:50.813 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.804+0000 7f711bfff700 1 -- 172.21.2.105:0/404359785 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f711c0aca40 msgr2=0x7f711c0ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:50.813 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.804+0000 7f711bfff700 1 --2- 172.21.2.105:0/404359785 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f711c0aca40 0x7f711c0ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:50.813 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.804+0000 7f711bfff700 1 -- 172.21.2.105:0/404359785 >> v2:172.21.2.115:3300/0 conn(0x7f711c1478b0 msgr2=0x7f711c144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:50.813 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.804+0000 7f711bfff700 1 --2- 172.21.2.105:0/404359785 >> v2:172.21.2.115:3300/0 conn(0x7f711c1478b0 0x7f711c144180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:50.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.804+0000 7f711bfff700 1 -- 172.21.2.105:0/404359785 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711c0b09a0 con 0x7f711c0b0520 2021-11-12T05:47:50.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.804+0000 7f711bfff700 1 --2- 172.21.2.105:0/404359785 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f711c0b0520 0x7f711c1473c0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 rx=0x7f710c002f70 tx=0x7f710c006eb0).ready entity=mon.0 client_cookie=72e2e416504f3018 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:50.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.804+0000 7f711b7fe700 1 -- 172.21.2.105:0/404359785 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f710c00d570 con 0x7f711c0b0520 2021-11-12T05:47:50.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.804+0000 7f711b7fe700 1 -- 172.21.2.105:0/404359785 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710c000e90 con 0x7f711c0b0520 2021-11-12T05:47:50.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.804+0000 7f711b7fe700 1 -- 172.21.2.105:0/404359785 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f710c00d900 con 0x7f711c0b0520 2021-11-12T05:47:50.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.804+0000 7f7122b1e700 1 -- 172.21.2.105:0/404359785 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f711c0b0520 msgr2=0x7f711c1473c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:50.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.804+0000 7f7122b1e700 1 --2- 172.21.2.105:0/404359785 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f711c0b0520 0x7f711c1473c0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 rx=0x7f710c002f70 tx=0x7f710c006eb0).stop 2021-11-12T05:47:50.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.804+0000 7f7122b1e700 1 -- 172.21.2.105:0/404359785 shutdown_connections 2021-11-12T05:47:50.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.804+0000 7f7122b1e700 1 --2- 172.21.2.105:0/404359785 >> v2:172.21.2.115:3300/0 conn(0x7f711c1478b0 0x7f711c144180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:50.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.804+0000 7f7122b1e700 1 --2- 172.21.2.105:0/404359785 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f711c0b0520 0x7f711c1473c0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:50.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.804+0000 7f7122b1e700 1 --2- 172.21.2.105:0/404359785 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f711c0aca40 0x7f711c0ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:50.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.804+0000 7f7122b1e700 1 -- 172.21.2.105:0/404359785 >> 172.21.2.105:0/404359785 conn(0x7f711c05c490 msgr2=0x7f711c0b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:50.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.804+0000 7f7122b1e700 1 -- 172.21.2.105:0/404359785 shutdown_connections 2021-11-12T05:47:50.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.804+0000 7f7122b1e700 1 -- 172.21.2.105:0/404359785 wait complete. 2021-11-12T05:47:50.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.804+0000 7f7122b1e700 1 Processor -- start 2021-11-12T05:47:50.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.804+0000 7f7122b1e700 1 -- start start 2021-11-12T05:47:50.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.808+0000 7f7122b1e700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f711c0aca40 0x7f711c14c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:50.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.808+0000 7f7122b1e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f711c0b0520 0x7f711c159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:50.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.808+0000 7f7122b1e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f711c1478b0 0x7f711c15a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:50.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.808+0000 7f7122b1e700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c0ac390 con 0x7f711c0b0520 2021-11-12T05:47:50.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.808+0000 7f7122b1e700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c0a8550 con 0x7f711c0aca40 2021-11-12T05:47:50.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.808+0000 7f7122b1e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711c0a87f0 con 0x7f711c1478b0 2021-11-12T05:47:50.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.808+0000 7f711bfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f711c0b0520 0x7f711c159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:50.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.808+0000 7f711bfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f711c0b0520 0x7f711c159f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49014/0 (socket says 172.21.2.105:49014) 2021-11-12T05:47:50.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.808+0000 7f711bfff700 1 -- 172.21.2.105:0/1824529507 learned_addr learned my addr 172.21.2.105:0/1824529507 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:50.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.808+0000 7f711bfff700 1 -- 172.21.2.105:0/1824529507 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f711c1478b0 msgr2=0x7f711c15a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:50.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.808+0000 7f711bfff700 1 --2- 172.21.2.105:0/1824529507 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f711c1478b0 0x7f711c15a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:50.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.808+0000 7f711bfff700 1 -- 172.21.2.105:0/1824529507 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f711c0aca40 msgr2=0x7f711c14c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:50.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.808+0000 7f711bfff700 1 --2- 172.21.2.105:0/1824529507 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f711c0aca40 0x7f711c14c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:50.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.808+0000 7f711bfff700 1 -- 172.21.2.105:0/1824529507 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f710c00b1e0 con 0x7f711c0b0520 2021-11-12T05:47:50.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.808+0000 7f711bfff700 1 --2- 172.21.2.105:0/1824529507 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f711c0b0520 0x7f711c159f00 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7f710c002f70 tx=0x7f710c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:50.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.808+0000 7f7119ffb700 1 -- 172.21.2.105:0/1824529507 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f710c006be0 con 0x7f711c0b0520 2021-11-12T05:47:50.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.808+0000 7f7119ffb700 1 -- 172.21.2.105:0/1824529507 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710c00de00 con 0x7f711c0b0520 2021-11-12T05:47:50.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.808+0000 7f7122b1e700 1 -- 172.21.2.105:0/1824529507 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f711c0ac080 con 0x7f711c0b0520 2021-11-12T05:47:50.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.808+0000 7f7119ffb700 1 -- 172.21.2.105:0/1824529507 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f710c01e460 con 0x7f711c0b0520 2021-11-12T05:47:50.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.808+0000 7f7122b1e700 1 -- 172.21.2.105:0/1824529507 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f711c0647e0 con 0x7f711c0b0520 2021-11-12T05:47:50.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.808+0000 7f7122b1e700 1 -- 172.21.2.105:0/1824529507 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f711c064ac0 con 0x7f711c0b0520 2021-11-12T05:47:50.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.808+0000 7f7119ffb700 1 -- 172.21.2.105:0/1824529507 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f710c01a040 con 0x7f711c0b0520 2021-11-12T05:47:50.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.808+0000 7f7119ffb700 1 --2- 172.21.2.105:0/1824529507 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f71000536a0 0x7f7100055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:50.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.808+0000 7f7119ffb700 1 -- 172.21.2.105:0/1824529507 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f710c06caa0 con 0x7f711c0b0520 2021-11-12T05:47:50.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.808+0000 7f71208ba700 1 --2- 172.21.2.105:0/1824529507 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f71000536a0 0x7f7100055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:50.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.808+0000 7f71208ba700 1 --2- 172.21.2.105:0/1824529507 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f71000536a0 0x7f7100055b60 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f7104002f70 tx=0x7f7104006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:50.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.812+0000 7f7119ffb700 1 -- 172.21.2.105:0/1824529507 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f710c043af0 con 0x7f711c0b0520 2021-11-12T05:47:50.924 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:50.920+0000 7f7122b1e700 1 -- 172.21.2.105:0/1824529507 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f711c057350 con 0x7f711c0b0520 2021-11-12T05:47:51.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.440+0000 7f7119ffb700 1 -- 172.21.2.105:0/1824529507 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v44) v1 ==== 118+0+0 (secure 0 0 0) 0x7f710c0470d0 con 0x7f711c0b0520 2021-11-12T05:47:51.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.444+0000 7f7122b1e700 1 -- 172.21.2.105:0/1824529507 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f71000536a0 msgr2=0x7f7100055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:51.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.444+0000 7f7122b1e700 1 --2- 172.21.2.105:0/1824529507 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f71000536a0 0x7f7100055b60 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f7104002f70 tx=0x7f7104006a80).stop 2021-11-12T05:47:51.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.444+0000 7f7122b1e700 1 -- 172.21.2.105:0/1824529507 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f711c0b0520 msgr2=0x7f711c159f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:51.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.444+0000 7f7122b1e700 1 --2- 172.21.2.105:0/1824529507 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f711c0b0520 0x7f711c159f00 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7f710c002f70 tx=0x7f710c015000).stop 2021-11-12T05:47:51.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.444+0000 7f7122b1e700 1 -- 172.21.2.105:0/1824529507 shutdown_connections 2021-11-12T05:47:51.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.444+0000 7f7122b1e700 1 --2- 172.21.2.105:0/1824529507 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f71000536a0 0x7f7100055b60 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:51.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.444+0000 7f7122b1e700 1 --2- 172.21.2.105:0/1824529507 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f711c1478b0 0x7f711c15a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:51.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.444+0000 7f7122b1e700 1 --2- 172.21.2.105:0/1824529507 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f711c0b0520 0x7f711c159f00 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:51.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.444+0000 7f7122b1e700 1 --2- 172.21.2.105:0/1824529507 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f711c0aca40 0x7f711c14c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:51.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.444+0000 7f7122b1e700 1 -- 172.21.2.105:0/1824529507 >> 172.21.2.105:0/1824529507 conn(0x7f711c05c490 msgr2=0x7f711c1453e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:51.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.444+0000 7f7122b1e700 1 -- 172.21.2.105:0/1824529507 shutdown_connections 2021-11-12T05:47:51.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.444+0000 7f7122b1e700 1 -- 172.21.2.105:0/1824529507 wait complete. 2021-11-12T05:47:51.455 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:47:51.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.500+0000 7f36fabe9700 1 Processor -- start 2021-11-12T05:47:51.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.500+0000 7f36fabe9700 1 -- start start 2021-11-12T05:47:51.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.500+0000 7f36fabe9700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f36f40b0780 0x7f36f41434d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:51.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.500+0000 7f36fabe9700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f40b2d20 con 0x7f36f40b2940 2021-11-12T05:47:51.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.500+0000 7f36fabe9700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f40b1fc0 con 0x7f36f40b0cc0 2021-11-12T05:47:51.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.500+0000 7f36fabe9700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f405cba0 con 0x7f36f40b0780 2021-11-12T05:47:51.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.500+0000 7f36f8985700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f36f40b2940 0x7f36f4142dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:59416/0 (socket says 172.21.2.105:59416) 2021-11-12T05:47:51.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.500+0000 7f36f8985700 1 -- 172.21.2.105:0/3896195941 learned_addr learned my addr 172.21.2.105:0/3896195941 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:51.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.500+0000 7f36f37fe700 1 -- 172.21.2.105:0/3896195941 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 447209475 0 0) 0x7f36f40b2d20 con 0x7f36f40b2940 2021-11-12T05:47:51.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.500+0000 7f36f37fe700 1 -- 172.21.2.105:0/3896195941 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36d4003260 con 0x7f36f40b2940 2021-11-12T05:47:51.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.500+0000 7f36f37fe700 1 -- 172.21.2.105:0/3896195941 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2446643447 0 0) 0x7f36d4003260 con 0x7f36f40b2940 2021-11-12T05:47:51.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.500+0000 7f36f37fe700 1 -- 172.21.2.105:0/3896195941 >> v2:172.21.2.115:3300/0 conn(0x7f36f40b0780 msgr2=0x7f36f41434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:51.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.500+0000 7f36f37fe700 1 --2- 172.21.2.105:0/3896195941 >> v2:172.21.2.115:3300/0 conn(0x7f36f40b0780 0x7f36f41434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:51.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.500+0000 7f36f37fe700 1 -- 172.21.2.105:0/3896195941 >> v1:172.21.2.115:6789/0 conn(0x7f36f40b0cc0 legacy=0x7f36f405c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:51.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.500+0000 7f36f37fe700 1 -- 172.21.2.105:0/3896195941 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f40b15e0 con 0x7f36f40b2940 2021-11-12T05:47:51.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.500+0000 7f36f37fe700 1 -- 172.21.2.105:0/3896195941 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f36e4001660 con 0x7f36f40b2940 2021-11-12T05:47:51.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36f37fe700 1 -- 172.21.2.105:0/3896195941 >> v1:172.21.2.105:6789/0 conn(0x7f36f40b2940 legacy=0x7f36f4142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:51.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36f37fe700 1 --2- 172.21.2.105:0/3896195941 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f36d4003750 0x7f36d4003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:51.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36f37fe700 1 --2- 172.21.2.105:0/3896195941 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f36d4004500 0x7f36d4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:51.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36f37fe700 1 --2- 172.21.2.105:0/3896195941 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f36d4004f90 0x7f36d400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:51.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36f37fe700 1 -- 172.21.2.105:0/3896195941 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f405cba0 con 0x7f36d4003750 2021-11-12T05:47:51.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36f37fe700 1 -- 172.21.2.105:0/3896195941 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d400be80 con 0x7f36d4004f90 2021-11-12T05:47:51.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36f37fe700 1 -- 172.21.2.105:0/3896195941 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d400c040 con 0x7f36d4004500 2021-11-12T05:47:51.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36f8985700 1 --2- 172.21.2.105:0/3896195941 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f36d4003750 0x7f36d4003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:51.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36f8985700 1 -- 172.21.2.105:0/3896195941 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f36d4004500 msgr2=0x7f36d4004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:51.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36f8985700 1 --2- 172.21.2.105:0/3896195941 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f36d4004500 0x7f36d4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:51.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36f8985700 1 -- 172.21.2.105:0/3896195941 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f36d4004f90 msgr2=0x7f36d400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:51.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36f8985700 1 --2- 172.21.2.105:0/3896195941 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f36d4004f90 0x7f36d400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:51.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36f8985700 1 -- 172.21.2.105:0/3896195941 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d4003260 con 0x7f36d4003750 2021-11-12T05:47:51.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36f9186700 1 -- 172.21.2.105:0/3896195941 reap_dead start 2021-11-12T05:47:51.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36f8985700 1 --2- 172.21.2.105:0/3896195941 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f36d4003750 0x7f36d4003b50 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7f36f40b2f60 tx=0x7f36f40b1770).ready entity=mon.0 client_cookie=feec29eb89bbb9d8 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:51.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36f37fe700 1 -- 172.21.2.105:0/3896195941 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36e40070d0 con 0x7f36d4003750 2021-11-12T05:47:51.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36f37fe700 1 -- 172.21.2.105:0/3896195941 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e4007230 con 0x7f36d4003750 2021-11-12T05:47:51.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36f37fe700 1 -- 172.21.2.105:0/3896195941 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36e400c9c0 con 0x7f36d4003750 2021-11-12T05:47:51.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36fabe9700 1 -- 172.21.2.105:0/3896195941 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f36d4003750 msgr2=0x7f36d4003b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:51.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36fabe9700 1 --2- 172.21.2.105:0/3896195941 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f36d4003750 0x7f36d4003b50 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7f36f40b2f60 tx=0x7f36f40b1770).stop 2021-11-12T05:47:51.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36fabe9700 1 -- 172.21.2.105:0/3896195941 shutdown_connections 2021-11-12T05:47:51.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36fabe9700 1 --2- 172.21.2.105:0/3896195941 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f36d4003750 0x7f36d4003b50 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:51.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36fabe9700 1 -- 172.21.2.105:0/3896195941 >> 172.21.2.105:0/3896195941 conn(0x7f36f4068440 msgr2=0x7f36f4062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:51.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36fabe9700 1 -- 172.21.2.105:0/3896195941 shutdown_connections 2021-11-12T05:47:51.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36fabe9700 1 -- 172.21.2.105:0/3896195941 wait complete. 2021-11-12T05:47:51.521 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36fabe9700 1 Processor -- start 2021-11-12T05:47:51.521 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36fabe9700 1 -- start start 2021-11-12T05:47:51.521 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36fabe9700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f36d4003750 0x7f36f414e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:51.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36fabe9700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f36f4063fe0 0x7f36f4156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:51.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36fabe9700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f36f4136450 0x7f36f4064810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:51.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36fabe9700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f40abdc0 con 0x7f36f4063fe0 2021-11-12T05:47:51.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36fabe9700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f40ac060 con 0x7f36d4003750 2021-11-12T05:47:51.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36fabe9700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f40ac300 con 0x7f36f4136450 2021-11-12T05:47:51.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36f3fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f36f4063fe0 0x7f36f4156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:51.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36f3fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f36f4063fe0 0x7f36f4156f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49036/0 (socket says 172.21.2.105:49036) 2021-11-12T05:47:51.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36f3fff700 1 -- 172.21.2.105:0/2769057966 learned_addr learned my addr 172.21.2.105:0/2769057966 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:51.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36f3fff700 1 -- 172.21.2.105:0/2769057966 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f36f4136450 msgr2=0x7f36f4064810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:51.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36f3fff700 1 --2- 172.21.2.105:0/2769057966 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f36f4136450 0x7f36f4064810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:51.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36f3fff700 1 -- 172.21.2.105:0/2769057966 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f36d4003750 msgr2=0x7f36f414e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:51.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36f3fff700 1 --2- 172.21.2.105:0/2769057966 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f36d4003750 0x7f36f414e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:51.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36f3fff700 1 -- 172.21.2.105:0/2769057966 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f4064d00 con 0x7f36f4063fe0 2021-11-12T05:47:51.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36f3fff700 1 --2- 172.21.2.105:0/2769057966 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f36f4063fe0 0x7f36f4156f70 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7f36dc002f70 tx=0x7f36dc006db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:51.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36f1ffb700 1 -- 172.21.2.105:0/2769057966 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36dc009e80 con 0x7f36f4063fe0 2021-11-12T05:47:51.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36f1ffb700 1 -- 172.21.2.105:0/2769057966 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36dc013460 con 0x7f36f4063fe0 2021-11-12T05:47:51.526 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36fabe9700 1 -- 172.21.2.105:0/2769057966 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f4064f50 con 0x7f36f4063fe0 2021-11-12T05:47:51.526 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36f1ffb700 1 -- 172.21.2.105:0/2769057966 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36dc0137c0 con 0x7f36f4063fe0 2021-11-12T05:47:51.526 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36fabe9700 1 -- 172.21.2.105:0/2769057966 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f4157710 con 0x7f36f4063fe0 2021-11-12T05:47:51.526 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36fabe9700 1 -- 172.21.2.105:0/2769057966 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f4136870 con 0x7f36f4063fe0 2021-11-12T05:47:51.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.504+0000 7f36f1ffb700 1 -- 172.21.2.105:0/2769057966 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f36dc01a060 con 0x7f36f4063fe0 2021-11-12T05:47:51.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.508+0000 7f36f1ffb700 1 --2- 172.21.2.105:0/2769057966 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f36d8053610 0x7f36d8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:51.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.508+0000 7f36f1ffb700 1 -- 172.21.2.105:0/2769057966 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f36dc06b470 con 0x7f36f4063fe0 2021-11-12T05:47:51.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.508+0000 7f36f8985700 1 --2- 172.21.2.105:0/2769057966 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f36d8053610 0x7f36d8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:51.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.508+0000 7f36f8985700 1 --2- 172.21.2.105:0/2769057966 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f36d8053610 0x7f36d8055ad0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f36f40b2f60 tx=0x7f36e4013000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:51.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.508+0000 7f36f1ffb700 1 -- 172.21.2.105:0/2769057966 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f36dc042370 con 0x7f36f4063fe0 2021-11-12T05:47:51.623 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.620+0000 7f36fabe9700 1 -- 172.21.2.105:0/2769057966 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36f40645b0 con 0x7f36f4063fe0 2021-11-12T05:47:51.623 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.620+0000 7f36f1ffb700 1 -- 172.21.2.105:0/2769057966 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f36dc018020 con 0x7f36f4063fe0 2021-11-12T05:47:51.624 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:51.624 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":44,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4751,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/3227424218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":3227424218},{"type":"v1","addr":"172.21.2.115:6833","nonce":3227424218}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":43}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:47:50.427589+0000","modified":"2021-11-12T05:47:51.432486+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7017":{"gid":7017,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/3298879485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":3298879485},{"type":"v1","addr":"172.21.2.105:6835","nonce":3298879485}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-11-12T05:47:51.625 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.620+0000 7f36fabe9700 1 -- 172.21.2.105:0/2769057966 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f36d8053610 msgr2=0x7f36d8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:51.626 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.620+0000 7f36fabe9700 1 --2- 172.21.2.105:0/2769057966 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f36d8053610 0x7f36d8055ad0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f36f40b2f60 tx=0x7f36e4013000).stop 2021-11-12T05:47:51.626 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.620+0000 7f36fabe9700 1 -- 172.21.2.105:0/2769057966 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f36f4063fe0 msgr2=0x7f36f4156f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:51.626 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.620+0000 7f36fabe9700 1 --2- 172.21.2.105:0/2769057966 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f36f4063fe0 0x7f36f4156f70 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7f36dc002f70 tx=0x7f36dc006db0).stop 2021-11-12T05:47:51.627 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.620+0000 7f36fabe9700 1 -- 172.21.2.105:0/2769057966 shutdown_connections 2021-11-12T05:47:51.627 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.620+0000 7f36fabe9700 1 --2- 172.21.2.105:0/2769057966 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f36d8053610 0x7f36d8055ad0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:51.627 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.620+0000 7f36fabe9700 1 --2- 172.21.2.105:0/2769057966 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f36f4136450 0x7f36f4064810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:51.627 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.620+0000 7f36fabe9700 1 --2- 172.21.2.105:0/2769057966 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f36f4063fe0 0x7f36f4156f70 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:51.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.620+0000 7f36fabe9700 1 --2- 172.21.2.105:0/2769057966 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f36d4003750 0x7f36f414e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:51.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.620+0000 7f36fabe9700 1 -- 172.21.2.105:0/2769057966 >> 172.21.2.105:0/2769057966 conn(0x7f36f4068440 msgr2=0x7f36f4137a20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:51.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.620+0000 7f36fabe9700 1 -- 172.21.2.105:0/2769057966 shutdown_connections 2021-11-12T05:47:51.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.620+0000 7f36fabe9700 1 -- 172.21.2.105:0/2769057966 wait complete. 2021-11-12T05:47:51.629 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 44 2021-11-12T05:47:51.631 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:47:51.683 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.676+0000 7f267d72d700 1 Processor -- start 2021-11-12T05:47:51.683 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.676+0000 7f267d72d700 1 -- start start 2021-11-12T05:47:51.684 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.676+0000 7f267d72d700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f26780ad080 0x7f26780af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:51.684 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.676+0000 7f267d72d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f26780ac280 0x7f26780ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:51.684 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.676+0000 7f267d72d700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26780ac7b0 con 0x7f267814abe0 2021-11-12T05:47:51.684 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.676+0000 7f267d72d700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26781488a0 con 0x7f26780ac280 2021-11-12T05:47:51.684 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.676+0000 7f267d72d700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26780ac9e0 con 0x7f26780ad080 2021-11-12T05:47:51.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f26767fc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f26780ac280 0x7f26780ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:51.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f26767fc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f26780ac280 0x7f26780ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49044/0 (socket says 172.21.2.105:49044) 2021-11-12T05:47:51.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f26767fc700 1 -- 172.21.2.105:0/2775352730 learned_addr learned my addr 172.21.2.105:0/2775352730 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:51.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f26767fc700 1 -- 172.21.2.105:0/2775352730 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f26780ad080 msgr2=0x7f26780af730 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:47:51.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f26767fc700 1 --2- 172.21.2.105:0/2775352730 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f26780ad080 0x7f26780af730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:51.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f26767fc700 1 -- 172.21.2.105:0/2775352730 >> v1:172.21.2.105:6789/0 conn(0x7f267814abe0 legacy=0x7f267814b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:51.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f26767fc700 1 -- 172.21.2.105:0/2775352730 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26780b0b30 con 0x7f26780ac280 2021-11-12T05:47:51.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f26767fc700 1 --2- 172.21.2.105:0/2775352730 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f26780ac280 0x7f26780ad460 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 rx=0x7f2670001490 tx=0x7f2660006eb0).ready entity=mon.0 client_cookie=9128652c21752328 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:51.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f2675ffb700 1 -- 172.21.2.105:0/2775352730 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f266000d570 con 0x7f26780ac280 2021-11-12T05:47:51.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f2675ffb700 1 -- 172.21.2.105:0/2775352730 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2660000e90 con 0x7f26780ac280 2021-11-12T05:47:51.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f2675ffb700 1 -- 172.21.2.105:0/2775352730 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f266000d900 con 0x7f26780ac280 2021-11-12T05:47:51.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f267d72d700 1 -- 172.21.2.105:0/2775352730 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f26780ac280 msgr2=0x7f26780ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:51.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f267d72d700 1 --2- 172.21.2.105:0/2775352730 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f26780ac280 0x7f26780ad460 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 rx=0x7f2670001490 tx=0x7f2660006eb0).stop 2021-11-12T05:47:51.692 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f267d72d700 1 -- 172.21.2.105:0/2775352730 shutdown_connections 2021-11-12T05:47:51.692 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f267d72d700 1 --2- 172.21.2.105:0/2775352730 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f26780ac280 0x7f26780ad460 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:51.692 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f267d72d700 1 --2- 172.21.2.105:0/2775352730 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f26780ad080 0x7f26780af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:51.692 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f267d72d700 1 -- 172.21.2.105:0/2775352730 >> 172.21.2.105:0/2775352730 conn(0x7f26780b5370 msgr2=0x7f26780b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:51.692 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f267d72d700 1 -- 172.21.2.105:0/2775352730 shutdown_connections 2021-11-12T05:47:51.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f267d72d700 1 -- 172.21.2.105:0/2775352730 wait complete. 2021-11-12T05:47:51.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f267d72d700 1 Processor -- start 2021-11-12T05:47:51.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f267d72d700 1 -- start start 2021-11-12T05:47:51.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f267d72d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f26780ac280 0x7f26780a9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:51.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f267d72d700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f26780ad080 0x7f2678063750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:51.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f267d72d700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f267814abe0 0x7f26780a7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:51.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f267d72d700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26780a8ba0 con 0x7f26780ac280 2021-11-12T05:47:51.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f267d72d700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26780641e0 con 0x7f267814abe0 2021-11-12T05:47:51.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f267d72d700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26780aa940 con 0x7f26780ad080 2021-11-12T05:47:51.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f2676ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f26780ac280 0x7f26780a9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:51.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f2676ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f26780ac280 0x7f26780a9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49050/0 (socket says 172.21.2.105:49050) 2021-11-12T05:47:51.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f2676ffd700 1 -- 172.21.2.105:0/446934877 learned_addr learned my addr 172.21.2.105:0/446934877 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:51.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f2676ffd700 1 -- 172.21.2.105:0/446934877 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f26780ad080 msgr2=0x7f2678063750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:51.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f2676ffd700 1 --2- 172.21.2.105:0/446934877 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f26780ad080 0x7f2678063750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:51.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f2676ffd700 1 -- 172.21.2.105:0/446934877 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f267814abe0 msgr2=0x7f26780a7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:51.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f2676ffd700 1 --2- 172.21.2.105:0/446934877 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f267814abe0 0x7f26780a7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:51.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f2676ffd700 1 -- 172.21.2.105:0/446934877 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266000b1e0 con 0x7f26780ac280 2021-11-12T05:47:51.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f2676ffd700 1 --2- 172.21.2.105:0/446934877 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f26780ac280 0x7f26780a9c40 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 rx=0x7f2668002fb0 tx=0x7f2668006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:51.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f266ffff700 1 -- 172.21.2.105:0/446934877 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2668013460 con 0x7f26780ac280 2021-11-12T05:47:51.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f266ffff700 1 -- 172.21.2.105:0/446934877 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26680135c0 con 0x7f26780ac280 2021-11-12T05:47:51.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f267d72d700 1 -- 172.21.2.105:0/446934877 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26780aabe0 con 0x7f26780ac280 2021-11-12T05:47:51.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f267d72d700 1 -- 172.21.2.105:0/446934877 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26780a95a0 con 0x7f26780ac280 2021-11-12T05:47:51.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f266ffff700 1 -- 172.21.2.105:0/446934877 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2668013920 con 0x7f26780ac280 2021-11-12T05:47:51.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.680+0000 7f267d72d700 1 -- 172.21.2.105:0/446934877 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2678064030 con 0x7f26780ac280 2021-11-12T05:47:51.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.684+0000 7f266ffff700 1 -- 172.21.2.105:0/446934877 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f266800f070 con 0x7f26780ac280 2021-11-12T05:47:51.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.684+0000 7f266ffff700 1 --2- 172.21.2.105:0/446934877 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f265c053660 0x7f265c055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:51.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.684+0000 7f266ffff700 1 -- 172.21.2.105:0/446934877 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f266806b620 con 0x7f26780ac280 2021-11-12T05:47:51.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.684+0000 7f26767fc700 1 --2- 172.21.2.105:0/446934877 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f265c053660 0x7f265c055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:51.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.684+0000 7f26767fc700 1 --2- 172.21.2.105:0/446934877 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f265c053660 0x7f265c055b20 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f2670001490 tx=0x7f2660015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:51.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.684+0000 7f266ffff700 1 -- 172.21.2.105:0/446934877 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2668042520 con 0x7f26780ac280 2021-11-12T05:47:51.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.768+0000 7f267d72d700 1 -- 172.21.2.105:0/446934877 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f26780aba30 con 0x7f26780ac280 2021-11-12T05:47:51.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.768+0000 7f266ffff700 1 -- 172.21.2.105:0/446934877 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+16287 (secure 0 0 0) 0x7f2668045b40 con 0x7f26780ac280 2021-11-12T05:47:51.775 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:51.775 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":96,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:47:51.430945+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:47:48.259327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-11-12T05:47:49.399624+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:47:51.776 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.772+0000 7f267d72d700 1 -- 172.21.2.105:0/446934877 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f265c053660 msgr2=0x7f265c055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:51.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.772+0000 7f267d72d700 1 --2- 172.21.2.105:0/446934877 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f265c053660 0x7f265c055b20 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f2670001490 tx=0x7f2660015000).stop 2021-11-12T05:47:51.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.772+0000 7f267d72d700 1 -- 172.21.2.105:0/446934877 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f26780ac280 msgr2=0x7f26780a9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:51.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.772+0000 7f267d72d700 1 --2- 172.21.2.105:0/446934877 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f26780ac280 0x7f26780a9c40 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 rx=0x7f2668002fb0 tx=0x7f2668006df0).stop 2021-11-12T05:47:51.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.772+0000 7f267d72d700 1 -- 172.21.2.105:0/446934877 shutdown_connections 2021-11-12T05:47:51.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.772+0000 7f267d72d700 1 --2- 172.21.2.105:0/446934877 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f265c053660 0x7f265c055b20 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:51.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.772+0000 7f267d72d700 1 --2- 172.21.2.105:0/446934877 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f267814abe0 0x7f26780a7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:51.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.772+0000 7f267d72d700 1 --2- 172.21.2.105:0/446934877 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f26780ad080 0x7f2678063750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:51.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.772+0000 7f267d72d700 1 --2- 172.21.2.105:0/446934877 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f26780ac280 0x7f26780a9c40 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:51.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.772+0000 7f267d72d700 1 -- 172.21.2.105:0/446934877 >> 172.21.2.105:0/446934877 conn(0x7f26780b5370 msgr2=0x7f26780ae880 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:51.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.772+0000 7f267d72d700 1 -- 172.21.2.105:0/446934877 shutdown_connections 2021-11-12T05:47:51.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.772+0000 7f267d72d700 1 -- 172.21.2.105:0/446934877 wait complete. 2021-11-12T05:47:51.783 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-12T05:47:51.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.832+0000 7f22a808f700 1 Processor -- start 2021-11-12T05:47:51.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.832+0000 7f22a808f700 1 -- start start 2021-11-12T05:47:51.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.832+0000 7f22a808f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f22a00ad080 0x7f22a00af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:51.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.832+0000 7f22a808f700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f22a00ac280 0x7f22a00ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:51.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.832+0000 7f22a808f700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f22a014abe0 0x7f22a014b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:51.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.832+0000 7f22a808f700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22a01488a0 con 0x7f22a014abe0 2021-11-12T05:47:51.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.832+0000 7f22a808f700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22a00ac7b0 con 0x7f22a00ac280 2021-11-12T05:47:51.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.832+0000 7f22a808f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a00ac9e0 con 0x7f22a00ad080 2021-11-12T05:47:51.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.832+0000 7f22a662c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f22a014abe0 0x7f22a014b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:51.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.832+0000 7f22a662c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f22a014abe0 0x7f22a014b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49056/0 (socket says 172.21.2.105:49056) 2021-11-12T05:47:51.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.832+0000 7f22a662c700 1 -- 172.21.2.105:0/2329011232 learned_addr learned my addr 172.21.2.105:0/2329011232 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:51.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.832+0000 7f22a662c700 1 -- 172.21.2.105:0/2329011232 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f22a00ad080 msgr2=0x7f22a00af730 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:47:51.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.832+0000 7f22a662c700 1 --2- 172.21.2.105:0/2329011232 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f22a00ad080 0x7f22a00af730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:51.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.832+0000 7f22a662c700 1 -- 172.21.2.105:0/2329011232 >> v2:172.21.2.115:3300/0 conn(0x7f22a00ac280 msgr2=0x7f22a00ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:51.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.832+0000 7f22a662c700 1 --2- 172.21.2.105:0/2329011232 >> v2:172.21.2.115:3300/0 conn(0x7f22a00ac280 0x7f22a00ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:51.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.832+0000 7f22a662c700 1 -- 172.21.2.105:0/2329011232 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a00b0b30 con 0x7f22a014abe0 2021-11-12T05:47:51.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.832+0000 7f22a662c700 1 --2- 172.21.2.105:0/2329011232 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f22a014abe0 0x7f22a014b090 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7f22a00ac6a0 tx=0x7f2298009290).ready entity=mon.0 client_cookie=83d7914d6bacba09 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:51.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.832+0000 7f22a4e29700 1 -- 172.21.2.105:0/2329011232 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f229800b830 con 0x7f22a014abe0 2021-11-12T05:47:51.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.832+0000 7f22a4e29700 1 -- 172.21.2.105:0/2329011232 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229800b990 con 0x7f22a014abe0 2021-11-12T05:47:51.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.832+0000 7f22a4e29700 1 -- 172.21.2.105:0/2329011232 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f229800bb40 con 0x7f22a014abe0 2021-11-12T05:47:51.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.836+0000 7f22a808f700 1 -- 172.21.2.105:0/2329011232 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f22a014abe0 msgr2=0x7f22a014b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:51.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.836+0000 7f22a808f700 1 --2- 172.21.2.105:0/2329011232 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f22a014abe0 0x7f22a014b090 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7f22a00ac6a0 tx=0x7f2298009290).stop 2021-11-12T05:47:51.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.836+0000 7f22a808f700 1 -- 172.21.2.105:0/2329011232 shutdown_connections 2021-11-12T05:47:51.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.836+0000 7f22a808f700 1 --2- 172.21.2.105:0/2329011232 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f22a014abe0 0x7f22a014b090 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:51.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.836+0000 7f22a808f700 1 --2- 172.21.2.105:0/2329011232 >> v2:172.21.2.115:3300/0 conn(0x7f22a00ac280 0x7f22a00ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:51.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.836+0000 7f22a808f700 1 --2- 172.21.2.105:0/2329011232 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f22a00ad080 0x7f22a00af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:51.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.836+0000 7f22a808f700 1 -- 172.21.2.105:0/2329011232 >> 172.21.2.105:0/2329011232 conn(0x7f22a00b5370 msgr2=0x7f22a00b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:51.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.836+0000 7f22a808f700 1 -- 172.21.2.105:0/2329011232 shutdown_connections 2021-11-12T05:47:51.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.836+0000 7f22a808f700 1 -- 172.21.2.105:0/2329011232 wait complete. 2021-11-12T05:47:51.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.836+0000 7f22a808f700 1 Processor -- start 2021-11-12T05:47:51.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.836+0000 7f22a808f700 1 -- start start 2021-11-12T05:47:51.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.836+0000 7f22a808f700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f22a00ac280 0x7f22a00ab1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:51.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.836+0000 7f22a808f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f22a00ad080 0x7f22a00ab6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:51.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.836+0000 7f22a808f700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f22a014abe0 0x7f22a00a7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:51.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.836+0000 7f22a808f700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a00a9b80 con 0x7f22a00ac280 2021-11-12T05:47:51.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.836+0000 7f22a808f700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a00a9e20 con 0x7f22a014abe0 2021-11-12T05:47:51.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.836+0000 7f22a808f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a01578e0 con 0x7f22a00ad080 2021-11-12T05:47:51.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.836+0000 7f22a5e2b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f22a00ac280 0x7f22a00ab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:51.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.836+0000 7f22a5e2b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f22a00ac280 0x7f22a00ab1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49060/0 (socket says 172.21.2.105:49060) 2021-11-12T05:47:51.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.836+0000 7f22a5e2b700 1 -- 172.21.2.105:0/36789505 learned_addr learned my addr 172.21.2.105:0/36789505 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:51.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.836+0000 7f22a5e2b700 1 -- 172.21.2.105:0/36789505 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f22a00ad080 msgr2=0x7f22a00ab6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:51.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.836+0000 7f22a5e2b700 1 --2- 172.21.2.105:0/36789505 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f22a00ad080 0x7f22a00ab6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:51.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.836+0000 7f22a5e2b700 1 -- 172.21.2.105:0/36789505 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f22a014abe0 msgr2=0x7f22a00a7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:51.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.836+0000 7f22a5e2b700 1 --2- 172.21.2.105:0/36789505 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f22a014abe0 0x7f22a00a7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:51.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.836+0000 7f22a5e2b700 1 -- 172.21.2.105:0/36789505 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2298009530 con 0x7f22a00ac280 2021-11-12T05:47:51.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.836+0000 7f22a5e2b700 1 --2- 172.21.2.105:0/36789505 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f22a00ac280 0x7f22a00ab1c0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7f2294002fb0 tx=0x7f2294006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:51.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.836+0000 7f2292ffd700 1 -- 172.21.2.105:0/36789505 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2294013460 con 0x7f22a00ac280 2021-11-12T05:47:51.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.836+0000 7f2292ffd700 1 -- 172.21.2.105:0/36789505 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22940135c0 con 0x7f22a00ac280 2021-11-12T05:47:51.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.836+0000 7f2292ffd700 1 -- 172.21.2.105:0/36789505 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2294013920 con 0x7f22a00ac280 2021-11-12T05:47:51.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.836+0000 7f22a808f700 1 -- 172.21.2.105:0/36789505 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a00a9870 con 0x7f22a00ac280 2021-11-12T05:47:51.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.836+0000 7f22a808f700 1 -- 172.21.2.105:0/36789505 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a00aaa40 con 0x7f22a00ac280 2021-11-12T05:47:51.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.836+0000 7f22a808f700 1 -- 172.21.2.105:0/36789505 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22a0157fa0 con 0x7f22a00ac280 2021-11-12T05:47:51.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.836+0000 7f2292ffd700 1 -- 172.21.2.105:0/36789505 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f229400f070 con 0x7f22a00ac280 2021-11-12T05:47:51.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.840+0000 7f2292ffd700 1 --2- 172.21.2.105:0/36789505 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f22800536f0 0x7f2280055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:51.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.840+0000 7f2292ffd700 1 -- 172.21.2.105:0/36789505 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f229406b520 con 0x7f22a00ac280 2021-11-12T05:47:51.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.840+0000 7f22a562a700 1 --2- 172.21.2.105:0/36789505 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f22800536f0 0x7f2280055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:51.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.840+0000 7f22a562a700 1 --2- 172.21.2.105:0/36789505 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f22800536f0 0x7f2280055bb0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f229c002f70 tx=0x7f229c006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:51.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.840+0000 7f2292ffd700 1 -- 172.21.2.105:0/36789505 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f22a0157fa0 con 0x7f22a00ac280 2021-11-12T05:47:51.956 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.952+0000 7f22a808f700 1 -- 172.21.2.105:0/36789505 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f22a0157fa0 con 0x7f22a00ac280 2021-11-12T05:47:51.961 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.956+0000 7f2292ffd700 1 -- 172.21.2.105:0/36789505 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v31) v1 ==== 184+0+0 (secure 0 0 0) 0x7f22a0157fa0 con 0x7f22a00ac280 2021-11-12T05:47:51.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.956+0000 7f22a808f700 1 -- 172.21.2.105:0/36789505 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f22800536f0 msgr2=0x7f2280055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:51.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.956+0000 7f22a808f700 1 --2- 172.21.2.105:0/36789505 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f22800536f0 0x7f2280055bb0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f229c002f70 tx=0x7f229c006a80).stop 2021-11-12T05:47:51.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.956+0000 7f22a808f700 1 -- 172.21.2.105:0/36789505 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f22a00ac280 msgr2=0x7f22a00ab1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:51.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.956+0000 7f22a808f700 1 --2- 172.21.2.105:0/36789505 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f22a00ac280 0x7f22a00ab1c0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7f2294002fb0 tx=0x7f2294006df0).stop 2021-11-12T05:47:51.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.960+0000 7f22a808f700 1 -- 172.21.2.105:0/36789505 shutdown_connections 2021-11-12T05:47:51.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.960+0000 7f22a808f700 1 --2- 172.21.2.105:0/36789505 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f22800536f0 0x7f2280055bb0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:51.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.960+0000 7f22a808f700 1 --2- 172.21.2.105:0/36789505 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f22a014abe0 0x7f22a00a7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:51.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.960+0000 7f22a808f700 1 --2- 172.21.2.105:0/36789505 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f22a00ad080 0x7f22a00ab6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:51.965 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.960+0000 7f22a808f700 1 --2- 172.21.2.105:0/36789505 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f22a00ac280 0x7f22a00ab1c0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:51.965 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.960+0000 7f22a808f700 1 -- 172.21.2.105:0/36789505 >> 172.21.2.105:0/36789505 conn(0x7f22a00b5370 msgr2=0x7f22a005fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:51.965 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.960+0000 7f22a808f700 1 -- 172.21.2.105:0/36789505 shutdown_connections 2021-11-12T05:47:51.965 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:51.960+0000 7f22a808f700 1 -- 172.21.2.105:0/36789505 wait complete. 2021-11-12T05:47:51.966 INFO:teuthology.orchestra.run.gibba005.stderr:updated caps for client.0 2021-11-12T05:47:51.969 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-12T05:47:52.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.020+0000 7f94c2bfd700 1 Processor -- start 2021-11-12T05:47:52.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.020+0000 7f94c2bfd700 1 -- start start 2021-11-12T05:47:52.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.020+0000 7f94c2bfd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f94bc0ad080 0x7f94bc0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:52.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.020+0000 7f94c2bfd700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94bc0ac7b0 con 0x7f94bc14b2f0 2021-11-12T05:47:52.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.020+0000 7f94c2bfd700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94bc0ac9e0 con 0x7f94bc0ac280 2021-11-12T05:47:52.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.020+0000 7f94c2bfd700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94bc1488a0 con 0x7f94bc0ad080 2021-11-12T05:47:52.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.020+0000 7f94c119a700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f94bc14b2f0 0x7f94bc147a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:59464/0 (socket says 172.21.2.105:59464) 2021-11-12T05:47:52.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.020+0000 7f94c0999700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f94bc0ad080 0x7f94bc0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:52.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.020+0000 7f94c119a700 1 -- 172.21.2.105:0/3262457072 learned_addr learned my addr 172.21.2.105:0/3262457072 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:52.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.020+0000 7f94c0999700 1 -- 172.21.2.105:0/3262457072 >> v1:172.21.2.115:6789/0 conn(0x7f94bc0ac280 legacy=0x7f94bc14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:52.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.020+0000 7f94c0999700 1 -- 172.21.2.105:0/3262457072 >> v1:172.21.2.105:6789/0 conn(0x7f94bc14b2f0 legacy=0x7f94bc147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:52.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.020+0000 7f94c0999700 1 -- 172.21.2.105:0/3262457072 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94bc0b0b30 con 0x7f94bc0ad080 2021-11-12T05:47:52.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.020+0000 7f94c0999700 1 --2- 172.21.2.105:0/3262457072 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f94bc0ad080 0x7f94bc0af730 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 rx=0x7f94bc0b0eb0 tx=0x7f94a4006df0).ready entity=mon.0 client_cookie=4d03b343a7ceb19b server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:52.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.020+0000 7f94bb7fe700 1 -- 172.21.2.105:0/3262457072 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94a400d5c0 con 0x7f94bc0ad080 2021-11-12T05:47:52.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.020+0000 7f94bb7fe700 1 -- 172.21.2.105:0/3262457072 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a4000e90 con 0x7f94bc0ad080 2021-11-12T05:47:52.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.020+0000 7f94bb7fe700 1 -- 172.21.2.105:0/3262457072 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94a400d910 con 0x7f94bc0ad080 2021-11-12T05:47:52.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.020+0000 7f94c2bfd700 1 -- 172.21.2.105:0/3262457072 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f94bc0ad080 msgr2=0x7f94bc0af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:52.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.020+0000 7f94c2bfd700 1 --2- 172.21.2.105:0/3262457072 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f94bc0ad080 0x7f94bc0af730 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 rx=0x7f94bc0b0eb0 tx=0x7f94a4006df0).stop 2021-11-12T05:47:52.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.020+0000 7f94c2bfd700 1 -- 172.21.2.105:0/3262457072 shutdown_connections 2021-11-12T05:47:52.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.020+0000 7f94c2bfd700 1 --2- 172.21.2.105:0/3262457072 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f94bc0ad080 0x7f94bc0af730 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:52.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.020+0000 7f94c2bfd700 1 -- 172.21.2.105:0/3262457072 >> 172.21.2.105:0/3262457072 conn(0x7f94bc0b5370 msgr2=0x7f94bc0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:52.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.020+0000 7f94c2bfd700 1 -- 172.21.2.105:0/3262457072 shutdown_connections 2021-11-12T05:47:52.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.020+0000 7f94c2bfd700 1 -- 172.21.2.105:0/3262457072 wait complete. 2021-11-12T05:47:52.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.024+0000 7f94c2bfd700 1 Processor -- start 2021-11-12T05:47:52.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.024+0000 7f94c2bfd700 1 -- start start 2021-11-12T05:47:52.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.024+0000 7f94c2bfd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f94bc0ac280 0x7f94bc0ab560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:52.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.024+0000 7f94c2bfd700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f94bc0ad080 0x7f94bc0aba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:52.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.024+0000 7f94c2bfd700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f94bc14b2f0 0x7f94bc066930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:52.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.024+0000 7f94c2bfd700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc0aaa80 con 0x7f94bc0ac280 2021-11-12T05:47:52.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.024+0000 7f94c2bfd700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc064110 con 0x7f94bc14b2f0 2021-11-12T05:47:52.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.024+0000 7f94c2bfd700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94bc0643b0 con 0x7f94bc0ad080 2021-11-12T05:47:52.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.024+0000 7f94c0999700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f94bc0ac280 0x7f94bc0ab560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:52.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.024+0000 7f94c0999700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f94bc0ac280 0x7f94bc0ab560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49074/0 (socket says 172.21.2.105:49074) 2021-11-12T05:47:52.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.024+0000 7f94c0999700 1 -- 172.21.2.105:0/3799346871 learned_addr learned my addr 172.21.2.105:0/3799346871 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:52.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.024+0000 7f94c0999700 1 -- 172.21.2.105:0/3799346871 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f94bc0ad080 msgr2=0x7f94bc0aba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:52.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.024+0000 7f94c0999700 1 --2- 172.21.2.105:0/3799346871 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f94bc0ad080 0x7f94bc0aba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:52.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.024+0000 7f94c0999700 1 -- 172.21.2.105:0/3799346871 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f94bc14b2f0 msgr2=0x7f94bc066930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:52.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.024+0000 7f94c0999700 1 --2- 172.21.2.105:0/3799346871 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f94bc14b2f0 0x7f94bc066930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:52.042 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.024+0000 7f94c0999700 1 -- 172.21.2.105:0/3799346871 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a400b180 con 0x7f94bc0ac280 2021-11-12T05:47:52.042 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.024+0000 7f94c0999700 1 --2- 172.21.2.105:0/3799346871 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f94bc0ac280 0x7f94bc0ab560 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7f94bc0b0eb0 tx=0x7f94a4012000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:52.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.024+0000 7f94b9ffb700 1 -- 172.21.2.105:0/3799346871 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94a4016070 con 0x7f94bc0ac280 2021-11-12T05:47:52.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.024+0000 7f94b9ffb700 1 -- 172.21.2.105:0/3799346871 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a4002f50 con 0x7f94bc0ac280 2021-11-12T05:47:52.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.024+0000 7f94c2bfd700 1 -- 172.21.2.105:0/3799346871 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94bc0a9b40 con 0x7f94bc0ac280 2021-11-12T05:47:52.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.024+0000 7f94b9ffb700 1 -- 172.21.2.105:0/3799346871 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94a401e450 con 0x7f94bc0ac280 2021-11-12T05:47:52.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.024+0000 7f94c2bfd700 1 -- 172.21.2.105:0/3799346871 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94bc0ab050 con 0x7f94bc0ac280 2021-11-12T05:47:52.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.024+0000 7f94c2bfd700 1 -- 172.21.2.105:0/3799346871 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94bc0aabf0 con 0x7f94bc0ac280 2021-11-12T05:47:52.045 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.024+0000 7f94b9ffb700 1 -- 172.21.2.105:0/3799346871 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f94a4025030 con 0x7f94bc0ac280 2021-11-12T05:47:52.045 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.024+0000 7f94b9ffb700 1 --2- 172.21.2.105:0/3799346871 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f94a00536a0 0x7f94a0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:52.045 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.024+0000 7f94b9ffb700 1 -- 172.21.2.105:0/3799346871 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f94a406cba0 con 0x7f94bc0ac280 2021-11-12T05:47:52.046 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.024+0000 7f94bbfff700 1 --2- 172.21.2.105:0/3799346871 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f94a00536a0 0x7f94a0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:52.046 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.024+0000 7f94bbfff700 1 --2- 172.21.2.105:0/3799346871 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f94a00536a0 0x7f94a0055b60 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f94ac002f90 tx=0x7f94ac0069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:52.046 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.028+0000 7f94b9ffb700 1 -- 172.21.2.105:0/3799346871 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f94bc0aabf0 con 0x7f94bc0ac280 2021-11-12T05:47:52.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.140+0000 7f94c2bfd700 1 -- 172.21.2.105:0/3799346871 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f94bc0aabc0 con 0x7f94bc0ac280 2021-11-12T05:47:52.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.144+0000 7f94b9ffb700 1 -- 172.21.2.105:0/3799346871 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v32) v1 ==== 184+0+0 (secure 0 0 0) 0x7f94a4023070 con 0x7f94bc0ac280 2021-11-12T05:47:52.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.144+0000 7f94c2bfd700 1 -- 172.21.2.105:0/3799346871 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f94a00536a0 msgr2=0x7f94a0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:52.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.144+0000 7f94c2bfd700 1 --2- 172.21.2.105:0/3799346871 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f94a00536a0 0x7f94a0055b60 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f94ac002f90 tx=0x7f94ac0069b0).stop 2021-11-12T05:47:52.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.144+0000 7f94c2bfd700 1 -- 172.21.2.105:0/3799346871 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f94bc0ac280 msgr2=0x7f94bc0ab560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:52.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.144+0000 7f94c2bfd700 1 --2- 172.21.2.105:0/3799346871 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f94bc0ac280 0x7f94bc0ab560 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7f94bc0b0eb0 tx=0x7f94a4012000).stop 2021-11-12T05:47:52.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.144+0000 7f94c2bfd700 1 -- 172.21.2.105:0/3799346871 shutdown_connections 2021-11-12T05:47:52.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.144+0000 7f94c2bfd700 1 --2- 172.21.2.105:0/3799346871 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f94a00536a0 0x7f94a0055b60 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:52.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.144+0000 7f94c2bfd700 1 --2- 172.21.2.105:0/3799346871 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f94bc14b2f0 0x7f94bc066930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:52.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.144+0000 7f94c2bfd700 1 --2- 172.21.2.105:0/3799346871 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f94bc0ad080 0x7f94bc0aba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:52.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.144+0000 7f94c2bfd700 1 --2- 172.21.2.105:0/3799346871 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f94bc0ac280 0x7f94bc0ab560 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:52.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.144+0000 7f94c2bfd700 1 -- 172.21.2.105:0/3799346871 >> 172.21.2.105:0/3799346871 conn(0x7f94bc0b5370 msgr2=0x7f94bc14aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:52.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.144+0000 7f94c2bfd700 1 -- 172.21.2.105:0/3799346871 shutdown_connections 2021-11-12T05:47:52.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.144+0000 7f94c2bfd700 1 -- 172.21.2.105:0/3799346871 wait complete. 2021-11-12T05:47:52.153 INFO:teuthology.orchestra.run.gibba005.stderr:updated caps for client.1 2021-11-12T05:47:52.156 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-12T05:47:52.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.208+0000 7fa287501700 1 Processor -- start 2021-11-12T05:47:52.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.208+0000 7fa287501700 1 -- start start 2021-11-12T05:47:52.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.208+0000 7fa287501700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fa280062010 0x7fa2800b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:52.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.208+0000 7fa287501700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa2800b3100 0x7fa2800b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:52.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.208+0000 7fa287501700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa2800b4640 0x7fa2800b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:52.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.208+0000 7fa287501700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2800b2110 con 0x7fa2800b4640 2021-11-12T05:47:52.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.208+0000 7fa287501700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2800b4fe0 con 0x7fa280062010 2021-11-12T05:47:52.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.208+0000 7fa287501700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2800b2370 con 0x7fa2800b3100 2021-11-12T05:47:52.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.208+0000 7fa285a9e700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa2800b4640 0x7fa2800b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:52.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.208+0000 7fa285a9e700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa2800b4640 0x7fa2800b4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49084/0 (socket says 172.21.2.105:49084) 2021-11-12T05:47:52.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.208+0000 7fa285a9e700 1 -- 172.21.2.105:0/2600587158 learned_addr learned my addr 172.21.2.105:0/2600587158 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:52.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.208+0000 7fa285a9e700 1 -- 172.21.2.105:0/2600587158 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa2800b3100 msgr2=0x7fa2800b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:52.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.208+0000 7fa285a9e700 1 --2- 172.21.2.105:0/2600587158 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa2800b3100 0x7fa2800b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:52.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.208+0000 7fa285a9e700 1 -- 172.21.2.105:0/2600587158 >> v2:172.21.2.115:3300/0 conn(0x7fa280062010 msgr2=0x7fa2800b5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:52.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.208+0000 7fa285a9e700 1 --2- 172.21.2.105:0/2600587158 >> v2:172.21.2.115:3300/0 conn(0x7fa280062010 0x7fa2800b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:52.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.208+0000 7fa285a9e700 1 -- 172.21.2.105:0/2600587158 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2800b2610 con 0x7fa2800b4640 2021-11-12T05:47:52.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.208+0000 7fa285a9e700 1 --2- 172.21.2.105:0/2600587158 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa2800b4640 0x7fa2800b4af0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 rx=0x7fa2780032f0 tx=0x7fa278009290).ready entity=mon.0 client_cookie=1fabb63585e0afc0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:52.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.208+0000 7fa26ffff700 1 -- 172.21.2.105:0/2600587158 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa27800b870 con 0x7fa2800b4640 2021-11-12T05:47:52.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.208+0000 7fa26ffff700 1 -- 172.21.2.105:0/2600587158 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27800b9d0 con 0x7fa2800b4640 2021-11-12T05:47:52.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.208+0000 7fa26ffff700 1 -- 172.21.2.105:0/2600587158 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa27800bb40 con 0x7fa2800b4640 2021-11-12T05:47:52.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.208+0000 7fa287501700 1 -- 172.21.2.105:0/2600587158 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa2800b4640 msgr2=0x7fa2800b4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:52.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.208+0000 7fa287501700 1 --2- 172.21.2.105:0/2600587158 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa2800b4640 0x7fa2800b4af0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 rx=0x7fa2780032f0 tx=0x7fa278009290).stop 2021-11-12T05:47:52.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.208+0000 7fa287501700 1 -- 172.21.2.105:0/2600587158 shutdown_connections 2021-11-12T05:47:52.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.208+0000 7fa287501700 1 --2- 172.21.2.105:0/2600587158 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa2800b4640 0x7fa2800b4af0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:52.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.208+0000 7fa287501700 1 --2- 172.21.2.105:0/2600587158 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa2800b3100 0x7fa2800b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:52.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.208+0000 7fa287501700 1 --2- 172.21.2.105:0/2600587158 >> v2:172.21.2.115:3300/0 conn(0x7fa280062010 0x7fa2800b5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:52.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.208+0000 7fa287501700 1 -- 172.21.2.105:0/2600587158 >> 172.21.2.105:0/2600587158 conn(0x7fa2800b9790 msgr2=0x7fa2800b9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:52.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.208+0000 7fa287501700 1 -- 172.21.2.105:0/2600587158 shutdown_connections 2021-11-12T05:47:52.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.208+0000 7fa287501700 1 -- 172.21.2.105:0/2600587158 wait complete. 2021-11-12T05:47:52.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.208+0000 7fa287501700 1 Processor -- start 2021-11-12T05:47:52.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.208+0000 7fa287501700 1 -- start start 2021-11-12T05:47:52.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.212+0000 7fa287501700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa280062010 0x7fa2800afad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:52.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.212+0000 7fa287501700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa2800b3100 0x7fa280155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:52.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.212+0000 7fa287501700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa2800b4640 0x7fa280114f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:52.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.212+0000 7fa287501700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2801471c0 con 0x7fa2800b4640 2021-11-12T05:47:52.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.212+0000 7fa287501700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa280114ae0 con 0x7fa2800b3100 2021-11-12T05:47:52.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.212+0000 7fa287501700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa280146f20 con 0x7fa280062010 2021-11-12T05:47:52.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.212+0000 7fa285a9e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa2800b4640 0x7fa280114f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:52.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.212+0000 7fa285a9e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa2800b4640 0x7fa280114f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49090/0 (socket says 172.21.2.105:49090) 2021-11-12T05:47:52.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.212+0000 7fa285a9e700 1 -- 172.21.2.105:0/2946375926 learned_addr learned my addr 172.21.2.105:0/2946375926 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:52.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.212+0000 7fa28529d700 1 --2- 172.21.2.105:0/2946375926 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa280062010 0x7fa2800afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:52.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.212+0000 7fa284a9c700 1 --2- 172.21.2.105:0/2946375926 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa2800b3100 0x7fa280155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:52.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.212+0000 7fa285a9e700 1 -- 172.21.2.105:0/2946375926 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa280062010 msgr2=0x7fa2800afad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:52.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.212+0000 7fa285a9e700 1 --2- 172.21.2.105:0/2946375926 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa280062010 0x7fa2800afad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:52.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.212+0000 7fa285a9e700 1 -- 172.21.2.105:0/2946375926 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa2800b3100 msgr2=0x7fa280155e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:52.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.212+0000 7fa285a9e700 1 --2- 172.21.2.105:0/2946375926 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa2800b3100 0x7fa280155e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:52.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.212+0000 7fa285a9e700 1 -- 172.21.2.105:0/2946375926 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa278009530 con 0x7fa2800b4640 2021-11-12T05:47:52.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.212+0000 7fa285a9e700 1 --2- 172.21.2.105:0/2946375926 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa2800b4640 0x7fa280114f40 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7fa2780032f0 tx=0x7fa278016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:52.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.212+0000 7fa26e7fc700 1 -- 172.21.2.105:0/2946375926 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa278021620 con 0x7fa2800b4640 2021-11-12T05:47:52.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.212+0000 7fa26e7fc700 1 -- 172.21.2.105:0/2946375926 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa278021780 con 0x7fa2800b4640 2021-11-12T05:47:52.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.212+0000 7fa26e7fc700 1 -- 172.21.2.105:0/2946375926 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa278021ae0 con 0x7fa2800b4640 2021-11-12T05:47:52.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.212+0000 7fa287501700 1 -- 172.21.2.105:0/2946375926 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa280156340 con 0x7fa2800b4640 2021-11-12T05:47:52.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.212+0000 7fa287501700 1 -- 172.21.2.105:0/2946375926 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa280145b60 con 0x7fa2800b4640 2021-11-12T05:47:52.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.212+0000 7fa287501700 1 -- 172.21.2.105:0/2946375926 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2800b4330 con 0x7fa2800b4640 2021-11-12T05:47:52.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.212+0000 7fa26e7fc700 1 -- 172.21.2.105:0/2946375926 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa27800f070 con 0x7fa2800b4640 2021-11-12T05:47:52.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.212+0000 7fa26e7fc700 1 --2- 172.21.2.105:0/2946375926 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa2600536d0 0x7fa260055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:52.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.212+0000 7fa26e7fc700 1 -- 172.21.2.105:0/2946375926 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fa27806d100 con 0x7fa2800b4640 2021-11-12T05:47:52.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.212+0000 7fa28529d700 1 --2- 172.21.2.105:0/2946375926 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa2600536d0 0x7fa260055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:52.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.212+0000 7fa28529d700 1 --2- 172.21.2.105:0/2946375926 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa2600536d0 0x7fa260055b90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7fa27c00c000 tx=0x7fa27c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:52.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.216+0000 7fa26e7fc700 1 -- 172.21.2.105:0/2946375926 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa278044110 con 0x7fa2800b4640 2021-11-12T05:47:52.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.324+0000 7fa287501700 1 -- 172.21.2.105:0/2946375926 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fa280057350 con 0x7fa2800b4640 2021-11-12T05:47:52.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.332+0000 7fa26e7fc700 1 -- 172.21.2.105:0/2946375926 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v33) v1 ==== 184+0+0 (secure 0 0 0) 0x7fa278015070 con 0x7fa2800b4640 2021-11-12T05:47:52.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.332+0000 7fa287501700 1 -- 172.21.2.105:0/2946375926 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa2600536d0 msgr2=0x7fa260055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:52.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.332+0000 7fa287501700 1 --2- 172.21.2.105:0/2946375926 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa2600536d0 0x7fa260055b90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7fa27c00c000 tx=0x7fa27c008040).stop 2021-11-12T05:47:52.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.332+0000 7fa287501700 1 -- 172.21.2.105:0/2946375926 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa2800b4640 msgr2=0x7fa280114f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:52.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.332+0000 7fa287501700 1 --2- 172.21.2.105:0/2946375926 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa2800b4640 0x7fa280114f40 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7fa2780032f0 tx=0x7fa278016000).stop 2021-11-12T05:47:52.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.332+0000 7fa287501700 1 -- 172.21.2.105:0/2946375926 shutdown_connections 2021-11-12T05:47:52.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.332+0000 7fa287501700 1 --2- 172.21.2.105:0/2946375926 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa2600536d0 0x7fa260055b90 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:52.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.332+0000 7fa287501700 1 --2- 172.21.2.105:0/2946375926 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa2800b4640 0x7fa280114f40 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:52.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.332+0000 7fa287501700 1 --2- 172.21.2.105:0/2946375926 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa2800b3100 0x7fa280155e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:52.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.332+0000 7fa287501700 1 --2- 172.21.2.105:0/2946375926 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa280062010 0x7fa2800afad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:52.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.332+0000 7fa287501700 1 -- 172.21.2.105:0/2946375926 >> 172.21.2.105:0/2946375926 conn(0x7fa2800b9790 msgr2=0x7fa2801415b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:52.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.332+0000 7fa287501700 1 -- 172.21.2.105:0/2946375926 shutdown_connections 2021-11-12T05:47:52.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.332+0000 7fa287501700 1 -- 172.21.2.105:0/2946375926 wait complete. 2021-11-12T05:47:52.340 INFO:teuthology.orchestra.run.gibba005.stderr:updated caps for client.2 2021-11-12T05:47:52.343 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:47:52.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.388+0000 7f658288f700 1 Processor -- start 2021-11-12T05:47:52.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.388+0000 7f658288f700 1 -- start start 2021-11-12T05:47:52.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f658288f700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f657c0ade80 0x7f657c143670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:52.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f658288f700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f657c0604e0 con 0x7f657c143b60 2021-11-12T05:47:52.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f658288f700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f657c062ee0 con 0x7f657c060100 2021-11-12T05:47:52.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f658288f700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f657c0b1a70 con 0x7f657c0ade80 2021-11-12T05:47:52.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f6580e2c700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f657c143b60 0x7f657c140140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:59494/0 (socket says 172.21.2.105:59494) 2021-11-12T05:47:52.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f6580e2c700 1 -- 172.21.2.105:0/364838241 learned_addr learned my addr 172.21.2.105:0/364838241 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:52.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f657affd700 1 -- 172.21.2.105:0/364838241 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 537488762 0 0) 0x7f657c0604e0 con 0x7f657c143b60 2021-11-12T05:47:52.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f657affd700 1 -- 172.21.2.105:0/364838241 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f655c003260 con 0x7f657c143b60 2021-11-12T05:47:52.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f657b7fe700 1 --2- 172.21.2.105:0/364838241 >> v2:172.21.2.115:3300/0 conn(0x7f657c0ade80 0x7f657c143670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:52.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f657affd700 1 -- 172.21.2.105:0/364838241 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2346323905 0 0) 0x7f655c003260 con 0x7f657c143b60 2021-11-12T05:47:52.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f657affd700 1 -- 172.21.2.105:0/364838241 >> v2:172.21.2.115:3300/0 conn(0x7f657c0ade80 msgr2=0x7f657c143670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:52.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f657affd700 1 --2- 172.21.2.105:0/364838241 >> v2:172.21.2.115:3300/0 conn(0x7f657c0ade80 0x7f657c143670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:52.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f657affd700 1 -- 172.21.2.105:0/364838241 >> v1:172.21.2.115:6789/0 conn(0x7f657c060100 legacy=0x7f657c0b29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:52.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f657affd700 1 -- 172.21.2.105:0/364838241 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f657c063180 con 0x7f657c143b60 2021-11-12T05:47:52.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f657affd700 1 -- 172.21.2.105:0/364838241 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f65740019e0 con 0x7f657c143b60 2021-11-12T05:47:52.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f657affd700 1 -- 172.21.2.105:0/364838241 >> v1:172.21.2.105:6789/0 conn(0x7f657c143b60 legacy=0x7f657c140140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:52.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f657affd700 1 --2- 172.21.2.105:0/364838241 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f655c003750 0x7f655c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:52.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f657affd700 1 --2- 172.21.2.105:0/364838241 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f655c004500 0x7f655c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:52.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f657affd700 1 --2- 172.21.2.105:0/364838241 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f655c004ec0 0x7f655c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:52.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f657affd700 1 -- 172.21.2.105:0/364838241 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657c0b1a70 con 0x7f655c003750 2021-11-12T05:47:52.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f657affd700 1 -- 172.21.2.105:0/364838241 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655c00bda0 con 0x7f655c004ec0 2021-11-12T05:47:52.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f657affd700 1 -- 172.21.2.105:0/364838241 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f655c00bf60 con 0x7f655c004500 2021-11-12T05:47:52.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f657bfff700 1 --2- 172.21.2.105:0/364838241 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f655c003750 0x7f655c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:52.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f657bfff700 1 -- 172.21.2.105:0/364838241 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f655c004500 msgr2=0x7f655c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:52.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f6580e2c700 1 --2- 172.21.2.105:0/364838241 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f655c004ec0 0x7f655c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:52.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f657bfff700 1 --2- 172.21.2.105:0/364838241 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f655c004500 0x7f655c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:52.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f657bfff700 1 -- 172.21.2.105:0/364838241 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f655c004ec0 msgr2=0x7f655c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:52.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f657bfff700 1 --2- 172.21.2.105:0/364838241 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f655c004ec0 0x7f655c00b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:52.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f657bfff700 1 -- 172.21.2.105:0/364838241 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f655c003260 con 0x7f655c003750 2021-11-12T05:47:52.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f6580e2c700 1 -- 172.21.2.105:0/364838241 reap_dead start 2021-11-12T05:47:52.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f657bfff700 1 --2- 172.21.2.105:0/364838241 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f655c003750 0x7f655c003b70 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 rx=0x7f657c0b85e0 tx=0x7f6564007a00).ready entity=mon.0 client_cookie=39f2074d19b383a4 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:52.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f657affd700 1 -- 172.21.2.105:0/364838241 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6564007d10 con 0x7f655c003750 2021-11-12T05:47:52.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f657affd700 1 -- 172.21.2.105:0/364838241 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6564007030 con 0x7f655c003750 2021-11-12T05:47:52.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f657affd700 1 -- 172.21.2.105:0/364838241 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6564007390 con 0x7f655c003750 2021-11-12T05:47:52.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f658288f700 1 -- 172.21.2.105:0/364838241 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f655c003750 msgr2=0x7f655c003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:52.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f658288f700 1 --2- 172.21.2.105:0/364838241 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f655c003750 0x7f655c003b70 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 rx=0x7f657c0b85e0 tx=0x7f6564007a00).stop 2021-11-12T05:47:52.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f658288f700 1 -- 172.21.2.105:0/364838241 shutdown_connections 2021-11-12T05:47:52.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f658288f700 1 --2- 172.21.2.105:0/364838241 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f655c003750 0x7f655c003b70 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:52.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f658288f700 1 -- 172.21.2.105:0/364838241 >> 172.21.2.105:0/364838241 conn(0x7f657c0608d0 msgr2=0x7f657c05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:52.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f658288f700 1 -- 172.21.2.105:0/364838241 shutdown_connections 2021-11-12T05:47:52.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f658288f700 1 -- 172.21.2.105:0/364838241 wait complete. 2021-11-12T05:47:52.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f658288f700 1 Processor -- start 2021-11-12T05:47:52.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f658288f700 1 -- start start 2021-11-12T05:47:52.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f658288f700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f655c003750 0x7f657c065790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:52.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f658288f700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f657c0af940 0x7f657c155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:52.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f658288f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f657c156070 0x7f657c1564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:52.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f658288f700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657c13cf70 con 0x7f657c0af940 2021-11-12T05:47:52.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f658288f700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657c1569e0 con 0x7f655c003750 2021-11-12T05:47:52.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f658288f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f657c152c50 con 0x7f657c156070 2021-11-12T05:47:52.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f657b7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f657c0af940 0x7f657c155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:52.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f657b7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f657c0af940 0x7f657c155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49112/0 (socket says 172.21.2.105:49112) 2021-11-12T05:47:52.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f657b7fe700 1 -- 172.21.2.105:0/2279338451 learned_addr learned my addr 172.21.2.105:0/2279338451 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:52.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f657b7fe700 1 -- 172.21.2.105:0/2279338451 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f657c156070 msgr2=0x7f657c1564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:52.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f657b7fe700 1 --2- 172.21.2.105:0/2279338451 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f657c156070 0x7f657c1564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:52.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f657b7fe700 1 -- 172.21.2.105:0/2279338451 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f655c003750 msgr2=0x7f657c065790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:52.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f657b7fe700 1 --2- 172.21.2.105:0/2279338451 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f655c003750 0x7f657c065790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:52.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.392+0000 7f657b7fe700 1 -- 172.21.2.105:0/2279338451 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f657c152ef0 con 0x7f657c0af940 2021-11-12T05:47:52.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.396+0000 7f657b7fe700 1 --2- 172.21.2.105:0/2279338451 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f657c0af940 0x7f657c155b80 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7f657c153510 tx=0x7f656c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:52.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.396+0000 7f65797fa700 1 -- 172.21.2.105:0/2279338451 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f656c016070 con 0x7f657c0af940 2021-11-12T05:47:52.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.396+0000 7f65797fa700 1 -- 172.21.2.105:0/2279338451 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656c000e90 con 0x7f657c0af940 2021-11-12T05:47:52.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.396+0000 7f658288f700 1 -- 172.21.2.105:0/2279338451 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f657c153190 con 0x7f657c0af940 2021-11-12T05:47:52.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.396+0000 7f65797fa700 1 -- 172.21.2.105:0/2279338451 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f656c011970 con 0x7f657c0af940 2021-11-12T05:47:52.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.396+0000 7f658288f700 1 -- 172.21.2.105:0/2279338451 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f657c066a10 con 0x7f657c0af940 2021-11-12T05:47:52.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.396+0000 7f658288f700 1 -- 172.21.2.105:0/2279338451 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f657c0afdc0 con 0x7f657c0af940 2021-11-12T05:47:52.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.396+0000 7f65797fa700 1 -- 172.21.2.105:0/2279338451 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f656c011ad0 con 0x7f657c0af940 2021-11-12T05:47:52.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.396+0000 7f65797fa700 1 --2- 172.21.2.105:0/2279338451 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6560053610 0x7f6560055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:52.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.396+0000 7f65797fa700 1 -- 172.21.2.105:0/2279338451 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f656c06b940 con 0x7f657c0af940 2021-11-12T05:47:52.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.396+0000 7f657bfff700 1 --2- 172.21.2.105:0/2279338451 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6560053610 0x7f6560055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:52.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.396+0000 7f657bfff700 1 --2- 172.21.2.105:0/2279338451 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6560053610 0x7f6560055ad0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f657c0b85e0 tx=0x7f6564015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:52.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.396+0000 7f65797fa700 1 -- 172.21.2.105:0/2279338451 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f656c042950 con 0x7f657c0af940 2021-11-12T05:47:52.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.508+0000 7f658288f700 1 -- 172.21.2.105:0/2279338451 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f657c153320 con 0x7f657c0af940 2021-11-12T05:47:52.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.508+0000 7f65797fa700 1 -- 172.21.2.105:0/2279338451 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f656c045f70 con 0x7f657c0af940 2021-11-12T05:47:52.515 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:52.515 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":44,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4751,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/3227424218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":3227424218},{"type":"v1","addr":"172.21.2.115:6833","nonce":3227424218}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":43}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:47:50.427589+0000","modified":"2021-11-12T05:47:51.432486+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7017":{"gid":7017,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/3298879485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":3298879485},{"type":"v1","addr":"172.21.2.105:6835","nonce":3298879485}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-11-12T05:47:52.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.512+0000 7f658288f700 1 -- 172.21.2.105:0/2279338451 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6560053610 msgr2=0x7f6560055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:52.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.512+0000 7f658288f700 1 --2- 172.21.2.105:0/2279338451 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6560053610 0x7f6560055ad0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f657c0b85e0 tx=0x7f6564015000).stop 2021-11-12T05:47:52.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.512+0000 7f658288f700 1 -- 172.21.2.105:0/2279338451 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f657c0af940 msgr2=0x7f657c155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:52.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.512+0000 7f658288f700 1 --2- 172.21.2.105:0/2279338451 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f657c0af940 0x7f657c155b80 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7f657c153510 tx=0x7f656c008040).stop 2021-11-12T05:47:52.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.512+0000 7f658288f700 1 -- 172.21.2.105:0/2279338451 shutdown_connections 2021-11-12T05:47:52.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.512+0000 7f658288f700 1 --2- 172.21.2.105:0/2279338451 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6560053610 0x7f6560055ad0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:52.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.512+0000 7f658288f700 1 --2- 172.21.2.105:0/2279338451 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f657c156070 0x7f657c1564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:52.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.512+0000 7f658288f700 1 --2- 172.21.2.105:0/2279338451 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f657c0af940 0x7f657c155b80 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:52.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.512+0000 7f658288f700 1 --2- 172.21.2.105:0/2279338451 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f655c003750 0x7f657c065790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:52.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.512+0000 7f658288f700 1 -- 172.21.2.105:0/2279338451 >> 172.21.2.105:0/2279338451 conn(0x7f657c0608d0 msgr2=0x7f657c13f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:52.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.512+0000 7f658288f700 1 -- 172.21.2.105:0/2279338451 shutdown_connections 2021-11-12T05:47:52.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.512+0000 7f658288f700 1 -- 172.21.2.105:0/2279338451 wait complete. 2021-11-12T05:47:52.519 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 44 2021-11-12T05:47:52.723 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 44, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:47:50.427589+0000', 'modified': '2021-11-12T05:47:51.432486+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7017}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7017': {'gid': 7017, 'name': 'a', 'rank': 0, 'incarnation': 43, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/3298879485', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 3298879485}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 3298879485}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:47:52.727 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:47:52.727 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:47:52.796 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":7017,"want_state":"up:active","state":"up:active","rank_uptime":2.3606062329999999,"mdsmap_epoch":44,"osdmap_epoch":97,"osdmap_epoch_barrier":96,"uptime":6.5852545600000001} 2021-11-12T05:47:52.796 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 7017, "mdsmap_epoch": 44, "osdmap_epoch": 97, "osdmap_epoch_barrier": 96, "rank_uptime": 2.360606233, "state": "up:active", "uptime": 6.58525456, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:47:52.797 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:47:52.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.844+0000 7ff6085ab700 1 Processor -- start 2021-11-12T05:47:52.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.844+0000 7ff6085ab700 1 -- start start 2021-11-12T05:47:52.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.844+0000 7ff6085ab700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff6000ade80 0x7ff6000601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:52.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.844+0000 7ff6085ab700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff60013a9c0 0x7ff60013ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:52.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.844+0000 7ff6085ab700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff600066150 con 0x7ff60005fdc0 2021-11-12T05:47:52.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.844+0000 7ff6085ab700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff600141fb0 con 0x7ff6000ade80 2021-11-12T05:47:52.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.844+0000 7ff6085ab700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6000663f0 con 0x7ff60013a9c0 2021-11-12T05:47:52.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.844+0000 7ff605b46700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff6000ade80 0x7ff6000601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:52.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.844+0000 7ff605b46700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff6000ade80 0x7ff6000601a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49120/0 (socket says 172.21.2.105:49120) 2021-11-12T05:47:52.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.844+0000 7ff605b46700 1 -- 172.21.2.105:0/2560930935 learned_addr learned my addr 172.21.2.105:0/2560930935 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:52.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.844+0000 7ff605b46700 1 -- 172.21.2.105:0/2560930935 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff60013a9c0 msgr2=0x7ff60013ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:52.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.844+0000 7ff605b46700 1 --2- 172.21.2.105:0/2560930935 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff60013a9c0 0x7ff60013ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:52.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.844+0000 7ff605b46700 1 -- 172.21.2.105:0/2560930935 >> v1:172.21.2.115:6789/0 conn(0x7ff60005fdc0 legacy=0x7ff600066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:52.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.844+0000 7ff605b46700 1 -- 172.21.2.105:0/2560930935 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff600140fd0 con 0x7ff6000ade80 2021-11-12T05:47:52.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.844+0000 7ff605b46700 1 --2- 172.21.2.105:0/2560930935 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff6000ade80 0x7ff6000601a0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7ff600060e00 tx=0x7ff5f8009290).ready entity=mon.0 client_cookie=6dd5653ef2803a1e server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:52.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.844+0000 7ff605345700 1 -- 172.21.2.105:0/2560930935 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5f800b860 con 0x7ff6000ade80 2021-11-12T05:47:52.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.844+0000 7ff605345700 1 -- 172.21.2.105:0/2560930935 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f800b9c0 con 0x7ff6000ade80 2021-11-12T05:47:52.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.844+0000 7ff605345700 1 -- 172.21.2.105:0/2560930935 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5f800bb70 con 0x7ff6000ade80 2021-11-12T05:47:52.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.844+0000 7ff6085ab700 1 -- 172.21.2.105:0/2560930935 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff6000ade80 msgr2=0x7ff6000601a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:52.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.844+0000 7ff6085ab700 1 --2- 172.21.2.105:0/2560930935 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff6000ade80 0x7ff6000601a0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7ff600060e00 tx=0x7ff5f8009290).stop 2021-11-12T05:47:52.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.844+0000 7ff6085ab700 1 -- 172.21.2.105:0/2560930935 shutdown_connections 2021-11-12T05:47:52.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.844+0000 7ff6085ab700 1 --2- 172.21.2.105:0/2560930935 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff60013a9c0 0x7ff60013ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:52.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.844+0000 7ff6085ab700 1 --2- 172.21.2.105:0/2560930935 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff6000ade80 0x7ff6000601a0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:52.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.844+0000 7ff6085ab700 1 -- 172.21.2.105:0/2560930935 >> 172.21.2.105:0/2560930935 conn(0x7ff6000608d0 msgr2=0x7ff60005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:52.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.844+0000 7ff6085ab700 1 -- 172.21.2.105:0/2560930935 shutdown_connections 2021-11-12T05:47:52.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.844+0000 7ff6085ab700 1 -- 172.21.2.105:0/2560930935 wait complete. 2021-11-12T05:47:52.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.844+0000 7ff6085ab700 1 Processor -- start 2021-11-12T05:47:52.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.844+0000 7ff6085ab700 1 -- start start 2021-11-12T05:47:52.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.844+0000 7ff6085ab700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff60005fdc0 0x7ff600142540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:52.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.844+0000 7ff6085ab700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff6000ade80 0x7ff600143ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:52.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.844+0000 7ff6085ab700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff60013a9c0 0x7ff600143fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:52.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.844+0000 7ff6085ab700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6000b6840 con 0x7ff60005fdc0 2021-11-12T05:47:52.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.844+0000 7ff6085ab700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff600144c50 con 0x7ff60013a9c0 2021-11-12T05:47:52.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.844+0000 7ff6085ab700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6001450f0 con 0x7ff6000ade80 2021-11-12T05:47:52.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.848+0000 7ff606347700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff60005fdc0 0x7ff600142540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:52.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.848+0000 7ff606347700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff60005fdc0 0x7ff600142540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49126/0 (socket says 172.21.2.105:49126) 2021-11-12T05:47:52.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.848+0000 7ff606347700 1 -- 172.21.2.105:0/2036338813 learned_addr learned my addr 172.21.2.105:0/2036338813 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:52.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.848+0000 7ff606347700 1 -- 172.21.2.105:0/2036338813 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff6000ade80 msgr2=0x7ff600143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:52.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.848+0000 7ff606347700 1 --2- 172.21.2.105:0/2036338813 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff6000ade80 0x7ff600143ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:52.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.848+0000 7ff606347700 1 -- 172.21.2.105:0/2036338813 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff60013a9c0 msgr2=0x7ff600143fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:52.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.848+0000 7ff606347700 1 --2- 172.21.2.105:0/2036338813 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff60013a9c0 0x7ff600143fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:52.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.848+0000 7ff606347700 1 -- 172.21.2.105:0/2036338813 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f8009530 con 0x7ff60005fdc0 2021-11-12T05:47:52.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.848+0000 7ff606347700 1 --2- 172.21.2.105:0/2036338813 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff60005fdc0 0x7ff600142540 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 rx=0x7ff5f0002f90 tx=0x7ff5f0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:52.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.848+0000 7ff5ef7fe700 1 -- 172.21.2.105:0/2036338813 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5f0013460 con 0x7ff60005fdc0 2021-11-12T05:47:52.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.848+0000 7ff5ef7fe700 1 -- 172.21.2.105:0/2036338813 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f00135c0 con 0x7ff60005fdc0 2021-11-12T05:47:52.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.848+0000 7ff5ef7fe700 1 -- 172.21.2.105:0/2036338813 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5f0013920 con 0x7ff60005fdc0 2021-11-12T05:47:52.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.848+0000 7ff6085ab700 1 -- 172.21.2.105:0/2036338813 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6000b7900 con 0x7ff60005fdc0 2021-11-12T05:47:52.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.848+0000 7ff6085ab700 1 -- 172.21.2.105:0/2036338813 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6000b6570 con 0x7ff60005fdc0 2021-11-12T05:47:52.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.848+0000 7ff6085ab700 1 -- 172.21.2.105:0/2036338813 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6000b6a40 con 0x7ff60005fdc0 2021-11-12T05:47:52.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.848+0000 7ff5ef7fe700 1 -- 172.21.2.105:0/2036338813 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff5f000f070 con 0x7ff60005fdc0 2021-11-12T05:47:52.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.848+0000 7ff5ef7fe700 1 --2- 172.21.2.105:0/2036338813 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff5e00534f0 0x7ff5e00559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:52.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.848+0000 7ff5ef7fe700 1 -- 172.21.2.105:0/2036338813 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6416+0+0 (secure 0 0 0) 0x7ff5f006b280 con 0x7ff60005fdc0 2021-11-12T05:47:52.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.848+0000 7ff605b46700 1 --2- 172.21.2.105:0/2036338813 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff5e00534f0 0x7ff5e00559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:52.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.848+0000 7ff605b46700 1 --2- 172.21.2.105:0/2036338813 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff5e00534f0 0x7ff5e00559b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7ff600060e00 tx=0x7ff5f8016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:52.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.852+0000 7ff5ef7fe700 1 -- 172.21.2.105:0/2036338813 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff5f0042180 con 0x7ff60005fdc0 2021-11-12T05:47:52.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.932+0000 7ff6085ab700 1 -- 172.21.2.105:0/2036338813 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6000b6570 con 0x7ff60005fdc0 2021-11-12T05:47:52.938 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.932+0000 7ff5ef7fe700 1 -- 172.21.2.105:0/2036338813 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+16274 (secure 0 0 0) 0x7ff6000b6570 con 0x7ff60005fdc0 2021-11-12T05:47:52.938 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:52.938 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":97,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:47:52.445451+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:47:48.259327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-11-12T05:47:49.399624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:47:52.939 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.936+0000 7ff6085ab700 1 -- 172.21.2.105:0/2036338813 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff5e00534f0 msgr2=0x7ff5e00559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:52.940 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.936+0000 7ff6085ab700 1 --2- 172.21.2.105:0/2036338813 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff5e00534f0 0x7ff5e00559b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7ff600060e00 tx=0x7ff5f8016000).stop 2021-11-12T05:47:52.940 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.936+0000 7ff6085ab700 1 -- 172.21.2.105:0/2036338813 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff60005fdc0 msgr2=0x7ff600142540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:52.940 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.936+0000 7ff6085ab700 1 --2- 172.21.2.105:0/2036338813 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff60005fdc0 0x7ff600142540 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 rx=0x7ff5f0002f90 tx=0x7ff5f0006df0).stop 2021-11-12T05:47:52.940 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.936+0000 7ff6085ab700 1 -- 172.21.2.105:0/2036338813 shutdown_connections 2021-11-12T05:47:52.940 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.936+0000 7ff6085ab700 1 --2- 172.21.2.105:0/2036338813 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff5e00534f0 0x7ff5e00559b0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:52.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.936+0000 7ff6085ab700 1 --2- 172.21.2.105:0/2036338813 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff60013a9c0 0x7ff600143fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:52.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.936+0000 7ff6085ab700 1 --2- 172.21.2.105:0/2036338813 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff6000ade80 0x7ff600143ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:52.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.936+0000 7ff6085ab700 1 --2- 172.21.2.105:0/2036338813 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff60005fdc0 0x7ff600142540 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:52.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.936+0000 7ff6085ab700 1 -- 172.21.2.105:0/2036338813 >> 172.21.2.105:0/2036338813 conn(0x7ff6000608d0 msgr2=0x7ff600139e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:52.942 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.936+0000 7ff6085ab700 1 -- 172.21.2.105:0/2036338813 shutdown_connections 2021-11-12T05:47:52.942 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.936+0000 7ff6085ab700 1 -- 172.21.2.105:0/2036338813 wait complete. 2021-11-12T05:47:52.946 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-12T05:47:48.259327+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '96', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2021-11-12T05:47:49.399624+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-12T05:47:52.946 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:47:52.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.992+0000 7f38bbcea700 1 Processor -- start 2021-11-12T05:47:52.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.992+0000 7f38bbcea700 1 -- start start 2021-11-12T05:47:53.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38bbcea700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f38b40b0520 0x7f38b4144890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:53.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38bbcea700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38b40b1840 con 0x7f38b40ace20 2021-11-12T05:47:53.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38bbcea700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38b40af2b0 con 0x7f38b40aca40 2021-11-12T05:47:53.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38bbcea700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38b40b0990 con 0x7f38b40b0520 2021-11-12T05:47:53.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38b9285700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f38b40ace20 0x7f38b4144180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:59530/0 (socket says 172.21.2.105:59530) 2021-11-12T05:47:53.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38b9285700 1 -- 172.21.2.105:0/787592008 learned_addr learned my addr 172.21.2.105:0/787592008 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:53.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38ba287700 1 --2- 172.21.2.105:0/787592008 >> v2:172.21.2.105:3300/0 conn(0x7f38b40b0520 0x7f38b4144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:53.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38b8a84700 1 -- 172.21.2.105:0/787592008 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2518976701 0 0) 0x7f38b40b1840 con 0x7f38b40ace20 2021-11-12T05:47:53.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38b8a84700 1 -- 172.21.2.105:0/787592008 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f389c003260 con 0x7f38b40ace20 2021-11-12T05:47:53.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38b8a84700 1 -- 172.21.2.105:0/787592008 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4243077103 0 0) 0x7f389c003260 con 0x7f38b40ace20 2021-11-12T05:47:53.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38ba287700 1 -- 172.21.2.105:0/787592008 >> v1:172.21.2.115:6789/0 conn(0x7f38b40aca40 legacy=0x7f38b41473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:53.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38ba287700 1 -- 172.21.2.105:0/787592008 >> v1:172.21.2.105:6789/0 conn(0x7f38b40ace20 legacy=0x7f38b4144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:53.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38ba287700 1 -- 172.21.2.105:0/787592008 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b4144d80 con 0x7f38b40b0520 2021-11-12T05:47:53.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38ba287700 1 --2- 172.21.2.105:0/787592008 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f38b40b0520 0x7f38b4144890 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7f38a4001800 tx=0x7f38ac0091d0).ready entity=mon.0 client_cookie=edf6953977a75559 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:53.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38b8a84700 1 -- 172.21.2.105:0/787592008 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38a4001660 con 0x7f38b40b0520 2021-11-12T05:47:53.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38b8a84700 1 -- 172.21.2.105:0/787592008 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38ac00b580 con 0x7f38b40b0520 2021-11-12T05:47:53.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38b8a84700 1 -- 172.21.2.105:0/787592008 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38ac00b6f0 con 0x7f38b40b0520 2021-11-12T05:47:53.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38bbcea700 1 -- 172.21.2.105:0/787592008 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f38b40b0520 msgr2=0x7f38b4144890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:53.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38bbcea700 1 --2- 172.21.2.105:0/787592008 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f38b40b0520 0x7f38b4144890 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7f38a4001800 tx=0x7f38ac0091d0).stop 2021-11-12T05:47:53.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38bbcea700 1 -- 172.21.2.105:0/787592008 shutdown_connections 2021-11-12T05:47:53.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38bbcea700 1 --2- 172.21.2.105:0/787592008 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f38b40b0520 0x7f38b4144890 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:53.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38bbcea700 1 -- 172.21.2.105:0/787592008 >> 172.21.2.105:0/787592008 conn(0x7f38b405c490 msgr2=0x7f38b40b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:53.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38bbcea700 1 -- 172.21.2.105:0/787592008 shutdown_connections 2021-11-12T05:47:53.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38bbcea700 1 -- 172.21.2.105:0/787592008 wait complete. 2021-11-12T05:47:53.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38bbcea700 1 Processor -- start 2021-11-12T05:47:53.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38bbcea700 1 -- start start 2021-11-12T05:47:53.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38bbcea700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f38b40aca40 0x7f38b40a9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:53.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38bbcea700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f38b40ace20 0x7f38b4143170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:53.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38bbcea700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f38b40b0520 0x7f38b40ab140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:53.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38bbcea700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b4144f70 con 0x7f38b40aca40 2021-11-12T05:47:53.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38bbcea700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b4157320 con 0x7f38b40ace20 2021-11-12T05:47:53.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38bbcea700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b41575c0 con 0x7f38b40b0520 2021-11-12T05:47:53.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38b9a86700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f38b40aca40 0x7f38b40a9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:53.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38b9a86700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f38b40aca40 0x7f38b40a9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49138/0 (socket says 172.21.2.105:49138) 2021-11-12T05:47:53.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38b9a86700 1 -- 172.21.2.105:0/874068726 learned_addr learned my addr 172.21.2.105:0/874068726 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:53.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38b9285700 1 --2- 172.21.2.105:0/874068726 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f38b40ace20 0x7f38b4143170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:53.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38ba287700 1 --2- 172.21.2.105:0/874068726 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f38b40b0520 0x7f38b40ab140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:53.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38b9a86700 1 -- 172.21.2.105:0/874068726 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f38b40b0520 msgr2=0x7f38b40ab140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:53.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38b9a86700 1 --2- 172.21.2.105:0/874068726 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f38b40b0520 0x7f38b40ab140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:53.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38b9a86700 1 -- 172.21.2.105:0/874068726 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f38b40ace20 msgr2=0x7f38b4143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:53.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38b9a86700 1 --2- 172.21.2.105:0/874068726 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f38b40ace20 0x7f38b4143170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:53.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38b9a86700 1 -- 172.21.2.105:0/874068726 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ac009470 con 0x7f38b40aca40 2021-11-12T05:47:53.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38b9285700 1 --2- 172.21.2.105:0/874068726 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f38b40ace20 0x7f38b4143170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:47:53.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38b9a86700 1 --2- 172.21.2.105:0/874068726 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f38b40aca40 0x7f38b40a9e30 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 rx=0x7f38b0002f90 tx=0x7f38b0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:53.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38a2ffd700 1 -- 172.21.2.105:0/874068726 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38b0013460 con 0x7f38b40aca40 2021-11-12T05:47:53.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38a2ffd700 1 -- 172.21.2.105:0/874068726 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b00135c0 con 0x7f38b40aca40 2021-11-12T05:47:53.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38bbcea700 1 -- 172.21.2.105:0/874068726 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38b40aaca0 con 0x7f38b40aca40 2021-11-12T05:47:53.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38a2ffd700 1 -- 172.21.2.105:0/874068726 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38b0013920 con 0x7f38b40aca40 2021-11-12T05:47:53.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:52.996+0000 7f38bbcea700 1 -- 172.21.2.105:0/874068726 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38b4156e20 con 0x7f38b40aca40 2021-11-12T05:47:53.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.000+0000 7f38bbcea700 1 -- 172.21.2.105:0/874068726 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38b4157130 con 0x7f38b40aca40 2021-11-12T05:47:53.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.000+0000 7f38a2ffd700 1 -- 172.21.2.105:0/874068726 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f38b001a060 con 0x7f38b40aca40 2021-11-12T05:47:53.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.000+0000 7f38a2ffd700 1 --2- 172.21.2.105:0/874068726 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3894053580 0x7f3894055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:53.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.000+0000 7f38a2ffd700 1 -- 172.21.2.105:0/874068726 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f38b006b410 con 0x7f38b40aca40 2021-11-12T05:47:53.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.000+0000 7f38b9285700 1 --2- 172.21.2.105:0/874068726 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3894053580 0x7f3894055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:53.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.000+0000 7f38b9285700 1 --2- 172.21.2.105:0/874068726 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3894053580 0x7f3894055a40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f38a400b000 tx=0x7f38a40019b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:53.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.000+0000 7f38a2ffd700 1 -- 172.21.2.105:0/874068726 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f38b0042420 con 0x7f38b40aca40 2021-11-12T05:47:53.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.084+0000 7f38bbcea700 1 -- 172.21.2.105:0/874068726 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f38b4157730 con 0x7f38b40aca40 2021-11-12T05:47:53.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.084+0000 7f38a2ffd700 1 -- 172.21.2.105:0/874068726 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v97) v1 ==== 110+0+10 (secure 0 0 0) 0x7f38b0018020 con 0x7f38b40aca40 2021-11-12T05:47:53.091 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:47:53.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.088+0000 7f38bbcea700 1 -- 172.21.2.105:0/874068726 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3894053580 msgr2=0x7f3894055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:53.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.088+0000 7f38bbcea700 1 --2- 172.21.2.105:0/874068726 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3894053580 0x7f3894055a40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f38a400b000 tx=0x7f38a40019b0).stop 2021-11-12T05:47:53.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.088+0000 7f38bbcea700 1 -- 172.21.2.105:0/874068726 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f38b40aca40 msgr2=0x7f38b40a9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:53.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.088+0000 7f38bbcea700 1 --2- 172.21.2.105:0/874068726 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f38b40aca40 0x7f38b40a9e30 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 rx=0x7f38b0002f90 tx=0x7f38b0006df0).stop 2021-11-12T05:47:53.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.088+0000 7f38bbcea700 1 -- 172.21.2.105:0/874068726 shutdown_connections 2021-11-12T05:47:53.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.088+0000 7f38bbcea700 1 --2- 172.21.2.105:0/874068726 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3894053580 0x7f3894055a40 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:53.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.088+0000 7f38bbcea700 1 --2- 172.21.2.105:0/874068726 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f38b40b0520 0x7f38b40ab140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:53.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.088+0000 7f38bbcea700 1 --2- 172.21.2.105:0/874068726 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f38b40ace20 0x7f38b4143170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:53.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.088+0000 7f38bbcea700 1 --2- 172.21.2.105:0/874068726 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f38b40aca40 0x7f38b40a9e30 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:53.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.088+0000 7f38bbcea700 1 -- 172.21.2.105:0/874068726 >> 172.21.2.105:0/874068726 conn(0x7f38b405c490 msgr2=0x7f38b40b1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:53.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.088+0000 7f38bbcea700 1 -- 172.21.2.105:0/874068726 shutdown_connections 2021-11-12T05:47:53.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.088+0000 7f38bbcea700 1 -- 172.21.2.105:0/874068726 wait complete. 2021-11-12T05:47:53.098 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:47:53.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa108b77700 1 Processor -- start 2021-11-12T05:47:53.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa108b77700 1 -- start start 2021-11-12T05:47:53.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa108b77700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1040b2e20 0x7fa1040b1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:53.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa108b77700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fa10405c490 0x7fa104142c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:53.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa108b77700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1040ad400 con 0x7fa10413ea50 2021-11-12T05:47:53.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa108b77700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1040b3200 con 0x7fa10405c490 2021-11-12T05:47:53.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa108b77700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1040ad660 con 0x7fa1040b2e20 2021-11-12T05:47:53.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa101d9b700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fa10413ea50 0x7fa10413ee90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:59544/0 (socket says 172.21.2.105:59544) 2021-11-12T05:47:53.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa101d9b700 1 -- 172.21.2.105:0/3936132120 learned_addr learned my addr 172.21.2.105:0/3936132120 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:53.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa10159a700 1 -- 172.21.2.105:0/3936132120 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3975909850 0 0) 0x7fa1040ad400 con 0x7fa10413ea50 2021-11-12T05:47:53.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa10159a700 1 -- 172.21.2.105:0/3936132120 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0e4003260 con 0x7fa10413ea50 2021-11-12T05:47:53.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa102d9d700 1 --2- 172.21.2.105:0/3936132120 >> v2:172.21.2.115:3300/0 conn(0x7fa10405c490 0x7fa104142c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:53.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa10259c700 1 --2- 172.21.2.105:0/3936132120 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1040b2e20 0x7fa1040b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:53.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa10159a700 1 -- 172.21.2.105:0/3936132120 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3538946675 0 0) 0x7fa0e4003260 con 0x7fa10413ea50 2021-11-12T05:47:53.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa10159a700 1 -- 172.21.2.105:0/3936132120 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1040b2e20 msgr2=0x7fa1040b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:53.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa10159a700 1 --2- 172.21.2.105:0/3936132120 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1040b2e20 0x7fa1040b1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:53.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa10159a700 1 -- 172.21.2.105:0/3936132120 >> v2:172.21.2.115:3300/0 conn(0x7fa10405c490 msgr2=0x7fa104142c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:53.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa10159a700 1 --2- 172.21.2.105:0/3936132120 >> v2:172.21.2.115:3300/0 conn(0x7fa10405c490 0x7fa104142c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:53.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa10159a700 1 -- 172.21.2.105:0/3936132120 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1040ad900 con 0x7fa10413ea50 2021-11-12T05:47:53.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa10159a700 1 -- 172.21.2.105:0/3936132120 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fa0f4001680 con 0x7fa10413ea50 2021-11-12T05:47:53.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa10159a700 1 -- 172.21.2.105:0/3936132120 >> v1:172.21.2.105:6789/0 conn(0x7fa10413ea50 legacy=0x7fa10413ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:53.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa10159a700 1 --2- 172.21.2.105:0/3936132120 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1040b2e20 0x7fa0e40037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:53.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa10159a700 1 --2- 172.21.2.105:0/3936132120 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa0e4003e00 0x7fa0e4004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:53.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa10159a700 1 --2- 172.21.2.105:0/3936132120 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa0e40049f0 0x7fa0e4004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:53.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa10159a700 1 -- 172.21.2.105:0/3936132120 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1040b3200 con 0x7fa0e40049f0 2021-11-12T05:47:53.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa10159a700 1 -- 172.21.2.105:0/3936132120 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1040ad660 con 0x7fa0e4003e00 2021-11-12T05:47:53.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa10159a700 1 -- 172.21.2.105:0/3936132120 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e400b8e0 con 0x7fa1040b2e20 2021-11-12T05:47:53.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa102d9d700 1 --2- 172.21.2.105:0/3936132120 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa0e40049f0 0x7fa0e4004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:53.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa102d9d700 1 -- 172.21.2.105:0/3936132120 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1040b2e20 msgr2=0x7fa0e40037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:53.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa102d9d700 1 --2- 172.21.2.105:0/3936132120 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1040b2e20 0x7fa0e40037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:53.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa102d9d700 1 -- 172.21.2.105:0/3936132120 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa0e4003e00 msgr2=0x7fa0e4004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:53.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa102d9d700 1 --2- 172.21.2.105:0/3936132120 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa0e4003e00 0x7fa0e4004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:53.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa102d9d700 1 -- 172.21.2.105:0/3936132120 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e4003260 con 0x7fa0e40049f0 2021-11-12T05:47:53.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa102d9d700 1 --2- 172.21.2.105:0/3936132120 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa0e40049f0 0x7fa0e4004e70 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 rx=0x7fa0fc00a000 tx=0x7fa0fc008040).ready entity=mon.0 client_cookie=5a2772603eefd478 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:53.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa10159a700 1 -- 172.21.2.105:0/3936132120 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0fc00c070 con 0x7fa0e40049f0 2021-11-12T05:47:53.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa10159a700 1 -- 172.21.2.105:0/3936132120 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0fc00e5f0 con 0x7fa0e40049f0 2021-11-12T05:47:53.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa10159a700 1 -- 172.21.2.105:0/3936132120 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0fc00e950 con 0x7fa0e40049f0 2021-11-12T05:47:53.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa108b77700 1 -- 172.21.2.105:0/3936132120 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa0e40049f0 msgr2=0x7fa0e4004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:53.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa108b77700 1 --2- 172.21.2.105:0/3936132120 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa0e40049f0 0x7fa0e4004e70 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 rx=0x7fa0fc00a000 tx=0x7fa0fc008040).stop 2021-11-12T05:47:53.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa102d9d700 1 -- 172.21.2.105:0/3936132120 reap_dead start 2021-11-12T05:47:53.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa108b77700 1 -- 172.21.2.105:0/3936132120 shutdown_connections 2021-11-12T05:47:53.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa108b77700 1 -- 172.21.2.105:0/3936132120 >> 172.21.2.105:0/3936132120 conn(0x7fa104062f60 msgr2=0x7fa104063370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:53.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa108b77700 1 -- 172.21.2.105:0/3936132120 shutdown_connections 2021-11-12T05:47:53.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa108b77700 1 -- 172.21.2.105:0/3936132120 wait complete. 2021-11-12T05:47:53.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa108b77700 1 Processor -- start 2021-11-12T05:47:53.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.148+0000 7fa108b77700 1 -- start start 2021-11-12T05:47:53.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.152+0000 7fa108b77700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa0e40049f0 0x7fa104126e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:53.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.152+0000 7fa108b77700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1040ab8e0 0x7fa1040abd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:53.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.152+0000 7fa108b77700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa1040ac230 0x7fa1040b3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:53.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.152+0000 7fa108b77700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa104127630 con 0x7fa0e40049f0 2021-11-12T05:47:53.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.152+0000 7fa108b77700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1040a9f40 con 0x7fa1040ac230 2021-11-12T05:47:53.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.152+0000 7fa108b77700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa104127340 con 0x7fa1040ab8e0 2021-11-12T05:47:53.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.152+0000 7fa10259c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa0e40049f0 0x7fa104126e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:53.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.152+0000 7fa10259c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa0e40049f0 0x7fa104126e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49156/0 (socket says 172.21.2.105:49156) 2021-11-12T05:47:53.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.152+0000 7fa10259c700 1 -- 172.21.2.105:0/3008064865 learned_addr learned my addr 172.21.2.105:0/3008064865 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:53.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.152+0000 7fa10259c700 1 -- 172.21.2.105:0/3008064865 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1040ab8e0 msgr2=0x7fa1040abd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:53.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.152+0000 7fa10259c700 1 --2- 172.21.2.105:0/3008064865 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1040ab8e0 0x7fa1040abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:53.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.152+0000 7fa10259c700 1 -- 172.21.2.105:0/3008064865 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa1040ac230 msgr2=0x7fa1040b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:53.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.152+0000 7fa10259c700 1 --2- 172.21.2.105:0/3008064865 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa1040ac230 0x7fa1040b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:53.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.152+0000 7fa10259c700 1 -- 172.21.2.105:0/3008064865 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa10412ed50 con 0x7fa0e40049f0 2021-11-12T05:47:53.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.152+0000 7fa10259c700 1 --2- 172.21.2.105:0/3008064865 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa0e40049f0 0x7fa104126e50 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7fa0ec00a000 tx=0x7fa0ec008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:53.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.152+0000 7fa0fb7fe700 1 -- 172.21.2.105:0/3008064865 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0ec016070 con 0x7fa0e40049f0 2021-11-12T05:47:53.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.152+0000 7fa0fb7fe700 1 -- 172.21.2.105:0/3008064865 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0ec000e90 con 0x7fa0e40049f0 2021-11-12T05:47:53.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.152+0000 7fa108b77700 1 -- 172.21.2.105:0/3008064865 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1040b56a0 con 0x7fa0e40049f0 2021-11-12T05:47:53.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.152+0000 7fa0fb7fe700 1 -- 172.21.2.105:0/3008064865 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0ec011970 con 0x7fa0e40049f0 2021-11-12T05:47:53.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.152+0000 7fa108b77700 1 -- 172.21.2.105:0/3008064865 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1040aa3e0 con 0x7fa0e40049f0 2021-11-12T05:47:53.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.152+0000 7fa108b77700 1 -- 172.21.2.105:0/3008064865 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1040b2060 con 0x7fa0e40049f0 2021-11-12T05:47:53.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.152+0000 7fa0fb7fe700 1 -- 172.21.2.105:0/3008064865 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa0ec011ad0 con 0x7fa0e40049f0 2021-11-12T05:47:53.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.152+0000 7fa0fb7fe700 1 --2- 172.21.2.105:0/3008064865 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa0e80536d0 0x7fa0e8055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:53.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.152+0000 7fa0fb7fe700 1 -- 172.21.2.105:0/3008064865 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fa0ec06b520 con 0x7fa0e40049f0 2021-11-12T05:47:53.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.152+0000 7fa101d9b700 1 --2- 172.21.2.105:0/3008064865 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa0e80536d0 0x7fa0e8055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:53.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.152+0000 7fa101d9b700 1 --2- 172.21.2.105:0/3008064865 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa0e80536d0 0x7fa0e8055b90 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fa0f4001390 tx=0x7fa0f4001610).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:53.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.156+0000 7fa0fb7fe700 1 -- 172.21.2.105:0/3008064865 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa0ec042460 con 0x7fa0e40049f0 2021-11-12T05:47:53.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.240+0000 7fa108b77700 1 -- 172.21.2.105:0/3008064865 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa104057350 con 0x7fa0e40049f0 2021-11-12T05:47:53.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.240+0000 7fa0fb7fe700 1 -- 172.21.2.105:0/3008064865 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v97) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa0ec045a80 con 0x7fa0e40049f0 2021-11-12T05:47:53.244 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:47:53.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.240+0000 7fa108b77700 1 -- 172.21.2.105:0/3008064865 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa0e80536d0 msgr2=0x7fa0e8055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:53.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.240+0000 7fa108b77700 1 --2- 172.21.2.105:0/3008064865 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa0e80536d0 0x7fa0e8055b90 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fa0f4001390 tx=0x7fa0f4001610).stop 2021-11-12T05:47:53.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.240+0000 7fa108b77700 1 -- 172.21.2.105:0/3008064865 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa0e40049f0 msgr2=0x7fa104126e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:53.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.240+0000 7fa108b77700 1 --2- 172.21.2.105:0/3008064865 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa0e40049f0 0x7fa104126e50 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7fa0ec00a000 tx=0x7fa0ec008040).stop 2021-11-12T05:47:53.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.240+0000 7fa108b77700 1 -- 172.21.2.105:0/3008064865 shutdown_connections 2021-11-12T05:47:53.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.240+0000 7fa108b77700 1 --2- 172.21.2.105:0/3008064865 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa0e80536d0 0x7fa0e8055b90 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:53.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.240+0000 7fa108b77700 1 --2- 172.21.2.105:0/3008064865 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa1040ac230 0x7fa1040b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:53.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.240+0000 7fa108b77700 1 --2- 172.21.2.105:0/3008064865 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1040ab8e0 0x7fa1040abd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:53.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.240+0000 7fa108b77700 1 --2- 172.21.2.105:0/3008064865 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa0e40049f0 0x7fa104126e50 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:53.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.240+0000 7fa108b77700 1 -- 172.21.2.105:0/3008064865 >> 172.21.2.105:0/3008064865 conn(0x7fa104062f60 msgr2=0x7fa104132630 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:53.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.240+0000 7fa108b77700 1 -- 172.21.2.105:0/3008064865 shutdown_connections 2021-11-12T05:47:53.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.240+0000 7fa108b77700 1 -- 172.21.2.105:0/3008064865 wait complete. 2021-11-12T05:47:53.251 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-12T05:47:53.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.300+0000 7fccaefff700 1 Processor -- start 2021-11-12T05:47:53.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.300+0000 7fccaefff700 1 -- start start 2021-11-12T05:47:53.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.300+0000 7fccaefff700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcca80626b0 0x7fcca8062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:53.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.300+0000 7fccaefff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fcca80af750 0x7fcca8130370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:53.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.300+0000 7fccaefff700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fcca8130860 0x7fcca814a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:53.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.300+0000 7fccaefff700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca8130cf0 con 0x7fcca80af750 2021-11-12T05:47:53.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.300+0000 7fccaefff700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca80b0d50 con 0x7fcca8130860 2021-11-12T05:47:53.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.300+0000 7fccaefff700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca80ad380 con 0x7fcca80626b0 2021-11-12T05:47:53.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.300+0000 7fcca7fff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fcca80af750 0x7fcca8130370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:53.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.300+0000 7fcca7fff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fcca80af750 0x7fcca8130370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49166/0 (socket says 172.21.2.105:49166) 2021-11-12T05:47:53.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.300+0000 7fcca7fff700 1 -- 172.21.2.105:0/2254981261 learned_addr learned my addr 172.21.2.105:0/2254981261 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:53.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.300+0000 7fcca7fff700 1 -- 172.21.2.105:0/2254981261 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcca80626b0 msgr2=0x7fcca8062a90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:47:53.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.300+0000 7fcca7fff700 1 --2- 172.21.2.105:0/2254981261 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcca80626b0 0x7fcca8062a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:53.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.300+0000 7fcca7fff700 1 -- 172.21.2.105:0/2254981261 >> v2:172.21.2.115:3300/0 conn(0x7fcca8130860 msgr2=0x7fcca814a950 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:47:53.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.300+0000 7fcca7fff700 1 --2- 172.21.2.105:0/2254981261 >> v2:172.21.2.115:3300/0 conn(0x7fcca8130860 0x7fcca814a950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:53.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.300+0000 7fcca7fff700 1 -- 172.21.2.105:0/2254981261 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca80ae190 con 0x7fcca80af750 2021-11-12T05:47:53.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.300+0000 7fcca7fff700 1 --2- 172.21.2.105:0/2254981261 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcca80af750 0x7fcca8130370 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7fcc90002f70 tx=0x7fcc90006eb0).ready entity=mon.0 client_cookie=fb6ba6384330c9dd server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:53.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.300+0000 7fcca77fe700 1 -- 172.21.2.105:0/2254981261 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc9000d570 con 0x7fcca80af750 2021-11-12T05:47:53.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.300+0000 7fcca77fe700 1 -- 172.21.2.105:0/2254981261 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc90000e90 con 0x7fcca80af750 2021-11-12T05:47:53.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.300+0000 7fcca77fe700 1 -- 172.21.2.105:0/2254981261 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc9000d900 con 0x7fcca80af750 2021-11-12T05:47:53.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.300+0000 7fccaefff700 1 -- 172.21.2.105:0/2254981261 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcca80af750 msgr2=0x7fcca8130370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:53.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.300+0000 7fccaefff700 1 --2- 172.21.2.105:0/2254981261 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcca80af750 0x7fcca8130370 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7fcc90002f70 tx=0x7fcc90006eb0).stop 2021-11-12T05:47:53.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.300+0000 7fccaefff700 1 -- 172.21.2.105:0/2254981261 shutdown_connections 2021-11-12T05:47:53.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.300+0000 7fccaefff700 1 --2- 172.21.2.105:0/2254981261 >> v2:172.21.2.115:3300/0 conn(0x7fcca8130860 0x7fcca814a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:53.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.300+0000 7fccaefff700 1 --2- 172.21.2.105:0/2254981261 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcca80af750 0x7fcca8130370 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:53.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.300+0000 7fccaefff700 1 --2- 172.21.2.105:0/2254981261 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcca80626b0 0x7fcca8062a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:53.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.300+0000 7fccaefff700 1 -- 172.21.2.105:0/2254981261 >> 172.21.2.105:0/2254981261 conn(0x7fcca80b5320 msgr2=0x7fcca80b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:53.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.300+0000 7fccaefff700 1 -- 172.21.2.105:0/2254981261 shutdown_connections 2021-11-12T05:47:53.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.300+0000 7fccaefff700 1 -- 172.21.2.105:0/2254981261 wait complete. 2021-11-12T05:47:53.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.304+0000 7fccaefff700 1 Processor -- start 2021-11-12T05:47:53.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.304+0000 7fccaefff700 1 -- start start 2021-11-12T05:47:53.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.304+0000 7fccaefff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcca80626b0 0x7fcca8146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:53.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.304+0000 7fccaefff700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcca80af750 0x7fcca8156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:53.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.304+0000 7fccaefff700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcca8130860 0x7fcca8066800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:53.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.304+0000 7fccaefff700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca8065560 con 0x7fcca80626b0 2021-11-12T05:47:53.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.304+0000 7fccaefff700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca815a0b0 con 0x7fcca80af750 2021-11-12T05:47:53.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.304+0000 7fccaefff700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca80660c0 con 0x7fcca8130860 2021-11-12T05:47:53.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.304+0000 7fccacd9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcca80626b0 0x7fcca8146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:53.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.304+0000 7fccacd9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcca80626b0 0x7fcca8146cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49170/0 (socket says 172.21.2.105:49170) 2021-11-12T05:47:53.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.304+0000 7fccacd9b700 1 -- 172.21.2.105:0/4235761304 learned_addr learned my addr 172.21.2.105:0/4235761304 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:53.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.304+0000 7fccacd9b700 1 -- 172.21.2.105:0/4235761304 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcca8130860 msgr2=0x7fcca8066800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:53.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.304+0000 7fccacd9b700 1 --2- 172.21.2.105:0/4235761304 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcca8130860 0x7fcca8066800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:53.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.304+0000 7fccacd9b700 1 -- 172.21.2.105:0/4235761304 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcca80af750 msgr2=0x7fcca8156850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:53.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.304+0000 7fccacd9b700 1 --2- 172.21.2.105:0/4235761304 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcca80af750 0x7fcca8156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:53.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.304+0000 7fccacd9b700 1 -- 172.21.2.105:0/4235761304 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc9000b1e0 con 0x7fcca80626b0 2021-11-12T05:47:53.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.304+0000 7fccacd9b700 1 --2- 172.21.2.105:0/4235761304 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcca80626b0 0x7fcca8146cc0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7fcc98002fb0 tx=0x7fcc98006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:53.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.304+0000 7fcca5ffb700 1 -- 172.21.2.105:0/4235761304 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc98013460 con 0x7fcca80626b0 2021-11-12T05:47:53.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.304+0000 7fcca5ffb700 1 -- 172.21.2.105:0/4235761304 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc980135c0 con 0x7fcca80626b0 2021-11-12T05:47:53.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.304+0000 7fccaefff700 1 -- 172.21.2.105:0/4235761304 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca8066360 con 0x7fcca80626b0 2021-11-12T05:47:53.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.304+0000 7fcca5ffb700 1 -- 172.21.2.105:0/4235761304 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc98013920 con 0x7fcca80626b0 2021-11-12T05:47:53.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.304+0000 7fccaefff700 1 -- 172.21.2.105:0/4235761304 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca8159da0 con 0x7fcca80626b0 2021-11-12T05:47:53.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.304+0000 7fccaefff700 1 -- 172.21.2.105:0/4235761304 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca80664f0 con 0x7fcca80626b0 2021-11-12T05:47:53.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.304+0000 7fcca5ffb700 1 -- 172.21.2.105:0/4235761304 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcc9800f070 con 0x7fcca80626b0 2021-11-12T05:47:53.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.304+0000 7fcca5ffb700 1 --2- 172.21.2.105:0/4235761304 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcc8c053610 0x7fcc8c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:53.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.304+0000 7fcca5ffb700 1 -- 172.21.2.105:0/4235761304 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fcc9806b4b0 con 0x7fcca80626b0 2021-11-12T05:47:53.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.304+0000 7fcca7fff700 1 --2- 172.21.2.105:0/4235761304 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcc8c053610 0x7fcc8c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:53.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.304+0000 7fcca7fff700 1 --2- 172.21.2.105:0/4235761304 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcc8c053610 0x7fcc8c055ad0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fcc90002f70 tx=0x7fcc90015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:53.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.308+0000 7fcca5ffb700 1 -- 172.21.2.105:0/4235761304 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcc980424c0 con 0x7fcca80626b0 2021-11-12T05:47:53.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.388+0000 7fccaefff700 1 -- 172.21.2.105:0/4235761304 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcca814ae40 con 0x7fcca80626b0 2021-11-12T05:47:53.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.388+0000 7fcca5ffb700 1 -- 172.21.2.105:0/4235761304 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v97) v1 ==== 104+0+10 (secure 0 0 0) 0x7fcc98045ae0 con 0x7fcca80626b0 2021-11-12T05:47:53.394 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:47:53.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.392+0000 7fccaefff700 1 -- 172.21.2.105:0/4235761304 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcc8c053610 msgr2=0x7fcc8c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:53.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.392+0000 7fccaefff700 1 --2- 172.21.2.105:0/4235761304 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcc8c053610 0x7fcc8c055ad0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fcc90002f70 tx=0x7fcc90015000).stop 2021-11-12T05:47:53.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.392+0000 7fccaefff700 1 -- 172.21.2.105:0/4235761304 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcca80626b0 msgr2=0x7fcca8146cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:53.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.392+0000 7fccaefff700 1 --2- 172.21.2.105:0/4235761304 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcca80626b0 0x7fcca8146cc0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7fcc98002fb0 tx=0x7fcc98006df0).stop 2021-11-12T05:47:53.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.392+0000 7fccaefff700 1 -- 172.21.2.105:0/4235761304 shutdown_connections 2021-11-12T05:47:53.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.392+0000 7fccaefff700 1 --2- 172.21.2.105:0/4235761304 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcc8c053610 0x7fcc8c055ad0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:53.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.392+0000 7fccaefff700 1 --2- 172.21.2.105:0/4235761304 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcca8130860 0x7fcca8066800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:53.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.392+0000 7fccaefff700 1 --2- 172.21.2.105:0/4235761304 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcca80af750 0x7fcca8156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:53.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.392+0000 7fccaefff700 1 --2- 172.21.2.105:0/4235761304 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcca80626b0 0x7fcca8146cc0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:53.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.392+0000 7fccaefff700 1 -- 172.21.2.105:0/4235761304 >> 172.21.2.105:0/4235761304 conn(0x7fcca80b5320 msgr2=0x7fcca80b0150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:53.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.392+0000 7fccaefff700 1 -- 172.21.2.105:0/4235761304 shutdown_connections 2021-11-12T05:47:53.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.392+0000 7fccaefff700 1 -- 172.21.2.105:0/4235761304 wait complete. 2021-11-12T05:47:53.402 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-12T05:47:53.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.452+0000 7fd7726a7700 1 Processor -- start 2021-11-12T05:47:53.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.452+0000 7fd7726a7700 1 -- start start 2021-11-12T05:47:53.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.452+0000 7fd7726a7700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd76c0b7c80 0x7fd76c067170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:53.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.452+0000 7fd7726a7700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd76c064900 0x7fd76c064d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:53.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.452+0000 7fd7726a7700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd76c0b8060 con 0x7fd76c065280 2021-11-12T05:47:53.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.452+0000 7fd7726a7700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd76c067d80 con 0x7fd76c0b7c80 2021-11-12T05:47:53.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.452+0000 7fd7726a7700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c067660 con 0x7fd76c064900 2021-11-12T05:47:53.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.452+0000 7fd76bfff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd76c0b7c80 0x7fd76c067170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:53.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.452+0000 7fd76bfff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd76c0b7c80 0x7fd76c067170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49178/0 (socket says 172.21.2.105:49178) 2021-11-12T05:47:53.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.452+0000 7fd76bfff700 1 -- 172.21.2.105:0/26658307 learned_addr learned my addr 172.21.2.105:0/26658307 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:53.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.452+0000 7fd76b7fe700 1 --2- 172.21.2.105:0/26658307 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd76c064900 0x7fd76c064d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:53.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.452+0000 7fd76bfff700 1 -- 172.21.2.105:0/26658307 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd76c064900 msgr2=0x7fd76c064d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:53.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.452+0000 7fd76bfff700 1 --2- 172.21.2.105:0/26658307 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd76c064900 0x7fd76c064d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:53.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.452+0000 7fd76bfff700 1 -- 172.21.2.105:0/26658307 >> v1:172.21.2.115:6789/0 conn(0x7fd76c065280 legacy=0x7fd76c144560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:53.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.452+0000 7fd76bfff700 1 -- 172.21.2.105:0/26658307 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76c067840 con 0x7fd76c0b7c80 2021-11-12T05:47:53.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.452+0000 7fd76bfff700 1 --2- 172.21.2.105:0/26658307 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd76c0b7c80 0x7fd76c067170 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7fd76c0611f0 tx=0x7fd760006eb0).ready entity=mon.0 client_cookie=92ba87cfdd6f631 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:53.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.452+0000 7fd76affd700 1 -- 172.21.2.105:0/26658307 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd76000d570 con 0x7fd76c0b7c80 2021-11-12T05:47:53.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.452+0000 7fd76affd700 1 -- 172.21.2.105:0/26658307 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd760000e90 con 0x7fd76c0b7c80 2021-11-12T05:47:53.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.452+0000 7fd76affd700 1 -- 172.21.2.105:0/26658307 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd76000d8c0 con 0x7fd76c0b7c80 2021-11-12T05:47:53.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.452+0000 7fd7726a7700 1 -- 172.21.2.105:0/26658307 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd76c0b7c80 msgr2=0x7fd76c067170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:53.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.452+0000 7fd7726a7700 1 --2- 172.21.2.105:0/26658307 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd76c0b7c80 0x7fd76c067170 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7fd76c0611f0 tx=0x7fd760006eb0).stop 2021-11-12T05:47:53.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.452+0000 7fd7726a7700 1 -- 172.21.2.105:0/26658307 shutdown_connections 2021-11-12T05:47:53.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.452+0000 7fd7726a7700 1 --2- 172.21.2.105:0/26658307 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd76c064900 0x7fd76c064d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:53.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.452+0000 7fd7726a7700 1 --2- 172.21.2.105:0/26658307 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd76c0b7c80 0x7fd76c067170 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:53.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.452+0000 7fd7726a7700 1 -- 172.21.2.105:0/26658307 >> 172.21.2.105:0/26658307 conn(0x7fd76c05c860 msgr2=0x7fd76c0608d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:53.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.452+0000 7fd7726a7700 1 -- 172.21.2.105:0/26658307 shutdown_connections 2021-11-12T05:47:53.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.452+0000 7fd7726a7700 1 -- 172.21.2.105:0/26658307 wait complete. 2021-11-12T05:47:53.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.452+0000 7fd7726a7700 1 Processor -- start 2021-11-12T05:47:53.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.452+0000 7fd7726a7700 1 -- start start 2021-11-12T05:47:53.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.452+0000 7fd7726a7700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd76c064900 0x7fd76c13bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:53.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.452+0000 7fd7726a7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd76c065280 0x7fd76c0b0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:53.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.456+0000 7fd7726a7700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd76c0b7c80 0x7fd76c13e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:53.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.456+0000 7fd7726a7700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c0b6860 con 0x7fd76c065280 2021-11-12T05:47:53.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.456+0000 7fd7726a7700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c0b6b00 con 0x7fd76c064900 2021-11-12T05:47:53.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.456+0000 7fd7726a7700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76c0b6da0 con 0x7fd76c0b7c80 2021-11-12T05:47:53.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.456+0000 7fd76b7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd76c065280 0x7fd76c0b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:53.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.456+0000 7fd76b7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd76c065280 0x7fd76c0b0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49186/0 (socket says 172.21.2.105:49186) 2021-11-12T05:47:53.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.456+0000 7fd76b7fe700 1 -- 172.21.2.105:0/1824204067 learned_addr learned my addr 172.21.2.105:0/1824204067 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:53.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.456+0000 7fd76bfff700 1 --2- 172.21.2.105:0/1824204067 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd76c064900 0x7fd76c13bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:53.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.456+0000 7fd770c44700 1 --2- 172.21.2.105:0/1824204067 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd76c0b7c80 0x7fd76c13e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:53.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.456+0000 7fd76b7fe700 1 -- 172.21.2.105:0/1824204067 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd76c0b7c80 msgr2=0x7fd76c13e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:53.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.456+0000 7fd76b7fe700 1 --2- 172.21.2.105:0/1824204067 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd76c0b7c80 0x7fd76c13e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:53.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.456+0000 7fd76b7fe700 1 -- 172.21.2.105:0/1824204067 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd76c064900 msgr2=0x7fd76c13bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:53.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.456+0000 7fd76b7fe700 1 --2- 172.21.2.105:0/1824204067 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd76c064900 0x7fd76c13bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:53.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.456+0000 7fd76b7fe700 1 -- 172.21.2.105:0/1824204067 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76000b1e0 con 0x7fd76c065280 2021-11-12T05:47:53.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.456+0000 7fd76b7fe700 1 --2- 172.21.2.105:0/1824204067 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd76c065280 0x7fd76c0b0780 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 rx=0x7fd75c0030b0 tx=0x7fd75c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:53.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.456+0000 7fd7697fa700 1 -- 172.21.2.105:0/1824204067 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd75c011780 con 0x7fd76c065280 2021-11-12T05:47:53.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.456+0000 7fd7697fa700 1 -- 172.21.2.105:0/1824204067 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75c0118e0 con 0x7fd76c065280 2021-11-12T05:47:53.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.456+0000 7fd7697fa700 1 -- 172.21.2.105:0/1824204067 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd75c011c40 con 0x7fd76c065280 2021-11-12T05:47:53.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.456+0000 7fd7726a7700 1 -- 172.21.2.105:0/1824204067 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd76c0b7040 con 0x7fd76c065280 2021-11-12T05:47:53.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.456+0000 7fd7726a7700 1 -- 172.21.2.105:0/1824204067 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd76c13b8b0 con 0x7fd76c065280 2021-11-12T05:47:53.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.456+0000 7fd7726a7700 1 -- 172.21.2.105:0/1824204067 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd76c057350 con 0x7fd76c065280 2021-11-12T05:47:53.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.456+0000 7fd7697fa700 1 -- 172.21.2.105:0/1824204067 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd75c012420 con 0x7fd76c065280 2021-11-12T05:47:53.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.456+0000 7fd7697fa700 1 --2- 172.21.2.105:0/1824204067 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd74c053640 0x7fd74c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:53.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.456+0000 7fd7697fa700 1 -- 172.21.2.105:0/1824204067 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fd75c06b950 con 0x7fd76c065280 2021-11-12T05:47:53.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.456+0000 7fd76bfff700 1 --2- 172.21.2.105:0/1824204067 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd74c053640 0x7fd74c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:53.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.456+0000 7fd76bfff700 1 --2- 172.21.2.105:0/1824204067 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd74c053640 0x7fd74c055b00 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fd76001a000 tx=0x7fd760015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:53.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.456+0000 7fd7697fa700 1 -- 172.21.2.105:0/1824204067 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd75c042900 con 0x7fd76c065280 2021-11-12T05:47:53.547 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.544+0000 7fd7726a7700 1 -- 172.21.2.105:0/1824204067 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd76c0b4d40 con 0x7fd76c065280 2021-11-12T05:47:53.547 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.544+0000 7fd7697fa700 1 -- 172.21.2.105:0/1824204067 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v97) v1 ==== 100+0+10 (secure 0 0 0) 0x7fd75c045f20 con 0x7fd76c065280 2021-11-12T05:47:53.548 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:47:53.549 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.544+0000 7fd7726a7700 1 -- 172.21.2.105:0/1824204067 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd74c053640 msgr2=0x7fd74c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:53.549 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.544+0000 7fd7726a7700 1 --2- 172.21.2.105:0/1824204067 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd74c053640 0x7fd74c055b00 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fd76001a000 tx=0x7fd760015000).stop 2021-11-12T05:47:53.549 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.544+0000 7fd7726a7700 1 -- 172.21.2.105:0/1824204067 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd76c065280 msgr2=0x7fd76c0b0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:53.549 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.544+0000 7fd7726a7700 1 --2- 172.21.2.105:0/1824204067 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd76c065280 0x7fd76c0b0780 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 rx=0x7fd75c0030b0 tx=0x7fd75c008040).stop 2021-11-12T05:47:53.550 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.544+0000 7fd7726a7700 1 -- 172.21.2.105:0/1824204067 shutdown_connections 2021-11-12T05:47:53.550 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.544+0000 7fd7726a7700 1 --2- 172.21.2.105:0/1824204067 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd74c053640 0x7fd74c055b00 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:53.550 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.544+0000 7fd7726a7700 1 --2- 172.21.2.105:0/1824204067 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd76c0b7c80 0x7fd76c13e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:53.550 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.544+0000 7fd7726a7700 1 --2- 172.21.2.105:0/1824204067 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd76c065280 0x7fd76c0b0780 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:53.551 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.544+0000 7fd7726a7700 1 --2- 172.21.2.105:0/1824204067 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd76c064900 0x7fd76c13bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:53.551 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.544+0000 7fd7726a7700 1 -- 172.21.2.105:0/1824204067 >> 172.21.2.105:0/1824204067 conn(0x7fd76c05c860 msgr2=0x7fd76c0608d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:53.551 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.544+0000 7fd7726a7700 1 -- 172.21.2.105:0/1824204067 shutdown_connections 2021-11-12T05:47:53.551 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.544+0000 7fd7726a7700 1 -- 172.21.2.105:0/1824204067 wait complete. 2021-11-12T05:47:53.555 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-12T05:47:53.555 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:47:53.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.604+0000 7fa779df0700 1 Processor -- start 2021-11-12T05:47:53.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.604+0000 7fa779df0700 1 -- start start 2021-11-12T05:47:53.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.604+0000 7fa779df0700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fa7740b5ac0 0x7fa7740b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:53.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.604+0000 7fa779df0700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa7740b01b0 0x7fa7740ae470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:53.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.604+0000 7fa779df0700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7740b5ea0 con 0x7fa7740ae960 2021-11-12T05:47:53.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.604+0000 7fa779df0700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7740b1a60 con 0x7fa7740b01b0 2021-11-12T05:47:53.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.604+0000 7fa779df0700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7740accd0 con 0x7fa7740b5ac0 2021-11-12T05:47:53.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.604+0000 7fa772ffd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa7740b01b0 0x7fa7740ae470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:53.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.604+0000 7fa772ffd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa7740b01b0 0x7fa7740ae470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49196/0 (socket says 172.21.2.105:49196) 2021-11-12T05:47:53.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.604+0000 7fa772ffd700 1 -- 172.21.2.105:0/2502123499 learned_addr learned my addr 172.21.2.105:0/2502123499 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:53.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.604+0000 7fa772ffd700 1 -- 172.21.2.105:0/2502123499 >> v2:172.21.2.115:3300/0 conn(0x7fa7740b5ac0 msgr2=0x7fa7740b13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:53.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.604+0000 7fa772ffd700 1 --2- 172.21.2.105:0/2502123499 >> v2:172.21.2.115:3300/0 conn(0x7fa7740b5ac0 0x7fa7740b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:53.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.604+0000 7fa772ffd700 1 -- 172.21.2.105:0/2502123499 >> v1:172.21.2.115:6789/0 conn(0x7fa7740ae960 legacy=0x7fa7740b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:53.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.604+0000 7fa772ffd700 1 -- 172.21.2.105:0/2502123499 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7740acf70 con 0x7fa7740b01b0 2021-11-12T05:47:53.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.604+0000 7fa772ffd700 1 --2- 172.21.2.105:0/2502123499 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa7740b01b0 0x7fa7740ae470 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7fa7740b6470 tx=0x7fa75c006f40).ready entity=mon.0 client_cookie=e642b9a0b44a8838 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:53.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.604+0000 7fa7727fc700 1 -- 172.21.2.105:0/2502123499 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa75c010070 con 0x7fa7740b01b0 2021-11-12T05:47:53.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.604+0000 7fa7727fc700 1 -- 172.21.2.105:0/2502123499 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75c000e90 con 0x7fa7740b01b0 2021-11-12T05:47:53.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.604+0000 7fa7727fc700 1 -- 172.21.2.105:0/2502123499 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa75c008860 con 0x7fa7740b01b0 2021-11-12T05:47:53.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.604+0000 7fa779df0700 1 -- 172.21.2.105:0/2502123499 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa7740b01b0 msgr2=0x7fa7740ae470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:53.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.604+0000 7fa779df0700 1 --2- 172.21.2.105:0/2502123499 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa7740b01b0 0x7fa7740ae470 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7fa7740b6470 tx=0x7fa75c006f40).stop 2021-11-12T05:47:53.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.604+0000 7fa779df0700 1 -- 172.21.2.105:0/2502123499 shutdown_connections 2021-11-12T05:47:53.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.604+0000 7fa779df0700 1 --2- 172.21.2.105:0/2502123499 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa7740b01b0 0x7fa7740ae470 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:53.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.604+0000 7fa779df0700 1 --2- 172.21.2.105:0/2502123499 >> v2:172.21.2.115:3300/0 conn(0x7fa7740b5ac0 0x7fa7740b13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:53.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.604+0000 7fa779df0700 1 -- 172.21.2.105:0/2502123499 >> 172.21.2.105:0/2502123499 conn(0x7fa7740628b0 msgr2=0x7fa774062c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:53.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.604+0000 7fa779df0700 1 -- 172.21.2.105:0/2502123499 shutdown_connections 2021-11-12T05:47:53.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.604+0000 7fa779df0700 1 -- 172.21.2.105:0/2502123499 wait complete. 2021-11-12T05:47:53.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.604+0000 7fa779df0700 1 Processor -- start 2021-11-12T05:47:53.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.604+0000 7fa779df0700 1 -- start start 2021-11-12T05:47:53.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.608+0000 7fa779df0700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa7740ae960 0x7fa77412bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:53.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.608+0000 7fa779df0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa7740b01b0 0x7fa774131850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:53.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.608+0000 7fa779df0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa7740b5ac0 0x7fa774065470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:53.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.608+0000 7fa779df0700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77412dca0 con 0x7fa7740b01b0 2021-11-12T05:47:53.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.608+0000 7fa779df0700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa774066f10 con 0x7fa7740ae960 2021-11-12T05:47:53.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.608+0000 7fa779df0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7740669d0 con 0x7fa7740b5ac0 2021-11-12T05:47:53.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.608+0000 7fa772ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa7740b01b0 0x7fa774131850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:53.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.608+0000 7fa772ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa7740b01b0 0x7fa774131850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49200/0 (socket says 172.21.2.105:49200) 2021-11-12T05:47:53.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.608+0000 7fa772ffd700 1 -- 172.21.2.105:0/2887123500 learned_addr learned my addr 172.21.2.105:0/2887123500 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:53.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.608+0000 7fa7737fe700 1 --2- 172.21.2.105:0/2887123500 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa7740ae960 0x7fa77412bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:53.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.608+0000 7fa773fff700 1 --2- 172.21.2.105:0/2887123500 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa7740b5ac0 0x7fa774065470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:53.621 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.608+0000 7fa772ffd700 1 -- 172.21.2.105:0/2887123500 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa7740b5ac0 msgr2=0x7fa774065470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:53.621 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.608+0000 7fa772ffd700 1 --2- 172.21.2.105:0/2887123500 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa7740b5ac0 0x7fa774065470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:53.621 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.608+0000 7fa772ffd700 1 -- 172.21.2.105:0/2887123500 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa7740ae960 msgr2=0x7fa77412bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:53.621 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.608+0000 7fa772ffd700 1 --2- 172.21.2.105:0/2887123500 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa7740ae960 0x7fa77412bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:53.621 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.608+0000 7fa772ffd700 1 -- 172.21.2.105:0/2887123500 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75c008240 con 0x7fa7740b01b0 2021-11-12T05:47:53.622 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.608+0000 7fa773fff700 1 --2- 172.21.2.105:0/2887123500 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa7740b5ac0 0x7fa774065470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:47:53.622 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.608+0000 7fa772ffd700 1 --2- 172.21.2.105:0/2887123500 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa7740b01b0 0x7fa774131850 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7fa7740b6470 tx=0x7fa7740b0050).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:53.622 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.608+0000 7fa770ff9700 1 -- 172.21.2.105:0/2887123500 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa75c00b3a0 con 0x7fa7740b01b0 2021-11-12T05:47:53.622 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.608+0000 7fa770ff9700 1 -- 172.21.2.105:0/2887123500 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75c00b500 con 0x7fa7740b01b0 2021-11-12T05:47:53.623 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.608+0000 7fa770ff9700 1 -- 172.21.2.105:0/2887123500 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa75c00b860 con 0x7fa7740b01b0 2021-11-12T05:47:53.623 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.608+0000 7fa779df0700 1 -- 172.21.2.105:0/2887123500 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa774066c70 con 0x7fa7740b01b0 2021-11-12T05:47:53.623 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.608+0000 7fa779df0700 1 -- 172.21.2.105:0/2887123500 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa774067160 con 0x7fa7740b01b0 2021-11-12T05:47:53.623 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.608+0000 7fa779df0700 1 -- 172.21.2.105:0/2887123500 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7740ad410 con 0x7fa7740b01b0 2021-11-12T05:47:53.623 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.608+0000 7fa770ff9700 1 -- 172.21.2.105:0/2887123500 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa75c015470 con 0x7fa7740b01b0 2021-11-12T05:47:53.624 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.608+0000 7fa770ff9700 1 --2- 172.21.2.105:0/2887123500 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa7580536f0 0x7fa758055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:53.624 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.608+0000 7fa770ff9700 1 -- 172.21.2.105:0/2887123500 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fa75c06cb50 con 0x7fa7740b01b0 2021-11-12T05:47:53.624 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.608+0000 7fa7737fe700 1 --2- 172.21.2.105:0/2887123500 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa7580536f0 0x7fa758055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:53.624 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.608+0000 7fa7737fe700 1 --2- 172.21.2.105:0/2887123500 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa7580536f0 0x7fa758055bb0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fa76400a000 tx=0x7fa764008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:53.625 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.612+0000 7fa770ff9700 1 -- 172.21.2.105:0/2887123500 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa75c043ae0 con 0x7fa7740b01b0 2021-11-12T05:47:53.723 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.720+0000 7fa779df0700 1 -- 172.21.2.105:0/2887123500 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa774057350 con 0x7fa7740b01b0 2021-11-12T05:47:53.723 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.720+0000 7fa770ff9700 1 -- 172.21.2.105:0/2887123500 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+2140 (secure 0 0 0) 0x7fa75c0470c0 con 0x7fa7740b01b0 2021-11-12T05:47:53.724 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:53.724 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":44,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4751,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/3227424218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":3227424218},{"type":"v1","addr":"172.21.2.115:6833","nonce":3227424218}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":43}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:47:50.427589+0000","modified":"2021-11-12T05:47:51.432486+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7017":{"gid":7017,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/3298879485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":3298879485},{"type":"v1","addr":"172.21.2.105:6835","nonce":3298879485}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-11-12T05:47:53.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.720+0000 7fa779df0700 1 -- 172.21.2.105:0/2887123500 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa7580536f0 msgr2=0x7fa758055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:53.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.720+0000 7fa779df0700 1 --2- 172.21.2.105:0/2887123500 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa7580536f0 0x7fa758055bb0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fa76400a000 tx=0x7fa764008040).stop 2021-11-12T05:47:53.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.720+0000 7fa779df0700 1 -- 172.21.2.105:0/2887123500 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa7740b01b0 msgr2=0x7fa774131850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:53.726 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.720+0000 7fa779df0700 1 --2- 172.21.2.105:0/2887123500 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa7740b01b0 0x7fa774131850 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7fa7740b6470 tx=0x7fa7740b0050).stop 2021-11-12T05:47:53.726 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.720+0000 7fa779df0700 1 -- 172.21.2.105:0/2887123500 shutdown_connections 2021-11-12T05:47:53.726 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.720+0000 7fa779df0700 1 --2- 172.21.2.105:0/2887123500 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa7580536f0 0x7fa758055bb0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:53.726 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.720+0000 7fa779df0700 1 --2- 172.21.2.105:0/2887123500 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa7740b5ac0 0x7fa774065470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:53.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.720+0000 7fa779df0700 1 --2- 172.21.2.105:0/2887123500 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa7740b01b0 0x7fa774131850 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:53.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.720+0000 7fa779df0700 1 --2- 172.21.2.105:0/2887123500 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa7740ae960 0x7fa77412bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:53.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.720+0000 7fa779df0700 1 -- 172.21.2.105:0/2887123500 >> 172.21.2.105:0/2887123500 conn(0x7fa7740628b0 msgr2=0x7fa77413ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:53.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.720+0000 7fa779df0700 1 -- 172.21.2.105:0/2887123500 shutdown_connections 2021-11-12T05:47:53.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:53.720+0000 7fa779df0700 1 -- 172.21.2.105:0/2887123500 wait complete. 2021-11-12T05:47:53.728 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 44 2021-11-12T05:47:53.932 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 44, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:47:50.427589+0000', 'modified': '2021-11-12T05:47:51.432486+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7017}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7017': {'gid': 7017, 'name': 'a', 'rank': 0, 'incarnation': 43, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/3298879485', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 3298879485}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 3298879485}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:47:53.933 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:47:53.934 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:47:53.998 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":7017,"want_state":"up:active","state":"up:active","rank_uptime":3.5627529340000001,"mdsmap_epoch":44,"osdmap_epoch":97,"osdmap_epoch_barrier":96,"uptime":7.7874009419999997} 2021-11-12T05:47:53.998 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 7017, "mdsmap_epoch": 44, "osdmap_epoch": 97, "osdmap_epoch_barrier": 96, "rank_uptime": 3.562752934, "state": "up:active", "uptime": 7.787400942, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:47:53.999 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-12T05:47:53.999 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-12T05:47:54.000 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba016.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-12T05:47:54.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:54.000 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:47:54.011 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:47:54.023 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:47:54.023 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:47:54.075 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:47:54.076 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:47:54.077 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:54.078 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:47:54.083 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-12T05:47:54.083 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:47:54.086 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:47:54.096 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:47:54.097 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:47:54.126 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:2021-11-12T05:47:54.121+0000 7f79bbe51080 -1 init, newargv = 0x557f33e9dd40 newargc=9ceph-fuse[14862 2021-11-12T05:47:54.126 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:]: starting ceph client 2021-11-12T05:47:54.131 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:47:54.132 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:47:54.133 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:54.133 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:47:54.139 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[14862]: starting fuse 2021-11-12T05:47:54.142 INFO:teuthology.orchestra.run.gibba016.stdout:52 2021-11-12T05:47:54.142 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-12T05:47:54.142 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:54.143 DEBUG:teuthology.orchestra.run.gibba016:> sudo python3 -c ' 2021-11-12T05:47:54.143 DEBUG:teuthology.orchestra.run.gibba016:> import glob 2021-11-12T05:47:54.144 DEBUG:teuthology.orchestra.run.gibba016:> import re 2021-11-12T05:47:54.144 DEBUG:teuthology.orchestra.run.gibba016:> import os 2021-11-12T05:47:54.145 DEBUG:teuthology.orchestra.run.gibba016:> import subprocess 2021-11-12T05:47:54.145 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:47:54.146 DEBUG:teuthology.orchestra.run.gibba016:> def find_socket(client_name): 2021-11-12T05:47:54.146 DEBUG:teuthology.orchestra.run.gibba016:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-12T05:47:54.147 DEBUG:teuthology.orchestra.run.gibba016:> files = glob.glob(asok_path) 2021-11-12T05:47:54.147 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:47:54.148 DEBUG:teuthology.orchestra.run.gibba016:> # Given a non-glob path, it better be there 2021-11-12T05:47:54.148 DEBUG:teuthology.orchestra.run.gibba016:> if "*" not in asok_path: 2021-11-12T05:47:54.148 DEBUG:teuthology.orchestra.run.gibba016:> assert(len(files) == 1) 2021-11-12T05:47:54.149 DEBUG:teuthology.orchestra.run.gibba016:> return files[0] 2021-11-12T05:47:54.149 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:47:54.150 DEBUG:teuthology.orchestra.run.gibba016:> for f in files: 2021-11-12T05:47:54.150 DEBUG:teuthology.orchestra.run.gibba016:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-12T05:47:54.151 DEBUG:teuthology.orchestra.run.gibba016:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-12T05:47:54.151 DEBUG:teuthology.orchestra.run.gibba016:> return f 2021-11-12T05:47:54.151 DEBUG:teuthology.orchestra.run.gibba016:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-12T05:47:54.152 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:47:54.152 DEBUG:teuthology.orchestra.run.gibba016:> print(find_socket("client.0")) 2021-11-12T05:47:54.153 DEBUG:teuthology.orchestra.run.gibba016:> ' 2021-11-12T05:47:54.254 INFO:teuthology.orchestra.run.gibba016.stdout:/var/run/ceph/ceph-client.0.14862.asok 2021-11-12T05:47:54.257 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14862.asok 2021-11-12T05:47:54.258 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:54.258 DEBUG:teuthology.orchestra.run.gibba016:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14862.asok status 2021-11-12T05:47:54.313 INFO:teuthology.orchestra.run.gibba016.stdout:{ 2021-11-12T05:47:54.313 INFO:teuthology.orchestra.run.gibba016.stdout: "metadata": { 2021-11-12T05:47:54.313 INFO:teuthology.orchestra.run.gibba016.stdout: "ceph_sha1": "a81ee2815de5acae59ead5b8c9137b6766fc8ea8", 2021-11-12T05:47:54.314 INFO:teuthology.orchestra.run.gibba016.stdout: "ceph_version": "ceph version 15.2.15-22-ga81ee281 (a81ee2815de5acae59ead5b8c9137b6766fc8ea8) octopus (stable)", 2021-11-12T05:47:54.314 INFO:teuthology.orchestra.run.gibba016.stdout: "entity_id": "0", 2021-11-12T05:47:54.314 INFO:teuthology.orchestra.run.gibba016.stdout: "hostname": "gibba016", 2021-11-12T05:47:54.314 INFO:teuthology.orchestra.run.gibba016.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-12T05:47:54.314 INFO:teuthology.orchestra.run.gibba016.stdout: "pid": "14862", 2021-11-12T05:47:54.315 INFO:teuthology.orchestra.run.gibba016.stdout: "root": "/" 2021-11-12T05:47:54.315 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:47:54.315 INFO:teuthology.orchestra.run.gibba016.stdout: "dentry_count": 0, 2021-11-12T05:47:54.315 INFO:teuthology.orchestra.run.gibba016.stdout: "dentry_pinned_count": 0, 2021-11-12T05:47:54.315 INFO:teuthology.orchestra.run.gibba016.stdout: "id": 4778, 2021-11-12T05:47:54.316 INFO:teuthology.orchestra.run.gibba016.stdout: "inst": { 2021-11-12T05:47:54.316 INFO:teuthology.orchestra.run.gibba016.stdout: "name": { 2021-11-12T05:47:54.316 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "client", 2021-11-12T05:47:54.316 INFO:teuthology.orchestra.run.gibba016.stdout: "num": 4778 2021-11-12T05:47:54.317 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:47:54.317 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": { 2021-11-12T05:47:54.317 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "v1", 2021-11-12T05:47:54.317 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": "172.21.2.116:0", 2021-11-12T05:47:54.317 INFO:teuthology.orchestra.run.gibba016.stdout: "nonce": 2776510142 2021-11-12T05:47:54.318 INFO:teuthology.orchestra.run.gibba016.stdout: } 2021-11-12T05:47:54.318 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:47:54.318 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": { 2021-11-12T05:47:54.318 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "v1", 2021-11-12T05:47:54.318 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": "172.21.2.116:0", 2021-11-12T05:47:54.319 INFO:teuthology.orchestra.run.gibba016.stdout: "nonce": 2776510142 2021-11-12T05:47:54.319 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:47:54.319 INFO:teuthology.orchestra.run.gibba016.stdout: "inst_str": "client.4778 172.21.2.116:0/2776510142", 2021-11-12T05:47:54.319 INFO:teuthology.orchestra.run.gibba016.stdout: "addr_str": "172.21.2.116:0/2776510142", 2021-11-12T05:47:54.320 INFO:teuthology.orchestra.run.gibba016.stdout: "inode_count": 1, 2021-11-12T05:47:54.320 INFO:teuthology.orchestra.run.gibba016.stdout: "mds_epoch": 44, 2021-11-12T05:47:54.320 INFO:teuthology.orchestra.run.gibba016.stdout: "osd_epoch": 97, 2021-11-12T05:47:54.320 INFO:teuthology.orchestra.run.gibba016.stdout: "osd_epoch_barrier": 0, 2021-11-12T05:47:54.320 INFO:teuthology.orchestra.run.gibba016.stdout: "blacklisted": false, 2021-11-12T05:47:54.321 INFO:teuthology.orchestra.run.gibba016.stdout: "fs_name": "cephfs" 2021-11-12T05:47:54.321 INFO:teuthology.orchestra.run.gibba016.stdout:} 2021-11-12T05:47:54.322 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:54.322 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:47:54.323 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:47:54.329 INFO:teuthology.orchestra.run.gibba016.stdout:fuseblk 2021-11-12T05:47:54.329 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-12T05:47:54.329 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:54.330 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:47:54.380 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:47:54.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d31ad0700 1 Processor -- start 2021-11-12T05:47:54.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d31ad0700 1 -- start start 2021-11-12T05:47:54.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d31ad0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6d2c0b3100 0x7f6d2c0b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:54.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d31ad0700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d2c0b2110 con 0x7f6d2c0b4d50 2021-11-12T05:47:54.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d31ad0700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d2c0b2370 con 0x7f6d2c062010 2021-11-12T05:47:54.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d31ad0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c0b2610 con 0x7f6d2c0b3100 2021-11-12T05:47:54.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d2affd700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f6d2c0b4d50 0x7f6d2c141e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:59606/0 (socket says 172.21.2.105:59606) 2021-11-12T05:47:54.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d2affd700 1 -- 172.21.2.105:0/3533252751 learned_addr learned my addr 172.21.2.105:0/3533252751 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:54.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d2a7fc700 1 -- 172.21.2.105:0/3533252751 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2580399571 0 0) 0x7f6d2c0b2110 con 0x7f6d2c0b4d50 2021-11-12T05:47:54.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d2a7fc700 1 -- 172.21.2.105:0/3533252751 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d0c003260 con 0x7f6d2c0b4d50 2021-11-12T05:47:54.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d2bfff700 1 --2- 172.21.2.105:0/3533252751 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6d2c0b3100 0x7f6d2c0b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:54.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d2a7fc700 1 -- 172.21.2.105:0/3533252751 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3597873599 0 0) 0x7f6d0c003260 con 0x7f6d2c0b4d50 2021-11-12T05:47:54.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d2a7fc700 1 -- 172.21.2.105:0/3533252751 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6d2c0b3100 msgr2=0x7f6d2c0b5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:54.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d2a7fc700 1 --2- 172.21.2.105:0/3533252751 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6d2c0b3100 0x7f6d2c0b5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:54.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d2a7fc700 1 -- 172.21.2.105:0/3533252751 >> v1:172.21.2.115:6789/0 conn(0x7f6d2c062010 legacy=0x7f6d2c0b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:54.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d2a7fc700 1 -- 172.21.2.105:0/3533252751 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d2c0b4330 con 0x7f6d2c0b4d50 2021-11-12T05:47:54.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d2a7fc700 1 -- 172.21.2.105:0/3533252751 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f6d1c001660 con 0x7f6d2c0b4d50 2021-11-12T05:47:54.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d2a7fc700 1 -- 172.21.2.105:0/3533252751 >> v1:172.21.2.105:6789/0 conn(0x7f6d2c0b4d50 legacy=0x7f6d2c141e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:54.443 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d2a7fc700 1 --2- 172.21.2.105:0/3533252751 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6d2c0b3100 0x7f6d0c003800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:54.443 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d2a7fc700 1 --2- 172.21.2.105:0/3533252751 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6d0c003e10 0x7f6d0c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:54.443 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d2a7fc700 1 --2- 172.21.2.105:0/3533252751 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6d0c004b10 0x7f6d0c004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:54.443 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d2a7fc700 1 -- 172.21.2.105:0/3533252751 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c0b2610 con 0x7f6d0c004b10 2021-11-12T05:47:54.444 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d2a7fc700 1 -- 172.21.2.105:0/3533252751 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c00b960 con 0x7f6d0c003e10 2021-11-12T05:47:54.444 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d2a7fc700 1 -- 172.21.2.105:0/3533252751 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c00bb20 con 0x7f6d2c0b3100 2021-11-12T05:47:54.444 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d2bfff700 1 --2- 172.21.2.105:0/3533252751 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6d0c004b10 0x7f6d0c004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:54.444 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d2b7fe700 1 --2- 172.21.2.105:0/3533252751 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6d2c0b3100 0x7f6d0c003800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:54.444 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d2bfff700 1 -- 172.21.2.105:0/3533252751 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6d2c0b3100 msgr2=0x7f6d0c003800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:54.445 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d2bfff700 1 --2- 172.21.2.105:0/3533252751 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6d2c0b3100 0x7f6d0c003800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:54.445 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d2bfff700 1 -- 172.21.2.105:0/3533252751 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6d0c003e10 msgr2=0x7f6d0c004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:54.445 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d2bfff700 1 --2- 172.21.2.105:0/3533252751 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6d0c003e10 0x7f6d0c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:54.445 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d2bfff700 1 -- 172.21.2.105:0/3533252751 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d0c003260 con 0x7f6d0c004b10 2021-11-12T05:47:54.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d2bfff700 1 --2- 172.21.2.105:0/3533252751 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6d0c004b10 0x7f6d0c004f90 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x7f6d2400a000 tx=0x7f6d24008040).ready entity=mon.0 client_cookie=fbcd08e734d6ddd7 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:54.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d2a7fc700 1 -- 172.21.2.105:0/3533252751 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d2400c070 con 0x7f6d0c004b10 2021-11-12T05:47:54.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d2a7fc700 1 -- 172.21.2.105:0/3533252751 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2400e5f0 con 0x7f6d0c004b10 2021-11-12T05:47:54.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d2a7fc700 1 -- 172.21.2.105:0/3533252751 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d2400e950 con 0x7f6d0c004b10 2021-11-12T05:47:54.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d31ad0700 1 -- 172.21.2.105:0/3533252751 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6d0c004b10 msgr2=0x7f6d0c004f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:54.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d31ad0700 1 --2- 172.21.2.105:0/3533252751 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6d0c004b10 0x7f6d0c004f90 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x7f6d2400a000 tx=0x7f6d24008040).stop 2021-11-12T05:47:54.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d2bfff700 1 -- 172.21.2.105:0/3533252751 reap_dead start 2021-11-12T05:47:54.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d31ad0700 1 -- 172.21.2.105:0/3533252751 shutdown_connections 2021-11-12T05:47:54.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d31ad0700 1 -- 172.21.2.105:0/3533252751 >> 172.21.2.105:0/3533252751 conn(0x7f6d2c0b9790 msgr2=0x7f6d2c0b9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:54.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d31ad0700 1 -- 172.21.2.105:0/3533252751 shutdown_connections 2021-11-12T05:47:54.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.432+0000 7f6d31ad0700 1 -- 172.21.2.105:0/3533252751 wait complete. 2021-11-12T05:47:54.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.436+0000 7f6d31ad0700 1 Processor -- start 2021-11-12T05:47:54.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.436+0000 7f6d31ad0700 1 -- start start 2021-11-12T05:47:54.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.436+0000 7f6d31ad0700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6d0c004b10 0x7f6d2c146f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:54.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.436+0000 7f6d31ad0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6d2c063750 0x7f6d2c13e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:54.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.436+0000 7f6d31ad0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6d2c0b0030 0x7f6d2c0652e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:54.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.436+0000 7f6d31ad0700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c063ee0 con 0x7f6d2c0b0030 2021-11-12T05:47:54.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.436+0000 7f6d31ad0700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c063c40 con 0x7f6d0c004b10 2021-11-12T05:47:54.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.436+0000 7f6d31ad0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c13ec80 con 0x7f6d2c063750 2021-11-12T05:47:54.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.436+0000 7f6d2bfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6d2c0b0030 0x7f6d2c0652e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:54.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.436+0000 7f6d2bfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6d2c0b0030 0x7f6d2c0652e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49222/0 (socket says 172.21.2.105:49222) 2021-11-12T05:47:54.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.436+0000 7f6d2bfff700 1 -- 172.21.2.105:0/1583485728 learned_addr learned my addr 172.21.2.105:0/1583485728 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:54.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.436+0000 7f6d2bfff700 1 -- 172.21.2.105:0/1583485728 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6d2c063750 msgr2=0x7f6d2c13e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:54.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.436+0000 7f6d2bfff700 1 --2- 172.21.2.105:0/1583485728 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6d2c063750 0x7f6d2c13e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:54.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.436+0000 7f6d2bfff700 1 -- 172.21.2.105:0/1583485728 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6d0c004b10 msgr2=0x7f6d2c146f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:54.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.436+0000 7f6d2bfff700 1 --2- 172.21.2.105:0/1583485728 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6d0c004b10 0x7f6d2c146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:54.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.436+0000 7f6d2bfff700 1 -- 172.21.2.105:0/1583485728 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d2c0aec10 con 0x7f6d2c0b0030 2021-11-12T05:47:54.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.436+0000 7f6d2bfff700 1 --2- 172.21.2.105:0/1583485728 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6d2c0b0030 0x7f6d2c0652e0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7f6d2c0b1ff0 tx=0x7f6d24008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:54.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.436+0000 7f6d28ff9700 1 -- 172.21.2.105:0/1583485728 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d2401d440 con 0x7f6d2c0b0030 2021-11-12T05:47:54.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.436+0000 7f6d28ff9700 1 -- 172.21.2.105:0/1583485728 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2401d5a0 con 0x7f6d2c0b0030 2021-11-12T05:47:54.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.436+0000 7f6d28ff9700 1 -- 172.21.2.105:0/1583485728 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d2401d710 con 0x7f6d2c0b0030 2021-11-12T05:47:54.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.436+0000 7f6d31ad0700 1 -- 172.21.2.105:0/1583485728 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d2c0657d0 con 0x7f6d2c0b0030 2021-11-12T05:47:54.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.436+0000 7f6d31ad0700 1 -- 172.21.2.105:0/1583485728 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d2c159fd0 con 0x7f6d2c0b0030 2021-11-12T05:47:54.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.436+0000 7f6d31ad0700 1 -- 172.21.2.105:0/1583485728 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d2c057350 con 0x7f6d2c0b0030 2021-11-12T05:47:54.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.436+0000 7f6d28ff9700 1 -- 172.21.2.105:0/1583485728 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6d2401d870 con 0x7f6d2c0b0030 2021-11-12T05:47:54.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.436+0000 7f6d28ff9700 1 --2- 172.21.2.105:0/1583485728 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6d10053660 0x7f6d10055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:54.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.436+0000 7f6d28ff9700 1 -- 172.21.2.105:0/1583485728 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f6d2406c0e0 con 0x7f6d2c0b0030 2021-11-12T05:47:54.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.436+0000 7f6d2b7fe700 1 --2- 172.21.2.105:0/1583485728 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6d10053660 0x7f6d10055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:54.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.436+0000 7f6d2b7fe700 1 --2- 172.21.2.105:0/1583485728 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6d10053660 0x7f6d10055b20 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f6d1400b000 tx=0x7f6d14009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:54.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.440+0000 7f6d28ff9700 1 -- 172.21.2.105:0/1583485728 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6d24042fe0 con 0x7f6d2c0b0030 2021-11-12T05:47:54.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.524+0000 7f6d31ad0700 1 -- 172.21.2.105:0/1583485728 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d2c0b0580 con 0x7f6d2c0b0030 2021-11-12T05:47:54.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.524+0000 7f6d28ff9700 1 -- 172.21.2.105:0/1583485728 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+16274 (secure 0 0 0) 0x7f6d24046600 con 0x7f6d2c0b0030 2021-11-12T05:47:54.529 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:54.529 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":97,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:47:52.445451+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:47:48.259327+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-11-12T05:47:49.399624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:47:54.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.524+0000 7f6d31ad0700 1 -- 172.21.2.105:0/1583485728 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6d10053660 msgr2=0x7f6d10055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:54.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.524+0000 7f6d31ad0700 1 --2- 172.21.2.105:0/1583485728 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6d10053660 0x7f6d10055b20 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f6d1400b000 tx=0x7f6d14009040).stop 2021-11-12T05:47:54.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.524+0000 7f6d31ad0700 1 -- 172.21.2.105:0/1583485728 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6d2c0b0030 msgr2=0x7f6d2c0652e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:54.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.524+0000 7f6d31ad0700 1 --2- 172.21.2.105:0/1583485728 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6d2c0b0030 0x7f6d2c0652e0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7f6d2c0b1ff0 tx=0x7f6d24008040).stop 2021-11-12T05:47:54.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.524+0000 7f6d31ad0700 1 -- 172.21.2.105:0/1583485728 shutdown_connections 2021-11-12T05:47:54.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.524+0000 7f6d31ad0700 1 --2- 172.21.2.105:0/1583485728 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6d10053660 0x7f6d10055b20 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:54.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.524+0000 7f6d31ad0700 1 --2- 172.21.2.105:0/1583485728 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6d2c0b0030 0x7f6d2c0652e0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:54.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.524+0000 7f6d31ad0700 1 --2- 172.21.2.105:0/1583485728 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6d2c063750 0x7f6d2c13e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:54.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.524+0000 7f6d31ad0700 1 --2- 172.21.2.105:0/1583485728 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6d0c004b10 0x7f6d2c146f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:54.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.524+0000 7f6d31ad0700 1 -- 172.21.2.105:0/1583485728 >> 172.21.2.105:0/1583485728 conn(0x7f6d2c0b9790 msgr2=0x7f6d2c05fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:54.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.524+0000 7f6d31ad0700 1 -- 172.21.2.105:0/1583485728 shutdown_connections 2021-11-12T05:47:54.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.524+0000 7f6d31ad0700 1 -- 172.21.2.105:0/1583485728 wait complete. 2021-11-12T05:47:54.536 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-12T05:47:48.259327+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '96', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2021-11-12T05:47:49.399624+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-12T05:47:54.537 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:47:54.590 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.584+0000 7f99f359b700 1 Processor -- start 2021-11-12T05:47:54.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.584+0000 7f99f359b700 1 -- start start 2021-11-12T05:47:54.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f359b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f99ec0aca40 0x7f99ec0ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:54.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f359b700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f99ec0b0520 0x7f99ec1473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:54.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f359b700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99ec0b1840 con 0x7f99ec1478b0 2021-11-12T05:47:54.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f359b700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99ec147d40 con 0x7f99ec0b0520 2021-11-12T05:47:54.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f359b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec0af2b0 con 0x7f99ec0aca40 2021-11-12T05:47:54.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f1b38700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f99ec1478b0 0x7f99ec144180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:59626/0 (socket says 172.21.2.105:59626) 2021-11-12T05:47:54.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f1b38700 1 -- 172.21.2.105:0/1169847020 learned_addr learned my addr 172.21.2.105:0/1169847020 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:54.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99dffff700 1 -- 172.21.2.105:0/1169847020 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 233703802 0 0) 0x7f99ec0b1840 con 0x7f99ec1478b0 2021-11-12T05:47:54.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99dffff700 1 -- 172.21.2.105:0/1169847020 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99d4003260 con 0x7f99ec1478b0 2021-11-12T05:47:54.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f1337700 1 --2- 172.21.2.105:0/1169847020 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f99ec0aca40 0x7f99ec0ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:54.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f0b36700 1 --2- 172.21.2.105:0/1169847020 >> v2:172.21.2.115:3300/0 conn(0x7f99ec0b0520 0x7f99ec1473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:54.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99dffff700 1 -- 172.21.2.105:0/1169847020 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1595915163 0 0) 0x7f99d4003260 con 0x7f99ec1478b0 2021-11-12T05:47:54.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99dffff700 1 -- 172.21.2.105:0/1169847020 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f99ec0aca40 msgr2=0x7f99ec0ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:54.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99dffff700 1 --2- 172.21.2.105:0/1169847020 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f99ec0aca40 0x7f99ec0ace20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:54.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99dffff700 1 -- 172.21.2.105:0/1169847020 >> v2:172.21.2.115:3300/0 conn(0x7f99ec0b0520 msgr2=0x7f99ec1473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:54.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99dffff700 1 --2- 172.21.2.105:0/1169847020 >> v2:172.21.2.115:3300/0 conn(0x7f99ec0b0520 0x7f99ec1473c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:54.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99dffff700 1 -- 172.21.2.105:0/1169847020 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ec0b09a0 con 0x7f99ec1478b0 2021-11-12T05:47:54.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99dffff700 1 -- 172.21.2.105:0/1169847020 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f99e40019e0 con 0x7f99ec1478b0 2021-11-12T05:47:54.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99dffff700 1 -- 172.21.2.105:0/1169847020 >> v1:172.21.2.105:6789/0 conn(0x7f99ec1478b0 legacy=0x7f99ec144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:54.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99dffff700 1 --2- 172.21.2.105:0/1169847020 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f99d40037d0 0x7f99d4003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:54.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99dffff700 1 --2- 172.21.2.105:0/1169847020 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f99ec0aca40 0x7f99d4004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:54.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99dffff700 1 --2- 172.21.2.105:0/1169847020 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99d40049f0 0x7f99d4004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:54.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99dffff700 1 -- 172.21.2.105:0/1169847020 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec147d40 con 0x7f99d40049f0 2021-11-12T05:47:54.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99dffff700 1 -- 172.21.2.105:0/1169847020 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec0af2b0 con 0x7f99d40037d0 2021-11-12T05:47:54.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99dffff700 1 -- 172.21.2.105:0/1169847020 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d400b880 con 0x7f99ec0aca40 2021-11-12T05:47:54.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f1b38700 1 --2- 172.21.2.105:0/1169847020 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99d40049f0 0x7f99d4004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:54.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f1b38700 1 -- 172.21.2.105:0/1169847020 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f99ec0aca40 msgr2=0x7f99d4004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:54.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f1b38700 1 --2- 172.21.2.105:0/1169847020 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f99ec0aca40 0x7f99d4004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:54.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f1b38700 1 -- 172.21.2.105:0/1169847020 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f99d40037d0 msgr2=0x7f99d4003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:54.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f1b38700 1 --2- 172.21.2.105:0/1169847020 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f99d40037d0 0x7f99d4003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:54.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f1b38700 1 -- 172.21.2.105:0/1169847020 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d4003260 con 0x7f99d40049f0 2021-11-12T05:47:54.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f1b38700 1 --2- 172.21.2.105:0/1169847020 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99d40049f0 0x7f99d4004e70 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7f99e40016f0 tx=0x7f99e4002100).ready entity=mon.0 client_cookie=a0f8816cb212a12b server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:54.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99dffff700 1 -- 172.21.2.105:0/1169847020 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99e400cb80 con 0x7f99d40049f0 2021-11-12T05:47:54.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99dffff700 1 -- 172.21.2.105:0/1169847020 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e400cce0 con 0x7f99d40049f0 2021-11-12T05:47:54.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99dffff700 1 -- 172.21.2.105:0/1169847020 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99e4005b80 con 0x7f99d40049f0 2021-11-12T05:47:54.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f359b700 1 -- 172.21.2.105:0/1169847020 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99d40049f0 msgr2=0x7f99d4004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:54.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f359b700 1 --2- 172.21.2.105:0/1169847020 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99d40049f0 0x7f99d4004e70 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7f99e40016f0 tx=0x7f99e4002100).stop 2021-11-12T05:47:54.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f1b38700 1 -- 172.21.2.105:0/1169847020 reap_dead start 2021-11-12T05:47:54.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f359b700 1 -- 172.21.2.105:0/1169847020 shutdown_connections 2021-11-12T05:47:54.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f359b700 1 -- 172.21.2.105:0/1169847020 >> 172.21.2.105:0/1169847020 conn(0x7f99ec05c490 msgr2=0x7f99ec0b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:54.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f359b700 1 -- 172.21.2.105:0/1169847020 shutdown_connections 2021-11-12T05:47:54.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f359b700 1 -- 172.21.2.105:0/1169847020 wait complete. 2021-11-12T05:47:54.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f359b700 1 Processor -- start 2021-11-12T05:47:54.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f359b700 1 -- start start 2021-11-12T05:47:54.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f359b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f99d40049f0 0x7f99ec147060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:54.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f359b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99ec0a9a60 0x7f99ec159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:54.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f359b700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f99ec0a8c90 0x7f99ec0ab5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:54.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f359b700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec0b4fa0 con 0x7f99ec0a9a60 2021-11-12T05:47:54.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f359b700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec0a9210 con 0x7f99ec0a8c90 2021-11-12T05:47:54.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f359b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec0a94b0 con 0x7f99d40049f0 2021-11-12T05:47:54.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f0b36700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99ec0a9a60 0x7f99ec159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:54.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f0b36700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99ec0a9a60 0x7f99ec159b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49242/0 (socket says 172.21.2.105:49242) 2021-11-12T05:47:54.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f0b36700 1 -- 172.21.2.105:0/4053429020 learned_addr learned my addr 172.21.2.105:0/4053429020 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:54.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f0b36700 1 -- 172.21.2.105:0/4053429020 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f99d40049f0 msgr2=0x7f99ec147060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:54.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f0b36700 1 --2- 172.21.2.105:0/4053429020 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f99d40049f0 0x7f99ec147060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:54.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f0b36700 1 -- 172.21.2.105:0/4053429020 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f99ec0a8c90 msgr2=0x7f99ec0ab5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:54.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f0b36700 1 --2- 172.21.2.105:0/4053429020 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f99ec0a8c90 0x7f99ec0ab5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:54.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f0b36700 1 -- 172.21.2.105:0/4053429020 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ec0a9750 con 0x7f99ec0a9a60 2021-11-12T05:47:54.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.588+0000 7f99f0b36700 1 --2- 172.21.2.105:0/4053429020 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99ec0a9a60 0x7f99ec159b20 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7f99e000a000 tx=0x7f99e0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:54.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.592+0000 7f99de7fc700 1 -- 172.21.2.105:0/4053429020 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99e0011500 con 0x7f99ec0a9a60 2021-11-12T05:47:54.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.592+0000 7f99de7fc700 1 -- 172.21.2.105:0/4053429020 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e0000e90 con 0x7f99ec0a9a60 2021-11-12T05:47:54.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.592+0000 7f99f359b700 1 -- 172.21.2.105:0/4053429020 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99ec0abac0 con 0x7f99ec0a9a60 2021-11-12T05:47:54.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.592+0000 7f99f359b700 1 -- 172.21.2.105:0/4053429020 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99ec0abf70 con 0x7f99ec0a9a60 2021-11-12T05:47:54.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.592+0000 7f99de7fc700 1 -- 172.21.2.105:0/4053429020 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99e0011850 con 0x7f99ec0a9a60 2021-11-12T05:47:54.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.592+0000 7f99f359b700 1 -- 172.21.2.105:0/4053429020 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99ec057350 con 0x7f99ec0a9a60 2021-11-12T05:47:54.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.592+0000 7f99de7fc700 1 -- 172.21.2.105:0/4053429020 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f99e0019020 con 0x7f99ec0a9a60 2021-11-12T05:47:54.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.592+0000 7f99de7fc700 1 --2- 172.21.2.105:0/4053429020 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f99cc0536f0 0x7f99cc055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:54.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.592+0000 7f99de7fc700 1 -- 172.21.2.105:0/4053429020 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f99e006b1f0 con 0x7f99ec0a9a60 2021-11-12T05:47:54.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.592+0000 7f99f1337700 1 --2- 172.21.2.105:0/4053429020 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f99cc0536f0 0x7f99cc055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:54.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.592+0000 7f99f1337700 1 --2- 172.21.2.105:0/4053429020 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f99cc0536f0 0x7f99cc055bb0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f99e800a000 tx=0x7f99e8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:54.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.592+0000 7f99de7fc700 1 -- 172.21.2.105:0/4053429020 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f99e0042200 con 0x7f99ec0a9a60 2021-11-12T05:47:54.682 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.676+0000 7f99f359b700 1 -- 172.21.2.105:0/4053429020 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f99ec05da10 con 0x7f99ec0a9a60 2021-11-12T05:47:54.683 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.676+0000 7f99de7fc700 1 -- 172.21.2.105:0/4053429020 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v97) v1 ==== 110+0+10 (secure 0 0 0) 0x7f99e0045820 con 0x7f99ec0a9a60 2021-11-12T05:47:54.683 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:47:54.684 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.680+0000 7f99f359b700 1 -- 172.21.2.105:0/4053429020 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f99cc0536f0 msgr2=0x7f99cc055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:54.684 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.680+0000 7f99f359b700 1 --2- 172.21.2.105:0/4053429020 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f99cc0536f0 0x7f99cc055bb0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f99e800a000 tx=0x7f99e8008040).stop 2021-11-12T05:47:54.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.680+0000 7f99f359b700 1 -- 172.21.2.105:0/4053429020 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99ec0a9a60 msgr2=0x7f99ec159b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:54.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.680+0000 7f99f359b700 1 --2- 172.21.2.105:0/4053429020 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99ec0a9a60 0x7f99ec159b20 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7f99e000a000 tx=0x7f99e0008040).stop 2021-11-12T05:47:54.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.680+0000 7f99f359b700 1 -- 172.21.2.105:0/4053429020 shutdown_connections 2021-11-12T05:47:54.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.680+0000 7f99f359b700 1 --2- 172.21.2.105:0/4053429020 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f99cc0536f0 0x7f99cc055bb0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:54.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.680+0000 7f99f359b700 1 --2- 172.21.2.105:0/4053429020 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f99ec0a8c90 0x7f99ec0ab5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:54.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.680+0000 7f99f359b700 1 --2- 172.21.2.105:0/4053429020 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f99ec0a9a60 0x7f99ec159b20 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:54.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.680+0000 7f99f359b700 1 --2- 172.21.2.105:0/4053429020 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f99d40049f0 0x7f99ec147060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:54.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.680+0000 7f99f359b700 1 -- 172.21.2.105:0/4053429020 >> 172.21.2.105:0/4053429020 conn(0x7f99ec05c490 msgr2=0x7f99ec1453b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:54.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.680+0000 7f99f359b700 1 -- 172.21.2.105:0/4053429020 shutdown_connections 2021-11-12T05:47:54.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.680+0000 7f99f359b700 1 -- 172.21.2.105:0/4053429020 wait complete. 2021-11-12T05:47:54.690 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:47:54.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.736+0000 7fcc62937700 1 Processor -- start 2021-11-12T05:47:54.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.736+0000 7fcc62937700 1 -- start start 2021-11-12T05:47:54.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.736+0000 7fcc62937700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fcc5c0aca40 0x7fcc5c0ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:54.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.736+0000 7fcc62937700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc5c0b1840 con 0x7fcc5c0b0520 2021-11-12T05:47:54.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.736+0000 7fcc62937700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc5c0b09d0 con 0x7fcc5c144180 2021-11-12T05:47:54.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.736+0000 7fcc62937700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc5c0af2b0 con 0x7fcc5c0aca40 2021-11-12T05:47:54.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.736+0000 7fcc5b7fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fcc5c0b0520 0x7fcc5c1473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:59642/0 (socket says 172.21.2.105:59642) 2021-11-12T05:47:54.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.736+0000 7fcc5b7fe700 1 -- 172.21.2.105:0/2080262905 learned_addr learned my addr 172.21.2.105:0/2080262905 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:54.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc5bfff700 1 --2- 172.21.2.105:0/2080262905 >> v2:172.21.2.115:3300/0 conn(0x7fcc5c0aca40 0x7fcc5c0ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:54.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc5affd700 1 -- 172.21.2.105:0/2080262905 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1728280212 0 0) 0x7fcc5c0b1840 con 0x7fcc5c0b0520 2021-11-12T05:47:54.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc5affd700 1 -- 172.21.2.105:0/2080262905 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc48003260 con 0x7fcc5c0b0520 2021-11-12T05:47:54.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc5affd700 1 -- 172.21.2.105:0/2080262905 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1574203840 0 0) 0x7fcc48003260 con 0x7fcc5c0b0520 2021-11-12T05:47:54.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc5affd700 1 -- 172.21.2.105:0/2080262905 >> v2:172.21.2.115:3300/0 conn(0x7fcc5c0aca40 msgr2=0x7fcc5c0ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:54.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc5affd700 1 --2- 172.21.2.105:0/2080262905 >> v2:172.21.2.115:3300/0 conn(0x7fcc5c0aca40 0x7fcc5c0ace20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:54.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc5affd700 1 -- 172.21.2.105:0/2080262905 >> v1:172.21.2.115:6789/0 conn(0x7fcc5c144180 legacy=0x7fcc5c1445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:54.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc5affd700 1 -- 172.21.2.105:0/2080262905 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5c0b1a70 con 0x7fcc5c0b0520 2021-11-12T05:47:54.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc5affd700 1 -- 172.21.2.105:0/2080262905 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fcc4c001660 con 0x7fcc5c0b0520 2021-11-12T05:47:54.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc5affd700 1 -- 172.21.2.105:0/2080262905 >> v1:172.21.2.105:6789/0 conn(0x7fcc5c0b0520 legacy=0x7fcc5c1473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:54.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc5affd700 1 --2- 172.21.2.105:0/2080262905 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcc48003750 0x7fcc48003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:54.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc5affd700 1 --2- 172.21.2.105:0/2080262905 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcc48004500 0x7fcc48004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:54.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc5affd700 1 --2- 172.21.2.105:0/2080262905 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcc48004e70 0x7fcc4800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:54.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc5affd700 1 -- 172.21.2.105:0/2080262905 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c0af2b0 con 0x7fcc48004500 2021-11-12T05:47:54.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc5affd700 1 -- 172.21.2.105:0/2080262905 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4800bd20 con 0x7fcc48003750 2021-11-12T05:47:54.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc5affd700 1 -- 172.21.2.105:0/2080262905 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4800bee0 con 0x7fcc48004e70 2021-11-12T05:47:54.750 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc5b7fe700 1 --2- 172.21.2.105:0/2080262905 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcc48004500 0x7fcc48004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:54.750 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc5b7fe700 1 -- 172.21.2.105:0/2080262905 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcc48004e70 msgr2=0x7fcc4800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:54.750 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc5b7fe700 1 --2- 172.21.2.105:0/2080262905 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcc48004e70 0x7fcc4800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:54.750 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc5b7fe700 1 -- 172.21.2.105:0/2080262905 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcc48003750 msgr2=0x7fcc48003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:54.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc5b7fe700 1 --2- 172.21.2.105:0/2080262905 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcc48003750 0x7fcc48003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:54.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc5b7fe700 1 -- 172.21.2.105:0/2080262905 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc48003260 con 0x7fcc48004500 2021-11-12T05:47:54.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc60ed4700 1 -- 172.21.2.105:0/2080262905 reap_dead start 2021-11-12T05:47:54.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc5b7fe700 1 --2- 172.21.2.105:0/2080262905 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcc48004500 0x7fcc48004980 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 rx=0x7fcc4c001370 tx=0x7fcc5c0ad870).ready entity=mon.0 client_cookie=b77d88d8c7536322 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:54.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc5affd700 1 -- 172.21.2.105:0/2080262905 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc4c0070d0 con 0x7fcc48004500 2021-11-12T05:47:54.752 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc5affd700 1 -- 172.21.2.105:0/2080262905 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc4c007230 con 0x7fcc48004500 2021-11-12T05:47:54.752 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc5affd700 1 -- 172.21.2.105:0/2080262905 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc4c00c8f0 con 0x7fcc48004500 2021-11-12T05:47:54.752 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc62937700 1 -- 172.21.2.105:0/2080262905 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcc48004500 msgr2=0x7fcc48004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:54.752 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc62937700 1 --2- 172.21.2.105:0/2080262905 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcc48004500 0x7fcc48004980 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 rx=0x7fcc4c001370 tx=0x7fcc5c0ad870).stop 2021-11-12T05:47:54.752 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc62937700 1 -- 172.21.2.105:0/2080262905 shutdown_connections 2021-11-12T05:47:54.753 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc62937700 1 --2- 172.21.2.105:0/2080262905 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcc48004500 0x7fcc48004980 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:54.753 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc62937700 1 -- 172.21.2.105:0/2080262905 >> 172.21.2.105:0/2080262905 conn(0x7fcc5c05c490 msgr2=0x7fcc5c0b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:54.753 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc62937700 1 -- 172.21.2.105:0/2080262905 shutdown_connections 2021-11-12T05:47:54.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc62937700 1 -- 172.21.2.105:0/2080262905 wait complete. 2021-11-12T05:47:54.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc62937700 1 Processor -- start 2021-11-12T05:47:54.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc62937700 1 -- start start 2021-11-12T05:47:54.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc62937700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcc48004500 0x7fcc5c0a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:54.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc62937700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcc5c0aa200 0x7fcc5c0aab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:54.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc62937700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcc5c0ab050 0x7fcc5c159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:54.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc62937700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c0a8e20 con 0x7fcc5c0ab050 2021-11-12T05:47:54.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc62937700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c065b70 con 0x7fcc48004500 2021-11-12T05:47:54.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc62937700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c066a60 con 0x7fcc5c0aa200 2021-11-12T05:47:54.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc60ed4700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcc5c0ab050 0x7fcc5c159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:54.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc60ed4700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcc5c0ab050 0x7fcc5c159fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49262/0 (socket says 172.21.2.105:49262) 2021-11-12T05:47:54.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.740+0000 7fcc60ed4700 1 -- 172.21.2.105:0/2253287738 learned_addr learned my addr 172.21.2.105:0/2253287738 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:54.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.744+0000 7fcc60ed4700 1 -- 172.21.2.105:0/2253287738 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcc5c0aa200 msgr2=0x7fcc5c0aab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:54.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.744+0000 7fcc60ed4700 1 --2- 172.21.2.105:0/2253287738 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcc5c0aa200 0x7fcc5c0aab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:54.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.744+0000 7fcc60ed4700 1 -- 172.21.2.105:0/2253287738 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcc48004500 msgr2=0x7fcc5c0a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:54.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.744+0000 7fcc60ed4700 1 --2- 172.21.2.105:0/2253287738 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcc48004500 0x7fcc5c0a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:54.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.744+0000 7fcc60ed4700 1 -- 172.21.2.105:0/2253287738 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5c0ac1a0 con 0x7fcc5c0ab050 2021-11-12T05:47:54.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.744+0000 7fcc60ed4700 1 --2- 172.21.2.105:0/2253287738 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcc5c0ab050 0x7fcc5c159fd0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7fcc4c001430 tx=0x7fcc54007d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:54.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.744+0000 7fcc597fa700 1 -- 172.21.2.105:0/2253287738 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc54005880 con 0x7fcc5c0ab050 2021-11-12T05:47:54.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.744+0000 7fcc597fa700 1 -- 172.21.2.105:0/2253287738 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc540059e0 con 0x7fcc5c0ab050 2021-11-12T05:47:54.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.744+0000 7fcc62937700 1 -- 172.21.2.105:0/2253287738 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc5c066e10 con 0x7fcc5c0ab050 2021-11-12T05:47:54.763 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.744+0000 7fcc597fa700 1 -- 172.21.2.105:0/2253287738 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc54005d40 con 0x7fcc5c0ab050 2021-11-12T05:47:54.763 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.744+0000 7fcc62937700 1 -- 172.21.2.105:0/2253287738 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc5c066720 con 0x7fcc5c0ab050 2021-11-12T05:47:54.763 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.744+0000 7fcc62937700 1 -- 172.21.2.105:0/2253287738 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc5c066ba0 con 0x7fcc5c0ab050 2021-11-12T05:47:54.763 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.744+0000 7fcc597fa700 1 -- 172.21.2.105:0/2253287738 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcc54010070 con 0x7fcc5c0ab050 2021-11-12T05:47:54.764 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.744+0000 7fcc597fa700 1 --2- 172.21.2.105:0/2253287738 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcc3c0536f0 0x7fcc3c055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:54.764 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.744+0000 7fcc597fa700 1 -- 172.21.2.105:0/2253287738 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fcc5406add0 con 0x7fcc5c0ab050 2021-11-12T05:47:54.764 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.744+0000 7fcc5bfff700 1 --2- 172.21.2.105:0/2253287738 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcc3c0536f0 0x7fcc3c055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:54.764 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.744+0000 7fcc5bfff700 1 --2- 172.21.2.105:0/2253287738 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcc3c0536f0 0x7fcc3c055bb0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fcc5000c000 tx=0x7fcc50006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:54.764 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.748+0000 7fcc597fa700 1 -- 172.21.2.105:0/2253287738 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcc54041cd0 con 0x7fcc5c0ab050 2021-11-12T05:47:54.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.828+0000 7fcc62937700 1 -- 172.21.2.105:0/2253287738 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcc5c0b09d0 con 0x7fcc5c0ab050 2021-11-12T05:47:54.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.828+0000 7fcc597fa700 1 -- 172.21.2.105:0/2253287738 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v97) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcc5c0b09d0 con 0x7fcc5c0ab050 2021-11-12T05:47:54.834 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:47:54.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.828+0000 7fcc62937700 1 -- 172.21.2.105:0/2253287738 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcc3c0536f0 msgr2=0x7fcc3c055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:54.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.828+0000 7fcc62937700 1 --2- 172.21.2.105:0/2253287738 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcc3c0536f0 0x7fcc3c055bb0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fcc5000c000 tx=0x7fcc50006df0).stop 2021-11-12T05:47:54.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.828+0000 7fcc62937700 1 -- 172.21.2.105:0/2253287738 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcc5c0ab050 msgr2=0x7fcc5c159fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:54.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.828+0000 7fcc62937700 1 --2- 172.21.2.105:0/2253287738 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcc5c0ab050 0x7fcc5c159fd0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7fcc4c001430 tx=0x7fcc54007d80).stop 2021-11-12T05:47:54.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.828+0000 7fcc62937700 1 -- 172.21.2.105:0/2253287738 shutdown_connections 2021-11-12T05:47:54.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.828+0000 7fcc62937700 1 --2- 172.21.2.105:0/2253287738 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcc3c0536f0 0x7fcc3c055bb0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:54.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.828+0000 7fcc62937700 1 --2- 172.21.2.105:0/2253287738 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcc5c0ab050 0x7fcc5c159fd0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:54.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.828+0000 7fcc62937700 1 --2- 172.21.2.105:0/2253287738 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcc5c0aa200 0x7fcc5c0aab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:54.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.828+0000 7fcc62937700 1 --2- 172.21.2.105:0/2253287738 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcc48004500 0x7fcc5c0a9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:54.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.828+0000 7fcc62937700 1 -- 172.21.2.105:0/2253287738 >> 172.21.2.105:0/2253287738 conn(0x7fcc5c05c490 msgr2=0x7fcc5c0b3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:54.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.828+0000 7fcc62937700 1 -- 172.21.2.105:0/2253287738 shutdown_connections 2021-11-12T05:47:54.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.828+0000 7fcc62937700 1 -- 172.21.2.105:0/2253287738 wait complete. 2021-11-12T05:47:54.841 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-12T05:47:54.894 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.888+0000 7f37302d6700 1 Processor -- start 2021-11-12T05:47:54.895 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.888+0000 7f37302d6700 1 -- start start 2021-11-12T05:47:54.896 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f37302d6700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f37280626b0 0x7f3728062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:54.897 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f37302d6700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f3728130a80 0x7f37281474d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:54.897 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f37302d6700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37280b0d50 con 0x7f37280af750 2021-11-12T05:47:54.897 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f37302d6700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37280ad380 con 0x7f3728130a80 2021-11-12T05:47:54.897 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f37302d6700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37280ae190 con 0x7f37280626b0 2021-11-12T05:47:54.898 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f372d871700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f37280af750 0x7f3728130370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:59664/0 (socket says 172.21.2.105:59664) 2021-11-12T05:47:54.898 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f372d871700 1 -- 172.21.2.105:0/2288248091 learned_addr learned my addr 172.21.2.105:0/2288248091 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:54.898 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f372e873700 1 --2- 172.21.2.105:0/2288248091 >> v2:172.21.2.105:3300/0 conn(0x7f3728130a80 0x7f37281474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:54.898 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f372e873700 1 -- 172.21.2.105:0/2288248091 >> v2:172.21.2.115:3300/0 conn(0x7f37280626b0 msgr2=0x7f3728062a90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:47:54.898 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f372e873700 1 --2- 172.21.2.105:0/2288248091 >> v2:172.21.2.115:3300/0 conn(0x7f37280626b0 0x7f3728062a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:54.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f372e873700 1 -- 172.21.2.105:0/2288248091 >> v1:172.21.2.105:6789/0 conn(0x7f37280af750 legacy=0x7f3728130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:54.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f372e873700 1 -- 172.21.2.105:0/2288248091 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37281479c0 con 0x7f3728130a80 2021-11-12T05:47:54.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f372e873700 1 --2- 172.21.2.105:0/2288248091 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3728130a80 0x7f37281474d0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7f37200032f0 tx=0x7f37200091d0).ready entity=mon.0 client_cookie=faf3e8615a6ee43c server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:54.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f372d070700 1 -- 172.21.2.105:0/2288248091 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3720009ea0 con 0x7f3728130a80 2021-11-12T05:47:54.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f372d070700 1 -- 172.21.2.105:0/2288248091 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f372000b870 con 0x7f3728130a80 2021-11-12T05:47:54.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f372d070700 1 -- 172.21.2.105:0/2288248091 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f372000ba20 con 0x7f3728130a80 2021-11-12T05:47:54.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f37302d6700 1 -- 172.21.2.105:0/2288248091 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3728130a80 msgr2=0x7f37281474d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:54.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f37302d6700 1 --2- 172.21.2.105:0/2288248091 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3728130a80 0x7f37281474d0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7f37200032f0 tx=0x7f37200091d0).stop 2021-11-12T05:47:54.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f37302d6700 1 -- 172.21.2.105:0/2288248091 shutdown_connections 2021-11-12T05:47:54.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f37302d6700 1 --2- 172.21.2.105:0/2288248091 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3728130a80 0x7f37281474d0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:54.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f37302d6700 1 --2- 172.21.2.105:0/2288248091 >> v2:172.21.2.115:3300/0 conn(0x7f37280626b0 0x7f3728062a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:54.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f37302d6700 1 -- 172.21.2.105:0/2288248091 >> 172.21.2.105:0/2288248091 conn(0x7f37280b5320 msgr2=0x7f37280b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:54.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f37302d6700 1 -- 172.21.2.105:0/2288248091 shutdown_connections 2021-11-12T05:47:54.902 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f37302d6700 1 -- 172.21.2.105:0/2288248091 wait complete. 2021-11-12T05:47:54.902 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f37302d6700 1 Processor -- start 2021-11-12T05:47:54.902 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f37302d6700 1 -- start start 2021-11-12T05:47:54.904 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f37302d6700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f37280626b0 0x7f372812f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:54.904 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f37302d6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f37280af750 0x7f372814ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:54.905 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f37302d6700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3728130a80 0x7f37281489e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:54.905 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f37302d6700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37281574e0 con 0x7f37280af750 2021-11-12T05:47:54.905 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f37302d6700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3728157740 con 0x7f3728130a80 2021-11-12T05:47:54.905 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f37302d6700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37281579e0 con 0x7f37280626b0 2021-11-12T05:47:54.906 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f372d871700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f37280af750 0x7f372814ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:54.906 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f372d871700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f37280af750 0x7f372814ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49276/0 (socket says 172.21.2.105:49276) 2021-11-12T05:47:54.906 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f372d871700 1 -- 172.21.2.105:0/323274228 learned_addr learned my addr 172.21.2.105:0/323274228 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:54.906 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f372d871700 1 -- 172.21.2.105:0/323274228 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f37280626b0 msgr2=0x7f372812f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:54.906 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f372d871700 1 --2- 172.21.2.105:0/323274228 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f37280626b0 0x7f372812f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:54.907 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f372d871700 1 -- 172.21.2.105:0/323274228 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3728130a80 msgr2=0x7f37281489e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:54.907 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f372d871700 1 --2- 172.21.2.105:0/323274228 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3728130a80 0x7f37281489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:54.907 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f372d871700 1 -- 172.21.2.105:0/323274228 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3720009470 con 0x7f37280af750 2021-11-12T05:47:54.907 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f372d871700 1 --2- 172.21.2.105:0/323274228 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f37280af750 0x7f372814ac40 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 rx=0x7f37280b0690 tx=0x7f3724007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:54.908 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f371b7fe700 1 -- 172.21.2.105:0/323274228 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f372400ce30 con 0x7f37280af750 2021-11-12T05:47:54.908 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f371b7fe700 1 -- 172.21.2.105:0/323274228 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37240072e0 con 0x7f37280af750 2021-11-12T05:47:54.908 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f37302d6700 1 -- 172.21.2.105:0/323274228 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f372812e410 con 0x7f37280af750 2021-11-12T05:47:54.908 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f371b7fe700 1 -- 172.21.2.105:0/323274228 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3724005800 con 0x7f37280af750 2021-11-12T05:47:54.909 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.892+0000 7f37302d6700 1 -- 172.21.2.105:0/323274228 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f372814a940 con 0x7f37280af750 2021-11-12T05:47:54.909 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.896+0000 7f37302d6700 1 -- 172.21.2.105:0/323274228 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3728057350 con 0x7f37280af750 2021-11-12T05:47:54.909 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.896+0000 7f371b7fe700 1 -- 172.21.2.105:0/323274228 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3724010070 con 0x7f37280af750 2021-11-12T05:47:54.909 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.896+0000 7f371b7fe700 1 --2- 172.21.2.105:0/323274228 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3708053610 0x7f3708055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:54.909 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.896+0000 7f371b7fe700 1 -- 172.21.2.105:0/323274228 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f372406b220 con 0x7f37280af750 2021-11-12T05:47:54.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.896+0000 7f372e072700 1 --2- 172.21.2.105:0/323274228 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3708053610 0x7f3708055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:54.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.896+0000 7f372e072700 1 --2- 172.21.2.105:0/323274228 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3708053610 0x7f3708055ad0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f371c002fb0 tx=0x7f371c0069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:54.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.896+0000 7f371b7fe700 1 -- 172.21.2.105:0/323274228 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3724042120 con 0x7f37280af750 2021-11-12T05:47:54.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.980+0000 7f37302d6700 1 -- 172.21.2.105:0/323274228 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f37280b17c0 con 0x7f37280af750 2021-11-12T05:47:54.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.980+0000 7f371b7fe700 1 -- 172.21.2.105:0/323274228 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v97) v1 ==== 104+0+10 (secure 0 0 0) 0x7f3724045740 con 0x7f37280af750 2021-11-12T05:47:54.987 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:47:54.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.984+0000 7f37302d6700 1 -- 172.21.2.105:0/323274228 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3708053610 msgr2=0x7f3708055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:54.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.984+0000 7f37302d6700 1 --2- 172.21.2.105:0/323274228 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3708053610 0x7f3708055ad0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f371c002fb0 tx=0x7f371c0069b0).stop 2021-11-12T05:47:54.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.984+0000 7f37302d6700 1 -- 172.21.2.105:0/323274228 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f37280af750 msgr2=0x7f372814ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:54.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.984+0000 7f37302d6700 1 --2- 172.21.2.105:0/323274228 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f37280af750 0x7f372814ac40 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 rx=0x7f37280b0690 tx=0x7f3724007c10).stop 2021-11-12T05:47:54.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.984+0000 7f37302d6700 1 -- 172.21.2.105:0/323274228 shutdown_connections 2021-11-12T05:47:54.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.984+0000 7f37302d6700 1 --2- 172.21.2.105:0/323274228 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3708053610 0x7f3708055ad0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:54.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.984+0000 7f37302d6700 1 --2- 172.21.2.105:0/323274228 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3728130a80 0x7f37281489e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:54.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.984+0000 7f37302d6700 1 --2- 172.21.2.105:0/323274228 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f37280af750 0x7f372814ac40 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:54.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.984+0000 7f37302d6700 1 --2- 172.21.2.105:0/323274228 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f37280626b0 0x7f372812f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:54.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.984+0000 7f37302d6700 1 -- 172.21.2.105:0/323274228 >> 172.21.2.105:0/323274228 conn(0x7f37280b5320 msgr2=0x7f37280b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:54.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.984+0000 7f37302d6700 1 -- 172.21.2.105:0/323274228 shutdown_connections 2021-11-12T05:47:54.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:54.984+0000 7f37302d6700 1 -- 172.21.2.105:0/323274228 wait complete. 2021-11-12T05:47:54.994 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-12T05:47:55.038 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:47:55.040 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:47:55.044 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:47:55.045 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.040+0000 7f20642da700 1 Processor -- start 2021-11-12T05:47:55.045 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.040+0000 7f20642da700 1 -- start start 2021-11-12T05:47:55.048 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.040+0000 7f20642da700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f205c0b7c80 0x7f205c067170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:55.048 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.040+0000 7f20642da700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f205c064900 0x7f205c064d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:55.049 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.040+0000 7f20642da700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f205c0b8060 con 0x7f205c065250 2021-11-12T05:47:55.049 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.040+0000 7f20642da700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f205c067d80 con 0x7f205c064900 2021-11-12T05:47:55.049 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.040+0000 7f20642da700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f205c067660 con 0x7f205c0b7c80 2021-11-12T05:47:55.049 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.040+0000 7f2061875700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f205c064900 0x7f205c064d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:55.049 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.040+0000 7f2061875700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f205c064900 0x7f205c064d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49280/0 (socket says 172.21.2.105:49280) 2021-11-12T05:47:55.050 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.040+0000 7f2061875700 1 -- 172.21.2.105:0/1082293732 learned_addr learned my addr 172.21.2.105:0/1082293732 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:55.050 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.040+0000 7f2061875700 1 -- 172.21.2.105:0/1082293732 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f205c0b7c80 msgr2=0x7f205c067170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:55.050 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.040+0000 7f2061875700 1 --2- 172.21.2.105:0/1082293732 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f205c0b7c80 0x7f205c067170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:55.050 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.040+0000 7f2061875700 1 -- 172.21.2.105:0/1082293732 >> v1:172.21.2.115:6789/0 conn(0x7f205c065250 legacy=0x7f205c144560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:55.051 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f2061875700 1 -- 172.21.2.105:0/1082293732 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f205c065670 con 0x7f205c064900 2021-11-12T05:47:55.051 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f2061875700 1 --2- 172.21.2.105:0/1082293732 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f205c064900 0x7f205c064d60 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 rx=0x7f205c0611f0 tx=0x7f2050006eb0).ready entity=mon.0 client_cookie=d0a94bfdf2d657f2 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:55.051 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f2061074700 1 -- 172.21.2.105:0/1082293732 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f205000d570 con 0x7f205c064900 2021-11-12T05:47:55.051 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f2061074700 1 -- 172.21.2.105:0/1082293732 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2050000e90 con 0x7f205c064900 2021-11-12T05:47:55.051 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f2061074700 1 -- 172.21.2.105:0/1082293732 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f205000d8c0 con 0x7f205c064900 2021-11-12T05:47:55.052 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f20642da700 1 -- 172.21.2.105:0/1082293732 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f205c064900 msgr2=0x7f205c064d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:55.052 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f20642da700 1 --2- 172.21.2.105:0/1082293732 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f205c064900 0x7f205c064d60 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 rx=0x7f205c0611f0 tx=0x7f2050006eb0).stop 2021-11-12T05:47:55.052 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f20642da700 1 -- 172.21.2.105:0/1082293732 shutdown_connections 2021-11-12T05:47:55.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f20642da700 1 --2- 172.21.2.105:0/1082293732 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f205c064900 0x7f205c064d60 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:55.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f20642da700 1 --2- 172.21.2.105:0/1082293732 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f205c0b7c80 0x7f205c067170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:55.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f20642da700 1 -- 172.21.2.105:0/1082293732 >> 172.21.2.105:0/1082293732 conn(0x7f205c05c860 msgr2=0x7f205c0608d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:55.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f20642da700 1 -- 172.21.2.105:0/1082293732 shutdown_connections 2021-11-12T05:47:55.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f20642da700 1 -- 172.21.2.105:0/1082293732 wait complete. 2021-11-12T05:47:55.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f20642da700 1 Processor -- start 2021-11-12T05:47:55.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f20642da700 1 -- start start 2021-11-12T05:47:55.055 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:47:55.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f20642da700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f205c064900 0x7f205c140800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:55.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f20642da700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f205c065250 0x7f205c0b6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:55.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f20642da700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f205c0b7c80 0x7f205c140db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:55.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f20642da700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f205c13cf70 con 0x7f205c065250 2021-11-12T05:47:55.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f20642da700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f205c13ccd0 con 0x7f205c064900 2021-11-12T05:47:55.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f20642da700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f205c15a160 con 0x7f205c0b7c80 2021-11-12T05:47:55.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f2061875700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f205c065250 0x7f205c0b6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:55.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f2061875700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f205c065250 0x7f205c0b6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49284/0 (socket says 172.21.2.105:49284) 2021-11-12T05:47:55.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f2061875700 1 -- 172.21.2.105:0/1168001346 learned_addr learned my addr 172.21.2.105:0/1168001346 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:55.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f2062877700 1 --2- 172.21.2.105:0/1168001346 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f205c0b7c80 0x7f205c140db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:55.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f2062076700 1 --2- 172.21.2.105:0/1168001346 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f205c064900 0x7f205c140800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:55.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f2061875700 1 -- 172.21.2.105:0/1168001346 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f205c0b7c80 msgr2=0x7f205c140db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:55.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f2061875700 1 --2- 172.21.2.105:0/1168001346 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f205c0b7c80 0x7f205c140db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:55.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f2061875700 1 -- 172.21.2.105:0/1168001346 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f205c064900 msgr2=0x7f205c140800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:55.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f2061875700 1 --2- 172.21.2.105:0/1168001346 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f205c064900 0x7f205c140800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:55.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f2061875700 1 -- 172.21.2.105:0/1168001346 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f205000b1e0 con 0x7f205c065250 2021-11-12T05:47:55.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f2062076700 1 --2- 172.21.2.105:0/1168001346 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f205c064900 0x7f205c140800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:47:55.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f2062877700 1 --2- 172.21.2.105:0/1168001346 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f205c0b7c80 0x7f205c140db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:47:55.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f2061875700 1 --2- 172.21.2.105:0/1168001346 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f205c065250 0x7f205c0b6b80 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7f205c0611f0 tx=0x7f2050015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:55.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f204f7fe700 1 -- 172.21.2.105:0/1168001346 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2050002f70 con 0x7f205c065250 2021-11-12T05:47:55.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f204f7fe700 1 -- 172.21.2.105:0/1168001346 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f205000de20 con 0x7f205c065250 2021-11-12T05:47:55.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f20642da700 1 -- 172.21.2.105:0/1168001346 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f205c1412a0 con 0x7f205c065250 2021-11-12T05:47:55.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f204f7fe700 1 -- 172.21.2.105:0/1168001346 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f205001e460 con 0x7f205c065250 2021-11-12T05:47:55.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.044+0000 7f20642da700 1 -- 172.21.2.105:0/1168001346 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f205c13c970 con 0x7f205c065250 2021-11-12T05:47:55.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.048+0000 7f20642da700 1 -- 172.21.2.105:0/1168001346 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f205c141ec0 con 0x7f205c065250 2021-11-12T05:47:55.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.048+0000 7f204f7fe700 1 -- 172.21.2.105:0/1168001346 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2050025030 con 0x7f205c065250 2021-11-12T05:47:55.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.048+0000 7f204f7fe700 1 --2- 172.21.2.105:0/1168001346 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f203c0534f0 0x7f203c0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:55.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.048+0000 7f204f7fe700 1 -- 172.21.2.105:0/1168001346 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f205006d020 con 0x7f205c065250 2021-11-12T05:47:55.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.048+0000 7f2062076700 1 --2- 172.21.2.105:0/1168001346 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f203c0534f0 0x7f203c0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:55.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.048+0000 7f2062076700 1 --2- 172.21.2.105:0/1168001346 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f203c0534f0 0x7f203c0559b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f205800a000 tx=0x7f2058008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:55.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.048+0000 7f204f7fe700 1 -- 172.21.2.105:0/1168001346 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2050043f20 con 0x7f205c065250 2021-11-12T05:47:55.067 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:47:55.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.132+0000 7f20642da700 1 -- 172.21.2.105:0/1168001346 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f205c057350 con 0x7f205c065250 2021-11-12T05:47:55.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.132+0000 7f204f7fe700 1 -- 172.21.2.105:0/1168001346 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v97) v1 ==== 100+0+10 (secure 0 0 0) 0x7f2050023020 con 0x7f205c065250 2021-11-12T05:47:55.138 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:47:55.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.132+0000 7f20642da700 1 -- 172.21.2.105:0/1168001346 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f203c0534f0 msgr2=0x7f203c0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:55.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.132+0000 7f20642da700 1 --2- 172.21.2.105:0/1168001346 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f203c0534f0 0x7f203c0559b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f205800a000 tx=0x7f2058008040).stop 2021-11-12T05:47:55.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.132+0000 7f20642da700 1 -- 172.21.2.105:0/1168001346 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f205c065250 msgr2=0x7f205c0b6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:55.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.132+0000 7f20642da700 1 --2- 172.21.2.105:0/1168001346 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f205c065250 0x7f205c0b6b80 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7f205c0611f0 tx=0x7f2050015000).stop 2021-11-12T05:47:55.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.132+0000 7f20642da700 1 -- 172.21.2.105:0/1168001346 shutdown_connections 2021-11-12T05:47:55.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.132+0000 7f20642da700 1 --2- 172.21.2.105:0/1168001346 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f203c0534f0 0x7f203c0559b0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:55.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.132+0000 7f20642da700 1 --2- 172.21.2.105:0/1168001346 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f205c0b7c80 0x7f205c140db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:55.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.132+0000 7f20642da700 1 --2- 172.21.2.105:0/1168001346 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f205c065250 0x7f205c0b6b80 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:55.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.132+0000 7f20642da700 1 --2- 172.21.2.105:0/1168001346 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f205c064900 0x7f205c140800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:55.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.132+0000 7f20642da700 1 -- 172.21.2.105:0/1168001346 >> 172.21.2.105:0/1168001346 conn(0x7f205c05c860 msgr2=0x7f205c0b0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:55.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.136+0000 7f20642da700 1 -- 172.21.2.105:0/1168001346 shutdown_connections 2021-11-12T05:47:55.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.136+0000 7f20642da700 1 -- 172.21.2.105:0/1168001346 wait complete. 2021-11-12T05:47:55.146 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-12T05:47:55.146 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:47:55.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.192+0000 7fb56165f700 1 Processor -- start 2021-11-12T05:47:55.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.192+0000 7fb56165f700 1 -- start start 2021-11-12T05:47:55.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.192+0000 7fb56165f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb55c0ad080 0x7fb55c0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:55.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.192+0000 7fb56165f700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fb55c14b2f0 0x7fb55c0ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:55.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.192+0000 7fb56165f700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb55c0ac7b0 con 0x7fb55c0ac280 2021-11-12T05:47:55.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.192+0000 7fb56165f700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb55c1488a0 con 0x7fb55c14b2f0 2021-11-12T05:47:55.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.192+0000 7fb56165f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c0ac9e0 con 0x7fb55c0ad080 2021-11-12T05:47:55.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb55a7fc700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fb55c0ac280 0x7fb55c14abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:59688/0 (socket says 172.21.2.105:59688) 2021-11-12T05:47:55.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb55a7fc700 1 -- 172.21.2.105:0/3237867210 learned_addr learned my addr 172.21.2.105:0/3237867210 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:55.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb559ffb700 1 -- 172.21.2.105:0/3237867210 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3925409363 0 0) 0x7fb55c0ac7b0 con 0x7fb55c0ac280 2021-11-12T05:47:55.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb559ffb700 1 -- 172.21.2.105:0/3237867210 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb540003260 con 0x7fb55c0ac280 2021-11-12T05:47:55.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb559ffb700 1 -- 172.21.2.105:0/3237867210 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4056028803 0 0) 0x7fb540003260 con 0x7fb55c0ac280 2021-11-12T05:47:55.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb559ffb700 1 -- 172.21.2.105:0/3237867210 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb55c0ad080 msgr2=0x7fb55c0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:55.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb559ffb700 1 --2- 172.21.2.105:0/3237867210 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb55c0ad080 0x7fb55c0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:55.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb559ffb700 1 -- 172.21.2.105:0/3237867210 >> v2:172.21.2.115:3300/0 conn(0x7fb55c14b2f0 msgr2=0x7fb55c0ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:55.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb559ffb700 1 --2- 172.21.2.105:0/3237867210 >> v2:172.21.2.115:3300/0 conn(0x7fb55c14b2f0 0x7fb55c0ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:55.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb559ffb700 1 -- 172.21.2.105:0/3237867210 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55c0b0b30 con 0x7fb55c0ac280 2021-11-12T05:47:55.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb559ffb700 1 -- 172.21.2.105:0/3237867210 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fb5540019e0 con 0x7fb55c0ac280 2021-11-12T05:47:55.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb559ffb700 1 -- 172.21.2.105:0/3237867210 >> v1:172.21.2.105:6789/0 conn(0x7fb55c0ac280 legacy=0x7fb55c14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:55.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb559ffb700 1 --2- 172.21.2.105:0/3237867210 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb540003750 0x7fb540003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:55.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb559ffb700 1 --2- 172.21.2.105:0/3237867210 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb55c0ad080 0x7fb540004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:55.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb559ffb700 1 --2- 172.21.2.105:0/3237867210 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb540004b10 0x7fb540004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:55.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb559ffb700 1 -- 172.21.2.105:0/3237867210 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c1488a0 con 0x7fb540003750 2021-11-12T05:47:55.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb559ffb700 1 -- 172.21.2.105:0/3237867210 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c0ac9e0 con 0x7fb540004b10 2021-11-12T05:47:55.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb559ffb700 1 -- 172.21.2.105:0/3237867210 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54000b990 con 0x7fb55c0ad080 2021-11-12T05:47:55.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb55affd700 1 --2- 172.21.2.105:0/3237867210 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb540003750 0x7fb540003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:55.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb55a7fc700 1 --2- 172.21.2.105:0/3237867210 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb55c0ad080 0x7fb540004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:55.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb55affd700 1 -- 172.21.2.105:0/3237867210 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb55c0ad080 msgr2=0x7fb540004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:55.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb55affd700 1 --2- 172.21.2.105:0/3237867210 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb55c0ad080 0x7fb540004500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:55.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb55affd700 1 -- 172.21.2.105:0/3237867210 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb540004b10 msgr2=0x7fb540004f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:55.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb55affd700 1 --2- 172.21.2.105:0/3237867210 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb540004b10 0x7fb540004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:55.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb55affd700 1 -- 172.21.2.105:0/3237867210 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb540003260 con 0x7fb540003750 2021-11-12T05:47:55.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb55affd700 1 --2- 172.21.2.105:0/3237867210 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb540003750 0x7fb540003b70 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7fb550002f70 tx=0x7fb550006ca0).ready entity=mon.0 client_cookie=7ce57e1c09e09073 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:55.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb559ffb700 1 -- 172.21.2.105:0/3237867210 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb550013410 con 0x7fb540003750 2021-11-12T05:47:55.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb559ffb700 1 -- 172.21.2.105:0/3237867210 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb550013570 con 0x7fb540003750 2021-11-12T05:47:55.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb559ffb700 1 -- 172.21.2.105:0/3237867210 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5500138d0 con 0x7fb540003750 2021-11-12T05:47:55.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb56165f700 1 -- 172.21.2.105:0/3237867210 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb540003750 msgr2=0x7fb540003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:55.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb56165f700 1 --2- 172.21.2.105:0/3237867210 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb540003750 0x7fb540003b70 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7fb550002f70 tx=0x7fb550006ca0).stop 2021-11-12T05:47:55.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb55b7fe700 1 -- 172.21.2.105:0/3237867210 reap_dead start 2021-11-12T05:47:55.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb56165f700 1 -- 172.21.2.105:0/3237867210 shutdown_connections 2021-11-12T05:47:55.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb56165f700 1 -- 172.21.2.105:0/3237867210 >> 172.21.2.105:0/3237867210 conn(0x7fb55c0b5370 msgr2=0x7fb55c0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:55.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb56165f700 1 -- 172.21.2.105:0/3237867210 shutdown_connections 2021-11-12T05:47:55.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb56165f700 1 -- 172.21.2.105:0/3237867210 wait complete. 2021-11-12T05:47:55.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb56165f700 1 Processor -- start 2021-11-12T05:47:55.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb56165f700 1 -- start start 2021-11-12T05:47:55.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb56165f700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb540003750 0x7fb55c0a7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:55.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb56165f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb55c148eb0 0x7fb55c0ab890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:55.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb56165f700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb55c15a700 0x7fb55c15ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:55.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb56165f700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c149310 con 0x7fb55c15a700 2021-11-12T05:47:55.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb56165f700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c15a2d0 con 0x7fb540003750 2021-11-12T05:47:55.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb56165f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c0a7a90 con 0x7fb55c148eb0 2021-11-12T05:47:55.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb55b7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb55c15a700 0x7fb55c15ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:55.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb55b7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb55c15a700 0x7fb55c15ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49308/0 (socket says 172.21.2.105:49308) 2021-11-12T05:47:55.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb55b7fe700 1 -- 172.21.2.105:0/268703393 learned_addr learned my addr 172.21.2.105:0/268703393 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:55.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb55a7fc700 1 --2- 172.21.2.105:0/268703393 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb55c148eb0 0x7fb55c0ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:55.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb55b7fe700 1 -- 172.21.2.105:0/268703393 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb55c148eb0 msgr2=0x7fb55c0ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:55.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb55b7fe700 1 --2- 172.21.2.105:0/268703393 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb55c148eb0 0x7fb55c0ab890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:55.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb55b7fe700 1 -- 172.21.2.105:0/268703393 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb540003750 msgr2=0x7fb55c0a7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:55.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb55b7fe700 1 --2- 172.21.2.105:0/268703393 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb540003750 0x7fb55c0a7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:55.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb55b7fe700 1 -- 172.21.2.105:0/268703393 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55c0a7d30 con 0x7fb55c15a700 2021-11-12T05:47:55.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb55b7fe700 1 --2- 172.21.2.105:0/268703393 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb55c15a700 0x7fb55c15ab80 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7fb5540016f0 tx=0x7fb54c007be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:55.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb54bfff700 1 -- 172.21.2.105:0/268703393 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb54c00ac20 con 0x7fb55c15a700 2021-11-12T05:47:55.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb54bfff700 1 -- 172.21.2.105:0/268703393 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54c00ad80 con 0x7fb55c15a700 2021-11-12T05:47:55.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb56165f700 1 -- 172.21.2.105:0/268703393 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb55c15b070 con 0x7fb55c15a700 2021-11-12T05:47:55.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb54bfff700 1 -- 172.21.2.105:0/268703393 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb54c007260 con 0x7fb55c15a700 2021-11-12T05:47:55.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.196+0000 7fb56165f700 1 -- 172.21.2.105:0/268703393 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb55c14a020 con 0x7fb55c15a700 2021-11-12T05:47:55.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.200+0000 7fb56165f700 1 -- 172.21.2.105:0/268703393 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb55c0b1440 con 0x7fb55c15a700 2021-11-12T05:47:55.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.200+0000 7fb54bfff700 1 -- 172.21.2.105:0/268703393 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb54c01b060 con 0x7fb55c15a700 2021-11-12T05:47:55.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.200+0000 7fb54bfff700 1 --2- 172.21.2.105:0/268703393 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb5380536a0 0x7fb538055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:55.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.200+0000 7fb54bfff700 1 -- 172.21.2.105:0/268703393 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fb54c06ace0 con 0x7fb55c15a700 2021-11-12T05:47:55.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.200+0000 7fb55affd700 1 --2- 172.21.2.105:0/268703393 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb5380536a0 0x7fb538055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:55.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.200+0000 7fb55affd700 1 --2- 172.21.2.105:0/268703393 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb5380536a0 0x7fb538055b60 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7fb550002f70 tx=0x7fb550014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:55.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.200+0000 7fb54bfff700 1 -- 172.21.2.105:0/268703393 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb54c041cf0 con 0x7fb55c15a700 2021-11-12T05:47:55.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.312+0000 7fb56165f700 1 -- 172.21.2.105:0/268703393 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb55c057350 con 0x7fb55c15a700 2021-11-12T05:47:55.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.312+0000 7fb54bfff700 1 -- 172.21.2.105:0/268703393 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+2140 (secure 0 0 0) 0x7fb54c019030 con 0x7fb55c15a700 2021-11-12T05:47:55.317 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:55.317 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":44,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4751,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/3227424218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":3227424218},{"type":"v1","addr":"172.21.2.115:6833","nonce":3227424218}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":43}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:47:50.427589+0000","modified":"2021-11-12T05:47:51.432486+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7017":{"gid":7017,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/3298879485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":3298879485},{"type":"v1","addr":"172.21.2.105:6835","nonce":3298879485}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-11-12T05:47:55.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.312+0000 7fb56165f700 1 -- 172.21.2.105:0/268703393 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb5380536a0 msgr2=0x7fb538055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:55.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.312+0000 7fb56165f700 1 --2- 172.21.2.105:0/268703393 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb5380536a0 0x7fb538055b60 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7fb550002f70 tx=0x7fb550014000).stop 2021-11-12T05:47:55.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.312+0000 7fb56165f700 1 -- 172.21.2.105:0/268703393 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb55c15a700 msgr2=0x7fb55c15ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:55.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.312+0000 7fb56165f700 1 --2- 172.21.2.105:0/268703393 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb55c15a700 0x7fb55c15ab80 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7fb5540016f0 tx=0x7fb54c007be0).stop 2021-11-12T05:47:55.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.312+0000 7fb56165f700 1 -- 172.21.2.105:0/268703393 shutdown_connections 2021-11-12T05:47:55.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.312+0000 7fb56165f700 1 --2- 172.21.2.105:0/268703393 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb5380536a0 0x7fb538055b60 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:55.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.312+0000 7fb56165f700 1 --2- 172.21.2.105:0/268703393 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb55c15a700 0x7fb55c15ab80 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:55.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.312+0000 7fb56165f700 1 --2- 172.21.2.105:0/268703393 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb55c148eb0 0x7fb55c0ab890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:55.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.312+0000 7fb56165f700 1 --2- 172.21.2.105:0/268703393 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb540003750 0x7fb55c0a7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:55.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.312+0000 7fb56165f700 1 -- 172.21.2.105:0/268703393 >> 172.21.2.105:0/268703393 conn(0x7fb55c0b5370 msgr2=0x7fb55c0aec40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:55.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.312+0000 7fb56165f700 1 -- 172.21.2.105:0/268703393 shutdown_connections 2021-11-12T05:47:55.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:55.312+0000 7fb56165f700 1 -- 172.21.2.105:0/268703393 wait complete. 2021-11-12T05:47:55.321 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 44 2021-11-12T05:47:55.526 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 44, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:47:50.427589+0000', 'modified': '2021-11-12T05:47:51.432486+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7017}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7017': {'gid': 7017, 'name': 'a', 'rank': 0, 'incarnation': 43, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/3298879485', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 3298879485}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 3298879485}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:47:55.527 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:47:55.527 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:47:55.593 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":7017,"want_state":"up:active","state":"up:active","rank_uptime":5.1581086750000003,"mdsmap_epoch":44,"osdmap_epoch":97,"osdmap_epoch_barrier":96,"uptime":9.3827572989999997} 2021-11-12T05:47:55.594 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 7017, "mdsmap_epoch": 44, "osdmap_epoch": 97, "osdmap_epoch_barrier": 96, "rank_uptime": 5.158108675, "state": "up:active", "uptime": 9.382757299, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:47:55.594 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-12T05:47:55.595 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-11-12T05:47:55.595 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@gibba038.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-11-12T05:47:55.595 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:55.596 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:47:55.607 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-12T05:47:55.618 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:47:55.619 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:47:55.625 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:47:55.625 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:47:55.626 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:55.626 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-12T05:47:55.671 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-12T05:47:55.672 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:47:55.674 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-12T05:47:55.683 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:47:55.683 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:47:55.712 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:ceph-fuse[14340]: starting ceph client 2021-11-12T05:47:55.713 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:2021-11-12T05:47:55.712+0000 7f0a87a4e080 -1 init, newargv = 0x55e0230e6920 newargc=9 2021-11-12T05:47:55.717 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:47:55.718 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:47:55.719 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:55.719 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-12T05:47:55.726 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:ceph-fuse[14340]: starting fuse 2021-11-12T05:47:55.729 INFO:teuthology.orchestra.run.gibba038.stdout:52 2021-11-12T05:47:55.730 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-12T05:47:55.730 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:55.731 DEBUG:teuthology.orchestra.run.gibba038:> sudo python3 -c ' 2021-11-12T05:47:55.731 DEBUG:teuthology.orchestra.run.gibba038:> import glob 2021-11-12T05:47:55.731 DEBUG:teuthology.orchestra.run.gibba038:> import re 2021-11-12T05:47:55.732 DEBUG:teuthology.orchestra.run.gibba038:> import os 2021-11-12T05:47:55.732 DEBUG:teuthology.orchestra.run.gibba038:> import subprocess 2021-11-12T05:47:55.733 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:47:55.733 DEBUG:teuthology.orchestra.run.gibba038:> def find_socket(client_name): 2021-11-12T05:47:55.733 DEBUG:teuthology.orchestra.run.gibba038:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-11-12T05:47:55.734 DEBUG:teuthology.orchestra.run.gibba038:> files = glob.glob(asok_path) 2021-11-12T05:47:55.734 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:47:55.735 DEBUG:teuthology.orchestra.run.gibba038:> # Given a non-glob path, it better be there 2021-11-12T05:47:55.735 DEBUG:teuthology.orchestra.run.gibba038:> if "*" not in asok_path: 2021-11-12T05:47:55.735 DEBUG:teuthology.orchestra.run.gibba038:> assert(len(files) == 1) 2021-11-12T05:47:55.736 DEBUG:teuthology.orchestra.run.gibba038:> return files[0] 2021-11-12T05:47:55.736 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:47:55.737 DEBUG:teuthology.orchestra.run.gibba038:> for f in files: 2021-11-12T05:47:55.737 DEBUG:teuthology.orchestra.run.gibba038:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-12T05:47:55.737 DEBUG:teuthology.orchestra.run.gibba038:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-12T05:47:55.738 DEBUG:teuthology.orchestra.run.gibba038:> return f 2021-11-12T05:47:55.738 DEBUG:teuthology.orchestra.run.gibba038:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-12T05:47:55.739 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:47:55.739 DEBUG:teuthology.orchestra.run.gibba038:> print(find_socket("client.1")) 2021-11-12T05:47:55.739 DEBUG:teuthology.orchestra.run.gibba038:> ' 2021-11-12T05:47:55.798 INFO:teuthology.orchestra.run.gibba038.stdout:/var/run/ceph/ceph-client.1.14340.asok 2021-11-12T05:47:55.801 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14340.asok 2021-11-12T05:47:55.801 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:55.801 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14340.asok status 2021-11-12T05:47:55.848 INFO:teuthology.orchestra.run.gibba038.stdout:{ 2021-11-12T05:47:55.849 INFO:teuthology.orchestra.run.gibba038.stdout: "metadata": { 2021-11-12T05:47:55.849 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_sha1": "a81ee2815de5acae59ead5b8c9137b6766fc8ea8", 2021-11-12T05:47:55.849 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_version": "ceph version 15.2.15-22-ga81ee281 (a81ee2815de5acae59ead5b8c9137b6766fc8ea8) octopus (stable)", 2021-11-12T05:47:55.849 INFO:teuthology.orchestra.run.gibba038.stdout: "entity_id": "1", 2021-11-12T05:47:55.850 INFO:teuthology.orchestra.run.gibba038.stdout: "hostname": "gibba038", 2021-11-12T05:47:55.850 INFO:teuthology.orchestra.run.gibba038.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-11-12T05:47:55.850 INFO:teuthology.orchestra.run.gibba038.stdout: "pid": "14340", 2021-11-12T05:47:55.850 INFO:teuthology.orchestra.run.gibba038.stdout: "root": "/" 2021-11-12T05:47:55.851 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:47:55.851 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_count": 0, 2021-11-12T05:47:55.851 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_pinned_count": 0, 2021-11-12T05:47:55.851 INFO:teuthology.orchestra.run.gibba038.stdout: "id": 4796, 2021-11-12T05:47:55.851 INFO:teuthology.orchestra.run.gibba038.stdout: "inst": { 2021-11-12T05:47:55.852 INFO:teuthology.orchestra.run.gibba038.stdout: "name": { 2021-11-12T05:47:55.852 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "client", 2021-11-12T05:47:55.852 INFO:teuthology.orchestra.run.gibba038.stdout: "num": 4796 2021-11-12T05:47:55.852 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:47:55.852 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-12T05:47:55.853 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-12T05:47:55.853 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-12T05:47:55.853 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 1549749869 2021-11-12T05:47:55.853 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-11-12T05:47:55.853 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:47:55.854 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-12T05:47:55.854 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-12T05:47:55.854 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-12T05:47:55.854 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 1549749869 2021-11-12T05:47:55.855 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:47:55.855 INFO:teuthology.orchestra.run.gibba038.stdout: "inst_str": "client.4796 172.21.2.138:0/1549749869", 2021-11-12T05:47:55.855 INFO:teuthology.orchestra.run.gibba038.stdout: "addr_str": "172.21.2.138:0/1549749869", 2021-11-12T05:47:55.855 INFO:teuthology.orchestra.run.gibba038.stdout: "inode_count": 1, 2021-11-12T05:47:55.856 INFO:teuthology.orchestra.run.gibba038.stdout: "mds_epoch": 44, 2021-11-12T05:47:55.856 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch": 97, 2021-11-12T05:47:55.856 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch_barrier": 0, 2021-11-12T05:47:55.856 INFO:teuthology.orchestra.run.gibba038.stdout: "blacklisted": false, 2021-11-12T05:47:55.856 INFO:teuthology.orchestra.run.gibba038.stdout: "fs_name": "cephfs" 2021-11-12T05:47:55.857 INFO:teuthology.orchestra.run.gibba038.stdout:} 2021-11-12T05:47:55.858 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:55.858 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:47:55.859 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:47:55.864 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-12T05:47:55.864 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-12T05:47:55.865 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:55.865 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:47:55.917 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-11-12T05:47:55.917 DEBUG:teuthology.orchestra.run.gibba016:> cd /home/ubuntu/cephtest/mnt.0 && sudo mkdir -p foo 2021-11-12T05:47:55.954 DEBUG:teuthology.orchestra.run.gibba016:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-11-12T05:47:55.954 DEBUG:teuthology.orchestra.run.gibba016:> import os 2021-11-12T05:47:55.955 DEBUG:teuthology.orchestra.run.gibba016:> import stat 2021-11-12T05:47:55.955 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:47:55.956 DEBUG:teuthology.orchestra.run.gibba016:> print(os.stat("/home/ubuntu/cephtest/mnt.0/foo").st_ino) 2021-11-12T05:47:55.956 DEBUG:teuthology.orchestra.run.gibba016:> ' 2021-11-12T05:47:55.992 INFO:teuthology.orchestra.run.gibba016.stdout:1099511627776 2021-11-12T05:47:56.201 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:47:56.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.252+0000 7f66abfff700 1 Processor -- start 2021-11-12T05:47:56.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.252+0000 7f66abfff700 1 -- start start 2021-11-12T05:47:56.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.252+0000 7f66abfff700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66ac0b2b50 0x7f66ac129ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:56.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.252+0000 7f66abfff700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66ac0b0520 con 0x7f66ac0b1300 2021-11-12T05:47:56.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.252+0000 7f66abfff700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66ac060de0 con 0x7f66ac060a00 2021-11-12T05:47:56.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.252+0000 7f66abfff700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66ac12a4e0 con 0x7f66ac0b2b50 2021-11-12T05:47:56.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.252+0000 7f66aa7fc700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f66ac0b1300 0x7f66ac1298e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:59710/0 (socket says 172.21.2.105:59710) 2021-11-12T05:47:56.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.252+0000 7f66aa7fc700 1 -- 172.21.2.105:0/2433285270 learned_addr learned my addr 172.21.2.105:0/2433285270 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:56.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.252+0000 7f66a9ffb700 1 -- 172.21.2.105:0/2433285270 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4055486507 0 0) 0x7f66ac0b0520 con 0x7f66ac0b1300 2021-11-12T05:47:56.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.252+0000 7f66a9ffb700 1 -- 172.21.2.105:0/2433285270 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f668c003260 con 0x7f66ac0b1300 2021-11-12T05:47:56.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66a9ffb700 1 -- 172.21.2.105:0/2433285270 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3864313408 0 0) 0x7f668c003260 con 0x7f66ac0b1300 2021-11-12T05:47:56.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66a9ffb700 1 -- 172.21.2.105:0/2433285270 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66ac0b2b50 msgr2=0x7f66ac129ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:56.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66a9ffb700 1 --2- 172.21.2.105:0/2433285270 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66ac0b2b50 0x7f66ac129ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:56.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66a9ffb700 1 -- 172.21.2.105:0/2433285270 >> v1:172.21.2.115:6789/0 conn(0x7f66ac060a00 legacy=0x7f66ac0b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:56.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66a9ffb700 1 -- 172.21.2.105:0/2433285270 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ac145030 con 0x7f66ac0b1300 2021-11-12T05:47:56.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66a9ffb700 1 -- 172.21.2.105:0/2433285270 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f669c001660 con 0x7f66ac0b1300 2021-11-12T05:47:56.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66a9ffb700 1 -- 172.21.2.105:0/2433285270 >> v1:172.21.2.105:6789/0 conn(0x7f66ac0b1300 legacy=0x7f66ac1298e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:56.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66a9ffb700 1 --2- 172.21.2.105:0/2433285270 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f668c003800 0x7f668c003c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:56.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66a9ffb700 1 --2- 172.21.2.105:0/2433285270 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f668c004500 0x7f668c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:56.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66a9ffb700 1 --2- 172.21.2.105:0/2433285270 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66ac0b2b50 0x7f668c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:56.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66a9ffb700 1 -- 172.21.2.105:0/2433285270 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ac12a4e0 con 0x7f668c003800 2021-11-12T05:47:56.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66a9ffb700 1 -- 172.21.2.105:0/2433285270 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668c005290 con 0x7f668c004500 2021-11-12T05:47:56.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66a9ffb700 1 -- 172.21.2.105:0/2433285270 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f668c00bc40 con 0x7f66ac0b2b50 2021-11-12T05:47:56.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66aaffd700 1 --2- 172.21.2.105:0/2433285270 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f668c003800 0x7f668c003c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:56.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66aaffd700 1 -- 172.21.2.105:0/2433285270 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66ac0b2b50 msgr2=0x7f668c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:56.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66aaffd700 1 --2- 172.21.2.105:0/2433285270 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66ac0b2b50 0x7f668c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:56.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66aaffd700 1 -- 172.21.2.105:0/2433285270 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f668c004500 msgr2=0x7f668c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:56.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66aaffd700 1 --2- 172.21.2.105:0/2433285270 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f668c004500 0x7f668c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:56.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66aaffd700 1 -- 172.21.2.105:0/2433285270 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668c003260 con 0x7f668c003800 2021-11-12T05:47:56.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66aaffd700 1 --2- 172.21.2.105:0/2433285270 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f668c003800 0x7f668c003c00 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 rx=0x7f6694000f70 tx=0x7f66940079e0).ready entity=mon.0 client_cookie=a7960615b67d7bce server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:56.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66a9ffb700 1 -- 172.21.2.105:0/2433285270 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6694007cf0 con 0x7f668c003800 2021-11-12T05:47:56.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66a9ffb700 1 -- 172.21.2.105:0/2433285270 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6694014410 con 0x7f668c003800 2021-11-12T05:47:56.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66a9ffb700 1 -- 172.21.2.105:0/2433285270 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6694014770 con 0x7f668c003800 2021-11-12T05:47:56.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66abfff700 1 -- 172.21.2.105:0/2433285270 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f668c003800 msgr2=0x7f668c003c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:56.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66abfff700 1 --2- 172.21.2.105:0/2433285270 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f668c003800 0x7f668c003c00 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 rx=0x7f6694000f70 tx=0x7f66940079e0).stop 2021-11-12T05:47:56.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66ab7fe700 1 -- 172.21.2.105:0/2433285270 reap_dead start 2021-11-12T05:47:56.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66abfff700 1 -- 172.21.2.105:0/2433285270 shutdown_connections 2021-11-12T05:47:56.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66abfff700 1 -- 172.21.2.105:0/2433285270 >> 172.21.2.105:0/2433285270 conn(0x7f66ac0b6430 msgr2=0x7f66ac0b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:56.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66abfff700 1 -- 172.21.2.105:0/2433285270 shutdown_connections 2021-11-12T05:47:56.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66abfff700 1 -- 172.21.2.105:0/2433285270 wait complete. 2021-11-12T05:47:56.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66abfff700 1 Processor -- start 2021-11-12T05:47:56.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66abfff700 1 -- start start 2021-11-12T05:47:56.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66abfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f668c003800 0x7f66ac066f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:56.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66abfff700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f66ac0669f0 0x7f66ac0b4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:56.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66abfff700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66ac152730 0x7f66ac152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:56.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66abfff700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ac152050 con 0x7f668c003800 2021-11-12T05:47:56.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66abfff700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ac1530a0 con 0x7f66ac0669f0 2021-11-12T05:47:56.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66abfff700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66ac122e00 con 0x7f66ac152730 2021-11-12T05:47:56.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66aaffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f668c003800 0x7f66ac066f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:56.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66aaffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f668c003800 0x7f66ac066f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49326/0 (socket says 172.21.2.105:49326) 2021-11-12T05:47:56.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66aaffd700 1 -- 172.21.2.105:0/1974756773 learned_addr learned my addr 172.21.2.105:0/1974756773 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:56.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66aaffd700 1 -- 172.21.2.105:0/1974756773 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66ac152730 msgr2=0x7f66ac152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:56.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66aaffd700 1 --2- 172.21.2.105:0/1974756773 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66ac152730 0x7f66ac152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:56.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66aaffd700 1 -- 172.21.2.105:0/1974756773 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f66ac0669f0 msgr2=0x7f66ac0b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:56.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66aaffd700 1 --2- 172.21.2.105:0/1974756773 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f66ac0669f0 0x7f66ac0b4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:56.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66aaffd700 1 -- 172.21.2.105:0/1974756773 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ac123080 con 0x7f668c003800 2021-11-12T05:47:56.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66aaffd700 1 --2- 172.21.2.105:0/1974756773 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f668c003800 0x7f66ac066f70 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f66ac152610 tx=0x7f6694015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:56.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66a3fff700 1 -- 172.21.2.105:0/1974756773 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66940137c0 con 0x7f668c003800 2021-11-12T05:47:56.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66a3fff700 1 -- 172.21.2.105:0/1974756773 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6694013920 con 0x7f668c003800 2021-11-12T05:47:56.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66abfff700 1 -- 172.21.2.105:0/1974756773 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66ac152290 con 0x7f668c003800 2021-11-12T05:47:56.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66a3fff700 1 -- 172.21.2.105:0/1974756773 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6694013c80 con 0x7f668c003800 2021-11-12T05:47:56.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.256+0000 7f66abfff700 1 -- 172.21.2.105:0/1974756773 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66ac155810 con 0x7f668c003800 2021-11-12T05:47:56.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.260+0000 7f66abfff700 1 -- 172.21.2.105:0/1974756773 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66ac152420 con 0x7f668c003800 2021-11-12T05:47:56.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.260+0000 7f66a3fff700 1 -- 172.21.2.105:0/1974756773 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f669402b3f0 con 0x7f668c003800 2021-11-12T05:47:56.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.260+0000 7f66a3fff700 1 --2- 172.21.2.105:0/1974756773 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f66900536a0 0x7f6690055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:56.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.260+0000 7f66a3fff700 1 -- 172.21.2.105:0/1974756773 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f669401c040 con 0x7f668c003800 2021-11-12T05:47:56.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.260+0000 7f66aa7fc700 1 --2- 172.21.2.105:0/1974756773 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f66900536a0 0x7f6690055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:56.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.260+0000 7f66aa7fc700 1 --2- 172.21.2.105:0/1974756773 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f66900536a0 0x7f6690055b60 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f66ac05ec90 tx=0x7f66ac063720).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:56.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.260+0000 7f66a3fff700 1 -- 172.21.2.105:0/1974756773 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6694043f30 con 0x7f668c003800 2021-11-12T05:47:56.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.372+0000 7f66abfff700 1 -- 172.21.2.105:0/1974756773 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f66ac0b0750 con 0x7f668c003800 2021-11-12T05:47:56.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.372+0000 7f66a3fff700 1 -- 172.21.2.105:0/1974756773 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f6694047510 con 0x7f668c003800 2021-11-12T05:47:56.378 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:56.378 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":44,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4751,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/3227424218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":3227424218},{"type":"v1","addr":"172.21.2.115:6833","nonce":3227424218}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":43}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:47:50.427589+0000","modified":"2021-11-12T05:47:51.432486+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7017":{"gid":7017,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/3298879485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":3298879485},{"type":"v1","addr":"172.21.2.105:6835","nonce":3298879485}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-11-12T05:47:56.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.372+0000 7f66abfff700 1 -- 172.21.2.105:0/1974756773 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f66900536a0 msgr2=0x7f6690055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:56.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.372+0000 7f66abfff700 1 --2- 172.21.2.105:0/1974756773 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f66900536a0 0x7f6690055b60 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f66ac05ec90 tx=0x7f66ac063720).stop 2021-11-12T05:47:56.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.372+0000 7f66abfff700 1 -- 172.21.2.105:0/1974756773 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f668c003800 msgr2=0x7f66ac066f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:56.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.372+0000 7f66abfff700 1 --2- 172.21.2.105:0/1974756773 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f668c003800 0x7f66ac066f70 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f66ac152610 tx=0x7f6694015000).stop 2021-11-12T05:47:56.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.372+0000 7f66abfff700 1 -- 172.21.2.105:0/1974756773 shutdown_connections 2021-11-12T05:47:56.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.372+0000 7f66abfff700 1 --2- 172.21.2.105:0/1974756773 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f66900536a0 0x7f6690055b60 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:56.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.372+0000 7f66abfff700 1 --2- 172.21.2.105:0/1974756773 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66ac152730 0x7f66ac152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:56.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.372+0000 7f66abfff700 1 --2- 172.21.2.105:0/1974756773 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f66ac0669f0 0x7f66ac0b4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:56.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.372+0000 7f66abfff700 1 --2- 172.21.2.105:0/1974756773 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f668c003800 0x7f66ac066f70 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:56.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.372+0000 7f66abfff700 1 -- 172.21.2.105:0/1974756773 >> 172.21.2.105:0/1974756773 conn(0x7f66ac0b6430 msgr2=0x7f66ac1297e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:56.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.372+0000 7f66abfff700 1 -- 172.21.2.105:0/1974756773 shutdown_connections 2021-11-12T05:47:56.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:56.372+0000 7f66abfff700 1 -- 172.21.2.105:0/1974756773 wait complete. 2021-11-12T05:47:56.382 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 44 2021-11-12T05:47:56.385 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 0x10000000000 2021-11-12T05:47:56.442 INFO:teuthology.orchestra.run.gibba005.stdout:{"path":"/foo","ino":1099511627776,"rdev":0,"ctime":"2021-11-12T05:47:55.942995+0000","btime":"2021-11-12T05:47:55.942995+0000","mode":16877,"uid":0,"gid":0,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2021-11-12T05:47:55.942995+0000","atime":"2021-11-12T05:47:55.942995+0000","time_warp_seq":0,"change_attr":0,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"version":2,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1},"nref":4,"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":4778,"pending":"pAsxLsXsxFsx","issued":"pAsxLsXsxFsx","wanted":"-","last_sent":1}],"loner":4778,"want_loner":4778,"mds_caps_wanted":[]} 2021-11-12T05:47:56.443 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2021-11-12T05:47:55.942995+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "backtrace_version": 2, "btime": "2021-11-12T05:47:55.942995+0000", "change_attr": 0, "client_caps": [ { "client_id": 4778, "issued": "pAsxLsXsxFsx", "last_sent": 1, "pending": "pAsxLsXsxFsx", "wanted": "-" } ], "client_ranges": [], "ctime": "2021-11-12T05:47:55.942995+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "flocklock": {}, "gid": 0, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 4778, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2021-11-12T05:47:55.942995+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/foo", "pins": { "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "request": 0 }, "policylock": {}, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 0, "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "want_loner": 4778, "xattr_version": 1, "xattrlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "xattrs": [] } 2021-11-12T05:47:56.443 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-12T05:47:56.444 DEBUG:teuthology.orchestra.run.gibba005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:47:56.452 DEBUG:teuthology.orchestra.run.gibba015:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:47:56.465 DEBUG:teuthology.orchestra.run.gibba016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:47:56.478 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:47:56.491 DEBUG:teuthology.orchestra.run.gibba044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:47:56.505 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-12T05:47:56.505 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:56.506 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:47:56.506 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:47:56.529 INFO:teuthology.orchestra.run.gibba016.stdout:fuseblk 2021-11-12T05:47:56.531 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-12T05:47:56.531 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba016.front.sepia.ceph.com... 2021-11-12T05:47:56.531 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-12T05:47:56.532 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:47:56.546 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[14862]: fuse finished with error 0 and tester_r 0 2021-11-12T05:47:56.547 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:56.548 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:47:56.548 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:47:56.600 INFO:teuthology.orchestra.run.gibba016.stdout:ext2/ext3 2021-11-12T05:47:56.601 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-12T05:47:56.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:47:56.712 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:47:56.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:56.716 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:47:56.717 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:47:56.728 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-12T05:47:56.729 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-12T05:47:56.729 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba038.front.sepia.ceph.com... 2021-11-12T05:47:56.730 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-12T05:47:56.730 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:47:56.784 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:ceph-fuse[14340]: fuse finished with error 0 and tester_r 0 2021-11-12T05:47:56.785 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:56.786 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:47:56.786 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:47:56.790 INFO:teuthology.orchestra.run.gibba038.stdout:ext2/ext3 2021-11-12T05:47:56.790 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-12T05:47:56.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:47:56.901 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:47:56.948 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:47:56.948 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:47:56.949 DEBUG:teuthology.orchestra.run.gibba044:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:47:56.953 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:47:56.954 INFO:teuthology.orchestra.run.gibba044.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-12T05:47:56.954 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-12T05:47:56.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:47:56.955 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:47:56.959 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:47:56.960 INFO:teuthology.orchestra.run.gibba044.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-12T05:47:56.960 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-12T05:47:57.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.012+0000 7f3ae5891700 1 Processor -- start 2021-11-12T05:47:57.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.012+0000 7f3ae5891700 1 -- start start 2021-11-12T05:47:57.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.012+0000 7f3ae5891700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f3ae00aa700 0x7f3ae00ac270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:57.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.012+0000 7f3ae5891700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ae00b20b0 con 0x7f3ae00b1cd0 2021-11-12T05:47:57.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.012+0000 7f3ae5891700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ae00b13e0 con 0x7f3ae00b0e60 2021-11-12T05:47:57.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.012+0000 7f3ae5891700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ae00b2870 con 0x7f3ae00aa700 2021-11-12T05:47:57.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.012+0000 7f3adeffd700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f3ae00b1cd0 0x7f3ae00abb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:59728/0 (socket says 172.21.2.105:59728) 2021-11-12T05:47:57.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.012+0000 7f3adeffd700 1 -- 172.21.2.105:0/980301070 learned_addr learned my addr 172.21.2.105:0/980301070 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:57.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.012+0000 7f3adf7fe700 1 --2- 172.21.2.105:0/980301070 >> v2:172.21.2.105:3300/0 conn(0x7f3ae00aa700 0x7f3ae00ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:57.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.012+0000 7f3adf7fe700 1 -- 172.21.2.105:0/980301070 >> v1:172.21.2.115:6789/0 conn(0x7f3ae00b0e60 legacy=0x7f3ae01424c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:57.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.012+0000 7f3adf7fe700 1 -- 172.21.2.105:0/980301070 >> v1:172.21.2.105:6789/0 conn(0x7f3ae00b1cd0 legacy=0x7f3ae00abb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:57.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.012+0000 7f3adf7fe700 1 -- 172.21.2.105:0/980301070 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae00ace10 con 0x7f3ae00aa700 2021-11-12T05:47:57.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.012+0000 7f3adf7fe700 1 --2- 172.21.2.105:0/980301070 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3ae00aa700 0x7f3ae00ac270 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7f3ae00b4160 tx=0x7f3ad80091d0).ready entity=mon.0 client_cookie=305122fffc5dd2dc server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:57.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.012+0000 7f3addffb700 1 -- 172.21.2.105:0/980301070 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ad8009ea0 con 0x7f3ae00aa700 2021-11-12T05:47:57.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.012+0000 7f3addffb700 1 -- 172.21.2.105:0/980301070 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad800b860 con 0x7f3ae00aa700 2021-11-12T05:47:57.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.012+0000 7f3addffb700 1 -- 172.21.2.105:0/980301070 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ad800b9d0 con 0x7f3ae00aa700 2021-11-12T05:47:57.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.012+0000 7f3ae5891700 1 -- 172.21.2.105:0/980301070 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3ae00aa700 msgr2=0x7f3ae00ac270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:57.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.012+0000 7f3ae5891700 1 --2- 172.21.2.105:0/980301070 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3ae00aa700 0x7f3ae00ac270 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7f3ae00b4160 tx=0x7f3ad80091d0).stop 2021-11-12T05:47:57.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.012+0000 7f3ae5891700 1 -- 172.21.2.105:0/980301070 shutdown_connections 2021-11-12T05:47:57.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.012+0000 7f3ae5891700 1 --2- 172.21.2.105:0/980301070 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3ae00aa700 0x7f3ae00ac270 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:57.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.012+0000 7f3ae5891700 1 -- 172.21.2.105:0/980301070 >> 172.21.2.105:0/980301070 conn(0x7f3ae0063610 msgr2=0x7f3ae00639f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:57.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.012+0000 7f3ae5891700 1 -- 172.21.2.105:0/980301070 shutdown_connections 2021-11-12T05:47:57.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.012+0000 7f3ae5891700 1 -- 172.21.2.105:0/980301070 wait complete. 2021-11-12T05:47:57.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.016+0000 7f3ae5891700 1 Processor -- start 2021-11-12T05:47:57.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.016+0000 7f3ae5891700 1 -- start start 2021-11-12T05:47:57.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.016+0000 7f3ae5891700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3ae00aa700 0x7f3ae00a2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:57.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.016+0000 7f3ae5891700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3ae00b0e60 0x7f3ae0157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:57.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.016+0000 7f3ae5891700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3ae00b1cd0 0x7f3ae005f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:57.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.016+0000 7f3ae5891700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae0067370 con 0x7f3ae00aa700 2021-11-12T05:47:57.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.016+0000 7f3ae5891700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae01570f0 con 0x7f3ae00b0e60 2021-11-12T05:47:57.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.016+0000 7f3ae5891700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae0157390 con 0x7f3ae00b1cd0 2021-11-12T05:47:57.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.016+0000 7f3adeffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3ae00aa700 0x7f3ae00a2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:57.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.016+0000 7f3adeffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3ae00aa700 0x7f3ae00a2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49338/0 (socket says 172.21.2.105:49338) 2021-11-12T05:47:57.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.016+0000 7f3adeffd700 1 -- 172.21.2.105:0/2720886084 learned_addr learned my addr 172.21.2.105:0/2720886084 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:57.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.016+0000 7f3adeffd700 1 -- 172.21.2.105:0/2720886084 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3ae00b1cd0 msgr2=0x7f3ae005f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:57.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.016+0000 7f3adeffd700 1 --2- 172.21.2.105:0/2720886084 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3ae00b1cd0 0x7f3ae005f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:57.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.016+0000 7f3adeffd700 1 -- 172.21.2.105:0/2720886084 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3ae00b0e60 msgr2=0x7f3ae0157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:57.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.016+0000 7f3adeffd700 1 --2- 172.21.2.105:0/2720886084 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3ae00b0e60 0x7f3ae0157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:57.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.016+0000 7f3adeffd700 1 -- 172.21.2.105:0/2720886084 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad8009470 con 0x7f3ae00aa700 2021-11-12T05:47:57.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.016+0000 7f3adeffd700 1 --2- 172.21.2.105:0/2720886084 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3ae00aa700 0x7f3ae00a2640 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7f3ae00b4120 tx=0x7f3ad0007ca0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:57.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.016+0000 7f3ad7fff700 1 -- 172.21.2.105:0/2720886084 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ad000ce30 con 0x7f3ae00aa700 2021-11-12T05:47:57.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.016+0000 7f3ad7fff700 1 -- 172.21.2.105:0/2720886084 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad00072e0 con 0x7f3ae00aa700 2021-11-12T05:47:57.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.016+0000 7f3ae5891700 1 -- 172.21.2.105:0/2720886084 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ae0157d20 con 0x7f3ae00aa700 2021-11-12T05:47:57.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.016+0000 7f3ae5891700 1 -- 172.21.2.105:0/2720886084 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae005fc90 con 0x7f3ae00aa700 2021-11-12T05:47:57.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.016+0000 7f3ad7fff700 1 -- 172.21.2.105:0/2720886084 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ad0005800 con 0x7f3ae00aa700 2021-11-12T05:47:57.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.016+0000 7f3ae5891700 1 -- 172.21.2.105:0/2720886084 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ae00a2b30 con 0x7f3ae00aa700 2021-11-12T05:47:57.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.016+0000 7f3ad7fff700 1 -- 172.21.2.105:0/2720886084 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3ad001a060 con 0x7f3ae00aa700 2021-11-12T05:47:57.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.016+0000 7f3ad7fff700 1 --2- 172.21.2.105:0/2720886084 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3ac4053660 0x7f3ac4055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:57.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.016+0000 7f3ad7fff700 1 -- 172.21.2.105:0/2720886084 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f3ad006af70 con 0x7f3ae00aa700 2021-11-12T05:47:57.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.016+0000 7f3ade7fc700 1 --2- 172.21.2.105:0/2720886084 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3ac4053660 0x7f3ac4055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:57.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.016+0000 7f3ade7fc700 1 --2- 172.21.2.105:0/2720886084 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3ac4053660 0x7f3ac4055b20 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f3ac8002f90 tx=0x7f3ac80069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:57.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.020+0000 7f3ad7fff700 1 -- 172.21.2.105:0/2720886084 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3ad0041e70 con 0x7f3ae00aa700 2021-11-12T05:47:57.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.100+0000 7f3ae5891700 1 -- 172.21.2.105:0/2720886084 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f3ae0157550 con 0x7f3ae00aa700 2021-11-12T05:47:57.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.100+0000 7f3ad7fff700 1 -- 172.21.2.105:0/2720886084 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v97) v1 ==== 81+0+34040 (secure 0 0 0) 0x7f3ad0018020 con 0x7f3ae00aa700 2021-11-12T05:47:57.107 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:57.108 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:47:57.108 INFO:teuthology.orchestra.run.gibba005.stdout: "epoch": 97, 2021-11-12T05:47:57.108 INFO:teuthology.orchestra.run.gibba005.stdout: "fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", 2021-11-12T05:47:57.108 INFO:teuthology.orchestra.run.gibba005.stdout: "created": "2021-11-12T05:40:19.986390+0000", 2021-11-12T05:47:57.109 INFO:teuthology.orchestra.run.gibba005.stdout: "modified": "2021-11-12T05:47:52.445451+0000", 2021-11-12T05:47:57.109 INFO:teuthology.orchestra.run.gibba005.stdout: "last_up_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:47:57.109 INFO:teuthology.orchestra.run.gibba005.stdout: "last_in_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:47:57.109 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-12T05:47:57.109 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_num": 5799936, 2021-11-12T05:47:57.110 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_set": [ 2021-11-12T05:47:57.110 INFO:teuthology.orchestra.run.gibba005.stdout: "pglog_hardlimit", 2021-11-12T05:47:57.110 INFO:teuthology.orchestra.run.gibba005.stdout: "purged_snapdirs", 2021-11-12T05:47:57.110 INFO:teuthology.orchestra.run.gibba005.stdout: "recovery_deletes", 2021-11-12T05:47:57.111 INFO:teuthology.orchestra.run.gibba005.stdout: "sortbitwise" 2021-11-12T05:47:57.111 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:47:57.111 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_version": 5, 2021-11-12T05:47:57.111 INFO:teuthology.orchestra.run.gibba005.stdout: "full_ratio": 0.94999998807907104, 2021-11-12T05:47:57.111 INFO:teuthology.orchestra.run.gibba005.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-12T05:47:57.112 INFO:teuthology.orchestra.run.gibba005.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-12T05:47:57.112 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_snapshot": "", 2021-11-12T05:47:57.112 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_max": 18, 2021-11-12T05:47:57.112 INFO:teuthology.orchestra.run.gibba005.stdout: "max_osd": 8, 2021-11-12T05:47:57.113 INFO:teuthology.orchestra.run.gibba005.stdout: "require_min_compat_client": "jewel", 2021-11-12T05:47:57.113 INFO:teuthology.orchestra.run.gibba005.stdout: "min_compat_client": "jewel", 2021-11-12T05:47:57.113 INFO:teuthology.orchestra.run.gibba005.stdout: "require_osd_release": "octopus", 2021-11-12T05:47:57.113 INFO:teuthology.orchestra.run.gibba005.stdout: "pools": [ 2021-11-12T05:47:57.113 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.114 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 1, 2021-11-12T05:47:57.114 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "device_health_metrics", 2021-11-12T05:47:57.114 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:22.022116+0000", 2021-11-12T05:47:57.114 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:47:57.115 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:47:57.115 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:47:57.115 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:47:57.115 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:47:57.116 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:47:57.116 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:47:57.116 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:47:57.116 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 1, 2021-11-12T05:47:57.117 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 1, 2021-11-12T05:47:57.117 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 1, 2021-11-12T05:47:57.117 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 1, 2021-11-12T05:47:57.117 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 1, 2021-11-12T05:47:57.117 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:47:57.118 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:47:57.118 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:47:57.118 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:47:57.118 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:47:57.119 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:47:57.119 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:47:57.119 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.119 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "16", 2021-11-12T05:47:57.120 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:47:57.120 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:47:57.120 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:47:57.120 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:47:57.120 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:47:57.121 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:47:57.121 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:47:57.121 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:47:57.121 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:47:57.122 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:47:57.122 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:47:57.122 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:47:57.122 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:47:57.122 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:47:57.123 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:47:57.123 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:47:57.123 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:47:57.123 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:47:57.124 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:47:57.124 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:47:57.124 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:47:57.124 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:47:57.125 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:47:57.125 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:47:57.125 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:47:57.125 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:47:57.125 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.126 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:47:57.126 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:47:57.126 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:47:57.126 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:47:57.126 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:47:57.127 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:47:57.127 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:47:57.127 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:47:57.127 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:47:57.128 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:47:57.128 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:47:57.128 INFO:teuthology.orchestra.run.gibba005.stdout: "options": { 2021-11-12T05:47:57.128 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_min": 1 2021-11-12T05:47:57.128 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.129 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:47:57.129 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr_devicehealth": {} 2021-11-12T05:47:57.129 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.129 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.129 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.130 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 2, 2021-11-12T05:47:57.130 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "rbd", 2021-11-12T05:47:57.130 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:29.953617+0000", 2021-11-12T05:47:57.130 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:47:57.131 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:47:57.131 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:47:57.131 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:47:57.131 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:47:57.131 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:47:57.132 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:47:57.132 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:47:57.132 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:47:57.132 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:47:57.133 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:47:57.133 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:47:57.133 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:47:57.133 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:47:57.133 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:47:57.134 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:47:57.134 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:47:57.134 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:47:57.134 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:47:57.135 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:47:57.135 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.135 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "19", 2021-11-12T05:47:57.135 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:47:57.135 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:47:57.136 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:47:57.136 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:47:57.136 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:47:57.136 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:47:57.136 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:47:57.137 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:47:57.137 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:47:57.137 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:47:57.137 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:47:57.138 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:47:57.138 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:47:57.138 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:47:57.138 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:47:57.138 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:47:57.139 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:47:57.139 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:47:57.139 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:47:57.139 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:47:57.140 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:47:57.140 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:47:57.140 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:47:57.140 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:47:57.140 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:47:57.141 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:47:57.141 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.141 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:47:57.141 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:47:57.141 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:47:57.142 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:47:57.142 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:47:57.142 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:47:57.142 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:47:57.143 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:47:57.143 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:47:57.143 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:47:57.143 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:47:57.143 INFO:teuthology.orchestra.run.gibba005.stdout: "options": {}, 2021-11-12T05:47:57.144 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:47:57.144 INFO:teuthology.orchestra.run.gibba005.stdout: "rbd": {} 2021-11-12T05:47:57.144 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.144 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.145 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.145 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 17, 2021-11-12T05:47:57.145 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "cephfs_metadata", 2021-11-12T05:47:57.145 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:47:48.259327+0000", 2021-11-12T05:47:57.145 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:47:57.146 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:47:57.146 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:47:57.146 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:47:57.146 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:47:57.146 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:47:57.147 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:47:57.147 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:47:57.147 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:47:57.147 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:47:57.147 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:47:57.148 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:47:57.148 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:47:57.148 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:47:57.148 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:47:57.149 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:47:57.149 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:47:57.149 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:47:57.149 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:47:57.149 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:47:57.150 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.150 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "96", 2021-11-12T05:47:57.150 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:47:57.150 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:47:57.150 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:47:57.151 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:47:57.151 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:47:57.151 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:47:57.151 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:47:57.152 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:47:57.152 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:47:57.152 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:47:57.152 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:47:57.152 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:47:57.153 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:47:57.153 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:47:57.153 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:47:57.153 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:47:57.153 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:47:57.154 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:47:57.154 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:47:57.154 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:47:57.154 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:47:57.155 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:47:57.155 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:47:57.155 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:47:57.155 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:47:57.155 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:47:57.156 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.156 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:47:57.156 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:47:57.156 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:47:57.157 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:47:57.157 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:47:57.157 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:47:57.157 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:47:57.157 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:47:57.158 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:47:57.158 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:47:57.158 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:47:57.158 INFO:teuthology.orchestra.run.gibba005.stdout: "options": { 2021-11-12T05:47:57.159 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_bias": 4, 2021-11-12T05:47:57.159 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_min": 16, 2021-11-12T05:47:57.159 INFO:teuthology.orchestra.run.gibba005.stdout: "recovery_priority": 5 2021-11-12T05:47:57.159 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.159 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:47:57.160 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs": { 2021-11-12T05:47:57.160 INFO:teuthology.orchestra.run.gibba005.stdout: "metadata": "cephfs" 2021-11-12T05:47:57.160 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.160 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.161 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.161 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.161 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 18, 2021-11-12T05:47:57.161 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "cephfs_data", 2021-11-12T05:47:57.161 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:47:49.399624+0000", 2021-11-12T05:47:57.162 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:47:57.162 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:47:57.162 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:47:57.162 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:47:57.163 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:47:57.163 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:47:57.163 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:47:57.163 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:47:57.163 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:47:57.164 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:47:57.164 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:47:57.164 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:47:57.164 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:47:57.164 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:47:57.165 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:47:57.165 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:47:57.165 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:47:57.165 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:47:57.166 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:47:57.166 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:47:57.166 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.166 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "97", 2021-11-12T05:47:57.166 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:47:57.167 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:47:57.167 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:47:57.167 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:47:57.167 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:47:57.168 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:47:57.168 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:47:57.168 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:47:57.168 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:47:57.168 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:47:57.169 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:47:57.169 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:47:57.169 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:47:57.169 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:47:57.169 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:47:57.170 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:47:57.170 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:47:57.170 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:47:57.170 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:47:57.171 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:47:57.171 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:47:57.171 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:47:57.171 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:47:57.171 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:47:57.172 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:47:57.172 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:47:57.172 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.172 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:47:57.172 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:47:57.173 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:47:57.173 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:47:57.173 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:47:57.173 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:47:57.174 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:47:57.174 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:47:57.174 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:47:57.174 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:47:57.174 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:47:57.175 INFO:teuthology.orchestra.run.gibba005.stdout: "options": {}, 2021-11-12T05:47:57.175 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:47:57.175 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs": { 2021-11-12T05:47:57.175 INFO:teuthology.orchestra.run.gibba005.stdout: "data": "cephfs" 2021-11-12T05:47:57.176 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.176 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.176 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.176 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:47:57.176 INFO:teuthology.orchestra.run.gibba005.stdout: "osds": [ 2021-11-12T05:47:57.177 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.177 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:47:57.177 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "ee8e30a0-4819-4475-80ec-dd3ee7d01322", 2021-11-12T05:47:57.177 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:57.177 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:57.178 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:57.178 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:57.178 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:57.178 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:57.179 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:57.179 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 93, 2021-11-12T05:47:57.179 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:57.179 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:57.180 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:57.180 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:57.180 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.180 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:57.180 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6802", 2021-11-12T05:47:57.181 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:57.181 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.181 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.181 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:57.181 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6803", 2021-11-12T05:47:57.182 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:57.182 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.182 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.182 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.183 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:57.183 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:57.183 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.183 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:57.183 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6804", 2021-11-12T05:47:57.184 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:57.184 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.184 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.184 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:57.184 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6805", 2021-11-12T05:47:57.185 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:57.185 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.185 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.185 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.185 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:57.186 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:57.186 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.186 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:57.186 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6808", 2021-11-12T05:47:57.187 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:57.187 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.187 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.187 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:57.187 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6809", 2021-11-12T05:47:57.188 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:57.188 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.188 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.188 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.188 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:57.189 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:57.189 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.189 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:57.189 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6806", 2021-11-12T05:47:57.190 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:57.190 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.190 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.190 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:57.190 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6807", 2021-11-12T05:47:57.191 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:47:57.191 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.191 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.191 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.192 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6803/14874", 2021-11-12T05:47:57.192 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6805/14874", 2021-11-12T05:47:57.192 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6809/14874", 2021-11-12T05:47:57.192 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6807/14874", 2021-11-12T05:47:57.192 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:57.193 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:57.193 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:57.193 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.193 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.194 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.194 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:47:57.194 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "b1bb06c3-26d0-4d92-82f8-b3e882242785", 2021-11-12T05:47:57.194 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:57.194 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:57.195 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:57.195 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:57.195 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:57.195 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:57.195 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:57.196 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 93, 2021-11-12T05:47:57.196 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:57.196 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:57.196 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:57.197 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:57.197 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.197 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:57.197 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6810", 2021-11-12T05:47:57.197 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:57.198 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.198 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.198 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:57.198 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6811", 2021-11-12T05:47:57.199 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:57.199 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.199 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.199 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.199 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:57.200 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:57.200 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.200 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:57.200 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6812", 2021-11-12T05:47:57.201 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:57.201 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.201 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.201 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:57.201 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6813", 2021-11-12T05:47:57.202 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:57.202 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.202 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.202 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.203 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:57.203 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:57.203 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.203 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:57.203 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6816", 2021-11-12T05:47:57.204 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:57.204 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.204 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.204 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:57.205 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6817", 2021-11-12T05:47:57.205 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:57.205 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.205 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.205 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.206 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:57.206 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:57.206 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.206 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:57.207 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6814", 2021-11-12T05:47:57.207 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:57.207 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.207 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.207 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:57.208 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6815", 2021-11-12T05:47:57.208 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:47:57.208 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.208 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.209 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.209 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6811/14875", 2021-11-12T05:47:57.209 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6813/14875", 2021-11-12T05:47:57.209 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6817/14875", 2021-11-12T05:47:57.209 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6815/14875", 2021-11-12T05:47:57.210 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:57.210 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:57.210 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:57.210 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.211 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.211 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.211 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:47:57.211 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "837b2c60-c335-4382-9f47-d86543a14022", 2021-11-12T05:47:57.211 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:57.212 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:57.212 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:57.212 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:57.212 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:57.213 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:57.213 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:57.213 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 95, 2021-11-12T05:47:57.213 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:57.213 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:57.214 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:57.214 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:57.214 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.214 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:57.215 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6818", 2021-11-12T05:47:57.215 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:57.215 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.215 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.215 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:57.216 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6819", 2021-11-12T05:47:57.216 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:57.216 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.216 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.217 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.217 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:57.217 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:57.217 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.217 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:57.218 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6820", 2021-11-12T05:47:57.218 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:57.218 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.218 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.219 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:57.219 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6821", 2021-11-12T05:47:57.219 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:57.219 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.219 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.220 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.220 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:57.220 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:57.220 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.220 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:57.221 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6824", 2021-11-12T05:47:57.221 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:57.221 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.221 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.222 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:57.222 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6825", 2021-11-12T05:47:57.222 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:57.222 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.222 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.223 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.223 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:57.223 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:57.223 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.224 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:57.224 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6822", 2021-11-12T05:47:57.224 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:57.224 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.225 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.225 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:57.225 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6823", 2021-11-12T05:47:57.225 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:47:57.225 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.226 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.226 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.226 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6819/14905", 2021-11-12T05:47:57.226 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6821/14905", 2021-11-12T05:47:57.227 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6825/14905", 2021-11-12T05:47:57.227 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6823/14905", 2021-11-12T05:47:57.227 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:57.227 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:57.227 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:57.228 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.228 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.228 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.228 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:47:57.228 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "eb2b737b-dda6-444b-a306-f33cbbd51f70", 2021-11-12T05:47:57.229 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:57.229 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:57.229 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:57.229 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:57.230 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:57.230 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:57.230 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:57.230 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 93, 2021-11-12T05:47:57.230 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:57.231 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:57.231 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:57.231 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:57.231 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.232 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:57.232 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6826", 2021-11-12T05:47:57.232 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:57.232 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.232 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.233 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:57.233 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6827", 2021-11-12T05:47:57.233 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:57.233 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.233 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.234 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.234 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:57.234 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:57.234 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.235 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:57.235 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6828", 2021-11-12T05:47:57.235 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:57.235 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.236 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.236 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:57.236 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6829", 2021-11-12T05:47:57.236 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:57.236 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.237 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.237 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.237 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:57.237 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:57.238 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.238 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:57.238 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6832", 2021-11-12T05:47:57.238 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:57.238 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.239 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.239 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:57.239 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6833", 2021-11-12T05:47:57.239 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:57.240 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.240 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.240 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.240 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:57.240 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:57.241 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.241 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:57.241 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6830", 2021-11-12T05:47:57.241 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:57.242 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.242 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.242 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:57.242 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6831", 2021-11-12T05:47:57.243 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:47:57.243 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.243 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.243 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.244 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6827/14876", 2021-11-12T05:47:57.244 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6829/14876", 2021-11-12T05:47:57.244 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6833/14876", 2021-11-12T05:47:57.244 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6831/14876", 2021-11-12T05:47:57.245 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:57.245 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:57.245 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:57.245 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.245 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.246 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.246 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:47:57.246 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "721529a1-c047-486a-a7ca-ddc15d80cdde", 2021-11-12T05:47:57.246 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:57.247 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:57.247 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:57.247 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:57.247 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:57.247 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:57.248 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:57.248 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 92, 2021-11-12T05:47:57.248 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:57.248 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:57.249 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:57.249 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:57.249 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.249 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:57.249 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6800", 2021-11-12T05:47:57.250 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:57.250 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.250 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.250 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:57.251 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6801", 2021-11-12T05:47:57.251 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:57.251 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.251 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.252 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.252 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:57.252 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:57.252 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.253 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:57.253 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6802", 2021-11-12T05:47:57.253 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:57.253 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.254 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.254 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:57.254 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6803", 2021-11-12T05:47:57.254 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:57.254 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.255 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.255 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.255 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:57.255 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:57.256 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.256 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:57.256 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6806", 2021-11-12T05:47:57.256 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:57.257 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.257 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.257 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:57.257 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6807", 2021-11-12T05:47:57.257 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:57.258 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.258 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.258 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.258 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:57.258 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:57.259 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.259 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:57.259 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6804", 2021-11-12T05:47:57.259 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:57.260 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.260 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.260 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:57.260 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6805", 2021-11-12T05:47:57.260 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:47:57.261 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.261 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.261 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.261 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6801/15096", 2021-11-12T05:47:57.261 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6803/15096", 2021-11-12T05:47:57.262 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6807/15096", 2021-11-12T05:47:57.262 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6805/15096", 2021-11-12T05:47:57.262 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:57.262 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:57.262 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:57.263 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.263 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.263 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.263 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:47:57.264 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "68b72ab2-fa82-4b5c-bf33-528f002e4950", 2021-11-12T05:47:57.264 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:57.264 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:57.264 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:57.264 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:57.265 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:57.265 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:57.265 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:57.265 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 82, 2021-11-12T05:47:57.265 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:57.266 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:57.266 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:57.266 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:57.266 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.267 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:57.267 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6808", 2021-11-12T05:47:57.267 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:57.267 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.267 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.268 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:57.268 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6809", 2021-11-12T05:47:57.268 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:57.268 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.269 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.269 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.269 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:57.269 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:57.269 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.270 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:57.270 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6810", 2021-11-12T05:47:57.270 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:57.270 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.271 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.271 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:57.271 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6811", 2021-11-12T05:47:57.271 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:57.271 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.272 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.272 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.272 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:57.272 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:57.273 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.273 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:57.273 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6814", 2021-11-12T05:47:57.273 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:57.273 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.274 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.274 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:57.274 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6815", 2021-11-12T05:47:57.274 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:57.275 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.275 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.275 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.275 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:57.276 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:57.276 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.276 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:57.276 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6812", 2021-11-12T05:47:57.276 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:57.277 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.277 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.277 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:57.277 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6813", 2021-11-12T05:47:57.277 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:47:57.278 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.278 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.278 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.279 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6809/15097", 2021-11-12T05:47:57.279 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6811/15097", 2021-11-12T05:47:57.279 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6815/15097", 2021-11-12T05:47:57.279 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6813/15097", 2021-11-12T05:47:57.280 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:57.280 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:57.280 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:57.280 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.281 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.281 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.281 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:47:57.281 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "a2c83b5d-8d37-4d30-ac04-30d89a76e485", 2021-11-12T05:47:57.281 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:57.282 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:57.282 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:57.282 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:57.282 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:57.282 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:57.283 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:57.283 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 92, 2021-11-12T05:47:57.283 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:57.283 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:57.283 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:57.284 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:57.284 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.284 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:57.284 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6816", 2021-11-12T05:47:57.285 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:57.285 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.285 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.285 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:57.285 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6817", 2021-11-12T05:47:57.286 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:57.286 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.286 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.286 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.286 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:57.287 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:57.287 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.287 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:57.287 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6818", 2021-11-12T05:47:57.287 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:57.288 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.288 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.288 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:57.288 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6819", 2021-11-12T05:47:57.289 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:57.289 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.289 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.289 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.289 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:57.290 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:57.290 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.290 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:57.290 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6822", 2021-11-12T05:47:57.291 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:57.291 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.291 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.291 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:57.291 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6823", 2021-11-12T05:47:57.292 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:57.292 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.292 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.292 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.292 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:57.293 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:57.293 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.293 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:57.293 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6820", 2021-11-12T05:47:57.294 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:57.294 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.294 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.294 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:57.294 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6821", 2021-11-12T05:47:57.295 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:47:57.295 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.295 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.295 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.295 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6817/15098", 2021-11-12T05:47:57.296 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6819/15098", 2021-11-12T05:47:57.296 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6823/15098", 2021-11-12T05:47:57.296 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6821/15098", 2021-11-12T05:47:57.296 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:57.297 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:57.297 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:57.297 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.297 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.297 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.298 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:47:57.298 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "786ce966-d0fb-4181-aed4-c26e3ef61c43", 2021-11-12T05:47:57.298 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:47:57.298 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:47:57.299 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:47:57.299 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:47:57.299 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:47:57.299 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:47:57.300 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:47:57.300 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 93, 2021-11-12T05:47:57.300 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:47:57.300 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:47:57.300 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:47:57.301 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:57.301 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.301 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:57.301 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6824", 2021-11-12T05:47:57.302 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:57.302 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.302 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.302 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:57.302 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6825", 2021-11-12T05:47:57.303 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:57.303 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.303 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.303 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.304 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:47:57.304 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:57.304 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.304 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:57.304 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6826", 2021-11-12T05:47:57.305 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:57.305 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.305 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.305 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:57.306 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6827", 2021-11-12T05:47:57.306 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:57.306 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.306 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.307 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.307 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:47:57.307 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:57.307 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.307 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:57.308 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6830", 2021-11-12T05:47:57.308 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:57.308 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.308 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.308 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:57.309 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6831", 2021-11-12T05:47:57.309 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:57.309 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.309 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.310 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.310 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:47:57.310 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:47:57.310 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.311 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:47:57.311 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6828", 2021-11-12T05:47:57.311 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:57.311 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.311 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.312 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:47:57.312 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6829", 2021-11-12T05:47:57.312 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:47:57.312 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.313 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.313 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.313 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6825/15099", 2021-11-12T05:47:57.313 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6827/15099", 2021-11-12T05:47:57.313 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6831/15099", 2021-11-12T05:47:57.314 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6829/15099", 2021-11-12T05:47:57.314 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:47:57.314 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:47:57.314 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:47:57.314 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:47:57.315 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.315 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:47:57.315 INFO:teuthology.orchestra.run.gibba005.stdout: "osd_xinfo": [ 2021-11-12T05:47:57.315 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.316 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:47:57.316 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:57.316 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:57.316 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:57.316 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:57.317 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:57.317 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.615112+0000", 2021-11-12T05:47:57.317 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:57.317 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.317 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.318 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:47:57.318 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:57.318 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:57.318 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:57.318 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:57.319 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:57.319 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.665935+0000", 2021-11-12T05:47:57.319 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:57.319 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.320 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.320 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:47:57.320 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:57.320 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:57.320 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:57.321 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:57.321 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:57.321 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.715877+0000", 2021-11-12T05:47:57.321 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:57.321 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.322 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.322 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:47:57.322 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:57.322 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:57.322 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:57.323 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:57.323 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:57.323 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.489234+0000", 2021-11-12T05:47:57.323 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:57.324 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.324 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.324 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:47:57.324 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:57.324 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:57.325 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:57.325 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:57.325 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:57.325 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.413776+0000", 2021-11-12T05:47:57.325 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:57.326 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.326 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.326 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:47:57.326 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:57.327 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:57.327 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:57.327 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:57.327 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:57.327 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.507960+0000", 2021-11-12T05:47:57.328 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:57.328 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.328 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.328 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:47:57.328 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:57.329 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:57.329 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:57.329 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:57.329 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:57.330 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.635696+0000", 2021-11-12T05:47:57.330 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:57.330 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.330 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:47:57.330 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:47:57.331 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:47:57.331 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:47:57.331 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:47:57.331 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:47:57.332 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:47:57.332 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.746949+0000", 2021-11-12T05:47:57.332 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:47:57.332 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.332 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:47:57.333 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap": [], 2021-11-12T05:47:57.333 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap_items": [], 2021-11-12T05:47:57.333 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_temp": [], 2021-11-12T05:47:57.333 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_temp": [], 2021-11-12T05:47:57.334 INFO:teuthology.orchestra.run.gibba005.stdout: "blacklist": {}, 2021-11-12T05:47:57.334 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profiles": { 2021-11-12T05:47:57.334 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs_data": { 2021-11-12T05:47:57.334 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-device-class": "", 2021-11-12T05:47:57.335 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:47:57.335 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-root": "default", 2021-11-12T05:47:57.335 INFO:teuthology.orchestra.run.gibba005.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-12T05:47:57.335 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:47:57.335 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "2", 2021-11-12T05:47:57.336 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:47:57.336 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:47:57.336 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van", 2021-11-12T05:47:57.336 INFO:teuthology.orchestra.run.gibba005.stdout: "w": "8" 2021-11-12T05:47:57.337 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.337 INFO:teuthology.orchestra.run.gibba005.stdout: "default": { 2021-11-12T05:47:57.337 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:47:57.337 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:47:57.337 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "1", 2021-11-12T05:47:57.338 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:47:57.338 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:47:57.338 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van" 2021-11-12T05:47:57.338 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:47:57.338 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:47:57.339 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps_queue": [], 2021-11-12T05:47:57.339 INFO:teuthology.orchestra.run.gibba005.stdout: "new_removed_snaps": [], 2021-11-12T05:47:57.339 INFO:teuthology.orchestra.run.gibba005.stdout: "new_purged_snaps": [], 2021-11-12T05:47:57.339 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_node_flags": {}, 2021-11-12T05:47:57.339 INFO:teuthology.orchestra.run.gibba005.stdout: "device_class_flags": {} 2021-11-12T05:47:57.340 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:47:57.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.104+0000 7f3ae5891700 1 -- 172.21.2.105:0/2720886084 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3ac4053660 msgr2=0x7f3ac4055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:57.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.104+0000 7f3ae5891700 1 --2- 172.21.2.105:0/2720886084 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3ac4053660 0x7f3ac4055b20 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f3ac8002f90 tx=0x7f3ac80069b0).stop 2021-11-12T05:47:57.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.104+0000 7f3ae5891700 1 -- 172.21.2.105:0/2720886084 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3ae00aa700 msgr2=0x7f3ae00a2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:57.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.104+0000 7f3ae5891700 1 --2- 172.21.2.105:0/2720886084 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3ae00aa700 0x7f3ae00a2640 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7f3ae00b4120 tx=0x7f3ad0007ca0).stop 2021-11-12T05:47:57.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.104+0000 7f3ae5891700 1 -- 172.21.2.105:0/2720886084 shutdown_connections 2021-11-12T05:47:57.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.104+0000 7f3ae5891700 1 --2- 172.21.2.105:0/2720886084 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3ac4053660 0x7f3ac4055b20 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:57.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.104+0000 7f3ae5891700 1 --2- 172.21.2.105:0/2720886084 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3ae00b1cd0 0x7f3ae005f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:57.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.104+0000 7f3ae5891700 1 --2- 172.21.2.105:0/2720886084 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3ae00b0e60 0x7f3ae0157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:57.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.104+0000 7f3ae5891700 1 --2- 172.21.2.105:0/2720886084 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3ae00aa700 0x7f3ae00a2640 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:57.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.104+0000 7f3ae5891700 1 -- 172.21.2.105:0/2720886084 >> 172.21.2.105:0/2720886084 conn(0x7f3ae0063610 msgr2=0x7f3ae00b42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:57.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.104+0000 7f3ae5891700 1 -- 172.21.2.105:0/2720886084 shutdown_connections 2021-11-12T05:47:57.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.104+0000 7f3ae5891700 1 -- 172.21.2.105:0/2720886084 wait complete. 2021-11-12T05:47:57.345 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:47:57.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.412+0000 7fe48d563700 1 Processor -- start 2021-11-12T05:47:57.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.412+0000 7fe48d563700 1 -- start start 2021-11-12T05:47:57.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.412+0000 7fe48d563700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe48814b2f0 0x7fe4880af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:57.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.412+0000 7fe48d563700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4880ac7b0 con 0x7fe4880ad080 2021-11-12T05:47:57.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.412+0000 7fe48d563700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4880ac9e0 con 0x7fe4880ac280 2021-11-12T05:47:57.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.412+0000 7fe48d563700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4881488a0 con 0x7fe48814b2f0 2021-11-12T05:47:57.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.412+0000 7fe486ffd700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fe4880ad080 0x7fe48814abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:59742/0 (socket says 172.21.2.105:59742) 2021-11-12T05:47:57.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.412+0000 7fe486ffd700 1 -- 172.21.2.105:0/3976361688 learned_addr learned my addr 172.21.2.105:0/3976361688 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:57.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.412+0000 7fe4877fe700 1 --2- 172.21.2.105:0/3976361688 >> v2:172.21.2.105:3300/0 conn(0x7fe48814b2f0 0x7fe4880af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:57.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.412+0000 7fe485ffb700 1 -- 172.21.2.105:0/3976361688 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2911154965 0 0) 0x7fe4880ac7b0 con 0x7fe4880ad080 2021-11-12T05:47:57.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.412+0000 7fe485ffb700 1 -- 172.21.2.105:0/3976361688 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe468003260 con 0x7fe4880ad080 2021-11-12T05:47:57.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.412+0000 7fe4877fe700 1 -- 172.21.2.105:0/3976361688 >> v1:172.21.2.115:6789/0 conn(0x7fe4880ac280 legacy=0x7fe488147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:57.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.412+0000 7fe4877fe700 1 -- 172.21.2.105:0/3976361688 >> v1:172.21.2.105:6789/0 conn(0x7fe4880ad080 legacy=0x7fe48814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:57.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.412+0000 7fe4877fe700 1 -- 172.21.2.105:0/3976361688 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4880b0b30 con 0x7fe48814b2f0 2021-11-12T05:47:57.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.412+0000 7fe4877fe700 1 --2- 172.21.2.105:0/3976361688 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe48814b2f0 0x7fe4880af730 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7fe470001110 tx=0x7fe4800091d0).ready entity=mon.0 client_cookie=3cb2b6e17f3f033e server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:57.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.412+0000 7fe485ffb700 1 -- 172.21.2.105:0/3976361688 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe48000b640 con 0x7fe48814b2f0 2021-11-12T05:47:57.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.412+0000 7fe485ffb700 1 -- 172.21.2.105:0/3976361688 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48000b7a0 con 0x7fe48814b2f0 2021-11-12T05:47:57.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.412+0000 7fe485ffb700 1 -- 172.21.2.105:0/3976361688 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe48000b910 con 0x7fe48814b2f0 2021-11-12T05:47:57.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.412+0000 7fe48d563700 1 -- 172.21.2.105:0/3976361688 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe48814b2f0 msgr2=0x7fe4880af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:57.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.412+0000 7fe48d563700 1 --2- 172.21.2.105:0/3976361688 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe48814b2f0 0x7fe4880af730 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7fe470001110 tx=0x7fe4800091d0).stop 2021-11-12T05:47:57.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.412+0000 7fe48d563700 1 -- 172.21.2.105:0/3976361688 shutdown_connections 2021-11-12T05:47:57.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.412+0000 7fe48d563700 1 --2- 172.21.2.105:0/3976361688 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe48814b2f0 0x7fe4880af730 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:57.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.412+0000 7fe48d563700 1 -- 172.21.2.105:0/3976361688 >> 172.21.2.105:0/3976361688 conn(0x7fe4880b5370 msgr2=0x7fe4880b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:57.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.412+0000 7fe48d563700 1 -- 172.21.2.105:0/3976361688 shutdown_connections 2021-11-12T05:47:57.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.412+0000 7fe48d563700 1 -- 172.21.2.105:0/3976361688 wait complete. 2021-11-12T05:47:57.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.412+0000 7fe48d563700 1 Processor -- start 2021-11-12T05:47:57.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.416+0000 7fe48d563700 1 -- start start 2021-11-12T05:47:57.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.416+0000 7fe48d563700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe4880ac280 0x7fe48815a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:57.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.416+0000 7fe48d563700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe4880ad080 0x7fe48815a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:57.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.416+0000 7fe48d563700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe48814b2f0 0x7fe4880a82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:57.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.416+0000 7fe48d563700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4880a78f0 con 0x7fe48814b2f0 2021-11-12T05:47:57.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.416+0000 7fe48d563700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4880a7650 con 0x7fe4880ac280 2021-11-12T05:47:57.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.416+0000 7fe48d563700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4880ab7a0 con 0x7fe4880ad080 2021-11-12T05:47:57.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.416+0000 7fe4877fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe48814b2f0 0x7fe4880a82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:57.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.416+0000 7fe4877fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe48814b2f0 0x7fe4880a82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49356/0 (socket says 172.21.2.105:49356) 2021-11-12T05:47:57.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.416+0000 7fe4877fe700 1 -- 172.21.2.105:0/2439517663 learned_addr learned my addr 172.21.2.105:0/2439517663 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:57.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.416+0000 7fe4877fe700 1 -- 172.21.2.105:0/2439517663 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe4880ad080 msgr2=0x7fe48815a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:57.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.416+0000 7fe4877fe700 1 --2- 172.21.2.105:0/2439517663 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe4880ad080 0x7fe48815a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:57.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.416+0000 7fe4877fe700 1 -- 172.21.2.105:0/2439517663 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe4880ac280 msgr2=0x7fe48815a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:57.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.416+0000 7fe4877fe700 1 --2- 172.21.2.105:0/2439517663 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe4880ac280 0x7fe48815a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:57.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.416+0000 7fe4877fe700 1 -- 172.21.2.105:0/2439517663 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe480009470 con 0x7fe48814b2f0 2021-11-12T05:47:57.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.416+0000 7fe4877fe700 1 --2- 172.21.2.105:0/2439517663 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe48814b2f0 0x7fe4880a82d0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 rx=0x7fe470001110 tx=0x7fe480016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:57.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.416+0000 7fe47ffff700 1 -- 172.21.2.105:0/2439517663 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe48000b640 con 0x7fe48814b2f0 2021-11-12T05:47:57.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.416+0000 7fe47ffff700 1 -- 172.21.2.105:0/2439517663 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4800032d0 con 0x7fe48814b2f0 2021-11-12T05:47:57.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.416+0000 7fe47ffff700 1 -- 172.21.2.105:0/2439517663 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe48001f5e0 con 0x7fe48814b2f0 2021-11-12T05:47:57.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.416+0000 7fe48d563700 1 -- 172.21.2.105:0/2439517663 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe48814a9b0 con 0x7fe48814b2f0 2021-11-12T05:47:57.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.416+0000 7fe48d563700 1 -- 172.21.2.105:0/2439517663 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4880abde0 con 0x7fe48814b2f0 2021-11-12T05:47:57.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.416+0000 7fe48d563700 1 -- 172.21.2.105:0/2439517663 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4880ab5e0 con 0x7fe48814b2f0 2021-11-12T05:47:57.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.416+0000 7fe47ffff700 1 -- 172.21.2.105:0/2439517663 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe480026030 con 0x7fe48814b2f0 2021-11-12T05:47:57.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.416+0000 7fe47ffff700 1 --2- 172.21.2.105:0/2439517663 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe46c053610 0x7fe46c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:57.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.416+0000 7fe47ffff700 1 -- 172.21.2.105:0/2439517663 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fe48006c640 con 0x7fe48814b2f0 2021-11-12T05:47:57.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.416+0000 7fe486ffd700 1 --2- 172.21.2.105:0/2439517663 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe46c053610 0x7fe46c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:57.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.416+0000 7fe486ffd700 1 --2- 172.21.2.105:0/2439517663 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe46c053610 0x7fe46c055ad0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7fe470000ed0 tx=0x7fe4700076c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:57.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.420+0000 7fe47ffff700 1 -- 172.21.2.105:0/2439517663 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe480043690 con 0x7fe48814b2f0 2021-11-12T05:47:57.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.528+0000 7fe48d563700 1 -- 172.21.2.105:0/2439517663 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4880ab5e0 con 0x7fe48814b2f0 2021-11-12T05:47:57.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.528+0000 7fe47ffff700 1 -- 172.21.2.105:0/2439517663 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+2140 (secure 0 0 0) 0x7fe480024870 con 0x7fe48814b2f0 2021-11-12T05:47:57.532 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:57.532 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":44,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4751,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/3227424218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":3227424218},{"type":"v1","addr":"172.21.2.115:6833","nonce":3227424218}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":43}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:47:50.427589+0000","modified":"2021-11-12T05:47:51.432486+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7017},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7017":{"gid":7017,"name":"a","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/3298879485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":3298879485},{"type":"v1","addr":"172.21.2.105:6835","nonce":3298879485}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-11-12T05:47:57.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.528+0000 7fe48d563700 1 -- 172.21.2.105:0/2439517663 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe46c053610 msgr2=0x7fe46c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:57.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.528+0000 7fe48d563700 1 --2- 172.21.2.105:0/2439517663 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe46c053610 0x7fe46c055ad0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7fe470000ed0 tx=0x7fe4700076c0).stop 2021-11-12T05:47:57.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.528+0000 7fe48d563700 1 -- 172.21.2.105:0/2439517663 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe48814b2f0 msgr2=0x7fe4880a82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:57.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.528+0000 7fe48d563700 1 --2- 172.21.2.105:0/2439517663 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe48814b2f0 0x7fe4880a82d0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 rx=0x7fe470001110 tx=0x7fe480016000).stop 2021-11-12T05:47:57.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.528+0000 7fe48d563700 1 -- 172.21.2.105:0/2439517663 shutdown_connections 2021-11-12T05:47:57.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.528+0000 7fe48d563700 1 --2- 172.21.2.105:0/2439517663 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe46c053610 0x7fe46c055ad0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:57.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.528+0000 7fe48d563700 1 --2- 172.21.2.105:0/2439517663 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe48814b2f0 0x7fe4880a82d0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:57.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.528+0000 7fe48d563700 1 --2- 172.21.2.105:0/2439517663 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe4880ad080 0x7fe48815a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:57.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.528+0000 7fe48d563700 1 --2- 172.21.2.105:0/2439517663 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe4880ac280 0x7fe48815a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:57.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.528+0000 7fe48d563700 1 -- 172.21.2.105:0/2439517663 >> 172.21.2.105:0/2439517663 conn(0x7fe4880b5370 msgr2=0x7fe4881419e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:57.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.528+0000 7fe48d563700 1 -- 172.21.2.105:0/2439517663 shutdown_connections 2021-11-12T05:47:57.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.528+0000 7fe48d563700 1 -- 172.21.2.105:0/2439517663 wait complete. 2021-11-12T05:47:57.537 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 44 2021-11-12T05:47:57.539 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-12T05:47:57.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f9088544700 1 Processor -- start 2021-11-12T05:47:57.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f9088544700 1 -- start start 2021-11-12T05:47:57.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f9088544700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f90800b37d0 0x7f9080141500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:57.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f9088544700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90800b26e0 con 0x7f9080060100 2021-11-12T05:47:57.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f9088544700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90800604e0 con 0x7f90801419f0 2021-11-12T05:47:57.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f9088544700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9080145160 con 0x7f90800b37d0 2021-11-12T05:47:57.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f90862e0700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f9080060100 0x7f90800b1fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:59756/0 (socket says 172.21.2.105:59756) 2021-11-12T05:47:57.594 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f90862e0700 1 -- 172.21.2.105:0/476636045 learned_addr learned my addr 172.21.2.105:0/476636045 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:57.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f90852de700 1 -- 172.21.2.105:0/476636045 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2829248750 0 0) 0x7f90800b26e0 con 0x7f9080060100 2021-11-12T05:47:57.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f90852de700 1 -- 172.21.2.105:0/476636045 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9068003260 con 0x7f9080060100 2021-11-12T05:47:57.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f90852de700 1 -- 172.21.2.105:0/476636045 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3056631218 0 0) 0x7f9068003260 con 0x7f9080060100 2021-11-12T05:47:57.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f90852de700 1 -- 172.21.2.105:0/476636045 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f90800b37d0 msgr2=0x7f9080141500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:57.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f90852de700 1 --2- 172.21.2.105:0/476636045 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f90800b37d0 0x7f9080141500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:57.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f90852de700 1 -- 172.21.2.105:0/476636045 >> v1:172.21.2.115:6789/0 conn(0x7f90801419f0 legacy=0x7f90800b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:57.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f90852de700 1 -- 172.21.2.105:0/476636045 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9080141060 con 0x7f9080060100 2021-11-12T05:47:57.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f90852de700 1 -- 172.21.2.105:0/476636045 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f9070001660 con 0x7f9080060100 2021-11-12T05:47:57.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f90852de700 1 -- 172.21.2.105:0/476636045 >> v1:172.21.2.105:6789/0 conn(0x7f9080060100 legacy=0x7f90800b1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:57.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f90852de700 1 --2- 172.21.2.105:0/476636045 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f90800b37d0 0x7f9068003800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:57.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f90852de700 1 --2- 172.21.2.105:0/476636045 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9068003ef0 0x7f9068004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:57.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f90852de700 1 --2- 172.21.2.105:0/476636045 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9068004bf0 0x7f906800fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:57.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f90852de700 1 -- 172.21.2.105:0/476636045 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9080145160 con 0x7f9068003ef0 2021-11-12T05:47:57.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f90852de700 1 -- 172.21.2.105:0/476636045 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90680052f0 con 0x7f9068004bf0 2021-11-12T05:47:57.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f90852de700 1 -- 172.21.2.105:0/476636045 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9068010050 con 0x7f90800b37d0 2021-11-12T05:47:57.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f9085adf700 1 --2- 172.21.2.105:0/476636045 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9068003ef0 0x7f9068004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:57.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f90862e0700 1 --2- 172.21.2.105:0/476636045 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f90800b37d0 0x7f9068003800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:57.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f9086ae1700 1 --2- 172.21.2.105:0/476636045 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9068004bf0 0x7f906800fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:57.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f9085adf700 1 -- 172.21.2.105:0/476636045 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f90800b37d0 msgr2=0x7f9068003800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:57.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f9085adf700 1 --2- 172.21.2.105:0/476636045 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f90800b37d0 0x7f9068003800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:57.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f9085adf700 1 -- 172.21.2.105:0/476636045 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9068004bf0 msgr2=0x7f906800fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:57.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f9085adf700 1 --2- 172.21.2.105:0/476636045 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9068004bf0 0x7f906800fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:57.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f9085adf700 1 -- 172.21.2.105:0/476636045 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9068003260 con 0x7f9068003ef0 2021-11-12T05:47:57.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f90862e0700 1 --2- 172.21.2.105:0/476636045 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f90800b37d0 0x7f9068003800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:47:57.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f9085adf700 1 --2- 172.21.2.105:0/476636045 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9068003ef0 0x7f9068004500 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7f907c002f70 tx=0x7f907c006ca0).ready entity=mon.0 client_cookie=433a164f28362b64 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:57.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f90852de700 1 -- 172.21.2.105:0/476636045 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f907c013410 con 0x7f9068003ef0 2021-11-12T05:47:57.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f90852de700 1 -- 172.21.2.105:0/476636045 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907c013570 con 0x7f9068003ef0 2021-11-12T05:47:57.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f90852de700 1 -- 172.21.2.105:0/476636045 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f907c0138d0 con 0x7f9068003ef0 2021-11-12T05:47:57.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f9088544700 1 -- 172.21.2.105:0/476636045 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9068003ef0 msgr2=0x7f9068004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:57.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f9088544700 1 --2- 172.21.2.105:0/476636045 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9068003ef0 0x7f9068004500 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7f907c002f70 tx=0x7f907c006ca0).stop 2021-11-12T05:47:57.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f9086ae1700 1 -- 172.21.2.105:0/476636045 reap_dead start 2021-11-12T05:47:57.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f9088544700 1 -- 172.21.2.105:0/476636045 shutdown_connections 2021-11-12T05:47:57.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f9088544700 1 -- 172.21.2.105:0/476636045 >> 172.21.2.105:0/476636045 conn(0x7f90800608d0 msgr2=0x7f908005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:57.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f9088544700 1 -- 172.21.2.105:0/476636045 shutdown_connections 2021-11-12T05:47:57.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.588+0000 7f9088544700 1 -- 172.21.2.105:0/476636045 wait complete. 2021-11-12T05:47:57.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.592+0000 7f9088544700 1 Processor -- start 2021-11-12T05:47:57.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.592+0000 7f9088544700 1 -- start start 2021-11-12T05:47:57.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.592+0000 7f9088544700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9068003ef0 0x7f90800b6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:57.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.592+0000 7f9088544700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9080143d50 0x7f9080142e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:57.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.592+0000 7f9088544700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f90800afdf0 0x7f90800b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:57.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.592+0000 7f9088544700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90801423e0 con 0x7f9068003ef0 2021-11-12T05:47:57.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.592+0000 7f9088544700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9080142680 con 0x7f9080143d50 2021-11-12T05:47:57.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.592+0000 7f9088544700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9080143950 con 0x7f90800afdf0 2021-11-12T05:47:57.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.592+0000 7f90862e0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9068003ef0 0x7f90800b6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:57.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.592+0000 7f90862e0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9068003ef0 0x7f90800b6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49374/0 (socket says 172.21.2.105:49374) 2021-11-12T05:47:57.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.592+0000 7f90862e0700 1 -- 172.21.2.105:0/1757413488 learned_addr learned my addr 172.21.2.105:0/1757413488 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:57.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.592+0000 7f9086ae1700 1 --2- 172.21.2.105:0/1757413488 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f90800afdf0 0x7f90800b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:57.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.592+0000 7f90862e0700 1 -- 172.21.2.105:0/1757413488 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f90800afdf0 msgr2=0x7f90800b02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:57.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.592+0000 7f90862e0700 1 --2- 172.21.2.105:0/1757413488 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f90800afdf0 0x7f90800b02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:57.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.592+0000 7f90862e0700 1 -- 172.21.2.105:0/1757413488 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9080143d50 msgr2=0x7f9080142e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:57.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.592+0000 7f9085adf700 1 --2- 172.21.2.105:0/1757413488 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9080143d50 0x7f9080142e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:57.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.592+0000 7f90862e0700 1 --2- 172.21.2.105:0/1757413488 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9080143d50 0x7f9080142e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:57.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.592+0000 7f90862e0700 1 -- 172.21.2.105:0/1757413488 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9080143b10 con 0x7f9068003ef0 2021-11-12T05:47:57.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.592+0000 7f9085adf700 1 --2- 172.21.2.105:0/1757413488 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9080143d50 0x7f9080142e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:47:57.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.592+0000 7f90862e0700 1 --2- 172.21.2.105:0/1757413488 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9068003ef0 0x7f90800b6dc0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7f9070001940 tx=0x7f9070009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:57.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.592+0000 7f906f7fe700 1 -- 172.21.2.105:0/1757413488 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9070007170 con 0x7f9068003ef0 2021-11-12T05:47:57.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.592+0000 7f906f7fe700 1 -- 172.21.2.105:0/1757413488 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90700072d0 con 0x7f9068003ef0 2021-11-12T05:47:57.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.592+0000 7f9088544700 1 -- 172.21.2.105:0/1757413488 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90800b0790 con 0x7f9068003ef0 2021-11-12T05:47:57.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.592+0000 7f906f7fe700 1 -- 172.21.2.105:0/1757413488 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9070004920 con 0x7f9068003ef0 2021-11-12T05:47:57.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.592+0000 7f9088544700 1 -- 172.21.2.105:0/1757413488 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90801275d0 con 0x7f9068003ef0 2021-11-12T05:47:57.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.592+0000 7f9088544700 1 -- 172.21.2.105:0/1757413488 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9080141e80 con 0x7f9068003ef0 2021-11-12T05:47:57.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.592+0000 7f906f7fe700 1 -- 172.21.2.105:0/1757413488 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f907001b060 con 0x7f9068003ef0 2021-11-12T05:47:57.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.592+0000 7f906f7fe700 1 --2- 172.21.2.105:0/1757413488 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f90600534f0 0x7f90600559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:57.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.592+0000 7f906f7fe700 1 -- 172.21.2.105:0/1757413488 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f907006b690 con 0x7f9068003ef0 2021-11-12T05:47:57.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.592+0000 7f9085adf700 1 --2- 172.21.2.105:0/1757413488 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f90600534f0 0x7f90600559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:57.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.592+0000 7f9085adf700 1 --2- 172.21.2.105:0/1757413488 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f90600534f0 0x7f90600559b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f907c016000 tx=0x7f907c014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:57.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.596+0000 7f906f7fe700 1 -- 172.21.2.105:0/1757413488 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9070042640 con 0x7f9068003ef0 2021-11-12T05:47:57.711 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:57.708+0000 7f9088544700 1 -- 172.21.2.105:0/1757413488 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9080057350 con 0x7f9068003ef0 2021-11-12T05:47:58.475 INFO:tasks.ceph.mon.a.gibba005.stderr:2021-11-12T05:47:58.472+0000 7fe9772b2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-12T05:47:58.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.484+0000 7f906f7fe700 1 -- 172.21.2.105:0/1757413488 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v45) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9070019020 con 0x7f9068003ef0 2021-11-12T05:47:58.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.484+0000 7f9088544700 1 -- 172.21.2.105:0/1757413488 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f90600534f0 msgr2=0x7f90600559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:58.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.484+0000 7f9088544700 1 --2- 172.21.2.105:0/1757413488 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f90600534f0 0x7f90600559b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f907c016000 tx=0x7f907c014000).stop 2021-11-12T05:47:58.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.484+0000 7f9088544700 1 -- 172.21.2.105:0/1757413488 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9068003ef0 msgr2=0x7f90800b6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:58.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.484+0000 7f9088544700 1 --2- 172.21.2.105:0/1757413488 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9068003ef0 0x7f90800b6dc0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7f9070001940 tx=0x7f9070009040).stop 2021-11-12T05:47:58.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.484+0000 7f9088544700 1 -- 172.21.2.105:0/1757413488 shutdown_connections 2021-11-12T05:47:58.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.484+0000 7f9088544700 1 --2- 172.21.2.105:0/1757413488 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f90600534f0 0x7f90600559b0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:58.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.484+0000 7f9088544700 1 --2- 172.21.2.105:0/1757413488 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f90800afdf0 0x7f90800b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:58.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.484+0000 7f9088544700 1 --2- 172.21.2.105:0/1757413488 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9080143d50 0x7f9080142e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:58.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.484+0000 7f9088544700 1 --2- 172.21.2.105:0/1757413488 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9068003ef0 0x7f90800b6dc0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:58.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.484+0000 7f9088544700 1 -- 172.21.2.105:0/1757413488 >> 172.21.2.105:0/1757413488 conn(0x7f90800608d0 msgr2=0x7f908005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:58.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.484+0000 7f9088544700 1 -- 172.21.2.105:0/1757413488 shutdown_connections 2021-11-12T05:47:58.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.484+0000 7f9088544700 1 -- 172.21.2.105:0/1757413488 wait complete. 2021-11-12T05:47:58.493 INFO:teuthology.orchestra.run.gibba005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-12T05:47:58.498 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:47:58.503 INFO:tasks.ceph.mds.a.gibba005.stdout:starting mds.a at 2021-11-12T05:47:58.550 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.544+0000 7fd699b2c700 1 Processor -- start 2021-11-12T05:47:58.550 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.544+0000 7fd699b2c700 1 -- start start 2021-11-12T05:47:58.552 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.544+0000 7fd699b2c700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fd6940b0780 0x7fd6941434d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:58.552 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.544+0000 7fd699b2c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd6940b0cc0 0x7fd69405c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:58.553 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd699b2c700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6940b2d20 con 0x7fd6940b2940 2021-11-12T05:47:58.553 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd699b2c700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6940b1fc0 con 0x7fd6940b0cc0 2021-11-12T05:47:58.553 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd699b2c700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6940b15e0 con 0x7fd6940b0780 2021-11-12T05:47:58.553 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd693fff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd6940b0cc0 0x7fd69405c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:58.553 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd693fff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd6940b0cc0 0x7fd69405c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49392/0 (socket says 172.21.2.105:49392) 2021-11-12T05:47:58.554 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd693fff700 1 -- 172.21.2.105:0/2083283384 learned_addr learned my addr 172.21.2.105:0/2083283384 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:58.554 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd693fff700 1 -- 172.21.2.105:0/2083283384 >> v2:172.21.2.115:3300/0 conn(0x7fd6940b0780 msgr2=0x7fd6941434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:58.554 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd693fff700 1 --2- 172.21.2.105:0/2083283384 >> v2:172.21.2.115:3300/0 conn(0x7fd6940b0780 0x7fd6941434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:58.554 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd693fff700 1 -- 172.21.2.105:0/2083283384 >> v1:172.21.2.115:6789/0 conn(0x7fd6940b2940 legacy=0x7fd694142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:58.555 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd693fff700 1 -- 172.21.2.105:0/2083283384 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6940b1880 con 0x7fd6940b0cc0 2021-11-12T05:47:58.555 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd693fff700 1 --2- 172.21.2.105:0/2083283384 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6940b0cc0 0x7fd69405c490 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7fd6940b1ea0 tx=0x7fd68c009290).ready entity=mon.0 client_cookie=b562d8fb839e3272 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:58.555 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd6927fc700 1 -- 172.21.2.105:0/2083283384 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd68c00b830 con 0x7fd6940b0cc0 2021-11-12T05:47:58.555 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd6927fc700 1 -- 172.21.2.105:0/2083283384 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68c00b990 con 0x7fd6940b0cc0 2021-11-12T05:47:58.556 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd6927fc700 1 -- 172.21.2.105:0/2083283384 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd68c00bb40 con 0x7fd6940b0cc0 2021-11-12T05:47:58.556 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd699b2c700 1 -- 172.21.2.105:0/2083283384 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6940b0cc0 msgr2=0x7fd69405c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:58.556 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd699b2c700 1 --2- 172.21.2.105:0/2083283384 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6940b0cc0 0x7fd69405c490 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7fd6940b1ea0 tx=0x7fd68c009290).stop 2021-11-12T05:47:58.556 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd699b2c700 1 -- 172.21.2.105:0/2083283384 shutdown_connections 2021-11-12T05:47:58.556 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd699b2c700 1 --2- 172.21.2.105:0/2083283384 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6940b0cc0 0x7fd69405c490 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:58.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd699b2c700 1 --2- 172.21.2.105:0/2083283384 >> v2:172.21.2.115:3300/0 conn(0x7fd6940b0780 0x7fd6941434d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:58.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd699b2c700 1 -- 172.21.2.105:0/2083283384 >> 172.21.2.105:0/2083283384 conn(0x7fd694068440 msgr2=0x7fd694062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:58.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd699b2c700 1 -- 172.21.2.105:0/2083283384 shutdown_connections 2021-11-12T05:47:58.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd699b2c700 1 -- 172.21.2.105:0/2083283384 wait complete. 2021-11-12T05:47:58.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd699b2c700 1 Processor -- start 2021-11-12T05:47:58.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd699b2c700 1 -- start start 2021-11-12T05:47:58.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd699b2c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6940b0780 0x7fd6940659f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:58.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd699b2c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6940b0cc0 0x7fd6940ac250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:58.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd699b2c700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd6940b2940 0x7fd6940a8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:58.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd699b2c700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd694139830 con 0x7fd6940b0cc0 2021-11-12T05:47:58.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd699b2c700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd694066bc0 con 0x7fd6940b2940 2021-11-12T05:47:58.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd699b2c700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd694066e60 con 0x7fd6940b0780 2021-11-12T05:47:58.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd692ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6940b0cc0 0x7fd6940ac250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:58.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd692ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6940b0cc0 0x7fd6940ac250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49396/0 (socket says 172.21.2.105:49396) 2021-11-12T05:47:58.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd692ffd700 1 -- 172.21.2.105:0/93956436 learned_addr learned my addr 172.21.2.105:0/93956436 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:58.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd692ffd700 1 -- 172.21.2.105:0/93956436 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6940b0780 msgr2=0x7fd6940659f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:47:58.563 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd692ffd700 1 --2- 172.21.2.105:0/93956436 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6940b0780 0x7fd6940659f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:58.563 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd692ffd700 1 -- 172.21.2.105:0/93956436 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd6940b2940 msgr2=0x7fd6940a8160 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:47:58.563 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd692ffd700 1 --2- 172.21.2.105:0/93956436 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd6940b2940 0x7fd6940a8160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:58.563 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd692ffd700 1 -- 172.21.2.105:0/93956436 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68c009530 con 0x7fd6940b0cc0 2021-11-12T05:47:58.563 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd692ffd700 1 --2- 172.21.2.105:0/93956436 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6940b0cc0 0x7fd6940ac250 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7fd67c002f70 tx=0x7fd67c006e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:58.564 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd690ff9700 1 -- 172.21.2.105:0/93956436 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd67c013460 con 0x7fd6940b0cc0 2021-11-12T05:47:58.564 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd690ff9700 1 -- 172.21.2.105:0/93956436 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67c0135c0 con 0x7fd6940b0cc0 2021-11-12T05:47:58.564 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd699b2c700 1 -- 172.21.2.105:0/93956436 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd694140540 con 0x7fd6940b0cc0 2021-11-12T05:47:58.564 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd690ff9700 1 -- 172.21.2.105:0/93956436 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd67c013920 con 0x7fd6940b0cc0 2021-11-12T05:47:58.565 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd699b2c700 1 -- 172.21.2.105:0/93956436 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6940a8650 con 0x7fd6940b0cc0 2021-11-12T05:47:58.565 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.548+0000 7fd699b2c700 1 -- 172.21.2.105:0/93956436 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6940b1b20 con 0x7fd6940b0cc0 2021-11-12T05:47:58.565 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.552+0000 7fd690ff9700 1 -- 172.21.2.105:0/93956436 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd67c01a060 con 0x7fd6940b0cc0 2021-11-12T05:47:58.565 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.552+0000 7fd690ff9700 1 --2- 172.21.2.105:0/93956436 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd678053610 0x7fd678055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:58.565 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.552+0000 7fd690ff9700 1 -- 172.21.2.105:0/93956436 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6502+0+0 (secure 0 0 0) 0x7fd67c06b620 con 0x7fd6940b0cc0 2021-11-12T05:47:58.566 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.552+0000 7fd6937fe700 1 --2- 172.21.2.105:0/93956436 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd678053610 0x7fd678055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:58.566 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.552+0000 7fd6937fe700 1 --2- 172.21.2.105:0/93956436 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd678053610 0x7fd678055ad0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7fd684002f10 tx=0x7fd6840068b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:58.566 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.552+0000 7fd690ff9700 1 -- 172.21.2.105:0/93956436 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd67c0424c0 con 0x7fd6940b0cc0 2021-11-12T05:47:58.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.664+0000 7fd699b2c700 1 -- 172.21.2.105:0/93956436 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd694057350 con 0x7fd6940b0cc0 2021-11-12T05:47:58.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.664+0000 7fd690ff9700 1 -- 172.21.2.105:0/93956436 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+1779 (secure 0 0 0) 0x7fd67c045ae0 con 0x7fd6940b0cc0 2021-11-12T05:47:58.669 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:47:58.669 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":45,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4751,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/3227424218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":3227424218},{"type":"v1","addr":"172.21.2.115:6833","nonce":3227424218}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":43}],"filesystems":[{"mdsmap":{"epoch":45,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:47:50.427589+0000","modified":"2021-11-12T05:47:58.475424+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":98,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-11-12T05:47:58.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.664+0000 7fd699b2c700 1 -- 172.21.2.105:0/93956436 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd678053610 msgr2=0x7fd678055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:58.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.664+0000 7fd699b2c700 1 --2- 172.21.2.105:0/93956436 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd678053610 0x7fd678055ad0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7fd684002f10 tx=0x7fd6840068b0).stop 2021-11-12T05:47:58.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.664+0000 7fd699b2c700 1 -- 172.21.2.105:0/93956436 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6940b0cc0 msgr2=0x7fd6940ac250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:58.671 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.664+0000 7fd699b2c700 1 --2- 172.21.2.105:0/93956436 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6940b0cc0 0x7fd6940ac250 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7fd67c002f70 tx=0x7fd67c006e90).stop 2021-11-12T05:47:58.671 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.664+0000 7fd699b2c700 1 -- 172.21.2.105:0/93956436 shutdown_connections 2021-11-12T05:47:58.671 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.664+0000 7fd699b2c700 1 --2- 172.21.2.105:0/93956436 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd678053610 0x7fd678055ad0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:58.671 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.664+0000 7fd699b2c700 1 --2- 172.21.2.105:0/93956436 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd6940b2940 0x7fd6940a8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:58.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.664+0000 7fd699b2c700 1 --2- 172.21.2.105:0/93956436 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6940b0cc0 0x7fd6940ac250 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:58.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.664+0000 7fd699b2c700 1 --2- 172.21.2.105:0/93956436 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6940b0780 0x7fd6940659f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:47:58.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.664+0000 7fd699b2c700 1 -- 172.21.2.105:0/93956436 >> 172.21.2.105:0/93956436 conn(0x7fd694068440 msgr2=0x7fd6940ae700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:58.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.664+0000 7fd699b2c700 1 -- 172.21.2.105:0/93956436 shutdown_connections 2021-11-12T05:47:58.673 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.664+0000 7fd699b2c700 1 -- 172.21.2.105:0/93956436 wait complete. 2021-11-12T05:47:58.673 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 45 2021-11-12T05:47:58.676 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-12T05:47:58.728 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.724+0000 7f5775a39700 1 Processor -- start 2021-11-12T05:47:58.728 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.724+0000 7f5775a39700 1 -- start start 2021-11-12T05:47:58.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.724+0000 7f5775a39700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f57700ace20 0x7f57700b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:58.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.724+0000 7f5775a39700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f5770144180 0x7f5770144610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:58.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.724+0000 7f5775a39700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57700b1840 con 0x7f57700aca40 2021-11-12T05:47:58.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.724+0000 7f5775a39700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57700ad2a0 con 0x7f5770144180 2021-11-12T05:47:58.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.724+0000 7f5775a39700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57700b0a10 con 0x7f57700ace20 2021-11-12T05:47:58.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.724+0000 7f576effd700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7f57700aca40 0x7f57701473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:58268/0 (socket says 172.21.2.105:58268) 2021-11-12T05:47:58.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.724+0000 7f576f7fe700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f5770144180 0x7f5770144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:58.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.724+0000 7f576effd700 1 -- 172.21.2.105:0/494428460 learned_addr learned my addr 172.21.2.105:0/494428460 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:58.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.724+0000 7f576e7fc700 1 --2- 172.21.2.105:0/494428460 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f57700ace20 0x7f57700b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:58.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.724+0000 7f576dffb700 1 -- 172.21.2.105:0/494428460 <== mon.1 v1:172.21.2.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2795704968 0 0) 0x7f57700b1840 con 0x7f57700aca40 2021-11-12T05:47:58.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.724+0000 7f576f7fe700 1 -- 172.21.2.105:0/494428460 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f57700ace20 msgr2=0x7f57700b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:58.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.724+0000 7f576f7fe700 1 --2- 172.21.2.105:0/494428460 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f57700ace20 0x7f57700b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:58.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.724+0000 7f576f7fe700 1 -- 172.21.2.105:0/494428460 >> v1:172.21.2.115:6789/0 conn(0x7f57700aca40 legacy=0x7f57701473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:58.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.724+0000 7f576f7fe700 1 -- 172.21.2.105:0/494428460 --> v2:172.21.2.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57700af2b0 con 0x7f5770144180 2021-11-12T05:47:58.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.724+0000 7f576f7fe700 1 --2- 172.21.2.105:0/494428460 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5770144180 0x7f5770144610 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f57680032f0 tx=0x7f57680091d0).ready entity=mon.1 client_cookie=a8add4d2b629f68f server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:58.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.728+0000 7f576dffb700 1 -- 172.21.2.105:0/494428460 <== mon.1 v2:172.21.2.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f576800b6c0 con 0x7f5770144180 2021-11-12T05:47:58.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.728+0000 7f576dffb700 1 -- 172.21.2.105:0/494428460 <== mon.1 v2:172.21.2.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576800b820 con 0x7f5770144180 2021-11-12T05:47:58.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.728+0000 7f576dffb700 1 -- 172.21.2.105:0/494428460 <== mon.1 v2:172.21.2.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f576800b990 con 0x7f5770144180 2021-11-12T05:47:58.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.728+0000 7f5775a39700 1 -- 172.21.2.105:0/494428460 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5770144180 msgr2=0x7f5770144610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:58.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.728+0000 7f5775a39700 1 --2- 172.21.2.105:0/494428460 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5770144180 0x7f5770144610 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f57680032f0 tx=0x7f57680091d0).stop 2021-11-12T05:47:58.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.728+0000 7f5775a39700 1 -- 172.21.2.105:0/494428460 shutdown_connections 2021-11-12T05:47:58.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.728+0000 7f5775a39700 1 --2- 172.21.2.105:0/494428460 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5770144180 0x7f5770144610 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:58.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.728+0000 7f5775a39700 1 --2- 172.21.2.105:0/494428460 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f57700ace20 0x7f57700b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:58.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.728+0000 7f5775a39700 1 -- 172.21.2.105:0/494428460 >> 172.21.2.105:0/494428460 conn(0x7f577005c490 msgr2=0x7f57700b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:58.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.728+0000 7f5775a39700 1 -- 172.21.2.105:0/494428460 shutdown_connections 2021-11-12T05:47:58.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.728+0000 7f5775a39700 1 -- 172.21.2.105:0/494428460 wait complete. 2021-11-12T05:47:58.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.728+0000 7f5775a39700 1 Processor -- start 2021-11-12T05:47:58.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.728+0000 7f5775a39700 1 -- start start 2021-11-12T05:47:58.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.728+0000 7f5775a39700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f57700aca40 0x7f57700abc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:58.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.728+0000 7f5775a39700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f57700ace20 0x7f57700aa260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:58.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.728+0000 7f5775a39700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5770144180 0x7f57700b3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:58.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.728+0000 7f5775a39700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5770147fe0 con 0x7f5770144180 2021-11-12T05:47:58.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.728+0000 7f5775a39700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57700a7a10 con 0x7f57700aca40 2021-11-12T05:47:58.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.728+0000 7f5775a39700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57700a7cb0 con 0x7f57700ace20 2021-11-12T05:47:58.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.728+0000 7f576f7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5770144180 0x7f57700b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:58.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.728+0000 7f576f7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5770144180 0x7f57700b3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49414/0 (socket says 172.21.2.105:49414) 2021-11-12T05:47:58.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.728+0000 7f576f7fe700 1 -- 172.21.2.105:0/2715795615 learned_addr learned my addr 172.21.2.105:0/2715795615 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:58.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.728+0000 7f576effd700 1 --2- 172.21.2.105:0/2715795615 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f57700aca40 0x7f57700abc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:58.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.728+0000 7f576e7fc700 1 --2- 172.21.2.105:0/2715795615 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f57700ace20 0x7f57700aa260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:58.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.728+0000 7f576f7fe700 1 -- 172.21.2.105:0/2715795615 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f57700ace20 msgr2=0x7f57700aa260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:58.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.728+0000 7f576f7fe700 1 --2- 172.21.2.105:0/2715795615 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f57700ace20 0x7f57700aa260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:58.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.728+0000 7f576f7fe700 1 -- 172.21.2.105:0/2715795615 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f57700aca40 msgr2=0x7f57700abc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:58.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.728+0000 7f576f7fe700 1 --2- 172.21.2.105:0/2715795615 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f57700aca40 0x7f57700abc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:58.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.728+0000 7f576f7fe700 1 -- 172.21.2.105:0/2715795615 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5768009470 con 0x7f5770144180 2021-11-12T05:47:58.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.728+0000 7f576effd700 1 --2- 172.21.2.105:0/2715795615 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f57700aca40 0x7f57700abc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-12T05:47:58.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.728+0000 7f576f7fe700 1 --2- 172.21.2.105:0/2715795615 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5770144180 0x7f57700b3430 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7f57680032f0 tx=0x7f5768016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:58.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.728+0000 7f5767fff700 1 -- 172.21.2.105:0/2715795615 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f576800b6c0 con 0x7f5770144180 2021-11-12T05:47:58.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.728+0000 7f5767fff700 1 -- 172.21.2.105:0/2715795615 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5768021440 con 0x7f5770144180 2021-11-12T05:47:58.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.728+0000 7f5775a39700 1 -- 172.21.2.105:0/2715795615 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57700a7f50 con 0x7f5770144180 2021-11-12T05:47:58.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.728+0000 7f5767fff700 1 -- 172.21.2.105:0/2715795615 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57680217a0 con 0x7f5770144180 2021-11-12T05:47:58.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.728+0000 7f5775a39700 1 -- 172.21.2.105:0/2715795615 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57700a71c0 con 0x7f5770144180 2021-11-12T05:47:58.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.728+0000 7f5775a39700 1 -- 172.21.2.105:0/2715795615 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57700a8110 con 0x7f5770144180 2021-11-12T05:47:58.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.728+0000 7f5767fff700 1 -- 172.21.2.105:0/2715795615 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f576800f070 con 0x7f5770144180 2021-11-12T05:47:58.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.732+0000 7f5767fff700 1 --2- 172.21.2.105:0/2715795615 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5754053610 0x7f5754055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:58.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.732+0000 7f5767fff700 1 -- 172.21.2.105:0/2715795615 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f576806c1a0 con 0x7f5770144180 2021-11-12T05:47:58.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.732+0000 7f576effd700 1 --2- 172.21.2.105:0/2715795615 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5754053610 0x7f5754055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:58.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.732+0000 7f576effd700 1 --2- 172.21.2.105:0/2715795615 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5754053610 0x7f5754055ad0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f575800d000 tx=0x7f5758007a00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:58.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.732+0000 7f5767fff700 1 -- 172.21.2.105:0/2715795615 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5768043150 con 0x7f5770144180 2021-11-12T05:47:58.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:58.840+0000 7f5775a39700 1 -- 172.21.2.105:0/2715795615 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f577005f280 con 0x7f5770144180 2021-11-12T05:47:59.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.724+0000 7f5767fff700 1 -- 172.21.2.105:0/2715795615 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v46) v1 ==== 104+0+0 (secure 0 0 0) 0x7f57680150a0 con 0x7f5770144180 2021-11-12T05:47:59.728 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.724+0000 7f5775a39700 1 -- 172.21.2.105:0/2715795615 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5754053610 msgr2=0x7f5754055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:59.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.724+0000 7f5775a39700 1 --2- 172.21.2.105:0/2715795615 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5754053610 0x7f5754055ad0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f575800d000 tx=0x7f5758007a00).stop 2021-11-12T05:47:59.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.724+0000 7f5775a39700 1 -- 172.21.2.105:0/2715795615 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5770144180 msgr2=0x7f57700b3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:59.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.724+0000 7f5775a39700 1 --2- 172.21.2.105:0/2715795615 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5770144180 0x7f57700b3430 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7f57680032f0 tx=0x7f5768016000).stop 2021-11-12T05:47:59.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.724+0000 7f5775a39700 1 -- 172.21.2.105:0/2715795615 shutdown_connections 2021-11-12T05:47:59.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.724+0000 7f5775a39700 1 --2- 172.21.2.105:0/2715795615 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5754053610 0x7f5754055ad0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:59.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.724+0000 7f5775a39700 1 --2- 172.21.2.105:0/2715795615 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5770144180 0x7f57700b3430 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:59.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.724+0000 7f5775a39700 1 --2- 172.21.2.105:0/2715795615 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f57700ace20 0x7f57700aa260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:59.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.724+0000 7f5775a39700 1 --2- 172.21.2.105:0/2715795615 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f57700aca40 0x7f57700abc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:59.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.724+0000 7f5775a39700 1 -- 172.21.2.105:0/2715795615 >> 172.21.2.105:0/2715795615 conn(0x7f577005c490 msgr2=0x7f577014aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:59.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.724+0000 7f5775a39700 1 -- 172.21.2.105:0/2715795615 shutdown_connections 2021-11-12T05:47:59.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.724+0000 7f5775a39700 1 -- 172.21.2.105:0/2715795615 wait complete. 2021-11-12T05:47:59.736 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-12T05:47:59.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f6595e66700 1 Processor -- start 2021-11-12T05:47:59.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f6595e66700 1 -- start start 2021-11-12T05:47:59.804 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f6595e66700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f659014b2f0 0x7f65900af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:59.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f6595e66700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65900ac7b0 con 0x7f65900ac280 2021-11-12T05:47:59.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f6595e66700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65900ac9e0 con 0x7f65900ad080 2021-11-12T05:47:59.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f6595e66700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65901488a0 con 0x7f659014b2f0 2021-11-12T05:47:59.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f658effd700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f65900ac280 0x7f6590147a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:59818/0 (socket says 172.21.2.105:59818) 2021-11-12T05:47:59.806 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f658effd700 1 -- 172.21.2.105:0/2378652318 learned_addr learned my addr 172.21.2.105:0/2378652318 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:47:59.806 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f658ffff700 1 --2- 172.21.2.105:0/2378652318 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f659014b2f0 0x7f65900af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:59.806 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f658e7fc700 1 -- 172.21.2.105:0/2378652318 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2117221673 0 0) 0x7f65900ac7b0 con 0x7f65900ac280 2021-11-12T05:47:59.806 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f658e7fc700 1 -- 172.21.2.105:0/2378652318 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6570003260 con 0x7f65900ac280 2021-11-12T05:47:59.807 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f658e7fc700 1 -- 172.21.2.105:0/2378652318 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4189367096 0 0) 0x7f6570003260 con 0x7f65900ac280 2021-11-12T05:47:59.807 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f658e7fc700 1 -- 172.21.2.105:0/2378652318 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f659014b2f0 msgr2=0x7f65900af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:59.807 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f658e7fc700 1 --2- 172.21.2.105:0/2378652318 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f659014b2f0 0x7f65900af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:59.807 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f658e7fc700 1 -- 172.21.2.105:0/2378652318 >> v1:172.21.2.115:6789/0 conn(0x7f65900ad080 legacy=0x7f659014abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:59.807 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f658e7fc700 1 -- 172.21.2.105:0/2378652318 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65900b0b30 con 0x7f65900ac280 2021-11-12T05:47:59.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f658e7fc700 1 -- 172.21.2.105:0/2378652318 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f6578001660 con 0x7f65900ac280 2021-11-12T05:47:59.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f658e7fc700 1 -- 172.21.2.105:0/2378652318 >> v1:172.21.2.105:6789/0 conn(0x7f65900ac280 legacy=0x7f6590147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:59.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f658e7fc700 1 --2- 172.21.2.105:0/2378652318 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6570003780 0x7f6570003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:59.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f658e7fc700 1 --2- 172.21.2.105:0/2378652318 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f659014b2f0 0x7f6570004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:59.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f658e7fc700 1 --2- 172.21.2.105:0/2378652318 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f65700049f0 0x7f6570004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:59.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f658e7fc700 1 -- 172.21.2.105:0/2378652318 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65901488a0 con 0x7f65700049f0 2021-11-12T05:47:59.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f658e7fc700 1 -- 172.21.2.105:0/2378652318 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657000b800 con 0x7f6570003780 2021-11-12T05:47:59.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f658e7fc700 1 -- 172.21.2.105:0/2378652318 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f657000b9c0 con 0x7f659014b2f0 2021-11-12T05:47:59.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f658ffff700 1 --2- 172.21.2.105:0/2378652318 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f65700049f0 0x7f6570004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:59.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f658f7fe700 1 --2- 172.21.2.105:0/2378652318 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6570003780 0x7f6570003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:59.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f658effd700 1 --2- 172.21.2.105:0/2378652318 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f659014b2f0 0x7f6570004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:59.811 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f658ffff700 1 -- 172.21.2.105:0/2378652318 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f659014b2f0 msgr2=0x7f6570004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:59.811 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f658ffff700 1 --2- 172.21.2.105:0/2378652318 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f659014b2f0 0x7f6570004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:59.811 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f658ffff700 1 -- 172.21.2.105:0/2378652318 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6570003780 msgr2=0x7f6570003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:47:59.811 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f658ffff700 1 --2- 172.21.2.105:0/2378652318 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6570003780 0x7f6570003ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:59.811 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f658ffff700 1 -- 172.21.2.105:0/2378652318 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6570003260 con 0x7f65700049f0 2021-11-12T05:47:59.812 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f658ffff700 1 --2- 172.21.2.105:0/2378652318 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f65700049f0 0x7f6570004e70 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7f658800c000 tx=0x7f65880091d0).ready entity=mon.0 client_cookie=c084ee162c456a53 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:59.812 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f658e7fc700 1 -- 172.21.2.105:0/2378652318 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f658800e7e0 con 0x7f65700049f0 2021-11-12T05:47:59.812 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f658e7fc700 1 -- 172.21.2.105:0/2378652318 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658800e940 con 0x7f65700049f0 2021-11-12T05:47:59.813 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f658e7fc700 1 -- 172.21.2.105:0/2378652318 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f658800eca0 con 0x7f65700049f0 2021-11-12T05:47:59.813 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f6595e66700 1 -- 172.21.2.105:0/2378652318 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f65700049f0 msgr2=0x7f6570004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:59.813 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f6595e66700 1 --2- 172.21.2.105:0/2378652318 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f65700049f0 0x7f6570004e70 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7f658800c000 tx=0x7f65880091d0).stop 2021-11-12T05:47:59.813 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f658ffff700 1 -- 172.21.2.105:0/2378652318 reap_dead start 2021-11-12T05:47:59.813 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f6595e66700 1 -- 172.21.2.105:0/2378652318 shutdown_connections 2021-11-12T05:47:59.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f6595e66700 1 -- 172.21.2.105:0/2378652318 >> 172.21.2.105:0/2378652318 conn(0x7f65900b5370 msgr2=0x7f65900b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:47:59.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f6595e66700 1 -- 172.21.2.105:0/2378652318 shutdown_connections 2021-11-12T05:47:59.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.796+0000 7f6595e66700 1 -- 172.21.2.105:0/2378652318 wait complete. 2021-11-12T05:47:59.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.800+0000 7f6595e66700 1 Processor -- start 2021-11-12T05:47:59.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.800+0000 7f6595e66700 1 -- start start 2021-11-12T05:47:59.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.800+0000 7f6595e66700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f65700049f0 0x7f6590157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:59.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.800+0000 7f6595e66700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6590063620 0x7f6590063aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:59.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.800+0000 7f6595e66700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6590155dc0 0x7f6590156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:59.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.800+0000 7f6595e66700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65900a99e0 con 0x7f65700049f0 2021-11-12T05:47:59.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.800+0000 7f6595e66700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6590157a40 con 0x7f6590063620 2021-11-12T05:47:59.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.800+0000 7f6595e66700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65900a94a0 con 0x7f6590155dc0 2021-11-12T05:47:59.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.800+0000 7f658f7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f65700049f0 0x7f6590157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:59.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.800+0000 7f658ffff700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6590155dc0 0x7f6590156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:59.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.800+0000 7f658f7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f65700049f0 0x7f6590157550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49430/0 (socket says 172.21.2.105:49430) 2021-11-12T05:47:59.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.800+0000 7f658f7fe700 1 -- 172.21.2.105:0/3336927866 learned_addr learned my addr 172.21.2.105:0/3336927866 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:47:59.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.800+0000 7f658effd700 1 --2- 172.21.2.105:0/3336927866 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6590063620 0x7f6590063aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:59.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.800+0000 7f658f7fe700 1 -- 172.21.2.105:0/3336927866 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6590155dc0 msgr2=0x7f6590156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:59.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.800+0000 7f658f7fe700 1 --2- 172.21.2.105:0/3336927866 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6590155dc0 0x7f6590156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:59.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.800+0000 7f658f7fe700 1 -- 172.21.2.105:0/3336927866 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6590063620 msgr2=0x7f6590063aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:47:59.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.800+0000 7f658f7fe700 1 --2- 172.21.2.105:0/3336927866 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6590063620 0x7f6590063aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:47:59.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.800+0000 7f658f7fe700 1 -- 172.21.2.105:0/3336927866 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65900a9740 con 0x7f65700049f0 2021-11-12T05:47:59.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.800+0000 7f658effd700 1 --2- 172.21.2.105:0/3336927866 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6590063620 0x7f6590063aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:47:59.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.800+0000 7f658ffff700 1 --2- 172.21.2.105:0/3336927866 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6590155dc0 0x7f6590156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:47:59.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.800+0000 7f658f7fe700 1 --2- 172.21.2.105:0/3336927866 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f65700049f0 0x7f6590157550 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7f65900aa1c0 tx=0x7f6580007a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:59.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.800+0000 7f658cff9700 1 -- 172.21.2.105:0/3336927866 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6580011590 con 0x7f65700049f0 2021-11-12T05:47:59.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.800+0000 7f658cff9700 1 -- 172.21.2.105:0/3336927866 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65800116f0 con 0x7f65700049f0 2021-11-12T05:47:59.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.800+0000 7f6595e66700 1 -- 172.21.2.105:0/3336927866 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6590156730 con 0x7f65700049f0 2021-11-12T05:47:59.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.800+0000 7f658cff9700 1 -- 172.21.2.105:0/3336927866 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6580011a50 con 0x7f65700049f0 2021-11-12T05:47:59.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.800+0000 7f6595e66700 1 -- 172.21.2.105:0/3336927866 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f659015a280 con 0x7f65700049f0 2021-11-12T05:47:59.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.800+0000 7f6595e66700 1 -- 172.21.2.105:0/3336927866 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65900aa200 con 0x7f65700049f0 2021-11-12T05:47:59.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.800+0000 7f658cff9700 1 -- 172.21.2.105:0/3336927866 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f658001a030 con 0x7f65700049f0 2021-11-12T05:47:59.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.800+0000 7f658cff9700 1 --2- 172.21.2.105:0/3336927866 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6574053660 0x7f6574055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:47:59.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.800+0000 7f658cff9700 1 -- 172.21.2.105:0/3336927866 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f658006b570 con 0x7f65700049f0 2021-11-12T05:47:59.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.800+0000 7f658effd700 1 --2- 172.21.2.105:0/3336927866 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6574053660 0x7f6574055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:47:59.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.800+0000 7f658effd700 1 --2- 172.21.2.105:0/3336927866 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6574053660 0x7f6574055b20 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f6578005000 tx=0x7f6578009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:47:59.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.804+0000 7f658cff9700 1 -- 172.21.2.105:0/3336927866 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f65800425d0 con 0x7f65700049f0 2021-11-12T05:47:59.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:47:59.884+0000 7f6595e66700 1 -- 172.21.2.105:0/3336927866 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f65900b1440 con 0x7f65700049f0 2021-11-12T05:48:00.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.728+0000 7f658cff9700 1 -- 172.21.2.105:0/3336927866 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v99) v1 ==== 185+0+0 (secure 0 0 0) 0x7f6580018070 con 0x7f65700049f0 2021-11-12T05:48:00.739 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.732+0000 7f6595e66700 1 -- 172.21.2.105:0/3336927866 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6574053660 msgr2=0x7f6574055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:00.739 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.732+0000 7f6595e66700 1 --2- 172.21.2.105:0/3336927866 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6574053660 0x7f6574055b20 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f6578005000 tx=0x7f6578009040).stop 2021-11-12T05:48:00.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.732+0000 7f6595e66700 1 -- 172.21.2.105:0/3336927866 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f65700049f0 msgr2=0x7f6590157550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:00.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.732+0000 7f6595e66700 1 --2- 172.21.2.105:0/3336927866 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f65700049f0 0x7f6590157550 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7f65900aa1c0 tx=0x7f6580007a00).stop 2021-11-12T05:48:00.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.736+0000 7f6595e66700 1 -- 172.21.2.105:0/3336927866 shutdown_connections 2021-11-12T05:48:00.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.736+0000 7f6595e66700 1 --2- 172.21.2.105:0/3336927866 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6574053660 0x7f6574055b20 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:00.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.736+0000 7f6595e66700 1 --2- 172.21.2.105:0/3336927866 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6590155dc0 0x7f6590156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:00.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.736+0000 7f6595e66700 1 --2- 172.21.2.105:0/3336927866 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6590063620 0x7f6590063aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:00.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.736+0000 7f6595e66700 1 --2- 172.21.2.105:0/3336927866 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f65700049f0 0x7f6590157550 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:00.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.736+0000 7f6595e66700 1 -- 172.21.2.105:0/3336927866 >> 172.21.2.105:0/3336927866 conn(0x7f65900b5370 msgr2=0x7f659014aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:00.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.736+0000 7f6595e66700 1 -- 172.21.2.105:0/3336927866 shutdown_connections 2021-11-12T05:48:00.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.736+0000 7f6595e66700 1 -- 172.21.2.105:0/3336927866 wait complete. 2021-11-12T05:48:00.742 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_metadata' removed 2021-11-12T05:48:00.751 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-12T05:48:00.803 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0df94700 1 Processor -- start 2021-11-12T05:48:00.804 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0df94700 1 -- start start 2021-11-12T05:48:00.804 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0df94700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fba080b26f0 0x7fba0814b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:00.804 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0df94700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fba08060be0 0x7fba080ac6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:00.804 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0df94700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fba08147b10 0x7fba08144210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:00.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0df94700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba0814b7b0 con 0x7fba08147b10 2021-11-12T05:48:00.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0df94700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba080ac440 con 0x7fba08060be0 2021-11-12T05:48:00.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0df94700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba080b2ad0 con 0x7fba080b26f0 2021-11-12T05:48:00.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0d793700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fba08147b10 0x7fba08144210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:00.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0d793700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fba08147b10 0x7fba08144210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49438/0 (socket says 172.21.2.105:49438) 2021-11-12T05:48:00.806 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0d793700 1 -- 172.21.2.105:0/2839901978 learned_addr learned my addr 172.21.2.105:0/2839901978 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:00.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0d793700 1 -- 172.21.2.105:0/2839901978 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fba080b26f0 msgr2=0x7fba0814b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:00.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0d793700 1 --2- 172.21.2.105:0/2839901978 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fba080b26f0 0x7fba0814b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:00.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0d793700 1 -- 172.21.2.105:0/2839901978 >> v2:172.21.2.115:3300/0 conn(0x7fba08060be0 msgr2=0x7fba080ac6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:00.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0d793700 1 --2- 172.21.2.105:0/2839901978 >> v2:172.21.2.115:3300/0 conn(0x7fba08060be0 0x7fba080ac6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:00.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0d793700 1 -- 172.21.2.105:0/2839901978 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba081473d0 con 0x7fba08147b10 2021-11-12T05:48:00.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0d793700 1 --2- 172.21.2.105:0/2839901978 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fba08147b10 0x7fba08144210 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7fba000032f0 tx=0x7fba00009290).ready entity=mon.0 client_cookie=1d2f16928829dd6f server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:00.811 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba077fe700 1 -- 172.21.2.105:0/2839901978 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba0000b870 con 0x7fba08147b10 2021-11-12T05:48:00.811 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba077fe700 1 -- 172.21.2.105:0/2839901978 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0000b9d0 con 0x7fba08147b10 2021-11-12T05:48:00.811 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba077fe700 1 -- 172.21.2.105:0/2839901978 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba0000bb40 con 0x7fba08147b10 2021-11-12T05:48:00.811 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0df94700 1 -- 172.21.2.105:0/2839901978 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fba08147b10 msgr2=0x7fba08144210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:00.812 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0df94700 1 --2- 172.21.2.105:0/2839901978 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fba08147b10 0x7fba08144210 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7fba000032f0 tx=0x7fba00009290).stop 2021-11-12T05:48:00.812 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0df94700 1 -- 172.21.2.105:0/2839901978 shutdown_connections 2021-11-12T05:48:00.812 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0df94700 1 --2- 172.21.2.105:0/2839901978 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fba08147b10 0x7fba08144210 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:00.812 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0df94700 1 --2- 172.21.2.105:0/2839901978 >> v2:172.21.2.115:3300/0 conn(0x7fba08060be0 0x7fba080ac6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:00.812 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0df94700 1 --2- 172.21.2.105:0/2839901978 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fba080b26f0 0x7fba0814b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:00.813 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0df94700 1 -- 172.21.2.105:0/2839901978 >> 172.21.2.105:0/2839901978 conn(0x7fba080b5c50 msgr2=0x7fba080b1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:00.813 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0df94700 1 -- 172.21.2.105:0/2839901978 shutdown_connections 2021-11-12T05:48:00.813 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0df94700 1 -- 172.21.2.105:0/2839901978 wait complete. 2021-11-12T05:48:00.813 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0df94700 1 Processor -- start 2021-11-12T05:48:00.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0df94700 1 -- start start 2021-11-12T05:48:00.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0df94700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fba08060be0 0x7fba0814a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:00.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0df94700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fba080b26f0 0x7fba080ab740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:00.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0df94700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fba08147b10 0x7fba080abc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:00.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0df94700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba08062600 con 0x7fba08060be0 2021-11-12T05:48:00.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0df94700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba080646c0 con 0x7fba080b26f0 2021-11-12T05:48:00.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0df94700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba08063060 con 0x7fba08147b10 2021-11-12T05:48:00.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0cf92700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fba08060be0 0x7fba0814a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:00.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0cf92700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fba08060be0 0x7fba0814a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49444/0 (socket says 172.21.2.105:49444) 2021-11-12T05:48:00.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0cf92700 1 -- 172.21.2.105:0/1144499147 learned_addr learned my addr 172.21.2.105:0/1144499147 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:00.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0cf92700 1 -- 172.21.2.105:0/1144499147 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fba08147b10 msgr2=0x7fba080abc30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:48:00.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0cf92700 1 --2- 172.21.2.105:0/1144499147 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fba08147b10 0x7fba080abc30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:00.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0cf92700 1 -- 172.21.2.105:0/1144499147 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fba080b26f0 msgr2=0x7fba080ab740 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:48:00.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0cf92700 1 --2- 172.21.2.105:0/1144499147 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fba080b26f0 0x7fba080ab740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:00.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0cf92700 1 -- 172.21.2.105:0/1144499147 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba00009530 con 0x7fba08060be0 2021-11-12T05:48:00.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0cf92700 1 --2- 172.21.2.105:0/1144499147 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fba08060be0 0x7fba0814a230 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7fb9f8002f70 tx=0x7fb9f8006e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:00.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba05ffb700 1 -- 172.21.2.105:0/1144499147 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9f8013460 con 0x7fba08060be0 2021-11-12T05:48:00.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba05ffb700 1 -- 172.21.2.105:0/1144499147 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f80135c0 con 0x7fba08060be0 2021-11-12T05:48:00.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba05ffb700 1 -- 172.21.2.105:0/1144499147 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9f8013920 con 0x7fba08060be0 2021-11-12T05:48:00.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0df94700 1 -- 172.21.2.105:0/1144499147 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba08063300 con 0x7fba08060be0 2021-11-12T05:48:00.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.800+0000 7fba0df94700 1 -- 172.21.2.105:0/1144499147 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba080638d0 con 0x7fba08060be0 2021-11-12T05:48:00.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.804+0000 7fba0df94700 1 -- 172.21.2.105:0/1144499147 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba080634c0 con 0x7fba08060be0 2021-11-12T05:48:00.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.804+0000 7fba05ffb700 1 -- 172.21.2.105:0/1144499147 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb9f800f070 con 0x7fba08060be0 2021-11-12T05:48:00.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.804+0000 7fba05ffb700 1 --2- 172.21.2.105:0/1144499147 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb9ec053640 0x7fb9ec055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:00.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.804+0000 7fba05ffb700 1 -- 172.21.2.105:0/1144499147 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6064+0+0 (secure 0 0 0) 0x7fb9f806b1d0 con 0x7fba08060be0 2021-11-12T05:48:00.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.804+0000 7fba07fff700 1 --2- 172.21.2.105:0/1144499147 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb9ec053640 0x7fb9ec055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:00.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.804+0000 7fba07fff700 1 --2- 172.21.2.105:0/1144499147 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb9ec053640 0x7fb9ec055b00 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7fb9f0002f70 tx=0x7fb9f0006a00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:00.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.804+0000 7fba05ffb700 1 -- 172.21.2.105:0/1144499147 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb9f8042340 con 0x7fba08060be0 2021-11-12T05:48:00.893 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:00.888+0000 7fba0df94700 1 -- 172.21.2.105:0/1144499147 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fba08156620 con 0x7fba08060be0 2021-11-12T05:48:01.738 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.732+0000 7fba05ffb700 1 -- 172.21.2.105:0/1144499147 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v100) v1 ==== 173+0+0 (secure 0 0 0) 0x7fb9f8045960 con 0x7fba08060be0 2021-11-12T05:48:01.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.736+0000 7fba0df94700 1 -- 172.21.2.105:0/1144499147 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb9ec053640 msgr2=0x7fb9ec055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:01.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.736+0000 7fba0df94700 1 --2- 172.21.2.105:0/1144499147 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb9ec053640 0x7fb9ec055b00 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7fb9f0002f70 tx=0x7fb9f0006a00).stop 2021-11-12T05:48:01.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.736+0000 7fba0df94700 1 -- 172.21.2.105:0/1144499147 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fba08060be0 msgr2=0x7fba0814a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:01.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.736+0000 7fba0df94700 1 --2- 172.21.2.105:0/1144499147 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fba08060be0 0x7fba0814a230 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7fb9f8002f70 tx=0x7fb9f8006e40).stop 2021-11-12T05:48:01.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.736+0000 7fba0df94700 1 -- 172.21.2.105:0/1144499147 shutdown_connections 2021-11-12T05:48:01.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.736+0000 7fba0df94700 1 --2- 172.21.2.105:0/1144499147 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb9ec053640 0x7fb9ec055b00 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:01.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.736+0000 7fba0df94700 1 --2- 172.21.2.105:0/1144499147 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fba08147b10 0x7fba080abc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:01.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.736+0000 7fba0df94700 1 --2- 172.21.2.105:0/1144499147 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fba080b26f0 0x7fba080ab740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:01.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.736+0000 7fba0df94700 1 --2- 172.21.2.105:0/1144499147 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fba08060be0 0x7fba0814a230 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:01.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.736+0000 7fba0df94700 1 -- 172.21.2.105:0/1144499147 >> 172.21.2.105:0/1144499147 conn(0x7fba080b5c50 msgr2=0x7fba080b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:01.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.736+0000 7fba0df94700 1 -- 172.21.2.105:0/1144499147 shutdown_connections 2021-11-12T05:48:01.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.736+0000 7fba0df94700 1 -- 172.21.2.105:0/1144499147 wait complete. 2021-11-12T05:48:01.745 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_data' removed 2021-11-12T05:48:01.748 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-11-12T05:48:01.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.816+0000 7efe9aba5700 1 Processor -- start 2021-11-12T05:48:01.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.816+0000 7efe9aba5700 1 -- start start 2021-11-12T05:48:01.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.816+0000 7efe9aba5700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7efe940ace20 0x7efe940b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:01.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.816+0000 7efe9aba5700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efe94144180 0x7efe94144610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:01.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.816+0000 7efe9aba5700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe940b1840 con 0x7efe940aca40 2021-11-12T05:48:01.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.816+0000 7efe9aba5700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe940b0a10 con 0x7efe940ace20 2021-11-12T05:48:01.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.816+0000 7efe9aba5700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe940af2b0 con 0x7efe94144180 2021-11-12T05:48:01.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.816+0000 7efe98941700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7efe940aca40 0x7efe941473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:59852/0 (socket says 172.21.2.105:59852) 2021-11-12T05:48:01.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.816+0000 7efe98941700 1 -- 172.21.2.105:0/3853256398 learned_addr learned my addr 172.21.2.105:0/3853256398 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:01.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.816+0000 7efe937fe700 1 -- 172.21.2.105:0/3853256398 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 719662149 0 0) 0x7efe940b1840 con 0x7efe940aca40 2021-11-12T05:48:01.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.816+0000 7efe937fe700 1 -- 172.21.2.105:0/3853256398 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe74003260 con 0x7efe940aca40 2021-11-12T05:48:01.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.816+0000 7efe937fe700 1 -- 172.21.2.105:0/3853256398 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 140230585 0 0) 0x7efe74003260 con 0x7efe940aca40 2021-11-12T05:48:01.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.816+0000 7efe937fe700 1 -- 172.21.2.105:0/3853256398 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efe94144180 msgr2=0x7efe94144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:01.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.816+0000 7efe937fe700 1 --2- 172.21.2.105:0/3853256398 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efe94144180 0x7efe94144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:01.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.816+0000 7efe937fe700 1 -- 172.21.2.105:0/3853256398 >> v2:172.21.2.115:3300/0 conn(0x7efe940ace20 msgr2=0x7efe940b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:01.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.816+0000 7efe937fe700 1 --2- 172.21.2.105:0/3853256398 >> v2:172.21.2.115:3300/0 conn(0x7efe940ace20 0x7efe940b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:01.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.816+0000 7efe937fe700 1 -- 172.21.2.105:0/3853256398 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe940b1a70 con 0x7efe940aca40 2021-11-12T05:48:01.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.816+0000 7efe937fe700 1 -- 172.21.2.105:0/3853256398 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7efe84001660 con 0x7efe940aca40 2021-11-12T05:48:01.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.816+0000 7efe937fe700 1 -- 172.21.2.105:0/3853256398 >> v1:172.21.2.105:6789/0 conn(0x7efe940aca40 legacy=0x7efe941473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:01.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.816+0000 7efe937fe700 1 --2- 172.21.2.105:0/3853256398 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efe94144180 0x7efe74003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:01.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.816+0000 7efe937fe700 1 --2- 172.21.2.105:0/3853256398 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe74003e10 0x7efe74004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:01.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.816+0000 7efe937fe700 1 --2- 172.21.2.105:0/3853256398 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efe74004b10 0x7efe74004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:01.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.816+0000 7efe937fe700 1 -- 172.21.2.105:0/3853256398 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe940b0a10 con 0x7efe74003e10 2021-11-12T05:48:01.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.816+0000 7efe937fe700 1 -- 172.21.2.105:0/3853256398 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe940af2b0 con 0x7efe74004b10 2021-11-12T05:48:01.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.816+0000 7efe937fe700 1 -- 172.21.2.105:0/3853256398 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe7400b9e0 con 0x7efe94144180 2021-11-12T05:48:01.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe93fff700 1 --2- 172.21.2.105:0/3853256398 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe74003e10 0x7efe74004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:01.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe93fff700 1 -- 172.21.2.105:0/3853256398 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efe94144180 msgr2=0x7efe74003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:01.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe93fff700 1 --2- 172.21.2.105:0/3853256398 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efe94144180 0x7efe74003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:01.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe93fff700 1 -- 172.21.2.105:0/3853256398 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efe74004b10 msgr2=0x7efe74004f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:01.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe93fff700 1 --2- 172.21.2.105:0/3853256398 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efe74004b10 0x7efe74004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:01.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe93fff700 1 -- 172.21.2.105:0/3853256398 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe74003260 con 0x7efe74003e10 2021-11-12T05:48:01.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe93fff700 1 --2- 172.21.2.105:0/3853256398 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe74003e10 0x7efe74004500 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7efe7c002f70 tx=0x7efe7c006ca0).ready entity=mon.0 client_cookie=4deca2859d92a19e server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:01.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe937fe700 1 -- 172.21.2.105:0/3853256398 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe7c012410 con 0x7efe74003e10 2021-11-12T05:48:01.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe937fe700 1 -- 172.21.2.105:0/3853256398 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7c012570 con 0x7efe74003e10 2021-11-12T05:48:01.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe937fe700 1 -- 172.21.2.105:0/3853256398 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe7c0128d0 con 0x7efe74003e10 2021-11-12T05:48:01.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe9aba5700 1 -- 172.21.2.105:0/3853256398 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe74003e10 msgr2=0x7efe74004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:01.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe9aba5700 1 --2- 172.21.2.105:0/3853256398 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe74003e10 0x7efe74004500 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7efe7c002f70 tx=0x7efe7c006ca0).stop 2021-11-12T05:48:01.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe99142700 1 -- 172.21.2.105:0/3853256398 reap_dead start 2021-11-12T05:48:01.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe9aba5700 1 -- 172.21.2.105:0/3853256398 shutdown_connections 2021-11-12T05:48:01.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe9aba5700 1 -- 172.21.2.105:0/3853256398 >> 172.21.2.105:0/3853256398 conn(0x7efe9405c490 msgr2=0x7efe940b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:01.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe9aba5700 1 -- 172.21.2.105:0/3853256398 shutdown_connections 2021-11-12T05:48:01.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe9aba5700 1 -- 172.21.2.105:0/3853256398 wait complete. 2021-11-12T05:48:01.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe9aba5700 1 Processor -- start 2021-11-12T05:48:01.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe9aba5700 1 -- start start 2021-11-12T05:48:01.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe9aba5700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efe74003e10 0x7efe94065aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:01.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe9aba5700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efe940a7830 0x7efe940661d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:01.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe9aba5700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe940abb10 0x7efe940abf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:01.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe9aba5700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe940ac480 con 0x7efe940abb10 2021-11-12T05:48:01.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe9aba5700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe94065080 con 0x7efe74003e10 2021-11-12T05:48:01.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe9aba5700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe940a7d40 con 0x7efe940a7830 2021-11-12T05:48:01.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe99142700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe940abb10 0x7efe940abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:01.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe99142700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe940abb10 0x7efe940abf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49468/0 (socket says 172.21.2.105:49468) 2021-11-12T05:48:01.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe99142700 1 -- 172.21.2.105:0/14221908 learned_addr learned my addr 172.21.2.105:0/14221908 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:01.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe98941700 1 --2- 172.21.2.105:0/14221908 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efe74003e10 0x7efe94065aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:01.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe93fff700 1 --2- 172.21.2.105:0/14221908 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efe940a7830 0x7efe940661d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:01.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe99142700 1 -- 172.21.2.105:0/14221908 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efe940a7830 msgr2=0x7efe940661d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:01.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe99142700 1 --2- 172.21.2.105:0/14221908 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efe940a7830 0x7efe940661d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:01.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe99142700 1 -- 172.21.2.105:0/14221908 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efe74003e10 msgr2=0x7efe94065aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:01.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe99142700 1 --2- 172.21.2.105:0/14221908 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efe74003e10 0x7efe94065aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:01.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe99142700 1 -- 172.21.2.105:0/14221908 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe940a7fe0 con 0x7efe940abb10 2021-11-12T05:48:01.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe99142700 1 --2- 172.21.2.105:0/14221908 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe940abb10 0x7efe940abf90 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 rx=0x7efe84001110 tx=0x7efe8c00a060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:01.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe91ffb700 1 -- 172.21.2.105:0/14221908 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe8c005a20 con 0x7efe940abb10 2021-11-12T05:48:01.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe91ffb700 1 -- 172.21.2.105:0/14221908 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8c005b80 con 0x7efe940abb10 2021-11-12T05:48:01.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe9aba5700 1 -- 172.21.2.105:0/14221908 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe940a8280 con 0x7efe940abb10 2021-11-12T05:48:01.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe9aba5700 1 -- 172.21.2.105:0/14221908 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe94159cc0 con 0x7efe940abb10 2021-11-12T05:48:01.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe91ffb700 1 -- 172.21.2.105:0/14221908 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe8c007070 con 0x7efe940abb10 2021-11-12T05:48:01.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.820+0000 7efe9aba5700 1 -- 172.21.2.105:0/14221908 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe940a8410 con 0x7efe940abb10 2021-11-12T05:48:01.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.824+0000 7efe91ffb700 1 -- 172.21.2.105:0/14221908 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efe8c01b060 con 0x7efe940abb10 2021-11-12T05:48:01.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.824+0000 7efe91ffb700 1 --2- 172.21.2.105:0/14221908 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efe78053690 0x7efe78055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:01.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.824+0000 7efe91ffb700 1 -- 172.21.2.105:0/14221908 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5682+0+0 (secure 0 0 0) 0x7efe8c06af80 con 0x7efe940abb10 2021-11-12T05:48:01.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.824+0000 7efe98941700 1 --2- 172.21.2.105:0/14221908 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efe78053690 0x7efe78055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:01.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.824+0000 7efe98941700 1 --2- 172.21.2.105:0/14221908 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efe78053690 0x7efe78055b50 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7efe8400b000 tx=0x7efe940b62d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:01.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.824+0000 7efe91ffb700 1 -- 172.21.2.105:0/14221908 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efe8c042150 con 0x7efe940abb10 2021-11-12T05:48:01.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.908+0000 7efe9aba5700 1 -- 172.21.2.105:0/14221908 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7efe9405f280 con 0x7efe940abb10 2021-11-12T05:48:01.919 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.916+0000 7efe91ffb700 1 -- 172.21.2.105:0/14221908 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7efe8c019070 con 0x7efe940abb10 2021-11-12T05:48:01.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.916+0000 7efe9aba5700 1 -- 172.21.2.105:0/14221908 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efe78053690 msgr2=0x7efe78055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:01.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.916+0000 7efe9aba5700 1 --2- 172.21.2.105:0/14221908 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efe78053690 0x7efe78055b50 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7efe8400b000 tx=0x7efe940b62d0).stop 2021-11-12T05:48:01.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.916+0000 7efe9aba5700 1 -- 172.21.2.105:0/14221908 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe940abb10 msgr2=0x7efe940abf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:01.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.916+0000 7efe9aba5700 1 --2- 172.21.2.105:0/14221908 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe940abb10 0x7efe940abf90 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 rx=0x7efe84001110 tx=0x7efe8c00a060).stop 2021-11-12T05:48:01.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.916+0000 7efe9aba5700 1 -- 172.21.2.105:0/14221908 shutdown_connections 2021-11-12T05:48:01.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.916+0000 7efe9aba5700 1 --2- 172.21.2.105:0/14221908 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efe78053690 0x7efe78055b50 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:01.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.916+0000 7efe9aba5700 1 --2- 172.21.2.105:0/14221908 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe940abb10 0x7efe940abf90 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:01.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.916+0000 7efe9aba5700 1 --2- 172.21.2.105:0/14221908 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efe940a7830 0x7efe940661d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:01.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.916+0000 7efe9aba5700 1 --2- 172.21.2.105:0/14221908 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efe74003e10 0x7efe94065aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:01.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.916+0000 7efe9aba5700 1 -- 172.21.2.105:0/14221908 >> 172.21.2.105:0/14221908 conn(0x7efe9405c490 msgr2=0x7efe940b4130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:01.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.916+0000 7efe9aba5700 1 -- 172.21.2.105:0/14221908 shutdown_connections 2021-11-12T05:48:01.924 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.916+0000 7efe9aba5700 1 -- 172.21.2.105:0/14221908 wait complete. 2021-11-12T05:48:01.928 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical' 2021-11-12T05:48:01.979 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66f0bb5700 1 Processor -- start 2021-11-12T05:48:01.979 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66f0bb5700 1 -- start start 2021-11-12T05:48:01.980 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66f0bb5700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66ec05fdc0 0x7f66ec0601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:01.980 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66f0bb5700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f66ec0ade80 0x7f66ec066730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:01.980 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66f0bb5700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66ec066150 con 0x7f66ec13a9c0 2021-11-12T05:48:01.980 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66f0bb5700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66ec141fb0 con 0x7f66ec0ade80 2021-11-12T05:48:01.981 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66f0bb5700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec0663f0 con 0x7f66ec05fdc0 2021-11-12T05:48:01.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66e9d9b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f66ec0ade80 0x7f66ec066730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:01.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66e9d9b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f66ec0ade80 0x7f66ec066730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49476/0 (socket says 172.21.2.105:49476) 2021-11-12T05:48:01.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66e9d9b700 1 -- 172.21.2.105:0/3250446434 learned_addr learned my addr 172.21.2.105:0/3250446434 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:01.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66e9d9b700 1 -- 172.21.2.105:0/3250446434 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66ec05fdc0 msgr2=0x7f66ec0601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:01.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66e9d9b700 1 --2- 172.21.2.105:0/3250446434 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66ec05fdc0 0x7f66ec0601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:01.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66e9d9b700 1 -- 172.21.2.105:0/3250446434 >> v1:172.21.2.105:6789/0 conn(0x7f66ec13a9c0 legacy=0x7f66ec141470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:01.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66e9d9b700 1 -- 172.21.2.105:0/3250446434 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ec140fd0 con 0x7f66ec0ade80 2021-11-12T05:48:01.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66e9d9b700 1 --2- 172.21.2.105:0/3250446434 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66ec0ade80 0x7f66ec066730 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7f66e0002f70 tx=0x7f66e0006eb0).ready entity=mon.0 client_cookie=12853ed689ac4227 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:01.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66e959a700 1 -- 172.21.2.105:0/3250446434 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66e000d5c0 con 0x7f66ec0ade80 2021-11-12T05:48:01.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66e959a700 1 -- 172.21.2.105:0/3250446434 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e0000e90 con 0x7f66ec0ade80 2021-11-12T05:48:01.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66e959a700 1 -- 172.21.2.105:0/3250446434 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66e000d950 con 0x7f66ec0ade80 2021-11-12T05:48:01.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66f0bb5700 1 -- 172.21.2.105:0/3250446434 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66ec0ade80 msgr2=0x7f66ec066730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:01.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66f0bb5700 1 --2- 172.21.2.105:0/3250446434 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66ec0ade80 0x7f66ec066730 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7f66e0002f70 tx=0x7f66e0006eb0).stop 2021-11-12T05:48:01.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66f0bb5700 1 -- 172.21.2.105:0/3250446434 shutdown_connections 2021-11-12T05:48:01.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66f0bb5700 1 --2- 172.21.2.105:0/3250446434 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66ec0ade80 0x7f66ec066730 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:01.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66f0bb5700 1 --2- 172.21.2.105:0/3250446434 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66ec05fdc0 0x7f66ec0601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:01.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66f0bb5700 1 -- 172.21.2.105:0/3250446434 >> 172.21.2.105:0/3250446434 conn(0x7f66ec0608d0 msgr2=0x7f66ec05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:01.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66f0bb5700 1 -- 172.21.2.105:0/3250446434 shutdown_connections 2021-11-12T05:48:01.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66f0bb5700 1 -- 172.21.2.105:0/3250446434 wait complete. 2021-11-12T05:48:01.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66f0bb5700 1 Processor -- start 2021-11-12T05:48:01.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66f0bb5700 1 -- start start 2021-11-12T05:48:01.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66f0bb5700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66ec05fdc0 0x7f66ec0b5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:01.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66f0bb5700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f66ec0ade80 0x7f66ec13ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:01.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66f0bb5700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66ec13a9c0 0x7f66ec13bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:01.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66f0bb5700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec0b53d0 con 0x7f66ec13a9c0 2021-11-12T05:48:01.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66f0bb5700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec13da70 con 0x7f66ec0ade80 2021-11-12T05:48:01.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66f0bb5700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec13dd10 con 0x7f66ec05fdc0 2021-11-12T05:48:01.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66ead9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66ec13a9c0 0x7f66ec13bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:01.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66ead9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66ec13a9c0 0x7f66ec13bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49482/0 (socket says 172.21.2.105:49482) 2021-11-12T05:48:01.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66ead9d700 1 -- 172.21.2.105:0/3712157989 learned_addr learned my addr 172.21.2.105:0/3712157989 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:01.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66ead9d700 1 -- 172.21.2.105:0/3712157989 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66ec05fdc0 msgr2=0x7f66ec0b5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:01.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66ead9d700 1 --2- 172.21.2.105:0/3712157989 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66ec05fdc0 0x7f66ec0b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:01.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66ead9d700 1 -- 172.21.2.105:0/3712157989 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f66ec0ade80 msgr2=0x7f66ec13ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:01.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66ead9d700 1 --2- 172.21.2.105:0/3712157989 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f66ec0ade80 0x7f66ec13ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:01.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66ead9d700 1 -- 172.21.2.105:0/3712157989 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e000b1e0 con 0x7f66ec13a9c0 2021-11-12T05:48:01.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66ead9d700 1 --2- 172.21.2.105:0/3712157989 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66ec13a9c0 0x7f66ec13bf50 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7f66ec0adc40 tx=0x7f66e4007f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:01.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66db7fe700 1 -- 172.21.2.105:0/3712157989 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66e400f470 con 0x7f66ec13a9c0 2021-11-12T05:48:01.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66db7fe700 1 -- 172.21.2.105:0/3712157989 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e400f5d0 con 0x7f66ec13a9c0 2021-11-12T05:48:01.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66f0bb5700 1 -- 172.21.2.105:0/3712157989 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66ec143190 con 0x7f66ec13a9c0 2021-11-12T05:48:01.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66db7fe700 1 -- 172.21.2.105:0/3712157989 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66e400f930 con 0x7f66ec13a9c0 2021-11-12T05:48:01.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.976+0000 7f66f0bb5700 1 -- 172.21.2.105:0/3712157989 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66ec0b5df0 con 0x7f66ec13a9c0 2021-11-12T05:48:01.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.980+0000 7f66f0bb5700 1 -- 172.21.2.105:0/3712157989 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66ec057350 con 0x7f66ec13a9c0 2021-11-12T05:48:01.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.980+0000 7f66db7fe700 1 -- 172.21.2.105:0/3712157989 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f66e4019030 con 0x7f66ec13a9c0 2021-11-12T05:48:01.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.980+0000 7f66db7fe700 1 --2- 172.21.2.105:0/3712157989 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f66c80534f0 0x7f66c80559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:01.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.980+0000 7f66db7fe700 1 -- 172.21.2.105:0/3712157989 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f66e406b000 con 0x7f66ec13a9c0 2021-11-12T05:48:01.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.980+0000 7f66ea59c700 1 --2- 172.21.2.105:0/3712157989 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f66c80534f0 0x7f66c80559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:01.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.980+0000 7f66ea59c700 1 --2- 172.21.2.105:0/3712157989 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f66c80534f0 0x7f66c80559b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f66dc002f70 tx=0x7f66dc006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:01.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:01.980+0000 7f66db7fe700 1 -- 172.21.2.105:0/3712157989 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f66e40422e0 con 0x7f66ec13a9c0 2021-11-12T05:48:02.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.092+0000 7f66f0bb5700 1 -- 172.21.2.105:0/3712157989 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]} v 0) v1 -- 0x7f66ec05d9a0 con 0x7f66ec13a9c0 2021-11-12T05:48:02.752 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.748+0000 7f66db7fe700 1 -- 172.21.2.105:0/3712157989 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]}]=0 v312) v1 ==== 138+0+0 (secure 0 0 0) 0x7f66e4045900 con 0x7f66ec13a9c0 2021-11-12T05:48:02.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.748+0000 7f66f0bb5700 1 -- 172.21.2.105:0/3712157989 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f66c80534f0 msgr2=0x7f66c80559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:02.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.748+0000 7f66f0bb5700 1 --2- 172.21.2.105:0/3712157989 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f66c80534f0 0x7f66c80559b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f66dc002f70 tx=0x7f66dc006a80).stop 2021-11-12T05:48:02.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.748+0000 7f66f0bb5700 1 -- 172.21.2.105:0/3712157989 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66ec13a9c0 msgr2=0x7f66ec13bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:02.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.748+0000 7f66f0bb5700 1 --2- 172.21.2.105:0/3712157989 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66ec13a9c0 0x7f66ec13bf50 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7f66ec0adc40 tx=0x7f66e4007f50).stop 2021-11-12T05:48:02.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.748+0000 7f66f0bb5700 1 -- 172.21.2.105:0/3712157989 shutdown_connections 2021-11-12T05:48:02.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.748+0000 7f66f0bb5700 1 --2- 172.21.2.105:0/3712157989 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f66c80534f0 0x7f66c80559b0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:02.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.748+0000 7f66f0bb5700 1 --2- 172.21.2.105:0/3712157989 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66ec13a9c0 0x7f66ec13bf50 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:02.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.748+0000 7f66f0bb5700 1 --2- 172.21.2.105:0/3712157989 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f66ec0ade80 0x7f66ec13ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:02.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.748+0000 7f66f0bb5700 1 --2- 172.21.2.105:0/3712157989 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66ec05fdc0 0x7f66ec0b5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:02.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.748+0000 7f66f0bb5700 1 -- 172.21.2.105:0/3712157989 >> 172.21.2.105:0/3712157989 conn(0x7f66ec0608d0 msgr2=0x7f66ec0b3910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:02.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.748+0000 7f66f0bb5700 1 -- 172.21.2.105:0/3712157989 shutdown_connections 2021-11-12T05:48:02.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.748+0000 7f66f0bb5700 1 -- 172.21.2.105:0/3712157989 wait complete. 2021-11-12T05:48:02.761 INFO:tasks.cephfs_test_runner:test_dump_inode_hexademical (tasks.cephfs.test_misc.TestMisc) ... ok 2021-11-12T05:48:02.762 INFO:tasks.cephfs_test_runner:Starting test: test_filtered_df (tasks.cephfs.test_misc.TestMisc) 2021-11-12T05:48:02.762 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_filtered_df' 2021-11-12T05:48:02.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.812+0000 7fe9e4399700 1 Processor -- start 2021-11-12T05:48:02.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.812+0000 7fe9e4399700 1 -- start start 2021-11-12T05:48:02.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.812+0000 7fe9e4399700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe9dc0b01b0 0x7fe9dc0b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:02.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.812+0000 7fe9e4399700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fe9dc0aeb80 0x7fe9dc13e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:02.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.812+0000 7fe9e4399700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9dc0b5ea0 con 0x7fe9dc0b5ac0 2021-11-12T05:48:02.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.812+0000 7fe9e4399700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9dc0b1a60 con 0x7fe9dc0b01b0 2021-11-12T05:48:02.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.812+0000 7fe9e4399700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9dc0accd0 con 0x7fe9dc0aeb80 2021-11-12T05:48:02.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.812+0000 7fe9e1934700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe9dc0b01b0 0x7fe9dc0b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:02.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.812+0000 7fe9e1934700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe9dc0b01b0 0x7fe9dc0b13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49490/0 (socket says 172.21.2.105:49490) 2021-11-12T05:48:02.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.812+0000 7fe9e1934700 1 -- 172.21.2.105:0/4009597485 learned_addr learned my addr 172.21.2.105:0/4009597485 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:02.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.812+0000 7fe9e1934700 1 -- 172.21.2.105:0/4009597485 >> v2:172.21.2.115:3300/0 conn(0x7fe9dc0aeb80 msgr2=0x7fe9dc13e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:02.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.812+0000 7fe9e1934700 1 --2- 172.21.2.105:0/4009597485 >> v2:172.21.2.115:3300/0 conn(0x7fe9dc0aeb80 0x7fe9dc13e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:02.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.812+0000 7fe9e1934700 1 -- 172.21.2.105:0/4009597485 >> v1:172.21.2.115:6789/0 conn(0x7fe9dc0b5ac0 legacy=0x7fe9dc0ae470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:02.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.812+0000 7fe9e1934700 1 -- 172.21.2.105:0/4009597485 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9dc0acf70 con 0x7fe9dc0b01b0 2021-11-12T05:48:02.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.812+0000 7fe9e1934700 1 --2- 172.21.2.105:0/4009597485 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9dc0b01b0 0x7fe9dc0b13c0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7fe9dc0b6470 tx=0x7fe9d8006f40).ready entity=mon.0 client_cookie=4b85250f7674f90b server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:02.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.812+0000 7fe9e1133700 1 -- 172.21.2.105:0/4009597485 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9d8010070 con 0x7fe9dc0b01b0 2021-11-12T05:48:02.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.812+0000 7fe9e1133700 1 -- 172.21.2.105:0/4009597485 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d8000e90 con 0x7fe9dc0b01b0 2021-11-12T05:48:02.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.812+0000 7fe9e1133700 1 -- 172.21.2.105:0/4009597485 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9d8008860 con 0x7fe9dc0b01b0 2021-11-12T05:48:02.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.812+0000 7fe9e4399700 1 -- 172.21.2.105:0/4009597485 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9dc0b01b0 msgr2=0x7fe9dc0b13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:02.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.812+0000 7fe9e4399700 1 --2- 172.21.2.105:0/4009597485 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9dc0b01b0 0x7fe9dc0b13c0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7fe9dc0b6470 tx=0x7fe9d8006f40).stop 2021-11-12T05:48:02.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.812+0000 7fe9e4399700 1 -- 172.21.2.105:0/4009597485 shutdown_connections 2021-11-12T05:48:02.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.812+0000 7fe9e4399700 1 --2- 172.21.2.105:0/4009597485 >> v2:172.21.2.115:3300/0 conn(0x7fe9dc0aeb80 0x7fe9dc13e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:02.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.812+0000 7fe9e4399700 1 --2- 172.21.2.105:0/4009597485 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9dc0b01b0 0x7fe9dc0b13c0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:02.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.812+0000 7fe9e4399700 1 -- 172.21.2.105:0/4009597485 >> 172.21.2.105:0/4009597485 conn(0x7fe9dc0628b0 msgr2=0x7fe9dc062c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:02.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.812+0000 7fe9e4399700 1 -- 172.21.2.105:0/4009597485 shutdown_connections 2021-11-12T05:48:02.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.812+0000 7fe9e4399700 1 -- 172.21.2.105:0/4009597485 wait complete. 2021-11-12T05:48:02.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.816+0000 7fe9e4399700 1 Processor -- start 2021-11-12T05:48:02.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.816+0000 7fe9e4399700 1 -- start start 2021-11-12T05:48:02.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.816+0000 7fe9e4399700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9dc0aeb80 0x7fe9dc139670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:02.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.816+0000 7fe9e4399700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe9dc0b01b0 0x7fe9dc135d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:02.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.816+0000 7fe9e4399700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe9dc0b5ac0 0x7fe9dc136270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:02.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.816+0000 7fe9e4399700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc140ea0 con 0x7fe9dc0aeb80 2021-11-12T05:48:02.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.816+0000 7fe9e4399700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc142550 con 0x7fe9dc0b01b0 2021-11-12T05:48:02.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.816+0000 7fe9e4399700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc136760 con 0x7fe9dc0b5ac0 2021-11-12T05:48:02.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.816+0000 7fe9e2135700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9dc0aeb80 0x7fe9dc139670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:02.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.816+0000 7fe9e2135700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9dc0aeb80 0x7fe9dc139670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49492/0 (socket says 172.21.2.105:49492) 2021-11-12T05:48:02.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.816+0000 7fe9e2135700 1 -- 172.21.2.105:0/3478772991 learned_addr learned my addr 172.21.2.105:0/3478772991 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:02.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.816+0000 7fe9e2135700 1 -- 172.21.2.105:0/3478772991 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe9dc0b5ac0 msgr2=0x7fe9dc136270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:02.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.816+0000 7fe9e2135700 1 --2- 172.21.2.105:0/3478772991 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe9dc0b5ac0 0x7fe9dc136270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:02.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.816+0000 7fe9e2135700 1 -- 172.21.2.105:0/3478772991 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe9dc0b01b0 msgr2=0x7fe9dc135d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:02.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.816+0000 7fe9e2135700 1 --2- 172.21.2.105:0/3478772991 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe9dc0b01b0 0x7fe9dc135d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:02.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.816+0000 7fe9e2135700 1 -- 172.21.2.105:0/3478772991 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d8008240 con 0x7fe9dc0aeb80 2021-11-12T05:48:02.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.816+0000 7fe9e2135700 1 --2- 172.21.2.105:0/3478772991 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9dc0aeb80 0x7fe9dc139670 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 rx=0x7fe9dc142690 tx=0x7fe9d0006d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:02.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.816+0000 7fe9cf7fe700 1 -- 172.21.2.105:0/3478772991 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9d000f510 con 0x7fe9dc0aeb80 2021-11-12T05:48:02.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.816+0000 7fe9cf7fe700 1 -- 172.21.2.105:0/3478772991 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d000f670 con 0x7fe9dc0aeb80 2021-11-12T05:48:02.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.816+0000 7fe9e4399700 1 -- 172.21.2.105:0/3478772991 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9dc13a3b0 con 0x7fe9dc0aeb80 2021-11-12T05:48:02.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.816+0000 7fe9cf7fe700 1 -- 172.21.2.105:0/3478772991 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9d000f7e0 con 0x7fe9dc0aeb80 2021-11-12T05:48:02.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.816+0000 7fe9e4399700 1 -- 172.21.2.105:0/3478772991 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9dc138a70 con 0x7fe9dc0aeb80 2021-11-12T05:48:02.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.816+0000 7fe9e4399700 1 -- 172.21.2.105:0/3478772991 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9dc141ef0 con 0x7fe9dc0aeb80 2021-11-12T05:48:02.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.816+0000 7fe9cf7fe700 1 -- 172.21.2.105:0/3478772991 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe9d0017020 con 0x7fe9dc0aeb80 2021-11-12T05:48:02.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.816+0000 7fe9cf7fe700 1 --2- 172.21.2.105:0/3478772991 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe9bc0534f0 0x7fe9bc0559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:02.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.816+0000 7fe9cf7fe700 1 -- 172.21.2.105:0/3478772991 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fe9d006ab00 con 0x7fe9dc0aeb80 2021-11-12T05:48:02.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.816+0000 7fe9e1934700 1 --2- 172.21.2.105:0/3478772991 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe9bc0534f0 0x7fe9bc0559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:02.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.816+0000 7fe9e1934700 1 --2- 172.21.2.105:0/3478772991 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe9bc0534f0 0x7fe9bc0559b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7fe9dc0b6470 tx=0x7fe9dc0b0050).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:02.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.820+0000 7fe9cf7fe700 1 -- 172.21.2.105:0/3478772991 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe9d0041cd0 con 0x7fe9dc0aeb80 2021-11-12T05:48:02.938 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:02.932+0000 7fe9e4399700 1 -- 172.21.2.105:0/3478772991 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]} v 0) v1 -- 0x7fe9dc0ad410 con 0x7fe9dc0aeb80 2021-11-12T05:48:03.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.752+0000 7fe9cf7fe700 1 -- 172.21.2.105:0/3478772991 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]}]=0 v313) v1 ==== 130+0+0 (secure 0 0 0) 0x7fe9d0015030 con 0x7fe9dc0aeb80 2021-11-12T05:48:03.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.756+0000 7fe9e4399700 1 -- 172.21.2.105:0/3478772991 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe9bc0534f0 msgr2=0x7fe9bc0559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:03.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.756+0000 7fe9e4399700 1 --2- 172.21.2.105:0/3478772991 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe9bc0534f0 0x7fe9bc0559b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7fe9dc0b6470 tx=0x7fe9dc0b0050).stop 2021-11-12T05:48:03.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.756+0000 7fe9e4399700 1 -- 172.21.2.105:0/3478772991 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9dc0aeb80 msgr2=0x7fe9dc139670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:03.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.756+0000 7fe9e4399700 1 --2- 172.21.2.105:0/3478772991 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9dc0aeb80 0x7fe9dc139670 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 rx=0x7fe9dc142690 tx=0x7fe9d0006d70).stop 2021-11-12T05:48:03.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.756+0000 7fe9e4399700 1 -- 172.21.2.105:0/3478772991 shutdown_connections 2021-11-12T05:48:03.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.756+0000 7fe9e4399700 1 --2- 172.21.2.105:0/3478772991 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe9bc0534f0 0x7fe9bc0559b0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:03.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.756+0000 7fe9e4399700 1 --2- 172.21.2.105:0/3478772991 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe9dc0b5ac0 0x7fe9dc136270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:03.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.756+0000 7fe9e4399700 1 --2- 172.21.2.105:0/3478772991 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe9dc0b01b0 0x7fe9dc135d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:03.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.756+0000 7fe9e4399700 1 --2- 172.21.2.105:0/3478772991 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe9dc0aeb80 0x7fe9dc139670 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:03.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.756+0000 7fe9e4399700 1 -- 172.21.2.105:0/3478772991 >> 172.21.2.105:0/3478772991 conn(0x7fe9dc0628b0 msgr2=0x7fe9dc0af580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:03.763 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.756+0000 7fe9e4399700 1 -- 172.21.2.105:0/3478772991 shutdown_connections 2021-11-12T05:48:03.763 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.756+0000 7fe9e4399700 1 -- 172.21.2.105:0/3478772991 wait complete. 2021-11-12T05:48:03.767 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-11-12T05:48:03.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.816+0000 7fe085f15700 1 Processor -- start 2021-11-12T05:48:03.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.816+0000 7fe085f15700 1 -- start start 2021-11-12T05:48:03.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.816+0000 7fe085f15700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fe0800aca40 0x7fe0800ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:03.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.816+0000 7fe085f15700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe0800b0520 0x7fe0801473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:03.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.816+0000 7fe085f15700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0800b1840 con 0x7fe0801478b0 2021-11-12T05:48:03.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.816+0000 7fe085f15700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe080147d40 con 0x7fe0800aca40 2021-11-12T05:48:03.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.816+0000 7fe085f15700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0800af2b0 con 0x7fe0800b0520 2021-11-12T05:48:03.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.820+0000 7fe07f7fe700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fe0800aca40 0x7fe0800ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:03.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.820+0000 7fe07ffff700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7fe0801478b0 0x7fe080144180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:58366/0 (socket says 172.21.2.105:58366) 2021-11-12T05:48:03.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.820+0000 7fe07ffff700 1 -- 172.21.2.105:0/793990539 learned_addr learned my addr 172.21.2.105:0/793990539 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:03.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.820+0000 7fe07effd700 1 --2- 172.21.2.105:0/793990539 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe0800b0520 0x7fe0801473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:03.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.820+0000 7fe07f7fe700 1 -- 172.21.2.105:0/793990539 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe0800b0520 msgr2=0x7fe0801473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:03.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.820+0000 7fe07f7fe700 1 --2- 172.21.2.105:0/793990539 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe0800b0520 0x7fe0801473c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:03.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.820+0000 7fe07f7fe700 1 -- 172.21.2.105:0/793990539 >> v1:172.21.2.115:6789/0 conn(0x7fe0801478b0 legacy=0x7fe080144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:03.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.820+0000 7fe07f7fe700 1 -- 172.21.2.105:0/793990539 --> v2:172.21.2.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0800b09a0 con 0x7fe0800aca40 2021-11-12T05:48:03.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.820+0000 7fe07f7fe700 1 --2- 172.21.2.105:0/793990539 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe0800aca40 0x7fe0800ace20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fe068002f70 tx=0x7fe068006df0).ready entity=mon.1 client_cookie=9d59445e29cc8bc3 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:03.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.820+0000 7fe07e7fc700 1 -- 172.21.2.105:0/793990539 <== mon.1 v2:172.21.2.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe06800d570 con 0x7fe0800aca40 2021-11-12T05:48:03.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.820+0000 7fe07e7fc700 1 -- 172.21.2.105:0/793990539 <== mon.1 v2:172.21.2.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe068000e90 con 0x7fe0800aca40 2021-11-12T05:48:03.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.820+0000 7fe07e7fc700 1 -- 172.21.2.105:0/793990539 <== mon.1 v2:172.21.2.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe06800d8c0 con 0x7fe0800aca40 2021-11-12T05:48:03.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.820+0000 7fe085f15700 1 -- 172.21.2.105:0/793990539 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe0800aca40 msgr2=0x7fe0800ace20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:03.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.820+0000 7fe085f15700 1 --2- 172.21.2.105:0/793990539 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe0800aca40 0x7fe0800ace20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fe068002f70 tx=0x7fe068006df0).stop 2021-11-12T05:48:03.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.820+0000 7fe085f15700 1 -- 172.21.2.105:0/793990539 shutdown_connections 2021-11-12T05:48:03.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.820+0000 7fe085f15700 1 --2- 172.21.2.105:0/793990539 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe0800b0520 0x7fe0801473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:03.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.820+0000 7fe085f15700 1 --2- 172.21.2.105:0/793990539 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe0800aca40 0x7fe0800ace20 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:03.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.820+0000 7fe085f15700 1 -- 172.21.2.105:0/793990539 >> 172.21.2.105:0/793990539 conn(0x7fe08005c490 msgr2=0x7fe0800b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:03.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.820+0000 7fe085f15700 1 -- 172.21.2.105:0/793990539 shutdown_connections 2021-11-12T05:48:03.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.820+0000 7fe085f15700 1 -- 172.21.2.105:0/793990539 wait complete. 2021-11-12T05:48:03.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.820+0000 7fe085f15700 1 Processor -- start 2021-11-12T05:48:03.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.820+0000 7fe085f15700 1 -- start start 2021-11-12T05:48:03.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.820+0000 7fe085f15700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe0800aca40 0x7fe08014a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:03.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.820+0000 7fe085f15700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe0800b0520 0x7fe080062dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:03.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.820+0000 7fe085f15700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe0801478b0 0x7fe0800645f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:03.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.820+0000 7fe085f15700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe080062460 con 0x7fe0801478b0 2021-11-12T05:48:03.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.820+0000 7fe085f15700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe080062690 con 0x7fe0800b0520 2021-11-12T05:48:03.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.820+0000 7fe085f15700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe080062930 con 0x7fe0800aca40 2021-11-12T05:48:03.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.820+0000 7fe07ffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe0801478b0 0x7fe0800645f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:03.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.820+0000 7fe07ffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe0801478b0 0x7fe0800645f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49510/0 (socket says 172.21.2.105:49510) 2021-11-12T05:48:03.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.820+0000 7fe07ffff700 1 -- 172.21.2.105:0/1089356535 learned_addr learned my addr 172.21.2.105:0/1089356535 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:03.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.824+0000 7fe07effd700 1 --2- 172.21.2.105:0/1089356535 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe0800b0520 0x7fe080062dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:03.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.824+0000 7fe07f7fe700 1 --2- 172.21.2.105:0/1089356535 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe0800aca40 0x7fe08014a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:03.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.824+0000 7fe07ffff700 1 -- 172.21.2.105:0/1089356535 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe0800aca40 msgr2=0x7fe08014a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:03.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.824+0000 7fe07ffff700 1 --2- 172.21.2.105:0/1089356535 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe0800aca40 0x7fe08014a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:03.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.824+0000 7fe07ffff700 1 -- 172.21.2.105:0/1089356535 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe0800b0520 msgr2=0x7fe080062dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:03.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.824+0000 7fe07ffff700 1 --2- 172.21.2.105:0/1089356535 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe0800b0520 0x7fe080062dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:03.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.824+0000 7fe07ffff700 1 -- 172.21.2.105:0/1089356535 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe06800b180 con 0x7fe0801478b0 2021-11-12T05:48:03.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.824+0000 7fe07effd700 1 --2- 172.21.2.105:0/1089356535 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe0800b0520 0x7fe080062dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:48:03.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.824+0000 7fe07f7fe700 1 --2- 172.21.2.105:0/1089356535 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe0800aca40 0x7fe08014a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:48:03.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.824+0000 7fe07ffff700 1 --2- 172.21.2.105:0/1089356535 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe0801478b0 0x7fe0800645f0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7fe0800b00d0 tx=0x7fe078007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:03.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.824+0000 7fe07cff9700 1 -- 172.21.2.105:0/1089356535 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe078005ba0 con 0x7fe0801478b0 2021-11-12T05:48:03.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.824+0000 7fe07cff9700 1 -- 172.21.2.105:0/1089356535 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe078005d00 con 0x7fe0801478b0 2021-11-12T05:48:03.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.824+0000 7fe085f15700 1 -- 172.21.2.105:0/1089356535 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe08014afe0 con 0x7fe0801478b0 2021-11-12T05:48:03.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.824+0000 7fe085f15700 1 -- 172.21.2.105:0/1089356535 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe080064ae0 con 0x7fe0801478b0 2021-11-12T05:48:03.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.824+0000 7fe07cff9700 1 -- 172.21.2.105:0/1089356535 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0780072c0 con 0x7fe0801478b0 2021-11-12T05:48:03.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.824+0000 7fe085f15700 1 -- 172.21.2.105:0/1089356535 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe080156990 con 0x7fe0801478b0 2021-11-12T05:48:03.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.824+0000 7fe07cff9700 1 -- 172.21.2.105:0/1089356535 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe078010070 con 0x7fe0801478b0 2021-11-12T05:48:03.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.824+0000 7fe07cff9700 1 --2- 172.21.2.105:0/1089356535 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe0640535d0 0x7fe064055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:03.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.824+0000 7fe07cff9700 1 -- 172.21.2.105:0/1089356535 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fe07806b0d0 con 0x7fe0801478b0 2021-11-12T05:48:03.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.824+0000 7fe07f7fe700 1 --2- 172.21.2.105:0/1089356535 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe0640535d0 0x7fe064055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:03.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.824+0000 7fe07f7fe700 1 --2- 172.21.2.105:0/1089356535 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe0640535d0 0x7fe064055a90 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7fe068015000 tx=0x7fe068014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:03.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.828+0000 7fe07cff9700 1 -- 172.21.2.105:0/1089356535 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe0780423b0 con 0x7fe0801478b0 2021-11-12T05:48:03.913 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.908+0000 7fe085f15700 1 -- 172.21.2.105:0/1089356535 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe080057350 con 0x7fe0801478b0 2021-11-12T05:48:03.918 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.912+0000 7fe07cff9700 1 -- 172.21.2.105:0/1089356535 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe0780459d0 con 0x7fe0801478b0 2021-11-12T05:48:03.919 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.916+0000 7fe085f15700 1 -- 172.21.2.105:0/1089356535 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe0640535d0 msgr2=0x7fe064055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:03.920 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.916+0000 7fe085f15700 1 --2- 172.21.2.105:0/1089356535 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe0640535d0 0x7fe064055a90 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7fe068015000 tx=0x7fe068014000).stop 2021-11-12T05:48:03.920 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.916+0000 7fe085f15700 1 -- 172.21.2.105:0/1089356535 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe0801478b0 msgr2=0x7fe0800645f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:03.920 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.916+0000 7fe085f15700 1 --2- 172.21.2.105:0/1089356535 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe0801478b0 0x7fe0800645f0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7fe0800b00d0 tx=0x7fe078007f60).stop 2021-11-12T05:48:03.920 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.916+0000 7fe085f15700 1 -- 172.21.2.105:0/1089356535 shutdown_connections 2021-11-12T05:48:03.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.916+0000 7fe085f15700 1 --2- 172.21.2.105:0/1089356535 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe0640535d0 0x7fe064055a90 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:03.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.916+0000 7fe085f15700 1 --2- 172.21.2.105:0/1089356535 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe0801478b0 0x7fe0800645f0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:03.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.916+0000 7fe085f15700 1 --2- 172.21.2.105:0/1089356535 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe0800b0520 0x7fe080062dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:03.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.916+0000 7fe085f15700 1 --2- 172.21.2.105:0/1089356535 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe0800aca40 0x7fe08014a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:03.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.916+0000 7fe085f15700 1 -- 172.21.2.105:0/1089356535 >> 172.21.2.105:0/1089356535 conn(0x7fe08005c490 msgr2=0x7fe080138a90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:03.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.916+0000 7fe085f15700 1 -- 172.21.2.105:0/1089356535 shutdown_connections 2021-11-12T05:48:03.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:03.916+0000 7fe085f15700 1 -- 172.21.2.105:0/1089356535 wait complete. 2021-11-12T05:48:03.926 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-12T05:48:03.927 DEBUG:teuthology.orchestra.run.gibba005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:48:03.943 DEBUG:teuthology.orchestra.run.gibba015:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:48:03.953 DEBUG:teuthology.orchestra.run.gibba016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:48:03.967 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:48:03.980 DEBUG:teuthology.orchestra.run.gibba044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:48:03.993 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-12T05:48:03.993 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:03.994 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:48:03.994 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:48:03.999 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:48:04.000 INFO:teuthology.orchestra.run.gibba016.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-12T05:48:04.000 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-11-12T05:48:04.001 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:04.001 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:48:04.002 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:48:04.028 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:48:04.029 INFO:teuthology.orchestra.run.gibba038.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-12T05:48:04.029 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-12T05:48:04.030 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:04.030 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:48:04.031 DEBUG:teuthology.orchestra.run.gibba044:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:48:04.040 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:48:04.041 INFO:teuthology.orchestra.run.gibba044.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-12T05:48:04.041 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-12T05:48:04.041 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-12T05:48:04.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.092+0000 7fee73f18700 1 Processor -- start 2021-11-12T05:48:04.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.092+0000 7fee73f18700 1 -- start start 2021-11-12T05:48:04.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.092+0000 7fee73f18700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fee6c0b0e60 0x7fee6c0ac270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:04.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.092+0000 7fee73f18700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fee6c0aa700 0x7fee6c0ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:04.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.092+0000 7fee73f18700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee6c0b20b0 con 0x7fee6c0b1cd0 2021-11-12T05:48:04.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.092+0000 7fee73f18700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee6c0b2870 con 0x7fee6c0b0e60 2021-11-12T05:48:04.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.092+0000 7fee73f18700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c0b13e0 con 0x7fee6c0aa700 2021-11-12T05:48:04.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.092+0000 7fee71cb4700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fee6c0b1cd0 0x7fee6c0abb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:59912/0 (socket says 172.21.2.105:59912) 2021-11-12T05:48:04.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.092+0000 7fee71cb4700 1 -- 172.21.2.105:0/3839358347 learned_addr learned my addr 172.21.2.105:0/3839358347 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:04.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.092+0000 7fee714b3700 1 --2- 172.21.2.105:0/3839358347 >> v2:172.21.2.105:3300/0 conn(0x7fee6c0b0e60 0x7fee6c0ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:04.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.092+0000 7fee70cb2700 1 -- 172.21.2.105:0/3839358347 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 213147956 0 0) 0x7fee6c0b20b0 con 0x7fee6c0b1cd0 2021-11-12T05:48:04.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.092+0000 7fee70cb2700 1 -- 172.21.2.105:0/3839358347 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee54003260 con 0x7fee6c0b1cd0 2021-11-12T05:48:04.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.092+0000 7fee714b3700 1 -- 172.21.2.105:0/3839358347 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fee6c0aa700 msgr2=0x7fee6c0ad2b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:48:04.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.092+0000 7fee714b3700 1 --2- 172.21.2.105:0/3839358347 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fee6c0aa700 0x7fee6c0ad2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:04.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.092+0000 7fee714b3700 1 -- 172.21.2.105:0/3839358347 >> v1:172.21.2.105:6789/0 conn(0x7fee6c0b1cd0 legacy=0x7fee6c0abb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:04.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.092+0000 7fee714b3700 1 -- 172.21.2.105:0/3839358347 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee6c0ace10 con 0x7fee6c0b0e60 2021-11-12T05:48:04.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.096+0000 7fee714b3700 1 --2- 172.21.2.105:0/3839358347 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee6c0b0e60 0x7fee6c0ac270 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 rx=0x7fee5c002f70 tx=0x7fee5c006df0).ready entity=mon.0 client_cookie=1bf0932eaedbf6e6 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:04.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.096+0000 7fee70cb2700 1 -- 172.21.2.105:0/3839358347 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee5c00d570 con 0x7fee6c0b0e60 2021-11-12T05:48:04.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.096+0000 7fee70cb2700 1 -- 172.21.2.105:0/3839358347 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5c000e90 con 0x7fee6c0b0e60 2021-11-12T05:48:04.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.096+0000 7fee70cb2700 1 -- 172.21.2.105:0/3839358347 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee5c00d900 con 0x7fee6c0b0e60 2021-11-12T05:48:04.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.096+0000 7fee73f18700 1 -- 172.21.2.105:0/3839358347 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee6c0b0e60 msgr2=0x7fee6c0ac270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:04.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.096+0000 7fee73f18700 1 --2- 172.21.2.105:0/3839358347 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee6c0b0e60 0x7fee6c0ac270 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 rx=0x7fee5c002f70 tx=0x7fee5c006df0).stop 2021-11-12T05:48:04.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.096+0000 7fee73f18700 1 -- 172.21.2.105:0/3839358347 shutdown_connections 2021-11-12T05:48:04.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.096+0000 7fee73f18700 1 --2- 172.21.2.105:0/3839358347 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fee6c0aa700 0x7fee6c0ad2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:04.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.096+0000 7fee73f18700 1 --2- 172.21.2.105:0/3839358347 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee6c0b0e60 0x7fee6c0ac270 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:04.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.096+0000 7fee73f18700 1 -- 172.21.2.105:0/3839358347 >> 172.21.2.105:0/3839358347 conn(0x7fee6c063610 msgr2=0x7fee6c0639f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:04.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.096+0000 7fee73f18700 1 -- 172.21.2.105:0/3839358347 shutdown_connections 2021-11-12T05:48:04.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.096+0000 7fee73f18700 1 -- 172.21.2.105:0/3839358347 wait complete. 2021-11-12T05:48:04.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.096+0000 7fee73f18700 1 Processor -- start 2021-11-12T05:48:04.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.096+0000 7fee73f18700 1 -- start start 2021-11-12T05:48:04.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.096+0000 7fee73f18700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fee6c0aa700 0x7fee6c14a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:04.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.096+0000 7fee73f18700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fee6c0b0e60 0x7fee6c0afc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:04.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.096+0000 7fee73f18700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee6c0b1cd0 0x7fee6c13e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:04.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.096+0000 7fee73f18700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c067060 con 0x7fee6c0b1cd0 2021-11-12T05:48:04.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.096+0000 7fee73f18700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c067250 con 0x7fee6c0aa700 2021-11-12T05:48:04.110 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.096+0000 7fee73f18700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c13d6c0 con 0x7fee6c0b0e60 2021-11-12T05:48:04.110 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.096+0000 7fee724b5700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee6c0b1cd0 0x7fee6c13e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:04.110 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.096+0000 7fee724b5700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee6c0b1cd0 0x7fee6c13e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49526/0 (socket says 172.21.2.105:49526) 2021-11-12T05:48:04.110 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.096+0000 7fee724b5700 1 -- 172.21.2.105:0/1685138794 learned_addr learned my addr 172.21.2.105:0/1685138794 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:04.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.096+0000 7fee724b5700 1 -- 172.21.2.105:0/1685138794 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fee6c0b0e60 msgr2=0x7fee6c0afc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:04.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.096+0000 7fee724b5700 1 --2- 172.21.2.105:0/1685138794 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fee6c0b0e60 0x7fee6c0afc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:04.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.096+0000 7fee724b5700 1 -- 172.21.2.105:0/1685138794 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fee6c0aa700 msgr2=0x7fee6c14a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:04.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.096+0000 7fee724b5700 1 --2- 172.21.2.105:0/1685138794 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fee6c0aa700 0x7fee6c14a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:04.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.096+0000 7fee724b5700 1 -- 172.21.2.105:0/1685138794 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee5c00b180 con 0x7fee6c0b1cd0 2021-11-12T05:48:04.112 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.096+0000 7fee724b5700 1 --2- 172.21.2.105:0/1685138794 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee6c0b1cd0 0x7fee6c13e2c0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7fee64003330 tx=0x7fee640091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:04.112 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.096+0000 7fee5affd700 1 -- 172.21.2.105:0/1685138794 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee64001520 con 0x7fee6c0b1cd0 2021-11-12T05:48:04.112 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.096+0000 7fee5affd700 1 -- 172.21.2.105:0/1685138794 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee64001680 con 0x7fee6c0b1cd0 2021-11-12T05:48:04.112 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.096+0000 7fee5affd700 1 -- 172.21.2.105:0/1685138794 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee640019e0 con 0x7fee6c0b1cd0 2021-11-12T05:48:04.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.096+0000 7fee73f18700 1 -- 172.21.2.105:0/1685138794 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee6c1413b0 con 0x7fee6c0b1cd0 2021-11-12T05:48:04.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.096+0000 7fee73f18700 1 -- 172.21.2.105:0/1685138794 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee6c13dc60 con 0x7fee6c0b1cd0 2021-11-12T05:48:04.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.096+0000 7fee73f18700 1 -- 172.21.2.105:0/1685138794 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee6c0a9b40 con 0x7fee6c0b1cd0 2021-11-12T05:48:04.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.096+0000 7fee5affd700 1 -- 172.21.2.105:0/1685138794 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fee64018030 con 0x7fee6c0b1cd0 2021-11-12T05:48:04.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.096+0000 7fee5affd700 1 --2- 172.21.2.105:0/1685138794 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fee4c053690 0x7fee4c055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:04.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.100+0000 7fee5affd700 1 -- 172.21.2.105:0/1685138794 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fee6406b2a0 con 0x7fee6c0b1cd0 2021-11-12T05:48:04.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.100+0000 7fee71cb4700 1 --2- 172.21.2.105:0/1685138794 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fee4c053690 0x7fee4c055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:04.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.100+0000 7fee71cb4700 1 --2- 172.21.2.105:0/1685138794 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fee4c053690 0x7fee4c055b50 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7fee68001110 tx=0x7fee680076c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:04.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.100+0000 7fee5affd700 1 -- 172.21.2.105:0/1685138794 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fee6c0a9b40 con 0x7fee6c0b1cd0 2021-11-12T05:48:04.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.184+0000 7fee73f18700 1 -- 172.21.2.105:0/1685138794 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fee6c0a9b40 con 0x7fee6c0b1cd0 2021-11-12T05:48:04.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.184+0000 7fee5affd700 1 -- 172.21.2.105:0/1685138794 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v100) v1 ==== 81+0+29221 (secure 0 0 0) 0x7fee6c0a9b40 con 0x7fee6c0b1cd0 2021-11-12T05:48:04.190 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:04.190 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:48:04.191 INFO:teuthology.orchestra.run.gibba005.stdout: "epoch": 100, 2021-11-12T05:48:04.191 INFO:teuthology.orchestra.run.gibba005.stdout: "fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", 2021-11-12T05:48:04.192 INFO:teuthology.orchestra.run.gibba005.stdout: "created": "2021-11-12T05:40:19.986390+0000", 2021-11-12T05:48:04.192 INFO:teuthology.orchestra.run.gibba005.stdout: "modified": "2021-11-12T05:48:01.726569+0000", 2021-11-12T05:48:04.192 INFO:teuthology.orchestra.run.gibba005.stdout: "last_up_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:48:04.193 INFO:teuthology.orchestra.run.gibba005.stdout: "last_in_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:48:04.193 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-12T05:48:04.193 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_num": 5799936, 2021-11-12T05:48:04.193 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_set": [ 2021-11-12T05:48:04.194 INFO:teuthology.orchestra.run.gibba005.stdout: "pglog_hardlimit", 2021-11-12T05:48:04.194 INFO:teuthology.orchestra.run.gibba005.stdout: "purged_snapdirs", 2021-11-12T05:48:04.194 INFO:teuthology.orchestra.run.gibba005.stdout: "recovery_deletes", 2021-11-12T05:48:04.194 INFO:teuthology.orchestra.run.gibba005.stdout: "sortbitwise" 2021-11-12T05:48:04.195 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:48:04.195 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_version": 5, 2021-11-12T05:48:04.195 INFO:teuthology.orchestra.run.gibba005.stdout: "full_ratio": 0.94999998807907104, 2021-11-12T05:48:04.195 INFO:teuthology.orchestra.run.gibba005.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-12T05:48:04.196 INFO:teuthology.orchestra.run.gibba005.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-12T05:48:04.196 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_snapshot": "", 2021-11-12T05:48:04.196 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_max": 18, 2021-11-12T05:48:04.196 INFO:teuthology.orchestra.run.gibba005.stdout: "max_osd": 8, 2021-11-12T05:48:04.196 INFO:teuthology.orchestra.run.gibba005.stdout: "require_min_compat_client": "jewel", 2021-11-12T05:48:04.197 INFO:teuthology.orchestra.run.gibba005.stdout: "min_compat_client": "jewel", 2021-11-12T05:48:04.197 INFO:teuthology.orchestra.run.gibba005.stdout: "require_osd_release": "octopus", 2021-11-12T05:48:04.197 INFO:teuthology.orchestra.run.gibba005.stdout: "pools": [ 2021-11-12T05:48:04.198 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.198 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 1, 2021-11-12T05:48:04.198 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "device_health_metrics", 2021-11-12T05:48:04.198 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:22.022116+0000", 2021-11-12T05:48:04.198 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:48:04.199 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:48:04.199 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:48:04.199 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:48:04.199 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:48:04.199 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:48:04.200 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:48:04.200 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:48:04.200 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 1, 2021-11-12T05:48:04.200 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 1, 2021-11-12T05:48:04.201 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 1, 2021-11-12T05:48:04.201 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 1, 2021-11-12T05:48:04.201 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 1, 2021-11-12T05:48:04.201 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:48:04.201 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:48:04.202 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:48:04.202 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:48:04.202 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:48:04.202 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:48:04.202 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:48:04.203 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.203 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "16", 2021-11-12T05:48:04.203 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:48:04.203 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:48:04.204 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:48:04.204 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:48:04.204 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:48:04.204 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:48:04.204 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:48:04.205 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:48:04.205 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:48:04.205 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:48:04.206 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:48:04.206 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:48:04.206 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:48:04.207 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:48:04.207 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:48:04.208 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:48:04.208 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:48:04.209 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:48:04.209 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:48:04.210 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:48:04.210 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:48:04.210 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:48:04.211 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:48:04.211 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:48:04.211 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:48:04.212 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:48:04.212 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.212 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:48:04.212 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:48:04.213 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:48:04.213 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:48:04.213 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:48:04.213 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:48:04.213 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:48:04.214 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:48:04.214 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:48:04.214 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:48:04.215 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:48:04.215 INFO:teuthology.orchestra.run.gibba005.stdout: "options": { 2021-11-12T05:48:04.215 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_min": 1 2021-11-12T05:48:04.215 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.216 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:48:04.216 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr_devicehealth": {} 2021-11-12T05:48:04.216 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:04.216 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.217 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.217 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 2, 2021-11-12T05:48:04.217 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "rbd", 2021-11-12T05:48:04.217 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:29.953617+0000", 2021-11-12T05:48:04.217 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:48:04.218 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:48:04.218 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:48:04.218 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:48:04.218 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:48:04.219 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:48:04.219 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:48:04.219 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:48:04.219 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:48:04.220 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:48:04.220 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:48:04.220 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:48:04.220 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:48:04.221 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:48:04.221 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:48:04.221 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:48:04.221 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:48:04.222 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:48:04.222 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:48:04.222 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:48:04.222 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.223 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "19", 2021-11-12T05:48:04.223 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:48:04.224 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:48:04.224 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:48:04.224 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:48:04.225 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:48:04.225 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:48:04.225 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:48:04.226 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:48:04.226 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:48:04.226 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:48:04.227 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:48:04.227 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:48:04.227 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:48:04.227 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:48:04.227 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:48:04.228 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:48:04.228 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:48:04.228 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:48:04.228 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:48:04.228 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:48:04.229 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:48:04.229 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:48:04.229 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:48:04.229 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:48:04.230 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:48:04.230 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:48:04.230 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.230 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:48:04.231 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:48:04.231 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:48:04.231 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:48:04.231 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:48:04.231 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:48:04.232 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:48:04.232 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:48:04.232 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:48:04.233 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:48:04.233 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:48:04.233 INFO:teuthology.orchestra.run.gibba005.stdout: "options": {}, 2021-11-12T05:48:04.233 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:48:04.234 INFO:teuthology.orchestra.run.gibba005.stdout: "rbd": {} 2021-11-12T05:48:04.234 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:04.235 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:04.235 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:48:04.236 INFO:teuthology.orchestra.run.gibba005.stdout: "osds": [ 2021-11-12T05:48:04.236 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.237 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:48:04.237 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "ee8e30a0-4819-4475-80ec-dd3ee7d01322", 2021-11-12T05:48:04.238 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:48:04.238 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:48:04.238 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:48:04.238 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:48:04.239 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:48:04.239 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:48:04.239 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:48:04.239 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 93, 2021-11-12T05:48:04.239 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:48:04.240 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:48:04.240 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:48:04.240 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:04.240 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.241 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:04.241 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6802", 2021-11-12T05:48:04.241 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:48:04.241 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.242 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.242 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:04.242 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6803", 2021-11-12T05:48:04.242 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:48:04.242 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:04.243 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.243 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.243 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:48:04.243 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:04.244 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.244 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:04.244 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6804", 2021-11-12T05:48:04.244 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:48:04.244 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.245 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.245 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:04.245 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6805", 2021-11-12T05:48:04.245 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:48:04.245 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:04.246 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.246 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.246 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:48:04.246 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:04.247 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.247 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:04.247 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6808", 2021-11-12T05:48:04.247 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:48:04.247 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.248 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.248 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:04.248 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6809", 2021-11-12T05:48:04.248 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:48:04.248 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:04.249 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.249 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.249 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:48:04.249 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:04.249 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.250 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:04.250 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6806", 2021-11-12T05:48:04.250 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:48:04.250 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.251 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.251 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:04.251 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6807", 2021-11-12T05:48:04.251 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:48:04.251 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:04.252 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.252 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.252 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6803/14874", 2021-11-12T05:48:04.252 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6805/14874", 2021-11-12T05:48:04.253 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6809/14874", 2021-11-12T05:48:04.253 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6807/14874", 2021-11-12T05:48:04.253 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:48:04.253 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:48:04.253 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:48:04.254 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.254 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.254 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.254 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:48:04.255 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "b1bb06c3-26d0-4d92-82f8-b3e882242785", 2021-11-12T05:48:04.255 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:48:04.255 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:48:04.255 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:48:04.256 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:48:04.256 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:48:04.256 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:48:04.256 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:48:04.256 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 93, 2021-11-12T05:48:04.257 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:48:04.257 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:48:04.257 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:48:04.257 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:04.257 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.258 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:04.258 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6810", 2021-11-12T05:48:04.258 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:48:04.258 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.259 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.259 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:04.259 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6811", 2021-11-12T05:48:04.259 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:48:04.259 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:04.260 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.260 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.260 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:48:04.260 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:04.261 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.261 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:04.261 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6812", 2021-11-12T05:48:04.261 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:48:04.261 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.262 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.262 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:04.262 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6813", 2021-11-12T05:48:04.262 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:48:04.263 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:04.263 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.263 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.263 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:48:04.263 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:04.264 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.264 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:04.264 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6816", 2021-11-12T05:48:04.264 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:48:04.264 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.265 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.265 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:04.265 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6817", 2021-11-12T05:48:04.265 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:48:04.265 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:04.266 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.266 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.266 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:48:04.266 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:04.267 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.267 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:04.267 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6814", 2021-11-12T05:48:04.267 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:48:04.267 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.268 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.268 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:04.268 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6815", 2021-11-12T05:48:04.268 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:48:04.268 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:04.269 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.269 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.269 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6811/14875", 2021-11-12T05:48:04.269 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6813/14875", 2021-11-12T05:48:04.270 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6817/14875", 2021-11-12T05:48:04.270 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6815/14875", 2021-11-12T05:48:04.270 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:48:04.270 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:48:04.270 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:48:04.271 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.271 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.271 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.271 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:48:04.271 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "837b2c60-c335-4382-9f47-d86543a14022", 2021-11-12T05:48:04.272 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:48:04.272 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:48:04.272 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:48:04.272 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:48:04.273 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:48:04.273 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:48:04.273 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:48:04.273 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 95, 2021-11-12T05:48:04.273 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:48:04.274 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:48:04.274 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:48:04.274 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:04.274 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.274 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:04.275 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6818", 2021-11-12T05:48:04.275 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:48:04.275 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.275 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.276 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:04.276 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6819", 2021-11-12T05:48:04.276 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:48:04.276 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:04.276 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.277 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.277 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:48:04.277 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:04.277 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.278 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:04.278 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6820", 2021-11-12T05:48:04.278 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:48:04.278 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.278 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.279 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:04.279 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6821", 2021-11-12T05:48:04.279 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:48:04.279 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:04.280 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.280 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.280 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:48:04.280 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:04.280 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.281 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:04.281 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6824", 2021-11-12T05:48:04.281 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:48:04.281 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.281 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.282 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:04.282 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6825", 2021-11-12T05:48:04.282 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:48:04.282 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:04.283 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.283 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.283 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:48:04.283 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:04.283 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.284 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:04.284 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6822", 2021-11-12T05:48:04.284 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:48:04.284 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.285 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.285 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:04.285 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6823", 2021-11-12T05:48:04.285 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:48:04.285 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:04.286 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.286 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.286 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6819/14905", 2021-11-12T05:48:04.286 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6821/14905", 2021-11-12T05:48:04.287 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6825/14905", 2021-11-12T05:48:04.287 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6823/14905", 2021-11-12T05:48:04.287 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:48:04.287 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:48:04.287 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:48:04.288 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.288 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.288 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.288 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:48:04.288 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "eb2b737b-dda6-444b-a306-f33cbbd51f70", 2021-11-12T05:48:04.289 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:48:04.289 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:48:04.289 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:48:04.289 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:48:04.290 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:48:04.290 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:48:04.290 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:48:04.290 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 93, 2021-11-12T05:48:04.290 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:48:04.291 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:48:04.291 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:48:04.291 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:04.291 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.291 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:04.292 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6826", 2021-11-12T05:48:04.292 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:48:04.292 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.292 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.293 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:04.293 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6827", 2021-11-12T05:48:04.293 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:48:04.293 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:04.293 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.294 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.294 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:48:04.294 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:04.294 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.295 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:04.295 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6828", 2021-11-12T05:48:04.295 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:48:04.295 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.295 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.296 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:04.296 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6829", 2021-11-12T05:48:04.296 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:48:04.296 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:04.296 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.297 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.297 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:48:04.297 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:04.297 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.297 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:04.298 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6832", 2021-11-12T05:48:04.298 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:48:04.298 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.298 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.299 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:04.299 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6833", 2021-11-12T05:48:04.299 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:48:04.299 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:04.299 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.300 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.300 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:48:04.300 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:04.300 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.300 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:04.301 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6830", 2021-11-12T05:48:04.301 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:48:04.301 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.301 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.302 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:04.302 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6831", 2021-11-12T05:48:04.302 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:48:04.302 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:04.302 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.303 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.303 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6827/14876", 2021-11-12T05:48:04.303 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6829/14876", 2021-11-12T05:48:04.303 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6833/14876", 2021-11-12T05:48:04.304 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6831/14876", 2021-11-12T05:48:04.304 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:48:04.304 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:48:04.304 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:48:04.304 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.305 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.305 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.305 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:48:04.305 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "721529a1-c047-486a-a7ca-ddc15d80cdde", 2021-11-12T05:48:04.305 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:48:04.306 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:48:04.306 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:48:04.306 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:48:04.306 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:48:04.307 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:48:04.307 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:48:04.307 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 92, 2021-11-12T05:48:04.307 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:48:04.307 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:48:04.308 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:48:04.308 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:04.308 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.308 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:04.309 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6800", 2021-11-12T05:48:04.309 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:48:04.309 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.309 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.309 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:04.310 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6801", 2021-11-12T05:48:04.310 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:48:04.310 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:04.310 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.311 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.311 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:48:04.311 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:04.311 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.311 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:04.312 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6802", 2021-11-12T05:48:04.312 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:48:04.312 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.312 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.312 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:04.313 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6803", 2021-11-12T05:48:04.313 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:48:04.313 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:04.313 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.313 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.314 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:48:04.314 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:04.314 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.314 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:04.315 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6806", 2021-11-12T05:48:04.315 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:48:04.315 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.315 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.315 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:04.316 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6807", 2021-11-12T05:48:04.316 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:48:04.316 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:04.316 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.317 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.317 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:48:04.317 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:04.317 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.317 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:04.318 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6804", 2021-11-12T05:48:04.318 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:48:04.318 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.318 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.319 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:04.319 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6805", 2021-11-12T05:48:04.319 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:48:04.319 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:04.319 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.320 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.320 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6801/15096", 2021-11-12T05:48:04.320 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6803/15096", 2021-11-12T05:48:04.320 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6807/15096", 2021-11-12T05:48:04.320 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6805/15096", 2021-11-12T05:48:04.321 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:48:04.321 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:48:04.321 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:48:04.321 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.321 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.322 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.322 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:48:04.322 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "68b72ab2-fa82-4b5c-bf33-528f002e4950", 2021-11-12T05:48:04.322 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:48:04.323 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:48:04.323 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:48:04.323 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:48:04.323 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:48:04.323 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:48:04.324 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:48:04.324 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 82, 2021-11-12T05:48:04.324 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:48:04.324 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:48:04.325 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:48:04.325 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:04.325 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.326 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:04.326 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6808", 2021-11-12T05:48:04.326 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:48:04.326 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.326 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.327 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:04.327 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6809", 2021-11-12T05:48:04.327 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:48:04.327 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:04.328 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.328 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.328 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:48:04.328 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:04.328 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.329 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:04.329 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6810", 2021-11-12T05:48:04.329 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:48:04.329 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.330 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.330 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:04.330 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6811", 2021-11-12T05:48:04.330 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:48:04.330 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:04.331 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.331 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.331 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:48:04.331 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:04.332 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.332 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:04.332 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6814", 2021-11-12T05:48:04.332 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:48:04.333 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.333 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.333 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:04.333 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6815", 2021-11-12T05:48:04.333 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:48:04.334 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:04.334 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.334 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.334 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:48:04.334 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:04.335 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.335 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:04.335 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6812", 2021-11-12T05:48:04.335 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:48:04.336 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.336 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.336 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:04.336 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6813", 2021-11-12T05:48:04.336 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:48:04.337 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:04.337 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.337 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.337 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6809/15097", 2021-11-12T05:48:04.338 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6811/15097", 2021-11-12T05:48:04.338 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6815/15097", 2021-11-12T05:48:04.338 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6813/15097", 2021-11-12T05:48:04.338 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:48:04.338 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:48:04.339 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:48:04.339 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.339 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.339 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.339 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:48:04.340 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "a2c83b5d-8d37-4d30-ac04-30d89a76e485", 2021-11-12T05:48:04.340 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:48:04.340 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:48:04.340 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:48:04.341 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:48:04.341 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:48:04.341 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:48:04.341 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:48:04.341 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 92, 2021-11-12T05:48:04.342 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:48:04.342 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:48:04.342 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:48:04.342 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:04.343 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.343 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:04.343 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6816", 2021-11-12T05:48:04.343 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:48:04.343 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.344 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.344 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:04.344 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6817", 2021-11-12T05:48:04.344 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:48:04.344 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:04.345 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.345 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.345 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:48:04.345 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:04.346 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.346 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:04.346 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6818", 2021-11-12T05:48:04.346 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:48:04.347 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.347 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.347 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:04.347 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6819", 2021-11-12T05:48:04.348 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:48:04.348 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:04.348 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.348 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.348 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:48:04.349 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:04.349 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.349 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:04.349 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6822", 2021-11-12T05:48:04.349 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:48:04.350 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.350 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.350 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:04.350 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6823", 2021-11-12T05:48:04.351 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:48:04.351 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:04.351 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.351 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.351 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:48:04.352 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:04.352 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.352 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:04.352 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6820", 2021-11-12T05:48:04.352 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:48:04.353 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.353 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.353 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:04.353 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6821", 2021-11-12T05:48:04.354 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:48:04.354 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:04.354 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.354 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.354 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6817/15098", 2021-11-12T05:48:04.355 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6819/15098", 2021-11-12T05:48:04.355 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6823/15098", 2021-11-12T05:48:04.355 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6821/15098", 2021-11-12T05:48:04.355 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:48:04.355 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:48:04.356 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:48:04.356 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.356 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.356 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.357 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:48:04.357 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "786ce966-d0fb-4181-aed4-c26e3ef61c43", 2021-11-12T05:48:04.357 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:48:04.357 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:48:04.357 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:48:04.358 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:48:04.358 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:48:04.358 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:48:04.358 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:48:04.359 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 93, 2021-11-12T05:48:04.359 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:48:04.359 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:48:04.359 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:48:04.359 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:04.360 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.360 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:04.360 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6824", 2021-11-12T05:48:04.360 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:48:04.360 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.361 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.361 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:04.361 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6825", 2021-11-12T05:48:04.361 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:48:04.361 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:04.362 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.362 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.362 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:48:04.362 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:04.363 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.363 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:04.363 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6826", 2021-11-12T05:48:04.363 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:48:04.363 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.364 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.364 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:04.364 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6827", 2021-11-12T05:48:04.364 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:48:04.365 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:04.365 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.365 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.365 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:48:04.365 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:04.366 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.366 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:04.366 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6830", 2021-11-12T05:48:04.366 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:48:04.366 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.367 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.367 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:04.367 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6831", 2021-11-12T05:48:04.367 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:48:04.368 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:04.368 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.368 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.368 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:48:04.368 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:04.369 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.369 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:04.369 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6828", 2021-11-12T05:48:04.369 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:48:04.370 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.370 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.370 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:04.370 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6829", 2021-11-12T05:48:04.370 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:48:04.371 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:04.371 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.371 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.371 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6825/15099", 2021-11-12T05:48:04.371 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6827/15099", 2021-11-12T05:48:04.372 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6831/15099", 2021-11-12T05:48:04.372 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6829/15099", 2021-11-12T05:48:04.372 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:48:04.372 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:48:04.373 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:48:04.373 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:04.373 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:04.373 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:48:04.373 INFO:teuthology.orchestra.run.gibba005.stdout: "osd_xinfo": [ 2021-11-12T05:48:04.374 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.374 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:48:04.374 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:48:04.374 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:48:04.374 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:48:04.375 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:48:04.375 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:48:04.375 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.615112+0000", 2021-11-12T05:48:04.375 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:48:04.376 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.376 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.376 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:48:04.376 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:48:04.376 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:48:04.377 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:48:04.377 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:48:04.377 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:48:04.377 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.665935+0000", 2021-11-12T05:48:04.377 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:48:04.378 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.378 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.378 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:48:04.378 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:48:04.379 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:48:04.379 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:48:04.379 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:48:04.379 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:48:04.379 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.715877+0000", 2021-11-12T05:48:04.380 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:48:04.380 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.380 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.380 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:48:04.380 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:48:04.381 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:48:04.381 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:48:04.381 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:48:04.381 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:48:04.382 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.489234+0000", 2021-11-12T05:48:04.382 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:48:04.382 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.382 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.382 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:48:04.383 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:48:04.383 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:48:04.383 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:48:04.383 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:48:04.383 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:48:04.384 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.413776+0000", 2021-11-12T05:48:04.384 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:48:04.384 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.384 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.385 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:48:04.385 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:48:04.385 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:48:04.385 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:48:04.385 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:48:04.386 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:48:04.386 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.507960+0000", 2021-11-12T05:48:04.386 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:48:04.386 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.386 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.387 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:48:04.387 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:48:04.387 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:48:04.387 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:48:04.388 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:48:04.388 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:48:04.388 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.635696+0000", 2021-11-12T05:48:04.388 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:48:04.388 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.389 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:04.389 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:48:04.389 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:48:04.389 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:48:04.389 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:48:04.390 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:48:04.390 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:48:04.390 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.746949+0000", 2021-11-12T05:48:04.390 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:48:04.391 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:04.391 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:48:04.391 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap": [], 2021-11-12T05:48:04.391 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap_items": [], 2021-11-12T05:48:04.391 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_temp": [], 2021-11-12T05:48:04.392 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_temp": [], 2021-11-12T05:48:04.392 INFO:teuthology.orchestra.run.gibba005.stdout: "blacklist": { 2021-11-12T05:48:04.392 INFO:teuthology.orchestra.run.gibba005.stdout: "172.21.2.105:6835/3298879485": "2021-11-13T05:47:57.711468+0000", 2021-11-12T05:48:04.392 INFO:teuthology.orchestra.run.gibba005.stdout: "172.21.2.105:6834/3298879485": "2021-11-13T05:47:57.711468+0000" 2021-11-12T05:48:04.393 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.393 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profiles": { 2021-11-12T05:48:04.393 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs_data": { 2021-11-12T05:48:04.393 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-device-class": "", 2021-11-12T05:48:04.393 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:48:04.394 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-root": "default", 2021-11-12T05:48:04.394 INFO:teuthology.orchestra.run.gibba005.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-12T05:48:04.394 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:48:04.394 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "2", 2021-11-12T05:48:04.394 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:48:04.395 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:48:04.395 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van", 2021-11-12T05:48:04.395 INFO:teuthology.orchestra.run.gibba005.stdout: "w": "8" 2021-11-12T05:48:04.395 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.396 INFO:teuthology.orchestra.run.gibba005.stdout: "default": { 2021-11-12T05:48:04.396 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:48:04.396 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:48:04.396 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "1", 2021-11-12T05:48:04.396 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:48:04.397 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:48:04.397 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van" 2021-11-12T05:48:04.397 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:04.397 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:04.397 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps_queue": [], 2021-11-12T05:48:04.398 INFO:teuthology.orchestra.run.gibba005.stdout: "new_removed_snaps": [], 2021-11-12T05:48:04.398 INFO:teuthology.orchestra.run.gibba005.stdout: "new_purged_snaps": [], 2021-11-12T05:48:04.398 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_node_flags": {}, 2021-11-12T05:48:04.398 INFO:teuthology.orchestra.run.gibba005.stdout: "device_class_flags": {} 2021-11-12T05:48:04.399 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:48:04.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.184+0000 7fee73f18700 1 -- 172.21.2.105:0/1685138794 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fee4c053690 msgr2=0x7fee4c055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:04.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.184+0000 7fee73f18700 1 --2- 172.21.2.105:0/1685138794 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fee4c053690 0x7fee4c055b50 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7fee68001110 tx=0x7fee680076c0).stop 2021-11-12T05:48:04.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.184+0000 7fee73f18700 1 -- 172.21.2.105:0/1685138794 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee6c0b1cd0 msgr2=0x7fee6c13e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:04.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.184+0000 7fee73f18700 1 --2- 172.21.2.105:0/1685138794 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee6c0b1cd0 0x7fee6c13e2c0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7fee64003330 tx=0x7fee640091a0).stop 2021-11-12T05:48:04.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.184+0000 7fee73f18700 1 -- 172.21.2.105:0/1685138794 shutdown_connections 2021-11-12T05:48:04.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.184+0000 7fee73f18700 1 --2- 172.21.2.105:0/1685138794 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fee4c053690 0x7fee4c055b50 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:04.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.184+0000 7fee73f18700 1 --2- 172.21.2.105:0/1685138794 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fee6c0b1cd0 0x7fee6c13e2c0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:04.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.184+0000 7fee73f18700 1 --2- 172.21.2.105:0/1685138794 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fee6c0b0e60 0x7fee6c0afc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:04.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.184+0000 7fee73f18700 1 --2- 172.21.2.105:0/1685138794 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fee6c0aa700 0x7fee6c14a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:04.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.184+0000 7fee73f18700 1 -- 172.21.2.105:0/1685138794 >> 172.21.2.105:0/1685138794 conn(0x7fee6c063610 msgr2=0x7fee6c0ac330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:04.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.184+0000 7fee73f18700 1 -- 172.21.2.105:0/1685138794 shutdown_connections 2021-11-12T05:48:04.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.184+0000 7fee73f18700 1 -- 172.21.2.105:0/1685138794 wait complete. 2021-11-12T05:48:04.403 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:48:04.476 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.472+0000 7fd868000700 1 Processor -- start 2021-11-12T05:48:04.477 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.472+0000 7fd868000700 1 -- start start 2021-11-12T05:48:04.477 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.472+0000 7fd868000700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd8600ad080 0x7fd8600af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:04.477 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.472+0000 7fd868000700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fd8600ac280 0x7fd8600ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:04.477 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.472+0000 7fd868000700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8600ac7b0 con 0x7fd86014abe0 2021-11-12T05:48:04.478 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.472+0000 7fd868000700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8601488a0 con 0x7fd8600ad080 2021-11-12T05:48:04.478 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.472+0000 7fd868000700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8600ac9e0 con 0x7fd8600ac280 2021-11-12T05:48:04.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.472+0000 7fd865d9c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd8600ad080 0x7fd8600af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:04.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.472+0000 7fd86659d700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fd86014abe0 0x7fd86014b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:59926/0 (socket says 172.21.2.105:59926) 2021-11-12T05:48:04.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.472+0000 7fd86659d700 1 -- 172.21.2.105:0/1841334032 learned_addr learned my addr 172.21.2.105:0/1841334032 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:04.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.472+0000 7fd865d9c700 1 -- 172.21.2.105:0/1841334032 >> v2:172.21.2.115:3300/0 conn(0x7fd8600ac280 msgr2=0x7fd8600ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:04.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.472+0000 7fd865d9c700 1 --2- 172.21.2.105:0/1841334032 >> v2:172.21.2.115:3300/0 conn(0x7fd8600ac280 0x7fd8600ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:04.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.472+0000 7fd865d9c700 1 -- 172.21.2.105:0/1841334032 >> v1:172.21.2.105:6789/0 conn(0x7fd86014abe0 legacy=0x7fd86014b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:04.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.472+0000 7fd865d9c700 1 -- 172.21.2.105:0/1841334032 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8600b0b30 con 0x7fd8600ad080 2021-11-12T05:48:04.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.472+0000 7fd865d9c700 1 --2- 172.21.2.105:0/1841334032 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd8600ad080 0x7fd8600af730 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7fd854002f70 tx=0x7fd854006df0).ready entity=mon.0 client_cookie=72b396380dc9d216 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:04.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.472+0000 7fd864d9a700 1 -- 172.21.2.105:0/1841334032 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd85400d5c0 con 0x7fd8600ad080 2021-11-12T05:48:04.483 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.472+0000 7fd864d9a700 1 -- 172.21.2.105:0/1841334032 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd854000e90 con 0x7fd8600ad080 2021-11-12T05:48:04.483 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.472+0000 7fd864d9a700 1 -- 172.21.2.105:0/1841334032 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd85400d910 con 0x7fd8600ad080 2021-11-12T05:48:04.483 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.472+0000 7fd868000700 1 -- 172.21.2.105:0/1841334032 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd8600ad080 msgr2=0x7fd8600af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:04.483 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.472+0000 7fd868000700 1 --2- 172.21.2.105:0/1841334032 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd8600ad080 0x7fd8600af730 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7fd854002f70 tx=0x7fd854006df0).stop 2021-11-12T05:48:04.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.472+0000 7fd868000700 1 -- 172.21.2.105:0/1841334032 shutdown_connections 2021-11-12T05:48:04.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.472+0000 7fd868000700 1 --2- 172.21.2.105:0/1841334032 >> v2:172.21.2.115:3300/0 conn(0x7fd8600ac280 0x7fd8600ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:04.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.472+0000 7fd868000700 1 --2- 172.21.2.105:0/1841334032 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd8600ad080 0x7fd8600af730 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:04.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.472+0000 7fd868000700 1 -- 172.21.2.105:0/1841334032 >> 172.21.2.105:0/1841334032 conn(0x7fd8600b5370 msgr2=0x7fd8600b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:04.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.472+0000 7fd868000700 1 -- 172.21.2.105:0/1841334032 shutdown_connections 2021-11-12T05:48:04.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.472+0000 7fd868000700 1 -- 172.21.2.105:0/1841334032 wait complete. 2021-11-12T05:48:04.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.476+0000 7fd868000700 1 Processor -- start 2021-11-12T05:48:04.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.476+0000 7fd868000700 1 -- start start 2021-11-12T05:48:04.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.476+0000 7fd868000700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd8600ac280 0x7fd8600a9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:04.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.476+0000 7fd868000700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd8600ad080 0x7fd860149db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:04.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.476+0000 7fd868000700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd86014abe0 0x7fd8600a9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:04.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.476+0000 7fd868000700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8600aa3e0 con 0x7fd8600ac280 2021-11-12T05:48:04.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.476+0000 7fd868000700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8600aa680 con 0x7fd86014abe0 2021-11-12T05:48:04.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.476+0000 7fd868000700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8600a7020 con 0x7fd8600ad080 2021-11-12T05:48:04.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.476+0000 7fd865d9c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd8600ac280 0x7fd8600a9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:04.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.476+0000 7fd865d9c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd8600ac280 0x7fd8600a9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49536/0 (socket says 172.21.2.105:49536) 2021-11-12T05:48:04.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.476+0000 7fd865d9c700 1 -- 172.21.2.105:0/4261483065 learned_addr learned my addr 172.21.2.105:0/4261483065 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:04.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.476+0000 7fd865d9c700 1 -- 172.21.2.105:0/4261483065 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd8600ad080 msgr2=0x7fd860149db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:04.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.476+0000 7fd865d9c700 1 --2- 172.21.2.105:0/4261483065 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd8600ad080 0x7fd860149db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:04.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.476+0000 7fd865d9c700 1 -- 172.21.2.105:0/4261483065 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd86014abe0 msgr2=0x7fd8600a9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:04.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.476+0000 7fd865d9c700 1 --2- 172.21.2.105:0/4261483065 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd86014abe0 0x7fd8600a9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:04.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.476+0000 7fd865d9c700 1 -- 172.21.2.105:0/4261483065 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd85400b180 con 0x7fd8600ac280 2021-11-12T05:48:04.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.476+0000 7fd865d9c700 1 --2- 172.21.2.105:0/4261483065 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd8600ac280 0x7fd8600a9740 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7fd854002f70 tx=0x7fd854014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:04.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.476+0000 7fd852ffd700 1 -- 172.21.2.105:0/4261483065 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd854016070 con 0x7fd8600ac280 2021-11-12T05:48:04.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.476+0000 7fd852ffd700 1 -- 172.21.2.105:0/4261483065 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85400de90 con 0x7fd8600ac280 2021-11-12T05:48:04.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.476+0000 7fd868000700 1 -- 172.21.2.105:0/4261483065 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8600a7240 con 0x7fd8600ac280 2021-11-12T05:48:04.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.476+0000 7fd868000700 1 -- 172.21.2.105:0/4261483065 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd860062b60 con 0x7fd8600ac280 2021-11-12T05:48:04.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.476+0000 7fd852ffd700 1 -- 172.21.2.105:0/4261483065 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd85401e450 con 0x7fd8600ac280 2021-11-12T05:48:04.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.476+0000 7fd868000700 1 -- 172.21.2.105:0/4261483065 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8600aa230 con 0x7fd8600ac280 2021-11-12T05:48:04.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.476+0000 7fd852ffd700 1 -- 172.21.2.105:0/4261483065 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd854025030 con 0x7fd8600ac280 2021-11-12T05:48:04.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.476+0000 7fd852ffd700 1 --2- 172.21.2.105:0/4261483065 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd840053660 0x7fd840055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:04.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.476+0000 7fd852ffd700 1 -- 172.21.2.105:0/4261483065 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fd85406caa0 con 0x7fd8600ac280 2021-11-12T05:48:04.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.476+0000 7fd86559b700 1 --2- 172.21.2.105:0/4261483065 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd840053660 0x7fd840055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:04.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.476+0000 7fd86559b700 1 --2- 172.21.2.105:0/4261483065 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd840053660 0x7fd840055b20 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7fd85c002f70 tx=0x7fd85c006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:04.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.480+0000 7fd852ffd700 1 -- 172.21.2.105:0/4261483065 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd854043c70 con 0x7fd8600ac280 2021-11-12T05:48:04.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.588+0000 7fd868000700 1 -- 172.21.2.105:0/4261483065 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8600b1440 con 0x7fd8600ac280 2021-11-12T05:48:04.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.588+0000 7fd852ffd700 1 -- 172.21.2.105:0/4261483065 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+1206 (secure 0 0 0) 0x7fd854047290 con 0x7fd8600ac280 2021-11-12T05:48:04.594 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:04.594 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":47,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4751,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/3227424218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":3227424218},{"type":"v1","addr":"172.21.2.115:6833","nonce":3227424218}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":43},{"gid":5113,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.105:6835/673039210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":673039210},{"type":"v1","addr":"172.21.2.105:6835","nonce":673039210}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":47}],"filesystems":[]} 2021-11-12T05:48:04.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.588+0000 7fd868000700 1 -- 172.21.2.105:0/4261483065 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd840053660 msgr2=0x7fd840055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:04.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.588+0000 7fd868000700 1 --2- 172.21.2.105:0/4261483065 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd840053660 0x7fd840055b20 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7fd85c002f70 tx=0x7fd85c006a80).stop 2021-11-12T05:48:04.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.588+0000 7fd868000700 1 -- 172.21.2.105:0/4261483065 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd8600ac280 msgr2=0x7fd8600a9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:04.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.588+0000 7fd868000700 1 --2- 172.21.2.105:0/4261483065 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd8600ac280 0x7fd8600a9740 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7fd854002f70 tx=0x7fd854014000).stop 2021-11-12T05:48:04.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.592+0000 7fd868000700 1 -- 172.21.2.105:0/4261483065 shutdown_connections 2021-11-12T05:48:04.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.592+0000 7fd868000700 1 --2- 172.21.2.105:0/4261483065 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd840053660 0x7fd840055b20 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:04.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.592+0000 7fd868000700 1 --2- 172.21.2.105:0/4261483065 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd86014abe0 0x7fd8600a9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:04.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.592+0000 7fd868000700 1 --2- 172.21.2.105:0/4261483065 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd8600ad080 0x7fd860149db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:04.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.592+0000 7fd868000700 1 --2- 172.21.2.105:0/4261483065 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd8600ac280 0x7fd8600a9740 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:04.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.592+0000 7fd868000700 1 -- 172.21.2.105:0/4261483065 >> 172.21.2.105:0/4261483065 conn(0x7fd8600b5370 msgr2=0x7fd860144d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:04.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.592+0000 7fd868000700 1 -- 172.21.2.105:0/4261483065 shutdown_connections 2021-11-12T05:48:04.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.592+0000 7fd868000700 1 -- 172.21.2.105:0/4261483065 wait complete. 2021-11-12T05:48:04.598 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 47 2021-11-12T05:48:04.601 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:48:04.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.648+0000 7ff93cfa9700 1 Processor -- start 2021-11-12T05:48:04.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.648+0000 7ff93cfa9700 1 -- start start 2021-11-12T05:48:04.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.648+0000 7ff93cfa9700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff9380b0780 0x7ff9381434d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:04.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.648+0000 7ff93cfa9700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff9380b0cc0 0x7ff93805f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:04.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.648+0000 7ff93cfa9700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9380b2d20 con 0x7ff9380b2940 2021-11-12T05:48:04.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.648+0000 7ff93cfa9700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9380b1fc0 con 0x7ff9380b0780 2021-11-12T05:48:04.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.648+0000 7ff93cfa9700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9380b15e0 con 0x7ff9380b0cc0 2021-11-12T05:48:04.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.648+0000 7ff93659c700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7ff9380b2940 0x7ff938142dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:59940/0 (socket says 172.21.2.105:59940) 2021-11-12T05:48:04.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.648+0000 7ff93659c700 1 -- 172.21.2.105:0/2784377249 learned_addr learned my addr 172.21.2.105:0/2784377249 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:04.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.648+0000 7ff935d9b700 1 --2- 172.21.2.105:0/2784377249 >> v2:172.21.2.105:3300/0 conn(0x7ff9380b0780 0x7ff9381434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:04.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.648+0000 7ff935d9b700 1 -- 172.21.2.105:0/2784377249 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff9380b0cc0 msgr2=0x7ff93805f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:04.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.648+0000 7ff935d9b700 1 --2- 172.21.2.105:0/2784377249 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff9380b0cc0 0x7ff93805f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:04.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.648+0000 7ff935d9b700 1 -- 172.21.2.105:0/2784377249 >> v1:172.21.2.105:6789/0 conn(0x7ff9380b2940 legacy=0x7ff938142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:04.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.648+0000 7ff935d9b700 1 -- 172.21.2.105:0/2784377249 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9380b1880 con 0x7ff9380b0780 2021-11-12T05:48:04.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.648+0000 7ff935d9b700 1 --2- 172.21.2.105:0/2784377249 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff9380b0780 0x7ff9381434d0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7ff920002f70 tx=0x7ff920006e80).ready entity=mon.0 client_cookie=c4da6f14adfe2ef server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:04.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.648+0000 7ff93559a700 1 -- 172.21.2.105:0/2784377249 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff92000f730 con 0x7ff9380b0780 2021-11-12T05:48:04.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.648+0000 7ff93559a700 1 -- 172.21.2.105:0/2784377249 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff920000e90 con 0x7ff9380b0780 2021-11-12T05:48:04.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.648+0000 7ff93559a700 1 -- 172.21.2.105:0/2784377249 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff92000fa80 con 0x7ff9380b0780 2021-11-12T05:48:04.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.648+0000 7ff93cfa9700 1 -- 172.21.2.105:0/2784377249 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff9380b0780 msgr2=0x7ff9381434d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:04.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.648+0000 7ff93cfa9700 1 --2- 172.21.2.105:0/2784377249 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff9380b0780 0x7ff9381434d0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7ff920002f70 tx=0x7ff920006e80).stop 2021-11-12T05:48:04.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.648+0000 7ff93cfa9700 1 -- 172.21.2.105:0/2784377249 shutdown_connections 2021-11-12T05:48:04.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.648+0000 7ff93cfa9700 1 --2- 172.21.2.105:0/2784377249 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff9380b0cc0 0x7ff93805f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:04.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.648+0000 7ff93cfa9700 1 --2- 172.21.2.105:0/2784377249 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff9380b0780 0x7ff9381434d0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:04.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.648+0000 7ff93cfa9700 1 -- 172.21.2.105:0/2784377249 >> 172.21.2.105:0/2784377249 conn(0x7ff938068440 msgr2=0x7ff938062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:04.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.648+0000 7ff93cfa9700 1 -- 172.21.2.105:0/2784377249 shutdown_connections 2021-11-12T05:48:04.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.648+0000 7ff93cfa9700 1 -- 172.21.2.105:0/2784377249 wait complete. 2021-11-12T05:48:04.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.652+0000 7ff93cfa9700 1 Processor -- start 2021-11-12T05:48:04.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.652+0000 7ff93cfa9700 1 -- start start 2021-11-12T05:48:04.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.652+0000 7ff93cfa9700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff9380b0780 0x7ff938142030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:04.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.652+0000 7ff93cfa9700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff9380b0cc0 0x7ff938152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:04.663 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.652+0000 7ff93cfa9700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff9380b2940 0x7ff9381454d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:04.663 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.652+0000 7ff93cfa9700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff938152a50 con 0x7ff9380b2940 2021-11-12T05:48:04.663 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.652+0000 7ff93cfa9700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff938152cf0 con 0x7ff9380b0780 2021-11-12T05:48:04.663 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.652+0000 7ff93cfa9700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff938152760 con 0x7ff9380b0cc0 2021-11-12T05:48:04.664 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.652+0000 7ff936d9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff9380b2940 0x7ff9381454d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:04.664 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.652+0000 7ff936d9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff9380b2940 0x7ff9381454d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49554/0 (socket says 172.21.2.105:49554) 2021-11-12T05:48:04.664 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.652+0000 7ff936d9d700 1 -- 172.21.2.105:0/67660168 learned_addr learned my addr 172.21.2.105:0/67660168 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:04.664 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.652+0000 7ff936d9d700 1 -- 172.21.2.105:0/67660168 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff9380b0cc0 msgr2=0x7ff938152270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:04.664 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.652+0000 7ff936d9d700 1 --2- 172.21.2.105:0/67660168 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff9380b0cc0 0x7ff938152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:04.665 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.652+0000 7ff936d9d700 1 -- 172.21.2.105:0/67660168 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff9380b0780 msgr2=0x7ff938142030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:04.665 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.652+0000 7ff936d9d700 1 --2- 172.21.2.105:0/67660168 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff9380b0780 0x7ff938142030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:04.665 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.652+0000 7ff936d9d700 1 -- 172.21.2.105:0/67660168 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff92000c310 con 0x7ff9380b2940 2021-11-12T05:48:04.665 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.652+0000 7ff936d9d700 1 --2- 172.21.2.105:0/67660168 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff9380b2940 0x7ff9381454d0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 rx=0x7ff9300032f0 tx=0x7ff930009220).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:04.666 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.652+0000 7ff92f7fe700 1 -- 172.21.2.105:0/67660168 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff93000d580 con 0x7ff9380b2940 2021-11-12T05:48:04.666 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.652+0000 7ff92f7fe700 1 -- 172.21.2.105:0/67660168 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93000d6e0 con 0x7ff9380b2940 2021-11-12T05:48:04.666 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.652+0000 7ff92f7fe700 1 -- 172.21.2.105:0/67660168 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff93000da40 con 0x7ff9380b2940 2021-11-12T05:48:04.666 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.652+0000 7ff93cfa9700 1 -- 172.21.2.105:0/67660168 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9380a9690 con 0x7ff9380b2940 2021-11-12T05:48:04.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.652+0000 7ff93cfa9700 1 -- 172.21.2.105:0/67660168 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff938141c10 con 0x7ff9380b2940 2021-11-12T05:48:04.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.652+0000 7ff93cfa9700 1 -- 172.21.2.105:0/67660168 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9380b1b20 con 0x7ff9380b2940 2021-11-12T05:48:04.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.652+0000 7ff92f7fe700 1 -- 172.21.2.105:0/67660168 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff93000dba0 con 0x7ff9380b2940 2021-11-12T05:48:04.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.652+0000 7ff92f7fe700 1 --2- 172.21.2.105:0/67660168 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff91c0536f0 0x7ff91c055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:04.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.652+0000 7ff92f7fe700 1 -- 172.21.2.105:0/67660168 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5682+0+0 (secure 0 0 0) 0x7ff93006bc50 con 0x7ff9380b2940 2021-11-12T05:48:04.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.652+0000 7ff93659c700 1 --2- 172.21.2.105:0/67660168 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff91c0536f0 0x7ff91c055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:04.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.652+0000 7ff93659c700 1 --2- 172.21.2.105:0/67660168 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff91c0536f0 0x7ff91c055bb0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7ff9380b2f60 tx=0x7ff928007860).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:04.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.656+0000 7ff92f7fe700 1 -- 172.21.2.105:0/67660168 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff930042e20 con 0x7ff9380b2940 2021-11-12T05:48:04.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.764+0000 7ff93cfa9700 1 -- 172.21.2.105:0/67660168 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff938057350 con 0x7ff9380b2940 2021-11-12T05:48:04.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.764+0000 7ff92f7fe700 1 -- 172.21.2.105:0/67660168 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+1206 (secure 0 0 0) 0x7ff930046440 con 0x7ff9380b2940 2021-11-12T05:48:04.771 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:04.771 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":47,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4751,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/3227424218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":3227424218},{"type":"v1","addr":"172.21.2.115:6833","nonce":3227424218}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":43},{"gid":5113,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.105:6835/673039210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":673039210},{"type":"v1","addr":"172.21.2.105:6835","nonce":673039210}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":47}],"filesystems":[]} 2021-11-12T05:48:04.772 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.768+0000 7ff93cfa9700 1 -- 172.21.2.105:0/67660168 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff91c0536f0 msgr2=0x7ff91c055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:04.772 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.768+0000 7ff93cfa9700 1 --2- 172.21.2.105:0/67660168 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff91c0536f0 0x7ff91c055bb0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7ff9380b2f60 tx=0x7ff928007860).stop 2021-11-12T05:48:04.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.768+0000 7ff93cfa9700 1 -- 172.21.2.105:0/67660168 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff9380b2940 msgr2=0x7ff9381454d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:04.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.768+0000 7ff93cfa9700 1 --2- 172.21.2.105:0/67660168 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff9380b2940 0x7ff9381454d0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 rx=0x7ff9300032f0 tx=0x7ff930009220).stop 2021-11-12T05:48:04.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.768+0000 7ff93cfa9700 1 -- 172.21.2.105:0/67660168 shutdown_connections 2021-11-12T05:48:04.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.768+0000 7ff93cfa9700 1 --2- 172.21.2.105:0/67660168 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff91c0536f0 0x7ff91c055bb0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:04.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.768+0000 7ff93cfa9700 1 --2- 172.21.2.105:0/67660168 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff9380b2940 0x7ff9381454d0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:04.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.768+0000 7ff93cfa9700 1 --2- 172.21.2.105:0/67660168 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff9380b0cc0 0x7ff938152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:04.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.768+0000 7ff93cfa9700 1 --2- 172.21.2.105:0/67660168 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff9380b0780 0x7ff938142030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:04.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.768+0000 7ff93cfa9700 1 -- 172.21.2.105:0/67660168 >> 172.21.2.105:0/67660168 conn(0x7ff938068440 msgr2=0x7ff9380ae9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:04.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.768+0000 7ff93cfa9700 1 -- 172.21.2.105:0/67660168 shutdown_connections 2021-11-12T05:48:04.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.768+0000 7ff93cfa9700 1 -- 172.21.2.105:0/67660168 wait complete. 2021-11-12T05:48:04.775 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 47 2021-11-12T05:48:04.778 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-12T05:48:04.778 INFO:tasks.ceph.mds.a:Stopping old one... 2021-11-12T05:48:04.779 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-12T05:48:04.779 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T05:48:04.779 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-12T05:48:04.780 INFO:tasks.ceph.mds.b:Stopping old one... 2021-11-12T05:48:04.780 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-12T05:48:04.780 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T05:48:04.784 INFO:tasks.ceph.mds.a:Stopped 2021-11-12T05:48:04.785 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-12T05:48:04.786 INFO:tasks.ceph.mds.b:Stopped 2021-11-12T05:48:04.786 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-12T05:48:04.789 INFO:tasks.ceph.mds.b:Started 2021-11-12T05:48:04.789 DEBUG:teuthology.parallel:result is None 2021-11-12T05:48:04.824 INFO:tasks.ceph.mds.b.gibba015.stdout:starting mds.b at 2021-11-12T05:48:04.827 INFO:tasks.ceph.mds.a:Started 2021-11-12T05:48:04.828 DEBUG:teuthology.parallel:result is None 2021-11-12T05:48:04.828 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-11-12T05:48:04.862 INFO:tasks.ceph.mds.a.gibba005.stdout:starting mds.a at 2021-11-12T05:48:04.883 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cca7a4700 1 Processor -- start 2021-11-12T05:48:04.883 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cca7a4700 1 -- start start 2021-11-12T05:48:04.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cca7a4700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f6cc40626b0 0x7f6cc4062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:04.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cca7a4700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6cc40af750 0x7f6cc4130370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:04.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cca7a4700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cc4130d10 con 0x7f6cc4130860 2021-11-12T05:48:04.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cca7a4700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cc40b0d50 con 0x7f6cc40626b0 2021-11-12T05:48:04.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cca7a4700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc40ad380 con 0x7f6cc40af750 2021-11-12T05:48:04.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cc8d41700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f6cc4130860 0x7f6cc414a950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:59966/0 (socket says 172.21.2.105:59966) 2021-11-12T05:48:04.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cc8d41700 1 -- 172.21.2.105:0/3389563814 learned_addr learned my addr 172.21.2.105:0/3389563814 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:04.891 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cc3fff700 1 --2- 172.21.2.105:0/3389563814 >> v2:172.21.2.115:3300/0 conn(0x7f6cc40626b0 0x7f6cc4062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:04.891 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cc2ffd700 1 -- 172.21.2.105:0/3389563814 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3203249927 0 0) 0x7f6cc4130d10 con 0x7f6cc4130860 2021-11-12T05:48:04.891 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cc2ffd700 1 -- 172.21.2.105:0/3389563814 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cb0003260 con 0x7f6cc4130860 2021-11-12T05:48:04.891 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cc37fe700 1 --2- 172.21.2.105:0/3389563814 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6cc40af750 0x7f6cc4130370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:04.891 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cc2ffd700 1 -- 172.21.2.105:0/3389563814 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2986141867 0 0) 0x7f6cb0003260 con 0x7f6cc4130860 2021-11-12T05:48:04.892 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cc2ffd700 1 -- 172.21.2.105:0/3389563814 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6cc40af750 msgr2=0x7f6cc4130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:04.892 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cc2ffd700 1 --2- 172.21.2.105:0/3389563814 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6cc40af750 0x7f6cc4130370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:04.892 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cc2ffd700 1 -- 172.21.2.105:0/3389563814 >> v2:172.21.2.115:3300/0 conn(0x7f6cc40626b0 msgr2=0x7f6cc4062a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:04.892 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cc2ffd700 1 --2- 172.21.2.105:0/3389563814 >> v2:172.21.2.115:3300/0 conn(0x7f6cc40626b0 0x7f6cc4062a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:04.893 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cc2ffd700 1 -- 172.21.2.105:0/3389563814 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc40ae190 con 0x7f6cc4130860 2021-11-12T05:48:04.893 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cc2ffd700 1 -- 172.21.2.105:0/3389563814 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f6cbc0019e0 con 0x7f6cc4130860 2021-11-12T05:48:04.893 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cc37fe700 1 --2- 172.21.2.105:0/3389563814 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6cc40af750 0x7f6cc4130370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:48:04.893 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cc2ffd700 1 -- 172.21.2.105:0/3389563814 >> v1:172.21.2.105:6789/0 conn(0x7f6cc4130860 legacy=0x7f6cc414a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:04.893 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cc2ffd700 1 --2- 172.21.2.105:0/3389563814 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6cb0003750 0x7f6cb0003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:04.894 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cc2ffd700 1 --2- 172.21.2.105:0/3389563814 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6cc40af750 0x7f6cb0004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:04.894 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cc2ffd700 1 --2- 172.21.2.105:0/3389563814 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6cb00049f0 0x7f6cb0004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:04.894 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cc2ffd700 1 -- 172.21.2.105:0/3389563814 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc40b0d50 con 0x7f6cb0003750 2021-11-12T05:48:04.894 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cc2ffd700 1 -- 172.21.2.105:0/3389563814 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc40ad380 con 0x7f6cb00049f0 2021-11-12T05:48:04.895 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cc2ffd700 1 -- 172.21.2.105:0/3389563814 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb000b780 con 0x7f6cc40af750 2021-11-12T05:48:04.895 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cc3fff700 1 --2- 172.21.2.105:0/3389563814 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6cb0003750 0x7f6cb0003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:04.895 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cc8d41700 1 --2- 172.21.2.105:0/3389563814 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6cb00049f0 0x7f6cb0004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:04.895 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cc37fe700 1 --2- 172.21.2.105:0/3389563814 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6cc40af750 0x7f6cb0004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:04.895 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cc3fff700 1 -- 172.21.2.105:0/3389563814 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6cc40af750 msgr2=0x7f6cb0004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:04.896 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cc3fff700 1 --2- 172.21.2.105:0/3389563814 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6cc40af750 0x7f6cb0004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:04.896 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cc3fff700 1 -- 172.21.2.105:0/3389563814 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6cb00049f0 msgr2=0x7f6cb0004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:04.896 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cc3fff700 1 --2- 172.21.2.105:0/3389563814 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6cb00049f0 0x7f6cb0004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:04.896 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cc3fff700 1 -- 172.21.2.105:0/3389563814 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb0003260 con 0x7f6cb0003750 2021-11-12T05:48:04.897 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cc3fff700 1 --2- 172.21.2.105:0/3389563814 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6cb0003750 0x7f6cb0003b70 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 rx=0x7f6cb800a000 tx=0x7f6cb8008040).ready entity=mon.0 client_cookie=de361545e8886ca8 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:04.897 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cc2ffd700 1 -- 172.21.2.105:0/3389563814 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6cb8013670 con 0x7f6cb0003750 2021-11-12T05:48:04.897 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cc2ffd700 1 -- 172.21.2.105:0/3389563814 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb80137d0 con 0x7f6cb0003750 2021-11-12T05:48:04.897 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cc2ffd700 1 -- 172.21.2.105:0/3389563814 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6cb8013b30 con 0x7f6cb0003750 2021-11-12T05:48:04.897 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cca7a4700 1 -- 172.21.2.105:0/3389563814 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6cb0003750 msgr2=0x7f6cb0003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:04.898 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cca7a4700 1 --2- 172.21.2.105:0/3389563814 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6cb0003750 0x7f6cb0003b70 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 rx=0x7f6cb800a000 tx=0x7f6cb8008040).stop 2021-11-12T05:48:04.898 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cc8d41700 1 -- 172.21.2.105:0/3389563814 reap_dead start 2021-11-12T05:48:04.898 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cca7a4700 1 -- 172.21.2.105:0/3389563814 shutdown_connections 2021-11-12T05:48:04.898 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cca7a4700 1 -- 172.21.2.105:0/3389563814 >> 172.21.2.105:0/3389563814 conn(0x7f6cc40b5320 msgr2=0x7f6cc40b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:04.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cca7a4700 1 -- 172.21.2.105:0/3389563814 shutdown_connections 2021-11-12T05:48:04.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cca7a4700 1 -- 172.21.2.105:0/3389563814 wait complete. 2021-11-12T05:48:04.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cca7a4700 1 Processor -- start 2021-11-12T05:48:04.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cca7a4700 1 -- start start 2021-11-12T05:48:04.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cca7a4700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6cb0003750 0x7f6cc4066e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:04.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cca7a4700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6cc4159b90 0x7f6cc415a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:04.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cca7a4700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6cc415a500 0x7f6cc4156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:04.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cca7a4700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc40631f0 con 0x7f6cb0003750 2021-11-12T05:48:04.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cca7a4700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc4063420 con 0x7f6cc4159b90 2021-11-12T05:48:04.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.880+0000 7f6cca7a4700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc40636c0 con 0x7f6cc415a500 2021-11-12T05:48:04.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.884+0000 7f6cc3fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6cb0003750 0x7f6cc4066e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:04.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.884+0000 7f6cc3fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6cb0003750 0x7f6cc4066e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49580/0 (socket says 172.21.2.105:49580) 2021-11-12T05:48:04.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.884+0000 7f6cc3fff700 1 -- 172.21.2.105:0/325346611 learned_addr learned my addr 172.21.2.105:0/325346611 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:04.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.884+0000 7f6cc37fe700 1 --2- 172.21.2.105:0/325346611 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6cc4159b90 0x7f6cc415a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:04.902 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.884+0000 7f6cc3fff700 1 -- 172.21.2.105:0/325346611 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6cc415a500 msgr2=0x7f6cc4156560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:04.902 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.884+0000 7f6cc3fff700 1 --2- 172.21.2.105:0/325346611 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6cc415a500 0x7f6cc4156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:04.902 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.884+0000 7f6cc3fff700 1 -- 172.21.2.105:0/325346611 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6cc4159b90 msgr2=0x7f6cc415a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:04.902 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.884+0000 7f6cc3fff700 1 --2- 172.21.2.105:0/325346611 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6cc4159b90 0x7f6cc415a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:04.903 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.884+0000 7f6cc3fff700 1 -- 172.21.2.105:0/325346611 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc4063960 con 0x7f6cb0003750 2021-11-12T05:48:04.903 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.884+0000 7f6cc3fff700 1 --2- 172.21.2.105:0/325346611 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6cb0003750 0x7f6cc4066e20 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7f6cb800a000 tx=0x7f6cb8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:04.903 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.884+0000 7f6cc17fa700 1 -- 172.21.2.105:0/325346611 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6cb800b180 con 0x7f6cb0003750 2021-11-12T05:48:04.903 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.884+0000 7f6cc17fa700 1 -- 172.21.2.105:0/325346611 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb8000e90 con 0x7f6cb0003750 2021-11-12T05:48:04.903 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.884+0000 7f6cca7a4700 1 -- 172.21.2.105:0/325346611 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cc415a980 con 0x7f6cb0003750 2021-11-12T05:48:04.904 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.884+0000 7f6cc17fa700 1 -- 172.21.2.105:0/325346611 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6cb801d600 con 0x7f6cb0003750 2021-11-12T05:48:04.904 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.884+0000 7f6cca7a4700 1 -- 172.21.2.105:0/325346611 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cc4144e90 con 0x7f6cb0003750 2021-11-12T05:48:04.904 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.884+0000 7f6cca7a4700 1 -- 172.21.2.105:0/325346611 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cc4063af0 con 0x7f6cb0003750 2021-11-12T05:48:04.904 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.884+0000 7f6cc17fa700 1 -- 172.21.2.105:0/325346611 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6cb801d760 con 0x7f6cb0003750 2021-11-12T05:48:04.905 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.884+0000 7f6cc17fa700 1 --2- 172.21.2.105:0/325346611 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6ca40535b0 0x7f6ca4055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:04.905 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.884+0000 7f6cc17fa700 1 -- 172.21.2.105:0/325346611 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f6cb806d1c0 con 0x7f6cb0003750 2021-11-12T05:48:04.905 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.884+0000 7f6cc37fe700 1 --2- 172.21.2.105:0/325346611 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6ca40535b0 0x7f6ca4055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:04.905 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.884+0000 7f6cc37fe700 1 --2- 172.21.2.105:0/325346611 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6ca40535b0 0x7f6ca4055a70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f6cb400c000 tx=0x7f6cb4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:04.906 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.884+0000 7f6cc17fa700 1 -- 172.21.2.105:0/325346611 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6cb8044440 con 0x7f6cb0003750 2021-11-12T05:48:04.984 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:04.980+0000 7f6cca7a4700 1 -- 172.21.2.105:0/325346611 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f6cc4057350 con 0x7f6cb0003750 2021-11-12T05:48:05.931 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.928+0000 7f6cc17fa700 1 -- 172.21.2.105:0/325346611 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v103) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6cb8012e60 con 0x7f6cb0003750 2021-11-12T05:48:05.933 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.928+0000 7f6cca7a4700 1 -- 172.21.2.105:0/325346611 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6ca40535b0 msgr2=0x7f6ca4055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:05.934 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.928+0000 7f6cca7a4700 1 --2- 172.21.2.105:0/325346611 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6ca40535b0 0x7f6ca4055a70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f6cb400c000 tx=0x7f6cb4008040).stop 2021-11-12T05:48:05.934 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.928+0000 7f6cca7a4700 1 -- 172.21.2.105:0/325346611 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6cb0003750 msgr2=0x7f6cc4066e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:05.934 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.928+0000 7f6cca7a4700 1 --2- 172.21.2.105:0/325346611 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6cb0003750 0x7f6cc4066e20 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7f6cb800a000 tx=0x7f6cb8008040).stop 2021-11-12T05:48:05.934 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.928+0000 7f6cca7a4700 1 -- 172.21.2.105:0/325346611 shutdown_connections 2021-11-12T05:48:05.935 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.928+0000 7f6cca7a4700 1 --2- 172.21.2.105:0/325346611 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6ca40535b0 0x7f6ca4055a70 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:05.935 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.928+0000 7f6cca7a4700 1 --2- 172.21.2.105:0/325346611 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6cc415a500 0x7f6cc4156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:05.935 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.928+0000 7f6cca7a4700 1 --2- 172.21.2.105:0/325346611 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6cc4159b90 0x7f6cc415a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:05.935 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.928+0000 7f6cca7a4700 1 --2- 172.21.2.105:0/325346611 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6cb0003750 0x7f6cc4066e20 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:05.935 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.928+0000 7f6cca7a4700 1 -- 172.21.2.105:0/325346611 >> 172.21.2.105:0/325346611 conn(0x7f6cc40b5320 msgr2=0x7f6cc40b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:05.936 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.928+0000 7f6cca7a4700 1 -- 172.21.2.105:0/325346611 shutdown_connections 2021-11-12T05:48:05.936 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.928+0000 7f6cca7a4700 1 -- 172.21.2.105:0/325346611 wait complete. 2021-11-12T05:48:05.936 INFO:teuthology.orchestra.run.gibba005.stderr: removed all blacklist entries 2021-11-12T05:48:05.940 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-11-12T05:48:05.940 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-11-12T05:48:05.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04e6319700 1 Processor -- start 2021-11-12T05:48:05.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04e6319700 1 -- start start 2021-11-12T05:48:05.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04e6319700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f04e00626b0 0x7f04e0062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:05.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04e6319700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f04e00af750 0x7f04e0130370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:05.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04e6319700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e0130d10 con 0x7f04e0130860 2021-11-12T05:48:05.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04e6319700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e00b0d50 con 0x7f04e00626b0 2021-11-12T05:48:05.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04e6319700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e00ad380 con 0x7f04e00af750 2021-11-12T05:48:05.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04e48b6700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f04e0130860 0x7f04e014a950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:59990/0 (socket says 172.21.2.105:59990) 2021-11-12T05:48:05.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04e48b6700 1 -- 172.21.2.105:0/868144928 learned_addr learned my addr 172.21.2.105:0/868144928 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:05.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04deffd700 1 -- 172.21.2.105:0/868144928 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1748555967 0 0) 0x7f04e0130d10 con 0x7f04e0130860 2021-11-12T05:48:06.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04deffd700 1 -- 172.21.2.105:0/868144928 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04c0003260 con 0x7f04e0130860 2021-11-12T05:48:06.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04df7fe700 1 --2- 172.21.2.105:0/868144928 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f04e00af750 0x7f04e0130370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:06.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04dffff700 1 --2- 172.21.2.105:0/868144928 >> v2:172.21.2.115:3300/0 conn(0x7f04e00626b0 0x7f04e0062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:06.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04deffd700 1 -- 172.21.2.105:0/868144928 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1425634589 0 0) 0x7f04c0003260 con 0x7f04e0130860 2021-11-12T05:48:06.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04deffd700 1 -- 172.21.2.105:0/868144928 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f04e00af750 msgr2=0x7f04e0130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:06.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04deffd700 1 --2- 172.21.2.105:0/868144928 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f04e00af750 0x7f04e0130370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:06.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04deffd700 1 -- 172.21.2.105:0/868144928 >> v2:172.21.2.115:3300/0 conn(0x7f04e00626b0 msgr2=0x7f04e0062a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:06.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04deffd700 1 --2- 172.21.2.105:0/868144928 >> v2:172.21.2.115:3300/0 conn(0x7f04e00626b0 0x7f04e0062a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:06.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04deffd700 1 -- 172.21.2.105:0/868144928 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e00ae190 con 0x7f04e0130860 2021-11-12T05:48:06.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04deffd700 1 -- 172.21.2.105:0/868144928 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f04d80019e0 con 0x7f04e0130860 2021-11-12T05:48:06.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04deffd700 1 -- 172.21.2.105:0/868144928 >> v1:172.21.2.105:6789/0 conn(0x7f04e0130860 legacy=0x7f04e014a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:06.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04deffd700 1 --2- 172.21.2.105:0/868144928 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04c00037d0 0x7f04c0003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04deffd700 1 --2- 172.21.2.105:0/868144928 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f04e00af750 0x7f04c0004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04deffd700 1 --2- 172.21.2.105:0/868144928 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f04c00049f0 0x7f04c0004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04deffd700 1 -- 172.21.2.105:0/868144928 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e00b0d50 con 0x7f04c00037d0 2021-11-12T05:48:06.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04deffd700 1 -- 172.21.2.105:0/868144928 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e00ad380 con 0x7f04c00049f0 2021-11-12T05:48:06.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04deffd700 1 -- 172.21.2.105:0/868144928 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c000b750 con 0x7f04e00af750 2021-11-12T05:48:06.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04dffff700 1 --2- 172.21.2.105:0/868144928 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04c00037d0 0x7f04c0003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:06.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04e48b6700 1 --2- 172.21.2.105:0/868144928 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f04c00049f0 0x7f04c0004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:06.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04df7fe700 1 --2- 172.21.2.105:0/868144928 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f04e00af750 0x7f04c0004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:06.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04dffff700 1 -- 172.21.2.105:0/868144928 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f04e00af750 msgr2=0x7f04c0004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:06.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04dffff700 1 --2- 172.21.2.105:0/868144928 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f04e00af750 0x7f04c0004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:06.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04dffff700 1 -- 172.21.2.105:0/868144928 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f04c00049f0 msgr2=0x7f04c0004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:06.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04dffff700 1 --2- 172.21.2.105:0/868144928 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f04c00049f0 0x7f04c0004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:06.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04dffff700 1 -- 172.21.2.105:0/868144928 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c0003260 con 0x7f04c00037d0 2021-11-12T05:48:06.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04df7fe700 1 --2- 172.21.2.105:0/868144928 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f04e00af750 0x7f04c0004500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:48:06.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04dffff700 1 --2- 172.21.2.105:0/868144928 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04c00037d0 0x7f04c0003bf0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 rx=0x7f04c800c000 tx=0x7f04c8006df0).ready entity=mon.0 client_cookie=e7a8696da4a541e9 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:06.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04deffd700 1 -- 172.21.2.105:0/868144928 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04c800e830 con 0x7f04c00037d0 2021-11-12T05:48:06.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04deffd700 1 -- 172.21.2.105:0/868144928 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c800e990 con 0x7f04c00037d0 2021-11-12T05:48:06.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04deffd700 1 -- 172.21.2.105:0/868144928 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04c800ecf0 con 0x7f04c00037d0 2021-11-12T05:48:06.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04e6319700 1 -- 172.21.2.105:0/868144928 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04c00037d0 msgr2=0x7f04c0003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:06.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04e6319700 1 --2- 172.21.2.105:0/868144928 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04c00037d0 0x7f04c0003bf0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 rx=0x7f04c800c000 tx=0x7f04c8006df0).stop 2021-11-12T05:48:06.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04e48b6700 1 -- 172.21.2.105:0/868144928 reap_dead start 2021-11-12T05:48:06.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04e6319700 1 -- 172.21.2.105:0/868144928 shutdown_connections 2021-11-12T05:48:06.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04e6319700 1 -- 172.21.2.105:0/868144928 >> 172.21.2.105:0/868144928 conn(0x7f04e00b5320 msgr2=0x7f04e00b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:06.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04e6319700 1 -- 172.21.2.105:0/868144928 shutdown_connections 2021-11-12T05:48:06.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.988+0000 7f04e6319700 1 -- 172.21.2.105:0/868144928 wait complete. 2021-11-12T05:48:06.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.992+0000 7f04e6319700 1 Processor -- start 2021-11-12T05:48:06.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.992+0000 7f04e6319700 1 -- start start 2021-11-12T05:48:06.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.992+0000 7f04e6319700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f04c00037d0 0x7f04e0148920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.992+0000 7f04e6319700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04e015a2f0 0x7f04e00666e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.992+0000 7f04e6319700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f04e0066bd0 0x7f04e0144430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.992+0000 7f04e6319700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e0064110 con 0x7f04e015a2f0 2021-11-12T05:48:06.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.992+0000 7f04e6319700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e0063250 con 0x7f04c00037d0 2021-11-12T05:48:06.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.992+0000 7f04e6319700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e0062fb0 con 0x7f04e0066bd0 2021-11-12T05:48:06.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.992+0000 7f04df7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04e015a2f0 0x7f04e00666e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:06.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.992+0000 7f04df7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04e015a2f0 0x7f04e00666e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49604/0 (socket says 172.21.2.105:49604) 2021-11-12T05:48:06.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.992+0000 7f04df7fe700 1 -- 172.21.2.105:0/1501829999 learned_addr learned my addr 172.21.2.105:0/1501829999 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:06.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.992+0000 7f04dffff700 1 --2- 172.21.2.105:0/1501829999 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f04c00037d0 0x7f04e0148920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:06.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.992+0000 7f04e48b6700 1 --2- 172.21.2.105:0/1501829999 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f04e0066bd0 0x7f04e0144430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:06.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.992+0000 7f04df7fe700 1 -- 172.21.2.105:0/1501829999 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f04e0066bd0 msgr2=0x7f04e0144430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:06.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.992+0000 7f04df7fe700 1 --2- 172.21.2.105:0/1501829999 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f04e0066bd0 0x7f04e0144430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:06.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.992+0000 7f04df7fe700 1 -- 172.21.2.105:0/1501829999 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f04c00037d0 msgr2=0x7f04e0148920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:06.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.992+0000 7f04df7fe700 1 --2- 172.21.2.105:0/1501829999 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f04c00037d0 0x7f04e0148920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:06.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.992+0000 7f04df7fe700 1 -- 172.21.2.105:0/1501829999 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e0063e70 con 0x7f04e015a2f0 2021-11-12T05:48:06.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.992+0000 7f04df7fe700 1 --2- 172.21.2.105:0/1501829999 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04e015a2f0 0x7f04e00666e0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7f04d000b000 tx=0x7f04d0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:06.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.992+0000 7f04dd7fa700 1 -- 172.21.2.105:0/1501829999 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04d0012610 con 0x7f04e015a2f0 2021-11-12T05:48:06.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.992+0000 7f04dd7fa700 1 -- 172.21.2.105:0/1501829999 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d0012770 con 0x7f04e015a2f0 2021-11-12T05:48:06.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.992+0000 7f04e6319700 1 -- 172.21.2.105:0/1501829999 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04e0148e10 con 0x7f04e015a2f0 2021-11-12T05:48:06.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.992+0000 7f04e6319700 1 -- 172.21.2.105:0/1501829999 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e0067050 con 0x7f04e015a2f0 2021-11-12T05:48:06.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.992+0000 7f04dd7fa700 1 -- 172.21.2.105:0/1501829999 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04d0012ad0 con 0x7f04e015a2f0 2021-11-12T05:48:06.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.992+0000 7f04e6319700 1 -- 172.21.2.105:0/1501829999 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04e0057350 con 0x7f04e015a2f0 2021-11-12T05:48:06.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.992+0000 7f04dd7fa700 1 -- 172.21.2.105:0/1501829999 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f04d0012c30 con 0x7f04e015a2f0 2021-11-12T05:48:06.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.992+0000 7f04dd7fa700 1 --2- 172.21.2.105:0/1501829999 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f04c40534f0 0x7f04c40559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.992+0000 7f04dd7fa700 1 -- 172.21.2.105:0/1501829999 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f04d006c150 con 0x7f04e015a2f0 2021-11-12T05:48:06.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.992+0000 7f04dffff700 1 --2- 172.21.2.105:0/1501829999 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f04c40534f0 0x7f04c40559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:06.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.992+0000 7f04dffff700 1 --2- 172.21.2.105:0/1501829999 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f04c40534f0 0x7f04c40559b0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f04c801c000 tx=0x7f04c8019000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:06.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:05.996+0000 7f04dd7fa700 1 -- 172.21.2.105:0/1501829999 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f04d00433f0 con 0x7f04e015a2f0 2021-11-12T05:48:06.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.108+0000 7f04e6319700 1 -- 172.21.2.105:0/1501829999 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f04e0067450 con 0x7f04e015a2f0 2021-11-12T05:48:06.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.108+0000 7f04dd7fa700 1 -- 172.21.2.105:0/1501829999 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v33) v1 ==== 80+0+4242 (secure 0 0 0) 0x7f04d0046a10 con 0x7f04e015a2f0 2021-11-12T05:48:06.114 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:06.114 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:48:06.114 INFO:teuthology.orchestra.run.gibba005.stdout: "auth_dump": [ 2021-11-12T05:48:06.115 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:06.115 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mds.a", 2021-11-12T05:48:06.115 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1hGVLeOhAAX2029T+USC1Um93TSzjxdA==", 2021-11-12T05:48:06.115 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:48:06.115 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:48:06.116 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:48:06.116 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:48:06.116 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:48:06.116 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:06.117 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:06.117 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:06.117 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mds.b", 2021-11-12T05:48:06.117 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hiebUAxAAGcjDAGyvecjzagGoRBX8tg==", 2021-11-12T05:48:06.118 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:48:06.118 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:48:06.118 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:48:06.118 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:48:06.118 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:48:06.119 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:06.119 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:06.119 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:06.119 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.0", 2021-11-12T05:48:06.120 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1ht05fORAAN2YrbsxBau1FQC4C8Dvb3g==", 2021-11-12T05:48:06.120 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:48:06.120 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:48:06.120 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:48:06.120 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:48:06.121 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:06.121 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:06.121 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:06.122 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.1", 2021-11-12T05:48:06.122 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAu/o1hzp1vGhAAQ6u3Npb+yNGlNOUdoHzFZA==", 2021-11-12T05:48:06.122 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:48:06.122 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:48:06.123 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:48:06.123 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:48:06.123 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:06.123 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:06.123 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:06.124 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.2", 2021-11-12T05:48:06.124 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAw/o1hHWwOOhAAx7txWG8rbch18+SBnJkfkQ==", 2021-11-12T05:48:06.124 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:48:06.124 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:48:06.124 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:48:06.125 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:48:06.125 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:06.125 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:06.125 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:06.126 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.3", 2021-11-12T05:48:06.126 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAz/o1howZpHxAAKgUVxU2tSNZbxW+6OfJF9g==", 2021-11-12T05:48:06.126 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:48:06.126 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:48:06.126 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:48:06.127 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:48:06.127 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:06.127 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:06.127 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:06.128 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.4", 2021-11-12T05:48:06.128 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA2/o1humA5KRAAVbO6UYLOBQDq3WiEkkS6xw==", 2021-11-12T05:48:06.128 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:48:06.128 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:48:06.128 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:48:06.129 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:48:06.129 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:06.129 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:06.129 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:06.129 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.5", 2021-11-12T05:48:06.130 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA5/o1hALdKDRAAR9nsaDOo9GUgpmBPHVp5HQ==", 2021-11-12T05:48:06.130 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:48:06.130 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:48:06.130 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:48:06.131 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:48:06.131 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:06.131 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:06.131 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:06.131 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.6", 2021-11-12T05:48:06.132 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA7/o1hCVP2KhAAHj5SxnJ81mKrJOg2CE2wLQ==", 2021-11-12T05:48:06.132 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:48:06.132 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:48:06.132 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:48:06.132 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:48:06.133 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:06.133 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:06.133 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:06.133 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.7", 2021-11-12T05:48:06.134 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA+/o1hWCEqEBAAv8nF9NeF2Ue5W8Ijj8Skgg==", 2021-11-12T05:48:06.134 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:48:06.134 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:48:06.134 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:48:06.134 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:48:06.135 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:06.135 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:06.135 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:06.135 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.0", 2021-11-12T05:48:06.136 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hzEzhCBAATF8giEBtrj13SAr5EJV4TA==", 2021-11-12T05:48:06.136 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:48:06.136 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:48:06.136 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow r", 2021-11-12T05:48:06.136 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-12T05:48:06.137 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:06.137 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:06.137 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:06.137 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.1", 2021-11-12T05:48:06.137 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hO6zfCxAAae1obagtpsnA9e8FlTExVA==", 2021-11-12T05:48:06.138 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:48:06.138 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:48:06.138 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow r", 2021-11-12T05:48:06.138 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-12T05:48:06.139 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:06.139 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:06.139 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:06.139 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.2", 2021-11-12T05:48:06.139 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hFYDGDhAAyz77VXKtOz86ztJ8FUIvAg==", 2021-11-12T05:48:06.140 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:48:06.140 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:48:06.140 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow r", 2021-11-12T05:48:06.140 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-12T05:48:06.141 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:06.141 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:06.141 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:06.141 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.admin", 2021-11-12T05:48:06.141 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1hwdoBHRAAUHHEU3dbyso2BnE/JppV8A==", 2021-11-12T05:48:06.142 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:48:06.142 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow *", 2021-11-12T05:48:06.142 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:48:06.142 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:48:06.142 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:48:06.143 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:06.143 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:06.143 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:06.143 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mgr.x", 2021-11-12T05:48:06.144 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1h6JBaORAAbgxQtCzGNj7MLfgwGd4cWA==", 2021-11-12T05:48:06.144 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:48:06.144 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow *", 2021-11-12T05:48:06.144 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow profile mgr", 2021-11-12T05:48:06.144 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:48:06.145 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:06.145 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:06.145 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:06.145 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mgr.y", 2021-11-12T05:48:06.145 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1hwfvvNRAASU7NmYBG/Yb6/ma1/Ew7mw==", 2021-11-12T05:48:06.146 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:48:06.146 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow *", 2021-11-12T05:48:06.146 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow profile mgr", 2021-11-12T05:48:06.146 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:48:06.147 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:06.147 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:06.147 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:06.147 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:48:06.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.108+0000 7f04e6319700 1 -- 172.21.2.105:0/1501829999 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f04c40534f0 msgr2=0x7f04c40559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:06.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.108+0000 7f04e6319700 1 --2- 172.21.2.105:0/1501829999 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f04c40534f0 0x7f04c40559b0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f04c801c000 tx=0x7f04c8019000).stop 2021-11-12T05:48:06.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.108+0000 7f04e6319700 1 -- 172.21.2.105:0/1501829999 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04e015a2f0 msgr2=0x7f04e00666e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:06.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.108+0000 7f04e6319700 1 --2- 172.21.2.105:0/1501829999 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04e015a2f0 0x7f04e00666e0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7f04d000b000 tx=0x7f04d0008040).stop 2021-11-12T05:48:06.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.108+0000 7f04e6319700 1 -- 172.21.2.105:0/1501829999 shutdown_connections 2021-11-12T05:48:06.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.108+0000 7f04e6319700 1 --2- 172.21.2.105:0/1501829999 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f04c40534f0 0x7f04c40559b0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:06.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.108+0000 7f04e6319700 1 --2- 172.21.2.105:0/1501829999 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f04e0066bd0 0x7f04e0144430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:06.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.108+0000 7f04e6319700 1 --2- 172.21.2.105:0/1501829999 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04e015a2f0 0x7f04e00666e0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:06.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.108+0000 7f04e6319700 1 --2- 172.21.2.105:0/1501829999 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f04c00037d0 0x7f04e0148920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:06.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.108+0000 7f04e6319700 1 -- 172.21.2.105:0/1501829999 >> 172.21.2.105:0/1501829999 conn(0x7f04e00b5320 msgr2=0x7f04e00b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:06.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.108+0000 7f04e6319700 1 -- 172.21.2.105:0/1501829999 shutdown_connections 2021-11-12T05:48:06.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.108+0000 7f04e6319700 1 -- 172.21.2.105:0/1501829999 wait complete. 2021-11-12T05:48:06.152 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:48:06.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.196+0000 7fe18e59f700 1 Processor -- start 2021-11-12T05:48:06.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.196+0000 7fe18e59f700 1 -- start start 2021-11-12T05:48:06.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe18e59f700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fe1880ad080 0x7fe1880af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe18e59f700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe1880ac280 0x7fe1880ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe18e59f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe18814abe0 0x7fe18814b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe18e59f700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1881488a0 con 0x7fe1880ac280 2021-11-12T05:48:06.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe18e59f700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1880ac7b0 con 0x7fe1880ad080 2021-11-12T05:48:06.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe18e59f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1880ac9e0 con 0x7fe18814abe0 2021-11-12T05:48:06.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe1877fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe1880ac280 0x7fe1880ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:06.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe1877fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe1880ac280 0x7fe1880ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49614/0 (socket says 172.21.2.105:49614) 2021-11-12T05:48:06.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe1877fe700 1 -- 172.21.2.105:0/3588881294 learned_addr learned my addr 172.21.2.105:0/3588881294 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:06.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe1877fe700 1 -- 172.21.2.105:0/3588881294 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe18814abe0 msgr2=0x7fe18814b090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:48:06.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe1877fe700 1 --2- 172.21.2.105:0/3588881294 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe18814abe0 0x7fe18814b090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:06.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe1877fe700 1 -- 172.21.2.105:0/3588881294 >> v2:172.21.2.115:3300/0 conn(0x7fe1880ad080 msgr2=0x7fe1880af730 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:48:06.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe1877fe700 1 --2- 172.21.2.105:0/3588881294 >> v2:172.21.2.115:3300/0 conn(0x7fe1880ad080 0x7fe1880af730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:06.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe1877fe700 1 -- 172.21.2.105:0/3588881294 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1880b0b30 con 0x7fe1880ac280 2021-11-12T05:48:06.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe1877fe700 1 --2- 172.21.2.105:0/3588881294 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe1880ac280 0x7fe1880ad460 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 rx=0x7fe1880ac6a0 tx=0x7fe170006eb0).ready entity=mon.0 client_cookie=b19a72dc5f6ecc9b server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:06.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe186ffd700 1 -- 172.21.2.105:0/3588881294 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe17000d570 con 0x7fe1880ac280 2021-11-12T05:48:06.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe186ffd700 1 -- 172.21.2.105:0/3588881294 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe170000e90 con 0x7fe1880ac280 2021-11-12T05:48:06.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe186ffd700 1 -- 172.21.2.105:0/3588881294 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe17000d8c0 con 0x7fe1880ac280 2021-11-12T05:48:06.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe18e59f700 1 -- 172.21.2.105:0/3588881294 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe1880ac280 msgr2=0x7fe1880ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:06.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe18e59f700 1 --2- 172.21.2.105:0/3588881294 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe1880ac280 0x7fe1880ad460 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 rx=0x7fe1880ac6a0 tx=0x7fe170006eb0).stop 2021-11-12T05:48:06.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe18e59f700 1 -- 172.21.2.105:0/3588881294 shutdown_connections 2021-11-12T05:48:06.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe18e59f700 1 --2- 172.21.2.105:0/3588881294 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe18814abe0 0x7fe18814b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:06.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe18e59f700 1 --2- 172.21.2.105:0/3588881294 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe1880ac280 0x7fe1880ad460 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:06.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe18e59f700 1 --2- 172.21.2.105:0/3588881294 >> v2:172.21.2.115:3300/0 conn(0x7fe1880ad080 0x7fe1880af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:06.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe18e59f700 1 -- 172.21.2.105:0/3588881294 >> 172.21.2.105:0/3588881294 conn(0x7fe1880b5370 msgr2=0x7fe1880b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:06.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe18e59f700 1 -- 172.21.2.105:0/3588881294 shutdown_connections 2021-11-12T05:48:06.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe18e59f700 1 -- 172.21.2.105:0/3588881294 wait complete. 2021-11-12T05:48:06.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe18e59f700 1 Processor -- start 2021-11-12T05:48:06.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe18e59f700 1 -- start start 2021-11-12T05:48:06.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe18e59f700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe1880ac280 0x7fe1880aab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe18e59f700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe1880ad080 0x7fe188063fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe18e59f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe18814abe0 0x7fe1880ab3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe18e59f700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1880a95a0 con 0x7fe1880ac280 2021-11-12T05:48:06.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe18e59f700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1880aba40 con 0x7fe1880ad080 2021-11-12T05:48:06.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe18e59f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1880abce0 con 0x7fe18814abe0 2021-11-12T05:48:06.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe187fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe1880ac280 0x7fe1880aab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:06.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe187fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe1880ac280 0x7fe1880aab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49618/0 (socket says 172.21.2.105:49618) 2021-11-12T05:48:06.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe187fff700 1 -- 172.21.2.105:0/4067598734 learned_addr learned my addr 172.21.2.105:0/4067598734 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:06.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe187fff700 1 -- 172.21.2.105:0/4067598734 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe18814abe0 msgr2=0x7fe1880ab3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:06.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe187fff700 1 --2- 172.21.2.105:0/4067598734 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe18814abe0 0x7fe1880ab3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:06.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe187fff700 1 -- 172.21.2.105:0/4067598734 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe1880ad080 msgr2=0x7fe188063fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:06.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe187fff700 1 --2- 172.21.2.105:0/4067598734 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe1880ad080 0x7fe188063fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:06.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe187fff700 1 -- 172.21.2.105:0/4067598734 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17000b1e0 con 0x7fe1880ac280 2021-11-12T05:48:06.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe187fff700 1 --2- 172.21.2.105:0/4067598734 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe1880ac280 0x7fe1880aab20 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7fe178002fb0 tx=0x7fe178006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:06.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe1857fa700 1 -- 172.21.2.105:0/4067598734 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe178013460 con 0x7fe1880ac280 2021-11-12T05:48:06.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe1857fa700 1 -- 172.21.2.105:0/4067598734 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1780135c0 con 0x7fe1880ac280 2021-11-12T05:48:06.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe18e59f700 1 -- 172.21.2.105:0/4067598734 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1880a99d0 con 0x7fe1880ac280 2021-11-12T05:48:06.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe1857fa700 1 -- 172.21.2.105:0/4067598734 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe178013920 con 0x7fe1880ac280 2021-11-12T05:48:06.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.200+0000 7fe18e59f700 1 -- 172.21.2.105:0/4067598734 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe188157130 con 0x7fe1880ac280 2021-11-12T05:48:06.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.204+0000 7fe18e59f700 1 -- 172.21.2.105:0/4067598734 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe18814b580 con 0x7fe1880ac280 2021-11-12T05:48:06.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.204+0000 7fe1857fa700 1 -- 172.21.2.105:0/4067598734 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe17800f070 con 0x7fe1880ac280 2021-11-12T05:48:06.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.204+0000 7fe1857fa700 1 --2- 172.21.2.105:0/4067598734 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe16c053610 0x7fe16c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.204+0000 7fe1857fa700 1 -- 172.21.2.105:0/4067598734 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fe17806b290 con 0x7fe1880ac280 2021-11-12T05:48:06.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.204+0000 7fe1877fe700 1 --2- 172.21.2.105:0/4067598734 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe16c053610 0x7fe16c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:06.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.204+0000 7fe1877fe700 1 --2- 172.21.2.105:0/4067598734 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe16c053610 0x7fe16c055ad0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7fe1880ac6a0 tx=0x7fe170015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:06.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.204+0000 7fe1857fa700 1 -- 172.21.2.105:0/4067598734 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe1780424c0 con 0x7fe1880ac280 2021-11-12T05:48:06.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.292+0000 7fe18e59f700 1 -- 172.21.2.105:0/4067598734 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe188057350 con 0x7fe1880ac280 2021-11-12T05:48:06.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.292+0000 7fe1857fa700 1 -- 172.21.2.105:0/4067598734 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) v1 ==== 74+0+13416 (secure 0 0 0) 0x7fe178045ae0 con 0x7fe1880ac280 2021-11-12T05:48:06.296 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:06.297 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":103,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:48:05.919863+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:48:06.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.292+0000 7fe18e59f700 1 -- 172.21.2.105:0/4067598734 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe16c053610 msgr2=0x7fe16c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:06.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.292+0000 7fe18e59f700 1 --2- 172.21.2.105:0/4067598734 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe16c053610 0x7fe16c055ad0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7fe1880ac6a0 tx=0x7fe170015000).stop 2021-11-12T05:48:06.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.292+0000 7fe18e59f700 1 -- 172.21.2.105:0/4067598734 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe1880ac280 msgr2=0x7fe1880aab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:06.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.292+0000 7fe18e59f700 1 --2- 172.21.2.105:0/4067598734 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe1880ac280 0x7fe1880aab20 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7fe178002fb0 tx=0x7fe178006df0).stop 2021-11-12T05:48:06.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.292+0000 7fe18e59f700 1 -- 172.21.2.105:0/4067598734 shutdown_connections 2021-11-12T05:48:06.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.292+0000 7fe18e59f700 1 --2- 172.21.2.105:0/4067598734 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe16c053610 0x7fe16c055ad0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:06.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.292+0000 7fe18e59f700 1 --2- 172.21.2.105:0/4067598734 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe18814abe0 0x7fe1880ab3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:06.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.292+0000 7fe18e59f700 1 --2- 172.21.2.105:0/4067598734 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe1880ad080 0x7fe188063fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:06.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.292+0000 7fe18e59f700 1 --2- 172.21.2.105:0/4067598734 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe1880ac280 0x7fe1880aab20 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:06.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.292+0000 7fe18e59f700 1 -- 172.21.2.105:0/4067598734 >> 172.21.2.105:0/4067598734 conn(0x7fe1880b5370 msgr2=0x7fe1881444a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:06.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.292+0000 7fe18e59f700 1 -- 172.21.2.105:0/4067598734 shutdown_connections 2021-11-12T05:48:06.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.292+0000 7fe18e59f700 1 -- 172.21.2.105:0/4067598734 wait complete. 2021-11-12T05:48:06.304 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-12T05:48:06.305 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:48:06.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.352+0000 7f0f8aa90700 1 Processor -- start 2021-11-12T05:48:06.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.352+0000 7f0f8aa90700 1 -- start start 2021-11-12T05:48:06.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8aa90700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f0f840ace20 0x7f0f840b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8aa90700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f840b1840 con 0x7f0f840aca40 2021-11-12T05:48:06.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8aa90700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f840af2b0 con 0x7f0f84144180 2021-11-12T05:48:06.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8aa90700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f840b0a10 con 0x7f0f840ace20 2021-11-12T05:48:06.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8882c700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f0f840aca40 0x7f0f841473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60020/0 (socket says 172.21.2.105:60020) 2021-11-12T05:48:06.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8882c700 1 -- 172.21.2.105:0/1902375982 learned_addr learned my addr 172.21.2.105:0/1902375982 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:06.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f837fe700 1 -- 172.21.2.105:0/1902375982 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1389204612 0 0) 0x7f0f840b1840 con 0x7f0f840aca40 2021-11-12T05:48:06.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f837fe700 1 -- 172.21.2.105:0/1902375982 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f64003260 con 0x7f0f840aca40 2021-11-12T05:48:06.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f83fff700 1 --2- 172.21.2.105:0/1902375982 >> v2:172.21.2.115:3300/0 conn(0x7f0f840ace20 0x7f0f840b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:06.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f837fe700 1 -- 172.21.2.105:0/1902375982 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2731556885 0 0) 0x7f0f64003260 con 0x7f0f840aca40 2021-11-12T05:48:06.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f837fe700 1 -- 172.21.2.105:0/1902375982 >> v2:172.21.2.115:3300/0 conn(0x7f0f840ace20 msgr2=0x7f0f840b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:06.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f837fe700 1 --2- 172.21.2.105:0/1902375982 >> v2:172.21.2.115:3300/0 conn(0x7f0f840ace20 0x7f0f840b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:06.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f837fe700 1 -- 172.21.2.105:0/1902375982 >> v1:172.21.2.115:6789/0 conn(0x7f0f84144180 legacy=0x7f0f841445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:06.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f837fe700 1 -- 172.21.2.105:0/1902375982 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f840b1a70 con 0x7f0f840aca40 2021-11-12T05:48:06.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f837fe700 1 -- 172.21.2.105:0/1902375982 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f0f6c001660 con 0x7f0f840aca40 2021-11-12T05:48:06.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f837fe700 1 -- 172.21.2.105:0/1902375982 >> v1:172.21.2.105:6789/0 conn(0x7f0f840aca40 legacy=0x7f0f841473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:06.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f837fe700 1 --2- 172.21.2.105:0/1902375982 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0f64003820 0x7f0f64003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f837fe700 1 --2- 172.21.2.105:0/1902375982 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0f64004500 0x7f0f64004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f837fe700 1 --2- 172.21.2.105:0/1902375982 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0f64004f70 0x7f0f6400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f837fe700 1 -- 172.21.2.105:0/1902375982 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f840b0a10 con 0x7f0f64003820 2021-11-12T05:48:06.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f837fe700 1 -- 172.21.2.105:0/1902375982 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6400be50 con 0x7f0f64004500 2021-11-12T05:48:06.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f837fe700 1 -- 172.21.2.105:0/1902375982 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6400c010 con 0x7f0f64004f70 2021-11-12T05:48:06.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8882c700 1 --2- 172.21.2.105:0/1902375982 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0f64003820 0x7f0f64003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:06.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8882c700 1 -- 172.21.2.105:0/1902375982 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0f64004f70 msgr2=0x7f0f6400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:06.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8882c700 1 --2- 172.21.2.105:0/1902375982 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0f64004f70 0x7f0f6400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:06.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8882c700 1 -- 172.21.2.105:0/1902375982 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0f64004500 msgr2=0x7f0f64004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:06.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8882c700 1 --2- 172.21.2.105:0/1902375982 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0f64004500 0x7f0f64004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:06.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8882c700 1 -- 172.21.2.105:0/1902375982 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f64003260 con 0x7f0f64003820 2021-11-12T05:48:06.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8902d700 1 -- 172.21.2.105:0/1902375982 reap_dead start 2021-11-12T05:48:06.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8882c700 1 --2- 172.21.2.105:0/1902375982 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0f64003820 0x7f0f64003c20 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7f0f840611e0 tx=0x7f0f840ad870).ready entity=mon.0 client_cookie=95e629391ba27ac7 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:06.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f837fe700 1 -- 172.21.2.105:0/1902375982 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f6c0070d0 con 0x7f0f64003820 2021-11-12T05:48:06.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f837fe700 1 -- 172.21.2.105:0/1902375982 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f6c007230 con 0x7f0f64003820 2021-11-12T05:48:06.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f837fe700 1 -- 172.21.2.105:0/1902375982 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f6c00c8f0 con 0x7f0f64003820 2021-11-12T05:48:06.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8aa90700 1 -- 172.21.2.105:0/1902375982 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0f64003820 msgr2=0x7f0f64003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:06.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8aa90700 1 --2- 172.21.2.105:0/1902375982 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0f64003820 0x7f0f64003c20 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7f0f840611e0 tx=0x7f0f840ad870).stop 2021-11-12T05:48:06.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8aa90700 1 -- 172.21.2.105:0/1902375982 shutdown_connections 2021-11-12T05:48:06.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8aa90700 1 --2- 172.21.2.105:0/1902375982 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0f64003820 0x7f0f64003c20 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:06.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8aa90700 1 -- 172.21.2.105:0/1902375982 >> 172.21.2.105:0/1902375982 conn(0x7f0f8405c490 msgr2=0x7f0f840b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:06.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8aa90700 1 -- 172.21.2.105:0/1902375982 shutdown_connections 2021-11-12T05:48:06.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8aa90700 1 -- 172.21.2.105:0/1902375982 wait complete. 2021-11-12T05:48:06.373 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8aa90700 1 Processor -- start 2021-11-12T05:48:06.373 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8aa90700 1 -- start start 2021-11-12T05:48:06.373 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8aa90700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0f64003820 0x7f0f8414cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.373 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8aa90700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0f8414a370 0x7f0f8414a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.374 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8aa90700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0f841401f0 0x7f0f84140670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.374 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8aa90700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8414b600 con 0x7f0f841401f0 2021-11-12T05:48:06.374 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8aa90700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f841423b0 con 0x7f0f8414a370 2021-11-12T05:48:06.374 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8aa90700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f84141940 con 0x7f0f64003820 2021-11-12T05:48:06.374 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8902d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0f841401f0 0x7f0f84140670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:06.375 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8902d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0f841401f0 0x7f0f84140670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49640/0 (socket says 172.21.2.105:49640) 2021-11-12T05:48:06.375 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8902d700 1 -- 172.21.2.105:0/556519343 learned_addr learned my addr 172.21.2.105:0/556519343 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:06.375 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8902d700 1 -- 172.21.2.105:0/556519343 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0f64003820 msgr2=0x7f0f8414cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:06.375 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8902d700 1 --2- 172.21.2.105:0/556519343 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0f64003820 0x7f0f8414cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:06.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8902d700 1 -- 172.21.2.105:0/556519343 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0f8414a370 msgr2=0x7f0f8414a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:06.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8902d700 1 --2- 172.21.2.105:0/556519343 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0f8414a370 0x7f0f8414a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:06.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8902d700 1 -- 172.21.2.105:0/556519343 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f84141be0 con 0x7f0f841401f0 2021-11-12T05:48:06.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8902d700 1 --2- 172.21.2.105:0/556519343 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0f841401f0 0x7f0f84140670 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7f0f8414acc0 tx=0x7f0f7c007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:06.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f81ffb700 1 -- 172.21.2.105:0/556519343 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f7c00ceb0 con 0x7f0f841401f0 2021-11-12T05:48:06.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f81ffb700 1 -- 172.21.2.105:0/556519343 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7c005a90 con 0x7f0f841401f0 2021-11-12T05:48:06.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f81ffb700 1 -- 172.21.2.105:0/556519343 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f7c005df0 con 0x7f0f841401f0 2021-11-12T05:48:06.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8aa90700 1 -- 172.21.2.105:0/556519343 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f841415c0 con 0x7f0f841401f0 2021-11-12T05:48:06.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.356+0000 7f0f8aa90700 1 -- 172.21.2.105:0/556519343 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f84142a00 con 0x7f0f841401f0 2021-11-12T05:48:06.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.360+0000 7f0f8aa90700 1 -- 172.21.2.105:0/556519343 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f84057350 con 0x7f0f841401f0 2021-11-12T05:48:06.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.360+0000 7f0f81ffb700 1 -- 172.21.2.105:0/556519343 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0f7c010070 con 0x7f0f841401f0 2021-11-12T05:48:06.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.360+0000 7f0f81ffb700 1 --2- 172.21.2.105:0/556519343 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0f680536d0 0x7f0f68055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.360+0000 7f0f81ffb700 1 -- 172.21.2.105:0/556519343 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f0f7c06ae00 con 0x7f0f841401f0 2021-11-12T05:48:06.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.360+0000 7f0f8882c700 1 --2- 172.21.2.105:0/556519343 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0f680536d0 0x7f0f68055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:06.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.360+0000 7f0f8882c700 1 --2- 172.21.2.105:0/556519343 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0f680536d0 0x7f0f68055b90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f0f840611e0 tx=0x7f0f6c015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:06.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.360+0000 7f0f81ffb700 1 -- 172.21.2.105:0/556519343 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0f7c042140 con 0x7f0f841401f0 2021-11-12T05:48:06.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.444+0000 7f0f8aa90700 1 -- 172.21.2.105:0/556519343 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0f841417b0 con 0x7f0f841401f0 2021-11-12T05:48:06.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.444+0000 7f0f81ffb700 1 -- 172.21.2.105:0/556519343 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v103) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0f7c045760 con 0x7f0f841401f0 2021-11-12T05:48:06.451 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:48:06.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.448+0000 7f0f8aa90700 1 -- 172.21.2.105:0/556519343 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0f680536d0 msgr2=0x7f0f68055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:06.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.448+0000 7f0f8aa90700 1 --2- 172.21.2.105:0/556519343 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0f680536d0 0x7f0f68055b90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f0f840611e0 tx=0x7f0f6c015000).stop 2021-11-12T05:48:06.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.448+0000 7f0f8aa90700 1 -- 172.21.2.105:0/556519343 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0f841401f0 msgr2=0x7f0f84140670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:06.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.448+0000 7f0f8aa90700 1 --2- 172.21.2.105:0/556519343 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0f841401f0 0x7f0f84140670 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7f0f8414acc0 tx=0x7f0f7c007dc0).stop 2021-11-12T05:48:06.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.448+0000 7f0f8aa90700 1 -- 172.21.2.105:0/556519343 shutdown_connections 2021-11-12T05:48:06.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.448+0000 7f0f8aa90700 1 --2- 172.21.2.105:0/556519343 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0f680536d0 0x7f0f68055b90 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:06.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.448+0000 7f0f8aa90700 1 --2- 172.21.2.105:0/556519343 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0f841401f0 0x7f0f84140670 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:06.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.448+0000 7f0f8aa90700 1 --2- 172.21.2.105:0/556519343 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0f8414a370 0x7f0f8414a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:06.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.448+0000 7f0f8aa90700 1 --2- 172.21.2.105:0/556519343 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0f64003820 0x7f0f8414cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:06.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.448+0000 7f0f8aa90700 1 -- 172.21.2.105:0/556519343 >> 172.21.2.105:0/556519343 conn(0x7f0f8405c490 msgr2=0x7f0f84143770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:06.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.448+0000 7f0f8aa90700 1 -- 172.21.2.105:0/556519343 shutdown_connections 2021-11-12T05:48:06.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.448+0000 7f0f8aa90700 1 -- 172.21.2.105:0/556519343 wait complete. 2021-11-12T05:48:06.458 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:48:06.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.508+0000 7f43d9817700 1 Processor -- start 2021-11-12T05:48:06.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.508+0000 7f43d9817700 1 -- start start 2021-11-12T05:48:06.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.508+0000 7f43d9817700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f43d40b2e20 0x7f43d40b1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.508+0000 7f43d9817700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d40ad400 con 0x7f43d4142c50 2021-11-12T05:48:06.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.508+0000 7f43d9817700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d40b3200 con 0x7f43d413ea50 2021-11-12T05:48:06.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.508+0000 7f43d9817700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d40ad660 con 0x7f43d40b2e20 2021-11-12T05:48:06.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.508+0000 7f43d37fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f43d4142c50 0x7f43d4143070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60040/0 (socket says 172.21.2.105:60040) 2021-11-12T05:48:06.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.508+0000 7f43d37fe700 1 -- 172.21.2.105:0/3887236583 learned_addr learned my addr 172.21.2.105:0/3887236583 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:06.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.508+0000 7f43d2ffd700 1 --2- 172.21.2.105:0/3887236583 >> v2:172.21.2.105:3300/0 conn(0x7f43d40b2e20 0x7f43d40b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:06.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.508+0000 7f43d1ffb700 1 -- 172.21.2.105:0/3887236583 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2676438212 0 0) 0x7f43d40ad400 con 0x7f43d4142c50 2021-11-12T05:48:06.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.508+0000 7f43d1ffb700 1 -- 172.21.2.105:0/3887236583 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43b4004370 con 0x7f43d4142c50 2021-11-12T05:48:06.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.508+0000 7f43d2ffd700 1 -- 172.21.2.105:0/3887236583 >> v1:172.21.2.115:6789/0 conn(0x7f43d413ea50 legacy=0x7f43d413eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:06.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.508+0000 7f43d2ffd700 1 -- 172.21.2.105:0/3887236583 >> v1:172.21.2.105:6789/0 conn(0x7f43d4142c50 legacy=0x7f43d4143070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:06.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.508+0000 7f43d2ffd700 1 -- 172.21.2.105:0/3887236583 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d40ad900 con 0x7f43d40b2e20 2021-11-12T05:48:06.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.508+0000 7f43d2ffd700 1 --2- 172.21.2.105:0/3887236583 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f43d40b2e20 0x7f43d40b1060 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 rx=0x7f43d40b35c0 tx=0x7f43c4006df0).ready entity=mon.0 client_cookie=2b5452d92cc5ad78 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:06.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.508+0000 7f43d1ffb700 1 -- 172.21.2.105:0/3887236583 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43c400d5c0 con 0x7f43d40b2e20 2021-11-12T05:48:06.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.508+0000 7f43d1ffb700 1 -- 172.21.2.105:0/3887236583 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c4000e90 con 0x7f43d40b2e20 2021-11-12T05:48:06.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.508+0000 7f43d1ffb700 1 -- 172.21.2.105:0/3887236583 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43c400d910 con 0x7f43d40b2e20 2021-11-12T05:48:06.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.508+0000 7f43d9817700 1 -- 172.21.2.105:0/3887236583 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f43d40b2e20 msgr2=0x7f43d40b1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:06.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.508+0000 7f43d9817700 1 --2- 172.21.2.105:0/3887236583 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f43d40b2e20 0x7f43d40b1060 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 rx=0x7f43d40b35c0 tx=0x7f43c4006df0).stop 2021-11-12T05:48:06.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.508+0000 7f43d9817700 1 -- 172.21.2.105:0/3887236583 shutdown_connections 2021-11-12T05:48:06.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.508+0000 7f43d9817700 1 --2- 172.21.2.105:0/3887236583 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f43d40b2e20 0x7f43d40b1060 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:06.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.508+0000 7f43d9817700 1 -- 172.21.2.105:0/3887236583 >> 172.21.2.105:0/3887236583 conn(0x7f43d4062f60 msgr2=0x7f43d4063370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:06.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.508+0000 7f43d9817700 1 -- 172.21.2.105:0/3887236583 shutdown_connections 2021-11-12T05:48:06.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.508+0000 7f43d9817700 1 -- 172.21.2.105:0/3887236583 wait complete. 2021-11-12T05:48:06.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.508+0000 7f43d9817700 1 Processor -- start 2021-11-12T05:48:06.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.508+0000 7f43d9817700 1 -- start start 2021-11-12T05:48:06.520 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.512+0000 7f43d9817700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f43d40b2e20 0x7f43d4065820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.520 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.512+0000 7f43d9817700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f43d413ea50 0x7f43d413d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.520 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.512+0000 7f43d9817700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f43d4142c50 0x7f43d414e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.520 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.512+0000 7f43d9817700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d4064eb0 con 0x7f43d40b2e20 2021-11-12T05:48:06.521 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.512+0000 7f43d9817700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d40650e0 con 0x7f43d413ea50 2021-11-12T05:48:06.521 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.512+0000 7f43d9817700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d4065380 con 0x7f43d4142c50 2021-11-12T05:48:06.521 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.512+0000 7f43d2ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f43d40b2e20 0x7f43d4065820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:06.521 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.512+0000 7f43d2ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f43d40b2e20 0x7f43d4065820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49650/0 (socket says 172.21.2.105:49650) 2021-11-12T05:48:06.521 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.512+0000 7f43d2ffd700 1 -- 172.21.2.105:0/1409500612 learned_addr learned my addr 172.21.2.105:0/1409500612 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:06.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.512+0000 7f43d2ffd700 1 -- 172.21.2.105:0/1409500612 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f43d4142c50 msgr2=0x7f43d414e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:06.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.512+0000 7f43d2ffd700 1 --2- 172.21.2.105:0/1409500612 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f43d4142c50 0x7f43d414e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:06.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.512+0000 7f43d2ffd700 1 -- 172.21.2.105:0/1409500612 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f43d413ea50 msgr2=0x7f43d413d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:06.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.512+0000 7f43d2ffd700 1 --2- 172.21.2.105:0/1409500612 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f43d413ea50 0x7f43d413d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:06.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.512+0000 7f43d2ffd700 1 -- 172.21.2.105:0/1409500612 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c400b180 con 0x7f43d40b2e20 2021-11-12T05:48:06.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.512+0000 7f43d2ffd700 1 --2- 172.21.2.105:0/1409500612 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f43d40b2e20 0x7f43d4065820 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 rx=0x7f43d40b35c0 tx=0x7f43c4014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:06.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.512+0000 7f43cbfff700 1 -- 172.21.2.105:0/1409500612 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43c4016070 con 0x7f43d40b2e20 2021-11-12T05:48:06.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.512+0000 7f43cbfff700 1 -- 172.21.2.105:0/1409500612 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c4002f70 con 0x7f43d40b2e20 2021-11-12T05:48:06.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.512+0000 7f43cbfff700 1 -- 172.21.2.105:0/1409500612 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43c400de70 con 0x7f43d40b2e20 2021-11-12T05:48:06.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.512+0000 7f43d9817700 1 -- 172.21.2.105:0/1409500612 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d413dba0 con 0x7f43d40b2e20 2021-11-12T05:48:06.526 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.512+0000 7f43d9817700 1 -- 172.21.2.105:0/1409500612 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d413cf60 con 0x7f43d40b2e20 2021-11-12T05:48:06.526 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.512+0000 7f43d9817700 1 -- 172.21.2.105:0/1409500612 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d4065540 con 0x7f43d40b2e20 2021-11-12T05:48:06.526 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.512+0000 7f43cbfff700 1 -- 172.21.2.105:0/1409500612 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f43c4025030 con 0x7f43d40b2e20 2021-11-12T05:48:06.526 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.512+0000 7f43cbfff700 1 --2- 172.21.2.105:0/1409500612 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f43b80535d0 0x7f43b8055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.512+0000 7f43cbfff700 1 -- 172.21.2.105:0/1409500612 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f43c406c920 con 0x7f43d40b2e20 2021-11-12T05:48:06.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.512+0000 7f43d27fc700 1 --2- 172.21.2.105:0/1409500612 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f43b80535d0 0x7f43b8055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:06.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.512+0000 7f43d27fc700 1 --2- 172.21.2.105:0/1409500612 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f43b80535d0 0x7f43b8055a90 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f43bc001fa0 tx=0x7f43bc0077f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:06.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.516+0000 7f43cbfff700 1 -- 172.21.2.105:0/1409500612 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f43c4043b50 con 0x7f43d40b2e20 2021-11-12T05:48:06.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.596+0000 7f43d9817700 1 -- 172.21.2.105:0/1409500612 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f43d40b2060 con 0x7f43d40b2e20 2021-11-12T05:48:06.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.596+0000 7f43cbfff700 1 -- 172.21.2.105:0/1409500612 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v103) v1 ==== 92+0+10 (secure 0 0 0) 0x7f43c4023020 con 0x7f43d40b2e20 2021-11-12T05:48:06.603 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:48:06.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.600+0000 7f43d9817700 1 -- 172.21.2.105:0/1409500612 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f43b80535d0 msgr2=0x7f43b8055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:06.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.600+0000 7f43d9817700 1 --2- 172.21.2.105:0/1409500612 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f43b80535d0 0x7f43b8055a90 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f43bc001fa0 tx=0x7f43bc0077f0).stop 2021-11-12T05:48:06.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.600+0000 7f43d9817700 1 -- 172.21.2.105:0/1409500612 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f43d40b2e20 msgr2=0x7f43d4065820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:06.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.600+0000 7f43d9817700 1 --2- 172.21.2.105:0/1409500612 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f43d40b2e20 0x7f43d4065820 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 rx=0x7f43d40b35c0 tx=0x7f43c4014000).stop 2021-11-12T05:48:06.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.600+0000 7f43d9817700 1 -- 172.21.2.105:0/1409500612 shutdown_connections 2021-11-12T05:48:06.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.600+0000 7f43d9817700 1 --2- 172.21.2.105:0/1409500612 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f43b80535d0 0x7f43b8055a90 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:06.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.600+0000 7f43d9817700 1 --2- 172.21.2.105:0/1409500612 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f43d4142c50 0x7f43d414e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:06.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.600+0000 7f43d9817700 1 --2- 172.21.2.105:0/1409500612 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f43d413ea50 0x7f43d413d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:06.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.600+0000 7f43d9817700 1 --2- 172.21.2.105:0/1409500612 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f43d40b2e20 0x7f43d4065820 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:06.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.600+0000 7f43d9817700 1 -- 172.21.2.105:0/1409500612 >> 172.21.2.105:0/1409500612 conn(0x7f43d4062f60 msgr2=0x7f43d413eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:06.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.600+0000 7f43d9817700 1 -- 172.21.2.105:0/1409500612 shutdown_connections 2021-11-12T05:48:06.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.600+0000 7f43d9817700 1 -- 172.21.2.105:0/1409500612 wait complete. 2021-11-12T05:48:06.610 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-12T05:48:06.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.656+0000 7f9ff8876700 1 Processor -- start 2021-11-12T05:48:06.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.656+0000 7f9ff8876700 1 -- start start 2021-11-12T05:48:06.665 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.656+0000 7f9ff8876700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f9ff40ad080 0x7f9ff40af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.665 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.656+0000 7f9ff8876700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f9ff40ac280 0x7f9ff40ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.666 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.656+0000 7f9ff8876700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff40ac7b0 con 0x7f9ff414abe0 2021-11-12T05:48:06.666 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.656+0000 7f9ff8876700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff41488a0 con 0x7f9ff40ad080 2021-11-12T05:48:06.666 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.656+0000 7f9ff8876700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff40ac9e0 con 0x7f9ff40ac280 2021-11-12T05:48:06.666 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.656+0000 7f9ff2d9d700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f9ff414abe0 0x7f9ff414b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60056/0 (socket says 172.21.2.105:60056) 2021-11-12T05:48:06.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.656+0000 7f9ff2d9d700 1 -- 172.21.2.105:0/553893143 learned_addr learned my addr 172.21.2.105:0/553893143 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:06.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.656+0000 7f9ff259c700 1 --2- 172.21.2.105:0/553893143 >> v2:172.21.2.105:3300/0 conn(0x7f9ff40ad080 0x7f9ff40af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:06.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.656+0000 7f9ff159a700 1 -- 172.21.2.105:0/553893143 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2244168422 0 0) 0x7f9ff40ac7b0 con 0x7f9ff414abe0 2021-11-12T05:48:06.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.656+0000 7f9ff159a700 1 -- 172.21.2.105:0/553893143 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fd4003260 con 0x7f9ff414abe0 2021-11-12T05:48:06.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.656+0000 7f9ff259c700 1 -- 172.21.2.105:0/553893143 >> v2:172.21.2.115:3300/0 conn(0x7f9ff40ac280 msgr2=0x7f9ff40ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:06.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.656+0000 7f9ff259c700 1 --2- 172.21.2.105:0/553893143 >> v2:172.21.2.115:3300/0 conn(0x7f9ff40ac280 0x7f9ff40ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:06.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.656+0000 7f9ff259c700 1 -- 172.21.2.105:0/553893143 >> v1:172.21.2.105:6789/0 conn(0x7f9ff414abe0 legacy=0x7f9ff414b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:06.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.656+0000 7f9ff259c700 1 -- 172.21.2.105:0/553893143 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff40b0b30 con 0x7f9ff40ad080 2021-11-12T05:48:06.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.656+0000 7f9ff259c700 1 --2- 172.21.2.105:0/553893143 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9ff40ad080 0x7f9ff40af730 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7f9fe4002f70 tx=0x7f9fe4006df0).ready entity=mon.0 client_cookie=1d77ce3cd32b3483 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:06.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.656+0000 7f9ff159a700 1 -- 172.21.2.105:0/553893143 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fe400d570 con 0x7f9ff40ad080 2021-11-12T05:48:06.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.656+0000 7f9ff159a700 1 -- 172.21.2.105:0/553893143 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe4000e90 con 0x7f9ff40ad080 2021-11-12T05:48:06.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.656+0000 7f9ff159a700 1 -- 172.21.2.105:0/553893143 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fe400d8c0 con 0x7f9ff40ad080 2021-11-12T05:48:06.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.660+0000 7f9ff8876700 1 -- 172.21.2.105:0/553893143 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9ff40ad080 msgr2=0x7f9ff40af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:06.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.660+0000 7f9ff8876700 1 --2- 172.21.2.105:0/553893143 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9ff40ad080 0x7f9ff40af730 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7f9fe4002f70 tx=0x7f9fe4006df0).stop 2021-11-12T05:48:06.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.660+0000 7f9ff8876700 1 -- 172.21.2.105:0/553893143 shutdown_connections 2021-11-12T05:48:06.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.660+0000 7f9ff8876700 1 --2- 172.21.2.105:0/553893143 >> v2:172.21.2.115:3300/0 conn(0x7f9ff40ac280 0x7f9ff40ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:06.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.660+0000 7f9ff8876700 1 --2- 172.21.2.105:0/553893143 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9ff40ad080 0x7f9ff40af730 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:06.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.660+0000 7f9ff8876700 1 -- 172.21.2.105:0/553893143 >> 172.21.2.105:0/553893143 conn(0x7f9ff40b5370 msgr2=0x7f9ff40b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:06.671 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.660+0000 7f9ff8876700 1 -- 172.21.2.105:0/553893143 shutdown_connections 2021-11-12T05:48:06.671 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.660+0000 7f9ff8876700 1 -- 172.21.2.105:0/553893143 wait complete. 2021-11-12T05:48:06.671 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.660+0000 7f9ff8876700 1 Processor -- start 2021-11-12T05:48:06.671 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.660+0000 7f9ff8876700 1 -- start start 2021-11-12T05:48:06.671 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.660+0000 7f9ff8876700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9ff40ac280 0x7f9ff40a9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.660+0000 7f9ff8876700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9ff40ad080 0x7f9ff4149780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.660+0000 7f9ff8876700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9ff414abe0 0x7f9ff40a7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.660+0000 7f9ff8876700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff40a7a70 con 0x7f9ff40ac280 2021-11-12T05:48:06.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.660+0000 7f9ff8876700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff40a7cb0 con 0x7f9ff40ad080 2021-11-12T05:48:06.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.660+0000 7f9ff8876700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff40a7f50 con 0x7f9ff414abe0 2021-11-12T05:48:06.673 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.660+0000 7f9ff259c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9ff40ac280 0x7f9ff40a9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:06.673 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.660+0000 7f9ff259c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9ff40ac280 0x7f9ff40a9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49666/0 (socket says 172.21.2.105:49666) 2021-11-12T05:48:06.673 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.660+0000 7f9ff259c700 1 -- 172.21.2.105:0/953600390 learned_addr learned my addr 172.21.2.105:0/953600390 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:06.673 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.660+0000 7f9ff259c700 1 -- 172.21.2.105:0/953600390 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9ff414abe0 msgr2=0x7f9ff40a7580 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:48:06.674 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.660+0000 7f9ff259c700 1 --2- 172.21.2.105:0/953600390 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9ff414abe0 0x7f9ff40a7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:06.674 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.660+0000 7f9ff259c700 1 -- 172.21.2.105:0/953600390 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9ff40ad080 msgr2=0x7f9ff4149780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:06.674 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.660+0000 7f9ff259c700 1 --2- 172.21.2.105:0/953600390 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9ff40ad080 0x7f9ff4149780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:06.674 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.660+0000 7f9ff259c700 1 -- 172.21.2.105:0/953600390 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe400b180 con 0x7f9ff40ac280 2021-11-12T05:48:06.674 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.660+0000 7f9ff259c700 1 --2- 172.21.2.105:0/953600390 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9ff40ac280 0x7f9ff40a9cc0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 rx=0x7f9fe4002f70 tx=0x7f9fe4014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:06.675 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.660+0000 7f9feb7fe700 1 -- 172.21.2.105:0/953600390 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fe400dea0 con 0x7f9ff40ac280 2021-11-12T05:48:06.675 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.660+0000 7f9feb7fe700 1 -- 172.21.2.105:0/953600390 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe401e400 con 0x7f9ff40ac280 2021-11-12T05:48:06.675 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.660+0000 7f9feb7fe700 1 -- 172.21.2.105:0/953600390 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fe401e760 con 0x7f9ff40ac280 2021-11-12T05:48:06.675 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.660+0000 7f9ff8876700 1 -- 172.21.2.105:0/953600390 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ff4157d40 con 0x7f9ff40ac280 2021-11-12T05:48:06.676 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.660+0000 7f9ff8876700 1 -- 172.21.2.105:0/953600390 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff414a840 con 0x7f9ff40ac280 2021-11-12T05:48:06.676 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.660+0000 7f9ff8876700 1 -- 172.21.2.105:0/953600390 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ff40b1440 con 0x7f9ff40ac280 2021-11-12T05:48:06.677 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.660+0000 7f9feb7fe700 1 -- 172.21.2.105:0/953600390 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9fe401c070 con 0x7f9ff40ac280 2021-11-12T05:48:06.677 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.660+0000 7f9feb7fe700 1 --2- 172.21.2.105:0/953600390 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9fd8053610 0x7f9fd8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.677 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.660+0000 7f9feb7fe700 1 -- 172.21.2.105:0/953600390 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f9fe406c2a0 con 0x7f9ff40ac280 2021-11-12T05:48:06.677 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.660+0000 7f9ff1d9b700 1 --2- 172.21.2.105:0/953600390 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9fd8053610 0x7f9fd8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:06.678 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.660+0000 7f9ff1d9b700 1 --2- 172.21.2.105:0/953600390 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9fd8053610 0x7f9fd8055ad0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f9fdc002f70 tx=0x7f9fdc006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:06.678 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.664+0000 7f9feb7fe700 1 -- 172.21.2.105:0/953600390 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9fe40434d0 con 0x7f9ff40ac280 2021-11-12T05:48:06.753 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.748+0000 7f9ff8876700 1 -- 172.21.2.105:0/953600390 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9ff4057350 con 0x7f9ff40ac280 2021-11-12T05:48:06.753 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.748+0000 7f9feb7fe700 1 -- 172.21.2.105:0/953600390 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v103) v1 ==== 84+0+143 (secure 0 0 0) 0x7f9fe4023090 con 0x7f9ff40ac280 2021-11-12T05:48:06.754 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:06.754 INFO:teuthology.orchestra.run.gibba005.stdout:[ 2021-11-12T05:48:06.754 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:06.755 INFO:teuthology.orchestra.run.gibba005.stdout: "poolnum": 1, 2021-11-12T05:48:06.755 INFO:teuthology.orchestra.run.gibba005.stdout: "poolname": "device_health_metrics" 2021-11-12T05:48:06.755 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:06.755 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:06.755 INFO:teuthology.orchestra.run.gibba005.stdout: "poolnum": 2, 2021-11-12T05:48:06.756 INFO:teuthology.orchestra.run.gibba005.stdout: "poolname": "rbd" 2021-11-12T05:48:06.756 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:06.756 INFO:teuthology.orchestra.run.gibba005.stdout:] 2021-11-12T05:48:06.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.748+0000 7f9ff8876700 1 -- 172.21.2.105:0/953600390 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9fd8053610 msgr2=0x7f9fd8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:06.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.748+0000 7f9ff8876700 1 --2- 172.21.2.105:0/953600390 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9fd8053610 0x7f9fd8055ad0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f9fdc002f70 tx=0x7f9fdc006a80).stop 2021-11-12T05:48:06.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.748+0000 7f9ff8876700 1 -- 172.21.2.105:0/953600390 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9ff40ac280 msgr2=0x7f9ff40a9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:06.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.748+0000 7f9ff8876700 1 --2- 172.21.2.105:0/953600390 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9ff40ac280 0x7f9ff40a9cc0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 rx=0x7f9fe4002f70 tx=0x7f9fe4014000).stop 2021-11-12T05:48:06.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.748+0000 7f9ff8876700 1 -- 172.21.2.105:0/953600390 shutdown_connections 2021-11-12T05:48:06.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.748+0000 7f9ff8876700 1 --2- 172.21.2.105:0/953600390 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9fd8053610 0x7f9fd8055ad0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:06.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.748+0000 7f9ff8876700 1 --2- 172.21.2.105:0/953600390 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9ff414abe0 0x7f9ff40a7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:06.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.748+0000 7f9ff8876700 1 --2- 172.21.2.105:0/953600390 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9ff40ad080 0x7f9ff4149780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:06.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.748+0000 7f9ff8876700 1 --2- 172.21.2.105:0/953600390 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9ff40ac280 0x7f9ff40a9cc0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:06.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.748+0000 7f9ff8876700 1 -- 172.21.2.105:0/953600390 >> 172.21.2.105:0/953600390 conn(0x7f9ff40b5370 msgr2=0x7f9ff4145c60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:06.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.748+0000 7f9ff8876700 1 -- 172.21.2.105:0/953600390 shutdown_connections 2021-11-12T05:48:06.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.748+0000 7f9ff8876700 1 -- 172.21.2.105:0/953600390 wait complete. 2021-11-12T05:48:06.761 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-12T05:48:06.761 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-12T05:48:06.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.808+0000 7f2f43162700 1 Processor -- start 2021-11-12T05:48:06.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.808+0000 7f2f43162700 1 -- start start 2021-11-12T05:48:06.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f43162700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f2f3c0ad270 0x7f2f3c129090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f43162700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2f3c0ad780 0x7f2f3c0adbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f43162700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f3c140870 con 0x7f2f3c0634b0 2021-11-12T05:48:06.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f43162700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f3c140cd0 con 0x7f2f3c0ad270 2021-11-12T05:48:06.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f43162700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3c067630 con 0x7f2f3c0ad780 2021-11-12T05:48:06.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f3bfff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f2f3c0ad270 0x7f2f3c129090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:06.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f3bfff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f2f3c0ad270 0x7f2f3c129090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49676/0 (socket says 172.21.2.105:49676) 2021-11-12T05:48:06.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f3bfff700 1 -- 172.21.2.105:0/1588175950 learned_addr learned my addr 172.21.2.105:0/1588175950 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:06.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f416ff700 1 --2- 172.21.2.105:0/1588175950 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2f3c0ad780 0x7f2f3c0adbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:06.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f3bfff700 1 -- 172.21.2.105:0/1588175950 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2f3c0ad780 msgr2=0x7f2f3c0adbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:06.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f3bfff700 1 --2- 172.21.2.105:0/1588175950 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2f3c0ad780 0x7f2f3c0adbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:06.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f3bfff700 1 -- 172.21.2.105:0/1588175950 >> v1:172.21.2.115:6789/0 conn(0x7f2f3c0634b0 legacy=0x7f2f3c128980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:06.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f3bfff700 1 -- 172.21.2.105:0/1588175950 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f3c05fcc0 con 0x7f2f3c0ad270 2021-11-12T05:48:06.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f3bfff700 1 --2- 172.21.2.105:0/1588175950 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2f3c0ad270 0x7f2f3c129090 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 rx=0x7f2f3c05d250 tx=0x7f2f2c006eb0).ready entity=mon.0 client_cookie=8fafbbf875fede43 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:06.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f3b7fe700 1 -- 172.21.2.105:0/1588175950 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f2c00d570 con 0x7f2f3c0ad270 2021-11-12T05:48:06.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f3b7fe700 1 -- 172.21.2.105:0/1588175950 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2c000e90 con 0x7f2f3c0ad270 2021-11-12T05:48:06.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f3b7fe700 1 -- 172.21.2.105:0/1588175950 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f2c00d8c0 con 0x7f2f3c0ad270 2021-11-12T05:48:06.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f43162700 1 -- 172.21.2.105:0/1588175950 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2f3c0ad270 msgr2=0x7f2f3c129090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:06.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f43162700 1 --2- 172.21.2.105:0/1588175950 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2f3c0ad270 0x7f2f3c129090 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 rx=0x7f2f3c05d250 tx=0x7f2f2c006eb0).stop 2021-11-12T05:48:06.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f43162700 1 -- 172.21.2.105:0/1588175950 shutdown_connections 2021-11-12T05:48:06.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f43162700 1 --2- 172.21.2.105:0/1588175950 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2f3c0ad780 0x7f2f3c0adbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:06.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f43162700 1 --2- 172.21.2.105:0/1588175950 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2f3c0ad270 0x7f2f3c129090 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:06.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f43162700 1 -- 172.21.2.105:0/1588175950 >> 172.21.2.105:0/1588175950 conn(0x7f2f3c0b5320 msgr2=0x7f2f3c0b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:06.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f43162700 1 -- 172.21.2.105:0/1588175950 shutdown_connections 2021-11-12T05:48:06.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f43162700 1 -- 172.21.2.105:0/1588175950 wait complete. 2021-11-12T05:48:06.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f43162700 1 Processor -- start 2021-11-12T05:48:06.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f43162700 1 -- start start 2021-11-12T05:48:06.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f43162700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2f3c0634b0 0x7f2f3c12d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f43162700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2f3c0ad270 0x7f2f3c0b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f43162700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2f3c0ad780 0x7f2f3c126d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f43162700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3c12ab30 con 0x7f2f3c0ad780 2021-11-12T05:48:06.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f43162700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3c12a890 con 0x7f2f3c0634b0 2021-11-12T05:48:06.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f43162700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3c12cfd0 con 0x7f2f3c0ad270 2021-11-12T05:48:06.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f416ff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2f3c0ad780 0x7f2f3c126d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:06.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f416ff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2f3c0ad780 0x7f2f3c126d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49682/0 (socket says 172.21.2.105:49682) 2021-11-12T05:48:06.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f416ff700 1 -- 172.21.2.105:0/2389968327 learned_addr learned my addr 172.21.2.105:0/2389968327 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:06.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f40efe700 1 --2- 172.21.2.105:0/2389968327 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2f3c0634b0 0x7f2f3c12d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:06.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f3bfff700 1 --2- 172.21.2.105:0/2389968327 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2f3c0ad270 0x7f2f3c0b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:06.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f416ff700 1 -- 172.21.2.105:0/2389968327 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2f3c0ad270 msgr2=0x7f2f3c0b05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:06.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f416ff700 1 --2- 172.21.2.105:0/2389968327 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2f3c0ad270 0x7f2f3c0b05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:06.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f416ff700 1 -- 172.21.2.105:0/2389968327 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2f3c0634b0 msgr2=0x7f2f3c12d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:06.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f416ff700 1 --2- 172.21.2.105:0/2389968327 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2f3c0634b0 0x7f2f3c12d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:06.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f416ff700 1 -- 172.21.2.105:0/2389968327 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f2c00b1e0 con 0x7f2f3c0ad780 2021-11-12T05:48:06.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f416ff700 1 --2- 172.21.2.105:0/2389968327 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2f3c0ad780 0x7f2f3c126d20 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 rx=0x7f2f3400a000 tx=0x7f2f34008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:06.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.812+0000 7f2f39ffb700 1 -- 172.21.2.105:0/2389968327 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f340127e0 con 0x7f2f3c0ad780 2021-11-12T05:48:06.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.816+0000 7f2f39ffb700 1 -- 172.21.2.105:0/2389968327 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f34012940 con 0x7f2f3c0ad780 2021-11-12T05:48:06.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.816+0000 7f2f43162700 1 -- 172.21.2.105:0/2389968327 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f3c143390 con 0x7f2f3c0ad780 2021-11-12T05:48:06.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.816+0000 7f2f43162700 1 -- 172.21.2.105:0/2389968327 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f3c144090 con 0x7f2f3c0ad780 2021-11-12T05:48:06.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.816+0000 7f2f39ffb700 1 -- 172.21.2.105:0/2389968327 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f34012ca0 con 0x7f2f3c0ad780 2021-11-12T05:48:06.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.816+0000 7f2f43162700 1 -- 172.21.2.105:0/2389968327 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f14003410 con 0x7f2f3c0ad780 2021-11-12T05:48:06.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.816+0000 7f2f39ffb700 1 -- 172.21.2.105:0/2389968327 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2f34013480 con 0x7f2f3c0ad780 2021-11-12T05:48:06.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.816+0000 7f2f39ffb700 1 --2- 172.21.2.105:0/2389968327 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2f20053610 0x7f2f20055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:06.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.816+0000 7f2f39ffb700 1 -- 172.21.2.105:0/2389968327 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f2f3406ba00 con 0x7f2f3c0ad780 2021-11-12T05:48:06.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.816+0000 7f2f40efe700 1 --2- 172.21.2.105:0/2389968327 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2f20053610 0x7f2f20055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:06.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.816+0000 7f2f40efe700 1 --2- 172.21.2.105:0/2389968327 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2f20053610 0x7f2f20055ad0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f2f2400d000 tx=0x7f2f24007b70).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:06.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.816+0000 7f2f39ffb700 1 -- 172.21.2.105:0/2389968327 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2f34042ce0 con 0x7f2f3c0ad780 2021-11-12T05:48:06.904 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:06.900+0000 7f2f43162700 1 -- 172.21.2.105:0/2389968327 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f2f14003c40 con 0x7f2f3c0ad780 2021-11-12T05:48:07.787 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.784+0000 7f2f39ffb700 1 -- 172.21.2.105:0/2389968327 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v104) v1 ==== 133+0+0 (secure 0 0 0) 0x7f2f34012e00 con 0x7f2f3c0ad780 2021-11-12T05:48:07.789 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.784+0000 7f2f43162700 1 -- 172.21.2.105:0/2389968327 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2f20053610 msgr2=0x7f2f20055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:07.789 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.784+0000 7f2f43162700 1 --2- 172.21.2.105:0/2389968327 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2f20053610 0x7f2f20055ad0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f2f2400d000 tx=0x7f2f24007b70).stop 2021-11-12T05:48:07.789 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.784+0000 7f2f43162700 1 -- 172.21.2.105:0/2389968327 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2f3c0ad780 msgr2=0x7f2f3c126d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:07.789 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.784+0000 7f2f43162700 1 --2- 172.21.2.105:0/2389968327 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2f3c0ad780 0x7f2f3c126d20 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 rx=0x7f2f3400a000 tx=0x7f2f34008040).stop 2021-11-12T05:48:07.790 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.784+0000 7f2f43162700 1 -- 172.21.2.105:0/2389968327 shutdown_connections 2021-11-12T05:48:07.790 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.784+0000 7f2f43162700 1 --2- 172.21.2.105:0/2389968327 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2f20053610 0x7f2f20055ad0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:07.790 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.784+0000 7f2f43162700 1 --2- 172.21.2.105:0/2389968327 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2f3c0ad780 0x7f2f3c126d20 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:07.790 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.784+0000 7f2f43162700 1 --2- 172.21.2.105:0/2389968327 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2f3c0ad270 0x7f2f3c0b05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:07.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.784+0000 7f2f43162700 1 --2- 172.21.2.105:0/2389968327 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2f3c0634b0 0x7f2f3c12d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:07.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.784+0000 7f2f43162700 1 -- 172.21.2.105:0/2389968327 >> 172.21.2.105:0/2389968327 conn(0x7f2f3c0b5320 msgr2=0x7f2f3c127cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:07.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.784+0000 7f2f43162700 1 -- 172.21.2.105:0/2389968327 shutdown_connections 2021-11-12T05:48:07.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.784+0000 7f2f43162700 1 -- 172.21.2.105:0/2389968327 wait complete. 2021-11-12T05:48:07.792 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_metadata' created 2021-11-12T05:48:07.795 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-11-12T05:48:07.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.844+0000 7f9835857700 1 Processor -- start 2021-11-12T05:48:07.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.844+0000 7f9835857700 1 -- start start 2021-11-12T05:48:07.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.844+0000 7f9835857700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f98300aca40 0x7f98300ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:07.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.844+0000 7f9835857700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f9830144180 0x7f9830144610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:07.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.844+0000 7f9835857700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98300b1840 con 0x7f98300b0520 2021-11-12T05:48:07.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.844+0000 7f9835857700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98300af2b0 con 0x7f9830144180 2021-11-12T05:48:07.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.844+0000 7f9835857700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98300b09a0 con 0x7f98300aca40 2021-11-12T05:48:07.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.844+0000 7f982f7fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f9830144180 0x7f9830144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:07.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.844+0000 7f982f7fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f9830144180 0x7f9830144610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49686/0 (socket says 172.21.2.105:49686) 2021-11-12T05:48:07.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.844+0000 7f982f7fe700 1 -- 172.21.2.105:0/1611147011 learned_addr learned my addr 172.21.2.105:0/1611147011 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:07.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.844+0000 7f982f7fe700 1 -- 172.21.2.105:0/1611147011 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f98300aca40 msgr2=0x7f98300ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:07.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.844+0000 7f982f7fe700 1 --2- 172.21.2.105:0/1611147011 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f98300aca40 0x7f98300ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:07.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.844+0000 7f982f7fe700 1 -- 172.21.2.105:0/1611147011 >> v1:172.21.2.115:6789/0 conn(0x7f98300b0520 legacy=0x7f98301473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:07.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.844+0000 7f982f7fe700 1 -- 172.21.2.105:0/1611147011 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98300b1a70 con 0x7f9830144180 2021-11-12T05:48:07.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.844+0000 7f982f7fe700 1 --2- 172.21.2.105:0/1611147011 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9830144180 0x7f9830144610 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7f98300b00d0 tx=0x7f9828009290).ready entity=mon.0 client_cookie=62cf3e619cd59a48 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:07.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.844+0000 7f982dffb700 1 -- 172.21.2.105:0/1611147011 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f982800b860 con 0x7f9830144180 2021-11-12T05:48:07.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.844+0000 7f982dffb700 1 -- 172.21.2.105:0/1611147011 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982800b9c0 con 0x7f9830144180 2021-11-12T05:48:07.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.844+0000 7f982dffb700 1 -- 172.21.2.105:0/1611147011 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f982800bb70 con 0x7f9830144180 2021-11-12T05:48:07.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.844+0000 7f9835857700 1 -- 172.21.2.105:0/1611147011 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9830144180 msgr2=0x7f9830144610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:07.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.844+0000 7f9835857700 1 --2- 172.21.2.105:0/1611147011 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9830144180 0x7f9830144610 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7f98300b00d0 tx=0x7f9828009290).stop 2021-11-12T05:48:07.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.844+0000 7f9835857700 1 -- 172.21.2.105:0/1611147011 shutdown_connections 2021-11-12T05:48:07.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.844+0000 7f9835857700 1 --2- 172.21.2.105:0/1611147011 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9830144180 0x7f9830144610 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:07.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.844+0000 7f9835857700 1 --2- 172.21.2.105:0/1611147011 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f98300aca40 0x7f98300ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:07.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.844+0000 7f9835857700 1 -- 172.21.2.105:0/1611147011 >> 172.21.2.105:0/1611147011 conn(0x7f983005c490 msgr2=0x7f98300b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:07.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.844+0000 7f9835857700 1 -- 172.21.2.105:0/1611147011 shutdown_connections 2021-11-12T05:48:07.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.844+0000 7f9835857700 1 -- 172.21.2.105:0/1611147011 wait complete. 2021-11-12T05:48:07.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.848+0000 7f9835857700 1 Processor -- start 2021-11-12T05:48:07.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.848+0000 7f9835857700 1 -- start start 2021-11-12T05:48:07.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.848+0000 7f9835857700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f98300aca40 0x7f9830143b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:07.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.848+0000 7f9835857700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f98300b0520 0x7f98300a80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:07.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.848+0000 7f9835857700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9830144180 0x7f983015a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:07.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.848+0000 7f9835857700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98300a85d0 con 0x7f9830144180 2021-11-12T05:48:07.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.848+0000 7f9835857700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983015a210 con 0x7f98300aca40 2021-11-12T05:48:07.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.848+0000 7f9835857700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f983015a4b0 con 0x7f98300b0520 2021-11-12T05:48:07.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.848+0000 7f982f7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9830144180 0x7f983015a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:07.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.848+0000 7f982f7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9830144180 0x7f983015a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49696/0 (socket says 172.21.2.105:49696) 2021-11-12T05:48:07.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.848+0000 7f982f7fe700 1 -- 172.21.2.105:0/82809546 learned_addr learned my addr 172.21.2.105:0/82809546 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:07.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.848+0000 7f982e7fc700 1 --2- 172.21.2.105:0/82809546 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f98300b0520 0x7f98300a80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:07.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.848+0000 7f982effd700 1 --2- 172.21.2.105:0/82809546 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f98300aca40 0x7f9830143b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:07.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.848+0000 7f982f7fe700 1 -- 172.21.2.105:0/82809546 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f98300b0520 msgr2=0x7f98300a80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:07.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.848+0000 7f982f7fe700 1 --2- 172.21.2.105:0/82809546 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f98300b0520 0x7f98300a80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:07.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.848+0000 7f982f7fe700 1 -- 172.21.2.105:0/82809546 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f98300aca40 msgr2=0x7f9830143b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:07.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.848+0000 7f982f7fe700 1 --2- 172.21.2.105:0/82809546 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f98300aca40 0x7f9830143b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:07.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.848+0000 7f982f7fe700 1 -- 172.21.2.105:0/82809546 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9828009530 con 0x7f9830144180 2021-11-12T05:48:07.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.848+0000 7f982f7fe700 1 --2- 172.21.2.105:0/82809546 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9830144180 0x7f983015a950 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7f98300b00d0 tx=0x7f9828016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:07.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.848+0000 7f9827fff700 1 -- 172.21.2.105:0/82809546 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f982800bb30 con 0x7f9830144180 2021-11-12T05:48:07.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.848+0000 7f9827fff700 1 -- 172.21.2.105:0/82809546 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982801f420 con 0x7f9830144180 2021-11-12T05:48:07.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.848+0000 7f9827fff700 1 -- 172.21.2.105:0/82809546 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f982801f780 con 0x7f9830144180 2021-11-12T05:48:07.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.848+0000 7f9835857700 1 -- 172.21.2.105:0/82809546 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f983015ae40 con 0x7f9830144180 2021-11-12T05:48:07.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.848+0000 7f9835857700 1 -- 172.21.2.105:0/82809546 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98300abd40 con 0x7f9830144180 2021-11-12T05:48:07.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.848+0000 7f9835857700 1 -- 172.21.2.105:0/82809546 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98300a8750 con 0x7f9830144180 2021-11-12T05:48:07.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.848+0000 7f9827fff700 1 -- 172.21.2.105:0/82809546 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f982800f070 con 0x7f9830144180 2021-11-12T05:48:07.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.848+0000 7f9827fff700 1 --2- 172.21.2.105:0/82809546 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f98140536a0 0x7f9814055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:07.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.848+0000 7f9827fff700 1 -- 172.21.2.105:0/82809546 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5950+0+0 (secure 0 0 0) 0x7f982806c510 con 0x7f9830144180 2021-11-12T05:48:07.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.848+0000 7f982effd700 1 --2- 172.21.2.105:0/82809546 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f98140536a0 0x7f9814055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:07.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.848+0000 7f982effd700 1 --2- 172.21.2.105:0/82809546 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f98140536a0 0x7f9814055b60 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f981800a000 tx=0x7f9818008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:07.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.852+0000 7f9827fff700 1 -- 172.21.2.105:0/82809546 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f98280435e0 con 0x7f9830144180 2021-11-12T05:48:07.940 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:07.936+0000 7f9835857700 1 -- 172.21.2.105:0/82809546 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f9830057350 con 0x7f9830144180 2021-11-12T05:48:08.798 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.792+0000 7f9827fff700 1 -- 172.21.2.105:0/82809546 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v105) v1 ==== 125+0+0 (secure 0 0 0) 0x7f9828015070 con 0x7f9830144180 2021-11-12T05:48:08.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.796+0000 7f9835857700 1 -- 172.21.2.105:0/82809546 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f98140536a0 msgr2=0x7f9814055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:08.800 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.796+0000 7f9835857700 1 --2- 172.21.2.105:0/82809546 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f98140536a0 0x7f9814055b60 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f981800a000 tx=0x7f9818008040).stop 2021-11-12T05:48:08.800 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.796+0000 7f9835857700 1 -- 172.21.2.105:0/82809546 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9830144180 msgr2=0x7f983015a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:08.800 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.796+0000 7f9835857700 1 --2- 172.21.2.105:0/82809546 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9830144180 0x7f983015a950 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7f98300b00d0 tx=0x7f9828016000).stop 2021-11-12T05:48:08.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.796+0000 7f9835857700 1 -- 172.21.2.105:0/82809546 shutdown_connections 2021-11-12T05:48:08.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.796+0000 7f9835857700 1 --2- 172.21.2.105:0/82809546 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f98140536a0 0x7f9814055b60 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:08.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.796+0000 7f9835857700 1 --2- 172.21.2.105:0/82809546 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9830144180 0x7f983015a950 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:08.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.796+0000 7f9835857700 1 --2- 172.21.2.105:0/82809546 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f98300b0520 0x7f98300a80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:08.802 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.796+0000 7f9835857700 1 --2- 172.21.2.105:0/82809546 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f98300aca40 0x7f9830143b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:08.802 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.796+0000 7f9835857700 1 -- 172.21.2.105:0/82809546 >> 172.21.2.105:0/82809546 conn(0x7f983005c490 msgr2=0x7f9830060830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:08.802 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.796+0000 7f9835857700 1 -- 172.21.2.105:0/82809546 shutdown_connections 2021-11-12T05:48:08.802 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.796+0000 7f9835857700 1 -- 172.21.2.105:0/82809546 wait complete. 2021-11-12T05:48:08.803 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_data' created 2021-11-12T05:48:08.807 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-12T05:48:08.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.856+0000 7f6ec35df700 1 Processor -- start 2021-11-12T05:48:08.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.856+0000 7f6ec35df700 1 -- start start 2021-11-12T05:48:08.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.856+0000 7f6ec35df700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f6ebc0b2940 0x7f6ebc142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:08.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.856+0000 7f6ec35df700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ebc0b2d20 con 0x7f6ebc0b0cc0 2021-11-12T05:48:08.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.856+0000 7f6ec35df700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ebc0b1fc0 con 0x7f6ebc0b0780 2021-11-12T05:48:08.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.856+0000 7f6ec35df700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ebc0b15e0 con 0x7f6ebc0b2940 2021-11-12T05:48:08.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.856+0000 7f6ec137b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f6ebc0b2940 0x7f6ebc142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:08.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.856+0000 7f6ec1b7c700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f6ebc0b0cc0 0x7f6ebc05f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60096/0 (socket says 172.21.2.105:60096) 2021-11-12T05:48:08.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.856+0000 7f6ec1b7c700 1 -- 172.21.2.105:0/1003866989 learned_addr learned my addr 172.21.2.105:0/1003866989 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:08.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.856+0000 7f6ec137b700 1 -- 172.21.2.105:0/1003866989 >> v1:172.21.2.115:6789/0 conn(0x7f6ebc0b0780 legacy=0x7f6ebc1432b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:48:08.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.856+0000 7f6ec137b700 1 -- 172.21.2.105:0/1003866989 >> v1:172.21.2.105:6789/0 conn(0x7f6ebc0b0cc0 legacy=0x7f6ebc05f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:08.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.856+0000 7f6ec137b700 1 -- 172.21.2.105:0/1003866989 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ebc0b1880 con 0x7f6ebc0b2940 2021-11-12T05:48:08.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.856+0000 7f6ec137b700 1 --2- 172.21.2.105:0/1003866989 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6ebc0b2940 0x7f6ebc142dc0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 rx=0x7f6ebc0b2f60 tx=0x7f6eb8006df0).ready entity=mon.0 client_cookie=829ec3757febf1fe server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:08.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.856+0000 7f6eaffff700 1 -- 172.21.2.105:0/1003866989 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6eb800d5c0 con 0x7f6ebc0b2940 2021-11-12T05:48:08.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.856+0000 7f6eaffff700 1 -- 172.21.2.105:0/1003866989 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb8000e90 con 0x7f6ebc0b2940 2021-11-12T05:48:08.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.856+0000 7f6eaffff700 1 -- 172.21.2.105:0/1003866989 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6eb800d910 con 0x7f6ebc0b2940 2021-11-12T05:48:08.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.856+0000 7f6ec35df700 1 -- 172.21.2.105:0/1003866989 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6ebc0b2940 msgr2=0x7f6ebc142dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:08.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.856+0000 7f6ec35df700 1 --2- 172.21.2.105:0/1003866989 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6ebc0b2940 0x7f6ebc142dc0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 rx=0x7f6ebc0b2f60 tx=0x7f6eb8006df0).stop 2021-11-12T05:48:08.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.856+0000 7f6ec35df700 1 -- 172.21.2.105:0/1003866989 shutdown_connections 2021-11-12T05:48:08.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.856+0000 7f6ec35df700 1 --2- 172.21.2.105:0/1003866989 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6ebc0b2940 0x7f6ebc142dc0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:08.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.856+0000 7f6ec35df700 1 -- 172.21.2.105:0/1003866989 >> 172.21.2.105:0/1003866989 conn(0x7f6ebc068440 msgr2=0x7f6ebc062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:08.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.856+0000 7f6ec35df700 1 -- 172.21.2.105:0/1003866989 shutdown_connections 2021-11-12T05:48:08.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.856+0000 7f6ec35df700 1 -- 172.21.2.105:0/1003866989 wait complete. 2021-11-12T05:48:08.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.860+0000 7f6ec35df700 1 Processor -- start 2021-11-12T05:48:08.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.860+0000 7f6ec35df700 1 -- start start 2021-11-12T05:48:08.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.860+0000 7f6ec35df700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6ebc0b0780 0x7f6ebc066450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:08.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.860+0000 7f6ec35df700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6ebc0b0cc0 0x7f6ebc0a8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:08.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.860+0000 7f6ec35df700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6ebc0b2940 0x7f6ebc0a90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:08.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.860+0000 7f6ec35df700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc154f20 con 0x7f6ebc0b0780 2021-11-12T05:48:08.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.860+0000 7f6ec35df700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc145db0 con 0x7f6ebc0b2940 2021-11-12T05:48:08.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.860+0000 7f6ec35df700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc146050 con 0x7f6ebc0b0cc0 2021-11-12T05:48:08.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.860+0000 7f6ec137b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6ebc0b0780 0x7f6ebc066450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:08.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.860+0000 7f6ec137b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6ebc0b0780 0x7f6ebc066450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49708/0 (socket says 172.21.2.105:49708) 2021-11-12T05:48:08.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.860+0000 7f6ec137b700 1 -- 172.21.2.105:0/1806965088 learned_addr learned my addr 172.21.2.105:0/1806965088 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:08.873 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.860+0000 7f6ec137b700 1 -- 172.21.2.105:0/1806965088 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6ebc0b0cc0 msgr2=0x7f6ebc0a8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:08.873 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.860+0000 7f6ec137b700 1 --2- 172.21.2.105:0/1806965088 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6ebc0b0cc0 0x7f6ebc0a8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:08.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.860+0000 7f6ec137b700 1 -- 172.21.2.105:0/1806965088 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6ebc0b2940 msgr2=0x7f6ebc0a90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:08.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.860+0000 7f6ec137b700 1 --2- 172.21.2.105:0/1806965088 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6ebc0b2940 0x7f6ebc0a90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:08.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.860+0000 7f6ec137b700 1 -- 172.21.2.105:0/1806965088 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb800b180 con 0x7f6ebc0b0780 2021-11-12T05:48:08.875 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.860+0000 7f6ec137b700 1 --2- 172.21.2.105:0/1806965088 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6ebc0b0780 0x7f6ebc066450 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7f6ebc0b2f60 tx=0x7f6eb8012000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:08.875 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.860+0000 7f6eae7fc700 1 -- 172.21.2.105:0/1806965088 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6eb8016070 con 0x7f6ebc0b0780 2021-11-12T05:48:08.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.860+0000 7f6eae7fc700 1 -- 172.21.2.105:0/1806965088 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb8002f50 con 0x7f6ebc0b0780 2021-11-12T05:48:08.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.860+0000 7f6ec35df700 1 -- 172.21.2.105:0/1806965088 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ebc1462f0 con 0x7f6ebc0b0780 2021-11-12T05:48:08.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.860+0000 7f6ec35df700 1 -- 172.21.2.105:0/1806965088 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ebc0a95a0 con 0x7f6ebc0b0780 2021-11-12T05:48:08.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.860+0000 7f6eae7fc700 1 -- 172.21.2.105:0/1806965088 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6eb8013f00 con 0x7f6ebc0b0780 2021-11-12T05:48:08.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.860+0000 7f6ec35df700 1 -- 172.21.2.105:0/1806965088 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ebc0b1b20 con 0x7f6ebc0b0780 2021-11-12T05:48:08.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.860+0000 7f6eae7fc700 1 -- 172.21.2.105:0/1806965088 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6eb8025030 con 0x7f6ebc0b0780 2021-11-12T05:48:08.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.860+0000 7f6eae7fc700 1 --2- 172.21.2.105:0/1806965088 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6e9c0536f0 0x7f6e9c055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:08.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.860+0000 7f6eae7fc700 1 -- 172.21.2.105:0/1806965088 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6300+0+0 (secure 0 0 0) 0x7f6eb806cd90 con 0x7f6ebc0b0780 2021-11-12T05:48:08.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.860+0000 7f6ec0b7a700 1 --2- 172.21.2.105:0/1806965088 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6e9c0536f0 0x7f6e9c055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:08.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.860+0000 7f6ec0b7a700 1 --2- 172.21.2.105:0/1806965088 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6e9c0536f0 0x7f6e9c055bb0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f6eb0002fb0 tx=0x7f6eb00069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:08.881 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.864+0000 7f6eae7fc700 1 -- 172.21.2.105:0/1806965088 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6eb8043d00 con 0x7f6ebc0b0780 2021-11-12T05:48:08.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.972+0000 7f6ec35df700 1 -- 172.21.2.105:0/1806965088 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f6ebc057350 con 0x7f6ebc0b0780 2021-11-12T05:48:08.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.980+0000 7f6eae7fc700 1 -- 172.21.2.105:0/1806965088 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 19 and data pool 20 v49) v1 ==== 189+0+0 (secure 0 0 0) 0x7f6eb8047320 con 0x7f6ebc0b0780 2021-11-12T05:48:08.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.980+0000 7f6ec35df700 1 -- 172.21.2.105:0/1806965088 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6e9c0536f0 msgr2=0x7f6e9c055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:08.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.980+0000 7f6ec35df700 1 --2- 172.21.2.105:0/1806965088 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6e9c0536f0 0x7f6e9c055bb0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f6eb0002fb0 tx=0x7f6eb00069b0).stop 2021-11-12T05:48:08.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.980+0000 7f6ec35df700 1 -- 172.21.2.105:0/1806965088 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6ebc0b0780 msgr2=0x7f6ebc066450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:08.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.980+0000 7f6ec35df700 1 --2- 172.21.2.105:0/1806965088 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6ebc0b0780 0x7f6ebc066450 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7f6ebc0b2f60 tx=0x7f6eb8012000).stop 2021-11-12T05:48:08.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.980+0000 7f6ec35df700 1 -- 172.21.2.105:0/1806965088 shutdown_connections 2021-11-12T05:48:08.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.980+0000 7f6ec35df700 1 --2- 172.21.2.105:0/1806965088 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6e9c0536f0 0x7f6e9c055bb0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:08.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.980+0000 7f6ec35df700 1 --2- 172.21.2.105:0/1806965088 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6ebc0b2940 0x7f6ebc0a90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:08.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.980+0000 7f6ec35df700 1 --2- 172.21.2.105:0/1806965088 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6ebc0b0cc0 0x7f6ebc0a8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:08.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.980+0000 7f6ec35df700 1 --2- 172.21.2.105:0/1806965088 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6ebc0b0780 0x7f6ebc066450 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:08.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.980+0000 7f6ec35df700 1 -- 172.21.2.105:0/1806965088 >> 172.21.2.105:0/1806965088 conn(0x7f6ebc068440 msgr2=0x7f6ebc142fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:08.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.980+0000 7f6ec35df700 1 -- 172.21.2.105:0/1806965088 shutdown_connections 2021-11-12T05:48:08.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:08.980+0000 7f6ec35df700 1 -- 172.21.2.105:0/1806965088 wait complete. 2021-11-12T05:48:08.988 INFO:teuthology.orchestra.run.gibba005.stderr:new fs with metadata pool 19 and data pool 20 2021-11-12T05:48:08.992 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:48:09.042 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.036+0000 7f8a78934700 1 Processor -- start 2021-11-12T05:48:09.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.036+0000 7f8a78934700 1 -- start start 2021-11-12T05:48:09.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a78934700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f8a740b3170 0x7f8a740b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:09.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a78934700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8a740b04d0 0x7f8a740aa460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:09.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a78934700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a740b3550 con 0x7f8a740b11c0 2021-11-12T05:48:09.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a78934700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a740ad150 con 0x7f8a740b3170 2021-11-12T05:48:09.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a78934700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a740acc10 con 0x7f8a740b04d0 2021-11-12T05:48:09.049 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a7259c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f8a740b3170 0x7f8a740b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:09.049 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a7259c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f8a740b3170 0x7f8a740b3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49726/0 (socket says 172.21.2.105:49726) 2021-11-12T05:48:09.050 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a7259c700 1 -- 172.21.2.105:0/1696320355 learned_addr learned my addr 172.21.2.105:0/1696320355 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:09.050 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a7259c700 1 -- 172.21.2.105:0/1696320355 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8a740b04d0 msgr2=0x7f8a740aa460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:09.050 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a71d9b700 1 --2- 172.21.2.105:0/1696320355 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8a740b04d0 0x7f8a740aa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:09.050 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a7259c700 1 --2- 172.21.2.105:0/1696320355 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8a740b04d0 0x7f8a740aa460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:09.051 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a7259c700 1 -- 172.21.2.105:0/1696320355 >> v1:172.21.2.115:6789/0 conn(0x7f8a740b11c0 legacy=0x7f8a741448e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:09.051 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a7259c700 1 -- 172.21.2.105:0/1696320355 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a740aceb0 con 0x7f8a740b3170 2021-11-12T05:48:09.051 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a71d9b700 1 --2- 172.21.2.105:0/1696320355 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8a740b04d0 0x7f8a740aa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:48:09.051 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a7259c700 1 --2- 172.21.2.105:0/1696320355 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8a740b3170 0x7f8a740b3b60 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 rx=0x7f8a740b10a0 tx=0x7f8a5c006eb0).ready entity=mon.0 client_cookie=c50defa117aa0228 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:09.052 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a7159a700 1 -- 172.21.2.105:0/1696320355 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a5c00d570 con 0x7f8a740b3170 2021-11-12T05:48:09.052 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a7159a700 1 -- 172.21.2.105:0/1696320355 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5c000e90 con 0x7f8a740b3170 2021-11-12T05:48:09.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a7159a700 1 -- 172.21.2.105:0/1696320355 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a5c00d8c0 con 0x7f8a740b3170 2021-11-12T05:48:09.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a78934700 1 -- 172.21.2.105:0/1696320355 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8a740b3170 msgr2=0x7f8a740b3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:09.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a78934700 1 --2- 172.21.2.105:0/1696320355 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8a740b3170 0x7f8a740b3b60 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 rx=0x7f8a740b10a0 tx=0x7f8a5c006eb0).stop 2021-11-12T05:48:09.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a78934700 1 -- 172.21.2.105:0/1696320355 shutdown_connections 2021-11-12T05:48:09.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a78934700 1 --2- 172.21.2.105:0/1696320355 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8a740b04d0 0x7f8a740aa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:09.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a78934700 1 --2- 172.21.2.105:0/1696320355 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8a740b3170 0x7f8a740b3b60 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:09.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a78934700 1 -- 172.21.2.105:0/1696320355 >> 172.21.2.105:0/1696320355 conn(0x7f8a7405c490 msgr2=0x7f8a7405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:09.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a78934700 1 -- 172.21.2.105:0/1696320355 shutdown_connections 2021-11-12T05:48:09.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a78934700 1 -- 172.21.2.105:0/1696320355 wait complete. 2021-11-12T05:48:09.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a78934700 1 Processor -- start 2021-11-12T05:48:09.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a78934700 1 -- start start 2021-11-12T05:48:09.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a78934700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8a740b11c0 0x7f8a740645f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:09.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a78934700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8a740b3170 0x7f8a7414d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:09.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a78934700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8a7414d870 0x7f8a740651f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:09.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a78934700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a74143050 con 0x7f8a740b11c0 2021-11-12T05:48:09.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a78934700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a74064e20 con 0x7f8a740b3170 2021-11-12T05:48:09.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a78934700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a74157580 con 0x7f8a7414d870 2021-11-12T05:48:09.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a7259c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8a740b11c0 0x7f8a740645f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:09.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a7259c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8a740b11c0 0x7f8a740645f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49734/0 (socket says 172.21.2.105:49734) 2021-11-12T05:48:09.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a7259c700 1 -- 172.21.2.105:0/3977432235 learned_addr learned my addr 172.21.2.105:0/3977432235 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:09.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a7259c700 1 -- 172.21.2.105:0/3977432235 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8a7414d870 msgr2=0x7f8a740651f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:09.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a7259c700 1 --2- 172.21.2.105:0/3977432235 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8a7414d870 0x7f8a740651f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:09.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a7259c700 1 -- 172.21.2.105:0/3977432235 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8a740b3170 msgr2=0x7f8a7414d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:09.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a7259c700 1 --2- 172.21.2.105:0/3977432235 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8a740b3170 0x7f8a7414d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:09.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a7259c700 1 -- 172.21.2.105:0/3977432235 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a5c00b1e0 con 0x7f8a740b11c0 2021-11-12T05:48:09.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a7259c700 1 --2- 172.21.2.105:0/3977432235 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8a740b11c0 0x7f8a740645f0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7f8a740b10a0 tx=0x7f8a5c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:09.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.040+0000 7f8a6b7fe700 1 -- 172.21.2.105:0/3977432235 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a5c0118f0 con 0x7f8a740b11c0 2021-11-12T05:48:09.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.044+0000 7f8a6b7fe700 1 -- 172.21.2.105:0/3977432235 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5c011a50 con 0x7f8a740b11c0 2021-11-12T05:48:09.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.044+0000 7f8a78934700 1 -- 172.21.2.105:0/3977432235 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a74157820 con 0x7f8a740b11c0 2021-11-12T05:48:09.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.044+0000 7f8a78934700 1 -- 172.21.2.105:0/3977432235 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a74063b30 con 0x7f8a740b11c0 2021-11-12T05:48:09.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.044+0000 7f8a6b7fe700 1 -- 172.21.2.105:0/3977432235 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a5c011db0 con 0x7f8a740b11c0 2021-11-12T05:48:09.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.044+0000 7f8a78934700 1 -- 172.21.2.105:0/3977432235 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a74067390 con 0x7f8a740b11c0 2021-11-12T05:48:09.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.044+0000 7f8a6b7fe700 1 -- 172.21.2.105:0/3977432235 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8a5c025030 con 0x7f8a740b11c0 2021-11-12T05:48:09.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.044+0000 7f8a6b7fe700 1 --2- 172.21.2.105:0/3977432235 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8a580536a0 0x7f8a58055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:09.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.044+0000 7f8a6b7fe700 1 -- 172.21.2.105:0/3977432235 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f8a5c06cfa0 con 0x7f8a740b11c0 2021-11-12T05:48:09.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.044+0000 7f8a71d9b700 1 --2- 172.21.2.105:0/3977432235 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8a580536a0 0x7f8a58055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:09.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.044+0000 7f8a71d9b700 1 --2- 172.21.2.105:0/3977432235 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8a580536a0 0x7f8a58055b60 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f8a64007000 tx=0x7f8a64008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:09.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.044+0000 7f8a6b7fe700 1 -- 172.21.2.105:0/3977432235 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8a5c043ea0 con 0x7f8a740b11c0 2021-11-12T05:48:09.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.132+0000 7f8a78934700 1 -- 172.21.2.105:0/3977432235 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a74063e30 con 0x7f8a740b11c0 2021-11-12T05:48:09.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.132+0000 7f8a6b7fe700 1 -- 172.21.2.105:0/3977432235 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+16298 (secure 0 0 0) 0x7f8a5c023090 con 0x7f8a740b11c0 2021-11-12T05:48:09.137 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:09.137 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":106,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:48:08.977475+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:48:06.914733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-11-12T05:48:07.950921+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:48:09.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.132+0000 7f8a78934700 1 -- 172.21.2.105:0/3977432235 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8a580536a0 msgr2=0x7f8a58055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:09.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.132+0000 7f8a78934700 1 --2- 172.21.2.105:0/3977432235 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8a580536a0 0x7f8a58055b60 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f8a64007000 tx=0x7f8a64008040).stop 2021-11-12T05:48:09.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.132+0000 7f8a78934700 1 -- 172.21.2.105:0/3977432235 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8a740b11c0 msgr2=0x7f8a740645f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:09.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.132+0000 7f8a78934700 1 --2- 172.21.2.105:0/3977432235 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8a740b11c0 0x7f8a740645f0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7f8a740b10a0 tx=0x7f8a5c015000).stop 2021-11-12T05:48:09.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.132+0000 7f8a78934700 1 -- 172.21.2.105:0/3977432235 shutdown_connections 2021-11-12T05:48:09.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.132+0000 7f8a78934700 1 --2- 172.21.2.105:0/3977432235 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8a580536a0 0x7f8a58055b60 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:09.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.132+0000 7f8a78934700 1 --2- 172.21.2.105:0/3977432235 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8a7414d870 0x7f8a740651f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:09.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.132+0000 7f8a78934700 1 --2- 172.21.2.105:0/3977432235 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8a740b3170 0x7f8a7414d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:09.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.132+0000 7f8a78934700 1 --2- 172.21.2.105:0/3977432235 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8a740b11c0 0x7f8a740645f0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:09.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.132+0000 7f8a78934700 1 -- 172.21.2.105:0/3977432235 >> 172.21.2.105:0/3977432235 conn(0x7f8a7405c490 msgr2=0x7f8a740abfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:09.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.132+0000 7f8a78934700 1 -- 172.21.2.105:0/3977432235 shutdown_connections 2021-11-12T05:48:09.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.132+0000 7f8a78934700 1 -- 172.21.2.105:0/3977432235 wait complete. 2021-11-12T05:48:09.144 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:48:09.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a3fae700 1 Processor -- start 2021-11-12T05:48:09.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a3fae700 1 -- start start 2021-11-12T05:48:09.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a3fae700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fb19c05fdc0 0x7fb19c0601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:09.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a3fae700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb19c0ade80 0x7fb19c066730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:09.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a3fae700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb19c066150 con 0x7fb19c13a9c0 2021-11-12T05:48:09.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a3fae700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb19c141fb0 con 0x7fb19c05fdc0 2021-11-12T05:48:09.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a3fae700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c0663f0 con 0x7fb19c0ade80 2021-11-12T05:48:09.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a254b700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fb19c13a9c0 0x7fb19c141470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60136/0 (socket says 172.21.2.105:60136) 2021-11-12T05:48:09.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a254b700 1 -- 172.21.2.105:0/3454186157 learned_addr learned my addr 172.21.2.105:0/3454186157 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:09.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a0d48700 1 -- 172.21.2.105:0/3454186157 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1517294687 0 0) 0x7fb19c066150 con 0x7fb19c13a9c0 2021-11-12T05:48:09.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a0d48700 1 -- 172.21.2.105:0/3454186157 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb184003260 con 0x7fb19c13a9c0 2021-11-12T05:48:09.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a1d4a700 1 --2- 172.21.2.105:0/3454186157 >> v2:172.21.2.115:3300/0 conn(0x7fb19c05fdc0 0x7fb19c0601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:09.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a1549700 1 --2- 172.21.2.105:0/3454186157 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb19c0ade80 0x7fb19c066730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:09.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a0d48700 1 -- 172.21.2.105:0/3454186157 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3779507608 0 0) 0x7fb184003260 con 0x7fb19c13a9c0 2021-11-12T05:48:09.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a0d48700 1 -- 172.21.2.105:0/3454186157 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb19c0ade80 msgr2=0x7fb19c066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:09.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a0d48700 1 --2- 172.21.2.105:0/3454186157 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb19c0ade80 0x7fb19c066730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:09.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a0d48700 1 -- 172.21.2.105:0/3454186157 >> v2:172.21.2.115:3300/0 conn(0x7fb19c05fdc0 msgr2=0x7fb19c0601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:09.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a0d48700 1 --2- 172.21.2.105:0/3454186157 >> v2:172.21.2.115:3300/0 conn(0x7fb19c05fdc0 0x7fb19c0601a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:09.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a0d48700 1 -- 172.21.2.105:0/3454186157 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19c140fd0 con 0x7fb19c13a9c0 2021-11-12T05:48:09.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a0d48700 1 -- 172.21.2.105:0/3454186157 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fb1940019e0 con 0x7fb19c13a9c0 2021-11-12T05:48:09.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a0d48700 1 -- 172.21.2.105:0/3454186157 >> v1:172.21.2.105:6789/0 conn(0x7fb19c13a9c0 legacy=0x7fb19c141470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:09.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a0d48700 1 --2- 172.21.2.105:0/3454186157 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb184003750 0x7fb184003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:09.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a0d48700 1 --2- 172.21.2.105:0/3454186157 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb184004500 0x7fb184004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:09.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a0d48700 1 --2- 172.21.2.105:0/3454186157 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb19c0ade80 0x7fb184004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:09.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a0d48700 1 -- 172.21.2.105:0/3454186157 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c0663f0 con 0x7fb184004500 2021-11-12T05:48:09.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a0d48700 1 -- 172.21.2.105:0/3454186157 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18400b910 con 0x7fb184003750 2021-11-12T05:48:09.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a0d48700 1 -- 172.21.2.105:0/3454186157 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb18400bad0 con 0x7fb19c0ade80 2021-11-12T05:48:09.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a1549700 1 --2- 172.21.2.105:0/3454186157 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb184004500 0x7fb184004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:09.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a1549700 1 -- 172.21.2.105:0/3454186157 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb19c0ade80 msgr2=0x7fb184004ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:09.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a1549700 1 --2- 172.21.2.105:0/3454186157 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb19c0ade80 0x7fb184004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:09.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a1549700 1 -- 172.21.2.105:0/3454186157 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb184003750 msgr2=0x7fb184003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:09.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a1549700 1 --2- 172.21.2.105:0/3454186157 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb184003750 0x7fb184003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:09.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a1549700 1 -- 172.21.2.105:0/3454186157 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb184003260 con 0x7fb184004500 2021-11-12T05:48:09.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a1549700 1 --2- 172.21.2.105:0/3454186157 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb184004500 0x7fb184004980 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7fb18c007000 tx=0x7fb18c008040).ready entity=mon.0 client_cookie=76600d04de6f141d server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:09.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a0d48700 1 -- 172.21.2.105:0/3454186157 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb18c011890 con 0x7fb184004500 2021-11-12T05:48:09.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a0d48700 1 -- 172.21.2.105:0/3454186157 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18c00c030 con 0x7fb184004500 2021-11-12T05:48:09.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a0d48700 1 -- 172.21.2.105:0/3454186157 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb18c011be0 con 0x7fb184004500 2021-11-12T05:48:09.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a3fae700 1 -- 172.21.2.105:0/3454186157 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb184004500 msgr2=0x7fb184004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:09.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a3fae700 1 --2- 172.21.2.105:0/3454186157 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb184004500 0x7fb184004980 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7fb18c007000 tx=0x7fb18c008040).stop 2021-11-12T05:48:09.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a254b700 1 -- 172.21.2.105:0/3454186157 reap_dead start 2021-11-12T05:48:09.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a3fae700 1 -- 172.21.2.105:0/3454186157 shutdown_connections 2021-11-12T05:48:09.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a3fae700 1 -- 172.21.2.105:0/3454186157 >> 172.21.2.105:0/3454186157 conn(0x7fb19c0608d0 msgr2=0x7fb19c05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:09.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a3fae700 1 -- 172.21.2.105:0/3454186157 shutdown_connections 2021-11-12T05:48:09.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.192+0000 7fb1a3fae700 1 -- 172.21.2.105:0/3454186157 wait complete. 2021-11-12T05:48:09.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.196+0000 7fb1a3fae700 1 Processor -- start 2021-11-12T05:48:09.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.196+0000 7fb1a3fae700 1 -- start start 2021-11-12T05:48:09.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.196+0000 7fb1a3fae700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb184004500 0x7fb19c062b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:09.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.196+0000 7fb1a3fae700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb19c144af0 0x7fb19c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:09.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.196+0000 7fb1a3fae700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb19c0b7d20 0x7fb19c0af600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:09.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.196+0000 7fb1a3fae700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c1401a0 con 0x7fb19c144af0 2021-11-12T05:48:09.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.196+0000 7fb1a3fae700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c1403a0 con 0x7fb19c0b7d20 2021-11-12T05:48:09.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.196+0000 7fb1a3fae700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c145070 con 0x7fb184004500 2021-11-12T05:48:09.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.196+0000 7fb1a1549700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb19c144af0 0x7fb19c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:09.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.196+0000 7fb1a1549700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb19c144af0 0x7fb19c0b7830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49756/0 (socket says 172.21.2.105:49756) 2021-11-12T05:48:09.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.196+0000 7fb1a1549700 1 -- 172.21.2.105:0/2226438142 learned_addr learned my addr 172.21.2.105:0/2226438142 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:09.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.196+0000 7fb1a1549700 1 -- 172.21.2.105:0/2226438142 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb184004500 msgr2=0x7fb19c062b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:09.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.196+0000 7fb1a1549700 1 --2- 172.21.2.105:0/2226438142 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb184004500 0x7fb19c062b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:09.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.196+0000 7fb1a1549700 1 -- 172.21.2.105:0/2226438142 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb19c0b7d20 msgr2=0x7fb19c0af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:09.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.196+0000 7fb1a1549700 1 --2- 172.21.2.105:0/2226438142 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb19c0b7d20 0x7fb19c0af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:09.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.196+0000 7fb1a1549700 1 -- 172.21.2.105:0/2226438142 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19c0b5360 con 0x7fb19c144af0 2021-11-12T05:48:09.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.196+0000 7fb1a1549700 1 --2- 172.21.2.105:0/2226438142 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb19c144af0 0x7fb19c0b7830 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7fb19c142950 tx=0x7fb18c01b000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:09.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.196+0000 7fb18affd700 1 -- 172.21.2.105:0/2226438142 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb18c01aa70 con 0x7fb19c144af0 2021-11-12T05:48:09.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.196+0000 7fb18affd700 1 -- 172.21.2.105:0/2226438142 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18c000e90 con 0x7fb19c144af0 2021-11-12T05:48:09.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.196+0000 7fb1a3fae700 1 -- 172.21.2.105:0/2226438142 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb19c142c30 con 0x7fb19c144af0 2021-11-12T05:48:09.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.196+0000 7fb18affd700 1 -- 172.21.2.105:0/2226438142 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb18c01adc0 con 0x7fb19c144af0 2021-11-12T05:48:09.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.196+0000 7fb1a3fae700 1 -- 172.21.2.105:0/2226438142 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb19c1434a0 con 0x7fb19c144af0 2021-11-12T05:48:09.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.196+0000 7fb1a3fae700 1 -- 172.21.2.105:0/2226438142 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb19c1401a0 con 0x7fb19c144af0 2021-11-12T05:48:09.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.196+0000 7fb18affd700 1 -- 172.21.2.105:0/2226438142 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb18c025430 con 0x7fb19c144af0 2021-11-12T05:48:09.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.196+0000 7fb18affd700 1 --2- 172.21.2.105:0/2226438142 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb17c053640 0x7fb17c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:09.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.196+0000 7fb18affd700 1 -- 172.21.2.105:0/2226438142 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fb18c070b90 con 0x7fb19c144af0 2021-11-12T05:48:09.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.196+0000 7fb1a1d4a700 1 --2- 172.21.2.105:0/2226438142 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb17c053640 0x7fb17c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:09.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.196+0000 7fb1a1d4a700 1 --2- 172.21.2.105:0/2226438142 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb17c053640 0x7fb17c055b00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7fb198007000 tx=0x7fb198008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:09.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.200+0000 7fb18affd700 1 -- 172.21.2.105:0/2226438142 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb18c047b40 con 0x7fb19c144af0 2021-11-12T05:48:09.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.284+0000 7fb1a3fae700 1 -- 172.21.2.105:0/2226438142 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb19c143150 con 0x7fb19c144af0 2021-11-12T05:48:09.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.284+0000 7fb18affd700 1 -- 172.21.2.105:0/2226438142 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+16298 (secure 0 0 0) 0x7fb18c02a030 con 0x7fb19c144af0 2021-11-12T05:48:09.289 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:09.289 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":106,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:48:08.977475+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:48:06.914733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-11-12T05:48:07.950921+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:48:09.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.284+0000 7fb1a3fae700 1 -- 172.21.2.105:0/2226438142 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb17c053640 msgr2=0x7fb17c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:09.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.284+0000 7fb1a3fae700 1 --2- 172.21.2.105:0/2226438142 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb17c053640 0x7fb17c055b00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7fb198007000 tx=0x7fb198008040).stop 2021-11-12T05:48:09.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.284+0000 7fb1a3fae700 1 -- 172.21.2.105:0/2226438142 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb19c144af0 msgr2=0x7fb19c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:09.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.284+0000 7fb1a3fae700 1 --2- 172.21.2.105:0/2226438142 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb19c144af0 0x7fb19c0b7830 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7fb19c142950 tx=0x7fb18c01b000).stop 2021-11-12T05:48:09.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.284+0000 7fb1a3fae700 1 -- 172.21.2.105:0/2226438142 shutdown_connections 2021-11-12T05:48:09.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.284+0000 7fb1a3fae700 1 --2- 172.21.2.105:0/2226438142 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb17c053640 0x7fb17c055b00 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:09.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.284+0000 7fb1a3fae700 1 --2- 172.21.2.105:0/2226438142 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb19c0b7d20 0x7fb19c0af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:09.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.284+0000 7fb1a3fae700 1 --2- 172.21.2.105:0/2226438142 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb19c144af0 0x7fb19c0b7830 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:09.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.284+0000 7fb1a3fae700 1 --2- 172.21.2.105:0/2226438142 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb184004500 0x7fb19c062b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:09.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.284+0000 7fb1a3fae700 1 -- 172.21.2.105:0/2226438142 >> 172.21.2.105:0/2226438142 conn(0x7fb19c0608d0 msgr2=0x7fb19c1396c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:09.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.284+0000 7fb1a3fae700 1 -- 172.21.2.105:0/2226438142 shutdown_connections 2021-11-12T05:48:09.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.284+0000 7fb1a3fae700 1 -- 172.21.2.105:0/2226438142 wait complete. 2021-11-12T05:48:09.296 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-12T05:48:09.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.344+0000 7fe44929c700 1 Processor -- start 2021-11-12T05:48:09.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.344+0000 7fe44929c700 1 -- start start 2021-11-12T05:48:09.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.344+0000 7fe44929c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe4440aca40 0x7fe4440ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:09.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.344+0000 7fe44929c700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fe4440b0520 0x7fe4441473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:09.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.344+0000 7fe44929c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe4441478b0 0x7fe444144180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:09.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.344+0000 7fe44929c700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe444147d40 con 0x7fe4441478b0 2021-11-12T05:48:09.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.344+0000 7fe44929c700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4440b1840 con 0x7fe4440b0520 2021-11-12T05:48:09.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.344+0000 7fe44929c700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4440af2b0 con 0x7fe4440aca40 2021-11-12T05:48:09.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.344+0000 7fe4437fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe4441478b0 0x7fe444144180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:09.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.344+0000 7fe4437fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe4441478b0 0x7fe444144180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49764/0 (socket says 172.21.2.105:49764) 2021-11-12T05:48:09.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.344+0000 7fe4437fe700 1 -- 172.21.2.105:0/1453907415 learned_addr learned my addr 172.21.2.105:0/1453907415 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:09.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.344+0000 7fe4437fe700 1 -- 172.21.2.105:0/1453907415 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe4440aca40 msgr2=0x7fe4440ace20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:48:09.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.344+0000 7fe4437fe700 1 --2- 172.21.2.105:0/1453907415 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe4440aca40 0x7fe4440ace20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:09.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.344+0000 7fe4437fe700 1 -- 172.21.2.105:0/1453907415 >> v2:172.21.2.115:3300/0 conn(0x7fe4440b0520 msgr2=0x7fe4441473c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:48:09.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.344+0000 7fe4437fe700 1 --2- 172.21.2.105:0/1453907415 >> v2:172.21.2.115:3300/0 conn(0x7fe4440b0520 0x7fe4441473c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:09.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.344+0000 7fe4437fe700 1 -- 172.21.2.105:0/1453907415 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4440b09a0 con 0x7fe4441478b0 2021-11-12T05:48:09.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.344+0000 7fe4437fe700 1 --2- 172.21.2.105:0/1453907415 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe4441478b0 0x7fe444144180 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7fe43c0032f0 tx=0x7fe43c009290).ready entity=mon.0 client_cookie=2f3e3f3e825bf753 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:09.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.344+0000 7fe441ffb700 1 -- 172.21.2.105:0/1453907415 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe43c00b870 con 0x7fe4441478b0 2021-11-12T05:48:09.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.344+0000 7fe441ffb700 1 -- 172.21.2.105:0/1453907415 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43c00b9d0 con 0x7fe4441478b0 2021-11-12T05:48:09.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.344+0000 7fe441ffb700 1 -- 172.21.2.105:0/1453907415 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe43c00bb80 con 0x7fe4441478b0 2021-11-12T05:48:09.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.344+0000 7fe44929c700 1 -- 172.21.2.105:0/1453907415 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe4441478b0 msgr2=0x7fe444144180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:09.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.344+0000 7fe44929c700 1 --2- 172.21.2.105:0/1453907415 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe4441478b0 0x7fe444144180 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7fe43c0032f0 tx=0x7fe43c009290).stop 2021-11-12T05:48:09.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.344+0000 7fe44929c700 1 -- 172.21.2.105:0/1453907415 shutdown_connections 2021-11-12T05:48:09.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.344+0000 7fe44929c700 1 --2- 172.21.2.105:0/1453907415 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe4441478b0 0x7fe444144180 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:09.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.344+0000 7fe44929c700 1 --2- 172.21.2.105:0/1453907415 >> v2:172.21.2.115:3300/0 conn(0x7fe4440b0520 0x7fe4441473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:09.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.344+0000 7fe44929c700 1 --2- 172.21.2.105:0/1453907415 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe4440aca40 0x7fe4440ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:09.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.344+0000 7fe44929c700 1 -- 172.21.2.105:0/1453907415 >> 172.21.2.105:0/1453907415 conn(0x7fe44405c490 msgr2=0x7fe4440b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:09.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.344+0000 7fe44929c700 1 -- 172.21.2.105:0/1453907415 shutdown_connections 2021-11-12T05:48:09.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.344+0000 7fe44929c700 1 -- 172.21.2.105:0/1453907415 wait complete. 2021-11-12T05:48:09.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.348+0000 7fe44929c700 1 Processor -- start 2021-11-12T05:48:09.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.348+0000 7fe44929c700 1 -- start start 2021-11-12T05:48:09.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.348+0000 7fe44929c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe4440aca40 0x7fe444065ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:09.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.348+0000 7fe44929c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe4440b0520 0x7fe4440a7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:09.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.348+0000 7fe44929c700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe4441478b0 0x7fe4440a7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:09.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.348+0000 7fe44929c700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4441577d0 con 0x7fe4440b0520 2021-11-12T05:48:09.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.348+0000 7fe44929c700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe444157290 con 0x7fe4441478b0 2021-11-12T05:48:09.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.348+0000 7fe44929c700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe444157530 con 0x7fe4440aca40 2021-11-12T05:48:09.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.348+0000 7fe4427fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe4440b0520 0x7fe4440a7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:09.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.348+0000 7fe4427fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe4440b0520 0x7fe4440a7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49768/0 (socket says 172.21.2.105:49768) 2021-11-12T05:48:09.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.348+0000 7fe4427fc700 1 -- 172.21.2.105:0/2666341991 learned_addr learned my addr 172.21.2.105:0/2666341991 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:09.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.348+0000 7fe4427fc700 1 -- 172.21.2.105:0/2666341991 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe4440aca40 msgr2=0x7fe444065ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:09.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.348+0000 7fe4427fc700 1 --2- 172.21.2.105:0/2666341991 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe4440aca40 0x7fe444065ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:09.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.348+0000 7fe4427fc700 1 -- 172.21.2.105:0/2666341991 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe4441478b0 msgr2=0x7fe4440a7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:09.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.348+0000 7fe4427fc700 1 --2- 172.21.2.105:0/2666341991 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe4441478b0 0x7fe4440a7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:09.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.348+0000 7fe4427fc700 1 -- 172.21.2.105:0/2666341991 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe43c009530 con 0x7fe4440b0520 2021-11-12T05:48:09.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.348+0000 7fe4427fc700 1 --2- 172.21.2.105:0/2666341991 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe4440b0520 0x7fe4440a7360 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7fe42c002fb0 tx=0x7fe42c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:09.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.348+0000 7fe43bfff700 1 -- 172.21.2.105:0/2666341991 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe42c009e00 con 0x7fe4440b0520 2021-11-12T05:48:09.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.348+0000 7fe43bfff700 1 -- 172.21.2.105:0/2666341991 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42c013460 con 0x7fe4440b0520 2021-11-12T05:48:09.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.348+0000 7fe43bfff700 1 -- 172.21.2.105:0/2666341991 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe42c0137c0 con 0x7fe4440b0520 2021-11-12T05:48:09.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.348+0000 7fe44929c700 1 -- 172.21.2.105:0/2666341991 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4440b48a0 con 0x7fe4440b0520 2021-11-12T05:48:09.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.348+0000 7fe44929c700 1 -- 172.21.2.105:0/2666341991 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe444066d70 con 0x7fe4440b0520 2021-11-12T05:48:09.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.348+0000 7fe44929c700 1 -- 172.21.2.105:0/2666341991 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe444057350 con 0x7fe4440b0520 2021-11-12T05:48:09.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.348+0000 7fe43bfff700 1 -- 172.21.2.105:0/2666341991 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe42c00f070 con 0x7fe4440b0520 2021-11-12T05:48:09.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.348+0000 7fe43bfff700 1 --2- 172.21.2.105:0/2666341991 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe4280536a0 0x7fe428055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:09.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.348+0000 7fe43bfff700 1 -- 172.21.2.105:0/2666341991 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fe42c06b110 con 0x7fe4440b0520 2021-11-12T05:48:09.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.348+0000 7fe442ffd700 1 --2- 172.21.2.105:0/2666341991 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe4280536a0 0x7fe428055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:09.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.348+0000 7fe442ffd700 1 --2- 172.21.2.105:0/2666341991 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe4280536a0 0x7fe428055b60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7fe434002fb0 tx=0x7fe4340069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:09.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.352+0000 7fe43bfff700 1 -- 172.21.2.105:0/2666341991 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe42c042120 con 0x7fe4440b0520 2021-11-12T05:48:09.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.460+0000 7fe44929c700 1 -- 172.21.2.105:0/2666341991 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe44406a280 con 0x7fe4440b0520 2021-11-12T05:48:09.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.988+0000 7fe43bfff700 1 -- 172.21.2.105:0/2666341991 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v50) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe42c018030 con 0x7fe4440b0520 2021-11-12T05:48:09.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.988+0000 7fe44929c700 1 -- 172.21.2.105:0/2666341991 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe4280536a0 msgr2=0x7fe428055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:09.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.988+0000 7fe44929c700 1 --2- 172.21.2.105:0/2666341991 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe4280536a0 0x7fe428055b60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7fe434002fb0 tx=0x7fe4340069b0).stop 2021-11-12T05:48:09.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.988+0000 7fe44929c700 1 -- 172.21.2.105:0/2666341991 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe4440b0520 msgr2=0x7fe4440a7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:09.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.988+0000 7fe44929c700 1 --2- 172.21.2.105:0/2666341991 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe4440b0520 0x7fe4440a7360 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7fe42c002fb0 tx=0x7fe42c006df0).stop 2021-11-12T05:48:09.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.988+0000 7fe44929c700 1 -- 172.21.2.105:0/2666341991 shutdown_connections 2021-11-12T05:48:09.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.988+0000 7fe44929c700 1 --2- 172.21.2.105:0/2666341991 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe4280536a0 0x7fe428055b60 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:09.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.988+0000 7fe44929c700 1 --2- 172.21.2.105:0/2666341991 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe4441478b0 0x7fe4440a7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:09.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.988+0000 7fe44929c700 1 --2- 172.21.2.105:0/2666341991 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe4440b0520 0x7fe4440a7360 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:09.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.988+0000 7fe44929c700 1 --2- 172.21.2.105:0/2666341991 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe4440aca40 0x7fe444065ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:09.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.988+0000 7fe44929c700 1 -- 172.21.2.105:0/2666341991 >> 172.21.2.105:0/2666341991 conn(0x7fe44405c490 msgr2=0x7fe4440b1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:09.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.988+0000 7fe44929c700 1 -- 172.21.2.105:0/2666341991 shutdown_connections 2021-11-12T05:48:09.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:09.988+0000 7fe44929c700 1 -- 172.21.2.105:0/2666341991 wait complete. 2021-11-12T05:48:10.000 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:48:10.052 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.048+0000 7f801172b700 1 Processor -- start 2021-11-12T05:48:10.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.048+0000 7f801172b700 1 -- start start 2021-11-12T05:48:10.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.048+0000 7f801172b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f800c0ad080 0x7f800c0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.048+0000 7f801172b700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f800c0ac280 0x7f800c0ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.048+0000 7f801172b700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f800c0ac7b0 con 0x7f800c14abe0 2021-11-12T05:48:10.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.048+0000 7f801172b700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f800c1488a0 con 0x7f800c0ad080 2021-11-12T05:48:10.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.048+0000 7f801172b700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f800c0ac9e0 con 0x7f800c0ac280 2021-11-12T05:48:10.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.048+0000 7f800b7fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f800c14abe0 0x7f800c14b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60172/0 (socket says 172.21.2.105:60172) 2021-11-12T05:48:10.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.048+0000 7f800b7fe700 1 -- 172.21.2.105:0/2595002319 learned_addr learned my addr 172.21.2.105:0/2595002319 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:10.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.048+0000 7f800affd700 1 --2- 172.21.2.105:0/2595002319 >> v2:172.21.2.105:3300/0 conn(0x7f800c0ad080 0x7f800c0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:10.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.048+0000 7f8009ffb700 1 -- 172.21.2.105:0/2595002319 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2419539755 0 0) 0x7f800c0ac7b0 con 0x7f800c14abe0 2021-11-12T05:48:10.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.048+0000 7f8009ffb700 1 -- 172.21.2.105:0/2595002319 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fec003260 con 0x7f800c14abe0 2021-11-12T05:48:10.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.048+0000 7f800affd700 1 -- 172.21.2.105:0/2595002319 >> v2:172.21.2.115:3300/0 conn(0x7f800c0ac280 msgr2=0x7f800c0ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:10.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.048+0000 7f800affd700 1 --2- 172.21.2.105:0/2595002319 >> v2:172.21.2.115:3300/0 conn(0x7f800c0ac280 0x7f800c0ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:10.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.048+0000 7f800affd700 1 -- 172.21.2.105:0/2595002319 >> v1:172.21.2.105:6789/0 conn(0x7f800c14abe0 legacy=0x7f800c14b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:10.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.048+0000 7f800affd700 1 -- 172.21.2.105:0/2595002319 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f800c0b0b30 con 0x7f800c0ad080 2021-11-12T05:48:10.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.048+0000 7f800affd700 1 --2- 172.21.2.105:0/2595002319 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f800c0ad080 0x7f800c0af730 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7f7ff4002f70 tx=0x7f7ff4006df0).ready entity=mon.0 client_cookie=3582edcd7789a017 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:10.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.048+0000 7f8009ffb700 1 -- 172.21.2.105:0/2595002319 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ff400d570 con 0x7f800c0ad080 2021-11-12T05:48:10.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.048+0000 7f8009ffb700 1 -- 172.21.2.105:0/2595002319 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff4000e90 con 0x7f800c0ad080 2021-11-12T05:48:10.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.048+0000 7f8009ffb700 1 -- 172.21.2.105:0/2595002319 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ff400d8c0 con 0x7f800c0ad080 2021-11-12T05:48:10.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.048+0000 7f801172b700 1 -- 172.21.2.105:0/2595002319 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f800c0ad080 msgr2=0x7f800c0af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:10.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.048+0000 7f801172b700 1 --2- 172.21.2.105:0/2595002319 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f800c0ad080 0x7f800c0af730 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7f7ff4002f70 tx=0x7f7ff4006df0).stop 2021-11-12T05:48:10.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.048+0000 7f801172b700 1 -- 172.21.2.105:0/2595002319 shutdown_connections 2021-11-12T05:48:10.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.048+0000 7f801172b700 1 --2- 172.21.2.105:0/2595002319 >> v2:172.21.2.115:3300/0 conn(0x7f800c0ac280 0x7f800c0ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:10.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.048+0000 7f801172b700 1 --2- 172.21.2.105:0/2595002319 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f800c0ad080 0x7f800c0af730 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:10.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.048+0000 7f801172b700 1 -- 172.21.2.105:0/2595002319 >> 172.21.2.105:0/2595002319 conn(0x7f800c0b5370 msgr2=0x7f800c0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:10.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.048+0000 7f801172b700 1 -- 172.21.2.105:0/2595002319 shutdown_connections 2021-11-12T05:48:10.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.048+0000 7f801172b700 1 -- 172.21.2.105:0/2595002319 wait complete. 2021-11-12T05:48:10.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.052+0000 7f801172b700 1 Processor -- start 2021-11-12T05:48:10.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.052+0000 7f801172b700 1 -- start start 2021-11-12T05:48:10.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.052+0000 7f801172b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f800c0ac280 0x7f800c0b4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.052+0000 7f801172b700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f800c0ad080 0x7f800c15a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.052+0000 7f801172b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f800c14abe0 0x7f800c156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.052+0000 7f801172b700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800c063eb0 con 0x7f800c0ac280 2021-11-12T05:48:10.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.052+0000 7f801172b700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800c15a1a0 con 0x7f800c0ad080 2021-11-12T05:48:10.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.052+0000 7f801172b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800c15a440 con 0x7f800c14abe0 2021-11-12T05:48:10.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.052+0000 7f800affd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f800c0ac280 0x7f800c0b4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:10.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.052+0000 7f800affd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f800c0ac280 0x7f800c0b4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49784/0 (socket says 172.21.2.105:49784) 2021-11-12T05:48:10.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.052+0000 7f800affd700 1 -- 172.21.2.105:0/3841419129 learned_addr learned my addr 172.21.2.105:0/3841419129 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:10.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.052+0000 7f800affd700 1 -- 172.21.2.105:0/3841419129 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f800c14abe0 msgr2=0x7f800c156ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:10.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.052+0000 7f800affd700 1 --2- 172.21.2.105:0/3841419129 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f800c14abe0 0x7f800c156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:10.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.052+0000 7f800affd700 1 -- 172.21.2.105:0/3841419129 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f800c0ad080 msgr2=0x7f800c15a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:10.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.052+0000 7f800affd700 1 --2- 172.21.2.105:0/3841419129 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f800c0ad080 0x7f800c15a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:10.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.052+0000 7f800affd700 1 -- 172.21.2.105:0/3841419129 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff400b180 con 0x7f800c0ac280 2021-11-12T05:48:10.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.052+0000 7f800affd700 1 --2- 172.21.2.105:0/3841419129 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f800c0ac280 0x7f800c0b4a60 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7f7ff4002f70 tx=0x7f7ff4014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:10.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.052+0000 7f8003fff700 1 -- 172.21.2.105:0/3841419129 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ff400dea0 con 0x7f800c0ac280 2021-11-12T05:48:10.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.052+0000 7f8003fff700 1 -- 172.21.2.105:0/3841419129 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff401e400 con 0x7f800c0ac280 2021-11-12T05:48:10.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.052+0000 7f801172b700 1 -- 172.21.2.105:0/3841419129 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f800c0b4f50 con 0x7f800c0ac280 2021-11-12T05:48:10.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.052+0000 7f8003fff700 1 -- 172.21.2.105:0/3841419129 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ff401e760 con 0x7f800c0ac280 2021-11-12T05:48:10.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.052+0000 7f801172b700 1 -- 172.21.2.105:0/3841419129 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f800c15add0 con 0x7f800c0ac280 2021-11-12T05:48:10.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.052+0000 7f801172b700 1 -- 172.21.2.105:0/3841419129 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f800c15a600 con 0x7f800c0ac280 2021-11-12T05:48:10.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.052+0000 7f8003fff700 1 -- 172.21.2.105:0/3841419129 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7ff4025030 con 0x7f800c0ac280 2021-11-12T05:48:10.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.052+0000 7f8003fff700 1 --2- 172.21.2.105:0/3841419129 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7ff0053610 0x7f7ff0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.052+0000 7f8003fff700 1 -- 172.21.2.105:0/3841419129 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f7ff406c7b0 con 0x7f800c0ac280 2021-11-12T05:48:10.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.052+0000 7f800a7fc700 1 --2- 172.21.2.105:0/3841419129 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7ff0053610 0x7f7ff0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:10.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.052+0000 7f800a7fc700 1 --2- 172.21.2.105:0/3841419129 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7ff0053610 0x7f7ff0055ad0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f7ffc002f70 tx=0x7f7ffc006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:10.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.056+0000 7f8003fff700 1 -- 172.21.2.105:0/3841419129 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7ff40437c0 con 0x7f800c0ac280 2021-11-12T05:48:10.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.164+0000 7f801172b700 1 -- 172.21.2.105:0/3841419129 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f800c0b1440 con 0x7f800c0ac280 2021-11-12T05:48:10.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.164+0000 7f8003fff700 1 -- 172.21.2.105:0/3841419129 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f800c0b1440 con 0x7f800c0ac280 2021-11-12T05:48:10.169 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:10.169 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":50,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5140,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/1083784348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":1083784348},{"type":"v1","addr":"172.21.2.115:6833","nonce":1083784348}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:48:08.977584+0000","modified":"2021-11-12T05:48:09.981269+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7347},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7347":{"gid":7347,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/3290895957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":3290895957},{"type":"v1","addr":"172.21.2.105:6835","nonce":3290895957}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-11-12T05:48:10.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.164+0000 7f801172b700 1 -- 172.21.2.105:0/3841419129 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7ff0053610 msgr2=0x7f7ff0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:10.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.164+0000 7f801172b700 1 --2- 172.21.2.105:0/3841419129 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7ff0053610 0x7f7ff0055ad0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f7ffc002f70 tx=0x7f7ffc006a80).stop 2021-11-12T05:48:10.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.164+0000 7f801172b700 1 -- 172.21.2.105:0/3841419129 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f800c0ac280 msgr2=0x7f800c0b4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:10.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.164+0000 7f801172b700 1 --2- 172.21.2.105:0/3841419129 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f800c0ac280 0x7f800c0b4a60 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7f7ff4002f70 tx=0x7f7ff4014000).stop 2021-11-12T05:48:10.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.164+0000 7f801172b700 1 -- 172.21.2.105:0/3841419129 shutdown_connections 2021-11-12T05:48:10.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.164+0000 7f801172b700 1 --2- 172.21.2.105:0/3841419129 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7ff0053610 0x7f7ff0055ad0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:10.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.164+0000 7f801172b700 1 --2- 172.21.2.105:0/3841419129 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f800c14abe0 0x7f800c156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:10.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.164+0000 7f801172b700 1 --2- 172.21.2.105:0/3841419129 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f800c0ad080 0x7f800c15a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:10.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.164+0000 7f801172b700 1 --2- 172.21.2.105:0/3841419129 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f800c0ac280 0x7f800c0b4a60 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:10.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.164+0000 7f801172b700 1 -- 172.21.2.105:0/3841419129 >> 172.21.2.105:0/3841419129 conn(0x7f800c0b5370 msgr2=0x7f800c143b90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:10.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.164+0000 7f801172b700 1 -- 172.21.2.105:0/3841419129 shutdown_connections 2021-11-12T05:48:10.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.164+0000 7f801172b700 1 -- 172.21.2.105:0/3841419129 wait complete. 2021-11-12T05:48:10.174 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 50 2021-11-12T05:48:10.176 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:48:10.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.220+0000 7f75938a2700 1 Processor -- start 2021-11-12T05:48:10.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.220+0000 7f75938a2700 1 -- start start 2021-11-12T05:48:10.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f75938a2700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f758c0b5ac0 0x7f758c0b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f75938a2700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f758c0b01b0 0x7f758c0ae470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f75938a2700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f758c0b5ea0 con 0x7f758c0ae960 2021-11-12T05:48:10.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f75938a2700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f758c0b1a60 con 0x7f758c0b5ac0 2021-11-12T05:48:10.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f75938a2700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f758c0accd0 con 0x7f758c0b01b0 2021-11-12T05:48:10.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f7591e3f700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f758c0ae960 0x7f758c0b2240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60188/0 (socket says 172.21.2.105:60188) 2021-11-12T05:48:10.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f7591e3f700 1 -- 172.21.2.105:0/3750003636 learned_addr learned my addr 172.21.2.105:0/3750003636 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:10.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f757ffff700 1 -- 172.21.2.105:0/3750003636 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 674899959 0 0) 0x7f758c0b5ea0 con 0x7f758c0ae960 2021-11-12T05:48:10.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f757ffff700 1 -- 172.21.2.105:0/3750003636 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7574003260 con 0x7f758c0ae960 2021-11-12T05:48:10.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f7590e3d700 1 --2- 172.21.2.105:0/3750003636 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f758c0b01b0 0x7f758c0ae470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:10.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f759163e700 1 --2- 172.21.2.105:0/3750003636 >> v2:172.21.2.115:3300/0 conn(0x7f758c0b5ac0 0x7f758c0b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:10.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f757ffff700 1 -- 172.21.2.105:0/3750003636 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1240163163 0 0) 0x7f7574003260 con 0x7f758c0ae960 2021-11-12T05:48:10.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f757ffff700 1 -- 172.21.2.105:0/3750003636 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f758c0b01b0 msgr2=0x7f758c0ae470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:10.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f757ffff700 1 --2- 172.21.2.105:0/3750003636 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f758c0b01b0 0x7f758c0ae470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:10.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f757ffff700 1 -- 172.21.2.105:0/3750003636 >> v2:172.21.2.115:3300/0 conn(0x7f758c0b5ac0 msgr2=0x7f758c0b13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:10.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f757ffff700 1 --2- 172.21.2.105:0/3750003636 >> v2:172.21.2.115:3300/0 conn(0x7f758c0b5ac0 0x7f758c0b13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:10.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f757ffff700 1 -- 172.21.2.105:0/3750003636 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f758c0acf70 con 0x7f758c0ae960 2021-11-12T05:48:10.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f757ffff700 1 -- 172.21.2.105:0/3750003636 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f75840019e0 con 0x7f758c0ae960 2021-11-12T05:48:10.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f757ffff700 1 -- 172.21.2.105:0/3750003636 >> v1:172.21.2.105:6789/0 conn(0x7f758c0ae960 legacy=0x7f758c0b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:10.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f757ffff700 1 --2- 172.21.2.105:0/3750003636 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75740037d0 0x7f7574003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f757ffff700 1 --2- 172.21.2.105:0/3750003636 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7574004500 0x7f7574004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f757ffff700 1 --2- 172.21.2.105:0/3750003636 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7574004e70 0x7f757400d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f757ffff700 1 -- 172.21.2.105:0/3750003636 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758c0b1a60 con 0x7f75740037d0 2021-11-12T05:48:10.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f757ffff700 1 -- 172.21.2.105:0/3750003636 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758c0accd0 con 0x7f7574004500 2021-11-12T05:48:10.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f757ffff700 1 -- 172.21.2.105:0/3750003636 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757400dfb0 con 0x7f7574004e70 2021-11-12T05:48:10.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f7590e3d700 1 --2- 172.21.2.105:0/3750003636 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f758c0b01b0 0x7f758c0ae470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:48:10.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f759163e700 1 --2- 172.21.2.105:0/3750003636 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75740037d0 0x7f7574003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:10.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f759163e700 1 -- 172.21.2.105:0/3750003636 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7574004e70 msgr2=0x7f757400d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:10.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f759163e700 1 --2- 172.21.2.105:0/3750003636 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7574004e70 0x7f757400d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:10.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f7590e3d700 1 --2- 172.21.2.105:0/3750003636 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7574004500 0x7f7574004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:10.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f759163e700 1 -- 172.21.2.105:0/3750003636 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7574004500 msgr2=0x7f7574004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:10.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f759163e700 1 --2- 172.21.2.105:0/3750003636 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7574004500 0x7f7574004980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:10.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f759163e700 1 -- 172.21.2.105:0/3750003636 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7574003260 con 0x7f75740037d0 2021-11-12T05:48:10.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f759163e700 1 --2- 172.21.2.105:0/3750003636 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75740037d0 0x7f7574003bf0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7f758000a000 tx=0x7f7580008040).ready entity=mon.0 client_cookie=7037491f3a67bb4f server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:10.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f757ffff700 1 -- 172.21.2.105:0/3750003636 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75800128a0 con 0x7f75740037d0 2021-11-12T05:48:10.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f757ffff700 1 -- 172.21.2.105:0/3750003636 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7580012a00 con 0x7f75740037d0 2021-11-12T05:48:10.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f757ffff700 1 -- 172.21.2.105:0/3750003636 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7580012d60 con 0x7f75740037d0 2021-11-12T05:48:10.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f75938a2700 1 -- 172.21.2.105:0/3750003636 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75740037d0 msgr2=0x7f7574003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:10.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f75938a2700 1 --2- 172.21.2.105:0/3750003636 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75740037d0 0x7f7574003bf0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7f758000a000 tx=0x7f7580008040).stop 2021-11-12T05:48:10.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f7591e3f700 1 -- 172.21.2.105:0/3750003636 reap_dead start 2021-11-12T05:48:10.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f75938a2700 1 -- 172.21.2.105:0/3750003636 shutdown_connections 2021-11-12T05:48:10.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f75938a2700 1 -- 172.21.2.105:0/3750003636 >> 172.21.2.105:0/3750003636 conn(0x7f758c0628b0 msgr2=0x7f758c062c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:10.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f75938a2700 1 -- 172.21.2.105:0/3750003636 shutdown_connections 2021-11-12T05:48:10.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f75938a2700 1 -- 172.21.2.105:0/3750003636 wait complete. 2021-11-12T05:48:10.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f75938a2700 1 Processor -- start 2021-11-12T05:48:10.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.224+0000 7f75938a2700 1 -- start start 2021-11-12T05:48:10.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.228+0000 7f75938a2700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75740037d0 0x7f758c142ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.228+0000 7f75938a2700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f758c13cad0 0x7f758c13bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.228+0000 7f75938a2700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f758c065270 0x7f758c14e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.228+0000 7f75938a2700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758c13dc90 con 0x7f75740037d0 2021-11-12T05:48:10.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.228+0000 7f75938a2700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758c064b30 con 0x7f758c13cad0 2021-11-12T05:48:10.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.228+0000 7f75938a2700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f758c064dd0 con 0x7f758c065270 2021-11-12T05:48:10.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.228+0000 7f759163e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75740037d0 0x7f758c142ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:10.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.228+0000 7f759163e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75740037d0 0x7f758c142ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49800/0 (socket says 172.21.2.105:49800) 2021-11-12T05:48:10.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.228+0000 7f759163e700 1 -- 172.21.2.105:0/2364627457 learned_addr learned my addr 172.21.2.105:0/2364627457 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:10.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.228+0000 7f759163e700 1 -- 172.21.2.105:0/2364627457 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f758c065270 msgr2=0x7f758c14e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:10.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.228+0000 7f759163e700 1 --2- 172.21.2.105:0/2364627457 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f758c065270 0x7f758c14e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:10.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.228+0000 7f759163e700 1 -- 172.21.2.105:0/2364627457 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f758c13cad0 msgr2=0x7f758c13bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:10.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.228+0000 7f759163e700 1 --2- 172.21.2.105:0/2364627457 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f758c13cad0 0x7f758c13bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:10.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.228+0000 7f759163e700 1 -- 172.21.2.105:0/2364627457 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f758c0656f0 con 0x7f75740037d0 2021-11-12T05:48:10.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.228+0000 7f759163e700 1 --2- 172.21.2.105:0/2364627457 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75740037d0 0x7f758c142ea0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7f758000a000 tx=0x7f758001c000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:10.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.228+0000 7f757e7fc700 1 -- 172.21.2.105:0/2364627457 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f758001bc50 con 0x7f75740037d0 2021-11-12T05:48:10.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.228+0000 7f757e7fc700 1 -- 172.21.2.105:0/2364627457 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7580000e90 con 0x7f75740037d0 2021-11-12T05:48:10.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.228+0000 7f757e7fc700 1 -- 172.21.2.105:0/2364627457 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7580024410 con 0x7f75740037d0 2021-11-12T05:48:10.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.228+0000 7f75938a2700 1 -- 172.21.2.105:0/2364627457 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f758c14e880 con 0x7f75740037d0 2021-11-12T05:48:10.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.228+0000 7f75938a2700 1 -- 172.21.2.105:0/2364627457 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f758c066d10 con 0x7f75740037d0 2021-11-12T05:48:10.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.228+0000 7f75938a2700 1 -- 172.21.2.105:0/2364627457 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f758c065880 con 0x7f75740037d0 2021-11-12T05:48:10.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.228+0000 7f757e7fc700 1 -- 172.21.2.105:0/2364627457 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7580024570 con 0x7f75740037d0 2021-11-12T05:48:10.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.228+0000 7f757e7fc700 1 --2- 172.21.2.105:0/2364627457 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f756c0536d0 0x7f756c055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.228+0000 7f757e7fc700 1 -- 172.21.2.105:0/2364627457 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f7580070db0 con 0x7f75740037d0 2021-11-12T05:48:10.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.228+0000 7f7590e3d700 1 --2- 172.21.2.105:0/2364627457 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f756c0536d0 0x7f756c055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:10.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.228+0000 7f7590e3d700 1 --2- 172.21.2.105:0/2364627457 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f756c0536d0 0x7f756c055b90 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f7588008000 tx=0x7f7588008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:10.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.232+0000 7f757e7fc700 1 -- 172.21.2.105:0/2364627457 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7580047d60 con 0x7f75740037d0 2021-11-12T05:48:10.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.316+0000 7f75938a2700 1 -- 172.21.2.105:0/2364627457 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f758c064f90 con 0x7f75740037d0 2021-11-12T05:48:10.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.316+0000 7f757e7fc700 1 -- 172.21.2.105:0/2364627457 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f7580029070 con 0x7f75740037d0 2021-11-12T05:48:10.320 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:10.320 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":107,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:48:09.982370+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:48:06.914733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-11-12T05:48:07.950921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:48:10.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.316+0000 7f75938a2700 1 -- 172.21.2.105:0/2364627457 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f756c0536d0 msgr2=0x7f756c055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:10.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.316+0000 7f75938a2700 1 --2- 172.21.2.105:0/2364627457 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f756c0536d0 0x7f756c055b90 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f7588008000 tx=0x7f7588008040).stop 2021-11-12T05:48:10.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.316+0000 7f75938a2700 1 -- 172.21.2.105:0/2364627457 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75740037d0 msgr2=0x7f758c142ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:10.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.316+0000 7f75938a2700 1 --2- 172.21.2.105:0/2364627457 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75740037d0 0x7f758c142ea0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7f758000a000 tx=0x7f758001c000).stop 2021-11-12T05:48:10.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.316+0000 7f75938a2700 1 -- 172.21.2.105:0/2364627457 shutdown_connections 2021-11-12T05:48:10.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.316+0000 7f75938a2700 1 --2- 172.21.2.105:0/2364627457 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f756c0536d0 0x7f756c055b90 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:10.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.316+0000 7f75938a2700 1 --2- 172.21.2.105:0/2364627457 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f758c065270 0x7f758c14e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:10.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.316+0000 7f75938a2700 1 --2- 172.21.2.105:0/2364627457 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f758c13cad0 0x7f758c13bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:10.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.316+0000 7f75938a2700 1 --2- 172.21.2.105:0/2364627457 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75740037d0 0x7f758c142ea0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:10.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.316+0000 7f75938a2700 1 -- 172.21.2.105:0/2364627457 >> 172.21.2.105:0/2364627457 conn(0x7f758c0628b0 msgr2=0x7f758c0b3970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:10.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.316+0000 7f75938a2700 1 -- 172.21.2.105:0/2364627457 shutdown_connections 2021-11-12T05:48:10.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.316+0000 7f75938a2700 1 -- 172.21.2.105:0/2364627457 wait complete. 2021-11-12T05:48:10.328 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-12T05:48:10.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e74999700 1 Processor -- start 2021-11-12T05:48:10.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e74999700 1 -- start start 2021-11-12T05:48:10.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e74999700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9e7014b2f0 0x7f9e700af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e74999700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e700ac7b0 con 0x7f9e700ac280 2021-11-12T05:48:10.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e74999700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e700ac9e0 con 0x7f9e700ad080 2021-11-12T05:48:10.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e74999700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e701488a0 con 0x7f9e7014b2f0 2021-11-12T05:48:10.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e6dd9b700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f9e700ac280 0x7f9e70147a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60206/0 (socket says 172.21.2.105:60206) 2021-11-12T05:48:10.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e6dd9b700 1 -- 172.21.2.105:0/134399676 learned_addr learned my addr 172.21.2.105:0/134399676 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:10.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e6d59a700 1 -- 172.21.2.105:0/134399676 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2092898912 0 0) 0x7f9e700ac7b0 con 0x7f9e700ac280 2021-11-12T05:48:10.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e6d59a700 1 -- 172.21.2.105:0/134399676 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e54003260 con 0x7f9e700ac280 2021-11-12T05:48:10.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e6d59a700 1 -- 172.21.2.105:0/134399676 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 874228114 0 0) 0x7f9e54003260 con 0x7f9e700ac280 2021-11-12T05:48:10.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e6d59a700 1 -- 172.21.2.105:0/134399676 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9e7014b2f0 msgr2=0x7f9e700af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:10.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e6d59a700 1 --2- 172.21.2.105:0/134399676 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9e7014b2f0 0x7f9e700af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:10.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e6d59a700 1 -- 172.21.2.105:0/134399676 >> v1:172.21.2.115:6789/0 conn(0x7f9e700ad080 legacy=0x7f9e7014abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:10.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e6d59a700 1 -- 172.21.2.105:0/134399676 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e700b0b30 con 0x7f9e700ac280 2021-11-12T05:48:10.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e6d59a700 1 -- 172.21.2.105:0/134399676 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f9e60001660 con 0x7f9e700ac280 2021-11-12T05:48:10.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e6d59a700 1 -- 172.21.2.105:0/134399676 >> v1:172.21.2.105:6789/0 conn(0x7f9e700ac280 legacy=0x7f9e70147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:10.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e6d59a700 1 --2- 172.21.2.105:0/134399676 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9e54003800 0x7f9e54003c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e6d59a700 1 --2- 172.21.2.105:0/134399676 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9e7014b2f0 0x7f9e54004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e6d59a700 1 --2- 172.21.2.105:0/134399676 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9e54004bf0 0x7f9e5400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e6d59a700 1 -- 172.21.2.105:0/134399676 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e701488a0 con 0x7f9e54004bf0 2021-11-12T05:48:10.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e6d59a700 1 -- 172.21.2.105:0/134399676 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e540052d0 con 0x7f9e54003800 2021-11-12T05:48:10.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e6d59a700 1 -- 172.21.2.105:0/134399676 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5400bc40 con 0x7f9e7014b2f0 2021-11-12T05:48:10.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e6ed9d700 1 --2- 172.21.2.105:0/134399676 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9e54004bf0 0x7f9e5400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:10.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e6e59c700 1 --2- 172.21.2.105:0/134399676 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9e54003800 0x7f9e54003c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:10.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e6ed9d700 1 -- 172.21.2.105:0/134399676 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9e7014b2f0 msgr2=0x7f9e54004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:10.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e6ed9d700 1 --2- 172.21.2.105:0/134399676 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9e7014b2f0 0x7f9e54004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:10.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e6ed9d700 1 -- 172.21.2.105:0/134399676 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9e54003800 msgr2=0x7f9e54003c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:10.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e6ed9d700 1 --2- 172.21.2.105:0/134399676 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9e54003800 0x7f9e54003c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:10.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e6ed9d700 1 -- 172.21.2.105:0/134399676 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e54003260 con 0x7f9e54004bf0 2021-11-12T05:48:10.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e6ed9d700 1 --2- 172.21.2.105:0/134399676 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9e54004bf0 0x7f9e5400b750 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7f9e680032f0 tx=0x7f9e68006f90).ready entity=mon.0 client_cookie=3246ce63c4158bc7 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:10.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e6d59a700 1 -- 172.21.2.105:0/134399676 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e6800b460 con 0x7f9e54004bf0 2021-11-12T05:48:10.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e6d59a700 1 -- 172.21.2.105:0/134399676 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e6800b5c0 con 0x7f9e54004bf0 2021-11-12T05:48:10.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e6d59a700 1 -- 172.21.2.105:0/134399676 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e6800b730 con 0x7f9e54004bf0 2021-11-12T05:48:10.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e74999700 1 -- 172.21.2.105:0/134399676 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9e54004bf0 msgr2=0x7f9e5400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:10.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e74999700 1 --2- 172.21.2.105:0/134399676 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9e54004bf0 0x7f9e5400b750 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7f9e680032f0 tx=0x7f9e68006f90).stop 2021-11-12T05:48:10.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e6ed9d700 1 -- 172.21.2.105:0/134399676 reap_dead start 2021-11-12T05:48:10.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e74999700 1 -- 172.21.2.105:0/134399676 shutdown_connections 2021-11-12T05:48:10.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e74999700 1 -- 172.21.2.105:0/134399676 >> 172.21.2.105:0/134399676 conn(0x7f9e700b5370 msgr2=0x7f9e700b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:10.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e74999700 1 -- 172.21.2.105:0/134399676 shutdown_connections 2021-11-12T05:48:10.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.380+0000 7f9e74999700 1 -- 172.21.2.105:0/134399676 wait complete. 2021-11-12T05:48:10.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.384+0000 7f9e74999700 1 Processor -- start 2021-11-12T05:48:10.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.384+0000 7f9e74999700 1 -- start start 2021-11-12T05:48:10.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.384+0000 7f9e74999700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9e54004bf0 0x7f9e700ab2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.384+0000 7f9e74999700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9e700abad0 0x7f9e70156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.384+0000 7f9e74999700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9e70157330 0x7f9e700a7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.384+0000 7f9e74999700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e70157830 con 0x7f9e54004bf0 2021-11-12T05:48:10.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.384+0000 7f9e74999700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e70157ad0 con 0x7f9e70157330 2021-11-12T05:48:10.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.384+0000 7f9e74999700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7014b020 con 0x7f9e700abad0 2021-11-12T05:48:10.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.384+0000 7f9e6e59c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9e54004bf0 0x7f9e700ab2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:10.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.384+0000 7f9e6e59c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9e54004bf0 0x7f9e700ab2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49820/0 (socket says 172.21.2.105:49820) 2021-11-12T05:48:10.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.384+0000 7f9e6e59c700 1 -- 172.21.2.105:0/1570417763 learned_addr learned my addr 172.21.2.105:0/1570417763 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:10.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.384+0000 7f9e6e59c700 1 -- 172.21.2.105:0/1570417763 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9e700abad0 msgr2=0x7f9e70156e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:10.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.384+0000 7f9e6e59c700 1 --2- 172.21.2.105:0/1570417763 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9e700abad0 0x7f9e70156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:10.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.384+0000 7f9e6e59c700 1 -- 172.21.2.105:0/1570417763 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9e70157330 msgr2=0x7f9e700a7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:10.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.384+0000 7f9e6e59c700 1 --2- 172.21.2.105:0/1570417763 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9e70157330 0x7f9e700a7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:10.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.384+0000 7f9e6e59c700 1 -- 172.21.2.105:0/1570417763 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e700a7020 con 0x7f9e54004bf0 2021-11-12T05:48:10.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.384+0000 7f9e6e59c700 1 --2- 172.21.2.105:0/1570417763 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9e54004bf0 0x7f9e700ab2c0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7f9e6400b000 tx=0x7f9e64009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:10.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.384+0000 7f9e5f7fe700 1 -- 172.21.2.105:0/1570417763 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e64015630 con 0x7f9e54004bf0 2021-11-12T05:48:10.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.384+0000 7f9e5f7fe700 1 -- 172.21.2.105:0/1570417763 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e64000e90 con 0x7f9e54004bf0 2021-11-12T05:48:10.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.384+0000 7f9e74999700 1 -- 172.21.2.105:0/1570417763 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e700a72d0 con 0x7f9e54004bf0 2021-11-12T05:48:10.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.384+0000 7f9e74999700 1 -- 172.21.2.105:0/1570417763 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e700a8060 con 0x7f9e54004bf0 2021-11-12T05:48:10.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.384+0000 7f9e5f7fe700 1 -- 172.21.2.105:0/1570417763 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e64015980 con 0x7f9e54004bf0 2021-11-12T05:48:10.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.384+0000 7f9e74999700 1 -- 172.21.2.105:0/1570417763 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e700b1440 con 0x7f9e54004bf0 2021-11-12T05:48:10.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.384+0000 7f9e5f7fe700 1 -- 172.21.2.105:0/1570417763 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9e64015ae0 con 0x7f9e54004bf0 2021-11-12T05:48:10.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.384+0000 7f9e5f7fe700 1 --2- 172.21.2.105:0/1570417763 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9e4c0535d0 0x7f9e4c055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.384+0000 7f9e5f7fe700 1 -- 172.21.2.105:0/1570417763 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f9e6406b960 con 0x7f9e54004bf0 2021-11-12T05:48:10.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.384+0000 7f9e6dd9b700 1 --2- 172.21.2.105:0/1570417763 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9e4c0535d0 0x7f9e4c055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:10.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.384+0000 7f9e6dd9b700 1 --2- 172.21.2.105:0/1570417763 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9e4c0535d0 0x7f9e4c055a90 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f9e700b60a0 tx=0x7f9e60001590).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:10.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.388+0000 7f9e5f7fe700 1 -- 172.21.2.105:0/1570417763 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9e64042860 con 0x7f9e54004bf0 2021-11-12T05:48:10.505 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.500+0000 7f9e74999700 1 -- 172.21.2.105:0/1570417763 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f9e70057350 con 0x7f9e54004bf0 2021-11-12T05:48:10.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.504+0000 7f9e5f7fe700 1 -- 172.21.2.105:0/1570417763 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v34) v1 ==== 184+0+0 (secure 0 0 0) 0x7f9e64045e80 con 0x7f9e54004bf0 2021-11-12T05:48:10.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.508+0000 7f9e74999700 1 -- 172.21.2.105:0/1570417763 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9e4c0535d0 msgr2=0x7f9e4c055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:10.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.508+0000 7f9e74999700 1 --2- 172.21.2.105:0/1570417763 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9e4c0535d0 0x7f9e4c055a90 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f9e700b60a0 tx=0x7f9e60001590).stop 2021-11-12T05:48:10.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.508+0000 7f9e74999700 1 -- 172.21.2.105:0/1570417763 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9e54004bf0 msgr2=0x7f9e700ab2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:10.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.508+0000 7f9e74999700 1 --2- 172.21.2.105:0/1570417763 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9e54004bf0 0x7f9e700ab2c0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7f9e6400b000 tx=0x7f9e64009040).stop 2021-11-12T05:48:10.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.508+0000 7f9e74999700 1 -- 172.21.2.105:0/1570417763 shutdown_connections 2021-11-12T05:48:10.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.508+0000 7f9e74999700 1 --2- 172.21.2.105:0/1570417763 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9e4c0535d0 0x7f9e4c055a90 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:10.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.508+0000 7f9e74999700 1 --2- 172.21.2.105:0/1570417763 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9e70157330 0x7f9e700a7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:10.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.508+0000 7f9e74999700 1 --2- 172.21.2.105:0/1570417763 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9e700abad0 0x7f9e70156e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:10.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.508+0000 7f9e74999700 1 --2- 172.21.2.105:0/1570417763 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9e54004bf0 0x7f9e700ab2c0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:10.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.508+0000 7f9e74999700 1 -- 172.21.2.105:0/1570417763 >> 172.21.2.105:0/1570417763 conn(0x7f9e700b5370 msgr2=0x7f9e70060210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:10.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.508+0000 7f9e74999700 1 -- 172.21.2.105:0/1570417763 shutdown_connections 2021-11-12T05:48:10.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.508+0000 7f9e74999700 1 -- 172.21.2.105:0/1570417763 wait complete. 2021-11-12T05:48:10.516 INFO:teuthology.orchestra.run.gibba005.stderr:updated caps for client.0 2021-11-12T05:48:10.519 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-12T05:48:10.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.568+0000 7faf645a6700 1 Processor -- start 2021-11-12T05:48:10.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.568+0000 7faf645a6700 1 -- start start 2021-11-12T05:48:10.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.568+0000 7faf645a6700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7faf5c0af220 0x7faf5c0af600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.568+0000 7faf645a6700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7faf5c05fa00 0x7faf5c0aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.568+0000 7faf645a6700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf5c0aa9c0 con 0x7faf5c067210 2021-11-12T05:48:10.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.568+0000 7faf645a6700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf5c0a9ba0 con 0x7faf5c0af220 2021-11-12T05:48:10.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.568+0000 7faf645a6700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf5c0a9d90 con 0x7faf5c05fa00 2021-11-12T05:48:10.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.568+0000 7faf62342700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7faf5c0af220 0x7faf5c0af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:10.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.568+0000 7faf62342700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7faf5c0af220 0x7faf5c0af600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49828/0 (socket says 172.21.2.105:49828) 2021-11-12T05:48:10.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.568+0000 7faf62342700 1 -- 172.21.2.105:0/4148624889 learned_addr learned my addr 172.21.2.105:0/4148624889 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:10.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.568+0000 7faf62b43700 1 --1- 172.21.2.105:0/4148624889 >> v1:172.21.2.105:6789/0 conn(0x7faf5c067210 0x7faf5c0b2600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60224/0 (socket says 172.21.2.105:60224) 2021-11-12T05:48:10.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.568+0000 7faf62342700 1 -- 172.21.2.105:0/4148624889 >> v2:172.21.2.115:3300/0 conn(0x7faf5c05fa00 msgr2=0x7faf5c0aa4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:10.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.568+0000 7faf62342700 1 --2- 172.21.2.105:0/4148624889 >> v2:172.21.2.115:3300/0 conn(0x7faf5c05fa00 0x7faf5c0aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:10.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.568+0000 7faf62342700 1 -- 172.21.2.105:0/4148624889 >> v1:172.21.2.105:6789/0 conn(0x7faf5c067210 legacy=0x7faf5c0b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:10.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.568+0000 7faf62342700 1 -- 172.21.2.105:0/4148624889 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5c0aa030 con 0x7faf5c0af220 2021-11-12T05:48:10.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.568+0000 7faf62342700 1 --2- 172.21.2.105:0/4148624889 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faf5c0af220 0x7faf5c0af600 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7faf50002f70 tx=0x7faf50006eb0).ready entity=mon.0 client_cookie=a69ba468ce21b7cb server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:10.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.568+0000 7faf61340700 1 -- 172.21.2.105:0/4148624889 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf5000d610 con 0x7faf5c0af220 2021-11-12T05:48:10.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.568+0000 7faf61340700 1 -- 172.21.2.105:0/4148624889 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf50000e90 con 0x7faf5c0af220 2021-11-12T05:48:10.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.568+0000 7faf61340700 1 -- 172.21.2.105:0/4148624889 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf5000d9a0 con 0x7faf5c0af220 2021-11-12T05:48:10.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.572+0000 7faf645a6700 1 -- 172.21.2.105:0/4148624889 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faf5c0af220 msgr2=0x7faf5c0af600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:10.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.572+0000 7faf645a6700 1 --2- 172.21.2.105:0/4148624889 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faf5c0af220 0x7faf5c0af600 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7faf50002f70 tx=0x7faf50006eb0).stop 2021-11-12T05:48:10.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.572+0000 7faf645a6700 1 -- 172.21.2.105:0/4148624889 shutdown_connections 2021-11-12T05:48:10.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.572+0000 7faf645a6700 1 --2- 172.21.2.105:0/4148624889 >> v2:172.21.2.115:3300/0 conn(0x7faf5c05fa00 0x7faf5c0aa4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:10.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.572+0000 7faf645a6700 1 --2- 172.21.2.105:0/4148624889 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faf5c0af220 0x7faf5c0af600 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:10.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.572+0000 7faf645a6700 1 -- 172.21.2.105:0/4148624889 >> 172.21.2.105:0/4148624889 conn(0x7faf5c068440 msgr2=0x7faf5c062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:10.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.572+0000 7faf645a6700 1 -- 172.21.2.105:0/4148624889 shutdown_connections 2021-11-12T05:48:10.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.572+0000 7faf645a6700 1 -- 172.21.2.105:0/4148624889 wait complete. 2021-11-12T05:48:10.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.572+0000 7faf645a6700 1 Processor -- start 2021-11-12T05:48:10.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.572+0000 7faf645a6700 1 -- start start 2021-11-12T05:48:10.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.572+0000 7faf645a6700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7faf5c05fa00 0x7faf5c0ac1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.572+0000 7faf645a6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faf5c067210 0x7faf5c142c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.572+0000 7faf645a6700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7faf5c0af220 0x7faf5c143120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.572+0000 7faf645a6700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c066430 con 0x7faf5c067210 2021-11-12T05:48:10.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.572+0000 7faf645a6700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c063e50 con 0x7faf5c0af220 2021-11-12T05:48:10.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.572+0000 7faf645a6700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c13aed0 con 0x7faf5c05fa00 2021-11-12T05:48:10.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.572+0000 7faf61b41700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faf5c067210 0x7faf5c142c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:10.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.572+0000 7faf61b41700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faf5c067210 0x7faf5c142c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49836/0 (socket says 172.21.2.105:49836) 2021-11-12T05:48:10.586 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.572+0000 7faf61b41700 1 -- 172.21.2.105:0/3500273157 learned_addr learned my addr 172.21.2.105:0/3500273157 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:10.586 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.572+0000 7faf61b41700 1 -- 172.21.2.105:0/3500273157 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7faf5c05fa00 msgr2=0x7faf5c0ac1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:10.586 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.572+0000 7faf61b41700 1 --2- 172.21.2.105:0/3500273157 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7faf5c05fa00 0x7faf5c0ac1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:10.586 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.572+0000 7faf61b41700 1 -- 172.21.2.105:0/3500273157 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7faf5c0af220 msgr2=0x7faf5c143120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:10.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.572+0000 7faf61b41700 1 --2- 172.21.2.105:0/3500273157 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7faf5c0af220 0x7faf5c143120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:10.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.572+0000 7faf61b41700 1 -- 172.21.2.105:0/3500273157 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5000b1e0 con 0x7faf5c067210 2021-11-12T05:48:10.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.572+0000 7faf61b41700 1 --2- 172.21.2.105:0/3500273157 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faf5c067210 0x7faf5c142c30 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7faf58002f70 tx=0x7faf58006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:10.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.572+0000 7faf4f7fe700 1 -- 172.21.2.105:0/3500273157 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf58013460 con 0x7faf5c067210 2021-11-12T05:48:10.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.572+0000 7faf4f7fe700 1 -- 172.21.2.105:0/3500273157 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf580135c0 con 0x7faf5c067210 2021-11-12T05:48:10.588 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.572+0000 7faf645a6700 1 -- 172.21.2.105:0/3500273157 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf5c0ac6e0 con 0x7faf5c067210 2021-11-12T05:48:10.588 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.572+0000 7faf645a6700 1 -- 172.21.2.105:0/3500273157 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf5c140470 con 0x7faf5c067210 2021-11-12T05:48:10.588 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.572+0000 7faf4f7fe700 1 -- 172.21.2.105:0/3500273157 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf58013920 con 0x7faf5c067210 2021-11-12T05:48:10.588 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.572+0000 7faf645a6700 1 -- 172.21.2.105:0/3500273157 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf38003410 con 0x7faf5c067210 2021-11-12T05:48:10.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.572+0000 7faf4f7fe700 1 -- 172.21.2.105:0/3500273157 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faf5801a060 con 0x7faf5c067210 2021-11-12T05:48:10.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.572+0000 7faf4f7fe700 1 --2- 172.21.2.105:0/3500273157 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7faf3c0536f0 0x7faf3c055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.576+0000 7faf4f7fe700 1 -- 172.21.2.105:0/3500273157 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6416+0+0 (secure 0 0 0) 0x7faf5806b5b0 con 0x7faf5c067210 2021-11-12T05:48:10.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.576+0000 7faf62342700 1 --2- 172.21.2.105:0/3500273157 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7faf3c0536f0 0x7faf3c055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:10.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.576+0000 7faf62342700 1 --2- 172.21.2.105:0/3500273157 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7faf3c0536f0 0x7faf3c055bb0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7faf50002f70 tx=0x7faf50015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:10.590 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.576+0000 7faf4f7fe700 1 -- 172.21.2.105:0/3500273157 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faf580424b0 con 0x7faf5c067210 2021-11-12T05:48:10.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.688+0000 7faf645a6700 1 -- 172.21.2.105:0/3500273157 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7faf380036c0 con 0x7faf5c067210 2021-11-12T05:48:10.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.696+0000 7faf4f7fe700 1 -- 172.21.2.105:0/3500273157 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v35) v1 ==== 184+0+0 (secure 0 0 0) 0x7faf58045ad0 con 0x7faf5c067210 2021-11-12T05:48:10.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.696+0000 7faf645a6700 1 -- 172.21.2.105:0/3500273157 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7faf3c0536f0 msgr2=0x7faf3c055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:10.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.696+0000 7faf645a6700 1 --2- 172.21.2.105:0/3500273157 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7faf3c0536f0 0x7faf3c055bb0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7faf50002f70 tx=0x7faf50015000).stop 2021-11-12T05:48:10.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.696+0000 7faf645a6700 1 -- 172.21.2.105:0/3500273157 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faf5c067210 msgr2=0x7faf5c142c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:10.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.696+0000 7faf645a6700 1 --2- 172.21.2.105:0/3500273157 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faf5c067210 0x7faf5c142c30 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7faf58002f70 tx=0x7faf58006ec0).stop 2021-11-12T05:48:10.702 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.696+0000 7faf645a6700 1 -- 172.21.2.105:0/3500273157 shutdown_connections 2021-11-12T05:48:10.702 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.696+0000 7faf645a6700 1 --2- 172.21.2.105:0/3500273157 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7faf3c0536f0 0x7faf3c055bb0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:10.702 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.696+0000 7faf645a6700 1 --2- 172.21.2.105:0/3500273157 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7faf5c0af220 0x7faf5c143120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:10.702 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.696+0000 7faf645a6700 1 --2- 172.21.2.105:0/3500273157 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faf5c067210 0x7faf5c142c30 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:10.703 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.696+0000 7faf645a6700 1 --2- 172.21.2.105:0/3500273157 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7faf5c05fa00 0x7faf5c0ac1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:10.703 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.696+0000 7faf645a6700 1 -- 172.21.2.105:0/3500273157 >> 172.21.2.105:0/3500273157 conn(0x7faf5c068440 msgr2=0x7faf5c1411f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:10.703 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.696+0000 7faf645a6700 1 -- 172.21.2.105:0/3500273157 shutdown_connections 2021-11-12T05:48:10.703 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.696+0000 7faf645a6700 1 -- 172.21.2.105:0/3500273157 wait complete. 2021-11-12T05:48:10.704 INFO:teuthology.orchestra.run.gibba005.stderr:updated caps for client.1 2021-11-12T05:48:10.707 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-12T05:48:10.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.756+0000 7f3a1f1a3700 1 Processor -- start 2021-11-12T05:48:10.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.756+0000 7f3a1f1a3700 1 -- start start 2021-11-12T05:48:10.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.756+0000 7f3a1f1a3700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f3a1814b2f0 0x7f3a180af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.756+0000 7f3a1f1a3700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a180ac7b0 con 0x7f3a180ac280 2021-11-12T05:48:10.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.756+0000 7f3a1f1a3700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a180ac9e0 con 0x7f3a180ad080 2021-11-12T05:48:10.763 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.756+0000 7f3a1f1a3700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a181488a0 con 0x7f3a1814b2f0 2021-11-12T05:48:10.768 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.756+0000 7f3a17fff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f3a180ac280 0x7f3a18147a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60242/0 (socket says 172.21.2.105:60242) 2021-11-12T05:48:10.768 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.756+0000 7f3a17fff700 1 -- 172.21.2.105:0/3943128052 learned_addr learned my addr 172.21.2.105:0/3943128052 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:10.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.756+0000 7f3a177fe700 1 -- 172.21.2.105:0/3943128052 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2838331470 0 0) 0x7f3a180ac7b0 con 0x7f3a180ac280 2021-11-12T05:48:10.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.756+0000 7f3a177fe700 1 -- 172.21.2.105:0/3943128052 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a04003260 con 0x7f3a180ac280 2021-11-12T05:48:10.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.756+0000 7f3a177fe700 1 -- 172.21.2.105:0/3943128052 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2165068366 0 0) 0x7f3a04003260 con 0x7f3a180ac280 2021-11-12T05:48:10.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.756+0000 7f3a1d740700 1 --2- 172.21.2.105:0/3943128052 >> v2:172.21.2.115:3300/0 conn(0x7f3a1814b2f0 0x7f3a180af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:10.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.756+0000 7f3a177fe700 1 -- 172.21.2.105:0/3943128052 >> v2:172.21.2.115:3300/0 conn(0x7f3a1814b2f0 msgr2=0x7f3a180af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:10.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.756+0000 7f3a177fe700 1 --2- 172.21.2.105:0/3943128052 >> v2:172.21.2.115:3300/0 conn(0x7f3a1814b2f0 0x7f3a180af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:10.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.756+0000 7f3a177fe700 1 -- 172.21.2.105:0/3943128052 >> v1:172.21.2.115:6789/0 conn(0x7f3a180ad080 legacy=0x7f3a1814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:10.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.756+0000 7f3a177fe700 1 -- 172.21.2.105:0/3943128052 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a180b0b30 con 0x7f3a180ac280 2021-11-12T05:48:10.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.756+0000 7f3a177fe700 1 -- 172.21.2.105:0/3943128052 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f3a0c001660 con 0x7f3a180ac280 2021-11-12T05:48:10.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.756+0000 7f3a1d740700 1 --2- 172.21.2.105:0/3943128052 >> v2:172.21.2.115:3300/0 conn(0x7f3a1814b2f0 0x7f3a180af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:48:10.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.756+0000 7f3a177fe700 1 -- 172.21.2.105:0/3943128052 >> v1:172.21.2.105:6789/0 conn(0x7f3a180ac280 legacy=0x7f3a18147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:10.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.756+0000 7f3a177fe700 1 --2- 172.21.2.105:0/3943128052 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3a04003820 0x7f3a04003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.756+0000 7f3a177fe700 1 --2- 172.21.2.105:0/3943128052 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3a04004500 0x7f3a04004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.772 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.756+0000 7f3a177fe700 1 --2- 172.21.2.105:0/3943128052 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a04005050 0x7f3a0400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.772 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.756+0000 7f3a177fe700 1 -- 172.21.2.105:0/3943128052 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a181488a0 con 0x7f3a04005050 2021-11-12T05:48:10.772 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a177fe700 1 -- 172.21.2.105:0/3943128052 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0400bf40 con 0x7f3a04003820 2021-11-12T05:48:10.772 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a177fe700 1 -- 172.21.2.105:0/3943128052 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0400c100 con 0x7f3a04004500 2021-11-12T05:48:10.772 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a1d740700 1 --2- 172.21.2.105:0/3943128052 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a04005050 0x7f3a0400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:10.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a1cf3f700 1 --2- 172.21.2.105:0/3943128052 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3a04003820 0x7f3a04003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:10.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a17fff700 1 --2- 172.21.2.105:0/3943128052 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3a04004500 0x7f3a04004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:10.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a1d740700 1 -- 172.21.2.105:0/3943128052 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3a04004500 msgr2=0x7f3a04004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:10.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a1d740700 1 --2- 172.21.2.105:0/3943128052 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3a04004500 0x7f3a04004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:10.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a1d740700 1 -- 172.21.2.105:0/3943128052 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3a04003820 msgr2=0x7f3a04003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:10.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a1d740700 1 --2- 172.21.2.105:0/3943128052 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3a04003820 0x7f3a04003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:10.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a1d740700 1 -- 172.21.2.105:0/3943128052 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a04003260 con 0x7f3a04005050 2021-11-12T05:48:10.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a1cf3f700 1 --2- 172.21.2.105:0/3943128052 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3a04003820 0x7f3a04003c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:48:10.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a17fff700 1 --2- 172.21.2.105:0/3943128052 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3a04004500 0x7f3a04004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:48:10.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a1d740700 1 -- 172.21.2.105:0/3943128052 reap_dead start 2021-11-12T05:48:10.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a1d740700 1 --2- 172.21.2.105:0/3943128052 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a04005050 0x7f3a0400b750 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 rx=0x7f3a10007000 tx=0x7f3a10008040).ready entity=mon.0 client_cookie=54204fc8da2c47fe server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:10.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a177fe700 1 -- 172.21.2.105:0/3943128052 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a10006b40 con 0x7f3a04005050 2021-11-12T05:48:10.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a177fe700 1 -- 172.21.2.105:0/3943128052 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1000c710 con 0x7f3a04005050 2021-11-12T05:48:10.776 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a177fe700 1 -- 172.21.2.105:0/3943128052 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a1000c880 con 0x7f3a04005050 2021-11-12T05:48:10.776 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a1f1a3700 1 -- 172.21.2.105:0/3943128052 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a04005050 msgr2=0x7f3a0400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:10.776 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a1f1a3700 1 --2- 172.21.2.105:0/3943128052 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a04005050 0x7f3a0400b750 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 rx=0x7f3a10007000 tx=0x7f3a10008040).stop 2021-11-12T05:48:10.776 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a1f1a3700 1 -- 172.21.2.105:0/3943128052 shutdown_connections 2021-11-12T05:48:10.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a1f1a3700 1 --2- 172.21.2.105:0/3943128052 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a04005050 0x7f3a0400b750 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:10.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a1f1a3700 1 -- 172.21.2.105:0/3943128052 >> 172.21.2.105:0/3943128052 conn(0x7f3a180b5370 msgr2=0x7f3a180b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:10.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a1f1a3700 1 -- 172.21.2.105:0/3943128052 shutdown_connections 2021-11-12T05:48:10.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a1f1a3700 1 -- 172.21.2.105:0/3943128052 wait complete. 2021-11-12T05:48:10.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a1f1a3700 1 Processor -- start 2021-11-12T05:48:10.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a1f1a3700 1 -- start start 2021-11-12T05:48:10.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a1f1a3700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a04005050 0x7f3a180a9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a1f1a3700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3a180a93a0 0x7f3a18145e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a1f1a3700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3a1815a3d0 0x7f3a1815a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a1f1a3700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a180a9170 con 0x7f3a04005050 2021-11-12T05:48:10.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a1f1a3700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a18063ac0 con 0x7f3a1815a3d0 2021-11-12T05:48:10.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a1f1a3700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a18063d60 con 0x7f3a180a93a0 2021-11-12T05:48:10.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a1cf3f700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a04005050 0x7f3a180a9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:10.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a1cf3f700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a04005050 0x7f3a180a9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49854/0 (socket says 172.21.2.105:49854) 2021-11-12T05:48:10.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a1cf3f700 1 -- 172.21.2.105:0/2358041380 learned_addr learned my addr 172.21.2.105:0/2358041380 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:10.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a1cf3f700 1 -- 172.21.2.105:0/2358041380 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3a180a93a0 msgr2=0x7f3a18145e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:10.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a1cf3f700 1 --2- 172.21.2.105:0/2358041380 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3a180a93a0 0x7f3a18145e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:10.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a1cf3f700 1 -- 172.21.2.105:0/2358041380 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3a1815a3d0 msgr2=0x7f3a1815a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:10.781 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a1cf3f700 1 --2- 172.21.2.105:0/2358041380 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3a1815a3d0 0x7f3a1815a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:10.781 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a1cf3f700 1 -- 172.21.2.105:0/2358041380 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a18159f30 con 0x7f3a04005050 2021-11-12T05:48:10.781 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a1cf3f700 1 --2- 172.21.2.105:0/2358041380 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a04005050 0x7f3a180a9df0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f3a0800b000 tx=0x7f3a08009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:10.781 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a15ffb700 1 -- 172.21.2.105:0/2358041380 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a08015630 con 0x7f3a04005050 2021-11-12T05:48:10.782 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a15ffb700 1 -- 172.21.2.105:0/2358041380 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a08000e90 con 0x7f3a04005050 2021-11-12T05:48:10.782 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a1f1a3700 1 -- 172.21.2.105:0/2358041380 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a1815ad40 con 0x7f3a04005050 2021-11-12T05:48:10.782 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a15ffb700 1 -- 172.21.2.105:0/2358041380 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a08015980 con 0x7f3a04005050 2021-11-12T05:48:10.782 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a1f1a3700 1 -- 172.21.2.105:0/2358041380 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a180a7240 con 0x7f3a04005050 2021-11-12T05:48:10.782 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.760+0000 7f3a1f1a3700 1 -- 172.21.2.105:0/2358041380 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a1815a0c0 con 0x7f3a04005050 2021-11-12T05:48:10.783 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.764+0000 7f3a15ffb700 1 -- 172.21.2.105:0/2358041380 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3a0801b020 con 0x7f3a04005050 2021-11-12T05:48:10.783 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.764+0000 7f3a15ffb700 1 --2- 172.21.2.105:0/2358041380 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f39f8053610 0x7f39f8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.783 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.764+0000 7f3a15ffb700 1 -- 172.21.2.105:0/2358041380 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f3a0806b870 con 0x7f3a04005050 2021-11-12T05:48:10.783 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.764+0000 7f3a17fff700 1 --2- 172.21.2.105:0/2358041380 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f39f8053610 0x7f39f8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:10.784 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.764+0000 7f3a17fff700 1 --2- 172.21.2.105:0/2358041380 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f39f8053610 0x7f39f8055ad0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f3a0c00b000 tx=0x7f3a180ada20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:10.784 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.764+0000 7f3a15ffb700 1 -- 172.21.2.105:0/2358041380 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3a08042880 con 0x7f3a04005050 2021-11-12T05:48:10.881 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.876+0000 7f3a1f1a3700 1 -- 172.21.2.105:0/2358041380 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f3a180b1440 con 0x7f3a04005050 2021-11-12T05:48:10.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.880+0000 7f3a15ffb700 1 -- 172.21.2.105:0/2358041380 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v36) v1 ==== 184+0+0 (secure 0 0 0) 0x7f3a08045ea0 con 0x7f3a04005050 2021-11-12T05:48:10.888 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.884+0000 7f3a1f1a3700 1 -- 172.21.2.105:0/2358041380 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f39f8053610 msgr2=0x7f39f8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:10.888 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.884+0000 7f3a1f1a3700 1 --2- 172.21.2.105:0/2358041380 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f39f8053610 0x7f39f8055ad0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f3a0c00b000 tx=0x7f3a180ada20).stop 2021-11-12T05:48:10.888 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.884+0000 7f3a1f1a3700 1 -- 172.21.2.105:0/2358041380 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a04005050 msgr2=0x7f3a180a9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:10.888 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.884+0000 7f3a1f1a3700 1 --2- 172.21.2.105:0/2358041380 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a04005050 0x7f3a180a9df0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f3a0800b000 tx=0x7f3a08009040).stop 2021-11-12T05:48:10.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.884+0000 7f3a1f1a3700 1 -- 172.21.2.105:0/2358041380 shutdown_connections 2021-11-12T05:48:10.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.884+0000 7f3a1f1a3700 1 --2- 172.21.2.105:0/2358041380 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f39f8053610 0x7f39f8055ad0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:10.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.884+0000 7f3a1f1a3700 1 --2- 172.21.2.105:0/2358041380 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3a1815a3d0 0x7f3a1815a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:10.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.884+0000 7f3a1f1a3700 1 --2- 172.21.2.105:0/2358041380 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3a180a93a0 0x7f3a18145e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:10.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.884+0000 7f3a1f1a3700 1 --2- 172.21.2.105:0/2358041380 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a04005050 0x7f3a180a9df0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:10.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.884+0000 7f3a1f1a3700 1 -- 172.21.2.105:0/2358041380 >> 172.21.2.105:0/2358041380 conn(0x7f3a180b5370 msgr2=0x7f3a18148020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:10.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.884+0000 7f3a1f1a3700 1 -- 172.21.2.105:0/2358041380 shutdown_connections 2021-11-12T05:48:10.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.884+0000 7f3a1f1a3700 1 -- 172.21.2.105:0/2358041380 wait complete. 2021-11-12T05:48:10.891 INFO:teuthology.orchestra.run.gibba005.stderr:updated caps for client.2 2021-11-12T05:48:10.894 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:48:10.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.940+0000 7fcbd5e79700 1 Processor -- start 2021-11-12T05:48:10.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.940+0000 7fcbd5e79700 1 -- start start 2021-11-12T05:48:10.951 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.940+0000 7fcbd5e79700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbd00626f0 0x7fcbd00af590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.951 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.940+0000 7fcbd5e79700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fcbd00ad0d0 0x7fcbd0142c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.940+0000 7fcbd5e79700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd00b10b0 con 0x7fcbd00ad870 2021-11-12T05:48:10.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.940+0000 7fcbd5e79700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbd013f5b0 con 0x7fcbd00ad0d0 2021-11-12T05:48:10.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.940+0000 7fcbd5e79700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd0062ad0 con 0x7fcbd00626f0 2021-11-12T05:48:10.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.940+0000 7fcbceffd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fcbd00ad0d0 0x7fcbd0142c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:10.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.940+0000 7fcbceffd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fcbd00ad0d0 0x7fcbd0142c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49866/0 (socket says 172.21.2.105:49866) 2021-11-12T05:48:10.953 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.940+0000 7fcbceffd700 1 -- 172.21.2.105:0/1519417603 learned_addr learned my addr 172.21.2.105:0/1519417603 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:10.953 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.940+0000 7fcbcf7fe700 1 --2- 172.21.2.105:0/1519417603 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbd00626f0 0x7fcbd00af590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:10.953 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.940+0000 7fcbceffd700 1 -- 172.21.2.105:0/1519417603 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbd00626f0 msgr2=0x7fcbd00af590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:10.953 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.940+0000 7fcbceffd700 1 --2- 172.21.2.105:0/1519417603 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbd00626f0 0x7fcbd00af590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:10.953 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.940+0000 7fcbceffd700 1 -- 172.21.2.105:0/1519417603 >> v1:172.21.2.115:6789/0 conn(0x7fcbd00ad870 legacy=0x7fcbd00ab9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:10.954 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.940+0000 7fcbceffd700 1 -- 172.21.2.105:0/1519417603 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd0143160 con 0x7fcbd00ad0d0 2021-11-12T05:48:10.954 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.940+0000 7fcbceffd700 1 --2- 172.21.2.105:0/1519417603 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbd00ad0d0 0x7fcbd0142c70 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 rx=0x7fcbc4002f70 tx=0x7fcbc4006e40).ready entity=mon.0 client_cookie=5cebf53d1ab4c231 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:10.954 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.940+0000 7fcbce7fc700 1 -- 172.21.2.105:0/1519417603 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbc400bd20 con 0x7fcbd00ad0d0 2021-11-12T05:48:10.954 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.940+0000 7fcbce7fc700 1 -- 172.21.2.105:0/1519417603 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc4000e90 con 0x7fcbd00ad0d0 2021-11-12T05:48:10.955 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.940+0000 7fcbce7fc700 1 -- 172.21.2.105:0/1519417603 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbc40155e0 con 0x7fcbd00ad0d0 2021-11-12T05:48:10.955 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbd5e79700 1 -- 172.21.2.105:0/1519417603 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbd00ad0d0 msgr2=0x7fcbd0142c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:10.955 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbd5e79700 1 --2- 172.21.2.105:0/1519417603 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbd00ad0d0 0x7fcbd0142c70 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 rx=0x7fcbc4002f70 tx=0x7fcbc4006e40).stop 2021-11-12T05:48:10.955 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbd5e79700 1 -- 172.21.2.105:0/1519417603 shutdown_connections 2021-11-12T05:48:10.955 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbd5e79700 1 --2- 172.21.2.105:0/1519417603 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbd00ad0d0 0x7fcbd0142c70 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:10.962 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbd5e79700 1 --2- 172.21.2.105:0/1519417603 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbd00626f0 0x7fcbd00af590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:10.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbd5e79700 1 -- 172.21.2.105:0/1519417603 >> 172.21.2.105:0/1519417603 conn(0x7fcbd00b5370 msgr2=0x7fcbd00b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:10.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbd5e79700 1 -- 172.21.2.105:0/1519417603 shutdown_connections 2021-11-12T05:48:10.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbd5e79700 1 -- 172.21.2.105:0/1519417603 wait complete. 2021-11-12T05:48:10.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbd5e79700 1 Processor -- start 2021-11-12T05:48:10.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbd5e79700 1 -- start start 2021-11-12T05:48:10.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbd5e79700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbd00626f0 0x7fcbd014e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbd5e79700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbd00ad0d0 0x7fcbd00b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbd5e79700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcbd00ad870 0x7fcbd0151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.965 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbd5e79700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd0151b30 con 0x7fcbd00ad0d0 2021-11-12T05:48:10.965 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbd5e79700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd009eec0 con 0x7fcbd00ad870 2021-11-12T05:48:10.965 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbd5e79700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd009f160 con 0x7fcbd00626f0 2021-11-12T05:48:10.965 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbceffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbd00ad0d0 0x7fcbd00b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:10.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbceffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbd00ad0d0 0x7fcbd00b34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49870/0 (socket says 172.21.2.105:49870) 2021-11-12T05:48:10.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbceffd700 1 -- 172.21.2.105:0/1900835651 learned_addr learned my addr 172.21.2.105:0/1900835651 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:10.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbcf7fe700 1 --2- 172.21.2.105:0/1900835651 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbd00626f0 0x7fcbd014e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:10.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbceffd700 1 -- 172.21.2.105:0/1900835651 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbd00626f0 msgr2=0x7fcbd014e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:10.967 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbceffd700 1 --2- 172.21.2.105:0/1900835651 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbd00626f0 0x7fcbd014e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:10.967 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbceffd700 1 -- 172.21.2.105:0/1900835651 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcbd00ad870 msgr2=0x7fcbd0151f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:10.967 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbcffff700 1 --2- 172.21.2.105:0/1900835651 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcbd00ad870 0x7fcbd0151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:10.967 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbceffd700 1 --2- 172.21.2.105:0/1900835651 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcbd00ad870 0x7fcbd0151f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:10.967 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbceffd700 1 -- 172.21.2.105:0/1900835651 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc400d4d0 con 0x7fcbd00ad0d0 2021-11-12T05:48:10.968 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbcffff700 1 --2- 172.21.2.105:0/1900835651 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcbd00ad870 0x7fcbd0151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:48:10.968 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbceffd700 1 --2- 172.21.2.105:0/1900835651 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbd00ad0d0 0x7fcbd00b34e0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7fcbc4006fc0 tx=0x7fcbc4018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:10.968 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbccff9700 1 -- 172.21.2.105:0/1900835651 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbc4015c10 con 0x7fcbd00ad0d0 2021-11-12T05:48:10.969 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbccff9700 1 -- 172.21.2.105:0/1900835651 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc4015d70 con 0x7fcbd00ad0d0 2021-11-12T05:48:10.969 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbd5e79700 1 -- 172.21.2.105:0/1900835651 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd009f400 con 0x7fcbd00ad0d0 2021-11-12T05:48:10.969 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbccff9700 1 -- 172.21.2.105:0/1900835651 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbc401e5f0 con 0x7fcbd00ad0d0 2021-11-12T05:48:10.969 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbd5e79700 1 -- 172.21.2.105:0/1900835651 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd009f7d0 con 0x7fcbd00ad0d0 2021-11-12T05:48:10.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbd5e79700 1 -- 172.21.2.105:0/1900835651 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd009f590 con 0x7fcbd00ad0d0 2021-11-12T05:48:10.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbccff9700 1 -- 172.21.2.105:0/1900835651 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcbc401e750 con 0x7fcbd00ad0d0 2021-11-12T05:48:10.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbccff9700 1 --2- 172.21.2.105:0/1900835651 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcbb0053520 0x7fcbb00559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:10.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbccff9700 1 -- 172.21.2.105:0/1900835651 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fcbc406f4a0 con 0x7fcbd00ad0d0 2021-11-12T05:48:10.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbcf7fe700 1 --2- 172.21.2.105:0/1900835651 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcbb0053520 0x7fcbb00559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:10.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.944+0000 7fcbcf7fe700 1 --2- 172.21.2.105:0/1900835651 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcbb0053520 0x7fcbb00559e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7fcbc000c000 tx=0x7fcbc0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:10.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:10.948+0000 7fcbccff9700 1 -- 172.21.2.105:0/1900835651 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcbc40464b0 con 0x7fcbd00ad0d0 2021-11-12T05:48:11.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.060+0000 7fcbd5e79700 1 -- 172.21.2.105:0/1900835651 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcbd00b12e0 con 0x7fcbd00ad0d0 2021-11-12T05:48:11.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.060+0000 7fcbccff9700 1 -- 172.21.2.105:0/1900835651 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2140 (secure 0 0 0) 0x7fcbc4049ad0 con 0x7fcbd00ad0d0 2021-11-12T05:48:11.064 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:11.064 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":50,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5140,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/1083784348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":1083784348},{"type":"v1","addr":"172.21.2.115:6833","nonce":1083784348}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:48:08.977584+0000","modified":"2021-11-12T05:48:09.981269+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7347},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7347":{"gid":7347,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/3290895957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":3290895957},{"type":"v1","addr":"172.21.2.105:6835","nonce":3290895957}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-11-12T05:48:11.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.060+0000 7fcbd5e79700 1 -- 172.21.2.105:0/1900835651 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcbb0053520 msgr2=0x7fcbb00559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:11.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.060+0000 7fcbd5e79700 1 --2- 172.21.2.105:0/1900835651 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcbb0053520 0x7fcbb00559e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7fcbc000c000 tx=0x7fcbc0008040).stop 2021-11-12T05:48:11.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.060+0000 7fcbd5e79700 1 -- 172.21.2.105:0/1900835651 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbd00ad0d0 msgr2=0x7fcbd00b34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:11.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.060+0000 7fcbd5e79700 1 --2- 172.21.2.105:0/1900835651 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbd00ad0d0 0x7fcbd00b34e0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7fcbc4006fc0 tx=0x7fcbc4018000).stop 2021-11-12T05:48:11.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.060+0000 7fcbd5e79700 1 -- 172.21.2.105:0/1900835651 shutdown_connections 2021-11-12T05:48:11.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.060+0000 7fcbd5e79700 1 --2- 172.21.2.105:0/1900835651 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcbb0053520 0x7fcbb00559e0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:11.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.060+0000 7fcbd5e79700 1 --2- 172.21.2.105:0/1900835651 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcbd00ad870 0x7fcbd0151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:11.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.060+0000 7fcbd5e79700 1 --2- 172.21.2.105:0/1900835651 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbd00ad0d0 0x7fcbd00b34e0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:11.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.060+0000 7fcbd5e79700 1 --2- 172.21.2.105:0/1900835651 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbd00626f0 0x7fcbd014e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:11.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.060+0000 7fcbd5e79700 1 -- 172.21.2.105:0/1900835651 >> 172.21.2.105:0/1900835651 conn(0x7fcbd00b5370 msgr2=0x7fcbd00b4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:11.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.060+0000 7fcbd5e79700 1 -- 172.21.2.105:0/1900835651 shutdown_connections 2021-11-12T05:48:11.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.060+0000 7fcbd5e79700 1 -- 172.21.2.105:0/1900835651 wait complete. 2021-11-12T05:48:11.068 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 50 2021-11-12T05:48:11.273 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 50, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:48:08.977584+0000', 'modified': '2021-11-12T05:48:09.981269+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7347}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7347': {'gid': 7347, 'name': 'a', 'rank': 0, 'incarnation': 49, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/3290895957', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 3290895957}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 3290895957}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:48:11.273 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:48:11.274 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:48:11.344 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":7347,"want_state":"up:active","state":"up:active","rank_uptime":2.3582453380000001,"mdsmap_epoch":50,"osdmap_epoch":107,"osdmap_epoch_barrier":106,"uptime":6.4759607969999999} 2021-11-12T05:48:11.344 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 7347, "mdsmap_epoch": 50, "osdmap_epoch": 107, "osdmap_epoch_barrier": 106, "rank_uptime": 2.358245338, "state": "up:active", "uptime": 6.475960797, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:48:11.345 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:48:11.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.392+0000 7fd55fb8a700 1 Processor -- start 2021-11-12T05:48:11.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.392+0000 7fd55fb8a700 1 -- start start 2021-11-12T05:48:11.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.392+0000 7fd55fb8a700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd5580ad080 0x7fd5580af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:11.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.392+0000 7fd55fb8a700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fd55814b2f0 0x7fd5580ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:11.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.392+0000 7fd55fb8a700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5580ac7b0 con 0x7fd5580ac280 2021-11-12T05:48:11.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.392+0000 7fd55fb8a700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5581488a0 con 0x7fd5580ad080 2021-11-12T05:48:11.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.392+0000 7fd55fb8a700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5580ac9e0 con 0x7fd55814b2f0 2021-11-12T05:48:11.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.392+0000 7fd55d926700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd5580ad080 0x7fd5580af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:11.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.392+0000 7fd55d926700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd5580ad080 0x7fd5580af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49876/0 (socket says 172.21.2.105:49876) 2021-11-12T05:48:11.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.392+0000 7fd55d926700 1 -- 172.21.2.105:0/2694975807 learned_addr learned my addr 172.21.2.105:0/2694975807 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:11.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.392+0000 7fd55d926700 1 -- 172.21.2.105:0/2694975807 >> v2:172.21.2.115:3300/0 conn(0x7fd55814b2f0 msgr2=0x7fd5580ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:11.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.392+0000 7fd55d926700 1 --2- 172.21.2.105:0/2694975807 >> v2:172.21.2.115:3300/0 conn(0x7fd55814b2f0 0x7fd5580ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:11.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.392+0000 7fd55d926700 1 -- 172.21.2.105:0/2694975807 >> v1:172.21.2.115:6789/0 conn(0x7fd5580ac280 legacy=0x7fd55814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:11.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.392+0000 7fd55d926700 1 -- 172.21.2.105:0/2694975807 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5580b0b30 con 0x7fd5580ad080 2021-11-12T05:48:11.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.392+0000 7fd55d926700 1 --2- 172.21.2.105:0/2694975807 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd5580ad080 0x7fd5580af730 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 rx=0x7fd5580b06e0 tx=0x7fd554006eb0).ready entity=mon.0 client_cookie=6d75764f3f80585b server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:11.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.392+0000 7fd55c924700 1 -- 172.21.2.105:0/2694975807 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd55400d5c0 con 0x7fd5580ad080 2021-11-12T05:48:11.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.392+0000 7fd55c924700 1 -- 172.21.2.105:0/2694975807 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd554000e90 con 0x7fd5580ad080 2021-11-12T05:48:11.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.392+0000 7fd55c924700 1 -- 172.21.2.105:0/2694975807 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd55400d910 con 0x7fd5580ad080 2021-11-12T05:48:11.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.392+0000 7fd55fb8a700 1 -- 172.21.2.105:0/2694975807 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd5580ad080 msgr2=0x7fd5580af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:11.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.392+0000 7fd55fb8a700 1 --2- 172.21.2.105:0/2694975807 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd5580ad080 0x7fd5580af730 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 rx=0x7fd5580b06e0 tx=0x7fd554006eb0).stop 2021-11-12T05:48:11.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.392+0000 7fd55fb8a700 1 -- 172.21.2.105:0/2694975807 shutdown_connections 2021-11-12T05:48:11.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.392+0000 7fd55fb8a700 1 --2- 172.21.2.105:0/2694975807 >> v2:172.21.2.115:3300/0 conn(0x7fd55814b2f0 0x7fd5580ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:11.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.392+0000 7fd55fb8a700 1 --2- 172.21.2.105:0/2694975807 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd5580ad080 0x7fd5580af730 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:11.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.392+0000 7fd55fb8a700 1 -- 172.21.2.105:0/2694975807 >> 172.21.2.105:0/2694975807 conn(0x7fd5580b5370 msgr2=0x7fd5580b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:11.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.392+0000 7fd55fb8a700 1 -- 172.21.2.105:0/2694975807 shutdown_connections 2021-11-12T05:48:11.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.392+0000 7fd55fb8a700 1 -- 172.21.2.105:0/2694975807 wait complete. 2021-11-12T05:48:11.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.392+0000 7fd55fb8a700 1 Processor -- start 2021-11-12T05:48:11.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.392+0000 7fd55fb8a700 1 -- start start 2021-11-12T05:48:11.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.392+0000 7fd55fb8a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd5580ac280 0x7fd5580ab640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:11.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.392+0000 7fd55fb8a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd5580ad080 0x7fd558066b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:11.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.392+0000 7fd55fb8a700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd55814b2f0 0x7fd558067000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:11.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.392+0000 7fd55fb8a700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5580674f0 con 0x7fd5580ad080 2021-11-12T05:48:11.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.392+0000 7fd55fb8a700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5580a9ba0 con 0x7fd55814b2f0 2021-11-12T05:48:11.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.392+0000 7fd55fb8a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5580a9d20 con 0x7fd5580ac280 2021-11-12T05:48:11.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.396+0000 7fd55d125700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd5580ad080 0x7fd558066b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:11.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.396+0000 7fd55d125700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd5580ad080 0x7fd558066b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49884/0 (socket says 172.21.2.105:49884) 2021-11-12T05:48:11.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.396+0000 7fd55d125700 1 -- 172.21.2.105:0/699829359 learned_addr learned my addr 172.21.2.105:0/699829359 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:11.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.396+0000 7fd55d125700 1 -- 172.21.2.105:0/699829359 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd5580ac280 msgr2=0x7fd5580ab640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:11.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.396+0000 7fd55d125700 1 --2- 172.21.2.105:0/699829359 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd5580ac280 0x7fd5580ab640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:11.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.396+0000 7fd55d125700 1 -- 172.21.2.105:0/699829359 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd55814b2f0 msgr2=0x7fd558067000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:11.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.396+0000 7fd55d125700 1 --2- 172.21.2.105:0/699829359 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd55814b2f0 0x7fd558067000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:11.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.396+0000 7fd55d125700 1 -- 172.21.2.105:0/699829359 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd55400b1e0 con 0x7fd5580ad080 2021-11-12T05:48:11.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.396+0000 7fd55d125700 1 --2- 172.21.2.105:0/699829359 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd5580ad080 0x7fd558066b10 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 rx=0x7fd54c002f90 tx=0x7fd54c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:11.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.396+0000 7fd54affd700 1 -- 172.21.2.105:0/699829359 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd54c013460 con 0x7fd5580ad080 2021-11-12T05:48:11.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.396+0000 7fd54affd700 1 -- 172.21.2.105:0/699829359 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54c0135c0 con 0x7fd5580ad080 2021-11-12T05:48:11.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.396+0000 7fd54affd700 1 -- 172.21.2.105:0/699829359 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd54c013920 con 0x7fd5580ad080 2021-11-12T05:48:11.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.396+0000 7fd55fb8a700 1 -- 172.21.2.105:0/699829359 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd558063620 con 0x7fd5580ad080 2021-11-12T05:48:11.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.396+0000 7fd55fb8a700 1 -- 172.21.2.105:0/699829359 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5580aaa30 con 0x7fd5580ad080 2021-11-12T05:48:11.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.396+0000 7fd55fb8a700 1 -- 172.21.2.105:0/699829359 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5580aac50 con 0x7fd5580ad080 2021-11-12T05:48:11.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.396+0000 7fd54affd700 1 -- 172.21.2.105:0/699829359 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd54c01a060 con 0x7fd5580ad080 2021-11-12T05:48:11.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.396+0000 7fd54affd700 1 --2- 172.21.2.105:0/699829359 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd538053690 0x7fd538055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:11.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.396+0000 7fd54affd700 1 -- 172.21.2.105:0/699829359 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fd54c06b4c0 con 0x7fd5580ad080 2021-11-12T05:48:11.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.396+0000 7fd55d926700 1 --2- 172.21.2.105:0/699829359 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd538053690 0x7fd538055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:11.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.396+0000 7fd55d926700 1 --2- 172.21.2.105:0/699829359 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd538053690 0x7fd538055b50 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7fd5580b06e0 tx=0x7fd554015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:11.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.400+0000 7fd54affd700 1 -- 172.21.2.105:0/699829359 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd54c0423c0 con 0x7fd5580ad080 2021-11-12T05:48:11.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.480+0000 7fd55fb8a700 1 -- 172.21.2.105:0/699829359 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd558057350 con 0x7fd5580ad080 2021-11-12T05:48:11.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.480+0000 7fd54affd700 1 -- 172.21.2.105:0/699829359 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+16285 (secure 0 0 0) 0x7fd54c018030 con 0x7fd5580ad080 2021-11-12T05:48:11.487 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:11.487 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":107,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:48:09.982370+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:48:06.914733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-11-12T05:48:07.950921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:48:11.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.484+0000 7fd55fb8a700 1 -- 172.21.2.105:0/699829359 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd538053690 msgr2=0x7fd538055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:11.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.484+0000 7fd55fb8a700 1 --2- 172.21.2.105:0/699829359 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd538053690 0x7fd538055b50 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7fd5580b06e0 tx=0x7fd554015000).stop 2021-11-12T05:48:11.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.484+0000 7fd55fb8a700 1 -- 172.21.2.105:0/699829359 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd5580ad080 msgr2=0x7fd558066b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:11.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.484+0000 7fd55fb8a700 1 --2- 172.21.2.105:0/699829359 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd5580ad080 0x7fd558066b10 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 rx=0x7fd54c002f90 tx=0x7fd54c006df0).stop 2021-11-12T05:48:11.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.484+0000 7fd55fb8a700 1 -- 172.21.2.105:0/699829359 shutdown_connections 2021-11-12T05:48:11.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.484+0000 7fd55fb8a700 1 --2- 172.21.2.105:0/699829359 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd538053690 0x7fd538055b50 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:11.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.484+0000 7fd55fb8a700 1 --2- 172.21.2.105:0/699829359 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd55814b2f0 0x7fd558067000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:11.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.484+0000 7fd55fb8a700 1 --2- 172.21.2.105:0/699829359 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd5580ad080 0x7fd558066b10 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:11.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.484+0000 7fd55fb8a700 1 --2- 172.21.2.105:0/699829359 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd5580ac280 0x7fd5580ab640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:11.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.484+0000 7fd55fb8a700 1 -- 172.21.2.105:0/699829359 >> 172.21.2.105:0/699829359 conn(0x7fd5580b5370 msgr2=0x7fd55814aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:11.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.484+0000 7fd55fb8a700 1 -- 172.21.2.105:0/699829359 shutdown_connections 2021-11-12T05:48:11.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.484+0000 7fd55fb8a700 1 -- 172.21.2.105:0/699829359 wait complete. 2021-11-12T05:48:11.494 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-12T05:48:06.914733+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '106', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2021-11-12T05:48:07.950921+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-12T05:48:11.495 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:48:11.548 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71e4ceb700 1 Processor -- start 2021-11-12T05:48:11.548 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71e4ceb700 1 -- start start 2021-11-12T05:48:11.548 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71e4ceb700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f71e00adb10 0x7f71e00ac9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:11.549 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71e4ceb700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f71e0060d30 0x7f71e0140140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:11.549 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71e4ceb700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71e0143c90 con 0x7f71e00b0f10 2021-11-12T05:48:11.549 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71e4ceb700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71e00ace90 con 0x7f71e00adb10 2021-11-12T05:48:11.549 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71e4ceb700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71e0143ec0 con 0x7f71e0060d30 2021-11-12T05:48:11.550 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71de59c700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f71e00b0f10 0x7f71e005f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60286/0 (socket says 172.21.2.105:60286) 2021-11-12T05:48:11.550 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71de59c700 1 -- 172.21.2.105:0/3911914750 learned_addr learned my addr 172.21.2.105:0/3911914750 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:11.555 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71dd59a700 1 -- 172.21.2.105:0/3911914750 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2538821177 0 0) 0x7f71e0143c90 con 0x7f71e00b0f10 2021-11-12T05:48:11.555 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71dd59a700 1 -- 172.21.2.105:0/3911914750 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71c0003260 con 0x7f71e00b0f10 2021-11-12T05:48:11.555 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71dd59a700 1 -- 172.21.2.105:0/3911914750 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 203178152 0 0) 0x7f71c0003260 con 0x7f71e00b0f10 2021-11-12T05:48:11.555 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71dd59a700 1 -- 172.21.2.105:0/3911914750 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f71e0060d30 msgr2=0x7f71e0140140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:11.556 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71dd59a700 1 --2- 172.21.2.105:0/3911914750 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f71e0060d30 0x7f71e0140140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:11.556 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71dd59a700 1 -- 172.21.2.105:0/3911914750 >> v2:172.21.2.115:3300/0 conn(0x7f71e00adb10 msgr2=0x7f71e00ac9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:11.556 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71dd59a700 1 --2- 172.21.2.105:0/3911914750 >> v2:172.21.2.115:3300/0 conn(0x7f71e00adb10 0x7f71e00ac9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:11.556 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71dd59a700 1 -- 172.21.2.105:0/3911914750 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e0144160 con 0x7f71e00b0f10 2021-11-12T05:48:11.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71dd59a700 1 -- 172.21.2.105:0/3911914750 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f71c8001660 con 0x7f71e00b0f10 2021-11-12T05:48:11.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71dd59a700 1 -- 172.21.2.105:0/3911914750 >> v1:172.21.2.105:6789/0 conn(0x7f71e00b0f10 legacy=0x7f71e005f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:11.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71dd59a700 1 --2- 172.21.2.105:0/3911914750 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f71c00037d0 0x7f71c0003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:11.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71dd59a700 1 --2- 172.21.2.105:0/3911914750 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71c0004500 0x7f71c0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:11.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71dd59a700 1 --2- 172.21.2.105:0/3911914750 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f71c0004e70 0x7f71c000fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:11.558 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71dd59a700 1 -- 172.21.2.105:0/3911914750 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e00ace90 con 0x7f71c0004500 2021-11-12T05:48:11.558 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71dd59a700 1 -- 172.21.2.105:0/3911914750 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e0143ec0 con 0x7f71c00037d0 2021-11-12T05:48:11.558 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71dd59a700 1 -- 172.21.2.105:0/3911914750 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c00102d0 con 0x7f71c0004e70 2021-11-12T05:48:11.558 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71ddd9b700 1 --2- 172.21.2.105:0/3911914750 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71c0004500 0x7f71c0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:11.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71de59c700 1 --2- 172.21.2.105:0/3911914750 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f71c00037d0 0x7f71c0003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:11.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71ded9d700 1 --2- 172.21.2.105:0/3911914750 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f71c0004e70 0x7f71c000fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:11.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71ddd9b700 1 -- 172.21.2.105:0/3911914750 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f71c0004e70 msgr2=0x7f71c000fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:11.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71ddd9b700 1 --2- 172.21.2.105:0/3911914750 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f71c0004e70 0x7f71c000fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:11.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71ddd9b700 1 -- 172.21.2.105:0/3911914750 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f71c00037d0 msgr2=0x7f71c0003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:11.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71ddd9b700 1 --2- 172.21.2.105:0/3911914750 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f71c00037d0 0x7f71c0003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:11.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71ddd9b700 1 -- 172.21.2.105:0/3911914750 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e0144160 con 0x7f71c0004500 2021-11-12T05:48:11.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71ddd9b700 1 --2- 172.21.2.105:0/3911914750 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71c0004500 0x7f71c0004980 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7f71d0002f70 tx=0x7f71d0006ca0).ready entity=mon.0 client_cookie=4e36e62d33a8e6d5 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:11.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71dd59a700 1 -- 172.21.2.105:0/3911914750 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71d0012410 con 0x7f71c0004500 2021-11-12T05:48:11.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71dd59a700 1 -- 172.21.2.105:0/3911914750 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d0012570 con 0x7f71c0004500 2021-11-12T05:48:11.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71dd59a700 1 -- 172.21.2.105:0/3911914750 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71d00128d0 con 0x7f71c0004500 2021-11-12T05:48:11.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71e4ceb700 1 -- 172.21.2.105:0/3911914750 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71c0004500 msgr2=0x7f71c0004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:11.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71e4ceb700 1 --2- 172.21.2.105:0/3911914750 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71c0004500 0x7f71c0004980 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7f71d0002f70 tx=0x7f71d0006ca0).stop 2021-11-12T05:48:11.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71ded9d700 1 -- 172.21.2.105:0/3911914750 reap_dead start 2021-11-12T05:48:11.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71e4ceb700 1 -- 172.21.2.105:0/3911914750 shutdown_connections 2021-11-12T05:48:11.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71e4ceb700 1 -- 172.21.2.105:0/3911914750 >> 172.21.2.105:0/3911914750 conn(0x7f71e005c490 msgr2=0x7f71e00b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:11.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71e4ceb700 1 -- 172.21.2.105:0/3911914750 shutdown_connections 2021-11-12T05:48:11.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.544+0000 7f71e4ceb700 1 -- 172.21.2.105:0/3911914750 wait complete. 2021-11-12T05:48:11.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.548+0000 7f71e4ceb700 1 Processor -- start 2021-11-12T05:48:11.563 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.548+0000 7f71e4ceb700 1 -- start start 2021-11-12T05:48:11.563 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.548+0000 7f71e4ceb700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71c0004500 0x7f71e00a9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:11.563 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.548+0000 7f71e4ceb700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f71e0159ee0 0x7f71e013ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:11.563 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.548+0000 7f71e4ceb700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f71e0066ef0 0x7f71e00ab2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:11.564 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.548+0000 7f71e4ceb700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e00665f0 con 0x7f71c0004500 2021-11-12T05:48:11.564 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.548+0000 7f71e4ceb700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e00660b0 con 0x7f71e0159ee0 2021-11-12T05:48:11.564 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.548+0000 7f71e4ceb700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71e0066350 con 0x7f71e0066ef0 2021-11-12T05:48:11.564 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.548+0000 7f71de59c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71c0004500 0x7f71e00a9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:11.564 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.548+0000 7f71de59c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71c0004500 0x7f71e00a9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49902/0 (socket says 172.21.2.105:49902) 2021-11-12T05:48:11.565 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.548+0000 7f71de59c700 1 -- 172.21.2.105:0/3879293699 learned_addr learned my addr 172.21.2.105:0/3879293699 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:11.565 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.548+0000 7f71de59c700 1 -- 172.21.2.105:0/3879293699 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f71e0066ef0 msgr2=0x7f71e00ab2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:11.565 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.548+0000 7f71de59c700 1 --2- 172.21.2.105:0/3879293699 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f71e0066ef0 0x7f71e00ab2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:11.566 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.548+0000 7f71de59c700 1 -- 172.21.2.105:0/3879293699 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f71e0159ee0 msgr2=0x7f71e013ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:11.566 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.548+0000 7f71de59c700 1 --2- 172.21.2.105:0/3879293699 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f71e0159ee0 0x7f71e013ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:11.566 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.548+0000 7f71de59c700 1 -- 172.21.2.105:0/3879293699 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e00ab7d0 con 0x7f71c0004500 2021-11-12T05:48:11.566 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.548+0000 7f71de59c700 1 --2- 172.21.2.105:0/3879293699 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71c0004500 0x7f71e00a9cd0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 rx=0x7f71c800b000 tx=0x7f71c80014f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:11.567 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.548+0000 7f71d77fe700 1 -- 172.21.2.105:0/3879293699 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71c8010710 con 0x7f71c0004500 2021-11-12T05:48:11.567 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.548+0000 7f71d77fe700 1 -- 172.21.2.105:0/3879293699 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c8010870 con 0x7f71c0004500 2021-11-12T05:48:11.567 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.548+0000 7f71e4ceb700 1 -- 172.21.2.105:0/3879293699 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e00aba20 con 0x7f71c0004500 2021-11-12T05:48:11.567 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.548+0000 7f71d77fe700 1 -- 172.21.2.105:0/3879293699 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71c8010bd0 con 0x7f71c0004500 2021-11-12T05:48:11.568 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.548+0000 7f71e4ceb700 1 -- 172.21.2.105:0/3879293699 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e00a7360 con 0x7f71c0004500 2021-11-12T05:48:11.568 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.548+0000 7f71e4ceb700 1 -- 172.21.2.105:0/3879293699 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71e00ae1d0 con 0x7f71c0004500 2021-11-12T05:48:11.568 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.548+0000 7f71d77fe700 1 -- 172.21.2.105:0/3879293699 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f71c8010d30 con 0x7f71c0004500 2021-11-12T05:48:11.568 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.548+0000 7f71d77fe700 1 --2- 172.21.2.105:0/3879293699 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f71c4053580 0x7f71c4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:11.568 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.548+0000 7f71d77fe700 1 -- 172.21.2.105:0/3879293699 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f71c806bb00 con 0x7f71c0004500 2021-11-12T05:48:11.569 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.548+0000 7f71ddd9b700 1 --2- 172.21.2.105:0/3879293699 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f71c4053580 0x7f71c4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:11.569 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.548+0000 7f71ddd9b700 1 --2- 172.21.2.105:0/3879293699 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f71c4053580 0x7f71c4055a40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f71d0002f70 tx=0x7f71d0015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:11.569 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.552+0000 7f71d77fe700 1 -- 172.21.2.105:0/3879293699 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f71c8042b10 con 0x7f71c0004500 2021-11-12T05:48:11.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.636+0000 7f71e4ceb700 1 -- 172.21.2.105:0/3879293699 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f71e0057350 con 0x7f71c0004500 2021-11-12T05:48:11.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.636+0000 7f71d77fe700 1 -- 172.21.2.105:0/3879293699 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v107) v1 ==== 110+0+10 (secure 0 0 0) 0x7f71c8046130 con 0x7f71c0004500 2021-11-12T05:48:11.640 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:48:11.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.636+0000 7f71e4ceb700 1 -- 172.21.2.105:0/3879293699 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f71c4053580 msgr2=0x7f71c4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:11.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.636+0000 7f71e4ceb700 1 --2- 172.21.2.105:0/3879293699 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f71c4053580 0x7f71c4055a40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f71d0002f70 tx=0x7f71d0015000).stop 2021-11-12T05:48:11.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.636+0000 7f71e4ceb700 1 -- 172.21.2.105:0/3879293699 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71c0004500 msgr2=0x7f71e00a9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:11.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.636+0000 7f71e4ceb700 1 --2- 172.21.2.105:0/3879293699 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71c0004500 0x7f71e00a9cd0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 rx=0x7f71c800b000 tx=0x7f71c80014f0).stop 2021-11-12T05:48:11.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.636+0000 7f71e4ceb700 1 -- 172.21.2.105:0/3879293699 shutdown_connections 2021-11-12T05:48:11.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.636+0000 7f71e4ceb700 1 --2- 172.21.2.105:0/3879293699 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f71c4053580 0x7f71c4055a40 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:11.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.636+0000 7f71e4ceb700 1 --2- 172.21.2.105:0/3879293699 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f71e0066ef0 0x7f71e00ab2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:11.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.636+0000 7f71e4ceb700 1 --2- 172.21.2.105:0/3879293699 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f71e0159ee0 0x7f71e013ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:11.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.636+0000 7f71e4ceb700 1 --2- 172.21.2.105:0/3879293699 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71c0004500 0x7f71e00a9cd0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:11.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.636+0000 7f71e4ceb700 1 -- 172.21.2.105:0/3879293699 >> 172.21.2.105:0/3879293699 conn(0x7f71e005c490 msgr2=0x7f71e0143460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:11.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.636+0000 7f71e4ceb700 1 -- 172.21.2.105:0/3879293699 shutdown_connections 2021-11-12T05:48:11.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.636+0000 7f71e4ceb700 1 -- 172.21.2.105:0/3879293699 wait complete. 2021-11-12T05:48:11.647 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:48:11.701 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.696+0000 7f86ac756700 1 Processor -- start 2021-11-12T05:48:11.701 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.696+0000 7f86ac756700 1 -- start start 2021-11-12T05:48:11.702 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.696+0000 7f86ac756700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f86a405fdc0 0x7f86a40b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:11.702 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.696+0000 7f86ac756700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f86a40601a0 0x7f86a413e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:11.702 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.696+0000 7f86ac756700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86a40ae9e0 con 0x7f86a40b06e0 2021-11-12T05:48:11.702 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.696+0000 7f86ac756700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86a40b31f0 con 0x7f86a405fdc0 2021-11-12T05:48:11.703 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.696+0000 7f86ac756700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a40af7c0 con 0x7f86a40601a0 2021-11-12T05:48:11.703 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.696+0000 7f86a9cf1700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f86a40b06e0 0x7f86a40af0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60310/0 (socket says 172.21.2.105:60310) 2021-11-12T05:48:11.703 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.696+0000 7f86a9cf1700 1 -- 172.21.2.105:0/3783851619 learned_addr learned my addr 172.21.2.105:0/3783851619 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:11.708 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.696+0000 7f86a94f0700 1 -- 172.21.2.105:0/3783851619 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 830622867 0 0) 0x7f86a40ae9e0 con 0x7f86a40b06e0 2021-11-12T05:48:11.708 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.696+0000 7f86a94f0700 1 -- 172.21.2.105:0/3783851619 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f868c003260 con 0x7f86a40b06e0 2021-11-12T05:48:11.708 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.696+0000 7f86a94f0700 1 -- 172.21.2.105:0/3783851619 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1616306658 0 0) 0x7f868c003260 con 0x7f86a40b06e0 2021-11-12T05:48:11.709 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.696+0000 7f86a94f0700 1 -- 172.21.2.105:0/3783851619 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f86a40601a0 msgr2=0x7f86a413e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:11.709 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.696+0000 7f86a94f0700 1 --2- 172.21.2.105:0/3783851619 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f86a40601a0 0x7f86a413e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:11.709 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.696+0000 7f86aa4f2700 1 --2- 172.21.2.105:0/3783851619 >> v2:172.21.2.115:3300/0 conn(0x7f86a405fdc0 0x7f86a40b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:11.709 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.696+0000 7f86a94f0700 1 -- 172.21.2.105:0/3783851619 >> v2:172.21.2.115:3300/0 conn(0x7f86a405fdc0 msgr2=0x7f86a40b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:11.710 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.696+0000 7f86a94f0700 1 --2- 172.21.2.105:0/3783851619 >> v2:172.21.2.115:3300/0 conn(0x7f86a405fdc0 0x7f86a40b1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:11.710 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.696+0000 7f86a94f0700 1 -- 172.21.2.105:0/3783851619 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a4067cb0 con 0x7f86a40b06e0 2021-11-12T05:48:11.710 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.696+0000 7f86a94f0700 1 -- 172.21.2.105:0/3783851619 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f8698001660 con 0x7f86a40b06e0 2021-11-12T05:48:11.710 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.696+0000 7f86a94f0700 1 -- 172.21.2.105:0/3783851619 >> v1:172.21.2.105:6789/0 conn(0x7f86a40b06e0 legacy=0x7f86a40af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:11.711 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.696+0000 7f86a94f0700 1 --2- 172.21.2.105:0/3783851619 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f868c0037d0 0x7f868c003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:11.711 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.696+0000 7f86a94f0700 1 --2- 172.21.2.105:0/3783851619 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f86a40601a0 0x7f868c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:11.711 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.696+0000 7f86a94f0700 1 --2- 172.21.2.105:0/3783851619 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f868c004b10 0x7f868c004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:11.711 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.696+0000 7f86a94f0700 1 -- 172.21.2.105:0/3783851619 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a40b31f0 con 0x7f868c004b10 2021-11-12T05:48:11.711 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.696+0000 7f86a94f0700 1 -- 172.21.2.105:0/3783851619 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a40af7c0 con 0x7f868c0037d0 2021-11-12T05:48:11.712 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.696+0000 7f86a94f0700 1 -- 172.21.2.105:0/3783851619 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868c0059b0 con 0x7f86a40601a0 2021-11-12T05:48:11.712 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.696+0000 7f86aacf3700 1 --2- 172.21.2.105:0/3783851619 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f868c004b10 0x7f868c004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:11.712 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.696+0000 7f86aacf3700 1 -- 172.21.2.105:0/3783851619 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f86a40601a0 msgr2=0x7f868c004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:11.712 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.696+0000 7f86aacf3700 1 --2- 172.21.2.105:0/3783851619 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f86a40601a0 0x7f868c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:11.713 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.696+0000 7f86aacf3700 1 -- 172.21.2.105:0/3783851619 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f868c0037d0 msgr2=0x7f868c003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:11.713 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.696+0000 7f86aacf3700 1 --2- 172.21.2.105:0/3783851619 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f868c0037d0 0x7f868c003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:11.713 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.696+0000 7f86aacf3700 1 -- 172.21.2.105:0/3783851619 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a4067cb0 con 0x7f868c004b10 2021-11-12T05:48:11.713 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.696+0000 7f86aacf3700 1 --2- 172.21.2.105:0/3783851619 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f868c004b10 0x7f868c004f90 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7f869c0032f0 tx=0x7f869c006f90).ready entity=mon.0 client_cookie=4ee615f30bbf08c5 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:11.714 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.696+0000 7f86a94f0700 1 -- 172.21.2.105:0/3783851619 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f869c00b460 con 0x7f868c004b10 2021-11-12T05:48:11.714 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.696+0000 7f86a94f0700 1 -- 172.21.2.105:0/3783851619 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869c00b5c0 con 0x7f868c004b10 2021-11-12T05:48:11.714 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.696+0000 7f86a94f0700 1 -- 172.21.2.105:0/3783851619 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f869c00b730 con 0x7f868c004b10 2021-11-12T05:48:11.714 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.700+0000 7f86ac756700 1 -- 172.21.2.105:0/3783851619 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f868c004b10 msgr2=0x7f868c004f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:11.715 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.700+0000 7f86ac756700 1 --2- 172.21.2.105:0/3783851619 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f868c004b10 0x7f868c004f90 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7f869c0032f0 tx=0x7f869c006f90).stop 2021-11-12T05:48:11.715 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.700+0000 7f86aacf3700 1 -- 172.21.2.105:0/3783851619 reap_dead start 2021-11-12T05:48:11.715 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.700+0000 7f86ac756700 1 -- 172.21.2.105:0/3783851619 shutdown_connections 2021-11-12T05:48:11.715 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.700+0000 7f86ac756700 1 -- 172.21.2.105:0/3783851619 >> 172.21.2.105:0/3783851619 conn(0x7f86a40632b0 msgr2=0x7f86a405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:11.716 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.700+0000 7f86ac756700 1 -- 172.21.2.105:0/3783851619 shutdown_connections 2021-11-12T05:48:11.716 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.700+0000 7f86ac756700 1 -- 172.21.2.105:0/3783851619 wait complete. 2021-11-12T05:48:11.716 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.700+0000 7f86ac756700 1 Processor -- start 2021-11-12T05:48:11.716 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.700+0000 7f86ac756700 1 -- start start 2021-11-12T05:48:11.717 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.700+0000 7f86ac756700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f868c004b10 0x7f86a4140c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:11.717 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.700+0000 7f86ac756700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f86a4157290 0x7f86a41410f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:11.717 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.700+0000 7f86ac756700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f86a4159b70 0x7f86a41444f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:11.717 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.700+0000 7f86ac756700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a40674a0 con 0x7f86a4159b70 2021-11-12T05:48:11.718 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.700+0000 7f86ac756700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a41568b0 con 0x7f86a4157290 2021-11-12T05:48:11.718 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.700+0000 7f86ac756700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a4156b50 con 0x7f868c004b10 2021-11-12T05:48:11.718 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.700+0000 7f86aacf3700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f86a4159b70 0x7f86a41444f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:11.718 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.700+0000 7f86aacf3700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f86a4159b70 0x7f86a41444f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49924/0 (socket says 172.21.2.105:49924) 2021-11-12T05:48:11.719 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.700+0000 7f86aacf3700 1 -- 172.21.2.105:0/3056848174 learned_addr learned my addr 172.21.2.105:0/3056848174 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:11.719 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.700+0000 7f86aacf3700 1 -- 172.21.2.105:0/3056848174 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f868c004b10 msgr2=0x7f86a4140c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:11.719 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.700+0000 7f86aacf3700 1 --2- 172.21.2.105:0/3056848174 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f868c004b10 0x7f86a4140c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:11.719 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.700+0000 7f86aacf3700 1 -- 172.21.2.105:0/3056848174 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f86a4157290 msgr2=0x7f86a41410f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:11.720 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.700+0000 7f86aacf3700 1 --2- 172.21.2.105:0/3056848174 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f86a4157290 0x7f86a41410f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:11.720 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.700+0000 7f86aacf3700 1 -- 172.21.2.105:0/3056848174 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a4156df0 con 0x7f86a4159b70 2021-11-12T05:48:11.720 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.700+0000 7f86aacf3700 1 --2- 172.21.2.105:0/3056848174 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f86a4159b70 0x7f86a41444f0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7f86a4061a60 tx=0x7f869c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:11.720 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.700+0000 7f86977fe700 1 -- 172.21.2.105:0/3056848174 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f869c00b110 con 0x7f86a4159b70 2021-11-12T05:48:11.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.700+0000 7f86977fe700 1 -- 172.21.2.105:0/3056848174 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869c011a70 con 0x7f86a4159b70 2021-11-12T05:48:11.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.700+0000 7f86ac756700 1 -- 172.21.2.105:0/3056848174 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86a4156560 con 0x7f86a4159b70 2021-11-12T05:48:11.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.700+0000 7f86ac756700 1 -- 172.21.2.105:0/3056848174 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86a4144c00 con 0x7f86a4159b70 2021-11-12T05:48:11.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.700+0000 7f86977fe700 1 -- 172.21.2.105:0/3056848174 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f869c011dd0 con 0x7f86a4159b70 2021-11-12T05:48:11.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.700+0000 7f86ac756700 1 -- 172.21.2.105:0/3056848174 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86a4156f80 con 0x7f86a4159b70 2021-11-12T05:48:11.722 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.700+0000 7f86977fe700 1 -- 172.21.2.105:0/3056848174 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f869c00f070 con 0x7f86a4159b70 2021-11-12T05:48:11.722 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.700+0000 7f86977fe700 1 --2- 172.21.2.105:0/3056848174 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f86840536f0 0x7f8684055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:11.722 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.700+0000 7f86977fe700 1 -- 172.21.2.105:0/3056848174 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f869c06ce40 con 0x7f86a4159b70 2021-11-12T05:48:11.722 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.700+0000 7f86aa4f2700 1 --2- 172.21.2.105:0/3056848174 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f86840536f0 0x7f8684055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:11.723 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.700+0000 7f86aa4f2700 1 --2- 172.21.2.105:0/3056848174 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f86840536f0 0x7f8684055bb0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f86a0007000 tx=0x7f86a0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:11.723 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.704+0000 7f86977fe700 1 -- 172.21.2.105:0/3056848174 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f869c043d40 con 0x7f86a4159b70 2021-11-12T05:48:11.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.788+0000 7f86ac756700 1 -- 172.21.2.105:0/3056848174 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f86a4057350 con 0x7f86a4159b70 2021-11-12T05:48:11.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.788+0000 7f86977fe700 1 -- 172.21.2.105:0/3056848174 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v107) v1 ==== 92+0+10 (secure 0 0 0) 0x7f869c047360 con 0x7f86a4159b70 2021-11-12T05:48:11.792 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:48:11.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.788+0000 7f86ac756700 1 -- 172.21.2.105:0/3056848174 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f86840536f0 msgr2=0x7f8684055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:11.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.788+0000 7f86ac756700 1 --2- 172.21.2.105:0/3056848174 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f86840536f0 0x7f8684055bb0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f86a0007000 tx=0x7f86a0008040).stop 2021-11-12T05:48:11.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.788+0000 7f86ac756700 1 -- 172.21.2.105:0/3056848174 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f86a4159b70 msgr2=0x7f86a41444f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:11.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.788+0000 7f86ac756700 1 --2- 172.21.2.105:0/3056848174 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f86a4159b70 0x7f86a41444f0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7f86a4061a60 tx=0x7f869c017000).stop 2021-11-12T05:48:11.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.788+0000 7f86ac756700 1 -- 172.21.2.105:0/3056848174 shutdown_connections 2021-11-12T05:48:11.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.788+0000 7f86ac756700 1 --2- 172.21.2.105:0/3056848174 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f86840536f0 0x7f8684055bb0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:11.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.788+0000 7f86ac756700 1 --2- 172.21.2.105:0/3056848174 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f86a4159b70 0x7f86a41444f0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:11.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.788+0000 7f86ac756700 1 --2- 172.21.2.105:0/3056848174 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f86a4157290 0x7f86a41410f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:11.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.788+0000 7f86ac756700 1 --2- 172.21.2.105:0/3056848174 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f868c004b10 0x7f86a4140c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:11.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.788+0000 7f86ac756700 1 -- 172.21.2.105:0/3056848174 >> 172.21.2.105:0/3056848174 conn(0x7f86a40632b0 msgr2=0x7f86a40b4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:11.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.788+0000 7f86ac756700 1 -- 172.21.2.105:0/3056848174 shutdown_connections 2021-11-12T05:48:11.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.788+0000 7f86ac756700 1 -- 172.21.2.105:0/3056848174 wait complete. 2021-11-12T05:48:11.799 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-12T05:48:11.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.848+0000 7f44606c9700 1 Processor -- start 2021-11-12T05:48:11.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.848+0000 7f44606c9700 1 -- start start 2021-11-12T05:48:11.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.848+0000 7f44606c9700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f44580b0e60 0x7f44580ac270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:11.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.848+0000 7f44606c9700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44580b20b0 con 0x7f44580aa700 2021-11-12T05:48:11.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.848+0000 7f44606c9700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44580b13e0 con 0x7f44580b1cd0 2021-11-12T05:48:11.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.848+0000 7f44606c9700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44580b2870 con 0x7f44580b0e60 2021-11-12T05:48:11.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.848+0000 7f445ec66700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f44580aa700 0x7f44581424c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60330/0 (socket says 172.21.2.105:60330) 2021-11-12T05:48:11.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.848+0000 7f445ec66700 1 -- 172.21.2.105:0/1235860147 learned_addr learned my addr 172.21.2.105:0/1235860147 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:11.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.848+0000 7f445dc64700 1 --2- 172.21.2.105:0/1235860147 >> v2:172.21.2.105:3300/0 conn(0x7f44580b0e60 0x7f44580ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:11.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.848+0000 7f445dc64700 1 -- 172.21.2.105:0/1235860147 >> v1:172.21.2.115:6789/0 conn(0x7f44580b1cd0 legacy=0x7f44580abb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:11.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.848+0000 7f445dc64700 1 -- 172.21.2.105:0/1235860147 >> v1:172.21.2.105:6789/0 conn(0x7f44580aa700 legacy=0x7f44581424c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:11.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.848+0000 7f445dc64700 1 -- 172.21.2.105:0/1235860147 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44580ace10 con 0x7f44580b0e60 2021-11-12T05:48:11.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.848+0000 7f445dc64700 1 --2- 172.21.2.105:0/1235860147 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f44580b0e60 0x7f44580ac270 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7f44580b4160 tx=0x7f4448006df0).ready entity=mon.0 client_cookie=1477ab44a73be5f2 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:11.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.848+0000 7f445d463700 1 -- 172.21.2.105:0/1235860147 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f444800d5c0 con 0x7f44580b0e60 2021-11-12T05:48:11.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.848+0000 7f445d463700 1 -- 172.21.2.105:0/1235860147 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4448000e90 con 0x7f44580b0e60 2021-11-12T05:48:11.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.848+0000 7f445d463700 1 -- 172.21.2.105:0/1235860147 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f444800d910 con 0x7f44580b0e60 2021-11-12T05:48:11.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.848+0000 7f44606c9700 1 -- 172.21.2.105:0/1235860147 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f44580b0e60 msgr2=0x7f44580ac270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:11.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.848+0000 7f44606c9700 1 --2- 172.21.2.105:0/1235860147 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f44580b0e60 0x7f44580ac270 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7f44580b4160 tx=0x7f4448006df0).stop 2021-11-12T05:48:11.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.848+0000 7f44606c9700 1 -- 172.21.2.105:0/1235860147 shutdown_connections 2021-11-12T05:48:11.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.848+0000 7f44606c9700 1 --2- 172.21.2.105:0/1235860147 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f44580b0e60 0x7f44580ac270 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:11.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.848+0000 7f44606c9700 1 -- 172.21.2.105:0/1235860147 >> 172.21.2.105:0/1235860147 conn(0x7f4458063610 msgr2=0x7f44580639f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:11.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.848+0000 7f44606c9700 1 -- 172.21.2.105:0/1235860147 shutdown_connections 2021-11-12T05:48:11.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.848+0000 7f44606c9700 1 -- 172.21.2.105:0/1235860147 wait complete. 2021-11-12T05:48:11.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.852+0000 7f44606c9700 1 Processor -- start 2021-11-12T05:48:11.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.852+0000 7f44606c9700 1 -- start start 2021-11-12T05:48:11.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.852+0000 7f44606c9700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f44580aa700 0x7f44581418e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:11.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.852+0000 7f44606c9700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f44580b0e60 0x7f4458066890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:11.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.852+0000 7f44606c9700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f44580b1cd0 0x7f445813d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:11.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.852+0000 7f44606c9700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445813cc60 con 0x7f44580aa700 2021-11-12T05:48:11.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.852+0000 7f44606c9700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4458141160 con 0x7f44580b0e60 2021-11-12T05:48:11.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.852+0000 7f44606c9700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f445813d0d0 con 0x7f44580b1cd0 2021-11-12T05:48:11.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.852+0000 7f445e465700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f44580aa700 0x7f44581418e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:11.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.852+0000 7f445e465700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f44580aa700 0x7f44581418e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49938/0 (socket says 172.21.2.105:49938) 2021-11-12T05:48:11.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.852+0000 7f445e465700 1 -- 172.21.2.105:0/2160117091 learned_addr learned my addr 172.21.2.105:0/2160117091 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:11.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.852+0000 7f445e465700 1 -- 172.21.2.105:0/2160117091 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f44580b1cd0 msgr2=0x7f445813d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:11.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.852+0000 7f445e465700 1 --2- 172.21.2.105:0/2160117091 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f44580b1cd0 0x7f445813d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:11.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.852+0000 7f445e465700 1 -- 172.21.2.105:0/2160117091 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f44580b0e60 msgr2=0x7f4458066890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:11.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.852+0000 7f445e465700 1 --2- 172.21.2.105:0/2160117091 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f44580b0e60 0x7f4458066890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:11.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.852+0000 7f445e465700 1 -- 172.21.2.105:0/2160117091 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444800b180 con 0x7f44580aa700 2021-11-12T05:48:11.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.852+0000 7f445e465700 1 --2- 172.21.2.105:0/2160117091 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f44580aa700 0x7f44581418e0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 rx=0x7f4454002ef0 tx=0x7f4454006d50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:11.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.852+0000 7f44477fe700 1 -- 172.21.2.105:0/2160117091 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4454009ea0 con 0x7f44580aa700 2021-11-12T05:48:11.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.852+0000 7f44477fe700 1 -- 172.21.2.105:0/2160117091 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4454002320 con 0x7f44580aa700 2021-11-12T05:48:11.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.852+0000 7f44477fe700 1 -- 172.21.2.105:0/2160117091 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4454002680 con 0x7f44580aa700 2021-11-12T05:48:11.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.852+0000 7f44606c9700 1 -- 172.21.2.105:0/2160117091 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4458066d80 con 0x7f44580aa700 2021-11-12T05:48:11.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.852+0000 7f44606c9700 1 -- 172.21.2.105:0/2160117091 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44580aa040 con 0x7f44580aa700 2021-11-12T05:48:11.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.852+0000 7f44606c9700 1 -- 172.21.2.105:0/2160117091 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4458140fa0 con 0x7f44580aa700 2021-11-12T05:48:11.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.852+0000 7f44477fe700 1 -- 172.21.2.105:0/2160117091 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f445400f030 con 0x7f44580aa700 2021-11-12T05:48:11.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.852+0000 7f44477fe700 1 --2- 172.21.2.105:0/2160117091 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4438053660 0x7f4438055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:11.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.852+0000 7f44477fe700 1 -- 172.21.2.105:0/2160117091 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f445406b930 con 0x7f44580aa700 2021-11-12T05:48:11.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.852+0000 7f445dc64700 1 --2- 172.21.2.105:0/2160117091 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4438053660 0x7f4438055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:11.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.852+0000 7f445dc64700 1 --2- 172.21.2.105:0/2160117091 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4438053660 0x7f4438055b20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f44580b4160 tx=0x7f4448012000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:11.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.856+0000 7f44477fe700 1 -- 172.21.2.105:0/2160117091 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4454042830 con 0x7f44580aa700 2021-11-12T05:48:11.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.940+0000 7f44606c9700 1 -- 172.21.2.105:0/2160117091 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4458141320 con 0x7f44580aa700 2021-11-12T05:48:11.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.940+0000 7f44477fe700 1 -- 172.21.2.105:0/2160117091 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v107) v1 ==== 104+0+10 (secure 0 0 0) 0x7f4454045e50 con 0x7f44580aa700 2021-11-12T05:48:11.945 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:48:11.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.940+0000 7f44606c9700 1 -- 172.21.2.105:0/2160117091 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4438053660 msgr2=0x7f4438055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:11.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.940+0000 7f44606c9700 1 --2- 172.21.2.105:0/2160117091 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4438053660 0x7f4438055b20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f44580b4160 tx=0x7f4448012000).stop 2021-11-12T05:48:11.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.940+0000 7f44606c9700 1 -- 172.21.2.105:0/2160117091 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f44580aa700 msgr2=0x7f44581418e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:11.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.940+0000 7f44606c9700 1 --2- 172.21.2.105:0/2160117091 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f44580aa700 0x7f44581418e0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 rx=0x7f4454002ef0 tx=0x7f4454006d50).stop 2021-11-12T05:48:11.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.940+0000 7f44606c9700 1 -- 172.21.2.105:0/2160117091 shutdown_connections 2021-11-12T05:48:11.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.940+0000 7f44606c9700 1 --2- 172.21.2.105:0/2160117091 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4438053660 0x7f4438055b20 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:11.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.940+0000 7f44606c9700 1 --2- 172.21.2.105:0/2160117091 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f44580b1cd0 0x7f445813d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:11.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.940+0000 7f44606c9700 1 --2- 172.21.2.105:0/2160117091 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f44580b0e60 0x7f4458066890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:11.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.940+0000 7f44606c9700 1 --2- 172.21.2.105:0/2160117091 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f44580aa700 0x7f44581418e0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:11.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.940+0000 7f44606c9700 1 -- 172.21.2.105:0/2160117091 >> 172.21.2.105:0/2160117091 conn(0x7f4458063610 msgr2=0x7f44580b5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:11.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.940+0000 7f44606c9700 1 -- 172.21.2.105:0/2160117091 shutdown_connections 2021-11-12T05:48:11.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:11.940+0000 7f44606c9700 1 -- 172.21.2.105:0/2160117091 wait complete. 2021-11-12T05:48:11.952 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-12T05:48:12.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60faaf8700 1 Processor -- start 2021-11-12T05:48:12.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60faaf8700 1 -- start start 2021-11-12T05:48:12.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60faaf8700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60f40ace20 0x7f60f40b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:12.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60faaf8700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f60f4144180 0x7f60f4144610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:12.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60faaf8700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f40b1840 con 0x7f60f40aca40 2021-11-12T05:48:12.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60faaf8700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60f40ad2a0 con 0x7f60f4144180 2021-11-12T05:48:12.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60faaf8700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f40b0a10 con 0x7f60f40ace20 2021-11-12T05:48:12.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60f8894700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f60f40aca40 0x7f60f41473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60340/0 (socket says 172.21.2.105:60340) 2021-11-12T05:48:12.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60f8894700 1 -- 172.21.2.105:0/3065084001 learned_addr learned my addr 172.21.2.105:0/3065084001 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:12.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60f37fe700 1 -- 172.21.2.105:0/3065084001 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4201234809 0 0) 0x7f60f40b1840 con 0x7f60f40aca40 2021-11-12T05:48:12.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60f37fe700 1 -- 172.21.2.105:0/3065084001 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60d4003260 con 0x7f60f40aca40 2021-11-12T05:48:12.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60f9095700 1 --2- 172.21.2.105:0/3065084001 >> v2:172.21.2.115:3300/0 conn(0x7f60f4144180 0x7f60f4144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:12.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60f3fff700 1 --2- 172.21.2.105:0/3065084001 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60f40ace20 0x7f60f40b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:12.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60f37fe700 1 -- 172.21.2.105:0/3065084001 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2908561763 0 0) 0x7f60d4003260 con 0x7f60f40aca40 2021-11-12T05:48:12.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60f37fe700 1 -- 172.21.2.105:0/3065084001 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60f40ace20 msgr2=0x7f60f40b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:12.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60f37fe700 1 --2- 172.21.2.105:0/3065084001 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60f40ace20 0x7f60f40b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:12.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60f37fe700 1 -- 172.21.2.105:0/3065084001 >> v2:172.21.2.115:3300/0 conn(0x7f60f4144180 msgr2=0x7f60f4144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:12.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60f37fe700 1 --2- 172.21.2.105:0/3065084001 >> v2:172.21.2.115:3300/0 conn(0x7f60f4144180 0x7f60f4144610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:12.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60f37fe700 1 -- 172.21.2.105:0/3065084001 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f40af2b0 con 0x7f60f40aca40 2021-11-12T05:48:12.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60f37fe700 1 -- 172.21.2.105:0/3065084001 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f60dc001660 con 0x7f60f40aca40 2021-11-12T05:48:12.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60f37fe700 1 -- 172.21.2.105:0/3065084001 >> v1:172.21.2.105:6789/0 conn(0x7f60f40aca40 legacy=0x7f60f41473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:12.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60f37fe700 1 --2- 172.21.2.105:0/3065084001 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f60d40037d0 0x7f60d4003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:12.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60f37fe700 1 --2- 172.21.2.105:0/3065084001 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60d4004500 0x7f60d4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:12.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60f37fe700 1 --2- 172.21.2.105:0/3065084001 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60f40ace20 0x7f60d4004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:12.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60f37fe700 1 -- 172.21.2.105:0/3065084001 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f40b0a10 con 0x7f60d4004500 2021-11-12T05:48:12.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60f37fe700 1 -- 172.21.2.105:0/3065084001 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60d400b750 con 0x7f60d40037d0 2021-11-12T05:48:12.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60f37fe700 1 -- 172.21.2.105:0/3065084001 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60d400b890 con 0x7f60f40ace20 2021-11-12T05:48:12.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60f3fff700 1 --2- 172.21.2.105:0/3065084001 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60d4004500 0x7f60d4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:12.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60f9095700 1 --2- 172.21.2.105:0/3065084001 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60f40ace20 0x7f60d4004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:12.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60f8894700 1 --2- 172.21.2.105:0/3065084001 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f60d40037d0 0x7f60d4003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:12.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60f9095700 1 -- 172.21.2.105:0/3065084001 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f60d40037d0 msgr2=0x7f60d4003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:12.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60f9095700 1 --2- 172.21.2.105:0/3065084001 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f60d40037d0 0x7f60d4003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:12.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60f9095700 1 -- 172.21.2.105:0/3065084001 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60d4004500 msgr2=0x7f60d4004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:12.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60f9095700 1 --2- 172.21.2.105:0/3065084001 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60d4004500 0x7f60d4004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:12.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60f9095700 1 -- 172.21.2.105:0/3065084001 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d4003260 con 0x7f60f40ace20 2021-11-12T05:48:12.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60f9095700 1 --2- 172.21.2.105:0/3065084001 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60f40ace20 0x7f60d4004e70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f60ec00c000 tx=0x7f60ec0091d0).ready entity=mon.2 client_cookie=b6a1e00720711f8c server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:12.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60f37fe700 1 -- 172.21.2.105:0/3065084001 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60ec00e7e0 con 0x7f60f40ace20 2021-11-12T05:48:12.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60f37fe700 1 -- 172.21.2.105:0/3065084001 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ec00e940 con 0x7f60f40ace20 2021-11-12T05:48:12.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.000+0000 7f60f37fe700 1 -- 172.21.2.105:0/3065084001 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60ec00eca0 con 0x7f60f40ace20 2021-11-12T05:48:12.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.004+0000 7f60faaf8700 1 -- 172.21.2.105:0/3065084001 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60f40ace20 msgr2=0x7f60d4004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:12.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.004+0000 7f60faaf8700 1 --2- 172.21.2.105:0/3065084001 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60f40ace20 0x7f60d4004e70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f60ec00c000 tx=0x7f60ec0091d0).stop 2021-11-12T05:48:12.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.004+0000 7f60f9095700 1 -- 172.21.2.105:0/3065084001 reap_dead start 2021-11-12T05:48:12.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.004+0000 7f60faaf8700 1 -- 172.21.2.105:0/3065084001 shutdown_connections 2021-11-12T05:48:12.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.004+0000 7f60faaf8700 1 -- 172.21.2.105:0/3065084001 >> 172.21.2.105:0/3065084001 conn(0x7f60f405c490 msgr2=0x7f60f40b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:12.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.004+0000 7f60faaf8700 1 -- 172.21.2.105:0/3065084001 shutdown_connections 2021-11-12T05:48:12.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.004+0000 7f60faaf8700 1 -- 172.21.2.105:0/3065084001 wait complete. 2021-11-12T05:48:12.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.004+0000 7f60faaf8700 1 Processor -- start 2021-11-12T05:48:12.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.004+0000 7f60faaf8700 1 -- start start 2021-11-12T05:48:12.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.004+0000 7f60faaf8700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f60f40ace20 0x7f60f414b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:12.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.004+0000 7f60faaf8700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60f4062460 0x7f60f4065ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:12.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.004+0000 7f60faaf8700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60f4148210 0x7f60f4063f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:12.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.004+0000 7f60faaf8700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f40635d0 con 0x7f60f4148210 2021-11-12T05:48:12.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.004+0000 7f60faaf8700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f4063ab0 con 0x7f60f40ace20 2021-11-12T05:48:12.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.004+0000 7f60faaf8700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f4063330 con 0x7f60f4062460 2021-11-12T05:48:12.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.004+0000 7f60f8894700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f60f40ace20 0x7f60f414b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:12.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.004+0000 7f60f3fff700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60f4062460 0x7f60f4065ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:12.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.004+0000 7f60f9095700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60f4148210 0x7f60f4063f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:12.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.004+0000 7f60f3fff700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60f4062460 0x7f60f4065ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3301/0 says I am v2:172.21.2.105:41144/0 (socket says 172.21.2.105:41144) 2021-11-12T05:48:12.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.004+0000 7f60f3fff700 1 -- 172.21.2.105:0/2415345143 learned_addr learned my addr 172.21.2.105:0/2415345143 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:12.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.004+0000 7f60f8894700 1 -- 172.21.2.105:0/2415345143 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60f4062460 msgr2=0x7f60f4065ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:12.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.004+0000 7f60f8894700 1 --2- 172.21.2.105:0/2415345143 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60f4062460 0x7f60f4065ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:12.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.004+0000 7f60f8894700 1 -- 172.21.2.105:0/2415345143 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60f4148210 msgr2=0x7f60f4063f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:12.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.004+0000 7f60f8894700 1 --2- 172.21.2.105:0/2415345143 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60f4148210 0x7f60f4063f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:12.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.004+0000 7f60f8894700 1 -- 172.21.2.105:0/2415345143 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f41477a0 con 0x7f60f40ace20 2021-11-12T05:48:12.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.004+0000 7f60f3fff700 1 --2- 172.21.2.105:0/2415345143 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60f4062460 0x7f60f4065ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-12T05:48:12.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.004+0000 7f60f8894700 1 --2- 172.21.2.105:0/2415345143 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f60f40ace20 0x7f60f414b180 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f60dc00d000 tx=0x7f60dc001d80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:12.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.004+0000 7f60f1ffb700 1 -- 172.21.2.105:0/2415345143 <== mon.1 v2:172.21.2.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60dc012540 con 0x7f60f40ace20 2021-11-12T05:48:12.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.004+0000 7f60f1ffb700 1 -- 172.21.2.105:0/2415345143 <== mon.1 v2:172.21.2.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60dc0126a0 con 0x7f60f40ace20 2021-11-12T05:48:12.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.004+0000 7f60faaf8700 1 -- 172.21.2.105:0/2415345143 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f4065fb0 con 0x7f60f40ace20 2021-11-12T05:48:12.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.004+0000 7f60f1ffb700 1 -- 172.21.2.105:0/2415345143 <== mon.1 v2:172.21.2.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60dc012a00 con 0x7f60f40ace20 2021-11-12T05:48:12.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.004+0000 7f60faaf8700 1 -- 172.21.2.105:0/2415345143 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f40645a0 con 0x7f60f40ace20 2021-11-12T05:48:12.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.004+0000 7f60faaf8700 1 -- 172.21.2.105:0/2415345143 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f4063c70 con 0x7f60f40ace20 2021-11-12T05:48:12.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.004+0000 7f60f1ffb700 1 -- 172.21.2.105:0/2415345143 <== mon.1 v2:172.21.2.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f60dc01b030 con 0x7f60f40ace20 2021-11-12T05:48:12.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.004+0000 7f60f1ffb700 1 --2- 172.21.2.105:0/2415345143 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f60d80535b0 0x7f60d8055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:12.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.004+0000 7f60f1ffb700 1 -- 172.21.2.105:0/2415345143 <== mon.1 v2:172.21.2.115:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f60dc06b330 con 0x7f60f40ace20 2021-11-12T05:48:12.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.004+0000 7f60f3fff700 1 --2- 172.21.2.105:0/2415345143 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f60d80535b0 0x7f60d8055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:12.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.004+0000 7f60f3fff700 1 --2- 172.21.2.105:0/2415345143 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f60d80535b0 0x7f60d8055a70 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f60e400b000 tx=0x7f60e4006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:12.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.008+0000 7f60f1ffb700 1 -- 172.21.2.105:0/2415345143 <== mon.1 v2:172.21.2.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f60f4063c70 con 0x7f60f40ace20 2021-11-12T05:48:12.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.092+0000 7f60faaf8700 1 -- 172.21.2.105:0/2415345143 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f60f4063bf0 con 0x7f60f40ace20 2021-11-12T05:48:12.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.092+0000 7f60f1ffb700 1 -- 172.21.2.105:0/2415345143 <== mon.1 v2:172.21.2.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v107) v1 ==== 100+0+10 (secure 0 0 0) 0x7f60dc019030 con 0x7f60f40ace20 2021-11-12T05:48:12.098 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:48:12.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.092+0000 7f60faaf8700 1 -- 172.21.2.105:0/2415345143 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f60d80535b0 msgr2=0x7f60d8055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:12.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.092+0000 7f60faaf8700 1 --2- 172.21.2.105:0/2415345143 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f60d80535b0 0x7f60d8055a70 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f60e400b000 tx=0x7f60e4006df0).stop 2021-11-12T05:48:12.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.092+0000 7f60faaf8700 1 -- 172.21.2.105:0/2415345143 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f60f40ace20 msgr2=0x7f60f414b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:12.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.092+0000 7f60faaf8700 1 --2- 172.21.2.105:0/2415345143 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f60f40ace20 0x7f60f414b180 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f60dc00d000 tx=0x7f60dc001d80).stop 2021-11-12T05:48:12.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.096+0000 7f60faaf8700 1 -- 172.21.2.105:0/2415345143 shutdown_connections 2021-11-12T05:48:12.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.096+0000 7f60faaf8700 1 --2- 172.21.2.105:0/2415345143 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f60d80535b0 0x7f60d8055a70 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:12.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.096+0000 7f60faaf8700 1 --2- 172.21.2.105:0/2415345143 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60f4148210 0x7f60f4063f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:12.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.096+0000 7f60faaf8700 1 --2- 172.21.2.105:0/2415345143 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60f4062460 0x7f60f4065ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:12.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.096+0000 7f60faaf8700 1 --2- 172.21.2.105:0/2415345143 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f60f40ace20 0x7f60f414b180 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:12.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.096+0000 7f60faaf8700 1 -- 172.21.2.105:0/2415345143 >> 172.21.2.105:0/2415345143 conn(0x7f60f405c490 msgr2=0x7f60f41435b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:12.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.096+0000 7f60faaf8700 1 -- 172.21.2.105:0/2415345143 shutdown_connections 2021-11-12T05:48:12.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.096+0000 7f60faaf8700 1 -- 172.21.2.105:0/2415345143 wait complete. 2021-11-12T05:48:12.105 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-12T05:48:12.106 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:48:12.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.152+0000 7fe35696a700 1 Processor -- start 2021-11-12T05:48:12.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.152+0000 7fe35696a700 1 -- start start 2021-11-12T05:48:12.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.152+0000 7fe35696a700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fe3500ac280 0x7fe35014b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:12.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.152+0000 7fe35696a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe3500af730 0x7fe3500ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:12.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.152+0000 7fe35696a700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3500ac7b0 con 0x7fe3500ad080 2021-11-12T05:48:12.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.152+0000 7fe35696a700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3501488a0 con 0x7fe3500ac280 2021-11-12T05:48:12.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.152+0000 7fe35696a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3500ac9e0 con 0x7fe3500af730 2021-11-12T05:48:12.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.156+0000 7fe34f7fe700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fe3500ac280 0x7fe35014b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:12.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.156+0000 7fe354f07700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe3500af730 0x7fe3500ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:12.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.156+0000 7fe354f07700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe3500af730 0x7fe3500ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3301/0 says I am v2:172.21.2.105:41154/0 (socket says 172.21.2.105:41154) 2021-11-12T05:48:12.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.156+0000 7fe34f7fe700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fe3500ac280 0x7fe35014b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3300/0 says I am v2:172.21.2.105:38908/0 (socket says 172.21.2.105:38908) 2021-11-12T05:48:12.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.156+0000 7fe354f07700 1 -- 172.21.2.105:0/1131810129 learned_addr learned my addr 172.21.2.105:0/1131810129 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:12.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.156+0000 7fe354f07700 1 -- 172.21.2.105:0/1131810129 >> v2:172.21.2.115:3300/0 conn(0x7fe3500ac280 msgr2=0x7fe35014b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:12.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.156+0000 7fe354f07700 1 --2- 172.21.2.105:0/1131810129 >> v2:172.21.2.115:3300/0 conn(0x7fe3500ac280 0x7fe35014b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:12.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.156+0000 7fe354f07700 1 -- 172.21.2.105:0/1131810129 >> v1:172.21.2.115:6789/0 conn(0x7fe3500ad080 legacy=0x7fe35014abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:12.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.156+0000 7fe354f07700 1 -- 172.21.2.105:0/1131810129 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3500b0b30 con 0x7fe3500af730 2021-11-12T05:48:12.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.156+0000 7fe354f07700 1 --2- 172.21.2.105:0/1131810129 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe3500af730 0x7fe3500ad460 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fe3480032f0 tx=0x7fe348009290).ready entity=mon.2 client_cookie=56085ebea6e83d69 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:12.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.156+0000 7fe34effd700 1 -- 172.21.2.105:0/1131810129 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe34800b8a0 con 0x7fe3500af730 2021-11-12T05:48:12.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.156+0000 7fe34effd700 1 -- 172.21.2.105:0/1131810129 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34800ba00 con 0x7fe3500af730 2021-11-12T05:48:12.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.156+0000 7fe34effd700 1 -- 172.21.2.105:0/1131810129 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe34800bb70 con 0x7fe3500af730 2021-11-12T05:48:12.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.156+0000 7fe35696a700 1 -- 172.21.2.105:0/1131810129 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe3500af730 msgr2=0x7fe3500ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:12.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.156+0000 7fe35696a700 1 --2- 172.21.2.105:0/1131810129 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe3500af730 0x7fe3500ad460 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fe3480032f0 tx=0x7fe348009290).stop 2021-11-12T05:48:12.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.156+0000 7fe35696a700 1 -- 172.21.2.105:0/1131810129 shutdown_connections 2021-11-12T05:48:12.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.156+0000 7fe35696a700 1 --2- 172.21.2.105:0/1131810129 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe3500af730 0x7fe3500ad460 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:12.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.156+0000 7fe35696a700 1 --2- 172.21.2.105:0/1131810129 >> v2:172.21.2.115:3300/0 conn(0x7fe3500ac280 0x7fe35014b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:12.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.156+0000 7fe35696a700 1 -- 172.21.2.105:0/1131810129 >> 172.21.2.105:0/1131810129 conn(0x7fe3500b5370 msgr2=0x7fe3500b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:12.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.156+0000 7fe35696a700 1 -- 172.21.2.105:0/1131810129 shutdown_connections 2021-11-12T05:48:12.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.156+0000 7fe35696a700 1 -- 172.21.2.105:0/1131810129 wait complete. 2021-11-12T05:48:12.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.156+0000 7fe35696a700 1 Processor -- start 2021-11-12T05:48:12.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.156+0000 7fe35696a700 1 -- start start 2021-11-12T05:48:12.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.156+0000 7fe35696a700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe3500ac280 0x7fe350156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:12.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.156+0000 7fe35696a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe3500ad080 0x7fe3500a7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:12.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.156+0000 7fe35696a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe3500af730 0x7fe3500a8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:12.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.156+0000 7fe35696a700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3500a9ae0 con 0x7fe3500ad080 2021-11-12T05:48:12.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.156+0000 7fe35696a700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3500a7c00 con 0x7fe3500ac280 2021-11-12T05:48:12.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.156+0000 7fe35696a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3500a7ea0 con 0x7fe3500af730 2021-11-12T05:48:12.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.156+0000 7fe34f7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe3500ad080 0x7fe3500a7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:12.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.156+0000 7fe34f7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe3500ad080 0x7fe3500a7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49970/0 (socket says 172.21.2.105:49970) 2021-11-12T05:48:12.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.156+0000 7fe34f7fe700 1 -- 172.21.2.105:0/4003350490 learned_addr learned my addr 172.21.2.105:0/4003350490 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:12.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.160+0000 7fe34ffff700 1 --2- 172.21.2.105:0/4003350490 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe3500ac280 0x7fe350156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:12.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.160+0000 7fe34f7fe700 1 -- 172.21.2.105:0/4003350490 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe3500af730 msgr2=0x7fe3500a8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:12.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.160+0000 7fe34f7fe700 1 --2- 172.21.2.105:0/4003350490 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe3500af730 0x7fe3500a8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:12.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.160+0000 7fe34f7fe700 1 -- 172.21.2.105:0/4003350490 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe3500ac280 msgr2=0x7fe350156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:12.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.160+0000 7fe34f7fe700 1 --2- 172.21.2.105:0/4003350490 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe3500ac280 0x7fe350156cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:12.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.160+0000 7fe34f7fe700 1 -- 172.21.2.105:0/4003350490 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe348009530 con 0x7fe3500ad080 2021-11-12T05:48:12.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.160+0000 7fe34ffff700 1 --2- 172.21.2.105:0/4003350490 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe3500ac280 0x7fe350156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:48:12.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.160+0000 7fe34f7fe700 1 --2- 172.21.2.105:0/4003350490 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe3500ad080 0x7fe3500a7360 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 rx=0x7fe34000c000 tx=0x7fe340006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:12.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.160+0000 7fe34d7fa700 1 -- 172.21.2.105:0/4003350490 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe340010780 con 0x7fe3500ad080 2021-11-12T05:48:12.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.160+0000 7fe34d7fa700 1 -- 172.21.2.105:0/4003350490 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3400108e0 con 0x7fe3500ad080 2021-11-12T05:48:12.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.160+0000 7fe35696a700 1 -- 172.21.2.105:0/4003350490 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3500a7940 con 0x7fe3500ad080 2021-11-12T05:48:12.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.160+0000 7fe35696a700 1 -- 172.21.2.105:0/4003350490 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3500abc90 con 0x7fe3500ad080 2021-11-12T05:48:12.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.160+0000 7fe34d7fa700 1 -- 172.21.2.105:0/4003350490 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe340010c40 con 0x7fe3500ad080 2021-11-12T05:48:12.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.160+0000 7fe35696a700 1 -- 172.21.2.105:0/4003350490 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3500b1440 con 0x7fe3500ad080 2021-11-12T05:48:12.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.160+0000 7fe34d7fa700 1 -- 172.21.2.105:0/4003350490 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe34001c460 con 0x7fe3500ad080 2021-11-12T05:48:12.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.160+0000 7fe34d7fa700 1 --2- 172.21.2.105:0/4003350490 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe334053610 0x7fe334055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:12.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.160+0000 7fe34d7fa700 1 -- 172.21.2.105:0/4003350490 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fe34006c120 con 0x7fe3500ad080 2021-11-12T05:48:12.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.160+0000 7fe34ffff700 1 --2- 172.21.2.105:0/4003350490 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe334053610 0x7fe334055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:12.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.160+0000 7fe34ffff700 1 --2- 172.21.2.105:0/4003350490 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe334053610 0x7fe334055ad0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7fe338008000 tx=0x7fe338009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:12.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.164+0000 7fe34d7fa700 1 -- 172.21.2.105:0/4003350490 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe340042fc0 con 0x7fe3500ad080 2021-11-12T05:48:12.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.272+0000 7fe35696a700 1 -- 172.21.2.105:0/4003350490 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe350057350 con 0x7fe3500ad080 2021-11-12T05:48:12.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.272+0000 7fe34d7fa700 1 -- 172.21.2.105:0/4003350490 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2140 (secure 0 0 0) 0x7fe3400465e0 con 0x7fe3500ad080 2021-11-12T05:48:12.277 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:12.277 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":50,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5140,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/1083784348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":1083784348},{"type":"v1","addr":"172.21.2.115:6833","nonce":1083784348}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:48:08.977584+0000","modified":"2021-11-12T05:48:09.981269+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7347},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7347":{"gid":7347,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/3290895957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":3290895957},{"type":"v1","addr":"172.21.2.105:6835","nonce":3290895957}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-11-12T05:48:12.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.272+0000 7fe35696a700 1 -- 172.21.2.105:0/4003350490 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe334053610 msgr2=0x7fe334055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:12.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.272+0000 7fe35696a700 1 --2- 172.21.2.105:0/4003350490 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe334053610 0x7fe334055ad0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7fe338008000 tx=0x7fe338009040).stop 2021-11-12T05:48:12.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.272+0000 7fe35696a700 1 -- 172.21.2.105:0/4003350490 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe3500ad080 msgr2=0x7fe3500a7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:12.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.272+0000 7fe35696a700 1 --2- 172.21.2.105:0/4003350490 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe3500ad080 0x7fe3500a7360 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 rx=0x7fe34000c000 tx=0x7fe340006df0).stop 2021-11-12T05:48:12.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.272+0000 7fe35696a700 1 -- 172.21.2.105:0/4003350490 shutdown_connections 2021-11-12T05:48:12.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.272+0000 7fe35696a700 1 --2- 172.21.2.105:0/4003350490 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe334053610 0x7fe334055ad0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:12.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.272+0000 7fe35696a700 1 --2- 172.21.2.105:0/4003350490 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe3500af730 0x7fe3500a8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:12.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.272+0000 7fe35696a700 1 --2- 172.21.2.105:0/4003350490 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe3500ad080 0x7fe3500a7360 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:12.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.272+0000 7fe35696a700 1 --2- 172.21.2.105:0/4003350490 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe3500ac280 0x7fe350156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:12.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.272+0000 7fe35696a700 1 -- 172.21.2.105:0/4003350490 >> 172.21.2.105:0/4003350490 conn(0x7fe3500b5370 msgr2=0x7fe350145c80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:12.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.272+0000 7fe35696a700 1 -- 172.21.2.105:0/4003350490 shutdown_connections 2021-11-12T05:48:12.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.272+0000 7fe35696a700 1 -- 172.21.2.105:0/4003350490 wait complete. 2021-11-12T05:48:12.282 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 50 2021-11-12T05:48:12.485 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 50, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:48:08.977584+0000', 'modified': '2021-11-12T05:48:09.981269+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7347}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7347': {'gid': 7347, 'name': 'a', 'rank': 0, 'incarnation': 49, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/3290895957', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 3290895957}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 3290895957}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:48:12.486 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:48:12.487 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:48:12.552 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":7347,"want_state":"up:active","state":"up:active","rank_uptime":3.5657761309999998,"mdsmap_epoch":50,"osdmap_epoch":107,"osdmap_epoch_barrier":106,"uptime":7.6834974630000001} 2021-11-12T05:48:12.553 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 7347, "mdsmap_epoch": 50, "osdmap_epoch": 107, "osdmap_epoch_barrier": 106, "rank_uptime": 3.565776131, "state": "up:active", "uptime": 7.683497463, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:48:12.553 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-12T05:48:12.554 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-12T05:48:12.554 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba016.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-12T05:48:12.555 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:12.555 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:48:12.566 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:48:12.618 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:48:12.619 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:48:12.625 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:48:12.626 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:48:12.627 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:12.628 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:48:12.676 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-12T05:48:12.676 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:48:12.679 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:48:12.689 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:48:12.690 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:48:12.718 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[14961]: starting ceph client 2021-11-12T05:48:12.719 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:2021-11-12T05:48:12.713+0000 7f5b9eda5080 -1 init, newargv = 0x56488f14d600 newargc=9 2021-11-12T05:48:12.724 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:48:12.725 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:48:12.727 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:12.728 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:48:12.732 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[14961]: starting fuse 2021-11-12T05:48:12.735 INFO:teuthology.orchestra.run.gibba016.stdout:52 2021-11-12T05:48:12.736 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-12T05:48:12.736 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:12.737 DEBUG:teuthology.orchestra.run.gibba016:> sudo python3 -c ' 2021-11-12T05:48:12.737 DEBUG:teuthology.orchestra.run.gibba016:> import glob 2021-11-12T05:48:12.737 DEBUG:teuthology.orchestra.run.gibba016:> import re 2021-11-12T05:48:12.738 DEBUG:teuthology.orchestra.run.gibba016:> import os 2021-11-12T05:48:12.738 DEBUG:teuthology.orchestra.run.gibba016:> import subprocess 2021-11-12T05:48:12.739 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:48:12.739 DEBUG:teuthology.orchestra.run.gibba016:> def find_socket(client_name): 2021-11-12T05:48:12.740 DEBUG:teuthology.orchestra.run.gibba016:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-12T05:48:12.740 DEBUG:teuthology.orchestra.run.gibba016:> files = glob.glob(asok_path) 2021-11-12T05:48:12.740 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:48:12.741 DEBUG:teuthology.orchestra.run.gibba016:> # Given a non-glob path, it better be there 2021-11-12T05:48:12.741 DEBUG:teuthology.orchestra.run.gibba016:> if "*" not in asok_path: 2021-11-12T05:48:12.742 DEBUG:teuthology.orchestra.run.gibba016:> assert(len(files) == 1) 2021-11-12T05:48:12.743 DEBUG:teuthology.orchestra.run.gibba016:> return files[0] 2021-11-12T05:48:12.743 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:48:12.743 DEBUG:teuthology.orchestra.run.gibba016:> for f in files: 2021-11-12T05:48:12.744 DEBUG:teuthology.orchestra.run.gibba016:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-12T05:48:12.745 DEBUG:teuthology.orchestra.run.gibba016:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-12T05:48:12.745 DEBUG:teuthology.orchestra.run.gibba016:> return f 2021-11-12T05:48:12.751 DEBUG:teuthology.orchestra.run.gibba016:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-12T05:48:12.752 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:48:12.752 DEBUG:teuthology.orchestra.run.gibba016:> print(find_socket("client.0")) 2021-11-12T05:48:12.753 DEBUG:teuthology.orchestra.run.gibba016:> ' 2021-11-12T05:48:12.801 INFO:teuthology.orchestra.run.gibba016.stdout:/var/run/ceph/ceph-client.0.14961.asok 2021-11-12T05:48:12.804 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14961.asok 2021-11-12T05:48:12.805 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:12.805 DEBUG:teuthology.orchestra.run.gibba016:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14961.asok status 2021-11-12T05:48:12.855 INFO:teuthology.orchestra.run.gibba016.stdout:{ 2021-11-12T05:48:12.856 INFO:teuthology.orchestra.run.gibba016.stdout: "metadata": { 2021-11-12T05:48:12.856 INFO:teuthology.orchestra.run.gibba016.stdout: "ceph_sha1": "a81ee2815de5acae59ead5b8c9137b6766fc8ea8", 2021-11-12T05:48:12.857 INFO:teuthology.orchestra.run.gibba016.stdout: "ceph_version": "ceph version 15.2.15-22-ga81ee281 (a81ee2815de5acae59ead5b8c9137b6766fc8ea8) octopus (stable)", 2021-11-12T05:48:12.857 INFO:teuthology.orchestra.run.gibba016.stdout: "entity_id": "0", 2021-11-12T05:48:12.857 INFO:teuthology.orchestra.run.gibba016.stdout: "hostname": "gibba016", 2021-11-12T05:48:12.857 INFO:teuthology.orchestra.run.gibba016.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-12T05:48:12.858 INFO:teuthology.orchestra.run.gibba016.stdout: "pid": "14961", 2021-11-12T05:48:12.858 INFO:teuthology.orchestra.run.gibba016.stdout: "root": "/" 2021-11-12T05:48:12.858 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:48:12.858 INFO:teuthology.orchestra.run.gibba016.stdout: "dentry_count": 0, 2021-11-12T05:48:12.859 INFO:teuthology.orchestra.run.gibba016.stdout: "dentry_pinned_count": 0, 2021-11-12T05:48:12.859 INFO:teuthology.orchestra.run.gibba016.stdout: "id": 5182, 2021-11-12T05:48:12.859 INFO:teuthology.orchestra.run.gibba016.stdout: "inst": { 2021-11-12T05:48:12.859 INFO:teuthology.orchestra.run.gibba016.stdout: "name": { 2021-11-12T05:48:12.860 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "client", 2021-11-12T05:48:12.860 INFO:teuthology.orchestra.run.gibba016.stdout: "num": 5182 2021-11-12T05:48:12.860 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:48:12.861 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": { 2021-11-12T05:48:12.861 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "v1", 2021-11-12T05:48:12.861 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": "172.21.2.116:0", 2021-11-12T05:48:12.861 INFO:teuthology.orchestra.run.gibba016.stdout: "nonce": 997663071 2021-11-12T05:48:12.862 INFO:teuthology.orchestra.run.gibba016.stdout: } 2021-11-12T05:48:12.862 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:48:12.863 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": { 2021-11-12T05:48:12.864 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "v1", 2021-11-12T05:48:12.864 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": "172.21.2.116:0", 2021-11-12T05:48:12.864 INFO:teuthology.orchestra.run.gibba016.stdout: "nonce": 997663071 2021-11-12T05:48:12.864 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:48:12.865 INFO:teuthology.orchestra.run.gibba016.stdout: "inst_str": "client.5182 172.21.2.116:0/997663071", 2021-11-12T05:48:12.865 INFO:teuthology.orchestra.run.gibba016.stdout: "addr_str": "172.21.2.116:0/997663071", 2021-11-12T05:48:12.865 INFO:teuthology.orchestra.run.gibba016.stdout: "inode_count": 1, 2021-11-12T05:48:12.865 INFO:teuthology.orchestra.run.gibba016.stdout: "mds_epoch": 50, 2021-11-12T05:48:12.866 INFO:teuthology.orchestra.run.gibba016.stdout: "osd_epoch": 107, 2021-11-12T05:48:12.866 INFO:teuthology.orchestra.run.gibba016.stdout: "osd_epoch_barrier": 0, 2021-11-12T05:48:12.866 INFO:teuthology.orchestra.run.gibba016.stdout: "blacklisted": false, 2021-11-12T05:48:12.866 INFO:teuthology.orchestra.run.gibba016.stdout: "fs_name": "cephfs" 2021-11-12T05:48:12.866 INFO:teuthology.orchestra.run.gibba016.stdout:} 2021-11-12T05:48:12.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:12.869 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:48:12.870 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:48:12.876 INFO:teuthology.orchestra.run.gibba016.stdout:fuseblk 2021-11-12T05:48:12.876 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-12T05:48:12.877 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:12.878 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:48:12.929 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:48:12.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.980+0000 7fcbf400a700 1 Processor -- start 2021-11-12T05:48:12.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.980+0000 7fcbf400a700 1 -- start start 2021-11-12T05:48:12.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.980+0000 7fcbf400a700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fcbec0ad080 0x7fcbec0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:12.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.980+0000 7fcbf400a700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fcbec0ac280 0x7fcbec0ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:12.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.980+0000 7fcbf400a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbec14abe0 0x7fcbec14b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:12.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.980+0000 7fcbf400a700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbec1488a0 con 0x7fcbec0ad080 2021-11-12T05:48:12.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.980+0000 7fcbf400a700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbec0ac7b0 con 0x7fcbec0ac280 2021-11-12T05:48:12.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.980+0000 7fcbf400a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec0ac9e0 con 0x7fcbec14abe0 2021-11-12T05:48:12.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.980+0000 7fcbf1da6700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fcbec0ad080 0x7fcbec0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:12.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.980+0000 7fcbf1da6700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fcbec0ad080 0x7fcbec0af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49976/0 (socket says 172.21.2.105:49976) 2021-11-12T05:48:12.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.980+0000 7fcbf1da6700 1 -- 172.21.2.105:0/1327575060 learned_addr learned my addr 172.21.2.105:0/1327575060 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:12.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.980+0000 7fcbf1da6700 1 -- 172.21.2.105:0/1327575060 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbec14abe0 msgr2=0x7fcbec14b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:12.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.980+0000 7fcbf1da6700 1 --2- 172.21.2.105:0/1327575060 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbec14abe0 0x7fcbec14b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:12.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.980+0000 7fcbf1da6700 1 -- 172.21.2.105:0/1327575060 >> v2:172.21.2.115:3300/0 conn(0x7fcbec0ac280 msgr2=0x7fcbec0ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:12.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.980+0000 7fcbf1da6700 1 --2- 172.21.2.105:0/1327575060 >> v2:172.21.2.115:3300/0 conn(0x7fcbec0ac280 0x7fcbec0ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:12.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.980+0000 7fcbf1da6700 1 -- 172.21.2.105:0/1327575060 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbec0b0b30 con 0x7fcbec0ad080 2021-11-12T05:48:12.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.980+0000 7fcbf1da6700 1 --2- 172.21.2.105:0/1327575060 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbec0ad080 0x7fcbec0af730 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 rx=0x7fcbec0ac6a0 tx=0x7fcbe8006eb0).ready entity=mon.0 client_cookie=6541a3dddbd566b server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:12.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.980+0000 7fcbf0da4700 1 -- 172.21.2.105:0/1327575060 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbe800d570 con 0x7fcbec0ad080 2021-11-12T05:48:12.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.980+0000 7fcbf0da4700 1 -- 172.21.2.105:0/1327575060 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe8000e90 con 0x7fcbec0ad080 2021-11-12T05:48:12.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.980+0000 7fcbf0da4700 1 -- 172.21.2.105:0/1327575060 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbe800d8c0 con 0x7fcbec0ad080 2021-11-12T05:48:12.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.980+0000 7fcbf400a700 1 -- 172.21.2.105:0/1327575060 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbec0ad080 msgr2=0x7fcbec0af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:12.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.980+0000 7fcbf400a700 1 --2- 172.21.2.105:0/1327575060 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbec0ad080 0x7fcbec0af730 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 rx=0x7fcbec0ac6a0 tx=0x7fcbe8006eb0).stop 2021-11-12T05:48:12.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.980+0000 7fcbf400a700 1 -- 172.21.2.105:0/1327575060 shutdown_connections 2021-11-12T05:48:12.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.980+0000 7fcbf400a700 1 --2- 172.21.2.105:0/1327575060 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbec14abe0 0x7fcbec14b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:12.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.980+0000 7fcbf400a700 1 --2- 172.21.2.105:0/1327575060 >> v2:172.21.2.115:3300/0 conn(0x7fcbec0ac280 0x7fcbec0ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:12.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.980+0000 7fcbf400a700 1 --2- 172.21.2.105:0/1327575060 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbec0ad080 0x7fcbec0af730 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:12.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.980+0000 7fcbf400a700 1 -- 172.21.2.105:0/1327575060 >> 172.21.2.105:0/1327575060 conn(0x7fcbec0b5370 msgr2=0x7fcbec0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:12.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.980+0000 7fcbf400a700 1 -- 172.21.2.105:0/1327575060 shutdown_connections 2021-11-12T05:48:12.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.980+0000 7fcbf400a700 1 -- 172.21.2.105:0/1327575060 wait complete. 2021-11-12T05:48:12.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.980+0000 7fcbf400a700 1 Processor -- start 2021-11-12T05:48:12.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.980+0000 7fcbf400a700 1 -- start start 2021-11-12T05:48:12.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.984+0000 7fcbf400a700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcbec0ac280 0x7fcbec0ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:12.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.984+0000 7fcbf400a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbec0ad080 0x7fcbec156be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:12.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.984+0000 7fcbf400a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbec14abe0 0x7fcbec0a97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:12.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.984+0000 7fcbf400a700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec062920 con 0x7fcbec0ad080 2021-11-12T05:48:12.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.984+0000 7fcbf400a700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec0aacf0 con 0x7fcbec0ac280 2021-11-12T05:48:12.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.984+0000 7fcbf400a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec0aaf90 con 0x7fcbec14abe0 2021-11-12T05:48:13.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.984+0000 7fcbf15a5700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbec0ad080 0x7fcbec156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:13.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.984+0000 7fcbf15a5700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbec0ad080 0x7fcbec156be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49984/0 (socket says 172.21.2.105:49984) 2021-11-12T05:48:13.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.984+0000 7fcbf15a5700 1 -- 172.21.2.105:0/1321369744 learned_addr learned my addr 172.21.2.105:0/1321369744 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:13.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.984+0000 7fcbf1da6700 1 --2- 172.21.2.105:0/1321369744 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcbec0ac280 0x7fcbec0ab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:13.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.984+0000 7fcbf15a5700 1 -- 172.21.2.105:0/1321369744 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbec14abe0 msgr2=0x7fcbec0a97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:13.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.984+0000 7fcbf15a5700 1 --2- 172.21.2.105:0/1321369744 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbec14abe0 0x7fcbec0a97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:13.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.984+0000 7fcbf15a5700 1 -- 172.21.2.105:0/1321369744 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcbec0ac280 msgr2=0x7fcbec0ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:13.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.984+0000 7fcbf15a5700 1 --2- 172.21.2.105:0/1321369744 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcbec0ac280 0x7fcbec0ab6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:13.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.984+0000 7fcbf15a5700 1 -- 172.21.2.105:0/1321369744 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe800b1e0 con 0x7fcbec0ad080 2021-11-12T05:48:13.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.984+0000 7fcbf15a5700 1 --2- 172.21.2.105:0/1321369744 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbec0ad080 0x7fcbec156be0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 rx=0x7fcbdc002f70 tx=0x7fcbdc006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:13.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.984+0000 7fcbdaffd700 1 -- 172.21.2.105:0/1321369744 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbdc013460 con 0x7fcbec0ad080 2021-11-12T05:48:13.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.984+0000 7fcbdaffd700 1 -- 172.21.2.105:0/1321369744 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbdc0135c0 con 0x7fcbec0ad080 2021-11-12T05:48:13.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.984+0000 7fcbdaffd700 1 -- 172.21.2.105:0/1321369744 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbdc013920 con 0x7fcbec0ad080 2021-11-12T05:48:13.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.984+0000 7fcbf400a700 1 -- 172.21.2.105:0/1321369744 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbec0ab230 con 0x7fcbec0ad080 2021-11-12T05:48:13.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.984+0000 7fcbf400a700 1 -- 172.21.2.105:0/1321369744 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbec0aa870 con 0x7fcbec0ad080 2021-11-12T05:48:13.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.984+0000 7fcbf400a700 1 -- 172.21.2.105:0/1321369744 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbec0ab3f0 con 0x7fcbec0ad080 2021-11-12T05:48:13.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.984+0000 7fcbdaffd700 1 -- 172.21.2.105:0/1321369744 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcbdc00f070 con 0x7fcbec0ad080 2021-11-12T05:48:13.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.984+0000 7fcbdaffd700 1 --2- 172.21.2.105:0/1321369744 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcbcc0536a0 0x7fcbcc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:13.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.984+0000 7fcbdaffd700 1 -- 172.21.2.105:0/1321369744 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fcbdc06b460 con 0x7fcbec0ad080 2021-11-12T05:48:13.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.984+0000 7fcbf1da6700 1 --2- 172.21.2.105:0/1321369744 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcbcc0536a0 0x7fcbcc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:13.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.984+0000 7fcbf1da6700 1 --2- 172.21.2.105:0/1321369744 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcbcc0536a0 0x7fcbcc055b60 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7fcbe8016000 tx=0x7fcbe8015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:13.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:12.988+0000 7fcbdaffd700 1 -- 172.21.2.105:0/1321369744 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcbdc042470 con 0x7fcbec0ad080 2021-11-12T05:48:13.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.072+0000 7fcbf400a700 1 -- 172.21.2.105:0/1321369744 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcbec14b580 con 0x7fcbec0ad080 2021-11-12T05:48:13.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.072+0000 7fcbdaffd700 1 -- 172.21.2.105:0/1321369744 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+16285 (secure 0 0 0) 0x7fcbdc045a90 con 0x7fcbec0ad080 2021-11-12T05:48:13.077 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:13.077 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":107,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:48:09.982370+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:48:06.914733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-11-12T05:48:07.950921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:48:13.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.072+0000 7fcbf400a700 1 -- 172.21.2.105:0/1321369744 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcbcc0536a0 msgr2=0x7fcbcc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:13.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.072+0000 7fcbf400a700 1 --2- 172.21.2.105:0/1321369744 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcbcc0536a0 0x7fcbcc055b60 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7fcbe8016000 tx=0x7fcbe8015000).stop 2021-11-12T05:48:13.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.072+0000 7fcbf400a700 1 -- 172.21.2.105:0/1321369744 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbec0ad080 msgr2=0x7fcbec156be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:13.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.072+0000 7fcbf400a700 1 --2- 172.21.2.105:0/1321369744 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbec0ad080 0x7fcbec156be0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 rx=0x7fcbdc002f70 tx=0x7fcbdc006ec0).stop 2021-11-12T05:48:13.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.072+0000 7fcbf400a700 1 -- 172.21.2.105:0/1321369744 shutdown_connections 2021-11-12T05:48:13.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.072+0000 7fcbf400a700 1 --2- 172.21.2.105:0/1321369744 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcbcc0536a0 0x7fcbcc055b60 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:13.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.072+0000 7fcbf400a700 1 --2- 172.21.2.105:0/1321369744 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbec14abe0 0x7fcbec0a97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:13.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.072+0000 7fcbf400a700 1 --2- 172.21.2.105:0/1321369744 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbec0ad080 0x7fcbec156be0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:13.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.072+0000 7fcbf400a700 1 --2- 172.21.2.105:0/1321369744 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcbec0ac280 0x7fcbec0ab6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:13.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.072+0000 7fcbf400a700 1 -- 172.21.2.105:0/1321369744 >> 172.21.2.105:0/1321369744 conn(0x7fcbec0b5370 msgr2=0x7fcbec147c60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:13.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.072+0000 7fcbf400a700 1 -- 172.21.2.105:0/1321369744 shutdown_connections 2021-11-12T05:48:13.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.072+0000 7fcbf400a700 1 -- 172.21.2.105:0/1321369744 wait complete. 2021-11-12T05:48:13.084 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-12T05:48:06.914733+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '106', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2021-11-12T05:48:07.950921+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-12T05:48:13.085 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:48:13.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.132+0000 7f9e2b83a700 1 Processor -- start 2021-11-12T05:48:13.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.132+0000 7f9e2b83a700 1 -- start start 2021-11-12T05:48:13.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.132+0000 7f9e2b83a700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f9e240aca40 0x7f9e240ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:13.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.132+0000 7f9e2b83a700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f9e24144180 0x7f9e241445f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:13.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.132+0000 7f9e2b83a700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e240b1840 con 0x7f9e240b0520 2021-11-12T05:48:13.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.132+0000 7f9e2b83a700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e240b09d0 con 0x7f9e24144180 2021-11-12T05:48:13.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.132+0000 7f9e2b83a700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e240af2b0 con 0x7f9e240aca40 2021-11-12T05:48:13.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.132+0000 7f9e28dd5700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f9e240b0520 0x7f9e241473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60390/0 (socket says 172.21.2.105:60390) 2021-11-12T05:48:13.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.132+0000 7f9e28dd5700 1 -- 172.21.2.105:0/3890846147 learned_addr learned my addr 172.21.2.105:0/3890846147 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:13.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.132+0000 7f9e29dd7700 1 --2- 172.21.2.105:0/3890846147 >> v2:172.21.2.105:3300/0 conn(0x7f9e24144180 0x7f9e241445f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:13.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.132+0000 7f9e29dd7700 1 -- 172.21.2.105:0/3890846147 >> v2:172.21.2.115:3300/0 conn(0x7f9e240aca40 msgr2=0x7f9e240ace20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:48:13.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.132+0000 7f9e29dd7700 1 --2- 172.21.2.105:0/3890846147 >> v2:172.21.2.115:3300/0 conn(0x7f9e240aca40 0x7f9e240ace20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:13.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.132+0000 7f9e29dd7700 1 -- 172.21.2.105:0/3890846147 >> v1:172.21.2.105:6789/0 conn(0x7f9e240b0520 legacy=0x7f9e241473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:13.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.132+0000 7f9e29dd7700 1 -- 172.21.2.105:0/3890846147 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e240b1a70 con 0x7f9e24144180 2021-11-12T05:48:13.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.132+0000 7f9e29dd7700 1 --2- 172.21.2.105:0/3890846147 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9e24144180 0x7f9e241445f0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7f9e1c0032f0 tx=0x7f9e1c0091d0).ready entity=mon.0 client_cookie=17a7fe07cd8de03b server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:13.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.132+0000 7f9e17fff700 1 -- 172.21.2.105:0/3890846147 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e1c009ea0 con 0x7f9e24144180 2021-11-12T05:48:13.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.132+0000 7f9e17fff700 1 -- 172.21.2.105:0/3890846147 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1c00b870 con 0x7f9e24144180 2021-11-12T05:48:13.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.132+0000 7f9e17fff700 1 -- 172.21.2.105:0/3890846147 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e1c00ba20 con 0x7f9e24144180 2021-11-12T05:48:13.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.136+0000 7f9e2b83a700 1 -- 172.21.2.105:0/3890846147 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9e24144180 msgr2=0x7f9e241445f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:13.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.136+0000 7f9e2b83a700 1 --2- 172.21.2.105:0/3890846147 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9e24144180 0x7f9e241445f0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7f9e1c0032f0 tx=0x7f9e1c0091d0).stop 2021-11-12T05:48:13.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.136+0000 7f9e2b83a700 1 -- 172.21.2.105:0/3890846147 shutdown_connections 2021-11-12T05:48:13.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.136+0000 7f9e2b83a700 1 --2- 172.21.2.105:0/3890846147 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9e24144180 0x7f9e241445f0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:13.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.136+0000 7f9e2b83a700 1 --2- 172.21.2.105:0/3890846147 >> v2:172.21.2.115:3300/0 conn(0x7f9e240aca40 0x7f9e240ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:13.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.136+0000 7f9e2b83a700 1 -- 172.21.2.105:0/3890846147 >> 172.21.2.105:0/3890846147 conn(0x7f9e2405c490 msgr2=0x7f9e240b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:13.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.136+0000 7f9e2b83a700 1 -- 172.21.2.105:0/3890846147 shutdown_connections 2021-11-12T05:48:13.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.136+0000 7f9e2b83a700 1 -- 172.21.2.105:0/3890846147 wait complete. 2021-11-12T05:48:13.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.136+0000 7f9e2b83a700 1 Processor -- start 2021-11-12T05:48:13.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.136+0000 7f9e2b83a700 1 -- start start 2021-11-12T05:48:13.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.136+0000 7f9e2b83a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9e240aca40 0x7f9e241466a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:13.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.136+0000 7f9e2b83a700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9e240b0520 0x7f9e2415a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:13.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.136+0000 7f9e2b83a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9e24144180 0x7f9e2415a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:13.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.136+0000 7f9e2b83a700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e24159c90 con 0x7f9e24144180 2021-11-12T05:48:13.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.136+0000 7f9e2b83a700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e24066ef0 con 0x7f9e240b0520 2021-11-12T05:48:13.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.136+0000 7f9e2b83a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e24066c10 con 0x7f9e240aca40 2021-11-12T05:48:13.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.136+0000 7f9e29dd7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9e24144180 0x7f9e2415a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:13.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.136+0000 7f9e29dd7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9e24144180 0x7f9e2415a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:49998/0 (socket says 172.21.2.105:49998) 2021-11-12T05:48:13.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.136+0000 7f9e29dd7700 1 -- 172.21.2.105:0/485334237 learned_addr learned my addr 172.21.2.105:0/485334237 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:13.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.136+0000 7f9e29dd7700 1 -- 172.21.2.105:0/485334237 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9e240aca40 msgr2=0x7f9e241466a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:48:13.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.136+0000 7f9e29dd7700 1 --2- 172.21.2.105:0/485334237 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9e240aca40 0x7f9e241466a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:13.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.136+0000 7f9e29dd7700 1 -- 172.21.2.105:0/485334237 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9e240b0520 msgr2=0x7f9e2415a0c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:48:13.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.136+0000 7f9e29dd7700 1 --2- 172.21.2.105:0/485334237 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9e240b0520 0x7f9e2415a0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:13.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.136+0000 7f9e29dd7700 1 -- 172.21.2.105:0/485334237 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e1c009470 con 0x7f9e24144180 2021-11-12T05:48:13.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.136+0000 7f9e29dd7700 1 --2- 172.21.2.105:0/485334237 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9e24144180 0x7f9e2415a5b0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7f9e1c0032f0 tx=0x7f9e1c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:13.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.136+0000 7f9e167fc700 1 -- 172.21.2.105:0/485334237 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e1c009ea0 con 0x7f9e24144180 2021-11-12T05:48:13.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.136+0000 7f9e167fc700 1 -- 172.21.2.105:0/485334237 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1c01f5e0 con 0x7f9e24144180 2021-11-12T05:48:13.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.136+0000 7f9e167fc700 1 -- 172.21.2.105:0/485334237 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e1c01f940 con 0x7f9e24144180 2021-11-12T05:48:13.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.136+0000 7f9e2b83a700 1 -- 172.21.2.105:0/485334237 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e2415aaa0 con 0x7f9e24144180 2021-11-12T05:48:13.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.136+0000 7f9e2b83a700 1 -- 172.21.2.105:0/485334237 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e24146b90 con 0x7f9e24144180 2021-11-12T05:48:13.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.136+0000 7f9e2b83a700 1 -- 172.21.2.105:0/485334237 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e24159e20 con 0x7f9e24144180 2021-11-12T05:48:13.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.136+0000 7f9e167fc700 1 -- 172.21.2.105:0/485334237 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9e1c026030 con 0x7f9e24144180 2021-11-12T05:48:13.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.136+0000 7f9e167fc700 1 --2- 172.21.2.105:0/485334237 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9e0c0536f0 0x7f9e0c055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:13.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.136+0000 7f9e167fc700 1 -- 172.21.2.105:0/485334237 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f9e1c06c740 con 0x7f9e24144180 2021-11-12T05:48:13.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.136+0000 7f9e295d6700 1 --2- 172.21.2.105:0/485334237 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9e0c0536f0 0x7f9e0c055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:13.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.136+0000 7f9e295d6700 1 --2- 172.21.2.105:0/485334237 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9e0c0536f0 0x7f9e0c055bb0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f9e20002fb0 tx=0x7f9e20006930).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:13.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.140+0000 7f9e167fc700 1 -- 172.21.2.105:0/485334237 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9e24159e20 con 0x7f9e24144180 2021-11-12T05:48:13.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.224+0000 7f9e2b83a700 1 -- 172.21.2.105:0/485334237 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f9e24159dd0 con 0x7f9e24144180 2021-11-12T05:48:13.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.224+0000 7f9e167fc700 1 -- 172.21.2.105:0/485334237 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v107) v1 ==== 110+0+10 (secure 0 0 0) 0x7f9e1c015020 con 0x7f9e24144180 2021-11-12T05:48:13.228 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:48:13.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.224+0000 7f9e2b83a700 1 -- 172.21.2.105:0/485334237 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9e0c0536f0 msgr2=0x7f9e0c055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:13.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.224+0000 7f9e2b83a700 1 --2- 172.21.2.105:0/485334237 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9e0c0536f0 0x7f9e0c055bb0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f9e20002fb0 tx=0x7f9e20006930).stop 2021-11-12T05:48:13.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.224+0000 7f9e2b83a700 1 -- 172.21.2.105:0/485334237 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9e24144180 msgr2=0x7f9e2415a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:13.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.224+0000 7f9e2b83a700 1 --2- 172.21.2.105:0/485334237 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9e24144180 0x7f9e2415a5b0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7f9e1c0032f0 tx=0x7f9e1c016000).stop 2021-11-12T05:48:13.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.224+0000 7f9e2b83a700 1 -- 172.21.2.105:0/485334237 shutdown_connections 2021-11-12T05:48:13.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.224+0000 7f9e2b83a700 1 --2- 172.21.2.105:0/485334237 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9e0c0536f0 0x7f9e0c055bb0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:13.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.224+0000 7f9e2b83a700 1 --2- 172.21.2.105:0/485334237 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9e24144180 0x7f9e2415a5b0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:13.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.224+0000 7f9e2b83a700 1 --2- 172.21.2.105:0/485334237 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9e240b0520 0x7f9e2415a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:13.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.224+0000 7f9e2b83a700 1 --2- 172.21.2.105:0/485334237 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9e240aca40 0x7f9e241466a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:13.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.224+0000 7f9e2b83a700 1 -- 172.21.2.105:0/485334237 >> 172.21.2.105:0/485334237 conn(0x7f9e2405c490 msgr2=0x7f9e2414b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:13.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.224+0000 7f9e2b83a700 1 -- 172.21.2.105:0/485334237 shutdown_connections 2021-11-12T05:48:13.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.224+0000 7f9e2b83a700 1 -- 172.21.2.105:0/485334237 wait complete. 2021-11-12T05:48:13.235 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:48:13.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f870a4e2700 1 Processor -- start 2021-11-12T05:48:13.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f870a4e2700 1 -- start start 2021-11-12T05:48:13.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f870a4e2700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f87040b2e20 0x7f87040b1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:13.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f870a4e2700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87040ad400 con 0x7f870413ea50 2021-11-12T05:48:13.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f870a4e2700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87040b3200 con 0x7f8704142c50 2021-11-12T05:48:13.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f870a4e2700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87040ad660 con 0x7f87040b2e20 2021-11-12T05:48:13.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f87037fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f870413ea50 0x7f870413eec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60404/0 (socket says 172.21.2.105:60404) 2021-11-12T05:48:13.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f87037fe700 1 -- 172.21.2.105:0/3395308672 learned_addr learned my addr 172.21.2.105:0/3395308672 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:13.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f8702ffd700 1 -- 172.21.2.105:0/3395308672 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4022524564 0 0) 0x7f87040ad400 con 0x7f870413ea50 2021-11-12T05:48:13.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f8702ffd700 1 -- 172.21.2.105:0/3395308672 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86f0003260 con 0x7f870413ea50 2021-11-12T05:48:13.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f8703fff700 1 --2- 172.21.2.105:0/3395308672 >> v2:172.21.2.115:3300/0 conn(0x7f87040b2e20 0x7f87040b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:13.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f8702ffd700 1 -- 172.21.2.105:0/3395308672 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1018602855 0 0) 0x7f86f0003260 con 0x7f870413ea50 2021-11-12T05:48:13.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f8702ffd700 1 -- 172.21.2.105:0/3395308672 >> v2:172.21.2.115:3300/0 conn(0x7f87040b2e20 msgr2=0x7f87040b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:13.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f8702ffd700 1 --2- 172.21.2.105:0/3395308672 >> v2:172.21.2.115:3300/0 conn(0x7f87040b2e20 0x7f87040b1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:13.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f8702ffd700 1 -- 172.21.2.105:0/3395308672 >> v1:172.21.2.115:6789/0 conn(0x7f8704142c50 legacy=0x7f8704143070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:13.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f8702ffd700 1 -- 172.21.2.105:0/3395308672 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87040ad900 con 0x7f870413ea50 2021-11-12T05:48:13.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f8702ffd700 1 -- 172.21.2.105:0/3395308672 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f86f8001680 con 0x7f870413ea50 2021-11-12T05:48:13.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f8702ffd700 1 -- 172.21.2.105:0/3395308672 >> v1:172.21.2.105:6789/0 conn(0x7f870413ea50 legacy=0x7f870413eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:13.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f8702ffd700 1 --2- 172.21.2.105:0/3395308672 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f86f0003820 0x7f86f0003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:13.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f8702ffd700 1 --2- 172.21.2.105:0/3395308672 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f86f0004500 0x7f86f0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:13.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f8702ffd700 1 --2- 172.21.2.105:0/3395308672 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f86f0005050 0x7f86f000c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:13.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f8702ffd700 1 -- 172.21.2.105:0/3395308672 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87040ad660 con 0x7f86f0003820 2021-11-12T05:48:13.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f8702ffd700 1 -- 172.21.2.105:0/3395308672 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f0005980 con 0x7f86f0005050 2021-11-12T05:48:13.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f8702ffd700 1 -- 172.21.2.105:0/3395308672 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f0005b40 con 0x7f86f0004500 2021-11-12T05:48:13.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f8703fff700 1 --2- 172.21.2.105:0/3395308672 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f86f0003820 0x7f86f0003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:13.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f8703fff700 1 -- 172.21.2.105:0/3395308672 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f86f0004500 msgr2=0x7f86f0004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:13.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f8703fff700 1 --2- 172.21.2.105:0/3395308672 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f86f0004500 0x7f86f0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:13.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f8703fff700 1 -- 172.21.2.105:0/3395308672 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f86f0005050 msgr2=0x7f86f000c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:13.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f8703fff700 1 --2- 172.21.2.105:0/3395308672 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f86f0005050 0x7f86f000c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:13.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f8703fff700 1 -- 172.21.2.105:0/3395308672 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f0003260 con 0x7f86f0003820 2021-11-12T05:48:13.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f8708a7f700 1 -- 172.21.2.105:0/3395308672 reap_dead start 2021-11-12T05:48:13.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f8703fff700 1 --2- 172.21.2.105:0/3395308672 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f86f0003820 0x7f86f0003c20 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7f86f4007000 tx=0x7f86f4008040).ready entity=mon.0 client_cookie=d26684a64786f3f0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:13.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f8702ffd700 1 -- 172.21.2.105:0/3395308672 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86f4012470 con 0x7f86f0003820 2021-11-12T05:48:13.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f8702ffd700 1 -- 172.21.2.105:0/3395308672 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f400c030 con 0x7f86f0003820 2021-11-12T05:48:13.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f8702ffd700 1 -- 172.21.2.105:0/3395308672 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86f40127c0 con 0x7f86f0003820 2021-11-12T05:48:13.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f870a4e2700 1 -- 172.21.2.105:0/3395308672 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f86f0003820 msgr2=0x7f86f0003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:13.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f870a4e2700 1 --2- 172.21.2.105:0/3395308672 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f86f0003820 0x7f86f0003c20 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7f86f4007000 tx=0x7f86f4008040).stop 2021-11-12T05:48:13.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f870a4e2700 1 -- 172.21.2.105:0/3395308672 shutdown_connections 2021-11-12T05:48:13.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f870a4e2700 1 --2- 172.21.2.105:0/3395308672 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f86f0003820 0x7f86f0003c20 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:13.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f870a4e2700 1 -- 172.21.2.105:0/3395308672 >> 172.21.2.105:0/3395308672 conn(0x7f8704062f60 msgr2=0x7f8704063370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:13.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f870a4e2700 1 -- 172.21.2.105:0/3395308672 shutdown_connections 2021-11-12T05:48:13.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.284+0000 7f870a4e2700 1 -- 172.21.2.105:0/3395308672 wait complete. 2021-11-12T05:48:13.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.288+0000 7f870a4e2700 1 Processor -- start 2021-11-12T05:48:13.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.288+0000 7f870a4e2700 1 -- start start 2021-11-12T05:48:13.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.288+0000 7f870a4e2700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f86f0003820 0x7f8704065160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:13.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.288+0000 7f870a4e2700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f870413cc70 0x7f870414e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:13.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.288+0000 7f870a4e2700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f870414e6e0 0x7f870414eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:13.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.288+0000 7f870a4e2700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8704065990 con 0x7f870413cc70 2021-11-12T05:48:13.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.288+0000 7f870a4e2700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8704065c30 con 0x7f870414e6e0 2021-11-12T05:48:13.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.288+0000 7f870a4e2700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f870413dc90 con 0x7f86f0003820 2021-11-12T05:48:13.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.288+0000 7f87037fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f870413cc70 0x7f870414e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:13.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.288+0000 7f87037fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f870413cc70 0x7f870414e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50018/0 (socket says 172.21.2.105:50018) 2021-11-12T05:48:13.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.288+0000 7f87037fe700 1 -- 172.21.2.105:0/3702413346 learned_addr learned my addr 172.21.2.105:0/3702413346 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:13.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.288+0000 7f87037fe700 1 -- 172.21.2.105:0/3702413346 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f86f0003820 msgr2=0x7f8704065160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:13.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.288+0000 7f87037fe700 1 --2- 172.21.2.105:0/3702413346 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f86f0003820 0x7f8704065160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:13.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.288+0000 7f87037fe700 1 -- 172.21.2.105:0/3702413346 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f870414e6e0 msgr2=0x7f870414eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:13.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.288+0000 7f87037fe700 1 --2- 172.21.2.105:0/3702413346 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f870414e6e0 0x7f870414eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:13.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.288+0000 7f87037fe700 1 -- 172.21.2.105:0/3702413346 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870413e130 con 0x7f870413cc70 2021-11-12T05:48:13.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.288+0000 7f87037fe700 1 --2- 172.21.2.105:0/3702413346 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f870413cc70 0x7f870414e1f0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7f87040b35c0 tx=0x7f87040ada90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:13.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.288+0000 7f87017fa700 1 -- 172.21.2.105:0/3702413346 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86f8007170 con 0x7f870413cc70 2021-11-12T05:48:13.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.288+0000 7f87017fa700 1 -- 172.21.2.105:0/3702413346 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f80072d0 con 0x7f870413cc70 2021-11-12T05:48:13.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.288+0000 7f870a4e2700 1 -- 172.21.2.105:0/3702413346 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f870413bf20 con 0x7f870413cc70 2021-11-12T05:48:13.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.288+0000 7f870a4e2700 1 -- 172.21.2.105:0/3702413346 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f870413b990 con 0x7f870413cc70 2021-11-12T05:48:13.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.288+0000 7f87017fa700 1 -- 172.21.2.105:0/3702413346 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86f8004920 con 0x7f870413cc70 2021-11-12T05:48:13.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.288+0000 7f870a4e2700 1 -- 172.21.2.105:0/3702413346 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87040b2060 con 0x7f870413cc70 2021-11-12T05:48:13.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.288+0000 7f87017fa700 1 -- 172.21.2.105:0/3702413346 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f86f8004a80 con 0x7f870413cc70 2021-11-12T05:48:13.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.288+0000 7f87017fa700 1 --2- 172.21.2.105:0/3702413346 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f86e40536f0 0x7f86e4055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:13.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.288+0000 7f87017fa700 1 -- 172.21.2.105:0/3702413346 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f86f806b800 con 0x7f870413cc70 2021-11-12T05:48:13.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.288+0000 7f8703fff700 1 --2- 172.21.2.105:0/3702413346 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f86e40536f0 0x7f86e4055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:13.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.288+0000 7f8703fff700 1 --2- 172.21.2.105:0/3702413346 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f86e40536f0 0x7f86e4055bb0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f86f4007000 tx=0x7f86f4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:13.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.292+0000 7f87017fa700 1 -- 172.21.2.105:0/3702413346 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f86f80426a0 con 0x7f870413cc70 2021-11-12T05:48:13.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.376+0000 7f870a4e2700 1 -- 172.21.2.105:0/3702413346 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8704057350 con 0x7f870413cc70 2021-11-12T05:48:13.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.376+0000 7f87017fa700 1 -- 172.21.2.105:0/3702413346 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v107) v1 ==== 92+0+10 (secure 0 0 0) 0x7f86f8045cc0 con 0x7f870413cc70 2021-11-12T05:48:13.382 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:48:13.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.376+0000 7f870a4e2700 1 -- 172.21.2.105:0/3702413346 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f86e40536f0 msgr2=0x7f86e4055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:13.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.376+0000 7f870a4e2700 1 --2- 172.21.2.105:0/3702413346 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f86e40536f0 0x7f86e4055bb0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f86f4007000 tx=0x7f86f4008040).stop 2021-11-12T05:48:13.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.376+0000 7f870a4e2700 1 -- 172.21.2.105:0/3702413346 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f870413cc70 msgr2=0x7f870414e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:13.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.376+0000 7f870a4e2700 1 --2- 172.21.2.105:0/3702413346 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f870413cc70 0x7f870414e1f0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7f87040b35c0 tx=0x7f87040ada90).stop 2021-11-12T05:48:13.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.376+0000 7f870a4e2700 1 -- 172.21.2.105:0/3702413346 shutdown_connections 2021-11-12T05:48:13.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.376+0000 7f870a4e2700 1 --2- 172.21.2.105:0/3702413346 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f86e40536f0 0x7f86e4055bb0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:13.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.376+0000 7f870a4e2700 1 --2- 172.21.2.105:0/3702413346 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f870414e6e0 0x7f870414eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:13.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.376+0000 7f870a4e2700 1 --2- 172.21.2.105:0/3702413346 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f870413cc70 0x7f870414e1f0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:13.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.376+0000 7f870a4e2700 1 --2- 172.21.2.105:0/3702413346 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f86f0003820 0x7f8704065160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:13.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.376+0000 7f870a4e2700 1 -- 172.21.2.105:0/3702413346 >> 172.21.2.105:0/3702413346 conn(0x7f8704062f60 msgr2=0x7f8704140e30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:13.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.376+0000 7f870a4e2700 1 -- 172.21.2.105:0/3702413346 shutdown_connections 2021-11-12T05:48:13.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.380+0000 7f870a4e2700 1 -- 172.21.2.105:0/3702413346 wait complete. 2021-11-12T05:48:13.389 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-12T05:48:13.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.464+0000 7f399fe31700 1 Processor -- start 2021-11-12T05:48:13.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.464+0000 7f399fe31700 1 -- start start 2021-11-12T05:48:13.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.464+0000 7f399fe31700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f39980b1cd0 0x7f39980ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:13.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.464+0000 7f399fe31700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f39980b0e60 0x7f39980abb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:13.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.464+0000 7f399fe31700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f39980aa700 0x7f39980ac050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:13.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.464+0000 7f399fe31700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39980b2870 con 0x7f39980aa700 2021-11-12T05:48:13.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.464+0000 7f399fe31700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39980b20b0 con 0x7f39980b0e60 2021-11-12T05:48:13.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.464+0000 7f399fe31700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39980b13e0 con 0x7f39980b1cd0 2021-11-12T05:48:13.478 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.464+0000 7f399e3ce700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f39980aa700 0x7f39980ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:13.478 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.464+0000 7f399e3ce700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f39980aa700 0x7f39980ac050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50028/0 (socket says 172.21.2.105:50028) 2021-11-12T05:48:13.478 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.464+0000 7f399e3ce700 1 -- 172.21.2.105:0/3619424377 learned_addr learned my addr 172.21.2.105:0/3619424377 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:13.479 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.464+0000 7f399e3ce700 1 -- 172.21.2.105:0/3619424377 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f39980b1cd0 msgr2=0x7f39980ad2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:13.479 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.464+0000 7f399e3ce700 1 --2- 172.21.2.105:0/3619424377 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f39980b1cd0 0x7f39980ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:13.479 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.464+0000 7f399e3ce700 1 -- 172.21.2.105:0/3619424377 >> v2:172.21.2.115:3300/0 conn(0x7f39980b0e60 msgr2=0x7f39980abb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:13.479 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.464+0000 7f399e3ce700 1 --2- 172.21.2.105:0/3619424377 >> v2:172.21.2.115:3300/0 conn(0x7f39980b0e60 0x7f39980abb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:13.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.464+0000 7f399e3ce700 1 -- 172.21.2.105:0/3619424377 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39980ace10 con 0x7f39980aa700 2021-11-12T05:48:13.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.464+0000 7f399e3ce700 1 --2- 172.21.2.105:0/3619424377 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f39980aa700 0x7f39980ac050 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7f39900032f0 tx=0x7f399000b530).ready entity=mon.0 client_cookie=36ea23fab018932f server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:13.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f399cbcb700 1 -- 172.21.2.105:0/3619424377 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f399000be70 con 0x7f39980aa700 2021-11-12T05:48:13.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f399cbcb700 1 -- 172.21.2.105:0/3619424377 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3990010470 con 0x7f39980aa700 2021-11-12T05:48:13.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f399cbcb700 1 -- 172.21.2.105:0/3619424377 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39900107d0 con 0x7f39980aa700 2021-11-12T05:48:13.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f399fe31700 1 -- 172.21.2.105:0/3619424377 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f39980aa700 msgr2=0x7f39980ac050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:13.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f399fe31700 1 --2- 172.21.2.105:0/3619424377 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f39980aa700 0x7f39980ac050 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7f39900032f0 tx=0x7f399000b530).stop 2021-11-12T05:48:13.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f399fe31700 1 -- 172.21.2.105:0/3619424377 shutdown_connections 2021-11-12T05:48:13.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f399fe31700 1 --2- 172.21.2.105:0/3619424377 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f39980aa700 0x7f39980ac050 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:13.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f399fe31700 1 --2- 172.21.2.105:0/3619424377 >> v2:172.21.2.115:3300/0 conn(0x7f39980b0e60 0x7f39980abb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:13.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f399fe31700 1 --2- 172.21.2.105:0/3619424377 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f39980b1cd0 0x7f39980ad2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:13.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f399fe31700 1 -- 172.21.2.105:0/3619424377 >> 172.21.2.105:0/3619424377 conn(0x7f3998063610 msgr2=0x7f39980639f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:13.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f399fe31700 1 -- 172.21.2.105:0/3619424377 shutdown_connections 2021-11-12T05:48:13.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f399fe31700 1 -- 172.21.2.105:0/3619424377 wait complete. 2021-11-12T05:48:13.483 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f399fe31700 1 Processor -- start 2021-11-12T05:48:13.483 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f399fe31700 1 -- start start 2021-11-12T05:48:13.483 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f399fe31700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f39980aa700 0x7f39980afd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:13.483 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f399fe31700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f39980b0e60 0x7f3998065870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:13.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f399fe31700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f39980b1cd0 0x7f3998137700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:13.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f399fe31700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399813df50 con 0x7f39980b1cd0 2021-11-12T05:48:13.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f399fe31700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39980b0720 con 0x7f39980b0e60 2021-11-12T05:48:13.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f399fe31700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f399813ee60 con 0x7f39980aa700 2021-11-12T05:48:13.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f399e3ce700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f39980b1cd0 0x7f3998137700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:13.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f399e3ce700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f39980b1cd0 0x7f3998137700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50034/0 (socket says 172.21.2.105:50034) 2021-11-12T05:48:13.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f399e3ce700 1 -- 172.21.2.105:0/4220165940 learned_addr learned my addr 172.21.2.105:0/4220165940 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:13.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f399e3ce700 1 -- 172.21.2.105:0/4220165940 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f39980aa700 msgr2=0x7f39980afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:13.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f399e3ce700 1 --2- 172.21.2.105:0/4220165940 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f39980aa700 0x7f39980afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:13.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f399e3ce700 1 -- 172.21.2.105:0/4220165940 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f39980b0e60 msgr2=0x7f3998065870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:13.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f399e3ce700 1 --2- 172.21.2.105:0/4220165940 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f39980b0e60 0x7f3998065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:13.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f399e3ce700 1 -- 172.21.2.105:0/4220165940 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399000b7d0 con 0x7f39980b1cd0 2021-11-12T05:48:13.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f399e3ce700 1 --2- 172.21.2.105:0/4220165940 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f39980b1cd0 0x7f3998137700 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7f39900032f0 tx=0x7f399000b530).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:13.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f398affd700 1 -- 172.21.2.105:0/4220165940 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f399001d070 con 0x7f39980b1cd0 2021-11-12T05:48:13.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f398affd700 1 -- 172.21.2.105:0/4220165940 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39900188d0 con 0x7f39980b1cd0 2021-11-12T05:48:13.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f398affd700 1 -- 172.21.2.105:0/4220165940 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3990018c30 con 0x7f39980b1cd0 2021-11-12T05:48:13.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f399fe31700 1 -- 172.21.2.105:0/4220165940 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f399813f100 con 0x7f39980b1cd0 2021-11-12T05:48:13.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f399fe31700 1 -- 172.21.2.105:0/4220165940 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3998065d60 con 0x7f39980b1cd0 2021-11-12T05:48:13.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f399fe31700 1 -- 172.21.2.105:0/4220165940 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f399813ec90 con 0x7f39980b1cd0 2021-11-12T05:48:13.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f398affd700 1 -- 172.21.2.105:0/4220165940 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3990029070 con 0x7f39980b1cd0 2021-11-12T05:48:13.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f398affd700 1 --2- 172.21.2.105:0/4220165940 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f39780534f0 0x7f39780559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:13.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f398affd700 1 -- 172.21.2.105:0/4220165940 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f399006d580 con 0x7f39980b1cd0 2021-11-12T05:48:13.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f399dbcd700 1 --2- 172.21.2.105:0/4220165940 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f39780534f0 0x7f39780559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:13.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.468+0000 7f399dbcd700 1 --2- 172.21.2.105:0/4220165940 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f39780534f0 0x7f39780559b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f398c002f70 tx=0x7f398c006950).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:13.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.472+0000 7f398affd700 1 -- 172.21.2.105:0/4220165940 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3990044540 con 0x7f39980b1cd0 2021-11-12T05:48:13.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.556+0000 7f399fe31700 1 -- 172.21.2.105:0/4220165940 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f39980acb50 con 0x7f39980b1cd0 2021-11-12T05:48:13.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.556+0000 7f398affd700 1 -- 172.21.2.105:0/4220165940 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v107) v1 ==== 104+0+10 (secure 0 0 0) 0x7f3990047aa0 con 0x7f39980b1cd0 2021-11-12T05:48:13.562 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:48:13.563 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.556+0000 7f399fe31700 1 -- 172.21.2.105:0/4220165940 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f39780534f0 msgr2=0x7f39780559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:13.564 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.556+0000 7f399fe31700 1 --2- 172.21.2.105:0/4220165940 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f39780534f0 0x7f39780559b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f398c002f70 tx=0x7f398c006950).stop 2021-11-12T05:48:13.564 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.556+0000 7f399fe31700 1 -- 172.21.2.105:0/4220165940 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f39980b1cd0 msgr2=0x7f3998137700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:13.564 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.556+0000 7f399fe31700 1 --2- 172.21.2.105:0/4220165940 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f39980b1cd0 0x7f3998137700 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7f39900032f0 tx=0x7f399000b530).stop 2021-11-12T05:48:13.564 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.556+0000 7f399fe31700 1 -- 172.21.2.105:0/4220165940 shutdown_connections 2021-11-12T05:48:13.565 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.556+0000 7f399fe31700 1 --2- 172.21.2.105:0/4220165940 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f39780534f0 0x7f39780559b0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:13.565 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.556+0000 7f399fe31700 1 --2- 172.21.2.105:0/4220165940 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f39980b1cd0 0x7f3998137700 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:13.565 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.556+0000 7f399fe31700 1 --2- 172.21.2.105:0/4220165940 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f39980b0e60 0x7f3998065870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:13.565 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.556+0000 7f399fe31700 1 --2- 172.21.2.105:0/4220165940 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f39980aa700 0x7f39980afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:13.566 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.556+0000 7f399fe31700 1 -- 172.21.2.105:0/4220165940 >> 172.21.2.105:0/4220165940 conn(0x7f3998063610 msgr2=0x7f399805bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:13.566 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.560+0000 7f399fe31700 1 -- 172.21.2.105:0/4220165940 shutdown_connections 2021-11-12T05:48:13.566 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.560+0000 7f399fe31700 1 -- 172.21.2.105:0/4220165940 wait complete. 2021-11-12T05:48:13.569 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-12T05:48:13.632 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.628+0000 7f076eb12700 1 Processor -- start 2021-11-12T05:48:13.632 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.628+0000 7f076eb12700 1 -- start start 2021-11-12T05:48:13.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.628+0000 7f076eb12700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f07680aca40 0x7f07680ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:13.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.628+0000 7f076eb12700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f07680b0520 0x7f07681473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:13.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.628+0000 7f076eb12700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07680b1840 con 0x7f07681478b0 2021-11-12T05:48:13.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.628+0000 7f076eb12700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0768147d40 con 0x7f07680b0520 2021-11-12T05:48:13.634 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.628+0000 7f076eb12700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07680af2b0 con 0x7f07680aca40 2021-11-12T05:48:13.634 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.628+0000 7f076d0af700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f07681478b0 0x7f0768144180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60438/0 (socket says 172.21.2.105:60438) 2021-11-12T05:48:13.634 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.628+0000 7f076d0af700 1 -- 172.21.2.105:0/1128208476 learned_addr learned my addr 172.21.2.105:0/1128208476 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:13.634 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.628+0000 7f0767fff700 1 --2- 172.21.2.105:0/1128208476 >> v2:172.21.2.105:3300/0 conn(0x7f07680b0520 0x7f07681473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:13.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.628+0000 7f0767fff700 1 -- 172.21.2.105:0/1128208476 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f07680aca40 msgr2=0x7f07680ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:13.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.628+0000 7f0767fff700 1 --2- 172.21.2.105:0/1128208476 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f07680aca40 0x7f07680ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:13.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.628+0000 7f0767fff700 1 -- 172.21.2.105:0/1128208476 >> v1:172.21.2.105:6789/0 conn(0x7f07681478b0 legacy=0x7f0768144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:13.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.628+0000 7f0767fff700 1 -- 172.21.2.105:0/1128208476 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07680b09a0 con 0x7f07680b0520 2021-11-12T05:48:13.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.628+0000 7f0767fff700 1 --2- 172.21.2.105:0/1128208476 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f07680b0520 0x7f07681473c0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7f0750002f70 tx=0x7f0750006df0).ready entity=mon.0 client_cookie=242ace845c0de68d server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:13.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.628+0000 7f07677fe700 1 -- 172.21.2.105:0/1128208476 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f075000d570 con 0x7f07680b0520 2021-11-12T05:48:13.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.628+0000 7f07677fe700 1 -- 172.21.2.105:0/1128208476 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0750000e90 con 0x7f07680b0520 2021-11-12T05:48:13.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.628+0000 7f07677fe700 1 -- 172.21.2.105:0/1128208476 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f075000d8c0 con 0x7f07680b0520 2021-11-12T05:48:13.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.628+0000 7f076eb12700 1 -- 172.21.2.105:0/1128208476 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f07680b0520 msgr2=0x7f07681473c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:13.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.628+0000 7f076eb12700 1 --2- 172.21.2.105:0/1128208476 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f07680b0520 0x7f07681473c0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7f0750002f70 tx=0x7f0750006df0).stop 2021-11-12T05:48:13.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.628+0000 7f076eb12700 1 -- 172.21.2.105:0/1128208476 shutdown_connections 2021-11-12T05:48:13.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.628+0000 7f076eb12700 1 --2- 172.21.2.105:0/1128208476 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f07680b0520 0x7f07681473c0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:13.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.628+0000 7f076eb12700 1 --2- 172.21.2.105:0/1128208476 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f07680aca40 0x7f07680ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:13.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.628+0000 7f076eb12700 1 -- 172.21.2.105:0/1128208476 >> 172.21.2.105:0/1128208476 conn(0x7f076805c490 msgr2=0x7f07680b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:13.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.628+0000 7f076eb12700 1 -- 172.21.2.105:0/1128208476 shutdown_connections 2021-11-12T05:48:13.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.628+0000 7f076eb12700 1 -- 172.21.2.105:0/1128208476 wait complete. 2021-11-12T05:48:13.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.632+0000 7f076eb12700 1 Processor -- start 2021-11-12T05:48:13.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.632+0000 7f076eb12700 1 -- start start 2021-11-12T05:48:13.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.632+0000 7f076eb12700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f07680aca40 0x7f0768064760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:13.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.632+0000 7f076eb12700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f07680b0520 0x7f0768141540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:13.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.632+0000 7f076eb12700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f07681478b0 0x7f0768141a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:13.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.632+0000 7f076eb12700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07681566f0 con 0x7f07681478b0 2021-11-12T05:48:13.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.632+0000 7f076eb12700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07680a71a0 con 0x7f07680b0520 2021-11-12T05:48:13.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.632+0000 7f076eb12700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07680a7440 con 0x7f07680aca40 2021-11-12T05:48:13.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.632+0000 7f076d0af700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f07681478b0 0x7f0768141a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:13.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.632+0000 7f076d0af700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f07681478b0 0x7f0768141a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50048/0 (socket says 172.21.2.105:50048) 2021-11-12T05:48:13.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.632+0000 7f076d0af700 1 -- 172.21.2.105:0/2599957410 learned_addr learned my addr 172.21.2.105:0/2599957410 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:13.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.632+0000 7f076d0af700 1 -- 172.21.2.105:0/2599957410 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f07680aca40 msgr2=0x7f0768064760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:13.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.632+0000 7f076d0af700 1 --2- 172.21.2.105:0/2599957410 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f07680aca40 0x7f0768064760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:13.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.632+0000 7f076d0af700 1 -- 172.21.2.105:0/2599957410 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f07680b0520 msgr2=0x7f0768141540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:13.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.632+0000 7f076d0af700 1 --2- 172.21.2.105:0/2599957410 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f07680b0520 0x7f0768141540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:13.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.632+0000 7f076d0af700 1 -- 172.21.2.105:0/2599957410 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f075000b180 con 0x7f07681478b0 2021-11-12T05:48:13.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.632+0000 7f076d0af700 1 --2- 172.21.2.105:0/2599957410 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f07681478b0 0x7f0768141a30 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7f07680b00d0 tx=0x7f0760007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:13.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.632+0000 7f0765ffb700 1 -- 172.21.2.105:0/2599957410 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0760005ba0 con 0x7f07681478b0 2021-11-12T05:48:13.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.632+0000 7f0765ffb700 1 -- 172.21.2.105:0/2599957410 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0760005d00 con 0x7f07681478b0 2021-11-12T05:48:13.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.632+0000 7f076eb12700 1 -- 172.21.2.105:0/2599957410 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0768063a70 con 0x7f07681478b0 2021-11-12T05:48:13.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.632+0000 7f076eb12700 1 -- 172.21.2.105:0/2599957410 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0768063670 con 0x7f07681478b0 2021-11-12T05:48:13.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.632+0000 7f0765ffb700 1 -- 172.21.2.105:0/2599957410 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07600072c0 con 0x7f07681478b0 2021-11-12T05:48:13.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.632+0000 7f076eb12700 1 -- 172.21.2.105:0/2599957410 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0740003410 con 0x7f07681478b0 2021-11-12T05:48:13.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.632+0000 7f0765ffb700 1 -- 172.21.2.105:0/2599957410 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0760010070 con 0x7f07681478b0 2021-11-12T05:48:13.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.632+0000 7f0765ffb700 1 --2- 172.21.2.105:0/2599957410 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f074c053660 0x7f074c055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:13.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.632+0000 7f0765ffb700 1 -- 172.21.2.105:0/2599957410 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f076006b880 con 0x7f07681478b0 2021-11-12T05:48:13.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.632+0000 7f076c8ae700 1 --2- 172.21.2.105:0/2599957410 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f074c053660 0x7f074c055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:13.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.632+0000 7f076c8ae700 1 --2- 172.21.2.105:0/2599957410 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f074c053660 0x7f074c055b20 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f0758002f70 tx=0x7f0758006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:13.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.636+0000 7f0765ffb700 1 -- 172.21.2.105:0/2599957410 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0760042780 con 0x7f07681478b0 2021-11-12T05:48:13.722 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.716+0000 7f076eb12700 1 -- 172.21.2.105:0/2599957410 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0740003c40 con 0x7f07681478b0 2021-11-12T05:48:13.722 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.716+0000 7f0765ffb700 1 -- 172.21.2.105:0/2599957410 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v107) v1 ==== 100+0+10 (secure 0 0 0) 0x7f0760045da0 con 0x7f07681478b0 2021-11-12T05:48:13.723 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:48:13.723 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.720+0000 7f076eb12700 1 -- 172.21.2.105:0/2599957410 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f074c053660 msgr2=0x7f074c055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:13.724 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.720+0000 7f076eb12700 1 --2- 172.21.2.105:0/2599957410 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f074c053660 0x7f074c055b20 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f0758002f70 tx=0x7f0758006a80).stop 2021-11-12T05:48:13.724 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.720+0000 7f076eb12700 1 -- 172.21.2.105:0/2599957410 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f07681478b0 msgr2=0x7f0768141a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:13.724 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.720+0000 7f076eb12700 1 --2- 172.21.2.105:0/2599957410 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f07681478b0 0x7f0768141a30 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7f07680b00d0 tx=0x7f0760007f60).stop 2021-11-12T05:48:13.724 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.720+0000 7f076eb12700 1 -- 172.21.2.105:0/2599957410 shutdown_connections 2021-11-12T05:48:13.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.720+0000 7f076eb12700 1 --2- 172.21.2.105:0/2599957410 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f074c053660 0x7f074c055b20 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:13.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.720+0000 7f076eb12700 1 --2- 172.21.2.105:0/2599957410 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f07681478b0 0x7f0768141a30 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:13.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.720+0000 7f076eb12700 1 --2- 172.21.2.105:0/2599957410 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f07680b0520 0x7f0768141540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:13.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.720+0000 7f076eb12700 1 --2- 172.21.2.105:0/2599957410 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f07680aca40 0x7f0768064760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:13.726 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.720+0000 7f076eb12700 1 -- 172.21.2.105:0/2599957410 >> 172.21.2.105:0/2599957410 conn(0x7f076805c490 msgr2=0x7f0768144f40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:13.726 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.720+0000 7f076eb12700 1 -- 172.21.2.105:0/2599957410 shutdown_connections 2021-11-12T05:48:13.726 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.720+0000 7f076eb12700 1 -- 172.21.2.105:0/2599957410 wait complete. 2021-11-12T05:48:13.730 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-12T05:48:13.730 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:48:13.782 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.776+0000 7fe2b9a24700 1 Processor -- start 2021-11-12T05:48:13.783 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.776+0000 7fe2b9a24700 1 -- start start 2021-11-12T05:48:13.783 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.776+0000 7fe2b9a24700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fe2b40b01b0 0x7fe2b40b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:13.783 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.776+0000 7fe2b9a24700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b40b5ea0 con 0x7fe2b40aeb80 2021-11-12T05:48:13.784 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.776+0000 7fe2b9a24700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b40b1a60 con 0x7fe2b40b5ac0 2021-11-12T05:48:13.784 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.776+0000 7fe2b9a24700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b40accd0 con 0x7fe2b40b01b0 2021-11-12T05:48:13.784 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.776+0000 7fe2b37fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fe2b40aeb80 0x7fe2b413e020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60450/0 (socket says 172.21.2.105:60450) 2021-11-12T05:48:13.784 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.776+0000 7fe2b37fe700 1 -- 172.21.2.105:0/3024929305 learned_addr learned my addr 172.21.2.105:0/3024929305 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:13.788 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b1ffb700 1 -- 172.21.2.105:0/3024929305 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2222713808 0 0) 0x7fe2b40b5ea0 con 0x7fe2b40aeb80 2021-11-12T05:48:13.789 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b1ffb700 1 -- 172.21.2.105:0/3024929305 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe298003260 con 0x7fe2b40aeb80 2021-11-12T05:48:13.789 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b1ffb700 1 -- 172.21.2.105:0/3024929305 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1885495084 0 0) 0x7fe298003260 con 0x7fe2b40aeb80 2021-11-12T05:48:13.789 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b1ffb700 1 -- 172.21.2.105:0/3024929305 >> v2:172.21.2.115:3300/0 conn(0x7fe2b40b01b0 msgr2=0x7fe2b40b13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:13.789 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b1ffb700 1 --2- 172.21.2.105:0/3024929305 >> v2:172.21.2.115:3300/0 conn(0x7fe2b40b01b0 0x7fe2b40b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:13.790 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b1ffb700 1 -- 172.21.2.105:0/3024929305 >> v1:172.21.2.115:6789/0 conn(0x7fe2b40b5ac0 legacy=0x7fe2b40ae470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:13.790 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b1ffb700 1 -- 172.21.2.105:0/3024929305 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b40acf70 con 0x7fe2b40aeb80 2021-11-12T05:48:13.790 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b1ffb700 1 -- 172.21.2.105:0/3024929305 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fe2ac0019e0 con 0x7fe2b40aeb80 2021-11-12T05:48:13.790 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b1ffb700 1 -- 172.21.2.105:0/3024929305 >> v1:172.21.2.105:6789/0 conn(0x7fe2b40aeb80 legacy=0x7fe2b413e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:13.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b1ffb700 1 --2- 172.21.2.105:0/3024929305 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe2980037d0 0x7fe298003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:13.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b1ffb700 1 --2- 172.21.2.105:0/3024929305 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe298004500 0x7fe298004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:13.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b1ffb700 1 --2- 172.21.2.105:0/3024929305 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe298005070 0x7fe298007730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:13.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b1ffb700 1 -- 172.21.2.105:0/3024929305 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b40accd0 con 0x7fe298004500 2021-11-12T05:48:13.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b1ffb700 1 -- 172.21.2.105:0/3024929305 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe298007ed0 con 0x7fe298005070 2021-11-12T05:48:13.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b1ffb700 1 -- 172.21.2.105:0/3024929305 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe298008090 con 0x7fe2980037d0 2021-11-12T05:48:13.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b27fc700 1 --2- 172.21.2.105:0/3024929305 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe298004500 0x7fe298004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:13.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b27fc700 1 -- 172.21.2.105:0/3024929305 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe2980037d0 msgr2=0x7fe298003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:13.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b27fc700 1 --2- 172.21.2.105:0/3024929305 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe2980037d0 0x7fe298003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:13.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b27fc700 1 -- 172.21.2.105:0/3024929305 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe298005070 msgr2=0x7fe298007730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:13.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b27fc700 1 --2- 172.21.2.105:0/3024929305 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe298005070 0x7fe298007730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:13.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b27fc700 1 -- 172.21.2.105:0/3024929305 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b40acf70 con 0x7fe298004500 2021-11-12T05:48:13.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b37fe700 1 -- 172.21.2.105:0/3024929305 reap_dead start 2021-11-12T05:48:13.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b27fc700 1 --2- 172.21.2.105:0/3024929305 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe298004500 0x7fe298004980 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7fe2a4002f70 tx=0x7fe2a4006ca0).ready entity=mon.0 client_cookie=1b3120007f93df30 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:13.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b1ffb700 1 -- 172.21.2.105:0/3024929305 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2a4012460 con 0x7fe298004500 2021-11-12T05:48:13.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b1ffb700 1 -- 172.21.2.105:0/3024929305 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a40125c0 con 0x7fe298004500 2021-11-12T05:48:13.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b1ffb700 1 -- 172.21.2.105:0/3024929305 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2a4012920 con 0x7fe298004500 2021-11-12T05:48:13.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b9a24700 1 -- 172.21.2.105:0/3024929305 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe298004500 msgr2=0x7fe298004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:13.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b9a24700 1 --2- 172.21.2.105:0/3024929305 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe298004500 0x7fe298004980 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7fe2a4002f70 tx=0x7fe2a4006ca0).stop 2021-11-12T05:48:13.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b9a24700 1 -- 172.21.2.105:0/3024929305 shutdown_connections 2021-11-12T05:48:13.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b9a24700 1 --2- 172.21.2.105:0/3024929305 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe298004500 0x7fe298004980 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:13.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b9a24700 1 -- 172.21.2.105:0/3024929305 >> 172.21.2.105:0/3024929305 conn(0x7fe2b40628b0 msgr2=0x7fe2b4062c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:13.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b9a24700 1 -- 172.21.2.105:0/3024929305 shutdown_connections 2021-11-12T05:48:13.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b9a24700 1 -- 172.21.2.105:0/3024929305 wait complete. 2021-11-12T05:48:13.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b9a24700 1 Processor -- start 2021-11-12T05:48:13.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b9a24700 1 -- start start 2021-11-12T05:48:13.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b9a24700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe298004500 0x7fe2b413ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:13.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b9a24700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe2b413f110 0x7fe2b4139350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:13.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b9a24700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2b4138ee0 0x7fe2b41520b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:13.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b9a24700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b4136d00 con 0x7fe2b4138ee0 2021-11-12T05:48:13.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b9a24700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b41389f0 con 0x7fe2b413f110 2021-11-12T05:48:13.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b9a24700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b413c140 con 0x7fe298004500 2021-11-12T05:48:13.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b37fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2b4138ee0 0x7fe2b41520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:13.798 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b37fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2b4138ee0 0x7fe2b41520b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50068/0 (socket says 172.21.2.105:50068) 2021-11-12T05:48:13.798 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b37fe700 1 -- 172.21.2.105:0/213248665 learned_addr learned my addr 172.21.2.105:0/213248665 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:13.798 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b37fe700 1 -- 172.21.2.105:0/213248665 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe298004500 msgr2=0x7fe2b413ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:13.798 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b37fe700 1 --2- 172.21.2.105:0/213248665 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe298004500 0x7fe2b413ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:13.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b37fe700 1 -- 172.21.2.105:0/213248665 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe2b413f110 msgr2=0x7fe2b4139350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:13.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b37fe700 1 --2- 172.21.2.105:0/213248665 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe2b413f110 0x7fe2b4139350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:13.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b37fe700 1 -- 172.21.2.105:0/213248665 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b413c3e0 con 0x7fe2b4138ee0 2021-11-12T05:48:13.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b37fe700 1 --2- 172.21.2.105:0/213248665 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2b4138ee0 0x7fe2b41520b0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7fe2b405d270 tx=0x7fe2ac001ca0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:13.800 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2a3fff700 1 -- 172.21.2.105:0/213248665 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2ac004ab0 con 0x7fe2b4138ee0 2021-11-12T05:48:13.800 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2a3fff700 1 -- 172.21.2.105:0/213248665 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ac004c10 con 0x7fe2b4138ee0 2021-11-12T05:48:13.800 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2a3fff700 1 -- 172.21.2.105:0/213248665 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2ac0070d0 con 0x7fe2b4138ee0 2021-11-12T05:48:13.800 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b9a24700 1 -- 172.21.2.105:0/213248665 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b413fb00 con 0x7fe2b4138ee0 2021-11-12T05:48:13.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.780+0000 7fe2b9a24700 1 -- 172.21.2.105:0/213248665 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b4151920 con 0x7fe2b4138ee0 2021-11-12T05:48:13.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.784+0000 7fe2b9a24700 1 -- 172.21.2.105:0/213248665 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2b413a240 con 0x7fe2b4138ee0 2021-11-12T05:48:13.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.784+0000 7fe2a3fff700 1 -- 172.21.2.105:0/213248665 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe2ac01c070 con 0x7fe2b4138ee0 2021-11-12T05:48:13.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.784+0000 7fe2a3fff700 1 --2- 172.21.2.105:0/213248665 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe290053520 0x7fe2900559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:13.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.784+0000 7fe2a3fff700 1 -- 172.21.2.105:0/213248665 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fe2ac06af30 con 0x7fe2b4138ee0 2021-11-12T05:48:13.802 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.784+0000 7fe2b2ffd700 1 --2- 172.21.2.105:0/213248665 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe290053520 0x7fe2900559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:13.802 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.784+0000 7fe2b2ffd700 1 --2- 172.21.2.105:0/213248665 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe290053520 0x7fe2900559e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7fe2a8000f70 tx=0x7fe2a80069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:13.802 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.784+0000 7fe2a3fff700 1 -- 172.21.2.105:0/213248665 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe2ac041f40 con 0x7fe2b4138ee0 2021-11-12T05:48:13.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.896+0000 7fe2b9a24700 1 -- 172.21.2.105:0/213248665 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2b4138c20 con 0x7fe2b4138ee0 2021-11-12T05:48:13.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.896+0000 7fe2a3fff700 1 -- 172.21.2.105:0/213248665 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2140 (secure 0 0 0) 0x7fe2b4138c20 con 0x7fe2b4138ee0 2021-11-12T05:48:13.901 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:13.901 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":50,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5140,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/1083784348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":1083784348},{"type":"v1","addr":"172.21.2.115:6833","nonce":1083784348}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:48:08.977584+0000","modified":"2021-11-12T05:48:09.981269+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7347},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7347":{"gid":7347,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/3290895957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":3290895957},{"type":"v1","addr":"172.21.2.105:6835","nonce":3290895957}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-11-12T05:48:13.902 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.896+0000 7fe2b9a24700 1 -- 172.21.2.105:0/213248665 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe290053520 msgr2=0x7fe2900559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:13.903 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.896+0000 7fe2b9a24700 1 --2- 172.21.2.105:0/213248665 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe290053520 0x7fe2900559e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7fe2a8000f70 tx=0x7fe2a80069b0).stop 2021-11-12T05:48:13.903 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.896+0000 7fe2b9a24700 1 -- 172.21.2.105:0/213248665 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2b4138ee0 msgr2=0x7fe2b41520b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:13.903 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.896+0000 7fe2b9a24700 1 --2- 172.21.2.105:0/213248665 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2b4138ee0 0x7fe2b41520b0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7fe2b405d270 tx=0x7fe2ac001ca0).stop 2021-11-12T05:48:13.903 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.896+0000 7fe2b9a24700 1 -- 172.21.2.105:0/213248665 shutdown_connections 2021-11-12T05:48:13.904 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.896+0000 7fe2b9a24700 1 --2- 172.21.2.105:0/213248665 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe290053520 0x7fe2900559e0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:13.904 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.896+0000 7fe2b9a24700 1 --2- 172.21.2.105:0/213248665 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2b4138ee0 0x7fe2b41520b0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:13.904 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.896+0000 7fe2b9a24700 1 --2- 172.21.2.105:0/213248665 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe2b413f110 0x7fe2b4139350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:13.904 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.896+0000 7fe2b9a24700 1 --2- 172.21.2.105:0/213248665 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe298004500 0x7fe2b413ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:13.905 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.896+0000 7fe2b9a24700 1 -- 172.21.2.105:0/213248665 >> 172.21.2.105:0/213248665 conn(0x7fe2b40628b0 msgr2=0x7fe2b40b4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:13.905 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.896+0000 7fe2b9a24700 1 -- 172.21.2.105:0/213248665 shutdown_connections 2021-11-12T05:48:13.905 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:13.896+0000 7fe2b9a24700 1 -- 172.21.2.105:0/213248665 wait complete. 2021-11-12T05:48:13.906 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 50 2021-11-12T05:48:14.109 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 50, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:48:08.977584+0000', 'modified': '2021-11-12T05:48:09.981269+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7347}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7347': {'gid': 7347, 'name': 'a', 'rank': 0, 'incarnation': 49, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/3290895957', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 3290895957}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 3290895957}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:48:14.110 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:48:14.110 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:48:14.176 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":7347,"want_state":"up:active","state":"up:active","rank_uptime":5.1902693969999998,"mdsmap_epoch":50,"osdmap_epoch":107,"osdmap_epoch_barrier":106,"uptime":9.3079845930000005} 2021-11-12T05:48:14.176 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 7347, "mdsmap_epoch": 50, "osdmap_epoch": 107, "osdmap_epoch_barrier": 106, "rank_uptime": 5.190269397, "state": "up:active", "uptime": 9.307984593, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:48:14.177 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-12T05:48:14.177 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-11-12T05:48:14.178 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@gibba038.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-11-12T05:48:14.178 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:14.179 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:48:14.190 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-12T05:48:14.201 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:48:14.202 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:48:14.207 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:48:14.208 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:48:14.209 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:14.209 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-12T05:48:14.255 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-12T05:48:14.255 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:48:14.258 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-12T05:48:14.267 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:48:14.268 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:48:14.298 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:ceph-fuse[14417]: starting ceph client 2021-11-12T05:48:14.298 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:2021-11-12T05:48:14.296+0000 7f18ca0f7080 -1 init, newargv = 0x55b6aa62de60 newargc=9 2021-11-12T05:48:14.303 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:48:14.304 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:48:14.305 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:14.306 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-12T05:48:14.311 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:ceph-fuse[14417]: starting fuse 2021-11-12T05:48:14.315 INFO:teuthology.orchestra.run.gibba038.stdout:52 2021-11-12T05:48:14.316 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-12T05:48:14.316 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:14.317 DEBUG:teuthology.orchestra.run.gibba038:> sudo python3 -c ' 2021-11-12T05:48:14.318 DEBUG:teuthology.orchestra.run.gibba038:> import glob 2021-11-12T05:48:14.319 DEBUG:teuthology.orchestra.run.gibba038:> import re 2021-11-12T05:48:14.319 DEBUG:teuthology.orchestra.run.gibba038:> import os 2021-11-12T05:48:14.320 DEBUG:teuthology.orchestra.run.gibba038:> import subprocess 2021-11-12T05:48:14.321 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:48:14.322 DEBUG:teuthology.orchestra.run.gibba038:> def find_socket(client_name): 2021-11-12T05:48:14.322 DEBUG:teuthology.orchestra.run.gibba038:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-11-12T05:48:14.323 DEBUG:teuthology.orchestra.run.gibba038:> files = glob.glob(asok_path) 2021-11-12T05:48:14.324 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:48:14.325 DEBUG:teuthology.orchestra.run.gibba038:> # Given a non-glob path, it better be there 2021-11-12T05:48:14.325 DEBUG:teuthology.orchestra.run.gibba038:> if "*" not in asok_path: 2021-11-12T05:48:14.326 DEBUG:teuthology.orchestra.run.gibba038:> assert(len(files) == 1) 2021-11-12T05:48:14.327 DEBUG:teuthology.orchestra.run.gibba038:> return files[0] 2021-11-12T05:48:14.328 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:48:14.328 DEBUG:teuthology.orchestra.run.gibba038:> for f in files: 2021-11-12T05:48:14.329 DEBUG:teuthology.orchestra.run.gibba038:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-12T05:48:14.330 DEBUG:teuthology.orchestra.run.gibba038:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-12T05:48:14.330 DEBUG:teuthology.orchestra.run.gibba038:> return f 2021-11-12T05:48:14.331 DEBUG:teuthology.orchestra.run.gibba038:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-12T05:48:14.332 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:48:14.333 DEBUG:teuthology.orchestra.run.gibba038:> print(find_socket("client.1")) 2021-11-12T05:48:14.333 DEBUG:teuthology.orchestra.run.gibba038:> ' 2021-11-12T05:48:14.395 INFO:teuthology.orchestra.run.gibba038.stdout:/var/run/ceph/ceph-client.1.14417.asok 2021-11-12T05:48:14.399 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14417.asok 2021-11-12T05:48:14.400 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:14.400 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14417.asok status 2021-11-12T05:48:14.461 INFO:teuthology.orchestra.run.gibba038.stdout:{ 2021-11-12T05:48:14.461 INFO:teuthology.orchestra.run.gibba038.stdout: "metadata": { 2021-11-12T05:48:14.462 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_sha1": "a81ee2815de5acae59ead5b8c9137b6766fc8ea8", 2021-11-12T05:48:14.462 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_version": "ceph version 15.2.15-22-ga81ee281 (a81ee2815de5acae59ead5b8c9137b6766fc8ea8) octopus (stable)", 2021-11-12T05:48:14.462 INFO:teuthology.orchestra.run.gibba038.stdout: "entity_id": "1", 2021-11-12T05:48:14.462 INFO:teuthology.orchestra.run.gibba038.stdout: "hostname": "gibba038", 2021-11-12T05:48:14.463 INFO:teuthology.orchestra.run.gibba038.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-11-12T05:48:14.463 INFO:teuthology.orchestra.run.gibba038.stdout: "pid": "14417", 2021-11-12T05:48:14.463 INFO:teuthology.orchestra.run.gibba038.stdout: "root": "/" 2021-11-12T05:48:14.463 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:48:14.463 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_count": 0, 2021-11-12T05:48:14.464 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_pinned_count": 0, 2021-11-12T05:48:14.464 INFO:teuthology.orchestra.run.gibba038.stdout: "id": 7566, 2021-11-12T05:48:14.464 INFO:teuthology.orchestra.run.gibba038.stdout: "inst": { 2021-11-12T05:48:14.464 INFO:teuthology.orchestra.run.gibba038.stdout: "name": { 2021-11-12T05:48:14.465 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "client", 2021-11-12T05:48:14.465 INFO:teuthology.orchestra.run.gibba038.stdout: "num": 7566 2021-11-12T05:48:14.465 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:48:14.465 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-12T05:48:14.466 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-12T05:48:14.466 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-12T05:48:14.466 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 1108548027 2021-11-12T05:48:14.466 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-11-12T05:48:14.466 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:48:14.467 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-12T05:48:14.467 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-12T05:48:14.467 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-12T05:48:14.467 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 1108548027 2021-11-12T05:48:14.468 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:48:14.468 INFO:teuthology.orchestra.run.gibba038.stdout: "inst_str": "client.7566 172.21.2.138:0/1108548027", 2021-11-12T05:48:14.468 INFO:teuthology.orchestra.run.gibba038.stdout: "addr_str": "172.21.2.138:0/1108548027", 2021-11-12T05:48:14.468 INFO:teuthology.orchestra.run.gibba038.stdout: "inode_count": 1, 2021-11-12T05:48:14.469 INFO:teuthology.orchestra.run.gibba038.stdout: "mds_epoch": 50, 2021-11-12T05:48:14.469 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch": 107, 2021-11-12T05:48:14.469 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch_barrier": 0, 2021-11-12T05:48:14.469 INFO:teuthology.orchestra.run.gibba038.stdout: "blacklisted": false, 2021-11-12T05:48:14.469 INFO:teuthology.orchestra.run.gibba038.stdout: "fs_name": "cephfs" 2021-11-12T05:48:14.470 INFO:teuthology.orchestra.run.gibba038.stdout:} 2021-11-12T05:48:14.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:14.471 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:48:14.472 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:48:14.477 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-12T05:48:14.478 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-12T05:48:14.478 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:14.479 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:48:14.529 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2021-11-12T05:48:14.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.596+0000 7f256ddd1700 1 Processor -- start 2021-11-12T05:48:14.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.596+0000 7f256ddd1700 1 -- start start 2021-11-12T05:48:14.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.596+0000 7f256ddd1700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f25680ace20 0x7f25680b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:14.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.596+0000 7f256ddd1700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2568144180 0x7f2568144610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:14.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.596+0000 7f256ddd1700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25680b1840 con 0x7f25680aca40 2021-11-12T05:48:14.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.596+0000 7f256ddd1700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25680b0a10 con 0x7f25680ace20 2021-11-12T05:48:14.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.596+0000 7f256ddd1700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25680af2b0 con 0x7f2568144180 2021-11-12T05:48:14.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.596+0000 7f2566ffd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f25680ace20 0x7f25680b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:14.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.596+0000 7f2566ffd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f25680ace20 0x7f25680b0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50074/0 (socket says 172.21.2.105:50074) 2021-11-12T05:48:14.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.596+0000 7f2566ffd700 1 -- 172.21.2.105:0/3790333355 learned_addr learned my addr 172.21.2.105:0/3790333355 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:14.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.596+0000 7f2566ffd700 1 -- 172.21.2.105:0/3790333355 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2568144180 msgr2=0x7f2568144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:14.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.596+0000 7f2566ffd700 1 --2- 172.21.2.105:0/3790333355 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2568144180 0x7f2568144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:14.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.596+0000 7f2566ffd700 1 -- 172.21.2.105:0/3790333355 >> v1:172.21.2.115:6789/0 conn(0x7f25680aca40 legacy=0x7f25681473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:14.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.596+0000 7f2566ffd700 1 -- 172.21.2.105:0/3790333355 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25680b1a70 con 0x7f25680ace20 2021-11-12T05:48:14.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.596+0000 7f2566ffd700 1 --2- 172.21.2.105:0/3790333355 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f25680ace20 0x7f25680b0520 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7f2568061140 tx=0x7f2550006eb0).ready entity=mon.0 client_cookie=e93e5bafd4f5109d server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:14.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.596+0000 7f25667fc700 1 -- 172.21.2.105:0/3790333355 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f255000d570 con 0x7f25680ace20 2021-11-12T05:48:14.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.596+0000 7f25667fc700 1 -- 172.21.2.105:0/3790333355 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2550000e90 con 0x7f25680ace20 2021-11-12T05:48:14.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.596+0000 7f25667fc700 1 -- 172.21.2.105:0/3790333355 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f255000d8c0 con 0x7f25680ace20 2021-11-12T05:48:14.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.596+0000 7f256ddd1700 1 -- 172.21.2.105:0/3790333355 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f25680ace20 msgr2=0x7f25680b0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:14.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.596+0000 7f256ddd1700 1 --2- 172.21.2.105:0/3790333355 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f25680ace20 0x7f25680b0520 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7f2568061140 tx=0x7f2550006eb0).stop 2021-11-12T05:48:14.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.596+0000 7f256ddd1700 1 -- 172.21.2.105:0/3790333355 shutdown_connections 2021-11-12T05:48:14.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.596+0000 7f256ddd1700 1 --2- 172.21.2.105:0/3790333355 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2568144180 0x7f2568144610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:14.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.596+0000 7f256ddd1700 1 --2- 172.21.2.105:0/3790333355 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f25680ace20 0x7f25680b0520 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:14.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.596+0000 7f256ddd1700 1 -- 172.21.2.105:0/3790333355 >> 172.21.2.105:0/3790333355 conn(0x7f256805c490 msgr2=0x7f25680b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:14.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.596+0000 7f256ddd1700 1 -- 172.21.2.105:0/3790333355 shutdown_connections 2021-11-12T05:48:14.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.596+0000 7f256ddd1700 1 -- 172.21.2.105:0/3790333355 wait complete. 2021-11-12T05:48:14.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.600+0000 7f256ddd1700 1 Processor -- start 2021-11-12T05:48:14.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.600+0000 7f256ddd1700 1 -- start start 2021-11-12T05:48:14.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.600+0000 7f256ddd1700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f25680aca40 0x7f256814b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:14.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.600+0000 7f256ddd1700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f25680ace20 0x7f2568066950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:14.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.600+0000 7f256ddd1700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2568144180 0x7f2568159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:14.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.600+0000 7f256ddd1700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2568062650 con 0x7f25680aca40 2021-11-12T05:48:14.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.600+0000 7f256ddd1700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25680628f0 con 0x7f25680ace20 2021-11-12T05:48:14.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.600+0000 7f256ddd1700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2568062b90 con 0x7f2568144180 2021-11-12T05:48:14.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.600+0000 7f25677fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f25680aca40 0x7f256814b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:14.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.600+0000 7f25677fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f25680aca40 0x7f256814b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50080/0 (socket says 172.21.2.105:50080) 2021-11-12T05:48:14.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.600+0000 7f25677fe700 1 -- 172.21.2.105:0/908472171 learned_addr learned my addr 172.21.2.105:0/908472171 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:14.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.600+0000 7f25677fe700 1 -- 172.21.2.105:0/908472171 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2568144180 msgr2=0x7f2568159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:14.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.600+0000 7f25677fe700 1 --2- 172.21.2.105:0/908472171 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2568144180 0x7f2568159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:14.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.600+0000 7f25677fe700 1 -- 172.21.2.105:0/908472171 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f25680ace20 msgr2=0x7f2568066950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:14.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.600+0000 7f25677fe700 1 --2- 172.21.2.105:0/908472171 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f25680ace20 0x7f2568066950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:14.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.600+0000 7f25677fe700 1 -- 172.21.2.105:0/908472171 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f255000b1e0 con 0x7f25680aca40 2021-11-12T05:48:14.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.600+0000 7f25677fe700 1 --2- 172.21.2.105:0/908472171 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f25680aca40 0x7f256814b3b0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7f2558002f90 tx=0x7f2558006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:14.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.600+0000 7f2564ff9700 1 -- 172.21.2.105:0/908472171 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2558013460 con 0x7f25680aca40 2021-11-12T05:48:14.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.600+0000 7f2564ff9700 1 -- 172.21.2.105:0/908472171 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25580135c0 con 0x7f25680aca40 2021-11-12T05:48:14.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.600+0000 7f2564ff9700 1 -- 172.21.2.105:0/908472171 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2558013920 con 0x7f25680aca40 2021-11-12T05:48:14.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.600+0000 7f256ddd1700 1 -- 172.21.2.105:0/908472171 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25680672f0 con 0x7f25680aca40 2021-11-12T05:48:14.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.600+0000 7f256ddd1700 1 -- 172.21.2.105:0/908472171 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f256815a420 con 0x7f25680aca40 2021-11-12T05:48:14.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.600+0000 7f256ddd1700 1 -- 172.21.2.105:0/908472171 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2568062d50 con 0x7f25680aca40 2021-11-12T05:48:14.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.600+0000 7f2564ff9700 1 -- 172.21.2.105:0/908472171 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f255800f070 con 0x7f25680aca40 2021-11-12T05:48:14.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.600+0000 7f2564ff9700 1 --2- 172.21.2.105:0/908472171 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f254c053610 0x7f254c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:14.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.600+0000 7f2564ff9700 1 -- 172.21.2.105:0/908472171 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f255806b340 con 0x7f25680aca40 2021-11-12T05:48:14.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.600+0000 7f2566ffd700 1 --2- 172.21.2.105:0/908472171 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f254c053610 0x7f254c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:14.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.600+0000 7f2566ffd700 1 --2- 172.21.2.105:0/908472171 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f254c053610 0x7f254c055ad0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f2568061140 tx=0x7f2550015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:14.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.604+0000 7f2564ff9700 1 -- 172.21.2.105:0/908472171 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2558042350 con 0x7f25680aca40 2021-11-12T05:48:14.720 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.716+0000 7f256ddd1700 1 -- 172.21.2.105:0/908472171 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7f2568057350 con 0x7f25680aca40 2021-11-12T05:48:14.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.716+0000 7f2564ff9700 1 -- 172.21.2.105:0/908472171 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1936 (secure 0 0 0) 0x7f2558045970 con 0x7f25680aca40 2021-11-12T05:48:14.721 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:14.722 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:48:14.722 INFO:teuthology.orchestra.run.gibba005.stdout: "stats": { 2021-11-12T05:48:14.722 INFO:teuthology.orchestra.run.gibba005.stdout: "total_bytes": 773094113280, 2021-11-12T05:48:14.722 INFO:teuthology.orchestra.run.gibba005.stdout: "total_avail_bytes": 764493377536, 2021-11-12T05:48:14.723 INFO:teuthology.orchestra.run.gibba005.stdout: "total_used_bytes": 10801152, 2021-11-12T05:48:14.723 INFO:teuthology.orchestra.run.gibba005.stdout: "total_used_raw_bytes": 8600735744, 2021-11-12T05:48:14.723 INFO:teuthology.orchestra.run.gibba005.stdout: "total_used_raw_ratio": 0.011125082150101662, 2021-11-12T05:48:14.723 INFO:teuthology.orchestra.run.gibba005.stdout: "num_osds": 8, 2021-11-12T05:48:14.723 INFO:teuthology.orchestra.run.gibba005.stdout: "num_per_pool_osds": 8, 2021-11-12T05:48:14.724 INFO:teuthology.orchestra.run.gibba005.stdout: "num_per_pool_omap_osds": 8 2021-11-12T05:48:14.724 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:14.724 INFO:teuthology.orchestra.run.gibba005.stdout: "stats_by_class": { 2021-11-12T05:48:14.724 INFO:teuthology.orchestra.run.gibba005.stdout: "ssd": { 2021-11-12T05:48:14.725 INFO:teuthology.orchestra.run.gibba005.stdout: "total_bytes": 773094113280, 2021-11-12T05:48:14.725 INFO:teuthology.orchestra.run.gibba005.stdout: "total_avail_bytes": 764493377536, 2021-11-12T05:48:14.725 INFO:teuthology.orchestra.run.gibba005.stdout: "total_used_bytes": 10801152, 2021-11-12T05:48:14.725 INFO:teuthology.orchestra.run.gibba005.stdout: "total_used_raw_bytes": 8600735744, 2021-11-12T05:48:14.726 INFO:teuthology.orchestra.run.gibba005.stdout: "total_used_raw_ratio": 0.011125082150101662 2021-11-12T05:48:14.726 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:14.726 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:14.726 INFO:teuthology.orchestra.run.gibba005.stdout: "pools": [ 2021-11-12T05:48:14.726 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:14.727 INFO:teuthology.orchestra.run.gibba005.stdout: "name": "device_health_metrics", 2021-11-12T05:48:14.727 INFO:teuthology.orchestra.run.gibba005.stdout: "id": 1, 2021-11-12T05:48:14.727 INFO:teuthology.orchestra.run.gibba005.stdout: "stats": { 2021-11-12T05:48:14.727 INFO:teuthology.orchestra.run.gibba005.stdout: "stored": 0, 2021-11-12T05:48:14.728 INFO:teuthology.orchestra.run.gibba005.stdout: "objects": 2, 2021-11-12T05:48:14.728 INFO:teuthology.orchestra.run.gibba005.stdout: "kb_used": 0, 2021-11-12T05:48:14.728 INFO:teuthology.orchestra.run.gibba005.stdout: "bytes_used": 0, 2021-11-12T05:48:14.728 INFO:teuthology.orchestra.run.gibba005.stdout: "percent_used": 0, 2021-11-12T05:48:14.729 INFO:teuthology.orchestra.run.gibba005.stdout: "max_avail": 362919264256 2021-11-12T05:48:14.729 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:14.729 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:14.729 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:14.729 INFO:teuthology.orchestra.run.gibba005.stdout: "name": "rbd", 2021-11-12T05:48:14.730 INFO:teuthology.orchestra.run.gibba005.stdout: "id": 2, 2021-11-12T05:48:14.730 INFO:teuthology.orchestra.run.gibba005.stdout: "stats": { 2021-11-12T05:48:14.730 INFO:teuthology.orchestra.run.gibba005.stdout: "stored": 0, 2021-11-12T05:48:14.730 INFO:teuthology.orchestra.run.gibba005.stdout: "objects": 0, 2021-11-12T05:48:14.731 INFO:teuthology.orchestra.run.gibba005.stdout: "kb_used": 0, 2021-11-12T05:48:14.731 INFO:teuthology.orchestra.run.gibba005.stdout: "bytes_used": 0, 2021-11-12T05:48:14.731 INFO:teuthology.orchestra.run.gibba005.stdout: "percent_used": 0, 2021-11-12T05:48:14.731 INFO:teuthology.orchestra.run.gibba005.stdout: "max_avail": 362919264256 2021-11-12T05:48:14.731 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:14.732 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:14.732 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:14.732 INFO:teuthology.orchestra.run.gibba005.stdout: "name": "cephfs_metadata", 2021-11-12T05:48:14.732 INFO:teuthology.orchestra.run.gibba005.stdout: "id": 19, 2021-11-12T05:48:14.733 INFO:teuthology.orchestra.run.gibba005.stdout: "stats": { 2021-11-12T05:48:14.733 INFO:teuthology.orchestra.run.gibba005.stdout: "stored": 2304, 2021-11-12T05:48:14.733 INFO:teuthology.orchestra.run.gibba005.stdout: "objects": 21, 2021-11-12T05:48:14.733 INFO:teuthology.orchestra.run.gibba005.stdout: "kb_used": 64, 2021-11-12T05:48:14.733 INFO:teuthology.orchestra.run.gibba005.stdout: "bytes_used": 65536, 2021-11-12T05:48:14.734 INFO:teuthology.orchestra.run.gibba005.stdout: "percent_used": 9.0290043885943305e-08, 2021-11-12T05:48:14.734 INFO:teuthology.orchestra.run.gibba005.stdout: "max_avail": 362919264256 2021-11-12T05:48:14.734 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:14.734 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:14.735 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:14.735 INFO:teuthology.orchestra.run.gibba005.stdout: "name": "cephfs_data", 2021-11-12T05:48:14.735 INFO:teuthology.orchestra.run.gibba005.stdout: "id": 20, 2021-11-12T05:48:14.735 INFO:teuthology.orchestra.run.gibba005.stdout: "stats": { 2021-11-12T05:48:14.736 INFO:teuthology.orchestra.run.gibba005.stdout: "stored": 0, 2021-11-12T05:48:14.736 INFO:teuthology.orchestra.run.gibba005.stdout: "objects": 0, 2021-11-12T05:48:14.736 INFO:teuthology.orchestra.run.gibba005.stdout: "kb_used": 0, 2021-11-12T05:48:14.736 INFO:teuthology.orchestra.run.gibba005.stdout: "bytes_used": 0, 2021-11-12T05:48:14.736 INFO:teuthology.orchestra.run.gibba005.stdout: "percent_used": 0, 2021-11-12T05:48:14.737 INFO:teuthology.orchestra.run.gibba005.stdout: "max_avail": 362919264256 2021-11-12T05:48:14.737 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:14.737 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:14.737 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:14.737 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:48:14.739 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.716+0000 7f256ddd1700 1 -- 172.21.2.105:0/908472171 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f254c053610 msgr2=0x7f254c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:14.739 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.716+0000 7f256ddd1700 1 --2- 172.21.2.105:0/908472171 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f254c053610 0x7f254c055ad0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f2568061140 tx=0x7f2550015000).stop 2021-11-12T05:48:14.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.716+0000 7f256ddd1700 1 -- 172.21.2.105:0/908472171 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f25680aca40 msgr2=0x7f256814b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:14.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.716+0000 7f256ddd1700 1 --2- 172.21.2.105:0/908472171 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f25680aca40 0x7f256814b3b0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7f2558002f90 tx=0x7f2558006df0).stop 2021-11-12T05:48:14.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.716+0000 7f256ddd1700 1 -- 172.21.2.105:0/908472171 shutdown_connections 2021-11-12T05:48:14.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.716+0000 7f256ddd1700 1 --2- 172.21.2.105:0/908472171 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f254c053610 0x7f254c055ad0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:14.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.716+0000 7f256ddd1700 1 --2- 172.21.2.105:0/908472171 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2568144180 0x7f2568159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:14.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.716+0000 7f256ddd1700 1 --2- 172.21.2.105:0/908472171 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f25680ace20 0x7f2568066950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:14.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.716+0000 7f256ddd1700 1 --2- 172.21.2.105:0/908472171 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f25680aca40 0x7f256814b3b0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:14.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.716+0000 7f256ddd1700 1 -- 172.21.2.105:0/908472171 >> 172.21.2.105:0/908472171 conn(0x7f256805c490 msgr2=0x7f2568148890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:14.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.716+0000 7f256ddd1700 1 -- 172.21.2.105:0/908472171 shutdown_connections 2021-11-12T05:48:14.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.716+0000 7f256ddd1700 1 -- 172.21.2.105:0/908472171 wait complete. 2021-11-12T05:48:14.742 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data size -f json-pretty 2021-11-12T05:48:14.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfe00d7700 1 Processor -- start 2021-11-12T05:48:14.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfe00d7700 1 -- start start 2021-11-12T05:48:14.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfe00d7700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdfd80aca40 0x7fdfd80ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:14.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfe00d7700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fdfd80b0520 0x7fdfd81473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:14.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfe00d7700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd80b1840 con 0x7fdfd81478b0 2021-11-12T05:48:14.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfe00d7700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfd8147d40 con 0x7fdfd80b0520 2021-11-12T05:48:14.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfe00d7700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd80af2b0 con 0x7fdfd80aca40 2021-11-12T05:48:14.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfdd672700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fdfd80b0520 0x7fdfd81473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:14.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfdd672700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fdfd80b0520 0x7fdfd81473c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50090/0 (socket says 172.21.2.105:50090) 2021-11-12T05:48:14.798 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfdd672700 1 -- 172.21.2.105:0/1739744030 learned_addr learned my addr 172.21.2.105:0/1739744030 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:14.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfdd672700 1 -- 172.21.2.105:0/1739744030 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdfd80aca40 msgr2=0x7fdfd80ace20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:48:14.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfdd672700 1 --2- 172.21.2.105:0/1739744030 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdfd80aca40 0x7fdfd80ace20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:14.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfdd672700 1 -- 172.21.2.105:0/1739744030 >> v1:172.21.2.115:6789/0 conn(0x7fdfd81478b0 legacy=0x7fdfd8144180 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:48:14.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfdd672700 1 -- 172.21.2.105:0/1739744030 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd80b09a0 con 0x7fdfd80b0520 2021-11-12T05:48:14.802 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfdd672700 1 --2- 172.21.2.105:0/1739744030 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdfd80b0520 0x7fdfd81473c0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 rx=0x7fdfd80b00d0 tx=0x7fdfc8006eb0).ready entity=mon.0 client_cookie=6995035bc5cc7f7e server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:14.802 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfdce71700 1 -- 172.21.2.105:0/1739744030 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfc800d570 con 0x7fdfd80b0520 2021-11-12T05:48:14.802 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfdce71700 1 -- 172.21.2.105:0/1739744030 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc8000e90 con 0x7fdfd80b0520 2021-11-12T05:48:14.802 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfdce71700 1 -- 172.21.2.105:0/1739744030 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfc800d8c0 con 0x7fdfd80b0520 2021-11-12T05:48:14.803 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfe00d7700 1 -- 172.21.2.105:0/1739744030 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdfd80b0520 msgr2=0x7fdfd81473c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:14.803 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfe00d7700 1 --2- 172.21.2.105:0/1739744030 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdfd80b0520 0x7fdfd81473c0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 rx=0x7fdfd80b00d0 tx=0x7fdfc8006eb0).stop 2021-11-12T05:48:14.803 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfe00d7700 1 -- 172.21.2.105:0/1739744030 shutdown_connections 2021-11-12T05:48:14.803 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfe00d7700 1 --2- 172.21.2.105:0/1739744030 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdfd80b0520 0x7fdfd81473c0 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:14.804 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfe00d7700 1 --2- 172.21.2.105:0/1739744030 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdfd80aca40 0x7fdfd80ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:14.804 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfe00d7700 1 -- 172.21.2.105:0/1739744030 >> 172.21.2.105:0/1739744030 conn(0x7fdfd805c490 msgr2=0x7fdfd80b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:14.804 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfe00d7700 1 -- 172.21.2.105:0/1739744030 shutdown_connections 2021-11-12T05:48:14.804 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfe00d7700 1 -- 172.21.2.105:0/1739744030 wait complete. 2021-11-12T05:48:14.804 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfe00d7700 1 Processor -- start 2021-11-12T05:48:14.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfe00d7700 1 -- start start 2021-11-12T05:48:14.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfe00d7700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdfd80aca40 0x7fdfd80a7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:14.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfe00d7700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdfd80b0520 0x7fdfd80a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:14.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfe00d7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdfd81478b0 0x7fdfd8159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:14.806 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfe00d7700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd8064960 con 0x7fdfd81478b0 2021-11-12T05:48:14.806 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfe00d7700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd8157520 con 0x7fdfd80aca40 2021-11-12T05:48:14.806 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfe00d7700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd81577c0 con 0x7fdfd80b0520 2021-11-12T05:48:14.806 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfde674700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdfd81478b0 0x7fdfd8159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:14.806 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfde674700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdfd81478b0 0x7fdfd8159fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50096/0 (socket says 172.21.2.105:50096) 2021-11-12T05:48:14.807 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfde674700 1 -- 172.21.2.105:0/729589701 learned_addr learned my addr 172.21.2.105:0/729589701 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:14.807 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfde674700 1 -- 172.21.2.105:0/729589701 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdfd80b0520 msgr2=0x7fdfd80a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:14.807 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfde674700 1 --2- 172.21.2.105:0/729589701 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdfd80b0520 0x7fdfd80a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:14.807 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfde674700 1 -- 172.21.2.105:0/729589701 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdfd80aca40 msgr2=0x7fdfd80a7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:14.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfde674700 1 --2- 172.21.2.105:0/729589701 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdfd80aca40 0x7fdfd80a7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:14.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfde674700 1 -- 172.21.2.105:0/729589701 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc800b1e0 con 0x7fdfd81478b0 2021-11-12T05:48:14.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfde674700 1 --2- 172.21.2.105:0/729589701 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdfd81478b0 0x7fdfd8159fd0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 rx=0x7fdfd0001250 tx=0x7fdfd00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:14.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.792+0000 7fdfc6ffd700 1 -- 172.21.2.105:0/729589701 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfd00014e0 con 0x7fdfd81478b0 2021-11-12T05:48:14.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.796+0000 7fdfc6ffd700 1 -- 172.21.2.105:0/729589701 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd0001640 con 0x7fdfd81478b0 2021-11-12T05:48:14.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.796+0000 7fdfe00d7700 1 -- 172.21.2.105:0/729589701 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfd8064f50 con 0x7fdfd81478b0 2021-11-12T05:48:14.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.796+0000 7fdfc6ffd700 1 -- 172.21.2.105:0/729589701 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfd00019a0 con 0x7fdfd81478b0 2021-11-12T05:48:14.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.796+0000 7fdfe00d7700 1 -- 172.21.2.105:0/729589701 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfd80ac3e0 con 0x7fdfd81478b0 2021-11-12T05:48:14.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.796+0000 7fdfe00d7700 1 -- 172.21.2.105:0/729589701 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfd8157980 con 0x7fdfd81478b0 2021-11-12T05:48:14.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.796+0000 7fdfc6ffd700 1 -- 172.21.2.105:0/729589701 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdfd0018030 con 0x7fdfd81478b0 2021-11-12T05:48:14.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.796+0000 7fdfc6ffd700 1 --2- 172.21.2.105:0/729589701 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdfb80536a0 0x7fdfb8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:14.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.796+0000 7fdfc6ffd700 1 -- 172.21.2.105:0/729589701 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fdfd006b370 con 0x7fdfd81478b0 2021-11-12T05:48:14.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.796+0000 7fdfdde73700 1 --2- 172.21.2.105:0/729589701 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdfb80536a0 0x7fdfb8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:14.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.796+0000 7fdfdde73700 1 --2- 172.21.2.105:0/729589701 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdfb80536a0 0x7fdfb8055b60 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7fdfd4002fb0 tx=0x7fdfd40069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:14.811 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.796+0000 7fdfc6ffd700 1 -- 172.21.2.105:0/729589701 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdfd0042390 con 0x7fdfd81478b0 2021-11-12T05:48:14.885 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.880+0000 7fdfe00d7700 1 -- 172.21.2.105:0/729589701 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "size", "format": "json-pretty"} v 0) v1 -- 0x7fdfd814abc0 con 0x7fdfd81478b0 2021-11-12T05:48:14.885 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.880+0000 7fdfc6ffd700 1 -- 172.21.2.105:0/729589701 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "size", "format": "json-pretty"}]=0 v107) v1 ==== 123+0+64 (secure 0 0 0) 0x7fdfd00459b0 con 0x7fdfd81478b0 2021-11-12T05:48:14.886 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:14.886 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:48:14.886 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": "cephfs_data", 2021-11-12T05:48:14.887 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_id": 20, 2021-11-12T05:48:14.887 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2 2021-11-12T05:48:14.887 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:48:14.888 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.880+0000 7fdfe00d7700 1 -- 172.21.2.105:0/729589701 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdfb80536a0 msgr2=0x7fdfb8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:14.888 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.880+0000 7fdfe00d7700 1 --2- 172.21.2.105:0/729589701 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdfb80536a0 0x7fdfb8055b60 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7fdfd4002fb0 tx=0x7fdfd40069b0).stop 2021-11-12T05:48:14.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.880+0000 7fdfe00d7700 1 -- 172.21.2.105:0/729589701 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdfd81478b0 msgr2=0x7fdfd8159fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:14.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.880+0000 7fdfe00d7700 1 --2- 172.21.2.105:0/729589701 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdfd81478b0 0x7fdfd8159fd0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 rx=0x7fdfd0001250 tx=0x7fdfd00090f0).stop 2021-11-12T05:48:14.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.880+0000 7fdfe00d7700 1 -- 172.21.2.105:0/729589701 shutdown_connections 2021-11-12T05:48:14.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.880+0000 7fdfe00d7700 1 --2- 172.21.2.105:0/729589701 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdfb80536a0 0x7fdfb8055b60 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:14.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.880+0000 7fdfe00d7700 1 --2- 172.21.2.105:0/729589701 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdfd81478b0 0x7fdfd8159fd0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:14.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.880+0000 7fdfe00d7700 1 --2- 172.21.2.105:0/729589701 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdfd80b0520 0x7fdfd80a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:14.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.880+0000 7fdfe00d7700 1 --2- 172.21.2.105:0/729589701 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdfd80aca40 0x7fdfd80a7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:14.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.880+0000 7fdfe00d7700 1 -- 172.21.2.105:0/729589701 >> 172.21.2.105:0/729589701 conn(0x7fdfd805c490 msgr2=0x7fdfd80b3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:14.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.880+0000 7fdfe00d7700 1 -- 172.21.2.105:0/729589701 shutdown_connections 2021-11-12T05:48:14.891 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:14.880+0000 7fdfe00d7700 1 -- 172.21.2.105:0/729589701 wait complete. 2021-11-12T05:48:14.893 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-11-12T05:48:14.893 DEBUG:teuthology.orchestra.run.gibba016:> cd /home/ubuntu/cephtest/mnt.0 && sudo df . 2021-11-12T05:48:14.935 INFO:teuthology.orchestra.run.gibba016.stdout:Filesystem 1K-blocks Used Available Use% Mounted on 2021-11-12T05:48:14.935 INFO:teuthology.orchestra.run.gibba016.stdout:ceph-fuse 354410496 0 354410496 0% /home/ubuntu/cephtest/mnt.0 2021-11-12T05:48:14.936 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-12T05:48:14.937 DEBUG:teuthology.orchestra.run.gibba005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:48:14.945 DEBUG:teuthology.orchestra.run.gibba015:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:48:14.958 DEBUG:teuthology.orchestra.run.gibba016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:48:14.998 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:48:15.011 DEBUG:teuthology.orchestra.run.gibba044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:48:15.025 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-12T05:48:15.026 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:15.026 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:48:15.026 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:48:15.037 INFO:teuthology.orchestra.run.gibba016.stdout:fuseblk 2021-11-12T05:48:15.039 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-12T05:48:15.039 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba016.front.sepia.ceph.com... 2021-11-12T05:48:15.040 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-12T05:48:15.040 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:48:15.054 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[14961]: fuse finished with error 0 and tester_r 0 2021-11-12T05:48:15.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:15.056 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:48:15.057 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:48:15.108 INFO:teuthology.orchestra.run.gibba016.stdout:ext2/ext3 2021-11-12T05:48:15.109 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-12T05:48:15.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:48:15.131 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:48:15.141 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:15.141 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:48:15.142 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:48:15.153 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-12T05:48:15.154 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-12T05:48:15.155 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba038.front.sepia.ceph.com... 2021-11-12T05:48:15.155 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-12T05:48:15.156 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:48:15.208 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:ceph-fuse[14417]: fuse finished with error 0 and tester_r 0 2021-11-12T05:48:15.209 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:15.210 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:48:15.211 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:48:15.219 INFO:teuthology.orchestra.run.gibba038.stdout:ext2/ext3 2021-11-12T05:48:15.220 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-12T05:48:15.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:48:15.298 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:48:15.302 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:15.302 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:48:15.303 DEBUG:teuthology.orchestra.run.gibba044:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:48:15.312 INFO:teuthology.orchestra.run.gibba044.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-12T05:48:15.313 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:48:15.314 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-12T05:48:15.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:48:15.315 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:48:15.364 INFO:teuthology.orchestra.run.gibba044.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-12T05:48:15.365 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:48:15.366 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-12T05:48:15.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.432+0000 7f589de3a700 1 Processor -- start 2021-11-12T05:48:15.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.432+0000 7f589de3a700 1 -- start start 2021-11-12T05:48:15.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.432+0000 7f589de3a700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f5898066ba0 0x7f58980ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:15.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.432+0000 7f589de3a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f58980afcc0 0x7f5898146580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:15.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.432+0000 7f589de3a700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58980adcb0 con 0x7f58980ad270 2021-11-12T05:48:15.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.432+0000 7f589de3a700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5898066f80 con 0x7f5898066ba0 2021-11-12T05:48:15.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.432+0000 7f589de3a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58980b0880 con 0x7f58980afcc0 2021-11-12T05:48:15.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.436+0000 7f5896ffd700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f58980afcc0 0x7f5898146580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:15.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.436+0000 7f58977fe700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f5898066ba0 0x7f58980ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:15.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.436+0000 7f5897fff700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7f58980ad270 0x7f5898141f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:58966/0 (socket says 172.21.2.105:58966) 2021-11-12T05:48:15.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.436+0000 7f5897fff700 1 -- 172.21.2.105:0/2208864730 learned_addr learned my addr 172.21.2.105:0/2208864730 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:15.445 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.436+0000 7f5896ffd700 1 -- 172.21.2.105:0/2208864730 >> v2:172.21.2.115:3300/0 conn(0x7f5898066ba0 msgr2=0x7f58980ad7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:15.445 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.436+0000 7f5896ffd700 1 --2- 172.21.2.105:0/2208864730 >> v2:172.21.2.115:3300/0 conn(0x7f5898066ba0 0x7f58980ad7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:15.445 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.436+0000 7f5896ffd700 1 -- 172.21.2.105:0/2208864730 >> v1:172.21.2.115:6789/0 conn(0x7f58980ad270 legacy=0x7f5898141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:15.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.436+0000 7f5896ffd700 1 -- 172.21.2.105:0/2208864730 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58980b1240 con 0x7f58980afcc0 2021-11-12T05:48:15.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.436+0000 7f5896ffd700 1 --2- 172.21.2.105:0/2208864730 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f58980afcc0 0x7f5898146580 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f588c002f70 tx=0x7f588c006df0).ready entity=mon.2 client_cookie=c2541389b2505a11 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:15.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.436+0000 7f58967fc700 1 -- 172.21.2.105:0/2208864730 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f588c00d570 con 0x7f58980afcc0 2021-11-12T05:48:15.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.436+0000 7f58967fc700 1 -- 172.21.2.105:0/2208864730 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588c000e90 con 0x7f58980afcc0 2021-11-12T05:48:15.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.436+0000 7f58967fc700 1 -- 172.21.2.105:0/2208864730 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f588c00d8c0 con 0x7f58980afcc0 2021-11-12T05:48:15.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.436+0000 7f589de3a700 1 -- 172.21.2.105:0/2208864730 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f58980afcc0 msgr2=0x7f5898146580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:15.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.436+0000 7f589de3a700 1 --2- 172.21.2.105:0/2208864730 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f58980afcc0 0x7f5898146580 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f588c002f70 tx=0x7f588c006df0).stop 2021-11-12T05:48:15.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.436+0000 7f589de3a700 1 -- 172.21.2.105:0/2208864730 shutdown_connections 2021-11-12T05:48:15.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.436+0000 7f589de3a700 1 --2- 172.21.2.105:0/2208864730 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f58980afcc0 0x7f5898146580 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:15.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.436+0000 7f589de3a700 1 --2- 172.21.2.105:0/2208864730 >> v2:172.21.2.115:3300/0 conn(0x7f5898066ba0 0x7f58980ad7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:15.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.436+0000 7f589de3a700 1 -- 172.21.2.105:0/2208864730 >> 172.21.2.105:0/2208864730 conn(0x7f58980b5320 msgr2=0x7f58980b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:15.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.436+0000 7f589de3a700 1 -- 172.21.2.105:0/2208864730 shutdown_connections 2021-11-12T05:48:15.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.436+0000 7f589de3a700 1 -- 172.21.2.105:0/2208864730 wait complete. 2021-11-12T05:48:15.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.440+0000 7f589de3a700 1 Processor -- start 2021-11-12T05:48:15.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.440+0000 7f589de3a700 1 -- start start 2021-11-12T05:48:15.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.440+0000 7f589de3a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5898066ba0 0x7f58981430e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:15.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.440+0000 7f589de3a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f58980ad270 0x7f58981123b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:15.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.440+0000 7f589de3a700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f58980afcc0 0x7f58981128a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:15.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.440+0000 7f589de3a700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589810ee50 con 0x7f5898066ba0 2021-11-12T05:48:15.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.440+0000 7f589de3a700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589810f0f0 con 0x7f58980afcc0 2021-11-12T05:48:15.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.440+0000 7f589de3a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f589810f390 con 0x7f58980ad270 2021-11-12T05:48:15.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.440+0000 7f58977fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5898066ba0 0x7f58981430e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:15.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.440+0000 7f58977fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5898066ba0 0x7f58981430e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50106/0 (socket says 172.21.2.105:50106) 2021-11-12T05:48:15.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.440+0000 7f58977fe700 1 -- 172.21.2.105:0/3094184324 learned_addr learned my addr 172.21.2.105:0/3094184324 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:15.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.440+0000 7f5896ffd700 1 --2- 172.21.2.105:0/3094184324 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f58980ad270 0x7f58981123b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:15.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.440+0000 7f5897fff700 1 --2- 172.21.2.105:0/3094184324 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f58980afcc0 0x7f58981128a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:15.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.440+0000 7f58977fe700 1 -- 172.21.2.105:0/3094184324 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f58980ad270 msgr2=0x7f58981123b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:15.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.440+0000 7f58977fe700 1 --2- 172.21.2.105:0/3094184324 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f58980ad270 0x7f58981123b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:15.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.440+0000 7f58977fe700 1 -- 172.21.2.105:0/3094184324 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f58980afcc0 msgr2=0x7f58981128a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:15.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.440+0000 7f58977fe700 1 --2- 172.21.2.105:0/3094184324 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f58980afcc0 0x7f58981128a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:15.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.440+0000 7f58977fe700 1 -- 172.21.2.105:0/3094184324 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f588c00b180 con 0x7f5898066ba0 2021-11-12T05:48:15.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.440+0000 7f58977fe700 1 --2- 172.21.2.105:0/3094184324 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5898066ba0 0x7f58981430e0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7f588800c000 tx=0x7f5888006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:15.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.440+0000 7f5894ff9700 1 -- 172.21.2.105:0/3094184324 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5888010780 con 0x7f5898066ba0 2021-11-12T05:48:15.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.440+0000 7f5894ff9700 1 -- 172.21.2.105:0/3094184324 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58880108e0 con 0x7f5898066ba0 2021-11-12T05:48:15.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.440+0000 7f5894ff9700 1 -- 172.21.2.105:0/3094184324 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5888010c40 con 0x7f5898066ba0 2021-11-12T05:48:15.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.440+0000 7f589de3a700 1 -- 172.21.2.105:0/3094184324 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f589810ead0 con 0x7f5898066ba0 2021-11-12T05:48:15.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.440+0000 7f589de3a700 1 -- 172.21.2.105:0/3094184324 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5898110ad0 con 0x7f5898066ba0 2021-11-12T05:48:15.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.440+0000 7f589de3a700 1 -- 172.21.2.105:0/3094184324 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f589810ecc0 con 0x7f5898066ba0 2021-11-12T05:48:15.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.440+0000 7f5894ff9700 1 -- 172.21.2.105:0/3094184324 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f588801c460 con 0x7f5898066ba0 2021-11-12T05:48:15.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.440+0000 7f5894ff9700 1 --2- 172.21.2.105:0/3094184324 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5878053610 0x7f5878055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:15.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.440+0000 7f5894ff9700 1 -- 172.21.2.105:0/3094184324 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f588806c0e0 con 0x7f5898066ba0 2021-11-12T05:48:15.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.440+0000 7f5896ffd700 1 --2- 172.21.2.105:0/3094184324 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5878053610 0x7f5878055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:15.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.440+0000 7f5896ffd700 1 --2- 172.21.2.105:0/3094184324 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5878053610 0x7f5878055ad0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f588c018000 tx=0x7f588c014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:15.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.444+0000 7f5894ff9700 1 -- 172.21.2.105:0/3094184324 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5888042f80 con 0x7f5898066ba0 2021-11-12T05:48:15.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.528+0000 7f589de3a700 1 -- 172.21.2.105:0/3094184324 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f58980af3b0 con 0x7f5898066ba0 2021-11-12T05:48:15.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.528+0000 7f5894ff9700 1 -- 172.21.2.105:0/3094184324 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v107) v1 ==== 81+0+34051 (secure 0 0 0) 0x7f58880465a0 con 0x7f5898066ba0 2021-11-12T05:48:15.533 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:15.533 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:48:15.534 INFO:teuthology.orchestra.run.gibba005.stdout: "epoch": 107, 2021-11-12T05:48:15.534 INFO:teuthology.orchestra.run.gibba005.stdout: "fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", 2021-11-12T05:48:15.534 INFO:teuthology.orchestra.run.gibba005.stdout: "created": "2021-11-12T05:40:19.986390+0000", 2021-11-12T05:48:15.534 INFO:teuthology.orchestra.run.gibba005.stdout: "modified": "2021-11-12T05:48:09.982370+0000", 2021-11-12T05:48:15.535 INFO:teuthology.orchestra.run.gibba005.stdout: "last_up_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:48:15.535 INFO:teuthology.orchestra.run.gibba005.stdout: "last_in_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:48:15.535 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-12T05:48:15.535 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_num": 5799936, 2021-11-12T05:48:15.536 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_set": [ 2021-11-12T05:48:15.536 INFO:teuthology.orchestra.run.gibba005.stdout: "pglog_hardlimit", 2021-11-12T05:48:15.536 INFO:teuthology.orchestra.run.gibba005.stdout: "purged_snapdirs", 2021-11-12T05:48:15.536 INFO:teuthology.orchestra.run.gibba005.stdout: "recovery_deletes", 2021-11-12T05:48:15.537 INFO:teuthology.orchestra.run.gibba005.stdout: "sortbitwise" 2021-11-12T05:48:15.537 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:48:15.537 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_version": 5, 2021-11-12T05:48:15.537 INFO:teuthology.orchestra.run.gibba005.stdout: "full_ratio": 0.94999998807907104, 2021-11-12T05:48:15.538 INFO:teuthology.orchestra.run.gibba005.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-12T05:48:15.538 INFO:teuthology.orchestra.run.gibba005.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-12T05:48:15.538 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_snapshot": "", 2021-11-12T05:48:15.538 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_max": 20, 2021-11-12T05:48:15.538 INFO:teuthology.orchestra.run.gibba005.stdout: "max_osd": 8, 2021-11-12T05:48:15.539 INFO:teuthology.orchestra.run.gibba005.stdout: "require_min_compat_client": "jewel", 2021-11-12T05:48:15.539 INFO:teuthology.orchestra.run.gibba005.stdout: "min_compat_client": "jewel", 2021-11-12T05:48:15.539 INFO:teuthology.orchestra.run.gibba005.stdout: "require_osd_release": "octopus", 2021-11-12T05:48:15.539 INFO:teuthology.orchestra.run.gibba005.stdout: "pools": [ 2021-11-12T05:48:15.540 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.540 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 1, 2021-11-12T05:48:15.540 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "device_health_metrics", 2021-11-12T05:48:15.540 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:22.022116+0000", 2021-11-12T05:48:15.540 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:48:15.541 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:48:15.541 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:48:15.541 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:48:15.541 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:48:15.542 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:48:15.542 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:48:15.542 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:48:15.542 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 1, 2021-11-12T05:48:15.543 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 1, 2021-11-12T05:48:15.543 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 1, 2021-11-12T05:48:15.543 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 1, 2021-11-12T05:48:15.543 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 1, 2021-11-12T05:48:15.543 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:48:15.544 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:48:15.544 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:48:15.544 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:48:15.544 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:48:15.545 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:48:15.545 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:48:15.545 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.545 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "16", 2021-11-12T05:48:15.545 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:48:15.546 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:48:15.546 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:48:15.546 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:48:15.546 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:48:15.547 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:48:15.547 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:48:15.547 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:48:15.547 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:48:15.547 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:48:15.548 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:48:15.548 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:48:15.548 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:48:15.548 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:48:15.549 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:48:15.549 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:48:15.549 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:48:15.549 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:48:15.549 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:48:15.550 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:48:15.550 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:48:15.550 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:48:15.550 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:48:15.550 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:48:15.551 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:48:15.551 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:48:15.551 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.551 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:48:15.552 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:48:15.552 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:48:15.552 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:48:15.552 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:48:15.553 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:48:15.553 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:48:15.553 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:48:15.554 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:48:15.554 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:48:15.554 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:48:15.555 INFO:teuthology.orchestra.run.gibba005.stdout: "options": { 2021-11-12T05:48:15.555 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_min": 1 2021-11-12T05:48:15.555 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.556 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:48:15.556 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr_devicehealth": {} 2021-11-12T05:48:15.556 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.557 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.557 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.558 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 2, 2021-11-12T05:48:15.558 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "rbd", 2021-11-12T05:48:15.558 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:29.953617+0000", 2021-11-12T05:48:15.558 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:48:15.558 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:48:15.559 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:48:15.559 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:48:15.559 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:48:15.559 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:48:15.560 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:48:15.560 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:48:15.560 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:48:15.560 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:48:15.560 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:48:15.561 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:48:15.561 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:48:15.561 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:48:15.561 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:48:15.562 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:48:15.562 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:48:15.562 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:48:15.562 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:48:15.563 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:48:15.563 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.563 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "19", 2021-11-12T05:48:15.563 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:48:15.563 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:48:15.564 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:48:15.564 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:48:15.564 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:48:15.564 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:48:15.564 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:48:15.565 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:48:15.565 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:48:15.565 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:48:15.565 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:48:15.566 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:48:15.566 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:48:15.566 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:48:15.566 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:48:15.566 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:48:15.567 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:48:15.567 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:48:15.567 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:48:15.567 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:48:15.568 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:48:15.568 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:48:15.568 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:48:15.568 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:48:15.569 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:48:15.569 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:48:15.569 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.569 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:48:15.569 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:48:15.570 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:48:15.570 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:48:15.570 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:48:15.570 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:48:15.571 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:48:15.571 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:48:15.571 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:48:15.571 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:48:15.571 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:48:15.572 INFO:teuthology.orchestra.run.gibba005.stdout: "options": {}, 2021-11-12T05:48:15.572 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:48:15.572 INFO:teuthology.orchestra.run.gibba005.stdout: "rbd": {} 2021-11-12T05:48:15.572 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.572 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.573 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.573 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 19, 2021-11-12T05:48:15.573 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "cephfs_metadata", 2021-11-12T05:48:15.573 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:48:06.914733+0000", 2021-11-12T05:48:15.574 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:48:15.574 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:48:15.574 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:48:15.574 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:48:15.575 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:48:15.575 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:48:15.575 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:48:15.575 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:48:15.575 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:48:15.576 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:48:15.576 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:48:15.576 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:48:15.576 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:48:15.576 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:48:15.577 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:48:15.577 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:48:15.577 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:48:15.577 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:48:15.578 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:48:15.578 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:48:15.578 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.578 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "106", 2021-11-12T05:48:15.578 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:48:15.579 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:48:15.579 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:48:15.579 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:48:15.579 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:48:15.580 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:48:15.580 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:48:15.580 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:48:15.580 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:48:15.580 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:48:15.581 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:48:15.581 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:48:15.581 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:48:15.581 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:48:15.582 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:48:15.582 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:48:15.582 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:48:15.582 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:48:15.582 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:48:15.583 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:48:15.583 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:48:15.583 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:48:15.583 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:48:15.584 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:48:15.584 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:48:15.584 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:48:15.584 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.584 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:48:15.585 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:48:15.585 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:48:15.585 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:48:15.585 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:48:15.586 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:48:15.586 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:48:15.586 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:48:15.586 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:48:15.586 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:48:15.587 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:48:15.587 INFO:teuthology.orchestra.run.gibba005.stdout: "options": { 2021-11-12T05:48:15.587 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_bias": 4, 2021-11-12T05:48:15.587 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_min": 16, 2021-11-12T05:48:15.588 INFO:teuthology.orchestra.run.gibba005.stdout: "recovery_priority": 5 2021-11-12T05:48:15.588 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.588 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:48:15.588 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs": { 2021-11-12T05:48:15.588 INFO:teuthology.orchestra.run.gibba005.stdout: "metadata": "cephfs" 2021-11-12T05:48:15.589 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.589 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.589 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.589 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.590 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 20, 2021-11-12T05:48:15.590 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "cephfs_data", 2021-11-12T05:48:15.590 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:48:07.950921+0000", 2021-11-12T05:48:15.590 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:48:15.590 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:48:15.591 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:48:15.591 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:48:15.591 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:48:15.591 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:48:15.592 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:48:15.592 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:48:15.592 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:48:15.592 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:48:15.592 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:48:15.593 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:48:15.593 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:48:15.593 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:48:15.593 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:48:15.594 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:48:15.594 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:48:15.594 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:48:15.594 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:48:15.594 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:48:15.595 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.595 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "107", 2021-11-12T05:48:15.595 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:48:15.595 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:48:15.596 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:48:15.596 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:48:15.596 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:48:15.596 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:48:15.596 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:48:15.597 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:48:15.597 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:48:15.597 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:48:15.597 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:48:15.598 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:48:15.598 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:48:15.598 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:48:15.598 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:48:15.598 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:48:15.599 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:48:15.599 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:48:15.599 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:48:15.599 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:48:15.600 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:48:15.600 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:48:15.600 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:48:15.600 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:48:15.601 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:48:15.601 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:48:15.601 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.601 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:48:15.601 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:48:15.602 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:48:15.602 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:48:15.602 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:48:15.602 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:48:15.603 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:48:15.603 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:48:15.603 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:48:15.603 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:48:15.604 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:48:15.604 INFO:teuthology.orchestra.run.gibba005.stdout: "options": {}, 2021-11-12T05:48:15.604 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:48:15.604 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs": { 2021-11-12T05:48:15.604 INFO:teuthology.orchestra.run.gibba005.stdout: "data": "cephfs" 2021-11-12T05:48:15.605 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.605 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.605 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.606 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:48:15.606 INFO:teuthology.orchestra.run.gibba005.stdout: "osds": [ 2021-11-12T05:48:15.606 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.606 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:48:15.606 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "ee8e30a0-4819-4475-80ec-dd3ee7d01322", 2021-11-12T05:48:15.607 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:48:15.607 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:48:15.607 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:48:15.607 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:48:15.608 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:48:15.608 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:48:15.608 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:48:15.608 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 105, 2021-11-12T05:48:15.609 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:48:15.609 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:48:15.609 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:48:15.609 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:15.609 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.610 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:15.610 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6802", 2021-11-12T05:48:15.610 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:48:15.610 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.611 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.611 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:15.611 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6803", 2021-11-12T05:48:15.611 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:48:15.611 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.612 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.612 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.612 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:48:15.612 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:15.613 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.613 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:15.613 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6804", 2021-11-12T05:48:15.613 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:48:15.613 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.614 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.614 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:15.614 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6805", 2021-11-12T05:48:15.615 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:48:15.615 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.615 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.615 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.616 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:48:15.616 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:15.616 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.616 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:15.617 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6808", 2021-11-12T05:48:15.617 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:48:15.617 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.617 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.617 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:15.618 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6809", 2021-11-12T05:48:15.618 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:48:15.618 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.618 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.619 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.619 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:48:15.619 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:15.619 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.620 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:15.620 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6806", 2021-11-12T05:48:15.620 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:48:15.620 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.620 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.621 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:15.621 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6807", 2021-11-12T05:48:15.621 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:48:15.621 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.622 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.622 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.622 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6803/14874", 2021-11-12T05:48:15.622 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6805/14874", 2021-11-12T05:48:15.622 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6809/14874", 2021-11-12T05:48:15.623 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6807/14874", 2021-11-12T05:48:15.623 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:48:15.623 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:48:15.623 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:48:15.623 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.624 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.624 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.624 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:48:15.624 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "b1bb06c3-26d0-4d92-82f8-b3e882242785", 2021-11-12T05:48:15.625 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:48:15.625 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:48:15.625 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:48:15.625 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:48:15.625 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:48:15.626 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:48:15.626 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:48:15.626 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 105, 2021-11-12T05:48:15.626 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:48:15.627 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:48:15.627 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:48:15.627 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:15.627 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.627 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:15.628 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6810", 2021-11-12T05:48:15.628 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:48:15.628 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.628 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.629 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:15.629 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6811", 2021-11-12T05:48:15.629 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:48:15.629 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.629 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.630 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.630 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:48:15.630 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:15.631 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.631 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:15.631 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6812", 2021-11-12T05:48:15.631 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:48:15.632 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.632 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.632 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:15.632 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6813", 2021-11-12T05:48:15.632 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:48:15.633 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.633 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.633 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.633 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:48:15.634 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:15.634 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.634 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:15.634 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6816", 2021-11-12T05:48:15.634 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:48:15.635 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.635 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.635 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:15.635 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6817", 2021-11-12T05:48:15.636 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:48:15.636 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.636 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.636 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.636 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:48:15.637 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:15.637 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.637 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:15.637 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6814", 2021-11-12T05:48:15.638 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:48:15.638 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.638 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.638 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:15.639 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6815", 2021-11-12T05:48:15.639 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:48:15.639 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.639 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.639 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.640 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6811/14875", 2021-11-12T05:48:15.640 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6813/14875", 2021-11-12T05:48:15.640 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6817/14875", 2021-11-12T05:48:15.640 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6815/14875", 2021-11-12T05:48:15.641 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:48:15.641 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:48:15.641 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:48:15.641 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.642 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.642 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.642 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:48:15.642 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "837b2c60-c335-4382-9f47-d86543a14022", 2021-11-12T05:48:15.643 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:48:15.643 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:48:15.643 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:48:15.643 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:48:15.643 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:48:15.644 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:48:15.644 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:48:15.644 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 104, 2021-11-12T05:48:15.644 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:48:15.645 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:48:15.645 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:48:15.645 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:15.645 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.645 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:15.646 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6818", 2021-11-12T05:48:15.646 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:48:15.646 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.646 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.647 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:15.647 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6819", 2021-11-12T05:48:15.647 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:48:15.648 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.648 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.648 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.648 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:48:15.649 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:15.649 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.649 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:15.649 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6820", 2021-11-12T05:48:15.650 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:48:15.650 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.650 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.650 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:15.651 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6821", 2021-11-12T05:48:15.651 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:48:15.651 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.651 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.651 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.652 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:48:15.652 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:15.652 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.652 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:15.653 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6824", 2021-11-12T05:48:15.653 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:48:15.653 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.653 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.653 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:15.654 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6825", 2021-11-12T05:48:15.654 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:48:15.654 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.654 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.654 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.655 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:48:15.655 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:15.655 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.655 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:15.656 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6822", 2021-11-12T05:48:15.656 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:48:15.656 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.656 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.656 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:15.657 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6823", 2021-11-12T05:48:15.657 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:48:15.657 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.657 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.657 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.658 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6819/14905", 2021-11-12T05:48:15.658 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6821/14905", 2021-11-12T05:48:15.658 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6825/14905", 2021-11-12T05:48:15.658 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6823/14905", 2021-11-12T05:48:15.659 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:48:15.659 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:48:15.659 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:48:15.659 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.659 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.660 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.660 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:48:15.660 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "eb2b737b-dda6-444b-a306-f33cbbd51f70", 2021-11-12T05:48:15.660 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:48:15.661 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:48:15.661 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:48:15.661 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:48:15.661 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:48:15.661 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:48:15.662 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:48:15.662 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 105, 2021-11-12T05:48:15.662 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:48:15.662 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:48:15.662 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:48:15.663 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:15.663 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.663 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:15.663 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6826", 2021-11-12T05:48:15.664 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:48:15.664 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.664 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.664 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:15.664 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6827", 2021-11-12T05:48:15.665 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:48:15.665 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.665 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.665 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.666 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:48:15.666 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:15.666 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.666 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:15.666 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6828", 2021-11-12T05:48:15.667 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:48:15.667 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.667 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.667 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:15.668 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6829", 2021-11-12T05:48:15.668 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:48:15.668 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.668 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.668 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.669 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:48:15.669 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:15.669 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.669 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:15.670 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6832", 2021-11-12T05:48:15.670 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:48:15.670 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.670 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.670 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:15.671 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6833", 2021-11-12T05:48:15.671 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:48:15.671 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.671 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.671 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.672 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:48:15.672 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:15.672 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.672 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:15.673 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6830", 2021-11-12T05:48:15.673 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:48:15.673 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.673 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.674 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:15.674 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6831", 2021-11-12T05:48:15.674 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:48:15.674 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.675 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.675 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.675 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6827/14876", 2021-11-12T05:48:15.675 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6829/14876", 2021-11-12T05:48:15.675 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6833/14876", 2021-11-12T05:48:15.676 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6831/14876", 2021-11-12T05:48:15.676 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:48:15.676 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:48:15.676 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:48:15.676 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.677 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.677 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.677 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:48:15.677 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "721529a1-c047-486a-a7ca-ddc15d80cdde", 2021-11-12T05:48:15.678 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:48:15.678 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:48:15.678 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:48:15.678 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:48:15.679 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:48:15.679 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:48:15.679 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:48:15.679 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 104, 2021-11-12T05:48:15.679 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:48:15.680 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:48:15.680 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:48:15.680 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:15.680 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.681 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:15.681 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6800", 2021-11-12T05:48:15.681 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:48:15.681 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.682 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.682 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:15.682 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6801", 2021-11-12T05:48:15.683 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:48:15.683 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.683 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.683 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.684 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:48:15.684 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:15.684 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.684 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:15.685 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6802", 2021-11-12T05:48:15.685 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:48:15.685 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.685 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.686 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:15.686 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6803", 2021-11-12T05:48:15.686 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:48:15.686 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.686 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.687 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.687 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:48:15.687 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:15.687 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.688 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:15.688 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6806", 2021-11-12T05:48:15.688 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:48:15.688 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.688 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.689 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:15.689 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6807", 2021-11-12T05:48:15.689 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:48:15.689 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.690 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.690 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.690 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:48:15.690 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:15.690 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.691 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:15.691 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6804", 2021-11-12T05:48:15.691 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:48:15.691 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.692 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.692 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:15.692 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6805", 2021-11-12T05:48:15.692 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:48:15.692 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.693 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.693 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.693 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6801/15096", 2021-11-12T05:48:15.693 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6803/15096", 2021-11-12T05:48:15.694 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6807/15096", 2021-11-12T05:48:15.694 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6805/15096", 2021-11-12T05:48:15.694 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:48:15.694 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:48:15.694 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:48:15.695 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.695 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.695 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.695 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:48:15.696 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "68b72ab2-fa82-4b5c-bf33-528f002e4950", 2021-11-12T05:48:15.696 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:48:15.696 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:48:15.696 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:48:15.696 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:48:15.697 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:48:15.697 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:48:15.697 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:48:15.697 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 104, 2021-11-12T05:48:15.698 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:48:15.698 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:48:15.698 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:48:15.698 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:15.698 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.699 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:15.699 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6808", 2021-11-12T05:48:15.699 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:48:15.699 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.699 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.700 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:15.700 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6809", 2021-11-12T05:48:15.700 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:48:15.700 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.701 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.701 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.701 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:48:15.701 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:15.701 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.702 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:15.702 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6810", 2021-11-12T05:48:15.702 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:48:15.702 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.703 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.703 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:15.703 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6811", 2021-11-12T05:48:15.703 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:48:15.703 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.704 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.704 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.704 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:48:15.704 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:15.704 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.705 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:15.705 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6814", 2021-11-12T05:48:15.705 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:48:15.705 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.706 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.706 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:15.706 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6815", 2021-11-12T05:48:15.706 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:48:15.707 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.707 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.707 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.707 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:48:15.708 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:15.708 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.708 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:15.709 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6812", 2021-11-12T05:48:15.709 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:48:15.709 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.709 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.709 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:15.710 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6813", 2021-11-12T05:48:15.710 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:48:15.710 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.710 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.711 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.711 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6809/15097", 2021-11-12T05:48:15.711 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6811/15097", 2021-11-12T05:48:15.711 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6815/15097", 2021-11-12T05:48:15.712 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6813/15097", 2021-11-12T05:48:15.712 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:48:15.712 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:48:15.712 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:48:15.712 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.713 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.713 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.713 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:48:15.713 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "a2c83b5d-8d37-4d30-ac04-30d89a76e485", 2021-11-12T05:48:15.713 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:48:15.714 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:48:15.714 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:48:15.714 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:48:15.714 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:48:15.715 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:48:15.715 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:48:15.715 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 105, 2021-11-12T05:48:15.715 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:48:15.716 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:48:15.716 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:48:15.716 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:15.716 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.716 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:15.717 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6816", 2021-11-12T05:48:15.717 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:48:15.717 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.717 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.718 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:15.718 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6817", 2021-11-12T05:48:15.718 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:48:15.718 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.718 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.719 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.719 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:48:15.719 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:15.719 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.720 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:15.720 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6818", 2021-11-12T05:48:15.720 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:48:15.720 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.720 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.721 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:15.721 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6819", 2021-11-12T05:48:15.721 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:48:15.721 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.722 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.722 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.722 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:48:15.722 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:15.723 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.723 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:15.723 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6822", 2021-11-12T05:48:15.723 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:48:15.723 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.724 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.724 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:15.724 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6823", 2021-11-12T05:48:15.724 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:48:15.725 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.725 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.725 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.725 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:48:15.725 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:15.726 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.726 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:15.726 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6820", 2021-11-12T05:48:15.727 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:48:15.727 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.727 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.727 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:15.727 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6821", 2021-11-12T05:48:15.728 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:48:15.728 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.728 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.728 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.729 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6817/15098", 2021-11-12T05:48:15.729 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6819/15098", 2021-11-12T05:48:15.729 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6823/15098", 2021-11-12T05:48:15.729 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6821/15098", 2021-11-12T05:48:15.730 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:48:15.730 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:48:15.730 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:48:15.730 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.730 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.731 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.731 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:48:15.731 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "786ce966-d0fb-4181-aed4-c26e3ef61c43", 2021-11-12T05:48:15.731 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:48:15.732 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:48:15.732 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:48:15.732 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:48:15.732 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:48:15.732 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:48:15.733 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:48:15.733 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 105, 2021-11-12T05:48:15.733 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:48:15.733 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:48:15.733 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:48:15.734 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:15.734 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.734 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:15.734 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6824", 2021-11-12T05:48:15.735 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:48:15.735 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.735 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.735 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:15.736 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6825", 2021-11-12T05:48:15.736 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:48:15.736 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.736 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.736 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.737 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:48:15.737 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:15.737 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.737 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:15.738 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6826", 2021-11-12T05:48:15.738 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:48:15.738 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.739 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.739 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:15.739 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6827", 2021-11-12T05:48:15.739 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:48:15.739 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.740 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.740 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.740 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:48:15.740 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:15.741 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.741 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:15.741 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6830", 2021-11-12T05:48:15.741 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:48:15.741 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.742 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.742 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:15.742 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6831", 2021-11-12T05:48:15.742 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:48:15.743 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.743 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.743 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.743 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:48:15.744 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:15.744 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.744 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:15.744 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6828", 2021-11-12T05:48:15.744 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:48:15.745 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.745 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.745 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:15.745 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6829", 2021-11-12T05:48:15.745 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:48:15.746 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.746 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.746 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.746 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6825/15099", 2021-11-12T05:48:15.747 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6827/15099", 2021-11-12T05:48:15.747 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6831/15099", 2021-11-12T05:48:15.747 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6829/15099", 2021-11-12T05:48:15.747 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:48:15.748 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:48:15.748 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:48:15.748 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:15.748 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.748 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:48:15.749 INFO:teuthology.orchestra.run.gibba005.stdout: "osd_xinfo": [ 2021-11-12T05:48:15.749 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.749 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:48:15.749 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:48:15.750 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:48:15.750 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:48:15.750 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:48:15.750 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:48:15.751 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.615112+0000", 2021-11-12T05:48:15.751 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:48:15.751 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.751 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.752 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:48:15.752 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:48:15.752 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:48:15.752 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:48:15.752 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:48:15.753 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:48:15.753 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.665935+0000", 2021-11-12T05:48:15.753 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:48:15.753 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.754 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.754 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:48:15.754 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:48:15.754 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:48:15.754 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:48:15.755 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:48:15.755 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:48:15.755 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.715877+0000", 2021-11-12T05:48:15.755 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:48:15.756 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.756 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.756 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:48:15.756 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:48:15.756 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:48:15.757 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:48:15.757 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:48:15.757 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:48:15.757 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.489234+0000", 2021-11-12T05:48:15.758 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:48:15.758 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.758 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.758 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:48:15.758 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:48:15.759 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:48:15.759 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:48:15.759 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:48:15.760 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:48:15.760 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.413776+0000", 2021-11-12T05:48:15.761 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:48:15.761 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.761 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.761 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:48:15.762 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:48:15.762 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:48:15.762 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:48:15.763 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:48:15.763 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:48:15.763 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.507960+0000", 2021-11-12T05:48:15.763 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:48:15.764 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.764 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.764 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:48:15.764 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:48:15.764 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:48:15.765 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:48:15.765 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:48:15.765 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:48:15.765 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.635696+0000", 2021-11-12T05:48:15.766 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:48:15.766 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.766 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:15.766 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:48:15.767 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:48:15.767 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:48:15.767 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:48:15.767 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:48:15.767 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:48:15.768 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.746949+0000", 2021-11-12T05:48:15.768 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:48:15.768 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.768 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:48:15.769 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap": [], 2021-11-12T05:48:15.769 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap_items": [], 2021-11-12T05:48:15.769 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_temp": [], 2021-11-12T05:48:15.769 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_temp": [], 2021-11-12T05:48:15.769 INFO:teuthology.orchestra.run.gibba005.stdout: "blacklist": {}, 2021-11-12T05:48:15.770 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profiles": { 2021-11-12T05:48:15.770 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs_data": { 2021-11-12T05:48:15.770 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-device-class": "", 2021-11-12T05:48:15.770 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:48:15.771 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-root": "default", 2021-11-12T05:48:15.771 INFO:teuthology.orchestra.run.gibba005.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-12T05:48:15.771 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:48:15.771 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "2", 2021-11-12T05:48:15.771 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:48:15.772 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:48:15.772 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van", 2021-11-12T05:48:15.772 INFO:teuthology.orchestra.run.gibba005.stdout: "w": "8" 2021-11-12T05:48:15.772 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.772 INFO:teuthology.orchestra.run.gibba005.stdout: "default": { 2021-11-12T05:48:15.773 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:48:15.773 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:48:15.773 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "1", 2021-11-12T05:48:15.773 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:48:15.774 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:48:15.774 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van" 2021-11-12T05:48:15.774 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:15.774 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:15.775 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps_queue": [], 2021-11-12T05:48:15.775 INFO:teuthology.orchestra.run.gibba005.stdout: "new_removed_snaps": [], 2021-11-12T05:48:15.775 INFO:teuthology.orchestra.run.gibba005.stdout: "new_purged_snaps": [], 2021-11-12T05:48:15.775 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_node_flags": {}, 2021-11-12T05:48:15.775 INFO:teuthology.orchestra.run.gibba005.stdout: "device_class_flags": {} 2021-11-12T05:48:15.776 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:48:15.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.528+0000 7f589de3a700 1 -- 172.21.2.105:0/3094184324 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5878053610 msgr2=0x7f5878055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:15.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.528+0000 7f589de3a700 1 --2- 172.21.2.105:0/3094184324 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5878053610 0x7f5878055ad0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f588c018000 tx=0x7f588c014000).stop 2021-11-12T05:48:15.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.528+0000 7f589de3a700 1 -- 172.21.2.105:0/3094184324 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5898066ba0 msgr2=0x7f58981430e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:15.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.528+0000 7f589de3a700 1 --2- 172.21.2.105:0/3094184324 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5898066ba0 0x7f58981430e0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7f588800c000 tx=0x7f5888006df0).stop 2021-11-12T05:48:15.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.528+0000 7f589de3a700 1 -- 172.21.2.105:0/3094184324 shutdown_connections 2021-11-12T05:48:15.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.528+0000 7f589de3a700 1 --2- 172.21.2.105:0/3094184324 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5878053610 0x7f5878055ad0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:15.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.528+0000 7f589de3a700 1 --2- 172.21.2.105:0/3094184324 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f58980afcc0 0x7f58981128a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:15.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.528+0000 7f589de3a700 1 --2- 172.21.2.105:0/3094184324 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f58980ad270 0x7f58981123b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:15.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.528+0000 7f589de3a700 1 --2- 172.21.2.105:0/3094184324 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5898066ba0 0x7f58981430e0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:15.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.528+0000 7f589de3a700 1 -- 172.21.2.105:0/3094184324 >> 172.21.2.105:0/3094184324 conn(0x7f58980b5320 msgr2=0x7f589813d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:15.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.528+0000 7f589de3a700 1 -- 172.21.2.105:0/3094184324 shutdown_connections 2021-11-12T05:48:15.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.528+0000 7f589de3a700 1 -- 172.21.2.105:0/3094184324 wait complete. 2021-11-12T05:48:15.781 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:48:15.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.848+0000 7f10b79da700 1 Processor -- start 2021-11-12T05:48:15.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.848+0000 7f10b79da700 1 -- start start 2021-11-12T05:48:15.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.848+0000 7f10b79da700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f10b014b2f0 0x7f10b00af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:15.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.848+0000 7f10b79da700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10b00ac7b0 con 0x7f10b00ac280 2021-11-12T05:48:15.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.848+0000 7f10b79da700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10b00ac9e0 con 0x7f10b00ad080 2021-11-12T05:48:15.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.848+0000 7f10b79da700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10b01488a0 con 0x7f10b014b2f0 2021-11-12T05:48:15.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.848+0000 7f10b4f75700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f10b00ac280 0x7f10b0147a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60510/0 (socket says 172.21.2.105:60510) 2021-11-12T05:48:15.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.848+0000 7f10b4f75700 1 -- 172.21.2.105:0/4104782100 learned_addr learned my addr 172.21.2.105:0/4104782100 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:15.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.848+0000 7f10b5f77700 1 --2- 172.21.2.105:0/4104782100 >> v2:172.21.2.105:3300/0 conn(0x7f10b014b2f0 0x7f10b00af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:15.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.848+0000 7f109ffff700 1 -- 172.21.2.105:0/4104782100 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2183519333 0 0) 0x7f10b00ac7b0 con 0x7f10b00ac280 2021-11-12T05:48:15.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.848+0000 7f10b5f77700 1 -- 172.21.2.105:0/4104782100 >> v1:172.21.2.115:6789/0 conn(0x7f10b00ad080 legacy=0x7f10b014abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:15.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.848+0000 7f10b5f77700 1 -- 172.21.2.105:0/4104782100 >> v1:172.21.2.105:6789/0 conn(0x7f10b00ac280 legacy=0x7f10b0147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:15.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.848+0000 7f10b5f77700 1 -- 172.21.2.105:0/4104782100 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b00b0b30 con 0x7f10b014b2f0 2021-11-12T05:48:15.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.848+0000 7f10b5f77700 1 --2- 172.21.2.105:0/4104782100 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f10b014b2f0 0x7f10b00af730 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 rx=0x7f10b00ac6a0 tx=0x7f10a80091d0).ready entity=mon.0 client_cookie=c9b225b1f6cc5ad5 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:15.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.848+0000 7f109ffff700 1 -- 172.21.2.105:0/4104782100 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10a8009ea0 con 0x7f10b014b2f0 2021-11-12T05:48:15.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.848+0000 7f109ffff700 1 -- 172.21.2.105:0/4104782100 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a800b860 con 0x7f10b014b2f0 2021-11-12T05:48:15.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.848+0000 7f109ffff700 1 -- 172.21.2.105:0/4104782100 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10a800b9d0 con 0x7f10b014b2f0 2021-11-12T05:48:15.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.848+0000 7f10b79da700 1 -- 172.21.2.105:0/4104782100 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f10b014b2f0 msgr2=0x7f10b00af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:15.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.848+0000 7f10b79da700 1 --2- 172.21.2.105:0/4104782100 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f10b014b2f0 0x7f10b00af730 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 rx=0x7f10b00ac6a0 tx=0x7f10a80091d0).stop 2021-11-12T05:48:15.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.848+0000 7f10b79da700 1 -- 172.21.2.105:0/4104782100 shutdown_connections 2021-11-12T05:48:15.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.848+0000 7f10b79da700 1 --2- 172.21.2.105:0/4104782100 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f10b014b2f0 0x7f10b00af730 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:15.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.848+0000 7f10b79da700 1 -- 172.21.2.105:0/4104782100 >> 172.21.2.105:0/4104782100 conn(0x7f10b00b5370 msgr2=0x7f10b00b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:15.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.848+0000 7f10b79da700 1 -- 172.21.2.105:0/4104782100 shutdown_connections 2021-11-12T05:48:15.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.848+0000 7f10b79da700 1 -- 172.21.2.105:0/4104782100 wait complete. 2021-11-12T05:48:15.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.852+0000 7f10b79da700 1 Processor -- start 2021-11-12T05:48:15.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.852+0000 7f10b79da700 1 -- start start 2021-11-12T05:48:15.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.852+0000 7f10b79da700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f10b00ac280 0x7f10b00aab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:15.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.852+0000 7f10b79da700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f10b00ad080 0x7f10b00a95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:15.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.852+0000 7f10b79da700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f10b014b2f0 0x7f10b0157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:15.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.852+0000 7f10b79da700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b00abe70 con 0x7f10b00ac280 2021-11-12T05:48:15.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.852+0000 7f10b79da700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b00abbd0 con 0x7f10b00ad080 2021-11-12T05:48:15.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.852+0000 7f10b79da700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b00ab3f0 con 0x7f10b014b2f0 2021-11-12T05:48:15.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.852+0000 7f10b5776700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f10b00ac280 0x7f10b00aab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:15.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.852+0000 7f10b5776700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f10b00ac280 0x7f10b00aab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50118/0 (socket says 172.21.2.105:50118) 2021-11-12T05:48:15.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.852+0000 7f10b5776700 1 -- 172.21.2.105:0/4289858062 learned_addr learned my addr 172.21.2.105:0/4289858062 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:15.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.852+0000 7f10b5776700 1 -- 172.21.2.105:0/4289858062 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f10b014b2f0 msgr2=0x7f10b0157b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:15.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.852+0000 7f10b5776700 1 --2- 172.21.2.105:0/4289858062 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f10b014b2f0 0x7f10b0157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:15.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.852+0000 7f10b5776700 1 -- 172.21.2.105:0/4289858062 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f10b00ad080 msgr2=0x7f10b00a95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:15.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.852+0000 7f10b5776700 1 --2- 172.21.2.105:0/4289858062 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f10b00ad080 0x7f10b00a95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:15.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.852+0000 7f10b5776700 1 -- 172.21.2.105:0/4289858062 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a8009470 con 0x7f10b00ac280 2021-11-12T05:48:15.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.852+0000 7f10b5776700 1 --2- 172.21.2.105:0/4289858062 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f10b00ac280 0x7f10b00aab20 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7f10ac002f90 tx=0x7f10ac006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:15.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.852+0000 7f109e7fc700 1 -- 172.21.2.105:0/4289858062 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10ac013460 con 0x7f10b00ac280 2021-11-12T05:48:15.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.852+0000 7f109e7fc700 1 -- 172.21.2.105:0/4289858062 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ac0135c0 con 0x7f10b00ac280 2021-11-12T05:48:15.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.852+0000 7f109e7fc700 1 -- 172.21.2.105:0/4289858062 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10ac013920 con 0x7f10b00ac280 2021-11-12T05:48:15.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.852+0000 7f10b79da700 1 -- 172.21.2.105:0/4289858062 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10b00ab6d0 con 0x7f10b00ac280 2021-11-12T05:48:15.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.852+0000 7f10b79da700 1 -- 172.21.2.105:0/4289858062 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10b00a7240 con 0x7f10b00ac280 2021-11-12T05:48:15.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.852+0000 7f10b79da700 1 -- 172.21.2.105:0/4289858062 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10b00ab9e0 con 0x7f10b00ac280 2021-11-12T05:48:15.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.852+0000 7f109e7fc700 1 -- 172.21.2.105:0/4289858062 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f10ac01a060 con 0x7f10b00ac280 2021-11-12T05:48:15.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.852+0000 7f109e7fc700 1 --2- 172.21.2.105:0/4289858062 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1090053660 0x7f1090055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:15.873 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.852+0000 7f109e7fc700 1 -- 172.21.2.105:0/4289858062 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f10ac06b560 con 0x7f10b00ac280 2021-11-12T05:48:15.873 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.852+0000 7f10b4f75700 1 --2- 172.21.2.105:0/4289858062 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1090053660 0x7f1090055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:15.873 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.852+0000 7f10b4f75700 1 --2- 172.21.2.105:0/4289858062 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1090053660 0x7f1090055b20 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f10a0000bc0 tx=0x7f10a00011a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:15.873 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.856+0000 7f109e7fc700 1 -- 172.21.2.105:0/4289858062 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f10ac042460 con 0x7f10b00ac280 2021-11-12T05:48:15.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.960+0000 7f10b79da700 1 -- 172.21.2.105:0/4289858062 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f10b0057350 con 0x7f10b00ac280 2021-11-12T05:48:15.967 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.960+0000 7f109e7fc700 1 -- 172.21.2.105:0/4289858062 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2140 (secure 0 0 0) 0x7f10ac018020 con 0x7f10b00ac280 2021-11-12T05:48:15.967 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:15.967 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":50,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5140,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/1083784348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":1083784348},{"type":"v1","addr":"172.21.2.115:6833","nonce":1083784348}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:48:08.977584+0000","modified":"2021-11-12T05:48:09.981269+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7347},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7347":{"gid":7347,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/3290895957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":3290895957},{"type":"v1","addr":"172.21.2.105:6835","nonce":3290895957}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-11-12T05:48:15.968 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.964+0000 7f10b79da700 1 -- 172.21.2.105:0/4289858062 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1090053660 msgr2=0x7f1090055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:15.969 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.964+0000 7f10b79da700 1 --2- 172.21.2.105:0/4289858062 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1090053660 0x7f1090055b20 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f10a0000bc0 tx=0x7f10a00011a0).stop 2021-11-12T05:48:15.969 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.964+0000 7f10b79da700 1 -- 172.21.2.105:0/4289858062 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f10b00ac280 msgr2=0x7f10b00aab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:15.969 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.964+0000 7f10b79da700 1 --2- 172.21.2.105:0/4289858062 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f10b00ac280 0x7f10b00aab20 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7f10ac002f90 tx=0x7f10ac006df0).stop 2021-11-12T05:48:15.969 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.964+0000 7f10b79da700 1 -- 172.21.2.105:0/4289858062 shutdown_connections 2021-11-12T05:48:15.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.964+0000 7f10b79da700 1 --2- 172.21.2.105:0/4289858062 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1090053660 0x7f1090055b20 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:15.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.964+0000 7f10b79da700 1 --2- 172.21.2.105:0/4289858062 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f10b014b2f0 0x7f10b0157b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:15.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.964+0000 7f10b79da700 1 --2- 172.21.2.105:0/4289858062 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f10b00ad080 0x7f10b00a95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:15.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.964+0000 7f10b79da700 1 --2- 172.21.2.105:0/4289858062 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f10b00ac280 0x7f10b00aab20 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:15.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.964+0000 7f10b79da700 1 -- 172.21.2.105:0/4289858062 >> 172.21.2.105:0/4289858062 conn(0x7f10b00b5370 msgr2=0x7f10b00b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:15.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.964+0000 7f10b79da700 1 -- 172.21.2.105:0/4289858062 shutdown_connections 2021-11-12T05:48:15.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:15.964+0000 7f10b79da700 1 -- 172.21.2.105:0/4289858062 wait complete. 2021-11-12T05:48:15.971 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 50 2021-11-12T05:48:15.974 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-12T05:48:16.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.020+0000 7fab88c23700 1 Processor -- start 2021-11-12T05:48:16.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.020+0000 7fab88c23700 1 -- start start 2021-11-12T05:48:16.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.020+0000 7fab88c23700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fab84142900 0x7fab840b6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:16.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.020+0000 7fab88c23700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab8413fab0 con 0x7fab841390a0 2021-11-12T05:48:16.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.020+0000 7fab88c23700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab8413fd50 con 0x7fab840b6380 2021-11-12T05:48:16.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.020+0000 7fab88c23700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab8413fff0 con 0x7fab84142900 2021-11-12T05:48:16.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.020+0000 7fab82d9d700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fab841390a0 0x7fab840aeea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60522/0 (socket says 172.21.2.105:60522) 2021-11-12T05:48:16.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.020+0000 7fab82d9d700 1 -- 172.21.2.105:0/4056697253 learned_addr learned my addr 172.21.2.105:0/4056697253 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:16.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.020+0000 7fab8159a700 1 -- 172.21.2.105:0/4056697253 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1565636550 0 0) 0x7fab8413fab0 con 0x7fab841390a0 2021-11-12T05:48:16.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.020+0000 7fab8159a700 1 -- 172.21.2.105:0/4056697253 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab64003260 con 0x7fab841390a0 2021-11-12T05:48:16.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.020+0000 7fab81d9b700 1 --2- 172.21.2.105:0/4056697253 >> v2:172.21.2.115:3300/0 conn(0x7fab84142900 0x7fab840b6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:16.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.020+0000 7fab8159a700 1 -- 172.21.2.105:0/4056697253 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3075956345 0 0) 0x7fab64003260 con 0x7fab841390a0 2021-11-12T05:48:16.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.020+0000 7fab8159a700 1 -- 172.21.2.105:0/4056697253 >> v2:172.21.2.115:3300/0 conn(0x7fab84142900 msgr2=0x7fab840b6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:16.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.020+0000 7fab8159a700 1 --2- 172.21.2.105:0/4056697253 >> v2:172.21.2.115:3300/0 conn(0x7fab84142900 0x7fab840b6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:16.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.020+0000 7fab8159a700 1 -- 172.21.2.105:0/4056697253 >> v1:172.21.2.115:6789/0 conn(0x7fab840b6380 legacy=0x7fab8413f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:16.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.020+0000 7fab8159a700 1 -- 172.21.2.105:0/4056697253 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab841394f0 con 0x7fab841390a0 2021-11-12T05:48:16.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.020+0000 7fab8159a700 1 -- 172.21.2.105:0/4056697253 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fab7c0019e0 con 0x7fab841390a0 2021-11-12T05:48:16.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.020+0000 7fab8159a700 1 -- 172.21.2.105:0/4056697253 >> v1:172.21.2.105:6789/0 conn(0x7fab841390a0 legacy=0x7fab840aeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:16.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.020+0000 7fab8159a700 1 --2- 172.21.2.105:0/4056697253 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fab64003820 0x7fab64003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:16.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.020+0000 7fab8159a700 1 --2- 172.21.2.105:0/4056697253 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fab64004500 0x7fab64004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:16.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab8159a700 1 --2- 172.21.2.105:0/4056697253 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fab64004f70 0x7fab6400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:16.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab8159a700 1 -- 172.21.2.105:0/4056697253 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8413fff0 con 0x7fab64003820 2021-11-12T05:48:16.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab8159a700 1 -- 172.21.2.105:0/4056697253 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6400be50 con 0x7fab64004f70 2021-11-12T05:48:16.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab8159a700 1 -- 172.21.2.105:0/4056697253 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6400c010 con 0x7fab64004500 2021-11-12T05:48:16.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab8259c700 1 --2- 172.21.2.105:0/4056697253 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fab64003820 0x7fab64003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:16.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab8259c700 1 -- 172.21.2.105:0/4056697253 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fab64004500 msgr2=0x7fab64004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:16.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab8259c700 1 --2- 172.21.2.105:0/4056697253 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fab64004500 0x7fab64004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:16.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab8259c700 1 -- 172.21.2.105:0/4056697253 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fab64004f70 msgr2=0x7fab6400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:16.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab8259c700 1 --2- 172.21.2.105:0/4056697253 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fab64004f70 0x7fab6400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:16.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab82d9d700 1 -- 172.21.2.105:0/4056697253 reap_dead start 2021-11-12T05:48:16.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab8259c700 1 -- 172.21.2.105:0/4056697253 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab64003260 con 0x7fab64003820 2021-11-12T05:48:16.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab8259c700 1 --2- 172.21.2.105:0/4056697253 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fab64003820 0x7fab64003c20 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 rx=0x7fab74001fa0 tx=0x7fab74007a00).ready entity=mon.0 client_cookie=11dd5c7e7051cc0b server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:16.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab8159a700 1 -- 172.21.2.105:0/4056697253 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab74007070 con 0x7fab64003820 2021-11-12T05:48:16.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab8159a700 1 -- 172.21.2.105:0/4056697253 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab740071d0 con 0x7fab64003820 2021-11-12T05:48:16.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab8159a700 1 -- 172.21.2.105:0/4056697253 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab74006510 con 0x7fab64003820 2021-11-12T05:48:16.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab88c23700 1 -- 172.21.2.105:0/4056697253 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fab64003820 msgr2=0x7fab64003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:16.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab88c23700 1 --2- 172.21.2.105:0/4056697253 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fab64003820 0x7fab64003c20 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 rx=0x7fab74001fa0 tx=0x7fab74007a00).stop 2021-11-12T05:48:16.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab88c23700 1 -- 172.21.2.105:0/4056697253 shutdown_connections 2021-11-12T05:48:16.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab88c23700 1 --2- 172.21.2.105:0/4056697253 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fab64003820 0x7fab64003c20 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:16.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab88c23700 1 -- 172.21.2.105:0/4056697253 >> 172.21.2.105:0/4056697253 conn(0x7fab84063810 msgr2=0x7fab840b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:16.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab88c23700 1 -- 172.21.2.105:0/4056697253 shutdown_connections 2021-11-12T05:48:16.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab88c23700 1 -- 172.21.2.105:0/4056697253 wait complete. 2021-11-12T05:48:16.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab88c23700 1 Processor -- start 2021-11-12T05:48:16.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab88c23700 1 -- start start 2021-11-12T05:48:16.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab88c23700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fab64003820 0x7fab8413bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:16.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab88c23700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fab84066d00 0x7fab84139d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:16.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab88c23700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fab840b1bd0 0x7fab84063d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:16.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab88c23700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab840674b0 con 0x7fab840b1bd0 2021-11-12T05:48:16.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab88c23700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab840662b0 con 0x7fab84066d00 2021-11-12T05:48:16.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab88c23700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab84065d70 con 0x7fab64003820 2021-11-12T05:48:16.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab82d9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fab840b1bd0 0x7fab84063d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:16.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab82d9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fab840b1bd0 0x7fab84063d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50142/0 (socket says 172.21.2.105:50142) 2021-11-12T05:48:16.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab82d9d700 1 -- 172.21.2.105:0/1361408553 learned_addr learned my addr 172.21.2.105:0/1361408553 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:16.042 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab81d9b700 1 --2- 172.21.2.105:0/1361408553 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fab84066d00 0x7fab84139d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:16.042 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab8259c700 1 --2- 172.21.2.105:0/1361408553 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fab64003820 0x7fab8413bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:16.042 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab82d9d700 1 -- 172.21.2.105:0/1361408553 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fab64003820 msgr2=0x7fab8413bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:16.042 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab82d9d700 1 --2- 172.21.2.105:0/1361408553 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fab64003820 0x7fab8413bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:16.042 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab82d9d700 1 -- 172.21.2.105:0/1361408553 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fab84066d00 msgr2=0x7fab84139d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:16.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab82d9d700 1 --2- 172.21.2.105:0/1361408553 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fab84066d00 0x7fab84139d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:16.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab82d9d700 1 -- 172.21.2.105:0/1361408553 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab84066010 con 0x7fab840b1bd0 2021-11-12T05:48:16.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab81d9b700 1 --2- 172.21.2.105:0/1361408553 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fab84066d00 0x7fab84139d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:48:16.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab8259c700 1 --2- 172.21.2.105:0/1361408553 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fab64003820 0x7fab8413bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:48:16.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab82d9d700 1 --2- 172.21.2.105:0/1361408553 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fab840b1bd0 0x7fab84063d20 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7fab84066a60 tx=0x7fab7c001ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:16.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab7b7fe700 1 -- 172.21.2.105:0/1361408553 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab7c004ab0 con 0x7fab840b1bd0 2021-11-12T05:48:16.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab7b7fe700 1 -- 172.21.2.105:0/1361408553 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab7c004c10 con 0x7fab840b1bd0 2021-11-12T05:48:16.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab88c23700 1 -- 172.21.2.105:0/1361408553 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab84067650 con 0x7fab840b1bd0 2021-11-12T05:48:16.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab7b7fe700 1 -- 172.21.2.105:0/1361408553 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab7c0070d0 con 0x7fab840b1bd0 2021-11-12T05:48:16.045 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab88c23700 1 -- 172.21.2.105:0/1361408553 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab840b22a0 con 0x7fab840b1bd0 2021-11-12T05:48:16.045 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.024+0000 7fab88c23700 1 -- 172.21.2.105:0/1361408553 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab840670e0 con 0x7fab840b1bd0 2021-11-12T05:48:16.045 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.028+0000 7fab7b7fe700 1 -- 172.21.2.105:0/1361408553 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fab7c01b070 con 0x7fab840b1bd0 2021-11-12T05:48:16.045 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.028+0000 7fab7b7fe700 1 --2- 172.21.2.105:0/1361408553 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fab68053570 0x7fab68055a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:16.045 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.028+0000 7fab7b7fe700 1 -- 172.21.2.105:0/1361408553 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fab7c06b260 con 0x7fab840b1bd0 2021-11-12T05:48:16.046 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.028+0000 7fab8259c700 1 --2- 172.21.2.105:0/1361408553 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fab68053570 0x7fab68055a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:16.046 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.028+0000 7fab8259c700 1 --2- 172.21.2.105:0/1361408553 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fab68053570 0x7fab68055a30 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7fab74016000 tx=0x7fab74015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:16.046 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.028+0000 7fab7b7fe700 1 -- 172.21.2.105:0/1361408553 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fab7c042100 con 0x7fab840b1bd0 2021-11-12T05:48:16.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:16.136+0000 7fab88c23700 1 -- 172.21.2.105:0/1361408553 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fab84066aa0 con 0x7fab840b1bd0 2021-11-12T05:48:17.115 INFO:tasks.ceph.mon.a.gibba005.stderr:2021-11-12T05:48:17.112+0000 7fe9772b2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-12T05:48:17.127 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.124+0000 7fab7b7fe700 1 -- 172.21.2.105:0/1361408553 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v51) v1 ==== 161+0+0 (secure 0 0 0) 0x7fab7c019020 con 0x7fab840b1bd0 2021-11-12T05:48:17.129 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.124+0000 7fab88c23700 1 -- 172.21.2.105:0/1361408553 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fab68053570 msgr2=0x7fab68055a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:17.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.124+0000 7fab88c23700 1 --2- 172.21.2.105:0/1361408553 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fab68053570 0x7fab68055a30 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7fab74016000 tx=0x7fab74015000).stop 2021-11-12T05:48:17.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.124+0000 7fab88c23700 1 -- 172.21.2.105:0/1361408553 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fab840b1bd0 msgr2=0x7fab84063d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:17.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.124+0000 7fab88c23700 1 --2- 172.21.2.105:0/1361408553 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fab840b1bd0 0x7fab84063d20 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7fab84066a60 tx=0x7fab7c001ac0).stop 2021-11-12T05:48:17.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.124+0000 7fab88c23700 1 -- 172.21.2.105:0/1361408553 shutdown_connections 2021-11-12T05:48:17.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.124+0000 7fab88c23700 1 --2- 172.21.2.105:0/1361408553 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fab68053570 0x7fab68055a30 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:17.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.124+0000 7fab88c23700 1 --2- 172.21.2.105:0/1361408553 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fab840b1bd0 0x7fab84063d20 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:17.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.124+0000 7fab88c23700 1 --2- 172.21.2.105:0/1361408553 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fab84066d00 0x7fab84139d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:17.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.124+0000 7fab88c23700 1 --2- 172.21.2.105:0/1361408553 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fab64003820 0x7fab8413bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:17.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.124+0000 7fab88c23700 1 -- 172.21.2.105:0/1361408553 >> 172.21.2.105:0/1361408553 conn(0x7fab84063810 msgr2=0x7fab840b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:17.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.124+0000 7fab88c23700 1 -- 172.21.2.105:0/1361408553 shutdown_connections 2021-11-12T05:48:17.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.124+0000 7fab88c23700 1 -- 172.21.2.105:0/1361408553 wait complete. 2021-11-12T05:48:17.132 INFO:teuthology.orchestra.run.gibba005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-12T05:48:17.136 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:48:17.141 INFO:tasks.ceph.mds.a.gibba005.stdout:starting mds.a at 2021-11-12T05:48:17.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.184+0000 7f21b1974700 1 Processor -- start 2021-11-12T05:48:17.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.184+0000 7f21b1974700 1 -- start start 2021-11-12T05:48:17.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.184+0000 7f21b1974700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f21ac0b2940 0x7f21ac142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:17.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.184+0000 7f21b1974700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f21ac0b0780 0x7f21ac1432b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:17.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.184+0000 7f21b1974700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21ac0b2d20 con 0x7f21ac0b0cc0 2021-11-12T05:48:17.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.184+0000 7f21b1974700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21ac0b1fc0 con 0x7f21ac0b2940 2021-11-12T05:48:17.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.184+0000 7f21b1974700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21ac0b15e0 con 0x7f21ac0b0780 2021-11-12T05:48:17.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.184+0000 7f21ab7fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f21ac0b0cc0 0x7f21ac13fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60554/0 (socket says 172.21.2.105:60554) 2021-11-12T05:48:17.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.184+0000 7f21ab7fe700 1 -- 172.21.2.105:0/2743979894 learned_addr learned my addr 172.21.2.105:0/2743979894 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:17.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.184+0000 7f21aaffd700 1 --2- 172.21.2.105:0/2743979894 >> v2:172.21.2.105:3300/0 conn(0x7f21ac0b2940 0x7f21ac142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:17.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.184+0000 7f21aa7fc700 1 --2- 172.21.2.105:0/2743979894 >> v2:172.21.2.115:3300/0 conn(0x7f21ac0b0780 0x7f21ac1432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:17.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.184+0000 7f21aaffd700 1 -- 172.21.2.105:0/2743979894 >> v2:172.21.2.115:3300/0 conn(0x7f21ac0b0780 msgr2=0x7f21ac1432b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:17.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.184+0000 7f21a9ffb700 1 -- 172.21.2.105:0/2743979894 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2392984221 0 0) 0x7f21ac0b2d20 con 0x7f21ac0b0cc0 2021-11-12T05:48:17.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.184+0000 7f21aaffd700 1 --2- 172.21.2.105:0/2743979894 >> v2:172.21.2.115:3300/0 conn(0x7f21ac0b0780 0x7f21ac1432b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:17.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.184+0000 7f21aaffd700 1 -- 172.21.2.105:0/2743979894 >> v1:172.21.2.105:6789/0 conn(0x7f21ac0b0cc0 legacy=0x7f21ac13fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:17.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.184+0000 7f21aaffd700 1 -- 172.21.2.105:0/2743979894 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21ac0b1880 con 0x7f21ac0b2940 2021-11-12T05:48:17.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.184+0000 7f21aa7fc700 1 --2- 172.21.2.105:0/2743979894 >> v2:172.21.2.115:3300/0 conn(0x7f21ac0b0780 0x7f21ac1432b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:48:17.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.184+0000 7f21aaffd700 1 --2- 172.21.2.105:0/2743979894 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f21ac0b2940 0x7f21ac142dc0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7f2194002f70 tx=0x7f2194006df0).ready entity=mon.0 client_cookie=95a08f1fe9a92446 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:17.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.184+0000 7f21a9ffb700 1 -- 172.21.2.105:0/2743979894 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f219400d5c0 con 0x7f21ac0b2940 2021-11-12T05:48:17.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.184+0000 7f21a9ffb700 1 -- 172.21.2.105:0/2743979894 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2194000e90 con 0x7f21ac0b2940 2021-11-12T05:48:17.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.184+0000 7f21a9ffb700 1 -- 172.21.2.105:0/2743979894 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f219400d910 con 0x7f21ac0b2940 2021-11-12T05:48:17.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.184+0000 7f21b1974700 1 -- 172.21.2.105:0/2743979894 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f21ac0b2940 msgr2=0x7f21ac142dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:17.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.184+0000 7f21b1974700 1 --2- 172.21.2.105:0/2743979894 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f21ac0b2940 0x7f21ac142dc0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7f2194002f70 tx=0x7f2194006df0).stop 2021-11-12T05:48:17.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.184+0000 7f21b1974700 1 -- 172.21.2.105:0/2743979894 shutdown_connections 2021-11-12T05:48:17.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.184+0000 7f21b1974700 1 --2- 172.21.2.105:0/2743979894 >> v2:172.21.2.115:3300/0 conn(0x7f21ac0b0780 0x7f21ac1432b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:17.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.184+0000 7f21b1974700 1 --2- 172.21.2.105:0/2743979894 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f21ac0b2940 0x7f21ac142dc0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:17.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.184+0000 7f21b1974700 1 -- 172.21.2.105:0/2743979894 >> 172.21.2.105:0/2743979894 conn(0x7f21ac068440 msgr2=0x7f21ac062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:17.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.184+0000 7f21b1974700 1 -- 172.21.2.105:0/2743979894 shutdown_connections 2021-11-12T05:48:17.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.184+0000 7f21b1974700 1 -- 172.21.2.105:0/2743979894 wait complete. 2021-11-12T05:48:17.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.184+0000 7f21b1974700 1 Processor -- start 2021-11-12T05:48:17.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.184+0000 7f21b1974700 1 -- start start 2021-11-12T05:48:17.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.188+0000 7f21b1974700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f21ac0b0780 0x7f21ac066a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:17.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.188+0000 7f21b1974700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f21ac0b0cc0 0x7f21ac1380b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:17.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.188+0000 7f21b1974700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f21ac0b2940 0x7f21ac1385a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:17.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.188+0000 7f21b1974700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac13feb0 con 0x7f21ac0b0cc0 2021-11-12T05:48:17.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.188+0000 7f21b1974700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac13fc10 con 0x7f21ac0b0780 2021-11-12T05:48:17.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.188+0000 7f21b1974700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac063e70 con 0x7f21ac0b2940 2021-11-12T05:48:17.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.188+0000 7f21aa7fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f21ac0b0cc0 0x7f21ac1380b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:17.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.188+0000 7f21aa7fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f21ac0b0cc0 0x7f21ac1380b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50162/0 (socket says 172.21.2.105:50162) 2021-11-12T05:48:17.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.188+0000 7f21aa7fc700 1 -- 172.21.2.105:0/3416441571 learned_addr learned my addr 172.21.2.105:0/3416441571 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:17.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.188+0000 7f21aa7fc700 1 -- 172.21.2.105:0/3416441571 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f21ac0b2940 msgr2=0x7f21ac1385a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:17.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.188+0000 7f21aa7fc700 1 --2- 172.21.2.105:0/3416441571 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f21ac0b2940 0x7f21ac1385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:17.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.188+0000 7f21aa7fc700 1 -- 172.21.2.105:0/3416441571 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f21ac0b0780 msgr2=0x7f21ac066a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:17.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.188+0000 7f21aa7fc700 1 --2- 172.21.2.105:0/3416441571 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f21ac0b0780 0x7f21ac066a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:17.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.188+0000 7f21aa7fc700 1 -- 172.21.2.105:0/3416441571 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219400b180 con 0x7f21ac0b0cc0 2021-11-12T05:48:17.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.188+0000 7f21aa7fc700 1 --2- 172.21.2.105:0/3416441571 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f21ac0b0cc0 0x7f21ac1380b0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7f219c007000 tx=0x7f219c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:17.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.188+0000 7f21a3fff700 1 -- 172.21.2.105:0/3416441571 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f219c010580 con 0x7f21ac0b0cc0 2021-11-12T05:48:17.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.188+0000 7f21a3fff700 1 -- 172.21.2.105:0/3416441571 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219c0106e0 con 0x7f21ac0b0cc0 2021-11-12T05:48:17.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.188+0000 7f21b1974700 1 -- 172.21.2.105:0/3416441571 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21ac065c00 con 0x7f21ac0b0cc0 2021-11-12T05:48:17.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.188+0000 7f21a3fff700 1 -- 172.21.2.105:0/3416441571 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f219c010a40 con 0x7f21ac0b0cc0 2021-11-12T05:48:17.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.188+0000 7f21b1974700 1 -- 172.21.2.105:0/3416441571 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21ac138cb0 con 0x7f21ac0b0cc0 2021-11-12T05:48:17.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.188+0000 7f21b1974700 1 -- 172.21.2.105:0/3416441571 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21ac0b1b20 con 0x7f21ac0b0cc0 2021-11-12T05:48:17.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.188+0000 7f21a3fff700 1 -- 172.21.2.105:0/3416441571 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f219c010ba0 con 0x7f21ac0b0cc0 2021-11-12T05:48:17.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.188+0000 7f21a3fff700 1 --2- 172.21.2.105:0/3416441571 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2190053610 0x7f2190055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:17.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.188+0000 7f21a3fff700 1 -- 172.21.2.105:0/3416441571 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f219c06baf0 con 0x7f21ac0b0cc0 2021-11-12T05:48:17.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.188+0000 7f21aaffd700 1 --2- 172.21.2.105:0/3416441571 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2190053610 0x7f2190055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:17.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.188+0000 7f21aaffd700 1 --2- 172.21.2.105:0/3416441571 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2190053610 0x7f2190055ad0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f2194002f70 tx=0x7f2194014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:17.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.192+0000 7f21a3fff700 1 -- 172.21.2.105:0/3416441571 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f219c042a40 con 0x7f21ac0b0cc0 2021-11-12T05:48:17.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.300+0000 7f21b1974700 1 -- 172.21.2.105:0/3416441571 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f21ac138cb0 con 0x7f21ac0b0cc0 2021-11-12T05:48:17.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.304+0000 7f21a3fff700 1 -- 172.21.2.105:0/3416441571 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+1780 (secure 0 0 0) 0x7f21ac138cb0 con 0x7f21ac0b0cc0 2021-11-12T05:48:17.307 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:17.308 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":51,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5140,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/1083784348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":1083784348},{"type":"v1","addr":"172.21.2.115:6833","nonce":1083784348}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":48}],"filesystems":[{"mdsmap":{"epoch":51,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:48:08.977584+0000","modified":"2021-11-12T05:48:17.115409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":108,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-11-12T05:48:17.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.304+0000 7f21b1974700 1 -- 172.21.2.105:0/3416441571 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2190053610 msgr2=0x7f2190055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:17.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.304+0000 7f21b1974700 1 --2- 172.21.2.105:0/3416441571 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2190053610 0x7f2190055ad0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f2194002f70 tx=0x7f2194014000).stop 2021-11-12T05:48:17.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.304+0000 7f21b1974700 1 -- 172.21.2.105:0/3416441571 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f21ac0b0cc0 msgr2=0x7f21ac1380b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:17.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.304+0000 7f21b1974700 1 --2- 172.21.2.105:0/3416441571 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f21ac0b0cc0 0x7f21ac1380b0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7f219c007000 tx=0x7f219c008040).stop 2021-11-12T05:48:17.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.304+0000 7f21b1974700 1 -- 172.21.2.105:0/3416441571 shutdown_connections 2021-11-12T05:48:17.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.304+0000 7f21b1974700 1 --2- 172.21.2.105:0/3416441571 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2190053610 0x7f2190055ad0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:17.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.304+0000 7f21b1974700 1 --2- 172.21.2.105:0/3416441571 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f21ac0b2940 0x7f21ac1385a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:17.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.304+0000 7f21b1974700 1 --2- 172.21.2.105:0/3416441571 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f21ac0b0cc0 0x7f21ac1380b0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:17.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.304+0000 7f21b1974700 1 --2- 172.21.2.105:0/3416441571 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f21ac0b0780 0x7f21ac066a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:17.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.304+0000 7f21b1974700 1 -- 172.21.2.105:0/3416441571 >> 172.21.2.105:0/3416441571 conn(0x7f21ac068440 msgr2=0x7f21ac139030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:17.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.304+0000 7f21b1974700 1 -- 172.21.2.105:0/3416441571 shutdown_connections 2021-11-12T05:48:17.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.304+0000 7f21b1974700 1 -- 172.21.2.105:0/3416441571 wait complete. 2021-11-12T05:48:17.311 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 51 2021-11-12T05:48:17.315 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-12T05:48:17.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.360+0000 7f825b903700 1 Processor -- start 2021-11-12T05:48:17.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.360+0000 7f825b903700 1 -- start start 2021-11-12T05:48:17.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f825b903700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f82540aca40 0x7f82540ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:17.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f825b903700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f82540b0520 0x7f82541473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:17.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f825b903700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82540b1840 con 0x7f82541478b0 2021-11-12T05:48:17.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f825b903700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8254147d40 con 0x7f82540b0520 2021-11-12T05:48:17.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f825b903700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82540af2b0 con 0x7f82540aca40 2021-11-12T05:48:17.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f8259ea0700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f82541478b0 0x7f8254144180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60570/0 (socket says 172.21.2.105:60570) 2021-11-12T05:48:17.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f8259ea0700 1 -- 172.21.2.105:0/1250753859 learned_addr learned my addr 172.21.2.105:0/1250753859 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:17.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f8258e9e700 1 --2- 172.21.2.105:0/1250753859 >> v2:172.21.2.105:3300/0 conn(0x7f82540b0520 0x7f82541473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:17.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f8258e9e700 1 -- 172.21.2.105:0/1250753859 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f82540aca40 msgr2=0x7f82540ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:17.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f8258e9e700 1 --2- 172.21.2.105:0/1250753859 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f82540aca40 0x7f82540ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:17.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f8258e9e700 1 -- 172.21.2.105:0/1250753859 >> v1:172.21.2.105:6789/0 conn(0x7f82541478b0 legacy=0x7f8254144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:17.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f8258e9e700 1 -- 172.21.2.105:0/1250753859 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82540b09a0 con 0x7f82540b0520 2021-11-12T05:48:17.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f8258e9e700 1 --2- 172.21.2.105:0/1250753859 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f82540b0520 0x7f82541473c0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7f8248002f70 tx=0x7f8248006df0).ready entity=mon.0 client_cookie=502b8a49f45b3039 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:17.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f8247fff700 1 -- 172.21.2.105:0/1250753859 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f824800d570 con 0x7f82540b0520 2021-11-12T05:48:17.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f8247fff700 1 -- 172.21.2.105:0/1250753859 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8248000e90 con 0x7f82540b0520 2021-11-12T05:48:17.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f8247fff700 1 -- 172.21.2.105:0/1250753859 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f824800d8c0 con 0x7f82540b0520 2021-11-12T05:48:17.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f825b903700 1 -- 172.21.2.105:0/1250753859 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f82540b0520 msgr2=0x7f82541473c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:17.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f825b903700 1 --2- 172.21.2.105:0/1250753859 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f82540b0520 0x7f82541473c0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7f8248002f70 tx=0x7f8248006df0).stop 2021-11-12T05:48:17.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f825b903700 1 -- 172.21.2.105:0/1250753859 shutdown_connections 2021-11-12T05:48:17.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f825b903700 1 --2- 172.21.2.105:0/1250753859 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f82540b0520 0x7f82541473c0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:17.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f825b903700 1 --2- 172.21.2.105:0/1250753859 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f82540aca40 0x7f82540ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:17.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f825b903700 1 -- 172.21.2.105:0/1250753859 >> 172.21.2.105:0/1250753859 conn(0x7f825405c490 msgr2=0x7f82540b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:17.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f825b903700 1 -- 172.21.2.105:0/1250753859 shutdown_connections 2021-11-12T05:48:17.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f825b903700 1 -- 172.21.2.105:0/1250753859 wait complete. 2021-11-12T05:48:17.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f825b903700 1 Processor -- start 2021-11-12T05:48:17.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f825b903700 1 -- start start 2021-11-12T05:48:17.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f825b903700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f82540aca40 0x7f8254064760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:17.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f825b903700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f82540b0520 0x7f8254141540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:17.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f825b903700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f82541478b0 0x7f8254141a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:17.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f825b903700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82541566f0 con 0x7f82540aca40 2021-11-12T05:48:17.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f825b903700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82540a71a0 con 0x7f82541478b0 2021-11-12T05:48:17.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f825b903700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82540a7440 con 0x7f82540b0520 2021-11-12T05:48:17.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f825969f700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f82540aca40 0x7f8254064760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:17.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f825969f700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f82540aca40 0x7f8254064760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50176/0 (socket says 172.21.2.105:50176) 2021-11-12T05:48:17.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f825969f700 1 -- 172.21.2.105:0/129542535 learned_addr learned my addr 172.21.2.105:0/129542535 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:17.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f825969f700 1 -- 172.21.2.105:0/129542535 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f82540b0520 msgr2=0x7f8254141540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:17.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f825969f700 1 --2- 172.21.2.105:0/129542535 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f82540b0520 0x7f8254141540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:17.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f825969f700 1 -- 172.21.2.105:0/129542535 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f82541478b0 msgr2=0x7f8254141a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:17.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f825969f700 1 --2- 172.21.2.105:0/129542535 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f82541478b0 0x7f8254141a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:17.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f825969f700 1 -- 172.21.2.105:0/129542535 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f824800b180 con 0x7f82540aca40 2021-11-12T05:48:17.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f825969f700 1 --2- 172.21.2.105:0/129542535 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f82540aca40 0x7f8254064760 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7f8250002f70 tx=0x7f8250006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:17.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f82467fc700 1 -- 172.21.2.105:0/129542535 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8250013460 con 0x7f82540aca40 2021-11-12T05:48:17.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f82467fc700 1 -- 172.21.2.105:0/129542535 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82500135c0 con 0x7f82540aca40 2021-11-12T05:48:17.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f825b903700 1 -- 172.21.2.105:0/129542535 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8254063a70 con 0x7f82540aca40 2021-11-12T05:48:17.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f82467fc700 1 -- 172.21.2.105:0/129542535 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8250013920 con 0x7f82540aca40 2021-11-12T05:48:17.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.364+0000 7f825b903700 1 -- 172.21.2.105:0/129542535 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8254063670 con 0x7f82540aca40 2021-11-12T05:48:17.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.368+0000 7f825b903700 1 -- 172.21.2.105:0/129542535 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8254063d10 con 0x7f82540aca40 2021-11-12T05:48:17.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.368+0000 7f82467fc700 1 -- 172.21.2.105:0/129542535 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f825001a060 con 0x7f82540aca40 2021-11-12T05:48:17.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.368+0000 7f82467fc700 1 --2- 172.21.2.105:0/129542535 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8234053610 0x7f8234055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:17.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.368+0000 7f82467fc700 1 -- 172.21.2.105:0/129542535 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f825006b6c0 con 0x7f82540aca40 2021-11-12T05:48:17.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.368+0000 7f8258e9e700 1 --2- 172.21.2.105:0/129542535 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8234053610 0x7f8234055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:17.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.368+0000 7f8258e9e700 1 --2- 172.21.2.105:0/129542535 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8234053610 0x7f8234055ad0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f8248002f70 tx=0x7f8248015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:17.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.368+0000 7f82467fc700 1 -- 172.21.2.105:0/129542535 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8250042560 con 0x7f82540aca40 2021-11-12T05:48:17.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:17.480+0000 7f825b903700 1 -- 172.21.2.105:0/129542535 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f82540a7600 con 0x7f82540aca40 2021-11-12T05:48:18.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.128+0000 7f82467fc700 1 -- 172.21.2.105:0/129542535 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v52) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8250045b80 con 0x7f82540aca40 2021-11-12T05:48:18.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.132+0000 7f825b903700 1 -- 172.21.2.105:0/129542535 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8234053610 msgr2=0x7f8234055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:18.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.132+0000 7f825b903700 1 --2- 172.21.2.105:0/129542535 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8234053610 0x7f8234055ad0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f8248002f70 tx=0x7f8248015000).stop 2021-11-12T05:48:18.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.132+0000 7f825b903700 1 -- 172.21.2.105:0/129542535 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f82540aca40 msgr2=0x7f8254064760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:18.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.132+0000 7f825b903700 1 --2- 172.21.2.105:0/129542535 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f82540aca40 0x7f8254064760 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7f8250002f70 tx=0x7f8250006ec0).stop 2021-11-12T05:48:18.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.132+0000 7f825b903700 1 -- 172.21.2.105:0/129542535 shutdown_connections 2021-11-12T05:48:18.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.132+0000 7f825b903700 1 --2- 172.21.2.105:0/129542535 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8234053610 0x7f8234055ad0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:18.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.132+0000 7f825b903700 1 --2- 172.21.2.105:0/129542535 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f82541478b0 0x7f8254141a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:18.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.132+0000 7f825b903700 1 --2- 172.21.2.105:0/129542535 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f82540b0520 0x7f8254141540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:18.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.132+0000 7f825b903700 1 --2- 172.21.2.105:0/129542535 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f82540aca40 0x7f8254064760 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:18.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.132+0000 7f825b903700 1 -- 172.21.2.105:0/129542535 >> 172.21.2.105:0/129542535 conn(0x7f825405c490 msgr2=0x7f8254144f40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:18.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.132+0000 7f825b903700 1 -- 172.21.2.105:0/129542535 shutdown_connections 2021-11-12T05:48:18.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.132+0000 7f825b903700 1 -- 172.21.2.105:0/129542535 wait complete. 2021-11-12T05:48:18.142 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-12T05:48:18.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.192+0000 7f44dd35b700 1 Processor -- start 2021-11-12T05:48:18.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.192+0000 7f44dd35b700 1 -- start start 2021-11-12T05:48:18.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.192+0000 7f44dd35b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f44d805d760 0x7f44d80b5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:18.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.192+0000 7f44dd35b700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f44d80b13c0 0x7f44d80aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:18.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.192+0000 7f44dd35b700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44d80b1a60 con 0x7f44d80b01b0 2021-11-12T05:48:18.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.192+0000 7f44dd35b700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44d80b1850 con 0x7f44d805d760 2021-11-12T05:48:18.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.192+0000 7f44dd35b700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44d80accd0 con 0x7f44d80b13c0 2021-11-12T05:48:18.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.192+0000 7f44d6ffd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f44d805d760 0x7f44d80b5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:18.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.192+0000 7f44d6ffd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f44d805d760 0x7f44d80b5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50186/0 (socket says 172.21.2.105:50186) 2021-11-12T05:48:18.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.192+0000 7f44d6ffd700 1 -- 172.21.2.105:0/3798776047 learned_addr learned my addr 172.21.2.105:0/3798776047 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:18.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.192+0000 7f44d6ffd700 1 -- 172.21.2.105:0/3798776047 >> v2:172.21.2.115:3300/0 conn(0x7f44d80b13c0 msgr2=0x7f44d80aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:18.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.192+0000 7f44d6ffd700 1 --2- 172.21.2.105:0/3798776047 >> v2:172.21.2.115:3300/0 conn(0x7f44d80b13c0 0x7f44d80aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:18.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.192+0000 7f44d6ffd700 1 -- 172.21.2.105:0/3798776047 >> v1:172.21.2.115:6789/0 conn(0x7f44d80b01b0 legacy=0x7f44d80ae470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:18.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.192+0000 7f44d6ffd700 1 -- 172.21.2.105:0/3798776047 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d80acf70 con 0x7f44d805d760 2021-11-12T05:48:18.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.192+0000 7f44d6ffd700 1 --2- 172.21.2.105:0/3798776047 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f44d805d760 0x7f44d80b5ac0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7f44d80b6470 tx=0x7f44c8006eb0).ready entity=mon.0 client_cookie=cb5620c1d9ac1f24 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:18.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.192+0000 7f44d5ffb700 1 -- 172.21.2.105:0/3798776047 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44c800d5c0 con 0x7f44d805d760 2021-11-12T05:48:18.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.192+0000 7f44d5ffb700 1 -- 172.21.2.105:0/3798776047 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c8000e90 con 0x7f44d805d760 2021-11-12T05:48:18.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.192+0000 7f44d5ffb700 1 -- 172.21.2.105:0/3798776047 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44c800d910 con 0x7f44d805d760 2021-11-12T05:48:18.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.196+0000 7f44dd35b700 1 -- 172.21.2.105:0/3798776047 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f44d805d760 msgr2=0x7f44d80b5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:18.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.196+0000 7f44dd35b700 1 --2- 172.21.2.105:0/3798776047 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f44d805d760 0x7f44d80b5ac0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7f44d80b6470 tx=0x7f44c8006eb0).stop 2021-11-12T05:48:18.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.196+0000 7f44dd35b700 1 -- 172.21.2.105:0/3798776047 shutdown_connections 2021-11-12T05:48:18.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.196+0000 7f44dd35b700 1 --2- 172.21.2.105:0/3798776047 >> v2:172.21.2.115:3300/0 conn(0x7f44d80b13c0 0x7f44d80aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:18.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.196+0000 7f44dd35b700 1 --2- 172.21.2.105:0/3798776047 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f44d805d760 0x7f44d80b5ac0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:18.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.196+0000 7f44dd35b700 1 -- 172.21.2.105:0/3798776047 >> 172.21.2.105:0/3798776047 conn(0x7f44d80628b0 msgr2=0x7f44d8062c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:18.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.196+0000 7f44dd35b700 1 -- 172.21.2.105:0/3798776047 shutdown_connections 2021-11-12T05:48:18.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.196+0000 7f44dd35b700 1 -- 172.21.2.105:0/3798776047 wait complete. 2021-11-12T05:48:18.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.196+0000 7f44dd35b700 1 Processor -- start 2021-11-12T05:48:18.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.196+0000 7f44dd35b700 1 -- start start 2021-11-12T05:48:18.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.196+0000 7f44dd35b700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f44d805d760 0x7f44d8139780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:18.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.196+0000 7f44dd35b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f44d80b01b0 0x7f44d8138470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:18.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.196+0000 7f44dd35b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f44d80b13c0 0x7f44d813ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:18.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.196+0000 7f44dd35b700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d813b760 con 0x7f44d80b01b0 2021-11-12T05:48:18.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.196+0000 7f44dd35b700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d813fe40 con 0x7f44d805d760 2021-11-12T05:48:18.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.196+0000 7f44dd35b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d813c770 con 0x7f44d80b13c0 2021-11-12T05:48:18.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.196+0000 7f44d67fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f44d80b01b0 0x7f44d8138470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:18.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.196+0000 7f44d67fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f44d80b01b0 0x7f44d8138470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50194/0 (socket says 172.21.2.105:50194) 2021-11-12T05:48:18.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.196+0000 7f44d67fc700 1 -- 172.21.2.105:0/1733411798 learned_addr learned my addr 172.21.2.105:0/1733411798 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:18.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.196+0000 7f44d67fc700 1 -- 172.21.2.105:0/1733411798 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f44d80b13c0 msgr2=0x7f44d813ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:18.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.196+0000 7f44d67fc700 1 --2- 172.21.2.105:0/1733411798 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f44d80b13c0 0x7f44d813ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:18.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.196+0000 7f44d67fc700 1 -- 172.21.2.105:0/1733411798 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f44d805d760 msgr2=0x7f44d8139780 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:48:18.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.196+0000 7f44d67fc700 1 --2- 172.21.2.105:0/1733411798 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f44d805d760 0x7f44d8139780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:18.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.196+0000 7f44d67fc700 1 -- 172.21.2.105:0/1733411798 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c800b1e0 con 0x7f44d80b01b0 2021-11-12T05:48:18.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.196+0000 7f44d67fc700 1 --2- 172.21.2.105:0/1733411798 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f44d80b01b0 0x7f44d8138470 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 rx=0x7f44cc002f90 tx=0x7f44cc006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:18.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.196+0000 7f44c7fff700 1 -- 172.21.2.105:0/1733411798 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44cc013460 con 0x7f44d80b01b0 2021-11-12T05:48:18.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.196+0000 7f44c7fff700 1 -- 172.21.2.105:0/1733411798 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44cc0135c0 con 0x7f44d80b01b0 2021-11-12T05:48:18.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.196+0000 7f44dd35b700 1 -- 172.21.2.105:0/1733411798 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44d813b990 con 0x7f44d80b01b0 2021-11-12T05:48:18.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.196+0000 7f44dd35b700 1 -- 172.21.2.105:0/1733411798 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44d813f470 con 0x7f44d80b01b0 2021-11-12T05:48:18.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.196+0000 7f44c7fff700 1 -- 172.21.2.105:0/1733411798 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44cc013920 con 0x7f44d80b01b0 2021-11-12T05:48:18.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.196+0000 7f44dd35b700 1 -- 172.21.2.105:0/1733411798 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44d8148530 con 0x7f44d80b01b0 2021-11-12T05:48:18.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.196+0000 7f44c7fff700 1 -- 172.21.2.105:0/1733411798 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f44cc01a060 con 0x7f44d80b01b0 2021-11-12T05:48:18.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.196+0000 7f44c7fff700 1 --2- 172.21.2.105:0/1733411798 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f44b40535d0 0x7f44b4055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:18.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.196+0000 7f44c7fff700 1 -- 172.21.2.105:0/1733411798 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f44cc06b520 con 0x7f44d80b01b0 2021-11-12T05:48:18.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.196+0000 7f44d6ffd700 1 --2- 172.21.2.105:0/1733411798 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f44b40535d0 0x7f44b4055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:18.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.196+0000 7f44d6ffd700 1 --2- 172.21.2.105:0/1733411798 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f44b40535d0 0x7f44b4055a90 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f44d80b6470 tx=0x7f44c8015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:18.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.200+0000 7f44c7fff700 1 -- 172.21.2.105:0/1733411798 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f44d8148530 con 0x7f44d80b01b0 2021-11-12T05:48:18.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:18.284+0000 7f44dd35b700 1 -- 172.21.2.105:0/1733411798 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f44d8148530 con 0x7f44d80b01b0 2021-11-12T05:48:19.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.136+0000 7f44c7fff700 1 -- 172.21.2.105:0/1733411798 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v109) v1 ==== 185+0+0 (secure 0 0 0) 0x7f44d8148530 con 0x7f44d80b01b0 2021-11-12T05:48:19.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.136+0000 7f44dd35b700 1 -- 172.21.2.105:0/1733411798 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f44b40535d0 msgr2=0x7f44b4055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:19.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.136+0000 7f44dd35b700 1 --2- 172.21.2.105:0/1733411798 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f44b40535d0 0x7f44b4055a90 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f44d80b6470 tx=0x7f44c8015000).stop 2021-11-12T05:48:19.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.136+0000 7f44dd35b700 1 -- 172.21.2.105:0/1733411798 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f44d80b01b0 msgr2=0x7f44d8138470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:19.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.136+0000 7f44dd35b700 1 --2- 172.21.2.105:0/1733411798 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f44d80b01b0 0x7f44d8138470 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 rx=0x7f44cc002f90 tx=0x7f44cc006df0).stop 2021-11-12T05:48:19.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.136+0000 7f44dd35b700 1 -- 172.21.2.105:0/1733411798 shutdown_connections 2021-11-12T05:48:19.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.136+0000 7f44dd35b700 1 --2- 172.21.2.105:0/1733411798 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f44b40535d0 0x7f44b4055a90 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:19.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.136+0000 7f44dd35b700 1 --2- 172.21.2.105:0/1733411798 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f44d80b13c0 0x7f44d813ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:19.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.136+0000 7f44dd35b700 1 --2- 172.21.2.105:0/1733411798 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f44d80b01b0 0x7f44d8138470 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:19.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.136+0000 7f44dd35b700 1 --2- 172.21.2.105:0/1733411798 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f44d805d760 0x7f44d8139780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:19.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.136+0000 7f44dd35b700 1 -- 172.21.2.105:0/1733411798 >> 172.21.2.105:0/1733411798 conn(0x7f44d80628b0 msgr2=0x7f44d80adfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:19.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.136+0000 7f44dd35b700 1 -- 172.21.2.105:0/1733411798 shutdown_connections 2021-11-12T05:48:19.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.136+0000 7f44dd35b700 1 -- 172.21.2.105:0/1733411798 wait complete. 2021-11-12T05:48:19.145 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_metadata' removed 2021-11-12T05:48:19.149 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-12T05:48:19.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.196+0000 7f147fd3d700 1 Processor -- start 2021-11-12T05:48:19.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.196+0000 7f147fd3d700 1 -- start start 2021-11-12T05:48:19.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147fd3d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f14780adaf0 0x7f147813fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:19.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147fd3d700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f1478143b40 0x7f14780aded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:19.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147fd3d700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1478067860 con 0x7f14780ae3c0 2021-11-12T05:48:19.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147fd3d700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1478143400 con 0x7f14780adaf0 2021-11-12T05:48:19.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147fd3d700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14781436a0 con 0x7f1478143b40 2021-11-12T05:48:19.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147e2da700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f14780ae3c0 0x7f14780afe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60600/0 (socket says 172.21.2.105:60600) 2021-11-12T05:48:19.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147e2da700 1 -- 172.21.2.105:0/931729047 learned_addr learned my addr 172.21.2.105:0/931729047 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:19.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147dad9700 1 --2- 172.21.2.105:0/931729047 >> v2:172.21.2.105:3300/0 conn(0x7f14780adaf0 0x7f147813fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:19.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147cad7700 1 -- 172.21.2.105:0/931729047 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2095328004 0 0) 0x7f1478067860 con 0x7f14780ae3c0 2021-11-12T05:48:19.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147cad7700 1 -- 172.21.2.105:0/931729047 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1460003260 con 0x7f14780ae3c0 2021-11-12T05:48:19.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147dad9700 1 -- 172.21.2.105:0/931729047 >> v2:172.21.2.115:3300/0 conn(0x7f1478143b40 msgr2=0x7f14780aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:19.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147dad9700 1 --2- 172.21.2.105:0/931729047 >> v2:172.21.2.115:3300/0 conn(0x7f1478143b40 0x7f14780aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:19.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147dad9700 1 -- 172.21.2.105:0/931729047 >> v1:172.21.2.105:6789/0 conn(0x7f14780ae3c0 legacy=0x7f14780afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:19.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147dad9700 1 -- 172.21.2.105:0/931729047 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14780b2b40 con 0x7f14780adaf0 2021-11-12T05:48:19.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147dad9700 1 --2- 172.21.2.105:0/931729047 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f14780adaf0 0x7f147813fd90 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f146c002f70 tx=0x7f146c006df0).ready entity=mon.0 client_cookie=7918102451391c82 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:19.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147cad7700 1 -- 172.21.2.105:0/931729047 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f146c00d570 con 0x7f14780adaf0 2021-11-12T05:48:19.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147cad7700 1 -- 172.21.2.105:0/931729047 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146c000e90 con 0x7f14780adaf0 2021-11-12T05:48:19.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147cad7700 1 -- 172.21.2.105:0/931729047 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f146c00d8c0 con 0x7f14780adaf0 2021-11-12T05:48:19.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147fd3d700 1 -- 172.21.2.105:0/931729047 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f14780adaf0 msgr2=0x7f147813fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:19.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147fd3d700 1 --2- 172.21.2.105:0/931729047 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f14780adaf0 0x7f147813fd90 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f146c002f70 tx=0x7f146c006df0).stop 2021-11-12T05:48:19.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147fd3d700 1 -- 172.21.2.105:0/931729047 shutdown_connections 2021-11-12T05:48:19.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147fd3d700 1 --2- 172.21.2.105:0/931729047 >> v2:172.21.2.115:3300/0 conn(0x7f1478143b40 0x7f14780aded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:19.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147fd3d700 1 --2- 172.21.2.105:0/931729047 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f14780adaf0 0x7f147813fd90 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:19.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147fd3d700 1 -- 172.21.2.105:0/931729047 >> 172.21.2.105:0/931729047 conn(0x7f147805c490 msgr2=0x7f147805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:19.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147fd3d700 1 -- 172.21.2.105:0/931729047 shutdown_connections 2021-11-12T05:48:19.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147fd3d700 1 -- 172.21.2.105:0/931729047 wait complete. 2021-11-12T05:48:19.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147fd3d700 1 Processor -- start 2021-11-12T05:48:19.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147fd3d700 1 -- start start 2021-11-12T05:48:19.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147fd3d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f14780adaf0 0x7f14780b6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:19.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147fd3d700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f14780ae3c0 0x7f147815a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:19.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147fd3d700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1478143b40 0x7f147815a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:19.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147fd3d700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1478064780 con 0x7f14780adaf0 2021-11-12T05:48:19.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147fd3d700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14780aa380 con 0x7f1478143b40 2021-11-12T05:48:19.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147fd3d700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14780649b0 con 0x7f14780ae3c0 2021-11-12T05:48:19.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147dad9700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f14780adaf0 0x7f14780b6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:19.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147dad9700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f14780adaf0 0x7f14780b6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50206/0 (socket says 172.21.2.105:50206) 2021-11-12T05:48:19.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147dad9700 1 -- 172.21.2.105:0/479477968 learned_addr learned my addr 172.21.2.105:0/479477968 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:19.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147dad9700 1 -- 172.21.2.105:0/479477968 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f14780ae3c0 msgr2=0x7f147815a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:19.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147dad9700 1 --2- 172.21.2.105:0/479477968 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f14780ae3c0 0x7f147815a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:19.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147dad9700 1 -- 172.21.2.105:0/479477968 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1478143b40 msgr2=0x7f147815a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:19.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147dad9700 1 --2- 172.21.2.105:0/479477968 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1478143b40 0x7f147815a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:19.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147dad9700 1 -- 172.21.2.105:0/479477968 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f146c00b180 con 0x7f14780adaf0 2021-11-12T05:48:19.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147dad9700 1 --2- 172.21.2.105:0/479477968 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f14780adaf0 0x7f14780b6c20 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 rx=0x7f146c002f70 tx=0x7f146c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:19.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f146affd700 1 -- 172.21.2.105:0/479477968 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f146c016070 con 0x7f14780adaf0 2021-11-12T05:48:19.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f146affd700 1 -- 172.21.2.105:0/479477968 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146c0138d0 con 0x7f14780adaf0 2021-11-12T05:48:19.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f146affd700 1 -- 172.21.2.105:0/479477968 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f146c013c30 con 0x7f14780adaf0 2021-11-12T05:48:19.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147fd3d700 1 -- 172.21.2.105:0/479477968 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14780aa620 con 0x7f14780adaf0 2021-11-12T05:48:19.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147fd3d700 1 -- 172.21.2.105:0/479477968 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1478067330 con 0x7f14780adaf0 2021-11-12T05:48:19.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.200+0000 7f147fd3d700 1 -- 172.21.2.105:0/479477968 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14780ab2a0 con 0x7f14780adaf0 2021-11-12T05:48:19.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.204+0000 7f146affd700 1 -- 172.21.2.105:0/479477968 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f146c025030 con 0x7f14780adaf0 2021-11-12T05:48:19.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.204+0000 7f146affd700 1 --2- 172.21.2.105:0/479477968 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f14580535d0 0x7f1458055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:19.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.204+0000 7f146affd700 1 -- 172.21.2.105:0/479477968 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6064+0+0 (secure 0 0 0) 0x7f146c06cae0 con 0x7f14780adaf0 2021-11-12T05:48:19.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.204+0000 7f147d2d8700 1 --2- 172.21.2.105:0/479477968 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f14580535d0 0x7f1458055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:19.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.204+0000 7f147d2d8700 1 --2- 172.21.2.105:0/479477968 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f14580535d0 0x7f1458055a90 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f1474002f70 tx=0x7f14740069e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:19.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.204+0000 7f146affd700 1 -- 172.21.2.105:0/479477968 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f14780ab2a0 con 0x7f14780adaf0 2021-11-12T05:48:19.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:19.288+0000 7f147fd3d700 1 -- 172.21.2.105:0/479477968 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f14780ab2a0 con 0x7f14780adaf0 2021-11-12T05:48:20.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.140+0000 7f146affd700 1 -- 172.21.2.105:0/479477968 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v110) v1 ==== 173+0+0 (secure 0 0 0) 0x7f14780ab2a0 con 0x7f14780adaf0 2021-11-12T05:48:20.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.144+0000 7f147fd3d700 1 -- 172.21.2.105:0/479477968 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f14580535d0 msgr2=0x7f1458055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:20.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.144+0000 7f147fd3d700 1 --2- 172.21.2.105:0/479477968 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f14580535d0 0x7f1458055a90 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f1474002f70 tx=0x7f14740069e0).stop 2021-11-12T05:48:20.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.144+0000 7f147fd3d700 1 -- 172.21.2.105:0/479477968 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f14780adaf0 msgr2=0x7f14780b6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:20.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.144+0000 7f147fd3d700 1 --2- 172.21.2.105:0/479477968 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f14780adaf0 0x7f14780b6c20 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 rx=0x7f146c002f70 tx=0x7f146c014000).stop 2021-11-12T05:48:20.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.144+0000 7f147fd3d700 1 -- 172.21.2.105:0/479477968 shutdown_connections 2021-11-12T05:48:20.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.144+0000 7f147fd3d700 1 --2- 172.21.2.105:0/479477968 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f14580535d0 0x7f1458055a90 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:20.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.144+0000 7f147fd3d700 1 --2- 172.21.2.105:0/479477968 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1478143b40 0x7f147815a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:20.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.144+0000 7f147fd3d700 1 --2- 172.21.2.105:0/479477968 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f14780ae3c0 0x7f147815a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:20.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.144+0000 7f147fd3d700 1 --2- 172.21.2.105:0/479477968 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f14780adaf0 0x7f14780b6c20 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:20.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.144+0000 7f147fd3d700 1 -- 172.21.2.105:0/479477968 >> 172.21.2.105:0/479477968 conn(0x7f147805c490 msgr2=0x7f147813fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:20.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.144+0000 7f147fd3d700 1 -- 172.21.2.105:0/479477968 shutdown_connections 2021-11-12T05:48:20.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.144+0000 7f147fd3d700 1 -- 172.21.2.105:0/479477968 wait complete. 2021-11-12T05:48:20.151 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_data' removed 2021-11-12T05:48:20.156 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-11-12T05:48:20.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.208+0000 7f6c35b62700 1 Processor -- start 2021-11-12T05:48:20.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.208+0000 7f6c35b62700 1 -- start start 2021-11-12T05:48:20.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.208+0000 7f6c35b62700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f6c300b7c80 0x7f6c30067170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:20.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.208+0000 7f6c35b62700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f6c30140f90 0x7f6c301413b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:20.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.208+0000 7f6c35b62700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c300b8060 con 0x7f6c30064900 2021-11-12T05:48:20.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.208+0000 7f6c35b62700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c30067d80 con 0x7f6c300b7c80 2021-11-12T05:48:20.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.208+0000 7f6c35b62700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c30067660 con 0x7f6c30140f90 2021-11-12T05:48:20.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.208+0000 7f6c2effd700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f6c30064900 0x7f6c30064d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60612/0 (socket says 172.21.2.105:60612) 2021-11-12T05:48:20.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.208+0000 7f6c2effd700 1 -- 172.21.2.105:0/2486404098 learned_addr learned my addr 172.21.2.105:0/2486404098 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:20.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.208+0000 7f6c2f7fe700 1 --2- 172.21.2.105:0/2486404098 >> v2:172.21.2.105:3300/0 conn(0x7f6c300b7c80 0x7f6c30067170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:20.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.208+0000 7f6c2f7fe700 1 -- 172.21.2.105:0/2486404098 >> v2:172.21.2.115:3300/0 conn(0x7f6c30140f90 msgr2=0x7f6c301413b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:48:20.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.208+0000 7f6c2f7fe700 1 --2- 172.21.2.105:0/2486404098 >> v2:172.21.2.115:3300/0 conn(0x7f6c30140f90 0x7f6c301413b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:20.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.208+0000 7f6c2f7fe700 1 -- 172.21.2.105:0/2486404098 >> v1:172.21.2.105:6789/0 conn(0x7f6c30064900 legacy=0x7f6c30064d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:20.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.208+0000 7f6c2f7fe700 1 -- 172.21.2.105:0/2486404098 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c30067840 con 0x7f6c300b7c80 2021-11-12T05:48:20.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.208+0000 7f6c2f7fe700 1 --2- 172.21.2.105:0/2486404098 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6c300b7c80 0x7f6c30067170 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7f6c18002f70 tx=0x7f6c18006df0).ready entity=mon.0 client_cookie=d0a79dbc962e7481 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:20.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.208+0000 7f6c2e7fc700 1 -- 172.21.2.105:0/2486404098 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c1800d5c0 con 0x7f6c300b7c80 2021-11-12T05:48:20.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.208+0000 7f6c2e7fc700 1 -- 172.21.2.105:0/2486404098 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c18000e90 con 0x7f6c300b7c80 2021-11-12T05:48:20.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.208+0000 7f6c2e7fc700 1 -- 172.21.2.105:0/2486404098 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c1800d950 con 0x7f6c300b7c80 2021-11-12T05:48:20.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.212+0000 7f6c35b62700 1 -- 172.21.2.105:0/2486404098 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6c300b7c80 msgr2=0x7f6c30067170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:20.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.212+0000 7f6c35b62700 1 --2- 172.21.2.105:0/2486404098 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6c300b7c80 0x7f6c30067170 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7f6c18002f70 tx=0x7f6c18006df0).stop 2021-11-12T05:48:20.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.212+0000 7f6c35b62700 1 -- 172.21.2.105:0/2486404098 shutdown_connections 2021-11-12T05:48:20.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.212+0000 7f6c35b62700 1 --2- 172.21.2.105:0/2486404098 >> v2:172.21.2.115:3300/0 conn(0x7f6c30140f90 0x7f6c301413b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:20.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.212+0000 7f6c35b62700 1 --2- 172.21.2.105:0/2486404098 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6c300b7c80 0x7f6c30067170 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:20.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.212+0000 7f6c35b62700 1 -- 172.21.2.105:0/2486404098 >> 172.21.2.105:0/2486404098 conn(0x7f6c3005c860 msgr2=0x7f6c300608d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:20.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.212+0000 7f6c35b62700 1 -- 172.21.2.105:0/2486404098 shutdown_connections 2021-11-12T05:48:20.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.212+0000 7f6c35b62700 1 -- 172.21.2.105:0/2486404098 wait complete. 2021-11-12T05:48:20.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.212+0000 7f6c35b62700 1 Processor -- start 2021-11-12T05:48:20.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.212+0000 7f6c35b62700 1 -- start start 2021-11-12T05:48:20.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.212+0000 7f6c35b62700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6c30064900 0x7f6c300b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:20.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.212+0000 7f6c35b62700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6c300b7c80 0x7f6c30150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:20.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.212+0000 7f6c35b62700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6c30140f90 0x7f6c3013e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:20.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.212+0000 7f6c35b62700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c30150b10 con 0x7f6c30140f90 2021-11-12T05:48:20.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.212+0000 7f6c35b62700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c30150d30 con 0x7f6c300b7c80 2021-11-12T05:48:20.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.212+0000 7f6c35b62700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c30150fd0 con 0x7f6c30064900 2021-11-12T05:48:20.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.212+0000 7f6c2ffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6c30140f90 0x7f6c3013e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:20.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.212+0000 7f6c2ffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6c30140f90 0x7f6c3013e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50220/0 (socket says 172.21.2.105:50220) 2021-11-12T05:48:20.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.212+0000 7f6c2ffff700 1 -- 172.21.2.105:0/1141384124 learned_addr learned my addr 172.21.2.105:0/1141384124 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:20.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.212+0000 7f6c2ffff700 1 -- 172.21.2.105:0/1141384124 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6c30064900 msgr2=0x7f6c300b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:20.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.212+0000 7f6c2ffff700 1 --2- 172.21.2.105:0/1141384124 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6c30064900 0x7f6c300b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:20.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.212+0000 7f6c2ffff700 1 -- 172.21.2.105:0/1141384124 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6c300b7c80 msgr2=0x7f6c30150620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:20.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.212+0000 7f6c2ffff700 1 --2- 172.21.2.105:0/1141384124 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6c300b7c80 0x7f6c30150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:20.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.212+0000 7f6c2ffff700 1 -- 172.21.2.105:0/1141384124 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c1800b180 con 0x7f6c30140f90 2021-11-12T05:48:20.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.212+0000 7f6c2ffff700 1 --2- 172.21.2.105:0/1141384124 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6c30140f90 0x7f6c3013e370 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7f6c28003270 tx=0x7f6c280090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:20.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.212+0000 7f6c2cff9700 1 -- 172.21.2.105:0/1141384124 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c2800d4a0 con 0x7f6c30140f90 2021-11-12T05:48:20.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.212+0000 7f6c2cff9700 1 -- 172.21.2.105:0/1141384124 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2800d600 con 0x7f6c30140f90 2021-11-12T05:48:20.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.212+0000 7f6c35b62700 1 -- 172.21.2.105:0/1141384124 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c30151270 con 0x7f6c30140f90 2021-11-12T05:48:20.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.212+0000 7f6c2cff9700 1 -- 172.21.2.105:0/1141384124 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c2800d960 con 0x7f6c30140f90 2021-11-12T05:48:20.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.212+0000 7f6c35b62700 1 -- 172.21.2.105:0/1141384124 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c3013ea80 con 0x7f6c30140f90 2021-11-12T05:48:20.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.212+0000 7f6c35b62700 1 -- 172.21.2.105:0/1141384124 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c30067ae0 con 0x7f6c30140f90 2021-11-12T05:48:20.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.212+0000 7f6c2cff9700 1 -- 172.21.2.105:0/1141384124 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6c28018030 con 0x7f6c30140f90 2021-11-12T05:48:20.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.212+0000 7f6c2cff9700 1 --2- 172.21.2.105:0/1141384124 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6c140535b0 0x7f6c14055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:20.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.212+0000 7f6c2cff9700 1 -- 172.21.2.105:0/1141384124 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f6c2806af40 con 0x7f6c30140f90 2021-11-12T05:48:20.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.212+0000 7f6c2f7fe700 1 --2- 172.21.2.105:0/1141384124 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6c140535b0 0x7f6c14055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:20.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.212+0000 7f6c2f7fe700 1 --2- 172.21.2.105:0/1141384124 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6c140535b0 0x7f6c14055a70 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f6c18002f70 tx=0x7f6c18014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:20.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.216+0000 7f6c2cff9700 1 -- 172.21.2.105:0/1141384124 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6c280422d0 con 0x7f6c30140f90 2021-11-12T05:48:20.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.304+0000 7f6c35b62700 1 -- 172.21.2.105:0/1141384124 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f6c30057350 con 0x7f6c30140f90 2021-11-12T05:48:20.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.308+0000 7f6c2cff9700 1 -- 172.21.2.105:0/1141384124 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6c280458f0 con 0x7f6c30140f90 2021-11-12T05:48:20.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.308+0000 7f6c35b62700 1 -- 172.21.2.105:0/1141384124 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6c140535b0 msgr2=0x7f6c14055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:20.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.308+0000 7f6c35b62700 1 --2- 172.21.2.105:0/1141384124 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6c140535b0 0x7f6c14055a70 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f6c18002f70 tx=0x7f6c18014000).stop 2021-11-12T05:48:20.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.308+0000 7f6c35b62700 1 -- 172.21.2.105:0/1141384124 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6c30140f90 msgr2=0x7f6c3013e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:20.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.308+0000 7f6c35b62700 1 --2- 172.21.2.105:0/1141384124 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6c30140f90 0x7f6c3013e370 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7f6c28003270 tx=0x7f6c280090f0).stop 2021-11-12T05:48:20.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.308+0000 7f6c35b62700 1 -- 172.21.2.105:0/1141384124 shutdown_connections 2021-11-12T05:48:20.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.308+0000 7f6c35b62700 1 --2- 172.21.2.105:0/1141384124 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6c140535b0 0x7f6c14055a70 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:20.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.308+0000 7f6c35b62700 1 --2- 172.21.2.105:0/1141384124 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6c30140f90 0x7f6c3013e370 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:20.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.308+0000 7f6c35b62700 1 --2- 172.21.2.105:0/1141384124 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6c300b7c80 0x7f6c30150620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:20.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.308+0000 7f6c35b62700 1 --2- 172.21.2.105:0/1141384124 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6c30064900 0x7f6c300b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:20.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.308+0000 7f6c35b62700 1 -- 172.21.2.105:0/1141384124 >> 172.21.2.105:0/1141384124 conn(0x7f6c3005c860 msgr2=0x7f6c300654e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:20.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.308+0000 7f6c35b62700 1 -- 172.21.2.105:0/1141384124 shutdown_connections 2021-11-12T05:48:20.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.308+0000 7f6c35b62700 1 -- 172.21.2.105:0/1141384124 wait complete. 2021-11-12T05:48:20.321 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_filtered_df' 2021-11-12T05:48:20.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbef3c8700 1 Processor -- start 2021-11-12T05:48:20.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbef3c8700 1 -- start start 2021-11-12T05:48:20.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbef3c8700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbe80af750 0x7fcbe8062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:20.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbef3c8700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbe80b0d50 con 0x7fcbe8130a80 2021-11-12T05:48:20.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbef3c8700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbe80ad380 con 0x7fcbe80626b0 2021-11-12T05:48:20.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbef3c8700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe80ae190 con 0x7fcbe80af750 2021-11-12T05:48:20.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbed965700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fcbe8130a80 0x7fcbe81474d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60628/0 (socket says 172.21.2.105:60628) 2021-11-12T05:48:20.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbed965700 1 -- 172.21.2.105:0/358009250 learned_addr learned my addr 172.21.2.105:0/358009250 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:20.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbec963700 1 --2- 172.21.2.105:0/358009250 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbe80af750 0x7fcbe8062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:20.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbdbfff700 1 -- 172.21.2.105:0/358009250 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2871360969 0 0) 0x7fcbe80b0d50 con 0x7fcbe8130a80 2021-11-12T05:48:20.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbdbfff700 1 -- 172.21.2.105:0/358009250 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbd0003260 con 0x7fcbe8130a80 2021-11-12T05:48:20.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbdbfff700 1 -- 172.21.2.105:0/358009250 <== mon.1 v1:172.21.2.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3567153913 0 0) 0x7fcbe80ad380 con 0x7fcbe80626b0 2021-11-12T05:48:20.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbdbfff700 1 -- 172.21.2.105:0/358009250 --> v1:172.21.2.115:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbe80b0d50 con 0x7fcbe80626b0 2021-11-12T05:48:20.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbdbfff700 1 -- 172.21.2.105:0/358009250 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 742640301 0 0) 0x7fcbd0003260 con 0x7fcbe8130a80 2021-11-12T05:48:20.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbdbfff700 1 -- 172.21.2.105:0/358009250 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbe80af750 msgr2=0x7fcbe8062a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:20.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbdbfff700 1 --2- 172.21.2.105:0/358009250 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbe80af750 0x7fcbe8062a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:20.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbdbfff700 1 -- 172.21.2.105:0/358009250 >> v1:172.21.2.115:6789/0 conn(0x7fcbe80626b0 legacy=0x7fcbe8130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:20.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbdbfff700 1 -- 172.21.2.105:0/358009250 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe80ae2d0 con 0x7fcbe8130a80 2021-11-12T05:48:20.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbdbfff700 1 -- 172.21.2.105:0/358009250 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fcbe00019e0 con 0x7fcbe8130a80 2021-11-12T05:48:20.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbdbfff700 1 -- 172.21.2.105:0/358009250 >> v1:172.21.2.105:6789/0 conn(0x7fcbe8130a80 legacy=0x7fcbe81474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:20.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbdbfff700 1 --2- 172.21.2.105:0/358009250 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbd0003910 0x7fcbd0003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:20.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbdbfff700 1 --2- 172.21.2.105:0/358009250 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbe80af750 0x7fcbd0004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:20.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbdbfff700 1 --2- 172.21.2.105:0/358009250 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcbd00049f0 0x7fcbd0004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:20.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbdbfff700 1 -- 172.21.2.105:0/358009250 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe80ae190 con 0x7fcbd0003910 2021-11-12T05:48:20.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbdbfff700 1 -- 172.21.2.105:0/358009250 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd000b750 con 0x7fcbd00049f0 2021-11-12T05:48:20.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbdbfff700 1 -- 172.21.2.105:0/358009250 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd000b910 con 0x7fcbe80af750 2021-11-12T05:48:20.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbed164700 1 --2- 172.21.2.105:0/358009250 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbd0003910 0x7fcbd0003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:20.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbec963700 1 --2- 172.21.2.105:0/358009250 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbe80af750 0x7fcbd0004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:20.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbed164700 1 -- 172.21.2.105:0/358009250 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbe80af750 msgr2=0x7fcbd0004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:20.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbed164700 1 --2- 172.21.2.105:0/358009250 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbe80af750 0x7fcbd0004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:20.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbed164700 1 -- 172.21.2.105:0/358009250 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcbd00049f0 msgr2=0x7fcbd0004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:20.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbed965700 1 --2- 172.21.2.105:0/358009250 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcbd00049f0 0x7fcbd0004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:20.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbed164700 1 --2- 172.21.2.105:0/358009250 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcbd00049f0 0x7fcbd0004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:20.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbed164700 1 -- 172.21.2.105:0/358009250 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd0003260 con 0x7fcbd0003910 2021-11-12T05:48:20.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbed965700 1 --2- 172.21.2.105:0/358009250 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcbd00049f0 0x7fcbd0004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:48:20.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbed164700 1 --2- 172.21.2.105:0/358009250 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbd0003910 0x7fcbd0003cf0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 rx=0x7fcbe4001110 tx=0x7fcbe4007a00).ready entity=mon.0 client_cookie=9e690cc40be8ac56 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:20.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbdbfff700 1 -- 172.21.2.105:0/358009250 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbe4007d10 con 0x7fcbd0003910 2021-11-12T05:48:20.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbdbfff700 1 -- 172.21.2.105:0/358009250 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe4007030 con 0x7fcbd0003910 2021-11-12T05:48:20.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbdbfff700 1 -- 172.21.2.105:0/358009250 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbe4007390 con 0x7fcbd0003910 2021-11-12T05:48:20.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbef3c8700 1 -- 172.21.2.105:0/358009250 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbd0003910 msgr2=0x7fcbd0003cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:20.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbef3c8700 1 --2- 172.21.2.105:0/358009250 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbd0003910 0x7fcbd0003cf0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 rx=0x7fcbe4001110 tx=0x7fcbe4007a00).stop 2021-11-12T05:48:20.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbed965700 1 -- 172.21.2.105:0/358009250 reap_dead start 2021-11-12T05:48:20.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbef3c8700 1 -- 172.21.2.105:0/358009250 shutdown_connections 2021-11-12T05:48:20.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbef3c8700 1 -- 172.21.2.105:0/358009250 >> 172.21.2.105:0/358009250 conn(0x7fcbe80b5320 msgr2=0x7fcbe80b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:20.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbef3c8700 1 -- 172.21.2.105:0/358009250 shutdown_connections 2021-11-12T05:48:20.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbef3c8700 1 -- 172.21.2.105:0/358009250 wait complete. 2021-11-12T05:48:20.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbef3c8700 1 Processor -- start 2021-11-12T05:48:20.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.368+0000 7fcbef3c8700 1 -- start start 2021-11-12T05:48:20.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.372+0000 7fcbef3c8700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbd0003910 0x7fcbe812c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:20.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.372+0000 7fcbef3c8700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbe805fbd0 0x7fcbe814e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:20.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.372+0000 7fcbef3c8700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcbe8144820 0x7fcbe8144ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:20.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.372+0000 7fcbef3c8700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe812cfa0 con 0x7fcbe805fbd0 2021-11-12T05:48:20.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.372+0000 7fcbef3c8700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe812fe00 con 0x7fcbe8144820 2021-11-12T05:48:20.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.372+0000 7fcbef3c8700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe80603f0 con 0x7fcbd0003910 2021-11-12T05:48:20.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.372+0000 7fcbec963700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbe805fbd0 0x7fcbe814e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:20.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.372+0000 7fcbec963700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbe805fbd0 0x7fcbe814e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50242/0 (socket says 172.21.2.105:50242) 2021-11-12T05:48:20.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.372+0000 7fcbec963700 1 -- 172.21.2.105:0/298498044 learned_addr learned my addr 172.21.2.105:0/298498044 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:20.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.372+0000 7fcbed164700 1 --2- 172.21.2.105:0/298498044 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbd0003910 0x7fcbe812c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:20.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.372+0000 7fcbed965700 1 --2- 172.21.2.105:0/298498044 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcbe8144820 0x7fcbe8144ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:20.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.372+0000 7fcbec963700 1 -- 172.21.2.105:0/298498044 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbd0003910 msgr2=0x7fcbe812c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:20.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.372+0000 7fcbec963700 1 --2- 172.21.2.105:0/298498044 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbd0003910 0x7fcbe812c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:20.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.372+0000 7fcbec963700 1 -- 172.21.2.105:0/298498044 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcbe8144820 msgr2=0x7fcbe8144ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:20.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.372+0000 7fcbec963700 1 --2- 172.21.2.105:0/298498044 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcbe8144820 0x7fcbe8144ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:20.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.372+0000 7fcbec963700 1 -- 172.21.2.105:0/298498044 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe812be90 con 0x7fcbe805fbd0 2021-11-12T05:48:20.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.372+0000 7fcbec963700 1 --2- 172.21.2.105:0/298498044 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbe805fbd0 0x7fcbe814e1a0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7fcbe812b880 tx=0x7fcbdc006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:20.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.372+0000 7fcbda7fc700 1 -- 172.21.2.105:0/298498044 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbdc00f8e0 con 0x7fcbe805fbd0 2021-11-12T05:48:20.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.372+0000 7fcbda7fc700 1 -- 172.21.2.105:0/298498044 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbdc00fa40 con 0x7fcbe805fbd0 2021-11-12T05:48:20.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.372+0000 7fcbef3c8700 1 -- 172.21.2.105:0/298498044 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbe812c130 con 0x7fcbe805fbd0 2021-11-12T05:48:20.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.372+0000 7fcbda7fc700 1 -- 172.21.2.105:0/298498044 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbdc00fda0 con 0x7fcbe805fbd0 2021-11-12T05:48:20.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.372+0000 7fcbef3c8700 1 -- 172.21.2.105:0/298498044 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbe805f7d0 con 0x7fcbe805fbd0 2021-11-12T05:48:20.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.372+0000 7fcbef3c8700 1 -- 172.21.2.105:0/298498044 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbe8062a90 con 0x7fcbe805fbd0 2021-11-12T05:48:20.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.372+0000 7fcbda7fc700 1 -- 172.21.2.105:0/298498044 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcbdc01e460 con 0x7fcbe805fbd0 2021-11-12T05:48:20.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.372+0000 7fcbda7fc700 1 --2- 172.21.2.105:0/298498044 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcbc8053660 0x7fcbc8055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:20.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.372+0000 7fcbda7fc700 1 -- 172.21.2.105:0/298498044 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fcbdc06c2b0 con 0x7fcbe805fbd0 2021-11-12T05:48:20.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.372+0000 7fcbed164700 1 --2- 172.21.2.105:0/298498044 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcbc8053660 0x7fcbc8055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:20.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.372+0000 7fcbed164700 1 --2- 172.21.2.105:0/298498044 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcbc8053660 0x7fcbc8055b20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7fcbe4018000 tx=0x7fcbe4015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:20.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.376+0000 7fcbda7fc700 1 -- 172.21.2.105:0/298498044 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcbdc043530 con 0x7fcbe805fbd0 2021-11-12T05:48:20.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:20.488+0000 7fcbef3c8700 1 -- 172.21.2.105:0/298498044 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]} v 0) v1 -- 0x7fcbe8057350 con 0x7fcbe805fbd0 2021-11-12T05:48:21.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.152+0000 7fcbda7fc700 1 -- 172.21.2.105:0/298498044 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]}]=0 v330) v1 ==== 127+0+0 (secure 0 0 0) 0x7fcbdc046b50 con 0x7fcbe805fbd0 2021-11-12T05:48:21.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.152+0000 7fcbef3c8700 1 -- 172.21.2.105:0/298498044 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcbc8053660 msgr2=0x7fcbc8055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:21.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.152+0000 7fcbef3c8700 1 --2- 172.21.2.105:0/298498044 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcbc8053660 0x7fcbc8055b20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7fcbe4018000 tx=0x7fcbe4015000).stop 2021-11-12T05:48:21.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.152+0000 7fcbef3c8700 1 -- 172.21.2.105:0/298498044 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbe805fbd0 msgr2=0x7fcbe814e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:21.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.152+0000 7fcbef3c8700 1 --2- 172.21.2.105:0/298498044 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbe805fbd0 0x7fcbe814e1a0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7fcbe812b880 tx=0x7fcbdc006df0).stop 2021-11-12T05:48:21.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.152+0000 7fcbef3c8700 1 -- 172.21.2.105:0/298498044 shutdown_connections 2021-11-12T05:48:21.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.152+0000 7fcbef3c8700 1 --2- 172.21.2.105:0/298498044 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcbc8053660 0x7fcbc8055b20 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:21.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.152+0000 7fcbef3c8700 1 --2- 172.21.2.105:0/298498044 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcbe8144820 0x7fcbe8144ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:21.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.152+0000 7fcbef3c8700 1 --2- 172.21.2.105:0/298498044 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbe805fbd0 0x7fcbe814e1a0 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:21.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.152+0000 7fcbef3c8700 1 --2- 172.21.2.105:0/298498044 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbd0003910 0x7fcbe812c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:21.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.152+0000 7fcbef3c8700 1 -- 172.21.2.105:0/298498044 >> 172.21.2.105:0/298498044 conn(0x7fcbe80b5320 msgr2=0x7fcbe814caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:21.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.152+0000 7fcbef3c8700 1 -- 172.21.2.105:0/298498044 shutdown_connections 2021-11-12T05:48:21.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.152+0000 7fcbef3c8700 1 -- 172.21.2.105:0/298498044 wait complete. 2021-11-12T05:48:21.380 INFO:tasks.cephfs_test_runner:test_filtered_df (tasks.cephfs.test_misc.TestMisc) ... ok 2021-11-12T05:48:21.381 INFO:tasks.cephfs_test_runner:Starting test: test_fs_new (tasks.cephfs.test_misc.TestMisc) 2021-11-12T05:48:21.381 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_fs_new' 2021-11-12T05:48:21.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.436+0000 7f66e52d0700 1 Processor -- start 2021-11-12T05:48:21.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.436+0000 7f66e52d0700 1 -- start start 2021-11-12T05:48:21.444 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.436+0000 7f66e52d0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66e00b1d40 0x7f66e0067550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:21.445 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.436+0000 7f66e52d0700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f66e005c490 0x7f66e0149c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:21.445 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.436+0000 7f66e52d0700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66e0067a40 con 0x7f66e0060860 2021-11-12T05:48:21.445 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.436+0000 7f66e52d0700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66e00afec0 con 0x7f66e005c490 2021-11-12T05:48:21.445 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.436+0000 7f66e52d0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e00acf60 con 0x7f66e00b1d40 2021-11-12T05:48:21.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.436+0000 7f66dffff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f66e0060860 0x7f66e00ad6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60644/0 (socket says 172.21.2.105:60644) 2021-11-12T05:48:21.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.436+0000 7f66dffff700 1 -- 172.21.2.105:0/153627195 learned_addr learned my addr 172.21.2.105:0/153627195 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:21.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.436+0000 7f66deffd700 1 -- 172.21.2.105:0/153627195 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3268589290 0 0) 0x7f66e0067a40 con 0x7f66e0060860 2021-11-12T05:48:21.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.436+0000 7f66deffd700 1 -- 172.21.2.105:0/153627195 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66cc003260 con 0x7f66e0060860 2021-11-12T05:48:21.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.436+0000 7f66deffd700 1 -- 172.21.2.105:0/153627195 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3026972803 0 0) 0x7f66cc003260 con 0x7f66e0060860 2021-11-12T05:48:21.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.436+0000 7f66deffd700 1 -- 172.21.2.105:0/153627195 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66e00b1d40 msgr2=0x7f66e0067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:21.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.436+0000 7f66deffd700 1 --2- 172.21.2.105:0/153627195 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66e00b1d40 0x7f66e0067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:21.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.436+0000 7f66deffd700 1 -- 172.21.2.105:0/153627195 >> v2:172.21.2.115:3300/0 conn(0x7f66e005c490 msgr2=0x7f66e0149c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:21.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.436+0000 7f66deffd700 1 --2- 172.21.2.105:0/153627195 >> v2:172.21.2.115:3300/0 conn(0x7f66e005c490 0x7f66e0149c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:21.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.436+0000 7f66deffd700 1 -- 172.21.2.105:0/153627195 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e00ad200 con 0x7f66e0060860 2021-11-12T05:48:21.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.436+0000 7f66deffd700 1 -- 172.21.2.105:0/153627195 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f66d0001660 con 0x7f66e0060860 2021-11-12T05:48:21.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.436+0000 7f66deffd700 1 -- 172.21.2.105:0/153627195 >> v1:172.21.2.105:6789/0 conn(0x7f66e0060860 legacy=0x7f66e00ad6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:21.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.436+0000 7f66deffd700 1 --2- 172.21.2.105:0/153627195 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f66cc003750 0x7f66cc003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:21.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66deffd700 1 --2- 172.21.2.105:0/153627195 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66e00b1d40 0x7f66cc004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:21.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66deffd700 1 --2- 172.21.2.105:0/153627195 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66cc004b10 0x7f66cc004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:21.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66deffd700 1 -- 172.21.2.105:0/153627195 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e00afec0 con 0x7f66cc004b10 2021-11-12T05:48:21.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66deffd700 1 -- 172.21.2.105:0/153627195 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e00acf60 con 0x7f66cc003750 2021-11-12T05:48:21.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66deffd700 1 -- 172.21.2.105:0/153627195 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc00b990 con 0x7f66e00b1d40 2021-11-12T05:48:21.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66e4acf700 1 --2- 172.21.2.105:0/153627195 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66cc004b10 0x7f66cc004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:21.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66dffff700 1 --2- 172.21.2.105:0/153627195 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f66cc003750 0x7f66cc003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:21.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66df7fe700 1 --2- 172.21.2.105:0/153627195 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66e00b1d40 0x7f66cc004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:21.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66e4acf700 1 -- 172.21.2.105:0/153627195 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66e00b1d40 msgr2=0x7f66cc004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:21.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66e4acf700 1 --2- 172.21.2.105:0/153627195 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66e00b1d40 0x7f66cc004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:21.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66e4acf700 1 -- 172.21.2.105:0/153627195 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f66cc003750 msgr2=0x7f66cc003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:21.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66e4acf700 1 --2- 172.21.2.105:0/153627195 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f66cc003750 0x7f66cc003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:21.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66e4acf700 1 -- 172.21.2.105:0/153627195 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66cc003260 con 0x7f66cc004b10 2021-11-12T05:48:21.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66e4acf700 1 --2- 172.21.2.105:0/153627195 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66cc004b10 0x7f66cc004f90 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7f66d80032f0 tx=0x7f66d8006f90).ready entity=mon.0 client_cookie=257e7ee691814be3 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:21.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66deffd700 1 -- 172.21.2.105:0/153627195 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66d800b460 con 0x7f66cc004b10 2021-11-12T05:48:21.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66deffd700 1 -- 172.21.2.105:0/153627195 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d800b5c0 con 0x7f66cc004b10 2021-11-12T05:48:21.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66deffd700 1 -- 172.21.2.105:0/153627195 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66d800b730 con 0x7f66cc004b10 2021-11-12T05:48:21.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66e52d0700 1 -- 172.21.2.105:0/153627195 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66cc004b10 msgr2=0x7f66cc004f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:21.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66e52d0700 1 --2- 172.21.2.105:0/153627195 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66cc004b10 0x7f66cc004f90 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7f66d80032f0 tx=0x7f66d8006f90).stop 2021-11-12T05:48:21.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66e4acf700 1 -- 172.21.2.105:0/153627195 reap_dead start 2021-11-12T05:48:21.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66e52d0700 1 -- 172.21.2.105:0/153627195 shutdown_connections 2021-11-12T05:48:21.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66e52d0700 1 -- 172.21.2.105:0/153627195 >> 172.21.2.105:0/153627195 conn(0x7f66e00b6430 msgr2=0x7f66e00b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:21.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66e52d0700 1 -- 172.21.2.105:0/153627195 shutdown_connections 2021-11-12T05:48:21.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66e52d0700 1 -- 172.21.2.105:0/153627195 wait complete. 2021-11-12T05:48:21.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66e52d0700 1 Processor -- start 2021-11-12T05:48:21.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66e52d0700 1 -- start start 2021-11-12T05:48:21.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66e52d0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66cc004b10 0x7f66e013a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:21.458 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66e52d0700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f66e013acd0 0x7f66e013a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:21.458 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66e52d0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66e013b2e0 0x7f66e013b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:21.458 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66e52d0700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e013e2a0 con 0x7f66cc004b10 2021-11-12T05:48:21.458 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66e52d0700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e0066250 con 0x7f66e013acd0 2021-11-12T05:48:21.458 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66e52d0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e0134920 con 0x7f66e013b2e0 2021-11-12T05:48:21.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66dffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66cc004b10 0x7f66e013a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:21.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66dffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66cc004b10 0x7f66e013a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50262/0 (socket says 172.21.2.105:50262) 2021-11-12T05:48:21.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66dffff700 1 -- 172.21.2.105:0/3050047150 learned_addr learned my addr 172.21.2.105:0/3050047150 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:21.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66df7fe700 1 --2- 172.21.2.105:0/3050047150 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f66e013acd0 0x7f66e013a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:21.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66e4acf700 1 --2- 172.21.2.105:0/3050047150 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66e013b2e0 0x7f66e013b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:21.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66dffff700 1 -- 172.21.2.105:0/3050047150 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66e013b2e0 msgr2=0x7f66e013b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:21.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66dffff700 1 --2- 172.21.2.105:0/3050047150 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66e013b2e0 0x7f66e013b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:21.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66dffff700 1 -- 172.21.2.105:0/3050047150 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f66e013acd0 msgr2=0x7f66e013a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:21.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66dffff700 1 --2- 172.21.2.105:0/3050047150 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f66e013acd0 0x7f66e013a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:21.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66dffff700 1 -- 172.21.2.105:0/3050047150 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e013e720 con 0x7f66cc004b10 2021-11-12T05:48:21.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66dffff700 1 --2- 172.21.2.105:0/3050047150 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66cc004b10 0x7f66e013a1c0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7f66e013c460 tx=0x7f66e00ae840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:21.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66dd7fa700 1 -- 172.21.2.105:0/3050047150 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66d0015630 con 0x7f66cc004b10 2021-11-12T05:48:21.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66dd7fa700 1 -- 172.21.2.105:0/3050047150 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d0010040 con 0x7f66cc004b10 2021-11-12T05:48:21.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66e52d0700 1 -- 172.21.2.105:0/3050047150 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66e013e480 con 0x7f66cc004b10 2021-11-12T05:48:21.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66dd7fa700 1 -- 172.21.2.105:0/3050047150 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66d0015980 con 0x7f66cc004b10 2021-11-12T05:48:21.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.440+0000 7f66e52d0700 1 -- 172.21.2.105:0/3050047150 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e013bcd0 con 0x7f66cc004b10 2021-11-12T05:48:21.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.444+0000 7f66e52d0700 1 -- 172.21.2.105:0/3050047150 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66e00addb0 con 0x7f66cc004b10 2021-11-12T05:48:21.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.444+0000 7f66dd7fa700 1 -- 172.21.2.105:0/3050047150 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f66d00103c0 con 0x7f66cc004b10 2021-11-12T05:48:21.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.444+0000 7f66dd7fa700 1 --2- 172.21.2.105:0/3050047150 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f66c00536d0 0x7f66c0055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:21.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.444+0000 7f66dd7fa700 1 -- 172.21.2.105:0/3050047150 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f66d006b4e0 con 0x7f66cc004b10 2021-11-12T05:48:21.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.444+0000 7f66df7fe700 1 --2- 172.21.2.105:0/3050047150 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f66c00536d0 0x7f66c0055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:21.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.444+0000 7f66df7fe700 1 --2- 172.21.2.105:0/3050047150 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f66c00536d0 0x7f66c0055b90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f66d400c000 tx=0x7f66d4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:21.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.444+0000 7f66dd7fa700 1 -- 172.21.2.105:0/3050047150 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f66d0042650 con 0x7f66cc004b10 2021-11-12T05:48:21.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:21.556+0000 7f66e52d0700 1 -- 172.21.2.105:0/3050047150 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_fs_new"]} v 0) v1 -- 0x7f66e0057350 con 0x7f66cc004b10 2021-11-12T05:48:22.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.164+0000 7f66dd7fa700 1 -- 172.21.2.105:0/3050047150 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_fs_new"]}]=0 v331) v1 ==== 125+0+0 (secure 0 0 0) 0x7f66d0045c70 con 0x7f66cc004b10 2021-11-12T05:48:22.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.164+0000 7f66e52d0700 1 -- 172.21.2.105:0/3050047150 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f66c00536d0 msgr2=0x7f66c0055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:22.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.164+0000 7f66e52d0700 1 --2- 172.21.2.105:0/3050047150 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f66c00536d0 0x7f66c0055b90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f66d400c000 tx=0x7f66d4008040).stop 2021-11-12T05:48:22.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.164+0000 7f66e52d0700 1 -- 172.21.2.105:0/3050047150 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66cc004b10 msgr2=0x7f66e013a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:22.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.164+0000 7f66e52d0700 1 --2- 172.21.2.105:0/3050047150 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66cc004b10 0x7f66e013a1c0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7f66e013c460 tx=0x7f66e00ae840).stop 2021-11-12T05:48:22.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.164+0000 7f66e52d0700 1 -- 172.21.2.105:0/3050047150 shutdown_connections 2021-11-12T05:48:22.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.164+0000 7f66e52d0700 1 --2- 172.21.2.105:0/3050047150 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f66c00536d0 0x7f66c0055b90 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:22.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.164+0000 7f66e52d0700 1 --2- 172.21.2.105:0/3050047150 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66e013b2e0 0x7f66e013b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:22.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.164+0000 7f66e52d0700 1 --2- 172.21.2.105:0/3050047150 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f66e013acd0 0x7f66e013a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:22.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.164+0000 7f66e52d0700 1 --2- 172.21.2.105:0/3050047150 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66cc004b10 0x7f66e013a1c0 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:22.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.164+0000 7f66e52d0700 1 -- 172.21.2.105:0/3050047150 >> 172.21.2.105:0/3050047150 conn(0x7f66e00b6430 msgr2=0x7f66e0134fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:22.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.164+0000 7f66e52d0700 1 -- 172.21.2.105:0/3050047150 shutdown_connections 2021-11-12T05:48:22.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.164+0000 7f66e52d0700 1 -- 172.21.2.105:0/3050047150 wait complete. 2021-11-12T05:48:22.176 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-11-12T05:48:22.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.228+0000 7f513642a700 1 Processor -- start 2021-11-12T05:48:22.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.228+0000 7f513642a700 1 -- start start 2021-11-12T05:48:22.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f513642a700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f51300ace20 0x7f51300b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:22.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f513642a700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51300b1840 con 0x7f5130144180 2021-11-12T05:48:22.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f513642a700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51300af2b0 con 0x7f51300aca40 2021-11-12T05:48:22.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f513642a700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51300b0a10 con 0x7f51300ace20 2021-11-12T05:48:22.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f51349c7700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f5130144180 0x7f51301445f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60666/0 (socket says 172.21.2.105:60666) 2021-11-12T05:48:22.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f51349c7700 1 -- 172.21.2.105:0/4113655436 learned_addr learned my addr 172.21.2.105:0/4113655436 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:22.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f512f7fe700 1 --2- 172.21.2.105:0/4113655436 >> v2:172.21.2.105:3300/0 conn(0x7f51300ace20 0x7f51300b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:22.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f512effd700 1 -- 172.21.2.105:0/4113655436 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1220889909 0 0) 0x7f51300b1840 con 0x7f5130144180 2021-11-12T05:48:22.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f512effd700 1 -- 172.21.2.105:0/4113655436 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5110003260 con 0x7f5130144180 2021-11-12T05:48:22.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f512f7fe700 1 -- 172.21.2.105:0/4113655436 >> v1:172.21.2.115:6789/0 conn(0x7f51300aca40 legacy=0x7f51301473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:22.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f512f7fe700 1 -- 172.21.2.105:0/4113655436 >> v1:172.21.2.105:6789/0 conn(0x7f5130144180 legacy=0x7f51301445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:22.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f512f7fe700 1 -- 172.21.2.105:0/4113655436 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51300b1a70 con 0x7f51300ace20 2021-11-12T05:48:22.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f512f7fe700 1 --2- 172.21.2.105:0/4113655436 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f51300ace20 0x7f51300b0520 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 rx=0x7f5128001490 tx=0x7f5120006df0).ready entity=mon.0 client_cookie=a6a4ba1f76dea3bb server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:22.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f512effd700 1 -- 172.21.2.105:0/4113655436 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f512000d570 con 0x7f51300ace20 2021-11-12T05:48:22.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f512effd700 1 -- 172.21.2.105:0/4113655436 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5120000e90 con 0x7f51300ace20 2021-11-12T05:48:22.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f512effd700 1 -- 172.21.2.105:0/4113655436 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f512000d8c0 con 0x7f51300ace20 2021-11-12T05:48:22.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f513642a700 1 -- 172.21.2.105:0/4113655436 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f51300ace20 msgr2=0x7f51300b0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:22.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f513642a700 1 --2- 172.21.2.105:0/4113655436 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f51300ace20 0x7f51300b0520 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 rx=0x7f5128001490 tx=0x7f5120006df0).stop 2021-11-12T05:48:22.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f513642a700 1 -- 172.21.2.105:0/4113655436 shutdown_connections 2021-11-12T05:48:22.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f513642a700 1 --2- 172.21.2.105:0/4113655436 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f51300ace20 0x7f51300b0520 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:22.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f513642a700 1 -- 172.21.2.105:0/4113655436 >> 172.21.2.105:0/4113655436 conn(0x7f513005c490 msgr2=0x7f51300b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:22.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f513642a700 1 -- 172.21.2.105:0/4113655436 shutdown_connections 2021-11-12T05:48:22.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f513642a700 1 -- 172.21.2.105:0/4113655436 wait complete. 2021-11-12T05:48:22.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f513642a700 1 Processor -- start 2021-11-12T05:48:22.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f513642a700 1 -- start start 2021-11-12T05:48:22.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f513642a700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f51300aca40 0x7f5130156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:22.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f513642a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f51300ace20 0x7f5130067170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:22.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f513642a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5130144180 0x7f5130062be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:22.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f513642a700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51300655a0 con 0x7f5130144180 2021-11-12T05:48:22.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f513642a700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5130066790 con 0x7f51300aca40 2021-11-12T05:48:22.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f513642a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5130066a30 con 0x7f51300ace20 2021-11-12T05:48:22.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f51349c7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5130144180 0x7f5130062be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:22.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f51349c7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5130144180 0x7f5130062be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50276/0 (socket says 172.21.2.105:50276) 2021-11-12T05:48:22.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f51349c7700 1 -- 172.21.2.105:0/1780033382 learned_addr learned my addr 172.21.2.105:0/1780033382 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:22.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f51349c7700 1 -- 172.21.2.105:0/1780033382 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f51300ace20 msgr2=0x7f5130067170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:22.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f51349c7700 1 --2- 172.21.2.105:0/1780033382 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f51300ace20 0x7f5130067170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:22.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f51349c7700 1 -- 172.21.2.105:0/1780033382 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f51300aca40 msgr2=0x7f5130156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:22.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f51349c7700 1 --2- 172.21.2.105:0/1780033382 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f51300aca40 0x7f5130156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:22.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f51349c7700 1 -- 172.21.2.105:0/1780033382 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f512000b180 con 0x7f5130144180 2021-11-12T05:48:22.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f51349c7700 1 --2- 172.21.2.105:0/1780033382 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5130144180 0x7f5130062be0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 rx=0x7f5128000f40 tx=0x7f5128007ea0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:22.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f512d7fa700 1 -- 172.21.2.105:0/1780033382 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5128005ba0 con 0x7f5130144180 2021-11-12T05:48:22.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f512d7fa700 1 -- 172.21.2.105:0/1780033382 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5128005d00 con 0x7f5130144180 2021-11-12T05:48:22.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f512d7fa700 1 -- 172.21.2.105:0/1780033382 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51280072c0 con 0x7f5130144180 2021-11-12T05:48:22.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f513642a700 1 -- 172.21.2.105:0/1780033382 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5130066cd0 con 0x7f5130144180 2021-11-12T05:48:22.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.232+0000 7f513642a700 1 -- 172.21.2.105:0/1780033382 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51300662f0 con 0x7f5130144180 2021-11-12T05:48:22.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.236+0000 7f513642a700 1 -- 172.21.2.105:0/1780033382 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5130066e60 con 0x7f5130144180 2021-11-12T05:48:22.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.236+0000 7f512d7fa700 1 -- 172.21.2.105:0/1780033382 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5128010070 con 0x7f5130144180 2021-11-12T05:48:22.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.236+0000 7f512d7fa700 1 --2- 172.21.2.105:0/1780033382 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f51140535b0 0x7f5114055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:22.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.236+0000 7f512d7fa700 1 -- 172.21.2.105:0/1780033382 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f512806b2e0 con 0x7f5130144180 2021-11-12T05:48:22.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.236+0000 7f512ffff700 1 --2- 172.21.2.105:0/1780033382 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f51140535b0 0x7f5114055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:22.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.236+0000 7f512ffff700 1 --2- 172.21.2.105:0/1780033382 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f51140535b0 0x7f5114055a70 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f5118002f90 tx=0x7f51180069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:22.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.236+0000 7f512d7fa700 1 -- 172.21.2.105:0/1780033382 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f51280424b0 con 0x7f5130144180 2021-11-12T05:48:22.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.320+0000 7f513642a700 1 -- 172.21.2.105:0/1780033382 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f5130066570 con 0x7f5130144180 2021-11-12T05:48:22.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.324+0000 7f512d7fa700 1 -- 172.21.2.105:0/1780033382 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5128045ad0 con 0x7f5130144180 2021-11-12T05:48:22.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.324+0000 7f513642a700 1 -- 172.21.2.105:0/1780033382 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f51140535b0 msgr2=0x7f5114055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:22.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.324+0000 7f513642a700 1 --2- 172.21.2.105:0/1780033382 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f51140535b0 0x7f5114055a70 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f5118002f90 tx=0x7f51180069b0).stop 2021-11-12T05:48:22.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.324+0000 7f513642a700 1 -- 172.21.2.105:0/1780033382 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5130144180 msgr2=0x7f5130062be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:22.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.324+0000 7f513642a700 1 --2- 172.21.2.105:0/1780033382 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5130144180 0x7f5130062be0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 rx=0x7f5128000f40 tx=0x7f5128007ea0).stop 2021-11-12T05:48:22.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.328+0000 7f513642a700 1 -- 172.21.2.105:0/1780033382 shutdown_connections 2021-11-12T05:48:22.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.328+0000 7f513642a700 1 --2- 172.21.2.105:0/1780033382 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f51140535b0 0x7f5114055a70 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:22.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.328+0000 7f513642a700 1 --2- 172.21.2.105:0/1780033382 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5130144180 0x7f5130062be0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:22.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.328+0000 7f513642a700 1 --2- 172.21.2.105:0/1780033382 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f51300ace20 0x7f5130067170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:22.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.328+0000 7f513642a700 1 --2- 172.21.2.105:0/1780033382 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f51300aca40 0x7f5130156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:22.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.328+0000 7f513642a700 1 -- 172.21.2.105:0/1780033382 >> 172.21.2.105:0/1780033382 conn(0x7f513005c490 msgr2=0x7f5130141400 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:22.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.328+0000 7f513642a700 1 -- 172.21.2.105:0/1780033382 shutdown_connections 2021-11-12T05:48:22.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.328+0000 7f513642a700 1 -- 172.21.2.105:0/1780033382 wait complete. 2021-11-12T05:48:22.337 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-12T05:48:22.337 DEBUG:teuthology.orchestra.run.gibba005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:48:22.345 DEBUG:teuthology.orchestra.run.gibba015:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:48:22.354 DEBUG:teuthology.orchestra.run.gibba016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:48:22.367 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:48:22.380 DEBUG:teuthology.orchestra.run.gibba044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:48:22.394 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-12T05:48:22.394 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:22.395 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:48:22.395 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:48:22.415 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:48:22.416 INFO:teuthology.orchestra.run.gibba016.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-12T05:48:22.417 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-11-12T05:48:22.417 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:22.418 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:48:22.418 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:48:22.427 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:48:22.428 INFO:teuthology.orchestra.run.gibba038.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-12T05:48:22.428 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-12T05:48:22.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:22.429 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:48:22.430 DEBUG:teuthology.orchestra.run.gibba044:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:48:22.440 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:48:22.441 INFO:teuthology.orchestra.run.gibba044.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-12T05:48:22.441 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-12T05:48:22.442 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-12T05:48:22.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.508+0000 7f3b29311700 1 Processor -- start 2021-11-12T05:48:22.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.508+0000 7f3b29311700 1 -- start start 2021-11-12T05:48:22.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.508+0000 7f3b29311700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f3b240b6380 0x7f3b240b6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:22.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.508+0000 7f3b29311700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f3b24142900 0x7f3b2413f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:22.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.508+0000 7f3b29311700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b2413fab0 con 0x7f3b241390a0 2021-11-12T05:48:22.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.508+0000 7f3b29311700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b240afeb0 con 0x7f3b24142900 2021-11-12T05:48:22.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.508+0000 7f3b29311700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b2413fd50 con 0x7f3b240b6380 2021-11-12T05:48:22.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.508+0000 7f3b237fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f3b241390a0 0x7f3b2405f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60680/0 (socket says 172.21.2.105:60680) 2021-11-12T05:48:22.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.508+0000 7f3b227fc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f3b24142900 0x7f3b2413f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:22.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.508+0000 7f3b237fe700 1 -- 172.21.2.105:0/2598686053 learned_addr learned my addr 172.21.2.105:0/2598686053 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:22.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.508+0000 7f3b227fc700 1 -- 172.21.2.105:0/2598686053 >> v2:172.21.2.115:3300/0 conn(0x7f3b240b6380 msgr2=0x7f3b240b6760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:48:22.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.508+0000 7f3b227fc700 1 --2- 172.21.2.105:0/2598686053 >> v2:172.21.2.115:3300/0 conn(0x7f3b240b6380 0x7f3b240b6760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:22.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.508+0000 7f3b21ffb700 1 -- 172.21.2.105:0/2598686053 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3590466441 0 0) 0x7f3b2413fab0 con 0x7f3b241390a0 2021-11-12T05:48:22.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.508+0000 7f3b227fc700 1 -- 172.21.2.105:0/2598686053 >> v1:172.21.2.105:6789/0 conn(0x7f3b241390a0 legacy=0x7f3b2405f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:22.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.512+0000 7f3b227fc700 1 -- 172.21.2.105:0/2598686053 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2413fff0 con 0x7f3b24142900 2021-11-12T05:48:22.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.512+0000 7f3b227fc700 1 --2- 172.21.2.105:0/2598686053 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3b24142900 0x7f3b2413f300 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7f3b0c002f70 tx=0x7f3b0c006e80).ready entity=mon.0 client_cookie=3696623dbbbedb37 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:22.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.512+0000 7f3b21ffb700 1 -- 172.21.2.105:0/2598686053 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b0c014070 con 0x7f3b24142900 2021-11-12T05:48:22.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.512+0000 7f3b21ffb700 1 -- 172.21.2.105:0/2598686053 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0c000e90 con 0x7f3b24142900 2021-11-12T05:48:22.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.512+0000 7f3b21ffb700 1 -- 172.21.2.105:0/2598686053 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b0c00a860 con 0x7f3b24142900 2021-11-12T05:48:22.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.512+0000 7f3b29311700 1 -- 172.21.2.105:0/2598686053 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3b24142900 msgr2=0x7f3b2413f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:22.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.512+0000 7f3b29311700 1 --2- 172.21.2.105:0/2598686053 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3b24142900 0x7f3b2413f300 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7f3b0c002f70 tx=0x7f3b0c006e80).stop 2021-11-12T05:48:22.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.512+0000 7f3b29311700 1 -- 172.21.2.105:0/2598686053 shutdown_connections 2021-11-12T05:48:22.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.512+0000 7f3b29311700 1 --2- 172.21.2.105:0/2598686053 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3b24142900 0x7f3b2413f300 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:22.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.512+0000 7f3b29311700 1 --2- 172.21.2.105:0/2598686053 >> v2:172.21.2.115:3300/0 conn(0x7f3b240b6380 0x7f3b240b6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:22.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.512+0000 7f3b29311700 1 -- 172.21.2.105:0/2598686053 >> 172.21.2.105:0/2598686053 conn(0x7f3b24063810 msgr2=0x7f3b240b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:22.526 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.512+0000 7f3b29311700 1 -- 172.21.2.105:0/2598686053 shutdown_connections 2021-11-12T05:48:22.526 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.512+0000 7f3b29311700 1 -- 172.21.2.105:0/2598686053 wait complete. 2021-11-12T05:48:22.526 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.512+0000 7f3b29311700 1 Processor -- start 2021-11-12T05:48:22.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.512+0000 7f3b29311700 1 -- start start 2021-11-12T05:48:22.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.512+0000 7f3b29311700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3b240b6380 0x7f3b240b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:22.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.512+0000 7f3b29311700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3b241390a0 0x7f3b24066ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:22.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.512+0000 7f3b29311700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3b24142900 0x7f3b24063c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:22.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.512+0000 7f3b29311700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b24139fe0 con 0x7f3b241390a0 2021-11-12T05:48:22.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.512+0000 7f3b29311700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b24066250 con 0x7f3b24142900 2021-11-12T05:48:22.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.512+0000 7f3b29311700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b240664f0 con 0x7f3b240b6380 2021-11-12T05:48:22.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.512+0000 7f3b227fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3b241390a0 0x7f3b24066ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:22.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.512+0000 7f3b227fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3b241390a0 0x7f3b24066ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50288/0 (socket says 172.21.2.105:50288) 2021-11-12T05:48:22.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.512+0000 7f3b227fc700 1 -- 172.21.2.105:0/2729707359 learned_addr learned my addr 172.21.2.105:0/2729707359 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:22.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.512+0000 7f3b227fc700 1 -- 172.21.2.105:0/2729707359 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3b240b6380 msgr2=0x7f3b240b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:22.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.512+0000 7f3b227fc700 1 --2- 172.21.2.105:0/2729707359 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3b240b6380 0x7f3b240b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:22.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.512+0000 7f3b227fc700 1 -- 172.21.2.105:0/2729707359 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3b24142900 msgr2=0x7f3b24063c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:22.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.512+0000 7f3b227fc700 1 --2- 172.21.2.105:0/2729707359 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3b24142900 0x7f3b24063c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:22.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.512+0000 7f3b227fc700 1 -- 172.21.2.105:0/2729707359 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b0c00c310 con 0x7f3b241390a0 2021-11-12T05:48:22.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.512+0000 7f3b227fc700 1 --2- 172.21.2.105:0/2729707359 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3b241390a0 0x7f3b24066ed0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 rx=0x7f3b0c002f70 tx=0x7f3b24140180).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:22.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.512+0000 7f3b1bfff700 1 -- 172.21.2.105:0/2729707359 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b0c010c80 con 0x7f3b241390a0 2021-11-12T05:48:22.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.512+0000 7f3b1bfff700 1 -- 172.21.2.105:0/2729707359 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0c010de0 con 0x7f3b241390a0 2021-11-12T05:48:22.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.512+0000 7f3b1bfff700 1 -- 172.21.2.105:0/2729707359 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b0c01d640 con 0x7f3b241390a0 2021-11-12T05:48:22.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.512+0000 7f3b29311700 1 -- 172.21.2.105:0/2729707359 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b24066790 con 0x7f3b241390a0 2021-11-12T05:48:22.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.512+0000 7f3b29311700 1 -- 172.21.2.105:0/2729707359 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b24129970 con 0x7f3b241390a0 2021-11-12T05:48:22.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.512+0000 7f3b29311700 1 -- 172.21.2.105:0/2729707359 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b2413f7f0 con 0x7f3b241390a0 2021-11-12T05:48:22.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.512+0000 7f3b1bfff700 1 -- 172.21.2.105:0/2729707359 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3b0c00e040 con 0x7f3b241390a0 2021-11-12T05:48:22.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.512+0000 7f3b1bfff700 1 --2- 172.21.2.105:0/2729707359 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3b08053610 0x7f3b08055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:22.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.516+0000 7f3b1bfff700 1 -- 172.21.2.105:0/2729707359 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f3b0c06e930 con 0x7f3b241390a0 2021-11-12T05:48:22.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.516+0000 7f3b22ffd700 1 --2- 172.21.2.105:0/2729707359 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3b08053610 0x7f3b08055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:22.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.516+0000 7f3b22ffd700 1 --2- 172.21.2.105:0/2729707359 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3b08053610 0x7f3b08055ad0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f3b14002fb0 tx=0x7f3b140069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:22.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.516+0000 7f3b1bfff700 1 -- 172.21.2.105:0/2729707359 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3b0c045c10 con 0x7f3b241390a0 2021-11-12T05:48:22.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.600+0000 7f3b29311700 1 -- 172.21.2.105:0/2729707359 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f3b24057350 con 0x7f3b241390a0 2021-11-12T05:48:22.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.600+0000 7f3b1bfff700 1 -- 172.21.2.105:0/2729707359 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v110) v1 ==== 81+0+29229 (secure 0 0 0) 0x7f3b0c049230 con 0x7f3b241390a0 2021-11-12T05:48:22.606 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:22.606 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:48:22.606 INFO:teuthology.orchestra.run.gibba005.stdout: "epoch": 110, 2021-11-12T05:48:22.606 INFO:teuthology.orchestra.run.gibba005.stdout: "fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", 2021-11-12T05:48:22.607 INFO:teuthology.orchestra.run.gibba005.stdout: "created": "2021-11-12T05:40:19.986390+0000", 2021-11-12T05:48:22.607 INFO:teuthology.orchestra.run.gibba005.stdout: "modified": "2021-11-12T05:48:20.143480+0000", 2021-11-12T05:48:22.607 INFO:teuthology.orchestra.run.gibba005.stdout: "last_up_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:48:22.607 INFO:teuthology.orchestra.run.gibba005.stdout: "last_in_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:48:22.607 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-12T05:48:22.608 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_num": 5799936, 2021-11-12T05:48:22.608 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_set": [ 2021-11-12T05:48:22.608 INFO:teuthology.orchestra.run.gibba005.stdout: "pglog_hardlimit", 2021-11-12T05:48:22.608 INFO:teuthology.orchestra.run.gibba005.stdout: "purged_snapdirs", 2021-11-12T05:48:22.608 INFO:teuthology.orchestra.run.gibba005.stdout: "recovery_deletes", 2021-11-12T05:48:22.609 INFO:teuthology.orchestra.run.gibba005.stdout: "sortbitwise" 2021-11-12T05:48:22.609 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:48:22.609 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_version": 5, 2021-11-12T05:48:22.609 INFO:teuthology.orchestra.run.gibba005.stdout: "full_ratio": 0.94999998807907104, 2021-11-12T05:48:22.610 INFO:teuthology.orchestra.run.gibba005.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-12T05:48:22.610 INFO:teuthology.orchestra.run.gibba005.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-12T05:48:22.610 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_snapshot": "", 2021-11-12T05:48:22.611 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_max": 20, 2021-11-12T05:48:22.611 INFO:teuthology.orchestra.run.gibba005.stdout: "max_osd": 8, 2021-11-12T05:48:22.611 INFO:teuthology.orchestra.run.gibba005.stdout: "require_min_compat_client": "jewel", 2021-11-12T05:48:22.611 INFO:teuthology.orchestra.run.gibba005.stdout: "min_compat_client": "jewel", 2021-11-12T05:48:22.612 INFO:teuthology.orchestra.run.gibba005.stdout: "require_osd_release": "octopus", 2021-11-12T05:48:22.612 INFO:teuthology.orchestra.run.gibba005.stdout: "pools": [ 2021-11-12T05:48:22.612 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.612 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 1, 2021-11-12T05:48:22.612 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "device_health_metrics", 2021-11-12T05:48:22.613 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:22.022116+0000", 2021-11-12T05:48:22.613 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:48:22.613 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:48:22.613 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:48:22.613 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:48:22.614 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:48:22.614 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:48:22.614 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:48:22.614 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:48:22.615 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 1, 2021-11-12T05:48:22.615 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 1, 2021-11-12T05:48:22.615 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 1, 2021-11-12T05:48:22.615 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 1, 2021-11-12T05:48:22.616 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 1, 2021-11-12T05:48:22.616 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:48:22.616 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:48:22.616 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:48:22.616 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:48:22.617 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:48:22.617 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:48:22.617 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:48:22.617 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.617 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "16", 2021-11-12T05:48:22.618 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:48:22.618 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:48:22.618 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:48:22.618 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:48:22.619 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:48:22.619 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:48:22.619 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:48:22.619 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:48:22.619 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:48:22.620 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:48:22.620 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:48:22.620 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:48:22.620 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:48:22.621 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:48:22.621 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:48:22.621 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:48:22.622 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:48:22.622 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:48:22.622 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:48:22.622 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:48:22.623 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:48:22.623 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:48:22.623 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:48:22.623 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:48:22.623 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:48:22.624 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:48:22.624 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.624 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:48:22.624 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:48:22.625 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:48:22.625 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:48:22.625 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:48:22.625 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:48:22.626 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:48:22.626 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:48:22.626 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:48:22.626 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:48:22.627 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:48:22.627 INFO:teuthology.orchestra.run.gibba005.stdout: "options": { 2021-11-12T05:48:22.627 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_min": 1 2021-11-12T05:48:22.627 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.628 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:48:22.628 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr_devicehealth": {} 2021-11-12T05:48:22.628 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:22.628 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.629 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.629 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 2, 2021-11-12T05:48:22.629 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "rbd", 2021-11-12T05:48:22.629 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:29.953617+0000", 2021-11-12T05:48:22.629 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:48:22.630 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:48:22.630 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:48:22.630 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:48:22.631 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:48:22.631 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:48:22.631 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:48:22.631 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:48:22.632 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:48:22.632 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:48:22.632 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:48:22.632 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:48:22.633 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:48:22.633 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:48:22.633 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:48:22.633 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:48:22.634 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:48:22.634 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:48:22.634 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:48:22.634 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:48:22.635 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.635 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "19", 2021-11-12T05:48:22.635 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:48:22.635 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:48:22.636 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:48:22.636 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:48:22.636 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:48:22.636 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:48:22.636 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:48:22.637 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:48:22.637 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:48:22.637 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:48:22.637 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:48:22.638 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:48:22.638 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:48:22.638 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:48:22.638 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:48:22.639 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:48:22.639 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:48:22.639 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:48:22.640 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:48:22.640 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:48:22.640 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:48:22.640 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:48:22.641 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:48:22.641 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:48:22.641 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:48:22.641 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:48:22.642 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.642 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:48:22.642 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:48:22.643 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:48:22.643 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:48:22.643 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:48:22.643 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:48:22.643 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:48:22.644 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:48:22.644 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:48:22.644 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:48:22.644 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:48:22.645 INFO:teuthology.orchestra.run.gibba005.stdout: "options": {}, 2021-11-12T05:48:22.645 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:48:22.645 INFO:teuthology.orchestra.run.gibba005.stdout: "rbd": {} 2021-11-12T05:48:22.645 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:22.645 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:22.646 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:48:22.646 INFO:teuthology.orchestra.run.gibba005.stdout: "osds": [ 2021-11-12T05:48:22.646 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.646 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:48:22.647 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "ee8e30a0-4819-4475-80ec-dd3ee7d01322", 2021-11-12T05:48:22.647 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:48:22.647 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:48:22.647 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:48:22.647 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:48:22.648 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:48:22.648 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:48:22.648 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:48:22.648 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 105, 2021-11-12T05:48:22.649 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:48:22.649 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:48:22.649 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:48:22.649 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:22.649 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.650 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:22.650 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6802", 2021-11-12T05:48:22.650 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:48:22.650 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.651 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.651 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:22.651 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6803", 2021-11-12T05:48:22.651 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:48:22.652 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:22.652 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.652 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.653 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:48:22.653 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:22.653 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.653 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:22.654 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6804", 2021-11-12T05:48:22.654 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:48:22.654 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.654 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.654 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:22.655 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6805", 2021-11-12T05:48:22.655 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:48:22.655 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:22.655 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.656 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.656 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:48:22.656 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:22.656 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.657 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:22.657 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6808", 2021-11-12T05:48:22.657 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:48:22.657 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.658 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.658 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:22.658 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6809", 2021-11-12T05:48:22.658 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:48:22.659 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:22.659 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.659 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.659 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:48:22.660 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:22.660 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.660 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:22.660 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6806", 2021-11-12T05:48:22.660 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:48:22.661 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.661 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.661 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:22.661 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6807", 2021-11-12T05:48:22.662 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:48:22.662 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:22.662 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.662 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.663 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6803/14874", 2021-11-12T05:48:22.663 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6805/14874", 2021-11-12T05:48:22.663 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6809/14874", 2021-11-12T05:48:22.664 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6807/14874", 2021-11-12T05:48:22.664 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:48:22.664 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:48:22.664 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:48:22.665 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.665 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.665 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.665 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:48:22.665 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "b1bb06c3-26d0-4d92-82f8-b3e882242785", 2021-11-12T05:48:22.666 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:48:22.666 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:48:22.666 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:48:22.666 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:48:22.667 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:48:22.667 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:48:22.667 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:48:22.667 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 105, 2021-11-12T05:48:22.667 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:48:22.668 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:48:22.668 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:48:22.668 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:22.668 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.669 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:22.669 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6810", 2021-11-12T05:48:22.669 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:48:22.669 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.669 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.670 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:22.670 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6811", 2021-11-12T05:48:22.670 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:48:22.670 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:22.671 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.671 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.671 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:48:22.671 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:22.671 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.672 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:22.672 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6812", 2021-11-12T05:48:22.672 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:48:22.672 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.673 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.673 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:22.673 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6813", 2021-11-12T05:48:22.674 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:48:22.674 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:22.674 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.674 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.674 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:48:22.675 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:22.675 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.675 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:22.675 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6816", 2021-11-12T05:48:22.676 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:48:22.676 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.676 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.676 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:22.676 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6817", 2021-11-12T05:48:22.677 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:48:22.677 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:22.677 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.677 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.678 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:48:22.678 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:22.678 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.679 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:22.679 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6814", 2021-11-12T05:48:22.679 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:48:22.679 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.679 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.680 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:22.680 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6815", 2021-11-12T05:48:22.680 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:48:22.680 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:22.681 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.681 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.681 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6811/14875", 2021-11-12T05:48:22.681 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6813/14875", 2021-11-12T05:48:22.682 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6817/14875", 2021-11-12T05:48:22.682 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6815/14875", 2021-11-12T05:48:22.682 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:48:22.682 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:48:22.683 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:48:22.683 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.683 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.683 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.684 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:48:22.684 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "837b2c60-c335-4382-9f47-d86543a14022", 2021-11-12T05:48:22.684 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:48:22.684 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:48:22.685 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:48:22.685 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:48:22.685 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:48:22.685 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:48:22.686 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:48:22.686 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 104, 2021-11-12T05:48:22.686 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:48:22.686 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:48:22.687 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:48:22.687 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:22.687 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.687 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:22.688 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6818", 2021-11-12T05:48:22.688 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:48:22.688 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.688 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.689 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:22.689 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6819", 2021-11-12T05:48:22.689 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:48:22.689 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:22.690 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.690 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.690 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:48:22.690 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:22.691 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.691 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:22.691 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6820", 2021-11-12T05:48:22.691 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:48:22.692 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.692 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.692 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:22.692 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6821", 2021-11-12T05:48:22.693 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:48:22.693 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:22.693 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.693 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.694 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:48:22.694 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:22.694 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.694 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:22.695 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6824", 2021-11-12T05:48:22.695 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:48:22.695 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.696 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.696 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:22.696 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6825", 2021-11-12T05:48:22.696 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:48:22.696 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:22.697 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.697 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.697 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:48:22.697 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:22.698 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.698 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:22.698 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6822", 2021-11-12T05:48:22.698 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:48:22.699 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.699 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.699 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:22.699 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6823", 2021-11-12T05:48:22.700 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:48:22.700 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:22.700 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.700 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.700 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6819/14905", 2021-11-12T05:48:22.701 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6821/14905", 2021-11-12T05:48:22.701 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6825/14905", 2021-11-12T05:48:22.701 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6823/14905", 2021-11-12T05:48:22.701 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:48:22.702 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:48:22.702 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:48:22.702 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.702 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.702 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.703 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:48:22.703 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "eb2b737b-dda6-444b-a306-f33cbbd51f70", 2021-11-12T05:48:22.703 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:48:22.703 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:48:22.703 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:48:22.704 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:48:22.704 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:48:22.704 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:48:22.704 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:48:22.704 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 105, 2021-11-12T05:48:22.705 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:48:22.705 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:48:22.705 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:48:22.705 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:22.706 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.706 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:22.706 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6826", 2021-11-12T05:48:22.706 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:48:22.706 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.707 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.707 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:22.707 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6827", 2021-11-12T05:48:22.707 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:48:22.707 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:22.708 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.708 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.708 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:48:22.708 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:22.709 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.709 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:22.709 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6828", 2021-11-12T05:48:22.709 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:48:22.710 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.710 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.710 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:22.710 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6829", 2021-11-12T05:48:22.710 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:48:22.711 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:22.711 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.711 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.711 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:48:22.712 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:22.712 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.712 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:22.712 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6832", 2021-11-12T05:48:22.713 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:48:22.713 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.713 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.714 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:22.714 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6833", 2021-11-12T05:48:22.714 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:48:22.714 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:22.714 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.715 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.715 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:48:22.715 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:22.715 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.716 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:22.716 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6830", 2021-11-12T05:48:22.716 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:48:22.716 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.717 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.717 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:22.717 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6831", 2021-11-12T05:48:22.717 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:48:22.717 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:22.718 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.718 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.718 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6827/14876", 2021-11-12T05:48:22.718 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6829/14876", 2021-11-12T05:48:22.718 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6833/14876", 2021-11-12T05:48:22.719 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6831/14876", 2021-11-12T05:48:22.719 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:48:22.719 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:48:22.719 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:48:22.720 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.720 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.720 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.720 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:48:22.720 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "721529a1-c047-486a-a7ca-ddc15d80cdde", 2021-11-12T05:48:22.721 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:48:22.721 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:48:22.721 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:48:22.721 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:48:22.721 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:48:22.722 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:48:22.722 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:48:22.722 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 104, 2021-11-12T05:48:22.722 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:48:22.722 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:48:22.723 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:48:22.723 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:22.723 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.723 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:22.724 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6800", 2021-11-12T05:48:22.724 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:48:22.724 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.725 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.725 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:22.725 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6801", 2021-11-12T05:48:22.725 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:48:22.726 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:22.726 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.726 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.726 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:48:22.727 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:22.727 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.727 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:22.727 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6802", 2021-11-12T05:48:22.728 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:48:22.728 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.728 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.728 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:22.729 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6803", 2021-11-12T05:48:22.729 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:48:22.729 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:22.729 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.730 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.730 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:48:22.730 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:22.730 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.731 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:22.731 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6806", 2021-11-12T05:48:22.731 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:48:22.731 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.732 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.732 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:22.732 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6807", 2021-11-12T05:48:22.732 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:48:22.732 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:22.733 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.733 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.733 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:48:22.733 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:22.734 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.734 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:22.734 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6804", 2021-11-12T05:48:22.735 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:48:22.735 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.735 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.736 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:22.736 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6805", 2021-11-12T05:48:22.736 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:48:22.736 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:22.737 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.737 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.737 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6801/15096", 2021-11-12T05:48:22.737 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6803/15096", 2021-11-12T05:48:22.738 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6807/15096", 2021-11-12T05:48:22.738 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6805/15096", 2021-11-12T05:48:22.738 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:48:22.738 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:48:22.739 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:48:22.739 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.739 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.739 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.740 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:48:22.740 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "68b72ab2-fa82-4b5c-bf33-528f002e4950", 2021-11-12T05:48:22.740 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:48:22.741 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:48:22.741 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:48:22.741 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:48:22.741 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:48:22.742 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:48:22.742 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:48:22.742 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 104, 2021-11-12T05:48:22.742 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:48:22.743 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:48:22.743 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:48:22.743 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:22.743 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.744 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:22.744 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6808", 2021-11-12T05:48:22.744 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:48:22.745 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.745 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.745 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:22.745 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6809", 2021-11-12T05:48:22.746 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:48:22.746 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:22.746 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.746 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.747 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:48:22.747 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:22.747 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.747 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:22.748 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6810", 2021-11-12T05:48:22.748 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:48:22.748 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.748 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.748 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:22.749 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6811", 2021-11-12T05:48:22.749 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:48:22.749 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:22.749 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.750 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.750 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:48:22.750 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:22.750 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.750 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:22.751 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6814", 2021-11-12T05:48:22.751 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:48:22.751 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.751 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.752 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:22.752 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6815", 2021-11-12T05:48:22.752 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:48:22.752 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:22.753 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.753 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.754 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:48:22.754 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:22.754 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.754 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:22.755 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6812", 2021-11-12T05:48:22.755 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:48:22.755 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.755 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.756 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:22.756 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6813", 2021-11-12T05:48:22.756 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:48:22.756 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:22.756 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.757 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.757 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6809/15097", 2021-11-12T05:48:22.757 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6811/15097", 2021-11-12T05:48:22.757 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6815/15097", 2021-11-12T05:48:22.758 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6813/15097", 2021-11-12T05:48:22.758 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:48:22.758 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:48:22.758 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:48:22.759 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.759 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.759 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.759 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:48:22.759 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "a2c83b5d-8d37-4d30-ac04-30d89a76e485", 2021-11-12T05:48:22.760 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:48:22.760 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:48:22.760 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:48:22.760 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:48:22.761 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:48:22.761 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:48:22.761 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:48:22.761 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 105, 2021-11-12T05:48:22.762 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:48:22.762 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:48:22.762 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:48:22.762 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:22.762 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.763 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:22.763 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6816", 2021-11-12T05:48:22.763 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:48:22.763 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.764 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.764 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:22.764 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6817", 2021-11-12T05:48:22.764 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:48:22.765 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:22.765 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.765 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.765 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:48:22.766 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:22.766 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.766 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:22.766 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6818", 2021-11-12T05:48:22.767 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:48:22.767 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.767 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.767 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:22.768 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6819", 2021-11-12T05:48:22.768 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:48:22.768 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:22.768 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.768 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.769 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:48:22.769 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:22.769 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.769 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:22.770 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6822", 2021-11-12T05:48:22.770 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:48:22.770 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.770 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.770 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:22.771 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6823", 2021-11-12T05:48:22.771 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:48:22.771 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:22.771 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.772 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.772 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:48:22.772 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:22.772 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.772 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:22.773 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6820", 2021-11-12T05:48:22.773 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:48:22.773 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.773 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.773 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:22.774 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6821", 2021-11-12T05:48:22.774 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:48:22.774 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:22.775 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.775 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.775 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6817/15098", 2021-11-12T05:48:22.775 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6819/15098", 2021-11-12T05:48:22.776 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6823/15098", 2021-11-12T05:48:22.776 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6821/15098", 2021-11-12T05:48:22.776 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:48:22.776 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:48:22.776 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:48:22.777 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.777 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.777 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.777 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:48:22.777 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "786ce966-d0fb-4181-aed4-c26e3ef61c43", 2021-11-12T05:48:22.778 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:48:22.778 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:48:22.778 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:48:22.778 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:48:22.779 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:48:22.779 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:48:22.779 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:48:22.779 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 105, 2021-11-12T05:48:22.780 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:48:22.780 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:48:22.780 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:48:22.780 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:22.781 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.781 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:22.781 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6824", 2021-11-12T05:48:22.781 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:48:22.781 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.782 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.782 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:22.782 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6825", 2021-11-12T05:48:22.782 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:48:22.783 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:22.783 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.783 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.783 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:48:22.784 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:22.784 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.784 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:22.785 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6826", 2021-11-12T05:48:22.785 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:48:22.785 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.785 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.786 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:22.786 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6827", 2021-11-12T05:48:22.786 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:48:22.786 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:22.787 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.787 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.787 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:48:22.787 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:22.788 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.788 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:22.788 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6830", 2021-11-12T05:48:22.788 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:48:22.789 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.789 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.789 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:22.790 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6831", 2021-11-12T05:48:22.790 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:48:22.790 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:22.790 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.791 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.791 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:48:22.791 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:22.791 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.792 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:22.792 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6828", 2021-11-12T05:48:22.792 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:48:22.792 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.793 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.793 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:22.793 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6829", 2021-11-12T05:48:22.793 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:48:22.793 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:22.794 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.794 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.794 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6825/15099", 2021-11-12T05:48:22.794 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6827/15099", 2021-11-12T05:48:22.795 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6831/15099", 2021-11-12T05:48:22.795 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6829/15099", 2021-11-12T05:48:22.795 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:48:22.795 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:48:22.796 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:48:22.796 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:22.796 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:22.797 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:48:22.797 INFO:teuthology.orchestra.run.gibba005.stdout: "osd_xinfo": [ 2021-11-12T05:48:22.797 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.797 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:48:22.798 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:48:22.798 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:48:22.798 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:48:22.798 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:48:22.799 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:48:22.799 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.615112+0000", 2021-11-12T05:48:22.799 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:48:22.799 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.800 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.800 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:48:22.800 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:48:22.800 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:48:22.801 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:48:22.801 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:48:22.801 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:48:22.801 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.665935+0000", 2021-11-12T05:48:22.802 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:48:22.802 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.802 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.802 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:48:22.803 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:48:22.803 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:48:22.803 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:48:22.803 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:48:22.804 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:48:22.804 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.715877+0000", 2021-11-12T05:48:22.804 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:48:22.804 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.805 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.805 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:48:22.805 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:48:22.805 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:48:22.806 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:48:22.806 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:48:22.806 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:48:22.806 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.489234+0000", 2021-11-12T05:48:22.807 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:48:22.807 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.807 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.807 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:48:22.808 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:48:22.808 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:48:22.808 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:48:22.808 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:48:22.809 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:48:22.809 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.413776+0000", 2021-11-12T05:48:22.809 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:48:22.809 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.810 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.810 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:48:22.810 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:48:22.810 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:48:22.811 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:48:22.811 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:48:22.811 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:48:22.811 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.507960+0000", 2021-11-12T05:48:22.812 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:48:22.812 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.812 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.812 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:48:22.813 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:48:22.813 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:48:22.813 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:48:22.813 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:48:22.814 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:48:22.814 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.635696+0000", 2021-11-12T05:48:22.814 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:48:22.814 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.815 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:22.815 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:48:22.815 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:48:22.815 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:48:22.816 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:48:22.816 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:48:22.816 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:48:22.816 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.746949+0000", 2021-11-12T05:48:22.816 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:48:22.817 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:22.817 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:48:22.817 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap": [], 2021-11-12T05:48:22.818 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap_items": [], 2021-11-12T05:48:22.818 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_temp": [], 2021-11-12T05:48:22.818 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_temp": [], 2021-11-12T05:48:22.818 INFO:teuthology.orchestra.run.gibba005.stdout: "blacklist": { 2021-11-12T05:48:22.819 INFO:teuthology.orchestra.run.gibba005.stdout: "172.21.2.105:6835/3290895957": "2021-11-13T05:48:16.142958+0000", 2021-11-12T05:48:22.819 INFO:teuthology.orchestra.run.gibba005.stdout: "172.21.2.105:6834/3290895957": "2021-11-13T05:48:16.142958+0000" 2021-11-12T05:48:22.819 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.819 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profiles": { 2021-11-12T05:48:22.820 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs_data": { 2021-11-12T05:48:22.820 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-device-class": "", 2021-11-12T05:48:22.820 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:48:22.820 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-root": "default", 2021-11-12T05:48:22.821 INFO:teuthology.orchestra.run.gibba005.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-12T05:48:22.821 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:48:22.821 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "2", 2021-11-12T05:48:22.821 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:48:22.821 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:48:22.822 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van", 2021-11-12T05:48:22.822 INFO:teuthology.orchestra.run.gibba005.stdout: "w": "8" 2021-11-12T05:48:22.822 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.822 INFO:teuthology.orchestra.run.gibba005.stdout: "default": { 2021-11-12T05:48:22.823 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:48:22.823 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:48:22.823 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "1", 2021-11-12T05:48:22.823 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:48:22.824 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:48:22.824 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van" 2021-11-12T05:48:22.824 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:22.824 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:22.825 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps_queue": [], 2021-11-12T05:48:22.825 INFO:teuthology.orchestra.run.gibba005.stdout: "new_removed_snaps": [], 2021-11-12T05:48:22.825 INFO:teuthology.orchestra.run.gibba005.stdout: "new_purged_snaps": [], 2021-11-12T05:48:22.825 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_node_flags": {}, 2021-11-12T05:48:22.826 INFO:teuthology.orchestra.run.gibba005.stdout: "device_class_flags": {} 2021-11-12T05:48:22.826 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:48:22.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.600+0000 7f3b29311700 1 -- 172.21.2.105:0/2729707359 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3b08053610 msgr2=0x7f3b08055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:22.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.600+0000 7f3b29311700 1 --2- 172.21.2.105:0/2729707359 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3b08053610 0x7f3b08055ad0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f3b14002fb0 tx=0x7f3b140069b0).stop 2021-11-12T05:48:22.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.600+0000 7f3b29311700 1 -- 172.21.2.105:0/2729707359 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3b241390a0 msgr2=0x7f3b24066ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:22.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.600+0000 7f3b29311700 1 --2- 172.21.2.105:0/2729707359 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3b241390a0 0x7f3b24066ed0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 rx=0x7f3b0c002f70 tx=0x7f3b24140180).stop 2021-11-12T05:48:22.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.600+0000 7f3b29311700 1 -- 172.21.2.105:0/2729707359 shutdown_connections 2021-11-12T05:48:22.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.600+0000 7f3b29311700 1 --2- 172.21.2.105:0/2729707359 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3b08053610 0x7f3b08055ad0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:22.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.600+0000 7f3b29311700 1 --2- 172.21.2.105:0/2729707359 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3b24142900 0x7f3b24063c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:22.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.600+0000 7f3b29311700 1 --2- 172.21.2.105:0/2729707359 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3b241390a0 0x7f3b24066ed0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:22.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.600+0000 7f3b29311700 1 --2- 172.21.2.105:0/2729707359 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3b240b6380 0x7f3b240b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:22.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.600+0000 7f3b29311700 1 -- 172.21.2.105:0/2729707359 >> 172.21.2.105:0/2729707359 conn(0x7f3b24063810 msgr2=0x7f3b241377e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:22.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.600+0000 7f3b29311700 1 -- 172.21.2.105:0/2729707359 shutdown_connections 2021-11-12T05:48:22.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.600+0000 7f3b29311700 1 -- 172.21.2.105:0/2729707359 wait complete. 2021-11-12T05:48:22.831 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:48:22.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.880+0000 7f72731bc700 1 Processor -- start 2021-11-12T05:48:22.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.880+0000 7f72731bc700 1 -- start start 2021-11-12T05:48:22.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.880+0000 7f72731bc700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f726c0b4d50 0x7f726c0b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:22.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.880+0000 7f72731bc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f726c0b3100 0x7f726c0b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:22.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.880+0000 7f72731bc700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f726c0b2110 con 0x7f726c062010 2021-11-12T05:48:22.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.880+0000 7f72731bc700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f726c0b2370 con 0x7f726c0b3100 2021-11-12T05:48:22.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.880+0000 7f72731bc700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726c0b2610 con 0x7f726c0b4d50 2021-11-12T05:48:22.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.880+0000 7f7271759700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f726c0b3100 0x7f726c0b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:22.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.880+0000 7f7270f58700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f726c062010 0x7f726c0b4640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60692/0 (socket says 172.21.2.105:60692) 2021-11-12T05:48:22.891 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.880+0000 7f7270f58700 1 -- 172.21.2.105:0/1476351233 learned_addr learned my addr 172.21.2.105:0/1476351233 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:22.891 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f726b7fe700 1 -- 172.21.2.105:0/1476351233 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4010216904 0 0) 0x7f726c0b2110 con 0x7f726c062010 2021-11-12T05:48:22.891 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f726b7fe700 1 -- 172.21.2.105:0/1476351233 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f724c003260 con 0x7f726c062010 2021-11-12T05:48:22.891 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f7271759700 1 -- 172.21.2.105:0/1476351233 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f726c0b4d50 msgr2=0x7f726c0b5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:22.892 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f7271759700 1 --2- 172.21.2.105:0/1476351233 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f726c0b4d50 0x7f726c0b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:22.892 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f7271759700 1 -- 172.21.2.105:0/1476351233 >> v1:172.21.2.105:6789/0 conn(0x7f726c062010 legacy=0x7f726c0b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:22.892 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f7271759700 1 -- 172.21.2.105:0/1476351233 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726c0b4330 con 0x7f726c0b3100 2021-11-12T05:48:22.893 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f7271759700 1 --2- 172.21.2.105:0/1476351233 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f726c0b3100 0x7f726c0b2ab0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7f72640032f0 tx=0x7f72640091d0).ready entity=mon.0 client_cookie=d0e9804b60291f1b server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:22.893 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f726b7fe700 1 -- 172.21.2.105:0/1476351233 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f726400b6c0 con 0x7f726c0b3100 2021-11-12T05:48:22.893 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f726b7fe700 1 -- 172.21.2.105:0/1476351233 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726400b820 con 0x7f726c0b3100 2021-11-12T05:48:22.893 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f726b7fe700 1 -- 172.21.2.105:0/1476351233 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f726400b990 con 0x7f726c0b3100 2021-11-12T05:48:22.894 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f72731bc700 1 -- 172.21.2.105:0/1476351233 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f726c0b3100 msgr2=0x7f726c0b2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:22.894 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f72731bc700 1 --2- 172.21.2.105:0/1476351233 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f726c0b3100 0x7f726c0b2ab0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7f72640032f0 tx=0x7f72640091d0).stop 2021-11-12T05:48:22.894 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f72731bc700 1 -- 172.21.2.105:0/1476351233 shutdown_connections 2021-11-12T05:48:22.894 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f72731bc700 1 --2- 172.21.2.105:0/1476351233 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f726c0b3100 0x7f726c0b2ab0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:22.894 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f72731bc700 1 --2- 172.21.2.105:0/1476351233 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f726c0b4d50 0x7f726c0b5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:22.895 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f72731bc700 1 -- 172.21.2.105:0/1476351233 >> 172.21.2.105:0/1476351233 conn(0x7f726c0b9790 msgr2=0x7f726c0b9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:22.895 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f72731bc700 1 -- 172.21.2.105:0/1476351233 shutdown_connections 2021-11-12T05:48:22.895 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f72731bc700 1 -- 172.21.2.105:0/1476351233 wait complete. 2021-11-12T05:48:22.896 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f72731bc700 1 Processor -- start 2021-11-12T05:48:22.896 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f72731bc700 1 -- start start 2021-11-12T05:48:22.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f72731bc700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f726c062010 0x7f726c0af490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:22.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f72731bc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f726c0b3100 0x7f726c0b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:22.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f72731bc700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f726c0b4d50 0x7f726c0ae680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:22.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f72731bc700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726c0afa90 con 0x7f726c0b3100 2021-11-12T05:48:22.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f72731bc700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726c0aeb70 con 0x7f726c0b4d50 2021-11-12T05:48:22.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f72731bc700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726c0afc70 con 0x7f726c062010 2021-11-12T05:48:22.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f726bfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f726c0b3100 0x7f726c0b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:22.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f726bfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f726c0b3100 0x7f726c0b7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50302/0 (socket says 172.21.2.105:50302) 2021-11-12T05:48:22.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f726bfff700 1 -- 172.21.2.105:0/3377538516 learned_addr learned my addr 172.21.2.105:0/3377538516 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:22.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f726bfff700 1 -- 172.21.2.105:0/3377538516 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f726c062010 msgr2=0x7f726c0af490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:22.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f726bfff700 1 --2- 172.21.2.105:0/3377538516 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f726c062010 0x7f726c0af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:22.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f726bfff700 1 -- 172.21.2.105:0/3377538516 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f726c0b4d50 msgr2=0x7f726c0ae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:22.902 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f726bfff700 1 --2- 172.21.2.105:0/3377538516 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f726c0b4d50 0x7f726c0ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:22.902 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f726bfff700 1 -- 172.21.2.105:0/3377538516 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7264009470 con 0x7f726c0b3100 2021-11-12T05:48:22.902 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f726bfff700 1 --2- 172.21.2.105:0/3377538516 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f726c0b3100 0x7f726c0b7900 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 rx=0x7f726c0aecb0 tx=0x7f7254006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:22.902 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f7269ffb700 1 -- 172.21.2.105:0/3377538516 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7254013460 con 0x7f726c0b3100 2021-11-12T05:48:22.903 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f7269ffb700 1 -- 172.21.2.105:0/3377538516 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72540135c0 con 0x7f726c0b3100 2021-11-12T05:48:22.903 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f72731bc700 1 -- 172.21.2.105:0/3377538516 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f726c0aff10 con 0x7f726c0b3100 2021-11-12T05:48:22.903 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f7269ffb700 1 -- 172.21.2.105:0/3377538516 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7254013920 con 0x7f726c0b3100 2021-11-12T05:48:22.903 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.884+0000 7f72731bc700 1 -- 172.21.2.105:0/3377538516 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f726c15a200 con 0x7f726c0b3100 2021-11-12T05:48:22.904 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.888+0000 7f72731bc700 1 -- 172.21.2.105:0/3377538516 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f726c0b00a0 con 0x7f726c0b3100 2021-11-12T05:48:22.904 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.888+0000 7f7269ffb700 1 -- 172.21.2.105:0/3377538516 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f725401a060 con 0x7f726c0b3100 2021-11-12T05:48:22.904 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.888+0000 7f7269ffb700 1 --2- 172.21.2.105:0/3377538516 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7250053610 0x7f7250055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:22.904 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.888+0000 7f7269ffb700 1 -- 172.21.2.105:0/3377538516 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f725406b140 con 0x7f726c0b3100 2021-11-12T05:48:22.905 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.888+0000 7f7270f58700 1 --2- 172.21.2.105:0/3377538516 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7250053610 0x7f7250055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:22.905 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.888+0000 7f7270f58700 1 --2- 172.21.2.105:0/3377538516 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7250053610 0x7f7250055ad0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f725c001110 tx=0x7f725c0076c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:22.905 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.888+0000 7f7269ffb700 1 -- 172.21.2.105:0/3377538516 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7254042420 con 0x7f726c0b3100 2021-11-12T05:48:23.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.996+0000 7f72731bc700 1 -- 172.21.2.105:0/3377538516 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f726c0623f0 con 0x7f726c0b3100 2021-11-12T05:48:23.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:22.996+0000 7f7269ffb700 1 -- 172.21.2.105:0/3377538516 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+1209 (secure 0 0 0) 0x7f7254018020 con 0x7f726c0b3100 2021-11-12T05:48:23.003 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:23.003 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":52,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5140,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/1083784348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":1083784348},{"type":"v1","addr":"172.21.2.115:6833","nonce":1083784348}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":48},{"gid":7605,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.105:6835/4234594667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":4234594667},{"type":"v1","addr":"172.21.2.105:6835","nonce":4234594667}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52}],"filesystems":[]} 2021-11-12T05:48:23.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.000+0000 7f72731bc700 1 -- 172.21.2.105:0/3377538516 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7250053610 msgr2=0x7f7250055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:23.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.000+0000 7f72731bc700 1 --2- 172.21.2.105:0/3377538516 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7250053610 0x7f7250055ad0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f725c001110 tx=0x7f725c0076c0).stop 2021-11-12T05:48:23.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.000+0000 7f72731bc700 1 -- 172.21.2.105:0/3377538516 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f726c0b3100 msgr2=0x7f726c0b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:23.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.000+0000 7f72731bc700 1 --2- 172.21.2.105:0/3377538516 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f726c0b3100 0x7f726c0b7900 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 rx=0x7f726c0aecb0 tx=0x7f7254006df0).stop 2021-11-12T05:48:23.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.000+0000 7f72731bc700 1 -- 172.21.2.105:0/3377538516 shutdown_connections 2021-11-12T05:48:23.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.000+0000 7f72731bc700 1 --2- 172.21.2.105:0/3377538516 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7250053610 0x7f7250055ad0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:23.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.000+0000 7f72731bc700 1 --2- 172.21.2.105:0/3377538516 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f726c0b4d50 0x7f726c0ae680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:23.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.000+0000 7f72731bc700 1 --2- 172.21.2.105:0/3377538516 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f726c0b3100 0x7f726c0b7900 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:23.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.000+0000 7f72731bc700 1 --2- 172.21.2.105:0/3377538516 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f726c062010 0x7f726c0af490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:23.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.000+0000 7f72731bc700 1 -- 172.21.2.105:0/3377538516 >> 172.21.2.105:0/3377538516 conn(0x7f726c0b9790 msgr2=0x7f726c143260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:23.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.000+0000 7f72731bc700 1 -- 172.21.2.105:0/3377538516 shutdown_connections 2021-11-12T05:48:23.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.000+0000 7f72731bc700 1 -- 172.21.2.105:0/3377538516 wait complete. 2021-11-12T05:48:23.008 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 52 2021-11-12T05:48:23.010 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:48:23.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.056+0000 7fc58ee80700 1 Processor -- start 2021-11-12T05:48:23.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.056+0000 7fc58ee80700 1 -- start start 2021-11-12T05:48:23.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.056+0000 7fc58ee80700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc5880adaf0 0x7fc58813fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:23.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.056+0000 7fc58ee80700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fc588143b40 0x7fc588143f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:23.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.056+0000 7fc58ee80700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc588067860 con 0x7fc5880aded0 2021-11-12T05:48:23.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.056+0000 7fc58ee80700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc588143400 con 0x7fc588143b40 2021-11-12T05:48:23.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.056+0000 7fc58ee80700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5881436a0 con 0x7fc5880adaf0 2021-11-12T05:48:23.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.056+0000 7fc58d41d700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fc5880aded0 0x7fc5880afe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60708/0 (socket says 172.21.2.105:60708) 2021-11-12T05:48:23.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.056+0000 7fc58d41d700 1 -- 172.21.2.105:0/2655777667 learned_addr learned my addr 172.21.2.105:0/2655777667 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:23.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.056+0000 7fc587fff700 1 --2- 172.21.2.105:0/2655777667 >> v2:172.21.2.105:3300/0 conn(0x7fc588143b40 0x7fc588143f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:23.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.056+0000 7fc587fff700 1 -- 172.21.2.105:0/2655777667 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc5880adaf0 msgr2=0x7fc58813fd90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:48:23.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.056+0000 7fc587fff700 1 --2- 172.21.2.105:0/2655777667 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc5880adaf0 0x7fc58813fd90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:23.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.056+0000 7fc587fff700 1 -- 172.21.2.105:0/2655777667 >> v1:172.21.2.105:6789/0 conn(0x7fc5880aded0 legacy=0x7fc5880afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:23.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.056+0000 7fc587fff700 1 -- 172.21.2.105:0/2655777667 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5880b2b40 con 0x7fc588143b40 2021-11-12T05:48:23.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.056+0000 7fc587fff700 1 --2- 172.21.2.105:0/2655777667 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc588143b40 0x7fc588143f80 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7fc57c002f70 tx=0x7fc57c006df0).ready entity=mon.0 client_cookie=d13a178134d53564 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:23.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.056+0000 7fc5877fe700 1 -- 172.21.2.105:0/2655777667 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc57c00d570 con 0x7fc588143b40 2021-11-12T05:48:23.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.056+0000 7fc5877fe700 1 -- 172.21.2.105:0/2655777667 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57c000e90 con 0x7fc588143b40 2021-11-12T05:48:23.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.056+0000 7fc5877fe700 1 -- 172.21.2.105:0/2655777667 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc57c00d900 con 0x7fc588143b40 2021-11-12T05:48:23.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.056+0000 7fc58ee80700 1 -- 172.21.2.105:0/2655777667 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc588143b40 msgr2=0x7fc588143f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:23.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.056+0000 7fc58ee80700 1 --2- 172.21.2.105:0/2655777667 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc588143b40 0x7fc588143f80 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7fc57c002f70 tx=0x7fc57c006df0).stop 2021-11-12T05:48:23.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.056+0000 7fc58ee80700 1 -- 172.21.2.105:0/2655777667 shutdown_connections 2021-11-12T05:48:23.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.056+0000 7fc58ee80700 1 --2- 172.21.2.105:0/2655777667 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc588143b40 0x7fc588143f80 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:23.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.056+0000 7fc58ee80700 1 --2- 172.21.2.105:0/2655777667 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc5880adaf0 0x7fc58813fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:23.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.056+0000 7fc58ee80700 1 -- 172.21.2.105:0/2655777667 >> 172.21.2.105:0/2655777667 conn(0x7fc58805c490 msgr2=0x7fc58805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:23.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.056+0000 7fc58ee80700 1 -- 172.21.2.105:0/2655777667 shutdown_connections 2021-11-12T05:48:23.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.056+0000 7fc58ee80700 1 -- 172.21.2.105:0/2655777667 wait complete. 2021-11-12T05:48:23.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.060+0000 7fc58ee80700 1 Processor -- start 2021-11-12T05:48:23.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.060+0000 7fc58ee80700 1 -- start start 2021-11-12T05:48:23.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.060+0000 7fc58ee80700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc5880adaf0 0x7fc588142220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:23.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.060+0000 7fc58ee80700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc5880aded0 0x7fc588063a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:23.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.060+0000 7fc58ee80700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc588143b40 0x7fc588063f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:23.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.060+0000 7fc58ee80700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58813ce70 con 0x7fc588143b40 2021-11-12T05:48:23.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.060+0000 7fc58ee80700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc588066e30 con 0x7fc5880aded0 2021-11-12T05:48:23.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.060+0000 7fc58ee80700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5880670d0 con 0x7fc5880adaf0 2021-11-12T05:48:23.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.060+0000 7fc58d41d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc588143b40 0x7fc588063f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:23.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.060+0000 7fc58d41d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc588143b40 0x7fc588063f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50320/0 (socket says 172.21.2.105:50320) 2021-11-12T05:48:23.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.060+0000 7fc58d41d700 1 -- 172.21.2.105:0/3044764229 learned_addr learned my addr 172.21.2.105:0/3044764229 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:23.073 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.060+0000 7fc58d41d700 1 -- 172.21.2.105:0/3044764229 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc5880adaf0 msgr2=0x7fc588142220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:23.074 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.060+0000 7fc58d41d700 1 --2- 172.21.2.105:0/3044764229 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc5880adaf0 0x7fc588142220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:23.074 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.060+0000 7fc58d41d700 1 -- 172.21.2.105:0/3044764229 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc5880aded0 msgr2=0x7fc588063a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:23.074 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.060+0000 7fc58d41d700 1 --2- 172.21.2.105:0/3044764229 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc5880aded0 0x7fc588063a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:23.074 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.060+0000 7fc58d41d700 1 -- 172.21.2.105:0/3044764229 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57c00b180 con 0x7fc588143b40 2021-11-12T05:48:23.074 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.060+0000 7fc58d41d700 1 --2- 172.21.2.105:0/3044764229 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc588143b40 0x7fc588063f30 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7fc5880b63f0 tx=0x7fc580007f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:23.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.060+0000 7fc585ffb700 1 -- 172.21.2.105:0/3044764229 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc580005ba0 con 0x7fc588143b40 2021-11-12T05:48:23.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.060+0000 7fc585ffb700 1 -- 172.21.2.105:0/3044764229 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc580005d00 con 0x7fc588143b40 2021-11-12T05:48:23.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.060+0000 7fc58ee80700 1 -- 172.21.2.105:0/3044764229 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc588067370 con 0x7fc588143b40 2021-11-12T05:48:23.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.060+0000 7fc585ffb700 1 -- 172.21.2.105:0/3044764229 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5800072c0 con 0x7fc588143b40 2021-11-12T05:48:23.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.060+0000 7fc58ee80700 1 -- 172.21.2.105:0/3044764229 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc588066ab0 con 0x7fc588143b40 2021-11-12T05:48:23.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.060+0000 7fc58ee80700 1 -- 172.21.2.105:0/3044764229 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc588067500 con 0x7fc588143b40 2021-11-12T05:48:23.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.060+0000 7fc585ffb700 1 -- 172.21.2.105:0/3044764229 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc580010070 con 0x7fc588143b40 2021-11-12T05:48:23.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.060+0000 7fc585ffb700 1 --2- 172.21.2.105:0/3044764229 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc568053610 0x7fc568055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:23.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.060+0000 7fc585ffb700 1 -- 172.21.2.105:0/3044764229 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fc58006b1e0 con 0x7fc588143b40 2021-11-12T05:48:23.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.060+0000 7fc58cc1c700 1 --2- 172.21.2.105:0/3044764229 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc568053610 0x7fc568055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:23.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.060+0000 7fc58cc1c700 1 --2- 172.21.2.105:0/3044764229 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc568053610 0x7fc568055ad0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7fc578002fb0 tx=0x7fc5780069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:23.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.064+0000 7fc585ffb700 1 -- 172.21.2.105:0/3044764229 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc5800423b0 con 0x7fc588143b40 2021-11-12T05:48:23.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.172+0000 7fc58ee80700 1 -- 172.21.2.105:0/3044764229 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5880afb00 con 0x7fc588143b40 2021-11-12T05:48:23.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.172+0000 7fc585ffb700 1 -- 172.21.2.105:0/3044764229 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+1209 (secure 0 0 0) 0x7fc580018070 con 0x7fc588143b40 2021-11-12T05:48:23.178 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:23.178 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":52,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5140,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/1083784348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":1083784348},{"type":"v1","addr":"172.21.2.115:6833","nonce":1083784348}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":48},{"gid":7605,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.105:6835/4234594667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":4234594667},{"type":"v1","addr":"172.21.2.105:6835","nonce":4234594667}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52}],"filesystems":[]} 2021-11-12T05:48:23.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.172+0000 7fc58ee80700 1 -- 172.21.2.105:0/3044764229 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc568053610 msgr2=0x7fc568055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:23.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.172+0000 7fc58ee80700 1 --2- 172.21.2.105:0/3044764229 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc568053610 0x7fc568055ad0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7fc578002fb0 tx=0x7fc5780069b0).stop 2021-11-12T05:48:23.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.172+0000 7fc58ee80700 1 -- 172.21.2.105:0/3044764229 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc588143b40 msgr2=0x7fc588063f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:23.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.172+0000 7fc58ee80700 1 --2- 172.21.2.105:0/3044764229 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc588143b40 0x7fc588063f30 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7fc5880b63f0 tx=0x7fc580007f00).stop 2021-11-12T05:48:23.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.172+0000 7fc58ee80700 1 -- 172.21.2.105:0/3044764229 shutdown_connections 2021-11-12T05:48:23.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.172+0000 7fc58ee80700 1 --2- 172.21.2.105:0/3044764229 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc568053610 0x7fc568055ad0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:23.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.172+0000 7fc58ee80700 1 --2- 172.21.2.105:0/3044764229 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc588143b40 0x7fc588063f30 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:23.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.172+0000 7fc58ee80700 1 --2- 172.21.2.105:0/3044764229 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc5880aded0 0x7fc588063a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:23.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.172+0000 7fc58ee80700 1 --2- 172.21.2.105:0/3044764229 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc5880adaf0 0x7fc588142220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:23.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.172+0000 7fc58ee80700 1 -- 172.21.2.105:0/3044764229 >> 172.21.2.105:0/3044764229 conn(0x7fc58805c490 msgr2=0x7fc5880b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:23.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.172+0000 7fc58ee80700 1 -- 172.21.2.105:0/3044764229 shutdown_connections 2021-11-12T05:48:23.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.172+0000 7fc58ee80700 1 -- 172.21.2.105:0/3044764229 wait complete. 2021-11-12T05:48:23.182 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 52 2021-11-12T05:48:23.185 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-12T05:48:23.185 INFO:tasks.ceph.mds.a:Stopping old one... 2021-11-12T05:48:23.186 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-12T05:48:23.186 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T05:48:23.187 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-12T05:48:23.187 INFO:tasks.ceph.mds.b:Stopping old one... 2021-11-12T05:48:23.187 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-12T05:48:23.187 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T05:48:23.191 INFO:tasks.ceph.mds.a:Stopped 2021-11-12T05:48:23.191 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-12T05:48:23.194 INFO:tasks.ceph.mds.b:Stopped 2021-11-12T05:48:23.194 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-12T05:48:23.195 INFO:tasks.ceph.mds.a:Started 2021-11-12T05:48:23.195 DEBUG:teuthology.parallel:result is None 2021-11-12T05:48:23.197 INFO:tasks.ceph.mds.b:Started 2021-11-12T05:48:23.198 DEBUG:teuthology.parallel:result is None 2021-11-12T05:48:23.198 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-11-12T05:48:23.227 INFO:tasks.ceph.mds.a.gibba005.stdout:starting mds.a at 2021-11-12T05:48:23.235 INFO:tasks.ceph.mds.b.gibba015.stdout:starting mds.b at 2021-11-12T05:48:23.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7ce5d14700 1 Processor -- start 2021-11-12T05:48:23.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7ce5d14700 1 -- start start 2021-11-12T05:48:23.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7ce5d14700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f7ce00af750 0x7f7ce0062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:23.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7ce5d14700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ce00b0d50 con 0x7f7ce00626b0 2021-11-12T05:48:23.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7ce5d14700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ce00ad380 con 0x7f7ce0130a80 2021-11-12T05:48:23.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7ce5d14700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ce00ae190 con 0x7f7ce00af750 2021-11-12T05:48:23.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7cdf7fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f7ce00626b0 0x7f7ce0130370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60732/0 (socket says 172.21.2.105:60732) 2021-11-12T05:48:23.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7cdf7fe700 1 -- 172.21.2.105:0/1537664723 learned_addr learned my addr 172.21.2.105:0/1537664723 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:23.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7cde7fc700 1 -- 172.21.2.105:0/1537664723 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4194102426 0 0) 0x7f7ce00b0d50 con 0x7f7ce00626b0 2021-11-12T05:48:23.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7cde7fc700 1 -- 172.21.2.105:0/1537664723 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cc0003260 con 0x7f7ce00626b0 2021-11-12T05:48:23.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7cdeffd700 1 --2- 172.21.2.105:0/1537664723 >> v2:172.21.2.115:3300/0 conn(0x7f7ce00af750 0x7f7ce0062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:23.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7cde7fc700 1 -- 172.21.2.105:0/1537664723 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2846768888 0 0) 0x7f7cc0003260 con 0x7f7ce00626b0 2021-11-12T05:48:23.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7cde7fc700 1 -- 172.21.2.105:0/1537664723 >> v2:172.21.2.115:3300/0 conn(0x7f7ce00af750 msgr2=0x7f7ce0062a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:23.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7cde7fc700 1 --2- 172.21.2.105:0/1537664723 >> v2:172.21.2.115:3300/0 conn(0x7f7ce00af750 0x7f7ce0062a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:23.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7cde7fc700 1 -- 172.21.2.105:0/1537664723 >> v1:172.21.2.115:6789/0 conn(0x7f7ce0130a80 legacy=0x7f7ce01474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:23.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7cde7fc700 1 -- 172.21.2.105:0/1537664723 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce00ae2d0 con 0x7f7ce00626b0 2021-11-12T05:48:23.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7cde7fc700 1 -- 172.21.2.105:0/1537664723 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f7cd0001660 con 0x7f7ce00626b0 2021-11-12T05:48:23.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7cde7fc700 1 -- 172.21.2.105:0/1537664723 >> v1:172.21.2.105:6789/0 conn(0x7f7ce00626b0 legacy=0x7f7ce0130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:23.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7cde7fc700 1 --2- 172.21.2.105:0/1537664723 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7cc0003750 0x7f7cc0003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:23.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7cde7fc700 1 --2- 172.21.2.105:0/1537664723 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7cc0004500 0x7f7cc0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:23.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7cde7fc700 1 --2- 172.21.2.105:0/1537664723 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7cc0004e70 0x7f7cc000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:23.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7cde7fc700 1 -- 172.21.2.105:0/1537664723 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce00ae190 con 0x7f7cc0004e70 2021-11-12T05:48:23.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7cde7fc700 1 -- 172.21.2.105:0/1537664723 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc000bd20 con 0x7f7cc0003750 2021-11-12T05:48:23.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7cde7fc700 1 -- 172.21.2.105:0/1537664723 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc000bee0 con 0x7f7cc0004500 2021-11-12T05:48:23.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7cdffff700 1 --2- 172.21.2.105:0/1537664723 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7cc0004e70 0x7f7cc000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:23.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7cdf7fe700 1 --2- 172.21.2.105:0/1537664723 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7cc0003750 0x7f7cc0003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:23.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7cdeffd700 1 --2- 172.21.2.105:0/1537664723 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7cc0004500 0x7f7cc0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:23.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7cdffff700 1 -- 172.21.2.105:0/1537664723 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7cc0004500 msgr2=0x7f7cc0004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:23.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7cdffff700 1 --2- 172.21.2.105:0/1537664723 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7cc0004500 0x7f7cc0004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:23.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7cdffff700 1 -- 172.21.2.105:0/1537664723 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7cc0003750 msgr2=0x7f7cc0003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:23.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7cdffff700 1 --2- 172.21.2.105:0/1537664723 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7cc0003750 0x7f7cc0003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:23.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7cdffff700 1 -- 172.21.2.105:0/1537664723 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc0003260 con 0x7f7cc0004e70 2021-11-12T05:48:23.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7cdf7fe700 1 --2- 172.21.2.105:0/1537664723 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7cc0003750 0x7f7cc0003b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:48:23.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7cdffff700 1 -- 172.21.2.105:0/1537664723 reap_dead start 2021-11-12T05:48:23.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7cdffff700 1 --2- 172.21.2.105:0/1537664723 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7cc0004e70 0x7f7cc000b750 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 rx=0x7f7ce005d1b0 tx=0x7f7cd8007d80).ready entity=mon.0 client_cookie=6454b2f5d8110a9f server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:23.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7cde7fc700 1 -- 172.21.2.105:0/1537664723 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cd8001620 con 0x7f7cc0004e70 2021-11-12T05:48:23.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7cde7fc700 1 -- 172.21.2.105:0/1537664723 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd8006890 con 0x7f7cc0004e70 2021-11-12T05:48:23.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7cde7fc700 1 -- 172.21.2.105:0/1537664723 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cd8006bf0 con 0x7f7cc0004e70 2021-11-12T05:48:23.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7ce5d14700 1 -- 172.21.2.105:0/1537664723 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7cc0004e70 msgr2=0x7f7cc000b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:23.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7ce5d14700 1 --2- 172.21.2.105:0/1537664723 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7cc0004e70 0x7f7cc000b750 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 rx=0x7f7ce005d1b0 tx=0x7f7cd8007d80).stop 2021-11-12T05:48:23.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7ce5d14700 1 -- 172.21.2.105:0/1537664723 shutdown_connections 2021-11-12T05:48:23.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7ce5d14700 1 --2- 172.21.2.105:0/1537664723 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7cc0004e70 0x7f7cc000b750 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:23.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7ce5d14700 1 -- 172.21.2.105:0/1537664723 >> 172.21.2.105:0/1537664723 conn(0x7f7ce00b5320 msgr2=0x7f7ce00b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:23.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7ce5d14700 1 -- 172.21.2.105:0/1537664723 shutdown_connections 2021-11-12T05:48:23.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.248+0000 7f7ce5d14700 1 -- 172.21.2.105:0/1537664723 wait complete. 2021-11-12T05:48:23.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.252+0000 7f7ce5d14700 1 Processor -- start 2021-11-12T05:48:23.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.252+0000 7f7ce5d14700 1 -- start start 2021-11-12T05:48:23.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.252+0000 7f7ce5d14700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7cc0004e70 0x7f7ce014b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:23.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.252+0000 7f7ce5d14700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7ce014a710 0x7f7ce0066580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:23.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.252+0000 7f7ce5d14700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7ce0066a70 0x7f7ce0159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:23.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.252+0000 7f7ce5d14700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce0149a30 con 0x7f7ce0066a70 2021-11-12T05:48:23.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.252+0000 7f7ce5d14700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce0149dd0 con 0x7f7cc0004e70 2021-11-12T05:48:23.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.252+0000 7f7ce5d14700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce0065050 con 0x7f7ce014a710 2021-11-12T05:48:23.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.252+0000 7f7cdffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7ce0066a70 0x7f7ce0159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:23.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.252+0000 7f7cdffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7ce0066a70 0x7f7ce0159db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50350/0 (socket says 172.21.2.105:50350) 2021-11-12T05:48:23.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.252+0000 7f7cdffff700 1 -- 172.21.2.105:0/345990257 learned_addr learned my addr 172.21.2.105:0/345990257 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:23.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.252+0000 7f7cdeffd700 1 --2- 172.21.2.105:0/345990257 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7ce014a710 0x7f7ce0066580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:23.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.252+0000 7f7cdf7fe700 1 --2- 172.21.2.105:0/345990257 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7cc0004e70 0x7f7ce014b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:23.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.252+0000 7f7cdffff700 1 -- 172.21.2.105:0/345990257 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7ce014a710 msgr2=0x7f7ce0066580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:23.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.252+0000 7f7cdffff700 1 --2- 172.21.2.105:0/345990257 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7ce014a710 0x7f7ce0066580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:23.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.252+0000 7f7cdffff700 1 -- 172.21.2.105:0/345990257 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7cc0004e70 msgr2=0x7f7ce014b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:23.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.252+0000 7f7cdffff700 1 --2- 172.21.2.105:0/345990257 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7cc0004e70 0x7f7ce014b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:23.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.252+0000 7f7cdffff700 1 -- 172.21.2.105:0/345990257 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce01492f0 con 0x7f7ce0066a70 2021-11-12T05:48:23.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.252+0000 7f7cdffff700 1 --2- 172.21.2.105:0/345990257 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7ce0066a70 0x7f7ce0159db0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7f7ce0149910 tx=0x7f7cd8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:23.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.252+0000 7f7cdcff9700 1 -- 172.21.2.105:0/345990257 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cd8001620 con 0x7f7ce0066a70 2021-11-12T05:48:23.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.252+0000 7f7cdcff9700 1 -- 172.21.2.105:0/345990257 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd801d600 con 0x7f7ce0066a70 2021-11-12T05:48:23.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.252+0000 7f7ce5d14700 1 -- 172.21.2.105:0/345990257 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ce0149590 con 0x7f7ce0066a70 2021-11-12T05:48:23.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.252+0000 7f7cdcff9700 1 -- 172.21.2.105:0/345990257 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cd8007b60 con 0x7f7ce0066a70 2021-11-12T05:48:23.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.252+0000 7f7ce5d14700 1 -- 172.21.2.105:0/345990257 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ce0148850 con 0x7f7ce0066a70 2021-11-12T05:48:23.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.252+0000 7f7ce5d14700 1 -- 172.21.2.105:0/345990257 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ce0149720 con 0x7f7ce0066a70 2021-11-12T05:48:23.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.252+0000 7f7cdcff9700 1 -- 172.21.2.105:0/345990257 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7cd8024030 con 0x7f7ce0066a70 2021-11-12T05:48:23.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.252+0000 7f7cdcff9700 1 --2- 172.21.2.105:0/345990257 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7cc4053520 0x7f7cc40559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:23.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.252+0000 7f7cdcff9700 1 -- 172.21.2.105:0/345990257 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f7cd806c170 con 0x7f7ce0066a70 2021-11-12T05:48:23.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.252+0000 7f7cdf7fe700 1 --2- 172.21.2.105:0/345990257 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7cc4053520 0x7f7cc40559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:23.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.252+0000 7f7cdf7fe700 1 --2- 172.21.2.105:0/345990257 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7cc4053520 0x7f7cc40559e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f7cd000d000 tx=0x7f7cd0007040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:23.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.256+0000 7f7cdcff9700 1 -- 172.21.2.105:0/345990257 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7cd8043450 con 0x7f7ce0066a70 2021-11-12T05:48:23.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:23.348+0000 7f7ce5d14700 1 -- 172.21.2.105:0/345990257 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f7ce0062a90 con 0x7f7ce0066a70 2021-11-12T05:48:24.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.240+0000 7f7cdcff9700 1 -- 172.21.2.105:0/345990257 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v112) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7cd8022020 con 0x7f7ce0066a70 2021-11-12T05:48:24.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.248+0000 7f7ce5d14700 1 -- 172.21.2.105:0/345990257 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7cc4053520 msgr2=0x7f7cc40559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:24.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.248+0000 7f7ce5d14700 1 --2- 172.21.2.105:0/345990257 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7cc4053520 0x7f7cc40559e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f7cd000d000 tx=0x7f7cd0007040).stop 2021-11-12T05:48:24.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.248+0000 7f7ce5d14700 1 -- 172.21.2.105:0/345990257 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7ce0066a70 msgr2=0x7f7ce0159db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:24.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.248+0000 7f7ce5d14700 1 --2- 172.21.2.105:0/345990257 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7ce0066a70 0x7f7ce0159db0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7f7ce0149910 tx=0x7f7cd8016000).stop 2021-11-12T05:48:24.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.248+0000 7f7ce5d14700 1 -- 172.21.2.105:0/345990257 shutdown_connections 2021-11-12T05:48:24.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.248+0000 7f7ce5d14700 1 --2- 172.21.2.105:0/345990257 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7cc4053520 0x7f7cc40559e0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:24.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.248+0000 7f7ce5d14700 1 --2- 172.21.2.105:0/345990257 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7ce0066a70 0x7f7ce0159db0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:24.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.248+0000 7f7ce5d14700 1 --2- 172.21.2.105:0/345990257 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7ce014a710 0x7f7ce0066580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:24.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.248+0000 7f7ce5d14700 1 --2- 172.21.2.105:0/345990257 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7cc0004e70 0x7f7ce014b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:24.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.248+0000 7f7ce5d14700 1 -- 172.21.2.105:0/345990257 >> 172.21.2.105:0/345990257 conn(0x7f7ce00b5320 msgr2=0x7f7ce012f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:24.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.248+0000 7f7ce5d14700 1 -- 172.21.2.105:0/345990257 shutdown_connections 2021-11-12T05:48:24.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.248+0000 7f7ce5d14700 1 -- 172.21.2.105:0/345990257 wait complete. 2021-11-12T05:48:24.254 INFO:teuthology.orchestra.run.gibba005.stderr: removed all blacklist entries 2021-11-12T05:48:24.263 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-11-12T05:48:24.264 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-11-12T05:48:24.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.356+0000 7f2320e82700 1 Processor -- start 2021-11-12T05:48:24.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.356+0000 7f2320e82700 1 -- start start 2021-11-12T05:48:24.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.356+0000 7f2320e82700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f231c0b37d0 0x7f231c141500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:24.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.356+0000 7f2320e82700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f231c1419f0 0x7f231c0b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:24.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.356+0000 7f2320e82700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f231c0b26e0 con 0x7f231c060100 2021-11-12T05:48:24.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.356+0000 7f2320e82700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f231c0604e0 con 0x7f231c0b37d0 2021-11-12T05:48:24.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.356+0000 7f2320e82700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f231c145160 con 0x7f231c1419f0 2021-11-12T05:48:24.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.356+0000 7f2319d9b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f231c0b37d0 0x7f231c141500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:24.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.356+0000 7f2319d9b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f231c0b37d0 0x7f231c141500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50360/0 (socket says 172.21.2.105:50360) 2021-11-12T05:48:24.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.356+0000 7f2319d9b700 1 -- 172.21.2.105:0/2461616515 learned_addr learned my addr 172.21.2.105:0/2461616515 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:24.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.356+0000 7f2319d9b700 1 -- 172.21.2.105:0/2461616515 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f231c1419f0 msgr2=0x7f231c0b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:24.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.356+0000 7f2319d9b700 1 --2- 172.21.2.105:0/2461616515 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f231c1419f0 0x7f231c0b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:24.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.356+0000 7f2319d9b700 1 -- 172.21.2.105:0/2461616515 >> v1:172.21.2.115:6789/0 conn(0x7f231c060100 legacy=0x7f231c0b1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:24.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.356+0000 7f2319d9b700 1 -- 172.21.2.105:0/2461616515 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231c141060 con 0x7f231c0b37d0 2021-11-12T05:48:24.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.356+0000 7f2319d9b700 1 --2- 172.21.2.105:0/2461616515 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f231c0b37d0 0x7f231c141500 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 rx=0x7f231c0640c0 tx=0x7f2304006eb0).ready entity=mon.0 client_cookie=93f2eff31505188b server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:24.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.356+0000 7f231959a700 1 -- 172.21.2.105:0/2461616515 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f230400d570 con 0x7f231c0b37d0 2021-11-12T05:48:24.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.356+0000 7f231959a700 1 -- 172.21.2.105:0/2461616515 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2304000e90 con 0x7f231c0b37d0 2021-11-12T05:48:24.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.356+0000 7f231959a700 1 -- 172.21.2.105:0/2461616515 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f230400d900 con 0x7f231c0b37d0 2021-11-12T05:48:24.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.360+0000 7f2320e82700 1 -- 172.21.2.105:0/2461616515 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f231c0b37d0 msgr2=0x7f231c141500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:24.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.360+0000 7f2320e82700 1 --2- 172.21.2.105:0/2461616515 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f231c0b37d0 0x7f231c141500 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 rx=0x7f231c0640c0 tx=0x7f2304006eb0).stop 2021-11-12T05:48:24.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.360+0000 7f2320e82700 1 -- 172.21.2.105:0/2461616515 shutdown_connections 2021-11-12T05:48:24.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.360+0000 7f2320e82700 1 --2- 172.21.2.105:0/2461616515 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f231c1419f0 0x7f231c0b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:24.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.360+0000 7f2320e82700 1 --2- 172.21.2.105:0/2461616515 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f231c0b37d0 0x7f231c141500 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:24.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.360+0000 7f2320e82700 1 -- 172.21.2.105:0/2461616515 >> 172.21.2.105:0/2461616515 conn(0x7f231c0608d0 msgr2=0x7f231c05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:24.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.360+0000 7f2320e82700 1 -- 172.21.2.105:0/2461616515 shutdown_connections 2021-11-12T05:48:24.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.360+0000 7f2320e82700 1 -- 172.21.2.105:0/2461616515 wait complete. 2021-11-12T05:48:24.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.360+0000 7f2320e82700 1 Processor -- start 2021-11-12T05:48:24.373 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.360+0000 7f2320e82700 1 -- start start 2021-11-12T05:48:24.373 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.360+0000 7f2320e82700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f231c060100 0x7f231c0b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:24.373 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.360+0000 7f2320e82700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f231c0b37d0 0x7f231c0b6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:24.373 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.360+0000 7f2320e82700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f231c1419f0 0x7f231c0b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:24.374 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.360+0000 7f2320e82700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231c12bab0 con 0x7f231c0b37d0 2021-11-12T05:48:24.374 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.360+0000 7f2320e82700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231c12bce0 con 0x7f231c1419f0 2021-11-12T05:48:24.374 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.360+0000 7f2320e82700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f231c140650 con 0x7f231c060100 2021-11-12T05:48:24.374 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.360+0000 7f2319d9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f231c0b37d0 0x7f231c0b6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:24.374 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.360+0000 7f2319d9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f231c0b37d0 0x7f231c0b6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50366/0 (socket says 172.21.2.105:50366) 2021-11-12T05:48:24.375 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.360+0000 7f2319d9b700 1 -- 172.21.2.105:0/818484671 learned_addr learned my addr 172.21.2.105:0/818484671 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:24.375 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.360+0000 7f2319d9b700 1 -- 172.21.2.105:0/818484671 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f231c060100 msgr2=0x7f231c0b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:24.375 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.360+0000 7f2319d9b700 1 --2- 172.21.2.105:0/818484671 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f231c060100 0x7f231c0b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:24.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.360+0000 7f2319d9b700 1 -- 172.21.2.105:0/818484671 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f231c1419f0 msgr2=0x7f231c0b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:24.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.360+0000 7f2319d9b700 1 --2- 172.21.2.105:0/818484671 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f231c1419f0 0x7f231c0b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:24.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.360+0000 7f2319d9b700 1 -- 172.21.2.105:0/818484671 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f230400b1e0 con 0x7f231c0b37d0 2021-11-12T05:48:24.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.360+0000 7f2319d9b700 1 --2- 172.21.2.105:0/818484671 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f231c0b37d0 0x7f231c0b6680 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 rx=0x7f231c0640c0 tx=0x7f2304015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:24.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.360+0000 7f23137fe700 1 -- 172.21.2.105:0/818484671 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2304006be0 con 0x7f231c0b37d0 2021-11-12T05:48:24.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.360+0000 7f23137fe700 1 -- 172.21.2.105:0/818484671 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2304002f50 con 0x7f231c0b37d0 2021-11-12T05:48:24.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.360+0000 7f23137fe700 1 -- 172.21.2.105:0/818484671 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f230400de40 con 0x7f231c0b37d0 2021-11-12T05:48:24.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.360+0000 7f2320e82700 1 -- 172.21.2.105:0/818484671 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f231c140af0 con 0x7f231c0b37d0 2021-11-12T05:48:24.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.360+0000 7f2320e82700 1 -- 172.21.2.105:0/818484671 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f231c0b6370 con 0x7f231c0b37d0 2021-11-12T05:48:24.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.360+0000 7f2320e82700 1 -- 172.21.2.105:0/818484671 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f231c0ae720 con 0x7f231c0b37d0 2021-11-12T05:48:24.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.360+0000 7f23137fe700 1 -- 172.21.2.105:0/818484671 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f230400f070 con 0x7f231c0b37d0 2021-11-12T05:48:24.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.360+0000 7f23137fe700 1 --2- 172.21.2.105:0/818484671 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2300053660 0x7f2300055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:24.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.360+0000 7f23137fe700 1 -- 172.21.2.105:0/818484671 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f230406d2f0 con 0x7f231c0b37d0 2021-11-12T05:48:24.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.360+0000 7f231a59c700 1 --2- 172.21.2.105:0/818484671 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2300053660 0x7f2300055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:24.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.364+0000 7f231a59c700 1 --2- 172.21.2.105:0/818484671 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2300053660 0x7f2300055b20 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f230c002f90 tx=0x7f230c0069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:24.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.364+0000 7f23137fe700 1 -- 172.21.2.105:0/818484671 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f231c0ae720 con 0x7f231c0b37d0 2021-11-12T05:48:24.478 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.472+0000 7f2320e82700 1 -- 172.21.2.105:0/818484671 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f231c1404b0 con 0x7f231c0b37d0 2021-11-12T05:48:24.479 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.472+0000 7f23137fe700 1 -- 172.21.2.105:0/818484671 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v37) v1 ==== 80+0+4242 (secure 0 0 0) 0x7f231c1404b0 con 0x7f231c0b37d0 2021-11-12T05:48:24.479 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:24.479 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:48:24.480 INFO:teuthology.orchestra.run.gibba005.stdout: "auth_dump": [ 2021-11-12T05:48:24.480 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:24.480 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mds.a", 2021-11-12T05:48:24.480 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1hGVLeOhAAX2029T+USC1Um93TSzjxdA==", 2021-11-12T05:48:24.480 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:48:24.481 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:48:24.481 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:48:24.481 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:48:24.481 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:48:24.482 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:24.482 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:24.482 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:24.482 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mds.b", 2021-11-12T05:48:24.483 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hiebUAxAAGcjDAGyvecjzagGoRBX8tg==", 2021-11-12T05:48:24.483 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:48:24.483 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:48:24.483 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:48:24.483 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:48:24.484 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:48:24.484 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:24.484 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:24.484 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:24.485 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.0", 2021-11-12T05:48:24.485 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1ht05fORAAN2YrbsxBau1FQC4C8Dvb3g==", 2021-11-12T05:48:24.485 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:48:24.485 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:48:24.486 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:48:24.486 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:48:24.486 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:24.486 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:24.487 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:24.487 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.1", 2021-11-12T05:48:24.487 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAu/o1hzp1vGhAAQ6u3Npb+yNGlNOUdoHzFZA==", 2021-11-12T05:48:24.487 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:48:24.487 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:48:24.488 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:48:24.488 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:48:24.488 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:24.488 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:24.488 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:24.489 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.2", 2021-11-12T05:48:24.489 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAw/o1hHWwOOhAAx7txWG8rbch18+SBnJkfkQ==", 2021-11-12T05:48:24.489 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:48:24.489 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:48:24.490 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:48:24.490 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:48:24.490 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:24.490 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:24.491 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:24.491 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.3", 2021-11-12T05:48:24.491 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAz/o1howZpHxAAKgUVxU2tSNZbxW+6OfJF9g==", 2021-11-12T05:48:24.491 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:48:24.491 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:48:24.492 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:48:24.492 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:48:24.492 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:24.492 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:24.492 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:24.493 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.4", 2021-11-12T05:48:24.493 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA2/o1humA5KRAAVbO6UYLOBQDq3WiEkkS6xw==", 2021-11-12T05:48:24.493 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:48:24.493 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:48:24.494 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:48:24.494 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:48:24.494 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:24.494 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:24.495 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:24.495 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.5", 2021-11-12T05:48:24.495 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA5/o1hALdKDRAAR9nsaDOo9GUgpmBPHVp5HQ==", 2021-11-12T05:48:24.495 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:48:24.496 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:48:24.496 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:48:24.496 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:48:24.496 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:24.496 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:24.497 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:24.497 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.6", 2021-11-12T05:48:24.497 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA7/o1hCVP2KhAAHj5SxnJ81mKrJOg2CE2wLQ==", 2021-11-12T05:48:24.497 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:48:24.498 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:48:24.498 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:48:24.498 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:48:24.498 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:24.498 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:24.499 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:24.499 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.7", 2021-11-12T05:48:24.499 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA+/o1hWCEqEBAAv8nF9NeF2Ue5W8Ijj8Skgg==", 2021-11-12T05:48:24.499 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:48:24.500 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:48:24.500 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:48:24.500 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:48:24.500 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:24.500 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:24.501 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:24.501 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.0", 2021-11-12T05:48:24.501 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hzEzhCBAATF8giEBtrj13SAr5EJV4TA==", 2021-11-12T05:48:24.501 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:48:24.501 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:48:24.502 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow r", 2021-11-12T05:48:24.502 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-12T05:48:24.502 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:24.502 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:24.503 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:24.503 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.1", 2021-11-12T05:48:24.503 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hO6zfCxAAae1obagtpsnA9e8FlTExVA==", 2021-11-12T05:48:24.503 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:48:24.503 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:48:24.504 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow r", 2021-11-12T05:48:24.504 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-12T05:48:24.504 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:24.505 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:24.505 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:24.505 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.2", 2021-11-12T05:48:24.505 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hFYDGDhAAyz77VXKtOz86ztJ8FUIvAg==", 2021-11-12T05:48:24.506 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:48:24.506 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:48:24.506 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow r", 2021-11-12T05:48:24.506 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-12T05:48:24.506 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:24.507 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:24.507 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:24.507 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.admin", 2021-11-12T05:48:24.507 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1hwdoBHRAAUHHEU3dbyso2BnE/JppV8A==", 2021-11-12T05:48:24.508 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:48:24.508 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow *", 2021-11-12T05:48:24.508 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:48:24.508 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:48:24.508 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:48:24.509 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:24.509 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:24.509 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:24.509 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mgr.x", 2021-11-12T05:48:24.509 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1h6JBaORAAbgxQtCzGNj7MLfgwGd4cWA==", 2021-11-12T05:48:24.510 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:48:24.510 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow *", 2021-11-12T05:48:24.510 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow profile mgr", 2021-11-12T05:48:24.510 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:48:24.511 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:24.511 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:24.511 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:24.511 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mgr.y", 2021-11-12T05:48:24.511 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1hwfvvNRAASU7NmYBG/Yb6/ma1/Ew7mw==", 2021-11-12T05:48:24.512 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:48:24.512 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow *", 2021-11-12T05:48:24.512 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow profile mgr", 2021-11-12T05:48:24.512 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:48:24.513 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:24.513 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:24.513 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:24.513 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:48:24.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.476+0000 7f2320e82700 1 -- 172.21.2.105:0/818484671 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2300053660 msgr2=0x7f2300055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:24.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.476+0000 7f2320e82700 1 --2- 172.21.2.105:0/818484671 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2300053660 0x7f2300055b20 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f230c002f90 tx=0x7f230c0069b0).stop 2021-11-12T05:48:24.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.476+0000 7f2320e82700 1 -- 172.21.2.105:0/818484671 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f231c0b37d0 msgr2=0x7f231c0b6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:24.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.476+0000 7f2320e82700 1 --2- 172.21.2.105:0/818484671 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f231c0b37d0 0x7f231c0b6680 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 rx=0x7f231c0640c0 tx=0x7f2304015000).stop 2021-11-12T05:48:24.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.476+0000 7f2320e82700 1 -- 172.21.2.105:0/818484671 shutdown_connections 2021-11-12T05:48:24.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.476+0000 7f2320e82700 1 --2- 172.21.2.105:0/818484671 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2300053660 0x7f2300055b20 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:24.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.476+0000 7f2320e82700 1 --2- 172.21.2.105:0/818484671 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f231c1419f0 0x7f231c0b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:24.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.476+0000 7f2320e82700 1 --2- 172.21.2.105:0/818484671 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f231c0b37d0 0x7f231c0b6680 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:24.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.476+0000 7f2320e82700 1 --2- 172.21.2.105:0/818484671 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f231c060100 0x7f231c0b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:24.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.476+0000 7f2320e82700 1 -- 172.21.2.105:0/818484671 >> 172.21.2.105:0/818484671 conn(0x7f231c0608d0 msgr2=0x7f231c065690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:24.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.476+0000 7f2320e82700 1 -- 172.21.2.105:0/818484671 shutdown_connections 2021-11-12T05:48:24.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.476+0000 7f2320e82700 1 -- 172.21.2.105:0/818484671 wait complete. 2021-11-12T05:48:24.518 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:48:24.568 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.564+0000 7fb5b8ddf700 1 Processor -- start 2021-11-12T05:48:24.568 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.564+0000 7fb5b8ddf700 1 -- start start 2021-11-12T05:48:24.570 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.564+0000 7fb5b8ddf700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb5b40ad080 0x7fb5b40af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:24.570 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.564+0000 7fb5b8ddf700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fb5b40ac280 0x7fb5b40ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:24.570 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.564+0000 7fb5b8ddf700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5b40ac7b0 con 0x7fb5b414abe0 2021-11-12T05:48:24.570 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.564+0000 7fb5b8ddf700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5b41488a0 con 0x7fb5b40ad080 2021-11-12T05:48:24.571 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.564+0000 7fb5b8ddf700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5b40ac9e0 con 0x7fb5b40ac280 2021-11-12T05:48:24.571 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.564+0000 7fb5b259c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb5b40ad080 0x7fb5b40af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:24.571 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.564+0000 7fb5b259c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb5b40ad080 0x7fb5b40af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50370/0 (socket says 172.21.2.105:50370) 2021-11-12T05:48:24.571 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.564+0000 7fb5b259c700 1 -- 172.21.2.105:0/1183705831 learned_addr learned my addr 172.21.2.105:0/1183705831 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:24.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.564+0000 7fb5b259c700 1 -- 172.21.2.105:0/1183705831 >> v2:172.21.2.115:3300/0 conn(0x7fb5b40ac280 msgr2=0x7fb5b40ad460 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:48:24.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.564+0000 7fb5b259c700 1 --2- 172.21.2.105:0/1183705831 >> v2:172.21.2.115:3300/0 conn(0x7fb5b40ac280 0x7fb5b40ad460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:24.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.564+0000 7fb5b259c700 1 -- 172.21.2.105:0/1183705831 >> v1:172.21.2.115:6789/0 conn(0x7fb5b414abe0 legacy=0x7fb5b414b090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:48:24.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.564+0000 7fb5b259c700 1 -- 172.21.2.105:0/1183705831 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b40b0b30 con 0x7fb5b40ad080 2021-11-12T05:48:24.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.564+0000 7fb5b259c700 1 --2- 172.21.2.105:0/1183705831 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb5b40ad080 0x7fb5b40af730 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 rx=0x7fb5b414bc40 tx=0x7fb59c006eb0).ready entity=mon.0 client_cookie=775c4b533b3b4351 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:24.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.564+0000 7fb5b159a700 1 -- 172.21.2.105:0/1183705831 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb59c00d5c0 con 0x7fb5b40ad080 2021-11-12T05:48:24.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.564+0000 7fb5b159a700 1 -- 172.21.2.105:0/1183705831 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59c000e90 con 0x7fb5b40ad080 2021-11-12T05:48:24.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.564+0000 7fb5b159a700 1 -- 172.21.2.105:0/1183705831 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb59c00d910 con 0x7fb5b40ad080 2021-11-12T05:48:24.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.564+0000 7fb5b8ddf700 1 -- 172.21.2.105:0/1183705831 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb5b40ad080 msgr2=0x7fb5b40af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:24.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.564+0000 7fb5b8ddf700 1 --2- 172.21.2.105:0/1183705831 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb5b40ad080 0x7fb5b40af730 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 rx=0x7fb5b414bc40 tx=0x7fb59c006eb0).stop 2021-11-12T05:48:24.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.564+0000 7fb5b8ddf700 1 -- 172.21.2.105:0/1183705831 shutdown_connections 2021-11-12T05:48:24.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.564+0000 7fb5b8ddf700 1 --2- 172.21.2.105:0/1183705831 >> v2:172.21.2.115:3300/0 conn(0x7fb5b40ac280 0x7fb5b40ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:24.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.564+0000 7fb5b8ddf700 1 --2- 172.21.2.105:0/1183705831 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb5b40ad080 0x7fb5b40af730 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:24.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.564+0000 7fb5b8ddf700 1 -- 172.21.2.105:0/1183705831 >> 172.21.2.105:0/1183705831 conn(0x7fb5b40b5370 msgr2=0x7fb5b40b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:24.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.564+0000 7fb5b8ddf700 1 -- 172.21.2.105:0/1183705831 shutdown_connections 2021-11-12T05:48:24.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.564+0000 7fb5b8ddf700 1 -- 172.21.2.105:0/1183705831 wait complete. 2021-11-12T05:48:24.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.564+0000 7fb5b8ddf700 1 Processor -- start 2021-11-12T05:48:24.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.564+0000 7fb5b8ddf700 1 -- start start 2021-11-12T05:48:24.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.568+0000 7fb5b8ddf700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb5b40ac280 0x7fb5b4062af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:24.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.568+0000 7fb5b8ddf700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb5b40ad080 0x7fb5b40669a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:24.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.568+0000 7fb5b8ddf700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb5b414abe0 0x7fb5b4066e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:24.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.568+0000 7fb5b8ddf700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b4144600 con 0x7fb5b414abe0 2021-11-12T05:48:24.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.568+0000 7fb5b8ddf700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b40651a0 con 0x7fb5b40ad080 2021-11-12T05:48:24.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.568+0000 7fb5b8ddf700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b4065440 con 0x7fb5b40ac280 2021-11-12T05:48:24.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.568+0000 7fb5b2d9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb5b414abe0 0x7fb5b4066e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:24.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.568+0000 7fb5b2d9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb5b414abe0 0x7fb5b4066e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50378/0 (socket says 172.21.2.105:50378) 2021-11-12T05:48:24.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.568+0000 7fb5b2d9d700 1 -- 172.21.2.105:0/2134653219 learned_addr learned my addr 172.21.2.105:0/2134653219 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:24.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.568+0000 7fb5b2d9d700 1 -- 172.21.2.105:0/2134653219 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb5b40ac280 msgr2=0x7fb5b4062af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:24.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.568+0000 7fb5b2d9d700 1 --2- 172.21.2.105:0/2134653219 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb5b40ac280 0x7fb5b4062af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:24.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.568+0000 7fb5b2d9d700 1 -- 172.21.2.105:0/2134653219 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb5b40ad080 msgr2=0x7fb5b40669a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:24.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.568+0000 7fb5b2d9d700 1 --2- 172.21.2.105:0/2134653219 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb5b40ad080 0x7fb5b40669a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:24.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.568+0000 7fb5b2d9d700 1 -- 172.21.2.105:0/2134653219 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb59c00b1e0 con 0x7fb5b414abe0 2021-11-12T05:48:24.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.568+0000 7fb5b2d9d700 1 --2- 172.21.2.105:0/2134653219 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb5b414abe0 0x7fb5b4066e90 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 rx=0x7fb5ac001250 tx=0x7fb5ac0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:24.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.568+0000 7fb5ab7fe700 1 -- 172.21.2.105:0/2134653219 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5ac0014e0 con 0x7fb5b414abe0 2021-11-12T05:48:24.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.568+0000 7fb5ab7fe700 1 -- 172.21.2.105:0/2134653219 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5ac001640 con 0x7fb5b414abe0 2021-11-12T05:48:24.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.568+0000 7fb5ab7fe700 1 -- 172.21.2.105:0/2134653219 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5ac0019a0 con 0x7fb5b414abe0 2021-11-12T05:48:24.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.568+0000 7fb5b8ddf700 1 -- 172.21.2.105:0/2134653219 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5b40aab40 con 0x7fb5b414abe0 2021-11-12T05:48:24.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.568+0000 7fb5b8ddf700 1 -- 172.21.2.105:0/2134653219 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5b40aafe0 con 0x7fb5b414abe0 2021-11-12T05:48:24.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.568+0000 7fb5b8ddf700 1 -- 172.21.2.105:0/2134653219 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5b40aacd0 con 0x7fb5b414abe0 2021-11-12T05:48:24.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.568+0000 7fb5ab7fe700 1 -- 172.21.2.105:0/2134653219 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb5ac018030 con 0x7fb5b414abe0 2021-11-12T05:48:24.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.568+0000 7fb5ab7fe700 1 --2- 172.21.2.105:0/2134653219 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb598053660 0x7fb598055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:24.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.568+0000 7fb5ab7fe700 1 -- 172.21.2.105:0/2134653219 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fb5ac06b0a0 con 0x7fb5b414abe0 2021-11-12T05:48:24.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.568+0000 7fb5b259c700 1 --2- 172.21.2.105:0/2134653219 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb598053660 0x7fb598055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:24.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.568+0000 7fb5b259c700 1 --2- 172.21.2.105:0/2134653219 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb598053660 0x7fb598055b20 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7fb5b414bc40 tx=0x7fb59c015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:24.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.572+0000 7fb5ab7fe700 1 -- 172.21.2.105:0/2134653219 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb5ac042490 con 0x7fb5b414abe0 2021-11-12T05:48:24.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.652+0000 7fb5b8ddf700 1 -- 172.21.2.105:0/2134653219 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5b4057350 con 0x7fb5b414abe0 2021-11-12T05:48:24.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.652+0000 7fb5ab7fe700 1 -- 172.21.2.105:0/2134653219 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+13424 (secure 0 0 0) 0x7fb5ac023480 con 0x7fb5b414abe0 2021-11-12T05:48:24.659 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:24.659 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":112,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:48:24.234857+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:48:24.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.656+0000 7fb5b8ddf700 1 -- 172.21.2.105:0/2134653219 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb598053660 msgr2=0x7fb598055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:24.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.656+0000 7fb5b8ddf700 1 --2- 172.21.2.105:0/2134653219 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb598053660 0x7fb598055b20 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7fb5b414bc40 tx=0x7fb59c015000).stop 2021-11-12T05:48:24.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.656+0000 7fb5b8ddf700 1 -- 172.21.2.105:0/2134653219 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb5b414abe0 msgr2=0x7fb5b4066e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:24.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.656+0000 7fb5b8ddf700 1 --2- 172.21.2.105:0/2134653219 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb5b414abe0 0x7fb5b4066e90 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 rx=0x7fb5ac001250 tx=0x7fb5ac0090f0).stop 2021-11-12T05:48:24.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.656+0000 7fb5b8ddf700 1 -- 172.21.2.105:0/2134653219 shutdown_connections 2021-11-12T05:48:24.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.656+0000 7fb5b8ddf700 1 --2- 172.21.2.105:0/2134653219 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb598053660 0x7fb598055b20 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:24.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.656+0000 7fb5b8ddf700 1 --2- 172.21.2.105:0/2134653219 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb5b414abe0 0x7fb5b4066e90 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:24.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.656+0000 7fb5b8ddf700 1 --2- 172.21.2.105:0/2134653219 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb5b40ad080 0x7fb5b40669a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:24.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.656+0000 7fb5b8ddf700 1 --2- 172.21.2.105:0/2134653219 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb5b40ac280 0x7fb5b4062af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:24.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.656+0000 7fb5b8ddf700 1 -- 172.21.2.105:0/2134653219 >> 172.21.2.105:0/2134653219 conn(0x7fb5b40b5370 msgr2=0x7fb5b4144fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:24.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.656+0000 7fb5b8ddf700 1 -- 172.21.2.105:0/2134653219 shutdown_connections 2021-11-12T05:48:24.663 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.656+0000 7fb5b8ddf700 1 -- 172.21.2.105:0/2134653219 wait complete. 2021-11-12T05:48:24.666 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-12T05:48:24.667 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:48:24.719 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.716+0000 7fc95aedb700 1 Processor -- start 2021-11-12T05:48:24.719 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.716+0000 7fc95aedb700 1 -- start start 2021-11-12T05:48:24.720 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.716+0000 7fc95aedb700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc9540aec50 0x7fc954145120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:24.720 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.716+0000 7fc95aedb700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fc954060d80 0x7fc954142530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:24.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.716+0000 7fc95aedb700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9540b1770 con 0x7fc9540b12a0 2021-11-12T05:48:24.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.716+0000 7fc95aedb700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc954142320 con 0x7fc954060d80 2021-11-12T05:48:24.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.716+0000 7fc95aedb700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc954062a70 con 0x7fc9540aec50 2021-11-12T05:48:24.722 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.716+0000 7fc959478700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7fc9540b12a0 0x7fc9540669c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:59246/0 (socket says 172.21.2.105:59246) 2021-11-12T05:48:24.722 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.716+0000 7fc959478700 1 -- 172.21.2.105:0/2589075075 learned_addr learned my addr 172.21.2.105:0/2589075075 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:24.723 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.716+0000 7fc953fff700 1 --2- 172.21.2.105:0/2589075075 >> v2:172.21.2.115:3300/0 conn(0x7fc954060d80 0x7fc954142530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:24.723 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.716+0000 7fc958c77700 1 --2- 172.21.2.105:0/2589075075 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc9540aec50 0x7fc954145120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:24.723 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.716+0000 7fc958c77700 1 -- 172.21.2.105:0/2589075075 >> v2:172.21.2.115:3300/0 conn(0x7fc954060d80 msgr2=0x7fc954142530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:24.723 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.716+0000 7fc958c77700 1 --2- 172.21.2.105:0/2589075075 >> v2:172.21.2.115:3300/0 conn(0x7fc954060d80 0x7fc954142530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:24.724 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.716+0000 7fc958c77700 1 -- 172.21.2.105:0/2589075075 >> v1:172.21.2.115:6789/0 conn(0x7fc9540b12a0 legacy=0x7fc9540669c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:24.724 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.716+0000 7fc958c77700 1 -- 172.21.2.105:0/2589075075 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9540b0380 con 0x7fc9540aec50 2021-11-12T05:48:24.724 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.716+0000 7fc953fff700 1 --2- 172.21.2.105:0/2589075075 >> v2:172.21.2.115:3300/0 conn(0x7fc954060d80 0x7fc954142530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-12T05:48:24.724 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.716+0000 7fc958c77700 1 --2- 172.21.2.105:0/2589075075 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc9540aec50 0x7fc954145120 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fc944002f70 tx=0x7fc944006df0).ready entity=mon.2 client_cookie=2a9bf981a1c412f0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:24.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.720+0000 7fc9537fe700 1 -- 172.21.2.105:0/2589075075 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc94400d570 con 0x7fc9540aec50 2021-11-12T05:48:24.728 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.720+0000 7fc9537fe700 1 -- 172.21.2.105:0/2589075075 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc944000e90 con 0x7fc9540aec50 2021-11-12T05:48:24.728 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.720+0000 7fc9537fe700 1 -- 172.21.2.105:0/2589075075 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc94400d8c0 con 0x7fc9540aec50 2021-11-12T05:48:24.728 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.720+0000 7fc95aedb700 1 -- 172.21.2.105:0/2589075075 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc9540aec50 msgr2=0x7fc954145120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:24.728 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.720+0000 7fc95aedb700 1 --2- 172.21.2.105:0/2589075075 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc9540aec50 0x7fc954145120 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fc944002f70 tx=0x7fc944006df0).stop 2021-11-12T05:48:24.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.720+0000 7fc95aedb700 1 -- 172.21.2.105:0/2589075075 shutdown_connections 2021-11-12T05:48:24.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.720+0000 7fc95aedb700 1 --2- 172.21.2.105:0/2589075075 >> v2:172.21.2.115:3300/0 conn(0x7fc954060d80 0x7fc954142530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:24.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.720+0000 7fc95aedb700 1 --2- 172.21.2.105:0/2589075075 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc9540aec50 0x7fc954145120 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:24.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.720+0000 7fc95aedb700 1 -- 172.21.2.105:0/2589075075 >> 172.21.2.105:0/2589075075 conn(0x7fc95405c490 msgr2=0x7fc9540b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:24.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.720+0000 7fc95aedb700 1 -- 172.21.2.105:0/2589075075 shutdown_connections 2021-11-12T05:48:24.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.720+0000 7fc95aedb700 1 -- 172.21.2.105:0/2589075075 wait complete. 2021-11-12T05:48:24.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.720+0000 7fc95aedb700 1 Processor -- start 2021-11-12T05:48:24.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.720+0000 7fc95aedb700 1 -- start start 2021-11-12T05:48:24.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.720+0000 7fc95aedb700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc954060d80 0x7fc9540a0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:24.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.720+0000 7fc95aedb700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc9540aec50 0x7fc9540a1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:24.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.720+0000 7fc95aedb700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc9540b12a0 0x7fc9540ab190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:24.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.720+0000 7fc95aedb700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95409fd40 con 0x7fc9540b12a0 2021-11-12T05:48:24.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.720+0000 7fc95aedb700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95409f620 con 0x7fc954060d80 2021-11-12T05:48:24.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.720+0000 7fc95aedb700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9540a39f0 con 0x7fc9540aec50 2021-11-12T05:48:24.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.720+0000 7fc959478700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc9540b12a0 0x7fc9540ab190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:24.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.720+0000 7fc959478700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc9540b12a0 0x7fc9540ab190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50388/0 (socket says 172.21.2.105:50388) 2021-11-12T05:48:24.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.720+0000 7fc959478700 1 -- 172.21.2.105:0/1548967444 learned_addr learned my addr 172.21.2.105:0/1548967444 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:24.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.720+0000 7fc959478700 1 -- 172.21.2.105:0/1548967444 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc9540aec50 msgr2=0x7fc9540a1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:24.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.720+0000 7fc959478700 1 --2- 172.21.2.105:0/1548967444 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc9540aec50 0x7fc9540a1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:24.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.720+0000 7fc959478700 1 -- 172.21.2.105:0/1548967444 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc954060d80 msgr2=0x7fc9540a0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:24.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.720+0000 7fc959478700 1 --2- 172.21.2.105:0/1548967444 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc954060d80 0x7fc9540a0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:24.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.720+0000 7fc959478700 1 -- 172.21.2.105:0/1548967444 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc93c00b180 con 0x7fc9540b12a0 2021-11-12T05:48:24.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.720+0000 7fc959478700 1 --2- 172.21.2.105:0/1548967444 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc9540b12a0 0x7fc9540ab190 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 rx=0x7fc9540b0930 tx=0x7fc94c007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:24.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.720+0000 7fc951ffb700 1 -- 172.21.2.105:0/1548967444 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc94c005ba0 con 0x7fc9540b12a0 2021-11-12T05:48:24.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.720+0000 7fc951ffb700 1 -- 172.21.2.105:0/1548967444 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94c005d00 con 0x7fc9540b12a0 2021-11-12T05:48:24.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.720+0000 7fc95aedb700 1 -- 172.21.2.105:0/1548967444 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc94400b180 con 0x7fc9540b12a0 2021-11-12T05:48:24.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.720+0000 7fc951ffb700 1 -- 172.21.2.105:0/1548967444 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc94c0072c0 con 0x7fc9540b12a0 2021-11-12T05:48:24.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.720+0000 7fc95aedb700 1 -- 172.21.2.105:0/1548967444 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9540a3720 con 0x7fc9540b12a0 2021-11-12T05:48:24.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.720+0000 7fc95aedb700 1 -- 172.21.2.105:0/1548967444 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9540b19a0 con 0x7fc9540b12a0 2021-11-12T05:48:24.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.724+0000 7fc951ffb700 1 -- 172.21.2.105:0/1548967444 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc94c010070 con 0x7fc9540b12a0 2021-11-12T05:48:24.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.724+0000 7fc951ffb700 1 --2- 172.21.2.105:0/1548967444 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc938053640 0x7fc938055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:24.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.724+0000 7fc951ffb700 1 -- 172.21.2.105:0/1548967444 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fc94c06af30 con 0x7fc9540b12a0 2021-11-12T05:48:24.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.724+0000 7fc958c77700 1 --2- 172.21.2.105:0/1548967444 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc938053640 0x7fc938055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:24.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.724+0000 7fc958c77700 1 --2- 172.21.2.105:0/1548967444 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc938053640 0x7fc938055b00 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7fc944002f70 tx=0x7fc944014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:24.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.724+0000 7fc951ffb700 1 -- 172.21.2.105:0/1548967444 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc94c042270 con 0x7fc9540b12a0 2021-11-12T05:48:24.811 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.808+0000 7fc95aedb700 1 -- 172.21.2.105:0/1548967444 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc954057350 con 0x7fc9540b12a0 2021-11-12T05:48:24.812 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.808+0000 7fc951ffb700 1 -- 172.21.2.105:0/1548967444 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v112) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc94c018030 con 0x7fc9540b12a0 2021-11-12T05:48:24.812 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:48:24.813 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.808+0000 7fc95aedb700 1 -- 172.21.2.105:0/1548967444 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc938053640 msgr2=0x7fc938055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:24.813 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.808+0000 7fc95aedb700 1 --2- 172.21.2.105:0/1548967444 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc938053640 0x7fc938055b00 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7fc944002f70 tx=0x7fc944014000).stop 2021-11-12T05:48:24.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.808+0000 7fc95aedb700 1 -- 172.21.2.105:0/1548967444 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc9540b12a0 msgr2=0x7fc9540ab190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:24.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.808+0000 7fc95aedb700 1 --2- 172.21.2.105:0/1548967444 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc9540b12a0 0x7fc9540ab190 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 rx=0x7fc9540b0930 tx=0x7fc94c007f60).stop 2021-11-12T05:48:24.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.808+0000 7fc95aedb700 1 -- 172.21.2.105:0/1548967444 shutdown_connections 2021-11-12T05:48:24.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.808+0000 7fc95aedb700 1 --2- 172.21.2.105:0/1548967444 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc938053640 0x7fc938055b00 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:24.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.808+0000 7fc95aedb700 1 --2- 172.21.2.105:0/1548967444 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc9540b12a0 0x7fc9540ab190 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:24.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.808+0000 7fc95aedb700 1 --2- 172.21.2.105:0/1548967444 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc9540aec50 0x7fc9540a1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:24.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.808+0000 7fc95aedb700 1 --2- 172.21.2.105:0/1548967444 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc954060d80 0x7fc9540a0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:24.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.808+0000 7fc95aedb700 1 -- 172.21.2.105:0/1548967444 >> 172.21.2.105:0/1548967444 conn(0x7fc95405c490 msgr2=0x7fc9540b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:24.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.808+0000 7fc95aedb700 1 -- 172.21.2.105:0/1548967444 shutdown_connections 2021-11-12T05:48:24.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.808+0000 7fc95aedb700 1 -- 172.21.2.105:0/1548967444 wait complete. 2021-11-12T05:48:24.819 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:48:24.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.868+0000 7efcf8431700 1 Processor -- start 2021-11-12T05:48:24.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.868+0000 7efcf8431700 1 -- start start 2021-11-12T05:48:24.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.868+0000 7efcf8431700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efcf00aca40 0x7efcf00ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:24.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.868+0000 7efcf8431700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7efcf00b0520 0x7efcf01473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:24.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.868+0000 7efcf8431700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf00b1840 con 0x7efcf01478b0 2021-11-12T05:48:24.875 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.868+0000 7efcf8431700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf0147d40 con 0x7efcf00b0520 2021-11-12T05:48:24.875 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.868+0000 7efcf8431700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf00af2b0 con 0x7efcf00aca40 2021-11-12T05:48:24.875 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.868+0000 7efcf59cc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7efcf00b0520 0x7efcf01473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:24.875 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.868+0000 7efcf59cc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7efcf00b0520 0x7efcf01473c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50398/0 (socket says 172.21.2.105:50398) 2021-11-12T05:48:24.875 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.868+0000 7efcf59cc700 1 -- 172.21.2.105:0/1450790129 learned_addr learned my addr 172.21.2.105:0/1450790129 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:24.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.868+0000 7efcf59cc700 1 -- 172.21.2.105:0/1450790129 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efcf00aca40 msgr2=0x7efcf00ace20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:48:24.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.868+0000 7efcf59cc700 1 --2- 172.21.2.105:0/1450790129 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efcf00aca40 0x7efcf00ace20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:24.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.868+0000 7efcf59cc700 1 -- 172.21.2.105:0/1450790129 >> v1:172.21.2.115:6789/0 conn(0x7efcf01478b0 legacy=0x7efcf0144180 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:48:24.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.868+0000 7efcf59cc700 1 -- 172.21.2.105:0/1450790129 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf00b09a0 con 0x7efcf00b0520 2021-11-12T05:48:24.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.868+0000 7efcf59cc700 1 --2- 172.21.2.105:0/1450790129 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efcf00b0520 0x7efcf01473c0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 rx=0x7efcf00b00d0 tx=0x7efcec006eb0).ready entity=mon.0 client_cookie=25d65f002295201c server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:24.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.868+0000 7efcf51cb700 1 -- 172.21.2.105:0/1450790129 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efcec00d570 con 0x7efcf00b0520 2021-11-12T05:48:24.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.868+0000 7efcf51cb700 1 -- 172.21.2.105:0/1450790129 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcec000e90 con 0x7efcf00b0520 2021-11-12T05:48:24.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.868+0000 7efcf51cb700 1 -- 172.21.2.105:0/1450790129 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efcec00d8c0 con 0x7efcf00b0520 2021-11-12T05:48:24.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.868+0000 7efcf8431700 1 -- 172.21.2.105:0/1450790129 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efcf00b0520 msgr2=0x7efcf01473c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:24.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.868+0000 7efcf8431700 1 --2- 172.21.2.105:0/1450790129 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efcf00b0520 0x7efcf01473c0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 rx=0x7efcf00b00d0 tx=0x7efcec006eb0).stop 2021-11-12T05:48:24.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.868+0000 7efcf8431700 1 -- 172.21.2.105:0/1450790129 shutdown_connections 2021-11-12T05:48:24.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.868+0000 7efcf8431700 1 --2- 172.21.2.105:0/1450790129 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efcf00b0520 0x7efcf01473c0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:24.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.868+0000 7efcf8431700 1 --2- 172.21.2.105:0/1450790129 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efcf00aca40 0x7efcf00ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:24.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.868+0000 7efcf8431700 1 -- 172.21.2.105:0/1450790129 >> 172.21.2.105:0/1450790129 conn(0x7efcf005c490 msgr2=0x7efcf00b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:24.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.868+0000 7efcf8431700 1 -- 172.21.2.105:0/1450790129 shutdown_connections 2021-11-12T05:48:24.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.868+0000 7efcf8431700 1 -- 172.21.2.105:0/1450790129 wait complete. 2021-11-12T05:48:24.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.868+0000 7efcf8431700 1 Processor -- start 2021-11-12T05:48:24.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.868+0000 7efcf8431700 1 -- start start 2021-11-12T05:48:24.883 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.872+0000 7efcf8431700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efcf00aca40 0x7efcf00a7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:24.883 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.872+0000 7efcf8431700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efcf00b0520 0x7efcf00a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:24.883 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.872+0000 7efcf8431700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efcf01478b0 0x7efcf0159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:24.883 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.872+0000 7efcf8431700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf0064960 con 0x7efcf00b0520 2021-11-12T05:48:24.884 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.872+0000 7efcf8431700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf0157520 con 0x7efcf00aca40 2021-11-12T05:48:24.884 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.872+0000 7efcf8431700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf01577c0 con 0x7efcf01478b0 2021-11-12T05:48:24.884 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.872+0000 7efcf59cc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efcf00b0520 0x7efcf00a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:24.884 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.872+0000 7efcf59cc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efcf00b0520 0x7efcf00a83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50402/0 (socket says 172.21.2.105:50402) 2021-11-12T05:48:24.885 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.872+0000 7efcf59cc700 1 -- 172.21.2.105:0/653620144 learned_addr learned my addr 172.21.2.105:0/653620144 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:24.885 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.872+0000 7efcf59cc700 1 -- 172.21.2.105:0/653620144 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efcf01478b0 msgr2=0x7efcf0159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:24.885 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.872+0000 7efcf59cc700 1 --2- 172.21.2.105:0/653620144 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efcf01478b0 0x7efcf0159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:24.885 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.872+0000 7efcf59cc700 1 -- 172.21.2.105:0/653620144 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efcf00aca40 msgr2=0x7efcf00a7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:24.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.872+0000 7efcf59cc700 1 --2- 172.21.2.105:0/653620144 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efcf00aca40 0x7efcf00a7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:24.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.872+0000 7efcf59cc700 1 -- 172.21.2.105:0/653620144 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcec00b1e0 con 0x7efcf00b0520 2021-11-12T05:48:24.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.872+0000 7efcf59cc700 1 --2- 172.21.2.105:0/653620144 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efcf00b0520 0x7efcf00a83b0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7efcf00b00d0 tx=0x7efcec015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:24.886 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.872+0000 7efcdf7fe700 1 -- 172.21.2.105:0/653620144 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efcec006b60 con 0x7efcf00b0520 2021-11-12T05:48:24.887 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.872+0000 7efcdf7fe700 1 -- 172.21.2.105:0/653620144 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcec002f70 con 0x7efcf00b0520 2021-11-12T05:48:24.887 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.872+0000 7efcf8431700 1 -- 172.21.2.105:0/653620144 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf0064f50 con 0x7efcf00b0520 2021-11-12T05:48:24.887 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.872+0000 7efcdf7fe700 1 -- 172.21.2.105:0/653620144 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efcec00de20 con 0x7efcf00b0520 2021-11-12T05:48:24.887 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.872+0000 7efcf8431700 1 -- 172.21.2.105:0/653620144 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf00ac3e0 con 0x7efcf00b0520 2021-11-12T05:48:24.887 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.872+0000 7efcf8431700 1 -- 172.21.2.105:0/653620144 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf0157980 con 0x7efcf00b0520 2021-11-12T05:48:24.888 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.872+0000 7efcdf7fe700 1 -- 172.21.2.105:0/653620144 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efcec025030 con 0x7efcf00b0520 2021-11-12T05:48:24.888 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.872+0000 7efcdf7fe700 1 --2- 172.21.2.105:0/653620144 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efcd00536a0 0x7efcd0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:24.888 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.872+0000 7efcdf7fe700 1 -- 172.21.2.105:0/653620144 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5596+0+0 (secure 0 0 0) 0x7efcec06ca70 con 0x7efcf00b0520 2021-11-12T05:48:24.888 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.872+0000 7efcf61cd700 1 --2- 172.21.2.105:0/653620144 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efcd00536a0 0x7efcd0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:24.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.872+0000 7efcf61cd700 1 --2- 172.21.2.105:0/653620144 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efcd00536a0 0x7efcd0055b60 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7efce0002fb0 tx=0x7efce00069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:24.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.876+0000 7efcdf7fe700 1 -- 172.21.2.105:0/653620144 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efcec043db0 con 0x7efcf00b0520 2021-11-12T05:48:24.961 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.956+0000 7efcf8431700 1 -- 172.21.2.105:0/653620144 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efcf0057350 con 0x7efcf00b0520 2021-11-12T05:48:24.962 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.956+0000 7efcdf7fe700 1 -- 172.21.2.105:0/653620144 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v112) v1 ==== 92+0+10 (secure 0 0 0) 0x7efcec06ce60 con 0x7efcf00b0520 2021-11-12T05:48:24.962 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:48:24.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.956+0000 7efcf8431700 1 -- 172.21.2.105:0/653620144 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efcd00536a0 msgr2=0x7efcd0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:24.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.956+0000 7efcf8431700 1 --2- 172.21.2.105:0/653620144 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efcd00536a0 0x7efcd0055b60 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7efce0002fb0 tx=0x7efce00069b0).stop 2021-11-12T05:48:24.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.956+0000 7efcf8431700 1 -- 172.21.2.105:0/653620144 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efcf00b0520 msgr2=0x7efcf00a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:24.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.956+0000 7efcf8431700 1 --2- 172.21.2.105:0/653620144 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efcf00b0520 0x7efcf00a83b0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7efcf00b00d0 tx=0x7efcec015000).stop 2021-11-12T05:48:24.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.960+0000 7efcf8431700 1 -- 172.21.2.105:0/653620144 shutdown_connections 2021-11-12T05:48:24.965 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.960+0000 7efcf8431700 1 --2- 172.21.2.105:0/653620144 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efcd00536a0 0x7efcd0055b60 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:24.965 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.960+0000 7efcf8431700 1 --2- 172.21.2.105:0/653620144 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efcf01478b0 0x7efcf0159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:24.965 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.960+0000 7efcf8431700 1 --2- 172.21.2.105:0/653620144 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efcf00b0520 0x7efcf00a83b0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:24.965 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.960+0000 7efcf8431700 1 --2- 172.21.2.105:0/653620144 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efcf00aca40 0x7efcf00a7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:24.965 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.960+0000 7efcf8431700 1 -- 172.21.2.105:0/653620144 >> 172.21.2.105:0/653620144 conn(0x7efcf005c490 msgr2=0x7efcf00b3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:24.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.960+0000 7efcf8431700 1 -- 172.21.2.105:0/653620144 shutdown_connections 2021-11-12T05:48:24.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:24.960+0000 7efcf8431700 1 -- 172.21.2.105:0/653620144 wait complete. 2021-11-12T05:48:24.969 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-12T05:48:25.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.016+0000 7ff78356e700 1 Processor -- start 2021-11-12T05:48:25.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.016+0000 7ff78356e700 1 -- start start 2021-11-12T05:48:25.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.016+0000 7ff78356e700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff77c0ad080 0x7ff77c0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:25.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.016+0000 7ff78356e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff77c0ac280 0x7ff77c0ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:25.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.016+0000 7ff78356e700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff77c0ac7b0 con 0x7ff77c14abe0 2021-11-12T05:48:25.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.016+0000 7ff78356e700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff77c1488a0 con 0x7ff77c0ad080 2021-11-12T05:48:25.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.016+0000 7ff78356e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c0ac9e0 con 0x7ff77c0ac280 2021-11-12T05:48:25.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.016+0000 7ff781b0b700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7ff77c14abe0 0x7ff77c14b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60804/0 (socket says 172.21.2.105:60804) 2021-11-12T05:48:25.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.016+0000 7ff781b0b700 1 -- 172.21.2.105:0/4023354280 learned_addr learned my addr 172.21.2.105:0/4023354280 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:25.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.016+0000 7ff78130a700 1 --2- 172.21.2.105:0/4023354280 >> v2:172.21.2.105:3300/0 conn(0x7ff77c0ad080 0x7ff77c0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:25.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.016+0000 7ff78130a700 1 -- 172.21.2.105:0/4023354280 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff77c0ac280 msgr2=0x7ff77c0ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:25.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.016+0000 7ff78130a700 1 --2- 172.21.2.105:0/4023354280 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff77c0ac280 0x7ff77c0ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:25.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.016+0000 7ff78130a700 1 -- 172.21.2.105:0/4023354280 >> v1:172.21.2.105:6789/0 conn(0x7ff77c14abe0 legacy=0x7ff77c14b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:25.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.016+0000 7ff78130a700 1 -- 172.21.2.105:0/4023354280 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77c0b0b30 con 0x7ff77c0ad080 2021-11-12T05:48:25.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.016+0000 7ff78130a700 1 --2- 172.21.2.105:0/4023354280 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff77c0ad080 0x7ff77c0af730 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 rx=0x7ff770002f70 tx=0x7ff770006df0).ready entity=mon.0 client_cookie=845916e3587919ea server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:25.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.016+0000 7ff76ffff700 1 -- 172.21.2.105:0/4023354280 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff77000d570 con 0x7ff77c0ad080 2021-11-12T05:48:25.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.016+0000 7ff76ffff700 1 -- 172.21.2.105:0/4023354280 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff770000e90 con 0x7ff77c0ad080 2021-11-12T05:48:25.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.016+0000 7ff76ffff700 1 -- 172.21.2.105:0/4023354280 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff77000d8c0 con 0x7ff77c0ad080 2021-11-12T05:48:25.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.016+0000 7ff78356e700 1 -- 172.21.2.105:0/4023354280 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff77c0ad080 msgr2=0x7ff77c0af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:25.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.016+0000 7ff78356e700 1 --2- 172.21.2.105:0/4023354280 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff77c0ad080 0x7ff77c0af730 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 rx=0x7ff770002f70 tx=0x7ff770006df0).stop 2021-11-12T05:48:25.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.016+0000 7ff78356e700 1 -- 172.21.2.105:0/4023354280 shutdown_connections 2021-11-12T05:48:25.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.016+0000 7ff78356e700 1 --2- 172.21.2.105:0/4023354280 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff77c0ac280 0x7ff77c0ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:25.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.016+0000 7ff78356e700 1 --2- 172.21.2.105:0/4023354280 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff77c0ad080 0x7ff77c0af730 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:25.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.016+0000 7ff78356e700 1 -- 172.21.2.105:0/4023354280 >> 172.21.2.105:0/4023354280 conn(0x7ff77c0b5370 msgr2=0x7ff77c0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:25.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.016+0000 7ff78356e700 1 -- 172.21.2.105:0/4023354280 shutdown_connections 2021-11-12T05:48:25.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.016+0000 7ff78356e700 1 -- 172.21.2.105:0/4023354280 wait complete. 2021-11-12T05:48:25.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.016+0000 7ff78356e700 1 Processor -- start 2021-11-12T05:48:25.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.016+0000 7ff78356e700 1 -- start start 2021-11-12T05:48:25.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.020+0000 7ff78356e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff77c0ac280 0x7ff77c0ab860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:25.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.020+0000 7ff78356e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff77c0ad080 0x7ff77c0aa400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:25.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.020+0000 7ff78356e700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff77c14abe0 0x7ff77c0a8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:25.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.020+0000 7ff78356e700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c064740 con 0x7ff77c0ac280 2021-11-12T05:48:25.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.020+0000 7ff78356e700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c0649e0 con 0x7ff77c14abe0 2021-11-12T05:48:25.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.020+0000 7ff78356e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c064c80 con 0x7ff77c0ad080 2021-11-12T05:48:25.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.020+0000 7ff78130a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff77c0ac280 0x7ff77c0ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:25.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.020+0000 7ff78130a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff77c0ac280 0x7ff77c0ab860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50414/0 (socket says 172.21.2.105:50414) 2021-11-12T05:48:25.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.020+0000 7ff78130a700 1 -- 172.21.2.105:0/3720531289 learned_addr learned my addr 172.21.2.105:0/3720531289 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:25.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.020+0000 7ff78130a700 1 -- 172.21.2.105:0/3720531289 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff77c0ad080 msgr2=0x7ff77c0aa400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:25.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.020+0000 7ff78130a700 1 --2- 172.21.2.105:0/3720531289 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff77c0ad080 0x7ff77c0aa400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:25.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.020+0000 7ff78130a700 1 -- 172.21.2.105:0/3720531289 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff77c14abe0 msgr2=0x7ff77c0a8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:25.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.020+0000 7ff78130a700 1 --2- 172.21.2.105:0/3720531289 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff77c14abe0 0x7ff77c0a8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:25.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.020+0000 7ff78130a700 1 -- 172.21.2.105:0/3720531289 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77000b180 con 0x7ff77c0ac280 2021-11-12T05:48:25.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.020+0000 7ff78130a700 1 --2- 172.21.2.105:0/3720531289 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff77c0ac280 0x7ff77c0ab860 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7ff770002f70 tx=0x7ff770015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:25.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.020+0000 7ff76e7fc700 1 -- 172.21.2.105:0/3720531289 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff77000de40 con 0x7ff77c0ac280 2021-11-12T05:48:25.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.020+0000 7ff76e7fc700 1 -- 172.21.2.105:0/3720531289 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff770011ca0 con 0x7ff77c0ac280 2021-11-12T05:48:25.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.020+0000 7ff76e7fc700 1 -- 172.21.2.105:0/3720531289 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff77001e460 con 0x7ff77c0ac280 2021-11-12T05:48:25.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.020+0000 7ff78356e700 1 -- 172.21.2.105:0/3720531289 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff77c065120 con 0x7ff77c0ac280 2021-11-12T05:48:25.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.020+0000 7ff78356e700 1 -- 172.21.2.105:0/3720531289 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff77c0aa8f0 con 0x7ff77c0ac280 2021-11-12T05:48:25.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.020+0000 7ff78356e700 1 -- 172.21.2.105:0/3720531289 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff77c0645b0 con 0x7ff77c0ac280 2021-11-12T05:48:25.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.020+0000 7ff76e7fc700 1 -- 172.21.2.105:0/3720531289 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff77001a040 con 0x7ff77c0ac280 2021-11-12T05:48:25.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.020+0000 7ff76e7fc700 1 --2- 172.21.2.105:0/3720531289 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff75c0536a0 0x7ff75c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:25.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.020+0000 7ff76e7fc700 1 -- 172.21.2.105:0/3720531289 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5596+0+0 (secure 0 0 0) 0x7ff77006c7e0 con 0x7ff77c0ac280 2021-11-12T05:48:25.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.020+0000 7ff780b09700 1 --2- 172.21.2.105:0/3720531289 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff75c0536a0 0x7ff75c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:25.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.020+0000 7ff780b09700 1 --2- 172.21.2.105:0/3720531289 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff75c0536a0 0x7ff75c055b60 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7ff778002f70 tx=0x7ff778006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:25.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.024+0000 7ff76e7fc700 1 -- 172.21.2.105:0/3720531289 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff770043a10 con 0x7ff77c0ac280 2021-11-12T05:48:25.110 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:48:25.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.104+0000 7ff78356e700 1 -- 172.21.2.105:0/3720531289 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff77c064e40 con 0x7ff77c0ac280 2021-11-12T05:48:25.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.108+0000 7ff76e7fc700 1 -- 172.21.2.105:0/3720531289 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v112) v1 ==== 84+0+143 (secure 0 0 0) 0x7ff770023020 con 0x7ff77c0ac280 2021-11-12T05:48:25.112 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:25.112 INFO:teuthology.orchestra.run.gibba005.stdout:[ 2021-11-12T05:48:25.113 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:25.113 INFO:teuthology.orchestra.run.gibba005.stdout: "poolnum": 1, 2021-11-12T05:48:25.113 INFO:teuthology.orchestra.run.gibba005.stdout: "poolname": "device_health_metrics" 2021-11-12T05:48:25.113 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:25.114 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:25.114 INFO:teuthology.orchestra.run.gibba005.stdout: "poolnum": 2, 2021-11-12T05:48:25.114 INFO:teuthology.orchestra.run.gibba005.stdout: "poolname": "rbd" 2021-11-12T05:48:25.114 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:25.115 INFO:teuthology.orchestra.run.gibba005.stdout:] 2021-11-12T05:48:25.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.108+0000 7ff78356e700 1 -- 172.21.2.105:0/3720531289 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff75c0536a0 msgr2=0x7ff75c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:25.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.108+0000 7ff78356e700 1 --2- 172.21.2.105:0/3720531289 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff75c0536a0 0x7ff75c055b60 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7ff778002f70 tx=0x7ff778006a80).stop 2021-11-12T05:48:25.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.108+0000 7ff78356e700 1 -- 172.21.2.105:0/3720531289 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff77c0ac280 msgr2=0x7ff77c0ab860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:25.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.108+0000 7ff78356e700 1 --2- 172.21.2.105:0/3720531289 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff77c0ac280 0x7ff77c0ab860 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7ff770002f70 tx=0x7ff770015000).stop 2021-11-12T05:48:25.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.108+0000 7ff78356e700 1 -- 172.21.2.105:0/3720531289 shutdown_connections 2021-11-12T05:48:25.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.108+0000 7ff78356e700 1 --2- 172.21.2.105:0/3720531289 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff75c0536a0 0x7ff75c055b60 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:25.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.108+0000 7ff78356e700 1 --2- 172.21.2.105:0/3720531289 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff77c14abe0 0x7ff77c0a8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:25.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.108+0000 7ff78356e700 1 --2- 172.21.2.105:0/3720531289 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff77c0ad080 0x7ff77c0aa400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:25.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.108+0000 7ff78356e700 1 --2- 172.21.2.105:0/3720531289 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff77c0ac280 0x7ff77c0ab860 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:25.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.108+0000 7ff78356e700 1 -- 172.21.2.105:0/3720531289 >> 172.21.2.105:0/3720531289 conn(0x7ff77c0b5370 msgr2=0x7ff77c145ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:25.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.108+0000 7ff78356e700 1 -- 172.21.2.105:0/3720531289 shutdown_connections 2021-11-12T05:48:25.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.108+0000 7ff78356e700 1 -- 172.21.2.105:0/3720531289 wait complete. 2021-11-12T05:48:25.119 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:48:25.121 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-12T05:48:25.121 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-12T05:48:25.124 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:48:25.127 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:48:25.130 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:48:25.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.168+0000 7f639edb9700 1 Processor -- start 2021-11-12T05:48:25.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.168+0000 7f639edb9700 1 -- start start 2021-11-12T05:48:25.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.168+0000 7f639edb9700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6398060100 0x7f63980b1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:25.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.168+0000 7f639edb9700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f63980b37d0 0x7f6398141500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:25.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.168+0000 7f639edb9700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63980604e0 con 0x7f63981419f0 2021-11-12T05:48:25.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.168+0000 7f639edb9700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6398145160 con 0x7f63980b37d0 2021-11-12T05:48:25.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.168+0000 7f639edb9700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6398141060 con 0x7f6398060100 2021-11-12T05:48:25.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.172+0000 7f639cb55700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6398060100 0x7f63980b1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:25.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.172+0000 7f6397fff700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f63980b37d0 0x7f6398141500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:25.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.172+0000 7f639d356700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7f63981419f0 0x7f63981298d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:59286/0 (socket says 172.21.2.105:59286) 2021-11-12T05:48:25.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.172+0000 7f639d356700 1 -- 172.21.2.105:0/1316915221 learned_addr learned my addr 172.21.2.105:0/1316915221 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:25.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.172+0000 7f639cb55700 1 -- 172.21.2.105:0/1316915221 >> v2:172.21.2.115:3300/0 conn(0x7f63980b37d0 msgr2=0x7f6398141500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:25.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.172+0000 7f639cb55700 1 --2- 172.21.2.105:0/1316915221 >> v2:172.21.2.115:3300/0 conn(0x7f63980b37d0 0x7f6398141500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:25.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.172+0000 7f639cb55700 1 -- 172.21.2.105:0/1316915221 >> v1:172.21.2.115:6789/0 conn(0x7f63981419f0 legacy=0x7f63981298d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:25.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.172+0000 7f639cb55700 1 -- 172.21.2.105:0/1316915221 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6398141e80 con 0x7f6398060100 2021-11-12T05:48:25.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.172+0000 7f6397fff700 1 --2- 172.21.2.105:0/1316915221 >> v2:172.21.2.115:3300/0 conn(0x7f63980b37d0 0x7f6398141500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-12T05:48:25.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.172+0000 7f639cb55700 1 --2- 172.21.2.105:0/1316915221 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6398060100 0x7f63980b1fd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f6388002f70 tx=0x7f6388006df0).ready entity=mon.2 client_cookie=a29f09ca63fde663 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:25.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.172+0000 7f63977fe700 1 -- 172.21.2.105:0/1316915221 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f638800d570 con 0x7f6398060100 2021-11-12T05:48:25.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.172+0000 7f63977fe700 1 -- 172.21.2.105:0/1316915221 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6388000e90 con 0x7f6398060100 2021-11-12T05:48:25.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.172+0000 7f63977fe700 1 -- 172.21.2.105:0/1316915221 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f638800d8c0 con 0x7f6398060100 2021-11-12T05:48:25.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.172+0000 7f639edb9700 1 -- 172.21.2.105:0/1316915221 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6398060100 msgr2=0x7f63980b1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:25.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.172+0000 7f639edb9700 1 --2- 172.21.2.105:0/1316915221 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6398060100 0x7f63980b1fd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f6388002f70 tx=0x7f6388006df0).stop 2021-11-12T05:48:25.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.172+0000 7f639edb9700 1 -- 172.21.2.105:0/1316915221 shutdown_connections 2021-11-12T05:48:25.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.172+0000 7f639edb9700 1 --2- 172.21.2.105:0/1316915221 >> v2:172.21.2.115:3300/0 conn(0x7f63980b37d0 0x7f6398141500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:25.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.172+0000 7f639edb9700 1 --2- 172.21.2.105:0/1316915221 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6398060100 0x7f63980b1fd0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:25.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.172+0000 7f639edb9700 1 -- 172.21.2.105:0/1316915221 >> 172.21.2.105:0/1316915221 conn(0x7f63980608d0 msgr2=0x7f639805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:25.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.172+0000 7f639edb9700 1 -- 172.21.2.105:0/1316915221 shutdown_connections 2021-11-12T05:48:25.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.172+0000 7f639edb9700 1 -- 172.21.2.105:0/1316915221 wait complete. 2021-11-12T05:48:25.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.172+0000 7f639edb9700 1 Processor -- start 2021-11-12T05:48:25.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.172+0000 7f639edb9700 1 -- start start 2021-11-12T05:48:25.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.176+0000 7f639edb9700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6398060100 0x7f6398156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:25.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.176+0000 7f639edb9700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f63980b37d0 0x7f63980b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:25.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.176+0000 7f639edb9700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f63981419f0 0x7f63981402d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:25.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.176+0000 7f639edb9700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63980b1270 con 0x7f6398060100 2021-11-12T05:48:25.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.176+0000 7f639edb9700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6398156e70 con 0x7f63981419f0 2021-11-12T05:48:25.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.176+0000 7f639edb9700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6398157110 con 0x7f63980b37d0 2021-11-12T05:48:25.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.176+0000 7f639cb55700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6398060100 0x7f6398156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:25.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.176+0000 7f639cb55700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6398060100 0x7f6398156840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50428/0 (socket says 172.21.2.105:50428) 2021-11-12T05:48:25.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.176+0000 7f639cb55700 1 -- 172.21.2.105:0/620137183 learned_addr learned my addr 172.21.2.105:0/620137183 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:25.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.176+0000 7f639cb55700 1 -- 172.21.2.105:0/620137183 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f63980b37d0 msgr2=0x7f63980b0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:25.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.176+0000 7f639cb55700 1 --2- 172.21.2.105:0/620137183 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f63980b37d0 0x7f63980b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:25.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.176+0000 7f639cb55700 1 -- 172.21.2.105:0/620137183 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f63981419f0 msgr2=0x7f63981402d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:25.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.176+0000 7f639cb55700 1 --2- 172.21.2.105:0/620137183 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f63981419f0 0x7f63981402d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:25.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.176+0000 7f639cb55700 1 -- 172.21.2.105:0/620137183 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638000d590 con 0x7f6398060100 2021-11-12T05:48:25.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.176+0000 7f639cb55700 1 --2- 172.21.2.105:0/620137183 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6398060100 0x7f6398156840 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7f6388002f70 tx=0x7f6388014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:25.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.176+0000 7f6395ffb700 1 -- 172.21.2.105:0/620137183 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f638800dea0 con 0x7f6398060100 2021-11-12T05:48:25.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.176+0000 7f6395ffb700 1 -- 172.21.2.105:0/620137183 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638801e400 con 0x7f6398060100 2021-11-12T05:48:25.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.176+0000 7f639edb9700 1 -- 172.21.2.105:0/620137183 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f638800b180 con 0x7f6398060100 2021-11-12T05:48:25.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.176+0000 7f639edb9700 1 -- 172.21.2.105:0/620137183 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6398135ea0 con 0x7f6398060100 2021-11-12T05:48:25.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.176+0000 7f6395ffb700 1 -- 172.21.2.105:0/620137183 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f638801e760 con 0x7f6398060100 2021-11-12T05:48:25.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.176+0000 7f639edb9700 1 -- 172.21.2.105:0/620137183 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6398140d50 con 0x7f6398060100 2021-11-12T05:48:25.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.176+0000 7f6395ffb700 1 -- 172.21.2.105:0/620137183 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6388025030 con 0x7f6398060100 2021-11-12T05:48:25.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.176+0000 7f6395ffb700 1 --2- 172.21.2.105:0/620137183 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f637c053540 0x7f637c055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:25.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.176+0000 7f6395ffb700 1 -- 172.21.2.105:0/620137183 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f638806c7d0 con 0x7f6398060100 2021-11-12T05:48:25.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.176+0000 7f6397fff700 1 --2- 172.21.2.105:0/620137183 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f637c053540 0x7f637c055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:25.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.176+0000 7f6397fff700 1 --2- 172.21.2.105:0/620137183 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f637c053540 0x7f637c055a00 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f6380010000 tx=0x7f638000f040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:25.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.180+0000 7f6395ffb700 1 -- 172.21.2.105:0/620137183 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6388043a00 con 0x7f6398060100 2021-11-12T05:48:25.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:25.264+0000 7f639edb9700 1 -- 172.21.2.105:0/620137183 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f6398057350 con 0x7f6398060100 2021-11-12T05:48:26.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.192+0000 7f6395ffb700 1 -- 172.21.2.105:0/620137183 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v113) v1 ==== 133+0+0 (secure 0 0 0) 0x7f6388023020 con 0x7f6398060100 2021-11-12T05:48:26.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.192+0000 7f639edb9700 1 -- 172.21.2.105:0/620137183 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f637c053540 msgr2=0x7f637c055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:26.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.192+0000 7f639edb9700 1 --2- 172.21.2.105:0/620137183 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f637c053540 0x7f637c055a00 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f6380010000 tx=0x7f638000f040).stop 2021-11-12T05:48:26.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.192+0000 7f639edb9700 1 -- 172.21.2.105:0/620137183 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6398060100 msgr2=0x7f6398156840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:26.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.192+0000 7f639edb9700 1 --2- 172.21.2.105:0/620137183 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6398060100 0x7f6398156840 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7f6388002f70 tx=0x7f6388014000).stop 2021-11-12T05:48:26.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.192+0000 7f639edb9700 1 -- 172.21.2.105:0/620137183 shutdown_connections 2021-11-12T05:48:26.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.192+0000 7f639edb9700 1 --2- 172.21.2.105:0/620137183 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f637c053540 0x7f637c055a00 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:26.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.192+0000 7f639edb9700 1 --2- 172.21.2.105:0/620137183 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f63981419f0 0x7f63981402d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:26.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.192+0000 7f639edb9700 1 --2- 172.21.2.105:0/620137183 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f63980b37d0 0x7f63980b0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:26.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.192+0000 7f639edb9700 1 --2- 172.21.2.105:0/620137183 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6398060100 0x7f6398156840 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:26.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.192+0000 7f639edb9700 1 -- 172.21.2.105:0/620137183 >> 172.21.2.105:0/620137183 conn(0x7f63980608d0 msgr2=0x7f63980613f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:26.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.192+0000 7f639edb9700 1 -- 172.21.2.105:0/620137183 shutdown_connections 2021-11-12T05:48:26.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.192+0000 7f639edb9700 1 -- 172.21.2.105:0/620137183 wait complete. 2021-11-12T05:48:26.201 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_metadata' created 2021-11-12T05:48:26.204 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-11-12T05:48:26.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.304+0000 7f1e8cd1d700 1 Processor -- start 2021-11-12T05:48:26.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.304+0000 7f1e8cd1d700 1 -- start start 2021-11-12T05:48:26.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.304+0000 7f1e8cd1d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f1e880aca40 0x7f1e880ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:26.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.304+0000 7f1e8cd1d700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1e88144180 0x7f1e88144610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:26.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.304+0000 7f1e8cd1d700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e880b1840 con 0x7f1e880b0520 2021-11-12T05:48:26.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.304+0000 7f1e8cd1d700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e880b09d0 con 0x7f1e880aca40 2021-11-12T05:48:26.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.304+0000 7f1e8cd1d700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e880af2b0 con 0x7f1e88144180 2021-11-12T05:48:26.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.304+0000 7f1e85d9b700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f1e880b0520 0x7f1e881473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60832/0 (socket says 172.21.2.105:60832) 2021-11-12T05:48:26.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.304+0000 7f1e85d9b700 1 -- 172.21.2.105:0/3449833201 learned_addr learned my addr 172.21.2.105:0/3449833201 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:26.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.304+0000 7f1e8659c700 1 --2- 172.21.2.105:0/3449833201 >> v2:172.21.2.105:3300/0 conn(0x7f1e880aca40 0x7f1e880ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:26.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.304+0000 7f1e8559a700 1 -- 172.21.2.105:0/3449833201 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1584958706 0 0) 0x7f1e880b1840 con 0x7f1e880b0520 2021-11-12T05:48:26.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.304+0000 7f1e8559a700 1 -- 172.21.2.105:0/3449833201 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e6c003260 con 0x7f1e880b0520 2021-11-12T05:48:26.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.304+0000 7f1e8659c700 1 -- 172.21.2.105:0/3449833201 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1e88144180 msgr2=0x7f1e88144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:26.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.304+0000 7f1e8659c700 1 --2- 172.21.2.105:0/3449833201 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1e88144180 0x7f1e88144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:26.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.304+0000 7f1e8659c700 1 -- 172.21.2.105:0/3449833201 >> v1:172.21.2.105:6789/0 conn(0x7f1e880b0520 legacy=0x7f1e881473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:26.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.304+0000 7f1e8659c700 1 -- 172.21.2.105:0/3449833201 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e880b1a70 con 0x7f1e880aca40 2021-11-12T05:48:26.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.304+0000 7f1e8659c700 1 --2- 172.21.2.105:0/3449833201 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1e880aca40 0x7f1e880ace20 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7f1e7c002f70 tx=0x7f1e7c006df0).ready entity=mon.0 client_cookie=366e27b29a288c3a server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:26.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.304+0000 7f1e8559a700 1 -- 172.21.2.105:0/3449833201 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e7c00d570 con 0x7f1e880aca40 2021-11-12T05:48:26.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.304+0000 7f1e8559a700 1 -- 172.21.2.105:0/3449833201 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7c000e90 con 0x7f1e880aca40 2021-11-12T05:48:26.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.304+0000 7f1e8559a700 1 -- 172.21.2.105:0/3449833201 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e7c00d8c0 con 0x7f1e880aca40 2021-11-12T05:48:26.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.304+0000 7f1e8cd1d700 1 -- 172.21.2.105:0/3449833201 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1e880aca40 msgr2=0x7f1e880ace20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:26.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.304+0000 7f1e8cd1d700 1 --2- 172.21.2.105:0/3449833201 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1e880aca40 0x7f1e880ace20 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7f1e7c002f70 tx=0x7f1e7c006df0).stop 2021-11-12T05:48:26.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.304+0000 7f1e8cd1d700 1 -- 172.21.2.105:0/3449833201 shutdown_connections 2021-11-12T05:48:26.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.304+0000 7f1e8cd1d700 1 --2- 172.21.2.105:0/3449833201 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1e88144180 0x7f1e88144610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:26.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.304+0000 7f1e8cd1d700 1 --2- 172.21.2.105:0/3449833201 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1e880aca40 0x7f1e880ace20 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:26.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.304+0000 7f1e8cd1d700 1 -- 172.21.2.105:0/3449833201 >> 172.21.2.105:0/3449833201 conn(0x7f1e8805c490 msgr2=0x7f1e880b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:26.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.304+0000 7f1e8cd1d700 1 -- 172.21.2.105:0/3449833201 shutdown_connections 2021-11-12T05:48:26.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.304+0000 7f1e8cd1d700 1 -- 172.21.2.105:0/3449833201 wait complete. 2021-11-12T05:48:26.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.304+0000 7f1e8cd1d700 1 Processor -- start 2021-11-12T05:48:26.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.304+0000 7f1e8cd1d700 1 -- start start 2021-11-12T05:48:26.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.308+0000 7f1e8cd1d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1e880aca40 0x7f1e88065210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:26.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.308+0000 7f1e8cd1d700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1e880b0520 0x7f1e88141420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:26.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.308+0000 7f1e8cd1d700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1e88144180 0x7f1e88065820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:26.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.308+0000 7f1e8cd1d700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e88064830 con 0x7f1e880aca40 2021-11-12T05:48:26.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.308+0000 7f1e8cd1d700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e88064ad0 con 0x7f1e880b0520 2021-11-12T05:48:26.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.308+0000 7f1e8cd1d700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e88064d70 con 0x7f1e88144180 2021-11-12T05:48:26.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.308+0000 7f1e8659c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1e880aca40 0x7f1e88065210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:26.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.308+0000 7f1e8659c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1e880aca40 0x7f1e88065210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50444/0 (socket says 172.21.2.105:50444) 2021-11-12T05:48:26.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.308+0000 7f1e8659c700 1 -- 172.21.2.105:0/514038732 learned_addr learned my addr 172.21.2.105:0/514038732 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:26.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.308+0000 7f1e8659c700 1 -- 172.21.2.105:0/514038732 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1e88144180 msgr2=0x7f1e88065820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:26.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.308+0000 7f1e8659c700 1 --2- 172.21.2.105:0/514038732 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1e88144180 0x7f1e88065820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:26.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.308+0000 7f1e8659c700 1 -- 172.21.2.105:0/514038732 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1e880b0520 msgr2=0x7f1e88141420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:26.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.308+0000 7f1e8659c700 1 --2- 172.21.2.105:0/514038732 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1e880b0520 0x7f1e88141420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:26.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.308+0000 7f1e8659c700 1 -- 172.21.2.105:0/514038732 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e7c00b180 con 0x7f1e880aca40 2021-11-12T05:48:26.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.308+0000 7f1e8659c700 1 --2- 172.21.2.105:0/514038732 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1e880aca40 0x7f1e88065210 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7f1e7c002f70 tx=0x7f1e7c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:26.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.308+0000 7f1e777fe700 1 -- 172.21.2.105:0/514038732 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e7c016070 con 0x7f1e880aca40 2021-11-12T05:48:26.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.308+0000 7f1e777fe700 1 -- 172.21.2.105:0/514038732 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7c00de00 con 0x7f1e880aca40 2021-11-12T05:48:26.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.308+0000 7f1e8cd1d700 1 -- 172.21.2.105:0/514038732 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e88141910 con 0x7f1e880aca40 2021-11-12T05:48:26.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.308+0000 7f1e8cd1d700 1 -- 172.21.2.105:0/514038732 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e881481d0 con 0x7f1e880aca40 2021-11-12T05:48:26.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.308+0000 7f1e777fe700 1 -- 172.21.2.105:0/514038732 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e7c006b20 con 0x7f1e880aca40 2021-11-12T05:48:26.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.308+0000 7f1e8cd1d700 1 -- 172.21.2.105:0/514038732 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e88064f30 con 0x7f1e880aca40 2021-11-12T05:48:26.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.308+0000 7f1e777fe700 1 -- 172.21.2.105:0/514038732 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1e7c025030 con 0x7f1e880aca40 2021-11-12T05:48:26.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.308+0000 7f1e777fe700 1 --2- 172.21.2.105:0/514038732 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1e640536a0 0x7f1e64055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:26.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.308+0000 7f1e777fe700 1 -- 172.21.2.105:0/514038732 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5950+0+0 (secure 0 0 0) 0x7f1e7c06c820 con 0x7f1e880aca40 2021-11-12T05:48:26.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.308+0000 7f1e85d9b700 1 --2- 172.21.2.105:0/514038732 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1e640536a0 0x7f1e64055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:26.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.308+0000 7f1e85d9b700 1 --2- 172.21.2.105:0/514038732 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1e640536a0 0x7f1e64055b60 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7f1e78001110 tx=0x7f1e780076c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:26.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.312+0000 7f1e777fe700 1 -- 172.21.2.105:0/514038732 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1e7c043a00 con 0x7f1e880aca40 2021-11-12T05:48:26.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:26.396+0000 7f1e8cd1d700 1 -- 172.21.2.105:0/514038732 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f1e88057350 con 0x7f1e880aca40 2021-11-12T05:48:27.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.204+0000 7f1e777fe700 1 -- 172.21.2.105:0/514038732 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v114) v1 ==== 125+0+0 (secure 0 0 0) 0x7f1e7c023020 con 0x7f1e880aca40 2021-11-12T05:48:27.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.204+0000 7f1e8cd1d700 1 -- 172.21.2.105:0/514038732 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1e640536a0 msgr2=0x7f1e64055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:27.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.204+0000 7f1e8cd1d700 1 --2- 172.21.2.105:0/514038732 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1e640536a0 0x7f1e64055b60 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7f1e78001110 tx=0x7f1e780076c0).stop 2021-11-12T05:48:27.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.204+0000 7f1e8cd1d700 1 -- 172.21.2.105:0/514038732 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1e880aca40 msgr2=0x7f1e88065210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:27.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.204+0000 7f1e8cd1d700 1 --2- 172.21.2.105:0/514038732 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1e880aca40 0x7f1e88065210 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7f1e7c002f70 tx=0x7f1e7c014000).stop 2021-11-12T05:48:27.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.204+0000 7f1e8cd1d700 1 -- 172.21.2.105:0/514038732 shutdown_connections 2021-11-12T05:48:27.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.204+0000 7f1e8cd1d700 1 --2- 172.21.2.105:0/514038732 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1e640536a0 0x7f1e64055b60 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:27.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.204+0000 7f1e8cd1d700 1 --2- 172.21.2.105:0/514038732 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1e88144180 0x7f1e88065820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:27.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.204+0000 7f1e8cd1d700 1 --2- 172.21.2.105:0/514038732 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1e880b0520 0x7f1e88141420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:27.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.204+0000 7f1e8cd1d700 1 --2- 172.21.2.105:0/514038732 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1e880aca40 0x7f1e88065210 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:27.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.204+0000 7f1e8cd1d700 1 -- 172.21.2.105:0/514038732 >> 172.21.2.105:0/514038732 conn(0x7f1e8805c490 msgr2=0x7f1e880b5100 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:27.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.204+0000 7f1e8cd1d700 1 -- 172.21.2.105:0/514038732 shutdown_connections 2021-11-12T05:48:27.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.204+0000 7f1e8cd1d700 1 -- 172.21.2.105:0/514038732 wait complete. 2021-11-12T05:48:27.213 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_data' created 2021-11-12T05:48:27.217 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-12T05:48:27.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.268+0000 7fcbf2be3700 1 Processor -- start 2021-11-12T05:48:27.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.268+0000 7fcbf2be3700 1 -- start start 2021-11-12T05:48:27.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.268+0000 7fcbf2be3700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fcbec0b0780 0x7fcbec1434d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:27.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.268+0000 7fcbf2be3700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbec0b2d20 con 0x7fcbec0b2940 2021-11-12T05:48:27.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.268+0000 7fcbf2be3700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbec0b1fc0 con 0x7fcbec0b0cc0 2021-11-12T05:48:27.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.268+0000 7fcbf2be3700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbec0b15e0 con 0x7fcbec0b0780 2021-11-12T05:48:27.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.268+0000 7fcbf097f700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fcbec0b2940 0x7fcbec142dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60846/0 (socket says 172.21.2.105:60846) 2021-11-12T05:48:27.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.268+0000 7fcbf097f700 1 -- 172.21.2.105:0/1210585134 learned_addr learned my addr 172.21.2.105:0/1210585134 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:27.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.268+0000 7fcbeb7fe700 1 -- 172.21.2.105:0/1210585134 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 935397768 0 0) 0x7fcbec0b2d20 con 0x7fcbec0b2940 2021-11-12T05:48:27.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.268+0000 7fcbeb7fe700 1 -- 172.21.2.105:0/1210585134 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbcc004370 con 0x7fcbec0b2940 2021-11-12T05:48:27.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.268+0000 7fcbebfff700 1 --2- 172.21.2.105:0/1210585134 >> v2:172.21.2.115:3300/0 conn(0x7fcbec0b0780 0x7fcbec1434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:27.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.268+0000 7fcbeb7fe700 1 -- 172.21.2.105:0/1210585134 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2818605839 0 0) 0x7fcbcc004370 con 0x7fcbec0b2940 2021-11-12T05:48:27.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.268+0000 7fcbeb7fe700 1 -- 172.21.2.105:0/1210585134 >> v2:172.21.2.115:3300/0 conn(0x7fcbec0b0780 msgr2=0x7fcbec1434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:27.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.268+0000 7fcbeb7fe700 1 --2- 172.21.2.105:0/1210585134 >> v2:172.21.2.115:3300/0 conn(0x7fcbec0b0780 0x7fcbec1434d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:27.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.268+0000 7fcbeb7fe700 1 -- 172.21.2.105:0/1210585134 >> v1:172.21.2.115:6789/0 conn(0x7fcbec0b0cc0 legacy=0x7fcbec05f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:27.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.268+0000 7fcbeb7fe700 1 -- 172.21.2.105:0/1210585134 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbec0b1880 con 0x7fcbec0b2940 2021-11-12T05:48:27.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.268+0000 7fcbeb7fe700 1 -- 172.21.2.105:0/1210585134 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fcbd4001660 con 0x7fcbec0b2940 2021-11-12T05:48:27.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbeb7fe700 1 -- 172.21.2.105:0/1210585134 >> v1:172.21.2.105:6789/0 conn(0x7fcbec0b2940 legacy=0x7fcbec142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:27.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbeb7fe700 1 --2- 172.21.2.105:0/1210585134 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbcc004860 0x7fcbcc004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:27.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbeb7fe700 1 --2- 172.21.2.105:0/1210585134 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcbcc005610 0x7fcbcc005a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:27.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbeb7fe700 1 --2- 172.21.2.105:0/1210585134 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbcc005fd0 0x7fcbcc00c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:27.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbeb7fe700 1 -- 172.21.2.105:0/1210585134 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec0b15e0 con 0x7fcbcc004860 2021-11-12T05:48:27.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbeb7fe700 1 -- 172.21.2.105:0/1210585134 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc00ce90 con 0x7fcbcc005610 2021-11-12T05:48:27.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbeb7fe700 1 -- 172.21.2.105:0/1210585134 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc00d050 con 0x7fcbcc005fd0 2021-11-12T05:48:27.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbf097f700 1 --2- 172.21.2.105:0/1210585134 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbcc004860 0x7fcbcc004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:27.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbf097f700 1 -- 172.21.2.105:0/1210585134 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbcc005fd0 msgr2=0x7fcbcc00c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:27.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbf097f700 1 --2- 172.21.2.105:0/1210585134 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbcc005fd0 0x7fcbcc00c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:27.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbf097f700 1 -- 172.21.2.105:0/1210585134 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcbcc005610 msgr2=0x7fcbcc005a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:27.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbf097f700 1 --2- 172.21.2.105:0/1210585134 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcbcc005610 0x7fcbcc005a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:27.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbf097f700 1 -- 172.21.2.105:0/1210585134 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbcc004370 con 0x7fcbcc004860 2021-11-12T05:48:27.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbf1180700 1 -- 172.21.2.105:0/1210585134 reap_dead start 2021-11-12T05:48:27.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbf097f700 1 --2- 172.21.2.105:0/1210585134 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbcc004860 0x7fcbcc004c60 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 rx=0x7fcbec0b2f60 tx=0x7fcbec0b1a10).ready entity=mon.0 client_cookie=b0f56037b72cf93f server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:27.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbeb7fe700 1 -- 172.21.2.105:0/1210585134 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbd4007270 con 0x7fcbcc004860 2021-11-12T05:48:27.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbeb7fe700 1 -- 172.21.2.105:0/1210585134 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd40073d0 con 0x7fcbcc004860 2021-11-12T05:48:27.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbeb7fe700 1 -- 172.21.2.105:0/1210585134 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbd400cae0 con 0x7fcbcc004860 2021-11-12T05:48:27.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbf2be3700 1 -- 172.21.2.105:0/1210585134 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbcc004860 msgr2=0x7fcbcc004c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:27.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbf2be3700 1 --2- 172.21.2.105:0/1210585134 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbcc004860 0x7fcbcc004c60 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 rx=0x7fcbec0b2f60 tx=0x7fcbec0b1a10).stop 2021-11-12T05:48:27.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbf2be3700 1 -- 172.21.2.105:0/1210585134 shutdown_connections 2021-11-12T05:48:27.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbf2be3700 1 --2- 172.21.2.105:0/1210585134 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbcc004860 0x7fcbcc004c60 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:27.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbf2be3700 1 -- 172.21.2.105:0/1210585134 >> 172.21.2.105:0/1210585134 conn(0x7fcbec068440 msgr2=0x7fcbec062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:27.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbf2be3700 1 -- 172.21.2.105:0/1210585134 shutdown_connections 2021-11-12T05:48:27.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbf2be3700 1 -- 172.21.2.105:0/1210585134 wait complete. 2021-11-12T05:48:27.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbf2be3700 1 Processor -- start 2021-11-12T05:48:27.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbf2be3700 1 -- start start 2021-11-12T05:48:27.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbf2be3700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbcc004860 0x7fcbec1467e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:27.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbf2be3700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbec065ec0 0x7fcbec14ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:27.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbf2be3700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcbec14ef30 0x7fcbec142fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:27.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbf2be3700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec0670a0 con 0x7fcbec065ec0 2021-11-12T05:48:27.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbf2be3700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec1418c0 con 0x7fcbec14ef30 2021-11-12T05:48:27.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbf2be3700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec14f3c0 con 0x7fcbcc004860 2021-11-12T05:48:27.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbebfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbec065ec0 0x7fcbec14ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:27.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbebfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbec065ec0 0x7fcbec14ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50462/0 (socket says 172.21.2.105:50462) 2021-11-12T05:48:27.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbebfff700 1 -- 172.21.2.105:0/2000059373 learned_addr learned my addr 172.21.2.105:0/2000059373 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:27.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbebfff700 1 -- 172.21.2.105:0/2000059373 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbcc004860 msgr2=0x7fcbec1467e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:27.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbebfff700 1 --2- 172.21.2.105:0/2000059373 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbcc004860 0x7fcbec1467e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:27.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbebfff700 1 -- 172.21.2.105:0/2000059373 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcbec14ef30 msgr2=0x7fcbec142fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:27.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbebfff700 1 --2- 172.21.2.105:0/2000059373 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcbec14ef30 0x7fcbec142fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:27.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbebfff700 1 -- 172.21.2.105:0/2000059373 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbec066e00 con 0x7fcbec065ec0 2021-11-12T05:48:27.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbebfff700 1 --2- 172.21.2.105:0/2000059373 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbec065ec0 0x7fcbec14ea40 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7fcbdc00a000 tx=0x7fcbdc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:27.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbe9ffb700 1 -- 172.21.2.105:0/2000059373 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbdc0099f0 con 0x7fcbec065ec0 2021-11-12T05:48:27.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbe9ffb700 1 -- 172.21.2.105:0/2000059373 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbdc000e90 con 0x7fcbec065ec0 2021-11-12T05:48:27.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbe9ffb700 1 -- 172.21.2.105:0/2000059373 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbdc009d40 con 0x7fcbec065ec0 2021-11-12T05:48:27.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbf2be3700 1 -- 172.21.2.105:0/2000059373 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbec14e430 con 0x7fcbec065ec0 2021-11-12T05:48:27.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.272+0000 7fcbf2be3700 1 -- 172.21.2.105:0/2000059373 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbec064f70 con 0x7fcbec065ec0 2021-11-12T05:48:27.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.276+0000 7fcbf2be3700 1 -- 172.21.2.105:0/2000059373 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbec1416f0 con 0x7fcbec065ec0 2021-11-12T05:48:27.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.276+0000 7fcbe9ffb700 1 -- 172.21.2.105:0/2000059373 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fcbdc011450 con 0x7fcbec065ec0 2021-11-12T05:48:27.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.276+0000 7fcbe9ffb700 1 --2- 172.21.2.105:0/2000059373 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcbd0057aa0 0x7fcbd0059f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:27.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.276+0000 7fcbe9ffb700 1 -- 172.21.2.105:0/2000059373 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6300+0+0 (secure 0 0 0) 0x7fcbdc06bc30 con 0x7fcbec065ec0 2021-11-12T05:48:27.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.276+0000 7fcbf097f700 1 --2- 172.21.2.105:0/2000059373 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcbd0057aa0 0x7fcbd0059f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:27.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.276+0000 7fcbf097f700 1 --2- 172.21.2.105:0/2000059373 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcbd0057aa0 0x7fcbd0059f60 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7fcbec0b2f60 tx=0x7fcbd4015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:27.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.276+0000 7fcbe9ffb700 1 -- 172.21.2.105:0/2000059373 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcbdc042b40 con 0x7fcbec065ec0 2021-11-12T05:48:27.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.388+0000 7fcbf2be3700 1 -- 172.21.2.105:0/2000059373 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fcbec0b1b20 con 0x7fcbec065ec0 2021-11-12T05:48:27.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.392+0000 7fcbe9ffb700 1 -- 172.21.2.105:0/2000059373 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 21 and data pool 22 v54) v1 ==== 189+0+0 (secure 0 0 0) 0x7fcbdc046160 con 0x7fcbec065ec0 2021-11-12T05:48:27.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.396+0000 7fcbf2be3700 1 -- 172.21.2.105:0/2000059373 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcbd0057aa0 msgr2=0x7fcbd0059f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:27.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.396+0000 7fcbf2be3700 1 --2- 172.21.2.105:0/2000059373 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcbd0057aa0 0x7fcbd0059f60 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7fcbec0b2f60 tx=0x7fcbd4015000).stop 2021-11-12T05:48:27.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.396+0000 7fcbf2be3700 1 -- 172.21.2.105:0/2000059373 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbec065ec0 msgr2=0x7fcbec14ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:27.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.396+0000 7fcbf2be3700 1 --2- 172.21.2.105:0/2000059373 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbec065ec0 0x7fcbec14ea40 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7fcbdc00a000 tx=0x7fcbdc008040).stop 2021-11-12T05:48:27.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.396+0000 7fcbf2be3700 1 -- 172.21.2.105:0/2000059373 shutdown_connections 2021-11-12T05:48:27.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.396+0000 7fcbf2be3700 1 --2- 172.21.2.105:0/2000059373 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcbd0057aa0 0x7fcbd0059f60 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:27.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.396+0000 7fcbf2be3700 1 --2- 172.21.2.105:0/2000059373 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fcbec14ef30 0x7fcbec142fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:27.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.396+0000 7fcbf2be3700 1 --2- 172.21.2.105:0/2000059373 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fcbec065ec0 0x7fcbec14ea40 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:27.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.396+0000 7fcbf2be3700 1 --2- 172.21.2.105:0/2000059373 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fcbcc004860 0x7fcbec1467e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:27.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.396+0000 7fcbf2be3700 1 -- 172.21.2.105:0/2000059373 >> 172.21.2.105:0/2000059373 conn(0x7fcbec068440 msgr2=0x7fcbec0b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:27.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.396+0000 7fcbf2be3700 1 -- 172.21.2.105:0/2000059373 shutdown_connections 2021-11-12T05:48:27.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.396+0000 7fcbf2be3700 1 -- 172.21.2.105:0/2000059373 wait complete. 2021-11-12T05:48:27.403 INFO:teuthology.orchestra.run.gibba005.stderr:new fs with metadata pool 21 and data pool 22 2021-11-12T05:48:27.405 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:48:27.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.452+0000 7f7c6a811700 1 Processor -- start 2021-11-12T05:48:27.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.452+0000 7f7c6a811700 1 -- start start 2021-11-12T05:48:27.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.452+0000 7f7c6a811700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f7c640ad080 0x7f7c640af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:27.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.452+0000 7f7c6a811700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f7c6414b2f0 0x7f7c640ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:27.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.452+0000 7f7c6a811700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c640ac7b0 con 0x7f7c640ac280 2021-11-12T05:48:27.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.452+0000 7f7c6a811700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c641488a0 con 0x7f7c6414b2f0 2021-11-12T05:48:27.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.452+0000 7f7c6a811700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c640ac9e0 con 0x7f7c640ad080 2021-11-12T05:48:27.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.452+0000 7f7c68dae700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f7c6414b2f0 0x7f7c640ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:27.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.452+0000 7f7c68dae700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f7c6414b2f0 0x7f7c640ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50484/0 (socket says 172.21.2.105:50484) 2021-11-12T05:48:27.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.452+0000 7f7c68dae700 1 -- 172.21.2.105:0/4162158281 learned_addr learned my addr 172.21.2.105:0/4162158281 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:27.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.452+0000 7f7c68dae700 1 -- 172.21.2.105:0/4162158281 >> v2:172.21.2.115:3300/0 conn(0x7f7c640ad080 msgr2=0x7f7c640af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:27.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.452+0000 7f7c68dae700 1 --2- 172.21.2.105:0/4162158281 >> v2:172.21.2.115:3300/0 conn(0x7f7c640ad080 0x7f7c640af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:27.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.452+0000 7f7c68dae700 1 -- 172.21.2.105:0/4162158281 >> v1:172.21.2.115:6789/0 conn(0x7f7c640ac280 legacy=0x7f7c6414abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:27.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.452+0000 7f7c68dae700 1 -- 172.21.2.105:0/4162158281 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c640b0b30 con 0x7f7c6414b2f0 2021-11-12T05:48:27.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.452+0000 7f7c68dae700 1 --2- 172.21.2.105:0/4162158281 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7c6414b2f0 0x7f7c640ad460 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7f7c640b06e0 tx=0x7f7c5c009290).ready entity=mon.0 client_cookie=25733b82cac3a4ef server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:27.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.452+0000 7f7c62ffd700 1 -- 172.21.2.105:0/4162158281 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c5c00b830 con 0x7f7c6414b2f0 2021-11-12T05:48:27.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.452+0000 7f7c62ffd700 1 -- 172.21.2.105:0/4162158281 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5c00b990 con 0x7f7c6414b2f0 2021-11-12T05:48:27.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.452+0000 7f7c62ffd700 1 -- 172.21.2.105:0/4162158281 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c5c00bb40 con 0x7f7c6414b2f0 2021-11-12T05:48:27.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.452+0000 7f7c6a811700 1 -- 172.21.2.105:0/4162158281 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7c6414b2f0 msgr2=0x7f7c640ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:27.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.452+0000 7f7c6a811700 1 --2- 172.21.2.105:0/4162158281 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7c6414b2f0 0x7f7c640ad460 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7f7c640b06e0 tx=0x7f7c5c009290).stop 2021-11-12T05:48:27.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.452+0000 7f7c6a811700 1 -- 172.21.2.105:0/4162158281 shutdown_connections 2021-11-12T05:48:27.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.452+0000 7f7c6a811700 1 --2- 172.21.2.105:0/4162158281 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7c6414b2f0 0x7f7c640ad460 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:27.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.452+0000 7f7c6a811700 1 --2- 172.21.2.105:0/4162158281 >> v2:172.21.2.115:3300/0 conn(0x7f7c640ad080 0x7f7c640af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:27.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.452+0000 7f7c6a811700 1 -- 172.21.2.105:0/4162158281 >> 172.21.2.105:0/4162158281 conn(0x7f7c640b5370 msgr2=0x7f7c640b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:27.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.452+0000 7f7c6a811700 1 -- 172.21.2.105:0/4162158281 shutdown_connections 2021-11-12T05:48:27.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.452+0000 7f7c6a811700 1 -- 172.21.2.105:0/4162158281 wait complete. 2021-11-12T05:48:27.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.456+0000 7f7c6a811700 1 Processor -- start 2021-11-12T05:48:27.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.456+0000 7f7c6a811700 1 -- start start 2021-11-12T05:48:27.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.456+0000 7f7c6a811700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7c640ac280 0x7f7c640a9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:27.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.456+0000 7f7c6a811700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7c640ad080 0x7f7c64063850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:27.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.456+0000 7f7c6a811700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7c6414b2f0 0x7f7c64142a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:27.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.456+0000 7f7c6a811700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c640643b0 con 0x7f7c6414b2f0 2021-11-12T05:48:27.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.456+0000 7f7c6a811700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c64062a30 con 0x7f7c640ac280 2021-11-12T05:48:27.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.456+0000 7f7c6a811700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c64159b80 con 0x7f7c640ad080 2021-11-12T05:48:27.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.456+0000 7f7c68dae700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7c6414b2f0 0x7f7c64142a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:27.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.456+0000 7f7c68dae700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7c6414b2f0 0x7f7c64142a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50492/0 (socket says 172.21.2.105:50492) 2021-11-12T05:48:27.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.456+0000 7f7c68dae700 1 -- 172.21.2.105:0/3548702544 learned_addr learned my addr 172.21.2.105:0/3548702544 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:27.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.456+0000 7f7c68dae700 1 -- 172.21.2.105:0/3548702544 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7c640ad080 msgr2=0x7f7c64063850 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:48:27.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.456+0000 7f7c68dae700 1 --2- 172.21.2.105:0/3548702544 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7c640ad080 0x7f7c64063850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:27.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.456+0000 7f7c68dae700 1 -- 172.21.2.105:0/3548702544 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7c640ac280 msgr2=0x7f7c640a9ab0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:48:27.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.456+0000 7f7c68dae700 1 --2- 172.21.2.105:0/3548702544 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7c640ac280 0x7f7c640a9ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:27.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.456+0000 7f7c68dae700 1 -- 172.21.2.105:0/3548702544 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5c009530 con 0x7f7c6414b2f0 2021-11-12T05:48:27.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.456+0000 7f7c68dae700 1 --2- 172.21.2.105:0/3548702544 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7c6414b2f0 0x7f7c64142a10 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 rx=0x7f7c64159d10 tx=0x7f7c5c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:27.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.456+0000 7f7c617fa700 1 -- 172.21.2.105:0/3548702544 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c5c00b830 con 0x7f7c6414b2f0 2021-11-12T05:48:27.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.456+0000 7f7c617fa700 1 -- 172.21.2.105:0/3548702544 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5c0032f0 con 0x7f7c6414b2f0 2021-11-12T05:48:27.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.456+0000 7f7c617fa700 1 -- 172.21.2.105:0/3548702544 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c5c020620 con 0x7f7c6414b2f0 2021-11-12T05:48:27.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.456+0000 7f7c6a811700 1 -- 172.21.2.105:0/3548702544 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c64159df0 con 0x7f7c6414b2f0 2021-11-12T05:48:27.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.456+0000 7f7c6a811700 1 -- 172.21.2.105:0/3548702544 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c640abb60 con 0x7f7c6414b2f0 2021-11-12T05:48:27.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.456+0000 7f7c6a811700 1 -- 172.21.2.105:0/3548702544 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c64064110 con 0x7f7c6414b2f0 2021-11-12T05:48:27.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.456+0000 7f7c617fa700 1 -- 172.21.2.105:0/3548702544 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7c5c026020 con 0x7f7c6414b2f0 2021-11-12T05:48:27.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.456+0000 7f7c617fa700 1 --2- 172.21.2.105:0/3548702544 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7c480536f0 0x7f7c48055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:27.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.456+0000 7f7c617fa700 1 -- 172.21.2.105:0/3548702544 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f7c5c06c900 con 0x7f7c6414b2f0 2021-11-12T05:48:27.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.456+0000 7f7c63fff700 1 --2- 172.21.2.105:0/3548702544 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7c480536f0 0x7f7c48055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:27.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.456+0000 7f7c63fff700 1 --2- 172.21.2.105:0/3548702544 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7c480536f0 0x7f7c48055bb0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f7c54002f70 tx=0x7f7c54006a00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:27.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.460+0000 7f7c617fa700 1 -- 172.21.2.105:0/3548702544 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7c64064110 con 0x7f7c6414b2f0 2021-11-12T05:48:27.549 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.544+0000 7f7c6a811700 1 -- 172.21.2.105:0/3548702544 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c64064110 con 0x7f7c6414b2f0 2021-11-12T05:48:27.551 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.544+0000 7f7c617fa700 1 -- 172.21.2.105:0/3548702544 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+16298 (secure 0 0 0) 0x7f7c64064110 con 0x7f7c6414b2f0 2021-11-12T05:48:27.552 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:27.552 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":116,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:48:27.392649+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:48:25.280993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-11-12T05:48:26.409707+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:48:27.554 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.548+0000 7f7c6a811700 1 -- 172.21.2.105:0/3548702544 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7c480536f0 msgr2=0x7f7c48055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:27.554 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.548+0000 7f7c6a811700 1 --2- 172.21.2.105:0/3548702544 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7c480536f0 0x7f7c48055bb0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f7c54002f70 tx=0x7f7c54006a00).stop 2021-11-12T05:48:27.555 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.548+0000 7f7c6a811700 1 -- 172.21.2.105:0/3548702544 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7c6414b2f0 msgr2=0x7f7c64142a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:27.555 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.548+0000 7f7c6a811700 1 --2- 172.21.2.105:0/3548702544 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7c6414b2f0 0x7f7c64142a10 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 rx=0x7f7c64159d10 tx=0x7f7c5c016000).stop 2021-11-12T05:48:27.556 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.548+0000 7f7c6a811700 1 -- 172.21.2.105:0/3548702544 shutdown_connections 2021-11-12T05:48:27.556 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.548+0000 7f7c6a811700 1 --2- 172.21.2.105:0/3548702544 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7c480536f0 0x7f7c48055bb0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:27.556 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.548+0000 7f7c6a811700 1 --2- 172.21.2.105:0/3548702544 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7c6414b2f0 0x7f7c64142a10 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:27.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.548+0000 7f7c6a811700 1 --2- 172.21.2.105:0/3548702544 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7c640ad080 0x7f7c64063850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:27.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.548+0000 7f7c6a811700 1 --2- 172.21.2.105:0/3548702544 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7c640ac280 0x7f7c640a9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:27.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.548+0000 7f7c6a811700 1 -- 172.21.2.105:0/3548702544 >> 172.21.2.105:0/3548702544 conn(0x7f7c640b5370 msgr2=0x7f7c6414aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:27.558 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.548+0000 7f7c6a811700 1 -- 172.21.2.105:0/3548702544 shutdown_connections 2021-11-12T05:48:27.558 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.548+0000 7f7c6a811700 1 -- 172.21.2.105:0/3548702544 wait complete. 2021-11-12T05:48:27.560 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:48:27.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.608+0000 7f050c625700 1 Processor -- start 2021-11-12T05:48:27.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.608+0000 7f050c625700 1 -- start start 2021-11-12T05:48:27.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.608+0000 7f050c625700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f05040ad080 0x7f05040af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:27.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.608+0000 7f050c625700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05040ac7b0 con 0x7f050414b2f0 2021-11-12T05:48:27.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.608+0000 7f050c625700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05040ac9e0 con 0x7f05040ac280 2021-11-12T05:48:27.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.608+0000 7f050c625700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05041488a0 con 0x7f05040ad080 2021-11-12T05:48:27.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.608+0000 7f050abc2700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f050414b2f0 0x7f0504147a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60896/0 (socket says 172.21.2.105:60896) 2021-11-12T05:48:27.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.608+0000 7f050abc2700 1 -- 172.21.2.105:0/1671560318 learned_addr learned my addr 172.21.2.105:0/1671560318 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:27.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.608+0000 7f05093bf700 1 -- 172.21.2.105:0/1671560318 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2775797806 0 0) 0x7f05040ac7b0 con 0x7f050414b2f0 2021-11-12T05:48:27.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.608+0000 7f05093bf700 1 -- 172.21.2.105:0/1671560318 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04ec003260 con 0x7f050414b2f0 2021-11-12T05:48:27.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.608+0000 7f050a3c1700 1 --2- 172.21.2.105:0/1671560318 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f05040ad080 0x7f05040af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:27.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.608+0000 7f05093bf700 1 -- 172.21.2.105:0/1671560318 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 315306542 0 0) 0x7f04ec003260 con 0x7f050414b2f0 2021-11-12T05:48:27.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.608+0000 7f05093bf700 1 -- 172.21.2.105:0/1671560318 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f05040ad080 msgr2=0x7f05040af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:27.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.608+0000 7f05093bf700 1 --2- 172.21.2.105:0/1671560318 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f05040ad080 0x7f05040af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:27.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.608+0000 7f05093bf700 1 -- 172.21.2.105:0/1671560318 >> v1:172.21.2.115:6789/0 conn(0x7f05040ac280 legacy=0x7f050414abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:27.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.608+0000 7f05093bf700 1 -- 172.21.2.105:0/1671560318 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05040b0b30 con 0x7f050414b2f0 2021-11-12T05:48:27.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.608+0000 7f05093bf700 1 -- 172.21.2.105:0/1671560318 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f04fc0019e0 con 0x7f050414b2f0 2021-11-12T05:48:27.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.608+0000 7f05093bf700 1 -- 172.21.2.105:0/1671560318 >> v1:172.21.2.105:6789/0 conn(0x7f050414b2f0 legacy=0x7f0504147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:27.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.608+0000 7f05093bf700 1 --2- 172.21.2.105:0/1671560318 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f04ec003780 0x7f04ec003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:27.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.608+0000 7f05093bf700 1 --2- 172.21.2.105:0/1671560318 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04ec004500 0x7f04ec004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:27.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.608+0000 7f05093bf700 1 --2- 172.21.2.105:0/1671560318 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f05040ad080 0x7f04ec004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:27.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.608+0000 7f05093bf700 1 -- 172.21.2.105:0/1671560318 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05041488a0 con 0x7f04ec004500 2021-11-12T05:48:27.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.608+0000 7f05093bf700 1 -- 172.21.2.105:0/1671560318 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ec00b8e0 con 0x7f04ec003780 2021-11-12T05:48:27.621 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.608+0000 7f05093bf700 1 -- 172.21.2.105:0/1671560318 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04ec00ba50 con 0x7f05040ad080 2021-11-12T05:48:27.621 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.608+0000 7f0509bc0700 1 --2- 172.21.2.105:0/1671560318 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04ec004500 0x7f04ec004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:27.621 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.608+0000 7f0509bc0700 1 -- 172.21.2.105:0/1671560318 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f05040ad080 msgr2=0x7f04ec004ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:27.621 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.608+0000 7f0509bc0700 1 --2- 172.21.2.105:0/1671560318 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f05040ad080 0x7f04ec004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:27.621 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.608+0000 7f0509bc0700 1 -- 172.21.2.105:0/1671560318 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f04ec003780 msgr2=0x7f04ec003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:27.622 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.608+0000 7f0509bc0700 1 --2- 172.21.2.105:0/1671560318 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f04ec003780 0x7f04ec003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:27.622 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.608+0000 7f0509bc0700 1 -- 172.21.2.105:0/1671560318 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ec003260 con 0x7f04ec004500 2021-11-12T05:48:27.622 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.608+0000 7f0509bc0700 1 --2- 172.21.2.105:0/1671560318 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04ec004500 0x7f04ec004980 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7f05040b6060 tx=0x7f0500007a00).ready entity=mon.0 client_cookie=e37d2e8fd1069f76 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:27.622 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.612+0000 7f05093bf700 1 -- 172.21.2.105:0/1671560318 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0500007d10 con 0x7f04ec004500 2021-11-12T05:48:27.623 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.612+0000 7f05093bf700 1 -- 172.21.2.105:0/1671560318 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0500007030 con 0x7f04ec004500 2021-11-12T05:48:27.623 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.612+0000 7f05093bf700 1 -- 172.21.2.105:0/1671560318 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0500007390 con 0x7f04ec004500 2021-11-12T05:48:27.623 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.612+0000 7f050c625700 1 -- 172.21.2.105:0/1671560318 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04ec004500 msgr2=0x7f04ec004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:27.623 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.612+0000 7f050c625700 1 --2- 172.21.2.105:0/1671560318 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04ec004500 0x7f04ec004980 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7f05040b6060 tx=0x7f0500007a00).stop 2021-11-12T05:48:27.623 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.612+0000 7f050abc2700 1 -- 172.21.2.105:0/1671560318 reap_dead start 2021-11-12T05:48:27.624 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.612+0000 7f050c625700 1 -- 172.21.2.105:0/1671560318 shutdown_connections 2021-11-12T05:48:27.624 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.612+0000 7f050c625700 1 -- 172.21.2.105:0/1671560318 >> 172.21.2.105:0/1671560318 conn(0x7f05040b5370 msgr2=0x7f05040b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:27.624 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.612+0000 7f050c625700 1 -- 172.21.2.105:0/1671560318 shutdown_connections 2021-11-12T05:48:27.624 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.612+0000 7f050c625700 1 -- 172.21.2.105:0/1671560318 wait complete. 2021-11-12T05:48:27.625 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.612+0000 7f050c625700 1 Processor -- start 2021-11-12T05:48:27.625 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.612+0000 7f050c625700 1 -- start start 2021-11-12T05:48:27.627 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.612+0000 7f050c625700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04ec004500 0x7f05040abb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:27.627 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.612+0000 7f050c625700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0504157590 0x7f05040a7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:27.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.612+0000 7f050c625700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f05040a8030 0x7f05040a8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:27.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.612+0000 7f050c625700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05040a7020 con 0x7f04ec004500 2021-11-12T05:48:27.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.612+0000 7f050c625700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05040a72c0 con 0x7f0504157590 2021-11-12T05:48:27.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.612+0000 7f050c625700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05040a7560 con 0x7f05040a8030 2021-11-12T05:48:27.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.612+0000 7f050a3c1700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04ec004500 0x7f05040abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:27.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.612+0000 7f050a3c1700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04ec004500 0x7f05040abb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50508/0 (socket says 172.21.2.105:50508) 2021-11-12T05:48:27.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.612+0000 7f050a3c1700 1 -- 172.21.2.105:0/2827682701 learned_addr learned my addr 172.21.2.105:0/2827682701 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:27.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.612+0000 7f050a3c1700 1 -- 172.21.2.105:0/2827682701 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f05040a8030 msgr2=0x7f05040a8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:27.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.612+0000 7f050a3c1700 1 --2- 172.21.2.105:0/2827682701 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f05040a8030 0x7f05040a8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:27.630 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.612+0000 7f050a3c1700 1 -- 172.21.2.105:0/2827682701 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0504157590 msgr2=0x7f05040a7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:27.630 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.612+0000 7f050a3c1700 1 --2- 172.21.2.105:0/2827682701 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0504157590 0x7f05040a7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:27.630 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.612+0000 7f050a3c1700 1 -- 172.21.2.105:0/2827682701 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0504157a10 con 0x7f04ec004500 2021-11-12T05:48:27.630 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.612+0000 7f050a3c1700 1 --2- 172.21.2.105:0/2827682701 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04ec004500 0x7f05040abb10 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7f04f8002f30 tx=0x7f04f8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:27.631 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.612+0000 7f04f77fe700 1 -- 172.21.2.105:0/2827682701 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04f8016070 con 0x7f04ec004500 2021-11-12T05:48:27.631 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.612+0000 7f04f77fe700 1 -- 172.21.2.105:0/2827682701 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f8000e90 con 0x7f04ec004500 2021-11-12T05:48:27.631 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.612+0000 7f050c625700 1 -- 172.21.2.105:0/2827682701 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05040a8c60 con 0x7f04ec004500 2021-11-12T05:48:27.631 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.612+0000 7f04f77fe700 1 -- 172.21.2.105:0/2827682701 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04f80119b0 con 0x7f04ec004500 2021-11-12T05:48:27.631 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.612+0000 7f050c625700 1 -- 172.21.2.105:0/2827682701 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05040a9160 con 0x7f04ec004500 2021-11-12T05:48:27.632 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.612+0000 7f050c625700 1 -- 172.21.2.105:0/2827682701 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05040b1440 con 0x7f04ec004500 2021-11-12T05:48:27.632 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.612+0000 7f04f77fe700 1 -- 172.21.2.105:0/2827682701 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f04f8011b10 con 0x7f04ec004500 2021-11-12T05:48:27.632 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.616+0000 7f04f77fe700 1 --2- 172.21.2.105:0/2827682701 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f04e4053580 0x7f04e4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:27.632 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.616+0000 7f04f77fe700 1 -- 172.21.2.105:0/2827682701 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f04f806b4d0 con 0x7f04ec004500 2021-11-12T05:48:27.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.616+0000 7f0509bc0700 1 --2- 172.21.2.105:0/2827682701 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f04e4053580 0x7f04e4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:27.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.616+0000 7f0509bc0700 1 --2- 172.21.2.105:0/2827682701 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f04e4053580 0x7f04e4055a40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f05040b6060 tx=0x7f0500015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:27.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.616+0000 7f04f77fe700 1 -- 172.21.2.105:0/2827682701 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f04f80424e0 con 0x7f04ec004500 2021-11-12T05:48:27.705 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.700+0000 7f050c625700 1 -- 172.21.2.105:0/2827682701 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0504057350 con 0x7f04ec004500 2021-11-12T05:48:27.706 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.700+0000 7f04f77fe700 1 -- 172.21.2.105:0/2827682701 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+16298 (secure 0 0 0) 0x7f04f8045b00 con 0x7f04ec004500 2021-11-12T05:48:27.706 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:27.707 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":116,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:48:27.392649+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:48:25.280993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-11-12T05:48:26.409707+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:48:27.707 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.704+0000 7f050c625700 1 -- 172.21.2.105:0/2827682701 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f04e4053580 msgr2=0x7f04e4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:27.708 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.704+0000 7f050c625700 1 --2- 172.21.2.105:0/2827682701 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f04e4053580 0x7f04e4055a40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f05040b6060 tx=0x7f0500015000).stop 2021-11-12T05:48:27.708 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.704+0000 7f050c625700 1 -- 172.21.2.105:0/2827682701 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04ec004500 msgr2=0x7f05040abb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:27.708 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.704+0000 7f050c625700 1 --2- 172.21.2.105:0/2827682701 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04ec004500 0x7f05040abb10 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7f04f8002f30 tx=0x7f04f8008040).stop 2021-11-12T05:48:27.708 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.704+0000 7f050c625700 1 -- 172.21.2.105:0/2827682701 shutdown_connections 2021-11-12T05:48:27.709 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.704+0000 7f050c625700 1 --2- 172.21.2.105:0/2827682701 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f04e4053580 0x7f04e4055a40 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:27.709 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.704+0000 7f050c625700 1 --2- 172.21.2.105:0/2827682701 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f05040a8030 0x7f05040a8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:27.709 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.704+0000 7f050c625700 1 --2- 172.21.2.105:0/2827682701 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0504157590 0x7f05040a7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:27.709 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.704+0000 7f050c625700 1 --2- 172.21.2.105:0/2827682701 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04ec004500 0x7f05040abb10 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:27.710 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.704+0000 7f050c625700 1 -- 172.21.2.105:0/2827682701 >> 172.21.2.105:0/2827682701 conn(0x7f05040b5370 msgr2=0x7f050405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:27.710 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.704+0000 7f050c625700 1 -- 172.21.2.105:0/2827682701 shutdown_connections 2021-11-12T05:48:27.710 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.704+0000 7f050c625700 1 -- 172.21.2.105:0/2827682701 wait complete. 2021-11-12T05:48:27.714 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-12T05:48:27.768 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f71106b0700 1 Processor -- start 2021-11-12T05:48:27.768 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f71106b0700 1 -- start start 2021-11-12T05:48:27.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f71106b0700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f71080b7c80 0x7f7108067170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:27.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f71106b0700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71080b8060 con 0x7f7108064900 2021-11-12T05:48:27.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f71106b0700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7108067840 con 0x7f7108140f90 2021-11-12T05:48:27.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f71106b0700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7108067d80 con 0x7f71080b7c80 2021-11-12T05:48:27.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f710dc4b700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f7108064900 0x7f7108064d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60912/0 (socket says 172.21.2.105:60912) 2021-11-12T05:48:27.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f710dc4b700 1 -- 172.21.2.105:0/59063588 learned_addr learned my addr 172.21.2.105:0/59063588 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:27.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f710e44c700 1 --2- 172.21.2.105:0/59063588 >> v2:172.21.2.105:3300/0 conn(0x7f71080b7c80 0x7f7108067170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:27.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f710e44c700 1 -- 172.21.2.105:0/59063588 >> v1:172.21.2.115:6789/0 conn(0x7f7108140f90 legacy=0x7f71081413b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:48:27.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f710e44c700 1 -- 172.21.2.105:0/59063588 >> v1:172.21.2.105:6789/0 conn(0x7f7108064900 legacy=0x7f7108064d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:27.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f710e44c700 1 -- 172.21.2.105:0/59063588 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7108067ae0 con 0x7f71080b7c80 2021-11-12T05:48:27.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f710e44c700 1 --2- 172.21.2.105:0/59063588 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71080b7c80 0x7f7108067170 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 rx=0x7f71080b7850 tx=0x7f7104006df0).ready entity=mon.0 client_cookie=7eca91514eec805c server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:27.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f710d44a700 1 -- 172.21.2.105:0/59063588 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f710400d5c0 con 0x7f71080b7c80 2021-11-12T05:48:27.772 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f710d44a700 1 -- 172.21.2.105:0/59063588 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7104000e90 con 0x7f71080b7c80 2021-11-12T05:48:27.772 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f710d44a700 1 -- 172.21.2.105:0/59063588 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f710400d910 con 0x7f71080b7c80 2021-11-12T05:48:27.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f71106b0700 1 -- 172.21.2.105:0/59063588 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71080b7c80 msgr2=0x7f7108067170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:27.776 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f71106b0700 1 --2- 172.21.2.105:0/59063588 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71080b7c80 0x7f7108067170 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 rx=0x7f71080b7850 tx=0x7f7104006df0).stop 2021-11-12T05:48:27.776 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f71106b0700 1 -- 172.21.2.105:0/59063588 shutdown_connections 2021-11-12T05:48:27.776 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f71106b0700 1 --2- 172.21.2.105:0/59063588 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71080b7c80 0x7f7108067170 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:27.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f71106b0700 1 -- 172.21.2.105:0/59063588 >> 172.21.2.105:0/59063588 conn(0x7f710805c860 msgr2=0x7f71080608d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:27.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f71106b0700 1 -- 172.21.2.105:0/59063588 shutdown_connections 2021-11-12T05:48:27.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f71106b0700 1 -- 172.21.2.105:0/59063588 wait complete. 2021-11-12T05:48:27.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f71106b0700 1 Processor -- start 2021-11-12T05:48:27.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f71106b0700 1 -- start start 2021-11-12T05:48:27.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f71106b0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7108064900 0x7f710813e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:27.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f71106b0700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f71080b7c80 0x7f710813a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:27.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f71106b0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7108140f90 0x7f710813a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:27.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f71106b0700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7108067660 con 0x7f7108064900 2021-11-12T05:48:27.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f71106b0700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710813f1c0 con 0x7f71080b7c80 2021-11-12T05:48:27.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f71106b0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f710813aa50 con 0x7f7108140f90 2021-11-12T05:48:27.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f710e44c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7108064900 0x7f710813e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:27.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f710e44c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7108064900 0x7f710813e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50522/0 (socket says 172.21.2.105:50522) 2021-11-12T05:48:27.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f710e44c700 1 -- 172.21.2.105:0/1375005432 learned_addr learned my addr 172.21.2.105:0/1375005432 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:27.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f710e44c700 1 -- 172.21.2.105:0/1375005432 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7108140f90 msgr2=0x7f710813a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:27.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f710e44c700 1 --2- 172.21.2.105:0/1375005432 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7108140f90 0x7f710813a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:27.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f710e44c700 1 -- 172.21.2.105:0/1375005432 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f71080b7c80 msgr2=0x7f710813a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:27.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f710e44c700 1 --2- 172.21.2.105:0/1375005432 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f71080b7c80 0x7f710813a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:27.781 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f710e44c700 1 -- 172.21.2.105:0/1375005432 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f710400b180 con 0x7f7108064900 2021-11-12T05:48:27.781 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f710e44c700 1 --2- 172.21.2.105:0/1375005432 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7108064900 0x7f710813e030 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 rx=0x7f71080b7850 tx=0x7f7104012000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:27.781 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f70f77fe700 1 -- 172.21.2.105:0/1375005432 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7104016070 con 0x7f7108064900 2021-11-12T05:48:27.781 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f70f77fe700 1 -- 172.21.2.105:0/1375005432 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7104002f50 con 0x7f7108064900 2021-11-12T05:48:27.782 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.764+0000 7f71106b0700 1 -- 172.21.2.105:0/1375005432 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f710813fe20 con 0x7f7108064900 2021-11-12T05:48:27.782 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.768+0000 7f70f77fe700 1 -- 172.21.2.105:0/1375005432 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f710401e450 con 0x7f7108064900 2021-11-12T05:48:27.782 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.768+0000 7f71106b0700 1 -- 172.21.2.105:0/1375005432 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7108140800 con 0x7f7108064900 2021-11-12T05:48:27.783 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.768+0000 7f71106b0700 1 -- 172.21.2.105:0/1375005432 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71080b31e0 con 0x7f7108064900 2021-11-12T05:48:27.783 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.768+0000 7f70f77fe700 1 -- 172.21.2.105:0/1375005432 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7104025030 con 0x7f7108064900 2021-11-12T05:48:27.783 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.768+0000 7f70f77fe700 1 --2- 172.21.2.105:0/1375005432 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f70e80536d0 0x7f70e8055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:27.783 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.768+0000 7f70f77fe700 1 -- 172.21.2.105:0/1375005432 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f710406ca90 con 0x7f7108064900 2021-11-12T05:48:27.784 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.768+0000 7f710dc4b700 1 --2- 172.21.2.105:0/1375005432 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f70e80536d0 0x7f70e8055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:27.784 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.768+0000 7f710dc4b700 1 --2- 172.21.2.105:0/1375005432 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f70e80536d0 0x7f70e8055b90 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f71080b2d90 tx=0x7f70f8007860).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:27.784 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.768+0000 7f70f77fe700 1 -- 172.21.2.105:0/1375005432 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7104043aa0 con 0x7f7108064900 2021-11-12T05:48:27.883 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:27.880+0000 7f71106b0700 1 -- 172.21.2.105:0/1375005432 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7108057350 con 0x7f7108064900 2021-11-12T05:48:28.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.400+0000 7f70f77fe700 1 -- 172.21.2.105:0/1375005432 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v55) v1 ==== 118+0+0 (secure 0 0 0) 0x7f71040470c0 con 0x7f7108064900 2021-11-12T05:48:28.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.404+0000 7f71106b0700 1 -- 172.21.2.105:0/1375005432 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f70e80536d0 msgr2=0x7f70e8055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:28.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.404+0000 7f71106b0700 1 --2- 172.21.2.105:0/1375005432 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f70e80536d0 0x7f70e8055b90 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f71080b2d90 tx=0x7f70f8007860).stop 2021-11-12T05:48:28.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.404+0000 7f71106b0700 1 -- 172.21.2.105:0/1375005432 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7108064900 msgr2=0x7f710813e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:28.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.404+0000 7f71106b0700 1 --2- 172.21.2.105:0/1375005432 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7108064900 0x7f710813e030 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 rx=0x7f71080b7850 tx=0x7f7104012000).stop 2021-11-12T05:48:28.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.404+0000 7f71106b0700 1 -- 172.21.2.105:0/1375005432 shutdown_connections 2021-11-12T05:48:28.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.404+0000 7f71106b0700 1 --2- 172.21.2.105:0/1375005432 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f70e80536d0 0x7f70e8055b90 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:28.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.404+0000 7f71106b0700 1 --2- 172.21.2.105:0/1375005432 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7108140f90 0x7f710813a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:28.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.404+0000 7f71106b0700 1 --2- 172.21.2.105:0/1375005432 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f71080b7c80 0x7f710813a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:28.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.404+0000 7f71106b0700 1 --2- 172.21.2.105:0/1375005432 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7108064900 0x7f710813e030 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:28.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.404+0000 7f71106b0700 1 -- 172.21.2.105:0/1375005432 >> 172.21.2.105:0/1375005432 conn(0x7f710805c860 msgr2=0x7f710813af10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:28.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.404+0000 7f71106b0700 1 -- 172.21.2.105:0/1375005432 shutdown_connections 2021-11-12T05:48:28.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.404+0000 7f71106b0700 1 -- 172.21.2.105:0/1375005432 wait complete. 2021-11-12T05:48:28.414 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:48:28.474 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.468+0000 7f7899a8b700 1 Processor -- start 2021-11-12T05:48:28.474 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.468+0000 7f7899a8b700 1 -- start start 2021-11-12T05:48:28.474 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.468+0000 7f7899a8b700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f789414b2f0 0x7f78940af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:28.475 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.468+0000 7f7899a8b700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78940ac7b0 con 0x7f78940ac280 2021-11-12T05:48:28.475 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.468+0000 7f7899a8b700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78940ac9e0 con 0x7f78940ad080 2021-11-12T05:48:28.475 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.468+0000 7f7899a8b700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78941488a0 con 0x7f789414b2f0 2021-11-12T05:48:28.475 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.468+0000 7f7892ffd700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f78940ac280 0x7f7894147a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60928/0 (socket says 172.21.2.105:60928) 2021-11-12T05:48:28.476 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.468+0000 7f7892ffd700 1 -- 172.21.2.105:0/1175348887 learned_addr learned my addr 172.21.2.105:0/1175348887 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:28.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.468+0000 7f78927fc700 1 -- 172.21.2.105:0/1175348887 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2177420318 0 0) 0x7f78940ac7b0 con 0x7f78940ac280 2021-11-12T05:48:28.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.468+0000 7f78927fc700 1 -- 172.21.2.105:0/1175348887 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7874003260 con 0x7f78940ac280 2021-11-12T05:48:28.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.468+0000 7f7893fff700 1 --2- 172.21.2.105:0/1175348887 >> v2:172.21.2.115:3300/0 conn(0x7f789414b2f0 0x7f78940af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:28.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f78927fc700 1 -- 172.21.2.105:0/1175348887 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 476805523 0 0) 0x7f7874003260 con 0x7f78940ac280 2021-11-12T05:48:28.483 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f78927fc700 1 -- 172.21.2.105:0/1175348887 >> v2:172.21.2.115:3300/0 conn(0x7f789414b2f0 msgr2=0x7f78940af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:28.483 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f78927fc700 1 --2- 172.21.2.105:0/1175348887 >> v2:172.21.2.115:3300/0 conn(0x7f789414b2f0 0x7f78940af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:28.483 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f78927fc700 1 -- 172.21.2.105:0/1175348887 >> v1:172.21.2.115:6789/0 conn(0x7f78940ad080 legacy=0x7f789414abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:28.483 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f78927fc700 1 -- 172.21.2.105:0/1175348887 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78940b0b30 con 0x7f78940ac280 2021-11-12T05:48:28.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f78927fc700 1 -- 172.21.2.105:0/1175348887 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f787c001660 con 0x7f78940ac280 2021-11-12T05:48:28.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f78927fc700 1 -- 172.21.2.105:0/1175348887 >> v1:172.21.2.105:6789/0 conn(0x7f78940ac280 legacy=0x7f7894147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:28.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f78927fc700 1 --2- 172.21.2.105:0/1175348887 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f78740037a0 0x7f7874003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:28.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f78927fc700 1 --2- 172.21.2.105:0/1175348887 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7874004500 0x7f7874004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:28.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f78927fc700 1 --2- 172.21.2.105:0/1175348887 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7874004f90 0x7f787400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:28.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f78927fc700 1 -- 172.21.2.105:0/1175348887 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78941488a0 con 0x7f7874004500 2021-11-12T05:48:28.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f78927fc700 1 -- 172.21.2.105:0/1175348887 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787400be00 con 0x7f7874004f90 2021-11-12T05:48:28.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f78927fc700 1 -- 172.21.2.105:0/1175348887 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787400bfc0 con 0x7f78740037a0 2021-11-12T05:48:28.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7892ffd700 1 --2- 172.21.2.105:0/1175348887 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7874004500 0x7f7874004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:28.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7893fff700 1 --2- 172.21.2.105:0/1175348887 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7874004f90 0x7f787400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:28.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7892ffd700 1 -- 172.21.2.105:0/1175348887 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f78740037a0 msgr2=0x7f7874003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:28.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7892ffd700 1 --2- 172.21.2.105:0/1175348887 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f78740037a0 0x7f7874003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:28.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7892ffd700 1 -- 172.21.2.105:0/1175348887 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7874004f90 msgr2=0x7f787400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:28.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7892ffd700 1 --2- 172.21.2.105:0/1175348887 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7874004f90 0x7f787400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:28.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7892ffd700 1 -- 172.21.2.105:0/1175348887 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7874003260 con 0x7f7874004500 2021-11-12T05:48:28.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7893fff700 1 --2- 172.21.2.105:0/1175348887 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7874004f90 0x7f787400b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:48:28.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7893fff700 1 -- 172.21.2.105:0/1175348887 reap_dead start 2021-11-12T05:48:28.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7892ffd700 1 --2- 172.21.2.105:0/1175348887 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7874004500 0x7f7874004980 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7f787c001370 tx=0x7f78940ada20).ready entity=mon.0 client_cookie=f608fcffb813f082 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:28.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f78927fc700 1 -- 172.21.2.105:0/1175348887 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f787c0070d0 con 0x7f7874004500 2021-11-12T05:48:28.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f78927fc700 1 -- 172.21.2.105:0/1175348887 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787c007230 con 0x7f7874004500 2021-11-12T05:48:28.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f78927fc700 1 -- 172.21.2.105:0/1175348887 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f787c00c8f0 con 0x7f7874004500 2021-11-12T05:48:28.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7899a8b700 1 -- 172.21.2.105:0/1175348887 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7874004500 msgr2=0x7f7874004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:28.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7899a8b700 1 --2- 172.21.2.105:0/1175348887 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7874004500 0x7f7874004980 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7f787c001370 tx=0x7f78940ada20).stop 2021-11-12T05:48:28.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7899a8b700 1 -- 172.21.2.105:0/1175348887 shutdown_connections 2021-11-12T05:48:28.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7899a8b700 1 --2- 172.21.2.105:0/1175348887 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7874004500 0x7f7874004980 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:28.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7899a8b700 1 -- 172.21.2.105:0/1175348887 >> 172.21.2.105:0/1175348887 conn(0x7f78940b5370 msgr2=0x7f78940b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:28.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7899a8b700 1 -- 172.21.2.105:0/1175348887 shutdown_connections 2021-11-12T05:48:28.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7899a8b700 1 -- 172.21.2.105:0/1175348887 wait complete. 2021-11-12T05:48:28.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7899a8b700 1 Processor -- start 2021-11-12T05:48:28.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7899a8b700 1 -- start start 2021-11-12T05:48:28.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7899a8b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7874004500 0x7f789414ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:28.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7899a8b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7894149d40 0x7f789415a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:28.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7899a8b700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f789415a9e0 0x7f78940a93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:28.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7899a8b700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789415a0c0 con 0x7f7894149d40 2021-11-12T05:48:28.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7899a8b700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78940a7790 con 0x7f789415a9e0 2021-11-12T05:48:28.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7899a8b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78940a7a30 con 0x7f7874004500 2021-11-12T05:48:28.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7892ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7894149d40 0x7f789415a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:28.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7892ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7894149d40 0x7f789415a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50544/0 (socket says 172.21.2.105:50544) 2021-11-12T05:48:28.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7892ffd700 1 -- 172.21.2.105:0/1498091848 learned_addr learned my addr 172.21.2.105:0/1498091848 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:28.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7893fff700 1 --2- 172.21.2.105:0/1498091848 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f789415a9e0 0x7f78940a93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:28.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f78937fe700 1 --2- 172.21.2.105:0/1498091848 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7874004500 0x7f789414ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:28.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7892ffd700 1 -- 172.21.2.105:0/1498091848 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7874004500 msgr2=0x7f789414ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:28.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7892ffd700 1 --2- 172.21.2.105:0/1498091848 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7874004500 0x7f789414ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:28.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7892ffd700 1 -- 172.21.2.105:0/1498091848 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f789415a9e0 msgr2=0x7f78940a93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:28.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7892ffd700 1 --2- 172.21.2.105:0/1498091848 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f789415a9e0 0x7f78940a93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:28.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7892ffd700 1 -- 172.21.2.105:0/1498091848 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78940a7090 con 0x7f7894149d40 2021-11-12T05:48:28.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7892ffd700 1 --2- 172.21.2.105:0/1498091848 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7894149d40 0x7f789415a4f0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 rx=0x7f787c001370 tx=0x7f787c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:28.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7890ff9700 1 -- 172.21.2.105:0/1498091848 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f787c0070d0 con 0x7f7894149d40 2021-11-12T05:48:28.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7890ff9700 1 -- 172.21.2.105:0/1498091848 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787c018070 con 0x7f7894149d40 2021-11-12T05:48:28.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7899a8b700 1 -- 172.21.2.105:0/1498091848 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f789414a1a0 con 0x7f7894149d40 2021-11-12T05:48:28.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7890ff9700 1 -- 172.21.2.105:0/1498091848 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f787c004920 con 0x7f7894149d40 2021-11-12T05:48:28.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.472+0000 7f7899a8b700 1 -- 172.21.2.105:0/1498091848 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78940a7360 con 0x7f7894149d40 2021-11-12T05:48:28.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.476+0000 7f7899a8b700 1 -- 172.21.2.105:0/1498091848 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78940a75b0 con 0x7f7894149d40 2021-11-12T05:48:28.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.476+0000 7f7890ff9700 1 -- 172.21.2.105:0/1498091848 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f787c024020 con 0x7f7894149d40 2021-11-12T05:48:28.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.476+0000 7f7890ff9700 1 --2- 172.21.2.105:0/1498091848 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f78780536d0 0x7f7878055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:28.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.476+0000 7f7890ff9700 1 -- 172.21.2.105:0/1498091848 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f787c06c500 con 0x7f7894149d40 2021-11-12T05:48:28.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.476+0000 7f78937fe700 1 --2- 172.21.2.105:0/1498091848 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f78780536d0 0x7f7878055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:28.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.476+0000 7f78937fe700 1 --2- 172.21.2.105:0/1498091848 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f78780536d0 0x7f7878055b90 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f788400b000 tx=0x7f7884009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:28.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.476+0000 7f7890ff9700 1 -- 172.21.2.105:0/1498091848 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f787c043510 con 0x7f7894149d40 2021-11-12T05:48:28.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.588+0000 7f7899a8b700 1 -- 172.21.2.105:0/1498091848 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78940b1440 con 0x7f7894149d40 2021-11-12T05:48:28.594 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.588+0000 7f7890ff9700 1 -- 172.21.2.105:0/1498091848 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f787c046b30 con 0x7f7894149d40 2021-11-12T05:48:28.594 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:28.595 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":55,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4889,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/903045813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":903045813},{"type":"v1","addr":"172.21.2.115:6833","nonce":903045813}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":54}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:48:27.392744+0000","modified":"2021-11-12T05:48:28.395983+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7701},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7701":{"gid":7701,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/2721453399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":2721453399},{"type":"v1","addr":"172.21.2.105:6835","nonce":2721453399}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-11-12T05:48:28.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.592+0000 7f7899a8b700 1 -- 172.21.2.105:0/1498091848 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f78780536d0 msgr2=0x7f7878055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:28.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.592+0000 7f7899a8b700 1 --2- 172.21.2.105:0/1498091848 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f78780536d0 0x7f7878055b90 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f788400b000 tx=0x7f7884009040).stop 2021-11-12T05:48:28.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.592+0000 7f7899a8b700 1 -- 172.21.2.105:0/1498091848 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7894149d40 msgr2=0x7f789415a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:28.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.592+0000 7f7899a8b700 1 --2- 172.21.2.105:0/1498091848 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7894149d40 0x7f789415a4f0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 rx=0x7f787c001370 tx=0x7f787c015000).stop 2021-11-12T05:48:28.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.592+0000 7f7899a8b700 1 -- 172.21.2.105:0/1498091848 shutdown_connections 2021-11-12T05:48:28.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.592+0000 7f7899a8b700 1 --2- 172.21.2.105:0/1498091848 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f78780536d0 0x7f7878055b90 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:28.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.592+0000 7f7899a8b700 1 --2- 172.21.2.105:0/1498091848 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f789415a9e0 0x7f78940a93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:28.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.592+0000 7f7899a8b700 1 --2- 172.21.2.105:0/1498091848 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7894149d40 0x7f789415a4f0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:28.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.592+0000 7f7899a8b700 1 --2- 172.21.2.105:0/1498091848 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7874004500 0x7f789414ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:28.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.592+0000 7f7899a8b700 1 -- 172.21.2.105:0/1498091848 >> 172.21.2.105:0/1498091848 conn(0x7f78940b5370 msgr2=0x7f789405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:28.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.592+0000 7f7899a8b700 1 -- 172.21.2.105:0/1498091848 shutdown_connections 2021-11-12T05:48:28.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.592+0000 7f7899a8b700 1 -- 172.21.2.105:0/1498091848 wait complete. 2021-11-12T05:48:28.599 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 55 2021-11-12T05:48:28.602 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:48:28.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.648+0000 7f24826fc700 1 Processor -- start 2021-11-12T05:48:28.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.648+0000 7f24826fc700 1 -- start start 2021-11-12T05:48:28.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.648+0000 7f24826fc700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f247c0601a0 0x7f247c141470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:28.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.648+0000 7f24826fc700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f247c066150 con 0x7f247c05fdc0 2021-11-12T05:48:28.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.648+0000 7f24826fc700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f247c0663f0 con 0x7f247c0ade80 2021-11-12T05:48:28.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.648+0000 7f24826fc700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f247c141fb0 con 0x7f247c0601a0 2021-11-12T05:48:28.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.648+0000 7f247bfff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f247c05fdc0 0x7f247c066730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60946/0 (socket says 172.21.2.105:60946) 2021-11-12T05:48:28.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.648+0000 7f247bfff700 1 -- 172.21.2.105:0/3501476942 learned_addr learned my addr 172.21.2.105:0/3501476942 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:28.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.648+0000 7f247affd700 1 -- 172.21.2.105:0/3501476942 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1581960042 0 0) 0x7f247c066150 con 0x7f247c05fdc0 2021-11-12T05:48:28.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.648+0000 7f247affd700 1 -- 172.21.2.105:0/3501476942 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f245c003260 con 0x7f247c05fdc0 2021-11-12T05:48:28.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.648+0000 7f247affd700 1 -- 172.21.2.105:0/3501476942 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1169167289 0 0) 0x7f245c003260 con 0x7f247c05fdc0 2021-11-12T05:48:28.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.648+0000 7f247affd700 1 -- 172.21.2.105:0/3501476942 >> v2:172.21.2.115:3300/0 conn(0x7f247c0601a0 msgr2=0x7f247c141470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:28.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.648+0000 7f247affd700 1 --2- 172.21.2.105:0/3501476942 >> v2:172.21.2.115:3300/0 conn(0x7f247c0601a0 0x7f247c141470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:28.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.648+0000 7f247affd700 1 -- 172.21.2.105:0/3501476942 >> v1:172.21.2.115:6789/0 conn(0x7f247c0ade80 legacy=0x7f247c13a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:28.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.648+0000 7f247affd700 1 -- 172.21.2.105:0/3501476942 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f247c140fd0 con 0x7f247c05fdc0 2021-11-12T05:48:28.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.648+0000 7f247affd700 1 -- 172.21.2.105:0/3501476942 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f246c001660 con 0x7f247c05fdc0 2021-11-12T05:48:28.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.648+0000 7f247affd700 1 -- 172.21.2.105:0/3501476942 >> v1:172.21.2.105:6789/0 conn(0x7f247c05fdc0 legacy=0x7f247c066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:28.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.648+0000 7f247affd700 1 --2- 172.21.2.105:0/3501476942 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f245c003750 0x7f245c003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:28.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.648+0000 7f247affd700 1 --2- 172.21.2.105:0/3501476942 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f245c004500 0x7f245c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:28.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.648+0000 7f247affd700 1 --2- 172.21.2.105:0/3501476942 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f245c004f90 0x7f245c00fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:28.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.648+0000 7f247affd700 1 -- 172.21.2.105:0/3501476942 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245c010210 con 0x7f245c004f90 2021-11-12T05:48:28.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.648+0000 7f247affd700 1 -- 172.21.2.105:0/3501476942 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245c010380 con 0x7f245c003750 2021-11-12T05:48:28.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.648+0000 7f247affd700 1 -- 172.21.2.105:0/3501476942 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f245c010540 con 0x7f245c004500 2021-11-12T05:48:28.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.648+0000 7f2480c99700 1 --2- 172.21.2.105:0/3501476942 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f245c004f90 0x7f245c00fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:28.663 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.648+0000 7f247bfff700 1 --2- 172.21.2.105:0/3501476942 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f245c003750 0x7f245c003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:28.663 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.648+0000 7f2480c99700 1 -- 172.21.2.105:0/3501476942 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f245c004500 msgr2=0x7f245c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:28.663 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.648+0000 7f2480c99700 1 --2- 172.21.2.105:0/3501476942 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f245c004500 0x7f245c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:28.663 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.648+0000 7f2480c99700 1 -- 172.21.2.105:0/3501476942 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f245c003750 msgr2=0x7f245c003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:28.663 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.648+0000 7f2480c99700 1 --2- 172.21.2.105:0/3501476942 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f245c003750 0x7f245c003b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:28.664 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.648+0000 7f2480c99700 1 -- 172.21.2.105:0/3501476942 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f247c140fd0 con 0x7f245c004f90 2021-11-12T05:48:28.664 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.648+0000 7f2480c99700 1 -- 172.21.2.105:0/3501476942 reap_dead start 2021-11-12T05:48:28.664 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.648+0000 7f2480c99700 1 --2- 172.21.2.105:0/3501476942 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f245c004f90 0x7f245c00fb60 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7f24740032f0 tx=0x7f2474006f90).ready entity=mon.0 client_cookie=c00bc143874ebd7e server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:28.664 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.652+0000 7f247affd700 1 -- 172.21.2.105:0/3501476942 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2474011440 con 0x7f245c004f90 2021-11-12T05:48:28.665 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.652+0000 7f247affd700 1 -- 172.21.2.105:0/3501476942 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24740115a0 con 0x7f245c004f90 2021-11-12T05:48:28.665 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.652+0000 7f247affd700 1 -- 172.21.2.105:0/3501476942 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2474011900 con 0x7f245c004f90 2021-11-12T05:48:28.665 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.652+0000 7f24826fc700 1 -- 172.21.2.105:0/3501476942 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f245c004f90 msgr2=0x7f245c00fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:28.665 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.652+0000 7f24826fc700 1 --2- 172.21.2.105:0/3501476942 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f245c004f90 0x7f245c00fb60 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7f24740032f0 tx=0x7f2474006f90).stop 2021-11-12T05:48:28.665 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.652+0000 7f24826fc700 1 -- 172.21.2.105:0/3501476942 shutdown_connections 2021-11-12T05:48:28.666 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.652+0000 7f24826fc700 1 --2- 172.21.2.105:0/3501476942 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f245c004f90 0x7f245c00fb60 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:28.666 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.652+0000 7f24826fc700 1 -- 172.21.2.105:0/3501476942 >> 172.21.2.105:0/3501476942 conn(0x7f247c0608d0 msgr2=0x7f247c05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:28.666 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.652+0000 7f24826fc700 1 -- 172.21.2.105:0/3501476942 shutdown_connections 2021-11-12T05:48:28.666 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.652+0000 7f24826fc700 1 -- 172.21.2.105:0/3501476942 wait complete. 2021-11-12T05:48:28.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.652+0000 7f24826fc700 1 Processor -- start 2021-11-12T05:48:28.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.652+0000 7f24826fc700 1 -- start start 2021-11-12T05:48:28.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.652+0000 7f24826fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f245c004f90 0x7f247c142fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:28.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.652+0000 7f24826fc700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f247c14db20 0x7f247c0b4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:28.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.652+0000 7f24826fc700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f247c0b7a50 0x7f247c0b7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:28.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.652+0000 7f24826fc700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247c14dfa0 con 0x7f245c004f90 2021-11-12T05:48:28.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.652+0000 7f24826fc700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247c0b04f0 con 0x7f247c0b7a50 2021-11-12T05:48:28.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.652+0000 7f24826fc700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f247c0b83c0 con 0x7f247c14db20 2021-11-12T05:48:28.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.652+0000 7f247bfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f245c004f90 0x7f247c142fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:28.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.652+0000 7f247bfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f245c004f90 0x7f247c142fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50562/0 (socket says 172.21.2.105:50562) 2021-11-12T05:48:28.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.652+0000 7f247bfff700 1 -- 172.21.2.105:0/3550753767 learned_addr learned my addr 172.21.2.105:0/3550753767 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:28.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.652+0000 7f247bfff700 1 -- 172.21.2.105:0/3550753767 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f247c14db20 msgr2=0x7f247c0b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:28.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.652+0000 7f247bfff700 1 --2- 172.21.2.105:0/3550753767 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f247c14db20 0x7f247c0b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:28.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.652+0000 7f247bfff700 1 -- 172.21.2.105:0/3550753767 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f247c0b7a50 msgr2=0x7f247c0b7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:28.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.652+0000 7f247bfff700 1 --2- 172.21.2.105:0/3550753767 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f247c0b7a50 0x7f247c0b7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:28.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.652+0000 7f247bfff700 1 -- 172.21.2.105:0/3550753767 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f247c0b1390 con 0x7f245c004f90 2021-11-12T05:48:28.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.652+0000 7f247bfff700 1 --2- 172.21.2.105:0/3550753767 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f245c004f90 0x7f247c142fa0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 rx=0x7f246c008000 tx=0x7f246c009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:28.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.652+0000 7f24797fa700 1 -- 172.21.2.105:0/3550753767 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f246c007170 con 0x7f245c004f90 2021-11-12T05:48:28.671 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.652+0000 7f24797fa700 1 -- 172.21.2.105:0/3550753767 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246c0072d0 con 0x7f245c004f90 2021-11-12T05:48:28.671 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.652+0000 7f24826fc700 1 -- 172.21.2.105:0/3550753767 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f247c0b4530 con 0x7f245c004f90 2021-11-12T05:48:28.671 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.652+0000 7f24797fa700 1 -- 172.21.2.105:0/3550753767 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f246c004920 con 0x7f245c004f90 2021-11-12T05:48:28.671 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.652+0000 7f24826fc700 1 -- 172.21.2.105:0/3550753767 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f247c0b00f0 con 0x7f245c004f90 2021-11-12T05:48:28.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.652+0000 7f24826fc700 1 -- 172.21.2.105:0/3550753767 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f247c057350 con 0x7f245c004f90 2021-11-12T05:48:28.673 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.652+0000 7f24797fa700 1 -- 172.21.2.105:0/3550753767 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f246c004a80 con 0x7f245c004f90 2021-11-12T05:48:28.673 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.652+0000 7f24797fa700 1 --2- 172.21.2.105:0/3550753767 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f24600536d0 0x7f2460055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:28.673 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.652+0000 7f24797fa700 1 -- 172.21.2.105:0/3550753767 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f246c06b8a0 con 0x7f245c004f90 2021-11-12T05:48:28.673 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.652+0000 7f247b7fe700 1 --2- 172.21.2.105:0/3550753767 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f24600536d0 0x7f2460055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:28.674 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.656+0000 7f247b7fe700 1 --2- 172.21.2.105:0/3550753767 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f24600536d0 0x7f2460055b90 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f2464000f70 tx=0x7f24640069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:28.674 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.656+0000 7f24797fa700 1 -- 172.21.2.105:0/3550753767 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f246c0428b0 con 0x7f245c004f90 2021-11-12T05:48:28.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.740+0000 7f24826fc700 1 -- 172.21.2.105:0/3550753767 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f247c0661d0 con 0x7f245c004f90 2021-11-12T05:48:28.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.740+0000 7f24797fa700 1 -- 172.21.2.105:0/3550753767 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f246c045ed0 con 0x7f245c004f90 2021-11-12T05:48:28.745 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:28.746 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":117,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:48:28.397131+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:48:25.280993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-11-12T05:48:26.409707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:48:28.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.740+0000 7f24826fc700 1 -- 172.21.2.105:0/3550753767 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f24600536d0 msgr2=0x7f2460055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:28.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.740+0000 7f24826fc700 1 --2- 172.21.2.105:0/3550753767 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f24600536d0 0x7f2460055b90 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f2464000f70 tx=0x7f24640069b0).stop 2021-11-12T05:48:28.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.740+0000 7f24826fc700 1 -- 172.21.2.105:0/3550753767 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f245c004f90 msgr2=0x7f247c142fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:28.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.740+0000 7f24826fc700 1 --2- 172.21.2.105:0/3550753767 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f245c004f90 0x7f247c142fa0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 rx=0x7f246c008000 tx=0x7f246c009040).stop 2021-11-12T05:48:28.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.740+0000 7f24826fc700 1 -- 172.21.2.105:0/3550753767 shutdown_connections 2021-11-12T05:48:28.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.740+0000 7f24826fc700 1 --2- 172.21.2.105:0/3550753767 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f24600536d0 0x7f2460055b90 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:28.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.740+0000 7f24826fc700 1 --2- 172.21.2.105:0/3550753767 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f247c0b7a50 0x7f247c0b7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:28.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.740+0000 7f24826fc700 1 --2- 172.21.2.105:0/3550753767 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f247c14db20 0x7f247c0b4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:28.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.740+0000 7f24826fc700 1 --2- 172.21.2.105:0/3550753767 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f245c004f90 0x7f247c142fa0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:28.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.740+0000 7f24826fc700 1 -- 172.21.2.105:0/3550753767 >> 172.21.2.105:0/3550753767 conn(0x7f247c0608d0 msgr2=0x7f247c13d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:28.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.740+0000 7f24826fc700 1 -- 172.21.2.105:0/3550753767 shutdown_connections 2021-11-12T05:48:28.750 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.740+0000 7f24826fc700 1 -- 172.21.2.105:0/3550753767 wait complete. 2021-11-12T05:48:28.753 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-12T05:48:28.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.804+0000 7fa62c18c700 1 Processor -- start 2021-11-12T05:48:28.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.804+0000 7fa62c18c700 1 -- start start 2021-11-12T05:48:28.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.804+0000 7fa62c18c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa6240ac280 0x7fa62414b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:28.811 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.804+0000 7fa62c18c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa6240af730 0x7fa6240ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:28.811 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.804+0000 7fa62c18c700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6240ac7b0 con 0x7fa6240ad080 2021-11-12T05:48:28.811 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.804+0000 7fa62c18c700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6241488a0 con 0x7fa6240af730 2021-11-12T05:48:28.812 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.804+0000 7fa62c18c700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6240ac9e0 con 0x7fa6240ac280 2021-11-12T05:48:28.812 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.804+0000 7fa62a729700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa6240af730 0x7fa6240ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:28.813 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.804+0000 7fa62a729700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa6240af730 0x7fa6240ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50572/0 (socket says 172.21.2.105:50572) 2021-11-12T05:48:28.813 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.804+0000 7fa62a729700 1 -- 172.21.2.105:0/3638163433 learned_addr learned my addr 172.21.2.105:0/3638163433 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:28.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.804+0000 7fa62a729700 1 -- 172.21.2.105:0/3638163433 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa6240ac280 msgr2=0x7fa62414b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:28.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.804+0000 7fa62a729700 1 --2- 172.21.2.105:0/3638163433 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa6240ac280 0x7fa62414b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:28.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.804+0000 7fa62a729700 1 -- 172.21.2.105:0/3638163433 >> v1:172.21.2.115:6789/0 conn(0x7fa6240ad080 legacy=0x7fa62414abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:28.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.804+0000 7fa62a729700 1 -- 172.21.2.105:0/3638163433 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6240b0b30 con 0x7fa6240af730 2021-11-12T05:48:28.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.804+0000 7fa62a729700 1 --2- 172.21.2.105:0/3638163433 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa6240af730 0x7fa6240ad460 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7fa62414bc40 tx=0x7fa61c009290).ready entity=mon.0 client_cookie=3ef1f7600388659d server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:28.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.804+0000 7fa628f26700 1 -- 172.21.2.105:0/3638163433 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa61c00b830 con 0x7fa6240af730 2021-11-12T05:48:28.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.804+0000 7fa628f26700 1 -- 172.21.2.105:0/3638163433 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61c00b990 con 0x7fa6240af730 2021-11-12T05:48:28.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.804+0000 7fa628f26700 1 -- 172.21.2.105:0/3638163433 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa61c00bb00 con 0x7fa6240af730 2021-11-12T05:48:28.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.804+0000 7fa62c18c700 1 -- 172.21.2.105:0/3638163433 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa6240af730 msgr2=0x7fa6240ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:28.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.804+0000 7fa62c18c700 1 --2- 172.21.2.105:0/3638163433 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa6240af730 0x7fa6240ad460 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7fa62414bc40 tx=0x7fa61c009290).stop 2021-11-12T05:48:28.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.804+0000 7fa62c18c700 1 -- 172.21.2.105:0/3638163433 shutdown_connections 2021-11-12T05:48:28.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.804+0000 7fa62c18c700 1 --2- 172.21.2.105:0/3638163433 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa6240af730 0x7fa6240ad460 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:28.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.804+0000 7fa62c18c700 1 --2- 172.21.2.105:0/3638163433 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa6240ac280 0x7fa62414b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:28.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.804+0000 7fa62c18c700 1 -- 172.21.2.105:0/3638163433 >> 172.21.2.105:0/3638163433 conn(0x7fa6240b5370 msgr2=0x7fa6240b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:28.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.804+0000 7fa62c18c700 1 -- 172.21.2.105:0/3638163433 shutdown_connections 2021-11-12T05:48:28.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.804+0000 7fa62c18c700 1 -- 172.21.2.105:0/3638163433 wait complete. 2021-11-12T05:48:28.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.808+0000 7fa62c18c700 1 Processor -- start 2021-11-12T05:48:28.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.808+0000 7fa62c18c700 1 -- start start 2021-11-12T05:48:28.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.808+0000 7fa62c18c700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa6240ac280 0x7fa6240abb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:28.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.808+0000 7fa62c18c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa6240ad080 0x7fa6240637e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:28.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.808+0000 7fa62c18c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa6240af730 0x7fa624156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:28.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.808+0000 7fa62c18c700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6240ab250 con 0x7fa6240af730 2021-11-12T05:48:28.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.808+0000 7fa62c18c700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa624063ea0 con 0x7fa6240ac280 2021-11-12T05:48:28.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.808+0000 7fa62c18c700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa624064140 con 0x7fa6240ad080 2021-11-12T05:48:28.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.808+0000 7fa62a729700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa6240af730 0x7fa624156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:28.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.808+0000 7fa62a729700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa6240af730 0x7fa624156dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50578/0 (socket says 172.21.2.105:50578) 2021-11-12T05:48:28.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.808+0000 7fa62a729700 1 -- 172.21.2.105:0/932222569 learned_addr learned my addr 172.21.2.105:0/932222569 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:28.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.808+0000 7fa62a729700 1 -- 172.21.2.105:0/932222569 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa6240ad080 msgr2=0x7fa6240637e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:28.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.808+0000 7fa62a729700 1 --2- 172.21.2.105:0/932222569 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa6240ad080 0x7fa6240637e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:28.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.808+0000 7fa62a729700 1 -- 172.21.2.105:0/932222569 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa6240ac280 msgr2=0x7fa6240abb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:28.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.808+0000 7fa62a729700 1 --2- 172.21.2.105:0/932222569 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa6240ac280 0x7fa6240abb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:28.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.808+0000 7fa62a729700 1 -- 172.21.2.105:0/932222569 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61c009530 con 0x7fa6240af730 2021-11-12T05:48:28.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.808+0000 7fa62a729700 1 --2- 172.21.2.105:0/932222569 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa6240af730 0x7fa624156dc0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 rx=0x7fa62414bc40 tx=0x7fa61c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:28.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.808+0000 7fa616ffd700 1 -- 172.21.2.105:0/932222569 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa61c00b830 con 0x7fa6240af730 2021-11-12T05:48:28.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.808+0000 7fa616ffd700 1 -- 172.21.2.105:0/932222569 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61c01f610 con 0x7fa6240af730 2021-11-12T05:48:28.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.808+0000 7fa62c18c700 1 -- 172.21.2.105:0/932222569 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6240a8a90 con 0x7fa6240af730 2021-11-12T05:48:28.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.808+0000 7fa616ffd700 1 -- 172.21.2.105:0/932222569 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa61c01f970 con 0x7fa6240af730 2021-11-12T05:48:28.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.808+0000 7fa62c18c700 1 -- 172.21.2.105:0/932222569 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6240ab680 con 0x7fa6240af730 2021-11-12T05:48:28.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.808+0000 7fa62c18c700 1 -- 172.21.2.105:0/932222569 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6240ab3c0 con 0x7fa6240af730 2021-11-12T05:48:28.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.808+0000 7fa616ffd700 1 -- 172.21.2.105:0/932222569 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa61c00f070 con 0x7fa6240af730 2021-11-12T05:48:28.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.808+0000 7fa616ffd700 1 --2- 172.21.2.105:0/932222569 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa6040536f0 0x7fa604055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:28.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.808+0000 7fa616ffd700 1 -- 172.21.2.105:0/932222569 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fa61c06c690 con 0x7fa6240af730 2021-11-12T05:48:28.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.808+0000 7fa629f28700 1 --2- 172.21.2.105:0/932222569 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa6040536f0 0x7fa604055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:28.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.808+0000 7fa629f28700 1 --2- 172.21.2.105:0/932222569 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa6040536f0 0x7fa604055bb0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fa620002f90 tx=0x7fa6200069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:28.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.812+0000 7fa616ffd700 1 -- 172.21.2.105:0/932222569 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa6240ab3c0 con 0x7fa6240af730 2021-11-12T05:48:28.925 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.920+0000 7fa62c18c700 1 -- 172.21.2.105:0/932222569 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fa624063cd0 con 0x7fa6240af730 2021-11-12T05:48:28.930 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.924+0000 7fa616ffd700 1 -- 172.21.2.105:0/932222569 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v38) v1 ==== 184+0+0 (secure 0 0 0) 0x7fa61c015070 con 0x7fa6240af730 2021-11-12T05:48:28.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.928+0000 7fa62c18c700 1 -- 172.21.2.105:0/932222569 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa6040536f0 msgr2=0x7fa604055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:28.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.928+0000 7fa62c18c700 1 --2- 172.21.2.105:0/932222569 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa6040536f0 0x7fa604055bb0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fa620002f90 tx=0x7fa6200069b0).stop 2021-11-12T05:48:28.933 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.928+0000 7fa62c18c700 1 -- 172.21.2.105:0/932222569 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa6240af730 msgr2=0x7fa624156dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:28.933 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.928+0000 7fa62c18c700 1 --2- 172.21.2.105:0/932222569 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa6240af730 0x7fa624156dc0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 rx=0x7fa62414bc40 tx=0x7fa61c016000).stop 2021-11-12T05:48:28.933 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.928+0000 7fa62c18c700 1 -- 172.21.2.105:0/932222569 shutdown_connections 2021-11-12T05:48:28.933 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.928+0000 7fa62c18c700 1 --2- 172.21.2.105:0/932222569 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa6040536f0 0x7fa604055bb0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:28.934 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.928+0000 7fa62c18c700 1 --2- 172.21.2.105:0/932222569 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa6240af730 0x7fa624156dc0 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:28.934 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.928+0000 7fa62c18c700 1 --2- 172.21.2.105:0/932222569 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa6240ad080 0x7fa6240637e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:28.934 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.928+0000 7fa62c18c700 1 --2- 172.21.2.105:0/932222569 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa6240ac280 0x7fa6240abb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:28.934 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.928+0000 7fa62c18c700 1 -- 172.21.2.105:0/932222569 >> 172.21.2.105:0/932222569 conn(0x7fa6240b5370 msgr2=0x7fa624143d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:28.934 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.928+0000 7fa62c18c700 1 -- 172.21.2.105:0/932222569 shutdown_connections 2021-11-12T05:48:28.935 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.928+0000 7fa62c18c700 1 -- 172.21.2.105:0/932222569 wait complete. 2021-11-12T05:48:28.935 INFO:teuthology.orchestra.run.gibba005.stderr:updated caps for client.0 2021-11-12T05:48:28.938 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-12T05:48:28.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.988+0000 7fbac9cc9700 1 Processor -- start 2021-11-12T05:48:28.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.988+0000 7fbac9cc9700 1 -- start start 2021-11-12T05:48:28.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.988+0000 7fbac9cc9700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fbac40ad080 0x7fbac40af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:28.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.988+0000 7fbac9cc9700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fbac40ac280 0x7fbac40ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:28.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.988+0000 7fbac9cc9700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac40ac7b0 con 0x7fbac414abe0 2021-11-12T05:48:28.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.988+0000 7fbac9cc9700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac41488a0 con 0x7fbac40ad080 2021-11-12T05:48:28.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.988+0000 7fbac9cc9700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac40ac9e0 con 0x7fbac40ac280 2021-11-12T05:48:28.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.988+0000 7fbac3fff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fbac414abe0 0x7fbac414b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60980/0 (socket says 172.21.2.105:60980) 2021-11-12T05:48:28.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.988+0000 7fbac3fff700 1 -- 172.21.2.105:0/2715381092 learned_addr learned my addr 172.21.2.105:0/2715381092 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:28.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.988+0000 7fbac37fe700 1 --2- 172.21.2.105:0/2715381092 >> v2:172.21.2.105:3300/0 conn(0x7fbac40ad080 0x7fbac40af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:28.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.988+0000 7fbac37fe700 1 -- 172.21.2.105:0/2715381092 >> v2:172.21.2.115:3300/0 conn(0x7fbac40ac280 msgr2=0x7fbac40ad460 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:48:28.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.988+0000 7fbac37fe700 1 --2- 172.21.2.105:0/2715381092 >> v2:172.21.2.115:3300/0 conn(0x7fbac40ac280 0x7fbac40ad460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:29.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.988+0000 7fbac37fe700 1 -- 172.21.2.105:0/2715381092 >> v1:172.21.2.105:6789/0 conn(0x7fbac414abe0 legacy=0x7fbac414b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:29.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.988+0000 7fbac37fe700 1 -- 172.21.2.105:0/2715381092 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac40b0b30 con 0x7fbac40ad080 2021-11-12T05:48:29.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.988+0000 7fbac37fe700 1 --2- 172.21.2.105:0/2715381092 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbac40ad080 0x7fbac40af730 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7fbaac002f70 tx=0x7fbaac006df0).ready entity=mon.0 client_cookie=771bd612ac995cea server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:29.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.988+0000 7fbac27fc700 1 -- 172.21.2.105:0/2715381092 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbaac00d5c0 con 0x7fbac40ad080 2021-11-12T05:48:29.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.988+0000 7fbac27fc700 1 -- 172.21.2.105:0/2715381092 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaac000e90 con 0x7fbac40ad080 2021-11-12T05:48:29.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.988+0000 7fbac27fc700 1 -- 172.21.2.105:0/2715381092 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbaac00d950 con 0x7fbac40ad080 2021-11-12T05:48:29.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.988+0000 7fbac9cc9700 1 -- 172.21.2.105:0/2715381092 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbac40ad080 msgr2=0x7fbac40af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:29.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.988+0000 7fbac9cc9700 1 --2- 172.21.2.105:0/2715381092 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbac40ad080 0x7fbac40af730 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7fbaac002f70 tx=0x7fbaac006df0).stop 2021-11-12T05:48:29.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.988+0000 7fbac9cc9700 1 -- 172.21.2.105:0/2715381092 shutdown_connections 2021-11-12T05:48:29.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.988+0000 7fbac9cc9700 1 --2- 172.21.2.105:0/2715381092 >> v2:172.21.2.115:3300/0 conn(0x7fbac40ac280 0x7fbac40ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:29.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.988+0000 7fbac9cc9700 1 --2- 172.21.2.105:0/2715381092 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbac40ad080 0x7fbac40af730 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:29.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.988+0000 7fbac9cc9700 1 -- 172.21.2.105:0/2715381092 >> 172.21.2.105:0/2715381092 conn(0x7fbac40b5370 msgr2=0x7fbac40b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:29.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.992+0000 7fbac9cc9700 1 -- 172.21.2.105:0/2715381092 shutdown_connections 2021-11-12T05:48:29.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.992+0000 7fbac9cc9700 1 -- 172.21.2.105:0/2715381092 wait complete. 2021-11-12T05:48:29.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.992+0000 7fbac9cc9700 1 Processor -- start 2021-11-12T05:48:29.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.992+0000 7fbac9cc9700 1 -- start start 2021-11-12T05:48:29.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.992+0000 7fbac9cc9700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbac40ac280 0x7fbac40ab300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:29.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.992+0000 7fbac9cc9700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbac40ad080 0x7fbac40ab7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:29.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.992+0000 7fbac9cc9700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbac414abe0 0x7fbac4156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:29.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.992+0000 7fbac9cc9700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac4063f20 con 0x7fbac414abe0 2021-11-12T05:48:29.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.992+0000 7fbac9cc9700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac40641c0 con 0x7fbac40ac280 2021-11-12T05:48:29.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.992+0000 7fbac9cc9700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac40a98e0 con 0x7fbac40ad080 2021-11-12T05:48:29.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.992+0000 7fbac3fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbac414abe0 0x7fbac4156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:29.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.992+0000 7fbac3fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbac414abe0 0x7fbac4156f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50590/0 (socket says 172.21.2.105:50590) 2021-11-12T05:48:29.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.992+0000 7fbac3fff700 1 -- 172.21.2.105:0/3465445703 learned_addr learned my addr 172.21.2.105:0/3465445703 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:29.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.992+0000 7fbac3fff700 1 -- 172.21.2.105:0/3465445703 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbac40ad080 msgr2=0x7fbac40ab7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:29.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.992+0000 7fbac3fff700 1 --2- 172.21.2.105:0/3465445703 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbac40ad080 0x7fbac40ab7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:29.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.992+0000 7fbac3fff700 1 -- 172.21.2.105:0/3465445703 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbac40ac280 msgr2=0x7fbac40ab300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:29.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.992+0000 7fbac3fff700 1 --2- 172.21.2.105:0/3465445703 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbac40ac280 0x7fbac40ab300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:29.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.992+0000 7fbac3fff700 1 -- 172.21.2.105:0/3465445703 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaac00b180 con 0x7fbac414abe0 2021-11-12T05:48:29.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.992+0000 7fbac3fff700 1 --2- 172.21.2.105:0/3465445703 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbac414abe0 0x7fbac4156f10 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7fbac414bc40 tx=0x7fbabc007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:29.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.992+0000 7fbac0ff9700 1 -- 172.21.2.105:0/3465445703 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbabc005ba0 con 0x7fbac414abe0 2021-11-12T05:48:29.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.992+0000 7fbac0ff9700 1 -- 172.21.2.105:0/3465445703 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbabc005d00 con 0x7fbac414abe0 2021-11-12T05:48:29.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.992+0000 7fbac0ff9700 1 -- 172.21.2.105:0/3465445703 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbabc0072c0 con 0x7fbac414abe0 2021-11-12T05:48:29.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.992+0000 7fbac9cc9700 1 -- 172.21.2.105:0/3465445703 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac40a9650 con 0x7fbac414abe0 2021-11-12T05:48:29.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.992+0000 7fbac9cc9700 1 -- 172.21.2.105:0/3465445703 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac40a9fa0 con 0x7fbac414abe0 2021-11-12T05:48:29.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.992+0000 7fbac9cc9700 1 -- 172.21.2.105:0/3465445703 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac40b1440 con 0x7fbac414abe0 2021-11-12T05:48:29.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.992+0000 7fbac0ff9700 1 -- 172.21.2.105:0/3465445703 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbabc010070 con 0x7fbac414abe0 2021-11-12T05:48:29.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.992+0000 7fbac0ff9700 1 --2- 172.21.2.105:0/3465445703 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbaa80536f0 0x7fbaa8055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:29.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.992+0000 7fbac0ff9700 1 -- 172.21.2.105:0/3465445703 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fbabc06b4a0 con 0x7fbac414abe0 2021-11-12T05:48:29.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.992+0000 7fbac37fe700 1 --2- 172.21.2.105:0/3465445703 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbaa80536f0 0x7fbaa8055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:29.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.992+0000 7fbac37fe700 1 --2- 172.21.2.105:0/3465445703 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbaa80536f0 0x7fbaa8055bb0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7fbaac002f70 tx=0x7fbaac014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:29.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:28.996+0000 7fbac0ff9700 1 -- 172.21.2.105:0/3465445703 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbabc0423a0 con 0x7fbac414abe0 2021-11-12T05:48:29.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.108+0000 7fbac9cc9700 1 -- 172.21.2.105:0/3465445703 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fbac4057350 con 0x7fbac414abe0 2021-11-12T05:48:29.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.112+0000 7fbac0ff9700 1 -- 172.21.2.105:0/3465445703 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v39) v1 ==== 184+0+0 (secure 0 0 0) 0x7fbabc0459c0 con 0x7fbac414abe0 2021-11-12T05:48:29.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.112+0000 7fbac9cc9700 1 -- 172.21.2.105:0/3465445703 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbaa80536f0 msgr2=0x7fbaa8055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:29.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.112+0000 7fbac9cc9700 1 --2- 172.21.2.105:0/3465445703 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbaa80536f0 0x7fbaa8055bb0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7fbaac002f70 tx=0x7fbaac014000).stop 2021-11-12T05:48:29.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.112+0000 7fbac9cc9700 1 -- 172.21.2.105:0/3465445703 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbac414abe0 msgr2=0x7fbac4156f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:29.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.112+0000 7fbac9cc9700 1 --2- 172.21.2.105:0/3465445703 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbac414abe0 0x7fbac4156f10 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7fbac414bc40 tx=0x7fbabc007f60).stop 2021-11-12T05:48:29.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.116+0000 7fbac9cc9700 1 -- 172.21.2.105:0/3465445703 shutdown_connections 2021-11-12T05:48:29.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.116+0000 7fbac9cc9700 1 --2- 172.21.2.105:0/3465445703 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbaa80536f0 0x7fbaa8055bb0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:29.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.116+0000 7fbac9cc9700 1 --2- 172.21.2.105:0/3465445703 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbac414abe0 0x7fbac4156f10 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:29.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.116+0000 7fbac9cc9700 1 --2- 172.21.2.105:0/3465445703 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbac40ad080 0x7fbac40ab7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:29.121 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.116+0000 7fbac9cc9700 1 --2- 172.21.2.105:0/3465445703 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbac40ac280 0x7fbac40ab300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:29.121 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.116+0000 7fbac9cc9700 1 -- 172.21.2.105:0/3465445703 >> 172.21.2.105:0/3465445703 conn(0x7fbac40b5370 msgr2=0x7fbac4143d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:29.121 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.116+0000 7fbac9cc9700 1 -- 172.21.2.105:0/3465445703 shutdown_connections 2021-11-12T05:48:29.121 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.116+0000 7fbac9cc9700 1 -- 172.21.2.105:0/3465445703 wait complete. 2021-11-12T05:48:29.122 INFO:teuthology.orchestra.run.gibba005.stderr:updated caps for client.1 2021-11-12T05:48:29.125 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-12T05:48:29.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.176+0000 7f7031121700 1 Processor -- start 2021-11-12T05:48:29.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.176+0000 7f7031121700 1 -- start start 2021-11-12T05:48:29.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.176+0000 7f7031121700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f702c05fdc0 0x7f702c0601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:29.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.176+0000 7f7031121700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f702c0ade80 0x7f702c066730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:29.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.176+0000 7f7031121700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f702c066150 con 0x7f702c13a9c0 2021-11-12T05:48:29.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.176+0000 7f7031121700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f702c141fb0 con 0x7f702c05fdc0 2021-11-12T05:48:29.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.176+0000 7f7031121700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f702c0663f0 con 0x7f702c0ade80 2021-11-12T05:48:29.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.176+0000 7f702b59e700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f702c13a9c0 0x7f702c141470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:60992/0 (socket says 172.21.2.105:60992) 2021-11-12T05:48:29.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.176+0000 7f702b59e700 1 -- 172.21.2.105:0/3288888484 learned_addr learned my addr 172.21.2.105:0/3288888484 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:29.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.176+0000 7f702ad9d700 1 --2- 172.21.2.105:0/3288888484 >> v2:172.21.2.105:3300/0 conn(0x7f702c05fdc0 0x7f702c0601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:29.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.176+0000 7f702ad9d700 1 -- 172.21.2.105:0/3288888484 >> v2:172.21.2.115:3300/0 conn(0x7f702c0ade80 msgr2=0x7f702c066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:29.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.176+0000 7f702ad9d700 1 --2- 172.21.2.105:0/3288888484 >> v2:172.21.2.115:3300/0 conn(0x7f702c0ade80 0x7f702c066730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:29.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.176+0000 7f702ad9d700 1 -- 172.21.2.105:0/3288888484 >> v1:172.21.2.105:6789/0 conn(0x7f702c13a9c0 legacy=0x7f702c141470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:29.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.176+0000 7f702ad9d700 1 -- 172.21.2.105:0/3288888484 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f702c140fd0 con 0x7f702c05fdc0 2021-11-12T05:48:29.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.176+0000 7f702ad9d700 1 --2- 172.21.2.105:0/3288888484 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f702c05fdc0 0x7f702c0601a0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7f7014002f70 tx=0x7f7014006df0).ready entity=mon.0 client_cookie=8a230ad5dcaefd19 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:29.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.176+0000 7f7029d9b700 1 -- 172.21.2.105:0/3288888484 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f701400d5c0 con 0x7f702c05fdc0 2021-11-12T05:48:29.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.176+0000 7f7029d9b700 1 -- 172.21.2.105:0/3288888484 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7014000e90 con 0x7f702c05fdc0 2021-11-12T05:48:29.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.176+0000 7f7029d9b700 1 -- 172.21.2.105:0/3288888484 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f701400d910 con 0x7f702c05fdc0 2021-11-12T05:48:29.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.176+0000 7f7031121700 1 -- 172.21.2.105:0/3288888484 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f702c05fdc0 msgr2=0x7f702c0601a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:29.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.176+0000 7f7031121700 1 --2- 172.21.2.105:0/3288888484 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f702c05fdc0 0x7f702c0601a0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7f7014002f70 tx=0x7f7014006df0).stop 2021-11-12T05:48:29.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.176+0000 7f7031121700 1 -- 172.21.2.105:0/3288888484 shutdown_connections 2021-11-12T05:48:29.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.176+0000 7f7031121700 1 --2- 172.21.2.105:0/3288888484 >> v2:172.21.2.115:3300/0 conn(0x7f702c0ade80 0x7f702c066730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:29.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.176+0000 7f7031121700 1 --2- 172.21.2.105:0/3288888484 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f702c05fdc0 0x7f702c0601a0 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:29.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.176+0000 7f7031121700 1 -- 172.21.2.105:0/3288888484 >> 172.21.2.105:0/3288888484 conn(0x7f702c0608d0 msgr2=0x7f702c05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:29.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.176+0000 7f7031121700 1 -- 172.21.2.105:0/3288888484 shutdown_connections 2021-11-12T05:48:29.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.176+0000 7f7031121700 1 -- 172.21.2.105:0/3288888484 wait complete. 2021-11-12T05:48:29.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.176+0000 7f7031121700 1 Processor -- start 2021-11-12T05:48:29.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.176+0000 7f7031121700 1 -- start start 2021-11-12T05:48:29.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.180+0000 7f7031121700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f702c05fdc0 0x7f702c0b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:29.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.180+0000 7f7031121700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f702c0ade80 0x7f702c143670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:29.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.180+0000 7f7031121700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f702c13a9c0 0x7f702c143c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:29.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.180+0000 7f7031121700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702c0b5b10 con 0x7f702c05fdc0 2021-11-12T05:48:29.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.180+0000 7f7031121700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702c155c20 con 0x7f702c0ade80 2021-11-12T05:48:29.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.180+0000 7f7031121700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f702c155ec0 con 0x7f702c13a9c0 2021-11-12T05:48:29.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.180+0000 7f702ad9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f702c05fdc0 0x7f702c0b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:29.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.180+0000 7f702ad9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f702c05fdc0 0x7f702c0b54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50604/0 (socket says 172.21.2.105:50604) 2021-11-12T05:48:29.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.180+0000 7f702ad9d700 1 -- 172.21.2.105:0/4116592374 learned_addr learned my addr 172.21.2.105:0/4116592374 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:29.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.180+0000 7f702ad9d700 1 -- 172.21.2.105:0/4116592374 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f702c13a9c0 msgr2=0x7f702c143c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:29.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.180+0000 7f702ad9d700 1 --2- 172.21.2.105:0/4116592374 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f702c13a9c0 0x7f702c143c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:29.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.180+0000 7f702ad9d700 1 -- 172.21.2.105:0/4116592374 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f702c0ade80 msgr2=0x7f702c143670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:29.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.180+0000 7f702ad9d700 1 --2- 172.21.2.105:0/4116592374 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f702c0ade80 0x7f702c143670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:29.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.180+0000 7f702ad9d700 1 -- 172.21.2.105:0/4116592374 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f701400b180 con 0x7f702c05fdc0 2021-11-12T05:48:29.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.180+0000 7f702ad9d700 1 --2- 172.21.2.105:0/4116592374 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f702c05fdc0 0x7f702c0b54e0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 rx=0x7f7014002f70 tx=0x7f7014014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:29.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.180+0000 7f7023fff700 1 -- 172.21.2.105:0/4116592374 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f701401e400 con 0x7f702c05fdc0 2021-11-12T05:48:29.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.180+0000 7f7023fff700 1 -- 172.21.2.105:0/4116592374 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f701401e560 con 0x7f702c05fdc0 2021-11-12T05:48:29.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.180+0000 7f7031121700 1 -- 172.21.2.105:0/4116592374 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f702c144180 con 0x7f702c05fdc0 2021-11-12T05:48:29.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.180+0000 7f7023fff700 1 -- 172.21.2.105:0/4116592374 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f701401e8c0 con 0x7f702c05fdc0 2021-11-12T05:48:29.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.180+0000 7f7031121700 1 -- 172.21.2.105:0/4116592374 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f702c156580 con 0x7f702c05fdc0 2021-11-12T05:48:29.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.180+0000 7f7031121700 1 -- 172.21.2.105:0/4116592374 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f702c156080 con 0x7f702c05fdc0 2021-11-12T05:48:29.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.180+0000 7f7023fff700 1 -- 172.21.2.105:0/4116592374 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7014025030 con 0x7f702c05fdc0 2021-11-12T05:48:29.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.180+0000 7f7023fff700 1 --2- 172.21.2.105:0/4116592374 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f70100536d0 0x7f7010055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:29.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.180+0000 7f7023fff700 1 -- 172.21.2.105:0/4116592374 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f701406c950 con 0x7f702c05fdc0 2021-11-12T05:48:29.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.180+0000 7f702a59c700 1 --2- 172.21.2.105:0/4116592374 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f70100536d0 0x7f7010055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:29.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.180+0000 7f702a59c700 1 --2- 172.21.2.105:0/4116592374 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f70100536d0 0x7f7010055b90 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f701c002f70 tx=0x7f701c006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:29.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.184+0000 7f7023fff700 1 -- 172.21.2.105:0/4116592374 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7014043900 con 0x7f702c05fdc0 2021-11-12T05:48:29.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.296+0000 7f7031121700 1 -- 172.21.2.105:0/4116592374 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f702c057350 con 0x7f702c05fdc0 2021-11-12T05:48:29.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.300+0000 7f7023fff700 1 -- 172.21.2.105:0/4116592374 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v40) v1 ==== 184+0+0 (secure 0 0 0) 0x7f7014046f20 con 0x7f702c05fdc0 2021-11-12T05:48:29.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.304+0000 7f7031121700 1 -- 172.21.2.105:0/4116592374 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f70100536d0 msgr2=0x7f7010055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:29.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.304+0000 7f7031121700 1 --2- 172.21.2.105:0/4116592374 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f70100536d0 0x7f7010055b90 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f701c002f70 tx=0x7f701c006a80).stop 2021-11-12T05:48:29.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.304+0000 7f7031121700 1 -- 172.21.2.105:0/4116592374 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f702c05fdc0 msgr2=0x7f702c0b54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:29.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.304+0000 7f7031121700 1 --2- 172.21.2.105:0/4116592374 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f702c05fdc0 0x7f702c0b54e0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 rx=0x7f7014002f70 tx=0x7f7014014000).stop 2021-11-12T05:48:29.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.304+0000 7f7031121700 1 -- 172.21.2.105:0/4116592374 shutdown_connections 2021-11-12T05:48:29.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.304+0000 7f7031121700 1 --2- 172.21.2.105:0/4116592374 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f70100536d0 0x7f7010055b90 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:29.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.304+0000 7f7031121700 1 --2- 172.21.2.105:0/4116592374 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f702c13a9c0 0x7f702c143c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:29.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.304+0000 7f7031121700 1 --2- 172.21.2.105:0/4116592374 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f702c0ade80 0x7f702c143670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:29.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.304+0000 7f7031121700 1 --2- 172.21.2.105:0/4116592374 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f702c05fdc0 0x7f702c0b54e0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:29.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.304+0000 7f7031121700 1 -- 172.21.2.105:0/4116592374 >> 172.21.2.105:0/4116592374 conn(0x7f702c0608d0 msgr2=0x7f702c0b3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:29.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.304+0000 7f7031121700 1 -- 172.21.2.105:0/4116592374 shutdown_connections 2021-11-12T05:48:29.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.304+0000 7f7031121700 1 -- 172.21.2.105:0/4116592374 wait complete. 2021-11-12T05:48:29.311 INFO:teuthology.orchestra.run.gibba005.stderr:updated caps for client.2 2021-11-12T05:48:29.315 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:48:29.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.360+0000 7f50cbfff700 1 Processor -- start 2021-11-12T05:48:29.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.360+0000 7f50cbfff700 1 -- start start 2021-11-12T05:48:29.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.360+0000 7f50cbfff700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f50cc0b6740 0x7f50cc147a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:29.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.360+0000 7f50cbfff700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f50cc0aede0 0x7f50cc14a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:29.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.360+0000 7f50cbfff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f50cc14ac00 0x7f50cc1462e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:29.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.360+0000 7f50cbfff700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50cc0af2a0 con 0x7f50cc14ac00 2021-11-12T05:48:29.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.360+0000 7f50cbfff700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50cc0b6b20 con 0x7f50cc0b6740 2021-11-12T05:48:29.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.360+0000 7f50cbfff700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc1472e0 con 0x7f50cc0aede0 2021-11-12T05:48:29.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.360+0000 7f50cb7fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f50cc14ac00 0x7f50cc1462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:29.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.360+0000 7f50cb7fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f50cc14ac00 0x7f50cc1462e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50614/0 (socket says 172.21.2.105:50614) 2021-11-12T05:48:29.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.360+0000 7f50cb7fe700 1 -- 172.21.2.105:0/2154128137 learned_addr learned my addr 172.21.2.105:0/2154128137 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:29.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.360+0000 7f50caffd700 1 --2- 172.21.2.105:0/2154128137 >> v2:172.21.2.115:3300/0 conn(0x7f50cc0b6740 0x7f50cc147a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:29.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.360+0000 7f50cb7fe700 1 -- 172.21.2.105:0/2154128137 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f50cc0aede0 msgr2=0x7f50cc14a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:29.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.360+0000 7f50ca7fc700 1 --2- 172.21.2.105:0/2154128137 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f50cc0aede0 0x7f50cc14a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:29.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.360+0000 7f50cb7fe700 1 --2- 172.21.2.105:0/2154128137 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f50cc0aede0 0x7f50cc14a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:29.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.360+0000 7f50cb7fe700 1 -- 172.21.2.105:0/2154128137 >> v2:172.21.2.115:3300/0 conn(0x7f50cc0b6740 msgr2=0x7f50cc147a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:29.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.360+0000 7f50cb7fe700 1 --2- 172.21.2.105:0/2154128137 >> v2:172.21.2.115:3300/0 conn(0x7f50cc0b6740 0x7f50cc147a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:29.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.360+0000 7f50cb7fe700 1 -- 172.21.2.105:0/2154128137 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50cc147580 con 0x7f50cc14ac00 2021-11-12T05:48:29.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.360+0000 7f50caffd700 1 --2- 172.21.2.105:0/2154128137 >> v2:172.21.2.115:3300/0 conn(0x7f50cc0b6740 0x7f50cc147a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:48:29.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.360+0000 7f50ca7fc700 1 --2- 172.21.2.105:0/2154128137 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f50cc0aede0 0x7f50cc14a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:48:29.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.360+0000 7f50cb7fe700 1 --2- 172.21.2.105:0/2154128137 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f50cc14ac00 0x7f50cc1462e0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7f50c40032f0 tx=0x7f50c4009290).ready entity=mon.0 client_cookie=514fb7414bd2d770 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:29.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.360+0000 7f50c9ffb700 1 -- 172.21.2.105:0/2154128137 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50c400b870 con 0x7f50cc14ac00 2021-11-12T05:48:29.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.360+0000 7f50c9ffb700 1 -- 172.21.2.105:0/2154128137 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c400b9d0 con 0x7f50cc14ac00 2021-11-12T05:48:29.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.360+0000 7f50c9ffb700 1 -- 172.21.2.105:0/2154128137 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50c400bb40 con 0x7f50cc14ac00 2021-11-12T05:48:29.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.360+0000 7f50cbfff700 1 -- 172.21.2.105:0/2154128137 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f50cc14ac00 msgr2=0x7f50cc1462e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:29.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.360+0000 7f50cbfff700 1 --2- 172.21.2.105:0/2154128137 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f50cc14ac00 0x7f50cc1462e0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7f50c40032f0 tx=0x7f50c4009290).stop 2021-11-12T05:48:29.373 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.360+0000 7f50cbfff700 1 -- 172.21.2.105:0/2154128137 shutdown_connections 2021-11-12T05:48:29.373 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.360+0000 7f50cbfff700 1 --2- 172.21.2.105:0/2154128137 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f50cc14ac00 0x7f50cc1462e0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:29.373 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.360+0000 7f50cbfff700 1 --2- 172.21.2.105:0/2154128137 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f50cc0aede0 0x7f50cc14a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:29.373 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.360+0000 7f50cbfff700 1 --2- 172.21.2.105:0/2154128137 >> v2:172.21.2.115:3300/0 conn(0x7f50cc0b6740 0x7f50cc147a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:29.374 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.360+0000 7f50cbfff700 1 -- 172.21.2.105:0/2154128137 >> 172.21.2.105:0/2154128137 conn(0x7f50cc0613f0 msgr2=0x7f50cc0617d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:29.374 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.360+0000 7f50cbfff700 1 -- 172.21.2.105:0/2154128137 shutdown_connections 2021-11-12T05:48:29.374 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.360+0000 7f50cbfff700 1 -- 172.21.2.105:0/2154128137 wait complete. 2021-11-12T05:48:29.374 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.364+0000 7f50cbfff700 1 Processor -- start 2021-11-12T05:48:29.375 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.364+0000 7f50cbfff700 1 -- start start 2021-11-12T05:48:29.375 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.364+0000 7f50cbfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f50cc0aede0 0x7f50cc156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:29.375 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.364+0000 7f50cbfff700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f50cc0b6740 0x7f50cc112e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:29.375 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.364+0000 7f50cbfff700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f50cc14ac00 0x7f50cc159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:29.375 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.364+0000 7f50cbfff700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc0671a0 con 0x7f50cc0aede0 2021-11-12T05:48:29.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.364+0000 7f50cbfff700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc157480 con 0x7f50cc14ac00 2021-11-12T05:48:29.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.364+0000 7f50cbfff700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc10f530 con 0x7f50cc0b6740 2021-11-12T05:48:29.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.364+0000 7f50caffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f50cc0aede0 0x7f50cc156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:29.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.364+0000 7f50caffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f50cc0aede0 0x7f50cc156ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50616/0 (socket says 172.21.2.105:50616) 2021-11-12T05:48:29.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.364+0000 7f50caffd700 1 -- 172.21.2.105:0/1017133608 learned_addr learned my addr 172.21.2.105:0/1017133608 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:29.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.364+0000 7f50caffd700 1 -- 172.21.2.105:0/1017133608 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f50cc0b6740 msgr2=0x7f50cc112e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:29.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.364+0000 7f50caffd700 1 --2- 172.21.2.105:0/1017133608 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f50cc0b6740 0x7f50cc112e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:29.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.364+0000 7f50caffd700 1 -- 172.21.2.105:0/1017133608 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f50cc14ac00 msgr2=0x7f50cc159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:29.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.364+0000 7f50caffd700 1 --2- 172.21.2.105:0/1017133608 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f50cc14ac00 0x7f50cc159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:29.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.364+0000 7f50caffd700 1 -- 172.21.2.105:0/1017133608 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c4009530 con 0x7f50cc0aede0 2021-11-12T05:48:29.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.364+0000 7f50caffd700 1 --2- 172.21.2.105:0/1017133608 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f50cc0aede0 0x7f50cc156ed0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 rx=0x7f50bc007000 tx=0x7f50bc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:29.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.364+0000 7f50c3fff700 1 -- 172.21.2.105:0/1017133608 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50bc010580 con 0x7f50cc0aede0 2021-11-12T05:48:29.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.364+0000 7f50c3fff700 1 -- 172.21.2.105:0/1017133608 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50bc0106e0 con 0x7f50cc0aede0 2021-11-12T05:48:29.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.364+0000 7f50cbfff700 1 -- 172.21.2.105:0/1017133608 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50cc10f7d0 con 0x7f50cc0aede0 2021-11-12T05:48:29.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.364+0000 7f50c3fff700 1 -- 172.21.2.105:0/1017133608 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50bc010a40 con 0x7f50cc0aede0 2021-11-12T05:48:29.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.364+0000 7f50cbfff700 1 -- 172.21.2.105:0/1017133608 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50cc11c350 con 0x7f50cc0aede0 2021-11-12T05:48:29.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.364+0000 7f50cbfff700 1 -- 172.21.2.105:0/1017133608 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50cc10f960 con 0x7f50cc0aede0 2021-11-12T05:48:29.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.364+0000 7f50c3fff700 1 -- 172.21.2.105:0/1017133608 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f50bc010ba0 con 0x7f50cc0aede0 2021-11-12T05:48:29.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.364+0000 7f50c3fff700 1 --2- 172.21.2.105:0/1017133608 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f50b0053520 0x7f50b00559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:29.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.364+0000 7f50c3fff700 1 -- 172.21.2.105:0/1017133608 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f50bc06ba80 con 0x7f50cc0aede0 2021-11-12T05:48:29.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.364+0000 7f50ca7fc700 1 --2- 172.21.2.105:0/1017133608 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f50b0053520 0x7f50b00559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:29.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.364+0000 7f50ca7fc700 1 --2- 172.21.2.105:0/1017133608 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f50b0053520 0x7f50b00559e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f50b4007000 tx=0x7f50b4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:29.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.368+0000 7f50c3fff700 1 -- 172.21.2.105:0/1017133608 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f50bc042a90 con 0x7f50cc0aede0 2021-11-12T05:48:29.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.476+0000 7f50cbfff700 1 -- 172.21.2.105:0/1017133608 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50cc11c350 con 0x7f50cc0aede0 2021-11-12T05:48:29.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.476+0000 7f50c3fff700 1 -- 172.21.2.105:0/1017133608 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f50cc11c350 con 0x7f50cc0aede0 2021-11-12T05:48:29.482 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:29.482 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":55,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4889,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/903045813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":903045813},{"type":"v1","addr":"172.21.2.115:6833","nonce":903045813}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":54}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:48:27.392744+0000","modified":"2021-11-12T05:48:28.395983+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7701},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7701":{"gid":7701,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/2721453399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":2721453399},{"type":"v1","addr":"172.21.2.105:6835","nonce":2721453399}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-11-12T05:48:29.483 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.480+0000 7f50cbfff700 1 -- 172.21.2.105:0/1017133608 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f50b0053520 msgr2=0x7f50b00559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:29.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.480+0000 7f50cbfff700 1 --2- 172.21.2.105:0/1017133608 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f50b0053520 0x7f50b00559e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f50b4007000 tx=0x7f50b4008040).stop 2021-11-12T05:48:29.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.480+0000 7f50cbfff700 1 -- 172.21.2.105:0/1017133608 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f50cc0aede0 msgr2=0x7f50cc156ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:29.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.480+0000 7f50cbfff700 1 --2- 172.21.2.105:0/1017133608 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f50cc0aede0 0x7f50cc156ed0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 rx=0x7f50bc007000 tx=0x7f50bc008040).stop 2021-11-12T05:48:29.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.480+0000 7f50cbfff700 1 -- 172.21.2.105:0/1017133608 shutdown_connections 2021-11-12T05:48:29.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.480+0000 7f50cbfff700 1 --2- 172.21.2.105:0/1017133608 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f50b0053520 0x7f50b00559e0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:29.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.480+0000 7f50cbfff700 1 --2- 172.21.2.105:0/1017133608 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f50cc14ac00 0x7f50cc159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:29.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.480+0000 7f50cbfff700 1 --2- 172.21.2.105:0/1017133608 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f50cc0b6740 0x7f50cc112e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:29.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.480+0000 7f50cbfff700 1 --2- 172.21.2.105:0/1017133608 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f50cc0aede0 0x7f50cc156ed0 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:29.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.480+0000 7f50cbfff700 1 -- 172.21.2.105:0/1017133608 >> 172.21.2.105:0/1017133608 conn(0x7f50cc0613f0 msgr2=0x7f50cc0b1590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:29.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.480+0000 7f50cbfff700 1 -- 172.21.2.105:0/1017133608 shutdown_connections 2021-11-12T05:48:29.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.480+0000 7f50cbfff700 1 -- 172.21.2.105:0/1017133608 wait complete. 2021-11-12T05:48:29.486 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 55 2021-11-12T05:48:29.692 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 55, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:48:27.392744+0000', 'modified': '2021-11-12T05:48:28.395983+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7701}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7701': {'gid': 7701, 'name': 'a', 'rank': 0, 'incarnation': 54, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/2721453399', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 2721453399}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 2721453399}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:48:29.692 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:48:29.693 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:48:29.758 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":7701,"want_state":"up:active","state":"up:active","rank_uptime":2.356822142,"mdsmap_epoch":55,"osdmap_epoch":117,"osdmap_epoch_barrier":116,"uptime":6.5244223039999998} 2021-11-12T05:48:29.758 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 7701, "mdsmap_epoch": 55, "osdmap_epoch": 117, "osdmap_epoch_barrier": 116, "rank_uptime": 2.356822142, "state": "up:active", "uptime": 6.524422304, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:48:29.759 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:48:29.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.804+0000 7f83ca5eb700 1 Processor -- start 2021-11-12T05:48:29.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.804+0000 7f83ca5eb700 1 -- start start 2021-11-12T05:48:29.811 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.804+0000 7f83ca5eb700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f83c40ac280 0x7f83c414b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:29.812 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.804+0000 7f83ca5eb700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f83c40af730 0x7f83c40ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:29.812 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.804+0000 7f83ca5eb700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83c40ac7b0 con 0x7f83c40ad080 2021-11-12T05:48:29.812 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.804+0000 7f83ca5eb700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83c41488a0 con 0x7f83c40af730 2021-11-12T05:48:29.812 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.804+0000 7f83ca5eb700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83c40ac9e0 con 0x7f83c40ac280 2021-11-12T05:48:29.813 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.804+0000 7f83c8b88700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f83c40af730 0x7f83c40ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:29.813 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.804+0000 7f83c3fff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f83c40ad080 0x7f83c414abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:32788/0 (socket says 172.21.2.105:32788) 2021-11-12T05:48:29.813 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.804+0000 7f83c3fff700 1 -- 172.21.2.105:0/894829153 learned_addr learned my addr 172.21.2.105:0/894829153 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:29.813 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.804+0000 7f83c8b88700 1 -- 172.21.2.105:0/894829153 >> v2:172.21.2.115:3300/0 conn(0x7f83c40ac280 msgr2=0x7f83c414b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:29.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.804+0000 7f83c8b88700 1 --2- 172.21.2.105:0/894829153 >> v2:172.21.2.115:3300/0 conn(0x7f83c40ac280 0x7f83c414b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:29.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.804+0000 7f83c8b88700 1 -- 172.21.2.105:0/894829153 >> v1:172.21.2.105:6789/0 conn(0x7f83c40ad080 legacy=0x7f83c414abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:29.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.804+0000 7f83c8b88700 1 -- 172.21.2.105:0/894829153 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c40b0b30 con 0x7f83c40af730 2021-11-12T05:48:29.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.804+0000 7f83c8b88700 1 --2- 172.21.2.105:0/894829153 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f83c40af730 0x7f83c40ad460 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7f83c40b1000 tx=0x7f83bc0091d0).ready entity=mon.0 client_cookie=6259c0b7db9148ab server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:29.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83c2ffd700 1 -- 172.21.2.105:0/894829153 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83bc009ea0 con 0x7f83c40af730 2021-11-12T05:48:29.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83c2ffd700 1 -- 172.21.2.105:0/894829153 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83bc00b860 con 0x7f83c40af730 2021-11-12T05:48:29.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83c2ffd700 1 -- 172.21.2.105:0/894829153 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83bc00b9d0 con 0x7f83c40af730 2021-11-12T05:48:29.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83ca5eb700 1 -- 172.21.2.105:0/894829153 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f83c40af730 msgr2=0x7f83c40ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:29.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83ca5eb700 1 --2- 172.21.2.105:0/894829153 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f83c40af730 0x7f83c40ad460 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7f83c40b1000 tx=0x7f83bc0091d0).stop 2021-11-12T05:48:29.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83ca5eb700 1 -- 172.21.2.105:0/894829153 shutdown_connections 2021-11-12T05:48:29.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83ca5eb700 1 --2- 172.21.2.105:0/894829153 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f83c40af730 0x7f83c40ad460 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:29.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83ca5eb700 1 --2- 172.21.2.105:0/894829153 >> v2:172.21.2.115:3300/0 conn(0x7f83c40ac280 0x7f83c414b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:29.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83ca5eb700 1 -- 172.21.2.105:0/894829153 >> 172.21.2.105:0/894829153 conn(0x7f83c40b5370 msgr2=0x7f83c40b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:29.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83ca5eb700 1 -- 172.21.2.105:0/894829153 shutdown_connections 2021-11-12T05:48:29.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83ca5eb700 1 -- 172.21.2.105:0/894829153 wait complete. 2021-11-12T05:48:29.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83ca5eb700 1 Processor -- start 2021-11-12T05:48:29.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83ca5eb700 1 -- start start 2021-11-12T05:48:29.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83ca5eb700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f83c40ac280 0x7f83c40ab150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:29.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83ca5eb700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f83c40ad080 0x7f83c4142970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:29.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83ca5eb700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f83c40af730 0x7f83c4142e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:29.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83ca5eb700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c40a9740 con 0x7f83c40af730 2021-11-12T05:48:29.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83ca5eb700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c40aa8e0 con 0x7f83c40ad080 2021-11-12T05:48:29.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83ca5eb700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c40aab10 con 0x7f83c40ac280 2021-11-12T05:48:29.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83c8b88700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f83c40af730 0x7f83c4142e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:29.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83c8b88700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f83c40af730 0x7f83c4142e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50630/0 (socket says 172.21.2.105:50630) 2021-11-12T05:48:29.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83c8b88700 1 -- 172.21.2.105:0/1993813482 learned_addr learned my addr 172.21.2.105:0/1993813482 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:29.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83c8b88700 1 -- 172.21.2.105:0/1993813482 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f83c40ac280 msgr2=0x7f83c40ab150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:29.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83c8b88700 1 --2- 172.21.2.105:0/1993813482 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f83c40ac280 0x7f83c40ab150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:29.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83c37fe700 1 --2- 172.21.2.105:0/1993813482 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f83c40ad080 0x7f83c4142970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:29.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83c8b88700 1 -- 172.21.2.105:0/1993813482 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f83c40ad080 msgr2=0x7f83c4142970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:29.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83c8b88700 1 --2- 172.21.2.105:0/1993813482 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f83c40ad080 0x7f83c4142970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:29.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83c8b88700 1 -- 172.21.2.105:0/1993813482 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83bc009470 con 0x7f83c40af730 2021-11-12T05:48:29.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83c37fe700 1 --2- 172.21.2.105:0/1993813482 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f83c40ad080 0x7f83c4142970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:48:29.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83c8b88700 1 --2- 172.21.2.105:0/1993813482 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f83c40af730 0x7f83c4142e60 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 rx=0x7f83c40a8e50 tx=0x7f83bc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:29.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83c17fa700 1 -- 172.21.2.105:0/1993813482 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83bc021630 con 0x7f83c40af730 2021-11-12T05:48:29.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83c17fa700 1 -- 172.21.2.105:0/1993813482 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83bc021790 con 0x7f83c40af730 2021-11-12T05:48:29.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83c17fa700 1 -- 172.21.2.105:0/1993813482 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83bc021af0 con 0x7f83c40af730 2021-11-12T05:48:29.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83ca5eb700 1 -- 172.21.2.105:0/1993813482 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c40a9e40 con 0x7f83c40af730 2021-11-12T05:48:29.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83ca5eb700 1 -- 172.21.2.105:0/1993813482 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c4143350 con 0x7f83c40af730 2021-11-12T05:48:29.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83ca5eb700 1 -- 172.21.2.105:0/1993813482 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c40b1440 con 0x7f83c40af730 2021-11-12T05:48:29.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83c17fa700 1 -- 172.21.2.105:0/1993813482 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f83bc027020 con 0x7f83c40af730 2021-11-12T05:48:29.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83c17fa700 1 --2- 172.21.2.105:0/1993813482 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f83a8053640 0x7f83a8055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:29.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83c17fa700 1 -- 172.21.2.105:0/1993813482 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f83bc06d330 con 0x7f83c40af730 2021-11-12T05:48:29.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.808+0000 7f83c3fff700 1 --2- 172.21.2.105:0/1993813482 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f83a8053640 0x7f83a8055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:29.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.812+0000 7f83c3fff700 1 --2- 172.21.2.105:0/1993813482 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f83a8053640 0x7f83a8055b00 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f83c40b0eb0 tx=0x7f83b40077d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:29.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.812+0000 7f83c17fa700 1 -- 172.21.2.105:0/1993813482 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f83bc044340 con 0x7f83c40af730 2021-11-12T05:48:29.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.896+0000 7f83ca5eb700 1 -- 172.21.2.105:0/1993813482 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83c4068700 con 0x7f83c40af730 2021-11-12T05:48:29.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.896+0000 7f83c17fa700 1 -- 172.21.2.105:0/1993813482 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f83bc015020 con 0x7f83c40af730 2021-11-12T05:48:29.901 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:29.902 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":117,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:48:28.397131+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:48:25.280993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-11-12T05:48:26.409707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:48:29.903 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.896+0000 7f83ca5eb700 1 -- 172.21.2.105:0/1993813482 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f83a8053640 msgr2=0x7f83a8055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:29.903 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.896+0000 7f83ca5eb700 1 --2- 172.21.2.105:0/1993813482 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f83a8053640 0x7f83a8055b00 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f83c40b0eb0 tx=0x7f83b40077d0).stop 2021-11-12T05:48:29.903 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.896+0000 7f83ca5eb700 1 -- 172.21.2.105:0/1993813482 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f83c40af730 msgr2=0x7f83c4142e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:29.904 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.896+0000 7f83ca5eb700 1 --2- 172.21.2.105:0/1993813482 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f83c40af730 0x7f83c4142e60 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 rx=0x7f83c40a8e50 tx=0x7f83bc016000).stop 2021-11-12T05:48:29.904 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.896+0000 7f83ca5eb700 1 -- 172.21.2.105:0/1993813482 shutdown_connections 2021-11-12T05:48:29.904 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.896+0000 7f83ca5eb700 1 --2- 172.21.2.105:0/1993813482 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f83a8053640 0x7f83a8055b00 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:29.904 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.896+0000 7f83ca5eb700 1 --2- 172.21.2.105:0/1993813482 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f83c40af730 0x7f83c4142e60 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:29.904 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.896+0000 7f83ca5eb700 1 --2- 172.21.2.105:0/1993813482 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f83c40ad080 0x7f83c4142970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:29.905 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.896+0000 7f83ca5eb700 1 --2- 172.21.2.105:0/1993813482 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f83c40ac280 0x7f83c40ab150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:29.905 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.896+0000 7f83ca5eb700 1 -- 172.21.2.105:0/1993813482 >> 172.21.2.105:0/1993813482 conn(0x7f83c40b5370 msgr2=0x7f83c4060570 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:29.905 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.896+0000 7f83ca5eb700 1 -- 172.21.2.105:0/1993813482 shutdown_connections 2021-11-12T05:48:29.905 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.896+0000 7f83ca5eb700 1 -- 172.21.2.105:0/1993813482 wait complete. 2021-11-12T05:48:29.908 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-12T05:48:25.280993+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2021-11-12T05:48:26.409707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '117', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-12T05:48:29.909 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:48:29.962 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.956+0000 7f649810f700 1 Processor -- start 2021-11-12T05:48:29.962 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.956+0000 7f649810f700 1 -- start start 2021-11-12T05:48:29.962 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.956+0000 7f649810f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f64900b2cc0 0x7f64900b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:29.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.956+0000 7f649810f700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f6490143da0 0x7f6490140240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:29.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.956+0000 7f649810f700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64900aa0b0 con 0x7f64900b2290 2021-11-12T05:48:29.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.956+0000 7f649810f700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64900a9b70 con 0x7f6490143da0 2021-11-12T05:48:29.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.956+0000 7f649810f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64900a9e10 con 0x7f64900b2cc0 2021-11-12T05:48:29.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.956+0000 7f64956aa700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f64900b2290 0x7f6490143690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:32806/0 (socket says 172.21.2.105:32806) 2021-11-12T05:48:29.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.956+0000 7f64956aa700 1 -- 172.21.2.105:0/301668433 learned_addr learned my addr 172.21.2.105:0/301668433 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:29.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.956+0000 7f64966ac700 1 --2- 172.21.2.105:0/301668433 >> v2:172.21.2.105:3300/0 conn(0x7f6490143da0 0x7f6490140240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:29.968 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.956+0000 7f64966ac700 1 -- 172.21.2.105:0/301668433 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f64900b2cc0 msgr2=0x7f64900b30a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:48:29.968 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.956+0000 7f64966ac700 1 --2- 172.21.2.105:0/301668433 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f64900b2cc0 0x7f64900b30a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:29.968 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.956+0000 7f64966ac700 1 -- 172.21.2.105:0/301668433 >> v1:172.21.2.105:6789/0 conn(0x7f64900b2290 legacy=0x7f6490143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:29.968 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.956+0000 7f64966ac700 1 -- 172.21.2.105:0/301668433 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64900b0800 con 0x7f6490143da0 2021-11-12T05:48:29.969 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.956+0000 7f6494ea9700 1 -- 172.21.2.105:0/301668433 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 467209440 0 0) 0x7f64900aa0b0 con 0x7f64900b2290 2021-11-12T05:48:29.969 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.956+0000 7f64966ac700 1 --2- 172.21.2.105:0/301668433 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6490143da0 0x7f6490140240 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7f64880032f0 tx=0x7f64880091d0).ready entity=mon.0 client_cookie=34f82fd2503743fb server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:29.969 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.956+0000 7f6494ea9700 1 -- 172.21.2.105:0/301668433 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6488009ea0 con 0x7f6490143da0 2021-11-12T05:48:29.969 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.960+0000 7f6494ea9700 1 -- 172.21.2.105:0/301668433 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648800b8a0 con 0x7f6490143da0 2021-11-12T05:48:29.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.960+0000 7f6494ea9700 1 -- 172.21.2.105:0/301668433 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f648800ba10 con 0x7f6490143da0 2021-11-12T05:48:29.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.960+0000 7f649810f700 1 -- 172.21.2.105:0/301668433 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6490143da0 msgr2=0x7f6490140240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:29.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.960+0000 7f649810f700 1 --2- 172.21.2.105:0/301668433 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6490143da0 0x7f6490140240 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7f64880032f0 tx=0x7f64880091d0).stop 2021-11-12T05:48:29.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.960+0000 7f649810f700 1 -- 172.21.2.105:0/301668433 shutdown_connections 2021-11-12T05:48:29.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.960+0000 7f649810f700 1 --2- 172.21.2.105:0/301668433 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6490143da0 0x7f6490140240 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:29.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.960+0000 7f649810f700 1 --2- 172.21.2.105:0/301668433 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f64900b2cc0 0x7f64900b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:29.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.960+0000 7f649810f700 1 -- 172.21.2.105:0/301668433 >> 172.21.2.105:0/301668433 conn(0x7f649005c490 msgr2=0x7f649005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:29.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.960+0000 7f649810f700 1 -- 172.21.2.105:0/301668433 shutdown_connections 2021-11-12T05:48:29.972 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.960+0000 7f649810f700 1 -- 172.21.2.105:0/301668433 wait complete. 2021-11-12T05:48:29.972 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.960+0000 7f649810f700 1 Processor -- start 2021-11-12T05:48:29.972 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.960+0000 7f649810f700 1 -- start start 2021-11-12T05:48:29.973 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.960+0000 7f649810f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f64900b2290 0x7f6490141cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:29.973 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.960+0000 7f649810f700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f64900b2cc0 0x7f649009e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:29.973 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.960+0000 7f649810f700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6490143da0 0x7f649013d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:29.973 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.960+0000 7f649810f700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64900a96f0 con 0x7f6490143da0 2021-11-12T05:48:29.973 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.960+0000 7f649810f700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6490065240 con 0x7f64900b2cc0 2021-11-12T05:48:29.974 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.960+0000 7f649810f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64900654e0 con 0x7f64900b2290 2021-11-12T05:48:29.974 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.960+0000 7f64966ac700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6490143da0 0x7f649013d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:29.974 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.960+0000 7f64966ac700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6490143da0 0x7f649013d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50648/0 (socket says 172.21.2.105:50648) 2021-11-12T05:48:29.974 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.960+0000 7f64966ac700 1 -- 172.21.2.105:0/4154438735 learned_addr learned my addr 172.21.2.105:0/4154438735 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:29.975 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.960+0000 7f64966ac700 1 -- 172.21.2.105:0/4154438735 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f64900b2290 msgr2=0x7f6490141cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:29.975 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.960+0000 7f64966ac700 1 --2- 172.21.2.105:0/4154438735 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f64900b2290 0x7f6490141cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:29.975 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.960+0000 7f64966ac700 1 -- 172.21.2.105:0/4154438735 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f64900b2cc0 msgr2=0x7f649009e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:29.975 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.960+0000 7f64966ac700 1 --2- 172.21.2.105:0/4154438735 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f64900b2cc0 0x7f649009e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:29.975 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.960+0000 7f64966ac700 1 -- 172.21.2.105:0/4154438735 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6488009470 con 0x7f6490143da0 2021-11-12T05:48:29.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.960+0000 7f64966ac700 1 --2- 172.21.2.105:0/4154438735 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6490143da0 0x7f649013d210 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 rx=0x7f64880032f0 tx=0x7f6488016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:29.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.960+0000 7f647effd700 1 -- 172.21.2.105:0/4154438735 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6488011e10 con 0x7f6490143da0 2021-11-12T05:48:29.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.960+0000 7f647effd700 1 -- 172.21.2.105:0/4154438735 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648801f3f0 con 0x7f6490143da0 2021-11-12T05:48:29.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.960+0000 7f647effd700 1 -- 172.21.2.105:0/4154438735 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f648801f750 con 0x7f6490143da0 2021-11-12T05:48:29.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.960+0000 7f649810f700 1 -- 172.21.2.105:0/4154438735 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6490065780 con 0x7f6490143da0 2021-11-12T05:48:29.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.960+0000 7f649810f700 1 -- 172.21.2.105:0/4154438735 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f649009ed00 con 0x7f6490143da0 2021-11-12T05:48:29.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.960+0000 7f649810f700 1 -- 172.21.2.105:0/4154438735 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6490065910 con 0x7f6490143da0 2021-11-12T05:48:29.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.960+0000 7f647effd700 1 -- 172.21.2.105:0/4154438735 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6488026030 con 0x7f6490143da0 2021-11-12T05:48:29.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.960+0000 7f647effd700 1 --2- 172.21.2.105:0/4154438735 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f64700536a0 0x7f6470055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:29.978 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.964+0000 7f647effd700 1 -- 172.21.2.105:0/4154438735 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f648806c720 con 0x7f6490143da0 2021-11-12T05:48:29.978 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.964+0000 7f6495eab700 1 --2- 172.21.2.105:0/4154438735 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f64700536a0 0x7f6470055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:29.978 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.964+0000 7f6495eab700 1 --2- 172.21.2.105:0/4154438735 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f64700536a0 0x7f6470055b60 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f648c002fb0 tx=0x7f648c0069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:29.979 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:29.964+0000 7f647effd700 1 -- 172.21.2.105:0/4154438735 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6488043820 con 0x7f6490143da0 2021-11-12T05:48:30.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.048+0000 7f649810f700 1 -- 172.21.2.105:0/4154438735 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6490144210 con 0x7f6490143da0 2021-11-12T05:48:30.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.048+0000 7f647effd700 1 -- 172.21.2.105:0/4154438735 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v117) v1 ==== 110+0+10 (secure 0 0 0) 0x7f64880150b0 con 0x7f6490143da0 2021-11-12T05:48:30.054 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:48:30.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.048+0000 7f649810f700 1 -- 172.21.2.105:0/4154438735 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f64700536a0 msgr2=0x7f6470055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:30.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.048+0000 7f649810f700 1 --2- 172.21.2.105:0/4154438735 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f64700536a0 0x7f6470055b60 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f648c002fb0 tx=0x7f648c0069b0).stop 2021-11-12T05:48:30.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.048+0000 7f649810f700 1 -- 172.21.2.105:0/4154438735 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6490143da0 msgr2=0x7f649013d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:30.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.048+0000 7f649810f700 1 --2- 172.21.2.105:0/4154438735 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6490143da0 0x7f649013d210 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 rx=0x7f64880032f0 tx=0x7f6488016000).stop 2021-11-12T05:48:30.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.048+0000 7f649810f700 1 -- 172.21.2.105:0/4154438735 shutdown_connections 2021-11-12T05:48:30.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.048+0000 7f649810f700 1 --2- 172.21.2.105:0/4154438735 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f64700536a0 0x7f6470055b60 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:30.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.048+0000 7f649810f700 1 --2- 172.21.2.105:0/4154438735 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6490143da0 0x7f649013d210 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:30.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.048+0000 7f649810f700 1 --2- 172.21.2.105:0/4154438735 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f64900b2cc0 0x7f649009e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:30.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.048+0000 7f649810f700 1 --2- 172.21.2.105:0/4154438735 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f64900b2290 0x7f6490141cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:30.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.048+0000 7f649810f700 1 -- 172.21.2.105:0/4154438735 >> 172.21.2.105:0/4154438735 conn(0x7f649005c490 msgr2=0x7f64901405e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:30.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.048+0000 7f649810f700 1 -- 172.21.2.105:0/4154438735 shutdown_connections 2021-11-12T05:48:30.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.048+0000 7f649810f700 1 -- 172.21.2.105:0/4154438735 wait complete. 2021-11-12T05:48:30.061 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:48:30.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.108+0000 7f9a26343700 1 Processor -- start 2021-11-12T05:48:30.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.108+0000 7f9a26343700 1 -- start start 2021-11-12T05:48:30.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.108+0000 7f9a26343700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f9a200b2f70 0x7f9a200b7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:30.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.108+0000 7f9a26343700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a200b2590 con 0x7f9a20142fc0 2021-11-12T05:48:30.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.108+0000 7f9a26343700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a200b2830 con 0x7f9a200b76d0 2021-11-12T05:48:30.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.108+0000 7f9a26343700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a200b2ad0 con 0x7f9a200b2f70 2021-11-12T05:48:30.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.108+0000 7f9a248e0700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f9a20142fc0 0x7f9a20062340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:32816/0 (socket says 172.21.2.105:32816) 2021-11-12T05:48:30.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.108+0000 7f9a248e0700 1 -- 172.21.2.105:0/3720313385 learned_addr learned my addr 172.21.2.105:0/3720313385 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:30.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.108+0000 7f9a1f7fe700 1 --2- 172.21.2.105:0/3720313385 >> v2:172.21.2.115:3300/0 conn(0x7f9a200b2f70 0x7f9a200b7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:30.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.112+0000 7f9a1f7fe700 1 -- 172.21.2.105:0/3720313385 >> v1:172.21.2.115:6789/0 conn(0x7f9a200b76d0 legacy=0x7f9a2013cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:30.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.112+0000 7f9a1f7fe700 1 -- 172.21.2.105:0/3720313385 >> v1:172.21.2.105:6789/0 conn(0x7f9a20142fc0 legacy=0x7f9a20062340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:30.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.112+0000 7f9a1f7fe700 1 -- 172.21.2.105:0/3720313385 --> v2:172.21.2.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2013d460 con 0x7f9a200b2f70 2021-11-12T05:48:30.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.112+0000 7f9a1f7fe700 1 --2- 172.21.2.105:0/3720313385 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9a200b2f70 0x7f9a200b7ab0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f9a180032f0 tx=0x7f9a180091d0).ready entity=mon.1 client_cookie=6640ab2f264c39b7 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:30.123 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.120+0000 7f9a1effd700 1 -- 172.21.2.105:0/3720313385 <== mon.1 v2:172.21.2.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a18009ea0 con 0x7f9a200b2f70 2021-11-12T05:48:30.124 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.120+0000 7f9a1effd700 1 -- 172.21.2.105:0/3720313385 <== mon.1 v2:172.21.2.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1800b8a0 con 0x7f9a200b2f70 2021-11-12T05:48:30.124 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.120+0000 7f9a1effd700 1 -- 172.21.2.105:0/3720313385 <== mon.1 v2:172.21.2.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a1800ba10 con 0x7f9a200b2f70 2021-11-12T05:48:30.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.120+0000 7f9a26343700 1 -- 172.21.2.105:0/3720313385 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9a200b2f70 msgr2=0x7f9a200b7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:30.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.120+0000 7f9a26343700 1 --2- 172.21.2.105:0/3720313385 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9a200b2f70 0x7f9a200b7ab0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f9a180032f0 tx=0x7f9a180091d0).stop 2021-11-12T05:48:30.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.120+0000 7f9a26343700 1 -- 172.21.2.105:0/3720313385 shutdown_connections 2021-11-12T05:48:30.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.120+0000 7f9a26343700 1 --2- 172.21.2.105:0/3720313385 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9a200b2f70 0x7f9a200b7ab0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:30.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.120+0000 7f9a26343700 1 -- 172.21.2.105:0/3720313385 >> 172.21.2.105:0/3720313385 conn(0x7f9a200608d0 msgr2=0x7f9a2005c490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:30.127 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.120+0000 7f9a26343700 1 -- 172.21.2.105:0/3720313385 shutdown_connections 2021-11-12T05:48:30.127 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.120+0000 7f9a26343700 1 -- 172.21.2.105:0/3720313385 wait complete. 2021-11-12T05:48:30.129 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.124+0000 7f9a26343700 1 Processor -- start 2021-11-12T05:48:30.129 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.124+0000 7f9a26343700 1 -- start start 2021-11-12T05:48:30.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.128+0000 7f9a26343700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9a200b2f70 0x7f9a20153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:30.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.128+0000 7f9a26343700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9a200b76d0 0x7f9a20142070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:30.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.128+0000 7f9a26343700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9a20142fc0 0x7f9a20144490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:30.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.128+0000 7f9a26343700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a20152670 con 0x7f9a20142fc0 2021-11-12T05:48:30.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.128+0000 7f9a26343700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a201528a0 con 0x7f9a200b76d0 2021-11-12T05:48:30.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.128+0000 7f9a26343700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a20152b40 con 0x7f9a200b2f70 2021-11-12T05:48:30.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.128+0000 7f9a248e0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9a20142fc0 0x7f9a20144490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:30.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.128+0000 7f9a248e0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9a20142fc0 0x7f9a20144490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50660/0 (socket says 172.21.2.105:50660) 2021-11-12T05:48:30.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.128+0000 7f9a248e0700 1 -- 172.21.2.105:0/1396256169 learned_addr learned my addr 172.21.2.105:0/1396256169 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:30.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.128+0000 7f9a1f7fe700 1 --2- 172.21.2.105:0/1396256169 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9a200b76d0 0x7f9a20142070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:30.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.128+0000 7f9a1ffff700 1 --2- 172.21.2.105:0/1396256169 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9a200b2f70 0x7f9a20153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:30.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.128+0000 7f9a248e0700 1 -- 172.21.2.105:0/1396256169 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9a200b2f70 msgr2=0x7f9a20153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:30.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.128+0000 7f9a248e0700 1 --2- 172.21.2.105:0/1396256169 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9a200b2f70 0x7f9a20153280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:30.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.128+0000 7f9a248e0700 1 -- 172.21.2.105:0/1396256169 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9a200b76d0 msgr2=0x7f9a20142070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:30.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.128+0000 7f9a248e0700 1 --2- 172.21.2.105:0/1396256169 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9a200b76d0 0x7f9a20142070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:30.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.128+0000 7f9a248e0700 1 -- 172.21.2.105:0/1396256169 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a18009470 con 0x7f9a20142fc0 2021-11-12T05:48:30.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.128+0000 7f9a248e0700 1 --2- 172.21.2.105:0/1396256169 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9a20142fc0 0x7f9a20144490 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 rx=0x7f9a200b7420 tx=0x7f9a10007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:30.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.128+0000 7f9a1d7fa700 1 -- 172.21.2.105:0/1396256169 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a10001d70 con 0x7f9a20142fc0 2021-11-12T05:48:30.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.128+0000 7f9a1d7fa700 1 -- 172.21.2.105:0/1396256169 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a100070d0 con 0x7f9a20142fc0 2021-11-12T05:48:30.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.128+0000 7f9a1d7fa700 1 -- 172.21.2.105:0/1396256169 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a10007430 con 0x7f9a20142fc0 2021-11-12T05:48:30.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.128+0000 7f9a26343700 1 -- 172.21.2.105:0/1396256169 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a20152de0 con 0x7f9a20142fc0 2021-11-12T05:48:30.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.128+0000 7f9a26343700 1 -- 172.21.2.105:0/1396256169 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a20142780 con 0x7f9a20142fc0 2021-11-12T05:48:30.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.132+0000 7f9a26343700 1 -- 172.21.2.105:0/1396256169 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a20152f70 con 0x7f9a20142fc0 2021-11-12T05:48:30.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.132+0000 7f9a1d7fa700 1 -- 172.21.2.105:0/1396256169 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9a10010070 con 0x7f9a20142fc0 2021-11-12T05:48:30.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.132+0000 7f9a1d7fa700 1 --2- 172.21.2.105:0/1396256169 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9a000536a0 0x7f9a00055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:30.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.136+0000 7f9a1d7fa700 1 -- 172.21.2.105:0/1396256169 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f9a1006af20 con 0x7f9a20142fc0 2021-11-12T05:48:30.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.136+0000 7f9a1ffff700 1 --2- 172.21.2.105:0/1396256169 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9a000536a0 0x7f9a00055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:30.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.136+0000 7f9a1ffff700 1 --2- 172.21.2.105:0/1396256169 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9a000536a0 0x7f9a00055b60 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f9a1400d000 tx=0x7f9a14000bc0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:30.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.148+0000 7f9a1d7fa700 1 -- 172.21.2.105:0/1396256169 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9a10041f30 con 0x7f9a20142fc0 2021-11-12T05:48:30.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.268+0000 7f9a26343700 1 -- 172.21.2.105:0/1396256169 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9a200b2210 con 0x7f9a20142fc0 2021-11-12T05:48:30.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.268+0000 7f9a1d7fa700 1 -- 172.21.2.105:0/1396256169 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v117) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9a10045550 con 0x7f9a20142fc0 2021-11-12T05:48:30.273 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:48:30.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.268+0000 7f9a26343700 1 -- 172.21.2.105:0/1396256169 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9a000536a0 msgr2=0x7f9a00055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:30.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.268+0000 7f9a26343700 1 --2- 172.21.2.105:0/1396256169 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9a000536a0 0x7f9a00055b60 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f9a1400d000 tx=0x7f9a14000bc0).stop 2021-11-12T05:48:30.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.268+0000 7f9a26343700 1 -- 172.21.2.105:0/1396256169 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9a20142fc0 msgr2=0x7f9a20144490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:30.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.268+0000 7f9a26343700 1 --2- 172.21.2.105:0/1396256169 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9a20142fc0 0x7f9a20144490 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 rx=0x7f9a200b7420 tx=0x7f9a10007c30).stop 2021-11-12T05:48:30.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.268+0000 7f9a26343700 1 -- 172.21.2.105:0/1396256169 shutdown_connections 2021-11-12T05:48:30.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.268+0000 7f9a26343700 1 --2- 172.21.2.105:0/1396256169 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9a000536a0 0x7f9a00055b60 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:30.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.268+0000 7f9a26343700 1 --2- 172.21.2.105:0/1396256169 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9a20142fc0 0x7f9a20144490 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:30.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.268+0000 7f9a26343700 1 --2- 172.21.2.105:0/1396256169 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9a200b76d0 0x7f9a20142070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:30.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.268+0000 7f9a26343700 1 --2- 172.21.2.105:0/1396256169 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9a200b2f70 0x7f9a20153280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:30.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.268+0000 7f9a26343700 1 -- 172.21.2.105:0/1396256169 >> 172.21.2.105:0/1396256169 conn(0x7f9a200608d0 msgr2=0x7f9a200b3900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:30.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.268+0000 7f9a26343700 1 -- 172.21.2.105:0/1396256169 shutdown_connections 2021-11-12T05:48:30.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.268+0000 7f9a26343700 1 -- 172.21.2.105:0/1396256169 wait complete. 2021-11-12T05:48:30.280 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-12T05:48:30.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.328+0000 7f938b6f7700 1 Processor -- start 2021-11-12T05:48:30.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.328+0000 7f938b6f7700 1 -- start start 2021-11-12T05:48:30.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.328+0000 7f938b6f7700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f93840626b0 0x7f9384062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:30.334 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.328+0000 7f938b6f7700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f93840af750 0x7f9384130370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:30.334 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.328+0000 7f938b6f7700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f9384130860 0x7f938414a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:30.334 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.328+0000 7f938b6f7700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9384130cf0 con 0x7f93840af750 2021-11-12T05:48:30.334 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.328+0000 7f938b6f7700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93840b0d50 con 0x7f9384130860 2021-11-12T05:48:30.334 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.328+0000 7f938b6f7700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93840ad380 con 0x7f93840626b0 2021-11-12T05:48:30.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.328+0000 7f9388c92700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f93840af750 0x7f9384130370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:30.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.328+0000 7f9388c92700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f93840af750 0x7f9384130370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50664/0 (socket says 172.21.2.105:50664) 2021-11-12T05:48:30.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.328+0000 7f9388c92700 1 -- 172.21.2.105:0/3857194277 learned_addr learned my addr 172.21.2.105:0/3857194277 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:30.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.328+0000 7f9388c92700 1 -- 172.21.2.105:0/3857194277 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f93840626b0 msgr2=0x7f9384062a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:30.336 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.328+0000 7f9388c92700 1 --2- 172.21.2.105:0/3857194277 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f93840626b0 0x7f9384062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:30.336 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.328+0000 7f9388c92700 1 -- 172.21.2.105:0/3857194277 >> v2:172.21.2.115:3300/0 conn(0x7f9384130860 msgr2=0x7f938414a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:30.336 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.328+0000 7f9388c92700 1 --2- 172.21.2.105:0/3857194277 >> v2:172.21.2.115:3300/0 conn(0x7f9384130860 0x7f938414a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:30.336 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.328+0000 7f9388c92700 1 -- 172.21.2.105:0/3857194277 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93840ae190 con 0x7f93840af750 2021-11-12T05:48:30.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.328+0000 7f9388c92700 1 --2- 172.21.2.105:0/3857194277 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f93840af750 0x7f9384130370 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7f9378002f70 tx=0x7f9378006eb0).ready entity=mon.0 client_cookie=6f0e8f9d0db4948b server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:30.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.328+0000 7f9377fff700 1 -- 172.21.2.105:0/3857194277 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f937800d570 con 0x7f93840af750 2021-11-12T05:48:30.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.328+0000 7f9377fff700 1 -- 172.21.2.105:0/3857194277 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9378000e90 con 0x7f93840af750 2021-11-12T05:48:30.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.328+0000 7f9377fff700 1 -- 172.21.2.105:0/3857194277 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f937800d900 con 0x7f93840af750 2021-11-12T05:48:30.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.328+0000 7f938b6f7700 1 -- 172.21.2.105:0/3857194277 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f93840af750 msgr2=0x7f9384130370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:30.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.328+0000 7f938b6f7700 1 --2- 172.21.2.105:0/3857194277 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f93840af750 0x7f9384130370 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7f9378002f70 tx=0x7f9378006eb0).stop 2021-11-12T05:48:30.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.328+0000 7f938b6f7700 1 -- 172.21.2.105:0/3857194277 shutdown_connections 2021-11-12T05:48:30.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.328+0000 7f938b6f7700 1 --2- 172.21.2.105:0/3857194277 >> v2:172.21.2.115:3300/0 conn(0x7f9384130860 0x7f938414a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:30.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.328+0000 7f938b6f7700 1 --2- 172.21.2.105:0/3857194277 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f93840af750 0x7f9384130370 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:30.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.328+0000 7f938b6f7700 1 --2- 172.21.2.105:0/3857194277 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f93840626b0 0x7f9384062a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:30.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.328+0000 7f938b6f7700 1 -- 172.21.2.105:0/3857194277 >> 172.21.2.105:0/3857194277 conn(0x7f93840b5320 msgr2=0x7f93840b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:30.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.328+0000 7f938b6f7700 1 -- 172.21.2.105:0/3857194277 shutdown_connections 2021-11-12T05:48:30.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.328+0000 7f938b6f7700 1 -- 172.21.2.105:0/3857194277 wait complete. 2021-11-12T05:48:30.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.332+0000 7f938b6f7700 1 Processor -- start 2021-11-12T05:48:30.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.332+0000 7f938b6f7700 1 -- start start 2021-11-12T05:48:30.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.332+0000 7f938b6f7700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f93840626b0 0x7f93840660e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:30.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.332+0000 7f938b6f7700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f93840af750 0x7f9384064060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:30.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.332+0000 7f938b6f7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9384130860 0x7f9384062dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:30.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.332+0000 7f938b6f7700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938414a250 con 0x7f9384130860 2021-11-12T05:48:30.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.332+0000 7f938b6f7700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9384063680 con 0x7f93840626b0 2021-11-12T05:48:30.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.332+0000 7f938b6f7700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9384063920 con 0x7f93840af750 2021-11-12T05:48:30.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.332+0000 7f9389c94700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9384130860 0x7f9384062dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:30.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.332+0000 7f9389c94700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9384130860 0x7f9384062dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50668/0 (socket says 172.21.2.105:50668) 2021-11-12T05:48:30.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.332+0000 7f9389c94700 1 -- 172.21.2.105:0/2902835450 learned_addr learned my addr 172.21.2.105:0/2902835450 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:30.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.332+0000 7f9389c94700 1 -- 172.21.2.105:0/2902835450 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f93840af750 msgr2=0x7f9384064060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:30.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.332+0000 7f9389c94700 1 --2- 172.21.2.105:0/2902835450 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f93840af750 0x7f9384064060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:30.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.332+0000 7f9389c94700 1 -- 172.21.2.105:0/2902835450 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f93840626b0 msgr2=0x7f93840660e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:30.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.332+0000 7f9389c94700 1 --2- 172.21.2.105:0/2902835450 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f93840626b0 0x7f93840660e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:30.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.332+0000 7f9389c94700 1 -- 172.21.2.105:0/2902835450 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f937800b1e0 con 0x7f9384130860 2021-11-12T05:48:30.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.332+0000 7f9389c94700 1 --2- 172.21.2.105:0/2902835450 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9384130860 0x7f9384062dd0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7f937c0032f0 tx=0x7f937c009120).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:30.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.332+0000 7f93767fc700 1 -- 172.21.2.105:0/2902835450 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f937c00d4a0 con 0x7f9384130860 2021-11-12T05:48:30.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.332+0000 7f93767fc700 1 -- 172.21.2.105:0/2902835450 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937c00d600 con 0x7f9384130860 2021-11-12T05:48:30.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.332+0000 7f938b6f7700 1 -- 172.21.2.105:0/2902835450 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9384063bc0 con 0x7f9384130860 2021-11-12T05:48:30.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.332+0000 7f93767fc700 1 -- 172.21.2.105:0/2902835450 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f937c00d960 con 0x7f9384130860 2021-11-12T05:48:30.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.332+0000 7f938b6f7700 1 -- 172.21.2.105:0/2902835450 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f938414ac10 con 0x7f9384130860 2021-11-12T05:48:30.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.332+0000 7f938b6f7700 1 -- 172.21.2.105:0/2902835450 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9384063d50 con 0x7f9384130860 2021-11-12T05:48:30.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.332+0000 7f93767fc700 1 -- 172.21.2.105:0/2902835450 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f937c018030 con 0x7f9384130860 2021-11-12T05:48:30.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.332+0000 7f93767fc700 1 --2- 172.21.2.105:0/2902835450 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9364053580 0x7f9364055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:30.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.332+0000 7f93767fc700 1 -- 172.21.2.105:0/2902835450 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f937c06b360 con 0x7f9384130860 2021-11-12T05:48:30.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.332+0000 7f9389493700 1 --2- 172.21.2.105:0/2902835450 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9364053580 0x7f9364055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:30.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.332+0000 7f9389493700 1 --2- 172.21.2.105:0/2902835450 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9364053580 0x7f9364055a40 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f9380002f70 tx=0x7f9380006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:30.348 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.336+0000 7f93767fc700 1 -- 172.21.2.105:0/2902835450 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f937c042420 con 0x7f9384130860 2021-11-12T05:48:30.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.416+0000 7f938b6f7700 1 -- 172.21.2.105:0/2902835450 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f938414ae40 con 0x7f9384130860 2021-11-12T05:48:30.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.416+0000 7f93767fc700 1 -- 172.21.2.105:0/2902835450 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v117) v1 ==== 104+0+10 (secure 0 0 0) 0x7f937c045a40 con 0x7f9384130860 2021-11-12T05:48:30.423 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:48:30.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.420+0000 7f938b6f7700 1 -- 172.21.2.105:0/2902835450 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9364053580 msgr2=0x7f9364055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:30.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.420+0000 7f938b6f7700 1 --2- 172.21.2.105:0/2902835450 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9364053580 0x7f9364055a40 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f9380002f70 tx=0x7f9380006a80).stop 2021-11-12T05:48:30.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.420+0000 7f938b6f7700 1 -- 172.21.2.105:0/2902835450 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9384130860 msgr2=0x7f9384062dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:30.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.420+0000 7f938b6f7700 1 --2- 172.21.2.105:0/2902835450 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9384130860 0x7f9384062dd0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7f937c0032f0 tx=0x7f937c009120).stop 2021-11-12T05:48:30.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.420+0000 7f938b6f7700 1 -- 172.21.2.105:0/2902835450 shutdown_connections 2021-11-12T05:48:30.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.420+0000 7f938b6f7700 1 --2- 172.21.2.105:0/2902835450 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9364053580 0x7f9364055a40 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:30.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.420+0000 7f938b6f7700 1 --2- 172.21.2.105:0/2902835450 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9384130860 0x7f9384062dd0 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:30.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.420+0000 7f938b6f7700 1 --2- 172.21.2.105:0/2902835450 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f93840af750 0x7f9384064060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:30.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.420+0000 7f938b6f7700 1 --2- 172.21.2.105:0/2902835450 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f93840626b0 0x7f93840660e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:30.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.420+0000 7f938b6f7700 1 -- 172.21.2.105:0/2902835450 >> 172.21.2.105:0/2902835450 conn(0x7f93840b5320 msgr2=0x7f93841452f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:30.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.420+0000 7f938b6f7700 1 -- 172.21.2.105:0/2902835450 shutdown_connections 2021-11-12T05:48:30.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.420+0000 7f938b6f7700 1 -- 172.21.2.105:0/2902835450 wait complete. 2021-11-12T05:48:30.430 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-12T05:48:30.483 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.476+0000 7f4416682700 1 Processor -- start 2021-11-12T05:48:30.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.476+0000 7f4416682700 1 -- start start 2021-11-12T05:48:30.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f4416682700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f44100ace20 0x7f44100b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:30.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f4416682700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f4410144180 0x7f44101445f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:30.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f4416682700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44100b1840 con 0x7f44100aca40 2021-11-12T05:48:30.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f4416682700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44100b0a10 con 0x7f44100ace20 2021-11-12T05:48:30.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f4416682700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44100af2b0 con 0x7f4410144180 2021-11-12T05:48:30.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f440ffff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f44100aca40 0x7f44101473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:32840/0 (socket says 172.21.2.105:32840) 2021-11-12T05:48:30.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f440ffff700 1 -- 172.21.2.105:0/1754726022 learned_addr learned my addr 172.21.2.105:0/1754726022 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:30.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f440f7fe700 1 --2- 172.21.2.105:0/1754726022 >> v2:172.21.2.105:3300/0 conn(0x7f44100ace20 0x7f44100b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:30.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f440effd700 1 -- 172.21.2.105:0/1754726022 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3041087330 0 0) 0x7f44100b1840 con 0x7f44100aca40 2021-11-12T05:48:30.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f440effd700 1 -- 172.21.2.105:0/1754726022 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43f0003260 con 0x7f44100aca40 2021-11-12T05:48:30.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f440f7fe700 1 -- 172.21.2.105:0/1754726022 >> v2:172.21.2.115:3300/0 conn(0x7f4410144180 msgr2=0x7f44101445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:30.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f440f7fe700 1 --2- 172.21.2.105:0/1754726022 >> v2:172.21.2.115:3300/0 conn(0x7f4410144180 0x7f44101445f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:30.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f440f7fe700 1 -- 172.21.2.105:0/1754726022 >> v1:172.21.2.105:6789/0 conn(0x7f44100aca40 legacy=0x7f44101473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:30.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f440f7fe700 1 -- 172.21.2.105:0/1754726022 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44100b1a70 con 0x7f44100ace20 2021-11-12T05:48:30.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f440f7fe700 1 --2- 172.21.2.105:0/1754726022 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f44100ace20 0x7f44100b0520 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 rx=0x7f4400002f70 tx=0x7f4400006df0).ready entity=mon.0 client_cookie=b5452268c69a747b server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:30.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f440effd700 1 -- 172.21.2.105:0/1754726022 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f440000d570 con 0x7f44100ace20 2021-11-12T05:48:30.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f440effd700 1 -- 172.21.2.105:0/1754726022 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4400000e90 con 0x7f44100ace20 2021-11-12T05:48:30.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f440effd700 1 -- 172.21.2.105:0/1754726022 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f440000d8c0 con 0x7f44100ace20 2021-11-12T05:48:30.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f4416682700 1 -- 172.21.2.105:0/1754726022 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f44100ace20 msgr2=0x7f44100b0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:30.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f4416682700 1 --2- 172.21.2.105:0/1754726022 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f44100ace20 0x7f44100b0520 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 rx=0x7f4400002f70 tx=0x7f4400006df0).stop 2021-11-12T05:48:30.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f4416682700 1 -- 172.21.2.105:0/1754726022 shutdown_connections 2021-11-12T05:48:30.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f4416682700 1 --2- 172.21.2.105:0/1754726022 >> v2:172.21.2.115:3300/0 conn(0x7f4410144180 0x7f44101445f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:30.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f4416682700 1 --2- 172.21.2.105:0/1754726022 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f44100ace20 0x7f44100b0520 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:30.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f4416682700 1 -- 172.21.2.105:0/1754726022 >> 172.21.2.105:0/1754726022 conn(0x7f441005c490 msgr2=0x7f44100b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:30.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f4416682700 1 -- 172.21.2.105:0/1754726022 shutdown_connections 2021-11-12T05:48:30.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f4416682700 1 -- 172.21.2.105:0/1754726022 wait complete. 2021-11-12T05:48:30.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f4416682700 1 Processor -- start 2021-11-12T05:48:30.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f4416682700 1 -- start start 2021-11-12T05:48:30.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f4416682700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f44100aca40 0x7f44101448d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:30.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f4416682700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f44100ace20 0x7f4410147e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:30.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f4416682700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4410144180 0x7f4410064880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:30.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f4416682700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44101473f0 con 0x7f4410144180 2021-11-12T05:48:30.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f4416682700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4410063300 con 0x7f44100aca40 2021-11-12T05:48:30.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f4416682700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4410147620 con 0x7f44100ace20 2021-11-12T05:48:30.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f4414c1f700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4410144180 0x7f4410064880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:30.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f4414c1f700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4410144180 0x7f4410064880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50686/0 (socket says 172.21.2.105:50686) 2021-11-12T05:48:30.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f4414c1f700 1 -- 172.21.2.105:0/1896741599 learned_addr learned my addr 172.21.2.105:0/1896741599 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:30.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f4414c1f700 1 -- 172.21.2.105:0/1896741599 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f44100ace20 msgr2=0x7f4410147e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:30.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f4414c1f700 1 --2- 172.21.2.105:0/1896741599 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f44100ace20 0x7f4410147e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:30.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f4414c1f700 1 -- 172.21.2.105:0/1896741599 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f44100aca40 msgr2=0x7f44101448d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:30.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f4414c1f700 1 --2- 172.21.2.105:0/1896741599 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f44100aca40 0x7f44101448d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:30.498 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f4414c1f700 1 -- 172.21.2.105:0/1896741599 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f440000b180 con 0x7f4410144180 2021-11-12T05:48:30.498 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.480+0000 7f4414c1f700 1 --2- 172.21.2.105:0/1896741599 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4410144180 0x7f4410064880 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7f44080032f0 tx=0x7f44080091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:30.498 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.484+0000 7f440d7fa700 1 -- 172.21.2.105:0/1896741599 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f440800d4a0 con 0x7f4410144180 2021-11-12T05:48:30.498 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.484+0000 7f440d7fa700 1 -- 172.21.2.105:0/1896741599 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440800d600 con 0x7f4410144180 2021-11-12T05:48:30.498 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.484+0000 7f440d7fa700 1 -- 172.21.2.105:0/1896741599 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f440800d960 con 0x7f4410144180 2021-11-12T05:48:30.499 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.484+0000 7f4416682700 1 -- 172.21.2.105:0/1896741599 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44101416f0 con 0x7f4410144180 2021-11-12T05:48:30.499 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.484+0000 7f4416682700 1 -- 172.21.2.105:0/1896741599 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4410147010 con 0x7f4410144180 2021-11-12T05:48:30.499 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.484+0000 7f4416682700 1 -- 172.21.2.105:0/1896741599 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4410063140 con 0x7f4410144180 2021-11-12T05:48:30.499 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.484+0000 7f440d7fa700 1 -- 172.21.2.105:0/1896741599 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4408018030 con 0x7f4410144180 2021-11-12T05:48:30.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.484+0000 7f440d7fa700 1 --2- 172.21.2.105:0/1896741599 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f43f4053660 0x7f43f4055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:30.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.484+0000 7f440d7fa700 1 -- 172.21.2.105:0/1896741599 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f440806b4f0 con 0x7f4410144180 2021-11-12T05:48:30.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.484+0000 7f440ffff700 1 --2- 172.21.2.105:0/1896741599 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f43f4053660 0x7f43f4055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:30.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.484+0000 7f440ffff700 1 --2- 172.21.2.105:0/1896741599 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f43f4053660 0x7f43f4055b20 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f43f8001110 tx=0x7f43f80076c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:30.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.484+0000 7f440d7fa700 1 -- 172.21.2.105:0/1896741599 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f44080424a0 con 0x7f4410144180 2021-11-12T05:48:30.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.568+0000 7f4416682700 1 -- 172.21.2.105:0/1896741599 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4410057350 con 0x7f4410144180 2021-11-12T05:48:30.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.572+0000 7f440d7fa700 1 -- 172.21.2.105:0/1896741599 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v117) v1 ==== 100+0+10 (secure 0 0 0) 0x7f4408045ac0 con 0x7f4410144180 2021-11-12T05:48:30.575 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:48:30.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.572+0000 7f4416682700 1 -- 172.21.2.105:0/1896741599 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f43f4053660 msgr2=0x7f43f4055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:30.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.572+0000 7f4416682700 1 --2- 172.21.2.105:0/1896741599 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f43f4053660 0x7f43f4055b20 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f43f8001110 tx=0x7f43f80076c0).stop 2021-11-12T05:48:30.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.572+0000 7f4416682700 1 -- 172.21.2.105:0/1896741599 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4410144180 msgr2=0x7f4410064880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:30.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.572+0000 7f4416682700 1 --2- 172.21.2.105:0/1896741599 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4410144180 0x7f4410064880 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7f44080032f0 tx=0x7f44080091a0).stop 2021-11-12T05:48:30.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.572+0000 7f4416682700 1 -- 172.21.2.105:0/1896741599 shutdown_connections 2021-11-12T05:48:30.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.572+0000 7f4416682700 1 --2- 172.21.2.105:0/1896741599 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f43f4053660 0x7f43f4055b20 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:30.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.572+0000 7f4416682700 1 --2- 172.21.2.105:0/1896741599 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4410144180 0x7f4410064880 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:30.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.572+0000 7f4416682700 1 --2- 172.21.2.105:0/1896741599 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f44100ace20 0x7f4410147e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:30.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.572+0000 7f4416682700 1 --2- 172.21.2.105:0/1896741599 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f44100aca40 0x7f44101448d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:30.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.572+0000 7f4416682700 1 -- 172.21.2.105:0/1896741599 >> 172.21.2.105:0/1896741599 conn(0x7f441005c490 msgr2=0x7f441014c230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:30.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.572+0000 7f4416682700 1 -- 172.21.2.105:0/1896741599 shutdown_connections 2021-11-12T05:48:30.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.572+0000 7f4416682700 1 -- 172.21.2.105:0/1896741599 wait complete. 2021-11-12T05:48:30.583 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-12T05:48:30.583 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:48:30.634 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.628+0000 7fd947c12700 1 Processor -- start 2021-11-12T05:48:30.634 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.628+0000 7fd947c12700 1 -- start start 2021-11-12T05:48:30.635 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.628+0000 7fd947c12700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd9400adaf0 0x7fd94013fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:30.635 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.628+0000 7fd947c12700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fd940143b40 0x7fd940143f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:30.635 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.628+0000 7fd947c12700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd940067860 con 0x7fd9400aded0 2021-11-12T05:48:30.636 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.628+0000 7fd947c12700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd940143400 con 0x7fd940143b40 2021-11-12T05:48:30.636 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.632+0000 7fd947c12700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9401436a0 con 0x7fd9400adaf0 2021-11-12T05:48:30.636 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.632+0000 7fd9451ad700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fd940143b40 0x7fd940143f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:30.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.632+0000 7fd9459ae700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd9400adaf0 0x7fd94013fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:30.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.632+0000 7fd9461af700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7fd9400aded0 0x7fd9400afe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:59556/0 (socket says 172.21.2.105:59556) 2021-11-12T05:48:30.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.632+0000 7fd9461af700 1 -- 172.21.2.105:0/3835046007 learned_addr learned my addr 172.21.2.105:0/3835046007 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:30.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.632+0000 7fd9451ad700 1 -- 172.21.2.105:0/3835046007 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd9400adaf0 msgr2=0x7fd94013fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:30.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.632+0000 7fd9451ad700 1 --2- 172.21.2.105:0/3835046007 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd9400adaf0 0x7fd94013fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:30.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.632+0000 7fd9451ad700 1 -- 172.21.2.105:0/3835046007 >> v1:172.21.2.115:6789/0 conn(0x7fd9400aded0 legacy=0x7fd9400afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:30.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.632+0000 7fd9451ad700 1 -- 172.21.2.105:0/3835046007 --> v2:172.21.2.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9400b2b40 con 0x7fd940143b40 2021-11-12T05:48:30.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.632+0000 7fd9451ad700 1 --2- 172.21.2.105:0/3835046007 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd940143b40 0x7fd940143f80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fd93c002f70 tx=0x7fd93c006df0).ready entity=mon.1 client_cookie=46ddd70d012d200c server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:30.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.632+0000 7fd9449ac700 1 -- 172.21.2.105:0/3835046007 <== mon.1 v2:172.21.2.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd93c014070 con 0x7fd940143b40 2021-11-12T05:48:30.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.632+0000 7fd9449ac700 1 -- 172.21.2.105:0/3835046007 <== mon.1 v2:172.21.2.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd93c000e90 con 0x7fd940143b40 2021-11-12T05:48:30.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.632+0000 7fd9449ac700 1 -- 172.21.2.105:0/3835046007 <== mon.1 v2:172.21.2.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd93c00fb60 con 0x7fd940143b40 2021-11-12T05:48:30.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.632+0000 7fd947c12700 1 -- 172.21.2.105:0/3835046007 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd940143b40 msgr2=0x7fd940143f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:30.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.632+0000 7fd947c12700 1 --2- 172.21.2.105:0/3835046007 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd940143b40 0x7fd940143f80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fd93c002f70 tx=0x7fd93c006df0).stop 2021-11-12T05:48:30.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.632+0000 7fd947c12700 1 -- 172.21.2.105:0/3835046007 shutdown_connections 2021-11-12T05:48:30.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.632+0000 7fd947c12700 1 --2- 172.21.2.105:0/3835046007 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd940143b40 0x7fd940143f80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:30.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.632+0000 7fd947c12700 1 --2- 172.21.2.105:0/3835046007 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd9400adaf0 0x7fd94013fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:30.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.632+0000 7fd947c12700 1 -- 172.21.2.105:0/3835046007 >> 172.21.2.105:0/3835046007 conn(0x7fd94005c490 msgr2=0x7fd94005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:30.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.632+0000 7fd947c12700 1 -- 172.21.2.105:0/3835046007 shutdown_connections 2021-11-12T05:48:30.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.636+0000 7fd947c12700 1 -- 172.21.2.105:0/3835046007 wait complete. 2021-11-12T05:48:30.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.636+0000 7fd947c12700 1 Processor -- start 2021-11-12T05:48:30.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.636+0000 7fd947c12700 1 -- start start 2021-11-12T05:48:30.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.636+0000 7fd947c12700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd9400adaf0 0x7fd940142990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:30.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.636+0000 7fd947c12700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd9400aded0 0x7fd94013cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:30.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.636+0000 7fd947c12700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd940143b40 0x7fd940064720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:30.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.636+0000 7fd947c12700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9400637d0 con 0x7fd940143b40 2021-11-12T05:48:30.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.636+0000 7fd947c12700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94013d160 con 0x7fd9400adaf0 2021-11-12T05:48:30.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.636+0000 7fd947c12700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd940063530 con 0x7fd9400aded0 2021-11-12T05:48:30.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.636+0000 7fd9461af700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd940143b40 0x7fd940064720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:30.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.636+0000 7fd9461af700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd940143b40 0x7fd940064720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50700/0 (socket says 172.21.2.105:50700) 2021-11-12T05:48:30.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.636+0000 7fd9461af700 1 -- 172.21.2.105:0/2568299037 learned_addr learned my addr 172.21.2.105:0/2568299037 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:30.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.636+0000 7fd9459ae700 1 --2- 172.21.2.105:0/2568299037 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd9400adaf0 0x7fd940142990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:30.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.636+0000 7fd9461af700 1 -- 172.21.2.105:0/2568299037 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd9400aded0 msgr2=0x7fd94013cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:30.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.636+0000 7fd9461af700 1 --2- 172.21.2.105:0/2568299037 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd9400aded0 0x7fd94013cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:30.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.636+0000 7fd9461af700 1 -- 172.21.2.105:0/2568299037 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd9400adaf0 msgr2=0x7fd940142990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:30.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.636+0000 7fd9461af700 1 --2- 172.21.2.105:0/2568299037 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd9400adaf0 0x7fd940142990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:30.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.636+0000 7fd9461af700 1 -- 172.21.2.105:0/2568299037 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd93c00b180 con 0x7fd940143b40 2021-11-12T05:48:30.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.636+0000 7fd9461af700 1 --2- 172.21.2.105:0/2568299037 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd940143b40 0x7fd940064720 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7fd940066780 tx=0x7fd938007f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:30.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.636+0000 7fd92effd700 1 -- 172.21.2.105:0/2568299037 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd938005ba0 con 0x7fd940143b40 2021-11-12T05:48:30.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.636+0000 7fd92effd700 1 -- 172.21.2.105:0/2568299037 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd938005d00 con 0x7fd940143b40 2021-11-12T05:48:30.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.636+0000 7fd947c12700 1 -- 172.21.2.105:0/2568299037 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9400642c0 con 0x7fd940143b40 2021-11-12T05:48:30.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.636+0000 7fd92effd700 1 -- 172.21.2.105:0/2568299037 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9380072c0 con 0x7fd940143b40 2021-11-12T05:48:30.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.636+0000 7fd947c12700 1 -- 172.21.2.105:0/2568299037 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9400acd20 con 0x7fd940143b40 2021-11-12T05:48:30.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.636+0000 7fd947c12700 1 -- 172.21.2.105:0/2568299037 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd940064450 con 0x7fd940143b40 2021-11-12T05:48:30.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.636+0000 7fd92effd700 1 -- 172.21.2.105:0/2568299037 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd938010070 con 0x7fd940143b40 2021-11-12T05:48:30.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.636+0000 7fd92effd700 1 --2- 172.21.2.105:0/2568299037 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd9200534f0 0x7fd9200559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:30.650 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.636+0000 7fd92effd700 1 -- 172.21.2.105:0/2568299037 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fd93806b390 con 0x7fd940143b40 2021-11-12T05:48:30.650 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.636+0000 7fd9459ae700 1 --2- 172.21.2.105:0/2568299037 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd9200534f0 0x7fd9200559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:30.650 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.636+0000 7fd9459ae700 1 --2- 172.21.2.105:0/2568299037 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd9200534f0 0x7fd9200559b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7fd93000b000 tx=0x7fd930008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:30.650 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.640+0000 7fd92effd700 1 -- 172.21.2.105:0/2568299037 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd9380423a0 con 0x7fd940143b40 2021-11-12T05:48:30.753 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.748+0000 7fd947c12700 1 -- 172.21.2.105:0/2568299037 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9400afb00 con 0x7fd940143b40 2021-11-12T05:48:30.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.748+0000 7fd92effd700 1 -- 172.21.2.105:0/2568299037 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+2139 (secure 0 0 0) 0x7fd938018070 con 0x7fd940143b40 2021-11-12T05:48:30.755 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:30.755 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":55,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4889,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/903045813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":903045813},{"type":"v1","addr":"172.21.2.115:6833","nonce":903045813}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":54}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:48:27.392744+0000","modified":"2021-11-12T05:48:28.395983+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7701},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7701":{"gid":7701,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/2721453399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":2721453399},{"type":"v1","addr":"172.21.2.105:6835","nonce":2721453399}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-11-12T05:48:30.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.752+0000 7fd947c12700 1 -- 172.21.2.105:0/2568299037 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd9200534f0 msgr2=0x7fd9200559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:30.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.752+0000 7fd947c12700 1 --2- 172.21.2.105:0/2568299037 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd9200534f0 0x7fd9200559b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7fd93000b000 tx=0x7fd930008040).stop 2021-11-12T05:48:30.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.752+0000 7fd947c12700 1 -- 172.21.2.105:0/2568299037 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd940143b40 msgr2=0x7fd940064720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:30.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.752+0000 7fd947c12700 1 --2- 172.21.2.105:0/2568299037 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd940143b40 0x7fd940064720 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7fd940066780 tx=0x7fd938007f00).stop 2021-11-12T05:48:30.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.752+0000 7fd947c12700 1 -- 172.21.2.105:0/2568299037 shutdown_connections 2021-11-12T05:48:30.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.752+0000 7fd947c12700 1 --2- 172.21.2.105:0/2568299037 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd9200534f0 0x7fd9200559b0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:30.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.752+0000 7fd947c12700 1 --2- 172.21.2.105:0/2568299037 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd940143b40 0x7fd940064720 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:30.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.752+0000 7fd947c12700 1 --2- 172.21.2.105:0/2568299037 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd9400aded0 0x7fd94013cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:30.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.752+0000 7fd947c12700 1 --2- 172.21.2.105:0/2568299037 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd9400adaf0 0x7fd940142990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:30.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.752+0000 7fd947c12700 1 -- 172.21.2.105:0/2568299037 >> 172.21.2.105:0/2568299037 conn(0x7fd94005c490 msgr2=0x7fd94013f990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:30.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.752+0000 7fd947c12700 1 -- 172.21.2.105:0/2568299037 shutdown_connections 2021-11-12T05:48:30.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:30.752+0000 7fd947c12700 1 -- 172.21.2.105:0/2568299037 wait complete. 2021-11-12T05:48:30.758 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 55 2021-11-12T05:48:30.963 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 55, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:48:27.392744+0000', 'modified': '2021-11-12T05:48:28.395983+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7701}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7701': {'gid': 7701, 'name': 'a', 'rank': 0, 'incarnation': 54, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/2721453399', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 2721453399}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 2721453399}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:48:30.964 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:48:30.965 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:48:31.046 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":7701,"want_state":"up:active","state":"up:active","rank_uptime":3.645213665,"mdsmap_epoch":55,"osdmap_epoch":117,"osdmap_epoch_barrier":116,"uptime":7.8128148450000001} 2021-11-12T05:48:31.046 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 7701, "mdsmap_epoch": 55, "osdmap_epoch": 117, "osdmap_epoch_barrier": 116, "rank_uptime": 3.645213665, "state": "up:active", "uptime": 7.812814845, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:48:31.047 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-12T05:48:31.047 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-12T05:48:31.048 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba016.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-12T05:48:31.048 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:31.049 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:48:31.060 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:48:31.114 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:48:31.115 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:48:31.126 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:48:31.127 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:48:31.128 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:31.128 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:48:31.132 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-12T05:48:31.133 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:48:31.177 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:48:31.187 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:48:31.187 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:48:31.192 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:48:31.193 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:48:31.193 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:31.194 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:48:31.215 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:2021-11-12T05:48:31.209+0000 7f67b0ff9080 -1 init, newargv = 0x55cafba7bd30 newargc=9 2021-11-12T05:48:31.215 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[15047]: starting ceph client 2021-11-12T05:48:31.230 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[15047]: starting fuse 2021-11-12T05:48:32.319 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:48:32.332 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:48:32.332 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:48:32.383 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:48:32.384 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:48:32.385 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:32.385 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:48:32.390 INFO:teuthology.orchestra.run.gibba016.stdout:52 2021-11-12T05:48:32.390 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-12T05:48:32.391 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:32.391 DEBUG:teuthology.orchestra.run.gibba016:> sudo python3 -c ' 2021-11-12T05:48:32.392 DEBUG:teuthology.orchestra.run.gibba016:> import glob 2021-11-12T05:48:32.392 DEBUG:teuthology.orchestra.run.gibba016:> import re 2021-11-12T05:48:32.393 DEBUG:teuthology.orchestra.run.gibba016:> import os 2021-11-12T05:48:32.393 DEBUG:teuthology.orchestra.run.gibba016:> import subprocess 2021-11-12T05:48:32.393 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:48:32.394 DEBUG:teuthology.orchestra.run.gibba016:> def find_socket(client_name): 2021-11-12T05:48:32.394 DEBUG:teuthology.orchestra.run.gibba016:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-12T05:48:32.395 DEBUG:teuthology.orchestra.run.gibba016:> files = glob.glob(asok_path) 2021-11-12T05:48:32.395 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:48:32.395 DEBUG:teuthology.orchestra.run.gibba016:> # Given a non-glob path, it better be there 2021-11-12T05:48:32.396 DEBUG:teuthology.orchestra.run.gibba016:> if "*" not in asok_path: 2021-11-12T05:48:32.396 DEBUG:teuthology.orchestra.run.gibba016:> assert(len(files) == 1) 2021-11-12T05:48:32.397 DEBUG:teuthology.orchestra.run.gibba016:> return files[0] 2021-11-12T05:48:32.397 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:48:32.397 DEBUG:teuthology.orchestra.run.gibba016:> for f in files: 2021-11-12T05:48:32.398 DEBUG:teuthology.orchestra.run.gibba016:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-12T05:48:32.398 DEBUG:teuthology.orchestra.run.gibba016:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-12T05:48:32.399 DEBUG:teuthology.orchestra.run.gibba016:> return f 2021-11-12T05:48:32.399 DEBUG:teuthology.orchestra.run.gibba016:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-12T05:48:32.399 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:48:32.400 DEBUG:teuthology.orchestra.run.gibba016:> print(find_socket("client.0")) 2021-11-12T05:48:32.400 DEBUG:teuthology.orchestra.run.gibba016:> ' 2021-11-12T05:48:32.428 INFO:teuthology.orchestra.run.gibba016.stdout:/var/run/ceph/ceph-client.0.15047.asok 2021-11-12T05:48:32.430 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.15047.asok 2021-11-12T05:48:32.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:32.431 DEBUG:teuthology.orchestra.run.gibba016:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.15047.asok status 2021-11-12T05:48:32.479 INFO:teuthology.orchestra.run.gibba016.stdout:{ 2021-11-12T05:48:32.479 INFO:teuthology.orchestra.run.gibba016.stdout: "metadata": { 2021-11-12T05:48:32.479 INFO:teuthology.orchestra.run.gibba016.stdout: "ceph_sha1": "a81ee2815de5acae59ead5b8c9137b6766fc8ea8", 2021-11-12T05:48:32.480 INFO:teuthology.orchestra.run.gibba016.stdout: "ceph_version": "ceph version 15.2.15-22-ga81ee281 (a81ee2815de5acae59ead5b8c9137b6766fc8ea8) octopus (stable)", 2021-11-12T05:48:32.480 INFO:teuthology.orchestra.run.gibba016.stdout: "entity_id": "0", 2021-11-12T05:48:32.480 INFO:teuthology.orchestra.run.gibba016.stdout: "hostname": "gibba016", 2021-11-12T05:48:32.480 INFO:teuthology.orchestra.run.gibba016.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-12T05:48:32.480 INFO:teuthology.orchestra.run.gibba016.stdout: "pid": "15047", 2021-11-12T05:48:32.481 INFO:teuthology.orchestra.run.gibba016.stdout: "root": "/" 2021-11-12T05:48:32.481 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:48:32.481 INFO:teuthology.orchestra.run.gibba016.stdout: "dentry_count": 0, 2021-11-12T05:48:32.481 INFO:teuthology.orchestra.run.gibba016.stdout: "dentry_pinned_count": 0, 2021-11-12T05:48:32.482 INFO:teuthology.orchestra.run.gibba016.stdout: "id": 7875, 2021-11-12T05:48:32.482 INFO:teuthology.orchestra.run.gibba016.stdout: "inst": { 2021-11-12T05:48:32.482 INFO:teuthology.orchestra.run.gibba016.stdout: "name": { 2021-11-12T05:48:32.482 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "client", 2021-11-12T05:48:32.482 INFO:teuthology.orchestra.run.gibba016.stdout: "num": 7875 2021-11-12T05:48:32.483 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:48:32.483 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": { 2021-11-12T05:48:32.483 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "v1", 2021-11-12T05:48:32.483 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": "172.21.2.116:0", 2021-11-12T05:48:32.484 INFO:teuthology.orchestra.run.gibba016.stdout: "nonce": 4245182240 2021-11-12T05:48:32.484 INFO:teuthology.orchestra.run.gibba016.stdout: } 2021-11-12T05:48:32.484 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:48:32.484 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": { 2021-11-12T05:48:32.484 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "v1", 2021-11-12T05:48:32.485 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": "172.21.2.116:0", 2021-11-12T05:48:32.485 INFO:teuthology.orchestra.run.gibba016.stdout: "nonce": 4245182240 2021-11-12T05:48:32.485 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:48:32.485 INFO:teuthology.orchestra.run.gibba016.stdout: "inst_str": "client.7875 172.21.2.116:0/4245182240", 2021-11-12T05:48:32.486 INFO:teuthology.orchestra.run.gibba016.stdout: "addr_str": "172.21.2.116:0/4245182240", 2021-11-12T05:48:32.486 INFO:teuthology.orchestra.run.gibba016.stdout: "inode_count": 1, 2021-11-12T05:48:32.486 INFO:teuthology.orchestra.run.gibba016.stdout: "mds_epoch": 55, 2021-11-12T05:48:32.486 INFO:teuthology.orchestra.run.gibba016.stdout: "osd_epoch": 117, 2021-11-12T05:48:32.486 INFO:teuthology.orchestra.run.gibba016.stdout: "osd_epoch_barrier": 0, 2021-11-12T05:48:32.487 INFO:teuthology.orchestra.run.gibba016.stdout: "blacklisted": false, 2021-11-12T05:48:32.487 INFO:teuthology.orchestra.run.gibba016.stdout: "fs_name": "cephfs" 2021-11-12T05:48:32.487 INFO:teuthology.orchestra.run.gibba016.stdout:} 2021-11-12T05:48:32.488 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:32.489 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:48:32.489 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:48:32.536 INFO:teuthology.orchestra.run.gibba016.stdout:fuseblk 2021-11-12T05:48:32.537 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-12T05:48:32.537 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:32.538 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:48:32.547 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:48:32.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.596+0000 7f0c0fde9700 1 Processor -- start 2021-11-12T05:48:32.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.596+0000 7f0c0fde9700 1 -- start start 2021-11-12T05:48:32.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.596+0000 7f0c0fde9700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f0c080ad080 0x7f0c080af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:32.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.596+0000 7f0c0fde9700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f0c080ac280 0x7f0c080ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:32.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.596+0000 7f0c0fde9700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c080ac7b0 con 0x7f0c0814abe0 2021-11-12T05:48:32.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.596+0000 7f0c0fde9700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c081488a0 con 0x7f0c080ad080 2021-11-12T05:48:32.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.596+0000 7f0c0fde9700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c080ac9e0 con 0x7f0c080ac280 2021-11-12T05:48:32.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0db85700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f0c080ad080 0x7f0c080af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:32.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0db85700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f0c080ad080 0x7f0c080af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50704/0 (socket says 172.21.2.105:50704) 2021-11-12T05:48:32.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0db85700 1 -- 172.21.2.105:0/2396901510 learned_addr learned my addr 172.21.2.105:0/2396901510 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:32.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0e386700 1 --1- 172.21.2.105:0/2396901510 >> v1:172.21.2.105:6789/0 conn(0x7f0c0814abe0 0x7f0c0814b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:32868/0 (socket says 172.21.2.105:32868) 2021-11-12T05:48:32.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0db85700 1 -- 172.21.2.105:0/2396901510 >> v2:172.21.2.115:3300/0 conn(0x7f0c080ac280 msgr2=0x7f0c080ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:32.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0db85700 1 --2- 172.21.2.105:0/2396901510 >> v2:172.21.2.115:3300/0 conn(0x7f0c080ac280 0x7f0c080ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:32.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0db85700 1 -- 172.21.2.105:0/2396901510 >> v1:172.21.2.105:6789/0 conn(0x7f0c0814abe0 legacy=0x7f0c0814b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:32.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0db85700 1 -- 172.21.2.105:0/2396901510 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c080b0b30 con 0x7f0c080ad080 2021-11-12T05:48:32.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0db85700 1 --2- 172.21.2.105:0/2396901510 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0c080ad080 0x7f0c080af730 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 rx=0x7f0bfc002f70 tx=0x7f0bfc006eb0).ready entity=mon.0 client_cookie=8470634a4b4de4c8 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:32.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0cb83700 1 -- 172.21.2.105:0/2396901510 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bfc00d610 con 0x7f0c080ad080 2021-11-12T05:48:32.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0cb83700 1 -- 172.21.2.105:0/2396901510 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bfc000e90 con 0x7f0c080ad080 2021-11-12T05:48:32.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0cb83700 1 -- 172.21.2.105:0/2396901510 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bfc00d9a0 con 0x7f0c080ad080 2021-11-12T05:48:32.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0fde9700 1 -- 172.21.2.105:0/2396901510 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0c080ad080 msgr2=0x7f0c080af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:32.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0fde9700 1 --2- 172.21.2.105:0/2396901510 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0c080ad080 0x7f0c080af730 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 rx=0x7f0bfc002f70 tx=0x7f0bfc006eb0).stop 2021-11-12T05:48:32.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0fde9700 1 -- 172.21.2.105:0/2396901510 shutdown_connections 2021-11-12T05:48:32.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0fde9700 1 --2- 172.21.2.105:0/2396901510 >> v2:172.21.2.115:3300/0 conn(0x7f0c080ac280 0x7f0c080ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:32.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0fde9700 1 --2- 172.21.2.105:0/2396901510 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0c080ad080 0x7f0c080af730 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:32.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0fde9700 1 -- 172.21.2.105:0/2396901510 >> 172.21.2.105:0/2396901510 conn(0x7f0c080b5370 msgr2=0x7f0c080b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:32.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0fde9700 1 -- 172.21.2.105:0/2396901510 shutdown_connections 2021-11-12T05:48:32.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0fde9700 1 -- 172.21.2.105:0/2396901510 wait complete. 2021-11-12T05:48:32.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0fde9700 1 Processor -- start 2021-11-12T05:48:32.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0fde9700 1 -- start start 2021-11-12T05:48:32.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0fde9700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0c080ac280 0x7f0c080ab410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:32.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0fde9700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0c080ad080 0x7f0c08066930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:32.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0fde9700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0c0814abe0 0x7f0c08066e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:32.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0fde9700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c080aa0b0 con 0x7f0c080ac280 2021-11-12T05:48:32.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0fde9700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c080aade0 con 0x7f0c0814abe0 2021-11-12T05:48:32.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0fde9700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c080641f0 con 0x7f0c080ad080 2021-11-12T05:48:32.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0db85700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0c080ac280 0x7f0c080ab410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:32.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0db85700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0c080ac280 0x7f0c080ab410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50708/0 (socket says 172.21.2.105:50708) 2021-11-12T05:48:32.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0db85700 1 -- 172.21.2.105:0/2576292590 learned_addr learned my addr 172.21.2.105:0/2576292590 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:32.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0db85700 1 -- 172.21.2.105:0/2576292590 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0c080ad080 msgr2=0x7f0c08066930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:32.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0db85700 1 --2- 172.21.2.105:0/2576292590 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0c080ad080 0x7f0c08066930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:32.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0db85700 1 -- 172.21.2.105:0/2576292590 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0c0814abe0 msgr2=0x7f0c08066e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:32.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0db85700 1 --2- 172.21.2.105:0/2576292590 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0c0814abe0 0x7f0c08066e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:32.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0db85700 1 -- 172.21.2.105:0/2576292590 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bfc00b1e0 con 0x7f0c080ac280 2021-11-12T05:48:32.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0db85700 1 --2- 172.21.2.105:0/2576292590 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0c080ac280 0x7f0c080ab410 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7f0c080aa1f0 tx=0x7f0bfc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:32.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c06ffd700 1 -- 172.21.2.105:0/2576292590 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bfc011910 con 0x7f0c080ac280 2021-11-12T05:48:32.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c06ffd700 1 -- 172.21.2.105:0/2576292590 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bfc011a70 con 0x7f0c080ac280 2021-11-12T05:48:32.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0fde9700 1 -- 172.21.2.105:0/2576292590 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c08064490 con 0x7f0c080ac280 2021-11-12T05:48:32.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c06ffd700 1 -- 172.21.2.105:0/2576292590 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bfc011dd0 con 0x7f0c080ac280 2021-11-12T05:48:32.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.600+0000 7f0c0fde9700 1 -- 172.21.2.105:0/2576292590 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c080a96c0 con 0x7f0c080ac280 2021-11-12T05:48:32.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.604+0000 7f0c0fde9700 1 -- 172.21.2.105:0/2576292590 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c080b1440 con 0x7f0c080ac280 2021-11-12T05:48:32.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.604+0000 7f0c06ffd700 1 -- 172.21.2.105:0/2576292590 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0bfc025030 con 0x7f0c080ac280 2021-11-12T05:48:32.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.604+0000 7f0c06ffd700 1 --2- 172.21.2.105:0/2576292590 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0be80536a0 0x7f0be8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:32.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.604+0000 7f0c06ffd700 1 -- 172.21.2.105:0/2576292590 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f0bfc06cdf0 con 0x7f0c080ac280 2021-11-12T05:48:32.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.604+0000 7f0c0d384700 1 --2- 172.21.2.105:0/2576292590 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0be80536a0 0x7f0be8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:32.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.604+0000 7f0c0d384700 1 --2- 172.21.2.105:0/2576292590 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0be80536a0 0x7f0be8055b60 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f0bf8002f70 tx=0x7f0bf8006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:32.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.604+0000 7f0c06ffd700 1 -- 172.21.2.105:0/2576292590 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0bfc043e00 con 0x7f0c080ac280 2021-11-12T05:48:32.692 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.688+0000 7f0c0fde9700 1 -- 172.21.2.105:0/2576292590 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c08057350 con 0x7f0c080ac280 2021-11-12T05:48:32.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.688+0000 7f0c06ffd700 1 -- 172.21.2.105:0/2576292590 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f0bfc023070 con 0x7f0c080ac280 2021-11-12T05:48:32.693 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:32.693 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":117,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:48:28.397131+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:48:25.280993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-11-12T05:48:26.409707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:48:32.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.688+0000 7f0c0fde9700 1 -- 172.21.2.105:0/2576292590 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0be80536a0 msgr2=0x7f0be8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:32.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.688+0000 7f0c0fde9700 1 --2- 172.21.2.105:0/2576292590 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0be80536a0 0x7f0be8055b60 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f0bf8002f70 tx=0x7f0bf8006a80).stop 2021-11-12T05:48:32.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.688+0000 7f0c0fde9700 1 -- 172.21.2.105:0/2576292590 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0c080ac280 msgr2=0x7f0c080ab410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:32.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.688+0000 7f0c0fde9700 1 --2- 172.21.2.105:0/2576292590 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0c080ac280 0x7f0c080ab410 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7f0c080aa1f0 tx=0x7f0bfc015000).stop 2021-11-12T05:48:32.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.688+0000 7f0c0fde9700 1 -- 172.21.2.105:0/2576292590 shutdown_connections 2021-11-12T05:48:32.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.688+0000 7f0c0fde9700 1 --2- 172.21.2.105:0/2576292590 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0be80536a0 0x7f0be8055b60 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:32.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.688+0000 7f0c0fde9700 1 --2- 172.21.2.105:0/2576292590 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0c0814abe0 0x7f0c08066e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:32.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.688+0000 7f0c0fde9700 1 --2- 172.21.2.105:0/2576292590 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0c080ad080 0x7f0c08066930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:32.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.688+0000 7f0c0fde9700 1 --2- 172.21.2.105:0/2576292590 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0c080ac280 0x7f0c080ab410 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:32.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.688+0000 7f0c0fde9700 1 -- 172.21.2.105:0/2576292590 >> 172.21.2.105:0/2576292590 conn(0x7f0c080b5370 msgr2=0x7f0c0814b090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:32.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.688+0000 7f0c0fde9700 1 -- 172.21.2.105:0/2576292590 shutdown_connections 2021-11-12T05:48:32.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.688+0000 7f0c0fde9700 1 -- 172.21.2.105:0/2576292590 wait complete. 2021-11-12T05:48:32.701 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-12T05:48:25.280993+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2021-11-12T05:48:26.409707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '117', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-12T05:48:32.702 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:48:32.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.748+0000 7f2e43cb4700 1 Processor -- start 2021-11-12T05:48:32.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.748+0000 7f2e43cb4700 1 -- start start 2021-11-12T05:48:32.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e43cb4700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f2e3c0b0f10 0x7f2e3c0ac9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:32.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e43cb4700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f2e3c060d30 0x7f2e3c140140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:32.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e43cb4700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e3c143c90 con 0x7f2e3c0adb10 2021-11-12T05:48:32.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e43cb4700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e3c0ace90 con 0x7f2e3c060d30 2021-11-12T05:48:32.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e43cb4700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e3c143ec0 con 0x7f2e3c0b0f10 2021-11-12T05:48:32.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e42251700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f2e3c060d30 0x7f2e3c140140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:32.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e42251700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f2e3c060d30 0x7f2e3c140140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50716/0 (socket says 172.21.2.105:50716) 2021-11-12T05:48:32.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e42251700 1 -- 172.21.2.105:0/432679076 learned_addr learned my addr 172.21.2.105:0/432679076 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:32.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e42251700 1 -- 172.21.2.105:0/432679076 >> v2:172.21.2.115:3300/0 conn(0x7f2e3c0b0f10 msgr2=0x7f2e3c0ac9a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:48:32.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e42251700 1 --2- 172.21.2.105:0/432679076 >> v2:172.21.2.115:3300/0 conn(0x7f2e3c0b0f10 0x7f2e3c0ac9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:32.768 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e42251700 1 -- 172.21.2.105:0/432679076 >> v1:172.21.2.115:6789/0 conn(0x7f2e3c0adb10 legacy=0x7f2e3c05f6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:48:32.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e42251700 1 -- 172.21.2.105:0/432679076 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e3c144160 con 0x7f2e3c060d30 2021-11-12T05:48:32.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e42251700 1 --2- 172.21.2.105:0/432679076 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2e3c060d30 0x7f2e3c140140 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 rx=0x7f2e3c0aea80 tx=0x7f2e34009290).ready entity=mon.0 client_cookie=8dfa4bae1f164779 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:32.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e40a4e700 1 -- 172.21.2.105:0/432679076 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e3400b830 con 0x7f2e3c060d30 2021-11-12T05:48:32.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e40a4e700 1 -- 172.21.2.105:0/432679076 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e3400b990 con 0x7f2e3c060d30 2021-11-12T05:48:32.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e40a4e700 1 -- 172.21.2.105:0/432679076 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e3400bb40 con 0x7f2e3c060d30 2021-11-12T05:48:32.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e43cb4700 1 -- 172.21.2.105:0/432679076 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2e3c060d30 msgr2=0x7f2e3c140140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:32.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e43cb4700 1 --2- 172.21.2.105:0/432679076 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2e3c060d30 0x7f2e3c140140 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 rx=0x7f2e3c0aea80 tx=0x7f2e34009290).stop 2021-11-12T05:48:32.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e43cb4700 1 -- 172.21.2.105:0/432679076 shutdown_connections 2021-11-12T05:48:32.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e43cb4700 1 --2- 172.21.2.105:0/432679076 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2e3c060d30 0x7f2e3c140140 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:32.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e43cb4700 1 --2- 172.21.2.105:0/432679076 >> v2:172.21.2.115:3300/0 conn(0x7f2e3c0b0f10 0x7f2e3c0ac9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:32.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e43cb4700 1 -- 172.21.2.105:0/432679076 >> 172.21.2.105:0/432679076 conn(0x7f2e3c05c490 msgr2=0x7f2e3c0b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:32.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e43cb4700 1 -- 172.21.2.105:0/432679076 shutdown_connections 2021-11-12T05:48:32.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e43cb4700 1 -- 172.21.2.105:0/432679076 wait complete. 2021-11-12T05:48:32.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e43cb4700 1 Processor -- start 2021-11-12T05:48:32.772 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e43cb4700 1 -- start start 2021-11-12T05:48:32.772 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e43cb4700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2e3c060d30 0x7f2e3c09eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:32.772 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e43cb4700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2e3c0adb10 0x7f2e3c1524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:32.772 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e43cb4700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2e3c0b0f10 0x7f2e3c152c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:32.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e43cb4700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3c13f520 con 0x7f2e3c0b0f10 2021-11-12T05:48:32.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e43cb4700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3c1418d0 con 0x7f2e3c060d30 2021-11-12T05:48:32.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e43cb4700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3c141b70 con 0x7f2e3c0adb10 2021-11-12T05:48:32.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e42251700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2e3c0b0f10 0x7f2e3c152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:32.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e42251700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2e3c0b0f10 0x7f2e3c152c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50720/0 (socket says 172.21.2.105:50720) 2021-11-12T05:48:32.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e42251700 1 -- 172.21.2.105:0/1729068111 learned_addr learned my addr 172.21.2.105:0/1729068111 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:32.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e42251700 1 -- 172.21.2.105:0/1729068111 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2e3c0adb10 msgr2=0x7f2e3c1524a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:48:32.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e42251700 1 --2- 172.21.2.105:0/1729068111 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2e3c0adb10 0x7f2e3c1524a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:32.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e42251700 1 -- 172.21.2.105:0/1729068111 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2e3c060d30 msgr2=0x7f2e3c09eb50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:48:32.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e42251700 1 --2- 172.21.2.105:0/1729068111 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2e3c060d30 0x7f2e3c09eb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:32.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e42251700 1 -- 172.21.2.105:0/1729068111 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e34009530 con 0x7f2e3c0b0f10 2021-11-12T05:48:32.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e42251700 1 --2- 172.21.2.105:0/1729068111 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2e3c0b0f10 0x7f2e3c152c60 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7f2e3c0aea80 tx=0x7f2e34016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:32.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e2effd700 1 -- 172.21.2.105:0/1729068111 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e34021620 con 0x7f2e3c0b0f10 2021-11-12T05:48:32.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e2effd700 1 -- 172.21.2.105:0/1729068111 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e34021780 con 0x7f2e3c0b0f10 2021-11-12T05:48:32.776 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e43cb4700 1 -- 172.21.2.105:0/1729068111 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e3c152990 con 0x7f2e3c0b0f10 2021-11-12T05:48:32.776 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e43cb4700 1 -- 172.21.2.105:0/1729068111 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e3c1415c0 con 0x7f2e3c0b0f10 2021-11-12T05:48:32.776 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e2effd700 1 -- 172.21.2.105:0/1729068111 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e34021ae0 con 0x7f2e3c0b0f10 2021-11-12T05:48:32.776 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e43cb4700 1 -- 172.21.2.105:0/1729068111 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e3c0a0170 con 0x7f2e3c0b0f10 2021-11-12T05:48:32.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.752+0000 7f2e2effd700 1 -- 172.21.2.105:0/1729068111 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2e3400f070 con 0x7f2e3c0b0f10 2021-11-12T05:48:32.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.756+0000 7f2e2effd700 1 --2- 172.21.2.105:0/1729068111 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2e1c0536f0 0x7f2e1c055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:32.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.756+0000 7f2e2effd700 1 -- 172.21.2.105:0/1729068111 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f2e3406d240 con 0x7f2e3c0b0f10 2021-11-12T05:48:32.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.756+0000 7f2e41a50700 1 --2- 172.21.2.105:0/1729068111 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2e1c0536f0 0x7f2e1c055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:32.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.756+0000 7f2e41a50700 1 --2- 172.21.2.105:0/1729068111 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2e1c0536f0 0x7f2e1c055bb0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f2e30000ed0 tx=0x7f2e300068b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:32.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.756+0000 7f2e2effd700 1 -- 172.21.2.105:0/1729068111 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2e34044180 con 0x7f2e3c0b0f10 2021-11-12T05:48:32.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.840+0000 7f2e43cb4700 1 -- 172.21.2.105:0/1729068111 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f2e3c140630 con 0x7f2e3c0b0f10 2021-11-12T05:48:32.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.840+0000 7f2e2effd700 1 -- 172.21.2.105:0/1729068111 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v117) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2e34047760 con 0x7f2e3c0b0f10 2021-11-12T05:48:32.845 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:48:32.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.840+0000 7f2e43cb4700 1 -- 172.21.2.105:0/1729068111 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2e1c0536f0 msgr2=0x7f2e1c055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:32.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.840+0000 7f2e43cb4700 1 --2- 172.21.2.105:0/1729068111 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2e1c0536f0 0x7f2e1c055bb0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f2e30000ed0 tx=0x7f2e300068b0).stop 2021-11-12T05:48:32.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.840+0000 7f2e43cb4700 1 -- 172.21.2.105:0/1729068111 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2e3c0b0f10 msgr2=0x7f2e3c152c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:32.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.840+0000 7f2e43cb4700 1 --2- 172.21.2.105:0/1729068111 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2e3c0b0f10 0x7f2e3c152c60 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7f2e3c0aea80 tx=0x7f2e34016000).stop 2021-11-12T05:48:32.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.840+0000 7f2e43cb4700 1 -- 172.21.2.105:0/1729068111 shutdown_connections 2021-11-12T05:48:32.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.840+0000 7f2e43cb4700 1 --2- 172.21.2.105:0/1729068111 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2e1c0536f0 0x7f2e1c055bb0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:32.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.840+0000 7f2e43cb4700 1 --2- 172.21.2.105:0/1729068111 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2e3c0b0f10 0x7f2e3c152c60 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:32.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.840+0000 7f2e43cb4700 1 --2- 172.21.2.105:0/1729068111 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2e3c0adb10 0x7f2e3c1524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:32.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.840+0000 7f2e43cb4700 1 --2- 172.21.2.105:0/1729068111 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2e3c060d30 0x7f2e3c09eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:32.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.840+0000 7f2e43cb4700 1 -- 172.21.2.105:0/1729068111 >> 172.21.2.105:0/1729068111 conn(0x7f2e3c05c490 msgr2=0x7f2e3c0b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:32.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.840+0000 7f2e43cb4700 1 -- 172.21.2.105:0/1729068111 shutdown_connections 2021-11-12T05:48:32.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.840+0000 7f2e43cb4700 1 -- 172.21.2.105:0/1729068111 wait complete. 2021-11-12T05:48:32.853 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:48:32.904 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.900+0000 7fc8173c4700 1 Processor -- start 2021-11-12T05:48:32.905 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.900+0000 7fc8173c4700 1 -- start start 2021-11-12T05:48:32.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.900+0000 7fc8173c4700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fc8100ace20 0x7fc8100b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:32.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.900+0000 7fc8173c4700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8100b1840 con 0x7fc810144180 2021-11-12T05:48:32.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.900+0000 7fc8173c4700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8100af2b0 con 0x7fc8100aca40 2021-11-12T05:48:32.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.900+0000 7fc8173c4700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8100b0a10 con 0x7fc8100ace20 2021-11-12T05:48:32.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.900+0000 7fc815961700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fc810144180 0x7fc8101445f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:32894/0 (socket says 172.21.2.105:32894) 2021-11-12T05:48:32.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.900+0000 7fc815961700 1 -- 172.21.2.105:0/3432076350 learned_addr learned my addr 172.21.2.105:0/3432076350 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:32.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.900+0000 7fc803fff700 1 -- 172.21.2.105:0/3432076350 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 831194473 0 0) 0x7fc8100b1840 con 0x7fc810144180 2021-11-12T05:48:32.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.900+0000 7fc803fff700 1 -- 172.21.2.105:0/3432076350 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7f8003260 con 0x7fc810144180 2021-11-12T05:48:32.912 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.900+0000 7fc81495f700 1 --2- 172.21.2.105:0/3432076350 >> v2:172.21.2.115:3300/0 conn(0x7fc8100ace20 0x7fc8100b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:32.912 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.900+0000 7fc803fff700 1 -- 172.21.2.105:0/3432076350 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3895030256 0 0) 0x7fc7f8003260 con 0x7fc810144180 2021-11-12T05:48:32.912 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.900+0000 7fc803fff700 1 -- 172.21.2.105:0/3432076350 >> v2:172.21.2.115:3300/0 conn(0x7fc8100ace20 msgr2=0x7fc8100b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:32.912 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.900+0000 7fc803fff700 1 --2- 172.21.2.105:0/3432076350 >> v2:172.21.2.115:3300/0 conn(0x7fc8100ace20 0x7fc8100b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:32.913 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.900+0000 7fc803fff700 1 -- 172.21.2.105:0/3432076350 >> v1:172.21.2.115:6789/0 conn(0x7fc8100aca40 legacy=0x7fc8101473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:32.913 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.900+0000 7fc803fff700 1 -- 172.21.2.105:0/3432076350 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8100b1a70 con 0x7fc810144180 2021-11-12T05:48:32.913 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.900+0000 7fc803fff700 1 -- 172.21.2.105:0/3432076350 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fc8080019e0 con 0x7fc810144180 2021-11-12T05:48:32.913 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.900+0000 7fc803fff700 1 -- 172.21.2.105:0/3432076350 >> v1:172.21.2.105:6789/0 conn(0x7fc810144180 legacy=0x7fc8101445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:32.913 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.900+0000 7fc803fff700 1 --2- 172.21.2.105:0/3432076350 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc7f8003750 0x7fc7f8003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:32.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.900+0000 7fc803fff700 1 --2- 172.21.2.105:0/3432076350 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc7f8004500 0x7fc7f8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:32.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.900+0000 7fc803fff700 1 --2- 172.21.2.105:0/3432076350 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc7f8004ec0 0x7fc7f800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:32.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.900+0000 7fc803fff700 1 -- 172.21.2.105:0/3432076350 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8100b0a10 con 0x7fc7f8003750 2021-11-12T05:48:32.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.900+0000 7fc803fff700 1 -- 172.21.2.105:0/3432076350 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f800bd80 con 0x7fc7f8004ec0 2021-11-12T05:48:32.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.900+0000 7fc803fff700 1 -- 172.21.2.105:0/3432076350 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f800bf40 con 0x7fc7f8004500 2021-11-12T05:48:32.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.900+0000 7fc815160700 1 --2- 172.21.2.105:0/3432076350 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc7f8003750 0x7fc7f8003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:32.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.900+0000 7fc815160700 1 -- 172.21.2.105:0/3432076350 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc7f8004500 msgr2=0x7fc7f8004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:32.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.900+0000 7fc815160700 1 --2- 172.21.2.105:0/3432076350 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc7f8004500 0x7fc7f8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:32.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.900+0000 7fc815160700 1 -- 172.21.2.105:0/3432076350 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc7f8004ec0 msgr2=0x7fc7f800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:32.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.900+0000 7fc815160700 1 --2- 172.21.2.105:0/3432076350 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc7f8004ec0 0x7fc7f800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:32.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.900+0000 7fc815961700 1 -- 172.21.2.105:0/3432076350 reap_dead start 2021-11-12T05:48:32.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.900+0000 7fc815160700 1 -- 172.21.2.105:0/3432076350 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f8003260 con 0x7fc7f8003750 2021-11-12T05:48:32.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.900+0000 7fc815160700 1 --2- 172.21.2.105:0/3432076350 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc7f8003750 0x7fc7f8003b50 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7fc804001fa0 tx=0x7fc804007a00).ready entity=mon.0 client_cookie=2c0d7f8524289bee server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:32.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.904+0000 7fc803fff700 1 -- 172.21.2.105:0/3432076350 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc804007070 con 0x7fc7f8003750 2021-11-12T05:48:32.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.904+0000 7fc803fff700 1 -- 172.21.2.105:0/3432076350 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8040071d0 con 0x7fc7f8003750 2021-11-12T05:48:32.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.904+0000 7fc803fff700 1 -- 172.21.2.105:0/3432076350 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc804006510 con 0x7fc7f8003750 2021-11-12T05:48:32.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.904+0000 7fc8173c4700 1 -- 172.21.2.105:0/3432076350 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc7f8003750 msgr2=0x7fc7f8003b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:32.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.904+0000 7fc8173c4700 1 --2- 172.21.2.105:0/3432076350 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc7f8003750 0x7fc7f8003b50 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7fc804001fa0 tx=0x7fc804007a00).stop 2021-11-12T05:48:32.918 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.904+0000 7fc8173c4700 1 -- 172.21.2.105:0/3432076350 shutdown_connections 2021-11-12T05:48:32.918 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.904+0000 7fc8173c4700 1 --2- 172.21.2.105:0/3432076350 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc7f8003750 0x7fc7f8003b50 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:32.918 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.904+0000 7fc8173c4700 1 -- 172.21.2.105:0/3432076350 >> 172.21.2.105:0/3432076350 conn(0x7fc81005c490 msgr2=0x7fc8100b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:32.918 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.904+0000 7fc8173c4700 1 -- 172.21.2.105:0/3432076350 shutdown_connections 2021-11-12T05:48:32.918 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.904+0000 7fc8173c4700 1 -- 172.21.2.105:0/3432076350 wait complete. 2021-11-12T05:48:32.919 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.904+0000 7fc8173c4700 1 Processor -- start 2021-11-12T05:48:32.919 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.904+0000 7fc8173c4700 1 -- start start 2021-11-12T05:48:32.919 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.904+0000 7fc8173c4700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc7f8003750 0x7fc81014a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:32.919 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.904+0000 7fc8173c4700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc8100a90d0 0x7fc8100a8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:32.919 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.904+0000 7fc8173c4700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc8100a8880 0x7fc8101445b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:32.920 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.904+0000 7fc8173c4700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc810147290 con 0x7fc8100a8880 2021-11-12T05:48:32.920 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.904+0000 7fc8173c4700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc810148180 con 0x7fc8100a90d0 2021-11-12T05:48:32.920 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.904+0000 7fc8173c4700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc810148410 con 0x7fc7f8003750 2021-11-12T05:48:32.920 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.904+0000 7fc815961700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc8100a8880 0x7fc8101445b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:32.920 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.904+0000 7fc815961700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc8100a8880 0x7fc8101445b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50744/0 (socket says 172.21.2.105:50744) 2021-11-12T05:48:32.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.904+0000 7fc815961700 1 -- 172.21.2.105:0/2517795214 learned_addr learned my addr 172.21.2.105:0/2517795214 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:32.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.904+0000 7fc815160700 1 --2- 172.21.2.105:0/2517795214 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc7f8003750 0x7fc81014a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:32.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.904+0000 7fc81495f700 1 --2- 172.21.2.105:0/2517795214 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc8100a90d0 0x7fc8100a8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:32.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.904+0000 7fc815961700 1 -- 172.21.2.105:0/2517795214 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc7f8003750 msgr2=0x7fc81014a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:32.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.904+0000 7fc815961700 1 --2- 172.21.2.105:0/2517795214 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc7f8003750 0x7fc81014a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:32.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.904+0000 7fc815961700 1 -- 172.21.2.105:0/2517795214 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc8100a90d0 msgr2=0x7fc8100a8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:32.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.904+0000 7fc815961700 1 --2- 172.21.2.105:0/2517795214 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc8100a90d0 0x7fc8100a8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:32.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.904+0000 7fc815961700 1 -- 172.21.2.105:0/2517795214 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc810146ff0 con 0x7fc8100a8880 2021-11-12T05:48:32.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.904+0000 7fc815961700 1 --2- 172.21.2.105:0/2517795214 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc8100a8880 0x7fc8101445b0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 rx=0x7fc8100af5f0 tx=0x7fc8100ad870).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:32.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.904+0000 7fc8027fc700 1 -- 172.21.2.105:0/2517795214 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc808004ab0 con 0x7fc8100a8880 2021-11-12T05:48:32.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.904+0000 7fc8027fc700 1 -- 172.21.2.105:0/2517795214 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc808004c10 con 0x7fc8100a8880 2021-11-12T05:48:32.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.904+0000 7fc8027fc700 1 -- 172.21.2.105:0/2517795214 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc808007030 con 0x7fc8100a8880 2021-11-12T05:48:32.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.904+0000 7fc8173c4700 1 -- 172.21.2.105:0/2517795214 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8101474d0 con 0x7fc8100a8880 2021-11-12T05:48:32.924 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.904+0000 7fc8173c4700 1 -- 172.21.2.105:0/2517795214 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc810146170 con 0x7fc8100a8880 2021-11-12T05:48:32.925 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.904+0000 7fc8173c4700 1 -- 172.21.2.105:0/2517795214 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc810057350 con 0x7fc8100a8880 2021-11-12T05:48:32.925 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.904+0000 7fc8027fc700 1 -- 172.21.2.105:0/2517795214 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc80801b060 con 0x7fc8100a8880 2021-11-12T05:48:32.925 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.908+0000 7fc8027fc700 1 --2- 172.21.2.105:0/2517795214 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc7f0053540 0x7fc7f0055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:32.925 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.908+0000 7fc8027fc700 1 -- 172.21.2.105:0/2517795214 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fc80806b590 con 0x7fc8100a8880 2021-11-12T05:48:32.926 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.908+0000 7fc815160700 1 --2- 172.21.2.105:0/2517795214 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc7f0053540 0x7fc7f0055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:32.926 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.908+0000 7fc815160700 1 --2- 172.21.2.105:0/2517795214 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc7f0053540 0x7fc7f0055a00 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7fc804019000 tx=0x7fc804015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:32.926 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.908+0000 7fc8027fc700 1 -- 172.21.2.105:0/2517795214 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc808042490 con 0x7fc8100a8880 2021-11-12T05:48:32.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.988+0000 7fc8173c4700 1 -- 172.21.2.105:0/2517795214 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc81005f280 con 0x7fc8100a8880 2021-11-12T05:48:32.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.992+0000 7fc8027fc700 1 -- 172.21.2.105:0/2517795214 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v117) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc808019070 con 0x7fc8100a8880 2021-11-12T05:48:32.995 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:48:32.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.992+0000 7fc8173c4700 1 -- 172.21.2.105:0/2517795214 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc7f0053540 msgr2=0x7fc7f0055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:32.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.992+0000 7fc8173c4700 1 --2- 172.21.2.105:0/2517795214 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc7f0053540 0x7fc7f0055a00 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7fc804019000 tx=0x7fc804015000).stop 2021-11-12T05:48:32.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.992+0000 7fc8173c4700 1 -- 172.21.2.105:0/2517795214 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc8100a8880 msgr2=0x7fc8101445b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:32.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.992+0000 7fc8173c4700 1 --2- 172.21.2.105:0/2517795214 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc8100a8880 0x7fc8101445b0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 rx=0x7fc8100af5f0 tx=0x7fc8100ad870).stop 2021-11-12T05:48:32.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.992+0000 7fc8173c4700 1 -- 172.21.2.105:0/2517795214 shutdown_connections 2021-11-12T05:48:32.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.992+0000 7fc8173c4700 1 --2- 172.21.2.105:0/2517795214 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc7f0053540 0x7fc7f0055a00 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:32.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.992+0000 7fc8173c4700 1 --2- 172.21.2.105:0/2517795214 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc8100a8880 0x7fc8101445b0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:32.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.992+0000 7fc8173c4700 1 --2- 172.21.2.105:0/2517795214 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc8100a90d0 0x7fc8100a8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:32.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.992+0000 7fc8173c4700 1 --2- 172.21.2.105:0/2517795214 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc7f8003750 0x7fc81014a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:32.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.992+0000 7fc8173c4700 1 -- 172.21.2.105:0/2517795214 >> 172.21.2.105:0/2517795214 conn(0x7fc81005c490 msgr2=0x7fc810060600 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:32.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.992+0000 7fc8173c4700 1 -- 172.21.2.105:0/2517795214 shutdown_connections 2021-11-12T05:48:32.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:32.992+0000 7fc8173c4700 1 -- 172.21.2.105:0/2517795214 wait complete. 2021-11-12T05:48:33.002 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-12T05:48:33.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.052+0000 7fb725afe700 1 Processor -- start 2021-11-12T05:48:33.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.052+0000 7fb725afe700 1 -- start start 2021-11-12T05:48:33.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.052+0000 7fb725afe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb7200626b0 0x7fb720062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:33.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.052+0000 7fb725afe700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fb7200af750 0x7fb720130370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:33.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.052+0000 7fb725afe700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb720130cf0 con 0x7fb720130860 2021-11-12T05:48:33.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.052+0000 7fb725afe700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7200b0d50 con 0x7fb7200626b0 2021-11-12T05:48:33.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.052+0000 7fb725afe700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7200ad380 con 0x7fb7200af750 2021-11-12T05:48:33.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.052+0000 7fb71f7fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb7200626b0 0x7fb720062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:33.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.052+0000 7fb71f7fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb7200626b0 0x7fb720062a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50748/0 (socket says 172.21.2.105:50748) 2021-11-12T05:48:33.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.052+0000 7fb71f7fe700 1 -- 172.21.2.105:0/3103530557 learned_addr learned my addr 172.21.2.105:0/3103530557 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:33.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.052+0000 7fb71f7fe700 1 -- 172.21.2.105:0/3103530557 >> v2:172.21.2.115:3300/0 conn(0x7fb7200af750 msgr2=0x7fb720130370 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:48:33.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.052+0000 7fb71f7fe700 1 --2- 172.21.2.105:0/3103530557 >> v2:172.21.2.115:3300/0 conn(0x7fb7200af750 0x7fb720130370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:33.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.052+0000 7fb71f7fe700 1 -- 172.21.2.105:0/3103530557 >> v1:172.21.2.115:6789/0 conn(0x7fb720130860 legacy=0x7fb72014a950 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:48:33.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.052+0000 7fb71f7fe700 1 -- 172.21.2.105:0/3103530557 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7200ae190 con 0x7fb7200626b0 2021-11-12T05:48:33.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.052+0000 7fb71f7fe700 1 --2- 172.21.2.105:0/3103530557 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb7200626b0 0x7fb720062a90 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7fb7200b0690 tx=0x7fb708006eb0).ready entity=mon.0 client_cookie=37216d4e0a993e65 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:33.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.052+0000 7fb71e7fc700 1 -- 172.21.2.105:0/3103530557 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb70800d5c0 con 0x7fb7200626b0 2021-11-12T05:48:33.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.052+0000 7fb71e7fc700 1 -- 172.21.2.105:0/3103530557 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb708000e90 con 0x7fb7200626b0 2021-11-12T05:48:33.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.052+0000 7fb71e7fc700 1 -- 172.21.2.105:0/3103530557 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb70800d910 con 0x7fb7200626b0 2021-11-12T05:48:33.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.052+0000 7fb725afe700 1 -- 172.21.2.105:0/3103530557 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb7200626b0 msgr2=0x7fb720062a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:33.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.052+0000 7fb725afe700 1 --2- 172.21.2.105:0/3103530557 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb7200626b0 0x7fb720062a90 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7fb7200b0690 tx=0x7fb708006eb0).stop 2021-11-12T05:48:33.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.052+0000 7fb725afe700 1 -- 172.21.2.105:0/3103530557 shutdown_connections 2021-11-12T05:48:33.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.052+0000 7fb725afe700 1 --2- 172.21.2.105:0/3103530557 >> v2:172.21.2.115:3300/0 conn(0x7fb7200af750 0x7fb720130370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:33.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.052+0000 7fb725afe700 1 --2- 172.21.2.105:0/3103530557 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb7200626b0 0x7fb720062a90 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:33.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.052+0000 7fb725afe700 1 -- 172.21.2.105:0/3103530557 >> 172.21.2.105:0/3103530557 conn(0x7fb7200b5320 msgr2=0x7fb7200b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:33.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.052+0000 7fb725afe700 1 -- 172.21.2.105:0/3103530557 shutdown_connections 2021-11-12T05:48:33.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.052+0000 7fb725afe700 1 -- 172.21.2.105:0/3103530557 wait complete. 2021-11-12T05:48:33.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.052+0000 7fb725afe700 1 Processor -- start 2021-11-12T05:48:33.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.052+0000 7fb725afe700 1 -- start start 2021-11-12T05:48:33.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.052+0000 7fb725afe700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb7200626b0 0x7fb72014dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:33.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.052+0000 7fb725afe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb7200af750 0x7fb720064010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:33.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.052+0000 7fb725afe700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb720130860 0x7fb720064500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:33.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.052+0000 7fb725afe700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb720066a10 con 0x7fb7200af750 2021-11-12T05:48:33.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.052+0000 7fb725afe700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb720063aa0 con 0x7fb720130860 2021-11-12T05:48:33.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.052+0000 7fb725afe700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb720066c70 con 0x7fb7200626b0 2021-11-12T05:48:33.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.052+0000 7fb71effd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb7200af750 0x7fb720064010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:33.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.052+0000 7fb71effd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb7200af750 0x7fb720064010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50754/0 (socket says 172.21.2.105:50754) 2021-11-12T05:48:33.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.052+0000 7fb71effd700 1 -- 172.21.2.105:0/852233328 learned_addr learned my addr 172.21.2.105:0/852233328 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:33.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.056+0000 7fb71effd700 1 -- 172.21.2.105:0/852233328 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb7200626b0 msgr2=0x7fb72014dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:33.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.056+0000 7fb71effd700 1 --2- 172.21.2.105:0/852233328 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb7200626b0 0x7fb72014dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:33.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.056+0000 7fb71effd700 1 -- 172.21.2.105:0/852233328 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb720130860 msgr2=0x7fb720064500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:33.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.056+0000 7fb71effd700 1 --2- 172.21.2.105:0/852233328 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb720130860 0x7fb720064500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:33.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.056+0000 7fb71effd700 1 -- 172.21.2.105:0/852233328 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb70800b1e0 con 0x7fb7200af750 2021-11-12T05:48:33.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.056+0000 7fb71effd700 1 --2- 172.21.2.105:0/852233328 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb7200af750 0x7fb720064010 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7fb710002fb0 tx=0x7fb710006de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:33.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.056+0000 7fb71cff9700 1 -- 172.21.2.105:0/852233328 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb710013460 con 0x7fb7200af750 2021-11-12T05:48:33.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.056+0000 7fb71cff9700 1 -- 172.21.2.105:0/852233328 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7100135c0 con 0x7fb7200af750 2021-11-12T05:48:33.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.056+0000 7fb71cff9700 1 -- 172.21.2.105:0/852233328 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb710013920 con 0x7fb7200af750 2021-11-12T05:48:33.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.056+0000 7fb725afe700 1 -- 172.21.2.105:0/852233328 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb720063760 con 0x7fb7200af750 2021-11-12T05:48:33.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.056+0000 7fb725afe700 1 -- 172.21.2.105:0/852233328 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb720063240 con 0x7fb7200af750 2021-11-12T05:48:33.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.056+0000 7fb725afe700 1 -- 172.21.2.105:0/852233328 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb720057350 con 0x7fb7200af750 2021-11-12T05:48:33.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.056+0000 7fb71cff9700 1 -- 172.21.2.105:0/852233328 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb71000f070 con 0x7fb7200af750 2021-11-12T05:48:33.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.056+0000 7fb71cff9700 1 --2- 172.21.2.105:0/852233328 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb704053690 0x7fb704055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:33.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.056+0000 7fb71cff9700 1 -- 172.21.2.105:0/852233328 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fb71006b3f0 con 0x7fb7200af750 2021-11-12T05:48:33.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.056+0000 7fb71f7fe700 1 --2- 172.21.2.105:0/852233328 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb704053690 0x7fb704055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:33.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.056+0000 7fb71f7fe700 1 --2- 172.21.2.105:0/852233328 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb704053690 0x7fb704055b50 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7fb7200b0690 tx=0x7fb708015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:33.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.060+0000 7fb71cff9700 1 -- 172.21.2.105:0/852233328 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb7100422f0 con 0x7fb7200af750 2021-11-12T05:48:33.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.140+0000 7fb725afe700 1 -- 172.21.2.105:0/852233328 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb720063240 con 0x7fb7200af750 2021-11-12T05:48:33.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.140+0000 7fb71cff9700 1 -- 172.21.2.105:0/852233328 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v117) v1 ==== 104+0+10 (secure 0 0 0) 0x7fb710045910 con 0x7fb7200af750 2021-11-12T05:48:33.146 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:48:33.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.144+0000 7fb725afe700 1 -- 172.21.2.105:0/852233328 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb704053690 msgr2=0x7fb704055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:33.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.144+0000 7fb725afe700 1 --2- 172.21.2.105:0/852233328 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb704053690 0x7fb704055b50 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7fb7200b0690 tx=0x7fb708015000).stop 2021-11-12T05:48:33.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.144+0000 7fb725afe700 1 -- 172.21.2.105:0/852233328 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb7200af750 msgr2=0x7fb720064010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:33.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.144+0000 7fb725afe700 1 --2- 172.21.2.105:0/852233328 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb7200af750 0x7fb720064010 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7fb710002fb0 tx=0x7fb710006de0).stop 2021-11-12T05:48:33.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.144+0000 7fb725afe700 1 -- 172.21.2.105:0/852233328 shutdown_connections 2021-11-12T05:48:33.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.144+0000 7fb725afe700 1 --2- 172.21.2.105:0/852233328 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb704053690 0x7fb704055b50 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:33.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.144+0000 7fb725afe700 1 --2- 172.21.2.105:0/852233328 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb720130860 0x7fb720064500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:33.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.144+0000 7fb725afe700 1 --2- 172.21.2.105:0/852233328 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb7200af750 0x7fb720064010 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:33.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.144+0000 7fb725afe700 1 --2- 172.21.2.105:0/852233328 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb7200626b0 0x7fb72014dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:33.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.144+0000 7fb725afe700 1 -- 172.21.2.105:0/852233328 >> 172.21.2.105:0/852233328 conn(0x7fb7200b5320 msgr2=0x7fb7200b4720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:33.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.144+0000 7fb725afe700 1 -- 172.21.2.105:0/852233328 shutdown_connections 2021-11-12T05:48:33.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.144+0000 7fb725afe700 1 -- 172.21.2.105:0/852233328 wait complete. 2021-11-12T05:48:33.154 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-12T05:48:33.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.204+0000 7fce872de700 1 Processor -- start 2021-11-12T05:48:33.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.204+0000 7fce872de700 1 -- start start 2021-11-12T05:48:33.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.204+0000 7fce872de700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fce800aca40 0x7fce800ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:33.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.204+0000 7fce872de700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fce800b0520 0x7fce801473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:33.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.204+0000 7fce872de700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce800b1840 con 0x7fce801478b0 2021-11-12T05:48:33.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.204+0000 7fce872de700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce80147d20 con 0x7fce800aca40 2021-11-12T05:48:33.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.204+0000 7fce872de700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce800b09d0 con 0x7fce800b0520 2021-11-12T05:48:33.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.204+0000 7fce8507a700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fce800aca40 0x7fce800ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:33.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.204+0000 7fce8507a700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fce800aca40 0x7fce800ace20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50760/0 (socket says 172.21.2.105:50760) 2021-11-12T05:48:33.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.204+0000 7fce8507a700 1 -- 172.21.2.105:0/1019006091 learned_addr learned my addr 172.21.2.105:0/1019006091 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:33.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.204+0000 7fce8507a700 1 -- 172.21.2.105:0/1019006091 >> v2:172.21.2.115:3300/0 conn(0x7fce800b0520 msgr2=0x7fce801473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:33.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.204+0000 7fce8507a700 1 --2- 172.21.2.105:0/1019006091 >> v2:172.21.2.115:3300/0 conn(0x7fce800b0520 0x7fce801473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:33.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.204+0000 7fce8507a700 1 -- 172.21.2.105:0/1019006091 >> v1:172.21.2.105:6789/0 conn(0x7fce801478b0 legacy=0x7fce80144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:33.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.204+0000 7fce8507a700 1 -- 172.21.2.105:0/1019006091 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce800af2b0 con 0x7fce800aca40 2021-11-12T05:48:33.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.204+0000 7fce8507a700 1 --2- 172.21.2.105:0/1019006091 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fce800aca40 0x7fce800ace20 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7fce7c002f70 tx=0x7fce7c006eb0).ready entity=mon.0 client_cookie=5aed4b70b6340588 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:33.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.204+0000 7fce6ffff700 1 -- 172.21.2.105:0/1019006091 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce7c00d610 con 0x7fce800aca40 2021-11-12T05:48:33.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.204+0000 7fce6ffff700 1 -- 172.21.2.105:0/1019006091 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7c000e90 con 0x7fce800aca40 2021-11-12T05:48:33.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.204+0000 7fce6ffff700 1 -- 172.21.2.105:0/1019006091 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce7c00d9a0 con 0x7fce800aca40 2021-11-12T05:48:33.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.204+0000 7fce872de700 1 -- 172.21.2.105:0/1019006091 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fce800aca40 msgr2=0x7fce800ace20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:33.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.204+0000 7fce872de700 1 --2- 172.21.2.105:0/1019006091 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fce800aca40 0x7fce800ace20 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7fce7c002f70 tx=0x7fce7c006eb0).stop 2021-11-12T05:48:33.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.204+0000 7fce872de700 1 -- 172.21.2.105:0/1019006091 shutdown_connections 2021-11-12T05:48:33.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.204+0000 7fce872de700 1 --2- 172.21.2.105:0/1019006091 >> v2:172.21.2.115:3300/0 conn(0x7fce800b0520 0x7fce801473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:33.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.204+0000 7fce872de700 1 --2- 172.21.2.105:0/1019006091 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fce800aca40 0x7fce800ace20 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:33.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.204+0000 7fce872de700 1 -- 172.21.2.105:0/1019006091 >> 172.21.2.105:0/1019006091 conn(0x7fce8005c490 msgr2=0x7fce800b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:33.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.204+0000 7fce872de700 1 -- 172.21.2.105:0/1019006091 shutdown_connections 2021-11-12T05:48:33.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.204+0000 7fce872de700 1 -- 172.21.2.105:0/1019006091 wait complete. 2021-11-12T05:48:33.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.204+0000 7fce872de700 1 Processor -- start 2021-11-12T05:48:33.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.204+0000 7fce872de700 1 -- start start 2021-11-12T05:48:33.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.204+0000 7fce872de700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fce800aca40 0x7fce800641b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:33.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.204+0000 7fce872de700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fce800b0520 0x7fce8014a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:33.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.204+0000 7fce872de700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fce801478b0 0x7fce8015aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:33.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.204+0000 7fce872de700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce800a8020 con 0x7fce801478b0 2021-11-12T05:48:33.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.204+0000 7fce872de700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8015a2e0 con 0x7fce800aca40 2021-11-12T05:48:33.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.204+0000 7fce872de700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce8015a580 con 0x7fce800b0520 2021-11-12T05:48:33.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.208+0000 7fce8587b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fce801478b0 0x7fce8015aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:33.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.208+0000 7fce8587b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fce801478b0 0x7fce8015aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50770/0 (socket says 172.21.2.105:50770) 2021-11-12T05:48:33.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.208+0000 7fce8587b700 1 -- 172.21.2.105:0/3027826972 learned_addr learned my addr 172.21.2.105:0/3027826972 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:33.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.208+0000 7fce8587b700 1 -- 172.21.2.105:0/3027826972 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fce800b0520 msgr2=0x7fce8014a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:33.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.208+0000 7fce8587b700 1 --2- 172.21.2.105:0/3027826972 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fce800b0520 0x7fce8014a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:33.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.208+0000 7fce8587b700 1 -- 172.21.2.105:0/3027826972 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fce800aca40 msgr2=0x7fce800641b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:33.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.208+0000 7fce8587b700 1 --2- 172.21.2.105:0/3027826972 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fce800aca40 0x7fce800641b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:33.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.208+0000 7fce8587b700 1 -- 172.21.2.105:0/3027826972 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7c00b1e0 con 0x7fce801478b0 2021-11-12T05:48:33.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.208+0000 7fce8587b700 1 --2- 172.21.2.105:0/3027826972 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fce801478b0 0x7fce8015aa20 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 rx=0x7fce80061140 tx=0x7fce78007f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:33.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.208+0000 7fce6e7fc700 1 -- 172.21.2.105:0/3027826972 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce7800f470 con 0x7fce801478b0 2021-11-12T05:48:33.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.208+0000 7fce6e7fc700 1 -- 172.21.2.105:0/3027826972 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7800f5d0 con 0x7fce801478b0 2021-11-12T05:48:33.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.208+0000 7fce6e7fc700 1 -- 172.21.2.105:0/3027826972 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce7800f930 con 0x7fce801478b0 2021-11-12T05:48:33.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.208+0000 7fce872de700 1 -- 172.21.2.105:0/3027826972 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce80063e20 con 0x7fce801478b0 2021-11-12T05:48:33.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.208+0000 7fce872de700 1 -- 172.21.2.105:0/3027826972 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce800a7bf0 con 0x7fce801478b0 2021-11-12T05:48:33.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.208+0000 7fce872de700 1 -- 172.21.2.105:0/3027826972 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce8015a740 con 0x7fce801478b0 2021-11-12T05:48:33.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.208+0000 7fce6e7fc700 1 -- 172.21.2.105:0/3027826972 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fce78019030 con 0x7fce801478b0 2021-11-12T05:48:33.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.208+0000 7fce6e7fc700 1 --2- 172.21.2.105:0/3027826972 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fce600536f0 0x7fce60055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:33.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.208+0000 7fce6e7fc700 1 -- 172.21.2.105:0/3027826972 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fce7806b290 con 0x7fce801478b0 2021-11-12T05:48:33.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.208+0000 7fce8507a700 1 --2- 172.21.2.105:0/3027826972 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fce600536f0 0x7fce60055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:33.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.208+0000 7fce8507a700 1 --2- 172.21.2.105:0/3027826972 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fce600536f0 0x7fce60055bb0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7fce7c002f70 tx=0x7fce7c015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:33.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.212+0000 7fce6e7fc700 1 -- 172.21.2.105:0/3027826972 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fce78042190 con 0x7fce801478b0 2021-11-12T05:48:33.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.292+0000 7fce872de700 1 -- 172.21.2.105:0/3027826972 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fce800b1140 con 0x7fce801478b0 2021-11-12T05:48:33.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.292+0000 7fce6e7fc700 1 -- 172.21.2.105:0/3027826972 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v117) v1 ==== 100+0+10 (secure 0 0 0) 0x7fce780457b0 con 0x7fce801478b0 2021-11-12T05:48:33.298 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:48:33.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.292+0000 7fce872de700 1 -- 172.21.2.105:0/3027826972 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fce600536f0 msgr2=0x7fce60055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:33.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.292+0000 7fce872de700 1 --2- 172.21.2.105:0/3027826972 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fce600536f0 0x7fce60055bb0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7fce7c002f70 tx=0x7fce7c015000).stop 2021-11-12T05:48:33.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.292+0000 7fce872de700 1 -- 172.21.2.105:0/3027826972 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fce801478b0 msgr2=0x7fce8015aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:33.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.292+0000 7fce872de700 1 --2- 172.21.2.105:0/3027826972 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fce801478b0 0x7fce8015aa20 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 rx=0x7fce80061140 tx=0x7fce78007f50).stop 2021-11-12T05:48:33.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.292+0000 7fce872de700 1 -- 172.21.2.105:0/3027826972 shutdown_connections 2021-11-12T05:48:33.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.292+0000 7fce872de700 1 --2- 172.21.2.105:0/3027826972 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fce600536f0 0x7fce60055bb0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:33.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.292+0000 7fce872de700 1 --2- 172.21.2.105:0/3027826972 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fce801478b0 0x7fce8015aa20 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:33.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.292+0000 7fce872de700 1 --2- 172.21.2.105:0/3027826972 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fce800b0520 0x7fce8014a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:33.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.292+0000 7fce872de700 1 --2- 172.21.2.105:0/3027826972 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fce800aca40 0x7fce800641b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:33.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.292+0000 7fce872de700 1 -- 172.21.2.105:0/3027826972 >> 172.21.2.105:0/3027826972 conn(0x7fce8005c490 msgr2=0x7fce80144d20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:33.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.292+0000 7fce872de700 1 -- 172.21.2.105:0/3027826972 shutdown_connections 2021-11-12T05:48:33.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.292+0000 7fce872de700 1 -- 172.21.2.105:0/3027826972 wait complete. 2021-11-12T05:48:33.305 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-12T05:48:33.305 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:48:33.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.364+0000 7fcccaf32700 1 Processor -- start 2021-11-12T05:48:33.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.364+0000 7fcccaf32700 1 -- start start 2021-11-12T05:48:33.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.364+0000 7fcccaf32700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fccc40b4d50 0x7fccc40b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:33.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.364+0000 7fcccaf32700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fccc40b3100 0x7fccc40b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:33.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.364+0000 7fcccaf32700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc40b2110 con 0x7fccc4062010 2021-11-12T05:48:33.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.364+0000 7fcccaf32700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccc40b2370 con 0x7fccc40b3100 2021-11-12T05:48:33.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.364+0000 7fcccaf32700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc40b2610 con 0x7fccc40b4d50 2021-11-12T05:48:33.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.364+0000 7fccc8cce700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fccc4062010 0x7fccc40b4640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:32938/0 (socket says 172.21.2.105:32938) 2021-11-12T05:48:33.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.364+0000 7fccc8cce700 1 -- 172.21.2.105:0/3070634164 learned_addr learned my addr 172.21.2.105:0/3070634164 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:33.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.364+0000 7fccc94cf700 1 --2- 172.21.2.105:0/3070634164 >> v2:172.21.2.105:3300/0 conn(0x7fccc40b3100 0x7fccc40b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:33.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.364+0000 7fccc37fe700 1 -- 172.21.2.105:0/3070634164 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3556985065 0 0) 0x7fccc40b2110 con 0x7fccc4062010 2021-11-12T05:48:33.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.364+0000 7fccc37fe700 1 -- 172.21.2.105:0/3070634164 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcca4003260 con 0x7fccc4062010 2021-11-12T05:48:33.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.364+0000 7fccc94cf700 1 -- 172.21.2.105:0/3070634164 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fccc40b4d50 msgr2=0x7fccc40b5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:33.373 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.364+0000 7fccc94cf700 1 --2- 172.21.2.105:0/3070634164 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fccc40b4d50 0x7fccc40b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:33.373 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.364+0000 7fccc37fe700 1 -- 172.21.2.105:0/3070634164 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1231258244 0 0) 0x7fcca4003260 con 0x7fccc4062010 2021-11-12T05:48:33.373 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.364+0000 7fccc94cf700 1 -- 172.21.2.105:0/3070634164 >> v1:172.21.2.105:6789/0 conn(0x7fccc4062010 legacy=0x7fccc40b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:33.373 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.364+0000 7fccc94cf700 1 -- 172.21.2.105:0/3070634164 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc40b4330 con 0x7fccc40b3100 2021-11-12T05:48:33.374 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.364+0000 7fccc94cf700 1 --2- 172.21.2.105:0/3070634164 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fccc40b3100 0x7fccc40b2ab0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7fccb4001820 tx=0x7fccbc0091d0).ready entity=mon.0 client_cookie=1c0f3e3d6941d4b6 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:33.374 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.364+0000 7fccc37fe700 1 -- 172.21.2.105:0/3070634164 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccb4001680 con 0x7fccc40b3100 2021-11-12T05:48:33.374 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.364+0000 7fccc37fe700 1 -- 172.21.2.105:0/3070634164 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccbc00b580 con 0x7fccc40b3100 2021-11-12T05:48:33.374 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.364+0000 7fccc37fe700 1 -- 172.21.2.105:0/3070634164 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccbc00b6f0 con 0x7fccc40b3100 2021-11-12T05:48:33.375 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.364+0000 7fcccaf32700 1 -- 172.21.2.105:0/3070634164 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fccc40b3100 msgr2=0x7fccc40b2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:33.375 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.364+0000 7fcccaf32700 1 --2- 172.21.2.105:0/3070634164 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fccc40b3100 0x7fccc40b2ab0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7fccb4001820 tx=0x7fccbc0091d0).stop 2021-11-12T05:48:33.375 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.364+0000 7fcccaf32700 1 -- 172.21.2.105:0/3070634164 shutdown_connections 2021-11-12T05:48:33.375 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.364+0000 7fcccaf32700 1 --2- 172.21.2.105:0/3070634164 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fccc40b3100 0x7fccc40b2ab0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:33.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.364+0000 7fcccaf32700 1 --2- 172.21.2.105:0/3070634164 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fccc40b4d50 0x7fccc40b5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:33.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.364+0000 7fcccaf32700 1 -- 172.21.2.105:0/3070634164 >> 172.21.2.105:0/3070634164 conn(0x7fccc40b9790 msgr2=0x7fccc40b9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:33.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.364+0000 7fcccaf32700 1 -- 172.21.2.105:0/3070634164 shutdown_connections 2021-11-12T05:48:33.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.364+0000 7fcccaf32700 1 -- 172.21.2.105:0/3070634164 wait complete. 2021-11-12T05:48:33.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.364+0000 7fcccaf32700 1 Processor -- start 2021-11-12T05:48:33.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.364+0000 7fcccaf32700 1 -- start start 2021-11-12T05:48:33.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.368+0000 7fcccaf32700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fccc4062010 0x7fccc40b88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:33.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.368+0000 7fcccaf32700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fccc40b3100 0x7fccc413e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:33.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.368+0000 7fcccaf32700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fccc40b4d50 0x7fccc413e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:33.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.368+0000 7fcccaf32700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc40af0b0 con 0x7fccc4062010 2021-11-12T05:48:33.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.368+0000 7fcccaf32700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc40b0060 con 0x7fccc40b3100 2021-11-12T05:48:33.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.368+0000 7fcccaf32700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc40640f0 con 0x7fccc40b4d50 2021-11-12T05:48:33.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.368+0000 7fccc8cce700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fccc4062010 0x7fccc40b88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:33.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.368+0000 7fccc8cce700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fccc4062010 0x7fccc40b88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50780/0 (socket says 172.21.2.105:50780) 2021-11-12T05:48:33.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.368+0000 7fccc8cce700 1 -- 172.21.2.105:0/3265545142 learned_addr learned my addr 172.21.2.105:0/3265545142 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:33.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.368+0000 7fccc8cce700 1 -- 172.21.2.105:0/3265545142 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fccc40b4d50 msgr2=0x7fccc413e8b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:48:33.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.368+0000 7fccc8cce700 1 --2- 172.21.2.105:0/3265545142 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fccc40b4d50 0x7fccc413e8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:33.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.368+0000 7fccc8cce700 1 -- 172.21.2.105:0/3265545142 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fccc40b3100 msgr2=0x7fccc413e3c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:48:33.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.368+0000 7fccc8cce700 1 --2- 172.21.2.105:0/3265545142 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fccc40b3100 0x7fccc413e3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:33.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.368+0000 7fccc8cce700 1 -- 172.21.2.105:0/3265545142 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccbc009470 con 0x7fccc4062010 2021-11-12T05:48:33.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.368+0000 7fccc8cce700 1 --2- 172.21.2.105:0/3265545142 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fccc4062010 0x7fccc40b88f0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 rx=0x7fccb40018e0 tx=0x7fccb4001b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:33.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.368+0000 7fccc1ffb700 1 -- 172.21.2.105:0/3265545142 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccb4001bc0 con 0x7fccc4062010 2021-11-12T05:48:33.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.368+0000 7fccc1ffb700 1 -- 172.21.2.105:0/3265545142 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb4007170 con 0x7fccc4062010 2021-11-12T05:48:33.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.368+0000 7fccc1ffb700 1 -- 172.21.2.105:0/3265545142 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccb4004730 con 0x7fccc4062010 2021-11-12T05:48:33.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.368+0000 7fcccaf32700 1 -- 172.21.2.105:0/3265545142 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc40b8de0 con 0x7fccc4062010 2021-11-12T05:48:33.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.368+0000 7fcccaf32700 1 -- 172.21.2.105:0/3265545142 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc40b92a0 con 0x7fccc4062010 2021-11-12T05:48:33.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.368+0000 7fcccaf32700 1 -- 172.21.2.105:0/3265545142 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccc40aeed0 con 0x7fccc4062010 2021-11-12T05:48:33.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.368+0000 7fccc1ffb700 1 -- 172.21.2.105:0/3265545142 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fccb4004890 con 0x7fccc4062010 2021-11-12T05:48:33.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.368+0000 7fccc1ffb700 1 --2- 172.21.2.105:0/3265545142 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcca8053640 0x7fcca8055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:33.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.368+0000 7fccc1ffb700 1 -- 172.21.2.105:0/3265545142 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fccb406b760 con 0x7fccc4062010 2021-11-12T05:48:33.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.368+0000 7fccc3fff700 1 --2- 172.21.2.105:0/3265545142 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcca8053640 0x7fcca8055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:33.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.368+0000 7fccc3fff700 1 --2- 172.21.2.105:0/3265545142 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcca8053640 0x7fcca8055b00 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fccac002f70 tx=0x7fccac006970).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:33.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.372+0000 7fccc1ffb700 1 -- 172.21.2.105:0/3265545142 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fccb4042710 con 0x7fccc4062010 2021-11-12T05:48:33.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.480+0000 7fcccaf32700 1 -- 172.21.2.105:0/3265545142 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fccc40623f0 con 0x7fccc4062010 2021-11-12T05:48:33.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.480+0000 7fccc1ffb700 1 -- 172.21.2.105:0/3265545142 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+2139 (secure 0 0 0) 0x7fccb4045d30 con 0x7fccc4062010 2021-11-12T05:48:33.485 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:33.485 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":55,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4889,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/903045813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":903045813},{"type":"v1","addr":"172.21.2.115:6833","nonce":903045813}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":54}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:48:27.392744+0000","modified":"2021-11-12T05:48:28.395983+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7701},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7701":{"gid":7701,"name":"a","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/2721453399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":2721453399},{"type":"v1","addr":"172.21.2.105:6835","nonce":2721453399}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-11-12T05:48:33.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.480+0000 7fcccaf32700 1 -- 172.21.2.105:0/3265545142 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcca8053640 msgr2=0x7fcca8055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:33.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.480+0000 7fcccaf32700 1 --2- 172.21.2.105:0/3265545142 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcca8053640 0x7fcca8055b00 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fccac002f70 tx=0x7fccac006970).stop 2021-11-12T05:48:33.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.480+0000 7fcccaf32700 1 -- 172.21.2.105:0/3265545142 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fccc4062010 msgr2=0x7fccc40b88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:33.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.480+0000 7fcccaf32700 1 --2- 172.21.2.105:0/3265545142 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fccc4062010 0x7fccc40b88f0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 rx=0x7fccb40018e0 tx=0x7fccb4001b50).stop 2021-11-12T05:48:33.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.480+0000 7fcccaf32700 1 -- 172.21.2.105:0/3265545142 shutdown_connections 2021-11-12T05:48:33.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.480+0000 7fcccaf32700 1 --2- 172.21.2.105:0/3265545142 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fcca8053640 0x7fcca8055b00 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:33.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.480+0000 7fcccaf32700 1 --2- 172.21.2.105:0/3265545142 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fccc40b4d50 0x7fccc413e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:33.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.480+0000 7fcccaf32700 1 --2- 172.21.2.105:0/3265545142 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fccc40b3100 0x7fccc413e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:33.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.480+0000 7fcccaf32700 1 --2- 172.21.2.105:0/3265545142 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fccc4062010 0x7fccc40b88f0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:33.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.480+0000 7fcccaf32700 1 -- 172.21.2.105:0/3265545142 >> 172.21.2.105:0/3265545142 conn(0x7fccc40b9790 msgr2=0x7fccc405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:33.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.480+0000 7fcccaf32700 1 -- 172.21.2.105:0/3265545142 shutdown_connections 2021-11-12T05:48:33.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:33.480+0000 7fcccaf32700 1 -- 172.21.2.105:0/3265545142 wait complete. 2021-11-12T05:48:33.491 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 55 2021-11-12T05:48:33.694 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 55, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:48:27.392744+0000', 'modified': '2021-11-12T05:48:28.395983+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7701}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7701': {'gid': 7701, 'name': 'a', 'rank': 0, 'incarnation': 54, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/2721453399', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 2721453399}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 2721453399}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:48:33.694 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:48:33.695 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:48:33.759 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":7701,"want_state":"up:active","state":"up:active","rank_uptime":6.3591881580000003,"mdsmap_epoch":55,"osdmap_epoch":117,"osdmap_epoch_barrier":116,"uptime":10.526789450000001} 2021-11-12T05:48:33.760 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 7701, "mdsmap_epoch": 55, "osdmap_epoch": 117, "osdmap_epoch_barrier": 116, "rank_uptime": 6.359188158, "state": "up:active", "uptime": 10.52678945, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:48:33.761 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-12T05:48:33.761 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-11-12T05:48:33.761 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@gibba038.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-11-12T05:48:33.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:33.762 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:48:33.774 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-12T05:48:33.826 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:48:33.826 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:48:33.832 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:48:33.833 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:48:33.834 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:33.834 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-12T05:48:33.838 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-12T05:48:33.839 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:48:33.881 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-12T05:48:33.890 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:48:33.891 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:48:33.895 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:48:33.896 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:48:33.897 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:33.897 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-12T05:48:33.919 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:2021-11-12T05:48:33.920+0000 7fefa7904080 -1 init, newargv = 0x560571007ab0 newargc=9 2021-11-12T05:48:33.920 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:ceph-fuse[14501]: starting ceph client 2021-11-12T05:48:33.933 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:ceph-fuse[14501]: starting fuse 2021-11-12T05:48:35.024 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-12T05:48:35.036 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:48:35.037 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:48:35.086 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:48:35.087 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:48:35.088 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:35.088 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-12T05:48:35.093 INFO:teuthology.orchestra.run.gibba038.stdout:52 2021-11-12T05:48:35.094 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-12T05:48:35.094 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:35.095 DEBUG:teuthology.orchestra.run.gibba038:> sudo python3 -c ' 2021-11-12T05:48:35.095 DEBUG:teuthology.orchestra.run.gibba038:> import glob 2021-11-12T05:48:35.096 DEBUG:teuthology.orchestra.run.gibba038:> import re 2021-11-12T05:48:35.097 DEBUG:teuthology.orchestra.run.gibba038:> import os 2021-11-12T05:48:35.098 DEBUG:teuthology.orchestra.run.gibba038:> import subprocess 2021-11-12T05:48:35.099 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:48:35.099 DEBUG:teuthology.orchestra.run.gibba038:> def find_socket(client_name): 2021-11-12T05:48:35.100 DEBUG:teuthology.orchestra.run.gibba038:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-11-12T05:48:35.101 DEBUG:teuthology.orchestra.run.gibba038:> files = glob.glob(asok_path) 2021-11-12T05:48:35.101 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:48:35.102 DEBUG:teuthology.orchestra.run.gibba038:> # Given a non-glob path, it better be there 2021-11-12T05:48:35.102 DEBUG:teuthology.orchestra.run.gibba038:> if "*" not in asok_path: 2021-11-12T05:48:35.103 DEBUG:teuthology.orchestra.run.gibba038:> assert(len(files) == 1) 2021-11-12T05:48:35.103 DEBUG:teuthology.orchestra.run.gibba038:> return files[0] 2021-11-12T05:48:35.103 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:48:35.104 DEBUG:teuthology.orchestra.run.gibba038:> for f in files: 2021-11-12T05:48:35.104 DEBUG:teuthology.orchestra.run.gibba038:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-12T05:48:35.105 DEBUG:teuthology.orchestra.run.gibba038:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-12T05:48:35.105 DEBUG:teuthology.orchestra.run.gibba038:> return f 2021-11-12T05:48:35.105 DEBUG:teuthology.orchestra.run.gibba038:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-12T05:48:35.106 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:48:35.107 DEBUG:teuthology.orchestra.run.gibba038:> print(find_socket("client.1")) 2021-11-12T05:48:35.107 DEBUG:teuthology.orchestra.run.gibba038:> ' 2021-11-12T05:48:35.170 INFO:teuthology.orchestra.run.gibba038.stdout:/var/run/ceph/ceph-client.1.14501.asok 2021-11-12T05:48:35.173 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14501.asok 2021-11-12T05:48:35.174 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:35.175 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14501.asok status 2021-11-12T05:48:35.222 INFO:teuthology.orchestra.run.gibba038.stdout:{ 2021-11-12T05:48:35.223 INFO:teuthology.orchestra.run.gibba038.stdout: "metadata": { 2021-11-12T05:48:35.223 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_sha1": "a81ee2815de5acae59ead5b8c9137b6766fc8ea8", 2021-11-12T05:48:35.223 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_version": "ceph version 15.2.15-22-ga81ee281 (a81ee2815de5acae59ead5b8c9137b6766fc8ea8) octopus (stable)", 2021-11-12T05:48:35.224 INFO:teuthology.orchestra.run.gibba038.stdout: "entity_id": "1", 2021-11-12T05:48:35.224 INFO:teuthology.orchestra.run.gibba038.stdout: "hostname": "gibba038", 2021-11-12T05:48:35.224 INFO:teuthology.orchestra.run.gibba038.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-11-12T05:48:35.224 INFO:teuthology.orchestra.run.gibba038.stdout: "pid": "14501", 2021-11-12T05:48:35.224 INFO:teuthology.orchestra.run.gibba038.stdout: "root": "/" 2021-11-12T05:48:35.225 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:48:35.225 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_count": 0, 2021-11-12T05:48:35.225 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_pinned_count": 0, 2021-11-12T05:48:35.225 INFO:teuthology.orchestra.run.gibba038.stdout: "id": 7929, 2021-11-12T05:48:35.226 INFO:teuthology.orchestra.run.gibba038.stdout: "inst": { 2021-11-12T05:48:35.226 INFO:teuthology.orchestra.run.gibba038.stdout: "name": { 2021-11-12T05:48:35.226 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "client", 2021-11-12T05:48:35.226 INFO:teuthology.orchestra.run.gibba038.stdout: "num": 7929 2021-11-12T05:48:35.226 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:48:35.227 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-12T05:48:35.227 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-12T05:48:35.227 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-12T05:48:35.227 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 852443381 2021-11-12T05:48:35.228 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-11-12T05:48:35.228 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:48:35.228 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-12T05:48:35.228 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-12T05:48:35.228 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-12T05:48:35.229 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 852443381 2021-11-12T05:48:35.229 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:48:35.229 INFO:teuthology.orchestra.run.gibba038.stdout: "inst_str": "client.7929 172.21.2.138:0/852443381", 2021-11-12T05:48:35.229 INFO:teuthology.orchestra.run.gibba038.stdout: "addr_str": "172.21.2.138:0/852443381", 2021-11-12T05:48:35.229 INFO:teuthology.orchestra.run.gibba038.stdout: "inode_count": 1, 2021-11-12T05:48:35.230 INFO:teuthology.orchestra.run.gibba038.stdout: "mds_epoch": 55, 2021-11-12T05:48:35.230 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch": 117, 2021-11-12T05:48:35.230 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch_barrier": 0, 2021-11-12T05:48:35.230 INFO:teuthology.orchestra.run.gibba038.stdout: "blacklisted": false, 2021-11-12T05:48:35.231 INFO:teuthology.orchestra.run.gibba038.stdout: "fs_name": "cephfs" 2021-11-12T05:48:35.231 INFO:teuthology.orchestra.run.gibba038.stdout:} 2021-11-12T05:48:35.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:35.233 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:48:35.233 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:48:35.238 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-12T05:48:35.238 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-12T05:48:35.239 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:35.239 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:48:35.288 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:35.289 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:48:35.289 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:48:35.301 INFO:teuthology.orchestra.run.gibba016.stdout:fuseblk 2021-11-12T05:48:35.302 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-12T05:48:35.303 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:35.303 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:48:35.303 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:48:35.354 INFO:teuthology.orchestra.run.gibba016.stdout:fuseblk 2021-11-12T05:48:35.355 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-12T05:48:35.356 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba016.front.sepia.ceph.com... 2021-11-12T05:48:35.356 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-12T05:48:35.357 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:48:35.371 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[15047]: fuse finished with error 0 and tester_r 0 2021-11-12T05:48:35.372 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:35.372 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:48:35.373 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:48:35.377 INFO:teuthology.orchestra.run.gibba016.stdout:ext2/ext3 2021-11-12T05:48:35.377 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-12T05:48:35.378 INFO:teuthology.orchestra.run:waiting for 900 2021-11-12T05:48:35.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:48:35.422 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:48:35.426 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:35.427 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:48:35.427 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:48:35.438 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-12T05:48:35.439 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-12T05:48:35.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:35.440 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:48:35.441 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:48:35.494 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-12T05:48:35.495 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-12T05:48:35.495 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba038.front.sepia.ceph.com... 2021-11-12T05:48:35.496 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-12T05:48:35.496 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:48:35.516 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:ceph-fuse[14501]: fuse finished with error 0 and tester_r 0 2021-11-12T05:48:35.519 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:35.519 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:48:35.519 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:48:35.529 INFO:teuthology.orchestra.run.gibba038.stdout:ext2/ext3 2021-11-12T05:48:35.530 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-12T05:48:35.530 INFO:teuthology.orchestra.run:waiting for 900 2021-11-12T05:48:41.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:48:41.633 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:48:41.643 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-12T05:48:41.644 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T05:48:41.644 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-12T05:48:41.645 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T05:48:41.656 INFO:tasks.ceph.mds.b:Stopped 2021-11-12T05:48:41.656 DEBUG:teuthology.parallel:result is None 2021-11-12T05:48:41.657 INFO:tasks.ceph.mds.a:Stopped 2021-11-12T05:48:41.658 DEBUG:teuthology.parallel:result is None 2021-11-12T05:48:41.658 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2021-11-12T05:48:41.659 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2021-11-12T05:48:41.710 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.704+0000 7f0199140700 1 Processor -- start 2021-11-12T05:48:41.711 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.704+0000 7f4768ffa700 1 Processor -- start 2021-11-12T05:48:41.711 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.704+0000 7f4768ffa700 1 -- start start 2021-11-12T05:48:41.711 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.704+0000 7f0199140700 1 -- start start 2021-11-12T05:48:41.712 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.704+0000 7f4768ffa700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f47640b13f0 0x7f47640ae660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:41.712 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.704+0000 7f4768ffa700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f47640ac7b0 0x7f4764142210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:41.713 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.704+0000 7f4768ffa700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4764066fc0 con 0x7f4764066be0 2021-11-12T05:48:41.713 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.704+0000 7f4768ffa700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47640b0740 con 0x7f47640b13f0 2021-11-12T05:48:41.713 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.704+0000 7f4768ffa700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47640b09e0 con 0x7f47640ac7b0 2021-11-12T05:48:41.714 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.704+0000 7f0199140700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f01940ad080 0x7f01940af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:41.714 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.704+0000 7f0199140700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f01940ac280 0x7f01940ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:41.714 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.704+0000 7f0199140700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01940ac7b0 con 0x7f019414abe0 2021-11-12T05:48:41.714 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.704+0000 7f0199140700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01941488a0 con 0x7f01940ad080 2021-11-12T05:48:41.715 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.704+0000 7f0199140700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01940ac9e0 con 0x7f01940ac280 2021-11-12T05:48:41.715 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f4762d9d700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f47640ac7b0 0x7f4764142210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:41.715 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f476259c700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7f4764066be0 0x7f47640adf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:59652/0 (socket says 172.21.2.105:59652) 2021-11-12T05:48:41.716 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f0192d9d700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f01940ad080 0x7f01940af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:41.716 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f019259c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f01940ac280 0x7f01940ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:41.716 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f4761d9b700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f47640b13f0 0x7f47640ae660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:41.717 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f476259c700 1 -- 172.21.2.105:0/2149550696 learned_addr learned my addr 172.21.2.105:0/2149550696 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:41.717 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f019359e700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7f019414abe0 0x7f019414b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:59660/0 (socket says 172.21.2.105:59660) 2021-11-12T05:48:41.718 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f019359e700 1 -- 172.21.2.105:0/1463234015 learned_addr learned my addr 172.21.2.105:0/1463234015 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:41.718 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f0192d9d700 1 -- 172.21.2.105:0/1463234015 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f01940ac280 msgr2=0x7f01940ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:41.718 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f0192d9d700 1 --2- 172.21.2.105:0/1463234015 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f01940ac280 0x7f01940ad460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:41.719 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f4762d9d700 1 -- 172.21.2.105:0/2149550696 >> v2:172.21.2.115:3300/0 conn(0x7f47640b13f0 msgr2=0x7f47640ae660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:41.719 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f4762d9d700 1 --2- 172.21.2.105:0/2149550696 >> v2:172.21.2.115:3300/0 conn(0x7f47640b13f0 0x7f47640ae660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:41.719 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f4762d9d700 1 -- 172.21.2.105:0/2149550696 >> v1:172.21.2.115:6789/0 conn(0x7f4764066be0 legacy=0x7f47640adf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:41.719 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f0192d9d700 1 -- 172.21.2.105:0/1463234015 >> v1:172.21.2.115:6789/0 conn(0x7f019414abe0 legacy=0x7f019414b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:41.720 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f4762d9d700 1 -- 172.21.2.105:0/2149550696 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47640afdb0 con 0x7f47640ac7b0 2021-11-12T05:48:41.720 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f0191d9b700 1 -- 172.21.2.105:0/1463234015 <== mon.1 v1:172.21.2.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3056391797 0 0) 0x7f01940ac7b0 con 0x7f019414abe0 2021-11-12T05:48:41.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f0192d9d700 1 -- 172.21.2.105:0/1463234015 --> v2:172.21.2.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01940b0b30 con 0x7f01940ad080 2021-11-12T05:48:41.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f0192d9d700 1 --2- 172.21.2.105:0/1463234015 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f01940ad080 0x7f01940af730 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f0188002f70 tx=0x7f0188006df0).ready entity=mon.1 client_cookie=b85c335a78f0f1f5 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:41.722 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f4762d9d700 1 --2- 172.21.2.105:0/2149550696 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f47640ac7b0 0x7f4764142210 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f475c0032f0 tx=0x7f475c0091d0).ready entity=mon.2 client_cookie=a6b0325958b4d0e5 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:41.722 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f476159a700 1 -- 172.21.2.105:0/2149550696 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f475c00b6c0 con 0x7f47640ac7b0 2021-11-12T05:48:41.722 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f0191d9b700 1 -- 172.21.2.105:0/1463234015 <== mon.1 v2:172.21.2.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f018800d570 con 0x7f01940ad080 2021-11-12T05:48:41.723 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f476159a700 1 -- 172.21.2.105:0/2149550696 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475c00b820 con 0x7f47640ac7b0 2021-11-12T05:48:41.723 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f476159a700 1 -- 172.21.2.105:0/2149550696 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f475c00b990 con 0x7f47640ac7b0 2021-11-12T05:48:41.724 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f0191d9b700 1 -- 172.21.2.105:0/1463234015 <== mon.1 v2:172.21.2.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0188000e90 con 0x7f01940ad080 2021-11-12T05:48:41.724 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f0191d9b700 1 -- 172.21.2.105:0/1463234015 <== mon.1 v2:172.21.2.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f018800d8c0 con 0x7f01940ad080 2021-11-12T05:48:41.724 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f4768ffa700 1 -- 172.21.2.105:0/2149550696 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f47640ac7b0 msgr2=0x7f4764142210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:41.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f4768ffa700 1 --2- 172.21.2.105:0/2149550696 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f47640ac7b0 0x7f4764142210 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f475c0032f0 tx=0x7f475c0091d0).stop 2021-11-12T05:48:41.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f0199140700 1 -- 172.21.2.105:0/1463234015 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f01940ad080 msgr2=0x7f01940af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:41.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f0199140700 1 --2- 172.21.2.105:0/1463234015 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f01940ad080 0x7f01940af730 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f0188002f70 tx=0x7f0188006df0).stop 2021-11-12T05:48:41.726 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f4768ffa700 1 -- 172.21.2.105:0/2149550696 shutdown_connections 2021-11-12T05:48:41.726 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f4768ffa700 1 --2- 172.21.2.105:0/2149550696 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f47640ac7b0 0x7f4764142210 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:41.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f4768ffa700 1 --2- 172.21.2.105:0/2149550696 >> v2:172.21.2.115:3300/0 conn(0x7f47640b13f0 0x7f47640ae660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:41.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f4768ffa700 1 -- 172.21.2.105:0/2149550696 >> 172.21.2.105:0/2149550696 conn(0x7f47640b5370 msgr2=0x7f47640b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:41.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f4768ffa700 1 -- 172.21.2.105:0/2149550696 shutdown_connections 2021-11-12T05:48:41.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f4768ffa700 1 -- 172.21.2.105:0/2149550696 wait complete. 2021-11-12T05:48:41.728 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f0199140700 1 -- 172.21.2.105:0/1463234015 shutdown_connections 2021-11-12T05:48:41.728 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f0199140700 1 --2- 172.21.2.105:0/1463234015 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f01940ac280 0x7f01940ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:41.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f0199140700 1 --2- 172.21.2.105:0/1463234015 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f01940ad080 0x7f01940af730 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:41.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f0199140700 1 -- 172.21.2.105:0/1463234015 >> 172.21.2.105:0/1463234015 conn(0x7f01940b5370 msgr2=0x7f01940b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:41.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f0199140700 1 -- 172.21.2.105:0/1463234015 shutdown_connections 2021-11-12T05:48:41.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f0199140700 1 -- 172.21.2.105:0/1463234015 wait complete. 2021-11-12T05:48:41.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f4768ffa700 1 Processor -- start 2021-11-12T05:48:41.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f4768ffa700 1 -- start start 2021-11-12T05:48:41.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f0199140700 1 Processor -- start 2021-11-12T05:48:41.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.708+0000 7f0199140700 1 -- start start 2021-11-12T05:48:41.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f4768ffa700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4764066be0 0x7f4764146040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:41.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f4768ffa700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f47640ac7b0 0x7f4764156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:41.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f4768ffa700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f47640b13f0 0x7f47641526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:41.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f4768ffa700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47640a58d0 con 0x7f4764066be0 2021-11-12T05:48:41.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f4768ffa700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4764155dc0 con 0x7f47640b13f0 2021-11-12T05:48:41.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f4768ffa700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4764156060 con 0x7f47640ac7b0 2021-11-12T05:48:41.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f0199140700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f01940ac280 0x7f0194144910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:41.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f0199140700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f01940ad080 0x7f01940a82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:41.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f0199140700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f019414abe0 0x7f01940a8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:41.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f0199140700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0194148b80 con 0x7f019414abe0 2021-11-12T05:48:41.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f0199140700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01940a8c80 con 0x7f01940ad080 2021-11-12T05:48:41.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f0199140700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0194156d70 con 0x7f01940ac280 2021-11-12T05:48:41.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f476259c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4764066be0 0x7f4764146040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:41.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f476259c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4764066be0 0x7f4764146040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50802/0 (socket says 172.21.2.105:50802) 2021-11-12T05:48:41.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f476259c700 1 -- 172.21.2.105:0/3585405843 learned_addr learned my addr 172.21.2.105:0/3585405843 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:41.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f4762d9d700 1 --2- 172.21.2.105:0/3585405843 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f47640b13f0 0x7f47641526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:41.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f4761d9b700 1 --2- 172.21.2.105:0/3585405843 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f47640ac7b0 0x7f4764156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:41.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f019359e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f019414abe0 0x7f01940a8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:41.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f019359e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f019414abe0 0x7f01940a8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50806/0 (socket says 172.21.2.105:50806) 2021-11-12T05:48:41.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f019359e700 1 -- 172.21.2.105:0/1658571581 learned_addr learned my addr 172.21.2.105:0/1658571581 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:41.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f019259c700 1 --2- 172.21.2.105:0/1658571581 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f01940ad080 0x7f01940a82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:41.738 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f0192d9d700 1 --2- 172.21.2.105:0/1658571581 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f01940ac280 0x7f0194144910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:41.739 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f476259c700 1 -- 172.21.2.105:0/3585405843 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f47640ac7b0 msgr2=0x7f4764156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:41.739 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f476259c700 1 --2- 172.21.2.105:0/3585405843 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f47640ac7b0 0x7f4764156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:41.739 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f476259c700 1 -- 172.21.2.105:0/3585405843 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f47640b13f0 msgr2=0x7f47641526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:41.739 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f476259c700 1 --2- 172.21.2.105:0/3585405843 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f47640b13f0 0x7f47641526f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:41.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f476259c700 1 -- 172.21.2.105:0/3585405843 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f475c009470 con 0x7f4764066be0 2021-11-12T05:48:41.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f476259c700 1 --2- 172.21.2.105:0/3585405843 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4764066be0 0x7f4764146040 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 rx=0x7f47640611f0 tx=0x7f4758007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:41.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f019359e700 1 -- 172.21.2.105:0/1658571581 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f01940ac280 msgr2=0x7f0194144910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:41.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f019359e700 1 --2- 172.21.2.105:0/1658571581 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f01940ac280 0x7f0194144910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:41.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f019359e700 1 -- 172.21.2.105:0/1658571581 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f01940ad080 msgr2=0x7f01940a82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:41.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f019359e700 1 --2- 172.21.2.105:0/1658571581 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f01940ad080 0x7f01940a82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:41.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f019359e700 1 -- 172.21.2.105:0/1658571581 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f018800b180 con 0x7f019414abe0 2021-11-12T05:48:41.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f47537fe700 1 -- 172.21.2.105:0/3585405843 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47580070d0 con 0x7f4764066be0 2021-11-12T05:48:41.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f47537fe700 1 -- 172.21.2.105:0/3585405843 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4758007230 con 0x7f4764066be0 2021-11-12T05:48:41.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f4768ffa700 1 -- 172.21.2.105:0/3585405843 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47640a10e0 con 0x7f4764066be0 2021-11-12T05:48:41.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f47537fe700 1 -- 172.21.2.105:0/3585405843 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4758005610 con 0x7f4764066be0 2021-11-12T05:48:41.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f019359e700 1 --2- 172.21.2.105:0/1658571581 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f019414abe0 0x7f01940a8790 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 rx=0x7f0184000ed0 tx=0x7f0184007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:41.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f4768ffa700 1 -- 172.21.2.105:0/3585405843 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47640a5430 con 0x7f4764066be0 2021-11-12T05:48:41.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f0183fff700 1 -- 172.21.2.105:0/1658571581 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0184007110 con 0x7f019414abe0 2021-11-12T05:48:41.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f0183fff700 1 -- 172.21.2.105:0/1658571581 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0184007270 con 0x7f019414abe0 2021-11-12T05:48:41.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f0183fff700 1 -- 172.21.2.105:0/1658571581 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0184005030 con 0x7f019414abe0 2021-11-12T05:48:41.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f0199140700 1 -- 172.21.2.105:0/1658571581 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0194156a10 con 0x7f019414abe0 2021-11-12T05:48:41.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f0199140700 1 -- 172.21.2.105:0/1658571581 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01940a7020 con 0x7f019414abe0 2021-11-12T05:48:41.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f4768ffa700 1 -- 172.21.2.105:0/3585405843 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47640a16d0 con 0x7f4764066be0 2021-11-12T05:48:41.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f47537fe700 1 -- 172.21.2.105:0/3585405843 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4758010070 con 0x7f4764066be0 2021-11-12T05:48:41.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f0199140700 1 -- 172.21.2.105:0/1658571581 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0194148cf0 con 0x7f019414abe0 2021-11-12T05:48:41.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f47537fe700 1 --2- 172.21.2.105:0/3585405843 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f47400536a0 0x7f4740055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:41.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f47537fe700 1 -- 172.21.2.105:0/3585405843 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f475806b0a0 con 0x7f4764066be0 2021-11-12T05:48:41.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f4761d9b700 1 --2- 172.21.2.105:0/3585405843 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f47400536a0 0x7f4740055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:41.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f0183fff700 1 -- 172.21.2.105:0/1658571581 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0184005190 con 0x7f019414abe0 2021-11-12T05:48:41.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f4761d9b700 1 --2- 172.21.2.105:0/3585405843 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f47400536a0 0x7f4740055b60 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f475400b000 tx=0x7f4754008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:41.750 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f0183fff700 1 --2- 172.21.2.105:0/1658571581 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0170053580 0x7f0170055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:41.750 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f0183fff700 1 -- 172.21.2.105:0/1658571581 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f018406b200 con 0x7f019414abe0 2021-11-12T05:48:41.750 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f0192d9d700 1 --2- 172.21.2.105:0/1658571581 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0170053580 0x7f0170055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:41.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.712+0000 7f0192d9d700 1 --2- 172.21.2.105:0/1658571581 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0170053580 0x7f0170055a40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f018801a000 tx=0x7f0188014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:41.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.716+0000 7f47537fe700 1 -- 172.21.2.105:0/3585405843 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f47640a16d0 con 0x7f4764066be0 2021-11-12T05:48:41.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.716+0000 7f0183fff700 1 -- 172.21.2.105:0/1658571581 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0194148cf0 con 0x7f019414abe0 2021-11-12T05:48:41.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.828+0000 7f4768ffa700 1 -- 172.21.2.105:0/3585405843 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f47640a16d0 con 0x7f4764066be0 2021-11-12T05:48:41.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:41.832+0000 7f0199140700 1 -- 172.21.2.105:0/1658571581 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7f0194148cc0 con 0x7f019414abe0 2021-11-12T05:48:42.149 INFO:tasks.ceph.mon.a.gibba005.stderr:2021-11-12T05:48:42.144+0000 7fe9772b2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-12T05:48:42.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.156+0000 7f47537fe700 1 -- 172.21.2.105:0/3585405843 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 7701 v56) v1 ==== 95+0+0 (secure 0 0 0) 0x7f47640a16d0 con 0x7f4764066be0 2021-11-12T05:48:42.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.156+0000 7f0183fff700 1 -- 172.21.2.105:0/1658571581 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 4889 v56) v1 ==== 95+0+0 (secure 0 0 0) 0x7f0184042210 con 0x7f019414abe0 2021-11-12T05:48:42.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.160+0000 7f4768ffa700 1 -- 172.21.2.105:0/3585405843 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f47400536a0 msgr2=0x7f4740055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:42.163 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.160+0000 7f4768ffa700 1 --2- 172.21.2.105:0/3585405843 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f47400536a0 0x7f4740055b60 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f475400b000 tx=0x7f4754008040).stop 2021-11-12T05:48:42.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.160+0000 7f4768ffa700 1 -- 172.21.2.105:0/3585405843 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4764066be0 msgr2=0x7f4764146040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:42.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.160+0000 7f4768ffa700 1 --2- 172.21.2.105:0/3585405843 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4764066be0 0x7f4764146040 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 rx=0x7f47640611f0 tx=0x7f4758007c40).stop 2021-11-12T05:48:42.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.160+0000 7f0199140700 1 -- 172.21.2.105:0/1658571581 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0170053580 msgr2=0x7f0170055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:42.164 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.160+0000 7f0199140700 1 --2- 172.21.2.105:0/1658571581 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0170053580 0x7f0170055a40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f018801a000 tx=0x7f0188014000).stop 2021-11-12T05:48:42.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.160+0000 7f0199140700 1 -- 172.21.2.105:0/1658571581 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f019414abe0 msgr2=0x7f01940a8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:42.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.160+0000 7f0199140700 1 --2- 172.21.2.105:0/1658571581 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f019414abe0 0x7f01940a8790 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 rx=0x7f0184000ed0 tx=0x7f0184007c60).stop 2021-11-12T05:48:42.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.160+0000 7f4768ffa700 1 -- 172.21.2.105:0/3585405843 shutdown_connections 2021-11-12T05:48:42.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.160+0000 7f4768ffa700 1 --2- 172.21.2.105:0/3585405843 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f47400536a0 0x7f4740055b60 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:42.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.160+0000 7f0199140700 1 -- 172.21.2.105:0/1658571581 shutdown_connections 2021-11-12T05:48:42.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.160+0000 7f0199140700 1 --2- 172.21.2.105:0/1658571581 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0170053580 0x7f0170055a40 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:42.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.160+0000 7f4768ffa700 1 --2- 172.21.2.105:0/3585405843 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f47640b13f0 0x7f47641526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:42.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.160+0000 7f4768ffa700 1 --2- 172.21.2.105:0/3585405843 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f47640ac7b0 0x7f4764156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:42.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.160+0000 7f4768ffa700 1 --2- 172.21.2.105:0/3585405843 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4764066be0 0x7f4764146040 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:42.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.160+0000 7f4768ffa700 1 -- 172.21.2.105:0/3585405843 >> 172.21.2.105:0/3585405843 conn(0x7f47640b5370 msgr2=0x7f47640b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:42.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.160+0000 7f0199140700 1 --2- 172.21.2.105:0/1658571581 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f019414abe0 0x7f01940a8790 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:42.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.160+0000 7f0199140700 1 --2- 172.21.2.105:0/1658571581 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f01940ad080 0x7f01940a82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:42.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.160+0000 7f0199140700 1 --2- 172.21.2.105:0/1658571581 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f01940ac280 0x7f0194144910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:42.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.160+0000 7f0199140700 1 -- 172.21.2.105:0/1658571581 >> 172.21.2.105:0/1658571581 conn(0x7f01940b5370 msgr2=0x7f01940b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:42.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.160+0000 7f4768ffa700 1 -- 172.21.2.105:0/3585405843 shutdown_connections 2021-11-12T05:48:42.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.160+0000 7f0199140700 1 -- 172.21.2.105:0/1658571581 shutdown_connections 2021-11-12T05:48:42.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.160+0000 7f4768ffa700 1 -- 172.21.2.105:0/3585405843 wait complete. 2021-11-12T05:48:42.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.160+0000 7f0199140700 1 -- 172.21.2.105:0/1658571581 wait complete. 2021-11-12T05:48:42.171 INFO:teuthology.orchestra.run.gibba005.stderr:failed mds gid 4889 2021-11-12T05:48:42.172 INFO:teuthology.orchestra.run.gibba005.stderr:failed mds gid 7701 2021-11-12T05:48:42.173 DEBUG:teuthology.parallel:result is '' 2021-11-12T05:48:42.174 DEBUG:teuthology.parallel:result is '' 2021-11-12T05:48:42.174 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-12T05:48:42.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04f652a700 1 Processor -- start 2021-11-12T05:48:42.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04f652a700 1 -- start start 2021-11-12T05:48:42.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04f652a700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f04f00aca40 0x7f04f00ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:42.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04f652a700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f04f00b0520 0x7f04f01473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:42.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04f652a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f04f01478b0 0x7f04f0144180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:42.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04f652a700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f0147d40 con 0x7f04f00b0520 2021-11-12T05:48:42.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04f652a700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f00b1840 con 0x7f04f00aca40 2021-11-12T05:48:42.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04f652a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f00b09d0 con 0x7f04f01478b0 2021-11-12T05:48:42.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04ef7fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f04f00b0520 0x7f04f01473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:42.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04ef7fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f04f00b0520 0x7f04f01473c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50818/0 (socket says 172.21.2.105:50818) 2021-11-12T05:48:42.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04ef7fe700 1 -- 172.21.2.105:0/350809165 learned_addr learned my addr 172.21.2.105:0/350809165 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:42.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04ef7fe700 1 -- 172.21.2.105:0/350809165 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f04f01478b0 msgr2=0x7f04f0144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:42.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04ef7fe700 1 --2- 172.21.2.105:0/350809165 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f04f01478b0 0x7f04f0144180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:42.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04ef7fe700 1 -- 172.21.2.105:0/350809165 >> v2:172.21.2.115:3300/0 conn(0x7f04f00aca40 msgr2=0x7f04f00ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:42.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04ef7fe700 1 --2- 172.21.2.105:0/350809165 >> v2:172.21.2.115:3300/0 conn(0x7f04f00aca40 0x7f04f00ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:42.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04ef7fe700 1 -- 172.21.2.105:0/350809165 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f00af2b0 con 0x7f04f00b0520 2021-11-12T05:48:42.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04ef7fe700 1 --2- 172.21.2.105:0/350809165 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04f00b0520 0x7f04f01473c0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 rx=0x7f04f00ae6a0 tx=0x7f04d8006eb0).ready entity=mon.0 client_cookie=84b88327c8757399 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:42.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04eeffd700 1 -- 172.21.2.105:0/350809165 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04d800d570 con 0x7f04f00b0520 2021-11-12T05:48:42.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04eeffd700 1 -- 172.21.2.105:0/350809165 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d8000e90 con 0x7f04f00b0520 2021-11-12T05:48:42.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04eeffd700 1 -- 172.21.2.105:0/350809165 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04d800d8c0 con 0x7f04f00b0520 2021-11-12T05:48:42.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04f652a700 1 -- 172.21.2.105:0/350809165 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04f00b0520 msgr2=0x7f04f01473c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:42.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04f652a700 1 --2- 172.21.2.105:0/350809165 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04f00b0520 0x7f04f01473c0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 rx=0x7f04f00ae6a0 tx=0x7f04d8006eb0).stop 2021-11-12T05:48:42.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04f652a700 1 -- 172.21.2.105:0/350809165 shutdown_connections 2021-11-12T05:48:42.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04f652a700 1 --2- 172.21.2.105:0/350809165 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f04f01478b0 0x7f04f0144180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:42.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04f652a700 1 --2- 172.21.2.105:0/350809165 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04f00b0520 0x7f04f01473c0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:42.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04f652a700 1 --2- 172.21.2.105:0/350809165 >> v2:172.21.2.115:3300/0 conn(0x7f04f00aca40 0x7f04f00ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:42.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04f652a700 1 -- 172.21.2.105:0/350809165 >> 172.21.2.105:0/350809165 conn(0x7f04f005c490 msgr2=0x7f04f00b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:42.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04f652a700 1 -- 172.21.2.105:0/350809165 shutdown_connections 2021-11-12T05:48:42.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04f652a700 1 -- 172.21.2.105:0/350809165 wait complete. 2021-11-12T05:48:42.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04f652a700 1 Processor -- start 2021-11-12T05:48:42.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04f652a700 1 -- start start 2021-11-12T05:48:42.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04f652a700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f04f00aca40 0x7f04f0066e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:42.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04f652a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f04f00b0520 0x7f04f0064500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:42.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04f652a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04f01478b0 0x7f04f0149c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:42.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04f652a700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f0157180 con 0x7f04f01478b0 2021-11-12T05:48:42.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04f652a700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f00a75a0 con 0x7f04f00aca40 2021-11-12T05:48:42.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04f652a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f00a7020 con 0x7f04f00b0520 2021-11-12T05:48:42.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04f4ac7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04f01478b0 0x7f04f0149c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:42.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04f4ac7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04f01478b0 0x7f04f0149c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50824/0 (socket says 172.21.2.105:50824) 2021-11-12T05:48:42.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04f4ac7700 1 -- 172.21.2.105:0/796220298 learned_addr learned my addr 172.21.2.105:0/796220298 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:42.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04ef7fe700 1 --2- 172.21.2.105:0/796220298 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f04f00b0520 0x7f04f0064500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:42.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04effff700 1 --2- 172.21.2.105:0/796220298 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f04f00aca40 0x7f04f0066e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:42.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04f4ac7700 1 -- 172.21.2.105:0/796220298 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f04f00b0520 msgr2=0x7f04f0064500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:42.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04f4ac7700 1 --2- 172.21.2.105:0/796220298 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f04f00b0520 0x7f04f0064500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:42.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04f4ac7700 1 -- 172.21.2.105:0/796220298 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f04f00aca40 msgr2=0x7f04f0066e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:42.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04f4ac7700 1 --2- 172.21.2.105:0/796220298 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f04f00aca40 0x7f04f0066e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:42.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04f4ac7700 1 -- 172.21.2.105:0/796220298 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d800b1e0 con 0x7f04f01478b0 2021-11-12T05:48:42.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.224+0000 7f04ef7fe700 1 --2- 172.21.2.105:0/796220298 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f04f00b0520 0x7f04f0064500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:48:42.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.228+0000 7f04f4ac7700 1 --2- 172.21.2.105:0/796220298 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04f01478b0 0x7f04f0149c10 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7f04e80032f0 tx=0x7f04e8009120).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:42.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.228+0000 7f04ed7fa700 1 -- 172.21.2.105:0/796220298 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04e800f510 con 0x7f04f01478b0 2021-11-12T05:48:42.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.228+0000 7f04ed7fa700 1 -- 172.21.2.105:0/796220298 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e800f670 con 0x7f04f01478b0 2021-11-12T05:48:42.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.228+0000 7f04f652a700 1 -- 172.21.2.105:0/796220298 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f01573b0 con 0x7f04f01478b0 2021-11-12T05:48:42.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.228+0000 7f04ed7fa700 1 -- 172.21.2.105:0/796220298 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04e800f7e0 con 0x7f04f01478b0 2021-11-12T05:48:42.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.228+0000 7f04f652a700 1 -- 172.21.2.105:0/796220298 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f0063b40 con 0x7f04f01478b0 2021-11-12T05:48:42.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.228+0000 7f04f652a700 1 -- 172.21.2.105:0/796220298 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f0057350 con 0x7f04f01478b0 2021-11-12T05:48:42.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.228+0000 7f04ed7fa700 1 -- 172.21.2.105:0/796220298 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f04e800f070 con 0x7f04f01478b0 2021-11-12T05:48:42.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.228+0000 7f04ed7fa700 1 --2- 172.21.2.105:0/796220298 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f04d40536a0 0x7f04d4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:42.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.228+0000 7f04ed7fa700 1 -- 172.21.2.105:0/796220298 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f04e806b6b0 con 0x7f04f01478b0 2021-11-12T05:48:42.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.228+0000 7f04effff700 1 --2- 172.21.2.105:0/796220298 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f04d40536a0 0x7f04d4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:42.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.228+0000 7f04effff700 1 --2- 172.21.2.105:0/796220298 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f04d40536a0 0x7f04d4055b60 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f04e0007000 tx=0x7f04e0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:42.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.228+0000 7f04ed7fa700 1 -- 172.21.2.105:0/796220298 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f04e8042660 con 0x7f04f01478b0 2021-11-12T05:48:42.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:42.340+0000 7f04f652a700 1 -- 172.21.2.105:0/796220298 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f04f0157540 con 0x7f04f01478b0 2021-11-12T05:48:43.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.164+0000 7f04ed7fa700 1 -- 172.21.2.105:0/796220298 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v57) v1 ==== 104+0+0 (secure 0 0 0) 0x7f04e8045c80 con 0x7f04f01478b0 2021-11-12T05:48:43.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.168+0000 7f04f652a700 1 -- 172.21.2.105:0/796220298 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f04d40536a0 msgr2=0x7f04d4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:43.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.168+0000 7f04f652a700 1 --2- 172.21.2.105:0/796220298 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f04d40536a0 0x7f04d4055b60 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f04e0007000 tx=0x7f04e0008040).stop 2021-11-12T05:48:43.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.168+0000 7f04f652a700 1 -- 172.21.2.105:0/796220298 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04f01478b0 msgr2=0x7f04f0149c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:43.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.168+0000 7f04f652a700 1 --2- 172.21.2.105:0/796220298 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04f01478b0 0x7f04f0149c10 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7f04e80032f0 tx=0x7f04e8009120).stop 2021-11-12T05:48:43.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.168+0000 7f04f652a700 1 -- 172.21.2.105:0/796220298 shutdown_connections 2021-11-12T05:48:43.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.168+0000 7f04f652a700 1 --2- 172.21.2.105:0/796220298 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f04d40536a0 0x7f04d4055b60 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:43.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.168+0000 7f04f652a700 1 --2- 172.21.2.105:0/796220298 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f04f01478b0 0x7f04f0149c10 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:43.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.168+0000 7f04f652a700 1 --2- 172.21.2.105:0/796220298 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f04f00b0520 0x7f04f0064500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:43.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.168+0000 7f04f652a700 1 --2- 172.21.2.105:0/796220298 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f04f00aca40 0x7f04f0066e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:43.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.168+0000 7f04f652a700 1 -- 172.21.2.105:0/796220298 >> 172.21.2.105:0/796220298 conn(0x7f04f005c490 msgr2=0x7f04f0145770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:43.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.168+0000 7f04f652a700 1 -- 172.21.2.105:0/796220298 shutdown_connections 2021-11-12T05:48:43.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.168+0000 7f04f652a700 1 -- 172.21.2.105:0/796220298 wait complete. 2021-11-12T05:48:43.178 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-12T05:48:43.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.228+0000 7f30d1fb7700 1 Processor -- start 2021-11-12T05:48:43.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.228+0000 7f30d1fb7700 1 -- start start 2021-11-12T05:48:43.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.228+0000 7f30d1fb7700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f30cc0ac280 0x7f30cc14b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:43.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.228+0000 7f30d1fb7700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f30cc0af730 0x7f30cc0ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:43.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.228+0000 7f30d1fb7700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30cc0ac7b0 con 0x7f30cc0ad080 2021-11-12T05:48:43.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.228+0000 7f30d1fb7700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30cc1488a0 con 0x7f30cc0ac280 2021-11-12T05:48:43.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.228+0000 7f30d1fb7700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30cc0ac9e0 con 0x7f30cc0af730 2021-11-12T05:48:43.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.228+0000 7f30caffd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f30cc0ac280 0x7f30cc14b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:43.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.228+0000 7f30caffd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f30cc0ac280 0x7f30cc14b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50832/0 (socket says 172.21.2.105:50832) 2021-11-12T05:48:43.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.228+0000 7f30caffd700 1 -- 172.21.2.105:0/823445753 learned_addr learned my addr 172.21.2.105:0/823445753 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:43.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.228+0000 7f30caffd700 1 -- 172.21.2.105:0/823445753 >> v2:172.21.2.115:3300/0 conn(0x7f30cc0af730 msgr2=0x7f30cc0ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:43.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.228+0000 7f30cbfff700 1 --2- 172.21.2.105:0/823445753 >> v2:172.21.2.115:3300/0 conn(0x7f30cc0af730 0x7f30cc0ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:43.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.228+0000 7f30caffd700 1 --2- 172.21.2.105:0/823445753 >> v2:172.21.2.115:3300/0 conn(0x7f30cc0af730 0x7f30cc0ad460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:43.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.228+0000 7f30caffd700 1 -- 172.21.2.105:0/823445753 >> v1:172.21.2.115:6789/0 conn(0x7f30cc0ad080 legacy=0x7f30cc14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:43.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.228+0000 7f30caffd700 1 -- 172.21.2.105:0/823445753 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30cc0b0b30 con 0x7f30cc0ac280 2021-11-12T05:48:43.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.228+0000 7f30cbfff700 1 --2- 172.21.2.105:0/823445753 >> v2:172.21.2.115:3300/0 conn(0x7f30cc0af730 0x7f30cc0ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:48:43.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.228+0000 7f30caffd700 1 --2- 172.21.2.105:0/823445753 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f30cc0ac280 0x7f30cc14b2f0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 rx=0x7f30cc0b0eb0 tx=0x7f30b4006eb0).ready entity=mon.0 client_cookie=8462396d07c9b3d8 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:43.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.228+0000 7f30ca7fc700 1 -- 172.21.2.105:0/823445753 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30b400d5c0 con 0x7f30cc0ac280 2021-11-12T05:48:43.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.228+0000 7f30ca7fc700 1 -- 172.21.2.105:0/823445753 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b4000e90 con 0x7f30cc0ac280 2021-11-12T05:48:43.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.228+0000 7f30ca7fc700 1 -- 172.21.2.105:0/823445753 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30b400d950 con 0x7f30cc0ac280 2021-11-12T05:48:43.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.232+0000 7f30d1fb7700 1 -- 172.21.2.105:0/823445753 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f30cc0ac280 msgr2=0x7f30cc14b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:43.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.232+0000 7f30d1fb7700 1 --2- 172.21.2.105:0/823445753 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f30cc0ac280 0x7f30cc14b2f0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 rx=0x7f30cc0b0eb0 tx=0x7f30b4006eb0).stop 2021-11-12T05:48:43.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.232+0000 7f30d1fb7700 1 -- 172.21.2.105:0/823445753 shutdown_connections 2021-11-12T05:48:43.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.232+0000 7f30d1fb7700 1 --2- 172.21.2.105:0/823445753 >> v2:172.21.2.115:3300/0 conn(0x7f30cc0af730 0x7f30cc0ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:43.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.232+0000 7f30d1fb7700 1 --2- 172.21.2.105:0/823445753 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f30cc0ac280 0x7f30cc14b2f0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:43.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.232+0000 7f30d1fb7700 1 -- 172.21.2.105:0/823445753 >> 172.21.2.105:0/823445753 conn(0x7f30cc0b5370 msgr2=0x7f30cc0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:43.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.232+0000 7f30d1fb7700 1 -- 172.21.2.105:0/823445753 shutdown_connections 2021-11-12T05:48:43.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.232+0000 7f30d1fb7700 1 -- 172.21.2.105:0/823445753 wait complete. 2021-11-12T05:48:43.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.232+0000 7f30d1fb7700 1 Processor -- start 2021-11-12T05:48:43.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.232+0000 7f30d1fb7700 1 -- start start 2021-11-12T05:48:43.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.232+0000 7f30d1fb7700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f30cc0ac280 0x7f30cc0a9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:43.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.232+0000 7f30d1fb7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f30cc0ad080 0x7f30cc1572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:43.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.232+0000 7f30d1fb7700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f30cc0af730 0x7f30cc0a7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:43.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.232+0000 7f30d1fb7700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc1433e0 con 0x7f30cc0ad080 2021-11-12T05:48:43.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.232+0000 7f30d1fb7700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc063fd0 con 0x7f30cc0af730 2021-11-12T05:48:43.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.232+0000 7f30d1fb7700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc156b90 con 0x7f30cc0ac280 2021-11-12T05:48:43.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.232+0000 7f30caffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f30cc0ad080 0x7f30cc1572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:43.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.232+0000 7f30caffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f30cc0ad080 0x7f30cc1572d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50836/0 (socket says 172.21.2.105:50836) 2021-11-12T05:48:43.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.232+0000 7f30caffd700 1 -- 172.21.2.105:0/4138678251 learned_addr learned my addr 172.21.2.105:0/4138678251 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:43.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.232+0000 7f30cb7fe700 1 --2- 172.21.2.105:0/4138678251 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f30cc0ac280 0x7f30cc0a9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:43.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.232+0000 7f30cbfff700 1 --2- 172.21.2.105:0/4138678251 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f30cc0af730 0x7f30cc0a7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:43.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.232+0000 7f30caffd700 1 -- 172.21.2.105:0/4138678251 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f30cc0ac280 msgr2=0x7f30cc0a9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:43.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.232+0000 7f30caffd700 1 --2- 172.21.2.105:0/4138678251 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f30cc0ac280 0x7f30cc0a9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:43.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.232+0000 7f30caffd700 1 -- 172.21.2.105:0/4138678251 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f30cc0af730 msgr2=0x7f30cc0a7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:43.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.232+0000 7f30caffd700 1 --2- 172.21.2.105:0/4138678251 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f30cc0af730 0x7f30cc0a7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:43.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.232+0000 7f30caffd700 1 -- 172.21.2.105:0/4138678251 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b400b1e0 con 0x7f30cc0ad080 2021-11-12T05:48:43.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.232+0000 7f30caffd700 1 --2- 172.21.2.105:0/4138678251 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f30cc0ad080 0x7f30cc1572d0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7f30cc0b0eb0 tx=0x7f30b4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:43.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.232+0000 7f30c8ff9700 1 -- 172.21.2.105:0/4138678251 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30b4011ab0 con 0x7f30cc0ad080 2021-11-12T05:48:43.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.232+0000 7f30c8ff9700 1 -- 172.21.2.105:0/4138678251 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b4011c10 con 0x7f30cc0ad080 2021-11-12T05:48:43.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.232+0000 7f30c8ff9700 1 -- 172.21.2.105:0/4138678251 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30b401e460 con 0x7f30cc0ad080 2021-11-12T05:48:43.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.232+0000 7f30d1fb7700 1 -- 172.21.2.105:0/4138678251 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30cc156e30 con 0x7f30cc0ad080 2021-11-12T05:48:43.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.232+0000 7f30d1fb7700 1 -- 172.21.2.105:0/4138678251 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30cc145580 con 0x7f30cc0ad080 2021-11-12T05:48:43.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.232+0000 7f30d1fb7700 1 -- 172.21.2.105:0/4138678251 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30cc156fc0 con 0x7f30cc0ad080 2021-11-12T05:48:43.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.232+0000 7f30c8ff9700 1 -- 172.21.2.105:0/4138678251 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f30b4025030 con 0x7f30cc0ad080 2021-11-12T05:48:43.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.232+0000 7f30c8ff9700 1 --2- 172.21.2.105:0/4138678251 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f30b00534f0 0x7f30b00559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:43.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.232+0000 7f30c8ff9700 1 -- 172.21.2.105:0/4138678251 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f30b406ce20 con 0x7f30cc0ad080 2021-11-12T05:48:43.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.232+0000 7f30cb7fe700 1 --2- 172.21.2.105:0/4138678251 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f30b00534f0 0x7f30b00559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:43.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.236+0000 7f30cb7fe700 1 --2- 172.21.2.105:0/4138678251 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f30b00534f0 0x7f30b00559b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f30bc00b000 tx=0x7f30bc009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:43.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.236+0000 7f30c8ff9700 1 -- 172.21.2.105:0/4138678251 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f30b4043dd0 con 0x7f30cc0ad080 2021-11-12T05:48:43.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:43.320+0000 7f30d1fb7700 1 -- 172.21.2.105:0/4138678251 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f30cc0b1440 con 0x7f30cc0ad080 2021-11-12T05:48:44.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.168+0000 7f30c8ff9700 1 -- 172.21.2.105:0/4138678251 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v120) v1 ==== 185+0+0 (secure 0 0 0) 0x7f30b40473f0 con 0x7f30cc0ad080 2021-11-12T05:48:44.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.172+0000 7f30d1fb7700 1 -- 172.21.2.105:0/4138678251 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f30b00534f0 msgr2=0x7f30b00559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:44.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.172+0000 7f30d1fb7700 1 --2- 172.21.2.105:0/4138678251 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f30b00534f0 0x7f30b00559b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f30bc00b000 tx=0x7f30bc009040).stop 2021-11-12T05:48:44.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.172+0000 7f30d1fb7700 1 -- 172.21.2.105:0/4138678251 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f30cc0ad080 msgr2=0x7f30cc1572d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:44.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.172+0000 7f30d1fb7700 1 --2- 172.21.2.105:0/4138678251 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f30cc0ad080 0x7f30cc1572d0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7f30cc0b0eb0 tx=0x7f30b4015000).stop 2021-11-12T05:48:44.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.172+0000 7f30d1fb7700 1 -- 172.21.2.105:0/4138678251 shutdown_connections 2021-11-12T05:48:44.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.172+0000 7f30d1fb7700 1 --2- 172.21.2.105:0/4138678251 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f30b00534f0 0x7f30b00559b0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:44.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.172+0000 7f30d1fb7700 1 --2- 172.21.2.105:0/4138678251 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f30cc0af730 0x7f30cc0a7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:44.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.172+0000 7f30d1fb7700 1 --2- 172.21.2.105:0/4138678251 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f30cc0ad080 0x7f30cc1572d0 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:44.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.172+0000 7f30d1fb7700 1 --2- 172.21.2.105:0/4138678251 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f30cc0ac280 0x7f30cc0a9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:44.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.172+0000 7f30d1fb7700 1 -- 172.21.2.105:0/4138678251 >> 172.21.2.105:0/4138678251 conn(0x7f30cc0b5370 msgr2=0x7f30cc143dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:44.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.172+0000 7f30d1fb7700 1 -- 172.21.2.105:0/4138678251 shutdown_connections 2021-11-12T05:48:44.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.172+0000 7f30d1fb7700 1 -- 172.21.2.105:0/4138678251 wait complete. 2021-11-12T05:48:44.179 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_metadata' removed 2021-11-12T05:48:44.182 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-12T05:48:44.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.232+0000 7f22eb746700 1 Processor -- start 2021-11-12T05:48:44.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.232+0000 7f22eb746700 1 -- start start 2021-11-12T05:48:44.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.232+0000 7f22eb746700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f22e40af750 0x7f22e4062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:44.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.232+0000 7f22eb746700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f22e4130a80 0x7f22e41474d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:44.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.232+0000 7f22eb746700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22e40b0d50 con 0x7f22e40626b0 2021-11-12T05:48:44.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.232+0000 7f22eb746700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22e40ad380 con 0x7f22e4130a80 2021-11-12T05:48:44.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.232+0000 7f22eb746700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e40ae190 con 0x7f22e40af750 2021-11-12T05:48:44.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.232+0000 7f22e9ce3700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f22e4130a80 0x7f22e41474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:44.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.232+0000 7f22e9ce3700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f22e4130a80 0x7f22e41474d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50844/0 (socket says 172.21.2.105:50844) 2021-11-12T05:48:44.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.232+0000 7f22e9ce3700 1 -- 172.21.2.105:0/3968351845 learned_addr learned my addr 172.21.2.105:0/3968351845 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:44.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.232+0000 7f22e9ce3700 1 -- 172.21.2.105:0/3968351845 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f22e40af750 msgr2=0x7f22e4062a90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:48:44.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.232+0000 7f22e9ce3700 1 --2- 172.21.2.105:0/3968351845 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f22e40af750 0x7f22e4062a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:44.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.232+0000 7f22e9ce3700 1 -- 172.21.2.105:0/3968351845 >> v1:172.21.2.115:6789/0 conn(0x7f22e40626b0 legacy=0x7f22e4130370 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:48:44.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.232+0000 7f22e9ce3700 1 -- 172.21.2.105:0/3968351845 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e41479c0 con 0x7f22e4130a80 2021-11-12T05:48:44.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.232+0000 7f22e9ce3700 1 --2- 172.21.2.105:0/3968351845 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f22e4130a80 0x7f22e41474d0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7f22e40af1d0 tx=0x7f22dc009290).ready entity=mon.0 client_cookie=b29b2f820a2e05f9 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:44.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.232+0000 7f22d3fff700 1 -- 172.21.2.105:0/3968351845 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22dc00b860 con 0x7f22e4130a80 2021-11-12T05:48:44.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.232+0000 7f22d3fff700 1 -- 172.21.2.105:0/3968351845 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22dc00b9c0 con 0x7f22e4130a80 2021-11-12T05:48:44.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.232+0000 7f22d3fff700 1 -- 172.21.2.105:0/3968351845 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22dc00bb70 con 0x7f22e4130a80 2021-11-12T05:48:44.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.232+0000 7f22eb746700 1 -- 172.21.2.105:0/3968351845 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f22e4130a80 msgr2=0x7f22e41474d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:44.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.232+0000 7f22eb746700 1 --2- 172.21.2.105:0/3968351845 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f22e4130a80 0x7f22e41474d0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7f22e40af1d0 tx=0x7f22dc009290).stop 2021-11-12T05:48:44.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.232+0000 7f22eb746700 1 -- 172.21.2.105:0/3968351845 shutdown_connections 2021-11-12T05:48:44.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.232+0000 7f22eb746700 1 --2- 172.21.2.105:0/3968351845 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f22e4130a80 0x7f22e41474d0 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:44.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.232+0000 7f22eb746700 1 --2- 172.21.2.105:0/3968351845 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f22e40af750 0x7f22e4062a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:44.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.232+0000 7f22eb746700 1 -- 172.21.2.105:0/3968351845 >> 172.21.2.105:0/3968351845 conn(0x7f22e40b5320 msgr2=0x7f22e40b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:44.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.232+0000 7f22eb746700 1 -- 172.21.2.105:0/3968351845 shutdown_connections 2021-11-12T05:48:44.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.232+0000 7f22eb746700 1 -- 172.21.2.105:0/3968351845 wait complete. 2021-11-12T05:48:44.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.236+0000 7f22eb746700 1 Processor -- start 2021-11-12T05:48:44.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.236+0000 7f22eb746700 1 -- start start 2021-11-12T05:48:44.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.236+0000 7f22eb746700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f22e40626b0 0x7f22e40b3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:44.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.236+0000 7f22eb746700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f22e40af750 0x7f22e41452f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:44.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.236+0000 7f22eb746700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f22e4130a80 0x7f22e40666d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:44.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.236+0000 7f22eb746700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e40654c0 con 0x7f22e40626b0 2021-11-12T05:48:44.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.236+0000 7f22eb746700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e4066000 con 0x7f22e40af750 2021-11-12T05:48:44.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.236+0000 7f22eb746700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e4064a80 con 0x7f22e4130a80 2021-11-12T05:48:44.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.236+0000 7f22e94e2700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f22e40626b0 0x7f22e40b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:44.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.236+0000 7f22e94e2700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f22e40626b0 0x7f22e40b3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50848/0 (socket says 172.21.2.105:50848) 2021-11-12T05:48:44.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.236+0000 7f22e94e2700 1 -- 172.21.2.105:0/4012415015 learned_addr learned my addr 172.21.2.105:0/4012415015 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:44.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.236+0000 7f22e94e2700 1 -- 172.21.2.105:0/4012415015 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f22e4130a80 msgr2=0x7f22e40666d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:48:44.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.236+0000 7f22e94e2700 1 --2- 172.21.2.105:0/4012415015 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f22e4130a80 0x7f22e40666d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:44.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.236+0000 7f22e94e2700 1 -- 172.21.2.105:0/4012415015 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f22e40af750 msgr2=0x7f22e41452f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:48:44.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.236+0000 7f22e94e2700 1 --2- 172.21.2.105:0/4012415015 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f22e40af750 0x7f22e41452f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:44.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.236+0000 7f22e94e2700 1 -- 172.21.2.105:0/4012415015 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22dc009530 con 0x7f22e40626b0 2021-11-12T05:48:44.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.236+0000 7f22e94e2700 1 --2- 172.21.2.105:0/4012415015 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f22e40626b0 0x7f22e40b3490 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 rx=0x7f22e0002fb0 tx=0x7f22e0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:44.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.236+0000 7f22d27fc700 1 -- 172.21.2.105:0/4012415015 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22e0013460 con 0x7f22e40626b0 2021-11-12T05:48:44.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.236+0000 7f22d27fc700 1 -- 172.21.2.105:0/4012415015 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e00135c0 con 0x7f22e40626b0 2021-11-12T05:48:44.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.236+0000 7f22eb746700 1 -- 172.21.2.105:0/4012415015 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e4066230 con 0x7f22e40626b0 2021-11-12T05:48:44.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.236+0000 7f22eb746700 1 -- 172.21.2.105:0/4012415015 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22e41457e0 con 0x7f22e40626b0 2021-11-12T05:48:44.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.236+0000 7f22d27fc700 1 -- 172.21.2.105:0/4012415015 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22e0013920 con 0x7f22e40626b0 2021-11-12T05:48:44.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.236+0000 7f22eb746700 1 -- 172.21.2.105:0/4012415015 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22e4057350 con 0x7f22e40626b0 2021-11-12T05:48:44.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.236+0000 7f22d27fc700 1 -- 172.21.2.105:0/4012415015 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f22e000f070 con 0x7f22e40626b0 2021-11-12T05:48:44.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.236+0000 7f22d27fc700 1 --2- 172.21.2.105:0/4012415015 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f22c40536f0 0x7f22c4055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:44.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.236+0000 7f22d27fc700 1 -- 172.21.2.105:0/4012415015 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6064+0+0 (secure 0 0 0) 0x7f22e006b460 con 0x7f22e40626b0 2021-11-12T05:48:44.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.236+0000 7f22e8ce1700 1 --2- 172.21.2.105:0/4012415015 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f22c40536f0 0x7f22c4055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:44.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.236+0000 7f22e8ce1700 1 --2- 172.21.2.105:0/4012415015 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f22c40536f0 0x7f22c4055bb0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f22d4002fb0 tx=0x7f22d4006930).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:44.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.240+0000 7f22d27fc700 1 -- 172.21.2.105:0/4012415015 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f22e00424c0 con 0x7f22e40626b0 2021-11-12T05:48:44.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:44.324+0000 7f22eb746700 1 -- 172.21.2.105:0/4012415015 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f22e405d9a0 con 0x7f22e40626b0 2021-11-12T05:48:45.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:45.184+0000 7f22d27fc700 1 -- 172.21.2.105:0/4012415015 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v121) v1 ==== 133+0+0 (secure 0 0 0) 0x7f22e0045ae0 con 0x7f22e40626b0 2021-11-12T05:48:45.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:45.188+0000 7f22eb746700 1 -- 172.21.2.105:0/4012415015 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f22c40536f0 msgr2=0x7f22c4055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:45.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:45.188+0000 7f22eb746700 1 --2- 172.21.2.105:0/4012415015 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f22c40536f0 0x7f22c4055bb0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f22d4002fb0 tx=0x7f22d4006930).stop 2021-11-12T05:48:45.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:45.188+0000 7f22eb746700 1 -- 172.21.2.105:0/4012415015 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f22e40626b0 msgr2=0x7f22e40b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:45.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:45.188+0000 7f22eb746700 1 --2- 172.21.2.105:0/4012415015 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f22e40626b0 0x7f22e40b3490 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 rx=0x7f22e0002fb0 tx=0x7f22e0006df0).stop 2021-11-12T05:48:45.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:45.188+0000 7f22eb746700 1 -- 172.21.2.105:0/4012415015 shutdown_connections 2021-11-12T05:48:45.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:45.188+0000 7f22eb746700 1 --2- 172.21.2.105:0/4012415015 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f22c40536f0 0x7f22c4055bb0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:45.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:45.188+0000 7f22eb746700 1 --2- 172.21.2.105:0/4012415015 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f22e4130a80 0x7f22e40666d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:45.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:45.188+0000 7f22eb746700 1 --2- 172.21.2.105:0/4012415015 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f22e40af750 0x7f22e41452f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:45.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:45.188+0000 7f22eb746700 1 --2- 172.21.2.105:0/4012415015 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f22e40626b0 0x7f22e40b3490 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:45.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:45.188+0000 7f22eb746700 1 -- 172.21.2.105:0/4012415015 >> 172.21.2.105:0/4012415015 conn(0x7f22e40b5320 msgr2=0x7f22e40afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:45.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:45.188+0000 7f22eb746700 1 -- 172.21.2.105:0/4012415015 shutdown_connections 2021-11-12T05:48:45.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:45.188+0000 7f22eb746700 1 -- 172.21.2.105:0/4012415015 wait complete. 2021-11-12T05:48:45.196 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_metadata' created 2021-11-12T05:48:45.199 DEBUG:teuthology.orchestra.run.gibba016:> sudo rados -p cephfs_metadata put key /etc/fstab 2021-11-12T05:48:45.224 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cd625b80 1 Processor -- start 2021-11-12T05:48:45.225 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cd625b80 1 -- start start 2021-11-12T05:48:45.225 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cd625b80 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x55fcfa7f4dd0 0x55fcfa805320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:45.225 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cd625b80 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x55fcfa7f58c0 0x55fcfa805810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:45.226 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cd625b80 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x55fcfa808110 0x55fcfa805d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:45.226 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cd625b80 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcfa6f7e70 con 0x55fcfa7f4dd0 2021-11-12T05:48:45.226 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cd625b80 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcfa6e8460 con 0x55fcfa808110 2021-11-12T05:48:45.226 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cd625b80 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fcfa811e80 con 0x55fcfa7f58c0 2021-11-12T05:48:45.227 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cb262700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x55fcfa7f58c0 0x55fcfa805810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:45.227 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cc264700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x55fcfa808110 0x55fcfa805d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:45.227 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cb262700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x55fcfa7f58c0 0x55fcfa805810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3301/0 says I am v2:172.21.2.116:47464/0 (socket says 172.21.2.116:47464) 2021-11-12T05:48:45.227 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cb262700 1 -- 172.21.2.116:0/4074810367 learned_addr learned my addr 172.21.2.116:0/4074810367 (peer_addr_for_me v2:172.21.2.116:0/0) 2021-11-12T05:48:45.232 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cba63700 1 --2- 172.21.2.116:0/4074810367 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x55fcfa7f4dd0 0x55fcfa805320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:45.236 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cb262700 1 -- 172.21.2.116:0/4074810367 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x55fcfa808110 msgr2=0x55fcfa805d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:45.236 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cb262700 1 --2- 172.21.2.116:0/4074810367 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x55fcfa808110 0x55fcfa805d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:45.236 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cb262700 1 -- 172.21.2.116:0/4074810367 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x55fcfa7f4dd0 msgr2=0x55fcfa805320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:45.236 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cb262700 1 --2- 172.21.2.116:0/4074810367 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x55fcfa7f4dd0 0x55fcfa805320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:45.237 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cb262700 1 -- 172.21.2.116:0/4074810367 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4bc005cd0 con 0x55fcfa7f58c0 2021-11-12T05:48:45.237 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cb262700 1 --2- 172.21.2.116:0/4074810367 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x55fcfa7f58c0 0x55fcfa805810 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x55fcfa807940 tx=0x7fa4bc015000).ready entity=mon.2 client_cookie=c2310ee5bcd11685 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:45.237 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4c9a5f700 1 -- 172.21.2.116:0/4074810367 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4bc008890 con 0x55fcfa7f58c0 2021-11-12T05:48:45.237 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4c9a5f700 1 -- 172.21.2.116:0/4074810367 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4bc0089f0 con 0x55fcfa7f58c0 2021-11-12T05:48:45.238 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4c9a5f700 1 -- 172.21.2.116:0/4074810367 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4bc008d50 con 0x55fcfa7f58c0 2021-11-12T05:48:45.238 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cd625b80 1 -- 172.21.2.116:0/4074810367 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x55fcfa7f58c0 msgr2=0x55fcfa805810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:45.238 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cd625b80 1 --2- 172.21.2.116:0/4074810367 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x55fcfa7f58c0 0x55fcfa805810 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x55fcfa807940 tx=0x7fa4bc015000).stop 2021-11-12T05:48:45.238 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cd625b80 1 -- 172.21.2.116:0/4074810367 shutdown_connections 2021-11-12T05:48:45.238 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cd625b80 1 --2- 172.21.2.116:0/4074810367 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x55fcfa808110 0x55fcfa805d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:45.239 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cd625b80 1 --2- 172.21.2.116:0/4074810367 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x55fcfa7f58c0 0x55fcfa805810 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:45.239 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cd625b80 1 --2- 172.21.2.116:0/4074810367 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x55fcfa7f4dd0 0x55fcfa805320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:45.239 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cd625b80 1 -- 172.21.2.116:0/4074810367 >> 172.21.2.116:0/4074810367 conn(0x55fcfa7f0b70 msgr2=0x55fcfa803c00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:45.239 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cd625b80 1 -- 172.21.2.116:0/4074810367 shutdown_connections 2021-11-12T05:48:45.240 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cd625b80 1 -- 172.21.2.116:0/4074810367 wait complete. 2021-11-12T05:48:45.240 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cd625b80 1 Processor -- start 2021-11-12T05:48:45.240 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cd625b80 1 -- start start 2021-11-12T05:48:45.240 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cd625b80 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x55fcfa7f4dd0 0x55fcfa7fa550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:45.240 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cd625b80 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x55fcfa7f58c0 0x55fcfa7f5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:45.241 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cd625b80 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x55fcfa808110 0x55fcfa7f6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:45.241 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cd625b80 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcfa809fc0 con 0x55fcfa7f4dd0 2021-11-12T05:48:45.241 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cd625b80 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcfa7f6810 con 0x55fcfa7f58c0 2021-11-12T05:48:45.241 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cd625b80 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fcfa7f69a0 con 0x55fcfa808110 2021-11-12T05:48:45.242 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cc264700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x55fcfa808110 0x55fcfa7f6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:45.242 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cc264700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x55fcfa808110 0x55fcfa7f6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3301/0 says I am v2:172.21.2.116:47474/0 (socket says 172.21.2.116:47474) 2021-11-12T05:48:45.242 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cc264700 1 -- 172.21.2.116:0/1946944671 learned_addr learned my addr 172.21.2.116:0/1946944671 (peer_addr_for_me v2:172.21.2.116:0/0) 2021-11-12T05:48:45.242 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cb262700 1 --2- 172.21.2.116:0/1946944671 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x55fcfa7f58c0 0x55fcfa7f5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:45.243 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.221+0000 7fa4cba63700 1 --2- 172.21.2.116:0/1946944671 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x55fcfa7f4dd0 0x55fcfa7fa550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:45.243 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.225+0000 7fa4cc264700 1 -- 172.21.2.116:0/1946944671 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x55fcfa7f58c0 msgr2=0x55fcfa7f5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:45.243 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.225+0000 7fa4cc264700 1 --2- 172.21.2.116:0/1946944671 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x55fcfa7f58c0 0x55fcfa7f5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:45.243 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.225+0000 7fa4cc264700 1 -- 172.21.2.116:0/1946944671 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x55fcfa7f4dd0 msgr2=0x55fcfa7fa550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:45.243 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.225+0000 7fa4cc264700 1 --2- 172.21.2.116:0/1946944671 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x55fcfa7f4dd0 0x55fcfa7fa550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:45.244 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.225+0000 7fa4cc264700 1 -- 172.21.2.116:0/1946944671 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fcfa70cb00 con 0x55fcfa808110 2021-11-12T05:48:45.244 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.225+0000 7fa4cc264700 1 --2- 172.21.2.116:0/1946944671 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x55fcfa808110 0x55fcfa7f6320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fa4c400c000 tx=0x7fa4c4008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:45.244 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.225+0000 7fa4c925e700 1 -- 172.21.2.116:0/1946944671 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4c40062c0 con 0x55fcfa808110 2021-11-12T05:48:45.244 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.225+0000 7fa4cd625b80 1 -- 172.21.2.116:0/1946944671 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fcfa6e0fe0 con 0x55fcfa808110 2021-11-12T05:48:45.245 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.225+0000 7fa4cd625b80 1 -- 172.21.2.116:0/1946944671 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fcfa8195c0 con 0x55fcfa808110 2021-11-12T05:48:45.245 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.225+0000 7fa4c925e700 1 -- 172.21.2.116:0/1946944671 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c4004520 con 0x55fcfa808110 2021-11-12T05:48:45.245 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.225+0000 7fa4c925e700 1 -- 172.21.2.116:0/1946944671 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4c4004880 con 0x55fcfa808110 2021-11-12T05:48:45.245 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.225+0000 7fa4c925e700 1 -- 172.21.2.116:0/1946944671 <== mon.2 v2:172.21.2.115:3301/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa4c4019030 con 0x55fcfa808110 2021-11-12T05:48:45.245 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.225+0000 7fa4c925e700 1 --2- 172.21.2.116:0/1946944671 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa4ac052190 0x7fa4ac054650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:45.246 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.225+0000 7fa4c925e700 1 -- 172.21.2.116:0/1946944671 <== mon.2 v2:172.21.2.115:3301/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6418+0+0 (secure 0 0 0) 0x7fa4c406a270 con 0x55fcfa808110 2021-11-12T05:48:45.246 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.229+0000 7fa4cd625b80 1 --2- 172.21.2.116:0/1946944671 >> [v2:172.21.2.105:6802/14874,v1:172.21.2.105:6803/14874] conn(0x55fcfa81a300 0x55fcfa81c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:45.246 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.229+0000 7fa4cd625b80 1 -- 172.21.2.116:0/1946944671 --> [v2:172.21.2.105:6802/14874,v1:172.21.2.105:6803/14874] -- osd_op(unknown.0.0:1 23.0 23:0620e6f9:::key:head [writefull 0~617 in=617b] snapc 0=[] ondisk+write+known_if_redirected e121) v8 -- 0x55fcfa81cc80 con 0x55fcfa81a300 2021-11-12T05:48:45.247 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.229+0000 7fa4cba63700 1 --2- 172.21.2.116:0/1946944671 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa4ac052190 0x7fa4ac054650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:45.247 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.229+0000 7fa4cb262700 1 --2- 172.21.2.116:0/1946944671 >> [v2:172.21.2.105:6802/14874,v1:172.21.2.105:6803/14874] conn(0x55fcfa81a300 0x55fcfa81c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:45.247 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.229+0000 7fa4cb262700 1 --2- 172.21.2.116:0/1946944671 >> [v2:172.21.2.105:6802/14874,v1:172.21.2.105:6803/14874] conn(0x55fcfa81a300 0x55fcfa81c6f0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:45.247 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:45.229+0000 7fa4cba63700 1 --2- 172.21.2.116:0/1946944671 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa4ac052190 0x7fa4ac054650 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7fa4b400c000 tx=0x7fa4b4000bc0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:46.351 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:46.349+0000 7fa4c925e700 1 -- 172.21.2.116:0/1946944671 <== osd.0 v2:172.21.2.105:6802/14874 1 ==== osd_map(122..122 src has 1..122) v4 ==== 320+0+0 (crc 0 0 0) 0x7fa4bc008b60 con 0x55fcfa81a300 2021-11-12T05:48:46.357 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:46.357+0000 7fa4cb262700 1 -- 172.21.2.116:0/1946944671 <== osd.0 v2:172.21.2.105:6802/14874 2 ==== osd_op_reply(1 key [writefull 0~617] v122'1 uv1 ondisk = 0) v8 ==== 147+0+0 (crc 0 0 0) 0x7fa4bc025040 con 0x55fcfa81a300 2021-11-12T05:48:46.358 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:46.357+0000 7fa4cd625b80 1 -- 172.21.2.116:0/1946944671 >> [v2:172.21.2.105:6802/14874,v1:172.21.2.105:6803/14874] conn(0x55fcfa81a300 msgr2=0x55fcfa81c6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:46.358 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:46.357+0000 7fa4cd625b80 1 --2- 172.21.2.116:0/1946944671 >> [v2:172.21.2.105:6802/14874,v1:172.21.2.105:6803/14874] conn(0x55fcfa81a300 0x55fcfa81c6f0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:46.359 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:46.357+0000 7fa4cd625b80 1 -- 172.21.2.116:0/1946944671 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa4ac052190 msgr2=0x7fa4ac054650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:46.360 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:46.357+0000 7fa4cd625b80 1 --2- 172.21.2.116:0/1946944671 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa4ac052190 0x7fa4ac054650 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7fa4b400c000 tx=0x7fa4b4000bc0).stop 2021-11-12T05:48:46.360 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:46.357+0000 7fa4cd625b80 1 -- 172.21.2.116:0/1946944671 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x55fcfa808110 msgr2=0x55fcfa7f6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:46.360 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:46.357+0000 7fa4cd625b80 1 --2- 172.21.2.116:0/1946944671 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x55fcfa808110 0x55fcfa7f6320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fa4c400c000 tx=0x7fa4c4008040).stop 2021-11-12T05:48:46.360 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:46.357+0000 7fa4cc264700 1 -- 172.21.2.116:0/1946944671 reap_dead start 2021-11-12T05:48:46.361 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:46.357+0000 7fa4cd625b80 1 -- 172.21.2.116:0/1946944671 shutdown_connections 2021-11-12T05:48:46.361 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:46.357+0000 7fa4cd625b80 1 -- 172.21.2.116:0/1946944671 >> 172.21.2.116:0/1946944671 conn(0x55fcfa7f0b70 msgr2=0x55fcfa805530 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:46.361 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:46.357+0000 7fa4cd625b80 1 -- 172.21.2.116:0/1946944671 shutdown_connections 2021-11-12T05:48:46.361 INFO:teuthology.orchestra.run.gibba016.stderr:2021-11-12T05:48:46.357+0000 7fa4cd625b80 1 -- 172.21.2.116:0/1946944671 wait complete. 2021-11-12T05:48:46.367 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2021-11-12T05:48:46.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b23141700 1 Processor -- start 2021-11-12T05:48:46.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b23141700 1 -- start start 2021-11-12T05:48:46.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b23141700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f0b1c0aca40 0x7f0b1c0ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:46.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b23141700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0b1c144180 0x7f0b1c144610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:46.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b23141700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b1c0b1840 con 0x7f0b1c0b0520 2021-11-12T05:48:46.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b23141700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b1c0b09d0 con 0x7f0b1c0aca40 2021-11-12T05:48:46.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b23141700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1c0af2b0 con 0x7f0b1c144180 2021-11-12T05:48:46.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b20edd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f0b1c0aca40 0x7f0b1c0ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:46.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b20edd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f0b1c0aca40 0x7f0b1c0ace20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50856/0 (socket says 172.21.2.105:50856) 2021-11-12T05:48:46.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b20edd700 1 -- 172.21.2.105:0/2755735857 learned_addr learned my addr 172.21.2.105:0/2755735857 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:46.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b1bfff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f0b1c0b0520 0x7f0b1c1473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:33020/0 (socket says 172.21.2.105:33020) 2021-11-12T05:48:46.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b20edd700 1 -- 172.21.2.105:0/2755735857 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0b1c144180 msgr2=0x7f0b1c144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:46.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b20edd700 1 --2- 172.21.2.105:0/2755735857 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0b1c144180 0x7f0b1c144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:46.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b20edd700 1 -- 172.21.2.105:0/2755735857 >> v1:172.21.2.105:6789/0 conn(0x7f0b1c0b0520 legacy=0x7f0b1c1473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:46.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b20edd700 1 -- 172.21.2.105:0/2755735857 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b1c0b1a70 con 0x7f0b1c0aca40 2021-11-12T05:48:46.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b20edd700 1 --2- 172.21.2.105:0/2755735857 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0b1c0aca40 0x7f0b1c0ace20 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7f0b0c002f70 tx=0x7f0b0c006eb0).ready entity=mon.0 client_cookie=c62e90169d3485c7 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:46.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b1b7fe700 1 -- 172.21.2.105:0/2755735857 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b0c00d5c0 con 0x7f0b1c0aca40 2021-11-12T05:48:46.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b1b7fe700 1 -- 172.21.2.105:0/2755735857 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0c000e90 con 0x7f0b1c0aca40 2021-11-12T05:48:46.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b1b7fe700 1 -- 172.21.2.105:0/2755735857 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b0c00d950 con 0x7f0b1c0aca40 2021-11-12T05:48:46.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b23141700 1 -- 172.21.2.105:0/2755735857 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0b1c0aca40 msgr2=0x7f0b1c0ace20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:46.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b23141700 1 --2- 172.21.2.105:0/2755735857 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0b1c0aca40 0x7f0b1c0ace20 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7f0b0c002f70 tx=0x7f0b0c006eb0).stop 2021-11-12T05:48:46.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b23141700 1 -- 172.21.2.105:0/2755735857 shutdown_connections 2021-11-12T05:48:46.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b23141700 1 --2- 172.21.2.105:0/2755735857 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0b1c144180 0x7f0b1c144610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:46.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b23141700 1 --2- 172.21.2.105:0/2755735857 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0b1c0aca40 0x7f0b1c0ace20 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:46.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b23141700 1 -- 172.21.2.105:0/2755735857 >> 172.21.2.105:0/2755735857 conn(0x7f0b1c05c490 msgr2=0x7f0b1c0b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:46.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b23141700 1 -- 172.21.2.105:0/2755735857 shutdown_connections 2021-11-12T05:48:46.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b23141700 1 -- 172.21.2.105:0/2755735857 wait complete. 2021-11-12T05:48:46.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b23141700 1 Processor -- start 2021-11-12T05:48:46.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b23141700 1 -- start start 2021-11-12T05:48:46.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b23141700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0b1c0aca40 0x7f0b1c147e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:46.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b23141700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0b1c0b0520 0x7f0b1c1415c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:46.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b23141700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0b1c144180 0x7f0b1c064520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:46.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b23141700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1c147590 con 0x7f0b1c0aca40 2021-11-12T05:48:46.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b23141700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1c066b20 con 0x7f0b1c144180 2021-11-12T05:48:46.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b23141700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1c0665e0 con 0x7f0b1c0b0520 2021-11-12T05:48:46.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b20edd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0b1c0aca40 0x7f0b1c147e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:46.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b20edd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0b1c0aca40 0x7f0b1c147e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50860/0 (socket says 172.21.2.105:50860) 2021-11-12T05:48:46.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b20edd700 1 -- 172.21.2.105:0/3819967923 learned_addr learned my addr 172.21.2.105:0/3819967923 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:46.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b20edd700 1 -- 172.21.2.105:0/3819967923 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0b1c0b0520 msgr2=0x7f0b1c1415c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:46.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b20edd700 1 --2- 172.21.2.105:0/3819967923 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0b1c0b0520 0x7f0b1c1415c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:46.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b20edd700 1 -- 172.21.2.105:0/3819967923 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0b1c144180 msgr2=0x7f0b1c064520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:46.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b20edd700 1 --2- 172.21.2.105:0/3819967923 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0b1c144180 0x7f0b1c064520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:46.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.416+0000 7f0b20edd700 1 -- 172.21.2.105:0/3819967923 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b0c00b1e0 con 0x7f0b1c0aca40 2021-11-12T05:48:46.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.420+0000 7f0b20edd700 1 --2- 172.21.2.105:0/3819967923 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0b1c0aca40 0x7f0b1c147e30 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 rx=0x7f0b0c002f70 tx=0x7f0b0c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:46.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.420+0000 7f0b19ffb700 1 -- 172.21.2.105:0/3819967923 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b0c006b60 con 0x7f0b1c0aca40 2021-11-12T05:48:46.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.420+0000 7f0b19ffb700 1 -- 172.21.2.105:0/3819967923 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0c011ce0 con 0x7f0b1c0aca40 2021-11-12T05:48:46.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.420+0000 7f0b19ffb700 1 -- 172.21.2.105:0/3819967923 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b0c01e650 con 0x7f0b1c0aca40 2021-11-12T05:48:46.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.420+0000 7f0b23141700 1 -- 172.21.2.105:0/3819967923 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b1c066880 con 0x7f0b1c0aca40 2021-11-12T05:48:46.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.420+0000 7f0b23141700 1 -- 172.21.2.105:0/3819967923 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b1c066d10 con 0x7f0b1c0aca40 2021-11-12T05:48:46.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.420+0000 7f0b23141700 1 -- 172.21.2.105:0/3819967923 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b1c062460 con 0x7f0b1c0aca40 2021-11-12T05:48:46.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.420+0000 7f0b19ffb700 1 -- 172.21.2.105:0/3819967923 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0b0c025030 con 0x7f0b1c0aca40 2021-11-12T05:48:46.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.420+0000 7f0b19ffb700 1 --2- 172.21.2.105:0/3819967923 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0afc0536a0 0x7f0afc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:46.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.420+0000 7f0b19ffb700 1 -- 172.21.2.105:0/3819967923 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6418+0+0 (secure 0 0 0) 0x7f0b0c06ceb0 con 0x7f0b1c0aca40 2021-11-12T05:48:46.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.420+0000 7f0b1bfff700 1 --2- 172.21.2.105:0/3819967923 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0afc0536a0 0x7f0afc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:46.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.420+0000 7f0b1bfff700 1 --2- 172.21.2.105:0/3819967923 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0afc0536a0 0x7f0afc055b60 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f0b1c061140 tx=0x7f0b10007800).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:46.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.420+0000 7f0b19ffb700 1 -- 172.21.2.105:0/3819967923 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0b0c043eb0 con 0x7f0b1c0aca40 2021-11-12T05:48:46.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.532+0000 7f0b23141700 1 -- 172.21.2.105:0/3819967923 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7f0b1c05f280 con 0x7f0b1c0aca40 2021-11-12T05:48:46.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.532+0000 7f0b19ffb700 1 -- 172.21.2.105:0/3819967923 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1906 (secure 0 0 0) 0x7f0b0c023020 con 0x7f0b1c0aca40 2021-11-12T05:48:46.538 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:46.538 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:48:46.539 INFO:teuthology.orchestra.run.gibba005.stdout: "stats": { 2021-11-12T05:48:46.539 INFO:teuthology.orchestra.run.gibba005.stdout: "total_bytes": 773094113280, 2021-11-12T05:48:46.539 INFO:teuthology.orchestra.run.gibba005.stdout: "total_avail_bytes": 764492292096, 2021-11-12T05:48:46.539 INFO:teuthology.orchestra.run.gibba005.stdout: "total_used_bytes": 11886592, 2021-11-12T05:48:46.540 INFO:teuthology.orchestra.run.gibba005.stdout: "total_used_raw_bytes": 8601821184, 2021-11-12T05:48:46.540 INFO:teuthology.orchestra.run.gibba005.stdout: "total_used_raw_ratio": 0.011126486584544182, 2021-11-12T05:48:46.540 INFO:teuthology.orchestra.run.gibba005.stdout: "num_osds": 8, 2021-11-12T05:48:46.540 INFO:teuthology.orchestra.run.gibba005.stdout: "num_per_pool_osds": 8, 2021-11-12T05:48:46.541 INFO:teuthology.orchestra.run.gibba005.stdout: "num_per_pool_omap_osds": 8 2021-11-12T05:48:46.541 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:46.541 INFO:teuthology.orchestra.run.gibba005.stdout: "stats_by_class": { 2021-11-12T05:48:46.541 INFO:teuthology.orchestra.run.gibba005.stdout: "ssd": { 2021-11-12T05:48:46.542 INFO:teuthology.orchestra.run.gibba005.stdout: "total_bytes": 773094113280, 2021-11-12T05:48:46.542 INFO:teuthology.orchestra.run.gibba005.stdout: "total_avail_bytes": 764492292096, 2021-11-12T05:48:46.542 INFO:teuthology.orchestra.run.gibba005.stdout: "total_used_bytes": 11886592, 2021-11-12T05:48:46.542 INFO:teuthology.orchestra.run.gibba005.stdout: "total_used_raw_bytes": 8601821184, 2021-11-12T05:48:46.543 INFO:teuthology.orchestra.run.gibba005.stdout: "total_used_raw_ratio": 0.011126486584544182 2021-11-12T05:48:46.543 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:46.543 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:46.543 INFO:teuthology.orchestra.run.gibba005.stdout: "pools": [ 2021-11-12T05:48:46.544 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:46.544 INFO:teuthology.orchestra.run.gibba005.stdout: "name": "device_health_metrics", 2021-11-12T05:48:46.544 INFO:teuthology.orchestra.run.gibba005.stdout: "id": 1, 2021-11-12T05:48:46.544 INFO:teuthology.orchestra.run.gibba005.stdout: "stats": { 2021-11-12T05:48:46.545 INFO:teuthology.orchestra.run.gibba005.stdout: "stored": 0, 2021-11-12T05:48:46.545 INFO:teuthology.orchestra.run.gibba005.stdout: "objects": 2, 2021-11-12T05:48:46.545 INFO:teuthology.orchestra.run.gibba005.stdout: "kb_used": 0, 2021-11-12T05:48:46.545 INFO:teuthology.orchestra.run.gibba005.stdout: "bytes_used": 0, 2021-11-12T05:48:46.545 INFO:teuthology.orchestra.run.gibba005.stdout: "percent_used": 0, 2021-11-12T05:48:46.546 INFO:teuthology.orchestra.run.gibba005.stdout: "max_avail": 362918608896 2021-11-12T05:48:46.546 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:46.546 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:46.546 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:46.547 INFO:teuthology.orchestra.run.gibba005.stdout: "name": "rbd", 2021-11-12T05:48:46.547 INFO:teuthology.orchestra.run.gibba005.stdout: "id": 2, 2021-11-12T05:48:46.547 INFO:teuthology.orchestra.run.gibba005.stdout: "stats": { 2021-11-12T05:48:46.547 INFO:teuthology.orchestra.run.gibba005.stdout: "stored": 0, 2021-11-12T05:48:46.548 INFO:teuthology.orchestra.run.gibba005.stdout: "objects": 0, 2021-11-12T05:48:46.548 INFO:teuthology.orchestra.run.gibba005.stdout: "kb_used": 0, 2021-11-12T05:48:46.548 INFO:teuthology.orchestra.run.gibba005.stdout: "bytes_used": 0, 2021-11-12T05:48:46.548 INFO:teuthology.orchestra.run.gibba005.stdout: "percent_used": 0, 2021-11-12T05:48:46.549 INFO:teuthology.orchestra.run.gibba005.stdout: "max_avail": 362918608896 2021-11-12T05:48:46.549 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:46.549 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:46.549 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:46.550 INFO:teuthology.orchestra.run.gibba005.stdout: "name": "cephfs_data", 2021-11-12T05:48:46.550 INFO:teuthology.orchestra.run.gibba005.stdout: "id": 22, 2021-11-12T05:48:46.550 INFO:teuthology.orchestra.run.gibba005.stdout: "stats": { 2021-11-12T05:48:46.551 INFO:teuthology.orchestra.run.gibba005.stdout: "stored": 0, 2021-11-12T05:48:46.551 INFO:teuthology.orchestra.run.gibba005.stdout: "objects": 0, 2021-11-12T05:48:46.551 INFO:teuthology.orchestra.run.gibba005.stdout: "kb_used": 0, 2021-11-12T05:48:46.551 INFO:teuthology.orchestra.run.gibba005.stdout: "bytes_used": 0, 2021-11-12T05:48:46.552 INFO:teuthology.orchestra.run.gibba005.stdout: "percent_used": 0, 2021-11-12T05:48:46.552 INFO:teuthology.orchestra.run.gibba005.stdout: "max_avail": 362918608896 2021-11-12T05:48:46.552 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:46.552 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:46.553 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:46.553 INFO:teuthology.orchestra.run.gibba005.stdout: "name": "cephfs_metadata", 2021-11-12T05:48:46.553 INFO:teuthology.orchestra.run.gibba005.stdout: "id": 23, 2021-11-12T05:48:46.553 INFO:teuthology.orchestra.run.gibba005.stdout: "stats": { 2021-11-12T05:48:46.554 INFO:teuthology.orchestra.run.gibba005.stdout: "stored": 0, 2021-11-12T05:48:46.554 INFO:teuthology.orchestra.run.gibba005.stdout: "objects": 0, 2021-11-12T05:48:46.554 INFO:teuthology.orchestra.run.gibba005.stdout: "kb_used": 0, 2021-11-12T05:48:46.554 INFO:teuthology.orchestra.run.gibba005.stdout: "bytes_used": 0, 2021-11-12T05:48:46.555 INFO:teuthology.orchestra.run.gibba005.stdout: "percent_used": 0, 2021-11-12T05:48:46.555 INFO:teuthology.orchestra.run.gibba005.stdout: "max_avail": 362918608896 2021-11-12T05:48:46.555 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:46.555 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:46.556 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:46.556 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:48:46.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.532+0000 7f0b23141700 1 -- 172.21.2.105:0/3819967923 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0afc0536a0 msgr2=0x7f0afc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:46.558 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.532+0000 7f0b23141700 1 --2- 172.21.2.105:0/3819967923 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0afc0536a0 0x7f0afc055b60 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f0b1c061140 tx=0x7f0b10007800).stop 2021-11-12T05:48:46.558 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.532+0000 7f0b23141700 1 -- 172.21.2.105:0/3819967923 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0b1c0aca40 msgr2=0x7f0b1c147e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:46.558 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.532+0000 7f0b23141700 1 --2- 172.21.2.105:0/3819967923 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0b1c0aca40 0x7f0b1c147e30 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 rx=0x7f0b0c002f70 tx=0x7f0b0c015000).stop 2021-11-12T05:48:46.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.532+0000 7f0b23141700 1 -- 172.21.2.105:0/3819967923 shutdown_connections 2021-11-12T05:48:46.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.532+0000 7f0b23141700 1 --2- 172.21.2.105:0/3819967923 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0afc0536a0 0x7f0afc055b60 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:46.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.532+0000 7f0b23141700 1 --2- 172.21.2.105:0/3819967923 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0b1c144180 0x7f0b1c064520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:46.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.532+0000 7f0b23141700 1 --2- 172.21.2.105:0/3819967923 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0b1c0b0520 0x7f0b1c1415c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:46.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.532+0000 7f0b23141700 1 --2- 172.21.2.105:0/3819967923 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0b1c0aca40 0x7f0b1c147e30 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:46.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.532+0000 7f0b23141700 1 -- 172.21.2.105:0/3819967923 >> 172.21.2.105:0/3819967923 conn(0x7f0b1c05c490 msgr2=0x7f0b1c0b5100 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:46.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.532+0000 7f0b23141700 1 -- 172.21.2.105:0/3819967923 shutdown_connections 2021-11-12T05:48:46.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:46.532+0000 7f0b23141700 1 -- 172.21.2.105:0/3819967923 wait complete. 2021-11-12T05:48:46.561 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30)... 2021-11-12T05:48:51.562 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2021-11-12T05:48:51.626 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.612+0000 7fc0832c5700 1 Processor -- start 2021-11-12T05:48:51.627 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.612+0000 7fc0832c5700 1 -- start start 2021-11-12T05:48:51.627 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.612+0000 7fc0832c5700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fc07c0b0520 0x7fc07c144890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:51.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.612+0000 7fc0832c5700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc07c0b1840 con 0x7fc07c0aca40 2021-11-12T05:48:51.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.612+0000 7fc0832c5700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc07c0af2b0 con 0x7fc07c0ace20 2021-11-12T05:48:51.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.612+0000 7fc0832c5700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc07c0b0990 con 0x7fc07c0b0520 2021-11-12T05:48:51.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.612+0000 7fc081061700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fc07c0aca40 0x7fc07c1473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:33032/0 (socket says 172.21.2.105:33032) 2021-11-12T05:48:51.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.612+0000 7fc081061700 1 -- 172.21.2.105:0/32299463 learned_addr learned my addr 172.21.2.105:0/32299463 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:51.630 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.612+0000 7fc06ffff700 1 -- 172.21.2.105:0/32299463 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2048220152 0 0) 0x7fc07c0b1840 con 0x7fc07c0aca40 2021-11-12T05:48:51.630 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.612+0000 7fc06ffff700 1 -- 172.21.2.105:0/32299463 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc064003260 con 0x7fc07c0aca40 2021-11-12T05:48:51.630 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.612+0000 7fc06ffff700 1 -- 172.21.2.105:0/32299463 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3422614287 0 0) 0x7fc064003260 con 0x7fc07c0aca40 2021-11-12T05:48:51.631 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.612+0000 7fc06ffff700 1 -- 172.21.2.105:0/32299463 >> v2:172.21.2.115:3300/0 conn(0x7fc07c0b0520 msgr2=0x7fc07c144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:51.631 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.612+0000 7fc06ffff700 1 --2- 172.21.2.105:0/32299463 >> v2:172.21.2.115:3300/0 conn(0x7fc07c0b0520 0x7fc07c144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:51.631 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.612+0000 7fc06ffff700 1 -- 172.21.2.105:0/32299463 >> v1:172.21.2.115:6789/0 conn(0x7fc07c0ace20 legacy=0x7fc07c144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:51.632 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.612+0000 7fc06ffff700 1 -- 172.21.2.105:0/32299463 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07c144d80 con 0x7fc07c0aca40 2021-11-12T05:48:51.632 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.612+0000 7fc06ffff700 1 -- 172.21.2.105:0/32299463 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fc078001660 con 0x7fc07c0aca40 2021-11-12T05:48:51.632 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.612+0000 7fc06ffff700 1 -- 172.21.2.105:0/32299463 >> v1:172.21.2.105:6789/0 conn(0x7fc07c0aca40 legacy=0x7fc07c1473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:51.632 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.612+0000 7fc06ffff700 1 --2- 172.21.2.105:0/32299463 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc064003820 0x7fc064003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:51.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.612+0000 7fc06ffff700 1 --2- 172.21.2.105:0/32299463 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc064004500 0x7fc064004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:51.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.612+0000 7fc06ffff700 1 --2- 172.21.2.105:0/32299463 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc064005050 0x7fc06400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:51.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.612+0000 7fc06ffff700 1 -- 172.21.2.105:0/32299463 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c0b0990 con 0x7fc064004500 2021-11-12T05:48:51.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.612+0000 7fc06ffff700 1 -- 172.21.2.105:0/32299463 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06400bf40 con 0x7fc064005050 2021-11-12T05:48:51.634 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.612+0000 7fc06ffff700 1 -- 172.21.2.105:0/32299463 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc06400c100 con 0x7fc064003820 2021-11-12T05:48:51.634 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.612+0000 7fc080860700 1 --2- 172.21.2.105:0/32299463 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc064004500 0x7fc064004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:51.635 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc080860700 1 -- 172.21.2.105:0/32299463 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc064003820 msgr2=0x7fc064003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:51.635 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc080860700 1 --2- 172.21.2.105:0/32299463 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc064003820 0x7fc064003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:51.635 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc080860700 1 -- 172.21.2.105:0/32299463 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc064005050 msgr2=0x7fc06400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:51.636 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc080860700 1 --2- 172.21.2.105:0/32299463 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc064005050 0x7fc06400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:51.636 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc080860700 1 -- 172.21.2.105:0/32299463 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc064003260 con 0x7fc064004500 2021-11-12T05:48:51.636 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc081862700 1 -- 172.21.2.105:0/32299463 reap_dead start 2021-11-12T05:48:51.636 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc080860700 1 --2- 172.21.2.105:0/32299463 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc064004500 0x7fc064004980 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 rx=0x7fc070000f70 tx=0x7fc0700079e0).ready entity=mon.0 client_cookie=2aa3538ce6f7fccb server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:51.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc06ffff700 1 -- 172.21.2.105:0/32299463 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc070007cf0 con 0x7fc064004500 2021-11-12T05:48:51.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc06ffff700 1 -- 172.21.2.105:0/32299463 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc070014410 con 0x7fc064004500 2021-11-12T05:48:51.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc06ffff700 1 -- 172.21.2.105:0/32299463 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc070014770 con 0x7fc064004500 2021-11-12T05:48:51.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc0832c5700 1 -- 172.21.2.105:0/32299463 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc064004500 msgr2=0x7fc064004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:51.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc0832c5700 1 --2- 172.21.2.105:0/32299463 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc064004500 0x7fc064004980 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 rx=0x7fc070000f70 tx=0x7fc0700079e0).stop 2021-11-12T05:48:51.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc0832c5700 1 -- 172.21.2.105:0/32299463 shutdown_connections 2021-11-12T05:48:51.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc0832c5700 1 --2- 172.21.2.105:0/32299463 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc064004500 0x7fc064004980 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:51.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc0832c5700 1 -- 172.21.2.105:0/32299463 >> 172.21.2.105:0/32299463 conn(0x7fc07c05c490 msgr2=0x7fc07c0b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:51.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc0832c5700 1 -- 172.21.2.105:0/32299463 shutdown_connections 2021-11-12T05:48:51.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc0832c5700 1 -- 172.21.2.105:0/32299463 wait complete. 2021-11-12T05:48:51.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc0832c5700 1 Processor -- start 2021-11-12T05:48:51.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc0832c5700 1 -- start start 2021-11-12T05:48:51.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc0832c5700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc064004500 0x7fc07c159c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:51.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc0832c5700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc07c0a7510 0x7fc07c0a8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:51.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc0832c5700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc07c063b70 0x7fc07c15a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:51.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc0832c5700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c0a90a0 con 0x7fc07c063b70 2021-11-12T05:48:51.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc0832c5700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c066590 con 0x7fc07c0a7510 2021-11-12T05:48:51.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc0832c5700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c0667c0 con 0x7fc064004500 2021-11-12T05:48:51.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc081862700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc07c063b70 0x7fc07c15a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:51.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc081862700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc07c063b70 0x7fc07c15a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50884/0 (socket says 172.21.2.105:50884) 2021-11-12T05:48:51.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc081862700 1 -- 172.21.2.105:0/2025154206 learned_addr learned my addr 172.21.2.105:0/2025154206 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:51.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc080860700 1 --2- 172.21.2.105:0/2025154206 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc07c0a7510 0x7fc07c0a8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:51.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc081061700 1 --2- 172.21.2.105:0/2025154206 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc064004500 0x7fc07c159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:51.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc081862700 1 -- 172.21.2.105:0/2025154206 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc064004500 msgr2=0x7fc07c159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:51.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc081862700 1 --2- 172.21.2.105:0/2025154206 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc064004500 0x7fc07c159c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:51.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc081862700 1 -- 172.21.2.105:0/2025154206 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc07c0a7510 msgr2=0x7fc07c0a8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:51.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc081862700 1 --2- 172.21.2.105:0/2025154206 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc07c0a7510 0x7fc07c0a8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:51.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc081862700 1 -- 172.21.2.105:0/2025154206 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07c066a60 con 0x7fc07c063b70 2021-11-12T05:48:51.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc081862700 1 --2- 172.21.2.105:0/2025154206 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc07c063b70 0x7fc07c15a2b0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 rx=0x7fc07c066350 tx=0x7fc074007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:51.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc06e7fc700 1 -- 172.21.2.105:0/2025154206 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc074005a20 con 0x7fc07c063b70 2021-11-12T05:48:51.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc06e7fc700 1 -- 172.21.2.105:0/2025154206 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc074005b80 con 0x7fc07c063b70 2021-11-12T05:48:51.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc06e7fc700 1 -- 172.21.2.105:0/2025154206 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0740070d0 con 0x7fc07c063b70 2021-11-12T05:48:51.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc0832c5700 1 -- 172.21.2.105:0/2025154206 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc07c063ff0 con 0x7fc07c063b70 2021-11-12T05:48:51.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc0832c5700 1 -- 172.21.2.105:0/2025154206 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc07c15a940 con 0x7fc07c063b70 2021-11-12T05:48:51.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.616+0000 7fc0832c5700 1 -- 172.21.2.105:0/2025154206 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc07c057350 con 0x7fc07c063b70 2021-11-12T05:48:51.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.620+0000 7fc06e7fc700 1 -- 172.21.2.105:0/2025154206 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc07401d070 con 0x7fc07c063b70 2021-11-12T05:48:51.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.620+0000 7fc06e7fc700 1 --2- 172.21.2.105:0/2025154206 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc05c053610 0x7fc05c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:51.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.620+0000 7fc06e7fc700 1 -- 172.21.2.105:0/2025154206 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6418+0+0 (secure 0 0 0) 0x7fc07406ad60 con 0x7fc07c063b70 2021-11-12T05:48:51.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.620+0000 7fc081061700 1 --2- 172.21.2.105:0/2025154206 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc05c053610 0x7fc05c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:51.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.620+0000 7fc081061700 1 --2- 172.21.2.105:0/2025154206 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc05c053610 0x7fc05c055ad0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7fc078008000 tx=0x7fc078009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:51.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.620+0000 7fc06e7fc700 1 -- 172.21.2.105:0/2025154206 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc074041c50 con 0x7fc07c063b70 2021-11-12T05:48:51.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.732+0000 7fc0832c5700 1 -- 172.21.2.105:0/2025154206 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7fc07c05f280 con 0x7fc07c063b70 2021-11-12T05:48:51.738 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.732+0000 7fc06e7fc700 1 -- 172.21.2.105:0/2025154206 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1932 (secure 0 0 0) 0x7fc074045270 con 0x7fc07c063b70 2021-11-12T05:48:51.738 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:51.738 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:48:51.739 INFO:teuthology.orchestra.run.gibba005.stdout: "stats": { 2021-11-12T05:48:51.739 INFO:teuthology.orchestra.run.gibba005.stdout: "total_bytes": 773094113280, 2021-11-12T05:48:51.739 INFO:teuthology.orchestra.run.gibba005.stdout: "total_avail_bytes": 764491874304, 2021-11-12T05:48:51.740 INFO:teuthology.orchestra.run.gibba005.stdout: "total_used_bytes": 12304384, 2021-11-12T05:48:51.740 INFO:teuthology.orchestra.run.gibba005.stdout: "total_used_raw_bytes": 8602238976, 2021-11-12T05:48:51.740 INFO:teuthology.orchestra.run.gibba005.stdout: "total_used_raw_ratio": 0.011127026751637459, 2021-11-12T05:48:51.740 INFO:teuthology.orchestra.run.gibba005.stdout: "num_osds": 8, 2021-11-12T05:48:51.740 INFO:teuthology.orchestra.run.gibba005.stdout: "num_per_pool_osds": 8, 2021-11-12T05:48:51.741 INFO:teuthology.orchestra.run.gibba005.stdout: "num_per_pool_omap_osds": 8 2021-11-12T05:48:51.741 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:51.741 INFO:teuthology.orchestra.run.gibba005.stdout: "stats_by_class": { 2021-11-12T05:48:51.741 INFO:teuthology.orchestra.run.gibba005.stdout: "ssd": { 2021-11-12T05:48:51.742 INFO:teuthology.orchestra.run.gibba005.stdout: "total_bytes": 773094113280, 2021-11-12T05:48:51.742 INFO:teuthology.orchestra.run.gibba005.stdout: "total_avail_bytes": 764491874304, 2021-11-12T05:48:51.742 INFO:teuthology.orchestra.run.gibba005.stdout: "total_used_bytes": 12304384, 2021-11-12T05:48:51.742 INFO:teuthology.orchestra.run.gibba005.stdout: "total_used_raw_bytes": 8602238976, 2021-11-12T05:48:51.743 INFO:teuthology.orchestra.run.gibba005.stdout: "total_used_raw_ratio": 0.011127026751637459 2021-11-12T05:48:51.743 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:51.743 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:51.743 INFO:teuthology.orchestra.run.gibba005.stdout: "pools": [ 2021-11-12T05:48:51.743 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:51.744 INFO:teuthology.orchestra.run.gibba005.stdout: "name": "device_health_metrics", 2021-11-12T05:48:51.744 INFO:teuthology.orchestra.run.gibba005.stdout: "id": 1, 2021-11-12T05:48:51.744 INFO:teuthology.orchestra.run.gibba005.stdout: "stats": { 2021-11-12T05:48:51.744 INFO:teuthology.orchestra.run.gibba005.stdout: "stored": 0, 2021-11-12T05:48:51.745 INFO:teuthology.orchestra.run.gibba005.stdout: "objects": 2, 2021-11-12T05:48:51.745 INFO:teuthology.orchestra.run.gibba005.stdout: "kb_used": 0, 2021-11-12T05:48:51.745 INFO:teuthology.orchestra.run.gibba005.stdout: "bytes_used": 0, 2021-11-12T05:48:51.745 INFO:teuthology.orchestra.run.gibba005.stdout: "percent_used": 0, 2021-11-12T05:48:51.746 INFO:teuthology.orchestra.run.gibba005.stdout: "max_avail": 362918543360 2021-11-12T05:48:51.746 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:51.746 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:51.746 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:51.747 INFO:teuthology.orchestra.run.gibba005.stdout: "name": "rbd", 2021-11-12T05:48:51.747 INFO:teuthology.orchestra.run.gibba005.stdout: "id": 2, 2021-11-12T05:48:51.748 INFO:teuthology.orchestra.run.gibba005.stdout: "stats": { 2021-11-12T05:48:51.748 INFO:teuthology.orchestra.run.gibba005.stdout: "stored": 0, 2021-11-12T05:48:51.748 INFO:teuthology.orchestra.run.gibba005.stdout: "objects": 0, 2021-11-12T05:48:51.749 INFO:teuthology.orchestra.run.gibba005.stdout: "kb_used": 0, 2021-11-12T05:48:51.749 INFO:teuthology.orchestra.run.gibba005.stdout: "bytes_used": 0, 2021-11-12T05:48:51.750 INFO:teuthology.orchestra.run.gibba005.stdout: "percent_used": 0, 2021-11-12T05:48:51.750 INFO:teuthology.orchestra.run.gibba005.stdout: "max_avail": 362918543360 2021-11-12T05:48:51.751 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:51.751 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:51.751 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:51.752 INFO:teuthology.orchestra.run.gibba005.stdout: "name": "cephfs_data", 2021-11-12T05:48:51.752 INFO:teuthology.orchestra.run.gibba005.stdout: "id": 22, 2021-11-12T05:48:51.753 INFO:teuthology.orchestra.run.gibba005.stdout: "stats": { 2021-11-12T05:48:51.753 INFO:teuthology.orchestra.run.gibba005.stdout: "stored": 0, 2021-11-12T05:48:51.754 INFO:teuthology.orchestra.run.gibba005.stdout: "objects": 0, 2021-11-12T05:48:51.754 INFO:teuthology.orchestra.run.gibba005.stdout: "kb_used": 0, 2021-11-12T05:48:51.755 INFO:teuthology.orchestra.run.gibba005.stdout: "bytes_used": 0, 2021-11-12T05:48:51.755 INFO:teuthology.orchestra.run.gibba005.stdout: "percent_used": 0, 2021-11-12T05:48:51.755 INFO:teuthology.orchestra.run.gibba005.stdout: "max_avail": 362918543360 2021-11-12T05:48:51.756 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:51.756 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:51.757 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:51.757 INFO:teuthology.orchestra.run.gibba005.stdout: "name": "cephfs_metadata", 2021-11-12T05:48:51.757 INFO:teuthology.orchestra.run.gibba005.stdout: "id": 23, 2021-11-12T05:48:51.758 INFO:teuthology.orchestra.run.gibba005.stdout: "stats": { 2021-11-12T05:48:51.758 INFO:teuthology.orchestra.run.gibba005.stdout: "stored": 617, 2021-11-12T05:48:51.759 INFO:teuthology.orchestra.run.gibba005.stdout: "objects": 1, 2021-11-12T05:48:51.759 INFO:teuthology.orchestra.run.gibba005.stdout: "kb_used": 8, 2021-11-12T05:48:51.760 INFO:teuthology.orchestra.run.gibba005.stdout: "bytes_used": 8192, 2021-11-12T05:48:51.760 INFO:teuthology.orchestra.run.gibba005.stdout: "percent_used": 1.1286279466560245e-08, 2021-11-12T05:48:51.760 INFO:teuthology.orchestra.run.gibba005.stdout: "max_avail": 362918543360 2021-11-12T05:48:51.761 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:51.761 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:51.762 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:51.762 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:48:51.765 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.732+0000 7fc0832c5700 1 -- 172.21.2.105:0/2025154206 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc05c053610 msgr2=0x7fc05c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:51.766 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.732+0000 7fc0832c5700 1 --2- 172.21.2.105:0/2025154206 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc05c053610 0x7fc05c055ad0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7fc078008000 tx=0x7fc078009040).stop 2021-11-12T05:48:51.766 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.732+0000 7fc0832c5700 1 -- 172.21.2.105:0/2025154206 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc07c063b70 msgr2=0x7fc07c15a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:51.767 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.732+0000 7fc0832c5700 1 --2- 172.21.2.105:0/2025154206 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc07c063b70 0x7fc07c15a2b0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 rx=0x7fc07c066350 tx=0x7fc074007f90).stop 2021-11-12T05:48:51.767 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.732+0000 7fc0832c5700 1 -- 172.21.2.105:0/2025154206 shutdown_connections 2021-11-12T05:48:51.767 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.732+0000 7fc0832c5700 1 --2- 172.21.2.105:0/2025154206 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc05c053610 0x7fc05c055ad0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:51.768 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.732+0000 7fc0832c5700 1 --2- 172.21.2.105:0/2025154206 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc07c063b70 0x7fc07c15a2b0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:51.768 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.732+0000 7fc0832c5700 1 --2- 172.21.2.105:0/2025154206 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc07c0a7510 0x7fc07c0a8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:51.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.732+0000 7fc0832c5700 1 --2- 172.21.2.105:0/2025154206 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc064004500 0x7fc07c159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:51.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.732+0000 7fc0832c5700 1 -- 172.21.2.105:0/2025154206 >> 172.21.2.105:0/2025154206 conn(0x7fc07c05c490 msgr2=0x7fc07c144390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:51.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.732+0000 7fc0832c5700 1 -- 172.21.2.105:0/2025154206 shutdown_connections 2021-11-12T05:48:51.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.732+0000 7fc0832c5700 1 -- 172.21.2.105:0/2025154206 wait complete. 2021-11-12T05:48:51.771 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s 2021-11-12T05:48:51.772 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2021-11-12T05:48:51.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.820+0000 7fec2b1da700 1 Processor -- start 2021-11-12T05:48:51.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.820+0000 7fec2b1da700 1 -- start start 2021-11-12T05:48:51.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.820+0000 7fec2b1da700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fec240aca40 0x7fec240ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:51.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.820+0000 7fec2b1da700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fec240b0520 0x7fec241473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:51.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.820+0000 7fec2b1da700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec240b1840 con 0x7fec241478b0 2021-11-12T05:48:51.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.820+0000 7fec2b1da700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec24147d40 con 0x7fec240b0520 2021-11-12T05:48:51.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.820+0000 7fec2b1da700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec240af2b0 con 0x7fec240aca40 2021-11-12T05:48:51.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.824+0000 7fec23fff700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fec240b0520 0x7fec241473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:51.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.824+0000 7fec29777700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7fec241478b0 0x7fec24144180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:59756/0 (socket says 172.21.2.105:59756) 2021-11-12T05:48:51.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.824+0000 7fec28f76700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fec240aca40 0x7fec240ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:51.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.824+0000 7fec29777700 1 -- 172.21.2.105:0/3030569169 learned_addr learned my addr 172.21.2.105:0/3030569169 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:51.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.824+0000 7fec23fff700 1 -- 172.21.2.105:0/3030569169 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fec240aca40 msgr2=0x7fec240ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:51.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.824+0000 7fec23fff700 1 --2- 172.21.2.105:0/3030569169 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fec240aca40 0x7fec240ace20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:51.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.824+0000 7fec23fff700 1 -- 172.21.2.105:0/3030569169 >> v1:172.21.2.115:6789/0 conn(0x7fec241478b0 legacy=0x7fec24144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:51.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.824+0000 7fec23fff700 1 -- 172.21.2.105:0/3030569169 --> v2:172.21.2.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec240b09a0 con 0x7fec240b0520 2021-11-12T05:48:51.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.824+0000 7fec23fff700 1 --2- 172.21.2.105:0/3030569169 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fec240b0520 0x7fec241473c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fec0c002f70 tx=0x7fec0c006df0).ready entity=mon.1 client_cookie=6f77c5c102d2a75f server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:51.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.824+0000 7fec237fe700 1 -- 172.21.2.105:0/3030569169 <== mon.1 v2:172.21.2.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec0c00d570 con 0x7fec240b0520 2021-11-12T05:48:51.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.824+0000 7fec237fe700 1 -- 172.21.2.105:0/3030569169 <== mon.1 v2:172.21.2.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0c000e90 con 0x7fec240b0520 2021-11-12T05:48:51.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.824+0000 7fec237fe700 1 -- 172.21.2.105:0/3030569169 <== mon.1 v2:172.21.2.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec0c00d8c0 con 0x7fec240b0520 2021-11-12T05:48:51.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.824+0000 7fec2b1da700 1 -- 172.21.2.105:0/3030569169 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fec240b0520 msgr2=0x7fec241473c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:51.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.824+0000 7fec2b1da700 1 --2- 172.21.2.105:0/3030569169 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fec240b0520 0x7fec241473c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fec0c002f70 tx=0x7fec0c006df0).stop 2021-11-12T05:48:51.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.824+0000 7fec2b1da700 1 -- 172.21.2.105:0/3030569169 shutdown_connections 2021-11-12T05:48:51.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.824+0000 7fec2b1da700 1 --2- 172.21.2.105:0/3030569169 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fec240b0520 0x7fec241473c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:51.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.824+0000 7fec2b1da700 1 --2- 172.21.2.105:0/3030569169 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fec240aca40 0x7fec240ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:51.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.824+0000 7fec2b1da700 1 -- 172.21.2.105:0/3030569169 >> 172.21.2.105:0/3030569169 conn(0x7fec2405c490 msgr2=0x7fec240b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:51.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.824+0000 7fec2b1da700 1 -- 172.21.2.105:0/3030569169 shutdown_connections 2021-11-12T05:48:51.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.824+0000 7fec2b1da700 1 -- 172.21.2.105:0/3030569169 wait complete. 2021-11-12T05:48:51.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.824+0000 7fec2b1da700 1 Processor -- start 2021-11-12T05:48:51.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.824+0000 7fec2b1da700 1 -- start start 2021-11-12T05:48:51.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.828+0000 7fec2b1da700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fec240aca40 0x7fec24159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:51.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.828+0000 7fec2b1da700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fec240b0520 0x7fec240648d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:51.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.828+0000 7fec2b1da700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fec241478b0 0x7fec240a8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:51.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.828+0000 7fec2b1da700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec240a7f50 con 0x7fec241478b0 2021-11-12T05:48:51.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.828+0000 7fec2b1da700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec240ab080 con 0x7fec240aca40 2021-11-12T05:48:51.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.828+0000 7fec2b1da700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec24067230 con 0x7fec240b0520 2021-11-12T05:48:51.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.828+0000 7fec29777700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fec241478b0 0x7fec240a8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:51.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.828+0000 7fec29777700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fec241478b0 0x7fec240a8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50898/0 (socket says 172.21.2.105:50898) 2021-11-12T05:48:51.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.828+0000 7fec29777700 1 -- 172.21.2.105:0/139415845 learned_addr learned my addr 172.21.2.105:0/139415845 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:51.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.828+0000 7fec23fff700 1 --2- 172.21.2.105:0/139415845 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fec240b0520 0x7fec240648d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:51.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.828+0000 7fec28f76700 1 --2- 172.21.2.105:0/139415845 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fec240aca40 0x7fec24159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:51.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.828+0000 7fec29777700 1 -- 172.21.2.105:0/139415845 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fec240b0520 msgr2=0x7fec240648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:51.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.828+0000 7fec29777700 1 --2- 172.21.2.105:0/139415845 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fec240b0520 0x7fec240648d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:51.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.828+0000 7fec29777700 1 -- 172.21.2.105:0/139415845 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fec240aca40 msgr2=0x7fec24159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:51.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.828+0000 7fec29777700 1 --2- 172.21.2.105:0/139415845 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fec240aca40 0x7fec24159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:51.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.828+0000 7fec29777700 1 -- 172.21.2.105:0/139415845 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0c00b180 con 0x7fec241478b0 2021-11-12T05:48:51.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.828+0000 7fec29777700 1 --2- 172.21.2.105:0/139415845 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fec241478b0 0x7fec240a8630 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7fec240b00d0 tx=0x7fec1c007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:51.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.828+0000 7fec21ffb700 1 -- 172.21.2.105:0/139415845 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec1c005ba0 con 0x7fec241478b0 2021-11-12T05:48:51.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.828+0000 7fec21ffb700 1 -- 172.21.2.105:0/139415845 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec1c005d00 con 0x7fec241478b0 2021-11-12T05:48:51.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.828+0000 7fec2b1da700 1 -- 172.21.2.105:0/139415845 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec240a7530 con 0x7fec241478b0 2021-11-12T05:48:51.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.828+0000 7fec21ffb700 1 -- 172.21.2.105:0/139415845 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec1c0072c0 con 0x7fec241478b0 2021-11-12T05:48:51.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.828+0000 7fec2b1da700 1 -- 172.21.2.105:0/139415845 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec240a71c0 con 0x7fec241478b0 2021-11-12T05:48:51.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.828+0000 7fec2b1da700 1 -- 172.21.2.105:0/139415845 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec24057350 con 0x7fec241478b0 2021-11-12T05:48:51.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.828+0000 7fec21ffb700 1 -- 172.21.2.105:0/139415845 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fec1c010070 con 0x7fec241478b0 2021-11-12T05:48:51.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.828+0000 7fec21ffb700 1 --2- 172.21.2.105:0/139415845 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fec08053660 0x7fec08055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:51.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.828+0000 7fec21ffb700 1 -- 172.21.2.105:0/139415845 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6418+0+0 (secure 0 0 0) 0x7fec1c06b360 con 0x7fec241478b0 2021-11-12T05:48:51.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.828+0000 7fec28f76700 1 --2- 172.21.2.105:0/139415845 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fec08053660 0x7fec08055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:51.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.828+0000 7fec28f76700 1 --2- 172.21.2.105:0/139415845 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fec08053660 0x7fec08055b20 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7fec1400b000 tx=0x7fec14008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:51.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.832+0000 7fec21ffb700 1 -- 172.21.2.105:0/139415845 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fec1c042360 con 0x7fec241478b0 2021-11-12T05:48:51.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.940+0000 7fec2b1da700 1 -- 172.21.2.105:0/139415845 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fec2405f280 con 0x7fec241478b0 2021-11-12T05:48:51.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.940+0000 7fec21ffb700 1 -- 172.21.2.105:0/139415845 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=-22 pool 'cephfs_metadata' already contains some objects. Use an empty pool instead. v57) v1 ==== 209+0+0 (secure 0 0 0) 0x7fec1c045980 con 0x7fec241478b0 2021-11-12T05:48:51.945 INFO:teuthology.orchestra.run.gibba005.stderr:Error EINVAL: pool 'cephfs_metadata' already contains some objects. Use an empty pool instead. 2021-11-12T05:48:51.947 DEBUG:teuthology.orchestra.run:got remote process result: 22 2021-11-12T05:48:51.948 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-12T05:48:52.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.996+0000 7f82e6709700 1 Processor -- start 2021-11-12T05:48:52.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.996+0000 7f82e6709700 1 -- start start 2021-11-12T05:48:52.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.996+0000 7f82e6709700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f82e00ad080 0x7f82e00af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:52.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.996+0000 7f82e6709700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f82e00ac280 0x7f82e00ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:52.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.996+0000 7f82e6709700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f82e014abe0 0x7f82e014b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:52.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.996+0000 7f82e6709700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82e01488a0 con 0x7f82e00ad080 2021-11-12T05:48:52.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.996+0000 7f82e6709700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82e00ac7b0 con 0x7f82e00ac280 2021-11-12T05:48:52.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.996+0000 7f82e6709700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e00ac9e0 con 0x7f82e014abe0 2021-11-12T05:48:52.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.996+0000 7f82dffff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f82e00ad080 0x7f82e00af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:52.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.996+0000 7f82dffff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f82e00ad080 0x7f82e00af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50902/0 (socket says 172.21.2.105:50902) 2021-11-12T05:48:52.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.996+0000 7f82dffff700 1 -- 172.21.2.105:0/2979539876 learned_addr learned my addr 172.21.2.105:0/2979539876 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:52.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.996+0000 7f82dffff700 1 -- 172.21.2.105:0/2979539876 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f82e014abe0 msgr2=0x7f82e014b090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:48:52.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.996+0000 7f82dffff700 1 --2- 172.21.2.105:0/2979539876 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f82e014abe0 0x7f82e014b090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:52.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.996+0000 7f82dffff700 1 -- 172.21.2.105:0/2979539876 >> v2:172.21.2.115:3300/0 conn(0x7f82e00ac280 msgr2=0x7f82e00ad460 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:48:52.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.996+0000 7f82dffff700 1 --2- 172.21.2.105:0/2979539876 >> v2:172.21.2.115:3300/0 conn(0x7f82e00ac280 0x7f82e00ad460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:52.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.996+0000 7f82dffff700 1 -- 172.21.2.105:0/2979539876 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e00b0b30 con 0x7f82e00ad080 2021-11-12T05:48:52.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.996+0000 7f82dffff700 1 --2- 172.21.2.105:0/2979539876 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f82e00ad080 0x7f82e00af730 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7f82e00ac6a0 tx=0x7f82c8006eb0).ready entity=mon.0 client_cookie=1d03aa934359288d server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:52.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:51.996+0000 7f82deffd700 1 -- 172.21.2.105:0/2979539876 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82c800d570 con 0x7f82e00ad080 2021-11-12T05:48:52.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82deffd700 1 -- 172.21.2.105:0/2979539876 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c8000e90 con 0x7f82e00ad080 2021-11-12T05:48:52.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82deffd700 1 -- 172.21.2.105:0/2979539876 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82c800d8c0 con 0x7f82e00ad080 2021-11-12T05:48:52.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82e6709700 1 -- 172.21.2.105:0/2979539876 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f82e00ad080 msgr2=0x7f82e00af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:52.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82e6709700 1 --2- 172.21.2.105:0/2979539876 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f82e00ad080 0x7f82e00af730 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7f82e00ac6a0 tx=0x7f82c8006eb0).stop 2021-11-12T05:48:52.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82e6709700 1 -- 172.21.2.105:0/2979539876 shutdown_connections 2021-11-12T05:48:52.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82e6709700 1 --2- 172.21.2.105:0/2979539876 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f82e014abe0 0x7f82e014b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:52.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82e6709700 1 --2- 172.21.2.105:0/2979539876 >> v2:172.21.2.115:3300/0 conn(0x7f82e00ac280 0x7f82e00ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:52.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82e6709700 1 --2- 172.21.2.105:0/2979539876 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f82e00ad080 0x7f82e00af730 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:52.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82e6709700 1 -- 172.21.2.105:0/2979539876 >> 172.21.2.105:0/2979539876 conn(0x7f82e00b5370 msgr2=0x7f82e00b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:52.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82e6709700 1 -- 172.21.2.105:0/2979539876 shutdown_connections 2021-11-12T05:48:52.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82e6709700 1 -- 172.21.2.105:0/2979539876 wait complete. 2021-11-12T05:48:52.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82e6709700 1 Processor -- start 2021-11-12T05:48:52.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82e6709700 1 -- start start 2021-11-12T05:48:52.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82e6709700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f82e00ac280 0x7f82e00aab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:52.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82e6709700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f82e00ad080 0x7f82e00ab3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:52.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82e6709700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f82e014abe0 0x7f82e00668e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:52.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82e6709700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e00a9fc0 con 0x7f82e014abe0 2021-11-12T05:48:52.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82e6709700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e00ab8b0 con 0x7f82e00ad080 2021-11-12T05:48:52.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82e6709700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e00a9960 con 0x7f82e00ac280 2021-11-12T05:48:52.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82e4ca6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f82e014abe0 0x7f82e00668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:52.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82e4ca6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f82e014abe0 0x7f82e00668e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50908/0 (socket says 172.21.2.105:50908) 2021-11-12T05:48:52.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82e4ca6700 1 -- 172.21.2.105:0/997071111 learned_addr learned my addr 172.21.2.105:0/997071111 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:52.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82e4ca6700 1 -- 172.21.2.105:0/997071111 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f82e00ac280 msgr2=0x7f82e00aab60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:48:52.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82e4ca6700 1 --2- 172.21.2.105:0/997071111 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f82e00ac280 0x7f82e00aab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:52.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82e4ca6700 1 -- 172.21.2.105:0/997071111 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f82e00ad080 msgr2=0x7f82e00ab3c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:48:52.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82e4ca6700 1 --2- 172.21.2.105:0/997071111 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f82e00ad080 0x7f82e00ab3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:52.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82e4ca6700 1 -- 172.21.2.105:0/997071111 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c800b1e0 con 0x7f82e014abe0 2021-11-12T05:48:52.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82e4ca6700 1 --2- 172.21.2.105:0/997071111 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f82e014abe0 0x7f82e00668e0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7f82d8001250 tx=0x7f82d80090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:52.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82dd7fa700 1 -- 172.21.2.105:0/997071111 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82d80014e0 con 0x7f82e014abe0 2021-11-12T05:48:52.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82dd7fa700 1 -- 172.21.2.105:0/997071111 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d8001640 con 0x7f82e014abe0 2021-11-12T05:48:52.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82e6709700 1 -- 172.21.2.105:0/997071111 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e00a9c80 con 0x7f82e014abe0 2021-11-12T05:48:52.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82dd7fa700 1 -- 172.21.2.105:0/997071111 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82d80019a0 con 0x7f82e014abe0 2021-11-12T05:48:52.018 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82e6709700 1 -- 172.21.2.105:0/997071111 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e0064160 con 0x7f82e014abe0 2021-11-12T05:48:52.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82e6709700 1 -- 172.21.2.105:0/997071111 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e00aa1c0 con 0x7f82e014abe0 2021-11-12T05:48:52.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82dd7fa700 1 -- 172.21.2.105:0/997071111 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f82d8018030 con 0x7f82e014abe0 2021-11-12T05:48:52.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82dd7fa700 1 --2- 172.21.2.105:0/997071111 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f82c4053660 0x7f82c4055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:52.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82dd7fa700 1 -- 172.21.2.105:0/997071111 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6418+0+0 (secure 0 0 0) 0x7f82d806b3e0 con 0x7f82e014abe0 2021-11-12T05:48:52.019 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82dffff700 1 --2- 172.21.2.105:0/997071111 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f82c4053660 0x7f82c4055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:52.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.000+0000 7f82dffff700 1 --2- 172.21.2.105:0/997071111 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f82c4053660 0x7f82c4055b20 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f82e00ac6a0 tx=0x7f82c8015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:52.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.004+0000 7f82dd7fa700 1 -- 172.21.2.105:0/997071111 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f82d8042490 con 0x7f82e014abe0 2021-11-12T05:48:52.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.112+0000 7f82e6709700 1 -- 172.21.2.105:0/997071111 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f82e014b580 con 0x7f82e014abe0 2021-11-12T05:48:52.273 INFO:tasks.ceph.mon.a.gibba005.stderr:2021-11-12T05:48:52.112+0000 7fe974aad700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-12T05:48:52.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.116+0000 7f82dd7fa700 1 -- 172.21.2.105:0/997071111 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 23 and data pool 22 v58) v1 ==== 189+0+0 (secure 0 0 0) 0x7f82d8045ab0 con 0x7f82e014abe0 2021-11-12T05:48:52.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.120+0000 7f82e6709700 1 -- 172.21.2.105:0/997071111 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f82c4053660 msgr2=0x7f82c4055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:52.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.120+0000 7f82e6709700 1 --2- 172.21.2.105:0/997071111 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f82c4053660 0x7f82c4055b20 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f82e00ac6a0 tx=0x7f82c8015000).stop 2021-11-12T05:48:52.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.120+0000 7f82e6709700 1 -- 172.21.2.105:0/997071111 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f82e014abe0 msgr2=0x7f82e00668e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:52.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.120+0000 7f82e6709700 1 --2- 172.21.2.105:0/997071111 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f82e014abe0 0x7f82e00668e0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7f82d8001250 tx=0x7f82d80090f0).stop 2021-11-12T05:48:52.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.120+0000 7f82e6709700 1 -- 172.21.2.105:0/997071111 shutdown_connections 2021-11-12T05:48:52.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.120+0000 7f82e6709700 1 --2- 172.21.2.105:0/997071111 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f82c4053660 0x7f82c4055b20 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:52.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.120+0000 7f82e6709700 1 --2- 172.21.2.105:0/997071111 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f82e014abe0 0x7f82e00668e0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:52.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.120+0000 7f82e6709700 1 --2- 172.21.2.105:0/997071111 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f82e00ad080 0x7f82e00ab3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:52.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.120+0000 7f82e6709700 1 --2- 172.21.2.105:0/997071111 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f82e00ac280 0x7f82e00aab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:52.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.120+0000 7f82e6709700 1 -- 172.21.2.105:0/997071111 >> 172.21.2.105:0/997071111 conn(0x7f82e00b5370 msgr2=0x7f82e0146820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:52.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.120+0000 7f82e6709700 1 -- 172.21.2.105:0/997071111 shutdown_connections 2021-11-12T05:48:52.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.120+0000 7f82e6709700 1 -- 172.21.2.105:0/997071111 wait complete. 2021-11-12T05:48:52.278 INFO:teuthology.orchestra.run.gibba005.stderr:new fs with metadata pool 23 and data pool 22 2021-11-12T05:48:52.279 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-12T05:48:52.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.332+0000 7f35fd1c1700 1 Processor -- start 2021-11-12T05:48:52.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.332+0000 7f35fd1c1700 1 -- start start 2021-11-12T05:48:52.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.332+0000 7f35fd1c1700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f35f80aca40 0x7f35f80ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:52.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.332+0000 7f35fd1c1700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f35f80b0520 0x7f35f81473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:52.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.332+0000 7f35fd1c1700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35f80b1840 con 0x7f35f81478b0 2021-11-12T05:48:52.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.332+0000 7f35fd1c1700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35f8147d20 con 0x7f35f80aca40 2021-11-12T05:48:52.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.332+0000 7f35fd1c1700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35f80b09d0 con 0x7f35f80b0520 2021-11-12T05:48:52.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.332+0000 7f35f6d9d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f35f80aca40 0x7f35f80ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:52.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.332+0000 7f35f6d9d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f35f80aca40 0x7f35f80ace20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50916/0 (socket says 172.21.2.105:50916) 2021-11-12T05:48:52.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.332+0000 7f35f6d9d700 1 -- 172.21.2.105:0/425219181 learned_addr learned my addr 172.21.2.105:0/425219181 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:52.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.332+0000 7f35f6d9d700 1 -- 172.21.2.105:0/425219181 >> v2:172.21.2.115:3300/0 conn(0x7f35f80b0520 msgr2=0x7f35f81473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:52.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.332+0000 7f35f6d9d700 1 --2- 172.21.2.105:0/425219181 >> v2:172.21.2.115:3300/0 conn(0x7f35f80b0520 0x7f35f81473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:52.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.332+0000 7f35f6d9d700 1 -- 172.21.2.105:0/425219181 >> v1:172.21.2.115:6789/0 conn(0x7f35f81478b0 legacy=0x7f35f8144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:52.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.332+0000 7f35f6d9d700 1 -- 172.21.2.105:0/425219181 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f80af2b0 con 0x7f35f80aca40 2021-11-12T05:48:52.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.332+0000 7f35f6d9d700 1 --2- 172.21.2.105:0/425219181 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f35f80aca40 0x7f35f80ace20 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7f35f8061140 tx=0x7f35e8006eb0).ready entity=mon.0 client_cookie=3fd12175f693d2de server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:52.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.332+0000 7f35f5d9b700 1 -- 172.21.2.105:0/425219181 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35e800d5c0 con 0x7f35f80aca40 2021-11-12T05:48:52.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.336+0000 7f35f5d9b700 1 -- 172.21.2.105:0/425219181 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e8000e90 con 0x7f35f80aca40 2021-11-12T05:48:52.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.336+0000 7f35f5d9b700 1 -- 172.21.2.105:0/425219181 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35e800d910 con 0x7f35f80aca40 2021-11-12T05:48:52.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.336+0000 7f35fd1c1700 1 -- 172.21.2.105:0/425219181 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f35f80aca40 msgr2=0x7f35f80ace20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:52.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.336+0000 7f35fd1c1700 1 --2- 172.21.2.105:0/425219181 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f35f80aca40 0x7f35f80ace20 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7f35f8061140 tx=0x7f35e8006eb0).stop 2021-11-12T05:48:52.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.336+0000 7f35fd1c1700 1 -- 172.21.2.105:0/425219181 shutdown_connections 2021-11-12T05:48:52.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.336+0000 7f35fd1c1700 1 --2- 172.21.2.105:0/425219181 >> v2:172.21.2.115:3300/0 conn(0x7f35f80b0520 0x7f35f81473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:52.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.336+0000 7f35fd1c1700 1 --2- 172.21.2.105:0/425219181 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f35f80aca40 0x7f35f80ace20 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:52.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.336+0000 7f35fd1c1700 1 -- 172.21.2.105:0/425219181 >> 172.21.2.105:0/425219181 conn(0x7f35f805c490 msgr2=0x7f35f80b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:52.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.336+0000 7f35fd1c1700 1 -- 172.21.2.105:0/425219181 shutdown_connections 2021-11-12T05:48:52.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.336+0000 7f35fd1c1700 1 -- 172.21.2.105:0/425219181 wait complete. 2021-11-12T05:48:52.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.336+0000 7f35fd1c1700 1 Processor -- start 2021-11-12T05:48:52.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.336+0000 7f35fd1c1700 1 -- start start 2021-11-12T05:48:52.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.336+0000 7f35fd1c1700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f35f80aca40 0x7f35f81471e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:52.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.336+0000 7f35fd1c1700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f35f80b0520 0x7f35f8156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:52.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.336+0000 7f35fd1c1700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f35f81478b0 0x7f35f815a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:52.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.336+0000 7f35fd1c1700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f8156f60 con 0x7f35f81478b0 2021-11-12T05:48:52.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.336+0000 7f35fd1c1700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f80a75a0 con 0x7f35f80aca40 2021-11-12T05:48:52.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.336+0000 7f35fd1c1700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f80a7840 con 0x7f35f80b0520 2021-11-12T05:48:52.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.336+0000 7f35f759e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f35f81478b0 0x7f35f815a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:52.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.336+0000 7f35f759e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f35f81478b0 0x7f35f815a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50926/0 (socket says 172.21.2.105:50926) 2021-11-12T05:48:52.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.336+0000 7f35f759e700 1 -- 172.21.2.105:0/1518184896 learned_addr learned my addr 172.21.2.105:0/1518184896 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:52.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.336+0000 7f35f759e700 1 -- 172.21.2.105:0/1518184896 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f35f80b0520 msgr2=0x7f35f8156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:52.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.336+0000 7f35f759e700 1 --2- 172.21.2.105:0/1518184896 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f35f80b0520 0x7f35f8156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:52.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.336+0000 7f35f759e700 1 -- 172.21.2.105:0/1518184896 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f35f80aca40 msgr2=0x7f35f81471e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:52.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.336+0000 7f35f759e700 1 --2- 172.21.2.105:0/1518184896 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f35f80aca40 0x7f35f81471e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:52.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.336+0000 7f35f759e700 1 -- 172.21.2.105:0/1518184896 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e800b1e0 con 0x7f35f81478b0 2021-11-12T05:48:52.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.336+0000 7f35f759e700 1 --2- 172.21.2.105:0/1518184896 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f35f81478b0 0x7f35f815a5c0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7f35f0003270 tx=0x7f35f00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:52.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.336+0000 7f35e7fff700 1 -- 172.21.2.105:0/1518184896 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35f000d4a0 con 0x7f35f81478b0 2021-11-12T05:48:52.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.336+0000 7f35e7fff700 1 -- 172.21.2.105:0/1518184896 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f000d600 con 0x7f35f81478b0 2021-11-12T05:48:52.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.336+0000 7f35fd1c1700 1 -- 172.21.2.105:0/1518184896 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35f815a120 con 0x7f35f81478b0 2021-11-12T05:48:52.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.336+0000 7f35fd1c1700 1 -- 172.21.2.105:0/1518184896 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35f80a7240 con 0x7f35f81478b0 2021-11-12T05:48:52.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.336+0000 7f35e7fff700 1 -- 172.21.2.105:0/1518184896 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35f000d960 con 0x7f35f81478b0 2021-11-12T05:48:52.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.336+0000 7f35fd1c1700 1 -- 172.21.2.105:0/1518184896 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35f815a2e0 con 0x7f35f81478b0 2021-11-12T05:48:52.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.336+0000 7f35e7fff700 1 -- 172.21.2.105:0/1518184896 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f35f0018030 con 0x7f35f81478b0 2021-11-12T05:48:52.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.340+0000 7f35e7fff700 1 --2- 172.21.2.105:0/1518184896 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f35d40536f0 0x7f35d4055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:52.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.340+0000 7f35e7fff700 1 -- 172.21.2.105:0/1518184896 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f35f006b530 con 0x7f35f81478b0 2021-11-12T05:48:52.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.340+0000 7f35f6d9d700 1 --2- 172.21.2.105:0/1518184896 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f35d40536f0 0x7f35d4055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:52.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.340+0000 7f35f6d9d700 1 --2- 172.21.2.105:0/1518184896 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f35d40536f0 0x7f35d4055bb0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f35f8061140 tx=0x7f35e8015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:52.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.340+0000 7f35e7fff700 1 -- 172.21.2.105:0/1518184896 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f35f0042480 con 0x7f35f81478b0 2021-11-12T05:48:52.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:52.448+0000 7f35fd1c1700 1 -- 172.21.2.105:0/1518184896 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f35f80b1140 con 0x7f35f81478b0 2021-11-12T05:48:53.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.140+0000 7f35e7fff700 1 -- 172.21.2.105:0/1518184896 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v59) v1 ==== 104+0+0 (secure 0 0 0) 0x7f35f0045aa0 con 0x7f35f81478b0 2021-11-12T05:48:53.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.144+0000 7f35fd1c1700 1 -- 172.21.2.105:0/1518184896 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f35d40536f0 msgr2=0x7f35d4055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:53.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.144+0000 7f35fd1c1700 1 --2- 172.21.2.105:0/1518184896 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f35d40536f0 0x7f35d4055bb0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f35f8061140 tx=0x7f35e8015000).stop 2021-11-12T05:48:53.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.144+0000 7f35fd1c1700 1 -- 172.21.2.105:0/1518184896 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f35f81478b0 msgr2=0x7f35f815a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:53.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.144+0000 7f35fd1c1700 1 --2- 172.21.2.105:0/1518184896 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f35f81478b0 0x7f35f815a5c0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7f35f0003270 tx=0x7f35f00090f0).stop 2021-11-12T05:48:53.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.144+0000 7f35fd1c1700 1 -- 172.21.2.105:0/1518184896 shutdown_connections 2021-11-12T05:48:53.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.144+0000 7f35fd1c1700 1 --2- 172.21.2.105:0/1518184896 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f35d40536f0 0x7f35d4055bb0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:53.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.144+0000 7f35fd1c1700 1 --2- 172.21.2.105:0/1518184896 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f35f81478b0 0x7f35f815a5c0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:53.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.144+0000 7f35fd1c1700 1 --2- 172.21.2.105:0/1518184896 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f35f80b0520 0x7f35f8156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:53.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.144+0000 7f35fd1c1700 1 --2- 172.21.2.105:0/1518184896 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f35f80aca40 0x7f35f81471e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:53.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.144+0000 7f35fd1c1700 1 -- 172.21.2.105:0/1518184896 >> 172.21.2.105:0/1518184896 conn(0x7f35f805c490 msgr2=0x7f35f805fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:53.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.144+0000 7f35fd1c1700 1 -- 172.21.2.105:0/1518184896 shutdown_connections 2021-11-12T05:48:53.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.144+0000 7f35fd1c1700 1 -- 172.21.2.105:0/1518184896 wait complete. 2021-11-12T05:48:53.154 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-12T05:48:53.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.204+0000 7ff84fac6700 1 Processor -- start 2021-11-12T05:48:53.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.204+0000 7ff84fac6700 1 -- start start 2021-11-12T05:48:53.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.204+0000 7ff84fac6700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff8480ac280 0x7ff84814b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:53.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.204+0000 7ff84fac6700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff8480af730 0x7ff8480ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:53.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.204+0000 7ff84fac6700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8480ac7b0 con 0x7ff8480ad080 2021-11-12T05:48:53.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.204+0000 7ff84fac6700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8481488a0 con 0x7ff8480ac280 2021-11-12T05:48:53.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.204+0000 7ff84fac6700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8480ac9e0 con 0x7ff8480af730 2021-11-12T05:48:53.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.204+0000 7ff84d061700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff8480ac280 0x7ff84814b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:53.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.204+0000 7ff84d862700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7ff8480ad080 0x7ff84814abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:33096/0 (socket says 172.21.2.105:33096) 2021-11-12T05:48:53.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.204+0000 7ff84d862700 1 -- 172.21.2.105:0/3652426911 learned_addr learned my addr 172.21.2.105:0/3652426911 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:53.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.204+0000 7ff84d061700 1 -- 172.21.2.105:0/3652426911 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff8480af730 msgr2=0x7ff8480ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:53.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.204+0000 7ff84d061700 1 --2- 172.21.2.105:0/3652426911 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff8480af730 0x7ff8480ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:53.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.204+0000 7ff84d061700 1 -- 172.21.2.105:0/3652426911 >> v1:172.21.2.105:6789/0 conn(0x7ff8480ad080 legacy=0x7ff84814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:53.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.204+0000 7ff84d061700 1 -- 172.21.2.105:0/3652426911 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8480b0b30 con 0x7ff8480ac280 2021-11-12T05:48:53.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.204+0000 7ff84d061700 1 --2- 172.21.2.105:0/3652426911 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff8480ac280 0x7ff84814b2f0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 rx=0x7ff83c002f70 tx=0x7ff83c006df0).ready entity=mon.0 client_cookie=80558edf60d9b8a4 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:53.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.204+0000 7ff84c860700 1 -- 172.21.2.105:0/3652426911 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff83c00d570 con 0x7ff8480ac280 2021-11-12T05:48:53.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.204+0000 7ff84c860700 1 -- 172.21.2.105:0/3652426911 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83c000e90 con 0x7ff8480ac280 2021-11-12T05:48:53.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.204+0000 7ff84c860700 1 -- 172.21.2.105:0/3652426911 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff83c00d8c0 con 0x7ff8480ac280 2021-11-12T05:48:53.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.204+0000 7ff84fac6700 1 -- 172.21.2.105:0/3652426911 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff8480ac280 msgr2=0x7ff84814b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:53.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.204+0000 7ff84fac6700 1 --2- 172.21.2.105:0/3652426911 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff8480ac280 0x7ff84814b2f0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 rx=0x7ff83c002f70 tx=0x7ff83c006df0).stop 2021-11-12T05:48:53.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.204+0000 7ff84fac6700 1 -- 172.21.2.105:0/3652426911 shutdown_connections 2021-11-12T05:48:53.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.204+0000 7ff84fac6700 1 --2- 172.21.2.105:0/3652426911 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff8480af730 0x7ff8480ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:53.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.204+0000 7ff84fac6700 1 --2- 172.21.2.105:0/3652426911 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff8480ac280 0x7ff84814b2f0 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:53.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.204+0000 7ff84fac6700 1 -- 172.21.2.105:0/3652426911 >> 172.21.2.105:0/3652426911 conn(0x7ff8480b5370 msgr2=0x7ff8480b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:53.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.204+0000 7ff84fac6700 1 -- 172.21.2.105:0/3652426911 shutdown_connections 2021-11-12T05:48:53.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.204+0000 7ff84fac6700 1 -- 172.21.2.105:0/3652426911 wait complete. 2021-11-12T05:48:53.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.204+0000 7ff84fac6700 1 Processor -- start 2021-11-12T05:48:53.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.204+0000 7ff84fac6700 1 -- start start 2021-11-12T05:48:53.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.204+0000 7ff84fac6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff8480ac280 0x7ff8480671a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:53.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.204+0000 7ff84fac6700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff8480ad080 0x7ff84814c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:53.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.204+0000 7ff84fac6700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff8480af730 0x7ff8480aabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:53.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.204+0000 7ff84fac6700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8480a95d0 con 0x7ff8480ac280 2021-11-12T05:48:53.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.204+0000 7ff84fac6700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8480ab740 con 0x7ff8480ad080 2021-11-12T05:48:53.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.204+0000 7ff84fac6700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8480aa1a0 con 0x7ff8480af730 2021-11-12T05:48:53.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.204+0000 7ff84d862700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff8480ac280 0x7ff8480671a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:53.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.204+0000 7ff84d862700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff8480ac280 0x7ff8480671a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50938/0 (socket says 172.21.2.105:50938) 2021-11-12T05:48:53.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.204+0000 7ff84d862700 1 -- 172.21.2.105:0/1268578068 learned_addr learned my addr 172.21.2.105:0/1268578068 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:53.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.208+0000 7ff84d862700 1 -- 172.21.2.105:0/1268578068 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff8480af730 msgr2=0x7ff8480aabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:53.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.208+0000 7ff84d862700 1 --2- 172.21.2.105:0/1268578068 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff8480af730 0x7ff8480aabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:53.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.208+0000 7ff84d862700 1 -- 172.21.2.105:0/1268578068 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff8480ad080 msgr2=0x7ff84814c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:53.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.208+0000 7ff84d862700 1 --2- 172.21.2.105:0/1268578068 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff8480ad080 0x7ff84814c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:53.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.208+0000 7ff84d862700 1 -- 172.21.2.105:0/1268578068 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83c00b180 con 0x7ff8480ac280 2021-11-12T05:48:53.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.208+0000 7ff84d862700 1 --2- 172.21.2.105:0/1268578068 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff8480ac280 0x7ff8480671a0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7ff848062890 tx=0x7ff844007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:53.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.208+0000 7ff83affd700 1 -- 172.21.2.105:0/1268578068 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff84400ce20 con 0x7ff8480ac280 2021-11-12T05:48:53.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.208+0000 7ff83affd700 1 -- 172.21.2.105:0/1268578068 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8440072e0 con 0x7ff8480ac280 2021-11-12T05:48:53.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.208+0000 7ff84fac6700 1 -- 172.21.2.105:0/1268578068 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8480aa450 con 0x7ff8480ac280 2021-11-12T05:48:53.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.208+0000 7ff83affd700 1 -- 172.21.2.105:0/1268578068 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff844005800 con 0x7ff8480ac280 2021-11-12T05:48:53.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.208+0000 7ff84fac6700 1 -- 172.21.2.105:0/1268578068 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8480a9ca0 con 0x7ff8480ac280 2021-11-12T05:48:53.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.208+0000 7ff84fac6700 1 -- 172.21.2.105:0/1268578068 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8480b1440 con 0x7ff8480ac280 2021-11-12T05:48:53.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.208+0000 7ff83affd700 1 -- 172.21.2.105:0/1268578068 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff844010070 con 0x7ff8480ac280 2021-11-12T05:48:53.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.208+0000 7ff83affd700 1 --2- 172.21.2.105:0/1268578068 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff8280535b0 0x7ff828055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:53.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.208+0000 7ff83affd700 1 -- 172.21.2.105:0/1268578068 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6502+0+0 (secure 0 0 0) 0x7ff84406b0b0 con 0x7ff8480ac280 2021-11-12T05:48:53.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.208+0000 7ff84d061700 1 --2- 172.21.2.105:0/1268578068 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff8280535b0 0x7ff828055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:53.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.208+0000 7ff84d061700 1 --2- 172.21.2.105:0/1268578068 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff8280535b0 0x7ff828055a70 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7ff83c002f70 tx=0x7ff83c015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:53.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.208+0000 7ff83affd700 1 -- 172.21.2.105:0/1268578068 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff844042060 con 0x7ff8480ac280 2021-11-12T05:48:53.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:53.292+0000 7ff84fac6700 1 -- 172.21.2.105:0/1268578068 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff848057350 con 0x7ff8480ac280 2021-11-12T05:48:54.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.148+0000 7ff83affd700 1 -- 172.21.2.105:0/1268578068 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v125) v1 ==== 185+0+0 (secure 0 0 0) 0x7ff844045680 con 0x7ff8480ac280 2021-11-12T05:48:54.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.148+0000 7ff84fac6700 1 -- 172.21.2.105:0/1268578068 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff8280535b0 msgr2=0x7ff828055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:54.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.148+0000 7ff84fac6700 1 --2- 172.21.2.105:0/1268578068 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff8280535b0 0x7ff828055a70 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7ff83c002f70 tx=0x7ff83c015000).stop 2021-11-12T05:48:54.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.148+0000 7ff84fac6700 1 -- 172.21.2.105:0/1268578068 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff8480ac280 msgr2=0x7ff8480671a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:54.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.148+0000 7ff84fac6700 1 --2- 172.21.2.105:0/1268578068 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff8480ac280 0x7ff8480671a0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7ff848062890 tx=0x7ff844007c40).stop 2021-11-12T05:48:54.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.148+0000 7ff84fac6700 1 -- 172.21.2.105:0/1268578068 shutdown_connections 2021-11-12T05:48:54.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.148+0000 7ff84fac6700 1 --2- 172.21.2.105:0/1268578068 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff8280535b0 0x7ff828055a70 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:54.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.148+0000 7ff84fac6700 1 --2- 172.21.2.105:0/1268578068 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff8480af730 0x7ff8480aabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:54.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.148+0000 7ff84fac6700 1 --2- 172.21.2.105:0/1268578068 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff8480ad080 0x7ff84814c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:54.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.148+0000 7ff84fac6700 1 --2- 172.21.2.105:0/1268578068 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff8480ac280 0x7ff8480671a0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:54.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.148+0000 7ff84fac6700 1 -- 172.21.2.105:0/1268578068 >> 172.21.2.105:0/1268578068 conn(0x7ff8480b5370 msgr2=0x7ff8480b31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:54.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.148+0000 7ff84fac6700 1 -- 172.21.2.105:0/1268578068 shutdown_connections 2021-11-12T05:48:54.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.148+0000 7ff84fac6700 1 -- 172.21.2.105:0/1268578068 wait complete. 2021-11-12T05:48:54.156 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_metadata' removed 2021-11-12T05:48:54.160 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-12T05:48:54.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.208+0000 7fa64113e700 1 Processor -- start 2021-11-12T05:48:54.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.208+0000 7fa64113e700 1 -- start start 2021-11-12T05:48:54.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.208+0000 7fa64113e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa63c0b6380 0x7fa63c0b6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:54.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.208+0000 7fa64113e700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa63c1390a0 0x7fa63c1394f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:54.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.208+0000 7fa64113e700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa63c13fab0 con 0x7fa63c142900 2021-11-12T05:48:54.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.208+0000 7fa64113e700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa63c0afeb0 con 0x7fa63c1390a0 2021-11-12T05:48:54.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.208+0000 7fa64113e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c13fd50 con 0x7fa63c0b6380 2021-11-12T05:48:54.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.208+0000 7fa63b59e700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa63c1390a0 0x7fa63c1394f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:54.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.208+0000 7fa63b59e700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa63c1390a0 0x7fa63c1394f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50948/0 (socket says 172.21.2.105:50948) 2021-11-12T05:48:54.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.208+0000 7fa63b59e700 1 -- 172.21.2.105:0/677388822 learned_addr learned my addr 172.21.2.105:0/677388822 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:54.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.208+0000 7fa63b59e700 1 -- 172.21.2.105:0/677388822 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa63c0b6380 msgr2=0x7fa63c0b6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:54.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.208+0000 7fa63b59e700 1 --2- 172.21.2.105:0/677388822 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa63c0b6380 0x7fa63c0b6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:54.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.208+0000 7fa63b59e700 1 -- 172.21.2.105:0/677388822 >> v1:172.21.2.115:6789/0 conn(0x7fa63c142900 legacy=0x7fa63c13f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:54.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.208+0000 7fa63b59e700 1 -- 172.21.2.105:0/677388822 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63c13fff0 con 0x7fa63c1390a0 2021-11-12T05:48:54.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa63b59e700 1 --2- 172.21.2.105:0/677388822 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa63c1390a0 0x7fa63c1394f0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 rx=0x7fa63c05d540 tx=0x7fa63400a430).ready entity=mon.0 client_cookie=e71f3bc94aa2e24f server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:54.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa639d9b700 1 -- 172.21.2.105:0/677388822 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa63400cc60 con 0x7fa63c1390a0 2021-11-12T05:48:54.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa639d9b700 1 -- 172.21.2.105:0/677388822 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63400cdc0 con 0x7fa63c1390a0 2021-11-12T05:48:54.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa639d9b700 1 -- 172.21.2.105:0/677388822 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa634010600 con 0x7fa63c1390a0 2021-11-12T05:48:54.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa64113e700 1 -- 172.21.2.105:0/677388822 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa63c1390a0 msgr2=0x7fa63c1394f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:54.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa64113e700 1 --2- 172.21.2.105:0/677388822 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa63c1390a0 0x7fa63c1394f0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 rx=0x7fa63c05d540 tx=0x7fa63400a430).stop 2021-11-12T05:48:54.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa64113e700 1 -- 172.21.2.105:0/677388822 shutdown_connections 2021-11-12T05:48:54.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa64113e700 1 --2- 172.21.2.105:0/677388822 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa63c1390a0 0x7fa63c1394f0 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:54.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa64113e700 1 --2- 172.21.2.105:0/677388822 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa63c0b6380 0x7fa63c0b6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:54.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa64113e700 1 -- 172.21.2.105:0/677388822 >> 172.21.2.105:0/677388822 conn(0x7fa63c063810 msgr2=0x7fa63c0b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:54.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa64113e700 1 -- 172.21.2.105:0/677388822 shutdown_connections 2021-11-12T05:48:54.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa64113e700 1 -- 172.21.2.105:0/677388822 wait complete. 2021-11-12T05:48:54.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa64113e700 1 Processor -- start 2021-11-12T05:48:54.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa64113e700 1 -- start start 2021-11-12T05:48:54.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa64113e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa63c0b6380 0x7fa63c141640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:54.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa64113e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa63c1390a0 0x7fa63c0667d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:54.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa64113e700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa63c142900 0x7fa63c1344f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:54.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa64113e700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c063fc0 con 0x7fa63c1390a0 2021-11-12T05:48:54.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa64113e700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c064260 con 0x7fa63c142900 2021-11-12T05:48:54.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa64113e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c064500 con 0x7fa63c0b6380 2021-11-12T05:48:54.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa63a59c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa63c1390a0 0x7fa63c0667d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:54.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa63a59c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa63c1390a0 0x7fa63c0667d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50952/0 (socket says 172.21.2.105:50952) 2021-11-12T05:48:54.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa63a59c700 1 -- 172.21.2.105:0/592178979 learned_addr learned my addr 172.21.2.105:0/592178979 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:54.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa63a59c700 1 -- 172.21.2.105:0/592178979 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa63c0b6380 msgr2=0x7fa63c141640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:54.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa63a59c700 1 --2- 172.21.2.105:0/592178979 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa63c0b6380 0x7fa63c141640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:54.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa63a59c700 1 -- 172.21.2.105:0/592178979 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa63c142900 msgr2=0x7fa63c1344f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:54.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa63a59c700 1 --2- 172.21.2.105:0/592178979 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa63c142900 0x7fa63c1344f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:54.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa63a59c700 1 -- 172.21.2.105:0/592178979 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63400a6d0 con 0x7fa63c1390a0 2021-11-12T05:48:54.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa63a59c700 1 --2- 172.21.2.105:0/592178979 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa63c1390a0 0x7fa63c0667d0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7fa624002f10 tx=0x7fa624006d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:54.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa633fff700 1 -- 172.21.2.105:0/592178979 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa62400f510 con 0x7fa63c1390a0 2021-11-12T05:48:54.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa633fff700 1 -- 172.21.2.105:0/592178979 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62400f670 con 0x7fa63c1390a0 2021-11-12T05:48:54.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa64113e700 1 -- 172.21.2.105:0/592178979 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa63c0649a0 con 0x7fa63c1390a0 2021-11-12T05:48:54.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa64113e700 1 -- 172.21.2.105:0/592178979 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa63c1410c0 con 0x7fa63c1390a0 2021-11-12T05:48:54.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa633fff700 1 -- 172.21.2.105:0/592178979 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa62400f7e0 con 0x7fa63c1390a0 2021-11-12T05:48:54.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa64113e700 1 -- 172.21.2.105:0/592178979 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa63c0646c0 con 0x7fa63c1390a0 2021-11-12T05:48:54.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa633fff700 1 -- 172.21.2.105:0/592178979 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa624017020 con 0x7fa63c1390a0 2021-11-12T05:48:54.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa633fff700 1 --2- 172.21.2.105:0/592178979 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa620053690 0x7fa620055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:54.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa633fff700 1 -- 172.21.2.105:0/592178979 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6064+0+0 (secure 0 0 0) 0x7fa62406ab20 con 0x7fa63c1390a0 2021-11-12T05:48:54.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.212+0000 7fa63ad9d700 1 --2- 172.21.2.105:0/592178979 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa620053690 0x7fa620055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:54.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.216+0000 7fa63ad9d700 1 --2- 172.21.2.105:0/592178979 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa620053690 0x7fa620055b50 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7fa62c002f70 tx=0x7fa62c006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:54.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.216+0000 7fa633fff700 1 -- 172.21.2.105:0/592178979 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa624041b80 con 0x7fa63c1390a0 2021-11-12T05:48:54.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:54.300+0000 7fa64113e700 1 -- 172.21.2.105:0/592178979 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fa63c057350 con 0x7fa63c1390a0 2021-11-12T05:48:55.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.152+0000 7fa633fff700 1 -- 172.21.2.105:0/592178979 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v126) v1 ==== 133+0+0 (secure 0 0 0) 0x7fa6240451a0 con 0x7fa63c1390a0 2021-11-12T05:48:55.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.152+0000 7fa64113e700 1 -- 172.21.2.105:0/592178979 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa620053690 msgr2=0x7fa620055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:55.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.152+0000 7fa64113e700 1 --2- 172.21.2.105:0/592178979 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa620053690 0x7fa620055b50 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7fa62c002f70 tx=0x7fa62c006a80).stop 2021-11-12T05:48:55.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.152+0000 7fa64113e700 1 -- 172.21.2.105:0/592178979 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa63c1390a0 msgr2=0x7fa63c0667d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:55.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.152+0000 7fa64113e700 1 --2- 172.21.2.105:0/592178979 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa63c1390a0 0x7fa63c0667d0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7fa624002f10 tx=0x7fa624006d70).stop 2021-11-12T05:48:55.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.156+0000 7fa64113e700 1 -- 172.21.2.105:0/592178979 shutdown_connections 2021-11-12T05:48:55.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.156+0000 7fa64113e700 1 --2- 172.21.2.105:0/592178979 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa620053690 0x7fa620055b50 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:55.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.156+0000 7fa64113e700 1 --2- 172.21.2.105:0/592178979 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa63c142900 0x7fa63c1344f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:55.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.156+0000 7fa64113e700 1 --2- 172.21.2.105:0/592178979 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa63c1390a0 0x7fa63c0667d0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:55.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.156+0000 7fa64113e700 1 --2- 172.21.2.105:0/592178979 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa63c0b6380 0x7fa63c141640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:55.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.156+0000 7fa64113e700 1 -- 172.21.2.105:0/592178979 >> 172.21.2.105:0/592178979 conn(0x7fa63c063810 msgr2=0x7fa63c13de50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:55.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.156+0000 7fa64113e700 1 -- 172.21.2.105:0/592178979 shutdown_connections 2021-11-12T05:48:55.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.156+0000 7fa64113e700 1 -- 172.21.2.105:0/592178979 wait complete. 2021-11-12T05:48:55.162 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_metadata' created 2021-11-12T05:48:55.165 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2021-11-12T05:48:55.195 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:48:55.197 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:48:55.199 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:48:55.203 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:48:55.206 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:48:55.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.212+0000 7fddb4a0f700 1 Processor -- start 2021-11-12T05:48:55.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.212+0000 7fddb4a0f700 1 -- start start 2021-11-12T05:48:55.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.212+0000 7fddb4a0f700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fddb00b6430 0x7fddb0143090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:55.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.212+0000 7fddb4a0f700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fddb00b4060 0x7fddb0146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:55.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.212+0000 7fddb4a0f700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb0147620 con 0x7fddb01471b0 2021-11-12T05:48:55.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.212+0000 7fddb4a0f700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb00b6810 con 0x7fddb00b6430 2021-11-12T05:48:55.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.212+0000 7fddb4a0f700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb00b6d60 con 0x7fddb00b4060 2021-11-12T05:48:55.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.212+0000 7fddae59c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fddb00b6430 0x7fddb0143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:55.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.212+0000 7fddae59c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fddb00b6430 0x7fddb0143090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50958/0 (socket says 172.21.2.105:50958) 2021-11-12T05:48:55.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.212+0000 7fddae59c700 1 -- 172.21.2.105:0/4287286700 learned_addr learned my addr 172.21.2.105:0/4287286700 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:55.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.212+0000 7fddae59c700 1 -- 172.21.2.105:0/4287286700 >> v2:172.21.2.115:3300/0 conn(0x7fddb00b4060 msgr2=0x7fddb0146cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:55.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.212+0000 7fddae59c700 1 --2- 172.21.2.105:0/4287286700 >> v2:172.21.2.115:3300/0 conn(0x7fddb00b4060 0x7fddb0146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:55.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.212+0000 7fddae59c700 1 -- 172.21.2.105:0/4287286700 >> v1:172.21.2.105:6789/0 conn(0x7fddb01471b0 legacy=0x7fddb0140040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:55.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.212+0000 7fddad59a700 1 -- 172.21.2.105:0/4287286700 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 889904703 0 0) 0x7fddb0147620 con 0x7fddb01471b0 2021-11-12T05:48:55.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.212+0000 7fddae59c700 1 -- 172.21.2.105:0/4287286700 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb0146820 con 0x7fddb00b6430 2021-11-12T05:48:55.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fddae59c700 1 --2- 172.21.2.105:0/4287286700 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fddb00b6430 0x7fddb0143090 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 rx=0x7fdd98002f70 tx=0x7fdd98006eb0).ready entity=mon.0 client_cookie=2070455bd3f28385 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:55.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fddad59a700 1 -- 172.21.2.105:0/4287286700 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd9800d610 con 0x7fddb00b6430 2021-11-12T05:48:55.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fddad59a700 1 -- 172.21.2.105:0/4287286700 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd98000e90 con 0x7fddb00b6430 2021-11-12T05:48:55.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fddad59a700 1 -- 172.21.2.105:0/4287286700 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd9800d9a0 con 0x7fddb00b6430 2021-11-12T05:48:55.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fddb4a0f700 1 -- 172.21.2.105:0/4287286700 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fddb00b6430 msgr2=0x7fddb0143090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:55.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fddb4a0f700 1 --2- 172.21.2.105:0/4287286700 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fddb00b6430 0x7fddb0143090 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 rx=0x7fdd98002f70 tx=0x7fdd98006eb0).stop 2021-11-12T05:48:55.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fddb4a0f700 1 -- 172.21.2.105:0/4287286700 shutdown_connections 2021-11-12T05:48:55.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fddb4a0f700 1 --2- 172.21.2.105:0/4287286700 >> v2:172.21.2.115:3300/0 conn(0x7fddb00b4060 0x7fddb0146cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:55.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fddb4a0f700 1 --2- 172.21.2.105:0/4287286700 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fddb00b6430 0x7fddb0143090 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:55.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fddb4a0f700 1 -- 172.21.2.105:0/4287286700 >> 172.21.2.105:0/4287286700 conn(0x7fddb0062030 msgr2=0x7fddb0062440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:55.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fddb4a0f700 1 -- 172.21.2.105:0/4287286700 shutdown_connections 2021-11-12T05:48:55.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fddb4a0f700 1 -- 172.21.2.105:0/4287286700 wait complete. 2021-11-12T05:48:55.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fddb4a0f700 1 Processor -- start 2021-11-12T05:48:55.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fddb4a0f700 1 -- start start 2021-11-12T05:48:55.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fddb4a0f700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fddb00b4060 0x7fddb0140150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:55.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fddb4a0f700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fddb00b6430 0x7fddb01523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:55.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fddb4a0f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fddb01471b0 0x7fddb0155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:55.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fddb4a0f700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb01559a0 con 0x7fddb00b6430 2021-11-12T05:48:55.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fddb4a0f700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb014a360 con 0x7fddb00b4060 2021-11-12T05:48:55.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fddb4a0f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb014a600 con 0x7fddb01471b0 2021-11-12T05:48:55.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fddadd9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fddb00b6430 0x7fddb01523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:55.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fddadd9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fddb00b6430 0x7fddb01523e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50966/0 (socket says 172.21.2.105:50966) 2021-11-12T05:48:55.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fddadd9b700 1 -- 172.21.2.105:0/2638649440 learned_addr learned my addr 172.21.2.105:0/2638649440 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:55.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fddae59c700 1 --2- 172.21.2.105:0/2638649440 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fddb00b4060 0x7fddb0140150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:55.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fddaed9d700 1 --2- 172.21.2.105:0/2638649440 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fddb01471b0 0x7fddb0155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:55.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fddadd9b700 1 -- 172.21.2.105:0/2638649440 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fddb01471b0 msgr2=0x7fddb0155dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:55.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fddadd9b700 1 --2- 172.21.2.105:0/2638649440 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fddb01471b0 0x7fddb0155dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:55.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fddadd9b700 1 -- 172.21.2.105:0/2638649440 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fddb00b4060 msgr2=0x7fddb0140150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:55.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fddadd9b700 1 --2- 172.21.2.105:0/2638649440 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fddb00b4060 0x7fddb0140150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:55.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fddadd9b700 1 -- 172.21.2.105:0/2638649440 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd9800b1e0 con 0x7fddb00b6430 2021-11-12T05:48:55.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fddadd9b700 1 --2- 172.21.2.105:0/2638649440 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fddb00b6430 0x7fddb01523e0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 rx=0x7fdda0002f70 tx=0x7fdda0006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:55.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fdda77fe700 1 -- 172.21.2.105:0/2638649440 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdda0009ea0 con 0x7fddb00b6430 2021-11-12T05:48:55.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fdda77fe700 1 -- 172.21.2.105:0/2638649440 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda0013460 con 0x7fddb00b6430 2021-11-12T05:48:55.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fddb4a0f700 1 -- 172.21.2.105:0/2638649440 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb00b1260 con 0x7fddb00b6430 2021-11-12T05:48:55.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fddb4a0f700 1 -- 172.21.2.105:0/2638649440 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb00b15b0 con 0x7fddb00b6430 2021-11-12T05:48:55.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fdda77fe700 1 -- 172.21.2.105:0/2638649440 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdda00137c0 con 0x7fddb00b6430 2021-11-12T05:48:55.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fddb4a0f700 1 -- 172.21.2.105:0/2638649440 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb0155ae0 con 0x7fddb00b6430 2021-11-12T05:48:55.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fdda77fe700 1 -- 172.21.2.105:0/2638649440 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdda001a060 con 0x7fddb00b6430 2021-11-12T05:48:55.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fdda77fe700 1 --2- 172.21.2.105:0/2638649440 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdd94053610 0x7fdd94055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:55.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fdda77fe700 1 -- 172.21.2.105:0/2638649440 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6418+0+0 (secure 0 0 0) 0x7fdda006b3b0 con 0x7fddb00b6430 2021-11-12T05:48:55.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.216+0000 7fddae59c700 1 --2- 172.21.2.105:0/2638649440 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdd94053610 0x7fdd94055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:55.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.220+0000 7fddae59c700 1 --2- 172.21.2.105:0/2638649440 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdd94053610 0x7fdd94055ad0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7fdd9801c000 tx=0x7fdd98015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:55.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.220+0000 7fdda77fe700 1 -- 172.21.2.105:0/2638649440 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdda00423b0 con 0x7fddb00b6430 2021-11-12T05:48:55.336 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.332+0000 7fddb4a0f700 1 -- 172.21.2.105:0/2638649440 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fddb014a770 con 0x7fddb00b6430 2021-11-12T05:48:55.336 INFO:tasks.ceph.mon.a.gibba005.stderr:2021-11-12T05:48:55.332+0000 7fe974aad700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-12T05:48:55.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.336+0000 7fdda77fe700 1 -- 172.21.2.105:0/2638649440 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 24 and data pool 22 v60) v1 ==== 174+0+0 (secure 0 0 0) 0x7fddb014a770 con 0x7fddb00b6430 2021-11-12T05:48:55.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.336+0000 7fddb4a0f700 1 -- 172.21.2.105:0/2638649440 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdd94053610 msgr2=0x7fdd94055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:55.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.336+0000 7fddb4a0f700 1 --2- 172.21.2.105:0/2638649440 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdd94053610 0x7fdd94055ad0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7fdd9801c000 tx=0x7fdd98015000).stop 2021-11-12T05:48:55.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.336+0000 7fddb4a0f700 1 -- 172.21.2.105:0/2638649440 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fddb00b6430 msgr2=0x7fddb01523e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:55.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.336+0000 7fddb4a0f700 1 --2- 172.21.2.105:0/2638649440 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fddb00b6430 0x7fddb01523e0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 rx=0x7fdda0002f70 tx=0x7fdda0006ec0).stop 2021-11-12T05:48:55.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.336+0000 7fddb4a0f700 1 -- 172.21.2.105:0/2638649440 shutdown_connections 2021-11-12T05:48:55.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.336+0000 7fddb4a0f700 1 --2- 172.21.2.105:0/2638649440 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdd94053610 0x7fdd94055ad0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:55.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.336+0000 7fddb4a0f700 1 --2- 172.21.2.105:0/2638649440 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fddb01471b0 0x7fddb0155dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:55.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.336+0000 7fddb4a0f700 1 --2- 172.21.2.105:0/2638649440 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fddb00b6430 0x7fddb01523e0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:55.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.336+0000 7fddb4a0f700 1 --2- 172.21.2.105:0/2638649440 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fddb00b4060 0x7fddb0140150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:55.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.336+0000 7fddb4a0f700 1 -- 172.21.2.105:0/2638649440 >> 172.21.2.105:0/2638649440 conn(0x7fddb0062030 msgr2=0x7fddb0143b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:55.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.336+0000 7fddb4a0f700 1 -- 172.21.2.105:0/2638649440 shutdown_connections 2021-11-12T05:48:55.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.336+0000 7fddb4a0f700 1 -- 172.21.2.105:0/2638649440 wait complete. 2021-11-12T05:48:55.346 INFO:teuthology.orchestra.run.gibba005.stderr:new fs with metadata pool 24 and data pool 22 2021-11-12T05:48:55.349 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-12T05:48:55.350 DEBUG:teuthology.orchestra.run.gibba005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:48:55.357 DEBUG:teuthology.orchestra.run.gibba015:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:48:55.364 DEBUG:teuthology.orchestra.run.gibba016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:48:55.393 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:48:55.407 DEBUG:teuthology.orchestra.run.gibba044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:48:55.435 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-12T05:48:55.436 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:55.436 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:48:55.437 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:48:55.446 INFO:teuthology.orchestra.run.gibba016.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-12T05:48:55.447 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:48:55.448 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-11-12T05:48:55.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:48:55.449 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:48:55.457 INFO:teuthology.orchestra.run.gibba016.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-12T05:48:55.458 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:48:55.459 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:55.460 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:48:55.460 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:48:55.466 INFO:teuthology.orchestra.run.gibba038.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-12T05:48:55.467 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:48:55.468 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-12T05:48:55.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:48:55.469 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:48:55.519 INFO:teuthology.orchestra.run.gibba038.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-12T05:48:55.520 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:48:55.521 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:48:55.522 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:48:55.522 DEBUG:teuthology.orchestra.run.gibba044:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:48:55.531 INFO:teuthology.orchestra.run.gibba044.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-12T05:48:55.532 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:48:55.533 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-12T05:48:55.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:48:55.534 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:48:55.584 INFO:teuthology.orchestra.run.gibba044.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-12T05:48:55.585 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:48:55.587 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-12T05:48:55.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.652+0000 7f4f924c4700 1 Processor -- start 2021-11-12T05:48:55.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.652+0000 7f4f924c4700 1 -- start start 2021-11-12T05:48:55.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f924c4700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f4f8c0b0bf0 0x7f4f8c142e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:55.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f924c4700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f4f8c143dc0 0x7f4f8c1468b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:55.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f924c4700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f8c0b43f0 con 0x7f4f8c0621b0 2021-11-12T05:48:55.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f924c4700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f8c0b6590 con 0x7f4f8c143dc0 2021-11-12T05:48:55.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f924c4700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f8c062590 con 0x7f4f8c0b0bf0 2021-11-12T05:48:55.665 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f90a61700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f4f8c143dc0 0x7f4f8c1468b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:55.665 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f8bfff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f4f8c0621b0 0x7f4f8c1436b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:33136/0 (socket says 172.21.2.105:33136) 2021-11-12T05:48:55.665 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f8bfff700 1 -- 172.21.2.105:0/452021688 learned_addr learned my addr 172.21.2.105:0/452021688 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:55.665 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f90a61700 1 -- 172.21.2.105:0/452021688 >> v2:172.21.2.115:3300/0 conn(0x7f4f8c0b0bf0 msgr2=0x7f4f8c142e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:55.666 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f90a61700 1 --2- 172.21.2.105:0/452021688 >> v2:172.21.2.115:3300/0 conn(0x7f4f8c0b0bf0 0x7f4f8c142e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:55.666 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f90a61700 1 -- 172.21.2.105:0/452021688 >> v1:172.21.2.105:6789/0 conn(0x7f4f8c0621b0 legacy=0x7f4f8c1436b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:55.666 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f90a61700 1 -- 172.21.2.105:0/452021688 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f8c0b4150 con 0x7f4f8c143dc0 2021-11-12T05:48:55.666 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f90a61700 1 --2- 172.21.2.105:0/452021688 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4f8c143dc0 0x7f4f8c1468b0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 rx=0x7f4f840032f0 tx=0x7f4f840091d0).ready entity=mon.0 client_cookie=e677243615fbd825 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:55.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f8b7fe700 1 -- 172.21.2.105:0/452021688 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f84009ea0 con 0x7f4f8c143dc0 2021-11-12T05:48:55.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f8b7fe700 1 -- 172.21.2.105:0/452021688 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8400b870 con 0x7f4f8c143dc0 2021-11-12T05:48:55.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f8b7fe700 1 -- 172.21.2.105:0/452021688 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f8400b9e0 con 0x7f4f8c143dc0 2021-11-12T05:48:55.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f924c4700 1 -- 172.21.2.105:0/452021688 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4f8c143dc0 msgr2=0x7f4f8c1468b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:55.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f924c4700 1 --2- 172.21.2.105:0/452021688 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4f8c143dc0 0x7f4f8c1468b0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 rx=0x7f4f840032f0 tx=0x7f4f840091d0).stop 2021-11-12T05:48:55.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f924c4700 1 -- 172.21.2.105:0/452021688 shutdown_connections 2021-11-12T05:48:55.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f924c4700 1 --2- 172.21.2.105:0/452021688 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4f8c143dc0 0x7f4f8c1468b0 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:55.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f924c4700 1 --2- 172.21.2.105:0/452021688 >> v2:172.21.2.115:3300/0 conn(0x7f4f8c0b0bf0 0x7f4f8c142e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:55.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f924c4700 1 -- 172.21.2.105:0/452021688 >> 172.21.2.105:0/452021688 conn(0x7f4f8c0b97b0 msgr2=0x7f4f8c0b9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:55.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f924c4700 1 -- 172.21.2.105:0/452021688 shutdown_connections 2021-11-12T05:48:55.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f924c4700 1 -- 172.21.2.105:0/452021688 wait complete. 2021-11-12T05:48:55.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f924c4700 1 Processor -- start 2021-11-12T05:48:55.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f924c4700 1 -- start start 2021-11-12T05:48:55.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f924c4700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4f8c0621b0 0x7f4f8c0ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:55.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f924c4700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4f8c143dc0 0x7f4f8c1492b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:55.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f924c4700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4f8c0aece0 0x7f4f8c0af170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:55.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f924c4700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c148be0 con 0x7f4f8c0621b0 2021-11-12T05:48:55.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f924c4700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c0af660 con 0x7f4f8c0aece0 2021-11-12T05:48:55.671 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f924c4700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c147910 con 0x7f4f8c143dc0 2021-11-12T05:48:55.671 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f8bfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4f8c0621b0 0x7f4f8c0ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:55.671 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f8bfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4f8c0621b0 0x7f4f8c0ad5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50978/0 (socket says 172.21.2.105:50978) 2021-11-12T05:48:55.671 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f8bfff700 1 -- 172.21.2.105:0/2937422132 learned_addr learned my addr 172.21.2.105:0/2937422132 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:55.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f8bfff700 1 -- 172.21.2.105:0/2937422132 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4f8c143dc0 msgr2=0x7f4f8c1492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:55.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f8bfff700 1 --2- 172.21.2.105:0/2937422132 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4f8c143dc0 0x7f4f8c1492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:55.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f8bfff700 1 -- 172.21.2.105:0/2937422132 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4f8c0aece0 msgr2=0x7f4f8c0af170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:55.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f8bfff700 1 --2- 172.21.2.105:0/2937422132 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4f8c0aece0 0x7f4f8c0af170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:55.672 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f8bfff700 1 -- 172.21.2.105:0/2937422132 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f84009470 con 0x7f4f8c0621b0 2021-11-12T05:48:55.673 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.656+0000 7f4f8bfff700 1 --2- 172.21.2.105:0/2937422132 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4f8c0621b0 0x7f4f8c0ad5b0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7f4f8c0607f0 tx=0x7f4f7c007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:55.673 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.660+0000 7f4f89ffb700 1 -- 172.21.2.105:0/2937422132 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f7c00ce30 con 0x7f4f8c0621b0 2021-11-12T05:48:55.673 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.660+0000 7f4f89ffb700 1 -- 172.21.2.105:0/2937422132 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f7c0072e0 con 0x7f4f8c0621b0 2021-11-12T05:48:55.673 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.660+0000 7f4f924c4700 1 -- 172.21.2.105:0/2937422132 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f8c148e10 con 0x7f4f8c0621b0 2021-11-12T05:48:55.674 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.660+0000 7f4f924c4700 1 -- 172.21.2.105:0/2937422132 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f8c1486b0 con 0x7f4f8c0621b0 2021-11-12T05:48:55.674 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.660+0000 7f4f89ffb700 1 -- 172.21.2.105:0/2937422132 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f7c005800 con 0x7f4f8c0621b0 2021-11-12T05:48:55.674 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.660+0000 7f4f924c4700 1 -- 172.21.2.105:0/2937422132 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f64003410 con 0x7f4f8c0621b0 2021-11-12T05:48:55.674 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.660+0000 7f4f89ffb700 1 -- 172.21.2.105:0/2937422132 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4f7c010070 con 0x7f4f8c0621b0 2021-11-12T05:48:55.675 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.660+0000 7f4f89ffb700 1 --2- 172.21.2.105:0/2937422132 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4f70053660 0x7f4f70055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:55.675 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.660+0000 7f4f89ffb700 1 -- 172.21.2.105:0/2937422132 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f4f7c06b300 con 0x7f4f8c0621b0 2021-11-12T05:48:55.675 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.660+0000 7f4f837fe700 1 --2- 172.21.2.105:0/2937422132 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4f70053660 0x7f4f70055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:55.675 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.660+0000 7f4f837fe700 1 --2- 172.21.2.105:0/2937422132 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4f70053660 0x7f4f70055b20 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f4f74002f70 tx=0x7f4f74006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:55.676 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.660+0000 7f4f89ffb700 1 -- 172.21.2.105:0/2937422132 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4f7c0421a0 con 0x7f4f8c0621b0 2021-11-12T05:48:55.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.744+0000 7f4f924c4700 1 -- 172.21.2.105:0/2937422132 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f4f640036c0 con 0x7f4f8c0621b0 2021-11-12T05:48:55.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.744+0000 7f4f89ffb700 1 -- 172.21.2.105:0/2937422132 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v127) v1 ==== 81+0+34218 (secure 0 0 0) 0x7f4f7c0457c0 con 0x7f4f8c0621b0 2021-11-12T05:48:55.750 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:55.751 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:48:55.751 INFO:teuthology.orchestra.run.gibba005.stdout: "epoch": 127, 2021-11-12T05:48:55.751 INFO:teuthology.orchestra.run.gibba005.stdout: "fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", 2021-11-12T05:48:55.751 INFO:teuthology.orchestra.run.gibba005.stdout: "created": "2021-11-12T05:40:19.986390+0000", 2021-11-12T05:48:55.752 INFO:teuthology.orchestra.run.gibba005.stdout: "modified": "2021-11-12T05:48:55.336277+0000", 2021-11-12T05:48:55.752 INFO:teuthology.orchestra.run.gibba005.stdout: "last_up_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:48:55.752 INFO:teuthology.orchestra.run.gibba005.stdout: "last_in_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:48:55.752 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-12T05:48:55.753 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_num": 5799936, 2021-11-12T05:48:55.753 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_set": [ 2021-11-12T05:48:55.753 INFO:teuthology.orchestra.run.gibba005.stdout: "pglog_hardlimit", 2021-11-12T05:48:55.753 INFO:teuthology.orchestra.run.gibba005.stdout: "purged_snapdirs", 2021-11-12T05:48:55.753 INFO:teuthology.orchestra.run.gibba005.stdout: "recovery_deletes", 2021-11-12T05:48:55.754 INFO:teuthology.orchestra.run.gibba005.stdout: "sortbitwise" 2021-11-12T05:48:55.754 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:48:55.754 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_version": 5, 2021-11-12T05:48:55.754 INFO:teuthology.orchestra.run.gibba005.stdout: "full_ratio": 0.94999998807907104, 2021-11-12T05:48:55.755 INFO:teuthology.orchestra.run.gibba005.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-12T05:48:55.755 INFO:teuthology.orchestra.run.gibba005.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-12T05:48:55.755 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_snapshot": "", 2021-11-12T05:48:55.755 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_max": 24, 2021-11-12T05:48:55.756 INFO:teuthology.orchestra.run.gibba005.stdout: "max_osd": 8, 2021-11-12T05:48:55.756 INFO:teuthology.orchestra.run.gibba005.stdout: "require_min_compat_client": "jewel", 2021-11-12T05:48:55.756 INFO:teuthology.orchestra.run.gibba005.stdout: "min_compat_client": "jewel", 2021-11-12T05:48:55.756 INFO:teuthology.orchestra.run.gibba005.stdout: "require_osd_release": "octopus", 2021-11-12T05:48:55.756 INFO:teuthology.orchestra.run.gibba005.stdout: "pools": [ 2021-11-12T05:48:55.757 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.757 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 1, 2021-11-12T05:48:55.757 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "device_health_metrics", 2021-11-12T05:48:55.757 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:22.022116+0000", 2021-11-12T05:48:55.758 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:48:55.758 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:48:55.758 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:48:55.758 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:48:55.758 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:48:55.759 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:48:55.759 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:48:55.759 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:48:55.759 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 1, 2021-11-12T05:48:55.760 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 1, 2021-11-12T05:48:55.760 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 1, 2021-11-12T05:48:55.760 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 1, 2021-11-12T05:48:55.760 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 1, 2021-11-12T05:48:55.761 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:48:55.761 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:48:55.761 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:48:55.761 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:48:55.762 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:48:55.762 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:48:55.762 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:48:55.762 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.762 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "16", 2021-11-12T05:48:55.763 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:48:55.763 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:48:55.763 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:48:55.763 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:48:55.764 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:48:55.764 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:48:55.764 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:48:55.764 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:48:55.764 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:48:55.765 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:48:55.765 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:48:55.765 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:48:55.765 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:48:55.766 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:48:55.766 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:48:55.766 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:48:55.766 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:48:55.766 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:48:55.767 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:48:55.767 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:48:55.767 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:48:55.767 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:48:55.768 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:48:55.768 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:48:55.768 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:48:55.768 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:48:55.769 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.769 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:48:55.769 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:48:55.769 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:48:55.769 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:48:55.770 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:48:55.770 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:48:55.770 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:48:55.770 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:48:55.771 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:48:55.771 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:48:55.771 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:48:55.771 INFO:teuthology.orchestra.run.gibba005.stdout: "options": { 2021-11-12T05:48:55.772 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_min": 1 2021-11-12T05:48:55.772 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.772 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:48:55.772 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr_devicehealth": {} 2021-11-12T05:48:55.773 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.773 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.773 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.773 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 2, 2021-11-12T05:48:55.773 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "rbd", 2021-11-12T05:48:55.774 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:29.953617+0000", 2021-11-12T05:48:55.774 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:48:55.774 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:48:55.774 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:48:55.775 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:48:55.775 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:48:55.775 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:48:55.775 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:48:55.776 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:48:55.776 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:48:55.776 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:48:55.776 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:48:55.776 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:48:55.777 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:48:55.777 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:48:55.777 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:48:55.777 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:48:55.778 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:48:55.778 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:48:55.778 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:48:55.778 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:48:55.779 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.779 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "19", 2021-11-12T05:48:55.779 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:48:55.779 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:48:55.779 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:48:55.780 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:48:55.780 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:48:55.780 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:48:55.780 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:48:55.781 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:48:55.781 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:48:55.781 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:48:55.781 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:48:55.782 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:48:55.782 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:48:55.782 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:48:55.782 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:48:55.782 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:48:55.783 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:48:55.783 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:48:55.783 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:48:55.783 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:48:55.784 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:48:55.784 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:48:55.784 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:48:55.784 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:48:55.785 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:48:55.785 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:48:55.785 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.785 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:48:55.785 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:48:55.786 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:48:55.786 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:48:55.786 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:48:55.786 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:48:55.787 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:48:55.787 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:48:55.787 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:48:55.787 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:48:55.787 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:48:55.788 INFO:teuthology.orchestra.run.gibba005.stdout: "options": {}, 2021-11-12T05:48:55.788 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:48:55.788 INFO:teuthology.orchestra.run.gibba005.stdout: "rbd": {} 2021-11-12T05:48:55.788 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.789 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.789 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.789 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 22, 2021-11-12T05:48:55.789 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "cephfs_data", 2021-11-12T05:48:55.789 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:48:26.409707+0000", 2021-11-12T05:48:55.790 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:48:55.790 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:48:55.790 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:48:55.790 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:48:55.791 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:48:55.791 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:48:55.791 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:48:55.791 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:48:55.792 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:48:55.792 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:48:55.792 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:48:55.792 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:48:55.792 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:48:55.793 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:48:55.793 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:48:55.793 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:48:55.793 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:48:55.793 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:48:55.794 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:48:55.794 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:48:55.794 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.794 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "127", 2021-11-12T05:48:55.795 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:48:55.795 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:48:55.795 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:48:55.795 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:48:55.795 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:48:55.796 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:48:55.796 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:48:55.796 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:48:55.796 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:48:55.797 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:48:55.797 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:48:55.797 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:48:55.797 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:48:55.797 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:48:55.798 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:48:55.798 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:48:55.798 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:48:55.798 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:48:55.798 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:48:55.799 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:48:55.799 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:48:55.799 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:48:55.799 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:48:55.800 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:48:55.800 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:48:55.800 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:48:55.800 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.800 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:48:55.801 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:48:55.801 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:48:55.801 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:48:55.801 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:48:55.801 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:48:55.802 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:48:55.802 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:48:55.802 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:48:55.802 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:48:55.803 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:48:55.803 INFO:teuthology.orchestra.run.gibba005.stdout: "options": {}, 2021-11-12T05:48:55.803 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:48:55.803 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs": { 2021-11-12T05:48:55.803 INFO:teuthology.orchestra.run.gibba005.stdout: "data": "cephfs" 2021-11-12T05:48:55.804 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.804 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.804 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.804 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.805 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 24, 2021-11-12T05:48:55.805 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "cephfs_metadata", 2021-11-12T05:48:55.805 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:48:54.316532+0000", 2021-11-12T05:48:55.805 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 32769, 2021-11-12T05:48:55.806 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool,creating", 2021-11-12T05:48:55.806 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:48:55.806 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:48:55.806 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:48:55.806 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:48:55.807 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:48:55.807 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:48:55.807 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:48:55.807 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:48:55.808 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:48:55.808 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:48:55.808 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:48:55.808 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:48:55.809 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:48:55.809 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:48:55.809 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:48:55.809 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:48:55.809 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:48:55.810 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:48:55.810 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.810 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "127", 2021-11-12T05:48:55.810 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:48:55.811 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:48:55.811 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:48:55.811 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:48:55.811 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:48:55.812 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:48:55.812 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:48:55.812 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:48:55.812 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:48:55.813 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:48:55.813 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:48:55.813 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:48:55.813 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:48:55.813 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:48:55.814 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:48:55.814 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:48:55.814 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:48:55.814 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:48:55.815 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:48:55.815 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:48:55.815 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:48:55.815 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:48:55.815 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:48:55.816 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:48:55.816 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:48:55.816 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:48:55.816 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.817 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:48:55.817 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:48:55.817 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:48:55.817 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:48:55.818 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:48:55.818 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:48:55.818 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:48:55.819 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:48:55.819 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:48:55.819 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:48:55.819 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:48:55.820 INFO:teuthology.orchestra.run.gibba005.stdout: "options": { 2021-11-12T05:48:55.820 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_bias": 4, 2021-11-12T05:48:55.820 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_min": 16, 2021-11-12T05:48:55.820 INFO:teuthology.orchestra.run.gibba005.stdout: "recovery_priority": 5 2021-11-12T05:48:55.821 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.821 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:48:55.821 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs": { 2021-11-12T05:48:55.821 INFO:teuthology.orchestra.run.gibba005.stdout: "metadata": "cephfs" 2021-11-12T05:48:55.822 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.822 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.822 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.822 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:48:55.823 INFO:teuthology.orchestra.run.gibba005.stdout: "osds": [ 2021-11-12T05:48:55.823 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.823 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:48:55.823 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "ee8e30a0-4819-4475-80ec-dd3ee7d01322", 2021-11-12T05:48:55.824 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:48:55.824 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:48:55.824 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:48:55.824 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:48:55.824 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:48:55.825 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:48:55.825 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:48:55.825 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 126, 2021-11-12T05:48:55.825 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:48:55.826 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:48:55.826 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:48:55.826 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:55.826 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.827 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:55.827 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6802", 2021-11-12T05:48:55.827 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:48:55.827 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.827 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.828 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:55.828 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6803", 2021-11-12T05:48:55.828 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:48:55.828 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.829 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.829 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.829 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:48:55.829 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:55.829 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.830 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:55.830 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6804", 2021-11-12T05:48:55.830 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:48:55.830 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.831 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.831 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:55.831 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6805", 2021-11-12T05:48:55.831 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:48:55.831 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.832 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.832 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.832 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:48:55.832 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:55.833 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.833 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:55.833 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6808", 2021-11-12T05:48:55.833 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:48:55.834 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.834 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.834 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:55.834 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6809", 2021-11-12T05:48:55.834 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:48:55.835 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.835 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.835 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.835 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:48:55.836 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:55.836 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.836 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:55.836 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6806", 2021-11-12T05:48:55.836 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:48:55.837 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.837 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.837 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:55.837 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6807", 2021-11-12T05:48:55.838 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:48:55.838 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.838 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.838 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.838 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6803/14874", 2021-11-12T05:48:55.839 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6805/14874", 2021-11-12T05:48:55.839 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6809/14874", 2021-11-12T05:48:55.839 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6807/14874", 2021-11-12T05:48:55.839 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:48:55.840 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:48:55.840 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:48:55.840 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.840 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.840 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.841 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:48:55.841 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "b1bb06c3-26d0-4d92-82f8-b3e882242785", 2021-11-12T05:48:55.841 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:48:55.841 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:48:55.842 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:48:55.842 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:48:55.842 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:48:55.842 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:48:55.842 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:48:55.843 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 126, 2021-11-12T05:48:55.843 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:48:55.843 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:48:55.843 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:48:55.844 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:55.844 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.844 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:55.844 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6810", 2021-11-12T05:48:55.844 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:48:55.845 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.845 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.845 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:55.845 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6811", 2021-11-12T05:48:55.846 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:48:55.846 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.846 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.846 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.846 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:48:55.847 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:55.847 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.847 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:55.847 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6812", 2021-11-12T05:48:55.848 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:48:55.848 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.848 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.848 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:55.848 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6813", 2021-11-12T05:48:55.849 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:48:55.849 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.849 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.849 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.850 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:48:55.850 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:55.850 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.850 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:55.850 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6816", 2021-11-12T05:48:55.851 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:48:55.851 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.851 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.851 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:55.851 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6817", 2021-11-12T05:48:55.852 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:48:55.852 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.852 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.852 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.853 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:48:55.853 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:55.853 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.853 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:55.853 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6814", 2021-11-12T05:48:55.854 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:48:55.854 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.854 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.854 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:55.854 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6815", 2021-11-12T05:48:55.855 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:48:55.855 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.855 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.855 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.856 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6811/14875", 2021-11-12T05:48:55.856 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6813/14875", 2021-11-12T05:48:55.856 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6817/14875", 2021-11-12T05:48:55.856 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6815/14875", 2021-11-12T05:48:55.856 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:48:55.857 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:48:55.857 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:48:55.857 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.857 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.857 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.858 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:48:55.858 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "837b2c60-c335-4382-9f47-d86543a14022", 2021-11-12T05:48:55.858 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:48:55.858 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:48:55.859 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:48:55.859 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:48:55.859 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:48:55.859 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:48:55.860 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:48:55.860 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 121, 2021-11-12T05:48:55.860 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:48:55.860 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:48:55.860 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:48:55.861 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:55.861 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.861 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:55.861 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6818", 2021-11-12T05:48:55.862 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:48:55.862 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.862 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.862 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:55.862 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6819", 2021-11-12T05:48:55.863 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:48:55.863 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.863 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.863 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.864 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:48:55.864 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:55.864 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.864 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:55.864 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6820", 2021-11-12T05:48:55.865 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:48:55.865 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.865 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.865 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:55.866 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6821", 2021-11-12T05:48:55.866 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:48:55.866 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.866 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.866 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.867 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:48:55.867 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:55.867 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.867 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:55.867 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6824", 2021-11-12T05:48:55.868 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:48:55.868 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.868 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.868 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:55.869 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6825", 2021-11-12T05:48:55.869 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:48:55.869 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.869 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.869 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.870 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:48:55.870 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:55.870 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.870 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:55.871 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6822", 2021-11-12T05:48:55.871 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:48:55.871 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.871 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.871 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:55.872 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6823", 2021-11-12T05:48:55.872 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:48:55.872 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.872 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.872 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.873 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6819/14905", 2021-11-12T05:48:55.873 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6821/14905", 2021-11-12T05:48:55.873 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6825/14905", 2021-11-12T05:48:55.873 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6823/14905", 2021-11-12T05:48:55.874 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:48:55.874 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:48:55.874 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:48:55.874 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.874 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.875 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.875 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:48:55.875 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "eb2b737b-dda6-444b-a306-f33cbbd51f70", 2021-11-12T05:48:55.875 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:48:55.876 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:48:55.876 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:48:55.876 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:48:55.876 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:48:55.876 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:48:55.877 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:48:55.877 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 126, 2021-11-12T05:48:55.877 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:48:55.877 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:48:55.878 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:48:55.878 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:55.878 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.878 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:55.878 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6826", 2021-11-12T05:48:55.879 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:48:55.879 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.879 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.879 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:55.880 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6827", 2021-11-12T05:48:55.880 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:48:55.880 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.880 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.880 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.881 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:48:55.881 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:55.881 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.881 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:55.881 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6828", 2021-11-12T05:48:55.882 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:48:55.882 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.882 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.882 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:55.883 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6829", 2021-11-12T05:48:55.883 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:48:55.883 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.883 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.883 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.884 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:48:55.884 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:55.884 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.884 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:55.885 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6832", 2021-11-12T05:48:55.885 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:48:55.885 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.885 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.885 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:55.886 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6833", 2021-11-12T05:48:55.886 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:48:55.886 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.886 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.887 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.887 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:48:55.887 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:55.887 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.887 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:55.888 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6830", 2021-11-12T05:48:55.888 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:48:55.888 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.888 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.889 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:55.889 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6831", 2021-11-12T05:48:55.889 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:48:55.889 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.889 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.890 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.890 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6827/14876", 2021-11-12T05:48:55.890 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6829/14876", 2021-11-12T05:48:55.890 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6833/14876", 2021-11-12T05:48:55.891 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6831/14876", 2021-11-12T05:48:55.891 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:48:55.891 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:48:55.891 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:48:55.891 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.892 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.892 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.892 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:48:55.892 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "721529a1-c047-486a-a7ca-ddc15d80cdde", 2021-11-12T05:48:55.892 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:48:55.893 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:48:55.893 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:48:55.893 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:48:55.893 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:48:55.894 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:48:55.894 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:48:55.894 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 121, 2021-11-12T05:48:55.894 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:48:55.895 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:48:55.895 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:48:55.895 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:55.895 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.896 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:55.896 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6800", 2021-11-12T05:48:55.896 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:48:55.896 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.896 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.897 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:55.897 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6801", 2021-11-12T05:48:55.897 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:48:55.897 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.897 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.898 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.898 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:48:55.898 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:55.898 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.899 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:55.899 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6802", 2021-11-12T05:48:55.899 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:48:55.899 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.899 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.900 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:55.900 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6803", 2021-11-12T05:48:55.900 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:48:55.900 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.901 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.901 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.901 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:48:55.901 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:55.901 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.902 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:55.902 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6806", 2021-11-12T05:48:55.902 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:48:55.902 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.903 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.903 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:55.903 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6807", 2021-11-12T05:48:55.903 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:48:55.903 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.904 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.904 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.904 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:48:55.904 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:55.904 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.905 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:55.905 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6804", 2021-11-12T05:48:55.905 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:48:55.905 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.906 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.906 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:55.906 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6805", 2021-11-12T05:48:55.906 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:48:55.906 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.907 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.907 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.907 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6801/15096", 2021-11-12T05:48:55.907 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6803/15096", 2021-11-12T05:48:55.908 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6807/15096", 2021-11-12T05:48:55.908 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6805/15096", 2021-11-12T05:48:55.908 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:48:55.908 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:48:55.908 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:48:55.909 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.909 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.909 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.909 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:48:55.910 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "68b72ab2-fa82-4b5c-bf33-528f002e4950", 2021-11-12T05:48:55.910 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:48:55.910 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:48:55.910 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:48:55.910 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:48:55.911 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:48:55.911 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:48:55.911 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:48:55.911 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 126, 2021-11-12T05:48:55.911 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:48:55.912 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:48:55.912 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:48:55.912 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:55.912 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.913 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:55.913 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6808", 2021-11-12T05:48:55.913 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:48:55.913 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.913 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.914 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:55.914 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6809", 2021-11-12T05:48:55.914 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:48:55.914 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.915 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.915 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.915 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:48:55.915 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:55.915 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.916 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:55.916 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6810", 2021-11-12T05:48:55.916 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:48:55.916 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.917 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.917 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:55.917 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6811", 2021-11-12T05:48:55.917 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:48:55.917 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.918 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.918 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.918 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:48:55.918 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:55.919 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.919 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:55.919 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6814", 2021-11-12T05:48:55.919 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:48:55.919 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.920 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.920 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:55.920 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6815", 2021-11-12T05:48:55.920 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:48:55.921 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.921 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.921 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.921 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:48:55.921 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:55.922 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.922 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:55.922 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6812", 2021-11-12T05:48:55.922 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:48:55.922 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.923 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.923 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:55.923 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6813", 2021-11-12T05:48:55.923 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:48:55.924 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.924 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.924 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.924 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6809/15097", 2021-11-12T05:48:55.925 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6811/15097", 2021-11-12T05:48:55.925 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6815/15097", 2021-11-12T05:48:55.925 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6813/15097", 2021-11-12T05:48:55.925 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:48:55.925 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:48:55.926 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:48:55.926 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.926 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.926 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.927 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:48:55.927 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "a2c83b5d-8d37-4d30-ac04-30d89a76e485", 2021-11-12T05:48:55.927 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:48:55.927 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:48:55.927 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:48:55.928 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:48:55.928 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:48:55.928 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:48:55.928 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:48:55.928 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 126, 2021-11-12T05:48:55.929 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:48:55.929 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:48:55.929 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:48:55.929 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:55.930 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.930 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:55.930 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6816", 2021-11-12T05:48:55.930 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:48:55.930 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.931 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.931 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:55.931 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6817", 2021-11-12T05:48:55.931 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:48:55.932 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.932 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.932 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.932 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:48:55.932 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:55.933 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.933 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:55.933 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6818", 2021-11-12T05:48:55.933 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:48:55.933 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.934 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.934 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:55.934 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6819", 2021-11-12T05:48:55.934 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:48:55.935 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.935 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.935 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.935 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:48:55.936 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:55.936 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.936 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:55.936 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6822", 2021-11-12T05:48:55.936 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:48:55.937 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.937 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.937 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:55.937 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6823", 2021-11-12T05:48:55.938 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:48:55.938 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.938 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.938 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.938 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:48:55.939 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:55.939 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.939 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:55.939 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6820", 2021-11-12T05:48:55.940 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:48:55.940 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.940 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.940 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:55.941 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6821", 2021-11-12T05:48:55.941 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:48:55.941 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.941 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.941 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.942 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6817/15098", 2021-11-12T05:48:55.942 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6819/15098", 2021-11-12T05:48:55.942 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6823/15098", 2021-11-12T05:48:55.942 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6821/15098", 2021-11-12T05:48:55.943 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:48:55.943 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:48:55.943 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:48:55.943 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.943 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.944 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.944 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:48:55.944 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "786ce966-d0fb-4181-aed4-c26e3ef61c43", 2021-11-12T05:48:55.944 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:48:55.945 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:48:55.945 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:48:55.945 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:48:55.945 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:48:55.946 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:48:55.946 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:48:55.946 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 126, 2021-11-12T05:48:55.946 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:48:55.946 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:48:55.947 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:48:55.947 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:55.947 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.947 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:55.947 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6824", 2021-11-12T05:48:55.948 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:48:55.948 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.948 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.948 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:55.949 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6825", 2021-11-12T05:48:55.949 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:48:55.949 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.949 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.949 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.950 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:48:55.950 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:55.950 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.950 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:55.950 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6826", 2021-11-12T05:48:55.951 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:48:55.951 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.951 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.951 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:55.952 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6827", 2021-11-12T05:48:55.952 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:48:55.952 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.952 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.952 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.953 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:48:55.953 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:55.953 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.953 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:55.954 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6830", 2021-11-12T05:48:55.954 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:48:55.954 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.954 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.954 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:55.955 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6831", 2021-11-12T05:48:55.955 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:48:55.955 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.955 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.956 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.956 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:48:55.956 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:48:55.956 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.956 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:48:55.957 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6828", 2021-11-12T05:48:55.957 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:48:55.957 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.957 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.958 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:48:55.958 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6829", 2021-11-12T05:48:55.958 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:48:55.958 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.958 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.959 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.959 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6825/15099", 2021-11-12T05:48:55.959 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6827/15099", 2021-11-12T05:48:55.959 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6831/15099", 2021-11-12T05:48:55.960 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6829/15099", 2021-11-12T05:48:55.960 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:48:55.960 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:48:55.960 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:48:55.960 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:48:55.961 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.961 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:48:55.961 INFO:teuthology.orchestra.run.gibba005.stdout: "osd_xinfo": [ 2021-11-12T05:48:55.961 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.962 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:48:55.962 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:48:55.962 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:48:55.962 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:48:55.962 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:48:55.963 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:48:55.963 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.615112+0000", 2021-11-12T05:48:55.963 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:48:55.963 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.964 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.964 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:48:55.964 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:48:55.964 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:48:55.964 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:48:55.965 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:48:55.965 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:48:55.965 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.665935+0000", 2021-11-12T05:48:55.965 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:48:55.965 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.966 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.966 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:48:55.966 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:48:55.966 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:48:55.967 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:48:55.967 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:48:55.967 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:48:55.967 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.715877+0000", 2021-11-12T05:48:55.967 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:48:55.968 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.968 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.968 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:48:55.968 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:48:55.969 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:48:55.969 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:48:55.969 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:48:55.969 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:48:55.969 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.489234+0000", 2021-11-12T05:48:55.970 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:48:55.970 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.970 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.970 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:48:55.971 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:48:55.971 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:48:55.971 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:48:55.971 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:48:55.971 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:48:55.972 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.413776+0000", 2021-11-12T05:48:55.972 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:48:55.972 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.972 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.973 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:48:55.973 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:48:55.973 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:48:55.973 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:48:55.973 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:48:55.974 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:48:55.974 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.507960+0000", 2021-11-12T05:48:55.974 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:48:55.974 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.974 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.975 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:48:55.975 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:48:55.975 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:48:55.975 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:48:55.976 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:48:55.976 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:48:55.976 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.635696+0000", 2021-11-12T05:48:55.976 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:48:55.976 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.977 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:48:55.977 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:48:55.977 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:48:55.977 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:48:55.978 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:48:55.978 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:48:55.978 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:48:55.978 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.746949+0000", 2021-11-12T05:48:55.978 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:48:55.979 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.979 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:48:55.979 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap": [], 2021-11-12T05:48:55.979 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap_items": [], 2021-11-12T05:48:55.980 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_temp": [], 2021-11-12T05:48:55.980 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_temp": [], 2021-11-12T05:48:55.980 INFO:teuthology.orchestra.run.gibba005.stdout: "blacklist": { 2021-11-12T05:48:55.980 INFO:teuthology.orchestra.run.gibba005.stdout: "172.21.2.105:6835/2721453399": "2021-11-13T05:48:41.834794+0000", 2021-11-12T05:48:55.980 INFO:teuthology.orchestra.run.gibba005.stdout: "172.21.2.105:6834/2721453399": "2021-11-13T05:48:41.834794+0000" 2021-11-12T05:48:55.981 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.981 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profiles": { 2021-11-12T05:48:55.981 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs_data": { 2021-11-12T05:48:55.981 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-device-class": "", 2021-11-12T05:48:55.981 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:48:55.982 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-root": "default", 2021-11-12T05:48:55.982 INFO:teuthology.orchestra.run.gibba005.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-12T05:48:55.982 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:48:55.982 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "2", 2021-11-12T05:48:55.983 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:48:55.983 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:48:55.983 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van", 2021-11-12T05:48:55.983 INFO:teuthology.orchestra.run.gibba005.stdout: "w": "8" 2021-11-12T05:48:55.983 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.984 INFO:teuthology.orchestra.run.gibba005.stdout: "default": { 2021-11-12T05:48:55.984 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:48:55.984 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:48:55.984 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "1", 2021-11-12T05:48:55.985 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:48:55.985 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:48:55.985 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van" 2021-11-12T05:48:55.985 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:48:55.985 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:48:55.986 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps_queue": [], 2021-11-12T05:48:55.986 INFO:teuthology.orchestra.run.gibba005.stdout: "new_removed_snaps": [], 2021-11-12T05:48:55.986 INFO:teuthology.orchestra.run.gibba005.stdout: "new_purged_snaps": [], 2021-11-12T05:48:55.986 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_node_flags": {}, 2021-11-12T05:48:55.986 INFO:teuthology.orchestra.run.gibba005.stdout: "device_class_flags": {} 2021-11-12T05:48:55.987 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:48:55.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.744+0000 7f4f924c4700 1 -- 172.21.2.105:0/2937422132 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4f70053660 msgr2=0x7f4f70055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:55.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.744+0000 7f4f924c4700 1 --2- 172.21.2.105:0/2937422132 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4f70053660 0x7f4f70055b20 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f4f74002f70 tx=0x7f4f74006a80).stop 2021-11-12T05:48:55.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.744+0000 7f4f924c4700 1 -- 172.21.2.105:0/2937422132 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4f8c0621b0 msgr2=0x7f4f8c0ad5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:55.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.744+0000 7f4f924c4700 1 --2- 172.21.2.105:0/2937422132 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4f8c0621b0 0x7f4f8c0ad5b0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7f4f8c0607f0 tx=0x7f4f7c007c40).stop 2021-11-12T05:48:55.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.744+0000 7f4f924c4700 1 -- 172.21.2.105:0/2937422132 shutdown_connections 2021-11-12T05:48:55.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.744+0000 7f4f924c4700 1 --2- 172.21.2.105:0/2937422132 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4f70053660 0x7f4f70055b20 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:55.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.744+0000 7f4f924c4700 1 --2- 172.21.2.105:0/2937422132 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4f8c0aece0 0x7f4f8c0af170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:55.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.744+0000 7f4f924c4700 1 --2- 172.21.2.105:0/2937422132 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4f8c143dc0 0x7f4f8c1492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:55.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.744+0000 7f4f924c4700 1 --2- 172.21.2.105:0/2937422132 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4f8c0621b0 0x7f4f8c0ad5b0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:55.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.744+0000 7f4f924c4700 1 -- 172.21.2.105:0/2937422132 >> 172.21.2.105:0/2937422132 conn(0x7f4f8c0b97b0 msgr2=0x7f4f8c141740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:55.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.744+0000 7f4f924c4700 1 -- 172.21.2.105:0/2937422132 shutdown_connections 2021-11-12T05:48:55.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:55.744+0000 7f4f924c4700 1 -- 172.21.2.105:0/2937422132 wait complete. 2021-11-12T05:48:55.992 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:48:56.046 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.040+0000 7fde76bd8700 1 Processor -- start 2021-11-12T05:48:56.047 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.040+0000 7fde76bd8700 1 -- start start 2021-11-12T05:48:56.047 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.044+0000 7fde76bd8700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fde700ad080 0x7fde700af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:56.048 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.044+0000 7fde76bd8700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fde700ac280 0x7fde700ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:56.048 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.044+0000 7fde76bd8700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde700ac7b0 con 0x7fde7014abe0 2021-11-12T05:48:56.048 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.044+0000 7fde76bd8700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde701488a0 con 0x7fde700ad080 2021-11-12T05:48:56.048 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.044+0000 7fde76bd8700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde700ac9e0 con 0x7fde700ac280 2021-11-12T05:48:56.049 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.044+0000 7fde6ffff700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fde700ac280 0x7fde700ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:56.049 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.044+0000 7fde74974700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fde700ad080 0x7fde700af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:56.050 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.044+0000 7fde75175700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7fde7014abe0 0x7fde7014b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:59854/0 (socket says 172.21.2.105:59854) 2021-11-12T05:48:56.050 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.044+0000 7fde75175700 1 -- 172.21.2.105:0/3341197278 learned_addr learned my addr 172.21.2.105:0/3341197278 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:56.050 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.044+0000 7fde74974700 1 -- 172.21.2.105:0/3341197278 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fde700ac280 msgr2=0x7fde700ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:56.050 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.044+0000 7fde74974700 1 --2- 172.21.2.105:0/3341197278 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fde700ac280 0x7fde700ad460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:56.051 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.044+0000 7fde74974700 1 -- 172.21.2.105:0/3341197278 >> v1:172.21.2.115:6789/0 conn(0x7fde7014abe0 legacy=0x7fde7014b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:56.051 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.044+0000 7fde74974700 1 -- 172.21.2.105:0/3341197278 --> v2:172.21.2.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde700b0b30 con 0x7fde700ad080 2021-11-12T05:48:56.051 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.044+0000 7fde74974700 1 --2- 172.21.2.105:0/3341197278 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fde700ad080 0x7fde700af730 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7fde58002f70 tx=0x7fde58006df0).ready entity=mon.1 client_cookie=ab48c88cc1ac9aff server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:56.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.044+0000 7fde6f7fe700 1 -- 172.21.2.105:0/3341197278 <== mon.1 v2:172.21.2.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde5800d570 con 0x7fde700ad080 2021-11-12T05:48:56.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.044+0000 7fde6f7fe700 1 -- 172.21.2.105:0/3341197278 <== mon.1 v2:172.21.2.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde58000e90 con 0x7fde700ad080 2021-11-12T05:48:56.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.044+0000 7fde6f7fe700 1 -- 172.21.2.105:0/3341197278 <== mon.1 v2:172.21.2.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde5800d8c0 con 0x7fde700ad080 2021-11-12T05:48:56.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.044+0000 7fde76bd8700 1 -- 172.21.2.105:0/3341197278 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fde700ad080 msgr2=0x7fde700af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:56.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.044+0000 7fde76bd8700 1 --2- 172.21.2.105:0/3341197278 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fde700ad080 0x7fde700af730 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7fde58002f70 tx=0x7fde58006df0).stop 2021-11-12T05:48:56.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.044+0000 7fde76bd8700 1 -- 172.21.2.105:0/3341197278 shutdown_connections 2021-11-12T05:48:56.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.044+0000 7fde76bd8700 1 --2- 172.21.2.105:0/3341197278 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fde700ac280 0x7fde700ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:56.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.044+0000 7fde76bd8700 1 --2- 172.21.2.105:0/3341197278 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fde700ad080 0x7fde700af730 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:56.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.044+0000 7fde76bd8700 1 -- 172.21.2.105:0/3341197278 >> 172.21.2.105:0/3341197278 conn(0x7fde700b5370 msgr2=0x7fde700b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:56.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.044+0000 7fde76bd8700 1 -- 172.21.2.105:0/3341197278 shutdown_connections 2021-11-12T05:48:56.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.044+0000 7fde76bd8700 1 -- 172.21.2.105:0/3341197278 wait complete. 2021-11-12T05:48:56.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.048+0000 7fde76bd8700 1 Processor -- start 2021-11-12T05:48:56.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.048+0000 7fde76bd8700 1 -- start start 2021-11-12T05:48:56.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.048+0000 7fde76bd8700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde700ac280 0x7fde70144d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:56.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.048+0000 7fde76bd8700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fde700ad080 0x7fde7015a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:56.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.048+0000 7fde76bd8700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fde7014abe0 0x7fde7015a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:56.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.048+0000 7fde76bd8700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde700ab0b0 con 0x7fde700ac280 2021-11-12T05:48:56.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.048+0000 7fde76bd8700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde700a7020 con 0x7fde7014abe0 2021-11-12T05:48:56.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.048+0000 7fde76bd8700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde700ab2e0 con 0x7fde700ad080 2021-11-12T05:48:56.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.048+0000 7fde74974700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde700ac280 0x7fde70144d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:56.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.048+0000 7fde74974700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde700ac280 0x7fde70144d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:50992/0 (socket says 172.21.2.105:50992) 2021-11-12T05:48:56.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.048+0000 7fde74974700 1 -- 172.21.2.105:0/3062909059 learned_addr learned my addr 172.21.2.105:0/3062909059 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:56.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.048+0000 7fde74974700 1 -- 172.21.2.105:0/3062909059 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fde700ad080 msgr2=0x7fde7015a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:56.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.048+0000 7fde74974700 1 --2- 172.21.2.105:0/3062909059 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fde700ad080 0x7fde7015a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:56.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.048+0000 7fde74974700 1 -- 172.21.2.105:0/3062909059 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fde7014abe0 msgr2=0x7fde7015a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:56.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.048+0000 7fde74974700 1 --2- 172.21.2.105:0/3062909059 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fde7014abe0 0x7fde7015a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:56.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.048+0000 7fde74974700 1 -- 172.21.2.105:0/3062909059 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5800b180 con 0x7fde700ac280 2021-11-12T05:48:56.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.048+0000 7fde74974700 1 --2- 172.21.2.105:0/3062909059 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde700ac280 0x7fde70144d50 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 rx=0x7fde58002f70 tx=0x7fde58014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:56.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.048+0000 7fde6dffb700 1 -- 172.21.2.105:0/3062909059 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde58016070 con 0x7fde700ac280 2021-11-12T05:48:56.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.048+0000 7fde6dffb700 1 -- 172.21.2.105:0/3062909059 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5800de40 con 0x7fde700ac280 2021-11-12T05:48:56.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.048+0000 7fde76bd8700 1 -- 172.21.2.105:0/3062909059 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde700a72c0 con 0x7fde700ac280 2021-11-12T05:48:56.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.048+0000 7fde6dffb700 1 -- 172.21.2.105:0/3062909059 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde5801e450 con 0x7fde700ac280 2021-11-12T05:48:56.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.048+0000 7fde76bd8700 1 -- 172.21.2.105:0/3062909059 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde7014a730 con 0x7fde700ac280 2021-11-12T05:48:56.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.048+0000 7fde76bd8700 1 -- 172.21.2.105:0/3062909059 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde700b1440 con 0x7fde700ac280 2021-11-12T05:48:56.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.048+0000 7fde6dffb700 1 -- 172.21.2.105:0/3062909059 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fde58025030 con 0x7fde700ac280 2021-11-12T05:48:56.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.048+0000 7fde6dffb700 1 --2- 172.21.2.105:0/3062909059 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fde54053660 0x7fde54055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:56.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.048+0000 7fde6dffb700 1 -- 172.21.2.105:0/3062909059 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6502+0+0 (secure 0 0 0) 0x7fde5806cc80 con 0x7fde700ac280 2021-11-12T05:48:56.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.048+0000 7fde6ffff700 1 --2- 172.21.2.105:0/3062909059 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fde54053660 0x7fde54055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:56.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.048+0000 7fde6ffff700 1 --2- 172.21.2.105:0/3062909059 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fde54053660 0x7fde54055b20 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7fde6000c000 tx=0x7fde60006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:56.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.052+0000 7fde6dffb700 1 -- 172.21.2.105:0/3062909059 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fde58073080 con 0x7fde700ac280 2021-11-12T05:48:56.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.160+0000 7fde76bd8700 1 -- 172.21.2.105:0/3062909059 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde70057350 con 0x7fde700ac280 2021-11-12T05:48:56.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.160+0000 7fde6dffb700 1 -- 172.21.2.105:0/3062909059 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+1426 (secure 0 0 0) 0x7fde58023020 con 0x7fde700ac280 2021-11-12T05:48:56.165 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:56.166 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":60,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:48:55.336383+0000","modified":"2021-11-12T05:48:55.336428+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[22],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2021-11-12T05:48:56.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.160+0000 7fde76bd8700 1 -- 172.21.2.105:0/3062909059 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fde54053660 msgr2=0x7fde54055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:56.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.160+0000 7fde76bd8700 1 --2- 172.21.2.105:0/3062909059 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fde54053660 0x7fde54055b20 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7fde6000c000 tx=0x7fde60006df0).stop 2021-11-12T05:48:56.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.160+0000 7fde76bd8700 1 -- 172.21.2.105:0/3062909059 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde700ac280 msgr2=0x7fde70144d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:56.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.160+0000 7fde76bd8700 1 --2- 172.21.2.105:0/3062909059 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde700ac280 0x7fde70144d50 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 rx=0x7fde58002f70 tx=0x7fde58014000).stop 2021-11-12T05:48:56.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.160+0000 7fde76bd8700 1 -- 172.21.2.105:0/3062909059 shutdown_connections 2021-11-12T05:48:56.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.160+0000 7fde76bd8700 1 --2- 172.21.2.105:0/3062909059 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fde54053660 0x7fde54055b20 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:56.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.160+0000 7fde76bd8700 1 --2- 172.21.2.105:0/3062909059 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fde7014abe0 0x7fde7015a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:56.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.160+0000 7fde76bd8700 1 --2- 172.21.2.105:0/3062909059 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fde700ad080 0x7fde7015a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:56.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.160+0000 7fde76bd8700 1 --2- 172.21.2.105:0/3062909059 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde700ac280 0x7fde70144d50 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:56.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.160+0000 7fde76bd8700 1 -- 172.21.2.105:0/3062909059 >> 172.21.2.105:0/3062909059 conn(0x7fde700b5370 msgr2=0x7fde700b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:56.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.160+0000 7fde76bd8700 1 -- 172.21.2.105:0/3062909059 shutdown_connections 2021-11-12T05:48:56.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.160+0000 7fde76bd8700 1 -- 172.21.2.105:0/3062909059 wait complete. 2021-11-12T05:48:56.170 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 60 2021-11-12T05:48:56.173 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-12T05:48:56.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.220+0000 7f0463134700 1 Processor -- start 2021-11-12T05:48:56.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.220+0000 7f0463134700 1 -- start start 2021-11-12T05:48:56.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.220+0000 7f0463134700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f045c0b0bf0 0x7f045c142e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:56.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.220+0000 7f0463134700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f045c0b43f0 con 0x7f045c143dc0 2021-11-12T05:48:56.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.220+0000 7f0463134700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f045c062590 con 0x7f045c0621b0 2021-11-12T05:48:56.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.220+0000 7f0463134700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f045c0b6590 con 0x7f045c0b0bf0 2021-11-12T05:48:56.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.220+0000 7f045bfff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f045c0b0bf0 0x7f045c142e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:56.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.220+0000 7f04616d1700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f045c143dc0 0x7f045c1468b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:33164/0 (socket says 172.21.2.105:33164) 2021-11-12T05:48:56.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.220+0000 7f04616d1700 1 -- 172.21.2.105:0/2982274476 learned_addr learned my addr 172.21.2.105:0/2982274476 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:56.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.220+0000 7f045bfff700 1 -- 172.21.2.105:0/2982274476 >> v1:172.21.2.115:6789/0 conn(0x7f045c0621b0 legacy=0x7f045c1436b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:56.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.220+0000 7f045bfff700 1 -- 172.21.2.105:0/2982274476 >> v1:172.21.2.105:6789/0 conn(0x7f045c143dc0 legacy=0x7f045c1468b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:56.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.220+0000 7f045bfff700 1 -- 172.21.2.105:0/2982274476 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f045c0b4150 con 0x7f045c0b0bf0 2021-11-12T05:48:56.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.220+0000 7f045bfff700 1 --2- 172.21.2.105:0/2982274476 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f045c0b0bf0 0x7f045c142e60 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 rx=0x7f045c063460 tx=0x7f0444006df0).ready entity=mon.0 client_cookie=592610e53fa7b4e2 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:56.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.220+0000 7f045b7fe700 1 -- 172.21.2.105:0/2982274476 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f044400d5c0 con 0x7f045c0b0bf0 2021-11-12T05:48:56.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.220+0000 7f045b7fe700 1 -- 172.21.2.105:0/2982274476 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0444000e90 con 0x7f045c0b0bf0 2021-11-12T05:48:56.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.220+0000 7f045b7fe700 1 -- 172.21.2.105:0/2982274476 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f044400d910 con 0x7f045c0b0bf0 2021-11-12T05:48:56.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.220+0000 7f0463134700 1 -- 172.21.2.105:0/2982274476 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f045c0b0bf0 msgr2=0x7f045c142e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:56.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.220+0000 7f0463134700 1 --2- 172.21.2.105:0/2982274476 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f045c0b0bf0 0x7f045c142e60 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 rx=0x7f045c063460 tx=0x7f0444006df0).stop 2021-11-12T05:48:56.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.220+0000 7f0463134700 1 -- 172.21.2.105:0/2982274476 shutdown_connections 2021-11-12T05:48:56.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.220+0000 7f0463134700 1 --2- 172.21.2.105:0/2982274476 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f045c0b0bf0 0x7f045c142e60 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:56.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.220+0000 7f0463134700 1 -- 172.21.2.105:0/2982274476 >> 172.21.2.105:0/2982274476 conn(0x7f045c0b97b0 msgr2=0x7f045c0b9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:56.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.220+0000 7f0463134700 1 -- 172.21.2.105:0/2982274476 shutdown_connections 2021-11-12T05:48:56.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.220+0000 7f0463134700 1 -- 172.21.2.105:0/2982274476 wait complete. 2021-11-12T05:48:56.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.220+0000 7f0463134700 1 Processor -- start 2021-11-12T05:48:56.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.220+0000 7f0463134700 1 -- start start 2021-11-12T05:48:56.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.220+0000 7f0463134700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f045c0621b0 0x7f045c141f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:56.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.220+0000 7f0463134700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f045c143dc0 0x7f045c0af0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:56.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.220+0000 7f0463134700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f045c0b00d0 0x7f045c0af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:56.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.220+0000 7f0463134700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045c152490 con 0x7f045c0621b0 2021-11-12T05:48:56.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.220+0000 7f0463134700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045c145a40 con 0x7f045c0b00d0 2021-11-12T05:48:56.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.220+0000 7f0463134700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f045c145ce0 con 0x7f045c143dc0 2021-11-12T05:48:56.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.220+0000 7f0460ed0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f045c0621b0 0x7f045c141f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:56.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.220+0000 7f0460ed0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f045c0621b0 0x7f045c141f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51006/0 (socket says 172.21.2.105:51006) 2021-11-12T05:48:56.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.220+0000 7f0460ed0700 1 -- 172.21.2.105:0/115908062 learned_addr learned my addr 172.21.2.105:0/115908062 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:56.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.224+0000 7f0460ed0700 1 -- 172.21.2.105:0/115908062 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f045c143dc0 msgr2=0x7f045c0af0e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:48:56.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.224+0000 7f0460ed0700 1 --2- 172.21.2.105:0/115908062 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f045c143dc0 0x7f045c0af0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:56.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.224+0000 7f0460ed0700 1 -- 172.21.2.105:0/115908062 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f045c0b00d0 msgr2=0x7f045c0af5d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:48:56.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.224+0000 7f0460ed0700 1 --2- 172.21.2.105:0/115908062 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f045c0b00d0 0x7f045c0af5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:56.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.224+0000 7f0460ed0700 1 -- 172.21.2.105:0/115908062 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f044400b180 con 0x7f045c0621b0 2021-11-12T05:48:56.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.224+0000 7f0460ed0700 1 --2- 172.21.2.105:0/115908062 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f045c0621b0 0x7f045c141f20 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 rx=0x7f044c002f90 tx=0x7f044c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:56.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.224+0000 7f0459ffb700 1 -- 172.21.2.105:0/115908062 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f044c013460 con 0x7f045c0621b0 2021-11-12T05:48:56.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.224+0000 7f0459ffb700 1 -- 172.21.2.105:0/115908062 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044c0135c0 con 0x7f045c0621b0 2021-11-12T05:48:56.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.224+0000 7f0459ffb700 1 -- 172.21.2.105:0/115908062 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f044c013920 con 0x7f045c0621b0 2021-11-12T05:48:56.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.224+0000 7f0463134700 1 -- 172.21.2.105:0/115908062 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f045c145f80 con 0x7f045c0621b0 2021-11-12T05:48:56.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.224+0000 7f0463134700 1 -- 172.21.2.105:0/115908062 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f045c144d00 con 0x7f045c0621b0 2021-11-12T05:48:56.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.224+0000 7f0463134700 1 -- 172.21.2.105:0/115908062 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f045c145010 con 0x7f045c0621b0 2021-11-12T05:48:56.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.224+0000 7f0459ffb700 1 -- 172.21.2.105:0/115908062 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f044c00f070 con 0x7f045c0621b0 2021-11-12T05:48:56.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.224+0000 7f0459ffb700 1 --2- 172.21.2.105:0/115908062 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f04400535b0 0x7f0440055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:56.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.224+0000 7f0459ffb700 1 -- 172.21.2.105:0/115908062 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f044c06b2a0 con 0x7f045c0621b0 2021-11-12T05:48:56.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.224+0000 7f045bfff700 1 --2- 172.21.2.105:0/115908062 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f04400535b0 0x7f0440055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:56.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.224+0000 7f045bfff700 1 --2- 172.21.2.105:0/115908062 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f04400535b0 0x7f0440055a70 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f045c063460 tx=0x7f0444012000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:56.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.224+0000 7f0459ffb700 1 -- 172.21.2.105:0/115908062 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f045c145010 con 0x7f045c0621b0 2021-11-12T05:48:56.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:56.332+0000 7f0463134700 1 -- 172.21.2.105:0/115908062 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f045c145010 con 0x7f045c0621b0 2021-11-12T05:48:57.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.168+0000 7f0459ffb700 1 -- 172.21.2.105:0/115908062 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v61) v1 ==== 161+0+0 (secure 0 0 0) 0x7f045c145010 con 0x7f045c0621b0 2021-11-12T05:48:57.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.168+0000 7f0463134700 1 -- 172.21.2.105:0/115908062 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f04400535b0 msgr2=0x7f0440055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:57.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.168+0000 7f0463134700 1 --2- 172.21.2.105:0/115908062 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f04400535b0 0x7f0440055a70 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f045c063460 tx=0x7f0444012000).stop 2021-11-12T05:48:57.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.168+0000 7f0463134700 1 -- 172.21.2.105:0/115908062 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f045c0621b0 msgr2=0x7f045c141f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:57.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.168+0000 7f0463134700 1 --2- 172.21.2.105:0/115908062 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f045c0621b0 0x7f045c141f20 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 rx=0x7f044c002f90 tx=0x7f044c006df0).stop 2021-11-12T05:48:57.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.168+0000 7f0463134700 1 -- 172.21.2.105:0/115908062 shutdown_connections 2021-11-12T05:48:57.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.168+0000 7f0463134700 1 --2- 172.21.2.105:0/115908062 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f04400535b0 0x7f0440055a70 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:57.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.168+0000 7f0463134700 1 --2- 172.21.2.105:0/115908062 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f045c0b00d0 0x7f045c0af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:57.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.168+0000 7f0463134700 1 --2- 172.21.2.105:0/115908062 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f045c143dc0 0x7f045c0af0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:57.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.168+0000 7f0463134700 1 --2- 172.21.2.105:0/115908062 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f045c0621b0 0x7f045c141f20 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:57.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.168+0000 7f0463134700 1 -- 172.21.2.105:0/115908062 >> 172.21.2.105:0/115908062 conn(0x7f045c0b97b0 msgr2=0x7f045c0b9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:57.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.168+0000 7f0463134700 1 -- 172.21.2.105:0/115908062 shutdown_connections 2021-11-12T05:48:57.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.168+0000 7f0463134700 1 -- 172.21.2.105:0/115908062 wait complete. 2021-11-12T05:48:57.177 INFO:teuthology.orchestra.run.gibba005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-12T05:48:57.181 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:48:57.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.228+0000 7f6c73848700 1 Processor -- start 2021-11-12T05:48:57.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.228+0000 7f6c73848700 1 -- start start 2021-11-12T05:48:57.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.228+0000 7f6c73848700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f6c6c0ac280 0x7f6c6c14b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:57.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.228+0000 7f6c73848700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f6c6c0af730 0x7f6c6c0ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:57.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.228+0000 7f6c73848700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c6c0ac7b0 con 0x7f6c6c0ad080 2021-11-12T05:48:57.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.228+0000 7f6c73848700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c6c1488a0 con 0x7f6c6c0ac280 2021-11-12T05:48:57.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.228+0000 7f6c73848700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c6c0ac9e0 con 0x7f6c6c0af730 2021-11-12T05:48:57.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.228+0000 7f6c70de3700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f6c6c0ac280 0x7f6c6c14b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:57.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c70de3700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f6c6c0ac280 0x7f6c6c14b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51018/0 (socket says 172.21.2.105:51018) 2021-11-12T05:48:57.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c70de3700 1 -- 172.21.2.105:0/628142734 learned_addr learned my addr 172.21.2.105:0/628142734 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:57.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c70de3700 1 -- 172.21.2.105:0/628142734 >> v2:172.21.2.115:3300/0 conn(0x7f6c6c0af730 msgr2=0x7f6c6c0ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:57.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c70de3700 1 --2- 172.21.2.105:0/628142734 >> v2:172.21.2.115:3300/0 conn(0x7f6c6c0af730 0x7f6c6c0ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:57.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c70de3700 1 -- 172.21.2.105:0/628142734 >> v1:172.21.2.105:6789/0 conn(0x7f6c6c0ad080 legacy=0x7f6c6c14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:57.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c70de3700 1 -- 172.21.2.105:0/628142734 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c6c0b0b30 con 0x7f6c6c0ac280 2021-11-12T05:48:57.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c70de3700 1 --2- 172.21.2.105:0/628142734 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6c6c0ac280 0x7f6c6c14b2f0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7f6c6c0b1000 tx=0x7f6c68006eb0).ready entity=mon.0 client_cookie=281e7a493163608d server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:57.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c5ffff700 1 -- 172.21.2.105:0/628142734 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c6800d610 con 0x7f6c6c0ac280 2021-11-12T05:48:57.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c5ffff700 1 -- 172.21.2.105:0/628142734 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c68000e90 con 0x7f6c6c0ac280 2021-11-12T05:48:57.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c5ffff700 1 -- 172.21.2.105:0/628142734 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c6800d960 con 0x7f6c6c0ac280 2021-11-12T05:48:57.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c73848700 1 -- 172.21.2.105:0/628142734 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6c6c0ac280 msgr2=0x7f6c6c14b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:57.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c73848700 1 --2- 172.21.2.105:0/628142734 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6c6c0ac280 0x7f6c6c14b2f0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7f6c6c0b1000 tx=0x7f6c68006eb0).stop 2021-11-12T05:48:57.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c73848700 1 -- 172.21.2.105:0/628142734 shutdown_connections 2021-11-12T05:48:57.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c73848700 1 --2- 172.21.2.105:0/628142734 >> v2:172.21.2.115:3300/0 conn(0x7f6c6c0af730 0x7f6c6c0ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:57.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c73848700 1 --2- 172.21.2.105:0/628142734 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6c6c0ac280 0x7f6c6c14b2f0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:57.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c73848700 1 -- 172.21.2.105:0/628142734 >> 172.21.2.105:0/628142734 conn(0x7f6c6c0b5370 msgr2=0x7f6c6c0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:57.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c73848700 1 -- 172.21.2.105:0/628142734 shutdown_connections 2021-11-12T05:48:57.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c73848700 1 -- 172.21.2.105:0/628142734 wait complete. 2021-11-12T05:48:57.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c73848700 1 Processor -- start 2021-11-12T05:48:57.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c73848700 1 -- start start 2021-11-12T05:48:57.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c73848700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6c6c0ac280 0x7f6c6c0a9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:57.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c73848700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6c6c0ad080 0x7f6c6c157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:57.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c73848700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6c6c0af730 0x7f6c6c05fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:57.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c73848700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6c157b00 con 0x7f6c6c0af730 2021-11-12T05:48:57.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c73848700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6c0a8e70 con 0x7f6c6c0ac280 2021-11-12T05:48:57.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c73848700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6c0a8a90 con 0x7f6c6c0ad080 2021-11-12T05:48:57.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c71de5700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6c6c0af730 0x7f6c6c05fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:57.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c71de5700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6c6c0af730 0x7f6c6c05fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51020/0 (socket says 172.21.2.105:51020) 2021-11-12T05:48:57.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c71de5700 1 -- 172.21.2.105:0/3477424141 learned_addr learned my addr 172.21.2.105:0/3477424141 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:57.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c71de5700 1 -- 172.21.2.105:0/3477424141 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6c6c0ad080 msgr2=0x7f6c6c157610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:57.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c71de5700 1 --2- 172.21.2.105:0/3477424141 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6c6c0ad080 0x7f6c6c157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:57.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c71de5700 1 -- 172.21.2.105:0/3477424141 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6c6c0ac280 msgr2=0x7f6c6c0a9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:57.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c71de5700 1 --2- 172.21.2.105:0/3477424141 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6c6c0ac280 0x7f6c6c0a9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:57.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c71de5700 1 -- 172.21.2.105:0/3477424141 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c6800b1e0 con 0x7f6c6c0af730 2021-11-12T05:48:57.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c71de5700 1 --2- 172.21.2.105:0/3477424141 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6c6c0af730 0x7f6c6c05fa70 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 rx=0x7f6c640032f0 tx=0x7f6c640091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:57.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c5e7fc700 1 -- 172.21.2.105:0/3477424141 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c6400d4a0 con 0x7f6c6c0af730 2021-11-12T05:48:57.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c5e7fc700 1 -- 172.21.2.105:0/3477424141 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6400d600 con 0x7f6c6c0af730 2021-11-12T05:48:57.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c5e7fc700 1 -- 172.21.2.105:0/3477424141 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c6400d960 con 0x7f6c6c0af730 2021-11-12T05:48:57.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c73848700 1 -- 172.21.2.105:0/3477424141 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c6c0a87f0 con 0x7f6c6c0af730 2021-11-12T05:48:57.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.232+0000 7f6c73848700 1 -- 172.21.2.105:0/3477424141 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c6c05ffe0 con 0x7f6c6c0af730 2021-11-12T05:48:57.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.236+0000 7f6c73848700 1 -- 172.21.2.105:0/3477424141 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c6c0a8650 con 0x7f6c6c0af730 2021-11-12T05:48:57.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.236+0000 7f6c5e7fc700 1 -- 172.21.2.105:0/3477424141 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6c64018030 con 0x7f6c6c0af730 2021-11-12T05:48:57.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.236+0000 7f6c5e7fc700 1 --2- 172.21.2.105:0/3477424141 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6c4c053660 0x7f6c4c055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:57.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.236+0000 7f6c5e7fc700 1 -- 172.21.2.105:0/3477424141 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f6c6406b620 con 0x7f6c6c0af730 2021-11-12T05:48:57.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.236+0000 7f6c715e4700 1 --2- 172.21.2.105:0/3477424141 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6c4c053660 0x7f6c4c055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:57.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.236+0000 7f6c715e4700 1 --2- 172.21.2.105:0/3477424141 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6c4c053660 0x7f6c4c055b20 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f6c6c0b0eb0 tx=0x7f6c60007810).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:57.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.236+0000 7f6c5e7fc700 1 -- 172.21.2.105:0/3477424141 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6c6c0a8650 con 0x7f6c6c0af730 2021-11-12T05:48:57.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.344+0000 7f6c73848700 1 -- 172.21.2.105:0/3477424141 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c6c0a8650 con 0x7f6c6c0af730 2021-11-12T05:48:57.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.344+0000 7f6c5e7fc700 1 -- 172.21.2.105:0/3477424141 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+1426 (secure 0 0 0) 0x7f6c6c0a8650 con 0x7f6c6c0af730 2021-11-12T05:48:57.350 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:48:57.350 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":61,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":61,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:48:55.336383+0000","modified":"2021-11-12T05:48:57.159879+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[22],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2021-11-12T05:48:57.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.344+0000 7f6c73848700 1 -- 172.21.2.105:0/3477424141 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6c4c053660 msgr2=0x7f6c4c055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:57.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.344+0000 7f6c73848700 1 --2- 172.21.2.105:0/3477424141 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6c4c053660 0x7f6c4c055b20 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f6c6c0b0eb0 tx=0x7f6c60007810).stop 2021-11-12T05:48:57.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.344+0000 7f6c73848700 1 -- 172.21.2.105:0/3477424141 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6c6c0af730 msgr2=0x7f6c6c05fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:57.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.344+0000 7f6c73848700 1 --2- 172.21.2.105:0/3477424141 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6c6c0af730 0x7f6c6c05fa70 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 rx=0x7f6c640032f0 tx=0x7f6c640091a0).stop 2021-11-12T05:48:57.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.344+0000 7f6c73848700 1 -- 172.21.2.105:0/3477424141 shutdown_connections 2021-11-12T05:48:57.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.344+0000 7f6c73848700 1 --2- 172.21.2.105:0/3477424141 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6c4c053660 0x7f6c4c055b20 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:57.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.344+0000 7f6c73848700 1 --2- 172.21.2.105:0/3477424141 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6c6c0af730 0x7f6c6c05fa70 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:57.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.344+0000 7f6c73848700 1 --2- 172.21.2.105:0/3477424141 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6c6c0ad080 0x7f6c6c157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:57.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.344+0000 7f6c73848700 1 --2- 172.21.2.105:0/3477424141 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6c6c0ac280 0x7f6c6c0a9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:57.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.344+0000 7f6c73848700 1 -- 172.21.2.105:0/3477424141 >> 172.21.2.105:0/3477424141 conn(0x7f6c6c0b5370 msgr2=0x7f6c6c0b4900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:57.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.344+0000 7f6c73848700 1 -- 172.21.2.105:0/3477424141 shutdown_connections 2021-11-12T05:48:57.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.344+0000 7f6c73848700 1 -- 172.21.2.105:0/3477424141 wait complete. 2021-11-12T05:48:57.354 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 61 2021-11-12T05:48:57.357 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-12T05:48:57.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.412+0000 7f7845ff7700 1 Processor -- start 2021-11-12T05:48:57.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.412+0000 7f7845ff7700 1 -- start start 2021-11-12T05:48:57.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.412+0000 7f7845ff7700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f78400aca40 0x7f78400ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:57.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.412+0000 7f7845ff7700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f78400b0520 0x7f78401473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:57.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.412+0000 7f7845ff7700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78400b1840 con 0x7f78401478b0 2021-11-12T05:48:57.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.412+0000 7f7845ff7700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7840147d40 con 0x7f78400aca40 2021-11-12T05:48:57.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.412+0000 7f7845ff7700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78400af2b0 con 0x7f78400b0520 2021-11-12T05:48:57.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.412+0000 7f783f7fe700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f78400aca40 0x7f78400ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:57.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.412+0000 7f783ffff700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7f78401478b0 0x7f7840144180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:59894/0 (socket says 172.21.2.105:59894) 2021-11-12T05:48:57.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.412+0000 7f783ffff700 1 -- 172.21.2.105:0/2988338684 learned_addr learned my addr 172.21.2.105:0/2988338684 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:57.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.412+0000 7f783effd700 1 --2- 172.21.2.105:0/2988338684 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f78400b0520 0x7f78401473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:57.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.412+0000 7f783f7fe700 1 -- 172.21.2.105:0/2988338684 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f78400b0520 msgr2=0x7f78401473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:57.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.412+0000 7f783f7fe700 1 --2- 172.21.2.105:0/2988338684 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f78400b0520 0x7f78401473c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:57.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.412+0000 7f783f7fe700 1 -- 172.21.2.105:0/2988338684 >> v1:172.21.2.115:6789/0 conn(0x7f78401478b0 legacy=0x7f7840144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:57.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.412+0000 7f783f7fe700 1 -- 172.21.2.105:0/2988338684 --> v2:172.21.2.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78400b09a0 con 0x7f78400aca40 2021-11-12T05:48:57.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.412+0000 7f783effd700 1 --2- 172.21.2.105:0/2988338684 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f78400b0520 0x7f78401473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-12T05:48:57.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.416+0000 7f783f7fe700 1 --2- 172.21.2.105:0/2988338684 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f78400aca40 0x7f78400ace20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f7828002f70 tx=0x7f7828006df0).ready entity=mon.1 client_cookie=3283c7a0893f8d02 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:57.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.416+0000 7f783e7fc700 1 -- 172.21.2.105:0/2988338684 <== mon.1 v2:172.21.2.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f782800d570 con 0x7f78400aca40 2021-11-12T05:48:57.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.416+0000 7f783e7fc700 1 -- 172.21.2.105:0/2988338684 <== mon.1 v2:172.21.2.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7828000e90 con 0x7f78400aca40 2021-11-12T05:48:57.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.416+0000 7f783e7fc700 1 -- 172.21.2.105:0/2988338684 <== mon.1 v2:172.21.2.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f782800d8c0 con 0x7f78400aca40 2021-11-12T05:48:57.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.416+0000 7f7845ff7700 1 -- 172.21.2.105:0/2988338684 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f78400aca40 msgr2=0x7f78400ace20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:57.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.416+0000 7f7845ff7700 1 --2- 172.21.2.105:0/2988338684 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f78400aca40 0x7f78400ace20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f7828002f70 tx=0x7f7828006df0).stop 2021-11-12T05:48:57.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.416+0000 7f7845ff7700 1 -- 172.21.2.105:0/2988338684 shutdown_connections 2021-11-12T05:48:57.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.416+0000 7f7845ff7700 1 --2- 172.21.2.105:0/2988338684 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f78400b0520 0x7f78401473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:57.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.416+0000 7f7845ff7700 1 --2- 172.21.2.105:0/2988338684 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f78400aca40 0x7f78400ace20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:57.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.416+0000 7f7845ff7700 1 -- 172.21.2.105:0/2988338684 >> 172.21.2.105:0/2988338684 conn(0x7f784005c490 msgr2=0x7f78400b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:57.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.416+0000 7f7845ff7700 1 -- 172.21.2.105:0/2988338684 shutdown_connections 2021-11-12T05:48:57.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.416+0000 7f7845ff7700 1 -- 172.21.2.105:0/2988338684 wait complete. 2021-11-12T05:48:57.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.420+0000 7f7845ff7700 1 Processor -- start 2021-11-12T05:48:57.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.420+0000 7f7845ff7700 1 -- start start 2021-11-12T05:48:57.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.424+0000 7f7845ff7700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f78400aca40 0x7f7840066e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:57.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.424+0000 7f7845ff7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f78400b0520 0x7f78401497b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:57.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.424+0000 7f7845ff7700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f78401478b0 0x7f7840062460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:57.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.424+0000 7f7845ff7700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7840066930 con 0x7f78400b0520 2021-11-12T05:48:57.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.424+0000 7f7845ff7700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7840066bd0 con 0x7f78400aca40 2021-11-12T05:48:57.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.424+0000 7f7845ff7700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7840062950 con 0x7f78401478b0 2021-11-12T05:48:57.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.424+0000 7f783effd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f78400b0520 0x7f78401497b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:57.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.424+0000 7f783effd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f78400b0520 0x7f78401497b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51036/0 (socket says 172.21.2.105:51036) 2021-11-12T05:48:57.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.424+0000 7f783effd700 1 -- 172.21.2.105:0/2437584592 learned_addr learned my addr 172.21.2.105:0/2437584592 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:57.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.424+0000 7f783f7fe700 1 --2- 172.21.2.105:0/2437584592 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f78400aca40 0x7f7840066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:57.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.424+0000 7f783ffff700 1 --2- 172.21.2.105:0/2437584592 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f78401478b0 0x7f7840062460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:57.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.424+0000 7f783effd700 1 -- 172.21.2.105:0/2437584592 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f78401478b0 msgr2=0x7f7840062460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:57.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.424+0000 7f783effd700 1 --2- 172.21.2.105:0/2437584592 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f78401478b0 0x7f7840062460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:57.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.424+0000 7f783effd700 1 -- 172.21.2.105:0/2437584592 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f78400aca40 msgr2=0x7f7840066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:57.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.424+0000 7f783effd700 1 --2- 172.21.2.105:0/2437584592 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f78400aca40 0x7f7840066e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:57.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.424+0000 7f783effd700 1 -- 172.21.2.105:0/2437584592 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f783000b180 con 0x7f78400b0520 2021-11-12T05:48:57.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.428+0000 7f783effd700 1 --2- 172.21.2.105:0/2437584592 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f78400b0520 0x7f78401497b0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7f783000c000 tx=0x7f7830006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:57.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.428+0000 7f783cff9700 1 -- 172.21.2.105:0/2437584592 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f783000c7e0 con 0x7f78400b0520 2021-11-12T05:48:57.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.428+0000 7f783cff9700 1 -- 172.21.2.105:0/2437584592 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783000c940 con 0x7f78400b0520 2021-11-12T05:48:57.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.428+0000 7f783cff9700 1 -- 172.21.2.105:0/2437584592 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f783000cca0 con 0x7f78400b0520 2021-11-12T05:48:57.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.428+0000 7f7845ff7700 1 -- 172.21.2.105:0/2437584592 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f782800b180 con 0x7f78400b0520 2021-11-12T05:48:57.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.428+0000 7f7845ff7700 1 -- 172.21.2.105:0/2437584592 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7840062c50 con 0x7f78400b0520 2021-11-12T05:48:57.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.432+0000 7f7845ff7700 1 -- 172.21.2.105:0/2437584592 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78401570c0 con 0x7f78400b0520 2021-11-12T05:48:57.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.432+0000 7f783cff9700 1 -- 172.21.2.105:0/2437584592 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f783001c460 con 0x7f78400b0520 2021-11-12T05:48:57.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.432+0000 7f783cff9700 1 --2- 172.21.2.105:0/2437584592 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7824053600 0x7f7824055ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:57.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.432+0000 7f783cff9700 1 -- 172.21.2.105:0/2437584592 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f783006c110 con 0x7f78400b0520 2021-11-12T05:48:57.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.432+0000 7f783f7fe700 1 --2- 172.21.2.105:0/2437584592 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7824053600 0x7f7824055ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:57.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.436+0000 7f783f7fe700 1 --2- 172.21.2.105:0/2437584592 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7824053600 0x7f7824055ac0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f782801a000 tx=0x7f7828014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:57.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.444+0000 7f783cff9700 1 -- 172.21.2.105:0/2437584592 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f78401570c0 con 0x7f78400b0520 2021-11-12T05:48:57.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:57.596+0000 7f7845ff7700 1 -- 172.21.2.105:0/2437584592 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f78401570c0 con 0x7f78400b0520 2021-11-12T05:48:58.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.176+0000 7f783cff9700 1 -- 172.21.2.105:0/2437584592 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v62) v1 ==== 104+0+0 (secure 0 0 0) 0x7f78401570c0 con 0x7f78400b0520 2021-11-12T05:48:58.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.180+0000 7f7845ff7700 1 -- 172.21.2.105:0/2437584592 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7824053600 msgr2=0x7f7824055ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:58.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.180+0000 7f7845ff7700 1 --2- 172.21.2.105:0/2437584592 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7824053600 0x7f7824055ac0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f782801a000 tx=0x7f7828014000).stop 2021-11-12T05:48:58.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.180+0000 7f7845ff7700 1 -- 172.21.2.105:0/2437584592 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f78400b0520 msgr2=0x7f78401497b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:58.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.180+0000 7f7845ff7700 1 --2- 172.21.2.105:0/2437584592 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f78400b0520 0x7f78401497b0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7f783000c000 tx=0x7f7830006df0).stop 2021-11-12T05:48:58.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.180+0000 7f7845ff7700 1 -- 172.21.2.105:0/2437584592 shutdown_connections 2021-11-12T05:48:58.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.180+0000 7f7845ff7700 1 --2- 172.21.2.105:0/2437584592 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7824053600 0x7f7824055ac0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:58.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.180+0000 7f7845ff7700 1 --2- 172.21.2.105:0/2437584592 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f78401478b0 0x7f7840062460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:58.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.180+0000 7f7845ff7700 1 --2- 172.21.2.105:0/2437584592 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f78400b0520 0x7f78401497b0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:58.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.180+0000 7f7845ff7700 1 --2- 172.21.2.105:0/2437584592 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f78400aca40 0x7f7840066e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:58.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.180+0000 7f7845ff7700 1 -- 172.21.2.105:0/2437584592 >> 172.21.2.105:0/2437584592 conn(0x7f784005c490 msgr2=0x7f78401444f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:58.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.180+0000 7f7845ff7700 1 -- 172.21.2.105:0/2437584592 shutdown_connections 2021-11-12T05:48:58.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.180+0000 7f7845ff7700 1 -- 172.21.2.105:0/2437584592 wait complete. 2021-11-12T05:48:58.190 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-12T05:48:58.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d85e1b700 1 Processor -- start 2021-11-12T05:48:58.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d85e1b700 1 -- start start 2021-11-12T05:48:58.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d85e1b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5d800ad080 0x7f5d800af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:58.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d85e1b700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d800ac7b0 con 0x7f5d8014b2f0 2021-11-12T05:48:58.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d85e1b700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d800ac9e0 con 0x7f5d800ac280 2021-11-12T05:48:58.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d85e1b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d801488a0 con 0x7f5d800ad080 2021-11-12T05:48:58.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d7ffff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f5d8014b2f0 0x7f5d80147a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:33206/0 (socket says 172.21.2.105:33206) 2021-11-12T05:48:58.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d7ffff700 1 -- 172.21.2.105:0/2378317380 learned_addr learned my addr 172.21.2.105:0/2378317380 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:48:58.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d7e7fc700 1 -- 172.21.2.105:0/2378317380 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 398126704 0 0) 0x7f5d800ac7b0 con 0x7f5d8014b2f0 2021-11-12T05:48:58.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d7e7fc700 1 -- 172.21.2.105:0/2378317380 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d60003260 con 0x7f5d8014b2f0 2021-11-12T05:48:58.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d7f7fe700 1 --2- 172.21.2.105:0/2378317380 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5d800ad080 0x7f5d800af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:58.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d7e7fc700 1 -- 172.21.2.105:0/2378317380 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 748491526 0 0) 0x7f5d60003260 con 0x7f5d8014b2f0 2021-11-12T05:48:58.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d7e7fc700 1 -- 172.21.2.105:0/2378317380 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5d800ad080 msgr2=0x7f5d800af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:58.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d7e7fc700 1 --2- 172.21.2.105:0/2378317380 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5d800ad080 0x7f5d800af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:58.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d7e7fc700 1 -- 172.21.2.105:0/2378317380 >> v1:172.21.2.115:6789/0 conn(0x7f5d800ac280 legacy=0x7f5d8014abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:58.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d7e7fc700 1 -- 172.21.2.105:0/2378317380 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d800b0b30 con 0x7f5d8014b2f0 2021-11-12T05:48:58.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d7e7fc700 1 -- 172.21.2.105:0/2378317380 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f5d780019e0 con 0x7f5d8014b2f0 2021-11-12T05:48:58.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d7e7fc700 1 -- 172.21.2.105:0/2378317380 >> v1:172.21.2.105:6789/0 conn(0x7f5d8014b2f0 legacy=0x7f5d80147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:58.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d7e7fc700 1 --2- 172.21.2.105:0/2378317380 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5d60003780 0x7f5d60003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:58.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d7e7fc700 1 --2- 172.21.2.105:0/2378317380 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5d60004500 0x7f5d60004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:58.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d7e7fc700 1 --2- 172.21.2.105:0/2378317380 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5d800ad080 0x7f5d60004f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:58.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d7e7fc700 1 -- 172.21.2.105:0/2378317380 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d801488a0 con 0x7f5d60004500 2021-11-12T05:48:58.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d7e7fc700 1 -- 172.21.2.105:0/2378317380 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6000b830 con 0x7f5d60003780 2021-11-12T05:48:58.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d7e7fc700 1 -- 172.21.2.105:0/2378317380 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6000b9f0 con 0x7f5d800ad080 2021-11-12T05:48:58.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d7effd700 1 --2- 172.21.2.105:0/2378317380 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5d60004500 0x7f5d60004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:58.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d7f7fe700 1 --2- 172.21.2.105:0/2378317380 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5d60003780 0x7f5d60003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:58.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d7ffff700 1 --2- 172.21.2.105:0/2378317380 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5d800ad080 0x7f5d60004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:58.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d7effd700 1 -- 172.21.2.105:0/2378317380 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5d800ad080 msgr2=0x7f5d60004f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:58.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d7effd700 1 --2- 172.21.2.105:0/2378317380 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5d800ad080 0x7f5d60004f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:58.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d7effd700 1 -- 172.21.2.105:0/2378317380 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5d60003780 msgr2=0x7f5d60003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:58.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d7effd700 1 --2- 172.21.2.105:0/2378317380 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5d60003780 0x7f5d60003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:58.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d7effd700 1 -- 172.21.2.105:0/2378317380 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d60003260 con 0x7f5d60004500 2021-11-12T05:48:58.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d7f7fe700 1 --2- 172.21.2.105:0/2378317380 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5d60003780 0x7f5d60003b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:48:58.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d7effd700 1 --2- 172.21.2.105:0/2378317380 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5d60004500 0x7f5d60004980 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 rx=0x7f5d70001fa0 tx=0x7f5d70007a00).ready entity=mon.0 client_cookie=875215a21ece7d2d server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:58.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d7e7fc700 1 -- 172.21.2.105:0/2378317380 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d70007070 con 0x7f5d60004500 2021-11-12T05:48:58.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d7e7fc700 1 -- 172.21.2.105:0/2378317380 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d700071d0 con 0x7f5d60004500 2021-11-12T05:48:58.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d7e7fc700 1 -- 172.21.2.105:0/2378317380 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d70006510 con 0x7f5d60004500 2021-11-12T05:48:58.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d85e1b700 1 -- 172.21.2.105:0/2378317380 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5d60004500 msgr2=0x7f5d60004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:58.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d85e1b700 1 --2- 172.21.2.105:0/2378317380 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5d60004500 0x7f5d60004980 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 rx=0x7f5d70001fa0 tx=0x7f5d70007a00).stop 2021-11-12T05:48:58.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d7ffff700 1 -- 172.21.2.105:0/2378317380 reap_dead start 2021-11-12T05:48:58.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d85e1b700 1 -- 172.21.2.105:0/2378317380 shutdown_connections 2021-11-12T05:48:58.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.240+0000 7f5d85e1b700 1 -- 172.21.2.105:0/2378317380 >> 172.21.2.105:0/2378317380 conn(0x7f5d800b5370 msgr2=0x7f5d800b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:58.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.244+0000 7f5d85e1b700 1 -- 172.21.2.105:0/2378317380 shutdown_connections 2021-11-12T05:48:58.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.244+0000 7f5d85e1b700 1 -- 172.21.2.105:0/2378317380 wait complete. 2021-11-12T05:48:58.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.244+0000 7f5d85e1b700 1 Processor -- start 2021-11-12T05:48:58.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.244+0000 7f5d85e1b700 1 -- start start 2021-11-12T05:48:58.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.244+0000 7f5d85e1b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5d60004500 0x7f5d80156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:58.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.244+0000 7f5d85e1b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5d800abc20 0x7f5d800a7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:58.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.244+0000 7f5d85e1b700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5d8014aec0 0x7f5d80149d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:58.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.244+0000 7f5d85e1b700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d80157ab0 con 0x7f5d800abc20 2021-11-12T05:48:58.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.244+0000 7f5d85e1b700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d800a7020 con 0x7f5d8014aec0 2021-11-12T05:48:58.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.244+0000 7f5d85e1b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d800a87f0 con 0x7f5d60004500 2021-11-12T05:48:58.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.244+0000 7f5d7effd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5d800abc20 0x7f5d800a7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:58.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.244+0000 7f5d7effd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5d800abc20 0x7f5d800a7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51058/0 (socket says 172.21.2.105:51058) 2021-11-12T05:48:58.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.244+0000 7f5d7effd700 1 -- 172.21.2.105:0/230343656 learned_addr learned my addr 172.21.2.105:0/230343656 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:58.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.244+0000 7f5d7ffff700 1 --2- 172.21.2.105:0/230343656 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5d8014aec0 0x7f5d80149d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:58.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.244+0000 7f5d7f7fe700 1 --2- 172.21.2.105:0/230343656 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5d60004500 0x7f5d80156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:58.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.244+0000 7f5d7effd700 1 -- 172.21.2.105:0/230343656 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5d60004500 msgr2=0x7f5d80156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:58.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.244+0000 7f5d7effd700 1 --2- 172.21.2.105:0/230343656 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5d60004500 0x7f5d80156a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:58.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.244+0000 7f5d7effd700 1 -- 172.21.2.105:0/230343656 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5d8014aec0 msgr2=0x7f5d80149d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:58.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.244+0000 7f5d7effd700 1 --2- 172.21.2.105:0/230343656 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5d8014aec0 0x7f5d80149d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:58.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.244+0000 7f5d7effd700 1 -- 172.21.2.105:0/230343656 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d80157cc0 con 0x7f5d800abc20 2021-11-12T05:48:58.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.244+0000 7f5d7effd700 1 --2- 172.21.2.105:0/230343656 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5d800abc20 0x7f5d800a7d40 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7f5d800a8980 tx=0x7f5d70015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:58.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.244+0000 7f5d7cff9700 1 -- 172.21.2.105:0/230343656 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d70014620 con 0x7f5d800abc20 2021-11-12T05:48:58.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.244+0000 7f5d7cff9700 1 -- 172.21.2.105:0/230343656 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d70014780 con 0x7f5d800abc20 2021-11-12T05:48:58.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.244+0000 7f5d85e1b700 1 -- 172.21.2.105:0/230343656 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d800a8550 con 0x7f5d800abc20 2021-11-12T05:48:58.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.244+0000 7f5d7cff9700 1 -- 172.21.2.105:0/230343656 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d70014ae0 con 0x7f5d800abc20 2021-11-12T05:48:58.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.244+0000 7f5d85e1b700 1 -- 172.21.2.105:0/230343656 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d8014a210 con 0x7f5d800abc20 2021-11-12T05:48:58.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.244+0000 7f5d85e1b700 1 -- 172.21.2.105:0/230343656 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d800b1440 con 0x7f5d800abc20 2021-11-12T05:48:58.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.244+0000 7f5d7cff9700 1 -- 172.21.2.105:0/230343656 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5d7001d070 con 0x7f5d800abc20 2021-11-12T05:48:58.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.244+0000 7f5d7cff9700 1 --2- 172.21.2.105:0/230343656 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5d64053610 0x7f5d64055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:58.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.244+0000 7f5d7cff9700 1 -- 172.21.2.105:0/230343656 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f5d7006c970 con 0x7f5d800abc20 2021-11-12T05:48:58.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.244+0000 7f5d7f7fe700 1 --2- 172.21.2.105:0/230343656 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5d64053610 0x7f5d64055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:58.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.244+0000 7f5d7f7fe700 1 --2- 172.21.2.105:0/230343656 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5d64053610 0x7f5d64055ad0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f5d6800c000 tx=0x7f5d68008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:58.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.248+0000 7f5d7cff9700 1 -- 172.21.2.105:0/230343656 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5d70043920 con 0x7f5d800abc20 2021-11-12T05:48:58.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:58.332+0000 7f5d85e1b700 1 -- 172.21.2.105:0/230343656 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5d80057350 con 0x7f5d800abc20 2021-11-12T05:48:59.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.228+0000 7f5d7cff9700 1 -- 172.21.2.105:0/230343656 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v129) v1 ==== 185+0+0 (secure 0 0 0) 0x7f5d70046f40 con 0x7f5d800abc20 2021-11-12T05:48:59.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.228+0000 7f5d85e1b700 1 -- 172.21.2.105:0/230343656 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5d64053610 msgr2=0x7f5d64055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:59.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.228+0000 7f5d85e1b700 1 --2- 172.21.2.105:0/230343656 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5d64053610 0x7f5d64055ad0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f5d6800c000 tx=0x7f5d68008040).stop 2021-11-12T05:48:59.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.228+0000 7f5d85e1b700 1 -- 172.21.2.105:0/230343656 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5d800abc20 msgr2=0x7f5d800a7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:59.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.228+0000 7f5d85e1b700 1 --2- 172.21.2.105:0/230343656 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5d800abc20 0x7f5d800a7d40 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7f5d800a8980 tx=0x7f5d70015000).stop 2021-11-12T05:48:59.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.228+0000 7f5d85e1b700 1 -- 172.21.2.105:0/230343656 shutdown_connections 2021-11-12T05:48:59.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.228+0000 7f5d85e1b700 1 --2- 172.21.2.105:0/230343656 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5d64053610 0x7f5d64055ad0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:59.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.228+0000 7f5d85e1b700 1 --2- 172.21.2.105:0/230343656 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5d8014aec0 0x7f5d80149d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:59.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.228+0000 7f5d85e1b700 1 --2- 172.21.2.105:0/230343656 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5d800abc20 0x7f5d800a7d40 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:59.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.228+0000 7f5d85e1b700 1 --2- 172.21.2.105:0/230343656 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5d60004500 0x7f5d80156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:59.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.228+0000 7f5d85e1b700 1 -- 172.21.2.105:0/230343656 >> 172.21.2.105:0/230343656 conn(0x7f5d800b5370 msgr2=0x7f5d800aeb20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:59.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.228+0000 7f5d85e1b700 1 -- 172.21.2.105:0/230343656 shutdown_connections 2021-11-12T05:48:59.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.228+0000 7f5d85e1b700 1 -- 172.21.2.105:0/230343656 wait complete. 2021-11-12T05:48:59.237 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_metadata' removed 2021-11-12T05:48:59.242 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-12T05:48:59.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.288+0000 7f25847bb700 1 Processor -- start 2021-11-12T05:48:59.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.288+0000 7f25847bb700 1 -- start start 2021-11-12T05:48:59.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.292+0000 7f25847bb700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f257c0ac280 0x7f257c14b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:59.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.292+0000 7f25847bb700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f257c0af730 0x7f257c0ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:59.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.292+0000 7f25847bb700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f257c0ac7b0 con 0x7f257c0ad080 2021-11-12T05:48:59.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.292+0000 7f25847bb700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f257c1488a0 con 0x7f257c0ac280 2021-11-12T05:48:59.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.292+0000 7f25847bb700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f257c0ac9e0 con 0x7f257c0af730 2021-11-12T05:48:59.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.292+0000 7f2581d56700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f257c0ac280 0x7f257c14b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:59.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.292+0000 7f2581d56700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f257c0ac280 0x7f257c14b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51066/0 (socket says 172.21.2.105:51066) 2021-11-12T05:48:59.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.292+0000 7f2581d56700 1 -- 172.21.2.105:0/3577241434 learned_addr learned my addr 172.21.2.105:0/3577241434 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:59.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.292+0000 7f2581d56700 1 -- 172.21.2.105:0/3577241434 >> v2:172.21.2.115:3300/0 conn(0x7f257c0af730 msgr2=0x7f257c0ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:48:59.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.292+0000 7f2581d56700 1 --2- 172.21.2.105:0/3577241434 >> v2:172.21.2.115:3300/0 conn(0x7f257c0af730 0x7f257c0ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:59.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.292+0000 7f2581d56700 1 -- 172.21.2.105:0/3577241434 >> v1:172.21.2.105:6789/0 conn(0x7f257c0ad080 legacy=0x7f257c14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:59.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.292+0000 7f2581d56700 1 -- 172.21.2.105:0/3577241434 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f257c0b0b30 con 0x7f257c0ac280 2021-11-12T05:48:59.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.292+0000 7f2581d56700 1 --2- 172.21.2.105:0/3577241434 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f257c0ac280 0x7f257c14b2f0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7f2578001110 tx=0x7f2570006eb0).ready entity=mon.0 client_cookie=cbd440e308924c2f server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:59.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.292+0000 7f2581555700 1 -- 172.21.2.105:0/3577241434 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f257000d5c0 con 0x7f257c0ac280 2021-11-12T05:48:59.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.292+0000 7f2581555700 1 -- 172.21.2.105:0/3577241434 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2570000e90 con 0x7f257c0ac280 2021-11-12T05:48:59.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.292+0000 7f2581555700 1 -- 172.21.2.105:0/3577241434 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f257000d950 con 0x7f257c0ac280 2021-11-12T05:48:59.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.292+0000 7f25847bb700 1 -- 172.21.2.105:0/3577241434 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f257c0ac280 msgr2=0x7f257c14b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:59.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.292+0000 7f25847bb700 1 --2- 172.21.2.105:0/3577241434 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f257c0ac280 0x7f257c14b2f0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7f2578001110 tx=0x7f2570006eb0).stop 2021-11-12T05:48:59.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.292+0000 7f25847bb700 1 -- 172.21.2.105:0/3577241434 shutdown_connections 2021-11-12T05:48:59.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.292+0000 7f25847bb700 1 --2- 172.21.2.105:0/3577241434 >> v2:172.21.2.115:3300/0 conn(0x7f257c0af730 0x7f257c0ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:59.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.292+0000 7f25847bb700 1 --2- 172.21.2.105:0/3577241434 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f257c0ac280 0x7f257c14b2f0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:48:59.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.292+0000 7f25847bb700 1 -- 172.21.2.105:0/3577241434 >> 172.21.2.105:0/3577241434 conn(0x7f257c0b5370 msgr2=0x7f257c0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:48:59.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.292+0000 7f25847bb700 1 -- 172.21.2.105:0/3577241434 shutdown_connections 2021-11-12T05:48:59.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.292+0000 7f25847bb700 1 -- 172.21.2.105:0/3577241434 wait complete. 2021-11-12T05:48:59.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.292+0000 7f25847bb700 1 Processor -- start 2021-11-12T05:48:59.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.292+0000 7f25847bb700 1 -- start start 2021-11-12T05:48:59.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.292+0000 7f25847bb700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f257c0ac280 0x7f257c0aa640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:59.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.292+0000 7f25847bb700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f257c0ad080 0x7f257c0aafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:59.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.292+0000 7f25847bb700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f257c0af730 0x7f257c0a7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:59.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.292+0000 7f25847bb700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257c1574c0 con 0x7f257c0ac280 2021-11-12T05:48:59.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.292+0000 7f25847bb700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257c157700 con 0x7f257c0ad080 2021-11-12T05:48:59.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.292+0000 7f25847bb700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f257c1579a0 con 0x7f257c0af730 2021-11-12T05:48:59.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.292+0000 7f2582557700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f257c0ac280 0x7f257c0aa640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:59.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.292+0000 7f2582557700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f257c0ac280 0x7f257c0aa640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51070/0 (socket says 172.21.2.105:51070) 2021-11-12T05:48:59.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.292+0000 7f2582557700 1 -- 172.21.2.105:0/3808263240 learned_addr learned my addr 172.21.2.105:0/3808263240 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:48:59.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.296+0000 7f2582557700 1 -- 172.21.2.105:0/3808263240 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f257c0af730 msgr2=0x7f257c0a7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:59.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.296+0000 7f2582557700 1 --2- 172.21.2.105:0/3808263240 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f257c0af730 0x7f257c0a7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:59.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.296+0000 7f2582557700 1 -- 172.21.2.105:0/3808263240 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f257c0ad080 msgr2=0x7f257c0aafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:48:59.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.296+0000 7f2582557700 1 --2- 172.21.2.105:0/3808263240 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f257c0ad080 0x7f257c0aafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:48:59.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.296+0000 7f2582557700 1 -- 172.21.2.105:0/3808263240 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f257000b1e0 con 0x7f257c0ac280 2021-11-12T05:48:59.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.296+0000 7f2582557700 1 --2- 172.21.2.105:0/3808263240 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f257c0ac280 0x7f257c0aa640 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 rx=0x7f25780011d0 tx=0x7f2578007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:59.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.296+0000 7f256f7fe700 1 -- 172.21.2.105:0/3808263240 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2578007240 con 0x7f257c0ac280 2021-11-12T05:48:59.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.296+0000 7f256f7fe700 1 -- 172.21.2.105:0/3808263240 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25780073a0 con 0x7f257c0ac280 2021-11-12T05:48:59.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.296+0000 7f256f7fe700 1 -- 172.21.2.105:0/3808263240 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2578006700 con 0x7f257c0ac280 2021-11-12T05:48:59.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.296+0000 7f25847bb700 1 -- 172.21.2.105:0/3808263240 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f257c0a9400 con 0x7f257c0ac280 2021-11-12T05:48:59.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.296+0000 7f25847bb700 1 -- 172.21.2.105:0/3808263240 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f257c0ab6f0 con 0x7f257c0ac280 2021-11-12T05:48:59.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.296+0000 7f25847bb700 1 -- 172.21.2.105:0/3808263240 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f257c0b1440 con 0x7f257c0ac280 2021-11-12T05:48:59.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.296+0000 7f256f7fe700 1 -- 172.21.2.105:0/3808263240 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2578010030 con 0x7f257c0ac280 2021-11-12T05:48:59.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.296+0000 7f256f7fe700 1 --2- 172.21.2.105:0/3808263240 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f255c0535d0 0x7f255c055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:48:59.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.296+0000 7f256f7fe700 1 -- 172.21.2.105:0/3808263240 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6064+0+0 (secure 0 0 0) 0x7f257806b7c0 con 0x7f257c0ac280 2021-11-12T05:48:59.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.296+0000 7f2581d56700 1 --2- 172.21.2.105:0/3808263240 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f255c0535d0 0x7f255c055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:48:59.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.296+0000 7f2581d56700 1 --2- 172.21.2.105:0/3808263240 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f255c0535d0 0x7f255c055a90 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f2578001110 tx=0x7f2570015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:48:59.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.296+0000 7f256f7fe700 1 -- 172.21.2.105:0/3808263240 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2578042930 con 0x7f257c0ac280 2021-11-12T05:48:59.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:48:59.380+0000 7f25847bb700 1 -- 172.21.2.105:0/3808263240 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f257c057350 con 0x7f257c0ac280 2021-11-12T05:49:00.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.248+0000 7f256f7fe700 1 -- 172.21.2.105:0/3808263240 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v130) v1 ==== 173+0+0 (secure 0 0 0) 0x7f2578045f50 con 0x7f257c0ac280 2021-11-12T05:49:00.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.252+0000 7f25847bb700 1 -- 172.21.2.105:0/3808263240 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f255c0535d0 msgr2=0x7f255c055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:00.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.252+0000 7f25847bb700 1 --2- 172.21.2.105:0/3808263240 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f255c0535d0 0x7f255c055a90 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f2578001110 tx=0x7f2570015000).stop 2021-11-12T05:49:00.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.252+0000 7f25847bb700 1 -- 172.21.2.105:0/3808263240 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f257c0ac280 msgr2=0x7f257c0aa640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:00.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.252+0000 7f25847bb700 1 --2- 172.21.2.105:0/3808263240 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f257c0ac280 0x7f257c0aa640 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 rx=0x7f25780011d0 tx=0x7f2578007c00).stop 2021-11-12T05:49:00.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.252+0000 7f25847bb700 1 -- 172.21.2.105:0/3808263240 shutdown_connections 2021-11-12T05:49:00.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.252+0000 7f25847bb700 1 --2- 172.21.2.105:0/3808263240 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f255c0535d0 0x7f255c055a90 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:00.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.252+0000 7f25847bb700 1 --2- 172.21.2.105:0/3808263240 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f257c0af730 0x7f257c0a7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:00.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.252+0000 7f25847bb700 1 --2- 172.21.2.105:0/3808263240 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f257c0ad080 0x7f257c0aafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:00.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.252+0000 7f25847bb700 1 --2- 172.21.2.105:0/3808263240 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f257c0ac280 0x7f257c0aa640 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:00.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.252+0000 7f25847bb700 1 -- 172.21.2.105:0/3808263240 >> 172.21.2.105:0/3808263240 conn(0x7f257c0b5370 msgr2=0x7f257c0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:00.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.252+0000 7f25847bb700 1 -- 172.21.2.105:0/3808263240 shutdown_connections 2021-11-12T05:49:00.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.252+0000 7f25847bb700 1 -- 172.21.2.105:0/3808263240 wait complete. 2021-11-12T05:49:00.259 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_data' removed 2021-11-12T05:49:00.262 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-11-12T05:49:00.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.312+0000 7f27eef95700 1 Processor -- start 2021-11-12T05:49:00.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.312+0000 7f27eef95700 1 -- start start 2021-11-12T05:49:00.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.312+0000 7f27eef95700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f27e80aca40 0x7f27e80ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:00.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.312+0000 7f27eef95700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f27e8144180 0x7f27e81445f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:00.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.312+0000 7f27eef95700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e80b1840 con 0x7f27e80b0520 2021-11-12T05:49:00.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.312+0000 7f27eef95700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e80b09d0 con 0x7f27e8144180 2021-11-12T05:49:00.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.312+0000 7f27eef95700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e80af2b0 con 0x7f27e80aca40 2021-11-12T05:49:00.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.312+0000 7f27ed532700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f27e8144180 0x7f27e81445f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:00.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.312+0000 7f27ed532700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f27e8144180 0x7f27e81445f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51078/0 (socket says 172.21.2.105:51078) 2021-11-12T05:49:00.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.312+0000 7f27ed532700 1 -- 172.21.2.105:0/3962968896 learned_addr learned my addr 172.21.2.105:0/3962968896 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:00.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.312+0000 7f27ed532700 1 -- 172.21.2.105:0/3962968896 >> v2:172.21.2.115:3300/0 conn(0x7f27e80aca40 msgr2=0x7f27e80ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:00.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.312+0000 7f27ed532700 1 --2- 172.21.2.105:0/3962968896 >> v2:172.21.2.115:3300/0 conn(0x7f27e80aca40 0x7f27e80ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:00.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.312+0000 7f27ed532700 1 -- 172.21.2.105:0/3962968896 >> v1:172.21.2.115:6789/0 conn(0x7f27e80b0520 legacy=0x7f27e81473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:00.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.312+0000 7f27ed532700 1 -- 172.21.2.105:0/3962968896 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e80b1a70 con 0x7f27e8144180 2021-11-12T05:49:00.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.312+0000 7f27ed532700 1 --2- 172.21.2.105:0/3962968896 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f27e8144180 0x7f27e81445f0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7f27e8061140 tx=0x7f27e0009290).ready entity=mon.0 client_cookie=3ec247d18ee9fc61 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:00.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.312+0000 7f27e77fe700 1 -- 172.21.2.105:0/3962968896 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27e000b830 con 0x7f27e8144180 2021-11-12T05:49:00.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.312+0000 7f27e77fe700 1 -- 172.21.2.105:0/3962968896 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e000b990 con 0x7f27e8144180 2021-11-12T05:49:00.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.312+0000 7f27e77fe700 1 -- 172.21.2.105:0/3962968896 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27e000bb40 con 0x7f27e8144180 2021-11-12T05:49:00.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.312+0000 7f27eef95700 1 -- 172.21.2.105:0/3962968896 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f27e8144180 msgr2=0x7f27e81445f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:00.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.312+0000 7f27eef95700 1 --2- 172.21.2.105:0/3962968896 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f27e8144180 0x7f27e81445f0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7f27e8061140 tx=0x7f27e0009290).stop 2021-11-12T05:49:00.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.312+0000 7f27eef95700 1 -- 172.21.2.105:0/3962968896 shutdown_connections 2021-11-12T05:49:00.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.312+0000 7f27eef95700 1 --2- 172.21.2.105:0/3962968896 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f27e8144180 0x7f27e81445f0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:00.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.312+0000 7f27eef95700 1 --2- 172.21.2.105:0/3962968896 >> v2:172.21.2.115:3300/0 conn(0x7f27e80aca40 0x7f27e80ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:00.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.312+0000 7f27eef95700 1 -- 172.21.2.105:0/3962968896 >> 172.21.2.105:0/3962968896 conn(0x7f27e805c490 msgr2=0x7f27e80b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:00.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.312+0000 7f27eef95700 1 -- 172.21.2.105:0/3962968896 shutdown_connections 2021-11-12T05:49:00.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.312+0000 7f27eef95700 1 -- 172.21.2.105:0/3962968896 wait complete. 2021-11-12T05:49:00.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.312+0000 7f27eef95700 1 Processor -- start 2021-11-12T05:49:00.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.312+0000 7f27eef95700 1 -- start start 2021-11-12T05:49:00.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.312+0000 7f27eef95700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f27e80aca40 0x7f27e81469e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:00.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.312+0000 7f27eef95700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f27e80b0520 0x7f27e815a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:00.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.316+0000 7f27eef95700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f27e8144180 0x7f27e815a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:00.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.316+0000 7f27eef95700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e8157640 con 0x7f27e8144180 2021-11-12T05:49:00.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.316+0000 7f27eef95700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e8159c70 con 0x7f27e80aca40 2021-11-12T05:49:00.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.316+0000 7f27eef95700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e8066df0 con 0x7f27e80b0520 2021-11-12T05:49:00.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.316+0000 7f27ed532700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f27e8144180 0x7f27e815a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:00.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.316+0000 7f27ed532700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f27e8144180 0x7f27e815a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51086/0 (socket says 172.21.2.105:51086) 2021-11-12T05:49:00.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.316+0000 7f27ed532700 1 -- 172.21.2.105:0/2024869831 learned_addr learned my addr 172.21.2.105:0/2024869831 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:00.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.316+0000 7f27ed532700 1 -- 172.21.2.105:0/2024869831 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f27e80b0520 msgr2=0x7f27e815a0a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:49:00.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.316+0000 7f27ed532700 1 --2- 172.21.2.105:0/2024869831 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f27e80b0520 0x7f27e815a0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:00.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.316+0000 7f27ed532700 1 -- 172.21.2.105:0/2024869831 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f27e80aca40 msgr2=0x7f27e81469e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:49:00.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.316+0000 7f27ed532700 1 --2- 172.21.2.105:0/2024869831 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f27e80aca40 0x7f27e81469e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:00.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.316+0000 7f27ed532700 1 -- 172.21.2.105:0/2024869831 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e0009530 con 0x7f27e8144180 2021-11-12T05:49:00.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.316+0000 7f27ed532700 1 --2- 172.21.2.105:0/2024869831 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f27e8144180 0x7f27e815a590 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7f27e8061140 tx=0x7f27e0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:00.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.316+0000 7f27e5ffb700 1 -- 172.21.2.105:0/2024869831 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27e000b830 con 0x7f27e8144180 2021-11-12T05:49:00.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.316+0000 7f27e5ffb700 1 -- 172.21.2.105:0/2024869831 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e0020430 con 0x7f27e8144180 2021-11-12T05:49:00.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.316+0000 7f27e5ffb700 1 -- 172.21.2.105:0/2024869831 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27e0020790 con 0x7f27e8144180 2021-11-12T05:49:00.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.316+0000 7f27eef95700 1 -- 172.21.2.105:0/2024869831 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e8066b10 con 0x7f27e8144180 2021-11-12T05:49:00.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.316+0000 7f27eef95700 1 -- 172.21.2.105:0/2024869831 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e8062da0 con 0x7f27e8144180 2021-11-12T05:49:00.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.316+0000 7f27eef95700 1 -- 172.21.2.105:0/2024869831 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e8057350 con 0x7f27e8144180 2021-11-12T05:49:00.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.316+0000 7f27e5ffb700 1 -- 172.21.2.105:0/2024869831 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f27e0028070 con 0x7f27e8144180 2021-11-12T05:49:00.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.316+0000 7f27e5ffb700 1 --2- 172.21.2.105:0/2024869831 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f27c80536a0 0x7f27c8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:00.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.316+0000 7f27e5ffb700 1 -- 172.21.2.105:0/2024869831 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f27e006c1c0 con 0x7f27e8144180 2021-11-12T05:49:00.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.316+0000 7f27ecd31700 1 --2- 172.21.2.105:0/2024869831 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f27c80536a0 0x7f27c8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:00.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.316+0000 7f27ecd31700 1 --2- 172.21.2.105:0/2024869831 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f27c80536a0 0x7f27c8055b60 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f27d8002f70 tx=0x7f27d8006a00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:00.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.320+0000 7f27e5ffb700 1 -- 172.21.2.105:0/2024869831 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f27e00434a0 con 0x7f27e8144180 2021-11-12T05:49:00.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.400+0000 7f27eef95700 1 -- 172.21.2.105:0/2024869831 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f27e805f280 con 0x7f27e8144180 2021-11-12T05:49:00.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.408+0000 7f27e5ffb700 1 -- 172.21.2.105:0/2024869831 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f27e0009390 con 0x7f27e8144180 2021-11-12T05:49:00.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.408+0000 7f27eef95700 1 -- 172.21.2.105:0/2024869831 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f27c80536a0 msgr2=0x7f27c8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:00.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.408+0000 7f27eef95700 1 --2- 172.21.2.105:0/2024869831 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f27c80536a0 0x7f27c8055b60 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f27d8002f70 tx=0x7f27d8006a00).stop 2021-11-12T05:49:00.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.408+0000 7f27eef95700 1 -- 172.21.2.105:0/2024869831 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f27e8144180 msgr2=0x7f27e815a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:00.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.408+0000 7f27eef95700 1 --2- 172.21.2.105:0/2024869831 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f27e8144180 0x7f27e815a590 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7f27e8061140 tx=0x7f27e0016000).stop 2021-11-12T05:49:00.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.408+0000 7f27eef95700 1 -- 172.21.2.105:0/2024869831 shutdown_connections 2021-11-12T05:49:00.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.408+0000 7f27eef95700 1 --2- 172.21.2.105:0/2024869831 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f27c80536a0 0x7f27c8055b60 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:00.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.408+0000 7f27eef95700 1 --2- 172.21.2.105:0/2024869831 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f27e8144180 0x7f27e815a590 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:00.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.408+0000 7f27eef95700 1 --2- 172.21.2.105:0/2024869831 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f27e80b0520 0x7f27e815a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:00.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.408+0000 7f27eef95700 1 --2- 172.21.2.105:0/2024869831 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f27e80aca40 0x7f27e81469e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:00.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.408+0000 7f27eef95700 1 -- 172.21.2.105:0/2024869831 >> 172.21.2.105:0/2024869831 conn(0x7f27e805c490 msgr2=0x7f27e814b180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:00.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.408+0000 7f27eef95700 1 -- 172.21.2.105:0/2024869831 shutdown_connections 2021-11-12T05:49:00.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.408+0000 7f27eef95700 1 -- 172.21.2.105:0/2024869831 wait complete. 2021-11-12T05:49:00.419 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_fs_new' 2021-11-12T05:49:00.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.464+0000 7fc47a7ed700 1 Processor -- start 2021-11-12T05:49:00.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.464+0000 7fc47a7ed700 1 -- start start 2021-11-12T05:49:00.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc47a7ed700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fc4740ad080 0x7fc4740af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:00.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc47a7ed700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc4740ac280 0x7fc4740ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:00.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc47a7ed700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4740ac7b0 con 0x7fc47414abe0 2021-11-12T05:49:00.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc47a7ed700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4741488a0 con 0x7fc4740ad080 2021-11-12T05:49:00.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc47a7ed700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4740ac9e0 con 0x7fc4740ac280 2021-11-12T05:49:00.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc473fff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fc4740ad080 0x7fc4740af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:00.474 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc473fff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fc4740ad080 0x7fc4740af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51090/0 (socket says 172.21.2.105:51090) 2021-11-12T05:49:00.474 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc473fff700 1 -- 172.21.2.105:0/2706330002 learned_addr learned my addr 172.21.2.105:0/2706330002 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:00.474 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc473fff700 1 -- 172.21.2.105:0/2706330002 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc4740ac280 msgr2=0x7fc4740ad460 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:49:00.474 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc473fff700 1 --2- 172.21.2.105:0/2706330002 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc4740ac280 0x7fc4740ad460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:00.474 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc473fff700 1 -- 172.21.2.105:0/2706330002 >> v1:172.21.2.115:6789/0 conn(0x7fc47414abe0 legacy=0x7fc47414b090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:49:00.475 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc473fff700 1 -- 172.21.2.105:0/2706330002 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4740b0b30 con 0x7fc4740ad080 2021-11-12T05:49:00.475 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc473fff700 1 --2- 172.21.2.105:0/2706330002 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc4740ad080 0x7fc4740af730 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7fc4740b6060 tx=0x7fc45c006eb0).ready entity=mon.0 client_cookie=f5b5b9bf84987e07 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:00.475 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc472ffd700 1 -- 172.21.2.105:0/2706330002 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc45c00d570 con 0x7fc4740ad080 2021-11-12T05:49:00.475 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc472ffd700 1 -- 172.21.2.105:0/2706330002 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc45c000e90 con 0x7fc4740ad080 2021-11-12T05:49:00.475 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc472ffd700 1 -- 172.21.2.105:0/2706330002 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc45c00d8c0 con 0x7fc4740ad080 2021-11-12T05:49:00.476 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc47a7ed700 1 -- 172.21.2.105:0/2706330002 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc4740ad080 msgr2=0x7fc4740af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:00.476 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc47a7ed700 1 --2- 172.21.2.105:0/2706330002 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc4740ad080 0x7fc4740af730 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7fc4740b6060 tx=0x7fc45c006eb0).stop 2021-11-12T05:49:00.476 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc47a7ed700 1 -- 172.21.2.105:0/2706330002 shutdown_connections 2021-11-12T05:49:00.476 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc47a7ed700 1 --2- 172.21.2.105:0/2706330002 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc4740ac280 0x7fc4740ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:00.476 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc47a7ed700 1 --2- 172.21.2.105:0/2706330002 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc4740ad080 0x7fc4740af730 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:00.477 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc47a7ed700 1 -- 172.21.2.105:0/2706330002 >> 172.21.2.105:0/2706330002 conn(0x7fc4740b5370 msgr2=0x7fc4740b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:00.477 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc47a7ed700 1 -- 172.21.2.105:0/2706330002 shutdown_connections 2021-11-12T05:49:00.477 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc47a7ed700 1 -- 172.21.2.105:0/2706330002 wait complete. 2021-11-12T05:49:00.479 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc47a7ed700 1 Processor -- start 2021-11-12T05:49:00.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc47a7ed700 1 -- start start 2021-11-12T05:49:00.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc47a7ed700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc4740ac280 0x7fc4740a8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:00.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc47a7ed700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc4740ad080 0x7fc474157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:00.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc47a7ed700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc47414abe0 0x7fc474157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:00.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc47a7ed700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4740aa600 con 0x7fc47414abe0 2021-11-12T05:49:00.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc47a7ed700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4740abb80 con 0x7fc4740ad080 2021-11-12T05:49:00.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc47a7ed700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4740a7a60 con 0x7fc4740ac280 2021-11-12T05:49:00.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc478d8a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc47414abe0 0x7fc474157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:00.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc478d8a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc47414abe0 0x7fc474157520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51098/0 (socket says 172.21.2.105:51098) 2021-11-12T05:49:00.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc478d8a700 1 -- 172.21.2.105:0/2646707202 learned_addr learned my addr 172.21.2.105:0/2646707202 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:00.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc478d8a700 1 -- 172.21.2.105:0/2646707202 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc4740ac280 msgr2=0x7fc4740a8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:00.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc478d8a700 1 --2- 172.21.2.105:0/2646707202 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc4740ac280 0x7fc4740a8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:00.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc478d8a700 1 -- 172.21.2.105:0/2646707202 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc4740ad080 msgr2=0x7fc474157030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:00.483 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc478d8a700 1 --2- 172.21.2.105:0/2646707202 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc4740ad080 0x7fc474157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:00.483 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc478d8a700 1 -- 172.21.2.105:0/2646707202 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45c00b1e0 con 0x7fc47414abe0 2021-11-12T05:49:00.483 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc478d8a700 1 --2- 172.21.2.105:0/2646707202 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc47414abe0 0x7fc474157520 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7fc46c001250 tx=0x7fc46c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:00.483 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc4717fa700 1 -- 172.21.2.105:0/2646707202 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc46c0014e0 con 0x7fc47414abe0 2021-11-12T05:49:00.483 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc4717fa700 1 -- 172.21.2.105:0/2646707202 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc46c001640 con 0x7fc47414abe0 2021-11-12T05:49:00.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc4717fa700 1 -- 172.21.2.105:0/2646707202 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc46c0019a0 con 0x7fc47414abe0 2021-11-12T05:49:00.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc47a7ed700 1 -- 172.21.2.105:0/2646707202 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4740abdb0 con 0x7fc47414abe0 2021-11-12T05:49:00.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.468+0000 7fc47a7ed700 1 -- 172.21.2.105:0/2646707202 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc474157a10 con 0x7fc47414abe0 2021-11-12T05:49:00.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.472+0000 7fc47a7ed700 1 -- 172.21.2.105:0/2646707202 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4740b1440 con 0x7fc47414abe0 2021-11-12T05:49:00.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.472+0000 7fc4717fa700 1 -- 172.21.2.105:0/2646707202 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc46c018030 con 0x7fc47414abe0 2021-11-12T05:49:00.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.472+0000 7fc4717fa700 1 --2- 172.21.2.105:0/2646707202 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc458053610 0x7fc458055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:00.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.472+0000 7fc4717fa700 1 -- 172.21.2.105:0/2646707202 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fc46c06b1c0 con 0x7fc47414abe0 2021-11-12T05:49:00.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.472+0000 7fc473fff700 1 --2- 172.21.2.105:0/2646707202 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc458053610 0x7fc458055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:00.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.472+0000 7fc473fff700 1 --2- 172.21.2.105:0/2646707202 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc458053610 0x7fc458055ad0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7fc4740b6060 tx=0x7fc45c015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:00.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.472+0000 7fc4717fa700 1 -- 172.21.2.105:0/2646707202 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc46c042440 con 0x7fc47414abe0 2021-11-12T05:49:00.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:00.584+0000 7fc47a7ed700 1 -- 172.21.2.105:0/2646707202 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_fs_new"]} v 0) v1 -- 0x7fc474057350 con 0x7fc47414abe0 2021-11-12T05:49:01.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.252+0000 7fc4717fa700 1 -- 172.21.2.105:0/2646707202 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_fs_new"]}]=0 v363) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc46c045a60 con 0x7fc47414abe0 2021-11-12T05:49:01.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.252+0000 7fc47a7ed700 1 -- 172.21.2.105:0/2646707202 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc458053610 msgr2=0x7fc458055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:01.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.252+0000 7fc47a7ed700 1 --2- 172.21.2.105:0/2646707202 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc458053610 0x7fc458055ad0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7fc4740b6060 tx=0x7fc45c015000).stop 2021-11-12T05:49:01.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.252+0000 7fc47a7ed700 1 -- 172.21.2.105:0/2646707202 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc47414abe0 msgr2=0x7fc474157520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:01.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.252+0000 7fc47a7ed700 1 --2- 172.21.2.105:0/2646707202 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc47414abe0 0x7fc474157520 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7fc46c001250 tx=0x7fc46c0090f0).stop 2021-11-12T05:49:01.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.252+0000 7fc47a7ed700 1 -- 172.21.2.105:0/2646707202 shutdown_connections 2021-11-12T05:49:01.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.252+0000 7fc47a7ed700 1 --2- 172.21.2.105:0/2646707202 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc458053610 0x7fc458055ad0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:01.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.252+0000 7fc47a7ed700 1 --2- 172.21.2.105:0/2646707202 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc47414abe0 0x7fc474157520 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:01.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.252+0000 7fc47a7ed700 1 --2- 172.21.2.105:0/2646707202 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc4740ad080 0x7fc474157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:01.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.252+0000 7fc47a7ed700 1 --2- 172.21.2.105:0/2646707202 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc4740ac280 0x7fc4740a8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:01.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.252+0000 7fc47a7ed700 1 -- 172.21.2.105:0/2646707202 >> 172.21.2.105:0/2646707202 conn(0x7fc4740b5370 msgr2=0x7fc4740ae880 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:01.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.252+0000 7fc47a7ed700 1 -- 172.21.2.105:0/2646707202 shutdown_connections 2021-11-12T05:49:01.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.252+0000 7fc47a7ed700 1 -- 172.21.2.105:0/2646707202 wait complete. 2021-11-12T05:49:01.265 INFO:tasks.cephfs_test_runner:test_fs_new (tasks.cephfs.test_misc.TestMisc) ... ok 2021-11-12T05:49:01.266 INFO:tasks.cephfs_test_runner:Starting test: test_getattr_caps (tasks.cephfs.test_misc.TestMisc) 2021-11-12T05:49:01.266 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_getattr_caps' 2021-11-12T05:49:01.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.312+0000 7f30392f7700 1 Processor -- start 2021-11-12T05:49:01.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.312+0000 7f30392f7700 1 -- start start 2021-11-12T05:49:01.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.312+0000 7f30392f7700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f30340ad080 0x7f30340af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:01.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.312+0000 7f30392f7700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f30340ac280 0x7f30340ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:01.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.312+0000 7f30392f7700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30340ac7b0 con 0x7f303414abe0 2021-11-12T05:49:01.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.312+0000 7f30392f7700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30341488a0 con 0x7f30340ad080 2021-11-12T05:49:01.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.312+0000 7f30392f7700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30340ac9e0 con 0x7f30340ac280 2021-11-12T05:49:01.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.316+0000 7f3032ffd700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f30340ad080 0x7f30340af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:01.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.316+0000 7f30327fc700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f30340ac280 0x7f30340ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:01.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.316+0000 7f30337fe700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7f303414abe0 0x7f303414b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:59972/0 (socket says 172.21.2.105:59972) 2021-11-12T05:49:01.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.316+0000 7f30337fe700 1 -- 172.21.2.105:0/3984937197 learned_addr learned my addr 172.21.2.105:0/3984937197 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:01.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.316+0000 7f30327fc700 1 -- 172.21.2.105:0/3984937197 >> v2:172.21.2.115:3300/0 conn(0x7f30340ad080 msgr2=0x7f30340af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:01.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.316+0000 7f30327fc700 1 --2- 172.21.2.105:0/3984937197 >> v2:172.21.2.115:3300/0 conn(0x7f30340ad080 0x7f30340af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:01.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.316+0000 7f30327fc700 1 -- 172.21.2.105:0/3984937197 >> v1:172.21.2.115:6789/0 conn(0x7f303414abe0 legacy=0x7f303414b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:01.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.316+0000 7f30327fc700 1 -- 172.21.2.105:0/3984937197 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30340b0b30 con 0x7f30340ac280 2021-11-12T05:49:01.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.316+0000 7f30327fc700 1 --2- 172.21.2.105:0/3984937197 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f30340ac280 0x7f30340ad460 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f3024002f70 tx=0x7f3024006df0).ready entity=mon.2 client_cookie=63e8a1b9ec025ad8 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:01.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.316+0000 7f3031ffb700 1 -- 172.21.2.105:0/3984937197 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f302400d570 con 0x7f30340ac280 2021-11-12T05:49:01.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.316+0000 7f3031ffb700 1 -- 172.21.2.105:0/3984937197 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3024000e90 con 0x7f30340ac280 2021-11-12T05:49:01.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.316+0000 7f3031ffb700 1 -- 172.21.2.105:0/3984937197 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f302400d8c0 con 0x7f30340ac280 2021-11-12T05:49:01.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.316+0000 7f30392f7700 1 -- 172.21.2.105:0/3984937197 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f30340ac280 msgr2=0x7f30340ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:01.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.316+0000 7f30392f7700 1 --2- 172.21.2.105:0/3984937197 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f30340ac280 0x7f30340ad460 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f3024002f70 tx=0x7f3024006df0).stop 2021-11-12T05:49:01.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.316+0000 7f30392f7700 1 -- 172.21.2.105:0/3984937197 shutdown_connections 2021-11-12T05:49:01.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.316+0000 7f30392f7700 1 --2- 172.21.2.105:0/3984937197 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f30340ac280 0x7f30340ad460 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:01.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.316+0000 7f30392f7700 1 --2- 172.21.2.105:0/3984937197 >> v2:172.21.2.115:3300/0 conn(0x7f30340ad080 0x7f30340af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:01.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.316+0000 7f30392f7700 1 -- 172.21.2.105:0/3984937197 >> 172.21.2.105:0/3984937197 conn(0x7f30340b5370 msgr2=0x7f30340b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:01.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.316+0000 7f30392f7700 1 -- 172.21.2.105:0/3984937197 shutdown_connections 2021-11-12T05:49:01.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.316+0000 7f30392f7700 1 -- 172.21.2.105:0/3984937197 wait complete. 2021-11-12T05:49:01.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.320+0000 7f30392f7700 1 Processor -- start 2021-11-12T05:49:01.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.320+0000 7f30392f7700 1 -- start start 2021-11-12T05:49:01.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.320+0000 7f30392f7700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f30340ac280 0x7f3034066bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:01.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.320+0000 7f30392f7700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f30340ad080 0x7f30340670e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:01.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.320+0000 7f30392f7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f303414abe0 0x7f3034063950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:01.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.320+0000 7f30392f7700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30340a9b70 con 0x7f303414abe0 2021-11-12T05:49:01.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.320+0000 7f30392f7700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30340a9e10 con 0x7f30340ad080 2021-11-12T05:49:01.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.320+0000 7f30392f7700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30340aa0b0 con 0x7f30340ac280 2021-11-12T05:49:01.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.320+0000 7f30337fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f303414abe0 0x7f3034063950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:01.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.320+0000 7f30337fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f303414abe0 0x7f3034063950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51110/0 (socket says 172.21.2.105:51110) 2021-11-12T05:49:01.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.320+0000 7f30337fe700 1 -- 172.21.2.105:0/1382413202 learned_addr learned my addr 172.21.2.105:0/1382413202 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:01.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.320+0000 7f30327fc700 1 --2- 172.21.2.105:0/1382413202 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f30340ad080 0x7f30340670e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:01.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.320+0000 7f3032ffd700 1 --2- 172.21.2.105:0/1382413202 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f30340ac280 0x7f3034066bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:01.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.320+0000 7f30337fe700 1 -- 172.21.2.105:0/1382413202 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f30340ac280 msgr2=0x7f3034066bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:01.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.320+0000 7f30337fe700 1 --2- 172.21.2.105:0/1382413202 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f30340ac280 0x7f3034066bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:01.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.320+0000 7f30337fe700 1 -- 172.21.2.105:0/1382413202 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f30340ad080 msgr2=0x7f30340670e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:01.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.320+0000 7f30337fe700 1 --2- 172.21.2.105:0/1382413202 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f30340ad080 0x7f30340670e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:01.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.320+0000 7f30337fe700 1 -- 172.21.2.105:0/1382413202 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f302400b180 con 0x7f303414abe0 2021-11-12T05:49:01.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.320+0000 7f30327fc700 1 --2- 172.21.2.105:0/1382413202 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f30340ad080 0x7f30340670e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:49:01.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.320+0000 7f3032ffd700 1 --2- 172.21.2.105:0/1382413202 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f30340ac280 0x7f3034066bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:49:01.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.320+0000 7f30337fe700 1 --2- 172.21.2.105:0/1382413202 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f303414abe0 0x7f3034063950 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 rx=0x7f30340b6060 tx=0x7f302c007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:01.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.320+0000 7f3023fff700 1 -- 172.21.2.105:0/1382413202 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f302c005ba0 con 0x7f303414abe0 2021-11-12T05:49:01.334 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.320+0000 7f3023fff700 1 -- 172.21.2.105:0/1382413202 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302c005d00 con 0x7f303414abe0 2021-11-12T05:49:01.334 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.320+0000 7f30392f7700 1 -- 172.21.2.105:0/1382413202 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30340ab5a0 con 0x7f303414abe0 2021-11-12T05:49:01.334 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.320+0000 7f3023fff700 1 -- 172.21.2.105:0/1382413202 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f302c0072c0 con 0x7f303414abe0 2021-11-12T05:49:01.334 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.320+0000 7f30392f7700 1 -- 172.21.2.105:0/1382413202 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30340a9770 con 0x7f303414abe0 2021-11-12T05:49:01.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.320+0000 7f30392f7700 1 -- 172.21.2.105:0/1382413202 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30340ab730 con 0x7f303414abe0 2021-11-12T05:49:01.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.320+0000 7f3023fff700 1 -- 172.21.2.105:0/1382413202 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f302c01a070 con 0x7f303414abe0 2021-11-12T05:49:01.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.320+0000 7f3023fff700 1 --2- 172.21.2.105:0/1382413202 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3010053610 0x7f3010055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:01.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.320+0000 7f3023fff700 1 -- 172.21.2.105:0/1382413202 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f302c06aa90 con 0x7f303414abe0 2021-11-12T05:49:01.336 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.320+0000 7f3032ffd700 1 --2- 172.21.2.105:0/1382413202 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3010053610 0x7f3010055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:01.336 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.320+0000 7f3032ffd700 1 --2- 172.21.2.105:0/1382413202 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3010053610 0x7f3010055ad0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f302800b000 tx=0x7f3028008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:01.336 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.324+0000 7f3023fff700 1 -- 172.21.2.105:0/1382413202 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f302c041d70 con 0x7f303414abe0 2021-11-12T05:49:01.443 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:01.436+0000 7f30392f7700 1 -- 172.21.2.105:0/1382413202 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]} v 0) v1 -- 0x7f3034057350 con 0x7f303414abe0 2021-11-12T05:49:02.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.256+0000 7f3023fff700 1 -- 172.21.2.105:0/1382413202 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]}]=0 v364) v1 ==== 131+0+0 (secure 0 0 0) 0x7f302c045390 con 0x7f303414abe0 2021-11-12T05:49:02.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.260+0000 7f30392f7700 1 -- 172.21.2.105:0/1382413202 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3010053610 msgr2=0x7f3010055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:02.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.260+0000 7f30392f7700 1 --2- 172.21.2.105:0/1382413202 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3010053610 0x7f3010055ad0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f302800b000 tx=0x7f3028008040).stop 2021-11-12T05:49:02.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.260+0000 7f30392f7700 1 -- 172.21.2.105:0/1382413202 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f303414abe0 msgr2=0x7f3034063950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:02.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.260+0000 7f30392f7700 1 --2- 172.21.2.105:0/1382413202 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f303414abe0 0x7f3034063950 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 rx=0x7f30340b6060 tx=0x7f302c007f60).stop 2021-11-12T05:49:02.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.260+0000 7f30392f7700 1 -- 172.21.2.105:0/1382413202 shutdown_connections 2021-11-12T05:49:02.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.260+0000 7f30392f7700 1 --2- 172.21.2.105:0/1382413202 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3010053610 0x7f3010055ad0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:02.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.260+0000 7f30392f7700 1 --2- 172.21.2.105:0/1382413202 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f303414abe0 0x7f3034063950 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:02.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.260+0000 7f30392f7700 1 --2- 172.21.2.105:0/1382413202 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f30340ad080 0x7f30340670e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:02.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.260+0000 7f30392f7700 1 --2- 172.21.2.105:0/1382413202 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f30340ac280 0x7f3034066bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:02.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.260+0000 7f30392f7700 1 -- 172.21.2.105:0/1382413202 >> 172.21.2.105:0/1382413202 conn(0x7f30340b5370 msgr2=0x7f30340b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:02.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.260+0000 7f30392f7700 1 -- 172.21.2.105:0/1382413202 shutdown_connections 2021-11-12T05:49:02.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.260+0000 7f30392f7700 1 -- 172.21.2.105:0/1382413202 wait complete. 2021-11-12T05:49:02.271 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-11-12T05:49:02.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f0549fa0700 1 Processor -- start 2021-11-12T05:49:02.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f0549fa0700 1 -- start start 2021-11-12T05:49:02.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f0549fa0700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f05440aca40 0x7f05440ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:02.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f0549fa0700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05440b1840 con 0x7f0544144180 2021-11-12T05:49:02.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f0549fa0700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05440b09d0 con 0x7f05440b0520 2021-11-12T05:49:02.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f0549fa0700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05440af2b0 con 0x7f05440aca40 2021-11-12T05:49:02.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f05437fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f05440aca40 0x7f05440ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:02.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f0543fff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f0544144180 0x7f05441445f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:33286/0 (socket says 172.21.2.105:33286) 2021-11-12T05:49:02.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f0543fff700 1 -- 172.21.2.105:0/1438317721 learned_addr learned my addr 172.21.2.105:0/1438317721 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:02.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f05437fe700 1 -- 172.21.2.105:0/1438317721 >> v1:172.21.2.115:6789/0 conn(0x7f05440b0520 legacy=0x7f05441473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:02.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f05437fe700 1 -- 172.21.2.105:0/1438317721 >> v1:172.21.2.105:6789/0 conn(0x7f0544144180 legacy=0x7f05441445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:02.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f05437fe700 1 -- 172.21.2.105:0/1438317721 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05440b1a70 con 0x7f05440aca40 2021-11-12T05:49:02.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f05437fe700 1 --2- 172.21.2.105:0/1438317721 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f05440aca40 0x7f05440ace20 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 rx=0x7f05440611e0 tx=0x7f052c006df0).ready entity=mon.0 client_cookie=ca6cd3e733e7d5e6 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:02.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f05427fc700 1 -- 172.21.2.105:0/1438317721 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f052c00d5c0 con 0x7f05440aca40 2021-11-12T05:49:02.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f05427fc700 1 -- 172.21.2.105:0/1438317721 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052c000e90 con 0x7f05440aca40 2021-11-12T05:49:02.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f05427fc700 1 -- 172.21.2.105:0/1438317721 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f052c00d910 con 0x7f05440aca40 2021-11-12T05:49:02.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f0549fa0700 1 -- 172.21.2.105:0/1438317721 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f05440aca40 msgr2=0x7f05440ace20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:02.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f0549fa0700 1 --2- 172.21.2.105:0/1438317721 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f05440aca40 0x7f05440ace20 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 rx=0x7f05440611e0 tx=0x7f052c006df0).stop 2021-11-12T05:49:02.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f0549fa0700 1 -- 172.21.2.105:0/1438317721 shutdown_connections 2021-11-12T05:49:02.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f0549fa0700 1 --2- 172.21.2.105:0/1438317721 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f05440aca40 0x7f05440ace20 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:02.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f0549fa0700 1 -- 172.21.2.105:0/1438317721 >> 172.21.2.105:0/1438317721 conn(0x7f054405c490 msgr2=0x7f05440b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:02.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f0549fa0700 1 -- 172.21.2.105:0/1438317721 shutdown_connections 2021-11-12T05:49:02.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f0549fa0700 1 -- 172.21.2.105:0/1438317721 wait complete. 2021-11-12T05:49:02.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f0549fa0700 1 Processor -- start 2021-11-12T05:49:02.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f0549fa0700 1 -- start start 2021-11-12T05:49:02.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f0549fa0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f05440aca40 0x7f05440a8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:02.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f0549fa0700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f05440b0520 0x7f05441569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:02.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f0549fa0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0544144180 0x7f05441473f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:02.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f0549fa0700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0544142320 con 0x7f05440aca40 2021-11-12T05:49:02.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f0549fa0700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0544063370 con 0x7f05440b0520 2021-11-12T05:49:02.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f0549fa0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0544156ea0 con 0x7f0544144180 2021-11-12T05:49:02.334 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f05437fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f05440aca40 0x7f05440a8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:02.334 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f05437fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f05440aca40 0x7f05440a8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51126/0 (socket says 172.21.2.105:51126) 2021-11-12T05:49:02.334 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f05437fe700 1 -- 172.21.2.105:0/1603372736 learned_addr learned my addr 172.21.2.105:0/1603372736 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:02.334 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f05437fe700 1 -- 172.21.2.105:0/1603372736 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0544144180 msgr2=0x7f05441473f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:02.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f05437fe700 1 --2- 172.21.2.105:0/1603372736 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0544144180 0x7f05441473f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:02.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f05437fe700 1 -- 172.21.2.105:0/1603372736 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f05440b0520 msgr2=0x7f05441569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:02.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f05437fe700 1 --2- 172.21.2.105:0/1603372736 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f05440b0520 0x7f05441569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:02.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.320+0000 7f05437fe700 1 -- 172.21.2.105:0/1603372736 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052c00b180 con 0x7f05440aca40 2021-11-12T05:49:02.336 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.324+0000 7f05437fe700 1 --2- 172.21.2.105:0/1603372736 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f05440aca40 0x7f05440a8ae0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 rx=0x7f0544148670 tx=0x7f052c012000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:02.336 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.324+0000 7f0540ff9700 1 -- 172.21.2.105:0/1603372736 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f052c016070 con 0x7f05440aca40 2021-11-12T05:49:02.336 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.324+0000 7f0540ff9700 1 -- 172.21.2.105:0/1603372736 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052c002f50 con 0x7f05440aca40 2021-11-12T05:49:02.336 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.324+0000 7f0549fa0700 1 -- 172.21.2.105:0/1603372736 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05440630d0 con 0x7f05440aca40 2021-11-12T05:49:02.336 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.324+0000 7f0549fa0700 1 -- 172.21.2.105:0/1603372736 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0544148310 con 0x7f05440aca40 2021-11-12T05:49:02.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.324+0000 7f0540ff9700 1 -- 172.21.2.105:0/1603372736 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f052c013f00 con 0x7f05440aca40 2021-11-12T05:49:02.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.324+0000 7f0549fa0700 1 -- 172.21.2.105:0/1603372736 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05440a8880 con 0x7f05440aca40 2021-11-12T05:49:02.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.324+0000 7f0540ff9700 1 -- 172.21.2.105:0/1603372736 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f052c025030 con 0x7f05440aca40 2021-11-12T05:49:02.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.324+0000 7f0540ff9700 1 --2- 172.21.2.105:0/1603372736 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0528053610 0x7f0528055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:02.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.324+0000 7f0540ff9700 1 -- 172.21.2.105:0/1603372736 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f052c06c910 con 0x7f05440aca40 2021-11-12T05:49:02.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.324+0000 7f0542ffd700 1 --2- 172.21.2.105:0/1603372736 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0528053610 0x7f0528055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:02.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.324+0000 7f0542ffd700 1 --2- 172.21.2.105:0/1603372736 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0528053610 0x7f0528055ad0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f053c003310 tx=0x7f053c006d30).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:02.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.328+0000 7f0540ff9700 1 -- 172.21.2.105:0/1603372736 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f052c043ae0 con 0x7f05440aca40 2021-11-12T05:49:02.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.408+0000 7f0549fa0700 1 -- 172.21.2.105:0/1603372736 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f05440b09d0 con 0x7f05440aca40 2021-11-12T05:49:02.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.416+0000 7f0540ff9700 1 -- 172.21.2.105:0/1603372736 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f05440b09d0 con 0x7f05440aca40 2021-11-12T05:49:02.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.416+0000 7f0549fa0700 1 -- 172.21.2.105:0/1603372736 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0528053610 msgr2=0x7f0528055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:02.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.416+0000 7f0549fa0700 1 --2- 172.21.2.105:0/1603372736 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0528053610 0x7f0528055ad0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f053c003310 tx=0x7f053c006d30).stop 2021-11-12T05:49:02.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.416+0000 7f0549fa0700 1 -- 172.21.2.105:0/1603372736 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f05440aca40 msgr2=0x7f05440a8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:02.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.416+0000 7f0549fa0700 1 --2- 172.21.2.105:0/1603372736 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f05440aca40 0x7f05440a8ae0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 rx=0x7f0544148670 tx=0x7f052c012000).stop 2021-11-12T05:49:02.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.416+0000 7f0549fa0700 1 -- 172.21.2.105:0/1603372736 shutdown_connections 2021-11-12T05:49:02.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.416+0000 7f0549fa0700 1 --2- 172.21.2.105:0/1603372736 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0528053610 0x7f0528055ad0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:02.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.416+0000 7f0549fa0700 1 --2- 172.21.2.105:0/1603372736 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0544144180 0x7f05441473f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:02.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.416+0000 7f0549fa0700 1 --2- 172.21.2.105:0/1603372736 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f05440b0520 0x7f05441569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:02.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.416+0000 7f0549fa0700 1 --2- 172.21.2.105:0/1603372736 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f05440aca40 0x7f05440a8ae0 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:02.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.416+0000 7f0549fa0700 1 -- 172.21.2.105:0/1603372736 >> 172.21.2.105:0/1603372736 conn(0x7f054405c490 msgr2=0x7f0544142c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:02.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.416+0000 7f0549fa0700 1 -- 172.21.2.105:0/1603372736 shutdown_connections 2021-11-12T05:49:02.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.416+0000 7f0549fa0700 1 -- 172.21.2.105:0/1603372736 wait complete. 2021-11-12T05:49:02.427 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-12T05:49:02.427 DEBUG:teuthology.orchestra.run.gibba005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:49:02.435 DEBUG:teuthology.orchestra.run.gibba015:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:49:02.443 DEBUG:teuthology.orchestra.run.gibba016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:49:02.456 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:49:02.470 DEBUG:teuthology.orchestra.run.gibba044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:49:02.483 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-12T05:49:02.484 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:02.484 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:49:02.484 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:49:02.489 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:49:02.490 INFO:teuthology.orchestra.run.gibba016.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-12T05:49:02.490 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-11-12T05:49:02.491 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:02.491 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:49:02.492 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:49:02.496 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:49:02.496 INFO:teuthology.orchestra.run.gibba038.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-12T05:49:02.497 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-12T05:49:02.497 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:02.498 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:49:02.498 DEBUG:teuthology.orchestra.run.gibba044:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:49:02.507 INFO:teuthology.orchestra.run.gibba044.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-12T05:49:02.508 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:49:02.509 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-12T05:49:02.509 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-12T05:49:02.567 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a0e316700 1 Processor -- start 2021-11-12T05:49:02.567 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a0e316700 1 -- start start 2021-11-12T05:49:02.568 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a0e316700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f7a080626b0 0x7f7a08062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:02.568 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a0e316700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f7a08130a80 0x7f7a081474d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:02.569 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a0e316700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a080b0d50 con 0x7f7a080af750 2021-11-12T05:49:02.569 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a0e316700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a080ad380 con 0x7f7a08130a80 2021-11-12T05:49:02.569 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a0e316700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a080ae190 con 0x7f7a080626b0 2021-11-12T05:49:02.569 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a0c8b3700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f7a08130a80 0x7f7a081474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:02.570 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a0c8b3700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f7a08130a80 0x7f7a081474d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51134/0 (socket says 172.21.2.105:51134) 2021-11-12T05:49:02.570 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a0c8b3700 1 -- 172.21.2.105:0/681403793 learned_addr learned my addr 172.21.2.105:0/681403793 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:02.570 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a0c8b3700 1 -- 172.21.2.105:0/681403793 >> v2:172.21.2.115:3300/0 conn(0x7f7a080626b0 msgr2=0x7f7a08062a90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:49:02.570 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a0c8b3700 1 --2- 172.21.2.105:0/681403793 >> v2:172.21.2.115:3300/0 conn(0x7f7a080626b0 0x7f7a08062a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:02.571 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a0c8b3700 1 -- 172.21.2.105:0/681403793 >> v1:172.21.2.115:6789/0 conn(0x7f7a080af750 legacy=0x7f7a08130370 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:49:02.571 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a0c8b3700 1 -- 172.21.2.105:0/681403793 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a081479c0 con 0x7f7a08130a80 2021-11-12T05:49:02.571 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a0c8b3700 1 --2- 172.21.2.105:0/681403793 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7a08130a80 0x7f7a081474d0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7f7a080b0690 tx=0x7f7a00009290).ready entity=mon.0 client_cookie=944c4ced696e28d0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:02.571 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a06ffd700 1 -- 172.21.2.105:0/681403793 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a0000b830 con 0x7f7a08130a80 2021-11-12T05:49:02.571 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a06ffd700 1 -- 172.21.2.105:0/681403793 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0000b990 con 0x7f7a08130a80 2021-11-12T05:49:02.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a06ffd700 1 -- 172.21.2.105:0/681403793 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a0000bb40 con 0x7f7a08130a80 2021-11-12T05:49:02.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a0e316700 1 -- 172.21.2.105:0/681403793 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7a08130a80 msgr2=0x7f7a081474d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:02.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a0e316700 1 --2- 172.21.2.105:0/681403793 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7a08130a80 0x7f7a081474d0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7f7a080b0690 tx=0x7f7a00009290).stop 2021-11-12T05:49:02.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a0e316700 1 -- 172.21.2.105:0/681403793 shutdown_connections 2021-11-12T05:49:02.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a0e316700 1 --2- 172.21.2.105:0/681403793 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7a08130a80 0x7f7a081474d0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:02.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a0e316700 1 --2- 172.21.2.105:0/681403793 >> v2:172.21.2.115:3300/0 conn(0x7f7a080626b0 0x7f7a08062a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:02.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a0e316700 1 -- 172.21.2.105:0/681403793 >> 172.21.2.105:0/681403793 conn(0x7f7a080b5320 msgr2=0x7f7a080b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:02.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a0e316700 1 -- 172.21.2.105:0/681403793 shutdown_connections 2021-11-12T05:49:02.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a0e316700 1 -- 172.21.2.105:0/681403793 wait complete. 2021-11-12T05:49:02.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a0e316700 1 Processor -- start 2021-11-12T05:49:02.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a0e316700 1 -- start start 2021-11-12T05:49:02.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a0e316700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7a080626b0 0x7f7a08064f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:02.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a0e316700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7a080af750 0x7f7a08148850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:02.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a0e316700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7a08130a80 0x7f7a0812e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:02.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a0e316700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a08148d40 con 0x7f7a080af750 2021-11-12T05:49:02.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a0e316700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a080631b0 con 0x7f7a08130a80 2021-11-12T05:49:02.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a0e316700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a080635a0 con 0x7f7a080626b0 2021-11-12T05:49:02.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a077fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7a080af750 0x7f7a08148850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:02.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a077fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7a080af750 0x7f7a08148850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51140/0 (socket says 172.21.2.105:51140) 2021-11-12T05:49:02.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a077fe700 1 -- 172.21.2.105:0/1571557615 learned_addr learned my addr 172.21.2.105:0/1571557615 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:02.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a077fe700 1 -- 172.21.2.105:0/1571557615 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7a080626b0 msgr2=0x7f7a08064f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:02.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a077fe700 1 --2- 172.21.2.105:0/1571557615 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7a080626b0 0x7f7a08064f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:02.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a077fe700 1 -- 172.21.2.105:0/1571557615 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7a08130a80 msgr2=0x7f7a0812e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:02.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a077fe700 1 --2- 172.21.2.105:0/1571557615 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7a08130a80 0x7f7a0812e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:02.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a077fe700 1 -- 172.21.2.105:0/1571557615 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a00009530 con 0x7f7a080af750 2021-11-12T05:49:02.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.564+0000 7f7a077fe700 1 --2- 172.21.2.105:0/1571557615 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7a080af750 0x7f7a08148850 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 rx=0x7f79fc002fb0 tx=0x7f79fc006de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:02.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.568+0000 7f7a057fa700 1 -- 172.21.2.105:0/1571557615 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79fc013460 con 0x7f7a080af750 2021-11-12T05:49:02.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.568+0000 7f7a057fa700 1 -- 172.21.2.105:0/1571557615 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79fc0135c0 con 0x7f7a080af750 2021-11-12T05:49:02.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.568+0000 7f7a0e316700 1 -- 172.21.2.105:0/1571557615 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a08149c80 con 0x7f7a080af750 2021-11-12T05:49:02.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.568+0000 7f7a057fa700 1 -- 172.21.2.105:0/1571557615 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79fc013920 con 0x7f7a080af750 2021-11-12T05:49:02.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.568+0000 7f7a0e316700 1 -- 172.21.2.105:0/1571557615 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a080639e0 con 0x7f7a080af750 2021-11-12T05:49:02.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.568+0000 7f7a0e316700 1 -- 172.21.2.105:0/1571557615 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a08149e10 con 0x7f7a080af750 2021-11-12T05:49:02.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.568+0000 7f7a057fa700 1 -- 172.21.2.105:0/1571557615 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f79fc00f070 con 0x7f7a080af750 2021-11-12T05:49:02.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.568+0000 7f7a057fa700 1 --2- 172.21.2.105:0/1571557615 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f79e8053580 0x7f79e8055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:02.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.568+0000 7f7a057fa700 1 -- 172.21.2.105:0/1571557615 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f79fc06b320 con 0x7f7a080af750 2021-11-12T05:49:02.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.568+0000 7f7a07fff700 1 --2- 172.21.2.105:0/1571557615 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f79e8053580 0x7f79e8055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:02.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.568+0000 7f7a07fff700 1 --2- 172.21.2.105:0/1571557615 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f79e8053580 0x7f79e8055a40 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f79f8002fb0 tx=0x7f79f80069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:02.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.568+0000 7f7a057fa700 1 -- 172.21.2.105:0/1571557615 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f79fc0424f0 con 0x7f7a080af750 2021-11-12T05:49:02.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.652+0000 7f7a0e316700 1 -- 172.21.2.105:0/1571557615 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f7a08057350 con 0x7f7a080af750 2021-11-12T05:49:02.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.652+0000 7f7a057fa700 1 -- 172.21.2.105:0/1571557615 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v130) v1 ==== 81+0+29229 (secure 0 0 0) 0x7f79fc045b10 con 0x7f7a080af750 2021-11-12T05:49:02.658 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:02.659 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:49:02.659 INFO:teuthology.orchestra.run.gibba005.stdout: "epoch": 130, 2021-11-12T05:49:02.659 INFO:teuthology.orchestra.run.gibba005.stdout: "fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", 2021-11-12T05:49:02.659 INFO:teuthology.orchestra.run.gibba005.stdout: "created": "2021-11-12T05:40:19.986390+0000", 2021-11-12T05:49:02.659 INFO:teuthology.orchestra.run.gibba005.stdout: "modified": "2021-11-12T05:49:00.230876+0000", 2021-11-12T05:49:02.660 INFO:teuthology.orchestra.run.gibba005.stdout: "last_up_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:49:02.660 INFO:teuthology.orchestra.run.gibba005.stdout: "last_in_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:49:02.660 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-12T05:49:02.660 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_num": 5799936, 2021-11-12T05:49:02.661 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_set": [ 2021-11-12T05:49:02.661 INFO:teuthology.orchestra.run.gibba005.stdout: "pglog_hardlimit", 2021-11-12T05:49:02.661 INFO:teuthology.orchestra.run.gibba005.stdout: "purged_snapdirs", 2021-11-12T05:49:02.661 INFO:teuthology.orchestra.run.gibba005.stdout: "recovery_deletes", 2021-11-12T05:49:02.661 INFO:teuthology.orchestra.run.gibba005.stdout: "sortbitwise" 2021-11-12T05:49:02.662 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:49:02.662 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_version": 5, 2021-11-12T05:49:02.662 INFO:teuthology.orchestra.run.gibba005.stdout: "full_ratio": 0.94999998807907104, 2021-11-12T05:49:02.662 INFO:teuthology.orchestra.run.gibba005.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-12T05:49:02.663 INFO:teuthology.orchestra.run.gibba005.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-12T05:49:02.663 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_snapshot": "", 2021-11-12T05:49:02.663 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_max": 24, 2021-11-12T05:49:02.663 INFO:teuthology.orchestra.run.gibba005.stdout: "max_osd": 8, 2021-11-12T05:49:02.664 INFO:teuthology.orchestra.run.gibba005.stdout: "require_min_compat_client": "jewel", 2021-11-12T05:49:02.664 INFO:teuthology.orchestra.run.gibba005.stdout: "min_compat_client": "jewel", 2021-11-12T05:49:02.664 INFO:teuthology.orchestra.run.gibba005.stdout: "require_osd_release": "octopus", 2021-11-12T05:49:02.664 INFO:teuthology.orchestra.run.gibba005.stdout: "pools": [ 2021-11-12T05:49:02.664 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.665 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 1, 2021-11-12T05:49:02.665 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "device_health_metrics", 2021-11-12T05:49:02.665 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:22.022116+0000", 2021-11-12T05:49:02.665 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:49:02.665 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:49:02.666 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:49:02.666 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:49:02.666 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:49:02.666 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:49:02.667 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:49:02.667 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:49:02.667 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 1, 2021-11-12T05:49:02.667 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 1, 2021-11-12T05:49:02.667 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 1, 2021-11-12T05:49:02.668 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 1, 2021-11-12T05:49:02.668 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 1, 2021-11-12T05:49:02.668 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:49:02.668 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:49:02.669 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:49:02.669 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:49:02.669 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:49:02.669 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:49:02.670 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:49:02.670 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.670 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "16", 2021-11-12T05:49:02.670 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:49:02.670 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:49:02.671 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:49:02.671 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:49:02.671 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:49:02.671 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:49:02.672 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:49:02.672 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:49:02.672 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:49:02.672 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:49:02.672 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:49:02.673 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:49:02.673 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:49:02.673 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:49:02.673 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:49:02.674 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:49:02.674 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:49:02.674 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:49:02.674 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:49:02.674 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:49:02.675 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:49:02.675 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:49:02.675 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:49:02.675 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:49:02.676 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:49:02.676 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:49:02.676 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.676 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:49:02.676 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:49:02.677 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:49:02.677 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:49:02.677 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:49:02.677 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:49:02.678 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:49:02.678 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:49:02.678 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:49:02.678 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:49:02.678 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:49:02.679 INFO:teuthology.orchestra.run.gibba005.stdout: "options": { 2021-11-12T05:49:02.679 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_min": 1 2021-11-12T05:49:02.679 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.679 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:49:02.680 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr_devicehealth": {} 2021-11-12T05:49:02.680 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:02.680 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.680 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.680 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 2, 2021-11-12T05:49:02.681 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "rbd", 2021-11-12T05:49:02.681 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:29.953617+0000", 2021-11-12T05:49:02.681 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:49:02.681 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:49:02.682 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:49:02.682 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:49:02.682 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:49:02.682 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:49:02.682 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:49:02.683 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:49:02.683 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:49:02.683 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:49:02.683 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:49:02.684 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:49:02.684 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:49:02.684 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:49:02.684 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:49:02.684 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:49:02.685 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:49:02.685 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:49:02.685 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:49:02.685 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:49:02.686 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.686 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "19", 2021-11-12T05:49:02.686 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:49:02.686 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:49:02.686 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:49:02.687 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:49:02.687 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:49:02.687 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:49:02.687 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:49:02.688 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:49:02.688 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:49:02.688 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:49:02.688 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:49:02.688 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:49:02.689 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:49:02.689 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:49:02.689 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:49:02.689 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:49:02.690 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:49:02.690 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:49:02.690 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:49:02.690 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:49:02.690 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:49:02.691 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:49:02.691 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:49:02.691 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:49:02.691 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:49:02.692 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:49:02.692 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.692 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:49:02.692 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:49:02.692 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:49:02.693 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:49:02.693 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:49:02.693 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:49:02.693 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:49:02.694 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:49:02.694 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:49:02.694 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:49:02.694 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:49:02.694 INFO:teuthology.orchestra.run.gibba005.stdout: "options": {}, 2021-11-12T05:49:02.695 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:49:02.695 INFO:teuthology.orchestra.run.gibba005.stdout: "rbd": {} 2021-11-12T05:49:02.695 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:02.695 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:02.696 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:49:02.696 INFO:teuthology.orchestra.run.gibba005.stdout: "osds": [ 2021-11-12T05:49:02.696 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.696 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:49:02.696 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "ee8e30a0-4819-4475-80ec-dd3ee7d01322", 2021-11-12T05:49:02.697 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:02.697 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:02.697 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:02.697 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:02.698 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:02.698 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:02.698 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:02.698 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 126, 2021-11-12T05:49:02.698 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:02.699 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:02.699 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:02.699 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:02.699 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.699 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:02.700 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6802", 2021-11-12T05:49:02.700 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:02.700 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.700 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.700 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:02.701 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6803", 2021-11-12T05:49:02.701 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:02.701 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:02.701 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.701 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.702 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:02.702 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:02.702 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.702 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:02.703 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6804", 2021-11-12T05:49:02.703 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:02.703 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.703 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.703 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:02.704 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6805", 2021-11-12T05:49:02.704 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:02.704 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:02.704 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.704 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.705 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:02.705 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:02.705 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.705 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:02.705 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6808", 2021-11-12T05:49:02.706 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:02.706 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.706 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.706 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:02.707 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6809", 2021-11-12T05:49:02.707 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:02.707 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:02.707 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.707 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.708 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:02.708 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:02.708 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.708 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:02.709 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6806", 2021-11-12T05:49:02.709 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:02.709 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.709 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.709 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:02.710 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6807", 2021-11-12T05:49:02.710 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:02.710 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:02.710 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.711 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.711 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6803/14874", 2021-11-12T05:49:02.711 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6805/14874", 2021-11-12T05:49:02.711 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6809/14874", 2021-11-12T05:49:02.711 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6807/14874", 2021-11-12T05:49:02.712 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:02.712 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:02.712 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:02.712 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.712 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.713 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.713 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:49:02.713 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "b1bb06c3-26d0-4d92-82f8-b3e882242785", 2021-11-12T05:49:02.713 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:02.713 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:02.714 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:02.714 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:02.714 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:02.714 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:02.715 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:02.715 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 126, 2021-11-12T05:49:02.715 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:02.715 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:02.715 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:02.716 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:02.716 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.716 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:02.716 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6810", 2021-11-12T05:49:02.716 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:02.717 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.717 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.717 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:02.717 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6811", 2021-11-12T05:49:02.717 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:02.718 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:02.718 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.718 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.718 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:02.718 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:02.719 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.719 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:02.719 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6812", 2021-11-12T05:49:02.719 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:02.719 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.720 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.720 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:02.720 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6813", 2021-11-12T05:49:02.720 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:02.720 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:02.721 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.721 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.721 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:02.721 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:02.722 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.722 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:02.722 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6816", 2021-11-12T05:49:02.722 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:02.722 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.723 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.723 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:02.723 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6817", 2021-11-12T05:49:02.723 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:02.724 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:02.724 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.724 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.724 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:02.724 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:02.725 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.725 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:02.725 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6814", 2021-11-12T05:49:02.725 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:02.726 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.726 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.726 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:02.726 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6815", 2021-11-12T05:49:02.726 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:02.727 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:02.727 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.727 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.727 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6811/14875", 2021-11-12T05:49:02.728 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6813/14875", 2021-11-12T05:49:02.728 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6817/14875", 2021-11-12T05:49:02.728 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6815/14875", 2021-11-12T05:49:02.728 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:02.728 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:02.729 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:02.729 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.729 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.729 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.729 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:49:02.730 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "837b2c60-c335-4382-9f47-d86543a14022", 2021-11-12T05:49:02.730 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:02.730 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:02.730 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:02.731 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:02.731 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:02.731 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:02.731 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:02.731 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 121, 2021-11-12T05:49:02.732 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:02.732 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:02.732 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:02.732 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:02.733 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.733 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:02.733 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6818", 2021-11-12T05:49:02.733 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:02.733 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.734 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.734 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:02.734 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6819", 2021-11-12T05:49:02.734 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:02.734 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:02.735 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.735 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.735 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:02.735 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:02.736 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.736 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:02.736 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6820", 2021-11-12T05:49:02.736 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:02.736 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.737 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.737 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:02.737 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6821", 2021-11-12T05:49:02.737 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:02.737 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:02.738 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.738 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.738 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:02.738 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:02.739 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.739 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:02.739 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6824", 2021-11-12T05:49:02.739 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:02.740 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.740 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.740 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:02.740 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6825", 2021-11-12T05:49:02.740 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:02.741 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:02.741 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.741 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.741 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:02.741 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:02.742 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.742 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:02.742 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6822", 2021-11-12T05:49:02.742 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:02.742 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.743 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.743 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:02.743 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6823", 2021-11-12T05:49:02.743 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:02.744 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:02.744 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.744 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.744 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6819/14905", 2021-11-12T05:49:02.744 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6821/14905", 2021-11-12T05:49:02.745 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6825/14905", 2021-11-12T05:49:02.745 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6823/14905", 2021-11-12T05:49:02.745 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:02.745 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:02.745 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:02.746 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.746 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.746 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.746 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:49:02.746 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "eb2b737b-dda6-444b-a306-f33cbbd51f70", 2021-11-12T05:49:02.747 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:02.747 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:02.747 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:02.747 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:02.748 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:02.748 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:02.748 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:02.748 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 126, 2021-11-12T05:49:02.748 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:02.749 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:02.749 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:02.749 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:02.749 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.749 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:02.750 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6826", 2021-11-12T05:49:02.750 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:02.750 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.750 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.750 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:02.751 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6827", 2021-11-12T05:49:02.751 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:02.751 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:02.751 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.752 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.752 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:02.752 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:02.752 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.752 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:02.753 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6828", 2021-11-12T05:49:02.753 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:02.753 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.753 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.753 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:02.754 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6829", 2021-11-12T05:49:02.754 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:02.754 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:02.754 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.755 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.755 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:02.755 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:02.755 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.755 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:02.756 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6832", 2021-11-12T05:49:02.756 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:02.756 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.756 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.756 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:02.757 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6833", 2021-11-12T05:49:02.757 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:02.757 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:02.757 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.757 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.758 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:02.758 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:02.758 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.758 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:02.758 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6830", 2021-11-12T05:49:02.759 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:02.759 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.759 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.759 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:02.759 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6831", 2021-11-12T05:49:02.760 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:02.760 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:02.760 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.760 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.761 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6827/14876", 2021-11-12T05:49:02.761 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6829/14876", 2021-11-12T05:49:02.761 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6833/14876", 2021-11-12T05:49:02.761 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6831/14876", 2021-11-12T05:49:02.761 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:02.762 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:02.762 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:02.762 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.762 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.762 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.763 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:49:02.763 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "721529a1-c047-486a-a7ca-ddc15d80cdde", 2021-11-12T05:49:02.763 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:02.763 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:02.764 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:02.764 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:02.764 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:02.764 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:02.764 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:02.765 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 121, 2021-11-12T05:49:02.765 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:02.765 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:02.765 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:02.765 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:02.766 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.766 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:02.766 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6800", 2021-11-12T05:49:02.766 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:02.766 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.767 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.767 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:02.767 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6801", 2021-11-12T05:49:02.767 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:02.768 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:02.768 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.768 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.768 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:02.768 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:02.769 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.769 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:02.769 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6802", 2021-11-12T05:49:02.769 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:02.769 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.770 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.770 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:02.770 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6803", 2021-11-12T05:49:02.770 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:02.771 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:02.771 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.771 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.771 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:02.771 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:02.772 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.772 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:02.772 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6806", 2021-11-12T05:49:02.772 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:02.773 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.773 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.773 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:02.773 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6807", 2021-11-12T05:49:02.773 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:02.774 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:02.774 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.774 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.774 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:02.775 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:02.775 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.775 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:02.775 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6804", 2021-11-12T05:49:02.775 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:02.776 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.776 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.776 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:02.776 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6805", 2021-11-12T05:49:02.777 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:02.777 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:02.777 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.777 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.777 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6801/15096", 2021-11-12T05:49:02.778 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6803/15096", 2021-11-12T05:49:02.778 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6807/15096", 2021-11-12T05:49:02.778 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6805/15096", 2021-11-12T05:49:02.778 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:02.778 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:02.779 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:02.779 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.779 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.779 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.779 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:49:02.780 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "68b72ab2-fa82-4b5c-bf33-528f002e4950", 2021-11-12T05:49:02.780 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:02.780 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:02.780 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:02.781 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:02.781 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:02.781 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:02.781 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:02.781 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 126, 2021-11-12T05:49:02.782 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:02.782 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:02.782 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:02.782 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:02.783 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.783 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:02.783 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6808", 2021-11-12T05:49:02.783 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:02.783 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.784 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.784 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:02.784 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6809", 2021-11-12T05:49:02.784 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:02.785 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:02.785 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.785 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.785 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:02.785 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:02.786 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.786 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:02.786 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6810", 2021-11-12T05:49:02.786 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:02.787 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.787 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.787 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:02.787 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6811", 2021-11-12T05:49:02.787 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:02.788 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:02.788 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.788 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.788 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:02.788 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:02.789 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.789 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:02.789 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6814", 2021-11-12T05:49:02.789 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:02.789 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.790 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.790 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:02.790 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6815", 2021-11-12T05:49:02.790 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:02.791 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:02.791 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.791 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.791 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:02.791 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:02.792 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.792 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:02.792 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6812", 2021-11-12T05:49:02.792 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:02.792 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.793 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.793 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:02.793 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6813", 2021-11-12T05:49:02.793 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:02.793 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:02.794 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.794 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.794 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6809/15097", 2021-11-12T05:49:02.794 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6811/15097", 2021-11-12T05:49:02.795 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6815/15097", 2021-11-12T05:49:02.795 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6813/15097", 2021-11-12T05:49:02.799 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:02.800 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:02.800 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:02.800 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.800 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.801 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.801 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:49:02.801 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "a2c83b5d-8d37-4d30-ac04-30d89a76e485", 2021-11-12T05:49:02.801 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:02.801 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:02.802 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:02.802 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:02.802 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:02.802 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:02.802 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:02.803 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 126, 2021-11-12T05:49:02.803 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:02.803 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:02.803 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:02.803 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:02.804 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.804 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:02.804 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6816", 2021-11-12T05:49:02.804 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:02.804 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.805 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.805 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:02.805 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6817", 2021-11-12T05:49:02.805 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:02.805 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:02.806 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.806 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.806 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:02.806 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:02.806 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.807 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:02.807 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6818", 2021-11-12T05:49:02.807 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:02.807 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.808 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.808 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:02.808 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6819", 2021-11-12T05:49:02.808 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:02.808 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:02.808 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.809 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.809 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:02.809 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:02.809 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.810 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:02.810 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6822", 2021-11-12T05:49:02.810 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:02.810 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.810 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.811 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:02.811 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6823", 2021-11-12T05:49:02.811 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:02.811 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:02.811 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.811 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.812 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:02.812 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:02.812 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.812 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:02.812 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6820", 2021-11-12T05:49:02.813 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:02.813 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.813 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.813 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:02.814 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6821", 2021-11-12T05:49:02.814 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:02.814 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:02.814 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.815 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.815 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6817/15098", 2021-11-12T05:49:02.815 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6819/15098", 2021-11-12T05:49:02.815 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6823/15098", 2021-11-12T05:49:02.815 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6821/15098", 2021-11-12T05:49:02.816 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:02.816 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:02.816 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:02.816 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.817 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.817 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.817 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:49:02.817 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "786ce966-d0fb-4181-aed4-c26e3ef61c43", 2021-11-12T05:49:02.817 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:02.818 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:02.818 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:02.818 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:02.818 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:02.818 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:02.819 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:02.819 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 126, 2021-11-12T05:49:02.819 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:02.819 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:02.819 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:02.820 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:02.820 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.820 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:02.820 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6824", 2021-11-12T05:49:02.820 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:02.821 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.821 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.821 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:02.821 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6825", 2021-11-12T05:49:02.821 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:02.822 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:02.822 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.822 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.822 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:02.822 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:02.823 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.823 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:02.823 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6826", 2021-11-12T05:49:02.823 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:02.824 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.824 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.824 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:02.824 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6827", 2021-11-12T05:49:02.824 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:02.825 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:02.825 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.825 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.825 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:02.825 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:02.826 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.826 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:02.826 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6830", 2021-11-12T05:49:02.826 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:02.827 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.827 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.827 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:02.827 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6831", 2021-11-12T05:49:02.827 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:02.828 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:02.828 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.828 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.828 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:02.828 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:02.829 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.829 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:02.829 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6828", 2021-11-12T05:49:02.829 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:02.830 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.830 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.830 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:02.830 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6829", 2021-11-12T05:49:02.830 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:02.831 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:02.831 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.831 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.831 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6825/15099", 2021-11-12T05:49:02.832 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6827/15099", 2021-11-12T05:49:02.832 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6831/15099", 2021-11-12T05:49:02.832 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6829/15099", 2021-11-12T05:49:02.832 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:02.832 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:02.833 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:02.833 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:02.833 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:02.833 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:49:02.833 INFO:teuthology.orchestra.run.gibba005.stdout: "osd_xinfo": [ 2021-11-12T05:49:02.834 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.834 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:49:02.834 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:02.834 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:02.834 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:02.835 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:02.835 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:02.835 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.615112+0000", 2021-11-12T05:49:02.835 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:02.835 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.836 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.836 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:49:02.836 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:02.836 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:02.836 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:02.837 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:02.837 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:02.837 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.665935+0000", 2021-11-12T05:49:02.837 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:02.837 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.838 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.838 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:49:02.838 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:02.838 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:02.838 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:02.839 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:02.839 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:02.839 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.715877+0000", 2021-11-12T05:49:02.839 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:02.839 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.840 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.840 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:49:02.840 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:02.840 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:02.840 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:02.841 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:02.841 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:02.841 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.489234+0000", 2021-11-12T05:49:02.841 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:02.841 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.842 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.842 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:49:02.842 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:02.842 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:02.842 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:02.843 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:02.843 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:02.843 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.413776+0000", 2021-11-12T05:49:02.843 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:02.843 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.844 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.844 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:49:02.844 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:02.844 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:02.844 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:02.845 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:02.845 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:02.845 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.507960+0000", 2021-11-12T05:49:02.845 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:02.846 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.846 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.846 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:49:02.846 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:02.846 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:02.847 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:02.847 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:02.847 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:02.847 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.635696+0000", 2021-11-12T05:49:02.847 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:02.848 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.848 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:02.848 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:49:02.848 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:02.848 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:02.849 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:02.849 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:02.849 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:02.849 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.746949+0000", 2021-11-12T05:49:02.850 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:02.850 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:02.850 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:49:02.850 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap": [], 2021-11-12T05:49:02.850 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap_items": [], 2021-11-12T05:49:02.851 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_temp": [], 2021-11-12T05:49:02.851 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_temp": [], 2021-11-12T05:49:02.851 INFO:teuthology.orchestra.run.gibba005.stdout: "blacklist": { 2021-11-12T05:49:02.851 INFO:teuthology.orchestra.run.gibba005.stdout: "172.21.2.105:6835/2721453399": "2021-11-13T05:48:41.834794+0000", 2021-11-12T05:49:02.851 INFO:teuthology.orchestra.run.gibba005.stdout: "172.21.2.105:6834/2721453399": "2021-11-13T05:48:41.834794+0000" 2021-11-12T05:49:02.852 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.852 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profiles": { 2021-11-12T05:49:02.852 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs_data": { 2021-11-12T05:49:02.852 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-device-class": "", 2021-11-12T05:49:02.852 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:49:02.853 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-root": "default", 2021-11-12T05:49:02.853 INFO:teuthology.orchestra.run.gibba005.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-12T05:49:02.853 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:49:02.853 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "2", 2021-11-12T05:49:02.853 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:49:02.854 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:49:02.854 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van", 2021-11-12T05:49:02.854 INFO:teuthology.orchestra.run.gibba005.stdout: "w": "8" 2021-11-12T05:49:02.854 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.855 INFO:teuthology.orchestra.run.gibba005.stdout: "default": { 2021-11-12T05:49:02.855 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:49:02.855 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:49:02.855 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "1", 2021-11-12T05:49:02.855 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:49:02.856 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:49:02.856 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van" 2021-11-12T05:49:02.856 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:02.856 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:02.856 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps_queue": [], 2021-11-12T05:49:02.857 INFO:teuthology.orchestra.run.gibba005.stdout: "new_removed_snaps": [], 2021-11-12T05:49:02.857 INFO:teuthology.orchestra.run.gibba005.stdout: "new_purged_snaps": [], 2021-11-12T05:49:02.857 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_node_flags": {}, 2021-11-12T05:49:02.857 INFO:teuthology.orchestra.run.gibba005.stdout: "device_class_flags": {} 2021-11-12T05:49:02.857 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:49:02.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.652+0000 7f7a0e316700 1 -- 172.21.2.105:0/1571557615 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f79e8053580 msgr2=0x7f79e8055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:02.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.652+0000 7f7a0e316700 1 --2- 172.21.2.105:0/1571557615 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f79e8053580 0x7f79e8055a40 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f79f8002fb0 tx=0x7f79f80069b0).stop 2021-11-12T05:49:02.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.652+0000 7f7a0e316700 1 -- 172.21.2.105:0/1571557615 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7a080af750 msgr2=0x7f7a08148850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:02.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.652+0000 7f7a0e316700 1 --2- 172.21.2.105:0/1571557615 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7a080af750 0x7f7a08148850 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 rx=0x7f79fc002fb0 tx=0x7f79fc006de0).stop 2021-11-12T05:49:02.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.656+0000 7f7a0e316700 1 -- 172.21.2.105:0/1571557615 shutdown_connections 2021-11-12T05:49:02.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.656+0000 7f7a0e316700 1 --2- 172.21.2.105:0/1571557615 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f79e8053580 0x7f79e8055a40 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:02.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.656+0000 7f7a0e316700 1 --2- 172.21.2.105:0/1571557615 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7a08130a80 0x7f7a0812e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:02.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.656+0000 7f7a0e316700 1 --2- 172.21.2.105:0/1571557615 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7a080af750 0x7f7a08148850 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:02.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.656+0000 7f7a0e316700 1 --2- 172.21.2.105:0/1571557615 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7a080626b0 0x7f7a08064f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:02.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.656+0000 7f7a0e316700 1 -- 172.21.2.105:0/1571557615 >> 172.21.2.105:0/1571557615 conn(0x7f7a080b5320 msgr2=0x7f7a080b4750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:02.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.656+0000 7f7a0e316700 1 -- 172.21.2.105:0/1571557615 shutdown_connections 2021-11-12T05:49:02.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.656+0000 7f7a0e316700 1 -- 172.21.2.105:0/1571557615 wait complete. 2021-11-12T05:49:02.862 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:49:02.918 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.912+0000 7fa92183b700 1 Processor -- start 2021-11-12T05:49:02.918 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.912+0000 7fa92183b700 1 -- start start 2021-11-12T05:49:02.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.912+0000 7fa92183b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa91c0b64d0 0x7fa91c0b68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:02.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.912+0000 7fa92183b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa91c0ade50 0x7fa91c140470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:02.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.912+0000 7fa92183b700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa91c13fd30 con 0x7fa91c0b14f0 2021-11-12T05:49:02.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.912+0000 7fa92183b700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa91c0ae820 con 0x7fa91c0b64d0 2021-11-12T05:49:02.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.912+0000 7fa92183b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa91c13ffd0 con 0x7fa91c0ade50 2021-11-12T05:49:02.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.912+0000 7fa920839700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa91c0b64d0 0x7fa91c0b68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:02.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.912+0000 7fa920839700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa91c0b64d0 0x7fa91c0b68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51148/0 (socket says 172.21.2.105:51148) 2021-11-12T05:49:02.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.912+0000 7fa92103a700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fa91c0b14f0 0x7fa91c1396c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:33310/0 (socket says 172.21.2.105:33310) 2021-11-12T05:49:02.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.912+0000 7fa920839700 1 -- 172.21.2.105:0/3876670061 learned_addr learned my addr 172.21.2.105:0/3876670061 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:02.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.912+0000 7fa920839700 1 -- 172.21.2.105:0/3876670061 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa91c0ade50 msgr2=0x7fa91c140470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:02.924 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.912+0000 7fa920839700 1 --2- 172.21.2.105:0/3876670061 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa91c0ade50 0x7fa91c140470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:02.924 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.912+0000 7fa920839700 1 -- 172.21.2.105:0/3876670061 >> v1:172.21.2.105:6789/0 conn(0x7fa91c0b14f0 legacy=0x7fa91c1396c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:02.924 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.912+0000 7fa920839700 1 -- 172.21.2.105:0/3876670061 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa91c0b1b50 con 0x7fa91c0b64d0 2021-11-12T05:49:02.924 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.912+0000 7fa91b7fe700 1 -- 172.21.2.105:0/3876670061 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1025197482 0 0) 0x7fa91c13fd30 con 0x7fa91c0b14f0 2021-11-12T05:49:02.924 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa920839700 1 --2- 172.21.2.105:0/3876670061 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa91c0b64d0 0x7fa91c0b68b0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7fa91c0af410 tx=0x7fa90c006eb0).ready entity=mon.0 client_cookie=ae212062492883c7 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:02.925 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa91b7fe700 1 -- 172.21.2.105:0/3876670061 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa90c00d5c0 con 0x7fa91c0b64d0 2021-11-12T05:49:02.925 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa91b7fe700 1 -- 172.21.2.105:0/3876670061 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa90c000e90 con 0x7fa91c0b64d0 2021-11-12T05:49:02.925 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa91b7fe700 1 -- 172.21.2.105:0/3876670061 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa90c00d910 con 0x7fa91c0b64d0 2021-11-12T05:49:02.925 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa92183b700 1 -- 172.21.2.105:0/3876670061 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa91c0b64d0 msgr2=0x7fa91c0b68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:02.926 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa92183b700 1 --2- 172.21.2.105:0/3876670061 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa91c0b64d0 0x7fa91c0b68b0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7fa91c0af410 tx=0x7fa90c006eb0).stop 2021-11-12T05:49:02.926 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa92183b700 1 -- 172.21.2.105:0/3876670061 shutdown_connections 2021-11-12T05:49:02.926 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa92183b700 1 --2- 172.21.2.105:0/3876670061 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa91c0ade50 0x7fa91c140470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:02.926 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa92183b700 1 --2- 172.21.2.105:0/3876670061 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa91c0b64d0 0x7fa91c0b68b0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:02.926 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa92183b700 1 -- 172.21.2.105:0/3876670061 >> 172.21.2.105:0/3876670061 conn(0x7fa91c0613f0 msgr2=0x7fa91c0617d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:02.927 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa92183b700 1 -- 172.21.2.105:0/3876670061 shutdown_connections 2021-11-12T05:49:02.927 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa92183b700 1 -- 172.21.2.105:0/3876670061 wait complete. 2021-11-12T05:49:02.927 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa92183b700 1 Processor -- start 2021-11-12T05:49:02.927 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa92183b700 1 -- start start 2021-11-12T05:49:02.927 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa92183b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa91c0ade50 0x7fa91c065ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:02.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa92183b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa91c0b14f0 0x7fa91c1414a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:02.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa92183b700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa91c0b64d0 0x7fa91c141990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:02.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa92183b700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91c143610 con 0x7fa91c0b14f0 2021-11-12T05:49:02.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa92183b700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91c13d570 con 0x7fa91c0b64d0 2021-11-12T05:49:02.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa92183b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa91c0656b0 con 0x7fa91c0ade50 2021-11-12T05:49:02.929 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa91bfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa91c0b14f0 0x7fa91c1414a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:02.929 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa91bfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa91c0b14f0 0x7fa91c1414a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51154/0 (socket says 172.21.2.105:51154) 2021-11-12T05:49:02.929 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa91bfff700 1 -- 172.21.2.105:0/421995269 learned_addr learned my addr 172.21.2.105:0/421995269 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:02.929 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa91bfff700 1 -- 172.21.2.105:0/421995269 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa91c0ade50 msgr2=0x7fa91c065ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:02.930 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa91bfff700 1 --2- 172.21.2.105:0/421995269 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa91c0ade50 0x7fa91c065ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:02.930 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa91bfff700 1 -- 172.21.2.105:0/421995269 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa91c0b64d0 msgr2=0x7fa91c141990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:02.930 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa91bfff700 1 --2- 172.21.2.105:0/421995269 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa91c0b64d0 0x7fa91c141990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:02.930 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa91bfff700 1 -- 172.21.2.105:0/421995269 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa90c00b1e0 con 0x7fa91c0b14f0 2021-11-12T05:49:02.930 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa91bfff700 1 --2- 172.21.2.105:0/421995269 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa91c0b14f0 0x7fa91c1414a0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7fa904002f70 tx=0x7fa904006eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:02.931 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa919ffb700 1 -- 172.21.2.105:0/421995269 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa904013460 con 0x7fa91c0b14f0 2021-11-12T05:49:02.931 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa919ffb700 1 -- 172.21.2.105:0/421995269 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9040135c0 con 0x7fa91c0b14f0 2021-11-12T05:49:02.931 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa919ffb700 1 -- 172.21.2.105:0/421995269 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa904013920 con 0x7fa91c0b14f0 2021-11-12T05:49:02.931 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa92183b700 1 -- 172.21.2.105:0/421995269 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa91c15a830 con 0x7fa91c0b14f0 2021-11-12T05:49:02.931 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa92183b700 1 -- 172.21.2.105:0/421995269 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa91c065fd0 con 0x7fa91c0b14f0 2021-11-12T05:49:02.933 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa92183b700 1 -- 172.21.2.105:0/421995269 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa91c0640d0 con 0x7fa91c0b14f0 2021-11-12T05:49:02.933 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa919ffb700 1 -- 172.21.2.105:0/421995269 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa90400f070 con 0x7fa91c0b14f0 2021-11-12T05:49:02.933 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa919ffb700 1 --2- 172.21.2.105:0/421995269 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa9000536a0 0x7fa900055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:02.933 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa919ffb700 1 -- 172.21.2.105:0/421995269 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fa90406b100 con 0x7fa91c0b14f0 2021-11-12T05:49:02.933 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.916+0000 7fa920839700 1 --2- 172.21.2.105:0/421995269 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa9000536a0 0x7fa900055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:02.934 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.920+0000 7fa920839700 1 --2- 172.21.2.105:0/421995269 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa9000536a0 0x7fa900055b60 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7fa91c0af410 tx=0x7fa90c015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:02.934 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:02.920+0000 7fa919ffb700 1 -- 172.21.2.105:0/421995269 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa91c0640d0 con 0x7fa91c0b14f0 2021-11-12T05:49:03.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.028+0000 7fa92183b700 1 -- 172.21.2.105:0/421995269 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa91c0640d0 con 0x7fa91c0b14f0 2021-11-12T05:49:03.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.028+0000 7fa919ffb700 1 -- 172.21.2.105:0/421995269 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+504 (secure 0 0 0) 0x7fa91c0640d0 con 0x7fa91c0b14f0 2021-11-12T05:49:03.033 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:03.033 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":62,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[]} 2021-11-12T05:49:03.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.028+0000 7fa92183b700 1 -- 172.21.2.105:0/421995269 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa9000536a0 msgr2=0x7fa900055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:03.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.028+0000 7fa92183b700 1 --2- 172.21.2.105:0/421995269 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa9000536a0 0x7fa900055b60 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7fa91c0af410 tx=0x7fa90c015000).stop 2021-11-12T05:49:03.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.028+0000 7fa92183b700 1 -- 172.21.2.105:0/421995269 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa91c0b14f0 msgr2=0x7fa91c1414a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:03.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.028+0000 7fa92183b700 1 --2- 172.21.2.105:0/421995269 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa91c0b14f0 0x7fa91c1414a0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7fa904002f70 tx=0x7fa904006eb0).stop 2021-11-12T05:49:03.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.028+0000 7fa92183b700 1 -- 172.21.2.105:0/421995269 shutdown_connections 2021-11-12T05:49:03.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.028+0000 7fa92183b700 1 --2- 172.21.2.105:0/421995269 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa9000536a0 0x7fa900055b60 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:03.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.028+0000 7fa92183b700 1 --2- 172.21.2.105:0/421995269 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa91c0b64d0 0x7fa91c141990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:03.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.028+0000 7fa92183b700 1 --2- 172.21.2.105:0/421995269 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa91c0b14f0 0x7fa91c1414a0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:03.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.028+0000 7fa92183b700 1 --2- 172.21.2.105:0/421995269 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa91c0ade50 0x7fa91c065ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:03.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.028+0000 7fa92183b700 1 -- 172.21.2.105:0/421995269 >> 172.21.2.105:0/421995269 conn(0x7fa91c0613f0 msgr2=0x7fa91c0b58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:03.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.028+0000 7fa92183b700 1 -- 172.21.2.105:0/421995269 shutdown_connections 2021-11-12T05:49:03.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.028+0000 7fa92183b700 1 -- 172.21.2.105:0/421995269 wait complete. 2021-11-12T05:49:03.037 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 62 2021-11-12T05:49:03.041 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:49:03.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca3859c700 1 Processor -- start 2021-11-12T05:49:03.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca3859c700 1 -- start start 2021-11-12T05:49:03.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca3859c700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fca300ade80 0x7fca300601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:03.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca3859c700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca30066150 con 0x7fca3013a9c0 2021-11-12T05:49:03.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca3859c700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca300663f0 con 0x7fca3005fdc0 2021-11-12T05:49:03.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca3859c700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca30141fb0 con 0x7fca300ade80 2021-11-12T05:49:03.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca36b39700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fca3013a9c0 0x7fca30141470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:33326/0 (socket says 172.21.2.105:33326) 2021-11-12T05:49:03.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca36b39700 1 -- 172.21.2.105:0/162638302 learned_addr learned my addr 172.21.2.105:0/162638302 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:03.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca35336700 1 -- 172.21.2.105:0/162638302 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3236232266 0 0) 0x7fca30066150 con 0x7fca3013a9c0 2021-11-12T05:49:03.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca35336700 1 -- 172.21.2.105:0/162638302 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca18003260 con 0x7fca3013a9c0 2021-11-12T05:49:03.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca35b37700 1 --2- 172.21.2.105:0/162638302 >> v2:172.21.2.115:3300/0 conn(0x7fca300ade80 0x7fca300601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:03.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca35336700 1 -- 172.21.2.105:0/162638302 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1907902157 0 0) 0x7fca18003260 con 0x7fca3013a9c0 2021-11-12T05:49:03.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca35336700 1 -- 172.21.2.105:0/162638302 >> v2:172.21.2.115:3300/0 conn(0x7fca300ade80 msgr2=0x7fca300601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:03.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca35336700 1 --2- 172.21.2.105:0/162638302 >> v2:172.21.2.115:3300/0 conn(0x7fca300ade80 0x7fca300601a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:03.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca35336700 1 -- 172.21.2.105:0/162638302 >> v1:172.21.2.115:6789/0 conn(0x7fca3005fdc0 legacy=0x7fca30066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:03.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca35336700 1 -- 172.21.2.105:0/162638302 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca30140fd0 con 0x7fca3013a9c0 2021-11-12T05:49:03.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca35336700 1 -- 172.21.2.105:0/162638302 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fca280019e0 con 0x7fca3013a9c0 2021-11-12T05:49:03.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca35336700 1 -- 172.21.2.105:0/162638302 >> v1:172.21.2.105:6789/0 conn(0x7fca3013a9c0 legacy=0x7fca30141470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:03.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca35336700 1 --2- 172.21.2.105:0/162638302 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fca18003820 0x7fca18003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:03.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca35336700 1 --2- 172.21.2.105:0/162638302 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fca18004500 0x7fca18004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:03.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca35336700 1 --2- 172.21.2.105:0/162638302 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fca18005050 0x7fca1800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:03.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca35336700 1 -- 172.21.2.105:0/162638302 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1800bf10 con 0x7fca18003820 2021-11-12T05:49:03.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca35336700 1 -- 172.21.2.105:0/162638302 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1800c080 con 0x7fca18004500 2021-11-12T05:49:03.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca35336700 1 -- 172.21.2.105:0/162638302 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca1800c240 con 0x7fca18005050 2021-11-12T05:49:03.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca36338700 1 --2- 172.21.2.105:0/162638302 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fca18003820 0x7fca18003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:03.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca35b37700 1 --2- 172.21.2.105:0/162638302 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fca18004500 0x7fca18004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:03.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca36b39700 1 --2- 172.21.2.105:0/162638302 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fca18005050 0x7fca1800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:03.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca36338700 1 -- 172.21.2.105:0/162638302 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fca18005050 msgr2=0x7fca1800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:03.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca36338700 1 --2- 172.21.2.105:0/162638302 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fca18005050 0x7fca1800b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:03.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca36338700 1 -- 172.21.2.105:0/162638302 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fca18004500 msgr2=0x7fca18004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:03.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca36338700 1 --2- 172.21.2.105:0/162638302 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fca18004500 0x7fca18004980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:03.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca36338700 1 -- 172.21.2.105:0/162638302 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca18003260 con 0x7fca18003820 2021-11-12T05:49:03.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca36b39700 1 -- 172.21.2.105:0/162638302 reap_dead start 2021-11-12T05:49:03.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca36338700 1 --2- 172.21.2.105:0/162638302 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fca18003820 0x7fca18003c20 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 rx=0x7fca2c001fa0 tx=0x7fca2c007a00).ready entity=mon.0 client_cookie=45d75483607ec51a server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:03.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca35336700 1 -- 172.21.2.105:0/162638302 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca2c007070 con 0x7fca18003820 2021-11-12T05:49:03.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca35336700 1 -- 172.21.2.105:0/162638302 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2c0071d0 con 0x7fca18003820 2021-11-12T05:49:03.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca35336700 1 -- 172.21.2.105:0/162638302 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca2c006510 con 0x7fca18003820 2021-11-12T05:49:03.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca3859c700 1 -- 172.21.2.105:0/162638302 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fca18003820 msgr2=0x7fca18003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:03.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca3859c700 1 --2- 172.21.2.105:0/162638302 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fca18003820 0x7fca18003c20 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 rx=0x7fca2c001fa0 tx=0x7fca2c007a00).stop 2021-11-12T05:49:03.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca3859c700 1 -- 172.21.2.105:0/162638302 shutdown_connections 2021-11-12T05:49:03.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca3859c700 1 --2- 172.21.2.105:0/162638302 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fca18003820 0x7fca18003c20 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:03.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca3859c700 1 -- 172.21.2.105:0/162638302 >> 172.21.2.105:0/162638302 conn(0x7fca300608d0 msgr2=0x7fca3005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:03.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca3859c700 1 -- 172.21.2.105:0/162638302 shutdown_connections 2021-11-12T05:49:03.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca3859c700 1 -- 172.21.2.105:0/162638302 wait complete. 2021-11-12T05:49:03.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.088+0000 7fca3859c700 1 Processor -- start 2021-11-12T05:49:03.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.092+0000 7fca3859c700 1 -- start start 2021-11-12T05:49:03.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.092+0000 7fca3859c700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fca18003820 0x7fca30144470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:03.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.092+0000 7fca3859c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fca3013b260 0x7fca3013f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:03.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.092+0000 7fca3859c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fca30144ab0 0x7fca3013feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:03.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.092+0000 7fca3859c700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3013d040 con 0x7fca30144ab0 2021-11-12T05:49:03.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.092+0000 7fca3859c700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3013d270 con 0x7fca18003820 2021-11-12T05:49:03.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.092+0000 7fca3859c700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca301403a0 con 0x7fca3013b260 2021-11-12T05:49:03.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.092+0000 7fca36b39700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fca30144ab0 0x7fca3013feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:03.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.092+0000 7fca36b39700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fca30144ab0 0x7fca3013feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51172/0 (socket says 172.21.2.105:51172) 2021-11-12T05:49:03.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.092+0000 7fca36b39700 1 -- 172.21.2.105:0/2207419700 learned_addr learned my addr 172.21.2.105:0/2207419700 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:03.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.092+0000 7fca36b39700 1 -- 172.21.2.105:0/2207419700 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fca3013b260 msgr2=0x7fca3013f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:03.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.092+0000 7fca36b39700 1 --2- 172.21.2.105:0/2207419700 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fca3013b260 0x7fca3013f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:03.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.092+0000 7fca36b39700 1 -- 172.21.2.105:0/2207419700 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fca18003820 msgr2=0x7fca30144470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:03.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.092+0000 7fca36b39700 1 --2- 172.21.2.105:0/2207419700 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fca18003820 0x7fca30144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:03.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.092+0000 7fca36b39700 1 -- 172.21.2.105:0/2207419700 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca30143870 con 0x7fca30144ab0 2021-11-12T05:49:03.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.092+0000 7fca36b39700 1 --2- 172.21.2.105:0/2207419700 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fca30144ab0 0x7fca3013feb0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 rx=0x7fca280016f0 tx=0x7fca28009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:03.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.092+0000 7fca1f7fe700 1 -- 172.21.2.105:0/2207419700 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca280020d0 con 0x7fca30144ab0 2021-11-12T05:49:03.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.092+0000 7fca1f7fe700 1 -- 172.21.2.105:0/2207419700 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca28004ab0 con 0x7fca30144ab0 2021-11-12T05:49:03.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.092+0000 7fca3859c700 1 -- 172.21.2.105:0/2207419700 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca301430f0 con 0x7fca30144ab0 2021-11-12T05:49:03.109 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.092+0000 7fca1f7fe700 1 -- 172.21.2.105:0/2207419700 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca28004e10 con 0x7fca30144ab0 2021-11-12T05:49:03.110 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.092+0000 7fca3859c700 1 -- 172.21.2.105:0/2207419700 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca30150040 con 0x7fca30144ab0 2021-11-12T05:49:03.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.092+0000 7fca3859c700 1 -- 172.21.2.105:0/2207419700 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca3013d430 con 0x7fca30144ab0 2021-11-12T05:49:03.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.092+0000 7fca1f7fe700 1 -- 172.21.2.105:0/2207419700 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fca28007030 con 0x7fca30144ab0 2021-11-12T05:49:03.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.092+0000 7fca1f7fe700 1 --2- 172.21.2.105:0/2207419700 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fca100536d0 0x7fca10055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:03.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.092+0000 7fca1f7fe700 1 -- 172.21.2.105:0/2207419700 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fca2806b770 con 0x7fca30144ab0 2021-11-12T05:49:03.112 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.092+0000 7fca36338700 1 --2- 172.21.2.105:0/2207419700 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fca100536d0 0x7fca10055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:03.112 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.092+0000 7fca36338700 1 --2- 172.21.2.105:0/2207419700 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fca100536d0 0x7fca10055b90 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7fca2c001fa0 tx=0x7fca2c015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:03.112 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.096+0000 7fca1f7fe700 1 -- 172.21.2.105:0/2207419700 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fca280429f0 con 0x7fca30144ab0 2021-11-12T05:49:03.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.204+0000 7fca3859c700 1 -- 172.21.2.105:0/2207419700 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fca30057350 con 0x7fca30144ab0 2021-11-12T05:49:03.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.204+0000 7fca1f7fe700 1 -- 172.21.2.105:0/2207419700 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+504 (secure 0 0 0) 0x7fca28046010 con 0x7fca30144ab0 2021-11-12T05:49:03.209 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:03.210 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":62,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[]} 2021-11-12T05:49:03.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.204+0000 7fca3859c700 1 -- 172.21.2.105:0/2207419700 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fca100536d0 msgr2=0x7fca10055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:03.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.204+0000 7fca3859c700 1 --2- 172.21.2.105:0/2207419700 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fca100536d0 0x7fca10055b90 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7fca2c001fa0 tx=0x7fca2c015000).stop 2021-11-12T05:49:03.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.204+0000 7fca3859c700 1 -- 172.21.2.105:0/2207419700 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fca30144ab0 msgr2=0x7fca3013feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:03.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.204+0000 7fca3859c700 1 --2- 172.21.2.105:0/2207419700 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fca30144ab0 0x7fca3013feb0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 rx=0x7fca280016f0 tx=0x7fca28009040).stop 2021-11-12T05:49:03.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.204+0000 7fca3859c700 1 -- 172.21.2.105:0/2207419700 shutdown_connections 2021-11-12T05:49:03.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.204+0000 7fca3859c700 1 --2- 172.21.2.105:0/2207419700 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fca100536d0 0x7fca10055b90 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:03.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.204+0000 7fca3859c700 1 --2- 172.21.2.105:0/2207419700 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fca30144ab0 0x7fca3013feb0 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:03.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.204+0000 7fca3859c700 1 --2- 172.21.2.105:0/2207419700 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fca3013b260 0x7fca3013f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:03.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.204+0000 7fca3859c700 1 --2- 172.21.2.105:0/2207419700 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fca18003820 0x7fca30144470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:03.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.204+0000 7fca3859c700 1 -- 172.21.2.105:0/2207419700 >> 172.21.2.105:0/2207419700 conn(0x7fca300608d0 msgr2=0x7fca300af2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:03.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.204+0000 7fca3859c700 1 -- 172.21.2.105:0/2207419700 shutdown_connections 2021-11-12T05:49:03.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.204+0000 7fca3859c700 1 -- 172.21.2.105:0/2207419700 wait complete. 2021-11-12T05:49:03.213 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 62 2021-11-12T05:49:03.217 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-12T05:49:03.217 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-12T05:49:03.218 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-12T05:49:03.218 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-12T05:49:03.220 INFO:tasks.ceph.mds.a:Started 2021-11-12T05:49:03.220 DEBUG:teuthology.parallel:result is None 2021-11-12T05:49:03.221 INFO:tasks.ceph.mds.b:Started 2021-11-12T05:49:03.222 DEBUG:teuthology.parallel:result is None 2021-11-12T05:49:03.222 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-11-12T05:49:03.252 INFO:tasks.ceph.mds.a.gibba005.stdout:starting mds.a at 2021-11-12T05:49:03.260 INFO:tasks.ceph.mds.b.gibba015.stdout:starting mds.b at 2021-11-12T05:49:03.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.268+0000 7f665d1e3700 1 Processor -- start 2021-11-12T05:49:03.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.268+0000 7f665d1e3700 1 -- start start 2021-11-12T05:49:03.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f665d1e3700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66580ab3a0 0x7f66580acab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:03.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f665d1e3700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6658146e90 con 0x7f66580b2ef0 2021-11-12T05:49:03.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f665d1e3700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66580b6b70 con 0x7f66580b6790 2021-11-12T05:49:03.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f665d1e3700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6658060500 con 0x7f66580ab3a0 2021-11-12T05:49:03.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f665659c700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f66580b2ef0 0x7f6658146780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:33358/0 (socket says 172.21.2.105:33358) 2021-11-12T05:49:03.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f665659c700 1 -- 172.21.2.105:0/1505642529 learned_addr learned my addr 172.21.2.105:0/1505642529 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:03.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f665759e700 1 --2- 172.21.2.105:0/1505642529 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66580ab3a0 0x7f66580acab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:03.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f6655d9b700 1 -- 172.21.2.105:0/1505642529 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 415505582 0 0) 0x7f6658146e90 con 0x7f66580b2ef0 2021-11-12T05:49:03.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f6655d9b700 1 -- 172.21.2.105:0/1505642529 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6638003260 con 0x7f66580b2ef0 2021-11-12T05:49:03.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f6655d9b700 1 -- 172.21.2.105:0/1505642529 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1799985955 0 0) 0x7f6638003260 con 0x7f66580b2ef0 2021-11-12T05:49:03.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f6655d9b700 1 -- 172.21.2.105:0/1505642529 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66580ab3a0 msgr2=0x7f66580acab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:03.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f6655d9b700 1 --2- 172.21.2.105:0/1505642529 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66580ab3a0 0x7f66580acab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:03.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f6655d9b700 1 -- 172.21.2.105:0/1505642529 >> v1:172.21.2.115:6789/0 conn(0x7f66580b6790 legacy=0x7f665805fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:03.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f6655d9b700 1 -- 172.21.2.105:0/1505642529 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66580b3470 con 0x7f66580b2ef0 2021-11-12T05:49:03.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f6655d9b700 1 -- 172.21.2.105:0/1505642529 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f6648001660 con 0x7f66580b2ef0 2021-11-12T05:49:03.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f6655d9b700 1 -- 172.21.2.105:0/1505642529 >> v1:172.21.2.105:6789/0 conn(0x7f66580b2ef0 legacy=0x7f6658146780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:03.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f6655d9b700 1 --2- 172.21.2.105:0/1505642529 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66580ab3a0 0x7f6638003780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:03.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f6655d9b700 1 --2- 172.21.2.105:0/1505642529 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6638003d00 0x7f6638004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:03.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f6655d9b700 1 --2- 172.21.2.105:0/1505642529 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f66380049f0 0x7f6638004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:03.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f6655d9b700 1 -- 172.21.2.105:0/1505642529 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6658060500 con 0x7f6638003d00 2021-11-12T05:49:03.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f6655d9b700 1 -- 172.21.2.105:0/1505642529 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663800b830 con 0x7f66380049f0 2021-11-12T05:49:03.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f6655d9b700 1 -- 172.21.2.105:0/1505642529 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663800b9f0 con 0x7f66580ab3a0 2021-11-12T05:49:03.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f665659c700 1 --2- 172.21.2.105:0/1505642529 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6638003d00 0x7f6638004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:03.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f6656d9d700 1 --2- 172.21.2.105:0/1505642529 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66580ab3a0 0x7f6638003780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:03.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f665759e700 1 --2- 172.21.2.105:0/1505642529 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f66380049f0 0x7f6638004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:03.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f665659c700 1 -- 172.21.2.105:0/1505642529 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66580ab3a0 msgr2=0x7f6638003780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:03.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f665659c700 1 --2- 172.21.2.105:0/1505642529 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66580ab3a0 0x7f6638003780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:03.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f665659c700 1 -- 172.21.2.105:0/1505642529 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f66380049f0 msgr2=0x7f6638004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:03.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f665659c700 1 --2- 172.21.2.105:0/1505642529 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f66380049f0 0x7f6638004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:03.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f665659c700 1 -- 172.21.2.105:0/1505642529 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6638003260 con 0x7f6638003d00 2021-11-12T05:49:03.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f665759e700 1 --2- 172.21.2.105:0/1505642529 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f66380049f0 0x7f6638004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:49:03.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f665659c700 1 --2- 172.21.2.105:0/1505642529 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6638003d00 0x7f6638004500 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 rx=0x7f6648001370 tx=0x7f66580b3600).ready entity=mon.0 client_cookie=ecd92c7a188d0e59 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:03.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f6655d9b700 1 -- 172.21.2.105:0/1505642529 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66480070d0 con 0x7f6638003d00 2021-11-12T05:49:03.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f6655d9b700 1 -- 172.21.2.105:0/1505642529 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6648007230 con 0x7f6638003d00 2021-11-12T05:49:03.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f6655d9b700 1 -- 172.21.2.105:0/1505642529 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f664800c8f0 con 0x7f6638003d00 2021-11-12T05:49:03.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f665d1e3700 1 -- 172.21.2.105:0/1505642529 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6638003d00 msgr2=0x7f6638004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:03.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f665d1e3700 1 --2- 172.21.2.105:0/1505642529 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6638003d00 0x7f6638004500 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 rx=0x7f6648001370 tx=0x7f66580b3600).stop 2021-11-12T05:49:03.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f665759e700 1 -- 172.21.2.105:0/1505642529 reap_dead start 2021-11-12T05:49:03.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f665d1e3700 1 -- 172.21.2.105:0/1505642529 shutdown_connections 2021-11-12T05:49:03.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f665d1e3700 1 -- 172.21.2.105:0/1505642529 >> 172.21.2.105:0/1505642529 conn(0x7f6658063610 msgr2=0x7f66580639f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:03.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f665d1e3700 1 -- 172.21.2.105:0/1505642529 shutdown_connections 2021-11-12T05:49:03.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f665d1e3700 1 -- 172.21.2.105:0/1505642529 wait complete. 2021-11-12T05:49:03.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f665d1e3700 1 Processor -- start 2021-11-12T05:49:03.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.272+0000 7f665d1e3700 1 -- start start 2021-11-12T05:49:03.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.276+0000 7f665d1e3700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6638003d00 0x7f66580ae820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:03.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.276+0000 7f665d1e3700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66580afb70 0x7f6658147f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:03.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.276+0000 7f665d1e3700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66580a9ea0 0x7f6658148410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:03.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.276+0000 7f665d1e3700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66580ad9b0 con 0x7f66580afb70 2021-11-12T05:49:03.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.276+0000 7f665d1e3700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6658147a80 con 0x7f6638003d00 2021-11-12T05:49:03.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.276+0000 7f665d1e3700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66580aed10 con 0x7f66580a9ea0 2021-11-12T05:49:03.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.276+0000 7f665659c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66580afb70 0x7f6658147f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:03.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.276+0000 7f665659c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66580afb70 0x7f6658147f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51204/0 (socket says 172.21.2.105:51204) 2021-11-12T05:49:03.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.276+0000 7f665659c700 1 -- 172.21.2.105:0/1814972158 learned_addr learned my addr 172.21.2.105:0/1814972158 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:03.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.276+0000 7f6656d9d700 1 --2- 172.21.2.105:0/1814972158 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6638003d00 0x7f66580ae820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:03.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.276+0000 7f665759e700 1 --2- 172.21.2.105:0/1814972158 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66580a9ea0 0x7f6658148410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:03.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.276+0000 7f665659c700 1 -- 172.21.2.105:0/1814972158 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66580a9ea0 msgr2=0x7f6658148410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:03.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.276+0000 7f665659c700 1 --2- 172.21.2.105:0/1814972158 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66580a9ea0 0x7f6658148410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:03.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.276+0000 7f665659c700 1 -- 172.21.2.105:0/1814972158 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6638003d00 msgr2=0x7f66580ae820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:03.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.276+0000 7f665659c700 1 --2- 172.21.2.105:0/1814972158 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6638003d00 0x7f66580ae820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:03.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.276+0000 7f665659c700 1 -- 172.21.2.105:0/1814972158 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66580ae380 con 0x7f66580afb70 2021-11-12T05:49:03.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.276+0000 7f665659c700 1 --2- 172.21.2.105:0/1814972158 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66580afb70 0x7f6658147f20 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 rx=0x7f6648001370 tx=0x7f6648013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:03.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.276+0000 7f664ffff700 1 -- 172.21.2.105:0/1814972158 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6648017030 con 0x7f66580afb70 2021-11-12T05:49:03.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.276+0000 7f664ffff700 1 -- 172.21.2.105:0/1814972158 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6648004730 con 0x7f66580afb70 2021-11-12T05:49:03.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.276+0000 7f665d1e3700 1 -- 172.21.2.105:0/1814972158 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6658155e30 con 0x7f66580afb70 2021-11-12T05:49:03.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.276+0000 7f664ffff700 1 -- 172.21.2.105:0/1814972158 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f664801a040 con 0x7f66580afb70 2021-11-12T05:49:03.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.276+0000 7f665d1e3700 1 -- 172.21.2.105:0/1814972158 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66581562e0 con 0x7f66580afb70 2021-11-12T05:49:03.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.276+0000 7f665d1e3700 1 -- 172.21.2.105:0/1814972158 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f665805f6b0 con 0x7f66580afb70 2021-11-12T05:49:03.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.276+0000 7f664ffff700 1 -- 172.21.2.105:0/1814972158 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6648010070 con 0x7f66580afb70 2021-11-12T05:49:03.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.276+0000 7f664ffff700 1 --2- 172.21.2.105:0/1814972158 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f663c0536a0 0x7f663c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:03.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.276+0000 7f664ffff700 1 -- 172.21.2.105:0/1814972158 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f664806c350 con 0x7f66580afb70 2021-11-12T05:49:03.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.276+0000 7f6656d9d700 1 --2- 172.21.2.105:0/1814972158 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f663c0536a0 0x7f663c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:03.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.276+0000 7f6656d9d700 1 --2- 172.21.2.105:0/1814972158 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f663c0536a0 0x7f663c055b60 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f6640003000 tx=0x7f6640009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:03.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.280+0000 7f664ffff700 1 -- 172.21.2.105:0/1814972158 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6648043630 con 0x7f66580afb70 2021-11-12T05:49:03.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:03.372+0000 7f665d1e3700 1 -- 172.21.2.105:0/1814972158 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f6658057350 con 0x7f66580afb70 2021-11-12T05:49:04.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.276+0000 7f664ffff700 1 -- 172.21.2.105:0/1814972158 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v131) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6648010300 con 0x7f66580afb70 2021-11-12T05:49:04.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.276+0000 7f665d1e3700 1 -- 172.21.2.105:0/1814972158 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f663c0536a0 msgr2=0x7f663c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:04.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.276+0000 7f665d1e3700 1 --2- 172.21.2.105:0/1814972158 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f663c0536a0 0x7f663c055b60 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f6640003000 tx=0x7f6640009040).stop 2021-11-12T05:49:04.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.276+0000 7f665d1e3700 1 -- 172.21.2.105:0/1814972158 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66580afb70 msgr2=0x7f6658147f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:04.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.276+0000 7f665d1e3700 1 --2- 172.21.2.105:0/1814972158 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66580afb70 0x7f6658147f20 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 rx=0x7f6648001370 tx=0x7f6648013000).stop 2021-11-12T05:49:04.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.276+0000 7f665d1e3700 1 -- 172.21.2.105:0/1814972158 shutdown_connections 2021-11-12T05:49:04.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.276+0000 7f665d1e3700 1 --2- 172.21.2.105:0/1814972158 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f663c0536a0 0x7f663c055b60 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:04.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.276+0000 7f665d1e3700 1 --2- 172.21.2.105:0/1814972158 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f66580a9ea0 0x7f6658148410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:04.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.276+0000 7f665d1e3700 1 --2- 172.21.2.105:0/1814972158 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f66580afb70 0x7f6658147f20 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:04.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.276+0000 7f665d1e3700 1 --2- 172.21.2.105:0/1814972158 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6638003d00 0x7f66580ae820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:04.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.276+0000 7f665d1e3700 1 -- 172.21.2.105:0/1814972158 >> 172.21.2.105:0/1814972158 conn(0x7f6658063610 msgr2=0x7f66580ac0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:04.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.276+0000 7f665d1e3700 1 -- 172.21.2.105:0/1814972158 shutdown_connections 2021-11-12T05:49:04.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.276+0000 7f665d1e3700 1 -- 172.21.2.105:0/1814972158 wait complete. 2021-11-12T05:49:04.284 INFO:teuthology.orchestra.run.gibba005.stderr: removed all blacklist entries 2021-11-12T05:49:04.288 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-11-12T05:49:04.288 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-11-12T05:49:04.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a5bc62700 1 Processor -- start 2021-11-12T05:49:04.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a5bc62700 1 -- start start 2021-11-12T05:49:04.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a5bc62700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8a540b1cd0 0x7f8a540ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:04.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a5bc62700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f8a540b0e60 0x7f8a540abb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:04.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a5bc62700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a540b20b0 con 0x7f8a540aa700 2021-11-12T05:49:04.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a5bc62700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a540b2870 con 0x7f8a540b0e60 2021-11-12T05:49:04.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a5bc62700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a540b13e0 con 0x7f8a540b1cd0 2021-11-12T05:49:04.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a5a1ff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f8a540aa700 0x7f8a540ac050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:33382/0 (socket says 172.21.2.105:33382) 2021-11-12T05:49:04.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a5a1ff700 1 -- 172.21.2.105:0/256849450 learned_addr learned my addr 172.21.2.105:0/256849450 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:04.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a589fc700 1 -- 172.21.2.105:0/256849450 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1509259982 0 0) 0x7f8a540b20b0 con 0x7f8a540aa700 2021-11-12T05:49:04.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a589fc700 1 -- 172.21.2.105:0/256849450 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a3c003260 con 0x7f8a540aa700 2021-11-12T05:49:04.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a589fc700 1 -- 172.21.2.105:0/256849450 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 735344012 0 0) 0x7f8a3c003260 con 0x7f8a540aa700 2021-11-12T05:49:04.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a589fc700 1 -- 172.21.2.105:0/256849450 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8a540b1cd0 msgr2=0x7f8a540ad2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:04.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a589fc700 1 --2- 172.21.2.105:0/256849450 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8a540b1cd0 0x7f8a540ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:04.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a589fc700 1 -- 172.21.2.105:0/256849450 >> v2:172.21.2.115:3300/0 conn(0x7f8a540b0e60 msgr2=0x7f8a540abb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:04.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a589fc700 1 --2- 172.21.2.105:0/256849450 >> v2:172.21.2.115:3300/0 conn(0x7f8a540b0e60 0x7f8a540abb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:04.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a589fc700 1 -- 172.21.2.105:0/256849450 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a540ace10 con 0x7f8a540aa700 2021-11-12T05:49:04.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a589fc700 1 -- 172.21.2.105:0/256849450 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f8a4c0019e0 con 0x7f8a540aa700 2021-11-12T05:49:04.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a589fc700 1 -- 172.21.2.105:0/256849450 >> v1:172.21.2.105:6789/0 conn(0x7f8a540aa700 legacy=0x7f8a540ac050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:04.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a589fc700 1 --2- 172.21.2.105:0/256849450 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8a3c0037d0 0x7f8a3c003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:04.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a589fc700 1 --2- 172.21.2.105:0/256849450 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8a540b1cd0 0x7f8a3c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:04.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a589fc700 1 --2- 172.21.2.105:0/256849450 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8a3c004bf0 0x7f8a3c00d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:04.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a589fc700 1 -- 172.21.2.105:0/256849450 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a540b13e0 con 0x7f8a3c004bf0 2021-11-12T05:49:04.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a589fc700 1 -- 172.21.2.105:0/256849450 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c005280 con 0x7f8a3c0037d0 2021-11-12T05:49:04.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a589fc700 1 -- 172.21.2.105:0/256849450 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c00de50 con 0x7f8a540b1cd0 2021-11-12T05:49:04.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a5a1ff700 1 --2- 172.21.2.105:0/256849450 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8a3c004bf0 0x7f8a3c00d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:04.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a5a1ff700 1 -- 172.21.2.105:0/256849450 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8a540b1cd0 msgr2=0x7f8a3c004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:04.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a5a1ff700 1 --2- 172.21.2.105:0/256849450 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8a540b1cd0 0x7f8a3c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:04.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a5a1ff700 1 -- 172.21.2.105:0/256849450 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8a3c0037d0 msgr2=0x7f8a3c003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:04.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a5a1ff700 1 --2- 172.21.2.105:0/256849450 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8a3c0037d0 0x7f8a3c003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:04.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a5a1ff700 1 -- 172.21.2.105:0/256849450 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3c003260 con 0x7f8a3c004bf0 2021-11-12T05:49:04.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a5a1ff700 1 --2- 172.21.2.105:0/256849450 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8a3c004bf0 0x7f8a3c00d960 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 rx=0x7f8a4c0016f0 tx=0x7f8a4c002100).ready entity=mon.0 client_cookie=1f02e22af091c2e4 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:04.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a589fc700 1 -- 172.21.2.105:0/256849450 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a4c00cda0 con 0x7f8a3c004bf0 2021-11-12T05:49:04.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a589fc700 1 -- 172.21.2.105:0/256849450 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4c005990 con 0x7f8a3c004bf0 2021-11-12T05:49:04.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a589fc700 1 -- 172.21.2.105:0/256849450 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a4c005cf0 con 0x7f8a3c004bf0 2021-11-12T05:49:04.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a5bc62700 1 -- 172.21.2.105:0/256849450 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8a3c004bf0 msgr2=0x7f8a3c00d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:04.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a5bc62700 1 --2- 172.21.2.105:0/256849450 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8a3c004bf0 0x7f8a3c00d960 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 rx=0x7f8a4c0016f0 tx=0x7f8a4c002100).stop 2021-11-12T05:49:04.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a5a1ff700 1 -- 172.21.2.105:0/256849450 reap_dead start 2021-11-12T05:49:04.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a5bc62700 1 -- 172.21.2.105:0/256849450 shutdown_connections 2021-11-12T05:49:04.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a5bc62700 1 -- 172.21.2.105:0/256849450 >> 172.21.2.105:0/256849450 conn(0x7f8a54063610 msgr2=0x7f8a540639f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:04.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a5bc62700 1 -- 172.21.2.105:0/256849450 shutdown_connections 2021-11-12T05:49:04.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a5bc62700 1 -- 172.21.2.105:0/256849450 wait complete. 2021-11-12T05:49:04.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a5bc62700 1 Processor -- start 2021-11-12T05:49:04.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a5bc62700 1 -- start start 2021-11-12T05:49:04.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a5bc62700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8a3c004bf0 0x7f8a54157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:04.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a5bc62700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8a540b5130 0x7f8a540a7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:04.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a5bc62700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8a540b01e0 0x7f8a540ae840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:04.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a5bc62700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a54156970 con 0x7f8a540b01e0 2021-11-12T05:49:04.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a5bc62700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a54156b60 con 0x7f8a540b5130 2021-11-12T05:49:04.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.380+0000 7f8a5bc62700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a54156e00 con 0x7f8a3c004bf0 2021-11-12T05:49:04.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.384+0000 7f8a5a1ff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8a540b01e0 0x7f8a540ae840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:04.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.384+0000 7f8a5a1ff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8a540b01e0 0x7f8a540ae840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51228/0 (socket says 172.21.2.105:51228) 2021-11-12T05:49:04.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.384+0000 7f8a5a1ff700 1 -- 172.21.2.105:0/3435969313 learned_addr learned my addr 172.21.2.105:0/3435969313 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:04.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.384+0000 7f8a5a1ff700 1 -- 172.21.2.105:0/3435969313 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8a3c004bf0 msgr2=0x7f8a54157540 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:49:04.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.384+0000 7f8a5a1ff700 1 --2- 172.21.2.105:0/3435969313 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8a3c004bf0 0x7f8a54157540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:04.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.384+0000 7f8a5a1ff700 1 -- 172.21.2.105:0/3435969313 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8a540b5130 msgr2=0x7f8a540a7380 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:49:04.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.384+0000 7f8a5a1ff700 1 --2- 172.21.2.105:0/3435969313 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8a540b5130 0x7f8a540a7380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:04.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.384+0000 7f8a5a1ff700 1 -- 172.21.2.105:0/3435969313 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a541570a0 con 0x7f8a540b01e0 2021-11-12T05:49:04.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.384+0000 7f8a5a1ff700 1 --2- 172.21.2.105:0/3435969313 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8a540b01e0 0x7f8a540ae840 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7f8a5405ee70 tx=0x7f8a4c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:04.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.384+0000 7f8a46ffd700 1 -- 172.21.2.105:0/3435969313 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a4c004ca0 con 0x7f8a540b01e0 2021-11-12T05:49:04.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.384+0000 7f8a46ffd700 1 -- 172.21.2.105:0/3435969313 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4c004e00 con 0x7f8a540b01e0 2021-11-12T05:49:04.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.384+0000 7f8a5bc62700 1 -- 172.21.2.105:0/3435969313 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a540b0660 con 0x7f8a540b01e0 2021-11-12T05:49:04.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.384+0000 7f8a46ffd700 1 -- 172.21.2.105:0/3435969313 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a4c0072c0 con 0x7f8a540b01e0 2021-11-12T05:49:04.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.384+0000 7f8a5bc62700 1 -- 172.21.2.105:0/3435969313 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a540aeed0 con 0x7f8a540b01e0 2021-11-12T05:49:04.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.384+0000 7f8a5bc62700 1 -- 172.21.2.105:0/3435969313 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a54157230 con 0x7f8a540b01e0 2021-11-12T05:49:04.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.384+0000 7f8a46ffd700 1 -- 172.21.2.105:0/3435969313 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8a4c007420 con 0x7f8a540b01e0 2021-11-12T05:49:04.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.384+0000 7f8a46ffd700 1 --2- 172.21.2.105:0/3435969313 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8a340536a0 0x7f8a34055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:04.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.384+0000 7f8a46ffd700 1 -- 172.21.2.105:0/3435969313 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f8a4c06c720 con 0x7f8a540b01e0 2021-11-12T05:49:04.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.384+0000 7f8a599fe700 1 --2- 172.21.2.105:0/3435969313 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8a340536a0 0x7f8a34055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:04.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.384+0000 7f8a599fe700 1 --2- 172.21.2.105:0/3435969313 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8a340536a0 0x7f8a34055b60 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f8a50002f70 tx=0x7f8a500069a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:04.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.388+0000 7f8a46ffd700 1 -- 172.21.2.105:0/3435969313 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8a4c043a60 con 0x7f8a540b01e0 2021-11-12T05:49:04.503 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.496+0000 7f8a5bc62700 1 -- 172.21.2.105:0/3435969313 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8a54157230 con 0x7f8a540b01e0 2021-11-12T05:49:04.503 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.500+0000 7f8a46ffd700 1 -- 172.21.2.105:0/3435969313 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v40) v1 ==== 80+0+4242 (secure 0 0 0) 0x7f8a4c007aa0 con 0x7f8a540b01e0 2021-11-12T05:49:04.504 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:04.504 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:49:04.505 INFO:teuthology.orchestra.run.gibba005.stdout: "auth_dump": [ 2021-11-12T05:49:04.505 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:04.505 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mds.a", 2021-11-12T05:49:04.505 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1hGVLeOhAAX2029T+USC1Um93TSzjxdA==", 2021-11-12T05:49:04.506 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:04.506 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:49:04.506 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:49:04.506 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:49:04.507 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:04.507 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:04.507 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:04.507 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:04.508 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mds.b", 2021-11-12T05:49:04.508 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hiebUAxAAGcjDAGyvecjzagGoRBX8tg==", 2021-11-12T05:49:04.508 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:04.508 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:49:04.509 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:49:04.509 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:49:04.509 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:04.509 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:04.509 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:04.510 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:04.510 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.0", 2021-11-12T05:49:04.510 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1ht05fORAAN2YrbsxBau1FQC4C8Dvb3g==", 2021-11-12T05:49:04.510 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:04.511 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:49:04.511 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:49:04.511 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:04.511 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:04.511 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:04.512 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:04.512 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.1", 2021-11-12T05:49:04.512 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAu/o1hzp1vGhAAQ6u3Npb+yNGlNOUdoHzFZA==", 2021-11-12T05:49:04.512 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:04.513 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:49:04.513 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:49:04.513 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:04.513 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:04.513 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:04.514 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:04.514 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.2", 2021-11-12T05:49:04.514 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAw/o1hHWwOOhAAx7txWG8rbch18+SBnJkfkQ==", 2021-11-12T05:49:04.514 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:04.515 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:49:04.515 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:49:04.515 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:04.515 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:04.515 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:04.516 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:04.516 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.3", 2021-11-12T05:49:04.516 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAz/o1howZpHxAAKgUVxU2tSNZbxW+6OfJF9g==", 2021-11-12T05:49:04.516 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:04.517 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:49:04.517 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:49:04.517 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:04.517 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:04.518 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:04.518 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:04.518 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.4", 2021-11-12T05:49:04.518 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA2/o1humA5KRAAVbO6UYLOBQDq3WiEkkS6xw==", 2021-11-12T05:49:04.518 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:04.519 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:49:04.519 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:49:04.519 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:04.519 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:04.520 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:04.520 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:04.520 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.5", 2021-11-12T05:49:04.520 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA5/o1hALdKDRAAR9nsaDOo9GUgpmBPHVp5HQ==", 2021-11-12T05:49:04.520 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:04.521 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:49:04.521 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:49:04.521 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:04.521 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:04.522 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:04.522 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:04.522 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.6", 2021-11-12T05:49:04.522 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA7/o1hCVP2KhAAHj5SxnJ81mKrJOg2CE2wLQ==", 2021-11-12T05:49:04.522 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:04.523 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:49:04.523 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:49:04.523 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:04.523 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:04.523 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:04.524 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:04.524 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.7", 2021-11-12T05:49:04.524 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA+/o1hWCEqEBAAv8nF9NeF2Ue5W8Ijj8Skgg==", 2021-11-12T05:49:04.524 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:04.525 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:49:04.525 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:49:04.525 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:04.525 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:04.525 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:04.526 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:04.526 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.0", 2021-11-12T05:49:04.526 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hzEzhCBAATF8giEBtrj13SAr5EJV4TA==", 2021-11-12T05:49:04.526 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:04.527 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:49:04.527 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow r", 2021-11-12T05:49:04.527 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-12T05:49:04.527 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:04.527 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:04.528 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:04.528 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.1", 2021-11-12T05:49:04.528 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hO6zfCxAAae1obagtpsnA9e8FlTExVA==", 2021-11-12T05:49:04.528 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:04.529 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:49:04.529 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow r", 2021-11-12T05:49:04.529 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-12T05:49:04.529 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:04.529 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:04.530 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:04.530 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.2", 2021-11-12T05:49:04.530 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hFYDGDhAAyz77VXKtOz86ztJ8FUIvAg==", 2021-11-12T05:49:04.530 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:04.531 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:49:04.531 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow r", 2021-11-12T05:49:04.531 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-12T05:49:04.531 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:04.531 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:04.532 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:04.532 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.admin", 2021-11-12T05:49:04.532 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1hwdoBHRAAUHHEU3dbyso2BnE/JppV8A==", 2021-11-12T05:49:04.532 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:04.532 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow *", 2021-11-12T05:49:04.533 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:49:04.533 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:49:04.533 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:04.533 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:04.534 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:04.534 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:04.534 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mgr.x", 2021-11-12T05:49:04.534 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1h6JBaORAAbgxQtCzGNj7MLfgwGd4cWA==", 2021-11-12T05:49:04.535 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:04.535 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow *", 2021-11-12T05:49:04.535 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow profile mgr", 2021-11-12T05:49:04.535 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:04.535 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:04.536 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:04.536 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:04.536 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mgr.y", 2021-11-12T05:49:04.536 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1hwfvvNRAASU7NmYBG/Yb6/ma1/Ew7mw==", 2021-11-12T05:49:04.536 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:04.537 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow *", 2021-11-12T05:49:04.537 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow profile mgr", 2021-11-12T05:49:04.537 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:04.537 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:04.538 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:04.538 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:04.538 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:49:04.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.500+0000 7f8a5bc62700 1 -- 172.21.2.105:0/3435969313 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8a340536a0 msgr2=0x7f8a34055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:04.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.500+0000 7f8a5bc62700 1 --2- 172.21.2.105:0/3435969313 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8a340536a0 0x7f8a34055b60 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f8a50002f70 tx=0x7f8a500069a0).stop 2021-11-12T05:49:04.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.500+0000 7f8a5bc62700 1 -- 172.21.2.105:0/3435969313 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8a540b01e0 msgr2=0x7f8a540ae840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:04.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.500+0000 7f8a5bc62700 1 --2- 172.21.2.105:0/3435969313 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8a540b01e0 0x7f8a540ae840 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7f8a5405ee70 tx=0x7f8a4c017000).stop 2021-11-12T05:49:04.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.500+0000 7f8a5bc62700 1 -- 172.21.2.105:0/3435969313 shutdown_connections 2021-11-12T05:49:04.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.500+0000 7f8a5bc62700 1 --2- 172.21.2.105:0/3435969313 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8a340536a0 0x7f8a34055b60 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:04.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.500+0000 7f8a5bc62700 1 --2- 172.21.2.105:0/3435969313 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8a540b01e0 0x7f8a540ae840 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:04.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.500+0000 7f8a5bc62700 1 --2- 172.21.2.105:0/3435969313 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8a540b5130 0x7f8a540a7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:04.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.500+0000 7f8a5bc62700 1 --2- 172.21.2.105:0/3435969313 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8a3c004bf0 0x7f8a54157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:04.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.500+0000 7f8a5bc62700 1 -- 172.21.2.105:0/3435969313 >> 172.21.2.105:0/3435969313 conn(0x7f8a54063610 msgr2=0x7f8a541418b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:04.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.500+0000 7f8a5bc62700 1 -- 172.21.2.105:0/3435969313 shutdown_connections 2021-11-12T05:49:04.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.500+0000 7f8a5bc62700 1 -- 172.21.2.105:0/3435969313 wait complete. 2021-11-12T05:49:04.543 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:49:04.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.588+0000 7f996e955700 1 Processor -- start 2021-11-12T05:49:04.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.588+0000 7f996e955700 1 -- start start 2021-11-12T05:49:04.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f996e955700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f99680b3170 0x7f99680b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:04.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f996e955700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99680aa8f0 con 0x7f99680b04d0 2021-11-12T05:49:04.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f996e955700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99680b3550 con 0x7f99680aa460 2021-11-12T05:49:04.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f996e955700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99680ad150 con 0x7f99680b3170 2021-11-12T05:49:04.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f99677fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f99680b04d0 0x7f99680b11c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:33398/0 (socket says 172.21.2.105:33398) 2021-11-12T05:49:04.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f99677fe700 1 -- 172.21.2.105:0/216932081 learned_addr learned my addr 172.21.2.105:0/216932081 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:04.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f9966ffd700 1 -- 172.21.2.105:0/216932081 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 900183211 0 0) 0x7f99680aa8f0 con 0x7f99680b04d0 2021-11-12T05:49:04.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f9966ffd700 1 -- 172.21.2.105:0/216932081 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9948003260 con 0x7f99680b04d0 2021-11-12T05:49:04.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f9966ffd700 1 -- 172.21.2.105:0/216932081 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2952976330 0 0) 0x7f9948003260 con 0x7f99680b04d0 2021-11-12T05:49:04.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f9966ffd700 1 -- 172.21.2.105:0/216932081 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f99680b3170 msgr2=0x7f99680b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:04.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f9966ffd700 1 --2- 172.21.2.105:0/216932081 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f99680b3170 0x7f99680b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:04.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f9966ffd700 1 -- 172.21.2.105:0/216932081 >> v1:172.21.2.115:6789/0 conn(0x7f99680aa460 legacy=0x7f99681448e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:04.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f9966ffd700 1 -- 172.21.2.105:0/216932081 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99680acc10 con 0x7f99680b04d0 2021-11-12T05:49:04.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f9966ffd700 1 -- 172.21.2.105:0/216932081 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f9950001660 con 0x7f99680b04d0 2021-11-12T05:49:04.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f9966ffd700 1 -- 172.21.2.105:0/216932081 >> v1:172.21.2.105:6789/0 conn(0x7f99680b04d0 legacy=0x7f99680b11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:04.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f9966ffd700 1 --2- 172.21.2.105:0/216932081 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f99680b3170 0x7f9948003800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:04.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f9966ffd700 1 --2- 172.21.2.105:0/216932081 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9948003ef0 0x7f9948004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:04.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f9966ffd700 1 --2- 172.21.2.105:0/216932081 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9948004bf0 0x7f994800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:04.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f9966ffd700 1 -- 172.21.2.105:0/216932081 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99480052c0 con 0x7f9948004bf0 2021-11-12T05:49:04.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f9966ffd700 1 -- 172.21.2.105:0/216932081 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994800bc40 con 0x7f9948003ef0 2021-11-12T05:49:04.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f9966ffd700 1 -- 172.21.2.105:0/216932081 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f994800bd80 con 0x7f99680b3170 2021-11-12T05:49:04.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f996cef2700 1 --2- 172.21.2.105:0/216932081 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9948004bf0 0x7f994800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:04.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f99677fe700 1 --2- 172.21.2.105:0/216932081 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9948003ef0 0x7f9948004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:04.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f9967fff700 1 --2- 172.21.2.105:0/216932081 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f99680b3170 0x7f9948003800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:04.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f996cef2700 1 -- 172.21.2.105:0/216932081 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f99680b3170 msgr2=0x7f9948003800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:04.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f996cef2700 1 --2- 172.21.2.105:0/216932081 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f99680b3170 0x7f9948003800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:04.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f996cef2700 1 -- 172.21.2.105:0/216932081 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9948003ef0 msgr2=0x7f9948004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:04.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f996cef2700 1 --2- 172.21.2.105:0/216932081 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9948003ef0 0x7f9948004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:04.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f996cef2700 1 -- 172.21.2.105:0/216932081 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9948003260 con 0x7f9948004bf0 2021-11-12T05:49:04.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f9967fff700 1 --2- 172.21.2.105:0/216932081 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f99680b3170 0x7f9948003800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:49:04.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f996cef2700 1 --2- 172.21.2.105:0/216932081 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9948004bf0 0x7f994800b750 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 rx=0x7f99600012f0 tx=0x7f9960007d60).ready entity=mon.0 client_cookie=10f7d05d374224f0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:04.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f9966ffd700 1 -- 172.21.2.105:0/216932081 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99600014c0 con 0x7f9948004bf0 2021-11-12T05:49:04.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f9966ffd700 1 -- 172.21.2.105:0/216932081 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9960006870 con 0x7f9948004bf0 2021-11-12T05:49:04.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f9966ffd700 1 -- 172.21.2.105:0/216932081 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9960006bd0 con 0x7f9948004bf0 2021-11-12T05:49:04.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f996e955700 1 -- 172.21.2.105:0/216932081 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9948004bf0 msgr2=0x7f994800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:04.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f996e955700 1 --2- 172.21.2.105:0/216932081 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9948004bf0 0x7f994800b750 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 rx=0x7f99600012f0 tx=0x7f9960007d60).stop 2021-11-12T05:49:04.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f996cef2700 1 -- 172.21.2.105:0/216932081 reap_dead start 2021-11-12T05:49:04.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f996e955700 1 -- 172.21.2.105:0/216932081 shutdown_connections 2021-11-12T05:49:04.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f996e955700 1 -- 172.21.2.105:0/216932081 >> 172.21.2.105:0/216932081 conn(0x7f996805c490 msgr2=0x7f996805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:04.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f996e955700 1 -- 172.21.2.105:0/216932081 shutdown_connections 2021-11-12T05:49:04.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.592+0000 7f996e955700 1 -- 172.21.2.105:0/216932081 wait complete. 2021-11-12T05:49:04.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.596+0000 7f996e955700 1 Processor -- start 2021-11-12T05:49:04.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.596+0000 7f996e955700 1 -- start start 2021-11-12T05:49:04.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.596+0000 7f996e955700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9948004bf0 0x7f9968155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:04.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.596+0000 7f996e955700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9968143a80 0x7f9968064d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:04.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.596+0000 7f996e955700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9968065210 0x7f99680a8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:04.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.596+0000 7f996e955700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99680adb70 con 0x7f9968143a80 2021-11-12T05:49:04.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.596+0000 7f996e955700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99680aeb20 con 0x7f9948004bf0 2021-11-12T05:49:04.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.596+0000 7f996e955700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99680ae5a0 con 0x7f9968065210 2021-11-12T05:49:04.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.596+0000 7f99677fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9968143a80 0x7f9968064d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:04.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.596+0000 7f99677fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9968143a80 0x7f9968064d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51246/0 (socket says 172.21.2.105:51246) 2021-11-12T05:49:04.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.596+0000 7f99677fe700 1 -- 172.21.2.105:0/3107910067 learned_addr learned my addr 172.21.2.105:0/3107910067 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:04.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.596+0000 7f99677fe700 1 -- 172.21.2.105:0/3107910067 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9968065210 msgr2=0x7f99680a8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:04.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.596+0000 7f99677fe700 1 --2- 172.21.2.105:0/3107910067 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9968065210 0x7f99680a8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:04.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.596+0000 7f99677fe700 1 -- 172.21.2.105:0/3107910067 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9948004bf0 msgr2=0x7f9968155b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:04.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.596+0000 7f99677fe700 1 --2- 172.21.2.105:0/3107910067 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9948004bf0 0x7f9968155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:04.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.596+0000 7f99677fe700 1 -- 172.21.2.105:0/3107910067 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99680af650 con 0x7f9968143a80 2021-11-12T05:49:04.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.596+0000 7f99677fe700 1 --2- 172.21.2.105:0/3107910067 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9968143a80 0x7f9968064d20 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7f99500019a0 tx=0x7f996806a0c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:04.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.596+0000 7f99657fa700 1 -- 172.21.2.105:0/3107910067 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9950015630 con 0x7f9968143a80 2021-11-12T05:49:04.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.596+0000 7f99657fa700 1 -- 172.21.2.105:0/3107910067 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9950010040 con 0x7f9968143a80 2021-11-12T05:49:04.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.596+0000 7f99657fa700 1 -- 172.21.2.105:0/3107910067 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9950015980 con 0x7f9968143a80 2021-11-12T05:49:04.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.596+0000 7f996e955700 1 -- 172.21.2.105:0/3107910067 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99680656c0 con 0x7f9968143a80 2021-11-12T05:49:04.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.596+0000 7f996e955700 1 -- 172.21.2.105:0/3107910067 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99680a37d0 con 0x7f9968143a80 2021-11-12T05:49:04.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.596+0000 7f996e955700 1 -- 172.21.2.105:0/3107910067 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99680aceb0 con 0x7f9968143a80 2021-11-12T05:49:04.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.596+0000 7f99657fa700 1 -- 172.21.2.105:0/3107910067 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9950015ae0 con 0x7f9968143a80 2021-11-12T05:49:04.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.596+0000 7f99657fa700 1 --2- 172.21.2.105:0/3107910067 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f994c0535d0 0x7f994c055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:04.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.596+0000 7f99657fa700 1 -- 172.21.2.105:0/3107910067 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f995006b420 con 0x7f9968143a80 2021-11-12T05:49:04.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.596+0000 7f9967fff700 1 --2- 172.21.2.105:0/3107910067 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f994c0535d0 0x7f994c055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:04.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.596+0000 7f9967fff700 1 --2- 172.21.2.105:0/3107910067 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f994c0535d0 0x7f994c055a90 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f9958007000 tx=0x7f9958008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:04.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.600+0000 7f99657fa700 1 -- 172.21.2.105:0/3107910067 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9950042650 con 0x7f9968143a80 2021-11-12T05:49:04.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.684+0000 7f996e955700 1 -- 172.21.2.105:0/3107910067 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9968057350 con 0x7f9968143a80 2021-11-12T05:49:04.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.684+0000 7f99657fa700 1 -- 172.21.2.105:0/3107910067 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) v1 ==== 74+0+13424 (secure 0 0 0) 0x7f9950045c70 con 0x7f9968143a80 2021-11-12T05:49:04.690 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:04.690 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":131,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:49:04.265547+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:49:04.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.684+0000 7f996e955700 1 -- 172.21.2.105:0/3107910067 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f994c0535d0 msgr2=0x7f994c055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:04.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.684+0000 7f996e955700 1 --2- 172.21.2.105:0/3107910067 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f994c0535d0 0x7f994c055a90 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f9958007000 tx=0x7f9958008040).stop 2021-11-12T05:49:04.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.684+0000 7f996e955700 1 -- 172.21.2.105:0/3107910067 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9968143a80 msgr2=0x7f9968064d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:04.692 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.684+0000 7f996e955700 1 --2- 172.21.2.105:0/3107910067 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9968143a80 0x7f9968064d20 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7f99500019a0 tx=0x7f996806a0c0).stop 2021-11-12T05:49:04.692 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.684+0000 7f996e955700 1 -- 172.21.2.105:0/3107910067 shutdown_connections 2021-11-12T05:49:04.692 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.684+0000 7f996e955700 1 --2- 172.21.2.105:0/3107910067 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f994c0535d0 0x7f994c055a90 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:04.692 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.684+0000 7f996e955700 1 --2- 172.21.2.105:0/3107910067 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9968065210 0x7f99680a8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:04.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.684+0000 7f996e955700 1 --2- 172.21.2.105:0/3107910067 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9968143a80 0x7f9968064d20 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:04.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.684+0000 7f996e955700 1 --2- 172.21.2.105:0/3107910067 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9948004bf0 0x7f9968155b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:04.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.684+0000 7f996e955700 1 -- 172.21.2.105:0/3107910067 >> 172.21.2.105:0/3107910067 conn(0x7f996805c490 msgr2=0x7f99680b47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:04.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.684+0000 7f996e955700 1 -- 172.21.2.105:0/3107910067 shutdown_connections 2021-11-12T05:49:04.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.684+0000 7f996e955700 1 -- 172.21.2.105:0/3107910067 wait complete. 2021-11-12T05:49:04.697 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-12T05:49:04.698 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:49:04.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.744+0000 7f3a09837700 1 Processor -- start 2021-11-12T05:49:04.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.744+0000 7f3a09837700 1 -- start start 2021-11-12T05:49:04.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a09837700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f3a04060530 0x7f3a04143620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:04.752 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a09837700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3a040b1720 0x7f3a04066620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:04.752 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a09837700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f3a04066b10 0x7f3a0405fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:04.752 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a09837700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a040af6c0 con 0x7f3a04060530 2021-11-12T05:49:04.752 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a09837700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a040af180 con 0x7f3a04066b10 2021-11-12T05:49:04.753 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a09837700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a040af420 con 0x7f3a040b1720 2021-11-12T05:49:04.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a02ffd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f3a04060530 0x7f3a04143620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:04.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a02ffd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f3a04060530 0x7f3a04143620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51252/0 (socket says 172.21.2.105:51252) 2021-11-12T05:49:04.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a02ffd700 1 -- 172.21.2.105:0/821061595 learned_addr learned my addr 172.21.2.105:0/821061595 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:04.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a02ffd700 1 -- 172.21.2.105:0/821061595 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3a040b1720 msgr2=0x7f3a04066620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:04.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a02ffd700 1 --2- 172.21.2.105:0/821061595 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3a040b1720 0x7f3a04066620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:04.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a02ffd700 1 -- 172.21.2.105:0/821061595 >> v2:172.21.2.115:3300/0 conn(0x7f3a04066b10 msgr2=0x7f3a0405fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:04.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a02ffd700 1 --2- 172.21.2.105:0/821061595 >> v2:172.21.2.115:3300/0 conn(0x7f3a04066b10 0x7f3a0405fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:04.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a02ffd700 1 -- 172.21.2.105:0/821061595 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0413f630 con 0x7f3a04060530 2021-11-12T05:49:04.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a02ffd700 1 --2- 172.21.2.105:0/821061595 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a04060530 0x7f3a04143620 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7f39f4002f70 tx=0x7f39f4006eb0).ready entity=mon.0 client_cookie=6f67b0d443779572 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:04.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a01ffb700 1 -- 172.21.2.105:0/821061595 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39f400d570 con 0x7f3a04060530 2021-11-12T05:49:04.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a01ffb700 1 -- 172.21.2.105:0/821061595 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f4000e90 con 0x7f3a04060530 2021-11-12T05:49:04.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a01ffb700 1 -- 172.21.2.105:0/821061595 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39f400d900 con 0x7f3a04060530 2021-11-12T05:49:04.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a09837700 1 -- 172.21.2.105:0/821061595 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a04060530 msgr2=0x7f3a04143620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:04.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a09837700 1 --2- 172.21.2.105:0/821061595 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a04060530 0x7f3a04143620 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7f39f4002f70 tx=0x7f39f4006eb0).stop 2021-11-12T05:49:04.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a09837700 1 -- 172.21.2.105:0/821061595 shutdown_connections 2021-11-12T05:49:04.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a09837700 1 --2- 172.21.2.105:0/821061595 >> v2:172.21.2.115:3300/0 conn(0x7f3a04066b10 0x7f3a0405fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:04.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a09837700 1 --2- 172.21.2.105:0/821061595 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3a040b1720 0x7f3a04066620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:04.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a09837700 1 --2- 172.21.2.105:0/821061595 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a04060530 0x7f3a04143620 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:04.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a09837700 1 -- 172.21.2.105:0/821061595 >> 172.21.2.105:0/821061595 conn(0x7f3a0405c490 msgr2=0x7f3a040b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:04.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a09837700 1 -- 172.21.2.105:0/821061595 shutdown_connections 2021-11-12T05:49:04.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a09837700 1 -- 172.21.2.105:0/821061595 wait complete. 2021-11-12T05:49:04.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a09837700 1 Processor -- start 2021-11-12T05:49:04.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a09837700 1 -- start start 2021-11-12T05:49:04.763 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a09837700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3a04060530 0x7f3a04145fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:04.763 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a09837700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3a04066b10 0x7f3a041464a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:04.763 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a09837700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a040b1720 0x7f3a04155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:04.763 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a09837700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a04145ad0 con 0x7f3a040b1720 2021-11-12T05:49:04.764 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a09837700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a04148aa0 con 0x7f3a04060530 2021-11-12T05:49:04.764 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a09837700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a04148800 con 0x7f3a04066b10 2021-11-12T05:49:04.764 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a037fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a040b1720 0x7f3a04155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:04.764 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a037fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a040b1720 0x7f3a04155b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51262/0 (socket says 172.21.2.105:51262) 2021-11-12T05:49:04.765 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a037fe700 1 -- 172.21.2.105:0/2535345183 learned_addr learned my addr 172.21.2.105:0/2535345183 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:04.765 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a037fe700 1 -- 172.21.2.105:0/2535345183 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3a04066b10 msgr2=0x7f3a041464a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:04.765 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a037fe700 1 --2- 172.21.2.105:0/2535345183 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3a04066b10 0x7f3a041464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:04.765 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a037fe700 1 -- 172.21.2.105:0/2535345183 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3a04060530 msgr2=0x7f3a04145fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:04.765 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a037fe700 1 --2- 172.21.2.105:0/2535345183 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3a04060530 0x7f3a04145fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:04.766 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a037fe700 1 -- 172.21.2.105:0/2535345183 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f400b1e0 con 0x7f3a040b1720 2021-11-12T05:49:04.766 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a037fe700 1 --2- 172.21.2.105:0/2535345183 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a040b1720 0x7f3a04155b70 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 rx=0x7f39fc0032f0 tx=0x7f39fc009220).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:04.766 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f39fbfff700 1 -- 172.21.2.105:0/2535345183 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39fc00d580 con 0x7f3a040b1720 2021-11-12T05:49:04.766 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a09837700 1 -- 172.21.2.105:0/2535345183 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a041442d0 con 0x7f3a040b1720 2021-11-12T05:49:04.767 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f39fbfff700 1 -- 172.21.2.105:0/2535345183 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39fc00d6e0 con 0x7f3a040b1720 2021-11-12T05:49:04.767 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f39fbfff700 1 -- 172.21.2.105:0/2535345183 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39fc00da40 con 0x7f3a040b1720 2021-11-12T05:49:04.767 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.748+0000 7f3a09837700 1 -- 172.21.2.105:0/2535345183 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a041453f0 con 0x7f3a040b1720 2021-11-12T05:49:04.767 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.752+0000 7f3a09837700 1 -- 172.21.2.105:0/2535345183 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a04057350 con 0x7f3a040b1720 2021-11-12T05:49:04.768 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.752+0000 7f39fbfff700 1 -- 172.21.2.105:0/2535345183 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f39fc00dba0 con 0x7f3a040b1720 2021-11-12T05:49:04.768 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.752+0000 7f39fbfff700 1 --2- 172.21.2.105:0/2535345183 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f39e80536a0 0x7f39e8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:04.768 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.752+0000 7f39fbfff700 1 -- 172.21.2.105:0/2535345183 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f39fc06bb30 con 0x7f3a040b1720 2021-11-12T05:49:04.768 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.752+0000 7f3a02ffd700 1 --2- 172.21.2.105:0/2535345183 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f39e80536a0 0x7f39e8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:04.768 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.752+0000 7f3a02ffd700 1 --2- 172.21.2.105:0/2535345183 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f39e80536a0 0x7f39e8055b60 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f39f4002f70 tx=0x7f39f4015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:04.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.752+0000 7f39fbfff700 1 -- 172.21.2.105:0/2535345183 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f39fc042df0 con 0x7f3a040b1720 2021-11-12T05:49:04.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.836+0000 7f3a09837700 1 -- 172.21.2.105:0/2535345183 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3a041485f0 con 0x7f3a040b1720 2021-11-12T05:49:04.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.836+0000 7f39fbfff700 1 -- 172.21.2.105:0/2535345183 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v131) v1 ==== 110+0+10 (secure 0 0 0) 0x7f39fc046410 con 0x7f3a040b1720 2021-11-12T05:49:04.843 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:49:04.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.840+0000 7f3a09837700 1 -- 172.21.2.105:0/2535345183 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f39e80536a0 msgr2=0x7f39e8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:04.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.840+0000 7f3a09837700 1 --2- 172.21.2.105:0/2535345183 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f39e80536a0 0x7f39e8055b60 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f39f4002f70 tx=0x7f39f4015000).stop 2021-11-12T05:49:04.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.840+0000 7f3a09837700 1 -- 172.21.2.105:0/2535345183 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a040b1720 msgr2=0x7f3a04155b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:04.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.840+0000 7f3a09837700 1 --2- 172.21.2.105:0/2535345183 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a040b1720 0x7f3a04155b70 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 rx=0x7f39fc0032f0 tx=0x7f39fc009220).stop 2021-11-12T05:49:04.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.840+0000 7f3a09837700 1 -- 172.21.2.105:0/2535345183 shutdown_connections 2021-11-12T05:49:04.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.840+0000 7f3a09837700 1 --2- 172.21.2.105:0/2535345183 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f39e80536a0 0x7f39e8055b60 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:04.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.840+0000 7f3a09837700 1 --2- 172.21.2.105:0/2535345183 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a040b1720 0x7f3a04155b70 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:04.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.840+0000 7f3a09837700 1 --2- 172.21.2.105:0/2535345183 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3a04066b10 0x7f3a041464a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:04.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.840+0000 7f3a09837700 1 --2- 172.21.2.105:0/2535345183 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3a04060530 0x7f3a04145fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:04.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.840+0000 7f3a09837700 1 -- 172.21.2.105:0/2535345183 >> 172.21.2.105:0/2535345183 conn(0x7f3a0405c490 msgr2=0x7f3a040afc60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:04.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.840+0000 7f3a09837700 1 -- 172.21.2.105:0/2535345183 shutdown_connections 2021-11-12T05:49:04.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.840+0000 7f3a09837700 1 -- 172.21.2.105:0/2535345183 wait complete. 2021-11-12T05:49:04.850 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:49:04.903 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.900+0000 7fc898aba700 1 Processor -- start 2021-11-12T05:49:04.904 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.900+0000 7fc898aba700 1 -- start start 2021-11-12T05:49:04.906 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.900+0000 7fc898aba700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc8940aca40 0x7fc8940ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:04.906 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.900+0000 7fc898aba700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fc8940b0520 0x7fc8941473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:04.906 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.900+0000 7fc898aba700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fc8941478b0 0x7fc894144180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:04.906 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.900+0000 7fc898aba700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc894147d40 con 0x7fc8941478b0 2021-11-12T05:49:04.907 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.900+0000 7fc898aba700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8940b1840 con 0x7fc8940b0520 2021-11-12T05:49:04.907 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.900+0000 7fc898aba700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8940af2b0 con 0x7fc8940aca40 2021-11-12T05:49:04.907 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.900+0000 7fc892d9d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fc8941478b0 0x7fc894144180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:04.908 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.900+0000 7fc892d9d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fc8941478b0 0x7fc894144180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51270/0 (socket says 172.21.2.105:51270) 2021-11-12T05:49:04.908 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.900+0000 7fc892d9d700 1 -- 172.21.2.105:0/3688425108 learned_addr learned my addr 172.21.2.105:0/3688425108 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:04.908 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.900+0000 7fc892d9d700 1 -- 172.21.2.105:0/3688425108 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc8940aca40 msgr2=0x7fc8940ace20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:49:04.908 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.900+0000 7fc892d9d700 1 --2- 172.21.2.105:0/3688425108 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc8940aca40 0x7fc8940ace20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:04.908 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.900+0000 7fc892d9d700 1 -- 172.21.2.105:0/3688425108 >> v2:172.21.2.115:3300/0 conn(0x7fc8940b0520 msgr2=0x7fc8941473c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:49:04.909 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.900+0000 7fc892d9d700 1 --2- 172.21.2.105:0/3688425108 >> v2:172.21.2.115:3300/0 conn(0x7fc8940b0520 0x7fc8941473c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:04.909 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.900+0000 7fc892d9d700 1 -- 172.21.2.105:0/3688425108 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8940b09a0 con 0x7fc8941478b0 2021-11-12T05:49:04.909 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.900+0000 7fc892d9d700 1 --2- 172.21.2.105:0/3688425108 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc8941478b0 0x7fc894144180 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7fc88c0032f0 tx=0x7fc88c009290).ready entity=mon.0 client_cookie=ee55d8a4d2b0d54e server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:04.909 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.900+0000 7fc89159a700 1 -- 172.21.2.105:0/3688425108 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc88c00b870 con 0x7fc8941478b0 2021-11-12T05:49:04.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.900+0000 7fc89159a700 1 -- 172.21.2.105:0/3688425108 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88c00b9d0 con 0x7fc8941478b0 2021-11-12T05:49:04.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.900+0000 7fc89159a700 1 -- 172.21.2.105:0/3688425108 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc88c00bb80 con 0x7fc8941478b0 2021-11-12T05:49:04.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.900+0000 7fc898aba700 1 -- 172.21.2.105:0/3688425108 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc8941478b0 msgr2=0x7fc894144180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:04.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.900+0000 7fc898aba700 1 --2- 172.21.2.105:0/3688425108 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc8941478b0 0x7fc894144180 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7fc88c0032f0 tx=0x7fc88c009290).stop 2021-11-12T05:49:04.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.900+0000 7fc898aba700 1 -- 172.21.2.105:0/3688425108 shutdown_connections 2021-11-12T05:49:04.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.900+0000 7fc898aba700 1 --2- 172.21.2.105:0/3688425108 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc8941478b0 0x7fc894144180 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:04.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.900+0000 7fc898aba700 1 --2- 172.21.2.105:0/3688425108 >> v2:172.21.2.115:3300/0 conn(0x7fc8940b0520 0x7fc8941473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:04.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.900+0000 7fc898aba700 1 --2- 172.21.2.105:0/3688425108 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc8940aca40 0x7fc8940ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:04.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.900+0000 7fc898aba700 1 -- 172.21.2.105:0/3688425108 >> 172.21.2.105:0/3688425108 conn(0x7fc89405c490 msgr2=0x7fc8940b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:04.912 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.900+0000 7fc898aba700 1 -- 172.21.2.105:0/3688425108 shutdown_connections 2021-11-12T05:49:04.912 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.900+0000 7fc898aba700 1 -- 172.21.2.105:0/3688425108 wait complete. 2021-11-12T05:49:04.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.900+0000 7fc898aba700 1 Processor -- start 2021-11-12T05:49:04.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.900+0000 7fc898aba700 1 -- start start 2021-11-12T05:49:04.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.904+0000 7fc898aba700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc8940aca40 0x7fc894065ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:04.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.904+0000 7fc898aba700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc8940b0520 0x7fc8940a7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:04.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.904+0000 7fc898aba700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc8941478b0 0x7fc8940a7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:04.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.904+0000 7fc898aba700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8941577d0 con 0x7fc8940b0520 2021-11-12T05:49:04.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.904+0000 7fc898aba700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc894157290 con 0x7fc8941478b0 2021-11-12T05:49:04.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.904+0000 7fc898aba700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc894157530 con 0x7fc8940aca40 2021-11-12T05:49:04.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.904+0000 7fc891d9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc8940b0520 0x7fc8940a7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:04.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.904+0000 7fc891d9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc8940b0520 0x7fc8940a7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51274/0 (socket says 172.21.2.105:51274) 2021-11-12T05:49:04.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.904+0000 7fc891d9b700 1 -- 172.21.2.105:0/70663108 learned_addr learned my addr 172.21.2.105:0/70663108 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:04.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.904+0000 7fc891d9b700 1 -- 172.21.2.105:0/70663108 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc8940aca40 msgr2=0x7fc894065ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:04.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.904+0000 7fc891d9b700 1 --2- 172.21.2.105:0/70663108 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc8940aca40 0x7fc894065ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:04.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.904+0000 7fc891d9b700 1 -- 172.21.2.105:0/70663108 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc8941478b0 msgr2=0x7fc8940a7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:04.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.904+0000 7fc891d9b700 1 --2- 172.21.2.105:0/70663108 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc8941478b0 0x7fc8940a7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:04.918 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.904+0000 7fc891d9b700 1 -- 172.21.2.105:0/70663108 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc88c009530 con 0x7fc8940b0520 2021-11-12T05:49:04.918 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.904+0000 7fc891d9b700 1 --2- 172.21.2.105:0/70663108 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc8940b0520 0x7fc8940a7360 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7fc884002fb0 tx=0x7fc884006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:04.918 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.904+0000 7fc88b7fe700 1 -- 172.21.2.105:0/70663108 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc884009e00 con 0x7fc8940b0520 2021-11-12T05:49:04.918 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.904+0000 7fc88b7fe700 1 -- 172.21.2.105:0/70663108 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc884013460 con 0x7fc8940b0520 2021-11-12T05:49:04.919 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.904+0000 7fc898aba700 1 -- 172.21.2.105:0/70663108 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8940b48a0 con 0x7fc8940b0520 2021-11-12T05:49:04.919 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.904+0000 7fc88b7fe700 1 -- 172.21.2.105:0/70663108 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8840137c0 con 0x7fc8940b0520 2021-11-12T05:49:04.919 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.904+0000 7fc898aba700 1 -- 172.21.2.105:0/70663108 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc894066d70 con 0x7fc8940b0520 2021-11-12T05:49:04.919 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.904+0000 7fc898aba700 1 -- 172.21.2.105:0/70663108 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc894057350 con 0x7fc8940b0520 2021-11-12T05:49:04.919 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.904+0000 7fc88b7fe700 1 -- 172.21.2.105:0/70663108 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc88400f070 con 0x7fc8940b0520 2021-11-12T05:49:04.920 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.904+0000 7fc88b7fe700 1 --2- 172.21.2.105:0/70663108 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc8780536f0 0x7fc878055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:04.920 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.904+0000 7fc88b7fe700 1 -- 172.21.2.105:0/70663108 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fc88406b130 con 0x7fc8940b0520 2021-11-12T05:49:04.920 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.904+0000 7fc89259c700 1 --2- 172.21.2.105:0/70663108 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc8780536f0 0x7fc878055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:04.920 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.904+0000 7fc89259c700 1 --2- 172.21.2.105:0/70663108 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc8780536f0 0x7fc878055bb0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7fc87c002fb0 tx=0x7fc87c0069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:04.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.908+0000 7fc88b7fe700 1 -- 172.21.2.105:0/70663108 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc884042470 con 0x7fc8940b0520 2021-11-12T05:49:04.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.988+0000 7fc898aba700 1 -- 172.21.2.105:0/70663108 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc89406a280 con 0x7fc8940b0520 2021-11-12T05:49:04.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.988+0000 7fc88b7fe700 1 -- 172.21.2.105:0/70663108 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v131) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc884045a90 con 0x7fc8940b0520 2021-11-12T05:49:04.995 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:49:04.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.992+0000 7fc898aba700 1 -- 172.21.2.105:0/70663108 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc8780536f0 msgr2=0x7fc878055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:04.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.992+0000 7fc898aba700 1 --2- 172.21.2.105:0/70663108 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc8780536f0 0x7fc878055bb0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7fc87c002fb0 tx=0x7fc87c0069b0).stop 2021-11-12T05:49:04.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.992+0000 7fc898aba700 1 -- 172.21.2.105:0/70663108 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc8940b0520 msgr2=0x7fc8940a7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:04.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.992+0000 7fc898aba700 1 --2- 172.21.2.105:0/70663108 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc8940b0520 0x7fc8940a7360 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7fc884002fb0 tx=0x7fc884006df0).stop 2021-11-12T05:49:04.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.992+0000 7fc898aba700 1 -- 172.21.2.105:0/70663108 shutdown_connections 2021-11-12T05:49:04.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.992+0000 7fc898aba700 1 --2- 172.21.2.105:0/70663108 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc8780536f0 0x7fc878055bb0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:04.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.992+0000 7fc898aba700 1 --2- 172.21.2.105:0/70663108 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc8941478b0 0x7fc8940a7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:04.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.992+0000 7fc898aba700 1 --2- 172.21.2.105:0/70663108 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc8940b0520 0x7fc8940a7360 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:04.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.992+0000 7fc898aba700 1 --2- 172.21.2.105:0/70663108 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc8940aca40 0x7fc894065ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:04.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.992+0000 7fc898aba700 1 -- 172.21.2.105:0/70663108 >> 172.21.2.105:0/70663108 conn(0x7fc89405c490 msgr2=0x7fc8940b1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:04.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.992+0000 7fc898aba700 1 -- 172.21.2.105:0/70663108 shutdown_connections 2021-11-12T05:49:04.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:04.992+0000 7fc898aba700 1 -- 172.21.2.105:0/70663108 wait complete. 2021-11-12T05:49:05.002 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-12T05:49:05.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.048+0000 7f8868002700 1 Processor -- start 2021-11-12T05:49:05.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.048+0000 7f8868002700 1 -- start start 2021-11-12T05:49:05.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.048+0000 7f8868002700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f886005fdc0 0x7f88600601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:05.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.048+0000 7f8868002700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f886013a9c0 0x7f886013ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:05.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.048+0000 7f8868002700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8860066150 con 0x7f88600ade80 2021-11-12T05:49:05.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.048+0000 7f8868002700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8860141fb0 con 0x7f886013a9c0 2021-11-12T05:49:05.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.048+0000 7f8868002700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88600663f0 con 0x7f886005fdc0 2021-11-12T05:49:05.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.052+0000 7f8865d9e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f886005fdc0 0x7f88600601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:05.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.052+0000 7f886659f700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f886013a9c0 0x7f886013ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:05.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.052+0000 7f8865d9e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f886005fdc0 0x7f88600601a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3301/0 says I am v2:172.21.2.105:42472/0 (socket says 172.21.2.105:42472) 2021-11-12T05:49:05.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.052+0000 7f886659f700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f886013a9c0 0x7f886013ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3300/0 says I am v2:172.21.2.105:40222/0 (socket says 172.21.2.105:40222) 2021-11-12T05:49:05.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.052+0000 7f886559d700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7f88600ade80 0x7f8860066730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:60148/0 (socket says 172.21.2.105:60148) 2021-11-12T05:49:05.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.052+0000 7f8865d9e700 1 -- 172.21.2.105:0/2906992486 learned_addr learned my addr 172.21.2.105:0/2906992486 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:05.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.052+0000 7f8865d9e700 1 -- 172.21.2.105:0/2906992486 >> v2:172.21.2.115:3300/0 conn(0x7f886013a9c0 msgr2=0x7f886013ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:05.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.052+0000 7f8865d9e700 1 --2- 172.21.2.105:0/2906992486 >> v2:172.21.2.115:3300/0 conn(0x7f886013a9c0 0x7f886013ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:05.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.052+0000 7f8865d9e700 1 -- 172.21.2.105:0/2906992486 >> v1:172.21.2.115:6789/0 conn(0x7f88600ade80 legacy=0x7f8860066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:05.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.052+0000 7f8865d9e700 1 -- 172.21.2.105:0/2906992486 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8860140fd0 con 0x7f886005fdc0 2021-11-12T05:49:05.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.052+0000 7f8865d9e700 1 --2- 172.21.2.105:0/2906992486 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f886005fdc0 0x7f88600601a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f8854002f70 tx=0x7f8854006eb0).ready entity=mon.2 client_cookie=498a72f81adb75b8 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:05.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.052+0000 7f8864d9c700 1 -- 172.21.2.105:0/2906992486 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f885400d570 con 0x7f886005fdc0 2021-11-12T05:49:05.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.052+0000 7f8864d9c700 1 -- 172.21.2.105:0/2906992486 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8854000e90 con 0x7f886005fdc0 2021-11-12T05:49:05.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.052+0000 7f8864d9c700 1 -- 172.21.2.105:0/2906992486 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f885400d900 con 0x7f886005fdc0 2021-11-12T05:49:05.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.052+0000 7f8868002700 1 -- 172.21.2.105:0/2906992486 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f886005fdc0 msgr2=0x7f88600601a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:05.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.052+0000 7f8868002700 1 --2- 172.21.2.105:0/2906992486 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f886005fdc0 0x7f88600601a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f8854002f70 tx=0x7f8854006eb0).stop 2021-11-12T05:49:05.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.052+0000 7f8868002700 1 -- 172.21.2.105:0/2906992486 shutdown_connections 2021-11-12T05:49:05.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.052+0000 7f8868002700 1 --2- 172.21.2.105:0/2906992486 >> v2:172.21.2.115:3300/0 conn(0x7f886013a9c0 0x7f886013ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:05.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.052+0000 7f8868002700 1 --2- 172.21.2.105:0/2906992486 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f886005fdc0 0x7f88600601a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:05.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.052+0000 7f8868002700 1 -- 172.21.2.105:0/2906992486 >> 172.21.2.105:0/2906992486 conn(0x7f88600608d0 msgr2=0x7f886005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:05.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.052+0000 7f8868002700 1 -- 172.21.2.105:0/2906992486 shutdown_connections 2021-11-12T05:49:05.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.052+0000 7f8868002700 1 -- 172.21.2.105:0/2906992486 wait complete. 2021-11-12T05:49:05.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.056+0000 7f8868002700 1 Processor -- start 2021-11-12T05:49:05.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.056+0000 7f8868002700 1 -- start start 2021-11-12T05:49:05.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.056+0000 7f8868002700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f886005fdc0 0x7f88600b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:05.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.056+0000 7f8868002700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f88600ade80 0x7f88601434d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:05.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.056+0000 7f8868002700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f886013a9c0 0x7f88601439c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:05.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.056+0000 7f8868002700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88600b6610 con 0x7f886013a9c0 2021-11-12T05:49:05.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.056+0000 7f8868002700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8860062580 con 0x7f886005fdc0 2021-11-12T05:49:05.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.056+0000 7f8868002700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88600b6370 con 0x7f88600ade80 2021-11-12T05:49:05.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.056+0000 7f886659f700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f886013a9c0 0x7f88601439c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:05.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.056+0000 7f886659f700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f886013a9c0 0x7f88601439c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51290/0 (socket says 172.21.2.105:51290) 2021-11-12T05:49:05.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.056+0000 7f886659f700 1 -- 172.21.2.105:0/2056705319 learned_addr learned my addr 172.21.2.105:0/2056705319 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:05.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.056+0000 7f886659f700 1 -- 172.21.2.105:0/2056705319 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f88600ade80 msgr2=0x7f88601434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:05.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.056+0000 7f886659f700 1 --2- 172.21.2.105:0/2056705319 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f88600ade80 0x7f88601434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:05.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.056+0000 7f886659f700 1 -- 172.21.2.105:0/2056705319 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f886005fdc0 msgr2=0x7f88600b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:05.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.056+0000 7f886659f700 1 --2- 172.21.2.105:0/2056705319 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f886005fdc0 0x7f88600b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:05.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.056+0000 7f886659f700 1 -- 172.21.2.105:0/2056705319 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885400b1e0 con 0x7f886013a9c0 2021-11-12T05:49:05.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.056+0000 7f886659f700 1 --2- 172.21.2.105:0/2056705319 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f886013a9c0 0x7f88601439c0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 rx=0x7f8858006e00 tx=0x7f88580091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:05.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.056+0000 7f8852ffd700 1 -- 172.21.2.105:0/2056705319 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f885800c7f0 con 0x7f886013a9c0 2021-11-12T05:49:05.069 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.056+0000 7f8852ffd700 1 -- 172.21.2.105:0/2056705319 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885800c950 con 0x7f886013a9c0 2021-11-12T05:49:05.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.056+0000 7f8868002700 1 -- 172.21.2.105:0/2056705319 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f886013a090 con 0x7f886013a9c0 2021-11-12T05:49:05.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.056+0000 7f8852ffd700 1 -- 172.21.2.105:0/2056705319 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f885800ccb0 con 0x7f886013a9c0 2021-11-12T05:49:05.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.056+0000 7f8868002700 1 -- 172.21.2.105:0/2056705319 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8860143eb0 con 0x7f886013a9c0 2021-11-12T05:49:05.070 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.056+0000 7f8868002700 1 -- 172.21.2.105:0/2056705319 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88600b61a0 con 0x7f886013a9c0 2021-11-12T05:49:05.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.056+0000 7f8852ffd700 1 -- 172.21.2.105:0/2056705319 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8858022070 con 0x7f886013a9c0 2021-11-12T05:49:05.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.056+0000 7f8852ffd700 1 --2- 172.21.2.105:0/2056705319 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8840053690 0x7f8840055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:05.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.056+0000 7f8852ffd700 1 -- 172.21.2.105:0/2056705319 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f885806bec0 con 0x7f886013a9c0 2021-11-12T05:49:05.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.056+0000 7f8865d9e700 1 --2- 172.21.2.105:0/2056705319 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8840053690 0x7f8840055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:05.071 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.056+0000 7f8865d9e700 1 --2- 172.21.2.105:0/2056705319 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8840053690 0x7f8840055b50 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f8854002f70 tx=0x7f8854015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:05.072 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.060+0000 7f8852ffd700 1 -- 172.21.2.105:0/2056705319 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8858043200 con 0x7f886013a9c0 2021-11-12T05:49:05.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.148+0000 7f8868002700 1 -- 172.21.2.105:0/2056705319 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8860057350 con 0x7f886013a9c0 2021-11-12T05:49:05.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.148+0000 7f8852ffd700 1 -- 172.21.2.105:0/2056705319 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v131) v1 ==== 84+0+143 (secure 0 0 0) 0x7f8858016070 con 0x7f886013a9c0 2021-11-12T05:49:05.153 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:05.153 INFO:teuthology.orchestra.run.gibba005.stdout:[ 2021-11-12T05:49:05.153 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:05.153 INFO:teuthology.orchestra.run.gibba005.stdout: "poolnum": 1, 2021-11-12T05:49:05.154 INFO:teuthology.orchestra.run.gibba005.stdout: "poolname": "device_health_metrics" 2021-11-12T05:49:05.154 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:05.154 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:05.154 INFO:teuthology.orchestra.run.gibba005.stdout: "poolnum": 2, 2021-11-12T05:49:05.155 INFO:teuthology.orchestra.run.gibba005.stdout: "poolname": "rbd" 2021-11-12T05:49:05.155 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:05.155 INFO:teuthology.orchestra.run.gibba005.stdout:] 2021-11-12T05:49:05.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.148+0000 7f8868002700 1 -- 172.21.2.105:0/2056705319 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8840053690 msgr2=0x7f8840055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:05.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.148+0000 7f8868002700 1 --2- 172.21.2.105:0/2056705319 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8840053690 0x7f8840055b50 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f8854002f70 tx=0x7f8854015000).stop 2021-11-12T05:49:05.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.148+0000 7f8868002700 1 -- 172.21.2.105:0/2056705319 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f886013a9c0 msgr2=0x7f88601439c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:05.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.148+0000 7f8868002700 1 --2- 172.21.2.105:0/2056705319 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f886013a9c0 0x7f88601439c0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 rx=0x7f8858006e00 tx=0x7f88580091d0).stop 2021-11-12T05:49:05.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.148+0000 7f8868002700 1 -- 172.21.2.105:0/2056705319 shutdown_connections 2021-11-12T05:49:05.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.148+0000 7f8868002700 1 --2- 172.21.2.105:0/2056705319 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8840053690 0x7f8840055b50 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:05.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.148+0000 7f8868002700 1 --2- 172.21.2.105:0/2056705319 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f886013a9c0 0x7f88601439c0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:05.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.148+0000 7f8868002700 1 --2- 172.21.2.105:0/2056705319 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f88600ade80 0x7f88601434d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:05.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.148+0000 7f8868002700 1 --2- 172.21.2.105:0/2056705319 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f886005fdc0 0x7f88600b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:05.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.148+0000 7f8868002700 1 -- 172.21.2.105:0/2056705319 >> 172.21.2.105:0/2056705319 conn(0x7f88600608d0 msgr2=0x7f88600b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:05.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.148+0000 7f8868002700 1 -- 172.21.2.105:0/2056705319 shutdown_connections 2021-11-12T05:49:05.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.148+0000 7f8868002700 1 -- 172.21.2.105:0/2056705319 wait complete. 2021-11-12T05:49:05.160 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-12T05:49:05.160 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-12T05:49:05.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.208+0000 7f57598ba700 1 Processor -- start 2021-11-12T05:49:05.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.208+0000 7f57598ba700 1 -- start start 2021-11-12T05:49:05.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.208+0000 7f57598ba700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f57540af750 0x7f5754062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:05.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.208+0000 7f57598ba700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57540b0d50 con 0x7f5754130a80 2021-11-12T05:49:05.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.208+0000 7f57598ba700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57540ad380 con 0x7f57540626b0 2021-11-12T05:49:05.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.208+0000 7f57598ba700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57540ae190 con 0x7f57540af750 2021-11-12T05:49:05.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.208+0000 7f57537fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f5754130a80 0x7f57541474d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:33458/0 (socket says 172.21.2.105:33458) 2021-11-12T05:49:05.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.208+0000 7f57537fe700 1 -- 172.21.2.105:0/3635442459 learned_addr learned my addr 172.21.2.105:0/3635442459 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:05.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.208+0000 7f5751ffb700 1 -- 172.21.2.105:0/3635442459 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3945640936 0 0) 0x7f57540b0d50 con 0x7f5754130a80 2021-11-12T05:49:05.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.208+0000 7f5751ffb700 1 -- 172.21.2.105:0/3635442459 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5734003260 con 0x7f5754130a80 2021-11-12T05:49:05.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.208+0000 7f5751ffb700 1 -- 172.21.2.105:0/3635442459 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2457169532 0 0) 0x7f5734003260 con 0x7f5754130a80 2021-11-12T05:49:05.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.208+0000 7f5751ffb700 1 -- 172.21.2.105:0/3635442459 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f57540af750 msgr2=0x7f5754062a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:05.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.208+0000 7f5751ffb700 1 --2- 172.21.2.105:0/3635442459 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f57540af750 0x7f5754062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:05.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.208+0000 7f5751ffb700 1 -- 172.21.2.105:0/3635442459 >> v1:172.21.2.115:6789/0 conn(0x7f57540626b0 legacy=0x7f5754130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:05.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.208+0000 7f5751ffb700 1 -- 172.21.2.105:0/3635442459 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57540ae2d0 con 0x7f5754130a80 2021-11-12T05:49:05.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.208+0000 7f5751ffb700 1 -- 172.21.2.105:0/3635442459 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f574c0019e0 con 0x7f5754130a80 2021-11-12T05:49:05.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.208+0000 7f5751ffb700 1 -- 172.21.2.105:0/3635442459 >> v1:172.21.2.105:6789/0 conn(0x7f5754130a80 legacy=0x7f57541474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:05.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f5751ffb700 1 --2- 172.21.2.105:0/3635442459 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5734003780 0x7f5734003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:05.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f5751ffb700 1 --2- 172.21.2.105:0/3635442459 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5734004500 0x7f5734004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:05.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f5751ffb700 1 --2- 172.21.2.105:0/3635442459 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f57540af750 0x7f5734004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:05.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f5751ffb700 1 -- 172.21.2.105:0/3635442459 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57540ae190 con 0x7f5734003780 2021-11-12T05:49:05.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f5751ffb700 1 -- 172.21.2.105:0/3635442459 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573400b910 con 0x7f5734004500 2021-11-12T05:49:05.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f5751ffb700 1 -- 172.21.2.105:0/3635442459 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f573400bad0 con 0x7f57540af750 2021-11-12T05:49:05.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f5752ffd700 1 --2- 172.21.2.105:0/3635442459 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5734003780 0x7f5734003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:05.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f57537fe700 1 --2- 172.21.2.105:0/3635442459 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f57540af750 0x7f5734004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:05.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f5752ffd700 1 -- 172.21.2.105:0/3635442459 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f57540af750 msgr2=0x7f5734004ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:05.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f5752ffd700 1 --2- 172.21.2.105:0/3635442459 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f57540af750 0x7f5734004ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:05.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f5752ffd700 1 -- 172.21.2.105:0/3635442459 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5734004500 msgr2=0x7f5734004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:05.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f5752ffd700 1 --2- 172.21.2.105:0/3635442459 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5734004500 0x7f5734004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:05.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f5752ffd700 1 -- 172.21.2.105:0/3635442459 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5734003260 con 0x7f5734003780 2021-11-12T05:49:05.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f5752ffd700 1 --2- 172.21.2.105:0/3635442459 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5734003780 0x7f5734003b80 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7f5744000f70 tx=0x7f57440079e0).ready entity=mon.0 client_cookie=193bbffc5e841006 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:05.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f5751ffb700 1 -- 172.21.2.105:0/3635442459 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5744001d80 con 0x7f5734003780 2021-11-12T05:49:05.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f5751ffb700 1 -- 172.21.2.105:0/3635442459 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5744014410 con 0x7f5734003780 2021-11-12T05:49:05.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f5751ffb700 1 -- 172.21.2.105:0/3635442459 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5744007cf0 con 0x7f5734003780 2021-11-12T05:49:05.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f57598ba700 1 -- 172.21.2.105:0/3635442459 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5734003780 msgr2=0x7f5734003b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:05.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f57598ba700 1 --2- 172.21.2.105:0/3635442459 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5734003780 0x7f5734003b80 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7f5744000f70 tx=0x7f57440079e0).stop 2021-11-12T05:49:05.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f57537fe700 1 -- 172.21.2.105:0/3635442459 reap_dead start 2021-11-12T05:49:05.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f57598ba700 1 -- 172.21.2.105:0/3635442459 shutdown_connections 2021-11-12T05:49:05.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f57598ba700 1 -- 172.21.2.105:0/3635442459 >> 172.21.2.105:0/3635442459 conn(0x7f57540b5320 msgr2=0x7f57540b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:05.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f57598ba700 1 -- 172.21.2.105:0/3635442459 shutdown_connections 2021-11-12T05:49:05.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f57598ba700 1 -- 172.21.2.105:0/3635442459 wait complete. 2021-11-12T05:49:05.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f57598ba700 1 Processor -- start 2021-11-12T05:49:05.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f57598ba700 1 -- start start 2021-11-12T05:49:05.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f57598ba700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5734003780 0x7f575414b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:05.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f57598ba700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5754148cf0 0x7f575412e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:05.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f57598ba700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f57540669d0 0x7f5754066e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:05.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f57598ba700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5754063590 con 0x7f57540669d0 2021-11-12T05:49:05.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f57598ba700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5754063050 con 0x7f5734003780 2021-11-12T05:49:05.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f57598ba700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57540632f0 con 0x7f5754148cf0 2021-11-12T05:49:05.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f57537fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f57540669d0 0x7f5754066e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:05.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f57537fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f57540669d0 0x7f5754066e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51306/0 (socket says 172.21.2.105:51306) 2021-11-12T05:49:05.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f57537fe700 1 -- 172.21.2.105:0/92316519 learned_addr learned my addr 172.21.2.105:0/92316519 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:05.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f5752ffd700 1 --2- 172.21.2.105:0/92316519 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5734003780 0x7f575414b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:05.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f57527fc700 1 --2- 172.21.2.105:0/92316519 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5754148cf0 0x7f575412e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:05.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f57537fe700 1 -- 172.21.2.105:0/92316519 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5754148cf0 msgr2=0x7f575412e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:05.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f57537fe700 1 --2- 172.21.2.105:0/92316519 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5754148cf0 0x7f575412e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:05.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f57537fe700 1 -- 172.21.2.105:0/92316519 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5734003780 msgr2=0x7f575414b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:05.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f57537fe700 1 --2- 172.21.2.105:0/92316519 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5734003780 0x7f575414b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:05.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f57537fe700 1 -- 172.21.2.105:0/92316519 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f575412e5f0 con 0x7f57540669d0 2021-11-12T05:49:05.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f57527fc700 1 --2- 172.21.2.105:0/92316519 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5754148cf0 0x7f575412e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:49:05.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f57537fe700 1 --2- 172.21.2.105:0/92316519 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f57540669d0 0x7f5754066e80 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7f574c001c40 tx=0x7f574c009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:05.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f574bfff700 1 -- 172.21.2.105:0/92316519 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f574c007e00 con 0x7f57540669d0 2021-11-12T05:49:05.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f574bfff700 1 -- 172.21.2.105:0/92316519 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f574c004ab0 con 0x7f57540669d0 2021-11-12T05:49:05.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f57598ba700 1 -- 172.21.2.105:0/92316519 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5754146f00 con 0x7f57540669d0 2021-11-12T05:49:05.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f574bfff700 1 -- 172.21.2.105:0/92316519 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f574c004e10 con 0x7f57540669d0 2021-11-12T05:49:05.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.212+0000 7f57598ba700 1 -- 172.21.2.105:0/92316519 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f575414d610 con 0x7f57540669d0 2021-11-12T05:49:05.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.216+0000 7f57598ba700 1 -- 172.21.2.105:0/92316519 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f575414b1c0 con 0x7f57540669d0 2021-11-12T05:49:05.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.216+0000 7f574bfff700 1 -- 172.21.2.105:0/92316519 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f574c01c060 con 0x7f57540669d0 2021-11-12T05:49:05.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.216+0000 7f574bfff700 1 --2- 172.21.2.105:0/92316519 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5738053520 0x7f57380559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:05.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.216+0000 7f574bfff700 1 -- 172.21.2.105:0/92316519 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f574c06ada0 con 0x7f57540669d0 2021-11-12T05:49:05.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.216+0000 7f5752ffd700 1 --2- 172.21.2.105:0/92316519 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5738053520 0x7f57380559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:05.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.216+0000 7f5752ffd700 1 --2- 172.21.2.105:0/92316519 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5738053520 0x7f57380559e0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f574401c000 tx=0x7f5744015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:05.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.216+0000 7f574bfff700 1 -- 172.21.2.105:0/92316519 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f574c041fd0 con 0x7f57540669d0 2021-11-12T05:49:05.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:05.300+0000 7f57598ba700 1 -- 172.21.2.105:0/92316519 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f57540ae2d0 con 0x7f57540669d0 2021-11-12T05:49:06.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.292+0000 7f574bfff700 1 -- 172.21.2.105:0/92316519 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v132) v1 ==== 133+0+0 (secure 0 0 0) 0x7f57540ae2d0 con 0x7f57540669d0 2021-11-12T05:49:06.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.292+0000 7f57598ba700 1 -- 172.21.2.105:0/92316519 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5738053520 msgr2=0x7f57380559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:06.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.292+0000 7f57598ba700 1 --2- 172.21.2.105:0/92316519 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5738053520 0x7f57380559e0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f574401c000 tx=0x7f5744015000).stop 2021-11-12T05:49:06.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.292+0000 7f57598ba700 1 -- 172.21.2.105:0/92316519 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f57540669d0 msgr2=0x7f5754066e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:06.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.292+0000 7f57598ba700 1 --2- 172.21.2.105:0/92316519 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f57540669d0 0x7f5754066e80 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7f574c001c40 tx=0x7f574c009040).stop 2021-11-12T05:49:06.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.292+0000 7f57598ba700 1 -- 172.21.2.105:0/92316519 shutdown_connections 2021-11-12T05:49:06.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.292+0000 7f57598ba700 1 --2- 172.21.2.105:0/92316519 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5738053520 0x7f57380559e0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:06.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.292+0000 7f57598ba700 1 --2- 172.21.2.105:0/92316519 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f57540669d0 0x7f5754066e80 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:06.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.292+0000 7f57598ba700 1 --2- 172.21.2.105:0/92316519 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5754148cf0 0x7f575412e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:06.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.292+0000 7f57598ba700 1 --2- 172.21.2.105:0/92316519 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5734003780 0x7f575414b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:06.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.292+0000 7f57598ba700 1 -- 172.21.2.105:0/92316519 >> 172.21.2.105:0/92316519 conn(0x7f57540b5320 msgr2=0x7f57540b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:06.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.292+0000 7f57598ba700 1 -- 172.21.2.105:0/92316519 shutdown_connections 2021-11-12T05:49:06.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.292+0000 7f57598ba700 1 -- 172.21.2.105:0/92316519 wait complete. 2021-11-12T05:49:06.301 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_metadata' created 2021-11-12T05:49:06.304 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-11-12T05:49:06.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.360+0000 7fd48c27e700 1 Processor -- start 2021-11-12T05:49:06.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.360+0000 7fd48c27e700 1 -- start start 2021-11-12T05:49:06.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.360+0000 7fd48c27e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd4840b2290 0x7fd4840b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:06.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.360+0000 7fd48c27e700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd484143da0 0x7fd484140240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:06.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.360+0000 7fd48c27e700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4840aa0b0 con 0x7fd4840b2cc0 2021-11-12T05:49:06.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.360+0000 7fd48c27e700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4840a9b70 con 0x7fd484143da0 2021-11-12T05:49:06.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.360+0000 7fd48c27e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4840a9e10 con 0x7fd4840b2290 2021-11-12T05:49:06.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.360+0000 7fd48a81b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd484143da0 0x7fd484140240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:06.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.360+0000 7fd48a81b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd484143da0 0x7fd484140240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51314/0 (socket says 172.21.2.105:51314) 2021-11-12T05:49:06.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.360+0000 7fd48a81b700 1 -- 172.21.2.105:0/2469201294 learned_addr learned my addr 172.21.2.105:0/2469201294 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:06.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.360+0000 7fd48a81b700 1 -- 172.21.2.105:0/2469201294 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd4840b2290 msgr2=0x7fd4840b30a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:49:06.368 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.360+0000 7fd48a81b700 1 --2- 172.21.2.105:0/2469201294 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd4840b2290 0x7fd4840b30a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:06.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.360+0000 7fd48a81b700 1 -- 172.21.2.105:0/2469201294 >> v1:172.21.2.115:6789/0 conn(0x7fd4840b2cc0 legacy=0x7fd484143690 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:49:06.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.360+0000 7fd48a81b700 1 -- 172.21.2.105:0/2469201294 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4840b0800 con 0x7fd484143da0 2021-11-12T05:49:06.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.360+0000 7fd48a81b700 1 --2- 172.21.2.105:0/2469201294 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd484143da0 0x7fd484140240 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 rx=0x7fd484069fe0 tx=0x7fd47c00b530).ready entity=mon.0 client_cookie=d7f1d8a8adca89d9 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:06.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.360+0000 7fd489018700 1 -- 172.21.2.105:0/2469201294 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd47c00be70 con 0x7fd484143da0 2021-11-12T05:49:06.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.360+0000 7fd489018700 1 -- 172.21.2.105:0/2469201294 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47c010470 con 0x7fd484143da0 2021-11-12T05:49:06.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.360+0000 7fd489018700 1 -- 172.21.2.105:0/2469201294 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd47c010810 con 0x7fd484143da0 2021-11-12T05:49:06.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.360+0000 7fd48c27e700 1 -- 172.21.2.105:0/2469201294 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd484143da0 msgr2=0x7fd484140240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:06.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.360+0000 7fd48c27e700 1 --2- 172.21.2.105:0/2469201294 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd484143da0 0x7fd484140240 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 rx=0x7fd484069fe0 tx=0x7fd47c00b530).stop 2021-11-12T05:49:06.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.360+0000 7fd48c27e700 1 -- 172.21.2.105:0/2469201294 shutdown_connections 2021-11-12T05:49:06.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.360+0000 7fd48c27e700 1 --2- 172.21.2.105:0/2469201294 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd484143da0 0x7fd484140240 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:06.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.360+0000 7fd48c27e700 1 --2- 172.21.2.105:0/2469201294 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd4840b2290 0x7fd4840b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:06.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.360+0000 7fd48c27e700 1 -- 172.21.2.105:0/2469201294 >> 172.21.2.105:0/2469201294 conn(0x7fd48405c490 msgr2=0x7fd48405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:06.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.360+0000 7fd48c27e700 1 -- 172.21.2.105:0/2469201294 shutdown_connections 2021-11-12T05:49:06.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.360+0000 7fd48c27e700 1 -- 172.21.2.105:0/2469201294 wait complete. 2021-11-12T05:49:06.375 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.360+0000 7fd48c27e700 1 Processor -- start 2021-11-12T05:49:06.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.360+0000 7fd48c27e700 1 -- start start 2021-11-12T05:49:06.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.364+0000 7fd48c27e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd4840b2290 0x7fd484066ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:06.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.364+0000 7fd48c27e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd4840b2cc0 0x7fd4840a8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:06.376 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.364+0000 7fd48c27e700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd484143da0 0x7fd4840a9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:06.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.364+0000 7fd48c27e700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd484065fe0 con 0x7fd4840b2290 2021-11-12T05:49:06.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.364+0000 7fd48c27e700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd484140370 con 0x7fd484143da0 2021-11-12T05:49:06.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.364+0000 7fd48c27e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4840a4fa0 con 0x7fd4840b2cc0 2021-11-12T05:49:06.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.364+0000 7fd48a01a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd4840b2290 0x7fd484066ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:06.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.364+0000 7fd48a01a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd4840b2290 0x7fd484066ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51320/0 (socket says 172.21.2.105:51320) 2021-11-12T05:49:06.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.364+0000 7fd48a01a700 1 -- 172.21.2.105:0/3830318488 learned_addr learned my addr 172.21.2.105:0/3830318488 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:06.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.364+0000 7fd48a01a700 1 -- 172.21.2.105:0/3830318488 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd4840b2cc0 msgr2=0x7fd4840a8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:06.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.364+0000 7fd48a01a700 1 --2- 172.21.2.105:0/3830318488 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd4840b2cc0 0x7fd4840a8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:06.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.364+0000 7fd48a01a700 1 -- 172.21.2.105:0/3830318488 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd484143da0 msgr2=0x7fd4840a9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:06.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.364+0000 7fd48a01a700 1 --2- 172.21.2.105:0/3830318488 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd484143da0 0x7fd4840a9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:06.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.364+0000 7fd48a01a700 1 -- 172.21.2.105:0/3830318488 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd47c00b7d0 con 0x7fd4840b2290 2021-11-12T05:49:06.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.364+0000 7fd48a01a700 1 --2- 172.21.2.105:0/3830318488 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd4840b2290 0x7fd484066ef0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7fd480002fb0 tx=0x7fd480006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:06.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.364+0000 7fd4777fe700 1 -- 172.21.2.105:0/3830318488 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd480013460 con 0x7fd4840b2290 2021-11-12T05:49:06.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.364+0000 7fd4777fe700 1 -- 172.21.2.105:0/3830318488 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4800135c0 con 0x7fd4840b2290 2021-11-12T05:49:06.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.364+0000 7fd4777fe700 1 -- 172.21.2.105:0/3830318488 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd480013920 con 0x7fd4840b2290 2021-11-12T05:49:06.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.364+0000 7fd48c27e700 1 -- 172.21.2.105:0/3830318488 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4840a5240 con 0x7fd4840b2290 2021-11-12T05:49:06.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.364+0000 7fd48c27e700 1 -- 172.21.2.105:0/3830318488 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4840a9670 con 0x7fd4840b2290 2021-11-12T05:49:06.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.364+0000 7fd48c27e700 1 -- 172.21.2.105:0/3830318488 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4840a56e0 con 0x7fd4840b2290 2021-11-12T05:49:06.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.364+0000 7fd4777fe700 1 -- 172.21.2.105:0/3830318488 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd48000f070 con 0x7fd4840b2290 2021-11-12T05:49:06.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.364+0000 7fd4777fe700 1 --2- 172.21.2.105:0/3830318488 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd464053610 0x7fd464055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:06.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.364+0000 7fd4777fe700 1 -- 172.21.2.105:0/3830318488 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5950+0+0 (secure 0 0 0) 0x7fd48006b120 con 0x7fd4840b2290 2021-11-12T05:49:06.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.364+0000 7fd489819700 1 --2- 172.21.2.105:0/3830318488 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd464053610 0x7fd464055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:06.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.364+0000 7fd489819700 1 --2- 172.21.2.105:0/3830318488 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd464053610 0x7fd464055ad0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7fd478002fb0 tx=0x7fd4780069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:06.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.368+0000 7fd4777fe700 1 -- 172.21.2.105:0/3830318488 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd4840a56e0 con 0x7fd4840b2290 2021-11-12T05:49:06.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:06.452+0000 7fd48c27e700 1 -- 172.21.2.105:0/3830318488 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fd4840a56e0 con 0x7fd4840b2290 2021-11-12T05:49:07.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.304+0000 7fd4777fe700 1 -- 172.21.2.105:0/3830318488 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v133) v1 ==== 125+0+0 (secure 0 0 0) 0x7fd4840a56e0 con 0x7fd4840b2290 2021-11-12T05:49:07.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.304+0000 7fd48c27e700 1 -- 172.21.2.105:0/3830318488 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd464053610 msgr2=0x7fd464055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:07.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.304+0000 7fd48c27e700 1 --2- 172.21.2.105:0/3830318488 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd464053610 0x7fd464055ad0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7fd478002fb0 tx=0x7fd4780069b0).stop 2021-11-12T05:49:07.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.304+0000 7fd48c27e700 1 -- 172.21.2.105:0/3830318488 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd4840b2290 msgr2=0x7fd484066ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:07.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.304+0000 7fd48c27e700 1 --2- 172.21.2.105:0/3830318488 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd4840b2290 0x7fd484066ef0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7fd480002fb0 tx=0x7fd480006df0).stop 2021-11-12T05:49:07.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.304+0000 7fd48c27e700 1 -- 172.21.2.105:0/3830318488 shutdown_connections 2021-11-12T05:49:07.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.304+0000 7fd48c27e700 1 --2- 172.21.2.105:0/3830318488 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd464053610 0x7fd464055ad0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:07.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.304+0000 7fd48c27e700 1 --2- 172.21.2.105:0/3830318488 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd484143da0 0x7fd4840a9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:07.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.304+0000 7fd48c27e700 1 --2- 172.21.2.105:0/3830318488 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd4840b2cc0 0x7fd4840a8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:07.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.304+0000 7fd48c27e700 1 --2- 172.21.2.105:0/3830318488 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd4840b2290 0x7fd484066ef0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:07.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.304+0000 7fd48c27e700 1 -- 172.21.2.105:0/3830318488 >> 172.21.2.105:0/3830318488 conn(0x7fd48405c490 msgr2=0x7fd4840b1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:07.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.304+0000 7fd48c27e700 1 -- 172.21.2.105:0/3830318488 shutdown_connections 2021-11-12T05:49:07.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.304+0000 7fd48c27e700 1 -- 172.21.2.105:0/3830318488 wait complete. 2021-11-12T05:49:07.312 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_data' created 2021-11-12T05:49:07.316 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-12T05:49:07.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.364+0000 7fdbbf99c700 1 Processor -- start 2021-11-12T05:49:07.369 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.364+0000 7fdbbf99c700 1 -- start start 2021-11-12T05:49:07.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.364+0000 7fdbbf99c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fdbb805f9f0 0x7fdbb80601b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:07.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.364+0000 7fdbbf99c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdbb80b3b90 0x7fdbb8142560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:07.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.364+0000 7fdbbf99c700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbb80af7f0 con 0x7fdbb80b26d0 2021-11-12T05:49:07.371 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.364+0000 7fdbbf99c700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbb80af340 con 0x7fdbb805f9f0 2021-11-12T05:49:07.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.364+0000 7fdbbf99c700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb805fdd0 con 0x7fdbb80b3b90 2021-11-12T05:49:07.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.364+0000 7fdbbcf37700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fdbb80b26d0 0x7fdbb80b3480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:33496/0 (socket says 172.21.2.105:33496) 2021-11-12T05:49:07.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.364+0000 7fdbbcf37700 1 -- 172.21.2.105:0/754570901 learned_addr learned my addr 172.21.2.105:0/754570901 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:07.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.364+0000 7fdbbd738700 1 --2- 172.21.2.105:0/754570901 >> v2:172.21.2.105:3300/0 conn(0x7fdbb805f9f0 0x7fdbb80601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:07.372 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.364+0000 7fdbabfff700 1 -- 172.21.2.105:0/754570901 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1732113421 0 0) 0x7fdbb80af7f0 con 0x7fdbb80b26d0 2021-11-12T05:49:07.373 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.364+0000 7fdbabfff700 1 -- 172.21.2.105:0/754570901 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdba0003260 con 0x7fdbb80b26d0 2021-11-12T05:49:07.373 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.364+0000 7fdbbd738700 1 -- 172.21.2.105:0/754570901 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdbb80b3b90 msgr2=0x7fdbb8142560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:07.373 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.364+0000 7fdbbd738700 1 --2- 172.21.2.105:0/754570901 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdbb80b3b90 0x7fdbb8142560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:07.373 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.364+0000 7fdbbd738700 1 -- 172.21.2.105:0/754570901 >> v1:172.21.2.105:6789/0 conn(0x7fdbb80b26d0 legacy=0x7fdbb80b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:07.374 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.364+0000 7fdbbd738700 1 -- 172.21.2.105:0/754570901 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb805d110 con 0x7fdbb805f9f0 2021-11-12T05:49:07.374 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.364+0000 7fdbbd738700 1 --2- 172.21.2.105:0/754570901 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdbb805f9f0 0x7fdbb80601b0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7fdbb4002f70 tx=0x7fdbb4006df0).ready entity=mon.0 client_cookie=34f82a4b4d6195f5 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:07.374 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.364+0000 7fdbabfff700 1 -- 172.21.2.105:0/754570901 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbb400d570 con 0x7fdbb805f9f0 2021-11-12T05:49:07.374 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.364+0000 7fdbabfff700 1 -- 172.21.2.105:0/754570901 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb4000e90 con 0x7fdbb805f9f0 2021-11-12T05:49:07.375 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.364+0000 7fdbabfff700 1 -- 172.21.2.105:0/754570901 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbb400d8c0 con 0x7fdbb805f9f0 2021-11-12T05:49:07.375 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.368+0000 7fdbbf99c700 1 -- 172.21.2.105:0/754570901 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdbb805f9f0 msgr2=0x7fdbb80601b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:07.375 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.368+0000 7fdbbf99c700 1 --2- 172.21.2.105:0/754570901 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdbb805f9f0 0x7fdbb80601b0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7fdbb4002f70 tx=0x7fdbb4006df0).stop 2021-11-12T05:49:07.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.368+0000 7fdbbf99c700 1 -- 172.21.2.105:0/754570901 shutdown_connections 2021-11-12T05:49:07.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.368+0000 7fdbbf99c700 1 --2- 172.21.2.105:0/754570901 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdbb80b3b90 0x7fdbb8142560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:07.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.368+0000 7fdbbf99c700 1 --2- 172.21.2.105:0/754570901 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdbb805f9f0 0x7fdbb80601b0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:07.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.368+0000 7fdbbf99c700 1 -- 172.21.2.105:0/754570901 >> 172.21.2.105:0/754570901 conn(0x7fdbb805c490 msgr2=0x7fdbb805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:07.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.368+0000 7fdbbf99c700 1 -- 172.21.2.105:0/754570901 shutdown_connections 2021-11-12T05:49:07.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.368+0000 7fdbbf99c700 1 -- 172.21.2.105:0/754570901 wait complete. 2021-11-12T05:49:07.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.368+0000 7fdbbf99c700 1 Processor -- start 2021-11-12T05:49:07.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.368+0000 7fdbbf99c700 1 -- start start 2021-11-12T05:49:07.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.368+0000 7fdbbf99c700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdbb805f9f0 0x7fdbb81471a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:07.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.368+0000 7fdbbf99c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdbb80b26d0 0x7fdbb80ab390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:07.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.368+0000 7fdbbf99c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdbb80b3b90 0x7fdbb80ab880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:07.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.368+0000 7fdbbf99c700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb8063530 con 0x7fdbb80b3b90 2021-11-12T05:49:07.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.368+0000 7fdbbf99c700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb80675d0 con 0x7fdbb805f9f0 2021-11-12T05:49:07.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.368+0000 7fdbbf99c700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb8156340 con 0x7fdbb80b26d0 2021-11-12T05:49:07.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.368+0000 7fdbbdf39700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdbb80b3b90 0x7fdbb80ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:07.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.368+0000 7fdbbdf39700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdbb80b3b90 0x7fdbb80ab880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51338/0 (socket says 172.21.2.105:51338) 2021-11-12T05:49:07.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.368+0000 7fdbbdf39700 1 -- 172.21.2.105:0/4275800811 learned_addr learned my addr 172.21.2.105:0/4275800811 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:07.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.368+0000 7fdbbdf39700 1 -- 172.21.2.105:0/4275800811 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdbb80b26d0 msgr2=0x7fdbb80ab390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:07.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.368+0000 7fdbbdf39700 1 --2- 172.21.2.105:0/4275800811 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdbb80b26d0 0x7fdbb80ab390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:07.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.368+0000 7fdbbdf39700 1 -- 172.21.2.105:0/4275800811 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdbb805f9f0 msgr2=0x7fdbb81471a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:07.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.368+0000 7fdbbd738700 1 --2- 172.21.2.105:0/4275800811 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdbb805f9f0 0x7fdbb81471a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:07.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.368+0000 7fdbbdf39700 1 --2- 172.21.2.105:0/4275800811 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdbb805f9f0 0x7fdbb81471a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:07.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.368+0000 7fdbbdf39700 1 -- 172.21.2.105:0/4275800811 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb400b180 con 0x7fdbb80b3b90 2021-11-12T05:49:07.383 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.368+0000 7fdbbdf39700 1 --2- 172.21.2.105:0/4275800811 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdbb80b3b90 0x7fdbb80ab880 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7fdbb00032f0 tx=0x7fdbb00091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:07.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.368+0000 7fdbaa7fc700 1 -- 172.21.2.105:0/4275800811 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbb000d4a0 con 0x7fdbb80b3b90 2021-11-12T05:49:07.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.368+0000 7fdbaa7fc700 1 -- 172.21.2.105:0/4275800811 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb000d600 con 0x7fdbb80b3b90 2021-11-12T05:49:07.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.368+0000 7fdbbf99c700 1 -- 172.21.2.105:0/4275800811 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbb80abd70 con 0x7fdbb80b3b90 2021-11-12T05:49:07.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.368+0000 7fdbaa7fc700 1 -- 172.21.2.105:0/4275800811 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbb000d960 con 0x7fdbb80b3b90 2021-11-12T05:49:07.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.368+0000 7fdbbf99c700 1 -- 172.21.2.105:0/4275800811 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbb81565a0 con 0x7fdbb80b3b90 2021-11-12T05:49:07.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.372+0000 7fdbbf99c700 1 -- 172.21.2.105:0/4275800811 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbb80af550 con 0x7fdbb80b3b90 2021-11-12T05:49:07.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.372+0000 7fdbaa7fc700 1 -- 172.21.2.105:0/4275800811 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdbb0018030 con 0x7fdbb80b3b90 2021-11-12T05:49:07.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.372+0000 7fdbaa7fc700 1 --2- 172.21.2.105:0/4275800811 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdb980536d0 0x7fdb98055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:07.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.372+0000 7fdbaa7fc700 1 -- 172.21.2.105:0/4275800811 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6300+0+0 (secure 0 0 0) 0x7fdbb006b4f0 con 0x7fdbb80b3b90 2021-11-12T05:49:07.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.372+0000 7fdbbd738700 1 --2- 172.21.2.105:0/4275800811 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdb980536d0 0x7fdb98055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:07.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.372+0000 7fdbbd738700 1 --2- 172.21.2.105:0/4275800811 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdb980536d0 0x7fdb98055b90 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7fdbb4015000 tx=0x7fdbb4014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:07.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.372+0000 7fdbaa7fc700 1 -- 172.21.2.105:0/4275800811 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdbb0042470 con 0x7fdbb80b3b90 2021-11-12T05:49:07.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.480+0000 7fdbbf99c700 1 -- 172.21.2.105:0/4275800811 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fdbb8057350 con 0x7fdbb80b3b90 2021-11-12T05:49:07.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.488+0000 7fdbaa7fc700 1 -- 172.21.2.105:0/4275800811 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 25 and data pool 26 v64) v1 ==== 189+0+0 (secure 0 0 0) 0x7fdbb0045a90 con 0x7fdbb80b3b90 2021-11-12T05:49:07.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.488+0000 7fdbbf99c700 1 -- 172.21.2.105:0/4275800811 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdb980536d0 msgr2=0x7fdb98055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:07.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.488+0000 7fdbbf99c700 1 --2- 172.21.2.105:0/4275800811 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdb980536d0 0x7fdb98055b90 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7fdbb4015000 tx=0x7fdbb4014000).stop 2021-11-12T05:49:07.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.488+0000 7fdbbf99c700 1 -- 172.21.2.105:0/4275800811 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdbb80b3b90 msgr2=0x7fdbb80ab880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:07.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.488+0000 7fdbbf99c700 1 --2- 172.21.2.105:0/4275800811 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdbb80b3b90 0x7fdbb80ab880 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7fdbb00032f0 tx=0x7fdbb00091a0).stop 2021-11-12T05:49:07.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.488+0000 7fdbbf99c700 1 -- 172.21.2.105:0/4275800811 shutdown_connections 2021-11-12T05:49:07.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.488+0000 7fdbbf99c700 1 --2- 172.21.2.105:0/4275800811 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdb980536d0 0x7fdb98055b90 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:07.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.488+0000 7fdbbf99c700 1 --2- 172.21.2.105:0/4275800811 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdbb80b3b90 0x7fdbb80ab880 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:07.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.488+0000 7fdbbf99c700 1 --2- 172.21.2.105:0/4275800811 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdbb80b26d0 0x7fdbb80ab390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:07.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.488+0000 7fdbbf99c700 1 --2- 172.21.2.105:0/4275800811 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdbb805f9f0 0x7fdbb81471a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:07.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.488+0000 7fdbbf99c700 1 -- 172.21.2.105:0/4275800811 >> 172.21.2.105:0/4275800811 conn(0x7fdbb805c490 msgr2=0x7fdbb81480b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:07.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.488+0000 7fdbbf99c700 1 -- 172.21.2.105:0/4275800811 shutdown_connections 2021-11-12T05:49:07.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.488+0000 7fdbbf99c700 1 -- 172.21.2.105:0/4275800811 wait complete. 2021-11-12T05:49:07.498 INFO:teuthology.orchestra.run.gibba005.stderr:new fs with metadata pool 25 and data pool 26 2021-11-12T05:49:07.502 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:49:07.566 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.552+0000 7f27526f3700 1 Processor -- start 2021-11-12T05:49:07.567 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.552+0000 7f27526f3700 1 -- start start 2021-11-12T05:49:07.567 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.552+0000 7f27526f3700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f274c0ac280 0x7f274c14b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:07.568 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.552+0000 7f27526f3700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f274c0ac7b0 con 0x7f274c0af730 2021-11-12T05:49:07.569 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.552+0000 7f27526f3700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f274c0ac9e0 con 0x7f274c0ad080 2021-11-12T05:49:07.569 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.552+0000 7f27526f3700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f274c1488a0 con 0x7f274c0ac280 2021-11-12T05:49:07.569 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.552+0000 7f2750c90700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f274c0af730 0x7f274c147a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:33520/0 (socket says 172.21.2.105:33520) 2021-11-12T05:49:07.570 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.552+0000 7f2750c90700 1 -- 172.21.2.105:0/1641547842 learned_addr learned my addr 172.21.2.105:0/1641547842 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:07.571 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.552+0000 7f274b7fe700 1 --2- 172.21.2.105:0/1641547842 >> v2:172.21.2.105:3300/0 conn(0x7f274c0ac280 0x7f274c14b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:07.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.552+0000 7f274b7fe700 1 -- 172.21.2.105:0/1641547842 >> v1:172.21.2.115:6789/0 conn(0x7f274c0ad080 legacy=0x7f274c14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:07.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.552+0000 7f274b7fe700 1 -- 172.21.2.105:0/1641547842 >> v1:172.21.2.105:6789/0 conn(0x7f274c0af730 legacy=0x7f274c147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:07.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.552+0000 7f274b7fe700 1 -- 172.21.2.105:0/1641547842 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274c0b0b30 con 0x7f274c0ac280 2021-11-12T05:49:07.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.552+0000 7f274b7fe700 1 --2- 172.21.2.105:0/1641547842 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f274c0ac280 0x7f274c14b2f0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7f274c0ac6a0 tx=0x7f273c006df0).ready entity=mon.0 client_cookie=8582dc158e74f335 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:07.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.552+0000 7f274affd700 1 -- 172.21.2.105:0/1641547842 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f273c00d5c0 con 0x7f274c0ac280 2021-11-12T05:49:07.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.552+0000 7f274affd700 1 -- 172.21.2.105:0/1641547842 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273c000e90 con 0x7f274c0ac280 2021-11-12T05:49:07.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.552+0000 7f274affd700 1 -- 172.21.2.105:0/1641547842 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f273c00d910 con 0x7f274c0ac280 2021-11-12T05:49:07.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.556+0000 7f27526f3700 1 -- 172.21.2.105:0/1641547842 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f274c0ac280 msgr2=0x7f274c14b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:07.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.556+0000 7f27526f3700 1 --2- 172.21.2.105:0/1641547842 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f274c0ac280 0x7f274c14b2f0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7f274c0ac6a0 tx=0x7f273c006df0).stop 2021-11-12T05:49:07.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.556+0000 7f27526f3700 1 -- 172.21.2.105:0/1641547842 shutdown_connections 2021-11-12T05:49:07.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.556+0000 7f27526f3700 1 --2- 172.21.2.105:0/1641547842 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f274c0ac280 0x7f274c14b2f0 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:07.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.556+0000 7f27526f3700 1 -- 172.21.2.105:0/1641547842 >> 172.21.2.105:0/1641547842 conn(0x7f274c0b5370 msgr2=0x7f274c0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:07.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.556+0000 7f27526f3700 1 -- 172.21.2.105:0/1641547842 shutdown_connections 2021-11-12T05:49:07.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.556+0000 7f27526f3700 1 -- 172.21.2.105:0/1641547842 wait complete. 2021-11-12T05:49:07.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.556+0000 7f27526f3700 1 Processor -- start 2021-11-12T05:49:07.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.556+0000 7f27526f3700 1 -- start start 2021-11-12T05:49:07.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.556+0000 7f27526f3700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f274c0ac280 0x7f274c0637b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:07.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.556+0000 7f27526f3700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f274c0ad080 0x7f274c063ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:07.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.556+0000 7f27526f3700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f274c0af730 0x7f274c156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:07.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.556+0000 7f27526f3700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274c1433e0 con 0x7f274c0ad080 2021-11-12T05:49:07.586 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.556+0000 7f27526f3700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274c157fc0 con 0x7f274c0ac280 2021-11-12T05:49:07.586 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.556+0000 7f27526f3700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274c0a9eb0 con 0x7f274c0af730 2021-11-12T05:49:07.586 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.556+0000 7f274b7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f274c0ad080 0x7f274c063ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:07.586 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.556+0000 7f274b7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f274c0ad080 0x7f274c063ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51360/0 (socket says 172.21.2.105:51360) 2021-11-12T05:49:07.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.556+0000 7f274b7fe700 1 -- 172.21.2.105:0/1163422574 learned_addr learned my addr 172.21.2.105:0/1163422574 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:07.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.556+0000 7f274b7fe700 1 -- 172.21.2.105:0/1163422574 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f274c0af730 msgr2=0x7f274c156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:07.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.556+0000 7f274b7fe700 1 --2- 172.21.2.105:0/1163422574 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f274c0af730 0x7f274c156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:07.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.556+0000 7f274b7fe700 1 -- 172.21.2.105:0/1163422574 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f274c0ac280 msgr2=0x7f274c0637b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:07.588 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.556+0000 7f274b7fe700 1 --2- 172.21.2.105:0/1163422574 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f274c0ac280 0x7f274c0637b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:07.588 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.556+0000 7f274b7fe700 1 -- 172.21.2.105:0/1163422574 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273c00b180 con 0x7f274c0ad080 2021-11-12T05:49:07.588 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.556+0000 7f274b7fe700 1 --2- 172.21.2.105:0/1163422574 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f274c0ad080 0x7f274c063ca0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 rx=0x7f274c0a9ff0 tx=0x7f273c012000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:07.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.556+0000 7f27497fa700 1 -- 172.21.2.105:0/1163422574 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f273c002f50 con 0x7f274c0ad080 2021-11-12T05:49:07.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.556+0000 7f27497fa700 1 -- 172.21.2.105:0/1163422574 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273c013d10 con 0x7f274c0ad080 2021-11-12T05:49:07.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.556+0000 7f27526f3700 1 -- 172.21.2.105:0/1163422574 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f274c157a60 con 0x7f274c0ad080 2021-11-12T05:49:07.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.556+0000 7f27497fa700 1 -- 172.21.2.105:0/1163422574 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f273c01f640 con 0x7f274c0ad080 2021-11-12T05:49:07.590 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.556+0000 7f27526f3700 1 -- 172.21.2.105:0/1163422574 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f274c0a8790 con 0x7f274c0ad080 2021-11-12T05:49:07.590 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.556+0000 7f27526f3700 1 -- 172.21.2.105:0/1163422574 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f274c0b1440 con 0x7f274c0ad080 2021-11-12T05:49:07.590 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.556+0000 7f27497fa700 1 -- 172.21.2.105:0/1163422574 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f273c026070 con 0x7f274c0ad080 2021-11-12T05:49:07.590 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.556+0000 7f27497fa700 1 --2- 172.21.2.105:0/1163422574 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f27300536a0 0x7f2730055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:07.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.556+0000 7f27497fa700 1 -- 172.21.2.105:0/1163422574 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f273c06c510 con 0x7f274c0ad080 2021-11-12T05:49:07.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.556+0000 7f274bfff700 1 --2- 172.21.2.105:0/1163422574 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f27300536a0 0x7f2730055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:07.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.556+0000 7f274bfff700 1 --2- 172.21.2.105:0/1163422574 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f27300536a0 0x7f2730055b60 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f2734002f90 tx=0x7f27340069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:07.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.560+0000 7f27497fa700 1 -- 172.21.2.105:0/1163422574 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f273c043520 con 0x7f274c0ad080 2021-11-12T05:49:07.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.644+0000 7f27526f3700 1 -- 172.21.2.105:0/1163422574 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f274c057350 con 0x7f274c0ad080 2021-11-12T05:49:07.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.644+0000 7f27497fa700 1 -- 172.21.2.105:0/1163422574 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) v1 ==== 74+0+16311 (secure 0 0 0) 0x7f273c046b40 con 0x7f274c0ad080 2021-11-12T05:49:07.649 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:07.650 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":134,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:49:07.486328+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:49:05.315585+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-11-12T05:49:06.466127+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:49:07.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.644+0000 7f27526f3700 1 -- 172.21.2.105:0/1163422574 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f27300536a0 msgr2=0x7f2730055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:07.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.644+0000 7f27526f3700 1 --2- 172.21.2.105:0/1163422574 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f27300536a0 0x7f2730055b60 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f2734002f90 tx=0x7f27340069b0).stop 2021-11-12T05:49:07.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.644+0000 7f27526f3700 1 -- 172.21.2.105:0/1163422574 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f274c0ad080 msgr2=0x7f274c063ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:07.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.644+0000 7f27526f3700 1 --2- 172.21.2.105:0/1163422574 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f274c0ad080 0x7f274c063ca0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 rx=0x7f274c0a9ff0 tx=0x7f273c012000).stop 2021-11-12T05:49:07.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.644+0000 7f27526f3700 1 -- 172.21.2.105:0/1163422574 shutdown_connections 2021-11-12T05:49:07.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.644+0000 7f27526f3700 1 --2- 172.21.2.105:0/1163422574 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f27300536a0 0x7f2730055b60 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:07.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.644+0000 7f27526f3700 1 --2- 172.21.2.105:0/1163422574 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f274c0af730 0x7f274c156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:07.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.644+0000 7f27526f3700 1 --2- 172.21.2.105:0/1163422574 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f274c0ad080 0x7f274c063ca0 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:07.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.644+0000 7f27526f3700 1 --2- 172.21.2.105:0/1163422574 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f274c0ac280 0x7f274c0637b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:07.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.644+0000 7f27526f3700 1 -- 172.21.2.105:0/1163422574 >> 172.21.2.105:0/1163422574 conn(0x7f274c0b5370 msgr2=0x7f274c143da0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:07.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.644+0000 7f27526f3700 1 -- 172.21.2.105:0/1163422574 shutdown_connections 2021-11-12T05:49:07.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.644+0000 7f27526f3700 1 -- 172.21.2.105:0/1163422574 wait complete. 2021-11-12T05:49:07.657 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:49:07.708 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.704+0000 7fa077933700 1 Processor -- start 2021-11-12T05:49:07.709 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.704+0000 7fa077933700 1 -- start start 2021-11-12T05:49:07.709 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.704+0000 7fa077933700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fa07014b2f0 0x7fa0700af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:07.709 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.704+0000 7fa077933700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0700ac7b0 con 0x7fa0700ad080 2021-11-12T05:49:07.710 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.704+0000 7fa077933700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0700ac9e0 con 0x7fa0700ac280 2021-11-12T05:49:07.710 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.704+0000 7fa077933700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0701488a0 con 0x7fa07014b2f0 2021-11-12T05:49:07.715 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.704+0000 7fa0756cf700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fa0700ad080 0x7fa07014abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:33530/0 (socket says 172.21.2.105:33530) 2021-11-12T05:49:07.716 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.704+0000 7fa0756cf700 1 -- 172.21.2.105:0/2963332583 learned_addr learned my addr 172.21.2.105:0/2963332583 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:07.716 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.704+0000 7fa063fff700 1 -- 172.21.2.105:0/2963332583 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2971228191 0 0) 0x7fa0700ac7b0 con 0x7fa0700ad080 2021-11-12T05:49:07.716 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.704+0000 7fa063fff700 1 -- 172.21.2.105:0/2963332583 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa058003260 con 0x7fa0700ad080 2021-11-12T05:49:07.716 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.704+0000 7fa075ed0700 1 --2- 172.21.2.105:0/2963332583 >> v2:172.21.2.115:3300/0 conn(0x7fa07014b2f0 0x7fa0700af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:07.717 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.704+0000 7fa063fff700 1 -- 172.21.2.105:0/2963332583 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 171492372 0 0) 0x7fa058003260 con 0x7fa0700ad080 2021-11-12T05:49:07.717 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.704+0000 7fa063fff700 1 -- 172.21.2.105:0/2963332583 >> v2:172.21.2.115:3300/0 conn(0x7fa07014b2f0 msgr2=0x7fa0700af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:07.717 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.704+0000 7fa063fff700 1 --2- 172.21.2.105:0/2963332583 >> v2:172.21.2.115:3300/0 conn(0x7fa07014b2f0 0x7fa0700af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:07.718 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.704+0000 7fa063fff700 1 -- 172.21.2.105:0/2963332583 >> v1:172.21.2.115:6789/0 conn(0x7fa0700ac280 legacy=0x7fa070147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:07.718 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.704+0000 7fa063fff700 1 -- 172.21.2.105:0/2963332583 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0700b0b30 con 0x7fa0700ad080 2021-11-12T05:49:07.718 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.704+0000 7fa063fff700 1 -- 172.21.2.105:0/2963332583 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fa064001660 con 0x7fa0700ad080 2021-11-12T05:49:07.718 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.704+0000 7fa063fff700 1 -- 172.21.2.105:0/2963332583 >> v1:172.21.2.105:6789/0 conn(0x7fa0700ad080 legacy=0x7fa07014abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:07.719 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.704+0000 7fa063fff700 1 --2- 172.21.2.105:0/2963332583 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa0580037a0 0x7fa058003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:07.719 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.704+0000 7fa063fff700 1 --2- 172.21.2.105:0/2963332583 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa058004500 0x7fa058004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:07.719 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.704+0000 7fa063fff700 1 --2- 172.21.2.105:0/2963332583 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa058004f90 0x7fa05800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:07.720 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.704+0000 7fa063fff700 1 -- 172.21.2.105:0/2963332583 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0701488a0 con 0x7fa058004500 2021-11-12T05:49:07.720 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.704+0000 7fa063fff700 1 -- 172.21.2.105:0/2963332583 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05800be00 con 0x7fa058004f90 2021-11-12T05:49:07.720 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.704+0000 7fa063fff700 1 -- 172.21.2.105:0/2963332583 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa05800bfc0 con 0x7fa0580037a0 2021-11-12T05:49:07.720 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.704+0000 7fa074ece700 1 --2- 172.21.2.105:0/2963332583 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa058004500 0x7fa058004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:07.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.704+0000 7fa074ece700 1 -- 172.21.2.105:0/2963332583 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa0580037a0 msgr2=0x7fa058003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:07.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.704+0000 7fa074ece700 1 --2- 172.21.2.105:0/2963332583 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa0580037a0 0x7fa058003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:07.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.704+0000 7fa074ece700 1 -- 172.21.2.105:0/2963332583 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa058004f90 msgr2=0x7fa05800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:07.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.704+0000 7fa074ece700 1 --2- 172.21.2.105:0/2963332583 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa058004f90 0x7fa05800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:07.722 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.704+0000 7fa074ece700 1 -- 172.21.2.105:0/2963332583 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa058003260 con 0x7fa058004500 2021-11-12T05:49:07.722 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.704+0000 7fa075ed0700 1 -- 172.21.2.105:0/2963332583 reap_dead start 2021-11-12T05:49:07.722 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.708+0000 7fa074ece700 1 --2- 172.21.2.105:0/2963332583 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa058004500 0x7fa058004980 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 rx=0x7fa0700ac6a0 tx=0x7fa06c007a00).ready entity=mon.0 client_cookie=355b30ba964c3f70 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:07.722 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.708+0000 7fa063fff700 1 -- 172.21.2.105:0/2963332583 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa06c007d10 con 0x7fa058004500 2021-11-12T05:49:07.723 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.708+0000 7fa063fff700 1 -- 172.21.2.105:0/2963332583 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06c007030 con 0x7fa058004500 2021-11-12T05:49:07.723 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.708+0000 7fa063fff700 1 -- 172.21.2.105:0/2963332583 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa06c007390 con 0x7fa058004500 2021-11-12T05:49:07.723 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.708+0000 7fa077933700 1 -- 172.21.2.105:0/2963332583 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa058004500 msgr2=0x7fa058004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:07.723 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.708+0000 7fa077933700 1 --2- 172.21.2.105:0/2963332583 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa058004500 0x7fa058004980 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 rx=0x7fa0700ac6a0 tx=0x7fa06c007a00).stop 2021-11-12T05:49:07.724 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.708+0000 7fa077933700 1 -- 172.21.2.105:0/2963332583 shutdown_connections 2021-11-12T05:49:07.724 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.708+0000 7fa077933700 1 --2- 172.21.2.105:0/2963332583 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa058004500 0x7fa058004980 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:07.724 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.708+0000 7fa077933700 1 -- 172.21.2.105:0/2963332583 >> 172.21.2.105:0/2963332583 conn(0x7fa0700b5370 msgr2=0x7fa0700b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:07.724 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.708+0000 7fa077933700 1 -- 172.21.2.105:0/2963332583 shutdown_connections 2021-11-12T05:49:07.724 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.708+0000 7fa077933700 1 -- 172.21.2.105:0/2963332583 wait complete. 2021-11-12T05:49:07.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.708+0000 7fa077933700 1 Processor -- start 2021-11-12T05:49:07.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.708+0000 7fa077933700 1 -- start start 2021-11-12T05:49:07.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.708+0000 7fa077933700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa058004500 0x7fa07014c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:07.725 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.708+0000 7fa077933700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa07014a060 0x7fa070156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:07.726 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.708+0000 7fa077933700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa070157420 0x7fa07015a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:07.726 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.708+0000 7fa077933700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa070156b50 con 0x7fa070157420 2021-11-12T05:49:07.726 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.708+0000 7fa077933700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0700aa290 con 0x7fa058004500 2021-11-12T05:49:07.726 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.708+0000 7fa077933700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0700a9ff0 con 0x7fa07014a060 2021-11-12T05:49:07.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.708+0000 7fa075ed0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa070157420 0x7fa07015a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:07.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.708+0000 7fa075ed0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa070157420 0x7fa07015a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51380/0 (socket says 172.21.2.105:51380) 2021-11-12T05:49:07.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.708+0000 7fa075ed0700 1 -- 172.21.2.105:0/3945134701 learned_addr learned my addr 172.21.2.105:0/3945134701 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:07.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.708+0000 7fa0756cf700 1 --2- 172.21.2.105:0/3945134701 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa058004500 0x7fa07014c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:07.727 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.708+0000 7fa074ece700 1 --2- 172.21.2.105:0/3945134701 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa07014a060 0x7fa070156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:07.728 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.708+0000 7fa075ed0700 1 -- 172.21.2.105:0/3945134701 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa07014a060 msgr2=0x7fa070156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:07.728 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.708+0000 7fa075ed0700 1 --2- 172.21.2.105:0/3945134701 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa07014a060 0x7fa070156f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:07.728 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.708+0000 7fa075ed0700 1 -- 172.21.2.105:0/3945134701 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa058004500 msgr2=0x7fa07014c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:07.728 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.708+0000 7fa075ed0700 1 --2- 172.21.2.105:0/3945134701 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa058004500 0x7fa07014c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:07.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.708+0000 7fa075ed0700 1 -- 172.21.2.105:0/3945134701 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa070149cf0 con 0x7fa070157420 2021-11-12T05:49:07.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.708+0000 7fa075ed0700 1 --2- 172.21.2.105:0/3945134701 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa070157420 0x7fa07015a180 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 rx=0x7fa064001430 tx=0x7fa068008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:07.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.708+0000 7fa0627fc700 1 -- 172.21.2.105:0/3945134701 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa06800c070 con 0x7fa070157420 2021-11-12T05:49:07.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.708+0000 7fa0627fc700 1 -- 172.21.2.105:0/3945134701 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0680133f0 con 0x7fa070157420 2021-11-12T05:49:07.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.708+0000 7fa077933700 1 -- 172.21.2.105:0/3945134701 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa07014ada0 con 0x7fa070157420 2021-11-12T05:49:07.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.708+0000 7fa0627fc700 1 -- 172.21.2.105:0/3945134701 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa068013750 con 0x7fa070157420 2021-11-12T05:49:07.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.708+0000 7fa077933700 1 -- 172.21.2.105:0/3945134701 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa070157ac0 con 0x7fa070157420 2021-11-12T05:49:07.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.708+0000 7fa0627fc700 1 -- 172.21.2.105:0/3945134701 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa0680138b0 con 0x7fa070157420 2021-11-12T05:49:07.730 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.708+0000 7fa077933700 1 -- 172.21.2.105:0/3945134701 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa07014b0b0 con 0x7fa070157420 2021-11-12T05:49:07.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.712+0000 7fa0627fc700 1 --2- 172.21.2.105:0/3945134701 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa050053640 0x7fa050055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:07.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.712+0000 7fa0627fc700 1 -- 172.21.2.105:0/3945134701 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fa06806b3c0 con 0x7fa070157420 2021-11-12T05:49:07.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.712+0000 7fa0756cf700 1 --2- 172.21.2.105:0/3945134701 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa050053640 0x7fa050055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:07.731 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.712+0000 7fa0756cf700 1 --2- 172.21.2.105:0/3945134701 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa050053640 0x7fa050055b00 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7fa06400b000 tx=0x7fa0700ada20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:07.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.712+0000 7fa0627fc700 1 -- 172.21.2.105:0/3945134701 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa0680423d0 con 0x7fa070157420 2021-11-12T05:49:07.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.796+0000 7fa077933700 1 -- 172.21.2.105:0/3945134701 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0700b1440 con 0x7fa070157420 2021-11-12T05:49:07.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.796+0000 7fa0627fc700 1 -- 172.21.2.105:0/3945134701 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) v1 ==== 74+0+16311 (secure 0 0 0) 0x7fa0680459f0 con 0x7fa070157420 2021-11-12T05:49:07.806 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:07.806 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":134,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:49:07.486328+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:49:05.315585+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-11-12T05:49:06.466127+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:49:07.807 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.796+0000 7fa077933700 1 -- 172.21.2.105:0/3945134701 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa050053640 msgr2=0x7fa050055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:07.807 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.796+0000 7fa077933700 1 --2- 172.21.2.105:0/3945134701 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa050053640 0x7fa050055b00 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7fa06400b000 tx=0x7fa0700ada20).stop 2021-11-12T05:49:07.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.796+0000 7fa077933700 1 -- 172.21.2.105:0/3945134701 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa070157420 msgr2=0x7fa07015a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:07.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.796+0000 7fa077933700 1 --2- 172.21.2.105:0/3945134701 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa070157420 0x7fa07015a180 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 rx=0x7fa064001430 tx=0x7fa068008040).stop 2021-11-12T05:49:07.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.796+0000 7fa077933700 1 -- 172.21.2.105:0/3945134701 shutdown_connections 2021-11-12T05:49:07.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.796+0000 7fa077933700 1 --2- 172.21.2.105:0/3945134701 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa050053640 0x7fa050055b00 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:07.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.796+0000 7fa077933700 1 --2- 172.21.2.105:0/3945134701 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa070157420 0x7fa07015a180 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:07.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.796+0000 7fa077933700 1 --2- 172.21.2.105:0/3945134701 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa07014a060 0x7fa070156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:07.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.796+0000 7fa077933700 1 --2- 172.21.2.105:0/3945134701 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa058004500 0x7fa07014c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:07.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.796+0000 7fa077933700 1 -- 172.21.2.105:0/3945134701 >> 172.21.2.105:0/3945134701 conn(0x7fa0700b5370 msgr2=0x7fa0700b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:07.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.796+0000 7fa077933700 1 -- 172.21.2.105:0/3945134701 shutdown_connections 2021-11-12T05:49:07.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.796+0000 7fa077933700 1 -- 172.21.2.105:0/3945134701 wait complete. 2021-11-12T05:49:07.811 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-12T05:49:07.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.860+0000 7fd3e9854700 1 Processor -- start 2021-11-12T05:49:07.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.860+0000 7fd3e9854700 1 -- start start 2021-11-12T05:49:07.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.860+0000 7fd3e9854700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3e40b7b00 0x7fd3e4140d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:07.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.860+0000 7fd3e9854700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fd3e40ae090 0x7fd3e40b2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:07.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.860+0000 7fd3e9854700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3e40b7ee0 con 0x7fd3e40b2f00 2021-11-12T05:49:07.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.860+0000 7fd3e9854700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3e40b2030 con 0x7fd3e40ae090 2021-11-12T05:49:07.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.860+0000 7fd3e9854700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e40b22d0 con 0x7fd3e40b7b00 2021-11-12T05:49:07.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.860+0000 7fd3e27fc700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fd3e40ae090 0x7fd3e40b2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:07.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.860+0000 7fd3e37fe700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7fd3e40b2f00 0x7fd3e4144390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:60254/0 (socket says 172.21.2.105:60254) 2021-11-12T05:49:07.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.860+0000 7fd3e2ffd700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3e40b7b00 0x7fd3e4140d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:07.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.860+0000 7fd3e37fe700 1 -- 172.21.2.105:0/2670923619 learned_addr learned my addr 172.21.2.105:0/2670923619 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:07.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e2ffd700 1 -- 172.21.2.105:0/2670923619 >> v2:172.21.2.115:3300/0 conn(0x7fd3e40ae090 msgr2=0x7fd3e40b2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:07.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e2ffd700 1 --2- 172.21.2.105:0/2670923619 >> v2:172.21.2.115:3300/0 conn(0x7fd3e40ae090 0x7fd3e40b2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:07.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e2ffd700 1 -- 172.21.2.105:0/2670923619 >> v1:172.21.2.115:6789/0 conn(0x7fd3e40b2f00 legacy=0x7fd3e4144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:07.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e2ffd700 1 -- 172.21.2.105:0/2670923619 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e40b2570 con 0x7fd3e40b7b00 2021-11-12T05:49:07.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e2ffd700 1 --2- 172.21.2.105:0/2670923619 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3e40b7b00 0x7fd3e4140d80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fd3d4002f70 tx=0x7fd3d4006e80).ready entity=mon.2 client_cookie=e83645426524cd0d server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:07.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e1ffb700 1 -- 172.21.2.105:0/2670923619 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3d4012070 con 0x7fd3e40b7b00 2021-11-12T05:49:07.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e1ffb700 1 -- 172.21.2.105:0/2670923619 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d4000e90 con 0x7fd3e40b7b00 2021-11-12T05:49:07.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e1ffb700 1 -- 172.21.2.105:0/2670923619 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3d400f7f0 con 0x7fd3e40b7b00 2021-11-12T05:49:07.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e9854700 1 -- 172.21.2.105:0/2670923619 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3e40b7b00 msgr2=0x7fd3e4140d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:07.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e9854700 1 --2- 172.21.2.105:0/2670923619 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3e40b7b00 0x7fd3e4140d80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fd3d4002f70 tx=0x7fd3d4006e80).stop 2021-11-12T05:49:07.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e9854700 1 -- 172.21.2.105:0/2670923619 shutdown_connections 2021-11-12T05:49:07.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e9854700 1 --2- 172.21.2.105:0/2670923619 >> v2:172.21.2.115:3300/0 conn(0x7fd3e40ae090 0x7fd3e40b2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:07.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e9854700 1 --2- 172.21.2.105:0/2670923619 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3e40b7b00 0x7fd3e4140d80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:07.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e9854700 1 -- 172.21.2.105:0/2670923619 >> 172.21.2.105:0/2670923619 conn(0x7fd3e40608d0 msgr2=0x7fd3e405c490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:07.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e9854700 1 -- 172.21.2.105:0/2670923619 shutdown_connections 2021-11-12T05:49:07.873 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e9854700 1 -- 172.21.2.105:0/2670923619 wait complete. 2021-11-12T05:49:07.875 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e9854700 1 Processor -- start 2021-11-12T05:49:07.875 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e9854700 1 -- start start 2021-11-12T05:49:07.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e9854700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd3e40ae090 0x7fd3e40672b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:07.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e9854700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3e40b2f00 0x7fd3e40b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:07.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e9854700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3e40b7b00 0x7fd3e412aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:07.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e9854700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e41432f0 con 0x7fd3e40b7b00 2021-11-12T05:49:07.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e9854700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e4143590 con 0x7fd3e40ae090 2021-11-12T05:49:07.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e9854700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e4143830 con 0x7fd3e40b2f00 2021-11-12T05:49:07.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e37fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3e40b7b00 0x7fd3e412aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:07.877 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e37fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3e40b7b00 0x7fd3e412aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51394/0 (socket says 172.21.2.105:51394) 2021-11-12T05:49:07.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e37fe700 1 -- 172.21.2.105:0/293702641 learned_addr learned my addr 172.21.2.105:0/293702641 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:07.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e27fc700 1 --2- 172.21.2.105:0/293702641 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3e40b2f00 0x7fd3e40b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:07.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e2ffd700 1 --2- 172.21.2.105:0/293702641 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd3e40ae090 0x7fd3e40672b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:07.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e37fe700 1 -- 172.21.2.105:0/293702641 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3e40b2f00 msgr2=0x7fd3e40b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:07.878 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e37fe700 1 --2- 172.21.2.105:0/293702641 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3e40b2f00 0x7fd3e40b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:07.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e37fe700 1 -- 172.21.2.105:0/293702641 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd3e40ae090 msgr2=0x7fd3e40672b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:07.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e37fe700 1 --2- 172.21.2.105:0/293702641 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd3e40ae090 0x7fd3e40672b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:07.879 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e37fe700 1 -- 172.21.2.105:0/293702641 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d400d590 con 0x7fd3e40b7b00 2021-11-12T05:49:07.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e27fc700 1 --2- 172.21.2.105:0/293702641 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3e40b2f00 0x7fd3e40b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:49:07.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e2ffd700 1 --2- 172.21.2.105:0/293702641 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd3e40ae090 0x7fd3e40672b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:49:07.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e37fe700 1 --2- 172.21.2.105:0/293702641 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3e40b7b00 0x7fd3e412aa70 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7fd3e40ad790 tx=0x7fd3dc007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:07.880 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3d3fff700 1 -- 172.21.2.105:0/293702641 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3dc005ba0 con 0x7fd3e40b7b00 2021-11-12T05:49:07.881 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3d3fff700 1 -- 172.21.2.105:0/293702641 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3dc005d00 con 0x7fd3e40b7b00 2021-11-12T05:49:07.881 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e9854700 1 -- 172.21.2.105:0/293702641 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3e40630c0 con 0x7fd3e40b7b00 2021-11-12T05:49:07.881 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3d3fff700 1 -- 172.21.2.105:0/293702641 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3dc0072c0 con 0x7fd3e40b7b00 2021-11-12T05:49:07.881 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.864+0000 7fd3e9854700 1 -- 172.21.2.105:0/293702641 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3e40b16e0 con 0x7fd3e40b7b00 2021-11-12T05:49:07.882 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.868+0000 7fd3e9854700 1 -- 172.21.2.105:0/293702641 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3e41439f0 con 0x7fd3e40b7b00 2021-11-12T05:49:07.882 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.868+0000 7fd3d3fff700 1 -- 172.21.2.105:0/293702641 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd3dc010070 con 0x7fd3e40b7b00 2021-11-12T05:49:07.882 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.868+0000 7fd3d3fff700 1 --2- 172.21.2.105:0/293702641 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd3c00536a0 0x7fd3c0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:07.882 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.868+0000 7fd3d3fff700 1 -- 172.21.2.105:0/293702641 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fd3dc06b4b0 con 0x7fd3e40b7b00 2021-11-12T05:49:07.882 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.868+0000 7fd3e2ffd700 1 --2- 172.21.2.105:0/293702641 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd3c00536a0 0x7fd3c0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:07.883 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.868+0000 7fd3e2ffd700 1 --2- 172.21.2.105:0/293702641 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd3c00536a0 0x7fd3c0055b60 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7fd3d4018000 tx=0x7fd3e41412a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:07.883 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.868+0000 7fd3d3fff700 1 -- 172.21.2.105:0/293702641 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd3dc0423b0 con 0x7fd3e40b7b00 2021-11-12T05:49:07.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:07.980+0000 7fd3e9854700 1 -- 172.21.2.105:0/293702641 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd3e4057350 con 0x7fd3e40b7b00 2021-11-12T05:49:08.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.496+0000 7fd3d3fff700 1 -- 172.21.2.105:0/293702641 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v65) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd3dc0459d0 con 0x7fd3e40b7b00 2021-11-12T05:49:08.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.496+0000 7fd3e9854700 1 -- 172.21.2.105:0/293702641 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd3c00536a0 msgr2=0x7fd3c0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:08.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.496+0000 7fd3e9854700 1 --2- 172.21.2.105:0/293702641 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd3c00536a0 0x7fd3c0055b60 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7fd3d4018000 tx=0x7fd3e41412a0).stop 2021-11-12T05:49:08.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.496+0000 7fd3e9854700 1 -- 172.21.2.105:0/293702641 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3e40b7b00 msgr2=0x7fd3e412aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:08.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.496+0000 7fd3e9854700 1 --2- 172.21.2.105:0/293702641 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3e40b7b00 0x7fd3e412aa70 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7fd3e40ad790 tx=0x7fd3dc007f10).stop 2021-11-12T05:49:08.503 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.496+0000 7fd3e9854700 1 -- 172.21.2.105:0/293702641 shutdown_connections 2021-11-12T05:49:08.503 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.496+0000 7fd3e9854700 1 --2- 172.21.2.105:0/293702641 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd3c00536a0 0x7fd3c0055b60 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:08.503 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.496+0000 7fd3e9854700 1 --2- 172.21.2.105:0/293702641 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3e40b7b00 0x7fd3e412aa70 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:08.503 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.496+0000 7fd3e9854700 1 --2- 172.21.2.105:0/293702641 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3e40b2f00 0x7fd3e40b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:08.504 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.496+0000 7fd3e9854700 1 --2- 172.21.2.105:0/293702641 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd3e40ae090 0x7fd3e40672b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:08.504 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.496+0000 7fd3e9854700 1 -- 172.21.2.105:0/293702641 >> 172.21.2.105:0/293702641 conn(0x7fd3e40608d0 msgr2=0x7fd3e40b4160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:08.504 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.496+0000 7fd3e9854700 1 -- 172.21.2.105:0/293702641 shutdown_connections 2021-11-12T05:49:08.504 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.496+0000 7fd3e9854700 1 -- 172.21.2.105:0/293702641 wait complete. 2021-11-12T05:49:08.509 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:49:08.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.556+0000 7f2f0359e700 1 Processor -- start 2021-11-12T05:49:08.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.556+0000 7f2f0359e700 1 -- start start 2021-11-12T05:49:08.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.556+0000 7f2f0359e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2f040b1cf0 0x7f2f040601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:08.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.556+0000 7f2f0359e700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f04063030 con 0x7f2f040ae2a0 2021-11-12T05:49:08.563 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.556+0000 7f2f0359e700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f04063290 con 0x7f2f0405fdc0 2021-11-12T05:49:08.563 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.556+0000 7f2f0359e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f04061650 con 0x7f2f040b1cf0 2021-11-12T05:49:08.569 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.556+0000 7f2f01d9b700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f2f040ae2a0 0x7f2f041436a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:33566/0 (socket says 172.21.2.105:33566) 2021-11-12T05:49:08.569 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.556+0000 7f2f01d9b700 1 -- 172.21.2.105:0/46480495 learned_addr learned my addr 172.21.2.105:0/46480495 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:08.570 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.556+0000 7f2f0159a700 1 -- 172.21.2.105:0/46480495 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 76803894 0 0) 0x7f2f04063030 con 0x7f2f040ae2a0 2021-11-12T05:49:08.570 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.556+0000 7f2f0159a700 1 -- 172.21.2.105:0/46480495 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ee8003260 con 0x7f2f040ae2a0 2021-11-12T05:49:08.570 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.556+0000 7f2f02d9d700 1 --2- 172.21.2.105:0/46480495 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2f040b1cf0 0x7f2f040601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:08.570 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.556+0000 7f2f0159a700 1 -- 172.21.2.105:0/46480495 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 136809789 0 0) 0x7f2ee8003260 con 0x7f2f040ae2a0 2021-11-12T05:49:08.571 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.556+0000 7f2f0159a700 1 -- 172.21.2.105:0/46480495 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2f040b1cf0 msgr2=0x7f2f040601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:08.571 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.556+0000 7f2f0159a700 1 --2- 172.21.2.105:0/46480495 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2f040b1cf0 0x7f2f040601a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:08.571 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.556+0000 7f2f0159a700 1 -- 172.21.2.105:0/46480495 >> v1:172.21.2.115:6789/0 conn(0x7f2f0405fdc0 legacy=0x7f2f04144430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:08.571 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.556+0000 7f2f0159a700 1 -- 172.21.2.105:0/46480495 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f04143200 con 0x7f2f040ae2a0 2021-11-12T05:49:08.571 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.556+0000 7f2f0159a700 1 -- 172.21.2.105:0/46480495 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f2ef8001660 con 0x7f2f040ae2a0 2021-11-12T05:49:08.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.556+0000 7f2f0159a700 1 -- 172.21.2.105:0/46480495 >> v1:172.21.2.105:6789/0 conn(0x7f2f040ae2a0 legacy=0x7f2f041436a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:08.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.556+0000 7f2f0159a700 1 --2- 172.21.2.105:0/46480495 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2f040b1cf0 0x7f2ee8003780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:08.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.556+0000 7f2f0159a700 1 --2- 172.21.2.105:0/46480495 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ee8003d40 0x7f2ee8004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:08.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.556+0000 7f2f0159a700 1 --2- 172.21.2.105:0/46480495 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2ee80049f0 0x7f2ee8004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:08.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.556+0000 7f2f0159a700 1 -- 172.21.2.105:0/46480495 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee800b850 con 0x7f2ee8003d40 2021-11-12T05:49:08.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.556+0000 7f2f0159a700 1 -- 172.21.2.105:0/46480495 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee800b9c0 con 0x7f2ee80049f0 2021-11-12T05:49:08.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.556+0000 7f2f0159a700 1 -- 172.21.2.105:0/46480495 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee800bb80 con 0x7f2f040b1cf0 2021-11-12T05:49:08.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.556+0000 7f2f01d9b700 1 --2- 172.21.2.105:0/46480495 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ee8003d40 0x7f2ee8004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:08.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f01d9b700 1 -- 172.21.2.105:0/46480495 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2f040b1cf0 msgr2=0x7f2ee8003780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:08.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f01d9b700 1 --2- 172.21.2.105:0/46480495 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2f040b1cf0 0x7f2ee8003780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:08.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f01d9b700 1 -- 172.21.2.105:0/46480495 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2ee80049f0 msgr2=0x7f2ee8004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:08.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f01d9b700 1 --2- 172.21.2.105:0/46480495 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2ee80049f0 0x7f2ee8004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:08.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f01d9b700 1 -- 172.21.2.105:0/46480495 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee8003260 con 0x7f2ee8003d40 2021-11-12T05:49:08.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f01d9b700 1 --2- 172.21.2.105:0/46480495 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ee8003d40 0x7f2ee8004500 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 rx=0x7f2f04061060 tx=0x7f2f04063420).ready entity=mon.0 client_cookie=ec9c81a07b965ebc server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:08.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f0159a700 1 -- 172.21.2.105:0/46480495 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ef80071a0 con 0x7f2ee8003d40 2021-11-12T05:49:08.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f0159a700 1 -- 172.21.2.105:0/46480495 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef8007300 con 0x7f2ee8003d40 2021-11-12T05:49:08.575 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f0159a700 1 -- 172.21.2.105:0/46480495 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ef800cae0 con 0x7f2ee8003d40 2021-11-12T05:49:08.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f0359e700 1 -- 172.21.2.105:0/46480495 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ee8003d40 msgr2=0x7f2ee8004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:08.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f0359e700 1 --2- 172.21.2.105:0/46480495 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ee8003d40 0x7f2ee8004500 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 rx=0x7f2f04061060 tx=0x7f2f04063420).stop 2021-11-12T05:49:08.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f02d9d700 1 -- 172.21.2.105:0/46480495 reap_dead start 2021-11-12T05:49:08.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f0359e700 1 -- 172.21.2.105:0/46480495 shutdown_connections 2021-11-12T05:49:08.576 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f0359e700 1 -- 172.21.2.105:0/46480495 >> 172.21.2.105:0/46480495 conn(0x7f2f040608d0 msgr2=0x7f2f0405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:08.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f0359e700 1 -- 172.21.2.105:0/46480495 shutdown_connections 2021-11-12T05:49:08.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f0359e700 1 -- 172.21.2.105:0/46480495 wait complete. 2021-11-12T05:49:08.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f0359e700 1 Processor -- start 2021-11-12T05:49:08.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f0359e700 1 -- start start 2021-11-12T05:49:08.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f0359e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ee8003d40 0x7f2f04145210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:08.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f0359e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2f040aece0 0x7f2f04066200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:08.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f0359e700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2f04064810 0x7f2f040666f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:08.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f0359e700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f040b0f10 con 0x7f2ee8003d40 2021-11-12T05:49:08.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f0359e700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f04065820 con 0x7f2f04064810 2021-11-12T05:49:08.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f0359e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f04065ac0 con 0x7f2f040aece0 2021-11-12T05:49:08.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f0259c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ee8003d40 0x7f2f04145210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:08.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f0259c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ee8003d40 0x7f2f04145210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51410/0 (socket says 172.21.2.105:51410) 2021-11-12T05:49:08.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f0259c700 1 -- 172.21.2.105:0/1239936536 learned_addr learned my addr 172.21.2.105:0/1239936536 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:08.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f01d9b700 1 --2- 172.21.2.105:0/1239936536 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2f040aece0 0x7f2f04066200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:08.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f02d9d700 1 --2- 172.21.2.105:0/1239936536 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2f04064810 0x7f2f040666f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:08.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f0259c700 1 -- 172.21.2.105:0/1239936536 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2f040aece0 msgr2=0x7f2f04066200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:08.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f0259c700 1 --2- 172.21.2.105:0/1239936536 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2f040aece0 0x7f2f04066200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:08.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f0259c700 1 -- 172.21.2.105:0/1239936536 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2f04064810 msgr2=0x7f2f040666f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:08.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f0259c700 1 --2- 172.21.2.105:0/1239936536 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2f04064810 0x7f2f040666f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:08.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f0259c700 1 -- 172.21.2.105:0/1239936536 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f04065d60 con 0x7f2ee8003d40 2021-11-12T05:49:08.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f02d9d700 1 --2- 172.21.2.105:0/1239936536 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2f04064810 0x7f2f040666f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:49:08.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f0259c700 1 --2- 172.21.2.105:0/1239936536 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ee8003d40 0x7f2f04145210 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7f2efc0012f0 tx=0x7f2efc0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:08.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2ef37fe700 1 -- 172.21.2.105:0/1239936536 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2efc001540 con 0x7f2ee8003d40 2021-11-12T05:49:08.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2ef37fe700 1 -- 172.21.2.105:0/1239936536 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2efc0016a0 con 0x7f2ee8003d40 2021-11-12T05:49:08.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f0359e700 1 -- 172.21.2.105:0/1239936536 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f040670b0 con 0x7f2ee8003d40 2021-11-12T05:49:08.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2ef37fe700 1 -- 172.21.2.105:0/1239936536 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2efc001a00 con 0x7f2ee8003d40 2021-11-12T05:49:08.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f0359e700 1 -- 172.21.2.105:0/1239936536 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f040ae7d0 con 0x7f2ee8003d40 2021-11-12T05:49:08.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.560+0000 7f2f0359e700 1 -- 172.21.2.105:0/1239936536 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f04065ef0 con 0x7f2ee8003d40 2021-11-12T05:49:08.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.564+0000 7f2ef37fe700 1 -- 172.21.2.105:0/1239936536 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2efc018030 con 0x7f2ee8003d40 2021-11-12T05:49:08.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.564+0000 7f2ef37fe700 1 --2- 172.21.2.105:0/1239936536 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2ee0053610 0x7f2ee0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:08.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.564+0000 7f2ef37fe700 1 -- 172.21.2.105:0/1239936536 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f2efc06b4b0 con 0x7f2ee8003d40 2021-11-12T05:49:08.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.564+0000 7f2f01d9b700 1 --2- 172.21.2.105:0/1239936536 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2ee0053610 0x7f2ee0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:08.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.564+0000 7f2f01d9b700 1 --2- 172.21.2.105:0/1239936536 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2ee0053610 0x7f2ee0055ad0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f2ef801a000 tx=0x7f2ef8013000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:08.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.564+0000 7f2ef37fe700 1 -- 172.21.2.105:0/1239936536 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2efc0424d0 con 0x7f2ee8003d40 2021-11-12T05:49:08.680 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.676+0000 7f2f0359e700 1 -- 172.21.2.105:0/1239936536 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f04142f20 con 0x7f2ee8003d40 2021-11-12T05:49:08.681 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.676+0000 7f2ef37fe700 1 -- 172.21.2.105:0/1239936536 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f2efc045af0 con 0x7f2ee8003d40 2021-11-12T05:49:08.681 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:08.682 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":65,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4979,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/2405231908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":2405231908},{"type":"v1","addr":"172.21.2.115:6833","nonce":2405231908}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":63}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:49:07.486433+0000","modified":"2021-11-12T05:49:08.490302+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8115},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8115":{"gid":8115,"name":"a","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/737863904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":737863904},{"type":"v1","addr":"172.21.2.105:6835","nonce":737863904}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-11-12T05:49:08.683 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.676+0000 7f2f0359e700 1 -- 172.21.2.105:0/1239936536 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2ee0053610 msgr2=0x7f2ee0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:08.683 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.676+0000 7f2f0359e700 1 --2- 172.21.2.105:0/1239936536 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2ee0053610 0x7f2ee0055ad0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f2ef801a000 tx=0x7f2ef8013000).stop 2021-11-12T05:49:08.683 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.676+0000 7f2f0359e700 1 -- 172.21.2.105:0/1239936536 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ee8003d40 msgr2=0x7f2f04145210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:08.683 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.676+0000 7f2f0359e700 1 --2- 172.21.2.105:0/1239936536 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ee8003d40 0x7f2f04145210 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7f2efc0012f0 tx=0x7f2efc0091d0).stop 2021-11-12T05:49:08.684 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.676+0000 7f2f0359e700 1 -- 172.21.2.105:0/1239936536 shutdown_connections 2021-11-12T05:49:08.684 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.676+0000 7f2f0359e700 1 --2- 172.21.2.105:0/1239936536 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2ee0053610 0x7f2ee0055ad0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:08.684 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.676+0000 7f2f0359e700 1 --2- 172.21.2.105:0/1239936536 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2f04064810 0x7f2f040666f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:08.684 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.676+0000 7f2f0359e700 1 --2- 172.21.2.105:0/1239936536 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2f040aece0 0x7f2f04066200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:08.684 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.676+0000 7f2f0359e700 1 --2- 172.21.2.105:0/1239936536 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2ee8003d40 0x7f2f04145210 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:08.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.676+0000 7f2f0359e700 1 -- 172.21.2.105:0/1239936536 >> 172.21.2.105:0/1239936536 conn(0x7f2f040608d0 msgr2=0x7f2f040b6750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:08.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.676+0000 7f2f0359e700 1 -- 172.21.2.105:0/1239936536 shutdown_connections 2021-11-12T05:49:08.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.676+0000 7f2f0359e700 1 -- 172.21.2.105:0/1239936536 wait complete. 2021-11-12T05:49:08.685 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 65 2021-11-12T05:49:08.688 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:49:08.738 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.732+0000 7f7127c21700 1 Processor -- start 2021-11-12T05:49:08.739 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.732+0000 7f7127c21700 1 -- start start 2021-11-12T05:49:08.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f7127c21700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f71200ade80 0x7f7120143670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:08.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f7127c21700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7120143b60 0x7f7120140140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:08.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f7127c21700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71200604e0 con 0x7f7120060100 2021-11-12T05:49:08.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f7127c21700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71200b1a70 con 0x7f71200ade80 2021-11-12T05:49:08.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f7127c21700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7120062ee0 con 0x7f7120143b60 2021-11-12T05:49:08.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f71259bd700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f7120060100 0x7f71200b29d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:33582/0 (socket says 172.21.2.105:33582) 2021-11-12T05:49:08.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f71259bd700 1 -- 172.21.2.105:0/269682882 learned_addr learned my addr 172.21.2.105:0/269682882 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:08.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f71249bb700 1 -- 172.21.2.105:0/269682882 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3128397971 0 0) 0x7f71200604e0 con 0x7f7120060100 2021-11-12T05:49:08.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f71249bb700 1 -- 172.21.2.105:0/269682882 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7108003260 con 0x7f7120060100 2021-11-12T05:49:08.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f71249bb700 1 -- 172.21.2.105:0/269682882 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 893713839 0 0) 0x7f7108003260 con 0x7f7120060100 2021-11-12T05:49:08.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f71249bb700 1 -- 172.21.2.105:0/269682882 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7120143b60 msgr2=0x7f7120140140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:08.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f71249bb700 1 --2- 172.21.2.105:0/269682882 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7120143b60 0x7f7120140140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:08.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f71249bb700 1 -- 172.21.2.105:0/269682882 >> v2:172.21.2.115:3300/0 conn(0x7f71200ade80 msgr2=0x7f7120143670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:08.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f71249bb700 1 --2- 172.21.2.105:0/269682882 >> v2:172.21.2.115:3300/0 conn(0x7f71200ade80 0x7f7120143670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:08.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f71249bb700 1 -- 172.21.2.105:0/269682882 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7120063180 con 0x7f7120060100 2021-11-12T05:49:08.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f71249bb700 1 -- 172.21.2.105:0/269682882 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f711c001660 con 0x7f7120060100 2021-11-12T05:49:08.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f71249bb700 1 -- 172.21.2.105:0/269682882 >> v1:172.21.2.105:6789/0 conn(0x7f7120060100 legacy=0x7f71200b29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:08.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f71249bb700 1 --2- 172.21.2.105:0/269682882 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7120143b60 0x7f71080037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:08.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f71249bb700 1 --2- 172.21.2.105:0/269682882 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7108003ee0 0x7f7108004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:08.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f71249bb700 1 --2- 172.21.2.105:0/269682882 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7108004bf0 0x7f710800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:08.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f71249bb700 1 -- 172.21.2.105:0/269682882 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71200b1a70 con 0x7f7108004bf0 2021-11-12T05:49:08.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f71249bb700 1 -- 172.21.2.105:0/269682882 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7120062ee0 con 0x7f7108003ee0 2021-11-12T05:49:08.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f71249bb700 1 -- 172.21.2.105:0/269682882 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71080053a0 con 0x7f7120143b60 2021-11-12T05:49:08.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f71261be700 1 --2- 172.21.2.105:0/269682882 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7108004bf0 0x7f710800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:08.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f71251bc700 1 --2- 172.21.2.105:0/269682882 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7108003ee0 0x7f7108004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:08.750 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f71259bd700 1 --2- 172.21.2.105:0/269682882 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7120143b60 0x7f71080037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:08.750 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f71261be700 1 -- 172.21.2.105:0/269682882 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7120143b60 msgr2=0x7f71080037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:08.750 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f71261be700 1 --2- 172.21.2.105:0/269682882 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7120143b60 0x7f71080037d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:08.750 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f71261be700 1 -- 172.21.2.105:0/269682882 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7108003ee0 msgr2=0x7f7108004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:08.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f71261be700 1 --2- 172.21.2.105:0/269682882 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7108003ee0 0x7f7108004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:08.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f71261be700 1 -- 172.21.2.105:0/269682882 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7108003260 con 0x7f7108004bf0 2021-11-12T05:49:08.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f71261be700 1 --2- 172.21.2.105:0/269682882 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7108004bf0 0x7f710800b750 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 rx=0x7f71180032f0 tx=0x7f7118006f90).ready entity=mon.0 client_cookie=b6582e4bd5310e4 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:08.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f71249bb700 1 -- 172.21.2.105:0/269682882 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f711800b460 con 0x7f7108004bf0 2021-11-12T05:49:08.752 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f71249bb700 1 -- 172.21.2.105:0/269682882 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711800b5c0 con 0x7f7108004bf0 2021-11-12T05:49:08.752 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f71249bb700 1 -- 172.21.2.105:0/269682882 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f711800b920 con 0x7f7108004bf0 2021-11-12T05:49:08.752 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f7127c21700 1 -- 172.21.2.105:0/269682882 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7108004bf0 msgr2=0x7f710800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:08.752 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f7127c21700 1 --2- 172.21.2.105:0/269682882 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7108004bf0 0x7f710800b750 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 rx=0x7f71180032f0 tx=0x7f7118006f90).stop 2021-11-12T05:49:08.752 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f71261be700 1 -- 172.21.2.105:0/269682882 reap_dead start 2021-11-12T05:49:08.753 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f7127c21700 1 -- 172.21.2.105:0/269682882 shutdown_connections 2021-11-12T05:49:08.753 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f7127c21700 1 -- 172.21.2.105:0/269682882 >> 172.21.2.105:0/269682882 conn(0x7f71200608d0 msgr2=0x7f712005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:08.753 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f7127c21700 1 -- 172.21.2.105:0/269682882 shutdown_connections 2021-11-12T05:49:08.753 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f7127c21700 1 -- 172.21.2.105:0/269682882 wait complete. 2021-11-12T05:49:08.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f7127c21700 1 Processor -- start 2021-11-12T05:49:08.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.736+0000 7f7127c21700 1 -- start start 2021-11-12T05:49:08.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.740+0000 7f7127c21700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7108004bf0 0x7f71200651c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:08.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.740+0000 7f7127c21700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71200656b0 0x7f71201524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:08.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.740+0000 7f7127c21700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f71200b5bc0 0x7f71201529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:08.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.740+0000 7f7127c21700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71200b0d40 con 0x7f71200656b0 2021-11-12T05:49:08.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.740+0000 7f7127c21700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7120153070 con 0x7f7108004bf0 2021-11-12T05:49:08.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.740+0000 7f7127c21700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7120065df0 con 0x7f71200b5bc0 2021-11-12T05:49:08.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.740+0000 7f71251bc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71200656b0 0x7f71201524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:08.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.740+0000 7f71251bc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71200656b0 0x7f71201524e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51430/0 (socket says 172.21.2.105:51430) 2021-11-12T05:49:08.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.740+0000 7f71251bc700 1 -- 172.21.2.105:0/404778778 learned_addr learned my addr 172.21.2.105:0/404778778 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:08.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.740+0000 7f71259bd700 1 --2- 172.21.2.105:0/404778778 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7108004bf0 0x7f71200651c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:08.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.740+0000 7f71261be700 1 --2- 172.21.2.105:0/404778778 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f71200b5bc0 0x7f71201529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:08.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.740+0000 7f71251bc700 1 -- 172.21.2.105:0/404778778 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f71200b5bc0 msgr2=0x7f71201529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:08.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.740+0000 7f71251bc700 1 --2- 172.21.2.105:0/404778778 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f71200b5bc0 0x7f71201529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:08.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.740+0000 7f71251bc700 1 -- 172.21.2.105:0/404778778 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7108004bf0 msgr2=0x7f71200651c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:08.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.740+0000 7f71251bc700 1 --2- 172.21.2.105:0/404778778 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7108004bf0 0x7f71200651c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:08.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.740+0000 7f71251bc700 1 -- 172.21.2.105:0/404778778 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7120065b50 con 0x7f71200656b0 2021-11-12T05:49:08.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.740+0000 7f71251bc700 1 --2- 172.21.2.105:0/404778778 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71200656b0 0x7f71201524e0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7f711400a000 tx=0x7f7114008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:08.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.740+0000 7f7112ffd700 1 -- 172.21.2.105:0/404778778 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71140145f0 con 0x7f71200656b0 2021-11-12T05:49:08.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.740+0000 7f7112ffd700 1 -- 172.21.2.105:0/404778778 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711400f040 con 0x7f71200656b0 2021-11-12T05:49:08.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.740+0000 7f7127c21700 1 -- 172.21.2.105:0/404778778 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71200b57c0 con 0x7f71200656b0 2021-11-12T05:49:08.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.740+0000 7f7127c21700 1 -- 172.21.2.105:0/404778778 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71200b6480 con 0x7f71200656b0 2021-11-12T05:49:08.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.740+0000 7f7112ffd700 1 -- 172.21.2.105:0/404778778 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7114014940 con 0x7f71200656b0 2021-11-12T05:49:08.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.740+0000 7f7127c21700 1 -- 172.21.2.105:0/404778778 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7120152ec0 con 0x7f71200656b0 2021-11-12T05:49:08.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.740+0000 7f7112ffd700 1 -- 172.21.2.105:0/404778778 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f711401a020 con 0x7f71200656b0 2021-11-12T05:49:08.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.740+0000 7f7112ffd700 1 --2- 172.21.2.105:0/404778778 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7100053720 0x7f7100055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:08.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.740+0000 7f7112ffd700 1 -- 172.21.2.105:0/404778778 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f711406b3f0 con 0x7f71200656b0 2021-11-12T05:49:08.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.740+0000 7f71259bd700 1 --2- 172.21.2.105:0/404778778 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7100053720 0x7f7100055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:08.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.740+0000 7f71259bd700 1 --2- 172.21.2.105:0/404778778 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7100053720 0x7f7100055be0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f711c00c000 tx=0x7f711c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:08.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.744+0000 7f7112ffd700 1 -- 172.21.2.105:0/404778778 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f71140422f0 con 0x7f71200656b0 2021-11-12T05:49:08.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.824+0000 7f7127c21700 1 -- 172.21.2.105:0/404778778 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7120142f30 con 0x7f71200656b0 2021-11-12T05:49:08.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.824+0000 7f7112ffd700 1 -- 172.21.2.105:0/404778778 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+16298 (secure 0 0 0) 0x7f7114045910 con 0x7f71200656b0 2021-11-12T05:49:08.831 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:08.831 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":135,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:49:08.491475+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:49:05.315585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-11-12T05:49:06.466127+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:49:08.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.828+0000 7f7127c21700 1 -- 172.21.2.105:0/404778778 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7100053720 msgr2=0x7f7100055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:08.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.828+0000 7f7127c21700 1 --2- 172.21.2.105:0/404778778 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7100053720 0x7f7100055be0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f711c00c000 tx=0x7f711c009040).stop 2021-11-12T05:49:08.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.828+0000 7f7127c21700 1 -- 172.21.2.105:0/404778778 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71200656b0 msgr2=0x7f71201524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:08.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.828+0000 7f7127c21700 1 --2- 172.21.2.105:0/404778778 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71200656b0 0x7f71201524e0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7f711400a000 tx=0x7f7114008040).stop 2021-11-12T05:49:08.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.828+0000 7f7127c21700 1 -- 172.21.2.105:0/404778778 shutdown_connections 2021-11-12T05:49:08.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.828+0000 7f7127c21700 1 --2- 172.21.2.105:0/404778778 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7100053720 0x7f7100055be0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:08.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.828+0000 7f7127c21700 1 --2- 172.21.2.105:0/404778778 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f71200b5bc0 0x7f71201529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:08.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.828+0000 7f7127c21700 1 --2- 172.21.2.105:0/404778778 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f71200656b0 0x7f71201524e0 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:08.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.828+0000 7f7127c21700 1 --2- 172.21.2.105:0/404778778 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7108004bf0 0x7f71200651c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:08.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.828+0000 7f7127c21700 1 -- 172.21.2.105:0/404778778 >> 172.21.2.105:0/404778778 conn(0x7f71200608d0 msgr2=0x7f712013d250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:08.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.828+0000 7f7127c21700 1 -- 172.21.2.105:0/404778778 shutdown_connections 2021-11-12T05:49:08.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.828+0000 7f7127c21700 1 -- 172.21.2.105:0/404778778 wait complete. 2021-11-12T05:49:08.839 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-12T05:49:08.935 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd605aa3700 1 Processor -- start 2021-11-12T05:49:08.936 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd605aa3700 1 -- start start 2021-11-12T05:49:08.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd605aa3700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd6000ad080 0x7fd6000af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:08.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd605aa3700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6000ac280 0x7fd6000ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:08.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd605aa3700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fd60014abe0 0x7fd60014b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:08.938 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd605aa3700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6001488a0 con 0x7fd6000ad080 2021-11-12T05:49:08.938 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd605aa3700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6000ac7b0 con 0x7fd60014abe0 2021-11-12T05:49:08.938 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd605aa3700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6000ac9e0 con 0x7fd6000ac280 2021-11-12T05:49:08.938 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd5ff7fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd6000ad080 0x7fd6000af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:08.939 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd5ff7fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd6000ad080 0x7fd6000af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51438/0 (socket says 172.21.2.105:51438) 2021-11-12T05:49:08.939 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd5ff7fe700 1 -- 172.21.2.105:0/2180562975 learned_addr learned my addr 172.21.2.105:0/2180562975 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:08.939 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd5ff7fe700 1 -- 172.21.2.105:0/2180562975 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6000ac280 msgr2=0x7fd6000ad460 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:49:08.939 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd5ff7fe700 1 --2- 172.21.2.105:0/2180562975 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6000ac280 0x7fd6000ad460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:08.939 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd5ff7fe700 1 -- 172.21.2.105:0/2180562975 >> v2:172.21.2.115:3300/0 conn(0x7fd60014abe0 msgr2=0x7fd60014b090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:49:08.940 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd5ff7fe700 1 --2- 172.21.2.105:0/2180562975 >> v2:172.21.2.115:3300/0 conn(0x7fd60014abe0 0x7fd60014b090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:08.940 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd5ff7fe700 1 -- 172.21.2.105:0/2180562975 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6000b0b30 con 0x7fd6000ad080 2021-11-12T05:49:08.940 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd5ff7fe700 1 --2- 172.21.2.105:0/2180562975 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6000ad080 0x7fd6000af730 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 rx=0x7fd6000ac6a0 tx=0x7fd5e8006eb0).ready entity=mon.0 client_cookie=510732299ac11635 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:08.940 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd5fe7fc700 1 -- 172.21.2.105:0/2180562975 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5e800d570 con 0x7fd6000ad080 2021-11-12T05:49:08.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd5fe7fc700 1 -- 172.21.2.105:0/2180562975 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e8000e90 con 0x7fd6000ad080 2021-11-12T05:49:08.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd5fe7fc700 1 -- 172.21.2.105:0/2180562975 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5e800d8c0 con 0x7fd6000ad080 2021-11-12T05:49:08.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd605aa3700 1 -- 172.21.2.105:0/2180562975 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6000ad080 msgr2=0x7fd6000af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:08.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd605aa3700 1 --2- 172.21.2.105:0/2180562975 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6000ad080 0x7fd6000af730 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 rx=0x7fd6000ac6a0 tx=0x7fd5e8006eb0).stop 2021-11-12T05:49:08.942 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd605aa3700 1 -- 172.21.2.105:0/2180562975 shutdown_connections 2021-11-12T05:49:08.942 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd605aa3700 1 --2- 172.21.2.105:0/2180562975 >> v2:172.21.2.115:3300/0 conn(0x7fd60014abe0 0x7fd60014b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:08.942 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd605aa3700 1 --2- 172.21.2.105:0/2180562975 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6000ac280 0x7fd6000ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:08.942 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd605aa3700 1 --2- 172.21.2.105:0/2180562975 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd6000ad080 0x7fd6000af730 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:08.942 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd605aa3700 1 -- 172.21.2.105:0/2180562975 >> 172.21.2.105:0/2180562975 conn(0x7fd6000b5370 msgr2=0x7fd6000b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:08.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd605aa3700 1 -- 172.21.2.105:0/2180562975 shutdown_connections 2021-11-12T05:49:08.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd605aa3700 1 -- 172.21.2.105:0/2180562975 wait complete. 2021-11-12T05:49:08.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd605aa3700 1 Processor -- start 2021-11-12T05:49:08.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd605aa3700 1 -- start start 2021-11-12T05:49:08.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd605aa3700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd6000ac280 0x7fd6000aac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:08.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd605aa3700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6000ad080 0x7fd600157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:08.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd605aa3700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd60014abe0 0x7fd6000ab500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:08.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd605aa3700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6000a96b0 con 0x7fd60014abe0 2021-11-12T05:49:08.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd605aa3700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6000a9950 con 0x7fd6000ac280 2021-11-12T05:49:08.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd605aa3700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6000a9bf0 con 0x7fd6000ad080 2021-11-12T05:49:08.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd5fffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd60014abe0 0x7fd6000ab500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:08.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd5fffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd60014abe0 0x7fd6000ab500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51446/0 (socket says 172.21.2.105:51446) 2021-11-12T05:49:08.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.932+0000 7fd5fffff700 1 -- 172.21.2.105:0/4251537975 learned_addr learned my addr 172.21.2.105:0/4251537975 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:08.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.936+0000 7fd5fffff700 1 -- 172.21.2.105:0/4251537975 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6000ad080 msgr2=0x7fd600157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:08.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.936+0000 7fd5fffff700 1 --2- 172.21.2.105:0/4251537975 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6000ad080 0x7fd600157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:08.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.936+0000 7fd5fffff700 1 -- 172.21.2.105:0/4251537975 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd6000ac280 msgr2=0x7fd6000aac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:08.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.936+0000 7fd5fffff700 1 --2- 172.21.2.105:0/4251537975 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd6000ac280 0x7fd6000aac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:08.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.936+0000 7fd5fffff700 1 -- 172.21.2.105:0/4251537975 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e800b1e0 con 0x7fd60014abe0 2021-11-12T05:49:08.950 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.936+0000 7fd5fffff700 1 --2- 172.21.2.105:0/4251537975 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd60014abe0 0x7fd6000ab500 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7fd5f8001250 tx=0x7fd5f80090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:08.950 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.936+0000 7fd5fcff9700 1 -- 172.21.2.105:0/4251537975 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5f80014e0 con 0x7fd60014abe0 2021-11-12T05:49:08.950 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.936+0000 7fd5fcff9700 1 -- 172.21.2.105:0/4251537975 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f8001640 con 0x7fd60014abe0 2021-11-12T05:49:08.950 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.936+0000 7fd605aa3700 1 -- 172.21.2.105:0/4251537975 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6000ab9f0 con 0x7fd60014abe0 2021-11-12T05:49:08.950 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.936+0000 7fd5fcff9700 1 -- 172.21.2.105:0/4251537975 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5f80019a0 con 0x7fd60014abe0 2021-11-12T05:49:08.951 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.936+0000 7fd605aa3700 1 -- 172.21.2.105:0/4251537975 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6000a7020 con 0x7fd60014abe0 2021-11-12T05:49:08.951 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.936+0000 7fd605aa3700 1 -- 172.21.2.105:0/4251537975 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd600157b30 con 0x7fd60014abe0 2021-11-12T05:49:08.951 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.936+0000 7fd5fcff9700 1 -- 172.21.2.105:0/4251537975 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd5f8018030 con 0x7fd60014abe0 2021-11-12T05:49:08.951 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.936+0000 7fd5fcff9700 1 --2- 172.21.2.105:0/4251537975 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd5e40536a0 0x7fd5e4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:08.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.936+0000 7fd5fcff9700 1 -- 172.21.2.105:0/4251537975 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fd5f806b3b0 con 0x7fd60014abe0 2021-11-12T05:49:08.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.936+0000 7fd5ff7fe700 1 --2- 172.21.2.105:0/4251537975 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd5e40536a0 0x7fd5e4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:08.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.936+0000 7fd5ff7fe700 1 --2- 172.21.2.105:0/4251537975 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd5e40536a0 0x7fd5e4055b60 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7fd6000ac6a0 tx=0x7fd5e8015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:08.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:08.940+0000 7fd5fcff9700 1 -- 172.21.2.105:0/4251537975 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd5f8042470 con 0x7fd60014abe0 2021-11-12T05:49:09.052 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.048+0000 7fd605aa3700 1 -- 172.21.2.105:0/4251537975 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fd60014b580 con 0x7fd60014abe0 2021-11-12T05:49:09.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.052+0000 7fd5fcff9700 1 -- 172.21.2.105:0/4251537975 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v41) v1 ==== 184+0+0 (secure 0 0 0) 0x7fd5f8045a90 con 0x7fd60014abe0 2021-11-12T05:49:09.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.052+0000 7fd605aa3700 1 -- 172.21.2.105:0/4251537975 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd5e40536a0 msgr2=0x7fd5e4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:09.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.052+0000 7fd605aa3700 1 --2- 172.21.2.105:0/4251537975 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd5e40536a0 0x7fd5e4055b60 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7fd6000ac6a0 tx=0x7fd5e8015000).stop 2021-11-12T05:49:09.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.052+0000 7fd605aa3700 1 -- 172.21.2.105:0/4251537975 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd60014abe0 msgr2=0x7fd6000ab500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:09.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.052+0000 7fd605aa3700 1 --2- 172.21.2.105:0/4251537975 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd60014abe0 0x7fd6000ab500 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7fd5f8001250 tx=0x7fd5f80090f0).stop 2021-11-12T05:49:09.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.052+0000 7fd605aa3700 1 -- 172.21.2.105:0/4251537975 shutdown_connections 2021-11-12T05:49:09.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.052+0000 7fd605aa3700 1 --2- 172.21.2.105:0/4251537975 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd5e40536a0 0x7fd5e4055b60 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:09.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.052+0000 7fd605aa3700 1 --2- 172.21.2.105:0/4251537975 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd60014abe0 0x7fd6000ab500 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:09.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.052+0000 7fd605aa3700 1 --2- 172.21.2.105:0/4251537975 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd6000ad080 0x7fd600157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:09.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.052+0000 7fd605aa3700 1 --2- 172.21.2.105:0/4251537975 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd6000ac280 0x7fd6000aac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:09.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.052+0000 7fd605aa3700 1 -- 172.21.2.105:0/4251537975 >> 172.21.2.105:0/4251537975 conn(0x7fd6000b5370 msgr2=0x7fd600146820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:09.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.052+0000 7fd605aa3700 1 -- 172.21.2.105:0/4251537975 shutdown_connections 2021-11-12T05:49:09.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.052+0000 7fd605aa3700 1 -- 172.21.2.105:0/4251537975 wait complete. 2021-11-12T05:49:09.062 INFO:teuthology.orchestra.run.gibba005.stderr:updated caps for client.0 2021-11-12T05:49:09.065 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-12T05:49:09.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.116+0000 7ff31a49b700 1 Processor -- start 2021-11-12T05:49:09.121 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.116+0000 7ff31a49b700 1 -- start start 2021-11-12T05:49:09.124 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.116+0000 7ff31a49b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff3140ac280 0x7ff31414b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:09.124 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.116+0000 7ff31a49b700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7ff3140af730 0x7ff3140ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:09.124 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.116+0000 7ff31a49b700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3140ac7b0 con 0x7ff3140ad080 2021-11-12T05:49:09.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.116+0000 7ff31a49b700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3141488a0 con 0x7ff3140ac280 2021-11-12T05:49:09.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.116+0000 7ff31a49b700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3140ac9e0 con 0x7ff3140af730 2021-11-12T05:49:09.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.116+0000 7ff3137fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7ff3140ac280 0x7ff31414b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:09.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.116+0000 7ff313fff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7ff3140ad080 0x7ff31414abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:33614/0 (socket says 172.21.2.105:33614) 2021-11-12T05:49:09.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.116+0000 7ff313fff700 1 -- 172.21.2.105:0/3362346213 learned_addr learned my addr 172.21.2.105:0/3362346213 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:09.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.116+0000 7ff3137fe700 1 -- 172.21.2.105:0/3362346213 >> v2:172.21.2.115:3300/0 conn(0x7ff3140af730 msgr2=0x7ff3140ad460 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:49:09.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.116+0000 7ff3137fe700 1 --2- 172.21.2.105:0/3362346213 >> v2:172.21.2.115:3300/0 conn(0x7ff3140af730 0x7ff3140ad460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:09.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.116+0000 7ff3137fe700 1 -- 172.21.2.105:0/3362346213 >> v1:172.21.2.105:6789/0 conn(0x7ff3140ad080 legacy=0x7ff31414abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:09.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.116+0000 7ff3137fe700 1 -- 172.21.2.105:0/3362346213 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3140b0b30 con 0x7ff3140ac280 2021-11-12T05:49:09.127 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.116+0000 7ff3137fe700 1 --2- 172.21.2.105:0/3362346213 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3140ac280 0x7ff31414b2f0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7ff3140b1000 tx=0x7ff2fc006df0).ready entity=mon.0 client_cookie=984c84a4ae012e76 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:09.127 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.116+0000 7ff312ffd700 1 -- 172.21.2.105:0/3362346213 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2fc00d5c0 con 0x7ff3140ac280 2021-11-12T05:49:09.127 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.116+0000 7ff312ffd700 1 -- 172.21.2.105:0/3362346213 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2fc000e90 con 0x7ff3140ac280 2021-11-12T05:49:09.127 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.116+0000 7ff312ffd700 1 -- 172.21.2.105:0/3362346213 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2fc00d950 con 0x7ff3140ac280 2021-11-12T05:49:09.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.116+0000 7ff31a49b700 1 -- 172.21.2.105:0/3362346213 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3140ac280 msgr2=0x7ff31414b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:09.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.116+0000 7ff31a49b700 1 --2- 172.21.2.105:0/3362346213 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3140ac280 0x7ff31414b2f0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7ff3140b1000 tx=0x7ff2fc006df0).stop 2021-11-12T05:49:09.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.116+0000 7ff31a49b700 1 -- 172.21.2.105:0/3362346213 shutdown_connections 2021-11-12T05:49:09.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.116+0000 7ff31a49b700 1 --2- 172.21.2.105:0/3362346213 >> v2:172.21.2.115:3300/0 conn(0x7ff3140af730 0x7ff3140ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:09.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.116+0000 7ff31a49b700 1 --2- 172.21.2.105:0/3362346213 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3140ac280 0x7ff31414b2f0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:09.129 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.116+0000 7ff31a49b700 1 -- 172.21.2.105:0/3362346213 >> 172.21.2.105:0/3362346213 conn(0x7ff3140b5370 msgr2=0x7ff3140b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:09.129 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.116+0000 7ff31a49b700 1 -- 172.21.2.105:0/3362346213 shutdown_connections 2021-11-12T05:49:09.129 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.116+0000 7ff31a49b700 1 -- 172.21.2.105:0/3362346213 wait complete. 2021-11-12T05:49:09.129 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.116+0000 7ff31a49b700 1 Processor -- start 2021-11-12T05:49:09.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.116+0000 7ff31a49b700 1 -- start start 2021-11-12T05:49:09.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.120+0000 7ff31a49b700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff3140ac280 0x7ff314156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:09.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.120+0000 7ff31a49b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3140ad080 0x7ff3140aaf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:09.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.120+0000 7ff31a49b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff3140af730 0x7ff3140b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:09.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.120+0000 7ff31a49b700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3140aab00 con 0x7ff3140ad080 2021-11-12T05:49:09.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.120+0000 7ff31a49b700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3140ab630 con 0x7ff3140ac280 2021-11-12T05:49:09.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.120+0000 7ff31a49b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3140ab8d0 con 0x7ff3140af730 2021-11-12T05:49:09.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.120+0000 7ff3137fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3140ad080 0x7ff3140aaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:09.131 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.120+0000 7ff3137fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3140ad080 0x7ff3140aaf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51458/0 (socket says 172.21.2.105:51458) 2021-11-12T05:49:09.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.120+0000 7ff3137fe700 1 -- 172.21.2.105:0/726491263 learned_addr learned my addr 172.21.2.105:0/726491263 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:09.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.120+0000 7ff3137fe700 1 -- 172.21.2.105:0/726491263 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff3140af730 msgr2=0x7ff3140b36e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:49:09.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.120+0000 7ff3137fe700 1 --2- 172.21.2.105:0/726491263 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff3140af730 0x7ff3140b36e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:09.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.120+0000 7ff3137fe700 1 -- 172.21.2.105:0/726491263 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff3140ac280 msgr2=0x7ff314156c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:09.132 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.120+0000 7ff3137fe700 1 --2- 172.21.2.105:0/726491263 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff3140ac280 0x7ff314156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:09.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.120+0000 7ff3137fe700 1 -- 172.21.2.105:0/726491263 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2fc00b180 con 0x7ff3140ad080 2021-11-12T05:49:09.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.120+0000 7ff3137fe700 1 --2- 172.21.2.105:0/726491263 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3140ad080 0x7ff3140aaf60 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 rx=0x7ff3140b1000 tx=0x7ff2fc012000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:09.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.120+0000 7ff3117fa700 1 -- 172.21.2.105:0/726491263 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2fc016070 con 0x7ff3140ad080 2021-11-12T05:49:09.133 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.120+0000 7ff3117fa700 1 -- 172.21.2.105:0/726491263 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2fc00d940 con 0x7ff3140ad080 2021-11-12T05:49:09.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.120+0000 7ff31a49b700 1 -- 172.21.2.105:0/726491263 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3140aa7f0 con 0x7ff3140ad080 2021-11-12T05:49:09.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.120+0000 7ff3117fa700 1 -- 172.21.2.105:0/726491263 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2fc013f00 con 0x7ff3140ad080 2021-11-12T05:49:09.134 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.120+0000 7ff31a49b700 1 -- 172.21.2.105:0/726491263 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3140a9870 con 0x7ff3140ad080 2021-11-12T05:49:09.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.120+0000 7ff31a49b700 1 -- 172.21.2.105:0/726491263 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3140a9b50 con 0x7ff3140ad080 2021-11-12T05:49:09.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.120+0000 7ff3117fa700 1 -- 172.21.2.105:0/726491263 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff2fc025030 con 0x7ff3140ad080 2021-11-12T05:49:09.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.120+0000 7ff3117fa700 1 --2- 172.21.2.105:0/726491263 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff2f8053640 0x7ff2f8055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:09.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.120+0000 7ff3117fa700 1 -- 172.21.2.105:0/726491263 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6416+0+0 (secure 0 0 0) 0x7ff2fc06cbe0 con 0x7ff3140ad080 2021-11-12T05:49:09.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.120+0000 7ff313fff700 1 --2- 172.21.2.105:0/726491263 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff2f8053640 0x7ff2f8055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:09.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.120+0000 7ff313fff700 1 --2- 172.21.2.105:0/726491263 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff2f8053640 0x7ff2f8055b00 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7ff3140b0eb0 tx=0x7ff304007800).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:09.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.124+0000 7ff3117fa700 1 -- 172.21.2.105:0/726491263 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff2fc043bf0 con 0x7ff3140ad080 2021-11-12T05:49:09.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.236+0000 7ff31a49b700 1 -- 172.21.2.105:0/726491263 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7ff3140aba90 con 0x7ff3140ad080 2021-11-12T05:49:09.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.240+0000 7ff3117fa700 1 -- 172.21.2.105:0/726491263 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v42) v1 ==== 184+0+0 (secure 0 0 0) 0x7ff2fc023020 con 0x7ff3140ad080 2021-11-12T05:49:09.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.240+0000 7ff31a49b700 1 -- 172.21.2.105:0/726491263 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff2f8053640 msgr2=0x7ff2f8055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:09.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.240+0000 7ff31a49b700 1 --2- 172.21.2.105:0/726491263 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff2f8053640 0x7ff2f8055b00 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7ff3140b0eb0 tx=0x7ff304007800).stop 2021-11-12T05:49:09.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.240+0000 7ff31a49b700 1 -- 172.21.2.105:0/726491263 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3140ad080 msgr2=0x7ff3140aaf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:09.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.240+0000 7ff31a49b700 1 --2- 172.21.2.105:0/726491263 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3140ad080 0x7ff3140aaf60 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 rx=0x7ff3140b1000 tx=0x7ff2fc012000).stop 2021-11-12T05:49:09.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.240+0000 7ff31a49b700 1 -- 172.21.2.105:0/726491263 shutdown_connections 2021-11-12T05:49:09.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.240+0000 7ff31a49b700 1 --2- 172.21.2.105:0/726491263 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff2f8053640 0x7ff2f8055b00 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:09.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.240+0000 7ff31a49b700 1 --2- 172.21.2.105:0/726491263 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff3140af730 0x7ff3140b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:09.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.240+0000 7ff31a49b700 1 --2- 172.21.2.105:0/726491263 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff3140ad080 0x7ff3140aaf60 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:09.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.240+0000 7ff31a49b700 1 --2- 172.21.2.105:0/726491263 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff3140ac280 0x7ff314156c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:09.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.240+0000 7ff31a49b700 1 -- 172.21.2.105:0/726491263 >> 172.21.2.105:0/726491263 conn(0x7ff3140b5370 msgr2=0x7ff3140b4900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:09.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.240+0000 7ff31a49b700 1 -- 172.21.2.105:0/726491263 shutdown_connections 2021-11-12T05:49:09.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.240+0000 7ff31a49b700 1 -- 172.21.2.105:0/726491263 wait complete. 2021-11-12T05:49:09.248 INFO:teuthology.orchestra.run.gibba005.stderr:updated caps for client.1 2021-11-12T05:49:09.252 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-12T05:49:09.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.300+0000 7f0e445a7700 1 Processor -- start 2021-11-12T05:49:09.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.300+0000 7f0e445a7700 1 -- start start 2021-11-12T05:49:09.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.300+0000 7f0e445a7700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0e3c0ad080 0x7f0e3c0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:09.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.300+0000 7f0e445a7700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f0e3c14b2f0 0x7f0e3c0ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:09.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.300+0000 7f0e445a7700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e3c0ac7b0 con 0x7f0e3c0ac280 2021-11-12T05:49:09.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.300+0000 7f0e445a7700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e3c1488a0 con 0x7f0e3c14b2f0 2021-11-12T05:49:09.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.300+0000 7f0e445a7700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c0ac9e0 con 0x7f0e3c0ad080 2021-11-12T05:49:09.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.300+0000 7f0e42b44700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f0e3c14b2f0 0x7f0e3c0ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:09.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.300+0000 7f0e42b44700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f0e3c14b2f0 0x7f0e3c0ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51464/0 (socket says 172.21.2.105:51464) 2021-11-12T05:49:09.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.300+0000 7f0e42b44700 1 -- 172.21.2.105:0/4065717940 learned_addr learned my addr 172.21.2.105:0/4065717940 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:09.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.300+0000 7f0e42343700 1 --2- 172.21.2.105:0/4065717940 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0e3c0ad080 0x7f0e3c0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:09.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e42b44700 1 -- 172.21.2.105:0/4065717940 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0e3c0ad080 msgr2=0x7f0e3c0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:09.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e42b44700 1 --2- 172.21.2.105:0/4065717940 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0e3c0ad080 0x7f0e3c0af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:09.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e42b44700 1 -- 172.21.2.105:0/4065717940 >> v1:172.21.2.115:6789/0 conn(0x7f0e3c0ac280 legacy=0x7f0e3c14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:09.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e42b44700 1 -- 172.21.2.105:0/4065717940 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c0b0b30 con 0x7f0e3c14b2f0 2021-11-12T05:49:09.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e42b44700 1 --2- 172.21.2.105:0/4065717940 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0e3c14b2f0 0x7f0e3c0ad460 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7f0e3c0ac6a0 tx=0x7f0e34009290).ready entity=mon.0 client_cookie=b6415b7da0b872ea server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:09.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e41341700 1 -- 172.21.2.105:0/4065717940 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e3400b860 con 0x7f0e3c14b2f0 2021-11-12T05:49:09.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e41341700 1 -- 172.21.2.105:0/4065717940 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3400b9c0 con 0x7f0e3c14b2f0 2021-11-12T05:49:09.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e41341700 1 -- 172.21.2.105:0/4065717940 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e3400bb30 con 0x7f0e3c14b2f0 2021-11-12T05:49:09.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e445a7700 1 -- 172.21.2.105:0/4065717940 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0e3c14b2f0 msgr2=0x7f0e3c0ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:09.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e445a7700 1 --2- 172.21.2.105:0/4065717940 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0e3c14b2f0 0x7f0e3c0ad460 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7f0e3c0ac6a0 tx=0x7f0e34009290).stop 2021-11-12T05:49:09.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e445a7700 1 -- 172.21.2.105:0/4065717940 shutdown_connections 2021-11-12T05:49:09.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e445a7700 1 --2- 172.21.2.105:0/4065717940 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0e3c14b2f0 0x7f0e3c0ad460 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:09.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e445a7700 1 --2- 172.21.2.105:0/4065717940 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0e3c0ad080 0x7f0e3c0af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:09.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e445a7700 1 -- 172.21.2.105:0/4065717940 >> 172.21.2.105:0/4065717940 conn(0x7f0e3c0b5370 msgr2=0x7f0e3c0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:09.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e445a7700 1 -- 172.21.2.105:0/4065717940 shutdown_connections 2021-11-12T05:49:09.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e445a7700 1 -- 172.21.2.105:0/4065717940 wait complete. 2021-11-12T05:49:09.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e445a7700 1 Processor -- start 2021-11-12T05:49:09.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e445a7700 1 -- start start 2021-11-12T05:49:09.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e445a7700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0e3c0ac280 0x7f0e3c147120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:09.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e445a7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0e3c0ad080 0x7f0e3c149c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:09.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e445a7700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0e3c14b2f0 0x7f0e3c15a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:09.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e445a7700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c14b090 con 0x7f0e3c0ad080 2021-11-12T05:49:09.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e445a7700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c0a9eb0 con 0x7f0e3c0ac280 2021-11-12T05:49:09.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e445a7700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c0aa150 con 0x7f0e3c14b2f0 2021-11-12T05:49:09.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e41b42700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0e3c0ad080 0x7f0e3c149c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:09.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e41b42700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0e3c0ad080 0x7f0e3c149c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51472/0 (socket says 172.21.2.105:51472) 2021-11-12T05:49:09.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e41b42700 1 -- 172.21.2.105:0/2019843462 learned_addr learned my addr 172.21.2.105:0/2019843462 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:09.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e42b44700 1 --2- 172.21.2.105:0/2019843462 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0e3c14b2f0 0x7f0e3c15a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:09.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e42343700 1 --2- 172.21.2.105:0/2019843462 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0e3c0ac280 0x7f0e3c147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:09.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e41b42700 1 -- 172.21.2.105:0/2019843462 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0e3c14b2f0 msgr2=0x7f0e3c15a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:09.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e41b42700 1 --2- 172.21.2.105:0/2019843462 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0e3c14b2f0 0x7f0e3c15a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:09.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e41b42700 1 -- 172.21.2.105:0/2019843462 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0e3c0ac280 msgr2=0x7f0e3c147120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:09.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e41b42700 1 --2- 172.21.2.105:0/2019843462 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0e3c0ac280 0x7f0e3c147120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:09.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e41b42700 1 -- 172.21.2.105:0/2019843462 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e34009530 con 0x7f0e3c0ad080 2021-11-12T05:49:09.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e41b42700 1 --2- 172.21.2.105:0/2019843462 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0e3c0ad080 0x7f0e3c149c60 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 rx=0x7f0e3c0b0550 tx=0x7f0e38007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:09.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e2b7fe700 1 -- 172.21.2.105:0/2019843462 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e3800ce60 con 0x7f0e3c0ad080 2021-11-12T05:49:09.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e2b7fe700 1 -- 172.21.2.105:0/2019843462 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e38012400 con 0x7f0e3c0ad080 2021-11-12T05:49:09.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e2b7fe700 1 -- 172.21.2.105:0/2019843462 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e38012760 con 0x7f0e3c0ad080 2021-11-12T05:49:09.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e445a7700 1 -- 172.21.2.105:0/2019843462 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e3c14ad10 con 0x7f0e3c0ad080 2021-11-12T05:49:09.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e445a7700 1 -- 172.21.2.105:0/2019843462 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e3c15a800 con 0x7f0e3c0ad080 2021-11-12T05:49:09.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.304+0000 7f0e445a7700 1 -- 172.21.2.105:0/2019843462 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e3c15a000 con 0x7f0e3c0ad080 2021-11-12T05:49:09.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.308+0000 7f0e2b7fe700 1 -- 172.21.2.105:0/2019843462 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0e38019030 con 0x7f0e3c0ad080 2021-11-12T05:49:09.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.308+0000 7f0e2b7fe700 1 --2- 172.21.2.105:0/2019843462 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0e1c0536a0 0x7f0e1c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:09.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.308+0000 7f0e2b7fe700 1 -- 172.21.2.105:0/2019843462 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f0e3806ad20 con 0x7f0e3c0ad080 2021-11-12T05:49:09.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.308+0000 7f0e42343700 1 --2- 172.21.2.105:0/2019843462 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0e1c0536a0 0x7f0e1c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:09.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.308+0000 7f0e42343700 1 --2- 172.21.2.105:0/2019843462 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0e1c0536a0 0x7f0e1c055b60 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f0e2c00c000 tx=0x7f0e2c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:09.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.308+0000 7f0e2b7fe700 1 -- 172.21.2.105:0/2019843462 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0e38041cd0 con 0x7f0e3c0ad080 2021-11-12T05:49:09.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.420+0000 7f0e445a7700 1 -- 172.21.2.105:0/2019843462 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f0e3c057350 con 0x7f0e3c0ad080 2021-11-12T05:49:09.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.424+0000 7f0e2b7fe700 1 -- 172.21.2.105:0/2019843462 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v43) v1 ==== 184+0+0 (secure 0 0 0) 0x7f0e380452f0 con 0x7f0e3c0ad080 2021-11-12T05:49:09.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.424+0000 7f0e445a7700 1 -- 172.21.2.105:0/2019843462 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0e1c0536a0 msgr2=0x7f0e1c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:09.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.424+0000 7f0e445a7700 1 --2- 172.21.2.105:0/2019843462 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0e1c0536a0 0x7f0e1c055b60 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f0e2c00c000 tx=0x7f0e2c008040).stop 2021-11-12T05:49:09.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.424+0000 7f0e445a7700 1 -- 172.21.2.105:0/2019843462 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0e3c0ad080 msgr2=0x7f0e3c149c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:09.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.424+0000 7f0e445a7700 1 --2- 172.21.2.105:0/2019843462 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0e3c0ad080 0x7f0e3c149c60 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 rx=0x7f0e3c0b0550 tx=0x7f0e38007c50).stop 2021-11-12T05:49:09.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.424+0000 7f0e445a7700 1 -- 172.21.2.105:0/2019843462 shutdown_connections 2021-11-12T05:49:09.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.424+0000 7f0e445a7700 1 --2- 172.21.2.105:0/2019843462 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0e1c0536a0 0x7f0e1c055b60 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:09.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.424+0000 7f0e445a7700 1 --2- 172.21.2.105:0/2019843462 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0e3c14b2f0 0x7f0e3c15a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:09.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.424+0000 7f0e445a7700 1 --2- 172.21.2.105:0/2019843462 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0e3c0ad080 0x7f0e3c149c60 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:09.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.424+0000 7f0e445a7700 1 --2- 172.21.2.105:0/2019843462 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0e3c0ac280 0x7f0e3c147120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:09.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.424+0000 7f0e445a7700 1 -- 172.21.2.105:0/2019843462 >> 172.21.2.105:0/2019843462 conn(0x7f0e3c0b5370 msgr2=0x7f0e3c145d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:09.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.424+0000 7f0e445a7700 1 -- 172.21.2.105:0/2019843462 shutdown_connections 2021-11-12T05:49:09.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.424+0000 7f0e445a7700 1 -- 172.21.2.105:0/2019843462 wait complete. 2021-11-12T05:49:09.433 INFO:teuthology.orchestra.run.gibba005.stderr:updated caps for client.2 2021-11-12T05:49:09.436 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:49:09.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42f25ea700 1 Processor -- start 2021-11-12T05:49:09.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42f25ea700 1 -- start start 2021-11-12T05:49:09.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42f25ea700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f42ec14b2f0 0x7f42ec0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:09.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42f25ea700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42ec0ac7b0 con 0x7f42ec0ac280 2021-11-12T05:49:09.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42f25ea700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42ec0ac9e0 con 0x7f42ec0ad080 2021-11-12T05:49:09.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42f25ea700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec1488a0 con 0x7f42ec14b2f0 2021-11-12T05:49:09.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42eb7fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f42ec0ac280 0x7f42ec147a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:33646/0 (socket says 172.21.2.105:33646) 2021-11-12T05:49:09.494 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42eb7fe700 1 -- 172.21.2.105:0/1407019926 learned_addr learned my addr 172.21.2.105:0/1407019926 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:09.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42eaffd700 1 -- 172.21.2.105:0/1407019926 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2348297327 0 0) 0x7f42ec0ac7b0 con 0x7f42ec0ac280 2021-11-12T05:49:09.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42eaffd700 1 -- 172.21.2.105:0/1407019926 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42cc003260 con 0x7f42ec0ac280 2021-11-12T05:49:09.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42f0b87700 1 --2- 172.21.2.105:0/1407019926 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f42ec14b2f0 0x7f42ec0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:09.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42eaffd700 1 -- 172.21.2.105:0/1407019926 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2621637236 0 0) 0x7f42cc003260 con 0x7f42ec0ac280 2021-11-12T05:49:09.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42eaffd700 1 -- 172.21.2.105:0/1407019926 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f42ec14b2f0 msgr2=0x7f42ec0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:09.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42eaffd700 1 --2- 172.21.2.105:0/1407019926 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f42ec14b2f0 0x7f42ec0af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:09.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42eaffd700 1 -- 172.21.2.105:0/1407019926 >> v1:172.21.2.115:6789/0 conn(0x7f42ec0ad080 legacy=0x7f42ec14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:09.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42eaffd700 1 -- 172.21.2.105:0/1407019926 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ec0b0b30 con 0x7f42ec0ac280 2021-11-12T05:49:09.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42eaffd700 1 -- 172.21.2.105:0/1407019926 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f42dc001660 con 0x7f42ec0ac280 2021-11-12T05:49:09.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42eaffd700 1 -- 172.21.2.105:0/1407019926 >> v1:172.21.2.105:6789/0 conn(0x7f42ec0ac280 legacy=0x7f42ec147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:09.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42eaffd700 1 --2- 172.21.2.105:0/1407019926 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f42cc003780 0x7f42cc003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:09.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42eaffd700 1 --2- 172.21.2.105:0/1407019926 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f42cc004500 0x7f42cc004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:09.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42eaffd700 1 --2- 172.21.2.105:0/1407019926 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f42ec14b2f0 0x7f42cc004eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:09.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42eaffd700 1 -- 172.21.2.105:0/1407019926 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec1488a0 con 0x7f42cc003780 2021-11-12T05:49:09.498 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42eaffd700 1 -- 172.21.2.105:0/1407019926 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc00b830 con 0x7f42cc004500 2021-11-12T05:49:09.498 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42eaffd700 1 -- 172.21.2.105:0/1407019926 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc00b9f0 con 0x7f42ec14b2f0 2021-11-12T05:49:09.498 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42ebfff700 1 --2- 172.21.2.105:0/1407019926 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f42cc003780 0x7f42cc003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:09.498 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42f0b87700 1 --2- 172.21.2.105:0/1407019926 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f42ec14b2f0 0x7f42cc004eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:09.499 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42eb7fe700 1 --2- 172.21.2.105:0/1407019926 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f42cc004500 0x7f42cc004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:09.499 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42ebfff700 1 -- 172.21.2.105:0/1407019926 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f42ec14b2f0 msgr2=0x7f42cc004eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:09.499 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42ebfff700 1 --2- 172.21.2.105:0/1407019926 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f42ec14b2f0 0x7f42cc004eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:09.499 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42ebfff700 1 -- 172.21.2.105:0/1407019926 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f42cc004500 msgr2=0x7f42cc004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:09.499 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42ebfff700 1 --2- 172.21.2.105:0/1407019926 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f42cc004500 0x7f42cc004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:09.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42ebfff700 1 -- 172.21.2.105:0/1407019926 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42cc003260 con 0x7f42cc003780 2021-11-12T05:49:09.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42ebfff700 1 --2- 172.21.2.105:0/1407019926 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f42cc003780 0x7f42cc003ba0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7f42ec0b60a0 tx=0x7f42d4007a00).ready entity=mon.0 client_cookie=86bbab27fad7474f server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:09.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42eaffd700 1 -- 172.21.2.105:0/1407019926 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42d4007d10 con 0x7f42cc003780 2021-11-12T05:49:09.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42eaffd700 1 -- 172.21.2.105:0/1407019926 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d4007030 con 0x7f42cc003780 2021-11-12T05:49:09.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42eaffd700 1 -- 172.21.2.105:0/1407019926 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42d4007390 con 0x7f42cc003780 2021-11-12T05:49:09.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42f25ea700 1 -- 172.21.2.105:0/1407019926 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f42cc003780 msgr2=0x7f42cc003ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:09.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42f25ea700 1 --2- 172.21.2.105:0/1407019926 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f42cc003780 0x7f42cc003ba0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7f42ec0b60a0 tx=0x7f42d4007a00).stop 2021-11-12T05:49:09.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42f0b87700 1 -- 172.21.2.105:0/1407019926 reap_dead start 2021-11-12T05:49:09.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42f25ea700 1 -- 172.21.2.105:0/1407019926 shutdown_connections 2021-11-12T05:49:09.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42f25ea700 1 -- 172.21.2.105:0/1407019926 >> 172.21.2.105:0/1407019926 conn(0x7f42ec0b5370 msgr2=0x7f42ec0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:09.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42f25ea700 1 -- 172.21.2.105:0/1407019926 shutdown_connections 2021-11-12T05:49:09.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42f25ea700 1 -- 172.21.2.105:0/1407019926 wait complete. 2021-11-12T05:49:09.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42f25ea700 1 Processor -- start 2021-11-12T05:49:09.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42f25ea700 1 -- start start 2021-11-12T05:49:09.503 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42f25ea700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f42cc003780 0x7f42ec063560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:09.503 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42f25ea700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f42ec063a50 0x7f42ec0a8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:09.503 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42f25ea700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f42ec0a85f0 0x7f42ec15a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:09.503 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42f25ea700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec0a9b40 con 0x7f42ec0a85f0 2021-11-12T05:49:09.504 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42f25ea700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec157970 con 0x7f42cc003780 2021-11-12T05:49:09.504 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.484+0000 7f42f25ea700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec0a9400 con 0x7f42ec063a50 2021-11-12T05:49:09.504 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.488+0000 7f42f0b87700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f42ec0a85f0 0x7f42ec15a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:09.504 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.488+0000 7f42f0b87700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f42ec0a85f0 0x7f42ec15a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51494/0 (socket says 172.21.2.105:51494) 2021-11-12T05:49:09.504 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.488+0000 7f42f0b87700 1 -- 172.21.2.105:0/2070192679 learned_addr learned my addr 172.21.2.105:0/2070192679 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:09.505 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.488+0000 7f42eb7fe700 1 --2- 172.21.2.105:0/2070192679 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f42ec063a50 0x7f42ec0a8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:09.505 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.488+0000 7f42ebfff700 1 --2- 172.21.2.105:0/2070192679 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f42cc003780 0x7f42ec063560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:09.505 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.488+0000 7f42f0b87700 1 -- 172.21.2.105:0/2070192679 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f42ec063a50 msgr2=0x7f42ec0a8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:09.505 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.488+0000 7f42f0b87700 1 --2- 172.21.2.105:0/2070192679 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f42ec063a50 0x7f42ec0a8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:09.505 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.488+0000 7f42f0b87700 1 -- 172.21.2.105:0/2070192679 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f42cc003780 msgr2=0x7f42ec063560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:09.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.488+0000 7f42f0b87700 1 --2- 172.21.2.105:0/2070192679 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f42cc003780 0x7f42ec063560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:09.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.488+0000 7f42f0b87700 1 -- 172.21.2.105:0/2070192679 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ec0a96a0 con 0x7f42ec0a85f0 2021-11-12T05:49:09.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.488+0000 7f42f0b87700 1 --2- 172.21.2.105:0/2070192679 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f42ec0a85f0 0x7f42ec15a090 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 rx=0x7f42e400b000 tx=0x7f42e40091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:09.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.488+0000 7f42e97fa700 1 -- 172.21.2.105:0/2070192679 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42e4019070 con 0x7f42ec0a85f0 2021-11-12T05:49:09.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.488+0000 7f42e97fa700 1 -- 172.21.2.105:0/2070192679 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e400f830 con 0x7f42ec0a85f0 2021-11-12T05:49:09.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.488+0000 7f42e97fa700 1 -- 172.21.2.105:0/2070192679 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42e400fb90 con 0x7f42ec0a85f0 2021-11-12T05:49:09.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.488+0000 7f42f25ea700 1 -- 172.21.2.105:0/2070192679 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42ec063eb0 con 0x7f42ec0a85f0 2021-11-12T05:49:09.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.488+0000 7f42f25ea700 1 -- 172.21.2.105:0/2070192679 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42ec0a9e10 con 0x7f42ec0a85f0 2021-11-12T05:49:09.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.488+0000 7f42f25ea700 1 -- 172.21.2.105:0/2070192679 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42ec0a9830 con 0x7f42ec0a85f0 2021-11-12T05:49:09.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.488+0000 7f42e97fa700 1 -- 172.21.2.105:0/2070192679 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f42e400fcf0 con 0x7f42ec0a85f0 2021-11-12T05:49:09.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.488+0000 7f42e97fa700 1 --2- 172.21.2.105:0/2070192679 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f42d00535b0 0x7f42d0055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:09.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.488+0000 7f42e97fa700 1 -- 172.21.2.105:0/2070192679 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f42e406c320 con 0x7f42ec0a85f0 2021-11-12T05:49:09.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.488+0000 7f42ebfff700 1 --2- 172.21.2.105:0/2070192679 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f42d00535b0 0x7f42d0055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:09.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.488+0000 7f42ebfff700 1 --2- 172.21.2.105:0/2070192679 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f42d00535b0 0x7f42d0055a70 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f42d4019000 tx=0x7f42d4015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:09.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.488+0000 7f42e97fa700 1 -- 172.21.2.105:0/2070192679 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f42e4043330 con 0x7f42ec0a85f0 2021-11-12T05:49:09.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.600+0000 7f42f25ea700 1 -- 172.21.2.105:0/2070192679 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42ec0b1440 con 0x7f42ec0a85f0 2021-11-12T05:49:09.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.600+0000 7f42e97fa700 1 -- 172.21.2.105:0/2070192679 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f42e4046950 con 0x7f42ec0a85f0 2021-11-12T05:49:09.605 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:09.606 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":65,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4979,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/2405231908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":2405231908},{"type":"v1","addr":"172.21.2.115:6833","nonce":2405231908}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":63}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:49:07.486433+0000","modified":"2021-11-12T05:49:08.490302+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8115},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8115":{"gid":8115,"name":"a","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/737863904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":737863904},{"type":"v1","addr":"172.21.2.105:6835","nonce":737863904}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-11-12T05:49:09.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.600+0000 7f42f25ea700 1 -- 172.21.2.105:0/2070192679 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f42d00535b0 msgr2=0x7f42d0055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:09.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.600+0000 7f42f25ea700 1 --2- 172.21.2.105:0/2070192679 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f42d00535b0 0x7f42d0055a70 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f42d4019000 tx=0x7f42d4015000).stop 2021-11-12T05:49:09.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.600+0000 7f42f25ea700 1 -- 172.21.2.105:0/2070192679 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f42ec0a85f0 msgr2=0x7f42ec15a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:09.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.600+0000 7f42f25ea700 1 --2- 172.21.2.105:0/2070192679 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f42ec0a85f0 0x7f42ec15a090 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 rx=0x7f42e400b000 tx=0x7f42e40091d0).stop 2021-11-12T05:49:09.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.600+0000 7f42f25ea700 1 -- 172.21.2.105:0/2070192679 shutdown_connections 2021-11-12T05:49:09.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.600+0000 7f42f25ea700 1 --2- 172.21.2.105:0/2070192679 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f42d00535b0 0x7f42d0055a70 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:09.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.600+0000 7f42f25ea700 1 --2- 172.21.2.105:0/2070192679 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f42ec0a85f0 0x7f42ec15a090 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:09.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.600+0000 7f42f25ea700 1 --2- 172.21.2.105:0/2070192679 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f42ec063a50 0x7f42ec0a8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:09.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.600+0000 7f42f25ea700 1 --2- 172.21.2.105:0/2070192679 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f42cc003780 0x7f42ec063560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:09.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.600+0000 7f42f25ea700 1 -- 172.21.2.105:0/2070192679 >> 172.21.2.105:0/2070192679 conn(0x7f42ec0b5370 msgr2=0x7f42ec14aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:09.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.600+0000 7f42f25ea700 1 -- 172.21.2.105:0/2070192679 shutdown_connections 2021-11-12T05:49:09.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.600+0000 7f42f25ea700 1 -- 172.21.2.105:0/2070192679 wait complete. 2021-11-12T05:49:09.610 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 65 2021-11-12T05:49:09.815 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 65, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:49:07.486433+0000', 'modified': '2021-11-12T05:49:08.490302+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8115}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8115': {'gid': 8115, 'name': 'a', 'rank': 0, 'incarnation': 64, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/737863904', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 737863904}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 737863904}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:49:09.816 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:49:09.816 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:49:09.880 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":8115,"want_state":"up:active","state":"up:active","rank_uptime":2.3859800839999998,"mdsmap_epoch":65,"osdmap_epoch":135,"osdmap_epoch_barrier":134,"uptime":6.6228113850000003} 2021-11-12T05:49:09.881 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 8115, "mdsmap_epoch": 65, "osdmap_epoch": 135, "osdmap_epoch_barrier": 134, "rank_uptime": 2.385980084, "state": "up:active", "uptime": 6.622811385, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:49:09.881 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:49:09.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.928+0000 7f44431e0700 1 Processor -- start 2021-11-12T05:49:09.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.928+0000 7f44431e0700 1 -- start start 2021-11-12T05:49:09.933 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.928+0000 7f44431e0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f443c0b2940 0x7f443c142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:09.934 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.928+0000 7f44431e0700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f443c0b0780 0x7f443c1432b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:09.934 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.928+0000 7f44431e0700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f443c0b2d20 con 0x7f443c0b0cc0 2021-11-12T05:49:09.934 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.928+0000 7f44431e0700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f443c0b1fc0 con 0x7f443c0b0780 2021-11-12T05:49:09.934 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.928+0000 7f44431e0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f443c0b15e0 con 0x7f443c0b2940 2021-11-12T05:49:09.935 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.928+0000 7f444177d700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f443c0b0cc0 0x7f443c13fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:33662/0 (socket says 172.21.2.105:33662) 2021-11-12T05:49:09.935 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.928+0000 7f444177d700 1 -- 172.21.2.105:0/2585343275 learned_addr learned my addr 172.21.2.105:0/2585343275 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:09.935 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.928+0000 7f443bfff700 1 --2- 172.21.2.105:0/2585343275 >> v2:172.21.2.105:3300/0 conn(0x7f443c0b0780 0x7f443c1432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:09.935 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.928+0000 7f443b7fe700 1 -- 172.21.2.105:0/2585343275 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1850919260 0 0) 0x7f443c0b2d20 con 0x7f443c0b0cc0 2021-11-12T05:49:09.936 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.928+0000 7f443b7fe700 1 -- 172.21.2.105:0/2585343275 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f441c004370 con 0x7f443c0b0cc0 2021-11-12T05:49:09.936 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.928+0000 7f443bfff700 1 -- 172.21.2.105:0/2585343275 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f443c0b2940 msgr2=0x7f443c142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:09.936 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.928+0000 7f443bfff700 1 --2- 172.21.2.105:0/2585343275 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f443c0b2940 0x7f443c142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:09.936 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.928+0000 7f443bfff700 1 -- 172.21.2.105:0/2585343275 >> v1:172.21.2.105:6789/0 conn(0x7f443c0b0cc0 legacy=0x7f443c13fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:09.936 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.928+0000 7f443bfff700 1 -- 172.21.2.105:0/2585343275 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f443c0b1880 con 0x7f443c0b0780 2021-11-12T05:49:09.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.928+0000 7f443bfff700 1 --2- 172.21.2.105:0/2585343275 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f443c0b0780 0x7f443c1432b0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7f4424002f70 tx=0x7f4424006df0).ready entity=mon.0 client_cookie=57cf95369b5d65ec server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:09.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.928+0000 7f443b7fe700 1 -- 172.21.2.105:0/2585343275 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f442400d570 con 0x7f443c0b0780 2021-11-12T05:49:09.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.928+0000 7f443b7fe700 1 -- 172.21.2.105:0/2585343275 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4424000e90 con 0x7f443c0b0780 2021-11-12T05:49:09.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.928+0000 7f443b7fe700 1 -- 172.21.2.105:0/2585343275 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f442400d8c0 con 0x7f443c0b0780 2021-11-12T05:49:09.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.928+0000 7f44431e0700 1 -- 172.21.2.105:0/2585343275 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f443c0b0780 msgr2=0x7f443c1432b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:09.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.928+0000 7f44431e0700 1 --2- 172.21.2.105:0/2585343275 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f443c0b0780 0x7f443c1432b0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7f4424002f70 tx=0x7f4424006df0).stop 2021-11-12T05:49:09.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.928+0000 7f44431e0700 1 -- 172.21.2.105:0/2585343275 shutdown_connections 2021-11-12T05:49:09.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.928+0000 7f44431e0700 1 --2- 172.21.2.105:0/2585343275 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f443c0b0780 0x7f443c1432b0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:09.942 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.928+0000 7f44431e0700 1 --2- 172.21.2.105:0/2585343275 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f443c0b2940 0x7f443c142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:09.942 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.928+0000 7f44431e0700 1 -- 172.21.2.105:0/2585343275 >> 172.21.2.105:0/2585343275 conn(0x7f443c068440 msgr2=0x7f443c062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:09.942 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.928+0000 7f44431e0700 1 -- 172.21.2.105:0/2585343275 shutdown_connections 2021-11-12T05:49:09.942 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.928+0000 7f44431e0700 1 -- 172.21.2.105:0/2585343275 wait complete. 2021-11-12T05:49:09.942 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.932+0000 7f44431e0700 1 Processor -- start 2021-11-12T05:49:09.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.932+0000 7f44431e0700 1 -- start start 2021-11-12T05:49:09.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.932+0000 7f44431e0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f443c0b0780 0x7f443c0665a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:09.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.932+0000 7f44431e0700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f443c0b0cc0 0x7f443c13ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:09.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.932+0000 7f44431e0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f443c0b2940 0x7f443c13f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:09.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.932+0000 7f44431e0700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443c156da0 con 0x7f443c0b0780 2021-11-12T05:49:09.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.932+0000 7f44431e0700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443c15ae60 con 0x7f443c0b0cc0 2021-11-12T05:49:09.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.932+0000 7f44431e0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f443c15b100 con 0x7f443c0b2940 2021-11-12T05:49:09.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.932+0000 7f4440f7c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f443c0b0780 0x7f443c0665a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:09.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.932+0000 7f4440f7c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f443c0b0780 0x7f443c0665a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51504/0 (socket says 172.21.2.105:51504) 2021-11-12T05:49:09.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.932+0000 7f4440f7c700 1 -- 172.21.2.105:0/3726064884 learned_addr learned my addr 172.21.2.105:0/3726064884 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:09.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.932+0000 7f4440f7c700 1 -- 172.21.2.105:0/3726064884 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f443c0b2940 msgr2=0x7f443c13f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:09.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.932+0000 7f4440f7c700 1 --2- 172.21.2.105:0/3726064884 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f443c0b2940 0x7f443c13f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:09.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.932+0000 7f4440f7c700 1 -- 172.21.2.105:0/3726064884 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f443c0b0cc0 msgr2=0x7f443c13ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:09.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.932+0000 7f4440f7c700 1 --2- 172.21.2.105:0/3726064884 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f443c0b0cc0 0x7f443c13ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:09.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.932+0000 7f4440f7c700 1 -- 172.21.2.105:0/3726064884 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f442400b180 con 0x7f443c0b0780 2021-11-12T05:49:09.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.932+0000 7f4440f7c700 1 --2- 172.21.2.105:0/3726064884 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f443c0b0780 0x7f443c0665a0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 rx=0x7f442c002f70 tx=0x7f442c006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:09.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.932+0000 7f4439ffb700 1 -- 172.21.2.105:0/3726064884 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f442c013460 con 0x7f443c0b0780 2021-11-12T05:49:09.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.932+0000 7f4439ffb700 1 -- 172.21.2.105:0/3726064884 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f442c0135c0 con 0x7f443c0b0780 2021-11-12T05:49:09.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.932+0000 7f44431e0700 1 -- 172.21.2.105:0/3726064884 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f443c0a8f70 con 0x7f443c0b0780 2021-11-12T05:49:09.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.932+0000 7f4439ffb700 1 -- 172.21.2.105:0/3726064884 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f442c013920 con 0x7f443c0b0780 2021-11-12T05:49:09.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.932+0000 7f44431e0700 1 -- 172.21.2.105:0/3726064884 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f443c140d30 con 0x7f443c0b0780 2021-11-12T05:49:09.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.932+0000 7f44431e0700 1 -- 172.21.2.105:0/3726064884 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f443c15b2c0 con 0x7f443c0b0780 2021-11-12T05:49:09.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.932+0000 7f4439ffb700 1 -- 172.21.2.105:0/3726064884 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f442c00f070 con 0x7f443c0b0780 2021-11-12T05:49:09.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.932+0000 7f4439ffb700 1 --2- 172.21.2.105:0/3726064884 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4420053610 0x7f4420055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:09.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.932+0000 7f4439ffb700 1 -- 172.21.2.105:0/3726064884 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f442c06b370 con 0x7f443c0b0780 2021-11-12T05:49:09.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.932+0000 7f443bfff700 1 --2- 172.21.2.105:0/3726064884 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4420053610 0x7f4420055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:09.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.932+0000 7f443bfff700 1 --2- 172.21.2.105:0/3726064884 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4420053610 0x7f4420055ad0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f4424002f70 tx=0x7f4424014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:09.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:09.936+0000 7f4439ffb700 1 -- 172.21.2.105:0/3726064884 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f442c042380 con 0x7f443c0b0780 2021-11-12T05:49:10.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.016+0000 7f44431e0700 1 -- 172.21.2.105:0/3726064884 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f443c0b1b20 con 0x7f443c0b0780 2021-11-12T05:49:10.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.016+0000 7f4439ffb700 1 -- 172.21.2.105:0/3726064884 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+16298 (secure 0 0 0) 0x7f442c0459a0 con 0x7f443c0b0780 2021-11-12T05:49:10.023 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:10.023 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":135,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:49:08.491475+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:49:05.315585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-11-12T05:49:06.466127+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:49:10.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.020+0000 7f44431e0700 1 -- 172.21.2.105:0/3726064884 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4420053610 msgr2=0x7f4420055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:10.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.020+0000 7f44431e0700 1 --2- 172.21.2.105:0/3726064884 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4420053610 0x7f4420055ad0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f4424002f70 tx=0x7f4424014000).stop 2021-11-12T05:49:10.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.020+0000 7f44431e0700 1 -- 172.21.2.105:0/3726064884 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f443c0b0780 msgr2=0x7f443c0665a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:10.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.020+0000 7f44431e0700 1 --2- 172.21.2.105:0/3726064884 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f443c0b0780 0x7f443c0665a0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 rx=0x7f442c002f70 tx=0x7f442c006e20).stop 2021-11-12T05:49:10.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.020+0000 7f44431e0700 1 -- 172.21.2.105:0/3726064884 shutdown_connections 2021-11-12T05:49:10.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.020+0000 7f44431e0700 1 --2- 172.21.2.105:0/3726064884 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4420053610 0x7f4420055ad0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:10.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.020+0000 7f44431e0700 1 --2- 172.21.2.105:0/3726064884 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f443c0b2940 0x7f443c13f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:10.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.020+0000 7f44431e0700 1 --2- 172.21.2.105:0/3726064884 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f443c0b0cc0 0x7f443c13ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:10.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.020+0000 7f44431e0700 1 --2- 172.21.2.105:0/3726064884 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f443c0b0780 0x7f443c0665a0 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:10.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.020+0000 7f44431e0700 1 -- 172.21.2.105:0/3726064884 >> 172.21.2.105:0/3726064884 conn(0x7f443c068440 msgr2=0x7f443c0b4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:10.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.020+0000 7f44431e0700 1 -- 172.21.2.105:0/3726064884 shutdown_connections 2021-11-12T05:49:10.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.020+0000 7f44431e0700 1 -- 172.21.2.105:0/3726064884 wait complete. 2021-11-12T05:49:10.031 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-12T05:49:05.315585+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '135', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2021-11-12T05:49:06.466127+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '134', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-12T05:49:10.032 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:49:10.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.080+0000 7effb6540700 1 Processor -- start 2021-11-12T05:49:10.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.080+0000 7effb6540700 1 -- start start 2021-11-12T05:49:10.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.080+0000 7effb6540700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7effb00b7b00 0x7effb0140d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:10.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.080+0000 7effb6540700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7effb00b3980 0x7effb00b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:10.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.080+0000 7effb6540700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb00b7ee0 con 0x7effb00ae090 2021-11-12T05:49:10.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.080+0000 7effb6540700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb00b2030 con 0x7effb00b3980 2021-11-12T05:49:10.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.080+0000 7effb6540700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb00b22d0 con 0x7effb00b7b00 2021-11-12T05:49:10.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.080+0000 7effb4add700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7effb00b3980 0x7effb00b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:10.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.080+0000 7effb4add700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7effb00b3980 0x7effb00b3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51516/0 (socket says 172.21.2.105:51516) 2021-11-12T05:49:10.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.080+0000 7effb4add700 1 -- 172.21.2.105:0/2520132081 learned_addr learned my addr 172.21.2.105:0/2520132081 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:10.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.080+0000 7effb4add700 1 -- 172.21.2.105:0/2520132081 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7effb00b7b00 msgr2=0x7effb0140d80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:49:10.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.080+0000 7effb4add700 1 --2- 172.21.2.105:0/2520132081 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7effb00b7b00 0x7effb0140d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:10.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.080+0000 7effb4add700 1 -- 172.21.2.105:0/2520132081 >> v1:172.21.2.115:6789/0 conn(0x7effb00ae090 legacy=0x7effb00b2a10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:49:10.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.080+0000 7effb4add700 1 -- 172.21.2.105:0/2520132081 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb00b2570 con 0x7effb00b3980 2021-11-12T05:49:10.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.080+0000 7effb4add700 1 --2- 172.21.2.105:0/2520132081 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7effb00b3980 0x7effb00b3df0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7effb00ad790 tx=0x7effa8009290).ready entity=mon.0 client_cookie=33991da1446ced69 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:10.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.080+0000 7effaeffd700 1 -- 172.21.2.105:0/2520132081 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effa800b860 con 0x7effb00b3980 2021-11-12T05:49:10.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.080+0000 7effaeffd700 1 -- 172.21.2.105:0/2520132081 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa800b9c0 con 0x7effb00b3980 2021-11-12T05:49:10.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.080+0000 7effaeffd700 1 -- 172.21.2.105:0/2520132081 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effa800bb70 con 0x7effb00b3980 2021-11-12T05:49:10.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.080+0000 7effb6540700 1 -- 172.21.2.105:0/2520132081 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7effb00b3980 msgr2=0x7effb00b3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:10.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.080+0000 7effb6540700 1 --2- 172.21.2.105:0/2520132081 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7effb00b3980 0x7effb00b3df0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7effb00ad790 tx=0x7effa8009290).stop 2021-11-12T05:49:10.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.080+0000 7effb6540700 1 -- 172.21.2.105:0/2520132081 shutdown_connections 2021-11-12T05:49:10.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.080+0000 7effb6540700 1 --2- 172.21.2.105:0/2520132081 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7effb00b3980 0x7effb00b3df0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:10.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.080+0000 7effb6540700 1 --2- 172.21.2.105:0/2520132081 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7effb00b7b00 0x7effb0140d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:10.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.080+0000 7effb6540700 1 -- 172.21.2.105:0/2520132081 >> 172.21.2.105:0/2520132081 conn(0x7effb00608d0 msgr2=0x7effb005c490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:10.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.080+0000 7effb6540700 1 -- 172.21.2.105:0/2520132081 shutdown_connections 2021-11-12T05:49:10.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.080+0000 7effb6540700 1 -- 172.21.2.105:0/2520132081 wait complete. 2021-11-12T05:49:10.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.080+0000 7effb6540700 1 Processor -- start 2021-11-12T05:49:10.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.080+0000 7effb6540700 1 -- start start 2021-11-12T05:49:10.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.084+0000 7effb6540700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7effb00ae090 0x7effb0152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:10.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.084+0000 7effb6540700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7effb00b3980 0x7effb01432a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:10.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.084+0000 7effb6540700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7effb00b7b00 0x7effb0062630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:10.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.084+0000 7effb6540700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb0153600 con 0x7effb00ae090 2021-11-12T05:49:10.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.084+0000 7effb6540700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb014fda0 con 0x7effb00b3980 2021-11-12T05:49:10.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.084+0000 7effb6540700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb0143790 con 0x7effb00b7b00 2021-11-12T05:49:10.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.084+0000 7effaffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7effb00ae090 0x7effb0152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:10.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.084+0000 7effaffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7effb00ae090 0x7effb0152dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51518/0 (socket says 172.21.2.105:51518) 2021-11-12T05:49:10.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.084+0000 7effaffff700 1 -- 172.21.2.105:0/3182552198 learned_addr learned my addr 172.21.2.105:0/3182552198 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:10.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.084+0000 7effaffff700 1 -- 172.21.2.105:0/3182552198 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7effb00b7b00 msgr2=0x7effb0062630 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:49:10.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.084+0000 7effaffff700 1 --2- 172.21.2.105:0/3182552198 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7effb00b7b00 0x7effb0062630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:10.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.084+0000 7effaffff700 1 -- 172.21.2.105:0/3182552198 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7effb00b3980 msgr2=0x7effb01432a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:10.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.084+0000 7effaffff700 1 --2- 172.21.2.105:0/3182552198 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7effb00b3980 0x7effb01432a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:10.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.084+0000 7effaffff700 1 -- 172.21.2.105:0/3182552198 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa8009530 con 0x7effb00ae090 2021-11-12T05:49:10.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.084+0000 7effaffff700 1 --2- 172.21.2.105:0/3182552198 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7effb00ae090 0x7effb0152dd0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7eff98000ed0 tx=0x7eff98006d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:10.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.084+0000 7effad7fa700 1 -- 172.21.2.105:0/3182552198 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff98009e00 con 0x7effb00ae090 2021-11-12T05:49:10.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.084+0000 7effad7fa700 1 -- 172.21.2.105:0/3182552198 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff98012410 con 0x7effb00ae090 2021-11-12T05:49:10.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.084+0000 7effb6540700 1 -- 172.21.2.105:0/3182552198 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb0143a20 con 0x7effb00ae090 2021-11-12T05:49:10.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.084+0000 7effad7fa700 1 -- 172.21.2.105:0/3182552198 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff98012770 con 0x7effb00ae090 2021-11-12T05:49:10.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.084+0000 7effb6540700 1 -- 172.21.2.105:0/3182552198 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb00aefc0 con 0x7effb00ae090 2021-11-12T05:49:10.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.084+0000 7effb6540700 1 -- 172.21.2.105:0/3182552198 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb0057350 con 0x7effb00ae090 2021-11-12T05:49:10.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.084+0000 7effad7fa700 1 -- 172.21.2.105:0/3182552198 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7eff9800f030 con 0x7effb00ae090 2021-11-12T05:49:10.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.084+0000 7effad7fa700 1 --2- 172.21.2.105:0/3182552198 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7eff94053660 0x7eff94055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:10.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.084+0000 7effad7fa700 1 -- 172.21.2.105:0/3182552198 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6416+0+0 (secure 0 0 0) 0x7eff9806b5d0 con 0x7effb00ae090 2021-11-12T05:49:10.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.084+0000 7effaf7fe700 1 --2- 172.21.2.105:0/3182552198 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7eff94053660 0x7eff94055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:10.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.084+0000 7effaf7fe700 1 --2- 172.21.2.105:0/3182552198 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7eff94053660 0x7eff94055b20 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7effa0002fb0 tx=0x7effa00069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:10.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.088+0000 7effad7fa700 1 -- 172.21.2.105:0/3182552198 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7eff980425e0 con 0x7effb00ae090 2021-11-12T05:49:10.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.172+0000 7effb6540700 1 -- 172.21.2.105:0/3182552198 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7effb005f280 con 0x7effb00ae090 2021-11-12T05:49:10.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.172+0000 7effad7fa700 1 -- 172.21.2.105:0/3182552198 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v135) v1 ==== 110+0+10 (secure 0 0 0) 0x7eff98045c00 con 0x7effb00ae090 2021-11-12T05:49:10.176 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:49:10.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.172+0000 7effb6540700 1 -- 172.21.2.105:0/3182552198 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7eff94053660 msgr2=0x7eff94055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:10.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.172+0000 7effb6540700 1 --2- 172.21.2.105:0/3182552198 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7eff94053660 0x7eff94055b20 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7effa0002fb0 tx=0x7effa00069b0).stop 2021-11-12T05:49:10.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.172+0000 7effb6540700 1 -- 172.21.2.105:0/3182552198 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7effb00ae090 msgr2=0x7effb0152dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:10.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.172+0000 7effb6540700 1 --2- 172.21.2.105:0/3182552198 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7effb00ae090 0x7effb0152dd0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7eff98000ed0 tx=0x7eff98006d70).stop 2021-11-12T05:49:10.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.172+0000 7effb6540700 1 -- 172.21.2.105:0/3182552198 shutdown_connections 2021-11-12T05:49:10.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.172+0000 7effb6540700 1 --2- 172.21.2.105:0/3182552198 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7eff94053660 0x7eff94055b20 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:10.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.172+0000 7effb6540700 1 --2- 172.21.2.105:0/3182552198 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7effb00b7b00 0x7effb0062630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:10.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.172+0000 7effb6540700 1 --2- 172.21.2.105:0/3182552198 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7effb00b3980 0x7effb01432a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:10.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.172+0000 7effb6540700 1 --2- 172.21.2.105:0/3182552198 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7effb00ae090 0x7effb0152dd0 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:10.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.172+0000 7effb6540700 1 -- 172.21.2.105:0/3182552198 >> 172.21.2.105:0/3182552198 conn(0x7effb00608d0 msgr2=0x7effb0127d20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:10.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.172+0000 7effb6540700 1 -- 172.21.2.105:0/3182552198 shutdown_connections 2021-11-12T05:49:10.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.172+0000 7effb6540700 1 -- 172.21.2.105:0/3182552198 wait complete. 2021-11-12T05:49:10.183 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:49:10.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb5dfbe700 1 Processor -- start 2021-11-12T05:49:10.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb5dfbe700 1 -- start start 2021-11-12T05:49:10.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb5dfbe700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbb580b7b00 0x7fbb58140d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:10.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb5dfbe700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb580b7ee0 con 0x7fbb580ae090 2021-11-12T05:49:10.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb5dfbe700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb580b2030 con 0x7fbb580b3980 2021-11-12T05:49:10.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb5dfbe700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb580b22d0 con 0x7fbb580b7b00 2021-11-12T05:49:10.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb56ffd700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fbb580ae090 0x7fbb580b2a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:33694/0 (socket says 172.21.2.105:33694) 2021-11-12T05:49:10.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb56ffd700 1 -- 172.21.2.105:0/1506813670 learned_addr learned my addr 172.21.2.105:0/1506813670 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:10.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb567fc700 1 -- 172.21.2.105:0/1506813670 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1313236017 0 0) 0x7fbb580b7ee0 con 0x7fbb580ae090 2021-11-12T05:49:10.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb567fc700 1 -- 172.21.2.105:0/1506813670 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb38003260 con 0x7fbb580ae090 2021-11-12T05:49:10.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb567fc700 1 -- 172.21.2.105:0/1506813670 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3769723928 0 0) 0x7fbb38003260 con 0x7fbb580ae090 2021-11-12T05:49:10.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb567fc700 1 -- 172.21.2.105:0/1506813670 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbb580b7b00 msgr2=0x7fbb58140d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:10.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb567fc700 1 --2- 172.21.2.105:0/1506813670 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbb580b7b00 0x7fbb58140d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:10.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb567fc700 1 -- 172.21.2.105:0/1506813670 >> v1:172.21.2.115:6789/0 conn(0x7fbb580b3980 legacy=0x7fbb580b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:10.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb567fc700 1 -- 172.21.2.105:0/1506813670 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb580b2570 con 0x7fbb580ae090 2021-11-12T05:49:10.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb567fc700 1 -- 172.21.2.105:0/1506813670 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fbb40001660 con 0x7fbb580ae090 2021-11-12T05:49:10.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb567fc700 1 -- 172.21.2.105:0/1506813670 >> v1:172.21.2.105:6789/0 conn(0x7fbb580ae090 legacy=0x7fbb580b2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:10.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb567fc700 1 --2- 172.21.2.105:0/1506813670 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbb580b7b00 0x7fbb38003800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:10.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb567fc700 1 --2- 172.21.2.105:0/1506813670 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbb38003ef0 0x7fbb38004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:10.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb567fc700 1 --2- 172.21.2.105:0/1506813670 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbb38004bf0 0x7fbb3800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:10.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb567fc700 1 -- 172.21.2.105:0/1506813670 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb580b22d0 con 0x7fbb38003ef0 2021-11-12T05:49:10.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb567fc700 1 -- 172.21.2.105:0/1506813670 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb380052f0 con 0x7fbb38004bf0 2021-11-12T05:49:10.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb567fc700 1 -- 172.21.2.105:0/1506813670 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3800bc40 con 0x7fbb580b7b00 2021-11-12T05:49:10.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb56ffd700 1 --2- 172.21.2.105:0/1506813670 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbb38003ef0 0x7fbb38004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:10.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb56ffd700 1 -- 172.21.2.105:0/1506813670 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbb580b7b00 msgr2=0x7fbb38003800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:10.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb56ffd700 1 --2- 172.21.2.105:0/1506813670 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbb580b7b00 0x7fbb38003800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:10.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb56ffd700 1 -- 172.21.2.105:0/1506813670 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbb38004bf0 msgr2=0x7fbb3800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:10.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb56ffd700 1 --2- 172.21.2.105:0/1506813670 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbb38004bf0 0x7fbb3800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:10.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb56ffd700 1 -- 172.21.2.105:0/1506813670 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb38003260 con 0x7fbb38003ef0 2021-11-12T05:49:10.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb56ffd700 1 --2- 172.21.2.105:0/1506813670 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbb38003ef0 0x7fbb38004500 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 rx=0x7fbb580b5070 tx=0x7fbb580b21c0).ready entity=mon.0 client_cookie=61f215e4312fac9e server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:10.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb567fc700 1 -- 172.21.2.105:0/1506813670 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb400070d0 con 0x7fbb38003ef0 2021-11-12T05:49:10.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb567fc700 1 -- 172.21.2.105:0/1506813670 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb40007230 con 0x7fbb38003ef0 2021-11-12T05:49:10.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb567fc700 1 -- 172.21.2.105:0/1506813670 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb4000c890 con 0x7fbb38003ef0 2021-11-12T05:49:10.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb5dfbe700 1 -- 172.21.2.105:0/1506813670 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbb38003ef0 msgr2=0x7fbb38004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:10.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb5dfbe700 1 --2- 172.21.2.105:0/1506813670 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbb38003ef0 0x7fbb38004500 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 rx=0x7fbb580b5070 tx=0x7fbb580b21c0).stop 2021-11-12T05:49:10.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb57fff700 1 -- 172.21.2.105:0/1506813670 reap_dead start 2021-11-12T05:49:10.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb5dfbe700 1 -- 172.21.2.105:0/1506813670 shutdown_connections 2021-11-12T05:49:10.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb5dfbe700 1 -- 172.21.2.105:0/1506813670 >> 172.21.2.105:0/1506813670 conn(0x7fbb580608d0 msgr2=0x7fbb5805c490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:10.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb5dfbe700 1 -- 172.21.2.105:0/1506813670 shutdown_connections 2021-11-12T05:49:10.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb5dfbe700 1 -- 172.21.2.105:0/1506813670 wait complete. 2021-11-12T05:49:10.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb5dfbe700 1 Processor -- start 2021-11-12T05:49:10.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.232+0000 7fbb5dfbe700 1 -- start start 2021-11-12T05:49:10.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.236+0000 7fbb5dfbe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbb38003ef0 0x7fbb5813ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:10.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.236+0000 7fbb5dfbe700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbb58129de0 0x7fbb580b0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:10.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.236+0000 7fbb5dfbe700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbb580afc60 0x7fbb580ae910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:10.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.236+0000 7fbb5dfbe700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb580b1360 con 0x7fbb38003ef0 2021-11-12T05:49:10.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.236+0000 7fbb5dfbe700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb580b0730 con 0x7fbb58129de0 2021-11-12T05:49:10.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.236+0000 7fbb5dfbe700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5813fda0 con 0x7fbb580afc60 2021-11-12T05:49:10.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.236+0000 7fbb577fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbb38003ef0 0x7fbb5813ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:10.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.236+0000 7fbb577fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbb38003ef0 0x7fbb5813ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51540/0 (socket says 172.21.2.105:51540) 2021-11-12T05:49:10.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.236+0000 7fbb577fe700 1 -- 172.21.2.105:0/2880731611 learned_addr learned my addr 172.21.2.105:0/2880731611 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:10.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.236+0000 7fbb56ffd700 1 --2- 172.21.2.105:0/2880731611 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbb58129de0 0x7fbb580b0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:10.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.236+0000 7fbb577fe700 1 -- 172.21.2.105:0/2880731611 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbb580afc60 msgr2=0x7fbb580ae910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:10.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.236+0000 7fbb577fe700 1 --2- 172.21.2.105:0/2880731611 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbb580afc60 0x7fbb580ae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:10.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.236+0000 7fbb577fe700 1 -- 172.21.2.105:0/2880731611 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbb58129de0 msgr2=0x7fbb580b0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:10.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.236+0000 7fbb577fe700 1 --2- 172.21.2.105:0/2880731611 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbb58129de0 0x7fbb580b0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:10.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.236+0000 7fbb577fe700 1 -- 172.21.2.105:0/2880731611 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb5812bec0 con 0x7fbb38003ef0 2021-11-12T05:49:10.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.236+0000 7fbb577fe700 1 --2- 172.21.2.105:0/2880731611 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbb38003ef0 0x7fbb5813ef60 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 rx=0x7fbb5812a240 tx=0x7fbb48006e70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:10.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.236+0000 7fbb54ff9700 1 -- 172.21.2.105:0/2880731611 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb4800e470 con 0x7fbb38003ef0 2021-11-12T05:49:10.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.236+0000 7fbb54ff9700 1 -- 172.21.2.105:0/2880731611 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb48000e90 con 0x7fbb38003ef0 2021-11-12T05:49:10.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.236+0000 7fbb54ff9700 1 -- 172.21.2.105:0/2880731611 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb4800e7c0 con 0x7fbb38003ef0 2021-11-12T05:49:10.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.236+0000 7fbb5dfbe700 1 -- 172.21.2.105:0/2880731611 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb5812c160 con 0x7fbb38003ef0 2021-11-12T05:49:10.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.236+0000 7fbb5dfbe700 1 -- 172.21.2.105:0/2880731611 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb5813f450 con 0x7fbb38003ef0 2021-11-12T05:49:10.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.236+0000 7fbb5dfbe700 1 -- 172.21.2.105:0/2880731611 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb580b0470 con 0x7fbb38003ef0 2021-11-12T05:49:10.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.236+0000 7fbb54ff9700 1 -- 172.21.2.105:0/2880731611 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbb4800f070 con 0x7fbb38003ef0 2021-11-12T05:49:10.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.236+0000 7fbb54ff9700 1 --2- 172.21.2.105:0/2880731611 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbb3c053600 0x7fbb3c055ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:10.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.236+0000 7fbb54ff9700 1 -- 172.21.2.105:0/2880731611 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fbb4806af60 con 0x7fbb38003ef0 2021-11-12T05:49:10.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.236+0000 7fbb56ffd700 1 --2- 172.21.2.105:0/2880731611 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbb3c053600 0x7fbb3c055ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:10.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.236+0000 7fbb56ffd700 1 --2- 172.21.2.105:0/2880731611 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbb3c053600 0x7fbb3c055ac0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7fbb40014000 tx=0x7fbb40015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:10.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.240+0000 7fbb54ff9700 1 -- 172.21.2.105:0/2880731611 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbb580b0470 con 0x7fbb38003ef0 2021-11-12T05:49:10.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.320+0000 7fbb5dfbe700 1 -- 172.21.2.105:0/2880731611 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbb580b0470 con 0x7fbb38003ef0 2021-11-12T05:49:10.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.320+0000 7fbb54ff9700 1 -- 172.21.2.105:0/2880731611 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v135) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbb580b0470 con 0x7fbb38003ef0 2021-11-12T05:49:10.327 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:49:10.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.324+0000 7fbb5dfbe700 1 -- 172.21.2.105:0/2880731611 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbb3c053600 msgr2=0x7fbb3c055ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:10.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.324+0000 7fbb5dfbe700 1 --2- 172.21.2.105:0/2880731611 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbb3c053600 0x7fbb3c055ac0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7fbb40014000 tx=0x7fbb40015000).stop 2021-11-12T05:49:10.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.324+0000 7fbb5dfbe700 1 -- 172.21.2.105:0/2880731611 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbb38003ef0 msgr2=0x7fbb5813ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:10.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.324+0000 7fbb5dfbe700 1 --2- 172.21.2.105:0/2880731611 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbb38003ef0 0x7fbb5813ef60 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 rx=0x7fbb5812a240 tx=0x7fbb48006e70).stop 2021-11-12T05:49:10.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.324+0000 7fbb5dfbe700 1 -- 172.21.2.105:0/2880731611 shutdown_connections 2021-11-12T05:49:10.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.324+0000 7fbb5dfbe700 1 --2- 172.21.2.105:0/2880731611 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbb3c053600 0x7fbb3c055ac0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:10.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.324+0000 7fbb5dfbe700 1 --2- 172.21.2.105:0/2880731611 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbb580afc60 0x7fbb580ae910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:10.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.324+0000 7fbb5dfbe700 1 --2- 172.21.2.105:0/2880731611 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbb58129de0 0x7fbb580b0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:10.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.324+0000 7fbb5dfbe700 1 --2- 172.21.2.105:0/2880731611 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbb38003ef0 0x7fbb5813ef60 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:10.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.324+0000 7fbb5dfbe700 1 -- 172.21.2.105:0/2880731611 >> 172.21.2.105:0/2880731611 conn(0x7fbb580608d0 msgr2=0x7fbb580b5300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:10.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.324+0000 7fbb5dfbe700 1 -- 172.21.2.105:0/2880731611 shutdown_connections 2021-11-12T05:49:10.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.324+0000 7fbb5dfbe700 1 -- 172.21.2.105:0/2880731611 wait complete. 2021-11-12T05:49:10.334 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-12T05:49:10.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f871edc5700 1 Processor -- start 2021-11-12T05:49:10.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f871edc5700 1 -- start start 2021-11-12T05:49:10.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f871edc5700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f87180b6380 0x7f87180b6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:10.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f871edc5700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f871813fab0 con 0x7f8718142900 2021-11-12T05:49:10.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f871edc5700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f871813fd50 con 0x7f87181390a0 2021-11-12T05:49:10.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f871edc5700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f871813fff0 con 0x7f87180b6380 2021-11-12T05:49:10.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f8717fff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f8718142900 0x7f871813f300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:33712/0 (socket says 172.21.2.105:33712) 2021-11-12T05:49:10.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f8717fff700 1 -- 172.21.2.105:0/3211888747 learned_addr learned my addr 172.21.2.105:0/3211888747 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:10.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f87177fe700 1 -- 172.21.2.105:0/3211888747 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 836791677 0 0) 0x7f871813fab0 con 0x7f8718142900 2021-11-12T05:49:10.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f87177fe700 1 -- 172.21.2.105:0/3211888747 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86f8003260 con 0x7f8718142900 2021-11-12T05:49:10.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f871cb61700 1 --2- 172.21.2.105:0/3211888747 >> v2:172.21.2.115:3300/0 conn(0x7f87180b6380 0x7f87180b6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:10.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f87177fe700 1 -- 172.21.2.105:0/3211888747 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3902395395 0 0) 0x7f86f8003260 con 0x7f8718142900 2021-11-12T05:49:10.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f87177fe700 1 -- 172.21.2.105:0/3211888747 >> v2:172.21.2.115:3300/0 conn(0x7f87180b6380 msgr2=0x7f87180b6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:10.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f87177fe700 1 --2- 172.21.2.105:0/3211888747 >> v2:172.21.2.115:3300/0 conn(0x7f87180b6380 0x7f87180b6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:10.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f87177fe700 1 -- 172.21.2.105:0/3211888747 >> v1:172.21.2.115:6789/0 conn(0x7f87181390a0 legacy=0x7f87180aeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:10.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f87177fe700 1 -- 172.21.2.105:0/3211888747 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87181394a0 con 0x7f8718142900 2021-11-12T05:49:10.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f87177fe700 1 -- 172.21.2.105:0/3211888747 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f8708001660 con 0x7f8718142900 2021-11-12T05:49:10.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f87177fe700 1 -- 172.21.2.105:0/3211888747 >> v1:172.21.2.105:6789/0 conn(0x7f8718142900 legacy=0x7f871813f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:10.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f87177fe700 1 --2- 172.21.2.105:0/3211888747 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f86f8003820 0x7f86f8003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:10.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f87177fe700 1 --2- 172.21.2.105:0/3211888747 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f86f8004500 0x7f86f8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:10.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f87177fe700 1 --2- 172.21.2.105:0/3211888747 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f86f8004f70 0x7f86f800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:10.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f87177fe700 1 -- 172.21.2.105:0/3211888747 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871813fff0 con 0x7f86f8003820 2021-11-12T05:49:10.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f87177fe700 1 -- 172.21.2.105:0/3211888747 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f800be50 con 0x7f86f8004f70 2021-11-12T05:49:10.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f87177fe700 1 -- 172.21.2.105:0/3211888747 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f800d120 con 0x7f86f8004500 2021-11-12T05:49:10.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f871cb61700 1 --2- 172.21.2.105:0/3211888747 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f86f8003820 0x7f86f8003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:10.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f871cb61700 1 -- 172.21.2.105:0/3211888747 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f86f8004500 msgr2=0x7f86f8004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:10.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f871cb61700 1 --2- 172.21.2.105:0/3211888747 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f86f8004500 0x7f86f8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:10.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f871cb61700 1 -- 172.21.2.105:0/3211888747 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f86f8004f70 msgr2=0x7f86f800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:10.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f871cb61700 1 --2- 172.21.2.105:0/3211888747 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f86f8004f70 0x7f86f800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:10.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f871cb61700 1 -- 172.21.2.105:0/3211888747 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f8003260 con 0x7f86f8003820 2021-11-12T05:49:10.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f871d362700 1 -- 172.21.2.105:0/3211888747 reap_dead start 2021-11-12T05:49:10.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f871cb61700 1 --2- 172.21.2.105:0/3211888747 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f86f8003820 0x7f86f8003c20 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7f870000a000 tx=0x7f8700008040).ready entity=mon.0 client_cookie=4da2ab16ae934e3c server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:10.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f87177fe700 1 -- 172.21.2.105:0/3211888747 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8700013670 con 0x7f86f8003820 2021-11-12T05:49:10.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f87177fe700 1 -- 172.21.2.105:0/3211888747 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87000137d0 con 0x7f86f8003820 2021-11-12T05:49:10.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f87177fe700 1 -- 172.21.2.105:0/3211888747 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8700013b30 con 0x7f86f8003820 2021-11-12T05:49:10.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f871edc5700 1 -- 172.21.2.105:0/3211888747 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f86f8003820 msgr2=0x7f86f8003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:10.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f871edc5700 1 --2- 172.21.2.105:0/3211888747 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f86f8003820 0x7f86f8003c20 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7f870000a000 tx=0x7f8700008040).stop 2021-11-12T05:49:10.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f871edc5700 1 -- 172.21.2.105:0/3211888747 shutdown_connections 2021-11-12T05:49:10.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f871edc5700 1 --2- 172.21.2.105:0/3211888747 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f86f8003820 0x7f86f8003c20 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:10.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f871edc5700 1 -- 172.21.2.105:0/3211888747 >> 172.21.2.105:0/3211888747 conn(0x7f8718063810 msgr2=0x7f87180b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:10.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f871edc5700 1 -- 172.21.2.105:0/3211888747 shutdown_connections 2021-11-12T05:49:10.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.384+0000 7f871edc5700 1 -- 172.21.2.105:0/3211888747 wait complete. 2021-11-12T05:49:10.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.388+0000 7f871edc5700 1 Processor -- start 2021-11-12T05:49:10.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.388+0000 7f871edc5700 1 -- start start 2021-11-12T05:49:10.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.388+0000 7f871edc5700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f86f8003820 0x7f871805f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:10.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.388+0000 7f871edc5700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f871813a3c0 0x7f87180664c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:10.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.388+0000 7f871edc5700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8718066cf0 0x7f8718159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:10.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.388+0000 7f871edc5700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8718067c70 con 0x7f871813a3c0 2021-11-12T05:49:10.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.388+0000 7f871edc5700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8718135a50 con 0x7f8718066cf0 2021-11-12T05:49:10.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.388+0000 7f871edc5700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8718135cf0 con 0x7f86f8003820 2021-11-12T05:49:10.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.388+0000 7f8717fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f871813a3c0 0x7f87180664c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:10.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.388+0000 7f8717fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f871813a3c0 0x7f87180664c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51560/0 (socket says 172.21.2.105:51560) 2021-11-12T05:49:10.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.388+0000 7f8717fff700 1 -- 172.21.2.105:0/568483163 learned_addr learned my addr 172.21.2.105:0/568483163 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:10.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.388+0000 7f8717fff700 1 -- 172.21.2.105:0/568483163 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f86f8003820 msgr2=0x7f871805f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:10.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.388+0000 7f8717fff700 1 --2- 172.21.2.105:0/568483163 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f86f8003820 0x7f871805f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:10.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.388+0000 7f8717fff700 1 -- 172.21.2.105:0/568483163 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8718066cf0 msgr2=0x7f8718159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:10.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.388+0000 7f871d362700 1 --2- 172.21.2.105:0/568483163 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8718066cf0 0x7f8718159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:10.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.388+0000 7f8717fff700 1 --2- 172.21.2.105:0/568483163 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8718066cf0 0x7f8718159c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:10.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.388+0000 7f8717fff700 1 -- 172.21.2.105:0/568483163 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87180669b0 con 0x7f871813a3c0 2021-11-12T05:49:10.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.388+0000 7f8717fff700 1 --2- 172.21.2.105:0/568483163 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f871813a3c0 0x7f87180664c0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7f87180b37a0 tx=0x7f8708001ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:10.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.388+0000 7f8715ffb700 1 -- 172.21.2.105:0/568483163 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8708007170 con 0x7f871813a3c0 2021-11-12T05:49:10.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.388+0000 7f8715ffb700 1 -- 172.21.2.105:0/568483163 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87080072d0 con 0x7f871813a3c0 2021-11-12T05:49:10.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.388+0000 7f8715ffb700 1 -- 172.21.2.105:0/568483163 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8708004920 con 0x7f871813a3c0 2021-11-12T05:49:10.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.388+0000 7f871edc5700 1 -- 172.21.2.105:0/568483163 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8718067960 con 0x7f871813a3c0 2021-11-12T05:49:10.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.388+0000 7f871edc5700 1 -- 172.21.2.105:0/568483163 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f871815a2a0 con 0x7f871813a3c0 2021-11-12T05:49:10.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.388+0000 7f871edc5700 1 -- 172.21.2.105:0/568483163 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8718135eb0 con 0x7f871813a3c0 2021-11-12T05:49:10.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.388+0000 7f8715ffb700 1 -- 172.21.2.105:0/568483163 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8708004a80 con 0x7f871813a3c0 2021-11-12T05:49:10.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.388+0000 7f8715ffb700 1 --2- 172.21.2.105:0/568483163 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f86fc053600 0x7f86fc055ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:10.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.388+0000 7f8715ffb700 1 -- 172.21.2.105:0/568483163 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f870806b720 con 0x7f871813a3c0 2021-11-12T05:49:10.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.388+0000 7f871cb61700 1 --2- 172.21.2.105:0/568483163 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f86fc053600 0x7f86fc055ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:10.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.388+0000 7f871cb61700 1 --2- 172.21.2.105:0/568483163 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f86fc053600 0x7f86fc055ac0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f870000a000 tx=0x7f8700008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:10.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.392+0000 7f8715ffb700 1 -- 172.21.2.105:0/568483163 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8708042620 con 0x7f871813a3c0 2021-11-12T05:49:10.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.476+0000 7f871edc5700 1 -- 172.21.2.105:0/568483163 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8718057350 con 0x7f871813a3c0 2021-11-12T05:49:10.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.476+0000 7f8715ffb700 1 -- 172.21.2.105:0/568483163 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v136) v1 ==== 104+0+10 (secure 0 0 0) 0x7f8708045c40 con 0x7f871813a3c0 2021-11-12T05:49:10.482 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:49:10.483 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.476+0000 7f871edc5700 1 -- 172.21.2.105:0/568483163 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f86fc053600 msgr2=0x7f86fc055ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:10.483 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.476+0000 7f871edc5700 1 --2- 172.21.2.105:0/568483163 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f86fc053600 0x7f86fc055ac0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f870000a000 tx=0x7f8700008040).stop 2021-11-12T05:49:10.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.476+0000 7f871edc5700 1 -- 172.21.2.105:0/568483163 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f871813a3c0 msgr2=0x7f87180664c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:10.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.476+0000 7f871edc5700 1 --2- 172.21.2.105:0/568483163 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f871813a3c0 0x7f87180664c0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7f87180b37a0 tx=0x7f8708001ae0).stop 2021-11-12T05:49:10.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.476+0000 7f871edc5700 1 -- 172.21.2.105:0/568483163 shutdown_connections 2021-11-12T05:49:10.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.480+0000 7f871edc5700 1 --2- 172.21.2.105:0/568483163 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f86fc053600 0x7f86fc055ac0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:10.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.480+0000 7f871edc5700 1 --2- 172.21.2.105:0/568483163 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8718066cf0 0x7f8718159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:10.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.480+0000 7f871edc5700 1 --2- 172.21.2.105:0/568483163 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f871813a3c0 0x7f87180664c0 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:10.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.480+0000 7f871edc5700 1 --2- 172.21.2.105:0/568483163 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f86f8003820 0x7f871805f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:10.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.480+0000 7f871edc5700 1 -- 172.21.2.105:0/568483163 >> 172.21.2.105:0/568483163 conn(0x7f8718063810 msgr2=0x7f8718137700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:10.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.480+0000 7f871edc5700 1 -- 172.21.2.105:0/568483163 shutdown_connections 2021-11-12T05:49:10.486 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.480+0000 7f871edc5700 1 -- 172.21.2.105:0/568483163 wait complete. 2021-11-12T05:49:10.489 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-12T05:49:10.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.536+0000 7f91bb72d700 1 Processor -- start 2021-11-12T05:49:10.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.536+0000 7f91bb72d700 1 -- start start 2021-11-12T05:49:10.546 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.536+0000 7f91bb72d700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f91b40b2e20 0x7f91b40b1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:10.546 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.536+0000 7f91bb72d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f91b4142c50 0x7f91b41430c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:10.547 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.536+0000 7f91bb72d700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b40ad400 con 0x7f91b413ea50 2021-11-12T05:49:10.547 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.536+0000 7f91bb72d700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91b40b3200 con 0x7f91b4142c50 2021-11-12T05:49:10.547 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.536+0000 7f91bb72d700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b40ad660 con 0x7f91b40b2e20 2021-11-12T05:49:10.547 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.536+0000 7f91b8cc8700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f91b413ea50 0x7f91b413ee90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:33730/0 (socket says 172.21.2.105:33730) 2021-11-12T05:49:10.548 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.536+0000 7f91b8cc8700 1 -- 172.21.2.105:0/4275675038 learned_addr learned my addr 172.21.2.105:0/4275675038 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:10.548 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.536+0000 7f91b9cca700 1 --2- 172.21.2.105:0/4275675038 >> v2:172.21.2.105:3300/0 conn(0x7f91b4142c50 0x7f91b41430c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:10.548 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.536+0000 7f91a3fff700 1 -- 172.21.2.105:0/4275675038 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2487486114 0 0) 0x7f91b40ad400 con 0x7f91b413ea50 2021-11-12T05:49:10.548 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.536+0000 7f91a3fff700 1 -- 172.21.2.105:0/4275675038 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f919c003260 con 0x7f91b413ea50 2021-11-12T05:49:10.549 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.536+0000 7f91b9cca700 1 -- 172.21.2.105:0/4275675038 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f91b40b2e20 msgr2=0x7f91b40b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:10.549 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.536+0000 7f91b9cca700 1 --2- 172.21.2.105:0/4275675038 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f91b40b2e20 0x7f91b40b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:10.549 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.536+0000 7f91b9cca700 1 -- 172.21.2.105:0/4275675038 >> v1:172.21.2.105:6789/0 conn(0x7f91b413ea50 legacy=0x7f91b413ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:10.549 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.536+0000 7f91b9cca700 1 -- 172.21.2.105:0/4275675038 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b40ad900 con 0x7f91b4142c50 2021-11-12T05:49:10.550 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.536+0000 7f91b9cca700 1 --2- 172.21.2.105:0/4275675038 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f91b4142c50 0x7f91b41430c0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7f91ac0032f0 tx=0x7f91ac0091d0).ready entity=mon.0 client_cookie=ee0b63aca352ef8 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:10.550 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91a3fff700 1 -- 172.21.2.105:0/4275675038 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91ac00b6c0 con 0x7f91b4142c50 2021-11-12T05:49:10.550 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91a3fff700 1 -- 172.21.2.105:0/4275675038 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ac00b820 con 0x7f91b4142c50 2021-11-12T05:49:10.550 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91a3fff700 1 -- 172.21.2.105:0/4275675038 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91ac00b990 con 0x7f91b4142c50 2021-11-12T05:49:10.551 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91bb72d700 1 -- 172.21.2.105:0/4275675038 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f91b4142c50 msgr2=0x7f91b41430c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:10.551 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91bb72d700 1 --2- 172.21.2.105:0/4275675038 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f91b4142c50 0x7f91b41430c0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7f91ac0032f0 tx=0x7f91ac0091d0).stop 2021-11-12T05:49:10.552 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91bb72d700 1 -- 172.21.2.105:0/4275675038 shutdown_connections 2021-11-12T05:49:10.552 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91bb72d700 1 --2- 172.21.2.105:0/4275675038 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f91b4142c50 0x7f91b41430c0 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:10.552 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91bb72d700 1 --2- 172.21.2.105:0/4275675038 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f91b40b2e20 0x7f91b40b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:10.552 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91bb72d700 1 -- 172.21.2.105:0/4275675038 >> 172.21.2.105:0/4275675038 conn(0x7f91b4062f60 msgr2=0x7f91b4063370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:10.553 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91bb72d700 1 -- 172.21.2.105:0/4275675038 shutdown_connections 2021-11-12T05:49:10.553 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91bb72d700 1 -- 172.21.2.105:0/4275675038 wait complete. 2021-11-12T05:49:10.554 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91bb72d700 1 Processor -- start 2021-11-12T05:49:10.554 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91bb72d700 1 -- start start 2021-11-12T05:49:10.555 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91bb72d700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f91b40b2e20 0x7f91b40a9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:10.555 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91bb72d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f91b413ea50 0x7f91b4064110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:10.556 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91bb72d700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f91b4142c50 0x7f91b4137950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:10.556 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91bb72d700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b40ab540 con 0x7f91b413ea50 2021-11-12T05:49:10.556 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91bb72d700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b40ac590 con 0x7f91b4142c50 2021-11-12T05:49:10.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91bb72d700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b40ac830 con 0x7f91b40b2e20 2021-11-12T05:49:10.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91b8cc8700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f91b413ea50 0x7f91b4064110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:10.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91b8cc8700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f91b413ea50 0x7f91b4064110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51574/0 (socket says 172.21.2.105:51574) 2021-11-12T05:49:10.558 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91b8cc8700 1 -- 172.21.2.105:0/1432005779 learned_addr learned my addr 172.21.2.105:0/1432005779 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:10.558 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91b8cc8700 1 -- 172.21.2.105:0/1432005779 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f91b40b2e20 msgr2=0x7f91b40a9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:10.558 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91b8cc8700 1 --2- 172.21.2.105:0/1432005779 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f91b40b2e20 0x7f91b40a9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:10.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91b8cc8700 1 -- 172.21.2.105:0/1432005779 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f91b4142c50 msgr2=0x7f91b4137950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:10.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91b8cc8700 1 --2- 172.21.2.105:0/1432005779 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f91b4142c50 0x7f91b4137950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:10.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91b8cc8700 1 -- 172.21.2.105:0/1432005779 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ac009470 con 0x7f91b413ea50 2021-11-12T05:49:10.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91b8cc8700 1 --2- 172.21.2.105:0/1432005779 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f91b413ea50 0x7f91b4064110 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7f91a4001110 tx=0x7f91a4007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:10.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91a27fc700 1 -- 172.21.2.105:0/1432005779 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91a400ce30 con 0x7f91b413ea50 2021-11-12T05:49:10.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91a27fc700 1 -- 172.21.2.105:0/1432005779 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a40072e0 con 0x7f91b413ea50 2021-11-12T05:49:10.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91bb72d700 1 -- 172.21.2.105:0/1432005779 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b40ac010 con 0x7f91b413ea50 2021-11-12T05:49:10.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91bb72d700 1 -- 172.21.2.105:0/1432005779 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b40ab900 con 0x7f91b413ea50 2021-11-12T05:49:10.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91a27fc700 1 -- 172.21.2.105:0/1432005779 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91a4005800 con 0x7f91b413ea50 2021-11-12T05:49:10.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91bb72d700 1 -- 172.21.2.105:0/1432005779 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9190003410 con 0x7f91b413ea50 2021-11-12T05:49:10.561 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91a27fc700 1 -- 172.21.2.105:0/1432005779 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f91a401a060 con 0x7f91b413ea50 2021-11-12T05:49:10.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91a27fc700 1 --2- 172.21.2.105:0/1432005779 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9194053660 0x7f9194055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:10.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91a27fc700 1 -- 172.21.2.105:0/1432005779 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f91a406aee0 con 0x7f91b413ea50 2021-11-12T05:49:10.563 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91b94c9700 1 --2- 172.21.2.105:0/1432005779 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9194053660 0x7f9194055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:10.563 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.540+0000 7f91b94c9700 1 --2- 172.21.2.105:0/1432005779 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9194053660 0x7f9194055b20 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f91b0002f70 tx=0x7f91b0006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:10.564 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.544+0000 7f91a27fc700 1 -- 172.21.2.105:0/1432005779 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f91a4041ef0 con 0x7f91b413ea50 2021-11-12T05:49:10.632 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.628+0000 7f91bb72d700 1 -- 172.21.2.105:0/1432005779 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9190003c40 con 0x7f91b413ea50 2021-11-12T05:49:10.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.628+0000 7f91a27fc700 1 -- 172.21.2.105:0/1432005779 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v136) v1 ==== 100+0+10 (secure 0 0 0) 0x7f91a4018070 con 0x7f91b413ea50 2021-11-12T05:49:10.633 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:49:10.634 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.628+0000 7f91bb72d700 1 -- 172.21.2.105:0/1432005779 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9194053660 msgr2=0x7f9194055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:10.635 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.628+0000 7f91bb72d700 1 --2- 172.21.2.105:0/1432005779 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9194053660 0x7f9194055b20 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f91b0002f70 tx=0x7f91b0006a80).stop 2021-11-12T05:49:10.635 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.628+0000 7f91bb72d700 1 -- 172.21.2.105:0/1432005779 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f91b413ea50 msgr2=0x7f91b4064110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:10.635 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.628+0000 7f91bb72d700 1 --2- 172.21.2.105:0/1432005779 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f91b413ea50 0x7f91b4064110 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7f91a4001110 tx=0x7f91a4007aa0).stop 2021-11-12T05:49:10.636 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.628+0000 7f91bb72d700 1 -- 172.21.2.105:0/1432005779 shutdown_connections 2021-11-12T05:49:10.636 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.628+0000 7f91bb72d700 1 --2- 172.21.2.105:0/1432005779 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9194053660 0x7f9194055b20 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:10.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.628+0000 7f91bb72d700 1 --2- 172.21.2.105:0/1432005779 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f91b4142c50 0x7f91b4137950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:10.637 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.628+0000 7f91bb72d700 1 --2- 172.21.2.105:0/1432005779 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f91b413ea50 0x7f91b4064110 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:10.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.628+0000 7f91bb72d700 1 --2- 172.21.2.105:0/1432005779 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f91b40b2e20 0x7f91b40a9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:10.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.628+0000 7f91bb72d700 1 -- 172.21.2.105:0/1432005779 >> 172.21.2.105:0/1432005779 conn(0x7f91b4062f60 msgr2=0x7f91b40af3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:10.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.628+0000 7f91bb72d700 1 -- 172.21.2.105:0/1432005779 shutdown_connections 2021-11-12T05:49:10.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.628+0000 7f91bb72d700 1 -- 172.21.2.105:0/1432005779 wait complete. 2021-11-12T05:49:10.641 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-12T05:49:10.642 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:49:10.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.688+0000 7f53c179c700 1 Processor -- start 2021-11-12T05:49:10.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.688+0000 7f53c179c700 1 -- start start 2021-11-12T05:49:10.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53c179c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f53bc064280 0x7f53bc0b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:10.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53c179c700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53bc0af0e0 con 0x7f53bc0671d0 2021-11-12T05:49:10.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53c179c700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53bc0638a0 con 0x7f53bc0aed00 2021-11-12T05:49:10.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53c179c700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53bc063b40 con 0x7f53bc064280 2021-11-12T05:49:10.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53bb7fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f53bc064280 0x7f53bc0b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:10.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53ba7fc700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f53bc0671d0 0x7f53bc05f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:33742/0 (socket says 172.21.2.105:33742) 2021-11-12T05:49:10.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53ba7fc700 1 -- 172.21.2.105:0/1031542344 learned_addr learned my addr 172.21.2.105:0/1031542344 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:10.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53bb7fe700 1 -- 172.21.2.105:0/1031542344 >> v1:172.21.2.115:6789/0 conn(0x7f53bc0aed00 legacy=0x7f53bc066ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:10.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53bb7fe700 1 -- 172.21.2.105:0/1031542344 >> v1:172.21.2.105:6789/0 conn(0x7f53bc0671d0 legacy=0x7f53bc05f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:10.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53bb7fe700 1 -- 172.21.2.105:0/1031542344 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53bc063de0 con 0x7f53bc064280 2021-11-12T05:49:10.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53bb7fe700 1 --2- 172.21.2.105:0/1031542344 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f53bc064280 0x7f53bc0b04a0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7f53bc0b62e0 tx=0x7f53b40091d0).ready entity=mon.0 client_cookie=a802e38f8b4aef82 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:10.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53b9ffb700 1 -- 172.21.2.105:0/1031542344 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53b4009ea0 con 0x7f53bc064280 2021-11-12T05:49:10.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53b9ffb700 1 -- 172.21.2.105:0/1031542344 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b400b860 con 0x7f53bc064280 2021-11-12T05:49:10.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53b9ffb700 1 -- 172.21.2.105:0/1031542344 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53b400b9d0 con 0x7f53bc064280 2021-11-12T05:49:10.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53c179c700 1 -- 172.21.2.105:0/1031542344 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f53bc064280 msgr2=0x7f53bc0b04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:10.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53c179c700 1 --2- 172.21.2.105:0/1031542344 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f53bc064280 0x7f53bc0b04a0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7f53bc0b62e0 tx=0x7f53b40091d0).stop 2021-11-12T05:49:10.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53c179c700 1 -- 172.21.2.105:0/1031542344 shutdown_connections 2021-11-12T05:49:10.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53c179c700 1 --2- 172.21.2.105:0/1031542344 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f53bc064280 0x7f53bc0b04a0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:10.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53c179c700 1 -- 172.21.2.105:0/1031542344 >> 172.21.2.105:0/1031542344 conn(0x7f53bc0b5370 msgr2=0x7f53bc0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:10.701 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53c179c700 1 -- 172.21.2.105:0/1031542344 shutdown_connections 2021-11-12T05:49:10.701 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53c179c700 1 -- 172.21.2.105:0/1031542344 wait complete. 2021-11-12T05:49:10.703 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53c179c700 1 Processor -- start 2021-11-12T05:49:10.704 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53c179c700 1 -- start start 2021-11-12T05:49:10.704 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53c179c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f53bc064280 0x7f53bc1529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:10.704 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53c179c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f53bc0671d0 0x7f53bc0addb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:10.704 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53c179c700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f53bc0aed00 0x7f53bc156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:10.705 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53c179c700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53bc152ec0 con 0x7f53bc0671d0 2021-11-12T05:49:10.705 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53c179c700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53bc0a38d0 con 0x7f53bc0aed00 2021-11-12T05:49:10.705 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53c179c700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53bc0a3b70 con 0x7f53bc064280 2021-11-12T05:49:10.705 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53ba7fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f53bc0671d0 0x7f53bc0addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:10.705 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53ba7fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f53bc0671d0 0x7f53bc0addb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51586/0 (socket says 172.21.2.105:51586) 2021-11-12T05:49:10.706 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53ba7fc700 1 -- 172.21.2.105:0/1850830196 learned_addr learned my addr 172.21.2.105:0/1850830196 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:10.706 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53ba7fc700 1 -- 172.21.2.105:0/1850830196 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f53bc064280 msgr2=0x7f53bc1529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:10.706 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53ba7fc700 1 --2- 172.21.2.105:0/1850830196 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f53bc064280 0x7f53bc1529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:10.706 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53ba7fc700 1 -- 172.21.2.105:0/1850830196 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f53bc0aed00 msgr2=0x7f53bc156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:10.707 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53ba7fc700 1 --2- 172.21.2.105:0/1850830196 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f53bc0aed00 0x7f53bc156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:10.707 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53ba7fc700 1 -- 172.21.2.105:0/1850830196 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b4009470 con 0x7f53bc0671d0 2021-11-12T05:49:10.707 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53ba7fc700 1 --2- 172.21.2.105:0/1850830196 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f53bc0671d0 0x7f53bc0addb0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 rx=0x7f53bc0b2f10 tx=0x7f53a4007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:10.707 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53b3fff700 1 -- 172.21.2.105:0/1850830196 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53a400ce30 con 0x7f53bc0671d0 2021-11-12T05:49:10.708 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53b3fff700 1 -- 172.21.2.105:0/1850830196 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a40072e0 con 0x7f53bc0671d0 2021-11-12T05:49:10.708 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53b3fff700 1 -- 172.21.2.105:0/1850830196 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53a4005800 con 0x7f53bc0671d0 2021-11-12T05:49:10.708 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53c179c700 1 -- 172.21.2.105:0/1850830196 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53bc156000 con 0x7f53bc0671d0 2021-11-12T05:49:10.708 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53c179c700 1 -- 172.21.2.105:0/1850830196 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53bc0657d0 con 0x7f53bc0671d0 2021-11-12T05:49:10.709 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.692+0000 7f53c179c700 1 -- 172.21.2.105:0/1850830196 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53bc066620 con 0x7f53bc0671d0 2021-11-12T05:49:10.709 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.696+0000 7f53b3fff700 1 -- 172.21.2.105:0/1850830196 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f53a4010070 con 0x7f53bc0671d0 2021-11-12T05:49:10.709 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.696+0000 7f53b3fff700 1 --2- 172.21.2.105:0/1850830196 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f53a0053540 0x7f53a0055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:10.709 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.696+0000 7f53b3fff700 1 -- 172.21.2.105:0/1850830196 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f53a406b0c0 con 0x7f53bc0671d0 2021-11-12T05:49:10.710 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.696+0000 7f53baffd700 1 --2- 172.21.2.105:0/1850830196 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f53a0053540 0x7f53a0055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:10.710 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.696+0000 7f53baffd700 1 --2- 172.21.2.105:0/1850830196 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f53a0053540 0x7f53a0055a00 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f53ac002ef0 tx=0x7f53ac006910).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:10.710 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.696+0000 7f53b3fff700 1 -- 172.21.2.105:0/1850830196 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f53bc066620 con 0x7f53bc0671d0 2021-11-12T05:49:10.811 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.808+0000 7f53c179c700 1 -- 172.21.2.105:0/1850830196 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53bc066620 con 0x7f53bc0671d0 2021-11-12T05:49:10.812 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.808+0000 7f53b3fff700 1 -- 172.21.2.105:0/1850830196 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f53bc066620 con 0x7f53bc0671d0 2021-11-12T05:49:10.812 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:10.813 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":65,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4979,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/2405231908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":2405231908},{"type":"v1","addr":"172.21.2.115:6833","nonce":2405231908}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":63}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:49:07.486433+0000","modified":"2021-11-12T05:49:08.490302+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8115},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8115":{"gid":8115,"name":"a","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/737863904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":737863904},{"type":"v1","addr":"172.21.2.105:6835","nonce":737863904}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-11-12T05:49:10.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.808+0000 7f53c179c700 1 -- 172.21.2.105:0/1850830196 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f53a0053540 msgr2=0x7f53a0055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:10.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.808+0000 7f53c179c700 1 --2- 172.21.2.105:0/1850830196 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f53a0053540 0x7f53a0055a00 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f53ac002ef0 tx=0x7f53ac006910).stop 2021-11-12T05:49:10.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.808+0000 7f53c179c700 1 -- 172.21.2.105:0/1850830196 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f53bc0671d0 msgr2=0x7f53bc0addb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:10.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.808+0000 7f53c179c700 1 --2- 172.21.2.105:0/1850830196 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f53bc0671d0 0x7f53bc0addb0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 rx=0x7f53bc0b2f10 tx=0x7f53a4007c10).stop 2021-11-12T05:49:10.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.808+0000 7f53c179c700 1 -- 172.21.2.105:0/1850830196 shutdown_connections 2021-11-12T05:49:10.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.808+0000 7f53c179c700 1 --2- 172.21.2.105:0/1850830196 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f53a0053540 0x7f53a0055a00 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:10.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.808+0000 7f53c179c700 1 --2- 172.21.2.105:0/1850830196 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f53bc0aed00 0x7f53bc156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:10.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.808+0000 7f53c179c700 1 --2- 172.21.2.105:0/1850830196 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f53bc0671d0 0x7f53bc0addb0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:10.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.808+0000 7f53c179c700 1 --2- 172.21.2.105:0/1850830196 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f53bc064280 0x7f53bc1529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:10.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.808+0000 7f53c179c700 1 -- 172.21.2.105:0/1850830196 >> 172.21.2.105:0/1850830196 conn(0x7f53bc0b5370 msgr2=0x7f53bc146300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:10.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.808+0000 7f53c179c700 1 -- 172.21.2.105:0/1850830196 shutdown_connections 2021-11-12T05:49:10.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:10.808+0000 7f53c179c700 1 -- 172.21.2.105:0/1850830196 wait complete. 2021-11-12T05:49:10.817 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 65 2021-11-12T05:49:11.022 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 65, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:49:07.486433+0000', 'modified': '2021-11-12T05:49:08.490302+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8115}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8115': {'gid': 8115, 'name': 'a', 'rank': 0, 'incarnation': 64, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/737863904', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 737863904}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 737863904}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:49:11.022 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:49:11.023 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:49:11.087 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":8115,"want_state":"up:active","state":"up:active","rank_uptime":3.5923354889999999,"mdsmap_epoch":65,"osdmap_epoch":136,"osdmap_epoch_barrier":134,"uptime":7.829164273} 2021-11-12T05:49:11.088 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 8115, "mdsmap_epoch": 65, "osdmap_epoch": 136, "osdmap_epoch_barrier": 134, "rank_uptime": 3.592335489, "state": "up:active", "uptime": 7.829164273, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:49:11.088 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-12T05:49:11.089 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-12T05:49:11.089 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba016.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-12T05:49:11.089 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:11.090 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:49:11.101 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:49:11.155 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:49:11.155 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:49:11.161 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:49:11.161 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:49:11.162 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:11.163 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:49:11.167 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-12T05:49:11.167 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:49:11.210 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:49:11.219 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:49:11.220 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:49:11.225 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:49:11.226 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:49:11.227 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:11.227 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:49:11.248 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[15164]: starting ceph client 2021-11-12T05:49:11.248 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:2021-11-12T05:49:11.245+0000 7f08e44b0080 -1 init, newargv = 0x565491548cd0 newargc=9 2021-11-12T05:49:11.263 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[15164]: starting fuse 2021-11-12T05:49:12.333 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:49:12.345 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:49:12.345 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:49:12.395 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:49:12.396 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:49:12.397 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:12.397 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:49:12.403 INFO:teuthology.orchestra.run.gibba016.stdout:52 2021-11-12T05:49:12.403 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-12T05:49:12.404 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:12.404 DEBUG:teuthology.orchestra.run.gibba016:> sudo python3 -c ' 2021-11-12T05:49:12.405 DEBUG:teuthology.orchestra.run.gibba016:> import glob 2021-11-12T05:49:12.405 DEBUG:teuthology.orchestra.run.gibba016:> import re 2021-11-12T05:49:12.406 DEBUG:teuthology.orchestra.run.gibba016:> import os 2021-11-12T05:49:12.406 DEBUG:teuthology.orchestra.run.gibba016:> import subprocess 2021-11-12T05:49:12.406 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:49:12.407 DEBUG:teuthology.orchestra.run.gibba016:> def find_socket(client_name): 2021-11-12T05:49:12.407 DEBUG:teuthology.orchestra.run.gibba016:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-12T05:49:12.408 DEBUG:teuthology.orchestra.run.gibba016:> files = glob.glob(asok_path) 2021-11-12T05:49:12.408 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:49:12.408 DEBUG:teuthology.orchestra.run.gibba016:> # Given a non-glob path, it better be there 2021-11-12T05:49:12.409 DEBUG:teuthology.orchestra.run.gibba016:> if "*" not in asok_path: 2021-11-12T05:49:12.409 DEBUG:teuthology.orchestra.run.gibba016:> assert(len(files) == 1) 2021-11-12T05:49:12.410 DEBUG:teuthology.orchestra.run.gibba016:> return files[0] 2021-11-12T05:49:12.410 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:49:12.410 DEBUG:teuthology.orchestra.run.gibba016:> for f in files: 2021-11-12T05:49:12.411 DEBUG:teuthology.orchestra.run.gibba016:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-12T05:49:12.411 DEBUG:teuthology.orchestra.run.gibba016:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-12T05:49:12.412 DEBUG:teuthology.orchestra.run.gibba016:> return f 2021-11-12T05:49:12.412 DEBUG:teuthology.orchestra.run.gibba016:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-12T05:49:12.413 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:49:12.413 DEBUG:teuthology.orchestra.run.gibba016:> print(find_socket("client.0")) 2021-11-12T05:49:12.413 DEBUG:teuthology.orchestra.run.gibba016:> ' 2021-11-12T05:49:12.444 INFO:teuthology.orchestra.run.gibba016.stdout:/var/run/ceph/ceph-client.0.15164.asok 2021-11-12T05:49:12.446 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.15164.asok 2021-11-12T05:49:12.447 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:12.447 DEBUG:teuthology.orchestra.run.gibba016:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.15164.asok status 2021-11-12T05:49:12.552 INFO:teuthology.orchestra.run.gibba016.stdout:{ 2021-11-12T05:49:12.552 INFO:teuthology.orchestra.run.gibba016.stdout: "metadata": { 2021-11-12T05:49:12.552 INFO:teuthology.orchestra.run.gibba016.stdout: "ceph_sha1": "a81ee2815de5acae59ead5b8c9137b6766fc8ea8", 2021-11-12T05:49:12.552 INFO:teuthology.orchestra.run.gibba016.stdout: "ceph_version": "ceph version 15.2.15-22-ga81ee281 (a81ee2815de5acae59ead5b8c9137b6766fc8ea8) octopus (stable)", 2021-11-12T05:49:12.553 INFO:teuthology.orchestra.run.gibba016.stdout: "entity_id": "0", 2021-11-12T05:49:12.553 INFO:teuthology.orchestra.run.gibba016.stdout: "hostname": "gibba016", 2021-11-12T05:49:12.553 INFO:teuthology.orchestra.run.gibba016.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-12T05:49:12.553 INFO:teuthology.orchestra.run.gibba016.stdout: "pid": "15164", 2021-11-12T05:49:12.554 INFO:teuthology.orchestra.run.gibba016.stdout: "root": "/" 2021-11-12T05:49:12.554 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:49:12.554 INFO:teuthology.orchestra.run.gibba016.stdout: "dentry_count": 0, 2021-11-12T05:49:12.554 INFO:teuthology.orchestra.run.gibba016.stdout: "dentry_pinned_count": 0, 2021-11-12T05:49:12.554 INFO:teuthology.orchestra.run.gibba016.stdout: "id": 5024, 2021-11-12T05:49:12.555 INFO:teuthology.orchestra.run.gibba016.stdout: "inst": { 2021-11-12T05:49:12.555 INFO:teuthology.orchestra.run.gibba016.stdout: "name": { 2021-11-12T05:49:12.555 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "client", 2021-11-12T05:49:12.555 INFO:teuthology.orchestra.run.gibba016.stdout: "num": 5024 2021-11-12T05:49:12.556 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:49:12.556 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": { 2021-11-12T05:49:12.556 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "v1", 2021-11-12T05:49:12.556 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": "172.21.2.116:0", 2021-11-12T05:49:12.556 INFO:teuthology.orchestra.run.gibba016.stdout: "nonce": 574786387 2021-11-12T05:49:12.556 INFO:teuthology.orchestra.run.gibba016.stdout: } 2021-11-12T05:49:12.557 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:49:12.557 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": { 2021-11-12T05:49:12.557 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "v1", 2021-11-12T05:49:12.557 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": "172.21.2.116:0", 2021-11-12T05:49:12.558 INFO:teuthology.orchestra.run.gibba016.stdout: "nonce": 574786387 2021-11-12T05:49:12.558 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:49:12.558 INFO:teuthology.orchestra.run.gibba016.stdout: "inst_str": "client.5024 172.21.2.116:0/574786387", 2021-11-12T05:49:12.558 INFO:teuthology.orchestra.run.gibba016.stdout: "addr_str": "172.21.2.116:0/574786387", 2021-11-12T05:49:12.559 INFO:teuthology.orchestra.run.gibba016.stdout: "inode_count": 1, 2021-11-12T05:49:12.559 INFO:teuthology.orchestra.run.gibba016.stdout: "mds_epoch": 65, 2021-11-12T05:49:12.559 INFO:teuthology.orchestra.run.gibba016.stdout: "osd_epoch": 136, 2021-11-12T05:49:12.559 INFO:teuthology.orchestra.run.gibba016.stdout: "osd_epoch_barrier": 0, 2021-11-12T05:49:12.559 INFO:teuthology.orchestra.run.gibba016.stdout: "blacklisted": false, 2021-11-12T05:49:12.560 INFO:teuthology.orchestra.run.gibba016.stdout: "fs_name": "cephfs" 2021-11-12T05:49:12.560 INFO:teuthology.orchestra.run.gibba016.stdout:} 2021-11-12T05:49:12.561 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:12.561 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:49:12.562 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:49:12.567 INFO:teuthology.orchestra.run.gibba016.stdout:fuseblk 2021-11-12T05:49:12.567 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-12T05:49:12.568 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:12.568 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:49:12.576 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:49:12.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.624+0000 7f98cb858700 1 Processor -- start 2021-11-12T05:49:12.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.624+0000 7f98cb858700 1 -- start start 2021-11-12T05:49:12.631 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.624+0000 7f98cb858700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f98c40adaf0 0x7f98c413fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:12.631 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.624+0000 7f98cb858700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c4067860 con 0x7f98c4143fb0 2021-11-12T05:49:12.631 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.624+0000 7f98cb858700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c4143400 con 0x7f98c4143b40 2021-11-12T05:49:12.632 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.624+0000 7f98cb858700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c41436a0 con 0x7f98c40adaf0 2021-11-12T05:49:12.632 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.624+0000 7f98c9df5700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f98c4143fb0 0x7f98c40afe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:33758/0 (socket says 172.21.2.105:33758) 2021-11-12T05:49:12.632 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.624+0000 7f98c9df5700 1 -- 172.21.2.105:0/1495639385 learned_addr learned my addr 172.21.2.105:0/1495639385 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:12.632 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.624+0000 7f98c95f4700 1 --2- 172.21.2.105:0/1495639385 >> v2:172.21.2.105:3300/0 conn(0x7f98c40adaf0 0x7f98c413fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:12.632 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.624+0000 7f98b7fff700 1 -- 172.21.2.105:0/1495639385 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2392277979 0 0) 0x7f98c4067860 con 0x7f98c4143fb0 2021-11-12T05:49:12.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.624+0000 7f98b7fff700 1 -- 172.21.2.105:0/1495639385 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98ac003260 con 0x7f98c4143fb0 2021-11-12T05:49:12.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.624+0000 7f98c95f4700 1 -- 172.21.2.105:0/1495639385 >> v1:172.21.2.115:6789/0 conn(0x7f98c4143b40 legacy=0x7f98c40aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:12.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.624+0000 7f98c95f4700 1 -- 172.21.2.105:0/1495639385 >> v1:172.21.2.105:6789/0 conn(0x7f98c4143fb0 legacy=0x7f98c40afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:12.633 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.624+0000 7f98c95f4700 1 -- 172.21.2.105:0/1495639385 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c40b2b40 con 0x7f98c40adaf0 2021-11-12T05:49:12.634 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.624+0000 7f98c95f4700 1 --2- 172.21.2.105:0/1495639385 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98c40adaf0 0x7f98c413fd90 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 rx=0x7f98c40625f0 tx=0x7f98c0006df0).ready entity=mon.0 client_cookie=45434393710750c8 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:12.634 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.624+0000 7f98b7fff700 1 -- 172.21.2.105:0/1495639385 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98c0014070 con 0x7f98c40adaf0 2021-11-12T05:49:12.634 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.628+0000 7f98b7fff700 1 -- 172.21.2.105:0/1495639385 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c0000e90 con 0x7f98c40adaf0 2021-11-12T05:49:12.634 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.628+0000 7f98b7fff700 1 -- 172.21.2.105:0/1495639385 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98c000fbb0 con 0x7f98c40adaf0 2021-11-12T05:49:12.634 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.628+0000 7f98cb858700 1 -- 172.21.2.105:0/1495639385 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98c40adaf0 msgr2=0x7f98c413fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:12.635 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.628+0000 7f98cb858700 1 --2- 172.21.2.105:0/1495639385 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98c40adaf0 0x7f98c413fd90 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 rx=0x7f98c40625f0 tx=0x7f98c0006df0).stop 2021-11-12T05:49:12.635 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.628+0000 7f98cb858700 1 -- 172.21.2.105:0/1495639385 shutdown_connections 2021-11-12T05:49:12.635 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.628+0000 7f98cb858700 1 --2- 172.21.2.105:0/1495639385 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98c40adaf0 0x7f98c413fd90 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:12.635 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.628+0000 7f98cb858700 1 -- 172.21.2.105:0/1495639385 >> 172.21.2.105:0/1495639385 conn(0x7f98c405c490 msgr2=0x7f98c405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:12.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.628+0000 7f98cb858700 1 -- 172.21.2.105:0/1495639385 shutdown_connections 2021-11-12T05:49:12.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.628+0000 7f98cb858700 1 -- 172.21.2.105:0/1495639385 wait complete. 2021-11-12T05:49:12.638 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.628+0000 7f98cb858700 1 Processor -- start 2021-11-12T05:49:12.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.628+0000 7f98cb858700 1 -- start start 2021-11-12T05:49:12.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.628+0000 7f98cb858700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f98c4143b40 0x7f98c40b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:12.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.628+0000 7f98cb858700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98c4143fb0 0x7f98c4066560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:12.639 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.628+0000 7f98cb858700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f98c40acd50 0x7f98c4066a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:12.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.628+0000 7f98cb858700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c40ac960 con 0x7f98c4143fb0 2021-11-12T05:49:12.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.628+0000 7f98cb858700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c413f840 con 0x7f98c40acd50 2021-11-12T05:49:12.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.628+0000 7f98cb858700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c415ae10 con 0x7f98c4143b40 2021-11-12T05:49:12.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.628+0000 7f98c8df3700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98c4143fb0 0x7f98c4066560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:12.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.628+0000 7f98c8df3700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98c4143fb0 0x7f98c4066560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51598/0 (socket says 172.21.2.105:51598) 2021-11-12T05:49:12.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.628+0000 7f98c8df3700 1 -- 172.21.2.105:0/3891308736 learned_addr learned my addr 172.21.2.105:0/3891308736 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:12.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.628+0000 7f98c8df3700 1 -- 172.21.2.105:0/3891308736 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f98c4143b40 msgr2=0x7f98c40b0f10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:49:12.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.628+0000 7f98c8df3700 1 --2- 172.21.2.105:0/3891308736 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f98c4143b40 0x7f98c40b0f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:12.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.628+0000 7f98c8df3700 1 -- 172.21.2.105:0/3891308736 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f98c40acd50 msgr2=0x7f98c4066a50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:49:12.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.628+0000 7f98c8df3700 1 --2- 172.21.2.105:0/3891308736 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f98c40acd50 0x7f98c4066a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:12.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.628+0000 7f98c8df3700 1 -- 172.21.2.105:0/3891308736 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c000b180 con 0x7f98c4143fb0 2021-11-12T05:49:12.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.628+0000 7f98c8df3700 1 --2- 172.21.2.105:0/3891308736 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98c4143fb0 0x7f98c4066560 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7f98b8002f90 tx=0x7f98b8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:12.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.628+0000 7f98b67fc700 1 -- 172.21.2.105:0/3891308736 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98b8013460 con 0x7f98c4143fb0 2021-11-12T05:49:12.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.628+0000 7f98b67fc700 1 -- 172.21.2.105:0/3891308736 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b80135c0 con 0x7f98c4143fb0 2021-11-12T05:49:12.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.628+0000 7f98cb858700 1 -- 172.21.2.105:0/3891308736 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98c415b0b0 con 0x7f98c4143fb0 2021-11-12T05:49:12.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.628+0000 7f98b67fc700 1 -- 172.21.2.105:0/3891308736 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98b8013920 con 0x7f98c4143fb0 2021-11-12T05:49:12.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.628+0000 7f98cb858700 1 -- 172.21.2.105:0/3891308736 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c4157ec0 con 0x7f98c4143fb0 2021-11-12T05:49:12.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.628+0000 7f98cb858700 1 -- 172.21.2.105:0/3891308736 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98c415ac60 con 0x7f98c4143fb0 2021-11-12T05:49:12.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.628+0000 7f98b67fc700 1 -- 172.21.2.105:0/3891308736 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f98b801a060 con 0x7f98c4143fb0 2021-11-12T05:49:12.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.628+0000 7f98b67fc700 1 --2- 172.21.2.105:0/3891308736 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f98a40536a0 0x7f98a4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:12.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.628+0000 7f98b67fc700 1 -- 172.21.2.105:0/3891308736 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f98b806b540 con 0x7f98c4143fb0 2021-11-12T05:49:12.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.628+0000 7f98c95f4700 1 --2- 172.21.2.105:0/3891308736 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f98a40536a0 0x7f98a4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:12.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.628+0000 7f98c95f4700 1 --2- 172.21.2.105:0/3891308736 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f98a40536a0 0x7f98a4055b60 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f98c40625f0 tx=0x7f98c0016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:12.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.632+0000 7f98b67fc700 1 -- 172.21.2.105:0/3891308736 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f98b8042440 con 0x7f98c4143fb0 2021-11-12T05:49:12.718 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.712+0000 7f98cb858700 1 -- 172.21.2.105:0/3891308736 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98c40afb00 con 0x7f98c4143fb0 2021-11-12T05:49:12.719 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.716+0000 7f98b67fc700 1 -- 172.21.2.105:0/3891308736 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f98b8018020 con 0x7f98c4143fb0 2021-11-12T05:49:12.720 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:12.720 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":136,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:49:10.427356+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:49:05.315585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-11-12T05:49:06.466127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:49:12.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.716+0000 7f98cb858700 1 -- 172.21.2.105:0/3891308736 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f98a40536a0 msgr2=0x7f98a4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:12.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.716+0000 7f98cb858700 1 --2- 172.21.2.105:0/3891308736 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f98a40536a0 0x7f98a4055b60 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f98c40625f0 tx=0x7f98c0016000).stop 2021-11-12T05:49:12.722 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.716+0000 7f98cb858700 1 -- 172.21.2.105:0/3891308736 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98c4143fb0 msgr2=0x7f98c4066560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:12.722 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.716+0000 7f98cb858700 1 --2- 172.21.2.105:0/3891308736 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98c4143fb0 0x7f98c4066560 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7f98b8002f90 tx=0x7f98b8006df0).stop 2021-11-12T05:49:12.722 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.716+0000 7f98cb858700 1 -- 172.21.2.105:0/3891308736 shutdown_connections 2021-11-12T05:49:12.722 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.716+0000 7f98cb858700 1 --2- 172.21.2.105:0/3891308736 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f98a40536a0 0x7f98a4055b60 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:12.723 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.716+0000 7f98cb858700 1 --2- 172.21.2.105:0/3891308736 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f98c40acd50 0x7f98c4066a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:12.723 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.716+0000 7f98cb858700 1 --2- 172.21.2.105:0/3891308736 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f98c4143fb0 0x7f98c4066560 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:12.723 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.716+0000 7f98cb858700 1 --2- 172.21.2.105:0/3891308736 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f98c4143b40 0x7f98c40b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:12.723 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.716+0000 7f98cb858700 1 -- 172.21.2.105:0/3891308736 >> 172.21.2.105:0/3891308736 conn(0x7f98c405c490 msgr2=0x7f98c40a96b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:12.724 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.716+0000 7f98cb858700 1 -- 172.21.2.105:0/3891308736 shutdown_connections 2021-11-12T05:49:12.724 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.716+0000 7f98cb858700 1 -- 172.21.2.105:0/3891308736 wait complete. 2021-11-12T05:49:12.727 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-12T05:49:05.315585+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '135', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2021-11-12T05:49:06.466127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '136', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-12T05:49:12.728 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:49:12.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.776+0000 7f607ad2a700 1 Processor -- start 2021-11-12T05:49:12.781 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.776+0000 7f607ad2a700 1 -- start start 2021-11-12T05:49:12.782 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.776+0000 7f607ad2a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60740aca40 0x7f60740ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:12.783 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.776+0000 7f607ad2a700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f60740b0520 0x7f60741473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:12.783 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.776+0000 7f607ad2a700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60740b1840 con 0x7f60741478b0 2021-11-12T05:49:12.783 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.776+0000 7f607ad2a700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6074147d40 con 0x7f60740b0520 2021-11-12T05:49:12.783 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.776+0000 7f607ad2a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60740af2b0 con 0x7f60740aca40 2021-11-12T05:49:12.784 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.776+0000 7f60792c7700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f60741478b0 0x7f6074144180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:33768/0 (socket says 172.21.2.105:33768) 2021-11-12T05:49:12.784 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.776+0000 7f60792c7700 1 -- 172.21.2.105:0/3766839744 learned_addr learned my addr 172.21.2.105:0/3766839744 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:12.784 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.776+0000 7f6073fff700 1 --2- 172.21.2.105:0/3766839744 >> v2:172.21.2.105:3300/0 conn(0x7f60740b0520 0x7f60741473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:12.784 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.776+0000 7f6073fff700 1 -- 172.21.2.105:0/3766839744 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60740aca40 msgr2=0x7f60740ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:12.784 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.776+0000 7f6073fff700 1 --2- 172.21.2.105:0/3766839744 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60740aca40 0x7f60740ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:12.785 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.776+0000 7f6073fff700 1 -- 172.21.2.105:0/3766839744 >> v1:172.21.2.105:6789/0 conn(0x7f60741478b0 legacy=0x7f6074144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:12.785 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.776+0000 7f6073fff700 1 -- 172.21.2.105:0/3766839744 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60740b09a0 con 0x7f60740b0520 2021-11-12T05:49:12.785 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.776+0000 7f6073fff700 1 --2- 172.21.2.105:0/3766839744 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60740b0520 0x7f60741473c0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 rx=0x7f605c002f70 tx=0x7f605c006df0).ready entity=mon.0 client_cookie=11cbc01ae833acb6 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:12.785 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.776+0000 7f60737fe700 1 -- 172.21.2.105:0/3766839744 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f605c00d570 con 0x7f60740b0520 2021-11-12T05:49:12.786 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.776+0000 7f60737fe700 1 -- 172.21.2.105:0/3766839744 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f605c000e90 con 0x7f60740b0520 2021-11-12T05:49:12.786 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.776+0000 7f60737fe700 1 -- 172.21.2.105:0/3766839744 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f605c00d8c0 con 0x7f60740b0520 2021-11-12T05:49:12.786 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.776+0000 7f607ad2a700 1 -- 172.21.2.105:0/3766839744 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60740b0520 msgr2=0x7f60741473c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:12.786 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.776+0000 7f607ad2a700 1 --2- 172.21.2.105:0/3766839744 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60740b0520 0x7f60741473c0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 rx=0x7f605c002f70 tx=0x7f605c006df0).stop 2021-11-12T05:49:12.786 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.776+0000 7f607ad2a700 1 -- 172.21.2.105:0/3766839744 shutdown_connections 2021-11-12T05:49:12.787 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.776+0000 7f607ad2a700 1 --2- 172.21.2.105:0/3766839744 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60740b0520 0x7f60741473c0 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:12.787 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.776+0000 7f607ad2a700 1 --2- 172.21.2.105:0/3766839744 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60740aca40 0x7f60740ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:12.787 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.776+0000 7f607ad2a700 1 -- 172.21.2.105:0/3766839744 >> 172.21.2.105:0/3766839744 conn(0x7f607405c490 msgr2=0x7f60740b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:12.787 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.776+0000 7f607ad2a700 1 -- 172.21.2.105:0/3766839744 shutdown_connections 2021-11-12T05:49:12.788 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.776+0000 7f607ad2a700 1 -- 172.21.2.105:0/3766839744 wait complete. 2021-11-12T05:49:12.790 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.780+0000 7f607ad2a700 1 Processor -- start 2021-11-12T05:49:12.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.780+0000 7f607ad2a700 1 -- start start 2021-11-12T05:49:12.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.780+0000 7f607ad2a700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f60740aca40 0x7f60740a7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:12.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.780+0000 7f607ad2a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60740b0520 0x7f6074138580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:12.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.780+0000 7f607ad2a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60741478b0 0x7f6074138a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:12.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.780+0000 7f607ad2a700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6074063830 con 0x7f60741478b0 2021-11-12T05:49:12.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.780+0000 7f607ad2a700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60740ac3a0 con 0x7f60740aca40 2021-11-12T05:49:12.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.780+0000 7f607ad2a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6074063a90 con 0x7f60740b0520 2021-11-12T05:49:12.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.780+0000 7f60792c7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60741478b0 0x7f6074138a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:12.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.780+0000 7f60792c7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60741478b0 0x7f6074138a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51612/0 (socket says 172.21.2.105:51612) 2021-11-12T05:49:12.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.780+0000 7f60792c7700 1 -- 172.21.2.105:0/3848367756 learned_addr learned my addr 172.21.2.105:0/3848367756 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:12.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.780+0000 7f60792c7700 1 -- 172.21.2.105:0/3848367756 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60740b0520 msgr2=0x7f6074138580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:12.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.780+0000 7f60792c7700 1 --2- 172.21.2.105:0/3848367756 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60740b0520 0x7f6074138580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:12.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.780+0000 7f60792c7700 1 -- 172.21.2.105:0/3848367756 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f60740aca40 msgr2=0x7f60740a7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:12.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.780+0000 7f60792c7700 1 --2- 172.21.2.105:0/3848367756 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f60740aca40 0x7f60740a7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:12.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.780+0000 7f60792c7700 1 -- 172.21.2.105:0/3848367756 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605c00b180 con 0x7f60741478b0 2021-11-12T05:49:12.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.780+0000 7f60792c7700 1 --2- 172.21.2.105:0/3848367756 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60741478b0 0x7f6074138a70 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 rx=0x7f60740b00d0 tx=0x7f606c0013a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:12.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.780+0000 7f6071ffb700 1 -- 172.21.2.105:0/3848367756 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f606c005ba0 con 0x7f60741478b0 2021-11-12T05:49:12.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.780+0000 7f6071ffb700 1 -- 172.21.2.105:0/3848367756 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606c005d00 con 0x7f60741478b0 2021-11-12T05:49:12.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.780+0000 7f607ad2a700 1 -- 172.21.2.105:0/3848367756 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f607414aaa0 con 0x7f60741478b0 2021-11-12T05:49:12.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.780+0000 7f6071ffb700 1 -- 172.21.2.105:0/3848367756 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f606c0072c0 con 0x7f60741478b0 2021-11-12T05:49:12.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.780+0000 7f607ad2a700 1 -- 172.21.2.105:0/3848367756 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60740ac060 con 0x7f60741478b0 2021-11-12T05:49:12.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.780+0000 7f607ad2a700 1 -- 172.21.2.105:0/3848367756 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6074057350 con 0x7f60741478b0 2021-11-12T05:49:12.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.780+0000 7f6071ffb700 1 -- 172.21.2.105:0/3848367756 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f606c010070 con 0x7f60741478b0 2021-11-12T05:49:12.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.780+0000 7f6071ffb700 1 --2- 172.21.2.105:0/3848367756 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f60580534f0 0x7f60580559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:12.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.780+0000 7f6071ffb700 1 -- 172.21.2.105:0/3848367756 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f606c06b420 con 0x7f60741478b0 2021-11-12T05:49:12.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.780+0000 7f6078ac6700 1 --2- 172.21.2.105:0/3848367756 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f60580534f0 0x7f60580559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:12.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.780+0000 7f6078ac6700 1 --2- 172.21.2.105:0/3848367756 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f60580534f0 0x7f60580559b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f6064002f70 tx=0x7f6064006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:12.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.784+0000 7f6071ffb700 1 -- 172.21.2.105:0/3848367756 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f606c042430 con 0x7f60741478b0 2021-11-12T05:49:12.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.868+0000 7f607ad2a700 1 -- 172.21.2.105:0/3848367756 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6074063c00 con 0x7f60741478b0 2021-11-12T05:49:12.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.868+0000 7f6071ffb700 1 -- 172.21.2.105:0/3848367756 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v136) v1 ==== 110+0+10 (secure 0 0 0) 0x7f606c045a50 con 0x7f60741478b0 2021-11-12T05:49:12.872 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:49:12.873 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.868+0000 7f607ad2a700 1 -- 172.21.2.105:0/3848367756 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f60580534f0 msgr2=0x7f60580559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:12.873 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.868+0000 7f607ad2a700 1 --2- 172.21.2.105:0/3848367756 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f60580534f0 0x7f60580559b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f6064002f70 tx=0x7f6064006a80).stop 2021-11-12T05:49:12.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.868+0000 7f607ad2a700 1 -- 172.21.2.105:0/3848367756 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60741478b0 msgr2=0x7f6074138a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:12.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.868+0000 7f607ad2a700 1 --2- 172.21.2.105:0/3848367756 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60741478b0 0x7f6074138a70 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 rx=0x7f60740b00d0 tx=0x7f606c0013a0).stop 2021-11-12T05:49:12.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.868+0000 7f607ad2a700 1 -- 172.21.2.105:0/3848367756 shutdown_connections 2021-11-12T05:49:12.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.868+0000 7f607ad2a700 1 --2- 172.21.2.105:0/3848367756 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f60580534f0 0x7f60580559b0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:12.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.868+0000 7f607ad2a700 1 --2- 172.21.2.105:0/3848367756 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60741478b0 0x7f6074138a70 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:12.875 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.868+0000 7f607ad2a700 1 --2- 172.21.2.105:0/3848367756 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60740b0520 0x7f6074138580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:12.875 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.868+0000 7f607ad2a700 1 --2- 172.21.2.105:0/3848367756 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f60740aca40 0x7f60740a7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:12.875 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.868+0000 7f607ad2a700 1 -- 172.21.2.105:0/3848367756 >> 172.21.2.105:0/3848367756 conn(0x7f607405c490 msgr2=0x7f607405bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:12.875 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.868+0000 7f607ad2a700 1 -- 172.21.2.105:0/3848367756 shutdown_connections 2021-11-12T05:49:12.876 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.868+0000 7f607ad2a700 1 -- 172.21.2.105:0/3848367756 wait complete. 2021-11-12T05:49:12.879 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:49:12.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23ff630700 1 Processor -- start 2021-11-12T05:49:12.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23ff630700 1 -- start start 2021-11-12T05:49:12.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23ff630700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f23f80b0520 0x7f23f8144890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:12.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23ff630700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23f80b1840 con 0x7f23f80aca40 2021-11-12T05:49:12.933 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23ff630700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23f80af2b0 con 0x7f23f80ace20 2021-11-12T05:49:12.933 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23ff630700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23f80b0990 con 0x7f23f80b0520 2021-11-12T05:49:12.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23fd3cc700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f23f80aca40 0x7f23f81473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:33780/0 (socket says 172.21.2.105:33780) 2021-11-12T05:49:12.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23fd3cc700 1 -- 172.21.2.105:0/1199149024 learned_addr learned my addr 172.21.2.105:0/1199149024 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:12.938 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23ebfff700 1 -- 172.21.2.105:0/1199149024 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3967400758 0 0) 0x7f23f80b1840 con 0x7f23f80aca40 2021-11-12T05:49:12.938 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23ebfff700 1 -- 172.21.2.105:0/1199149024 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23e0003260 con 0x7f23f80aca40 2021-11-12T05:49:12.938 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23ebfff700 1 -- 172.21.2.105:0/1199149024 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 230084452 0 0) 0x7f23e0003260 con 0x7f23f80aca40 2021-11-12T05:49:12.938 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23ebfff700 1 -- 172.21.2.105:0/1199149024 >> v2:172.21.2.115:3300/0 conn(0x7f23f80b0520 msgr2=0x7f23f8144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:12.939 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23ebfff700 1 --2- 172.21.2.105:0/1199149024 >> v2:172.21.2.115:3300/0 conn(0x7f23f80b0520 0x7f23f8144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:12.939 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23ebfff700 1 -- 172.21.2.105:0/1199149024 >> v1:172.21.2.115:6789/0 conn(0x7f23f80ace20 legacy=0x7f23f8144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:12.939 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23ebfff700 1 -- 172.21.2.105:0/1199149024 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f8144d80 con 0x7f23f80aca40 2021-11-12T05:49:12.939 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23ebfff700 1 -- 172.21.2.105:0/1199149024 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f23ec001660 con 0x7f23f80aca40 2021-11-12T05:49:12.939 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23ebfff700 1 -- 172.21.2.105:0/1199149024 >> v1:172.21.2.105:6789/0 conn(0x7f23f80aca40 legacy=0x7f23f81473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:12.940 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23ebfff700 1 --2- 172.21.2.105:0/1199149024 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f23e0003820 0x7f23e0003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:12.940 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23ebfff700 1 --2- 172.21.2.105:0/1199149024 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f23e0004500 0x7f23e0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:12.940 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23ebfff700 1 --2- 172.21.2.105:0/1199149024 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f23e0005050 0x7f23e000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:12.940 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23ebfff700 1 -- 172.21.2.105:0/1199149024 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f80b0990 con 0x7f23e0004500 2021-11-12T05:49:12.940 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23ebfff700 1 -- 172.21.2.105:0/1199149024 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e000bf40 con 0x7f23e0003820 2021-11-12T05:49:12.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23ebfff700 1 -- 172.21.2.105:0/1199149024 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e000c100 con 0x7f23e0005050 2021-11-12T05:49:12.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23fcbcb700 1 --2- 172.21.2.105:0/1199149024 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f23e0004500 0x7f23e0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:12.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23fd3cc700 1 --2- 172.21.2.105:0/1199149024 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f23e0003820 0x7f23e0003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:12.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23fcbcb700 1 -- 172.21.2.105:0/1199149024 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f23e0005050 msgr2=0x7f23e000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:12.942 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23fcbcb700 1 --2- 172.21.2.105:0/1199149024 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f23e0005050 0x7f23e000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:12.942 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23fcbcb700 1 -- 172.21.2.105:0/1199149024 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f23e0003820 msgr2=0x7f23e0003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:12.942 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23fcbcb700 1 --2- 172.21.2.105:0/1199149024 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f23e0003820 0x7f23e0003c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:12.942 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23fcbcb700 1 -- 172.21.2.105:0/1199149024 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e0003260 con 0x7f23e0004500 2021-11-12T05:49:12.942 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23fdbcd700 1 -- 172.21.2.105:0/1199149024 reap_dead start 2021-11-12T05:49:12.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23fcbcb700 1 --2- 172.21.2.105:0/1199149024 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f23e0004500 0x7f23e0004980 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7f23f4000f70 tx=0x7f23f40079e0).ready entity=mon.0 client_cookie=f986b5570fbfc23c server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:12.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23ebfff700 1 -- 172.21.2.105:0/1199149024 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23f4007cf0 con 0x7f23e0004500 2021-11-12T05:49:12.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23ebfff700 1 -- 172.21.2.105:0/1199149024 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f4014410 con 0x7f23e0004500 2021-11-12T05:49:12.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23ebfff700 1 -- 172.21.2.105:0/1199149024 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23f4014770 con 0x7f23e0004500 2021-11-12T05:49:12.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23ff630700 1 -- 172.21.2.105:0/1199149024 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f23e0004500 msgr2=0x7f23e0004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:12.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23ff630700 1 --2- 172.21.2.105:0/1199149024 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f23e0004500 0x7f23e0004980 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7f23f4000f70 tx=0x7f23f40079e0).stop 2021-11-12T05:49:12.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23ff630700 1 -- 172.21.2.105:0/1199149024 shutdown_connections 2021-11-12T05:49:12.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23ff630700 1 --2- 172.21.2.105:0/1199149024 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f23e0004500 0x7f23e0004980 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:12.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23ff630700 1 -- 172.21.2.105:0/1199149024 >> 172.21.2.105:0/1199149024 conn(0x7f23f805c490 msgr2=0x7f23f80b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:12.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23ff630700 1 -- 172.21.2.105:0/1199149024 shutdown_connections 2021-11-12T05:49:12.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.928+0000 7f23ff630700 1 -- 172.21.2.105:0/1199149024 wait complete. 2021-11-12T05:49:12.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.932+0000 7f23ff630700 1 Processor -- start 2021-11-12T05:49:12.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.932+0000 7f23ff630700 1 -- start start 2021-11-12T05:49:12.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.932+0000 7f23ff630700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f23e0004500 0x7f23f8065b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:12.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.932+0000 7f23ff630700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f23f80a71c0 0x7f23f80a96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:12.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.932+0000 7f23ff630700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f23f8156840 0x7f23f8156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:12.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.932+0000 7f23ff630700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f8154300 con 0x7f23f80a71c0 2021-11-12T05:49:12.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.932+0000 7f23ff630700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f8066190 con 0x7f23e0004500 2021-11-12T05:49:12.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.932+0000 7f23ff630700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f80a8fa0 con 0x7f23f8156840 2021-11-12T05:49:12.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.932+0000 7f23fcbcb700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f23f80a71c0 0x7f23f80a96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:12.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.932+0000 7f23fcbcb700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f23f80a71c0 0x7f23f80a96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51630/0 (socket says 172.21.2.105:51630) 2021-11-12T05:49:12.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.932+0000 7f23fcbcb700 1 -- 172.21.2.105:0/2947558030 learned_addr learned my addr 172.21.2.105:0/2947558030 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:12.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.932+0000 7f23fd3cc700 1 --2- 172.21.2.105:0/2947558030 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f23e0004500 0x7f23f8065b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:12.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.932+0000 7f23fdbcd700 1 --2- 172.21.2.105:0/2947558030 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f23f8156840 0x7f23f8156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:12.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.932+0000 7f23fcbcb700 1 -- 172.21.2.105:0/2947558030 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f23f8156840 msgr2=0x7f23f8156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:12.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.932+0000 7f23fcbcb700 1 --2- 172.21.2.105:0/2947558030 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f23f8156840 0x7f23f8156cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:12.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.932+0000 7f23fcbcb700 1 -- 172.21.2.105:0/2947558030 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f23e0004500 msgr2=0x7f23f8065b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:12.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.932+0000 7f23fcbcb700 1 --2- 172.21.2.105:0/2947558030 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f23e0004500 0x7f23f8065b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:12.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.932+0000 7f23fcbcb700 1 -- 172.21.2.105:0/2947558030 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f80a9240 con 0x7f23f80a71c0 2021-11-12T05:49:12.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.932+0000 7f23fcbcb700 1 --2- 172.21.2.105:0/2947558030 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f23f80a71c0 0x7f23f80a96e0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 rx=0x7f23f4000f70 tx=0x7f23f4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:12.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.932+0000 7f23ea7fc700 1 -- 172.21.2.105:0/2947558030 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23f40138c0 con 0x7f23f80a71c0 2021-11-12T05:49:12.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.932+0000 7f23ea7fc700 1 -- 172.21.2.105:0/2947558030 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f4013a20 con 0x7f23f80a71c0 2021-11-12T05:49:12.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.932+0000 7f23ea7fc700 1 -- 172.21.2.105:0/2947558030 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23f4013da0 con 0x7f23f80a71c0 2021-11-12T05:49:12.950 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.932+0000 7f23ff630700 1 -- 172.21.2.105:0/2947558030 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23f8067470 con 0x7f23f80a71c0 2021-11-12T05:49:12.950 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.932+0000 7f23ff630700 1 -- 172.21.2.105:0/2947558030 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23f8065010 con 0x7f23f80a71c0 2021-11-12T05:49:12.950 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.932+0000 7f23ff630700 1 -- 172.21.2.105:0/2947558030 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23f80a93d0 con 0x7f23f80a71c0 2021-11-12T05:49:12.950 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.932+0000 7f23ea7fc700 1 -- 172.21.2.105:0/2947558030 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f23f4022470 con 0x7f23f80a71c0 2021-11-12T05:49:12.951 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.932+0000 7f23ea7fc700 1 --2- 172.21.2.105:0/2947558030 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f23d8053610 0x7f23d8055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:12.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.932+0000 7f23ea7fc700 1 -- 172.21.2.105:0/2947558030 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f23f401c040 con 0x7f23f80a71c0 2021-11-12T05:49:12.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.932+0000 7f23fd3cc700 1 --2- 172.21.2.105:0/2947558030 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f23d8053610 0x7f23d8055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:12.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.932+0000 7f23fd3cc700 1 --2- 172.21.2.105:0/2947558030 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f23d8053610 0x7f23d8055ad0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f23ec00c000 tx=0x7f23ec009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:12.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:12.936+0000 7f23ea7fc700 1 -- 172.21.2.105:0/2947558030 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f23f4043c70 con 0x7f23f80a71c0 2021-11-12T05:49:13.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.020+0000 7f23ff630700 1 -- 172.21.2.105:0/2947558030 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f23f8057350 con 0x7f23f80a71c0 2021-11-12T05:49:13.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.020+0000 7f23ea7fc700 1 -- 172.21.2.105:0/2947558030 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v136) v1 ==== 92+0+10 (secure 0 0 0) 0x7f23f4027070 con 0x7f23f80a71c0 2021-11-12T05:49:13.024 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:49:13.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.020+0000 7f23ff630700 1 -- 172.21.2.105:0/2947558030 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f23d8053610 msgr2=0x7f23d8055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:13.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.020+0000 7f23ff630700 1 --2- 172.21.2.105:0/2947558030 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f23d8053610 0x7f23d8055ad0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f23ec00c000 tx=0x7f23ec009040).stop 2021-11-12T05:49:13.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.020+0000 7f23ff630700 1 -- 172.21.2.105:0/2947558030 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f23f80a71c0 msgr2=0x7f23f80a96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:13.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.020+0000 7f23ff630700 1 --2- 172.21.2.105:0/2947558030 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f23f80a71c0 0x7f23f80a96e0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 rx=0x7f23f4000f70 tx=0x7f23f4015000).stop 2021-11-12T05:49:13.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.020+0000 7f23ff630700 1 -- 172.21.2.105:0/2947558030 shutdown_connections 2021-11-12T05:49:13.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.020+0000 7f23ff630700 1 --2- 172.21.2.105:0/2947558030 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f23d8053610 0x7f23d8055ad0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:13.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.020+0000 7f23ff630700 1 --2- 172.21.2.105:0/2947558030 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f23f8156840 0x7f23f8156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:13.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.020+0000 7f23ff630700 1 --2- 172.21.2.105:0/2947558030 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f23f80a71c0 0x7f23f80a96e0 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:13.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.020+0000 7f23ff630700 1 --2- 172.21.2.105:0/2947558030 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f23e0004500 0x7f23f8065b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:13.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.020+0000 7f23ff630700 1 -- 172.21.2.105:0/2947558030 >> 172.21.2.105:0/2947558030 conn(0x7f23f805c490 msgr2=0x7f23f80b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:13.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.020+0000 7f23ff630700 1 -- 172.21.2.105:0/2947558030 shutdown_connections 2021-11-12T05:49:13.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.020+0000 7f23ff630700 1 -- 172.21.2.105:0/2947558030 wait complete. 2021-11-12T05:49:13.031 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-12T05:49:13.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.080+0000 7fc56a9bf700 1 Processor -- start 2021-11-12T05:49:13.084 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.080+0000 7fc56a9bf700 1 -- start start 2021-11-12T05:49:13.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.080+0000 7fc56a9bf700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc5640b37d0 0x7fc564141500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:13.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.080+0000 7fc56a9bf700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fc5641419f0 0x7fc5640b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:13.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.080+0000 7fc56a9bf700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5640b26e0 con 0x7fc564060100 2021-11-12T05:49:13.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.080+0000 7fc56a9bf700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5640604e0 con 0x7fc5641419f0 2021-11-12T05:49:13.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.080+0000 7fc56a9bf700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc564145160 con 0x7fc5640b37d0 2021-11-12T05:49:13.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.080+0000 7fc563fff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fc564060100 0x7fc5640b1fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:33800/0 (socket says 172.21.2.105:33800) 2021-11-12T05:49:13.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.080+0000 7fc563fff700 1 -- 172.21.2.105:0/2660713952 learned_addr learned my addr 172.21.2.105:0/2660713952 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:13.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.080+0000 7fc568f5c700 1 --2- 172.21.2.105:0/2660713952 >> v2:172.21.2.105:3300/0 conn(0x7fc5641419f0 0x7fc5640b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:13.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.080+0000 7fc568f5c700 1 -- 172.21.2.105:0/2660713952 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc5640b37d0 msgr2=0x7fc564141500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:13.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.080+0000 7fc568f5c700 1 --2- 172.21.2.105:0/2660713952 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc5640b37d0 0x7fc564141500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:13.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.080+0000 7fc562ffd700 1 -- 172.21.2.105:0/2660713952 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1627349418 0 0) 0x7fc5640b26e0 con 0x7fc564060100 2021-11-12T05:49:13.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.080+0000 7fc568f5c700 1 -- 172.21.2.105:0/2660713952 >> v1:172.21.2.105:6789/0 conn(0x7fc564060100 legacy=0x7fc5640b1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:13.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.080+0000 7fc568f5c700 1 -- 172.21.2.105:0/2660713952 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc564141060 con 0x7fc5641419f0 2021-11-12T05:49:13.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.080+0000 7fc568f5c700 1 --2- 172.21.2.105:0/2660713952 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc5641419f0 0x7fc5640b3f50 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7fc55c0032f0 tx=0x7fc55c0091d0).ready entity=mon.0 client_cookie=b0e723feea3ea75c server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:13.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.080+0000 7fc562ffd700 1 -- 172.21.2.105:0/2660713952 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc55c009ea0 con 0x7fc5641419f0 2021-11-12T05:49:13.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.080+0000 7fc562ffd700 1 -- 172.21.2.105:0/2660713952 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc55c00b8a0 con 0x7fc5641419f0 2021-11-12T05:49:13.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.080+0000 7fc562ffd700 1 -- 172.21.2.105:0/2660713952 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc55c00ba10 con 0x7fc5641419f0 2021-11-12T05:49:13.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.080+0000 7fc56a9bf700 1 -- 172.21.2.105:0/2660713952 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc5641419f0 msgr2=0x7fc5640b3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:13.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.080+0000 7fc56a9bf700 1 --2- 172.21.2.105:0/2660713952 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc5641419f0 0x7fc5640b3f50 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7fc55c0032f0 tx=0x7fc55c0091d0).stop 2021-11-12T05:49:13.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.080+0000 7fc56a9bf700 1 -- 172.21.2.105:0/2660713952 shutdown_connections 2021-11-12T05:49:13.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.080+0000 7fc56a9bf700 1 --2- 172.21.2.105:0/2660713952 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc5641419f0 0x7fc5640b3f50 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:13.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.080+0000 7fc56a9bf700 1 --2- 172.21.2.105:0/2660713952 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc5640b37d0 0x7fc564141500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:13.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.080+0000 7fc56a9bf700 1 -- 172.21.2.105:0/2660713952 >> 172.21.2.105:0/2660713952 conn(0x7fc5640608d0 msgr2=0x7fc56405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:13.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.080+0000 7fc56a9bf700 1 -- 172.21.2.105:0/2660713952 shutdown_connections 2021-11-12T05:49:13.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.080+0000 7fc56a9bf700 1 -- 172.21.2.105:0/2660713952 wait complete. 2021-11-12T05:49:13.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.080+0000 7fc56a9bf700 1 Processor -- start 2021-11-12T05:49:13.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.084+0000 7fc56a9bf700 1 -- start start 2021-11-12T05:49:13.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.084+0000 7fc56a9bf700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc564060100 0x7fc564150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:13.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.084+0000 7fc56a9bf700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc5640b37d0 0x7fc5641278b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:13.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.084+0000 7fc56a9bf700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc5641419f0 0x7fc564127da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:13.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.084+0000 7fc56a9bf700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc564151140 con 0x7fc564060100 2021-11-12T05:49:13.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.084+0000 7fc56a9bf700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5640aea10 con 0x7fc5641419f0 2021-11-12T05:49:13.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.084+0000 7fc56a9bf700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5640aec70 con 0x7fc5640b37d0 2021-11-12T05:49:13.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.084+0000 7fc563fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc564060100 0x7fc564150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:13.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.084+0000 7fc563fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc564060100 0x7fc564150c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51642/0 (socket says 172.21.2.105:51642) 2021-11-12T05:49:13.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.084+0000 7fc563fff700 1 -- 172.21.2.105:0/2987806172 learned_addr learned my addr 172.21.2.105:0/2987806172 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:13.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.084+0000 7fc563fff700 1 -- 172.21.2.105:0/2987806172 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc5640b37d0 msgr2=0x7fc5641278b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:49:13.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.084+0000 7fc563fff700 1 --2- 172.21.2.105:0/2987806172 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc5640b37d0 0x7fc5641278b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:13.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.084+0000 7fc563fff700 1 -- 172.21.2.105:0/2987806172 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc5641419f0 msgr2=0x7fc564127da0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:49:13.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.084+0000 7fc563fff700 1 --2- 172.21.2.105:0/2987806172 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc5641419f0 0x7fc564127da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:13.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.084+0000 7fc563fff700 1 -- 172.21.2.105:0/2987806172 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc55c009470 con 0x7fc564060100 2021-11-12T05:49:13.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.084+0000 7fc563fff700 1 --2- 172.21.2.105:0/2987806172 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc564060100 0x7fc564150c50 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 rx=0x7fc554000bc0 tx=0x7fc554007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:13.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.084+0000 7fc5617fa700 1 -- 172.21.2.105:0/2987806172 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc55400ce50 con 0x7fc564060100 2021-11-12T05:49:13.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.084+0000 7fc5617fa700 1 -- 172.21.2.105:0/2987806172 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5540072e0 con 0x7fc564060100 2021-11-12T05:49:13.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.084+0000 7fc5617fa700 1 -- 172.21.2.105:0/2987806172 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc554005800 con 0x7fc564060100 2021-11-12T05:49:13.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.084+0000 7fc56a9bf700 1 -- 172.21.2.105:0/2987806172 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5640aef10 con 0x7fc564060100 2021-11-12T05:49:13.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.084+0000 7fc56a9bf700 1 -- 172.21.2.105:0/2987806172 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc564145360 con 0x7fc564060100 2021-11-12T05:49:13.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.084+0000 7fc56a9bf700 1 -- 172.21.2.105:0/2987806172 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc564141e80 con 0x7fc564060100 2021-11-12T05:49:13.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.084+0000 7fc5617fa700 1 -- 172.21.2.105:0/2987806172 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc55401a060 con 0x7fc564060100 2021-11-12T05:49:13.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.084+0000 7fc5617fa700 1 --2- 172.21.2.105:0/2987806172 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc548053540 0x7fc548055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:13.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.084+0000 7fc5617fa700 1 -- 172.21.2.105:0/2987806172 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fc55406b440 con 0x7fc564060100 2021-11-12T05:49:13.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.084+0000 7fc5637fe700 1 --2- 172.21.2.105:0/2987806172 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc548053540 0x7fc548055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:13.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.084+0000 7fc5637fe700 1 --2- 172.21.2.105:0/2987806172 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc548053540 0x7fc548055a00 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7fc54c002f70 tx=0x7fc54c006a00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:13.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.088+0000 7fc5617fa700 1 -- 172.21.2.105:0/2987806172 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc554042340 con 0x7fc564060100 2021-11-12T05:49:13.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.168+0000 7fc56a9bf700 1 -- 172.21.2.105:0/2987806172 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc564057350 con 0x7fc564060100 2021-11-12T05:49:13.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.168+0000 7fc5617fa700 1 -- 172.21.2.105:0/2987806172 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v136) v1 ==== 104+0+10 (secure 0 0 0) 0x7fc5540180a0 con 0x7fc564060100 2021-11-12T05:49:13.175 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:49:13.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.172+0000 7fc56a9bf700 1 -- 172.21.2.105:0/2987806172 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc548053540 msgr2=0x7fc548055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:13.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.172+0000 7fc56a9bf700 1 --2- 172.21.2.105:0/2987806172 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc548053540 0x7fc548055a00 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7fc54c002f70 tx=0x7fc54c006a00).stop 2021-11-12T05:49:13.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.172+0000 7fc56a9bf700 1 -- 172.21.2.105:0/2987806172 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc564060100 msgr2=0x7fc564150c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:13.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.172+0000 7fc56a9bf700 1 --2- 172.21.2.105:0/2987806172 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc564060100 0x7fc564150c50 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 rx=0x7fc554000bc0 tx=0x7fc554007a60).stop 2021-11-12T05:49:13.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.172+0000 7fc56a9bf700 1 -- 172.21.2.105:0/2987806172 shutdown_connections 2021-11-12T05:49:13.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.172+0000 7fc56a9bf700 1 --2- 172.21.2.105:0/2987806172 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc548053540 0x7fc548055a00 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:13.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.172+0000 7fc56a9bf700 1 --2- 172.21.2.105:0/2987806172 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc5641419f0 0x7fc564127da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:13.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.172+0000 7fc56a9bf700 1 --2- 172.21.2.105:0/2987806172 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc5640b37d0 0x7fc5641278b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:13.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.172+0000 7fc56a9bf700 1 --2- 172.21.2.105:0/2987806172 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc564060100 0x7fc564150c50 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:13.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.172+0000 7fc56a9bf700 1 -- 172.21.2.105:0/2987806172 >> 172.21.2.105:0/2987806172 conn(0x7fc5640608d0 msgr2=0x7fc5640b1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:13.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.172+0000 7fc56a9bf700 1 -- 172.21.2.105:0/2987806172 shutdown_connections 2021-11-12T05:49:13.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.172+0000 7fc56a9bf700 1 -- 172.21.2.105:0/2987806172 wait complete. 2021-11-12T05:49:13.182 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-12T05:49:13.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.228+0000 7fc43d607700 1 Processor -- start 2021-11-12T05:49:13.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.228+0000 7fc43d607700 1 -- start start 2021-11-12T05:49:13.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.228+0000 7fc43d607700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc4380aca40 0x7fc4380ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:13.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.228+0000 7fc43d607700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fc438144180 0x7fc438144610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:13.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.228+0000 7fc43d607700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4380b1840 con 0x7fc4380b0520 2021-11-12T05:49:13.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.228+0000 7fc43d607700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4380af2b0 con 0x7fc438144180 2021-11-12T05:49:13.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.228+0000 7fc43d607700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4380b09a0 con 0x7fc4380aca40 2021-11-12T05:49:13.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.228+0000 7fc4367fc700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fc4380b0520 0x7fc4381473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:33816/0 (socket says 172.21.2.105:33816) 2021-11-12T05:49:13.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.228+0000 7fc4367fc700 1 -- 172.21.2.105:0/389833213 learned_addr learned my addr 172.21.2.105:0/389833213 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:13.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc435ffb700 1 -- 172.21.2.105:0/389833213 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4067563037 0 0) 0x7fc4380b1840 con 0x7fc4380b0520 2021-11-12T05:49:13.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc435ffb700 1 -- 172.21.2.105:0/389833213 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc418003260 con 0x7fc4380b0520 2021-11-12T05:49:13.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc436ffd700 1 --2- 172.21.2.105:0/389833213 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc4380aca40 0x7fc4380ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:13.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc4377fe700 1 --2- 172.21.2.105:0/389833213 >> v2:172.21.2.115:3300/0 conn(0x7fc438144180 0x7fc438144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:13.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc435ffb700 1 -- 172.21.2.105:0/389833213 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 834583877 0 0) 0x7fc418003260 con 0x7fc4380b0520 2021-11-12T05:49:13.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc435ffb700 1 -- 172.21.2.105:0/389833213 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc4380aca40 msgr2=0x7fc4380ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:13.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc435ffb700 1 --2- 172.21.2.105:0/389833213 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc4380aca40 0x7fc4380ace20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:13.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc435ffb700 1 -- 172.21.2.105:0/389833213 >> v2:172.21.2.115:3300/0 conn(0x7fc438144180 msgr2=0x7fc438144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:13.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc435ffb700 1 --2- 172.21.2.105:0/389833213 >> v2:172.21.2.115:3300/0 conn(0x7fc438144180 0x7fc438144610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:13.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc435ffb700 1 -- 172.21.2.105:0/389833213 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4380b1a70 con 0x7fc4380b0520 2021-11-12T05:49:13.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc435ffb700 1 -- 172.21.2.105:0/389833213 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fc420001660 con 0x7fc4380b0520 2021-11-12T05:49:13.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc435ffb700 1 -- 172.21.2.105:0/389833213 >> v1:172.21.2.105:6789/0 conn(0x7fc4380b0520 legacy=0x7fc4381473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:13.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc435ffb700 1 --2- 172.21.2.105:0/389833213 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc4180037d0 0x7fc418003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:13.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc435ffb700 1 --2- 172.21.2.105:0/389833213 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc4380aca40 0x7fc418004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:13.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc435ffb700 1 --2- 172.21.2.105:0/389833213 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc4180049f0 0x7fc418004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:13.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc435ffb700 1 -- 172.21.2.105:0/389833213 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4380af2b0 con 0x7fc4180037d0 2021-11-12T05:49:13.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc435ffb700 1 -- 172.21.2.105:0/389833213 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4380b09a0 con 0x7fc4180049f0 2021-11-12T05:49:13.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc435ffb700 1 -- 172.21.2.105:0/389833213 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc41800b7d0 con 0x7fc4380aca40 2021-11-12T05:49:13.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc436ffd700 1 --2- 172.21.2.105:0/389833213 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc4180037d0 0x7fc418003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:13.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc436ffd700 1 -- 172.21.2.105:0/389833213 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc4380aca40 msgr2=0x7fc418004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:13.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc436ffd700 1 --2- 172.21.2.105:0/389833213 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc4380aca40 0x7fc418004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:13.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc436ffd700 1 -- 172.21.2.105:0/389833213 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc4180049f0 msgr2=0x7fc418004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:13.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc436ffd700 1 --2- 172.21.2.105:0/389833213 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc4180049f0 0x7fc418004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:13.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc436ffd700 1 -- 172.21.2.105:0/389833213 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc418003260 con 0x7fc4180037d0 2021-11-12T05:49:13.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc436ffd700 1 --2- 172.21.2.105:0/389833213 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc4180037d0 0x7fc418003bf0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7fc42800c000 tx=0x7fc428006df0).ready entity=mon.0 client_cookie=aa723bbf399abe3c server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:13.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc435ffb700 1 -- 172.21.2.105:0/389833213 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc42800e830 con 0x7fc4180037d0 2021-11-12T05:49:13.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc435ffb700 1 -- 172.21.2.105:0/389833213 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42800e990 con 0x7fc4180037d0 2021-11-12T05:49:13.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc435ffb700 1 -- 172.21.2.105:0/389833213 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc42800ecf0 con 0x7fc4180037d0 2021-11-12T05:49:13.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc43d607700 1 -- 172.21.2.105:0/389833213 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc4180037d0 msgr2=0x7fc418003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:13.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc43d607700 1 --2- 172.21.2.105:0/389833213 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc4180037d0 0x7fc418003bf0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7fc42800c000 tx=0x7fc428006df0).stop 2021-11-12T05:49:13.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc4377fe700 1 -- 172.21.2.105:0/389833213 reap_dead start 2021-11-12T05:49:13.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc43d607700 1 -- 172.21.2.105:0/389833213 shutdown_connections 2021-11-12T05:49:13.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc43d607700 1 -- 172.21.2.105:0/389833213 >> 172.21.2.105:0/389833213 conn(0x7fc43805c490 msgr2=0x7fc4380b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:13.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc43d607700 1 -- 172.21.2.105:0/389833213 shutdown_connections 2021-11-12T05:49:13.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc43d607700 1 -- 172.21.2.105:0/389833213 wait complete. 2021-11-12T05:49:13.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc43d607700 1 Processor -- start 2021-11-12T05:49:13.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc43d607700 1 -- start start 2021-11-12T05:49:13.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc43d607700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc4180037d0 0x7fc4381569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:13.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc43d607700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc438144590 0x7fc438146900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:13.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc43d607700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc4380627a0 0x7fc4381454f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:13.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc43d607700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc438157c10 con 0x7fc4380627a0 2021-11-12T05:49:13.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc43d607700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc438144b10 con 0x7fc438144590 2021-11-12T05:49:13.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc43d607700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc438144db0 con 0x7fc4180037d0 2021-11-12T05:49:13.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc4377fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc4380627a0 0x7fc4381454f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:13.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc4377fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc4380627a0 0x7fc4381454f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51662/0 (socket says 172.21.2.105:51662) 2021-11-12T05:49:13.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.232+0000 7fc4377fe700 1 -- 172.21.2.105:0/2051140647 learned_addr learned my addr 172.21.2.105:0/2051140647 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:13.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.236+0000 7fc4377fe700 1 -- 172.21.2.105:0/2051140647 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc4180037d0 msgr2=0x7fc4381569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:13.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.236+0000 7fc4377fe700 1 --2- 172.21.2.105:0/2051140647 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc4180037d0 0x7fc4381569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:13.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.236+0000 7fc4377fe700 1 -- 172.21.2.105:0/2051140647 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc438144590 msgr2=0x7fc438146900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:13.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.236+0000 7fc4377fe700 1 --2- 172.21.2.105:0/2051140647 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc438144590 0x7fc438146900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:13.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.236+0000 7fc4377fe700 1 -- 172.21.2.105:0/2051140647 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc438145050 con 0x7fc4380627a0 2021-11-12T05:49:13.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.236+0000 7fc4377fe700 1 --2- 172.21.2.105:0/2051140647 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc4380627a0 0x7fc4381454f0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 rx=0x7fc430000b60 tx=0x7fc430008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:13.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.236+0000 7fc42ffff700 1 -- 172.21.2.105:0/2051140647 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc43000c070 con 0x7fc4380627a0 2021-11-12T05:49:13.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.236+0000 7fc42ffff700 1 -- 172.21.2.105:0/2051140647 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4300135e0 con 0x7fc4380627a0 2021-11-12T05:49:13.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.236+0000 7fc43d607700 1 -- 172.21.2.105:0/2051140647 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4381459e0 con 0x7fc4380627a0 2021-11-12T05:49:13.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.236+0000 7fc42ffff700 1 -- 172.21.2.105:0/2051140647 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc430013940 con 0x7fc4380627a0 2021-11-12T05:49:13.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.236+0000 7fc43d607700 1 -- 172.21.2.105:0/2051140647 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc438145e90 con 0x7fc4380627a0 2021-11-12T05:49:13.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.236+0000 7fc43d607700 1 -- 172.21.2.105:0/2051140647 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4381451e0 con 0x7fc4380627a0 2021-11-12T05:49:13.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.236+0000 7fc42ffff700 1 -- 172.21.2.105:0/2051140647 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc43001b030 con 0x7fc4380627a0 2021-11-12T05:49:13.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.236+0000 7fc42ffff700 1 --2- 172.21.2.105:0/2051140647 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc41c0536a0 0x7fc41c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:13.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.236+0000 7fc42ffff700 1 -- 172.21.2.105:0/2051140647 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fc43006aef0 con 0x7fc4380627a0 2021-11-12T05:49:13.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.236+0000 7fc436ffd700 1 --2- 172.21.2.105:0/2051140647 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc41c0536a0 0x7fc41c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:13.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.236+0000 7fc436ffd700 1 --2- 172.21.2.105:0/2051140647 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc41c0536a0 0x7fc41c055b60 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7fc42800c000 tx=0x7fc428019000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:13.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.240+0000 7fc42ffff700 1 -- 172.21.2.105:0/2051140647 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc430041f00 con 0x7fc4380627a0 2021-11-12T05:49:13.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.320+0000 7fc43d607700 1 -- 172.21.2.105:0/2051140647 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc438057350 con 0x7fc4380627a0 2021-11-12T05:49:13.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.324+0000 7fc42ffff700 1 -- 172.21.2.105:0/2051140647 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v136) v1 ==== 100+0+10 (secure 0 0 0) 0x7fc430045520 con 0x7fc4380627a0 2021-11-12T05:49:13.327 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:49:13.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.324+0000 7fc43d607700 1 -- 172.21.2.105:0/2051140647 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc41c0536a0 msgr2=0x7fc41c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:13.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.324+0000 7fc43d607700 1 --2- 172.21.2.105:0/2051140647 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc41c0536a0 0x7fc41c055b60 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7fc42800c000 tx=0x7fc428019000).stop 2021-11-12T05:49:13.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.324+0000 7fc43d607700 1 -- 172.21.2.105:0/2051140647 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc4380627a0 msgr2=0x7fc4381454f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:13.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.324+0000 7fc43d607700 1 --2- 172.21.2.105:0/2051140647 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc4380627a0 0x7fc4381454f0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 rx=0x7fc430000b60 tx=0x7fc430008040).stop 2021-11-12T05:49:13.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.324+0000 7fc43d607700 1 -- 172.21.2.105:0/2051140647 shutdown_connections 2021-11-12T05:49:13.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.324+0000 7fc43d607700 1 --2- 172.21.2.105:0/2051140647 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc41c0536a0 0x7fc41c055b60 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:13.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.324+0000 7fc43d607700 1 --2- 172.21.2.105:0/2051140647 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc4380627a0 0x7fc4381454f0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:13.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.324+0000 7fc43d607700 1 --2- 172.21.2.105:0/2051140647 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc438144590 0x7fc438146900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:13.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.324+0000 7fc43d607700 1 --2- 172.21.2.105:0/2051140647 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc4180037d0 0x7fc4381569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:13.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.324+0000 7fc43d607700 1 -- 172.21.2.105:0/2051140647 >> 172.21.2.105:0/2051140647 conn(0x7fc43805c490 msgr2=0x7fc4381436e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:13.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.324+0000 7fc43d607700 1 -- 172.21.2.105:0/2051140647 shutdown_connections 2021-11-12T05:49:13.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.324+0000 7fc43d607700 1 -- 172.21.2.105:0/2051140647 wait complete. 2021-11-12T05:49:13.334 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-12T05:49:13.335 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:49:13.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.380+0000 7fd4f144e700 1 Processor -- start 2021-11-12T05:49:13.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.380+0000 7fd4f144e700 1 -- start start 2021-11-12T05:49:13.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.380+0000 7fd4f144e700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd4ec066be0 0x7fd4ec1426b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:13.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.380+0000 7fd4f144e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd4ec0b1380 0x7fd4ec142ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:13.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.380+0000 7fd4f144e700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4ec0ac7b0 con 0x7fd4ec0acd20 2021-11-12T05:49:13.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.380+0000 7fd4f144e700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4ec0b0140 con 0x7fd4ec066be0 2021-11-12T05:49:13.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.380+0000 7fd4f144e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec066fc0 con 0x7fd4ec0b1380 2021-11-12T05:49:13.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.380+0000 7fd4eb7fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fd4ec0acd20 0x7fd4ec0adf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:33834/0 (socket says 172.21.2.105:33834) 2021-11-12T05:49:13.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.380+0000 7fd4eb7fe700 1 -- 172.21.2.105:0/3208427908 learned_addr learned my addr 172.21.2.105:0/3208427908 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:13.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.380+0000 7fd4eaffd700 1 --2- 172.21.2.105:0/3208427908 >> v2:172.21.2.105:3300/0 conn(0x7fd4ec066be0 0x7fd4ec1426b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:13.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.380+0000 7fd4e9ffb700 1 -- 172.21.2.105:0/3208427908 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4222316514 0 0) 0x7fd4ec0ac7b0 con 0x7fd4ec0acd20 2021-11-12T05:49:13.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.380+0000 7fd4e9ffb700 1 -- 172.21.2.105:0/3208427908 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4cc003260 con 0x7fd4ec0acd20 2021-11-12T05:49:13.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.380+0000 7fd4eaffd700 1 -- 172.21.2.105:0/3208427908 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd4ec0b1380 msgr2=0x7fd4ec142ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:13.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.380+0000 7fd4eaffd700 1 --2- 172.21.2.105:0/3208427908 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd4ec0b1380 0x7fd4ec142ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:13.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.380+0000 7fd4eaffd700 1 -- 172.21.2.105:0/3208427908 >> v1:172.21.2.105:6789/0 conn(0x7fd4ec0acd20 legacy=0x7fd4ec0adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:13.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.380+0000 7fd4eaffd700 1 -- 172.21.2.105:0/3208427908 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ec0afd10 con 0x7fd4ec066be0 2021-11-12T05:49:13.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.380+0000 7fd4eaffd700 1 --2- 172.21.2.105:0/3208427908 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd4ec066be0 0x7fd4ec1426b0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 rx=0x7fd4d4002f70 tx=0x7fd4d4006df0).ready entity=mon.0 client_cookie=41128f13ce959f7b server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:13.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.384+0000 7fd4e9ffb700 1 -- 172.21.2.105:0/3208427908 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4d400d570 con 0x7fd4ec066be0 2021-11-12T05:49:13.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.384+0000 7fd4e9ffb700 1 -- 172.21.2.105:0/3208427908 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d4000e90 con 0x7fd4ec066be0 2021-11-12T05:49:13.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.384+0000 7fd4e9ffb700 1 -- 172.21.2.105:0/3208427908 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4d400d8c0 con 0x7fd4ec066be0 2021-11-12T05:49:13.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.384+0000 7fd4f144e700 1 -- 172.21.2.105:0/3208427908 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd4ec066be0 msgr2=0x7fd4ec1426b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:13.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.384+0000 7fd4f144e700 1 --2- 172.21.2.105:0/3208427908 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd4ec066be0 0x7fd4ec1426b0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 rx=0x7fd4d4002f70 tx=0x7fd4d4006df0).stop 2021-11-12T05:49:13.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.384+0000 7fd4f144e700 1 -- 172.21.2.105:0/3208427908 shutdown_connections 2021-11-12T05:49:13.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.384+0000 7fd4f144e700 1 --2- 172.21.2.105:0/3208427908 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd4ec0b1380 0x7fd4ec142ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:13.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.384+0000 7fd4f144e700 1 --2- 172.21.2.105:0/3208427908 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd4ec066be0 0x7fd4ec1426b0 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:13.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.384+0000 7fd4f144e700 1 -- 172.21.2.105:0/3208427908 >> 172.21.2.105:0/3208427908 conn(0x7fd4ec0b5370 msgr2=0x7fd4ec0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:13.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.384+0000 7fd4f144e700 1 -- 172.21.2.105:0/3208427908 shutdown_connections 2021-11-12T05:49:13.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.384+0000 7fd4f144e700 1 -- 172.21.2.105:0/3208427908 wait complete. 2021-11-12T05:49:13.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.384+0000 7fd4f144e700 1 Processor -- start 2021-11-12T05:49:13.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.384+0000 7fd4f144e700 1 -- start start 2021-11-12T05:49:13.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.384+0000 7fd4f144e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd4ec066be0 0x7fd4ec148c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:13.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.384+0000 7fd4f144e700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd4ec0acd20 0x7fd4ec0a13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:13.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.384+0000 7fd4f144e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd4ec0b1380 0x7fd4ec0a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:13.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.384+0000 7fd4f144e700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec0a38e0 con 0x7fd4ec0b1380 2021-11-12T05:49:13.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.384+0000 7fd4f144e700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec0a01a0 con 0x7fd4ec0acd20 2021-11-12T05:49:13.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.384+0000 7fd4f144e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec1493d0 con 0x7fd4ec066be0 2021-11-12T05:49:13.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.384+0000 7fd4eb7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd4ec0b1380 0x7fd4ec0a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:13.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.384+0000 7fd4eb7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd4ec0b1380 0x7fd4ec0a18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51676/0 (socket says 172.21.2.105:51676) 2021-11-12T05:49:13.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.384+0000 7fd4eb7fe700 1 -- 172.21.2.105:0/3549072749 learned_addr learned my addr 172.21.2.105:0/3549072749 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:13.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.384+0000 7fd4eb7fe700 1 -- 172.21.2.105:0/3549072749 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd4ec066be0 msgr2=0x7fd4ec148c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:13.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.384+0000 7fd4eb7fe700 1 --2- 172.21.2.105:0/3549072749 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd4ec066be0 0x7fd4ec148c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:13.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.384+0000 7fd4eb7fe700 1 -- 172.21.2.105:0/3549072749 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd4ec0acd20 msgr2=0x7fd4ec0a13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:13.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.384+0000 7fd4eb7fe700 1 --2- 172.21.2.105:0/3549072749 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd4ec0acd20 0x7fd4ec0a13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:13.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.384+0000 7fd4eb7fe700 1 -- 172.21.2.105:0/3549072749 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d400b180 con 0x7fd4ec0b1380 2021-11-12T05:49:13.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.384+0000 7fd4eb7fe700 1 --2- 172.21.2.105:0/3549072749 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd4ec0b1380 0x7fd4ec0a18c0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7fd4e4001110 tx=0x7fd4e4007a20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:13.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.384+0000 7fd4e3fff700 1 -- 172.21.2.105:0/3549072749 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4e40070d0 con 0x7fd4ec0b1380 2021-11-12T05:49:13.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.384+0000 7fd4e3fff700 1 -- 172.21.2.105:0/3549072749 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e4007230 con 0x7fd4ec0b1380 2021-11-12T05:49:13.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.384+0000 7fd4f144e700 1 -- 172.21.2.105:0/3549072749 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4ec0a3640 con 0x7fd4ec0b1380 2021-11-12T05:49:13.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.384+0000 7fd4e3fff700 1 -- 172.21.2.105:0/3549072749 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4e4005610 con 0x7fd4ec0b1380 2021-11-12T05:49:13.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.384+0000 7fd4f144e700 1 -- 172.21.2.105:0/3549072749 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4ec149180 con 0x7fd4ec0b1380 2021-11-12T05:49:13.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.384+0000 7fd4f144e700 1 -- 172.21.2.105:0/3549072749 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4ec0a1f50 con 0x7fd4ec0b1380 2021-11-12T05:49:13.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.384+0000 7fd4e3fff700 1 -- 172.21.2.105:0/3549072749 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd4e4010070 con 0x7fd4ec0b1380 2021-11-12T05:49:13.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.384+0000 7fd4e3fff700 1 --2- 172.21.2.105:0/3549072749 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd4d0053610 0x7fd4d0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:13.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.384+0000 7fd4e3fff700 1 -- 172.21.2.105:0/3549072749 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fd4e406b080 con 0x7fd4ec0b1380 2021-11-12T05:49:13.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.384+0000 7fd4eaffd700 1 --2- 172.21.2.105:0/3549072749 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd4d0053610 0x7fd4d0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:13.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.388+0000 7fd4eaffd700 1 --2- 172.21.2.105:0/3549072749 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd4d0053610 0x7fd4d0055ad0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7fd4d4002f70 tx=0x7fd4d4014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:13.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.388+0000 7fd4e3fff700 1 -- 172.21.2.105:0/3549072749 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd4e4042090 con 0x7fd4ec0b1380 2021-11-12T05:49:13.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.496+0000 7fd4f144e700 1 -- 172.21.2.105:0/3549072749 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd4ec0ac9e0 con 0x7fd4ec0b1380 2021-11-12T05:49:13.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.496+0000 7fd4e3fff700 1 -- 172.21.2.105:0/3549072749 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2139 (secure 0 0 0) 0x7fd4e40456b0 con 0x7fd4ec0b1380 2021-11-12T05:49:13.502 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:13.502 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":65,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4979,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/2405231908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":2405231908},{"type":"v1","addr":"172.21.2.115:6833","nonce":2405231908}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":63}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:49:07.486433+0000","modified":"2021-11-12T05:49:08.490302+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8115},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8115":{"gid":8115,"name":"a","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/737863904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":737863904},{"type":"v1","addr":"172.21.2.105:6835","nonce":737863904}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-11-12T05:49:13.504 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.496+0000 7fd4f144e700 1 -- 172.21.2.105:0/3549072749 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd4d0053610 msgr2=0x7fd4d0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:13.504 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.496+0000 7fd4f144e700 1 --2- 172.21.2.105:0/3549072749 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd4d0053610 0x7fd4d0055ad0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7fd4d4002f70 tx=0x7fd4d4014000).stop 2021-11-12T05:49:13.504 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.496+0000 7fd4f144e700 1 -- 172.21.2.105:0/3549072749 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd4ec0b1380 msgr2=0x7fd4ec0a18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:13.504 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.496+0000 7fd4f144e700 1 --2- 172.21.2.105:0/3549072749 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd4ec0b1380 0x7fd4ec0a18c0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7fd4e4001110 tx=0x7fd4e4007a20).stop 2021-11-12T05:49:13.504 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.496+0000 7fd4f144e700 1 -- 172.21.2.105:0/3549072749 shutdown_connections 2021-11-12T05:49:13.505 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.496+0000 7fd4f144e700 1 --2- 172.21.2.105:0/3549072749 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd4d0053610 0x7fd4d0055ad0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:13.505 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.496+0000 7fd4f144e700 1 --2- 172.21.2.105:0/3549072749 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd4ec0b1380 0x7fd4ec0a18c0 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:13.505 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.496+0000 7fd4f144e700 1 --2- 172.21.2.105:0/3549072749 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd4ec0acd20 0x7fd4ec0a13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:13.505 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.496+0000 7fd4f144e700 1 --2- 172.21.2.105:0/3549072749 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd4ec066be0 0x7fd4ec148c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:13.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.496+0000 7fd4f144e700 1 -- 172.21.2.105:0/3549072749 >> 172.21.2.105:0/3549072749 conn(0x7fd4ec0b5370 msgr2=0x7fd4ec05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:13.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.496+0000 7fd4f144e700 1 -- 172.21.2.105:0/3549072749 shutdown_connections 2021-11-12T05:49:13.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:13.496+0000 7fd4f144e700 1 -- 172.21.2.105:0/3549072749 wait complete. 2021-11-12T05:49:13.506 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 65 2021-11-12T05:49:13.711 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 65, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:49:07.486433+0000', 'modified': '2021-11-12T05:49:08.490302+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8115}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8115': {'gid': 8115, 'name': 'a', 'rank': 0, 'incarnation': 64, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/737863904', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 737863904}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 737863904}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:49:13.712 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:49:13.712 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:49:13.791 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":8115,"want_state":"up:active","state":"up:active","rank_uptime":6.2966777169999997,"mdsmap_epoch":65,"osdmap_epoch":136,"osdmap_epoch_barrier":134,"uptime":10.533505086} 2021-11-12T05:49:13.792 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 8115, "mdsmap_epoch": 65, "osdmap_epoch": 136, "osdmap_epoch_barrier": 134, "rank_uptime": 6.296677717, "state": "up:active", "uptime": 10.533505086, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:49:13.792 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-12T05:49:13.793 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-11-12T05:49:13.793 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@gibba038.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-11-12T05:49:13.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:13.794 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:49:13.804 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-12T05:49:13.816 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:49:13.816 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:49:13.822 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:49:13.823 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:49:13.824 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:13.824 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-12T05:49:13.828 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-12T05:49:13.829 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:49:13.873 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-12T05:49:13.881 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:49:13.882 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:49:13.887 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:49:13.888 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:49:13.889 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:13.889 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-12T05:49:13.912 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:2021-11-12T05:49:13.912+0000 7fde1f0be080 -1 init, newargv = 0x55698e6341a0 newargc=9 2021-11-12T05:49:13.912 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:ceph-fuse[14592]: starting ceph client 2021-11-12T05:49:13.925 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:ceph-fuse[14592]: starting fuse 2021-11-12T05:49:15.016 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-12T05:49:15.028 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:49:15.028 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:49:15.078 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:49:15.078 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:49:15.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:15.080 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-12T05:49:15.085 INFO:teuthology.orchestra.run.gibba038.stdout:52 2021-11-12T05:49:15.085 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-12T05:49:15.086 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:15.086 DEBUG:teuthology.orchestra.run.gibba038:> sudo python3 -c ' 2021-11-12T05:49:15.087 DEBUG:teuthology.orchestra.run.gibba038:> import glob 2021-11-12T05:49:15.087 DEBUG:teuthology.orchestra.run.gibba038:> import re 2021-11-12T05:49:15.088 DEBUG:teuthology.orchestra.run.gibba038:> import os 2021-11-12T05:49:15.088 DEBUG:teuthology.orchestra.run.gibba038:> import subprocess 2021-11-12T05:49:15.088 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:49:15.089 DEBUG:teuthology.orchestra.run.gibba038:> def find_socket(client_name): 2021-11-12T05:49:15.089 DEBUG:teuthology.orchestra.run.gibba038:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-11-12T05:49:15.090 DEBUG:teuthology.orchestra.run.gibba038:> files = glob.glob(asok_path) 2021-11-12T05:49:15.090 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:49:15.091 DEBUG:teuthology.orchestra.run.gibba038:> # Given a non-glob path, it better be there 2021-11-12T05:49:15.091 DEBUG:teuthology.orchestra.run.gibba038:> if "*" not in asok_path: 2021-11-12T05:49:15.091 DEBUG:teuthology.orchestra.run.gibba038:> assert(len(files) == 1) 2021-11-12T05:49:15.092 DEBUG:teuthology.orchestra.run.gibba038:> return files[0] 2021-11-12T05:49:15.092 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:49:15.093 DEBUG:teuthology.orchestra.run.gibba038:> for f in files: 2021-11-12T05:49:15.093 DEBUG:teuthology.orchestra.run.gibba038:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-12T05:49:15.094 DEBUG:teuthology.orchestra.run.gibba038:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-12T05:49:15.094 DEBUG:teuthology.orchestra.run.gibba038:> return f 2021-11-12T05:49:15.094 DEBUG:teuthology.orchestra.run.gibba038:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-12T05:49:15.095 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:49:15.095 DEBUG:teuthology.orchestra.run.gibba038:> print(find_socket("client.1")) 2021-11-12T05:49:15.096 DEBUG:teuthology.orchestra.run.gibba038:> ' 2021-11-12T05:49:15.162 INFO:teuthology.orchestra.run.gibba038.stdout:/var/run/ceph/ceph-client.1.14592.asok 2021-11-12T05:49:15.164 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14592.asok 2021-11-12T05:49:15.165 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:15.165 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14592.asok status 2021-11-12T05:49:15.212 INFO:teuthology.orchestra.run.gibba038.stdout:{ 2021-11-12T05:49:15.212 INFO:teuthology.orchestra.run.gibba038.stdout: "metadata": { 2021-11-12T05:49:15.213 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_sha1": "a81ee2815de5acae59ead5b8c9137b6766fc8ea8", 2021-11-12T05:49:15.213 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_version": "ceph version 15.2.15-22-ga81ee281 (a81ee2815de5acae59ead5b8c9137b6766fc8ea8) octopus (stable)", 2021-11-12T05:49:15.213 INFO:teuthology.orchestra.run.gibba038.stdout: "entity_id": "1", 2021-11-12T05:49:15.213 INFO:teuthology.orchestra.run.gibba038.stdout: "hostname": "gibba038", 2021-11-12T05:49:15.214 INFO:teuthology.orchestra.run.gibba038.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-11-12T05:49:15.214 INFO:teuthology.orchestra.run.gibba038.stdout: "pid": "14592", 2021-11-12T05:49:15.214 INFO:teuthology.orchestra.run.gibba038.stdout: "root": "/" 2021-11-12T05:49:15.214 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:49:15.214 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_count": 0, 2021-11-12T05:49:15.215 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_pinned_count": 0, 2021-11-12T05:49:15.215 INFO:teuthology.orchestra.run.gibba038.stdout: "id": 5431, 2021-11-12T05:49:15.215 INFO:teuthology.orchestra.run.gibba038.stdout: "inst": { 2021-11-12T05:49:15.215 INFO:teuthology.orchestra.run.gibba038.stdout: "name": { 2021-11-12T05:49:15.215 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "client", 2021-11-12T05:49:15.216 INFO:teuthology.orchestra.run.gibba038.stdout: "num": 5431 2021-11-12T05:49:15.216 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:49:15.216 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-12T05:49:15.216 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-12T05:49:15.216 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-12T05:49:15.217 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 45398140 2021-11-12T05:49:15.217 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-11-12T05:49:15.217 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:49:15.217 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-12T05:49:15.218 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-12T05:49:15.218 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-12T05:49:15.218 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 45398140 2021-11-12T05:49:15.218 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:49:15.218 INFO:teuthology.orchestra.run.gibba038.stdout: "inst_str": "client.5431 172.21.2.138:0/45398140", 2021-11-12T05:49:15.219 INFO:teuthology.orchestra.run.gibba038.stdout: "addr_str": "172.21.2.138:0/45398140", 2021-11-12T05:49:15.219 INFO:teuthology.orchestra.run.gibba038.stdout: "inode_count": 1, 2021-11-12T05:49:15.219 INFO:teuthology.orchestra.run.gibba038.stdout: "mds_epoch": 65, 2021-11-12T05:49:15.219 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch": 136, 2021-11-12T05:49:15.220 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch_barrier": 0, 2021-11-12T05:49:15.220 INFO:teuthology.orchestra.run.gibba038.stdout: "blacklisted": false, 2021-11-12T05:49:15.220 INFO:teuthology.orchestra.run.gibba038.stdout: "fs_name": "cephfs" 2021-11-12T05:49:15.220 INFO:teuthology.orchestra.run.gibba038.stdout:} 2021-11-12T05:49:15.221 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:15.222 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:49:15.222 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:49:15.231 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-12T05:49:15.232 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-12T05:49:15.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:15.233 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:49:15.300 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:15.300 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:49:15.301 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:49:15.311 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-12T05:49:15.313 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-12T05:49:15.313 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:15.314 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:49:15.314 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:49:15.325 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-12T05:49:15.326 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-12T05:49:15.327 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba038.front.sepia.ceph.com... 2021-11-12T05:49:15.327 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-12T05:49:15.327 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:49:15.342 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:ceph-fuse[14592]: fuse finished with error 0 and tester_r 0 2021-11-12T05:49:15.343 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:15.343 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:49:15.344 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:49:15.395 INFO:teuthology.orchestra.run.gibba038.stdout:ext2/ext3 2021-11-12T05:49:15.396 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-12T05:49:15.397 INFO:teuthology.orchestra.run:waiting for 900 2021-11-12T05:49:21.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:49:21.499 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:49:21.510 DEBUG:teuthology.orchestra.run.gibba005:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-12T05:49:21.514 DEBUG:teuthology.orchestra.run.gibba015:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-12T05:49:21.521 DEBUG:teuthology.orchestra.run.gibba016:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-12T05:49:21.525 DEBUG:teuthology.orchestra.run.gibba038:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-12T05:49:21.553 DEBUG:teuthology.orchestra.run.gibba044:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-12T05:49:21.558 INFO:teuthology.orchestra.run.gibba015.stdout:[global] 2021-11-12T05:49:21.559 INFO:teuthology.orchestra.run.gibba015.stdout: chdir = "" 2021-11-12T05:49:21.559 INFO:teuthology.orchestra.run.gibba015.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-12T05:49:21.559 INFO:teuthology.orchestra.run.gibba015.stdout: auth supported = cephx 2021-11-12T05:49:21.559 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:21.560 INFO:teuthology.orchestra.run.gibba015.stdout: filestore xattr use omap = true 2021-11-12T05:49:21.560 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:21.560 INFO:teuthology.orchestra.run.gibba015.stdout: mon clock drift allowed = 1.000 2021-11-12T05:49:21.560 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:21.560 INFO:teuthology.orchestra.run.gibba015.stdout: osd crush chooseleaf type = 0 2021-11-12T05:49:21.561 INFO:teuthology.orchestra.run.gibba015.stdout: auth debug = true 2021-11-12T05:49:21.561 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:21.561 INFO:teuthology.orchestra.run.gibba015.stdout: ms die on old message = true 2021-11-12T05:49:21.561 INFO:teuthology.orchestra.run.gibba015.stdout: ms die on bug = true 2021-11-12T05:49:21.561 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:21.562 INFO:teuthology.orchestra.run.gibba015.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-12T05:49:21.562 INFO:teuthology.orchestra.run.gibba015.stdout: mon pg warn max object skew = 0 2021-11-12T05:49:21.562 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:21.562 INFO:teuthology.orchestra.run.gibba015.stdout: # disable pg_autoscaler by default for new pools 2021-11-12T05:49:21.563 INFO:teuthology.orchestra.run.gibba015.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-12T05:49:21.563 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:21.563 INFO:teuthology.orchestra.run.gibba015.stdout: osd pool default size = 2 2021-11-12T05:49:21.563 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:21.564 INFO:teuthology.orchestra.run.gibba015.stdout: mon osd allow primary affinity = true 2021-11-12T05:49:21.564 INFO:teuthology.orchestra.run.gibba015.stdout: mon osd allow pg remap = true 2021-11-12T05:49:21.564 INFO:teuthology.orchestra.run.gibba015.stdout: mon warn on legacy crush tunables = false 2021-11-12T05:49:21.564 INFO:teuthology.orchestra.run.gibba015.stdout: mon warn on crush straw calc version zero = false 2021-11-12T05:49:21.565 INFO:teuthology.orchestra.run.gibba015.stdout: mon warn on no sortbitwise = false 2021-11-12T05:49:21.565 INFO:teuthology.orchestra.run.gibba015.stdout: mon warn on osd down out interval zero = false 2021-11-12T05:49:21.565 INFO:teuthology.orchestra.run.gibba015.stdout: mon warn on too few osds = false 2021-11-12T05:49:21.565 INFO:teuthology.orchestra.run.gibba015.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-12T05:49:21.565 INFO:teuthology.orchestra.run.gibba015.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-12T05:49:21.566 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:21.566 INFO:teuthology.orchestra.run.gibba015.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-12T05:49:21.566 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:21.566 INFO:teuthology.orchestra.run.gibba015.stdout: osd default data pool replay window = 5 2021-11-12T05:49:21.566 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:21.567 INFO:teuthology.orchestra.run.gibba015.stdout: mon allow pool delete = true 2021-11-12T05:49:21.567 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:21.567 INFO:teuthology.orchestra.run.gibba015.stdout: mon cluster log file level = debug 2021-11-12T05:49:21.567 INFO:teuthology.orchestra.run.gibba015.stdout: debug asserts on shutdown = true 2021-11-12T05:49:21.568 INFO:teuthology.orchestra.run.gibba015.stdout: mon health detail to clog = false 2021-11-12T05:49:21.568 INFO:teuthology.orchestra.run.gibba015.stdout: mon host = "172.21.2.105,172.21.2.115,[v2:172.21.2.115:3301,v1:172.21.2.115:6790]" 2021-11-12T05:49:21.568 INFO:teuthology.orchestra.run.gibba015.stdout: fsid = 22928e10-9f3c-479a-96ca-77d6ddf80f9f 2021-11-12T05:49:21.568 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:21.568 INFO:teuthology.orchestra.run.gibba015.stdout:[osd] 2021-11-12T05:49:21.569 INFO:teuthology.orchestra.run.gibba015.stdout: osd journal size = 100 2021-11-12T05:49:21.569 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:21.569 INFO:teuthology.orchestra.run.gibba015.stdout: osd scrub load threshold = 5.0 2021-11-12T05:49:21.569 INFO:teuthology.orchestra.run.gibba015.stdout: osd scrub max interval = 600 2021-11-12T05:49:21.569 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:21.570 INFO:teuthology.orchestra.run.gibba015.stdout: osd recover clone overlap = true 2021-11-12T05:49:21.570 INFO:teuthology.orchestra.run.gibba015.stdout: osd recovery max chunk = 1048576 2021-11-12T05:49:21.570 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:21.570 INFO:teuthology.orchestra.run.gibba015.stdout: osd debug shutdown = true 2021-11-12T05:49:21.571 INFO:teuthology.orchestra.run.gibba015.stdout: osd debug op order = true 2021-11-12T05:49:21.571 INFO:teuthology.orchestra.run.gibba015.stdout: osd debug verify stray on activate = true 2021-11-12T05:49:21.571 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:21.571 INFO:teuthology.orchestra.run.gibba015.stdout: osd open classes on start = true 2021-11-12T05:49:21.571 INFO:teuthology.orchestra.run.gibba015.stdout: osd debug pg log writeout = true 2021-11-12T05:49:21.572 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:21.572 INFO:teuthology.orchestra.run.gibba015.stdout: osd deep scrub update digest min age = 30 2021-11-12T05:49:21.572 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:21.572 INFO:teuthology.orchestra.run.gibba015.stdout: osd map max advance = 10 2021-11-12T05:49:21.573 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:21.573 INFO:teuthology.orchestra.run.gibba015.stdout: journal zero on create = true 2021-11-12T05:49:21.573 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:21.573 INFO:teuthology.orchestra.run.gibba015.stdout: filestore ondisk finisher threads = 3 2021-11-12T05:49:21.573 INFO:teuthology.orchestra.run.gibba015.stdout: filestore apply finisher threads = 3 2021-11-12T05:49:21.574 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:21.574 INFO:teuthology.orchestra.run.gibba015.stdout: bdev debug aio = true 2021-11-12T05:49:21.574 INFO:teuthology.orchestra.run.gibba015.stdout: osd debug misdirected ops = true 2021-11-12T05:49:21.574 INFO:teuthology.orchestra.run.gibba015.stdout: bluestore block size = 96636764160 2021-11-12T05:49:21.574 INFO:teuthology.orchestra.run.gibba015.stdout: bluestore compression mode = aggressive 2021-11-12T05:49:21.575 INFO:teuthology.orchestra.run.gibba015.stdout: bluestore fsck on mount = True 2021-11-12T05:49:21.575 INFO:teuthology.orchestra.run.gibba015.stdout: debug bluefs = 20 2021-11-12T05:49:21.575 INFO:teuthology.orchestra.run.gibba015.stdout: debug bluestore = 20 2021-11-12T05:49:21.575 INFO:teuthology.orchestra.run.gibba015.stdout: debug ms = 1 2021-11-12T05:49:21.576 INFO:teuthology.orchestra.run.gibba015.stdout: debug osd = 20 2021-11-12T05:49:21.576 INFO:teuthology.orchestra.run.gibba015.stdout: debug rocksdb = 10 2021-11-12T05:49:21.576 INFO:teuthology.orchestra.run.gibba015.stdout: mon osd backfillfull_ratio = 0.85 2021-11-12T05:49:21.576 INFO:teuthology.orchestra.run.gibba015.stdout: mon osd full ratio = 0.9 2021-11-12T05:49:21.576 INFO:teuthology.orchestra.run.gibba015.stdout: mon osd nearfull ratio = 0.8 2021-11-12T05:49:21.577 INFO:teuthology.orchestra.run.gibba015.stdout: osd failsafe full ratio = 0.95 2021-11-12T05:49:21.577 INFO:teuthology.orchestra.run.gibba015.stdout: osd objectstore = bluestore 2021-11-12T05:49:21.577 INFO:teuthology.orchestra.run.gibba015.stdout: osd op complaint time = 180 2021-11-12T05:49:21.577 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:21.578 INFO:teuthology.orchestra.run.gibba015.stdout:[mgr] 2021-11-12T05:49:21.578 INFO:teuthology.orchestra.run.gibba015.stdout: debug ms = 1 2021-11-12T05:49:21.578 INFO:teuthology.orchestra.run.gibba015.stdout: debug mgr = 20 2021-11-12T05:49:21.578 INFO:teuthology.orchestra.run.gibba015.stdout: debug mon = 20 2021-11-12T05:49:21.578 INFO:teuthology.orchestra.run.gibba015.stdout: debug auth = 20 2021-11-12T05:49:21.579 INFO:teuthology.orchestra.run.gibba015.stdout: mon reweight min pgs per osd = 4 2021-11-12T05:49:21.579 INFO:teuthology.orchestra.run.gibba015.stdout: mon reweight min bytes per osd = 10 2021-11-12T05:49:21.579 INFO:teuthology.orchestra.run.gibba015.stdout: mgr/telemetry/nag = false 2021-11-12T05:49:21.579 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:21.579 INFO:teuthology.orchestra.run.gibba015.stdout:[mon] 2021-11-12T05:49:21.580 INFO:teuthology.orchestra.run.gibba015.stdout: debug ms = 1 2021-11-12T05:49:21.580 INFO:teuthology.orchestra.run.gibba015.stdout: debug mon = 20 2021-11-12T05:49:21.580 INFO:teuthology.orchestra.run.gibba015.stdout: debug paxos = 20 2021-11-12T05:49:21.580 INFO:teuthology.orchestra.run.gibba015.stdout: debug auth = 20 2021-11-12T05:49:21.581 INFO:teuthology.orchestra.run.gibba015.stdout: mon data avail warn = 5 2021-11-12T05:49:21.581 INFO:teuthology.orchestra.run.gibba015.stdout: mon mgr mkfs grace = 240 2021-11-12T05:49:21.581 INFO:teuthology.orchestra.run.gibba015.stdout: mon reweight min pgs per osd = 4 2021-11-12T05:49:21.581 INFO:teuthology.orchestra.run.gibba015.stdout: mon osd reporter subtree level = osd 2021-11-12T05:49:21.581 INFO:teuthology.orchestra.run.gibba015.stdout: mon osd prime pg temp = true 2021-11-12T05:49:21.582 INFO:teuthology.orchestra.run.gibba015.stdout: mon reweight min bytes per osd = 10 2021-11-12T05:49:21.582 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:21.582 INFO:teuthology.orchestra.run.gibba015.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-12T05:49:21.582 INFO:teuthology.orchestra.run.gibba015.stdout: auth mon ticket ttl = 660 # 11m 2021-11-12T05:49:21.582 INFO:teuthology.orchestra.run.gibba015.stdout: auth service ticket ttl = 240 # 4m 2021-11-12T05:49:21.583 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:21.583 INFO:teuthology.orchestra.run.gibba015.stdout: # don't complain about insecure global_id in the test suite 2021-11-12T05:49:21.583 INFO:teuthology.orchestra.run.gibba015.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-12T05:49:21.583 INFO:teuthology.orchestra.run.gibba015.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-12T05:49:21.584 INFO:teuthology.orchestra.run.gibba015.stdout: mon op complaint time = 120 2021-11-12T05:49:21.584 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:21.584 INFO:teuthology.orchestra.run.gibba015.stdout:[client] 2021-11-12T05:49:21.584 INFO:teuthology.orchestra.run.gibba015.stdout: rgw cache enabled = true 2021-11-12T05:49:21.584 INFO:teuthology.orchestra.run.gibba015.stdout: rgw enable ops log = true 2021-11-12T05:49:21.585 INFO:teuthology.orchestra.run.gibba015.stdout: rgw enable usage log = true 2021-11-12T05:49:21.585 INFO:teuthology.orchestra.run.gibba015.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-12T05:49:21.585 INFO:teuthology.orchestra.run.gibba015.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-12T05:49:21.585 INFO:teuthology.orchestra.run.gibba015.stdout: client mount timeout = 600 2021-11-12T05:49:21.586 INFO:teuthology.orchestra.run.gibba015.stdout: debug client = 20 2021-11-12T05:49:21.586 INFO:teuthology.orchestra.run.gibba015.stdout: debug ms = 1 2021-11-12T05:49:21.586 INFO:teuthology.orchestra.run.gibba015.stdout: rados mon op timeout = 15m 2021-11-12T05:49:21.586 INFO:teuthology.orchestra.run.gibba015.stdout: rados osd op timeout = 15m 2021-11-12T05:49:21.586 INFO:teuthology.orchestra.run.gibba015.stdout: client debug getattr caps = true 2021-11-12T05:49:21.587 INFO:teuthology.orchestra.run.gibba015.stdout:[mon.a] 2021-11-12T05:49:21.587 INFO:teuthology.orchestra.run.gibba015.stdout:[mon.b] 2021-11-12T05:49:21.587 INFO:teuthology.orchestra.run.gibba015.stdout:[mon.c] 2021-11-12T05:49:21.587 INFO:teuthology.orchestra.run.gibba015.stdout:[mds.a] 2021-11-12T05:49:21.587 INFO:teuthology.orchestra.run.gibba015.stdout:[mds.b] 2021-11-12T05:49:21.588 INFO:teuthology.orchestra.run.gibba015.stdout:[mds] 2021-11-12T05:49:21.588 INFO:teuthology.orchestra.run.gibba015.stdout: debug mds = 20 2021-11-12T05:49:21.588 INFO:teuthology.orchestra.run.gibba015.stdout: debug ms = 1 2021-11-12T05:49:21.588 INFO:teuthology.orchestra.run.gibba015.stdout: mds bal frag = True 2021-11-12T05:49:21.589 INFO:teuthology.orchestra.run.gibba015.stdout: mds bal fragment size max = 10000 2021-11-12T05:49:21.589 INFO:teuthology.orchestra.run.gibba015.stdout: mds bal merge size = 5 2021-11-12T05:49:21.589 INFO:teuthology.orchestra.run.gibba015.stdout: mds bal split bits = 3 2021-11-12T05:49:21.589 INFO:teuthology.orchestra.run.gibba015.stdout: mds bal split size = 100 2021-11-12T05:49:21.589 INFO:teuthology.orchestra.run.gibba015.stdout: mds debug frag = True 2021-11-12T05:49:21.590 INFO:teuthology.orchestra.run.gibba015.stdout: mds debug scatterstat = True 2021-11-12T05:49:21.590 INFO:teuthology.orchestra.run.gibba015.stdout: mds op complaint time = 180 2021-11-12T05:49:21.590 INFO:teuthology.orchestra.run.gibba015.stdout: mds verify scatter = True 2021-11-12T05:49:21.590 INFO:teuthology.orchestra.run.gibba015.stdout: osd op complaint time = 180 2021-11-12T05:49:21.590 INFO:teuthology.orchestra.run.gibba015.stdout: rados mon op timeout = 15m 2021-11-12T05:49:21.591 INFO:teuthology.orchestra.run.gibba015.stdout: rados osd op timeout = 15m 2021-11-12T05:49:21.591 INFO:teuthology.orchestra.run.gibba016.stdout:[global] 2021-11-12T05:49:21.591 INFO:teuthology.orchestra.run.gibba016.stdout: chdir = "" 2021-11-12T05:49:21.591 INFO:teuthology.orchestra.run.gibba016.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-12T05:49:21.591 INFO:teuthology.orchestra.run.gibba016.stdout: auth supported = cephx 2021-11-12T05:49:21.592 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:21.592 INFO:teuthology.orchestra.run.gibba016.stdout: filestore xattr use omap = true 2021-11-12T05:49:21.592 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:21.592 INFO:teuthology.orchestra.run.gibba016.stdout: mon clock drift allowed = 1.000 2021-11-12T05:49:21.592 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:21.593 INFO:teuthology.orchestra.run.gibba016.stdout: osd crush chooseleaf type = 0 2021-11-12T05:49:21.593 INFO:teuthology.orchestra.run.gibba016.stdout: auth debug = true 2021-11-12T05:49:21.593 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:21.593 INFO:teuthology.orchestra.run.gibba016.stdout: ms die on old message = true 2021-11-12T05:49:21.593 INFO:teuthology.orchestra.run.gibba016.stdout: ms die on bug = true 2021-11-12T05:49:21.594 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:21.594 INFO:teuthology.orchestra.run.gibba016.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-12T05:49:21.594 INFO:teuthology.orchestra.run.gibba016.stdout: mon pg warn max object skew = 0 2021-11-12T05:49:21.594 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:21.594 INFO:teuthology.orchestra.run.gibba016.stdout: # disable pg_autoscaler by default for new pools 2021-11-12T05:49:21.595 INFO:teuthology.orchestra.run.gibba016.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-12T05:49:21.595 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:21.595 INFO:teuthology.orchestra.run.gibba016.stdout: osd pool default size = 2 2021-11-12T05:49:21.595 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:21.595 INFO:teuthology.orchestra.run.gibba016.stdout: mon osd allow primary affinity = true 2021-11-12T05:49:21.596 INFO:teuthology.orchestra.run.gibba016.stdout: mon osd allow pg remap = true 2021-11-12T05:49:21.596 INFO:teuthology.orchestra.run.gibba016.stdout: mon warn on legacy crush tunables = false 2021-11-12T05:49:21.596 INFO:teuthology.orchestra.run.gibba016.stdout: mon warn on crush straw calc version zero = false 2021-11-12T05:49:21.596 INFO:teuthology.orchestra.run.gibba016.stdout: mon warn on no sortbitwise = false 2021-11-12T05:49:21.596 INFO:teuthology.orchestra.run.gibba016.stdout: mon warn on osd down out interval zero = false 2021-11-12T05:49:21.597 INFO:teuthology.orchestra.run.gibba016.stdout: mon warn on too few osds = false 2021-11-12T05:49:21.597 INFO:teuthology.orchestra.run.gibba016.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-12T05:49:21.597 INFO:teuthology.orchestra.run.gibba016.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-12T05:49:21.597 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:21.597 INFO:teuthology.orchestra.run.gibba016.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-12T05:49:21.598 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:21.598 INFO:teuthology.orchestra.run.gibba016.stdout: osd default data pool replay window = 5 2021-11-12T05:49:21.598 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:21.598 INFO:teuthology.orchestra.run.gibba016.stdout: mon allow pool delete = true 2021-11-12T05:49:21.599 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:21.599 INFO:teuthology.orchestra.run.gibba016.stdout: mon cluster log file level = debug 2021-11-12T05:49:21.599 INFO:teuthology.orchestra.run.gibba016.stdout: debug asserts on shutdown = true 2021-11-12T05:49:21.599 INFO:teuthology.orchestra.run.gibba016.stdout: mon health detail to clog = false 2021-11-12T05:49:21.599 INFO:teuthology.orchestra.run.gibba016.stdout: mon host = "172.21.2.105,172.21.2.115,[v2:172.21.2.115:3301,v1:172.21.2.115:6790]" 2021-11-12T05:49:21.600 INFO:teuthology.orchestra.run.gibba016.stdout: fsid = 22928e10-9f3c-479a-96ca-77d6ddf80f9f 2021-11-12T05:49:21.600 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:21.600 INFO:teuthology.orchestra.run.gibba016.stdout:[osd] 2021-11-12T05:49:21.600 INFO:teuthology.orchestra.run.gibba016.stdout: osd journal size = 100 2021-11-12T05:49:21.600 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:21.601 INFO:teuthology.orchestra.run.gibba016.stdout: osd scrub load threshold = 5.0 2021-11-12T05:49:21.601 INFO:teuthology.orchestra.run.gibba016.stdout: osd scrub max interval = 600 2021-11-12T05:49:21.601 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:21.601 INFO:teuthology.orchestra.run.gibba016.stdout: osd recover clone overlap = true 2021-11-12T05:49:21.602 INFO:teuthology.orchestra.run.gibba016.stdout: osd recovery max chunk = 1048576 2021-11-12T05:49:21.602 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:21.602 INFO:teuthology.orchestra.run.gibba016.stdout: osd debug shutdown = true 2021-11-12T05:49:21.602 INFO:teuthology.orchestra.run.gibba016.stdout: osd debug op order = true 2021-11-12T05:49:21.602 INFO:teuthology.orchestra.run.gibba016.stdout: osd debug verify stray on activate = true 2021-11-12T05:49:21.603 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:21.603 INFO:teuthology.orchestra.run.gibba016.stdout: osd open classes on start = true 2021-11-12T05:49:21.603 INFO:teuthology.orchestra.run.gibba016.stdout: osd debug pg log writeout = true 2021-11-12T05:49:21.603 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:21.604 INFO:teuthology.orchestra.run.gibba016.stdout: osd deep scrub update digest min age = 30 2021-11-12T05:49:21.604 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:21.604 INFO:teuthology.orchestra.run.gibba016.stdout: osd map max advance = 10 2021-11-12T05:49:21.604 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:21.604 INFO:teuthology.orchestra.run.gibba016.stdout: journal zero on create = true 2021-11-12T05:49:21.605 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:21.605 INFO:teuthology.orchestra.run.gibba016.stdout: filestore ondisk finisher threads = 3 2021-11-12T05:49:21.605 INFO:teuthology.orchestra.run.gibba016.stdout: filestore apply finisher threads = 3 2021-11-12T05:49:21.605 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:21.606 INFO:teuthology.orchestra.run.gibba016.stdout: bdev debug aio = true 2021-11-12T05:49:21.606 INFO:teuthology.orchestra.run.gibba016.stdout: osd debug misdirected ops = true 2021-11-12T05:49:21.606 INFO:teuthology.orchestra.run.gibba016.stdout: bluestore block size = 96636764160 2021-11-12T05:49:21.606 INFO:teuthology.orchestra.run.gibba016.stdout: bluestore compression mode = aggressive 2021-11-12T05:49:21.606 INFO:teuthology.orchestra.run.gibba016.stdout: bluestore fsck on mount = True 2021-11-12T05:49:21.607 INFO:teuthology.orchestra.run.gibba016.stdout: debug bluefs = 20 2021-11-12T05:49:21.607 INFO:teuthology.orchestra.run.gibba016.stdout: debug bluestore = 20 2021-11-12T05:49:21.607 INFO:teuthology.orchestra.run.gibba016.stdout: debug ms = 1 2021-11-12T05:49:21.607 INFO:teuthology.orchestra.run.gibba016.stdout: debug osd = 20 2021-11-12T05:49:21.607 INFO:teuthology.orchestra.run.gibba016.stdout: debug rocksdb = 10 2021-11-12T05:49:21.608 INFO:teuthology.orchestra.run.gibba016.stdout: mon osd backfillfull_ratio = 0.85 2021-11-12T05:49:21.608 INFO:teuthology.orchestra.run.gibba016.stdout: mon osd full ratio = 0.9 2021-11-12T05:49:21.608 INFO:teuthology.orchestra.run.gibba016.stdout: mon osd nearfull ratio = 0.8 2021-11-12T05:49:21.608 INFO:teuthology.orchestra.run.gibba016.stdout: osd failsafe full ratio = 0.95 2021-11-12T05:49:21.608 INFO:teuthology.orchestra.run.gibba016.stdout: osd objectstore = bluestore 2021-11-12T05:49:21.609 INFO:teuthology.orchestra.run.gibba016.stdout: osd op complaint time = 180 2021-11-12T05:49:21.609 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:21.609 INFO:teuthology.orchestra.run.gibba016.stdout:[mgr] 2021-11-12T05:49:21.609 INFO:teuthology.orchestra.run.gibba016.stdout: debug ms = 1 2021-11-12T05:49:21.609 INFO:teuthology.orchestra.run.gibba016.stdout: debug mgr = 20 2021-11-12T05:49:21.610 INFO:teuthology.orchestra.run.gibba016.stdout: debug mon = 20 2021-11-12T05:49:21.610 INFO:teuthology.orchestra.run.gibba016.stdout: debug auth = 20 2021-11-12T05:49:21.610 INFO:teuthology.orchestra.run.gibba016.stdout: mon reweight min pgs per osd = 4 2021-11-12T05:49:21.610 INFO:teuthology.orchestra.run.gibba016.stdout: mon reweight min bytes per osd = 10 2021-11-12T05:49:21.611 INFO:teuthology.orchestra.run.gibba016.stdout: mgr/telemetry/nag = false 2021-11-12T05:49:21.611 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:21.611 INFO:teuthology.orchestra.run.gibba016.stdout:[mon] 2021-11-12T05:49:21.611 INFO:teuthology.orchestra.run.gibba016.stdout: debug ms = 1 2021-11-12T05:49:21.612 INFO:teuthology.orchestra.run.gibba016.stdout: debug mon = 20 2021-11-12T05:49:21.612 INFO:teuthology.orchestra.run.gibba016.stdout: debug paxos = 20 2021-11-12T05:49:21.612 INFO:teuthology.orchestra.run.gibba016.stdout: debug auth = 20 2021-11-12T05:49:21.612 INFO:teuthology.orchestra.run.gibba016.stdout: mon data avail warn = 5 2021-11-12T05:49:21.612 INFO:teuthology.orchestra.run.gibba016.stdout: mon mgr mkfs grace = 240 2021-11-12T05:49:21.613 INFO:teuthology.orchestra.run.gibba016.stdout: mon reweight min pgs per osd = 4 2021-11-12T05:49:21.613 INFO:teuthology.orchestra.run.gibba016.stdout: mon osd reporter subtree level = osd 2021-11-12T05:49:21.613 INFO:teuthology.orchestra.run.gibba016.stdout: mon osd prime pg temp = true 2021-11-12T05:49:21.613 INFO:teuthology.orchestra.run.gibba016.stdout: mon reweight min bytes per osd = 10 2021-11-12T05:49:21.613 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:21.614 INFO:teuthology.orchestra.run.gibba016.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-12T05:49:21.614 INFO:teuthology.orchestra.run.gibba016.stdout: auth mon ticket ttl = 660 # 11m 2021-11-12T05:49:21.614 INFO:teuthology.orchestra.run.gibba016.stdout: auth service ticket ttl = 240 # 4m 2021-11-12T05:49:21.614 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:21.614 INFO:teuthology.orchestra.run.gibba016.stdout: # don't complain about insecure global_id in the test suite 2021-11-12T05:49:21.615 INFO:teuthology.orchestra.run.gibba016.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-12T05:49:21.615 INFO:teuthology.orchestra.run.gibba016.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-12T05:49:21.615 INFO:teuthology.orchestra.run.gibba016.stdout: mon op complaint time = 120 2021-11-12T05:49:21.615 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:21.615 INFO:teuthology.orchestra.run.gibba016.stdout:[client] 2021-11-12T05:49:21.616 INFO:teuthology.orchestra.run.gibba016.stdout: rgw cache enabled = true 2021-11-12T05:49:21.616 INFO:teuthology.orchestra.run.gibba016.stdout: rgw enable ops log = true 2021-11-12T05:49:21.616 INFO:teuthology.orchestra.run.gibba016.stdout: rgw enable usage log = true 2021-11-12T05:49:21.616 INFO:teuthology.orchestra.run.gibba016.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-12T05:49:21.616 INFO:teuthology.orchestra.run.gibba016.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-12T05:49:21.617 INFO:teuthology.orchestra.run.gibba016.stdout: client mount timeout = 600 2021-11-12T05:49:21.617 INFO:teuthology.orchestra.run.gibba016.stdout: debug client = 20 2021-11-12T05:49:21.617 INFO:teuthology.orchestra.run.gibba016.stdout: debug ms = 1 2021-11-12T05:49:21.617 INFO:teuthology.orchestra.run.gibba016.stdout: rados mon op timeout = 15m 2021-11-12T05:49:21.617 INFO:teuthology.orchestra.run.gibba016.stdout: rados osd op timeout = 15m 2021-11-12T05:49:21.618 INFO:teuthology.orchestra.run.gibba016.stdout: client debug getattr caps = true 2021-11-12T05:49:21.618 INFO:teuthology.orchestra.run.gibba016.stdout:[mon.a] 2021-11-12T05:49:21.618 INFO:teuthology.orchestra.run.gibba016.stdout:[mon.b] 2021-11-12T05:49:21.618 INFO:teuthology.orchestra.run.gibba016.stdout:[mon.c] 2021-11-12T05:49:21.618 INFO:teuthology.orchestra.run.gibba016.stdout:[mds.a] 2021-11-12T05:49:21.619 INFO:teuthology.orchestra.run.gibba016.stdout:[mds.b] 2021-11-12T05:49:21.619 INFO:teuthology.orchestra.run.gibba016.stdout:[mds] 2021-11-12T05:49:21.619 INFO:teuthology.orchestra.run.gibba016.stdout: debug mds = 20 2021-11-12T05:49:21.619 INFO:teuthology.orchestra.run.gibba016.stdout: debug ms = 1 2021-11-12T05:49:21.619 INFO:teuthology.orchestra.run.gibba016.stdout: mds bal frag = True 2021-11-12T05:49:21.620 INFO:teuthology.orchestra.run.gibba016.stdout: mds bal fragment size max = 10000 2021-11-12T05:49:21.620 INFO:teuthology.orchestra.run.gibba016.stdout: mds bal merge size = 5 2021-11-12T05:49:21.620 INFO:teuthology.orchestra.run.gibba016.stdout: mds bal split bits = 3 2021-11-12T05:49:21.620 INFO:teuthology.orchestra.run.gibba016.stdout: mds bal split size = 100 2021-11-12T05:49:21.620 INFO:teuthology.orchestra.run.gibba016.stdout: mds debug frag = True 2021-11-12T05:49:21.621 INFO:teuthology.orchestra.run.gibba016.stdout: mds debug scatterstat = True 2021-11-12T05:49:21.621 INFO:teuthology.orchestra.run.gibba016.stdout: mds op complaint time = 180 2021-11-12T05:49:21.621 INFO:teuthology.orchestra.run.gibba016.stdout: mds verify scatter = True 2021-11-12T05:49:21.621 INFO:teuthology.orchestra.run.gibba016.stdout: osd op complaint time = 180 2021-11-12T05:49:21.621 INFO:teuthology.orchestra.run.gibba016.stdout: rados mon op timeout = 15m 2021-11-12T05:49:21.622 INFO:teuthology.orchestra.run.gibba016.stdout: rados osd op timeout = 15m 2021-11-12T05:49:21.622 INFO:teuthology.orchestra.run.gibba005.stdout:[global] 2021-11-12T05:49:21.622 INFO:teuthology.orchestra.run.gibba005.stdout: chdir = "" 2021-11-12T05:49:21.622 INFO:teuthology.orchestra.run.gibba005.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-12T05:49:21.623 INFO:teuthology.orchestra.run.gibba005.stdout: auth supported = cephx 2021-11-12T05:49:21.623 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:21.623 INFO:teuthology.orchestra.run.gibba005.stdout: filestore xattr use omap = true 2021-11-12T05:49:21.623 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:21.624 INFO:teuthology.orchestra.run.gibba005.stdout: mon clock drift allowed = 1.000 2021-11-12T05:49:21.624 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:21.624 INFO:teuthology.orchestra.run.gibba005.stdout: osd crush chooseleaf type = 0 2021-11-12T05:49:21.624 INFO:teuthology.orchestra.run.gibba005.stdout: auth debug = true 2021-11-12T05:49:21.624 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:21.625 INFO:teuthology.orchestra.run.gibba005.stdout: ms die on old message = true 2021-11-12T05:49:21.625 INFO:teuthology.orchestra.run.gibba005.stdout: ms die on bug = true 2021-11-12T05:49:21.625 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:21.625 INFO:teuthology.orchestra.run.gibba005.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-12T05:49:21.625 INFO:teuthology.orchestra.run.gibba005.stdout: mon pg warn max object skew = 0 2021-11-12T05:49:21.626 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:21.626 INFO:teuthology.orchestra.run.gibba005.stdout: # disable pg_autoscaler by default for new pools 2021-11-12T05:49:21.626 INFO:teuthology.orchestra.run.gibba005.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-12T05:49:21.626 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:21.626 INFO:teuthology.orchestra.run.gibba005.stdout: osd pool default size = 2 2021-11-12T05:49:21.627 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:21.627 INFO:teuthology.orchestra.run.gibba005.stdout: mon osd allow primary affinity = true 2021-11-12T05:49:21.627 INFO:teuthology.orchestra.run.gibba005.stdout: mon osd allow pg remap = true 2021-11-12T05:49:21.627 INFO:teuthology.orchestra.run.gibba005.stdout: mon warn on legacy crush tunables = false 2021-11-12T05:49:21.627 INFO:teuthology.orchestra.run.gibba005.stdout: mon warn on crush straw calc version zero = false 2021-11-12T05:49:21.628 INFO:teuthology.orchestra.run.gibba005.stdout: mon warn on no sortbitwise = false 2021-11-12T05:49:21.628 INFO:teuthology.orchestra.run.gibba005.stdout: mon warn on osd down out interval zero = false 2021-11-12T05:49:21.628 INFO:teuthology.orchestra.run.gibba005.stdout: mon warn on too few osds = false 2021-11-12T05:49:21.628 INFO:teuthology.orchestra.run.gibba005.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-12T05:49:21.628 INFO:teuthology.orchestra.run.gibba005.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-12T05:49:21.629 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:21.629 INFO:teuthology.orchestra.run.gibba005.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-12T05:49:21.629 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:21.629 INFO:teuthology.orchestra.run.gibba005.stdout: osd default data pool replay window = 5 2021-11-12T05:49:21.629 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:21.630 INFO:teuthology.orchestra.run.gibba005.stdout: mon allow pool delete = true 2021-11-12T05:49:21.630 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:21.630 INFO:teuthology.orchestra.run.gibba005.stdout: mon cluster log file level = debug 2021-11-12T05:49:21.630 INFO:teuthology.orchestra.run.gibba005.stdout: debug asserts on shutdown = true 2021-11-12T05:49:21.631 INFO:teuthology.orchestra.run.gibba005.stdout: mon health detail to clog = false 2021-11-12T05:49:21.631 INFO:teuthology.orchestra.run.gibba005.stdout: mon host = "172.21.2.105,172.21.2.115,[v2:172.21.2.115:3301,v1:172.21.2.115:6790]" 2021-11-12T05:49:21.631 INFO:teuthology.orchestra.run.gibba005.stdout: fsid = 22928e10-9f3c-479a-96ca-77d6ddf80f9f 2021-11-12T05:49:21.631 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:21.631 INFO:teuthology.orchestra.run.gibba005.stdout:[osd] 2021-11-12T05:49:21.632 INFO:teuthology.orchestra.run.gibba005.stdout: osd journal size = 100 2021-11-12T05:49:21.632 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:21.632 INFO:teuthology.orchestra.run.gibba005.stdout: osd scrub load threshold = 5.0 2021-11-12T05:49:21.632 INFO:teuthology.orchestra.run.gibba005.stdout: osd scrub max interval = 600 2021-11-12T05:49:21.632 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:21.633 INFO:teuthology.orchestra.run.gibba005.stdout: osd recover clone overlap = true 2021-11-12T05:49:21.633 INFO:teuthology.orchestra.run.gibba005.stdout: osd recovery max chunk = 1048576 2021-11-12T05:49:21.633 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:21.633 INFO:teuthology.orchestra.run.gibba005.stdout: osd debug shutdown = true 2021-11-12T05:49:21.633 INFO:teuthology.orchestra.run.gibba005.stdout: osd debug op order = true 2021-11-12T05:49:21.634 INFO:teuthology.orchestra.run.gibba005.stdout: osd debug verify stray on activate = true 2021-11-12T05:49:21.634 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:21.634 INFO:teuthology.orchestra.run.gibba005.stdout: osd open classes on start = true 2021-11-12T05:49:21.634 INFO:teuthology.orchestra.run.gibba005.stdout: osd debug pg log writeout = true 2021-11-12T05:49:21.634 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:21.635 INFO:teuthology.orchestra.run.gibba005.stdout: osd deep scrub update digest min age = 30 2021-11-12T05:49:21.635 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:21.635 INFO:teuthology.orchestra.run.gibba005.stdout: osd map max advance = 10 2021-11-12T05:49:21.635 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:21.636 INFO:teuthology.orchestra.run.gibba005.stdout: journal zero on create = true 2021-11-12T05:49:21.636 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:21.636 INFO:teuthology.orchestra.run.gibba005.stdout: filestore ondisk finisher threads = 3 2021-11-12T05:49:21.636 INFO:teuthology.orchestra.run.gibba005.stdout: filestore apply finisher threads = 3 2021-11-12T05:49:21.636 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:21.637 INFO:teuthology.orchestra.run.gibba005.stdout: bdev debug aio = true 2021-11-12T05:49:21.637 INFO:teuthology.orchestra.run.gibba005.stdout: osd debug misdirected ops = true 2021-11-12T05:49:21.637 INFO:teuthology.orchestra.run.gibba005.stdout: bluestore block size = 96636764160 2021-11-12T05:49:21.637 INFO:teuthology.orchestra.run.gibba005.stdout: bluestore compression mode = aggressive 2021-11-12T05:49:21.637 INFO:teuthology.orchestra.run.gibba005.stdout: bluestore fsck on mount = True 2021-11-12T05:49:21.638 INFO:teuthology.orchestra.run.gibba005.stdout: debug bluefs = 20 2021-11-12T05:49:21.638 INFO:teuthology.orchestra.run.gibba005.stdout: debug bluestore = 20 2021-11-12T05:49:21.638 INFO:teuthology.orchestra.run.gibba005.stdout: debug ms = 1 2021-11-12T05:49:21.638 INFO:teuthology.orchestra.run.gibba005.stdout: debug osd = 20 2021-11-12T05:49:21.638 INFO:teuthology.orchestra.run.gibba005.stdout: debug rocksdb = 10 2021-11-12T05:49:21.639 INFO:teuthology.orchestra.run.gibba005.stdout: mon osd backfillfull_ratio = 0.85 2021-11-12T05:49:21.639 INFO:teuthology.orchestra.run.gibba005.stdout: mon osd full ratio = 0.9 2021-11-12T05:49:21.639 INFO:teuthology.orchestra.run.gibba005.stdout: mon osd nearfull ratio = 0.8 2021-11-12T05:49:21.639 INFO:teuthology.orchestra.run.gibba005.stdout: osd failsafe full ratio = 0.95 2021-11-12T05:49:21.639 INFO:teuthology.orchestra.run.gibba005.stdout: osd objectstore = bluestore 2021-11-12T05:49:21.640 INFO:teuthology.orchestra.run.gibba005.stdout: osd op complaint time = 180 2021-11-12T05:49:21.640 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:21.640 INFO:teuthology.orchestra.run.gibba005.stdout:[mgr] 2021-11-12T05:49:21.640 INFO:teuthology.orchestra.run.gibba005.stdout: debug ms = 1 2021-11-12T05:49:21.640 INFO:teuthology.orchestra.run.gibba005.stdout: debug mgr = 20 2021-11-12T05:49:21.641 INFO:teuthology.orchestra.run.gibba005.stdout: debug mon = 20 2021-11-12T05:49:21.641 INFO:teuthology.orchestra.run.gibba005.stdout: debug auth = 20 2021-11-12T05:49:21.641 INFO:teuthology.orchestra.run.gibba005.stdout: mon reweight min pgs per osd = 4 2021-11-12T05:49:21.641 INFO:teuthology.orchestra.run.gibba005.stdout: mon reweight min bytes per osd = 10 2021-11-12T05:49:21.641 INFO:teuthology.orchestra.run.gibba005.stdout: mgr/telemetry/nag = false 2021-11-12T05:49:21.642 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:21.642 INFO:teuthology.orchestra.run.gibba005.stdout:[mon] 2021-11-12T05:49:21.642 INFO:teuthology.orchestra.run.gibba005.stdout: debug ms = 1 2021-11-12T05:49:21.642 INFO:teuthology.orchestra.run.gibba005.stdout: debug mon = 20 2021-11-12T05:49:21.642 INFO:teuthology.orchestra.run.gibba005.stdout: debug paxos = 20 2021-11-12T05:49:21.643 INFO:teuthology.orchestra.run.gibba005.stdout: debug auth = 20 2021-11-12T05:49:21.643 INFO:teuthology.orchestra.run.gibba005.stdout: mon data avail warn = 5 2021-11-12T05:49:21.643 INFO:teuthology.orchestra.run.gibba005.stdout: mon mgr mkfs grace = 240 2021-11-12T05:49:21.643 INFO:teuthology.orchestra.run.gibba005.stdout: mon reweight min pgs per osd = 4 2021-11-12T05:49:21.644 INFO:teuthology.orchestra.run.gibba005.stdout: mon osd reporter subtree level = osd 2021-11-12T05:49:21.644 INFO:teuthology.orchestra.run.gibba005.stdout: mon osd prime pg temp = true 2021-11-12T05:49:21.644 INFO:teuthology.orchestra.run.gibba005.stdout: mon reweight min bytes per osd = 10 2021-11-12T05:49:21.644 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:21.644 INFO:teuthology.orchestra.run.gibba005.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-12T05:49:21.645 INFO:teuthology.orchestra.run.gibba005.stdout: auth mon ticket ttl = 660 # 11m 2021-11-12T05:49:21.645 INFO:teuthology.orchestra.run.gibba005.stdout: auth service ticket ttl = 240 # 4m 2021-11-12T05:49:21.645 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:21.645 INFO:teuthology.orchestra.run.gibba005.stdout: # don't complain about insecure global_id in the test suite 2021-11-12T05:49:21.645 INFO:teuthology.orchestra.run.gibba005.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-12T05:49:21.646 INFO:teuthology.orchestra.run.gibba005.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-12T05:49:21.646 INFO:teuthology.orchestra.run.gibba005.stdout: mon op complaint time = 120 2021-11-12T05:49:21.646 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:21.646 INFO:teuthology.orchestra.run.gibba005.stdout:[client] 2021-11-12T05:49:21.646 INFO:teuthology.orchestra.run.gibba005.stdout: rgw cache enabled = true 2021-11-12T05:49:21.647 INFO:teuthology.orchestra.run.gibba005.stdout: rgw enable ops log = true 2021-11-12T05:49:21.647 INFO:teuthology.orchestra.run.gibba005.stdout: rgw enable usage log = true 2021-11-12T05:49:21.647 INFO:teuthology.orchestra.run.gibba005.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-12T05:49:21.647 INFO:teuthology.orchestra.run.gibba005.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-12T05:49:21.647 INFO:teuthology.orchestra.run.gibba005.stdout: client mount timeout = 600 2021-11-12T05:49:21.648 INFO:teuthology.orchestra.run.gibba005.stdout: debug client = 20 2021-11-12T05:49:21.648 INFO:teuthology.orchestra.run.gibba005.stdout: debug ms = 1 2021-11-12T05:49:21.648 INFO:teuthology.orchestra.run.gibba005.stdout: rados mon op timeout = 15m 2021-11-12T05:49:21.648 INFO:teuthology.orchestra.run.gibba005.stdout: rados osd op timeout = 15m 2021-11-12T05:49:21.648 INFO:teuthology.orchestra.run.gibba005.stdout: client debug getattr caps = true 2021-11-12T05:49:21.648 INFO:teuthology.orchestra.run.gibba005.stdout:[mon.a] 2021-11-12T05:49:21.649 INFO:teuthology.orchestra.run.gibba005.stdout:[mon.b] 2021-11-12T05:49:21.649 INFO:teuthology.orchestra.run.gibba005.stdout:[mon.c] 2021-11-12T05:49:21.649 INFO:teuthology.orchestra.run.gibba005.stdout:[mds.a] 2021-11-12T05:49:21.649 INFO:teuthology.orchestra.run.gibba005.stdout:[mds.b] 2021-11-12T05:49:21.650 INFO:teuthology.orchestra.run.gibba005.stdout:[mds] 2021-11-12T05:49:21.650 INFO:teuthology.orchestra.run.gibba005.stdout: debug mds = 20 2021-11-12T05:49:21.650 INFO:teuthology.orchestra.run.gibba005.stdout: debug ms = 1 2021-11-12T05:49:21.650 INFO:teuthology.orchestra.run.gibba005.stdout: mds bal frag = True 2021-11-12T05:49:21.650 INFO:teuthology.orchestra.run.gibba005.stdout: mds bal fragment size max = 10000 2021-11-12T05:49:21.651 INFO:teuthology.orchestra.run.gibba005.stdout: mds bal merge size = 5 2021-11-12T05:49:21.651 INFO:teuthology.orchestra.run.gibba005.stdout: mds bal split bits = 3 2021-11-12T05:49:21.651 INFO:teuthology.orchestra.run.gibba005.stdout: mds bal split size = 100 2021-11-12T05:49:21.651 INFO:teuthology.orchestra.run.gibba005.stdout: mds debug frag = True 2021-11-12T05:49:21.651 INFO:teuthology.orchestra.run.gibba005.stdout: mds debug scatterstat = True 2021-11-12T05:49:21.652 INFO:teuthology.orchestra.run.gibba005.stdout: mds op complaint time = 180 2021-11-12T05:49:21.652 INFO:teuthology.orchestra.run.gibba005.stdout: mds verify scatter = True 2021-11-12T05:49:21.652 INFO:teuthology.orchestra.run.gibba005.stdout: osd op complaint time = 180 2021-11-12T05:49:21.652 INFO:teuthology.orchestra.run.gibba005.stdout: rados mon op timeout = 15m 2021-11-12T05:49:21.652 INFO:teuthology.orchestra.run.gibba005.stdout: rados osd op timeout = 15m 2021-11-12T05:49:21.656 INFO:teuthology.orchestra.run.gibba044.stdout:[global] 2021-11-12T05:49:21.656 INFO:teuthology.orchestra.run.gibba044.stdout: chdir = "" 2021-11-12T05:49:21.656 INFO:teuthology.orchestra.run.gibba044.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-12T05:49:21.657 INFO:teuthology.orchestra.run.gibba044.stdout: auth supported = cephx 2021-11-12T05:49:21.657 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:21.657 INFO:teuthology.orchestra.run.gibba044.stdout: filestore xattr use omap = true 2021-11-12T05:49:21.657 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:21.658 INFO:teuthology.orchestra.run.gibba044.stdout: mon clock drift allowed = 1.000 2021-11-12T05:49:21.658 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:21.658 INFO:teuthology.orchestra.run.gibba044.stdout: osd crush chooseleaf type = 0 2021-11-12T05:49:21.658 INFO:teuthology.orchestra.run.gibba044.stdout: auth debug = true 2021-11-12T05:49:21.658 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:21.659 INFO:teuthology.orchestra.run.gibba044.stdout: ms die on old message = true 2021-11-12T05:49:21.659 INFO:teuthology.orchestra.run.gibba044.stdout: ms die on bug = true 2021-11-12T05:49:21.659 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:21.659 INFO:teuthology.orchestra.run.gibba044.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-12T05:49:21.659 INFO:teuthology.orchestra.run.gibba044.stdout: mon pg warn max object skew = 0 2021-11-12T05:49:21.660 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:21.660 INFO:teuthology.orchestra.run.gibba044.stdout: # disable pg_autoscaler by default for new pools 2021-11-12T05:49:21.660 INFO:teuthology.orchestra.run.gibba044.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-12T05:49:21.660 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:21.661 INFO:teuthology.orchestra.run.gibba044.stdout: osd pool default size = 2 2021-11-12T05:49:21.661 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:21.661 INFO:teuthology.orchestra.run.gibba044.stdout: mon osd allow primary affinity = true 2021-11-12T05:49:21.661 INFO:teuthology.orchestra.run.gibba044.stdout: mon osd allow pg remap = true 2021-11-12T05:49:21.662 INFO:teuthology.orchestra.run.gibba044.stdout: mon warn on legacy crush tunables = false 2021-11-12T05:49:21.662 INFO:teuthology.orchestra.run.gibba044.stdout: mon warn on crush straw calc version zero = false 2021-11-12T05:49:21.662 INFO:teuthology.orchestra.run.gibba044.stdout: mon warn on no sortbitwise = false 2021-11-12T05:49:21.662 INFO:teuthology.orchestra.run.gibba044.stdout: mon warn on osd down out interval zero = false 2021-11-12T05:49:21.662 INFO:teuthology.orchestra.run.gibba044.stdout: mon warn on too few osds = false 2021-11-12T05:49:21.663 INFO:teuthology.orchestra.run.gibba044.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-12T05:49:21.663 INFO:teuthology.orchestra.run.gibba044.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-12T05:49:21.663 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:21.663 INFO:teuthology.orchestra.run.gibba044.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-12T05:49:21.663 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:21.664 INFO:teuthology.orchestra.run.gibba044.stdout: osd default data pool replay window = 5 2021-11-12T05:49:21.664 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:21.664 INFO:teuthology.orchestra.run.gibba044.stdout: mon allow pool delete = true 2021-11-12T05:49:21.664 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:21.664 INFO:teuthology.orchestra.run.gibba044.stdout: mon cluster log file level = debug 2021-11-12T05:49:21.665 INFO:teuthology.orchestra.run.gibba044.stdout: debug asserts on shutdown = true 2021-11-12T05:49:21.665 INFO:teuthology.orchestra.run.gibba044.stdout: mon health detail to clog = false 2021-11-12T05:49:21.665 INFO:teuthology.orchestra.run.gibba044.stdout: mon host = "172.21.2.105,172.21.2.115,[v2:172.21.2.115:3301,v1:172.21.2.115:6790]" 2021-11-12T05:49:21.665 INFO:teuthology.orchestra.run.gibba044.stdout: fsid = 22928e10-9f3c-479a-96ca-77d6ddf80f9f 2021-11-12T05:49:21.666 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:21.666 INFO:teuthology.orchestra.run.gibba044.stdout:[osd] 2021-11-12T05:49:21.666 INFO:teuthology.orchestra.run.gibba044.stdout: osd journal size = 100 2021-11-12T05:49:21.666 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:21.666 INFO:teuthology.orchestra.run.gibba044.stdout: osd scrub load threshold = 5.0 2021-11-12T05:49:21.667 INFO:teuthology.orchestra.run.gibba044.stdout: osd scrub max interval = 600 2021-11-12T05:49:21.667 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:21.667 INFO:teuthology.orchestra.run.gibba044.stdout: osd recover clone overlap = true 2021-11-12T05:49:21.667 INFO:teuthology.orchestra.run.gibba044.stdout: osd recovery max chunk = 1048576 2021-11-12T05:49:21.667 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:21.668 INFO:teuthology.orchestra.run.gibba044.stdout: osd debug shutdown = true 2021-11-12T05:49:21.668 INFO:teuthology.orchestra.run.gibba044.stdout: osd debug op order = true 2021-11-12T05:49:21.668 INFO:teuthology.orchestra.run.gibba044.stdout: osd debug verify stray on activate = true 2021-11-12T05:49:21.668 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:21.669 INFO:teuthology.orchestra.run.gibba044.stdout: osd open classes on start = true 2021-11-12T05:49:21.669 INFO:teuthology.orchestra.run.gibba044.stdout: osd debug pg log writeout = true 2021-11-12T05:49:21.669 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:21.669 INFO:teuthology.orchestra.run.gibba044.stdout: osd deep scrub update digest min age = 30 2021-11-12T05:49:21.669 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:21.670 INFO:teuthology.orchestra.run.gibba044.stdout: osd map max advance = 10 2021-11-12T05:49:21.670 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:21.670 INFO:teuthology.orchestra.run.gibba044.stdout: journal zero on create = true 2021-11-12T05:49:21.670 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:21.670 INFO:teuthology.orchestra.run.gibba044.stdout: filestore ondisk finisher threads = 3 2021-11-12T05:49:21.671 INFO:teuthology.orchestra.run.gibba044.stdout: filestore apply finisher threads = 3 2021-11-12T05:49:21.671 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:21.671 INFO:teuthology.orchestra.run.gibba044.stdout: bdev debug aio = true 2021-11-12T05:49:21.671 INFO:teuthology.orchestra.run.gibba044.stdout: osd debug misdirected ops = true 2021-11-12T05:49:21.672 INFO:teuthology.orchestra.run.gibba044.stdout: bluestore block size = 96636764160 2021-11-12T05:49:21.672 INFO:teuthology.orchestra.run.gibba044.stdout: bluestore compression mode = aggressive 2021-11-12T05:49:21.672 INFO:teuthology.orchestra.run.gibba044.stdout: bluestore fsck on mount = True 2021-11-12T05:49:21.672 INFO:teuthology.orchestra.run.gibba044.stdout: debug bluefs = 20 2021-11-12T05:49:21.672 INFO:teuthology.orchestra.run.gibba044.stdout: debug bluestore = 20 2021-11-12T05:49:21.673 INFO:teuthology.orchestra.run.gibba044.stdout: debug ms = 1 2021-11-12T05:49:21.673 INFO:teuthology.orchestra.run.gibba044.stdout: debug osd = 20 2021-11-12T05:49:21.673 INFO:teuthology.orchestra.run.gibba044.stdout: debug rocksdb = 10 2021-11-12T05:49:21.673 INFO:teuthology.orchestra.run.gibba044.stdout: mon osd backfillfull_ratio = 0.85 2021-11-12T05:49:21.674 INFO:teuthology.orchestra.run.gibba044.stdout: mon osd full ratio = 0.9 2021-11-12T05:49:21.674 INFO:teuthology.orchestra.run.gibba044.stdout: mon osd nearfull ratio = 0.8 2021-11-12T05:49:21.674 INFO:teuthology.orchestra.run.gibba044.stdout: osd failsafe full ratio = 0.95 2021-11-12T05:49:21.674 INFO:teuthology.orchestra.run.gibba044.stdout: osd objectstore = bluestore 2021-11-12T05:49:21.674 INFO:teuthology.orchestra.run.gibba044.stdout: osd op complaint time = 180 2021-11-12T05:49:21.675 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:21.675 INFO:teuthology.orchestra.run.gibba044.stdout:[mgr] 2021-11-12T05:49:21.675 INFO:teuthology.orchestra.run.gibba044.stdout: debug ms = 1 2021-11-12T05:49:21.675 INFO:teuthology.orchestra.run.gibba044.stdout: debug mgr = 20 2021-11-12T05:49:21.675 INFO:teuthology.orchestra.run.gibba044.stdout: debug mon = 20 2021-11-12T05:49:21.676 INFO:teuthology.orchestra.run.gibba044.stdout: debug auth = 20 2021-11-12T05:49:21.676 INFO:teuthology.orchestra.run.gibba044.stdout: mon reweight min pgs per osd = 4 2021-11-12T05:49:21.676 INFO:teuthology.orchestra.run.gibba044.stdout: mon reweight min bytes per osd = 10 2021-11-12T05:49:21.676 INFO:teuthology.orchestra.run.gibba044.stdout: mgr/telemetry/nag = false 2021-11-12T05:49:21.676 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:21.677 INFO:teuthology.orchestra.run.gibba044.stdout:[mon] 2021-11-12T05:49:21.677 INFO:teuthology.orchestra.run.gibba044.stdout: debug ms = 1 2021-11-12T05:49:21.677 INFO:teuthology.orchestra.run.gibba044.stdout: debug mon = 20 2021-11-12T05:49:21.677 INFO:teuthology.orchestra.run.gibba044.stdout: debug paxos = 20 2021-11-12T05:49:21.677 INFO:teuthology.orchestra.run.gibba044.stdout: debug auth = 20 2021-11-12T05:49:21.678 INFO:teuthology.orchestra.run.gibba044.stdout: mon data avail warn = 5 2021-11-12T05:49:21.678 INFO:teuthology.orchestra.run.gibba044.stdout: mon mgr mkfs grace = 240 2021-11-12T05:49:21.678 INFO:teuthology.orchestra.run.gibba044.stdout: mon reweight min pgs per osd = 4 2021-11-12T05:49:21.678 INFO:teuthology.orchestra.run.gibba044.stdout: mon osd reporter subtree level = osd 2021-11-12T05:49:21.679 INFO:teuthology.orchestra.run.gibba044.stdout: mon osd prime pg temp = true 2021-11-12T05:49:21.679 INFO:teuthology.orchestra.run.gibba044.stdout: mon reweight min bytes per osd = 10 2021-11-12T05:49:21.679 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:21.679 INFO:teuthology.orchestra.run.gibba044.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-12T05:49:21.679 INFO:teuthology.orchestra.run.gibba044.stdout: auth mon ticket ttl = 660 # 11m 2021-11-12T05:49:21.680 INFO:teuthology.orchestra.run.gibba044.stdout: auth service ticket ttl = 240 # 4m 2021-11-12T05:49:21.680 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:21.680 INFO:teuthology.orchestra.run.gibba044.stdout: # don't complain about insecure global_id in the test suite 2021-11-12T05:49:21.680 INFO:teuthology.orchestra.run.gibba044.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-12T05:49:21.680 INFO:teuthology.orchestra.run.gibba044.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-12T05:49:21.681 INFO:teuthology.orchestra.run.gibba044.stdout: mon op complaint time = 120 2021-11-12T05:49:21.681 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:21.681 INFO:teuthology.orchestra.run.gibba044.stdout:[client] 2021-11-12T05:49:21.681 INFO:teuthology.orchestra.run.gibba044.stdout: rgw cache enabled = true 2021-11-12T05:49:21.681 INFO:teuthology.orchestra.run.gibba044.stdout: rgw enable ops log = true 2021-11-12T05:49:21.682 INFO:teuthology.orchestra.run.gibba044.stdout: rgw enable usage log = true 2021-11-12T05:49:21.682 INFO:teuthology.orchestra.run.gibba044.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-12T05:49:21.682 INFO:teuthology.orchestra.run.gibba044.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-12T05:49:21.682 INFO:teuthology.orchestra.run.gibba044.stdout: client mount timeout = 600 2021-11-12T05:49:21.682 INFO:teuthology.orchestra.run.gibba044.stdout: debug client = 20 2021-11-12T05:49:21.683 INFO:teuthology.orchestra.run.gibba044.stdout: debug ms = 1 2021-11-12T05:49:21.683 INFO:teuthology.orchestra.run.gibba044.stdout: rados mon op timeout = 15m 2021-11-12T05:49:21.683 INFO:teuthology.orchestra.run.gibba044.stdout: rados osd op timeout = 15m 2021-11-12T05:49:21.683 INFO:teuthology.orchestra.run.gibba044.stdout: client debug getattr caps = true 2021-11-12T05:49:21.683 INFO:teuthology.orchestra.run.gibba044.stdout:[mon.a] 2021-11-12T05:49:21.684 INFO:teuthology.orchestra.run.gibba044.stdout:[mon.b] 2021-11-12T05:49:21.684 INFO:teuthology.orchestra.run.gibba044.stdout:[mon.c] 2021-11-12T05:49:21.684 INFO:teuthology.orchestra.run.gibba044.stdout:[mds.a] 2021-11-12T05:49:21.684 INFO:teuthology.orchestra.run.gibba044.stdout:[mds.b] 2021-11-12T05:49:21.685 INFO:teuthology.orchestra.run.gibba044.stdout:[mds] 2021-11-12T05:49:21.685 INFO:teuthology.orchestra.run.gibba044.stdout: debug mds = 20 2021-11-12T05:49:21.685 INFO:teuthology.orchestra.run.gibba044.stdout: debug ms = 1 2021-11-12T05:49:21.685 INFO:teuthology.orchestra.run.gibba044.stdout: mds bal frag = True 2021-11-12T05:49:21.685 INFO:teuthology.orchestra.run.gibba044.stdout: mds bal fragment size max = 10000 2021-11-12T05:49:21.686 INFO:teuthology.orchestra.run.gibba044.stdout: mds bal merge size = 5 2021-11-12T05:49:21.686 INFO:teuthology.orchestra.run.gibba044.stdout: mds bal split bits = 3 2021-11-12T05:49:21.686 INFO:teuthology.orchestra.run.gibba044.stdout: mds bal split size = 100 2021-11-12T05:49:21.686 INFO:teuthology.orchestra.run.gibba044.stdout: mds debug frag = True 2021-11-12T05:49:21.687 INFO:teuthology.orchestra.run.gibba044.stdout: mds debug scatterstat = True 2021-11-12T05:49:21.687 INFO:teuthology.orchestra.run.gibba044.stdout: mds op complaint time = 180 2021-11-12T05:49:21.687 INFO:teuthology.orchestra.run.gibba044.stdout: mds verify scatter = True 2021-11-12T05:49:21.687 INFO:teuthology.orchestra.run.gibba044.stdout: osd op complaint time = 180 2021-11-12T05:49:21.687 INFO:teuthology.orchestra.run.gibba044.stdout: rados mon op timeout = 15m 2021-11-12T05:49:21.688 INFO:teuthology.orchestra.run.gibba044.stdout: rados osd op timeout = 15m 2021-11-12T05:49:21.688 INFO:teuthology.orchestra.run.gibba038.stdout:[global] 2021-11-12T05:49:21.688 INFO:teuthology.orchestra.run.gibba038.stdout: chdir = "" 2021-11-12T05:49:21.688 INFO:teuthology.orchestra.run.gibba038.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-12T05:49:21.689 INFO:teuthology.orchestra.run.gibba038.stdout: auth supported = cephx 2021-11-12T05:49:21.689 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:21.689 INFO:teuthology.orchestra.run.gibba038.stdout: filestore xattr use omap = true 2021-11-12T05:49:21.689 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:21.689 INFO:teuthology.orchestra.run.gibba038.stdout: mon clock drift allowed = 1.000 2021-11-12T05:49:21.690 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:21.690 INFO:teuthology.orchestra.run.gibba038.stdout: osd crush chooseleaf type = 0 2021-11-12T05:49:21.690 INFO:teuthology.orchestra.run.gibba038.stdout: auth debug = true 2021-11-12T05:49:21.690 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:21.690 INFO:teuthology.orchestra.run.gibba038.stdout: ms die on old message = true 2021-11-12T05:49:21.691 INFO:teuthology.orchestra.run.gibba038.stdout: ms die on bug = true 2021-11-12T05:49:21.691 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:21.691 INFO:teuthology.orchestra.run.gibba038.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-12T05:49:21.691 INFO:teuthology.orchestra.run.gibba038.stdout: mon pg warn max object skew = 0 2021-11-12T05:49:21.692 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:21.692 INFO:teuthology.orchestra.run.gibba038.stdout: # disable pg_autoscaler by default for new pools 2021-11-12T05:49:21.692 INFO:teuthology.orchestra.run.gibba038.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-12T05:49:21.692 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:21.692 INFO:teuthology.orchestra.run.gibba038.stdout: osd pool default size = 2 2021-11-12T05:49:21.693 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:21.693 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd allow primary affinity = true 2021-11-12T05:49:21.693 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd allow pg remap = true 2021-11-12T05:49:21.693 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on legacy crush tunables = false 2021-11-12T05:49:21.693 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on crush straw calc version zero = false 2021-11-12T05:49:21.694 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on no sortbitwise = false 2021-11-12T05:49:21.694 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on osd down out interval zero = false 2021-11-12T05:49:21.694 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on too few osds = false 2021-11-12T05:49:21.694 INFO:teuthology.orchestra.run.gibba038.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-12T05:49:21.694 INFO:teuthology.orchestra.run.gibba038.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-12T05:49:21.695 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:21.695 INFO:teuthology.orchestra.run.gibba038.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-12T05:49:21.695 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:21.695 INFO:teuthology.orchestra.run.gibba038.stdout: osd default data pool replay window = 5 2021-11-12T05:49:21.696 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:21.696 INFO:teuthology.orchestra.run.gibba038.stdout: mon allow pool delete = true 2021-11-12T05:49:21.696 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:21.696 INFO:teuthology.orchestra.run.gibba038.stdout: mon cluster log file level = debug 2021-11-12T05:49:21.696 INFO:teuthology.orchestra.run.gibba038.stdout: debug asserts on shutdown = true 2021-11-12T05:49:21.697 INFO:teuthology.orchestra.run.gibba038.stdout: mon health detail to clog = false 2021-11-12T05:49:21.697 INFO:teuthology.orchestra.run.gibba038.stdout: mon host = "172.21.2.105,172.21.2.115,[v2:172.21.2.115:3301,v1:172.21.2.115:6790]" 2021-11-12T05:49:21.697 INFO:teuthology.orchestra.run.gibba038.stdout: fsid = 22928e10-9f3c-479a-96ca-77d6ddf80f9f 2021-11-12T05:49:21.697 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:21.698 INFO:teuthology.orchestra.run.gibba038.stdout:[osd] 2021-11-12T05:49:21.698 INFO:teuthology.orchestra.run.gibba038.stdout: osd journal size = 100 2021-11-12T05:49:21.698 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:21.698 INFO:teuthology.orchestra.run.gibba038.stdout: osd scrub load threshold = 5.0 2021-11-12T05:49:21.698 INFO:teuthology.orchestra.run.gibba038.stdout: osd scrub max interval = 600 2021-11-12T05:49:21.699 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:21.699 INFO:teuthology.orchestra.run.gibba038.stdout: osd recover clone overlap = true 2021-11-12T05:49:21.699 INFO:teuthology.orchestra.run.gibba038.stdout: osd recovery max chunk = 1048576 2021-11-12T05:49:21.699 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:21.700 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug shutdown = true 2021-11-12T05:49:21.700 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug op order = true 2021-11-12T05:49:21.700 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug verify stray on activate = true 2021-11-12T05:49:21.700 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:21.700 INFO:teuthology.orchestra.run.gibba038.stdout: osd open classes on start = true 2021-11-12T05:49:21.700 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug pg log writeout = true 2021-11-12T05:49:21.701 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:21.701 INFO:teuthology.orchestra.run.gibba038.stdout: osd deep scrub update digest min age = 30 2021-11-12T05:49:21.701 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:21.701 INFO:teuthology.orchestra.run.gibba038.stdout: osd map max advance = 10 2021-11-12T05:49:21.702 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:21.702 INFO:teuthology.orchestra.run.gibba038.stdout: journal zero on create = true 2021-11-12T05:49:21.702 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:21.702 INFO:teuthology.orchestra.run.gibba038.stdout: filestore ondisk finisher threads = 3 2021-11-12T05:49:21.702 INFO:teuthology.orchestra.run.gibba038.stdout: filestore apply finisher threads = 3 2021-11-12T05:49:21.703 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:21.703 INFO:teuthology.orchestra.run.gibba038.stdout: bdev debug aio = true 2021-11-12T05:49:21.703 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug misdirected ops = true 2021-11-12T05:49:21.703 INFO:teuthology.orchestra.run.gibba038.stdout: bluestore block size = 96636764160 2021-11-12T05:49:21.703 INFO:teuthology.orchestra.run.gibba038.stdout: bluestore compression mode = aggressive 2021-11-12T05:49:21.704 INFO:teuthology.orchestra.run.gibba038.stdout: bluestore fsck on mount = True 2021-11-12T05:49:21.704 INFO:teuthology.orchestra.run.gibba038.stdout: debug bluefs = 20 2021-11-12T05:49:21.704 INFO:teuthology.orchestra.run.gibba038.stdout: debug bluestore = 20 2021-11-12T05:49:21.704 INFO:teuthology.orchestra.run.gibba038.stdout: debug ms = 1 2021-11-12T05:49:21.704 INFO:teuthology.orchestra.run.gibba038.stdout: debug osd = 20 2021-11-12T05:49:21.705 INFO:teuthology.orchestra.run.gibba038.stdout: debug rocksdb = 10 2021-11-12T05:49:21.705 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd backfillfull_ratio = 0.85 2021-11-12T05:49:21.705 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd full ratio = 0.9 2021-11-12T05:49:21.705 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd nearfull ratio = 0.8 2021-11-12T05:49:21.706 INFO:teuthology.orchestra.run.gibba038.stdout: osd failsafe full ratio = 0.95 2021-11-12T05:49:21.706 INFO:teuthology.orchestra.run.gibba038.stdout: osd objectstore = bluestore 2021-11-12T05:49:21.706 INFO:teuthology.orchestra.run.gibba038.stdout: osd op complaint time = 180 2021-11-12T05:49:21.706 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:21.707 INFO:teuthology.orchestra.run.gibba038.stdout:[mgr] 2021-11-12T05:49:21.707 INFO:teuthology.orchestra.run.gibba038.stdout: debug ms = 1 2021-11-12T05:49:21.707 INFO:teuthology.orchestra.run.gibba038.stdout: debug mgr = 20 2021-11-12T05:49:21.707 INFO:teuthology.orchestra.run.gibba038.stdout: debug mon = 20 2021-11-12T05:49:21.707 INFO:teuthology.orchestra.run.gibba038.stdout: debug auth = 20 2021-11-12T05:49:21.708 INFO:teuthology.orchestra.run.gibba038.stdout: mon reweight min pgs per osd = 4 2021-11-12T05:49:21.708 INFO:teuthology.orchestra.run.gibba038.stdout: mon reweight min bytes per osd = 10 2021-11-12T05:49:21.708 INFO:teuthology.orchestra.run.gibba038.stdout: mgr/telemetry/nag = false 2021-11-12T05:49:21.708 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:21.709 INFO:teuthology.orchestra.run.gibba038.stdout:[mon] 2021-11-12T05:49:21.709 INFO:teuthology.orchestra.run.gibba038.stdout: debug ms = 1 2021-11-12T05:49:21.709 INFO:teuthology.orchestra.run.gibba038.stdout: debug mon = 20 2021-11-12T05:49:21.709 INFO:teuthology.orchestra.run.gibba038.stdout: debug paxos = 20 2021-11-12T05:49:21.709 INFO:teuthology.orchestra.run.gibba038.stdout: debug auth = 20 2021-11-12T05:49:21.710 INFO:teuthology.orchestra.run.gibba038.stdout: mon data avail warn = 5 2021-11-12T05:49:21.710 INFO:teuthology.orchestra.run.gibba038.stdout: mon mgr mkfs grace = 240 2021-11-12T05:49:21.710 INFO:teuthology.orchestra.run.gibba038.stdout: mon reweight min pgs per osd = 4 2021-11-12T05:49:21.710 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd reporter subtree level = osd 2021-11-12T05:49:21.710 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd prime pg temp = true 2021-11-12T05:49:21.711 INFO:teuthology.orchestra.run.gibba038.stdout: mon reweight min bytes per osd = 10 2021-11-12T05:49:21.711 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:21.711 INFO:teuthology.orchestra.run.gibba038.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-12T05:49:21.711 INFO:teuthology.orchestra.run.gibba038.stdout: auth mon ticket ttl = 660 # 11m 2021-11-12T05:49:21.712 INFO:teuthology.orchestra.run.gibba038.stdout: auth service ticket ttl = 240 # 4m 2021-11-12T05:49:21.712 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:21.712 INFO:teuthology.orchestra.run.gibba038.stdout: # don't complain about insecure global_id in the test suite 2021-11-12T05:49:21.712 INFO:teuthology.orchestra.run.gibba038.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-12T05:49:21.712 INFO:teuthology.orchestra.run.gibba038.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-12T05:49:21.713 INFO:teuthology.orchestra.run.gibba038.stdout: mon op complaint time = 120 2021-11-12T05:49:21.713 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:21.713 INFO:teuthology.orchestra.run.gibba038.stdout:[client] 2021-11-12T05:49:21.713 INFO:teuthology.orchestra.run.gibba038.stdout: rgw cache enabled = true 2021-11-12T05:49:21.713 INFO:teuthology.orchestra.run.gibba038.stdout: rgw enable ops log = true 2021-11-12T05:49:21.714 INFO:teuthology.orchestra.run.gibba038.stdout: rgw enable usage log = true 2021-11-12T05:49:21.714 INFO:teuthology.orchestra.run.gibba038.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-12T05:49:21.714 INFO:teuthology.orchestra.run.gibba038.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-12T05:49:21.714 INFO:teuthology.orchestra.run.gibba038.stdout: client mount timeout = 600 2021-11-12T05:49:21.715 INFO:teuthology.orchestra.run.gibba038.stdout: debug client = 20 2021-11-12T05:49:21.715 INFO:teuthology.orchestra.run.gibba038.stdout: debug ms = 1 2021-11-12T05:49:21.715 INFO:teuthology.orchestra.run.gibba038.stdout: rados mon op timeout = 15m 2021-11-12T05:49:21.715 INFO:teuthology.orchestra.run.gibba038.stdout: rados osd op timeout = 15m 2021-11-12T05:49:21.715 INFO:teuthology.orchestra.run.gibba038.stdout: client debug getattr caps = true 2021-11-12T05:49:21.716 INFO:teuthology.orchestra.run.gibba038.stdout:[mon.a] 2021-11-12T05:49:21.716 INFO:teuthology.orchestra.run.gibba038.stdout:[mon.b] 2021-11-12T05:49:21.716 INFO:teuthology.orchestra.run.gibba038.stdout:[mon.c] 2021-11-12T05:49:21.716 INFO:teuthology.orchestra.run.gibba038.stdout:[mds.a] 2021-11-12T05:49:21.717 INFO:teuthology.orchestra.run.gibba038.stdout:[mds.b] 2021-11-12T05:49:21.717 INFO:teuthology.orchestra.run.gibba038.stdout:[mds] 2021-11-12T05:49:21.717 INFO:teuthology.orchestra.run.gibba038.stdout: debug mds = 20 2021-11-12T05:49:21.717 INFO:teuthology.orchestra.run.gibba038.stdout: debug ms = 1 2021-11-12T05:49:21.717 INFO:teuthology.orchestra.run.gibba038.stdout: mds bal frag = True 2021-11-12T05:49:21.718 INFO:teuthology.orchestra.run.gibba038.stdout: mds bal fragment size max = 10000 2021-11-12T05:49:21.718 INFO:teuthology.orchestra.run.gibba038.stdout: mds bal merge size = 5 2021-11-12T05:49:21.718 INFO:teuthology.orchestra.run.gibba038.stdout: mds bal split bits = 3 2021-11-12T05:49:21.718 INFO:teuthology.orchestra.run.gibba038.stdout: mds bal split size = 100 2021-11-12T05:49:21.718 INFO:teuthology.orchestra.run.gibba038.stdout: mds debug frag = True 2021-11-12T05:49:21.719 INFO:teuthology.orchestra.run.gibba038.stdout: mds debug scatterstat = True 2021-11-12T05:49:21.719 INFO:teuthology.orchestra.run.gibba038.stdout: mds op complaint time = 180 2021-11-12T05:49:21.719 INFO:teuthology.orchestra.run.gibba038.stdout: mds verify scatter = True 2021-11-12T05:49:21.719 INFO:teuthology.orchestra.run.gibba038.stdout: osd op complaint time = 180 2021-11-12T05:49:21.719 INFO:teuthology.orchestra.run.gibba038.stdout: rados mon op timeout = 15m 2021-11-12T05:49:21.720 INFO:teuthology.orchestra.run.gibba038.stdout: rados osd op timeout = 15m 2021-11-12T05:49:21.720 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:49:21.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.772+0000 7efd6b5b1700 1 Processor -- start 2021-11-12T05:49:21.776 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.772+0000 7efd6b5b1700 1 -- start start 2021-11-12T05:49:21.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.772+0000 7efd6b5b1700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7efd640b6cd0 0x7efd640b70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:21.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.772+0000 7efd6b5b1700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efd640b1690 0x7efd6413fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:21.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.772+0000 7efd6b5b1700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7efd64139a50 0x7efd64139ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:21.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.772+0000 7efd6b5b1700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd641402a0 con 0x7efd640b6cd0 2021-11-12T05:49:21.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.772+0000 7efd6b5b1700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd640ae0f0 con 0x7efd64139a50 2021-11-12T05:49:21.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.772+0000 7efd6b5b1700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd640ae390 con 0x7efd640b1690 2021-11-12T05:49:21.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.772+0000 7efd6934d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7efd640b6cd0 0x7efd640b70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:21.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.772+0000 7efd6934d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7efd640b6cd0 0x7efd640b70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51686/0 (socket says 172.21.2.105:51686) 2021-11-12T05:49:21.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.772+0000 7efd6934d700 1 -- 172.21.2.105:0/579282968 learned_addr learned my addr 172.21.2.105:0/579282968 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:21.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.772+0000 7efd6934d700 1 -- 172.21.2.105:0/579282968 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efd640b1690 msgr2=0x7efd6413fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:21.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.772+0000 7efd6934d700 1 --2- 172.21.2.105:0/579282968 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efd640b1690 0x7efd6413fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:21.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.772+0000 7efd6934d700 1 -- 172.21.2.105:0/579282968 >> v2:172.21.2.115:3300/0 conn(0x7efd64139a50 msgr2=0x7efd64139ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:21.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.772+0000 7efd6934d700 1 --2- 172.21.2.105:0/579282968 >> v2:172.21.2.115:3300/0 conn(0x7efd64139a50 0x7efd64139ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:21.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.772+0000 7efd6934d700 1 -- 172.21.2.105:0/579282968 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd641433b0 con 0x7efd640b6cd0 2021-11-12T05:49:21.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.772+0000 7efd6934d700 1 --2- 172.21.2.105:0/579282968 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efd640b6cd0 0x7efd640b70b0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 rx=0x7efd60002f70 tx=0x7efd60006ee0).ready entity=mon.0 client_cookie=c2f8b32c1f96a733 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:21.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.772+0000 7efd53fff700 1 -- 172.21.2.105:0/579282968 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd6000bc50 con 0x7efd640b6cd0 2021-11-12T05:49:21.781 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.772+0000 7efd53fff700 1 -- 172.21.2.105:0/579282968 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd60000e90 con 0x7efd640b6cd0 2021-11-12T05:49:21.781 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.772+0000 7efd53fff700 1 -- 172.21.2.105:0/579282968 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd6000de90 con 0x7efd640b6cd0 2021-11-12T05:49:21.781 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.772+0000 7efd6b5b1700 1 -- 172.21.2.105:0/579282968 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efd640b6cd0 msgr2=0x7efd640b70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:21.781 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.772+0000 7efd6b5b1700 1 --2- 172.21.2.105:0/579282968 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efd640b6cd0 0x7efd640b70b0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 rx=0x7efd60002f70 tx=0x7efd60006ee0).stop 2021-11-12T05:49:21.782 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.772+0000 7efd6b5b1700 1 -- 172.21.2.105:0/579282968 shutdown_connections 2021-11-12T05:49:21.782 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.772+0000 7efd6b5b1700 1 --2- 172.21.2.105:0/579282968 >> v2:172.21.2.115:3300/0 conn(0x7efd64139a50 0x7efd64139ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:21.782 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.772+0000 7efd6b5b1700 1 --2- 172.21.2.105:0/579282968 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efd640b1690 0x7efd6413fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:21.782 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.772+0000 7efd6b5b1700 1 --2- 172.21.2.105:0/579282968 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efd640b6cd0 0x7efd640b70b0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:21.783 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.772+0000 7efd6b5b1700 1 -- 172.21.2.105:0/579282968 >> 172.21.2.105:0/579282968 conn(0x7efd64062270 msgr2=0x7efd640b65c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:21.785 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.772+0000 7efd6b5b1700 1 -- 172.21.2.105:0/579282968 shutdown_connections 2021-11-12T05:49:21.785 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.772+0000 7efd6b5b1700 1 -- 172.21.2.105:0/579282968 wait complete. 2021-11-12T05:49:21.785 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.772+0000 7efd6b5b1700 1 Processor -- start 2021-11-12T05:49:21.786 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.772+0000 7efd6b5b1700 1 -- start start 2021-11-12T05:49:21.786 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.772+0000 7efd6b5b1700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efd640b1690 0x7efd6413a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:21.786 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.772+0000 7efd6b5b1700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efd640b6cd0 0x7efd6413ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:21.786 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.772+0000 7efd6b5b1700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efd64139a50 0x7efd64151a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:21.787 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.772+0000 7efd6b5b1700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd640b6380 con 0x7efd640b6cd0 2021-11-12T05:49:21.787 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.772+0000 7efd6b5b1700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd640b6620 con 0x7efd640b1690 2021-11-12T05:49:21.787 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.772+0000 7efd6b5b1700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6413aff0 con 0x7efd64139a50 2021-11-12T05:49:21.787 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.776+0000 7efd68b4c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efd640b6cd0 0x7efd6413ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:21.787 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.776+0000 7efd68b4c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efd640b6cd0 0x7efd6413ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51694/0 (socket says 172.21.2.105:51694) 2021-11-12T05:49:21.788 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.776+0000 7efd68b4c700 1 -- 172.21.2.105:0/1883959980 learned_addr learned my addr 172.21.2.105:0/1883959980 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:21.788 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.776+0000 7efd68b4c700 1 -- 172.21.2.105:0/1883959980 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efd64139a50 msgr2=0x7efd64151a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:21.788 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.776+0000 7efd68b4c700 1 --2- 172.21.2.105:0/1883959980 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efd64139a50 0x7efd64151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:21.788 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.776+0000 7efd68b4c700 1 -- 172.21.2.105:0/1883959980 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efd640b1690 msgr2=0x7efd6413a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:21.789 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.776+0000 7efd68b4c700 1 --2- 172.21.2.105:0/1883959980 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efd640b1690 0x7efd6413a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:21.789 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.776+0000 7efd68b4c700 1 -- 172.21.2.105:0/1883959980 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6000d410 con 0x7efd640b6cd0 2021-11-12T05:49:21.789 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.776+0000 7efd68b4c700 1 --2- 172.21.2.105:0/1883959980 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efd640b6cd0 0x7efd6413ee50 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 rx=0x7efd54002f70 tx=0x7efd54006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:21.789 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.776+0000 7efd527fc700 1 -- 172.21.2.105:0/1883959980 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd54013460 con 0x7efd640b6cd0 2021-11-12T05:49:21.790 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.776+0000 7efd527fc700 1 -- 172.21.2.105:0/1883959980 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd540135c0 con 0x7efd640b6cd0 2021-11-12T05:49:21.790 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.776+0000 7efd527fc700 1 -- 172.21.2.105:0/1883959980 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd54013920 con 0x7efd640b6cd0 2021-11-12T05:49:21.790 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.776+0000 7efd6b5b1700 1 -- 172.21.2.105:0/1883959980 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd64063f50 con 0x7efd640b6cd0 2021-11-12T05:49:21.790 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.776+0000 7efd6b5b1700 1 -- 172.21.2.105:0/1883959980 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd6413b490 con 0x7efd640b6cd0 2021-11-12T05:49:21.790 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.776+0000 7efd6b5b1700 1 -- 172.21.2.105:0/1883959980 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd6413b1b0 con 0x7efd640b6cd0 2021-11-12T05:49:21.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.776+0000 7efd527fc700 1 -- 172.21.2.105:0/1883959980 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efd5401a060 con 0x7efd640b6cd0 2021-11-12T05:49:21.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.776+0000 7efd527fc700 1 --2- 172.21.2.105:0/1883959980 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efd440536f0 0x7efd44055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:21.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.776+0000 7efd527fc700 1 -- 172.21.2.105:0/1883959980 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6416+0+0 (secure 0 0 0) 0x7efd5406b670 con 0x7efd640b6cd0 2021-11-12T05:49:21.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.776+0000 7efd6934d700 1 --2- 172.21.2.105:0/1883959980 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efd440536f0 0x7efd44055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:21.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.776+0000 7efd6934d700 1 --2- 172.21.2.105:0/1883959980 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efd440536f0 0x7efd44055bb0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7efd60002f70 tx=0x7efd64143540).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:21.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.780+0000 7efd527fc700 1 -- 172.21.2.105:0/1883959980 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efd54042570 con 0x7efd640b6cd0 2021-11-12T05:49:21.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.860+0000 7efd6b5b1700 1 -- 172.21.2.105:0/1883959980 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd640b2d10 con 0x7efd640b6cd0 2021-11-12T05:49:21.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.860+0000 7efd527fc700 1 -- 172.21.2.105:0/1883959980 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) v1 ==== 74+0+16285 (secure 0 0 0) 0x7efd54045b90 con 0x7efd640b6cd0 2021-11-12T05:49:21.867 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:21.867 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":136,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:49:10.427356+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:49:05.315585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-11-12T05:49:06.466127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:49:21.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.864+0000 7efd6b5b1700 1 -- 172.21.2.105:0/1883959980 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efd440536f0 msgr2=0x7efd44055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:21.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.864+0000 7efd6b5b1700 1 --2- 172.21.2.105:0/1883959980 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efd440536f0 0x7efd44055bb0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7efd60002f70 tx=0x7efd64143540).stop 2021-11-12T05:49:21.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.864+0000 7efd6b5b1700 1 -- 172.21.2.105:0/1883959980 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efd640b6cd0 msgr2=0x7efd6413ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:21.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.864+0000 7efd6b5b1700 1 --2- 172.21.2.105:0/1883959980 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efd640b6cd0 0x7efd6413ee50 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 rx=0x7efd54002f70 tx=0x7efd54006ec0).stop 2021-11-12T05:49:21.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.864+0000 7efd6b5b1700 1 -- 172.21.2.105:0/1883959980 shutdown_connections 2021-11-12T05:49:21.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.864+0000 7efd6b5b1700 1 --2- 172.21.2.105:0/1883959980 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efd440536f0 0x7efd44055bb0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:21.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.864+0000 7efd6b5b1700 1 --2- 172.21.2.105:0/1883959980 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efd64139a50 0x7efd64151a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:21.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.864+0000 7efd6b5b1700 1 --2- 172.21.2.105:0/1883959980 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efd640b6cd0 0x7efd6413ee50 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:21.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.864+0000 7efd6b5b1700 1 --2- 172.21.2.105:0/1883959980 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efd640b1690 0x7efd6413a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:21.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.864+0000 7efd6b5b1700 1 -- 172.21.2.105:0/1883959980 >> 172.21.2.105:0/1883959980 conn(0x7efd64062270 msgr2=0x7efd64137200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:21.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.864+0000 7efd6b5b1700 1 -- 172.21.2.105:0/1883959980 shutdown_connections 2021-11-12T05:49:21.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.864+0000 7efd6b5b1700 1 -- 172.21.2.105:0/1883959980 wait complete. 2021-11-12T05:49:21.874 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-12T05:49:05.315585+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '135', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2021-11-12T05:49:06.466127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '136', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-12T05:49:21.875 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:49:21.927 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.920+0000 7f0743787700 1 Processor -- start 2021-11-12T05:49:21.927 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.924+0000 7f0743787700 1 -- start start 2021-11-12T05:49:21.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.924+0000 7f0743787700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f073c0aff10 0x7f073c141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:21.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.924+0000 7f0743787700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f073c0b0ea0 0x7f073c0b5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:21.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.924+0000 7f0743787700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f073c0aebb0 con 0x7f073c141190 2021-11-12T05:49:21.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.924+0000 7f0743787700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f073c0b15b0 con 0x7f073c0aff10 2021-11-12T05:49:21.929 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.924+0000 7f0743787700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f073c0b1310 con 0x7f073c0b0ea0 2021-11-12T05:49:21.929 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.924+0000 7f0741d24700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f073c0b0ea0 0x7f073c0b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:21.929 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.924+0000 7f0740d22700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f073c0aff10 0x7f073c141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:21.930 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.924+0000 7f0741523700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7f073c141190 0x7f073c1473d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:60562/0 (socket says 172.21.2.105:60562) 2021-11-12T05:49:21.930 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.924+0000 7f0741523700 1 -- 172.21.2.105:0/3262181033 learned_addr learned my addr 172.21.2.105:0/3262181033 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:21.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.924+0000 7f0740d22700 1 -- 172.21.2.105:0/3262181033 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f073c0b0ea0 msgr2=0x7f073c0b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:21.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.924+0000 7f0740d22700 1 --2- 172.21.2.105:0/3262181033 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f073c0b0ea0 0x7f073c0b5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:21.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.924+0000 7f0740d22700 1 -- 172.21.2.105:0/3262181033 >> v1:172.21.2.115:6789/0 conn(0x7f073c141190 legacy=0x7f073c1473d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:21.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.924+0000 7f0740d22700 1 -- 172.21.2.105:0/3262181033 --> v2:172.21.2.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073c0adc80 con 0x7f073c0aff10 2021-11-12T05:49:21.933 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.924+0000 7f0740d22700 1 --2- 172.21.2.105:0/3262181033 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f073c0aff10 0x7f073c141570 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f0738002f70 tx=0x7f0738006df0).ready entity=mon.1 client_cookie=6b65ef61b4f7cd17 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:21.933 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.924+0000 7f072ffff700 1 -- 172.21.2.105:0/3262181033 <== mon.1 v2:172.21.2.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f073800d570 con 0x7f073c0aff10 2021-11-12T05:49:21.933 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.924+0000 7f072ffff700 1 -- 172.21.2.105:0/3262181033 <== mon.1 v2:172.21.2.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0738000e90 con 0x7f073c0aff10 2021-11-12T05:49:21.933 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.924+0000 7f072ffff700 1 -- 172.21.2.105:0/3262181033 <== mon.1 v2:172.21.2.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f073800d8c0 con 0x7f073c0aff10 2021-11-12T05:49:21.934 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.928+0000 7f0743787700 1 -- 172.21.2.105:0/3262181033 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f073c0aff10 msgr2=0x7f073c141570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:21.934 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.928+0000 7f0743787700 1 --2- 172.21.2.105:0/3262181033 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f073c0aff10 0x7f073c141570 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f0738002f70 tx=0x7f0738006df0).stop 2021-11-12T05:49:21.934 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.928+0000 7f0743787700 1 -- 172.21.2.105:0/3262181033 shutdown_connections 2021-11-12T05:49:21.934 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.928+0000 7f0743787700 1 --2- 172.21.2.105:0/3262181033 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f073c0b0ea0 0x7f073c0b5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:21.935 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.928+0000 7f0743787700 1 --2- 172.21.2.105:0/3262181033 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f073c0aff10 0x7f073c141570 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:21.935 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.928+0000 7f0743787700 1 -- 172.21.2.105:0/3262181033 >> 172.21.2.105:0/3262181033 conn(0x7f073c062570 msgr2=0x7f073c062950 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:21.935 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.928+0000 7f0743787700 1 -- 172.21.2.105:0/3262181033 shutdown_connections 2021-11-12T05:49:21.935 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.928+0000 7f0743787700 1 -- 172.21.2.105:0/3262181033 wait complete. 2021-11-12T05:49:21.935 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.928+0000 7f0743787700 1 Processor -- start 2021-11-12T05:49:21.936 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.928+0000 7f0743787700 1 -- start start 2021-11-12T05:49:21.938 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.928+0000 7f0743787700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f073c0aff10 0x7f073c066cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:21.938 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.928+0000 7f0743787700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f073c0b0ea0 0x7f073c064540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:21.938 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.928+0000 7f0743787700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f073c141190 0x7f073c1498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:21.938 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.928+0000 7f0743787700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073c148300 con 0x7f073c0b0ea0 2021-11-12T05:49:21.939 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.928+0000 7f0743787700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073c0656c0 con 0x7f073c0aff10 2021-11-12T05:49:21.939 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.928+0000 7f0743787700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f073c139510 con 0x7f073c141190 2021-11-12T05:49:21.939 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.928+0000 7f0740d22700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f073c0b0ea0 0x7f073c064540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:21.939 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.928+0000 7f0740d22700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f073c0b0ea0 0x7f073c064540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51704/0 (socket says 172.21.2.105:51704) 2021-11-12T05:49:21.939 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.928+0000 7f0740d22700 1 -- 172.21.2.105:0/1022352617 learned_addr learned my addr 172.21.2.105:0/1022352617 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:21.940 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.928+0000 7f0740d22700 1 -- 172.21.2.105:0/1022352617 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f073c141190 msgr2=0x7f073c1498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:21.940 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.928+0000 7f0740d22700 1 --2- 172.21.2.105:0/1022352617 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f073c141190 0x7f073c1498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:21.940 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.928+0000 7f0740d22700 1 -- 172.21.2.105:0/1022352617 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f073c0aff10 msgr2=0x7f073c066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:21.940 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.928+0000 7f0740d22700 1 --2- 172.21.2.105:0/1022352617 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f073c0aff10 0x7f073c066cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:21.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.928+0000 7f0740d22700 1 -- 172.21.2.105:0/1022352617 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073800b180 con 0x7f073c0b0ea0 2021-11-12T05:49:21.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.928+0000 7f0740d22700 1 --2- 172.21.2.105:0/1022352617 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f073c0b0ea0 0x7f073c064540 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 rx=0x7f073c14b070 tx=0x7f0738014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:21.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.928+0000 7f072e7fc700 1 -- 172.21.2.105:0/1022352617 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0738016070 con 0x7f073c0b0ea0 2021-11-12T05:49:21.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.928+0000 7f072e7fc700 1 -- 172.21.2.105:0/1022352617 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073800de40 con 0x7f073c0b0ea0 2021-11-12T05:49:21.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.928+0000 7f072e7fc700 1 -- 172.21.2.105:0/1022352617 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f073801e450 con 0x7f073c0b0ea0 2021-11-12T05:49:21.942 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.928+0000 7f0743787700 1 -- 172.21.2.105:0/1022352617 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f073c1397b0 con 0x7f073c0b0ea0 2021-11-12T05:49:21.942 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.928+0000 7f0743787700 1 -- 172.21.2.105:0/1022352617 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f073c140e80 con 0x7f073c0b0ea0 2021-11-12T05:49:21.942 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.928+0000 7f0743787700 1 -- 172.21.2.105:0/1022352617 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f073c0b1850 con 0x7f073c0b0ea0 2021-11-12T05:49:21.942 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.928+0000 7f072e7fc700 1 -- 172.21.2.105:0/1022352617 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0738025030 con 0x7f073c0b0ea0 2021-11-12T05:49:21.942 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.932+0000 7f072e7fc700 1 --2- 172.21.2.105:0/1022352617 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f071c053720 0x7f071c055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:21.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.932+0000 7f072e7fc700 1 -- 172.21.2.105:0/1022352617 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f073806ccb0 con 0x7f073c0b0ea0 2021-11-12T05:49:21.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.932+0000 7f0741523700 1 --2- 172.21.2.105:0/1022352617 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f071c053720 0x7f071c055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:21.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.932+0000 7f0741523700 1 --2- 172.21.2.105:0/1022352617 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f071c053720 0x7f071c055be0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f073c06a380 tx=0x7f0730007860).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:21.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:21.932+0000 7f072e7fc700 1 -- 172.21.2.105:0/1022352617 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0738043bb0 con 0x7f073c0b0ea0 2021-11-12T05:49:22.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.016+0000 7f0743787700 1 -- 172.21.2.105:0/1022352617 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f073c057350 con 0x7f073c0b0ea0 2021-11-12T05:49:22.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.016+0000 7f072e7fc700 1 -- 172.21.2.105:0/1022352617 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v136) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0738023070 con 0x7f073c0b0ea0 2021-11-12T05:49:22.021 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:49:22.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.016+0000 7f0743787700 1 -- 172.21.2.105:0/1022352617 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f071c053720 msgr2=0x7f071c055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:22.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.016+0000 7f0743787700 1 --2- 172.21.2.105:0/1022352617 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f071c053720 0x7f071c055be0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f073c06a380 tx=0x7f0730007860).stop 2021-11-12T05:49:22.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.016+0000 7f0743787700 1 -- 172.21.2.105:0/1022352617 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f073c0b0ea0 msgr2=0x7f073c064540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:22.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.016+0000 7f0743787700 1 --2- 172.21.2.105:0/1022352617 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f073c0b0ea0 0x7f073c064540 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 rx=0x7f073c14b070 tx=0x7f0738014000).stop 2021-11-12T05:49:22.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.016+0000 7f0743787700 1 -- 172.21.2.105:0/1022352617 shutdown_connections 2021-11-12T05:49:22.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.016+0000 7f0743787700 1 --2- 172.21.2.105:0/1022352617 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f071c053720 0x7f071c055be0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:22.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.016+0000 7f0743787700 1 --2- 172.21.2.105:0/1022352617 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f073c141190 0x7f073c1498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:22.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.016+0000 7f0743787700 1 --2- 172.21.2.105:0/1022352617 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f073c0b0ea0 0x7f073c064540 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:22.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.016+0000 7f0743787700 1 --2- 172.21.2.105:0/1022352617 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f073c0aff10 0x7f073c066cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:22.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.016+0000 7f0743787700 1 -- 172.21.2.105:0/1022352617 >> 172.21.2.105:0/1022352617 conn(0x7f073c062570 msgr2=0x7f073c0b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:22.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.016+0000 7f0743787700 1 -- 172.21.2.105:0/1022352617 shutdown_connections 2021-11-12T05:49:22.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.016+0000 7f0743787700 1 -- 172.21.2.105:0/1022352617 wait complete. 2021-11-12T05:49:22.028 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:49:22.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.076+0000 7f5cc5114700 1 Processor -- start 2021-11-12T05:49:22.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.076+0000 7f5cc5114700 1 -- start start 2021-11-12T05:49:22.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.076+0000 7f5cc5114700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f5cc0141190 0x7f5cc0141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:22.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.076+0000 7f5cc5114700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f5cc00aff10 0x7f5cc00b0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:22.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.076+0000 7f5cc5114700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cc00aebb0 con 0x7f5cc01473d0 2021-11-12T05:49:22.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.076+0000 7f5cc5114700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cc00b1390 con 0x7f5cc0141190 2021-11-12T05:49:22.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.076+0000 7f5cc5114700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cc00b5b90 con 0x7f5cc00aff10 2021-11-12T05:49:22.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.076+0000 7f5cbed9d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f5cc0141190 0x7f5cc0141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:22.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.076+0000 7f5cbf59e700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f5cc01473d0 0x7f5cc00b5480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:33878/0 (socket says 172.21.2.105:33878) 2021-11-12T05:49:22.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.076+0000 7f5cbed9d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f5cc0141190 0x7f5cc0141570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51712/0 (socket says 172.21.2.105:51712) 2021-11-12T05:49:22.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.076+0000 7f5cbf59e700 1 -- 172.21.2.105:0/3823393601 learned_addr learned my addr 172.21.2.105:0/3823393601 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:22.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.076+0000 7f5cbed9d700 1 -- 172.21.2.105:0/3823393601 >> v2:172.21.2.115:3300/0 conn(0x7f5cc00aff10 msgr2=0x7f5cc00b0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:22.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.076+0000 7f5cbed9d700 1 --2- 172.21.2.105:0/3823393601 >> v2:172.21.2.115:3300/0 conn(0x7f5cc00aff10 0x7f5cc00b0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:22.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.076+0000 7f5cbed9d700 1 -- 172.21.2.105:0/3823393601 >> v1:172.21.2.105:6789/0 conn(0x7f5cc01473d0 legacy=0x7f5cc00b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:22.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.076+0000 7f5cbed9d700 1 -- 172.21.2.105:0/3823393601 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc00b15b0 con 0x7f5cc0141190 2021-11-12T05:49:22.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.076+0000 7f5cbed9d700 1 --2- 172.21.2.105:0/3823393601 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5cc0141190 0x7f5cc0141570 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 rx=0x7f5ca8002f70 tx=0x7f5ca8006df0).ready entity=mon.0 client_cookie=1afd1ad7d1e6a7c6 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:22.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.076+0000 7f5cbdd9b700 1 -- 172.21.2.105:0/3823393601 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ca800d5c0 con 0x7f5cc0141190 2021-11-12T05:49:22.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.076+0000 7f5cbdd9b700 1 -- 172.21.2.105:0/3823393601 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca8000e90 con 0x7f5cc0141190 2021-11-12T05:49:22.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.076+0000 7f5cbdd9b700 1 -- 172.21.2.105:0/3823393601 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ca800d910 con 0x7f5cc0141190 2021-11-12T05:49:22.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.076+0000 7f5cc5114700 1 -- 172.21.2.105:0/3823393601 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5cc0141190 msgr2=0x7f5cc0141570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:22.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.076+0000 7f5cc5114700 1 --2- 172.21.2.105:0/3823393601 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5cc0141190 0x7f5cc0141570 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 rx=0x7f5ca8002f70 tx=0x7f5ca8006df0).stop 2021-11-12T05:49:22.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.076+0000 7f5cc5114700 1 -- 172.21.2.105:0/3823393601 shutdown_connections 2021-11-12T05:49:22.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.076+0000 7f5cc5114700 1 --2- 172.21.2.105:0/3823393601 >> v2:172.21.2.115:3300/0 conn(0x7f5cc00aff10 0x7f5cc00b0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:22.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.076+0000 7f5cc5114700 1 --2- 172.21.2.105:0/3823393601 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5cc0141190 0x7f5cc0141570 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:22.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.076+0000 7f5cc5114700 1 -- 172.21.2.105:0/3823393601 >> 172.21.2.105:0/3823393601 conn(0x7f5cc0062570 msgr2=0x7f5cc0062950 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:22.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.076+0000 7f5cc5114700 1 -- 172.21.2.105:0/3823393601 shutdown_connections 2021-11-12T05:49:22.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.076+0000 7f5cc5114700 1 -- 172.21.2.105:0/3823393601 wait complete. 2021-11-12T05:49:22.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.080+0000 7f5cc5114700 1 Processor -- start 2021-11-12T05:49:22.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.080+0000 7f5cc5114700 1 -- start start 2021-11-12T05:49:22.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.080+0000 7f5cc5114700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5cc00aff10 0x7f5cc0144670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:22.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.080+0000 7f5cc5114700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5cc0141190 0x7f5cc01424c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:22.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.080+0000 7f5cc5114700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5cc01473d0 0x7f5cc01429b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:22.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.080+0000 7f5cc5114700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc014e560 con 0x7f5cc00aff10 2021-11-12T05:49:22.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.080+0000 7f5cc5114700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc014e800 con 0x7f5cc0141190 2021-11-12T05:49:22.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.080+0000 7f5cc5114700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc014eaa0 con 0x7f5cc01473d0 2021-11-12T05:49:22.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.080+0000 7f5cbed9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5cc00aff10 0x7f5cc0144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:22.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.080+0000 7f5cbed9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5cc00aff10 0x7f5cc0144670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51718/0 (socket says 172.21.2.105:51718) 2021-11-12T05:49:22.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.080+0000 7f5cbed9d700 1 -- 172.21.2.105:0/3186212875 learned_addr learned my addr 172.21.2.105:0/3186212875 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:22.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.080+0000 7f5cbed9d700 1 -- 172.21.2.105:0/3186212875 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5cc01473d0 msgr2=0x7f5cc01429b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:22.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.080+0000 7f5cbed9d700 1 --2- 172.21.2.105:0/3186212875 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5cc01473d0 0x7f5cc01429b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:22.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.080+0000 7f5cbed9d700 1 -- 172.21.2.105:0/3186212875 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5cc0141190 msgr2=0x7f5cc01424c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:22.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.080+0000 7f5cbed9d700 1 --2- 172.21.2.105:0/3186212875 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5cc0141190 0x7f5cc01424c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:22.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.080+0000 7f5cbed9d700 1 -- 172.21.2.105:0/3186212875 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca800b180 con 0x7f5cc00aff10 2021-11-12T05:49:22.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.080+0000 7f5cbed9d700 1 --2- 172.21.2.105:0/3186212875 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5cc00aff10 0x7f5cc0144670 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7f5ca8002f70 tx=0x7f5ca8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:22.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.080+0000 7f5cb7fff700 1 -- 172.21.2.105:0/3186212875 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ca8016070 con 0x7f5cc00aff10 2021-11-12T05:49:22.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.080+0000 7f5cb7fff700 1 -- 172.21.2.105:0/3186212875 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca800d940 con 0x7f5cc00aff10 2021-11-12T05:49:22.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.080+0000 7f5cc5114700 1 -- 172.21.2.105:0/3186212875 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cc0144d50 con 0x7f5cc00aff10 2021-11-12T05:49:22.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.080+0000 7f5cc5114700 1 -- 172.21.2.105:0/3186212875 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cc014d680 con 0x7f5cc00aff10 2021-11-12T05:49:22.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.080+0000 7f5cb7fff700 1 -- 172.21.2.105:0/3186212875 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ca801e450 con 0x7f5cc00aff10 2021-11-12T05:49:22.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.080+0000 7f5cc5114700 1 -- 172.21.2.105:0/3186212875 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cc0147840 con 0x7f5cc00aff10 2021-11-12T05:49:22.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.080+0000 7f5cb7fff700 1 -- 172.21.2.105:0/3186212875 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5ca8025030 con 0x7f5cc00aff10 2021-11-12T05:49:22.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.080+0000 7f5cb7fff700 1 --2- 172.21.2.105:0/3186212875 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5ca40536d0 0x7f5ca4055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:22.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.080+0000 7f5cb7fff700 1 -- 172.21.2.105:0/3186212875 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f5ca806cda0 con 0x7f5cc00aff10 2021-11-12T05:49:22.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.080+0000 7f5cbe59c700 1 --2- 172.21.2.105:0/3186212875 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5ca40536d0 0x7f5ca4055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:22.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.080+0000 7f5cbe59c700 1 --2- 172.21.2.105:0/3186212875 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5ca40536d0 0x7f5ca4055b90 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f5cb0002f70 tx=0x7f5cb0006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:22.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.084+0000 7f5cb7fff700 1 -- 172.21.2.105:0/3186212875 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5ca8043ca0 con 0x7f5cc00aff10 2021-11-12T05:49:22.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.168+0000 7f5cc5114700 1 -- 172.21.2.105:0/3186212875 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5cc0057350 con 0x7f5cc00aff10 2021-11-12T05:49:22.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.168+0000 7f5cb7fff700 1 -- 172.21.2.105:0/3186212875 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v136) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5ca80230a0 con 0x7f5cc00aff10 2021-11-12T05:49:22.173 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:49:22.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.168+0000 7f5cc5114700 1 -- 172.21.2.105:0/3186212875 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5ca40536d0 msgr2=0x7f5ca4055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:22.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.168+0000 7f5cc5114700 1 --2- 172.21.2.105:0/3186212875 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5ca40536d0 0x7f5ca4055b90 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f5cb0002f70 tx=0x7f5cb0006a80).stop 2021-11-12T05:49:22.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.168+0000 7f5cc5114700 1 -- 172.21.2.105:0/3186212875 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5cc00aff10 msgr2=0x7f5cc0144670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:22.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.168+0000 7f5cc5114700 1 --2- 172.21.2.105:0/3186212875 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5cc00aff10 0x7f5cc0144670 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7f5ca8002f70 tx=0x7f5ca8014000).stop 2021-11-12T05:49:22.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.168+0000 7f5cc5114700 1 -- 172.21.2.105:0/3186212875 shutdown_connections 2021-11-12T05:49:22.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.168+0000 7f5cc5114700 1 --2- 172.21.2.105:0/3186212875 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5ca40536d0 0x7f5ca4055b90 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:22.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.168+0000 7f5cc5114700 1 --2- 172.21.2.105:0/3186212875 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5cc01473d0 0x7f5cc01429b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:22.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.168+0000 7f5cc5114700 1 --2- 172.21.2.105:0/3186212875 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5cc0141190 0x7f5cc01424c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:22.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.168+0000 7f5cc5114700 1 --2- 172.21.2.105:0/3186212875 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5cc00aff10 0x7f5cc0144670 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:22.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.168+0000 7f5cc5114700 1 -- 172.21.2.105:0/3186212875 >> 172.21.2.105:0/3186212875 conn(0x7f5cc0062570 msgr2=0x7f5cc0140690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:22.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.168+0000 7f5cc5114700 1 -- 172.21.2.105:0/3186212875 shutdown_connections 2021-11-12T05:49:22.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.168+0000 7f5cc5114700 1 -- 172.21.2.105:0/3186212875 wait complete. 2021-11-12T05:49:22.180 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-12T05:49:22.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b4836b700 1 Processor -- start 2021-11-12T05:49:22.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b4836b700 1 -- start start 2021-11-12T05:49:22.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b4836b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6b400ba330 0x7f6b400b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:22.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b4836b700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f6b4005c720 0x7f6b400624f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:22.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b4836b700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b400ba710 con 0x7f6b400b2df0 2021-11-12T05:49:22.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b4836b700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b400b4520 con 0x7f6b4005c720 2021-11-12T05:49:22.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b4836b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b40061b10 con 0x7f6b400ba330 2021-11-12T05:49:22.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b46908700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f6b400b2df0 0x7f6b400b3240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:33890/0 (socket says 172.21.2.105:33890) 2021-11-12T05:49:22.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b46908700 1 -- 172.21.2.105:0/950673949 learned_addr learned my addr 172.21.2.105:0/950673949 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:22.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b45105700 1 -- 172.21.2.105:0/950673949 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2188731573 0 0) 0x7f6b400ba710 con 0x7f6b400b2df0 2021-11-12T05:49:22.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b45105700 1 -- 172.21.2.105:0/950673949 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b28003260 con 0x7f6b400b2df0 2021-11-12T05:49:22.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b46107700 1 --2- 172.21.2.105:0/950673949 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6b400ba330 0x7f6b400b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:22.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b45906700 1 --2- 172.21.2.105:0/950673949 >> v2:172.21.2.115:3300/0 conn(0x7f6b4005c720 0x7f6b400624f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:22.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b45105700 1 -- 172.21.2.105:0/950673949 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 48799318 0 0) 0x7f6b28003260 con 0x7f6b400b2df0 2021-11-12T05:49:22.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b45105700 1 -- 172.21.2.105:0/950673949 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6b400ba330 msgr2=0x7f6b400b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:22.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b45105700 1 --2- 172.21.2.105:0/950673949 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6b400ba330 0x7f6b400b27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:22.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b45105700 1 -- 172.21.2.105:0/950673949 >> v2:172.21.2.115:3300/0 conn(0x7f6b4005c720 msgr2=0x7f6b400624f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:22.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b45105700 1 --2- 172.21.2.105:0/950673949 >> v2:172.21.2.115:3300/0 conn(0x7f6b4005c720 0x7f6b400624f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:22.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b45105700 1 -- 172.21.2.105:0/950673949 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b40061db0 con 0x7f6b400b2df0 2021-11-12T05:49:22.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b45105700 1 -- 172.21.2.105:0/950673949 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f6b380019e0 con 0x7f6b400b2df0 2021-11-12T05:49:22.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b45105700 1 -- 172.21.2.105:0/950673949 >> v1:172.21.2.105:6789/0 conn(0x7f6b400b2df0 legacy=0x7f6b400b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:22.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b45105700 1 --2- 172.21.2.105:0/950673949 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6b280037d0 0x7f6b28003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:22.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b45105700 1 --2- 172.21.2.105:0/950673949 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6b28004500 0x7f6b28004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:22.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b45105700 1 --2- 172.21.2.105:0/950673949 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6b400ba330 0x7f6b28004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:22.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b45105700 1 -- 172.21.2.105:0/950673949 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b400b4520 con 0x7f6b28004500 2021-11-12T05:49:22.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b45105700 1 -- 172.21.2.105:0/950673949 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b40061b10 con 0x7f6b280037d0 2021-11-12T05:49:22.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b45105700 1 -- 172.21.2.105:0/950673949 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2800b750 con 0x7f6b400ba330 2021-11-12T05:49:22.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b45906700 1 --2- 172.21.2.105:0/950673949 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6b28004500 0x7f6b28004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:22.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b46107700 1 --2- 172.21.2.105:0/950673949 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6b280037d0 0x7f6b28003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:22.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b46908700 1 --2- 172.21.2.105:0/950673949 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6b400ba330 0x7f6b28004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:22.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b45906700 1 -- 172.21.2.105:0/950673949 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6b400ba330 msgr2=0x7f6b28004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:22.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b45906700 1 --2- 172.21.2.105:0/950673949 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6b400ba330 0x7f6b28004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:22.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b45906700 1 -- 172.21.2.105:0/950673949 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6b280037d0 msgr2=0x7f6b28003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:22.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b45906700 1 --2- 172.21.2.105:0/950673949 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6b280037d0 0x7f6b28003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:22.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b45906700 1 -- 172.21.2.105:0/950673949 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b28003260 con 0x7f6b28004500 2021-11-12T05:49:22.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b45906700 1 --2- 172.21.2.105:0/950673949 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6b28004500 0x7f6b28004980 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7f6b3c00c000 tx=0x7f6b3c006df0).ready entity=mon.0 client_cookie=645f7bb1dfe9524 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:22.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b45105700 1 -- 172.21.2.105:0/950673949 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b3c00e830 con 0x7f6b28004500 2021-11-12T05:49:22.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b45105700 1 -- 172.21.2.105:0/950673949 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3c00e990 con 0x7f6b28004500 2021-11-12T05:49:22.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.228+0000 7f6b45105700 1 -- 172.21.2.105:0/950673949 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b3c00ecf0 con 0x7f6b28004500 2021-11-12T05:49:22.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.232+0000 7f6b4836b700 1 -- 172.21.2.105:0/950673949 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6b28004500 msgr2=0x7f6b28004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:22.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.232+0000 7f6b4836b700 1 --2- 172.21.2.105:0/950673949 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6b28004500 0x7f6b28004980 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7f6b3c00c000 tx=0x7f6b3c006df0).stop 2021-11-12T05:49:22.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.232+0000 7f6b46908700 1 -- 172.21.2.105:0/950673949 reap_dead start 2021-11-12T05:49:22.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.232+0000 7f6b4836b700 1 -- 172.21.2.105:0/950673949 shutdown_connections 2021-11-12T05:49:22.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.232+0000 7f6b4836b700 1 -- 172.21.2.105:0/950673949 >> 172.21.2.105:0/950673949 conn(0x7f6b40060a10 msgr2=0x7f6b400b98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:22.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.232+0000 7f6b4836b700 1 -- 172.21.2.105:0/950673949 shutdown_connections 2021-11-12T05:49:22.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.232+0000 7f6b4836b700 1 -- 172.21.2.105:0/950673949 wait complete. 2021-11-12T05:49:22.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.232+0000 7f6b4836b700 1 Processor -- start 2021-11-12T05:49:22.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.232+0000 7f6b4836b700 1 -- start start 2021-11-12T05:49:22.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.232+0000 7f6b4836b700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6b28004500 0x7f6b400b8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:22.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.232+0000 7f6b4836b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6b400b94c0 0x7f6b400b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:22.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.232+0000 7f6b4836b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6b400aebc0 0x7f6b400af040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:22.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.232+0000 7f6b4836b700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b400b02a0 con 0x7f6b400aebc0 2021-11-12T05:49:22.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.232+0000 7f6b4836b700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b400b9920 con 0x7f6b28004500 2021-11-12T05:49:22.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.232+0000 7f6b4836b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b400af530 con 0x7f6b400b94c0 2021-11-12T05:49:22.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.232+0000 7f6b46908700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6b400aebc0 0x7f6b400af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:22.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.232+0000 7f6b46908700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6b400aebc0 0x7f6b400af040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51742/0 (socket says 172.21.2.105:51742) 2021-11-12T05:49:22.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.232+0000 7f6b46908700 1 -- 172.21.2.105:0/1770839216 learned_addr learned my addr 172.21.2.105:0/1770839216 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:22.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.232+0000 7f6b46107700 1 --2- 172.21.2.105:0/1770839216 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6b28004500 0x7f6b400b8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:22.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.232+0000 7f6b45906700 1 --2- 172.21.2.105:0/1770839216 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6b400b94c0 0x7f6b400b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:22.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.232+0000 7f6b46908700 1 -- 172.21.2.105:0/1770839216 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6b400b94c0 msgr2=0x7f6b400b5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:22.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.232+0000 7f6b46908700 1 --2- 172.21.2.105:0/1770839216 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6b400b94c0 0x7f6b400b5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:22.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.232+0000 7f6b46908700 1 -- 172.21.2.105:0/1770839216 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6b28004500 msgr2=0x7f6b400b8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:22.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.232+0000 7f6b46908700 1 --2- 172.21.2.105:0/1770839216 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6b28004500 0x7f6b400b8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:22.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.232+0000 7f6b46908700 1 -- 172.21.2.105:0/1770839216 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b400b8d80 con 0x7f6b400aebc0 2021-11-12T05:49:22.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.232+0000 7f6b46908700 1 --2- 172.21.2.105:0/1770839216 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6b400aebc0 0x7f6b400af040 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7f6b38000b60 tx=0x7f6b400b08d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:22.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.232+0000 7f6b2f7fe700 1 -- 172.21.2.105:0/1770839216 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b38011850 con 0x7f6b400aebc0 2021-11-12T05:49:22.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.232+0000 7f6b2f7fe700 1 -- 172.21.2.105:0/1770839216 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b380119b0 con 0x7f6b400aebc0 2021-11-12T05:49:22.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.232+0000 7f6b4836b700 1 -- 172.21.2.105:0/1770839216 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b400b9020 con 0x7f6b400aebc0 2021-11-12T05:49:22.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.232+0000 7f6b2f7fe700 1 -- 172.21.2.105:0/1770839216 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b38011d10 con 0x7f6b400aebc0 2021-11-12T05:49:22.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.232+0000 7f6b4836b700 1 -- 172.21.2.105:0/1770839216 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b40148c10 con 0x7f6b400aebc0 2021-11-12T05:49:22.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.232+0000 7f6b4836b700 1 -- 172.21.2.105:0/1770839216 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b400b91b0 con 0x7f6b400aebc0 2021-11-12T05:49:22.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.232+0000 7f6b2f7fe700 1 -- 172.21.2.105:0/1770839216 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f6b3801b030 con 0x7f6b400aebc0 2021-11-12T05:49:22.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.232+0000 7f6b2f7fe700 1 --2- 172.21.2.105:0/1770839216 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6b200536a0 0x7f6b20055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:22.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.232+0000 7f6b2f7fe700 1 -- 172.21.2.105:0/1770839216 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f6b3806b710 con 0x7f6b400aebc0 2021-11-12T05:49:22.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.232+0000 7f6b46107700 1 --2- 172.21.2.105:0/1770839216 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6b200536a0 0x7f6b20055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:22.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.236+0000 7f6b46107700 1 --2- 172.21.2.105:0/1770839216 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6b200536a0 0x7f6b20055b60 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f6b3000b000 tx=0x7f6b30006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:22.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.236+0000 7f6b2f7fe700 1 -- 172.21.2.105:0/1770839216 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6b380425b0 con 0x7f6b400aebc0 2021-11-12T05:49:22.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.320+0000 7f6b4836b700 1 -- 172.21.2.105:0/1770839216 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6b40057350 con 0x7f6b400aebc0 2021-11-12T05:49:22.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.320+0000 7f6b2f7fe700 1 -- 172.21.2.105:0/1770839216 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v136) v1 ==== 104+0+10 (secure 0 0 0) 0x7f6b38019070 con 0x7f6b400aebc0 2021-11-12T05:49:22.325 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:49:22.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.320+0000 7f6b4836b700 1 -- 172.21.2.105:0/1770839216 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6b200536a0 msgr2=0x7f6b20055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:22.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.320+0000 7f6b4836b700 1 --2- 172.21.2.105:0/1770839216 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6b200536a0 0x7f6b20055b60 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f6b3000b000 tx=0x7f6b30006df0).stop 2021-11-12T05:49:22.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.320+0000 7f6b4836b700 1 -- 172.21.2.105:0/1770839216 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6b400aebc0 msgr2=0x7f6b400af040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:22.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.320+0000 7f6b4836b700 1 --2- 172.21.2.105:0/1770839216 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6b400aebc0 0x7f6b400af040 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7f6b38000b60 tx=0x7f6b400b08d0).stop 2021-11-12T05:49:22.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.320+0000 7f6b4836b700 1 -- 172.21.2.105:0/1770839216 shutdown_connections 2021-11-12T05:49:22.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.320+0000 7f6b4836b700 1 --2- 172.21.2.105:0/1770839216 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f6b200536a0 0x7f6b20055b60 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:22.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.320+0000 7f6b4836b700 1 --2- 172.21.2.105:0/1770839216 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f6b400aebc0 0x7f6b400af040 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:22.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.320+0000 7f6b4836b700 1 --2- 172.21.2.105:0/1770839216 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6b400b94c0 0x7f6b400b5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:22.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.320+0000 7f6b4836b700 1 --2- 172.21.2.105:0/1770839216 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f6b28004500 0x7f6b400b8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:22.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.320+0000 7f6b4836b700 1 -- 172.21.2.105:0/1770839216 >> 172.21.2.105:0/1770839216 conn(0x7f6b40060a10 msgr2=0x7f6b400b6900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:22.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.320+0000 7f6b4836b700 1 -- 172.21.2.105:0/1770839216 shutdown_connections 2021-11-12T05:49:22.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.320+0000 7f6b4836b700 1 -- 172.21.2.105:0/1770839216 wait complete. 2021-11-12T05:49:22.332 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-12T05:49:22.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.380+0000 7f5a68350700 1 Processor -- start 2021-11-12T05:49:22.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.380+0000 7f5a68350700 1 -- start start 2021-11-12T05:49:22.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.380+0000 7f5a68350700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5a600b2ad0 0x7f5a6013c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:22.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.380+0000 7f5a68350700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f5a600b2160 0x7f5a60142b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:22.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.380+0000 7f5a68350700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a600b2eb0 con 0x7f5a600aff10 2021-11-12T05:49:22.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.380+0000 7f5a68350700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a600afb40 con 0x7f5a600b2160 2021-11-12T05:49:22.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.380+0000 7f5a68350700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a600ad7f0 con 0x7f5a600b2ad0 2021-11-12T05:49:22.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.380+0000 7f5a658eb700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f5a600aff10 0x7f5a6013c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:33914/0 (socket says 172.21.2.105:33914) 2021-11-12T05:49:22.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.380+0000 7f5a658eb700 1 -- 172.21.2.105:0/4048184875 learned_addr learned my addr 172.21.2.105:0/4048184875 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:22.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.380+0000 7f5a650ea700 1 -- 172.21.2.105:0/4048184875 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4024019699 0 0) 0x7f5a600b2eb0 con 0x7f5a600aff10 2021-11-12T05:49:22.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.380+0000 7f5a650ea700 1 -- 172.21.2.105:0/4048184875 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a48003260 con 0x7f5a600aff10 2021-11-12T05:49:22.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.380+0000 7f5a650ea700 1 -- 172.21.2.105:0/4048184875 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2426659145 0 0) 0x7f5a48003260 con 0x7f5a600aff10 2021-11-12T05:49:22.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.380+0000 7f5a650ea700 1 -- 172.21.2.105:0/4048184875 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5a600b2ad0 msgr2=0x7f5a6013c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:22.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.380+0000 7f5a650ea700 1 --2- 172.21.2.105:0/4048184875 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5a600b2ad0 0x7f5a6013c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:22.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.380+0000 7f5a650ea700 1 -- 172.21.2.105:0/4048184875 >> v2:172.21.2.115:3300/0 conn(0x7f5a600b2160 msgr2=0x7f5a60142b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:22.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.380+0000 7f5a650ea700 1 --2- 172.21.2.105:0/4048184875 >> v2:172.21.2.115:3300/0 conn(0x7f5a600b2160 0x7f5a60142b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:22.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.380+0000 7f5a650ea700 1 -- 172.21.2.105:0/4048184875 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a600ada90 con 0x7f5a600aff10 2021-11-12T05:49:22.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.380+0000 7f5a650ea700 1 -- 172.21.2.105:0/4048184875 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f5a54001660 con 0x7f5a600aff10 2021-11-12T05:49:22.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.380+0000 7f5a650ea700 1 -- 172.21.2.105:0/4048184875 >> v1:172.21.2.105:6789/0 conn(0x7f5a600aff10 legacy=0x7f5a6013c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:22.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.380+0000 7f5a650ea700 1 --2- 172.21.2.105:0/4048184875 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5a480037d0 0x7f5a48003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:22.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.380+0000 7f5a650ea700 1 --2- 172.21.2.105:0/4048184875 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5a48004500 0x7f5a48004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:22.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.380+0000 7f5a650ea700 1 --2- 172.21.2.105:0/4048184875 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5a600b2ad0 0x7f5a48007730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:22.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.380+0000 7f5a650ea700 1 -- 172.21.2.105:0/4048184875 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a600afb40 con 0x7f5a48004500 2021-11-12T05:49:22.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.380+0000 7f5a650ea700 1 -- 172.21.2.105:0/4048184875 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a600ad7f0 con 0x7f5a480037d0 2021-11-12T05:49:22.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.380+0000 7f5a650ea700 1 -- 172.21.2.105:0/4048184875 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a48005300 con 0x7f5a600b2ad0 2021-11-12T05:49:22.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.380+0000 7f5a658eb700 1 --2- 172.21.2.105:0/4048184875 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5a48004500 0x7f5a48004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:22.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.380+0000 7f5a658eb700 1 -- 172.21.2.105:0/4048184875 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5a600b2ad0 msgr2=0x7f5a48007730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:22.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.380+0000 7f5a658eb700 1 --2- 172.21.2.105:0/4048184875 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5a600b2ad0 0x7f5a48007730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:22.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.380+0000 7f5a658eb700 1 -- 172.21.2.105:0/4048184875 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5a480037d0 msgr2=0x7f5a48003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:22.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.380+0000 7f5a658eb700 1 --2- 172.21.2.105:0/4048184875 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5a480037d0 0x7f5a48003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:22.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.380+0000 7f5a658eb700 1 -- 172.21.2.105:0/4048184875 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a48003260 con 0x7f5a48004500 2021-11-12T05:49:22.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a658eb700 1 --2- 172.21.2.105:0/4048184875 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5a48004500 0x7f5a48004980 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7f5a54001370 tx=0x7f5a600ae480).ready entity=mon.0 client_cookie=61a0c869ff09d907 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:22.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a650ea700 1 -- 172.21.2.105:0/4048184875 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a540071a0 con 0x7f5a48004500 2021-11-12T05:49:22.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a650ea700 1 -- 172.21.2.105:0/4048184875 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a54007300 con 0x7f5a48004500 2021-11-12T05:49:22.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a650ea700 1 -- 172.21.2.105:0/4048184875 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a5400cae0 con 0x7f5a48004500 2021-11-12T05:49:22.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a68350700 1 -- 172.21.2.105:0/4048184875 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5a48004500 msgr2=0x7f5a48004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:22.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a68350700 1 --2- 172.21.2.105:0/4048184875 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5a48004500 0x7f5a48004980 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7f5a54001370 tx=0x7f5a600ae480).stop 2021-11-12T05:49:22.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a668ed700 1 -- 172.21.2.105:0/4048184875 reap_dead start 2021-11-12T05:49:22.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a68350700 1 -- 172.21.2.105:0/4048184875 shutdown_connections 2021-11-12T05:49:22.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a68350700 1 -- 172.21.2.105:0/4048184875 >> 172.21.2.105:0/4048184875 conn(0x7f5a600698e0 msgr2=0x7f5a6005bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:22.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a68350700 1 -- 172.21.2.105:0/4048184875 shutdown_connections 2021-11-12T05:49:22.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a68350700 1 -- 172.21.2.105:0/4048184875 wait complete. 2021-11-12T05:49:22.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a68350700 1 Processor -- start 2021-11-12T05:49:22.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a68350700 1 -- start start 2021-11-12T05:49:22.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a68350700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5a48004500 0x7f5a600b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:22.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a68350700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5a60142a50 0x7f5a6015a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:22.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a68350700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5a60156740 0x7f5a60064ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:22.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a68350700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a60159db0 con 0x7f5a48004500 2021-11-12T05:49:22.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a68350700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6015a050 con 0x7f5a60142a50 2021-11-12T05:49:22.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a68350700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a600b4ea0 con 0x7f5a60156740 2021-11-12T05:49:22.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a660ec700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5a48004500 0x7f5a600b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:22.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a660ec700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5a48004500 0x7f5a600b49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51760/0 (socket says 172.21.2.105:51760) 2021-11-12T05:49:22.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a660ec700 1 -- 172.21.2.105:0/1529376533 learned_addr learned my addr 172.21.2.105:0/1529376533 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:22.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a660ec700 1 -- 172.21.2.105:0/1529376533 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5a60156740 msgr2=0x7f5a60064ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:22.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a660ec700 1 --2- 172.21.2.105:0/1529376533 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5a60156740 0x7f5a60064ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:22.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a660ec700 1 -- 172.21.2.105:0/1529376533 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5a60142a50 msgr2=0x7f5a6015a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:22.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a660ec700 1 --2- 172.21.2.105:0/1529376533 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5a60142a50 0x7f5a6015a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:22.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a660ec700 1 -- 172.21.2.105:0/1529376533 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a60064960 con 0x7f5a48004500 2021-11-12T05:49:22.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a660ec700 1 --2- 172.21.2.105:0/1529376533 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5a48004500 0x7f5a600b49b0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 rx=0x7f5a5c002f70 tx=0x7f5a5c006e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:22.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a537fe700 1 -- 172.21.2.105:0/1529376533 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a5c013460 con 0x7f5a48004500 2021-11-12T05:49:22.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a537fe700 1 -- 172.21.2.105:0/1529376533 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5c0135c0 con 0x7f5a48004500 2021-11-12T05:49:22.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a68350700 1 -- 172.21.2.105:0/1529376533 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a60142650 con 0x7f5a48004500 2021-11-12T05:49:22.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a537fe700 1 -- 172.21.2.105:0/1529376533 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a5c013920 con 0x7f5a48004500 2021-11-12T05:49:22.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a68350700 1 -- 172.21.2.105:0/1529376533 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a6015ac00 con 0x7f5a48004500 2021-11-12T05:49:22.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a68350700 1 -- 172.21.2.105:0/1529376533 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a6015a210 con 0x7f5a48004500 2021-11-12T05:49:22.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a537fe700 1 -- 172.21.2.105:0/1529376533 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5a5c01a060 con 0x7f5a48004500 2021-11-12T05:49:22.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a537fe700 1 --2- 172.21.2.105:0/1529376533 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5a400535b0 0x7f5a40055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:22.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a537fe700 1 -- 172.21.2.105:0/1529376533 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f5a5c06b360 con 0x7f5a48004500 2021-11-12T05:49:22.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a658eb700 1 --2- 172.21.2.105:0/1529376533 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5a400535b0 0x7f5a40055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:22.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.384+0000 7f5a658eb700 1 --2- 172.21.2.105:0/1529376533 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5a400535b0 0x7f5a40055a70 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f5a54001370 tx=0x7f5a54015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:22.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.388+0000 7f5a537fe700 1 -- 172.21.2.105:0/1529376533 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5a5c042370 con 0x7f5a48004500 2021-11-12T05:49:22.475 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.472+0000 7f5a68350700 1 -- 172.21.2.105:0/1529376533 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5a6013f480 con 0x7f5a48004500 2021-11-12T05:49:22.476 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.472+0000 7f5a537fe700 1 -- 172.21.2.105:0/1529376533 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v136) v1 ==== 100+0+10 (secure 0 0 0) 0x7f5a5c045990 con 0x7f5a48004500 2021-11-12T05:49:22.476 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:49:22.478 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.472+0000 7f5a68350700 1 -- 172.21.2.105:0/1529376533 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5a400535b0 msgr2=0x7f5a40055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:22.478 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.472+0000 7f5a68350700 1 --2- 172.21.2.105:0/1529376533 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5a400535b0 0x7f5a40055a70 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f5a54001370 tx=0x7f5a54015000).stop 2021-11-12T05:49:22.478 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.472+0000 7f5a68350700 1 -- 172.21.2.105:0/1529376533 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5a48004500 msgr2=0x7f5a600b49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:22.478 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.472+0000 7f5a68350700 1 --2- 172.21.2.105:0/1529376533 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5a48004500 0x7f5a600b49b0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 rx=0x7f5a5c002f70 tx=0x7f5a5c006e50).stop 2021-11-12T05:49:22.479 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.472+0000 7f5a68350700 1 -- 172.21.2.105:0/1529376533 shutdown_connections 2021-11-12T05:49:22.479 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.472+0000 7f5a68350700 1 --2- 172.21.2.105:0/1529376533 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5a400535b0 0x7f5a40055a70 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:22.479 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.472+0000 7f5a68350700 1 --2- 172.21.2.105:0/1529376533 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5a60156740 0x7f5a60064ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:22.479 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.472+0000 7f5a68350700 1 --2- 172.21.2.105:0/1529376533 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5a60142a50 0x7f5a6015a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:22.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.472+0000 7f5a68350700 1 --2- 172.21.2.105:0/1529376533 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5a48004500 0x7f5a600b49b0 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:22.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.472+0000 7f5a68350700 1 -- 172.21.2.105:0/1529376533 >> 172.21.2.105:0/1529376533 conn(0x7f5a600698e0 msgr2=0x7f5a6013b990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:22.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.472+0000 7f5a68350700 1 -- 172.21.2.105:0/1529376533 shutdown_connections 2021-11-12T05:49:22.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.472+0000 7f5a68350700 1 -- 172.21.2.105:0/1529376533 wait complete. 2021-11-12T05:49:22.484 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-12T05:49:22.484 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:49:22.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.528+0000 7f8b66f3a700 1 Processor -- start 2021-11-12T05:49:22.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.528+0000 7f8b66f3a700 1 -- start start 2021-11-12T05:49:22.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b66f3a700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f8b600a8c40 0x7f8b6014b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:22.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b66f3a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8b600aff20 0x7f8b600ac960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:22.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b66f3a700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f8b600af250 0x7f8b600af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:22.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b66f3a700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b6014ad20 con 0x7f8b600af250 2021-11-12T05:49:22.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b66f3a700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b600afbd0 con 0x7f8b600a8c40 2021-11-12T05:49:22.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b66f3a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b600a9020 con 0x7f8b600aff20 2021-11-12T05:49:22.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b654d7700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f8b600af250 0x7f8b600af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:22.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b654d7700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f8b600af250 0x7f8b600af6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51766/0 (socket says 172.21.2.105:51766) 2021-11-12T05:49:22.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b654d7700 1 -- 172.21.2.105:0/3238644728 learned_addr learned my addr 172.21.2.105:0/3238644728 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:22.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b654d7700 1 -- 172.21.2.105:0/3238644728 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8b600aff20 msgr2=0x7f8b600ac960 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:49:22.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b654d7700 1 --2- 172.21.2.105:0/3238644728 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8b600aff20 0x7f8b600ac960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:22.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b654d7700 1 -- 172.21.2.105:0/3238644728 >> v2:172.21.2.115:3300/0 conn(0x7f8b600a8c40 msgr2=0x7f8b6014b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:22.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b654d7700 1 --2- 172.21.2.105:0/3238644728 >> v2:172.21.2.115:3300/0 conn(0x7f8b600a8c40 0x7f8b6014b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:22.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b654d7700 1 -- 172.21.2.105:0/3238644728 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b6014af50 con 0x7f8b600af250 2021-11-12T05:49:22.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b654d7700 1 --2- 172.21.2.105:0/3238644728 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8b600af250 0x7f8b600af6e0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 rx=0x7f8b580032f0 tx=0x7f8b58009290).ready entity=mon.0 client_cookie=d766e5c7eb58bb3 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:22.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b5f7fe700 1 -- 172.21.2.105:0/3238644728 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b5800b870 con 0x7f8b600af250 2021-11-12T05:49:22.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b5f7fe700 1 -- 172.21.2.105:0/3238644728 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5800b9d0 con 0x7f8b600af250 2021-11-12T05:49:22.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b5f7fe700 1 -- 172.21.2.105:0/3238644728 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b5800bb40 con 0x7f8b600af250 2021-11-12T05:49:22.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b66f3a700 1 -- 172.21.2.105:0/3238644728 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8b600af250 msgr2=0x7f8b600af6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:22.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b66f3a700 1 --2- 172.21.2.105:0/3238644728 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8b600af250 0x7f8b600af6e0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 rx=0x7f8b580032f0 tx=0x7f8b58009290).stop 2021-11-12T05:49:22.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b66f3a700 1 -- 172.21.2.105:0/3238644728 shutdown_connections 2021-11-12T05:49:22.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b66f3a700 1 --2- 172.21.2.105:0/3238644728 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8b600af250 0x7f8b600af6e0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:22.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b66f3a700 1 --2- 172.21.2.105:0/3238644728 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8b600aff20 0x7f8b600ac960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:22.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b66f3a700 1 --2- 172.21.2.105:0/3238644728 >> v2:172.21.2.115:3300/0 conn(0x7f8b600a8c40 0x7f8b6014b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:22.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b66f3a700 1 -- 172.21.2.105:0/3238644728 >> 172.21.2.105:0/3238644728 conn(0x7f8b60060760 msgr2=0x7f8b60060b40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:22.545 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b66f3a700 1 -- 172.21.2.105:0/3238644728 shutdown_connections 2021-11-12T05:49:22.545 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b66f3a700 1 -- 172.21.2.105:0/3238644728 wait complete. 2021-11-12T05:49:22.545 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b66f3a700 1 Processor -- start 2021-11-12T05:49:22.545 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b66f3a700 1 -- start start 2021-11-12T05:49:22.546 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b66f3a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8b600a8c40 0x7f8b6014a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:22.546 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b66f3a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8b600af250 0x7f8b60156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:22.546 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b66f3a700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8b600aff20 0x7f8b6015a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:22.546 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b66f3a700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b60159e30 con 0x7f8b600a8c40 2021-11-12T05:49:22.547 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b66f3a700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b60065000 con 0x7f8b600aff20 2021-11-12T05:49:22.547 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b66f3a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6015a060 con 0x7f8b600af250 2021-11-12T05:49:22.547 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b64cd6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8b600a8c40 0x7f8b6014a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:22.547 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b64cd6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8b600a8c40 0x7f8b6014a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51770/0 (socket says 172.21.2.105:51770) 2021-11-12T05:49:22.548 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b64cd6700 1 -- 172.21.2.105:0/3574433083 learned_addr learned my addr 172.21.2.105:0/3574433083 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:22.548 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b64cd6700 1 -- 172.21.2.105:0/3574433083 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8b600af250 msgr2=0x7f8b60156820 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:49:22.548 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b64cd6700 1 --2- 172.21.2.105:0/3574433083 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8b600af250 0x7f8b60156820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:22.548 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b64cd6700 1 -- 172.21.2.105:0/3574433083 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8b600aff20 msgr2=0x7f8b6015a500 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:49:22.548 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b64cd6700 1 --2- 172.21.2.105:0/3574433083 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8b600aff20 0x7f8b6015a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:22.549 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b64cd6700 1 -- 172.21.2.105:0/3574433083 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b58009530 con 0x7f8b600a8c40 2021-11-12T05:49:22.549 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b64cd6700 1 --2- 172.21.2.105:0/3574433083 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8b600a8c40 0x7f8b6014a150 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7f8b48002f70 tx=0x7f8b48006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:22.549 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b5dffb700 1 -- 172.21.2.105:0/3574433083 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b48013460 con 0x7f8b600a8c40 2021-11-12T05:49:22.549 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b5dffb700 1 -- 172.21.2.105:0/3574433083 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b480135c0 con 0x7f8b600a8c40 2021-11-12T05:49:22.550 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b66f3a700 1 -- 172.21.2.105:0/3574433083 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b60156d10 con 0x7f8b600a8c40 2021-11-12T05:49:22.550 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b5dffb700 1 -- 172.21.2.105:0/3574433083 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b48013920 con 0x7f8b600a8c40 2021-11-12T05:49:22.550 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.532+0000 7f8b66f3a700 1 -- 172.21.2.105:0/3574433083 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b600aa530 con 0x7f8b600a8c40 2021-11-12T05:49:22.550 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.536+0000 7f8b66f3a700 1 -- 172.21.2.105:0/3574433083 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b6015ad30 con 0x7f8b600a8c40 2021-11-12T05:49:22.550 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.536+0000 7f8b5dffb700 1 -- 172.21.2.105:0/3574433083 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8b4801a060 con 0x7f8b600a8c40 2021-11-12T05:49:22.551 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.536+0000 7f8b5dffb700 1 --2- 172.21.2.105:0/3574433083 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8b44053580 0x7f8b44055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:22.551 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.536+0000 7f8b5dffb700 1 -- 172.21.2.105:0/3574433083 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f8b4806b550 con 0x7f8b600a8c40 2021-11-12T05:49:22.551 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.536+0000 7f8b5ffff700 1 --2- 172.21.2.105:0/3574433083 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8b44053580 0x7f8b44055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:22.551 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.536+0000 7f8b5ffff700 1 --2- 172.21.2.105:0/3574433083 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8b44053580 0x7f8b44055a40 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f8b50002f70 tx=0x7f8b500068e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:22.551 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.536+0000 7f8b5dffb700 1 -- 172.21.2.105:0/3574433083 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8b6015ad30 con 0x7f8b600a8c40 2021-11-12T05:49:22.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.648+0000 7f8b66f3a700 1 -- 172.21.2.105:0/3574433083 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b6015a220 con 0x7f8b600a8c40 2021-11-12T05:49:22.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.648+0000 7f8b5dffb700 1 -- 172.21.2.105:0/3574433083 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f8b48042560 con 0x7f8b600a8c40 2021-11-12T05:49:22.652 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:22.653 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":65,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4979,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/2405231908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":2405231908},{"type":"v1","addr":"172.21.2.115:6833","nonce":2405231908}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":63}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:49:07.486433+0000","modified":"2021-11-12T05:49:08.490302+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8115},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8115":{"gid":8115,"name":"a","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/737863904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":737863904},{"type":"v1","addr":"172.21.2.105:6835","nonce":737863904}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-11-12T05:49:22.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.648+0000 7f8b66f3a700 1 -- 172.21.2.105:0/3574433083 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8b44053580 msgr2=0x7f8b44055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:22.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.648+0000 7f8b66f3a700 1 --2- 172.21.2.105:0/3574433083 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8b44053580 0x7f8b44055a40 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f8b50002f70 tx=0x7f8b500068e0).stop 2021-11-12T05:49:22.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.648+0000 7f8b66f3a700 1 -- 172.21.2.105:0/3574433083 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8b600a8c40 msgr2=0x7f8b6014a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:22.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.648+0000 7f8b66f3a700 1 --2- 172.21.2.105:0/3574433083 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8b600a8c40 0x7f8b6014a150 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7f8b48002f70 tx=0x7f8b48006ec0).stop 2021-11-12T05:49:22.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.648+0000 7f8b66f3a700 1 -- 172.21.2.105:0/3574433083 shutdown_connections 2021-11-12T05:49:22.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.648+0000 7f8b66f3a700 1 --2- 172.21.2.105:0/3574433083 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8b44053580 0x7f8b44055a40 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:22.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.648+0000 7f8b66f3a700 1 --2- 172.21.2.105:0/3574433083 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8b600aff20 0x7f8b6015a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:22.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.648+0000 7f8b66f3a700 1 --2- 172.21.2.105:0/3574433083 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8b600af250 0x7f8b60156820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:22.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.648+0000 7f8b66f3a700 1 --2- 172.21.2.105:0/3574433083 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8b600a8c40 0x7f8b6014a150 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:22.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.648+0000 7f8b66f3a700 1 -- 172.21.2.105:0/3574433083 >> 172.21.2.105:0/3574433083 conn(0x7f8b60060760 msgr2=0x7f8b60146900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:22.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.648+0000 7f8b66f3a700 1 -- 172.21.2.105:0/3574433083 shutdown_connections 2021-11-12T05:49:22.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:22.648+0000 7f8b66f3a700 1 -- 172.21.2.105:0/3574433083 wait complete. 2021-11-12T05:49:22.656 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 65 2021-11-12T05:49:22.860 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 65, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:49:07.486433+0000', 'modified': '2021-11-12T05:49:08.490302+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8115}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8115': {'gid': 8115, 'name': 'a', 'rank': 0, 'incarnation': 64, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/737863904', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 737863904}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 737863904}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:49:22.934 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:49:22.935 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:49:22.998 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":8115,"want_state":"up:active","state":"up:active","rank_uptime":15.504001697,"mdsmap_epoch":65,"osdmap_epoch":136,"osdmap_epoch_barrier":134,"uptime":19.740830396} 2021-11-12T05:49:22.999 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 8115, "mdsmap_epoch": 65, "osdmap_epoch": 136, "osdmap_epoch_barrier": 134, "rank_uptime": 15.504001697, "state": "up:active", "uptime": 19.740830396, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:49:23.000 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-12T05:49:23.000 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-11-12T05:49:23.000 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@gibba038.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-11-12T05:49:23.001 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:23.001 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:49:23.012 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-12T05:49:23.065 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:49:23.066 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:49:23.071 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:49:23.072 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:49:23.073 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:23.074 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-12T05:49:23.077 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-12T05:49:23.078 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:49:23.121 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-12T05:49:23.130 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:49:23.130 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:49:23.135 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:49:23.136 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:49:23.137 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:23.137 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-12T05:49:23.161 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:ceph-fuse[14674]: starting ceph client 2021-11-12T05:49:23.161 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:2021-11-12T05:49:23.160+0000 7ff0b36f1080 -1 init, newargv = 0x56286594a510 newargc=9 2021-11-12T05:49:23.179 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:ceph-fuse[14674]: starting fuse 2021-11-12T05:49:24.265 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-12T05:49:24.277 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:49:24.278 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:49:24.326 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:49:24.327 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:49:24.327 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:24.328 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-12T05:49:24.333 INFO:teuthology.orchestra.run.gibba038.stdout:52 2021-11-12T05:49:24.334 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-12T05:49:24.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:24.335 DEBUG:teuthology.orchestra.run.gibba038:> sudo python3 -c ' 2021-11-12T05:49:24.335 DEBUG:teuthology.orchestra.run.gibba038:> import glob 2021-11-12T05:49:24.335 DEBUG:teuthology.orchestra.run.gibba038:> import re 2021-11-12T05:49:24.336 DEBUG:teuthology.orchestra.run.gibba038:> import os 2021-11-12T05:49:24.336 DEBUG:teuthology.orchestra.run.gibba038:> import subprocess 2021-11-12T05:49:24.337 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:49:24.337 DEBUG:teuthology.orchestra.run.gibba038:> def find_socket(client_name): 2021-11-12T05:49:24.338 DEBUG:teuthology.orchestra.run.gibba038:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-11-12T05:49:24.338 DEBUG:teuthology.orchestra.run.gibba038:> files = glob.glob(asok_path) 2021-11-12T05:49:24.338 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:49:24.339 DEBUG:teuthology.orchestra.run.gibba038:> # Given a non-glob path, it better be there 2021-11-12T05:49:24.339 DEBUG:teuthology.orchestra.run.gibba038:> if "*" not in asok_path: 2021-11-12T05:49:24.340 DEBUG:teuthology.orchestra.run.gibba038:> assert(len(files) == 1) 2021-11-12T05:49:24.340 DEBUG:teuthology.orchestra.run.gibba038:> return files[0] 2021-11-12T05:49:24.341 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:49:24.341 DEBUG:teuthology.orchestra.run.gibba038:> for f in files: 2021-11-12T05:49:24.341 DEBUG:teuthology.orchestra.run.gibba038:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-12T05:49:24.342 DEBUG:teuthology.orchestra.run.gibba038:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-12T05:49:24.342 DEBUG:teuthology.orchestra.run.gibba038:> return f 2021-11-12T05:49:24.343 DEBUG:teuthology.orchestra.run.gibba038:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-12T05:49:24.343 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:49:24.343 DEBUG:teuthology.orchestra.run.gibba038:> print(find_socket("client.1")) 2021-11-12T05:49:24.344 DEBUG:teuthology.orchestra.run.gibba038:> ' 2021-11-12T05:49:24.409 INFO:teuthology.orchestra.run.gibba038.stdout:/var/run/ceph/ceph-client.1.14674.asok 2021-11-12T05:49:24.412 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14674.asok 2021-11-12T05:49:24.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:24.413 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14674.asok status 2021-11-12T05:49:24.460 INFO:teuthology.orchestra.run.gibba038.stdout:{ 2021-11-12T05:49:24.460 INFO:teuthology.orchestra.run.gibba038.stdout: "metadata": { 2021-11-12T05:49:24.460 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_sha1": "a81ee2815de5acae59ead5b8c9137b6766fc8ea8", 2021-11-12T05:49:24.461 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_version": "ceph version 15.2.15-22-ga81ee281 (a81ee2815de5acae59ead5b8c9137b6766fc8ea8) octopus (stable)", 2021-11-12T05:49:24.461 INFO:teuthology.orchestra.run.gibba038.stdout: "entity_id": "1", 2021-11-12T05:49:24.461 INFO:teuthology.orchestra.run.gibba038.stdout: "hostname": "gibba038", 2021-11-12T05:49:24.462 INFO:teuthology.orchestra.run.gibba038.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-11-12T05:49:24.462 INFO:teuthology.orchestra.run.gibba038.stdout: "pid": "14674", 2021-11-12T05:49:24.462 INFO:teuthology.orchestra.run.gibba038.stdout: "root": "/" 2021-11-12T05:49:24.462 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:49:24.462 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_count": 0, 2021-11-12T05:49:24.463 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_pinned_count": 0, 2021-11-12T05:49:24.463 INFO:teuthology.orchestra.run.gibba038.stdout: "id": 8382, 2021-11-12T05:49:24.463 INFO:teuthology.orchestra.run.gibba038.stdout: "inst": { 2021-11-12T05:49:24.463 INFO:teuthology.orchestra.run.gibba038.stdout: "name": { 2021-11-12T05:49:24.464 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "client", 2021-11-12T05:49:24.464 INFO:teuthology.orchestra.run.gibba038.stdout: "num": 8382 2021-11-12T05:49:24.464 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:49:24.464 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-12T05:49:24.464 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-12T05:49:24.465 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-12T05:49:24.465 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 4020422192 2021-11-12T05:49:24.465 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-11-12T05:49:24.465 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:49:24.465 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-12T05:49:24.466 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-12T05:49:24.466 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-12T05:49:24.466 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 4020422192 2021-11-12T05:49:24.466 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:49:24.467 INFO:teuthology.orchestra.run.gibba038.stdout: "inst_str": "client.8382 172.21.2.138:0/4020422192", 2021-11-12T05:49:24.467 INFO:teuthology.orchestra.run.gibba038.stdout: "addr_str": "172.21.2.138:0/4020422192", 2021-11-12T05:49:24.467 INFO:teuthology.orchestra.run.gibba038.stdout: "inode_count": 1, 2021-11-12T05:49:24.467 INFO:teuthology.orchestra.run.gibba038.stdout: "mds_epoch": 65, 2021-11-12T05:49:24.467 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch": 136, 2021-11-12T05:49:24.468 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch_barrier": 0, 2021-11-12T05:49:24.468 INFO:teuthology.orchestra.run.gibba038.stdout: "blacklisted": false, 2021-11-12T05:49:24.468 INFO:teuthology.orchestra.run.gibba038.stdout: "fs_name": "cephfs" 2021-11-12T05:49:24.468 INFO:teuthology.orchestra.run.gibba038.stdout:} 2021-11-12T05:49:24.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:24.470 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:49:24.470 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:49:24.477 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-12T05:49:24.478 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-12T05:49:24.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:24.479 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:49:24.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:24.543 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:49:24.544 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:49:24.555 INFO:teuthology.orchestra.run.gibba016.stdout:fuseblk 2021-11-12T05:49:24.557 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-12T05:49:24.557 DEBUG:teuthology.orchestra.run.gibba016:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-11-12T05:49:24.558 DEBUG:teuthology.orchestra.run.gibba016:> import time 2021-11-12T05:49:24.558 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:49:24.559 DEBUG:teuthology.orchestra.run.gibba016:> with open("/home/ubuntu/cephtest/mnt.0/testfile", '"'"'w'"'"') as f: 2021-11-12T05:49:24.559 DEBUG:teuthology.orchestra.run.gibba016:> f.write('"'"'content'"'"') 2021-11-12T05:49:24.559 DEBUG:teuthology.orchestra.run.gibba016:> f.flush() 2021-11-12T05:49:24.560 DEBUG:teuthology.orchestra.run.gibba016:> f.write('"'"'content2'"'"') 2021-11-12T05:49:24.560 DEBUG:teuthology.orchestra.run.gibba016:> while True: 2021-11-12T05:49:24.561 DEBUG:teuthology.orchestra.run.gibba016:> time.sleep(1) 2021-11-12T05:49:24.561 DEBUG:teuthology.orchestra.run.gibba016:> ' 2021-11-12T05:49:24.603 DEBUG:teuthology.orchestra.run.gibba016:> sudo ls /home/ubuntu/cephtest/mnt.0/testfile 2021-11-12T05:49:24.619 INFO:teuthology.orchestra.run.gibba016.stderr:ls: cannot access '/home/ubuntu/cephtest/mnt.0/testfile': No such file or directory 2021-11-12T05:49:24.619 DEBUG:teuthology.orchestra.run:got remote process result: 2 2021-11-12T05:49:25.245 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:49:25.249 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:49:25.252 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:49:25.255 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:49:25.259 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:49:25.621 DEBUG:teuthology.orchestra.run.gibba016:> sudo ls /home/ubuntu/cephtest/mnt.0/testfile 2021-11-12T05:49:25.642 INFO:teuthology.orchestra.run.gibba016.stdout:/home/ubuntu/cephtest/mnt.0/testfile 2021-11-12T05:49:25.644 DEBUG:tasks.cephfs.mount:File testfile became visible from 0 after 1s 2021-11-12T05:49:25.645 DEBUG:teuthology.orchestra.run.gibba038:> sudo ls /home/ubuntu/cephtest/mnt.1/testfile 2021-11-12T05:49:25.694 INFO:teuthology.orchestra.run.gibba038.stdout:/home/ubuntu/cephtest/mnt.1/testfile 2021-11-12T05:49:25.695 DEBUG:tasks.cephfs.mount:File testfile became visible from 1 after 0s 2021-11-12T05:49:25.696 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-11-12T05:49:25.696 DEBUG:teuthology.orchestra.run.gibba038:> cd /home/ubuntu/cephtest/mnt.1 && sudo cat testfile 2021-11-12T05:49:25.753 INFO:teuthology.orchestra.run.gibba038.stdout:content 2021-11-12T05:49:25.764 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-12T05:49:25.764 DEBUG:teuthology.orchestra.run.gibba005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:49:25.777 DEBUG:teuthology.orchestra.run.gibba015:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:49:25.791 DEBUG:teuthology.orchestra.run.gibba016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:49:25.801 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:49:25.829 DEBUG:teuthology.orchestra.run.gibba044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:49:25.842 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-12T05:49:25.843 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:25.843 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:49:25.844 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:49:25.855 INFO:teuthology.orchestra.run.gibba016.stdout:fuseblk 2021-11-12T05:49:25.856 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-12T05:49:25.857 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba016.front.sepia.ceph.com... 2021-11-12T05:49:25.857 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-12T05:49:25.858 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:49:25.872 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[15164]: fuse finished with error 0 and tester_r 0 2021-11-12T05:49:25.873 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:25.874 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:49:25.874 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:49:25.878 INFO:teuthology.orchestra.run.gibba016.stdout:ext2/ext3 2021-11-12T05:49:25.880 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-12T05:49:25.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:49:25.991 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:49:26.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:26.037 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:49:26.037 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:49:26.048 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-12T05:49:26.049 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-12T05:49:26.050 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba038.front.sepia.ceph.com... 2021-11-12T05:49:26.050 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-12T05:49:26.050 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:49:26.064 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:ceph-fuse[14674]: fuse finished with error 0 and tester_r 0 2021-11-12T05:49:26.065 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:26.065 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:49:26.066 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:49:26.115 INFO:teuthology.orchestra.run.gibba038.stdout:ext2/ext3 2021-11-12T05:49:26.116 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-12T05:49:26.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:49:26.165 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:49:26.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:26.169 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:49:26.170 DEBUG:teuthology.orchestra.run.gibba044:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:49:26.179 INFO:teuthology.orchestra.run.gibba044.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-12T05:49:26.180 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:49:26.180 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-12T05:49:26.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:49:26.181 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:49:26.190 INFO:teuthology.orchestra.run.gibba044.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-12T05:49:26.191 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:49:26.191 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-12T05:49:26.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.240+0000 7f07018d6700 1 Processor -- start 2021-11-12T05:49:26.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.240+0000 7f07018d6700 1 -- start start 2021-11-12T05:49:26.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.240+0000 7f07018d6700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f06fc05bd90 0x7f06fc14ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:26.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.240+0000 7f07018d6700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f06fc0b1ea0 0x7f06fc0b2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:26.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.240+0000 7f07018d6700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06fc05c8e0 con 0x7f06fc0ab8b0 2021-11-12T05:49:26.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.240+0000 7f07018d6700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06fc147430 con 0x7f06fc0b1ea0 2021-11-12T05:49:26.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.240+0000 7f07018d6700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc0ac8e0 con 0x7f06fc05bd90 2021-11-12T05:49:26.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f06fb7fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f06fc0b1ea0 0x7f06fc0b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:26.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f06faffd700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f06fc0ab8b0 0x7f06fc0acd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:33942/0 (socket says 172.21.2.105:33942) 2021-11-12T05:49:26.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f06faffd700 1 -- 172.21.2.105:0/500318239 learned_addr learned my addr 172.21.2.105:0/500318239 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:26.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f06f9ffb700 1 -- 172.21.2.105:0/500318239 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 667017042 0 0) 0x7f06fc05c8e0 con 0x7f06fc0ab8b0 2021-11-12T05:49:26.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f06f9ffb700 1 -- 172.21.2.105:0/500318239 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06dc003260 con 0x7f06fc0ab8b0 2021-11-12T05:49:26.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f06fb7fe700 1 -- 172.21.2.105:0/500318239 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f06fc05bd90 msgr2=0x7f06fc14ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:26.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f06fb7fe700 1 --2- 172.21.2.105:0/500318239 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f06fc05bd90 0x7f06fc14ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:26.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f06fb7fe700 1 -- 172.21.2.105:0/500318239 >> v1:172.21.2.105:6789/0 conn(0x7f06fc0ab8b0 legacy=0x7f06fc0acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:26.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f06fb7fe700 1 -- 172.21.2.105:0/500318239 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06fc0abc90 con 0x7f06fc0b1ea0 2021-11-12T05:49:26.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f06fb7fe700 1 --2- 172.21.2.105:0/500318239 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06fc0b1ea0 0x7f06fc0b2330 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x7f06f40032f0 tx=0x7f06f40091d0).ready entity=mon.0 client_cookie=cff569f4322be255 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:26.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f06f9ffb700 1 -- 172.21.2.105:0/500318239 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06f400b6c0 con 0x7f06fc0b1ea0 2021-11-12T05:49:26.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f06f9ffb700 1 -- 172.21.2.105:0/500318239 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f400b820 con 0x7f06fc0b1ea0 2021-11-12T05:49:26.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f06f9ffb700 1 -- 172.21.2.105:0/500318239 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06f400b990 con 0x7f06fc0b1ea0 2021-11-12T05:49:26.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f07018d6700 1 -- 172.21.2.105:0/500318239 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06fc0b1ea0 msgr2=0x7f06fc0b2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:26.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f07018d6700 1 --2- 172.21.2.105:0/500318239 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06fc0b1ea0 0x7f06fc0b2330 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x7f06f40032f0 tx=0x7f06f40091d0).stop 2021-11-12T05:49:26.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f07018d6700 1 -- 172.21.2.105:0/500318239 shutdown_connections 2021-11-12T05:49:26.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f07018d6700 1 --2- 172.21.2.105:0/500318239 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06fc0b1ea0 0x7f06fc0b2330 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:26.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f07018d6700 1 --2- 172.21.2.105:0/500318239 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f06fc05bd90 0x7f06fc14ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:26.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f07018d6700 1 -- 172.21.2.105:0/500318239 >> 172.21.2.105:0/500318239 conn(0x7f06fc060760 msgr2=0x7f06fc060b40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:26.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f07018d6700 1 -- 172.21.2.105:0/500318239 shutdown_connections 2021-11-12T05:49:26.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f07018d6700 1 -- 172.21.2.105:0/500318239 wait complete. 2021-11-12T05:49:26.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f07018d6700 1 Processor -- start 2021-11-12T05:49:26.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f07018d6700 1 -- start start 2021-11-12T05:49:26.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f07018d6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06fc05bd90 0x7f06fc09eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:26.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f07018d6700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f06fc0ab8b0 0x7f06fc156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:26.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f07018d6700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f06fc0b1ea0 0x7f06fc0a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:26.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f07018d6700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc14acf0 con 0x7f06fc05bd90 2021-11-12T05:49:26.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f07018d6700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc0a0510 con 0x7f06fc0b1ea0 2021-11-12T05:49:26.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f07018d6700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc14aa50 con 0x7f06fc0ab8b0 2021-11-12T05:49:26.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f06faffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06fc05bd90 0x7f06fc09eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:26.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f06faffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06fc05bd90 0x7f06fc09eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51784/0 (socket says 172.21.2.105:51784) 2021-11-12T05:49:26.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f06faffd700 1 -- 172.21.2.105:0/1387306030 learned_addr learned my addr 172.21.2.105:0/1387306030 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:26.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f06faffd700 1 -- 172.21.2.105:0/1387306030 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f06fc0ab8b0 msgr2=0x7f06fc156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:26.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f06faffd700 1 --2- 172.21.2.105:0/1387306030 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f06fc0ab8b0 0x7f06fc156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:26.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f06faffd700 1 -- 172.21.2.105:0/1387306030 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f06fc0b1ea0 msgr2=0x7f06fc0a0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:26.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f06faffd700 1 --2- 172.21.2.105:0/1387306030 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f06fc0b1ea0 0x7f06fc0a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:26.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f06faffd700 1 -- 172.21.2.105:0/1387306030 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f4009470 con 0x7f06fc05bd90 2021-11-12T05:49:26.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f06faffd700 1 --2- 172.21.2.105:0/1387306030 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06fc05bd90 0x7f06fc09eaf0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7f06ec001110 tx=0x7f06ec007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:26.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f06f3fff700 1 -- 172.21.2.105:0/1387306030 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06ec0070d0 con 0x7f06fc05bd90 2021-11-12T05:49:26.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f06f3fff700 1 -- 172.21.2.105:0/1387306030 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ec007230 con 0x7f06fc05bd90 2021-11-12T05:49:26.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f07018d6700 1 -- 172.21.2.105:0/1387306030 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06fc09efe0 con 0x7f06fc05bd90 2021-11-12T05:49:26.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f06f3fff700 1 -- 172.21.2.105:0/1387306030 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06ec005610 con 0x7f06fc05bd90 2021-11-12T05:49:26.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.244+0000 7f07018d6700 1 -- 172.21.2.105:0/1387306030 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06fc156a20 con 0x7f06fc05bd90 2021-11-12T05:49:26.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.248+0000 7f07018d6700 1 -- 172.21.2.105:0/1387306030 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06fc0a0340 con 0x7f06fc05bd90 2021-11-12T05:49:26.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.248+0000 7f06f3fff700 1 -- 172.21.2.105:0/1387306030 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f06ec01a070 con 0x7f06fc05bd90 2021-11-12T05:49:26.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.248+0000 7f06f3fff700 1 --2- 172.21.2.105:0/1387306030 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f06e0053520 0x7f06e00559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:26.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.248+0000 7f06f3fff700 1 -- 172.21.2.105:0/1387306030 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f06ec06ab60 con 0x7f06fc05bd90 2021-11-12T05:49:26.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.248+0000 7f06fa7fc700 1 --2- 172.21.2.105:0/1387306030 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f06e0053520 0x7f06e00559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:26.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.248+0000 7f06fa7fc700 1 --2- 172.21.2.105:0/1387306030 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f06e0053520 0x7f06e00559e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f06e4002f70 tx=0x7f06e4006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:26.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.248+0000 7f06f3fff700 1 -- 172.21.2.105:0/1387306030 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f06ec041a60 con 0x7f06fc05bd90 2021-11-12T05:49:26.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.332+0000 7f07018d6700 1 -- 172.21.2.105:0/1387306030 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f06fc0a0680 con 0x7f06fc05bd90 2021-11-12T05:49:26.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.332+0000 7f06f3fff700 1 -- 172.21.2.105:0/1387306030 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v136) v1 ==== 81+0+34051 (secure 0 0 0) 0x7f06ec045080 con 0x7f06fc05bd90 2021-11-12T05:49:26.338 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:26.338 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:49:26.339 INFO:teuthology.orchestra.run.gibba005.stdout: "epoch": 136, 2021-11-12T05:49:26.339 INFO:teuthology.orchestra.run.gibba005.stdout: "fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", 2021-11-12T05:49:26.339 INFO:teuthology.orchestra.run.gibba005.stdout: "created": "2021-11-12T05:40:19.986390+0000", 2021-11-12T05:49:26.339 INFO:teuthology.orchestra.run.gibba005.stdout: "modified": "2021-11-12T05:49:10.427356+0000", 2021-11-12T05:49:26.340 INFO:teuthology.orchestra.run.gibba005.stdout: "last_up_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:49:26.340 INFO:teuthology.orchestra.run.gibba005.stdout: "last_in_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:49:26.340 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-12T05:49:26.340 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_num": 5799936, 2021-11-12T05:49:26.340 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_set": [ 2021-11-12T05:49:26.341 INFO:teuthology.orchestra.run.gibba005.stdout: "pglog_hardlimit", 2021-11-12T05:49:26.341 INFO:teuthology.orchestra.run.gibba005.stdout: "purged_snapdirs", 2021-11-12T05:49:26.341 INFO:teuthology.orchestra.run.gibba005.stdout: "recovery_deletes", 2021-11-12T05:49:26.341 INFO:teuthology.orchestra.run.gibba005.stdout: "sortbitwise" 2021-11-12T05:49:26.342 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:49:26.342 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_version": 5, 2021-11-12T05:49:26.342 INFO:teuthology.orchestra.run.gibba005.stdout: "full_ratio": 0.94999998807907104, 2021-11-12T05:49:26.342 INFO:teuthology.orchestra.run.gibba005.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-12T05:49:26.342 INFO:teuthology.orchestra.run.gibba005.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-12T05:49:26.343 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_snapshot": "", 2021-11-12T05:49:26.343 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_max": 26, 2021-11-12T05:49:26.343 INFO:teuthology.orchestra.run.gibba005.stdout: "max_osd": 8, 2021-11-12T05:49:26.343 INFO:teuthology.orchestra.run.gibba005.stdout: "require_min_compat_client": "jewel", 2021-11-12T05:49:26.344 INFO:teuthology.orchestra.run.gibba005.stdout: "min_compat_client": "jewel", 2021-11-12T05:49:26.344 INFO:teuthology.orchestra.run.gibba005.stdout: "require_osd_release": "octopus", 2021-11-12T05:49:26.344 INFO:teuthology.orchestra.run.gibba005.stdout: "pools": [ 2021-11-12T05:49:26.344 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.344 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 1, 2021-11-12T05:49:26.345 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "device_health_metrics", 2021-11-12T05:49:26.345 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:22.022116+0000", 2021-11-12T05:49:26.345 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:49:26.345 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:49:26.345 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:49:26.346 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:49:26.346 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:49:26.346 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:49:26.346 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:49:26.347 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:49:26.347 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 1, 2021-11-12T05:49:26.347 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 1, 2021-11-12T05:49:26.347 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 1, 2021-11-12T05:49:26.348 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 1, 2021-11-12T05:49:26.348 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 1, 2021-11-12T05:49:26.348 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:49:26.348 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:49:26.348 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:49:26.349 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:49:26.349 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:49:26.349 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:49:26.349 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:49:26.349 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.350 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "16", 2021-11-12T05:49:26.350 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:49:26.350 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:49:26.350 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:49:26.351 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:49:26.351 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:49:26.351 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:49:26.351 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:49:26.352 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:49:26.352 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:49:26.352 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:49:26.352 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:49:26.353 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:49:26.353 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:49:26.353 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:49:26.353 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:49:26.353 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:49:26.354 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:49:26.354 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:49:26.354 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:49:26.354 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:49:26.355 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:49:26.355 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:49:26.355 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:49:26.355 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:49:26.356 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:49:26.356 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:49:26.356 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.356 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:49:26.356 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:49:26.357 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:49:26.357 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:49:26.357 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:49:26.357 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:49:26.358 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:49:26.358 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:49:26.358 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:49:26.358 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:49:26.359 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:49:26.359 INFO:teuthology.orchestra.run.gibba005.stdout: "options": { 2021-11-12T05:49:26.359 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_min": 1 2021-11-12T05:49:26.359 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.360 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:49:26.360 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr_devicehealth": {} 2021-11-12T05:49:26.360 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.360 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.361 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.361 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 2, 2021-11-12T05:49:26.361 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "rbd", 2021-11-12T05:49:26.361 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:29.953617+0000", 2021-11-12T05:49:26.361 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:49:26.362 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:49:26.362 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:49:26.362 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:49:26.362 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:49:26.363 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:49:26.363 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:49:26.363 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:49:26.363 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:49:26.364 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:49:26.364 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:49:26.364 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:49:26.364 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:49:26.365 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:49:26.365 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:49:26.365 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:49:26.365 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:49:26.365 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:49:26.366 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:49:26.366 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:49:26.366 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.366 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "19", 2021-11-12T05:49:26.367 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:49:26.367 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:49:26.367 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:49:26.367 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:49:26.368 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:49:26.368 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:49:26.368 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:49:26.368 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:49:26.369 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:49:26.369 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:49:26.369 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:49:26.369 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:49:26.369 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:49:26.370 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:49:26.370 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:49:26.370 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:49:26.370 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:49:26.371 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:49:26.371 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:49:26.371 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:49:26.371 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:49:26.372 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:49:26.372 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:49:26.372 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:49:26.372 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:49:26.372 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:49:26.373 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.373 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:49:26.373 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:49:26.373 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:49:26.374 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:49:26.374 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:49:26.374 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:49:26.374 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:49:26.375 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:49:26.375 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:49:26.375 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:49:26.375 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:49:26.376 INFO:teuthology.orchestra.run.gibba005.stdout: "options": {}, 2021-11-12T05:49:26.376 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:49:26.376 INFO:teuthology.orchestra.run.gibba005.stdout: "rbd": {} 2021-11-12T05:49:26.376 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.376 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.377 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.377 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 25, 2021-11-12T05:49:26.377 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "cephfs_metadata", 2021-11-12T05:49:26.377 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:49:05.315585+0000", 2021-11-12T05:49:26.378 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:49:26.378 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:49:26.378 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:49:26.378 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:49:26.378 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:49:26.379 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:49:26.379 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:49:26.379 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:49:26.379 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:49:26.380 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:49:26.380 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:49:26.380 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:49:26.380 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:49:26.381 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:49:26.381 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:49:26.381 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:49:26.381 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:49:26.381 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:49:26.382 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:49:26.382 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:49:26.382 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.382 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "135", 2021-11-12T05:49:26.383 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:49:26.383 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:49:26.383 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:49:26.383 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:49:26.383 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:49:26.384 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:49:26.384 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:49:26.384 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:49:26.384 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:49:26.385 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:49:26.385 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:49:26.385 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:49:26.385 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:49:26.386 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:49:26.386 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:49:26.386 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:49:26.386 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:49:26.387 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:49:26.387 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:49:26.387 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:49:26.387 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:49:26.388 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:49:26.388 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:49:26.388 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:49:26.388 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:49:26.388 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:49:26.389 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.389 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:49:26.389 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:49:26.389 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:49:26.390 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:49:26.390 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:49:26.390 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:49:26.390 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:49:26.390 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:49:26.391 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:49:26.391 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:49:26.391 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:49:26.392 INFO:teuthology.orchestra.run.gibba005.stdout: "options": { 2021-11-12T05:49:26.392 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_bias": 4, 2021-11-12T05:49:26.392 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_min": 16, 2021-11-12T05:49:26.392 INFO:teuthology.orchestra.run.gibba005.stdout: "recovery_priority": 5 2021-11-12T05:49:26.392 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.393 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:49:26.393 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs": { 2021-11-12T05:49:26.393 INFO:teuthology.orchestra.run.gibba005.stdout: "metadata": "cephfs" 2021-11-12T05:49:26.393 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.394 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.394 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.394 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.394 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 26, 2021-11-12T05:49:26.395 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "cephfs_data", 2021-11-12T05:49:26.395 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:49:06.466127+0000", 2021-11-12T05:49:26.395 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:49:26.395 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:49:26.396 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:49:26.396 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:49:26.396 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:49:26.396 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:49:26.396 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:49:26.397 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:49:26.397 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:49:26.397 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:49:26.397 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:49:26.398 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:49:26.398 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:49:26.398 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:49:26.398 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:49:26.399 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:49:26.399 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:49:26.399 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:49:26.399 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:49:26.400 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:49:26.400 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.400 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "136", 2021-11-12T05:49:26.400 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:49:26.400 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:49:26.401 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:49:26.401 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:49:26.401 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:49:26.401 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:49:26.402 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:49:26.402 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:49:26.402 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:49:26.402 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:49:26.403 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:49:26.403 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:49:26.403 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:49:26.403 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:49:26.403 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:49:26.404 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:49:26.404 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:49:26.404 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:49:26.404 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:49:26.405 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:49:26.405 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:49:26.405 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:49:26.405 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:49:26.406 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:49:26.406 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:49:26.406 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:49:26.406 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.407 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:49:26.407 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:49:26.407 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:49:26.407 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:49:26.407 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:49:26.408 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:49:26.408 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:49:26.408 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:49:26.408 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:49:26.408 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:49:26.409 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:49:26.409 INFO:teuthology.orchestra.run.gibba005.stdout: "options": {}, 2021-11-12T05:49:26.409 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:49:26.409 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs": { 2021-11-12T05:49:26.410 INFO:teuthology.orchestra.run.gibba005.stdout: "data": "cephfs" 2021-11-12T05:49:26.410 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.410 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.410 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.411 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:49:26.411 INFO:teuthology.orchestra.run.gibba005.stdout: "osds": [ 2021-11-12T05:49:26.411 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.411 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:49:26.412 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "ee8e30a0-4819-4475-80ec-dd3ee7d01322", 2021-11-12T05:49:26.412 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:26.412 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:26.412 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:26.412 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:26.413 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:26.413 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:26.413 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:26.413 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 132, 2021-11-12T05:49:26.414 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:26.414 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:26.414 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:26.414 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:26.415 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.415 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:26.415 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6802", 2021-11-12T05:49:26.415 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:26.416 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.416 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.416 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:26.416 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6803", 2021-11-12T05:49:26.417 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:26.417 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.417 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.417 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.417 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:26.418 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:26.418 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.418 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:26.418 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6804", 2021-11-12T05:49:26.419 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:26.419 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.419 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.419 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:26.420 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6805", 2021-11-12T05:49:26.420 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:26.420 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.420 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.421 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.421 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:26.421 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:26.421 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.422 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:26.422 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6808", 2021-11-12T05:49:26.422 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:26.422 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.422 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.423 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:26.423 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6809", 2021-11-12T05:49:26.423 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:26.423 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.424 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.424 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.424 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:26.424 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:26.424 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.425 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:26.425 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6806", 2021-11-12T05:49:26.425 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:26.425 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.426 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.426 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:26.426 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6807", 2021-11-12T05:49:26.426 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:26.426 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.427 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.427 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.427 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6803/14874", 2021-11-12T05:49:26.427 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6805/14874", 2021-11-12T05:49:26.428 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6809/14874", 2021-11-12T05:49:26.428 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6807/14874", 2021-11-12T05:49:26.428 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:26.428 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:26.429 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:26.429 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.429 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.429 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.429 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:49:26.430 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "b1bb06c3-26d0-4d92-82f8-b3e882242785", 2021-11-12T05:49:26.430 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:26.430 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:26.430 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:26.431 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:26.431 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:26.431 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:26.431 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:26.431 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 133, 2021-11-12T05:49:26.432 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:26.432 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:26.432 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:26.432 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:26.433 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.433 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:26.433 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6810", 2021-11-12T05:49:26.433 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:26.434 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.434 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.434 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:26.434 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6811", 2021-11-12T05:49:26.434 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:26.435 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.435 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.435 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.435 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:26.435 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:26.436 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.436 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:26.436 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6812", 2021-11-12T05:49:26.436 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:26.437 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.437 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.437 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:26.437 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6813", 2021-11-12T05:49:26.437 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:26.438 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.438 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.438 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.438 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:26.439 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:26.439 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.439 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:26.439 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6816", 2021-11-12T05:49:26.440 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:26.440 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.440 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.440 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:26.441 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6817", 2021-11-12T05:49:26.441 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:26.441 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.441 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.441 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.442 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:26.442 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:26.442 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.442 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:26.443 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6814", 2021-11-12T05:49:26.443 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:26.443 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.443 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.444 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:26.444 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6815", 2021-11-12T05:49:26.444 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:26.444 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.445 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.445 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.445 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6811/14875", 2021-11-12T05:49:26.445 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6813/14875", 2021-11-12T05:49:26.446 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6817/14875", 2021-11-12T05:49:26.446 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6815/14875", 2021-11-12T05:49:26.446 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:26.446 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:26.446 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:26.447 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.447 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.447 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.447 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:49:26.448 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "837b2c60-c335-4382-9f47-d86543a14022", 2021-11-12T05:49:26.448 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:26.448 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:26.448 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:26.449 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:26.449 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:26.449 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:26.449 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:26.449 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 133, 2021-11-12T05:49:26.450 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:26.450 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:26.450 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:26.450 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:26.451 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.451 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:26.451 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6818", 2021-11-12T05:49:26.451 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:26.452 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.452 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.452 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:26.452 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6819", 2021-11-12T05:49:26.453 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:26.453 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.453 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.453 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.454 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:26.454 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:26.454 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.454 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:26.455 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6820", 2021-11-12T05:49:26.455 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:26.455 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.455 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.456 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:26.456 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6821", 2021-11-12T05:49:26.456 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:26.456 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.456 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.457 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.457 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:26.457 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:26.457 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.458 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:26.458 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6824", 2021-11-12T05:49:26.458 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:26.458 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.458 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.459 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:26.459 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6825", 2021-11-12T05:49:26.459 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:26.459 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.460 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.460 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.460 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:26.460 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:26.461 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.461 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:26.461 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6822", 2021-11-12T05:49:26.461 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:26.462 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.462 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.462 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:26.462 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6823", 2021-11-12T05:49:26.463 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:26.463 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.463 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.463 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.463 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6819/14905", 2021-11-12T05:49:26.464 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6821/14905", 2021-11-12T05:49:26.464 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6825/14905", 2021-11-12T05:49:26.464 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6823/14905", 2021-11-12T05:49:26.464 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:26.465 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:26.465 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:26.465 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.465 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.466 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.466 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:49:26.466 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "eb2b737b-dda6-444b-a306-f33cbbd51f70", 2021-11-12T05:49:26.466 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:26.467 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:26.467 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:26.467 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:26.467 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:26.467 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:26.468 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:26.468 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 132, 2021-11-12T05:49:26.468 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:26.468 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:26.468 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:26.469 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:26.469 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.469 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:26.469 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6826", 2021-11-12T05:49:26.469 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:26.470 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.470 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.470 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:26.470 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6827", 2021-11-12T05:49:26.471 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:26.471 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.471 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.471 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.471 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:26.472 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:26.472 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.472 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:26.472 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6828", 2021-11-12T05:49:26.472 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:26.473 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.473 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.473 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:26.473 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6829", 2021-11-12T05:49:26.473 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:26.474 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.474 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.474 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.474 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:26.475 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:26.475 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.475 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:26.475 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6832", 2021-11-12T05:49:26.475 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:26.476 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.476 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.476 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:26.476 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6833", 2021-11-12T05:49:26.477 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:26.477 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.477 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.477 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.478 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:26.478 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:26.478 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.478 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:26.478 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6830", 2021-11-12T05:49:26.479 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:26.479 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.479 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.479 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:26.479 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6831", 2021-11-12T05:49:26.480 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:26.480 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.480 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.480 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.480 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6827/14876", 2021-11-12T05:49:26.481 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6829/14876", 2021-11-12T05:49:26.481 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6833/14876", 2021-11-12T05:49:26.481 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6831/14876", 2021-11-12T05:49:26.481 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:26.482 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:26.482 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:26.482 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.482 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.482 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.483 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:49:26.483 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "721529a1-c047-486a-a7ca-ddc15d80cdde", 2021-11-12T05:49:26.483 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:26.483 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:26.483 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:26.484 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:26.484 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:26.484 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:26.484 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:26.485 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 134, 2021-11-12T05:49:26.485 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:26.485 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:26.485 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:26.485 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:26.486 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.486 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:26.486 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6800", 2021-11-12T05:49:26.486 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:26.486 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.487 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.487 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:26.487 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6801", 2021-11-12T05:49:26.487 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:26.487 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.488 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.488 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.488 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:26.488 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:26.488 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.489 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:26.489 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6802", 2021-11-12T05:49:26.489 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:26.489 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.489 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.490 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:26.490 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6803", 2021-11-12T05:49:26.490 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:26.490 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.490 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.491 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.491 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:26.491 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:26.491 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.491 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:26.492 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6806", 2021-11-12T05:49:26.492 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:26.492 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.492 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.492 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:26.493 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6807", 2021-11-12T05:49:26.493 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:26.493 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.493 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.493 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.494 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:26.494 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:26.494 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.494 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:26.495 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6804", 2021-11-12T05:49:26.495 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:26.495 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.495 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.495 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:26.495 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6805", 2021-11-12T05:49:26.496 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:26.496 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.496 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.496 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.497 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6801/15096", 2021-11-12T05:49:26.497 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6803/15096", 2021-11-12T05:49:26.497 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6807/15096", 2021-11-12T05:49:26.497 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6805/15096", 2021-11-12T05:49:26.497 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:26.498 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:26.498 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:26.498 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.498 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.498 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.499 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:49:26.499 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "68b72ab2-fa82-4b5c-bf33-528f002e4950", 2021-11-12T05:49:26.499 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:26.499 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:26.499 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:26.500 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:26.500 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:26.500 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:26.500 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:26.500 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 126, 2021-11-12T05:49:26.501 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:26.501 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:26.501 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:26.501 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:26.501 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.502 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:26.502 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6808", 2021-11-12T05:49:26.502 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:26.502 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.502 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.503 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:26.503 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6809", 2021-11-12T05:49:26.503 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:26.503 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.503 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.504 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.504 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:26.504 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:26.504 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.504 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:26.505 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6810", 2021-11-12T05:49:26.505 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:26.505 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.505 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.505 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:26.506 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6811", 2021-11-12T05:49:26.506 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:26.506 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.506 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.506 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.507 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:26.507 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:26.507 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.507 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:26.507 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6814", 2021-11-12T05:49:26.508 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:26.508 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.508 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.508 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:26.508 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6815", 2021-11-12T05:49:26.509 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:26.509 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.509 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.509 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.510 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:26.510 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:26.510 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.510 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:26.510 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6812", 2021-11-12T05:49:26.511 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:26.511 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.511 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.511 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:26.511 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6813", 2021-11-12T05:49:26.512 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:26.512 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.512 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.512 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.512 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6809/15097", 2021-11-12T05:49:26.513 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6811/15097", 2021-11-12T05:49:26.513 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6815/15097", 2021-11-12T05:49:26.513 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6813/15097", 2021-11-12T05:49:26.513 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:26.513 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:26.514 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:26.514 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.514 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.514 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.514 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:49:26.515 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "a2c83b5d-8d37-4d30-ac04-30d89a76e485", 2021-11-12T05:49:26.515 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:26.515 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:26.515 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:26.516 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:26.516 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:26.516 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:26.516 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:26.516 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 133, 2021-11-12T05:49:26.517 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:26.517 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:26.517 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:26.517 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:26.517 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.518 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:26.518 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6816", 2021-11-12T05:49:26.518 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:26.518 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.519 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.519 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:26.519 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6817", 2021-11-12T05:49:26.519 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:26.519 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.520 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.520 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.520 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:26.520 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:26.520 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.521 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:26.521 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6818", 2021-11-12T05:49:26.521 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:26.521 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.521 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.522 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:26.522 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6819", 2021-11-12T05:49:26.522 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:26.522 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.522 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.523 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.523 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:26.523 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:26.523 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.523 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:26.524 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6822", 2021-11-12T05:49:26.524 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:26.524 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.524 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.524 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:26.525 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6823", 2021-11-12T05:49:26.525 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:26.525 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.525 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.525 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.526 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:26.526 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:26.526 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.526 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:26.526 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6820", 2021-11-12T05:49:26.527 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:26.527 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.527 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.527 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:26.527 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6821", 2021-11-12T05:49:26.528 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:26.528 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.528 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.528 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.528 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6817/15098", 2021-11-12T05:49:26.529 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6819/15098", 2021-11-12T05:49:26.529 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6823/15098", 2021-11-12T05:49:26.529 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6821/15098", 2021-11-12T05:49:26.529 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:26.529 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:26.530 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:26.530 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.530 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.530 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.530 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:49:26.531 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "786ce966-d0fb-4181-aed4-c26e3ef61c43", 2021-11-12T05:49:26.531 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:26.531 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:26.531 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:26.531 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:26.532 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:26.532 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:26.532 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:26.532 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 133, 2021-11-12T05:49:26.533 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:26.533 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:26.533 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:26.533 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:26.533 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.534 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:26.534 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6824", 2021-11-12T05:49:26.534 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:26.534 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.534 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.535 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:26.535 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6825", 2021-11-12T05:49:26.535 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:26.535 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.535 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.536 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.536 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:26.536 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:26.536 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.536 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:26.537 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6826", 2021-11-12T05:49:26.537 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:26.537 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.537 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.537 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:26.538 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6827", 2021-11-12T05:49:26.538 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:26.538 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.538 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.538 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.539 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:26.539 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:26.539 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.539 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:26.539 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6830", 2021-11-12T05:49:26.540 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:26.540 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.540 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.540 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:26.541 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6831", 2021-11-12T05:49:26.541 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:26.541 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.541 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.541 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.542 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:26.542 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:26.542 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.542 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:26.543 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6828", 2021-11-12T05:49:26.543 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:26.543 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.543 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.543 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:26.544 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6829", 2021-11-12T05:49:26.544 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:26.544 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.544 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.544 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.545 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6825/15099", 2021-11-12T05:49:26.545 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6827/15099", 2021-11-12T05:49:26.545 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6831/15099", 2021-11-12T05:49:26.545 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6829/15099", 2021-11-12T05:49:26.546 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:26.546 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:26.546 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:26.546 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:26.546 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.547 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:49:26.547 INFO:teuthology.orchestra.run.gibba005.stdout: "osd_xinfo": [ 2021-11-12T05:49:26.547 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.547 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:49:26.547 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:26.548 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:26.548 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:26.548 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:26.548 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:26.549 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.615112+0000", 2021-11-12T05:49:26.549 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:26.549 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.549 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.549 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:49:26.550 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:26.550 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:26.550 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:26.550 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:26.551 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:26.551 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.665935+0000", 2021-11-12T05:49:26.551 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:26.551 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.551 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.552 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:49:26.552 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:26.552 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:26.552 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:26.552 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:26.552 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:26.553 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.715877+0000", 2021-11-12T05:49:26.553 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:26.553 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.553 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.553 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:49:26.554 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:26.554 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:26.554 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:26.554 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:26.554 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:26.555 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.489234+0000", 2021-11-12T05:49:26.555 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:26.555 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.555 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.555 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:49:26.556 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:26.556 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:26.556 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:26.556 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:26.556 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:26.557 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.413776+0000", 2021-11-12T05:49:26.557 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:26.557 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.557 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.558 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:49:26.558 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:26.558 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:26.558 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:26.558 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:26.559 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:26.559 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.507960+0000", 2021-11-12T05:49:26.559 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:26.559 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.559 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.560 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:49:26.560 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:26.560 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:26.560 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:26.560 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:26.561 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:26.561 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.635696+0000", 2021-11-12T05:49:26.561 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:26.561 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.562 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:26.562 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:49:26.562 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:26.562 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:26.562 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:26.563 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:26.563 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:26.563 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.746949+0000", 2021-11-12T05:49:26.563 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:26.563 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.564 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:49:26.564 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap": [], 2021-11-12T05:49:26.564 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap_items": [], 2021-11-12T05:49:26.564 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_temp": [], 2021-11-12T05:49:26.565 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_temp": [], 2021-11-12T05:49:26.565 INFO:teuthology.orchestra.run.gibba005.stdout: "blacklist": {}, 2021-11-12T05:49:26.565 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profiles": { 2021-11-12T05:49:26.565 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs_data": { 2021-11-12T05:49:26.565 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-device-class": "", 2021-11-12T05:49:26.565 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:49:26.566 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-root": "default", 2021-11-12T05:49:26.566 INFO:teuthology.orchestra.run.gibba005.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-12T05:49:26.566 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:49:26.566 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "2", 2021-11-12T05:49:26.567 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:49:26.567 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:49:26.567 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van", 2021-11-12T05:49:26.567 INFO:teuthology.orchestra.run.gibba005.stdout: "w": "8" 2021-11-12T05:49:26.567 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.568 INFO:teuthology.orchestra.run.gibba005.stdout: "default": { 2021-11-12T05:49:26.568 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:49:26.568 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:49:26.568 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "1", 2021-11-12T05:49:26.568 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:49:26.569 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:49:26.569 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van" 2021-11-12T05:49:26.569 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:26.569 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:26.569 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps_queue": [], 2021-11-12T05:49:26.570 INFO:teuthology.orchestra.run.gibba005.stdout: "new_removed_snaps": [], 2021-11-12T05:49:26.570 INFO:teuthology.orchestra.run.gibba005.stdout: "new_purged_snaps": [], 2021-11-12T05:49:26.570 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_node_flags": {}, 2021-11-12T05:49:26.570 INFO:teuthology.orchestra.run.gibba005.stdout: "device_class_flags": {} 2021-11-12T05:49:26.571 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:49:26.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.332+0000 7f07018d6700 1 -- 172.21.2.105:0/1387306030 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f06e0053520 msgr2=0x7f06e00559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:26.572 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.332+0000 7f07018d6700 1 --2- 172.21.2.105:0/1387306030 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f06e0053520 0x7f06e00559e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f06e4002f70 tx=0x7f06e4006a80).stop 2021-11-12T05:49:26.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.332+0000 7f07018d6700 1 -- 172.21.2.105:0/1387306030 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06fc05bd90 msgr2=0x7f06fc09eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:26.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.332+0000 7f07018d6700 1 --2- 172.21.2.105:0/1387306030 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06fc05bd90 0x7f06fc09eaf0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7f06ec001110 tx=0x7f06ec007aa0).stop 2021-11-12T05:49:26.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.336+0000 7f07018d6700 1 -- 172.21.2.105:0/1387306030 shutdown_connections 2021-11-12T05:49:26.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.336+0000 7f07018d6700 1 --2- 172.21.2.105:0/1387306030 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f06e0053520 0x7f06e00559e0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:26.573 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.336+0000 7f07018d6700 1 --2- 172.21.2.105:0/1387306030 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f06fc0b1ea0 0x7f06fc0a0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:26.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.336+0000 7f07018d6700 1 --2- 172.21.2.105:0/1387306030 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f06fc0ab8b0 0x7f06fc156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:26.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.336+0000 7f07018d6700 1 --2- 172.21.2.105:0/1387306030 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06fc05bd90 0x7f06fc09eaf0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:26.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.336+0000 7f07018d6700 1 -- 172.21.2.105:0/1387306030 >> 172.21.2.105:0/1387306030 conn(0x7f06fc060760 msgr2=0x7f06fc146a60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:26.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.336+0000 7f07018d6700 1 -- 172.21.2.105:0/1387306030 shutdown_connections 2021-11-12T05:49:26.574 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.336+0000 7f07018d6700 1 -- 172.21.2.105:0/1387306030 wait complete. 2021-11-12T05:49:26.575 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:49:26.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.644+0000 7fe266bcc700 1 Processor -- start 2021-11-12T05:49:26.648 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.644+0000 7fe266bcc700 1 -- start start 2021-11-12T05:49:26.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.644+0000 7fe266bcc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe2600b7940 0x7fe260144650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:26.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.644+0000 7fe266bcc700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fe2600ad3b0 0x7fe2600b2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:26.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.644+0000 7fe266bcc700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe260066430 con 0x7fe2600b2d10 2021-11-12T05:49:26.649 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.644+0000 7fe266bcc700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2600b7d20 con 0x7fe2600b7940 2021-11-12T05:49:26.650 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.644+0000 7fe266bcc700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2600b23a0 con 0x7fe2600ad3b0 2021-11-12T05:49:26.650 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.644+0000 7fe265169700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fe2600b2d10 0x7fe2600b40f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:33960/0 (socket says 172.21.2.105:33960) 2021-11-12T05:49:26.650 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.644+0000 7fe265169700 1 -- 172.21.2.105:0/2815966234 learned_addr learned my addr 172.21.2.105:0/2815966234 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:26.650 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.644+0000 7fe264968700 1 --2- 172.21.2.105:0/2815966234 >> v2:172.21.2.105:3300/0 conn(0x7fe2600b7940 0x7fe260144650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:26.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.644+0000 7fe264968700 1 -- 172.21.2.105:0/2815966234 >> v2:172.21.2.115:3300/0 conn(0x7fe2600ad3b0 msgr2=0x7fe2600b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:26.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.644+0000 7fe264968700 1 --2- 172.21.2.105:0/2815966234 >> v2:172.21.2.115:3300/0 conn(0x7fe2600ad3b0 0x7fe2600b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:26.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.644+0000 7fe264968700 1 -- 172.21.2.105:0/2815966234 >> v1:172.21.2.105:6789/0 conn(0x7fe2600b2d10 legacy=0x7fe2600b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:26.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.644+0000 7fe264968700 1 -- 172.21.2.105:0/2815966234 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2600b2100 con 0x7fe2600b7940 2021-11-12T05:49:26.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.644+0000 7fe264968700 1 --2- 172.21.2.105:0/2815966234 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2600b7940 0x7fe260144650 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7fe250002f70 tx=0x7fe250006df0).ready entity=mon.0 client_cookie=dc9ee8c1970e00df server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:26.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.644+0000 7fe25f7fe700 1 -- 172.21.2.105:0/2815966234 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe25000d5c0 con 0x7fe2600b7940 2021-11-12T05:49:26.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.644+0000 7fe25f7fe700 1 -- 172.21.2.105:0/2815966234 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe250000e90 con 0x7fe2600b7940 2021-11-12T05:49:26.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.644+0000 7fe25f7fe700 1 -- 172.21.2.105:0/2815966234 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe25000d910 con 0x7fe2600b7940 2021-11-12T05:49:26.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.644+0000 7fe266bcc700 1 -- 172.21.2.105:0/2815966234 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2600b7940 msgr2=0x7fe260144650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:26.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.644+0000 7fe266bcc700 1 --2- 172.21.2.105:0/2815966234 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2600b7940 0x7fe260144650 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7fe250002f70 tx=0x7fe250006df0).stop 2021-11-12T05:49:26.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.644+0000 7fe266bcc700 1 -- 172.21.2.105:0/2815966234 shutdown_connections 2021-11-12T05:49:26.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.644+0000 7fe266bcc700 1 --2- 172.21.2.105:0/2815966234 >> v2:172.21.2.115:3300/0 conn(0x7fe2600ad3b0 0x7fe2600b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:26.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.644+0000 7fe266bcc700 1 --2- 172.21.2.105:0/2815966234 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2600b7940 0x7fe260144650 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:26.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.644+0000 7fe266bcc700 1 -- 172.21.2.105:0/2815966234 >> 172.21.2.105:0/2815966234 conn(0x7fe26005bd90 msgr2=0x7fe2600646d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:26.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.644+0000 7fe266bcc700 1 -- 172.21.2.105:0/2815966234 shutdown_connections 2021-11-12T05:49:26.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.644+0000 7fe266bcc700 1 -- 172.21.2.105:0/2815966234 wait complete. 2021-11-12T05:49:26.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.648+0000 7fe266bcc700 1 Processor -- start 2021-11-12T05:49:26.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.648+0000 7fe266bcc700 1 -- start start 2021-11-12T05:49:26.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.648+0000 7fe266bcc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2600ad3b0 0x7fe2600b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:26.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.648+0000 7fe266bcc700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe2600b2d10 0x7fe260144de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:26.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.648+0000 7fe266bcc700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe2600b7940 0x7fe2601118f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:26.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.648+0000 7fe266bcc700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe260147680 con 0x7fe2600ad3b0 2021-11-12T05:49:26.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.648+0000 7fe266bcc700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe260147920 con 0x7fe2600b7940 2021-11-12T05:49:26.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.648+0000 7fe266bcc700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe260111420 con 0x7fe2600b2d10 2021-11-12T05:49:26.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.648+0000 7fe264968700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2600ad3b0 0x7fe2600b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:26.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.648+0000 7fe264968700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2600ad3b0 0x7fe2600b0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51798/0 (socket says 172.21.2.105:51798) 2021-11-12T05:49:26.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.648+0000 7fe264968700 1 -- 172.21.2.105:0/44439362 learned_addr learned my addr 172.21.2.105:0/44439362 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:26.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.648+0000 7fe264968700 1 -- 172.21.2.105:0/44439362 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe2600b2d10 msgr2=0x7fe260144de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:26.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.648+0000 7fe264968700 1 --2- 172.21.2.105:0/44439362 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe2600b2d10 0x7fe260144de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:26.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.648+0000 7fe264968700 1 -- 172.21.2.105:0/44439362 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe2600b7940 msgr2=0x7fe2601118f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:26.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.648+0000 7fe264968700 1 --2- 172.21.2.105:0/44439362 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe2600b7940 0x7fe2601118f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:26.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.648+0000 7fe264968700 1 -- 172.21.2.105:0/44439362 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe25000b180 con 0x7fe2600ad3b0 2021-11-12T05:49:26.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.648+0000 7fe264968700 1 --2- 172.21.2.105:0/44439362 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2600ad3b0 0x7fe2600b0640 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 rx=0x7fe250002f70 tx=0x7fe250014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:26.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.648+0000 7fe25dffb700 1 -- 172.21.2.105:0/44439362 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe250016070 con 0x7fe2600ad3b0 2021-11-12T05:49:26.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.648+0000 7fe25dffb700 1 -- 172.21.2.105:0/44439362 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25000de90 con 0x7fe2600ad3b0 2021-11-12T05:49:26.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.648+0000 7fe266bcc700 1 -- 172.21.2.105:0/44439362 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe260147300 con 0x7fe2600ad3b0 2021-11-12T05:49:26.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.648+0000 7fe25dffb700 1 -- 172.21.2.105:0/44439362 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe25001e450 con 0x7fe2600ad3b0 2021-11-12T05:49:26.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.648+0000 7fe266bcc700 1 -- 172.21.2.105:0/44439362 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe260146380 con 0x7fe2600ad3b0 2021-11-12T05:49:26.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.648+0000 7fe266bcc700 1 -- 172.21.2.105:0/44439362 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2601115e0 con 0x7fe2600ad3b0 2021-11-12T05:49:26.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.648+0000 7fe25dffb700 1 -- 172.21.2.105:0/44439362 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe250025030 con 0x7fe2600ad3b0 2021-11-12T05:49:26.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.648+0000 7fe25dffb700 1 --2- 172.21.2.105:0/44439362 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe2400536f0 0x7fe240055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:26.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.648+0000 7fe25dffb700 1 -- 172.21.2.105:0/44439362 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fe25006cd90 con 0x7fe2600ad3b0 2021-11-12T05:49:26.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.648+0000 7fe25ffff700 1 --2- 172.21.2.105:0/44439362 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe2400536f0 0x7fe240055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:26.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.648+0000 7fe25ffff700 1 --2- 172.21.2.105:0/44439362 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe2400536f0 0x7fe240055bb0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fe254002f70 tx=0x7fe254006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:26.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.652+0000 7fe25dffb700 1 -- 172.21.2.105:0/44439362 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe250072020 con 0x7fe2600ad3b0 2021-11-12T05:49:26.763 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.760+0000 7fe266bcc700 1 -- 172.21.2.105:0/44439362 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2601474f0 con 0x7fe2600ad3b0 2021-11-12T05:49:26.764 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.760+0000 7fe25dffb700 1 -- 172.21.2.105:0/44439362 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+2139 (secure 0 0 0) 0x7fe250043c90 con 0x7fe2600ad3b0 2021-11-12T05:49:26.765 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:26.765 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":65,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4979,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/2405231908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":2405231908},{"type":"v1","addr":"172.21.2.115:6833","nonce":2405231908}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":63}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:49:07.486433+0000","modified":"2021-11-12T05:49:08.490302+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8115},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8115":{"gid":8115,"name":"a","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/737863904","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":737863904},{"type":"v1","addr":"172.21.2.105:6835","nonce":737863904}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-11-12T05:49:26.766 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.760+0000 7fe266bcc700 1 -- 172.21.2.105:0/44439362 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe2400536f0 msgr2=0x7fe240055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:26.766 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.760+0000 7fe266bcc700 1 --2- 172.21.2.105:0/44439362 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe2400536f0 0x7fe240055bb0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fe254002f70 tx=0x7fe254006a80).stop 2021-11-12T05:49:26.766 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.760+0000 7fe266bcc700 1 -- 172.21.2.105:0/44439362 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2600ad3b0 msgr2=0x7fe2600b0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:26.767 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.760+0000 7fe266bcc700 1 --2- 172.21.2.105:0/44439362 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2600ad3b0 0x7fe2600b0640 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 rx=0x7fe250002f70 tx=0x7fe250014000).stop 2021-11-12T05:49:26.767 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.760+0000 7fe266bcc700 1 -- 172.21.2.105:0/44439362 shutdown_connections 2021-11-12T05:49:26.767 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.760+0000 7fe266bcc700 1 --2- 172.21.2.105:0/44439362 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe2400536f0 0x7fe240055bb0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:26.767 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.760+0000 7fe266bcc700 1 --2- 172.21.2.105:0/44439362 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe2600b7940 0x7fe2601118f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:26.768 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.760+0000 7fe266bcc700 1 --2- 172.21.2.105:0/44439362 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe2600b2d10 0x7fe260144de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:26.768 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.760+0000 7fe266bcc700 1 --2- 172.21.2.105:0/44439362 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe2600ad3b0 0x7fe2600b0640 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:26.768 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.760+0000 7fe266bcc700 1 -- 172.21.2.105:0/44439362 >> 172.21.2.105:0/44439362 conn(0x7fe26005bd90 msgr2=0x7fe2600b5860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:26.768 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.760+0000 7fe266bcc700 1 -- 172.21.2.105:0/44439362 shutdown_connections 2021-11-12T05:49:26.768 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.760+0000 7fe266bcc700 1 -- 172.21.2.105:0/44439362 wait complete. 2021-11-12T05:49:26.769 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 65 2021-11-12T05:49:26.772 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-12T05:49:26.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.820+0000 7f915d50e700 1 Processor -- start 2021-11-12T05:49:26.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.820+0000 7f915d50e700 1 -- start start 2021-11-12T05:49:26.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.820+0000 7f915d50e700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f915814fe80 0x7f9158152270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:26.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.820+0000 7f915d50e700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91580b5f60 con 0x7f91580ac100 2021-11-12T05:49:26.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.820+0000 7f915d50e700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91580abe50 con 0x7f91580b5b80 2021-11-12T05:49:26.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.820+0000 7f915d50e700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f915805c730 con 0x7f915814fe80 2021-11-12T05:49:26.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.820+0000 7f91567fc700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f91580ac100 0x7f915814b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:33970/0 (socket says 172.21.2.105:33970) 2021-11-12T05:49:26.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.820+0000 7f91567fc700 1 -- 172.21.2.105:0/101517710 learned_addr learned my addr 172.21.2.105:0/101517710 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:26.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.820+0000 7f91577fe700 1 --2- 172.21.2.105:0/101517710 >> v2:172.21.2.105:3300/0 conn(0x7f915814fe80 0x7f9158152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:26.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.820+0000 7f91577fe700 1 -- 172.21.2.105:0/101517710 >> v1:172.21.2.115:6789/0 conn(0x7f91580b5b80 legacy=0x7f915814ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:26.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.820+0000 7f91577fe700 1 -- 172.21.2.105:0/101517710 >> v1:172.21.2.105:6789/0 conn(0x7f91580ac100 legacy=0x7f915814b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:26.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.820+0000 7f91577fe700 1 -- 172.21.2.105:0/101517710 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f915805c9d0 con 0x7f915814fe80 2021-11-12T05:49:26.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.820+0000 7f91577fe700 1 --2- 172.21.2.105:0/101517710 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f915814fe80 0x7f9158152270 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7f91580b53f0 tx=0x7f91500091d0).ready entity=mon.0 client_cookie=168f9c1302612f49 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:26.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.820+0000 7f9155ffb700 1 -- 172.21.2.105:0/101517710 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9150009ea0 con 0x7f915814fe80 2021-11-12T05:49:26.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.820+0000 7f9155ffb700 1 -- 172.21.2.105:0/101517710 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915000b860 con 0x7f915814fe80 2021-11-12T05:49:26.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.820+0000 7f9155ffb700 1 -- 172.21.2.105:0/101517710 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f915000b9d0 con 0x7f915814fe80 2021-11-12T05:49:26.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.820+0000 7f915d50e700 1 -- 172.21.2.105:0/101517710 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f915814fe80 msgr2=0x7f9158152270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:26.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.820+0000 7f915d50e700 1 --2- 172.21.2.105:0/101517710 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f915814fe80 0x7f9158152270 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7f91580b53f0 tx=0x7f91500091d0).stop 2021-11-12T05:49:26.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.820+0000 7f915d50e700 1 -- 172.21.2.105:0/101517710 shutdown_connections 2021-11-12T05:49:26.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.820+0000 7f915d50e700 1 --2- 172.21.2.105:0/101517710 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f915814fe80 0x7f9158152270 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:26.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.820+0000 7f915d50e700 1 -- 172.21.2.105:0/101517710 >> 172.21.2.105:0/101517710 conn(0x7f9158062420 msgr2=0x7f9158062830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:26.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.820+0000 7f915d50e700 1 -- 172.21.2.105:0/101517710 shutdown_connections 2021-11-12T05:49:26.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.820+0000 7f915d50e700 1 -- 172.21.2.105:0/101517710 wait complete. 2021-11-12T05:49:26.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.820+0000 7f915d50e700 1 Processor -- start 2021-11-12T05:49:26.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.820+0000 7f915d50e700 1 -- start start 2021-11-12T05:49:26.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.824+0000 7f915d50e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f91580ac100 0x7f9158143690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:26.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.824+0000 7f915d50e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f91580b5b80 0x7f91580638c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:26.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.824+0000 7f915d50e700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f915814fe80 0x7f9158063db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:26.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.824+0000 7f915d50e700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91580ad520 con 0x7f91580b5b80 2021-11-12T05:49:26.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.824+0000 7f915d50e700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9158147800 con 0x7f915814fe80 2021-11-12T05:49:26.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.824+0000 7f915d50e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91580ae110 con 0x7f91580ac100 2021-11-12T05:49:26.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.824+0000 7f91567fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f91580b5b80 0x7f91580638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:26.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.824+0000 7f91567fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f91580b5b80 0x7f91580638c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51814/0 (socket says 172.21.2.105:51814) 2021-11-12T05:49:26.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.824+0000 7f91567fc700 1 -- 172.21.2.105:0/895497948 learned_addr learned my addr 172.21.2.105:0/895497948 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:26.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.824+0000 7f91567fc700 1 -- 172.21.2.105:0/895497948 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f91580ac100 msgr2=0x7f9158143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:26.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.824+0000 7f91567fc700 1 --2- 172.21.2.105:0/895497948 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f91580ac100 0x7f9158143690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:26.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.824+0000 7f91567fc700 1 -- 172.21.2.105:0/895497948 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f915814fe80 msgr2=0x7f9158063db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:26.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.824+0000 7f91567fc700 1 --2- 172.21.2.105:0/895497948 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f915814fe80 0x7f9158063db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:26.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.824+0000 7f91567fc700 1 -- 172.21.2.105:0/895497948 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9150009470 con 0x7f91580b5b80 2021-11-12T05:49:26.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.824+0000 7f91567fc700 1 --2- 172.21.2.105:0/895497948 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f91580b5b80 0x7f91580638c0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 rx=0x7f91580688c0 tx=0x7f9140007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:26.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.824+0000 7f914ffff700 1 -- 172.21.2.105:0/895497948 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f914000ce30 con 0x7f91580b5b80 2021-11-12T05:49:26.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.824+0000 7f914ffff700 1 -- 172.21.2.105:0/895497948 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91400072e0 con 0x7f91580b5b80 2021-11-12T05:49:26.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.824+0000 7f914ffff700 1 -- 172.21.2.105:0/895497948 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9140005800 con 0x7f91580b5b80 2021-11-12T05:49:26.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.824+0000 7f915d50e700 1 -- 172.21.2.105:0/895497948 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91580ad750 con 0x7f91580b5b80 2021-11-12T05:49:26.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.824+0000 7f915d50e700 1 -- 172.21.2.105:0/895497948 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91580adbf0 con 0x7f91580b5b80 2021-11-12T05:49:26.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.824+0000 7f915d50e700 1 -- 172.21.2.105:0/895497948 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91580ad8e0 con 0x7f91580b5b80 2021-11-12T05:49:26.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.824+0000 7f914ffff700 1 -- 172.21.2.105:0/895497948 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9140010070 con 0x7f91580b5b80 2021-11-12T05:49:26.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.824+0000 7f914ffff700 1 --2- 172.21.2.105:0/895497948 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f913c0535d0 0x7f913c055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:26.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.824+0000 7f914ffff700 1 -- 172.21.2.105:0/895497948 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f914006b140 con 0x7f91580b5b80 2021-11-12T05:49:26.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.824+0000 7f9156ffd700 1 --2- 172.21.2.105:0/895497948 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f913c0535d0 0x7f913c055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:26.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.824+0000 7f9156ffd700 1 --2- 172.21.2.105:0/895497948 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f913c0535d0 0x7f913c055a90 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f9148002f90 tx=0x7f91480069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:26.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.828+0000 7f914ffff700 1 -- 172.21.2.105:0/895497948 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9140042150 con 0x7f91580b5b80 2021-11-12T05:49:26.940 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:26.936+0000 7f915d50e700 1 -- 172.21.2.105:0/895497948 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f915805cc70 con 0x7f91580b5b80 2021-11-12T05:49:27.153 INFO:tasks.ceph.mon.a.gibba005.stderr:2021-11-12T05:49:27.148+0000 7fe9772b2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-12T05:49:27.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.160+0000 7f914ffff700 1 -- 172.21.2.105:0/895497948 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v66) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9140045770 con 0x7f91580b5b80 2021-11-12T05:49:27.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.164+0000 7f915d50e700 1 -- 172.21.2.105:0/895497948 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f913c0535d0 msgr2=0x7f913c055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:27.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.164+0000 7f915d50e700 1 --2- 172.21.2.105:0/895497948 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f913c0535d0 0x7f913c055a90 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f9148002f90 tx=0x7f91480069b0).stop 2021-11-12T05:49:27.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.164+0000 7f915d50e700 1 -- 172.21.2.105:0/895497948 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f91580b5b80 msgr2=0x7f91580638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:27.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.164+0000 7f915d50e700 1 --2- 172.21.2.105:0/895497948 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f91580b5b80 0x7f91580638c0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 rx=0x7f91580688c0 tx=0x7f9140007c40).stop 2021-11-12T05:49:27.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.164+0000 7f915d50e700 1 -- 172.21.2.105:0/895497948 shutdown_connections 2021-11-12T05:49:27.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.164+0000 7f915d50e700 1 --2- 172.21.2.105:0/895497948 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f913c0535d0 0x7f913c055a90 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:27.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.164+0000 7f915d50e700 1 --2- 172.21.2.105:0/895497948 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f915814fe80 0x7f9158063db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:27.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.164+0000 7f915d50e700 1 --2- 172.21.2.105:0/895497948 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f91580b5b80 0x7f91580638c0 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:27.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.164+0000 7f915d50e700 1 --2- 172.21.2.105:0/895497948 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f91580ac100 0x7f9158143690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:27.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.164+0000 7f915d50e700 1 -- 172.21.2.105:0/895497948 >> 172.21.2.105:0/895497948 conn(0x7f9158062420 msgr2=0x7f91580b32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:27.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.164+0000 7f915d50e700 1 -- 172.21.2.105:0/895497948 shutdown_connections 2021-11-12T05:49:27.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.164+0000 7f915d50e700 1 -- 172.21.2.105:0/895497948 wait complete. 2021-11-12T05:49:27.170 INFO:teuthology.orchestra.run.gibba005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-12T05:49:27.177 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:49:27.186 INFO:tasks.ceph.mds.a.gibba005.stdout:starting mds.a at 2021-11-12T05:49:27.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.224+0000 7fd78ff58700 1 Processor -- start 2021-11-12T05:49:27.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.224+0000 7fd78ff58700 1 -- start start 2021-11-12T05:49:27.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.224+0000 7fd78ff58700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd7880b7940 0x7fd788144650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:27.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.224+0000 7fd78ff58700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd7880ad3b0 0x7fd7880b2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:27.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.224+0000 7fd78ff58700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd788066430 con 0x7fd7880b2d10 2021-11-12T05:49:27.235 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.224+0000 7fd78ff58700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7880b7d20 con 0x7fd7880ad3b0 2021-11-12T05:49:27.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.224+0000 7fd78ff58700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7880b23a0 con 0x7fd7880b7940 2021-11-12T05:49:27.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.224+0000 7fd78d4f3700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd7880ad3b0 0x7fd7880b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:27.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.224+0000 7fd78e4f5700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fd7880b2d10 0x7fd7880b40f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34002/0 (socket says 172.21.2.105:34002) 2021-11-12T05:49:27.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.224+0000 7fd78e4f5700 1 -- 172.21.2.105:0/6744345 learned_addr learned my addr 172.21.2.105:0/6744345 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:27.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd78d4f3700 1 -- 172.21.2.105:0/6744345 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd7880b7940 msgr2=0x7fd788144650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:27.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd78d4f3700 1 --2- 172.21.2.105:0/6744345 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd7880b7940 0x7fd788144650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:27.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd78d4f3700 1 -- 172.21.2.105:0/6744345 >> v1:172.21.2.105:6789/0 conn(0x7fd7880b2d10 legacy=0x7fd7880b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:27.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd78ccf2700 1 -- 172.21.2.105:0/6744345 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2434290428 0 0) 0x7fd788066430 con 0x7fd7880b2d10 2021-11-12T05:49:27.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd78d4f3700 1 -- 172.21.2.105:0/6744345 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7880b2100 con 0x7fd7880ad3b0 2021-11-12T05:49:27.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd78d4f3700 1 --2- 172.21.2.105:0/6744345 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd7880ad3b0 0x7fd7880b2820 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 rx=0x7fd784002f70 tx=0x7fd784006df0).ready entity=mon.0 client_cookie=8f07c62e52ab7333 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:27.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd78ccf2700 1 -- 172.21.2.105:0/6744345 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd78400d570 con 0x7fd7880ad3b0 2021-11-12T05:49:27.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd78ccf2700 1 -- 172.21.2.105:0/6744345 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd784000e90 con 0x7fd7880ad3b0 2021-11-12T05:49:27.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd78ccf2700 1 -- 172.21.2.105:0/6744345 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd78400d8c0 con 0x7fd7880ad3b0 2021-11-12T05:49:27.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd78ff58700 1 -- 172.21.2.105:0/6744345 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd7880ad3b0 msgr2=0x7fd7880b2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:27.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd78ff58700 1 --2- 172.21.2.105:0/6744345 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd7880ad3b0 0x7fd7880b2820 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 rx=0x7fd784002f70 tx=0x7fd784006df0).stop 2021-11-12T05:49:27.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd78ff58700 1 -- 172.21.2.105:0/6744345 shutdown_connections 2021-11-12T05:49:27.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd78ff58700 1 --2- 172.21.2.105:0/6744345 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd7880ad3b0 0x7fd7880b2820 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:27.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd78ff58700 1 --2- 172.21.2.105:0/6744345 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd7880b7940 0x7fd788144650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:27.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd78ff58700 1 -- 172.21.2.105:0/6744345 >> 172.21.2.105:0/6744345 conn(0x7fd78805bd90 msgr2=0x7fd7880646d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:27.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd78ff58700 1 -- 172.21.2.105:0/6744345 shutdown_connections 2021-11-12T05:49:27.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd78ff58700 1 -- 172.21.2.105:0/6744345 wait complete. 2021-11-12T05:49:27.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd78ff58700 1 Processor -- start 2021-11-12T05:49:27.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd78ff58700 1 -- start start 2021-11-12T05:49:27.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd78ff58700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd7880ad3b0 0x7fd788111b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:27.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd78ff58700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd7880b2d10 0x7fd7880b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:27.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd78ff58700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd7880b7940 0x7fd7881159b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:27.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd78ff58700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd788113d20 con 0x7fd7880b2d10 2021-11-12T05:49:27.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd78ff58700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd788115270 con 0x7fd7880ad3b0 2021-11-12T05:49:27.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd78ff58700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd788115510 con 0x7fd7880b7940 2021-11-12T05:49:27.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd78d4f3700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd7880b2d10 0x7fd7880b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:27.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd78d4f3700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd7880b2d10 0x7fd7880b02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51844/0 (socket says 172.21.2.105:51844) 2021-11-12T05:49:27.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd78d4f3700 1 -- 172.21.2.105:0/3002708172 learned_addr learned my addr 172.21.2.105:0/3002708172 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:27.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd78d4f3700 1 -- 172.21.2.105:0/3002708172 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd7880b7940 msgr2=0x7fd7881159b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:49:27.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd78d4f3700 1 --2- 172.21.2.105:0/3002708172 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd7880b7940 0x7fd7881159b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:27.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd78d4f3700 1 -- 172.21.2.105:0/3002708172 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd7880ad3b0 msgr2=0x7fd788111b50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:49:27.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd78d4f3700 1 --2- 172.21.2.105:0/3002708172 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd7880ad3b0 0x7fd788111b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:27.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd78d4f3700 1 -- 172.21.2.105:0/3002708172 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd78400b180 con 0x7fd7880b2d10 2021-11-12T05:49:27.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd78d4f3700 1 --2- 172.21.2.105:0/3002708172 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd7880b2d10 0x7fd7880b02e0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7fd784002f70 tx=0x7fd784015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:27.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd77affd700 1 -- 172.21.2.105:0/3002708172 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7840119d0 con 0x7fd7880b2d10 2021-11-12T05:49:27.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd77affd700 1 -- 172.21.2.105:0/3002708172 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd784011b30 con 0x7fd7880b2d10 2021-11-12T05:49:27.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd78ff58700 1 -- 172.21.2.105:0/3002708172 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd788113920 con 0x7fd7880b2d10 2021-11-12T05:49:27.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd78ff58700 1 -- 172.21.2.105:0/3002708172 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd788116040 con 0x7fd7880b2d10 2021-11-12T05:49:27.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd77affd700 1 -- 172.21.2.105:0/3002708172 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd784011e90 con 0x7fd7880b2d10 2021-11-12T05:49:27.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd78ff58700 1 -- 172.21.2.105:0/3002708172 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd764003410 con 0x7fd7880b2d10 2021-11-12T05:49:27.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd77affd700 1 -- 172.21.2.105:0/3002708172 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd784025030 con 0x7fd7880b2d10 2021-11-12T05:49:27.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd77affd700 1 --2- 172.21.2.105:0/3002708172 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd768053720 0x7fd768055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:27.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd77affd700 1 -- 172.21.2.105:0/3002708172 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6502+0+0 (secure 0 0 0) 0x7fd78406d040 con 0x7fd7880b2d10 2021-11-12T05:49:27.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.228+0000 7fd78dcf4700 1 --2- 172.21.2.105:0/3002708172 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd768053720 0x7fd768055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:27.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.232+0000 7fd78dcf4700 1 --2- 172.21.2.105:0/3002708172 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd768053720 0x7fd768055be0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7fd77c002f70 tx=0x7fd77c006960).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:27.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.232+0000 7fd77affd700 1 -- 172.21.2.105:0/3002708172 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd784043ee0 con 0x7fd7880b2d10 2021-11-12T05:49:27.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.340+0000 7fd78ff58700 1 -- 172.21.2.105:0/3002708172 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd764003c40 con 0x7fd7880b2d10 2021-11-12T05:49:27.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.344+0000 7fd77affd700 1 -- 172.21.2.105:0/3002708172 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+1782 (secure 0 0 0) 0x7fd784047500 con 0x7fd7880b2d10 2021-11-12T05:49:27.348 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:27.348 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":66,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4979,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/2405231908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":2405231908},{"type":"v1","addr":"172.21.2.115:6833","nonce":2405231908}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":63}],"filesystems":[{"mdsmap":{"epoch":66,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:49:07.486433+0000","modified":"2021-11-12T05:49:27.153006+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":137,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-11-12T05:49:27.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.344+0000 7fd78ff58700 1 -- 172.21.2.105:0/3002708172 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd768053720 msgr2=0x7fd768055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:27.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.344+0000 7fd78ff58700 1 --2- 172.21.2.105:0/3002708172 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd768053720 0x7fd768055be0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7fd77c002f70 tx=0x7fd77c006960).stop 2021-11-12T05:49:27.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.344+0000 7fd78ff58700 1 -- 172.21.2.105:0/3002708172 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd7880b2d10 msgr2=0x7fd7880b02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:27.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.344+0000 7fd78ff58700 1 --2- 172.21.2.105:0/3002708172 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd7880b2d10 0x7fd7880b02e0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7fd784002f70 tx=0x7fd784015000).stop 2021-11-12T05:49:27.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.344+0000 7fd78ff58700 1 -- 172.21.2.105:0/3002708172 shutdown_connections 2021-11-12T05:49:27.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.344+0000 7fd78ff58700 1 --2- 172.21.2.105:0/3002708172 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd768053720 0x7fd768055be0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:27.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.344+0000 7fd78ff58700 1 --2- 172.21.2.105:0/3002708172 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd7880b7940 0x7fd7881159b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:27.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.344+0000 7fd78ff58700 1 --2- 172.21.2.105:0/3002708172 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd7880b2d10 0x7fd7880b02e0 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:27.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.344+0000 7fd78ff58700 1 --2- 172.21.2.105:0/3002708172 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd7880ad3b0 0x7fd788111b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:27.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.344+0000 7fd78ff58700 1 -- 172.21.2.105:0/3002708172 >> 172.21.2.105:0/3002708172 conn(0x7fd78805bd90 msgr2=0x7fd788141420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:27.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.344+0000 7fd78ff58700 1 -- 172.21.2.105:0/3002708172 shutdown_connections 2021-11-12T05:49:27.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.344+0000 7fd78ff58700 1 -- 172.21.2.105:0/3002708172 wait complete. 2021-11-12T05:49:27.352 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 66 2021-11-12T05:49:27.355 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-12T05:49:27.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.400+0000 7fbe286cf700 1 Processor -- start 2021-11-12T05:49:27.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.400+0000 7fbe286cf700 1 -- start start 2021-11-12T05:49:27.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe286cf700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fbe200b0be0 0x7fbe200ad680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:27.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe286cf700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fbe200b1ec0 0x7fbe200af590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:27.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe286cf700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe200acd10 con 0x7fbe2005ec40 2021-11-12T05:49:27.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe286cf700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe200acf40 con 0x7fbe200b1ec0 2021-11-12T05:49:27.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe286cf700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe200ad1e0 con 0x7fbe200b0be0 2021-11-12T05:49:27.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe26c6c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fbe200b1ec0 0x7fbe200af590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:27.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe26c6c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fbe200b1ec0 0x7fbe200af590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51854/0 (socket says 172.21.2.105:51854) 2021-11-12T05:49:27.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe26c6c700 1 -- 172.21.2.105:0/1535764188 learned_addr learned my addr 172.21.2.105:0/1535764188 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:27.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe26c6c700 1 -- 172.21.2.105:0/1535764188 >> v2:172.21.2.115:3300/0 conn(0x7fbe200b0be0 msgr2=0x7fbe200ad680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:27.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe26c6c700 1 --2- 172.21.2.105:0/1535764188 >> v2:172.21.2.115:3300/0 conn(0x7fbe200b0be0 0x7fbe200ad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:27.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe26c6c700 1 -- 172.21.2.105:0/1535764188 >> v1:172.21.2.115:6789/0 conn(0x7fbe2005ec40 legacy=0x7fbe200aee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:27.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe26c6c700 1 -- 172.21.2.105:0/1535764188 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe200afe70 con 0x7fbe200b1ec0 2021-11-12T05:49:27.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe26c6c700 1 --2- 172.21.2.105:0/1535764188 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbe200b1ec0 0x7fbe200af590 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 rx=0x7fbe200ae2a0 tx=0x7fbe18009290).ready entity=mon.0 client_cookie=3366de117f5fdd95 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:27.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe25469700 1 -- 172.21.2.105:0/1535764188 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe1800b830 con 0x7fbe200b1ec0 2021-11-12T05:49:27.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe25469700 1 -- 172.21.2.105:0/1535764188 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe1800b990 con 0x7fbe200b1ec0 2021-11-12T05:49:27.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe25469700 1 -- 172.21.2.105:0/1535764188 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe1800bb40 con 0x7fbe200b1ec0 2021-11-12T05:49:27.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe286cf700 1 -- 172.21.2.105:0/1535764188 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbe200b1ec0 msgr2=0x7fbe200af590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:27.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe286cf700 1 --2- 172.21.2.105:0/1535764188 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbe200b1ec0 0x7fbe200af590 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 rx=0x7fbe200ae2a0 tx=0x7fbe18009290).stop 2021-11-12T05:49:27.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe286cf700 1 -- 172.21.2.105:0/1535764188 shutdown_connections 2021-11-12T05:49:27.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe286cf700 1 --2- 172.21.2.105:0/1535764188 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbe200b1ec0 0x7fbe200af590 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:27.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe286cf700 1 --2- 172.21.2.105:0/1535764188 >> v2:172.21.2.115:3300/0 conn(0x7fbe200b0be0 0x7fbe200ad680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:27.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe286cf700 1 -- 172.21.2.105:0/1535764188 >> 172.21.2.105:0/1535764188 conn(0x7fbe2005cb90 msgr2=0x7fbe200b58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:27.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe286cf700 1 -- 172.21.2.105:0/1535764188 shutdown_connections 2021-11-12T05:49:27.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe286cf700 1 -- 172.21.2.105:0/1535764188 wait complete. 2021-11-12T05:49:27.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe286cf700 1 Processor -- start 2021-11-12T05:49:27.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe286cf700 1 -- start start 2021-11-12T05:49:27.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe286cf700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbe2005ec40 0x7fbe2012be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:27.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe286cf700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbe200b0be0 0x7fbe20064e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:27.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe286cf700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbe200b1ec0 0x7fbe20140820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:27.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe286cf700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe20067000 con 0x7fbe2005ec40 2021-11-12T05:49:27.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe286cf700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe20066620 con 0x7fbe200b0be0 2021-11-12T05:49:27.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe286cf700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe200668c0 con 0x7fbe200b1ec0 2021-11-12T05:49:27.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe2646b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbe2005ec40 0x7fbe2012be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:27.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe2646b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbe2005ec40 0x7fbe2012be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51858/0 (socket says 172.21.2.105:51858) 2021-11-12T05:49:27.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe2646b700 1 -- 172.21.2.105:0/620377284 learned_addr learned my addr 172.21.2.105:0/620377284 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:27.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe2646b700 1 -- 172.21.2.105:0/620377284 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbe200b1ec0 msgr2=0x7fbe20140820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:27.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe2646b700 1 --2- 172.21.2.105:0/620377284 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbe200b1ec0 0x7fbe20140820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:27.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe2646b700 1 -- 172.21.2.105:0/620377284 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbe200b0be0 msgr2=0x7fbe20064e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:27.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe2646b700 1 --2- 172.21.2.105:0/620377284 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbe200b0be0 0x7fbe20064e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:27.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe2646b700 1 -- 172.21.2.105:0/620377284 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe18009530 con 0x7fbe2005ec40 2021-11-12T05:49:27.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.404+0000 7fbe2646b700 1 --2- 172.21.2.105:0/620377284 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbe2005ec40 0x7fbe2012be10 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7fbe1c002f70 tx=0x7fbe1c006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:27.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.408+0000 7fbe137fe700 1 -- 172.21.2.105:0/620377284 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe1c013460 con 0x7fbe2005ec40 2021-11-12T05:49:27.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.408+0000 7fbe137fe700 1 -- 172.21.2.105:0/620377284 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe1c0135c0 con 0x7fbe2005ec40 2021-11-12T05:49:27.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.408+0000 7fbe137fe700 1 -- 172.21.2.105:0/620377284 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe1c013920 con 0x7fbe2005ec40 2021-11-12T05:49:27.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.408+0000 7fbe286cf700 1 -- 172.21.2.105:0/620377284 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe20066b60 con 0x7fbe2005ec40 2021-11-12T05:49:27.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.408+0000 7fbe286cf700 1 -- 172.21.2.105:0/620377284 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe2012cb20 con 0x7fbe2005ec40 2021-11-12T05:49:27.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.408+0000 7fbe286cf700 1 -- 172.21.2.105:0/620377284 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe20057350 con 0x7fbe2005ec40 2021-11-12T05:49:27.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.408+0000 7fbe137fe700 1 -- 172.21.2.105:0/620377284 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbe1c00f070 con 0x7fbe2005ec40 2021-11-12T05:49:27.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.408+0000 7fbe137fe700 1 --2- 172.21.2.105:0/620377284 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbe000536a0 0x7fbe00055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:27.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.408+0000 7fbe137fe700 1 -- 172.21.2.105:0/620377284 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6502+0+0 (secure 0 0 0) 0x7fbe1c06b570 con 0x7fbe2005ec40 2021-11-12T05:49:27.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.408+0000 7fbe25c6a700 1 --2- 172.21.2.105:0/620377284 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbe000536a0 0x7fbe00055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:27.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.408+0000 7fbe25c6a700 1 --2- 172.21.2.105:0/620377284 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbe000536a0 0x7fbe00055b60 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7fbe14002f90 tx=0x7fbe140069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:27.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.412+0000 7fbe137fe700 1 -- 172.21.2.105:0/620377284 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbe1c042410 con 0x7fbe2005ec40 2021-11-12T05:49:27.521 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:27.516+0000 7fbe286cf700 1 -- 172.21.2.105:0/620377284 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbe20066cf0 con 0x7fbe2005ec40 2021-11-12T05:49:28.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.168+0000 7fbe137fe700 1 -- 172.21.2.105:0/620377284 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v67) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbe1c045a30 con 0x7fbe2005ec40 2021-11-12T05:49:28.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.168+0000 7fbe286cf700 1 -- 172.21.2.105:0/620377284 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbe000536a0 msgr2=0x7fbe00055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:28.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.168+0000 7fbe286cf700 1 --2- 172.21.2.105:0/620377284 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbe000536a0 0x7fbe00055b60 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7fbe14002f90 tx=0x7fbe140069b0).stop 2021-11-12T05:49:28.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.168+0000 7fbe286cf700 1 -- 172.21.2.105:0/620377284 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbe2005ec40 msgr2=0x7fbe2012be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:28.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.168+0000 7fbe286cf700 1 --2- 172.21.2.105:0/620377284 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbe2005ec40 0x7fbe2012be10 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7fbe1c002f70 tx=0x7fbe1c006ec0).stop 2021-11-12T05:49:28.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.168+0000 7fbe286cf700 1 -- 172.21.2.105:0/620377284 shutdown_connections 2021-11-12T05:49:28.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.168+0000 7fbe286cf700 1 --2- 172.21.2.105:0/620377284 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbe000536a0 0x7fbe00055b60 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:28.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.168+0000 7fbe286cf700 1 --2- 172.21.2.105:0/620377284 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbe200b1ec0 0x7fbe20140820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:28.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.168+0000 7fbe286cf700 1 --2- 172.21.2.105:0/620377284 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbe200b0be0 0x7fbe20064e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:28.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.168+0000 7fbe286cf700 1 --2- 172.21.2.105:0/620377284 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbe2005ec40 0x7fbe2012be10 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:28.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.168+0000 7fbe286cf700 1 -- 172.21.2.105:0/620377284 >> 172.21.2.105:0/620377284 conn(0x7fbe2005cb90 msgr2=0x7fbe2013f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:28.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.168+0000 7fbe286cf700 1 -- 172.21.2.105:0/620377284 shutdown_connections 2021-11-12T05:49:28.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.168+0000 7fbe286cf700 1 -- 172.21.2.105:0/620377284 wait complete. 2021-11-12T05:49:28.179 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-12T05:49:28.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.228+0000 7f2989c94700 1 Processor -- start 2021-11-12T05:49:28.234 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.228+0000 7f2989c94700 1 -- start start 2021-11-12T05:49:28.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.228+0000 7f2989c94700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f2984141190 0x7f2984141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:28.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.228+0000 7f2989c94700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29840aebb0 con 0x7f29840b0ea0 2021-11-12T05:49:28.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.228+0000 7f2989c94700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29840b1330 con 0x7f29840aff10 2021-11-12T05:49:28.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.228+0000 7f2989c94700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29840b5b90 con 0x7f2984141190 2021-11-12T05:49:28.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.228+0000 7f2983fff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f29840b0ea0 0x7f29840b5480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34032/0 (socket says 172.21.2.105:34032) 2021-11-12T05:49:28.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.228+0000 7f2983fff700 1 -- 172.21.2.105:0/3265138803 learned_addr learned my addr 172.21.2.105:0/3265138803 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:28.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f29827fc700 1 -- 172.21.2.105:0/3265138803 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4042967062 0 0) 0x7f29840aebb0 con 0x7f29840b0ea0 2021-11-12T05:49:28.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f29827fc700 1 -- 172.21.2.105:0/3265138803 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2964003260 con 0x7f29840b0ea0 2021-11-12T05:49:28.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f29837fe700 1 --2- 172.21.2.105:0/3265138803 >> v2:172.21.2.115:3300/0 conn(0x7f2984141190 0x7f2984141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:28.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f29827fc700 1 -- 172.21.2.105:0/3265138803 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1868487592 0 0) 0x7f2964003260 con 0x7f29840b0ea0 2021-11-12T05:49:28.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f29827fc700 1 -- 172.21.2.105:0/3265138803 >> v2:172.21.2.115:3300/0 conn(0x7f2984141190 msgr2=0x7f2984141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:28.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f29827fc700 1 --2- 172.21.2.105:0/3265138803 >> v2:172.21.2.115:3300/0 conn(0x7f2984141190 0x7f2984141570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:28.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f29827fc700 1 -- 172.21.2.105:0/3265138803 >> v1:172.21.2.115:6789/0 conn(0x7f29840aff10 legacy=0x7f29841473d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:28.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f29827fc700 1 -- 172.21.2.105:0/3265138803 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29840b15b0 con 0x7f29840b0ea0 2021-11-12T05:49:28.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f29827fc700 1 -- 172.21.2.105:0/3265138803 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f297c0019e0 con 0x7f29840b0ea0 2021-11-12T05:49:28.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f29827fc700 1 -- 172.21.2.105:0/3265138803 >> v1:172.21.2.105:6789/0 conn(0x7f29840b0ea0 legacy=0x7f29840b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:28.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f29827fc700 1 --2- 172.21.2.105:0/3265138803 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2964003820 0x7f2964003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:28.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f29827fc700 1 --2- 172.21.2.105:0/3265138803 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2964004500 0x7f2964004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:28.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f29827fc700 1 --2- 172.21.2.105:0/3265138803 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2964004f70 0x7f296400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:28.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f29827fc700 1 -- 172.21.2.105:0/3265138803 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29840b5b90 con 0x7f2964004f70 2021-11-12T05:49:28.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f29827fc700 1 -- 172.21.2.105:0/3265138803 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296400be50 con 0x7f2964004500 2021-11-12T05:49:28.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f29827fc700 1 -- 172.21.2.105:0/3265138803 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f296400c010 con 0x7f2964003820 2021-11-12T05:49:28.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f2983fff700 1 --2- 172.21.2.105:0/3265138803 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2964004f70 0x7f296400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:28.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f2982ffd700 1 --2- 172.21.2.105:0/3265138803 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2964004500 0x7f2964004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:28.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f2983fff700 1 -- 172.21.2.105:0/3265138803 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2964003820 msgr2=0x7f2964003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:28.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f2983fff700 1 --2- 172.21.2.105:0/3265138803 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2964003820 0x7f2964003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:28.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f2983fff700 1 -- 172.21.2.105:0/3265138803 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2964004500 msgr2=0x7f2964004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:28.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f2983fff700 1 --2- 172.21.2.105:0/3265138803 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2964004500 0x7f2964004980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:28.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f2983fff700 1 -- 172.21.2.105:0/3265138803 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2964003260 con 0x7f2964004f70 2021-11-12T05:49:28.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f2983fff700 1 -- 172.21.2.105:0/3265138803 reap_dead start 2021-11-12T05:49:28.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f2983fff700 1 --2- 172.21.2.105:0/3265138803 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2964004f70 0x7f296400b750 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 rx=0x7f298406a380 tx=0x7f29840ae2c0).ready entity=mon.0 client_cookie=29b7ea59ac163876 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:28.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f29827fc700 1 -- 172.21.2.105:0/3265138803 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f297c00cbe0 con 0x7f2964004f70 2021-11-12T05:49:28.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f29827fc700 1 -- 172.21.2.105:0/3265138803 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297c00cd40 con 0x7f2964004f70 2021-11-12T05:49:28.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f29827fc700 1 -- 172.21.2.105:0/3265138803 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f297c005b80 con 0x7f2964004f70 2021-11-12T05:49:28.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f2989c94700 1 -- 172.21.2.105:0/3265138803 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2964004f70 msgr2=0x7f296400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:28.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f2989c94700 1 --2- 172.21.2.105:0/3265138803 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2964004f70 0x7f296400b750 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 rx=0x7f298406a380 tx=0x7f29840ae2c0).stop 2021-11-12T05:49:28.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f2989c94700 1 -- 172.21.2.105:0/3265138803 shutdown_connections 2021-11-12T05:49:28.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f2989c94700 1 --2- 172.21.2.105:0/3265138803 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2964004f70 0x7f296400b750 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:28.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f2989c94700 1 -- 172.21.2.105:0/3265138803 >> 172.21.2.105:0/3265138803 conn(0x7f2984062570 msgr2=0x7f2984062950 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:28.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f2989c94700 1 -- 172.21.2.105:0/3265138803 shutdown_connections 2021-11-12T05:49:28.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f2989c94700 1 -- 172.21.2.105:0/3265138803 wait complete. 2021-11-12T05:49:28.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f2989c94700 1 Processor -- start 2021-11-12T05:49:28.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f2989c94700 1 -- start start 2021-11-12T05:49:28.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f2989c94700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2964004f70 0x7f2984141950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:28.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f2989c94700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2984063490 0x7f29840666f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:28.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f2989c94700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2984142ca0 0x7f2984066be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:28.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f2989c94700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2984063930 con 0x7f2984063490 2021-11-12T05:49:28.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f2989c94700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2984063bd0 con 0x7f2984142ca0 2021-11-12T05:49:28.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f2989c94700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2984063e70 con 0x7f2964004f70 2021-11-12T05:49:28.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f2982ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2984063490 0x7f29840666f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:28.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f2982ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2984063490 0x7f29840666f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51880/0 (socket says 172.21.2.105:51880) 2021-11-12T05:49:28.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f2982ffd700 1 -- 172.21.2.105:0/2106998032 learned_addr learned my addr 172.21.2.105:0/2106998032 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:28.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f2983fff700 1 --2- 172.21.2.105:0/2106998032 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2984142ca0 0x7f2984066be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:28.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f29837fe700 1 --2- 172.21.2.105:0/2106998032 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2964004f70 0x7f2984141950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:28.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f2982ffd700 1 -- 172.21.2.105:0/2106998032 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2964004f70 msgr2=0x7f2984141950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:28.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f2982ffd700 1 --2- 172.21.2.105:0/2106998032 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2964004f70 0x7f2984141950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:28.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f2982ffd700 1 -- 172.21.2.105:0/2106998032 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2984142ca0 msgr2=0x7f2984066be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:28.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f2982ffd700 1 --2- 172.21.2.105:0/2106998032 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2984142ca0 0x7f2984066be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:28.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f2982ffd700 1 -- 172.21.2.105:0/2106998032 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29840670d0 con 0x7f2984063490 2021-11-12T05:49:28.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f29837fe700 1 --2- 172.21.2.105:0/2106998032 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2964004f70 0x7f2984141950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:49:28.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f2982ffd700 1 --2- 172.21.2.105:0/2106998032 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2984063490 0x7f29840666f0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 rx=0x7f296c008000 tx=0x7f296c009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:28.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f2980ff9700 1 -- 172.21.2.105:0/2106998032 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f296c007e10 con 0x7f2984063490 2021-11-12T05:49:28.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f2980ff9700 1 -- 172.21.2.105:0/2106998032 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f296c000e90 con 0x7f2984063490 2021-11-12T05:49:28.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f2989c94700 1 -- 172.21.2.105:0/2106998032 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2984141e40 con 0x7f2984063490 2021-11-12T05:49:28.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.232+0000 7f2980ff9700 1 -- 172.21.2.105:0/2106998032 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f296c0106d0 con 0x7f2984063490 2021-11-12T05:49:28.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.236+0000 7f2989c94700 1 -- 172.21.2.105:0/2106998032 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2984159c90 con 0x7f2984063490 2021-11-12T05:49:28.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.236+0000 7f2989c94700 1 -- 172.21.2.105:0/2106998032 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29840adc80 con 0x7f2984063490 2021-11-12T05:49:28.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.236+0000 7f2980ff9700 1 -- 172.21.2.105:0/2106998032 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f296c010830 con 0x7f2984063490 2021-11-12T05:49:28.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.236+0000 7f2980ff9700 1 --2- 172.21.2.105:0/2106998032 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f29680536d0 0x7f2968055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:28.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.236+0000 7f2980ff9700 1 -- 172.21.2.105:0/2106998032 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f296c06b740 con 0x7f2984063490 2021-11-12T05:49:28.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.236+0000 7f29837fe700 1 --2- 172.21.2.105:0/2106998032 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f29680536d0 0x7f2968055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:28.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.236+0000 7f29837fe700 1 --2- 172.21.2.105:0/2106998032 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f29680536d0 0x7f2968055b90 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f297400c000 tx=0x7f2974008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:28.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.236+0000 7f2980ff9700 1 -- 172.21.2.105:0/2106998032 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f296c0426f0 con 0x7f2984063490 2021-11-12T05:49:28.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:28.320+0000 7f2989c94700 1 -- 172.21.2.105:0/2106998032 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2984057350 con 0x7f2984063490 2021-11-12T05:49:29.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.172+0000 7f2980ff9700 1 -- 172.21.2.105:0/2106998032 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v138) v1 ==== 185+0+0 (secure 0 0 0) 0x7f296c045d10 con 0x7f2984063490 2021-11-12T05:49:29.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.172+0000 7f2989c94700 1 -- 172.21.2.105:0/2106998032 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f29680536d0 msgr2=0x7f2968055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:29.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.172+0000 7f2989c94700 1 --2- 172.21.2.105:0/2106998032 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f29680536d0 0x7f2968055b90 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f297400c000 tx=0x7f2974008040).stop 2021-11-12T05:49:29.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.172+0000 7f2989c94700 1 -- 172.21.2.105:0/2106998032 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2984063490 msgr2=0x7f29840666f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:29.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.172+0000 7f2989c94700 1 --2- 172.21.2.105:0/2106998032 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2984063490 0x7f29840666f0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 rx=0x7f296c008000 tx=0x7f296c009040).stop 2021-11-12T05:49:29.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.172+0000 7f2989c94700 1 -- 172.21.2.105:0/2106998032 shutdown_connections 2021-11-12T05:49:29.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.172+0000 7f2989c94700 1 --2- 172.21.2.105:0/2106998032 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f29680536d0 0x7f2968055b90 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:29.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.172+0000 7f2989c94700 1 --2- 172.21.2.105:0/2106998032 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2984142ca0 0x7f2984066be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:29.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.172+0000 7f2989c94700 1 --2- 172.21.2.105:0/2106998032 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2984063490 0x7f29840666f0 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:29.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.172+0000 7f2989c94700 1 --2- 172.21.2.105:0/2106998032 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2964004f70 0x7f2984141950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:29.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.172+0000 7f2989c94700 1 -- 172.21.2.105:0/2106998032 >> 172.21.2.105:0/2106998032 conn(0x7f2984062570 msgr2=0x7f29840b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:29.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.172+0000 7f2989c94700 1 -- 172.21.2.105:0/2106998032 shutdown_connections 2021-11-12T05:49:29.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.172+0000 7f2989c94700 1 -- 172.21.2.105:0/2106998032 wait complete. 2021-11-12T05:49:29.181 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_metadata' removed 2021-11-12T05:49:29.184 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-12T05:49:29.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.232+0000 7f8ec75b6700 1 Processor -- start 2021-11-12T05:49:29.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.232+0000 7f8ec75b6700 1 -- start start 2021-11-12T05:49:29.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8ec75b6700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f8ec00aff10 0x7f8ec0141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:29.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8ec75b6700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ec00aebb0 con 0x7f8ec00b0ea0 2021-11-12T05:49:29.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8ec75b6700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ec00b5b90 con 0x7f8ec0141190 2021-11-12T05:49:29.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8ec75b6700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec00b15b0 con 0x7f8ec00aff10 2021-11-12T05:49:29.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8ec4b51700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f8ec00aff10 0x7f8ec0141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:29.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8ec5b53700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f8ec00b0ea0 0x7f8ec00b5480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34052/0 (socket says 172.21.2.105:34052) 2021-11-12T05:49:29.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8ec5b53700 1 -- 172.21.2.105:0/2642974681 learned_addr learned my addr 172.21.2.105:0/2642974681 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:29.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8ec4b51700 1 -- 172.21.2.105:0/2642974681 >> v1:172.21.2.115:6789/0 conn(0x7f8ec0141190 legacy=0x7f8ec01473d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:49:29.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8ec4b51700 1 -- 172.21.2.105:0/2642974681 >> v1:172.21.2.105:6789/0 conn(0x7f8ec00b0ea0 legacy=0x7f8ec00b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:29.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8ec4b51700 1 -- 172.21.2.105:0/2642974681 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec00b12d0 con 0x7f8ec00aff10 2021-11-12T05:49:29.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8ec4b51700 1 --2- 172.21.2.105:0/2642974681 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8ec00aff10 0x7f8ec0141570 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 rx=0x7f8ec0060210 tx=0x7f8ebc006df0).ready entity=mon.0 client_cookie=f4cb07e027bbb3fb server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:29.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8eaffff700 1 -- 172.21.2.105:0/2642974681 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ebc00d5c0 con 0x7f8ec00aff10 2021-11-12T05:49:29.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8eaffff700 1 -- 172.21.2.105:0/2642974681 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ebc000e90 con 0x7f8ec00aff10 2021-11-12T05:49:29.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8eaffff700 1 -- 172.21.2.105:0/2642974681 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ebc00d910 con 0x7f8ec00aff10 2021-11-12T05:49:29.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8ec75b6700 1 -- 172.21.2.105:0/2642974681 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8ec00aff10 msgr2=0x7f8ec0141570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:29.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8ec75b6700 1 --2- 172.21.2.105:0/2642974681 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8ec00aff10 0x7f8ec0141570 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 rx=0x7f8ec0060210 tx=0x7f8ebc006df0).stop 2021-11-12T05:49:29.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8ec75b6700 1 -- 172.21.2.105:0/2642974681 shutdown_connections 2021-11-12T05:49:29.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8ec75b6700 1 --2- 172.21.2.105:0/2642974681 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8ec00aff10 0x7f8ec0141570 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:29.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8ec75b6700 1 -- 172.21.2.105:0/2642974681 >> 172.21.2.105:0/2642974681 conn(0x7f8ec0062570 msgr2=0x7f8ec0062950 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:29.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8ec75b6700 1 -- 172.21.2.105:0/2642974681 shutdown_connections 2021-11-12T05:49:29.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8ec75b6700 1 -- 172.21.2.105:0/2642974681 wait complete. 2021-11-12T05:49:29.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8ec75b6700 1 Processor -- start 2021-11-12T05:49:29.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8ec75b6700 1 -- start start 2021-11-12T05:49:29.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8ec75b6700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8ec00aff10 0x7f8ec0143760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:29.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8ec75b6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8ec00b0ea0 0x7f8ec0159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:29.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8ec75b6700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8ec0141190 0x7f8ec00644c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:29.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8ec75b6700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec0142e70 con 0x7f8ec00b0ea0 2021-11-12T05:49:29.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8ec75b6700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec015a310 con 0x7f8ec00aff10 2021-11-12T05:49:29.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8ec75b6700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec0142bd0 con 0x7f8ec0141190 2021-11-12T05:49:29.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8ec4b51700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8ec00b0ea0 0x7f8ec0159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:29.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8ec4b51700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8ec00b0ea0 0x7f8ec0159e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51896/0 (socket says 172.21.2.105:51896) 2021-11-12T05:49:29.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8ec4b51700 1 -- 172.21.2.105:0/1325660016 learned_addr learned my addr 172.21.2.105:0/1325660016 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:29.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8ec4b51700 1 -- 172.21.2.105:0/1325660016 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8ec0141190 msgr2=0x7f8ec00644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:29.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8ec4b51700 1 --2- 172.21.2.105:0/1325660016 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8ec0141190 0x7f8ec00644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:29.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8ec4b51700 1 -- 172.21.2.105:0/1325660016 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8ec00aff10 msgr2=0x7f8ec0143760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:29.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8ec4b51700 1 --2- 172.21.2.105:0/1325660016 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8ec00aff10 0x7f8ec0143760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:29.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8ec4b51700 1 -- 172.21.2.105:0/1325660016 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ebc00b180 con 0x7f8ec00b0ea0 2021-11-12T05:49:29.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8ec4b51700 1 --2- 172.21.2.105:0/1325660016 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8ec00b0ea0 0x7f8ec0159e20 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 rx=0x7f8ec0060210 tx=0x7f8ebc012000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:29.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8eae7fc700 1 -- 172.21.2.105:0/1325660016 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ebc016070 con 0x7f8ec00b0ea0 2021-11-12T05:49:29.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8eae7fc700 1 -- 172.21.2.105:0/1325660016 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ebc002f50 con 0x7f8ec00b0ea0 2021-11-12T05:49:29.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8ec75b6700 1 -- 172.21.2.105:0/1325660016 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ec0064020 con 0x7f8ec00b0ea0 2021-11-12T05:49:29.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8ec75b6700 1 -- 172.21.2.105:0/1325660016 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec01424a0 con 0x7f8ec00b0ea0 2021-11-12T05:49:29.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.236+0000 7f8eae7fc700 1 -- 172.21.2.105:0/1325660016 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ebc01e450 con 0x7f8ec00b0ea0 2021-11-12T05:49:29.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.240+0000 7f8ec75b6700 1 -- 172.21.2.105:0/1325660016 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ec00641b0 con 0x7f8ec00b0ea0 2021-11-12T05:49:29.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.240+0000 7f8eae7fc700 1 -- 172.21.2.105:0/1325660016 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8ebc025030 con 0x7f8ec00b0ea0 2021-11-12T05:49:29.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.240+0000 7f8eae7fc700 1 --2- 172.21.2.105:0/1325660016 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8ea00536f0 0x7f8ea0055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:29.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.240+0000 7f8eae7fc700 1 -- 172.21.2.105:0/1325660016 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6064+0+0 (secure 0 0 0) 0x7f8ebc06cd30 con 0x7f8ec00b0ea0 2021-11-12T05:49:29.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.240+0000 7f8ec5352700 1 --2- 172.21.2.105:0/1325660016 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8ea00536f0 0x7f8ea0055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:29.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.240+0000 7f8ec5352700 1 --2- 172.21.2.105:0/1325660016 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8ea00536f0 0x7f8ea0055bb0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f8eb0002ef0 tx=0x7f8eb0006910).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:29.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.240+0000 7f8eae7fc700 1 -- 172.21.2.105:0/1325660016 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8ebc043d90 con 0x7f8ec00b0ea0 2021-11-12T05:49:29.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:29.328+0000 7f8ec75b6700 1 -- 172.21.2.105:0/1325660016 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8ec00b1850 con 0x7f8ec00b0ea0 2021-11-12T05:49:30.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.176+0000 7f8eae7fc700 1 -- 172.21.2.105:0/1325660016 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v139) v1 ==== 173+0+0 (secure 0 0 0) 0x7f8ebc023020 con 0x7f8ec00b0ea0 2021-11-12T05:49:30.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.180+0000 7f8ec75b6700 1 -- 172.21.2.105:0/1325660016 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8ea00536f0 msgr2=0x7f8ea0055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:30.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.180+0000 7f8ec75b6700 1 --2- 172.21.2.105:0/1325660016 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8ea00536f0 0x7f8ea0055bb0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f8eb0002ef0 tx=0x7f8eb0006910).stop 2021-11-12T05:49:30.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.180+0000 7f8ec75b6700 1 -- 172.21.2.105:0/1325660016 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8ec00b0ea0 msgr2=0x7f8ec0159e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:30.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.180+0000 7f8ec75b6700 1 --2- 172.21.2.105:0/1325660016 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8ec00b0ea0 0x7f8ec0159e20 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 rx=0x7f8ec0060210 tx=0x7f8ebc012000).stop 2021-11-12T05:49:30.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.180+0000 7f8ec75b6700 1 -- 172.21.2.105:0/1325660016 shutdown_connections 2021-11-12T05:49:30.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.180+0000 7f8ec75b6700 1 --2- 172.21.2.105:0/1325660016 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8ea00536f0 0x7f8ea0055bb0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:30.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.180+0000 7f8ec75b6700 1 --2- 172.21.2.105:0/1325660016 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8ec0141190 0x7f8ec00644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:30.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.180+0000 7f8ec75b6700 1 --2- 172.21.2.105:0/1325660016 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8ec00b0ea0 0x7f8ec0159e20 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:30.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.180+0000 7f8ec75b6700 1 --2- 172.21.2.105:0/1325660016 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8ec00aff10 0x7f8ec0143760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:30.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.180+0000 7f8ec75b6700 1 -- 172.21.2.105:0/1325660016 >> 172.21.2.105:0/1325660016 conn(0x7f8ec0062570 msgr2=0x7f8ec013e530 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:30.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.180+0000 7f8ec75b6700 1 -- 172.21.2.105:0/1325660016 shutdown_connections 2021-11-12T05:49:30.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.180+0000 7f8ec75b6700 1 -- 172.21.2.105:0/1325660016 wait complete. 2021-11-12T05:49:30.188 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_data' removed 2021-11-12T05:49:30.193 DEBUG:teuthology.orchestra.run.gibba005:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-12T05:49:30.196 DEBUG:teuthology.orchestra.run.gibba015:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-12T05:49:30.198 DEBUG:teuthology.orchestra.run.gibba016:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-12T05:49:30.201 DEBUG:teuthology.orchestra.run.gibba038:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-12T05:49:30.204 DEBUG:teuthology.orchestra.run.gibba044:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-11-12T05:49:30.208 INFO:teuthology.orchestra.run.gibba005.stdout:[global] 2021-11-12T05:49:30.208 INFO:teuthology.orchestra.run.gibba005.stdout: chdir = "" 2021-11-12T05:49:30.209 INFO:teuthology.orchestra.run.gibba005.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-12T05:49:30.209 INFO:teuthology.orchestra.run.gibba005.stdout: auth supported = cephx 2021-11-12T05:49:30.209 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:30.209 INFO:teuthology.orchestra.run.gibba005.stdout: filestore xattr use omap = true 2021-11-12T05:49:30.210 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:30.210 INFO:teuthology.orchestra.run.gibba005.stdout: mon clock drift allowed = 1.000 2021-11-12T05:49:30.210 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:30.210 INFO:teuthology.orchestra.run.gibba005.stdout: osd crush chooseleaf type = 0 2021-11-12T05:49:30.211 INFO:teuthology.orchestra.run.gibba005.stdout: auth debug = true 2021-11-12T05:49:30.211 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:30.211 INFO:teuthology.orchestra.run.gibba005.stdout: ms die on old message = true 2021-11-12T05:49:30.211 INFO:teuthology.orchestra.run.gibba005.stdout: ms die on bug = true 2021-11-12T05:49:30.211 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:30.212 INFO:teuthology.orchestra.run.gibba005.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-12T05:49:30.212 INFO:teuthology.orchestra.run.gibba005.stdout: mon pg warn max object skew = 0 2021-11-12T05:49:30.212 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:30.212 INFO:teuthology.orchestra.run.gibba005.stdout: # disable pg_autoscaler by default for new pools 2021-11-12T05:49:30.213 INFO:teuthology.orchestra.run.gibba005.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-12T05:49:30.213 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:30.213 INFO:teuthology.orchestra.run.gibba005.stdout: osd pool default size = 2 2021-11-12T05:49:30.213 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:30.213 INFO:teuthology.orchestra.run.gibba005.stdout: mon osd allow primary affinity = true 2021-11-12T05:49:30.214 INFO:teuthology.orchestra.run.gibba005.stdout: mon osd allow pg remap = true 2021-11-12T05:49:30.214 INFO:teuthology.orchestra.run.gibba005.stdout: mon warn on legacy crush tunables = false 2021-11-12T05:49:30.214 INFO:teuthology.orchestra.run.gibba005.stdout: mon warn on crush straw calc version zero = false 2021-11-12T05:49:30.214 INFO:teuthology.orchestra.run.gibba005.stdout: mon warn on no sortbitwise = false 2021-11-12T05:49:30.215 INFO:teuthology.orchestra.run.gibba005.stdout: mon warn on osd down out interval zero = false 2021-11-12T05:49:30.215 INFO:teuthology.orchestra.run.gibba005.stdout: mon warn on too few osds = false 2021-11-12T05:49:30.215 INFO:teuthology.orchestra.run.gibba005.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-12T05:49:30.215 INFO:teuthology.orchestra.run.gibba005.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-12T05:49:30.215 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:30.216 INFO:teuthology.orchestra.run.gibba005.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-12T05:49:30.216 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:30.216 INFO:teuthology.orchestra.run.gibba005.stdout: osd default data pool replay window = 5 2021-11-12T05:49:30.216 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:30.217 INFO:teuthology.orchestra.run.gibba005.stdout: mon allow pool delete = true 2021-11-12T05:49:30.217 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:30.217 INFO:teuthology.orchestra.run.gibba005.stdout: mon cluster log file level = debug 2021-11-12T05:49:30.217 INFO:teuthology.orchestra.run.gibba005.stdout: debug asserts on shutdown = true 2021-11-12T05:49:30.217 INFO:teuthology.orchestra.run.gibba005.stdout: mon health detail to clog = false 2021-11-12T05:49:30.218 INFO:teuthology.orchestra.run.gibba005.stdout: mon host = "172.21.2.105,172.21.2.115,[v2:172.21.2.115:3301,v1:172.21.2.115:6790]" 2021-11-12T05:49:30.218 INFO:teuthology.orchestra.run.gibba005.stdout: fsid = 22928e10-9f3c-479a-96ca-77d6ddf80f9f 2021-11-12T05:49:30.218 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:30.218 INFO:teuthology.orchestra.run.gibba005.stdout:[osd] 2021-11-12T05:49:30.219 INFO:teuthology.orchestra.run.gibba005.stdout: osd journal size = 100 2021-11-12T05:49:30.219 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:30.219 INFO:teuthology.orchestra.run.gibba005.stdout: osd scrub load threshold = 5.0 2021-11-12T05:49:30.219 INFO:teuthology.orchestra.run.gibba005.stdout: osd scrub max interval = 600 2021-11-12T05:49:30.219 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:30.220 INFO:teuthology.orchestra.run.gibba005.stdout: osd recover clone overlap = true 2021-11-12T05:49:30.220 INFO:teuthology.orchestra.run.gibba005.stdout: osd recovery max chunk = 1048576 2021-11-12T05:49:30.220 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:30.220 INFO:teuthology.orchestra.run.gibba005.stdout: osd debug shutdown = true 2021-11-12T05:49:30.221 INFO:teuthology.orchestra.run.gibba005.stdout: osd debug op order = true 2021-11-12T05:49:30.221 INFO:teuthology.orchestra.run.gibba005.stdout: osd debug verify stray on activate = true 2021-11-12T05:49:30.221 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:30.221 INFO:teuthology.orchestra.run.gibba005.stdout: osd open classes on start = true 2021-11-12T05:49:30.221 INFO:teuthology.orchestra.run.gibba005.stdout: osd debug pg log writeout = true 2021-11-12T05:49:30.222 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:30.222 INFO:teuthology.orchestra.run.gibba005.stdout: osd deep scrub update digest min age = 30 2021-11-12T05:49:30.222 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:30.222 INFO:teuthology.orchestra.run.gibba005.stdout: osd map max advance = 10 2021-11-12T05:49:30.223 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:30.223 INFO:teuthology.orchestra.run.gibba005.stdout: journal zero on create = true 2021-11-12T05:49:30.223 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:30.223 INFO:teuthology.orchestra.run.gibba005.stdout: filestore ondisk finisher threads = 3 2021-11-12T05:49:30.223 INFO:teuthology.orchestra.run.gibba005.stdout: filestore apply finisher threads = 3 2021-11-12T05:49:30.224 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:30.224 INFO:teuthology.orchestra.run.gibba005.stdout: bdev debug aio = true 2021-11-12T05:49:30.224 INFO:teuthology.orchestra.run.gibba005.stdout: osd debug misdirected ops = true 2021-11-12T05:49:30.224 INFO:teuthology.orchestra.run.gibba005.stdout: bluestore block size = 96636764160 2021-11-12T05:49:30.225 INFO:teuthology.orchestra.run.gibba005.stdout: bluestore compression mode = aggressive 2021-11-12T05:49:30.225 INFO:teuthology.orchestra.run.gibba005.stdout: bluestore fsck on mount = True 2021-11-12T05:49:30.225 INFO:teuthology.orchestra.run.gibba005.stdout: debug bluefs = 20 2021-11-12T05:49:30.225 INFO:teuthology.orchestra.run.gibba005.stdout: debug bluestore = 20 2021-11-12T05:49:30.225 INFO:teuthology.orchestra.run.gibba005.stdout: debug ms = 1 2021-11-12T05:49:30.226 INFO:teuthology.orchestra.run.gibba005.stdout: debug osd = 20 2021-11-12T05:49:30.226 INFO:teuthology.orchestra.run.gibba005.stdout: debug rocksdb = 10 2021-11-12T05:49:30.226 INFO:teuthology.orchestra.run.gibba005.stdout: mon osd backfillfull_ratio = 0.85 2021-11-12T05:49:30.226 INFO:teuthology.orchestra.run.gibba005.stdout: mon osd full ratio = 0.9 2021-11-12T05:49:30.226 INFO:teuthology.orchestra.run.gibba005.stdout: mon osd nearfull ratio = 0.8 2021-11-12T05:49:30.227 INFO:teuthology.orchestra.run.gibba005.stdout: osd failsafe full ratio = 0.95 2021-11-12T05:49:30.227 INFO:teuthology.orchestra.run.gibba005.stdout: osd objectstore = bluestore 2021-11-12T05:49:30.227 INFO:teuthology.orchestra.run.gibba005.stdout: osd op complaint time = 180 2021-11-12T05:49:30.227 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:30.227 INFO:teuthology.orchestra.run.gibba005.stdout:[mgr] 2021-11-12T05:49:30.228 INFO:teuthology.orchestra.run.gibba005.stdout: debug ms = 1 2021-11-12T05:49:30.228 INFO:teuthology.orchestra.run.gibba005.stdout: debug mgr = 20 2021-11-12T05:49:30.228 INFO:teuthology.orchestra.run.gibba005.stdout: debug mon = 20 2021-11-12T05:49:30.228 INFO:teuthology.orchestra.run.gibba005.stdout: debug auth = 20 2021-11-12T05:49:30.229 INFO:teuthology.orchestra.run.gibba005.stdout: mon reweight min pgs per osd = 4 2021-11-12T05:49:30.229 INFO:teuthology.orchestra.run.gibba005.stdout: mon reweight min bytes per osd = 10 2021-11-12T05:49:30.229 INFO:teuthology.orchestra.run.gibba005.stdout: mgr/telemetry/nag = false 2021-11-12T05:49:30.229 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:30.229 INFO:teuthology.orchestra.run.gibba005.stdout:[mon] 2021-11-12T05:49:30.229 INFO:teuthology.orchestra.run.gibba005.stdout: debug ms = 1 2021-11-12T05:49:30.230 INFO:teuthology.orchestra.run.gibba005.stdout: debug mon = 20 2021-11-12T05:49:30.230 INFO:teuthology.orchestra.run.gibba005.stdout: debug paxos = 20 2021-11-12T05:49:30.230 INFO:teuthology.orchestra.run.gibba005.stdout: debug auth = 20 2021-11-12T05:49:30.230 INFO:teuthology.orchestra.run.gibba005.stdout: mon data avail warn = 5 2021-11-12T05:49:30.231 INFO:teuthology.orchestra.run.gibba005.stdout: mon mgr mkfs grace = 240 2021-11-12T05:49:30.231 INFO:teuthology.orchestra.run.gibba005.stdout: mon reweight min pgs per osd = 4 2021-11-12T05:49:30.231 INFO:teuthology.orchestra.run.gibba005.stdout: mon osd reporter subtree level = osd 2021-11-12T05:49:30.231 INFO:teuthology.orchestra.run.gibba005.stdout: mon osd prime pg temp = true 2021-11-12T05:49:30.231 INFO:teuthology.orchestra.run.gibba005.stdout: mon reweight min bytes per osd = 10 2021-11-12T05:49:30.232 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:30.232 INFO:teuthology.orchestra.run.gibba005.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-12T05:49:30.232 INFO:teuthology.orchestra.run.gibba005.stdout: auth mon ticket ttl = 660 # 11m 2021-11-12T05:49:30.232 INFO:teuthology.orchestra.run.gibba005.stdout: auth service ticket ttl = 240 # 4m 2021-11-12T05:49:30.232 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:30.233 INFO:teuthology.orchestra.run.gibba005.stdout: # don't complain about insecure global_id in the test suite 2021-11-12T05:49:30.233 INFO:teuthology.orchestra.run.gibba005.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-12T05:49:30.233 INFO:teuthology.orchestra.run.gibba005.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-12T05:49:30.233 INFO:teuthology.orchestra.run.gibba005.stdout: mon op complaint time = 120 2021-11-12T05:49:30.233 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:30.234 INFO:teuthology.orchestra.run.gibba005.stdout:[client] 2021-11-12T05:49:30.234 INFO:teuthology.orchestra.run.gibba005.stdout: rgw cache enabled = true 2021-11-12T05:49:30.234 INFO:teuthology.orchestra.run.gibba005.stdout: rgw enable ops log = true 2021-11-12T05:49:30.234 INFO:teuthology.orchestra.run.gibba005.stdout: rgw enable usage log = true 2021-11-12T05:49:30.235 INFO:teuthology.orchestra.run.gibba005.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-12T05:49:30.235 INFO:teuthology.orchestra.run.gibba005.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-12T05:49:30.235 INFO:teuthology.orchestra.run.gibba005.stdout: client mount timeout = 600 2021-11-12T05:49:30.235 INFO:teuthology.orchestra.run.gibba005.stdout: debug client = 20 2021-11-12T05:49:30.235 INFO:teuthology.orchestra.run.gibba005.stdout: debug ms = 1 2021-11-12T05:49:30.236 INFO:teuthology.orchestra.run.gibba005.stdout: rados mon op timeout = 15m 2021-11-12T05:49:30.236 INFO:teuthology.orchestra.run.gibba005.stdout: rados osd op timeout = 15m 2021-11-12T05:49:30.236 INFO:teuthology.orchestra.run.gibba005.stdout:[mon.a] 2021-11-12T05:49:30.236 INFO:teuthology.orchestra.run.gibba005.stdout:[mon.b] 2021-11-12T05:49:30.237 INFO:teuthology.orchestra.run.gibba005.stdout:[mon.c] 2021-11-12T05:49:30.237 INFO:teuthology.orchestra.run.gibba005.stdout:[mds.a] 2021-11-12T05:49:30.237 INFO:teuthology.orchestra.run.gibba005.stdout:[mds.b] 2021-11-12T05:49:30.237 INFO:teuthology.orchestra.run.gibba005.stdout:[mds] 2021-11-12T05:49:30.237 INFO:teuthology.orchestra.run.gibba005.stdout: debug mds = 20 2021-11-12T05:49:30.238 INFO:teuthology.orchestra.run.gibba005.stdout: debug ms = 1 2021-11-12T05:49:30.238 INFO:teuthology.orchestra.run.gibba005.stdout: mds bal frag = True 2021-11-12T05:49:30.238 INFO:teuthology.orchestra.run.gibba005.stdout: mds bal fragment size max = 10000 2021-11-12T05:49:30.238 INFO:teuthology.orchestra.run.gibba005.stdout: mds bal merge size = 5 2021-11-12T05:49:30.238 INFO:teuthology.orchestra.run.gibba005.stdout: mds bal split bits = 3 2021-11-12T05:49:30.239 INFO:teuthology.orchestra.run.gibba005.stdout: mds bal split size = 100 2021-11-12T05:49:30.239 INFO:teuthology.orchestra.run.gibba005.stdout: mds debug frag = True 2021-11-12T05:49:30.239 INFO:teuthology.orchestra.run.gibba005.stdout: mds debug scatterstat = True 2021-11-12T05:49:30.239 INFO:teuthology.orchestra.run.gibba005.stdout: mds op complaint time = 180 2021-11-12T05:49:30.240 INFO:teuthology.orchestra.run.gibba005.stdout: mds verify scatter = True 2021-11-12T05:49:30.240 INFO:teuthology.orchestra.run.gibba005.stdout: osd op complaint time = 180 2021-11-12T05:49:30.240 INFO:teuthology.orchestra.run.gibba005.stdout: rados mon op timeout = 15m 2021-11-12T05:49:30.240 INFO:teuthology.orchestra.run.gibba005.stdout: rados osd op timeout = 15m 2021-11-12T05:49:30.240 INFO:teuthology.orchestra.run.gibba015.stdout:[global] 2021-11-12T05:49:30.241 INFO:teuthology.orchestra.run.gibba015.stdout: chdir = "" 2021-11-12T05:49:30.241 INFO:teuthology.orchestra.run.gibba015.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-12T05:49:30.241 INFO:teuthology.orchestra.run.gibba015.stdout: auth supported = cephx 2021-11-12T05:49:30.241 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:30.242 INFO:teuthology.orchestra.run.gibba015.stdout: filestore xattr use omap = true 2021-11-12T05:49:30.242 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:30.242 INFO:teuthology.orchestra.run.gibba015.stdout: mon clock drift allowed = 1.000 2021-11-12T05:49:30.242 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:30.243 INFO:teuthology.orchestra.run.gibba015.stdout: osd crush chooseleaf type = 0 2021-11-12T05:49:30.243 INFO:teuthology.orchestra.run.gibba015.stdout: auth debug = true 2021-11-12T05:49:30.243 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:30.243 INFO:teuthology.orchestra.run.gibba015.stdout: ms die on old message = true 2021-11-12T05:49:30.243 INFO:teuthology.orchestra.run.gibba015.stdout: ms die on bug = true 2021-11-12T05:49:30.244 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:30.244 INFO:teuthology.orchestra.run.gibba015.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-12T05:49:30.244 INFO:teuthology.orchestra.run.gibba015.stdout: mon pg warn max object skew = 0 2021-11-12T05:49:30.244 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:30.244 INFO:teuthology.orchestra.run.gibba015.stdout: # disable pg_autoscaler by default for new pools 2021-11-12T05:49:30.245 INFO:teuthology.orchestra.run.gibba015.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-12T05:49:30.245 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:30.245 INFO:teuthology.orchestra.run.gibba015.stdout: osd pool default size = 2 2021-11-12T05:49:30.245 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:30.246 INFO:teuthology.orchestra.run.gibba015.stdout: mon osd allow primary affinity = true 2021-11-12T05:49:30.246 INFO:teuthology.orchestra.run.gibba015.stdout: mon osd allow pg remap = true 2021-11-12T05:49:30.246 INFO:teuthology.orchestra.run.gibba015.stdout: mon warn on legacy crush tunables = false 2021-11-12T05:49:30.246 INFO:teuthology.orchestra.run.gibba015.stdout: mon warn on crush straw calc version zero = false 2021-11-12T05:49:30.246 INFO:teuthology.orchestra.run.gibba015.stdout: mon warn on no sortbitwise = false 2021-11-12T05:49:30.247 INFO:teuthology.orchestra.run.gibba015.stdout: mon warn on osd down out interval zero = false 2021-11-12T05:49:30.247 INFO:teuthology.orchestra.run.gibba015.stdout: mon warn on too few osds = false 2021-11-12T05:49:30.247 INFO:teuthology.orchestra.run.gibba015.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-12T05:49:30.247 INFO:teuthology.orchestra.run.gibba015.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-12T05:49:30.248 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:30.248 INFO:teuthology.orchestra.run.gibba015.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-12T05:49:30.248 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:30.248 INFO:teuthology.orchestra.run.gibba015.stdout: osd default data pool replay window = 5 2021-11-12T05:49:30.248 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:30.249 INFO:teuthology.orchestra.run.gibba015.stdout: mon allow pool delete = true 2021-11-12T05:49:30.249 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:30.249 INFO:teuthology.orchestra.run.gibba015.stdout: mon cluster log file level = debug 2021-11-12T05:49:30.249 INFO:teuthology.orchestra.run.gibba015.stdout: debug asserts on shutdown = true 2021-11-12T05:49:30.249 INFO:teuthology.orchestra.run.gibba015.stdout: mon health detail to clog = false 2021-11-12T05:49:30.250 INFO:teuthology.orchestra.run.gibba015.stdout: mon host = "172.21.2.105,172.21.2.115,[v2:172.21.2.115:3301,v1:172.21.2.115:6790]" 2021-11-12T05:49:30.250 INFO:teuthology.orchestra.run.gibba015.stdout: fsid = 22928e10-9f3c-479a-96ca-77d6ddf80f9f 2021-11-12T05:49:30.250 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:30.250 INFO:teuthology.orchestra.run.gibba015.stdout:[osd] 2021-11-12T05:49:30.250 INFO:teuthology.orchestra.run.gibba015.stdout: osd journal size = 100 2021-11-12T05:49:30.251 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:30.251 INFO:teuthology.orchestra.run.gibba015.stdout: osd scrub load threshold = 5.0 2021-11-12T05:49:30.251 INFO:teuthology.orchestra.run.gibba015.stdout: osd scrub max interval = 600 2021-11-12T05:49:30.251 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:30.252 INFO:teuthology.orchestra.run.gibba015.stdout: osd recover clone overlap = true 2021-11-12T05:49:30.252 INFO:teuthology.orchestra.run.gibba015.stdout: osd recovery max chunk = 1048576 2021-11-12T05:49:30.252 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:30.252 INFO:teuthology.orchestra.run.gibba015.stdout: osd debug shutdown = true 2021-11-12T05:49:30.252 INFO:teuthology.orchestra.run.gibba015.stdout: osd debug op order = true 2021-11-12T05:49:30.253 INFO:teuthology.orchestra.run.gibba015.stdout: osd debug verify stray on activate = true 2021-11-12T05:49:30.253 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:30.253 INFO:teuthology.orchestra.run.gibba015.stdout: osd open classes on start = true 2021-11-12T05:49:30.253 INFO:teuthology.orchestra.run.gibba015.stdout: osd debug pg log writeout = true 2021-11-12T05:49:30.253 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:30.254 INFO:teuthology.orchestra.run.gibba015.stdout: osd deep scrub update digest min age = 30 2021-11-12T05:49:30.254 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:30.254 INFO:teuthology.orchestra.run.gibba015.stdout: osd map max advance = 10 2021-11-12T05:49:30.254 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:30.254 INFO:teuthology.orchestra.run.gibba015.stdout: journal zero on create = true 2021-11-12T05:49:30.255 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:30.255 INFO:teuthology.orchestra.run.gibba015.stdout: filestore ondisk finisher threads = 3 2021-11-12T05:49:30.255 INFO:teuthology.orchestra.run.gibba015.stdout: filestore apply finisher threads = 3 2021-11-12T05:49:30.255 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:30.256 INFO:teuthology.orchestra.run.gibba015.stdout: bdev debug aio = true 2021-11-12T05:49:30.256 INFO:teuthology.orchestra.run.gibba015.stdout: osd debug misdirected ops = true 2021-11-12T05:49:30.256 INFO:teuthology.orchestra.run.gibba015.stdout: bluestore block size = 96636764160 2021-11-12T05:49:30.256 INFO:teuthology.orchestra.run.gibba015.stdout: bluestore compression mode = aggressive 2021-11-12T05:49:30.256 INFO:teuthology.orchestra.run.gibba015.stdout: bluestore fsck on mount = True 2021-11-12T05:49:30.257 INFO:teuthology.orchestra.run.gibba015.stdout: debug bluefs = 20 2021-11-12T05:49:30.257 INFO:teuthology.orchestra.run.gibba015.stdout: debug bluestore = 20 2021-11-12T05:49:30.257 INFO:teuthology.orchestra.run.gibba015.stdout: debug ms = 1 2021-11-12T05:49:30.257 INFO:teuthology.orchestra.run.gibba015.stdout: debug osd = 20 2021-11-12T05:49:30.257 INFO:teuthology.orchestra.run.gibba015.stdout: debug rocksdb = 10 2021-11-12T05:49:30.258 INFO:teuthology.orchestra.run.gibba015.stdout: mon osd backfillfull_ratio = 0.85 2021-11-12T05:49:30.258 INFO:teuthology.orchestra.run.gibba015.stdout: mon osd full ratio = 0.9 2021-11-12T05:49:30.258 INFO:teuthology.orchestra.run.gibba015.stdout: mon osd nearfull ratio = 0.8 2021-11-12T05:49:30.258 INFO:teuthology.orchestra.run.gibba015.stdout: osd failsafe full ratio = 0.95 2021-11-12T05:49:30.258 INFO:teuthology.orchestra.run.gibba015.stdout: osd objectstore = bluestore 2021-11-12T05:49:30.259 INFO:teuthology.orchestra.run.gibba015.stdout: osd op complaint time = 180 2021-11-12T05:49:30.259 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:30.259 INFO:teuthology.orchestra.run.gibba015.stdout:[mgr] 2021-11-12T05:49:30.259 INFO:teuthology.orchestra.run.gibba015.stdout: debug ms = 1 2021-11-12T05:49:30.259 INFO:teuthology.orchestra.run.gibba015.stdout: debug mgr = 20 2021-11-12T05:49:30.260 INFO:teuthology.orchestra.run.gibba015.stdout: debug mon = 20 2021-11-12T05:49:30.260 INFO:teuthology.orchestra.run.gibba015.stdout: debug auth = 20 2021-11-12T05:49:30.260 INFO:teuthology.orchestra.run.gibba015.stdout: mon reweight min pgs per osd = 4 2021-11-12T05:49:30.260 INFO:teuthology.orchestra.run.gibba015.stdout: mon reweight min bytes per osd = 10 2021-11-12T05:49:30.260 INFO:teuthology.orchestra.run.gibba015.stdout: mgr/telemetry/nag = false 2021-11-12T05:49:30.261 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:30.261 INFO:teuthology.orchestra.run.gibba015.stdout:[mon] 2021-11-12T05:49:30.261 INFO:teuthology.orchestra.run.gibba015.stdout: debug ms = 1 2021-11-12T05:49:30.261 INFO:teuthology.orchestra.run.gibba015.stdout: debug mon = 20 2021-11-12T05:49:30.261 INFO:teuthology.orchestra.run.gibba015.stdout: debug paxos = 20 2021-11-12T05:49:30.262 INFO:teuthology.orchestra.run.gibba015.stdout: debug auth = 20 2021-11-12T05:49:30.262 INFO:teuthology.orchestra.run.gibba015.stdout: mon data avail warn = 5 2021-11-12T05:49:30.262 INFO:teuthology.orchestra.run.gibba015.stdout: mon mgr mkfs grace = 240 2021-11-12T05:49:30.262 INFO:teuthology.orchestra.run.gibba015.stdout: mon reweight min pgs per osd = 4 2021-11-12T05:49:30.262 INFO:teuthology.orchestra.run.gibba015.stdout: mon osd reporter subtree level = osd 2021-11-12T05:49:30.263 INFO:teuthology.orchestra.run.gibba015.stdout: mon osd prime pg temp = true 2021-11-12T05:49:30.263 INFO:teuthology.orchestra.run.gibba015.stdout: mon reweight min bytes per osd = 10 2021-11-12T05:49:30.263 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:30.263 INFO:teuthology.orchestra.run.gibba015.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-12T05:49:30.264 INFO:teuthology.orchestra.run.gibba015.stdout: auth mon ticket ttl = 660 # 11m 2021-11-12T05:49:30.264 INFO:teuthology.orchestra.run.gibba015.stdout: auth service ticket ttl = 240 # 4m 2021-11-12T05:49:30.264 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:30.264 INFO:teuthology.orchestra.run.gibba015.stdout: # don't complain about insecure global_id in the test suite 2021-11-12T05:49:30.264 INFO:teuthology.orchestra.run.gibba015.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-12T05:49:30.265 INFO:teuthology.orchestra.run.gibba015.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-12T05:49:30.265 INFO:teuthology.orchestra.run.gibba015.stdout: mon op complaint time = 120 2021-11-12T05:49:30.265 INFO:teuthology.orchestra.run.gibba015.stdout: 2021-11-12T05:49:30.265 INFO:teuthology.orchestra.run.gibba015.stdout:[client] 2021-11-12T05:49:30.265 INFO:teuthology.orchestra.run.gibba015.stdout: rgw cache enabled = true 2021-11-12T05:49:30.266 INFO:teuthology.orchestra.run.gibba015.stdout: rgw enable ops log = true 2021-11-12T05:49:30.266 INFO:teuthology.orchestra.run.gibba015.stdout: rgw enable usage log = true 2021-11-12T05:49:30.266 INFO:teuthology.orchestra.run.gibba015.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-12T05:49:30.266 INFO:teuthology.orchestra.run.gibba015.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-12T05:49:30.267 INFO:teuthology.orchestra.run.gibba015.stdout: client mount timeout = 600 2021-11-12T05:49:30.267 INFO:teuthology.orchestra.run.gibba015.stdout: debug client = 20 2021-11-12T05:49:30.267 INFO:teuthology.orchestra.run.gibba015.stdout: debug ms = 1 2021-11-12T05:49:30.267 INFO:teuthology.orchestra.run.gibba015.stdout: rados mon op timeout = 15m 2021-11-12T05:49:30.267 INFO:teuthology.orchestra.run.gibba015.stdout: rados osd op timeout = 15m 2021-11-12T05:49:30.268 INFO:teuthology.orchestra.run.gibba015.stdout:[mon.a] 2021-11-12T05:49:30.268 INFO:teuthology.orchestra.run.gibba015.stdout:[mon.b] 2021-11-12T05:49:30.268 INFO:teuthology.orchestra.run.gibba015.stdout:[mon.c] 2021-11-12T05:49:30.268 INFO:teuthology.orchestra.run.gibba015.stdout:[mds.a] 2021-11-12T05:49:30.268 INFO:teuthology.orchestra.run.gibba015.stdout:[mds.b] 2021-11-12T05:49:30.269 INFO:teuthology.orchestra.run.gibba015.stdout:[mds] 2021-11-12T05:49:30.269 INFO:teuthology.orchestra.run.gibba015.stdout: debug mds = 20 2021-11-12T05:49:30.269 INFO:teuthology.orchestra.run.gibba015.stdout: debug ms = 1 2021-11-12T05:49:30.269 INFO:teuthology.orchestra.run.gibba015.stdout: mds bal frag = True 2021-11-12T05:49:30.270 INFO:teuthology.orchestra.run.gibba015.stdout: mds bal fragment size max = 10000 2021-11-12T05:49:30.270 INFO:teuthology.orchestra.run.gibba015.stdout: mds bal merge size = 5 2021-11-12T05:49:30.270 INFO:teuthology.orchestra.run.gibba015.stdout: mds bal split bits = 3 2021-11-12T05:49:30.270 INFO:teuthology.orchestra.run.gibba015.stdout: mds bal split size = 100 2021-11-12T05:49:30.270 INFO:teuthology.orchestra.run.gibba015.stdout: mds debug frag = True 2021-11-12T05:49:30.271 INFO:teuthology.orchestra.run.gibba015.stdout: mds debug scatterstat = True 2021-11-12T05:49:30.271 INFO:teuthology.orchestra.run.gibba015.stdout: mds op complaint time = 180 2021-11-12T05:49:30.271 INFO:teuthology.orchestra.run.gibba015.stdout: mds verify scatter = True 2021-11-12T05:49:30.271 INFO:teuthology.orchestra.run.gibba015.stdout: osd op complaint time = 180 2021-11-12T05:49:30.271 INFO:teuthology.orchestra.run.gibba015.stdout: rados mon op timeout = 15m 2021-11-12T05:49:30.272 INFO:teuthology.orchestra.run.gibba015.stdout: rados osd op timeout = 15m 2021-11-12T05:49:30.275 INFO:teuthology.orchestra.run.gibba044.stdout:[global] 2021-11-12T05:49:30.275 INFO:teuthology.orchestra.run.gibba044.stdout: chdir = "" 2021-11-12T05:49:30.276 INFO:teuthology.orchestra.run.gibba044.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-12T05:49:30.276 INFO:teuthology.orchestra.run.gibba044.stdout: auth supported = cephx 2021-11-12T05:49:30.276 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:30.276 INFO:teuthology.orchestra.run.gibba044.stdout: filestore xattr use omap = true 2021-11-12T05:49:30.277 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:30.277 INFO:teuthology.orchestra.run.gibba044.stdout: mon clock drift allowed = 1.000 2021-11-12T05:49:30.277 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:30.277 INFO:teuthology.orchestra.run.gibba044.stdout: osd crush chooseleaf type = 0 2021-11-12T05:49:30.278 INFO:teuthology.orchestra.run.gibba044.stdout: auth debug = true 2021-11-12T05:49:30.278 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:30.278 INFO:teuthology.orchestra.run.gibba044.stdout: ms die on old message = true 2021-11-12T05:49:30.278 INFO:teuthology.orchestra.run.gibba044.stdout: ms die on bug = true 2021-11-12T05:49:30.278 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:30.279 INFO:teuthology.orchestra.run.gibba044.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-12T05:49:30.279 INFO:teuthology.orchestra.run.gibba044.stdout: mon pg warn max object skew = 0 2021-11-12T05:49:30.279 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:30.279 INFO:teuthology.orchestra.run.gibba044.stdout: # disable pg_autoscaler by default for new pools 2021-11-12T05:49:30.279 INFO:teuthology.orchestra.run.gibba044.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-12T05:49:30.280 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:30.280 INFO:teuthology.orchestra.run.gibba044.stdout: osd pool default size = 2 2021-11-12T05:49:30.280 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:30.280 INFO:teuthology.orchestra.run.gibba044.stdout: mon osd allow primary affinity = true 2021-11-12T05:49:30.281 INFO:teuthology.orchestra.run.gibba044.stdout: mon osd allow pg remap = true 2021-11-12T05:49:30.281 INFO:teuthology.orchestra.run.gibba044.stdout: mon warn on legacy crush tunables = false 2021-11-12T05:49:30.281 INFO:teuthology.orchestra.run.gibba044.stdout: mon warn on crush straw calc version zero = false 2021-11-12T05:49:30.281 INFO:teuthology.orchestra.run.gibba044.stdout: mon warn on no sortbitwise = false 2021-11-12T05:49:30.281 INFO:teuthology.orchestra.run.gibba044.stdout: mon warn on osd down out interval zero = false 2021-11-12T05:49:30.282 INFO:teuthology.orchestra.run.gibba044.stdout: mon warn on too few osds = false 2021-11-12T05:49:30.282 INFO:teuthology.orchestra.run.gibba044.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-12T05:49:30.282 INFO:teuthology.orchestra.run.gibba044.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-12T05:49:30.282 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:30.283 INFO:teuthology.orchestra.run.gibba044.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-12T05:49:30.283 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:30.283 INFO:teuthology.orchestra.run.gibba044.stdout: osd default data pool replay window = 5 2021-11-12T05:49:30.283 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:30.283 INFO:teuthology.orchestra.run.gibba044.stdout: mon allow pool delete = true 2021-11-12T05:49:30.284 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:30.284 INFO:teuthology.orchestra.run.gibba044.stdout: mon cluster log file level = debug 2021-11-12T05:49:30.284 INFO:teuthology.orchestra.run.gibba044.stdout: debug asserts on shutdown = true 2021-11-12T05:49:30.284 INFO:teuthology.orchestra.run.gibba044.stdout: mon health detail to clog = false 2021-11-12T05:49:30.285 INFO:teuthology.orchestra.run.gibba044.stdout: mon host = "172.21.2.105,172.21.2.115,[v2:172.21.2.115:3301,v1:172.21.2.115:6790]" 2021-11-12T05:49:30.285 INFO:teuthology.orchestra.run.gibba044.stdout: fsid = 22928e10-9f3c-479a-96ca-77d6ddf80f9f 2021-11-12T05:49:30.285 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:30.285 INFO:teuthology.orchestra.run.gibba044.stdout:[osd] 2021-11-12T05:49:30.285 INFO:teuthology.orchestra.run.gibba044.stdout: osd journal size = 100 2021-11-12T05:49:30.286 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:30.286 INFO:teuthology.orchestra.run.gibba044.stdout: osd scrub load threshold = 5.0 2021-11-12T05:49:30.286 INFO:teuthology.orchestra.run.gibba044.stdout: osd scrub max interval = 600 2021-11-12T05:49:30.286 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:30.286 INFO:teuthology.orchestra.run.gibba044.stdout: osd recover clone overlap = true 2021-11-12T05:49:30.287 INFO:teuthology.orchestra.run.gibba044.stdout: osd recovery max chunk = 1048576 2021-11-12T05:49:30.287 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:30.287 INFO:teuthology.orchestra.run.gibba044.stdout: osd debug shutdown = true 2021-11-12T05:49:30.287 INFO:teuthology.orchestra.run.gibba044.stdout: osd debug op order = true 2021-11-12T05:49:30.287 INFO:teuthology.orchestra.run.gibba044.stdout: osd debug verify stray on activate = true 2021-11-12T05:49:30.288 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:30.288 INFO:teuthology.orchestra.run.gibba044.stdout: osd open classes on start = true 2021-11-12T05:49:30.288 INFO:teuthology.orchestra.run.gibba044.stdout: osd debug pg log writeout = true 2021-11-12T05:49:30.288 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:30.289 INFO:teuthology.orchestra.run.gibba044.stdout: osd deep scrub update digest min age = 30 2021-11-12T05:49:30.289 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:30.289 INFO:teuthology.orchestra.run.gibba044.stdout: osd map max advance = 10 2021-11-12T05:49:30.289 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:30.289 INFO:teuthology.orchestra.run.gibba044.stdout: journal zero on create = true 2021-11-12T05:49:30.290 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:30.290 INFO:teuthology.orchestra.run.gibba044.stdout: filestore ondisk finisher threads = 3 2021-11-12T05:49:30.290 INFO:teuthology.orchestra.run.gibba044.stdout: filestore apply finisher threads = 3 2021-11-12T05:49:30.290 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:30.291 INFO:teuthology.orchestra.run.gibba044.stdout: bdev debug aio = true 2021-11-12T05:49:30.291 INFO:teuthology.orchestra.run.gibba044.stdout: osd debug misdirected ops = true 2021-11-12T05:49:30.291 INFO:teuthology.orchestra.run.gibba044.stdout: bluestore block size = 96636764160 2021-11-12T05:49:30.291 INFO:teuthology.orchestra.run.gibba044.stdout: bluestore compression mode = aggressive 2021-11-12T05:49:30.291 INFO:teuthology.orchestra.run.gibba044.stdout: bluestore fsck on mount = True 2021-11-12T05:49:30.292 INFO:teuthology.orchestra.run.gibba044.stdout: debug bluefs = 20 2021-11-12T05:49:30.292 INFO:teuthology.orchestra.run.gibba044.stdout: debug bluestore = 20 2021-11-12T05:49:30.292 INFO:teuthology.orchestra.run.gibba044.stdout: debug ms = 1 2021-11-12T05:49:30.292 INFO:teuthology.orchestra.run.gibba044.stdout: debug osd = 20 2021-11-12T05:49:30.292 INFO:teuthology.orchestra.run.gibba044.stdout: debug rocksdb = 10 2021-11-12T05:49:30.293 INFO:teuthology.orchestra.run.gibba044.stdout: mon osd backfillfull_ratio = 0.85 2021-11-12T05:49:30.293 INFO:teuthology.orchestra.run.gibba044.stdout: mon osd full ratio = 0.9 2021-11-12T05:49:30.293 INFO:teuthology.orchestra.run.gibba044.stdout: mon osd nearfull ratio = 0.8 2021-11-12T05:49:30.293 INFO:teuthology.orchestra.run.gibba044.stdout: osd failsafe full ratio = 0.95 2021-11-12T05:49:30.294 INFO:teuthology.orchestra.run.gibba044.stdout: osd objectstore = bluestore 2021-11-12T05:49:30.294 INFO:teuthology.orchestra.run.gibba044.stdout: osd op complaint time = 180 2021-11-12T05:49:30.294 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:30.294 INFO:teuthology.orchestra.run.gibba044.stdout:[mgr] 2021-11-12T05:49:30.294 INFO:teuthology.orchestra.run.gibba044.stdout: debug ms = 1 2021-11-12T05:49:30.295 INFO:teuthology.orchestra.run.gibba044.stdout: debug mgr = 20 2021-11-12T05:49:30.295 INFO:teuthology.orchestra.run.gibba044.stdout: debug mon = 20 2021-11-12T05:49:30.295 INFO:teuthology.orchestra.run.gibba044.stdout: debug auth = 20 2021-11-12T05:49:30.295 INFO:teuthology.orchestra.run.gibba044.stdout: mon reweight min pgs per osd = 4 2021-11-12T05:49:30.295 INFO:teuthology.orchestra.run.gibba044.stdout: mon reweight min bytes per osd = 10 2021-11-12T05:49:30.296 INFO:teuthology.orchestra.run.gibba044.stdout: mgr/telemetry/nag = false 2021-11-12T05:49:30.296 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:30.296 INFO:teuthology.orchestra.run.gibba044.stdout:[mon] 2021-11-12T05:49:30.296 INFO:teuthology.orchestra.run.gibba044.stdout: debug ms = 1 2021-11-12T05:49:30.297 INFO:teuthology.orchestra.run.gibba044.stdout: debug mon = 20 2021-11-12T05:49:30.297 INFO:teuthology.orchestra.run.gibba044.stdout: debug paxos = 20 2021-11-12T05:49:30.297 INFO:teuthology.orchestra.run.gibba044.stdout: debug auth = 20 2021-11-12T05:49:30.297 INFO:teuthology.orchestra.run.gibba044.stdout: mon data avail warn = 5 2021-11-12T05:49:30.297 INFO:teuthology.orchestra.run.gibba044.stdout: mon mgr mkfs grace = 240 2021-11-12T05:49:30.298 INFO:teuthology.orchestra.run.gibba044.stdout: mon reweight min pgs per osd = 4 2021-11-12T05:49:30.298 INFO:teuthology.orchestra.run.gibba044.stdout: mon osd reporter subtree level = osd 2021-11-12T05:49:30.298 INFO:teuthology.orchestra.run.gibba044.stdout: mon osd prime pg temp = true 2021-11-12T05:49:30.298 INFO:teuthology.orchestra.run.gibba044.stdout: mon reweight min bytes per osd = 10 2021-11-12T05:49:30.299 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:30.299 INFO:teuthology.orchestra.run.gibba044.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-12T05:49:30.299 INFO:teuthology.orchestra.run.gibba044.stdout: auth mon ticket ttl = 660 # 11m 2021-11-12T05:49:30.299 INFO:teuthology.orchestra.run.gibba044.stdout: auth service ticket ttl = 240 # 4m 2021-11-12T05:49:30.299 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:30.300 INFO:teuthology.orchestra.run.gibba044.stdout: # don't complain about insecure global_id in the test suite 2021-11-12T05:49:30.300 INFO:teuthology.orchestra.run.gibba044.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-12T05:49:30.300 INFO:teuthology.orchestra.run.gibba044.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-12T05:49:30.300 INFO:teuthology.orchestra.run.gibba044.stdout: mon op complaint time = 120 2021-11-12T05:49:30.300 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-11-12T05:49:30.301 INFO:teuthology.orchestra.run.gibba044.stdout:[client] 2021-11-12T05:49:30.301 INFO:teuthology.orchestra.run.gibba044.stdout: rgw cache enabled = true 2021-11-12T05:49:30.301 INFO:teuthology.orchestra.run.gibba044.stdout: rgw enable ops log = true 2021-11-12T05:49:30.301 INFO:teuthology.orchestra.run.gibba044.stdout: rgw enable usage log = true 2021-11-12T05:49:30.302 INFO:teuthology.orchestra.run.gibba044.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-12T05:49:30.302 INFO:teuthology.orchestra.run.gibba044.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-12T05:49:30.302 INFO:teuthology.orchestra.run.gibba044.stdout: client mount timeout = 600 2021-11-12T05:49:30.302 INFO:teuthology.orchestra.run.gibba044.stdout: debug client = 20 2021-11-12T05:49:30.302 INFO:teuthology.orchestra.run.gibba044.stdout: debug ms = 1 2021-11-12T05:49:30.303 INFO:teuthology.orchestra.run.gibba044.stdout: rados mon op timeout = 15m 2021-11-12T05:49:30.303 INFO:teuthology.orchestra.run.gibba044.stdout: rados osd op timeout = 15m 2021-11-12T05:49:30.303 INFO:teuthology.orchestra.run.gibba044.stdout:[mon.a] 2021-11-12T05:49:30.303 INFO:teuthology.orchestra.run.gibba044.stdout:[mon.b] 2021-11-12T05:49:30.303 INFO:teuthology.orchestra.run.gibba044.stdout:[mon.c] 2021-11-12T05:49:30.304 INFO:teuthology.orchestra.run.gibba044.stdout:[mds.a] 2021-11-12T05:49:30.304 INFO:teuthology.orchestra.run.gibba044.stdout:[mds.b] 2021-11-12T05:49:30.304 INFO:teuthology.orchestra.run.gibba044.stdout:[mds] 2021-11-12T05:49:30.304 INFO:teuthology.orchestra.run.gibba044.stdout: debug mds = 20 2021-11-12T05:49:30.305 INFO:teuthology.orchestra.run.gibba044.stdout: debug ms = 1 2021-11-12T05:49:30.305 INFO:teuthology.orchestra.run.gibba044.stdout: mds bal frag = True 2021-11-12T05:49:30.305 INFO:teuthology.orchestra.run.gibba044.stdout: mds bal fragment size max = 10000 2021-11-12T05:49:30.305 INFO:teuthology.orchestra.run.gibba044.stdout: mds bal merge size = 5 2021-11-12T05:49:30.305 INFO:teuthology.orchestra.run.gibba044.stdout: mds bal split bits = 3 2021-11-12T05:49:30.306 INFO:teuthology.orchestra.run.gibba044.stdout: mds bal split size = 100 2021-11-12T05:49:30.306 INFO:teuthology.orchestra.run.gibba044.stdout: mds debug frag = True 2021-11-12T05:49:30.306 INFO:teuthology.orchestra.run.gibba044.stdout: mds debug scatterstat = True 2021-11-12T05:49:30.306 INFO:teuthology.orchestra.run.gibba044.stdout: mds op complaint time = 180 2021-11-12T05:49:30.306 INFO:teuthology.orchestra.run.gibba044.stdout: mds verify scatter = True 2021-11-12T05:49:30.307 INFO:teuthology.orchestra.run.gibba044.stdout: osd op complaint time = 180 2021-11-12T05:49:30.307 INFO:teuthology.orchestra.run.gibba044.stdout: rados mon op timeout = 15m 2021-11-12T05:49:30.307 INFO:teuthology.orchestra.run.gibba044.stdout: rados osd op timeout = 15m 2021-11-12T05:49:30.307 INFO:teuthology.orchestra.run.gibba016.stdout:[global] 2021-11-12T05:49:30.308 INFO:teuthology.orchestra.run.gibba016.stdout: chdir = "" 2021-11-12T05:49:30.308 INFO:teuthology.orchestra.run.gibba016.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-12T05:49:30.308 INFO:teuthology.orchestra.run.gibba016.stdout: auth supported = cephx 2021-11-12T05:49:30.308 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:30.309 INFO:teuthology.orchestra.run.gibba016.stdout: filestore xattr use omap = true 2021-11-12T05:49:30.309 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:30.309 INFO:teuthology.orchestra.run.gibba016.stdout: mon clock drift allowed = 1.000 2021-11-12T05:49:30.309 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:30.309 INFO:teuthology.orchestra.run.gibba016.stdout: osd crush chooseleaf type = 0 2021-11-12T05:49:30.310 INFO:teuthology.orchestra.run.gibba016.stdout: auth debug = true 2021-11-12T05:49:30.310 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:30.310 INFO:teuthology.orchestra.run.gibba016.stdout: ms die on old message = true 2021-11-12T05:49:30.310 INFO:teuthology.orchestra.run.gibba016.stdout: ms die on bug = true 2021-11-12T05:49:30.311 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:30.311 INFO:teuthology.orchestra.run.gibba016.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-12T05:49:30.311 INFO:teuthology.orchestra.run.gibba016.stdout: mon pg warn max object skew = 0 2021-11-12T05:49:30.311 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:30.311 INFO:teuthology.orchestra.run.gibba016.stdout: # disable pg_autoscaler by default for new pools 2021-11-12T05:49:30.312 INFO:teuthology.orchestra.run.gibba016.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-12T05:49:30.312 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:30.312 INFO:teuthology.orchestra.run.gibba016.stdout: osd pool default size = 2 2021-11-12T05:49:30.312 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:30.312 INFO:teuthology.orchestra.run.gibba016.stdout: mon osd allow primary affinity = true 2021-11-12T05:49:30.313 INFO:teuthology.orchestra.run.gibba016.stdout: mon osd allow pg remap = true 2021-11-12T05:49:30.313 INFO:teuthology.orchestra.run.gibba016.stdout: mon warn on legacy crush tunables = false 2021-11-12T05:49:30.313 INFO:teuthology.orchestra.run.gibba016.stdout: mon warn on crush straw calc version zero = false 2021-11-12T05:49:30.313 INFO:teuthology.orchestra.run.gibba016.stdout: mon warn on no sortbitwise = false 2021-11-12T05:49:30.313 INFO:teuthology.orchestra.run.gibba016.stdout: mon warn on osd down out interval zero = false 2021-11-12T05:49:30.314 INFO:teuthology.orchestra.run.gibba016.stdout: mon warn on too few osds = false 2021-11-12T05:49:30.314 INFO:teuthology.orchestra.run.gibba016.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-12T05:49:30.314 INFO:teuthology.orchestra.run.gibba016.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-12T05:49:30.314 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:30.315 INFO:teuthology.orchestra.run.gibba016.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-12T05:49:30.315 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:30.315 INFO:teuthology.orchestra.run.gibba016.stdout: osd default data pool replay window = 5 2021-11-12T05:49:30.315 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:30.315 INFO:teuthology.orchestra.run.gibba016.stdout: mon allow pool delete = true 2021-11-12T05:49:30.316 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:30.316 INFO:teuthology.orchestra.run.gibba016.stdout: mon cluster log file level = debug 2021-11-12T05:49:30.316 INFO:teuthology.orchestra.run.gibba016.stdout: debug asserts on shutdown = true 2021-11-12T05:49:30.316 INFO:teuthology.orchestra.run.gibba016.stdout: mon health detail to clog = false 2021-11-12T05:49:30.317 INFO:teuthology.orchestra.run.gibba016.stdout: mon host = "172.21.2.105,172.21.2.115,[v2:172.21.2.115:3301,v1:172.21.2.115:6790]" 2021-11-12T05:49:30.317 INFO:teuthology.orchestra.run.gibba016.stdout: fsid = 22928e10-9f3c-479a-96ca-77d6ddf80f9f 2021-11-12T05:49:30.317 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:30.317 INFO:teuthology.orchestra.run.gibba016.stdout:[osd] 2021-11-12T05:49:30.317 INFO:teuthology.orchestra.run.gibba016.stdout: osd journal size = 100 2021-11-12T05:49:30.318 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:30.318 INFO:teuthology.orchestra.run.gibba016.stdout: osd scrub load threshold = 5.0 2021-11-12T05:49:30.318 INFO:teuthology.orchestra.run.gibba016.stdout: osd scrub max interval = 600 2021-11-12T05:49:30.318 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:30.319 INFO:teuthology.orchestra.run.gibba016.stdout: osd recover clone overlap = true 2021-11-12T05:49:30.319 INFO:teuthology.orchestra.run.gibba016.stdout: osd recovery max chunk = 1048576 2021-11-12T05:49:30.319 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:30.319 INFO:teuthology.orchestra.run.gibba016.stdout: osd debug shutdown = true 2021-11-12T05:49:30.319 INFO:teuthology.orchestra.run.gibba016.stdout: osd debug op order = true 2021-11-12T05:49:30.320 INFO:teuthology.orchestra.run.gibba016.stdout: osd debug verify stray on activate = true 2021-11-12T05:49:30.320 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:30.320 INFO:teuthology.orchestra.run.gibba016.stdout: osd open classes on start = true 2021-11-12T05:49:30.320 INFO:teuthology.orchestra.run.gibba016.stdout: osd debug pg log writeout = true 2021-11-12T05:49:30.321 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:30.321 INFO:teuthology.orchestra.run.gibba016.stdout: osd deep scrub update digest min age = 30 2021-11-12T05:49:30.321 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:30.321 INFO:teuthology.orchestra.run.gibba016.stdout: osd map max advance = 10 2021-11-12T05:49:30.321 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:30.322 INFO:teuthology.orchestra.run.gibba016.stdout: journal zero on create = true 2021-11-12T05:49:30.322 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:30.322 INFO:teuthology.orchestra.run.gibba016.stdout: filestore ondisk finisher threads = 3 2021-11-12T05:49:30.322 INFO:teuthology.orchestra.run.gibba016.stdout: filestore apply finisher threads = 3 2021-11-12T05:49:30.322 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:30.323 INFO:teuthology.orchestra.run.gibba016.stdout: bdev debug aio = true 2021-11-12T05:49:30.323 INFO:teuthology.orchestra.run.gibba016.stdout: osd debug misdirected ops = true 2021-11-12T05:49:30.323 INFO:teuthology.orchestra.run.gibba016.stdout: bluestore block size = 96636764160 2021-11-12T05:49:30.323 INFO:teuthology.orchestra.run.gibba016.stdout: bluestore compression mode = aggressive 2021-11-12T05:49:30.324 INFO:teuthology.orchestra.run.gibba016.stdout: bluestore fsck on mount = True 2021-11-12T05:49:30.324 INFO:teuthology.orchestra.run.gibba016.stdout: debug bluefs = 20 2021-11-12T05:49:30.324 INFO:teuthology.orchestra.run.gibba016.stdout: debug bluestore = 20 2021-11-12T05:49:30.324 INFO:teuthology.orchestra.run.gibba016.stdout: debug ms = 1 2021-11-12T05:49:30.325 INFO:teuthology.orchestra.run.gibba016.stdout: debug osd = 20 2021-11-12T05:49:30.325 INFO:teuthology.orchestra.run.gibba016.stdout: debug rocksdb = 10 2021-11-12T05:49:30.325 INFO:teuthology.orchestra.run.gibba016.stdout: mon osd backfillfull_ratio = 0.85 2021-11-12T05:49:30.325 INFO:teuthology.orchestra.run.gibba016.stdout: mon osd full ratio = 0.9 2021-11-12T05:49:30.325 INFO:teuthology.orchestra.run.gibba016.stdout: mon osd nearfull ratio = 0.8 2021-11-12T05:49:30.326 INFO:teuthology.orchestra.run.gibba016.stdout: osd failsafe full ratio = 0.95 2021-11-12T05:49:30.326 INFO:teuthology.orchestra.run.gibba016.stdout: osd objectstore = bluestore 2021-11-12T05:49:30.326 INFO:teuthology.orchestra.run.gibba016.stdout: osd op complaint time = 180 2021-11-12T05:49:30.326 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:30.326 INFO:teuthology.orchestra.run.gibba016.stdout:[mgr] 2021-11-12T05:49:30.327 INFO:teuthology.orchestra.run.gibba016.stdout: debug ms = 1 2021-11-12T05:49:30.327 INFO:teuthology.orchestra.run.gibba016.stdout: debug mgr = 20 2021-11-12T05:49:30.327 INFO:teuthology.orchestra.run.gibba016.stdout: debug mon = 20 2021-11-12T05:49:30.327 INFO:teuthology.orchestra.run.gibba016.stdout: debug auth = 20 2021-11-12T05:49:30.328 INFO:teuthology.orchestra.run.gibba016.stdout: mon reweight min pgs per osd = 4 2021-11-12T05:49:30.328 INFO:teuthology.orchestra.run.gibba016.stdout: mon reweight min bytes per osd = 10 2021-11-12T05:49:30.328 INFO:teuthology.orchestra.run.gibba016.stdout: mgr/telemetry/nag = false 2021-11-12T05:49:30.328 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:30.328 INFO:teuthology.orchestra.run.gibba016.stdout:[mon] 2021-11-12T05:49:30.329 INFO:teuthology.orchestra.run.gibba016.stdout: debug ms = 1 2021-11-12T05:49:30.329 INFO:teuthology.orchestra.run.gibba016.stdout: debug mon = 20 2021-11-12T05:49:30.329 INFO:teuthology.orchestra.run.gibba016.stdout: debug paxos = 20 2021-11-12T05:49:30.329 INFO:teuthology.orchestra.run.gibba016.stdout: debug auth = 20 2021-11-12T05:49:30.329 INFO:teuthology.orchestra.run.gibba016.stdout: mon data avail warn = 5 2021-11-12T05:49:30.330 INFO:teuthology.orchestra.run.gibba016.stdout: mon mgr mkfs grace = 240 2021-11-12T05:49:30.330 INFO:teuthology.orchestra.run.gibba016.stdout: mon reweight min pgs per osd = 4 2021-11-12T05:49:30.330 INFO:teuthology.orchestra.run.gibba016.stdout: mon osd reporter subtree level = osd 2021-11-12T05:49:30.330 INFO:teuthology.orchestra.run.gibba016.stdout: mon osd prime pg temp = true 2021-11-12T05:49:30.330 INFO:teuthology.orchestra.run.gibba016.stdout: mon reweight min bytes per osd = 10 2021-11-12T05:49:30.331 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:30.331 INFO:teuthology.orchestra.run.gibba016.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-12T05:49:30.331 INFO:teuthology.orchestra.run.gibba016.stdout: auth mon ticket ttl = 660 # 11m 2021-11-12T05:49:30.331 INFO:teuthology.orchestra.run.gibba016.stdout: auth service ticket ttl = 240 # 4m 2021-11-12T05:49:30.332 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:30.332 INFO:teuthology.orchestra.run.gibba016.stdout: # don't complain about insecure global_id in the test suite 2021-11-12T05:49:30.332 INFO:teuthology.orchestra.run.gibba016.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-12T05:49:30.332 INFO:teuthology.orchestra.run.gibba016.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-12T05:49:30.332 INFO:teuthology.orchestra.run.gibba016.stdout: mon op complaint time = 120 2021-11-12T05:49:30.333 INFO:teuthology.orchestra.run.gibba016.stdout: 2021-11-12T05:49:30.333 INFO:teuthology.orchestra.run.gibba016.stdout:[client] 2021-11-12T05:49:30.333 INFO:teuthology.orchestra.run.gibba016.stdout: rgw cache enabled = true 2021-11-12T05:49:30.333 INFO:teuthology.orchestra.run.gibba016.stdout: rgw enable ops log = true 2021-11-12T05:49:30.333 INFO:teuthology.orchestra.run.gibba016.stdout: rgw enable usage log = true 2021-11-12T05:49:30.334 INFO:teuthology.orchestra.run.gibba016.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-12T05:49:30.334 INFO:teuthology.orchestra.run.gibba016.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-12T05:49:30.334 INFO:teuthology.orchestra.run.gibba016.stdout: client mount timeout = 600 2021-11-12T05:49:30.334 INFO:teuthology.orchestra.run.gibba016.stdout: debug client = 20 2021-11-12T05:49:30.335 INFO:teuthology.orchestra.run.gibba016.stdout: debug ms = 1 2021-11-12T05:49:30.335 INFO:teuthology.orchestra.run.gibba016.stdout: rados mon op timeout = 15m 2021-11-12T05:49:30.335 INFO:teuthology.orchestra.run.gibba016.stdout: rados osd op timeout = 15m 2021-11-12T05:49:30.335 INFO:teuthology.orchestra.run.gibba016.stdout:[mon.a] 2021-11-12T05:49:30.335 INFO:teuthology.orchestra.run.gibba016.stdout:[mon.b] 2021-11-12T05:49:30.336 INFO:teuthology.orchestra.run.gibba016.stdout:[mon.c] 2021-11-12T05:49:30.336 INFO:teuthology.orchestra.run.gibba016.stdout:[mds.a] 2021-11-12T05:49:30.336 INFO:teuthology.orchestra.run.gibba016.stdout:[mds.b] 2021-11-12T05:49:30.336 INFO:teuthology.orchestra.run.gibba016.stdout:[mds] 2021-11-12T05:49:30.336 INFO:teuthology.orchestra.run.gibba016.stdout: debug mds = 20 2021-11-12T05:49:30.337 INFO:teuthology.orchestra.run.gibba016.stdout: debug ms = 1 2021-11-12T05:49:30.337 INFO:teuthology.orchestra.run.gibba016.stdout: mds bal frag = True 2021-11-12T05:49:30.337 INFO:teuthology.orchestra.run.gibba016.stdout: mds bal fragment size max = 10000 2021-11-12T05:49:30.337 INFO:teuthology.orchestra.run.gibba016.stdout: mds bal merge size = 5 2021-11-12T05:49:30.338 INFO:teuthology.orchestra.run.gibba016.stdout: mds bal split bits = 3 2021-11-12T05:49:30.338 INFO:teuthology.orchestra.run.gibba016.stdout: mds bal split size = 100 2021-11-12T05:49:30.338 INFO:teuthology.orchestra.run.gibba016.stdout: mds debug frag = True 2021-11-12T05:49:30.338 INFO:teuthology.orchestra.run.gibba016.stdout: mds debug scatterstat = True 2021-11-12T05:49:30.338 INFO:teuthology.orchestra.run.gibba016.stdout: mds op complaint time = 180 2021-11-12T05:49:30.339 INFO:teuthology.orchestra.run.gibba016.stdout: mds verify scatter = True 2021-11-12T05:49:30.339 INFO:teuthology.orchestra.run.gibba016.stdout: osd op complaint time = 180 2021-11-12T05:49:30.339 INFO:teuthology.orchestra.run.gibba016.stdout: rados mon op timeout = 15m 2021-11-12T05:49:30.339 INFO:teuthology.orchestra.run.gibba016.stdout: rados osd op timeout = 15m 2021-11-12T05:49:30.340 INFO:teuthology.orchestra.run.gibba038.stdout:[global] 2021-11-12T05:49:30.340 INFO:teuthology.orchestra.run.gibba038.stdout: chdir = "" 2021-11-12T05:49:30.340 INFO:teuthology.orchestra.run.gibba038.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-12T05:49:30.340 INFO:teuthology.orchestra.run.gibba038.stdout: auth supported = cephx 2021-11-12T05:49:30.341 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:30.341 INFO:teuthology.orchestra.run.gibba038.stdout: filestore xattr use omap = true 2021-11-12T05:49:30.341 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:30.341 INFO:teuthology.orchestra.run.gibba038.stdout: mon clock drift allowed = 1.000 2021-11-12T05:49:30.341 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:30.342 INFO:teuthology.orchestra.run.gibba038.stdout: osd crush chooseleaf type = 0 2021-11-12T05:49:30.342 INFO:teuthology.orchestra.run.gibba038.stdout: auth debug = true 2021-11-12T05:49:30.342 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:30.342 INFO:teuthology.orchestra.run.gibba038.stdout: ms die on old message = true 2021-11-12T05:49:30.342 INFO:teuthology.orchestra.run.gibba038.stdout: ms die on bug = true 2021-11-12T05:49:30.343 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:30.343 INFO:teuthology.orchestra.run.gibba038.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-12T05:49:30.343 INFO:teuthology.orchestra.run.gibba038.stdout: mon pg warn max object skew = 0 2021-11-12T05:49:30.343 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:30.344 INFO:teuthology.orchestra.run.gibba038.stdout: # disable pg_autoscaler by default for new pools 2021-11-12T05:49:30.344 INFO:teuthology.orchestra.run.gibba038.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-12T05:49:30.344 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:30.344 INFO:teuthology.orchestra.run.gibba038.stdout: osd pool default size = 2 2021-11-12T05:49:30.344 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:30.345 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd allow primary affinity = true 2021-11-12T05:49:30.345 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd allow pg remap = true 2021-11-12T05:49:30.345 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on legacy crush tunables = false 2021-11-12T05:49:30.345 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on crush straw calc version zero = false 2021-11-12T05:49:30.346 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on no sortbitwise = false 2021-11-12T05:49:30.346 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on osd down out interval zero = false 2021-11-12T05:49:30.346 INFO:teuthology.orchestra.run.gibba038.stdout: mon warn on too few osds = false 2021-11-12T05:49:30.346 INFO:teuthology.orchestra.run.gibba038.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-12T05:49:30.346 INFO:teuthology.orchestra.run.gibba038.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-12T05:49:30.347 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:30.347 INFO:teuthology.orchestra.run.gibba038.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-11-12T05:49:30.347 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:30.347 INFO:teuthology.orchestra.run.gibba038.stdout: osd default data pool replay window = 5 2021-11-12T05:49:30.347 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:30.348 INFO:teuthology.orchestra.run.gibba038.stdout: mon allow pool delete = true 2021-11-12T05:49:30.348 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:30.348 INFO:teuthology.orchestra.run.gibba038.stdout: mon cluster log file level = debug 2021-11-12T05:49:30.348 INFO:teuthology.orchestra.run.gibba038.stdout: debug asserts on shutdown = true 2021-11-12T05:49:30.349 INFO:teuthology.orchestra.run.gibba038.stdout: mon health detail to clog = false 2021-11-12T05:49:30.349 INFO:teuthology.orchestra.run.gibba038.stdout: mon host = "172.21.2.105,172.21.2.115,[v2:172.21.2.115:3301,v1:172.21.2.115:6790]" 2021-11-12T05:49:30.349 INFO:teuthology.orchestra.run.gibba038.stdout: fsid = 22928e10-9f3c-479a-96ca-77d6ddf80f9f 2021-11-12T05:49:30.349 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:30.349 INFO:teuthology.orchestra.run.gibba038.stdout:[osd] 2021-11-12T05:49:30.350 INFO:teuthology.orchestra.run.gibba038.stdout: osd journal size = 100 2021-11-12T05:49:30.350 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:30.350 INFO:teuthology.orchestra.run.gibba038.stdout: osd scrub load threshold = 5.0 2021-11-12T05:49:30.350 INFO:teuthology.orchestra.run.gibba038.stdout: osd scrub max interval = 600 2021-11-12T05:49:30.350 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:30.351 INFO:teuthology.orchestra.run.gibba038.stdout: osd recover clone overlap = true 2021-11-12T05:49:30.351 INFO:teuthology.orchestra.run.gibba038.stdout: osd recovery max chunk = 1048576 2021-11-12T05:49:30.351 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:30.351 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug shutdown = true 2021-11-12T05:49:30.352 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug op order = true 2021-11-12T05:49:30.352 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug verify stray on activate = true 2021-11-12T05:49:30.352 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:30.352 INFO:teuthology.orchestra.run.gibba038.stdout: osd open classes on start = true 2021-11-12T05:49:30.352 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug pg log writeout = true 2021-11-12T05:49:30.353 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:30.353 INFO:teuthology.orchestra.run.gibba038.stdout: osd deep scrub update digest min age = 30 2021-11-12T05:49:30.353 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:30.353 INFO:teuthology.orchestra.run.gibba038.stdout: osd map max advance = 10 2021-11-12T05:49:30.354 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:30.354 INFO:teuthology.orchestra.run.gibba038.stdout: journal zero on create = true 2021-11-12T05:49:30.354 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:30.354 INFO:teuthology.orchestra.run.gibba038.stdout: filestore ondisk finisher threads = 3 2021-11-12T05:49:30.354 INFO:teuthology.orchestra.run.gibba038.stdout: filestore apply finisher threads = 3 2021-11-12T05:49:30.355 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:30.355 INFO:teuthology.orchestra.run.gibba038.stdout: bdev debug aio = true 2021-11-12T05:49:30.355 INFO:teuthology.orchestra.run.gibba038.stdout: osd debug misdirected ops = true 2021-11-12T05:49:30.355 INFO:teuthology.orchestra.run.gibba038.stdout: bluestore block size = 96636764160 2021-11-12T05:49:30.355 INFO:teuthology.orchestra.run.gibba038.stdout: bluestore compression mode = aggressive 2021-11-12T05:49:30.356 INFO:teuthology.orchestra.run.gibba038.stdout: bluestore fsck on mount = True 2021-11-12T05:49:30.356 INFO:teuthology.orchestra.run.gibba038.stdout: debug bluefs = 20 2021-11-12T05:49:30.356 INFO:teuthology.orchestra.run.gibba038.stdout: debug bluestore = 20 2021-11-12T05:49:30.356 INFO:teuthology.orchestra.run.gibba038.stdout: debug ms = 1 2021-11-12T05:49:30.356 INFO:teuthology.orchestra.run.gibba038.stdout: debug osd = 20 2021-11-12T05:49:30.357 INFO:teuthology.orchestra.run.gibba038.stdout: debug rocksdb = 10 2021-11-12T05:49:30.357 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd backfillfull_ratio = 0.85 2021-11-12T05:49:30.357 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd full ratio = 0.9 2021-11-12T05:49:30.357 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd nearfull ratio = 0.8 2021-11-12T05:49:30.358 INFO:teuthology.orchestra.run.gibba038.stdout: osd failsafe full ratio = 0.95 2021-11-12T05:49:30.358 INFO:teuthology.orchestra.run.gibba038.stdout: osd objectstore = bluestore 2021-11-12T05:49:30.358 INFO:teuthology.orchestra.run.gibba038.stdout: osd op complaint time = 180 2021-11-12T05:49:30.358 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:30.358 INFO:teuthology.orchestra.run.gibba038.stdout:[mgr] 2021-11-12T05:49:30.359 INFO:teuthology.orchestra.run.gibba038.stdout: debug ms = 1 2021-11-12T05:49:30.359 INFO:teuthology.orchestra.run.gibba038.stdout: debug mgr = 20 2021-11-12T05:49:30.359 INFO:teuthology.orchestra.run.gibba038.stdout: debug mon = 20 2021-11-12T05:49:30.359 INFO:teuthology.orchestra.run.gibba038.stdout: debug auth = 20 2021-11-12T05:49:30.359 INFO:teuthology.orchestra.run.gibba038.stdout: mon reweight min pgs per osd = 4 2021-11-12T05:49:30.360 INFO:teuthology.orchestra.run.gibba038.stdout: mon reweight min bytes per osd = 10 2021-11-12T05:49:30.360 INFO:teuthology.orchestra.run.gibba038.stdout: mgr/telemetry/nag = false 2021-11-12T05:49:30.360 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:30.360 INFO:teuthology.orchestra.run.gibba038.stdout:[mon] 2021-11-12T05:49:30.361 INFO:teuthology.orchestra.run.gibba038.stdout: debug ms = 1 2021-11-12T05:49:30.361 INFO:teuthology.orchestra.run.gibba038.stdout: debug mon = 20 2021-11-12T05:49:30.361 INFO:teuthology.orchestra.run.gibba038.stdout: debug paxos = 20 2021-11-12T05:49:30.361 INFO:teuthology.orchestra.run.gibba038.stdout: debug auth = 20 2021-11-12T05:49:30.361 INFO:teuthology.orchestra.run.gibba038.stdout: mon data avail warn = 5 2021-11-12T05:49:30.362 INFO:teuthology.orchestra.run.gibba038.stdout: mon mgr mkfs grace = 240 2021-11-12T05:49:30.362 INFO:teuthology.orchestra.run.gibba038.stdout: mon reweight min pgs per osd = 4 2021-11-12T05:49:30.362 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd reporter subtree level = osd 2021-11-12T05:49:30.362 INFO:teuthology.orchestra.run.gibba038.stdout: mon osd prime pg temp = true 2021-11-12T05:49:30.362 INFO:teuthology.orchestra.run.gibba038.stdout: mon reweight min bytes per osd = 10 2021-11-12T05:49:30.363 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:30.363 INFO:teuthology.orchestra.run.gibba038.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-12T05:49:30.363 INFO:teuthology.orchestra.run.gibba038.stdout: auth mon ticket ttl = 660 # 11m 2021-11-12T05:49:30.363 INFO:teuthology.orchestra.run.gibba038.stdout: auth service ticket ttl = 240 # 4m 2021-11-12T05:49:30.364 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:30.364 INFO:teuthology.orchestra.run.gibba038.stdout: # don't complain about insecure global_id in the test suite 2021-11-12T05:49:30.364 INFO:teuthology.orchestra.run.gibba038.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-12T05:49:30.364 INFO:teuthology.orchestra.run.gibba038.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-12T05:49:30.364 INFO:teuthology.orchestra.run.gibba038.stdout: mon op complaint time = 120 2021-11-12T05:49:30.365 INFO:teuthology.orchestra.run.gibba038.stdout: 2021-11-12T05:49:30.365 INFO:teuthology.orchestra.run.gibba038.stdout:[client] 2021-11-12T05:49:30.365 INFO:teuthology.orchestra.run.gibba038.stdout: rgw cache enabled = true 2021-11-12T05:49:30.365 INFO:teuthology.orchestra.run.gibba038.stdout: rgw enable ops log = true 2021-11-12T05:49:30.365 INFO:teuthology.orchestra.run.gibba038.stdout: rgw enable usage log = true 2021-11-12T05:49:30.366 INFO:teuthology.orchestra.run.gibba038.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-12T05:49:30.366 INFO:teuthology.orchestra.run.gibba038.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-12T05:49:30.366 INFO:teuthology.orchestra.run.gibba038.stdout: client mount timeout = 600 2021-11-12T05:49:30.366 INFO:teuthology.orchestra.run.gibba038.stdout: debug client = 20 2021-11-12T05:49:30.366 INFO:teuthology.orchestra.run.gibba038.stdout: debug ms = 1 2021-11-12T05:49:30.367 INFO:teuthology.orchestra.run.gibba038.stdout: rados mon op timeout = 15m 2021-11-12T05:49:30.367 INFO:teuthology.orchestra.run.gibba038.stdout: rados osd op timeout = 15m 2021-11-12T05:49:30.367 INFO:teuthology.orchestra.run.gibba038.stdout:[mon.a] 2021-11-12T05:49:30.367 INFO:teuthology.orchestra.run.gibba038.stdout:[mon.b] 2021-11-12T05:49:30.368 INFO:teuthology.orchestra.run.gibba038.stdout:[mon.c] 2021-11-12T05:49:30.368 INFO:teuthology.orchestra.run.gibba038.stdout:[mds.a] 2021-11-12T05:49:30.368 INFO:teuthology.orchestra.run.gibba038.stdout:[mds.b] 2021-11-12T05:49:30.368 INFO:teuthology.orchestra.run.gibba038.stdout:[mds] 2021-11-12T05:49:30.368 INFO:teuthology.orchestra.run.gibba038.stdout: debug mds = 20 2021-11-12T05:49:30.369 INFO:teuthology.orchestra.run.gibba038.stdout: debug ms = 1 2021-11-12T05:49:30.369 INFO:teuthology.orchestra.run.gibba038.stdout: mds bal frag = True 2021-11-12T05:49:30.369 INFO:teuthology.orchestra.run.gibba038.stdout: mds bal fragment size max = 10000 2021-11-12T05:49:30.369 INFO:teuthology.orchestra.run.gibba038.stdout: mds bal merge size = 5 2021-11-12T05:49:30.369 INFO:teuthology.orchestra.run.gibba038.stdout: mds bal split bits = 3 2021-11-12T05:49:30.370 INFO:teuthology.orchestra.run.gibba038.stdout: mds bal split size = 100 2021-11-12T05:49:30.370 INFO:teuthology.orchestra.run.gibba038.stdout: mds debug frag = True 2021-11-12T05:49:30.370 INFO:teuthology.orchestra.run.gibba038.stdout: mds debug scatterstat = True 2021-11-12T05:49:30.370 INFO:teuthology.orchestra.run.gibba038.stdout: mds op complaint time = 180 2021-11-12T05:49:30.370 INFO:teuthology.orchestra.run.gibba038.stdout: mds verify scatter = True 2021-11-12T05:49:30.371 INFO:teuthology.orchestra.run.gibba038.stdout: osd op complaint time = 180 2021-11-12T05:49:30.371 INFO:teuthology.orchestra.run.gibba038.stdout: rados mon op timeout = 15m 2021-11-12T05:49:30.371 INFO:teuthology.orchestra.run.gibba038.stdout: rados osd op timeout = 15m 2021-11-12T05:49:30.372 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-11-12T05:49:30.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.480+0000 7f8c4d6d0700 1 Processor -- start 2021-11-12T05:49:30.485 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.480+0000 7f8c4d6d0700 1 -- start start 2021-11-12T05:49:30.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.480+0000 7f8c4d6d0700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f8c480aca40 0x7f8c480ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:30.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.480+0000 7f8c4d6d0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8c480b0520 0x7f8c481473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:30.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.480+0000 7f8c4d6d0700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f8c481478b0 0x7f8c48144180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:30.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.480+0000 7f8c4d6d0700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c48147d40 con 0x7f8c480aca40 2021-11-12T05:49:30.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.480+0000 7f8c4d6d0700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c480b1840 con 0x7f8c481478b0 2021-11-12T05:49:30.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.480+0000 7f8c4d6d0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c480af2b0 con 0x7f8c480b0520 2021-11-12T05:49:30.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.480+0000 7f8c46ffd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f8c480aca40 0x7f8c480ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:30.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.480+0000 7f8c46ffd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f8c480aca40 0x7f8c480ace20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51900/0 (socket says 172.21.2.105:51900) 2021-11-12T05:49:30.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.480+0000 7f8c46ffd700 1 -- 172.21.2.105:0/3716539653 learned_addr learned my addr 172.21.2.105:0/3716539653 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:30.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.480+0000 7f8c46ffd700 1 -- 172.21.2.105:0/3716539653 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8c480b0520 msgr2=0x7f8c481473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:30.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.480+0000 7f8c46ffd700 1 --2- 172.21.2.105:0/3716539653 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8c480b0520 0x7f8c481473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:30.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.480+0000 7f8c46ffd700 1 -- 172.21.2.105:0/3716539653 >> v2:172.21.2.115:3300/0 conn(0x7f8c481478b0 msgr2=0x7f8c48144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:30.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.480+0000 7f8c46ffd700 1 --2- 172.21.2.105:0/3716539653 >> v2:172.21.2.115:3300/0 conn(0x7f8c481478b0 0x7f8c48144180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:30.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.480+0000 7f8c46ffd700 1 -- 172.21.2.105:0/3716539653 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c480b09a0 con 0x7f8c480aca40 2021-11-12T05:49:30.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.480+0000 7f8c46ffd700 1 --2- 172.21.2.105:0/3716539653 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8c480aca40 0x7f8c480ace20 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 rx=0x7f8c30002f70 tx=0x7f8c30006eb0).ready entity=mon.0 client_cookie=eb554fc52e7ea179 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:30.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.480+0000 7f8c45ffb700 1 -- 172.21.2.105:0/3716539653 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c3000d570 con 0x7f8c480aca40 2021-11-12T05:49:30.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.480+0000 7f8c45ffb700 1 -- 172.21.2.105:0/3716539653 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c30000e90 con 0x7f8c480aca40 2021-11-12T05:49:30.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.480+0000 7f8c45ffb700 1 -- 172.21.2.105:0/3716539653 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c3000d900 con 0x7f8c480aca40 2021-11-12T05:49:30.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.480+0000 7f8c4d6d0700 1 -- 172.21.2.105:0/3716539653 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8c480aca40 msgr2=0x7f8c480ace20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:30.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.480+0000 7f8c4d6d0700 1 --2- 172.21.2.105:0/3716539653 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8c480aca40 0x7f8c480ace20 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 rx=0x7f8c30002f70 tx=0x7f8c30006eb0).stop 2021-11-12T05:49:30.491 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.484+0000 7f8c4d6d0700 1 -- 172.21.2.105:0/3716539653 shutdown_connections 2021-11-12T05:49:30.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.484+0000 7f8c4d6d0700 1 --2- 172.21.2.105:0/3716539653 >> v2:172.21.2.115:3300/0 conn(0x7f8c481478b0 0x7f8c48144180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:30.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.484+0000 7f8c4d6d0700 1 --2- 172.21.2.105:0/3716539653 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8c480b0520 0x7f8c481473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:30.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.484+0000 7f8c4d6d0700 1 --2- 172.21.2.105:0/3716539653 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8c480aca40 0x7f8c480ace20 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:30.492 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.484+0000 7f8c4d6d0700 1 -- 172.21.2.105:0/3716539653 >> 172.21.2.105:0/3716539653 conn(0x7f8c4805c490 msgr2=0x7f8c480b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:30.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.484+0000 7f8c4d6d0700 1 -- 172.21.2.105:0/3716539653 shutdown_connections 2021-11-12T05:49:30.493 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.484+0000 7f8c4d6d0700 1 -- 172.21.2.105:0/3716539653 wait complete. 2021-11-12T05:49:30.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.484+0000 7f8c4d6d0700 1 Processor -- start 2021-11-12T05:49:30.495 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.484+0000 7f8c4d6d0700 1 -- start start 2021-11-12T05:49:30.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.484+0000 7f8c4d6d0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8c480aca40 0x7f8c480b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:30.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.484+0000 7f8c4d6d0700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8c480b0520 0x7f8c48066ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:30.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.484+0000 7f8c4d6d0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8c481478b0 0x7f8c48066fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:30.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.484+0000 7f8c4d6d0700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c480a8f30 con 0x7f8c481478b0 2021-11-12T05:49:30.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.484+0000 7f8c4d6d0700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c480a91d0 con 0x7f8c480b0520 2021-11-12T05:49:30.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.484+0000 7f8c4d6d0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c480674b0 con 0x7f8c480aca40 2021-11-12T05:49:30.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.484+0000 7f8c477fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8c481478b0 0x7f8c48066fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:30.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.484+0000 7f8c477fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8c481478b0 0x7f8c48066fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51910/0 (socket says 172.21.2.105:51910) 2021-11-12T05:49:30.498 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.484+0000 7f8c477fe700 1 -- 172.21.2.105:0/3530513477 learned_addr learned my addr 172.21.2.105:0/3530513477 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:30.498 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.484+0000 7f8c467fc700 1 --2- 172.21.2.105:0/3530513477 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8c480b0520 0x7f8c48066ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:30.498 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.484+0000 7f8c46ffd700 1 --2- 172.21.2.105:0/3530513477 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8c480aca40 0x7f8c480b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:30.498 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.484+0000 7f8c477fe700 1 -- 172.21.2.105:0/3530513477 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8c480aca40 msgr2=0x7f8c480b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:30.498 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.484+0000 7f8c477fe700 1 --2- 172.21.2.105:0/3530513477 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8c480aca40 0x7f8c480b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:30.499 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.484+0000 7f8c477fe700 1 -- 172.21.2.105:0/3530513477 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8c480b0520 msgr2=0x7f8c48066ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:30.499 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.484+0000 7f8c477fe700 1 --2- 172.21.2.105:0/3530513477 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8c480b0520 0x7f8c48066ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:30.499 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.484+0000 7f8c477fe700 1 -- 172.21.2.105:0/3530513477 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3000b1e0 con 0x7f8c481478b0 2021-11-12T05:49:30.499 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.484+0000 7f8c477fe700 1 --2- 172.21.2.105:0/3530513477 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8c481478b0 0x7f8c48066fc0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 rx=0x7f8c400032f0 tx=0x7f8c40009120).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:30.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.484+0000 7f8c3ffff700 1 -- 172.21.2.105:0/3530513477 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c4000f510 con 0x7f8c481478b0 2021-11-12T05:49:30.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.484+0000 7f8c3ffff700 1 -- 172.21.2.105:0/3530513477 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c4000f670 con 0x7f8c481478b0 2021-11-12T05:49:30.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.484+0000 7f8c3ffff700 1 -- 172.21.2.105:0/3530513477 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c4000f7e0 con 0x7f8c481478b0 2021-11-12T05:49:30.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.484+0000 7f8c4d6d0700 1 -- 172.21.2.105:0/3530513477 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c48062490 con 0x7f8c481478b0 2021-11-12T05:49:30.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.484+0000 7f8c4d6d0700 1 -- 172.21.2.105:0/3530513477 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c480a9d20 con 0x7f8c481478b0 2021-11-12T05:49:30.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.484+0000 7f8c4d6d0700 1 -- 172.21.2.105:0/3530513477 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c480a9390 con 0x7f8c481478b0 2021-11-12T05:49:30.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.484+0000 7f8c3ffff700 1 -- 172.21.2.105:0/3530513477 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8c4000f070 con 0x7f8c481478b0 2021-11-12T05:49:30.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.484+0000 7f8c3ffff700 1 --2- 172.21.2.105:0/3530513477 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8c2c0535d0 0x7f8c2c055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:30.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.484+0000 7f8c3ffff700 1 -- 172.21.2.105:0/3530513477 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f8c4006b450 con 0x7f8c481478b0 2021-11-12T05:49:30.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.484+0000 7f8c46ffd700 1 --2- 172.21.2.105:0/3530513477 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8c2c0535d0 0x7f8c2c055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:30.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.488+0000 7f8c46ffd700 1 --2- 172.21.2.105:0/3530513477 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8c2c0535d0 0x7f8c2c055a90 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f8c30017000 tx=0x7f8c30015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:30.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.488+0000 7f8c3ffff700 1 -- 172.21.2.105:0/3530513477 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8c40042620 con 0x7f8c481478b0 2021-11-12T05:49:30.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.572+0000 7f8c4d6d0700 1 -- 172.21.2.105:0/3530513477 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f8c48057350 con 0x7f8c481478b0 2021-11-12T05:49:30.581 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.576+0000 7f8c3ffff700 1 -- 172.21.2.105:0/3530513477 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8c40045c40 con 0x7f8c481478b0 2021-11-12T05:49:30.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.576+0000 7f8c4d6d0700 1 -- 172.21.2.105:0/3530513477 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8c2c0535d0 msgr2=0x7f8c2c055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:30.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.576+0000 7f8c4d6d0700 1 --2- 172.21.2.105:0/3530513477 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8c2c0535d0 0x7f8c2c055a90 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f8c30017000 tx=0x7f8c30015000).stop 2021-11-12T05:49:30.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.576+0000 7f8c4d6d0700 1 -- 172.21.2.105:0/3530513477 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8c481478b0 msgr2=0x7f8c48066fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:30.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.576+0000 7f8c4d6d0700 1 --2- 172.21.2.105:0/3530513477 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8c481478b0 0x7f8c48066fc0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 rx=0x7f8c400032f0 tx=0x7f8c40009120).stop 2021-11-12T05:49:30.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.576+0000 7f8c4d6d0700 1 -- 172.21.2.105:0/3530513477 shutdown_connections 2021-11-12T05:49:30.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.576+0000 7f8c4d6d0700 1 --2- 172.21.2.105:0/3530513477 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8c2c0535d0 0x7f8c2c055a90 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:30.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.576+0000 7f8c4d6d0700 1 --2- 172.21.2.105:0/3530513477 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8c481478b0 0x7f8c48066fc0 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:30.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.576+0000 7f8c4d6d0700 1 --2- 172.21.2.105:0/3530513477 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8c480b0520 0x7f8c48066ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:30.584 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.576+0000 7f8c4d6d0700 1 --2- 172.21.2.105:0/3530513477 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8c480aca40 0x7f8c480b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:30.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.576+0000 7f8c4d6d0700 1 -- 172.21.2.105:0/3530513477 >> 172.21.2.105:0/3530513477 conn(0x7f8c4805c490 msgr2=0x7f8c4805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:30.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.576+0000 7f8c4d6d0700 1 -- 172.21.2.105:0/3530513477 shutdown_connections 2021-11-12T05:49:30.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.576+0000 7f8c4d6d0700 1 -- 172.21.2.105:0/3530513477 wait complete. 2021-11-12T05:49:30.589 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_getattr_caps' 2021-11-12T05:49:30.640 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.636+0000 7f5ee06ec700 1 Processor -- start 2021-11-12T05:49:30.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.636+0000 7f5ee06ec700 1 -- start start 2021-11-12T05:49:30.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.636+0000 7f5ee06ec700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f5ed80b37d0 0x7f5ed8141500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:30.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.636+0000 7f5ee06ec700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5ed81419f0 0x7f5ed80b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:30.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.636+0000 7f5ee06ec700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed80b26e0 con 0x7f5ed8060100 2021-11-12T05:49:30.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.636+0000 7f5ee06ec700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ed80604e0 con 0x7f5ed80b37d0 2021-11-12T05:49:30.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.636+0000 7f5ee06ec700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed8145160 con 0x7f5ed81419f0 2021-11-12T05:49:30.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.636+0000 7f5eddc87700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f5ed80b37d0 0x7f5ed8141500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:30.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.636+0000 7f5eddc87700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f5ed80b37d0 0x7f5ed8141500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51914/0 (socket says 172.21.2.105:51914) 2021-11-12T05:49:30.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.636+0000 7f5eddc87700 1 -- 172.21.2.105:0/151698695 learned_addr learned my addr 172.21.2.105:0/151698695 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:30.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.636+0000 7f5eddc87700 1 -- 172.21.2.105:0/151698695 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5ed81419f0 msgr2=0x7f5ed80b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:30.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.636+0000 7f5eddc87700 1 --2- 172.21.2.105:0/151698695 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5ed81419f0 0x7f5ed80b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:30.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.636+0000 7f5eddc87700 1 -- 172.21.2.105:0/151698695 >> v1:172.21.2.115:6789/0 conn(0x7f5ed8060100 legacy=0x7f5ed80b1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:30.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.636+0000 7f5eddc87700 1 -- 172.21.2.105:0/151698695 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed8141060 con 0x7f5ed80b37d0 2021-11-12T05:49:30.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.636+0000 7f5eddc87700 1 --2- 172.21.2.105:0/151698695 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ed80b37d0 0x7f5ed8141500 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 rx=0x7f5ed80640c0 tx=0x7f5ecc006eb0).ready entity=mon.0 client_cookie=8d99e712afbd9fa3 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:30.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.636+0000 7f5edd486700 1 -- 172.21.2.105:0/151698695 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ecc00d570 con 0x7f5ed80b37d0 2021-11-12T05:49:30.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.636+0000 7f5edd486700 1 -- 172.21.2.105:0/151698695 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ecc000e90 con 0x7f5ed80b37d0 2021-11-12T05:49:30.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.636+0000 7f5edd486700 1 -- 172.21.2.105:0/151698695 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ecc00d900 con 0x7f5ed80b37d0 2021-11-12T05:49:30.652 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.636+0000 7f5ee06ec700 1 -- 172.21.2.105:0/151698695 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ed80b37d0 msgr2=0x7f5ed8141500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:30.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.636+0000 7f5ee06ec700 1 --2- 172.21.2.105:0/151698695 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ed80b37d0 0x7f5ed8141500 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 rx=0x7f5ed80640c0 tx=0x7f5ecc006eb0).stop 2021-11-12T05:49:30.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.636+0000 7f5ee06ec700 1 -- 172.21.2.105:0/151698695 shutdown_connections 2021-11-12T05:49:30.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.636+0000 7f5ee06ec700 1 --2- 172.21.2.105:0/151698695 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5ed81419f0 0x7f5ed80b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:30.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.636+0000 7f5ee06ec700 1 --2- 172.21.2.105:0/151698695 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ed80b37d0 0x7f5ed8141500 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:30.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.636+0000 7f5ee06ec700 1 -- 172.21.2.105:0/151698695 >> 172.21.2.105:0/151698695 conn(0x7f5ed80608d0 msgr2=0x7f5ed805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:30.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.636+0000 7f5ee06ec700 1 -- 172.21.2.105:0/151698695 shutdown_connections 2021-11-12T05:49:30.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.636+0000 7f5ee06ec700 1 -- 172.21.2.105:0/151698695 wait complete. 2021-11-12T05:49:30.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.636+0000 7f5ee06ec700 1 Processor -- start 2021-11-12T05:49:30.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.636+0000 7f5ee06ec700 1 -- start start 2021-11-12T05:49:30.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.640+0000 7f5ee06ec700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5ed8060100 0x7f5ed8061730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:30.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.640+0000 7f5ee06ec700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ed80b37d0 0x7f5ed80b5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:30.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.640+0000 7f5ee06ec700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5ed81419f0 0x7f5ed80b5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:30.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.640+0000 7f5ee06ec700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed80aeee0 con 0x7f5ed80b37d0 2021-11-12T05:49:30.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.640+0000 7f5ee06ec700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed8063060 con 0x7f5ed8060100 2021-11-12T05:49:30.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.640+0000 7f5ee06ec700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed80b73f0 con 0x7f5ed81419f0 2021-11-12T05:49:30.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.640+0000 7f5eddc87700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ed80b37d0 0x7f5ed80b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:30.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.640+0000 7f5eddc87700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ed80b37d0 0x7f5ed80b5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51922/0 (socket says 172.21.2.105:51922) 2021-11-12T05:49:30.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.640+0000 7f5eddc87700 1 -- 172.21.2.105:0/1575322209 learned_addr learned my addr 172.21.2.105:0/1575322209 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:30.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.640+0000 7f5edec89700 1 --2- 172.21.2.105:0/1575322209 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5ed81419f0 0x7f5ed80b5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:30.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.640+0000 7f5ede488700 1 --2- 172.21.2.105:0/1575322209 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5ed8060100 0x7f5ed8061730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:30.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.640+0000 7f5eddc87700 1 -- 172.21.2.105:0/1575322209 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5ed81419f0 msgr2=0x7f5ed80b5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:30.663 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.640+0000 7f5eddc87700 1 --2- 172.21.2.105:0/1575322209 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5ed81419f0 0x7f5ed80b5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:30.663 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.640+0000 7f5eddc87700 1 -- 172.21.2.105:0/1575322209 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5ed8060100 msgr2=0x7f5ed8061730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:30.664 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.640+0000 7f5eddc87700 1 --2- 172.21.2.105:0/1575322209 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5ed8060100 0x7f5ed8061730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:30.664 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.640+0000 7f5eddc87700 1 -- 172.21.2.105:0/1575322209 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ecc00b1e0 con 0x7f5ed80b37d0 2021-11-12T05:49:30.665 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.640+0000 7f5eddc87700 1 --2- 172.21.2.105:0/1575322209 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ed80b37d0 0x7f5ed80b5960 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 rx=0x7f5ed80640c0 tx=0x7f5ecc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:30.665 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.640+0000 7f5ecb7fe700 1 -- 172.21.2.105:0/1575322209 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ecc006be0 con 0x7f5ed80b37d0 2021-11-12T05:49:30.666 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.640+0000 7f5ecb7fe700 1 -- 172.21.2.105:0/1575322209 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ecc002f50 con 0x7f5ed80b37d0 2021-11-12T05:49:30.666 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.640+0000 7f5ee06ec700 1 -- 172.21.2.105:0/1575322209 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed80b5500 con 0x7f5ed80b37d0 2021-11-12T05:49:30.666 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.640+0000 7f5ecb7fe700 1 -- 172.21.2.105:0/1575322209 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ecc00de40 con 0x7f5ed80b37d0 2021-11-12T05:49:30.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.640+0000 7f5ee06ec700 1 -- 172.21.2.105:0/1575322209 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed80b6970 con 0x7f5ed80b37d0 2021-11-12T05:49:30.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.640+0000 7f5ee06ec700 1 -- 172.21.2.105:0/1575322209 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed8141e80 con 0x7f5ed80b37d0 2021-11-12T05:49:30.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.640+0000 7f5ecb7fe700 1 -- 172.21.2.105:0/1575322209 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5ecc00f070 con 0x7f5ed80b37d0 2021-11-12T05:49:30.668 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.640+0000 7f5ecb7fe700 1 --2- 172.21.2.105:0/1575322209 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5eb8053660 0x7f5eb8055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:30.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.640+0000 7f5ecb7fe700 1 -- 172.21.2.105:0/1575322209 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f5ecc06d310 con 0x7f5ed80b37d0 2021-11-12T05:49:30.669 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.640+0000 7f5ede488700 1 --2- 172.21.2.105:0/1575322209 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5eb8053660 0x7f5eb8055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:30.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.640+0000 7f5ede488700 1 --2- 172.21.2.105:0/1575322209 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5eb8053660 0x7f5eb8055b20 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f5ed400a000 tx=0x7f5ed4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:30.670 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.644+0000 7f5ecb7fe700 1 -- 172.21.2.105:0/1575322209 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5ecc0444e0 con 0x7f5ed80b37d0 2021-11-12T05:49:30.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:30.752+0000 7f5ee06ec700 1 -- 172.21.2.105:0/1575322209 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]} v 0) v1 -- 0x7f5ed8057350 con 0x7f5ed80b37d0 2021-11-12T05:49:31.191 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.188+0000 7f5ecb7fe700 1 -- 172.21.2.105:0/1575322209 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]}]=0 v386) v1 ==== 128+0+0 (secure 0 0 0) 0x7f5ecc047b00 con 0x7f5ed80b37d0 2021-11-12T05:49:31.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.188+0000 7f5ee06ec700 1 -- 172.21.2.105:0/1575322209 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5eb8053660 msgr2=0x7f5eb8055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:31.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.188+0000 7f5ee06ec700 1 --2- 172.21.2.105:0/1575322209 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5eb8053660 0x7f5eb8055b20 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f5ed400a000 tx=0x7f5ed4008040).stop 2021-11-12T05:49:31.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.188+0000 7f5ee06ec700 1 -- 172.21.2.105:0/1575322209 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ed80b37d0 msgr2=0x7f5ed80b5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:31.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.188+0000 7f5ee06ec700 1 --2- 172.21.2.105:0/1575322209 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ed80b37d0 0x7f5ed80b5960 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 rx=0x7f5ed80640c0 tx=0x7f5ecc015000).stop 2021-11-12T05:49:31.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.188+0000 7f5ee06ec700 1 -- 172.21.2.105:0/1575322209 shutdown_connections 2021-11-12T05:49:31.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.188+0000 7f5ee06ec700 1 --2- 172.21.2.105:0/1575322209 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5eb8053660 0x7f5eb8055b20 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:31.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.188+0000 7f5ee06ec700 1 --2- 172.21.2.105:0/1575322209 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5ed81419f0 0x7f5ed80b5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:31.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.188+0000 7f5ee06ec700 1 --2- 172.21.2.105:0/1575322209 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5ed80b37d0 0x7f5ed80b5960 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:31.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.188+0000 7f5ee06ec700 1 --2- 172.21.2.105:0/1575322209 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5ed8060100 0x7f5ed8061730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:31.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.188+0000 7f5ee06ec700 1 -- 172.21.2.105:0/1575322209 >> 172.21.2.105:0/1575322209 conn(0x7f5ed80608d0 msgr2=0x7f5ed8065690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:31.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.188+0000 7f5ee06ec700 1 -- 172.21.2.105:0/1575322209 shutdown_connections 2021-11-12T05:49:31.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.188+0000 7f5ee06ec700 1 -- 172.21.2.105:0/1575322209 wait complete. 2021-11-12T05:49:31.199 INFO:tasks.cephfs_test_runner:test_getattr_caps (tasks.cephfs.test_misc.TestMisc) ... ok 2021-11-12T05:49:31.200 INFO:tasks.cephfs_test_runner:Starting test: test_root_rctime (tasks.cephfs.test_misc.TestMisc) 2021-11-12T05:49:31.201 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_root_rctime' 2021-11-12T05:49:31.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.248+0000 7f5c883a4700 1 Processor -- start 2021-11-12T05:49:31.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.248+0000 7f5c883a4700 1 -- start start 2021-11-12T05:49:31.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.248+0000 7f5c883a4700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f5c800ad080 0x7f5c800af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:31.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.248+0000 7f5c883a4700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c800ac7b0 con 0x7f5c8014b2f0 2021-11-12T05:49:31.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.248+0000 7f5c883a4700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c800ac9e0 con 0x7f5c800ac280 2021-11-12T05:49:31.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.248+0000 7f5c883a4700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c801488a0 con 0x7f5c800ad080 2021-11-12T05:49:31.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.248+0000 7f5c86941700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f5c8014b2f0 0x7f5c80147a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34096/0 (socket says 172.21.2.105:34096) 2021-11-12T05:49:31.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.248+0000 7f5c86941700 1 -- 172.21.2.105:0/3146091877 learned_addr learned my addr 172.21.2.105:0/3146091877 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:31.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.248+0000 7f5c8513e700 1 -- 172.21.2.105:0/3146091877 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3228130886 0 0) 0x7f5c800ac7b0 con 0x7f5c8014b2f0 2021-11-12T05:49:31.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.248+0000 7f5c8513e700 1 -- 172.21.2.105:0/3146091877 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c68003260 con 0x7f5c8014b2f0 2021-11-12T05:49:31.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.248+0000 7f5c86140700 1 --2- 172.21.2.105:0/3146091877 >> v2:172.21.2.115:3300/0 conn(0x7f5c800ad080 0x7f5c800af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:31.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.248+0000 7f5c8513e700 1 -- 172.21.2.105:0/3146091877 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3793364807 0 0) 0x7f5c68003260 con 0x7f5c8014b2f0 2021-11-12T05:49:31.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.248+0000 7f5c8513e700 1 -- 172.21.2.105:0/3146091877 >> v2:172.21.2.115:3300/0 conn(0x7f5c800ad080 msgr2=0x7f5c800af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:31.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.248+0000 7f5c8513e700 1 --2- 172.21.2.105:0/3146091877 >> v2:172.21.2.115:3300/0 conn(0x7f5c800ad080 0x7f5c800af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:31.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.248+0000 7f5c8513e700 1 -- 172.21.2.105:0/3146091877 >> v1:172.21.2.115:6789/0 conn(0x7f5c800ac280 legacy=0x7f5c8014abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:31.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.248+0000 7f5c8513e700 1 -- 172.21.2.105:0/3146091877 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c800b0b30 con 0x7f5c8014b2f0 2021-11-12T05:49:31.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.248+0000 7f5c8513e700 1 -- 172.21.2.105:0/3146091877 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f5c780019e0 con 0x7f5c8014b2f0 2021-11-12T05:49:31.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.248+0000 7f5c8513e700 1 -- 172.21.2.105:0/3146091877 >> v1:172.21.2.105:6789/0 conn(0x7f5c8014b2f0 legacy=0x7f5c80147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:31.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.248+0000 7f5c8513e700 1 --2- 172.21.2.105:0/3146091877 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5c680037a0 0x7f5c68003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:31.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.248+0000 7f5c8513e700 1 --2- 172.21.2.105:0/3146091877 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c68004500 0x7f5c68004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:31.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.248+0000 7f5c8513e700 1 --2- 172.21.2.105:0/3146091877 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5c68004f90 0x7f5c6800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:31.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.248+0000 7f5c8513e700 1 -- 172.21.2.105:0/3146091877 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c801488a0 con 0x7f5c68004500 2021-11-12T05:49:31.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.248+0000 7f5c8513e700 1 -- 172.21.2.105:0/3146091877 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6800be00 con 0x7f5c680037a0 2021-11-12T05:49:31.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.248+0000 7f5c8513e700 1 -- 172.21.2.105:0/3146091877 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6800bfc0 con 0x7f5c68004f90 2021-11-12T05:49:31.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.248+0000 7f5c8593f700 1 --2- 172.21.2.105:0/3146091877 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c68004500 0x7f5c68004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:31.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.248+0000 7f5c86941700 1 --2- 172.21.2.105:0/3146091877 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5c68004f90 0x7f5c6800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:31.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.248+0000 7f5c86140700 1 --2- 172.21.2.105:0/3146091877 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5c680037a0 0x7f5c68003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:31.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.248+0000 7f5c8593f700 1 -- 172.21.2.105:0/3146091877 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5c68004f90 msgr2=0x7f5c6800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:31.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.248+0000 7f5c8593f700 1 --2- 172.21.2.105:0/3146091877 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5c68004f90 0x7f5c6800b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:31.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.248+0000 7f5c8593f700 1 -- 172.21.2.105:0/3146091877 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5c680037a0 msgr2=0x7f5c68003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:31.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.248+0000 7f5c8593f700 1 --2- 172.21.2.105:0/3146091877 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5c680037a0 0x7f5c68003bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:31.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.248+0000 7f5c8593f700 1 -- 172.21.2.105:0/3146091877 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c68003260 con 0x7f5c68004500 2021-11-12T05:49:31.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.248+0000 7f5c86941700 1 -- 172.21.2.105:0/3146091877 reap_dead start 2021-11-12T05:49:31.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.248+0000 7f5c8593f700 1 --2- 172.21.2.105:0/3146091877 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c68004500 0x7f5c68004980 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 rx=0x7f5c800b0eb0 tx=0x7f5c7c007a00).ready entity=mon.0 client_cookie=103609dd56ab84cf server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:31.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.248+0000 7f5c8513e700 1 -- 172.21.2.105:0/3146091877 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c7c007d10 con 0x7f5c68004500 2021-11-12T05:49:31.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.248+0000 7f5c8513e700 1 -- 172.21.2.105:0/3146091877 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c7c007030 con 0x7f5c68004500 2021-11-12T05:49:31.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.248+0000 7f5c8513e700 1 -- 172.21.2.105:0/3146091877 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c7c007390 con 0x7f5c68004500 2021-11-12T05:49:31.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.252+0000 7f5c883a4700 1 -- 172.21.2.105:0/3146091877 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c68004500 msgr2=0x7f5c68004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:31.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.252+0000 7f5c883a4700 1 --2- 172.21.2.105:0/3146091877 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c68004500 0x7f5c68004980 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 rx=0x7f5c800b0eb0 tx=0x7f5c7c007a00).stop 2021-11-12T05:49:31.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.252+0000 7f5c883a4700 1 -- 172.21.2.105:0/3146091877 shutdown_connections 2021-11-12T05:49:31.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.252+0000 7f5c883a4700 1 --2- 172.21.2.105:0/3146091877 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c68004500 0x7f5c68004980 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:31.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.252+0000 7f5c883a4700 1 -- 172.21.2.105:0/3146091877 >> 172.21.2.105:0/3146091877 conn(0x7f5c800b5370 msgr2=0x7f5c800b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:31.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.252+0000 7f5c883a4700 1 -- 172.21.2.105:0/3146091877 shutdown_connections 2021-11-12T05:49:31.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.252+0000 7f5c883a4700 1 -- 172.21.2.105:0/3146091877 wait complete. 2021-11-12T05:49:31.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.252+0000 7f5c883a4700 1 Processor -- start 2021-11-12T05:49:31.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.252+0000 7f5c883a4700 1 -- start start 2021-11-12T05:49:31.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.252+0000 7f5c883a4700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5c68004500 0x7f5c801470a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:31.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.252+0000 7f5c883a4700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5c8014ae10 0x7f5c8015a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:31.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.252+0000 7f5c883a4700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c8014a080 0x7f5c8015ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:31.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.252+0000 7f5c883a4700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c800aa140 con 0x7f5c8014a080 2021-11-12T05:49:31.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.252+0000 7f5c883a4700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8015a290 con 0x7f5c8014ae10 2021-11-12T05:49:31.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.252+0000 7f5c883a4700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c80147590 con 0x7f5c68004500 2021-11-12T05:49:31.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.252+0000 7f5c86941700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c8014a080 0x7f5c8015ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:31.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.252+0000 7f5c86941700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c8014a080 0x7f5c8015ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51944/0 (socket says 172.21.2.105:51944) 2021-11-12T05:49:31.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.252+0000 7f5c86941700 1 -- 172.21.2.105:0/2236995099 learned_addr learned my addr 172.21.2.105:0/2236995099 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:31.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.252+0000 7f5c86140700 1 --2- 172.21.2.105:0/2236995099 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5c68004500 0x7f5c801470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:31.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.252+0000 7f5c8593f700 1 --2- 172.21.2.105:0/2236995099 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5c8014ae10 0x7f5c8015a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:31.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.252+0000 7f5c86941700 1 -- 172.21.2.105:0/2236995099 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5c68004500 msgr2=0x7f5c801470a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:31.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.252+0000 7f5c86941700 1 --2- 172.21.2.105:0/2236995099 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5c68004500 0x7f5c801470a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:31.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.252+0000 7f5c86941700 1 -- 172.21.2.105:0/2236995099 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5c8014ae10 msgr2=0x7f5c8015a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:31.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.252+0000 7f5c86941700 1 --2- 172.21.2.105:0/2236995099 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5c8014ae10 0x7f5c8015a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:31.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.252+0000 7f5c86941700 1 -- 172.21.2.105:0/2236995099 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c800a9e30 con 0x7f5c8014a080 2021-11-12T05:49:31.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.252+0000 7f5c86941700 1 --2- 172.21.2.105:0/2236995099 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c8014a080 0x7f5c8015ac20 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 rx=0x7f5c78001bc0 tx=0x7f5c78009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:31.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.252+0000 7f5c737fe700 1 -- 172.21.2.105:0/2236995099 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c78004ab0 con 0x7f5c8014a080 2021-11-12T05:49:31.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.252+0000 7f5c737fe700 1 -- 172.21.2.105:0/2236995099 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c78004c10 con 0x7f5c8014a080 2021-11-12T05:49:31.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.252+0000 7f5c737fe700 1 -- 172.21.2.105:0/2236995099 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c780070d0 con 0x7f5c8014a080 2021-11-12T05:49:31.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.252+0000 7f5c883a4700 1 -- 172.21.2.105:0/2236995099 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c80148ae0 con 0x7f5c8014a080 2021-11-12T05:49:31.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.252+0000 7f5c883a4700 1 -- 172.21.2.105:0/2236995099 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c80148f60 con 0x7f5c8014a080 2021-11-12T05:49:31.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.252+0000 7f5c883a4700 1 -- 172.21.2.105:0/2236995099 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c8015a450 con 0x7f5c8014a080 2021-11-12T05:49:31.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.252+0000 7f5c737fe700 1 -- 172.21.2.105:0/2236995099 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5c7801d070 con 0x7f5c8014a080 2021-11-12T05:49:31.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.252+0000 7f5c737fe700 1 --2- 172.21.2.105:0/2236995099 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5c60053610 0x7f5c60055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:31.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.252+0000 7f5c737fe700 1 -- 172.21.2.105:0/2236995099 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f5c7806ad50 con 0x7f5c8014a080 2021-11-12T05:49:31.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.252+0000 7f5c86140700 1 --2- 172.21.2.105:0/2236995099 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5c60053610 0x7f5c60055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:31.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.252+0000 7f5c86140700 1 --2- 172.21.2.105:0/2236995099 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5c60053610 0x7f5c60055ad0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f5c74009000 tx=0x7f5c74008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:31.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.256+0000 7f5c737fe700 1 -- 172.21.2.105:0/2236995099 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5c78041f90 con 0x7f5c8014a080 2021-11-12T05:49:31.373 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:31.368+0000 7f5c883a4700 1 -- 172.21.2.105:0/2236995099 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]} v 0) v1 -- 0x7f5c800b1440 con 0x7f5c8014a080 2021-11-12T05:49:32.196 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.192+0000 7f5c737fe700 1 -- 172.21.2.105:0/2236995099 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]}]=0 v387) v1 ==== 130+0+0 (secure 0 0 0) 0x7f5c780455b0 con 0x7f5c8014a080 2021-11-12T05:49:32.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.192+0000 7f5c883a4700 1 -- 172.21.2.105:0/2236995099 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5c60053610 msgr2=0x7f5c60055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:32.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.192+0000 7f5c883a4700 1 --2- 172.21.2.105:0/2236995099 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5c60053610 0x7f5c60055ad0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f5c74009000 tx=0x7f5c74008040).stop 2021-11-12T05:49:32.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.192+0000 7f5c883a4700 1 -- 172.21.2.105:0/2236995099 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c8014a080 msgr2=0x7f5c8015ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:32.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.192+0000 7f5c883a4700 1 --2- 172.21.2.105:0/2236995099 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c8014a080 0x7f5c8015ac20 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 rx=0x7f5c78001bc0 tx=0x7f5c78009040).stop 2021-11-12T05:49:32.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.192+0000 7f5c883a4700 1 -- 172.21.2.105:0/2236995099 shutdown_connections 2021-11-12T05:49:32.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.192+0000 7f5c883a4700 1 --2- 172.21.2.105:0/2236995099 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5c60053610 0x7f5c60055ad0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:32.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.192+0000 7f5c883a4700 1 --2- 172.21.2.105:0/2236995099 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5c8014a080 0x7f5c8015ac20 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:32.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.192+0000 7f5c883a4700 1 --2- 172.21.2.105:0/2236995099 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f5c8014ae10 0x7f5c8015a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:32.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.192+0000 7f5c883a4700 1 --2- 172.21.2.105:0/2236995099 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f5c68004500 0x7f5c801470a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:32.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.192+0000 7f5c883a4700 1 -- 172.21.2.105:0/2236995099 >> 172.21.2.105:0/2236995099 conn(0x7f5c800b5370 msgr2=0x7f5c800606e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:32.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.192+0000 7f5c883a4700 1 -- 172.21.2.105:0/2236995099 shutdown_connections 2021-11-12T05:49:32.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.192+0000 7f5c883a4700 1 -- 172.21.2.105:0/2236995099 wait complete. 2021-11-12T05:49:32.205 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-11-12T05:49:32.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.252+0000 7fbf8b28e700 1 Processor -- start 2021-11-12T05:49:32.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf8b28e700 1 -- start start 2021-11-12T05:49:32.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf8b28e700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fbf84067170 0x7fbf84065010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:32.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf8b28e700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf84067600 con 0x7fbf84140f90 2021-11-12T05:49:32.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf8b28e700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf840b8060 con 0x7fbf840b7c80 2021-11-12T05:49:32.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf8b28e700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf84067d80 con 0x7fbf84067170 2021-11-12T05:49:32.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf8982b700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fbf84140f90 0x7fbf841413b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34112/0 (socket says 172.21.2.105:34112) 2021-11-12T05:49:32.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf8982b700 1 -- 172.21.2.105:0/2889165310 learned_addr learned my addr 172.21.2.105:0/2889165310 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:32.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf88829700 1 --2- 172.21.2.105:0/2889165310 >> v2:172.21.2.105:3300/0 conn(0x7fbf84067170 0x7fbf84065010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:32.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf88829700 1 -- 172.21.2.105:0/2889165310 >> v1:172.21.2.115:6789/0 conn(0x7fbf840b7c80 legacy=0x7fbf84064900 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:49:32.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf88829700 1 -- 172.21.2.105:0/2889165310 >> v1:172.21.2.105:6789/0 conn(0x7fbf84140f90 legacy=0x7fbf841413b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:32.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf88829700 1 -- 172.21.2.105:0/2889165310 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf84067840 con 0x7fbf84067170 2021-11-12T05:49:32.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf88829700 1 --2- 172.21.2.105:0/2889165310 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbf84067170 0x7fbf84065010 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 rx=0x7fbf840b7850 tx=0x7fbf7c0091d0).ready entity=mon.0 client_cookie=aa2e13e0c5805c25 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:32.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf73fff700 1 -- 172.21.2.105:0/2889165310 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf7c009ea0 con 0x7fbf84067170 2021-11-12T05:49:32.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf73fff700 1 -- 172.21.2.105:0/2889165310 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7c00b860 con 0x7fbf84067170 2021-11-12T05:49:32.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf73fff700 1 -- 172.21.2.105:0/2889165310 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf7c00b9d0 con 0x7fbf84067170 2021-11-12T05:49:32.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf8b28e700 1 -- 172.21.2.105:0/2889165310 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbf84067170 msgr2=0x7fbf84065010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:32.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf8b28e700 1 --2- 172.21.2.105:0/2889165310 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbf84067170 0x7fbf84065010 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 rx=0x7fbf840b7850 tx=0x7fbf7c0091d0).stop 2021-11-12T05:49:32.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf8b28e700 1 -- 172.21.2.105:0/2889165310 shutdown_connections 2021-11-12T05:49:32.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf8b28e700 1 --2- 172.21.2.105:0/2889165310 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbf84067170 0x7fbf84065010 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:32.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf8b28e700 1 -- 172.21.2.105:0/2889165310 >> 172.21.2.105:0/2889165310 conn(0x7fbf8405c860 msgr2=0x7fbf840608d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:32.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf8b28e700 1 -- 172.21.2.105:0/2889165310 shutdown_connections 2021-11-12T05:49:32.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf8b28e700 1 -- 172.21.2.105:0/2889165310 wait complete. 2021-11-12T05:49:32.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf8b28e700 1 Processor -- start 2021-11-12T05:49:32.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf8b28e700 1 -- start start 2021-11-12T05:49:32.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf8b28e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbf84067170 0x7fbf840b3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:32.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf8b28e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbf840b7c80 0x7fbf841504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:32.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf8b28e700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbf84140f90 0x7fbf8413c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:32.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf8b28e700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf84153ac0 con 0x7fbf84067170 2021-11-12T05:49:32.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf8b28e700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf840b3d40 con 0x7fbf84140f90 2021-11-12T05:49:32.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf8b28e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf84153cb0 con 0x7fbf840b7c80 2021-11-12T05:49:32.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf8902a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbf84067170 0x7fbf840b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:32.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf8902a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbf84067170 0x7fbf840b3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51956/0 (socket says 172.21.2.105:51956) 2021-11-12T05:49:32.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf8902a700 1 -- 172.21.2.105:0/3539108467 learned_addr learned my addr 172.21.2.105:0/3539108467 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:32.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf8902a700 1 -- 172.21.2.105:0/3539108467 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbf840b7c80 msgr2=0x7fbf841504f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:32.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf8902a700 1 --2- 172.21.2.105:0/3539108467 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbf840b7c80 0x7fbf841504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:32.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf8902a700 1 -- 172.21.2.105:0/3539108467 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbf84140f90 msgr2=0x7fbf8413c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:32.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf8902a700 1 --2- 172.21.2.105:0/3539108467 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbf84140f90 0x7fbf8413c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:32.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf8902a700 1 -- 172.21.2.105:0/3539108467 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf7c009470 con 0x7fbf84067170 2021-11-12T05:49:32.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf8902a700 1 --2- 172.21.2.105:0/3539108467 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbf84067170 0x7fbf840b3710 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 rx=0x7fbf74002fb0 tx=0x7fbf74006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:32.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf727fc700 1 -- 172.21.2.105:0/3539108467 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf74013460 con 0x7fbf84067170 2021-11-12T05:49:32.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf727fc700 1 -- 172.21.2.105:0/3539108467 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf740135c0 con 0x7fbf84067170 2021-11-12T05:49:32.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf8b28e700 1 -- 172.21.2.105:0/3539108467 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf8413bcc0 con 0x7fbf84067170 2021-11-12T05:49:32.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf727fc700 1 -- 172.21.2.105:0/3539108467 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf74013920 con 0x7fbf84067170 2021-11-12T05:49:32.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.256+0000 7fbf8b28e700 1 -- 172.21.2.105:0/3539108467 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf8413cc20 con 0x7fbf84067170 2021-11-12T05:49:32.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.260+0000 7fbf8b28e700 1 -- 172.21.2.105:0/3539108467 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf84067ae0 con 0x7fbf84067170 2021-11-12T05:49:32.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.260+0000 7fbf727fc700 1 -- 172.21.2.105:0/3539108467 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbf7400f070 con 0x7fbf84067170 2021-11-12T05:49:32.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.260+0000 7fbf727fc700 1 --2- 172.21.2.105:0/3539108467 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbf64053580 0x7fbf64055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:32.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.260+0000 7fbf727fc700 1 -- 172.21.2.105:0/3539108467 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fbf7406b2a0 con 0x7fbf84067170 2021-11-12T05:49:32.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.260+0000 7fbf88829700 1 --2- 172.21.2.105:0/3539108467 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbf64053580 0x7fbf64055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:32.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.260+0000 7fbf88829700 1 --2- 172.21.2.105:0/3539108467 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbf64053580 0x7fbf64055a40 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7fbf840b7850 tx=0x7fbf7c016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:32.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.260+0000 7fbf727fc700 1 -- 172.21.2.105:0/3539108467 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbf74042470 con 0x7fbf84067170 2021-11-12T05:49:32.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.344+0000 7fbf8b28e700 1 -- 172.21.2.105:0/3539108467 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fbf840b3f00 con 0x7fbf84067170 2021-11-12T05:49:32.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.352+0000 7fbf727fc700 1 -- 172.21.2.105:0/3539108467 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbf74045a90 con 0x7fbf84067170 2021-11-12T05:49:32.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.352+0000 7fbf8b28e700 1 -- 172.21.2.105:0/3539108467 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbf64053580 msgr2=0x7fbf64055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:32.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.352+0000 7fbf8b28e700 1 --2- 172.21.2.105:0/3539108467 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbf64053580 0x7fbf64055a40 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7fbf840b7850 tx=0x7fbf7c016000).stop 2021-11-12T05:49:32.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.352+0000 7fbf8b28e700 1 -- 172.21.2.105:0/3539108467 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbf84067170 msgr2=0x7fbf840b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:32.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.352+0000 7fbf8b28e700 1 --2- 172.21.2.105:0/3539108467 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbf84067170 0x7fbf840b3710 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 rx=0x7fbf74002fb0 tx=0x7fbf74006df0).stop 2021-11-12T05:49:32.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.352+0000 7fbf8b28e700 1 -- 172.21.2.105:0/3539108467 shutdown_connections 2021-11-12T05:49:32.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.352+0000 7fbf8b28e700 1 --2- 172.21.2.105:0/3539108467 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbf64053580 0x7fbf64055a40 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:32.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.352+0000 7fbf8b28e700 1 --2- 172.21.2.105:0/3539108467 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbf84140f90 0x7fbf8413c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:32.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.352+0000 7fbf8b28e700 1 --2- 172.21.2.105:0/3539108467 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbf840b7c80 0x7fbf841504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:32.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.352+0000 7fbf8b28e700 1 --2- 172.21.2.105:0/3539108467 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbf84067170 0x7fbf840b3710 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:32.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.352+0000 7fbf8b28e700 1 -- 172.21.2.105:0/3539108467 >> 172.21.2.105:0/3539108467 conn(0x7fbf8405c860 msgr2=0x7fbf84144e30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:32.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.352+0000 7fbf8b28e700 1 -- 172.21.2.105:0/3539108467 shutdown_connections 2021-11-12T05:49:32.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.352+0000 7fbf8b28e700 1 -- 172.21.2.105:0/3539108467 wait complete. 2021-11-12T05:49:32.363 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-12T05:49:32.363 DEBUG:teuthology.orchestra.run.gibba005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:49:32.371 DEBUG:teuthology.orchestra.run.gibba015:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:49:32.380 DEBUG:teuthology.orchestra.run.gibba016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:49:32.393 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:49:32.407 DEBUG:teuthology.orchestra.run.gibba044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:49:32.421 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-12T05:49:32.422 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:32.422 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:49:32.422 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:49:32.427 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:49:32.427 INFO:teuthology.orchestra.run.gibba016.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-12T05:49:32.428 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-11-12T05:49:32.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:32.429 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:49:32.429 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:49:32.433 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:49:32.434 INFO:teuthology.orchestra.run.gibba038.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-12T05:49:32.435 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-12T05:49:32.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:32.436 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:49:32.436 DEBUG:teuthology.orchestra.run.gibba044:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:49:32.440 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:49:32.441 INFO:teuthology.orchestra.run.gibba044.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-12T05:49:32.441 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-12T05:49:32.441 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-12T05:49:32.499 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f181bf65700 1 Processor -- start 2021-11-12T05:49:32.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f181bf65700 1 -- start start 2021-11-12T05:49:32.505 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f181bf65700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f1814060100 0x7f18140b1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:32.505 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f181bf65700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f18140b37d0 0x7f1814141500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:32.505 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f181bf65700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f18141419f0 0x7f18141298d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:32.505 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f181bf65700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18140604e0 con 0x7f1814060100 2021-11-12T05:49:32.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f181bf65700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1814145160 con 0x7f18141419f0 2021-11-12T05:49:32.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f181bf65700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1814141060 con 0x7f18140b37d0 2021-11-12T05:49:32.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f1819d01700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f1814060100 0x7f18140b1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:32.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f1819d01700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f1814060100 0x7f18140b1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51960/0 (socket says 172.21.2.105:51960) 2021-11-12T05:49:32.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f1819d01700 1 -- 172.21.2.105:0/776453072 learned_addr learned my addr 172.21.2.105:0/776453072 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:32.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f1819d01700 1 -- 172.21.2.105:0/776453072 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f18140b37d0 msgr2=0x7f1814141500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:32.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f1819d01700 1 --2- 172.21.2.105:0/776453072 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f18140b37d0 0x7f1814141500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:32.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f1819d01700 1 -- 172.21.2.105:0/776453072 >> v2:172.21.2.115:3300/0 conn(0x7f18141419f0 msgr2=0x7f18141298d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:32.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f1819d01700 1 --2- 172.21.2.105:0/776453072 >> v2:172.21.2.115:3300/0 conn(0x7f18141419f0 0x7f18141298d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:32.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f1819d01700 1 -- 172.21.2.105:0/776453072 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1814141e80 con 0x7f1814060100 2021-11-12T05:49:32.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f1819d01700 1 --2- 172.21.2.105:0/776453072 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1814060100 0x7f18140b1fd0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 rx=0x7f1810002f70 tx=0x7f1810006eb0).ready entity=mon.0 client_cookie=8f7b676f1f9c11ce server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:32.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f1818cff700 1 -- 172.21.2.105:0/776453072 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f181000d570 con 0x7f1814060100 2021-11-12T05:49:32.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f1818cff700 1 -- 172.21.2.105:0/776453072 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1810000e90 con 0x7f1814060100 2021-11-12T05:49:32.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f1818cff700 1 -- 172.21.2.105:0/776453072 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f181000d900 con 0x7f1814060100 2021-11-12T05:49:32.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f181bf65700 1 -- 172.21.2.105:0/776453072 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1814060100 msgr2=0x7f18140b1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:32.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f181bf65700 1 --2- 172.21.2.105:0/776453072 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1814060100 0x7f18140b1fd0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 rx=0x7f1810002f70 tx=0x7f1810006eb0).stop 2021-11-12T05:49:32.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f181bf65700 1 -- 172.21.2.105:0/776453072 shutdown_connections 2021-11-12T05:49:32.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f181bf65700 1 --2- 172.21.2.105:0/776453072 >> v2:172.21.2.115:3300/0 conn(0x7f18141419f0 0x7f18141298d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:32.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f181bf65700 1 --2- 172.21.2.105:0/776453072 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f18140b37d0 0x7f1814141500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:32.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f181bf65700 1 --2- 172.21.2.105:0/776453072 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1814060100 0x7f18140b1fd0 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:32.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f181bf65700 1 -- 172.21.2.105:0/776453072 >> 172.21.2.105:0/776453072 conn(0x7f18140608d0 msgr2=0x7f181405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:32.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f181bf65700 1 -- 172.21.2.105:0/776453072 shutdown_connections 2021-11-12T05:49:32.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f181bf65700 1 -- 172.21.2.105:0/776453072 wait complete. 2021-11-12T05:49:32.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f181bf65700 1 Processor -- start 2021-11-12T05:49:32.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f181bf65700 1 -- start start 2021-11-12T05:49:32.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f181bf65700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1814060100 0x7f18140ae3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:32.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f181bf65700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f18140b37d0 0x7f1814143f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:32.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f181bf65700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f18141419f0 0x7f1814150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:32.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f181bf65700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181412da50 con 0x7f18140b37d0 2021-11-12T05:49:32.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f181bf65700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181412dcf0 con 0x7f18141419f0 2021-11-12T05:49:32.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f181bf65700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18141502c0 con 0x7f1814060100 2021-11-12T05:49:32.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f1819500700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f18140b37d0 0x7f1814143f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:32.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f1819500700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f18140b37d0 0x7f1814143f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51968/0 (socket says 172.21.2.105:51968) 2021-11-12T05:49:32.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.496+0000 7f1819500700 1 -- 172.21.2.105:0/761770412 learned_addr learned my addr 172.21.2.105:0/761770412 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:32.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.500+0000 7f1819500700 1 -- 172.21.2.105:0/761770412 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1814060100 msgr2=0x7f18140ae3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:32.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.500+0000 7f1819500700 1 --2- 172.21.2.105:0/761770412 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1814060100 0x7f18140ae3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:32.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.500+0000 7f1819500700 1 -- 172.21.2.105:0/761770412 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f18141419f0 msgr2=0x7f1814150760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:32.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.500+0000 7f1819500700 1 --2- 172.21.2.105:0/761770412 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f18141419f0 0x7f1814150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:32.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.500+0000 7f1819500700 1 -- 172.21.2.105:0/761770412 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181000b1e0 con 0x7f18140b37d0 2021-11-12T05:49:32.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.500+0000 7f1819500700 1 --2- 172.21.2.105:0/761770412 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f18140b37d0 0x7f1814143f20 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 rx=0x7f1804002f70 tx=0x7f1804006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:32.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.500+0000 7f1802ffd700 1 -- 172.21.2.105:0/761770412 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1804013460 con 0x7f18140b37d0 2021-11-12T05:49:32.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.500+0000 7f1802ffd700 1 -- 172.21.2.105:0/761770412 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18040135c0 con 0x7f18140b37d0 2021-11-12T05:49:32.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.500+0000 7f1802ffd700 1 -- 172.21.2.105:0/761770412 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1804013920 con 0x7f18140b37d0 2021-11-12T05:49:32.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.500+0000 7f181bf65700 1 -- 172.21.2.105:0/761770412 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f181414fff0 con 0x7f18140b37d0 2021-11-12T05:49:32.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.500+0000 7f181bf65700 1 -- 172.21.2.105:0/761770412 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1814144410 con 0x7f18140b37d0 2021-11-12T05:49:32.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.500+0000 7f181bf65700 1 -- 172.21.2.105:0/761770412 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1814150480 con 0x7f18140b37d0 2021-11-12T05:49:32.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.500+0000 7f1802ffd700 1 -- 172.21.2.105:0/761770412 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f180400f070 con 0x7f18140b37d0 2021-11-12T05:49:32.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.500+0000 7f1802ffd700 1 --2- 172.21.2.105:0/761770412 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f17f4053580 0x7f17f4055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:32.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.500+0000 7f1802ffd700 1 -- 172.21.2.105:0/761770412 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f180406b130 con 0x7f18140b37d0 2021-11-12T05:49:32.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.500+0000 7f1819d01700 1 --2- 172.21.2.105:0/761770412 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f17f4053580 0x7f17f4055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:32.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.500+0000 7f1819d01700 1 --2- 172.21.2.105:0/761770412 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f17f4053580 0x7f17f4055a40 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f1810002f70 tx=0x7f1810015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:32.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.500+0000 7f1802ffd700 1 -- 172.21.2.105:0/761770412 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1804042410 con 0x7f18140b37d0 2021-11-12T05:49:32.590 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.584+0000 7f181bf65700 1 -- 172.21.2.105:0/761770412 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f1814140d50 con 0x7f18140b37d0 2021-11-12T05:49:32.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.588+0000 7f1802ffd700 1 -- 172.21.2.105:0/761770412 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v139) v1 ==== 81+0+29227 (secure 0 0 0) 0x7f1804045a30 con 0x7f18140b37d0 2021-11-12T05:49:32.592 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:32.592 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:49:32.593 INFO:teuthology.orchestra.run.gibba005.stdout: "epoch": 139, 2021-11-12T05:49:32.593 INFO:teuthology.orchestra.run.gibba005.stdout: "fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", 2021-11-12T05:49:32.593 INFO:teuthology.orchestra.run.gibba005.stdout: "created": "2021-11-12T05:40:19.986390+0000", 2021-11-12T05:49:32.593 INFO:teuthology.orchestra.run.gibba005.stdout: "modified": "2021-11-12T05:49:30.179395+0000", 2021-11-12T05:49:32.594 INFO:teuthology.orchestra.run.gibba005.stdout: "last_up_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:49:32.594 INFO:teuthology.orchestra.run.gibba005.stdout: "last_in_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:49:32.594 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-12T05:49:32.594 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_num": 5799936, 2021-11-12T05:49:32.594 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_set": [ 2021-11-12T05:49:32.595 INFO:teuthology.orchestra.run.gibba005.stdout: "pglog_hardlimit", 2021-11-12T05:49:32.595 INFO:teuthology.orchestra.run.gibba005.stdout: "purged_snapdirs", 2021-11-12T05:49:32.595 INFO:teuthology.orchestra.run.gibba005.stdout: "recovery_deletes", 2021-11-12T05:49:32.595 INFO:teuthology.orchestra.run.gibba005.stdout: "sortbitwise" 2021-11-12T05:49:32.596 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:49:32.596 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_version": 5, 2021-11-12T05:49:32.596 INFO:teuthology.orchestra.run.gibba005.stdout: "full_ratio": 0.94999998807907104, 2021-11-12T05:49:32.596 INFO:teuthology.orchestra.run.gibba005.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-12T05:49:32.596 INFO:teuthology.orchestra.run.gibba005.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-12T05:49:32.597 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_snapshot": "", 2021-11-12T05:49:32.597 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_max": 26, 2021-11-12T05:49:32.597 INFO:teuthology.orchestra.run.gibba005.stdout: "max_osd": 8, 2021-11-12T05:49:32.597 INFO:teuthology.orchestra.run.gibba005.stdout: "require_min_compat_client": "jewel", 2021-11-12T05:49:32.598 INFO:teuthology.orchestra.run.gibba005.stdout: "min_compat_client": "jewel", 2021-11-12T05:49:32.598 INFO:teuthology.orchestra.run.gibba005.stdout: "require_osd_release": "octopus", 2021-11-12T05:49:32.598 INFO:teuthology.orchestra.run.gibba005.stdout: "pools": [ 2021-11-12T05:49:32.598 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.598 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 1, 2021-11-12T05:49:32.599 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "device_health_metrics", 2021-11-12T05:49:32.599 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:22.022116+0000", 2021-11-12T05:49:32.599 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:49:32.599 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:49:32.600 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:49:32.600 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:49:32.600 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:49:32.600 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:49:32.600 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:49:32.601 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:49:32.601 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 1, 2021-11-12T05:49:32.601 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 1, 2021-11-12T05:49:32.601 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 1, 2021-11-12T05:49:32.601 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 1, 2021-11-12T05:49:32.602 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 1, 2021-11-12T05:49:32.602 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:49:32.602 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:49:32.602 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:49:32.603 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:49:32.603 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:49:32.603 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:49:32.603 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:49:32.604 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.604 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "16", 2021-11-12T05:49:32.604 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:49:32.604 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:49:32.604 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:49:32.605 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:49:32.605 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:49:32.605 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:49:32.605 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:49:32.606 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:49:32.606 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:49:32.606 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:49:32.606 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:49:32.607 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:49:32.607 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:49:32.607 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:49:32.607 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:49:32.607 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:49:32.608 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:49:32.608 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:49:32.608 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:49:32.608 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:49:32.609 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:49:32.609 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:49:32.609 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:49:32.609 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:49:32.609 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:49:32.610 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:49:32.610 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.610 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:49:32.610 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:49:32.610 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:49:32.611 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:49:32.611 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:49:32.611 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:49:32.611 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:49:32.612 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:49:32.612 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:49:32.612 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:49:32.612 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:49:32.612 INFO:teuthology.orchestra.run.gibba005.stdout: "options": { 2021-11-12T05:49:32.613 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_min": 1 2021-11-12T05:49:32.613 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.613 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:49:32.613 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr_devicehealth": {} 2021-11-12T05:49:32.613 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:32.614 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.614 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.614 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 2, 2021-11-12T05:49:32.614 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "rbd", 2021-11-12T05:49:32.615 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:29.953617+0000", 2021-11-12T05:49:32.615 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:49:32.615 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:49:32.615 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:49:32.615 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:49:32.616 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:49:32.616 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:49:32.616 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:49:32.616 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:49:32.617 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:49:32.617 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:49:32.617 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:49:32.617 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:49:32.617 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:49:32.618 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:49:32.618 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:49:32.618 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:49:32.618 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:49:32.619 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:49:32.619 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:49:32.619 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:49:32.619 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.619 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "19", 2021-11-12T05:49:32.620 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:49:32.620 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:49:32.620 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:49:32.620 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:49:32.620 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:49:32.621 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:49:32.621 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:49:32.621 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:49:32.621 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:49:32.622 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:49:32.622 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:49:32.622 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:49:32.622 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:49:32.622 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:49:32.623 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:49:32.623 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:49:32.623 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:49:32.623 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:49:32.624 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:49:32.624 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:49:32.624 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:49:32.624 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:49:32.624 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:49:32.625 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:49:32.625 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:49:32.625 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:49:32.625 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.625 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:49:32.626 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:49:32.626 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:49:32.626 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:49:32.626 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:49:32.627 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:49:32.627 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:49:32.627 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:49:32.627 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:49:32.627 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:49:32.628 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:49:32.628 INFO:teuthology.orchestra.run.gibba005.stdout: "options": {}, 2021-11-12T05:49:32.628 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:49:32.628 INFO:teuthology.orchestra.run.gibba005.stdout: "rbd": {} 2021-11-12T05:49:32.629 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:32.629 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:32.629 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:49:32.629 INFO:teuthology.orchestra.run.gibba005.stdout: "osds": [ 2021-11-12T05:49:32.630 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.630 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:49:32.630 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "ee8e30a0-4819-4475-80ec-dd3ee7d01322", 2021-11-12T05:49:32.630 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:32.631 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:32.631 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:32.631 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:32.631 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:32.632 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:32.632 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:32.632 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 132, 2021-11-12T05:49:32.632 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:32.633 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:32.633 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:32.633 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:32.633 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.633 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:32.634 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6802", 2021-11-12T05:49:32.634 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:32.634 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.634 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.634 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:32.635 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6803", 2021-11-12T05:49:32.635 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:32.635 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:32.635 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.636 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.636 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:32.636 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:32.636 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.636 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:32.637 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6804", 2021-11-12T05:49:32.637 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:32.637 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.637 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.637 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:32.638 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6805", 2021-11-12T05:49:32.638 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:32.638 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:32.638 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.639 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.639 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:32.639 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:32.639 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.639 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:32.640 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6808", 2021-11-12T05:49:32.640 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:32.640 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.640 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.640 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:32.641 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6809", 2021-11-12T05:49:32.641 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:32.641 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:32.641 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.641 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.642 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:32.642 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:32.642 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.642 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:32.642 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6806", 2021-11-12T05:49:32.643 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:32.643 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.643 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.643 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:32.644 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6807", 2021-11-12T05:49:32.644 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:32.644 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:32.644 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.644 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.645 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6803/14874", 2021-11-12T05:49:32.645 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6805/14874", 2021-11-12T05:49:32.645 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6809/14874", 2021-11-12T05:49:32.645 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6807/14874", 2021-11-12T05:49:32.645 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:32.646 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:32.646 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:32.646 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.646 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.646 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.647 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:49:32.647 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "b1bb06c3-26d0-4d92-82f8-b3e882242785", 2021-11-12T05:49:32.647 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:32.647 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:32.648 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:32.648 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:32.648 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:32.648 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:32.648 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:32.649 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 133, 2021-11-12T05:49:32.649 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:32.649 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:32.649 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:32.649 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:32.650 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.650 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:32.650 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6810", 2021-11-12T05:49:32.650 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:32.651 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.651 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.651 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:32.651 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6811", 2021-11-12T05:49:32.651 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:32.652 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:32.652 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.652 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.652 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:32.652 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:32.653 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.653 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:32.653 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6812", 2021-11-12T05:49:32.653 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:32.653 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.654 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.654 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:32.654 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6813", 2021-11-12T05:49:32.654 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:32.654 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:32.655 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.655 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.655 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:32.655 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:32.656 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.656 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:32.656 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6816", 2021-11-12T05:49:32.656 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:32.656 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.657 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.657 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:32.657 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6817", 2021-11-12T05:49:32.657 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:32.657 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:32.658 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.658 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.658 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:32.658 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:32.659 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.659 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:32.659 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6814", 2021-11-12T05:49:32.659 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:32.659 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.660 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.660 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:32.660 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6815", 2021-11-12T05:49:32.660 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:32.660 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:32.661 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.661 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.661 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6811/14875", 2021-11-12T05:49:32.661 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6813/14875", 2021-11-12T05:49:32.661 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6817/14875", 2021-11-12T05:49:32.662 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6815/14875", 2021-11-12T05:49:32.662 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:32.662 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:32.662 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:32.663 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.663 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.663 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.663 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:49:32.663 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "837b2c60-c335-4382-9f47-d86543a14022", 2021-11-12T05:49:32.664 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:32.664 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:32.664 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:32.664 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:32.665 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:32.665 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:32.665 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:32.665 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 133, 2021-11-12T05:49:32.665 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:32.666 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:32.666 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:32.666 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:32.666 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.667 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:32.667 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6818", 2021-11-12T05:49:32.667 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:32.667 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.668 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.668 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:32.668 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6819", 2021-11-12T05:49:32.668 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:32.668 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:32.669 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.669 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.669 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:32.669 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:32.670 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.670 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:32.670 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6820", 2021-11-12T05:49:32.670 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:32.670 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.671 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.671 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:32.671 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6821", 2021-11-12T05:49:32.671 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:32.671 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:32.672 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.672 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.672 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:32.672 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:32.672 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.673 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:32.673 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6824", 2021-11-12T05:49:32.673 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:32.673 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.674 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.674 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:32.674 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6825", 2021-11-12T05:49:32.674 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:32.674 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:32.675 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.675 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.675 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:32.675 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:32.675 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.676 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:32.676 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6822", 2021-11-12T05:49:32.676 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:32.676 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.677 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.677 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:32.677 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6823", 2021-11-12T05:49:32.677 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:32.677 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:32.678 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.678 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.678 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6819/14905", 2021-11-12T05:49:32.678 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6821/14905", 2021-11-12T05:49:32.678 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6825/14905", 2021-11-12T05:49:32.679 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6823/14905", 2021-11-12T05:49:32.679 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:32.679 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:32.679 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:32.679 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.680 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.680 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.680 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:49:32.680 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "eb2b737b-dda6-444b-a306-f33cbbd51f70", 2021-11-12T05:49:32.680 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:32.681 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:32.681 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:32.681 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:32.681 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:32.682 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:32.682 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:32.682 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 132, 2021-11-12T05:49:32.682 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:32.682 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:32.683 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:32.683 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:32.683 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.683 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:32.683 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6826", 2021-11-12T05:49:32.684 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:32.684 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.684 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.684 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:32.684 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6827", 2021-11-12T05:49:32.685 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:32.685 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:32.685 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.685 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.685 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:32.686 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:32.686 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.686 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:32.686 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6828", 2021-11-12T05:49:32.686 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:32.687 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.687 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.687 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:32.687 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6829", 2021-11-12T05:49:32.688 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:32.688 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:32.688 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.688 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.688 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:32.689 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:32.689 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.689 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:32.689 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6832", 2021-11-12T05:49:32.689 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:32.690 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.690 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.690 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:32.690 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6833", 2021-11-12T05:49:32.691 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:32.691 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:32.691 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.691 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.691 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:32.692 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:32.692 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.692 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:32.692 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6830", 2021-11-12T05:49:32.692 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:32.693 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.693 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.693 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:32.693 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6831", 2021-11-12T05:49:32.694 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:32.694 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:32.694 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.694 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.695 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6827/14876", 2021-11-12T05:49:32.695 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6829/14876", 2021-11-12T05:49:32.695 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6833/14876", 2021-11-12T05:49:32.695 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6831/14876", 2021-11-12T05:49:32.695 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:32.696 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:32.696 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:32.696 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.696 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.697 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.697 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:49:32.697 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "721529a1-c047-486a-a7ca-ddc15d80cdde", 2021-11-12T05:49:32.697 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:32.698 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:32.698 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:32.698 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:32.698 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:32.698 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:32.699 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:32.699 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 134, 2021-11-12T05:49:32.699 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:32.699 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:32.699 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:32.700 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:32.700 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.700 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:32.700 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6800", 2021-11-12T05:49:32.700 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:32.701 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.701 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.701 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:32.701 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6801", 2021-11-12T05:49:32.702 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:32.702 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:32.702 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.702 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.703 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:32.703 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:32.703 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.703 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:32.703 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6802", 2021-11-12T05:49:32.704 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:32.704 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.704 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.704 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:32.704 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6803", 2021-11-12T05:49:32.705 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:32.705 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:32.705 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.705 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.706 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:32.706 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:32.706 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.706 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:32.706 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6806", 2021-11-12T05:49:32.707 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:32.707 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.707 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.707 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:32.707 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6807", 2021-11-12T05:49:32.708 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:32.708 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:32.708 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.708 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.709 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:32.709 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:32.709 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.709 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:32.709 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6804", 2021-11-12T05:49:32.710 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:32.710 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.710 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.710 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:32.710 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6805", 2021-11-12T05:49:32.711 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:32.711 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:32.711 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.711 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.712 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6801/15096", 2021-11-12T05:49:32.712 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6803/15096", 2021-11-12T05:49:32.712 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6807/15096", 2021-11-12T05:49:32.712 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6805/15096", 2021-11-12T05:49:32.712 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:32.713 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:32.713 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:32.713 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.713 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.713 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.714 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:49:32.714 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "68b72ab2-fa82-4b5c-bf33-528f002e4950", 2021-11-12T05:49:32.714 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:32.714 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:32.715 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:32.715 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:32.715 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:32.715 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:32.715 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:32.716 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 126, 2021-11-12T05:49:32.716 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:32.716 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:32.716 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:32.716 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:32.717 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.717 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:32.717 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6808", 2021-11-12T05:49:32.717 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:32.718 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.718 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.718 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:32.718 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6809", 2021-11-12T05:49:32.718 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:32.719 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:32.719 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.719 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.719 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:32.719 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:32.720 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.720 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:32.720 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6810", 2021-11-12T05:49:32.720 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:32.721 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.721 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.721 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:32.721 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6811", 2021-11-12T05:49:32.721 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:32.722 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:32.722 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.722 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.722 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:32.722 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:32.723 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.723 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:32.723 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6814", 2021-11-12T05:49:32.723 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:32.724 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.724 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.724 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:32.724 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6815", 2021-11-12T05:49:32.724 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:32.725 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:32.725 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.725 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.725 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:32.725 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:32.726 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.726 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:32.726 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6812", 2021-11-12T05:49:32.726 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:32.727 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.727 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.727 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:32.727 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6813", 2021-11-12T05:49:32.727 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:32.728 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:32.728 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.728 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.728 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6809/15097", 2021-11-12T05:49:32.729 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6811/15097", 2021-11-12T05:49:32.729 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6815/15097", 2021-11-12T05:49:32.729 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6813/15097", 2021-11-12T05:49:32.729 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:32.729 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:32.730 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:32.730 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.730 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.730 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.731 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:49:32.731 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "a2c83b5d-8d37-4d30-ac04-30d89a76e485", 2021-11-12T05:49:32.731 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:32.731 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:32.731 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:32.732 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:32.732 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:32.732 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:32.732 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:32.732 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 133, 2021-11-12T05:49:32.733 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:32.733 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:32.733 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:32.733 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:32.733 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.734 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:32.734 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6816", 2021-11-12T05:49:32.734 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:32.734 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.735 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.735 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:32.735 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6817", 2021-11-12T05:49:32.735 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:32.735 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:32.736 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.736 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.736 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:32.736 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:32.736 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.737 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:32.737 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6818", 2021-11-12T05:49:32.737 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:32.737 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.737 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.738 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:32.738 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6819", 2021-11-12T05:49:32.738 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:32.738 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:32.739 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.739 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.739 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:32.739 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:32.739 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.740 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:32.740 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6822", 2021-11-12T05:49:32.740 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:32.740 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.740 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.741 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:32.741 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6823", 2021-11-12T05:49:32.741 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:32.741 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:32.742 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.742 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.742 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:32.742 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:32.743 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.743 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:32.743 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6820", 2021-11-12T05:49:32.743 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:32.743 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.744 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.744 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:32.744 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6821", 2021-11-12T05:49:32.744 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:32.745 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:32.745 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.745 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.745 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6817/15098", 2021-11-12T05:49:32.745 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6819/15098", 2021-11-12T05:49:32.746 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6823/15098", 2021-11-12T05:49:32.746 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6821/15098", 2021-11-12T05:49:32.746 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:32.746 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:32.747 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:32.747 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.747 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.747 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.747 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:49:32.748 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "786ce966-d0fb-4181-aed4-c26e3ef61c43", 2021-11-12T05:49:32.748 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:32.748 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:32.748 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:32.748 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:32.749 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:32.749 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:32.749 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:32.749 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 133, 2021-11-12T05:49:32.750 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:32.750 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:32.750 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:32.750 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:32.750 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.751 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:32.751 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6824", 2021-11-12T05:49:32.751 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:32.751 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.751 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.752 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:32.752 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6825", 2021-11-12T05:49:32.752 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:32.752 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:32.753 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.753 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.753 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:32.753 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:32.753 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.754 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:32.754 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6826", 2021-11-12T05:49:32.754 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:32.754 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.754 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.755 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:32.755 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6827", 2021-11-12T05:49:32.755 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:32.755 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:32.756 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.756 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.756 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:32.756 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:32.756 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.757 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:32.757 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6830", 2021-11-12T05:49:32.757 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:32.757 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.757 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.758 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:32.758 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6831", 2021-11-12T05:49:32.758 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:32.758 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:32.759 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.759 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.759 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:32.759 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:32.759 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.760 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:32.760 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6828", 2021-11-12T05:49:32.760 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:32.760 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.761 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.761 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:32.761 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6829", 2021-11-12T05:49:32.761 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:32.761 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:32.762 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.762 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.762 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6825/15099", 2021-11-12T05:49:32.762 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6827/15099", 2021-11-12T05:49:32.763 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6831/15099", 2021-11-12T05:49:32.763 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6829/15099", 2021-11-12T05:49:32.763 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:32.763 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:32.763 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:32.764 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:32.764 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:32.764 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:49:32.764 INFO:teuthology.orchestra.run.gibba005.stdout: "osd_xinfo": [ 2021-11-12T05:49:32.765 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.765 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:49:32.765 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:32.765 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:32.765 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:32.766 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:32.766 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:32.766 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.615112+0000", 2021-11-12T05:49:32.766 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:32.766 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.767 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.767 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:49:32.767 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:32.767 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:32.768 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:32.768 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:32.768 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:32.768 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.665935+0000", 2021-11-12T05:49:32.768 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:32.769 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.769 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.769 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:49:32.769 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:32.769 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:32.770 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:32.770 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:32.770 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:32.770 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.715877+0000", 2021-11-12T05:49:32.770 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:32.771 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.771 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.771 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:49:32.771 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:32.772 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:32.772 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:32.772 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:32.772 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:32.772 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.489234+0000", 2021-11-12T05:49:32.773 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:32.773 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.773 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.773 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:49:32.774 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:32.774 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:32.774 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:32.774 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:32.774 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:32.775 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.413776+0000", 2021-11-12T05:49:32.775 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:32.775 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.775 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.775 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:49:32.776 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:32.776 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:32.776 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:32.776 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:32.777 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:32.777 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.507960+0000", 2021-11-12T05:49:32.777 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:32.777 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.777 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.778 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:49:32.778 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:32.778 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:32.778 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:32.778 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:32.779 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:32.779 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.635696+0000", 2021-11-12T05:49:32.779 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:32.779 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.779 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:32.780 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:49:32.780 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:32.780 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:32.780 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:32.781 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:32.781 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:32.781 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.746949+0000", 2021-11-12T05:49:32.781 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:32.781 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:32.782 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:49:32.782 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap": [], 2021-11-12T05:49:32.782 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap_items": [], 2021-11-12T05:49:32.782 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_temp": [], 2021-11-12T05:49:32.782 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_temp": [], 2021-11-12T05:49:32.783 INFO:teuthology.orchestra.run.gibba005.stdout: "blacklist": { 2021-11-12T05:49:32.783 INFO:teuthology.orchestra.run.gibba005.stdout: "172.21.2.105:6835/737863904": "2021-11-13T05:49:26.940750+0000", 2021-11-12T05:49:32.783 INFO:teuthology.orchestra.run.gibba005.stdout: "172.21.2.105:6834/737863904": "2021-11-13T05:49:26.940750+0000" 2021-11-12T05:49:32.783 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.784 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profiles": { 2021-11-12T05:49:32.784 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs_data": { 2021-11-12T05:49:32.784 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-device-class": "", 2021-11-12T05:49:32.784 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:49:32.784 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-root": "default", 2021-11-12T05:49:32.785 INFO:teuthology.orchestra.run.gibba005.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-12T05:49:32.785 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:49:32.785 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "2", 2021-11-12T05:49:32.785 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:49:32.785 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:49:32.786 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van", 2021-11-12T05:49:32.786 INFO:teuthology.orchestra.run.gibba005.stdout: "w": "8" 2021-11-12T05:49:32.786 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.786 INFO:teuthology.orchestra.run.gibba005.stdout: "default": { 2021-11-12T05:49:32.786 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:49:32.787 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:49:32.787 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "1", 2021-11-12T05:49:32.787 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:49:32.787 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:49:32.787 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van" 2021-11-12T05:49:32.788 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:32.788 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:32.788 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps_queue": [], 2021-11-12T05:49:32.788 INFO:teuthology.orchestra.run.gibba005.stdout: "new_removed_snaps": [], 2021-11-12T05:49:32.788 INFO:teuthology.orchestra.run.gibba005.stdout: "new_purged_snaps": [], 2021-11-12T05:49:32.789 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_node_flags": {}, 2021-11-12T05:49:32.789 INFO:teuthology.orchestra.run.gibba005.stdout: "device_class_flags": {} 2021-11-12T05:49:32.789 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:49:32.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.588+0000 7f181bf65700 1 -- 172.21.2.105:0/761770412 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f17f4053580 msgr2=0x7f17f4055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:32.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.588+0000 7f181bf65700 1 --2- 172.21.2.105:0/761770412 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f17f4053580 0x7f17f4055a40 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f1810002f70 tx=0x7f1810015000).stop 2021-11-12T05:49:32.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.588+0000 7f181bf65700 1 -- 172.21.2.105:0/761770412 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f18140b37d0 msgr2=0x7f1814143f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:32.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.588+0000 7f181bf65700 1 --2- 172.21.2.105:0/761770412 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f18140b37d0 0x7f1814143f20 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 rx=0x7f1804002f70 tx=0x7f1804006ec0).stop 2021-11-12T05:49:32.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.588+0000 7f181bf65700 1 -- 172.21.2.105:0/761770412 shutdown_connections 2021-11-12T05:49:32.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.588+0000 7f181bf65700 1 --2- 172.21.2.105:0/761770412 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f17f4053580 0x7f17f4055a40 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:32.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.588+0000 7f181bf65700 1 --2- 172.21.2.105:0/761770412 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f18141419f0 0x7f1814150760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:32.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.588+0000 7f181bf65700 1 --2- 172.21.2.105:0/761770412 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f18140b37d0 0x7f1814143f20 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:32.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.588+0000 7f181bf65700 1 --2- 172.21.2.105:0/761770412 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1814060100 0x7f18140ae3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:32.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.588+0000 7f181bf65700 1 -- 172.21.2.105:0/761770412 >> 172.21.2.105:0/761770412 conn(0x7f18140608d0 msgr2=0x7f1814142dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:32.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.588+0000 7f181bf65700 1 -- 172.21.2.105:0/761770412 shutdown_connections 2021-11-12T05:49:32.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.588+0000 7f181bf65700 1 -- 172.21.2.105:0/761770412 wait complete. 2021-11-12T05:49:32.794 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:49:32.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.844+0000 7fd3282f7700 1 Processor -- start 2021-11-12T05:49:32.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.844+0000 7fd3282f7700 1 -- start start 2021-11-12T05:49:32.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.844+0000 7fd3282f7700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3200ad080 0x7fd3200af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:32.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.844+0000 7fd3282f7700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fd32014b2f0 0x7fd3200ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:32.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.844+0000 7fd3282f7700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3200ac7b0 con 0x7fd3200ac280 2021-11-12T05:49:32.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.844+0000 7fd3282f7700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3201488a0 con 0x7fd32014b2f0 2021-11-12T05:49:32.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.844+0000 7fd3282f7700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3200ac9e0 con 0x7fd3200ad080 2021-11-12T05:49:32.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.844+0000 7fd326894700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fd32014b2f0 0x7fd3200ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:32.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.844+0000 7fd326093700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3200ad080 0x7fd3200af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:32.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.844+0000 7fd325892700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7fd3200ac280 0x7fd32014abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:60840/0 (socket says 172.21.2.105:60840) 2021-11-12T05:49:32.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.844+0000 7fd325892700 1 -- 172.21.2.105:0/3726760149 learned_addr learned my addr 172.21.2.105:0/3726760149 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:32.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.848+0000 7fd326894700 1 -- 172.21.2.105:0/3726760149 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3200ad080 msgr2=0x7fd3200af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:32.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.848+0000 7fd326894700 1 --2- 172.21.2.105:0/3726760149 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3200ad080 0x7fd3200af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:32.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.848+0000 7fd326894700 1 -- 172.21.2.105:0/3726760149 >> v1:172.21.2.115:6789/0 conn(0x7fd3200ac280 legacy=0x7fd32014abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:32.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.848+0000 7fd326894700 1 -- 172.21.2.105:0/3726760149 --> v2:172.21.2.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3200b0b30 con 0x7fd32014b2f0 2021-11-12T05:49:32.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.848+0000 7fd326894700 1 --2- 172.21.2.105:0/3726760149 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd32014b2f0 0x7fd3200ad460 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fd3200ac6a0 tx=0x7fd3180091d0).ready entity=mon.1 client_cookie=caa572333d467c18 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:32.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.848+0000 7fd325091700 1 -- 172.21.2.105:0/3726760149 <== mon.1 v2:172.21.2.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd31800b680 con 0x7fd32014b2f0 2021-11-12T05:49:32.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.848+0000 7fd325091700 1 -- 172.21.2.105:0/3726760149 <== mon.1 v2:172.21.2.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31800b7e0 con 0x7fd32014b2f0 2021-11-12T05:49:32.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.848+0000 7fd325091700 1 -- 172.21.2.105:0/3726760149 <== mon.1 v2:172.21.2.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd31800b950 con 0x7fd32014b2f0 2021-11-12T05:49:32.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.848+0000 7fd3282f7700 1 -- 172.21.2.105:0/3726760149 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd32014b2f0 msgr2=0x7fd3200ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:32.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.848+0000 7fd3282f7700 1 --2- 172.21.2.105:0/3726760149 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd32014b2f0 0x7fd3200ad460 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fd3200ac6a0 tx=0x7fd3180091d0).stop 2021-11-12T05:49:32.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.848+0000 7fd3282f7700 1 -- 172.21.2.105:0/3726760149 shutdown_connections 2021-11-12T05:49:32.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.848+0000 7fd3282f7700 1 --2- 172.21.2.105:0/3726760149 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd32014b2f0 0x7fd3200ad460 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:32.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.848+0000 7fd3282f7700 1 --2- 172.21.2.105:0/3726760149 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3200ad080 0x7fd3200af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:32.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.848+0000 7fd3282f7700 1 -- 172.21.2.105:0/3726760149 >> 172.21.2.105:0/3726760149 conn(0x7fd3200b5370 msgr2=0x7fd3200b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:32.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.848+0000 7fd3282f7700 1 -- 172.21.2.105:0/3726760149 shutdown_connections 2021-11-12T05:49:32.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.848+0000 7fd3282f7700 1 -- 172.21.2.105:0/3726760149 wait complete. 2021-11-12T05:49:32.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.848+0000 7fd3282f7700 1 Processor -- start 2021-11-12T05:49:32.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.848+0000 7fd3282f7700 1 -- start start 2021-11-12T05:49:32.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.852+0000 7fd3282f7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3200ac280 0x7fd320157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:32.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.852+0000 7fd3282f7700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd3200ad080 0x7fd320144a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:32.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.852+0000 7fd3282f7700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd32014b2f0 0x7fd3200a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:32.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.852+0000 7fd3282f7700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd320156bc0 con 0x7fd3200ac280 2021-11-12T05:49:32.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.852+0000 7fd3282f7700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3200aa200 con 0x7fd3200ad080 2021-11-12T05:49:32.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.852+0000 7fd3282f7700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd320156db0 con 0x7fd32014b2f0 2021-11-12T05:49:32.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.852+0000 7fd326093700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3200ac280 0x7fd320157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:32.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.852+0000 7fd326093700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3200ac280 0x7fd320157790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51980/0 (socket says 172.21.2.105:51980) 2021-11-12T05:49:32.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.852+0000 7fd326093700 1 -- 172.21.2.105:0/2338578730 learned_addr learned my addr 172.21.2.105:0/2338578730 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:32.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.852+0000 7fd326093700 1 -- 172.21.2.105:0/2338578730 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd32014b2f0 msgr2=0x7fd3200a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:32.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.852+0000 7fd326093700 1 --2- 172.21.2.105:0/2338578730 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd32014b2f0 0x7fd3200a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:32.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.852+0000 7fd326093700 1 -- 172.21.2.105:0/2338578730 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd3200ad080 msgr2=0x7fd320144a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:32.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.852+0000 7fd326093700 1 --2- 172.21.2.105:0/2338578730 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd3200ad080 0x7fd320144a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:32.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.852+0000 7fd326093700 1 -- 172.21.2.105:0/2338578730 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd318009470 con 0x7fd3200ac280 2021-11-12T05:49:32.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.852+0000 7fd326093700 1 --2- 172.21.2.105:0/2338578730 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3200ac280 0x7fd320157790 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 rx=0x7fd31400c000 tx=0x7fd314006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:32.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.852+0000 7fd3137fe700 1 -- 172.21.2.105:0/2338578730 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd314010780 con 0x7fd3200ac280 2021-11-12T05:49:32.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.852+0000 7fd3137fe700 1 -- 172.21.2.105:0/2338578730 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3140108e0 con 0x7fd3200ac280 2021-11-12T05:49:32.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.852+0000 7fd3137fe700 1 -- 172.21.2.105:0/2338578730 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd314010c40 con 0x7fd3200ac280 2021-11-12T05:49:32.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.852+0000 7fd3282f7700 1 -- 172.21.2.105:0/2338578730 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd320157050 con 0x7fd3200ac280 2021-11-12T05:49:32.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.852+0000 7fd3282f7700 1 -- 172.21.2.105:0/2338578730 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd32014ad60 con 0x7fd3200ac280 2021-11-12T05:49:32.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.852+0000 7fd3282f7700 1 -- 172.21.2.105:0/2338578730 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3200b1440 con 0x7fd3200ac280 2021-11-12T05:49:32.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.852+0000 7fd3137fe700 1 -- 172.21.2.105:0/2338578730 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd31401c460 con 0x7fd3200ac280 2021-11-12T05:49:32.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.852+0000 7fd3137fe700 1 --2- 172.21.2.105:0/2338578730 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd3000536d0 0x7fd300055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:32.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.852+0000 7fd3137fe700 1 -- 172.21.2.105:0/2338578730 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fd31406bd40 con 0x7fd3200ac280 2021-11-12T05:49:32.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.852+0000 7fd325892700 1 --2- 172.21.2.105:0/2338578730 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd3000536d0 0x7fd300055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:32.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.852+0000 7fd325892700 1 --2- 172.21.2.105:0/2338578730 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd3000536d0 0x7fd300055b90 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7fd3200b0550 tx=0x7fd31c007800).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:32.865 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.856+0000 7fd3137fe700 1 -- 172.21.2.105:0/2338578730 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd314042f20 con 0x7fd3200ac280 2021-11-12T05:49:32.967 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.960+0000 7fd3282f7700 1 -- 172.21.2.105:0/2338578730 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd320057350 con 0x7fd3200ac280 2021-11-12T05:49:32.967 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.964+0000 7fd3137fe700 1 -- 172.21.2.105:0/2338578730 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+1209 (secure 0 0 0) 0x7fd314046540 con 0x7fd3200ac280 2021-11-12T05:49:32.968 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:32.968 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":67,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4979,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/2405231908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":2405231908},{"type":"v1","addr":"172.21.2.115:6833","nonce":2405231908}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":63},{"gid":8415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.105:6835/2868307398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":2868307398},{"type":"v1","addr":"172.21.2.105:6835","nonce":2868307398}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67}],"filesystems":[]} 2021-11-12T05:49:32.969 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.964+0000 7fd3282f7700 1 -- 172.21.2.105:0/2338578730 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd3000536d0 msgr2=0x7fd300055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:32.969 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.964+0000 7fd3282f7700 1 --2- 172.21.2.105:0/2338578730 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd3000536d0 0x7fd300055b90 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7fd3200b0550 tx=0x7fd31c007800).stop 2021-11-12T05:49:32.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.964+0000 7fd3282f7700 1 -- 172.21.2.105:0/2338578730 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3200ac280 msgr2=0x7fd320157790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:32.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.964+0000 7fd3282f7700 1 --2- 172.21.2.105:0/2338578730 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3200ac280 0x7fd320157790 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 rx=0x7fd31400c000 tx=0x7fd314006df0).stop 2021-11-12T05:49:32.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.964+0000 7fd3282f7700 1 -- 172.21.2.105:0/2338578730 shutdown_connections 2021-11-12T05:49:32.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.964+0000 7fd3282f7700 1 --2- 172.21.2.105:0/2338578730 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd3000536d0 0x7fd300055b90 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:32.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.964+0000 7fd3282f7700 1 --2- 172.21.2.105:0/2338578730 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd32014b2f0 0x7fd3200a9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:32.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.964+0000 7fd3282f7700 1 --2- 172.21.2.105:0/2338578730 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd3200ad080 0x7fd320144a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:32.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.964+0000 7fd3282f7700 1 --2- 172.21.2.105:0/2338578730 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3200ac280 0x7fd320157790 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:32.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.964+0000 7fd3282f7700 1 -- 172.21.2.105:0/2338578730 >> 172.21.2.105:0/2338578730 conn(0x7fd3200b5370 msgr2=0x7fd320145d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:32.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.964+0000 7fd3282f7700 1 -- 172.21.2.105:0/2338578730 shutdown_connections 2021-11-12T05:49:32.972 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:32.964+0000 7fd3282f7700 1 -- 172.21.2.105:0/2338578730 wait complete. 2021-11-12T05:49:32.972 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 67 2021-11-12T05:49:32.975 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:49:33.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.020+0000 7fa39f2ca700 1 Processor -- start 2021-11-12T05:49:33.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.020+0000 7fa39f2ca700 1 -- start start 2021-11-12T05:49:33.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.020+0000 7fa39f2ca700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa3980ad080 0x7fa3980af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:33.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.020+0000 7fa39f2ca700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3980ac7b0 con 0x7fa39814b2f0 2021-11-12T05:49:33.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.020+0000 7fa39f2ca700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3980ac9e0 con 0x7fa3980ac280 2021-11-12T05:49:33.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.020+0000 7fa39f2ca700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3981488a0 con 0x7fa3980ad080 2021-11-12T05:49:33.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.020+0000 7fa39d867700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fa39814b2f0 0x7fa398147a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34152/0 (socket says 172.21.2.105:34152) 2021-11-12T05:49:33.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.020+0000 7fa39d867700 1 -- 172.21.2.105:0/962222712 learned_addr learned my addr 172.21.2.105:0/962222712 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:33.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.020+0000 7fa39d066700 1 --2- 172.21.2.105:0/962222712 >> v2:172.21.2.105:3300/0 conn(0x7fa3980ad080 0x7fa3980af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:33.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.020+0000 7fa38bfff700 1 -- 172.21.2.105:0/962222712 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3225584777 0 0) 0x7fa3980ac7b0 con 0x7fa39814b2f0 2021-11-12T05:49:33.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.020+0000 7fa39d066700 1 -- 172.21.2.105:0/962222712 >> v1:172.21.2.115:6789/0 conn(0x7fa3980ac280 legacy=0x7fa39814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:33.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.020+0000 7fa39d066700 1 -- 172.21.2.105:0/962222712 >> v1:172.21.2.105:6789/0 conn(0x7fa39814b2f0 legacy=0x7fa398147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:33.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.020+0000 7fa39d066700 1 -- 172.21.2.105:0/962222712 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3980b0b30 con 0x7fa3980ad080 2021-11-12T05:49:33.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.020+0000 7fa39d066700 1 --2- 172.21.2.105:0/962222712 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa3980ad080 0x7fa3980af730 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 rx=0x7fa3980b0eb0 tx=0x7fa38c006df0).ready entity=mon.0 client_cookie=dce9478ebb104f6d server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:33.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.020+0000 7fa38bfff700 1 -- 172.21.2.105:0/962222712 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa38c00d5c0 con 0x7fa3980ad080 2021-11-12T05:49:33.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.020+0000 7fa38bfff700 1 -- 172.21.2.105:0/962222712 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38c000e90 con 0x7fa3980ad080 2021-11-12T05:49:33.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.020+0000 7fa38bfff700 1 -- 172.21.2.105:0/962222712 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa38c00d910 con 0x7fa3980ad080 2021-11-12T05:49:33.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.020+0000 7fa39f2ca700 1 -- 172.21.2.105:0/962222712 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa3980ad080 msgr2=0x7fa3980af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:33.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.020+0000 7fa39f2ca700 1 --2- 172.21.2.105:0/962222712 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa3980ad080 0x7fa3980af730 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 rx=0x7fa3980b0eb0 tx=0x7fa38c006df0).stop 2021-11-12T05:49:33.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.020+0000 7fa39f2ca700 1 -- 172.21.2.105:0/962222712 shutdown_connections 2021-11-12T05:49:33.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.020+0000 7fa39f2ca700 1 --2- 172.21.2.105:0/962222712 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa3980ad080 0x7fa3980af730 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:33.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.020+0000 7fa39f2ca700 1 -- 172.21.2.105:0/962222712 >> 172.21.2.105:0/962222712 conn(0x7fa3980b5370 msgr2=0x7fa3980b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:33.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.020+0000 7fa39f2ca700 1 -- 172.21.2.105:0/962222712 shutdown_connections 2021-11-12T05:49:33.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.020+0000 7fa39f2ca700 1 -- 172.21.2.105:0/962222712 wait complete. 2021-11-12T05:49:33.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.024+0000 7fa39f2ca700 1 Processor -- start 2021-11-12T05:49:33.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.024+0000 7fa39f2ca700 1 -- start start 2021-11-12T05:49:33.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.024+0000 7fa39f2ca700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa3980ac280 0x7fa3980ab0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:33.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.024+0000 7fa39f2ca700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa3980ad080 0x7fa3981426d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:33.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.024+0000 7fa39f2ca700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa39814b2f0 0x7fa398142bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:33.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.024+0000 7fa39f2ca700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3980a9720 con 0x7fa39814b2f0 2021-11-12T05:49:33.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.024+0000 7fa39f2ca700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa398063d60 con 0x7fa3980ad080 2021-11-12T05:49:33.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.024+0000 7fa39f2ca700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa398064000 con 0x7fa3980ac280 2021-11-12T05:49:33.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.024+0000 7fa39d867700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa39814b2f0 0x7fa398142bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:33.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.024+0000 7fa39d867700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa39814b2f0 0x7fa398142bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:51994/0 (socket says 172.21.2.105:51994) 2021-11-12T05:49:33.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.024+0000 7fa39d867700 1 -- 172.21.2.105:0/1649450934 learned_addr learned my addr 172.21.2.105:0/1649450934 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:33.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.024+0000 7fa39d867700 1 -- 172.21.2.105:0/1649450934 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa3980ac280 msgr2=0x7fa3980ab0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:33.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.024+0000 7fa39d867700 1 --2- 172.21.2.105:0/1649450934 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa3980ac280 0x7fa3980ab0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:33.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.024+0000 7fa39d867700 1 -- 172.21.2.105:0/1649450934 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa3980ad080 msgr2=0x7fa3981426d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:33.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.024+0000 7fa39d867700 1 --2- 172.21.2.105:0/1649450934 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa3980ad080 0x7fa3981426d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:33.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.024+0000 7fa39d867700 1 -- 172.21.2.105:0/1649450934 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38c00b180 con 0x7fa39814b2f0 2021-11-12T05:49:33.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.024+0000 7fa39d867700 1 --2- 172.21.2.105:0/1649450934 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa39814b2f0 0x7fa398142bc0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 rx=0x7fa390001250 tx=0x7fa390001380).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:33.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.024+0000 7fa38a7fc700 1 -- 172.21.2.105:0/1649450934 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa390005ba0 con 0x7fa39814b2f0 2021-11-12T05:49:33.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.024+0000 7fa38a7fc700 1 -- 172.21.2.105:0/1649450934 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa390005d00 con 0x7fa39814b2f0 2021-11-12T05:49:33.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.024+0000 7fa39f2ca700 1 -- 172.21.2.105:0/1649450934 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3980a9950 con 0x7fa39814b2f0 2021-11-12T05:49:33.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.024+0000 7fa38a7fc700 1 -- 172.21.2.105:0/1649450934 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa390004a90 con 0x7fa39814b2f0 2021-11-12T05:49:33.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.024+0000 7fa39f2ca700 1 -- 172.21.2.105:0/1649450934 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3980a9320 con 0x7fa39814b2f0 2021-11-12T05:49:33.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.024+0000 7fa39f2ca700 1 -- 172.21.2.105:0/1649450934 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3980aa940 con 0x7fa39814b2f0 2021-11-12T05:49:33.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.024+0000 7fa38a7fc700 1 -- 172.21.2.105:0/1649450934 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa39001b070 con 0x7fa39814b2f0 2021-11-12T05:49:33.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.024+0000 7fa38a7fc700 1 --2- 172.21.2.105:0/1649450934 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa3780536a0 0x7fa378055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:33.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.024+0000 7fa38a7fc700 1 -- 172.21.2.105:0/1649450934 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fa39006b060 con 0x7fa39814b2f0 2021-11-12T05:49:33.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.024+0000 7fa39d066700 1 --2- 172.21.2.105:0/1649450934 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa3780536a0 0x7fa378055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:33.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.024+0000 7fa39d066700 1 --2- 172.21.2.105:0/1649450934 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa3780536a0 0x7fa378055b60 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7fa3980b0eb0 tx=0x7fa38c012000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:33.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.028+0000 7fa38a7fc700 1 -- 172.21.2.105:0/1649450934 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa3980aa940 con 0x7fa39814b2f0 2021-11-12T05:49:33.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.136+0000 7fa39f2ca700 1 -- 172.21.2.105:0/1649450934 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3980aa940 con 0x7fa39814b2f0 2021-11-12T05:49:33.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.136+0000 7fa38a7fc700 1 -- 172.21.2.105:0/1649450934 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+1209 (secure 0 0 0) 0x7fa3980aa940 con 0x7fa39814b2f0 2021-11-12T05:49:33.140 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:33.140 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":67,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4979,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.115:6833/2405231908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":2405231908},{"type":"v1","addr":"172.21.2.115:6833","nonce":2405231908}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":63},{"gid":8415,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.105:6835/2868307398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":2868307398},{"type":"v1","addr":"172.21.2.105:6835","nonce":2868307398}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67}],"filesystems":[]} 2021-11-12T05:49:33.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.136+0000 7fa39f2ca700 1 -- 172.21.2.105:0/1649450934 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa3780536a0 msgr2=0x7fa378055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:33.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.136+0000 7fa39f2ca700 1 --2- 172.21.2.105:0/1649450934 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa3780536a0 0x7fa378055b60 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7fa3980b0eb0 tx=0x7fa38c012000).stop 2021-11-12T05:49:33.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.136+0000 7fa39f2ca700 1 -- 172.21.2.105:0/1649450934 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa39814b2f0 msgr2=0x7fa398142bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:33.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.136+0000 7fa39f2ca700 1 --2- 172.21.2.105:0/1649450934 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa39814b2f0 0x7fa398142bc0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 rx=0x7fa390001250 tx=0x7fa390001380).stop 2021-11-12T05:49:33.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.136+0000 7fa39f2ca700 1 -- 172.21.2.105:0/1649450934 shutdown_connections 2021-11-12T05:49:33.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.136+0000 7fa39f2ca700 1 --2- 172.21.2.105:0/1649450934 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa3780536a0 0x7fa378055b60 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:33.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.136+0000 7fa39f2ca700 1 --2- 172.21.2.105:0/1649450934 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa39814b2f0 0x7fa398142bc0 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:33.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.136+0000 7fa39f2ca700 1 --2- 172.21.2.105:0/1649450934 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa3980ad080 0x7fa3981426d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:33.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.136+0000 7fa39f2ca700 1 --2- 172.21.2.105:0/1649450934 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa3980ac280 0x7fa3980ab0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:33.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.136+0000 7fa39f2ca700 1 -- 172.21.2.105:0/1649450934 >> 172.21.2.105:0/1649450934 conn(0x7fa3980b5370 msgr2=0x7fa398143c60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:33.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.136+0000 7fa39f2ca700 1 -- 172.21.2.105:0/1649450934 shutdown_connections 2021-11-12T05:49:33.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.136+0000 7fa39f2ca700 1 -- 172.21.2.105:0/1649450934 wait complete. 2021-11-12T05:49:33.144 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 67 2021-11-12T05:49:33.147 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-12T05:49:33.147 INFO:tasks.ceph.mds.a:Stopping old one... 2021-11-12T05:49:33.148 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-12T05:49:33.148 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T05:49:33.148 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-12T05:49:33.149 INFO:tasks.ceph.mds.b:Stopping old one... 2021-11-12T05:49:33.149 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-12T05:49:33.149 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T05:49:33.153 INFO:tasks.ceph.mds.a:Stopped 2021-11-12T05:49:33.154 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-12T05:49:33.161 INFO:tasks.ceph.mds.b:Stopped 2021-11-12T05:49:33.161 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-12T05:49:33.195 INFO:tasks.ceph.mds.a:Started 2021-11-12T05:49:33.196 DEBUG:teuthology.parallel:result is None 2021-11-12T05:49:33.203 INFO:tasks.ceph.mds.b:Started 2021-11-12T05:49:33.204 DEBUG:teuthology.parallel:result is None 2021-11-12T05:49:33.204 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-11-12T05:49:33.230 INFO:tasks.ceph.mds.a.gibba005.stdout:starting mds.a at 2021-11-12T05:49:33.242 INFO:tasks.ceph.mds.b.gibba015.stdout:starting mds.b at 2021-11-12T05:49:33.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.252+0000 7f9021f00700 1 Processor -- start 2021-11-12T05:49:33.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.252+0000 7f9021f00700 1 -- start start 2021-11-12T05:49:33.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.252+0000 7f9021f00700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f901c0b37d0 0x7f901c141500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:33.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.252+0000 7f9021f00700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f901c0b26e0 con 0x7f901c060100 2021-11-12T05:49:33.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.252+0000 7f9021f00700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f901c0604e0 con 0x7f901c1419f0 2021-11-12T05:49:33.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.252+0000 7f9021f00700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f901c145160 con 0x7f901c0b37d0 2021-11-12T05:49:33.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.252+0000 7f901affd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f901c0b37d0 0x7f901c141500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:33.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.252+0000 7f901affd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f901c0b37d0 0x7f901c141500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52014/0 (socket says 172.21.2.105:52014) 2021-11-12T05:49:33.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.252+0000 7f901affd700 1 -- 172.21.2.105:0/3244111474 learned_addr learned my addr 172.21.2.105:0/3244111474 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:33.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.252+0000 7f901affd700 1 -- 172.21.2.105:0/3244111474 >> v1:172.21.2.115:6789/0 conn(0x7f901c1419f0 legacy=0x7f901c0b3f50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:49:33.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.252+0000 7f901affd700 1 -- 172.21.2.105:0/3244111474 >> v1:172.21.2.105:6789/0 conn(0x7f901c060100 legacy=0x7f901c0b1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:33.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.252+0000 7f901affd700 1 -- 172.21.2.105:0/3244111474 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f901c141060 con 0x7f901c0b37d0 2021-11-12T05:49:33.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.252+0000 7f901affd700 1 --2- 172.21.2.105:0/3244111474 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f901c0b37d0 0x7f901c141500 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 rx=0x7f901c0640c0 tx=0x7f900c006eb0).ready entity=mon.0 client_cookie=bcef002b6a2f1e10 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:33.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.252+0000 7f901a7fc700 1 -- 172.21.2.105:0/3244111474 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f900c00d5c0 con 0x7f901c0b37d0 2021-11-12T05:49:33.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.252+0000 7f901a7fc700 1 -- 172.21.2.105:0/3244111474 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900c000e90 con 0x7f901c0b37d0 2021-11-12T05:49:33.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.252+0000 7f901a7fc700 1 -- 172.21.2.105:0/3244111474 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f900c00d950 con 0x7f901c0b37d0 2021-11-12T05:49:33.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.252+0000 7f9021f00700 1 -- 172.21.2.105:0/3244111474 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f901c0b37d0 msgr2=0x7f901c141500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:33.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.252+0000 7f9021f00700 1 --2- 172.21.2.105:0/3244111474 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f901c0b37d0 0x7f901c141500 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 rx=0x7f901c0640c0 tx=0x7f900c006eb0).stop 2021-11-12T05:49:33.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.252+0000 7f9021f00700 1 -- 172.21.2.105:0/3244111474 shutdown_connections 2021-11-12T05:49:33.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.252+0000 7f9021f00700 1 --2- 172.21.2.105:0/3244111474 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f901c0b37d0 0x7f901c141500 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:33.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.252+0000 7f9021f00700 1 -- 172.21.2.105:0/3244111474 >> 172.21.2.105:0/3244111474 conn(0x7f901c0608d0 msgr2=0x7f901c05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:33.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.252+0000 7f9021f00700 1 -- 172.21.2.105:0/3244111474 shutdown_connections 2021-11-12T05:49:33.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.252+0000 7f9021f00700 1 -- 172.21.2.105:0/3244111474 wait complete. 2021-11-12T05:49:33.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.256+0000 7f9021f00700 1 Processor -- start 2021-11-12T05:49:33.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.256+0000 7f9021f00700 1 -- start start 2021-11-12T05:49:33.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.256+0000 7f9021f00700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f901c060100 0x7f901c12c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:33.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.256+0000 7f9021f00700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f901c0b37d0 0x7f901c0b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:33.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.256+0000 7f9021f00700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f901c1419f0 0x7f901c0b09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:33.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.256+0000 7f9021f00700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901c12cad0 con 0x7f901c0b37d0 2021-11-12T05:49:33.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.256+0000 7f9021f00700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901c12cd20 con 0x7f901c060100 2021-11-12T05:49:33.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.256+0000 7f9021f00700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f901c12cfc0 con 0x7f901c1419f0 2021-11-12T05:49:33.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.256+0000 7f901affd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f901c0b37d0 0x7f901c0b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:33.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.256+0000 7f901affd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f901c0b37d0 0x7f901c0b40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52018/0 (socket says 172.21.2.105:52018) 2021-11-12T05:49:33.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.256+0000 7f901affd700 1 -- 172.21.2.105:0/604641614 learned_addr learned my addr 172.21.2.105:0/604641614 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:33.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.256+0000 7f901affd700 1 -- 172.21.2.105:0/604641614 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f901c1419f0 msgr2=0x7f901c0b09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:33.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.256+0000 7f901affd700 1 --2- 172.21.2.105:0/604641614 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f901c1419f0 0x7f901c0b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:33.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.256+0000 7f901affd700 1 -- 172.21.2.105:0/604641614 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f901c060100 msgr2=0x7f901c12c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:33.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.256+0000 7f901affd700 1 --2- 172.21.2.105:0/604641614 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f901c060100 0x7f901c12c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:33.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.256+0000 7f901affd700 1 -- 172.21.2.105:0/604641614 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f900c00b1e0 con 0x7f901c0b37d0 2021-11-12T05:49:33.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.256+0000 7f901affd700 1 --2- 172.21.2.105:0/604641614 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f901c0b37d0 0x7f901c0b40f0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 rx=0x7f901c0640c0 tx=0x7f900c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:33.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.256+0000 7f9018ff9700 1 -- 172.21.2.105:0/604641614 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f900c00de90 con 0x7f901c0b37d0 2021-11-12T05:49:33.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.256+0000 7f9018ff9700 1 -- 172.21.2.105:0/604641614 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900c0068b0 con 0x7f901c0b37d0 2021-11-12T05:49:33.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.256+0000 7f9018ff9700 1 -- 172.21.2.105:0/604641614 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f900c002f50 con 0x7f901c0b37d0 2021-11-12T05:49:33.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.256+0000 7f9021f00700 1 -- 172.21.2.105:0/604641614 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f901c12d260 con 0x7f901c0b37d0 2021-11-12T05:49:33.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.256+0000 7f9021f00700 1 -- 172.21.2.105:0/604641614 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f901c0b04a0 con 0x7f901c0b37d0 2021-11-12T05:49:33.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.256+0000 7f9021f00700 1 -- 172.21.2.105:0/604641614 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f901c1513e0 con 0x7f901c0b37d0 2021-11-12T05:49:33.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.256+0000 7f9018ff9700 1 -- 172.21.2.105:0/604641614 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f900c00f070 con 0x7f901c0b37d0 2021-11-12T05:49:33.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.256+0000 7f9018ff9700 1 --2- 172.21.2.105:0/604641614 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9000053660 0x7f9000055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:33.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.256+0000 7f9018ff9700 1 -- 172.21.2.105:0/604641614 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f900c06d3c0 con 0x7f901c0b37d0 2021-11-12T05:49:33.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.256+0000 7f901b7fe700 1 --2- 172.21.2.105:0/604641614 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9000053660 0x7f9000055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:33.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.256+0000 7f901b7fe700 1 --2- 172.21.2.105:0/604641614 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9000053660 0x7f9000055b20 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f901c0ad790 tx=0x7f90040077d0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:33.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.260+0000 7f9018ff9700 1 -- 172.21.2.105:0/604641614 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f900c044590 con 0x7f901c0b37d0 2021-11-12T05:49:33.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:33.352+0000 7f9021f00700 1 -- 172.21.2.105:0/604641614 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f901c141e80 con 0x7f901c0b37d0 2021-11-12T05:49:34.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.204+0000 7f9018ff9700 1 -- 172.21.2.105:0/604641614 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v140) v1 ==== 97+0+0 (secure 0 0 0) 0x7f900c047bb0 con 0x7f901c0b37d0 2021-11-12T05:49:34.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.204+0000 7f9021f00700 1 -- 172.21.2.105:0/604641614 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9000053660 msgr2=0x7f9000055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:34.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.204+0000 7f9021f00700 1 --2- 172.21.2.105:0/604641614 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9000053660 0x7f9000055b20 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f901c0ad790 tx=0x7f90040077d0).stop 2021-11-12T05:49:34.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.204+0000 7f9021f00700 1 -- 172.21.2.105:0/604641614 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f901c0b37d0 msgr2=0x7f901c0b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:34.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.204+0000 7f9021f00700 1 --2- 172.21.2.105:0/604641614 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f901c0b37d0 0x7f901c0b40f0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 rx=0x7f901c0640c0 tx=0x7f900c015000).stop 2021-11-12T05:49:34.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.204+0000 7f9021f00700 1 -- 172.21.2.105:0/604641614 shutdown_connections 2021-11-12T05:49:34.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.204+0000 7f9021f00700 1 --2- 172.21.2.105:0/604641614 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9000053660 0x7f9000055b20 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:34.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.204+0000 7f9021f00700 1 --2- 172.21.2.105:0/604641614 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f901c1419f0 0x7f901c0b09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:34.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.204+0000 7f9021f00700 1 --2- 172.21.2.105:0/604641614 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f901c0b37d0 0x7f901c0b40f0 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:34.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.204+0000 7f9021f00700 1 --2- 172.21.2.105:0/604641614 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f901c060100 0x7f901c12c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:34.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.204+0000 7f9021f00700 1 -- 172.21.2.105:0/604641614 >> 172.21.2.105:0/604641614 conn(0x7f901c0608d0 msgr2=0x7f901c05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:34.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.204+0000 7f9021f00700 1 -- 172.21.2.105:0/604641614 shutdown_connections 2021-11-12T05:49:34.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.204+0000 7f9021f00700 1 -- 172.21.2.105:0/604641614 wait complete. 2021-11-12T05:49:34.213 INFO:teuthology.orchestra.run.gibba005.stderr: removed all blacklist entries 2021-11-12T05:49:34.217 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-11-12T05:49:34.218 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-11-12T05:49:34.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.308+0000 7fc1d2583700 1 Processor -- start 2021-11-12T05:49:34.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.308+0000 7fc1d2583700 1 -- start start 2021-11-12T05:49:34.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.308+0000 7fc1d2583700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc1cc066ba0 0x7fc1cc0ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:34.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.308+0000 7fc1d2583700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fc1cc0ad270 0x7fc1cc05f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:34.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.308+0000 7fc1d2583700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1cc0adcb0 con 0x7fc1cc0afcc0 2021-11-12T05:49:34.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.308+0000 7fc1d2583700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1cc146c90 con 0x7fc1cc0ad270 2021-11-12T05:49:34.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.308+0000 7fc1d2583700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc066f80 con 0x7fc1cc066ba0 2021-11-12T05:49:34.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.312+0000 7fc1cb7fe700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7fc1cc0afcc0 0x7fc1cc146580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:60890/0 (socket says 172.21.2.105:60890) 2021-11-12T05:49:34.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.312+0000 7fc1cb7fe700 1 -- 172.21.2.105:0/3939675716 learned_addr learned my addr 172.21.2.105:0/3939675716 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:34.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.312+0000 7fc1d0b20700 1 --2- 172.21.2.105:0/3939675716 >> v2:172.21.2.115:3300/0 conn(0x7fc1cc0ad270 0x7fc1cc05f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:34.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.312+0000 7fc1cbfff700 1 --2- 172.21.2.105:0/3939675716 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc1cc066ba0 0x7fc1cc0ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:34.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.312+0000 7fc1cbfff700 1 -- 172.21.2.105:0/3939675716 >> v2:172.21.2.115:3300/0 conn(0x7fc1cc0ad270 msgr2=0x7fc1cc05f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:34.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.312+0000 7fc1cbfff700 1 --2- 172.21.2.105:0/3939675716 >> v2:172.21.2.115:3300/0 conn(0x7fc1cc0ad270 0x7fc1cc05f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:34.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.312+0000 7fc1cbfff700 1 -- 172.21.2.105:0/3939675716 >> v1:172.21.2.115:6789/0 conn(0x7fc1cc0afcc0 legacy=0x7fc1cc146580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:34.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.312+0000 7fc1cbfff700 1 -- 172.21.2.105:0/3939675716 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1cc0b0880 con 0x7fc1cc066ba0 2021-11-12T05:49:34.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.312+0000 7fc1cbfff700 1 --2- 172.21.2.105:0/3939675716 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc1cc066ba0 0x7fc1cc0ad7c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fc1bc002f70 tx=0x7fc1bc006df0).ready entity=mon.2 client_cookie=9b1af686a1f4c2ab server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:34.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.312+0000 7fc1caffd700 1 -- 172.21.2.105:0/3939675716 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1bc00d570 con 0x7fc1cc066ba0 2021-11-12T05:49:34.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.312+0000 7fc1caffd700 1 -- 172.21.2.105:0/3939675716 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1bc000e90 con 0x7fc1cc066ba0 2021-11-12T05:49:34.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.312+0000 7fc1caffd700 1 -- 172.21.2.105:0/3939675716 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1bc00d8c0 con 0x7fc1cc066ba0 2021-11-12T05:49:34.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.312+0000 7fc1d2583700 1 -- 172.21.2.105:0/3939675716 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc1cc066ba0 msgr2=0x7fc1cc0ad7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:34.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.312+0000 7fc1d2583700 1 --2- 172.21.2.105:0/3939675716 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc1cc066ba0 0x7fc1cc0ad7c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fc1bc002f70 tx=0x7fc1bc006df0).stop 2021-11-12T05:49:34.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.312+0000 7fc1d2583700 1 -- 172.21.2.105:0/3939675716 shutdown_connections 2021-11-12T05:49:34.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.312+0000 7fc1d2583700 1 --2- 172.21.2.105:0/3939675716 >> v2:172.21.2.115:3300/0 conn(0x7fc1cc0ad270 0x7fc1cc05f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:34.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.312+0000 7fc1d2583700 1 --2- 172.21.2.105:0/3939675716 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc1cc066ba0 0x7fc1cc0ad7c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:34.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.312+0000 7fc1d2583700 1 -- 172.21.2.105:0/3939675716 >> 172.21.2.105:0/3939675716 conn(0x7fc1cc0b5320 msgr2=0x7fc1cc0b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:34.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.312+0000 7fc1d2583700 1 -- 172.21.2.105:0/3939675716 shutdown_connections 2021-11-12T05:49:34.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.312+0000 7fc1d2583700 1 -- 172.21.2.105:0/3939675716 wait complete. 2021-11-12T05:49:34.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.312+0000 7fc1d2583700 1 Processor -- start 2021-11-12T05:49:34.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.316+0000 7fc1d2583700 1 -- start start 2021-11-12T05:49:34.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.316+0000 7fc1d2583700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc1cc066ba0 0x7fc1cc1108e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:34.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.316+0000 7fc1d2583700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc1cc0ad270 0x7fc1cc1522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:34.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.316+0000 7fc1d2583700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc1cc0afcc0 0x7fc1cc0b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:34.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.316+0000 7fc1d2583700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc10ef80 con 0x7fc1cc066ba0 2021-11-12T05:49:34.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.316+0000 7fc1d2583700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc10ec60 con 0x7fc1cc0afcc0 2021-11-12T05:49:34.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.316+0000 7fc1d2583700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1cc10fa70 con 0x7fc1cc0ad270 2021-11-12T05:49:34.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.316+0000 7fc1cbfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc1cc066ba0 0x7fc1cc1108e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:34.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.316+0000 7fc1cbfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc1cc066ba0 0x7fc1cc1108e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52030/0 (socket says 172.21.2.105:52030) 2021-11-12T05:49:34.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.316+0000 7fc1cbfff700 1 -- 172.21.2.105:0/854802406 learned_addr learned my addr 172.21.2.105:0/854802406 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:34.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.316+0000 7fc1cbfff700 1 -- 172.21.2.105:0/854802406 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc1cc0ad270 msgr2=0x7fc1cc1522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:34.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.316+0000 7fc1cbfff700 1 --2- 172.21.2.105:0/854802406 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc1cc0ad270 0x7fc1cc1522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:34.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.316+0000 7fc1cbfff700 1 -- 172.21.2.105:0/854802406 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc1cc0afcc0 msgr2=0x7fc1cc0b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:34.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.316+0000 7fc1cbfff700 1 --2- 172.21.2.105:0/854802406 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc1cc0afcc0 0x7fc1cc0b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:34.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.316+0000 7fc1cbfff700 1 -- 172.21.2.105:0/854802406 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1bc00b180 con 0x7fc1cc066ba0 2021-11-12T05:49:34.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.316+0000 7fc1cbfff700 1 --2- 172.21.2.105:0/854802406 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc1cc066ba0 0x7fc1cc1108e0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 rx=0x7fc1cc10eda0 tx=0x7fc1bc014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:34.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.316+0000 7fc1c97fa700 1 -- 172.21.2.105:0/854802406 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1bc00dea0 con 0x7fc1cc066ba0 2021-11-12T05:49:34.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.316+0000 7fc1c97fa700 1 -- 172.21.2.105:0/854802406 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1bc01e400 con 0x7fc1cc066ba0 2021-11-12T05:49:34.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.316+0000 7fc1d2583700 1 -- 172.21.2.105:0/854802406 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1cc10e950 con 0x7fc1cc066ba0 2021-11-12T05:49:34.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.316+0000 7fc1d2583700 1 -- 172.21.2.105:0/854802406 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1cc0b4ac0 con 0x7fc1cc066ba0 2021-11-12T05:49:34.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.316+0000 7fc1c97fa700 1 -- 172.21.2.105:0/854802406 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1bc01e760 con 0x7fc1cc066ba0 2021-11-12T05:49:34.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.316+0000 7fc1d2583700 1 -- 172.21.2.105:0/854802406 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1cc057350 con 0x7fc1cc066ba0 2021-11-12T05:49:34.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.316+0000 7fc1c97fa700 1 -- 172.21.2.105:0/854802406 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc1bc025030 con 0x7fc1cc066ba0 2021-11-12T05:49:34.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.316+0000 7fc1c97fa700 1 --2- 172.21.2.105:0/854802406 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc1b00536a0 0x7fc1b0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:34.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.316+0000 7fc1c97fa700 1 -- 172.21.2.105:0/854802406 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fc1bc06c640 con 0x7fc1cc066ba0 2021-11-12T05:49:34.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.316+0000 7fc1cb7fe700 1 --2- 172.21.2.105:0/854802406 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc1b00536a0 0x7fc1b0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:34.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.316+0000 7fc1cb7fe700 1 --2- 172.21.2.105:0/854802406 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc1b00536a0 0x7fc1b0055b60 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7fc1cc0b0760 tx=0x7fc1b4007860).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:34.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.320+0000 7fc1c97fa700 1 -- 172.21.2.105:0/854802406 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc1bc0472a0 con 0x7fc1cc066ba0 2021-11-12T05:49:34.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.428+0000 7fc1d2583700 1 -- 172.21.2.105:0/854802406 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc1cc0b1240 con 0x7fc1cc066ba0 2021-11-12T05:49:34.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.428+0000 7fc1c97fa700 1 -- 172.21.2.105:0/854802406 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v43) v1 ==== 80+0+4242 (secure 0 0 0) 0x7fc1bc023020 con 0x7fc1cc066ba0 2021-11-12T05:49:34.435 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:34.435 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:49:34.436 INFO:teuthology.orchestra.run.gibba005.stdout: "auth_dump": [ 2021-11-12T05:49:34.436 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:34.436 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mds.a", 2021-11-12T05:49:34.436 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1hGVLeOhAAX2029T+USC1Um93TSzjxdA==", 2021-11-12T05:49:34.436 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:34.437 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:49:34.437 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:49:34.437 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:49:34.437 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:34.438 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:34.438 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:34.438 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:34.438 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mds.b", 2021-11-12T05:49:34.439 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hiebUAxAAGcjDAGyvecjzagGoRBX8tg==", 2021-11-12T05:49:34.439 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:34.439 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:49:34.439 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:49:34.439 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:49:34.440 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:34.440 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:34.440 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:34.440 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:34.440 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.0", 2021-11-12T05:49:34.441 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1ht05fORAAN2YrbsxBau1FQC4C8Dvb3g==", 2021-11-12T05:49:34.441 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:34.441 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:49:34.441 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:49:34.442 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:34.442 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:34.442 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:34.442 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:34.442 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.1", 2021-11-12T05:49:34.443 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAu/o1hzp1vGhAAQ6u3Npb+yNGlNOUdoHzFZA==", 2021-11-12T05:49:34.443 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:34.443 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:49:34.443 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:49:34.444 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:34.444 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:34.444 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:34.444 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:34.444 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.2", 2021-11-12T05:49:34.445 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAw/o1hHWwOOhAAx7txWG8rbch18+SBnJkfkQ==", 2021-11-12T05:49:34.445 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:34.445 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:49:34.445 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:49:34.446 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:34.446 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:34.446 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:34.446 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:34.446 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.3", 2021-11-12T05:49:34.447 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAz/o1howZpHxAAKgUVxU2tSNZbxW+6OfJF9g==", 2021-11-12T05:49:34.447 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:34.447 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:49:34.447 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:49:34.448 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:34.448 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:34.448 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:34.448 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:34.448 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.4", 2021-11-12T05:49:34.449 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA2/o1humA5KRAAVbO6UYLOBQDq3WiEkkS6xw==", 2021-11-12T05:49:34.449 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:34.449 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:49:34.449 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:49:34.450 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:34.450 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:34.450 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:34.450 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:34.450 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.5", 2021-11-12T05:49:34.451 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA5/o1hALdKDRAAR9nsaDOo9GUgpmBPHVp5HQ==", 2021-11-12T05:49:34.451 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:34.451 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:49:34.451 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:49:34.452 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:34.452 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:34.452 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:34.452 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:34.453 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.6", 2021-11-12T05:49:34.453 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA7/o1hCVP2KhAAHj5SxnJ81mKrJOg2CE2wLQ==", 2021-11-12T05:49:34.453 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:34.453 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:49:34.453 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:49:34.454 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:34.454 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:34.454 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:34.454 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:34.455 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.7", 2021-11-12T05:49:34.455 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA+/o1hWCEqEBAAv8nF9NeF2Ue5W8Ijj8Skgg==", 2021-11-12T05:49:34.455 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:34.456 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:49:34.456 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:49:34.456 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:34.456 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:34.457 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:34.457 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:34.457 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.0", 2021-11-12T05:49:34.458 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hzEzhCBAATF8giEBtrj13SAr5EJV4TA==", 2021-11-12T05:49:34.458 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:34.458 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:49:34.458 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow r", 2021-11-12T05:49:34.458 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-12T05:49:34.459 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:34.459 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:34.459 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:34.459 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.1", 2021-11-12T05:49:34.460 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hO6zfCxAAae1obagtpsnA9e8FlTExVA==", 2021-11-12T05:49:34.460 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:34.460 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:49:34.460 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow r", 2021-11-12T05:49:34.460 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-12T05:49:34.461 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:34.461 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:34.461 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:34.461 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.2", 2021-11-12T05:49:34.462 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hFYDGDhAAyz77VXKtOz86ztJ8FUIvAg==", 2021-11-12T05:49:34.462 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:34.462 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:49:34.462 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow r", 2021-11-12T05:49:34.462 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-12T05:49:34.463 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:34.463 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:34.463 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:34.463 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.admin", 2021-11-12T05:49:34.464 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1hwdoBHRAAUHHEU3dbyso2BnE/JppV8A==", 2021-11-12T05:49:34.464 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:34.464 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow *", 2021-11-12T05:49:34.464 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:49:34.464 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:49:34.465 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:34.465 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:34.465 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:34.465 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:34.466 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mgr.x", 2021-11-12T05:49:34.466 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1h6JBaORAAbgxQtCzGNj7MLfgwGd4cWA==", 2021-11-12T05:49:34.466 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:34.466 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow *", 2021-11-12T05:49:34.466 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow profile mgr", 2021-11-12T05:49:34.467 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:34.467 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:34.467 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:34.467 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:34.467 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mgr.y", 2021-11-12T05:49:34.468 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1hwfvvNRAASU7NmYBG/Yb6/ma1/Ew7mw==", 2021-11-12T05:49:34.468 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:34.468 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow *", 2021-11-12T05:49:34.468 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow profile mgr", 2021-11-12T05:49:34.469 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:34.469 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:34.469 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:34.469 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:34.469 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:49:34.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.432+0000 7fc1d2583700 1 -- 172.21.2.105:0/854802406 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc1b00536a0 msgr2=0x7fc1b0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:34.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.432+0000 7fc1d2583700 1 --2- 172.21.2.105:0/854802406 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc1b00536a0 0x7fc1b0055b60 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7fc1cc0b0760 tx=0x7fc1b4007860).stop 2021-11-12T05:49:34.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.432+0000 7fc1d2583700 1 -- 172.21.2.105:0/854802406 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc1cc066ba0 msgr2=0x7fc1cc1108e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:34.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.432+0000 7fc1d2583700 1 --2- 172.21.2.105:0/854802406 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc1cc066ba0 0x7fc1cc1108e0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 rx=0x7fc1cc10eda0 tx=0x7fc1bc014000).stop 2021-11-12T05:49:34.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.432+0000 7fc1d2583700 1 -- 172.21.2.105:0/854802406 shutdown_connections 2021-11-12T05:49:34.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.432+0000 7fc1d2583700 1 --2- 172.21.2.105:0/854802406 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc1b00536a0 0x7fc1b0055b60 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:34.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.432+0000 7fc1d2583700 1 --2- 172.21.2.105:0/854802406 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc1cc0afcc0 0x7fc1cc0b45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:34.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.432+0000 7fc1d2583700 1 --2- 172.21.2.105:0/854802406 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc1cc0ad270 0x7fc1cc1522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:34.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.432+0000 7fc1d2583700 1 --2- 172.21.2.105:0/854802406 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc1cc066ba0 0x7fc1cc1108e0 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:34.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.432+0000 7fc1d2583700 1 -- 172.21.2.105:0/854802406 >> 172.21.2.105:0/854802406 conn(0x7fc1cc0b5320 msgr2=0x7fc1cc13d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:34.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.432+0000 7fc1d2583700 1 -- 172.21.2.105:0/854802406 shutdown_connections 2021-11-12T05:49:34.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.432+0000 7fc1d2583700 1 -- 172.21.2.105:0/854802406 wait complete. 2021-11-12T05:49:34.474 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:49:34.526 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.520+0000 7f55b1fc1700 1 Processor -- start 2021-11-12T05:49:34.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.520+0000 7f55b1fc1700 1 -- start start 2021-11-12T05:49:34.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55b1fc1700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f55ac05f9f0 0x7f55ac0601b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:34.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55b1fc1700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f55ac0b26d0 0x7f55ac0b3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:34.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55b1fc1700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f55ac0b3970 0x7f55ac146660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:34.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55b1fc1700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55ac0af340 con 0x7f55ac0b26d0 2021-11-12T05:49:34.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55b1fc1700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55ac0af7f0 con 0x7f55ac05f9f0 2021-11-12T05:49:34.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55b1fc1700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac0b3e00 con 0x7f55ac0b3970 2021-11-12T05:49:34.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55aaffd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f55ac0b26d0 0x7f55ac0b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:34.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55aaffd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f55ac0b26d0 0x7f55ac0b3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52040/0 (socket says 172.21.2.105:52040) 2021-11-12T05:49:34.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55aaffd700 1 -- 172.21.2.105:0/465005007 learned_addr learned my addr 172.21.2.105:0/465005007 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:34.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55aaffd700 1 -- 172.21.2.105:0/465005007 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f55ac0b3970 msgr2=0x7f55ac146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:34.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55aaffd700 1 --2- 172.21.2.105:0/465005007 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f55ac0b3970 0x7f55ac146660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:34.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55aaffd700 1 -- 172.21.2.105:0/465005007 >> v2:172.21.2.115:3300/0 conn(0x7f55ac05f9f0 msgr2=0x7f55ac0601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:34.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55aaffd700 1 --2- 172.21.2.105:0/465005007 >> v2:172.21.2.115:3300/0 conn(0x7f55ac05f9f0 0x7f55ac0601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:34.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55aaffd700 1 -- 172.21.2.105:0/465005007 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ac05fdd0 con 0x7f55ac0b26d0 2021-11-12T05:49:34.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55aaffd700 1 --2- 172.21.2.105:0/465005007 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f55ac0b26d0 0x7f55ac0b3480 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 rx=0x7f559c0032f0 tx=0x7f559c009290).ready entity=mon.0 client_cookie=670d62e4a37b3580 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:34.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55aa7fc700 1 -- 172.21.2.105:0/465005007 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f559c00b870 con 0x7f55ac0b26d0 2021-11-12T05:49:34.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55aa7fc700 1 -- 172.21.2.105:0/465005007 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559c00b9d0 con 0x7f55ac0b26d0 2021-11-12T05:49:34.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55aa7fc700 1 -- 172.21.2.105:0/465005007 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f559c00bb40 con 0x7f55ac0b26d0 2021-11-12T05:49:34.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55b1fc1700 1 -- 172.21.2.105:0/465005007 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f55ac0b26d0 msgr2=0x7f55ac0b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:34.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55b1fc1700 1 --2- 172.21.2.105:0/465005007 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f55ac0b26d0 0x7f55ac0b3480 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 rx=0x7f559c0032f0 tx=0x7f559c009290).stop 2021-11-12T05:49:34.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55b1fc1700 1 -- 172.21.2.105:0/465005007 shutdown_connections 2021-11-12T05:49:34.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55b1fc1700 1 --2- 172.21.2.105:0/465005007 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f55ac0b3970 0x7f55ac146660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:34.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55b1fc1700 1 --2- 172.21.2.105:0/465005007 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f55ac0b26d0 0x7f55ac0b3480 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:34.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55b1fc1700 1 --2- 172.21.2.105:0/465005007 >> v2:172.21.2.115:3300/0 conn(0x7f55ac05f9f0 0x7f55ac0601b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:34.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55b1fc1700 1 -- 172.21.2.105:0/465005007 >> 172.21.2.105:0/465005007 conn(0x7f55ac05c490 msgr2=0x7f55ac05c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:34.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55b1fc1700 1 -- 172.21.2.105:0/465005007 shutdown_connections 2021-11-12T05:49:34.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55b1fc1700 1 -- 172.21.2.105:0/465005007 wait complete. 2021-11-12T05:49:34.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55b1fc1700 1 Processor -- start 2021-11-12T05:49:34.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55b1fc1700 1 -- start start 2021-11-12T05:49:34.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55b1fc1700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f55ac05f9f0 0x7f55ac0b5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:34.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55b1fc1700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f55ac0b26d0 0x7f55ac0ab570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:34.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55b1fc1700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f55ac0b3970 0x7f55ac1568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:34.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55b1fc1700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac141ea0 con 0x7f55ac0b26d0 2021-11-12T05:49:34.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55b1fc1700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac0aab90 con 0x7f55ac0b3970 2021-11-12T05:49:34.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55b1fc1700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac0aae30 con 0x7f55ac05f9f0 2021-11-12T05:49:34.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55aaffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f55ac0b26d0 0x7f55ac0ab570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:34.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55aaffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f55ac0b26d0 0x7f55ac0ab570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52044/0 (socket says 172.21.2.105:52044) 2021-11-12T05:49:34.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55aaffd700 1 -- 172.21.2.105:0/1246583034 learned_addr learned my addr 172.21.2.105:0/1246583034 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:34.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55aaffd700 1 -- 172.21.2.105:0/1246583034 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f55ac05f9f0 msgr2=0x7f55ac0b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:34.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55aaffd700 1 --2- 172.21.2.105:0/1246583034 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f55ac05f9f0 0x7f55ac0b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:34.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55aaffd700 1 -- 172.21.2.105:0/1246583034 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f55ac0b3970 msgr2=0x7f55ac1568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:34.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55aaffd700 1 --2- 172.21.2.105:0/1246583034 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f55ac0b3970 0x7f55ac1568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:34.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55aaffd700 1 -- 172.21.2.105:0/1246583034 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f559c009530 con 0x7f55ac0b26d0 2021-11-12T05:49:34.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55aaffd700 1 --2- 172.21.2.105:0/1246583034 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f55ac0b26d0 0x7f55ac0ab570 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 rx=0x7f559c0032f0 tx=0x7f559c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:34.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55a8ff9700 1 -- 172.21.2.105:0/1246583034 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f559c00b870 con 0x7f55ac0b26d0 2021-11-12T05:49:34.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55a8ff9700 1 -- 172.21.2.105:0/1246583034 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559c01f410 con 0x7f55ac0b26d0 2021-11-12T05:49:34.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55b1fc1700 1 -- 172.21.2.105:0/1246583034 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55ac0ab0d0 con 0x7f55ac0b26d0 2021-11-12T05:49:34.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55a8ff9700 1 -- 172.21.2.105:0/1246583034 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f559c01f770 con 0x7f55ac0b26d0 2021-11-12T05:49:34.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.524+0000 7f55b1fc1700 1 -- 172.21.2.105:0/1246583034 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55ac156db0 con 0x7f55ac0b26d0 2021-11-12T05:49:34.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.528+0000 7f55b1fc1700 1 -- 172.21.2.105:0/1246583034 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55ac0ab260 con 0x7f55ac0b26d0 2021-11-12T05:49:34.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.528+0000 7f55a8ff9700 1 -- 172.21.2.105:0/1246583034 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f559c00f070 con 0x7f55ac0b26d0 2021-11-12T05:49:34.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.528+0000 7f55a8ff9700 1 --2- 172.21.2.105:0/1246583034 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f55900536f0 0x7f5590055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:34.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.528+0000 7f55a8ff9700 1 -- 172.21.2.105:0/1246583034 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f559c06c2e0 con 0x7f55ac0b26d0 2021-11-12T05:49:34.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.528+0000 7f55ab7fe700 1 --2- 172.21.2.105:0/1246583034 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f55900536f0 0x7f5590055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:34.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.528+0000 7f55ab7fe700 1 --2- 172.21.2.105:0/1246583034 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f55900536f0 0x7f5590055bb0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f5594002f70 tx=0x7f55940069e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:34.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.528+0000 7f55a8ff9700 1 -- 172.21.2.105:0/1246583034 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f559c043620 con 0x7f55ac0b26d0 2021-11-12T05:49:34.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.612+0000 7f55b1fc1700 1 -- 172.21.2.105:0/1246583034 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55ac0af550 con 0x7f55ac0b26d0 2021-11-12T05:49:34.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.612+0000 7f55a8ff9700 1 -- 172.21.2.105:0/1246583034 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) v1 ==== 74+0+13424 (secure 0 0 0) 0x7f559c030480 con 0x7f55ac0b26d0 2021-11-12T05:49:34.618 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:34.619 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":140,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:49:34.195580+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:49:34.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.612+0000 7f55b1fc1700 1 -- 172.21.2.105:0/1246583034 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f55900536f0 msgr2=0x7f5590055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:34.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.612+0000 7f55b1fc1700 1 --2- 172.21.2.105:0/1246583034 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f55900536f0 0x7f5590055bb0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f5594002f70 tx=0x7f55940069e0).stop 2021-11-12T05:49:34.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.612+0000 7f55b1fc1700 1 -- 172.21.2.105:0/1246583034 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f55ac0b26d0 msgr2=0x7f55ac0ab570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:34.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.612+0000 7f55b1fc1700 1 --2- 172.21.2.105:0/1246583034 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f55ac0b26d0 0x7f55ac0ab570 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 rx=0x7f559c0032f0 tx=0x7f559c016000).stop 2021-11-12T05:49:34.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.616+0000 7f55b1fc1700 1 -- 172.21.2.105:0/1246583034 shutdown_connections 2021-11-12T05:49:34.621 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.616+0000 7f55b1fc1700 1 --2- 172.21.2.105:0/1246583034 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f55900536f0 0x7f5590055bb0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:34.621 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.616+0000 7f55b1fc1700 1 --2- 172.21.2.105:0/1246583034 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f55ac0b3970 0x7f55ac1568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:34.621 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.616+0000 7f55b1fc1700 1 --2- 172.21.2.105:0/1246583034 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f55ac0b26d0 0x7f55ac0ab570 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:34.621 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.616+0000 7f55b1fc1700 1 --2- 172.21.2.105:0/1246583034 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f55ac05f9f0 0x7f55ac0b5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:34.621 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.616+0000 7f55b1fc1700 1 -- 172.21.2.105:0/1246583034 >> 172.21.2.105:0/1246583034 conn(0x7f55ac05c490 msgr2=0x7f55ac142c30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:34.622 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.616+0000 7f55b1fc1700 1 -- 172.21.2.105:0/1246583034 shutdown_connections 2021-11-12T05:49:34.622 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.616+0000 7f55b1fc1700 1 -- 172.21.2.105:0/1246583034 wait complete. 2021-11-12T05:49:34.626 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-12T05:49:34.626 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:49:34.679 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc3845cd700 1 Processor -- start 2021-11-12T05:49:34.679 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc3845cd700 1 -- start start 2021-11-12T05:49:34.682 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc3845cd700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fc37c0b4060 0x7fc37c146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:34.683 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc3845cd700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc37c147620 con 0x7fc37c0b6430 2021-11-12T05:49:34.683 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc3845cd700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc37c0b6810 con 0x7fc37c1471b0 2021-11-12T05:49:34.683 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc3845cd700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc37c0b6d60 con 0x7fc37c0b4060 2021-11-12T05:49:34.683 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc382369700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fc37c0b6430 0x7fc37c143090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34216/0 (socket says 172.21.2.105:34216) 2021-11-12T05:49:34.683 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc382369700 1 -- 172.21.2.105:0/3473329265 learned_addr learned my addr 172.21.2.105:0/3473329265 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:34.684 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc381367700 1 -- 172.21.2.105:0/3473329265 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2038981765 0 0) 0x7fc37c147620 con 0x7fc37c0b6430 2021-11-12T05:49:34.684 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc381367700 1 -- 172.21.2.105:0/3473329265 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc364003260 con 0x7fc37c0b6430 2021-11-12T05:49:34.684 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc381367700 1 -- 172.21.2.105:0/3473329265 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3642690500 0 0) 0x7fc364003260 con 0x7fc37c0b6430 2021-11-12T05:49:34.684 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc381367700 1 -- 172.21.2.105:0/3473329265 >> v2:172.21.2.115:3300/0 conn(0x7fc37c0b4060 msgr2=0x7fc37c146cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:34.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc381367700 1 --2- 172.21.2.105:0/3473329265 >> v2:172.21.2.115:3300/0 conn(0x7fc37c0b4060 0x7fc37c146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:34.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc381367700 1 -- 172.21.2.105:0/3473329265 >> v1:172.21.2.115:6789/0 conn(0x7fc37c1471b0 legacy=0x7fc37c140040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:34.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc381367700 1 -- 172.21.2.105:0/3473329265 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37c146820 con 0x7fc37c0b6430 2021-11-12T05:49:34.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc381367700 1 -- 172.21.2.105:0/3473329265 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fc378001660 con 0x7fc37c0b6430 2021-11-12T05:49:34.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc381367700 1 -- 172.21.2.105:0/3473329265 >> v1:172.21.2.105:6789/0 conn(0x7fc37c0b6430 legacy=0x7fc37c143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:34.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc381367700 1 --2- 172.21.2.105:0/3473329265 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc364003820 0x7fc364003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:34.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc381367700 1 --2- 172.21.2.105:0/3473329265 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc364004500 0x7fc364004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:34.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc381367700 1 --2- 172.21.2.105:0/3473329265 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc364005050 0x7fc36400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:34.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc381367700 1 -- 172.21.2.105:0/3473329265 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c0b6d60 con 0x7fc364003820 2021-11-12T05:49:34.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc381367700 1 -- 172.21.2.105:0/3473329265 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36400bf40 con 0x7fc364005050 2021-11-12T05:49:34.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc381367700 1 -- 172.21.2.105:0/3473329265 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc36400c100 con 0x7fc364004500 2021-11-12T05:49:34.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc382369700 1 --2- 172.21.2.105:0/3473329265 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc364003820 0x7fc364003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:34.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc382369700 1 -- 172.21.2.105:0/3473329265 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc364004500 msgr2=0x7fc364004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:34.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc382369700 1 --2- 172.21.2.105:0/3473329265 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc364004500 0x7fc364004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:34.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc382369700 1 -- 172.21.2.105:0/3473329265 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc364005050 msgr2=0x7fc36400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:34.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc382369700 1 --2- 172.21.2.105:0/3473329265 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc364005050 0x7fc36400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:34.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc382369700 1 -- 172.21.2.105:0/3473329265 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc364003260 con 0x7fc364003820 2021-11-12T05:49:34.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc382b6a700 1 -- 172.21.2.105:0/3473329265 reap_dead start 2021-11-12T05:49:34.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc382369700 1 --2- 172.21.2.105:0/3473329265 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc364003820 0x7fc364003c20 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 rx=0x7fc37c05d4c0 tx=0x7fc37c1469b0).ready entity=mon.0 client_cookie=be12723f61ce5503 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:34.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc381367700 1 -- 172.21.2.105:0/3473329265 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3780070d0 con 0x7fc364003820 2021-11-12T05:49:34.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc381367700 1 -- 172.21.2.105:0/3473329265 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc378007230 con 0x7fc364003820 2021-11-12T05:49:34.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc381367700 1 -- 172.21.2.105:0/3473329265 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc37800c8f0 con 0x7fc364003820 2021-11-12T05:49:34.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc3845cd700 1 -- 172.21.2.105:0/3473329265 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc364003820 msgr2=0x7fc364003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:34.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc3845cd700 1 --2- 172.21.2.105:0/3473329265 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc364003820 0x7fc364003c20 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 rx=0x7fc37c05d4c0 tx=0x7fc37c1469b0).stop 2021-11-12T05:49:34.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc3845cd700 1 -- 172.21.2.105:0/3473329265 shutdown_connections 2021-11-12T05:49:34.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc3845cd700 1 --2- 172.21.2.105:0/3473329265 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc364003820 0x7fc364003c20 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:34.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc3845cd700 1 -- 172.21.2.105:0/3473329265 >> 172.21.2.105:0/3473329265 conn(0x7fc37c062030 msgr2=0x7fc37c062440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:34.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc3845cd700 1 -- 172.21.2.105:0/3473329265 shutdown_connections 2021-11-12T05:49:34.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc3845cd700 1 -- 172.21.2.105:0/3473329265 wait complete. 2021-11-12T05:49:34.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc3845cd700 1 Processor -- start 2021-11-12T05:49:34.692 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.676+0000 7fc3845cd700 1 -- start start 2021-11-12T05:49:34.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.680+0000 7fc3845cd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc364003820 0x7fc37c0b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:34.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.680+0000 7fc3845cd700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc37c142cd0 0x7fc37c1562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:34.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.680+0000 7fc3845cd700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc37c141b10 0x7fc37c1567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:34.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.680+0000 7fc3845cd700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c141150 con 0x7fc364003820 2021-11-12T05:49:34.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.680+0000 7fc3845cd700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c143250 con 0x7fc37c141b10 2021-11-12T05:49:34.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.680+0000 7fc3845cd700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c1434f0 con 0x7fc37c142cd0 2021-11-12T05:49:34.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.680+0000 7fc382369700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc364003820 0x7fc37c0b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:34.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.680+0000 7fc382369700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc364003820 0x7fc37c0b2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52064/0 (socket says 172.21.2.105:52064) 2021-11-12T05:49:34.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.680+0000 7fc382369700 1 -- 172.21.2.105:0/2797095484 learned_addr learned my addr 172.21.2.105:0/2797095484 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:34.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.680+0000 7fc382369700 1 -- 172.21.2.105:0/2797095484 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc37c142cd0 msgr2=0x7fc37c1562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:34.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.680+0000 7fc382369700 1 --2- 172.21.2.105:0/2797095484 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc37c142cd0 0x7fc37c1562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:34.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.680+0000 7fc382369700 1 -- 172.21.2.105:0/2797095484 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc37c141b10 msgr2=0x7fc37c1567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:34.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.680+0000 7fc382369700 1 --2- 172.21.2.105:0/2797095484 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc37c141b10 0x7fc37c1567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:34.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.680+0000 7fc382369700 1 -- 172.21.2.105:0/2797095484 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37c143790 con 0x7fc364003820 2021-11-12T05:49:34.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.680+0000 7fc382369700 1 --2- 172.21.2.105:0/2797095484 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc364003820 0x7fc37c0b2cb0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 rx=0x7fc37c05d4c0 tx=0x7fc378015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:34.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.680+0000 7fc36f7fe700 1 -- 172.21.2.105:0/2797095484 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3780070d0 con 0x7fc364003820 2021-11-12T05:49:34.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.680+0000 7fc36f7fe700 1 -- 172.21.2.105:0/2797095484 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc378004920 con 0x7fc364003820 2021-11-12T05:49:34.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.680+0000 7fc3845cd700 1 -- 172.21.2.105:0/2797095484 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc37c0b31a0 con 0x7fc364003820 2021-11-12T05:49:34.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.680+0000 7fc36f7fe700 1 -- 172.21.2.105:0/2797095484 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc378004c80 con 0x7fc364003820 2021-11-12T05:49:34.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.680+0000 7fc3845cd700 1 -- 172.21.2.105:0/2797095484 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc37c114480 con 0x7fc364003820 2021-11-12T05:49:34.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.680+0000 7fc3845cd700 1 -- 172.21.2.105:0/2797095484 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc37c143920 con 0x7fc364003820 2021-11-12T05:49:34.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.680+0000 7fc36f7fe700 1 -- 172.21.2.105:0/2797095484 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc378027070 con 0x7fc364003820 2021-11-12T05:49:34.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.680+0000 7fc36f7fe700 1 --2- 172.21.2.105:0/2797095484 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc35c053610 0x7fc35c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:34.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.680+0000 7fc36f7fe700 1 -- 172.21.2.105:0/2797095484 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fc37806c2a0 con 0x7fc364003820 2021-11-12T05:49:34.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.680+0000 7fc381b68700 1 --2- 172.21.2.105:0/2797095484 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc35c053610 0x7fc35c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:34.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.680+0000 7fc381b68700 1 --2- 172.21.2.105:0/2797095484 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc35c053610 0x7fc35c055ad0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7fc370002f70 tx=0x7fc370006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:34.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.684+0000 7fc36f7fe700 1 -- 172.21.2.105:0/2797095484 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc3780435e0 con 0x7fc364003820 2021-11-12T05:49:34.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.768+0000 7fc3845cd700 1 -- 172.21.2.105:0/2797095484 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc37c0b39a0 con 0x7fc364003820 2021-11-12T05:49:34.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.768+0000 7fc36f7fe700 1 -- 172.21.2.105:0/2797095484 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v140) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc378001ae0 con 0x7fc364003820 2021-11-12T05:49:34.772 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:49:34.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.768+0000 7fc3845cd700 1 -- 172.21.2.105:0/2797095484 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc35c053610 msgr2=0x7fc35c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:34.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.768+0000 7fc3845cd700 1 --2- 172.21.2.105:0/2797095484 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc35c053610 0x7fc35c055ad0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7fc370002f70 tx=0x7fc370006a80).stop 2021-11-12T05:49:34.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.768+0000 7fc3845cd700 1 -- 172.21.2.105:0/2797095484 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc364003820 msgr2=0x7fc37c0b2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:34.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.768+0000 7fc3845cd700 1 --2- 172.21.2.105:0/2797095484 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc364003820 0x7fc37c0b2cb0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 rx=0x7fc37c05d4c0 tx=0x7fc378015000).stop 2021-11-12T05:49:34.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.768+0000 7fc3845cd700 1 -- 172.21.2.105:0/2797095484 shutdown_connections 2021-11-12T05:49:34.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.768+0000 7fc3845cd700 1 --2- 172.21.2.105:0/2797095484 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc35c053610 0x7fc35c055ad0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:34.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.768+0000 7fc3845cd700 1 --2- 172.21.2.105:0/2797095484 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc37c141b10 0x7fc37c1567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:34.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.768+0000 7fc3845cd700 1 --2- 172.21.2.105:0/2797095484 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc37c142cd0 0x7fc37c1562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:34.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.768+0000 7fc3845cd700 1 --2- 172.21.2.105:0/2797095484 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc364003820 0x7fc37c0b2cb0 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:34.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.768+0000 7fc3845cd700 1 -- 172.21.2.105:0/2797095484 >> 172.21.2.105:0/2797095484 conn(0x7fc37c062030 msgr2=0x7fc37c0b79f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:34.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.768+0000 7fc3845cd700 1 -- 172.21.2.105:0/2797095484 shutdown_connections 2021-11-12T05:49:34.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.768+0000 7fc3845cd700 1 -- 172.21.2.105:0/2797095484 wait complete. 2021-11-12T05:49:34.779 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:49:34.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f8de89700 1 Processor -- start 2021-11-12T05:49:34.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f8de89700 1 -- start start 2021-11-12T05:49:34.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f8de89700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2f880b2cc0 0x7f2f880b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:34.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f8de89700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f2f88143da0 0x7f2f88140240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:34.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f8de89700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f880aa0b0 con 0x7f2f880b2290 2021-11-12T05:49:34.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f8de89700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f880a9b70 con 0x7f2f88143da0 2021-11-12T05:49:34.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f8de89700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f880a9e10 con 0x7f2f880b2cc0 2021-11-12T05:49:34.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f86ffd700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f2f880b2290 0x7f2f88143690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34238/0 (socket says 172.21.2.105:34238) 2021-11-12T05:49:34.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f86ffd700 1 -- 172.21.2.105:0/1360991147 learned_addr learned my addr 172.21.2.105:0/1360991147 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:34.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f867fc700 1 -- 172.21.2.105:0/1360991147 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4269509224 0 0) 0x7f2f880aa0b0 con 0x7f2f880b2290 2021-11-12T05:49:34.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f867fc700 1 -- 172.21.2.105:0/1360991147 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f74003260 con 0x7f2f880b2290 2021-11-12T05:49:34.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f87fff700 1 --2- 172.21.2.105:0/1360991147 >> v2:172.21.2.115:3300/0 conn(0x7f2f88143da0 0x7f2f88140240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:34.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f877fe700 1 --2- 172.21.2.105:0/1360991147 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2f880b2cc0 0x7f2f880b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:34.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f867fc700 1 -- 172.21.2.105:0/1360991147 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3234550354 0 0) 0x7f2f74003260 con 0x7f2f880b2290 2021-11-12T05:49:34.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f867fc700 1 -- 172.21.2.105:0/1360991147 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2f880b2cc0 msgr2=0x7f2f880b30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:34.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f867fc700 1 --2- 172.21.2.105:0/1360991147 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2f880b2cc0 0x7f2f880b30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:34.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f867fc700 1 -- 172.21.2.105:0/1360991147 >> v2:172.21.2.115:3300/0 conn(0x7f2f88143da0 msgr2=0x7f2f88140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:34.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f867fc700 1 --2- 172.21.2.105:0/1360991147 >> v2:172.21.2.115:3300/0 conn(0x7f2f88143da0 0x7f2f88140240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:34.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f867fc700 1 -- 172.21.2.105:0/1360991147 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f880b0800 con 0x7f2f880b2290 2021-11-12T05:49:34.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f867fc700 1 -- 172.21.2.105:0/1360991147 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f2f7c001660 con 0x7f2f880b2290 2021-11-12T05:49:34.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f867fc700 1 -- 172.21.2.105:0/1360991147 >> v1:172.21.2.105:6789/0 conn(0x7f2f880b2290 legacy=0x7f2f88143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:34.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f867fc700 1 --2- 172.21.2.105:0/1360991147 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2f740037d0 0x7f2f74003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:34.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f867fc700 1 --2- 172.21.2.105:0/1360991147 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2f880b2cc0 0x7f2f74004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:34.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f867fc700 1 --2- 172.21.2.105:0/1360991147 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2f740049f0 0x7f2f74004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:34.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f867fc700 1 -- 172.21.2.105:0/1360991147 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f880a9b70 con 0x7f2f740049f0 2021-11-12T05:49:34.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f867fc700 1 -- 172.21.2.105:0/1360991147 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f880a9e10 con 0x7f2f740037d0 2021-11-12T05:49:34.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f867fc700 1 -- 172.21.2.105:0/1360991147 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7400b880 con 0x7f2f880b2cc0 2021-11-12T05:49:34.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f87fff700 1 --2- 172.21.2.105:0/1360991147 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2f740049f0 0x7f2f74004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:34.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f87fff700 1 -- 172.21.2.105:0/1360991147 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2f880b2cc0 msgr2=0x7f2f74004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:34.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f87fff700 1 --2- 172.21.2.105:0/1360991147 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2f880b2cc0 0x7f2f74004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:34.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f87fff700 1 -- 172.21.2.105:0/1360991147 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2f740037d0 msgr2=0x7f2f74003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:34.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f87fff700 1 --2- 172.21.2.105:0/1360991147 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2f740037d0 0x7f2f74003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:34.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f87fff700 1 -- 172.21.2.105:0/1360991147 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f74003260 con 0x7f2f740049f0 2021-11-12T05:49:34.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f87fff700 1 --2- 172.21.2.105:0/1360991147 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2f740049f0 0x7f2f74004e70 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 rx=0x7f2f8000a000 tx=0x7f2f80008040).ready entity=mon.0 client_cookie=8dd2d6416297d074 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:34.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f867fc700 1 -- 172.21.2.105:0/1360991147 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f8000c070 con 0x7f2f740049f0 2021-11-12T05:49:34.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f867fc700 1 -- 172.21.2.105:0/1360991147 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8000e5f0 con 0x7f2f740049f0 2021-11-12T05:49:34.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f867fc700 1 -- 172.21.2.105:0/1360991147 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f8000e950 con 0x7f2f740049f0 2021-11-12T05:49:34.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f8de89700 1 -- 172.21.2.105:0/1360991147 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2f740049f0 msgr2=0x7f2f74004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:34.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f8de89700 1 --2- 172.21.2.105:0/1360991147 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2f740049f0 0x7f2f74004e70 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 rx=0x7f2f8000a000 tx=0x7f2f80008040).stop 2021-11-12T05:49:34.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f87fff700 1 -- 172.21.2.105:0/1360991147 reap_dead start 2021-11-12T05:49:34.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f8de89700 1 -- 172.21.2.105:0/1360991147 shutdown_connections 2021-11-12T05:49:34.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f8de89700 1 -- 172.21.2.105:0/1360991147 >> 172.21.2.105:0/1360991147 conn(0x7f2f8805c490 msgr2=0x7f2f8805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:34.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f8de89700 1 -- 172.21.2.105:0/1360991147 shutdown_connections 2021-11-12T05:49:34.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.828+0000 7f2f8de89700 1 -- 172.21.2.105:0/1360991147 wait complete. 2021-11-12T05:49:34.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.832+0000 7f2f8de89700 1 Processor -- start 2021-11-12T05:49:34.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.832+0000 7f2f8de89700 1 -- start start 2021-11-12T05:49:34.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.832+0000 7f2f8de89700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2f740049f0 0x7f2f880a76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:34.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.832+0000 7f2f8de89700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2f880ad300 0x7f2f8812ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:34.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.832+0000 7f2f8de89700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2f8812efc0 0x7f2f880b5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:34.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.832+0000 7f2f8de89700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f880acc40 con 0x7f2f880ad300 2021-11-12T05:49:34.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.832+0000 7f2f8de89700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f880a7020 con 0x7f2f8812efc0 2021-11-12T05:49:34.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.832+0000 7f2f8de89700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f880a7250 con 0x7f2f740049f0 2021-11-12T05:49:34.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.832+0000 7f2f86ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2f880ad300 0x7f2f8812ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:34.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.832+0000 7f2f86ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2f880ad300 0x7f2f8812ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52088/0 (socket says 172.21.2.105:52088) 2021-11-12T05:49:34.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.832+0000 7f2f86ffd700 1 -- 172.21.2.105:0/1240106540 learned_addr learned my addr 172.21.2.105:0/1240106540 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:34.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.832+0000 7f2f86ffd700 1 -- 172.21.2.105:0/1240106540 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2f740049f0 msgr2=0x7f2f880a76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:34.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.832+0000 7f2f86ffd700 1 --2- 172.21.2.105:0/1240106540 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2f740049f0 0x7f2f880a76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:34.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.832+0000 7f2f86ffd700 1 -- 172.21.2.105:0/1240106540 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2f8812efc0 msgr2=0x7f2f880b5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:34.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.832+0000 7f2f86ffd700 1 --2- 172.21.2.105:0/1240106540 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2f8812efc0 0x7f2f880b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:34.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.832+0000 7f2f86ffd700 1 -- 172.21.2.105:0/1240106540 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f880a8d30 con 0x7f2f880ad300 2021-11-12T05:49:34.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.832+0000 7f2f86ffd700 1 --2- 172.21.2.105:0/1240106540 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2f880ad300 0x7f2f8812ead0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 rx=0x7f2f7c001370 tx=0x7f2f880aedf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:34.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.832+0000 7f2f84ff9700 1 -- 172.21.2.105:0/1240106540 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f7c007170 con 0x7f2f880ad300 2021-11-12T05:49:34.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.832+0000 7f2f84ff9700 1 -- 172.21.2.105:0/1240106540 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7c0072d0 con 0x7f2f880ad300 2021-11-12T05:49:34.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.832+0000 7f2f8de89700 1 -- 172.21.2.105:0/1240106540 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f880a8fd0 con 0x7f2f880ad300 2021-11-12T05:49:34.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.832+0000 7f2f8de89700 1 -- 172.21.2.105:0/1240106540 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f880a9720 con 0x7f2f880ad300 2021-11-12T05:49:34.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.832+0000 7f2f84ff9700 1 -- 172.21.2.105:0/1240106540 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f7c004920 con 0x7f2f880ad300 2021-11-12T05:49:34.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.832+0000 7f2f8de89700 1 -- 172.21.2.105:0/1240106540 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f88144210 con 0x7f2f880ad300 2021-11-12T05:49:34.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.832+0000 7f2f84ff9700 1 -- 172.21.2.105:0/1240106540 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2f7c004a80 con 0x7f2f880ad300 2021-11-12T05:49:34.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.832+0000 7f2f84ff9700 1 --2- 172.21.2.105:0/1240106540 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2f680536f0 0x7f2f68055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:34.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.832+0000 7f2f84ff9700 1 -- 172.21.2.105:0/1240106540 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f2f7c06b210 con 0x7f2f880ad300 2021-11-12T05:49:34.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.832+0000 7f2f877fe700 1 --2- 172.21.2.105:0/1240106540 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2f680536f0 0x7f2f68055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:34.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.832+0000 7f2f877fe700 1 --2- 172.21.2.105:0/1240106540 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2f680536f0 0x7f2f68055bb0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f2f7800a000 tx=0x7f2f78008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:34.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.836+0000 7f2f84ff9700 1 -- 172.21.2.105:0/1240106540 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2f7c042550 con 0x7f2f880ad300 2021-11-12T05:49:34.924 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.920+0000 7f2f8de89700 1 -- 172.21.2.105:0/1240106540 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2f880a9720 con 0x7f2f880ad300 2021-11-12T05:49:34.925 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.920+0000 7f2f84ff9700 1 -- 172.21.2.105:0/1240106540 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v140) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2f880a9720 con 0x7f2f880ad300 2021-11-12T05:49:34.926 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:49:34.926 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.920+0000 7f2f8de89700 1 -- 172.21.2.105:0/1240106540 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2f680536f0 msgr2=0x7f2f68055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:34.927 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.920+0000 7f2f8de89700 1 --2- 172.21.2.105:0/1240106540 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2f680536f0 0x7f2f68055bb0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f2f7800a000 tx=0x7f2f78008040).stop 2021-11-12T05:49:34.927 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.920+0000 7f2f8de89700 1 -- 172.21.2.105:0/1240106540 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2f880ad300 msgr2=0x7f2f8812ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:34.927 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.920+0000 7f2f8de89700 1 --2- 172.21.2.105:0/1240106540 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2f880ad300 0x7f2f8812ead0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 rx=0x7f2f7c001370 tx=0x7f2f880aedf0).stop 2021-11-12T05:49:34.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.920+0000 7f2f8de89700 1 -- 172.21.2.105:0/1240106540 shutdown_connections 2021-11-12T05:49:34.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.920+0000 7f2f8de89700 1 --2- 172.21.2.105:0/1240106540 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2f680536f0 0x7f2f68055bb0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:34.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.920+0000 7f2f8de89700 1 --2- 172.21.2.105:0/1240106540 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2f8812efc0 0x7f2f880b5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:34.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.920+0000 7f2f8de89700 1 --2- 172.21.2.105:0/1240106540 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2f880ad300 0x7f2f8812ead0 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:34.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.920+0000 7f2f8de89700 1 --2- 172.21.2.105:0/1240106540 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2f740049f0 0x7f2f880a76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:34.929 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.920+0000 7f2f8de89700 1 -- 172.21.2.105:0/1240106540 >> 172.21.2.105:0/1240106540 conn(0x7f2f8805c490 msgr2=0x7f2f8805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:34.929 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.920+0000 7f2f8de89700 1 -- 172.21.2.105:0/1240106540 shutdown_connections 2021-11-12T05:49:34.929 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.920+0000 7f2f8de89700 1 -- 172.21.2.105:0/1240106540 wait complete. 2021-11-12T05:49:34.933 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-12T05:49:34.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef356b700 1 Processor -- start 2021-11-12T05:49:34.983 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef356b700 1 -- start start 2021-11-12T05:49:34.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef356b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7efeec0b01b0 0x7efeec0b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:34.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef356b700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeec0b5ea0 con 0x7efeec0aeb80 2021-11-12T05:49:34.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef356b700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeec0b1a60 con 0x7efeec0b5ac0 2021-11-12T05:49:34.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef356b700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeec0accd0 con 0x7efeec0b01b0 2021-11-12T05:49:34.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef1b08700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7efeec0aeb80 0x7efeec13e020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34260/0 (socket says 172.21.2.105:34260) 2021-11-12T05:49:34.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef1b08700 1 -- 172.21.2.105:0/1736208786 learned_addr learned my addr 172.21.2.105:0/1736208786 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:34.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef0b06700 1 --2- 172.21.2.105:0/1736208786 >> v2:172.21.2.105:3300/0 conn(0x7efeec0b01b0 0x7efeec0b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:34.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efedffff700 1 -- 172.21.2.105:0/1736208786 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 342984415 0 0) 0x7efeec0b5ea0 con 0x7efeec0aeb80 2021-11-12T05:49:34.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efedffff700 1 -- 172.21.2.105:0/1736208786 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efed4003260 con 0x7efeec0aeb80 2021-11-12T05:49:34.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef0b06700 1 -- 172.21.2.105:0/1736208786 >> v1:172.21.2.115:6789/0 conn(0x7efeec0b5ac0 legacy=0x7efeec0ae470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:34.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef0b06700 1 -- 172.21.2.105:0/1736208786 >> v1:172.21.2.105:6789/0 conn(0x7efeec0aeb80 legacy=0x7efeec13e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:34.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef0b06700 1 -- 172.21.2.105:0/1736208786 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeec0acf70 con 0x7efeec0b01b0 2021-11-12T05:49:34.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef0b06700 1 --2- 172.21.2.105:0/1736208786 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efeec0b01b0 0x7efeec0b13c0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 rx=0x7efeec0ad2f0 tx=0x7efee0006df0).ready entity=mon.0 client_cookie=72175e98f02b6080 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:34.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efedffff700 1 -- 172.21.2.105:0/1736208786 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efee000d5c0 con 0x7efeec0b01b0 2021-11-12T05:49:34.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efedffff700 1 -- 172.21.2.105:0/1736208786 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee0000e90 con 0x7efeec0b01b0 2021-11-12T05:49:34.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efedffff700 1 -- 172.21.2.105:0/1736208786 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efee000d910 con 0x7efeec0b01b0 2021-11-12T05:49:34.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef356b700 1 -- 172.21.2.105:0/1736208786 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efeec0b01b0 msgr2=0x7efeec0b13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:34.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef356b700 1 --2- 172.21.2.105:0/1736208786 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efeec0b01b0 0x7efeec0b13c0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 rx=0x7efeec0ad2f0 tx=0x7efee0006df0).stop 2021-11-12T05:49:34.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef356b700 1 -- 172.21.2.105:0/1736208786 shutdown_connections 2021-11-12T05:49:34.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef356b700 1 --2- 172.21.2.105:0/1736208786 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efeec0b01b0 0x7efeec0b13c0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:34.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef356b700 1 -- 172.21.2.105:0/1736208786 >> 172.21.2.105:0/1736208786 conn(0x7efeec0628b0 msgr2=0x7efeec062c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:34.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef356b700 1 -- 172.21.2.105:0/1736208786 shutdown_connections 2021-11-12T05:49:34.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef356b700 1 -- 172.21.2.105:0/1736208786 wait complete. 2021-11-12T05:49:34.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef356b700 1 Processor -- start 2021-11-12T05:49:34.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef356b700 1 -- start start 2021-11-12T05:49:34.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef356b700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efeec0aeb80 0x7efeec066950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:34.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef356b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efeec0b01b0 0x7efeec142f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:34.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef356b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efeec0b5ac0 0x7efeec144bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:34.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef356b700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeec15ad10 con 0x7efeec0b5ac0 2021-11-12T05:49:34.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef356b700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeec067230 con 0x7efeec0aeb80 2021-11-12T05:49:34.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef356b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeec15a980 con 0x7efeec0b01b0 2021-11-12T05:49:34.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef1b08700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efeec0b5ac0 0x7efeec144bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:34.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef1b08700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efeec0b5ac0 0x7efeec144bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52102/0 (socket says 172.21.2.105:52102) 2021-11-12T05:49:34.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef1b08700 1 -- 172.21.2.105:0/3505051636 learned_addr learned my addr 172.21.2.105:0/3505051636 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:34.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef1b08700 1 -- 172.21.2.105:0/3505051636 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efeec0b01b0 msgr2=0x7efeec142f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:34.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef1b08700 1 --2- 172.21.2.105:0/3505051636 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efeec0b01b0 0x7efeec142f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:34.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef1b08700 1 -- 172.21.2.105:0/3505051636 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efeec0aeb80 msgr2=0x7efeec066950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:34.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef1b08700 1 --2- 172.21.2.105:0/3505051636 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efeec0aeb80 0x7efeec066950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:34.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef1b08700 1 -- 172.21.2.105:0/3505051636 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee000b180 con 0x7efeec0b5ac0 2021-11-12T05:49:34.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef1b08700 1 --2- 172.21.2.105:0/3505051636 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efeec0b5ac0 0x7efeec144bf0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 rx=0x7efee4001490 tx=0x7efee4005e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:34.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efede7fc700 1 -- 172.21.2.105:0/3505051636 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efee400f710 con 0x7efeec0b5ac0 2021-11-12T05:49:34.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efede7fc700 1 -- 172.21.2.105:0/3505051636 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee400f870 con 0x7efeec0b5ac0 2021-11-12T05:49:34.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef356b700 1 -- 172.21.2.105:0/3505051636 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeec1436f0 con 0x7efeec0b5ac0 2021-11-12T05:49:34.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efede7fc700 1 -- 172.21.2.105:0/3505051636 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efee400fbd0 con 0x7efeec0b5ac0 2021-11-12T05:49:34.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.980+0000 7efef356b700 1 -- 172.21.2.105:0/3505051636 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeec1439d0 con 0x7efeec0b5ac0 2021-11-12T05:49:34.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.984+0000 7efef356b700 1 -- 172.21.2.105:0/3505051636 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeec1455c0 con 0x7efeec0b5ac0 2021-11-12T05:49:34.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.984+0000 7efede7fc700 1 -- 172.21.2.105:0/3505051636 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efee401f070 con 0x7efeec0b5ac0 2021-11-12T05:49:34.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.984+0000 7efede7fc700 1 --2- 172.21.2.105:0/3505051636 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efecc053610 0x7efecc055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:34.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.984+0000 7efede7fc700 1 -- 172.21.2.105:0/3505051636 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5596+0+0 (secure 0 0 0) 0x7efee406c450 con 0x7efeec0b5ac0 2021-11-12T05:49:34.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.984+0000 7efef1307700 1 --2- 172.21.2.105:0/3505051636 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efecc053610 0x7efecc055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:34.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.984+0000 7efef1307700 1 --2- 172.21.2.105:0/3505051636 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efecc053610 0x7efecc055ad0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7efee8002ef0 tx=0x7efee8006910).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:34.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:34.984+0000 7efede7fc700 1 -- 172.21.2.105:0/3505051636 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efee4043680 con 0x7efeec0b5ac0 2021-11-12T05:49:35.075 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.072+0000 7efef356b700 1 -- 172.21.2.105:0/3505051636 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7efeec0673f0 con 0x7efeec0b5ac0 2021-11-12T05:49:35.076 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.072+0000 7efede7fc700 1 -- 172.21.2.105:0/3505051636 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v140) v1 ==== 84+0+143 (secure 0 0 0) 0x7efee4013020 con 0x7efeec0b5ac0 2021-11-12T05:49:35.076 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:35.076 INFO:teuthology.orchestra.run.gibba005.stdout:[ 2021-11-12T05:49:35.077 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:35.077 INFO:teuthology.orchestra.run.gibba005.stdout: "poolnum": 1, 2021-11-12T05:49:35.077 INFO:teuthology.orchestra.run.gibba005.stdout: "poolname": "device_health_metrics" 2021-11-12T05:49:35.077 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:35.077 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:35.078 INFO:teuthology.orchestra.run.gibba005.stdout: "poolnum": 2, 2021-11-12T05:49:35.078 INFO:teuthology.orchestra.run.gibba005.stdout: "poolname": "rbd" 2021-11-12T05:49:35.078 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:35.078 INFO:teuthology.orchestra.run.gibba005.stdout:] 2021-11-12T05:49:35.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.072+0000 7efef356b700 1 -- 172.21.2.105:0/3505051636 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efecc053610 msgr2=0x7efecc055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:35.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.072+0000 7efef356b700 1 --2- 172.21.2.105:0/3505051636 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efecc053610 0x7efecc055ad0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7efee8002ef0 tx=0x7efee8006910).stop 2021-11-12T05:49:35.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.072+0000 7efef356b700 1 -- 172.21.2.105:0/3505051636 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efeec0b5ac0 msgr2=0x7efeec144bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:35.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.072+0000 7efef356b700 1 --2- 172.21.2.105:0/3505051636 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efeec0b5ac0 0x7efeec144bf0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 rx=0x7efee4001490 tx=0x7efee4005e30).stop 2021-11-12T05:49:35.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.072+0000 7efef356b700 1 -- 172.21.2.105:0/3505051636 shutdown_connections 2021-11-12T05:49:35.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.072+0000 7efef356b700 1 --2- 172.21.2.105:0/3505051636 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efecc053610 0x7efecc055ad0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:35.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.072+0000 7efef356b700 1 --2- 172.21.2.105:0/3505051636 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efeec0b5ac0 0x7efeec144bf0 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:35.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.072+0000 7efef356b700 1 --2- 172.21.2.105:0/3505051636 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efeec0b01b0 0x7efeec142f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:35.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.072+0000 7efef356b700 1 --2- 172.21.2.105:0/3505051636 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efeec0aeb80 0x7efeec066950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:35.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.072+0000 7efef356b700 1 -- 172.21.2.105:0/3505051636 >> 172.21.2.105:0/3505051636 conn(0x7efeec0628b0 msgr2=0x7efeec0b21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:35.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.072+0000 7efef356b700 1 -- 172.21.2.105:0/3505051636 shutdown_connections 2021-11-12T05:49:35.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.072+0000 7efef356b700 1 -- 172.21.2.105:0/3505051636 wait complete. 2021-11-12T05:49:35.083 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-12T05:49:35.084 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-12T05:49:35.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.132+0000 7fce5bb28700 1 Processor -- start 2021-11-12T05:49:35.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.132+0000 7fce5bb28700 1 -- start start 2021-11-12T05:49:35.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.132+0000 7fce5bb28700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fce540626b0 0x7fce54062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:35.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.132+0000 7fce5bb28700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fce54130a80 0x7fce541474d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:35.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.132+0000 7fce5bb28700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce540b0d50 con 0x7fce540af750 2021-11-12T05:49:35.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.132+0000 7fce5bb28700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce540ad380 con 0x7fce540626b0 2021-11-12T05:49:35.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.132+0000 7fce5bb28700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce540ae190 con 0x7fce54130a80 2021-11-12T05:49:35.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.132+0000 7fce590c3700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fce540af750 0x7fce54130370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34274/0 (socket says 172.21.2.105:34274) 2021-11-12T05:49:35.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.132+0000 7fce590c3700 1 -- 172.21.2.105:0/273816199 learned_addr learned my addr 172.21.2.105:0/273816199 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:35.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.132+0000 7fce598c4700 1 --2- 172.21.2.105:0/273816199 >> v2:172.21.2.105:3300/0 conn(0x7fce540626b0 0x7fce54062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:35.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.132+0000 7fce598c4700 1 -- 172.21.2.105:0/273816199 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fce54130a80 msgr2=0x7fce541474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:35.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.132+0000 7fce598c4700 1 --2- 172.21.2.105:0/273816199 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fce54130a80 0x7fce541474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:35.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.132+0000 7fce598c4700 1 -- 172.21.2.105:0/273816199 >> v1:172.21.2.105:6789/0 conn(0x7fce540af750 legacy=0x7fce54130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:35.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.132+0000 7fce598c4700 1 -- 172.21.2.105:0/273816199 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce541479c0 con 0x7fce540626b0 2021-11-12T05:49:35.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.132+0000 7fce598c4700 1 --2- 172.21.2.105:0/273816199 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fce540626b0 0x7fce54062a90 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 rx=0x7fce48002f70 tx=0x7fce48006df0).ready entity=mon.0 client_cookie=3d5b71a3879645ff server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:35.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.132+0000 7fce588c2700 1 -- 172.21.2.105:0/273816199 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce4800d570 con 0x7fce540626b0 2021-11-12T05:49:35.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.132+0000 7fce588c2700 1 -- 172.21.2.105:0/273816199 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce48000e90 con 0x7fce540626b0 2021-11-12T05:49:35.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.132+0000 7fce588c2700 1 -- 172.21.2.105:0/273816199 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce4800d900 con 0x7fce540626b0 2021-11-12T05:49:35.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.132+0000 7fce5bb28700 1 -- 172.21.2.105:0/273816199 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fce540626b0 msgr2=0x7fce54062a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:35.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.132+0000 7fce5bb28700 1 --2- 172.21.2.105:0/273816199 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fce540626b0 0x7fce54062a90 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 rx=0x7fce48002f70 tx=0x7fce48006df0).stop 2021-11-12T05:49:35.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.132+0000 7fce5bb28700 1 -- 172.21.2.105:0/273816199 shutdown_connections 2021-11-12T05:49:35.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.132+0000 7fce5bb28700 1 --2- 172.21.2.105:0/273816199 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fce54130a80 0x7fce541474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:35.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.132+0000 7fce5bb28700 1 --2- 172.21.2.105:0/273816199 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fce540626b0 0x7fce54062a90 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:35.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.132+0000 7fce5bb28700 1 -- 172.21.2.105:0/273816199 >> 172.21.2.105:0/273816199 conn(0x7fce540b5320 msgr2=0x7fce540b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:35.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.136+0000 7fce5bb28700 1 -- 172.21.2.105:0/273816199 shutdown_connections 2021-11-12T05:49:35.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.136+0000 7fce5bb28700 1 -- 172.21.2.105:0/273816199 wait complete. 2021-11-12T05:49:35.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.136+0000 7fce5bb28700 1 Processor -- start 2021-11-12T05:49:35.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.136+0000 7fce5bb28700 1 -- start start 2021-11-12T05:49:35.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.136+0000 7fce5bb28700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fce540626b0 0x7fce5412ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:35.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.136+0000 7fce5bb28700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fce540af750 0x7fce54146c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:35.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.136+0000 7fce5bb28700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fce54130a80 0x7fce5412baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:35.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.136+0000 7fce5bb28700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce54149020 con 0x7fce54130a80 2021-11-12T05:49:35.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.136+0000 7fce5bb28700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce541492c0 con 0x7fce540af750 2021-11-12T05:49:35.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.136+0000 7fce5bb28700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce54149560 con 0x7fce540626b0 2021-11-12T05:49:35.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.136+0000 7fce5a0c5700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fce54130a80 0x7fce5412baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:35.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.136+0000 7fce5a0c5700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fce54130a80 0x7fce5412baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52116/0 (socket says 172.21.2.105:52116) 2021-11-12T05:49:35.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.136+0000 7fce5a0c5700 1 -- 172.21.2.105:0/1576215215 learned_addr learned my addr 172.21.2.105:0/1576215215 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:35.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.136+0000 7fce5a0c5700 1 -- 172.21.2.105:0/1576215215 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fce540626b0 msgr2=0x7fce5412ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:35.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.136+0000 7fce5a0c5700 1 --2- 172.21.2.105:0/1576215215 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fce540626b0 0x7fce5412ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:35.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.136+0000 7fce5a0c5700 1 -- 172.21.2.105:0/1576215215 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fce540af750 msgr2=0x7fce54146c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:35.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.136+0000 7fce5a0c5700 1 --2- 172.21.2.105:0/1576215215 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fce540af750 0x7fce54146c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:35.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.136+0000 7fce5a0c5700 1 -- 172.21.2.105:0/1576215215 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4800b180 con 0x7fce54130a80 2021-11-12T05:49:35.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.136+0000 7fce5a0c5700 1 --2- 172.21.2.105:0/1576215215 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fce54130a80 0x7fce5412baf0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 rx=0x7fce4c0032f0 tx=0x7fce4c009120).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:35.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.136+0000 7fce46ffd700 1 -- 172.21.2.105:0/1576215215 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce4c00d4a0 con 0x7fce54130a80 2021-11-12T05:49:35.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.136+0000 7fce46ffd700 1 -- 172.21.2.105:0/1576215215 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4c00d600 con 0x7fce54130a80 2021-11-12T05:49:35.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.136+0000 7fce5bb28700 1 -- 172.21.2.105:0/1576215215 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce54148d10 con 0x7fce54130a80 2021-11-12T05:49:35.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.136+0000 7fce46ffd700 1 -- 172.21.2.105:0/1576215215 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce4c00d960 con 0x7fce54130a80 2021-11-12T05:49:35.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.136+0000 7fce5bb28700 1 -- 172.21.2.105:0/1576215215 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce54147320 con 0x7fce54130a80 2021-11-12T05:49:35.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.136+0000 7fce5bb28700 1 -- 172.21.2.105:0/1576215215 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce54057350 con 0x7fce54130a80 2021-11-12T05:49:35.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.136+0000 7fce46ffd700 1 -- 172.21.2.105:0/1576215215 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fce4c018030 con 0x7fce54130a80 2021-11-12T05:49:35.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.136+0000 7fce46ffd700 1 --2- 172.21.2.105:0/1576215215 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fce34053690 0x7fce34055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:35.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.136+0000 7fce46ffd700 1 -- 172.21.2.105:0/1576215215 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fce4c06b170 con 0x7fce54130a80 2021-11-12T05:49:35.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.136+0000 7fce598c4700 1 --2- 172.21.2.105:0/1576215215 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fce34053690 0x7fce34055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:35.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.136+0000 7fce598c4700 1 --2- 172.21.2.105:0/1576215215 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fce34053690 0x7fce34055b50 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7fce48002f70 tx=0x7fce48015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:35.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.140+0000 7fce46ffd700 1 -- 172.21.2.105:0/1576215215 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fce4c042450 con 0x7fce54130a80 2021-11-12T05:49:35.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:35.224+0000 7fce5bb28700 1 -- 172.21.2.105:0/1576215215 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fce5405d9a0 con 0x7fce54130a80 2021-11-12T05:49:36.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.220+0000 7fce46ffd700 1 -- 172.21.2.105:0/1576215215 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v141) v1 ==== 133+0+0 (secure 0 0 0) 0x7fce4c045a70 con 0x7fce54130a80 2021-11-12T05:49:36.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.220+0000 7fce5bb28700 1 -- 172.21.2.105:0/1576215215 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fce34053690 msgr2=0x7fce34055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:36.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.220+0000 7fce5bb28700 1 --2- 172.21.2.105:0/1576215215 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fce34053690 0x7fce34055b50 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7fce48002f70 tx=0x7fce48015000).stop 2021-11-12T05:49:36.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.220+0000 7fce5bb28700 1 -- 172.21.2.105:0/1576215215 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fce54130a80 msgr2=0x7fce5412baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:36.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.220+0000 7fce5bb28700 1 --2- 172.21.2.105:0/1576215215 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fce54130a80 0x7fce5412baf0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 rx=0x7fce4c0032f0 tx=0x7fce4c009120).stop 2021-11-12T05:49:36.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.220+0000 7fce5bb28700 1 -- 172.21.2.105:0/1576215215 shutdown_connections 2021-11-12T05:49:36.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.220+0000 7fce5bb28700 1 --2- 172.21.2.105:0/1576215215 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fce34053690 0x7fce34055b50 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:36.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.220+0000 7fce5bb28700 1 --2- 172.21.2.105:0/1576215215 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fce54130a80 0x7fce5412baf0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:36.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.220+0000 7fce5bb28700 1 --2- 172.21.2.105:0/1576215215 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fce540af750 0x7fce54146c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:36.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.220+0000 7fce5bb28700 1 --2- 172.21.2.105:0/1576215215 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fce540626b0 0x7fce5412ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:36.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.220+0000 7fce5bb28700 1 -- 172.21.2.105:0/1576215215 >> 172.21.2.105:0/1576215215 conn(0x7fce540b5320 msgr2=0x7fce540b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:36.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.220+0000 7fce5bb28700 1 -- 172.21.2.105:0/1576215215 shutdown_connections 2021-11-12T05:49:36.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.220+0000 7fce5bb28700 1 -- 172.21.2.105:0/1576215215 wait complete. 2021-11-12T05:49:36.229 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_metadata' created 2021-11-12T05:49:36.233 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-11-12T05:49:36.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.280+0000 7f9fa759e700 1 Processor -- start 2021-11-12T05:49:36.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.280+0000 7f9fa759e700 1 -- start start 2021-11-12T05:49:36.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.280+0000 7f9fa759e700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f9fa80b26f0 0x7f9fa814b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:36.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.280+0000 7f9fa759e700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f9fa8147b10 0x7f9fa8144210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:36.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.280+0000 7f9fa759e700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fa814b7b0 con 0x7f9fa8060be0 2021-11-12T05:49:36.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.280+0000 7f9fa759e700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa80ac440 con 0x7f9fa80b26f0 2021-11-12T05:49:36.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.280+0000 7f9fa759e700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa80acdd0 con 0x7f9fa8147b10 2021-11-12T05:49:36.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.280+0000 7f9fa659c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f9fa80b26f0 0x7f9fa814b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:36.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.280+0000 7f9f9dd9b700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f9fa8060be0 0x7f9fa80ac6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34284/0 (socket says 172.21.2.105:34284) 2021-11-12T05:49:36.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.280+0000 7f9f9dd9b700 1 -- 172.21.2.105:0/2166981476 learned_addr learned my addr 172.21.2.105:0/2166981476 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:36.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.280+0000 7f9fa659c700 1 -- 172.21.2.105:0/2166981476 >> v2:172.21.2.115:3300/0 conn(0x7f9fa8147b10 msgr2=0x7f9fa8144210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:36.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.280+0000 7f9fa659c700 1 --2- 172.21.2.105:0/2166981476 >> v2:172.21.2.115:3300/0 conn(0x7f9fa8147b10 0x7f9fa8144210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:36.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.280+0000 7f9fa659c700 1 -- 172.21.2.105:0/2166981476 >> v1:172.21.2.105:6789/0 conn(0x7f9fa8060be0 legacy=0x7f9fa80ac6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:36.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.280+0000 7f9fa659c700 1 -- 172.21.2.105:0/2166981476 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa80b2ad0 con 0x7f9fa80b26f0 2021-11-12T05:49:36.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.280+0000 7f9fa659c700 1 --2- 172.21.2.105:0/2166981476 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9fa80b26f0 0x7f9fa814b1f0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 rx=0x7f9f98002f70 tx=0x7f9f98006df0).ready entity=mon.0 client_cookie=b6706fac45a855b1 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:36.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.280+0000 7f9fa5d9b700 1 -- 172.21.2.105:0/2166981476 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f9800d5c0 con 0x7f9fa80b26f0 2021-11-12T05:49:36.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.280+0000 7f9fa5d9b700 1 -- 172.21.2.105:0/2166981476 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f98000e90 con 0x7f9fa80b26f0 2021-11-12T05:49:36.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.280+0000 7f9fa5d9b700 1 -- 172.21.2.105:0/2166981476 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f9800d910 con 0x7f9fa80b26f0 2021-11-12T05:49:36.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.280+0000 7f9fa759e700 1 -- 172.21.2.105:0/2166981476 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9fa80b26f0 msgr2=0x7f9fa814b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:36.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.280+0000 7f9fa759e700 1 --2- 172.21.2.105:0/2166981476 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9fa80b26f0 0x7f9fa814b1f0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 rx=0x7f9f98002f70 tx=0x7f9f98006df0).stop 2021-11-12T05:49:36.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.284+0000 7f9fa759e700 1 -- 172.21.2.105:0/2166981476 shutdown_connections 2021-11-12T05:49:36.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.284+0000 7f9fa759e700 1 --2- 172.21.2.105:0/2166981476 >> v2:172.21.2.115:3300/0 conn(0x7f9fa8147b10 0x7f9fa8144210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:36.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.284+0000 7f9fa759e700 1 --2- 172.21.2.105:0/2166981476 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9fa80b26f0 0x7f9fa814b1f0 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:36.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.284+0000 7f9fa759e700 1 -- 172.21.2.105:0/2166981476 >> 172.21.2.105:0/2166981476 conn(0x7f9fa80b5c50 msgr2=0x7f9fa80b1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:36.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.284+0000 7f9fa759e700 1 -- 172.21.2.105:0/2166981476 shutdown_connections 2021-11-12T05:49:36.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.284+0000 7f9fa759e700 1 -- 172.21.2.105:0/2166981476 wait complete. 2021-11-12T05:49:36.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.284+0000 7f9fa759e700 1 Processor -- start 2021-11-12T05:49:36.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.284+0000 7f9fa759e700 1 -- start start 2021-11-12T05:49:36.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.284+0000 7f9fa759e700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9fa8060be0 0x7f9fa815a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:36.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.284+0000 7f9fa759e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9fa80b26f0 0x7f9fa8062cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:36.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.284+0000 7f9fa759e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9fa8147b10 0x7f9fa8063d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:36.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.284+0000 7f9fa759e700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa80664b0 con 0x7f9fa8147b10 2021-11-12T05:49:36.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.284+0000 7f9fa759e700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa8066750 con 0x7f9fa8060be0 2021-11-12T05:49:36.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.284+0000 7f9fa759e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa80669f0 con 0x7f9fa80b26f0 2021-11-12T05:49:36.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.284+0000 7f9fa6d9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9fa8147b10 0x7f9fa8063d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:36.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.284+0000 7f9fa6d9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9fa8147b10 0x7f9fa8063d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52126/0 (socket says 172.21.2.105:52126) 2021-11-12T05:49:36.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.284+0000 7f9fa6d9d700 1 -- 172.21.2.105:0/111647939 learned_addr learned my addr 172.21.2.105:0/111647939 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:36.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.284+0000 7f9fa6d9d700 1 -- 172.21.2.105:0/111647939 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9fa80b26f0 msgr2=0x7f9fa8062cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:36.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.284+0000 7f9fa6d9d700 1 --2- 172.21.2.105:0/111647939 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9fa80b26f0 0x7f9fa8062cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:36.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.284+0000 7f9fa6d9d700 1 -- 172.21.2.105:0/111647939 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9fa8060be0 msgr2=0x7f9fa815a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:36.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.284+0000 7f9fa6d9d700 1 --2- 172.21.2.105:0/111647939 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9fa8060be0 0x7f9fa815a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:36.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.284+0000 7f9fa6d9d700 1 -- 172.21.2.105:0/111647939 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9800b180 con 0x7f9fa8147b10 2021-11-12T05:49:36.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.284+0000 7f9fa6d9d700 1 --2- 172.21.2.105:0/111647939 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9fa8147b10 0x7f9fa8063d60 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 rx=0x7f9fa00032f0 tx=0x7f9fa0009220).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:36.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.284+0000 7f9f9ffff700 1 -- 172.21.2.105:0/111647939 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fa000d580 con 0x7f9fa8147b10 2021-11-12T05:49:36.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.284+0000 7f9f9ffff700 1 -- 172.21.2.105:0/111647939 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa000d6e0 con 0x7f9fa8147b10 2021-11-12T05:49:36.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.284+0000 7f9fa759e700 1 -- 172.21.2.105:0/111647939 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa815a7c0 con 0x7f9fa8147b10 2021-11-12T05:49:36.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.284+0000 7f9f9ffff700 1 -- 172.21.2.105:0/111647939 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fa000da40 con 0x7f9fa8147b10 2021-11-12T05:49:36.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.284+0000 7f9fa759e700 1 -- 172.21.2.105:0/111647939 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa80633d0 con 0x7f9fa8147b10 2021-11-12T05:49:36.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.284+0000 7f9fa759e700 1 -- 172.21.2.105:0/111647939 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fa8066bb0 con 0x7f9fa8147b10 2021-11-12T05:49:36.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.284+0000 7f9f9ffff700 1 -- 172.21.2.105:0/111647939 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9fa000dba0 con 0x7f9fa8147b10 2021-11-12T05:49:36.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.288+0000 7f9f9ffff700 1 --2- 172.21.2.105:0/111647939 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9f8c053570 0x7f9f8c055a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:36.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.288+0000 7f9f9ffff700 1 -- 172.21.2.105:0/111647939 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5950+0+0 (secure 0 0 0) 0x7f9fa006bd00 con 0x7f9fa8147b10 2021-11-12T05:49:36.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.288+0000 7f9fa659c700 1 --2- 172.21.2.105:0/111647939 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9f8c053570 0x7f9f8c055a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:36.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.288+0000 7f9fa659c700 1 --2- 172.21.2.105:0/111647939 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9f8c053570 0x7f9f8c055a30 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f9f98002f70 tx=0x7f9f98014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:36.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.288+0000 7f9f9ffff700 1 -- 172.21.2.105:0/111647939 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9fa0042dd0 con 0x7f9fa8147b10 2021-11-12T05:49:36.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:36.372+0000 7f9fa759e700 1 -- 172.21.2.105:0/111647939 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f9fa8057350 con 0x7f9fa8147b10 2021-11-12T05:49:37.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.232+0000 7f9f9ffff700 1 -- 172.21.2.105:0/111647939 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v142) v1 ==== 125+0+0 (secure 0 0 0) 0x7f9fa00463f0 con 0x7f9fa8147b10 2021-11-12T05:49:37.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.232+0000 7f9fa759e700 1 -- 172.21.2.105:0/111647939 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9f8c053570 msgr2=0x7f9f8c055a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:37.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.232+0000 7f9fa759e700 1 --2- 172.21.2.105:0/111647939 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9f8c053570 0x7f9f8c055a30 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f9f98002f70 tx=0x7f9f98014000).stop 2021-11-12T05:49:37.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.232+0000 7f9fa759e700 1 -- 172.21.2.105:0/111647939 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9fa8147b10 msgr2=0x7f9fa8063d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:37.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.232+0000 7f9fa759e700 1 --2- 172.21.2.105:0/111647939 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9fa8147b10 0x7f9fa8063d60 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 rx=0x7f9fa00032f0 tx=0x7f9fa0009220).stop 2021-11-12T05:49:37.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.232+0000 7f9fa759e700 1 -- 172.21.2.105:0/111647939 shutdown_connections 2021-11-12T05:49:37.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.232+0000 7f9fa759e700 1 --2- 172.21.2.105:0/111647939 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9f8c053570 0x7f9f8c055a30 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:37.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.232+0000 7f9fa759e700 1 --2- 172.21.2.105:0/111647939 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9fa8147b10 0x7f9fa8063d60 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:37.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.232+0000 7f9fa759e700 1 --2- 172.21.2.105:0/111647939 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9fa80b26f0 0x7f9fa8062cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:37.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.232+0000 7f9fa759e700 1 --2- 172.21.2.105:0/111647939 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9fa8060be0 0x7f9fa815a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:37.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.232+0000 7f9fa759e700 1 -- 172.21.2.105:0/111647939 >> 172.21.2.105:0/111647939 conn(0x7f9fa80b5c50 msgr2=0x7f9fa80b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:37.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.232+0000 7f9fa759e700 1 -- 172.21.2.105:0/111647939 shutdown_connections 2021-11-12T05:49:37.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.232+0000 7f9fa759e700 1 -- 172.21.2.105:0/111647939 wait complete. 2021-11-12T05:49:37.242 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_data' created 2021-11-12T05:49:37.245 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-12T05:49:37.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.296+0000 7f218b0cd700 1 Processor -- start 2021-11-12T05:49:37.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.296+0000 7f218b0cd700 1 -- start start 2021-11-12T05:49:37.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.296+0000 7f218b0cd700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f21840ad080 0x7f21840af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:37.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.296+0000 7f218b0cd700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f21840ac280 0x7f21840ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:37.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.296+0000 7f218b0cd700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21840ac7b0 con 0x7f218414abe0 2021-11-12T05:49:37.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.296+0000 7f218b0cd700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21841488a0 con 0x7f21840ac280 2021-11-12T05:49:37.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.296+0000 7f218b0cd700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21840ac9e0 con 0x7f21840ad080 2021-11-12T05:49:37.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.300+0000 7f2188e69700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f21840ad080 0x7f21840af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:37.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.300+0000 7f2188e69700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f21840ad080 0x7f21840af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3301/0 says I am v2:172.21.2.105:43322/0 (socket says 172.21.2.105:43322) 2021-11-12T05:49:37.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.300+0000 7f2188e69700 1 -- 172.21.2.105:0/1800422951 learned_addr learned my addr 172.21.2.105:0/1800422951 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:37.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.300+0000 7f2183fff700 1 --2- 172.21.2.105:0/1800422951 >> v2:172.21.2.115:3300/0 conn(0x7f21840ac280 0x7f21840ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:37.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.300+0000 7f2188e69700 1 -- 172.21.2.105:0/1800422951 >> v2:172.21.2.115:3300/0 conn(0x7f21840ac280 msgr2=0x7f21840ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:37.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.300+0000 7f2188e69700 1 --2- 172.21.2.105:0/1800422951 >> v2:172.21.2.115:3300/0 conn(0x7f21840ac280 0x7f21840ad460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:37.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.300+0000 7f2188e69700 1 -- 172.21.2.105:0/1800422951 >> v1:172.21.2.115:6789/0 conn(0x7f218414abe0 legacy=0x7f218414b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:37.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.300+0000 7f2188e69700 1 -- 172.21.2.105:0/1800422951 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21840b0b30 con 0x7f21840ad080 2021-11-12T05:49:37.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.300+0000 7f2188e69700 1 --2- 172.21.2.105:0/1800422951 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f21840ad080 0x7f21840af730 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f216c002f70 tx=0x7f216c006eb0).ready entity=mon.2 client_cookie=7ecbf1fc83c9f2cb server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:37.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.300+0000 7f21837fe700 1 -- 172.21.2.105:0/1800422951 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f216c00d570 con 0x7f21840ad080 2021-11-12T05:49:37.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.300+0000 7f21837fe700 1 -- 172.21.2.105:0/1800422951 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216c000e90 con 0x7f21840ad080 2021-11-12T05:49:37.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.300+0000 7f21837fe700 1 -- 172.21.2.105:0/1800422951 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f216c00d900 con 0x7f21840ad080 2021-11-12T05:49:37.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.300+0000 7f218b0cd700 1 -- 172.21.2.105:0/1800422951 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f21840ad080 msgr2=0x7f21840af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:37.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.300+0000 7f218b0cd700 1 --2- 172.21.2.105:0/1800422951 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f21840ad080 0x7f21840af730 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f216c002f70 tx=0x7f216c006eb0).stop 2021-11-12T05:49:37.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.300+0000 7f218b0cd700 1 -- 172.21.2.105:0/1800422951 shutdown_connections 2021-11-12T05:49:37.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.300+0000 7f218b0cd700 1 --2- 172.21.2.105:0/1800422951 >> v2:172.21.2.115:3300/0 conn(0x7f21840ac280 0x7f21840ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:37.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.300+0000 7f218b0cd700 1 --2- 172.21.2.105:0/1800422951 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f21840ad080 0x7f21840af730 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:37.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.300+0000 7f218b0cd700 1 -- 172.21.2.105:0/1800422951 >> 172.21.2.105:0/1800422951 conn(0x7f21840b5370 msgr2=0x7f21840b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:37.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.300+0000 7f218b0cd700 1 -- 172.21.2.105:0/1800422951 shutdown_connections 2021-11-12T05:49:37.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.300+0000 7f218b0cd700 1 -- 172.21.2.105:0/1800422951 wait complete. 2021-11-12T05:49:37.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.300+0000 7f218b0cd700 1 Processor -- start 2021-11-12T05:49:37.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.300+0000 7f218b0cd700 1 -- start start 2021-11-12T05:49:37.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.300+0000 7f218b0cd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f21840ac280 0x7f21840a95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:37.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.300+0000 7f218b0cd700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f21840ad080 0x7f2184156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:37.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.300+0000 7f218b0cd700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f218414abe0 0x7f21840632e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:37.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.300+0000 7f218b0cd700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2184143450 con 0x7f21840ac280 2021-11-12T05:49:37.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.300+0000 7f218b0cd700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21840a8950 con 0x7f218414abe0 2021-11-12T05:49:37.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.300+0000 7f218b0cd700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2184157220 con 0x7f21840ad080 2021-11-12T05:49:37.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.300+0000 7f2188e69700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f21840ac280 0x7f21840a95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:37.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.300+0000 7f2188e69700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f21840ac280 0x7f21840a95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52138/0 (socket says 172.21.2.105:52138) 2021-11-12T05:49:37.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.300+0000 7f2188e69700 1 -- 172.21.2.105:0/1430286342 learned_addr learned my addr 172.21.2.105:0/1430286342 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:37.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.304+0000 7f2188e69700 1 -- 172.21.2.105:0/1430286342 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f21840ad080 msgr2=0x7f2184156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:37.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.304+0000 7f2188e69700 1 --2- 172.21.2.105:0/1430286342 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f21840ad080 0x7f2184156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:37.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.304+0000 7f2188e69700 1 -- 172.21.2.105:0/1430286342 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f218414abe0 msgr2=0x7f21840632e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:37.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.304+0000 7f2188e69700 1 --2- 172.21.2.105:0/1430286342 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f218414abe0 0x7f21840632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:37.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.304+0000 7f2188e69700 1 -- 172.21.2.105:0/1430286342 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216c00b1e0 con 0x7f21840ac280 2021-11-12T05:49:37.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.304+0000 7f2188e69700 1 --2- 172.21.2.105:0/1430286342 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f21840ac280 0x7f21840a95f0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 rx=0x7f21840a8b50 tx=0x7f216c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:37.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.304+0000 7f2181ffb700 1 -- 172.21.2.105:0/1430286342 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f216c011760 con 0x7f21840ac280 2021-11-12T05:49:37.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.304+0000 7f2181ffb700 1 -- 172.21.2.105:0/1430286342 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216c0118c0 con 0x7f21840ac280 2021-11-12T05:49:37.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.304+0000 7f2181ffb700 1 -- 172.21.2.105:0/1430286342 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f216c011c20 con 0x7f21840ac280 2021-11-12T05:49:37.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.304+0000 7f218b0cd700 1 -- 172.21.2.105:0/1430286342 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2184157440 con 0x7f21840ac280 2021-11-12T05:49:37.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.304+0000 7f218b0cd700 1 -- 172.21.2.105:0/1430286342 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2184157980 con 0x7f21840ac280 2021-11-12T05:49:37.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.304+0000 7f218b0cd700 1 -- 172.21.2.105:0/1430286342 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21840b1440 con 0x7f21840ac280 2021-11-12T05:49:37.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.304+0000 7f2181ffb700 1 -- 172.21.2.105:0/1430286342 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f216c025030 con 0x7f21840ac280 2021-11-12T05:49:37.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.304+0000 7f2181ffb700 1 --2- 172.21.2.105:0/1430286342 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f21680536d0 0x7f2168055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:37.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.304+0000 7f2181ffb700 1 -- 172.21.2.105:0/1430286342 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6300+0+0 (secure 0 0 0) 0x7f216c06cc30 con 0x7f21840ac280 2021-11-12T05:49:37.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.304+0000 7f2183fff700 1 --2- 172.21.2.105:0/1430286342 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f21680536d0 0x7f2168055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:37.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.304+0000 7f2183fff700 1 --2- 172.21.2.105:0/1430286342 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f21680536d0 0x7f2168055b90 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f217400c000 tx=0x7f2174006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:37.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.308+0000 7f2181ffb700 1 -- 172.21.2.105:0/1430286342 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f216c043c10 con 0x7f21840ac280 2021-11-12T05:49:37.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.416+0000 7f218b0cd700 1 -- 172.21.2.105:0/1430286342 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f2184057350 con 0x7f21840ac280 2021-11-12T05:49:37.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.424+0000 7f2181ffb700 1 -- 172.21.2.105:0/1430286342 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 27 and data pool 28 v68) v1 ==== 189+0+0 (secure 0 0 0) 0x7f216c023020 con 0x7f21840ac280 2021-11-12T05:49:37.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.424+0000 7f218b0cd700 1 -- 172.21.2.105:0/1430286342 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f21680536d0 msgr2=0x7f2168055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:37.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.424+0000 7f218b0cd700 1 --2- 172.21.2.105:0/1430286342 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f21680536d0 0x7f2168055b90 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f217400c000 tx=0x7f2174006df0).stop 2021-11-12T05:49:37.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.424+0000 7f218b0cd700 1 -- 172.21.2.105:0/1430286342 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f21840ac280 msgr2=0x7f21840a95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:37.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.424+0000 7f218b0cd700 1 --2- 172.21.2.105:0/1430286342 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f21840ac280 0x7f21840a95f0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 rx=0x7f21840a8b50 tx=0x7f216c015000).stop 2021-11-12T05:49:37.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.424+0000 7f218b0cd700 1 -- 172.21.2.105:0/1430286342 shutdown_connections 2021-11-12T05:49:37.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.424+0000 7f218b0cd700 1 --2- 172.21.2.105:0/1430286342 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f21680536d0 0x7f2168055b90 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:37.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.424+0000 7f218b0cd700 1 --2- 172.21.2.105:0/1430286342 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f218414abe0 0x7f21840632e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:37.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.424+0000 7f218b0cd700 1 --2- 172.21.2.105:0/1430286342 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f21840ad080 0x7f2184156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:37.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.424+0000 7f218b0cd700 1 --2- 172.21.2.105:0/1430286342 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f21840ac280 0x7f21840a95f0 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:37.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.424+0000 7f218b0cd700 1 -- 172.21.2.105:0/1430286342 >> 172.21.2.105:0/1430286342 conn(0x7f21840b5370 msgr2=0x7f2184143e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:37.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.424+0000 7f218b0cd700 1 -- 172.21.2.105:0/1430286342 shutdown_connections 2021-11-12T05:49:37.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.424+0000 7f218b0cd700 1 -- 172.21.2.105:0/1430286342 wait complete. 2021-11-12T05:49:37.432 INFO:teuthology.orchestra.run.gibba005.stderr:new fs with metadata pool 27 and data pool 28 2021-11-12T05:49:37.437 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:49:37.487 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcffb01700 1 Processor -- start 2021-11-12T05:49:37.488 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcffb01700 1 -- start start 2021-11-12T05:49:37.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcffb01700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7efcf80ad080 0x7efcf80af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:37.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcffb01700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf80ac7b0 con 0x7efcf80ac280 2021-11-12T05:49:37.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcffb01700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf80ac9e0 con 0x7efcf814b2f0 2021-11-12T05:49:37.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcffb01700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf81488a0 con 0x7efcf80ad080 2021-11-12T05:49:37.489 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcfd09c700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7efcf80ac280 0x7efcf814abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34324/0 (socket says 172.21.2.105:34324) 2021-11-12T05:49:37.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcfd09c700 1 -- 172.21.2.105:0/1860067138 learned_addr learned my addr 172.21.2.105:0/1860067138 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:37.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcfc89b700 1 -- 172.21.2.105:0/1860067138 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 159201313 0 0) 0x7efcf80ac7b0 con 0x7efcf80ac280 2021-11-12T05:49:37.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcfc89b700 1 -- 172.21.2.105:0/1860067138 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efce0003260 con 0x7efcf80ac280 2021-11-12T05:49:37.490 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcfd89d700 1 --2- 172.21.2.105:0/1860067138 >> v2:172.21.2.115:3300/0 conn(0x7efcf80ad080 0x7efcf80af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:37.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcfc89b700 1 -- 172.21.2.105:0/1860067138 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2885038952 0 0) 0x7efce0003260 con 0x7efcf80ac280 2021-11-12T05:49:37.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcfc89b700 1 -- 172.21.2.105:0/1860067138 >> v2:172.21.2.115:3300/0 conn(0x7efcf80ad080 msgr2=0x7efcf80af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:37.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcfc89b700 1 --2- 172.21.2.105:0/1860067138 >> v2:172.21.2.115:3300/0 conn(0x7efcf80ad080 0x7efcf80af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:37.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcfc89b700 1 -- 172.21.2.105:0/1860067138 >> v1:172.21.2.115:6789/0 conn(0x7efcf814b2f0 legacy=0x7efcf8147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:37.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcfc89b700 1 -- 172.21.2.105:0/1860067138 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf80b0b30 con 0x7efcf80ac280 2021-11-12T05:49:37.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcfc89b700 1 -- 172.21.2.105:0/1860067138 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7efcec001660 con 0x7efcf80ac280 2021-11-12T05:49:37.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcfc89b700 1 -- 172.21.2.105:0/1860067138 >> v1:172.21.2.105:6789/0 conn(0x7efcf80ac280 legacy=0x7efcf814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:37.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcfc89b700 1 --2- 172.21.2.105:0/1860067138 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efce0003750 0x7efce0003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:37.498 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcfc89b700 1 --2- 172.21.2.105:0/1860067138 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efce0004500 0x7efce0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:37.498 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcfc89b700 1 --2- 172.21.2.105:0/1860067138 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efce0004e70 0x7efce000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:37.498 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcfc89b700 1 -- 172.21.2.105:0/1860067138 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf81488a0 con 0x7efce0004500 2021-11-12T05:49:37.498 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcfc89b700 1 -- 172.21.2.105:0/1860067138 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce000bd20 con 0x7efce0003750 2021-11-12T05:49:37.499 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcfc89b700 1 -- 172.21.2.105:0/1860067138 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce000bee0 con 0x7efce0004e70 2021-11-12T05:49:37.499 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcfd09c700 1 --2- 172.21.2.105:0/1860067138 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efce0004500 0x7efce0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:37.499 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcfd89d700 1 --2- 172.21.2.105:0/1860067138 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efce0003750 0x7efce0003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:37.499 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcfe09e700 1 --2- 172.21.2.105:0/1860067138 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efce0004e70 0x7efce000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:37.499 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcfd09c700 1 -- 172.21.2.105:0/1860067138 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efce0004e70 msgr2=0x7efce000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:37.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcfd09c700 1 --2- 172.21.2.105:0/1860067138 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efce0004e70 0x7efce000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:37.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcfd09c700 1 -- 172.21.2.105:0/1860067138 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efce0003750 msgr2=0x7efce0003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:37.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcfd09c700 1 --2- 172.21.2.105:0/1860067138 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efce0003750 0x7efce0003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:37.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcfd09c700 1 -- 172.21.2.105:0/1860067138 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf80b0b30 con 0x7efce0004500 2021-11-12T05:49:37.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcfe09e700 1 --2- 172.21.2.105:0/1860067138 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efce0004e70 0x7efce000b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:49:37.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcfe09e700 1 -- 172.21.2.105:0/1860067138 reap_dead start 2021-11-12T05:49:37.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcfd09c700 1 --2- 172.21.2.105:0/1860067138 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efce0004500 0x7efce0004980 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 rx=0x7efcec001370 tx=0x7efcec001dc0).ready entity=mon.0 client_cookie=7da82a5ae04a9871 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:37.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcfc89b700 1 -- 172.21.2.105:0/1860067138 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efcec0071a0 con 0x7efce0004500 2021-11-12T05:49:37.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcfc89b700 1 -- 172.21.2.105:0/1860067138 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcec007300 con 0x7efce0004500 2021-11-12T05:49:37.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcfc89b700 1 -- 172.21.2.105:0/1860067138 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efcec00cae0 con 0x7efce0004500 2021-11-12T05:49:37.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcffb01700 1 -- 172.21.2.105:0/1860067138 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efce0004500 msgr2=0x7efce0004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:37.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcffb01700 1 --2- 172.21.2.105:0/1860067138 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efce0004500 0x7efce0004980 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 rx=0x7efcec001370 tx=0x7efcec001dc0).stop 2021-11-12T05:49:37.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcffb01700 1 -- 172.21.2.105:0/1860067138 shutdown_connections 2021-11-12T05:49:37.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcffb01700 1 --2- 172.21.2.105:0/1860067138 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efce0004500 0x7efce0004980 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:37.503 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcffb01700 1 -- 172.21.2.105:0/1860067138 >> 172.21.2.105:0/1860067138 conn(0x7efcf80b5370 msgr2=0x7efcf80b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:37.503 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcffb01700 1 -- 172.21.2.105:0/1860067138 shutdown_connections 2021-11-12T05:49:37.503 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.484+0000 7efcffb01700 1 -- 172.21.2.105:0/1860067138 wait complete. 2021-11-12T05:49:37.503 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.488+0000 7efcffb01700 1 Processor -- start 2021-11-12T05:49:37.503 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.488+0000 7efcffb01700 1 -- start start 2021-11-12T05:49:37.504 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.488+0000 7efcffb01700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efce0004500 0x7efcf80aaa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:37.504 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.488+0000 7efcffb01700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efcf80a95c0 0x7efcf8144500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:37.504 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.488+0000 7efcffb01700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efcf8156f40 0x7efcf81573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:37.504 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.488+0000 7efcffb01700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf80ab0c0 con 0x7efcf8156f40 2021-11-12T05:49:37.505 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.488+0000 7efcffb01700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf80ab360 con 0x7efce0004500 2021-11-12T05:49:37.505 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.488+0000 7efcffb01700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf80ab600 con 0x7efcf80a95c0 2021-11-12T05:49:37.505 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.488+0000 7efcfe09e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efcf8156f40 0x7efcf81573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:37.505 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.488+0000 7efcfe09e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efcf8156f40 0x7efcf81573c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52170/0 (socket says 172.21.2.105:52170) 2021-11-12T05:49:37.505 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.488+0000 7efcfe09e700 1 -- 172.21.2.105:0/680358698 learned_addr learned my addr 172.21.2.105:0/680358698 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:37.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.488+0000 7efcfd09c700 1 --2- 172.21.2.105:0/680358698 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efcf80a95c0 0x7efcf8144500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:37.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.488+0000 7efcfd89d700 1 --2- 172.21.2.105:0/680358698 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efce0004500 0x7efcf80aaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:37.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.488+0000 7efcfe09e700 1 -- 172.21.2.105:0/680358698 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efcf80a95c0 msgr2=0x7efcf8144500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:37.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.488+0000 7efcfe09e700 1 --2- 172.21.2.105:0/680358698 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efcf80a95c0 0x7efcf8144500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:37.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.488+0000 7efcfe09e700 1 -- 172.21.2.105:0/680358698 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efce0004500 msgr2=0x7efcf80aaa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:37.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.488+0000 7efcfe09e700 1 --2- 172.21.2.105:0/680358698 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efce0004500 0x7efcf80aaa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:37.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.488+0000 7efcfe09e700 1 -- 172.21.2.105:0/680358698 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf81449f0 con 0x7efcf8156f40 2021-11-12T05:49:37.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.488+0000 7efcfd09c700 1 --2- 172.21.2.105:0/680358698 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efcf80a95c0 0x7efcf8144500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:49:37.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.488+0000 7efcfe09e700 1 --2- 172.21.2.105:0/680358698 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efcf8156f40 0x7efcf81573c0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 rx=0x7efcec001840 tx=0x7efcf0009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:37.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.488+0000 7efceaffd700 1 -- 172.21.2.105:0/680358698 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efcf000de50 con 0x7efcf8156f40 2021-11-12T05:49:37.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.488+0000 7efceaffd700 1 -- 172.21.2.105:0/680358698 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf0002490 con 0x7efcf8156f40 2021-11-12T05:49:37.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.488+0000 7efceaffd700 1 -- 172.21.2.105:0/680358698 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efcf00027f0 con 0x7efcf8156f40 2021-11-12T05:49:37.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.488+0000 7efcffb01700 1 -- 172.21.2.105:0/680358698 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf81578b0 con 0x7efcf8156f40 2021-11-12T05:49:37.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.488+0000 7efcffb01700 1 -- 172.21.2.105:0/680358698 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf8063150 con 0x7efcf8156f40 2021-11-12T05:49:37.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.488+0000 7efcffb01700 1 -- 172.21.2.105:0/680358698 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf80b1440 con 0x7efcf8156f40 2021-11-12T05:49:37.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.488+0000 7efceaffd700 1 -- 172.21.2.105:0/680358698 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efcf0002950 con 0x7efcf8156f40 2021-11-12T05:49:37.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.488+0000 7efceaffd700 1 --2- 172.21.2.105:0/680358698 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efcd80536a0 0x7efcd8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:37.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.488+0000 7efceaffd700 1 -- 172.21.2.105:0/680358698 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6416+0+0 (secure 0 0 0) 0x7efcf006b8d0 con 0x7efcf8156f40 2021-11-12T05:49:37.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.488+0000 7efcfd89d700 1 --2- 172.21.2.105:0/680358698 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efcd80536a0 0x7efcd8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:37.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.488+0000 7efcfd89d700 1 --2- 172.21.2.105:0/680358698 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efcd80536a0 0x7efcd8055b60 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7efcf400b000 tx=0x7efcf4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:37.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.492+0000 7efceaffd700 1 -- 172.21.2.105:0/680358698 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efcf00427d0 con 0x7efcf8156f40 2021-11-12T05:49:37.582 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.576+0000 7efcffb01700 1 -- 172.21.2.105:0/680358698 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efcf80ab7c0 con 0x7efcf8156f40 2021-11-12T05:49:37.583 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.580+0000 7efceaffd700 1 -- 172.21.2.105:0/680358698 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+16298 (secure 0 0 0) 0x7efcf0024fc0 con 0x7efcf8156f40 2021-11-12T05:49:37.584 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:37.584 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":145,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:49:37.422318+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:49:35.238196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-11-12T05:49:36.389415+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:49:37.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.580+0000 7efcffb01700 1 -- 172.21.2.105:0/680358698 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efcd80536a0 msgr2=0x7efcd8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:37.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.580+0000 7efcffb01700 1 --2- 172.21.2.105:0/680358698 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efcd80536a0 0x7efcd8055b60 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7efcf400b000 tx=0x7efcf4008040).stop 2021-11-12T05:49:37.586 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.580+0000 7efcffb01700 1 -- 172.21.2.105:0/680358698 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efcf8156f40 msgr2=0x7efcf81573c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:37.586 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.580+0000 7efcffb01700 1 --2- 172.21.2.105:0/680358698 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efcf8156f40 0x7efcf81573c0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 rx=0x7efcec001840 tx=0x7efcf0009040).stop 2021-11-12T05:49:37.586 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.580+0000 7efcffb01700 1 -- 172.21.2.105:0/680358698 shutdown_connections 2021-11-12T05:49:37.586 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.580+0000 7efcffb01700 1 --2- 172.21.2.105:0/680358698 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efcd80536a0 0x7efcd8055b60 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:37.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.580+0000 7efcffb01700 1 --2- 172.21.2.105:0/680358698 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efcf8156f40 0x7efcf81573c0 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:37.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.580+0000 7efcffb01700 1 --2- 172.21.2.105:0/680358698 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efcf80a95c0 0x7efcf8144500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:37.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.580+0000 7efcffb01700 1 --2- 172.21.2.105:0/680358698 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efce0004500 0x7efcf80aaa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:37.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.580+0000 7efcffb01700 1 -- 172.21.2.105:0/680358698 >> 172.21.2.105:0/680358698 conn(0x7efcf80b5370 msgr2=0x7efcf814aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:37.588 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.580+0000 7efcffb01700 1 -- 172.21.2.105:0/680358698 shutdown_connections 2021-11-12T05:49:37.588 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.580+0000 7efcffb01700 1 -- 172.21.2.105:0/680358698 wait complete. 2021-11-12T05:49:37.591 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:49:37.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.636+0000 7efe6eab1700 1 Processor -- start 2021-11-12T05:49:37.641 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.636+0000 7efe6eab1700 1 -- start start 2021-11-12T05:49:37.642 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.636+0000 7efe6eab1700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7efe680ad080 0x7efe680af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:37.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.636+0000 7efe6eab1700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7efe680ac280 0x7efe680ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:37.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.636+0000 7efe6eab1700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efe6814abe0 0x7efe6814b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:37.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.636+0000 7efe6eab1700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe681488a0 con 0x7efe680ac280 2021-11-12T05:49:37.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.636+0000 7efe6eab1700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe680ac7b0 con 0x7efe680ad080 2021-11-12T05:49:37.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.636+0000 7efe6eab1700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe680ac9e0 con 0x7efe6814abe0 2021-11-12T05:49:37.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.636+0000 7efe67fff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7efe680ac280 0x7efe680ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:37.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.636+0000 7efe67fff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7efe680ac280 0x7efe680ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52180/0 (socket says 172.21.2.105:52180) 2021-11-12T05:49:37.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.636+0000 7efe67fff700 1 -- 172.21.2.105:0/2375985352 learned_addr learned my addr 172.21.2.105:0/2375985352 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:37.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.636+0000 7efe67fff700 1 -- 172.21.2.105:0/2375985352 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efe6814abe0 msgr2=0x7efe6814b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:37.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.636+0000 7efe67fff700 1 --2- 172.21.2.105:0/2375985352 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efe6814abe0 0x7efe6814b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:37.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.636+0000 7efe67fff700 1 -- 172.21.2.105:0/2375985352 >> v2:172.21.2.115:3300/0 conn(0x7efe680ad080 msgr2=0x7efe680af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:37.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.636+0000 7efe67fff700 1 --2- 172.21.2.105:0/2375985352 >> v2:172.21.2.115:3300/0 conn(0x7efe680ad080 0x7efe680af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:37.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.636+0000 7efe67fff700 1 -- 172.21.2.105:0/2375985352 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe680b0b30 con 0x7efe680ac280 2021-11-12T05:49:37.645 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.636+0000 7efe67fff700 1 --2- 172.21.2.105:0/2375985352 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe680ac280 0x7efe680ad460 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 rx=0x7efe680ac6a0 tx=0x7efe58006eb0).ready entity=mon.0 client_cookie=3266f6f1c221eef4 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:37.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.636+0000 7efe677fe700 1 -- 172.21.2.105:0/2375985352 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe5800d570 con 0x7efe680ac280 2021-11-12T05:49:37.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.636+0000 7efe677fe700 1 -- 172.21.2.105:0/2375985352 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe58000e90 con 0x7efe680ac280 2021-11-12T05:49:37.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.636+0000 7efe677fe700 1 -- 172.21.2.105:0/2375985352 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe5800d8c0 con 0x7efe680ac280 2021-11-12T05:49:37.646 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.636+0000 7efe6eab1700 1 -- 172.21.2.105:0/2375985352 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe680ac280 msgr2=0x7efe680ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:37.647 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.636+0000 7efe6eab1700 1 --2- 172.21.2.105:0/2375985352 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe680ac280 0x7efe680ad460 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 rx=0x7efe680ac6a0 tx=0x7efe58006eb0).stop 2021-11-12T05:49:37.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.640+0000 7efe6eab1700 1 -- 172.21.2.105:0/2375985352 shutdown_connections 2021-11-12T05:49:37.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.640+0000 7efe6eab1700 1 --2- 172.21.2.105:0/2375985352 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efe6814abe0 0x7efe6814b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:37.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.640+0000 7efe6eab1700 1 --2- 172.21.2.105:0/2375985352 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe680ac280 0x7efe680ad460 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:37.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.640+0000 7efe6eab1700 1 --2- 172.21.2.105:0/2375985352 >> v2:172.21.2.115:3300/0 conn(0x7efe680ad080 0x7efe680af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:37.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.640+0000 7efe6eab1700 1 -- 172.21.2.105:0/2375985352 >> 172.21.2.105:0/2375985352 conn(0x7efe680b5370 msgr2=0x7efe680b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:37.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.640+0000 7efe6eab1700 1 -- 172.21.2.105:0/2375985352 shutdown_connections 2021-11-12T05:49:37.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.640+0000 7efe6eab1700 1 -- 172.21.2.105:0/2375985352 wait complete. 2021-11-12T05:49:37.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.640+0000 7efe6eab1700 1 Processor -- start 2021-11-12T05:49:37.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.640+0000 7efe6eab1700 1 -- start start 2021-11-12T05:49:37.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.640+0000 7efe6eab1700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efe680ac280 0x7efe680aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:37.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.640+0000 7efe6eab1700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efe680ad080 0x7efe680ab350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:37.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.640+0000 7efe6eab1700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe6814abe0 0x7efe68157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:37.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.640+0000 7efe6eab1700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe68158000 con 0x7efe6814abe0 2021-11-12T05:49:37.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.640+0000 7efe6eab1700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe68157130 con 0x7efe680ad080 2021-11-12T05:49:37.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.640+0000 7efe6eab1700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe681573d0 con 0x7efe680ac280 2021-11-12T05:49:37.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.640+0000 7efe6d04e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe6814abe0 0x7efe68157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:37.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.640+0000 7efe6d04e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe6814abe0 0x7efe68157b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52186/0 (socket says 172.21.2.105:52186) 2021-11-12T05:49:37.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.640+0000 7efe6d04e700 1 -- 172.21.2.105:0/1413214173 learned_addr learned my addr 172.21.2.105:0/1413214173 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:37.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.640+0000 7efe6d04e700 1 -- 172.21.2.105:0/1413214173 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efe680ac280 msgr2=0x7efe680aaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:37.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.640+0000 7efe6d04e700 1 --2- 172.21.2.105:0/1413214173 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efe680ac280 0x7efe680aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:37.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.640+0000 7efe6d04e700 1 -- 172.21.2.105:0/1413214173 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efe680ad080 msgr2=0x7efe680ab350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:37.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.640+0000 7efe6d04e700 1 --2- 172.21.2.105:0/1413214173 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efe680ad080 0x7efe680ab350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:37.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.640+0000 7efe6d04e700 1 -- 172.21.2.105:0/1413214173 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe5800b1e0 con 0x7efe6814abe0 2021-11-12T05:49:37.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.640+0000 7efe6d04e700 1 --2- 172.21.2.105:0/1413214173 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe6814abe0 0x7efe68157b10 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 rx=0x7efe600032f0 tx=0x7efe60009120).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:37.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.640+0000 7efe65ffb700 1 -- 172.21.2.105:0/1413214173 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe6000f510 con 0x7efe6814abe0 2021-11-12T05:49:37.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.640+0000 7efe65ffb700 1 -- 172.21.2.105:0/1413214173 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6000f670 con 0x7efe6814abe0 2021-11-12T05:49:37.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.640+0000 7efe65ffb700 1 -- 172.21.2.105:0/1413214173 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe6000f7e0 con 0x7efe6814abe0 2021-11-12T05:49:37.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.640+0000 7efe6eab1700 1 -- 172.21.2.105:0/1413214173 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe68157670 con 0x7efe6814abe0 2021-11-12T05:49:37.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.640+0000 7efe6eab1700 1 -- 172.21.2.105:0/1413214173 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe680a9ef0 con 0x7efe6814abe0 2021-11-12T05:49:37.659 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.640+0000 7efe6eab1700 1 -- 172.21.2.105:0/1413214173 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe68157830 con 0x7efe6814abe0 2021-11-12T05:49:37.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.640+0000 7efe65ffb700 1 -- 172.21.2.105:0/1413214173 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efe6000f070 con 0x7efe6814abe0 2021-11-12T05:49:37.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.644+0000 7efe65ffb700 1 --2- 172.21.2.105:0/1413214173 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efe48053690 0x7efe48055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:37.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.644+0000 7efe65ffb700 1 -- 172.21.2.105:0/1413214173 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6416+0+0 (secure 0 0 0) 0x7efe6006b640 con 0x7efe6814abe0 2021-11-12T05:49:37.660 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.644+0000 7efe6c84d700 1 --2- 172.21.2.105:0/1413214173 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efe48053690 0x7efe48055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:37.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.644+0000 7efe6c84d700 1 --2- 172.21.2.105:0/1413214173 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efe48053690 0x7efe48055b50 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7efe5c002f70 tx=0x7efe5c006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:37.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.644+0000 7efe65ffb700 1 -- 172.21.2.105:0/1413214173 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efe60042650 con 0x7efe6814abe0 2021-11-12T05:49:37.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.728+0000 7efe6eab1700 1 -- 172.21.2.105:0/1413214173 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe6814b580 con 0x7efe6814abe0 2021-11-12T05:49:37.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.728+0000 7efe65ffb700 1 -- 172.21.2.105:0/1413214173 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+16298 (secure 0 0 0) 0x7efe60045c70 con 0x7efe6814abe0 2021-11-12T05:49:37.733 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:37.734 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":145,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:49:37.422318+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:49:35.238196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-11-12T05:49:36.389415+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:49:37.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.728+0000 7efe6eab1700 1 -- 172.21.2.105:0/1413214173 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efe48053690 msgr2=0x7efe48055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:37.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.728+0000 7efe6eab1700 1 --2- 172.21.2.105:0/1413214173 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efe48053690 0x7efe48055b50 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7efe5c002f70 tx=0x7efe5c006a80).stop 2021-11-12T05:49:37.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.728+0000 7efe6eab1700 1 -- 172.21.2.105:0/1413214173 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe6814abe0 msgr2=0x7efe68157b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:37.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.728+0000 7efe6eab1700 1 --2- 172.21.2.105:0/1413214173 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe6814abe0 0x7efe68157b10 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 rx=0x7efe600032f0 tx=0x7efe60009120).stop 2021-11-12T05:49:37.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.728+0000 7efe6eab1700 1 -- 172.21.2.105:0/1413214173 shutdown_connections 2021-11-12T05:49:37.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.728+0000 7efe6eab1700 1 --2- 172.21.2.105:0/1413214173 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efe48053690 0x7efe48055b50 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:37.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.728+0000 7efe6eab1700 1 --2- 172.21.2.105:0/1413214173 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efe6814abe0 0x7efe68157b10 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:37.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.728+0000 7efe6eab1700 1 --2- 172.21.2.105:0/1413214173 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efe680ad080 0x7efe680ab350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:37.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.728+0000 7efe6eab1700 1 --2- 172.21.2.105:0/1413214173 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efe680ac280 0x7efe680aaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:37.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.728+0000 7efe6eab1700 1 -- 172.21.2.105:0/1413214173 >> 172.21.2.105:0/1413214173 conn(0x7efe680b5370 msgr2=0x7efe681444c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:37.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.728+0000 7efe6eab1700 1 -- 172.21.2.105:0/1413214173 shutdown_connections 2021-11-12T05:49:37.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.728+0000 7efe6eab1700 1 -- 172.21.2.105:0/1413214173 wait complete. 2021-11-12T05:49:37.741 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-12T05:49:37.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.788+0000 7f0a2215e700 1 Processor -- start 2021-11-12T05:49:37.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.788+0000 7f0a2215e700 1 -- start start 2021-11-12T05:49:37.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.788+0000 7f0a2215e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0a1c0aca40 0x7f0a1c0ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:37.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.788+0000 7f0a2215e700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f0a1c0b0520 0x7f0a1c1473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:37.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.788+0000 7f0a2215e700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a1c0b1840 con 0x7f0a1c1478b0 2021-11-12T05:49:37.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.788+0000 7f0a2215e700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a1c147d40 con 0x7f0a1c0b0520 2021-11-12T05:49:37.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.788+0000 7f0a2215e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c0af2b0 con 0x7f0a1c0aca40 2021-11-12T05:49:37.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.788+0000 7f0a1bfff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f0a1c1478b0 0x7f0a1c144180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34356/0 (socket says 172.21.2.105:34356) 2021-11-12T05:49:37.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.788+0000 7f0a1bfff700 1 -- 172.21.2.105:0/1449969748 learned_addr learned my addr 172.21.2.105:0/1449969748 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:37.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.788+0000 7f0a1affd700 1 --2- 172.21.2.105:0/1449969748 >> v2:172.21.2.105:3300/0 conn(0x7f0a1c0b0520 0x7f0a1c1473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:37.798 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.788+0000 7f0a1affd700 1 -- 172.21.2.105:0/1449969748 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0a1c0aca40 msgr2=0x7f0a1c0ace20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:49:37.798 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.788+0000 7f0a1affd700 1 --2- 172.21.2.105:0/1449969748 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0a1c0aca40 0x7f0a1c0ace20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:37.798 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.788+0000 7f0a1affd700 1 -- 172.21.2.105:0/1449969748 >> v1:172.21.2.105:6789/0 conn(0x7f0a1c1478b0 legacy=0x7f0a1c144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:37.798 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.788+0000 7f0a1affd700 1 -- 172.21.2.105:0/1449969748 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a1c0b09a0 con 0x7f0a1c0b0520 2021-11-12T05:49:37.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.788+0000 7f0a1affd700 1 --2- 172.21.2.105:0/1449969748 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a1c0b0520 0x7f0a1c1473c0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 rx=0x7f0a10002f70 tx=0x7f0a10006df0).ready entity=mon.0 client_cookie=f9ab2b11428839cb server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:37.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.788+0000 7f0a1a7fc700 1 -- 172.21.2.105:0/1449969748 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a1000d570 con 0x7f0a1c0b0520 2021-11-12T05:49:37.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.788+0000 7f0a1a7fc700 1 -- 172.21.2.105:0/1449969748 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a10000e90 con 0x7f0a1c0b0520 2021-11-12T05:49:37.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.788+0000 7f0a1a7fc700 1 -- 172.21.2.105:0/1449969748 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a1000d900 con 0x7f0a1c0b0520 2021-11-12T05:49:37.799 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.792+0000 7f0a2215e700 1 -- 172.21.2.105:0/1449969748 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a1c0b0520 msgr2=0x7f0a1c1473c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:37.800 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.792+0000 7f0a2215e700 1 --2- 172.21.2.105:0/1449969748 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a1c0b0520 0x7f0a1c1473c0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 rx=0x7f0a10002f70 tx=0x7f0a10006df0).stop 2021-11-12T05:49:37.800 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.792+0000 7f0a2215e700 1 -- 172.21.2.105:0/1449969748 shutdown_connections 2021-11-12T05:49:37.800 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.792+0000 7f0a2215e700 1 --2- 172.21.2.105:0/1449969748 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a1c0b0520 0x7f0a1c1473c0 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:37.800 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.792+0000 7f0a2215e700 1 --2- 172.21.2.105:0/1449969748 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0a1c0aca40 0x7f0a1c0ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:37.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.792+0000 7f0a2215e700 1 -- 172.21.2.105:0/1449969748 >> 172.21.2.105:0/1449969748 conn(0x7f0a1c05c490 msgr2=0x7f0a1c0b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:37.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.792+0000 7f0a2215e700 1 -- 172.21.2.105:0/1449969748 shutdown_connections 2021-11-12T05:49:37.801 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.792+0000 7f0a2215e700 1 -- 172.21.2.105:0/1449969748 wait complete. 2021-11-12T05:49:37.804 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.792+0000 7f0a2215e700 1 Processor -- start 2021-11-12T05:49:37.804 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.792+0000 7f0a2215e700 1 -- start start 2021-11-12T05:49:37.804 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.792+0000 7f0a2215e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0a1c0aca40 0x7f0a1c062d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:37.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.792+0000 7f0a2215e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a1c0b0520 0x7f0a1c146730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:37.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.792+0000 7f0a2215e700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0a1c1478b0 0x7f0a1c146c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:37.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.792+0000 7f0a2215e700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c0a8910 con 0x7f0a1c0b0520 2021-11-12T05:49:37.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.792+0000 7f0a2215e700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c0a8bb0 con 0x7f0a1c1478b0 2021-11-12T05:49:37.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.792+0000 7f0a2215e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c0a8e50 con 0x7f0a1c0aca40 2021-11-12T05:49:37.806 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.792+0000 7f0a1affd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a1c0b0520 0x7f0a1c146730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:37.806 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.792+0000 7f0a1affd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a1c0b0520 0x7f0a1c146730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52198/0 (socket says 172.21.2.105:52198) 2021-11-12T05:49:37.806 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.792+0000 7f0a1affd700 1 -- 172.21.2.105:0/2222661616 learned_addr learned my addr 172.21.2.105:0/2222661616 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:37.806 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.792+0000 7f0a1affd700 1 -- 172.21.2.105:0/2222661616 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0a1c0aca40 msgr2=0x7f0a1c062d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:37.807 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.792+0000 7f0a1affd700 1 --2- 172.21.2.105:0/2222661616 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0a1c0aca40 0x7f0a1c062d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:37.807 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.792+0000 7f0a1affd700 1 -- 172.21.2.105:0/2222661616 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0a1c1478b0 msgr2=0x7f0a1c146c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:37.807 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.792+0000 7f0a1affd700 1 --2- 172.21.2.105:0/2222661616 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0a1c1478b0 0x7f0a1c146c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:37.807 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.792+0000 7f0a1affd700 1 -- 172.21.2.105:0/2222661616 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a1000b180 con 0x7f0a1c0b0520 2021-11-12T05:49:37.807 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.792+0000 7f0a1affd700 1 --2- 172.21.2.105:0/2222661616 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a1c0b0520 0x7f0a1c146730 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 rx=0x7f0a10002f70 tx=0x7f0a10015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:37.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.792+0000 7f0a18ff9700 1 -- 172.21.2.105:0/2222661616 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a10006aa0 con 0x7f0a1c0b0520 2021-11-12T05:49:37.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.792+0000 7f0a18ff9700 1 -- 172.21.2.105:0/2222661616 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a1000de40 con 0x7f0a1c0b0520 2021-11-12T05:49:37.808 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.792+0000 7f0a18ff9700 1 -- 172.21.2.105:0/2222661616 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a1001e460 con 0x7f0a1c0b0520 2021-11-12T05:49:37.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.792+0000 7f0a2215e700 1 -- 172.21.2.105:0/2222661616 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a1c0a90f0 con 0x7f0a1c0b0520 2021-11-12T05:49:37.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.792+0000 7f0a2215e700 1 -- 172.21.2.105:0/2222661616 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a1c0a9590 con 0x7f0a1c0b0520 2021-11-12T05:49:37.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.792+0000 7f0a2215e700 1 -- 172.21.2.105:0/2222661616 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a1c1472b0 con 0x7f0a1c0b0520 2021-11-12T05:49:37.809 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.792+0000 7f0a18ff9700 1 -- 172.21.2.105:0/2222661616 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0a10025030 con 0x7f0a1c0b0520 2021-11-12T05:49:37.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.792+0000 7f0a18ff9700 1 --2- 172.21.2.105:0/2222661616 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f09fc0535d0 0x7f09fc055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:37.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.792+0000 7f0a18ff9700 1 -- 172.21.2.105:0/2222661616 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f0a1006cee0 con 0x7f0a1c0b0520 2021-11-12T05:49:37.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.792+0000 7f0a1b7fe700 1 --2- 172.21.2.105:0/2222661616 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f09fc0535d0 0x7f09fc055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:37.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.792+0000 7f0a1b7fe700 1 --2- 172.21.2.105:0/2222661616 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f09fc0535d0 0x7f09fc055a90 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f0a0c002fb0 tx=0x7f0a0c0069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:37.810 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.796+0000 7f0a18ff9700 1 -- 172.21.2.105:0/2222661616 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0a10043ef0 con 0x7f0a1c0b0520 2021-11-12T05:49:37.909 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:37.904+0000 7f0a2215e700 1 -- 172.21.2.105:0/2222661616 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0a1c0a92b0 con 0x7f0a1c0b0520 2021-11-12T05:49:38.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.432+0000 7f0a18ff9700 1 -- 172.21.2.105:0/2222661616 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v69) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0a100230b0 con 0x7f0a1c0b0520 2021-11-12T05:49:38.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.432+0000 7f0a2215e700 1 -- 172.21.2.105:0/2222661616 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f09fc0535d0 msgr2=0x7f09fc055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:38.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.432+0000 7f0a2215e700 1 --2- 172.21.2.105:0/2222661616 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f09fc0535d0 0x7f09fc055a90 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f0a0c002fb0 tx=0x7f0a0c0069b0).stop 2021-11-12T05:49:38.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.432+0000 7f0a2215e700 1 -- 172.21.2.105:0/2222661616 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a1c0b0520 msgr2=0x7f0a1c146730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:38.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.432+0000 7f0a2215e700 1 --2- 172.21.2.105:0/2222661616 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a1c0b0520 0x7f0a1c146730 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 rx=0x7f0a10002f70 tx=0x7f0a10015000).stop 2021-11-12T05:49:38.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.432+0000 7f0a2215e700 1 -- 172.21.2.105:0/2222661616 shutdown_connections 2021-11-12T05:49:38.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.432+0000 7f0a2215e700 1 --2- 172.21.2.105:0/2222661616 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f09fc0535d0 0x7f09fc055a90 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:38.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.432+0000 7f0a2215e700 1 --2- 172.21.2.105:0/2222661616 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0a1c1478b0 0x7f0a1c146c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:38.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.432+0000 7f0a2215e700 1 --2- 172.21.2.105:0/2222661616 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a1c0b0520 0x7f0a1c146730 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:38.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.432+0000 7f0a2215e700 1 --2- 172.21.2.105:0/2222661616 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0a1c0aca40 0x7f0a1c062d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:38.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.432+0000 7f0a2215e700 1 -- 172.21.2.105:0/2222661616 >> 172.21.2.105:0/2222661616 conn(0x7f0a1c05c490 msgr2=0x7f0a1c0b2600 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:38.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.432+0000 7f0a2215e700 1 -- 172.21.2.105:0/2222661616 shutdown_connections 2021-11-12T05:49:38.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.432+0000 7f0a2215e700 1 -- 172.21.2.105:0/2222661616 wait complete. 2021-11-12T05:49:38.444 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:49:38.496 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc78b44c700 1 Processor -- start 2021-11-12T05:49:38.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc78b44c700 1 -- start start 2021-11-12T05:49:38.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc78b44c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc7840ac280 0x7fc78414b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:38.497 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc78b44c700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7840ac7b0 con 0x7fc7840af730 2021-11-12T05:49:38.498 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc78b44c700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7840ac9e0 con 0x7fc7840ad080 2021-11-12T05:49:38.498 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc78b44c700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7841488a0 con 0x7fc7840ac280 2021-11-12T05:49:38.499 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc7899e9700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fc7840af730 0x7fc784147a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34372/0 (socket says 172.21.2.105:34372) 2021-11-12T05:49:38.499 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc7899e9700 1 -- 172.21.2.105:0/2632666682 learned_addr learned my addr 172.21.2.105:0/2632666682 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:38.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc777fff700 1 -- 172.21.2.105:0/2632666682 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1139150435 0 0) 0x7fc7840ac7b0 con 0x7fc7840af730 2021-11-12T05:49:38.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc7889e7700 1 --2- 172.21.2.105:0/2632666682 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc7840ac280 0x7fc78414b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:38.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc777fff700 1 -- 172.21.2.105:0/2632666682 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc76c003260 con 0x7fc7840af730 2021-11-12T05:49:38.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc777fff700 1 -- 172.21.2.105:0/2632666682 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2658755484 0 0) 0x7fc76c003260 con 0x7fc7840af730 2021-11-12T05:49:38.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc777fff700 1 -- 172.21.2.105:0/2632666682 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc7840ac280 msgr2=0x7fc78414b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:38.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc777fff700 1 --2- 172.21.2.105:0/2632666682 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc7840ac280 0x7fc78414b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:38.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc777fff700 1 -- 172.21.2.105:0/2632666682 >> v1:172.21.2.115:6789/0 conn(0x7fc7840ad080 legacy=0x7fc78414abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:38.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc777fff700 1 -- 172.21.2.105:0/2632666682 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7840b0b30 con 0x7fc7840af730 2021-11-12T05:49:38.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc777fff700 1 -- 172.21.2.105:0/2632666682 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fc77c0019e0 con 0x7fc7840af730 2021-11-12T05:49:38.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc777fff700 1 -- 172.21.2.105:0/2632666682 >> v1:172.21.2.105:6789/0 conn(0x7fc7840af730 legacy=0x7fc784147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:38.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc777fff700 1 --2- 172.21.2.105:0/2632666682 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc76c003780 0x7fc76c003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:38.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc777fff700 1 --2- 172.21.2.105:0/2632666682 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc76c004500 0x7fc76c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:38.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc777fff700 1 --2- 172.21.2.105:0/2632666682 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc7840ac280 0x7fc76c004eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:38.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc777fff700 1 -- 172.21.2.105:0/2632666682 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7841488a0 con 0x7fc76c003780 2021-11-12T05:49:38.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc777fff700 1 -- 172.21.2.105:0/2632666682 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c00b800 con 0x7fc76c004500 2021-11-12T05:49:38.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc777fff700 1 -- 172.21.2.105:0/2632666682 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c00b9c0 con 0x7fc7840ac280 2021-11-12T05:49:38.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc7891e8700 1 --2- 172.21.2.105:0/2632666682 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc76c003780 0x7fc76c003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:38.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc7889e7700 1 --2- 172.21.2.105:0/2632666682 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc76c004500 0x7fc76c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:38.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc7891e8700 1 -- 172.21.2.105:0/2632666682 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc7840ac280 msgr2=0x7fc76c004eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:38.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc7891e8700 1 --2- 172.21.2.105:0/2632666682 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc7840ac280 0x7fc76c004eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:38.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc7891e8700 1 -- 172.21.2.105:0/2632666682 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc76c004500 msgr2=0x7fc76c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:38.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc7891e8700 1 --2- 172.21.2.105:0/2632666682 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc76c004500 0x7fc76c004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:38.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc7891e8700 1 -- 172.21.2.105:0/2632666682 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc76c003260 con 0x7fc76c003780 2021-11-12T05:49:38.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc7889e7700 1 --2- 172.21.2.105:0/2632666682 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc76c004500 0x7fc76c004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:49:38.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc7891e8700 1 --2- 172.21.2.105:0/2632666682 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc76c003780 0x7fc76c003ba0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 rx=0x7fc7840b6060 tx=0x7fc780007a00).ready entity=mon.0 client_cookie=e5ca0b475030555d server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:38.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc777fff700 1 -- 172.21.2.105:0/2632666682 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc780007d10 con 0x7fc76c003780 2021-11-12T05:49:38.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc777fff700 1 -- 172.21.2.105:0/2632666682 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc780007030 con 0x7fc76c003780 2021-11-12T05:49:38.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc777fff700 1 -- 172.21.2.105:0/2632666682 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc780007390 con 0x7fc76c003780 2021-11-12T05:49:38.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc78b44c700 1 -- 172.21.2.105:0/2632666682 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc76c003780 msgr2=0x7fc76c003ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:38.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc78b44c700 1 --2- 172.21.2.105:0/2632666682 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc76c003780 0x7fc76c003ba0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 rx=0x7fc7840b6060 tx=0x7fc780007a00).stop 2021-11-12T05:49:38.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc7899e9700 1 -- 172.21.2.105:0/2632666682 reap_dead start 2021-11-12T05:49:38.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc78b44c700 1 -- 172.21.2.105:0/2632666682 shutdown_connections 2021-11-12T05:49:38.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc78b44c700 1 -- 172.21.2.105:0/2632666682 >> 172.21.2.105:0/2632666682 conn(0x7fc7840b5370 msgr2=0x7fc7840b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:38.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc78b44c700 1 -- 172.21.2.105:0/2632666682 shutdown_connections 2021-11-12T05:49:38.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.492+0000 7fc78b44c700 1 -- 172.21.2.105:0/2632666682 wait complete. 2021-11-12T05:49:38.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.496+0000 7fc78b44c700 1 Processor -- start 2021-11-12T05:49:38.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.496+0000 7fc78b44c700 1 -- start start 2021-11-12T05:49:38.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.496+0000 7fc78b44c700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc76c003780 0x7fc7840b4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:38.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.496+0000 7fc78b44c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc7840a9c70 0x7fc7840aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:38.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.496+0000 7fc78b44c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc7840a94e0 0x7fc7841572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:38.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.496+0000 7fc78b44c700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78415afc0 con 0x7fc7840a9c70 2021-11-12T05:49:38.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.496+0000 7fc78b44c700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc784156e50 con 0x7fc76c003780 2021-11-12T05:49:38.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.496+0000 7fc78b44c700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78415ac00 con 0x7fc7840a94e0 2021-11-12T05:49:38.520 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.496+0000 7fc7889e7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc7840a9c70 0x7fc7840aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:38.520 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.496+0000 7fc7889e7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc7840a9c70 0x7fc7840aa890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52216/0 (socket says 172.21.2.105:52216) 2021-11-12T05:49:38.520 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.496+0000 7fc7889e7700 1 -- 172.21.2.105:0/2042487054 learned_addr learned my addr 172.21.2.105:0/2042487054 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:38.521 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.496+0000 7fc7889e7700 1 -- 172.21.2.105:0/2042487054 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc7840a94e0 msgr2=0x7fc7841572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:38.521 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.496+0000 7fc7889e7700 1 --2- 172.21.2.105:0/2042487054 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc7840a94e0 0x7fc7841572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:38.521 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.496+0000 7fc7891e8700 1 --2- 172.21.2.105:0/2042487054 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc76c003780 0x7fc7840b4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:38.521 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.496+0000 7fc7889e7700 1 -- 172.21.2.105:0/2042487054 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc76c003780 msgr2=0x7fc7840b4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:38.521 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.496+0000 7fc7889e7700 1 --2- 172.21.2.105:0/2042487054 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc76c003780 0x7fc7840b4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:38.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.496+0000 7fc7889e7700 1 -- 172.21.2.105:0/2042487054 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7841577e0 con 0x7fc7840a9c70 2021-11-12T05:49:38.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.496+0000 7fc7889e7700 1 --2- 172.21.2.105:0/2042487054 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc7840a9c70 0x7fc7840aa890 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 rx=0x7fc77800b000 tx=0x7fc778008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:38.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.496+0000 7fc7767fc700 1 -- 172.21.2.105:0/2042487054 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc778017070 con 0x7fc7840a9c70 2021-11-12T05:49:38.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.496+0000 7fc7767fc700 1 -- 172.21.2.105:0/2042487054 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc778000e90 con 0x7fc7840a9c70 2021-11-12T05:49:38.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.496+0000 7fc78b44c700 1 -- 172.21.2.105:0/2042487054 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc784157a90 con 0x7fc7840a9c70 2021-11-12T05:49:38.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.496+0000 7fc7767fc700 1 -- 172.21.2.105:0/2042487054 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc778011980 con 0x7fc7840a9c70 2021-11-12T05:49:38.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.496+0000 7fc78b44c700 1 -- 172.21.2.105:0/2042487054 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc784155fd0 con 0x7fc7840a9c70 2021-11-12T05:49:38.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.496+0000 7fc78b44c700 1 -- 172.21.2.105:0/2042487054 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc78415adc0 con 0x7fc7840a9c70 2021-11-12T05:49:38.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.496+0000 7fc7767fc700 1 -- 172.21.2.105:0/2042487054 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc778011ae0 con 0x7fc7840a9c70 2021-11-12T05:49:38.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.496+0000 7fc7767fc700 1 --2- 172.21.2.105:0/2042487054 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc764053610 0x7fc764055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:38.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.496+0000 7fc7767fc700 1 -- 172.21.2.105:0/2042487054 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fc77806bb80 con 0x7fc7840a9c70 2021-11-12T05:49:38.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.496+0000 7fc7891e8700 1 --2- 172.21.2.105:0/2042487054 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc764053610 0x7fc764055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:38.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.496+0000 7fc7891e8700 1 --2- 172.21.2.105:0/2042487054 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc764053610 0x7fc764055ad0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7fc780016000 tx=0x7fc780015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:38.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.500+0000 7fc7767fc700 1 -- 172.21.2.105:0/2042487054 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc778042c40 con 0x7fc7840a9c70 2021-11-12T05:49:38.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.608+0000 7fc78b44c700 1 -- 172.21.2.105:0/2042487054 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7840b1440 con 0x7fc7840a9c70 2021-11-12T05:49:38.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.612+0000 7fc7767fc700 1 -- 172.21.2.105:0/2042487054 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+2139 (secure 0 0 0) 0x7fc778046260 con 0x7fc7840a9c70 2021-11-12T05:49:38.616 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:38.616 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":69,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5066,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/506237043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":506237043},{"type":"v1","addr":"172.21.2.115:6833","nonce":506237043}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":68}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:49:37.422405+0000","modified":"2021-11-12T05:49:38.425999+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8499},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8499":{"gid":8499,"name":"a","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/3394672010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":3394672010},{"type":"v1","addr":"172.21.2.105:6835","nonce":3394672010}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-11-12T05:49:38.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.612+0000 7fc78b44c700 1 -- 172.21.2.105:0/2042487054 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc764053610 msgr2=0x7fc764055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:38.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.612+0000 7fc78b44c700 1 --2- 172.21.2.105:0/2042487054 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc764053610 0x7fc764055ad0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7fc780016000 tx=0x7fc780015000).stop 2021-11-12T05:49:38.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.612+0000 7fc78b44c700 1 -- 172.21.2.105:0/2042487054 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc7840a9c70 msgr2=0x7fc7840aa890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:38.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.612+0000 7fc78b44c700 1 --2- 172.21.2.105:0/2042487054 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc7840a9c70 0x7fc7840aa890 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 rx=0x7fc77800b000 tx=0x7fc778008040).stop 2021-11-12T05:49:38.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.612+0000 7fc78b44c700 1 -- 172.21.2.105:0/2042487054 shutdown_connections 2021-11-12T05:49:38.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.612+0000 7fc78b44c700 1 --2- 172.21.2.105:0/2042487054 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc764053610 0x7fc764055ad0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:38.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.612+0000 7fc78b44c700 1 --2- 172.21.2.105:0/2042487054 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc7840a94e0 0x7fc7841572f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:38.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.612+0000 7fc78b44c700 1 --2- 172.21.2.105:0/2042487054 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc7840a9c70 0x7fc7840aa890 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:38.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.612+0000 7fc78b44c700 1 --2- 172.21.2.105:0/2042487054 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc76c003780 0x7fc7840b4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:38.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.612+0000 7fc78b44c700 1 -- 172.21.2.105:0/2042487054 >> 172.21.2.105:0/2042487054 conn(0x7fc7840b5370 msgr2=0x7fc7840b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:38.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.612+0000 7fc78b44c700 1 -- 172.21.2.105:0/2042487054 shutdown_connections 2021-11-12T05:49:38.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.612+0000 7fc78b44c700 1 -- 172.21.2.105:0/2042487054 wait complete. 2021-11-12T05:49:38.620 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 69 2021-11-12T05:49:38.623 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:49:38.674 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.668+0000 7f9c16512700 1 Processor -- start 2021-11-12T05:49:38.675 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.668+0000 7f9c16512700 1 -- start start 2021-11-12T05:49:38.675 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.668+0000 7f9c16512700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9c100ac280 0x7f9c1014b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:38.675 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.668+0000 7f9c16512700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c100ac7b0 con 0x7f9c100af730 2021-11-12T05:49:38.676 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.668+0000 7f9c16512700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c100ac9e0 con 0x7f9c100ad080 2021-11-12T05:49:38.676 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.668+0000 7f9c16512700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c101488a0 con 0x7f9c100ac280 2021-11-12T05:49:38.676 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.668+0000 7f9c14aaf700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f9c100af730 0x7f9c10147a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34392/0 (socket says 172.21.2.105:34392) 2021-11-12T05:49:38.676 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c14aaf700 1 -- 172.21.2.105:0/3258822739 learned_addr learned my addr 172.21.2.105:0/3258822739 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:38.681 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c0effd700 1 -- 172.21.2.105:0/3258822739 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 298292195 0 0) 0x7f9c100ac7b0 con 0x7f9c100af730 2021-11-12T05:49:38.682 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c0effd700 1 -- 172.21.2.105:0/3258822739 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bf0003260 con 0x7f9c100af730 2021-11-12T05:49:38.682 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c0f7fe700 1 --2- 172.21.2.105:0/3258822739 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9c100ac280 0x7f9c1014b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:38.682 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c0effd700 1 -- 172.21.2.105:0/3258822739 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2177553915 0 0) 0x7f9bf0003260 con 0x7f9c100af730 2021-11-12T05:49:38.682 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c0effd700 1 -- 172.21.2.105:0/3258822739 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9c100ac280 msgr2=0x7f9c1014b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:38.683 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c0effd700 1 --2- 172.21.2.105:0/3258822739 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9c100ac280 0x7f9c1014b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:38.683 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c0effd700 1 -- 172.21.2.105:0/3258822739 >> v1:172.21.2.115:6789/0 conn(0x7f9c100ad080 legacy=0x7f9c1014abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:38.683 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c0effd700 1 -- 172.21.2.105:0/3258822739 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c100b0b30 con 0x7f9c100af730 2021-11-12T05:49:38.683 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c0effd700 1 -- 172.21.2.105:0/3258822739 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f9c080019e0 con 0x7f9c100af730 2021-11-12T05:49:38.683 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c0effd700 1 -- 172.21.2.105:0/3258822739 >> v1:172.21.2.105:6789/0 conn(0x7f9c100af730 legacy=0x7f9c10147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:38.684 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c0effd700 1 --2- 172.21.2.105:0/3258822739 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9c100ac280 0x7f9bf0003800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:38.684 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c0effd700 1 --2- 172.21.2.105:0/3258822739 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9bf0003e10 0x7f9bf0004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:38.684 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c0effd700 1 --2- 172.21.2.105:0/3258822739 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9bf0004b10 0x7f9bf0004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:38.684 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c0effd700 1 -- 172.21.2.105:0/3258822739 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c101488a0 con 0x7f9bf0004b10 2021-11-12T05:49:38.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c0effd700 1 -- 172.21.2.105:0/3258822739 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf000b960 con 0x7f9bf0003e10 2021-11-12T05:49:38.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c0effd700 1 -- 172.21.2.105:0/3258822739 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf000bb20 con 0x7f9c100ac280 2021-11-12T05:49:38.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c14aaf700 1 --2- 172.21.2.105:0/3258822739 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9bf0004b10 0x7f9bf0004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:38.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c0f7fe700 1 --2- 172.21.2.105:0/3258822739 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9bf0003e10 0x7f9bf0004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:38.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c14aaf700 1 -- 172.21.2.105:0/3258822739 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9c100ac280 msgr2=0x7f9bf0003800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:38.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c0ffff700 1 --2- 172.21.2.105:0/3258822739 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9c100ac280 0x7f9bf0003800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:38.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c14aaf700 1 --2- 172.21.2.105:0/3258822739 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9c100ac280 0x7f9bf0003800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:38.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c14aaf700 1 -- 172.21.2.105:0/3258822739 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9bf0003e10 msgr2=0x7f9bf0004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:38.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c14aaf700 1 --2- 172.21.2.105:0/3258822739 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9bf0003e10 0x7f9bf0004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:38.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c14aaf700 1 -- 172.21.2.105:0/3258822739 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf0003260 con 0x7f9bf0004b10 2021-11-12T05:49:38.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c0f7fe700 1 --2- 172.21.2.105:0/3258822739 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9bf0003e10 0x7f9bf0004500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:49:38.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c14aaf700 1 --2- 172.21.2.105:0/3258822739 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9bf0004b10 0x7f9bf0004f90 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 rx=0x7f9c100b6060 tx=0x7f9c100aeb90).ready entity=mon.0 client_cookie=ba891c4a151fde9 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:38.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c0effd700 1 -- 172.21.2.105:0/3258822739 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c0800cc30 con 0x7f9bf0004b10 2021-11-12T05:49:38.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c0effd700 1 -- 172.21.2.105:0/3258822739 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0800cd90 con 0x7f9bf0004b10 2021-11-12T05:49:38.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c0effd700 1 -- 172.21.2.105:0/3258822739 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c08005b80 con 0x7f9bf0004b10 2021-11-12T05:49:38.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c16512700 1 -- 172.21.2.105:0/3258822739 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9bf0004b10 msgr2=0x7f9bf0004f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:38.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c16512700 1 --2- 172.21.2.105:0/3258822739 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9bf0004b10 0x7f9bf0004f90 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 rx=0x7f9c100b6060 tx=0x7f9c100aeb90).stop 2021-11-12T05:49:38.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c14aaf700 1 -- 172.21.2.105:0/3258822739 reap_dead start 2021-11-12T05:49:38.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c16512700 1 -- 172.21.2.105:0/3258822739 shutdown_connections 2021-11-12T05:49:38.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c16512700 1 -- 172.21.2.105:0/3258822739 >> 172.21.2.105:0/3258822739 conn(0x7f9c100b5370 msgr2=0x7f9c100b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:38.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c16512700 1 -- 172.21.2.105:0/3258822739 shutdown_connections 2021-11-12T05:49:38.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c16512700 1 -- 172.21.2.105:0/3258822739 wait complete. 2021-11-12T05:49:38.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c16512700 1 Processor -- start 2021-11-12T05:49:38.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c16512700 1 -- start start 2021-11-12T05:49:38.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c16512700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9bf0004b10 0x7f9c101479c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:38.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c16512700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9c100a9540 0x7f9c100aa260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:38.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c16512700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9c101571b0 0x7f9c100aace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:38.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c16512700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c10062540 con 0x7f9bf0004b10 2021-11-12T05:49:38.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.672+0000 7f9c16512700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c101433c0 con 0x7f9c100a9540 2021-11-12T05:49:38.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.676+0000 7f9c16512700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1015ad70 con 0x7f9c101571b0 2021-11-12T05:49:38.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.676+0000 7f9c0ffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9bf0004b10 0x7f9c101479c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:38.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.676+0000 7f9c0ffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9bf0004b10 0x7f9c101479c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52238/0 (socket says 172.21.2.105:52238) 2021-11-12T05:49:38.692 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.676+0000 7f9c0ffff700 1 -- 172.21.2.105:0/3031773841 learned_addr learned my addr 172.21.2.105:0/3031773841 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:38.692 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.676+0000 7f9c0ffff700 1 -- 172.21.2.105:0/3031773841 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9c101571b0 msgr2=0x7f9c100aace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:38.692 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.676+0000 7f9c0ffff700 1 --2- 172.21.2.105:0/3031773841 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9c101571b0 0x7f9c100aace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:38.692 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.676+0000 7f9c0ffff700 1 -- 172.21.2.105:0/3031773841 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9c100a9540 msgr2=0x7f9c100aa260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:38.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.676+0000 7f9c0ffff700 1 --2- 172.21.2.105:0/3031773841 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9c100a9540 0x7f9c100aa260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:38.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.676+0000 7f9c0ffff700 1 -- 172.21.2.105:0/3031773841 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c10156a70 con 0x7f9bf0004b10 2021-11-12T05:49:38.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.676+0000 7f9c0ffff700 1 --2- 172.21.2.105:0/3031773841 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9bf0004b10 0x7f9c101479c0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 rx=0x7f9c00008000 tx=0x7f9c00009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:38.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.676+0000 7f9c0d7fa700 1 -- 172.21.2.105:0/3031773841 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c00007e60 con 0x7f9bf0004b10 2021-11-12T05:49:38.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.676+0000 7f9c0d7fa700 1 -- 172.21.2.105:0/3031773841 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c00000e90 con 0x7f9bf0004b10 2021-11-12T05:49:38.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.676+0000 7f9c0d7fa700 1 -- 172.21.2.105:0/3031773841 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c000106d0 con 0x7f9bf0004b10 2021-11-12T05:49:38.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.676+0000 7f9c16512700 1 -- 172.21.2.105:0/3031773841 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c10156d10 con 0x7f9bf0004b10 2021-11-12T05:49:38.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.676+0000 7f9c16512700 1 -- 172.21.2.105:0/3031773841 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c100aa750 con 0x7f9bf0004b10 2021-11-12T05:49:38.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.676+0000 7f9c16512700 1 -- 172.21.2.105:0/3031773841 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c10156ea0 con 0x7f9bf0004b10 2021-11-12T05:49:38.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.676+0000 7f9c0d7fa700 1 -- 172.21.2.105:0/3031773841 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9c00010830 con 0x7f9bf0004b10 2021-11-12T05:49:38.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.676+0000 7f9c0d7fa700 1 --2- 172.21.2.105:0/3031773841 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9bf40536f0 0x7f9bf4055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:38.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.676+0000 7f9c0d7fa700 1 -- 172.21.2.105:0/3031773841 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f9c0006b7e0 con 0x7f9bf0004b10 2021-11-12T05:49:38.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.676+0000 7f9c0f7fe700 1 --2- 172.21.2.105:0/3031773841 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9bf40536f0 0x7f9bf4055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:38.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.676+0000 7f9c0f7fe700 1 --2- 172.21.2.105:0/3031773841 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9bf40536f0 0x7f9bf4055bb0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f9bf8008000 tx=0x7f9bf8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:38.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.680+0000 7f9c0d7fa700 1 -- 172.21.2.105:0/3031773841 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9c000426e0 con 0x7f9bf0004b10 2021-11-12T05:49:38.766 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.760+0000 7f9c16512700 1 -- 172.21.2.105:0/3031773841 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c10057350 con 0x7f9bf0004b10 2021-11-12T05:49:38.767 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.764+0000 7f9c0d7fa700 1 -- 172.21.2.105:0/3031773841 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f9c00045d00 con 0x7f9bf0004b10 2021-11-12T05:49:38.768 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:38.768 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":146,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:49:38.427121+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:49:35.238196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-11-12T05:49:36.389415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:49:38.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.764+0000 7f9c16512700 1 -- 172.21.2.105:0/3031773841 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9bf40536f0 msgr2=0x7f9bf4055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:38.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.764+0000 7f9c16512700 1 --2- 172.21.2.105:0/3031773841 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9bf40536f0 0x7f9bf4055bb0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f9bf8008000 tx=0x7f9bf8008040).stop 2021-11-12T05:49:38.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.764+0000 7f9c16512700 1 -- 172.21.2.105:0/3031773841 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9bf0004b10 msgr2=0x7f9c101479c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:38.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.764+0000 7f9c16512700 1 --2- 172.21.2.105:0/3031773841 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9bf0004b10 0x7f9c101479c0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 rx=0x7f9c00008000 tx=0x7f9c00009040).stop 2021-11-12T05:49:38.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.764+0000 7f9c16512700 1 -- 172.21.2.105:0/3031773841 shutdown_connections 2021-11-12T05:49:38.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.764+0000 7f9c16512700 1 --2- 172.21.2.105:0/3031773841 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9bf40536f0 0x7f9bf4055bb0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:38.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.764+0000 7f9c16512700 1 --2- 172.21.2.105:0/3031773841 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9c101571b0 0x7f9c100aace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:38.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.764+0000 7f9c16512700 1 --2- 172.21.2.105:0/3031773841 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9c100a9540 0x7f9c100aa260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:38.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.764+0000 7f9c16512700 1 --2- 172.21.2.105:0/3031773841 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9bf0004b10 0x7f9c101479c0 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:38.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.764+0000 7f9c16512700 1 -- 172.21.2.105:0/3031773841 >> 172.21.2.105:0/3031773841 conn(0x7f9c100b5370 msgr2=0x7f9c1014aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:38.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.764+0000 7f9c16512700 1 -- 172.21.2.105:0/3031773841 shutdown_connections 2021-11-12T05:49:38.772 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.764+0000 7f9c16512700 1 -- 172.21.2.105:0/3031773841 wait complete. 2021-11-12T05:49:38.775 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-12T05:49:38.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f8849ccf700 1 Processor -- start 2021-11-12T05:49:38.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f8849ccf700 1 -- start start 2021-11-12T05:49:38.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f8849ccf700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f88440ac280 0x7f884414b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:38.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f8849ccf700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f88440af730 0x7f88440ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:38.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f8849ccf700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88440ac7b0 con 0x7f88440ad080 2021-11-12T05:49:38.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f8849ccf700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88441488a0 con 0x7f88440af730 2021-11-12T05:49:38.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f8849ccf700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88440ac9e0 con 0x7f88440ac280 2021-11-12T05:49:38.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f88437fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f88440ad080 0x7f884414abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34408/0 (socket says 172.21.2.105:34408) 2021-11-12T05:49:38.839 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f88437fe700 1 -- 172.21.2.105:0/650511595 learned_addr learned my addr 172.21.2.105:0/650511595 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:38.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f88427fc700 1 -- 172.21.2.105:0/650511595 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1684397548 0 0) 0x7f88440ac7b0 con 0x7f88440ad080 2021-11-12T05:49:38.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f88427fc700 1 -- 172.21.2.105:0/650511595 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8824003260 con 0x7f88440ad080 2021-11-12T05:49:38.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f8843fff700 1 --2- 172.21.2.105:0/650511595 >> v2:172.21.2.115:3300/0 conn(0x7f88440af730 0x7f88440ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:38.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f88427fc700 1 -- 172.21.2.105:0/650511595 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3756313089 0 0) 0x7f8824003260 con 0x7f88440ad080 2021-11-12T05:49:38.840 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f8842ffd700 1 --2- 172.21.2.105:0/650511595 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f88440ac280 0x7f884414b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:38.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f88427fc700 1 -- 172.21.2.105:0/650511595 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f88440ac280 msgr2=0x7f884414b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:38.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f88427fc700 1 --2- 172.21.2.105:0/650511595 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f88440ac280 0x7f884414b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:38.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f88427fc700 1 -- 172.21.2.105:0/650511595 >> v2:172.21.2.115:3300/0 conn(0x7f88440af730 msgr2=0x7f88440ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:38.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f88427fc700 1 --2- 172.21.2.105:0/650511595 >> v2:172.21.2.115:3300/0 conn(0x7f88440af730 0x7f88440ad460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:38.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f88427fc700 1 -- 172.21.2.105:0/650511595 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88440b0b30 con 0x7f88440ad080 2021-11-12T05:49:38.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f88427fc700 1 -- 172.21.2.105:0/650511595 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f882c001680 con 0x7f88440ad080 2021-11-12T05:49:38.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f88427fc700 1 -- 172.21.2.105:0/650511595 >> v1:172.21.2.105:6789/0 conn(0x7f88440ad080 legacy=0x7f884414abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:38.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f88427fc700 1 --2- 172.21.2.105:0/650511595 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f88240037d0 0x7f8824003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:38.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f88427fc700 1 --2- 172.21.2.105:0/650511595 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8824004500 0x7f8824004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:38.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f88427fc700 1 --2- 172.21.2.105:0/650511595 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f88440ac280 0x7f882400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:38.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f88427fc700 1 -- 172.21.2.105:0/650511595 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88441488a0 con 0x7f8824004500 2021-11-12T05:49:38.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f88427fc700 1 -- 172.21.2.105:0/650511595 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88440ac9e0 con 0x7f88240037d0 2021-11-12T05:49:38.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f88427fc700 1 -- 172.21.2.105:0/650511595 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8824005300 con 0x7f88440ac280 2021-11-12T05:49:38.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f8843fff700 1 --2- 172.21.2.105:0/650511595 >> v2:172.21.2.115:3300/0 conn(0x7f88440af730 0x7f88440ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:49:38.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f8842ffd700 1 --2- 172.21.2.105:0/650511595 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8824004500 0x7f8824004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:38.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f88437fe700 1 --2- 172.21.2.105:0/650511595 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f88240037d0 0x7f8824003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:38.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f8842ffd700 1 -- 172.21.2.105:0/650511595 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f88440ac280 msgr2=0x7f882400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:38.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f8842ffd700 1 --2- 172.21.2.105:0/650511595 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f88440ac280 0x7f882400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:38.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f8842ffd700 1 -- 172.21.2.105:0/650511595 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f88240037d0 msgr2=0x7f8824003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:38.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f8842ffd700 1 --2- 172.21.2.105:0/650511595 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f88240037d0 0x7f8824003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:38.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f8842ffd700 1 -- 172.21.2.105:0/650511595 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8824003260 con 0x7f8824004500 2021-11-12T05:49:38.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f8842ffd700 1 --2- 172.21.2.105:0/650511595 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8824004500 0x7f8824004980 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 rx=0x7f8834007000 tx=0x7f8834008040).ready entity=mon.0 client_cookie=2c5675a10f301451 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:38.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f88427fc700 1 -- 172.21.2.105:0/650511595 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8834012470 con 0x7f8824004500 2021-11-12T05:49:38.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f88427fc700 1 -- 172.21.2.105:0/650511595 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883400c030 con 0x7f8824004500 2021-11-12T05:49:38.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f88427fc700 1 -- 172.21.2.105:0/650511595 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88340127c0 con 0x7f8824004500 2021-11-12T05:49:38.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f8849ccf700 1 -- 172.21.2.105:0/650511595 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8824004500 msgr2=0x7f8824004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:38.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f8849ccf700 1 --2- 172.21.2.105:0/650511595 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8824004500 0x7f8824004980 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 rx=0x7f8834007000 tx=0x7f8834008040).stop 2021-11-12T05:49:38.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f8843fff700 1 -- 172.21.2.105:0/650511595 reap_dead start 2021-11-12T05:49:38.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f8849ccf700 1 -- 172.21.2.105:0/650511595 shutdown_connections 2021-11-12T05:49:38.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f8849ccf700 1 -- 172.21.2.105:0/650511595 >> 172.21.2.105:0/650511595 conn(0x7f88440b5370 msgr2=0x7f88440b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:38.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f8849ccf700 1 -- 172.21.2.105:0/650511595 shutdown_connections 2021-11-12T05:49:38.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.828+0000 7f8849ccf700 1 -- 172.21.2.105:0/650511595 wait complete. 2021-11-12T05:49:38.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.832+0000 7f8849ccf700 1 Processor -- start 2021-11-12T05:49:38.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.832+0000 7f8849ccf700 1 -- start start 2021-11-12T05:49:38.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.832+0000 7f8849ccf700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8824004500 0x7f88440aa760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:38.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.832+0000 7f8849ccf700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f88440abb80 0x7f88440626f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:38.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.832+0000 7f8849ccf700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f88440aaf90 0x7f8844156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:38.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.832+0000 7f8849ccf700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8844062ed0 con 0x7f8824004500 2021-11-12T05:49:38.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.832+0000 7f8849ccf700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8844065100 con 0x7f88440abb80 2021-11-12T05:49:38.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.832+0000 7f8849ccf700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88440aac50 con 0x7f88440aaf90 2021-11-12T05:49:38.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.832+0000 7f88437fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8824004500 0x7f88440aa760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:38.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.832+0000 7f88437fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8824004500 0x7f88440aa760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52258/0 (socket says 172.21.2.105:52258) 2021-11-12T05:49:38.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.832+0000 7f88437fe700 1 -- 172.21.2.105:0/139079639 learned_addr learned my addr 172.21.2.105:0/139079639 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:38.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.832+0000 7f88437fe700 1 -- 172.21.2.105:0/139079639 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f88440aaf90 msgr2=0x7f8844156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:38.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.832+0000 7f88437fe700 1 --2- 172.21.2.105:0/139079639 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f88440aaf90 0x7f8844156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:38.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.832+0000 7f88437fe700 1 -- 172.21.2.105:0/139079639 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f88440abb80 msgr2=0x7f88440626f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:38.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.832+0000 7f88437fe700 1 --2- 172.21.2.105:0/139079639 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f88440abb80 0x7f88440626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:38.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.832+0000 7f88437fe700 1 -- 172.21.2.105:0/139079639 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8844064e10 con 0x7f8824004500 2021-11-12T05:49:38.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.832+0000 7f88437fe700 1 --2- 172.21.2.105:0/139079639 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8824004500 0x7f88440aa760 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 rx=0x7f882c00b000 tx=0x7f88440aeb90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:38.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.832+0000 7f8840ff9700 1 -- 172.21.2.105:0/139079639 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f882c010710 con 0x7f8824004500 2021-11-12T05:49:38.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.832+0000 7f8840ff9700 1 -- 172.21.2.105:0/139079639 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882c010870 con 0x7f8824004500 2021-11-12T05:49:38.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.832+0000 7f8849ccf700 1 -- 172.21.2.105:0/139079639 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8844062be0 con 0x7f8824004500 2021-11-12T05:49:38.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.832+0000 7f8849ccf700 1 -- 172.21.2.105:0/139079639 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8844157130 con 0x7f8824004500 2021-11-12T05:49:38.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.832+0000 7f8840ff9700 1 -- 172.21.2.105:0/139079639 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f882c010bd0 con 0x7f8824004500 2021-11-12T05:49:38.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.832+0000 7f8849ccf700 1 -- 172.21.2.105:0/139079639 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88440652c0 con 0x7f8824004500 2021-11-12T05:49:38.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.832+0000 7f8840ff9700 1 -- 172.21.2.105:0/139079639 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f882c010d30 con 0x7f8824004500 2021-11-12T05:49:38.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.832+0000 7f8840ff9700 1 --2- 172.21.2.105:0/139079639 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f88280536f0 0x7f8828055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:38.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.832+0000 7f8840ff9700 1 -- 172.21.2.105:0/139079639 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f882c06c0d0 con 0x7f8824004500 2021-11-12T05:49:38.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.832+0000 7f8842ffd700 1 --2- 172.21.2.105:0/139079639 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f88280536f0 0x7f8828055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:38.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.832+0000 7f8842ffd700 1 --2- 172.21.2.105:0/139079639 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f88280536f0 0x7f8828055bb0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f8834007000 tx=0x7f8834008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:38.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.836+0000 7f8840ff9700 1 -- 172.21.2.105:0/139079639 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f882c042fd0 con 0x7f8824004500 2021-11-12T05:49:38.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.948+0000 7f8849ccf700 1 -- 172.21.2.105:0/139079639 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f88440b1440 con 0x7f8824004500 2021-11-12T05:49:38.956 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.952+0000 7f8840ff9700 1 -- 172.21.2.105:0/139079639 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v44) v1 ==== 184+0+0 (secure 0 0 0) 0x7f882c0465f0 con 0x7f8824004500 2021-11-12T05:49:38.958 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.952+0000 7f8849ccf700 1 -- 172.21.2.105:0/139079639 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f88280536f0 msgr2=0x7f8828055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:38.958 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.952+0000 7f8849ccf700 1 --2- 172.21.2.105:0/139079639 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f88280536f0 0x7f8828055bb0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f8834007000 tx=0x7f8834008040).stop 2021-11-12T05:49:38.958 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.952+0000 7f8849ccf700 1 -- 172.21.2.105:0/139079639 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8824004500 msgr2=0x7f88440aa760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:38.959 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.952+0000 7f8849ccf700 1 --2- 172.21.2.105:0/139079639 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8824004500 0x7f88440aa760 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 rx=0x7f882c00b000 tx=0x7f88440aeb90).stop 2021-11-12T05:49:38.959 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.952+0000 7f8849ccf700 1 -- 172.21.2.105:0/139079639 shutdown_connections 2021-11-12T05:49:38.959 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.952+0000 7f8849ccf700 1 --2- 172.21.2.105:0/139079639 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f88280536f0 0x7f8828055bb0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:38.959 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.952+0000 7f8849ccf700 1 --2- 172.21.2.105:0/139079639 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f88440aaf90 0x7f8844156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:38.960 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.952+0000 7f8849ccf700 1 --2- 172.21.2.105:0/139079639 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f88440abb80 0x7f88440626f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:38.960 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.952+0000 7f8849ccf700 1 --2- 172.21.2.105:0/139079639 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8824004500 0x7f88440aa760 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:38.960 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.952+0000 7f8849ccf700 1 -- 172.21.2.105:0/139079639 >> 172.21.2.105:0/139079639 conn(0x7f88440b5370 msgr2=0x7f884414aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:38.960 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.952+0000 7f8849ccf700 1 -- 172.21.2.105:0/139079639 shutdown_connections 2021-11-12T05:49:38.961 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:38.952+0000 7f8849ccf700 1 -- 172.21.2.105:0/139079639 wait complete. 2021-11-12T05:49:38.961 INFO:teuthology.orchestra.run.gibba005.stderr:updated caps for client.0 2021-11-12T05:49:38.965 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-12T05:49:39.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.016+0000 7f4dd18af700 1 Processor -- start 2021-11-12T05:49:39.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.016+0000 7f4dd18af700 1 -- start start 2021-11-12T05:49:39.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.016+0000 7f4dd18af700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f4dcc0b0780 0x7f4dcc1434d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:39.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.016+0000 7f4dd18af700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4dcc0b0cc0 0x7f4dcc05f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:39.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.016+0000 7f4dd18af700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dcc0b2d20 con 0x7f4dcc0b2940 2021-11-12T05:49:39.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.016+0000 7f4dd18af700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dcc0b1fc0 con 0x7f4dcc0b0780 2021-11-12T05:49:39.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.016+0000 7f4dd18af700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc0b15e0 con 0x7f4dcc0b0cc0 2021-11-12T05:49:39.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.016+0000 7f4dcaffd700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f4dcc0b2940 0x7f4dcc142dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34428/0 (socket says 172.21.2.105:34428) 2021-11-12T05:49:39.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.016+0000 7f4dcaffd700 1 -- 172.21.2.105:0/3441819592 learned_addr learned my addr 172.21.2.105:0/3441819592 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:39.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.016+0000 7f4dca7fc700 1 --2- 172.21.2.105:0/3441819592 >> v2:172.21.2.105:3300/0 conn(0x7f4dcc0b0780 0x7f4dcc1434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:39.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.016+0000 7f4dca7fc700 1 -- 172.21.2.105:0/3441819592 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4dcc0b0cc0 msgr2=0x7f4dcc05f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:39.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.016+0000 7f4dca7fc700 1 --2- 172.21.2.105:0/3441819592 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4dcc0b0cc0 0x7f4dcc05f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:39.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.016+0000 7f4dca7fc700 1 -- 172.21.2.105:0/3441819592 >> v1:172.21.2.105:6789/0 conn(0x7f4dcc0b2940 legacy=0x7f4dcc142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:39.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.016+0000 7f4dca7fc700 1 -- 172.21.2.105:0/3441819592 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dcc0b1880 con 0x7f4dcc0b0780 2021-11-12T05:49:39.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.016+0000 7f4dca7fc700 1 --2- 172.21.2.105:0/3441819592 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4dcc0b0780 0x7f4dcc1434d0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 rx=0x7f4db4001110 tx=0x7f4dbc007f00).ready entity=mon.0 client_cookie=8f4f304ff29f45ab server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:39.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.016+0000 7f4dc9ffb700 1 -- 172.21.2.105:0/3441819592 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dbc010510 con 0x7f4dcc0b0780 2021-11-12T05:49:39.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.016+0000 7f4dc9ffb700 1 -- 172.21.2.105:0/3441819592 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dbc000e90 con 0x7f4dcc0b0780 2021-11-12T05:49:39.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.016+0000 7f4dc9ffb700 1 -- 172.21.2.105:0/3441819592 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dbc010670 con 0x7f4dcc0b0780 2021-11-12T05:49:39.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.016+0000 7f4dd18af700 1 -- 172.21.2.105:0/3441819592 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4dcc0b0780 msgr2=0x7f4dcc1434d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:39.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.016+0000 7f4dd18af700 1 --2- 172.21.2.105:0/3441819592 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4dcc0b0780 0x7f4dcc1434d0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 rx=0x7f4db4001110 tx=0x7f4dbc007f00).stop 2021-11-12T05:49:39.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.016+0000 7f4dd18af700 1 -- 172.21.2.105:0/3441819592 shutdown_connections 2021-11-12T05:49:39.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.016+0000 7f4dd18af700 1 --2- 172.21.2.105:0/3441819592 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4dcc0b0cc0 0x7f4dcc05f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:39.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.016+0000 7f4dd18af700 1 --2- 172.21.2.105:0/3441819592 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4dcc0b0780 0x7f4dcc1434d0 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:39.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.016+0000 7f4dd18af700 1 -- 172.21.2.105:0/3441819592 >> 172.21.2.105:0/3441819592 conn(0x7f4dcc068440 msgr2=0x7f4dcc062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:39.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.016+0000 7f4dd18af700 1 -- 172.21.2.105:0/3441819592 shutdown_connections 2021-11-12T05:49:39.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.016+0000 7f4dd18af700 1 -- 172.21.2.105:0/3441819592 wait complete. 2021-11-12T05:49:39.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.016+0000 7f4dd18af700 1 Processor -- start 2021-11-12T05:49:39.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.016+0000 7f4dd18af700 1 -- start start 2021-11-12T05:49:39.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.016+0000 7f4dd18af700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4dcc0b0780 0x7f4dcc0653d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:39.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.016+0000 7f4dd18af700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4dcc0b0cc0 0x7f4dcc1452c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:39.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.016+0000 7f4dd18af700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4dcc0b2940 0x7f4dcc1457b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:39.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.016+0000 7f4dd18af700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc146b30 con 0x7f4dcc0b0cc0 2021-11-12T05:49:39.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.016+0000 7f4dd18af700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc146dd0 con 0x7f4dcc0b2940 2021-11-12T05:49:39.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.016+0000 7f4dd18af700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc1423a0 con 0x7f4dcc0b0780 2021-11-12T05:49:39.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.020+0000 7f4dca7fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4dcc0b0cc0 0x7f4dcc1452c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:39.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.020+0000 7f4dca7fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4dcc0b0cc0 0x7f4dcc1452c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52270/0 (socket says 172.21.2.105:52270) 2021-11-12T05:49:39.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.020+0000 7f4dca7fc700 1 -- 172.21.2.105:0/465372332 learned_addr learned my addr 172.21.2.105:0/465372332 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:39.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.020+0000 7f4dcb7fe700 1 --2- 172.21.2.105:0/465372332 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4dcc0b2940 0x7f4dcc1457b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:39.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.020+0000 7f4dcaffd700 1 --2- 172.21.2.105:0/465372332 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4dcc0b0780 0x7f4dcc0653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:39.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.020+0000 7f4dca7fc700 1 -- 172.21.2.105:0/465372332 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4dcc0b0780 msgr2=0x7f4dcc0653d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:39.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.020+0000 7f4dca7fc700 1 --2- 172.21.2.105:0/465372332 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4dcc0b0780 0x7f4dcc0653d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:39.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.020+0000 7f4dca7fc700 1 -- 172.21.2.105:0/465372332 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4dcc0b2940 msgr2=0x7f4dcc1457b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:39.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.020+0000 7f4dca7fc700 1 --2- 172.21.2.105:0/465372332 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4dcc0b2940 0x7f4dcc1457b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:39.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.020+0000 7f4dca7fc700 1 -- 172.21.2.105:0/465372332 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dbc00c200 con 0x7f4dcc0b0cc0 2021-11-12T05:49:39.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.020+0000 7f4dca7fc700 1 --2- 172.21.2.105:0/465372332 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4dcc0b0cc0 0x7f4dcc1452c0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 rx=0x7f4db4001110 tx=0x7f4dbc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:39.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.020+0000 7f4dc3fff700 1 -- 172.21.2.105:0/465372332 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dbc002f50 con 0x7f4dcc0b0cc0 2021-11-12T05:49:39.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.020+0000 7f4dc3fff700 1 -- 172.21.2.105:0/465372332 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dbc022440 con 0x7f4dcc0b0cc0 2021-11-12T05:49:39.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.020+0000 7f4dd18af700 1 -- 172.21.2.105:0/465372332 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dcc145ca0 con 0x7f4dcc0b0cc0 2021-11-12T05:49:39.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.020+0000 7f4dc3fff700 1 -- 172.21.2.105:0/465372332 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dbc0227a0 con 0x7f4dcc0b0cc0 2021-11-12T05:49:39.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.020+0000 7f4dd18af700 1 -- 172.21.2.105:0/465372332 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dcc143ce0 con 0x7f4dcc0b0cc0 2021-11-12T05:49:39.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.020+0000 7f4dd18af700 1 -- 172.21.2.105:0/465372332 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dcc0b1b20 con 0x7f4dcc0b0cc0 2021-11-12T05:49:39.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.020+0000 7f4dc3fff700 1 -- 172.21.2.105:0/465372332 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4dbc028020 con 0x7f4dcc0b0cc0 2021-11-12T05:49:39.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.020+0000 7f4dc3fff700 1 --2- 172.21.2.105:0/465372332 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4db0053580 0x7f4db0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:39.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.020+0000 7f4dc3fff700 1 -- 172.21.2.105:0/465372332 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f4dbc06dae0 con 0x7f4dcc0b0cc0 2021-11-12T05:49:39.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.020+0000 7f4dcaffd700 1 --2- 172.21.2.105:0/465372332 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4db0053580 0x7f4db0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:39.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.020+0000 7f4dcaffd700 1 --2- 172.21.2.105:0/465372332 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4db0053580 0x7f4db0055a40 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f4db400b000 tx=0x7f4db4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:39.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.024+0000 7f4dc3fff700 1 -- 172.21.2.105:0/465372332 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4dbc044af0 con 0x7f4dcc0b0cc0 2021-11-12T05:49:39.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.132+0000 7f4dd18af700 1 -- 172.21.2.105:0/465372332 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f4dcc057350 con 0x7f4dcc0b0cc0 2021-11-12T05:49:39.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.140+0000 7f4dc3fff700 1 -- 172.21.2.105:0/465372332 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v45) v1 ==== 184+0+0 (secure 0 0 0) 0x7f4dbc016020 con 0x7f4dcc0b0cc0 2021-11-12T05:49:39.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.140+0000 7f4dd18af700 1 -- 172.21.2.105:0/465372332 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4db0053580 msgr2=0x7f4db0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:39.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.140+0000 7f4dd18af700 1 --2- 172.21.2.105:0/465372332 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4db0053580 0x7f4db0055a40 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f4db400b000 tx=0x7f4db4009040).stop 2021-11-12T05:49:39.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.140+0000 7f4dd18af700 1 -- 172.21.2.105:0/465372332 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4dcc0b0cc0 msgr2=0x7f4dcc1452c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:39.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.140+0000 7f4dd18af700 1 --2- 172.21.2.105:0/465372332 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4dcc0b0cc0 0x7f4dcc1452c0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 rx=0x7f4db4001110 tx=0x7f4dbc017000).stop 2021-11-12T05:49:39.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.140+0000 7f4dd18af700 1 -- 172.21.2.105:0/465372332 shutdown_connections 2021-11-12T05:49:39.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.140+0000 7f4dd18af700 1 --2- 172.21.2.105:0/465372332 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4db0053580 0x7f4db0055a40 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:39.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.140+0000 7f4dd18af700 1 --2- 172.21.2.105:0/465372332 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4dcc0b2940 0x7f4dcc1457b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:39.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.140+0000 7f4dd18af700 1 --2- 172.21.2.105:0/465372332 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4dcc0b0cc0 0x7f4dcc1452c0 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:39.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.140+0000 7f4dd18af700 1 --2- 172.21.2.105:0/465372332 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4dcc0b0780 0x7f4dcc0653d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:39.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.140+0000 7f4dd18af700 1 -- 172.21.2.105:0/465372332 >> 172.21.2.105:0/465372332 conn(0x7f4dcc068440 msgr2=0x7f4dcc0b4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:39.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.140+0000 7f4dd18af700 1 -- 172.21.2.105:0/465372332 shutdown_connections 2021-11-12T05:49:39.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.140+0000 7f4dd18af700 1 -- 172.21.2.105:0/465372332 wait complete. 2021-11-12T05:49:39.147 INFO:teuthology.orchestra.run.gibba005.stderr:updated caps for client.1 2021-11-12T05:49:39.151 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-12T05:49:39.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.204+0000 7fe161f6f700 1 Processor -- start 2021-11-12T05:49:39.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.204+0000 7fe161f6f700 1 -- start start 2021-11-12T05:49:39.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.204+0000 7fe161f6f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe15c0ad080 0x7fe15c0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:39.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.204+0000 7fe161f6f700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe15c0ac280 0x7fe15c0ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:39.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.204+0000 7fe161f6f700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe15c0ac7b0 con 0x7fe15c14abe0 2021-11-12T05:49:39.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.204+0000 7fe161f6f700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe15c1488a0 con 0x7fe15c0ac280 2021-11-12T05:49:39.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.204+0000 7fe161f6f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c0ac9e0 con 0x7fe15c0ad080 2021-11-12T05:49:39.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.204+0000 7fe15affd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe15c0ac280 0x7fe15c0ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:39.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.204+0000 7fe15affd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe15c0ac280 0x7fe15c0ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52280/0 (socket says 172.21.2.105:52280) 2021-11-12T05:49:39.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.204+0000 7fe15affd700 1 -- 172.21.2.105:0/1467159054 learned_addr learned my addr 172.21.2.105:0/1467159054 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:39.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.204+0000 7fe15affd700 1 -- 172.21.2.105:0/1467159054 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe15c0ad080 msgr2=0x7fe15c0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:39.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.204+0000 7fe15affd700 1 --2- 172.21.2.105:0/1467159054 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe15c0ad080 0x7fe15c0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:39.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.204+0000 7fe15affd700 1 -- 172.21.2.105:0/1467159054 >> v1:172.21.2.115:6789/0 conn(0x7fe15c14abe0 legacy=0x7fe15c14b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:39.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.204+0000 7fe15affd700 1 -- 172.21.2.105:0/1467159054 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe15c0b0b30 con 0x7fe15c0ac280 2021-11-12T05:49:39.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.204+0000 7fe15affd700 1 --2- 172.21.2.105:0/1467159054 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe15c0ac280 0x7fe15c0ad460 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 rx=0x7fe15c0b6060 tx=0x7fe14c006eb0).ready entity=mon.0 client_cookie=95eaac86ec215958 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:39.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.204+0000 7fe15a7fc700 1 -- 172.21.2.105:0/1467159054 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe14c00d570 con 0x7fe15c0ac280 2021-11-12T05:49:39.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.204+0000 7fe15a7fc700 1 -- 172.21.2.105:0/1467159054 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14c000e90 con 0x7fe15c0ac280 2021-11-12T05:49:39.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.204+0000 7fe15a7fc700 1 -- 172.21.2.105:0/1467159054 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe14c00d8c0 con 0x7fe15c0ac280 2021-11-12T05:49:39.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.208+0000 7fe161f6f700 1 -- 172.21.2.105:0/1467159054 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe15c0ac280 msgr2=0x7fe15c0ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:39.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.208+0000 7fe161f6f700 1 --2- 172.21.2.105:0/1467159054 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe15c0ac280 0x7fe15c0ad460 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 rx=0x7fe15c0b6060 tx=0x7fe14c006eb0).stop 2021-11-12T05:49:39.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.208+0000 7fe161f6f700 1 -- 172.21.2.105:0/1467159054 shutdown_connections 2021-11-12T05:49:39.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.208+0000 7fe161f6f700 1 --2- 172.21.2.105:0/1467159054 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe15c0ac280 0x7fe15c0ad460 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:39.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.208+0000 7fe161f6f700 1 --2- 172.21.2.105:0/1467159054 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe15c0ad080 0x7fe15c0af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:39.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.208+0000 7fe161f6f700 1 -- 172.21.2.105:0/1467159054 >> 172.21.2.105:0/1467159054 conn(0x7fe15c0b5370 msgr2=0x7fe15c0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:39.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.208+0000 7fe161f6f700 1 -- 172.21.2.105:0/1467159054 shutdown_connections 2021-11-12T05:49:39.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.208+0000 7fe161f6f700 1 -- 172.21.2.105:0/1467159054 wait complete. 2021-11-12T05:49:39.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.208+0000 7fe161f6f700 1 Processor -- start 2021-11-12T05:49:39.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.208+0000 7fe161f6f700 1 -- start start 2021-11-12T05:49:39.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.208+0000 7fe161f6f700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe15c0ac280 0x7fe15c0ab400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:39.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.208+0000 7fe161f6f700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe15c0ad080 0x7fe15c0ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:39.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.208+0000 7fe161f6f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe15c14abe0 0x7fe15c156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:39.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.208+0000 7fe161f6f700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c0aa920 con 0x7fe15c0ad080 2021-11-12T05:49:39.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.208+0000 7fe161f6f700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c063eb0 con 0x7fe15c0ac280 2021-11-12T05:49:39.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.208+0000 7fe161f6f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c064150 con 0x7fe15c14abe0 2021-11-12T05:49:39.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.208+0000 7fe15affd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe15c0ad080 0x7fe15c0ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:39.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.208+0000 7fe15affd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe15c0ad080 0x7fe15c0ab8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52282/0 (socket says 172.21.2.105:52282) 2021-11-12T05:49:39.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.208+0000 7fe15affd700 1 -- 172.21.2.105:0/2963517589 learned_addr learned my addr 172.21.2.105:0/2963517589 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:39.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.208+0000 7fe15affd700 1 -- 172.21.2.105:0/2963517589 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe15c14abe0 msgr2=0x7fe15c156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:39.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.208+0000 7fe15affd700 1 --2- 172.21.2.105:0/2963517589 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe15c14abe0 0x7fe15c156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:39.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.208+0000 7fe15affd700 1 -- 172.21.2.105:0/2963517589 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe15c0ac280 msgr2=0x7fe15c0ab400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:39.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.208+0000 7fe15affd700 1 --2- 172.21.2.105:0/2963517589 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe15c0ac280 0x7fe15c0ab400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:39.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.208+0000 7fe15affd700 1 -- 172.21.2.105:0/2963517589 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14c00b1e0 con 0x7fe15c0ad080 2021-11-12T05:49:39.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.208+0000 7fe15affd700 1 --2- 172.21.2.105:0/2963517589 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe15c0ad080 0x7fe15c0ab8f0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 rx=0x7fe15c0b6060 tx=0x7fe14c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:39.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.208+0000 7fe158ff9700 1 -- 172.21.2.105:0/2963517589 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe14c006b80 con 0x7fe15c0ad080 2021-11-12T05:49:39.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.208+0000 7fe158ff9700 1 -- 172.21.2.105:0/2963517589 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14c00d8f0 con 0x7fe15c0ad080 2021-11-12T05:49:39.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.208+0000 7fe158ff9700 1 -- 172.21.2.105:0/2963517589 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe14c01e460 con 0x7fe15c0ad080 2021-11-12T05:49:39.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.208+0000 7fe161f6f700 1 -- 172.21.2.105:0/2963517589 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe15c0a9e40 con 0x7fe15c0ad080 2021-11-12T05:49:39.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.208+0000 7fe161f6f700 1 -- 172.21.2.105:0/2963517589 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe15c0a9500 con 0x7fe15c0ad080 2021-11-12T05:49:39.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.208+0000 7fe161f6f700 1 -- 172.21.2.105:0/2963517589 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe15c0aaa60 con 0x7fe15c0ad080 2021-11-12T05:49:39.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.208+0000 7fe158ff9700 1 -- 172.21.2.105:0/2963517589 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe14c025030 con 0x7fe15c0ad080 2021-11-12T05:49:39.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.208+0000 7fe158ff9700 1 --2- 172.21.2.105:0/2963517589 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe1400536f0 0x7fe140055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:39.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.208+0000 7fe158ff9700 1 -- 172.21.2.105:0/2963517589 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fe14c06cf40 con 0x7fe15c0ad080 2021-11-12T05:49:39.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.208+0000 7fe15b7fe700 1 --2- 172.21.2.105:0/2963517589 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe1400536f0 0x7fe140055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:39.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.208+0000 7fe15b7fe700 1 --2- 172.21.2.105:0/2963517589 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe1400536f0 0x7fe140055bb0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7fe144002f70 tx=0x7fe144006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:39.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.212+0000 7fe158ff9700 1 -- 172.21.2.105:0/2963517589 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe14c043e40 con 0x7fe15c0ad080 2021-11-12T05:49:39.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.324+0000 7fe161f6f700 1 -- 172.21.2.105:0/2963517589 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fe15c0b1440 con 0x7fe15c0ad080 2021-11-12T05:49:39.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.328+0000 7fe158ff9700 1 -- 172.21.2.105:0/2963517589 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v46) v1 ==== 184+0+0 (secure 0 0 0) 0x7fe14c0230e0 con 0x7fe15c0ad080 2021-11-12T05:49:39.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.328+0000 7fe161f6f700 1 -- 172.21.2.105:0/2963517589 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe1400536f0 msgr2=0x7fe140055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:39.336 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.328+0000 7fe161f6f700 1 --2- 172.21.2.105:0/2963517589 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe1400536f0 0x7fe140055bb0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7fe144002f70 tx=0x7fe144006a80).stop 2021-11-12T05:49:39.336 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.328+0000 7fe161f6f700 1 -- 172.21.2.105:0/2963517589 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe15c0ad080 msgr2=0x7fe15c0ab8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:39.336 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.328+0000 7fe161f6f700 1 --2- 172.21.2.105:0/2963517589 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe15c0ad080 0x7fe15c0ab8f0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 rx=0x7fe15c0b6060 tx=0x7fe14c015000).stop 2021-11-12T05:49:39.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.328+0000 7fe161f6f700 1 -- 172.21.2.105:0/2963517589 shutdown_connections 2021-11-12T05:49:39.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.328+0000 7fe161f6f700 1 --2- 172.21.2.105:0/2963517589 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe1400536f0 0x7fe140055bb0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:39.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.328+0000 7fe161f6f700 1 --2- 172.21.2.105:0/2963517589 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe15c14abe0 0x7fe15c156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:39.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.328+0000 7fe161f6f700 1 --2- 172.21.2.105:0/2963517589 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe15c0ad080 0x7fe15c0ab8f0 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:39.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.328+0000 7fe161f6f700 1 --2- 172.21.2.105:0/2963517589 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe15c0ac280 0x7fe15c0ab400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:39.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.328+0000 7fe161f6f700 1 -- 172.21.2.105:0/2963517589 >> 172.21.2.105:0/2963517589 conn(0x7fe15c0b5370 msgr2=0x7fe15c0ae880 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:39.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.332+0000 7fe161f6f700 1 -- 172.21.2.105:0/2963517589 shutdown_connections 2021-11-12T05:49:39.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.332+0000 7fe161f6f700 1 -- 172.21.2.105:0/2963517589 wait complete. 2021-11-12T05:49:39.338 INFO:teuthology.orchestra.run.gibba005.stderr:updated caps for client.2 2021-11-12T05:49:39.341 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:49:39.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.388+0000 7f58ac13a700 1 Processor -- start 2021-11-12T05:49:39.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.388+0000 7f58ac13a700 1 -- start start 2021-11-12T05:49:39.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.388+0000 7f58ac13a700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f58a40ac280 0x7f58a414b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:39.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.388+0000 7f58ac13a700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a40ac7b0 con 0x7f58a40ad080 2021-11-12T05:49:39.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.388+0000 7f58ac13a700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a40ac9e0 con 0x7f58a40af730 2021-11-12T05:49:39.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.388+0000 7f58ac13a700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a41488a0 con 0x7f58a40ac280 2021-11-12T05:49:39.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.388+0000 7f58a96d5700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f58a40ac280 0x7f58a414b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:39.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.388+0000 7f58a96d5700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f58a40ac280 0x7f58a414b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52292/0 (socket says 172.21.2.105:52292) 2021-11-12T05:49:39.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.388+0000 7f58a96d5700 1 -- 172.21.2.105:0/3678240977 learned_addr learned my addr 172.21.2.105:0/3678240977 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:39.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.388+0000 7f58a96d5700 1 -- 172.21.2.105:0/3678240977 >> v1:172.21.2.115:6789/0 conn(0x7f58a40af730 legacy=0x7f58a4147a60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:49:39.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.388+0000 7f58a96d5700 1 -- 172.21.2.105:0/3678240977 >> v1:172.21.2.105:6789/0 conn(0x7f58a40ad080 legacy=0x7f58a414abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:39.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.388+0000 7f58a96d5700 1 -- 172.21.2.105:0/3678240977 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a40b0b30 con 0x7f58a40ac280 2021-11-12T05:49:39.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.388+0000 7f58a96d5700 1 --2- 172.21.2.105:0/3678240977 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f58a40ac280 0x7f58a414b2f0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 rx=0x7f58a40ac6a0 tx=0x7f5898006eb0).ready entity=mon.0 client_cookie=2163e572454a4e80 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:39.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.388+0000 7f58a8ed4700 1 -- 172.21.2.105:0/3678240977 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f589800d610 con 0x7f58a40ac280 2021-11-12T05:49:39.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.388+0000 7f58a8ed4700 1 -- 172.21.2.105:0/3678240977 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5898000e90 con 0x7f58a40ac280 2021-11-12T05:49:39.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.388+0000 7f58a8ed4700 1 -- 172.21.2.105:0/3678240977 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f589800d960 con 0x7f58a40ac280 2021-11-12T05:49:39.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.388+0000 7f58ac13a700 1 -- 172.21.2.105:0/3678240977 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f58a40ac280 msgr2=0x7f58a414b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:39.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.388+0000 7f58ac13a700 1 --2- 172.21.2.105:0/3678240977 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f58a40ac280 0x7f58a414b2f0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 rx=0x7f58a40ac6a0 tx=0x7f5898006eb0).stop 2021-11-12T05:49:39.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.388+0000 7f58ac13a700 1 -- 172.21.2.105:0/3678240977 shutdown_connections 2021-11-12T05:49:39.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.388+0000 7f58ac13a700 1 --2- 172.21.2.105:0/3678240977 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f58a40ac280 0x7f58a414b2f0 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:39.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.388+0000 7f58ac13a700 1 -- 172.21.2.105:0/3678240977 >> 172.21.2.105:0/3678240977 conn(0x7f58a40b5370 msgr2=0x7f58a40b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:39.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.388+0000 7f58ac13a700 1 -- 172.21.2.105:0/3678240977 shutdown_connections 2021-11-12T05:49:39.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.388+0000 7f58ac13a700 1 -- 172.21.2.105:0/3678240977 wait complete. 2021-11-12T05:49:39.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.388+0000 7f58ac13a700 1 Processor -- start 2021-11-12T05:49:39.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.388+0000 7f58ac13a700 1 -- start start 2021-11-12T05:49:39.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.388+0000 7f58ac13a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f58a40ac280 0x7f58a4066c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:39.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.388+0000 7f58ac13a700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f58a40ad080 0x7f58a4067160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:39.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.388+0000 7f58ac13a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f58a40af730 0x7f58a41429a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:39.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.388+0000 7f58ac13a700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a4156e40 con 0x7f58a40ac280 2021-11-12T05:49:39.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.388+0000 7f58ac13a700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a40aaca0 con 0x7f58a40ad080 2021-11-12T05:49:39.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.388+0000 7f58ac13a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a40a9c70 con 0x7f58a40af730 2021-11-12T05:49:39.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.392+0000 7f58a9ed6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f58a40ac280 0x7f58a4066c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:39.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.392+0000 7f58a9ed6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f58a40ac280 0x7f58a4066c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52298/0 (socket says 172.21.2.105:52298) 2021-11-12T05:49:39.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.392+0000 7f58a9ed6700 1 -- 172.21.2.105:0/2727825719 learned_addr learned my addr 172.21.2.105:0/2727825719 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:39.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.392+0000 7f58a9ed6700 1 -- 172.21.2.105:0/2727825719 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f58a40af730 msgr2=0x7f58a41429a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:39.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.392+0000 7f58a9ed6700 1 --2- 172.21.2.105:0/2727825719 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f58a40af730 0x7f58a41429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:39.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.392+0000 7f58a9ed6700 1 -- 172.21.2.105:0/2727825719 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f58a40ad080 msgr2=0x7f58a4067160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:39.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.392+0000 7f58a9ed6700 1 --2- 172.21.2.105:0/2727825719 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f58a40ad080 0x7f58a4067160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:39.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.392+0000 7f58a9ed6700 1 -- 172.21.2.105:0/2727825719 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f589800b1e0 con 0x7f58a40ac280 2021-11-12T05:49:39.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.392+0000 7f58a9ed6700 1 --2- 172.21.2.105:0/2727825719 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f58a40ac280 0x7f58a4066c70 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 rx=0x7f58a4062f50 tx=0x7f58a0007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:39.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.392+0000 7f5896ffd700 1 -- 172.21.2.105:0/2727825719 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58a000ce20 con 0x7f58a40ac280 2021-11-12T05:49:39.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.392+0000 7f5896ffd700 1 -- 172.21.2.105:0/2727825719 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a0007240 con 0x7f58a40ac280 2021-11-12T05:49:39.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.392+0000 7f5896ffd700 1 -- 172.21.2.105:0/2727825719 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58a0006700 con 0x7f58a40ac280 2021-11-12T05:49:39.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.392+0000 7f58ac13a700 1 -- 172.21.2.105:0/2727825719 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a40a9e90 con 0x7f58a40ac280 2021-11-12T05:49:39.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.392+0000 7f58ac13a700 1 -- 172.21.2.105:0/2727825719 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a40abba0 con 0x7f58a40ac280 2021-11-12T05:49:39.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.392+0000 7f58ac13a700 1 -- 172.21.2.105:0/2727825719 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a40aa020 con 0x7f58a40ac280 2021-11-12T05:49:39.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.392+0000 7f5896ffd700 1 -- 172.21.2.105:0/2727825719 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f58a0010030 con 0x7f58a40ac280 2021-11-12T05:49:39.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.392+0000 7f5896ffd700 1 --2- 172.21.2.105:0/2727825719 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5884053610 0x7f5884055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:39.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.392+0000 7f5896ffd700 1 -- 172.21.2.105:0/2727825719 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f58a006b730 con 0x7f58a40ac280 2021-11-12T05:49:39.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.392+0000 7f58a96d5700 1 --2- 172.21.2.105:0/2727825719 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5884053610 0x7f5884055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:39.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.392+0000 7f58a96d5700 1 --2- 172.21.2.105:0/2727825719 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5884053610 0x7f5884055ad0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f58a40ac6a0 tx=0x7f5898015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:39.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.396+0000 7f5896ffd700 1 -- 172.21.2.105:0/2727825719 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f58a0042740 con 0x7f58a40ac280 2021-11-12T05:49:39.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.504+0000 7f58ac13a700 1 -- 172.21.2.105:0/2727825719 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58a40b1440 con 0x7f58a40ac280 2021-11-12T05:49:39.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.504+0000 7f5896ffd700 1 -- 172.21.2.105:0/2727825719 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f58a0045d60 con 0x7f58a40ac280 2021-11-12T05:49:39.511 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:39.511 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":69,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5066,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/506237043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":506237043},{"type":"v1","addr":"172.21.2.115:6833","nonce":506237043}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":68}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:49:37.422405+0000","modified":"2021-11-12T05:49:38.425999+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8499},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8499":{"gid":8499,"name":"a","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/3394672010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":3394672010},{"type":"v1","addr":"172.21.2.105:6835","nonce":3394672010}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-11-12T05:49:39.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.508+0000 7f58ac13a700 1 -- 172.21.2.105:0/2727825719 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5884053610 msgr2=0x7f5884055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:39.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.508+0000 7f58ac13a700 1 --2- 172.21.2.105:0/2727825719 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5884053610 0x7f5884055ad0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f58a40ac6a0 tx=0x7f5898015000).stop 2021-11-12T05:49:39.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.508+0000 7f58ac13a700 1 -- 172.21.2.105:0/2727825719 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f58a40ac280 msgr2=0x7f58a4066c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:39.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.508+0000 7f58ac13a700 1 --2- 172.21.2.105:0/2727825719 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f58a40ac280 0x7f58a4066c70 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 rx=0x7f58a4062f50 tx=0x7f58a0007c10).stop 2021-11-12T05:49:39.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.508+0000 7f58ac13a700 1 -- 172.21.2.105:0/2727825719 shutdown_connections 2021-11-12T05:49:39.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.508+0000 7f58ac13a700 1 --2- 172.21.2.105:0/2727825719 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f5884053610 0x7f5884055ad0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:39.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.508+0000 7f58ac13a700 1 --2- 172.21.2.105:0/2727825719 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f58a40af730 0x7f58a41429a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:39.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.508+0000 7f58ac13a700 1 --2- 172.21.2.105:0/2727825719 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f58a40ad080 0x7f58a4067160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:39.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.508+0000 7f58ac13a700 1 --2- 172.21.2.105:0/2727825719 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f58a40ac280 0x7f58a4066c70 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:39.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.508+0000 7f58ac13a700 1 -- 172.21.2.105:0/2727825719 >> 172.21.2.105:0/2727825719 conn(0x7f58a40b5370 msgr2=0x7f58a4146820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:39.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.508+0000 7f58ac13a700 1 -- 172.21.2.105:0/2727825719 shutdown_connections 2021-11-12T05:49:39.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.508+0000 7f58ac13a700 1 -- 172.21.2.105:0/2727825719 wait complete. 2021-11-12T05:49:39.515 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 69 2021-11-12T05:49:39.719 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 69, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:49:37.422405+0000', 'modified': '2021-11-12T05:49:38.425999+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8499}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8499': {'gid': 8499, 'name': 'a', 'rank': 0, 'incarnation': 68, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/3394672010', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 3394672010}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 3394672010}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:49:39.720 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:49:39.721 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:49:39.786 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":8499,"want_state":"up:active","state":"up:active","rank_uptime":2.3548784490000001,"mdsmap_epoch":69,"osdmap_epoch":146,"osdmap_epoch_barrier":145,"uptime":6.5498186900000004} 2021-11-12T05:49:39.787 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 8499, "mdsmap_epoch": 69, "osdmap_epoch": 146, "osdmap_epoch_barrier": 145, "rank_uptime": 2.354878449, "state": "up:active", "uptime": 6.54981869, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:49:39.788 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:49:39.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.832+0000 7fa7af806700 1 Processor -- start 2021-11-12T05:49:39.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.832+0000 7fa7af806700 1 -- start start 2021-11-12T05:49:39.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.832+0000 7fa7af806700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa7a80ad080 0x7fa7a80af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:39.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.832+0000 7fa7af806700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fa7a814b2f0 0x7fa7a80ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:39.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.832+0000 7fa7af806700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a80ac7b0 con 0x7fa7a80ac280 2021-11-12T05:49:39.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.832+0000 7fa7af806700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7a81488a0 con 0x7fa7a80ad080 2021-11-12T05:49:39.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.832+0000 7fa7af806700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7a80ac9e0 con 0x7fa7a814b2f0 2021-11-12T05:49:39.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.832+0000 7fa7ad5a2700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa7a80ad080 0x7fa7a80af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:39.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.832+0000 7fa7ad5a2700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa7a80ad080 0x7fa7a80af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52304/0 (socket says 172.21.2.105:52304) 2021-11-12T05:49:39.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.832+0000 7fa7ad5a2700 1 -- 172.21.2.105:0/374497897 learned_addr learned my addr 172.21.2.105:0/374497897 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:39.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.832+0000 7fa7acda1700 1 --1- 172.21.2.105:0/374497897 >> v1:172.21.2.105:6789/0 conn(0x7fa7a80ac280 0x7fa7a814abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34470/0 (socket says 172.21.2.105:34470) 2021-11-12T05:49:39.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.832+0000 7fa797fff700 1 -- 172.21.2.105:0/374497897 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3142565735 0 0) 0x7fa7a80ac7b0 con 0x7fa7a80ac280 2021-11-12T05:49:39.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.832+0000 7fa797fff700 1 -- 172.21.2.105:0/374497897 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa790003260 con 0x7fa7a80ac280 2021-11-12T05:49:39.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.836+0000 7fa7ad5a2700 1 -- 172.21.2.105:0/374497897 >> v2:172.21.2.115:3300/0 conn(0x7fa7a814b2f0 msgr2=0x7fa7a80ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:39.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.836+0000 7fa7ad5a2700 1 --2- 172.21.2.105:0/374497897 >> v2:172.21.2.115:3300/0 conn(0x7fa7a814b2f0 0x7fa7a80ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:39.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.836+0000 7fa7ad5a2700 1 -- 172.21.2.105:0/374497897 >> v1:172.21.2.105:6789/0 conn(0x7fa7a80ac280 legacy=0x7fa7a814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:39.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.836+0000 7fa7ad5a2700 1 -- 172.21.2.105:0/374497897 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a80b0b30 con 0x7fa7a80ad080 2021-11-12T05:49:39.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.836+0000 7fa7ad5a2700 1 --2- 172.21.2.105:0/374497897 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa7a80ad080 0x7fa7a80af730 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 rx=0x7fa798002f70 tx=0x7fa798006eb0).ready entity=mon.0 client_cookie=7087d7fd8acce373 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:39.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.836+0000 7fa797fff700 1 -- 172.21.2.105:0/374497897 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa79800d5c0 con 0x7fa7a80ad080 2021-11-12T05:49:39.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.836+0000 7fa797fff700 1 -- 172.21.2.105:0/374497897 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa798000e90 con 0x7fa7a80ad080 2021-11-12T05:49:39.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.836+0000 7fa797fff700 1 -- 172.21.2.105:0/374497897 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa79800d950 con 0x7fa7a80ad080 2021-11-12T05:49:39.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.836+0000 7fa7af806700 1 -- 172.21.2.105:0/374497897 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa7a80ad080 msgr2=0x7fa7a80af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:39.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.836+0000 7fa7af806700 1 --2- 172.21.2.105:0/374497897 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa7a80ad080 0x7fa7a80af730 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 rx=0x7fa798002f70 tx=0x7fa798006eb0).stop 2021-11-12T05:49:39.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.836+0000 7fa7af806700 1 -- 172.21.2.105:0/374497897 shutdown_connections 2021-11-12T05:49:39.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.836+0000 7fa7af806700 1 --2- 172.21.2.105:0/374497897 >> v2:172.21.2.115:3300/0 conn(0x7fa7a814b2f0 0x7fa7a80ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:39.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.836+0000 7fa7af806700 1 --2- 172.21.2.105:0/374497897 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa7a80ad080 0x7fa7a80af730 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:39.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.836+0000 7fa7af806700 1 -- 172.21.2.105:0/374497897 >> 172.21.2.105:0/374497897 conn(0x7fa7a80b5370 msgr2=0x7fa7a80b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:39.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.836+0000 7fa7af806700 1 -- 172.21.2.105:0/374497897 shutdown_connections 2021-11-12T05:49:39.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.836+0000 7fa7af806700 1 -- 172.21.2.105:0/374497897 wait complete. 2021-11-12T05:49:39.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.836+0000 7fa7af806700 1 Processor -- start 2021-11-12T05:49:39.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.836+0000 7fa7af806700 1 -- start start 2021-11-12T05:49:39.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.836+0000 7fa7af806700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa7a80ac280 0x7fa7a8063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:39.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.836+0000 7fa7af806700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa7a80ad080 0x7fa7a8063b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:39.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.836+0000 7fa7af806700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa7a814b2f0 0x7fa7a8156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:39.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.836+0000 7fa7af806700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a80a9ee0 con 0x7fa7a80ad080 2021-11-12T05:49:39.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.836+0000 7fa7af806700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a8157920 con 0x7fa7a814b2f0 2021-11-12T05:49:39.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.836+0000 7fa7af806700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a80a9a40 con 0x7fa7a80ac280 2021-11-12T05:49:39.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.836+0000 7fa7acda1700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa7a80ad080 0x7fa7a8063b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:39.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.836+0000 7fa7acda1700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa7a80ad080 0x7fa7a8063b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52312/0 (socket says 172.21.2.105:52312) 2021-11-12T05:49:39.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.836+0000 7fa7acda1700 1 -- 172.21.2.105:0/3463540494 learned_addr learned my addr 172.21.2.105:0/3463540494 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:39.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.836+0000 7fa7acda1700 1 -- 172.21.2.105:0/3463540494 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa7a80ac280 msgr2=0x7fa7a8063640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:39.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.836+0000 7fa7acda1700 1 --2- 172.21.2.105:0/3463540494 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa7a80ac280 0x7fa7a8063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:39.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.836+0000 7fa7acda1700 1 -- 172.21.2.105:0/3463540494 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa7a814b2f0 msgr2=0x7fa7a8156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:39.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.836+0000 7fa7acda1700 1 --2- 172.21.2.105:0/3463540494 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa7a814b2f0 0x7fa7a8156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:39.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.836+0000 7fa7acda1700 1 -- 172.21.2.105:0/3463540494 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79800b1e0 con 0x7fa7a80ad080 2021-11-12T05:49:39.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.836+0000 7fa7acda1700 1 --2- 172.21.2.105:0/3463540494 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa7a80ad080 0x7fa7a8063b30 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 rx=0x7fa7a4001110 tx=0x7fa7a4007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:39.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.836+0000 7fa7967fc700 1 -- 172.21.2.105:0/3463540494 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7a40072e0 con 0x7fa7a80ad080 2021-11-12T05:49:39.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.836+0000 7fa7967fc700 1 -- 172.21.2.105:0/3463540494 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a4005550 con 0x7fa7a80ad080 2021-11-12T05:49:39.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.836+0000 7fa7967fc700 1 -- 172.21.2.105:0/3463540494 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7a40058b0 con 0x7fa7a80ad080 2021-11-12T05:49:39.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.836+0000 7fa7af806700 1 -- 172.21.2.105:0/3463540494 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7a8064020 con 0x7fa7a80ad080 2021-11-12T05:49:39.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.836+0000 7fa7af806700 1 -- 172.21.2.105:0/3463540494 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a81570f0 con 0x7fa7a80ad080 2021-11-12T05:49:39.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.840+0000 7fa7af806700 1 -- 172.21.2.105:0/3463540494 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7a80a9c00 con 0x7fa7a80ad080 2021-11-12T05:49:39.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.840+0000 7fa7967fc700 1 -- 172.21.2.105:0/3463540494 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa7a4010070 con 0x7fa7a80ad080 2021-11-12T05:49:39.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.840+0000 7fa7967fc700 1 --2- 172.21.2.105:0/3463540494 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa7880536d0 0x7fa788055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:39.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.840+0000 7fa7967fc700 1 -- 172.21.2.105:0/3463540494 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fa7a406b300 con 0x7fa7a80ad080 2021-11-12T05:49:39.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.840+0000 7fa7ad5a2700 1 --2- 172.21.2.105:0/3463540494 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa7880536d0 0x7fa788055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:39.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.840+0000 7fa7ad5a2700 1 --2- 172.21.2.105:0/3463540494 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa7880536d0 0x7fa788055b90 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7fa798002f70 tx=0x7fa798015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:39.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.840+0000 7fa7967fc700 1 -- 172.21.2.105:0/3463540494 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa7a4042200 con 0x7fa7a80ad080 2021-11-12T05:49:39.929 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.924+0000 7fa7af806700 1 -- 172.21.2.105:0/3463540494 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7a8157ae0 con 0x7fa7a80ad080 2021-11-12T05:49:39.930 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.924+0000 7fa7967fc700 1 -- 172.21.2.105:0/3463540494 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) v1 ==== 74+0+16285 (secure 0 0 0) 0x7fa7a4045820 con 0x7fa7a80ad080 2021-11-12T05:49:39.930 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:39.930 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":146,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:49:38.427121+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:49:35.238196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-11-12T05:49:36.389415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:49:39.931 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.924+0000 7fa7af806700 1 -- 172.21.2.105:0/3463540494 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa7880536d0 msgr2=0x7fa788055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:39.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.924+0000 7fa7af806700 1 --2- 172.21.2.105:0/3463540494 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa7880536d0 0x7fa788055b90 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7fa798002f70 tx=0x7fa798015000).stop 2021-11-12T05:49:39.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.924+0000 7fa7af806700 1 -- 172.21.2.105:0/3463540494 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa7a80ad080 msgr2=0x7fa7a8063b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:39.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.924+0000 7fa7af806700 1 --2- 172.21.2.105:0/3463540494 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa7a80ad080 0x7fa7a8063b30 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 rx=0x7fa7a4001110 tx=0x7fa7a4007ad0).stop 2021-11-12T05:49:39.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.924+0000 7fa7af806700 1 -- 172.21.2.105:0/3463540494 shutdown_connections 2021-11-12T05:49:39.933 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.924+0000 7fa7af806700 1 --2- 172.21.2.105:0/3463540494 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa7880536d0 0x7fa788055b90 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:39.933 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.924+0000 7fa7af806700 1 --2- 172.21.2.105:0/3463540494 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa7a814b2f0 0x7fa7a8156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:39.933 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.924+0000 7fa7af806700 1 --2- 172.21.2.105:0/3463540494 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa7a80ad080 0x7fa7a8063b30 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:39.933 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.924+0000 7fa7af806700 1 --2- 172.21.2.105:0/3463540494 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa7a80ac280 0x7fa7a8063640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:39.934 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.924+0000 7fa7af806700 1 -- 172.21.2.105:0/3463540494 >> 172.21.2.105:0/3463540494 conn(0x7fa7a80b5370 msgr2=0x7fa7a80aedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:39.934 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.924+0000 7fa7af806700 1 -- 172.21.2.105:0/3463540494 shutdown_connections 2021-11-12T05:49:39.934 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.924+0000 7fa7af806700 1 -- 172.21.2.105:0/3463540494 wait complete. 2021-11-12T05:49:39.937 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 27, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-12T05:49:35.238196+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '145', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 28, 'pool_name': 'cephfs_data', 'create_time': '2021-11-12T05:49:36.389415+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '146', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-12T05:49:39.938 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:49:39.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffafde85700 1 Processor -- start 2021-11-12T05:49:39.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffafde85700 1 -- start start 2021-11-12T05:49:39.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffafde85700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7ffaf80b2cc0 0x7ffaf80b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:39.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffafde85700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaf80aa0b0 con 0x7ffaf80b2290 2021-11-12T05:49:39.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffafde85700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaf80a9b70 con 0x7ffaf8143da0 2021-11-12T05:49:39.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffafde85700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaf80a9e10 con 0x7ffaf80b2cc0 2021-11-12T05:49:39.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffaf6ffd700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7ffaf80b2290 0x7ffaf8143690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34484/0 (socket says 172.21.2.105:34484) 2021-11-12T05:49:39.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffaf6ffd700 1 -- 172.21.2.105:0/2048046459 learned_addr learned my addr 172.21.2.105:0/2048046459 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:39.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffaf67fc700 1 -- 172.21.2.105:0/2048046459 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3964062929 0 0) 0x7ffaf80aa0b0 con 0x7ffaf80b2290 2021-11-12T05:49:39.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffaf67fc700 1 -- 172.21.2.105:0/2048046459 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffae4003260 con 0x7ffaf80b2290 2021-11-12T05:49:39.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffaf67fc700 1 -- 172.21.2.105:0/2048046459 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 863064852 0 0) 0x7ffae4003260 con 0x7ffaf80b2290 2021-11-12T05:49:40.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffaf67fc700 1 -- 172.21.2.105:0/2048046459 >> v2:172.21.2.115:3300/0 conn(0x7ffaf80b2cc0 msgr2=0x7ffaf80b30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:40.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffaf67fc700 1 --2- 172.21.2.105:0/2048046459 >> v2:172.21.2.115:3300/0 conn(0x7ffaf80b2cc0 0x7ffaf80b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:40.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffaf67fc700 1 -- 172.21.2.105:0/2048046459 >> v1:172.21.2.115:6789/0 conn(0x7ffaf8143da0 legacy=0x7ffaf8140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:40.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffaf67fc700 1 -- 172.21.2.105:0/2048046459 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf80b0800 con 0x7ffaf80b2290 2021-11-12T05:49:40.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffaf67fc700 1 -- 172.21.2.105:0/2048046459 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7ffaec001660 con 0x7ffaf80b2290 2021-11-12T05:49:40.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffaf67fc700 1 -- 172.21.2.105:0/2048046459 >> v1:172.21.2.105:6789/0 conn(0x7ffaf80b2290 legacy=0x7ffaf8143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:40.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffaf67fc700 1 --2- 172.21.2.105:0/2048046459 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ffae4003820 0x7ffae4003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:40.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffaf67fc700 1 --2- 172.21.2.105:0/2048046459 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ffae4004500 0x7ffae4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:40.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffaf67fc700 1 --2- 172.21.2.105:0/2048046459 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffae4005050 0x7ffae400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:40.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffaf67fc700 1 -- 172.21.2.105:0/2048046459 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf80a9e10 con 0x7ffae4005050 2021-11-12T05:49:40.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffaf67fc700 1 -- 172.21.2.105:0/2048046459 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae400bf40 con 0x7ffae4004500 2021-11-12T05:49:40.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffaf67fc700 1 -- 172.21.2.105:0/2048046459 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffae400c100 con 0x7ffae4003820 2021-11-12T05:49:40.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffaf7fff700 1 --2- 172.21.2.105:0/2048046459 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffae4005050 0x7ffae400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:40.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffaf7fff700 1 -- 172.21.2.105:0/2048046459 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ffae4003820 msgr2=0x7ffae4003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:40.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffaf7fff700 1 --2- 172.21.2.105:0/2048046459 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ffae4003820 0x7ffae4003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:40.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffaf7fff700 1 -- 172.21.2.105:0/2048046459 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ffae4004500 msgr2=0x7ffae4004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:40.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffaf7fff700 1 --2- 172.21.2.105:0/2048046459 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ffae4004500 0x7ffae4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:40.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffaf7fff700 1 -- 172.21.2.105:0/2048046459 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae4003260 con 0x7ffae4005050 2021-11-12T05:49:40.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffaf7fff700 1 -- 172.21.2.105:0/2048046459 reap_dead start 2021-11-12T05:49:40.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffaf7fff700 1 --2- 172.21.2.105:0/2048046459 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffae4005050 0x7ffae400b750 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 rx=0x7ffaf00012f0 tx=0x7ffaf0007d60).ready entity=mon.0 client_cookie=b99aeed2ef01cd91 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:40.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffaf67fc700 1 -- 172.21.2.105:0/2048046459 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffaf00014c0 con 0x7ffae4005050 2021-11-12T05:49:40.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffaf67fc700 1 -- 172.21.2.105:0/2048046459 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf0006870 con 0x7ffae4005050 2021-11-12T05:49:40.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffaf67fc700 1 -- 172.21.2.105:0/2048046459 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffaf0006bd0 con 0x7ffae4005050 2021-11-12T05:49:40.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffafde85700 1 -- 172.21.2.105:0/2048046459 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffae4005050 msgr2=0x7ffae400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:40.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffafde85700 1 --2- 172.21.2.105:0/2048046459 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffae4005050 0x7ffae400b750 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 rx=0x7ffaf00012f0 tx=0x7ffaf0007d60).stop 2021-11-12T05:49:40.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffafde85700 1 -- 172.21.2.105:0/2048046459 shutdown_connections 2021-11-12T05:49:40.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffafde85700 1 --2- 172.21.2.105:0/2048046459 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffae4005050 0x7ffae400b750 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:40.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffafde85700 1 -- 172.21.2.105:0/2048046459 >> 172.21.2.105:0/2048046459 conn(0x7ffaf805c490 msgr2=0x7ffaf805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:40.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffafde85700 1 -- 172.21.2.105:0/2048046459 shutdown_connections 2021-11-12T05:49:40.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffafde85700 1 -- 172.21.2.105:0/2048046459 wait complete. 2021-11-12T05:49:40.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffafde85700 1 Processor -- start 2021-11-12T05:49:40.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffafde85700 1 -- start start 2021-11-12T05:49:40.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffafde85700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ffae4005050 0x7ffaf8135c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:40.009 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffafde85700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffaf80b4ed0 0x7ffaf815a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:40.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.988+0000 7ffafde85700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ffaf80b5bf0 0x7ffaf80b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:40.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.992+0000 7ffafde85700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf80ac8d0 con 0x7ffaf80b4ed0 2021-11-12T05:49:40.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.992+0000 7ffafde85700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf80b3a00 con 0x7ffae4005050 2021-11-12T05:49:40.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.992+0000 7ffafde85700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf815a6d0 con 0x7ffaf80b5bf0 2021-11-12T05:49:40.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.992+0000 7ffaf6ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffaf80b4ed0 0x7ffaf815a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:40.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.992+0000 7ffaf6ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffaf80b4ed0 0x7ffaf815a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52330/0 (socket says 172.21.2.105:52330) 2021-11-12T05:49:40.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.992+0000 7ffaf6ffd700 1 -- 172.21.2.105:0/25514833 learned_addr learned my addr 172.21.2.105:0/25514833 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:40.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.992+0000 7ffaf6ffd700 1 -- 172.21.2.105:0/25514833 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ffaf80b5bf0 msgr2=0x7ffaf80b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:40.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.992+0000 7ffaf6ffd700 1 --2- 172.21.2.105:0/25514833 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ffaf80b5bf0 0x7ffaf80b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:40.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.992+0000 7ffaf6ffd700 1 -- 172.21.2.105:0/25514833 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ffae4005050 msgr2=0x7ffaf8135c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:40.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.992+0000 7ffaf6ffd700 1 --2- 172.21.2.105:0/25514833 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ffae4005050 0x7ffaf8135c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:40.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.992+0000 7ffaf6ffd700 1 -- 172.21.2.105:0/25514833 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf80ac630 con 0x7ffaf80b4ed0 2021-11-12T05:49:40.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.992+0000 7ffaf6ffd700 1 --2- 172.21.2.105:0/25514833 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffaf80b4ed0 0x7ffaf815a1e0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 rx=0x7ffaf80b3840 tx=0x7ffaf80a9d00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:40.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.992+0000 7ffaf4ff9700 1 -- 172.21.2.105:0/25514833 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffaec007170 con 0x7ffaf80b4ed0 2021-11-12T05:49:40.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.992+0000 7ffaf4ff9700 1 -- 172.21.2.105:0/25514833 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaec0072d0 con 0x7ffaf80b4ed0 2021-11-12T05:49:40.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.992+0000 7ffafde85700 1 -- 172.21.2.105:0/25514833 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaf80b4c60 con 0x7ffaf80b4ed0 2021-11-12T05:49:40.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.992+0000 7ffafde85700 1 -- 172.21.2.105:0/25514833 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaf80b4570 con 0x7ffaf80b4ed0 2021-11-12T05:49:40.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.992+0000 7ffaf4ff9700 1 -- 172.21.2.105:0/25514833 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffaec004920 con 0x7ffaf80b4ed0 2021-11-12T05:49:40.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.992+0000 7ffafde85700 1 -- 172.21.2.105:0/25514833 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffad0003410 con 0x7ffaf80b4ed0 2021-11-12T05:49:40.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.992+0000 7ffaf4ff9700 1 -- 172.21.2.105:0/25514833 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ffaec004a80 con 0x7ffaf80b4ed0 2021-11-12T05:49:40.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.992+0000 7ffaf4ff9700 1 --2- 172.21.2.105:0/25514833 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ffad80536f0 0x7ffad8055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:40.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.992+0000 7ffaf4ff9700 1 -- 172.21.2.105:0/25514833 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6416+0+0 (secure 0 0 0) 0x7ffaec06b580 con 0x7ffaf80b4ed0 2021-11-12T05:49:40.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.992+0000 7ffaf77fe700 1 --2- 172.21.2.105:0/25514833 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ffad80536f0 0x7ffad8055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:40.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.992+0000 7ffaf77fe700 1 --2- 172.21.2.105:0/25514833 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ffad80536f0 0x7ffad8055bb0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7ffae8002f70 tx=0x7ffae8006a00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:40.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:39.996+0000 7ffaf4ff9700 1 -- 172.21.2.105:0/25514833 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ffaec042590 con 0x7ffaf80b4ed0 2021-11-12T05:49:40.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.080+0000 7ffafde85700 1 -- 172.21.2.105:0/25514833 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ffad0003c40 con 0x7ffaf80b4ed0 2021-11-12T05:49:40.083 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.080+0000 7ffaf4ff9700 1 -- 172.21.2.105:0/25514833 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v146) v1 ==== 110+0+10 (secure 0 0 0) 0x7ffaec045bb0 con 0x7ffaf80b4ed0 2021-11-12T05:49:40.084 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:49:40.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.080+0000 7ffafde85700 1 -- 172.21.2.105:0/25514833 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ffad80536f0 msgr2=0x7ffad8055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:40.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.080+0000 7ffafde85700 1 --2- 172.21.2.105:0/25514833 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ffad80536f0 0x7ffad8055bb0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7ffae8002f70 tx=0x7ffae8006a00).stop 2021-11-12T05:49:40.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.080+0000 7ffafde85700 1 -- 172.21.2.105:0/25514833 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffaf80b4ed0 msgr2=0x7ffaf815a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:40.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.080+0000 7ffafde85700 1 --2- 172.21.2.105:0/25514833 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffaf80b4ed0 0x7ffaf815a1e0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 rx=0x7ffaf80b3840 tx=0x7ffaf80a9d00).stop 2021-11-12T05:49:40.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.080+0000 7ffafde85700 1 -- 172.21.2.105:0/25514833 shutdown_connections 2021-11-12T05:49:40.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.080+0000 7ffafde85700 1 --2- 172.21.2.105:0/25514833 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ffad80536f0 0x7ffad8055bb0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:40.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.080+0000 7ffafde85700 1 --2- 172.21.2.105:0/25514833 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ffaf80b5bf0 0x7ffaf80b3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:40.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.080+0000 7ffafde85700 1 --2- 172.21.2.105:0/25514833 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffaf80b4ed0 0x7ffaf815a1e0 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:40.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.080+0000 7ffafde85700 1 --2- 172.21.2.105:0/25514833 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ffae4005050 0x7ffaf8135c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:40.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.080+0000 7ffafde85700 1 -- 172.21.2.105:0/25514833 >> 172.21.2.105:0/25514833 conn(0x7ffaf805c490 msgr2=0x7ffaf8142410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:40.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.080+0000 7ffafde85700 1 -- 172.21.2.105:0/25514833 shutdown_connections 2021-11-12T05:49:40.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.080+0000 7ffafde85700 1 -- 172.21.2.105:0/25514833 wait complete. 2021-11-12T05:49:40.091 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:49:40.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.140+0000 7fea8f254700 1 Processor -- start 2021-11-12T05:49:40.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.140+0000 7fea8f254700 1 -- start start 2021-11-12T05:49:40.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.140+0000 7fea8f254700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fea880b7b00 0x7fea88140d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:40.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.140+0000 7fea8f254700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fea880b3980 0x7fea880b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:40.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.140+0000 7fea8f254700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea880b7ee0 con 0x7fea880ae090 2021-11-12T05:49:40.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.140+0000 7fea8f254700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea880b2030 con 0x7fea880b7b00 2021-11-12T05:49:40.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.140+0000 7fea8f254700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea880b22d0 con 0x7fea880b3980 2021-11-12T05:49:40.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.140+0000 7fea87fff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fea880ae090 0x7fea880b2a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34504/0 (socket says 172.21.2.105:34504) 2021-11-12T05:49:40.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.140+0000 7fea87fff700 1 -- 172.21.2.105:0/2694156781 learned_addr learned my addr 172.21.2.105:0/2694156781 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:40.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.140+0000 7fea8cff0700 1 --2- 172.21.2.105:0/2694156781 >> v2:172.21.2.105:3300/0 conn(0x7fea880b7b00 0x7fea88140d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:40.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.140+0000 7fea8cff0700 1 -- 172.21.2.105:0/2694156781 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fea880b3980 msgr2=0x7fea880b3e10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:49:40.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.140+0000 7fea8cff0700 1 --2- 172.21.2.105:0/2694156781 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fea880b3980 0x7fea880b3e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:40.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.140+0000 7fea8cff0700 1 -- 172.21.2.105:0/2694156781 >> v1:172.21.2.105:6789/0 conn(0x7fea880ae090 legacy=0x7fea880b2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:40.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.140+0000 7fea8cff0700 1 -- 172.21.2.105:0/2694156781 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea880b2570 con 0x7fea880b7b00 2021-11-12T05:49:40.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.140+0000 7fea8cff0700 1 --2- 172.21.2.105:0/2694156781 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fea880b7b00 0x7fea88140d80 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 rx=0x7fea7c001110 tx=0x7fea78006df0).ready entity=mon.0 client_cookie=8af520af9a979b4f server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:40.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.140+0000 7fea877fe700 1 -- 172.21.2.105:0/2694156781 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea7800d570 con 0x7fea880b7b00 2021-11-12T05:49:40.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.140+0000 7fea877fe700 1 -- 172.21.2.105:0/2694156781 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea78000e90 con 0x7fea880b7b00 2021-11-12T05:49:40.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.140+0000 7fea877fe700 1 -- 172.21.2.105:0/2694156781 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea7800d8c0 con 0x7fea880b7b00 2021-11-12T05:49:40.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.140+0000 7fea8f254700 1 -- 172.21.2.105:0/2694156781 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fea880b7b00 msgr2=0x7fea88140d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:40.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.140+0000 7fea8f254700 1 --2- 172.21.2.105:0/2694156781 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fea880b7b00 0x7fea88140d80 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 rx=0x7fea7c001110 tx=0x7fea78006df0).stop 2021-11-12T05:49:40.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.140+0000 7fea8f254700 1 -- 172.21.2.105:0/2694156781 shutdown_connections 2021-11-12T05:49:40.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.140+0000 7fea8f254700 1 --2- 172.21.2.105:0/2694156781 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fea880b3980 0x7fea880b3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:40.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.140+0000 7fea8f254700 1 --2- 172.21.2.105:0/2694156781 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fea880b7b00 0x7fea88140d80 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:40.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.140+0000 7fea8f254700 1 -- 172.21.2.105:0/2694156781 >> 172.21.2.105:0/2694156781 conn(0x7fea880608d0 msgr2=0x7fea8805c490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:40.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.140+0000 7fea8f254700 1 -- 172.21.2.105:0/2694156781 shutdown_connections 2021-11-12T05:49:40.150 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.140+0000 7fea8f254700 1 -- 172.21.2.105:0/2694156781 wait complete. 2021-11-12T05:49:40.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.140+0000 7fea8f254700 1 Processor -- start 2021-11-12T05:49:40.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.140+0000 7fea8f254700 1 -- start start 2021-11-12T05:49:40.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.140+0000 7fea8f254700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fea880ae090 0x7fea88066840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:40.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.140+0000 7fea8f254700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fea880b3980 0x7fea8814de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:40.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.140+0000 7fea8f254700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fea880b7b00 0x7fea8814e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:40.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.140+0000 7fea8f254700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea88141060 con 0x7fea880b7b00 2021-11-12T05:49:40.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.140+0000 7fea8f254700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea88140b20 con 0x7fea880ae090 2021-11-12T05:49:40.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.140+0000 7fea8f254700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea88140dc0 con 0x7fea880b3980 2021-11-12T05:49:40.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.144+0000 7fea8d7f1700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fea880b7b00 0x7fea8814e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:40.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.144+0000 7fea8d7f1700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fea880b7b00 0x7fea8814e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52346/0 (socket says 172.21.2.105:52346) 2021-11-12T05:49:40.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.144+0000 7fea8d7f1700 1 -- 172.21.2.105:0/2758706051 learned_addr learned my addr 172.21.2.105:0/2758706051 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:40.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.144+0000 7fea8d7f1700 1 -- 172.21.2.105:0/2758706051 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fea880b3980 msgr2=0x7fea8814de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:40.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.144+0000 7fea8d7f1700 1 --2- 172.21.2.105:0/2758706051 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fea880b3980 0x7fea8814de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:40.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.144+0000 7fea8d7f1700 1 -- 172.21.2.105:0/2758706051 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fea880ae090 msgr2=0x7fea88066840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:40.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.144+0000 7fea8d7f1700 1 --2- 172.21.2.105:0/2758706051 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fea880ae090 0x7fea88066840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:40.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.144+0000 7fea8d7f1700 1 -- 172.21.2.105:0/2758706051 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea7800b180 con 0x7fea880b7b00 2021-11-12T05:49:40.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.144+0000 7fea8d7f1700 1 --2- 172.21.2.105:0/2758706051 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fea880b7b00 0x7fea8814e680 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 rx=0x7fea80003330 tx=0x7fea800091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:40.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.144+0000 7fea85ffb700 1 -- 172.21.2.105:0/2758706051 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea80001520 con 0x7fea880b7b00 2021-11-12T05:49:40.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.144+0000 7fea85ffb700 1 -- 172.21.2.105:0/2758706051 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea80001680 con 0x7fea880b7b00 2021-11-12T05:49:40.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.144+0000 7fea8f254700 1 -- 172.21.2.105:0/2758706051 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea88142ca0 con 0x7fea880b7b00 2021-11-12T05:49:40.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.144+0000 7fea85ffb700 1 -- 172.21.2.105:0/2758706051 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea800019e0 con 0x7fea880b7b00 2021-11-12T05:49:40.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.144+0000 7fea8f254700 1 -- 172.21.2.105:0/2758706051 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea881405a0 con 0x7fea880b7b00 2021-11-12T05:49:40.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.144+0000 7fea8f254700 1 -- 172.21.2.105:0/2758706051 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea88057350 con 0x7fea880b7b00 2021-11-12T05:49:40.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.144+0000 7fea85ffb700 1 -- 172.21.2.105:0/2758706051 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fea80018030 con 0x7fea880b7b00 2021-11-12T05:49:40.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.144+0000 7fea85ffb700 1 --2- 172.21.2.105:0/2758706051 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fea680536f0 0x7fea68055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:40.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.144+0000 7fea85ffb700 1 -- 172.21.2.105:0/2758706051 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fea8006b650 con 0x7fea880b7b00 2021-11-12T05:49:40.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.144+0000 7fea8cff0700 1 --2- 172.21.2.105:0/2758706051 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fea680536f0 0x7fea68055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:40.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.144+0000 7fea8cff0700 1 --2- 172.21.2.105:0/2758706051 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fea680536f0 0x7fea68055bb0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7fea7c001110 tx=0x7fea78014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:40.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.148+0000 7fea85ffb700 1 -- 172.21.2.105:0/2758706051 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fea80041e90 con 0x7fea880b7b00 2021-11-12T05:49:40.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.232+0000 7fea8f254700 1 -- 172.21.2.105:0/2758706051 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fea8805f280 con 0x7fea880b7b00 2021-11-12T05:49:40.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.232+0000 7fea85ffb700 1 -- 172.21.2.105:0/2758706051 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v146) v1 ==== 92+0+10 (secure 0 0 0) 0x7fea80042600 con 0x7fea880b7b00 2021-11-12T05:49:40.237 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:49:40.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.232+0000 7fea8f254700 1 -- 172.21.2.105:0/2758706051 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fea680536f0 msgr2=0x7fea68055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:40.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.232+0000 7fea8f254700 1 --2- 172.21.2.105:0/2758706051 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fea680536f0 0x7fea68055bb0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7fea7c001110 tx=0x7fea78014000).stop 2021-11-12T05:49:40.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.232+0000 7fea8f254700 1 -- 172.21.2.105:0/2758706051 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fea880b7b00 msgr2=0x7fea8814e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:40.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.232+0000 7fea8f254700 1 --2- 172.21.2.105:0/2758706051 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fea880b7b00 0x7fea8814e680 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 rx=0x7fea80003330 tx=0x7fea800091a0).stop 2021-11-12T05:49:40.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.232+0000 7fea8f254700 1 -- 172.21.2.105:0/2758706051 shutdown_connections 2021-11-12T05:49:40.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.232+0000 7fea8f254700 1 --2- 172.21.2.105:0/2758706051 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fea680536f0 0x7fea68055bb0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:40.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.232+0000 7fea8f254700 1 --2- 172.21.2.105:0/2758706051 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fea880b7b00 0x7fea8814e680 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:40.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.232+0000 7fea8f254700 1 --2- 172.21.2.105:0/2758706051 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fea880b3980 0x7fea8814de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:40.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.232+0000 7fea8f254700 1 --2- 172.21.2.105:0/2758706051 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fea880ae090 0x7fea88066840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:40.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.232+0000 7fea8f254700 1 -- 172.21.2.105:0/2758706051 >> 172.21.2.105:0/2758706051 conn(0x7fea880608d0 msgr2=0x7fea88125a20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:40.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.232+0000 7fea8f254700 1 -- 172.21.2.105:0/2758706051 shutdown_connections 2021-11-12T05:49:40.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.232+0000 7fea8f254700 1 -- 172.21.2.105:0/2758706051 wait complete. 2021-11-12T05:49:40.244 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-12T05:49:40.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.292+0000 7ffb7062b700 1 Processor -- start 2021-11-12T05:49:40.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.292+0000 7ffb7062b700 1 -- start start 2021-11-12T05:49:40.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.292+0000 7ffb7062b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ffb680626b0 0x7ffb68062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:40.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.292+0000 7ffb7062b700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7ffb680af750 0x7ffb68130370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:40.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.292+0000 7ffb7062b700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb68130cf0 con 0x7ffb68130860 2021-11-12T05:49:40.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.292+0000 7ffb7062b700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb680b0d50 con 0x7ffb680af750 2021-11-12T05:49:40.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.292+0000 7ffb7062b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb680ad380 con 0x7ffb680626b0 2021-11-12T05:49:40.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.292+0000 7ffb6dbc6700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7ffb680af750 0x7ffb68130370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:40.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.292+0000 7ffb6ebc8700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7ffb68130860 0x7ffb6814a950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:32982/0 (socket says 172.21.2.105:32982) 2021-11-12T05:49:40.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.292+0000 7ffb6ebc8700 1 -- 172.21.2.105:0/3634520932 learned_addr learned my addr 172.21.2.105:0/3634520932 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:40.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.296+0000 7ffb6e3c7700 1 --2- 172.21.2.105:0/3634520932 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ffb680626b0 0x7ffb68062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:40.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.296+0000 7ffb6e3c7700 1 -- 172.21.2.105:0/3634520932 >> v2:172.21.2.115:3300/0 conn(0x7ffb680af750 msgr2=0x7ffb68130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:40.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.296+0000 7ffb6e3c7700 1 --2- 172.21.2.105:0/3634520932 >> v2:172.21.2.115:3300/0 conn(0x7ffb680af750 0x7ffb68130370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:40.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.296+0000 7ffb6e3c7700 1 -- 172.21.2.105:0/3634520932 >> v1:172.21.2.115:6789/0 conn(0x7ffb68130860 legacy=0x7ffb6814a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:40.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.296+0000 7ffb6e3c7700 1 -- 172.21.2.105:0/3634520932 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb680ae190 con 0x7ffb680626b0 2021-11-12T05:49:40.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.296+0000 7ffb6e3c7700 1 --2- 172.21.2.105:0/3634520932 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ffb680626b0 0x7ffb68062a90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7ffb64002f70 tx=0x7ffb64006df0).ready entity=mon.2 client_cookie=26dc14f4da57d755 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:40.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.296+0000 7ffb6d3c5700 1 -- 172.21.2.105:0/3634520932 <== mon.2 v2:172.21.2.115:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb6400d570 con 0x7ffb680626b0 2021-11-12T05:49:40.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.296+0000 7ffb6d3c5700 1 -- 172.21.2.105:0/3634520932 <== mon.2 v2:172.21.2.115:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb64000e90 con 0x7ffb680626b0 2021-11-12T05:49:40.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.296+0000 7ffb6d3c5700 1 -- 172.21.2.105:0/3634520932 <== mon.2 v2:172.21.2.115:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb6400d8c0 con 0x7ffb680626b0 2021-11-12T05:49:40.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.296+0000 7ffb7062b700 1 -- 172.21.2.105:0/3634520932 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ffb680626b0 msgr2=0x7ffb68062a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:40.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.296+0000 7ffb7062b700 1 --2- 172.21.2.105:0/3634520932 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ffb680626b0 0x7ffb68062a90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7ffb64002f70 tx=0x7ffb64006df0).stop 2021-11-12T05:49:40.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.296+0000 7ffb7062b700 1 -- 172.21.2.105:0/3634520932 shutdown_connections 2021-11-12T05:49:40.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.296+0000 7ffb7062b700 1 --2- 172.21.2.105:0/3634520932 >> v2:172.21.2.115:3300/0 conn(0x7ffb680af750 0x7ffb68130370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:40.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.296+0000 7ffb7062b700 1 --2- 172.21.2.105:0/3634520932 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ffb680626b0 0x7ffb68062a90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:40.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.296+0000 7ffb7062b700 1 -- 172.21.2.105:0/3634520932 >> 172.21.2.105:0/3634520932 conn(0x7ffb680b5320 msgr2=0x7ffb680b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:40.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.296+0000 7ffb7062b700 1 -- 172.21.2.105:0/3634520932 shutdown_connections 2021-11-12T05:49:40.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.296+0000 7ffb7062b700 1 -- 172.21.2.105:0/3634520932 wait complete. 2021-11-12T05:49:40.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.296+0000 7ffb7062b700 1 Processor -- start 2021-11-12T05:49:40.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.296+0000 7ffb7062b700 1 -- start start 2021-11-12T05:49:40.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.296+0000 7ffb7062b700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ffb680626b0 0x7ffb6814ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:40.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.296+0000 7ffb7062b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffb680af750 0x7ffb68156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:40.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.296+0000 7ffb7062b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ffb68130860 0x7ffb68156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:40.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.296+0000 7ffb7062b700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb680647a0 con 0x7ffb680af750 2021-11-12T05:49:40.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.296+0000 7ffb7062b700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb68065ba0 con 0x7ffb680626b0 2021-11-12T05:49:40.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.296+0000 7ffb7062b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb68065e40 con 0x7ffb68130860 2021-11-12T05:49:40.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.296+0000 7ffb6dbc6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffb680af750 0x7ffb68156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:40.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.296+0000 7ffb6dbc6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffb680af750 0x7ffb68156960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52358/0 (socket says 172.21.2.105:52358) 2021-11-12T05:49:40.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.296+0000 7ffb6dbc6700 1 -- 172.21.2.105:0/4045552921 learned_addr learned my addr 172.21.2.105:0/4045552921 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:40.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.300+0000 7ffb6dbc6700 1 -- 172.21.2.105:0/4045552921 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ffb68130860 msgr2=0x7ffb68156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:40.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.300+0000 7ffb6dbc6700 1 --2- 172.21.2.105:0/4045552921 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ffb68130860 0x7ffb68156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:40.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.300+0000 7ffb6dbc6700 1 -- 172.21.2.105:0/4045552921 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ffb680626b0 msgr2=0x7ffb6814ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:40.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.300+0000 7ffb6dbc6700 1 --2- 172.21.2.105:0/4045552921 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ffb680626b0 0x7ffb6814ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:40.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.300+0000 7ffb6dbc6700 1 -- 172.21.2.105:0/4045552921 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb6400b180 con 0x7ffb680af750 2021-11-12T05:49:40.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.300+0000 7ffb6dbc6700 1 --2- 172.21.2.105:0/4045552921 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffb680af750 0x7ffb68156960 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 rx=0x7ffb5c00c000 tx=0x7ffb5c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:40.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.300+0000 7ffb5b7fe700 1 -- 172.21.2.105:0/4045552921 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb5c010780 con 0x7ffb680af750 2021-11-12T05:49:40.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.300+0000 7ffb5b7fe700 1 -- 172.21.2.105:0/4045552921 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb5c0108e0 con 0x7ffb680af750 2021-11-12T05:49:40.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.300+0000 7ffb5b7fe700 1 -- 172.21.2.105:0/4045552921 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb5c010c40 con 0x7ffb680af750 2021-11-12T05:49:40.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.300+0000 7ffb7062b700 1 -- 172.21.2.105:0/4045552921 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb680660e0 con 0x7ffb680af750 2021-11-12T05:49:40.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.300+0000 7ffb7062b700 1 -- 172.21.2.105:0/4045552921 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb6814de50 con 0x7ffb680af750 2021-11-12T05:49:40.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.300+0000 7ffb7062b700 1 -- 172.21.2.105:0/4045552921 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb68057350 con 0x7ffb680af750 2021-11-12T05:49:40.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.300+0000 7ffb5b7fe700 1 -- 172.21.2.105:0/4045552921 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ffb5c01c460 con 0x7ffb680af750 2021-11-12T05:49:40.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.300+0000 7ffb5b7fe700 1 --2- 172.21.2.105:0/4045552921 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ffb48053540 0x7ffb48055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:40.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.300+0000 7ffb5b7fe700 1 -- 172.21.2.105:0/4045552921 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6416+0+0 (secure 0 0 0) 0x7ffb5c06c0b0 con 0x7ffb680af750 2021-11-12T05:49:40.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.300+0000 7ffb6e3c7700 1 --2- 172.21.2.105:0/4045552921 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ffb48053540 0x7ffb48055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:40.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.300+0000 7ffb6e3c7700 1 --2- 172.21.2.105:0/4045552921 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ffb48053540 0x7ffb48055a00 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7ffb64002f70 tx=0x7ffb64014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:40.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.300+0000 7ffb5b7fe700 1 -- 172.21.2.105:0/4045552921 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ffb5c042f50 con 0x7ffb680af750 2021-11-12T05:49:40.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.384+0000 7ffb7062b700 1 -- 172.21.2.105:0/4045552921 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffb680b3bd0 con 0x7ffb680af750 2021-11-12T05:49:40.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.384+0000 7ffb5b7fe700 1 -- 172.21.2.105:0/4045552921 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v146) v1 ==== 104+0+10 (secure 0 0 0) 0x7ffb5c046570 con 0x7ffb680af750 2021-11-12T05:49:40.389 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:49:40.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.384+0000 7ffb7062b700 1 -- 172.21.2.105:0/4045552921 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ffb48053540 msgr2=0x7ffb48055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:40.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.384+0000 7ffb7062b700 1 --2- 172.21.2.105:0/4045552921 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ffb48053540 0x7ffb48055a00 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7ffb64002f70 tx=0x7ffb64014000).stop 2021-11-12T05:49:40.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.384+0000 7ffb7062b700 1 -- 172.21.2.105:0/4045552921 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffb680af750 msgr2=0x7ffb68156960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:40.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.384+0000 7ffb7062b700 1 --2- 172.21.2.105:0/4045552921 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffb680af750 0x7ffb68156960 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 rx=0x7ffb5c00c000 tx=0x7ffb5c006df0).stop 2021-11-12T05:49:40.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.384+0000 7ffb7062b700 1 -- 172.21.2.105:0/4045552921 shutdown_connections 2021-11-12T05:49:40.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.384+0000 7ffb7062b700 1 --2- 172.21.2.105:0/4045552921 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ffb48053540 0x7ffb48055a00 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:40.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.384+0000 7ffb7062b700 1 --2- 172.21.2.105:0/4045552921 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ffb68130860 0x7ffb68156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:40.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.384+0000 7ffb7062b700 1 --2- 172.21.2.105:0/4045552921 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ffb680af750 0x7ffb68156960 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:40.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.384+0000 7ffb7062b700 1 --2- 172.21.2.105:0/4045552921 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ffb680626b0 0x7ffb6814ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:40.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.384+0000 7ffb7062b700 1 -- 172.21.2.105:0/4045552921 >> 172.21.2.105:0/4045552921 conn(0x7ffb680b5320 msgr2=0x7ffb6814a860 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:40.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.384+0000 7ffb7062b700 1 -- 172.21.2.105:0/4045552921 shutdown_connections 2021-11-12T05:49:40.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.384+0000 7ffb7062b700 1 -- 172.21.2.105:0/4045552921 wait complete. 2021-11-12T05:49:40.396 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-12T05:49:40.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.444+0000 7fa46557c700 1 Processor -- start 2021-11-12T05:49:40.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.444+0000 7fa46557c700 1 -- start start 2021-11-12T05:49:40.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.444+0000 7fa46557c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa4600b2e20 0x7fa4600b1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:40.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.444+0000 7fa46557c700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fa46013ea50 0x7fa46013ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:40.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.444+0000 7fa46557c700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4600ad400 con 0x7fa46005f6b0 2021-11-12T05:49:40.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.444+0000 7fa46557c700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4600b3200 con 0x7fa46013ea50 2021-11-12T05:49:40.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.444+0000 7fa46557c700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4600ad660 con 0x7fa4600b2e20 2021-11-12T05:49:40.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.444+0000 7fa45f7fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fa46005f6b0 0x7fa46005fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34528/0 (socket says 172.21.2.105:34528) 2021-11-12T05:49:40.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.444+0000 7fa45f7fe700 1 -- 172.21.2.105:0/2178917118 learned_addr learned my addr 172.21.2.105:0/2178917118 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:40.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.444+0000 7fa45dffb700 1 -- 172.21.2.105:0/2178917118 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3152601808 0 0) 0x7fa4600ad400 con 0x7fa46005f6b0 2021-11-12T05:49:40.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.444+0000 7fa45dffb700 1 -- 172.21.2.105:0/2178917118 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa440003260 con 0x7fa46005f6b0 2021-11-12T05:49:40.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.444+0000 7fa45effd700 1 --2- 172.21.2.105:0/2178917118 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa4600b2e20 0x7fa4600b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:40.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.444+0000 7fa45e7fc700 1 --2- 172.21.2.105:0/2178917118 >> v2:172.21.2.115:3300/0 conn(0x7fa46013ea50 0x7fa46013ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:40.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.444+0000 7fa45dffb700 1 -- 172.21.2.105:0/2178917118 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2839428791 0 0) 0x7fa440003260 con 0x7fa46005f6b0 2021-11-12T05:49:40.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.444+0000 7fa45dffb700 1 -- 172.21.2.105:0/2178917118 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa4600b2e20 msgr2=0x7fa4600b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:40.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.444+0000 7fa45dffb700 1 --2- 172.21.2.105:0/2178917118 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa4600b2e20 0x7fa4600b1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:40.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.444+0000 7fa45dffb700 1 -- 172.21.2.105:0/2178917118 >> v2:172.21.2.115:3300/0 conn(0x7fa46013ea50 msgr2=0x7fa46013ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:40.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.444+0000 7fa45dffb700 1 --2- 172.21.2.105:0/2178917118 >> v2:172.21.2.115:3300/0 conn(0x7fa46013ea50 0x7fa46013ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:40.458 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.444+0000 7fa45dffb700 1 -- 172.21.2.105:0/2178917118 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4600ad900 con 0x7fa46005f6b0 2021-11-12T05:49:40.458 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.444+0000 7fa45dffb700 1 -- 172.21.2.105:0/2178917118 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fa4580019e0 con 0x7fa46005f6b0 2021-11-12T05:49:40.458 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.444+0000 7fa45dffb700 1 -- 172.21.2.105:0/2178917118 >> v1:172.21.2.105:6789/0 conn(0x7fa46005f6b0 legacy=0x7fa46005fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:40.458 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.444+0000 7fa45dffb700 1 --2- 172.21.2.105:0/2178917118 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa4400037d0 0x7fa440003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:40.458 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.444+0000 7fa45dffb700 1 --2- 172.21.2.105:0/2178917118 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa440004500 0x7fa440004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:40.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.444+0000 7fa45dffb700 1 --2- 172.21.2.105:0/2178917118 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa4600b2e20 0x7fa440004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:40.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.444+0000 7fa45dffb700 1 -- 172.21.2.105:0/2178917118 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4600b3200 con 0x7fa4400037d0 2021-11-12T05:49:40.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.444+0000 7fa45dffb700 1 -- 172.21.2.105:0/2178917118 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4600ad660 con 0x7fa440004500 2021-11-12T05:49:40.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.444+0000 7fa45dffb700 1 -- 172.21.2.105:0/2178917118 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44000b750 con 0x7fa4600b2e20 2021-11-12T05:49:40.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa45effd700 1 --2- 172.21.2.105:0/2178917118 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa4400037d0 0x7fa440003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:40.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa45e7fc700 1 --2- 172.21.2.105:0/2178917118 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa440004500 0x7fa440004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:40.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa45f7fe700 1 --2- 172.21.2.105:0/2178917118 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa4600b2e20 0x7fa440004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:40.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa45effd700 1 -- 172.21.2.105:0/2178917118 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa4600b2e20 msgr2=0x7fa440004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:40.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa45effd700 1 --2- 172.21.2.105:0/2178917118 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa4600b2e20 0x7fa440004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:40.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa45effd700 1 -- 172.21.2.105:0/2178917118 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa440004500 msgr2=0x7fa440004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:40.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa45effd700 1 --2- 172.21.2.105:0/2178917118 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa440004500 0x7fa440004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:40.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa45effd700 1 -- 172.21.2.105:0/2178917118 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa440003260 con 0x7fa4400037d0 2021-11-12T05:49:40.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa45f7fe700 1 --2- 172.21.2.105:0/2178917118 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa4600b2e20 0x7fa440004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:49:40.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa45effd700 1 --2- 172.21.2.105:0/2178917118 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa4400037d0 0x7fa440003bf0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 rx=0x7fa44800e000 tx=0x7fa44800f040).ready entity=mon.0 client_cookie=b3c34311e1c65ec9 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:40.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa45dffb700 1 -- 172.21.2.105:0/2178917118 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa448012040 con 0x7fa4400037d0 2021-11-12T05:49:40.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa45dffb700 1 -- 172.21.2.105:0/2178917118 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44800baa0 con 0x7fa4400037d0 2021-11-12T05:49:40.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa45dffb700 1 -- 172.21.2.105:0/2178917118 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa44800be00 con 0x7fa4400037d0 2021-11-12T05:49:40.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa46557c700 1 -- 172.21.2.105:0/2178917118 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa4400037d0 msgr2=0x7fa440003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:40.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa46557c700 1 --2- 172.21.2.105:0/2178917118 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa4400037d0 0x7fa440003bf0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 rx=0x7fa44800e000 tx=0x7fa44800f040).stop 2021-11-12T05:49:40.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa45f7fe700 1 -- 172.21.2.105:0/2178917118 reap_dead start 2021-11-12T05:49:40.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa46557c700 1 -- 172.21.2.105:0/2178917118 shutdown_connections 2021-11-12T05:49:40.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa46557c700 1 -- 172.21.2.105:0/2178917118 >> 172.21.2.105:0/2178917118 conn(0x7fa460062f60 msgr2=0x7fa460063370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:40.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa46557c700 1 -- 172.21.2.105:0/2178917118 shutdown_connections 2021-11-12T05:49:40.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa46557c700 1 -- 172.21.2.105:0/2178917118 wait complete. 2021-11-12T05:49:40.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa46557c700 1 Processor -- start 2021-11-12T05:49:40.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa46557c700 1 -- start start 2021-11-12T05:49:40.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa46557c700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa4400037d0 0x7fa46013db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:40.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa46557c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa460067920 0x7fa46015a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:40.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa46557c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa46013c0e0 0x7fa46015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:40.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa46557c700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa460063dd0 con 0x7fa46013c0e0 2021-11-12T05:49:40.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa46557c700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4600642a0 con 0x7fa4400037d0 2021-11-12T05:49:40.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa46557c700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa460064000 con 0x7fa460067920 2021-11-12T05:49:40.465 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa45e7fc700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa460067920 0x7fa46015a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:40.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa45effd700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa4400037d0 0x7fa46013db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:40.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa45f7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa46013c0e0 0x7fa46015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:40.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa45e7fc700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa460067920 0x7fa46015a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3301/0 says I am v2:172.21.2.105:43568/0 (socket says 172.21.2.105:43568) 2021-11-12T05:49:40.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa45e7fc700 1 -- 172.21.2.105:0/1489120963 learned_addr learned my addr 172.21.2.105:0/1489120963 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:40.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa45effd700 1 -- 172.21.2.105:0/1489120963 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa460067920 msgr2=0x7fa46015a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:40.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa45effd700 1 --2- 172.21.2.105:0/1489120963 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa460067920 0x7fa46015a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:40.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa45effd700 1 -- 172.21.2.105:0/1489120963 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa46013c0e0 msgr2=0x7fa46015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:40.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa45effd700 1 --2- 172.21.2.105:0/1489120963 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa46013c0e0 0x7fa46015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:40.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa45effd700 1 -- 172.21.2.105:0/1489120963 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4600b5db0 con 0x7fa4400037d0 2021-11-12T05:49:40.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa45effd700 1 --2- 172.21.2.105:0/1489120963 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa4400037d0 0x7fa46013db20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7fa44800e000 tx=0x7fa44801a000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:40.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa457fff700 1 -- 172.21.2.105:0/1489120963 <== mon.1 v2:172.21.2.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa448009030 con 0x7fa4400037d0 2021-11-12T05:49:40.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa457fff700 1 -- 172.21.2.105:0/1489120963 <== mon.1 v2:172.21.2.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa448000e90 con 0x7fa4400037d0 2021-11-12T05:49:40.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa46557c700 1 -- 172.21.2.105:0/1489120963 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa46015abe0 con 0x7fa4400037d0 2021-11-12T05:49:40.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa46557c700 1 -- 172.21.2.105:0/1489120963 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4600b6270 con 0x7fa4400037d0 2021-11-12T05:49:40.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa457fff700 1 -- 172.21.2.105:0/1489120963 <== mon.1 v2:172.21.2.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa448012040 con 0x7fa4400037d0 2021-11-12T05:49:40.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.448+0000 7fa46557c700 1 -- 172.21.2.105:0/1489120963 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4600b2060 con 0x7fa4400037d0 2021-11-12T05:49:40.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.452+0000 7fa457fff700 1 -- 172.21.2.105:0/1489120963 <== mon.1 v2:172.21.2.115:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa448025030 con 0x7fa4400037d0 2021-11-12T05:49:40.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.452+0000 7fa457fff700 1 --2- 172.21.2.105:0/1489120963 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa444053640 0x7fa444055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:40.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.452+0000 7fa457fff700 1 -- 172.21.2.105:0/1489120963 <== mon.1 v2:172.21.2.115:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fa44806c4b0 con 0x7fa4400037d0 2021-11-12T05:49:40.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.452+0000 7fa45e7fc700 1 --2- 172.21.2.105:0/1489120963 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa444053640 0x7fa444055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:40.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.452+0000 7fa45e7fc700 1 --2- 172.21.2.105:0/1489120963 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa444053640 0x7fa444055b00 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7fa45000b000 tx=0x7fa450008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:40.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.452+0000 7fa457fff700 1 -- 172.21.2.105:0/1489120963 <== mon.1 v2:172.21.2.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa4480433b0 con 0x7fa4400037d0 2021-11-12T05:49:40.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.536+0000 7fa46557c700 1 -- 172.21.2.105:0/1489120963 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa460057350 con 0x7fa4400037d0 2021-11-12T05:49:40.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.540+0000 7fa457fff700 1 -- 172.21.2.105:0/1489120963 <== mon.1 v2:172.21.2.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v146) v1 ==== 100+0+10 (secure 0 0 0) 0x7fa44801c020 con 0x7fa4400037d0 2021-11-12T05:49:40.544 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:49:40.545 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.540+0000 7fa46557c700 1 -- 172.21.2.105:0/1489120963 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa444053640 msgr2=0x7fa444055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:40.545 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.540+0000 7fa46557c700 1 --2- 172.21.2.105:0/1489120963 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa444053640 0x7fa444055b00 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7fa45000b000 tx=0x7fa450008040).stop 2021-11-12T05:49:40.545 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.540+0000 7fa46557c700 1 -- 172.21.2.105:0/1489120963 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa4400037d0 msgr2=0x7fa46013db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:40.546 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.540+0000 7fa46557c700 1 --2- 172.21.2.105:0/1489120963 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa4400037d0 0x7fa46013db20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7fa44800e000 tx=0x7fa44801a000).stop 2021-11-12T05:49:40.546 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.540+0000 7fa46557c700 1 -- 172.21.2.105:0/1489120963 shutdown_connections 2021-11-12T05:49:40.546 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.540+0000 7fa46557c700 1 --2- 172.21.2.105:0/1489120963 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa444053640 0x7fa444055b00 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:40.546 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.540+0000 7fa46557c700 1 --2- 172.21.2.105:0/1489120963 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa46013c0e0 0x7fa46015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:40.546 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.540+0000 7fa46557c700 1 --2- 172.21.2.105:0/1489120963 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa460067920 0x7fa46015a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:40.547 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.540+0000 7fa46557c700 1 --2- 172.21.2.105:0/1489120963 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa4400037d0 0x7fa46013db20 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:40.547 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.540+0000 7fa46557c700 1 -- 172.21.2.105:0/1489120963 >> 172.21.2.105:0/1489120963 conn(0x7fa460062f60 msgr2=0x7fa460143030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:40.547 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.540+0000 7fa46557c700 1 -- 172.21.2.105:0/1489120963 shutdown_connections 2021-11-12T05:49:40.547 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.540+0000 7fa46557c700 1 -- 172.21.2.105:0/1489120963 wait complete. 2021-11-12T05:49:40.551 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-12T05:49:40.552 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:49:40.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.596+0000 7f064a242700 1 Processor -- start 2021-11-12T05:49:40.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.596+0000 7f064a242700 1 -- start start 2021-11-12T05:49:40.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.600+0000 7f064a242700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f06440ac280 0x7f064414b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:40.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.600+0000 7f064a242700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06440ac7b0 con 0x7f06440ad080 2021-11-12T05:49:40.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.600+0000 7f064a242700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06440ac9e0 con 0x7f06440af730 2021-11-12T05:49:40.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.600+0000 7f064a242700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06441488a0 con 0x7f06440ac280 2021-11-12T05:49:40.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.600+0000 7f0642ffd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f06440ac280 0x7f064414b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:40.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.600+0000 7f06437fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f06440ad080 0x7f064414abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34548/0 (socket says 172.21.2.105:34548) 2021-11-12T05:49:40.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.600+0000 7f06437fe700 1 -- 172.21.2.105:0/2908958217 learned_addr learned my addr 172.21.2.105:0/2908958217 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:40.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.600+0000 7f0642ffd700 1 -- 172.21.2.105:0/2908958217 >> v1:172.21.2.115:6789/0 conn(0x7f06440af730 legacy=0x7f0644147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:40.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.600+0000 7f0642ffd700 1 -- 172.21.2.105:0/2908958217 >> v1:172.21.2.105:6789/0 conn(0x7f06440ad080 legacy=0x7f064414abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:40.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.600+0000 7f0642ffd700 1 -- 172.21.2.105:0/2908958217 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06440b0b30 con 0x7f06440ac280 2021-11-12T05:49:40.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.600+0000 7f0642ffd700 1 --2- 172.21.2.105:0/2908958217 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06440ac280 0x7f064414b2f0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 rx=0x7f06440ac6a0 tx=0x7f062c006df0).ready entity=mon.0 client_cookie=646df7b1cd8b1d11 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:40.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.600+0000 7f06427fc700 1 -- 172.21.2.105:0/2908958217 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f062c00d5c0 con 0x7f06440ac280 2021-11-12T05:49:40.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.600+0000 7f06427fc700 1 -- 172.21.2.105:0/2908958217 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062c000e90 con 0x7f06440ac280 2021-11-12T05:49:40.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.600+0000 7f06427fc700 1 -- 172.21.2.105:0/2908958217 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f062c00d910 con 0x7f06440ac280 2021-11-12T05:49:40.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.600+0000 7f064a242700 1 -- 172.21.2.105:0/2908958217 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06440ac280 msgr2=0x7f064414b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:40.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.600+0000 7f064a242700 1 --2- 172.21.2.105:0/2908958217 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06440ac280 0x7f064414b2f0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 rx=0x7f06440ac6a0 tx=0x7f062c006df0).stop 2021-11-12T05:49:40.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.600+0000 7f064a242700 1 -- 172.21.2.105:0/2908958217 shutdown_connections 2021-11-12T05:49:40.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.600+0000 7f064a242700 1 --2- 172.21.2.105:0/2908958217 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06440ac280 0x7f064414b2f0 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:40.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.600+0000 7f064a242700 1 -- 172.21.2.105:0/2908958217 >> 172.21.2.105:0/2908958217 conn(0x7f06440b5370 msgr2=0x7f06440b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:40.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.600+0000 7f064a242700 1 -- 172.21.2.105:0/2908958217 shutdown_connections 2021-11-12T05:49:40.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.600+0000 7f064a242700 1 -- 172.21.2.105:0/2908958217 wait complete. 2021-11-12T05:49:40.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.600+0000 7f064a242700 1 Processor -- start 2021-11-12T05:49:40.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.600+0000 7f064a242700 1 -- start start 2021-11-12T05:49:40.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.600+0000 7f064a242700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f06440ac280 0x7f0644066c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:40.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.600+0000 7f064a242700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f06440ad080 0x7f0644067160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:40.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.600+0000 7f064a242700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06440af730 0x7f06441429a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:40.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.600+0000 7f064a242700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0644156e40 con 0x7f06440af730 2021-11-12T05:49:40.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.600+0000 7f064a242700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06440aaca0 con 0x7f06440ad080 2021-11-12T05:49:40.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.600+0000 7f064a242700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06440a9c70 con 0x7f06440ac280 2021-11-12T05:49:40.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.600+0000 7f0643fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06440af730 0x7f06441429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:40.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.600+0000 7f0643fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06440af730 0x7f06441429a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52394/0 (socket says 172.21.2.105:52394) 2021-11-12T05:49:40.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.600+0000 7f0643fff700 1 -- 172.21.2.105:0/3213743306 learned_addr learned my addr 172.21.2.105:0/3213743306 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:40.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.600+0000 7f0643fff700 1 -- 172.21.2.105:0/3213743306 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f06440ac280 msgr2=0x7f0644066c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:40.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.600+0000 7f0643fff700 1 --2- 172.21.2.105:0/3213743306 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f06440ac280 0x7f0644066c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:40.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.600+0000 7f0643fff700 1 -- 172.21.2.105:0/3213743306 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f06440ad080 msgr2=0x7f0644067160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:40.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.600+0000 7f0643fff700 1 --2- 172.21.2.105:0/3213743306 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f06440ad080 0x7f0644067160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:40.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.600+0000 7f0643fff700 1 -- 172.21.2.105:0/3213743306 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f062c00b180 con 0x7f06440af730 2021-11-12T05:49:40.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.600+0000 7f0643fff700 1 --2- 172.21.2.105:0/3213743306 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06440af730 0x7f06441429a0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 rx=0x7f0644062f50 tx=0x7f063c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:40.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.604+0000 7f0640ff9700 1 -- 172.21.2.105:0/3213743306 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f063c00d4a0 con 0x7f06440af730 2021-11-12T05:49:40.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.604+0000 7f0640ff9700 1 -- 172.21.2.105:0/3213743306 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063c00d600 con 0x7f06440af730 2021-11-12T05:49:40.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.604+0000 7f064a242700 1 -- 172.21.2.105:0/3213743306 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06440a9e90 con 0x7f06440af730 2021-11-12T05:49:40.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.604+0000 7f064a242700 1 -- 172.21.2.105:0/3213743306 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06440abba0 con 0x7f06440af730 2021-11-12T05:49:40.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.604+0000 7f0640ff9700 1 -- 172.21.2.105:0/3213743306 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f063c00d960 con 0x7f06440af730 2021-11-12T05:49:40.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.604+0000 7f064a242700 1 -- 172.21.2.105:0/3213743306 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06440aa020 con 0x7f06440af730 2021-11-12T05:49:40.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.604+0000 7f0640ff9700 1 -- 172.21.2.105:0/3213743306 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f063c018030 con 0x7f06440af730 2021-11-12T05:49:40.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.604+0000 7f0640ff9700 1 --2- 172.21.2.105:0/3213743306 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0628053660 0x7f0628055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:40.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.604+0000 7f0640ff9700 1 -- 172.21.2.105:0/3213743306 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f063c06b470 con 0x7f06440af730 2021-11-12T05:49:40.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.604+0000 7f06437fe700 1 --2- 172.21.2.105:0/3213743306 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0628053660 0x7f0628055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:40.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.604+0000 7f06437fe700 1 --2- 172.21.2.105:0/3213743306 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0628053660 0x7f0628055b20 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f06440b0eb0 tx=0x7f0634007800).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:40.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.604+0000 7f0640ff9700 1 -- 172.21.2.105:0/3213743306 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f063c042420 con 0x7f06440af730 2021-11-12T05:49:40.716 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.712+0000 7f064a242700 1 -- 172.21.2.105:0/3213743306 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06440b1440 con 0x7f06440af730 2021-11-12T05:49:40.717 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.712+0000 7f0640ff9700 1 -- 172.21.2.105:0/3213743306 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f063c045a40 con 0x7f06440af730 2021-11-12T05:49:40.718 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:40.718 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":69,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5066,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/506237043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":506237043},{"type":"v1","addr":"172.21.2.115:6833","nonce":506237043}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":68}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:49:37.422405+0000","modified":"2021-11-12T05:49:38.425999+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8499},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8499":{"gid":8499,"name":"a","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/3394672010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":3394672010},{"type":"v1","addr":"172.21.2.105:6835","nonce":3394672010}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-11-12T05:49:40.719 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.712+0000 7f064a242700 1 -- 172.21.2.105:0/3213743306 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0628053660 msgr2=0x7f0628055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:40.719 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.712+0000 7f064a242700 1 --2- 172.21.2.105:0/3213743306 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0628053660 0x7f0628055b20 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f06440b0eb0 tx=0x7f0634007800).stop 2021-11-12T05:49:40.719 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.712+0000 7f064a242700 1 -- 172.21.2.105:0/3213743306 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06440af730 msgr2=0x7f06441429a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:40.720 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.712+0000 7f064a242700 1 --2- 172.21.2.105:0/3213743306 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06440af730 0x7f06441429a0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 rx=0x7f0644062f50 tx=0x7f063c0090f0).stop 2021-11-12T05:49:40.720 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.712+0000 7f064a242700 1 -- 172.21.2.105:0/3213743306 shutdown_connections 2021-11-12T05:49:40.720 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.712+0000 7f064a242700 1 --2- 172.21.2.105:0/3213743306 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0628053660 0x7f0628055b20 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:40.720 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.712+0000 7f064a242700 1 --2- 172.21.2.105:0/3213743306 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f06440af730 0x7f06441429a0 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:40.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.712+0000 7f064a242700 1 --2- 172.21.2.105:0/3213743306 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f06440ad080 0x7f0644067160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:40.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.712+0000 7f064a242700 1 --2- 172.21.2.105:0/3213743306 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f06440ac280 0x7f0644066c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:40.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.712+0000 7f064a242700 1 -- 172.21.2.105:0/3213743306 >> 172.21.2.105:0/3213743306 conn(0x7f06440b5370 msgr2=0x7f0644146820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:40.721 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.712+0000 7f064a242700 1 -- 172.21.2.105:0/3213743306 shutdown_connections 2021-11-12T05:49:40.722 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:40.712+0000 7f064a242700 1 -- 172.21.2.105:0/3213743306 wait complete. 2021-11-12T05:49:40.722 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 69 2021-11-12T05:49:40.926 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 69, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:49:37.422405+0000', 'modified': '2021-11-12T05:49:38.425999+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8499}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8499': {'gid': 8499, 'name': 'a', 'rank': 0, 'incarnation': 68, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/3394672010', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 3394672010}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 3394672010}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:49:40.927 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:49:40.927 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:49:40.991 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":8499,"want_state":"up:active","state":"up:active","rank_uptime":3.561128509,"mdsmap_epoch":69,"osdmap_epoch":146,"osdmap_epoch_barrier":145,"uptime":7.7560840219999996} 2021-11-12T05:49:40.992 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 8499, "mdsmap_epoch": 69, "osdmap_epoch": 146, "osdmap_epoch_barrier": 145, "rank_uptime": 3.561128509, "state": "up:active", "uptime": 7.756084022, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:49:40.992 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-12T05:49:40.993 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-12T05:49:40.993 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba016.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-12T05:49:40.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:40.994 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:49:41.005 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:49:41.017 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:49:41.017 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:49:41.068 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:49:41.069 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:49:41.070 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:41.070 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:49:41.075 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-12T05:49:41.076 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:49:41.079 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:49:41.088 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:49:41.089 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:49:41.094 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:49:41.094 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:49:41.095 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:41.096 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:49:41.118 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:2021-11-12T05:49:41.113+0000 7fc774c48080 -1 init, newargv = 0x55d6ab91c480 newargc=9 2021-11-12T05:49:41.118 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[15278]: starting ceph client 2021-11-12T05:49:41.133 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[15278]: starting fuse 2021-11-12T05:49:42.222 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:49:42.234 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:49:42.235 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:49:42.283 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:49:42.284 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:49:42.285 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:42.286 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:49:42.291 INFO:teuthology.orchestra.run.gibba016.stdout:52 2021-11-12T05:49:42.291 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-12T05:49:42.292 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:42.292 DEBUG:teuthology.orchestra.run.gibba016:> sudo python3 -c ' 2021-11-12T05:49:42.293 DEBUG:teuthology.orchestra.run.gibba016:> import glob 2021-11-12T05:49:42.293 DEBUG:teuthology.orchestra.run.gibba016:> import re 2021-11-12T05:49:42.293 DEBUG:teuthology.orchestra.run.gibba016:> import os 2021-11-12T05:49:42.294 DEBUG:teuthology.orchestra.run.gibba016:> import subprocess 2021-11-12T05:49:42.294 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:49:42.295 DEBUG:teuthology.orchestra.run.gibba016:> def find_socket(client_name): 2021-11-12T05:49:42.295 DEBUG:teuthology.orchestra.run.gibba016:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-12T05:49:42.296 DEBUG:teuthology.orchestra.run.gibba016:> files = glob.glob(asok_path) 2021-11-12T05:49:42.296 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:49:42.296 DEBUG:teuthology.orchestra.run.gibba016:> # Given a non-glob path, it better be there 2021-11-12T05:49:42.297 DEBUG:teuthology.orchestra.run.gibba016:> if "*" not in asok_path: 2021-11-12T05:49:42.297 DEBUG:teuthology.orchestra.run.gibba016:> assert(len(files) == 1) 2021-11-12T05:49:42.298 DEBUG:teuthology.orchestra.run.gibba016:> return files[0] 2021-11-12T05:49:42.298 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:49:42.298 DEBUG:teuthology.orchestra.run.gibba016:> for f in files: 2021-11-12T05:49:42.299 DEBUG:teuthology.orchestra.run.gibba016:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-12T05:49:42.299 DEBUG:teuthology.orchestra.run.gibba016:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-12T05:49:42.300 DEBUG:teuthology.orchestra.run.gibba016:> return f 2021-11-12T05:49:42.300 DEBUG:teuthology.orchestra.run.gibba016:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-12T05:49:42.300 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:49:42.301 DEBUG:teuthology.orchestra.run.gibba016:> print(find_socket("client.0")) 2021-11-12T05:49:42.301 DEBUG:teuthology.orchestra.run.gibba016:> ' 2021-11-12T05:49:42.356 INFO:teuthology.orchestra.run.gibba016.stdout:/var/run/ceph/ceph-client.0.15278.asok 2021-11-12T05:49:42.359 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.15278.asok 2021-11-12T05:49:42.359 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:42.360 DEBUG:teuthology.orchestra.run.gibba016:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.15278.asok status 2021-11-12T05:49:42.409 INFO:teuthology.orchestra.run.gibba016.stdout:{ 2021-11-12T05:49:42.410 INFO:teuthology.orchestra.run.gibba016.stdout: "metadata": { 2021-11-12T05:49:42.410 INFO:teuthology.orchestra.run.gibba016.stdout: "ceph_sha1": "a81ee2815de5acae59ead5b8c9137b6766fc8ea8", 2021-11-12T05:49:42.410 INFO:teuthology.orchestra.run.gibba016.stdout: "ceph_version": "ceph version 15.2.15-22-ga81ee281 (a81ee2815de5acae59ead5b8c9137b6766fc8ea8) octopus (stable)", 2021-11-12T05:49:42.411 INFO:teuthology.orchestra.run.gibba016.stdout: "entity_id": "0", 2021-11-12T05:49:42.411 INFO:teuthology.orchestra.run.gibba016.stdout: "hostname": "gibba016", 2021-11-12T05:49:42.411 INFO:teuthology.orchestra.run.gibba016.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-12T05:49:42.411 INFO:teuthology.orchestra.run.gibba016.stdout: "pid": "15278", 2021-11-12T05:49:42.412 INFO:teuthology.orchestra.run.gibba016.stdout: "root": "/" 2021-11-12T05:49:42.412 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:49:42.412 INFO:teuthology.orchestra.run.gibba016.stdout: "dentry_count": 0, 2021-11-12T05:49:42.412 INFO:teuthology.orchestra.run.gibba016.stdout: "dentry_pinned_count": 0, 2021-11-12T05:49:42.413 INFO:teuthology.orchestra.run.gibba016.stdout: "id": 8679, 2021-11-12T05:49:42.413 INFO:teuthology.orchestra.run.gibba016.stdout: "inst": { 2021-11-12T05:49:42.413 INFO:teuthology.orchestra.run.gibba016.stdout: "name": { 2021-11-12T05:49:42.413 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "client", 2021-11-12T05:49:42.413 INFO:teuthology.orchestra.run.gibba016.stdout: "num": 8679 2021-11-12T05:49:42.414 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:49:42.414 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": { 2021-11-12T05:49:42.414 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "v1", 2021-11-12T05:49:42.414 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": "172.21.2.116:0", 2021-11-12T05:49:42.415 INFO:teuthology.orchestra.run.gibba016.stdout: "nonce": 2992519347 2021-11-12T05:49:42.415 INFO:teuthology.orchestra.run.gibba016.stdout: } 2021-11-12T05:49:42.415 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:49:42.415 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": { 2021-11-12T05:49:42.415 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "v1", 2021-11-12T05:49:42.416 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": "172.21.2.116:0", 2021-11-12T05:49:42.416 INFO:teuthology.orchestra.run.gibba016.stdout: "nonce": 2992519347 2021-11-12T05:49:42.416 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:49:42.416 INFO:teuthology.orchestra.run.gibba016.stdout: "inst_str": "client.8679 172.21.2.116:0/2992519347", 2021-11-12T05:49:42.417 INFO:teuthology.orchestra.run.gibba016.stdout: "addr_str": "172.21.2.116:0/2992519347", 2021-11-12T05:49:42.417 INFO:teuthology.orchestra.run.gibba016.stdout: "inode_count": 1, 2021-11-12T05:49:42.417 INFO:teuthology.orchestra.run.gibba016.stdout: "mds_epoch": 69, 2021-11-12T05:49:42.417 INFO:teuthology.orchestra.run.gibba016.stdout: "osd_epoch": 146, 2021-11-12T05:49:42.418 INFO:teuthology.orchestra.run.gibba016.stdout: "osd_epoch_barrier": 0, 2021-11-12T05:49:42.418 INFO:teuthology.orchestra.run.gibba016.stdout: "blacklisted": false, 2021-11-12T05:49:42.418 INFO:teuthology.orchestra.run.gibba016.stdout: "fs_name": "cephfs" 2021-11-12T05:49:42.418 INFO:teuthology.orchestra.run.gibba016.stdout:} 2021-11-12T05:49:42.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:42.420 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:49:42.420 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:49:42.426 INFO:teuthology.orchestra.run.gibba016.stdout:fuseblk 2021-11-12T05:49:42.427 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-12T05:49:42.427 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:42.427 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:49:42.477 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:49:42.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.524+0000 7fae2f130700 1 Processor -- start 2021-11-12T05:49:42.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.524+0000 7fae2f130700 1 -- start start 2021-11-12T05:49:42.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.524+0000 7fae2f130700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fae280ad080 0x7fae280af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:42.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.524+0000 7fae2f130700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fae2814b2f0 0x7fae280ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:42.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.524+0000 7fae2f130700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae280ac7b0 con 0x7fae280ac280 2021-11-12T05:49:42.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.524+0000 7fae2f130700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae281488a0 con 0x7fae2814b2f0 2021-11-12T05:49:42.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.524+0000 7fae2f130700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae280ac9e0 con 0x7fae280ad080 2021-11-12T05:49:42.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.524+0000 7fae2d6cd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fae2814b2f0 0x7fae280ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:42.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.524+0000 7fae2d6cd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fae2814b2f0 0x7fae280ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52402/0 (socket says 172.21.2.105:52402) 2021-11-12T05:49:42.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.524+0000 7fae2d6cd700 1 -- 172.21.2.105:0/587315684 learned_addr learned my addr 172.21.2.105:0/587315684 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:42.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.524+0000 7fae2d6cd700 1 -- 172.21.2.105:0/587315684 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fae280ad080 msgr2=0x7fae280af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:42.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.524+0000 7fae2d6cd700 1 --2- 172.21.2.105:0/587315684 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fae280ad080 0x7fae280af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:42.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.524+0000 7fae2d6cd700 1 -- 172.21.2.105:0/587315684 >> v1:172.21.2.115:6789/0 conn(0x7fae280ac280 legacy=0x7fae2814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:42.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.524+0000 7fae2d6cd700 1 -- 172.21.2.105:0/587315684 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae280b0b30 con 0x7fae2814b2f0 2021-11-12T05:49:42.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.524+0000 7fae2d6cd700 1 --2- 172.21.2.105:0/587315684 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fae2814b2f0 0x7fae280ad460 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 rx=0x7fae280b0550 tx=0x7fae20006eb0).ready entity=mon.0 client_cookie=8359b628e027b37b server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:42.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.524+0000 7fae277fe700 1 -- 172.21.2.105:0/587315684 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae2000d570 con 0x7fae2814b2f0 2021-11-12T05:49:42.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.524+0000 7fae277fe700 1 -- 172.21.2.105:0/587315684 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae20000e90 con 0x7fae2814b2f0 2021-11-12T05:49:42.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.524+0000 7fae277fe700 1 -- 172.21.2.105:0/587315684 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae2000d900 con 0x7fae2814b2f0 2021-11-12T05:49:42.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.528+0000 7fae2f130700 1 -- 172.21.2.105:0/587315684 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fae2814b2f0 msgr2=0x7fae280ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:42.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.528+0000 7fae2f130700 1 --2- 172.21.2.105:0/587315684 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fae2814b2f0 0x7fae280ad460 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 rx=0x7fae280b0550 tx=0x7fae20006eb0).stop 2021-11-12T05:49:42.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.528+0000 7fae2f130700 1 -- 172.21.2.105:0/587315684 shutdown_connections 2021-11-12T05:49:42.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.528+0000 7fae2f130700 1 --2- 172.21.2.105:0/587315684 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fae2814b2f0 0x7fae280ad460 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:42.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.528+0000 7fae2f130700 1 --2- 172.21.2.105:0/587315684 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fae280ad080 0x7fae280af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:42.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.528+0000 7fae2f130700 1 -- 172.21.2.105:0/587315684 >> 172.21.2.105:0/587315684 conn(0x7fae280b5370 msgr2=0x7fae280b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:42.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.528+0000 7fae2f130700 1 -- 172.21.2.105:0/587315684 shutdown_connections 2021-11-12T05:49:42.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.528+0000 7fae2f130700 1 -- 172.21.2.105:0/587315684 wait complete. 2021-11-12T05:49:42.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.528+0000 7fae2f130700 1 Processor -- start 2021-11-12T05:49:42.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.528+0000 7fae2f130700 1 -- start start 2021-11-12T05:49:42.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.528+0000 7fae2f130700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fae280ac280 0x7fae281575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:42.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.528+0000 7fae2f130700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fae280ad080 0x7fae28063700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:42.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.528+0000 7fae2f130700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fae2814b2f0 0x7fae28063bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:42.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.528+0000 7fae2f130700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae280a9ed0 con 0x7fae280ad080 2021-11-12T05:49:42.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.528+0000 7fae2f130700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae28157c10 con 0x7fae280ac280 2021-11-12T05:49:42.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.528+0000 7fae2f130700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae280a9510 con 0x7fae2814b2f0 2021-11-12T05:49:42.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.528+0000 7fae27fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fae280ad080 0x7fae28063700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:42.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.528+0000 7fae27fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fae280ad080 0x7fae28063700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52406/0 (socket says 172.21.2.105:52406) 2021-11-12T05:49:42.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.528+0000 7fae27fff700 1 -- 172.21.2.105:0/130012554 learned_addr learned my addr 172.21.2.105:0/130012554 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:42.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.528+0000 7fae2d6cd700 1 --2- 172.21.2.105:0/130012554 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fae2814b2f0 0x7fae28063bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:42.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.528+0000 7fae2cecc700 1 --2- 172.21.2.105:0/130012554 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fae280ac280 0x7fae281575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:42.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.528+0000 7fae27fff700 1 -- 172.21.2.105:0/130012554 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fae2814b2f0 msgr2=0x7fae28063bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:42.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.528+0000 7fae27fff700 1 --2- 172.21.2.105:0/130012554 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fae2814b2f0 0x7fae28063bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:42.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.528+0000 7fae27fff700 1 -- 172.21.2.105:0/130012554 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fae280ac280 msgr2=0x7fae281575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:42.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.528+0000 7fae27fff700 1 --2- 172.21.2.105:0/130012554 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fae280ac280 0x7fae281575a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:42.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.528+0000 7fae27fff700 1 -- 172.21.2.105:0/130012554 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae2000b1e0 con 0x7fae280ad080 2021-11-12T05:49:42.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.528+0000 7fae27fff700 1 --2- 172.21.2.105:0/130012554 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fae280ad080 0x7fae28063700 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 rx=0x7fae18003310 tx=0x7fae180091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:42.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.528+0000 7fae25ffb700 1 -- 172.21.2.105:0/130012554 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae180016f0 con 0x7fae280ad080 2021-11-12T05:49:42.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.528+0000 7fae25ffb700 1 -- 172.21.2.105:0/130012554 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae18001850 con 0x7fae280ad080 2021-11-12T05:49:42.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.528+0000 7fae25ffb700 1 -- 172.21.2.105:0/130012554 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae18001bb0 con 0x7fae280ad080 2021-11-12T05:49:42.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.528+0000 7fae2f130700 1 -- 172.21.2.105:0/130012554 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae280a97b0 con 0x7fae280ad080 2021-11-12T05:49:42.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.528+0000 7fae2f130700 1 -- 172.21.2.105:0/130012554 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae280a8250 con 0x7fae280ad080 2021-11-12T05:49:42.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.528+0000 7fae2f130700 1 -- 172.21.2.105:0/130012554 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae280b1440 con 0x7fae280ad080 2021-11-12T05:49:42.545 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.528+0000 7fae25ffb700 1 -- 172.21.2.105:0/130012554 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fae18018030 con 0x7fae280ad080 2021-11-12T05:49:42.545 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.532+0000 7fae25ffb700 1 --2- 172.21.2.105:0/130012554 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fae08053720 0x7fae08055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:42.545 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.532+0000 7fae25ffb700 1 -- 172.21.2.105:0/130012554 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fae1806b9d0 con 0x7fae280ad080 2021-11-12T05:49:42.545 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.532+0000 7fae2cecc700 1 --2- 172.21.2.105:0/130012554 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fae08053720 0x7fae08055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:42.546 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.532+0000 7fae2cecc700 1 --2- 172.21.2.105:0/130012554 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fae08053720 0x7fae08055be0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7fae1c00a000 tx=0x7fae1c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:42.546 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.532+0000 7fae25ffb700 1 -- 172.21.2.105:0/130012554 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fae18041e90 con 0x7fae280ad080 2021-11-12T05:49:42.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.616+0000 7fae2f130700 1 -- 172.21.2.105:0/130012554 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae28057350 con 0x7fae280ad080 2021-11-12T05:49:42.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.616+0000 7fae25ffb700 1 -- 172.21.2.105:0/130012554 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) v1 ==== 74+0+16285 (secure 0 0 0) 0x7fae18023fb0 con 0x7fae280ad080 2021-11-12T05:49:42.620 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:42.620 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":146,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:49:38.427121+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:49:35.238196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"145","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-11-12T05:49:36.389415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"146","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:49:42.621 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.616+0000 7fae2f130700 1 -- 172.21.2.105:0/130012554 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fae08053720 msgr2=0x7fae08055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:42.621 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.616+0000 7fae2f130700 1 --2- 172.21.2.105:0/130012554 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fae08053720 0x7fae08055be0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7fae1c00a000 tx=0x7fae1c008040).stop 2021-11-12T05:49:42.622 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.616+0000 7fae2f130700 1 -- 172.21.2.105:0/130012554 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fae280ad080 msgr2=0x7fae28063700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:42.622 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.616+0000 7fae2f130700 1 --2- 172.21.2.105:0/130012554 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fae280ad080 0x7fae28063700 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 rx=0x7fae18003310 tx=0x7fae180091d0).stop 2021-11-12T05:49:42.622 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.616+0000 7fae2f130700 1 -- 172.21.2.105:0/130012554 shutdown_connections 2021-11-12T05:49:42.622 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.616+0000 7fae2f130700 1 --2- 172.21.2.105:0/130012554 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fae08053720 0x7fae08055be0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:42.623 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.616+0000 7fae2f130700 1 --2- 172.21.2.105:0/130012554 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fae2814b2f0 0x7fae28063bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:42.623 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.616+0000 7fae2f130700 1 --2- 172.21.2.105:0/130012554 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fae280ad080 0x7fae28063700 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:42.623 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.616+0000 7fae2f130700 1 --2- 172.21.2.105:0/130012554 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fae280ac280 0x7fae281575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:42.623 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.616+0000 7fae2f130700 1 -- 172.21.2.105:0/130012554 >> 172.21.2.105:0/130012554 conn(0x7fae280b5370 msgr2=0x7fae2814aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:42.624 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.616+0000 7fae2f130700 1 -- 172.21.2.105:0/130012554 shutdown_connections 2021-11-12T05:49:42.624 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.616+0000 7fae2f130700 1 -- 172.21.2.105:0/130012554 wait complete. 2021-11-12T05:49:42.627 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 27, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-12T05:49:35.238196+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '145', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 28, 'pool_name': 'cephfs_data', 'create_time': '2021-11-12T05:49:36.389415+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '146', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-12T05:49:42.628 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:49:42.680 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.676+0000 7f1442cb3700 1 Processor -- start 2021-11-12T05:49:42.681 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.676+0000 7f1442cb3700 1 -- start start 2021-11-12T05:49:42.681 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.676+0000 7f1442cb3700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f143c05fdc0 0x7f143c0b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:42.681 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.676+0000 7f1442cb3700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f143c0b06e0 0x7f143c0601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:42.681 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.676+0000 7f1442cb3700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f143c0ae9e0 con 0x7f143c0af0b0 2021-11-12T05:49:42.682 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.676+0000 7f1442cb3700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f143c0b31f0 con 0x7f143c05fdc0 2021-11-12T05:49:42.682 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.676+0000 7f1442cb3700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f143c067cb0 con 0x7f143c0b06e0 2021-11-12T05:49:42.684 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.676+0000 7f1440a4f700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f143c05fdc0 0x7f143c0b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:42.684 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.676+0000 7f1440a4f700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f143c05fdc0 0x7f143c0b1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52412/0 (socket says 172.21.2.105:52412) 2021-11-12T05:49:42.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.676+0000 7f1440a4f700 1 -- 172.21.2.105:0/2649678280 learned_addr learned my addr 172.21.2.105:0/2649678280 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:42.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.676+0000 7f1440a4f700 1 -- 172.21.2.105:0/2649678280 >> v2:172.21.2.115:3300/0 conn(0x7f143c0b06e0 msgr2=0x7f143c0601a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:49:42.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.676+0000 7f1440a4f700 1 --2- 172.21.2.105:0/2649678280 >> v2:172.21.2.115:3300/0 conn(0x7f143c0b06e0 0x7f143c0601a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:42.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.676+0000 7f1440a4f700 1 -- 172.21.2.105:0/2649678280 >> v1:172.21.2.115:6789/0 conn(0x7f143c0af0b0 legacy=0x7f143c1425d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:49:42.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.676+0000 7f1440a4f700 1 -- 172.21.2.105:0/2649678280 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f143c0b0bf0 con 0x7f143c05fdc0 2021-11-12T05:49:42.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.676+0000 7f1440a4f700 1 --2- 172.21.2.105:0/2649678280 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f143c05fdc0 0x7f143c0b1200 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 rx=0x7f143c061f70 tx=0x7f142c006f40).ready entity=mon.0 client_cookie=2875450034359ecc server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:42.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.676+0000 7f143b7fe700 1 -- 172.21.2.105:0/2649678280 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f142c010070 con 0x7f143c05fdc0 2021-11-12T05:49:42.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.676+0000 7f143b7fe700 1 -- 172.21.2.105:0/2649678280 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142c000e90 con 0x7f143c05fdc0 2021-11-12T05:49:42.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.676+0000 7f143b7fe700 1 -- 172.21.2.105:0/2649678280 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f142c008860 con 0x7f143c05fdc0 2021-11-12T05:49:42.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.676+0000 7f1442cb3700 1 -- 172.21.2.105:0/2649678280 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f143c05fdc0 msgr2=0x7f143c0b1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:42.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.676+0000 7f1442cb3700 1 --2- 172.21.2.105:0/2649678280 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f143c05fdc0 0x7f143c0b1200 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 rx=0x7f143c061f70 tx=0x7f142c006f40).stop 2021-11-12T05:49:42.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.676+0000 7f1442cb3700 1 -- 172.21.2.105:0/2649678280 shutdown_connections 2021-11-12T05:49:42.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.676+0000 7f1442cb3700 1 --2- 172.21.2.105:0/2649678280 >> v2:172.21.2.115:3300/0 conn(0x7f143c0b06e0 0x7f143c0601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:42.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.676+0000 7f1442cb3700 1 --2- 172.21.2.105:0/2649678280 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f143c05fdc0 0x7f143c0b1200 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:42.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.676+0000 7f1442cb3700 1 -- 172.21.2.105:0/2649678280 >> 172.21.2.105:0/2649678280 conn(0x7f143c0632b0 msgr2=0x7f143c05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:42.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.676+0000 7f1442cb3700 1 -- 172.21.2.105:0/2649678280 shutdown_connections 2021-11-12T05:49:42.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.676+0000 7f1442cb3700 1 -- 172.21.2.105:0/2649678280 wait complete. 2021-11-12T05:49:42.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.676+0000 7f1442cb3700 1 Processor -- start 2021-11-12T05:49:42.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.680+0000 7f1442cb3700 1 -- start start 2021-11-12T05:49:42.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.680+0000 7f1442cb3700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f143c05fdc0 0x7f143c0659e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:42.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.680+0000 7f1442cb3700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f143c0af0b0 0x7f143c1404d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:42.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.680+0000 7f1442cb3700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f143c0b06e0 0x7f143c1409c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:42.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.680+0000 7f1442cb3700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143c0666a0 con 0x7f143c0b06e0 2021-11-12T05:49:42.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.680+0000 7f1442cb3700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143c0653c0 con 0x7f143c0af0b0 2021-11-12T05:49:42.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.680+0000 7f1442cb3700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f143c0650e0 con 0x7f143c05fdc0 2021-11-12T05:49:42.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.680+0000 7f1441250700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f143c0b06e0 0x7f143c1409c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:42.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.680+0000 7f1441250700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f143c0b06e0 0x7f143c1409c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52420/0 (socket says 172.21.2.105:52420) 2021-11-12T05:49:42.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.680+0000 7f1441250700 1 -- 172.21.2.105:0/393728696 learned_addr learned my addr 172.21.2.105:0/393728696 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:42.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.680+0000 7f1441250700 1 -- 172.21.2.105:0/393728696 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f143c05fdc0 msgr2=0x7f143c0659e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:49:42.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.680+0000 7f1441250700 1 --2- 172.21.2.105:0/393728696 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f143c05fdc0 0x7f143c0659e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:42.692 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.680+0000 7f1441250700 1 -- 172.21.2.105:0/393728696 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f143c0af0b0 msgr2=0x7f143c1404d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:49:42.692 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.680+0000 7f1441250700 1 --2- 172.21.2.105:0/393728696 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f143c0af0b0 0x7f143c1404d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:42.692 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.680+0000 7f1441250700 1 -- 172.21.2.105:0/393728696 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f142c008240 con 0x7f143c0b06e0 2021-11-12T05:49:42.692 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.680+0000 7f1441250700 1 --2- 172.21.2.105:0/393728696 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f143c0b06e0 0x7f143c1409c0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 rx=0x7f1434003330 tx=0x7f14340091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:42.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.680+0000 7f1439ffb700 1 -- 172.21.2.105:0/393728696 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1434001520 con 0x7f143c0b06e0 2021-11-12T05:49:42.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.680+0000 7f1439ffb700 1 -- 172.21.2.105:0/393728696 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1434001680 con 0x7f143c0b06e0 2021-11-12T05:49:42.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.680+0000 7f1442cb3700 1 -- 172.21.2.105:0/393728696 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f143c063a50 con 0x7f143c0b06e0 2021-11-12T05:49:42.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.680+0000 7f1442cb3700 1 -- 172.21.2.105:0/393728696 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f143c064e50 con 0x7f143c0b06e0 2021-11-12T05:49:42.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.680+0000 7f1439ffb700 1 -- 172.21.2.105:0/393728696 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14340019e0 con 0x7f143c0b06e0 2021-11-12T05:49:42.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.680+0000 7f1439ffb700 1 -- 172.21.2.105:0/393728696 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1434018030 con 0x7f143c0b06e0 2021-11-12T05:49:42.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.680+0000 7f1442cb3700 1 -- 172.21.2.105:0/393728696 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f143c063e90 con 0x7f143c0b06e0 2021-11-12T05:49:42.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.680+0000 7f1439ffb700 1 --2- 172.21.2.105:0/393728696 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f141c0536f0 0x7f141c055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:42.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.680+0000 7f1439ffb700 1 -- 172.21.2.105:0/393728696 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f143406b5d0 con 0x7f143c0b06e0 2021-11-12T05:49:42.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.680+0000 7f1440a4f700 1 --2- 172.21.2.105:0/393728696 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f141c0536f0 0x7f141c055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:42.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.680+0000 7f1440a4f700 1 --2- 172.21.2.105:0/393728696 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f141c0536f0 0x7f141c055bb0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f143c061f70 tx=0x7f143c0ad7f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:42.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.684+0000 7f1439ffb700 1 -- 172.21.2.105:0/393728696 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1434042580 con 0x7f143c0b06e0 2021-11-12T05:49:42.772 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.768+0000 7f1442cb3700 1 -- 172.21.2.105:0/393728696 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f143c0aec10 con 0x7f143c0b06e0 2021-11-12T05:49:42.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.768+0000 7f1439ffb700 1 -- 172.21.2.105:0/393728696 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v146) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1434045ba0 con 0x7f143c0b06e0 2021-11-12T05:49:42.773 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:49:42.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.768+0000 7f1442cb3700 1 -- 172.21.2.105:0/393728696 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f141c0536f0 msgr2=0x7f141c055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:42.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.768+0000 7f1442cb3700 1 --2- 172.21.2.105:0/393728696 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f141c0536f0 0x7f141c055bb0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f143c061f70 tx=0x7f143c0ad7f0).stop 2021-11-12T05:49:42.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.768+0000 7f1442cb3700 1 -- 172.21.2.105:0/393728696 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f143c0b06e0 msgr2=0x7f143c1409c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:42.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.768+0000 7f1442cb3700 1 --2- 172.21.2.105:0/393728696 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f143c0b06e0 0x7f143c1409c0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 rx=0x7f1434003330 tx=0x7f14340091a0).stop 2021-11-12T05:49:42.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.768+0000 7f1442cb3700 1 -- 172.21.2.105:0/393728696 shutdown_connections 2021-11-12T05:49:42.776 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.768+0000 7f1442cb3700 1 --2- 172.21.2.105:0/393728696 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f141c0536f0 0x7f141c055bb0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:42.776 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.768+0000 7f1442cb3700 1 --2- 172.21.2.105:0/393728696 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f143c0b06e0 0x7f143c1409c0 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:42.776 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.768+0000 7f1442cb3700 1 --2- 172.21.2.105:0/393728696 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f143c0af0b0 0x7f143c1404d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:42.776 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.768+0000 7f1442cb3700 1 --2- 172.21.2.105:0/393728696 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f143c05fdc0 0x7f143c0659e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:42.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.768+0000 7f1442cb3700 1 -- 172.21.2.105:0/393728696 >> 172.21.2.105:0/393728696 conn(0x7f143c0632b0 msgr2=0x7f143c0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:42.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.768+0000 7f1442cb3700 1 -- 172.21.2.105:0/393728696 shutdown_connections 2021-11-12T05:49:42.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.768+0000 7f1442cb3700 1 -- 172.21.2.105:0/393728696 wait complete. 2021-11-12T05:49:42.781 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:49:42.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.828+0000 7f118c740700 1 Processor -- start 2021-11-12T05:49:42.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.828+0000 7f118c740700 1 -- start start 2021-11-12T05:49:42.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.828+0000 7f118c740700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f11840b06e0 0x7f11840b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:42.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.828+0000 7f118c740700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11840ae9e0 con 0x7f11840601a0 2021-11-12T05:49:42.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.828+0000 7f118c740700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11840af7c0 con 0x7f118405fdc0 2021-11-12T05:49:42.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.828+0000 7f118c740700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11840b31f0 con 0x7f11840b06e0 2021-11-12T05:49:42.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.828+0000 7f118acdd700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f11840601a0 0x7f118413e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34592/0 (socket says 172.21.2.105:34592) 2021-11-12T05:49:42.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.828+0000 7f118acdd700 1 -- 172.21.2.105:0/751644439 learned_addr learned my addr 172.21.2.105:0/751644439 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:42.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.828+0000 7f11894da700 1 -- 172.21.2.105:0/751644439 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3325909525 0 0) 0x7f11840ae9e0 con 0x7f11840601a0 2021-11-12T05:49:42.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.828+0000 7f11894da700 1 -- 172.21.2.105:0/751644439 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f116c003260 con 0x7f11840601a0 2021-11-12T05:49:42.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.828+0000 7f11894da700 1 -- 172.21.2.105:0/751644439 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1622265486 0 0) 0x7f116c003260 con 0x7f11840601a0 2021-11-12T05:49:42.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.828+0000 7f11894da700 1 -- 172.21.2.105:0/751644439 >> v2:172.21.2.115:3300/0 conn(0x7f11840b06e0 msgr2=0x7f11840b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:42.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.828+0000 7f11894da700 1 --2- 172.21.2.105:0/751644439 >> v2:172.21.2.115:3300/0 conn(0x7f11840b06e0 0x7f11840b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:42.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.828+0000 7f11894da700 1 -- 172.21.2.105:0/751644439 >> v1:172.21.2.115:6789/0 conn(0x7f118405fdc0 legacy=0x7f11840af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:42.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.828+0000 7f11894da700 1 -- 172.21.2.105:0/751644439 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1184067cb0 con 0x7f11840601a0 2021-11-12T05:49:42.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.828+0000 7f11894da700 1 -- 172.21.2.105:0/751644439 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f117c0019e0 con 0x7f11840601a0 2021-11-12T05:49:42.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.828+0000 7f11894da700 1 -- 172.21.2.105:0/751644439 >> v1:172.21.2.105:6789/0 conn(0x7f11840601a0 legacy=0x7f118413e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:42.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.828+0000 7f11894da700 1 --2- 172.21.2.105:0/751644439 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f116c003820 0x7f116c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:42.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.828+0000 7f11894da700 1 --2- 172.21.2.105:0/751644439 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f116c004500 0x7f116c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:42.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.828+0000 7f11894da700 1 --2- 172.21.2.105:0/751644439 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f116c005050 0x7f116c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:42.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.828+0000 7f11894da700 1 -- 172.21.2.105:0/751644439 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11840b31f0 con 0x7f116c003820 2021-11-12T05:49:42.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.828+0000 7f11894da700 1 -- 172.21.2.105:0/751644439 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116c00bf40 con 0x7f116c005050 2021-11-12T05:49:42.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.828+0000 7f11894da700 1 -- 172.21.2.105:0/751644439 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f116c00d210 con 0x7f116c004500 2021-11-12T05:49:42.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.828+0000 7f118a4dc700 1 --2- 172.21.2.105:0/751644439 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f116c003820 0x7f116c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:42.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f118a4dc700 1 -- 172.21.2.105:0/751644439 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f116c004500 msgr2=0x7f116c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:42.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f118a4dc700 1 --2- 172.21.2.105:0/751644439 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f116c004500 0x7f116c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:42.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f118a4dc700 1 -- 172.21.2.105:0/751644439 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f116c005050 msgr2=0x7f116c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:42.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f118a4dc700 1 --2- 172.21.2.105:0/751644439 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f116c005050 0x7f116c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:42.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f118acdd700 1 -- 172.21.2.105:0/751644439 reap_dead start 2021-11-12T05:49:42.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f118a4dc700 1 -- 172.21.2.105:0/751644439 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f116c003260 con 0x7f116c003820 2021-11-12T05:49:42.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f118a4dc700 1 --2- 172.21.2.105:0/751644439 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f116c003820 0x7f116c003c20 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 rx=0x7f1180001fa0 tx=0x7f1180007a00).ready entity=mon.0 client_cookie=d19a512e8e29aa6e server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:42.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f11894da700 1 -- 172.21.2.105:0/751644439 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1180007070 con 0x7f116c003820 2021-11-12T05:49:42.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f11894da700 1 -- 172.21.2.105:0/751644439 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11800071d0 con 0x7f116c003820 2021-11-12T05:49:42.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f11894da700 1 -- 172.21.2.105:0/751644439 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1180006510 con 0x7f116c003820 2021-11-12T05:49:42.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f118c740700 1 -- 172.21.2.105:0/751644439 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f116c003820 msgr2=0x7f116c003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:42.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f118c740700 1 --2- 172.21.2.105:0/751644439 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f116c003820 0x7f116c003c20 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 rx=0x7f1180001fa0 tx=0x7f1180007a00).stop 2021-11-12T05:49:42.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f118c740700 1 -- 172.21.2.105:0/751644439 shutdown_connections 2021-11-12T05:49:42.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f118c740700 1 --2- 172.21.2.105:0/751644439 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f116c003820 0x7f116c003c20 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:42.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f118c740700 1 -- 172.21.2.105:0/751644439 >> 172.21.2.105:0/751644439 conn(0x7f11840632b0 msgr2=0x7f118405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:42.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f118c740700 1 -- 172.21.2.105:0/751644439 shutdown_connections 2021-11-12T05:49:42.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f118c740700 1 -- 172.21.2.105:0/751644439 wait complete. 2021-11-12T05:49:42.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f118c740700 1 Processor -- start 2021-11-12T05:49:42.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f118c740700 1 -- start start 2021-11-12T05:49:42.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f118c740700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f116c003820 0x7f1184066610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:42.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f118c740700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f11841430d0 0x7f118413f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:42.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f118c740700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f118413fb10 0x7f11841458a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:42.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f118c740700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1184153220 con 0x7f11841430d0 2021-11-12T05:49:42.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f118c740700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1184142130 con 0x7f116c003820 2021-11-12T05:49:42.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f118c740700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1184142360 con 0x7f118413fb10 2021-11-12T05:49:42.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f1189cdb700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f11841430d0 0x7f118413f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:42.853 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f1189cdb700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f11841430d0 0x7f118413f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52438/0 (socket says 172.21.2.105:52438) 2021-11-12T05:49:42.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f1189cdb700 1 -- 172.21.2.105:0/3792690280 learned_addr learned my addr 172.21.2.105:0/3792690280 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:42.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f1189cdb700 1 -- 172.21.2.105:0/3792690280 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f118413fb10 msgr2=0x7f11841458a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:42.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f1189cdb700 1 --2- 172.21.2.105:0/3792690280 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f118413fb10 0x7f11841458a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:42.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f1189cdb700 1 -- 172.21.2.105:0/3792690280 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f116c003820 msgr2=0x7f1184066610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:42.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f1189cdb700 1 --2- 172.21.2.105:0/3792690280 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f116c003820 0x7f1184066610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:42.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f1189cdb700 1 -- 172.21.2.105:0/3792690280 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118413ffc0 con 0x7f11841430d0 2021-11-12T05:49:42.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f1189cdb700 1 --2- 172.21.2.105:0/3792690280 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f11841430d0 0x7f118413f620 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 rx=0x7f1178002f70 tx=0x7f1178006db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:42.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f11777fe700 1 -- 172.21.2.105:0/3792690280 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1178009e80 con 0x7f11841430d0 2021-11-12T05:49:42.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f11777fe700 1 -- 172.21.2.105:0/3792690280 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1178013460 con 0x7f11841430d0 2021-11-12T05:49:42.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f118c740700 1 -- 172.21.2.105:0/3792690280 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1184066b00 con 0x7f11841430d0 2021-11-12T05:49:42.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f118c740700 1 -- 172.21.2.105:0/3792690280 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11841523c0 con 0x7f11841430d0 2021-11-12T05:49:42.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f11777fe700 1 -- 172.21.2.105:0/3792690280 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11780137c0 con 0x7f11841430d0 2021-11-12T05:49:42.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f118c740700 1 -- 172.21.2.105:0/3792690280 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1184057350 con 0x7f11841430d0 2021-11-12T05:49:42.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f11777fe700 1 -- 172.21.2.105:0/3792690280 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f117801a060 con 0x7f11841430d0 2021-11-12T05:49:42.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f11777fe700 1 --2- 172.21.2.105:0/3792690280 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1164053690 0x7f1164055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:42.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f11777fe700 1 -- 172.21.2.105:0/3792690280 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f117806b3b0 con 0x7f11841430d0 2021-11-12T05:49:42.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.832+0000 7f118a4dc700 1 --2- 172.21.2.105:0/3792690280 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1164053690 0x7f1164055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:42.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.836+0000 7f118a4dc700 1 --2- 172.21.2.105:0/3792690280 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1164053690 0x7f1164055b50 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f1180001fa0 tx=0x7f1180015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:42.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.836+0000 7f11777fe700 1 -- 172.21.2.105:0/3792690280 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f11780423c0 con 0x7f11841430d0 2021-11-12T05:49:42.924 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.920+0000 7f118c740700 1 -- 172.21.2.105:0/3792690280 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1184069a70 con 0x7f11841430d0 2021-11-12T05:49:42.925 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.920+0000 7f11777fe700 1 -- 172.21.2.105:0/3792690280 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v146) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1178018020 con 0x7f11841430d0 2021-11-12T05:49:42.925 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:49:42.926 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.920+0000 7f118c740700 1 -- 172.21.2.105:0/3792690280 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1164053690 msgr2=0x7f1164055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:42.927 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.920+0000 7f118c740700 1 --2- 172.21.2.105:0/3792690280 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1164053690 0x7f1164055b50 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f1180001fa0 tx=0x7f1180015000).stop 2021-11-12T05:49:42.927 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.920+0000 7f118c740700 1 -- 172.21.2.105:0/3792690280 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f11841430d0 msgr2=0x7f118413f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:42.927 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.920+0000 7f118c740700 1 --2- 172.21.2.105:0/3792690280 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f11841430d0 0x7f118413f620 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 rx=0x7f1178002f70 tx=0x7f1178006db0).stop 2021-11-12T05:49:42.927 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.920+0000 7f118c740700 1 -- 172.21.2.105:0/3792690280 shutdown_connections 2021-11-12T05:49:42.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.920+0000 7f118c740700 1 --2- 172.21.2.105:0/3792690280 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1164053690 0x7f1164055b50 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:42.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.920+0000 7f118c740700 1 --2- 172.21.2.105:0/3792690280 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f118413fb10 0x7f11841458a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:42.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.920+0000 7f118c740700 1 --2- 172.21.2.105:0/3792690280 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f11841430d0 0x7f118413f620 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:42.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.920+0000 7f118c740700 1 --2- 172.21.2.105:0/3792690280 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f116c003820 0x7f1184066610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:42.929 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.920+0000 7f118c740700 1 -- 172.21.2.105:0/3792690280 >> 172.21.2.105:0/3792690280 conn(0x7f11840632b0 msgr2=0x7f11840b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:42.929 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.920+0000 7f118c740700 1 -- 172.21.2.105:0/3792690280 shutdown_connections 2021-11-12T05:49:42.929 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.920+0000 7f118c740700 1 -- 172.21.2.105:0/3792690280 wait complete. 2021-11-12T05:49:42.933 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-12T05:49:42.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.980+0000 7ff38ac4a700 1 Processor -- start 2021-11-12T05:49:42.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.980+0000 7ff38ac4a700 1 -- start start 2021-11-12T05:49:42.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.980+0000 7ff38ac4a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff384062ac0 0x7ff3840b6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:42.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.980+0000 7ff38ac4a700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7ff38413ef20 0x7ff3840ae740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:42.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.980+0000 7ff38ac4a700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3840b6570 con 0x7ff3840b0130 2021-11-12T05:49:42.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.980+0000 7ff38ac4a700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3840b56a0 con 0x7ff38413ef20 2021-11-12T05:49:42.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.980+0000 7ff38ac4a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3840b5940 con 0x7ff384062ac0 2021-11-12T05:49:42.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.980+0000 7ff383fff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7ff3840b0130 0x7ff384138c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34610/0 (socket says 172.21.2.105:34610) 2021-11-12T05:49:42.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.980+0000 7ff383fff700 1 -- 172.21.2.105:0/987222743 learned_addr learned my addr 172.21.2.105:0/987222743 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:42.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.980+0000 7ff3837fe700 1 -- 172.21.2.105:0/987222743 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1120538144 0 0) 0x7ff3840b6570 con 0x7ff3840b0130 2021-11-12T05:49:42.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.980+0000 7ff3837fe700 1 -- 172.21.2.105:0/987222743 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff364003260 con 0x7ff3840b0130 2021-11-12T05:49:42.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff3837fe700 1 -- 172.21.2.105:0/987222743 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1788660712 0 0) 0x7ff364003260 con 0x7ff3840b0130 2021-11-12T05:49:42.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff3837fe700 1 -- 172.21.2.105:0/987222743 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff384062ac0 msgr2=0x7ff3840b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:42.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff3837fe700 1 --2- 172.21.2.105:0/987222743 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff384062ac0 0x7ff3840b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:42.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff3837fe700 1 -- 172.21.2.105:0/987222743 >> v2:172.21.2.115:3300/0 conn(0x7ff38413ef20 msgr2=0x7ff3840ae740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:42.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff3837fe700 1 --2- 172.21.2.105:0/987222743 >> v2:172.21.2.115:3300/0 conn(0x7ff38413ef20 0x7ff3840ae740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:42.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff3837fe700 1 -- 172.21.2.105:0/987222743 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3840b5be0 con 0x7ff3840b0130 2021-11-12T05:49:42.991 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff3837fe700 1 -- 172.21.2.105:0/987222743 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7ff36c001660 con 0x7ff3840b0130 2021-11-12T05:49:42.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff3837fe700 1 -- 172.21.2.105:0/987222743 >> v1:172.21.2.105:6789/0 conn(0x7ff3840b0130 legacy=0x7ff384138c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:42.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff3837fe700 1 --2- 172.21.2.105:0/987222743 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff364003750 0x7ff364003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:42.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff3837fe700 1 --2- 172.21.2.105:0/987222743 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff384062ac0 0x7ff364004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:42.992 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff3837fe700 1 --2- 172.21.2.105:0/987222743 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff364004b10 0x7ff364004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:42.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff3837fe700 1 -- 172.21.2.105:0/987222743 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3840b56a0 con 0x7ff364003750 2021-11-12T05:49:42.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff3837fe700 1 -- 172.21.2.105:0/987222743 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3840b5940 con 0x7ff364004b10 2021-11-12T05:49:42.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff3837fe700 1 -- 172.21.2.105:0/987222743 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff364005980 con 0x7ff384062ac0 2021-11-12T05:49:42.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff3889e6700 1 --2- 172.21.2.105:0/987222743 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff364003750 0x7ff364003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:42.993 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff3889e6700 1 -- 172.21.2.105:0/987222743 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff384062ac0 msgr2=0x7ff364004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:42.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff3889e6700 1 --2- 172.21.2.105:0/987222743 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff384062ac0 0x7ff364004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:42.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff3889e6700 1 -- 172.21.2.105:0/987222743 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff364004b10 msgr2=0x7ff364004f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:42.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff3889e6700 1 --2- 172.21.2.105:0/987222743 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff364004b10 0x7ff364004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:42.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff3889e6700 1 -- 172.21.2.105:0/987222743 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff364003260 con 0x7ff364003750 2021-11-12T05:49:42.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff3889e6700 1 --2- 172.21.2.105:0/987222743 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff364003750 0x7ff364003b70 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 rx=0x7ff374002f70 tx=0x7ff374006ca0).ready entity=mon.0 client_cookie=b7d48251622029d0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:42.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff3837fe700 1 -- 172.21.2.105:0/987222743 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff374012410 con 0x7ff364003750 2021-11-12T05:49:42.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff3837fe700 1 -- 172.21.2.105:0/987222743 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff374012570 con 0x7ff364003750 2021-11-12T05:49:42.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff3837fe700 1 -- 172.21.2.105:0/987222743 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3740128d0 con 0x7ff364003750 2021-11-12T05:49:42.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff38ac4a700 1 -- 172.21.2.105:0/987222743 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff364003750 msgr2=0x7ff364003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:42.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff38ac4a700 1 --2- 172.21.2.105:0/987222743 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff364003750 0x7ff364003b70 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 rx=0x7ff374002f70 tx=0x7ff374006ca0).stop 2021-11-12T05:49:42.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff3891e7700 1 -- 172.21.2.105:0/987222743 reap_dead start 2021-11-12T05:49:42.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff38ac4a700 1 -- 172.21.2.105:0/987222743 shutdown_connections 2021-11-12T05:49:42.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff38ac4a700 1 -- 172.21.2.105:0/987222743 >> 172.21.2.105:0/987222743 conn(0x7ff38405c490 msgr2=0x7ff38405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:42.996 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff38ac4a700 1 -- 172.21.2.105:0/987222743 shutdown_connections 2021-11-12T05:49:42.997 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff38ac4a700 1 -- 172.21.2.105:0/987222743 wait complete. 2021-11-12T05:49:42.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff38ac4a700 1 Processor -- start 2021-11-12T05:49:43.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff38ac4a700 1 -- start start 2021-11-12T05:49:43.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff38ac4a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff364003750 0x7ff384136950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:43.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff38ac4a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff384141bb0 0x7ff384142010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:43.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff38ac4a700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff38413a1f0 0x7ff38413a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:43.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff38ac4a700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff384140a40 con 0x7ff364003750 2021-11-12T05:49:43.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff38ac4a700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff384140500 con 0x7ff38413a1f0 2021-11-12T05:49:43.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff38ac4a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3841407a0 con 0x7ff384141bb0 2021-11-12T05:49:43.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff3889e6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff364003750 0x7ff384136950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:43.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff3889e6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff364003750 0x7ff384136950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52458/0 (socket says 172.21.2.105:52458) 2021-11-12T05:49:43.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff3889e6700 1 -- 172.21.2.105:0/101305749 learned_addr learned my addr 172.21.2.105:0/101305749 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:43.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff3889e6700 1 -- 172.21.2.105:0/101305749 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff384141bb0 msgr2=0x7ff384142010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:43.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff3889e6700 1 --2- 172.21.2.105:0/101305749 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff384141bb0 0x7ff384142010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:43.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff3889e6700 1 -- 172.21.2.105:0/101305749 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff38413a1f0 msgr2=0x7ff38413a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:43.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff3889e6700 1 --2- 172.21.2.105:0/101305749 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff38413a1f0 0x7ff38413a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:43.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff3889e6700 1 -- 172.21.2.105:0/101305749 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff38413ab90 con 0x7ff364003750 2021-11-12T05:49:43.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff3889e6700 1 --2- 172.21.2.105:0/101305749 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff364003750 0x7ff384136950 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 rx=0x7ff374002f70 tx=0x7ff374015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:43.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff381ffb700 1 -- 172.21.2.105:0/101305749 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff374012410 con 0x7ff364003750 2021-11-12T05:49:43.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff381ffb700 1 -- 172.21.2.105:0/101305749 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff374000e90 con 0x7ff364003750 2021-11-12T05:49:43.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff381ffb700 1 -- 172.21.2.105:0/101305749 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff37401e640 con 0x7ff364003750 2021-11-12T05:49:43.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff38ac4a700 1 -- 172.21.2.105:0/101305749 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff384137650 con 0x7ff364003750 2021-11-12T05:49:43.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.984+0000 7ff38ac4a700 1 -- 172.21.2.105:0/101305749 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3841410b0 con 0x7ff364003750 2021-11-12T05:49:43.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.988+0000 7ff38ac4a700 1 -- 172.21.2.105:0/101305749 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3840b3050 con 0x7ff364003750 2021-11-12T05:49:43.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.988+0000 7ff381ffb700 1 -- 172.21.2.105:0/101305749 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff374024020 con 0x7ff364003750 2021-11-12T05:49:43.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.988+0000 7ff381ffb700 1 --2- 172.21.2.105:0/101305749 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff368053720 0x7ff368055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:43.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.988+0000 7ff381ffb700 1 -- 172.21.2.105:0/101305749 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6416+0+0 (secure 0 0 0) 0x7ff37406cd10 con 0x7ff364003750 2021-11-12T05:49:43.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.988+0000 7ff383fff700 1 --2- 172.21.2.105:0/101305749 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff368053720 0x7ff368055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:43.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.988+0000 7ff383fff700 1 --2- 172.21.2.105:0/101305749 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff368053720 0x7ff368055be0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7ff36c001370 tx=0x7ff3840b5d70).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:43.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:42.988+0000 7ff381ffb700 1 -- 172.21.2.105:0/101305749 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff374043c10 con 0x7ff364003750 2021-11-12T05:49:43.077 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.072+0000 7ff38ac4a700 1 -- 172.21.2.105:0/101305749 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff384057350 con 0x7ff364003750 2021-11-12T05:49:43.078 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.072+0000 7ff381ffb700 1 -- 172.21.2.105:0/101305749 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v146) v1 ==== 104+0+10 (secure 0 0 0) 0x7ff374047230 con 0x7ff364003750 2021-11-12T05:49:43.078 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:49:43.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.076+0000 7ff38ac4a700 1 -- 172.21.2.105:0/101305749 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff368053720 msgr2=0x7ff368055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:43.079 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.076+0000 7ff38ac4a700 1 --2- 172.21.2.105:0/101305749 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff368053720 0x7ff368055be0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7ff36c001370 tx=0x7ff3840b5d70).stop 2021-11-12T05:49:43.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.076+0000 7ff38ac4a700 1 -- 172.21.2.105:0/101305749 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff364003750 msgr2=0x7ff384136950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:43.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.076+0000 7ff38ac4a700 1 --2- 172.21.2.105:0/101305749 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff364003750 0x7ff384136950 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 rx=0x7ff374002f70 tx=0x7ff374015000).stop 2021-11-12T05:49:43.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.076+0000 7ff38ac4a700 1 -- 172.21.2.105:0/101305749 shutdown_connections 2021-11-12T05:49:43.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.076+0000 7ff38ac4a700 1 --2- 172.21.2.105:0/101305749 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff368053720 0x7ff368055be0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:43.080 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.076+0000 7ff38ac4a700 1 --2- 172.21.2.105:0/101305749 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff38413a1f0 0x7ff38413a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:43.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.076+0000 7ff38ac4a700 1 --2- 172.21.2.105:0/101305749 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff384141bb0 0x7ff384142010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:43.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.076+0000 7ff38ac4a700 1 --2- 172.21.2.105:0/101305749 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff364003750 0x7ff384136950 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:43.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.076+0000 7ff38ac4a700 1 -- 172.21.2.105:0/101305749 >> 172.21.2.105:0/101305749 conn(0x7ff38405c490 msgr2=0x7ff384138aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:43.081 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.076+0000 7ff38ac4a700 1 -- 172.21.2.105:0/101305749 shutdown_connections 2021-11-12T05:49:43.082 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.076+0000 7ff38ac4a700 1 -- 172.21.2.105:0/101305749 wait complete. 2021-11-12T05:49:43.085 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-12T05:49:43.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.132+0000 7f8c1fa33700 1 Processor -- start 2021-11-12T05:49:43.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.132+0000 7f8c1fa33700 1 -- start start 2021-11-12T05:49:43.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.132+0000 7f8c1fa33700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f8c180b30a0 0x7f8c18140240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:43.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.132+0000 7f8c1fa33700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c180aa0b0 con 0x7f8c180b2cc0 2021-11-12T05:49:43.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.132+0000 7f8c1fa33700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c180a9b70 con 0x7f8c180b2290 2021-11-12T05:49:43.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.132+0000 7f8c1fa33700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c180a9e10 con 0x7f8c180b30a0 2021-11-12T05:49:43.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.132+0000 7f8c1d7cf700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f8c180b2cc0 0x7f8c18143690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34628/0 (socket says 172.21.2.105:34628) 2021-11-12T05:49:43.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.132+0000 7f8c1d7cf700 1 -- 172.21.2.105:0/3064653145 learned_addr learned my addr 172.21.2.105:0/3064653145 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:43.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c07fff700 1 -- 172.21.2.105:0/3064653145 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1012302880 0 0) 0x7f8c180aa0b0 con 0x7f8c180b2cc0 2021-11-12T05:49:43.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c07fff700 1 -- 172.21.2.105:0/3064653145 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c00003260 con 0x7f8c180b2cc0 2021-11-12T05:49:43.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c07fff700 1 -- 172.21.2.105:0/3064653145 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4250848180 0 0) 0x7f8c00003260 con 0x7f8c180b2cc0 2021-11-12T05:49:43.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c07fff700 1 -- 172.21.2.105:0/3064653145 >> v2:172.21.2.115:3300/0 conn(0x7f8c180b30a0 msgr2=0x7f8c18140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:43.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c07fff700 1 --2- 172.21.2.105:0/3064653145 >> v2:172.21.2.115:3300/0 conn(0x7f8c180b30a0 0x7f8c18140240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:43.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c07fff700 1 -- 172.21.2.105:0/3064653145 >> v1:172.21.2.115:6789/0 conn(0x7f8c180b2290 legacy=0x7f8c18143da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:43.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c07fff700 1 -- 172.21.2.105:0/3064653145 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c180b0800 con 0x7f8c180b2cc0 2021-11-12T05:49:43.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c07fff700 1 -- 172.21.2.105:0/3064653145 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f8c08001660 con 0x7f8c180b2cc0 2021-11-12T05:49:43.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c07fff700 1 -- 172.21.2.105:0/3064653145 >> v1:172.21.2.105:6789/0 conn(0x7f8c180b2cc0 legacy=0x7f8c18143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:43.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c07fff700 1 --2- 172.21.2.105:0/3064653145 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8c00003820 0x7f8c00003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:43.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c07fff700 1 --2- 172.21.2.105:0/3064653145 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8c00004500 0x7f8c00004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:43.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c07fff700 1 --2- 172.21.2.105:0/3064653145 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8c00005050 0x7f8c0000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:43.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c07fff700 1 -- 172.21.2.105:0/3064653145 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c180a9e10 con 0x7f8c00004500 2021-11-12T05:49:43.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c07fff700 1 -- 172.21.2.105:0/3064653145 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0000bf40 con 0x7f8c00005050 2021-11-12T05:49:43.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c07fff700 1 -- 172.21.2.105:0/3064653145 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0000c100 con 0x7f8c00003820 2021-11-12T05:49:43.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c1cfce700 1 --2- 172.21.2.105:0/3064653145 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8c00004500 0x7f8c00004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:43.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c1cfce700 1 -- 172.21.2.105:0/3064653145 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8c00003820 msgr2=0x7f8c00003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:43.145 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c1cfce700 1 --2- 172.21.2.105:0/3064653145 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8c00003820 0x7f8c00003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:43.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c1cfce700 1 -- 172.21.2.105:0/3064653145 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8c00005050 msgr2=0x7f8c0000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:43.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c1cfce700 1 --2- 172.21.2.105:0/3064653145 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8c00005050 0x7f8c0000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:43.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c1cfce700 1 -- 172.21.2.105:0/3064653145 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c00003260 con 0x7f8c00004500 2021-11-12T05:49:43.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c1dfd0700 1 -- 172.21.2.105:0/3064653145 reap_dead start 2021-11-12T05:49:43.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c1cfce700 1 --2- 172.21.2.105:0/3064653145 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8c00004500 0x7f8c00004980 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 rx=0x7f8c14000f70 tx=0x7f8c140079e0).ready entity=mon.0 client_cookie=d8787db5bb2be725 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:43.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c07fff700 1 -- 172.21.2.105:0/3064653145 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c14007cf0 con 0x7f8c00004500 2021-11-12T05:49:43.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c07fff700 1 -- 172.21.2.105:0/3064653145 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c14014410 con 0x7f8c00004500 2021-11-12T05:49:43.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c07fff700 1 -- 172.21.2.105:0/3064653145 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c14014770 con 0x7f8c00004500 2021-11-12T05:49:43.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c1fa33700 1 -- 172.21.2.105:0/3064653145 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8c00004500 msgr2=0x7f8c00004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:43.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c1fa33700 1 --2- 172.21.2.105:0/3064653145 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8c00004500 0x7f8c00004980 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 rx=0x7f8c14000f70 tx=0x7f8c140079e0).stop 2021-11-12T05:49:43.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c1fa33700 1 -- 172.21.2.105:0/3064653145 shutdown_connections 2021-11-12T05:49:43.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c1fa33700 1 --2- 172.21.2.105:0/3064653145 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8c00004500 0x7f8c00004980 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:43.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c1fa33700 1 -- 172.21.2.105:0/3064653145 >> 172.21.2.105:0/3064653145 conn(0x7f8c1805c490 msgr2=0x7f8c1805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:43.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c1fa33700 1 -- 172.21.2.105:0/3064653145 shutdown_connections 2021-11-12T05:49:43.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c1fa33700 1 -- 172.21.2.105:0/3064653145 wait complete. 2021-11-12T05:49:43.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c1fa33700 1 Processor -- start 2021-11-12T05:49:43.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c1fa33700 1 -- start start 2021-11-12T05:49:43.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c1fa33700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8c00004500 0x7f8c1813a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:43.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c1fa33700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8c180ab210 0x7f8c180b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:43.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c1fa33700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8c180b52c0 0x7f8c180b5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:43.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c1fa33700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c180b5c30 con 0x7f8c180b52c0 2021-11-12T05:49:43.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c1fa33700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c18066ed0 con 0x7f8c180ab210 2021-11-12T05:49:43.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c1fa33700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c18065520 con 0x7f8c00004500 2021-11-12T05:49:43.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c1dfd0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8c180b52c0 0x7f8c180b5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:43.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c1dfd0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8c180b52c0 0x7f8c180b5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52478/0 (socket says 172.21.2.105:52478) 2021-11-12T05:49:43.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c1dfd0700 1 -- 172.21.2.105:0/2193280026 learned_addr learned my addr 172.21.2.105:0/2193280026 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:43.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c1dfd0700 1 -- 172.21.2.105:0/2193280026 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8c00004500 msgr2=0x7f8c1813a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:43.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c1dfd0700 1 --2- 172.21.2.105:0/2193280026 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8c00004500 0x7f8c1813a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:43.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c1dfd0700 1 -- 172.21.2.105:0/2193280026 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8c180ab210 msgr2=0x7f8c180b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:43.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c1dfd0700 1 --2- 172.21.2.105:0/2193280026 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8c180ab210 0x7f8c180b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:43.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c1dfd0700 1 -- 172.21.2.105:0/2193280026 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c18067340 con 0x7f8c180b52c0 2021-11-12T05:49:43.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c1dfd0700 1 --2- 172.21.2.105:0/2193280026 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8c180b52c0 0x7f8c180b5740 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 rx=0x7f8c18062890 tx=0x7f8c10007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:43.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c067fc700 1 -- 172.21.2.105:0/2193280026 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c10005a20 con 0x7f8c180b52c0 2021-11-12T05:49:43.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c067fc700 1 -- 172.21.2.105:0/2193280026 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c10005b80 con 0x7f8c180b52c0 2021-11-12T05:49:43.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c067fc700 1 -- 172.21.2.105:0/2193280026 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c100070d0 con 0x7f8c180b52c0 2021-11-12T05:49:43.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c1fa33700 1 -- 172.21.2.105:0/2193280026 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c180aae30 con 0x7f8c180b52c0 2021-11-12T05:49:43.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.136+0000 7f8c1fa33700 1 -- 172.21.2.105:0/2193280026 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c181357e0 con 0x7f8c180b52c0 2021-11-12T05:49:43.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.140+0000 7f8c1fa33700 1 -- 172.21.2.105:0/2193280026 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c18067090 con 0x7f8c180b52c0 2021-11-12T05:49:43.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.140+0000 7f8c067fc700 1 -- 172.21.2.105:0/2193280026 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8c1001b060 con 0x7f8c180b52c0 2021-11-12T05:49:43.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.140+0000 7f8c067fc700 1 --2- 172.21.2.105:0/2193280026 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8bf8057a70 0x7f8bf8059f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:43.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.140+0000 7f8c067fc700 1 -- 172.21.2.105:0/2193280026 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f8c1006b220 con 0x7f8c180b52c0 2021-11-12T05:49:43.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.140+0000 7f8c1d7cf700 1 --2- 172.21.2.105:0/2193280026 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8bf8057a70 0x7f8bf8059f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:43.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.140+0000 7f8c1d7cf700 1 --2- 172.21.2.105:0/2193280026 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8bf8057a70 0x7f8bf8059f30 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7f8c180b3840 tx=0x7f8c180a9d00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:43.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.140+0000 7f8c067fc700 1 -- 172.21.2.105:0/2193280026 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8c10042120 con 0x7f8c180b52c0 2021-11-12T05:49:43.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.224+0000 7f8c1fa33700 1 -- 172.21.2.105:0/2193280026 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8c180ad830 con 0x7f8c180b52c0 2021-11-12T05:49:43.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.224+0000 7f8c067fc700 1 -- 172.21.2.105:0/2193280026 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v146) v1 ==== 100+0+10 (secure 0 0 0) 0x7f8c10019070 con 0x7f8c180b52c0 2021-11-12T05:49:43.228 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:49:43.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.224+0000 7f8c1fa33700 1 -- 172.21.2.105:0/2193280026 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8bf8057a70 msgr2=0x7f8bf8059f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:43.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.224+0000 7f8c1fa33700 1 --2- 172.21.2.105:0/2193280026 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8bf8057a70 0x7f8bf8059f30 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7f8c180b3840 tx=0x7f8c180a9d00).stop 2021-11-12T05:49:43.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.224+0000 7f8c1fa33700 1 -- 172.21.2.105:0/2193280026 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8c180b52c0 msgr2=0x7f8c180b5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:43.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.224+0000 7f8c1fa33700 1 --2- 172.21.2.105:0/2193280026 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8c180b52c0 0x7f8c180b5740 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 rx=0x7f8c18062890 tx=0x7f8c10007f90).stop 2021-11-12T05:49:43.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.224+0000 7f8c1fa33700 1 -- 172.21.2.105:0/2193280026 shutdown_connections 2021-11-12T05:49:43.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.224+0000 7f8c1fa33700 1 --2- 172.21.2.105:0/2193280026 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8bf8057a70 0x7f8bf8059f30 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:43.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.224+0000 7f8c1fa33700 1 --2- 172.21.2.105:0/2193280026 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8c180b52c0 0x7f8c180b5740 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:43.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.224+0000 7f8c1fa33700 1 --2- 172.21.2.105:0/2193280026 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8c180ab210 0x7f8c180b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:43.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.224+0000 7f8c1fa33700 1 --2- 172.21.2.105:0/2193280026 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8c00004500 0x7f8c1813a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:43.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.224+0000 7f8c1fa33700 1 -- 172.21.2.105:0/2193280026 >> 172.21.2.105:0/2193280026 conn(0x7f8c1805c490 msgr2=0x7f8c181426b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:43.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.224+0000 7f8c1fa33700 1 -- 172.21.2.105:0/2193280026 shutdown_connections 2021-11-12T05:49:43.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.224+0000 7f8c1fa33700 1 -- 172.21.2.105:0/2193280026 wait complete. 2021-11-12T05:49:43.236 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-12T05:49:43.236 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:49:43.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.280+0000 7f173119c700 1 Processor -- start 2021-11-12T05:49:43.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.280+0000 7f173119c700 1 -- start start 2021-11-12T05:49:43.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.280+0000 7f173119c700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f172c14b2f0 0x7f172c0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:43.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.280+0000 7f173119c700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f172c0ac7b0 con 0x7f172c0ad080 2021-11-12T05:49:43.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.280+0000 7f173119c700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f172c0ac9e0 con 0x7f172c0ac280 2021-11-12T05:49:43.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.280+0000 7f173119c700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f172c1488a0 con 0x7f172c14b2f0 2021-11-12T05:49:43.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.280+0000 7f172ad9d700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f172c0ad080 0x7f172c14abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34650/0 (socket says 172.21.2.105:34650) 2021-11-12T05:49:43.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.280+0000 7f172ad9d700 1 -- 172.21.2.105:0/1784863763 learned_addr learned my addr 172.21.2.105:0/1784863763 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:43.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f1729d9b700 1 -- 172.21.2.105:0/1784863763 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2609787064 0 0) 0x7f172c0ac7b0 con 0x7f172c0ad080 2021-11-12T05:49:43.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f1729d9b700 1 -- 172.21.2.105:0/1784863763 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f170c003260 con 0x7f172c0ad080 2021-11-12T05:49:43.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f1729d9b700 1 -- 172.21.2.105:0/1784863763 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1477951447 0 0) 0x7f170c003260 con 0x7f172c0ad080 2021-11-12T05:49:43.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f1729d9b700 1 -- 172.21.2.105:0/1784863763 >> v2:172.21.2.115:3300/0 conn(0x7f172c14b2f0 msgr2=0x7f172c0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:43.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f1729d9b700 1 --2- 172.21.2.105:0/1784863763 >> v2:172.21.2.115:3300/0 conn(0x7f172c14b2f0 0x7f172c0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:43.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f1729d9b700 1 -- 172.21.2.105:0/1784863763 >> v1:172.21.2.115:6789/0 conn(0x7f172c0ac280 legacy=0x7f172c147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:43.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f1729d9b700 1 -- 172.21.2.105:0/1784863763 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f172c0b0b30 con 0x7f172c0ad080 2021-11-12T05:49:43.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f1729d9b700 1 -- 172.21.2.105:0/1784863763 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f1714001660 con 0x7f172c0ad080 2021-11-12T05:49:43.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f1729d9b700 1 -- 172.21.2.105:0/1784863763 >> v1:172.21.2.105:6789/0 conn(0x7f172c0ad080 legacy=0x7f172c14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:43.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f1729d9b700 1 --2- 172.21.2.105:0/1784863763 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f170c0037d0 0x7f170c003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:43.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f1729d9b700 1 --2- 172.21.2.105:0/1784863763 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f170c004500 0x7f170c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:43.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f1729d9b700 1 --2- 172.21.2.105:0/1784863763 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f170c005070 0x7f170c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:43.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f1729d9b700 1 -- 172.21.2.105:0/1784863763 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172c1488a0 con 0x7f170c0037d0 2021-11-12T05:49:43.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f1729d9b700 1 -- 172.21.2.105:0/1784863763 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170c00bef0 con 0x7f170c004500 2021-11-12T05:49:43.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f1729d9b700 1 -- 172.21.2.105:0/1784863763 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f170c00c0b0 con 0x7f170c005070 2021-11-12T05:49:43.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f172ad9d700 1 --2- 172.21.2.105:0/1784863763 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f170c0037d0 0x7f170c003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:43.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f172ad9d700 1 -- 172.21.2.105:0/1784863763 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f170c005070 msgr2=0x7f170c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:43.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f172ad9d700 1 --2- 172.21.2.105:0/1784863763 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f170c005070 0x7f170c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:43.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f172ad9d700 1 -- 172.21.2.105:0/1784863763 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f170c004500 msgr2=0x7f170c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:43.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f172ad9d700 1 --2- 172.21.2.105:0/1784863763 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f170c004500 0x7f170c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:43.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f172ad9d700 1 -- 172.21.2.105:0/1784863763 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f172c0b0b30 con 0x7f170c0037d0 2021-11-12T05:49:43.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f172b59e700 1 -- 172.21.2.105:0/1784863763 reap_dead start 2021-11-12T05:49:43.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f172ad9d700 1 --2- 172.21.2.105:0/1784863763 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f170c0037d0 0x7f170c003bd0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 rx=0x7f1714001020 tx=0x7f1714001e20).ready entity=mon.0 client_cookie=2721b2b70e31f956 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:43.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f1729d9b700 1 -- 172.21.2.105:0/1784863763 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17140070d0 con 0x7f170c0037d0 2021-11-12T05:49:43.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f1729d9b700 1 -- 172.21.2.105:0/1784863763 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1714007230 con 0x7f170c0037d0 2021-11-12T05:49:43.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f1729d9b700 1 -- 172.21.2.105:0/1784863763 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f171400c9c0 con 0x7f170c0037d0 2021-11-12T05:49:43.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f173119c700 1 -- 172.21.2.105:0/1784863763 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f170c0037d0 msgr2=0x7f170c003bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:43.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f173119c700 1 --2- 172.21.2.105:0/1784863763 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f170c0037d0 0x7f170c003bd0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 rx=0x7f1714001020 tx=0x7f1714001e20).stop 2021-11-12T05:49:43.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f173119c700 1 -- 172.21.2.105:0/1784863763 shutdown_connections 2021-11-12T05:49:43.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f173119c700 1 --2- 172.21.2.105:0/1784863763 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f170c0037d0 0x7f170c003bd0 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:43.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f173119c700 1 -- 172.21.2.105:0/1784863763 >> 172.21.2.105:0/1784863763 conn(0x7f172c0b5370 msgr2=0x7f172c0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:43.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f173119c700 1 -- 172.21.2.105:0/1784863763 shutdown_connections 2021-11-12T05:49:43.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f173119c700 1 -- 172.21.2.105:0/1784863763 wait complete. 2021-11-12T05:49:43.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f173119c700 1 Processor -- start 2021-11-12T05:49:43.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f173119c700 1 -- start start 2021-11-12T05:49:43.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f173119c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f170c0037d0 0x7f172c0ab280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:43.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f173119c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f172c0a9150 0x7f172c0b4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:43.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f173119c700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f172c0aa3a0 0x7f172c0aa820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:43.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f173119c700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172c0a9940 con 0x7f172c0a9150 2021-11-12T05:49:43.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f173119c700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172c156830 con 0x7f172c0aa3a0 2021-11-12T05:49:43.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f173119c700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f172c1574c0 con 0x7f170c0037d0 2021-11-12T05:49:43.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f172a59c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f172c0a9150 0x7f172c0b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:43.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f172a59c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f172c0a9150 0x7f172c0b4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52498/0 (socket says 172.21.2.105:52498) 2021-11-12T05:49:43.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f172a59c700 1 -- 172.21.2.105:0/2490654129 learned_addr learned my addr 172.21.2.105:0/2490654129 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:43.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f172a59c700 1 -- 172.21.2.105:0/2490654129 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f170c0037d0 msgr2=0x7f172c0ab280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:43.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f172a59c700 1 --2- 172.21.2.105:0/2490654129 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f170c0037d0 0x7f172c0ab280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:43.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f172a59c700 1 -- 172.21.2.105:0/2490654129 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f172c0aa3a0 msgr2=0x7f172c0aa820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:43.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f172a59c700 1 --2- 172.21.2.105:0/2490654129 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f172c0aa3a0 0x7f172c0aa820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:43.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f172a59c700 1 -- 172.21.2.105:0/2490654129 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f172c157760 con 0x7f172c0a9150 2021-11-12T05:49:43.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f172a59c700 1 --2- 172.21.2.105:0/2490654129 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f172c0a9150 0x7f172c0b4110 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 rx=0x7f171c000f70 tx=0x7f171c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:43.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f1723fff700 1 -- 172.21.2.105:0/2490654129 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f171c013460 con 0x7f172c0a9150 2021-11-12T05:49:43.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f1723fff700 1 -- 172.21.2.105:0/2490654129 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171c0135c0 con 0x7f172c0a9150 2021-11-12T05:49:43.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f173119c700 1 -- 172.21.2.105:0/2490654129 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f172c0aad10 con 0x7f172c0a9150 2021-11-12T05:49:43.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f1723fff700 1 -- 172.21.2.105:0/2490654129 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f171c013920 con 0x7f172c0a9150 2021-11-12T05:49:43.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.284+0000 7f173119c700 1 -- 172.21.2.105:0/2490654129 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f172c0a8330 con 0x7f172c0a9150 2021-11-12T05:49:43.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.288+0000 7f173119c700 1 -- 172.21.2.105:0/2490654129 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f172c0b1440 con 0x7f172c0a9150 2021-11-12T05:49:43.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.288+0000 7f1723fff700 1 -- 172.21.2.105:0/2490654129 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f171c01a060 con 0x7f172c0a9150 2021-11-12T05:49:43.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.288+0000 7f1723fff700 1 --2- 172.21.2.105:0/2490654129 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f17100536a0 0x7f1710055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:43.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.288+0000 7f1723fff700 1 -- 172.21.2.105:0/2490654129 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f171c06b420 con 0x7f172c0a9150 2021-11-12T05:49:43.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.288+0000 7f172ad9d700 1 --2- 172.21.2.105:0/2490654129 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f17100536a0 0x7f1710055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:43.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.288+0000 7f172ad9d700 1 --2- 172.21.2.105:0/2490654129 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f17100536a0 0x7f1710055b60 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f1714001020 tx=0x7f1714015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:43.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.288+0000 7f1723fff700 1 -- 172.21.2.105:0/2490654129 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f171c042430 con 0x7f172c0a9150 2021-11-12T05:49:43.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.400+0000 7f173119c700 1 -- 172.21.2.105:0/2490654129 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f172c057350 con 0x7f172c0a9150 2021-11-12T05:49:43.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.400+0000 7f1723fff700 1 -- 172.21.2.105:0/2490654129 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f171c018030 con 0x7f172c0a9150 2021-11-12T05:49:43.404 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:43.405 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":69,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5066,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/506237043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":506237043},{"type":"v1","addr":"172.21.2.115:6833","nonce":506237043}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":68}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:49:37.422405+0000","modified":"2021-11-12T05:49:38.425999+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8499},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8499":{"gid":8499,"name":"a","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/3394672010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":3394672010},{"type":"v1","addr":"172.21.2.105:6835","nonce":3394672010}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-11-12T05:49:43.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.400+0000 7f173119c700 1 -- 172.21.2.105:0/2490654129 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f17100536a0 msgr2=0x7f1710055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:43.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.400+0000 7f173119c700 1 --2- 172.21.2.105:0/2490654129 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f17100536a0 0x7f1710055b60 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f1714001020 tx=0x7f1714015000).stop 2021-11-12T05:49:43.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.400+0000 7f173119c700 1 -- 172.21.2.105:0/2490654129 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f172c0a9150 msgr2=0x7f172c0b4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:43.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.400+0000 7f173119c700 1 --2- 172.21.2.105:0/2490654129 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f172c0a9150 0x7f172c0b4110 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 rx=0x7f171c000f70 tx=0x7f171c006df0).stop 2021-11-12T05:49:43.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.400+0000 7f173119c700 1 -- 172.21.2.105:0/2490654129 shutdown_connections 2021-11-12T05:49:43.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.400+0000 7f173119c700 1 --2- 172.21.2.105:0/2490654129 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f17100536a0 0x7f1710055b60 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:43.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.400+0000 7f173119c700 1 --2- 172.21.2.105:0/2490654129 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f172c0aa3a0 0x7f172c0aa820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:43.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.400+0000 7f173119c700 1 --2- 172.21.2.105:0/2490654129 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f172c0a9150 0x7f172c0b4110 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:43.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.400+0000 7f173119c700 1 --2- 172.21.2.105:0/2490654129 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f170c0037d0 0x7f172c0ab280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:43.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.400+0000 7f173119c700 1 -- 172.21.2.105:0/2490654129 >> 172.21.2.105:0/2490654129 conn(0x7f172c0b5370 msgr2=0x7f172c1466f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:43.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.400+0000 7f173119c700 1 -- 172.21.2.105:0/2490654129 shutdown_connections 2021-11-12T05:49:43.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:43.400+0000 7f173119c700 1 -- 172.21.2.105:0/2490654129 wait complete. 2021-11-12T05:49:43.409 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 69 2021-11-12T05:49:43.613 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 69, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:49:37.422405+0000', 'modified': '2021-11-12T05:49:38.425999+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8499}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8499': {'gid': 8499, 'name': 'a', 'rank': 0, 'incarnation': 68, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/3394672010', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 3394672010}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 3394672010}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:49:43.614 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:49:43.615 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:49:43.680 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":8499,"want_state":"up:active","state":"up:active","rank_uptime":6.2495653100000004,"mdsmap_epoch":69,"osdmap_epoch":146,"osdmap_epoch_barrier":145,"uptime":10.444504838} 2021-11-12T05:49:43.681 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 8499, "mdsmap_epoch": 69, "osdmap_epoch": 146, "osdmap_epoch_barrier": 145, "rank_uptime": 6.24956531, "state": "up:active", "uptime": 10.444504838, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:49:43.681 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-12T05:49:43.681 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-11-12T05:49:43.682 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@gibba038.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-11-12T05:49:43.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:43.683 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:49:43.696 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-12T05:49:43.708 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:49:43.708 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:49:43.758 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:49:43.758 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:49:43.759 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:43.760 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-12T05:49:43.765 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-12T05:49:43.765 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:49:43.809 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-12T05:49:43.820 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:49:43.821 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:49:43.826 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:49:43.826 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:49:43.827 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:43.828 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-12T05:49:43.850 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:2021-11-12T05:49:43.848+0000 7f467743e080 -1 init, newargv = 0x55b417927b90 newargc=9 2021-11-12T05:49:43.851 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:ceph-fuse[14773]: starting ceph client 2021-11-12T05:49:43.864 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:ceph-fuse[14773]: starting fuse 2021-11-12T05:49:44.955 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-12T05:49:44.968 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:49:44.968 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:49:45.017 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:49:45.018 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:49:45.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:45.020 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-12T05:49:45.025 INFO:teuthology.orchestra.run.gibba038.stdout:52 2021-11-12T05:49:45.025 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-12T05:49:45.025 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:45.026 DEBUG:teuthology.orchestra.run.gibba038:> sudo python3 -c ' 2021-11-12T05:49:45.026 DEBUG:teuthology.orchestra.run.gibba038:> import glob 2021-11-12T05:49:45.027 DEBUG:teuthology.orchestra.run.gibba038:> import re 2021-11-12T05:49:45.027 DEBUG:teuthology.orchestra.run.gibba038:> import os 2021-11-12T05:49:45.028 DEBUG:teuthology.orchestra.run.gibba038:> import subprocess 2021-11-12T05:49:45.028 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:49:45.029 DEBUG:teuthology.orchestra.run.gibba038:> def find_socket(client_name): 2021-11-12T05:49:45.029 DEBUG:teuthology.orchestra.run.gibba038:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-11-12T05:49:45.029 DEBUG:teuthology.orchestra.run.gibba038:> files = glob.glob(asok_path) 2021-11-12T05:49:45.030 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:49:45.030 DEBUG:teuthology.orchestra.run.gibba038:> # Given a non-glob path, it better be there 2021-11-12T05:49:45.031 DEBUG:teuthology.orchestra.run.gibba038:> if "*" not in asok_path: 2021-11-12T05:49:45.031 DEBUG:teuthology.orchestra.run.gibba038:> assert(len(files) == 1) 2021-11-12T05:49:45.031 DEBUG:teuthology.orchestra.run.gibba038:> return files[0] 2021-11-12T05:49:45.032 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:49:45.032 DEBUG:teuthology.orchestra.run.gibba038:> for f in files: 2021-11-12T05:49:45.033 DEBUG:teuthology.orchestra.run.gibba038:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-12T05:49:45.033 DEBUG:teuthology.orchestra.run.gibba038:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-12T05:49:45.034 DEBUG:teuthology.orchestra.run.gibba038:> return f 2021-11-12T05:49:45.034 DEBUG:teuthology.orchestra.run.gibba038:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-12T05:49:45.034 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:49:45.035 DEBUG:teuthology.orchestra.run.gibba038:> print(find_socket("client.1")) 2021-11-12T05:49:45.035 DEBUG:teuthology.orchestra.run.gibba038:> ' 2021-11-12T05:49:45.101 INFO:teuthology.orchestra.run.gibba038.stdout:/var/run/ceph/ceph-client.1.14773.asok 2021-11-12T05:49:45.104 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14773.asok 2021-11-12T05:49:45.104 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:45.105 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14773.asok status 2021-11-12T05:49:45.152 INFO:teuthology.orchestra.run.gibba038.stdout:{ 2021-11-12T05:49:45.152 INFO:teuthology.orchestra.run.gibba038.stdout: "metadata": { 2021-11-12T05:49:45.153 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_sha1": "a81ee2815de5acae59ead5b8c9137b6766fc8ea8", 2021-11-12T05:49:45.153 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_version": "ceph version 15.2.15-22-ga81ee281 (a81ee2815de5acae59ead5b8c9137b6766fc8ea8) octopus (stable)", 2021-11-12T05:49:45.153 INFO:teuthology.orchestra.run.gibba038.stdout: "entity_id": "1", 2021-11-12T05:49:45.153 INFO:teuthology.orchestra.run.gibba038.stdout: "hostname": "gibba038", 2021-11-12T05:49:45.154 INFO:teuthology.orchestra.run.gibba038.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-11-12T05:49:45.154 INFO:teuthology.orchestra.run.gibba038.stdout: "pid": "14773", 2021-11-12T05:49:45.154 INFO:teuthology.orchestra.run.gibba038.stdout: "root": "/" 2021-11-12T05:49:45.154 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:49:45.155 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_count": 0, 2021-11-12T05:49:45.155 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_pinned_count": 0, 2021-11-12T05:49:45.155 INFO:teuthology.orchestra.run.gibba038.stdout: "id": 8724, 2021-11-12T05:49:45.155 INFO:teuthology.orchestra.run.gibba038.stdout: "inst": { 2021-11-12T05:49:45.156 INFO:teuthology.orchestra.run.gibba038.stdout: "name": { 2021-11-12T05:49:45.156 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "client", 2021-11-12T05:49:45.156 INFO:teuthology.orchestra.run.gibba038.stdout: "num": 8724 2021-11-12T05:49:45.156 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:49:45.156 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-12T05:49:45.157 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-12T05:49:45.157 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-12T05:49:45.157 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 2172158025 2021-11-12T05:49:45.157 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-11-12T05:49:45.158 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:49:45.158 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-12T05:49:45.158 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-12T05:49:45.158 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-12T05:49:45.159 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 2172158025 2021-11-12T05:49:45.159 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:49:45.159 INFO:teuthology.orchestra.run.gibba038.stdout: "inst_str": "client.8724 172.21.2.138:0/2172158025", 2021-11-12T05:49:45.159 INFO:teuthology.orchestra.run.gibba038.stdout: "addr_str": "172.21.2.138:0/2172158025", 2021-11-12T05:49:45.159 INFO:teuthology.orchestra.run.gibba038.stdout: "inode_count": 1, 2021-11-12T05:49:45.160 INFO:teuthology.orchestra.run.gibba038.stdout: "mds_epoch": 69, 2021-11-12T05:49:45.160 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch": 146, 2021-11-12T05:49:45.160 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch_barrier": 0, 2021-11-12T05:49:45.160 INFO:teuthology.orchestra.run.gibba038.stdout: "blacklisted": false, 2021-11-12T05:49:45.161 INFO:teuthology.orchestra.run.gibba038.stdout: "fs_name": "cephfs" 2021-11-12T05:49:45.161 INFO:teuthology.orchestra.run.gibba038.stdout:} 2021-11-12T05:49:45.162 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:45.162 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:49:45.163 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:49:45.168 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-12T05:49:45.169 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-12T05:49:45.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:45.169 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:49:45.219 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-11-12T05:49:45.220 DEBUG:teuthology.orchestra.run.gibba016:> cd /home/ubuntu/cephtest/mnt.0 && sudo getfattr --only-values -n ceph.dir.rctime . 2021-11-12T05:49:45.265 INFO:teuthology.orchestra.run.gibba016.stdout:1636696185.219922446 2021-11-12T05:49:45.266 INFO:tasks.cephfs.test_misc:rctime = 1636696185.219922446 2021-11-12T05:49:45.266 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-12T05:49:45.267 DEBUG:teuthology.orchestra.run.gibba005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:49:45.280 DEBUG:teuthology.orchestra.run.gibba015:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:49:45.308 DEBUG:teuthology.orchestra.run.gibba016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:49:45.328 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:49:45.356 DEBUG:teuthology.orchestra.run.gibba044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:49:45.369 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-12T05:49:45.370 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:45.370 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:49:45.371 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:49:45.381 INFO:teuthology.orchestra.run.gibba016.stdout:fuseblk 2021-11-12T05:49:45.383 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-12T05:49:45.383 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba016.front.sepia.ceph.com... 2021-11-12T05:49:45.383 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-12T05:49:45.384 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:49:45.397 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[15278]: fuse finished with error 0 and tester_r 0 2021-11-12T05:49:45.398 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:45.399 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:49:45.399 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:49:45.449 INFO:teuthology.orchestra.run.gibba016.stdout:ext2/ext3 2021-11-12T05:49:45.450 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-12T05:49:45.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:49:45.527 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:49:45.531 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:45.531 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:49:45.532 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:49:45.543 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-12T05:49:45.544 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-12T05:49:45.544 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba038.front.sepia.ceph.com... 2021-11-12T05:49:45.545 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-12T05:49:45.545 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:49:45.600 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:ceph-fuse[14773]: fuse finished with error 0 and tester_r 0 2021-11-12T05:49:45.601 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:45.601 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:49:45.602 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:49:45.606 INFO:teuthology.orchestra.run.gibba038.stdout:ext2/ext3 2021-11-12T05:49:45.606 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-12T05:49:45.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:49:45.652 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:49:45.656 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:45.657 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:49:45.657 DEBUG:teuthology.orchestra.run.gibba044:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:49:45.666 INFO:teuthology.orchestra.run.gibba044.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-12T05:49:45.667 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:49:45.668 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-12T05:49:45.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:49:45.669 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:49:45.678 INFO:teuthology.orchestra.run.gibba044.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-12T05:49:45.678 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:49:45.679 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-12T05:49:45.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.729+0000 7fbb59e64700 1 Processor -- start 2021-11-12T05:49:45.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.729+0000 7fbb59e64700 1 -- start start 2021-11-12T05:49:45.739 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb59e64700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbb540af750 0x7fbb54062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:45.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb59e64700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fbb54130a80 0x7fbb541474d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:45.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb59e64700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb540b0d50 con 0x7fbb540626b0 2021-11-12T05:49:45.740 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb59e64700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb540ad380 con 0x7fbb54130a80 2021-11-12T05:49:45.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb59e64700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb540ae190 con 0x7fbb540af750 2021-11-12T05:49:45.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb53fff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fbb54130a80 0x7fbb541474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:45.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb53fff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fbb54130a80 0x7fbb541474d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52508/0 (socket says 172.21.2.105:52508) 2021-11-12T05:49:45.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb53fff700 1 -- 172.21.2.105:0/1170677726 learned_addr learned my addr 172.21.2.105:0/1170677726 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:45.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb53fff700 1 -- 172.21.2.105:0/1170677726 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbb540af750 msgr2=0x7fbb54062a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:45.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb53fff700 1 --2- 172.21.2.105:0/1170677726 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbb540af750 0x7fbb54062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:45.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb53fff700 1 -- 172.21.2.105:0/1170677726 >> v1:172.21.2.115:6789/0 conn(0x7fbb540626b0 legacy=0x7fbb54130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:45.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb53fff700 1 -- 172.21.2.105:0/1170677726 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb541479c0 con 0x7fbb54130a80 2021-11-12T05:49:45.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb53fff700 1 --2- 172.21.2.105:0/1170677726 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbb54130a80 0x7fbb541474d0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 rx=0x7fbb540af1d0 tx=0x7fbb4c009290).ready entity=mon.0 client_cookie=40452832f790be9e server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:45.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb527fc700 1 -- 172.21.2.105:0/1170677726 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb4c00b860 con 0x7fbb54130a80 2021-11-12T05:49:45.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb527fc700 1 -- 172.21.2.105:0/1170677726 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb4c00b9c0 con 0x7fbb54130a80 2021-11-12T05:49:45.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb527fc700 1 -- 172.21.2.105:0/1170677726 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb4c00bb70 con 0x7fbb54130a80 2021-11-12T05:49:45.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb59e64700 1 -- 172.21.2.105:0/1170677726 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbb54130a80 msgr2=0x7fbb541474d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:45.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb59e64700 1 --2- 172.21.2.105:0/1170677726 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbb54130a80 0x7fbb541474d0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 rx=0x7fbb540af1d0 tx=0x7fbb4c009290).stop 2021-11-12T05:49:45.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb59e64700 1 -- 172.21.2.105:0/1170677726 shutdown_connections 2021-11-12T05:49:45.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb59e64700 1 --2- 172.21.2.105:0/1170677726 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbb54130a80 0x7fbb541474d0 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:45.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb59e64700 1 --2- 172.21.2.105:0/1170677726 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbb540af750 0x7fbb54062a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:45.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb59e64700 1 -- 172.21.2.105:0/1170677726 >> 172.21.2.105:0/1170677726 conn(0x7fbb540b5320 msgr2=0x7fbb540b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:45.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb59e64700 1 -- 172.21.2.105:0/1170677726 shutdown_connections 2021-11-12T05:49:45.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb59e64700 1 -- 172.21.2.105:0/1170677726 wait complete. 2021-11-12T05:49:45.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb59e64700 1 Processor -- start 2021-11-12T05:49:45.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb59e64700 1 -- start start 2021-11-12T05:49:45.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb59e64700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbb540626b0 0x7fbb54159d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:45.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb59e64700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbb540af750 0x7fbb54063c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:45.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb59e64700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbb54130a80 0x7fbb541473d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:45.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb59e64700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb54148e60 con 0x7fbb540af750 2021-11-12T05:49:45.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb59e64700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb54149100 con 0x7fbb540626b0 2021-11-12T05:49:45.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb59e64700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb54064bc0 con 0x7fbb54130a80 2021-11-12T05:49:45.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb52ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbb540af750 0x7fbb54063c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:45.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb52ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbb540af750 0x7fbb54063c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52512/0 (socket says 172.21.2.105:52512) 2021-11-12T05:49:45.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb52ffd700 1 -- 172.21.2.105:0/1121499864 learned_addr learned my addr 172.21.2.105:0/1121499864 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:45.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb53fff700 1 --2- 172.21.2.105:0/1121499864 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbb54130a80 0x7fbb541473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:45.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb537fe700 1 --2- 172.21.2.105:0/1121499864 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbb540626b0 0x7fbb54159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:45.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb52ffd700 1 -- 172.21.2.105:0/1121499864 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbb54130a80 msgr2=0x7fbb541473d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:45.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb52ffd700 1 --2- 172.21.2.105:0/1121499864 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbb54130a80 0x7fbb541473d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:45.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb52ffd700 1 -- 172.21.2.105:0/1121499864 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbb540626b0 msgr2=0x7fbb54159d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:45.750 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb52ffd700 1 --2- 172.21.2.105:0/1121499864 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbb540626b0 0x7fbb54159d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:45.750 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.733+0000 7fbb52ffd700 1 -- 172.21.2.105:0/1121499864 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb4c009530 con 0x7fbb540af750 2021-11-12T05:49:45.750 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.737+0000 7fbb52ffd700 1 --2- 172.21.2.105:0/1121499864 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbb540af750 0x7fbb54063c20 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 rx=0x7fbb44002f70 tx=0x7fbb44006e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:45.750 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.737+0000 7fbb50ff9700 1 -- 172.21.2.105:0/1121499864 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb44013460 con 0x7fbb540af750 2021-11-12T05:49:45.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.737+0000 7fbb50ff9700 1 -- 172.21.2.105:0/1121499864 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb440135c0 con 0x7fbb540af750 2021-11-12T05:49:45.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.737+0000 7fbb50ff9700 1 -- 172.21.2.105:0/1121499864 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb44013920 con 0x7fbb540af750 2021-11-12T05:49:45.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.737+0000 7fbb59e64700 1 -- 172.21.2.105:0/1121499864 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb54148b50 con 0x7fbb540af750 2021-11-12T05:49:45.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.737+0000 7fbb59e64700 1 -- 172.21.2.105:0/1121499864 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb54066630 con 0x7fbb540af750 2021-11-12T05:49:45.752 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.737+0000 7fbb59e64700 1 -- 172.21.2.105:0/1121499864 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb54057350 con 0x7fbb540af750 2021-11-12T05:49:45.753 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.737+0000 7fbb50ff9700 1 -- 172.21.2.105:0/1121499864 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbb4400f070 con 0x7fbb540af750 2021-11-12T05:49:45.753 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.737+0000 7fbb50ff9700 1 --2- 172.21.2.105:0/1121499864 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbb38053610 0x7fbb38055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:45.753 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.737+0000 7fbb50ff9700 1 -- 172.21.2.105:0/1121499864 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fbb4406b460 con 0x7fbb540af750 2021-11-12T05:49:45.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.737+0000 7fbb537fe700 1 --2- 172.21.2.105:0/1121499864 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbb38053610 0x7fbb38055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:45.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.737+0000 7fbb537fe700 1 --2- 172.21.2.105:0/1121499864 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbb38053610 0x7fbb38055ad0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7fbb3c007000 tx=0x7fbb3c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:45.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.737+0000 7fbb50ff9700 1 -- 172.21.2.105:0/1121499864 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbb44042360 con 0x7fbb540af750 2021-11-12T05:49:45.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.821+0000 7fbb59e64700 1 -- 172.21.2.105:0/1121499864 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fbb5405d9a0 con 0x7fbb540af750 2021-11-12T05:49:45.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.821+0000 7fbb50ff9700 1 -- 172.21.2.105:0/1121499864 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v146) v1 ==== 81+0+34051 (secure 0 0 0) 0x7fbb44045980 con 0x7fbb540af750 2021-11-12T05:49:45.826 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:45.827 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:49:45.827 INFO:teuthology.orchestra.run.gibba005.stdout: "epoch": 146, 2021-11-12T05:49:45.827 INFO:teuthology.orchestra.run.gibba005.stdout: "fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", 2021-11-12T05:49:45.828 INFO:teuthology.orchestra.run.gibba005.stdout: "created": "2021-11-12T05:40:19.986390+0000", 2021-11-12T05:49:45.828 INFO:teuthology.orchestra.run.gibba005.stdout: "modified": "2021-11-12T05:49:38.427121+0000", 2021-11-12T05:49:45.828 INFO:teuthology.orchestra.run.gibba005.stdout: "last_up_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:49:45.828 INFO:teuthology.orchestra.run.gibba005.stdout: "last_in_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:49:45.828 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-12T05:49:45.829 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_num": 5799936, 2021-11-12T05:49:45.829 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_set": [ 2021-11-12T05:49:45.829 INFO:teuthology.orchestra.run.gibba005.stdout: "pglog_hardlimit", 2021-11-12T05:49:45.829 INFO:teuthology.orchestra.run.gibba005.stdout: "purged_snapdirs", 2021-11-12T05:49:45.830 INFO:teuthology.orchestra.run.gibba005.stdout: "recovery_deletes", 2021-11-12T05:49:45.830 INFO:teuthology.orchestra.run.gibba005.stdout: "sortbitwise" 2021-11-12T05:49:45.830 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:49:45.830 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_version": 5, 2021-11-12T05:49:45.831 INFO:teuthology.orchestra.run.gibba005.stdout: "full_ratio": 0.94999998807907104, 2021-11-12T05:49:45.831 INFO:teuthology.orchestra.run.gibba005.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-12T05:49:45.831 INFO:teuthology.orchestra.run.gibba005.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-12T05:49:45.831 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_snapshot": "", 2021-11-12T05:49:45.832 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_max": 28, 2021-11-12T05:49:45.832 INFO:teuthology.orchestra.run.gibba005.stdout: "max_osd": 8, 2021-11-12T05:49:45.832 INFO:teuthology.orchestra.run.gibba005.stdout: "require_min_compat_client": "jewel", 2021-11-12T05:49:45.832 INFO:teuthology.orchestra.run.gibba005.stdout: "min_compat_client": "jewel", 2021-11-12T05:49:45.832 INFO:teuthology.orchestra.run.gibba005.stdout: "require_osd_release": "octopus", 2021-11-12T05:49:45.833 INFO:teuthology.orchestra.run.gibba005.stdout: "pools": [ 2021-11-12T05:49:45.833 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.833 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 1, 2021-11-12T05:49:45.833 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "device_health_metrics", 2021-11-12T05:49:45.834 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:22.022116+0000", 2021-11-12T05:49:45.834 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:49:45.834 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:49:45.834 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:49:45.834 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:49:45.835 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:49:45.835 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:49:45.835 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:49:45.835 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:49:45.836 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 1, 2021-11-12T05:49:45.836 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 1, 2021-11-12T05:49:45.836 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 1, 2021-11-12T05:49:45.836 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 1, 2021-11-12T05:49:45.836 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 1, 2021-11-12T05:49:45.837 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:49:45.837 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:49:45.837 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:49:45.837 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:49:45.838 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:49:45.838 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:49:45.838 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:49:45.838 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.838 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "16", 2021-11-12T05:49:45.839 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:49:45.839 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:49:45.839 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:49:45.839 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:49:45.840 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:49:45.840 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:49:45.840 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:49:45.840 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:49:45.840 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:49:45.841 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:49:45.841 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:49:45.841 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:49:45.841 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:49:45.842 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:49:45.842 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:49:45.842 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:49:45.842 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:49:45.842 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:49:45.843 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:49:45.843 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:49:45.843 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:49:45.843 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:49:45.844 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:49:45.844 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:49:45.844 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:49:45.844 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:49:45.844 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.845 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:49:45.845 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:49:45.845 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:49:45.845 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:49:45.845 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:49:45.846 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:49:45.846 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:49:45.846 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:49:45.846 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:49:45.847 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:49:45.847 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:49:45.847 INFO:teuthology.orchestra.run.gibba005.stdout: "options": { 2021-11-12T05:49:45.847 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_min": 1 2021-11-12T05:49:45.848 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.848 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:49:45.848 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr_devicehealth": {} 2021-11-12T05:49:45.848 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:45.848 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.849 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.849 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 2, 2021-11-12T05:49:45.849 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "rbd", 2021-11-12T05:49:45.849 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:29.953617+0000", 2021-11-12T05:49:45.850 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:49:45.850 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:49:45.850 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:49:45.850 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:49:45.850 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:49:45.851 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:49:45.851 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:49:45.851 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:49:45.851 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:49:45.852 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:49:45.852 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:49:45.852 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:49:45.852 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:49:45.852 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:49:45.853 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:49:45.853 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:49:45.853 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:49:45.853 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:49:45.854 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:49:45.854 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:49:45.854 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.854 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "19", 2021-11-12T05:49:45.854 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:49:45.855 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:49:45.855 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:49:45.855 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:49:45.855 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:49:45.856 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:49:45.856 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:49:45.856 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:49:45.856 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:49:45.856 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:49:45.857 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:49:45.857 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:49:45.857 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:49:45.857 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:49:45.858 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:49:45.858 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:49:45.858 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:49:45.858 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:49:45.858 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:49:45.859 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:49:45.859 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:49:45.859 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:49:45.859 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:49:45.860 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:49:45.860 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:49:45.860 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:49:45.860 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.860 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:49:45.861 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:49:45.861 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:49:45.861 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:49:45.861 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:49:45.862 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:49:45.862 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:49:45.862 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:49:45.862 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:49:45.862 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:49:45.863 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:49:45.863 INFO:teuthology.orchestra.run.gibba005.stdout: "options": {}, 2021-11-12T05:49:45.863 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:49:45.863 INFO:teuthology.orchestra.run.gibba005.stdout: "rbd": {} 2021-11-12T05:49:45.863 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:45.864 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.864 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.864 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 27, 2021-11-12T05:49:45.864 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "cephfs_metadata", 2021-11-12T05:49:45.865 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:49:35.238196+0000", 2021-11-12T05:49:45.865 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:49:45.865 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:49:45.865 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:49:45.865 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:49:45.866 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:49:45.866 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:49:45.866 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:49:45.866 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:49:45.867 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:49:45.867 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:49:45.867 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:49:45.867 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:49:45.867 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:49:45.868 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:49:45.868 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:49:45.868 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:49:45.868 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:49:45.868 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:49:45.869 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:49:45.869 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:49:45.869 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.869 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "145", 2021-11-12T05:49:45.870 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:49:45.870 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:49:45.870 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:49:45.870 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:49:45.871 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:49:45.871 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:49:45.871 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:49:45.871 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:49:45.871 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:49:45.872 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:49:45.872 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:49:45.872 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:49:45.872 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:49:45.872 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:49:45.873 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:49:45.873 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:49:45.873 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:49:45.873 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:49:45.874 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:49:45.874 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:49:45.874 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:49:45.874 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:49:45.874 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:49:45.875 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:49:45.875 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:49:45.875 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:49:45.875 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.876 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:49:45.876 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:49:45.876 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:49:45.876 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:49:45.876 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:49:45.877 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:49:45.877 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:49:45.877 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:49:45.877 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:49:45.878 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:49:45.878 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:49:45.878 INFO:teuthology.orchestra.run.gibba005.stdout: "options": { 2021-11-12T05:49:45.878 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_bias": 4, 2021-11-12T05:49:45.878 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_min": 16, 2021-11-12T05:49:45.879 INFO:teuthology.orchestra.run.gibba005.stdout: "recovery_priority": 5 2021-11-12T05:49:45.879 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.879 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:49:45.879 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs": { 2021-11-12T05:49:45.879 INFO:teuthology.orchestra.run.gibba005.stdout: "metadata": "cephfs" 2021-11-12T05:49:45.880 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:45.880 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:45.880 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.880 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.881 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 28, 2021-11-12T05:49:45.881 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "cephfs_data", 2021-11-12T05:49:45.881 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:49:36.389415+0000", 2021-11-12T05:49:45.881 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:49:45.881 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:49:45.882 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:49:45.882 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:49:45.882 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:49:45.882 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:49:45.883 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:49:45.883 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:49:45.883 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:49:45.883 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:49:45.883 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:49:45.884 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:49:45.884 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:49:45.884 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:49:45.884 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:49:45.884 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:49:45.885 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:49:45.885 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:49:45.885 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:49:45.885 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:49:45.886 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.886 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "146", 2021-11-12T05:49:45.886 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:49:45.886 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:49:45.887 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:49:45.887 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:49:45.887 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:49:45.887 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:49:45.887 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:49:45.888 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:49:45.888 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:49:45.888 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:49:45.888 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:49:45.889 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:49:45.889 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:49:45.889 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:49:45.889 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:49:45.889 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:49:45.890 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:49:45.890 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:49:45.890 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:49:45.890 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:49:45.891 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:49:45.891 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:49:45.891 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:49:45.891 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:49:45.891 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:49:45.892 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:49:45.892 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.892 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:49:45.892 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:49:45.893 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:49:45.893 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:49:45.893 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:49:45.893 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:49:45.893 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:49:45.894 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:49:45.894 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:49:45.894 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:49:45.894 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:49:45.894 INFO:teuthology.orchestra.run.gibba005.stdout: "options": {}, 2021-11-12T05:49:45.895 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:49:45.895 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs": { 2021-11-12T05:49:45.895 INFO:teuthology.orchestra.run.gibba005.stdout: "data": "cephfs" 2021-11-12T05:49:45.895 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:45.896 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:45.896 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:45.896 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:49:45.896 INFO:teuthology.orchestra.run.gibba005.stdout: "osds": [ 2021-11-12T05:49:45.897 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.897 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:49:45.897 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "ee8e30a0-4819-4475-80ec-dd3ee7d01322", 2021-11-12T05:49:45.897 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:45.897 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:45.898 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:45.898 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:45.898 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:45.898 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:45.899 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:45.899 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 142, 2021-11-12T05:49:45.899 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:45.899 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:45.900 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:45.900 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:45.900 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.900 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:45.900 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6802", 2021-11-12T05:49:45.901 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:45.901 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.901 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.901 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:45.902 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6803", 2021-11-12T05:49:45.902 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:45.902 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:45.902 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:45.902 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.903 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:45.903 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:45.903 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.904 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:45.904 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6804", 2021-11-12T05:49:45.905 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:45.905 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.905 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.906 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:45.906 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6805", 2021-11-12T05:49:45.906 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:45.907 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:45.907 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:45.907 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.907 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:45.908 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:45.908 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.908 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:45.908 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6808", 2021-11-12T05:49:45.909 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:45.909 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.909 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.909 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:45.910 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6809", 2021-11-12T05:49:45.910 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:45.911 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:45.911 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:45.911 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.912 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:45.912 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:45.913 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.913 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:45.913 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6806", 2021-11-12T05:49:45.914 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:45.914 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.915 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.915 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:45.915 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6807", 2021-11-12T05:49:45.916 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:45.916 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:45.917 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:45.917 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.917 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6803/14874", 2021-11-12T05:49:45.918 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6805/14874", 2021-11-12T05:49:45.918 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6809/14874", 2021-11-12T05:49:45.918 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6807/14874", 2021-11-12T05:49:45.919 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:45.919 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:45.920 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:45.920 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:45.921 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.921 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.921 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:49:45.922 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "b1bb06c3-26d0-4d92-82f8-b3e882242785", 2021-11-12T05:49:45.922 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:45.922 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:45.923 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:45.923 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:45.924 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:45.924 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:45.924 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:45.925 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 142, 2021-11-12T05:49:45.925 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:45.925 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:45.926 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:45.926 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:45.926 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.927 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:45.927 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6810", 2021-11-12T05:49:45.928 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:45.928 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.928 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.929 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:45.929 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6811", 2021-11-12T05:49:45.930 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:45.930 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:45.930 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:45.931 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.931 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:45.932 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:45.932 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.932 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:45.933 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6812", 2021-11-12T05:49:45.933 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:45.933 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.934 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.934 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:45.935 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6813", 2021-11-12T05:49:45.935 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:45.935 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:45.936 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:45.936 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.937 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:45.937 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:45.937 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.938 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:45.938 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6816", 2021-11-12T05:49:45.939 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:45.939 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.939 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.940 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:45.940 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6817", 2021-11-12T05:49:45.940 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:45.941 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:45.941 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:45.942 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.942 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:45.942 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:45.943 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.943 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:45.944 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6814", 2021-11-12T05:49:45.944 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:45.944 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.945 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.945 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:45.946 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6815", 2021-11-12T05:49:45.946 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:45.946 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:45.947 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:45.947 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.947 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6811/14875", 2021-11-12T05:49:45.948 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6813/14875", 2021-11-12T05:49:45.948 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6817/14875", 2021-11-12T05:49:45.949 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6815/14875", 2021-11-12T05:49:45.949 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:45.949 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:45.950 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:45.950 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:45.950 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.951 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.951 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:49:45.952 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "837b2c60-c335-4382-9f47-d86543a14022", 2021-11-12T05:49:45.952 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:45.952 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:45.953 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:45.953 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:45.954 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:45.954 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:45.954 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:45.955 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 141, 2021-11-12T05:49:45.955 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:45.956 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:45.956 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:45.957 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:45.957 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.958 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:45.958 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6818", 2021-11-12T05:49:45.959 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:45.959 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.959 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.960 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:45.960 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6819", 2021-11-12T05:49:45.961 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:45.961 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:45.961 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:45.962 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.962 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:45.962 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:45.963 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.963 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:45.964 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6820", 2021-11-12T05:49:45.964 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:45.964 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.965 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.965 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:45.965 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6821", 2021-11-12T05:49:45.965 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:45.966 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:45.966 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:45.966 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.966 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:45.967 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:45.967 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.967 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:45.967 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6824", 2021-11-12T05:49:45.967 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:45.968 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.968 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.968 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:45.968 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6825", 2021-11-12T05:49:45.969 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:45.969 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:45.969 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:45.969 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.969 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:45.970 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:45.970 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.970 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:45.970 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6822", 2021-11-12T05:49:45.971 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:45.971 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.971 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.971 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:45.971 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6823", 2021-11-12T05:49:45.972 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:45.972 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:45.972 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:45.972 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.973 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6819/14905", 2021-11-12T05:49:45.973 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6821/14905", 2021-11-12T05:49:45.973 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6825/14905", 2021-11-12T05:49:45.973 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6823/14905", 2021-11-12T05:49:45.973 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:45.974 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:45.974 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:45.974 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:45.974 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.974 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.975 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:49:45.975 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "eb2b737b-dda6-444b-a306-f33cbbd51f70", 2021-11-12T05:49:45.975 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:45.975 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:45.976 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:45.976 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:45.976 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:45.976 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:45.976 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:45.977 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 132, 2021-11-12T05:49:45.977 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:45.977 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:45.977 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:45.977 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:45.978 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.978 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:45.978 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6826", 2021-11-12T05:49:45.978 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:45.979 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.979 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.979 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:45.979 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6827", 2021-11-12T05:49:45.979 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:45.980 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:45.980 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:45.980 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.980 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:45.981 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:45.981 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.981 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:45.981 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6828", 2021-11-12T05:49:45.981 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:45.982 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.982 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.982 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:45.982 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6829", 2021-11-12T05:49:45.983 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:45.983 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:45.983 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:45.983 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.983 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:45.984 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:45.984 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.984 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:45.984 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6832", 2021-11-12T05:49:45.985 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:45.985 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.985 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.985 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:45.985 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6833", 2021-11-12T05:49:45.986 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:45.986 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:45.986 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:45.986 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.986 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:45.987 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:45.987 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.987 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:45.987 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6830", 2021-11-12T05:49:45.988 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:45.988 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.988 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.988 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:45.989 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6831", 2021-11-12T05:49:45.989 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:45.989 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:45.989 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:45.989 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.990 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6827/14876", 2021-11-12T05:49:45.990 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6829/14876", 2021-11-12T05:49:45.990 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6833/14876", 2021-11-12T05:49:45.990 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6831/14876", 2021-11-12T05:49:45.991 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:45.991 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:45.991 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:45.991 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:45.991 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.992 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.992 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:49:45.992 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "721529a1-c047-486a-a7ca-ddc15d80cdde", 2021-11-12T05:49:45.992 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:45.992 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:45.993 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:45.993 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:45.993 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:45.993 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:45.994 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:45.994 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 141, 2021-11-12T05:49:45.994 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:45.994 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:45.994 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:45.995 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:45.995 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.995 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:45.995 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6800", 2021-11-12T05:49:45.995 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:45.996 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.996 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.996 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:45.996 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6801", 2021-11-12T05:49:45.997 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:45.997 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:45.997 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:45.997 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.997 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:45.998 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:45.998 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.998 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:45.998 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6802", 2021-11-12T05:49:45.999 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:45.999 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:45.999 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:45.999 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:45.999 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6803", 2021-11-12T05:49:46.000 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:46.000 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:46.000 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:46.000 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.001 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:46.001 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:46.001 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.001 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:46.001 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6806", 2021-11-12T05:49:46.002 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:46.002 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.002 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.002 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:46.002 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6807", 2021-11-12T05:49:46.003 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:46.003 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:46.003 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:46.003 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.004 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:46.004 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:46.004 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.004 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:46.004 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6804", 2021-11-12T05:49:46.005 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:46.005 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.005 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.005 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:46.006 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6805", 2021-11-12T05:49:46.006 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:46.006 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:46.006 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:46.006 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.007 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6801/15096", 2021-11-12T05:49:46.007 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6803/15096", 2021-11-12T05:49:46.007 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6807/15096", 2021-11-12T05:49:46.007 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6805/15096", 2021-11-12T05:49:46.008 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:46.008 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:46.008 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:46.008 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:46.008 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.009 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.009 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:49:46.009 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "68b72ab2-fa82-4b5c-bf33-528f002e4950", 2021-11-12T05:49:46.009 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:46.009 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:46.010 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:46.010 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:46.010 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:46.010 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:46.011 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:46.011 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 142, 2021-11-12T05:49:46.011 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:46.011 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:46.011 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:46.012 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:46.012 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.012 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:46.012 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6808", 2021-11-12T05:49:46.012 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:46.013 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.013 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.013 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:46.013 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6809", 2021-11-12T05:49:46.014 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:46.014 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:46.014 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:46.014 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.014 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:46.015 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:46.015 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.015 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:46.015 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6810", 2021-11-12T05:49:46.015 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:46.016 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.016 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.016 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:46.016 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6811", 2021-11-12T05:49:46.016 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:46.017 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:46.017 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:46.017 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.017 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:46.018 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:46.018 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.018 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:46.018 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6814", 2021-11-12T05:49:46.019 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:46.019 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.019 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.019 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:46.019 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6815", 2021-11-12T05:49:46.020 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:46.020 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:46.020 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:46.020 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.021 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:46.021 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:46.021 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.021 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:46.021 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6812", 2021-11-12T05:49:46.022 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:46.022 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.022 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.022 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:46.022 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6813", 2021-11-12T05:49:46.023 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:46.023 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:46.023 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:46.023 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.024 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6809/15097", 2021-11-12T05:49:46.024 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6811/15097", 2021-11-12T05:49:46.024 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6815/15097", 2021-11-12T05:49:46.024 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6813/15097", 2021-11-12T05:49:46.024 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:46.025 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:46.025 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:46.025 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:46.025 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.025 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.026 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:49:46.026 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "a2c83b5d-8d37-4d30-ac04-30d89a76e485", 2021-11-12T05:49:46.026 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:46.026 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:46.027 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:46.027 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:46.027 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:46.027 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:46.027 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:46.028 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 142, 2021-11-12T05:49:46.028 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:46.028 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:46.028 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:46.028 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:46.029 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.029 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:46.029 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6816", 2021-11-12T05:49:46.029 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:46.030 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.030 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.030 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:46.030 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6817", 2021-11-12T05:49:46.030 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:46.031 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:46.031 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:46.031 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.031 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:46.031 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:46.032 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.032 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:46.032 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6818", 2021-11-12T05:49:46.032 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:46.033 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.033 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.033 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:46.033 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6819", 2021-11-12T05:49:46.033 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:46.034 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:46.034 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:46.034 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.034 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:46.034 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:46.035 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.035 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:46.035 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6822", 2021-11-12T05:49:46.035 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:46.036 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.036 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.036 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:46.036 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6823", 2021-11-12T05:49:46.036 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:46.037 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:46.037 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:46.037 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.037 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:46.037 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:46.038 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.038 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:46.038 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6820", 2021-11-12T05:49:46.038 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:46.039 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.039 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.039 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:46.039 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6821", 2021-11-12T05:49:46.039 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:46.040 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:46.040 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:46.040 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.040 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6817/15098", 2021-11-12T05:49:46.041 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6819/15098", 2021-11-12T05:49:46.041 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6823/15098", 2021-11-12T05:49:46.041 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6821/15098", 2021-11-12T05:49:46.041 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:46.041 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:46.042 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:46.042 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:46.042 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.042 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.042 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:49:46.043 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "786ce966-d0fb-4181-aed4-c26e3ef61c43", 2021-11-12T05:49:46.043 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:46.043 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:46.043 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:46.043 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:46.044 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:46.044 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:46.044 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:46.044 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 142, 2021-11-12T05:49:46.045 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:46.045 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:46.045 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:46.045 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:46.046 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.046 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:46.046 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6824", 2021-11-12T05:49:46.046 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:46.046 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.047 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.047 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:46.047 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6825", 2021-11-12T05:49:46.047 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:46.047 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:46.048 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:46.048 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.048 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:46.048 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:46.049 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.049 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:46.049 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6826", 2021-11-12T05:49:46.049 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:46.049 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.050 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.050 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:46.050 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6827", 2021-11-12T05:49:46.050 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:46.051 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:46.051 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:46.051 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.051 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:46.051 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:46.052 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.052 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:46.052 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6830", 2021-11-12T05:49:46.052 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:46.053 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.053 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.053 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:46.053 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6831", 2021-11-12T05:49:46.053 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:46.054 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:46.054 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:46.054 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.054 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:46.055 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:46.055 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.055 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:46.055 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6828", 2021-11-12T05:49:46.055 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:46.056 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.056 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.056 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:46.056 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6829", 2021-11-12T05:49:46.056 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:46.057 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:46.057 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:46.057 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.057 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6825/15099", 2021-11-12T05:49:46.058 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6827/15099", 2021-11-12T05:49:46.058 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6831/15099", 2021-11-12T05:49:46.058 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6829/15099", 2021-11-12T05:49:46.058 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:46.059 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:46.059 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:46.059 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:46.059 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:46.059 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:49:46.060 INFO:teuthology.orchestra.run.gibba005.stdout: "osd_xinfo": [ 2021-11-12T05:49:46.060 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.060 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:49:46.060 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:46.061 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:46.061 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:46.061 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:46.061 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:46.061 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.615112+0000", 2021-11-12T05:49:46.062 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:46.062 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.062 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.062 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:49:46.063 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:46.063 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:46.063 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:46.063 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:46.063 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:46.064 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.665935+0000", 2021-11-12T05:49:46.064 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:46.064 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.064 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.064 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:49:46.065 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:46.065 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:46.065 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:46.065 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:46.066 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:46.066 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.715877+0000", 2021-11-12T05:49:46.066 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:46.066 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.067 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.067 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:49:46.067 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:46.067 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:46.067 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:46.068 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:46.068 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:46.068 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.489234+0000", 2021-11-12T05:49:46.068 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:46.069 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.069 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.069 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:49:46.069 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:46.069 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:46.070 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:46.070 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:46.070 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:46.070 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.413776+0000", 2021-11-12T05:49:46.071 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:46.071 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.071 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.071 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:49:46.071 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:46.072 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:46.072 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:46.072 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:46.072 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:46.073 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.507960+0000", 2021-11-12T05:49:46.073 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:46.073 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.073 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.073 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:49:46.074 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:46.074 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:46.074 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:46.074 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:46.075 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:46.075 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.635696+0000", 2021-11-12T05:49:46.075 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:46.075 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.075 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:46.076 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:49:46.076 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:46.076 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:46.076 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:46.077 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:46.077 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:46.077 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.746949+0000", 2021-11-12T05:49:46.077 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:46.077 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:46.078 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:49:46.078 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap": [], 2021-11-12T05:49:46.078 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap_items": [], 2021-11-12T05:49:46.078 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_temp": [], 2021-11-12T05:49:46.079 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_temp": [], 2021-11-12T05:49:46.079 INFO:teuthology.orchestra.run.gibba005.stdout: "blacklist": {}, 2021-11-12T05:49:46.079 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profiles": { 2021-11-12T05:49:46.079 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs_data": { 2021-11-12T05:49:46.080 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-device-class": "", 2021-11-12T05:49:46.080 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:49:46.080 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-root": "default", 2021-11-12T05:49:46.080 INFO:teuthology.orchestra.run.gibba005.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-12T05:49:46.080 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:49:46.081 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "2", 2021-11-12T05:49:46.081 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:49:46.081 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:49:46.081 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van", 2021-11-12T05:49:46.082 INFO:teuthology.orchestra.run.gibba005.stdout: "w": "8" 2021-11-12T05:49:46.082 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.082 INFO:teuthology.orchestra.run.gibba005.stdout: "default": { 2021-11-12T05:49:46.082 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:49:46.082 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:49:46.083 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "1", 2021-11-12T05:49:46.083 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:49:46.083 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:49:46.083 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van" 2021-11-12T05:49:46.083 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:46.084 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:46.084 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps_queue": [], 2021-11-12T05:49:46.084 INFO:teuthology.orchestra.run.gibba005.stdout: "new_removed_snaps": [], 2021-11-12T05:49:46.084 INFO:teuthology.orchestra.run.gibba005.stdout: "new_purged_snaps": [], 2021-11-12T05:49:46.085 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_node_flags": {}, 2021-11-12T05:49:46.085 INFO:teuthology.orchestra.run.gibba005.stdout: "device_class_flags": {} 2021-11-12T05:49:46.085 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:49:46.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.821+0000 7fbb59e64700 1 -- 172.21.2.105:0/1121499864 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbb38053610 msgr2=0x7fbb38055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:46.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.821+0000 7fbb59e64700 1 --2- 172.21.2.105:0/1121499864 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbb38053610 0x7fbb38055ad0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7fbb3c007000 tx=0x7fbb3c008040).stop 2021-11-12T05:49:46.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.821+0000 7fbb59e64700 1 -- 172.21.2.105:0/1121499864 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbb540af750 msgr2=0x7fbb54063c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:46.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.821+0000 7fbb59e64700 1 --2- 172.21.2.105:0/1121499864 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbb540af750 0x7fbb54063c20 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 rx=0x7fbb44002f70 tx=0x7fbb44006e90).stop 2021-11-12T05:49:46.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.825+0000 7fbb59e64700 1 -- 172.21.2.105:0/1121499864 shutdown_connections 2021-11-12T05:49:46.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.825+0000 7fbb59e64700 1 --2- 172.21.2.105:0/1121499864 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbb38053610 0x7fbb38055ad0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:46.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.825+0000 7fbb59e64700 1 --2- 172.21.2.105:0/1121499864 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbb54130a80 0x7fbb541473d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:46.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.825+0000 7fbb59e64700 1 --2- 172.21.2.105:0/1121499864 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbb540af750 0x7fbb54063c20 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:46.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.825+0000 7fbb59e64700 1 --2- 172.21.2.105:0/1121499864 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbb540626b0 0x7fbb54159d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:46.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.825+0000 7fbb59e64700 1 -- 172.21.2.105:0/1121499864 >> 172.21.2.105:0/1121499864 conn(0x7fbb540b5320 msgr2=0x7fbb540b3580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:46.089 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.825+0000 7fbb59e64700 1 -- 172.21.2.105:0/1121499864 shutdown_connections 2021-11-12T05:49:46.090 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:45.825+0000 7fbb59e64700 1 -- 172.21.2.105:0/1121499864 wait complete. 2021-11-12T05:49:46.090 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:49:46.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.141+0000 7f40f1f6d700 1 Processor -- start 2021-11-12T05:49:46.146 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.141+0000 7f40f1f6d700 1 -- start start 2021-11-12T05:49:46.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.141+0000 7f40f1f6d700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f40ec0ac280 0x7f40ec14b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:46.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.141+0000 7f40f1f6d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f40ec0af730 0x7f40ec0ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:46.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.141+0000 7f40f1f6d700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40ec0ac7b0 con 0x7f40ec0ad080 2021-11-12T05:49:46.147 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.141+0000 7f40f1f6d700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40ec1488a0 con 0x7f40ec0af730 2021-11-12T05:49:46.148 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.141+0000 7f40f1f6d700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40ec0ac9e0 con 0x7f40ec0ac280 2021-11-12T05:49:46.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.141+0000 7f40eb7fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f40ec0ad080 0x7f40ec14abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34682/0 (socket says 172.21.2.105:34682) 2021-11-12T05:49:46.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.141+0000 7f40eb7fe700 1 -- 172.21.2.105:0/2699796516 learned_addr learned my addr 172.21.2.105:0/2699796516 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:46.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.141+0000 7f40ebfff700 1 --2- 172.21.2.105:0/2699796516 >> v2:172.21.2.105:3300/0 conn(0x7f40ec0af730 0x7f40ec0ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:46.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40ea7fc700 1 -- 172.21.2.105:0/2699796516 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 807203579 0 0) 0x7f40ec0ac7b0 con 0x7f40ec0ad080 2021-11-12T05:49:46.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40ebfff700 1 -- 172.21.2.105:0/2699796516 >> v2:172.21.2.115:3300/0 conn(0x7f40ec0ac280 msgr2=0x7f40ec14b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:46.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40ebfff700 1 --2- 172.21.2.105:0/2699796516 >> v2:172.21.2.115:3300/0 conn(0x7f40ec0ac280 0x7f40ec14b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:46.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40ebfff700 1 -- 172.21.2.105:0/2699796516 >> v1:172.21.2.105:6789/0 conn(0x7f40ec0ad080 legacy=0x7f40ec14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:46.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40ebfff700 1 -- 172.21.2.105:0/2699796516 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ec0b0b30 con 0x7f40ec0af730 2021-11-12T05:49:46.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40ebfff700 1 --2- 172.21.2.105:0/2699796516 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f40ec0af730 0x7f40ec0ad460 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 rx=0x7f40ec0b1000 tx=0x7f40e40091d0).ready entity=mon.0 client_cookie=f184b4313894f309 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:46.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40ea7fc700 1 -- 172.21.2.105:0/2699796516 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40e4009ea0 con 0x7f40ec0af730 2021-11-12T05:49:46.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40ea7fc700 1 -- 172.21.2.105:0/2699796516 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e400b860 con 0x7f40ec0af730 2021-11-12T05:49:46.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40ea7fc700 1 -- 172.21.2.105:0/2699796516 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40e400b9d0 con 0x7f40ec0af730 2021-11-12T05:49:46.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40f1f6d700 1 -- 172.21.2.105:0/2699796516 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f40ec0af730 msgr2=0x7f40ec0ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:46.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40f1f6d700 1 --2- 172.21.2.105:0/2699796516 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f40ec0af730 0x7f40ec0ad460 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 rx=0x7f40ec0b1000 tx=0x7f40e40091d0).stop 2021-11-12T05:49:46.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40f1f6d700 1 -- 172.21.2.105:0/2699796516 shutdown_connections 2021-11-12T05:49:46.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40f1f6d700 1 --2- 172.21.2.105:0/2699796516 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f40ec0af730 0x7f40ec0ad460 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:46.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40f1f6d700 1 --2- 172.21.2.105:0/2699796516 >> v2:172.21.2.115:3300/0 conn(0x7f40ec0ac280 0x7f40ec14b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:46.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40f1f6d700 1 -- 172.21.2.105:0/2699796516 >> 172.21.2.105:0/2699796516 conn(0x7f40ec0b5370 msgr2=0x7f40ec0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:46.155 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40f1f6d700 1 -- 172.21.2.105:0/2699796516 shutdown_connections 2021-11-12T05:49:46.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40f1f6d700 1 -- 172.21.2.105:0/2699796516 wait complete. 2021-11-12T05:49:46.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40f1f6d700 1 Processor -- start 2021-11-12T05:49:46.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40f1f6d700 1 -- start start 2021-11-12T05:49:46.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40f1f6d700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f40ec0ac280 0x7f40ec15a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:46.156 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40f1f6d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f40ec0ad080 0x7f40ec05fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:46.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40f1f6d700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f40ec0af730 0x7f40ec156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:46.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40f1f6d700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec0abcc0 con 0x7f40ec0ad080 2021-11-12T05:49:46.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40f1f6d700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec15a170 con 0x7f40ec0af730 2021-11-12T05:49:46.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40f1f6d700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec15a410 con 0x7f40ec0ac280 2021-11-12T05:49:46.157 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40eaffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f40ec0ad080 0x7f40ec05fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:46.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40eaffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f40ec0ad080 0x7f40ec05fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52526/0 (socket says 172.21.2.105:52526) 2021-11-12T05:49:46.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40eaffd700 1 -- 172.21.2.105:0/46277502 learned_addr learned my addr 172.21.2.105:0/46277502 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:46.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40eaffd700 1 -- 172.21.2.105:0/46277502 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f40ec0ac280 msgr2=0x7f40ec15a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:46.158 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40eaffd700 1 --2- 172.21.2.105:0/46277502 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f40ec0ac280 0x7f40ec15a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:46.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40eaffd700 1 -- 172.21.2.105:0/46277502 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f40ec0af730 msgr2=0x7f40ec156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:46.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40eaffd700 1 --2- 172.21.2.105:0/46277502 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f40ec0af730 0x7f40ec156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:46.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40eaffd700 1 -- 172.21.2.105:0/46277502 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e4009470 con 0x7f40ec0ad080 2021-11-12T05:49:46.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40eaffd700 1 --2- 172.21.2.105:0/46277502 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f40ec0ad080 0x7f40ec05fff0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 rx=0x7f40dc002f70 tx=0x7f40dc006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:46.159 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40e8ff9700 1 -- 172.21.2.105:0/46277502 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40dc013460 con 0x7f40ec0ad080 2021-11-12T05:49:46.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40e8ff9700 1 -- 172.21.2.105:0/46277502 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40dc0135c0 con 0x7f40ec0ad080 2021-11-12T05:49:46.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40f1f6d700 1 -- 172.21.2.105:0/46277502 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40ec0a9530 con 0x7f40ec0ad080 2021-11-12T05:49:46.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40e8ff9700 1 -- 172.21.2.105:0/46277502 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40dc013920 con 0x7f40ec0ad080 2021-11-12T05:49:46.160 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40f1f6d700 1 -- 172.21.2.105:0/46277502 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40ec0604e0 con 0x7f40ec0ad080 2021-11-12T05:49:46.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.145+0000 7f40f1f6d700 1 -- 172.21.2.105:0/46277502 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40ec0a9280 con 0x7f40ec0ad080 2021-11-12T05:49:46.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.149+0000 7f40e8ff9700 1 -- 172.21.2.105:0/46277502 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f40dc01a060 con 0x7f40ec0ad080 2021-11-12T05:49:46.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.149+0000 7f40e8ff9700 1 --2- 172.21.2.105:0/46277502 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f40d00535d0 0x7f40d0055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:46.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.149+0000 7f40e8ff9700 1 -- 172.21.2.105:0/46277502 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f40dc06b660 con 0x7f40ec0ad080 2021-11-12T05:49:46.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.149+0000 7f40eb7fe700 1 --2- 172.21.2.105:0/46277502 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f40d00535d0 0x7f40d0055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:46.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.149+0000 7f40eb7fe700 1 --2- 172.21.2.105:0/46277502 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f40d00535d0 0x7f40d0055a90 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f40d4000bc0 tx=0x7f40d40011a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:46.162 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.149+0000 7f40e8ff9700 1 -- 172.21.2.105:0/46277502 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f40ec0a9280 con 0x7f40ec0ad080 2021-11-12T05:49:46.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.257+0000 7f40f1f6d700 1 -- 172.21.2.105:0/46277502 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40ec15a5d0 con 0x7f40ec0ad080 2021-11-12T05:49:46.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.261+0000 7f40e8ff9700 1 -- 172.21.2.105:0/46277502 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f40dc042560 con 0x7f40ec0ad080 2021-11-12T05:49:46.264 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:46.264 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":69,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5066,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/506237043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":506237043},{"type":"v1","addr":"172.21.2.115:6833","nonce":506237043}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":68}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:49:37.422405+0000","modified":"2021-11-12T05:49:38.425999+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8499},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8499":{"gid":8499,"name":"a","rank":0,"incarnation":68,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/3394672010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":3394672010},{"type":"v1","addr":"172.21.2.105:6835","nonce":3394672010}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-11-12T05:49:46.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.261+0000 7f40f1f6d700 1 -- 172.21.2.105:0/46277502 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f40d00535d0 msgr2=0x7f40d0055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:46.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.261+0000 7f40f1f6d700 1 --2- 172.21.2.105:0/46277502 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f40d00535d0 0x7f40d0055a90 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f40d4000bc0 tx=0x7f40d40011a0).stop 2021-11-12T05:49:46.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.261+0000 7f40f1f6d700 1 -- 172.21.2.105:0/46277502 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f40ec0ad080 msgr2=0x7f40ec05fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:46.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.261+0000 7f40f1f6d700 1 --2- 172.21.2.105:0/46277502 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f40ec0ad080 0x7f40ec05fff0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 rx=0x7f40dc002f70 tx=0x7f40dc006ec0).stop 2021-11-12T05:49:46.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.261+0000 7f40f1f6d700 1 -- 172.21.2.105:0/46277502 shutdown_connections 2021-11-12T05:49:46.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.261+0000 7f40f1f6d700 1 --2- 172.21.2.105:0/46277502 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f40d00535d0 0x7f40d0055a90 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:46.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.261+0000 7f40f1f6d700 1 --2- 172.21.2.105:0/46277502 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f40ec0af730 0x7f40ec156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:46.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.261+0000 7f40f1f6d700 1 --2- 172.21.2.105:0/46277502 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f40ec0ad080 0x7f40ec05fff0 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:46.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.261+0000 7f40f1f6d700 1 --2- 172.21.2.105:0/46277502 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f40ec0ac280 0x7f40ec15a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:46.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.261+0000 7f40f1f6d700 1 -- 172.21.2.105:0/46277502 >> 172.21.2.105:0/46277502 conn(0x7f40ec0b5370 msgr2=0x7f40ec143b90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:46.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.261+0000 7f40f1f6d700 1 -- 172.21.2.105:0/46277502 shutdown_connections 2021-11-12T05:49:46.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.261+0000 7f40f1f6d700 1 -- 172.21.2.105:0/46277502 wait complete. 2021-11-12T05:49:46.268 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 69 2021-11-12T05:49:46.271 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-12T05:49:46.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.317+0000 7f88961ea700 1 Processor -- start 2021-11-12T05:49:46.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.317+0000 7f88961ea700 1 -- start start 2021-11-12T05:49:46.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.317+0000 7f88961ea700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f88900634b0 0x7f8890128980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:46.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.317+0000 7f88961ea700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f88900ad270 0x7f8890128e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:46.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.317+0000 7f88961ea700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8890140870 con 0x7f8890143240 2021-11-12T05:49:46.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.317+0000 7f88961ea700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8890140cd0 con 0x7f88900634b0 2021-11-12T05:49:46.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.317+0000 7f88961ea700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8890067630 con 0x7f88900ad270 2021-11-12T05:49:46.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.321+0000 7f888f7fe700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f88900634b0 0x7f8890128980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:46.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.321+0000 7f888effd700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f88900ad270 0x7f8890128e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:46.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.321+0000 7f888ffff700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7f8890143240 0x7f88901436f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:33166/0 (socket says 172.21.2.105:33166) 2021-11-12T05:49:46.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.321+0000 7f888f7fe700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f88900634b0 0x7f8890128980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3300/0 says I am v2:172.21.2.105:41474/0 (socket says 172.21.2.105:41474) 2021-11-12T05:49:46.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.321+0000 7f888effd700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f88900ad270 0x7f8890128e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3301/0 says I am v2:172.21.2.105:43724/0 (socket says 172.21.2.105:43724) 2021-11-12T05:49:46.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.321+0000 7f888ffff700 1 -- 172.21.2.105:0/3788126233 learned_addr learned my addr 172.21.2.105:0/3788126233 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:46.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.321+0000 7f888f7fe700 1 -- 172.21.2.105:0/3788126233 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f88900ad270 msgr2=0x7f8890128e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:46.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.321+0000 7f888f7fe700 1 --2- 172.21.2.105:0/3788126233 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f88900ad270 0x7f8890128e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:46.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.321+0000 7f888f7fe700 1 -- 172.21.2.105:0/3788126233 >> v1:172.21.2.115:6789/0 conn(0x7f8890143240 legacy=0x7f88901436f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:46.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.321+0000 7f888f7fe700 1 -- 172.21.2.105:0/3788126233 --> v2:172.21.2.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f889005fcc0 con 0x7f88900634b0 2021-11-12T05:49:46.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.321+0000 7f888effd700 1 --2- 172.21.2.105:0/3788126233 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f88900ad270 0x7f8890128e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-12T05:49:46.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.321+0000 7f888f7fe700 1 --2- 172.21.2.105:0/3788126233 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f88900634b0 0x7f8890128980 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f8878002f70 tx=0x7f8878006e80).ready entity=mon.1 client_cookie=b08476924efa001a server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:46.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.321+0000 7f888e7fc700 1 -- 172.21.2.105:0/3788126233 <== mon.1 v2:172.21.2.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f887800b7d0 con 0x7f88900634b0 2021-11-12T05:49:46.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.321+0000 7f888e7fc700 1 -- 172.21.2.105:0/3788126233 <== mon.1 v2:172.21.2.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f887800b930 con 0x7f88900634b0 2021-11-12T05:49:46.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.321+0000 7f888e7fc700 1 -- 172.21.2.105:0/3788126233 <== mon.1 v2:172.21.2.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f887800bc90 con 0x7f88900634b0 2021-11-12T05:49:46.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.321+0000 7f88961ea700 1 -- 172.21.2.105:0/3788126233 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f88900634b0 msgr2=0x7f8890128980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:46.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.321+0000 7f88961ea700 1 --2- 172.21.2.105:0/3788126233 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f88900634b0 0x7f8890128980 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f8878002f70 tx=0x7f8878006e80).stop 2021-11-12T05:49:46.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.321+0000 7f88961ea700 1 -- 172.21.2.105:0/3788126233 shutdown_connections 2021-11-12T05:49:46.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.321+0000 7f88961ea700 1 --2- 172.21.2.105:0/3788126233 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f88900ad270 0x7f8890128e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:46.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.321+0000 7f88961ea700 1 --2- 172.21.2.105:0/3788126233 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f88900634b0 0x7f8890128980 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:46.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.321+0000 7f88961ea700 1 -- 172.21.2.105:0/3788126233 >> 172.21.2.105:0/3788126233 conn(0x7f88900b5320 msgr2=0x7f88900b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:46.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.321+0000 7f88961ea700 1 -- 172.21.2.105:0/3788126233 shutdown_connections 2021-11-12T05:49:46.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.321+0000 7f88961ea700 1 -- 172.21.2.105:0/3788126233 wait complete. 2021-11-12T05:49:46.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.325+0000 7f88961ea700 1 Processor -- start 2021-11-12T05:49:46.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.325+0000 7f88961ea700 1 -- start start 2021-11-12T05:49:46.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.325+0000 7f88961ea700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f88900634b0 0x7f8890066d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:46.334 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.325+0000 7f88961ea700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f88900ad270 0x7f8890146b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:46.334 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.325+0000 7f88961ea700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8890143240 0x7f8890141d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:46.334 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.325+0000 7f88961ea700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8890064180 con 0x7f8890143240 2021-11-12T05:49:46.334 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.325+0000 7f88961ea700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8890141140 con 0x7f88900634b0 2021-11-12T05:49:46.334 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.325+0000 7f88961ea700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88901413e0 con 0x7f88900ad270 2021-11-12T05:49:46.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.325+0000 7f888ffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8890143240 0x7f8890141d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:46.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.325+0000 7f888ffff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8890143240 0x7f8890141d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52538/0 (socket says 172.21.2.105:52538) 2021-11-12T05:49:46.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.325+0000 7f888ffff700 1 -- 172.21.2.105:0/3151094419 learned_addr learned my addr 172.21.2.105:0/3151094419 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:46.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.325+0000 7f888ffff700 1 -- 172.21.2.105:0/3151094419 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f88900ad270 msgr2=0x7f8890146b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:46.336 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.325+0000 7f888ffff700 1 --2- 172.21.2.105:0/3151094419 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f88900ad270 0x7f8890146b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:46.336 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.325+0000 7f888ffff700 1 -- 172.21.2.105:0/3151094419 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f88900634b0 msgr2=0x7f8890066d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:46.336 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.325+0000 7f888ffff700 1 --2- 172.21.2.105:0/3151094419 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f88900634b0 0x7f8890066d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:46.336 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.325+0000 7f888ffff700 1 -- 172.21.2.105:0/3151094419 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f888000b180 con 0x7f8890143240 2021-11-12T05:49:46.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.325+0000 7f888ffff700 1 --2- 172.21.2.105:0/3151094419 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8890143240 0x7f8890141d30 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 rx=0x7f88900afb30 tx=0x7f8888007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:46.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.325+0000 7f888cff9700 1 -- 172.21.2.105:0/3151094419 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8888005ba0 con 0x7f8890143240 2021-11-12T05:49:46.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.325+0000 7f888cff9700 1 -- 172.21.2.105:0/3151094419 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8888005d00 con 0x7f8890143240 2021-11-12T05:49:46.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.325+0000 7f888cff9700 1 -- 172.21.2.105:0/3151094419 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88880072c0 con 0x7f8890143240 2021-11-12T05:49:46.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.325+0000 7f88961ea700 1 -- 172.21.2.105:0/3151094419 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f887800d410 con 0x7f8890143240 2021-11-12T05:49:46.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.325+0000 7f88961ea700 1 -- 172.21.2.105:0/3151094419 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88901448b0 con 0x7f8890143240 2021-11-12T05:49:46.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.325+0000 7f88961ea700 1 -- 172.21.2.105:0/3151094419 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8890057350 con 0x7f8890143240 2021-11-12T05:49:46.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.325+0000 7f888cff9700 1 -- 172.21.2.105:0/3151094419 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f888801a060 con 0x7f8890143240 2021-11-12T05:49:46.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.325+0000 7f888cff9700 1 --2- 172.21.2.105:0/3151094419 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8874053690 0x7f8874055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:46.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.325+0000 7f888cff9700 1 -- 172.21.2.105:0/3151094419 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f888806b6f0 con 0x7f8890143240 2021-11-12T05:49:46.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.325+0000 7f888f7fe700 1 --2- 172.21.2.105:0/3151094419 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8874053690 0x7f8874055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:46.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.325+0000 7f888f7fe700 1 --2- 172.21.2.105:0/3151094419 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8874053690 0x7f8874055b50 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f8878002f70 tx=0x7f889013fc70).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:46.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.329+0000 7f888cff9700 1 -- 172.21.2.105:0/3151094419 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f88880425f0 con 0x7f8890143240 2021-11-12T05:49:46.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:46.433+0000 7f88961ea700 1 -- 172.21.2.105:0/3151094419 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f889005faa0 con 0x7f8890143240 2021-11-12T05:49:47.159 INFO:tasks.ceph.mon.a.gibba005.stderr:2021-11-12T05:49:47.157+0000 7fe9772b2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-12T05:49:47.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.169+0000 7f888cff9700 1 -- 172.21.2.105:0/3151094419 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v70) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8888018020 con 0x7f8890143240 2021-11-12T05:49:47.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.169+0000 7f88961ea700 1 -- 172.21.2.105:0/3151094419 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8874053690 msgr2=0x7f8874055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:47.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.169+0000 7f88961ea700 1 --2- 172.21.2.105:0/3151094419 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8874053690 0x7f8874055b50 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f8878002f70 tx=0x7f889013fc70).stop 2021-11-12T05:49:47.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.169+0000 7f88961ea700 1 -- 172.21.2.105:0/3151094419 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8890143240 msgr2=0x7f8890141d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:47.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.169+0000 7f88961ea700 1 --2- 172.21.2.105:0/3151094419 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8890143240 0x7f8890141d30 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 rx=0x7f88900afb30 tx=0x7f8888007f40).stop 2021-11-12T05:49:47.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.169+0000 7f88961ea700 1 -- 172.21.2.105:0/3151094419 shutdown_connections 2021-11-12T05:49:47.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.169+0000 7f88961ea700 1 --2- 172.21.2.105:0/3151094419 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8874053690 0x7f8874055b50 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:47.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.169+0000 7f88961ea700 1 --2- 172.21.2.105:0/3151094419 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8890143240 0x7f8890141d30 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:47.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.169+0000 7f88961ea700 1 --2- 172.21.2.105:0/3151094419 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f88900ad270 0x7f8890146b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:47.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.169+0000 7f88961ea700 1 --2- 172.21.2.105:0/3151094419 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f88900634b0 0x7f8890066d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:47.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.169+0000 7f88961ea700 1 -- 172.21.2.105:0/3151094419 >> 172.21.2.105:0/3151094419 conn(0x7f88900b5320 msgr2=0x7f88900afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:47.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.169+0000 7f88961ea700 1 -- 172.21.2.105:0/3151094419 shutdown_connections 2021-11-12T05:49:47.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.169+0000 7f88961ea700 1 -- 172.21.2.105:0/3151094419 wait complete. 2021-11-12T05:49:47.176 INFO:teuthology.orchestra.run.gibba005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-12T05:49:47.179 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:49:47.184 INFO:tasks.ceph.mds.a.gibba005.stdout:starting mds.a at 2021-11-12T05:49:47.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.229+0000 7f4c7b2cf700 1 Processor -- start 2021-11-12T05:49:47.233 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.229+0000 7f4c7b2cf700 1 -- start start 2021-11-12T05:49:47.239 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.229+0000 7f4c7b2cf700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4c74062010 0x7f4c740b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:47.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.229+0000 7f4c7b2cf700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f4c740b4d50 0x7f4c740b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:47.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.229+0000 7f4c7b2cf700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c740b2110 con 0x7f4c740b3100 2021-11-12T05:49:47.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.229+0000 7f4c7b2cf700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c740b2370 con 0x7f4c740b4d50 2021-11-12T05:49:47.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.229+0000 7f4c7b2cf700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c740b2610 con 0x7f4c74062010 2021-11-12T05:49:47.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.229+0000 7f4c7886a700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f4c740b3100 0x7f4c740b4640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34732/0 (socket says 172.21.2.105:34732) 2021-11-12T05:49:47.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.229+0000 7f4c7886a700 1 -- 172.21.2.105:0/3083383902 learned_addr learned my addr 172.21.2.105:0/3083383902 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:47.241 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.229+0000 7f4c63fff700 1 -- 172.21.2.105:0/3083383902 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1844326604 0 0) 0x7f4c740b2110 con 0x7f4c740b3100 2021-11-12T05:49:47.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.229+0000 7f4c63fff700 1 -- 172.21.2.105:0/3083383902 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c5c003260 con 0x7f4c740b3100 2021-11-12T05:49:47.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.229+0000 7f4c7906b700 1 --2- 172.21.2.105:0/3083383902 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4c74062010 0x7f4c740b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:47.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.229+0000 7f4c7986c700 1 --2- 172.21.2.105:0/3083383902 >> v2:172.21.2.115:3300/0 conn(0x7f4c740b4d50 0x7f4c740b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:47.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.229+0000 7f4c63fff700 1 -- 172.21.2.105:0/3083383902 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2408697757 0 0) 0x7f4c5c003260 con 0x7f4c740b3100 2021-11-12T05:49:47.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.229+0000 7f4c63fff700 1 -- 172.21.2.105:0/3083383902 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4c74062010 msgr2=0x7f4c740b5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:47.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.229+0000 7f4c63fff700 1 --2- 172.21.2.105:0/3083383902 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4c74062010 0x7f4c740b5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:47.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.229+0000 7f4c63fff700 1 -- 172.21.2.105:0/3083383902 >> v2:172.21.2.115:3300/0 conn(0x7f4c740b4d50 msgr2=0x7f4c740b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:47.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.229+0000 7f4c63fff700 1 --2- 172.21.2.105:0/3083383902 >> v2:172.21.2.115:3300/0 conn(0x7f4c740b4d50 0x7f4c740b2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:47.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.229+0000 7f4c63fff700 1 -- 172.21.2.105:0/3083383902 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c740b4330 con 0x7f4c740b3100 2021-11-12T05:49:47.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.229+0000 7f4c63fff700 1 -- 172.21.2.105:0/3083383902 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f4c70001680 con 0x7f4c740b3100 2021-11-12T05:49:47.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.229+0000 7f4c63fff700 1 -- 172.21.2.105:0/3083383902 >> v1:172.21.2.105:6789/0 conn(0x7f4c740b3100 legacy=0x7f4c740b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:47.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.229+0000 7f4c63fff700 1 --2- 172.21.2.105:0/3083383902 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4c5c003750 0x7f4c5c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:47.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.229+0000 7f4c63fff700 1 --2- 172.21.2.105:0/3083383902 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4c5c004500 0x7f4c5c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:47.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.229+0000 7f4c63fff700 1 --2- 172.21.2.105:0/3083383902 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4c74062010 0x7f4c5c004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:47.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.229+0000 7f4c63fff700 1 -- 172.21.2.105:0/3083383902 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c740b2370 con 0x7f4c5c003750 2021-11-12T05:49:47.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.229+0000 7f4c63fff700 1 -- 172.21.2.105:0/3083383902 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c740b2610 con 0x7f4c5c004500 2021-11-12T05:49:47.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.229+0000 7f4c63fff700 1 -- 172.21.2.105:0/3083383902 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5c00b7a0 con 0x7f4c74062010 2021-11-12T05:49:47.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.229+0000 7f4c7906b700 1 --2- 172.21.2.105:0/3083383902 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4c5c003750 0x7f4c5c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:47.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c7906b700 1 -- 172.21.2.105:0/3083383902 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4c74062010 msgr2=0x7f4c5c004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:47.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c7906b700 1 --2- 172.21.2.105:0/3083383902 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4c74062010 0x7f4c5c004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:47.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c7906b700 1 -- 172.21.2.105:0/3083383902 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4c5c004500 msgr2=0x7f4c5c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:47.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c7906b700 1 --2- 172.21.2.105:0/3083383902 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4c5c004500 0x7f4c5c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:47.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c7906b700 1 -- 172.21.2.105:0/3083383902 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c5c003260 con 0x7f4c5c003750 2021-11-12T05:49:47.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c7906b700 1 --2- 172.21.2.105:0/3083383902 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4c5c003750 0x7f4c5c003b70 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 rx=0x7f4c6400a000 tx=0x7f4c64008040).ready entity=mon.0 client_cookie=2f76ddea8bebd945 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:47.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c63fff700 1 -- 172.21.2.105:0/3083383902 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c64013670 con 0x7f4c5c003750 2021-11-12T05:49:47.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c63fff700 1 -- 172.21.2.105:0/3083383902 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c640137d0 con 0x7f4c5c003750 2021-11-12T05:49:47.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c63fff700 1 -- 172.21.2.105:0/3083383902 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c64013b30 con 0x7f4c5c003750 2021-11-12T05:49:47.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c7b2cf700 1 -- 172.21.2.105:0/3083383902 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4c5c003750 msgr2=0x7f4c5c003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:47.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c7b2cf700 1 --2- 172.21.2.105:0/3083383902 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4c5c003750 0x7f4c5c003b70 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 rx=0x7f4c6400a000 tx=0x7f4c64008040).stop 2021-11-12T05:49:47.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c7986c700 1 -- 172.21.2.105:0/3083383902 reap_dead start 2021-11-12T05:49:47.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c7b2cf700 1 -- 172.21.2.105:0/3083383902 shutdown_connections 2021-11-12T05:49:47.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c7b2cf700 1 -- 172.21.2.105:0/3083383902 >> 172.21.2.105:0/3083383902 conn(0x7f4c740b9790 msgr2=0x7f4c740b9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:47.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c7b2cf700 1 -- 172.21.2.105:0/3083383902 shutdown_connections 2021-11-12T05:49:47.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c7b2cf700 1 -- 172.21.2.105:0/3083383902 wait complete. 2021-11-12T05:49:47.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c7b2cf700 1 Processor -- start 2021-11-12T05:49:47.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c7b2cf700 1 -- start start 2021-11-12T05:49:47.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c7b2cf700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4c5c003750 0x7f4c74152740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:47.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c7b2cf700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4c740ae3f0 0x7f4c740ad410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:47.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c7b2cf700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4c74140120 0x7f4c741405a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:47.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c7b2cf700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c74146fa0 con 0x7f4c74140120 2021-11-12T05:49:47.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c7b2cf700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c74147240 con 0x7f4c5c003750 2021-11-12T05:49:47.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c7b2cf700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c740ad900 con 0x7f4c740ae3f0 2021-11-12T05:49:47.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c7986c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4c74140120 0x7f4c741405a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:47.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c7986c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4c74140120 0x7f4c741405a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52580/0 (socket says 172.21.2.105:52580) 2021-11-12T05:49:47.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c7986c700 1 -- 172.21.2.105:0/3028016826 learned_addr learned my addr 172.21.2.105:0/3028016826 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:47.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c7906b700 1 --2- 172.21.2.105:0/3028016826 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4c5c003750 0x7f4c74152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:47.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c7986c700 1 -- 172.21.2.105:0/3028016826 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4c740ae3f0 msgr2=0x7f4c740ad410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:47.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c7986c700 1 --2- 172.21.2.105:0/3028016826 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4c740ae3f0 0x7f4c740ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:47.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c7986c700 1 -- 172.21.2.105:0/3028016826 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4c5c003750 msgr2=0x7f4c74152740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:47.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c7986c700 1 --2- 172.21.2.105:0/3028016826 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4c5c003750 0x7f4c74152740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:47.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c7986c700 1 -- 172.21.2.105:0/3028016826 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c740af390 con 0x7f4c74140120 2021-11-12T05:49:47.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c7906b700 1 --2- 172.21.2.105:0/3028016826 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4c5c003750 0x7f4c74152740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:49:47.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c7986c700 1 --2- 172.21.2.105:0/3028016826 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4c74140120 0x7f4c741405a0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 rx=0x7f4c6c000b60 tx=0x7f4c6c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:47.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c627fc700 1 -- 172.21.2.105:0/3028016826 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c6c00c070 con 0x7f4c74140120 2021-11-12T05:49:47.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c627fc700 1 -- 172.21.2.105:0/3028016826 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6c0135e0 con 0x7f4c74140120 2021-11-12T05:49:47.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c627fc700 1 -- 172.21.2.105:0/3028016826 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c6c013940 con 0x7f4c74140120 2021-11-12T05:49:47.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c7b2cf700 1 -- 172.21.2.105:0/3028016826 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c74140a90 con 0x7f4c74140120 2021-11-12T05:49:47.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c7b2cf700 1 -- 172.21.2.105:0/3028016826 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c74156090 con 0x7f4c74140120 2021-11-12T05:49:47.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c7b2cf700 1 -- 172.21.2.105:0/3028016826 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c74146dc0 con 0x7f4c74140120 2021-11-12T05:49:47.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c627fc700 1 -- 172.21.2.105:0/3028016826 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4c6c01b030 con 0x7f4c74140120 2021-11-12T05:49:47.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c627fc700 1 --2- 172.21.2.105:0/3028016826 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4c540536d0 0x7f4c54055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:47.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c627fc700 1 -- 172.21.2.105:0/3028016826 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f4c6c06aec0 con 0x7f4c74140120 2021-11-12T05:49:47.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c7906b700 1 --2- 172.21.2.105:0/3028016826 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4c540536d0 0x7f4c54055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:47.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.233+0000 7f4c7906b700 1 --2- 172.21.2.105:0/3028016826 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4c540536d0 0x7f4c54055b90 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f4c64002000 tx=0x7f4c64008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:47.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.237+0000 7f4c627fc700 1 -- 172.21.2.105:0/3028016826 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4c6c041e70 con 0x7f4c74140120 2021-11-12T05:49:47.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.349+0000 7f4c7b2cf700 1 -- 172.21.2.105:0/3028016826 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c74147400 con 0x7f4c74140120 2021-11-12T05:49:47.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.349+0000 7f4c627fc700 1 -- 172.21.2.105:0/3028016826 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+1779 (secure 0 0 0) 0x7f4c6c045490 con 0x7f4c74140120 2021-11-12T05:49:47.353 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:47.353 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":70,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5066,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/506237043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":506237043},{"type":"v1","addr":"172.21.2.115:6833","nonce":506237043}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":68}],"filesystems":[{"mdsmap":{"epoch":70,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:49:37.422405+0000","modified":"2021-11-12T05:49:47.158662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":147,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-11-12T05:49:47.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.349+0000 7f4c7b2cf700 1 -- 172.21.2.105:0/3028016826 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4c540536d0 msgr2=0x7f4c54055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:47.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.349+0000 7f4c7b2cf700 1 --2- 172.21.2.105:0/3028016826 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4c540536d0 0x7f4c54055b90 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f4c64002000 tx=0x7f4c64008040).stop 2021-11-12T05:49:47.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.349+0000 7f4c7b2cf700 1 -- 172.21.2.105:0/3028016826 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4c74140120 msgr2=0x7f4c741405a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:47.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.349+0000 7f4c7b2cf700 1 --2- 172.21.2.105:0/3028016826 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4c74140120 0x7f4c741405a0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 rx=0x7f4c6c000b60 tx=0x7f4c6c008040).stop 2021-11-12T05:49:47.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.349+0000 7f4c7b2cf700 1 -- 172.21.2.105:0/3028016826 shutdown_connections 2021-11-12T05:49:47.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.349+0000 7f4c7b2cf700 1 --2- 172.21.2.105:0/3028016826 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4c540536d0 0x7f4c54055b90 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:47.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.349+0000 7f4c7b2cf700 1 --2- 172.21.2.105:0/3028016826 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4c74140120 0x7f4c741405a0 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:47.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.349+0000 7f4c7b2cf700 1 --2- 172.21.2.105:0/3028016826 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4c740ae3f0 0x7f4c740ad410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:47.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.349+0000 7f4c7b2cf700 1 --2- 172.21.2.105:0/3028016826 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4c5c003750 0x7f4c74152740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:47.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.349+0000 7f4c7b2cf700 1 -- 172.21.2.105:0/3028016826 >> 172.21.2.105:0/3028016826 conn(0x7f4c740b9790 msgr2=0x7f4c74141630 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:47.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.349+0000 7f4c7b2cf700 1 -- 172.21.2.105:0/3028016826 shutdown_connections 2021-11-12T05:49:47.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.349+0000 7f4c7b2cf700 1 -- 172.21.2.105:0/3028016826 wait complete. 2021-11-12T05:49:47.357 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 70 2021-11-12T05:49:47.360 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-12T05:49:47.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.409+0000 7f60ec288700 1 Processor -- start 2021-11-12T05:49:47.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.409+0000 7f60ec288700 1 -- start start 2021-11-12T05:49:47.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.409+0000 7f60ec288700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f60e40ace20 0x7f60e40b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:47.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.409+0000 7f60ec288700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f60e4144180 0x7f60e41445f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:47.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.409+0000 7f60ec288700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e40b1840 con 0x7f60e40aca40 2021-11-12T05:49:47.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.409+0000 7f60ec288700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e40b0a10 con 0x7f60e4144180 2021-11-12T05:49:47.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.409+0000 7f60ec288700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e40af2b0 con 0x7f60e40ace20 2021-11-12T05:49:47.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.409+0000 7f60ea825700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f60e4144180 0x7f60e41445f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:47.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.409+0000 7f60ea024700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f60e40aca40 0x7f60e41473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34748/0 (socket says 172.21.2.105:34748) 2021-11-12T05:49:47.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.409+0000 7f60ea024700 1 -- 172.21.2.105:0/2316644602 learned_addr learned my addr 172.21.2.105:0/2316644602 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:47.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.409+0000 7f60ea825700 1 -- 172.21.2.105:0/2316644602 >> v2:172.21.2.115:3300/0 conn(0x7f60e40ace20 msgr2=0x7f60e40b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:47.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.409+0000 7f60ea825700 1 --2- 172.21.2.105:0/2316644602 >> v2:172.21.2.115:3300/0 conn(0x7f60e40ace20 0x7f60e40b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:47.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.409+0000 7f60ea825700 1 -- 172.21.2.105:0/2316644602 >> v1:172.21.2.105:6789/0 conn(0x7f60e40aca40 legacy=0x7f60e41473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:47.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.409+0000 7f60ea825700 1 -- 172.21.2.105:0/2316644602 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e40b1a70 con 0x7f60e4144180 2021-11-12T05:49:47.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.409+0000 7f60ea825700 1 --2- 172.21.2.105:0/2316644602 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60e4144180 0x7f60e41445f0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 rx=0x7f60dc0032f0 tx=0x7f60dc0091d0).ready entity=mon.0 client_cookie=7b1304e24f011776 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:47.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.409+0000 7f60e9022700 1 -- 172.21.2.105:0/2316644602 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60dc009ea0 con 0x7f60e4144180 2021-11-12T05:49:47.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.409+0000 7f60e9022700 1 -- 172.21.2.105:0/2316644602 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60dc00b870 con 0x7f60e4144180 2021-11-12T05:49:47.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.409+0000 7f60e9022700 1 -- 172.21.2.105:0/2316644602 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60dc00b9e0 con 0x7f60e4144180 2021-11-12T05:49:47.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.409+0000 7f60ec288700 1 -- 172.21.2.105:0/2316644602 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60e4144180 msgr2=0x7f60e41445f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:47.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.409+0000 7f60ec288700 1 --2- 172.21.2.105:0/2316644602 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60e4144180 0x7f60e41445f0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 rx=0x7f60dc0032f0 tx=0x7f60dc0091d0).stop 2021-11-12T05:49:47.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.409+0000 7f60ec288700 1 -- 172.21.2.105:0/2316644602 shutdown_connections 2021-11-12T05:49:47.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.409+0000 7f60ec288700 1 --2- 172.21.2.105:0/2316644602 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60e4144180 0x7f60e41445f0 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:47.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.409+0000 7f60ec288700 1 --2- 172.21.2.105:0/2316644602 >> v2:172.21.2.115:3300/0 conn(0x7f60e40ace20 0x7f60e40b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:47.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.409+0000 7f60ec288700 1 -- 172.21.2.105:0/2316644602 >> 172.21.2.105:0/2316644602 conn(0x7f60e405c490 msgr2=0x7f60e40b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:47.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.409+0000 7f60ec288700 1 -- 172.21.2.105:0/2316644602 shutdown_connections 2021-11-12T05:49:47.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.409+0000 7f60ec288700 1 -- 172.21.2.105:0/2316644602 wait complete. 2021-11-12T05:49:47.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.413+0000 7f60ec288700 1 Processor -- start 2021-11-12T05:49:47.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.413+0000 7f60ec288700 1 -- start start 2021-11-12T05:49:47.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.413+0000 7f60ec288700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60e40aca40 0x7f60e40b38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:47.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.413+0000 7f60ec288700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f60e40ace20 0x7f60e40625e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:47.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.413+0000 7f60ec288700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60e4144180 0x7f60e4062ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:47.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.413+0000 7f60ec288700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e4146460 con 0x7f60e40aca40 2021-11-12T05:49:47.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.413+0000 7f60ec288700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e41452a0 con 0x7f60e40ace20 2021-11-12T05:49:47.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.413+0000 7f60ec288700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e4145fc0 con 0x7f60e4144180 2021-11-12T05:49:47.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.413+0000 7f60ea024700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60e40aca40 0x7f60e40b38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:47.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.413+0000 7f60ea024700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60e40aca40 0x7f60e40b38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52590/0 (socket says 172.21.2.105:52590) 2021-11-12T05:49:47.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.413+0000 7f60ea024700 1 -- 172.21.2.105:0/3422951447 learned_addr learned my addr 172.21.2.105:0/3422951447 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:47.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.413+0000 7f60ea024700 1 -- 172.21.2.105:0/3422951447 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60e4144180 msgr2=0x7f60e4062ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:49:47.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.413+0000 7f60ea024700 1 --2- 172.21.2.105:0/3422951447 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60e4144180 0x7f60e4062ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:47.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.413+0000 7f60ea024700 1 -- 172.21.2.105:0/3422951447 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f60e40ace20 msgr2=0x7f60e40625e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T05:49:47.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.413+0000 7f60ea024700 1 --2- 172.21.2.105:0/3422951447 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f60e40ace20 0x7f60e40625e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:47.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.413+0000 7f60ea024700 1 -- 172.21.2.105:0/3422951447 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60dc009470 con 0x7f60e40aca40 2021-11-12T05:49:47.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.413+0000 7f60ea024700 1 --2- 172.21.2.105:0/3422951447 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60e40aca40 0x7f60e40b38c0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 rx=0x7f60e4061140 tx=0x7f60e0007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:47.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.413+0000 7f60d77fe700 1 -- 172.21.2.105:0/3422951447 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60e000ce30 con 0x7f60e40aca40 2021-11-12T05:49:47.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.413+0000 7f60d77fe700 1 -- 172.21.2.105:0/3422951447 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e00072e0 con 0x7f60e40aca40 2021-11-12T05:49:47.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.413+0000 7f60ec288700 1 -- 172.21.2.105:0/3422951447 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e4066e30 con 0x7f60e40aca40 2021-11-12T05:49:47.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.413+0000 7f60d77fe700 1 -- 172.21.2.105:0/3422951447 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60e0005800 con 0x7f60e40aca40 2021-11-12T05:49:47.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.413+0000 7f60ec288700 1 -- 172.21.2.105:0/3422951447 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e4144ec0 con 0x7f60e40aca40 2021-11-12T05:49:47.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.413+0000 7f60ec288700 1 -- 172.21.2.105:0/3422951447 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e4057350 con 0x7f60e40aca40 2021-11-12T05:49:47.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.413+0000 7f60d77fe700 1 -- 172.21.2.105:0/3422951447 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f60e0010070 con 0x7f60e40aca40 2021-11-12T05:49:47.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.413+0000 7f60d77fe700 1 --2- 172.21.2.105:0/3422951447 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f60c4053640 0x7f60c4055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:47.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.413+0000 7f60d77fe700 1 -- 172.21.2.105:0/3422951447 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f60e006b0b0 con 0x7f60e40aca40 2021-11-12T05:49:47.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.413+0000 7f60e9823700 1 --2- 172.21.2.105:0/3422951447 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f60c4053640 0x7f60c4055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:47.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.413+0000 7f60e9823700 1 --2- 172.21.2.105:0/3422951447 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f60c4053640 0x7f60c4055b00 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f60d8002f70 tx=0x7f60d8006a00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:47.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.417+0000 7f60d77fe700 1 -- 172.21.2.105:0/3422951447 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f60e0042060 con 0x7f60e40aca40 2021-11-12T05:49:47.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:47.525+0000 7f60ec288700 1 -- 172.21.2.105:0/3422951447 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f60e40674e0 con 0x7f60e40aca40 2021-11-12T05:49:48.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.173+0000 7f60d77fe700 1 -- 172.21.2.105:0/3422951447 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v71) v1 ==== 104+0+0 (secure 0 0 0) 0x7f60e0045680 con 0x7f60e40aca40 2021-11-12T05:49:48.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.173+0000 7f60ec288700 1 -- 172.21.2.105:0/3422951447 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f60c4053640 msgr2=0x7f60c4055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:48.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.173+0000 7f60ec288700 1 --2- 172.21.2.105:0/3422951447 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f60c4053640 0x7f60c4055b00 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f60d8002f70 tx=0x7f60d8006a00).stop 2021-11-12T05:49:48.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.173+0000 7f60ec288700 1 -- 172.21.2.105:0/3422951447 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60e40aca40 msgr2=0x7f60e40b38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:48.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.173+0000 7f60ec288700 1 --2- 172.21.2.105:0/3422951447 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60e40aca40 0x7f60e40b38c0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 rx=0x7f60e4061140 tx=0x7f60e0007c00).stop 2021-11-12T05:49:48.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.173+0000 7f60ec288700 1 -- 172.21.2.105:0/3422951447 shutdown_connections 2021-11-12T05:49:48.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.173+0000 7f60ec288700 1 --2- 172.21.2.105:0/3422951447 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f60c4053640 0x7f60c4055b00 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:48.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.173+0000 7f60ec288700 1 --2- 172.21.2.105:0/3422951447 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f60e4144180 0x7f60e4062ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:48.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.173+0000 7f60ec288700 1 --2- 172.21.2.105:0/3422951447 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f60e40ace20 0x7f60e40625e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:48.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.173+0000 7f60ec288700 1 --2- 172.21.2.105:0/3422951447 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f60e40aca40 0x7f60e40b38c0 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:48.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.173+0000 7f60ec288700 1 -- 172.21.2.105:0/3422951447 >> 172.21.2.105:0/3422951447 conn(0x7f60e405c490 msgr2=0x7f60e414afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:48.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.173+0000 7f60ec288700 1 -- 172.21.2.105:0/3422951447 shutdown_connections 2021-11-12T05:49:48.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.177+0000 7f60ec288700 1 -- 172.21.2.105:0/3422951447 wait complete. 2021-11-12T05:49:48.185 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-12T05:49:48.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.233+0000 7f1d527a8700 1 Processor -- start 2021-11-12T05:49:48.238 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.233+0000 7f1d527a8700 1 -- start start 2021-11-12T05:49:48.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.233+0000 7f1d527a8700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1d4c14b2f0 0x7f1d4c0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:48.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.233+0000 7f1d527a8700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d4c0ac7b0 con 0x7f1d4c0ac280 2021-11-12T05:49:48.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.233+0000 7f1d527a8700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d4c0ac9e0 con 0x7f1d4c0ad080 2021-11-12T05:49:48.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.233+0000 7f1d527a8700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c1488a0 con 0x7f1d4c14b2f0 2021-11-12T05:49:48.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.233+0000 7f1d4b7fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f1d4c0ac280 0x7f1d4c147a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34766/0 (socket says 172.21.2.105:34766) 2021-11-12T05:49:48.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d4b7fe700 1 -- 172.21.2.105:0/874048290 learned_addr learned my addr 172.21.2.105:0/874048290 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:48.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d50d45700 1 --2- 172.21.2.105:0/874048290 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1d4c14b2f0 0x7f1d4c0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:48.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d4affd700 1 -- 172.21.2.105:0/874048290 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4282756354 0 0) 0x7f1d4c0ac7b0 con 0x7f1d4c0ac280 2021-11-12T05:49:48.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d4affd700 1 -- 172.21.2.105:0/874048290 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d2c003260 con 0x7f1d4c0ac280 2021-11-12T05:49:48.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d4affd700 1 -- 172.21.2.105:0/874048290 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3932352685 0 0) 0x7f1d2c003260 con 0x7f1d4c0ac280 2021-11-12T05:49:48.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d4affd700 1 -- 172.21.2.105:0/874048290 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1d4c14b2f0 msgr2=0x7f1d4c0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:48.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d4affd700 1 --2- 172.21.2.105:0/874048290 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1d4c14b2f0 0x7f1d4c0af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:48.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d4affd700 1 -- 172.21.2.105:0/874048290 >> v1:172.21.2.115:6789/0 conn(0x7f1d4c0ad080 legacy=0x7f1d4c14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:48.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d4affd700 1 -- 172.21.2.105:0/874048290 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d4c0b0b30 con 0x7f1d4c0ac280 2021-11-12T05:49:48.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d4affd700 1 -- 172.21.2.105:0/874048290 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f1d3c001660 con 0x7f1d4c0ac280 2021-11-12T05:49:48.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d4affd700 1 -- 172.21.2.105:0/874048290 >> v1:172.21.2.105:6789/0 conn(0x7f1d4c0ac280 legacy=0x7f1d4c147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:48.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d4affd700 1 --2- 172.21.2.105:0/874048290 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1d4c14b2f0 0x7f1d2c003780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:48.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d4affd700 1 --2- 172.21.2.105:0/874048290 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1d2c003cb0 0x7f1d2c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:48.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d4affd700 1 --2- 172.21.2.105:0/874048290 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1d2c0049f0 0x7f1d2c004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:48.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d4affd700 1 -- 172.21.2.105:0/874048290 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c1488a0 con 0x7f1d2c0049f0 2021-11-12T05:49:48.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d4affd700 1 -- 172.21.2.105:0/874048290 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c00b800 con 0x7f1d2c003cb0 2021-11-12T05:49:48.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d4affd700 1 -- 172.21.2.105:0/874048290 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c00b9c0 con 0x7f1d4c14b2f0 2021-11-12T05:49:48.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d50d45700 1 --2- 172.21.2.105:0/874048290 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1d2c0049f0 0x7f1d2c004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:48.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d4b7fe700 1 --2- 172.21.2.105:0/874048290 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1d2c003cb0 0x7f1d2c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:48.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d4bfff700 1 --2- 172.21.2.105:0/874048290 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1d4c14b2f0 0x7f1d2c003780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:48.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d50d45700 1 -- 172.21.2.105:0/874048290 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1d4c14b2f0 msgr2=0x7f1d2c003780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:48.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d50d45700 1 --2- 172.21.2.105:0/874048290 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1d4c14b2f0 0x7f1d2c003780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:48.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d50d45700 1 -- 172.21.2.105:0/874048290 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1d2c003cb0 msgr2=0x7f1d2c004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:48.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d50d45700 1 --2- 172.21.2.105:0/874048290 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1d2c003cb0 0x7f1d2c004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:48.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d50d45700 1 -- 172.21.2.105:0/874048290 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d2c003260 con 0x7f1d2c0049f0 2021-11-12T05:49:48.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d50d45700 1 --2- 172.21.2.105:0/874048290 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1d2c0049f0 0x7f1d2c004e70 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 rx=0x7f1d4400c000 tx=0x7f1d440091d0).ready entity=mon.0 client_cookie=c565f461bb89e3a7 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:48.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d4affd700 1 -- 172.21.2.105:0/874048290 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d4400e7e0 con 0x7f1d2c0049f0 2021-11-12T05:49:48.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d4affd700 1 -- 172.21.2.105:0/874048290 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d4400e940 con 0x7f1d2c0049f0 2021-11-12T05:49:48.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d4affd700 1 -- 172.21.2.105:0/874048290 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d4400eca0 con 0x7f1d2c0049f0 2021-11-12T05:49:48.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d527a8700 1 -- 172.21.2.105:0/874048290 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1d2c0049f0 msgr2=0x7f1d2c004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:48.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d527a8700 1 --2- 172.21.2.105:0/874048290 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1d2c0049f0 0x7f1d2c004e70 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 rx=0x7f1d4400c000 tx=0x7f1d440091d0).stop 2021-11-12T05:49:48.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d50d45700 1 -- 172.21.2.105:0/874048290 reap_dead start 2021-11-12T05:49:48.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d527a8700 1 -- 172.21.2.105:0/874048290 shutdown_connections 2021-11-12T05:49:48.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d527a8700 1 -- 172.21.2.105:0/874048290 >> 172.21.2.105:0/874048290 conn(0x7f1d4c0b5370 msgr2=0x7f1d4c0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:48.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d527a8700 1 -- 172.21.2.105:0/874048290 shutdown_connections 2021-11-12T05:49:48.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d527a8700 1 -- 172.21.2.105:0/874048290 wait complete. 2021-11-12T05:49:48.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d527a8700 1 Processor -- start 2021-11-12T05:49:48.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d527a8700 1 -- start start 2021-11-12T05:49:48.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d527a8700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1d2c0049f0 0x7f1d4c15ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:48.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d527a8700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1d4c0a9410 0x7f1d4c147d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:48.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d527a8700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1d4c063930 0x7f1d4c0a7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:48.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d527a8700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c15a1a0 con 0x7f1d2c0049f0 2021-11-12T05:49:48.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d527a8700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c15a440 con 0x7f1d4c063930 2021-11-12T05:49:48.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d527a8700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4c15a6e0 con 0x7f1d4c0a9410 2021-11-12T05:49:48.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d4bfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1d2c0049f0 0x7f1d4c15ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:48.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d4bfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1d2c0049f0 0x7f1d4c15ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52612/0 (socket says 172.21.2.105:52612) 2021-11-12T05:49:48.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d4bfff700 1 -- 172.21.2.105:0/3200245815 learned_addr learned my addr 172.21.2.105:0/3200245815 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:48.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d4b7fe700 1 --2- 172.21.2.105:0/3200245815 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1d4c0a9410 0x7f1d4c147d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:48.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d50d45700 1 --2- 172.21.2.105:0/3200245815 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1d4c063930 0x7f1d4c0a7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:48.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d4bfff700 1 -- 172.21.2.105:0/3200245815 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1d4c0a9410 msgr2=0x7f1d4c147d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:48.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d4bfff700 1 --2- 172.21.2.105:0/3200245815 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1d4c0a9410 0x7f1d4c147d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:48.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d4bfff700 1 -- 172.21.2.105:0/3200245815 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1d4c063930 msgr2=0x7f1d4c0a7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:48.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d4bfff700 1 --2- 172.21.2.105:0/3200245815 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1d4c063930 0x7f1d4c0a7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:48.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d4bfff700 1 -- 172.21.2.105:0/3200245815 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d4c063db0 con 0x7f1d2c0049f0 2021-11-12T05:49:48.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d4bfff700 1 --2- 172.21.2.105:0/3200245815 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1d2c0049f0 0x7f1d4c15ab80 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 rx=0x7f1d3400d000 tx=0x7f1d34007a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:48.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d497fa700 1 -- 172.21.2.105:0/3200245815 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d340114c0 con 0x7f1d2c0049f0 2021-11-12T05:49:48.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.237+0000 7f1d497fa700 1 -- 172.21.2.105:0/3200245815 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d34011620 con 0x7f1d2c0049f0 2021-11-12T05:49:48.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.241+0000 7f1d527a8700 1 -- 172.21.2.105:0/3200245815 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d4c0a7510 con 0x7f1d2c0049f0 2021-11-12T05:49:48.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.241+0000 7f1d497fa700 1 -- 172.21.2.105:0/3200245815 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d34011980 con 0x7f1d2c0049f0 2021-11-12T05:49:48.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.241+0000 7f1d527a8700 1 -- 172.21.2.105:0/3200245815 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d4c0a79c0 con 0x7f1d2c0049f0 2021-11-12T05:49:48.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.241+0000 7f1d527a8700 1 -- 172.21.2.105:0/3200245815 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d4c0b1440 con 0x7f1d2c0049f0 2021-11-12T05:49:48.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.241+0000 7f1d497fa700 1 -- 172.21.2.105:0/3200245815 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f1d3401a030 con 0x7f1d2c0049f0 2021-11-12T05:49:48.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.241+0000 7f1d497fa700 1 --2- 172.21.2.105:0/3200245815 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1d300534f0 0x7f1d300559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:48.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.241+0000 7f1d497fa700 1 -- 172.21.2.105:0/3200245815 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f1d3406b440 con 0x7f1d2c0049f0 2021-11-12T05:49:48.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.241+0000 7f1d4b7fe700 1 --2- 172.21.2.105:0/3200245815 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1d300534f0 0x7f1d300559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:48.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.241+0000 7f1d4b7fe700 1 --2- 172.21.2.105:0/3200245815 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1d300534f0 0x7f1d300559b0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f1d3c005000 tx=0x7f1d3c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:48.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.241+0000 7f1d497fa700 1 -- 172.21.2.105:0/3200245815 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1d340424a0 con 0x7f1d2c0049f0 2021-11-12T05:49:48.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:48.325+0000 7f1d527a8700 1 -- 172.21.2.105:0/3200245815 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1d4c057350 con 0x7f1d2c0049f0 2021-11-12T05:49:49.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.181+0000 7f1d497fa700 1 -- 172.21.2.105:0/3200245815 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v148) v1 ==== 185+0+0 (secure 0 0 0) 0x7f1d34018070 con 0x7f1d2c0049f0 2021-11-12T05:49:49.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.185+0000 7f1d527a8700 1 -- 172.21.2.105:0/3200245815 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1d300534f0 msgr2=0x7f1d300559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:49.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.185+0000 7f1d527a8700 1 --2- 172.21.2.105:0/3200245815 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1d300534f0 0x7f1d300559b0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f1d3c005000 tx=0x7f1d3c009040).stop 2021-11-12T05:49:49.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.185+0000 7f1d527a8700 1 -- 172.21.2.105:0/3200245815 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1d2c0049f0 msgr2=0x7f1d4c15ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:49.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.185+0000 7f1d527a8700 1 --2- 172.21.2.105:0/3200245815 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1d2c0049f0 0x7f1d4c15ab80 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 rx=0x7f1d3400d000 tx=0x7f1d34007a00).stop 2021-11-12T05:49:49.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.185+0000 7f1d527a8700 1 -- 172.21.2.105:0/3200245815 shutdown_connections 2021-11-12T05:49:49.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.185+0000 7f1d527a8700 1 --2- 172.21.2.105:0/3200245815 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f1d300534f0 0x7f1d300559b0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:49.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.185+0000 7f1d527a8700 1 --2- 172.21.2.105:0/3200245815 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f1d4c063930 0x7f1d4c0a7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:49.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.185+0000 7f1d527a8700 1 --2- 172.21.2.105:0/3200245815 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f1d4c0a9410 0x7f1d4c147d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:49.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.185+0000 7f1d527a8700 1 --2- 172.21.2.105:0/3200245815 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f1d2c0049f0 0x7f1d4c15ab80 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:49.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.185+0000 7f1d527a8700 1 -- 172.21.2.105:0/3200245815 >> 172.21.2.105:0/3200245815 conn(0x7f1d4c0b5370 msgr2=0x7f1d4c143bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:49.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.185+0000 7f1d527a8700 1 -- 172.21.2.105:0/3200245815 shutdown_connections 2021-11-12T05:49:49.190 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.185+0000 7f1d527a8700 1 -- 172.21.2.105:0/3200245815 wait complete. 2021-11-12T05:49:49.191 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_metadata' removed 2021-11-12T05:49:49.194 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-12T05:49:49.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.245+0000 7f521b21a700 1 Processor -- start 2021-11-12T05:49:49.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.245+0000 7f521b21a700 1 -- start start 2021-11-12T05:49:49.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.245+0000 7f521b21a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f52140ad080 0x7f52140af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:49.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.245+0000 7f521b21a700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f52140ac280 0x7f52140ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:49.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.245+0000 7f521b21a700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f521414abe0 0x7f521414b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:49.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.245+0000 7f521b21a700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52141488a0 con 0x7f52140ac280 2021-11-12T05:49:49.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.245+0000 7f521b21a700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52140ac7b0 con 0x7f521414abe0 2021-11-12T05:49:49.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.245+0000 7f521b21a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52140ac9e0 con 0x7f52140ad080 2021-11-12T05:49:49.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.245+0000 7f5213fff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f52140ac280 0x7f52140ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:49.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.245+0000 7f5213fff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f52140ac280 0x7f52140ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52624/0 (socket says 172.21.2.105:52624) 2021-11-12T05:49:49.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.245+0000 7f5213fff700 1 -- 172.21.2.105:0/66539247 learned_addr learned my addr 172.21.2.105:0/66539247 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:49.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.245+0000 7f5213fff700 1 -- 172.21.2.105:0/66539247 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f52140ad080 msgr2=0x7f52140af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:49.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.245+0000 7f5213fff700 1 --2- 172.21.2.105:0/66539247 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f52140ad080 0x7f52140af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:49.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.245+0000 7f5213fff700 1 -- 172.21.2.105:0/66539247 >> v2:172.21.2.115:3300/0 conn(0x7f521414abe0 msgr2=0x7f521414b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:49.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.245+0000 7f5213fff700 1 --2- 172.21.2.105:0/66539247 >> v2:172.21.2.115:3300/0 conn(0x7f521414abe0 0x7f521414b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:49.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.245+0000 7f5213fff700 1 -- 172.21.2.105:0/66539247 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52140b0b30 con 0x7f52140ac280 2021-11-12T05:49:49.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.245+0000 7f5213fff700 1 --2- 172.21.2.105:0/66539247 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f52140ac280 0x7f52140ad460 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 rx=0x7f52140ac6a0 tx=0x7f5204006eb0).ready entity=mon.0 client_cookie=c32cb3804ac9bbb0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:49.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.245+0000 7f52137fe700 1 -- 172.21.2.105:0/66539247 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f520400d570 con 0x7f52140ac280 2021-11-12T05:49:49.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.245+0000 7f52137fe700 1 -- 172.21.2.105:0/66539247 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5204000e90 con 0x7f52140ac280 2021-11-12T05:49:49.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.245+0000 7f52137fe700 1 -- 172.21.2.105:0/66539247 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f520400d8c0 con 0x7f52140ac280 2021-11-12T05:49:49.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.245+0000 7f521b21a700 1 -- 172.21.2.105:0/66539247 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f52140ac280 msgr2=0x7f52140ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:49.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.245+0000 7f521b21a700 1 --2- 172.21.2.105:0/66539247 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f52140ac280 0x7f52140ad460 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 rx=0x7f52140ac6a0 tx=0x7f5204006eb0).stop 2021-11-12T05:49:49.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.249+0000 7f521b21a700 1 -- 172.21.2.105:0/66539247 shutdown_connections 2021-11-12T05:49:49.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.249+0000 7f521b21a700 1 --2- 172.21.2.105:0/66539247 >> v2:172.21.2.115:3300/0 conn(0x7f521414abe0 0x7f521414b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:49.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.249+0000 7f521b21a700 1 --2- 172.21.2.105:0/66539247 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f52140ac280 0x7f52140ad460 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:49.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.249+0000 7f521b21a700 1 --2- 172.21.2.105:0/66539247 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f52140ad080 0x7f52140af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:49.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.249+0000 7f521b21a700 1 -- 172.21.2.105:0/66539247 >> 172.21.2.105:0/66539247 conn(0x7f52140b5370 msgr2=0x7f52140b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:49.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.249+0000 7f521b21a700 1 -- 172.21.2.105:0/66539247 shutdown_connections 2021-11-12T05:49:49.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.249+0000 7f521b21a700 1 -- 172.21.2.105:0/66539247 wait complete. 2021-11-12T05:49:49.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.249+0000 7f521b21a700 1 Processor -- start 2021-11-12T05:49:49.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.249+0000 7f521b21a700 1 -- start start 2021-11-12T05:49:49.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.249+0000 7f521b21a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f52140ac280 0x7f52140aaa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:49.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.249+0000 7f521b21a700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f52140ad080 0x7f52140a94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:49.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.249+0000 7f521b21a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f521414abe0 0x7f52140636d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:49.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.249+0000 7f521b21a700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52140ab050 con 0x7f52140ac280 2021-11-12T05:49:49.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.249+0000 7f521b21a700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52140ab2f0 con 0x7f52140ad080 2021-11-12T05:49:49.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.249+0000 7f521b21a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52140ab590 con 0x7f521414abe0 2021-11-12T05:49:49.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.249+0000 7f5218fb6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f52140ac280 0x7f52140aaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:49.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.249+0000 7f5218fb6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f52140ac280 0x7f52140aaa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52628/0 (socket says 172.21.2.105:52628) 2021-11-12T05:49:49.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.249+0000 7f5218fb6700 1 -- 172.21.2.105:0/2447787303 learned_addr learned my addr 172.21.2.105:0/2447787303 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:49.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.249+0000 7f5218fb6700 1 -- 172.21.2.105:0/2447787303 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f521414abe0 msgr2=0x7f52140636d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:49.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.249+0000 7f5218fb6700 1 --2- 172.21.2.105:0/2447787303 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f521414abe0 0x7f52140636d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:49.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.249+0000 7f5218fb6700 1 -- 172.21.2.105:0/2447787303 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f52140ad080 msgr2=0x7f52140a94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:49.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.249+0000 7f5218fb6700 1 --2- 172.21.2.105:0/2447787303 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f52140ad080 0x7f52140a94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:49.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.249+0000 7f5218fb6700 1 -- 172.21.2.105:0/2447787303 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520400b1e0 con 0x7f52140ac280 2021-11-12T05:49:49.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.249+0000 7f5218fb6700 1 --2- 172.21.2.105:0/2447787303 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f52140ac280 0x7f52140aaa20 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 rx=0x7f51fc002f70 tx=0x7f51fc006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:49.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.249+0000 7f5211ffb700 1 -- 172.21.2.105:0/2447787303 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51fc013460 con 0x7f52140ac280 2021-11-12T05:49:49.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.249+0000 7f5211ffb700 1 -- 172.21.2.105:0/2447787303 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51fc0135c0 con 0x7f52140ac280 2021-11-12T05:49:49.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.249+0000 7f5211ffb700 1 -- 172.21.2.105:0/2447787303 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51fc013920 con 0x7f52140ac280 2021-11-12T05:49:49.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.249+0000 7f521b21a700 1 -- 172.21.2.105:0/2447787303 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52140a99b0 con 0x7f52140ac280 2021-11-12T05:49:49.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.249+0000 7f521b21a700 1 -- 172.21.2.105:0/2447787303 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52140aa670 con 0x7f52140ac280 2021-11-12T05:49:49.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.249+0000 7f521b21a700 1 -- 172.21.2.105:0/2447787303 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f521414b580 con 0x7f52140ac280 2021-11-12T05:49:49.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.249+0000 7f5211ffb700 1 -- 172.21.2.105:0/2447787303 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f51fc00f070 con 0x7f52140ac280 2021-11-12T05:49:49.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.249+0000 7f5211ffb700 1 --2- 172.21.2.105:0/2447787303 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f51f80536a0 0x7f51f8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:49.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.249+0000 7f5211ffb700 1 -- 172.21.2.105:0/2447787303 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6064+0+0 (secure 0 0 0) 0x7f51fc06b2d0 con 0x7f52140ac280 2021-11-12T05:49:49.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.249+0000 7f5213fff700 1 --2- 172.21.2.105:0/2447787303 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f51f80536a0 0x7f51f8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:49.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.249+0000 7f5213fff700 1 --2- 172.21.2.105:0/2447787303 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f51f80536a0 0x7f51f8055b60 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f52140ac6a0 tx=0x7f5204015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:49.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.253+0000 7f5211ffb700 1 -- 172.21.2.105:0/2447787303 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f51fc042440 con 0x7f52140ac280 2021-11-12T05:49:49.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:49.337+0000 7f521b21a700 1 -- 172.21.2.105:0/2447787303 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5214057350 con 0x7f52140ac280 2021-11-12T05:49:50.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.193+0000 7f5211ffb700 1 -- 172.21.2.105:0/2447787303 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v149) v1 ==== 173+0+0 (secure 0 0 0) 0x7f51fc045a60 con 0x7f52140ac280 2021-11-12T05:49:50.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.197+0000 7f521b21a700 1 -- 172.21.2.105:0/2447787303 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f51f80536a0 msgr2=0x7f51f8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:50.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.197+0000 7f521b21a700 1 --2- 172.21.2.105:0/2447787303 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f51f80536a0 0x7f51f8055b60 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f52140ac6a0 tx=0x7f5204015000).stop 2021-11-12T05:49:50.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.197+0000 7f521b21a700 1 -- 172.21.2.105:0/2447787303 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f52140ac280 msgr2=0x7f52140aaa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:50.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.197+0000 7f521b21a700 1 --2- 172.21.2.105:0/2447787303 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f52140ac280 0x7f52140aaa20 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 rx=0x7f51fc002f70 tx=0x7f51fc006ec0).stop 2021-11-12T05:49:50.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.197+0000 7f521b21a700 1 -- 172.21.2.105:0/2447787303 shutdown_connections 2021-11-12T05:49:50.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.197+0000 7f521b21a700 1 --2- 172.21.2.105:0/2447787303 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f51f80536a0 0x7f51f8055b60 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:50.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.197+0000 7f521b21a700 1 --2- 172.21.2.105:0/2447787303 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f521414abe0 0x7f52140636d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:50.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.197+0000 7f521b21a700 1 --2- 172.21.2.105:0/2447787303 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f52140ad080 0x7f52140a94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:50.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.197+0000 7f521b21a700 1 --2- 172.21.2.105:0/2447787303 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f52140ac280 0x7f52140aaa20 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:50.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.197+0000 7f521b21a700 1 -- 172.21.2.105:0/2447787303 >> 172.21.2.105:0/2447787303 conn(0x7f52140b5370 msgr2=0x7f521405fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:50.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.197+0000 7f521b21a700 1 -- 172.21.2.105:0/2447787303 shutdown_connections 2021-11-12T05:49:50.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.197+0000 7f521b21a700 1 -- 172.21.2.105:0/2447787303 wait complete. 2021-11-12T05:49:50.202 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_data' removed 2021-11-12T05:49:50.207 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2021-11-12T05:49:50.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.257+0000 7f9453e4a700 1 Processor -- start 2021-11-12T05:49:50.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.257+0000 7f9453e4a700 1 -- start start 2021-11-12T05:49:50.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f9453e4a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f944c0b2e20 0x7f944c0b1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:50.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f9453e4a700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f944c05c490 0x7f944c13ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:50.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f9453e4a700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f944c0ad400 con 0x7f944c05c8d0 2021-11-12T05:49:50.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f9453e4a700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f944c0b3200 con 0x7f944c05c490 2021-11-12T05:49:50.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f9453e4a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f944c0ad660 con 0x7f944c0b2e20 2021-11-12T05:49:50.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f94513e5700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f944c05c490 0x7f944c13ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:50.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f94523e7700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f944c05c8d0 0x7f944c13ef40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34802/0 (socket says 172.21.2.105:34802) 2021-11-12T05:49:50.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f94523e7700 1 -- 172.21.2.105:0/2481747407 learned_addr learned my addr 172.21.2.105:0/2481747407 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:50.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f94513e5700 1 -- 172.21.2.105:0/2481747407 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f944c0b2e20 msgr2=0x7f944c0b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:50.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f94513e5700 1 --2- 172.21.2.105:0/2481747407 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f944c0b2e20 0x7f944c0b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:50.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f94513e5700 1 -- 172.21.2.105:0/2481747407 >> v1:172.21.2.105:6789/0 conn(0x7f944c05c8d0 legacy=0x7f944c13ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:50.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f94513e5700 1 -- 172.21.2.105:0/2481747407 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f944c0ad900 con 0x7f944c05c490 2021-11-12T05:49:50.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f94513e5700 1 --2- 172.21.2.105:0/2481747407 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f944c05c490 0x7f944c13ea50 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 rx=0x7f9440002f70 tx=0x7f9440006df0).ready entity=mon.0 client_cookie=310e31ec71a7297b server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:50.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f9450be4700 1 -- 172.21.2.105:0/2481747407 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f944000d570 con 0x7f944c05c490 2021-11-12T05:49:50.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f9450be4700 1 -- 172.21.2.105:0/2481747407 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9440000e90 con 0x7f944c05c490 2021-11-12T05:49:50.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f9450be4700 1 -- 172.21.2.105:0/2481747407 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f944000d8c0 con 0x7f944c05c490 2021-11-12T05:49:50.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f9453e4a700 1 -- 172.21.2.105:0/2481747407 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f944c05c490 msgr2=0x7f944c13ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:50.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f9453e4a700 1 --2- 172.21.2.105:0/2481747407 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f944c05c490 0x7f944c13ea50 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 rx=0x7f9440002f70 tx=0x7f9440006df0).stop 2021-11-12T05:49:50.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f9453e4a700 1 -- 172.21.2.105:0/2481747407 shutdown_connections 2021-11-12T05:49:50.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f9453e4a700 1 --2- 172.21.2.105:0/2481747407 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f944c05c490 0x7f944c13ea50 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:50.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f9453e4a700 1 --2- 172.21.2.105:0/2481747407 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f944c0b2e20 0x7f944c0b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:50.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f9453e4a700 1 -- 172.21.2.105:0/2481747407 >> 172.21.2.105:0/2481747407 conn(0x7f944c062f60 msgr2=0x7f944c063370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:50.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f9453e4a700 1 -- 172.21.2.105:0/2481747407 shutdown_connections 2021-11-12T05:49:50.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f9453e4a700 1 -- 172.21.2.105:0/2481747407 wait complete. 2021-11-12T05:49:50.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f9453e4a700 1 Processor -- start 2021-11-12T05:49:50.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f9453e4a700 1 -- start start 2021-11-12T05:49:50.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f9453e4a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f944c05c490 0x7f944c1359c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:50.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f9453e4a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f944c05c8d0 0x7f944c0b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:50.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f9453e4a700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f944c0b2e20 0x7f944c150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:50.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f9453e4a700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944c13df40 con 0x7f944c05c490 2021-11-12T05:49:50.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f9453e4a700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944c13e1e0 con 0x7f944c0b2e20 2021-11-12T05:49:50.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f9453e4a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f944c13dc30 con 0x7f944c05c8d0 2021-11-12T05:49:50.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f9451be6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f944c05c490 0x7f944c1359c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:50.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f9451be6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f944c05c490 0x7f944c1359c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52640/0 (socket says 172.21.2.105:52640) 2021-11-12T05:49:50.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f9451be6700 1 -- 172.21.2.105:0/3830436538 learned_addr learned my addr 172.21.2.105:0/3830436538 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:50.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f94513e5700 1 --2- 172.21.2.105:0/3830436538 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f944c05c8d0 0x7f944c0b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:50.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f94523e7700 1 --2- 172.21.2.105:0/3830436538 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f944c0b2e20 0x7f944c150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:50.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f9451be6700 1 -- 172.21.2.105:0/3830436538 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f944c05c8d0 msgr2=0x7f944c0b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:50.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f9451be6700 1 --2- 172.21.2.105:0/3830436538 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f944c05c8d0 0x7f944c0b50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:50.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f9451be6700 1 -- 172.21.2.105:0/3830436538 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f944c0b2e20 msgr2=0x7f944c150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:50.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f9451be6700 1 --2- 172.21.2.105:0/3830436538 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f944c0b2e20 0x7f944c150530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:50.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f9451be6700 1 -- 172.21.2.105:0/3830436538 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f944000b180 con 0x7f944c05c490 2021-11-12T05:49:50.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f94513e5700 1 --2- 172.21.2.105:0/3830436538 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f944c05c8d0 0x7f944c0b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:49:50.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f9451be6700 1 --2- 172.21.2.105:0/3830436538 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f944c05c490 0x7f944c1359c0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 rx=0x7f9448002f70 tx=0x7f9448006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:50.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f943effd700 1 -- 172.21.2.105:0/3830436538 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9448013460 con 0x7f944c05c490 2021-11-12T05:49:50.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f943effd700 1 -- 172.21.2.105:0/3830436538 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94480135c0 con 0x7f944c05c490 2021-11-12T05:49:50.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f9453e4a700 1 -- 172.21.2.105:0/3830436538 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f944c1404f0 con 0x7f944c05c490 2021-11-12T05:49:50.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f943effd700 1 -- 172.21.2.105:0/3830436538 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9448013920 con 0x7f944c05c490 2021-11-12T05:49:50.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.261+0000 7f9453e4a700 1 -- 172.21.2.105:0/3830436538 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f944c13ce20 con 0x7f944c05c490 2021-11-12T05:49:50.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.265+0000 7f9453e4a700 1 -- 172.21.2.105:0/3830436538 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f944c13e3a0 con 0x7f944c05c490 2021-11-12T05:49:50.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.265+0000 7f943effd700 1 -- 172.21.2.105:0/3830436538 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f944801a060 con 0x7f944c05c490 2021-11-12T05:49:50.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.265+0000 7f943effd700 1 --2- 172.21.2.105:0/3830436538 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f942c053580 0x7f942c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:50.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.265+0000 7f943effd700 1 -- 172.21.2.105:0/3830436538 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f944806b1d0 con 0x7f944c05c490 2021-11-12T05:49:50.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.265+0000 7f94513e5700 1 --2- 172.21.2.105:0/3830436538 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f942c053580 0x7f942c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:50.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.265+0000 7f94513e5700 1 --2- 172.21.2.105:0/3830436538 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f942c053580 0x7f942c055a40 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f944001a000 tx=0x7f9440015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:50.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.265+0000 7f943effd700 1 -- 172.21.2.105:0/3830436538 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9448042450 con 0x7f944c05c490 2021-11-12T05:49:50.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.349+0000 7f9453e4a700 1 -- 172.21.2.105:0/3830436538 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f944c0b2060 con 0x7f944c05c490 2021-11-12T05:49:50.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.353+0000 7f943effd700 1 -- 172.21.2.105:0/3830436538 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9448045a70 con 0x7f944c05c490 2021-11-12T05:49:50.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.357+0000 7f9453e4a700 1 -- 172.21.2.105:0/3830436538 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f942c053580 msgr2=0x7f942c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:50.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.357+0000 7f9453e4a700 1 --2- 172.21.2.105:0/3830436538 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f942c053580 0x7f942c055a40 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f944001a000 tx=0x7f9440015000).stop 2021-11-12T05:49:50.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.357+0000 7f9453e4a700 1 -- 172.21.2.105:0/3830436538 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f944c05c490 msgr2=0x7f944c1359c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:50.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.357+0000 7f9453e4a700 1 --2- 172.21.2.105:0/3830436538 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f944c05c490 0x7f944c1359c0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 rx=0x7f9448002f70 tx=0x7f9448006e20).stop 2021-11-12T05:49:50.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.357+0000 7f9453e4a700 1 -- 172.21.2.105:0/3830436538 shutdown_connections 2021-11-12T05:49:50.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.357+0000 7f9453e4a700 1 --2- 172.21.2.105:0/3830436538 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f942c053580 0x7f942c055a40 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:50.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.357+0000 7f9453e4a700 1 --2- 172.21.2.105:0/3830436538 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f944c0b2e20 0x7f944c150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:50.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.357+0000 7f9453e4a700 1 --2- 172.21.2.105:0/3830436538 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f944c05c8d0 0x7f944c0b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:50.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.357+0000 7f9453e4a700 1 --2- 172.21.2.105:0/3830436538 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f944c05c490 0x7f944c1359c0 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:50.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.357+0000 7f9453e4a700 1 -- 172.21.2.105:0/3830436538 >> 172.21.2.105:0/3830436538 conn(0x7f944c062f60 msgr2=0x7f944c05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:50.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.357+0000 7f9453e4a700 1 -- 172.21.2.105:0/3830436538 shutdown_connections 2021-11-12T05:49:50.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.357+0000 7f9453e4a700 1 -- 172.21.2.105:0/3830436538 wait complete. 2021-11-12T05:49:50.366 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_root_rctime' 2021-11-12T05:49:50.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.413+0000 7f510f5af700 1 Processor -- start 2021-11-12T05:49:50.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.413+0000 7f510f5af700 1 -- start start 2021-11-12T05:49:50.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.413+0000 7f510f5af700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f5108141c10 0x7f510814b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:50.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.413+0000 7f510f5af700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51080b26e0 con 0x7f51080b37d0 2021-11-12T05:49:50.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.413+0000 7f510f5af700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51080604e0 con 0x7f5108060100 2021-11-12T05:49:50.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.413+0000 7f510f5af700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5108145160 con 0x7f5108141c10 2021-11-12T05:49:50.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.413+0000 7f510cb4a700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f51080b37d0 0x7f5108141500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34816/0 (socket says 172.21.2.105:34816) 2021-11-12T05:49:50.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.413+0000 7f510cb4a700 1 -- 172.21.2.105:0/1750889437 learned_addr learned my addr 172.21.2.105:0/1750889437 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:50.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f50fbfff700 1 -- 172.21.2.105:0/1750889437 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1003228760 0 0) 0x7f51080b26e0 con 0x7f51080b37d0 2021-11-12T05:49:50.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f50fbfff700 1 -- 172.21.2.105:0/1750889437 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50f0003260 con 0x7f51080b37d0 2021-11-12T05:49:50.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f510db4c700 1 --2- 172.21.2.105:0/1750889437 >> v2:172.21.2.115:3300/0 conn(0x7f5108141c10 0x7f510814b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:50.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f50fbfff700 1 -- 172.21.2.105:0/1750889437 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3005587260 0 0) 0x7f50f0003260 con 0x7f51080b37d0 2021-11-12T05:49:50.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f50fbfff700 1 -- 172.21.2.105:0/1750889437 >> v2:172.21.2.115:3300/0 conn(0x7f5108141c10 msgr2=0x7f510814b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:50.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f50fbfff700 1 --2- 172.21.2.105:0/1750889437 >> v2:172.21.2.115:3300/0 conn(0x7f5108141c10 0x7f510814b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:50.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f50fbfff700 1 -- 172.21.2.105:0/1750889437 >> v1:172.21.2.115:6789/0 conn(0x7f5108060100 legacy=0x7f51080b1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:50.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f50fbfff700 1 -- 172.21.2.105:0/1750889437 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5108141060 con 0x7f51080b37d0 2021-11-12T05:49:50.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f50fbfff700 1 -- 172.21.2.105:0/1750889437 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f5104001660 con 0x7f51080b37d0 2021-11-12T05:49:50.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f50fbfff700 1 -- 172.21.2.105:0/1750889437 >> v1:172.21.2.105:6789/0 conn(0x7f51080b37d0 legacy=0x7f5108141500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:50.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f50fbfff700 1 --2- 172.21.2.105:0/1750889437 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f50f0003750 0x7f50f0003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:50.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f50fbfff700 1 --2- 172.21.2.105:0/1750889437 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f50f0004500 0x7f50f0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:50.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f50fbfff700 1 --2- 172.21.2.105:0/1750889437 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f50f0004e70 0x7f50f000fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:50.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f50fbfff700 1 -- 172.21.2.105:0/1750889437 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5108145160 con 0x7f50f0003750 2021-11-12T05:49:50.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f50fbfff700 1 -- 172.21.2.105:0/1750889437 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f0010130 con 0x7f50f0004e70 2021-11-12T05:49:50.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f50fbfff700 1 -- 172.21.2.105:0/1750889437 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f00102f0 con 0x7f50f0004500 2021-11-12T05:49:50.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f510d34b700 1 --2- 172.21.2.105:0/1750889437 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f50f0003750 0x7f50f0003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:50.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f510cb4a700 1 --2- 172.21.2.105:0/1750889437 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f50f0004500 0x7f50f0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:50.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f510db4c700 1 --2- 172.21.2.105:0/1750889437 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f50f0004e70 0x7f50f000fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:50.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f510d34b700 1 -- 172.21.2.105:0/1750889437 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f50f0004500 msgr2=0x7f50f0004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:50.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f510d34b700 1 --2- 172.21.2.105:0/1750889437 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f50f0004500 0x7f50f0004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:50.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f510d34b700 1 -- 172.21.2.105:0/1750889437 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f50f0004e70 msgr2=0x7f50f000fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:50.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f510d34b700 1 --2- 172.21.2.105:0/1750889437 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f50f0004e70 0x7f50f000fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:50.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f510d34b700 1 -- 172.21.2.105:0/1750889437 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f0003260 con 0x7f50f0003750 2021-11-12T05:49:50.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f510db4c700 1 --2- 172.21.2.105:0/1750889437 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f50f0004e70 0x7f50f000fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:49:50.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f510db4c700 1 -- 172.21.2.105:0/1750889437 reap_dead start 2021-11-12T05:49:50.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f510d34b700 1 --2- 172.21.2.105:0/1750889437 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f50f0003750 0x7f50f0003b70 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 rx=0x7f51080640c0 tx=0x7f50fc007a00).ready entity=mon.0 client_cookie=6c48a354f8956ce3 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:50.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f50fbfff700 1 -- 172.21.2.105:0/1750889437 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50fc007d10 con 0x7f50f0003750 2021-11-12T05:49:50.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f50fbfff700 1 -- 172.21.2.105:0/1750889437 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50fc007030 con 0x7f50f0003750 2021-11-12T05:49:50.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f50fbfff700 1 -- 172.21.2.105:0/1750889437 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50fc007390 con 0x7f50f0003750 2021-11-12T05:49:50.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f510f5af700 1 -- 172.21.2.105:0/1750889437 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f50f0003750 msgr2=0x7f50f0003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:50.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f510f5af700 1 --2- 172.21.2.105:0/1750889437 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f50f0003750 0x7f50f0003b70 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 rx=0x7f51080640c0 tx=0x7f50fc007a00).stop 2021-11-12T05:49:50.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f510f5af700 1 -- 172.21.2.105:0/1750889437 shutdown_connections 2021-11-12T05:49:50.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f510f5af700 1 --2- 172.21.2.105:0/1750889437 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f50f0003750 0x7f50f0003b70 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:50.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f510f5af700 1 -- 172.21.2.105:0/1750889437 >> 172.21.2.105:0/1750889437 conn(0x7f51080608d0 msgr2=0x7f510805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:50.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f510f5af700 1 -- 172.21.2.105:0/1750889437 shutdown_connections 2021-11-12T05:49:50.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f510f5af700 1 -- 172.21.2.105:0/1750889437 wait complete. 2021-11-12T05:49:50.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f510f5af700 1 Processor -- start 2021-11-12T05:49:50.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f510f5af700 1 -- start start 2021-11-12T05:49:50.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f510f5af700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f50f0003750 0x7f51080ae680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:50.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f510f5af700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f510814dea0 0x7f51080b0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:50.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f510f5af700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f51080b0af0 0x7f51080666a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:50.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f510f5af700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510814f110 con 0x7f510814dea0 2021-11-12T05:49:50.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f510f5af700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5108127f50 con 0x7f50f0003750 2021-11-12T05:49:50.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f510f5af700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51080b0160 con 0x7f51080b0af0 2021-11-12T05:49:50.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f510cb4a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f510814dea0 0x7f51080b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:50.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f510cb4a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f510814dea0 0x7f51080b0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52660/0 (socket says 172.21.2.105:52660) 2021-11-12T05:49:50.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f510cb4a700 1 -- 172.21.2.105:0/3995622657 learned_addr learned my addr 172.21.2.105:0/3995622657 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:50.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f510d34b700 1 --2- 172.21.2.105:0/3995622657 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f50f0003750 0x7f51080ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:50.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.417+0000 7f510db4c700 1 --2- 172.21.2.105:0/3995622657 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f51080b0af0 0x7f51080666a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:50.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.421+0000 7f510cb4a700 1 -- 172.21.2.105:0/3995622657 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f51080b0af0 msgr2=0x7f51080666a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:50.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.421+0000 7f510cb4a700 1 --2- 172.21.2.105:0/3995622657 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f51080b0af0 0x7f51080666a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:50.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.421+0000 7f510cb4a700 1 -- 172.21.2.105:0/3995622657 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f50f0003750 msgr2=0x7f51080ae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:50.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.421+0000 7f510cb4a700 1 --2- 172.21.2.105:0/3995622657 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f50f0003750 0x7f51080ae680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:50.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.421+0000 7f510cb4a700 1 -- 172.21.2.105:0/3995622657 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51081277f0 con 0x7f510814dea0 2021-11-12T05:49:50.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.421+0000 7f510cb4a700 1 --2- 172.21.2.105:0/3995622657 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f510814dea0 0x7f51080b0600 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 rx=0x7f510400d000 tx=0x7f51081411f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:50.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.421+0000 7f50fa7fc700 1 -- 172.21.2.105:0/3995622657 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5104011780 con 0x7f510814dea0 2021-11-12T05:49:50.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.421+0000 7f50fa7fc700 1 -- 172.21.2.105:0/3995622657 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51040118e0 con 0x7f510814dea0 2021-11-12T05:49:50.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.421+0000 7f510f5af700 1 -- 172.21.2.105:0/3995622657 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5108128660 con 0x7f510814dea0 2021-11-12T05:49:50.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.421+0000 7f50fa7fc700 1 -- 172.21.2.105:0/3995622657 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5104011c40 con 0x7f510814dea0 2021-11-12T05:49:50.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.421+0000 7f510f5af700 1 -- 172.21.2.105:0/3995622657 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5108129560 con 0x7f510814dea0 2021-11-12T05:49:50.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.421+0000 7f510f5af700 1 -- 172.21.2.105:0/3995622657 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51080b0ed0 con 0x7f510814dea0 2021-11-12T05:49:50.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.421+0000 7f50fa7fc700 1 -- 172.21.2.105:0/3995622657 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f510401b030 con 0x7f510814dea0 2021-11-12T05:49:50.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.421+0000 7f50fa7fc700 1 --2- 172.21.2.105:0/3995622657 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f50e80536a0 0x7f50e8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:50.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.421+0000 7f50fa7fc700 1 -- 172.21.2.105:0/3995622657 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f510406b380 con 0x7f510814dea0 2021-11-12T05:49:50.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.421+0000 7f510d34b700 1 --2- 172.21.2.105:0/3995622657 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f50e80536a0 0x7f50e8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:50.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.421+0000 7f510d34b700 1 --2- 172.21.2.105:0/3995622657 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f50e80536a0 0x7f50e8055b60 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f50fc019000 tx=0x7f50fc015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:50.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.421+0000 7f50fa7fc700 1 -- 172.21.2.105:0/3995622657 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5104042660 con 0x7f510814dea0 2021-11-12T05:49:50.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:50.537+0000 7f510f5af700 1 -- 172.21.2.105:0/3995622657 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]} v 0) v1 -- 0x7f5108140d50 con 0x7f510814dea0 2021-11-12T05:49:51.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.197+0000 7f50fa7fc700 1 -- 172.21.2.105:0/3995622657 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]}]=0 v403) v1 ==== 127+0+0 (secure 0 0 0) 0x7f5104019030 con 0x7f510814dea0 2021-11-12T05:49:51.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.201+0000 7f510f5af700 1 -- 172.21.2.105:0/3995622657 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f50e80536a0 msgr2=0x7f50e8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:51.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.201+0000 7f510f5af700 1 --2- 172.21.2.105:0/3995622657 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f50e80536a0 0x7f50e8055b60 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f50fc019000 tx=0x7f50fc015000).stop 2021-11-12T05:49:51.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.201+0000 7f510f5af700 1 -- 172.21.2.105:0/3995622657 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f510814dea0 msgr2=0x7f51080b0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:51.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.201+0000 7f510f5af700 1 --2- 172.21.2.105:0/3995622657 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f510814dea0 0x7f51080b0600 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 rx=0x7f510400d000 tx=0x7f51081411f0).stop 2021-11-12T05:49:51.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.201+0000 7f510f5af700 1 -- 172.21.2.105:0/3995622657 shutdown_connections 2021-11-12T05:49:51.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.201+0000 7f510f5af700 1 --2- 172.21.2.105:0/3995622657 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f50e80536a0 0x7f50e8055b60 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:51.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.201+0000 7f510f5af700 1 --2- 172.21.2.105:0/3995622657 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f51080b0af0 0x7f51080666a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:51.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.201+0000 7f510f5af700 1 --2- 172.21.2.105:0/3995622657 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f510814dea0 0x7f51080b0600 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:51.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.201+0000 7f510f5af700 1 --2- 172.21.2.105:0/3995622657 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f50f0003750 0x7f51080ae680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:51.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.201+0000 7f510f5af700 1 -- 172.21.2.105:0/3995622657 >> 172.21.2.105:0/3995622657 conn(0x7f51080608d0 msgr2=0x7f5108144450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:51.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.201+0000 7f510f5af700 1 -- 172.21.2.105:0/3995622657 shutdown_connections 2021-11-12T05:49:51.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.201+0000 7f510f5af700 1 -- 172.21.2.105:0/3995622657 wait complete. 2021-11-12T05:49:51.210 INFO:tasks.cephfs_test_runner:test_root_rctime (tasks.cephfs.test_misc.TestMisc) ... ok 2021-11-12T05:49:51.211 INFO:tasks.cephfs_test_runner:Starting test: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-11-12T05:49:51.211 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_statfs_on_deleted_fs' 2021-11-12T05:49:51.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.273+0000 7f261d7aa700 1 Processor -- start 2021-11-12T05:49:51.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.273+0000 7f261d7aa700 1 -- start start 2021-11-12T05:49:51.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.273+0000 7f261d7aa700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f26180ad080 0x7f26180af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:51.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.273+0000 7f261d7aa700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f26180ac280 0x7f26180ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:51.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.273+0000 7f261d7aa700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26180ac7b0 con 0x7f261814abe0 2021-11-12T05:49:51.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.273+0000 7f261d7aa700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26181488a0 con 0x7f26180ac280 2021-11-12T05:49:51.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.273+0000 7f261d7aa700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26180ac9e0 con 0x7f26180ad080 2021-11-12T05:49:51.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.273+0000 7f26167fc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f26180ac280 0x7f26180ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:51.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.273+0000 7f26167fc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f26180ac280 0x7f26180ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52672/0 (socket says 172.21.2.105:52672) 2021-11-12T05:49:51.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.273+0000 7f26167fc700 1 -- 172.21.2.105:0/2136418630 learned_addr learned my addr 172.21.2.105:0/2136418630 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:51.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.273+0000 7f26167fc700 1 -- 172.21.2.105:0/2136418630 >> v2:172.21.2.115:3300/0 conn(0x7f26180ad080 msgr2=0x7f26180af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:51.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.273+0000 7f26167fc700 1 --2- 172.21.2.105:0/2136418630 >> v2:172.21.2.115:3300/0 conn(0x7f26180ad080 0x7f26180af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:51.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.273+0000 7f26167fc700 1 -- 172.21.2.105:0/2136418630 >> v1:172.21.2.115:6789/0 conn(0x7f261814abe0 legacy=0x7f261814b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:51.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.273+0000 7f26167fc700 1 -- 172.21.2.105:0/2136418630 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26180b0b30 con 0x7f26180ac280 2021-11-12T05:49:51.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.273+0000 7f26167fc700 1 --2- 172.21.2.105:0/2136418630 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f26180ac280 0x7f26180ad460 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 rx=0x7f261814bc40 tx=0x7f2608006eb0).ready entity=mon.0 client_cookie=7f16db5eeeded111 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:51.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.273+0000 7f2615ffb700 1 -- 172.21.2.105:0/2136418630 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f260800d5c0 con 0x7f26180ac280 2021-11-12T05:49:51.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.273+0000 7f2615ffb700 1 -- 172.21.2.105:0/2136418630 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2608000e90 con 0x7f26180ac280 2021-11-12T05:49:51.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.273+0000 7f2615ffb700 1 -- 172.21.2.105:0/2136418630 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f260800d910 con 0x7f26180ac280 2021-11-12T05:49:51.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.273+0000 7f261d7aa700 1 -- 172.21.2.105:0/2136418630 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f26180ac280 msgr2=0x7f26180ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:51.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.273+0000 7f261d7aa700 1 --2- 172.21.2.105:0/2136418630 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f26180ac280 0x7f26180ad460 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 rx=0x7f261814bc40 tx=0x7f2608006eb0).stop 2021-11-12T05:49:51.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.273+0000 7f261d7aa700 1 -- 172.21.2.105:0/2136418630 shutdown_connections 2021-11-12T05:49:51.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.273+0000 7f261d7aa700 1 --2- 172.21.2.105:0/2136418630 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f26180ac280 0x7f26180ad460 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:51.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.273+0000 7f261d7aa700 1 --2- 172.21.2.105:0/2136418630 >> v2:172.21.2.115:3300/0 conn(0x7f26180ad080 0x7f26180af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:51.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.273+0000 7f261d7aa700 1 -- 172.21.2.105:0/2136418630 >> 172.21.2.105:0/2136418630 conn(0x7f26180b5370 msgr2=0x7f26180b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:51.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.273+0000 7f261d7aa700 1 -- 172.21.2.105:0/2136418630 shutdown_connections 2021-11-12T05:49:51.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.273+0000 7f261d7aa700 1 -- 172.21.2.105:0/2136418630 wait complete. 2021-11-12T05:49:51.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.273+0000 7f261d7aa700 1 Processor -- start 2021-11-12T05:49:51.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.273+0000 7f261d7aa700 1 -- start start 2021-11-12T05:49:51.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.277+0000 7f261d7aa700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f26180ac280 0x7f2618063560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:51.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.277+0000 7f261d7aa700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f26180ad080 0x7f2618063a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:51.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.277+0000 7f261d7aa700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f261814abe0 0x7f26180a8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:51.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.277+0000 7f261d7aa700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2618064030 con 0x7f26180ac280 2021-11-12T05:49:51.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.277+0000 7f261d7aa700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26181576d0 con 0x7f261814abe0 2021-11-12T05:49:51.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.277+0000 7f261d7aa700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2618157970 con 0x7f26180ad080 2021-11-12T05:49:51.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.277+0000 7f2616ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f26180ac280 0x7f2618063560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:51.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.277+0000 7f2616ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f26180ac280 0x7f2618063560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52674/0 (socket says 172.21.2.105:52674) 2021-11-12T05:49:51.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.277+0000 7f2616ffd700 1 -- 172.21.2.105:0/1571143388 learned_addr learned my addr 172.21.2.105:0/1571143388 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:51.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.277+0000 7f2616ffd700 1 -- 172.21.2.105:0/1571143388 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f26180ad080 msgr2=0x7f2618063a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:51.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.277+0000 7f2616ffd700 1 --2- 172.21.2.105:0/1571143388 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f26180ad080 0x7f2618063a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:51.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.277+0000 7f2616ffd700 1 -- 172.21.2.105:0/1571143388 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f261814abe0 msgr2=0x7f26180a8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:51.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.277+0000 7f2616ffd700 1 --2- 172.21.2.105:0/1571143388 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f261814abe0 0x7f26180a8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:51.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.277+0000 7f2616ffd700 1 -- 172.21.2.105:0/1571143388 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260800b1e0 con 0x7f26180ac280 2021-11-12T05:49:51.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.277+0000 7f2616ffd700 1 --2- 172.21.2.105:0/1571143388 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f26180ac280 0x7f2618063560 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 rx=0x7f2600002f70 tx=0x7f2600006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:51.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.277+0000 7f260ffff700 1 -- 172.21.2.105:0/1571143388 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2600013460 con 0x7f26180ac280 2021-11-12T05:49:51.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.277+0000 7f260ffff700 1 -- 172.21.2.105:0/1571143388 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26000135c0 con 0x7f26180ac280 2021-11-12T05:49:51.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.277+0000 7f261d7aa700 1 -- 172.21.2.105:0/1571143388 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26180a9400 con 0x7f26180ac280 2021-11-12T05:49:51.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.277+0000 7f261d7aa700 1 -- 172.21.2.105:0/1571143388 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26180a9a20 con 0x7f26180ac280 2021-11-12T05:49:51.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.277+0000 7f260ffff700 1 -- 172.21.2.105:0/1571143388 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2600013920 con 0x7f26180ac280 2021-11-12T05:49:51.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.277+0000 7f261d7aa700 1 -- 172.21.2.105:0/1571143388 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2618157b30 con 0x7f26180ac280 2021-11-12T05:49:51.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.277+0000 7f260ffff700 1 -- 172.21.2.105:0/1571143388 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f260001a060 con 0x7f26180ac280 2021-11-12T05:49:51.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.277+0000 7f260ffff700 1 --2- 172.21.2.105:0/1571143388 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f25fc053690 0x7f25fc055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:51.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.277+0000 7f260ffff700 1 -- 172.21.2.105:0/1571143388 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f260006b2a0 con 0x7f26180ac280 2021-11-12T05:49:51.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.277+0000 7f26167fc700 1 --2- 172.21.2.105:0/1571143388 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f25fc053690 0x7f25fc055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:51.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.277+0000 7f26167fc700 1 --2- 172.21.2.105:0/1571143388 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f25fc053690 0x7f25fc055b50 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f261814bc40 tx=0x7f2608015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:51.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.281+0000 7f260ffff700 1 -- 172.21.2.105:0/1571143388 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2600042500 con 0x7f26180ac280 2021-11-12T05:49:51.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:51.393+0000 7f261d7aa700 1 -- 172.21.2.105:0/1571143388 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_statfs_on_deleted_fs"]} v 0) v1 -- 0x7f26180b1440 con 0x7f26180ac280 2021-11-12T05:49:52.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.209+0000 7f260ffff700 1 -- 172.21.2.105:0/1571143388 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_statfs_on_deleted_fs"]}]=0 v404) v1 ==== 139+0+0 (secure 0 0 0) 0x7f2600018030 con 0x7f26180ac280 2021-11-12T05:49:52.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.209+0000 7f261d7aa700 1 -- 172.21.2.105:0/1571143388 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f25fc053690 msgr2=0x7f25fc055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:52.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.209+0000 7f261d7aa700 1 --2- 172.21.2.105:0/1571143388 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f25fc053690 0x7f25fc055b50 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f261814bc40 tx=0x7f2608015000).stop 2021-11-12T05:49:52.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.209+0000 7f261d7aa700 1 -- 172.21.2.105:0/1571143388 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f26180ac280 msgr2=0x7f2618063560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:52.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.209+0000 7f261d7aa700 1 --2- 172.21.2.105:0/1571143388 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f26180ac280 0x7f2618063560 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 rx=0x7f2600002f70 tx=0x7f2600006ec0).stop 2021-11-12T05:49:52.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.209+0000 7f261d7aa700 1 -- 172.21.2.105:0/1571143388 shutdown_connections 2021-11-12T05:49:52.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.209+0000 7f261d7aa700 1 --2- 172.21.2.105:0/1571143388 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f25fc053690 0x7f25fc055b50 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:52.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.209+0000 7f261d7aa700 1 --2- 172.21.2.105:0/1571143388 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f261814abe0 0x7f26180a8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:52.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.209+0000 7f261d7aa700 1 --2- 172.21.2.105:0/1571143388 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f26180ad080 0x7f2618063a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:52.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.209+0000 7f261d7aa700 1 --2- 172.21.2.105:0/1571143388 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f26180ac280 0x7f2618063560 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:52.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.209+0000 7f261d7aa700 1 -- 172.21.2.105:0/1571143388 >> 172.21.2.105:0/1571143388 conn(0x7f26180b5370 msgr2=0x7f261814b070 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:52.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.209+0000 7f261d7aa700 1 -- 172.21.2.105:0/1571143388 shutdown_connections 2021-11-12T05:49:52.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.209+0000 7f261d7aa700 1 -- 172.21.2.105:0/1571143388 wait complete. 2021-11-12T05:49:52.221 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2021-11-12T05:49:52.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.273+0000 7f248ccd2700 1 Processor -- start 2021-11-12T05:49:52.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.273+0000 7f248ccd2700 1 -- start start 2021-11-12T05:49:52.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.273+0000 7f248ccd2700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f248805fdc0 0x7f24880b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:52.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.273+0000 7f248ccd2700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24880ae9e0 con 0x7f24880601a0 2021-11-12T05:49:52.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.273+0000 7f248ccd2700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24880af7c0 con 0x7f24880b06e0 2021-11-12T05:49:52.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.273+0000 7f248ccd2700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24880b31f0 con 0x7f248805fdc0 2021-11-12T05:49:52.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.273+0000 7f2486d9d700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f24880601a0 0x7f248813e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34850/0 (socket says 172.21.2.105:34850) 2021-11-12T05:49:52.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.273+0000 7f2486d9d700 1 -- 172.21.2.105:0/1680340909 learned_addr learned my addr 172.21.2.105:0/1680340909 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:52.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.273+0000 7f248659c700 1 --2- 172.21.2.105:0/1680340909 >> v2:172.21.2.115:3300/0 conn(0x7f248805fdc0 0x7f24880b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:52.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.273+0000 7f248559a700 1 -- 172.21.2.105:0/1680340909 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 989839958 0 0) 0x7f24880ae9e0 con 0x7f24880601a0 2021-11-12T05:49:52.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.273+0000 7f248559a700 1 -- 172.21.2.105:0/1680340909 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2468003260 con 0x7f24880601a0 2021-11-12T05:49:52.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.273+0000 7f248559a700 1 -- 172.21.2.105:0/1680340909 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2243867614 0 0) 0x7f2468003260 con 0x7f24880601a0 2021-11-12T05:49:52.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.273+0000 7f248559a700 1 -- 172.21.2.105:0/1680340909 >> v2:172.21.2.115:3300/0 conn(0x7f248805fdc0 msgr2=0x7f24880b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:52.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.273+0000 7f248559a700 1 --2- 172.21.2.105:0/1680340909 >> v2:172.21.2.115:3300/0 conn(0x7f248805fdc0 0x7f24880b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:52.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.273+0000 7f248559a700 1 -- 172.21.2.105:0/1680340909 >> v1:172.21.2.115:6789/0 conn(0x7f24880b06e0 legacy=0x7f24880af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:52.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.273+0000 7f248559a700 1 -- 172.21.2.105:0/1680340909 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2488067cb0 con 0x7f24880601a0 2021-11-12T05:49:52.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.273+0000 7f248559a700 1 -- 172.21.2.105:0/1680340909 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f24800019e0 con 0x7f24880601a0 2021-11-12T05:49:52.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f248559a700 1 -- 172.21.2.105:0/1680340909 >> v1:172.21.2.105:6789/0 conn(0x7f24880601a0 legacy=0x7f248813e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:52.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f248559a700 1 --2- 172.21.2.105:0/1680340909 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2468003750 0x7f2468003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:52.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f248559a700 1 --2- 172.21.2.105:0/1680340909 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2468004500 0x7f2468004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:52.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f248559a700 1 --2- 172.21.2.105:0/1680340909 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2468004e70 0x7f246800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:52.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f248559a700 1 -- 172.21.2.105:0/1680340909 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24880b31f0 con 0x7f2468004e70 2021-11-12T05:49:52.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f248559a700 1 -- 172.21.2.105:0/1680340909 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246800bd20 con 0x7f2468003750 2021-11-12T05:49:52.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f248559a700 1 -- 172.21.2.105:0/1680340909 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f246800bee0 con 0x7f2468004500 2021-11-12T05:49:52.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f2486d9d700 1 --2- 172.21.2.105:0/1680340909 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2468004e70 0x7f246800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:52.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f248659c700 1 --2- 172.21.2.105:0/1680340909 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2468003750 0x7f2468003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:52.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f2486d9d700 1 -- 172.21.2.105:0/1680340909 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2468004500 msgr2=0x7f2468004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:52.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f2485d9b700 1 --2- 172.21.2.105:0/1680340909 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2468004500 0x7f2468004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:52.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f2486d9d700 1 --2- 172.21.2.105:0/1680340909 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2468004500 0x7f2468004980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:52.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f2486d9d700 1 -- 172.21.2.105:0/1680340909 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2468003750 msgr2=0x7f2468003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:52.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f2486d9d700 1 --2- 172.21.2.105:0/1680340909 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2468003750 0x7f2468003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:52.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f2486d9d700 1 -- 172.21.2.105:0/1680340909 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2468003260 con 0x7f2468004e70 2021-11-12T05:49:52.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f248659c700 1 --2- 172.21.2.105:0/1680340909 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2468003750 0x7f2468003b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:49:52.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f2486d9d700 1 -- 172.21.2.105:0/1680340909 reap_dead start 2021-11-12T05:49:52.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f2486d9d700 1 --2- 172.21.2.105:0/1680340909 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2468004e70 0x7f246800b750 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 rx=0x7f24800016f0 tx=0x7f2480002190).ready entity=mon.0 client_cookie=86e4a3d7fdf13a59 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:52.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f248559a700 1 -- 172.21.2.105:0/1680340909 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f248000cd10 con 0x7f2468004e70 2021-11-12T05:49:52.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f248559a700 1 -- 172.21.2.105:0/1680340909 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f248000ce70 con 0x7f2468004e70 2021-11-12T05:49:52.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f248559a700 1 -- 172.21.2.105:0/1680340909 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2480005b80 con 0x7f2468004e70 2021-11-12T05:49:52.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f248ccd2700 1 -- 172.21.2.105:0/1680340909 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2468004e70 msgr2=0x7f246800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:52.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f248ccd2700 1 --2- 172.21.2.105:0/1680340909 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2468004e70 0x7f246800b750 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 rx=0x7f24800016f0 tx=0x7f2480002190).stop 2021-11-12T05:49:52.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f248ccd2700 1 -- 172.21.2.105:0/1680340909 shutdown_connections 2021-11-12T05:49:52.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f248ccd2700 1 --2- 172.21.2.105:0/1680340909 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2468004e70 0x7f246800b750 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:52.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f248ccd2700 1 -- 172.21.2.105:0/1680340909 >> 172.21.2.105:0/1680340909 conn(0x7f24880632b0 msgr2=0x7f248805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:52.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f248ccd2700 1 -- 172.21.2.105:0/1680340909 shutdown_connections 2021-11-12T05:49:52.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f248ccd2700 1 -- 172.21.2.105:0/1680340909 wait complete. 2021-11-12T05:49:52.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f248ccd2700 1 Processor -- start 2021-11-12T05:49:52.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f248ccd2700 1 -- start start 2021-11-12T05:49:52.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f248ccd2700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2468004e70 0x7f2488131570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:52.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f248ccd2700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2488066750 0x7f2488131b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:52.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f248ccd2700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2488131ff0 0x7f2488153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:52.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f248ccd2700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248812f840 con 0x7f2488131ff0 2021-11-12T05:49:52.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f248ccd2700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248812c630 con 0x7f2488066750 2021-11-12T05:49:52.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f248ccd2700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f248812c9b0 con 0x7f2468004e70 2021-11-12T05:49:52.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f2486d9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2488131ff0 0x7f2488153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:52.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f2486d9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2488131ff0 0x7f2488153bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52696/0 (socket says 172.21.2.105:52696) 2021-11-12T05:49:52.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f2486d9d700 1 -- 172.21.2.105:0/3025392317 learned_addr learned my addr 172.21.2.105:0/3025392317 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:52.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f248659c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2468004e70 0x7f2488131570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:52.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f2485d9b700 1 --2- 172.21.2.105:0/3025392317 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2488066750 0x7f2488131b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:52.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f2486d9d700 1 -- 172.21.2.105:0/3025392317 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2468004e70 msgr2=0x7f2488131570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:52.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f2486d9d700 1 --2- 172.21.2.105:0/3025392317 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2468004e70 0x7f2488131570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:52.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f2486d9d700 1 -- 172.21.2.105:0/3025392317 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2488066750 msgr2=0x7f2488131b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:52.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f2486d9d700 1 --2- 172.21.2.105:0/3025392317 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2488066750 0x7f2488131b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:52.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f2486d9d700 1 -- 172.21.2.105:0/3025392317 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2488132470 con 0x7f2488131ff0 2021-11-12T05:49:52.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f2486d9d700 1 --2- 172.21.2.105:0/3025392317 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2488131ff0 0x7f2488153bc0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 rx=0x7f24800016f0 tx=0x7f2480015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:52.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f247f7fe700 1 -- 172.21.2.105:0/3025392317 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24800070d0 con 0x7f2488131ff0 2021-11-12T05:49:52.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f247f7fe700 1 -- 172.21.2.105:0/3025392317 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2480023070 con 0x7f2488131ff0 2021-11-12T05:49:52.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f248ccd2700 1 -- 172.21.2.105:0/3025392317 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24880b10c0 con 0x7f2488131ff0 2021-11-12T05:49:52.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f247f7fe700 1 -- 172.21.2.105:0/3025392317 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2480007420 con 0x7f2488131ff0 2021-11-12T05:49:52.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f248ccd2700 1 -- 172.21.2.105:0/3025392317 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f248812d0f0 con 0x7f2488131ff0 2021-11-12T05:49:52.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.277+0000 7f248ccd2700 1 -- 172.21.2.105:0/3025392317 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f248812cb70 con 0x7f2488131ff0 2021-11-12T05:49:52.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.281+0000 7f247f7fe700 1 -- 172.21.2.105:0/3025392317 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2480010070 con 0x7f2488131ff0 2021-11-12T05:49:52.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.281+0000 7f247f7fe700 1 --2- 172.21.2.105:0/3025392317 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f246c053580 0x7f246c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:52.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.281+0000 7f247f7fe700 1 -- 172.21.2.105:0/3025392317 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f2480019030 con 0x7f2488131ff0 2021-11-12T05:49:52.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.281+0000 7f248659c700 1 --2- 172.21.2.105:0/3025392317 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f246c053580 0x7f246c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:52.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.281+0000 7f248659c700 1 --2- 172.21.2.105:0/3025392317 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f246c053580 0x7f246c055a40 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f247000b000 tx=0x7f2470008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:52.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.281+0000 7f247f7fe700 1 -- 172.21.2.105:0/3025392317 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2480046fa0 con 0x7f2488131ff0 2021-11-12T05:49:52.370 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.365+0000 7f248ccd2700 1 -- 172.21.2.105:0/3025392317 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f2488066b30 con 0x7f2488131ff0 2021-11-12T05:49:52.375 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.373+0000 7f247f7fe700 1 -- 172.21.2.105:0/3025392317 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f248004a5c0 con 0x7f2488131ff0 2021-11-12T05:49:52.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.373+0000 7f248ccd2700 1 -- 172.21.2.105:0/3025392317 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f246c053580 msgr2=0x7f246c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:52.377 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.373+0000 7f248ccd2700 1 --2- 172.21.2.105:0/3025392317 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f246c053580 0x7f246c055a40 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f247000b000 tx=0x7f2470008040).stop 2021-11-12T05:49:52.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.373+0000 7f248ccd2700 1 -- 172.21.2.105:0/3025392317 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2488131ff0 msgr2=0x7f2488153bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:52.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.373+0000 7f248ccd2700 1 --2- 172.21.2.105:0/3025392317 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2488131ff0 0x7f2488153bc0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 rx=0x7f24800016f0 tx=0x7f2480015000).stop 2021-11-12T05:49:52.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.373+0000 7f248ccd2700 1 -- 172.21.2.105:0/3025392317 shutdown_connections 2021-11-12T05:49:52.378 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.373+0000 7f248ccd2700 1 --2- 172.21.2.105:0/3025392317 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f246c053580 0x7f246c055a40 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:52.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.373+0000 7f248ccd2700 1 --2- 172.21.2.105:0/3025392317 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2488131ff0 0x7f2488153bc0 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:52.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.373+0000 7f248ccd2700 1 --2- 172.21.2.105:0/3025392317 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2488066750 0x7f2488131b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:52.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.373+0000 7f248ccd2700 1 --2- 172.21.2.105:0/3025392317 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2468004e70 0x7f2488131570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:52.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.373+0000 7f248ccd2700 1 -- 172.21.2.105:0/3025392317 >> 172.21.2.105:0/3025392317 conn(0x7f24880632b0 msgr2=0x7f2488137de0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:52.379 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.373+0000 7f248ccd2700 1 -- 172.21.2.105:0/3025392317 shutdown_connections 2021-11-12T05:49:52.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.373+0000 7f248ccd2700 1 -- 172.21.2.105:0/3025392317 wait complete. 2021-11-12T05:49:52.383 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-12T05:49:52.384 DEBUG:teuthology.orchestra.run.gibba005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:49:52.391 DEBUG:teuthology.orchestra.run.gibba015:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:49:52.399 DEBUG:teuthology.orchestra.run.gibba016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:49:52.413 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:49:52.426 DEBUG:teuthology.orchestra.run.gibba044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T05:49:52.440 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-12T05:49:52.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:52.440 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:49:52.441 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:49:52.460 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:49:52.461 INFO:teuthology.orchestra.run.gibba016.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-11-12T05:49:52.462 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-11-12T05:49:52.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:52.462 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:49:52.463 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:49:52.467 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:49:52.468 INFO:teuthology.orchestra.run.gibba038.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-11-12T05:49:52.468 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-11-12T05:49:52.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:49:52.469 DEBUG:teuthology.orchestra.run.gibba044:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:49:52.470 DEBUG:teuthology.orchestra.run.gibba044:> ' -- /home/ubuntu/cephtest/mnt.2) 2021-11-12T05:49:52.479 INFO:teuthology.orchestra.run.gibba044.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.2': No such file or directory 2021-11-12T05:49:52.480 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T05:49:52.480 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.2 2021-11-12T05:49:52.481 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-12T05:49:52.552 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.549+0000 7f7e62173700 1 Processor -- start 2021-11-12T05:49:52.552 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.549+0000 7f7e62173700 1 -- start start 2021-11-12T05:49:52.554 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.549+0000 7f7e62173700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7e5c060100 0x7f7e5c0b1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:52.555 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.549+0000 7f7e62173700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f7e5c0b37d0 0x7f7e5c141500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:52.555 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.549+0000 7f7e62173700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e5c0604e0 con 0x7f7e5c1419f0 2021-11-12T05:49:52.555 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.549+0000 7f7e62173700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e5c145160 con 0x7f7e5c0b37d0 2021-11-12T05:49:52.555 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.549+0000 7f7e62173700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5c141060 con 0x7f7e5c060100 2021-11-12T05:49:52.556 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.549+0000 7f7e5bfff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f7e5c1419f0 0x7f7e5c1298d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34866/0 (socket says 172.21.2.105:34866) 2021-11-12T05:49:52.556 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.549+0000 7f7e5bfff700 1 -- 172.21.2.105:0/201446472 learned_addr learned my addr 172.21.2.105:0/201446472 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:52.556 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.549+0000 7f7e5affd700 1 --2- 172.21.2.105:0/201446472 >> v2:172.21.2.105:3300/0 conn(0x7f7e5c0b37d0 0x7f7e5c141500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:52.556 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.549+0000 7f7e5a7fc700 1 -- 172.21.2.105:0/201446472 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3848275738 0 0) 0x7f7e5c0604e0 con 0x7f7e5c1419f0 2021-11-12T05:49:52.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.549+0000 7f7e5a7fc700 1 -- 172.21.2.105:0/201446472 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e48003260 con 0x7f7e5c1419f0 2021-11-12T05:49:52.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.549+0000 7f7e5affd700 1 -- 172.21.2.105:0/201446472 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7e5c060100 msgr2=0x7f7e5c0b1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:52.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.549+0000 7f7e5affd700 1 --2- 172.21.2.105:0/201446472 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7e5c060100 0x7f7e5c0b1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:52.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.549+0000 7f7e5affd700 1 -- 172.21.2.105:0/201446472 >> v1:172.21.2.105:6789/0 conn(0x7f7e5c1419f0 legacy=0x7f7e5c1298d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:52.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.549+0000 7f7e5affd700 1 -- 172.21.2.105:0/201446472 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5c141e80 con 0x7f7e5c0b37d0 2021-11-12T05:49:52.558 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.549+0000 7f7e5affd700 1 --2- 172.21.2.105:0/201446472 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7e5c0b37d0 0x7f7e5c141500 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 rx=0x7f7e50002f70 tx=0x7f7e50006df0).ready entity=mon.0 client_cookie=ea82691a057e7233 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:52.558 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.549+0000 7f7e5a7fc700 1 -- 172.21.2.105:0/201446472 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e5000d570 con 0x7f7e5c0b37d0 2021-11-12T05:49:52.558 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.549+0000 7f7e5a7fc700 1 -- 172.21.2.105:0/201446472 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e50000e90 con 0x7f7e5c0b37d0 2021-11-12T05:49:52.558 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.549+0000 7f7e5a7fc700 1 -- 172.21.2.105:0/201446472 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e5000d8c0 con 0x7f7e5c0b37d0 2021-11-12T05:49:52.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.549+0000 7f7e62173700 1 -- 172.21.2.105:0/201446472 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7e5c0b37d0 msgr2=0x7f7e5c141500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:52.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.549+0000 7f7e62173700 1 --2- 172.21.2.105:0/201446472 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7e5c0b37d0 0x7f7e5c141500 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 rx=0x7f7e50002f70 tx=0x7f7e50006df0).stop 2021-11-12T05:49:52.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.549+0000 7f7e62173700 1 -- 172.21.2.105:0/201446472 shutdown_connections 2021-11-12T05:49:52.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.549+0000 7f7e62173700 1 --2- 172.21.2.105:0/201446472 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7e5c0b37d0 0x7f7e5c141500 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:52.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.549+0000 7f7e62173700 1 --2- 172.21.2.105:0/201446472 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7e5c060100 0x7f7e5c0b1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:52.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.549+0000 7f7e62173700 1 -- 172.21.2.105:0/201446472 >> 172.21.2.105:0/201446472 conn(0x7f7e5c0608d0 msgr2=0x7f7e5c05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:52.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.549+0000 7f7e62173700 1 -- 172.21.2.105:0/201446472 shutdown_connections 2021-11-12T05:49:52.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.549+0000 7f7e62173700 1 -- 172.21.2.105:0/201446472 wait complete. 2021-11-12T05:49:52.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.549+0000 7f7e62173700 1 Processor -- start 2021-11-12T05:49:52.560 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.553+0000 7f7e62173700 1 -- start start 2021-11-12T05:49:52.562 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.553+0000 7f7e62173700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7e5c060100 0x7f7e5c1434f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:52.563 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.553+0000 7f7e62173700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7e5c0b37d0 0x7f7e5c130c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:52.563 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.553+0000 7f7e62173700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7e5c1419f0 0x7f7e5c131140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:52.563 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.553+0000 7f7e62173700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5c12f820 con 0x7f7e5c0b37d0 2021-11-12T05:49:52.563 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.553+0000 7f7e62173700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5c067160 con 0x7f7e5c060100 2021-11-12T05:49:52.563 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.553+0000 7f7e62173700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5c0b05c0 con 0x7f7e5c1419f0 2021-11-12T05:49:52.564 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.553+0000 7f7e5affd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7e5c0b37d0 0x7f7e5c130c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:52.564 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.553+0000 7f7e5affd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7e5c0b37d0 0x7f7e5c130c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52712/0 (socket says 172.21.2.105:52712) 2021-11-12T05:49:52.564 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.553+0000 7f7e5affd700 1 -- 172.21.2.105:0/1770728086 learned_addr learned my addr 172.21.2.105:0/1770728086 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:52.564 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.553+0000 7f7e5affd700 1 -- 172.21.2.105:0/1770728086 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7e5c1419f0 msgr2=0x7f7e5c131140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:52.565 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.553+0000 7f7e5affd700 1 --2- 172.21.2.105:0/1770728086 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7e5c1419f0 0x7f7e5c131140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:52.565 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.553+0000 7f7e5affd700 1 -- 172.21.2.105:0/1770728086 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7e5c060100 msgr2=0x7f7e5c1434f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:52.565 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.553+0000 7f7e5affd700 1 --2- 172.21.2.105:0/1770728086 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7e5c060100 0x7f7e5c1434f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:52.565 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.553+0000 7f7e5affd700 1 -- 172.21.2.105:0/1770728086 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5000b180 con 0x7f7e5c0b37d0 2021-11-12T05:49:52.565 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.553+0000 7f7e5affd700 1 --2- 172.21.2.105:0/1770728086 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7e5c0b37d0 0x7f7e5c130c50 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 rx=0x7f7e50002f70 tx=0x7f7e50014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:52.566 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.553+0000 7f7e58ff9700 1 -- 172.21.2.105:0/1770728086 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e50016070 con 0x7f7e5c0b37d0 2021-11-12T05:49:52.566 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.553+0000 7f7e58ff9700 1 -- 172.21.2.105:0/1770728086 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5000de00 con 0x7f7e5c0b37d0 2021-11-12T05:49:52.566 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.553+0000 7f7e62173700 1 -- 172.21.2.105:0/1770728086 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e5c0b0860 con 0x7f7e5c0b37d0 2021-11-12T05:49:52.566 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.553+0000 7f7e62173700 1 -- 172.21.2.105:0/1770728086 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e5c0b0c30 con 0x7f7e5c0b37d0 2021-11-12T05:49:52.567 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.553+0000 7f7e58ff9700 1 -- 172.21.2.105:0/1770728086 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e50006b20 con 0x7f7e5c0b37d0 2021-11-12T05:49:52.567 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.553+0000 7f7e62173700 1 -- 172.21.2.105:0/1770728086 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e5c0b09f0 con 0x7f7e5c0b37d0 2021-11-12T05:49:52.567 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.553+0000 7f7e58ff9700 1 -- 172.21.2.105:0/1770728086 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7e50025030 con 0x7f7e5c0b37d0 2021-11-12T05:49:52.567 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.553+0000 7f7e58ff9700 1 --2- 172.21.2.105:0/1770728086 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7e3c053540 0x7f7e3c055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:52.567 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.553+0000 7f7e58ff9700 1 -- 172.21.2.105:0/1770728086 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f7e5006c950 con 0x7f7e5c0b37d0 2021-11-12T05:49:52.568 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.553+0000 7f7e5b7fe700 1 --2- 172.21.2.105:0/1770728086 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7e3c053540 0x7f7e3c055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:52.568 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.553+0000 7f7e5b7fe700 1 --2- 172.21.2.105:0/1770728086 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7e3c053540 0x7f7e3c055a00 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f7e4c002f70 tx=0x7f7e4c006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:52.568 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.557+0000 7f7e58ff9700 1 -- 172.21.2.105:0/1770728086 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7e50043b20 con 0x7f7e5c0b37d0 2021-11-12T05:49:52.643 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.637+0000 7f7e62173700 1 -- 172.21.2.105:0/1770728086 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f7e5c140d50 con 0x7f7e5c0b37d0 2021-11-12T05:49:52.644 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.641+0000 7f7e58ff9700 1 -- 172.21.2.105:0/1770728086 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v149) v1 ==== 81+0+29229 (secure 0 0 0) 0x7f7e50023020 con 0x7f7e5c0b37d0 2021-11-12T05:49:52.644 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:52.644 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:49:52.645 INFO:teuthology.orchestra.run.gibba005.stdout: "epoch": 149, 2021-11-12T05:49:52.645 INFO:teuthology.orchestra.run.gibba005.stdout: "fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", 2021-11-12T05:49:52.645 INFO:teuthology.orchestra.run.gibba005.stdout: "created": "2021-11-12T05:40:19.986390+0000", 2021-11-12T05:49:52.645 INFO:teuthology.orchestra.run.gibba005.stdout: "modified": "2021-11-12T05:49:50.186040+0000", 2021-11-12T05:49:52.646 INFO:teuthology.orchestra.run.gibba005.stdout: "last_up_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:49:52.646 INFO:teuthology.orchestra.run.gibba005.stdout: "last_in_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:49:52.646 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-12T05:49:52.646 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_num": 5799936, 2021-11-12T05:49:52.647 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_set": [ 2021-11-12T05:49:52.647 INFO:teuthology.orchestra.run.gibba005.stdout: "pglog_hardlimit", 2021-11-12T05:49:52.647 INFO:teuthology.orchestra.run.gibba005.stdout: "purged_snapdirs", 2021-11-12T05:49:52.647 INFO:teuthology.orchestra.run.gibba005.stdout: "recovery_deletes", 2021-11-12T05:49:52.647 INFO:teuthology.orchestra.run.gibba005.stdout: "sortbitwise" 2021-11-12T05:49:52.648 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:49:52.648 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_version": 5, 2021-11-12T05:49:52.648 INFO:teuthology.orchestra.run.gibba005.stdout: "full_ratio": 0.94999998807907104, 2021-11-12T05:49:52.648 INFO:teuthology.orchestra.run.gibba005.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-12T05:49:52.649 INFO:teuthology.orchestra.run.gibba005.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-12T05:49:52.649 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_snapshot": "", 2021-11-12T05:49:52.649 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_max": 28, 2021-11-12T05:49:52.649 INFO:teuthology.orchestra.run.gibba005.stdout: "max_osd": 8, 2021-11-12T05:49:52.649 INFO:teuthology.orchestra.run.gibba005.stdout: "require_min_compat_client": "jewel", 2021-11-12T05:49:52.650 INFO:teuthology.orchestra.run.gibba005.stdout: "min_compat_client": "jewel", 2021-11-12T05:49:52.650 INFO:teuthology.orchestra.run.gibba005.stdout: "require_osd_release": "octopus", 2021-11-12T05:49:52.650 INFO:teuthology.orchestra.run.gibba005.stdout: "pools": [ 2021-11-12T05:49:52.650 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.650 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 1, 2021-11-12T05:49:52.651 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "device_health_metrics", 2021-11-12T05:49:52.651 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:22.022116+0000", 2021-11-12T05:49:52.651 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:49:52.651 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:49:52.652 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:49:52.652 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:49:52.652 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:49:52.652 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:49:52.652 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:49:52.653 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:49:52.653 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 1, 2021-11-12T05:49:52.653 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 1, 2021-11-12T05:49:52.653 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 1, 2021-11-12T05:49:52.653 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 1, 2021-11-12T05:49:52.654 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 1, 2021-11-12T05:49:52.654 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:49:52.654 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:49:52.654 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:49:52.655 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:49:52.655 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:49:52.655 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:49:52.655 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:49:52.655 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.656 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "16", 2021-11-12T05:49:52.656 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:49:52.656 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:49:52.656 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:49:52.657 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:49:52.657 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:49:52.657 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:49:52.657 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:49:52.657 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:49:52.658 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:49:52.658 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:49:52.658 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:49:52.658 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:49:52.658 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:49:52.659 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:49:52.659 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:49:52.659 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:49:52.659 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:49:52.660 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:49:52.660 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:49:52.660 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:49:52.660 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:49:52.660 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:49:52.661 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:49:52.661 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:49:52.661 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:49:52.661 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:49:52.661 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.662 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:49:52.662 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:49:52.662 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:49:52.662 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:49:52.663 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:49:52.663 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:49:52.663 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:49:52.663 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:49:52.663 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:49:52.664 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:49:52.664 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:49:52.664 INFO:teuthology.orchestra.run.gibba005.stdout: "options": { 2021-11-12T05:49:52.664 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_min": 1 2021-11-12T05:49:52.664 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.665 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:49:52.665 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr_devicehealth": {} 2021-11-12T05:49:52.665 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:52.665 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.665 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.666 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 2, 2021-11-12T05:49:52.666 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "rbd", 2021-11-12T05:49:52.666 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:29.953617+0000", 2021-11-12T05:49:52.666 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:49:52.667 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:49:52.667 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:49:52.667 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:49:52.667 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:49:52.667 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:49:52.668 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:49:52.668 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:49:52.668 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:49:52.668 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:49:52.668 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:49:52.669 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:49:52.669 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:49:52.669 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:49:52.669 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:49:52.669 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:49:52.670 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:49:52.670 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:49:52.670 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:49:52.670 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:49:52.671 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.671 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "19", 2021-11-12T05:49:52.671 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:49:52.671 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:49:52.671 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:49:52.672 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:49:52.672 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:49:52.672 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:49:52.672 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:49:52.672 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:49:52.673 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:49:52.673 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:49:52.673 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:49:52.673 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:49:52.674 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:49:52.674 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:49:52.674 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:49:52.674 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:49:52.674 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:49:52.675 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:49:52.675 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:49:52.675 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:49:52.675 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:49:52.675 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:49:52.676 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:49:52.676 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:49:52.676 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:49:52.676 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:49:52.677 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.677 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:49:52.677 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:49:52.677 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:49:52.677 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:49:52.678 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:49:52.678 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:49:52.678 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:49:52.678 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:49:52.678 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:49:52.679 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:49:52.679 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:49:52.679 INFO:teuthology.orchestra.run.gibba005.stdout: "options": {}, 2021-11-12T05:49:52.679 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:49:52.680 INFO:teuthology.orchestra.run.gibba005.stdout: "rbd": {} 2021-11-12T05:49:52.680 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:52.680 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:52.680 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:49:52.680 INFO:teuthology.orchestra.run.gibba005.stdout: "osds": [ 2021-11-12T05:49:52.681 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.681 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:49:52.681 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "ee8e30a0-4819-4475-80ec-dd3ee7d01322", 2021-11-12T05:49:52.681 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:52.681 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:52.682 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:52.682 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:52.682 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:52.682 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:52.682 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:52.683 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 142, 2021-11-12T05:49:52.683 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:52.683 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:52.683 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:52.684 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:52.684 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.684 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:52.684 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6802", 2021-11-12T05:49:52.684 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:52.685 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.685 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.685 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:52.685 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6803", 2021-11-12T05:49:52.685 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:52.686 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:52.686 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.686 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.686 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:52.686 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:52.687 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.687 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:52.687 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6804", 2021-11-12T05:49:52.687 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:52.687 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.688 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.688 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:52.688 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6805", 2021-11-12T05:49:52.688 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:52.689 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:52.689 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.689 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.689 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:52.689 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:52.690 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.690 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:52.690 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6808", 2021-11-12T05:49:52.690 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:52.690 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.691 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.691 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:52.691 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6809", 2021-11-12T05:49:52.691 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:52.691 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:52.692 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.692 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.692 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:52.692 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:52.692 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.693 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:52.693 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6806", 2021-11-12T05:49:52.693 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:52.693 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.694 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.694 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:52.694 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6807", 2021-11-12T05:49:52.694 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:49:52.694 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:52.695 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.695 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.695 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6803/14874", 2021-11-12T05:49:52.695 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6805/14874", 2021-11-12T05:49:52.695 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6809/14874", 2021-11-12T05:49:52.696 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6807/14874", 2021-11-12T05:49:52.696 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:52.696 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:52.696 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:52.696 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.697 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.697 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.697 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:49:52.697 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "b1bb06c3-26d0-4d92-82f8-b3e882242785", 2021-11-12T05:49:52.698 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:52.698 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:52.698 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:52.698 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:52.698 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:52.699 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:52.699 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:52.699 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 142, 2021-11-12T05:49:52.699 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:52.699 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:52.700 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:52.700 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:52.700 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.700 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:52.700 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6810", 2021-11-12T05:49:52.701 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:52.701 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.701 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.701 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:52.701 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6811", 2021-11-12T05:49:52.702 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:52.702 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:52.702 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.702 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.703 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:52.703 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:52.703 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.703 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:52.704 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6812", 2021-11-12T05:49:52.704 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:52.704 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.704 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.705 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:52.705 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6813", 2021-11-12T05:49:52.705 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:52.705 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:52.705 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.706 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.706 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:52.706 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:52.706 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.707 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:52.707 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6816", 2021-11-12T05:49:52.707 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:52.707 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.708 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.708 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:52.708 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6817", 2021-11-12T05:49:52.708 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:52.709 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:52.709 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.709 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.709 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:52.709 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:52.710 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.710 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:52.710 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6814", 2021-11-12T05:49:52.710 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:52.710 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.711 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.711 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:52.711 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6815", 2021-11-12T05:49:52.711 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:49:52.712 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:52.712 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.712 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.712 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6811/14875", 2021-11-12T05:49:52.713 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6813/14875", 2021-11-12T05:49:52.713 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6817/14875", 2021-11-12T05:49:52.713 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6815/14875", 2021-11-12T05:49:52.714 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:52.714 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:52.714 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:52.714 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.715 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.715 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.715 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:49:52.715 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "837b2c60-c335-4382-9f47-d86543a14022", 2021-11-12T05:49:52.716 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:52.716 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:52.716 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:52.716 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:52.717 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:52.717 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:52.717 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:52.717 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 141, 2021-11-12T05:49:52.718 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:52.718 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:52.718 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:52.718 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:52.719 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.719 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:52.719 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6818", 2021-11-12T05:49:52.719 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:52.720 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.720 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.720 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:52.720 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6819", 2021-11-12T05:49:52.720 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:52.721 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:52.721 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.721 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.721 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:52.722 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:52.722 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.722 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:52.722 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6820", 2021-11-12T05:49:52.723 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:52.723 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.723 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.723 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:52.723 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6821", 2021-11-12T05:49:52.724 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:52.724 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:52.724 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.725 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.725 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:52.725 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:52.725 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.726 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:52.726 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6824", 2021-11-12T05:49:52.726 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:52.727 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.727 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.727 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:52.727 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6825", 2021-11-12T05:49:52.728 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:52.728 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:52.728 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.728 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.728 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:52.729 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:52.729 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.729 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:52.729 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6822", 2021-11-12T05:49:52.730 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:52.730 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.730 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.730 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:52.731 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6823", 2021-11-12T05:49:52.731 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:49:52.731 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:52.731 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.732 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.732 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6819/14905", 2021-11-12T05:49:52.732 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6821/14905", 2021-11-12T05:49:52.732 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6825/14905", 2021-11-12T05:49:52.732 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6823/14905", 2021-11-12T05:49:52.733 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:52.733 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:52.733 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:52.733 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.734 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.734 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.734 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:49:52.734 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "eb2b737b-dda6-444b-a306-f33cbbd51f70", 2021-11-12T05:49:52.735 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:52.735 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:52.735 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:52.735 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:52.736 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:52.736 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:52.736 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:52.736 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 132, 2021-11-12T05:49:52.737 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:52.737 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:52.737 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:52.737 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:52.737 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.738 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:52.738 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6826", 2021-11-12T05:49:52.738 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:52.738 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.739 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.739 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:52.739 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6827", 2021-11-12T05:49:52.739 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:52.740 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:52.740 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.740 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.740 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:52.740 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:52.741 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.741 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:52.741 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6828", 2021-11-12T05:49:52.741 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:52.742 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.742 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.742 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:52.742 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6829", 2021-11-12T05:49:52.743 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:52.743 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:52.743 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.743 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.744 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:52.744 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:52.744 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.744 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:52.744 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6832", 2021-11-12T05:49:52.745 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:52.745 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.745 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.745 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:52.746 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6833", 2021-11-12T05:49:52.746 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:52.746 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:52.746 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.747 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.747 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:52.747 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:52.747 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.748 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:52.748 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6830", 2021-11-12T05:49:52.748 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:52.748 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.749 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.749 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:52.749 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6831", 2021-11-12T05:49:52.749 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:49:52.749 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:52.750 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.750 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.750 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6827/14876", 2021-11-12T05:49:52.750 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6829/14876", 2021-11-12T05:49:52.751 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6833/14876", 2021-11-12T05:49:52.751 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6831/14876", 2021-11-12T05:49:52.751 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:52.751 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:52.751 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:52.752 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.752 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.752 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.752 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:49:52.753 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "721529a1-c047-486a-a7ca-ddc15d80cdde", 2021-11-12T05:49:52.753 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:52.753 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:52.753 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:52.754 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:52.754 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:52.754 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:52.754 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:52.755 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 141, 2021-11-12T05:49:52.755 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:52.755 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:52.755 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:52.755 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:52.756 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.756 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:52.756 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6800", 2021-11-12T05:49:52.756 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:52.757 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.757 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.757 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:52.757 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6801", 2021-11-12T05:49:52.758 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:52.758 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:52.758 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.758 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.759 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:52.759 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:52.759 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.759 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:52.759 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6802", 2021-11-12T05:49:52.760 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:52.760 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.760 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.760 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:52.761 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6803", 2021-11-12T05:49:52.761 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:52.761 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:52.761 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.762 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.762 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:52.762 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:52.762 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.763 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:52.763 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6806", 2021-11-12T05:49:52.763 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:52.763 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.763 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.764 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:52.764 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6807", 2021-11-12T05:49:52.764 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:52.764 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:52.765 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.765 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.765 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:52.765 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:52.766 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.766 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:52.766 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6804", 2021-11-12T05:49:52.766 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:52.767 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.767 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.767 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:52.767 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6805", 2021-11-12T05:49:52.768 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:49:52.768 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:52.768 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.768 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.768 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6801/15096", 2021-11-12T05:49:52.769 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6803/15096", 2021-11-12T05:49:52.769 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6807/15096", 2021-11-12T05:49:52.769 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6805/15096", 2021-11-12T05:49:52.769 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:52.770 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:52.770 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:52.770 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.770 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.771 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.771 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:49:52.771 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "68b72ab2-fa82-4b5c-bf33-528f002e4950", 2021-11-12T05:49:52.771 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:52.771 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:52.772 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:52.772 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:52.772 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:52.772 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:52.773 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:52.773 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 142, 2021-11-12T05:49:52.773 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:52.773 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:52.774 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:52.774 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:52.774 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.774 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:52.774 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6808", 2021-11-12T05:49:52.775 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:52.775 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.775 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.775 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:52.776 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6809", 2021-11-12T05:49:52.776 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:52.776 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:52.776 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.777 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.777 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:52.777 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:52.777 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.777 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:52.778 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6810", 2021-11-12T05:49:52.778 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:52.778 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.778 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.779 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:52.779 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6811", 2021-11-12T05:49:52.779 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:52.779 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:52.780 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.780 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.780 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:52.780 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:52.780 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.781 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:52.781 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6814", 2021-11-12T05:49:52.781 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:52.781 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.782 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.782 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:52.782 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6815", 2021-11-12T05:49:52.782 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:52.783 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:52.783 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.783 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.783 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:52.784 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:52.784 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.784 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:52.784 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6812", 2021-11-12T05:49:52.784 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:52.785 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.785 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.785 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:52.785 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6813", 2021-11-12T05:49:52.786 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:49:52.786 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:52.786 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.786 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.787 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6809/15097", 2021-11-12T05:49:52.787 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6811/15097", 2021-11-12T05:49:52.787 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6815/15097", 2021-11-12T05:49:52.787 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6813/15097", 2021-11-12T05:49:52.788 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:52.788 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:52.788 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:52.788 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.789 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.789 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.789 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:49:52.789 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "a2c83b5d-8d37-4d30-ac04-30d89a76e485", 2021-11-12T05:49:52.790 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:52.790 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:52.790 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:52.790 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:52.791 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:52.791 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:52.791 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:52.791 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 142, 2021-11-12T05:49:52.791 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:52.792 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:52.792 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:52.792 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:52.792 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.793 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:52.793 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6816", 2021-11-12T05:49:52.793 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:52.793 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.794 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.794 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:52.794 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6817", 2021-11-12T05:49:52.794 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:52.794 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:52.795 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.795 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.795 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:52.795 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:52.796 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.796 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:52.796 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6818", 2021-11-12T05:49:52.796 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:52.797 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.797 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.797 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:52.797 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6819", 2021-11-12T05:49:52.798 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:52.798 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:52.798 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.798 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.798 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:52.799 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:52.799 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.799 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:52.799 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6822", 2021-11-12T05:49:52.800 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:52.800 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.800 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.800 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:52.801 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6823", 2021-11-12T05:49:52.801 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:52.801 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:52.801 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.802 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.802 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:52.802 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:52.802 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.802 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:52.803 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6820", 2021-11-12T05:49:52.803 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:52.803 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.803 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.804 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:52.804 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6821", 2021-11-12T05:49:52.804 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:49:52.804 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:52.805 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.805 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.805 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6817/15098", 2021-11-12T05:49:52.805 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6819/15098", 2021-11-12T05:49:52.805 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6823/15098", 2021-11-12T05:49:52.806 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6821/15098", 2021-11-12T05:49:52.806 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:52.806 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:52.806 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:52.807 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.807 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.807 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.807 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:49:52.808 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "786ce966-d0fb-4181-aed4-c26e3ef61c43", 2021-11-12T05:49:52.808 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:49:52.808 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:49:52.808 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:49:52.808 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:49:52.809 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:49:52.809 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:49:52.809 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:49:52.809 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 142, 2021-11-12T05:49:52.810 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:49:52.810 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:49:52.810 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:49:52.810 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:52.811 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.811 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:52.811 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6824", 2021-11-12T05:49:52.811 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:52.811 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.812 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.812 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:52.812 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6825", 2021-11-12T05:49:52.812 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:52.813 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:52.813 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.813 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.813 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:49:52.814 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:52.814 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.814 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:52.814 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6826", 2021-11-12T05:49:52.815 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:52.815 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.815 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.815 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:52.815 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6827", 2021-11-12T05:49:52.816 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:52.816 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:52.816 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.816 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.817 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:49:52.817 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:52.817 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.817 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:52.818 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6830", 2021-11-12T05:49:52.818 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:52.818 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.818 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.819 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:52.819 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6831", 2021-11-12T05:49:52.819 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:52.819 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:52.820 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.820 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.820 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:49:52.820 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:49:52.821 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.821 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:49:52.821 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6828", 2021-11-12T05:49:52.822 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:52.822 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.822 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.822 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:49:52.823 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6829", 2021-11-12T05:49:52.823 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:49:52.823 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:52.823 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.824 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.824 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6825/15099", 2021-11-12T05:49:52.824 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6827/15099", 2021-11-12T05:49:52.825 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6831/15099", 2021-11-12T05:49:52.825 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6829/15099", 2021-11-12T05:49:52.825 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:49:52.825 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:49:52.826 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:49:52.826 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:52.826 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:52.826 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:49:52.827 INFO:teuthology.orchestra.run.gibba005.stdout: "osd_xinfo": [ 2021-11-12T05:49:52.827 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.827 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:49:52.827 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:52.828 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:52.828 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:52.828 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:52.828 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:52.829 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.615112+0000", 2021-11-12T05:49:52.829 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:52.829 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.830 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.830 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:49:52.830 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:52.830 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:52.831 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:52.831 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:52.831 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:52.832 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.665935+0000", 2021-11-12T05:49:52.832 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:52.832 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.832 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.832 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:49:52.833 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:52.833 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:52.833 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:52.833 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:52.834 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:52.834 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.715877+0000", 2021-11-12T05:49:52.834 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:52.834 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.835 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.835 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:49:52.835 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:52.835 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:52.836 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:52.836 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:52.836 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:52.836 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.489234+0000", 2021-11-12T05:49:52.837 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:52.837 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.837 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.837 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:49:52.838 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:52.838 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:52.838 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:52.838 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:52.839 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:52.839 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.413776+0000", 2021-11-12T05:49:52.839 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:52.839 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.840 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.840 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:49:52.840 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:52.840 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:52.841 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:52.841 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:52.841 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:52.841 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.507960+0000", 2021-11-12T05:49:52.842 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:52.842 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.842 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.842 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:49:52.843 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:52.843 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:52.843 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:52.843 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:52.844 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:52.844 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.635696+0000", 2021-11-12T05:49:52.844 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:52.844 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.844 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:52.845 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:49:52.845 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:49:52.849 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:49:52.849 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:49:52.850 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:49:52.850 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:49:52.850 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.746949+0000", 2021-11-12T05:49:52.850 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:49:52.851 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:52.851 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:49:52.851 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap": [], 2021-11-12T05:49:52.851 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap_items": [], 2021-11-12T05:49:52.851 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_temp": [], 2021-11-12T05:49:52.852 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_temp": [], 2021-11-12T05:49:52.852 INFO:teuthology.orchestra.run.gibba005.stdout: "blacklist": { 2021-11-12T05:49:52.852 INFO:teuthology.orchestra.run.gibba005.stdout: "172.21.2.105:6835/3394672010": "2021-11-13T05:49:46.438924+0000", 2021-11-12T05:49:52.852 INFO:teuthology.orchestra.run.gibba005.stdout: "172.21.2.105:6834/3394672010": "2021-11-13T05:49:46.438924+0000" 2021-11-12T05:49:52.853 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.853 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profiles": { 2021-11-12T05:49:52.853 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs_data": { 2021-11-12T05:49:52.853 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-device-class": "", 2021-11-12T05:49:52.853 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:49:52.854 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-root": "default", 2021-11-12T05:49:52.854 INFO:teuthology.orchestra.run.gibba005.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-12T05:49:52.854 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:49:52.854 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "2", 2021-11-12T05:49:52.855 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:49:52.855 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:49:52.855 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van", 2021-11-12T05:49:52.855 INFO:teuthology.orchestra.run.gibba005.stdout: "w": "8" 2021-11-12T05:49:52.856 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.856 INFO:teuthology.orchestra.run.gibba005.stdout: "default": { 2021-11-12T05:49:52.856 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:49:52.856 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:49:52.856 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "1", 2021-11-12T05:49:52.857 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:49:52.857 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:49:52.857 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van" 2021-11-12T05:49:52.857 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:52.858 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:52.858 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps_queue": [], 2021-11-12T05:49:52.858 INFO:teuthology.orchestra.run.gibba005.stdout: "new_removed_snaps": [], 2021-11-12T05:49:52.858 INFO:teuthology.orchestra.run.gibba005.stdout: "new_purged_snaps": [], 2021-11-12T05:49:52.859 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_node_flags": {}, 2021-11-12T05:49:52.859 INFO:teuthology.orchestra.run.gibba005.stdout: "device_class_flags": {} 2021-11-12T05:49:52.859 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:49:52.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.641+0000 7f7e62173700 1 -- 172.21.2.105:0/1770728086 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7e3c053540 msgr2=0x7f7e3c055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:52.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.641+0000 7f7e62173700 1 --2- 172.21.2.105:0/1770728086 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7e3c053540 0x7f7e3c055a00 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f7e4c002f70 tx=0x7f7e4c006a80).stop 2021-11-12T05:49:52.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.641+0000 7f7e62173700 1 -- 172.21.2.105:0/1770728086 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7e5c0b37d0 msgr2=0x7f7e5c130c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:52.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.641+0000 7f7e62173700 1 --2- 172.21.2.105:0/1770728086 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7e5c0b37d0 0x7f7e5c130c50 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 rx=0x7f7e50002f70 tx=0x7f7e50014000).stop 2021-11-12T05:49:52.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.641+0000 7f7e62173700 1 -- 172.21.2.105:0/1770728086 shutdown_connections 2021-11-12T05:49:52.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.641+0000 7f7e62173700 1 --2- 172.21.2.105:0/1770728086 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7e3c053540 0x7f7e3c055a00 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:52.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.641+0000 7f7e62173700 1 --2- 172.21.2.105:0/1770728086 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7e5c1419f0 0x7f7e5c131140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:52.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.641+0000 7f7e62173700 1 --2- 172.21.2.105:0/1770728086 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7e5c0b37d0 0x7f7e5c130c50 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:52.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.641+0000 7f7e62173700 1 --2- 172.21.2.105:0/1770728086 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7e5c060100 0x7f7e5c1434f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:52.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.641+0000 7f7e62173700 1 -- 172.21.2.105:0/1770728086 >> 172.21.2.105:0/1770728086 conn(0x7f7e5c0608d0 msgr2=0x7f7e5c05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:52.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.641+0000 7f7e62173700 1 -- 172.21.2.105:0/1770728086 shutdown_connections 2021-11-12T05:49:52.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.641+0000 7f7e62173700 1 -- 172.21.2.105:0/1770728086 wait complete. 2021-11-12T05:49:52.864 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:49:52.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.917+0000 7fa2931c3700 1 Processor -- start 2021-11-12T05:49:52.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.917+0000 7fa2931c3700 1 -- start start 2021-11-12T05:49:52.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.917+0000 7fa2931c3700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa28c14b2f0 0x7fa28c0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:52.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.917+0000 7fa2931c3700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa28c0ac7b0 con 0x7fa28c0ad080 2021-11-12T05:49:52.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.917+0000 7fa2931c3700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa28c0ac9e0 con 0x7fa28c0ac280 2021-11-12T05:49:52.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.917+0000 7fa2931c3700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c1488a0 con 0x7fa28c14b2f0 2021-11-12T05:49:52.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.917+0000 7fa290f5f700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fa28c0ad080 0x7fa28c14abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34880/0 (socket says 172.21.2.105:34880) 2021-11-12T05:49:52.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.917+0000 7fa290f5f700 1 -- 172.21.2.105:0/38616903 learned_addr learned my addr 172.21.2.105:0/38616903 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:52.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.917+0000 7fa28b7fe700 1 -- 172.21.2.105:0/38616903 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 117117391 0 0) 0x7fa28c0ac7b0 con 0x7fa28c0ad080 2021-11-12T05:49:52.928 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.917+0000 7fa28b7fe700 1 -- 172.21.2.105:0/38616903 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa26c003260 con 0x7fa28c0ad080 2021-11-12T05:49:52.929 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.917+0000 7fa28b7fe700 1 -- 172.21.2.105:0/38616903 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1643823884 0 0) 0x7fa26c003260 con 0x7fa28c0ad080 2021-11-12T05:49:52.929 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.917+0000 7fa28b7fe700 1 -- 172.21.2.105:0/38616903 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa28c14b2f0 msgr2=0x7fa28c0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:52.929 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.917+0000 7fa28b7fe700 1 --2- 172.21.2.105:0/38616903 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa28c14b2f0 0x7fa28c0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:52.929 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.917+0000 7fa28b7fe700 1 -- 172.21.2.105:0/38616903 >> v1:172.21.2.115:6789/0 conn(0x7fa28c0ac280 legacy=0x7fa28c147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:52.930 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.917+0000 7fa28b7fe700 1 -- 172.21.2.105:0/38616903 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28c0b0b30 con 0x7fa28c0ad080 2021-11-12T05:49:52.930 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.917+0000 7fa28b7fe700 1 -- 172.21.2.105:0/38616903 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fa27c001660 con 0x7fa28c0ad080 2021-11-12T05:49:52.930 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.917+0000 7fa28b7fe700 1 -- 172.21.2.105:0/38616903 >> v1:172.21.2.105:6789/0 conn(0x7fa28c0ad080 legacy=0x7fa28c14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:52.930 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.917+0000 7fa28b7fe700 1 --2- 172.21.2.105:0/38616903 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa26c003800 0x7fa26c003c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:52.930 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.917+0000 7fa28b7fe700 1 --2- 172.21.2.105:0/38616903 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa26c004500 0x7fa26c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:52.931 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.917+0000 7fa28b7fe700 1 --2- 172.21.2.105:0/38616903 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa28c14b2f0 0x7fa26c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:52.931 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.917+0000 7fa28b7fe700 1 -- 172.21.2.105:0/38616903 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c1488a0 con 0x7fa26c003800 2021-11-12T05:49:52.931 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.917+0000 7fa28b7fe700 1 -- 172.21.2.105:0/38616903 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26c0052c0 con 0x7fa26c004500 2021-11-12T05:49:52.931 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.917+0000 7fa28b7fe700 1 -- 172.21.2.105:0/38616903 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26c00bc40 con 0x7fa28c14b2f0 2021-11-12T05:49:52.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.917+0000 7fa290f5f700 1 --2- 172.21.2.105:0/38616903 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa26c003800 0x7fa26c003c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:52.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa290f5f700 1 -- 172.21.2.105:0/38616903 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa28c14b2f0 msgr2=0x7fa26c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:52.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa290f5f700 1 --2- 172.21.2.105:0/38616903 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa28c14b2f0 0x7fa26c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:52.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa290f5f700 1 -- 172.21.2.105:0/38616903 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa26c004500 msgr2=0x7fa26c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:52.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa290f5f700 1 --2- 172.21.2.105:0/38616903 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa26c004500 0x7fa26c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:52.933 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa290f5f700 1 -- 172.21.2.105:0/38616903 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa26c003260 con 0x7fa26c003800 2021-11-12T05:49:52.933 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa290f5f700 1 --2- 172.21.2.105:0/38616903 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa26c003800 0x7fa26c003c00 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 rx=0x7fa26c0054d0 tx=0x7fa27c001d60).ready entity=mon.0 client_cookie=b3ddda4584d56e47 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:52.933 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa28b7fe700 1 -- 172.21.2.105:0/38616903 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa27c0071a0 con 0x7fa26c003800 2021-11-12T05:49:52.933 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa28b7fe700 1 -- 172.21.2.105:0/38616903 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27c007300 con 0x7fa26c003800 2021-11-12T05:49:52.934 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa28b7fe700 1 -- 172.21.2.105:0/38616903 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa27c00caa0 con 0x7fa26c003800 2021-11-12T05:49:52.934 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa2931c3700 1 -- 172.21.2.105:0/38616903 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa26c003800 msgr2=0x7fa26c003c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:52.934 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa2931c3700 1 --2- 172.21.2.105:0/38616903 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa26c003800 0x7fa26c003c00 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 rx=0x7fa26c0054d0 tx=0x7fa27c001d60).stop 2021-11-12T05:49:52.934 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa291760700 1 -- 172.21.2.105:0/38616903 reap_dead start 2021-11-12T05:49:52.934 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa2931c3700 1 -- 172.21.2.105:0/38616903 shutdown_connections 2021-11-12T05:49:52.935 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa2931c3700 1 -- 172.21.2.105:0/38616903 >> 172.21.2.105:0/38616903 conn(0x7fa28c0b5370 msgr2=0x7fa28c0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:52.935 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa2931c3700 1 -- 172.21.2.105:0/38616903 shutdown_connections 2021-11-12T05:49:52.935 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa2931c3700 1 -- 172.21.2.105:0/38616903 wait complete. 2021-11-12T05:49:52.935 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa2931c3700 1 Processor -- start 2021-11-12T05:49:52.936 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa2931c3700 1 -- start start 2021-11-12T05:49:52.936 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa2931c3700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa28c148ae0 0x7fa28c0a7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:52.936 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa2931c3700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa28c148ec0 0x7fa28c15a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:52.936 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa2931c3700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa28c15aae0 0x7fa28c149ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:52.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa2931c3700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c0abf00 con 0x7fa28c148ae0 2021-11-12T05:49:52.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa2931c3700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c15a1c0 con 0x7fa28c148ec0 2021-11-12T05:49:52.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa2931c3700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c0ab850 con 0x7fa28c15aae0 2021-11-12T05:49:52.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa290f5f700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa28c148ae0 0x7fa28c0a7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:52.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa290f5f700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa28c148ae0 0x7fa28c0a7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52730/0 (socket says 172.21.2.105:52730) 2021-11-12T05:49:52.938 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa290f5f700 1 -- 172.21.2.105:0/1311296810 learned_addr learned my addr 172.21.2.105:0/1311296810 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:52.938 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa290f5f700 1 -- 172.21.2.105:0/1311296810 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa28c15aae0 msgr2=0x7fa28c149ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:52.938 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa290f5f700 1 --2- 172.21.2.105:0/1311296810 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa28c15aae0 0x7fa28c149ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:52.938 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa290f5f700 1 -- 172.21.2.105:0/1311296810 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa28c148ec0 msgr2=0x7fa28c15a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:52.939 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa290f5f700 1 --2- 172.21.2.105:0/1311296810 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa28c148ec0 0x7fa28c15a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:52.939 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa290f5f700 1 -- 172.21.2.105:0/1311296810 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28c0abaf0 con 0x7fa28c148ae0 2021-11-12T05:49:52.939 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa290f5f700 1 --2- 172.21.2.105:0/1311296810 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa28c148ae0 0x7fa28c0a7660 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 rx=0x7fa26c0054d0 tx=0x7fa27c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:52.939 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa289ffb700 1 -- 172.21.2.105:0/1311296810 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa27c0049e0 con 0x7fa28c148ae0 2021-11-12T05:49:52.940 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa289ffb700 1 -- 172.21.2.105:0/1311296810 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27c004b40 con 0x7fa28c148ae0 2021-11-12T05:49:52.940 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa2931c3700 1 -- 172.21.2.105:0/1311296810 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa28c157d20 con 0x7fa28c148ae0 2021-11-12T05:49:52.940 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa289ffb700 1 -- 172.21.2.105:0/1311296810 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa27c004ea0 con 0x7fa28c148ae0 2021-11-12T05:49:52.940 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa2931c3700 1 -- 172.21.2.105:0/1311296810 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa28c149320 con 0x7fa28c148ae0 2021-11-12T05:49:52.940 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.921+0000 7fa2931c3700 1 -- 172.21.2.105:0/1311296810 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa28c0b1440 con 0x7fa28c148ae0 2021-11-12T05:49:52.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.925+0000 7fa289ffb700 1 -- 172.21.2.105:0/1311296810 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa27c010070 con 0x7fa28c148ae0 2021-11-12T05:49:52.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.925+0000 7fa289ffb700 1 --2- 172.21.2.105:0/1311296810 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa2700536a0 0x7fa270055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:52.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.925+0000 7fa289ffb700 1 -- 172.21.2.105:0/1311296810 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fa27c06c4e0 con 0x7fa28c148ae0 2021-11-12T05:49:52.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.925+0000 7fa28bfff700 1 --2- 172.21.2.105:0/1311296810 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa2700536a0 0x7fa270055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:52.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.925+0000 7fa28bfff700 1 --2- 172.21.2.105:0/1311296810 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa2700536a0 0x7fa270055b60 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7fa274000f70 tx=0x7fa2740069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:52.942 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:52.925+0000 7fa289ffb700 1 -- 172.21.2.105:0/1311296810 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa27c0437c0 con 0x7fa28c148ae0 2021-11-12T05:49:53.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.033+0000 7fa2931c3700 1 -- 172.21.2.105:0/1311296810 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa28c057350 con 0x7fa28c148ae0 2021-11-12T05:49:53.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.033+0000 7fa289ffb700 1 -- 172.21.2.105:0/1311296810 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+1203 (secure 0 0 0) 0x7fa27c024030 con 0x7fa28c148ae0 2021-11-12T05:49:53.037 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:53.038 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":71,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5066,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/506237043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":506237043},{"type":"v1","addr":"172.21.2.115:6833","nonce":506237043}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":68},{"gid":8748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.105:6835/141759953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":141759953},{"type":"v1","addr":"172.21.2.105:6835","nonce":141759953}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":71}],"filesystems":[]} 2021-11-12T05:49:53.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.033+0000 7fa2931c3700 1 -- 172.21.2.105:0/1311296810 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa2700536a0 msgr2=0x7fa270055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:53.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.033+0000 7fa2931c3700 1 --2- 172.21.2.105:0/1311296810 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa2700536a0 0x7fa270055b60 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7fa274000f70 tx=0x7fa2740069b0).stop 2021-11-12T05:49:53.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.033+0000 7fa2931c3700 1 -- 172.21.2.105:0/1311296810 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa28c148ae0 msgr2=0x7fa28c0a7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:53.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.033+0000 7fa2931c3700 1 --2- 172.21.2.105:0/1311296810 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa28c148ae0 0x7fa28c0a7660 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 rx=0x7fa26c0054d0 tx=0x7fa27c015000).stop 2021-11-12T05:49:53.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.033+0000 7fa2931c3700 1 -- 172.21.2.105:0/1311296810 shutdown_connections 2021-11-12T05:49:53.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.033+0000 7fa2931c3700 1 --2- 172.21.2.105:0/1311296810 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa2700536a0 0x7fa270055b60 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:53.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.033+0000 7fa2931c3700 1 --2- 172.21.2.105:0/1311296810 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa28c15aae0 0x7fa28c149ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:53.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.033+0000 7fa2931c3700 1 --2- 172.21.2.105:0/1311296810 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa28c148ec0 0x7fa28c15a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:53.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.033+0000 7fa2931c3700 1 --2- 172.21.2.105:0/1311296810 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa28c148ae0 0x7fa28c0a7660 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:53.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.033+0000 7fa2931c3700 1 -- 172.21.2.105:0/1311296810 >> 172.21.2.105:0/1311296810 conn(0x7fa28c0b5370 msgr2=0x7fa28c141bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:53.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.033+0000 7fa2931c3700 1 -- 172.21.2.105:0/1311296810 shutdown_connections 2021-11-12T05:49:53.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.033+0000 7fa2931c3700 1 -- 172.21.2.105:0/1311296810 wait complete. 2021-11-12T05:49:53.042 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 71 2021-11-12T05:49:53.044 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:49:53.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75f575f700 1 Processor -- start 2021-11-12T05:49:53.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75f575f700 1 -- start start 2021-11-12T05:49:53.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75f575f700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f75f00ad080 0x7f75f00af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:53.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75f575f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f75f014b2f0 0x7f75f00ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:53.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75f575f700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f00ac7b0 con 0x7f75f00ac280 2021-11-12T05:49:53.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75f575f700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75f01488a0 con 0x7f75f00ad080 2021-11-12T05:49:53.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75f575f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f00ac9e0 con 0x7f75f014b2f0 2021-11-12T05:49:53.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75ee7fc700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f75f00ac280 0x7f75f014abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34904/0 (socket says 172.21.2.105:34904) 2021-11-12T05:49:53.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75ee7fc700 1 -- 172.21.2.105:0/1129731421 learned_addr learned my addr 172.21.2.105:0/1129731421 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:53.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75edffb700 1 -- 172.21.2.105:0/1129731421 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3164989355 0 0) 0x7f75f00ac7b0 con 0x7f75f00ac280 2021-11-12T05:49:53.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75edffb700 1 -- 172.21.2.105:0/1129731421 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75d0003260 con 0x7f75f00ac280 2021-11-12T05:49:53.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75edffb700 1 -- 172.21.2.105:0/1129731421 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1672870954 0 0) 0x7f75d0003260 con 0x7f75f00ac280 2021-11-12T05:49:53.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75edffb700 1 -- 172.21.2.105:0/1129731421 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f75f014b2f0 msgr2=0x7f75f00ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:53.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75edffb700 1 --2- 172.21.2.105:0/1129731421 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f75f014b2f0 0x7f75f00ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:53.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75edffb700 1 -- 172.21.2.105:0/1129731421 >> v2:172.21.2.115:3300/0 conn(0x7f75f00ad080 msgr2=0x7f75f00af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:53.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75edffb700 1 --2- 172.21.2.105:0/1129731421 >> v2:172.21.2.115:3300/0 conn(0x7f75f00ad080 0x7f75f00af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:53.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75edffb700 1 -- 172.21.2.105:0/1129731421 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f00b0b30 con 0x7f75f00ac280 2021-11-12T05:49:53.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75edffb700 1 -- 172.21.2.105:0/1129731421 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f75e0001660 con 0x7f75f00ac280 2021-11-12T05:49:53.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75edffb700 1 -- 172.21.2.105:0/1129731421 >> v1:172.21.2.105:6789/0 conn(0x7f75f00ac280 legacy=0x7f75f014abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:53.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75edffb700 1 --2- 172.21.2.105:0/1129731421 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75d00037d0 0x7f75d0003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:53.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75edffb700 1 --2- 172.21.2.105:0/1129731421 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f75d0004500 0x7f75d0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:53.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75edffb700 1 --2- 172.21.2.105:0/1129731421 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f75f014b2f0 0x7f75d000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:53.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75edffb700 1 -- 172.21.2.105:0/1129731421 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f01488a0 con 0x7f75d00037d0 2021-11-12T05:49:53.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75edffb700 1 -- 172.21.2.105:0/1129731421 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f00ac9e0 con 0x7f75d0004500 2021-11-12T05:49:53.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75edffb700 1 -- 172.21.2.105:0/1129731421 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d0005330 con 0x7f75f014b2f0 2021-11-12T05:49:53.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75eeffd700 1 --2- 172.21.2.105:0/1129731421 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75d00037d0 0x7f75d0003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:53.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75eeffd700 1 -- 172.21.2.105:0/1129731421 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f75f014b2f0 msgr2=0x7f75d000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:53.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75eeffd700 1 --2- 172.21.2.105:0/1129731421 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f75f014b2f0 0x7f75d000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:53.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75eeffd700 1 -- 172.21.2.105:0/1129731421 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f75d0004500 msgr2=0x7f75d0004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:53.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75eeffd700 1 --2- 172.21.2.105:0/1129731421 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f75d0004500 0x7f75d0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:53.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75eeffd700 1 -- 172.21.2.105:0/1129731421 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d0003260 con 0x7f75d00037d0 2021-11-12T05:49:53.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75eeffd700 1 --2- 172.21.2.105:0/1129731421 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75d00037d0 0x7f75d0003bf0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 rx=0x7f75d8002f70 tx=0x7f75d8006ca0).ready entity=mon.0 client_cookie=25c72d02579bb2a0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:53.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75edffb700 1 -- 172.21.2.105:0/1129731421 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75d8012410 con 0x7f75d00037d0 2021-11-12T05:49:53.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75edffb700 1 -- 172.21.2.105:0/1129731421 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d8012570 con 0x7f75d00037d0 2021-11-12T05:49:53.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75edffb700 1 -- 172.21.2.105:0/1129731421 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75d80128d0 con 0x7f75d00037d0 2021-11-12T05:49:53.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75f575f700 1 -- 172.21.2.105:0/1129731421 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75d00037d0 msgr2=0x7f75d0003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:53.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75f575f700 1 --2- 172.21.2.105:0/1129731421 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75d00037d0 0x7f75d0003bf0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 rx=0x7f75d8002f70 tx=0x7f75d8006ca0).stop 2021-11-12T05:49:53.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75ef7fe700 1 -- 172.21.2.105:0/1129731421 reap_dead start 2021-11-12T05:49:53.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75f575f700 1 -- 172.21.2.105:0/1129731421 shutdown_connections 2021-11-12T05:49:53.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75f575f700 1 -- 172.21.2.105:0/1129731421 >> 172.21.2.105:0/1129731421 conn(0x7f75f00b5370 msgr2=0x7f75f00b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:53.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75f575f700 1 -- 172.21.2.105:0/1129731421 shutdown_connections 2021-11-12T05:49:53.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.093+0000 7f75f575f700 1 -- 172.21.2.105:0/1129731421 wait complete. 2021-11-12T05:49:53.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.097+0000 7f75f575f700 1 Processor -- start 2021-11-12T05:49:53.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.097+0000 7f75f575f700 1 -- start start 2021-11-12T05:49:53.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.097+0000 7f75f575f700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f75d00037d0 0x7f75f0144d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:53.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.097+0000 7f75f575f700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f75f0063370 0x7f75f015aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:53.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.097+0000 7f75f575f700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75f00a7fb0 0x7f75f00a8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:53.111 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.097+0000 7f75f575f700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f015afb0 con 0x7f75f00a7fb0 2021-11-12T05:49:53.112 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.097+0000 7f75f575f700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f015a0e0 con 0x7f75f0063370 2021-11-12T05:49:53.112 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.097+0000 7f75f575f700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f015a380 con 0x7f75d00037d0 2021-11-12T05:49:53.112 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.097+0000 7f75ef7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75f00a7fb0 0x7f75f00a8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:53.112 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.097+0000 7f75ef7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75f00a7fb0 0x7f75f00a8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52748/0 (socket says 172.21.2.105:52748) 2021-11-12T05:49:53.112 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.097+0000 7f75ef7fe700 1 -- 172.21.2.105:0/1819664010 learned_addr learned my addr 172.21.2.105:0/1819664010 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:53.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.097+0000 7f75ef7fe700 1 -- 172.21.2.105:0/1819664010 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f75d00037d0 msgr2=0x7f75f0144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:53.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.097+0000 7f75ef7fe700 1 --2- 172.21.2.105:0/1819664010 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f75d00037d0 0x7f75f0144d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:53.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.097+0000 7f75ef7fe700 1 -- 172.21.2.105:0/1819664010 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f75f0063370 msgr2=0x7f75f015aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:53.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.097+0000 7f75ef7fe700 1 --2- 172.21.2.105:0/1819664010 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f75f0063370 0x7f75f015aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:53.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.097+0000 7f75ef7fe700 1 -- 172.21.2.105:0/1819664010 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f015a620 con 0x7f75f00a7fb0 2021-11-12T05:49:53.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.097+0000 7f75ef7fe700 1 --2- 172.21.2.105:0/1819664010 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75f00a7fb0 0x7f75f00a8430 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 rx=0x7f75e0001840 tx=0x7f75e800a060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:53.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.097+0000 7f75e7fff700 1 -- 172.21.2.105:0/1819664010 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75e8005a20 con 0x7f75f00a7fb0 2021-11-12T05:49:53.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.097+0000 7f75e7fff700 1 -- 172.21.2.105:0/1819664010 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e8005b80 con 0x7f75f00a7fb0 2021-11-12T05:49:53.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.097+0000 7f75e7fff700 1 -- 172.21.2.105:0/1819664010 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75e8007110 con 0x7f75f00a7fb0 2021-11-12T05:49:53.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.097+0000 7f75f575f700 1 -- 172.21.2.105:0/1819664010 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f01453a0 con 0x7f75f00a7fb0 2021-11-12T05:49:53.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.097+0000 7f75f575f700 1 -- 172.21.2.105:0/1819664010 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f00a9730 con 0x7f75f00a7fb0 2021-11-12T05:49:53.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.097+0000 7f75f575f700 1 -- 172.21.2.105:0/1819664010 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f00adac0 con 0x7f75f00a7fb0 2021-11-12T05:49:53.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.097+0000 7f75e7fff700 1 -- 172.21.2.105:0/1819664010 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f75e801d070 con 0x7f75f00a7fb0 2021-11-12T05:49:53.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.097+0000 7f75e7fff700 1 --2- 172.21.2.105:0/1819664010 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f75d4053640 0x7f75d4055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:53.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.097+0000 7f75e7fff700 1 -- 172.21.2.105:0/1819664010 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f75e806a920 con 0x7f75f00a7fb0 2021-11-12T05:49:53.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.097+0000 7f75eeffd700 1 --2- 172.21.2.105:0/1819664010 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f75d4053640 0x7f75d4055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:53.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.097+0000 7f75eeffd700 1 --2- 172.21.2.105:0/1819664010 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f75d4053640 0x7f75d4055b00 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f75d8002f70 tx=0x7f75d8015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:53.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.101+0000 7f75e7fff700 1 -- 172.21.2.105:0/1819664010 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f75e8041c00 con 0x7f75f00a7fb0 2021-11-12T05:49:53.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.213+0000 7f75f575f700 1 -- 172.21.2.105:0/1819664010 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75f015a7b0 con 0x7f75f00a7fb0 2021-11-12T05:49:53.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.213+0000 7f75e7fff700 1 -- 172.21.2.105:0/1819664010 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+1203 (secure 0 0 0) 0x7f75e8045220 con 0x7f75f00a7fb0 2021-11-12T05:49:53.216 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:53.216 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":71,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5066,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/506237043","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":506237043},{"type":"v1","addr":"172.21.2.115:6833","nonce":506237043}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":68},{"gid":8748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.2.105:6835/141759953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":141759953},{"type":"v1","addr":"172.21.2.105:6835","nonce":141759953}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":71}],"filesystems":[]} 2021-11-12T05:49:53.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.213+0000 7f75f575f700 1 -- 172.21.2.105:0/1819664010 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f75d4053640 msgr2=0x7f75d4055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:53.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.213+0000 7f75f575f700 1 --2- 172.21.2.105:0/1819664010 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f75d4053640 0x7f75d4055b00 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f75d8002f70 tx=0x7f75d8015000).stop 2021-11-12T05:49:53.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.213+0000 7f75f575f700 1 -- 172.21.2.105:0/1819664010 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75f00a7fb0 msgr2=0x7f75f00a8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:53.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.213+0000 7f75f575f700 1 --2- 172.21.2.105:0/1819664010 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75f00a7fb0 0x7f75f00a8430 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 rx=0x7f75e0001840 tx=0x7f75e800a060).stop 2021-11-12T05:49:53.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.213+0000 7f75f575f700 1 -- 172.21.2.105:0/1819664010 shutdown_connections 2021-11-12T05:49:53.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.213+0000 7f75f575f700 1 --2- 172.21.2.105:0/1819664010 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f75d4053640 0x7f75d4055b00 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:53.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.213+0000 7f75f575f700 1 --2- 172.21.2.105:0/1819664010 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f75f00a7fb0 0x7f75f00a8430 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:53.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.213+0000 7f75f575f700 1 --2- 172.21.2.105:0/1819664010 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f75f0063370 0x7f75f015aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:53.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.213+0000 7f75f575f700 1 --2- 172.21.2.105:0/1819664010 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f75d00037d0 0x7f75f0144d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:53.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.213+0000 7f75f575f700 1 -- 172.21.2.105:0/1819664010 >> 172.21.2.105:0/1819664010 conn(0x7f75f00b5370 msgr2=0x7f75f00b31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:53.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.213+0000 7f75f575f700 1 -- 172.21.2.105:0/1819664010 shutdown_connections 2021-11-12T05:49:53.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.213+0000 7f75f575f700 1 -- 172.21.2.105:0/1819664010 wait complete. 2021-11-12T05:49:53.220 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 71 2021-11-12T05:49:53.223 INFO:tasks.ceph.mds.a:Restarting daemon 2021-11-12T05:49:53.224 INFO:tasks.ceph.mds.a:Stopping old one... 2021-11-12T05:49:53.224 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-12T05:49:53.224 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T05:49:53.225 INFO:tasks.ceph.mds.b:Restarting daemon 2021-11-12T05:49:53.225 INFO:tasks.ceph.mds.b:Stopping old one... 2021-11-12T05:49:53.225 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-12T05:49:53.225 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T05:49:53.229 INFO:tasks.ceph.mds.a:Stopped 2021-11-12T05:49:53.230 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-11-12T05:49:53.231 INFO:tasks.ceph.mds.b:Stopped 2021-11-12T05:49:53.231 DEBUG:teuthology.orchestra.run.gibba015:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-11-12T05:49:53.233 INFO:tasks.ceph.mds.a:Started 2021-11-12T05:49:53.234 DEBUG:teuthology.parallel:result is None 2021-11-12T05:49:53.266 INFO:tasks.ceph.mds.a.gibba005.stdout:starting mds.a at 2021-11-12T05:49:53.276 INFO:tasks.ceph.mds.b:Started 2021-11-12T05:49:53.276 DEBUG:teuthology.parallel:result is None 2021-11-12T05:49:53.277 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2021-11-12T05:49:53.313 INFO:tasks.ceph.mds.b.gibba015.stdout:starting mds.b at 2021-11-12T05:49:53.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.341+0000 7ff6191c9700 1 Processor -- start 2021-11-12T05:49:53.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.341+0000 7ff6191c9700 1 -- start start 2021-11-12T05:49:53.350 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.341+0000 7ff6191c9700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff614062ac0 0x7ff6140b6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:53.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.341+0000 7ff6191c9700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6140b6570 con 0x7ff6140b0130 2021-11-12T05:49:53.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.341+0000 7ff6191c9700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6140b56a0 con 0x7ff61413ef20 2021-11-12T05:49:53.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.341+0000 7ff6191c9700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6140b5940 con 0x7ff614062ac0 2021-11-12T05:49:53.351 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.341+0000 7ff61259c700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7ff6140b0130 0x7ff614138c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34942/0 (socket says 172.21.2.105:34942) 2021-11-12T05:49:53.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.341+0000 7ff61259c700 1 -- 172.21.2.105:0/1255183016 learned_addr learned my addr 172.21.2.105:0/1255183016 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:53.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.341+0000 7ff612d9d700 1 --2- 172.21.2.105:0/1255183016 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff614062ac0 0x7ff6140b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:53.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.341+0000 7ff611d9b700 1 -- 172.21.2.105:0/1255183016 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2278914235 0 0) 0x7ff6140b6570 con 0x7ff6140b0130 2021-11-12T05:49:53.352 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.341+0000 7ff611d9b700 1 -- 172.21.2.105:0/1255183016 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5f4003260 con 0x7ff6140b0130 2021-11-12T05:49:53.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.341+0000 7ff611d9b700 1 -- 172.21.2.105:0/1255183016 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2568889027 0 0) 0x7ff5f4003260 con 0x7ff6140b0130 2021-11-12T05:49:53.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.341+0000 7ff611d9b700 1 -- 172.21.2.105:0/1255183016 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff614062ac0 msgr2=0x7ff6140b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:53.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.341+0000 7ff611d9b700 1 --2- 172.21.2.105:0/1255183016 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff614062ac0 0x7ff6140b6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:53.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.341+0000 7ff611d9b700 1 -- 172.21.2.105:0/1255183016 >> v1:172.21.2.115:6789/0 conn(0x7ff61413ef20 legacy=0x7ff6140ae740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:53.353 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.341+0000 7ff611d9b700 1 -- 172.21.2.105:0/1255183016 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6140b5be0 con 0x7ff6140b0130 2021-11-12T05:49:53.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.341+0000 7ff611d9b700 1 -- 172.21.2.105:0/1255183016 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7ff604001660 con 0x7ff6140b0130 2021-11-12T05:49:53.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.341+0000 7ff611d9b700 1 -- 172.21.2.105:0/1255183016 >> v1:172.21.2.105:6789/0 conn(0x7ff6140b0130 legacy=0x7ff614138c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:53.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.341+0000 7ff611d9b700 1 --2- 172.21.2.105:0/1255183016 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff614062ac0 0x7ff5f4003780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:53.354 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.341+0000 7ff611d9b700 1 --2- 172.21.2.105:0/1255183016 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff5f4003d00 0x7ff5f4004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:53.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.341+0000 7ff611d9b700 1 --2- 172.21.2.105:0/1255183016 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff5f40049f0 0x7ff5f4004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:53.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.341+0000 7ff611d9b700 1 -- 172.21.2.105:0/1255183016 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6140b5940 con 0x7ff5f4003d00 2021-11-12T05:49:53.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.341+0000 7ff611d9b700 1 -- 172.21.2.105:0/1255183016 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f400fd60 con 0x7ff5f40049f0 2021-11-12T05:49:53.355 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.341+0000 7ff611d9b700 1 -- 172.21.2.105:0/1255183016 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f400fea0 con 0x7ff614062ac0 2021-11-12T05:49:53.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.341+0000 7ff61259c700 1 --2- 172.21.2.105:0/1255183016 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff5f4003d00 0x7ff5f4004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:53.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.341+0000 7ff61359e700 1 --2- 172.21.2.105:0/1255183016 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff5f40049f0 0x7ff5f4004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:53.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.341+0000 7ff612d9d700 1 --2- 172.21.2.105:0/1255183016 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff614062ac0 0x7ff5f4003780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:53.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.341+0000 7ff61259c700 1 -- 172.21.2.105:0/1255183016 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff614062ac0 msgr2=0x7ff5f4003780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:53.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.341+0000 7ff61259c700 1 --2- 172.21.2.105:0/1255183016 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff614062ac0 0x7ff5f4003780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:53.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.341+0000 7ff61259c700 1 -- 172.21.2.105:0/1255183016 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff5f40049f0 msgr2=0x7ff5f4004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:53.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.341+0000 7ff61259c700 1 --2- 172.21.2.105:0/1255183016 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff5f40049f0 0x7ff5f4004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:53.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.341+0000 7ff61259c700 1 -- 172.21.2.105:0/1255183016 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f4003260 con 0x7ff5f4003d00 2021-11-12T05:49:53.357 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff61259c700 1 --2- 172.21.2.105:0/1255183016 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff5f4003d00 0x7ff5f4004500 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 rx=0x7ff604001370 tx=0x7ff6140b5d70).ready entity=mon.0 client_cookie=ef5c5dc5f4b334e5 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:53.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff611d9b700 1 -- 172.21.2.105:0/1255183016 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff604005ea0 con 0x7ff5f4003d00 2021-11-12T05:49:53.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff611d9b700 1 -- 172.21.2.105:0/1255183016 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60400c990 con 0x7ff5f4003d00 2021-11-12T05:49:53.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff611d9b700 1 -- 172.21.2.105:0/1255183016 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff60400ccf0 con 0x7ff5f4003d00 2021-11-12T05:49:53.358 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff6191c9700 1 -- 172.21.2.105:0/1255183016 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff5f4003d00 msgr2=0x7ff5f4004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:53.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff6191c9700 1 --2- 172.21.2.105:0/1255183016 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff5f4003d00 0x7ff5f4004500 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 rx=0x7ff604001370 tx=0x7ff6140b5d70).stop 2021-11-12T05:49:53.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff61359e700 1 -- 172.21.2.105:0/1255183016 reap_dead start 2021-11-12T05:49:53.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff6191c9700 1 -- 172.21.2.105:0/1255183016 shutdown_connections 2021-11-12T05:49:53.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff6191c9700 1 -- 172.21.2.105:0/1255183016 >> 172.21.2.105:0/1255183016 conn(0x7ff61405c490 msgr2=0x7ff61405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:53.359 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff6191c9700 1 -- 172.21.2.105:0/1255183016 shutdown_connections 2021-11-12T05:49:53.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff6191c9700 1 -- 172.21.2.105:0/1255183016 wait complete. 2021-11-12T05:49:53.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff6191c9700 1 Processor -- start 2021-11-12T05:49:53.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff6191c9700 1 -- start start 2021-11-12T05:49:53.360 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff6191c9700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff5f4003d00 0x7ff6140b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:53.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff6191c9700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff6141356a0 0x7ff614142a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:53.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff6191c9700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff614140830 0x7ff61413b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:53.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff6191c9700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61413a8c0 con 0x7ff614140830 2021-11-12T05:49:53.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff6191c9700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff614143cf0 con 0x7ff5f4003d00 2021-11-12T05:49:53.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff6191c9700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff61413b2f0 con 0x7ff6141356a0 2021-11-12T05:49:53.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff612d9d700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff5f4003d00 0x7ff6140b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:53.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff61359e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff614140830 0x7ff61413b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:53.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff612d9d700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff5f4003d00 0x7ff6140b0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3300/0 says I am v2:172.21.2.105:41728/0 (socket says 172.21.2.105:41728) 2021-11-12T05:49:53.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff612d9d700 1 -- 172.21.2.105:0/3093207391 learned_addr learned my addr 172.21.2.105:0/3093207391 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:53.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff61259c700 1 --2- 172.21.2.105:0/3093207391 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff6141356a0 0x7ff614142a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:53.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff61359e700 1 -- 172.21.2.105:0/3093207391 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff6141356a0 msgr2=0x7ff614142a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:53.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff61359e700 1 --2- 172.21.2.105:0/3093207391 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff6141356a0 0x7ff614142a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:53.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff61359e700 1 -- 172.21.2.105:0/3093207391 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff5f4003d00 msgr2=0x7ff6140b0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:53.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff61359e700 1 --2- 172.21.2.105:0/3093207391 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff5f4003d00 0x7ff6140b0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:53.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff61359e700 1 -- 172.21.2.105:0/3093207391 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff614143f20 con 0x7ff614140830 2021-11-12T05:49:53.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff61259c700 1 --2- 172.21.2.105:0/3093207391 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff6141356a0 0x7ff614142a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:49:53.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff61359e700 1 --2- 172.21.2.105:0/3093207391 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff614140830 0x7ff61413b720 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 rx=0x7ff61413ab60 tx=0x7ff60c009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:53.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff60bfff700 1 -- 172.21.2.105:0/3093207391 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff60c003220 con 0x7ff614140830 2021-11-12T05:49:53.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff60bfff700 1 -- 172.21.2.105:0/3093207391 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60c003380 con 0x7ff614140830 2021-11-12T05:49:53.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff6191c9700 1 -- 172.21.2.105:0/3093207391 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff614142f10 con 0x7ff614140830 2021-11-12T05:49:53.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff60bfff700 1 -- 172.21.2.105:0/3093207391 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff60c001770 con 0x7ff614140830 2021-11-12T05:49:53.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff6191c9700 1 -- 172.21.2.105:0/3093207391 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff61413bc10 con 0x7ff614140830 2021-11-12T05:49:53.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff6191c9700 1 -- 172.21.2.105:0/3093207391 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff61413b480 con 0x7ff614140830 2021-11-12T05:49:53.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff60bfff700 1 -- 172.21.2.105:0/3093207391 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff60c01c060 con 0x7ff614140830 2021-11-12T05:49:53.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff60bfff700 1 --2- 172.21.2.105:0/3093207391 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff5f80536a0 0x7ff5f8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:53.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff60bfff700 1 -- 172.21.2.105:0/3093207391 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5682+0+0 (secure 0 0 0) 0x7ff60c06b270 con 0x7ff614140830 2021-11-12T05:49:53.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff612d9d700 1 --2- 172.21.2.105:0/3093207391 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff5f80536a0 0x7ff5f8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:53.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.345+0000 7ff612d9d700 1 --2- 172.21.2.105:0/3093207391 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff5f80536a0 0x7ff5f8055b60 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7ff5fc00b000 tx=0x7ff5fc006df0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:53.367 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.349+0000 7ff60bfff700 1 -- 172.21.2.105:0/3093207391 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff61413b480 con 0x7ff614140830 2021-11-12T05:49:53.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:53.441+0000 7ff6191c9700 1 -- 172.21.2.105:0/3093207391 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7ff61413b480 con 0x7ff614140830 2021-11-12T05:49:54.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.309+0000 7ff60bfff700 1 -- 172.21.2.105:0/3093207391 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v151) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff61413b480 con 0x7ff614140830 2021-11-12T05:49:54.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.313+0000 7ff6191c9700 1 -- 172.21.2.105:0/3093207391 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff5f80536a0 msgr2=0x7ff5f8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:54.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.313+0000 7ff6191c9700 1 --2- 172.21.2.105:0/3093207391 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff5f80536a0 0x7ff5f8055b60 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7ff5fc00b000 tx=0x7ff5fc006df0).stop 2021-11-12T05:49:54.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.313+0000 7ff6191c9700 1 -- 172.21.2.105:0/3093207391 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff614140830 msgr2=0x7ff61413b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:54.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.313+0000 7ff6191c9700 1 --2- 172.21.2.105:0/3093207391 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff614140830 0x7ff61413b720 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 rx=0x7ff61413ab60 tx=0x7ff60c009040).stop 2021-11-12T05:49:54.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.313+0000 7ff6191c9700 1 -- 172.21.2.105:0/3093207391 shutdown_connections 2021-11-12T05:49:54.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.313+0000 7ff6191c9700 1 --2- 172.21.2.105:0/3093207391 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff5f80536a0 0x7ff5f8055b60 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:54.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.313+0000 7ff6191c9700 1 --2- 172.21.2.105:0/3093207391 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff614140830 0x7ff61413b720 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:54.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.313+0000 7ff6191c9700 1 --2- 172.21.2.105:0/3093207391 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff6141356a0 0x7ff614142a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:54.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.313+0000 7ff6191c9700 1 --2- 172.21.2.105:0/3093207391 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff5f4003d00 0x7ff6140b0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:54.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.313+0000 7ff6191c9700 1 -- 172.21.2.105:0/3093207391 >> 172.21.2.105:0/3093207391 conn(0x7ff61405c490 msgr2=0x7ff614144c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:54.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.313+0000 7ff6191c9700 1 -- 172.21.2.105:0/3093207391 shutdown_connections 2021-11-12T05:49:54.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.313+0000 7ff6191c9700 1 -- 172.21.2.105:0/3093207391 wait complete. 2021-11-12T05:49:54.321 INFO:teuthology.orchestra.run.gibba005.stderr: removed all blacklist entries 2021-11-12T05:49:54.325 INFO:tasks.cephfs.cephfs_test_case:['0', '1', '2'] 2021-11-12T05:49:54.326 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2021-11-12T05:49:54.380 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7fade2a76700 1 Processor -- start 2021-11-12T05:49:54.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7fade2a76700 1 -- start start 2021-11-12T05:49:54.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7fade2a76700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7faddc130a80 0x7faddc062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:54.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7fade2a76700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faddc0b0d50 con 0x7faddc0626b0 2021-11-12T05:49:54.381 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7fade2a76700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faddc0ad380 con 0x7faddc0af750 2021-11-12T05:49:54.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7fade2a76700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faddc0ae190 con 0x7faddc130a80 2021-11-12T05:49:54.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7fade0812700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7faddc0626b0 0x7faddc130370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34960/0 (socket says 172.21.2.105:34960) 2021-11-12T05:49:54.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7fade0812700 1 -- 172.21.2.105:0/1871220207 learned_addr learned my addr 172.21.2.105:0/1871220207 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:54.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7faddb7fe700 1 -- 172.21.2.105:0/1871220207 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3922061899 0 0) 0x7faddc0b0d50 con 0x7faddc0626b0 2021-11-12T05:49:54.382 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7faddb7fe700 1 -- 172.21.2.105:0/1871220207 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadbc003260 con 0x7faddc0626b0 2021-11-12T05:49:54.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7fade1013700 1 --2- 172.21.2.105:0/1871220207 >> v2:172.21.2.115:3300/0 conn(0x7faddc130a80 0x7faddc062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:54.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7faddb7fe700 1 -- 172.21.2.105:0/1871220207 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4039784150 0 0) 0x7fadbc003260 con 0x7faddc0626b0 2021-11-12T05:49:54.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7faddb7fe700 1 -- 172.21.2.105:0/1871220207 >> v2:172.21.2.115:3300/0 conn(0x7faddc130a80 msgr2=0x7faddc062a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:54.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7faddb7fe700 1 --2- 172.21.2.105:0/1871220207 >> v2:172.21.2.115:3300/0 conn(0x7faddc130a80 0x7faddc062a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:54.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7faddb7fe700 1 -- 172.21.2.105:0/1871220207 >> v1:172.21.2.115:6789/0 conn(0x7faddc0af750 legacy=0x7faddc1474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:54.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7faddb7fe700 1 -- 172.21.2.105:0/1871220207 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faddc0ae2d0 con 0x7faddc0626b0 2021-11-12T05:49:54.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7faddb7fe700 1 -- 172.21.2.105:0/1871220207 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fadcc001660 con 0x7faddc0626b0 2021-11-12T05:49:54.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7faddb7fe700 1 -- 172.21.2.105:0/1871220207 >> v1:172.21.2.105:6789/0 conn(0x7faddc0626b0 legacy=0x7faddc130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:54.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7faddb7fe700 1 --2- 172.21.2.105:0/1871220207 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fadbc003820 0x7fadbc003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:54.390 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7faddb7fe700 1 --2- 172.21.2.105:0/1871220207 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fadbc004500 0x7fadbc004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:54.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7faddb7fe700 1 --2- 172.21.2.105:0/1871220207 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fadbc004f70 0x7fadbc00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:54.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7faddb7fe700 1 -- 172.21.2.105:0/1871220207 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faddc0ae190 con 0x7fadbc003820 2021-11-12T05:49:54.391 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7faddb7fe700 1 -- 172.21.2.105:0/1871220207 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc00be50 con 0x7fadbc004500 2021-11-12T05:49:54.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7faddb7fe700 1 -- 172.21.2.105:0/1871220207 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc00c010 con 0x7fadbc004f70 2021-11-12T05:49:54.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7fade0812700 1 --2- 172.21.2.105:0/1871220207 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fadbc003820 0x7fadbc003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:54.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7fade0812700 1 -- 172.21.2.105:0/1871220207 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fadbc004f70 msgr2=0x7fadbc00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:54.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7fade0812700 1 --2- 172.21.2.105:0/1871220207 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fadbc004f70 0x7fadbc00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:54.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7faddbfff700 1 --2- 172.21.2.105:0/1871220207 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fadbc004500 0x7fadbc004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:54.393 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7fade0812700 1 -- 172.21.2.105:0/1871220207 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fadbc004500 msgr2=0x7fadbc004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:54.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7fade0812700 1 --2- 172.21.2.105:0/1871220207 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fadbc004500 0x7fadbc004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:54.394 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7fade0812700 1 -- 172.21.2.105:0/1871220207 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadbc003260 con 0x7fadbc003820 2021-11-12T05:49:54.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7fade1013700 1 -- 172.21.2.105:0/1871220207 reap_dead start 2021-11-12T05:49:54.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7faddbfff700 1 --2- 172.21.2.105:0/1871220207 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fadbc004500 0x7fadbc004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:49:54.395 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7fade0812700 1 --2- 172.21.2.105:0/1871220207 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fadbc003820 0x7fadbc003c20 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 rx=0x7faddc05d1f0 tx=0x7faddc0ae8e0).ready entity=mon.0 client_cookie=543232158624d7ad server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:54.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7faddb7fe700 1 -- 172.21.2.105:0/1871220207 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadcc0070d0 con 0x7fadbc003820 2021-11-12T05:49:54.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7faddb7fe700 1 -- 172.21.2.105:0/1871220207 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadcc007230 con 0x7fadbc003820 2021-11-12T05:49:54.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7faddb7fe700 1 -- 172.21.2.105:0/1871220207 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadcc00c8f0 con 0x7fadbc003820 2021-11-12T05:49:54.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7fade2a76700 1 -- 172.21.2.105:0/1871220207 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fadbc003820 msgr2=0x7fadbc003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:54.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7fade2a76700 1 --2- 172.21.2.105:0/1871220207 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fadbc003820 0x7fadbc003c20 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 rx=0x7faddc05d1f0 tx=0x7faddc0ae8e0).stop 2021-11-12T05:49:54.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7fade2a76700 1 -- 172.21.2.105:0/1871220207 shutdown_connections 2021-11-12T05:49:54.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7fade2a76700 1 --2- 172.21.2.105:0/1871220207 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fadbc003820 0x7fadbc003c20 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:54.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7fade2a76700 1 -- 172.21.2.105:0/1871220207 >> 172.21.2.105:0/1871220207 conn(0x7faddc0b5320 msgr2=0x7faddc0b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:54.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7fade2a76700 1 -- 172.21.2.105:0/1871220207 shutdown_connections 2021-11-12T05:49:54.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.377+0000 7fade2a76700 1 -- 172.21.2.105:0/1871220207 wait complete. 2021-11-12T05:49:54.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.381+0000 7fade2a76700 1 Processor -- start 2021-11-12T05:49:54.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.381+0000 7fade2a76700 1 -- start start 2021-11-12T05:49:54.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.381+0000 7fade2a76700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fadbc003820 0x7faddc12e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:54.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.381+0000 7fade2a76700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faddc1310d0 0x7faddc1497e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:54.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.381+0000 7fade2a76700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7faddc149cd0 0x7faddc14a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:54.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.381+0000 7fade2a76700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faddc14a640 con 0x7faddc1310d0 2021-11-12T05:49:54.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.381+0000 7fade2a76700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faddc066650 con 0x7faddc149cd0 2021-11-12T05:49:54.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.381+0000 7fade2a76700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faddc0668f0 con 0x7fadbc003820 2021-11-12T05:49:54.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.381+0000 7faddbfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faddc1310d0 0x7faddc1497e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:54.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.381+0000 7faddbfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faddc1310d0 0x7faddc1497e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52808/0 (socket says 172.21.2.105:52808) 2021-11-12T05:49:54.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.381+0000 7faddbfff700 1 -- 172.21.2.105:0/1781589499 learned_addr learned my addr 172.21.2.105:0/1781589499 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:54.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.381+0000 7faddbfff700 1 -- 172.21.2.105:0/1781589499 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fadbc003820 msgr2=0x7faddc12e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:54.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.381+0000 7faddbfff700 1 --2- 172.21.2.105:0/1781589499 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fadbc003820 0x7faddc12e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:54.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.381+0000 7faddbfff700 1 -- 172.21.2.105:0/1781589499 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7faddc149cd0 msgr2=0x7faddc14a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:54.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.381+0000 7faddbfff700 1 --2- 172.21.2.105:0/1781589499 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7faddc149cd0 0x7faddc14a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:54.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.381+0000 7faddbfff700 1 -- 172.21.2.105:0/1781589499 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faddc066b90 con 0x7faddc1310d0 2021-11-12T05:49:54.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.381+0000 7faddbfff700 1 --2- 172.21.2.105:0/1781589499 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faddc1310d0 0x7faddc1497e0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 rx=0x7fadc4008000 tx=0x7fadc4009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:54.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.381+0000 7fadd9ffb700 1 -- 172.21.2.105:0/1781589499 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadc4012410 con 0x7faddc1310d0 2021-11-12T05:49:54.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.381+0000 7fadd9ffb700 1 -- 172.21.2.105:0/1781589499 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc4000e90 con 0x7faddc1310d0 2021-11-12T05:49:54.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.381+0000 7fadd9ffb700 1 -- 172.21.2.105:0/1781589499 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadc40127a0 con 0x7faddc1310d0 2021-11-12T05:49:54.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.381+0000 7fade2a76700 1 -- 172.21.2.105:0/1781589499 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faddc063b30 con 0x7faddc1310d0 2021-11-12T05:49:54.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.381+0000 7fade2a76700 1 -- 172.21.2.105:0/1781589499 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faddc14b720 con 0x7faddc1310d0 2021-11-12T05:49:54.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.381+0000 7fade2a76700 1 -- 172.21.2.105:0/1781589499 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faddc062a90 con 0x7faddc1310d0 2021-11-12T05:49:54.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.381+0000 7fadd9ffb700 1 -- 172.21.2.105:0/1781589499 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fadc4019030 con 0x7faddc1310d0 2021-11-12T05:49:54.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.381+0000 7fadd9ffb700 1 --2- 172.21.2.105:0/1781589499 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fadc00536f0 0x7fadc0055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:54.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.381+0000 7fadd9ffb700 1 -- 172.21.2.105:0/1781589499 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fadc406ada0 con 0x7faddc1310d0 2021-11-12T05:49:54.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.381+0000 7fade0812700 1 --2- 172.21.2.105:0/1781589499 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fadc00536f0 0x7fadc0055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:54.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.381+0000 7fade0812700 1 --2- 172.21.2.105:0/1781589499 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fadc00536f0 0x7fadc0055bb0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7faddc05d1f0 tx=0x7fadcc013000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:54.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.385+0000 7fadd9ffb700 1 -- 172.21.2.105:0/1781589499 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fadc4041fd0 con 0x7faddc1310d0 2021-11-12T05:49:54.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.497+0000 7fade2a76700 1 -- 172.21.2.105:0/1781589499 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7faddc057350 con 0x7faddc1310d0 2021-11-12T05:49:54.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.497+0000 7fadd9ffb700 1 -- 172.21.2.105:0/1781589499 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v46) v1 ==== 80+0+4242 (secure 0 0 0) 0x7fadc40455f0 con 0x7faddc1310d0 2021-11-12T05:49:54.502 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:54.503 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:49:54.503 INFO:teuthology.orchestra.run.gibba005.stdout: "auth_dump": [ 2021-11-12T05:49:54.503 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:54.503 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mds.a", 2021-11-12T05:49:54.504 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1hGVLeOhAAX2029T+USC1Um93TSzjxdA==", 2021-11-12T05:49:54.504 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:54.504 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:49:54.504 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:49:54.505 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:49:54.505 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:54.505 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:54.505 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:54.506 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:54.506 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mds.b", 2021-11-12T05:49:54.506 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hiebUAxAAGcjDAGyvecjzagGoRBX8tg==", 2021-11-12T05:49:54.506 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:54.507 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:49:54.507 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:49:54.507 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:49:54.507 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:54.507 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:54.508 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:54.508 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:54.508 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.0", 2021-11-12T05:49:54.508 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1ht05fORAAN2YrbsxBau1FQC4C8Dvb3g==", 2021-11-12T05:49:54.509 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:54.509 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:49:54.509 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:49:54.509 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:54.509 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:54.510 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:54.510 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:54.510 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.1", 2021-11-12T05:49:54.510 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAu/o1hzp1vGhAAQ6u3Npb+yNGlNOUdoHzFZA==", 2021-11-12T05:49:54.511 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:54.511 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:49:54.511 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:49:54.511 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:54.511 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:54.512 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:54.512 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:54.512 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.2", 2021-11-12T05:49:54.512 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAw/o1hHWwOOhAAx7txWG8rbch18+SBnJkfkQ==", 2021-11-12T05:49:54.513 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:54.513 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:49:54.513 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:49:54.513 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:54.513 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:54.514 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:54.514 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:54.514 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.3", 2021-11-12T05:49:54.514 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAz/o1howZpHxAAKgUVxU2tSNZbxW+6OfJF9g==", 2021-11-12T05:49:54.514 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:54.515 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:49:54.515 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:49:54.515 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:54.515 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:54.516 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:54.516 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:54.516 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.4", 2021-11-12T05:49:54.516 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA2/o1humA5KRAAVbO6UYLOBQDq3WiEkkS6xw==", 2021-11-12T05:49:54.516 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:54.517 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:49:54.517 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:49:54.517 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:54.517 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:54.517 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:54.518 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:54.518 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.5", 2021-11-12T05:49:54.518 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA5/o1hALdKDRAAR9nsaDOo9GUgpmBPHVp5HQ==", 2021-11-12T05:49:54.518 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:54.518 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:49:54.519 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:49:54.519 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:54.519 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:54.519 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:54.520 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:54.520 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.6", 2021-11-12T05:49:54.520 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA7/o1hCVP2KhAAHj5SxnJ81mKrJOg2CE2wLQ==", 2021-11-12T05:49:54.520 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:54.520 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:49:54.521 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:49:54.521 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:54.521 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:54.521 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:54.521 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:54.522 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "osd.7", 2021-11-12T05:49:54.522 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQA+/o1hWCEqEBAAv8nF9NeF2Ue5W8Ijj8Skgg==", 2021-11-12T05:49:54.522 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:54.522 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:49:54.523 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:49:54.523 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:54.523 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:54.523 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:54.523 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:54.524 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.0", 2021-11-12T05:49:54.524 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hzEzhCBAATF8giEBtrj13SAr5EJV4TA==", 2021-11-12T05:49:54.524 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:54.524 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:49:54.524 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow r", 2021-11-12T05:49:54.525 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-12T05:49:54.525 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:54.525 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:54.525 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:54.526 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.1", 2021-11-12T05:49:54.526 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hO6zfCxAAae1obagtpsnA9e8FlTExVA==", 2021-11-12T05:49:54.526 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:54.526 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:49:54.526 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow r", 2021-11-12T05:49:54.527 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-12T05:49:54.527 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:54.527 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:54.527 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:54.527 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.2", 2021-11-12T05:49:54.528 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAr/o1hFYDGDhAAyz77VXKtOz86ztJ8FUIvAg==", 2021-11-12T05:49:54.528 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:54.528 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow", 2021-11-12T05:49:54.528 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow r", 2021-11-12T05:49:54.529 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow rw pool=cephfs_data" 2021-11-12T05:49:54.529 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:54.529 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:54.529 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:54.529 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "client.admin", 2021-11-12T05:49:54.530 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1hwdoBHRAAUHHEU3dbyso2BnE/JppV8A==", 2021-11-12T05:49:54.530 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:54.530 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow *", 2021-11-12T05:49:54.531 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr": "allow *", 2021-11-12T05:49:54.531 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow *", 2021-11-12T05:49:54.531 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:54.531 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:54.531 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:54.532 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:54.532 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mgr.x", 2021-11-12T05:49:54.532 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1h6JBaORAAbgxQtCzGNj7MLfgwGd4cWA==", 2021-11-12T05:49:54.532 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:54.532 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow *", 2021-11-12T05:49:54.533 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow profile mgr", 2021-11-12T05:49:54.533 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:54.533 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:54.533 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:54.534 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:54.534 INFO:teuthology.orchestra.run.gibba005.stdout: "entity": "mgr.y", 2021-11-12T05:49:54.535 INFO:teuthology.orchestra.run.gibba005.stdout: "key": "AQAq/o1hwfvvNRAASU7NmYBG/Yb6/ma1/Ew7mw==", 2021-11-12T05:49:54.535 INFO:teuthology.orchestra.run.gibba005.stdout: "caps": { 2021-11-12T05:49:54.535 INFO:teuthology.orchestra.run.gibba005.stdout: "mds": "allow *", 2021-11-12T05:49:54.535 INFO:teuthology.orchestra.run.gibba005.stdout: "mon": "allow profile mgr", 2021-11-12T05:49:54.535 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": "allow *" 2021-11-12T05:49:54.536 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:54.536 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:54.536 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:49:54.536 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:49:54.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.497+0000 7fade2a76700 1 -- 172.21.2.105:0/1781589499 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fadc00536f0 msgr2=0x7fadc0055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:54.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.497+0000 7fade2a76700 1 --2- 172.21.2.105:0/1781589499 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fadc00536f0 0x7fadc0055bb0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7faddc05d1f0 tx=0x7fadcc013000).stop 2021-11-12T05:49:54.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.497+0000 7fade2a76700 1 -- 172.21.2.105:0/1781589499 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faddc1310d0 msgr2=0x7faddc1497e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:54.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.497+0000 7fade2a76700 1 --2- 172.21.2.105:0/1781589499 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faddc1310d0 0x7faddc1497e0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 rx=0x7fadc4008000 tx=0x7fadc4009040).stop 2021-11-12T05:49:54.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.497+0000 7fade2a76700 1 -- 172.21.2.105:0/1781589499 shutdown_connections 2021-11-12T05:49:54.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.497+0000 7fade2a76700 1 --2- 172.21.2.105:0/1781589499 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fadc00536f0 0x7fadc0055bb0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:54.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.497+0000 7fade2a76700 1 --2- 172.21.2.105:0/1781589499 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7faddc149cd0 0x7faddc14a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:54.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.497+0000 7fade2a76700 1 --2- 172.21.2.105:0/1781589499 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faddc1310d0 0x7faddc1497e0 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:54.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.497+0000 7fade2a76700 1 --2- 172.21.2.105:0/1781589499 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fadbc003820 0x7faddc12e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:54.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.497+0000 7fade2a76700 1 -- 172.21.2.105:0/1781589499 >> 172.21.2.105:0/1781589499 conn(0x7faddc0b5320 msgr2=0x7faddc12d540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:54.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.501+0000 7fade2a76700 1 -- 172.21.2.105:0/1781589499 shutdown_connections 2021-11-12T05:49:54.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.501+0000 7fade2a76700 1 -- 172.21.2.105:0/1781589499 wait complete. 2021-11-12T05:49:54.541 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:49:54.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.589+0000 7fd3554d3700 1 Processor -- start 2021-11-12T05:49:54.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.589+0000 7fd3554d3700 1 -- start start 2021-11-12T05:49:54.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.589+0000 7fd3554d3700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd3500b0f80 0x7fd3500a8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:54.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.589+0000 7fd3554d3700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3500b5f90 0x7fd3500b1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:54.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.589+0000 7fd3554d3700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3500b06d0 con 0x7fd3500affa0 2021-11-12T05:49:54.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.589+0000 7fd3554d3700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd35014a980 con 0x7fd3500b0f80 2021-11-12T05:49:54.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.589+0000 7fd3554d3700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3500b0900 con 0x7fd3500b5f90 2021-11-12T05:49:54.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.589+0000 7fd34ffff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd3500b0f80 0x7fd3500a8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:54.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.589+0000 7fd34ffff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd3500b0f80 0x7fd3500a8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52816/0 (socket says 172.21.2.105:52816) 2021-11-12T05:49:54.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.589+0000 7fd34ffff700 1 -- 172.21.2.105:0/1764120047 learned_addr learned my addr 172.21.2.105:0/1764120047 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:54.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.589+0000 7fd34ffff700 1 -- 172.21.2.105:0/1764120047 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3500b5f90 msgr2=0x7fd3500b1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:54.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.589+0000 7fd34ffff700 1 --2- 172.21.2.105:0/1764120047 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3500b5f90 0x7fd3500b1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:54.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.589+0000 7fd34ffff700 1 -- 172.21.2.105:0/1764120047 >> v1:172.21.2.115:6789/0 conn(0x7fd3500affa0 legacy=0x7fd350146a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:54.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.589+0000 7fd34ffff700 1 -- 172.21.2.105:0/1764120047 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd350147120 con 0x7fd3500b0f80 2021-11-12T05:49:54.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.589+0000 7fd34ffff700 1 --2- 172.21.2.105:0/1764120047 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3500b0f80 0x7fd3500a8010 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 rx=0x7fd35005f530 tx=0x7fd340006eb0).ready entity=mon.0 client_cookie=4ec92dc7b895a994 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:54.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.589+0000 7fd34effd700 1 -- 172.21.2.105:0/1764120047 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd34000d570 con 0x7fd3500b0f80 2021-11-12T05:49:54.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.589+0000 7fd34effd700 1 -- 172.21.2.105:0/1764120047 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd340000e90 con 0x7fd3500b0f80 2021-11-12T05:49:54.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.589+0000 7fd34effd700 1 -- 172.21.2.105:0/1764120047 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd34000d8c0 con 0x7fd3500b0f80 2021-11-12T05:49:54.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.589+0000 7fd3554d3700 1 -- 172.21.2.105:0/1764120047 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3500b0f80 msgr2=0x7fd3500a8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:54.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.589+0000 7fd3554d3700 1 --2- 172.21.2.105:0/1764120047 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3500b0f80 0x7fd3500a8010 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 rx=0x7fd35005f530 tx=0x7fd340006eb0).stop 2021-11-12T05:49:54.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.589+0000 7fd3554d3700 1 -- 172.21.2.105:0/1764120047 shutdown_connections 2021-11-12T05:49:54.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.589+0000 7fd3554d3700 1 --2- 172.21.2.105:0/1764120047 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3500b5f90 0x7fd3500b1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:54.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.589+0000 7fd3554d3700 1 --2- 172.21.2.105:0/1764120047 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3500b0f80 0x7fd3500a8010 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:54.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.589+0000 7fd3554d3700 1 -- 172.21.2.105:0/1764120047 >> 172.21.2.105:0/1764120047 conn(0x7fd350062730 msgr2=0x7fd350062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:54.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.589+0000 7fd3554d3700 1 -- 172.21.2.105:0/1764120047 shutdown_connections 2021-11-12T05:49:54.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.589+0000 7fd3554d3700 1 -- 172.21.2.105:0/1764120047 wait complete. 2021-11-12T05:49:54.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.589+0000 7fd3554d3700 1 Processor -- start 2021-11-12T05:49:54.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.589+0000 7fd3554d3700 1 -- start start 2021-11-12T05:49:54.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.593+0000 7fd3554d3700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3500affa0 0x7fd350156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:54.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.593+0000 7fd3554d3700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3500b0f80 0x7fd3500b47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:54.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.593+0000 7fd3554d3700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd3500b5f90 0x7fd3501424a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:54.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.593+0000 7fd3554d3700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3500ab580 con 0x7fd3500b0f80 2021-11-12T05:49:54.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.593+0000 7fd3554d3700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd350157030 con 0x7fd3500b5f90 2021-11-12T05:49:54.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.593+0000 7fd3554d3700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd35014dc70 con 0x7fd3500affa0 2021-11-12T05:49:54.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.593+0000 7fd34f7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3500b0f80 0x7fd3500b47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:54.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.593+0000 7fd34f7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3500b0f80 0x7fd3500b47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52822/0 (socket says 172.21.2.105:52822) 2021-11-12T05:49:54.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.593+0000 7fd34f7fe700 1 -- 172.21.2.105:0/4135361276 learned_addr learned my addr 172.21.2.105:0/4135361276 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:54.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.593+0000 7fd34ffff700 1 --2- 172.21.2.105:0/4135361276 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3500affa0 0x7fd350156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:54.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.593+0000 7fd34f7fe700 1 -- 172.21.2.105:0/4135361276 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3500affa0 msgr2=0x7fd350156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:54.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.593+0000 7fd354cd2700 1 --2- 172.21.2.105:0/4135361276 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd3500b5f90 0x7fd3501424a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:54.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.593+0000 7fd34f7fe700 1 --2- 172.21.2.105:0/4135361276 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3500affa0 0x7fd350156b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:54.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.593+0000 7fd34f7fe700 1 -- 172.21.2.105:0/4135361276 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd3500b5f90 msgr2=0x7fd3501424a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:54.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.593+0000 7fd34f7fe700 1 --2- 172.21.2.105:0/4135361276 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd3500b5f90 0x7fd3501424a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:54.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.593+0000 7fd34f7fe700 1 -- 172.21.2.105:0/4135361276 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34000b1e0 con 0x7fd3500b0f80 2021-11-12T05:49:54.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.593+0000 7fd34ffff700 1 --2- 172.21.2.105:0/4135361276 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3500affa0 0x7fd350156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:49:54.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.593+0000 7fd354cd2700 1 --2- 172.21.2.105:0/4135361276 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd3500b5f90 0x7fd3501424a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:49:54.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.593+0000 7fd34f7fe700 1 --2- 172.21.2.105:0/4135361276 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3500b0f80 0x7fd3500b47b0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 rx=0x7fd3501571c0 tx=0x7fd338006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:54.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.593+0000 7fd34d7fa700 1 -- 172.21.2.105:0/4135361276 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd338013460 con 0x7fd3500b0f80 2021-11-12T05:49:54.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.593+0000 7fd34d7fa700 1 -- 172.21.2.105:0/4135361276 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3380135c0 con 0x7fd3500b0f80 2021-11-12T05:49:54.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.593+0000 7fd3554d3700 1 -- 172.21.2.105:0/4135361276 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3500b4ca0 con 0x7fd3500b0f80 2021-11-12T05:49:54.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.593+0000 7fd3554d3700 1 -- 172.21.2.105:0/4135361276 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3500a9f90 con 0x7fd3500b0f80 2021-11-12T05:49:54.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.593+0000 7fd34d7fa700 1 -- 172.21.2.105:0/4135361276 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd338013920 con 0x7fd3500b0f80 2021-11-12T05:49:54.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.593+0000 7fd3554d3700 1 -- 172.21.2.105:0/4135361276 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3500ab6f0 con 0x7fd3500b0f80 2021-11-12T05:49:54.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.593+0000 7fd34d7fa700 1 -- 172.21.2.105:0/4135361276 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd33801a060 con 0x7fd3500b0f80 2021-11-12T05:49:54.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.593+0000 7fd34d7fa700 1 --2- 172.21.2.105:0/4135361276 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd3340536d0 0x7fd334055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:54.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.593+0000 7fd34d7fa700 1 -- 172.21.2.105:0/4135361276 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fd33806b080 con 0x7fd3500b0f80 2021-11-12T05:49:54.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.593+0000 7fd34ffff700 1 --2- 172.21.2.105:0/4135361276 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd3340536d0 0x7fd334055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:54.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.593+0000 7fd34ffff700 1 --2- 172.21.2.105:0/4135361276 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd3340536d0 0x7fd334055b90 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7fd340017000 tx=0x7fd340015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:54.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.597+0000 7fd34d7fa700 1 -- 172.21.2.105:0/4135361276 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd3500ab6f0 con 0x7fd3500b0f80 2021-11-12T05:49:54.684 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.681+0000 7fd3554d3700 1 -- 172.21.2.105:0/4135361276 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3500ab6c0 con 0x7fd3500b0f80 2021-11-12T05:49:54.685 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.681+0000 7fd34d7fa700 1 -- 172.21.2.105:0/4135361276 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) v1 ==== 74+0+13424 (secure 0 0 0) 0x7fd338018070 con 0x7fd3500b0f80 2021-11-12T05:49:54.686 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:54.686 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":151,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:49:54.300088+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:49:54.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.681+0000 7fd3554d3700 1 -- 172.21.2.105:0/4135361276 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd3340536d0 msgr2=0x7fd334055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:54.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.681+0000 7fd3554d3700 1 --2- 172.21.2.105:0/4135361276 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd3340536d0 0x7fd334055b90 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7fd340017000 tx=0x7fd340015000).stop 2021-11-12T05:49:54.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.681+0000 7fd3554d3700 1 -- 172.21.2.105:0/4135361276 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3500b0f80 msgr2=0x7fd3500b47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:54.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.681+0000 7fd3554d3700 1 --2- 172.21.2.105:0/4135361276 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3500b0f80 0x7fd3500b47b0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 rx=0x7fd3501571c0 tx=0x7fd338006df0).stop 2021-11-12T05:49:54.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.681+0000 7fd3554d3700 1 -- 172.21.2.105:0/4135361276 shutdown_connections 2021-11-12T05:49:54.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.681+0000 7fd3554d3700 1 --2- 172.21.2.105:0/4135361276 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd3340536d0 0x7fd334055b90 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:54.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.681+0000 7fd3554d3700 1 --2- 172.21.2.105:0/4135361276 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd3500b5f90 0x7fd3501424a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:54.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.681+0000 7fd3554d3700 1 --2- 172.21.2.105:0/4135361276 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3500b0f80 0x7fd3500b47b0 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:54.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.681+0000 7fd3554d3700 1 --2- 172.21.2.105:0/4135361276 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3500affa0 0x7fd350156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:54.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.681+0000 7fd3554d3700 1 -- 172.21.2.105:0/4135361276 >> 172.21.2.105:0/4135361276 conn(0x7fd350062730 msgr2=0x7fd350148bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:54.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.681+0000 7fd3554d3700 1 -- 172.21.2.105:0/4135361276 shutdown_connections 2021-11-12T05:49:54.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.681+0000 7fd3554d3700 1 -- 172.21.2.105:0/4135361276 wait complete. 2021-11-12T05:49:54.693 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-11-12T05:49:54.694 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:49:54.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.741+0000 7faf8bee0700 1 Processor -- start 2021-11-12T05:49:54.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.741+0000 7faf8bee0700 1 -- start start 2021-11-12T05:49:54.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.741+0000 7faf8bee0700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7faf840b0520 0x7faf84144890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:54.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.741+0000 7faf8bee0700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf840b1840 con 0x7faf840aca40 2021-11-12T05:49:54.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.741+0000 7faf8bee0700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf840af2b0 con 0x7faf840ace20 2021-11-12T05:49:54.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.741+0000 7faf8bee0700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf840b0990 con 0x7faf840b0520 2021-11-12T05:49:54.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.741+0000 7faf89c7c700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7faf840aca40 0x7faf841473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:34994/0 (socket says 172.21.2.105:34994) 2021-11-12T05:49:54.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.741+0000 7faf89c7c700 1 -- 172.21.2.105:0/2215447677 learned_addr learned my addr 172.21.2.105:0/2215447677 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:54.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.741+0000 7faf8a47d700 1 --2- 172.21.2.105:0/2215447677 >> v2:172.21.2.105:3300/0 conn(0x7faf840b0520 0x7faf84144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:54.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.741+0000 7faf8a47d700 1 -- 172.21.2.105:0/2215447677 >> v1:172.21.2.115:6789/0 conn(0x7faf840ace20 legacy=0x7faf84144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:54.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.741+0000 7faf8a47d700 1 -- 172.21.2.105:0/2215447677 >> v1:172.21.2.105:6789/0 conn(0x7faf840aca40 legacy=0x7faf841473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:54.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.741+0000 7faf8a47d700 1 -- 172.21.2.105:0/2215447677 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf84144d80 con 0x7faf840b0520 2021-11-12T05:49:54.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.741+0000 7faf8a47d700 1 --2- 172.21.2.105:0/2215447677 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faf840b0520 0x7faf84144890 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 rx=0x7faf840611e0 tx=0x7faf7c0091d0).ready entity=mon.0 client_cookie=bcfc94a761177df6 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:54.750 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.741+0000 7faf88c7a700 1 -- 172.21.2.105:0/2215447677 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf7c009ea0 con 0x7faf840b0520 2021-11-12T05:49:54.750 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.741+0000 7faf88c7a700 1 -- 172.21.2.105:0/2215447677 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7c00b860 con 0x7faf840b0520 2021-11-12T05:49:54.750 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.741+0000 7faf88c7a700 1 -- 172.21.2.105:0/2215447677 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf7c00b9d0 con 0x7faf840b0520 2021-11-12T05:49:54.750 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.741+0000 7faf8bee0700 1 -- 172.21.2.105:0/2215447677 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faf840b0520 msgr2=0x7faf84144890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:54.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.741+0000 7faf8bee0700 1 --2- 172.21.2.105:0/2215447677 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faf840b0520 0x7faf84144890 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 rx=0x7faf840611e0 tx=0x7faf7c0091d0).stop 2021-11-12T05:49:54.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.745+0000 7faf8bee0700 1 -- 172.21.2.105:0/2215447677 shutdown_connections 2021-11-12T05:49:54.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.745+0000 7faf8bee0700 1 --2- 172.21.2.105:0/2215447677 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faf840b0520 0x7faf84144890 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:54.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.745+0000 7faf8bee0700 1 -- 172.21.2.105:0/2215447677 >> 172.21.2.105:0/2215447677 conn(0x7faf8405c490 msgr2=0x7faf840b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:54.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.745+0000 7faf8bee0700 1 -- 172.21.2.105:0/2215447677 shutdown_connections 2021-11-12T05:49:54.752 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.745+0000 7faf8bee0700 1 -- 172.21.2.105:0/2215447677 wait complete. 2021-11-12T05:49:54.752 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.745+0000 7faf8bee0700 1 Processor -- start 2021-11-12T05:49:54.752 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.745+0000 7faf8bee0700 1 -- start start 2021-11-12T05:49:54.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.745+0000 7faf8bee0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7faf840aca40 0x7faf84063860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:54.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.745+0000 7faf8bee0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faf840ace20 0x7faf84159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:54.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.745+0000 7faf8bee0700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7faf840b0520 0x7faf8415a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:54.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.745+0000 7faf8bee0700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf84066fe0 con 0x7faf840ace20 2021-11-12T05:49:54.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.745+0000 7faf8bee0700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf840aa2d0 con 0x7faf840b0520 2021-11-12T05:49:54.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.745+0000 7faf8bee0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf84066520 con 0x7faf840aca40 2021-11-12T05:49:54.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.745+0000 7faf8947b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faf840ace20 0x7faf84159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:54.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.745+0000 7faf8947b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faf840ace20 0x7faf84159c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52840/0 (socket says 172.21.2.105:52840) 2021-11-12T05:49:54.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.745+0000 7faf8947b700 1 -- 172.21.2.105:0/2640910296 learned_addr learned my addr 172.21.2.105:0/2640910296 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:54.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.745+0000 7faf8947b700 1 -- 172.21.2.105:0/2640910296 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7faf840aca40 msgr2=0x7faf84063860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:54.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.745+0000 7faf8947b700 1 --2- 172.21.2.105:0/2640910296 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7faf840aca40 0x7faf84063860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:54.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.745+0000 7faf8947b700 1 -- 172.21.2.105:0/2640910296 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7faf840b0520 msgr2=0x7faf8415a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:54.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.745+0000 7faf8947b700 1 --2- 172.21.2.105:0/2640910296 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7faf840b0520 0x7faf8415a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:54.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.745+0000 7faf8947b700 1 -- 172.21.2.105:0/2640910296 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7c009470 con 0x7faf840ace20 2021-11-12T05:49:54.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.745+0000 7faf8947b700 1 --2- 172.21.2.105:0/2640910296 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faf840ace20 0x7faf84159c60 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 rx=0x7faf80002f90 tx=0x7faf80006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:54.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.745+0000 7faf76ffd700 1 -- 172.21.2.105:0/2640910296 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf80013460 con 0x7faf840ace20 2021-11-12T05:49:54.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.745+0000 7faf76ffd700 1 -- 172.21.2.105:0/2640910296 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf800135c0 con 0x7faf840ace20 2021-11-12T05:49:54.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.745+0000 7faf76ffd700 1 -- 172.21.2.105:0/2640910296 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf80013920 con 0x7faf840ace20 2021-11-12T05:49:54.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.745+0000 7faf8bee0700 1 -- 172.21.2.105:0/2640910296 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf84066800 con 0x7faf840ace20 2021-11-12T05:49:54.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.745+0000 7faf8bee0700 1 -- 172.21.2.105:0/2640910296 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf8415a860 con 0x7faf840ace20 2021-11-12T05:49:54.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.745+0000 7faf8bee0700 1 -- 172.21.2.105:0/2640910296 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf84066e20 con 0x7faf840ace20 2021-11-12T05:49:54.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.745+0000 7faf76ffd700 1 -- 172.21.2.105:0/2640910296 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7faf8001a060 con 0x7faf840ace20 2021-11-12T05:49:54.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.745+0000 7faf76ffd700 1 --2- 172.21.2.105:0/2640910296 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7faf640536f0 0x7faf64055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:54.759 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.745+0000 7faf76ffd700 1 -- 172.21.2.105:0/2640910296 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5596+0+0 (secure 0 0 0) 0x7faf8006b230 con 0x7faf840ace20 2021-11-12T05:49:54.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.745+0000 7faf89c7c700 1 --2- 172.21.2.105:0/2640910296 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7faf640536f0 0x7faf64055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:54.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.749+0000 7faf89c7c700 1 --2- 172.21.2.105:0/2640910296 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7faf640536f0 0x7faf64055bb0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7faf84061140 tx=0x7faf78007800).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:54.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.749+0000 7faf76ffd700 1 -- 172.21.2.105:0/2640910296 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faf80042460 con 0x7faf840ace20 2021-11-12T05:49:54.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.829+0000 7faf8bee0700 1 -- 172.21.2.105:0/2640910296 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7faf840671e0 con 0x7faf840ace20 2021-11-12T05:49:54.835 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.829+0000 7faf76ffd700 1 -- 172.21.2.105:0/2640910296 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v151) v1 ==== 110+0+10 (secure 0 0 0) 0x7faf80045a80 con 0x7faf840ace20 2021-11-12T05:49:54.835 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:49:54.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.833+0000 7faf8bee0700 1 -- 172.21.2.105:0/2640910296 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7faf640536f0 msgr2=0x7faf64055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:54.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.833+0000 7faf8bee0700 1 --2- 172.21.2.105:0/2640910296 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7faf640536f0 0x7faf64055bb0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7faf84061140 tx=0x7faf78007800).stop 2021-11-12T05:49:54.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.833+0000 7faf8bee0700 1 -- 172.21.2.105:0/2640910296 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faf840ace20 msgr2=0x7faf84159c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:54.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.833+0000 7faf8bee0700 1 --2- 172.21.2.105:0/2640910296 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faf840ace20 0x7faf84159c60 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 rx=0x7faf80002f90 tx=0x7faf80006df0).stop 2021-11-12T05:49:54.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.833+0000 7faf8bee0700 1 -- 172.21.2.105:0/2640910296 shutdown_connections 2021-11-12T05:49:54.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.833+0000 7faf8bee0700 1 --2- 172.21.2.105:0/2640910296 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7faf640536f0 0x7faf64055bb0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:54.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.833+0000 7faf8bee0700 1 --2- 172.21.2.105:0/2640910296 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7faf840b0520 0x7faf8415a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:54.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.833+0000 7faf8bee0700 1 --2- 172.21.2.105:0/2640910296 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7faf840ace20 0x7faf84159c60 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:54.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.833+0000 7faf8bee0700 1 --2- 172.21.2.105:0/2640910296 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7faf840aca40 0x7faf84063860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:54.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.833+0000 7faf8bee0700 1 -- 172.21.2.105:0/2640910296 >> 172.21.2.105:0/2640910296 conn(0x7faf8405c490 msgr2=0x7faf84144390 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:54.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.833+0000 7faf8bee0700 1 -- 172.21.2.105:0/2640910296 shutdown_connections 2021-11-12T05:49:54.838 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.833+0000 7faf8bee0700 1 -- 172.21.2.105:0/2640910296 wait complete. 2021-11-12T05:49:54.842 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:49:54.895 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab54e89700 1 Processor -- start 2021-11-12T05:49:54.895 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab54e89700 1 -- start start 2021-11-12T05:49:54.897 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab54e89700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fab500aca40 0x7fab500ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:54.897 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab54e89700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fab500b0520 0x7fab501473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:54.897 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab54e89700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fab501478b0 0x7fab50144180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:54.898 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab54e89700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab50147d40 con 0x7fab500b0520 2021-11-12T05:49:54.898 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab54e89700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab500b1840 con 0x7fab500aca40 2021-11-12T05:49:54.898 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab54e89700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab500b09d0 con 0x7fab501478b0 2021-11-12T05:49:54.898 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab4dd9b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fab500b0520 0x7fab501473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:54.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab4dd9b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fab500b0520 0x7fab501473c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52844/0 (socket says 172.21.2.105:52844) 2021-11-12T05:49:54.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab4dd9b700 1 -- 172.21.2.105:0/2913610658 learned_addr learned my addr 172.21.2.105:0/2913610658 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:54.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab4dd9b700 1 -- 172.21.2.105:0/2913610658 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fab501478b0 msgr2=0x7fab50144180 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:49:54.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab4dd9b700 1 --2- 172.21.2.105:0/2913610658 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fab501478b0 0x7fab50144180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:54.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab4dd9b700 1 -- 172.21.2.105:0/2913610658 >> v2:172.21.2.115:3300/0 conn(0x7fab500aca40 msgr2=0x7fab500ace20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:49:54.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab4dd9b700 1 --2- 172.21.2.105:0/2913610658 >> v2:172.21.2.115:3300/0 conn(0x7fab500aca40 0x7fab500ace20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:54.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab4dd9b700 1 -- 172.21.2.105:0/2913610658 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab500af2b0 con 0x7fab500b0520 2021-11-12T05:49:54.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab4dd9b700 1 --2- 172.21.2.105:0/2913610658 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fab500b0520 0x7fab501473c0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 rx=0x7fab500ae6a0 tx=0x7fab40006eb0).ready entity=mon.0 client_cookie=9fbcb82abecdacd3 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:54.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab4d59a700 1 -- 172.21.2.105:0/2913610658 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab4000d570 con 0x7fab500b0520 2021-11-12T05:49:54.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab4d59a700 1 -- 172.21.2.105:0/2913610658 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab40000e90 con 0x7fab500b0520 2021-11-12T05:49:54.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab4d59a700 1 -- 172.21.2.105:0/2913610658 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab4000d8c0 con 0x7fab500b0520 2021-11-12T05:49:54.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab54e89700 1 -- 172.21.2.105:0/2913610658 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fab500b0520 msgr2=0x7fab501473c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:54.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab54e89700 1 --2- 172.21.2.105:0/2913610658 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fab500b0520 0x7fab501473c0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 rx=0x7fab500ae6a0 tx=0x7fab40006eb0).stop 2021-11-12T05:49:54.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab54e89700 1 -- 172.21.2.105:0/2913610658 shutdown_connections 2021-11-12T05:49:54.902 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab54e89700 1 --2- 172.21.2.105:0/2913610658 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fab501478b0 0x7fab50144180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:54.902 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab54e89700 1 --2- 172.21.2.105:0/2913610658 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fab500b0520 0x7fab501473c0 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:54.902 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab54e89700 1 --2- 172.21.2.105:0/2913610658 >> v2:172.21.2.115:3300/0 conn(0x7fab500aca40 0x7fab500ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:54.902 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab54e89700 1 -- 172.21.2.105:0/2913610658 >> 172.21.2.105:0/2913610658 conn(0x7fab5005c490 msgr2=0x7fab500b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:54.902 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab54e89700 1 -- 172.21.2.105:0/2913610658 shutdown_connections 2021-11-12T05:49:54.903 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab54e89700 1 -- 172.21.2.105:0/2913610658 wait complete. 2021-11-12T05:49:54.905 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab54e89700 1 Processor -- start 2021-11-12T05:49:54.906 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab54e89700 1 -- start start 2021-11-12T05:49:54.906 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab54e89700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fab500aca40 0x7fab50063220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:54.906 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab54e89700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fab500b0520 0x7fab50066cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:54.906 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab54e89700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fab501478b0 0x7fab50159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:54.907 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab54e89700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab501578b0 con 0x7fab501478b0 2021-11-12T05:49:54.907 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab54e89700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab500668c0 con 0x7fab500aca40 2021-11-12T05:49:54.907 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab54e89700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab50062490 con 0x7fab500b0520 2021-11-12T05:49:54.907 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab4ed9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fab501478b0 0x7fab50159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:54.907 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab4ed9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fab501478b0 0x7fab50159f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52854/0 (socket says 172.21.2.105:52854) 2021-11-12T05:49:54.908 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.893+0000 7fab4ed9d700 1 -- 172.21.2.105:0/4126838447 learned_addr learned my addr 172.21.2.105:0/4126838447 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:54.908 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.897+0000 7fab4ed9d700 1 -- 172.21.2.105:0/4126838447 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fab500b0520 msgr2=0x7fab50066cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:54.908 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.897+0000 7fab4ed9d700 1 --2- 172.21.2.105:0/4126838447 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fab500b0520 0x7fab50066cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:54.909 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.897+0000 7fab4ed9d700 1 -- 172.21.2.105:0/4126838447 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fab500aca40 msgr2=0x7fab50063220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:54.909 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.897+0000 7fab4ed9d700 1 --2- 172.21.2.105:0/4126838447 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fab500aca40 0x7fab50063220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:54.909 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.897+0000 7fab4ed9d700 1 -- 172.21.2.105:0/4126838447 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4000b1e0 con 0x7fab501478b0 2021-11-12T05:49:54.909 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.897+0000 7fab4ed9d700 1 --2- 172.21.2.105:0/4126838447 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fab501478b0 0x7fab50159f70 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 rx=0x7fab48001250 tx=0x7fab480090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:54.909 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.897+0000 7fab477fe700 1 -- 172.21.2.105:0/4126838447 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab480014e0 con 0x7fab501478b0 2021-11-12T05:49:54.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.897+0000 7fab477fe700 1 -- 172.21.2.105:0/4126838447 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab48001640 con 0x7fab501478b0 2021-11-12T05:49:54.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.897+0000 7fab477fe700 1 -- 172.21.2.105:0/4126838447 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab480019a0 con 0x7fab501478b0 2021-11-12T05:49:54.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.897+0000 7fab54e89700 1 -- 172.21.2.105:0/4126838447 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab50062730 con 0x7fab501478b0 2021-11-12T05:49:54.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.897+0000 7fab54e89700 1 -- 172.21.2.105:0/4126838447 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab50063710 con 0x7fab501478b0 2021-11-12T05:49:54.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.897+0000 7fab54e89700 1 -- 172.21.2.105:0/4126838447 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab50066a00 con 0x7fab501478b0 2021-11-12T05:49:54.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.897+0000 7fab477fe700 1 -- 172.21.2.105:0/4126838447 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fab48018030 con 0x7fab501478b0 2021-11-12T05:49:54.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.897+0000 7fab477fe700 1 --2- 172.21.2.105:0/4126838447 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fab340535d0 0x7fab34055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:54.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.897+0000 7fab477fe700 1 -- 172.21.2.105:0/4126838447 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5596+0+0 (secure 0 0 0) 0x7fab4806b190 con 0x7fab501478b0 2021-11-12T05:49:54.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.897+0000 7fab4e59c700 1 --2- 172.21.2.105:0/4126838447 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fab340535d0 0x7fab34055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:54.912 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.897+0000 7fab4e59c700 1 --2- 172.21.2.105:0/4126838447 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fab340535d0 0x7fab34055a90 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7fab38002fb0 tx=0x7fab380069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:54.912 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.901+0000 7fab477fe700 1 -- 172.21.2.105:0/4126838447 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fab48042470 con 0x7fab501478b0 2021-11-12T05:49:54.985 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.981+0000 7fab54e89700 1 -- 172.21.2.105:0/4126838447 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fab5005f280 con 0x7fab501478b0 2021-11-12T05:49:54.986 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.981+0000 7fab477fe700 1 -- 172.21.2.105:0/4126838447 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v151) v1 ==== 92+0+10 (secure 0 0 0) 0x7fab48045a90 con 0x7fab501478b0 2021-11-12T05:49:54.986 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:49:54.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.981+0000 7fab54e89700 1 -- 172.21.2.105:0/4126838447 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fab340535d0 msgr2=0x7fab34055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:54.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.981+0000 7fab54e89700 1 --2- 172.21.2.105:0/4126838447 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fab340535d0 0x7fab34055a90 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7fab38002fb0 tx=0x7fab380069b0).stop 2021-11-12T05:49:54.987 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.981+0000 7fab54e89700 1 -- 172.21.2.105:0/4126838447 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fab501478b0 msgr2=0x7fab50159f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:54.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.981+0000 7fab54e89700 1 --2- 172.21.2.105:0/4126838447 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fab501478b0 0x7fab50159f70 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 rx=0x7fab48001250 tx=0x7fab480090f0).stop 2021-11-12T05:49:54.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.981+0000 7fab54e89700 1 -- 172.21.2.105:0/4126838447 shutdown_connections 2021-11-12T05:49:54.988 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.981+0000 7fab54e89700 1 --2- 172.21.2.105:0/4126838447 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fab340535d0 0x7fab34055a90 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:54.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.981+0000 7fab54e89700 1 --2- 172.21.2.105:0/4126838447 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fab501478b0 0x7fab50159f70 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:54.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.981+0000 7fab54e89700 1 --2- 172.21.2.105:0/4126838447 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fab500b0520 0x7fab50066cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:54.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.981+0000 7fab54e89700 1 --2- 172.21.2.105:0/4126838447 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fab500aca40 0x7fab50063220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:54.989 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.981+0000 7fab54e89700 1 -- 172.21.2.105:0/4126838447 >> 172.21.2.105:0/4126838447 conn(0x7fab5005c490 msgr2=0x7fab500b1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:54.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.981+0000 7fab54e89700 1 -- 172.21.2.105:0/4126838447 shutdown_connections 2021-11-12T05:49:54.990 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:54.981+0000 7fab54e89700 1 -- 172.21.2.105:0/4126838447 wait complete. 2021-11-12T05:49:54.993 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2021-11-12T05:49:55.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54add0c700 1 Processor -- start 2021-11-12T05:49:55.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54add0c700 1 -- start start 2021-11-12T05:49:55.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54add0c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f54a80ad080 0x7f54a80af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:55.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54add0c700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f54a80ac280 0x7f54a80ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:55.045 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54add0c700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a80ac7b0 con 0x7f54a814abe0 2021-11-12T05:49:55.045 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54add0c700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a81488a0 con 0x7f54a80ac280 2021-11-12T05:49:55.045 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54add0c700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a80ac9e0 con 0x7f54a80ad080 2021-11-12T05:49:55.045 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54a7fff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f54a814abe0 0x7f54a814b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:35022/0 (socket says 172.21.2.105:35022) 2021-11-12T05:49:55.045 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54a7fff700 1 -- 172.21.2.105:0/943943418 learned_addr learned my addr 172.21.2.105:0/943943418 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:55.050 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54a67fc700 1 -- 172.21.2.105:0/943943418 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 51006305 0 0) 0x7f54a80ac7b0 con 0x7f54a814abe0 2021-11-12T05:49:55.050 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54a67fc700 1 -- 172.21.2.105:0/943943418 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5488003260 con 0x7f54a814abe0 2021-11-12T05:49:55.051 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54a6ffd700 1 --2- 172.21.2.105:0/943943418 >> v2:172.21.2.115:3300/0 conn(0x7f54a80ac280 0x7f54a80ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:55.051 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54a77fe700 1 --2- 172.21.2.105:0/943943418 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f54a80ad080 0x7f54a80af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:55.051 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54a67fc700 1 -- 172.21.2.105:0/943943418 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1707541025 0 0) 0x7f5488003260 con 0x7f54a814abe0 2021-11-12T05:49:55.051 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54a67fc700 1 -- 172.21.2.105:0/943943418 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f54a80ad080 msgr2=0x7f54a80af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:55.052 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54a67fc700 1 --2- 172.21.2.105:0/943943418 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f54a80ad080 0x7f54a80af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:55.052 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54a67fc700 1 -- 172.21.2.105:0/943943418 >> v2:172.21.2.115:3300/0 conn(0x7f54a80ac280 msgr2=0x7f54a80ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:55.052 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54a67fc700 1 --2- 172.21.2.105:0/943943418 >> v2:172.21.2.115:3300/0 conn(0x7f54a80ac280 0x7f54a80ad460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:55.052 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54a67fc700 1 -- 172.21.2.105:0/943943418 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a80b0b30 con 0x7f54a814abe0 2021-11-12T05:49:55.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54a67fc700 1 -- 172.21.2.105:0/943943418 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f54a00019e0 con 0x7f54a814abe0 2021-11-12T05:49:55.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54a67fc700 1 -- 172.21.2.105:0/943943418 >> v1:172.21.2.105:6789/0 conn(0x7f54a814abe0 legacy=0x7f54a814b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:55.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54a67fc700 1 --2- 172.21.2.105:0/943943418 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f54a80ad080 0x7f54880037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:55.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54a67fc700 1 --2- 172.21.2.105:0/943943418 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5488003e00 0x7f5488004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:55.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54a67fc700 1 --2- 172.21.2.105:0/943943418 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f54880049f0 0x7f5488004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:55.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54a67fc700 1 -- 172.21.2.105:0/943943418 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a81488a0 con 0x7f5488003e00 2021-11-12T05:49:55.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54a67fc700 1 -- 172.21.2.105:0/943943418 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a80ac9e0 con 0x7f54880049f0 2021-11-12T05:49:55.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54a67fc700 1 -- 172.21.2.105:0/943943418 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548800b8e0 con 0x7f54a80ad080 2021-11-12T05:49:55.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54a6ffd700 1 --2- 172.21.2.105:0/943943418 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5488003e00 0x7f5488004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:55.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54a77fe700 1 --2- 172.21.2.105:0/943943418 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f54a80ad080 0x7f54880037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:55.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54a6ffd700 1 -- 172.21.2.105:0/943943418 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f54a80ad080 msgr2=0x7f54880037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:55.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54a6ffd700 1 --2- 172.21.2.105:0/943943418 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f54a80ad080 0x7f54880037d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:55.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54a6ffd700 1 -- 172.21.2.105:0/943943418 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f54880049f0 msgr2=0x7f5488004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:55.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54a6ffd700 1 --2- 172.21.2.105:0/943943418 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f54880049f0 0x7f5488004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:55.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54a6ffd700 1 -- 172.21.2.105:0/943943418 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5488003260 con 0x7f5488003e00 2021-11-12T05:49:55.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54a6ffd700 1 --2- 172.21.2.105:0/943943418 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5488003e00 0x7f5488004500 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 rx=0x7f549000a000 tx=0x7f5490008040).ready entity=mon.0 client_cookie=792c344b258b84dd server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:55.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54a67fc700 1 -- 172.21.2.105:0/943943418 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5490013670 con 0x7f5488003e00 2021-11-12T05:49:55.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54a67fc700 1 -- 172.21.2.105:0/943943418 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54900137d0 con 0x7f5488003e00 2021-11-12T05:49:55.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54a67fc700 1 -- 172.21.2.105:0/943943418 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5490013b30 con 0x7f5488003e00 2021-11-12T05:49:55.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54add0c700 1 -- 172.21.2.105:0/943943418 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5488003e00 msgr2=0x7f5488004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:55.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54add0c700 1 --2- 172.21.2.105:0/943943418 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5488003e00 0x7f5488004500 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 rx=0x7f549000a000 tx=0x7f5490008040).stop 2021-11-12T05:49:55.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54a7fff700 1 -- 172.21.2.105:0/943943418 reap_dead start 2021-11-12T05:49:55.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54add0c700 1 -- 172.21.2.105:0/943943418 shutdown_connections 2021-11-12T05:49:55.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54add0c700 1 -- 172.21.2.105:0/943943418 >> 172.21.2.105:0/943943418 conn(0x7f54a80b5370 msgr2=0x7f54a80b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:55.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54add0c700 1 -- 172.21.2.105:0/943943418 shutdown_connections 2021-11-12T05:49:55.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54add0c700 1 -- 172.21.2.105:0/943943418 wait complete. 2021-11-12T05:49:55.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54add0c700 1 Processor -- start 2021-11-12T05:49:55.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.041+0000 7f54add0c700 1 -- start start 2021-11-12T05:49:55.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.045+0000 7f54add0c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5488003e00 0x7f54a80a9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:55.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.045+0000 7f54add0c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f54a80606d0 0x7f54a8156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:55.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.045+0000 7f54add0c700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f54a8060150 0x7f54a80a8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:55.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.045+0000 7f54add0c700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a8062510 con 0x7f5488003e00 2021-11-12T05:49:55.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.045+0000 7f54add0c700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a80aac00 con 0x7f54a8060150 2021-11-12T05:49:55.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.045+0000 7f54add0c700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a80aaea0 con 0x7f54a80606d0 2021-11-12T05:49:55.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.045+0000 7f54a77fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5488003e00 0x7f54a80a9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:55.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.045+0000 7f54a77fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5488003e00 0x7f54a80a9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52874/0 (socket says 172.21.2.105:52874) 2021-11-12T05:49:55.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.045+0000 7f54a77fe700 1 -- 172.21.2.105:0/1436455547 learned_addr learned my addr 172.21.2.105:0/1436455547 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:55.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.045+0000 7f54a77fe700 1 -- 172.21.2.105:0/1436455547 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f54a80606d0 msgr2=0x7f54a8156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:55.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.045+0000 7f54a77fe700 1 --2- 172.21.2.105:0/1436455547 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f54a80606d0 0x7f54a8156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:55.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.045+0000 7f54a77fe700 1 -- 172.21.2.105:0/1436455547 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f54a8060150 msgr2=0x7f54a80a8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:55.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.045+0000 7f54a77fe700 1 --2- 172.21.2.105:0/1436455547 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f54a8060150 0x7f54a80a8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:55.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.045+0000 7f54a77fe700 1 -- 172.21.2.105:0/1436455547 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a80a80c0 con 0x7f5488003e00 2021-11-12T05:49:55.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.045+0000 7f54a77fe700 1 --2- 172.21.2.105:0/1436455547 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5488003e00 0x7f54a80a9b00 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 rx=0x7f5498008000 tx=0x7f5498008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:55.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.045+0000 7f54a4ff9700 1 -- 172.21.2.105:0/1436455547 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f549800c070 con 0x7f5488003e00 2021-11-12T05:49:55.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.045+0000 7f54a4ff9700 1 -- 172.21.2.105:0/1436455547 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5498000e90 con 0x7f5488003e00 2021-11-12T05:49:55.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.045+0000 7f54a4ff9700 1 -- 172.21.2.105:0/1436455547 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54980135e0 con 0x7f5488003e00 2021-11-12T05:49:55.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.045+0000 7f54add0c700 1 -- 172.21.2.105:0/1436455547 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a80a8a50 con 0x7f5488003e00 2021-11-12T05:49:55.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.045+0000 7f54add0c700 1 -- 172.21.2.105:0/1436455547 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a80a8ed0 con 0x7f5488003e00 2021-11-12T05:49:55.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.045+0000 7f54add0c700 1 -- 172.21.2.105:0/1436455547 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a80a8250 con 0x7f5488003e00 2021-11-12T05:49:55.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.045+0000 7f54a4ff9700 1 -- 172.21.2.105:0/1436455547 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f5498019020 con 0x7f5488003e00 2021-11-12T05:49:55.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.045+0000 7f54a4ff9700 1 --2- 172.21.2.105:0/1436455547 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f548c053720 0x7f548c055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:55.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.045+0000 7f54a4ff9700 1 -- 172.21.2.105:0/1436455547 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f549806ac20 con 0x7f5488003e00 2021-11-12T05:49:55.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.045+0000 7f54a6ffd700 1 --2- 172.21.2.105:0/1436455547 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f548c053720 0x7f548c055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:55.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.045+0000 7f54a6ffd700 1 --2- 172.21.2.105:0/1436455547 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f548c053720 0x7f548c055be0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7f549000a000 tx=0x7f5490008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:55.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.049+0000 7f54a4ff9700 1 -- 172.21.2.105:0/1436455547 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5498041f00 con 0x7f5488003e00 2021-11-12T05:49:55.136 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.133+0000 7f54add0c700 1 -- 172.21.2.105:0/1436455547 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f54a80ab060 con 0x7f5488003e00 2021-11-12T05:49:55.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.133+0000 7f54a4ff9700 1 -- 172.21.2.105:0/1436455547 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v151) v1 ==== 84+0+143 (secure 0 0 0) 0x7f54a80ab060 con 0x7f5488003e00 2021-11-12T05:49:55.137 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:55.137 INFO:teuthology.orchestra.run.gibba005.stdout:[ 2021-11-12T05:49:55.138 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:55.138 INFO:teuthology.orchestra.run.gibba005.stdout: "poolnum": 1, 2021-11-12T05:49:55.138 INFO:teuthology.orchestra.run.gibba005.stdout: "poolname": "device_health_metrics" 2021-11-12T05:49:55.138 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:49:55.139 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:49:55.139 INFO:teuthology.orchestra.run.gibba005.stdout: "poolnum": 2, 2021-11-12T05:49:55.139 INFO:teuthology.orchestra.run.gibba005.stdout: "poolname": "rbd" 2021-11-12T05:49:55.139 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:49:55.139 INFO:teuthology.orchestra.run.gibba005.stdout:] 2021-11-12T05:49:55.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.133+0000 7f54add0c700 1 -- 172.21.2.105:0/1436455547 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f548c053720 msgr2=0x7f548c055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:55.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.133+0000 7f54add0c700 1 --2- 172.21.2.105:0/1436455547 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f548c053720 0x7f548c055be0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7f549000a000 tx=0x7f5490008040).stop 2021-11-12T05:49:55.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.133+0000 7f54add0c700 1 -- 172.21.2.105:0/1436455547 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5488003e00 msgr2=0x7f54a80a9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:55.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.133+0000 7f54add0c700 1 --2- 172.21.2.105:0/1436455547 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5488003e00 0x7f54a80a9b00 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 rx=0x7f5498008000 tx=0x7f5498008040).stop 2021-11-12T05:49:55.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.133+0000 7f54add0c700 1 -- 172.21.2.105:0/1436455547 shutdown_connections 2021-11-12T05:49:55.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.133+0000 7f54add0c700 1 --2- 172.21.2.105:0/1436455547 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f548c053720 0x7f548c055be0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:55.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.133+0000 7f54add0c700 1 --2- 172.21.2.105:0/1436455547 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f54a8060150 0x7f54a80a8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:55.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.133+0000 7f54add0c700 1 --2- 172.21.2.105:0/1436455547 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f54a80606d0 0x7f54a8156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:55.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.133+0000 7f54add0c700 1 --2- 172.21.2.105:0/1436455547 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f5488003e00 0x7f54a80a9b00 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:55.142 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.133+0000 7f54add0c700 1 -- 172.21.2.105:0/1436455547 >> 172.21.2.105:0/1436455547 conn(0x7f54a80b5370 msgr2=0x7f54a8143c60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:55.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.133+0000 7f54add0c700 1 -- 172.21.2.105:0/1436455547 shutdown_connections 2021-11-12T05:49:55.143 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.133+0000 7f54add0c700 1 -- 172.21.2.105:0/1436455547 wait complete. 2021-11-12T05:49:55.144 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-11-12T05:49:55.144 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2021-11-12T05:49:55.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.193+0000 7f204dd68700 1 Processor -- start 2021-11-12T05:49:55.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.193+0000 7f204dd68700 1 -- start start 2021-11-12T05:49:55.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.193+0000 7f204dd68700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f20480b1cd0 0x7f20480ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:55.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.193+0000 7f204dd68700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f20480aa700 0x7f20480ac270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:55.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.193+0000 7f204dd68700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20480b20b0 con 0x7f20480b0e60 2021-11-12T05:49:55.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.193+0000 7f204dd68700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20480b2870 con 0x7f20480b1cd0 2021-11-12T05:49:55.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.193+0000 7f204dd68700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20480b13e0 con 0x7f20480aa700 2021-11-12T05:49:55.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.193+0000 7f2046ffd700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f20480b0e60 0x7f20480abb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:35046/0 (socket says 172.21.2.105:35046) 2021-11-12T05:49:55.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.193+0000 7f2046ffd700 1 -- 172.21.2.105:0/1998264177 learned_addr learned my addr 172.21.2.105:0/1998264177 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:55.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.193+0000 7f20467fc700 1 -- 172.21.2.105:0/1998264177 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2648081318 0 0) 0x7f20480b20b0 con 0x7f20480b0e60 2021-11-12T05:49:55.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.193+0000 7f20467fc700 1 -- 172.21.2.105:0/1998264177 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2028003260 con 0x7f20480b0e60 2021-11-12T05:49:55.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.193+0000 7f20467fc700 1 -- 172.21.2.105:0/1998264177 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3690125251 0 0) 0x7f2028003260 con 0x7f20480b0e60 2021-11-12T05:49:55.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.193+0000 7f20467fc700 1 -- 172.21.2.105:0/1998264177 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f20480aa700 msgr2=0x7f20480ac270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:55.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.193+0000 7f20467fc700 1 --2- 172.21.2.105:0/1998264177 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f20480aa700 0x7f20480ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:55.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.193+0000 7f20467fc700 1 -- 172.21.2.105:0/1998264177 >> v2:172.21.2.115:3300/0 conn(0x7f20480b1cd0 msgr2=0x7f20480ad2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:55.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.193+0000 7f20477fe700 1 --2- 172.21.2.105:0/1998264177 >> v2:172.21.2.115:3300/0 conn(0x7f20480b1cd0 0x7f20480ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:55.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.193+0000 7f20467fc700 1 --2- 172.21.2.105:0/1998264177 >> v2:172.21.2.115:3300/0 conn(0x7f20480b1cd0 0x7f20480ad2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:55.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.193+0000 7f20467fc700 1 -- 172.21.2.105:0/1998264177 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20480ace10 con 0x7f20480b0e60 2021-11-12T05:49:55.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.193+0000 7f20467fc700 1 -- 172.21.2.105:0/1998264177 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f2038001660 con 0x7f20480b0e60 2021-11-12T05:49:55.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.193+0000 7f20477fe700 1 --2- 172.21.2.105:0/1998264177 >> v2:172.21.2.115:3300/0 conn(0x7f20480b1cd0 0x7f20480ad2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:49:55.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.193+0000 7f20467fc700 1 -- 172.21.2.105:0/1998264177 >> v1:172.21.2.105:6789/0 conn(0x7f20480b0e60 legacy=0x7f20480abb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:55.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.193+0000 7f20467fc700 1 --2- 172.21.2.105:0/1998264177 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f20480aa700 0x7f20280037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:55.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.193+0000 7f20467fc700 1 --2- 172.21.2.105:0/1998264177 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2028003ee0 0x7f2028004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:55.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.193+0000 7f20467fc700 1 --2- 172.21.2.105:0/1998264177 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2028004bf0 0x7f202800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:55.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.193+0000 7f20467fc700 1 -- 172.21.2.105:0/1998264177 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20480b13e0 con 0x7f2028003ee0 2021-11-12T05:49:55.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.193+0000 7f20467fc700 1 -- 172.21.2.105:0/1998264177 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2028005320 con 0x7f2028004bf0 2021-11-12T05:49:55.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.193+0000 7f20467fc700 1 -- 172.21.2.105:0/1998264177 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202800bc40 con 0x7f20480aa700 2021-11-12T05:49:55.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.193+0000 7f2046ffd700 1 --2- 172.21.2.105:0/1998264177 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2028003ee0 0x7f2028004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:55.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f2047fff700 1 --2- 172.21.2.105:0/1998264177 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2028004bf0 0x7f202800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:55.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f2046ffd700 1 -- 172.21.2.105:0/1998264177 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f20480aa700 msgr2=0x7f20280037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:55.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f2046ffd700 1 --2- 172.21.2.105:0/1998264177 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f20480aa700 0x7f20280037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:55.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f2046ffd700 1 -- 172.21.2.105:0/1998264177 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2028004bf0 msgr2=0x7f202800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:55.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f2046ffd700 1 --2- 172.21.2.105:0/1998264177 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2028004bf0 0x7f202800b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:55.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f2046ffd700 1 -- 172.21.2.105:0/1998264177 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2028003260 con 0x7f2028003ee0 2021-11-12T05:49:55.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f2046ffd700 1 --2- 172.21.2.105:0/1998264177 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2028003ee0 0x7f2028004500 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 rx=0x7f2038001370 tx=0x7f2038001d80).ready entity=mon.0 client_cookie=bb33a8f18c667fd server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:55.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f20467fc700 1 -- 172.21.2.105:0/1998264177 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20380070d0 con 0x7f2028003ee0 2021-11-12T05:49:55.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f20467fc700 1 -- 172.21.2.105:0/1998264177 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2038007230 con 0x7f2028003ee0 2021-11-12T05:49:55.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f20467fc700 1 -- 172.21.2.105:0/1998264177 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f203800c8f0 con 0x7f2028003ee0 2021-11-12T05:49:55.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f204dd68700 1 -- 172.21.2.105:0/1998264177 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2028003ee0 msgr2=0x7f2028004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:55.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f204dd68700 1 --2- 172.21.2.105:0/1998264177 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2028003ee0 0x7f2028004500 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 rx=0x7f2038001370 tx=0x7f2038001d80).stop 2021-11-12T05:49:55.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f2047fff700 1 -- 172.21.2.105:0/1998264177 reap_dead start 2021-11-12T05:49:55.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f204dd68700 1 -- 172.21.2.105:0/1998264177 shutdown_connections 2021-11-12T05:49:55.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f204dd68700 1 -- 172.21.2.105:0/1998264177 >> 172.21.2.105:0/1998264177 conn(0x7f2048063610 msgr2=0x7f20480639f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:55.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f204dd68700 1 -- 172.21.2.105:0/1998264177 shutdown_connections 2021-11-12T05:49:55.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f204dd68700 1 -- 172.21.2.105:0/1998264177 wait complete. 2021-11-12T05:49:55.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f204dd68700 1 Processor -- start 2021-11-12T05:49:55.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f204dd68700 1 -- start start 2021-11-12T05:49:55.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f204dd68700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2028003ee0 0x7f20480b5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:55.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f204dd68700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f20480671f0 0x7f204809eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:55.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f204dd68700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2048153040 0x7f20481534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:55.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f204dd68700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204809f090 con 0x7f2048153040 2021-11-12T05:49:55.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f204dd68700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204809f2b0 con 0x7f20480671f0 2021-11-12T05:49:55.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f204dd68700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204809f550 con 0x7f2028003ee0 2021-11-12T05:49:55.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f2047fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2048153040 0x7f20481534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:55.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f2047fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2048153040 0x7f20481534c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52894/0 (socket says 172.21.2.105:52894) 2021-11-12T05:49:55.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f2047fff700 1 -- 172.21.2.105:0/2493200869 learned_addr learned my addr 172.21.2.105:0/2493200869 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:55.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f20477fe700 1 --2- 172.21.2.105:0/2493200869 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2028003ee0 0x7f20480b5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:55.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f2046ffd700 1 --2- 172.21.2.105:0/2493200869 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f20480671f0 0x7f204809eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:55.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f2047fff700 1 -- 172.21.2.105:0/2493200869 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2028003ee0 msgr2=0x7f20480b5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:55.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f2047fff700 1 --2- 172.21.2.105:0/2493200869 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2028003ee0 0x7f20480b5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:55.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f2047fff700 1 -- 172.21.2.105:0/2493200869 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f20480671f0 msgr2=0x7f204809eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:55.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f2047fff700 1 --2- 172.21.2.105:0/2493200869 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f20480671f0 0x7f204809eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:55.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f2047fff700 1 -- 172.21.2.105:0/2493200869 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f204809f7f0 con 0x7f2048153040 2021-11-12T05:49:55.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f2046ffd700 1 --2- 172.21.2.105:0/2493200869 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f20480671f0 0x7f204809eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:49:55.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f2047fff700 1 --2- 172.21.2.105:0/2493200869 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2048153040 0x7f20481534c0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 rx=0x7f2038001840 tx=0x7f2040008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:55.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f2044ff9700 1 -- 172.21.2.105:0/2493200869 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2040010910 con 0x7f2048153040 2021-11-12T05:49:55.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f2044ff9700 1 -- 172.21.2.105:0/2493200869 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2040010a70 con 0x7f2048153040 2021-11-12T05:49:55.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f2044ff9700 1 -- 172.21.2.105:0/2493200869 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2040010dd0 con 0x7f2048153040 2021-11-12T05:49:55.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f204dd68700 1 -- 172.21.2.105:0/2493200869 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20481539b0 con 0x7f2048153040 2021-11-12T05:49:55.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f204dd68700 1 -- 172.21.2.105:0/2493200869 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20480a0eb0 con 0x7f2048153040 2021-11-12T05:49:55.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f204dd68700 1 -- 172.21.2.105:0/2493200869 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f204809f980 con 0x7f2048153040 2021-11-12T05:49:55.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f2044ff9700 1 -- 172.21.2.105:0/2493200869 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f204001c460 con 0x7f2048153040 2021-11-12T05:49:55.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f2044ff9700 1 --2- 172.21.2.105:0/2493200869 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f202c053640 0x7f202c055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:55.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f2044ff9700 1 -- 172.21.2.105:0/2493200869 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5596+0+0 (secure 0 0 0) 0x7f204006dc30 con 0x7f2048153040 2021-11-12T05:49:55.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f20477fe700 1 --2- 172.21.2.105:0/2493200869 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f202c053640 0x7f202c055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:55.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.197+0000 7f20477fe700 1 --2- 172.21.2.105:0/2493200869 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f202c053640 0x7f202c055b00 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f203000b000 tx=0x7f2030008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:55.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.201+0000 7f2044ff9700 1 -- 172.21.2.105:0/2493200869 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2040044f10 con 0x7f2048153040 2021-11-12T05:49:55.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:55.285+0000 7f204dd68700 1 -- 172.21.2.105:0/2493200869 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f20480acb50 con 0x7f2048153040 2021-11-12T05:49:55.330 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:49:55.333 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:49:55.336 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:49:55.340 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:49:55.343 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:49:56.240 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.237+0000 7f2044ff9700 1 -- 172.21.2.105:0/2493200869 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v152) v1 ==== 133+0+0 (secure 0 0 0) 0x7f2040048530 con 0x7f2048153040 2021-11-12T05:49:56.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.237+0000 7f204dd68700 1 -- 172.21.2.105:0/2493200869 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f202c053640 msgr2=0x7f202c055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:56.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.237+0000 7f204dd68700 1 --2- 172.21.2.105:0/2493200869 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f202c053640 0x7f202c055b00 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f203000b000 tx=0x7f2030008040).stop 2021-11-12T05:49:56.242 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.237+0000 7f204dd68700 1 -- 172.21.2.105:0/2493200869 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2048153040 msgr2=0x7f20481534c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:56.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.237+0000 7f204dd68700 1 --2- 172.21.2.105:0/2493200869 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2048153040 0x7f20481534c0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 rx=0x7f2038001840 tx=0x7f2040008040).stop 2021-11-12T05:49:56.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.237+0000 7f204dd68700 1 -- 172.21.2.105:0/2493200869 shutdown_connections 2021-11-12T05:49:56.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.237+0000 7f204dd68700 1 --2- 172.21.2.105:0/2493200869 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f202c053640 0x7f202c055b00 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:56.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.237+0000 7f204dd68700 1 --2- 172.21.2.105:0/2493200869 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2048153040 0x7f20481534c0 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:56.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.237+0000 7f204dd68700 1 --2- 172.21.2.105:0/2493200869 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f20480671f0 0x7f204809eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:56.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.237+0000 7f204dd68700 1 --2- 172.21.2.105:0/2493200869 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2028003ee0 0x7f20480b5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:56.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.237+0000 7f204dd68700 1 -- 172.21.2.105:0/2493200869 >> 172.21.2.105:0/2493200869 conn(0x7f2048063610 msgr2=0x7f204813fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:56.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.237+0000 7f204dd68700 1 -- 172.21.2.105:0/2493200869 shutdown_connections 2021-11-12T05:49:56.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.237+0000 7f204dd68700 1 -- 172.21.2.105:0/2493200869 wait complete. 2021-11-12T05:49:56.245 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_metadata' created 2021-11-12T05:49:56.248 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2021-11-12T05:49:56.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.297+0000 7f4dc2ddf700 1 Processor -- start 2021-11-12T05:49:56.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.297+0000 7f4dc2ddf700 1 -- start start 2021-11-12T05:49:56.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.297+0000 7f4dc2ddf700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f4dbc0aca40 0x7f4dbc0ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:56.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.297+0000 7f4dc2ddf700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f4dbc0b0520 0x7f4dbc1473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:56.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.297+0000 7f4dc2ddf700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4dbc1478b0 0x7f4dbc144180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:56.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.297+0000 7f4dc2ddf700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dbc147d40 con 0x7f4dbc0aca40 2021-11-12T05:49:56.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.297+0000 7f4dc2ddf700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dbc0b1840 con 0x7f4dbc0b0520 2021-11-12T05:49:56.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.297+0000 7f4dc2ddf700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc0b09d0 con 0x7f4dbc1478b0 2021-11-12T05:49:56.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.297+0000 7f4dc0b7b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f4dbc0aca40 0x7f4dbc0ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:56.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.297+0000 7f4dc0b7b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f4dbc0aca40 0x7f4dbc0ace20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52898/0 (socket says 172.21.2.105:52898) 2021-11-12T05:49:56.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.297+0000 7f4dc0b7b700 1 -- 172.21.2.105:0/2365998735 learned_addr learned my addr 172.21.2.105:0/2365998735 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:56.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.297+0000 7f4dc0b7b700 1 -- 172.21.2.105:0/2365998735 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4dbc1478b0 msgr2=0x7f4dbc144180 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:49:56.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.297+0000 7f4dc0b7b700 1 --2- 172.21.2.105:0/2365998735 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4dbc1478b0 0x7f4dbc144180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:56.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.297+0000 7f4dc0b7b700 1 -- 172.21.2.105:0/2365998735 >> v2:172.21.2.115:3300/0 conn(0x7f4dbc0b0520 msgr2=0x7f4dbc1473c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:49:56.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.297+0000 7f4dc0b7b700 1 --2- 172.21.2.105:0/2365998735 >> v2:172.21.2.115:3300/0 conn(0x7f4dbc0b0520 0x7f4dbc1473c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:56.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.297+0000 7f4dc0b7b700 1 -- 172.21.2.105:0/2365998735 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dbc0af2b0 con 0x7f4dbc0aca40 2021-11-12T05:49:56.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.297+0000 7f4dc0b7b700 1 --2- 172.21.2.105:0/2365998735 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4dbc0aca40 0x7f4dbc0ace20 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 rx=0x7f4dbc0ae6a0 tx=0x7f4dac006eb0).ready entity=mon.0 client_cookie=6af3da0e3313e7ff server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:56.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.297+0000 7f4dbb7fe700 1 -- 172.21.2.105:0/2365998735 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dac00d570 con 0x7f4dbc0aca40 2021-11-12T05:49:56.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.297+0000 7f4dbb7fe700 1 -- 172.21.2.105:0/2365998735 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dac000e90 con 0x7f4dbc0aca40 2021-11-12T05:49:56.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.297+0000 7f4dbb7fe700 1 -- 172.21.2.105:0/2365998735 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dac00d8c0 con 0x7f4dbc0aca40 2021-11-12T05:49:56.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.297+0000 7f4dc2ddf700 1 -- 172.21.2.105:0/2365998735 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4dbc0aca40 msgr2=0x7f4dbc0ace20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:56.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.297+0000 7f4dc2ddf700 1 --2- 172.21.2.105:0/2365998735 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4dbc0aca40 0x7f4dbc0ace20 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 rx=0x7f4dbc0ae6a0 tx=0x7f4dac006eb0).stop 2021-11-12T05:49:56.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.297+0000 7f4dc2ddf700 1 -- 172.21.2.105:0/2365998735 shutdown_connections 2021-11-12T05:49:56.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.297+0000 7f4dc2ddf700 1 --2- 172.21.2.105:0/2365998735 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4dbc1478b0 0x7f4dbc144180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:56.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.297+0000 7f4dc2ddf700 1 --2- 172.21.2.105:0/2365998735 >> v2:172.21.2.115:3300/0 conn(0x7f4dbc0b0520 0x7f4dbc1473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:56.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.297+0000 7f4dc2ddf700 1 --2- 172.21.2.105:0/2365998735 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4dbc0aca40 0x7f4dbc0ace20 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:56.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.297+0000 7f4dc2ddf700 1 -- 172.21.2.105:0/2365998735 >> 172.21.2.105:0/2365998735 conn(0x7f4dbc05c490 msgr2=0x7f4dbc0b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:56.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.301+0000 7f4dc2ddf700 1 -- 172.21.2.105:0/2365998735 shutdown_connections 2021-11-12T05:49:56.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.301+0000 7f4dc2ddf700 1 -- 172.21.2.105:0/2365998735 wait complete. 2021-11-12T05:49:56.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.301+0000 7f4dc2ddf700 1 Processor -- start 2021-11-12T05:49:56.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.301+0000 7f4dc2ddf700 1 -- start start 2021-11-12T05:49:56.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.301+0000 7f4dc2ddf700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4dbc0aca40 0x7f4dbc065a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:56.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.301+0000 7f4dc2ddf700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4dbc0b0520 0x7f4dbc0a7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:56.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.301+0000 7f4dc2ddf700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4dbc1478b0 0x7f4dbc0a7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:56.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.301+0000 7f4dc2ddf700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc067320 con 0x7f4dbc0b0520 2021-11-12T05:49:56.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.301+0000 7f4dc2ddf700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc0a8420 con 0x7f4dbc1478b0 2021-11-12T05:49:56.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.301+0000 7f4dc2ddf700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc1574a0 con 0x7f4dbc0aca40 2021-11-12T05:49:56.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.301+0000 7f4dbbfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4dbc0b0520 0x7f4dbc0a7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:56.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.301+0000 7f4dbbfff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4dbc0b0520 0x7f4dbc0a7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52906/0 (socket says 172.21.2.105:52906) 2021-11-12T05:49:56.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.301+0000 7f4dbbfff700 1 -- 172.21.2.105:0/2508981045 learned_addr learned my addr 172.21.2.105:0/2508981045 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:56.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.301+0000 7f4dbbfff700 1 -- 172.21.2.105:0/2508981045 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4dbc0aca40 msgr2=0x7f4dbc065a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:56.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.301+0000 7f4dbbfff700 1 --2- 172.21.2.105:0/2508981045 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4dbc0aca40 0x7f4dbc065a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:56.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.301+0000 7f4dbbfff700 1 -- 172.21.2.105:0/2508981045 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4dbc1478b0 msgr2=0x7f4dbc0a7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:56.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.301+0000 7f4dbbfff700 1 --2- 172.21.2.105:0/2508981045 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4dbc1478b0 0x7f4dbc0a7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:56.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.301+0000 7f4dbbfff700 1 -- 172.21.2.105:0/2508981045 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dac00b1e0 con 0x7f4dbc0b0520 2021-11-12T05:49:56.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.301+0000 7f4dbbfff700 1 --2- 172.21.2.105:0/2508981045 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4dbc0b0520 0x7f4dbc0a7360 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 rx=0x7f4da4002fb0 tx=0x7f4da4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:56.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.301+0000 7f4db9ffb700 1 -- 172.21.2.105:0/2508981045 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4da4013460 con 0x7f4dbc0b0520 2021-11-12T05:49:56.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.301+0000 7f4db9ffb700 1 -- 172.21.2.105:0/2508981045 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da40135c0 con 0x7f4dbc0b0520 2021-11-12T05:49:56.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.301+0000 7f4db9ffb700 1 -- 172.21.2.105:0/2508981045 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4da4013920 con 0x7f4dbc0b0520 2021-11-12T05:49:56.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.301+0000 7f4dc2ddf700 1 -- 172.21.2.105:0/2508981045 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dbc157740 con 0x7f4dbc0b0520 2021-11-12T05:49:56.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.301+0000 7f4dc2ddf700 1 -- 172.21.2.105:0/2508981045 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dbc064db0 con 0x7f4dbc0b0520 2021-11-12T05:49:56.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.301+0000 7f4dc2ddf700 1 -- 172.21.2.105:0/2508981045 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dbc057350 con 0x7f4dbc0b0520 2021-11-12T05:49:56.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.301+0000 7f4db9ffb700 1 -- 172.21.2.105:0/2508981045 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4da400f070 con 0x7f4dbc0b0520 2021-11-12T05:49:56.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.301+0000 7f4db9ffb700 1 --2- 172.21.2.105:0/2508981045 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4da0053580 0x7f4da0055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:56.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.301+0000 7f4db9ffb700 1 -- 172.21.2.105:0/2508981045 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5950+0+0 (secure 0 0 0) 0x7f4da406b070 con 0x7f4dbc0b0520 2021-11-12T05:49:56.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.301+0000 7f4dc0b7b700 1 --2- 172.21.2.105:0/2508981045 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4da0053580 0x7f4da0055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:56.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.301+0000 7f4dc0b7b700 1 --2- 172.21.2.105:0/2508981045 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4da0053580 0x7f4da0055a40 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f4dbc0ae6a0 tx=0x7f4dac015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:56.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.305+0000 7f4db9ffb700 1 -- 172.21.2.105:0/2508981045 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4da4042140 con 0x7f4dbc0b0520 2021-11-12T05:49:56.392 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:56.389+0000 7f4dc2ddf700 1 -- 172.21.2.105:0/2508981045 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f4dbc0674e0 con 0x7f4dbc0b0520 2021-11-12T05:49:57.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.249+0000 7f4db9ffb700 1 -- 172.21.2.105:0/2508981045 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v153) v1 ==== 125+0+0 (secure 0 0 0) 0x7f4da4018030 con 0x7f4dbc0b0520 2021-11-12T05:49:57.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.249+0000 7f4dc2ddf700 1 -- 172.21.2.105:0/2508981045 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4da0053580 msgr2=0x7f4da0055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:57.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.249+0000 7f4dc2ddf700 1 --2- 172.21.2.105:0/2508981045 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4da0053580 0x7f4da0055a40 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f4dbc0ae6a0 tx=0x7f4dac015000).stop 2021-11-12T05:49:57.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.249+0000 7f4dc2ddf700 1 -- 172.21.2.105:0/2508981045 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4dbc0b0520 msgr2=0x7f4dbc0a7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:57.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.249+0000 7f4dc2ddf700 1 --2- 172.21.2.105:0/2508981045 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4dbc0b0520 0x7f4dbc0a7360 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 rx=0x7f4da4002fb0 tx=0x7f4da4006df0).stop 2021-11-12T05:49:57.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.249+0000 7f4dc2ddf700 1 -- 172.21.2.105:0/2508981045 shutdown_connections 2021-11-12T05:49:57.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.249+0000 7f4dc2ddf700 1 --2- 172.21.2.105:0/2508981045 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4da0053580 0x7f4da0055a40 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:57.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.249+0000 7f4dc2ddf700 1 --2- 172.21.2.105:0/2508981045 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4dbc1478b0 0x7f4dbc0a7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:57.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.249+0000 7f4dc2ddf700 1 --2- 172.21.2.105:0/2508981045 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4dbc0b0520 0x7f4dbc0a7360 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:57.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.249+0000 7f4dc2ddf700 1 --2- 172.21.2.105:0/2508981045 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4dbc0aca40 0x7f4dbc065a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:57.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.249+0000 7f4dc2ddf700 1 -- 172.21.2.105:0/2508981045 >> 172.21.2.105:0/2508981045 conn(0x7f4dbc05c490 msgr2=0x7f4dbc144e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:57.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.249+0000 7f4dc2ddf700 1 -- 172.21.2.105:0/2508981045 shutdown_connections 2021-11-12T05:49:57.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.249+0000 7f4dc2ddf700 1 -- 172.21.2.105:0/2508981045 wait complete. 2021-11-12T05:49:57.257 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_data' created 2021-11-12T05:49:57.261 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2021-11-12T05:49:57.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.309+0000 7f68048b4700 1 Processor -- start 2021-11-12T05:49:57.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.309+0000 7f68048b4700 1 -- start start 2021-11-12T05:49:57.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.309+0000 7f68048b4700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f68000b0780 0x7f68001434d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:57.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.309+0000 7f68048b4700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68000b2d20 con 0x7f68000b0cc0 2021-11-12T05:49:57.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.309+0000 7f68048b4700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68000b1fc0 con 0x7f68000b2940 2021-11-12T05:49:57.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.309+0000 7f68048b4700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68000b15e0 con 0x7f68000b0780 2021-11-12T05:49:57.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.309+0000 7f67fed9d700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f68000b0cc0 0x7f680005f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:35078/0 (socket says 172.21.2.105:35078) 2021-11-12T05:49:57.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.309+0000 7f67fed9d700 1 -- 172.21.2.105:0/3193203851 learned_addr learned my addr 172.21.2.105:0/3193203851 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:57.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.309+0000 7f67fdd9b700 1 --2- 172.21.2.105:0/3193203851 >> v2:172.21.2.115:3300/0 conn(0x7f68000b0780 0x7f68001434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:57.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.309+0000 7f67fd59a700 1 -- 172.21.2.105:0/3193203851 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2991721265 0 0) 0x7f68000b2d20 con 0x7f68000b0cc0 2021-11-12T05:49:57.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.309+0000 7f67fd59a700 1 -- 172.21.2.105:0/3193203851 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67e0003260 con 0x7f68000b0cc0 2021-11-12T05:49:57.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.309+0000 7f67fd59a700 1 -- 172.21.2.105:0/3193203851 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2152882748 0 0) 0x7f67e0003260 con 0x7f68000b0cc0 2021-11-12T05:49:57.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.309+0000 7f67fd59a700 1 -- 172.21.2.105:0/3193203851 >> v2:172.21.2.115:3300/0 conn(0x7f68000b0780 msgr2=0x7f68001434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:57.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.309+0000 7f67fd59a700 1 --2- 172.21.2.105:0/3193203851 >> v2:172.21.2.115:3300/0 conn(0x7f68000b0780 0x7f68001434d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:57.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.309+0000 7f67fd59a700 1 -- 172.21.2.105:0/3193203851 >> v1:172.21.2.115:6789/0 conn(0x7f68000b2940 legacy=0x7f6800142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:57.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.309+0000 7f67fd59a700 1 -- 172.21.2.105:0/3193203851 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68000b1880 con 0x7f68000b0cc0 2021-11-12T05:49:57.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.309+0000 7f67fd59a700 1 -- 172.21.2.105:0/3193203851 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f67f80019e0 con 0x7f68000b0cc0 2021-11-12T05:49:57.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.309+0000 7f67fd59a700 1 -- 172.21.2.105:0/3193203851 >> v1:172.21.2.105:6789/0 conn(0x7f68000b0cc0 legacy=0x7f680005f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:57.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.309+0000 7f67fd59a700 1 --2- 172.21.2.105:0/3193203851 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f67e00037a0 0x7f67e0003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:57.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.309+0000 7f67fd59a700 1 --2- 172.21.2.105:0/3193203851 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f67e0004500 0x7f67e0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:57.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.309+0000 7f67fd59a700 1 --2- 172.21.2.105:0/3193203851 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f67e0004e70 0x7f67e000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:57.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.309+0000 7f67fd59a700 1 -- 172.21.2.105:0/3193203851 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68000b15e0 con 0x7f67e0004500 2021-11-12T05:49:57.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.309+0000 7f67fd59a700 1 -- 172.21.2.105:0/3193203851 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e000bda0 con 0x7f67e0004e70 2021-11-12T05:49:57.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.309+0000 7f67fd59a700 1 -- 172.21.2.105:0/3193203851 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67e000bf60 con 0x7f67e00037a0 2021-11-12T05:49:57.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.309+0000 7f67fdd9b700 1 --2- 172.21.2.105:0/3193203851 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f67e0004500 0x7f67e0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:57.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f67fed9d700 1 --2- 172.21.2.105:0/3193203851 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f67e0004e70 0x7f67e000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:57.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f67fdd9b700 1 -- 172.21.2.105:0/3193203851 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f67e00037a0 msgr2=0x7f67e0003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:57.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f67fdd9b700 1 --2- 172.21.2.105:0/3193203851 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f67e00037a0 0x7f67e0003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:57.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f67fdd9b700 1 -- 172.21.2.105:0/3193203851 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f67e0004e70 msgr2=0x7f67e000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:57.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f67fdd9b700 1 --2- 172.21.2.105:0/3193203851 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f67e0004e70 0x7f67e000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:57.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f67fdd9b700 1 -- 172.21.2.105:0/3193203851 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e0003260 con 0x7f67e0004500 2021-11-12T05:49:57.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f67fed9d700 1 --2- 172.21.2.105:0/3193203851 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f67e0004e70 0x7f67e000b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:49:57.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f67fed9d700 1 -- 172.21.2.105:0/3193203851 reap_dead start 2021-11-12T05:49:57.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f67fdd9b700 1 --2- 172.21.2.105:0/3193203851 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f67e0004500 0x7f67e0004980 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 rx=0x7f67e800c000 tx=0x7f67e8006df0).ready entity=mon.0 client_cookie=3a98dd0c294e0a85 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:57.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f67fd59a700 1 -- 172.21.2.105:0/3193203851 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67e800e5f0 con 0x7f67e0004500 2021-11-12T05:49:57.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f67fd59a700 1 -- 172.21.2.105:0/3193203851 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e800e750 con 0x7f67e0004500 2021-11-12T05:49:57.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f67fd59a700 1 -- 172.21.2.105:0/3193203851 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67e800eab0 con 0x7f67e0004500 2021-11-12T05:49:57.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f68048b4700 1 -- 172.21.2.105:0/3193203851 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f67e0004500 msgr2=0x7f67e0004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:57.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f68048b4700 1 --2- 172.21.2.105:0/3193203851 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f67e0004500 0x7f67e0004980 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 rx=0x7f67e800c000 tx=0x7f67e8006df0).stop 2021-11-12T05:49:57.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f68048b4700 1 -- 172.21.2.105:0/3193203851 shutdown_connections 2021-11-12T05:49:57.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f68048b4700 1 --2- 172.21.2.105:0/3193203851 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f67e0004500 0x7f67e0004980 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:57.332 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f68048b4700 1 -- 172.21.2.105:0/3193203851 >> 172.21.2.105:0/3193203851 conn(0x7f6800068440 msgr2=0x7f6800062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:57.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f68048b4700 1 -- 172.21.2.105:0/3193203851 shutdown_connections 2021-11-12T05:49:57.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f68048b4700 1 -- 172.21.2.105:0/3193203851 wait complete. 2021-11-12T05:49:57.333 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f68048b4700 1 Processor -- start 2021-11-12T05:49:57.334 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f68048b4700 1 -- start start 2021-11-12T05:49:57.334 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f68048b4700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f67e0004500 0x7f6800144310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:57.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f68048b4700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f68000654d0 0x7f6800144800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:57.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f68048b4700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6800065b00 0x7f6800065f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:57.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f68048b4700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68000642e0 con 0x7f67e0004500 2021-11-12T05:49:57.335 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f68048b4700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6800141ee0 con 0x7f68000654d0 2021-11-12T05:49:57.336 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f68048b4700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6800141c40 con 0x7f6800065b00 2021-11-12T05:49:57.336 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f67fe59c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f67e0004500 0x7f6800144310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:57.336 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f67fe59c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f67e0004500 0x7f6800144310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52926/0 (socket says 172.21.2.105:52926) 2021-11-12T05:49:57.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f67fe59c700 1 -- 172.21.2.105:0/864276080 learned_addr learned my addr 172.21.2.105:0/864276080 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:57.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f67fdd9b700 1 --2- 172.21.2.105:0/864276080 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f68000654d0 0x7f6800144800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:57.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f67fed9d700 1 --2- 172.21.2.105:0/864276080 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6800065b00 0x7f6800065f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:57.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f67fe59c700 1 -- 172.21.2.105:0/864276080 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6800065b00 msgr2=0x7f6800065f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:57.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f67fe59c700 1 --2- 172.21.2.105:0/864276080 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6800065b00 0x7f6800065f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:57.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f67fe59c700 1 -- 172.21.2.105:0/864276080 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f68000654d0 msgr2=0x7f6800144800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:57.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f67fe59c700 1 --2- 172.21.2.105:0/864276080 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f68000654d0 0x7f6800144800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:57.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f67fe59c700 1 -- 172.21.2.105:0/864276080 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68000645a0 con 0x7f67e0004500 2021-11-12T05:49:57.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f67fe59c700 1 --2- 172.21.2.105:0/864276080 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f67e0004500 0x7f6800144310 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 rx=0x7f6800066940 tx=0x7f67f0007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:57.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f67f77fe700 1 -- 172.21.2.105:0/864276080 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67f000cea0 con 0x7f67e0004500 2021-11-12T05:49:57.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f67f77fe700 1 -- 172.21.2.105:0/864276080 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f0007030 con 0x7f67e0004500 2021-11-12T05:49:57.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f68048b4700 1 -- 172.21.2.105:0/864276080 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6800064a40 con 0x7f67e0004500 2021-11-12T05:49:57.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f68048b4700 1 -- 172.21.2.105:0/864276080 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f680014e6f0 con 0x7f67e0004500 2021-11-12T05:49:57.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f67f77fe700 1 -- 172.21.2.105:0/864276080 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67f0007390 con 0x7f67e0004500 2021-11-12T05:49:57.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f68048b4700 1 -- 172.21.2.105:0/864276080 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6800064730 con 0x7f67e0004500 2021-11-12T05:49:57.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.313+0000 7f67f77fe700 1 -- 172.21.2.105:0/864276080 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f67f0010030 con 0x7f67e0004500 2021-11-12T05:49:57.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.317+0000 7f67f77fe700 1 --2- 172.21.2.105:0/864276080 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f67e40536d0 0x7f67e4055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:57.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.317+0000 7f67f77fe700 1 -- 172.21.2.105:0/864276080 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6300+0+0 (secure 0 0 0) 0x7f67f006b5c0 con 0x7f67e0004500 2021-11-12T05:49:57.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.317+0000 7f67fdd9b700 1 --2- 172.21.2.105:0/864276080 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f67e40536d0 0x7f67e4055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:57.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.317+0000 7f67fdd9b700 1 --2- 172.21.2.105:0/864276080 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f67e40536d0 0x7f67e4055b90 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f67e801d000 tx=0x7f67e8017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:57.347 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.317+0000 7f67f77fe700 1 -- 172.21.2.105:0/864276080 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f67f0042530 con 0x7f67e0004500 2021-11-12T05:49:57.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.433+0000 7f68048b4700 1 -- 172.21.2.105:0/864276080 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f68000b1b20 con 0x7f67e0004500 2021-11-12T05:49:57.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.437+0000 7f67f77fe700 1 -- 172.21.2.105:0/864276080 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 29 and data pool 30 v73) v1 ==== 189+0+0 (secure 0 0 0) 0x7f67f0045b50 con 0x7f67e0004500 2021-11-12T05:49:57.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.437+0000 7f68048b4700 1 -- 172.21.2.105:0/864276080 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f67e40536d0 msgr2=0x7f67e4055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:57.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.437+0000 7f68048b4700 1 --2- 172.21.2.105:0/864276080 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f67e40536d0 0x7f67e4055b90 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f67e801d000 tx=0x7f67e8017000).stop 2021-11-12T05:49:57.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.437+0000 7f68048b4700 1 -- 172.21.2.105:0/864276080 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f67e0004500 msgr2=0x7f6800144310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:57.443 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.437+0000 7f68048b4700 1 --2- 172.21.2.105:0/864276080 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f67e0004500 0x7f6800144310 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 rx=0x7f6800066940 tx=0x7f67f0007c00).stop 2021-11-12T05:49:57.443 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.437+0000 7f68048b4700 1 -- 172.21.2.105:0/864276080 shutdown_connections 2021-11-12T05:49:57.443 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.437+0000 7f68048b4700 1 --2- 172.21.2.105:0/864276080 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f67e40536d0 0x7f67e4055b90 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:57.443 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.437+0000 7f68048b4700 1 --2- 172.21.2.105:0/864276080 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f6800065b00 0x7f6800065f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:57.443 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.437+0000 7f68048b4700 1 --2- 172.21.2.105:0/864276080 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f68000654d0 0x7f6800144800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:57.444 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.437+0000 7f68048b4700 1 --2- 172.21.2.105:0/864276080 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f67e0004500 0x7f6800144310 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:57.444 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.437+0000 7f68048b4700 1 -- 172.21.2.105:0/864276080 >> 172.21.2.105:0/864276080 conn(0x7f6800068440 msgr2=0x7f68000b4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:57.444 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.437+0000 7f68048b4700 1 -- 172.21.2.105:0/864276080 shutdown_connections 2021-11-12T05:49:57.444 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.437+0000 7f68048b4700 1 -- 172.21.2.105:0/864276080 wait complete. 2021-11-12T05:49:57.445 INFO:teuthology.orchestra.run.gibba005.stderr:new fs with metadata pool 29 and data pool 30 2021-11-12T05:49:57.448 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:49:57.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb086b5b700 1 Processor -- start 2021-11-12T05:49:57.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb086b5b700 1 -- start start 2021-11-12T05:49:57.500 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb086b5b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb0800ade80 0x7fb0800601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:57.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb086b5b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb08013a9c0 0x7fb08013ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:57.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb086b5b700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb080066150 con 0x7fb08005fdc0 2021-11-12T05:49:57.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb086b5b700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb080141fb0 con 0x7fb08013a9c0 2021-11-12T05:49:57.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb086b5b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0800663f0 con 0x7fb0800ade80 2021-11-12T05:49:57.501 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb0850f8700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb08013a9c0 0x7fb08013ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:57.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb0850f8700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb08013a9c0 0x7fb08013ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52942/0 (socket says 172.21.2.105:52942) 2021-11-12T05:49:57.502 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb0850f8700 1 -- 172.21.2.105:0/1854351327 learned_addr learned my addr 172.21.2.105:0/1854351327 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:57.506 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb0850f8700 1 -- 172.21.2.105:0/1854351327 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb0800ade80 msgr2=0x7fb0800601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:57.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb0850f8700 1 --2- 172.21.2.105:0/1854351327 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb0800ade80 0x7fb0800601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:57.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb0850f8700 1 -- 172.21.2.105:0/1854351327 >> v1:172.21.2.115:6789/0 conn(0x7fb08005fdc0 legacy=0x7fb080066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:57.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb0850f8700 1 -- 172.21.2.105:0/1854351327 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb080140fd0 con 0x7fb08013a9c0 2021-11-12T05:49:57.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb0850f8700 1 --2- 172.21.2.105:0/1854351327 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb08013a9c0 0x7fb08013ae70 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 rx=0x7fb0800adc40 tx=0x7fb078009290).ready entity=mon.0 client_cookie=59148f7fc5615cf9 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:57.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb07f7fe700 1 -- 172.21.2.105:0/1854351327 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb07800b830 con 0x7fb08013a9c0 2021-11-12T05:49:57.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb07f7fe700 1 -- 172.21.2.105:0/1854351327 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07800b990 con 0x7fb08013a9c0 2021-11-12T05:49:57.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb07f7fe700 1 -- 172.21.2.105:0/1854351327 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb07800bb00 con 0x7fb08013a9c0 2021-11-12T05:49:57.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb086b5b700 1 -- 172.21.2.105:0/1854351327 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb08013a9c0 msgr2=0x7fb08013ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:57.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb086b5b700 1 --2- 172.21.2.105:0/1854351327 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb08013a9c0 0x7fb08013ae70 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 rx=0x7fb0800adc40 tx=0x7fb078009290).stop 2021-11-12T05:49:57.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb086b5b700 1 -- 172.21.2.105:0/1854351327 shutdown_connections 2021-11-12T05:49:57.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb086b5b700 1 --2- 172.21.2.105:0/1854351327 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb08013a9c0 0x7fb08013ae70 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:57.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb086b5b700 1 --2- 172.21.2.105:0/1854351327 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb0800ade80 0x7fb0800601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:57.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb086b5b700 1 -- 172.21.2.105:0/1854351327 >> 172.21.2.105:0/1854351327 conn(0x7fb0800608d0 msgr2=0x7fb08005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:57.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb086b5b700 1 -- 172.21.2.105:0/1854351327 shutdown_connections 2021-11-12T05:49:57.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb086b5b700 1 -- 172.21.2.105:0/1854351327 wait complete. 2021-11-12T05:49:57.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb086b5b700 1 Processor -- start 2021-11-12T05:49:57.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb086b5b700 1 -- start start 2021-11-12T05:49:57.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb086b5b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb08005fdc0 0x7fb080144d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:57.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb086b5b700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb0800ade80 0x7fb0800ae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:57.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb086b5b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb08013a9c0 0x7fb0800aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:57.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb086b5b700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb080061420 con 0x7fb08013a9c0 2021-11-12T05:49:57.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb086b5b700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb080144420 con 0x7fb0800ade80 2021-11-12T05:49:57.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb086b5b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0801446c0 con 0x7fb08005fdc0 2021-11-12T05:49:57.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb0850f8700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb08013a9c0 0x7fb0800aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:57.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb0850f8700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb08013a9c0 0x7fb0800aeec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52948/0 (socket says 172.21.2.105:52948) 2021-11-12T05:49:57.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb0850f8700 1 -- 172.21.2.105:0/311421854 learned_addr learned my addr 172.21.2.105:0/311421854 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:57.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb07ffff700 1 --2- 172.21.2.105:0/311421854 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb0800ade80 0x7fb0800ae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:57.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb0850f8700 1 -- 172.21.2.105:0/311421854 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb08005fdc0 msgr2=0x7fb080144d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:57.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb0850f8700 1 --2- 172.21.2.105:0/311421854 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb08005fdc0 0x7fb080144d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:57.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb0850f8700 1 -- 172.21.2.105:0/311421854 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb0800ade80 msgr2=0x7fb0800ae9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:57.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb0850f8700 1 --2- 172.21.2.105:0/311421854 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb0800ade80 0x7fb0800ae9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:57.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb0850f8700 1 -- 172.21.2.105:0/311421854 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb078009530 con 0x7fb08013a9c0 2021-11-12T05:49:57.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb0850f8700 1 --2- 172.21.2.105:0/311421854 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb08013a9c0 0x7fb0800aeec0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 rx=0x7fb0800adc40 tx=0x7fb078016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:57.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb07dffb700 1 -- 172.21.2.105:0/311421854 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb078021630 con 0x7fb08013a9c0 2021-11-12T05:49:57.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb07dffb700 1 -- 172.21.2.105:0/311421854 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb078021790 con 0x7fb08013a9c0 2021-11-12T05:49:57.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb086b5b700 1 -- 172.21.2.105:0/311421854 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb080061650 con 0x7fb08013a9c0 2021-11-12T05:49:57.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.497+0000 7fb07dffb700 1 -- 172.21.2.105:0/311421854 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb078021af0 con 0x7fb08013a9c0 2021-11-12T05:49:57.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.501+0000 7fb086b5b700 1 -- 172.21.2.105:0/311421854 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb080063240 con 0x7fb08013a9c0 2021-11-12T05:49:57.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.501+0000 7fb086b5b700 1 -- 172.21.2.105:0/311421854 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0800617e0 con 0x7fb08013a9c0 2021-11-12T05:49:57.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.501+0000 7fb07dffb700 1 -- 172.21.2.105:0/311421854 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb07800f070 con 0x7fb08013a9c0 2021-11-12T05:49:57.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.501+0000 7fb07dffb700 1 --2- 172.21.2.105:0/311421854 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb064053580 0x7fb064055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:57.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.501+0000 7fb07dffb700 1 -- 172.21.2.105:0/311421854 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fb07806d720 con 0x7fb08013a9c0 2021-11-12T05:49:57.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.501+0000 7fb0848f7700 1 --2- 172.21.2.105:0/311421854 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb064053580 0x7fb064055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:57.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.501+0000 7fb0848f7700 1 --2- 172.21.2.105:0/311421854 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb064053580 0x7fb064055a40 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7fb070002f90 tx=0x7fb0700069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:57.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.501+0000 7fb07dffb700 1 -- 172.21.2.105:0/311421854 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb078044620 con 0x7fb08013a9c0 2021-11-12T05:49:57.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.589+0000 7fb086b5b700 1 -- 172.21.2.105:0/311421854 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb080057350 con 0x7fb08013a9c0 2021-11-12T05:49:57.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.589+0000 7fb07dffb700 1 -- 172.21.2.105:0/311421854 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+16298 (secure 0 0 0) 0x7fb078015070 con 0x7fb08013a9c0 2021-11-12T05:49:57.593 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:57.593 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":155,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:49:57.435722+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:49:55.298718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-11-12T05:49:56.403004+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:49:57.594 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.589+0000 7fb086b5b700 1 -- 172.21.2.105:0/311421854 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb064053580 msgr2=0x7fb064055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:57.594 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.589+0000 7fb086b5b700 1 --2- 172.21.2.105:0/311421854 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb064053580 0x7fb064055a40 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7fb070002f90 tx=0x7fb0700069b0).stop 2021-11-12T05:49:57.594 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.589+0000 7fb086b5b700 1 -- 172.21.2.105:0/311421854 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb08013a9c0 msgr2=0x7fb0800aeec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:57.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.589+0000 7fb086b5b700 1 --2- 172.21.2.105:0/311421854 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb08013a9c0 0x7fb0800aeec0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 rx=0x7fb0800adc40 tx=0x7fb078016000).stop 2021-11-12T05:49:57.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.589+0000 7fb086b5b700 1 -- 172.21.2.105:0/311421854 shutdown_connections 2021-11-12T05:49:57.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.589+0000 7fb086b5b700 1 --2- 172.21.2.105:0/311421854 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb064053580 0x7fb064055a40 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:57.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.589+0000 7fb086b5b700 1 --2- 172.21.2.105:0/311421854 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb08013a9c0 0x7fb0800aeec0 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:57.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.589+0000 7fb086b5b700 1 --2- 172.21.2.105:0/311421854 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb0800ade80 0x7fb0800ae9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:57.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.589+0000 7fb086b5b700 1 --2- 172.21.2.105:0/311421854 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb08005fdc0 0x7fb080144d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:57.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.589+0000 7fb086b5b700 1 -- 172.21.2.105:0/311421854 >> 172.21.2.105:0/311421854 conn(0x7fb0800608d0 msgr2=0x7fb0801401c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:57.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.589+0000 7fb086b5b700 1 -- 172.21.2.105:0/311421854 shutdown_connections 2021-11-12T05:49:57.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.589+0000 7fb086b5b700 1 -- 172.21.2.105:0/311421854 wait complete. 2021-11-12T05:49:57.600 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:49:57.650 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.645+0000 7faa012ef700 1 Processor -- start 2021-11-12T05:49:57.651 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.645+0000 7faa012ef700 1 -- start start 2021-11-12T05:49:57.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7faa012ef700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa9fc05fdc0 0x7fa9fc0601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:57.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7faa012ef700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9fc066150 con 0x7fa9fc0ade80 2021-11-12T05:49:57.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7faa012ef700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9fc0663f0 con 0x7fa9fc13a9c0 2021-11-12T05:49:57.653 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7faa012ef700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9fc141fb0 con 0x7fa9fc05fdc0 2021-11-12T05:49:57.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7fa9fa7fc700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fa9fc0ade80 0x7fa9fc066730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:35118/0 (socket says 172.21.2.105:35118) 2021-11-12T05:49:57.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7fa9fa7fc700 1 -- 172.21.2.105:0/890491006 learned_addr learned my addr 172.21.2.105:0/890491006 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:57.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7fa9faffd700 1 --2- 172.21.2.105:0/890491006 >> v2:172.21.2.105:3300/0 conn(0x7fa9fc05fdc0 0x7fa9fc0601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:57.654 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7fa9faffd700 1 -- 172.21.2.105:0/890491006 >> v1:172.21.2.115:6789/0 conn(0x7fa9fc13a9c0 legacy=0x7fa9fc141470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:57.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7fa9f9ffb700 1 -- 172.21.2.105:0/890491006 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1174296220 0 0) 0x7fa9fc066150 con 0x7fa9fc0ade80 2021-11-12T05:49:57.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7fa9faffd700 1 -- 172.21.2.105:0/890491006 >> v1:172.21.2.105:6789/0 conn(0x7fa9fc0ade80 legacy=0x7fa9fc066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:57.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7fa9faffd700 1 -- 172.21.2.105:0/890491006 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9fc140fd0 con 0x7fa9fc05fdc0 2021-11-12T05:49:57.655 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7fa9faffd700 1 --2- 172.21.2.105:0/890491006 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa9fc05fdc0 0x7fa9fc0601a0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 rx=0x7fa9fc060ea0 tx=0x7fa9e4006df0).ready entity=mon.0 client_cookie=c81cbf088e15380 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:57.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7fa9f9ffb700 1 -- 172.21.2.105:0/890491006 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9e400d5c0 con 0x7fa9fc05fdc0 2021-11-12T05:49:57.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7fa9f9ffb700 1 -- 172.21.2.105:0/890491006 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e4000e90 con 0x7fa9fc05fdc0 2021-11-12T05:49:57.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7fa9f9ffb700 1 -- 172.21.2.105:0/890491006 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9e400d910 con 0x7fa9fc05fdc0 2021-11-12T05:49:57.656 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7faa012ef700 1 -- 172.21.2.105:0/890491006 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa9fc05fdc0 msgr2=0x7fa9fc0601a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:57.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7faa012ef700 1 --2- 172.21.2.105:0/890491006 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa9fc05fdc0 0x7fa9fc0601a0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 rx=0x7fa9fc060ea0 tx=0x7fa9e4006df0).stop 2021-11-12T05:49:57.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7faa012ef700 1 -- 172.21.2.105:0/890491006 shutdown_connections 2021-11-12T05:49:57.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7faa012ef700 1 --2- 172.21.2.105:0/890491006 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa9fc05fdc0 0x7fa9fc0601a0 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:57.657 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7faa012ef700 1 -- 172.21.2.105:0/890491006 >> 172.21.2.105:0/890491006 conn(0x7fa9fc0608d0 msgr2=0x7fa9fc05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:57.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7faa012ef700 1 -- 172.21.2.105:0/890491006 shutdown_connections 2021-11-12T05:49:57.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7faa012ef700 1 -- 172.21.2.105:0/890491006 wait complete. 2021-11-12T05:49:57.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7faa012ef700 1 Processor -- start 2021-11-12T05:49:57.658 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7faa012ef700 1 -- start start 2021-11-12T05:49:57.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7faa012ef700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa9fc05fdc0 0x7fa9fc13fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:57.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7faa012ef700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa9fc0ade80 0x7fa9fc0b6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:57.661 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7faa012ef700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa9fc13a9c0 0x7fa9fc142940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:57.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7faa012ef700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc0b1490 con 0x7fa9fc13a9c0 2021-11-12T05:49:57.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7faa012ef700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc145010 con 0x7fa9fc05fdc0 2021-11-12T05:49:57.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7faa012ef700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc0b54e0 con 0x7fa9fc0ade80 2021-11-12T05:49:57.662 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7fa9fb7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa9fc13a9c0 0x7fa9fc142940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:57.663 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7fa9fb7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa9fc13a9c0 0x7fa9fc142940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52960/0 (socket says 172.21.2.105:52960) 2021-11-12T05:49:57.663 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7fa9fb7fe700 1 -- 172.21.2.105:0/3454660595 learned_addr learned my addr 172.21.2.105:0/3454660595 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:57.663 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7fa9fb7fe700 1 -- 172.21.2.105:0/3454660595 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa9fc0ade80 msgr2=0x7fa9fc0b6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:57.663 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7fa9fb7fe700 1 --2- 172.21.2.105:0/3454660595 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa9fc0ade80 0x7fa9fc0b6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:57.664 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7fa9fb7fe700 1 -- 172.21.2.105:0/3454660595 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa9fc05fdc0 msgr2=0x7fa9fc13fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:57.664 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7fa9fb7fe700 1 --2- 172.21.2.105:0/3454660595 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa9fc05fdc0 0x7fa9fc13fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:57.664 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7fa9fb7fe700 1 -- 172.21.2.105:0/3454660595 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e400b180 con 0x7fa9fc13a9c0 2021-11-12T05:49:57.664 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7fa9fb7fe700 1 --2- 172.21.2.105:0/3454660595 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa9fc13a9c0 0x7fa9fc142940 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 rx=0x7fa9f4003290 tx=0x7fa9f40090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:57.665 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7fa9f3fff700 1 -- 172.21.2.105:0/3454660595 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9f400f510 con 0x7fa9fc13a9c0 2021-11-12T05:49:57.665 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7fa9f3fff700 1 -- 172.21.2.105:0/3454660595 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f400f670 con 0x7fa9fc13a9c0 2021-11-12T05:49:57.665 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7faa012ef700 1 -- 172.21.2.105:0/3454660595 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9fc0b7210 con 0x7fa9fc13a9c0 2021-11-12T05:49:57.665 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7faa012ef700 1 -- 172.21.2.105:0/3454660595 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9fc0b5980 con 0x7fa9fc13a9c0 2021-11-12T05:49:57.666 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.649+0000 7fa9f3fff700 1 -- 172.21.2.105:0/3454660595 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9f400f7e0 con 0x7fa9fc13a9c0 2021-11-12T05:49:57.666 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.653+0000 7faa012ef700 1 -- 172.21.2.105:0/3454660595 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9fc0b56a0 con 0x7fa9fc13a9c0 2021-11-12T05:49:57.666 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.653+0000 7fa9f3fff700 1 -- 172.21.2.105:0/3454660595 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa9f400f070 con 0x7fa9fc13a9c0 2021-11-12T05:49:57.666 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.653+0000 7fa9f3fff700 1 --2- 172.21.2.105:0/3454660595 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa9e0053540 0x7fa9e0055a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:57.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.653+0000 7fa9f3fff700 1 -- 172.21.2.105:0/3454660595 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fa9f406b700 con 0x7fa9fc13a9c0 2021-11-12T05:49:57.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.653+0000 7fa9faffd700 1 --2- 172.21.2.105:0/3454660595 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa9e0053540 0x7fa9e0055a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:57.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.653+0000 7fa9faffd700 1 --2- 172.21.2.105:0/3454660595 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa9e0053540 0x7fa9e0055a00 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7fa9fc060ea0 tx=0x7fa9e4012000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:57.667 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.653+0000 7fa9f3fff700 1 -- 172.21.2.105:0/3454660595 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa9f4042600 con 0x7fa9fc13a9c0 2021-11-12T05:49:57.741 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.737+0000 7faa012ef700 1 -- 172.21.2.105:0/3454660595 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9fc057350 con 0x7fa9fc13a9c0 2021-11-12T05:49:57.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.737+0000 7fa9f3fff700 1 -- 172.21.2.105:0/3454660595 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+16298 (secure 0 0 0) 0x7fa9f4045c20 con 0x7fa9fc13a9c0 2021-11-12T05:49:57.742 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:57.743 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":155,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:49:57.435722+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:49:55.298718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-11-12T05:49:56.403004+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:49:57.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.741+0000 7faa012ef700 1 -- 172.21.2.105:0/3454660595 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa9e0053540 msgr2=0x7fa9e0055a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:57.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.741+0000 7faa012ef700 1 --2- 172.21.2.105:0/3454660595 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa9e0053540 0x7fa9e0055a00 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7fa9fc060ea0 tx=0x7fa9e4012000).stop 2021-11-12T05:49:57.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.741+0000 7faa012ef700 1 -- 172.21.2.105:0/3454660595 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa9fc13a9c0 msgr2=0x7fa9fc142940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:57.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.741+0000 7faa012ef700 1 --2- 172.21.2.105:0/3454660595 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa9fc13a9c0 0x7fa9fc142940 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 rx=0x7fa9f4003290 tx=0x7fa9f40090f0).stop 2021-11-12T05:49:57.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.741+0000 7faa012ef700 1 -- 172.21.2.105:0/3454660595 shutdown_connections 2021-11-12T05:49:57.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.741+0000 7faa012ef700 1 --2- 172.21.2.105:0/3454660595 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa9e0053540 0x7fa9e0055a00 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:57.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.741+0000 7faa012ef700 1 --2- 172.21.2.105:0/3454660595 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa9fc13a9c0 0x7fa9fc142940 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:57.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.741+0000 7faa012ef700 1 --2- 172.21.2.105:0/3454660595 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa9fc0ade80 0x7fa9fc0b6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:57.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.741+0000 7faa012ef700 1 --2- 172.21.2.105:0/3454660595 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa9fc05fdc0 0x7fa9fc13fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:57.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.741+0000 7faa012ef700 1 -- 172.21.2.105:0/3454660595 >> 172.21.2.105:0/3454660595 conn(0x7fa9fc0608d0 msgr2=0x7fa9fc066730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:57.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.741+0000 7faa012ef700 1 -- 172.21.2.105:0/3454660595 shutdown_connections 2021-11-12T05:49:57.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.741+0000 7faa012ef700 1 -- 172.21.2.105:0/3454660595 wait complete. 2021-11-12T05:49:57.750 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2021-11-12T05:49:57.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.801+0000 7fd053a68700 1 Processor -- start 2021-11-12T05:49:57.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.801+0000 7fd053a68700 1 -- start start 2021-11-12T05:49:57.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd053a68700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fd04c0aca40 0x7fd04c0ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:57.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd053a68700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd04c0b1840 con 0x7fd04c0b0520 2021-11-12T05:49:57.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd053a68700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd04c0b09d0 con 0x7fd04c144180 2021-11-12T05:49:57.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd053a68700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd04c0af2b0 con 0x7fd04c0aca40 2021-11-12T05:49:57.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd051003700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fd04c0b0520 0x7fd04c1473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:35132/0 (socket says 172.21.2.105:35132) 2021-11-12T05:49:57.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd051003700 1 -- 172.21.2.105:0/706323980 learned_addr learned my addr 172.21.2.105:0/706323980 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:57.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd050802700 1 -- 172.21.2.105:0/706323980 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 679849162 0 0) 0x7fd04c0b1840 con 0x7fd04c0b0520 2021-11-12T05:49:57.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd050802700 1 -- 172.21.2.105:0/706323980 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd034003260 con 0x7fd04c0b0520 2021-11-12T05:49:57.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd050802700 1 -- 172.21.2.105:0/706323980 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2208811589 0 0) 0x7fd034003260 con 0x7fd04c0b0520 2021-11-12T05:49:57.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd050802700 1 -- 172.21.2.105:0/706323980 >> v2:172.21.2.115:3300/0 conn(0x7fd04c0aca40 msgr2=0x7fd04c0ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:57.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd050802700 1 --2- 172.21.2.105:0/706323980 >> v2:172.21.2.115:3300/0 conn(0x7fd04c0aca40 0x7fd04c0ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:57.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd050802700 1 -- 172.21.2.105:0/706323980 >> v1:172.21.2.115:6789/0 conn(0x7fd04c144180 legacy=0x7fd04c1445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:57.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd050802700 1 -- 172.21.2.105:0/706323980 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd04c0b1a70 con 0x7fd04c0b0520 2021-11-12T05:49:57.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd050802700 1 -- 172.21.2.105:0/706323980 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fd03c001660 con 0x7fd04c0b0520 2021-11-12T05:49:57.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd050802700 1 -- 172.21.2.105:0/706323980 >> v1:172.21.2.105:6789/0 conn(0x7fd04c0b0520 legacy=0x7fd04c1473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:57.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd050802700 1 --2- 172.21.2.105:0/706323980 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd034003820 0x7fd034003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:57.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd050802700 1 --2- 172.21.2.105:0/706323980 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd034004500 0x7fd034004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:57.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd050802700 1 --2- 172.21.2.105:0/706323980 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd034005050 0x7fd03400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:57.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd050802700 1 -- 172.21.2.105:0/706323980 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c0af2b0 con 0x7fd034003820 2021-11-12T05:49:57.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd050802700 1 -- 172.21.2.105:0/706323980 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd03400bf40 con 0x7fd034005050 2021-11-12T05:49:57.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd050802700 1 -- 172.21.2.105:0/706323980 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd03400c100 con 0x7fd034004500 2021-11-12T05:49:57.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd051804700 1 --2- 172.21.2.105:0/706323980 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd034003820 0x7fd034003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:57.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd052005700 1 --2- 172.21.2.105:0/706323980 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd034005050 0x7fd03400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:57.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd051804700 1 -- 172.21.2.105:0/706323980 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd034004500 msgr2=0x7fd034004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:57.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd051804700 1 --2- 172.21.2.105:0/706323980 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd034004500 0x7fd034004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:57.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd051804700 1 -- 172.21.2.105:0/706323980 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd034005050 msgr2=0x7fd03400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:57.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd051804700 1 --2- 172.21.2.105:0/706323980 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd034005050 0x7fd03400b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:57.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd051804700 1 -- 172.21.2.105:0/706323980 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd034003260 con 0x7fd034003820 2021-11-12T05:49:57.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd052005700 1 -- 172.21.2.105:0/706323980 reap_dead start 2021-11-12T05:49:57.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd051804700 1 --2- 172.21.2.105:0/706323980 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd034003820 0x7fd034003c20 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 rx=0x7fd048002f70 tx=0x7fd048006ca0).ready entity=mon.0 client_cookie=2dda786d8cc78a7c server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:57.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd050802700 1 -- 172.21.2.105:0/706323980 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd048013410 con 0x7fd034003820 2021-11-12T05:49:57.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd050802700 1 -- 172.21.2.105:0/706323980 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd048013570 con 0x7fd034003820 2021-11-12T05:49:57.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd050802700 1 -- 172.21.2.105:0/706323980 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0480138d0 con 0x7fd034003820 2021-11-12T05:49:57.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd053a68700 1 -- 172.21.2.105:0/706323980 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd034003820 msgr2=0x7fd034003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:57.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd053a68700 1 --2- 172.21.2.105:0/706323980 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd034003820 0x7fd034003c20 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 rx=0x7fd048002f70 tx=0x7fd048006ca0).stop 2021-11-12T05:49:57.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd053a68700 1 -- 172.21.2.105:0/706323980 shutdown_connections 2021-11-12T05:49:57.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd053a68700 1 --2- 172.21.2.105:0/706323980 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd034003820 0x7fd034003c20 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:57.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd053a68700 1 -- 172.21.2.105:0/706323980 >> 172.21.2.105:0/706323980 conn(0x7fd04c05c490 msgr2=0x7fd04c0b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:57.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd053a68700 1 -- 172.21.2.105:0/706323980 shutdown_connections 2021-11-12T05:49:57.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd053a68700 1 -- 172.21.2.105:0/706323980 wait complete. 2021-11-12T05:49:57.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd053a68700 1 Processor -- start 2021-11-12T05:49:57.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd053a68700 1 -- start start 2021-11-12T05:49:57.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd053a68700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd034003820 0x7fd04c147a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:57.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd053a68700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd04c157740 0x7fd04c146590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:57.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd053a68700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd04c156820 0x7fd04c146a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:57.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd053a68700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c156d60 con 0x7fd04c156820 2021-11-12T05:49:57.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd053a68700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c157000 con 0x7fd04c157740 2021-11-12T05:49:57.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd053a68700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c1572a0 con 0x7fd034003820 2021-11-12T05:49:57.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd052005700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd04c156820 0x7fd04c146a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:57.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd052005700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd04c156820 0x7fd04c146a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:52982/0 (socket says 172.21.2.105:52982) 2021-11-12T05:49:57.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.805+0000 7fd052005700 1 -- 172.21.2.105:0/317609337 learned_addr learned my addr 172.21.2.105:0/317609337 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:57.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.809+0000 7fd052005700 1 -- 172.21.2.105:0/317609337 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd034003820 msgr2=0x7fd04c147a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:57.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.809+0000 7fd052005700 1 --2- 172.21.2.105:0/317609337 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd034003820 0x7fd04c147a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:57.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.809+0000 7fd052005700 1 -- 172.21.2.105:0/317609337 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd04c157740 msgr2=0x7fd04c146590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:57.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.809+0000 7fd052005700 1 --2- 172.21.2.105:0/317609337 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd04c157740 0x7fd04c146590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:57.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.809+0000 7fd052005700 1 -- 172.21.2.105:0/317609337 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd04c0625e0 con 0x7fd04c156820 2021-11-12T05:49:57.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.809+0000 7fd052005700 1 --2- 172.21.2.105:0/317609337 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd04c156820 0x7fd04c146a80 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 rx=0x7fd04c05cd40 tx=0x7fd044009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:57.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.809+0000 7fd03affd700 1 -- 172.21.2.105:0/317609337 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd04400de50 con 0x7fd04c156820 2021-11-12T05:49:57.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.809+0000 7fd03affd700 1 -- 172.21.2.105:0/317609337 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0440032e0 con 0x7fd04c156820 2021-11-12T05:49:57.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.809+0000 7fd053a68700 1 -- 172.21.2.105:0/317609337 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd04c147f10 con 0x7fd04c156820 2021-11-12T05:49:57.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.809+0000 7fd053a68700 1 -- 172.21.2.105:0/317609337 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd04c065180 con 0x7fd04c156820 2021-11-12T05:49:57.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.809+0000 7fd03affd700 1 -- 172.21.2.105:0/317609337 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd044001630 con 0x7fd04c156820 2021-11-12T05:49:57.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.809+0000 7fd053a68700 1 -- 172.21.2.105:0/317609337 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd04c157460 con 0x7fd04c156820 2021-11-12T05:49:57.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.809+0000 7fd03affd700 1 -- 172.21.2.105:0/317609337 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd04401b060 con 0x7fd04c156820 2021-11-12T05:49:57.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.809+0000 7fd03affd700 1 --2- 172.21.2.105:0/317609337 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd02c0536a0 0x7fd02c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:57.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.809+0000 7fd03affd700 1 -- 172.21.2.105:0/317609337 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fd04406b2b0 con 0x7fd04c156820 2021-11-12T05:49:57.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.809+0000 7fd051804700 1 --2- 172.21.2.105:0/317609337 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd02c0536a0 0x7fd02c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:57.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.809+0000 7fd051804700 1 --2- 172.21.2.105:0/317609337 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd02c0536a0 0x7fd02c055b60 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7fd048002f70 tx=0x7fd048014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:57.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.813+0000 7fd03affd700 1 -- 172.21.2.105:0/317609337 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd0440422c0 con 0x7fd04c156820 2021-11-12T05:49:57.924 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:57.921+0000 7fd053a68700 1 -- 172.21.2.105:0/317609337 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd04c057350 con 0x7fd04c156820 2021-11-12T05:49:58.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.445+0000 7fd03affd700 1 -- 172.21.2.105:0/317609337 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v74) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd044019070 con 0x7fd04c156820 2021-11-12T05:49:58.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.445+0000 7fd053a68700 1 -- 172.21.2.105:0/317609337 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd02c0536a0 msgr2=0x7fd02c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:58.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.445+0000 7fd053a68700 1 --2- 172.21.2.105:0/317609337 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd02c0536a0 0x7fd02c055b60 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7fd048002f70 tx=0x7fd048014000).stop 2021-11-12T05:49:58.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.445+0000 7fd053a68700 1 -- 172.21.2.105:0/317609337 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd04c156820 msgr2=0x7fd04c146a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:58.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.445+0000 7fd053a68700 1 --2- 172.21.2.105:0/317609337 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd04c156820 0x7fd04c146a80 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 rx=0x7fd04c05cd40 tx=0x7fd044009040).stop 2021-11-12T05:49:58.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.445+0000 7fd053a68700 1 -- 172.21.2.105:0/317609337 shutdown_connections 2021-11-12T05:49:58.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.445+0000 7fd053a68700 1 --2- 172.21.2.105:0/317609337 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd02c0536a0 0x7fd02c055b60 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:58.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.445+0000 7fd053a68700 1 --2- 172.21.2.105:0/317609337 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd04c156820 0x7fd04c146a80 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:58.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.445+0000 7fd053a68700 1 --2- 172.21.2.105:0/317609337 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd04c157740 0x7fd04c146590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:58.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.445+0000 7fd053a68700 1 --2- 172.21.2.105:0/317609337 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd034003820 0x7fd04c147a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:58.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.445+0000 7fd053a68700 1 -- 172.21.2.105:0/317609337 >> 172.21.2.105:0/317609337 conn(0x7fd04c05c490 msgr2=0x7fd04c0608a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:58.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.445+0000 7fd053a68700 1 -- 172.21.2.105:0/317609337 shutdown_connections 2021-11-12T05:49:58.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.445+0000 7fd053a68700 1 -- 172.21.2.105:0/317609337 wait complete. 2021-11-12T05:49:58.457 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:49:58.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b9828c700 1 Processor -- start 2021-11-12T05:49:58.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b9828c700 1 -- start start 2021-11-12T05:49:58.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b9828c700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f4b900601a0 0x7f4b90141470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:58.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b9828c700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b90066150 con 0x7f4b9005fdc0 2021-11-12T05:49:58.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b9828c700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b900663f0 con 0x7f4b900ade80 2021-11-12T05:49:58.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b9828c700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b90141fb0 con 0x7f4b900601a0 2021-11-12T05:49:58.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b96028700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f4b9005fdc0 0x7f4b90066730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:35150/0 (socket says 172.21.2.105:35150) 2021-11-12T05:49:58.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b96028700 1 -- 172.21.2.105:0/2881547252 learned_addr learned my addr 172.21.2.105:0/2881547252 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:58.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b95026700 1 -- 172.21.2.105:0/2881547252 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 333300548 0 0) 0x7f4b90066150 con 0x7f4b9005fdc0 2021-11-12T05:49:58.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b95026700 1 -- 172.21.2.105:0/2881547252 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b78003260 con 0x7f4b9005fdc0 2021-11-12T05:49:58.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b96829700 1 --2- 172.21.2.105:0/2881547252 >> v2:172.21.2.115:3300/0 conn(0x7f4b900601a0 0x7f4b90141470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:58.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b95026700 1 -- 172.21.2.105:0/2881547252 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 828600235 0 0) 0x7f4b78003260 con 0x7f4b9005fdc0 2021-11-12T05:49:58.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b95026700 1 -- 172.21.2.105:0/2881547252 >> v2:172.21.2.115:3300/0 conn(0x7f4b900601a0 msgr2=0x7f4b90141470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:58.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b95026700 1 --2- 172.21.2.105:0/2881547252 >> v2:172.21.2.115:3300/0 conn(0x7f4b900601a0 0x7f4b90141470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:58.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b95026700 1 -- 172.21.2.105:0/2881547252 >> v1:172.21.2.115:6789/0 conn(0x7f4b900ade80 legacy=0x7f4b9013a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:58.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b95026700 1 -- 172.21.2.105:0/2881547252 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b90140fd0 con 0x7f4b9005fdc0 2021-11-12T05:49:58.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b95026700 1 -- 172.21.2.105:0/2881547252 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f4b84001660 con 0x7f4b9005fdc0 2021-11-12T05:49:58.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b95026700 1 -- 172.21.2.105:0/2881547252 >> v1:172.21.2.105:6789/0 conn(0x7f4b9005fdc0 legacy=0x7f4b90066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:58.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b95026700 1 --2- 172.21.2.105:0/2881547252 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4b78003750 0x7f4b78003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:58.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b95026700 1 --2- 172.21.2.105:0/2881547252 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4b78004500 0x7f4b78004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:58.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b95026700 1 --2- 172.21.2.105:0/2881547252 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4b78004ec0 0x7f4b7800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:58.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b95026700 1 -- 172.21.2.105:0/2881547252 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7800bd50 con 0x7f4b78003750 2021-11-12T05:49:58.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b95026700 1 -- 172.21.2.105:0/2881547252 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7800bec0 con 0x7f4b78004ec0 2021-11-12T05:49:58.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b95026700 1 -- 172.21.2.105:0/2881547252 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b78010490 con 0x7f4b78004500 2021-11-12T05:49:58.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b96028700 1 --2- 172.21.2.105:0/2881547252 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4b78003750 0x7f4b78003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:58.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b96028700 1 -- 172.21.2.105:0/2881547252 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4b78004500 msgr2=0x7f4b78004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:58.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b96028700 1 --2- 172.21.2.105:0/2881547252 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4b78004500 0x7f4b78004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:58.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b96028700 1 -- 172.21.2.105:0/2881547252 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4b78004ec0 msgr2=0x7f4b7800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:58.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b96028700 1 --2- 172.21.2.105:0/2881547252 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4b78004ec0 0x7f4b7800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:58.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b96829700 1 -- 172.21.2.105:0/2881547252 reap_dead start 2021-11-12T05:49:58.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b96028700 1 -- 172.21.2.105:0/2881547252 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b78003260 con 0x7f4b78003750 2021-11-12T05:49:58.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b96028700 1 --2- 172.21.2.105:0/2881547252 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4b78003750 0x7f4b78003b50 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 rx=0x7f4b90060ea0 tx=0x7f4b900662e0).ready entity=mon.0 client_cookie=91b5455060e09bc6 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:58.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b95026700 1 -- 172.21.2.105:0/2881547252 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b840070d0 con 0x7f4b78003750 2021-11-12T05:49:58.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b95026700 1 -- 172.21.2.105:0/2881547252 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b84007230 con 0x7f4b78003750 2021-11-12T05:49:58.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b95026700 1 -- 172.21.2.105:0/2881547252 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b8400c9c0 con 0x7f4b78003750 2021-11-12T05:49:58.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b9828c700 1 -- 172.21.2.105:0/2881547252 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4b78003750 msgr2=0x7f4b78003b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:58.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b9828c700 1 --2- 172.21.2.105:0/2881547252 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4b78003750 0x7f4b78003b50 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 rx=0x7f4b90060ea0 tx=0x7f4b900662e0).stop 2021-11-12T05:49:58.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b9828c700 1 -- 172.21.2.105:0/2881547252 shutdown_connections 2021-11-12T05:49:58.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b9828c700 1 --2- 172.21.2.105:0/2881547252 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4b78003750 0x7f4b78003b50 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:58.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b9828c700 1 -- 172.21.2.105:0/2881547252 >> 172.21.2.105:0/2881547252 conn(0x7f4b900608d0 msgr2=0x7f4b9005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:58.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b9828c700 1 -- 172.21.2.105:0/2881547252 shutdown_connections 2021-11-12T05:49:58.520 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.505+0000 7f4b9828c700 1 -- 172.21.2.105:0/2881547252 wait complete. 2021-11-12T05:49:58.520 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.509+0000 7f4b9828c700 1 Processor -- start 2021-11-12T05:49:58.520 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.509+0000 7f4b9828c700 1 -- start start 2021-11-12T05:49:58.522 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.509+0000 7f4b9828c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4b78003750 0x7f4b900b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:58.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.509+0000 7f4b9828c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4b9013cec0 0x7f4b900b2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:58.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.509+0000 7f4b9828c700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4b90142200 0x7f4b900ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:58.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.509+0000 7f4b9828c700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b900af330 con 0x7f4b9013cec0 2021-11-12T05:49:58.523 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.509+0000 7f4b9828c700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b900af5d0 con 0x7f4b90142200 2021-11-12T05:49:58.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.509+0000 7f4b9828c700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b900af870 con 0x7f4b78003750 2021-11-12T05:49:58.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.509+0000 7f4b95827700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4b9013cec0 0x7f4b900b2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:58.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.509+0000 7f4b95827700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4b9013cec0 0x7f4b900b2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53002/0 (socket says 172.21.2.105:53002) 2021-11-12T05:49:58.524 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.509+0000 7f4b95827700 1 -- 172.21.2.105:0/2839759580 learned_addr learned my addr 172.21.2.105:0/2839759580 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:58.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.509+0000 7f4b95827700 1 -- 172.21.2.105:0/2839759580 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4b78003750 msgr2=0x7f4b900b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:58.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.509+0000 7f4b95827700 1 --2- 172.21.2.105:0/2839759580 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4b78003750 0x7f4b900b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:58.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.509+0000 7f4b95827700 1 -- 172.21.2.105:0/2839759580 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4b90142200 msgr2=0x7f4b900ae880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:58.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.509+0000 7f4b95827700 1 --2- 172.21.2.105:0/2839759580 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4b90142200 0x7f4b900ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:58.525 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.509+0000 7f4b95827700 1 -- 172.21.2.105:0/2839759580 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b900b32f0 con 0x7f4b9013cec0 2021-11-12T05:49:58.526 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.509+0000 7f4b95827700 1 --2- 172.21.2.105:0/2839759580 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4b9013cec0 0x7f4b900b2e00 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 rx=0x7f4b8c001fa0 tx=0x7f4b8c007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:58.526 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.509+0000 7f4b837fe700 1 -- 172.21.2.105:0/2839759580 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b8c00ce80 con 0x7f4b9013cec0 2021-11-12T05:49:58.526 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.509+0000 7f4b837fe700 1 -- 172.21.2.105:0/2839759580 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8c000e90 con 0x7f4b9013cec0 2021-11-12T05:49:58.526 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.509+0000 7f4b9828c700 1 -- 172.21.2.105:0/2839759580 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b900b4800 con 0x7f4b9013cec0 2021-11-12T05:49:58.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.509+0000 7f4b837fe700 1 -- 172.21.2.105:0/2839759580 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b8c007430 con 0x7f4b9013cec0 2021-11-12T05:49:58.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.509+0000 7f4b9828c700 1 -- 172.21.2.105:0/2839759580 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b900aef10 con 0x7f4b9013cec0 2021-11-12T05:49:58.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.509+0000 7f4b9828c700 1 -- 172.21.2.105:0/2839759580 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b90057350 con 0x7f4b9013cec0 2021-11-12T05:49:58.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.509+0000 7f4b837fe700 1 -- 172.21.2.105:0/2839759580 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4b8c01a060 con 0x7f4b9013cec0 2021-11-12T05:49:58.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.509+0000 7f4b837fe700 1 --2- 172.21.2.105:0/2839759580 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4b70053640 0x7f4b70055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:58.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.509+0000 7f4b837fe700 1 -- 172.21.2.105:0/2839759580 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f4b8c06b250 con 0x7f4b9013cec0 2021-11-12T05:49:58.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.509+0000 7f4b96028700 1 --2- 172.21.2.105:0/2839759580 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4b70053640 0x7f4b70055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:58.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.509+0000 7f4b96028700 1 --2- 172.21.2.105:0/2839759580 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4b70053640 0x7f4b70055b00 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f4b90060ea0 tx=0x7f4b84013000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:58.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.513+0000 7f4b837fe700 1 -- 172.21.2.105:0/2839759580 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4b8c042260 con 0x7f4b9013cec0 2021-11-12T05:49:58.625 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.621+0000 7f4b9828c700 1 -- 172.21.2.105:0/2839759580 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4b900ad270 con 0x7f4b9013cec0 2021-11-12T05:49:58.625 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.621+0000 7f4b837fe700 1 -- 172.21.2.105:0/2839759580 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f4b8c018020 con 0x7f4b9013cec0 2021-11-12T05:49:58.625 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:58.626 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":74,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5596,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/460551031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":460551031},{"type":"v1","addr":"172.21.2.115:6833","nonce":460551031}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":73}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:49:57.435843+0000","modified":"2021-11-12T05:49:58.439104+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8829},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8829":{"gid":8829,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/4094714006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":4094714006},{"type":"v1","addr":"172.21.2.105:6835","nonce":4094714006}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-11-12T05:49:58.627 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.621+0000 7f4b9828c700 1 -- 172.21.2.105:0/2839759580 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4b70053640 msgr2=0x7f4b70055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:58.627 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.621+0000 7f4b9828c700 1 --2- 172.21.2.105:0/2839759580 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4b70053640 0x7f4b70055b00 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f4b90060ea0 tx=0x7f4b84013000).stop 2021-11-12T05:49:58.627 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.621+0000 7f4b9828c700 1 -- 172.21.2.105:0/2839759580 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4b9013cec0 msgr2=0x7f4b900b2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:58.627 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.621+0000 7f4b9828c700 1 --2- 172.21.2.105:0/2839759580 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4b9013cec0 0x7f4b900b2e00 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 rx=0x7f4b8c001fa0 tx=0x7f4b8c007c30).stop 2021-11-12T05:49:58.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.621+0000 7f4b9828c700 1 -- 172.21.2.105:0/2839759580 shutdown_connections 2021-11-12T05:49:58.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.621+0000 7f4b9828c700 1 --2- 172.21.2.105:0/2839759580 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4b70053640 0x7f4b70055b00 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:58.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.621+0000 7f4b9828c700 1 --2- 172.21.2.105:0/2839759580 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4b90142200 0x7f4b900ae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:58.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.621+0000 7f4b9828c700 1 --2- 172.21.2.105:0/2839759580 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4b9013cec0 0x7f4b900b2e00 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:58.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.621+0000 7f4b9828c700 1 --2- 172.21.2.105:0/2839759580 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4b78003750 0x7f4b900b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:58.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.621+0000 7f4b9828c700 1 -- 172.21.2.105:0/2839759580 >> 172.21.2.105:0/2839759580 conn(0x7f4b900608d0 msgr2=0x7f4b9013d460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:58.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.621+0000 7f4b9828c700 1 -- 172.21.2.105:0/2839759580 shutdown_connections 2021-11-12T05:49:58.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.621+0000 7f4b9828c700 1 -- 172.21.2.105:0/2839759580 wait complete. 2021-11-12T05:49:58.629 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 74 2021-11-12T05:49:58.633 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:49:58.684 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.681+0000 7efc7566e700 1 Processor -- start 2021-11-12T05:49:58.684 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.681+0000 7efc7566e700 1 -- start start 2021-11-12T05:49:58.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.681+0000 7efc7566e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efc700adaf0 0x7efc7013fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:58.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.681+0000 7efc7566e700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7efc70143b40 0x7efc70143f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:58.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.681+0000 7efc7566e700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc70067860 con 0x7efc700aded0 2021-11-12T05:49:58.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.681+0000 7efc7566e700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc70143400 con 0x7efc70143b40 2021-11-12T05:49:58.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.681+0000 7efc7566e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc701436a0 con 0x7efc700adaf0 2021-11-12T05:49:58.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.681+0000 7efc6e7fc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7efc70143b40 0x7efc70143f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:58.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.681+0000 7efc6e7fc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7efc70143b40 0x7efc70143f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53010/0 (socket says 172.21.2.105:53010) 2021-11-12T05:49:58.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.681+0000 7efc6e7fc700 1 -- 172.21.2.105:0/2419188773 learned_addr learned my addr 172.21.2.105:0/2419188773 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:58.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.681+0000 7efc6e7fc700 1 -- 172.21.2.105:0/2419188773 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efc700adaf0 msgr2=0x7efc7013fd90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:49:58.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.681+0000 7efc6e7fc700 1 --2- 172.21.2.105:0/2419188773 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efc700adaf0 0x7efc7013fd90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:58.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.681+0000 7efc6e7fc700 1 -- 172.21.2.105:0/2419188773 >> v1:172.21.2.115:6789/0 conn(0x7efc700aded0 legacy=0x7efc700afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:58.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.681+0000 7efc6e7fc700 1 -- 172.21.2.105:0/2419188773 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc700b2b40 con 0x7efc70143b40 2021-11-12T05:49:58.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.681+0000 7efc6e7fc700 1 --2- 172.21.2.105:0/2419188773 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efc70143b40 0x7efc70143f80 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 rx=0x7efc700b63f0 tx=0x7efc60006eb0).ready entity=mon.0 client_cookie=26a565494ea44d0a server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:58.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.681+0000 7efc6dffb700 1 -- 172.21.2.105:0/2419188773 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc6000d570 con 0x7efc70143b40 2021-11-12T05:49:58.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.681+0000 7efc6dffb700 1 -- 172.21.2.105:0/2419188773 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc60000e90 con 0x7efc70143b40 2021-11-12T05:49:58.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.681+0000 7efc6dffb700 1 -- 172.21.2.105:0/2419188773 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc6000d8c0 con 0x7efc70143b40 2021-11-12T05:49:58.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.681+0000 7efc7566e700 1 -- 172.21.2.105:0/2419188773 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efc70143b40 msgr2=0x7efc70143f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:58.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.681+0000 7efc7566e700 1 --2- 172.21.2.105:0/2419188773 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efc70143b40 0x7efc70143f80 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 rx=0x7efc700b63f0 tx=0x7efc60006eb0).stop 2021-11-12T05:49:58.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.681+0000 7efc7566e700 1 -- 172.21.2.105:0/2419188773 shutdown_connections 2021-11-12T05:49:58.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.681+0000 7efc7566e700 1 --2- 172.21.2.105:0/2419188773 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efc70143b40 0x7efc70143f80 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:58.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.681+0000 7efc7566e700 1 --2- 172.21.2.105:0/2419188773 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efc700adaf0 0x7efc7013fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:58.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.681+0000 7efc7566e700 1 -- 172.21.2.105:0/2419188773 >> 172.21.2.105:0/2419188773 conn(0x7efc7005c490 msgr2=0x7efc7005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:58.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.681+0000 7efc7566e700 1 -- 172.21.2.105:0/2419188773 shutdown_connections 2021-11-12T05:49:58.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.681+0000 7efc7566e700 1 -- 172.21.2.105:0/2419188773 wait complete. 2021-11-12T05:49:58.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.681+0000 7efc7566e700 1 Processor -- start 2021-11-12T05:49:58.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.681+0000 7efc7566e700 1 -- start start 2021-11-12T05:49:58.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.685+0000 7efc7566e700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efc700adaf0 0x7efc70063ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:58.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.685+0000 7efc7566e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efc700aded0 0x7efc7013e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:58.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.685+0000 7efc7566e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efc70143b40 0x7efc7013ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:58.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.685+0000 7efc7566e700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc700ac6e0 con 0x7efc700aded0 2021-11-12T05:49:58.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.685+0000 7efc7566e700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc70157e20 con 0x7efc700adaf0 2021-11-12T05:49:58.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.685+0000 7efc7566e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc701575e0 con 0x7efc70143b40 2021-11-12T05:49:58.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.685+0000 7efc6e7fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efc700aded0 0x7efc7013e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:58.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.685+0000 7efc6e7fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efc700aded0 0x7efc7013e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53014/0 (socket says 172.21.2.105:53014) 2021-11-12T05:49:58.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.685+0000 7efc6e7fc700 1 -- 172.21.2.105:0/1093725760 learned_addr learned my addr 172.21.2.105:0/1093725760 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:58.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.685+0000 7efc6effd700 1 --2- 172.21.2.105:0/1093725760 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efc700adaf0 0x7efc70063ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:58.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.685+0000 7efc6e7fc700 1 -- 172.21.2.105:0/1093725760 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efc70143b40 msgr2=0x7efc7013ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:58.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.685+0000 7efc6e7fc700 1 --2- 172.21.2.105:0/1093725760 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efc70143b40 0x7efc7013ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:58.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.685+0000 7efc6e7fc700 1 -- 172.21.2.105:0/1093725760 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efc700adaf0 msgr2=0x7efc70063ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:58.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.685+0000 7efc6e7fc700 1 --2- 172.21.2.105:0/1093725760 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efc700adaf0 0x7efc70063ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:58.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.685+0000 7efc6e7fc700 1 -- 172.21.2.105:0/1093725760 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6000b1e0 con 0x7efc700aded0 2021-11-12T05:49:58.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.685+0000 7efc6effd700 1 --2- 172.21.2.105:0/1093725760 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efc700adaf0 0x7efc70063ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:49:58.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.685+0000 7efc6e7fc700 1 --2- 172.21.2.105:0/1093725760 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efc700aded0 0x7efc7013e990 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 rx=0x7efc700b63f0 tx=0x7efc60015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:58.697 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.685+0000 7efc5ffff700 1 -- 172.21.2.105:0/1093725760 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc60002f70 con 0x7efc700aded0 2021-11-12T05:49:58.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.685+0000 7efc5ffff700 1 -- 172.21.2.105:0/1093725760 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6000de20 con 0x7efc700aded0 2021-11-12T05:49:58.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.685+0000 7efc7566e700 1 -- 172.21.2.105:0/1093725760 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc70064190 con 0x7efc700aded0 2021-11-12T05:49:58.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.685+0000 7efc5ffff700 1 -- 172.21.2.105:0/1093725760 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc6001e460 con 0x7efc700aded0 2021-11-12T05:49:58.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.685+0000 7efc7566e700 1 -- 172.21.2.105:0/1093725760 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc7013f370 con 0x7efc700aded0 2021-11-12T05:49:58.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.685+0000 7efc7566e700 1 -- 172.21.2.105:0/1093725760 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc70064320 con 0x7efc700aded0 2021-11-12T05:49:58.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.685+0000 7efc5ffff700 1 -- 172.21.2.105:0/1093725760 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efc60025030 con 0x7efc700aded0 2021-11-12T05:49:58.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.685+0000 7efc5ffff700 1 --2- 172.21.2.105:0/1093725760 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efc4c053580 0x7efc4c055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:58.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.685+0000 7efc5ffff700 1 -- 172.21.2.105:0/1093725760 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6416+0+0 (secure 0 0 0) 0x7efc6006ce60 con 0x7efc700aded0 2021-11-12T05:49:58.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.685+0000 7efc6effd700 1 --2- 172.21.2.105:0/1093725760 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efc4c053580 0x7efc4c055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:58.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.685+0000 7efc6effd700 1 --2- 172.21.2.105:0/1093725760 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efc4c053580 0x7efc4c055a40 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7efc64007000 tx=0x7efc64008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:58.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.689+0000 7efc5ffff700 1 -- 172.21.2.105:0/1093725760 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efc60043e70 con 0x7efc700aded0 2021-11-12T05:49:58.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.769+0000 7efc7566e700 1 -- 172.21.2.105:0/1093725760 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc700afb00 con 0x7efc700aded0 2021-11-12T05:49:58.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.769+0000 7efc5ffff700 1 -- 172.21.2.105:0/1093725760 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v156) v1 ==== 74+0+16285 (secure 0 0 0) 0x7efc60023020 con 0x7efc700aded0 2021-11-12T05:49:58.774 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:58.775 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":156,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:49:58.440307+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:49:55.298718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-11-12T05:49:56.403004+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:49:58.776 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.773+0000 7efc7566e700 1 -- 172.21.2.105:0/1093725760 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efc4c053580 msgr2=0x7efc4c055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:58.776 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.773+0000 7efc7566e700 1 --2- 172.21.2.105:0/1093725760 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efc4c053580 0x7efc4c055a40 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7efc64007000 tx=0x7efc64008040).stop 2021-11-12T05:49:58.776 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.773+0000 7efc7566e700 1 -- 172.21.2.105:0/1093725760 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efc700aded0 msgr2=0x7efc7013e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:58.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.773+0000 7efc7566e700 1 --2- 172.21.2.105:0/1093725760 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efc700aded0 0x7efc7013e990 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 rx=0x7efc700b63f0 tx=0x7efc60015000).stop 2021-11-12T05:49:58.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.773+0000 7efc7566e700 1 -- 172.21.2.105:0/1093725760 shutdown_connections 2021-11-12T05:49:58.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.773+0000 7efc7566e700 1 --2- 172.21.2.105:0/1093725760 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efc4c053580 0x7efc4c055a40 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:58.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.773+0000 7efc7566e700 1 --2- 172.21.2.105:0/1093725760 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efc70143b40 0x7efc7013ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:58.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.773+0000 7efc7566e700 1 --2- 172.21.2.105:0/1093725760 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efc700aded0 0x7efc7013e990 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:58.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.773+0000 7efc7566e700 1 --2- 172.21.2.105:0/1093725760 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efc700adaf0 0x7efc70063ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:58.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.773+0000 7efc7566e700 1 -- 172.21.2.105:0/1093725760 >> 172.21.2.105:0/1093725760 conn(0x7efc7005c490 msgr2=0x7efc7005fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:58.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.773+0000 7efc7566e700 1 -- 172.21.2.105:0/1093725760 shutdown_connections 2021-11-12T05:49:58.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.773+0000 7efc7566e700 1 -- 172.21.2.105:0/1093725760 wait complete. 2021-11-12T05:49:58.782 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-12T05:49:58.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.833+0000 7ff29bf0a700 1 Processor -- start 2021-11-12T05:49:58.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.833+0000 7ff29bf0a700 1 -- start start 2021-11-12T05:49:58.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.833+0000 7ff29bf0a700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7ff2940ad0d0 0x7ff2940af590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:58.841 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.833+0000 7ff29bf0a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff294142c70 0x7ff2940ab9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:58.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.833+0000 7ff29bf0a700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2940b10b0 con 0x7ff2940626f0 2021-11-12T05:49:58.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.833+0000 7ff29bf0a700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff29413f5b0 con 0x7ff2940ad0d0 2021-11-12T05:49:58.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.833+0000 7ff29bf0a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff294062ad0 con 0x7ff294142c70 2021-11-12T05:49:58.842 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.833+0000 7ff299ca6700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7ff2940626f0 0x7ff2940ad870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:35184/0 (socket says 172.21.2.105:35184) 2021-11-12T05:49:58.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.833+0000 7ff299ca6700 1 -- 172.21.2.105:0/2040458635 learned_addr learned my addr 172.21.2.105:0/2040458635 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:49:58.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.833+0000 7ff29a4a7700 1 --2- 172.21.2.105:0/2040458635 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff294142c70 0x7ff2940ab9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:58.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.833+0000 7ff2994a5700 1 --2- 172.21.2.105:0/2040458635 >> v2:172.21.2.115:3300/0 conn(0x7ff2940ad0d0 0x7ff2940af590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:58.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.833+0000 7ff298ca4700 1 -- 172.21.2.105:0/2040458635 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1765367344 0 0) 0x7ff2940b10b0 con 0x7ff2940626f0 2021-11-12T05:49:58.843 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.833+0000 7ff298ca4700 1 -- 172.21.2.105:0/2040458635 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff27c003260 con 0x7ff2940626f0 2021-11-12T05:49:58.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.833+0000 7ff298ca4700 1 -- 172.21.2.105:0/2040458635 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3523913102 0 0) 0x7ff27c003260 con 0x7ff2940626f0 2021-11-12T05:49:58.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.833+0000 7ff298ca4700 1 -- 172.21.2.105:0/2040458635 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff294142c70 msgr2=0x7ff2940ab9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:58.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.833+0000 7ff298ca4700 1 --2- 172.21.2.105:0/2040458635 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff294142c70 0x7ff2940ab9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:58.844 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.833+0000 7ff298ca4700 1 -- 172.21.2.105:0/2040458635 >> v2:172.21.2.115:3300/0 conn(0x7ff2940ad0d0 msgr2=0x7ff2940af590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:58.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.833+0000 7ff298ca4700 1 --2- 172.21.2.105:0/2040458635 >> v2:172.21.2.115:3300/0 conn(0x7ff2940ad0d0 0x7ff2940af590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:58.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.833+0000 7ff298ca4700 1 -- 172.21.2.105:0/2040458635 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2940b12e0 con 0x7ff2940626f0 2021-11-12T05:49:58.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.833+0000 7ff298ca4700 1 -- 172.21.2.105:0/2040458635 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7ff284001660 con 0x7ff2940626f0 2021-11-12T05:49:58.845 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.833+0000 7ff298ca4700 1 -- 172.21.2.105:0/2040458635 >> v1:172.21.2.105:6789/0 conn(0x7ff2940626f0 legacy=0x7ff2940ad870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:58.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.833+0000 7ff298ca4700 1 --2- 172.21.2.105:0/2040458635 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff294142c70 0x7ff27c003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:58.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.833+0000 7ff298ca4700 1 --2- 172.21.2.105:0/2040458635 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff27c003c80 0x7ff27c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:58.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.833+0000 7ff298ca4700 1 --2- 172.21.2.105:0/2040458635 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff27c0049f0 0x7ff27c004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:58.846 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.833+0000 7ff298ca4700 1 -- 172.21.2.105:0/2040458635 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29413f5b0 con 0x7ff27c003c80 2021-11-12T05:49:58.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.833+0000 7ff298ca4700 1 -- 172.21.2.105:0/2040458635 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff294062ad0 con 0x7ff27c0049f0 2021-11-12T05:49:58.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff298ca4700 1 -- 172.21.2.105:0/2040458635 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c00b780 con 0x7ff294142c70 2021-11-12T05:49:58.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff2994a5700 1 --2- 172.21.2.105:0/2040458635 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff27c003c80 0x7ff27c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:58.847 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff2994a5700 1 -- 172.21.2.105:0/2040458635 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff294142c70 msgr2=0x7ff27c003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:58.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff299ca6700 1 --2- 172.21.2.105:0/2040458635 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff294142c70 0x7ff27c003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:58.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff2994a5700 1 --2- 172.21.2.105:0/2040458635 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff294142c70 0x7ff27c003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:58.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff2994a5700 1 -- 172.21.2.105:0/2040458635 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff27c0049f0 msgr2=0x7ff27c004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:58.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff2994a5700 1 --2- 172.21.2.105:0/2040458635 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff27c0049f0 0x7ff27c004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:58.848 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff2994a5700 1 -- 172.21.2.105:0/2040458635 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff27c003260 con 0x7ff27c003c80 2021-11-12T05:49:58.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff299ca6700 1 --2- 172.21.2.105:0/2040458635 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff294142c70 0x7ff27c003750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:49:58.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff2994a5700 1 --2- 172.21.2.105:0/2040458635 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff27c003c80 0x7ff27c004500 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 rx=0x7ff29000d000 tx=0x7ff290006e80).ready entity=mon.0 client_cookie=37764d04119c0b58 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:58.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff298ca4700 1 -- 172.21.2.105:0/2040458635 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff29000f6f0 con 0x7ff27c003c80 2021-11-12T05:49:58.849 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff298ca4700 1 -- 172.21.2.105:0/2040458635 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29000f850 con 0x7ff27c003c80 2021-11-12T05:49:58.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff298ca4700 1 -- 172.21.2.105:0/2040458635 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff29000fbb0 con 0x7ff27c003c80 2021-11-12T05:49:58.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff29bf0a700 1 -- 172.21.2.105:0/2040458635 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff27c003c80 msgr2=0x7ff27c004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:58.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff29bf0a700 1 --2- 172.21.2.105:0/2040458635 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff27c003c80 0x7ff27c004500 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 rx=0x7ff29000d000 tx=0x7ff290006e80).stop 2021-11-12T05:49:58.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff29a4a7700 1 -- 172.21.2.105:0/2040458635 reap_dead start 2021-11-12T05:49:58.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff29bf0a700 1 -- 172.21.2.105:0/2040458635 shutdown_connections 2021-11-12T05:49:58.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff29bf0a700 1 -- 172.21.2.105:0/2040458635 >> 172.21.2.105:0/2040458635 conn(0x7ff2940b5370 msgr2=0x7ff2940b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:58.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff29bf0a700 1 -- 172.21.2.105:0/2040458635 shutdown_connections 2021-11-12T05:49:58.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff29bf0a700 1 -- 172.21.2.105:0/2040458635 wait complete. 2021-11-12T05:49:58.851 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff29bf0a700 1 Processor -- start 2021-11-12T05:49:58.852 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff29bf0a700 1 -- start start 2021-11-12T05:49:58.854 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff29bf0a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff27c003c80 0x7ff294065280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:58.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff29bf0a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff2940aae80 0x7ff294156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:58.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff29bf0a700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff29415a550 0x7ff29415aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:58.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff29bf0a700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2940a8000 con 0x7ff2940aae80 2021-11-12T05:49:58.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff29bf0a700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29415a0f0 con 0x7ff29415a550 2021-11-12T05:49:58.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff29bf0a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff29415aef0 con 0x7ff27c003c80 2021-11-12T05:49:58.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff2994a5700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff2940aae80 0x7ff294156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:58.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff2994a5700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff2940aae80 0x7ff294156a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53032/0 (socket says 172.21.2.105:53032) 2021-11-12T05:49:58.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff2994a5700 1 -- 172.21.2.105:0/2055617024 learned_addr learned my addr 172.21.2.105:0/2055617024 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:58.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff2994a5700 1 -- 172.21.2.105:0/2055617024 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff27c003c80 msgr2=0x7ff294065280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:58.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff2994a5700 1 --2- 172.21.2.105:0/2055617024 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff27c003c80 0x7ff294065280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:58.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff2994a5700 1 -- 172.21.2.105:0/2055617024 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff29415a550 msgr2=0x7ff29415aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:58.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff2994a5700 1 --2- 172.21.2.105:0/2055617024 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff29415a550 0x7ff29415aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:58.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff2994a5700 1 -- 172.21.2.105:0/2055617024 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff294156f80 con 0x7ff2940aae80 2021-11-12T05:49:58.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff2994a5700 1 --2- 172.21.2.105:0/2055617024 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff2940aae80 0x7ff294156a90 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 rx=0x7ff29000d000 tx=0x7ff290006e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:58.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff282ffd700 1 -- 172.21.2.105:0/2055617024 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff29000f6f0 con 0x7ff2940aae80 2021-11-12T05:49:58.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff282ffd700 1 -- 172.21.2.105:0/2055617024 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff290000e90 con 0x7ff2940aae80 2021-11-12T05:49:58.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff29bf0a700 1 -- 172.21.2.105:0/2055617024 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2940ab5e0 con 0x7ff2940aae80 2021-11-12T05:49:58.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.837+0000 7ff282ffd700 1 -- 172.21.2.105:0/2055617024 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff29000fee0 con 0x7ff2940aae80 2021-11-12T05:49:58.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.841+0000 7ff29bf0a700 1 -- 172.21.2.105:0/2055617024 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2940ab880 con 0x7ff2940aae80 2021-11-12T05:49:58.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.841+0000 7ff29bf0a700 1 -- 172.21.2.105:0/2055617024 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2940b1580 con 0x7ff2940aae80 2021-11-12T05:49:58.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.841+0000 7ff282ffd700 1 -- 172.21.2.105:0/2055617024 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ff29002b070 con 0x7ff2940aae80 2021-11-12T05:49:58.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.841+0000 7ff282ffd700 1 --2- 172.21.2.105:0/2055617024 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff2740536e0 0x7ff274055ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:58.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.841+0000 7ff282ffd700 1 -- 172.21.2.105:0/2055617024 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6416+0+0 (secure 0 0 0) 0x7ff29006d060 con 0x7ff2940aae80 2021-11-12T05:49:58.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.841+0000 7ff299ca6700 1 --2- 172.21.2.105:0/2055617024 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff2740536e0 0x7ff274055ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:58.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.841+0000 7ff299ca6700 1 --2- 172.21.2.105:0/2055617024 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff2740536e0 0x7ff274055ba0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7ff284008000 tx=0x7ff284009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:58.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.841+0000 7ff282ffd700 1 -- 172.21.2.105:0/2055617024 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff290044070 con 0x7ff2940aae80 2021-11-12T05:49:58.958 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.953+0000 7ff29bf0a700 1 -- 172.21.2.105:0/2055617024 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7ff294057350 con 0x7ff2940aae80 2021-11-12T05:49:58.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.961+0000 7ff282ffd700 1 -- 172.21.2.105:0/2055617024 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v47) v1 ==== 184+0+0 (secure 0 0 0) 0x7ff29000c4a0 con 0x7ff2940aae80 2021-11-12T05:49:58.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.961+0000 7ff29bf0a700 1 -- 172.21.2.105:0/2055617024 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff2740536e0 msgr2=0x7ff274055ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:58.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.961+0000 7ff29bf0a700 1 --2- 172.21.2.105:0/2055617024 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff2740536e0 0x7ff274055ba0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7ff284008000 tx=0x7ff284009040).stop 2021-11-12T05:49:58.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.961+0000 7ff29bf0a700 1 -- 172.21.2.105:0/2055617024 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff2940aae80 msgr2=0x7ff294156a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:58.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.961+0000 7ff29bf0a700 1 --2- 172.21.2.105:0/2055617024 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff2940aae80 0x7ff294156a90 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 rx=0x7ff29000d000 tx=0x7ff290006e80).stop 2021-11-12T05:49:58.967 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.961+0000 7ff29bf0a700 1 -- 172.21.2.105:0/2055617024 shutdown_connections 2021-11-12T05:49:58.967 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.961+0000 7ff29bf0a700 1 --2- 172.21.2.105:0/2055617024 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff2740536e0 0x7ff274055ba0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:58.967 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.961+0000 7ff29bf0a700 1 --2- 172.21.2.105:0/2055617024 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff29415a550 0x7ff29415aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:58.967 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.961+0000 7ff29bf0a700 1 --2- 172.21.2.105:0/2055617024 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff2940aae80 0x7ff294156a90 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:58.968 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.961+0000 7ff29bf0a700 1 --2- 172.21.2.105:0/2055617024 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff27c003c80 0x7ff294065280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:58.968 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.961+0000 7ff29bf0a700 1 -- 172.21.2.105:0/2055617024 >> 172.21.2.105:0/2055617024 conn(0x7ff2940b5370 msgr2=0x7ff2940b0870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:58.968 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.961+0000 7ff29bf0a700 1 -- 172.21.2.105:0/2055617024 shutdown_connections 2021-11-12T05:49:58.968 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:58.961+0000 7ff29bf0a700 1 -- 172.21.2.105:0/2055617024 wait complete. 2021-11-12T05:49:58.969 INFO:teuthology.orchestra.run.gibba005.stderr:updated caps for client.0 2021-11-12T05:49:58.972 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-12T05:49:59.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.021+0000 7fa747bb0700 1 Processor -- start 2021-11-12T05:49:59.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa747bb0700 1 -- start start 2021-11-12T05:49:59.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa747bb0700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa740066be0 0x7fa7401426b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:59.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa747bb0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa7400acd20 0x7fa7400adf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:59.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa747bb0700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7400ac7b0 con 0x7fa7400b1380 2021-11-12T05:49:59.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa747bb0700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7400b0140 con 0x7fa740066be0 2021-11-12T05:49:59.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa747bb0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa740066fc0 con 0x7fa7400acd20 2021-11-12T05:49:59.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa74594c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa740066be0 0x7fa7401426b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:59.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa74594c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa740066be0 0x7fa7401426b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53038/0 (socket says 172.21.2.105:53038) 2021-11-12T05:49:59.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa74594c700 1 -- 172.21.2.105:0/3838246818 learned_addr learned my addr 172.21.2.105:0/3838246818 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:59.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa74594c700 1 -- 172.21.2.105:0/3838246818 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa7400acd20 msgr2=0x7fa7400adf20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:49:59.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa74594c700 1 --2- 172.21.2.105:0/3838246818 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa7400acd20 0x7fa7400adf20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:59.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa74594c700 1 -- 172.21.2.105:0/3838246818 >> v1:172.21.2.115:6789/0 conn(0x7fa7400b1380 legacy=0x7fa740142ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:49:59.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa74594c700 1 -- 172.21.2.105:0/3838246818 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7400afd10 con 0x7fa740066be0 2021-11-12T05:49:59.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa74594c700 1 --2- 172.21.2.105:0/3838246818 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa740066be0 0x7fa7401426b0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 rx=0x7fa7400b2f10 tx=0x7fa734006eb0).ready entity=mon.0 client_cookie=8c6faa75bc83c20f server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:59.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa74494a700 1 -- 172.21.2.105:0/3838246818 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa73400d570 con 0x7fa740066be0 2021-11-12T05:49:59.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa74494a700 1 -- 172.21.2.105:0/3838246818 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa734000e90 con 0x7fa740066be0 2021-11-12T05:49:59.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa74494a700 1 -- 172.21.2.105:0/3838246818 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa73400d8c0 con 0x7fa740066be0 2021-11-12T05:49:59.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa747bb0700 1 -- 172.21.2.105:0/3838246818 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa740066be0 msgr2=0x7fa7401426b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:59.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa747bb0700 1 --2- 172.21.2.105:0/3838246818 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa740066be0 0x7fa7401426b0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 rx=0x7fa7400b2f10 tx=0x7fa734006eb0).stop 2021-11-12T05:49:59.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa747bb0700 1 -- 172.21.2.105:0/3838246818 shutdown_connections 2021-11-12T05:49:59.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa747bb0700 1 --2- 172.21.2.105:0/3838246818 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa7400acd20 0x7fa7400adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:59.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa747bb0700 1 --2- 172.21.2.105:0/3838246818 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa740066be0 0x7fa7401426b0 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:59.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa747bb0700 1 -- 172.21.2.105:0/3838246818 >> 172.21.2.105:0/3838246818 conn(0x7fa7400b5370 msgr2=0x7fa7400b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:59.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa747bb0700 1 -- 172.21.2.105:0/3838246818 shutdown_connections 2021-11-12T05:49:59.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa747bb0700 1 -- 172.21.2.105:0/3838246818 wait complete. 2021-11-12T05:49:59.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa747bb0700 1 Processor -- start 2021-11-12T05:49:59.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa747bb0700 1 -- start start 2021-11-12T05:49:59.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa747bb0700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa740066be0 0x7fa7400a37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:59.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa747bb0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa7400acd20 0x7fa74009fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:59.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa747bb0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa7400b1380 0x7fa74009eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:59.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa747bb0700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7400a2930 con 0x7fa7400b1380 2021-11-12T05:49:59.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa747bb0700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7400a1830 con 0x7fa740066be0 2021-11-12T05:49:59.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa747bb0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7400a1430 con 0x7fa7400acd20 2021-11-12T05:49:59.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa74614d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa7400b1380 0x7fa74009eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:59.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa74614d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa7400b1380 0x7fa74009eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53046/0 (socket says 172.21.2.105:53046) 2021-11-12T05:49:59.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa74614d700 1 -- 172.21.2.105:0/2874841133 learned_addr learned my addr 172.21.2.105:0/2874841133 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:59.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa74614d700 1 -- 172.21.2.105:0/2874841133 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa7400acd20 msgr2=0x7fa74009fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:59.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa74614d700 1 --2- 172.21.2.105:0/2874841133 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa7400acd20 0x7fa74009fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:59.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa74614d700 1 -- 172.21.2.105:0/2874841133 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa740066be0 msgr2=0x7fa7400a37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:59.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa74614d700 1 --2- 172.21.2.105:0/2874841133 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa740066be0 0x7fa7400a37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:59.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa74614d700 1 -- 172.21.2.105:0/2874841133 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73400b1e0 con 0x7fa7400b1380 2021-11-12T05:49:59.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa74614d700 1 --2- 172.21.2.105:0/2874841133 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa7400b1380 0x7fa74009eb50 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 rx=0x7fa738003330 tx=0x7fa7380091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:59.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa732ffd700 1 -- 172.21.2.105:0/2874841133 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa738001520 con 0x7fa7400b1380 2021-11-12T05:49:59.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.025+0000 7fa732ffd700 1 -- 172.21.2.105:0/2874841133 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa738001680 con 0x7fa7400b1380 2021-11-12T05:49:59.042 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.029+0000 7fa747bb0700 1 -- 172.21.2.105:0/2874841133 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7400a5210 con 0x7fa7400b1380 2021-11-12T05:49:59.042 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.029+0000 7fa732ffd700 1 -- 172.21.2.105:0/2874841133 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7380019e0 con 0x7fa7400b1380 2021-11-12T05:49:59.042 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.029+0000 7fa747bb0700 1 -- 172.21.2.105:0/2874841133 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7400a56c0 con 0x7fa7400b1380 2021-11-12T05:49:59.042 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.029+0000 7fa747bb0700 1 -- 172.21.2.105:0/2874841133 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7400a5cb0 con 0x7fa7400b1380 2021-11-12T05:49:59.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.029+0000 7fa732ffd700 1 -- 172.21.2.105:0/2874841133 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa738018030 con 0x7fa7400b1380 2021-11-12T05:49:59.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.029+0000 7fa732ffd700 1 --2- 172.21.2.105:0/2874841133 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa7200536a0 0x7fa720055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:59.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.029+0000 7fa732ffd700 1 -- 172.21.2.105:0/2874841133 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fa73806b4a0 con 0x7fa7400b1380 2021-11-12T05:49:59.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.029+0000 7fa74594c700 1 --2- 172.21.2.105:0/2874841133 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa7200536a0 0x7fa720055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:59.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.029+0000 7fa74594c700 1 --2- 172.21.2.105:0/2874841133 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa7200536a0 0x7fa720055b60 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7fa7400b2f10 tx=0x7fa734015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:59.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.029+0000 7fa732ffd700 1 -- 172.21.2.105:0/2874841133 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa738042560 con 0x7fa7400b1380 2021-11-12T05:49:59.144 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.141+0000 7fa747bb0700 1 -- 172.21.2.105:0/2874841133 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fa7400ac9e0 con 0x7fa7400b1380 2021-11-12T05:49:59.149 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.145+0000 7fa732ffd700 1 -- 172.21.2.105:0/2874841133 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v48) v1 ==== 184+0+0 (secure 0 0 0) 0x7fa738045b80 con 0x7fa7400b1380 2021-11-12T05:49:59.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.145+0000 7fa747bb0700 1 -- 172.21.2.105:0/2874841133 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa7200536a0 msgr2=0x7fa720055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:59.151 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.145+0000 7fa747bb0700 1 --2- 172.21.2.105:0/2874841133 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa7200536a0 0x7fa720055b60 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7fa7400b2f10 tx=0x7fa734015000).stop 2021-11-12T05:49:59.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.145+0000 7fa747bb0700 1 -- 172.21.2.105:0/2874841133 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa7400b1380 msgr2=0x7fa74009eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:59.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.145+0000 7fa747bb0700 1 --2- 172.21.2.105:0/2874841133 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa7400b1380 0x7fa74009eb50 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 rx=0x7fa738003330 tx=0x7fa7380091a0).stop 2021-11-12T05:49:59.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.145+0000 7fa747bb0700 1 -- 172.21.2.105:0/2874841133 shutdown_connections 2021-11-12T05:49:59.152 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.145+0000 7fa747bb0700 1 --2- 172.21.2.105:0/2874841133 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa7200536a0 0x7fa720055b60 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:59.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.145+0000 7fa747bb0700 1 --2- 172.21.2.105:0/2874841133 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa7400b1380 0x7fa74009eb50 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:59.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.145+0000 7fa747bb0700 1 --2- 172.21.2.105:0/2874841133 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa7400acd20 0x7fa74009fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:59.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.145+0000 7fa747bb0700 1 --2- 172.21.2.105:0/2874841133 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa740066be0 0x7fa7400a37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:59.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.149+0000 7fa747bb0700 1 -- 172.21.2.105:0/2874841133 >> 172.21.2.105:0/2874841133 conn(0x7fa7400b5370 msgr2=0x7fa740140d00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:59.153 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.149+0000 7fa747bb0700 1 -- 172.21.2.105:0/2874841133 shutdown_connections 2021-11-12T05:49:59.154 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.149+0000 7fa747bb0700 1 -- 172.21.2.105:0/2874841133 wait complete. 2021-11-12T05:49:59.154 INFO:teuthology.orchestra.run.gibba005.stderr:updated caps for client.1 2021-11-12T05:49:59.157 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.2 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-11-12T05:49:59.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.209+0000 7fdac7e52700 1 Processor -- start 2021-11-12T05:49:59.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.209+0000 7fdac7e52700 1 -- start start 2021-11-12T05:49:59.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.209+0000 7fdac7e52700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdac00adaf0 0x7fdac013fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:59.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.209+0000 7fdac7e52700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fdac0143b40 0x7fdac0143f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:59.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.209+0000 7fdac7e52700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac0067860 con 0x7fdac00aded0 2021-11-12T05:49:59.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.209+0000 7fdac7e52700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdac0143400 con 0x7fdac0143b40 2021-11-12T05:49:59.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.209+0000 7fdac7e52700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac01436a0 con 0x7fdac00adaf0 2021-11-12T05:49:59.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.209+0000 7fdac53ed700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fdac0143b40 0x7fdac0143f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:59.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.209+0000 7fdac53ed700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fdac0143b40 0x7fdac0143f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53054/0 (socket says 172.21.2.105:53054) 2021-11-12T05:49:59.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.209+0000 7fdac53ed700 1 -- 172.21.2.105:0/244555959 learned_addr learned my addr 172.21.2.105:0/244555959 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:59.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.209+0000 7fdac53ed700 1 -- 172.21.2.105:0/244555959 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdac00adaf0 msgr2=0x7fdac013fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:59.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.209+0000 7fdac53ed700 1 --2- 172.21.2.105:0/244555959 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdac00adaf0 0x7fdac013fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:59.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.209+0000 7fdac53ed700 1 -- 172.21.2.105:0/244555959 >> v1:172.21.2.115:6789/0 conn(0x7fdac00aded0 legacy=0x7fdac00afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:59.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.209+0000 7fdac53ed700 1 -- 172.21.2.105:0/244555959 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac00b2b40 con 0x7fdac0143b40 2021-11-12T05:49:59.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.209+0000 7fdac53ed700 1 --2- 172.21.2.105:0/244555959 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdac0143b40 0x7fdac0143f80 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 rx=0x7fdac00b63f0 tx=0x7fdabc006eb0).ready entity=mon.0 client_cookie=18e8c706d122783a server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:59.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.209+0000 7fdac4bec700 1 -- 172.21.2.105:0/244555959 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdabc00d570 con 0x7fdac0143b40 2021-11-12T05:49:59.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.209+0000 7fdac4bec700 1 -- 172.21.2.105:0/244555959 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdabc000e90 con 0x7fdac0143b40 2021-11-12T05:49:59.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.209+0000 7fdac4bec700 1 -- 172.21.2.105:0/244555959 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdabc00d8c0 con 0x7fdac0143b40 2021-11-12T05:49:59.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.209+0000 7fdac7e52700 1 -- 172.21.2.105:0/244555959 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdac0143b40 msgr2=0x7fdac0143f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:59.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.209+0000 7fdac7e52700 1 --2- 172.21.2.105:0/244555959 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdac0143b40 0x7fdac0143f80 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 rx=0x7fdac00b63f0 tx=0x7fdabc006eb0).stop 2021-11-12T05:49:59.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.209+0000 7fdac7e52700 1 -- 172.21.2.105:0/244555959 shutdown_connections 2021-11-12T05:49:59.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.209+0000 7fdac7e52700 1 --2- 172.21.2.105:0/244555959 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdac0143b40 0x7fdac0143f80 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:59.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.209+0000 7fdac7e52700 1 --2- 172.21.2.105:0/244555959 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdac00adaf0 0x7fdac013fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:59.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.209+0000 7fdac7e52700 1 -- 172.21.2.105:0/244555959 >> 172.21.2.105:0/244555959 conn(0x7fdac005c490 msgr2=0x7fdac005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:59.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.209+0000 7fdac7e52700 1 -- 172.21.2.105:0/244555959 shutdown_connections 2021-11-12T05:49:59.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.209+0000 7fdac7e52700 1 -- 172.21.2.105:0/244555959 wait complete. 2021-11-12T05:49:59.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.213+0000 7fdac7e52700 1 Processor -- start 2021-11-12T05:49:59.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.213+0000 7fdac7e52700 1 -- start start 2021-11-12T05:49:59.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.213+0000 7fdac7e52700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdac00adaf0 0x7fdac00acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:59.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.213+0000 7fdac7e52700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdac00aded0 0x7fdac0135820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:59.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.213+0000 7fdac7e52700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdac0143b40 0x7fdac013d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:59.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.213+0000 7fdac7e52700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac00ac340 con 0x7fdac0143b40 2021-11-12T05:49:59.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.213+0000 7fdac7e52700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac013f620 con 0x7fdac00adaf0 2021-11-12T05:49:59.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.213+0000 7fdac7e52700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac013f8c0 con 0x7fdac00aded0 2021-11-12T05:49:59.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.213+0000 7fdac63ef700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdac0143b40 0x7fdac013d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:59.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.213+0000 7fdac63ef700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdac0143b40 0x7fdac013d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53058/0 (socket says 172.21.2.105:53058) 2021-11-12T05:49:59.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.213+0000 7fdac63ef700 1 -- 172.21.2.105:0/1323785864 learned_addr learned my addr 172.21.2.105:0/1323785864 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:59.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.213+0000 7fdac5bee700 1 --2- 172.21.2.105:0/1323785864 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdac00adaf0 0x7fdac00acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:59.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.213+0000 7fdac53ed700 1 --2- 172.21.2.105:0/1323785864 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdac00aded0 0x7fdac0135820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:59.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.213+0000 7fdac63ef700 1 -- 172.21.2.105:0/1323785864 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdac00aded0 msgr2=0x7fdac0135820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:59.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.213+0000 7fdac63ef700 1 --2- 172.21.2.105:0/1323785864 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdac00aded0 0x7fdac0135820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:59.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.213+0000 7fdac63ef700 1 -- 172.21.2.105:0/1323785864 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdac00adaf0 msgr2=0x7fdac00acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:59.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.213+0000 7fdac63ef700 1 --2- 172.21.2.105:0/1323785864 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdac00adaf0 0x7fdac00acdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:59.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.213+0000 7fdac63ef700 1 -- 172.21.2.105:0/1323785864 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdabc00b1e0 con 0x7fdac0143b40 2021-11-12T05:49:59.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.213+0000 7fdac53ed700 1 --2- 172.21.2.105:0/1323785864 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdac00aded0 0x7fdac0135820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:49:59.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.213+0000 7fdac63ef700 1 --2- 172.21.2.105:0/1323785864 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdac0143b40 0x7fdac013d980 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 rx=0x7fdab8003310 tx=0x7fdab80091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:59.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.213+0000 7fdaaeffd700 1 -- 172.21.2.105:0/1323785864 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdab8001500 con 0x7fdac0143b40 2021-11-12T05:49:59.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.213+0000 7fdaaeffd700 1 -- 172.21.2.105:0/1323785864 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab8001660 con 0x7fdac0143b40 2021-11-12T05:49:59.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.213+0000 7fdac7e52700 1 -- 172.21.2.105:0/1323785864 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac013fb60 con 0x7fdac0143b40 2021-11-12T05:49:59.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.213+0000 7fdaaeffd700 1 -- 172.21.2.105:0/1323785864 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdab80019c0 con 0x7fdac0143b40 2021-11-12T05:49:59.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.213+0000 7fdac7e52700 1 -- 172.21.2.105:0/1323785864 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac00ab490 con 0x7fdac0143b40 2021-11-12T05:49:59.227 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.213+0000 7fdac7e52700 1 -- 172.21.2.105:0/1323785864 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac013fcf0 con 0x7fdac0143b40 2021-11-12T05:49:59.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.213+0000 7fdaaeffd700 1 -- 172.21.2.105:0/1323785864 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdab8018030 con 0x7fdac0143b40 2021-11-12T05:49:59.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.213+0000 7fdaaeffd700 1 --2- 172.21.2.105:0/1323785864 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdaa0053610 0x7fdaa0055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:59.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.213+0000 7fdaaeffd700 1 -- 172.21.2.105:0/1323785864 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fdab806b410 con 0x7fdac0143b40 2021-11-12T05:49:59.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.213+0000 7fdac5bee700 1 --2- 172.21.2.105:0/1323785864 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdaa0053610 0x7fdaa0055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:59.228 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.213+0000 7fdac5bee700 1 --2- 172.21.2.105:0/1323785864 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdaa0053610 0x7fdaa0055ad0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7fdab000a000 tx=0x7fdab0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:59.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.217+0000 7fdaaeffd700 1 -- 172.21.2.105:0/1323785864 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdab80424d0 con 0x7fdac0143b40 2021-11-12T05:49:59.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.329+0000 7fdac7e52700 1 -- 172.21.2.105:0/1323785864 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fdac00afb00 con 0x7fdac0143b40 2021-11-12T05:49:59.337 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.333+0000 7fdaaeffd700 1 -- 172.21.2.105:0/1323785864 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.2", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.2 v49) v1 ==== 184+0+0 (secure 0 0 0) 0x7fdab8045af0 con 0x7fdac0143b40 2021-11-12T05:49:59.338 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.333+0000 7fdac7e52700 1 -- 172.21.2.105:0/1323785864 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdaa0053610 msgr2=0x7fdaa0055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:59.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.333+0000 7fdac7e52700 1 --2- 172.21.2.105:0/1323785864 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdaa0053610 0x7fdaa0055ad0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7fdab000a000 tx=0x7fdab0008040).stop 2021-11-12T05:49:59.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.333+0000 7fdac7e52700 1 -- 172.21.2.105:0/1323785864 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdac0143b40 msgr2=0x7fdac013d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:59.339 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.333+0000 7fdac7e52700 1 --2- 172.21.2.105:0/1323785864 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdac0143b40 0x7fdac013d980 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 rx=0x7fdab8003310 tx=0x7fdab80091a0).stop 2021-11-12T05:49:59.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.333+0000 7fdac7e52700 1 -- 172.21.2.105:0/1323785864 shutdown_connections 2021-11-12T05:49:59.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.333+0000 7fdac7e52700 1 --2- 172.21.2.105:0/1323785864 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fdaa0053610 0x7fdaa0055ad0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:59.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.333+0000 7fdac7e52700 1 --2- 172.21.2.105:0/1323785864 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fdac0143b40 0x7fdac013d980 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:59.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.333+0000 7fdac7e52700 1 --2- 172.21.2.105:0/1323785864 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdac00aded0 0x7fdac0135820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:59.340 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.333+0000 7fdac7e52700 1 --2- 172.21.2.105:0/1323785864 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdac00adaf0 0x7fdac00acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:59.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.333+0000 7fdac7e52700 1 -- 172.21.2.105:0/1323785864 >> 172.21.2.105:0/1323785864 conn(0x7fdac005c490 msgr2=0x7fdac00afe10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:59.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.333+0000 7fdac7e52700 1 -- 172.21.2.105:0/1323785864 shutdown_connections 2021-11-12T05:49:59.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.333+0000 7fdac7e52700 1 -- 172.21.2.105:0/1323785864 wait complete. 2021-11-12T05:49:59.342 INFO:teuthology.orchestra.run.gibba005.stderr:updated caps for client.2 2021-11-12T05:49:59.345 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:49:59.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.393+0000 7f7fe2d6b700 1 Processor -- start 2021-11-12T05:49:59.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.393+0000 7f7fe2d6b700 1 -- start start 2021-11-12T05:49:59.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.393+0000 7f7fe2d6b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f7fdc0b01b0 0x7f7fdc0b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:59.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.393+0000 7f7fe2d6b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7fdc0aeb80 0x7f7fdc13e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:59.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.393+0000 7f7fe2d6b700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fdc0b5ea0 con 0x7f7fdc0b5ac0 2021-11-12T05:49:59.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.393+0000 7f7fe2d6b700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fdc0b1a60 con 0x7f7fdc0b01b0 2021-11-12T05:49:59.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.393+0000 7f7fe2d6b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc0accd0 con 0x7f7fdc0aeb80 2021-11-12T05:49:59.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.393+0000 7f7fdbfff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f7fdc0b01b0 0x7f7fdc0b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:59.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.393+0000 7f7fdbfff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f7fdc0b01b0 0x7f7fdc0b13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53066/0 (socket says 172.21.2.105:53066) 2021-11-12T05:49:59.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.393+0000 7f7fdbfff700 1 -- 172.21.2.105:0/392915553 learned_addr learned my addr 172.21.2.105:0/392915553 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:59.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.393+0000 7f7fdbfff700 1 -- 172.21.2.105:0/392915553 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7fdc0aeb80 msgr2=0x7f7fdc13e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:59.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.393+0000 7f7fdbfff700 1 --2- 172.21.2.105:0/392915553 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7fdc0aeb80 0x7f7fdc13e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:59.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.393+0000 7f7fdbfff700 1 -- 172.21.2.105:0/392915553 >> v1:172.21.2.115:6789/0 conn(0x7f7fdc0b5ac0 legacy=0x7f7fdc0ae470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:59.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.393+0000 7f7fdbfff700 1 -- 172.21.2.105:0/392915553 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fdc0acf70 con 0x7f7fdc0b01b0 2021-11-12T05:49:59.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.393+0000 7f7fdbfff700 1 --2- 172.21.2.105:0/392915553 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7fdc0b01b0 0x7f7fdc0b13c0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 rx=0x7f7fdc05d0f0 tx=0x7f7fc4006f40).ready entity=mon.0 client_cookie=32b1cf86a49887ad server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:59.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.393+0000 7f7fdb7fe700 1 -- 172.21.2.105:0/392915553 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fc400f070 con 0x7f7fdc0b01b0 2021-11-12T05:49:59.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.393+0000 7f7fdb7fe700 1 -- 172.21.2.105:0/392915553 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc4000e90 con 0x7f7fdc0b01b0 2021-11-12T05:49:59.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.393+0000 7f7fdb7fe700 1 -- 172.21.2.105:0/392915553 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fc400a0d0 con 0x7f7fdc0b01b0 2021-11-12T05:49:59.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.393+0000 7f7fe2d6b700 1 -- 172.21.2.105:0/392915553 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7fdc0b01b0 msgr2=0x7f7fdc0b13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:59.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.393+0000 7f7fe2d6b700 1 --2- 172.21.2.105:0/392915553 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7fdc0b01b0 0x7f7fdc0b13c0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 rx=0x7f7fdc05d0f0 tx=0x7f7fc4006f40).stop 2021-11-12T05:49:59.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.393+0000 7f7fe2d6b700 1 -- 172.21.2.105:0/392915553 shutdown_connections 2021-11-12T05:49:59.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.393+0000 7f7fe2d6b700 1 --2- 172.21.2.105:0/392915553 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7fdc0aeb80 0x7f7fdc13e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:59.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.393+0000 7f7fe2d6b700 1 --2- 172.21.2.105:0/392915553 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7fdc0b01b0 0x7f7fdc0b13c0 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:59.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.393+0000 7f7fe2d6b700 1 -- 172.21.2.105:0/392915553 >> 172.21.2.105:0/392915553 conn(0x7f7fdc0628b0 msgr2=0x7f7fdc062c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:59.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.393+0000 7f7fe2d6b700 1 -- 172.21.2.105:0/392915553 shutdown_connections 2021-11-12T05:49:59.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.393+0000 7f7fe2d6b700 1 -- 172.21.2.105:0/392915553 wait complete. 2021-11-12T05:49:59.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.397+0000 7f7fe2d6b700 1 Processor -- start 2021-11-12T05:49:59.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.397+0000 7f7fe2d6b700 1 -- start start 2021-11-12T05:49:59.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.397+0000 7f7fe2d6b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7fdc0aeb80 0x7f7fdc12e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:59.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.397+0000 7f7fe2d6b700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7fdc0b01b0 0x7f7fdc065c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:59.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.397+0000 7f7fe2d6b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7fdc0b5ac0 0x7f7fdc063eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:59.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.397+0000 7f7fe2d6b700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc134670 con 0x7f7fdc0aeb80 2021-11-12T05:49:59.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.397+0000 7f7fe2d6b700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc1351b0 con 0x7f7fdc0b01b0 2021-11-12T05:49:59.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.397+0000 7f7fe2d6b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc066110 con 0x7f7fdc0b5ac0 2021-11-12T05:49:59.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.397+0000 7f7fe0b07700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7fdc0aeb80 0x7f7fdc12e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:59.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.397+0000 7f7fe0b07700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7fdc0aeb80 0x7f7fdc12e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53070/0 (socket says 172.21.2.105:53070) 2021-11-12T05:49:59.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.397+0000 7f7fe0b07700 1 -- 172.21.2.105:0/2715276900 learned_addr learned my addr 172.21.2.105:0/2715276900 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:59.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.397+0000 7f7fe0b07700 1 -- 172.21.2.105:0/2715276900 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7fdc0b5ac0 msgr2=0x7f7fdc063eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:59.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.397+0000 7f7fe0b07700 1 --2- 172.21.2.105:0/2715276900 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7fdc0b5ac0 0x7f7fdc063eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:59.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.397+0000 7f7fe0b07700 1 -- 172.21.2.105:0/2715276900 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7fdc0b01b0 msgr2=0x7f7fdc065c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:59.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.397+0000 7f7fe0b07700 1 --2- 172.21.2.105:0/2715276900 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7fdc0b01b0 0x7f7fdc065c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:59.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.397+0000 7f7fe0b07700 1 -- 172.21.2.105:0/2715276900 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc400abf0 con 0x7f7fdc0aeb80 2021-11-12T05:49:59.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.397+0000 7f7fe0b07700 1 --2- 172.21.2.105:0/2715276900 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7fdc0aeb80 0x7f7fdc12e2e0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 rx=0x7f7fdc135340 tx=0x7f7fcc006d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:59.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.397+0000 7f7fd9ffb700 1 -- 172.21.2.105:0/2715276900 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fcc00f510 con 0x7f7fdc0aeb80 2021-11-12T05:49:59.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.397+0000 7f7fd9ffb700 1 -- 172.21.2.105:0/2715276900 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fcc00f670 con 0x7f7fdc0aeb80 2021-11-12T05:49:59.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.397+0000 7f7fe2d6b700 1 -- 172.21.2.105:0/2715276900 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fdc12ee00 con 0x7f7fdc0aeb80 2021-11-12T05:49:59.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.397+0000 7f7fd9ffb700 1 -- 172.21.2.105:0/2715276900 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7fcc00f7e0 con 0x7f7fdc0aeb80 2021-11-12T05:49:59.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.397+0000 7f7fe2d6b700 1 -- 172.21.2.105:0/2715276900 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fdc134f10 con 0x7f7fdc0aeb80 2021-11-12T05:49:59.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.397+0000 7f7fe2d6b700 1 -- 172.21.2.105:0/2715276900 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fdc0ad410 con 0x7f7fdc0aeb80 2021-11-12T05:49:59.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.397+0000 7f7fd9ffb700 1 -- 172.21.2.105:0/2715276900 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7fcc017020 con 0x7f7fdc0aeb80 2021-11-12T05:49:59.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.397+0000 7f7fd9ffb700 1 --2- 172.21.2.105:0/2715276900 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7fc0053660 0x7f7fc0055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:59.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.397+0000 7f7fd9ffb700 1 -- 172.21.2.105:0/2715276900 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f7fcc06b2f0 con 0x7f7fdc0aeb80 2021-11-12T05:49:59.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.397+0000 7f7fdbfff700 1 --2- 172.21.2.105:0/2715276900 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7fc0053660 0x7f7fc0055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:59.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.397+0000 7f7fdbfff700 1 --2- 172.21.2.105:0/2715276900 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7fc0053660 0x7f7fc0055b20 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f7fdc05d0f0 tx=0x7f7fc4016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:59.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.401+0000 7f7fd9ffb700 1 -- 172.21.2.105:0/2715276900 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7fcc0421f0 con 0x7f7fdc0aeb80 2021-11-12T05:49:59.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.509+0000 7f7fe2d6b700 1 -- 172.21.2.105:0/2715276900 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7fdc057350 con 0x7f7fdc0aeb80 2021-11-12T05:49:59.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.509+0000 7f7fd9ffb700 1 -- 172.21.2.105:0/2715276900 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f7fcc015070 con 0x7f7fdc0aeb80 2021-11-12T05:49:59.514 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:59.514 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":74,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5596,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/460551031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":460551031},{"type":"v1","addr":"172.21.2.115:6833","nonce":460551031}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":73}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:49:57.435843+0000","modified":"2021-11-12T05:49:58.439104+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8829},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8829":{"gid":8829,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/4094714006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":4094714006},{"type":"v1","addr":"172.21.2.105:6835","nonce":4094714006}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-11-12T05:49:59.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.509+0000 7f7fe2d6b700 1 -- 172.21.2.105:0/2715276900 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7fc0053660 msgr2=0x7f7fc0055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:59.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.509+0000 7f7fe2d6b700 1 --2- 172.21.2.105:0/2715276900 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7fc0053660 0x7f7fc0055b20 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f7fdc05d0f0 tx=0x7f7fc4016000).stop 2021-11-12T05:49:59.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.509+0000 7f7fe2d6b700 1 -- 172.21.2.105:0/2715276900 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7fdc0aeb80 msgr2=0x7f7fdc12e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:59.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.509+0000 7f7fe2d6b700 1 --2- 172.21.2.105:0/2715276900 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7fdc0aeb80 0x7f7fdc12e2e0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 rx=0x7f7fdc135340 tx=0x7f7fcc006d70).stop 2021-11-12T05:49:59.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.509+0000 7f7fe2d6b700 1 -- 172.21.2.105:0/2715276900 shutdown_connections 2021-11-12T05:49:59.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.509+0000 7f7fe2d6b700 1 --2- 172.21.2.105:0/2715276900 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7fc0053660 0x7f7fc0055b20 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:59.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.509+0000 7f7fe2d6b700 1 --2- 172.21.2.105:0/2715276900 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7fdc0b5ac0 0x7f7fdc063eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:59.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.509+0000 7f7fe2d6b700 1 --2- 172.21.2.105:0/2715276900 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7fdc0b01b0 0x7f7fdc065c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:59.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.509+0000 7f7fe2d6b700 1 --2- 172.21.2.105:0/2715276900 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7fdc0aeb80 0x7f7fdc12e2e0 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:59.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.509+0000 7f7fe2d6b700 1 -- 172.21.2.105:0/2715276900 >> 172.21.2.105:0/2715276900 conn(0x7f7fdc0628b0 msgr2=0x7f7fdc0b5010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:59.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.513+0000 7f7fe2d6b700 1 -- 172.21.2.105:0/2715276900 shutdown_connections 2021-11-12T05:49:59.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.513+0000 7f7fe2d6b700 1 -- 172.21.2.105:0/2715276900 wait complete. 2021-11-12T05:49:59.518 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 74 2021-11-12T05:49:59.723 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 74, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:49:57.435843+0000', 'modified': '2021-11-12T05:49:58.439104+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8829}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8829': {'gid': 8829, 'name': 'a', 'rank': 0, 'incarnation': 73, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/4094714006', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 4094714006}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 4094714006}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:49:59.723 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:49:59.724 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:49:59.805 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":8829,"want_state":"up:active","state":"up:active","rank_uptime":2.362271657,"mdsmap_epoch":74,"osdmap_epoch":156,"osdmap_epoch_barrier":155,"uptime":6.5339412960000001} 2021-11-12T05:49:59.806 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 8829, "mdsmap_epoch": 74, "osdmap_epoch": 156, "osdmap_epoch_barrier": 155, "rank_uptime": 2.362271657, "state": "up:active", "uptime": 6.533941296, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:49:59.807 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:49:59.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.853+0000 7efdb548a700 1 Processor -- start 2021-11-12T05:49:59.856 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.853+0000 7efdb548a700 1 -- start start 2021-11-12T05:49:59.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.853+0000 7efdb548a700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7efdb00ac280 0x7efdb014b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:59.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.853+0000 7efdb548a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efdb00af730 0x7efdb00ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:59.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.853+0000 7efdb548a700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdb00ac7b0 con 0x7efdb00ad080 2021-11-12T05:49:59.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.853+0000 7efdb548a700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb01488a0 con 0x7efdb00ac280 2021-11-12T05:49:59.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.853+0000 7efdb548a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb00ac9e0 con 0x7efdb00af730 2021-11-12T05:49:59.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.853+0000 7efdae7fc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7efdb00ac280 0x7efdb014b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:59.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.853+0000 7efdae7fc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7efdb00ac280 0x7efdb014b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53080/0 (socket says 172.21.2.105:53080) 2021-11-12T05:49:59.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.853+0000 7efdae7fc700 1 -- 172.21.2.105:0/3449343697 learned_addr learned my addr 172.21.2.105:0/3449343697 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:59.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.853+0000 7efdaeffd700 1 --1- 172.21.2.105:0/3449343697 >> v1:172.21.2.105:6789/0 conn(0x7efdb00ad080 0x7efdb014abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:35240/0 (socket says 172.21.2.105:35240) 2021-11-12T05:49:59.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.853+0000 7efdae7fc700 1 -- 172.21.2.105:0/3449343697 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efdb00af730 msgr2=0x7efdb00ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:49:59.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.853+0000 7efdae7fc700 1 --2- 172.21.2.105:0/3449343697 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efdb00af730 0x7efdb00ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:59.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.853+0000 7efdae7fc700 1 -- 172.21.2.105:0/3449343697 >> v1:172.21.2.105:6789/0 conn(0x7efdb00ad080 legacy=0x7efdb014abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:59.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.853+0000 7efdadffb700 1 -- 172.21.2.105:0/3449343697 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1047650516 0 0) 0x7efdb00ac7b0 con 0x7efdb00ad080 2021-11-12T05:49:59.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.853+0000 7efdae7fc700 1 -- 172.21.2.105:0/3449343697 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb00b0b30 con 0x7efdb00ac280 2021-11-12T05:49:59.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.853+0000 7efdae7fc700 1 --2- 172.21.2.105:0/3449343697 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efdb00ac280 0x7efdb014b2f0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 rx=0x7efda0002f70 tx=0x7efda0006eb0).ready entity=mon.0 client_cookie=88ecbf4b3a5504ac server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:59.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.853+0000 7efdadffb700 1 -- 172.21.2.105:0/3449343697 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efda000d5c0 con 0x7efdb00ac280 2021-11-12T05:49:59.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.853+0000 7efdadffb700 1 -- 172.21.2.105:0/3449343697 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda0000e90 con 0x7efdb00ac280 2021-11-12T05:49:59.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.853+0000 7efdadffb700 1 -- 172.21.2.105:0/3449343697 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efda000d910 con 0x7efdb00ac280 2021-11-12T05:49:59.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.853+0000 7efdb548a700 1 -- 172.21.2.105:0/3449343697 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efdb00ac280 msgr2=0x7efdb014b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:59.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.853+0000 7efdb548a700 1 --2- 172.21.2.105:0/3449343697 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efdb00ac280 0x7efdb014b2f0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 rx=0x7efda0002f70 tx=0x7efda0006eb0).stop 2021-11-12T05:49:59.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.853+0000 7efdb548a700 1 -- 172.21.2.105:0/3449343697 shutdown_connections 2021-11-12T05:49:59.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.853+0000 7efdb548a700 1 --2- 172.21.2.105:0/3449343697 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efdb00af730 0x7efdb00ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:49:59.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.853+0000 7efdb548a700 1 --2- 172.21.2.105:0/3449343697 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efdb00ac280 0x7efdb014b2f0 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:59.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.853+0000 7efdb548a700 1 -- 172.21.2.105:0/3449343697 >> 172.21.2.105:0/3449343697 conn(0x7efdb00b5370 msgr2=0x7efdb00b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:59.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.853+0000 7efdb548a700 1 -- 172.21.2.105:0/3449343697 shutdown_connections 2021-11-12T05:49:59.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.853+0000 7efdb548a700 1 -- 172.21.2.105:0/3449343697 wait complete. 2021-11-12T05:49:59.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.857+0000 7efdb548a700 1 Processor -- start 2021-11-12T05:49:59.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.857+0000 7efdb548a700 1 -- start start 2021-11-12T05:49:59.867 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.857+0000 7efdb548a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efdb00ac280 0x7efdb00608a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:59.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.857+0000 7efdb548a700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efdb00ad080 0x7efdb015aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:59.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.857+0000 7efdb548a700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efdb00af730 0x7efdb00a7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:59.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.857+0000 7efdb548a700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb015a380 con 0x7efdb00ac280 2021-11-12T05:49:59.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.857+0000 7efdb548a700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb015a620 con 0x7efdb00ad080 2021-11-12T05:49:59.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.857+0000 7efdb548a700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb00a9230 con 0x7efdb00af730 2021-11-12T05:49:59.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.857+0000 7efdaeffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efdb00ac280 0x7efdb00608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:59.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.857+0000 7efdaeffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efdb00ac280 0x7efdb00608a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53082/0 (socket says 172.21.2.105:53082) 2021-11-12T05:49:59.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.857+0000 7efdaeffd700 1 -- 172.21.2.105:0/523674230 learned_addr learned my addr 172.21.2.105:0/523674230 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:49:59.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.857+0000 7efdae7fc700 1 --2- 172.21.2.105:0/523674230 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efdb00ad080 0x7efdb015aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:59.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.857+0000 7efdaf7fe700 1 --2- 172.21.2.105:0/523674230 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efdb00af730 0x7efdb00a7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:59.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.857+0000 7efdaeffd700 1 -- 172.21.2.105:0/523674230 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efdb00af730 msgr2=0x7efdb00a7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:59.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.857+0000 7efdaeffd700 1 --2- 172.21.2.105:0/523674230 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efdb00af730 0x7efdb00a7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:59.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.857+0000 7efdaeffd700 1 -- 172.21.2.105:0/523674230 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efdb00ad080 msgr2=0x7efdb015aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:59.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.857+0000 7efdaeffd700 1 --2- 172.21.2.105:0/523674230 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efdb00ad080 0x7efdb015aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:59.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.857+0000 7efdaeffd700 1 -- 172.21.2.105:0/523674230 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda000b1e0 con 0x7efdb00ac280 2021-11-12T05:49:59.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.857+0000 7efdae7fc700 1 --2- 172.21.2.105:0/523674230 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efdb00ad080 0x7efdb015aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:49:59.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.857+0000 7efdaf7fe700 1 --2- 172.21.2.105:0/523674230 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efdb00af730 0x7efdb00a7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:49:59.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.857+0000 7efdaeffd700 1 --2- 172.21.2.105:0/523674230 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efdb00ac280 0x7efdb00608a0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 rx=0x7efd98000ed0 tx=0x7efd98007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:59.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.857+0000 7efda7fff700 1 -- 172.21.2.105:0/523674230 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd980072e0 con 0x7efdb00ac280 2021-11-12T05:49:59.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.857+0000 7efda7fff700 1 -- 172.21.2.105:0/523674230 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd98005550 con 0x7efdb00ac280 2021-11-12T05:49:59.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.857+0000 7efdb548a700 1 -- 172.21.2.105:0/523674230 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb0060d90 con 0x7efdb00ac280 2021-11-12T05:49:59.872 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.857+0000 7efdb548a700 1 -- 172.21.2.105:0/523674230 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb0063b70 con 0x7efdb00ac280 2021-11-12T05:49:59.873 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.857+0000 7efda7fff700 1 -- 172.21.2.105:0/523674230 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd980058b0 con 0x7efdb00ac280 2021-11-12T05:49:59.873 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.857+0000 7efdb548a700 1 -- 172.21.2.105:0/523674230 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb00a9890 con 0x7efdb00ac280 2021-11-12T05:49:59.873 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.857+0000 7efda7fff700 1 -- 172.21.2.105:0/523674230 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efd9801a060 con 0x7efdb00ac280 2021-11-12T05:49:59.873 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.857+0000 7efda7fff700 1 --2- 172.21.2.105:0/523674230 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efd94053640 0x7efd94055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:49:59.873 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.857+0000 7efda7fff700 1 -- 172.21.2.105:0/523674230 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6416+0+0 (secure 0 0 0) 0x7efd9806aff0 con 0x7efdb00ac280 2021-11-12T05:49:59.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.857+0000 7efdae7fc700 1 --2- 172.21.2.105:0/523674230 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efd94053640 0x7efd94055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:49:59.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.857+0000 7efdae7fc700 1 --2- 172.21.2.105:0/523674230 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efd94053640 0x7efd94055b00 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7efda0017000 tx=0x7efda0015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:49:59.874 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.861+0000 7efda7fff700 1 -- 172.21.2.105:0/523674230 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efdb00a9890 con 0x7efdb00ac280 2021-11-12T05:49:59.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.945+0000 7efdb548a700 1 -- 172.21.2.105:0/523674230 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efdb00a9890 con 0x7efdb00ac280 2021-11-12T05:49:59.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.945+0000 7efda7fff700 1 -- 172.21.2.105:0/523674230 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v156) v1 ==== 74+0+16285 (secure 0 0 0) 0x7efdb00a9890 con 0x7efdb00ac280 2021-11-12T05:49:59.948 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:49:59.948 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":156,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:49:58.440307+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:49:55.298718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-11-12T05:49:56.403004+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:49:59.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.945+0000 7efdb548a700 1 -- 172.21.2.105:0/523674230 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efd94053640 msgr2=0x7efd94055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:59.950 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.945+0000 7efdb548a700 1 --2- 172.21.2.105:0/523674230 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efd94053640 0x7efd94055b00 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7efda0017000 tx=0x7efda0015000).stop 2021-11-12T05:49:59.950 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.945+0000 7efdb548a700 1 -- 172.21.2.105:0/523674230 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efdb00ac280 msgr2=0x7efdb00608a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:49:59.950 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.945+0000 7efdb548a700 1 --2- 172.21.2.105:0/523674230 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efdb00ac280 0x7efdb00608a0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 rx=0x7efd98000ed0 tx=0x7efd98007ac0).stop 2021-11-12T05:49:59.950 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.945+0000 7efdb548a700 1 -- 172.21.2.105:0/523674230 shutdown_connections 2021-11-12T05:49:59.951 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.945+0000 7efdb548a700 1 --2- 172.21.2.105:0/523674230 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efd94053640 0x7efd94055b00 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:59.951 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.945+0000 7efdb548a700 1 --2- 172.21.2.105:0/523674230 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7efdb00af730 0x7efdb00a7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:59.951 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.945+0000 7efdb548a700 1 --2- 172.21.2.105:0/523674230 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7efdb00ad080 0x7efdb015aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:59.951 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.945+0000 7efdb548a700 1 --2- 172.21.2.105:0/523674230 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7efdb00ac280 0x7efdb00608a0 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:49:59.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.945+0000 7efdb548a700 1 -- 172.21.2.105:0/523674230 >> 172.21.2.105:0/523674230 conn(0x7efdb00b5370 msgr2=0x7efdb0143b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:49:59.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.945+0000 7efdb548a700 1 -- 172.21.2.105:0/523674230 shutdown_connections 2021-11-12T05:49:59.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:49:59.945+0000 7efdb548a700 1 -- 172.21.2.105:0/523674230 wait complete. 2021-11-12T05:49:59.956 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 29, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-12T05:49:55.298718+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '155', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 30, 'pool_name': 'cephfs_data', 'create_time': '2021-11-12T05:49:56.403004+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '156', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-12T05:49:59.957 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:50:00.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.005+0000 7f45528b6700 1 Processor -- start 2021-11-12T05:50:00.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.005+0000 7f45528b6700 1 -- start start 2021-11-12T05:50:00.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.005+0000 7f45528b6700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f454c0ace20 0x7f454c0b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:00.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.005+0000 7f45528b6700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f454c0b1840 con 0x7f454c144180 2021-11-12T05:50:00.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.005+0000 7f45528b6700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f454c0af2b0 con 0x7f454c0aca40 2021-11-12T05:50:00.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.005+0000 7f45528b6700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f454c0b0a10 con 0x7f454c0ace20 2021-11-12T05:50:00.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.005+0000 7f454b7fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f454c0ace20 0x7f454c0b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:00.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.005+0000 7f4550e53700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f454c144180 0x7f454c1445f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:35254/0 (socket says 172.21.2.105:35254) 2021-11-12T05:50:00.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.005+0000 7f4550e53700 1 -- 172.21.2.105:0/661357945 learned_addr learned my addr 172.21.2.105:0/661357945 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:50:00.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f454b7fe700 1 -- 172.21.2.105:0/661357945 >> v1:172.21.2.115:6789/0 conn(0x7f454c0aca40 legacy=0x7f454c1473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:00.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f454b7fe700 1 -- 172.21.2.105:0/661357945 >> v1:172.21.2.105:6789/0 conn(0x7f454c144180 legacy=0x7f454c1445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:00.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f454b7fe700 1 -- 172.21.2.105:0/661357945 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f454c0b1a70 con 0x7f454c0ace20 2021-11-12T05:50:00.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f454b7fe700 1 --2- 172.21.2.105:0/661357945 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f454c0ace20 0x7f454c0b0520 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 rx=0x7f453c002f70 tx=0x7f453c006df0).ready entity=mon.0 client_cookie=bb1037875f1f7fa server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:00.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f454affd700 1 -- 172.21.2.105:0/661357945 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f453c00d610 con 0x7f454c0ace20 2021-11-12T05:50:00.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f454affd700 1 -- 172.21.2.105:0/661357945 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453c000e90 con 0x7f454c0ace20 2021-11-12T05:50:00.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f454affd700 1 -- 172.21.2.105:0/661357945 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f453c00d960 con 0x7f454c0ace20 2021-11-12T05:50:00.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f45528b6700 1 -- 172.21.2.105:0/661357945 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f454c0ace20 msgr2=0x7f454c0b0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:00.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f45528b6700 1 --2- 172.21.2.105:0/661357945 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f454c0ace20 0x7f454c0b0520 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 rx=0x7f453c002f70 tx=0x7f453c006df0).stop 2021-11-12T05:50:00.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f45528b6700 1 -- 172.21.2.105:0/661357945 shutdown_connections 2021-11-12T05:50:00.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f45528b6700 1 --2- 172.21.2.105:0/661357945 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f454c0ace20 0x7f454c0b0520 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:00.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f45528b6700 1 -- 172.21.2.105:0/661357945 >> 172.21.2.105:0/661357945 conn(0x7f454c05c490 msgr2=0x7f454c0b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:50:00.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f45528b6700 1 -- 172.21.2.105:0/661357945 shutdown_connections 2021-11-12T05:50:00.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f45528b6700 1 -- 172.21.2.105:0/661357945 wait complete. 2021-11-12T05:50:00.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f45528b6700 1 Processor -- start 2021-11-12T05:50:00.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f45528b6700 1 -- start start 2021-11-12T05:50:00.020 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f45528b6700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f454c0aca40 0x7f454c065110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:00.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f45528b6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f454c0ace20 0x7f454c159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:00.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f45528b6700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f454c144180 0x7f454c0b2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:00.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f45528b6700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454c064250 con 0x7f454c0ace20 2021-11-12T05:50:00.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f45528b6700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454c141310 con 0x7f454c0aca40 2021-11-12T05:50:00.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f45528b6700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f454c063fb0 con 0x7f454c144180 2021-11-12T05:50:00.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f454b7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f454c0ace20 0x7f454c159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:00.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f454b7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f454c0ace20 0x7f454c159d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53100/0 (socket says 172.21.2.105:53100) 2021-11-12T05:50:00.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f454b7fe700 1 -- 172.21.2.105:0/3450489581 learned_addr learned my addr 172.21.2.105:0/3450489581 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:50:00.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f4550e53700 1 --2- 172.21.2.105:0/3450489581 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f454c144180 0x7f454c0b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:00.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f454bfff700 1 --2- 172.21.2.105:0/3450489581 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f454c0aca40 0x7f454c065110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:00.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f454b7fe700 1 -- 172.21.2.105:0/3450489581 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f454c144180 msgr2=0x7f454c0b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:00.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f454b7fe700 1 --2- 172.21.2.105:0/3450489581 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f454c144180 0x7f454c0b2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:00.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f454b7fe700 1 -- 172.21.2.105:0/3450489581 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f454c0aca40 msgr2=0x7f454c065110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:00.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f454b7fe700 1 --2- 172.21.2.105:0/3450489581 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f454c0aca40 0x7f454c065110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:00.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f454b7fe700 1 -- 172.21.2.105:0/3450489581 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453c00b180 con 0x7f454c0ace20 2021-11-12T05:50:00.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f4550e53700 1 --2- 172.21.2.105:0/3450489581 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f454c144180 0x7f454c0b2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:50:00.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f454bfff700 1 --2- 172.21.2.105:0/3450489581 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f454c0aca40 0x7f454c065110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T05:50:00.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f454b7fe700 1 --2- 172.21.2.105:0/3450489581 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f454c0ace20 0x7f454c159d10 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 rx=0x7f454c141450 tx=0x7f453c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:00.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f45497fa700 1 -- 172.21.2.105:0/3450489581 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f453c00d990 con 0x7f454c0ace20 2021-11-12T05:50:00.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f45497fa700 1 -- 172.21.2.105:0/3450489581 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453c011cd0 con 0x7f454c0ace20 2021-11-12T05:50:00.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f45497fa700 1 -- 172.21.2.105:0/3450489581 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f453c01e650 con 0x7f454c0ace20 2021-11-12T05:50:00.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f45528b6700 1 -- 172.21.2.105:0/3450489581 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f454c063140 con 0x7f454c0ace20 2021-11-12T05:50:00.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.009+0000 7f45528b6700 1 -- 172.21.2.105:0/3450489581 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f454c062f20 con 0x7f454c0ace20 2021-11-12T05:50:00.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.013+0000 7f45528b6700 1 -- 172.21.2.105:0/3450489581 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f454c057350 con 0x7f454c0ace20 2021-11-12T05:50:00.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.013+0000 7f45497fa700 1 -- 172.21.2.105:0/3450489581 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f453c025030 con 0x7f454c0ace20 2021-11-12T05:50:00.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.013+0000 7f45497fa700 1 --2- 172.21.2.105:0/3450489581 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4530053580 0x7f4530055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:00.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.013+0000 7f45497fa700 1 -- 172.21.2.105:0/3450489581 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f453c06cf70 con 0x7f454c0ace20 2021-11-12T05:50:00.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.013+0000 7f454bfff700 1 --2- 172.21.2.105:0/3450489581 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4530053580 0x7f4530055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:00.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.013+0000 7f454bfff700 1 --2- 172.21.2.105:0/3450489581 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4530053580 0x7f4530055a40 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f453400b000 tx=0x7f4534009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:00.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.013+0000 7f45497fa700 1 -- 172.21.2.105:0/3450489581 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f453c043e70 con 0x7f454c0ace20 2021-11-12T05:50:00.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.097+0000 7f45528b6700 1 -- 172.21.2.105:0/3450489581 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f454c064430 con 0x7f454c0ace20 2021-11-12T05:50:00.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.097+0000 7f45497fa700 1 -- 172.21.2.105:0/3450489581 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v156) v1 ==== 110+0+10 (secure 0 0 0) 0x7f453c023020 con 0x7f454c0ace20 2021-11-12T05:50:00.101 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:50:00.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.097+0000 7f45528b6700 1 -- 172.21.2.105:0/3450489581 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4530053580 msgr2=0x7f4530055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:00.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.097+0000 7f45528b6700 1 --2- 172.21.2.105:0/3450489581 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4530053580 0x7f4530055a40 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f453400b000 tx=0x7f4534009040).stop 2021-11-12T05:50:00.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.097+0000 7f45528b6700 1 -- 172.21.2.105:0/3450489581 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f454c0ace20 msgr2=0x7f454c159d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:00.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.097+0000 7f45528b6700 1 --2- 172.21.2.105:0/3450489581 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f454c0ace20 0x7f454c159d10 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 rx=0x7f454c141450 tx=0x7f453c015000).stop 2021-11-12T05:50:00.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.097+0000 7f45528b6700 1 -- 172.21.2.105:0/3450489581 shutdown_connections 2021-11-12T05:50:00.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.097+0000 7f45528b6700 1 --2- 172.21.2.105:0/3450489581 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4530053580 0x7f4530055a40 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:00.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.097+0000 7f45528b6700 1 --2- 172.21.2.105:0/3450489581 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f454c144180 0x7f454c0b2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:00.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.097+0000 7f45528b6700 1 --2- 172.21.2.105:0/3450489581 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f454c0ace20 0x7f454c159d10 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:00.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.097+0000 7f45528b6700 1 --2- 172.21.2.105:0/3450489581 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f454c0aca40 0x7f454c065110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:00.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.097+0000 7f45528b6700 1 -- 172.21.2.105:0/3450489581 >> 172.21.2.105:0/3450489581 conn(0x7f454c05c490 msgr2=0x7f454c1445f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:50:00.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.097+0000 7f45528b6700 1 -- 172.21.2.105:0/3450489581 shutdown_connections 2021-11-12T05:50:00.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.097+0000 7f45528b6700 1 -- 172.21.2.105:0/3450489581 wait complete. 2021-11-12T05:50:00.108 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:50:00.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.157+0000 7fd50cf75700 1 Processor -- start 2021-11-12T05:50:00.161 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.157+0000 7fd50cf75700 1 -- start start 2021-11-12T05:50:00.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.157+0000 7fd50cf75700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd5080ace20 0x7fd5080b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:00.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.157+0000 7fd50cf75700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5080b1840 con 0x7fd508144180 2021-11-12T05:50:00.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.157+0000 7fd50cf75700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5080af2b0 con 0x7fd5080aca40 2021-11-12T05:50:00.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.157+0000 7fd50cf75700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5080ad2a0 con 0x7fd5080ace20 2021-11-12T05:50:00.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.157+0000 7fd506d9d700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fd508144180 0x7fd508144610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:35270/0 (socket says 172.21.2.105:35270) 2021-11-12T05:50:00.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.157+0000 7fd506d9d700 1 -- 172.21.2.105:0/1674858319 learned_addr learned my addr 172.21.2.105:0/1674858319 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:50:00.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.157+0000 7fd50559a700 1 -- 172.21.2.105:0/1674858319 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3665647626 0 0) 0x7fd5080b1840 con 0x7fd508144180 2021-11-12T05:50:00.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.157+0000 7fd50559a700 1 -- 172.21.2.105:0/1674858319 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4e8003260 con 0x7fd508144180 2021-11-12T05:50:00.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.157+0000 7fd505d9b700 1 --2- 172.21.2.105:0/1674858319 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd5080ace20 0x7fd5080b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:00.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.157+0000 7fd50559a700 1 -- 172.21.2.105:0/1674858319 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1046054005 0 0) 0x7fd4e8003260 con 0x7fd508144180 2021-11-12T05:50:00.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.157+0000 7fd50559a700 1 -- 172.21.2.105:0/1674858319 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd5080ace20 msgr2=0x7fd5080b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:50:00.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.157+0000 7fd50559a700 1 --2- 172.21.2.105:0/1674858319 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd5080ace20 0x7fd5080b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:00.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.157+0000 7fd50559a700 1 -- 172.21.2.105:0/1674858319 >> v1:172.21.2.115:6789/0 conn(0x7fd5080aca40 legacy=0x7fd5081473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:50:00.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.157+0000 7fd50559a700 1 -- 172.21.2.105:0/1674858319 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5080b1a70 con 0x7fd508144180 2021-11-12T05:50:00.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.157+0000 7fd50559a700 1 -- 172.21.2.105:0/1674858319 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fd5000019e0 con 0x7fd508144180 2021-11-12T05:50:00.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.157+0000 7fd50559a700 1 -- 172.21.2.105:0/1674858319 >> v1:172.21.2.105:6789/0 conn(0x7fd508144180 legacy=0x7fd508144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:00.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.157+0000 7fd50559a700 1 --2- 172.21.2.105:0/1674858319 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd4e8003800 0x7fd4e8003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:00.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.157+0000 7fd50559a700 1 --2- 172.21.2.105:0/1674858319 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd4e8004500 0x7fd4e8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:00.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.157+0000 7fd50559a700 1 --2- 172.21.2.105:0/1674858319 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd4e8005070 0x7fd4e800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:00.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.157+0000 7fd50559a700 1 -- 172.21.2.105:0/1674858319 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e800bea0 con 0x7fd4e8005070 2021-11-12T05:50:00.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.157+0000 7fd50559a700 1 -- 172.21.2.105:0/1674858319 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e800c010 con 0x7fd4e8004500 2021-11-12T05:50:00.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.157+0000 7fd50559a700 1 -- 172.21.2.105:0/1674858319 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e800c1d0 con 0x7fd4e8003800 2021-11-12T05:50:00.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.157+0000 7fd506d9d700 1 --2- 172.21.2.105:0/1674858319 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd4e8005070 0x7fd4e800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:00.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.157+0000 7fd505d9b700 1 --2- 172.21.2.105:0/1674858319 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd5080ace20 0x7fd5080b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:50:00.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd506d9d700 1 -- 172.21.2.105:0/1674858319 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd4e8003800 msgr2=0x7fd4e8003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:50:00.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd506d9d700 1 --2- 172.21.2.105:0/1674858319 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd4e8003800 0x7fd4e8003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:00.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd506d9d700 1 -- 172.21.2.105:0/1674858319 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd4e8004500 msgr2=0x7fd4e8004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:50:00.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd506d9d700 1 --2- 172.21.2.105:0/1674858319 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd4e8004500 0x7fd4e8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:00.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd506d9d700 1 -- 172.21.2.105:0/1674858319 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e8003260 con 0x7fd4e8005070 2021-11-12T05:50:00.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd506d9d700 1 --2- 172.21.2.105:0/1674858319 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd4e8005070 0x7fd4e800b750 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 rx=0x7fd5080af5f0 tx=0x7fd5000020e0).ready entity=mon.0 client_cookie=187627d7888b2589 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:00.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd50559a700 1 -- 172.21.2.105:0/1674858319 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd50000cc60 con 0x7fd4e8005070 2021-11-12T05:50:00.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd50559a700 1 -- 172.21.2.105:0/1674858319 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50000cdc0 con 0x7fd4e8005070 2021-11-12T05:50:00.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd50559a700 1 -- 172.21.2.105:0/1674858319 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd500005b80 con 0x7fd4e8005070 2021-11-12T05:50:00.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd50cf75700 1 -- 172.21.2.105:0/1674858319 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd4e8005070 msgr2=0x7fd4e800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:00.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd50cf75700 1 --2- 172.21.2.105:0/1674858319 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd4e8005070 0x7fd4e800b750 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 rx=0x7fd5080af5f0 tx=0x7fd5000020e0).stop 2021-11-12T05:50:00.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd506d9d700 1 -- 172.21.2.105:0/1674858319 reap_dead start 2021-11-12T05:50:00.174 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd50cf75700 1 -- 172.21.2.105:0/1674858319 shutdown_connections 2021-11-12T05:50:00.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd50cf75700 1 -- 172.21.2.105:0/1674858319 >> 172.21.2.105:0/1674858319 conn(0x7fd50805c490 msgr2=0x7fd5080b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:50:00.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd50cf75700 1 -- 172.21.2.105:0/1674858319 shutdown_connections 2021-11-12T05:50:00.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd50cf75700 1 -- 172.21.2.105:0/1674858319 wait complete. 2021-11-12T05:50:00.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd50cf75700 1 Processor -- start 2021-11-12T05:50:00.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd50cf75700 1 -- start start 2021-11-12T05:50:00.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd50cf75700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd4e8005070 0x7fd508147810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:00.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd50cf75700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd508140da0 0x7fd50814a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:00.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd50cf75700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd508146360 0x7fd50813b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:00.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd50cf75700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd508146810 con 0x7fd508146360 2021-11-12T05:50:00.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd50cf75700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5081470d0 con 0x7fd508140da0 2021-11-12T05:50:00.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd50cf75700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd508147370 con 0x7fd4e8005070 2021-11-12T05:50:00.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd505d9b700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd508140da0 0x7fd50814a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:00.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd505d9b700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd508140da0 0x7fd50814a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.115:3300/0 says I am v2:172.21.2.105:42058/0 (socket says 172.21.2.105:42058) 2021-11-12T05:50:00.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd505d9b700 1 -- 172.21.2.105:0/4206016049 learned_addr learned my addr 172.21.2.105:0/4206016049 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:50:00.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd506d9d700 1 --2- 172.21.2.105:0/4206016049 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd508146360 0x7fd50813b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:00.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd50659c700 1 --2- 172.21.2.105:0/4206016049 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd4e8005070 0x7fd508147810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:00.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd506d9d700 1 -- 172.21.2.105:0/4206016049 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd4e8005070 msgr2=0x7fd508147810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:00.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd506d9d700 1 --2- 172.21.2.105:0/4206016049 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd4e8005070 0x7fd508147810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:00.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd506d9d700 1 -- 172.21.2.105:0/4206016049 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd508140da0 msgr2=0x7fd50814a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:00.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd506d9d700 1 --2- 172.21.2.105:0/4206016049 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd508140da0 0x7fd50814a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:00.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd506d9d700 1 -- 172.21.2.105:0/4206016049 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd50813ba20 con 0x7fd508146360 2021-11-12T05:50:00.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd50659c700 1 --2- 172.21.2.105:0/4206016049 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd4e8005070 0x7fd508147810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:50:00.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd506d9d700 1 --2- 172.21.2.105:0/4206016049 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd508146360 0x7fd50813b530 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 rx=0x7fd50805cd40 tx=0x7fd500015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:00.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd4ff7fe700 1 -- 172.21.2.105:0/4206016049 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5000020e0 con 0x7fd508146360 2021-11-12T05:50:00.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd4ff7fe700 1 -- 172.21.2.105:0/4206016049 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5000072e0 con 0x7fd508146360 2021-11-12T05:50:00.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd50cf75700 1 -- 172.21.2.105:0/4206016049 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd50813bbb0 con 0x7fd508146360 2021-11-12T05:50:00.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd4ff7fe700 1 -- 172.21.2.105:0/4206016049 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd500007640 con 0x7fd508146360 2021-11-12T05:50:00.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd50cf75700 1 -- 172.21.2.105:0/4206016049 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd50813bf40 con 0x7fd508146360 2021-11-12T05:50:00.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd50cf75700 1 -- 172.21.2.105:0/4206016049 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5081469d0 con 0x7fd508146360 2021-11-12T05:50:00.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd4ff7fe700 1 -- 172.21.2.105:0/4206016049 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd50001d070 con 0x7fd508146360 2021-11-12T05:50:00.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd4ff7fe700 1 --2- 172.21.2.105:0/4206016049 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd4ec0536d0 0x7fd4ec055b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:00.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd4ff7fe700 1 -- 172.21.2.105:0/4206016049 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fd50006c720 con 0x7fd508146360 2021-11-12T05:50:00.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.161+0000 7fd50659c700 1 --2- 172.21.2.105:0/4206016049 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd4ec0536d0 0x7fd4ec055b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:00.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.165+0000 7fd50659c700 1 --2- 172.21.2.105:0/4206016049 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd4ec0536d0 0x7fd4ec055b90 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7fd4f0008000 tx=0x7fd4f0009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:00.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.165+0000 7fd4ff7fe700 1 -- 172.21.2.105:0/4206016049 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd500043620 con 0x7fd508146360 2021-11-12T05:50:00.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.249+0000 7fd50cf75700 1 -- 172.21.2.105:0/4206016049 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd508147530 con 0x7fd508146360 2021-11-12T05:50:00.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.249+0000 7fd4ff7fe700 1 -- 172.21.2.105:0/4206016049 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v156) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd50001a070 con 0x7fd508146360 2021-11-12T05:50:00.254 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:50:00.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.249+0000 7fd50cf75700 1 -- 172.21.2.105:0/4206016049 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd4ec0536d0 msgr2=0x7fd4ec055b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:00.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.249+0000 7fd50cf75700 1 --2- 172.21.2.105:0/4206016049 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd4ec0536d0 0x7fd4ec055b90 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7fd4f0008000 tx=0x7fd4f0009040).stop 2021-11-12T05:50:00.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.249+0000 7fd50cf75700 1 -- 172.21.2.105:0/4206016049 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd508146360 msgr2=0x7fd50813b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:00.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.249+0000 7fd50cf75700 1 --2- 172.21.2.105:0/4206016049 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd508146360 0x7fd50813b530 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 rx=0x7fd50805cd40 tx=0x7fd500015000).stop 2021-11-12T05:50:00.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.249+0000 7fd50cf75700 1 -- 172.21.2.105:0/4206016049 shutdown_connections 2021-11-12T05:50:00.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.249+0000 7fd50cf75700 1 --2- 172.21.2.105:0/4206016049 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd4ec0536d0 0x7fd4ec055b90 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:00.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.249+0000 7fd50cf75700 1 --2- 172.21.2.105:0/4206016049 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd508146360 0x7fd50813b530 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:00.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.249+0000 7fd50cf75700 1 --2- 172.21.2.105:0/4206016049 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd508140da0 0x7fd50814a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:00.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.249+0000 7fd50cf75700 1 --2- 172.21.2.105:0/4206016049 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd4e8005070 0x7fd508147810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:00.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.249+0000 7fd50cf75700 1 -- 172.21.2.105:0/4206016049 >> 172.21.2.105:0/4206016049 conn(0x7fd50805c490 msgr2=0x7fd50805bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:50:00.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.249+0000 7fd50cf75700 1 -- 172.21.2.105:0/4206016049 shutdown_connections 2021-11-12T05:50:00.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.249+0000 7fd50cf75700 1 -- 172.21.2.105:0/4206016049 wait complete. 2021-11-12T05:50:00.261 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-12T05:50:00.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.309+0000 7fa889991700 1 Processor -- start 2021-11-12T05:50:00.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.309+0000 7fa889991700 1 -- start start 2021-11-12T05:50:00.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.309+0000 7fa889991700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa8840b0130 0x7fa8840b6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:00.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.309+0000 7fa889991700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8840b6570 con 0x7fa88413ef20 2021-11-12T05:50:00.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.309+0000 7fa889991700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8840b56a0 con 0x7fa884062ac0 2021-11-12T05:50:00.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.309+0000 7fa889991700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8840b5940 con 0x7fa8840b0130 2021-11-12T05:50:00.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.309+0000 7fa8837fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fa88413ef20 0x7fa8840ae740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:35290/0 (socket says 172.21.2.105:35290) 2021-11-12T05:50:00.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.309+0000 7fa8837fe700 1 -- 172.21.2.105:0/2283881320 learned_addr learned my addr 172.21.2.105:0/2283881320 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:50:00.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.309+0000 7fa8827fc700 1 --2- 172.21.2.105:0/2283881320 >> v2:172.21.2.105:3300/0 conn(0x7fa8840b0130 0x7fa8840b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:00.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.309+0000 7fa8827fc700 1 -- 172.21.2.105:0/2283881320 >> v1:172.21.2.115:6789/0 conn(0x7fa884062ac0 legacy=0x7fa884138c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:50:00.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.309+0000 7fa8827fc700 1 -- 172.21.2.105:0/2283881320 >> v1:172.21.2.105:6789/0 conn(0x7fa88413ef20 legacy=0x7fa8840ae740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:00.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.309+0000 7fa8827fc700 1 -- 172.21.2.105:0/2283881320 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8840b5be0 con 0x7fa8840b0130 2021-11-12T05:50:00.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.309+0000 7fa8827fc700 1 --2- 172.21.2.105:0/2283881320 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa8840b0130 0x7fa8840b6080 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 rx=0x7fa8840ae620 tx=0x7fa86c006df0).ready entity=mon.0 client_cookie=d953c8a331e7192d server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:00.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.309+0000 7fa881ffb700 1 -- 172.21.2.105:0/2283881320 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa86c010980 con 0x7fa8840b0130 2021-11-12T05:50:00.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.309+0000 7fa881ffb700 1 -- 172.21.2.105:0/2283881320 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86c000e90 con 0x7fa8840b0130 2021-11-12T05:50:00.319 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.309+0000 7fa881ffb700 1 -- 172.21.2.105:0/2283881320 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa86c010cd0 con 0x7fa8840b0130 2021-11-12T05:50:00.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.313+0000 7fa889991700 1 -- 172.21.2.105:0/2283881320 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa8840b0130 msgr2=0x7fa8840b6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:00.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.313+0000 7fa889991700 1 --2- 172.21.2.105:0/2283881320 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa8840b0130 0x7fa8840b6080 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 rx=0x7fa8840ae620 tx=0x7fa86c006df0).stop 2021-11-12T05:50:00.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.313+0000 7fa889991700 1 -- 172.21.2.105:0/2283881320 shutdown_connections 2021-11-12T05:50:00.320 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.313+0000 7fa889991700 1 --2- 172.21.2.105:0/2283881320 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa8840b0130 0x7fa8840b6080 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:00.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.313+0000 7fa889991700 1 -- 172.21.2.105:0/2283881320 >> 172.21.2.105:0/2283881320 conn(0x7fa88405c490 msgr2=0x7fa88405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:50:00.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.313+0000 7fa889991700 1 -- 172.21.2.105:0/2283881320 shutdown_connections 2021-11-12T05:50:00.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.313+0000 7fa889991700 1 -- 172.21.2.105:0/2283881320 wait complete. 2021-11-12T05:50:00.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.313+0000 7fa889991700 1 Processor -- start 2021-11-12T05:50:00.321 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.313+0000 7fa889991700 1 -- start start 2021-11-12T05:50:00.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.313+0000 7fa889991700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa884062ac0 0x7fa88415ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:00.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.313+0000 7fa889991700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa8840b0130 0x7fa8841425e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:00.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.313+0000 7fa889991700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa88413ef20 0x7fa884157040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:00.322 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.313+0000 7fa889991700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa884063aa0 con 0x7fa88413ef20 2021-11-12T05:50:00.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.313+0000 7fa889991700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa884063d40 con 0x7fa8840b0130 2021-11-12T05:50:00.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.313+0000 7fa889991700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa884063fe0 con 0x7fa884062ac0 2021-11-12T05:50:00.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.313+0000 7fa8837fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa88413ef20 0x7fa884157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:00.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.313+0000 7fa8837fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa88413ef20 0x7fa884157040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53132/0 (socket says 172.21.2.105:53132) 2021-11-12T05:50:00.323 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.313+0000 7fa8837fe700 1 -- 172.21.2.105:0/734781378 learned_addr learned my addr 172.21.2.105:0/734781378 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:50:00.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.313+0000 7fa8837fe700 1 -- 172.21.2.105:0/734781378 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa884062ac0 msgr2=0x7fa88415ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:00.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.313+0000 7fa8837fe700 1 --2- 172.21.2.105:0/734781378 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa884062ac0 0x7fa88415ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:00.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.313+0000 7fa8837fe700 1 -- 172.21.2.105:0/734781378 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa8840b0130 msgr2=0x7fa8841425e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:00.324 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.313+0000 7fa8837fe700 1 --2- 172.21.2.105:0/734781378 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa8840b0130 0x7fa8841425e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:00.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.313+0000 7fa8837fe700 1 -- 172.21.2.105:0/734781378 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa86c00c290 con 0x7fa88413ef20 2021-11-12T05:50:00.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.313+0000 7fa8837fe700 1 --2- 172.21.2.105:0/734781378 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa88413ef20 0x7fa884157040 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 rx=0x7fa8840ae5e0 tx=0x7fa87c007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:00.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.313+0000 7fa87bfff700 1 -- 172.21.2.105:0/734781378 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa87c005ba0 con 0x7fa88413ef20 2021-11-12T05:50:00.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.313+0000 7fa87bfff700 1 -- 172.21.2.105:0/734781378 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87c005d00 con 0x7fa88413ef20 2021-11-12T05:50:00.325 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.313+0000 7fa889991700 1 -- 172.21.2.105:0/734781378 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa88413aad0 con 0x7fa88413ef20 2021-11-12T05:50:00.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.313+0000 7fa889991700 1 -- 172.21.2.105:0/734781378 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa884157530 con 0x7fa88413ef20 2021-11-12T05:50:00.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.313+0000 7fa87bfff700 1 -- 172.21.2.105:0/734781378 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa87c0072c0 con 0x7fa88413ef20 2021-11-12T05:50:00.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.313+0000 7fa889991700 1 -- 172.21.2.105:0/734781378 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8840b3050 con 0x7fa88413ef20 2021-11-12T05:50:00.326 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.313+0000 7fa87bfff700 1 -- 172.21.2.105:0/734781378 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa87c010070 con 0x7fa88413ef20 2021-11-12T05:50:00.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.317+0000 7fa87bfff700 1 --2- 172.21.2.105:0/734781378 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa8680536f0 0x7fa868055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:00.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.317+0000 7fa87bfff700 1 -- 172.21.2.105:0/734781378 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fa87c06b370 con 0x7fa88413ef20 2021-11-12T05:50:00.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.317+0000 7fa882ffd700 1 --2- 172.21.2.105:0/734781378 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa8680536f0 0x7fa868055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:00.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.317+0000 7fa882ffd700 1 --2- 172.21.2.105:0/734781378 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa8680536f0 0x7fa868055bb0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7fa874002f90 tx=0x7fa8740069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:00.328 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.317+0000 7fa87bfff700 1 -- 172.21.2.105:0/734781378 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa87c042380 con 0x7fa88413ef20 2021-11-12T05:50:00.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.397+0000 7fa889991700 1 -- 172.21.2.105:0/734781378 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa884057350 con 0x7fa88413ef20 2021-11-12T05:50:00.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.397+0000 7fa87bfff700 1 -- 172.21.2.105:0/734781378 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v156) v1 ==== 104+0+10 (secure 0 0 0) 0x7fa87c0459a0 con 0x7fa88413ef20 2021-11-12T05:50:00.403 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:50:00.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.401+0000 7fa889991700 1 -- 172.21.2.105:0/734781378 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa8680536f0 msgr2=0x7fa868055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:00.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.401+0000 7fa889991700 1 --2- 172.21.2.105:0/734781378 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa8680536f0 0x7fa868055bb0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7fa874002f90 tx=0x7fa8740069b0).stop 2021-11-12T05:50:00.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.401+0000 7fa889991700 1 -- 172.21.2.105:0/734781378 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa88413ef20 msgr2=0x7fa884157040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:00.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.401+0000 7fa889991700 1 --2- 172.21.2.105:0/734781378 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa88413ef20 0x7fa884157040 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 rx=0x7fa8840ae5e0 tx=0x7fa87c007f60).stop 2021-11-12T05:50:00.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.401+0000 7fa889991700 1 -- 172.21.2.105:0/734781378 shutdown_connections 2021-11-12T05:50:00.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.401+0000 7fa889991700 1 --2- 172.21.2.105:0/734781378 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa8680536f0 0x7fa868055bb0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:00.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.401+0000 7fa889991700 1 --2- 172.21.2.105:0/734781378 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa88413ef20 0x7fa884157040 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:00.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.401+0000 7fa889991700 1 --2- 172.21.2.105:0/734781378 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa8840b0130 0x7fa8841425e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:00.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.401+0000 7fa889991700 1 --2- 172.21.2.105:0/734781378 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa884062ac0 0x7fa88415ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:00.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.401+0000 7fa889991700 1 -- 172.21.2.105:0/734781378 >> 172.21.2.105:0/734781378 conn(0x7fa88405c490 msgr2=0x7fa8840b46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:50:00.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.401+0000 7fa889991700 1 -- 172.21.2.105:0/734781378 shutdown_connections 2021-11-12T05:50:00.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.401+0000 7fa889991700 1 -- 172.21.2.105:0/734781378 wait complete. 2021-11-12T05:50:00.410 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-12T05:50:00.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.457+0000 7f27b1763700 1 Processor -- start 2021-11-12T05:50:00.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.457+0000 7f27b1763700 1 -- start start 2021-11-12T05:50:00.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27b1763700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f27ac060d80 0x7f27ac145120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:00.466 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27b1763700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27ac0b1770 con 0x7f27ac0b12a0 2021-11-12T05:50:00.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27b1763700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27ac0b0380 con 0x7f27ac0aec50 2021-11-12T05:50:00.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27b1763700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27ac142320 con 0x7f27ac060d80 2021-11-12T05:50:00.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27ab7fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f27ac0b12a0 0x7f27ac0669c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:35304/0 (socket says 172.21.2.105:35304) 2021-11-12T05:50:00.467 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27ab7fe700 1 -- 172.21.2.105:0/3596396727 learned_addr learned my addr 172.21.2.105:0/3596396727 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:50:00.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27a9ffb700 1 -- 172.21.2.105:0/3596396727 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3280610903 0 0) 0x7f27ac0b1770 con 0x7f27ac0b12a0 2021-11-12T05:50:00.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27a9ffb700 1 -- 172.21.2.105:0/3596396727 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f278c003260 con 0x7f27ac0b12a0 2021-11-12T05:50:00.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27a9ffb700 1 -- 172.21.2.105:0/3596396727 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1762899429 0 0) 0x7f278c003260 con 0x7f27ac0b12a0 2021-11-12T05:50:00.468 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27a9ffb700 1 -- 172.21.2.105:0/3596396727 >> v2:172.21.2.115:3300/0 conn(0x7f27ac060d80 msgr2=0x7f27ac145120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:50:00.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27a9ffb700 1 --2- 172.21.2.105:0/3596396727 >> v2:172.21.2.115:3300/0 conn(0x7f27ac060d80 0x7f27ac145120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:00.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27a9ffb700 1 -- 172.21.2.105:0/3596396727 >> v1:172.21.2.115:6789/0 conn(0x7f27ac0aec50 legacy=0x7f27ac142530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:50:00.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27a9ffb700 1 -- 172.21.2.105:0/3596396727 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ac0af030 con 0x7f27ac0b12a0 2021-11-12T05:50:00.469 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27a9ffb700 1 -- 172.21.2.105:0/3596396727 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f27a40019e0 con 0x7f27ac0b12a0 2021-11-12T05:50:00.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27a9ffb700 1 -- 172.21.2.105:0/3596396727 >> v1:172.21.2.105:6789/0 conn(0x7f27ac0b12a0 legacy=0x7f27ac0669c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:00.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27a9ffb700 1 --2- 172.21.2.105:0/3596396727 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f278c003820 0x7f278c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:00.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27a9ffb700 1 --2- 172.21.2.105:0/3596396727 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f278c004500 0x7f278c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:00.470 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27a9ffb700 1 --2- 172.21.2.105:0/3596396727 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f278c005050 0x7f278c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:00.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27a9ffb700 1 -- 172.21.2.105:0/3596396727 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ac142320 con 0x7f278c003820 2021-11-12T05:50:00.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27a9ffb700 1 -- 172.21.2.105:0/3596396727 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278c00bf40 con 0x7f278c005050 2021-11-12T05:50:00.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27a9ffb700 1 -- 172.21.2.105:0/3596396727 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f278c00c100 con 0x7f278c004500 2021-11-12T05:50:00.471 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27aaffd700 1 --2- 172.21.2.105:0/3596396727 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f278c003820 0x7f278c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:00.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27aaffd700 1 -- 172.21.2.105:0/3596396727 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f278c004500 msgr2=0x7f278c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:50:00.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27aaffd700 1 --2- 172.21.2.105:0/3596396727 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f278c004500 0x7f278c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:00.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27aaffd700 1 -- 172.21.2.105:0/3596396727 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f278c005050 msgr2=0x7f278c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:50:00.472 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27aaffd700 1 --2- 172.21.2.105:0/3596396727 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f278c005050 0x7f278c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:00.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27aaffd700 1 -- 172.21.2.105:0/3596396727 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f278c003260 con 0x7f278c003820 2021-11-12T05:50:00.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27ab7fe700 1 -- 172.21.2.105:0/3596396727 reap_dead start 2021-11-12T05:50:00.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27aaffd700 1 --2- 172.21.2.105:0/3596396727 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f278c003820 0x7f278c003c20 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 rx=0x7f2794000f70 tx=0x7f27940079e0).ready entity=mon.0 client_cookie=e720418050dc768 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:00.473 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27a9ffb700 1 -- 172.21.2.105:0/3596396727 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2794007cf0 con 0x7f278c003820 2021-11-12T05:50:00.474 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27a9ffb700 1 -- 172.21.2.105:0/3596396727 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2794014410 con 0x7f278c003820 2021-11-12T05:50:00.474 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27a9ffb700 1 -- 172.21.2.105:0/3596396727 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2794014770 con 0x7f278c003820 2021-11-12T05:50:00.474 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27b1763700 1 -- 172.21.2.105:0/3596396727 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f278c003820 msgr2=0x7f278c003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:00.474 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27b1763700 1 --2- 172.21.2.105:0/3596396727 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f278c003820 0x7f278c003c20 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 rx=0x7f2794000f70 tx=0x7f27940079e0).stop 2021-11-12T05:50:00.474 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27b1763700 1 -- 172.21.2.105:0/3596396727 shutdown_connections 2021-11-12T05:50:00.475 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27b1763700 1 --2- 172.21.2.105:0/3596396727 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f278c003820 0x7f278c003c20 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:00.475 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27b1763700 1 -- 172.21.2.105:0/3596396727 >> 172.21.2.105:0/3596396727 conn(0x7f27ac05c490 msgr2=0x7f27ac0b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:50:00.475 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27b1763700 1 -- 172.21.2.105:0/3596396727 shutdown_connections 2021-11-12T05:50:00.475 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27b1763700 1 -- 172.21.2.105:0/3596396727 wait complete. 2021-11-12T05:50:00.476 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27b1763700 1 Processor -- start 2021-11-12T05:50:00.476 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27b1763700 1 -- start start 2021-11-12T05:50:00.478 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27b1763700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f278c003820 0x7f27ac147680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:00.478 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27b1763700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f27ac0abaf0 0x7f27ac14b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:00.478 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27b1763700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f27ac155de0 0x7f27ac156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:00.479 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.461+0000 7f27b1763700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ac1462b0 con 0x7f278c003820 2021-11-12T05:50:00.479 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.465+0000 7f27b1763700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ac146550 con 0x7f27ac0abaf0 2021-11-12T05:50:00.479 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.465+0000 7f27b1763700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27ac1467f0 con 0x7f27ac155de0 2021-11-12T05:50:00.479 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.465+0000 7f27aaffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f278c003820 0x7f27ac147680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:00.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.465+0000 7f27aaffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f278c003820 0x7f27ac147680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53150/0 (socket says 172.21.2.105:53150) 2021-11-12T05:50:00.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.465+0000 7f27aaffd700 1 -- 172.21.2.105:0/2913621425 learned_addr learned my addr 172.21.2.105:0/2913621425 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:50:00.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.465+0000 7f27aaffd700 1 -- 172.21.2.105:0/2913621425 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f27ac155de0 msgr2=0x7f27ac156260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:00.480 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.465+0000 7f27aaffd700 1 --2- 172.21.2.105:0/2913621425 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f27ac155de0 0x7f27ac156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:00.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.465+0000 7f27aaffd700 1 -- 172.21.2.105:0/2913621425 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f27ac0abaf0 msgr2=0x7f27ac14b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:00.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.465+0000 7f27aaffd700 1 --2- 172.21.2.105:0/2913621425 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f27ac0abaf0 0x7f27ac14b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:00.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.465+0000 7f27aaffd700 1 -- 172.21.2.105:0/2913621425 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ac156750 con 0x7f278c003820 2021-11-12T05:50:00.481 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.465+0000 7f27aaffd700 1 --2- 172.21.2.105:0/2913621425 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f278c003820 0x7f27ac147680 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 rx=0x7f2794000f70 tx=0x7f2794015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:00.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.465+0000 7f27a3fff700 1 -- 172.21.2.105:0/2913621425 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2794013840 con 0x7f278c003820 2021-11-12T05:50:00.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.465+0000 7f27a3fff700 1 -- 172.21.2.105:0/2913621425 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27940139a0 con 0x7f278c003820 2021-11-12T05:50:00.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.465+0000 7f27b1763700 1 -- 172.21.2.105:0/2913621425 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27ac156940 con 0x7f278c003820 2021-11-12T05:50:00.482 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.465+0000 7f27a3fff700 1 -- 172.21.2.105:0/2913621425 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2794013d00 con 0x7f278c003820 2021-11-12T05:50:00.483 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.465+0000 7f27b1763700 1 -- 172.21.2.105:0/2913621425 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27ac1452c0 con 0x7f278c003820 2021-11-12T05:50:00.483 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.465+0000 7f27b1763700 1 -- 172.21.2.105:0/2913621425 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27ac0b19a0 con 0x7f278c003820 2021-11-12T05:50:00.483 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.465+0000 7f27a3fff700 1 -- 172.21.2.105:0/2913621425 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2794022470 con 0x7f278c003820 2021-11-12T05:50:00.483 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.465+0000 7f27a3fff700 1 --2- 172.21.2.105:0/2913621425 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2790053580 0x7f2790055a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:00.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.465+0000 7f27a3fff700 1 -- 172.21.2.105:0/2913621425 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f279401c040 con 0x7f278c003820 2021-11-12T05:50:00.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.465+0000 7f27aa7fc700 1 --2- 172.21.2.105:0/2913621425 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2790053580 0x7f2790055a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:00.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.465+0000 7f27aa7fc700 1 --2- 172.21.2.105:0/2913621425 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2790053580 0x7f2790055a40 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f279c002f70 tx=0x7f279c006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:00.484 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.469+0000 7f27a3fff700 1 -- 172.21.2.105:0/2913621425 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2794043f60 con 0x7f278c003820 2021-11-12T05:50:00.555 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.553+0000 7f27b1763700 1 -- 172.21.2.105:0/2913621425 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f27ac057350 con 0x7f278c003820 2021-11-12T05:50:00.555 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.553+0000 7f27a3fff700 1 -- 172.21.2.105:0/2913621425 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v156) v1 ==== 100+0+10 (secure 0 0 0) 0x7f2794047540 con 0x7f278c003820 2021-11-12T05:50:00.556 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:50:00.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.553+0000 7f27b1763700 1 -- 172.21.2.105:0/2913621425 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2790053580 msgr2=0x7f2790055a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:00.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.553+0000 7f27b1763700 1 --2- 172.21.2.105:0/2913621425 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2790053580 0x7f2790055a40 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f279c002f70 tx=0x7f279c006a80).stop 2021-11-12T05:50:00.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.553+0000 7f27b1763700 1 -- 172.21.2.105:0/2913621425 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f278c003820 msgr2=0x7f27ac147680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:00.557 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.553+0000 7f27b1763700 1 --2- 172.21.2.105:0/2913621425 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f278c003820 0x7f27ac147680 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 rx=0x7f2794000f70 tx=0x7f2794015000).stop 2021-11-12T05:50:00.558 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.553+0000 7f27b1763700 1 -- 172.21.2.105:0/2913621425 shutdown_connections 2021-11-12T05:50:00.558 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.553+0000 7f27b1763700 1 --2- 172.21.2.105:0/2913621425 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2790053580 0x7f2790055a40 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:00.558 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.553+0000 7f27b1763700 1 --2- 172.21.2.105:0/2913621425 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f27ac155de0 0x7f27ac156260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:00.558 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.553+0000 7f27b1763700 1 --2- 172.21.2.105:0/2913621425 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f27ac0abaf0 0x7f27ac14b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:00.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.553+0000 7f27b1763700 1 --2- 172.21.2.105:0/2913621425 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f278c003820 0x7f27ac147680 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:00.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.553+0000 7f27b1763700 1 -- 172.21.2.105:0/2913621425 >> 172.21.2.105:0/2913621425 conn(0x7f27ac05c490 msgr2=0x7f27ac0ae200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:50:00.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.553+0000 7f27b1763700 1 -- 172.21.2.105:0/2913621425 shutdown_connections 2021-11-12T05:50:00.559 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.553+0000 7f27b1763700 1 -- 172.21.2.105:0/2913621425 wait complete. 2021-11-12T05:50:00.563 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-12T05:50:00.563 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:50:00.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.609+0000 7f1529dcf700 1 Processor -- start 2021-11-12T05:50:00.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.609+0000 7f1529dcf700 1 -- start start 2021-11-12T05:50:00.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.609+0000 7f1529dcf700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f152414b2f0 0x7f15240af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:00.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.609+0000 7f1529dcf700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15240ac7b0 con 0x7f15240ad080 2021-11-12T05:50:00.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.609+0000 7f1529dcf700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15240ac9e0 con 0x7f15240ac280 2021-11-12T05:50:00.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.609+0000 7f1529dcf700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15241488a0 con 0x7f152414b2f0 2021-11-12T05:50:00.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.609+0000 7f1523fff700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f152414b2f0 0x7f15240af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:00.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.609+0000 7f15237fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f15240ad080 0x7f152414abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:35322/0 (socket says 172.21.2.105:35322) 2021-11-12T05:50:00.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.609+0000 7f15237fe700 1 -- 172.21.2.105:0/1866775878 learned_addr learned my addr 172.21.2.105:0/1866775878 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:50:00.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.613+0000 7f15227fc700 1 -- 172.21.2.105:0/1866775878 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1214554817 0 0) 0x7f15240ac7b0 con 0x7f15240ad080 2021-11-12T05:50:00.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.613+0000 7f1523fff700 1 -- 172.21.2.105:0/1866775878 >> v1:172.21.2.115:6789/0 conn(0x7f15240ac280 legacy=0x7f1524147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:50:00.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.613+0000 7f1523fff700 1 -- 172.21.2.105:0/1866775878 >> v1:172.21.2.105:6789/0 conn(0x7f15240ad080 legacy=0x7f152414abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:00.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.613+0000 7f1523fff700 1 -- 172.21.2.105:0/1866775878 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15240b0b30 con 0x7f152414b2f0 2021-11-12T05:50:00.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.613+0000 7f1523fff700 1 --2- 172.21.2.105:0/1866775878 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f152414b2f0 0x7f15240af730 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 rx=0x7f15240ac6a0 tx=0x7f151c0091d0).ready entity=mon.0 client_cookie=5c34b7972130fd79 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:00.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.613+0000 7f15227fc700 1 -- 172.21.2.105:0/1866775878 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f151c009ea0 con 0x7f152414b2f0 2021-11-12T05:50:00.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.613+0000 7f15227fc700 1 -- 172.21.2.105:0/1866775878 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151c00b860 con 0x7f152414b2f0 2021-11-12T05:50:00.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.613+0000 7f15227fc700 1 -- 172.21.2.105:0/1866775878 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f151c00b9d0 con 0x7f152414b2f0 2021-11-12T05:50:00.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.613+0000 7f1529dcf700 1 -- 172.21.2.105:0/1866775878 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f152414b2f0 msgr2=0x7f15240af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:00.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.613+0000 7f1529dcf700 1 --2- 172.21.2.105:0/1866775878 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f152414b2f0 0x7f15240af730 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 rx=0x7f15240ac6a0 tx=0x7f151c0091d0).stop 2021-11-12T05:50:00.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.613+0000 7f1529dcf700 1 -- 172.21.2.105:0/1866775878 shutdown_connections 2021-11-12T05:50:00.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.613+0000 7f1529dcf700 1 --2- 172.21.2.105:0/1866775878 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f152414b2f0 0x7f15240af730 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:00.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.613+0000 7f1529dcf700 1 -- 172.21.2.105:0/1866775878 >> 172.21.2.105:0/1866775878 conn(0x7f15240b5370 msgr2=0x7f15240b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:50:00.621 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.613+0000 7f1529dcf700 1 -- 172.21.2.105:0/1866775878 shutdown_connections 2021-11-12T05:50:00.621 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.613+0000 7f1529dcf700 1 -- 172.21.2.105:0/1866775878 wait complete. 2021-11-12T05:50:00.623 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.613+0000 7f1529dcf700 1 Processor -- start 2021-11-12T05:50:00.623 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.613+0000 7f1529dcf700 1 -- start start 2021-11-12T05:50:00.624 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.613+0000 7f1529dcf700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f15240ac280 0x7f15240639e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:00.624 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.613+0000 7f1529dcf700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f15240ad080 0x7f1524147d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:00.624 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.613+0000 7f1529dcf700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f152414b2f0 0x7f1524156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:00.624 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.613+0000 7f1529dcf700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15240a9070 con 0x7f152414b2f0 2021-11-12T05:50:00.624 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.613+0000 7f1529dcf700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15240a9310 con 0x7f15240ad080 2021-11-12T05:50:00.625 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.613+0000 7f1529dcf700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15240a95b0 con 0x7f15240ac280 2021-11-12T05:50:00.625 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.613+0000 7f1523fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f152414b2f0 0x7f1524156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:00.625 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.613+0000 7f1523fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f152414b2f0 0x7f1524156f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53168/0 (socket says 172.21.2.105:53168) 2021-11-12T05:50:00.625 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.613+0000 7f1523fff700 1 -- 172.21.2.105:0/696218868 learned_addr learned my addr 172.21.2.105:0/696218868 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:50:00.626 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.613+0000 7f1523fff700 1 -- 172.21.2.105:0/696218868 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f15240ac280 msgr2=0x7f15240639e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:00.626 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.613+0000 7f1523fff700 1 --2- 172.21.2.105:0/696218868 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f15240ac280 0x7f15240639e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:00.626 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.613+0000 7f1523fff700 1 -- 172.21.2.105:0/696218868 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f15240ad080 msgr2=0x7f1524147d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:00.626 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.613+0000 7f1523fff700 1 --2- 172.21.2.105:0/696218868 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f15240ad080 0x7f1524147d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:00.627 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.613+0000 7f1523fff700 1 -- 172.21.2.105:0/696218868 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f151c009470 con 0x7f152414b2f0 2021-11-12T05:50:00.627 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.613+0000 7f1523fff700 1 --2- 172.21.2.105:0/696218868 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f152414b2f0 0x7f1524156f70 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 rx=0x7f15240ac6a0 tx=0x7f151c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:00.627 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.613+0000 7f1520ff9700 1 -- 172.21.2.105:0/696218868 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f151c01f5e0 con 0x7f152414b2f0 2021-11-12T05:50:00.627 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.613+0000 7f1520ff9700 1 -- 172.21.2.105:0/696218868 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151c01f740 con 0x7f152414b2f0 2021-11-12T05:50:00.627 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.613+0000 7f1529dcf700 1 -- 172.21.2.105:0/696218868 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15241568b0 con 0x7f152414b2f0 2021-11-12T05:50:00.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.613+0000 7f1520ff9700 1 -- 172.21.2.105:0/696218868 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f151c01faa0 con 0x7f152414b2f0 2021-11-12T05:50:00.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.613+0000 7f1529dcf700 1 -- 172.21.2.105:0/696218868 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15240aa160 con 0x7f152414b2f0 2021-11-12T05:50:00.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.617+0000 7f1529dcf700 1 -- 172.21.2.105:0/696218868 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15240b1440 con 0x7f152414b2f0 2021-11-12T05:50:00.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.617+0000 7f1520ff9700 1 -- 172.21.2.105:0/696218868 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f151c026030 con 0x7f152414b2f0 2021-11-12T05:50:00.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.617+0000 7f1520ff9700 1 --2- 172.21.2.105:0/696218868 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f15080536a0 0x7f1508055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:00.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.617+0000 7f1520ff9700 1 -- 172.21.2.105:0/696218868 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f151c06cc30 con 0x7f152414b2f0 2021-11-12T05:50:00.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.617+0000 7f15237fe700 1 --2- 172.21.2.105:0/696218868 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f15080536a0 0x7f1508055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:00.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.617+0000 7f15237fe700 1 --2- 172.21.2.105:0/696218868 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f15080536a0 0x7f1508055b60 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f1514000ed0 tx=0x7f15140076c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:00.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.617+0000 7f1520ff9700 1 -- 172.21.2.105:0/696218868 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f151c043c40 con 0x7f152414b2f0 2021-11-12T05:50:00.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.725+0000 7f1529dcf700 1 -- 172.21.2.105:0/696218868 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1524068700 con 0x7f152414b2f0 2021-11-12T05:50:00.729 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.725+0000 7f1520ff9700 1 -- 172.21.2.105:0/696218868 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f151c024090 con 0x7f152414b2f0 2021-11-12T05:50:00.730 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:50:00.731 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":74,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5596,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/460551031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":460551031},{"type":"v1","addr":"172.21.2.115:6833","nonce":460551031}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":73}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:49:57.435843+0000","modified":"2021-11-12T05:49:58.439104+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8829},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8829":{"gid":8829,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/4094714006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":4094714006},{"type":"v1","addr":"172.21.2.105:6835","nonce":4094714006}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-11-12T05:50:00.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.725+0000 7f1529dcf700 1 -- 172.21.2.105:0/696218868 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f15080536a0 msgr2=0x7f1508055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:00.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.725+0000 7f1529dcf700 1 --2- 172.21.2.105:0/696218868 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f15080536a0 0x7f1508055b60 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f1514000ed0 tx=0x7f15140076c0).stop 2021-11-12T05:50:00.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.725+0000 7f1529dcf700 1 -- 172.21.2.105:0/696218868 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f152414b2f0 msgr2=0x7f1524156f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:00.732 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.725+0000 7f1529dcf700 1 --2- 172.21.2.105:0/696218868 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f152414b2f0 0x7f1524156f70 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 rx=0x7f15240ac6a0 tx=0x7f151c016000).stop 2021-11-12T05:50:00.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.725+0000 7f1529dcf700 1 -- 172.21.2.105:0/696218868 shutdown_connections 2021-11-12T05:50:00.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.725+0000 7f1529dcf700 1 --2- 172.21.2.105:0/696218868 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f15080536a0 0x7f1508055b60 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:00.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.725+0000 7f1529dcf700 1 --2- 172.21.2.105:0/696218868 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f152414b2f0 0x7f1524156f70 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:00.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.725+0000 7f1529dcf700 1 --2- 172.21.2.105:0/696218868 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f15240ad080 0x7f1524147d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:00.733 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.725+0000 7f1529dcf700 1 --2- 172.21.2.105:0/696218868 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f15240ac280 0x7f15240639e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:00.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.725+0000 7f1529dcf700 1 -- 172.21.2.105:0/696218868 >> 172.21.2.105:0/696218868 conn(0x7f15240b5370 msgr2=0x7f152414aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:50:00.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.725+0000 7f1529dcf700 1 -- 172.21.2.105:0/696218868 shutdown_connections 2021-11-12T05:50:00.734 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:00.725+0000 7f1529dcf700 1 -- 172.21.2.105:0/696218868 wait complete. 2021-11-12T05:50:00.734 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 74 2021-11-12T05:50:00.938 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 74, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:49:57.435843+0000', 'modified': '2021-11-12T05:49:58.439104+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8829}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8829': {'gid': 8829, 'name': 'a', 'rank': 0, 'incarnation': 73, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/4094714006', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 4094714006}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 4094714006}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:50:00.938 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:50:00.939 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:50:01.003 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":8829,"want_state":"up:active","state":"up:active","rank_uptime":3.5596736560000002,"mdsmap_epoch":74,"osdmap_epoch":156,"osdmap_epoch_barrier":155,"uptime":7.7313437690000004} 2021-11-12T05:50:01.004 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 8829, "mdsmap_epoch": 74, "osdmap_epoch": 156, "osdmap_epoch_barrier": 155, "rank_uptime": 3.559673656, "state": "up:active", "uptime": 7.731343769, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:50:01.004 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-12T05:50:01.005 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-11-12T05:50:01.005 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@gibba016.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-11-12T05:50:01.006 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:50:01.006 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:50:01.017 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:50:01.072 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:50:01.072 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:50:01.078 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:50:01.079 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:50:01.080 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:50:01.080 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:50:01.084 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-12T05:50:01.085 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:50:01.131 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:50:01.141 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:50:01.142 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:50:01.146 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:50:01.147 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:50:01.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:50:01.149 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:50:01.169 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:2021-11-12T05:50:01.161+0000 7fe974880080 -1 init, newargv = 0x5556ebb1be40 newargc=9 2021-11-12T05:50:01.169 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[15367]: starting ceph client 2021-11-12T05:50:01.174 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.gibba016.stderr:ceph-fuse[15367]: starting fuse 2021-11-12T05:50:02.275 DEBUG:teuthology.orchestra.run.gibba016:> sudo modprobe fuse 2021-11-12T05:50:02.287 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:50:02.288 DEBUG:teuthology.orchestra.run.gibba016:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:50:02.335 INFO:teuthology.orchestra.run.gibba016.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:50:02.336 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:50:02.337 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:50:02.337 DEBUG:teuthology.orchestra.run.gibba016:> ls /sys/fs/fuse/connections 2021-11-12T05:50:02.342 INFO:teuthology.orchestra.run.gibba016.stdout:52 2021-11-12T05:50:02.343 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-12T05:50:02.343 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:50:02.343 DEBUG:teuthology.orchestra.run.gibba016:> sudo python3 -c ' 2021-11-12T05:50:02.344 DEBUG:teuthology.orchestra.run.gibba016:> import glob 2021-11-12T05:50:02.344 DEBUG:teuthology.orchestra.run.gibba016:> import re 2021-11-12T05:50:02.345 DEBUG:teuthology.orchestra.run.gibba016:> import os 2021-11-12T05:50:02.345 DEBUG:teuthology.orchestra.run.gibba016:> import subprocess 2021-11-12T05:50:02.346 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:50:02.346 DEBUG:teuthology.orchestra.run.gibba016:> def find_socket(client_name): 2021-11-12T05:50:02.346 DEBUG:teuthology.orchestra.run.gibba016:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-11-12T05:50:02.347 DEBUG:teuthology.orchestra.run.gibba016:> files = glob.glob(asok_path) 2021-11-12T05:50:02.347 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:50:02.348 DEBUG:teuthology.orchestra.run.gibba016:> # Given a non-glob path, it better be there 2021-11-12T05:50:02.348 DEBUG:teuthology.orchestra.run.gibba016:> if "*" not in asok_path: 2021-11-12T05:50:02.348 DEBUG:teuthology.orchestra.run.gibba016:> assert(len(files) == 1) 2021-11-12T05:50:02.349 DEBUG:teuthology.orchestra.run.gibba016:> return files[0] 2021-11-12T05:50:02.349 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:50:02.350 DEBUG:teuthology.orchestra.run.gibba016:> for f in files: 2021-11-12T05:50:02.350 DEBUG:teuthology.orchestra.run.gibba016:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-12T05:50:02.351 DEBUG:teuthology.orchestra.run.gibba016:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-12T05:50:02.351 DEBUG:teuthology.orchestra.run.gibba016:> return f 2021-11-12T05:50:02.351 DEBUG:teuthology.orchestra.run.gibba016:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-12T05:50:02.352 DEBUG:teuthology.orchestra.run.gibba016:> 2021-11-12T05:50:02.352 DEBUG:teuthology.orchestra.run.gibba016:> print(find_socket("client.0")) 2021-11-12T05:50:02.353 DEBUG:teuthology.orchestra.run.gibba016:> ' 2021-11-12T05:50:02.379 INFO:teuthology.orchestra.run.gibba016.stdout:/var/run/ceph/ceph-client.0.15367.asok 2021-11-12T05:50:02.381 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.15367.asok 2021-11-12T05:50:02.382 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:50:02.383 DEBUG:teuthology.orchestra.run.gibba016:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.15367.asok status 2021-11-12T05:50:02.474 INFO:teuthology.orchestra.run.gibba016.stdout:{ 2021-11-12T05:50:02.475 INFO:teuthology.orchestra.run.gibba016.stdout: "metadata": { 2021-11-12T05:50:02.475 INFO:teuthology.orchestra.run.gibba016.stdout: "ceph_sha1": "a81ee2815de5acae59ead5b8c9137b6766fc8ea8", 2021-11-12T05:50:02.475 INFO:teuthology.orchestra.run.gibba016.stdout: "ceph_version": "ceph version 15.2.15-22-ga81ee281 (a81ee2815de5acae59ead5b8c9137b6766fc8ea8) octopus (stable)", 2021-11-12T05:50:02.475 INFO:teuthology.orchestra.run.gibba016.stdout: "entity_id": "0", 2021-11-12T05:50:02.476 INFO:teuthology.orchestra.run.gibba016.stdout: "hostname": "gibba016", 2021-11-12T05:50:02.476 INFO:teuthology.orchestra.run.gibba016.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-11-12T05:50:02.476 INFO:teuthology.orchestra.run.gibba016.stdout: "pid": "15367", 2021-11-12T05:50:02.476 INFO:teuthology.orchestra.run.gibba016.stdout: "root": "/" 2021-11-12T05:50:02.477 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:50:02.477 INFO:teuthology.orchestra.run.gibba016.stdout: "dentry_count": 0, 2021-11-12T05:50:02.477 INFO:teuthology.orchestra.run.gibba016.stdout: "dentry_pinned_count": 0, 2021-11-12T05:50:02.477 INFO:teuthology.orchestra.run.gibba016.stdout: "id": 5168, 2021-11-12T05:50:02.478 INFO:teuthology.orchestra.run.gibba016.stdout: "inst": { 2021-11-12T05:50:02.478 INFO:teuthology.orchestra.run.gibba016.stdout: "name": { 2021-11-12T05:50:02.478 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "client", 2021-11-12T05:50:02.478 INFO:teuthology.orchestra.run.gibba016.stdout: "num": 5168 2021-11-12T05:50:02.479 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:50:02.479 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": { 2021-11-12T05:50:02.479 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "v1", 2021-11-12T05:50:02.479 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": "172.21.2.116:0", 2021-11-12T05:50:02.480 INFO:teuthology.orchestra.run.gibba016.stdout: "nonce": 2100861513 2021-11-12T05:50:02.480 INFO:teuthology.orchestra.run.gibba016.stdout: } 2021-11-12T05:50:02.480 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:50:02.480 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": { 2021-11-12T05:50:02.481 INFO:teuthology.orchestra.run.gibba016.stdout: "type": "v1", 2021-11-12T05:50:02.481 INFO:teuthology.orchestra.run.gibba016.stdout: "addr": "172.21.2.116:0", 2021-11-12T05:50:02.481 INFO:teuthology.orchestra.run.gibba016.stdout: "nonce": 2100861513 2021-11-12T05:50:02.481 INFO:teuthology.orchestra.run.gibba016.stdout: }, 2021-11-12T05:50:02.482 INFO:teuthology.orchestra.run.gibba016.stdout: "inst_str": "client.5168 172.21.2.116:0/2100861513", 2021-11-12T05:50:02.482 INFO:teuthology.orchestra.run.gibba016.stdout: "addr_str": "172.21.2.116:0/2100861513", 2021-11-12T05:50:02.482 INFO:teuthology.orchestra.run.gibba016.stdout: "inode_count": 1, 2021-11-12T05:50:02.482 INFO:teuthology.orchestra.run.gibba016.stdout: "mds_epoch": 74, 2021-11-12T05:50:02.482 INFO:teuthology.orchestra.run.gibba016.stdout: "osd_epoch": 156, 2021-11-12T05:50:02.483 INFO:teuthology.orchestra.run.gibba016.stdout: "osd_epoch_barrier": 0, 2021-11-12T05:50:02.483 INFO:teuthology.orchestra.run.gibba016.stdout: "blacklisted": false, 2021-11-12T05:50:02.483 INFO:teuthology.orchestra.run.gibba016.stdout: "fs_name": "cephfs" 2021-11-12T05:50:02.483 INFO:teuthology.orchestra.run.gibba016.stdout:} 2021-11-12T05:50:02.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:50:02.485 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:50:02.486 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:50:02.491 INFO:teuthology.orchestra.run.gibba016.stdout:fuseblk 2021-11-12T05:50:02.491 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-11-12T05:50:02.492 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:50:02.492 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:50:02.558 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T05:50:02.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.609+0000 7f9d14f3d700 1 Processor -- start 2021-11-12T05:50:02.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.609+0000 7f9d14f3d700 1 -- start start 2021-11-12T05:50:02.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.609+0000 7f9d14f3d700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9d100b2940 0x7f9d10142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:02.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.609+0000 7f9d14f3d700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f9d100b0cc0 0x7f9d1005f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:02.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.609+0000 7f9d14f3d700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d100b2d20 con 0x7f9d100b0780 2021-11-12T05:50:02.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.609+0000 7f9d14f3d700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d100b1fc0 con 0x7f9d100b0cc0 2021-11-12T05:50:02.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.609+0000 7f9d14f3d700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d100b15e0 con 0x7f9d100b2940 2021-11-12T05:50:02.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.613+0000 7f9d0ed9d700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f9d100b0cc0 0x7f9d1005f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:02.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.613+0000 7f9d0e59c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9d100b2940 0x7f9d10142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:02.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.613+0000 7f9d0dd9b700 1 --1- >> v1:172.21.2.115:6789/0 conn(0x7f9d100b0780 0x7f9d101432b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.115:6789/0 says I am v1:172.21.2.105:33806/0 (socket says 172.21.2.105:33806) 2021-11-12T05:50:02.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.613+0000 7f9d0dd9b700 1 -- 172.21.2.105:0/1385546208 learned_addr learned my addr 172.21.2.105:0/1385546208 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:50:02.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.613+0000 7f9d0ed9d700 1 -- 172.21.2.105:0/1385546208 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9d100b2940 msgr2=0x7f9d10142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:50:02.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.613+0000 7f9d0ed9d700 1 --2- 172.21.2.105:0/1385546208 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9d100b2940 0x7f9d10142dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:02.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.613+0000 7f9d0ed9d700 1 -- 172.21.2.105:0/1385546208 >> v1:172.21.2.115:6789/0 conn(0x7f9d100b0780 legacy=0x7f9d101432b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:02.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.613+0000 7f9d0ed9d700 1 -- 172.21.2.105:0/1385546208 --> v2:172.21.2.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d100b1880 con 0x7f9d100b0cc0 2021-11-12T05:50:02.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.613+0000 7f9d0e59c700 1 --2- 172.21.2.105:0/1385546208 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9d100b2940 0x7f9d10142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-11-12T05:50:02.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.613+0000 7f9d0ed9d700 1 --2- 172.21.2.105:0/1385546208 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9d100b0cc0 0x7f9d1005f6b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f9d00001110 tx=0x7f9d0800b470).ready entity=mon.1 client_cookie=1533ef10b4592551 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:02.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.613+0000 7f9d0d59a700 1 -- 172.21.2.105:0/1385546208 <== mon.1 v2:172.21.2.115:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d0800dc30 con 0x7f9d100b0cc0 2021-11-12T05:50:02.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.613+0000 7f9d0d59a700 1 -- 172.21.2.105:0/1385546208 <== mon.1 v2:172.21.2.115:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0800dd90 con 0x7f9d100b0cc0 2021-11-12T05:50:02.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.613+0000 7f9d0d59a700 1 -- 172.21.2.105:0/1385546208 <== mon.1 v2:172.21.2.115:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d08010660 con 0x7f9d100b0cc0 2021-11-12T05:50:02.623 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.613+0000 7f9d14f3d700 1 -- 172.21.2.105:0/1385546208 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9d100b0cc0 msgr2=0x7f9d1005f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:02.623 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.613+0000 7f9d14f3d700 1 --2- 172.21.2.105:0/1385546208 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9d100b0cc0 0x7f9d1005f6b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f9d00001110 tx=0x7f9d0800b470).stop 2021-11-12T05:50:02.624 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.617+0000 7f9d14f3d700 1 -- 172.21.2.105:0/1385546208 shutdown_connections 2021-11-12T05:50:02.624 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.617+0000 7f9d14f3d700 1 --2- 172.21.2.105:0/1385546208 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9d100b0cc0 0x7f9d1005f6b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:02.624 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.617+0000 7f9d14f3d700 1 --2- 172.21.2.105:0/1385546208 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9d100b2940 0x7f9d10142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:02.624 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.617+0000 7f9d14f3d700 1 -- 172.21.2.105:0/1385546208 >> 172.21.2.105:0/1385546208 conn(0x7f9d10068440 msgr2=0x7f9d10062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:50:02.625 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.617+0000 7f9d14f3d700 1 -- 172.21.2.105:0/1385546208 shutdown_connections 2021-11-12T05:50:02.625 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.617+0000 7f9d14f3d700 1 -- 172.21.2.105:0/1385546208 wait complete. 2021-11-12T05:50:02.625 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.617+0000 7f9d14f3d700 1 Processor -- start 2021-11-12T05:50:02.625 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.617+0000 7f9d14f3d700 1 -- start start 2021-11-12T05:50:02.626 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.617+0000 7f9d14f3d700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9d100b0780 0x7f9d10065e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:02.626 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.617+0000 7f9d14f3d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9d100b0cc0 0x7f9d100abbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:02.626 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.617+0000 7f9d14f3d700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9d100b2940 0x7f9d10156100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:02.626 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.617+0000 7f9d14f3d700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1013c350 con 0x7f9d100b0cc0 2021-11-12T05:50:02.627 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.617+0000 7f9d14f3d700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d10155cd0 con 0x7f9d100b0780 2021-11-12T05:50:02.627 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.617+0000 7f9d14f3d700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1013c580 con 0x7f9d100b2940 2021-11-12T05:50:02.627 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.617+0000 7f9d0dd9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9d100b0cc0 0x7f9d100abbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:02.627 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.617+0000 7f9d0dd9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9d100b0cc0 0x7f9d100abbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53182/0 (socket says 172.21.2.105:53182) 2021-11-12T05:50:02.627 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.617+0000 7f9d0dd9b700 1 -- 172.21.2.105:0/3008057399 learned_addr learned my addr 172.21.2.105:0/3008057399 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:50:02.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.617+0000 7f9d0e59c700 1 --2- 172.21.2.105:0/3008057399 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9d100b0780 0x7f9d10065e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:02.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.617+0000 7f9d0dd9b700 1 -- 172.21.2.105:0/3008057399 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9d100b2940 msgr2=0x7f9d10156100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:02.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.617+0000 7f9d0dd9b700 1 --2- 172.21.2.105:0/3008057399 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9d100b2940 0x7f9d10156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:02.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.617+0000 7f9d0dd9b700 1 -- 172.21.2.105:0/3008057399 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9d100b0780 msgr2=0x7f9d10065e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:02.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.617+0000 7f9d0dd9b700 1 --2- 172.21.2.105:0/3008057399 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9d100b0780 0x7f9d10065e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:02.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.617+0000 7f9d0dd9b700 1 -- 172.21.2.105:0/3008057399 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf800b180 con 0x7f9d100b0cc0 2021-11-12T05:50:02.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.617+0000 7f9d0dd9b700 1 --2- 172.21.2.105:0/3008057399 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9d100b0cc0 0x7f9d100abbe0 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 rx=0x7f9d000011d0 tx=0x7f9d00007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:02.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.617+0000 7f9d077fe700 1 -- 172.21.2.105:0/3008057399 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d000072e0 con 0x7f9d100b0cc0 2021-11-12T05:50:02.630 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.617+0000 7f9d077fe700 1 -- 172.21.2.105:0/3008057399 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d00007440 con 0x7f9d100b0cc0 2021-11-12T05:50:02.630 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.617+0000 7f9d14f3d700 1 -- 172.21.2.105:0/3008057399 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d0800b710 con 0x7f9d100b0cc0 2021-11-12T05:50:02.630 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.617+0000 7f9d14f3d700 1 -- 172.21.2.105:0/3008057399 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d100ac0d0 con 0x7f9d100b0cc0 2021-11-12T05:50:02.630 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.617+0000 7f9d077fe700 1 -- 172.21.2.105:0/3008057399 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d00005800 con 0x7f9d100b0cc0 2021-11-12T05:50:02.630 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.617+0000 7f9d14f3d700 1 -- 172.21.2.105:0/3008057399 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d10057350 con 0x7f9d100b0cc0 2021-11-12T05:50:02.631 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.617+0000 7f9d077fe700 1 -- 172.21.2.105:0/3008057399 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9d00010070 con 0x7f9d100b0cc0 2021-11-12T05:50:02.631 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.621+0000 7f9d077fe700 1 --2- 172.21.2.105:0/3008057399 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9cf4053690 0x7f9cf4055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:02.631 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.621+0000 7f9d077fe700 1 -- 172.21.2.105:0/3008057399 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f9d0006b3d0 con 0x7f9d100b0cc0 2021-11-12T05:50:02.631 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.621+0000 7f9d0e59c700 1 --2- 172.21.2.105:0/3008057399 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9cf4053690 0x7f9cf4055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:02.632 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.621+0000 7f9d0e59c700 1 --2- 172.21.2.105:0/3008057399 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9cf4053690 0x7f9cf4055b50 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f9cf800b000 tx=0x7f9cf8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:02.632 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.621+0000 7f9d077fe700 1 -- 172.21.2.105:0/3008057399 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9d000422d0 con 0x7f9d100b0cc0 2021-11-12T05:50:02.707 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.705+0000 7f9d14f3d700 1 -- 172.21.2.105:0/3008057399 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d1013cc30 con 0x7f9d100b0cc0 2021-11-12T05:50:02.708 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.705+0000 7f9d077fe700 1 -- 172.21.2.105:0/3008057399 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v156) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f9d000458f0 con 0x7f9d100b0cc0 2021-11-12T05:50:02.708 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:50:02.709 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":156,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:49:58.440307+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-11-12T05:49:55.298718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-11-12T05:49:56.403004+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T05:50:02.710 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.705+0000 7f9d14f3d700 1 -- 172.21.2.105:0/3008057399 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9cf4053690 msgr2=0x7f9cf4055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:02.710 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.705+0000 7f9d14f3d700 1 --2- 172.21.2.105:0/3008057399 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9cf4053690 0x7f9cf4055b50 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f9cf800b000 tx=0x7f9cf8008040).stop 2021-11-12T05:50:02.710 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.705+0000 7f9d14f3d700 1 -- 172.21.2.105:0/3008057399 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9d100b0cc0 msgr2=0x7f9d100abbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:02.711 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.705+0000 7f9d14f3d700 1 --2- 172.21.2.105:0/3008057399 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9d100b0cc0 0x7f9d100abbe0 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 rx=0x7f9d000011d0 tx=0x7f9d00007c00).stop 2021-11-12T05:50:02.711 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.705+0000 7f9d14f3d700 1 -- 172.21.2.105:0/3008057399 shutdown_connections 2021-11-12T05:50:02.711 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.705+0000 7f9d14f3d700 1 --2- 172.21.2.105:0/3008057399 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9cf4053690 0x7f9cf4055b50 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:02.711 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.705+0000 7f9d14f3d700 1 --2- 172.21.2.105:0/3008057399 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9d100b2940 0x7f9d10156100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:02.711 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.705+0000 7f9d14f3d700 1 --2- 172.21.2.105:0/3008057399 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9d100b0cc0 0x7f9d100abbe0 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:02.712 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.705+0000 7f9d14f3d700 1 --2- 172.21.2.105:0/3008057399 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9d100b0780 0x7f9d10065e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:02.712 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.705+0000 7f9d14f3d700 1 -- 172.21.2.105:0/3008057399 >> 172.21.2.105:0/3008057399 conn(0x7f9d10068440 msgr2=0x7f9d1013b000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:50:02.712 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.705+0000 7f9d14f3d700 1 -- 172.21.2.105:0/3008057399 shutdown_connections 2021-11-12T05:50:02.712 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.705+0000 7f9d14f3d700 1 -- 172.21.2.105:0/3008057399 wait complete. 2021-11-12T05:50:02.716 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-11-12T05:40:22.022116+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-11-12T05:40:29.953617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 29, 'pool_name': 'cephfs_metadata', 'create_time': '2021-11-12T05:49:55.298718+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '155', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 30, 'pool_name': 'cephfs_data', 'create_time': '2021-11-12T05:49:56.403004+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '156', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-11-12T05:50:02.717 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2021-11-12T05:50:02.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.765+0000 7fd78c226700 1 Processor -- start 2021-11-12T05:50:02.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.765+0000 7fd78c226700 1 -- start start 2021-11-12T05:50:02.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.765+0000 7fd78c226700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd7840aca40 0x7fd7840ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:02.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.765+0000 7fd78c226700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fd7840b0520 0x7fd7841473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:02.772 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.765+0000 7fd78c226700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7840b1840 con 0x7fd7841478b0 2021-11-12T05:50:02.772 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.765+0000 7fd78c226700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd784147d20 con 0x7fd7840aca40 2021-11-12T05:50:02.772 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.765+0000 7fd78c226700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7840b09d0 con 0x7fd7840b0520 2021-11-12T05:50:02.772 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.765+0000 7fd789fc2700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd7840aca40 0x7fd7840ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:02.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.765+0000 7fd789fc2700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd7840aca40 0x7fd7840ace20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53188/0 (socket says 172.21.2.105:53188) 2021-11-12T05:50:02.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.765+0000 7fd789fc2700 1 -- 172.21.2.105:0/799665991 learned_addr learned my addr 172.21.2.105:0/799665991 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:50:02.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.765+0000 7fd789fc2700 1 -- 172.21.2.105:0/799665991 >> v2:172.21.2.115:3300/0 conn(0x7fd7840b0520 msgr2=0x7fd7841473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:50:02.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.765+0000 7fd789fc2700 1 --2- 172.21.2.105:0/799665991 >> v2:172.21.2.115:3300/0 conn(0x7fd7840b0520 0x7fd7841473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:02.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.765+0000 7fd789fc2700 1 -- 172.21.2.105:0/799665991 >> v1:172.21.2.115:6789/0 conn(0x7fd7841478b0 legacy=0x7fd784144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:50:02.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.765+0000 7fd789fc2700 1 -- 172.21.2.105:0/799665991 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7840af2b0 con 0x7fd7840aca40 2021-11-12T05:50:02.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.765+0000 7fd789fc2700 1 --2- 172.21.2.105:0/799665991 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd7840aca40 0x7fd7840ace20 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 rx=0x7fd784061140 tx=0x7fd774006eb0).ready entity=mon.0 client_cookie=44403690967fd61 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:02.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.765+0000 7fd788fc0700 1 -- 172.21.2.105:0/799665991 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd77400d5c0 con 0x7fd7840aca40 2021-11-12T05:50:02.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.765+0000 7fd788fc0700 1 -- 172.21.2.105:0/799665991 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd774000e90 con 0x7fd7840aca40 2021-11-12T05:50:02.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.765+0000 7fd788fc0700 1 -- 172.21.2.105:0/799665991 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd77400d910 con 0x7fd7840aca40 2021-11-12T05:50:02.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.765+0000 7fd78c226700 1 -- 172.21.2.105:0/799665991 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd7840aca40 msgr2=0x7fd7840ace20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:02.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.765+0000 7fd78c226700 1 --2- 172.21.2.105:0/799665991 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd7840aca40 0x7fd7840ace20 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 rx=0x7fd784061140 tx=0x7fd774006eb0).stop 2021-11-12T05:50:02.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.765+0000 7fd78c226700 1 -- 172.21.2.105:0/799665991 shutdown_connections 2021-11-12T05:50:02.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.765+0000 7fd78c226700 1 --2- 172.21.2.105:0/799665991 >> v2:172.21.2.115:3300/0 conn(0x7fd7840b0520 0x7fd7841473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:02.776 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.765+0000 7fd78c226700 1 --2- 172.21.2.105:0/799665991 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd7840aca40 0x7fd7840ace20 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:02.776 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.765+0000 7fd78c226700 1 -- 172.21.2.105:0/799665991 >> 172.21.2.105:0/799665991 conn(0x7fd78405c490 msgr2=0x7fd7840b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:50:02.776 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.765+0000 7fd78c226700 1 -- 172.21.2.105:0/799665991 shutdown_connections 2021-11-12T05:50:02.776 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.765+0000 7fd78c226700 1 -- 172.21.2.105:0/799665991 wait complete. 2021-11-12T05:50:02.776 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.765+0000 7fd78c226700 1 Processor -- start 2021-11-12T05:50:02.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.769+0000 7fd78c226700 1 -- start start 2021-11-12T05:50:02.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.769+0000 7fd78c226700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd7840aca40 0x7fd784138a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:02.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.769+0000 7fd78c226700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd7840b0520 0x7fd7840a9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:02.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.769+0000 7fd78c226700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd7841478b0 0x7fd784063730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:02.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.769+0000 7fd78c226700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd784066a00 con 0x7fd7841478b0 2021-11-12T05:50:02.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.769+0000 7fd78c226700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7840a9450 con 0x7fd7840b0520 2021-11-12T05:50:02.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.769+0000 7fd78c226700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7840a96f0 con 0x7fd7840aca40 2021-11-12T05:50:02.781 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.769+0000 7fd78a7c3700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd7841478b0 0x7fd784063730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:02.781 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.769+0000 7fd78a7c3700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd7841478b0 0x7fd784063730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53196/0 (socket says 172.21.2.105:53196) 2021-11-12T05:50:02.781 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.769+0000 7fd78a7c3700 1 -- 172.21.2.105:0/3148870312 learned_addr learned my addr 172.21.2.105:0/3148870312 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:50:02.781 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.769+0000 7fd78a7c3700 1 -- 172.21.2.105:0/3148870312 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd7840aca40 msgr2=0x7fd784138a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:02.781 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.769+0000 7fd78a7c3700 1 --2- 172.21.2.105:0/3148870312 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd7840aca40 0x7fd784138a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:02.782 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.769+0000 7fd78a7c3700 1 -- 172.21.2.105:0/3148870312 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd7840b0520 msgr2=0x7fd7840a9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:02.782 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.769+0000 7fd78a7c3700 1 --2- 172.21.2.105:0/3148870312 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd7840b0520 0x7fd7840a9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:02.782 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.769+0000 7fd78a7c3700 1 -- 172.21.2.105:0/3148870312 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd77400b1e0 con 0x7fd7841478b0 2021-11-12T05:50:02.782 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.769+0000 7fd78a7c3700 1 --2- 172.21.2.105:0/3148870312 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd7841478b0 0x7fd784063730 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 rx=0x7fd77c003270 tx=0x7fd77c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:02.783 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.769+0000 7fd772ffd700 1 -- 172.21.2.105:0/3148870312 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd77c00d4a0 con 0x7fd7841478b0 2021-11-12T05:50:02.783 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.769+0000 7fd772ffd700 1 -- 172.21.2.105:0/3148870312 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77c00d600 con 0x7fd7841478b0 2021-11-12T05:50:02.783 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.769+0000 7fd772ffd700 1 -- 172.21.2.105:0/3148870312 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd77c00d960 con 0x7fd7841478b0 2021-11-12T05:50:02.783 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.769+0000 7fd78c226700 1 -- 172.21.2.105:0/3148870312 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7840a9990 con 0x7fd7841478b0 2021-11-12T05:50:02.784 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.769+0000 7fd78c226700 1 -- 172.21.2.105:0/3148870312 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd784138650 con 0x7fd7841478b0 2021-11-12T05:50:02.784 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.769+0000 7fd78c226700 1 -- 172.21.2.105:0/3148870312 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7840a9b20 con 0x7fd7841478b0 2021-11-12T05:50:02.784 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.769+0000 7fd772ffd700 1 -- 172.21.2.105:0/3148870312 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd77c018030 con 0x7fd7841478b0 2021-11-12T05:50:02.784 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.769+0000 7fd772ffd700 1 --2- 172.21.2.105:0/3148870312 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd7640536a0 0x7fd764055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:02.784 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.769+0000 7fd772ffd700 1 -- 172.21.2.105:0/3148870312 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fd77c06b350 con 0x7fd7841478b0 2021-11-12T05:50:02.785 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.769+0000 7fd789fc2700 1 --2- 172.21.2.105:0/3148870312 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd7640536a0 0x7fd764055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:02.785 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.769+0000 7fd789fc2700 1 --2- 172.21.2.105:0/3148870312 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd7640536a0 0x7fd764055b60 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7fd784061140 tx=0x7fd774015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:02.785 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.773+0000 7fd772ffd700 1 -- 172.21.2.105:0/3148870312 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd77c042300 con 0x7fd7841478b0 2021-11-12T05:50:02.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.857+0000 7fd78c226700 1 -- 172.21.2.105:0/3148870312 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd784057350 con 0x7fd7841478b0 2021-11-12T05:50:02.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.857+0000 7fd772ffd700 1 -- 172.21.2.105:0/3148870312 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v156) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd77c045920 con 0x7fd7841478b0 2021-11-12T05:50:02.860 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 1 2021-11-12T05:50:02.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.857+0000 7fd78c226700 1 -- 172.21.2.105:0/3148870312 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd7640536a0 msgr2=0x7fd764055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:02.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.857+0000 7fd78c226700 1 --2- 172.21.2.105:0/3148870312 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd7640536a0 0x7fd764055b60 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7fd784061140 tx=0x7fd774015000).stop 2021-11-12T05:50:02.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.857+0000 7fd78c226700 1 -- 172.21.2.105:0/3148870312 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd7841478b0 msgr2=0x7fd784063730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:02.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.857+0000 7fd78c226700 1 --2- 172.21.2.105:0/3148870312 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd7841478b0 0x7fd784063730 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 rx=0x7fd77c003270 tx=0x7fd77c0090f0).stop 2021-11-12T05:50:02.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.857+0000 7fd78c226700 1 -- 172.21.2.105:0/3148870312 shutdown_connections 2021-11-12T05:50:02.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.857+0000 7fd78c226700 1 --2- 172.21.2.105:0/3148870312 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd7640536a0 0x7fd764055b60 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:02.862 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.857+0000 7fd78c226700 1 --2- 172.21.2.105:0/3148870312 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd7841478b0 0x7fd784063730 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:02.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.857+0000 7fd78c226700 1 --2- 172.21.2.105:0/3148870312 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd7840b0520 0x7fd7840a9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:02.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.857+0000 7fd78c226700 1 --2- 172.21.2.105:0/3148870312 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd7840aca40 0x7fd784138a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:02.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.857+0000 7fd78c226700 1 -- 172.21.2.105:0/3148870312 >> 172.21.2.105:0/3148870312 conn(0x7fd78405c490 msgr2=0x7fd784144d20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:50:02.863 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.857+0000 7fd78c226700 1 -- 172.21.2.105:0/3148870312 shutdown_connections 2021-11-12T05:50:02.864 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.857+0000 7fd78c226700 1 -- 172.21.2.105:0/3148870312 wait complete. 2021-11-12T05:50:02.867 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-11-12T05:50:02.930 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.925+0000 7fb374d47700 1 Processor -- start 2021-11-12T05:50:02.931 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.925+0000 7fb374d47700 1 -- start start 2021-11-12T05:50:02.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.925+0000 7fb374d47700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fb3700aca40 0x7fb3700ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:02.933 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.925+0000 7fb374d47700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb3700b0520 0x7fb3701473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:02.933 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.925+0000 7fb374d47700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb3701478b0 0x7fb370144180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:02.933 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.925+0000 7fb374d47700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb370147d40 con 0x7fb3700b0520 2021-11-12T05:50:02.933 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.925+0000 7fb374d47700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3700b1840 con 0x7fb3700aca40 2021-11-12T05:50:02.934 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.925+0000 7fb374d47700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3700b09d0 con 0x7fb3701478b0 2021-11-12T05:50:02.934 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb36dd9b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb3700b0520 0x7fb3701473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:02.934 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb36dd9b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb3700b0520 0x7fb3701473c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53204/0 (socket says 172.21.2.105:53204) 2021-11-12T05:50:02.934 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb36dd9b700 1 -- 172.21.2.105:0/4202694373 learned_addr learned my addr 172.21.2.105:0/4202694373 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:50:02.934 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb36dd9b700 1 -- 172.21.2.105:0/4202694373 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb3701478b0 msgr2=0x7fb370144180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:50:02.935 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb36dd9b700 1 --2- 172.21.2.105:0/4202694373 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb3701478b0 0x7fb370144180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:02.935 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb36dd9b700 1 -- 172.21.2.105:0/4202694373 >> v2:172.21.2.115:3300/0 conn(0x7fb3700aca40 msgr2=0x7fb3700ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:50:02.935 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb36dd9b700 1 --2- 172.21.2.105:0/4202694373 >> v2:172.21.2.115:3300/0 conn(0x7fb3700aca40 0x7fb3700ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:02.935 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb36dd9b700 1 -- 172.21.2.105:0/4202694373 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3700af2b0 con 0x7fb3700b0520 2021-11-12T05:50:02.936 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb36dd9b700 1 --2- 172.21.2.105:0/4202694373 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb3700b0520 0x7fb3701473c0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 rx=0x7fb3700ae6a0 tx=0x7fb360006eb0).ready entity=mon.0 client_cookie=a0fe78ee41737120 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:02.936 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb36d59a700 1 -- 172.21.2.105:0/4202694373 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb36000d570 con 0x7fb3700b0520 2021-11-12T05:50:02.936 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb36d59a700 1 -- 172.21.2.105:0/4202694373 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb360000e90 con 0x7fb3700b0520 2021-11-12T05:50:02.936 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb36d59a700 1 -- 172.21.2.105:0/4202694373 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb36000d8c0 con 0x7fb3700b0520 2021-11-12T05:50:02.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb374d47700 1 -- 172.21.2.105:0/4202694373 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb3700b0520 msgr2=0x7fb3701473c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:02.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb374d47700 1 --2- 172.21.2.105:0/4202694373 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb3700b0520 0x7fb3701473c0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 rx=0x7fb3700ae6a0 tx=0x7fb360006eb0).stop 2021-11-12T05:50:02.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb374d47700 1 -- 172.21.2.105:0/4202694373 shutdown_connections 2021-11-12T05:50:02.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb374d47700 1 --2- 172.21.2.105:0/4202694373 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb3701478b0 0x7fb370144180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:02.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb374d47700 1 --2- 172.21.2.105:0/4202694373 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb3700b0520 0x7fb3701473c0 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:02.938 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb374d47700 1 --2- 172.21.2.105:0/4202694373 >> v2:172.21.2.115:3300/0 conn(0x7fb3700aca40 0x7fb3700ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:02.938 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb374d47700 1 -- 172.21.2.105:0/4202694373 >> 172.21.2.105:0/4202694373 conn(0x7fb37005c490 msgr2=0x7fb3700b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:50:02.938 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb374d47700 1 -- 172.21.2.105:0/4202694373 shutdown_connections 2021-11-12T05:50:02.938 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb374d47700 1 -- 172.21.2.105:0/4202694373 wait complete. 2021-11-12T05:50:02.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb374d47700 1 Processor -- start 2021-11-12T05:50:02.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb374d47700 1 -- start start 2021-11-12T05:50:02.942 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb374d47700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb3700aca40 0x7fb370066e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:02.942 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb374d47700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb3700b0520 0x7fb370064500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:02.942 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb374d47700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb3701478b0 0x7fb370149c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:02.942 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb374d47700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb370157180 con 0x7fb3700b0520 2021-11-12T05:50:02.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb374d47700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3700a75a0 con 0x7fb3701478b0 2021-11-12T05:50:02.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb374d47700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3700a7020 con 0x7fb3700aca40 2021-11-12T05:50:02.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb36dd9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb3700b0520 0x7fb370064500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:02.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb36dd9b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb3700b0520 0x7fb370064500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53206/0 (socket says 172.21.2.105:53206) 2021-11-12T05:50:02.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb36dd9b700 1 -- 172.21.2.105:0/3239867558 learned_addr learned my addr 172.21.2.105:0/3239867558 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:50:02.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb36dd9b700 1 -- 172.21.2.105:0/3239867558 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb3700aca40 msgr2=0x7fb370066e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:02.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb36dd9b700 1 --2- 172.21.2.105:0/3239867558 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb3700aca40 0x7fb370066e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:02.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb36dd9b700 1 -- 172.21.2.105:0/3239867558 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb3701478b0 msgr2=0x7fb370149c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:02.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb36dd9b700 1 --2- 172.21.2.105:0/3239867558 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb3701478b0 0x7fb370149c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:02.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb36dd9b700 1 -- 172.21.2.105:0/3239867558 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb36000b1e0 con 0x7fb3700b0520 2021-11-12T05:50:02.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb36dd9b700 1 --2- 172.21.2.105:0/3239867558 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb3700b0520 0x7fb370064500 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 rx=0x7fb3700ae6a0 tx=0x7fb360015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:02.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb3677fe700 1 -- 172.21.2.105:0/3239867558 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb360021070 con 0x7fb3700b0520 2021-11-12T05:50:02.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb3677fe700 1 -- 172.21.2.105:0/3239867558 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36000de60 con 0x7fb3700b0520 2021-11-12T05:50:02.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb374d47700 1 -- 172.21.2.105:0/3239867558 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3701573b0 con 0x7fb3700b0520 2021-11-12T05:50:02.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb3677fe700 1 -- 172.21.2.105:0/3239867558 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb360002f50 con 0x7fb3700b0520 2021-11-12T05:50:02.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.929+0000 7fb374d47700 1 -- 172.21.2.105:0/3239867558 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb370063b40 con 0x7fb3700b0520 2021-11-12T05:50:02.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.933+0000 7fb374d47700 1 -- 172.21.2.105:0/3239867558 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb370157540 con 0x7fb3700b0520 2021-11-12T05:50:02.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.933+0000 7fb3677fe700 1 -- 172.21.2.105:0/3239867558 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb36000f070 con 0x7fb3700b0520 2021-11-12T05:50:02.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.933+0000 7fb3677fe700 1 --2- 172.21.2.105:0/3239867558 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb3540536f0 0x7fb354055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:02.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.933+0000 7fb3677fe700 1 -- 172.21.2.105:0/3239867558 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fb36006d1e0 con 0x7fb3700b0520 2021-11-12T05:50:02.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.933+0000 7fb36e59c700 1 --2- 172.21.2.105:0/3239867558 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb3540536f0 0x7fb354055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:02.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.933+0000 7fb36e59c700 1 --2- 172.21.2.105:0/3239867558 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb3540536f0 0x7fb354055bb0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7fb358002f70 tx=0x7fb358006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:02.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:02.933+0000 7fb3677fe700 1 -- 172.21.2.105:0/3239867558 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb3600440e0 con 0x7fb3700b0520 2021-11-12T05:50:03.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.017+0000 7fb374d47700 1 -- 172.21.2.105:0/3239867558 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb37005f280 con 0x7fb3700b0520 2021-11-12T05:50:03.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.017+0000 7fb3677fe700 1 -- 172.21.2.105:0/3239867558 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v156) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb360047700 con 0x7fb3700b0520 2021-11-12T05:50:03.023 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:50:03.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.021+0000 7fb374d47700 1 -- 172.21.2.105:0/3239867558 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb3540536f0 msgr2=0x7fb354055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:03.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.021+0000 7fb374d47700 1 --2- 172.21.2.105:0/3239867558 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb3540536f0 0x7fb354055bb0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7fb358002f70 tx=0x7fb358006a80).stop 2021-11-12T05:50:03.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.021+0000 7fb374d47700 1 -- 172.21.2.105:0/3239867558 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb3700b0520 msgr2=0x7fb370064500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:03.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.021+0000 7fb374d47700 1 --2- 172.21.2.105:0/3239867558 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb3700b0520 0x7fb370064500 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 rx=0x7fb3700ae6a0 tx=0x7fb360015000).stop 2021-11-12T05:50:03.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.021+0000 7fb374d47700 1 -- 172.21.2.105:0/3239867558 shutdown_connections 2021-11-12T05:50:03.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.021+0000 7fb374d47700 1 --2- 172.21.2.105:0/3239867558 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb3540536f0 0x7fb354055bb0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:03.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.021+0000 7fb374d47700 1 --2- 172.21.2.105:0/3239867558 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb3701478b0 0x7fb370149c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:03.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.021+0000 7fb374d47700 1 --2- 172.21.2.105:0/3239867558 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb3700b0520 0x7fb370064500 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:03.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.021+0000 7fb374d47700 1 --2- 172.21.2.105:0/3239867558 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb3700aca40 0x7fb370066e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:03.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.021+0000 7fb374d47700 1 -- 172.21.2.105:0/3239867558 >> 172.21.2.105:0/3239867558 conn(0x7fb37005c490 msgr2=0x7fb370145770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:50:03.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.021+0000 7fb374d47700 1 -- 172.21.2.105:0/3239867558 shutdown_connections 2021-11-12T05:50:03.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.021+0000 7fb374d47700 1 -- 172.21.2.105:0/3239867558 wait complete. 2021-11-12T05:50:03.031 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2021-11-12T05:50:03.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.081+0000 7fbdcbdd6700 1 Processor -- start 2021-11-12T05:50:03.085 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.081+0000 7fbdcbdd6700 1 -- start start 2021-11-12T05:50:03.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.081+0000 7fbdcbdd6700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fbdc40626b0 0x7fbdc4062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:03.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.081+0000 7fbdcbdd6700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fbdc4130a80 0x7fbdc41474d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:03.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.081+0000 7fbdcbdd6700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdc40b0d50 con 0x7fbdc40af750 2021-11-12T05:50:03.086 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.081+0000 7fbdcbdd6700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdc40ad380 con 0x7fbdc40626b0 2021-11-12T05:50:03.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.081+0000 7fbdcbdd6700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdc40ae190 con 0x7fbdc4130a80 2021-11-12T05:50:03.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.081+0000 7fbdc9371700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fbdc40af750 0x7fbdc4130370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:35378/0 (socket says 172.21.2.105:35378) 2021-11-12T05:50:03.087 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.081+0000 7fbdc9371700 1 -- 172.21.2.105:0/2315776303 learned_addr learned my addr 172.21.2.105:0/2315776303 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:50:03.088 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.081+0000 7fbdc9b72700 1 --2- 172.21.2.105:0/2315776303 >> v2:172.21.2.105:3300/0 conn(0x7fbdc40626b0 0x7fbdc4062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:03.091 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.081+0000 7fbdc9b72700 1 -- 172.21.2.105:0/2315776303 >> v2:172.21.2.115:3300/0 conn(0x7fbdc4130a80 msgr2=0x7fbdc41474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:50:03.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.081+0000 7fbdc9b72700 1 --2- 172.21.2.105:0/2315776303 >> v2:172.21.2.115:3300/0 conn(0x7fbdc4130a80 0x7fbdc41474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:03.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.081+0000 7fbdc9b72700 1 -- 172.21.2.105:0/2315776303 >> v1:172.21.2.105:6789/0 conn(0x7fbdc40af750 legacy=0x7fbdc4130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:03.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.081+0000 7fbdc9b72700 1 -- 172.21.2.105:0/2315776303 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc41479c0 con 0x7fbdc40626b0 2021-11-12T05:50:03.092 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.081+0000 7fbdc9b72700 1 --2- 172.21.2.105:0/2315776303 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbdc40626b0 0x7fbdc4062a90 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 rx=0x7fbdb8002f70 tx=0x7fbdb8006df0).ready entity=mon.0 client_cookie=616bc0054c69bc9e server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:03.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.081+0000 7fbdc8b70700 1 -- 172.21.2.105:0/2315776303 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdb800d5c0 con 0x7fbdc40626b0 2021-11-12T05:50:03.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.081+0000 7fbdc8b70700 1 -- 172.21.2.105:0/2315776303 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb8000e90 con 0x7fbdc40626b0 2021-11-12T05:50:03.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.081+0000 7fbdc8b70700 1 -- 172.21.2.105:0/2315776303 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdb800d950 con 0x7fbdc40626b0 2021-11-12T05:50:03.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.081+0000 7fbdcbdd6700 1 -- 172.21.2.105:0/2315776303 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbdc40626b0 msgr2=0x7fbdc4062a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:03.093 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.081+0000 7fbdcbdd6700 1 --2- 172.21.2.105:0/2315776303 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbdc40626b0 0x7fbdc4062a90 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 rx=0x7fbdb8002f70 tx=0x7fbdb8006df0).stop 2021-11-12T05:50:03.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.081+0000 7fbdcbdd6700 1 -- 172.21.2.105:0/2315776303 shutdown_connections 2021-11-12T05:50:03.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.081+0000 7fbdcbdd6700 1 --2- 172.21.2.105:0/2315776303 >> v2:172.21.2.115:3300/0 conn(0x7fbdc4130a80 0x7fbdc41474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:03.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.081+0000 7fbdcbdd6700 1 --2- 172.21.2.105:0/2315776303 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbdc40626b0 0x7fbdc4062a90 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:03.094 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.081+0000 7fbdcbdd6700 1 -- 172.21.2.105:0/2315776303 >> 172.21.2.105:0/2315776303 conn(0x7fbdc40b5320 msgr2=0x7fbdc40b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:50:03.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.081+0000 7fbdcbdd6700 1 -- 172.21.2.105:0/2315776303 shutdown_connections 2021-11-12T05:50:03.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.081+0000 7fbdcbdd6700 1 -- 172.21.2.105:0/2315776303 wait complete. 2021-11-12T05:50:03.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.081+0000 7fbdcbdd6700 1 Processor -- start 2021-11-12T05:50:03.095 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.081+0000 7fbdcbdd6700 1 -- start start 2021-11-12T05:50:03.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.085+0000 7fbdcbdd6700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbdc40626b0 0x7fbdc412f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:03.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.085+0000 7fbdcbdd6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbdc40af750 0x7fbdc414ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:03.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.085+0000 7fbdcbdd6700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbdc4130a80 0x7fbdc4157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:03.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.085+0000 7fbdcbdd6700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc41493b0 con 0x7fbdc40af750 2021-11-12T05:50:03.096 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.085+0000 7fbdcbdd6700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc412e550 con 0x7fbdc4130a80 2021-11-12T05:50:03.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.085+0000 7fbdcbdd6700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc41569e0 con 0x7fbdc40626b0 2021-11-12T05:50:03.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.085+0000 7fbdc9371700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbdc40af750 0x7fbdc414ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:03.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.085+0000 7fbdc9371700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbdc40af750 0x7fbdc414ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53224/0 (socket says 172.21.2.105:53224) 2021-11-12T05:50:03.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.085+0000 7fbdc9371700 1 -- 172.21.2.105:0/748058869 learned_addr learned my addr 172.21.2.105:0/748058869 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:50:03.097 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.085+0000 7fbdc9371700 1 -- 172.21.2.105:0/748058869 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbdc40626b0 msgr2=0x7fbdc412f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:03.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.085+0000 7fbdc9371700 1 --2- 172.21.2.105:0/748058869 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbdc40626b0 0x7fbdc412f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:03.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.085+0000 7fbdc9371700 1 -- 172.21.2.105:0/748058869 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbdc4130a80 msgr2=0x7fbdc4157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:03.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.085+0000 7fbdc9371700 1 --2- 172.21.2.105:0/748058869 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbdc4130a80 0x7fbdc4157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:03.098 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.085+0000 7fbdc9371700 1 -- 172.21.2.105:0/748058869 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb800b180 con 0x7fbdc40af750 2021-11-12T05:50:03.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.085+0000 7fbdc9371700 1 --2- 172.21.2.105:0/748058869 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbdc40af750 0x7fbdc414ac40 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 rx=0x7fbdc40b0690 tx=0x7fbdc0007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:03.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.085+0000 7fbdb6ffd700 1 -- 172.21.2.105:0/748058869 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdc000ce30 con 0x7fbdc40af750 2021-11-12T05:50:03.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.085+0000 7fbdb6ffd700 1 -- 172.21.2.105:0/748058869 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc00072e0 con 0x7fbdc40af750 2021-11-12T05:50:03.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.085+0000 7fbdb6ffd700 1 -- 172.21.2.105:0/748058869 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdc0005800 con 0x7fbdc40af750 2021-11-12T05:50:03.099 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.085+0000 7fbdcbdd6700 1 -- 172.21.2.105:0/748058869 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdc4156c80 con 0x7fbdc40af750 2021-11-12T05:50:03.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.085+0000 7fbdcbdd6700 1 -- 172.21.2.105:0/748058869 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdc412e020 con 0x7fbdc40af750 2021-11-12T05:50:03.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.085+0000 7fbdcbdd6700 1 -- 172.21.2.105:0/748058869 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdc412e390 con 0x7fbdc40af750 2021-11-12T05:50:03.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.085+0000 7fbdb6ffd700 1 -- 172.21.2.105:0/748058869 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fbdc0010070 con 0x7fbdc40af750 2021-11-12T05:50:03.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.085+0000 7fbdb6ffd700 1 --2- 172.21.2.105:0/748058869 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbda4053610 0x7fbda4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:03.100 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.085+0000 7fbdb6ffd700 1 -- 172.21.2.105:0/748058869 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fbdc006b1b0 con 0x7fbdc40af750 2021-11-12T05:50:03.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.085+0000 7fbdc9b72700 1 --2- 172.21.2.105:0/748058869 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbda4053610 0x7fbda4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:03.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.085+0000 7fbdc9b72700 1 --2- 172.21.2.105:0/748058869 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbda4053610 0x7fbda4055ad0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7fbdb8002f70 tx=0x7fbdb8014000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:03.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.089+0000 7fbdb6ffd700 1 -- 172.21.2.105:0/748058869 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbdc00420b0 con 0x7fbdc40af750 2021-11-12T05:50:03.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.173+0000 7fbdcbdd6700 1 -- 172.21.2.105:0/748058869 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbdc4156e10 con 0x7fbdc40af750 2021-11-12T05:50:03.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.173+0000 7fbdb6ffd700 1 -- 172.21.2.105:0/748058869 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v156) v1 ==== 104+0+10 (secure 0 0 0) 0x7fbdc0018020 con 0x7fbdc40af750 2021-11-12T05:50:03.177 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:50:03.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.173+0000 7fbdcbdd6700 1 -- 172.21.2.105:0/748058869 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbda4053610 msgr2=0x7fbda4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:03.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.173+0000 7fbdcbdd6700 1 --2- 172.21.2.105:0/748058869 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbda4053610 0x7fbda4055ad0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7fbdb8002f70 tx=0x7fbdb8014000).stop 2021-11-12T05:50:03.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.173+0000 7fbdcbdd6700 1 -- 172.21.2.105:0/748058869 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbdc40af750 msgr2=0x7fbdc414ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:03.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.173+0000 7fbdcbdd6700 1 --2- 172.21.2.105:0/748058869 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbdc40af750 0x7fbdc414ac40 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 rx=0x7fbdc40b0690 tx=0x7fbdc0007c10).stop 2021-11-12T05:50:03.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.173+0000 7fbdcbdd6700 1 -- 172.21.2.105:0/748058869 shutdown_connections 2021-11-12T05:50:03.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.173+0000 7fbdcbdd6700 1 --2- 172.21.2.105:0/748058869 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fbda4053610 0x7fbda4055ad0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:03.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.173+0000 7fbdcbdd6700 1 --2- 172.21.2.105:0/748058869 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fbdc4130a80 0x7fbdc4157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:03.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.173+0000 7fbdcbdd6700 1 --2- 172.21.2.105:0/748058869 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fbdc40af750 0x7fbdc414ac40 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:03.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.173+0000 7fbdcbdd6700 1 --2- 172.21.2.105:0/748058869 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fbdc40626b0 0x7fbdc412f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:03.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.173+0000 7fbdcbdd6700 1 -- 172.21.2.105:0/748058869 >> 172.21.2.105:0/748058869 conn(0x7fbdc40b5320 msgr2=0x7fbdc40b45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:50:03.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.173+0000 7fbdcbdd6700 1 -- 172.21.2.105:0/748058869 shutdown_connections 2021-11-12T05:50:03.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.173+0000 7fbdcbdd6700 1 -- 172.21.2.105:0/748058869 wait complete. 2021-11-12T05:50:03.183 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2021-11-12T05:50:03.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe43140c700 1 Processor -- start 2021-11-12T05:50:03.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe43140c700 1 -- start start 2021-11-12T05:50:03.236 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe43140c700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fe42c0b2e20 0x7fe42c0b1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:03.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe43140c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe42c13ea50 0x7fe42c13ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:03.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe43140c700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe42c0ad400 con 0x7fe42c05f6b0 2021-11-12T05:50:03.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe43140c700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe42c0b3200 con 0x7fe42c0b2e20 2021-11-12T05:50:03.237 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe43140c700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c0ad660 con 0x7fe42c13ea50 2021-11-12T05:50:03.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe42b7fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fe42c05f6b0 0x7fe42c05fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:35392/0 (socket says 172.21.2.105:35392) 2021-11-12T05:50:03.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe42b7fe700 1 -- 172.21.2.105:0/3677702117 learned_addr learned my addr 172.21.2.105:0/3677702117 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:50:03.243 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe429ffb700 1 -- 172.21.2.105:0/3677702117 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3392266503 0 0) 0x7fe42c0ad400 con 0x7fe42c05f6b0 2021-11-12T05:50:03.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe429ffb700 1 -- 172.21.2.105:0/3677702117 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe40c003260 con 0x7fe42c05f6b0 2021-11-12T05:50:03.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe42affd700 1 --2- 172.21.2.105:0/3677702117 >> v2:172.21.2.115:3300/0 conn(0x7fe42c0b2e20 0x7fe42c0b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:03.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe429ffb700 1 -- 172.21.2.105:0/3677702117 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1311968895 0 0) 0x7fe40c003260 con 0x7fe42c05f6b0 2021-11-12T05:50:03.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe429ffb700 1 -- 172.21.2.105:0/3677702117 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe42c13ea50 msgr2=0x7fe42c13ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:50:03.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe42a7fc700 1 --2- 172.21.2.105:0/3677702117 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe42c13ea50 0x7fe42c13ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:03.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe429ffb700 1 --2- 172.21.2.105:0/3677702117 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe42c13ea50 0x7fe42c13ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:03.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe429ffb700 1 -- 172.21.2.105:0/3677702117 >> v2:172.21.2.115:3300/0 conn(0x7fe42c0b2e20 msgr2=0x7fe42c0b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:50:03.245 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe429ffb700 1 --2- 172.21.2.105:0/3677702117 >> v2:172.21.2.115:3300/0 conn(0x7fe42c0b2e20 0x7fe42c0b1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:03.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe429ffb700 1 -- 172.21.2.105:0/3677702117 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42c0ad900 con 0x7fe42c05f6b0 2021-11-12T05:50:03.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe429ffb700 1 -- 172.21.2.105:0/3677702117 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fe4240019e0 con 0x7fe42c05f6b0 2021-11-12T05:50:03.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe429ffb700 1 -- 172.21.2.105:0/3677702117 >> v1:172.21.2.105:6789/0 conn(0x7fe42c05f6b0 legacy=0x7fe42c05fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:03.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe429ffb700 1 --2- 172.21.2.105:0/3677702117 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe40c0037d0 0x7fe40c003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:03.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe429ffb700 1 --2- 172.21.2.105:0/3677702117 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe40c004500 0x7fe40c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:03.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe429ffb700 1 --2- 172.21.2.105:0/3677702117 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe40c005070 0x7fe40c00c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:03.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe429ffb700 1 -- 172.21.2.105:0/3677702117 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c0b3200 con 0x7fe40c005070 2021-11-12T05:50:03.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe429ffb700 1 -- 172.21.2.105:0/3677702117 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c0ad660 con 0x7fe40c004500 2021-11-12T05:50:03.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe429ffb700 1 -- 172.21.2.105:0/3677702117 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe40c005800 con 0x7fe40c0037d0 2021-11-12T05:50:03.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe42a7fc700 1 --2- 172.21.2.105:0/3677702117 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe42c13ea50 0x7fe42c13ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:50:03.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe42affd700 1 --2- 172.21.2.105:0/3677702117 >> v2:172.21.2.115:3300/0 conn(0x7fe42c0b2e20 0x7fe42c0b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:50:03.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe42b7fe700 1 --2- 172.21.2.105:0/3677702117 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe40c005070 0x7fe40c00c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:03.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe42b7fe700 1 -- 172.21.2.105:0/3677702117 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe40c0037d0 msgr2=0x7fe40c003bf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:50:03.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe42b7fe700 1 --2- 172.21.2.105:0/3677702117 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe40c0037d0 0x7fe40c003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:03.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe42b7fe700 1 -- 172.21.2.105:0/3677702117 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe40c004500 msgr2=0x7fe40c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:50:03.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe42b7fe700 1 --2- 172.21.2.105:0/3677702117 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe40c004500 0x7fe40c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:03.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe42b7fe700 1 -- 172.21.2.105:0/3677702117 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe40c003260 con 0x7fe40c005070 2021-11-12T05:50:03.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe42b7fe700 1 --2- 172.21.2.105:0/3677702117 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe40c005070 0x7fe40c00c860 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 rx=0x7fe4240016f0 tx=0x7fe424002100).ready entity=mon.0 client_cookie=ca6359e957bdda16 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:03.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe429ffb700 1 -- 172.21.2.105:0/3677702117 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe42400cbb0 con 0x7fe40c005070 2021-11-12T05:50:03.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe429ffb700 1 -- 172.21.2.105:0/3677702117 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42400cd10 con 0x7fe40c005070 2021-11-12T05:50:03.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe429ffb700 1 -- 172.21.2.105:0/3677702117 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe424005b80 con 0x7fe40c005070 2021-11-12T05:50:03.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe43140c700 1 -- 172.21.2.105:0/3677702117 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe40c005070 msgr2=0x7fe40c00c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:03.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe43140c700 1 --2- 172.21.2.105:0/3677702117 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe40c005070 0x7fe40c00c860 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 rx=0x7fe4240016f0 tx=0x7fe424002100).stop 2021-11-12T05:50:03.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe42b7fe700 1 -- 172.21.2.105:0/3677702117 reap_dead start 2021-11-12T05:50:03.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe43140c700 1 -- 172.21.2.105:0/3677702117 shutdown_connections 2021-11-12T05:50:03.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe43140c700 1 -- 172.21.2.105:0/3677702117 >> 172.21.2.105:0/3677702117 conn(0x7fe42c062f60 msgr2=0x7fe42c063370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:50:03.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe43140c700 1 -- 172.21.2.105:0/3677702117 shutdown_connections 2021-11-12T05:50:03.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.233+0000 7fe43140c700 1 -- 172.21.2.105:0/3677702117 wait complete. 2021-11-12T05:50:03.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.237+0000 7fe43140c700 1 Processor -- start 2021-11-12T05:50:03.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.237+0000 7fe43140c700 1 -- start start 2021-11-12T05:50:03.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.237+0000 7fe43140c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe40c005070 0x7fe42c143690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:03.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.237+0000 7fe43140c700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe42c13e170 0x7fe42c0ab860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:03.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.237+0000 7fe43140c700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe42c13b1c0 0x7fe42c13cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:03.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.237+0000 7fe43140c700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c142f50 con 0x7fe40c005070 2021-11-12T05:50:03.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.237+0000 7fe43140c700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c1431f0 con 0x7fe42c13e170 2021-11-12T05:50:03.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.237+0000 7fe43140c700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c13b640 con 0x7fe42c13b1c0 2021-11-12T05:50:03.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.237+0000 7fe42affd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe40c005070 0x7fe42c143690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:03.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.237+0000 7fe42affd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe40c005070 0x7fe42c143690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53240/0 (socket says 172.21.2.105:53240) 2021-11-12T05:50:03.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.237+0000 7fe42affd700 1 -- 172.21.2.105:0/3691655301 learned_addr learned my addr 172.21.2.105:0/3691655301 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:50:03.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.237+0000 7fe42affd700 1 -- 172.21.2.105:0/3691655301 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe42c13b1c0 msgr2=0x7fe42c13cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:03.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.237+0000 7fe42affd700 1 --2- 172.21.2.105:0/3691655301 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe42c13b1c0 0x7fe42c13cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:03.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.237+0000 7fe42a7fc700 1 --2- 172.21.2.105:0/3691655301 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe42c13e170 0x7fe42c0ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:03.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.237+0000 7fe42affd700 1 -- 172.21.2.105:0/3691655301 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe42c13e170 msgr2=0x7fe42c0ab860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:03.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.237+0000 7fe42affd700 1 --2- 172.21.2.105:0/3691655301 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe42c13e170 0x7fe42c0ab860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:03.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.237+0000 7fe42affd700 1 -- 172.21.2.105:0/3691655301 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42c13d120 con 0x7fe40c005070 2021-11-12T05:50:03.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.237+0000 7fe42affd700 1 --2- 172.21.2.105:0/3691655301 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe40c005070 0x7fe42c143690 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 rx=0x7fe414007000 tx=0x7fe414008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:03.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.237+0000 7fe423fff700 1 -- 172.21.2.105:0/3691655301 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe41400f4e0 con 0x7fe40c005070 2021-11-12T05:50:03.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.237+0000 7fe423fff700 1 -- 172.21.2.105:0/3691655301 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41400c030 con 0x7fe40c005070 2021-11-12T05:50:03.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.237+0000 7fe43140c700 1 -- 172.21.2.105:0/3691655301 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe42c13d2b0 con 0x7fe40c005070 2021-11-12T05:50:03.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.237+0000 7fe423fff700 1 -- 172.21.2.105:0/3691655301 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe41400f830 con 0x7fe40c005070 2021-11-12T05:50:03.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.237+0000 7fe43140c700 1 -- 172.21.2.105:0/3691655301 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe42c136f80 con 0x7fe40c005070 2021-11-12T05:50:03.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.237+0000 7fe43140c700 1 -- 172.21.2.105:0/3691655301 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe42c142db0 con 0x7fe40c005070 2021-11-12T05:50:03.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.237+0000 7fe423fff700 1 -- 172.21.2.105:0/3691655301 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe41400f990 con 0x7fe40c005070 2021-11-12T05:50:03.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.237+0000 7fe423fff700 1 --2- 172.21.2.105:0/3691655301 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe410053520 0x7fe4100559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:03.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.237+0000 7fe423fff700 1 -- 172.21.2.105:0/3691655301 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6416+0+0 (secure 0 0 0) 0x7fe41406b540 con 0x7fe40c005070 2021-11-12T05:50:03.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.237+0000 7fe42a7fc700 1 --2- 172.21.2.105:0/3691655301 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe410053520 0x7fe4100559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:03.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.237+0000 7fe42a7fc700 1 --2- 172.21.2.105:0/3691655301 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe410053520 0x7fe4100559e0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7fe41c008000 tx=0x7fe41c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:03.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.241+0000 7fe423fff700 1 -- 172.21.2.105:0/3691655301 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe42c142db0 con 0x7fe40c005070 2021-11-12T05:50:03.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.321+0000 7fe43140c700 1 -- 172.21.2.105:0/3691655301 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe42c142db0 con 0x7fe40c005070 2021-11-12T05:50:03.327 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.325+0000 7fe423fff700 1 -- 172.21.2.105:0/3691655301 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v156) v1 ==== 100+0+10 (secure 0 0 0) 0x7fe42c142db0 con 0x7fe40c005070 2021-11-12T05:50:03.328 INFO:teuthology.orchestra.run.gibba005.stdout:pg_num: 8 2021-11-12T05:50:03.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.325+0000 7fe43140c700 1 -- 172.21.2.105:0/3691655301 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe410053520 msgr2=0x7fe4100559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:03.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.325+0000 7fe43140c700 1 --2- 172.21.2.105:0/3691655301 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe410053520 0x7fe4100559e0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7fe41c008000 tx=0x7fe41c008040).stop 2021-11-12T05:50:03.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.325+0000 7fe43140c700 1 -- 172.21.2.105:0/3691655301 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe40c005070 msgr2=0x7fe42c143690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:03.329 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.325+0000 7fe43140c700 1 --2- 172.21.2.105:0/3691655301 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe40c005070 0x7fe42c143690 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 rx=0x7fe414007000 tx=0x7fe414008040).stop 2021-11-12T05:50:03.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.325+0000 7fe43140c700 1 -- 172.21.2.105:0/3691655301 shutdown_connections 2021-11-12T05:50:03.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.325+0000 7fe43140c700 1 --2- 172.21.2.105:0/3691655301 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe410053520 0x7fe4100559e0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:03.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.325+0000 7fe43140c700 1 --2- 172.21.2.105:0/3691655301 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe42c13b1c0 0x7fe42c13cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:03.330 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.325+0000 7fe43140c700 1 --2- 172.21.2.105:0/3691655301 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe42c13e170 0x7fe42c0ab860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:03.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.325+0000 7fe43140c700 1 --2- 172.21.2.105:0/3691655301 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe40c005070 0x7fe42c143690 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:03.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.325+0000 7fe43140c700 1 -- 172.21.2.105:0/3691655301 >> 172.21.2.105:0/3691655301 conn(0x7fe42c062f60 msgr2=0x7fe42c05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:50:03.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.325+0000 7fe43140c700 1 -- 172.21.2.105:0/3691655301 shutdown_connections 2021-11-12T05:50:03.331 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.325+0000 7fe43140c700 1 -- 172.21.2.105:0/3691655301 wait complete. 2021-11-12T05:50:03.335 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-11-12T05:50:03.336 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:50:03.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa10fb9700 1 Processor -- start 2021-11-12T05:50:03.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa10fb9700 1 -- start start 2021-11-12T05:50:03.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa10fb9700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7ffa0c0ad080 0x7ffa0c0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:03.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa10fb9700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa0c0ac7b0 con 0x7ffa0c0ac280 2021-11-12T05:50:03.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa10fb9700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa0c0ac9e0 con 0x7ffa0c14b2f0 2021-11-12T05:50:03.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa10fb9700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa0c1488a0 con 0x7ffa0c0ad080 2021-11-12T05:50:03.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa09d9b700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7ffa0c0ac280 0x7ffa0c14abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:35414/0 (socket says 172.21.2.105:35414) 2021-11-12T05:50:03.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa09d9b700 1 -- 172.21.2.105:0/4257286747 learned_addr learned my addr 172.21.2.105:0/4257286747 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:50:03.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa0959a700 1 -- 172.21.2.105:0/4257286747 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3179706409 0 0) 0x7ffa0c0ac7b0 con 0x7ffa0c0ac280 2021-11-12T05:50:03.396 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa0959a700 1 -- 172.21.2.105:0/4257286747 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9f0003260 con 0x7ffa0c0ac280 2021-11-12T05:50:03.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa0a59c700 1 --2- 172.21.2.105:0/4257286747 >> v2:172.21.2.115:3300/0 conn(0x7ffa0c0ad080 0x7ffa0c0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:03.397 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa0959a700 1 -- 172.21.2.105:0/4257286747 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3869648109 0 0) 0x7ff9f0003260 con 0x7ffa0c0ac280 2021-11-12T05:50:03.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa0959a700 1 -- 172.21.2.105:0/4257286747 >> v2:172.21.2.115:3300/0 conn(0x7ffa0c0ad080 msgr2=0x7ffa0c0af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:50:03.398 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa0959a700 1 --2- 172.21.2.105:0/4257286747 >> v2:172.21.2.115:3300/0 conn(0x7ffa0c0ad080 0x7ffa0c0af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:03.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa0959a700 1 -- 172.21.2.105:0/4257286747 >> v1:172.21.2.115:6789/0 conn(0x7ffa0c14b2f0 legacy=0x7ffa0c147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:50:03.399 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa0959a700 1 -- 172.21.2.105:0/4257286747 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0c0b0b30 con 0x7ffa0c0ac280 2021-11-12T05:50:03.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa0959a700 1 -- 172.21.2.105:0/4257286747 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7ff9fc001660 con 0x7ffa0c0ac280 2021-11-12T05:50:03.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa0959a700 1 -- 172.21.2.105:0/4257286747 >> v1:172.21.2.105:6789/0 conn(0x7ffa0c0ac280 legacy=0x7ffa0c14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:03.400 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa0959a700 1 --2- 172.21.2.105:0/4257286747 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff9f0003820 0x7ff9f0003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:03.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa0959a700 1 --2- 172.21.2.105:0/4257286747 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff9f0004500 0x7ff9f0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:03.401 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa0959a700 1 --2- 172.21.2.105:0/4257286747 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff9f0005050 0x7ff9f000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:03.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa0959a700 1 -- 172.21.2.105:0/4257286747 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c1488a0 con 0x7ff9f0003820 2021-11-12T05:50:03.402 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa0959a700 1 -- 172.21.2.105:0/4257286747 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f000bf40 con 0x7ff9f0005050 2021-11-12T05:50:03.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa0959a700 1 -- 172.21.2.105:0/4257286747 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f000c100 con 0x7ff9f0004500 2021-11-12T05:50:03.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa0a59c700 1 --2- 172.21.2.105:0/4257286747 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff9f0003820 0x7ff9f0003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:03.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa0a59c700 1 -- 172.21.2.105:0/4257286747 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff9f0004500 msgr2=0x7ff9f0004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:50:03.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa0a59c700 1 --2- 172.21.2.105:0/4257286747 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ff9f0004500 0x7ff9f0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:03.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa0a59c700 1 -- 172.21.2.105:0/4257286747 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff9f0005050 msgr2=0x7ff9f000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:50:03.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa0a59c700 1 --2- 172.21.2.105:0/4257286747 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ff9f0005050 0x7ff9f000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:03.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa0a59c700 1 -- 172.21.2.105:0/4257286747 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f0003260 con 0x7ff9f0003820 2021-11-12T05:50:03.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa0ad9d700 1 -- 172.21.2.105:0/4257286747 reap_dead start 2021-11-12T05:50:03.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa0a59c700 1 --2- 172.21.2.105:0/4257286747 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff9f0003820 0x7ff9f0003c20 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 rx=0x7ffa00007000 tx=0x7ffa00008040).ready entity=mon.0 client_cookie=ba2e3a8af954d958 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:03.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa0959a700 1 -- 172.21.2.105:0/4257286747 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa00012470 con 0x7ff9f0003820 2021-11-12T05:50:03.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa0959a700 1 -- 172.21.2.105:0/4257286747 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0000c030 con 0x7ff9f0003820 2021-11-12T05:50:03.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa0959a700 1 -- 172.21.2.105:0/4257286747 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa000127c0 con 0x7ff9f0003820 2021-11-12T05:50:03.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa10fb9700 1 -- 172.21.2.105:0/4257286747 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff9f0003820 msgr2=0x7ff9f0003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:03.408 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa10fb9700 1 --2- 172.21.2.105:0/4257286747 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff9f0003820 0x7ff9f0003c20 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 rx=0x7ffa00007000 tx=0x7ffa00008040).stop 2021-11-12T05:50:03.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa10fb9700 1 -- 172.21.2.105:0/4257286747 shutdown_connections 2021-11-12T05:50:03.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa10fb9700 1 --2- 172.21.2.105:0/4257286747 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff9f0003820 0x7ff9f0003c20 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:03.409 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa10fb9700 1 -- 172.21.2.105:0/4257286747 >> 172.21.2.105:0/4257286747 conn(0x7ffa0c0b5370 msgr2=0x7ffa0c0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:50:03.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa10fb9700 1 -- 172.21.2.105:0/4257286747 shutdown_connections 2021-11-12T05:50:03.410 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa10fb9700 1 -- 172.21.2.105:0/4257286747 wait complete. 2021-11-12T05:50:03.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa10fb9700 1 Processor -- start 2021-11-12T05:50:03.411 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.385+0000 7ffa10fb9700 1 -- start start 2021-11-12T05:50:03.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.389+0000 7ffa10fb9700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff9f0003820 0x7ffa0c0a7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:03.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.389+0000 7ffa10fb9700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ffa0c149db0 0x7ffa0c0ab400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:03.412 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.389+0000 7ffa10fb9700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ffa0c0ab8f0 0x7ffa0c156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:03.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.389+0000 7ffa10fb9700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c14a210 con 0x7ff9f0003820 2021-11-12T05:50:03.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.389+0000 7ffa10fb9700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c147450 con 0x7ffa0c149db0 2021-11-12T05:50:03.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.389+0000 7ffa10fb9700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0c15a070 con 0x7ffa0c0ab8f0 2021-11-12T05:50:03.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.389+0000 7ffa0a59c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff9f0003820 0x7ffa0c0a7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:03.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.389+0000 7ffa0a59c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff9f0003820 0x7ffa0c0a7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53262/0 (socket says 172.21.2.105:53262) 2021-11-12T05:50:03.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.389+0000 7ffa0a59c700 1 -- 172.21.2.105:0/3602240087 learned_addr learned my addr 172.21.2.105:0/3602240087 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:50:03.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.389+0000 7ffa0a59c700 1 -- 172.21.2.105:0/3602240087 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ffa0c0ab8f0 msgr2=0x7ffa0c156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:03.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.389+0000 7ffa0a59c700 1 --2- 172.21.2.105:0/3602240087 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ffa0c0ab8f0 0x7ffa0c156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:03.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.389+0000 7ffa0a59c700 1 -- 172.21.2.105:0/3602240087 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ffa0c149db0 msgr2=0x7ffa0c0ab400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:03.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.389+0000 7ffa0a59c700 1 --2- 172.21.2.105:0/3602240087 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ffa0c149db0 0x7ffa0c0ab400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:03.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.389+0000 7ffa0a59c700 1 -- 172.21.2.105:0/3602240087 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0c0abd70 con 0x7ff9f0003820 2021-11-12T05:50:03.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.389+0000 7ffa0a59c700 1 --2- 172.21.2.105:0/3602240087 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff9f0003820 0x7ffa0c0a7bc0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 rx=0x7ffa00007000 tx=0x7ffa00008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:03.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.389+0000 7ff9fb7fe700 1 -- 172.21.2.105:0/3602240087 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa00021070 con 0x7ff9f0003820 2021-11-12T05:50:03.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.389+0000 7ff9fb7fe700 1 -- 172.21.2.105:0/3602240087 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa00000e90 con 0x7ff9f0003820 2021-11-12T05:50:03.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.389+0000 7ffa10fb9700 1 -- 172.21.2.105:0/3602240087 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa0c0b5030 con 0x7ff9f0003820 2021-11-12T05:50:03.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.389+0000 7ffa10fb9700 1 -- 172.21.2.105:0/3602240087 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa0c147150 con 0x7ff9f0003820 2021-11-12T05:50:03.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.389+0000 7ff9fb7fe700 1 -- 172.21.2.105:0/3602240087 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa0001dae0 con 0x7ff9f0003820 2021-11-12T05:50:03.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.389+0000 7ffa10fb9700 1 -- 172.21.2.105:0/3602240087 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9e4003410 con 0x7ff9f0003820 2021-11-12T05:50:03.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.389+0000 7ff9fb7fe700 1 -- 172.21.2.105:0/3602240087 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7ffa0001dc40 con 0x7ff9f0003820 2021-11-12T05:50:03.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.389+0000 7ff9fb7fe700 1 --2- 172.21.2.105:0/3602240087 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff9e8053720 0x7ff9e8055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:03.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.389+0000 7ff9fb7fe700 1 -- 172.21.2.105:0/3602240087 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6416+0+0 (secure 0 0 0) 0x7ffa0006cd40 con 0x7ff9f0003820 2021-11-12T05:50:03.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.389+0000 7ffa09d9b700 1 --2- 172.21.2.105:0/3602240087 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff9e8053720 0x7ff9e8055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:03.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.389+0000 7ffa09d9b700 1 --2- 172.21.2.105:0/3602240087 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff9e8053720 0x7ff9e8055be0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7ffa0c0b0eb0 tx=0x7ffa0c0ada20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:03.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.393+0000 7ff9fb7fe700 1 -- 172.21.2.105:0/3602240087 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ffa00043cf0 con 0x7ff9f0003820 2021-11-12T05:50:03.505 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.501+0000 7ffa10fb9700 1 -- 172.21.2.105:0/3602240087 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9e4003c40 con 0x7ff9f0003820 2021-11-12T05:50:03.505 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.501+0000 7ff9fb7fe700 1 -- 172.21.2.105:0/3602240087 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+2139 (secure 0 0 0) 0x7ffa00047310 con 0x7ff9f0003820 2021-11-12T05:50:03.506 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:50:03.506 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":74,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5596,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/460551031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":460551031},{"type":"v1","addr":"172.21.2.115:6833","nonce":460551031}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":73}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:49:57.435843+0000","modified":"2021-11-12T05:49:58.439104+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8829},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8829":{"gid":8829,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/4094714006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":4094714006},{"type":"v1","addr":"172.21.2.105:6835","nonce":4094714006}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-11-12T05:50:03.507 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.501+0000 7ffa10fb9700 1 -- 172.21.2.105:0/3602240087 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff9e8053720 msgr2=0x7ff9e8055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:03.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.501+0000 7ffa10fb9700 1 --2- 172.21.2.105:0/3602240087 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff9e8053720 0x7ff9e8055be0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7ffa0c0b0eb0 tx=0x7ffa0c0ada20).stop 2021-11-12T05:50:03.508 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.501+0000 7ffa10fb9700 1 -- 172.21.2.105:0/3602240087 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff9f0003820 msgr2=0x7ffa0c0a7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:03.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.501+0000 7ffa10fb9700 1 --2- 172.21.2.105:0/3602240087 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff9f0003820 0x7ffa0c0a7bc0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 rx=0x7ffa00007000 tx=0x7ffa00008040).stop 2021-11-12T05:50:03.509 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.501+0000 7ffa10fb9700 1 -- 172.21.2.105:0/3602240087 shutdown_connections 2021-11-12T05:50:03.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.501+0000 7ffa10fb9700 1 --2- 172.21.2.105:0/3602240087 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7ff9e8053720 0x7ff9e8055be0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:03.510 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.501+0000 7ffa10fb9700 1 --2- 172.21.2.105:0/3602240087 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7ffa0c0ab8f0 0x7ffa0c156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:03.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.501+0000 7ffa10fb9700 1 --2- 172.21.2.105:0/3602240087 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7ffa0c149db0 0x7ffa0c0ab400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:03.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.501+0000 7ffa10fb9700 1 --2- 172.21.2.105:0/3602240087 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7ff9f0003820 0x7ffa0c0a7bc0 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:03.511 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.501+0000 7ffa10fb9700 1 -- 172.21.2.105:0/3602240087 >> 172.21.2.105:0/3602240087 conn(0x7ffa0c0b5370 msgr2=0x7ffa0c060560 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:50:03.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.501+0000 7ffa10fb9700 1 -- 172.21.2.105:0/3602240087 shutdown_connections 2021-11-12T05:50:03.512 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:03.501+0000 7ffa10fb9700 1 -- 172.21.2.105:0/3602240087 wait complete. 2021-11-12T05:50:03.513 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 74 2021-11-12T05:50:03.716 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 74, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-11-12T05:49:57.435843+0000', 'modified': '2021-11-12T05:49:58.439104+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8829}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8829': {'gid': 8829, 'name': 'a', 'rank': 0, 'incarnation': 73, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.2.105:6835/4094714006', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.105:6834', 'nonce': 4094714006}, {'type': 'v1', 'addr': '172.21.2.105:6835', 'nonce': 4094714006}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-11-12T05:50:03.717 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-11-12T05:50:03.717 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-11-12T05:50:03.781 INFO:teuthology.orchestra.run.gibba005.stdout:{"cluster_fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","whoami":0,"id":8829,"want_state":"up:active","state":"up:active","rank_uptime":6.3379284289999998,"mdsmap_epoch":74,"osdmap_epoch":156,"osdmap_epoch_barrier":155,"uptime":10.509598657} 2021-11-12T05:50:03.782 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", "id": 8829, "mdsmap_epoch": 74, "osdmap_epoch": 156, "osdmap_epoch_barrier": 155, "rank_uptime": 6.337928429, "state": "up:active", "uptime": 10.509598657, "want_state": "up:active", "whoami": 0 } 2021-11-12T05:50:03.783 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-11-12T05:50:03.784 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-11-12T05:50:03.784 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@gibba038.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-11-12T05:50:03.785 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:50:03.786 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:50:03.798 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-12T05:50:03.849 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:50:03.850 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:50:03.861 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:50:03.861 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:50:03.863 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:50:03.863 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-12T05:50:03.867 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-11-12T05:50:03.868 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:50:03.913 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-12T05:50:03.923 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:50:03.924 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:50:03.928 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:50:03.929 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:50:03.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:50:03.931 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-12T05:50:03.952 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:2021-11-12T05:50:03.952+0000 7f959ac56080 -1 init, newargv = 0x55898f6a2bf0 newargc=9 2021-11-12T05:50:03.952 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:ceph-fuse[14858]: starting ceph client 2021-11-12T05:50:03.964 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:ceph-fuse[14858]: starting fuse 2021-11-12T05:50:05.056 DEBUG:teuthology.orchestra.run.gibba038:> sudo modprobe fuse 2021-11-12T05:50:05.068 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-11-12T05:50:05.069 DEBUG:teuthology.orchestra.run.gibba038:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-11-12T05:50:05.118 INFO:teuthology.orchestra.run.gibba038.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-11-12T05:50:05.118 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-11-12T05:50:05.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:50:05.120 DEBUG:teuthology.orchestra.run.gibba038:> ls /sys/fs/fuse/connections 2021-11-12T05:50:05.125 INFO:teuthology.orchestra.run.gibba038.stdout:52 2021-11-12T05:50:05.126 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2021-11-12T05:50:05.126 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:50:05.127 DEBUG:teuthology.orchestra.run.gibba038:> sudo python3 -c ' 2021-11-12T05:50:05.127 DEBUG:teuthology.orchestra.run.gibba038:> import glob 2021-11-12T05:50:05.128 DEBUG:teuthology.orchestra.run.gibba038:> import re 2021-11-12T05:50:05.128 DEBUG:teuthology.orchestra.run.gibba038:> import os 2021-11-12T05:50:05.128 DEBUG:teuthology.orchestra.run.gibba038:> import subprocess 2021-11-12T05:50:05.129 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:50:05.129 DEBUG:teuthology.orchestra.run.gibba038:> def find_socket(client_name): 2021-11-12T05:50:05.130 DEBUG:teuthology.orchestra.run.gibba038:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-11-12T05:50:05.130 DEBUG:teuthology.orchestra.run.gibba038:> files = glob.glob(asok_path) 2021-11-12T05:50:05.130 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:50:05.131 DEBUG:teuthology.orchestra.run.gibba038:> # Given a non-glob path, it better be there 2021-11-12T05:50:05.131 DEBUG:teuthology.orchestra.run.gibba038:> if "*" not in asok_path: 2021-11-12T05:50:05.132 DEBUG:teuthology.orchestra.run.gibba038:> assert(len(files) == 1) 2021-11-12T05:50:05.132 DEBUG:teuthology.orchestra.run.gibba038:> return files[0] 2021-11-12T05:50:05.133 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:50:05.133 DEBUG:teuthology.orchestra.run.gibba038:> for f in files: 2021-11-12T05:50:05.133 DEBUG:teuthology.orchestra.run.gibba038:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-11-12T05:50:05.134 DEBUG:teuthology.orchestra.run.gibba038:> if os.path.exists("/proc/{0}".format(pid)): 2021-11-12T05:50:05.134 DEBUG:teuthology.orchestra.run.gibba038:> return f 2021-11-12T05:50:05.135 DEBUG:teuthology.orchestra.run.gibba038:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-11-12T05:50:05.135 DEBUG:teuthology.orchestra.run.gibba038:> 2021-11-12T05:50:05.135 DEBUG:teuthology.orchestra.run.gibba038:> print(find_socket("client.1")) 2021-11-12T05:50:05.136 DEBUG:teuthology.orchestra.run.gibba038:> ' 2021-11-12T05:50:05.201 INFO:teuthology.orchestra.run.gibba038.stdout:/var/run/ceph/ceph-client.1.14858.asok 2021-11-12T05:50:05.204 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14858.asok 2021-11-12T05:50:05.204 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:50:05.205 DEBUG:teuthology.orchestra.run.gibba038:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14858.asok status 2021-11-12T05:50:05.252 INFO:teuthology.orchestra.run.gibba038.stdout:{ 2021-11-12T05:50:05.253 INFO:teuthology.orchestra.run.gibba038.stdout: "metadata": { 2021-11-12T05:50:05.253 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_sha1": "a81ee2815de5acae59ead5b8c9137b6766fc8ea8", 2021-11-12T05:50:05.253 INFO:teuthology.orchestra.run.gibba038.stdout: "ceph_version": "ceph version 15.2.15-22-ga81ee281 (a81ee2815de5acae59ead5b8c9137b6766fc8ea8) octopus (stable)", 2021-11-12T05:50:05.253 INFO:teuthology.orchestra.run.gibba038.stdout: "entity_id": "1", 2021-11-12T05:50:05.254 INFO:teuthology.orchestra.run.gibba038.stdout: "hostname": "gibba038", 2021-11-12T05:50:05.254 INFO:teuthology.orchestra.run.gibba038.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-11-12T05:50:05.254 INFO:teuthology.orchestra.run.gibba038.stdout: "pid": "14858", 2021-11-12T05:50:05.254 INFO:teuthology.orchestra.run.gibba038.stdout: "root": "/" 2021-11-12T05:50:05.254 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:50:05.255 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_count": 0, 2021-11-12T05:50:05.255 INFO:teuthology.orchestra.run.gibba038.stdout: "dentry_pinned_count": 0, 2021-11-12T05:50:05.255 INFO:teuthology.orchestra.run.gibba038.stdout: "id": 5653, 2021-11-12T05:50:05.256 INFO:teuthology.orchestra.run.gibba038.stdout: "inst": { 2021-11-12T05:50:05.256 INFO:teuthology.orchestra.run.gibba038.stdout: "name": { 2021-11-12T05:50:05.256 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "client", 2021-11-12T05:50:05.256 INFO:teuthology.orchestra.run.gibba038.stdout: "num": 5653 2021-11-12T05:50:05.257 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:50:05.257 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-12T05:50:05.257 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-12T05:50:05.257 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-12T05:50:05.257 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 4129508479 2021-11-12T05:50:05.258 INFO:teuthology.orchestra.run.gibba038.stdout: } 2021-11-12T05:50:05.258 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:50:05.258 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": { 2021-11-12T05:50:05.258 INFO:teuthology.orchestra.run.gibba038.stdout: "type": "v1", 2021-11-12T05:50:05.259 INFO:teuthology.orchestra.run.gibba038.stdout: "addr": "172.21.2.138:0", 2021-11-12T05:50:05.259 INFO:teuthology.orchestra.run.gibba038.stdout: "nonce": 4129508479 2021-11-12T05:50:05.259 INFO:teuthology.orchestra.run.gibba038.stdout: }, 2021-11-12T05:50:05.259 INFO:teuthology.orchestra.run.gibba038.stdout: "inst_str": "client.5653 172.21.2.138:0/4129508479", 2021-11-12T05:50:05.260 INFO:teuthology.orchestra.run.gibba038.stdout: "addr_str": "172.21.2.138:0/4129508479", 2021-11-12T05:50:05.260 INFO:teuthology.orchestra.run.gibba038.stdout: "inode_count": 1, 2021-11-12T05:50:05.260 INFO:teuthology.orchestra.run.gibba038.stdout: "mds_epoch": 74, 2021-11-12T05:50:05.260 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch": 156, 2021-11-12T05:50:05.260 INFO:teuthology.orchestra.run.gibba038.stdout: "osd_epoch_barrier": 0, 2021-11-12T05:50:05.261 INFO:teuthology.orchestra.run.gibba038.stdout: "blacklisted": false, 2021-11-12T05:50:05.261 INFO:teuthology.orchestra.run.gibba038.stdout: "fs_name": "cephfs" 2021-11-12T05:50:05.261 INFO:teuthology.orchestra.run.gibba038.stdout:} 2021-11-12T05:50:05.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:50:05.263 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:50:05.263 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:50:05.269 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-12T05:50:05.269 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-12T05:50:05.269 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:50:05.270 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:50:05.320 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:50:05.320 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:50:05.321 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:50:05.326 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-12T05:50:05.327 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-12T05:50:05.327 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:50:05.328 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:50:05.328 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:50:05.334 INFO:teuthology.orchestra.run.gibba038.stdout:fuseblk 2021-11-12T05:50:05.335 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-11-12T05:50:05.336 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@gibba038.front.sepia.ceph.com... 2021-11-12T05:50:05.336 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-11-12T05:50:05.337 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:50:05.391 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.gibba038.stderr:ceph-fuse[14858]: fuse finished with error 0 and tester_r 0 2021-11-12T05:50:05.393 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:50:05.393 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:50:05.394 DEBUG:teuthology.orchestra.run.gibba038:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:50:05.398 INFO:teuthology.orchestra.run.gibba038.stdout:ext2/ext3 2021-11-12T05:50:05.398 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-11-12T05:50:05.399 INFO:teuthology.orchestra.run:waiting for 900 2021-11-12T05:50:11.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-11-12T05:50:11.500 DEBUG:teuthology.orchestra.run.gibba038:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-11-12T05:50:11.510 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-11-12T05:50:11.511 DEBUG:teuthology.orchestra.run.gibba016:> cd /home/ubuntu/cephtest/mnt.0 && sudo bash -c 'stat -f .' 2021-11-12T05:50:11.530 INFO:teuthology.orchestra.run.gibba016.stdout: File: "." 2021-11-12T05:50:11.530 INFO:teuthology.orchestra.run.gibba016.stdout: ID: 0 Namelen: 255 Type: fuseblk 2021-11-12T05:50:11.531 INFO:teuthology.orchestra.run.gibba016.stdout:Block size: 4194304 Fundamental block size: 4194304 2021-11-12T05:50:11.531 INFO:teuthology.orchestra.run.gibba016.stdout:Blocks: Total: 86526 Free: 86526 Available: 86526 2021-11-12T05:50:11.531 INFO:teuthology.orchestra.run.gibba016.stdout:Inodes: Total: 1 Free: 0 2021-11-12T05:50:11.532 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2021-11-12T05:50:11.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.585+0000 7f7ac8b2d700 1 Processor -- start 2021-11-12T05:50:11.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.585+0000 7f7ac8b2d700 1 -- start start 2021-11-12T05:50:11.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.585+0000 7f7ac8b2d700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f7ac40626b0 0x7f7ac4062a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:11.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.585+0000 7f7ac8b2d700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7ac40af750 0x7f7ac4130370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:11.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.585+0000 7f7ac8b2d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f7ac4130860 0x7f7ac414a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:11.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.585+0000 7f7ac8b2d700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac4130d10 con 0x7f7ac4130860 2021-11-12T05:50:11.590 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.585+0000 7f7ac8b2d700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac40b0d50 con 0x7f7ac40626b0 2021-11-12T05:50:11.590 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.585+0000 7f7ac8b2d700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac40ad380 con 0x7f7ac40af750 2021-11-12T05:50:11.590 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.585+0000 7f7ac2d9d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f7ac4130860 0x7f7ac414a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:11.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.585+0000 7f7ac2d9d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f7ac4130860 0x7f7ac414a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53272/0 (socket says 172.21.2.105:53272) 2021-11-12T05:50:11.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.585+0000 7f7ac2d9d700 1 -- 172.21.2.105:0/327578187 learned_addr learned my addr 172.21.2.105:0/327578187 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:50:11.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.585+0000 7f7ac2d9d700 1 -- 172.21.2.105:0/327578187 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7ac40af750 msgr2=0x7f7ac4130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:50:11.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.585+0000 7f7ac2d9d700 1 --2- 172.21.2.105:0/327578187 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7ac40af750 0x7f7ac4130370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:11.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.585+0000 7f7ac2d9d700 1 -- 172.21.2.105:0/327578187 >> v2:172.21.2.115:3300/0 conn(0x7f7ac40626b0 msgr2=0x7f7ac4062a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:50:11.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.585+0000 7f7ac2d9d700 1 --2- 172.21.2.105:0/327578187 >> v2:172.21.2.115:3300/0 conn(0x7f7ac40626b0 0x7f7ac4062a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:11.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.585+0000 7f7ac2d9d700 1 -- 172.21.2.105:0/327578187 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac40ae190 con 0x7f7ac4130860 2021-11-12T05:50:11.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.585+0000 7f7ac2d9d700 1 --2- 172.21.2.105:0/327578187 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7ac4130860 0x7f7ac414a950 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 rx=0x7f7ab4002f70 tx=0x7f7ab4006eb0).ready entity=mon.0 client_cookie=d91ef3851992e2a5 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:11.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.585+0000 7f7ac159a700 1 -- 172.21.2.105:0/327578187 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ab400d570 con 0x7f7ac4130860 2021-11-12T05:50:11.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.585+0000 7f7ac159a700 1 -- 172.21.2.105:0/327578187 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab4000e90 con 0x7f7ac4130860 2021-11-12T05:50:11.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.585+0000 7f7ac159a700 1 -- 172.21.2.105:0/327578187 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ab400d900 con 0x7f7ac4130860 2021-11-12T05:50:11.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.585+0000 7f7ac8b2d700 1 -- 172.21.2.105:0/327578187 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7ac4130860 msgr2=0x7f7ac414a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:11.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.585+0000 7f7ac8b2d700 1 --2- 172.21.2.105:0/327578187 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7ac4130860 0x7f7ac414a950 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 rx=0x7f7ab4002f70 tx=0x7f7ab4006eb0).stop 2021-11-12T05:50:11.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.585+0000 7f7ac8b2d700 1 -- 172.21.2.105:0/327578187 shutdown_connections 2021-11-12T05:50:11.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.585+0000 7f7ac8b2d700 1 --2- 172.21.2.105:0/327578187 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7ac4130860 0x7f7ac414a950 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:11.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.585+0000 7f7ac8b2d700 1 --2- 172.21.2.105:0/327578187 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7ac40af750 0x7f7ac4130370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:11.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.585+0000 7f7ac8b2d700 1 --2- 172.21.2.105:0/327578187 >> v2:172.21.2.115:3300/0 conn(0x7f7ac40626b0 0x7f7ac4062a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:11.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.585+0000 7f7ac8b2d700 1 -- 172.21.2.105:0/327578187 >> 172.21.2.105:0/327578187 conn(0x7f7ac40b5320 msgr2=0x7f7ac40b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:50:11.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.585+0000 7f7ac8b2d700 1 -- 172.21.2.105:0/327578187 shutdown_connections 2021-11-12T05:50:11.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.585+0000 7f7ac8b2d700 1 -- 172.21.2.105:0/327578187 wait complete. 2021-11-12T05:50:11.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.585+0000 7f7ac8b2d700 1 Processor -- start 2021-11-12T05:50:11.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.585+0000 7f7ac8b2d700 1 -- start start 2021-11-12T05:50:11.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.589+0000 7f7ac8b2d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7ac40626b0 0x7f7ac415a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:11.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.589+0000 7f7ac8b2d700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7ac40af750 0x7f7ac414b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:11.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.589+0000 7f7ac8b2d700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7ac4130860 0x7f7ac41499a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:11.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.589+0000 7f7ac8b2d700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac414dc20 con 0x7f7ac40626b0 2021-11-12T05:50:11.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.589+0000 7f7ac8b2d700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac415ae70 con 0x7f7ac40af750 2021-11-12T05:50:11.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.589+0000 7f7ac8b2d700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac4159fa0 con 0x7f7ac4130860 2021-11-12T05:50:11.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.589+0000 7f7ac259c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7ac40626b0 0x7f7ac415a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:11.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.589+0000 7f7ac259c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7ac40626b0 0x7f7ac415a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53276/0 (socket says 172.21.2.105:53276) 2021-11-12T05:50:11.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.589+0000 7f7ac259c700 1 -- 172.21.2.105:0/3815207700 learned_addr learned my addr 172.21.2.105:0/3815207700 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:50:11.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.589+0000 7f7ac2d9d700 1 --2- 172.21.2.105:0/3815207700 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7ac4130860 0x7f7ac41499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:11.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.589+0000 7f7ac259c700 1 -- 172.21.2.105:0/3815207700 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7ac4130860 msgr2=0x7f7ac41499a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:11.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.589+0000 7f7ac1d9b700 1 --2- 172.21.2.105:0/3815207700 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7ac40af750 0x7f7ac414b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:11.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.589+0000 7f7ac259c700 1 --2- 172.21.2.105:0/3815207700 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7ac4130860 0x7f7ac41499a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:11.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.589+0000 7f7ac259c700 1 -- 172.21.2.105:0/3815207700 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7ac40af750 msgr2=0x7f7ac414b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:11.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.589+0000 7f7ac259c700 1 --2- 172.21.2.105:0/3815207700 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7ac40af750 0x7f7ac414b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:11.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.589+0000 7f7ac259c700 1 -- 172.21.2.105:0/3815207700 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab400b1e0 con 0x7f7ac40626b0 2021-11-12T05:50:11.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.589+0000 7f7ac2d9d700 1 --2- 172.21.2.105:0/3815207700 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7ac4130860 0x7f7ac41499a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:50:11.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.589+0000 7f7ac1d9b700 1 --2- 172.21.2.105:0/3815207700 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7ac40af750 0x7f7ac414b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:50:11.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.589+0000 7f7ac259c700 1 --2- 172.21.2.105:0/3815207700 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7ac40626b0 0x7f7ac415a980 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 rx=0x7f7ab8002f70 tx=0x7f7ab8006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:11.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.589+0000 7f7ab37fe700 1 -- 172.21.2.105:0/3815207700 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ab8013460 con 0x7f7ac40626b0 2021-11-12T05:50:11.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.589+0000 7f7ab37fe700 1 -- 172.21.2.105:0/3815207700 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab80135c0 con 0x7f7ac40626b0 2021-11-12T05:50:11.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.589+0000 7f7ac8b2d700 1 -- 172.21.2.105:0/3815207700 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac415a240 con 0x7f7ac40626b0 2021-11-12T05:50:11.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.589+0000 7f7ab37fe700 1 -- 172.21.2.105:0/3815207700 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ab8013920 con 0x7f7ac40626b0 2021-11-12T05:50:11.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.589+0000 7f7ac8b2d700 1 -- 172.21.2.105:0/3815207700 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac414bcf0 con 0x7f7ac40626b0 2021-11-12T05:50:11.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.589+0000 7f7ac8b2d700 1 -- 172.21.2.105:0/3815207700 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ac4063de0 con 0x7f7ac40626b0 2021-11-12T05:50:11.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.589+0000 7f7ab37fe700 1 -- 172.21.2.105:0/3815207700 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7ab801a060 con 0x7f7ac40626b0 2021-11-12T05:50:11.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.589+0000 7f7ab37fe700 1 --2- 172.21.2.105:0/3815207700 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7aa00536f0 0x7f7aa0055bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:11.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.589+0000 7f7ab37fe700 1 -- 172.21.2.105:0/3815207700 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f7ab806b610 con 0x7f7ac40626b0 2021-11-12T05:50:11.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.589+0000 7f7ac1d9b700 1 --2- 172.21.2.105:0/3815207700 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7aa00536f0 0x7f7aa0055bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:11.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.589+0000 7f7ac1d9b700 1 --2- 172.21.2.105:0/3815207700 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7aa00536f0 0x7f7aa0055bb0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f7abc007000 tx=0x7f7abc008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:11.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.593+0000 7f7ab37fe700 1 -- 172.21.2.105:0/3815207700 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7ab8042510 con 0x7f7ac40626b0 2021-11-12T05:50:11.680 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.677+0000 7f7ac8b2d700 1 -- 172.21.2.105:0/3815207700 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f7ac415a3d0 con 0x7f7ac40626b0 2021-11-12T05:50:11.681 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.677+0000 7f7ab37fe700 1 -- 172.21.2.105:0/3815207700 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v156) v1 ==== 81+0+34051 (secure 0 0 0) 0x7f7ab8018030 con 0x7f7ac40626b0 2021-11-12T05:50:11.682 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:50:11.682 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T05:50:11.682 INFO:teuthology.orchestra.run.gibba005.stdout: "epoch": 156, 2021-11-12T05:50:11.682 INFO:teuthology.orchestra.run.gibba005.stdout: "fsid": "22928e10-9f3c-479a-96ca-77d6ddf80f9f", 2021-11-12T05:50:11.682 INFO:teuthology.orchestra.run.gibba005.stdout: "created": "2021-11-12T05:40:19.986390+0000", 2021-11-12T05:50:11.683 INFO:teuthology.orchestra.run.gibba005.stdout: "modified": "2021-11-12T05:49:58.440307+0000", 2021-11-12T05:50:11.683 INFO:teuthology.orchestra.run.gibba005.stdout: "last_up_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:50:11.683 INFO:teuthology.orchestra.run.gibba005.stdout: "last_in_change": "2021-11-12T05:40:26.043478+0000", 2021-11-12T05:50:11.683 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-11-12T05:50:11.684 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_num": 5799936, 2021-11-12T05:50:11.684 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_set": [ 2021-11-12T05:50:11.684 INFO:teuthology.orchestra.run.gibba005.stdout: "pglog_hardlimit", 2021-11-12T05:50:11.684 INFO:teuthology.orchestra.run.gibba005.stdout: "purged_snapdirs", 2021-11-12T05:50:11.685 INFO:teuthology.orchestra.run.gibba005.stdout: "recovery_deletes", 2021-11-12T05:50:11.685 INFO:teuthology.orchestra.run.gibba005.stdout: "sortbitwise" 2021-11-12T05:50:11.685 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:50:11.685 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_version": 5, 2021-11-12T05:50:11.685 INFO:teuthology.orchestra.run.gibba005.stdout: "full_ratio": 0.94999998807907104, 2021-11-12T05:50:11.686 INFO:teuthology.orchestra.run.gibba005.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-11-12T05:50:11.686 INFO:teuthology.orchestra.run.gibba005.stdout: "nearfull_ratio": 0.85000002384185791, 2021-11-12T05:50:11.686 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_snapshot": "", 2021-11-12T05:50:11.686 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_max": 30, 2021-11-12T05:50:11.687 INFO:teuthology.orchestra.run.gibba005.stdout: "max_osd": 8, 2021-11-12T05:50:11.687 INFO:teuthology.orchestra.run.gibba005.stdout: "require_min_compat_client": "jewel", 2021-11-12T05:50:11.687 INFO:teuthology.orchestra.run.gibba005.stdout: "min_compat_client": "jewel", 2021-11-12T05:50:11.687 INFO:teuthology.orchestra.run.gibba005.stdout: "require_osd_release": "octopus", 2021-11-12T05:50:11.688 INFO:teuthology.orchestra.run.gibba005.stdout: "pools": [ 2021-11-12T05:50:11.688 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.688 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 1, 2021-11-12T05:50:11.688 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "device_health_metrics", 2021-11-12T05:50:11.688 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:22.022116+0000", 2021-11-12T05:50:11.689 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:50:11.689 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:50:11.689 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:50:11.689 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:50:11.690 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:50:11.690 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:50:11.690 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:50:11.690 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:50:11.690 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 1, 2021-11-12T05:50:11.691 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 1, 2021-11-12T05:50:11.691 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 1, 2021-11-12T05:50:11.691 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 1, 2021-11-12T05:50:11.691 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 1, 2021-11-12T05:50:11.692 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:50:11.692 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:50:11.692 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:50:11.692 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:50:11.692 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:50:11.693 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:50:11.693 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:50:11.693 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.693 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "16", 2021-11-12T05:50:11.693 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:50:11.694 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:50:11.694 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:50:11.694 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:50:11.694 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:50:11.695 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:50:11.695 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:50:11.695 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:50:11.695 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:50:11.695 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:50:11.696 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:50:11.696 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:50:11.696 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:50:11.696 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:50:11.696 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:50:11.697 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:50:11.697 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:50:11.697 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:50:11.697 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:50:11.697 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:50:11.698 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:50:11.698 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:50:11.698 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:50:11.698 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:50:11.698 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:50:11.699 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:50:11.699 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.699 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:50:11.700 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:50:11.700 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:50:11.700 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:50:11.700 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:50:11.701 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:50:11.701 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:50:11.701 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:50:11.701 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:50:11.702 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:50:11.702 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:50:11.702 INFO:teuthology.orchestra.run.gibba005.stdout: "options": { 2021-11-12T05:50:11.702 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_min": 1 2021-11-12T05:50:11.702 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.703 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:50:11.703 INFO:teuthology.orchestra.run.gibba005.stdout: "mgr_devicehealth": {} 2021-11-12T05:50:11.703 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.703 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.704 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.704 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 2, 2021-11-12T05:50:11.704 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "rbd", 2021-11-12T05:50:11.704 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:40:29.953617+0000", 2021-11-12T05:50:11.704 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:50:11.705 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:50:11.705 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:50:11.705 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:50:11.705 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:50:11.706 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:50:11.706 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:50:11.706 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:50:11.706 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:50:11.707 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:50:11.707 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:50:11.707 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:50:11.707 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:50:11.707 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:50:11.708 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:50:11.708 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:50:11.708 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:50:11.708 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:50:11.709 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:50:11.709 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:50:11.709 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.709 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "19", 2021-11-12T05:50:11.709 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:50:11.710 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:50:11.710 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:50:11.710 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:50:11.710 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:50:11.711 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:50:11.711 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:50:11.711 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:50:11.711 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:50:11.711 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:50:11.712 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:50:11.712 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:50:11.712 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:50:11.712 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:50:11.713 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:50:11.713 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:50:11.713 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:50:11.713 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:50:11.713 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:50:11.714 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:50:11.714 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:50:11.714 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:50:11.714 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:50:11.715 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:50:11.715 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:50:11.715 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:50:11.715 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.716 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:50:11.716 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:50:11.716 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:50:11.716 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:50:11.716 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:50:11.717 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:50:11.717 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:50:11.717 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:50:11.717 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:50:11.717 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:50:11.718 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:50:11.718 INFO:teuthology.orchestra.run.gibba005.stdout: "options": {}, 2021-11-12T05:50:11.718 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:50:11.718 INFO:teuthology.orchestra.run.gibba005.stdout: "rbd": {} 2021-11-12T05:50:11.719 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.719 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.719 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.719 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 29, 2021-11-12T05:50:11.720 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "cephfs_metadata", 2021-11-12T05:50:11.720 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:49:55.298718+0000", 2021-11-12T05:50:11.720 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:50:11.720 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:50:11.720 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:50:11.721 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:50:11.721 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:50:11.721 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:50:11.721 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:50:11.722 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:50:11.722 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:50:11.722 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:50:11.722 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:50:11.722 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:50:11.723 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:50:11.723 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:50:11.723 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:50:11.723 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:50:11.724 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:50:11.724 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:50:11.724 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:50:11.724 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:50:11.725 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.725 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "155", 2021-11-12T05:50:11.725 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:50:11.725 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:50:11.725 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:50:11.726 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:50:11.726 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:50:11.726 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:50:11.726 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:50:11.727 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:50:11.727 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:50:11.727 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:50:11.727 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:50:11.727 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:50:11.728 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:50:11.728 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:50:11.728 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:50:11.728 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:50:11.729 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:50:11.729 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:50:11.729 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:50:11.729 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:50:11.729 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:50:11.730 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:50:11.730 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:50:11.730 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:50:11.730 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:50:11.731 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:50:11.731 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.731 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:50:11.731 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:50:11.732 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:50:11.732 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:50:11.732 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:50:11.732 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:50:11.732 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:50:11.733 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:50:11.733 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:50:11.733 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:50:11.733 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:50:11.734 INFO:teuthology.orchestra.run.gibba005.stdout: "options": { 2021-11-12T05:50:11.734 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_bias": 4, 2021-11-12T05:50:11.734 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_min": 16, 2021-11-12T05:50:11.734 INFO:teuthology.orchestra.run.gibba005.stdout: "recovery_priority": 5 2021-11-12T05:50:11.735 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.735 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:50:11.735 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs": { 2021-11-12T05:50:11.735 INFO:teuthology.orchestra.run.gibba005.stdout: "metadata": "cephfs" 2021-11-12T05:50:11.735 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.736 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.736 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.736 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.736 INFO:teuthology.orchestra.run.gibba005.stdout: "pool": 30, 2021-11-12T05:50:11.737 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_name": "cephfs_data", 2021-11-12T05:50:11.737 INFO:teuthology.orchestra.run.gibba005.stdout: "create_time": "2021-11-12T05:49:56.403004+0000", 2021-11-12T05:50:11.737 INFO:teuthology.orchestra.run.gibba005.stdout: "flags": 1, 2021-11-12T05:50:11.737 INFO:teuthology.orchestra.run.gibba005.stdout: "flags_names": "hashpspool", 2021-11-12T05:50:11.738 INFO:teuthology.orchestra.run.gibba005.stdout: "type": 1, 2021-11-12T05:50:11.738 INFO:teuthology.orchestra.run.gibba005.stdout: "size": 2, 2021-11-12T05:50:11.738 INFO:teuthology.orchestra.run.gibba005.stdout: "min_size": 1, 2021-11-12T05:50:11.738 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_rule": 0, 2021-11-12T05:50:11.738 INFO:teuthology.orchestra.run.gibba005.stdout: "object_hash": 2, 2021-11-12T05:50:11.739 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_autoscale_mode": "off", 2021-11-12T05:50:11.739 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num": 8, 2021-11-12T05:50:11.739 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num": 8, 2021-11-12T05:50:11.739 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_placement_num_target": 8, 2021-11-12T05:50:11.740 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_target": 8, 2021-11-12T05:50:11.740 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_num_pending": 8, 2021-11-12T05:50:11.740 INFO:teuthology.orchestra.run.gibba005.stdout: "last_pg_merge_meta": { 2021-11-12T05:50:11.740 INFO:teuthology.orchestra.run.gibba005.stdout: "source_pgid": "0.0", 2021-11-12T05:50:11.741 INFO:teuthology.orchestra.run.gibba005.stdout: "ready_epoch": 0, 2021-11-12T05:50:11.741 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_started": 0, 2021-11-12T05:50:11.741 INFO:teuthology.orchestra.run.gibba005.stdout: "last_epoch_clean": 0, 2021-11-12T05:50:11.741 INFO:teuthology.orchestra.run.gibba005.stdout: "source_version": "0'0", 2021-11-12T05:50:11.742 INFO:teuthology.orchestra.run.gibba005.stdout: "target_version": "0'0" 2021-11-12T05:50:11.742 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.742 INFO:teuthology.orchestra.run.gibba005.stdout: "last_change": "156", 2021-11-12T05:50:11.742 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend": "0", 2021-11-12T05:50:11.742 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_prenautilus": "0", 2021-11-12T05:50:11.743 INFO:teuthology.orchestra.run.gibba005.stdout: "last_force_op_resend_preluminous": "0", 2021-11-12T05:50:11.743 INFO:teuthology.orchestra.run.gibba005.stdout: "auid": 0, 2021-11-12T05:50:11.743 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_mode": "selfmanaged", 2021-11-12T05:50:11.743 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_seq": 0, 2021-11-12T05:50:11.744 INFO:teuthology.orchestra.run.gibba005.stdout: "snap_epoch": 0, 2021-11-12T05:50:11.744 INFO:teuthology.orchestra.run.gibba005.stdout: "pool_snaps": [], 2021-11-12T05:50:11.744 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps": "[]", 2021-11-12T05:50:11.744 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_bytes": 0, 2021-11-12T05:50:11.744 INFO:teuthology.orchestra.run.gibba005.stdout: "quota_max_objects": 0, 2021-11-12T05:50:11.745 INFO:teuthology.orchestra.run.gibba005.stdout: "tiers": [], 2021-11-12T05:50:11.745 INFO:teuthology.orchestra.run.gibba005.stdout: "tier_of": -1, 2021-11-12T05:50:11.745 INFO:teuthology.orchestra.run.gibba005.stdout: "read_tier": -1, 2021-11-12T05:50:11.745 INFO:teuthology.orchestra.run.gibba005.stdout: "write_tier": -1, 2021-11-12T05:50:11.746 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_mode": "none", 2021-11-12T05:50:11.746 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_bytes": 0, 2021-11-12T05:50:11.746 INFO:teuthology.orchestra.run.gibba005.stdout: "target_max_objects": 0, 2021-11-12T05:50:11.746 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-11-12T05:50:11.747 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-11-12T05:50:11.747 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_target_full_ratio_micro": 800000, 2021-11-12T05:50:11.747 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_flush_age": 0, 2021-11-12T05:50:11.747 INFO:teuthology.orchestra.run.gibba005.stdout: "cache_min_evict_age": 0, 2021-11-12T05:50:11.747 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profile": "", 2021-11-12T05:50:11.748 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_params": { 2021-11-12T05:50:11.748 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "none" 2021-11-12T05:50:11.748 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.748 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_period": 0, 2021-11-12T05:50:11.749 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_count": 0, 2021-11-12T05:50:11.749 INFO:teuthology.orchestra.run.gibba005.stdout: "use_gmt_hitset": true, 2021-11-12T05:50:11.749 INFO:teuthology.orchestra.run.gibba005.stdout: "min_read_recency_for_promote": 0, 2021-11-12T05:50:11.749 INFO:teuthology.orchestra.run.gibba005.stdout: "min_write_recency_for_promote": 0, 2021-11-12T05:50:11.750 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_grade_decay_rate": 0, 2021-11-12T05:50:11.750 INFO:teuthology.orchestra.run.gibba005.stdout: "hit_set_search_last_n": 0, 2021-11-12T05:50:11.750 INFO:teuthology.orchestra.run.gibba005.stdout: "grade_table": [], 2021-11-12T05:50:11.750 INFO:teuthology.orchestra.run.gibba005.stdout: "stripe_width": 0, 2021-11-12T05:50:11.750 INFO:teuthology.orchestra.run.gibba005.stdout: "expected_num_objects": 0, 2021-11-12T05:50:11.751 INFO:teuthology.orchestra.run.gibba005.stdout: "fast_read": false, 2021-11-12T05:50:11.751 INFO:teuthology.orchestra.run.gibba005.stdout: "options": {}, 2021-11-12T05:50:11.751 INFO:teuthology.orchestra.run.gibba005.stdout: "application_metadata": { 2021-11-12T05:50:11.751 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs": { 2021-11-12T05:50:11.752 INFO:teuthology.orchestra.run.gibba005.stdout: "data": "cephfs" 2021-11-12T05:50:11.752 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.752 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.752 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.752 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:50:11.753 INFO:teuthology.orchestra.run.gibba005.stdout: "osds": [ 2021-11-12T05:50:11.753 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.753 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:50:11.753 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "ee8e30a0-4819-4475-80ec-dd3ee7d01322", 2021-11-12T05:50:11.754 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:50:11.754 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:50:11.754 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:50:11.754 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:50:11.754 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:50:11.755 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:50:11.755 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:50:11.755 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 153, 2021-11-12T05:50:11.755 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:50:11.756 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:50:11.756 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:50:11.756 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:50:11.756 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.757 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:50:11.757 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6802", 2021-11-12T05:50:11.757 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:50:11.757 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.757 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.758 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:50:11.758 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6803", 2021-11-12T05:50:11.758 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:50:11.758 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.759 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.759 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.759 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:50:11.759 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:50:11.760 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.760 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:50:11.760 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6804", 2021-11-12T05:50:11.760 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:50:11.761 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.761 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.761 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:50:11.761 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6805", 2021-11-12T05:50:11.762 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:50:11.762 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.762 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.762 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.762 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:50:11.763 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:50:11.763 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.763 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:50:11.763 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6808", 2021-11-12T05:50:11.764 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:50:11.764 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.764 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.764 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:50:11.765 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6809", 2021-11-12T05:50:11.765 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:50:11.765 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.765 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.765 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.766 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:50:11.766 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:50:11.766 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.766 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:50:11.767 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6806", 2021-11-12T05:50:11.767 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:50:11.767 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.767 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.768 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:50:11.768 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6807", 2021-11-12T05:50:11.768 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14874 2021-11-12T05:50:11.768 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.768 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.769 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.769 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6803/14874", 2021-11-12T05:50:11.769 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6805/14874", 2021-11-12T05:50:11.769 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6809/14874", 2021-11-12T05:50:11.770 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6807/14874", 2021-11-12T05:50:11.770 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:50:11.770 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:50:11.770 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:50:11.771 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.771 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.771 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.771 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:50:11.771 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "b1bb06c3-26d0-4d92-82f8-b3e882242785", 2021-11-12T05:50:11.772 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:50:11.772 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:50:11.772 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:50:11.772 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:50:11.773 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:50:11.773 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:50:11.773 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:50:11.773 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 152, 2021-11-12T05:50:11.773 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:50:11.774 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:50:11.774 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:50:11.774 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:50:11.774 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.775 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:50:11.775 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6810", 2021-11-12T05:50:11.775 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:50:11.775 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.776 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.776 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:50:11.776 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6811", 2021-11-12T05:50:11.776 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:50:11.777 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.777 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.777 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.777 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:50:11.777 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:50:11.778 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.778 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:50:11.778 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6812", 2021-11-12T05:50:11.778 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:50:11.779 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.779 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.779 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:50:11.779 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6813", 2021-11-12T05:50:11.780 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:50:11.780 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.780 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.780 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.780 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:50:11.781 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:50:11.781 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.781 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:50:11.781 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6816", 2021-11-12T05:50:11.781 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:50:11.782 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.782 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.782 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:50:11.782 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6817", 2021-11-12T05:50:11.783 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:50:11.783 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.783 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.783 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.784 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:50:11.784 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:50:11.784 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.784 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:50:11.784 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6814", 2021-11-12T05:50:11.785 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:50:11.785 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.785 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.785 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:50:11.786 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6815", 2021-11-12T05:50:11.786 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14875 2021-11-12T05:50:11.786 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.786 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.787 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.787 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6811/14875", 2021-11-12T05:50:11.787 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6813/14875", 2021-11-12T05:50:11.787 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6817/14875", 2021-11-12T05:50:11.788 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6815/14875", 2021-11-12T05:50:11.788 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:50:11.788 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:50:11.788 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:50:11.789 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.789 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.789 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.789 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:50:11.789 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "837b2c60-c335-4382-9f47-d86543a14022", 2021-11-12T05:50:11.790 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:50:11.790 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:50:11.790 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:50:11.790 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:50:11.791 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:50:11.791 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:50:11.791 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:50:11.791 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 153, 2021-11-12T05:50:11.792 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:50:11.792 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:50:11.792 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:50:11.792 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:50:11.793 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.793 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:50:11.793 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6818", 2021-11-12T05:50:11.793 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:50:11.793 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.794 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.794 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:50:11.794 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6819", 2021-11-12T05:50:11.794 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:50:11.795 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.795 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.795 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.795 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:50:11.796 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:50:11.796 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.796 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:50:11.796 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6820", 2021-11-12T05:50:11.797 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:50:11.797 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.797 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.797 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:50:11.798 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6821", 2021-11-12T05:50:11.798 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:50:11.798 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.798 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.798 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.799 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:50:11.799 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:50:11.799 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.799 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:50:11.800 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6824", 2021-11-12T05:50:11.800 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:50:11.800 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.800 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.800 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:50:11.801 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6825", 2021-11-12T05:50:11.801 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:50:11.801 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.801 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.802 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.802 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:50:11.802 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:50:11.802 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.803 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:50:11.803 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6822", 2021-11-12T05:50:11.803 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:50:11.803 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.803 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.804 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:50:11.804 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6823", 2021-11-12T05:50:11.804 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14905 2021-11-12T05:50:11.804 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.805 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.805 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.805 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6819/14905", 2021-11-12T05:50:11.805 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6821/14905", 2021-11-12T05:50:11.805 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6825/14905", 2021-11-12T05:50:11.806 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6823/14905", 2021-11-12T05:50:11.806 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:50:11.806 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:50:11.806 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:50:11.807 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.807 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.807 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.807 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:50:11.808 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "eb2b737b-dda6-444b-a306-f33cbbd51f70", 2021-11-12T05:50:11.808 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:50:11.808 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:50:11.808 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:50:11.809 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:50:11.809 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:50:11.809 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:50:11.809 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:50:11.810 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 154, 2021-11-12T05:50:11.810 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:50:11.810 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:50:11.810 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:50:11.810 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:50:11.811 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.811 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:50:11.811 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6826", 2021-11-12T05:50:11.811 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:50:11.812 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.812 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.812 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:50:11.812 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6827", 2021-11-12T05:50:11.813 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:50:11.813 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.813 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.813 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.813 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:50:11.814 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:50:11.814 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.814 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:50:11.814 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6828", 2021-11-12T05:50:11.815 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:50:11.815 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.815 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.815 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:50:11.815 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6829", 2021-11-12T05:50:11.816 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:50:11.816 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.816 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.816 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.817 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:50:11.817 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:50:11.817 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.817 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:50:11.818 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6832", 2021-11-12T05:50:11.818 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:50:11.818 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.818 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.819 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:50:11.819 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6833", 2021-11-12T05:50:11.819 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:50:11.819 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.819 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.820 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.820 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:50:11.820 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:50:11.820 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.821 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:50:11.821 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6830", 2021-11-12T05:50:11.821 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:50:11.821 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.822 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.822 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:50:11.822 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.105:6831", 2021-11-12T05:50:11.822 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 14876 2021-11-12T05:50:11.823 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.823 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.823 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.823 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.105:6827/14876", 2021-11-12T05:50:11.823 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.105:6829/14876", 2021-11-12T05:50:11.824 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.105:6833/14876", 2021-11-12T05:50:11.824 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.105:6831/14876", 2021-11-12T05:50:11.824 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:50:11.825 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:50:11.825 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:50:11.825 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.825 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.825 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.826 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:50:11.826 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "721529a1-c047-486a-a7ca-ddc15d80cdde", 2021-11-12T05:50:11.826 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:50:11.827 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:50:11.827 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:50:11.827 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:50:11.827 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:50:11.828 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:50:11.828 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:50:11.828 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 152, 2021-11-12T05:50:11.828 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:50:11.829 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:50:11.829 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:50:11.829 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:50:11.829 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.830 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:50:11.830 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6800", 2021-11-12T05:50:11.830 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:50:11.831 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.831 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.831 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:50:11.831 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6801", 2021-11-12T05:50:11.832 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:50:11.832 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.832 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.832 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.833 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:50:11.833 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:50:11.833 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.833 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:50:11.834 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6802", 2021-11-12T05:50:11.834 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:50:11.834 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.835 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.835 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:50:11.835 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6803", 2021-11-12T05:50:11.835 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:50:11.836 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.836 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.836 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.836 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:50:11.837 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:50:11.837 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.837 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:50:11.837 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6806", 2021-11-12T05:50:11.838 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:50:11.838 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.838 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.838 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:50:11.839 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6807", 2021-11-12T05:50:11.839 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:50:11.839 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.840 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.840 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.840 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:50:11.841 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:50:11.841 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.841 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:50:11.842 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6804", 2021-11-12T05:50:11.842 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:50:11.842 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.842 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.843 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:50:11.843 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6805", 2021-11-12T05:50:11.843 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15096 2021-11-12T05:50:11.844 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.844 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.844 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.845 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6801/15096", 2021-11-12T05:50:11.845 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6803/15096", 2021-11-12T05:50:11.845 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6807/15096", 2021-11-12T05:50:11.845 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6805/15096", 2021-11-12T05:50:11.845 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:50:11.846 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:50:11.846 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:50:11.846 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.847 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.847 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.847 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:50:11.848 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "68b72ab2-fa82-4b5c-bf33-528f002e4950", 2021-11-12T05:50:11.848 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:50:11.848 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:50:11.849 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:50:11.849 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:50:11.849 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:50:11.850 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:50:11.850 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:50:11.850 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 153, 2021-11-12T05:50:11.850 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:50:11.851 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:50:11.851 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:50:11.851 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:50:11.851 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.852 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:50:11.852 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6808", 2021-11-12T05:50:11.852 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:50:11.852 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.853 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.853 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:50:11.853 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6809", 2021-11-12T05:50:11.853 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:50:11.854 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.854 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.854 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.854 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:50:11.855 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:50:11.855 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.855 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:50:11.855 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6810", 2021-11-12T05:50:11.856 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:50:11.856 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.856 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.856 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:50:11.857 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6811", 2021-11-12T05:50:11.857 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:50:11.857 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.858 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.858 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.858 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:50:11.858 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:50:11.859 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.859 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:50:11.859 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6814", 2021-11-12T05:50:11.860 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:50:11.860 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.860 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.860 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:50:11.860 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6815", 2021-11-12T05:50:11.861 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:50:11.861 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.861 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.861 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.862 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:50:11.862 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:50:11.862 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.862 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:50:11.863 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6812", 2021-11-12T05:50:11.863 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:50:11.863 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.863 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.863 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:50:11.864 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6813", 2021-11-12T05:50:11.864 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15097 2021-11-12T05:50:11.864 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.864 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.865 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.865 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6809/15097", 2021-11-12T05:50:11.865 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6811/15097", 2021-11-12T05:50:11.865 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6815/15097", 2021-11-12T05:50:11.866 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6813/15097", 2021-11-12T05:50:11.866 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:50:11.866 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:50:11.866 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:50:11.866 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.867 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.867 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.867 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:50:11.867 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "a2c83b5d-8d37-4d30-ac04-30d89a76e485", 2021-11-12T05:50:11.868 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:50:11.868 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:50:11.868 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:50:11.868 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:50:11.869 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:50:11.869 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:50:11.869 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:50:11.869 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 153, 2021-11-12T05:50:11.869 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:50:11.870 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:50:11.870 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:50:11.870 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:50:11.870 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.871 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:50:11.871 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6816", 2021-11-12T05:50:11.871 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:50:11.871 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.871 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.872 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:50:11.872 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6817", 2021-11-12T05:50:11.872 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:50:11.872 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.873 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.873 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.873 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:50:11.873 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:50:11.873 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.874 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:50:11.874 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6818", 2021-11-12T05:50:11.874 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:50:11.874 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.875 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.875 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:50:11.875 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6819", 2021-11-12T05:50:11.875 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:50:11.875 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.876 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.876 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.876 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:50:11.876 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:50:11.877 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.877 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:50:11.877 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6822", 2021-11-12T05:50:11.877 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:50:11.877 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.878 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.878 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:50:11.878 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6823", 2021-11-12T05:50:11.878 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:50:11.879 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.879 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.879 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.879 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:50:11.879 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:50:11.880 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.880 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:50:11.880 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6820", 2021-11-12T05:50:11.880 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:50:11.881 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.881 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.881 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:50:11.881 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6821", 2021-11-12T05:50:11.882 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15098 2021-11-12T05:50:11.882 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.882 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.882 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.882 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6817/15098", 2021-11-12T05:50:11.883 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6819/15098", 2021-11-12T05:50:11.883 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6823/15098", 2021-11-12T05:50:11.883 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6821/15098", 2021-11-12T05:50:11.883 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:50:11.884 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:50:11.884 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:50:11.884 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.884 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.884 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.885 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:50:11.885 INFO:teuthology.orchestra.run.gibba005.stdout: "uuid": "786ce966-d0fb-4181-aed4-c26e3ef61c43", 2021-11-12T05:50:11.885 INFO:teuthology.orchestra.run.gibba005.stdout: "up": 1, 2021-11-12T05:50:11.885 INFO:teuthology.orchestra.run.gibba005.stdout: "in": 1, 2021-11-12T05:50:11.886 INFO:teuthology.orchestra.run.gibba005.stdout: "weight": 1, 2021-11-12T05:50:11.886 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_affinity": 1, 2021-11-12T05:50:11.886 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_begin": 0, 2021-11-12T05:50:11.886 INFO:teuthology.orchestra.run.gibba005.stdout: "last_clean_end": 0, 2021-11-12T05:50:11.886 INFO:teuthology.orchestra.run.gibba005.stdout: "up_from": 14, 2021-11-12T05:50:11.887 INFO:teuthology.orchestra.run.gibba005.stdout: "up_thru": 153, 2021-11-12T05:50:11.887 INFO:teuthology.orchestra.run.gibba005.stdout: "down_at": 0, 2021-11-12T05:50:11.887 INFO:teuthology.orchestra.run.gibba005.stdout: "lost_at": 0, 2021-11-12T05:50:11.887 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addrs": { 2021-11-12T05:50:11.888 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:50:11.888 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.888 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:50:11.888 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6824", 2021-11-12T05:50:11.889 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:50:11.889 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.889 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.889 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:50:11.889 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6825", 2021-11-12T05:50:11.890 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:50:11.890 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.890 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.890 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.890 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addrs": { 2021-11-12T05:50:11.891 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:50:11.891 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.891 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:50:11.891 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6826", 2021-11-12T05:50:11.892 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:50:11.892 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.892 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.892 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:50:11.893 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6827", 2021-11-12T05:50:11.893 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:50:11.893 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.894 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.894 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.894 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addrs": { 2021-11-12T05:50:11.894 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:50:11.895 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.895 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:50:11.895 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6830", 2021-11-12T05:50:11.895 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:50:11.896 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.896 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.896 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:50:11.896 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6831", 2021-11-12T05:50:11.897 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:50:11.897 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.897 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.897 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.898 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addrs": { 2021-11-12T05:50:11.898 INFO:teuthology.orchestra.run.gibba005.stdout: "addrvec": [ 2021-11-12T05:50:11.898 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.898 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v2", 2021-11-12T05:50:11.899 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6828", 2021-11-12T05:50:11.899 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:50:11.899 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.899 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.900 INFO:teuthology.orchestra.run.gibba005.stdout: "type": "v1", 2021-11-12T05:50:11.900 INFO:teuthology.orchestra.run.gibba005.stdout: "addr": "172.21.2.115:6829", 2021-11-12T05:50:11.900 INFO:teuthology.orchestra.run.gibba005.stdout: "nonce": 15099 2021-11-12T05:50:11.900 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.900 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.901 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.901 INFO:teuthology.orchestra.run.gibba005.stdout: "public_addr": "172.21.2.115:6825/15099", 2021-11-12T05:50:11.901 INFO:teuthology.orchestra.run.gibba005.stdout: "cluster_addr": "172.21.2.115:6827/15099", 2021-11-12T05:50:11.901 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_back_addr": "172.21.2.115:6831/15099", 2021-11-12T05:50:11.902 INFO:teuthology.orchestra.run.gibba005.stdout: "heartbeat_front_addr": "172.21.2.115:6829/15099", 2021-11-12T05:50:11.902 INFO:teuthology.orchestra.run.gibba005.stdout: "state": [ 2021-11-12T05:50:11.902 INFO:teuthology.orchestra.run.gibba005.stdout: "exists", 2021-11-12T05:50:11.902 INFO:teuthology.orchestra.run.gibba005.stdout: "up" 2021-11-12T05:50:11.903 INFO:teuthology.orchestra.run.gibba005.stdout: ] 2021-11-12T05:50:11.903 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.903 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:50:11.903 INFO:teuthology.orchestra.run.gibba005.stdout: "osd_xinfo": [ 2021-11-12T05:50:11.903 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.904 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 0, 2021-11-12T05:50:11.904 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:50:11.904 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:50:11.904 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:50:11.905 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:50:11.905 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:50:11.905 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.615112+0000", 2021-11-12T05:50:11.905 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:50:11.905 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.906 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.906 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 1, 2021-11-12T05:50:11.906 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:50:11.906 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:50:11.907 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:50:11.907 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:50:11.907 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:50:11.907 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.665935+0000", 2021-11-12T05:50:11.907 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:50:11.908 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.908 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.908 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 2, 2021-11-12T05:50:11.908 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:50:11.909 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:50:11.909 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:50:11.909 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:50:11.909 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:50:11.909 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.715877+0000", 2021-11-12T05:50:11.910 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:50:11.910 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.910 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.910 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 3, 2021-11-12T05:50:11.911 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:50:11.911 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:50:11.911 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:50:11.911 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:50:11.911 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:50:11.912 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.489234+0000", 2021-11-12T05:50:11.912 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:50:11.912 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.912 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.913 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 4, 2021-11-12T05:50:11.913 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:50:11.913 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:50:11.913 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:50:11.914 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:50:11.914 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:50:11.914 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.413776+0000", 2021-11-12T05:50:11.914 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:50:11.914 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.915 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.915 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 5, 2021-11-12T05:50:11.915 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:50:11.915 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:50:11.919 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:50:11.920 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:50:11.920 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:50:11.920 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.507960+0000", 2021-11-12T05:50:11.920 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:50:11.921 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.921 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.921 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 6, 2021-11-12T05:50:11.921 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:50:11.921 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:50:11.922 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:50:11.922 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:50:11.922 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:50:11.922 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.635696+0000", 2021-11-12T05:50:11.923 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:50:11.923 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.923 INFO:teuthology.orchestra.run.gibba005.stdout: { 2021-11-12T05:50:11.923 INFO:teuthology.orchestra.run.gibba005.stdout: "osd": 7, 2021-11-12T05:50:11.924 INFO:teuthology.orchestra.run.gibba005.stdout: "down_stamp": "0.000000", 2021-11-12T05:50:11.924 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_probability": 0, 2021-11-12T05:50:11.924 INFO:teuthology.orchestra.run.gibba005.stdout: "laggy_interval": 0, 2021-11-12T05:50:11.924 INFO:teuthology.orchestra.run.gibba005.stdout: "features": 4540138292840890367, 2021-11-12T05:50:11.925 INFO:teuthology.orchestra.run.gibba005.stdout: "old_weight": 0, 2021-11-12T05:50:11.925 INFO:teuthology.orchestra.run.gibba005.stdout: "last_purged_snaps_scrub": "2021-11-12T05:40:24.746949+0000", 2021-11-12T05:50:11.925 INFO:teuthology.orchestra.run.gibba005.stdout: "dead_epoch": 0 2021-11-12T05:50:11.925 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.925 INFO:teuthology.orchestra.run.gibba005.stdout: ], 2021-11-12T05:50:11.926 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap": [], 2021-11-12T05:50:11.926 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_upmap_items": [], 2021-11-12T05:50:11.926 INFO:teuthology.orchestra.run.gibba005.stdout: "pg_temp": [], 2021-11-12T05:50:11.926 INFO:teuthology.orchestra.run.gibba005.stdout: "primary_temp": [], 2021-11-12T05:50:11.927 INFO:teuthology.orchestra.run.gibba005.stdout: "blacklist": {}, 2021-11-12T05:50:11.927 INFO:teuthology.orchestra.run.gibba005.stdout: "erasure_code_profiles": { 2021-11-12T05:50:11.927 INFO:teuthology.orchestra.run.gibba005.stdout: "cephfs_data": { 2021-11-12T05:50:11.927 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-device-class": "", 2021-11-12T05:50:11.927 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:50:11.928 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-root": "default", 2021-11-12T05:50:11.928 INFO:teuthology.orchestra.run.gibba005.stdout: "jerasure-per-chunk-alignment": "false", 2021-11-12T05:50:11.928 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:50:11.928 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "2", 2021-11-12T05:50:11.928 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:50:11.929 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:50:11.929 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van", 2021-11-12T05:50:11.929 INFO:teuthology.orchestra.run.gibba005.stdout: "w": "8" 2021-11-12T05:50:11.929 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.929 INFO:teuthology.orchestra.run.gibba005.stdout: "default": { 2021-11-12T05:50:11.930 INFO:teuthology.orchestra.run.gibba005.stdout: "crush-failure-domain": "osd", 2021-11-12T05:50:11.930 INFO:teuthology.orchestra.run.gibba005.stdout: "k": "2", 2021-11-12T05:50:11.930 INFO:teuthology.orchestra.run.gibba005.stdout: "m": "1", 2021-11-12T05:50:11.930 INFO:teuthology.orchestra.run.gibba005.stdout: "plugin": "jerasure", 2021-11-12T05:50:11.931 INFO:teuthology.orchestra.run.gibba005.stdout: "ruleset-failure-domain": "osd", 2021-11-12T05:50:11.931 INFO:teuthology.orchestra.run.gibba005.stdout: "technique": "reed_sol_van" 2021-11-12T05:50:11.931 INFO:teuthology.orchestra.run.gibba005.stdout: } 2021-11-12T05:50:11.931 INFO:teuthology.orchestra.run.gibba005.stdout: }, 2021-11-12T05:50:11.932 INFO:teuthology.orchestra.run.gibba005.stdout: "removed_snaps_queue": [], 2021-11-12T05:50:11.932 INFO:teuthology.orchestra.run.gibba005.stdout: "new_removed_snaps": [], 2021-11-12T05:50:11.932 INFO:teuthology.orchestra.run.gibba005.stdout: "new_purged_snaps": [], 2021-11-12T05:50:11.932 INFO:teuthology.orchestra.run.gibba005.stdout: "crush_node_flags": {}, 2021-11-12T05:50:11.933 INFO:teuthology.orchestra.run.gibba005.stdout: "device_class_flags": {} 2021-11-12T05:50:11.933 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T05:50:11.935 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.677+0000 7f7ac8b2d700 1 -- 172.21.2.105:0/3815207700 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7aa00536f0 msgr2=0x7f7aa0055bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:11.935 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.677+0000 7f7ac8b2d700 1 --2- 172.21.2.105:0/3815207700 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7aa00536f0 0x7f7aa0055bb0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f7abc007000 tx=0x7f7abc008040).stop 2021-11-12T05:50:11.935 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.677+0000 7f7ac8b2d700 1 -- 172.21.2.105:0/3815207700 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7ac40626b0 msgr2=0x7f7ac415a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:11.935 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.677+0000 7f7ac8b2d700 1 --2- 172.21.2.105:0/3815207700 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7ac40626b0 0x7f7ac415a980 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 rx=0x7f7ab8002f70 tx=0x7f7ab8006ec0).stop 2021-11-12T05:50:11.936 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.677+0000 7f7ac8b2d700 1 -- 172.21.2.105:0/3815207700 shutdown_connections 2021-11-12T05:50:11.936 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.677+0000 7f7ac8b2d700 1 --2- 172.21.2.105:0/3815207700 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7aa00536f0 0x7f7aa0055bb0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:11.936 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.677+0000 7f7ac8b2d700 1 --2- 172.21.2.105:0/3815207700 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7ac4130860 0x7f7ac41499a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:11.936 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.677+0000 7f7ac8b2d700 1 --2- 172.21.2.105:0/3815207700 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7ac40af750 0x7f7ac414b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:11.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.677+0000 7f7ac8b2d700 1 --2- 172.21.2.105:0/3815207700 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7ac40626b0 0x7f7ac415a980 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:11.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.677+0000 7f7ac8b2d700 1 -- 172.21.2.105:0/3815207700 >> 172.21.2.105:0/3815207700 conn(0x7f7ac40b5320 msgr2=0x7f7ac412c550 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:50:11.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.677+0000 7f7ac8b2d700 1 -- 172.21.2.105:0/3815207700 shutdown_connections 2021-11-12T05:50:11.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.677+0000 7f7ac8b2d700 1 -- 172.21.2.105:0/3815207700 wait complete. 2021-11-12T05:50:11.938 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:50:11.994 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.989+0000 7f750daf7700 1 Processor -- start 2021-11-12T05:50:11.995 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.989+0000 7f750daf7700 1 -- start start 2021-11-12T05:50:11.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f750daf7700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f75080b27d0 0x7f7508144120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:11.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f750daf7700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75080b6b20 con 0x7f75080b6740 2021-11-12T05:50:11.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f750daf7700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7508144610 con 0x7f75080b38e0 2021-11-12T05:50:11.998 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f750daf7700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7508140a70 con 0x7f75080b27d0 2021-11-12T05:50:11.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f750caf5700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f75080b6740 0x7f75080b0000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:35446/0 (socket says 172.21.2.105:35446) 2021-11-12T05:50:11.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f750caf5700 1 -- 172.21.2.105:0/1104650426 learned_addr learned my addr 172.21.2.105:0/1104650426 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:50:11.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f75077fe700 1 -- 172.21.2.105:0/1104650426 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1428108862 0 0) 0x7f75080b6b20 con 0x7f75080b6740 2021-11-12T05:50:11.999 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f75077fe700 1 -- 172.21.2.105:0/1104650426 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74f4003260 con 0x7f75080b6740 2021-11-12T05:50:12.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f750d2f6700 1 --2- 172.21.2.105:0/1104650426 >> v2:172.21.2.115:3300/0 conn(0x7f75080b27d0 0x7f7508144120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:12.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f75077fe700 1 -- 172.21.2.105:0/1104650426 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1698929071 0 0) 0x7f74f4003260 con 0x7f75080b6740 2021-11-12T05:50:12.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f75077fe700 1 -- 172.21.2.105:0/1104650426 >> v2:172.21.2.115:3300/0 conn(0x7f75080b27d0 msgr2=0x7f7508144120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:50:12.000 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f75077fe700 1 --2- 172.21.2.105:0/1104650426 >> v2:172.21.2.115:3300/0 conn(0x7f75080b27d0 0x7f7508144120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:12.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f75077fe700 1 -- 172.21.2.105:0/1104650426 >> v1:172.21.2.115:6789/0 conn(0x7f75080b38e0 legacy=0x7f750813f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:50:12.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f75077fe700 1 -- 172.21.2.105:0/1104650426 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75080af600 con 0x7f75080b6740 2021-11-12T05:50:12.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f75077fe700 1 -- 172.21.2.105:0/1104650426 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f74fc001660 con 0x7f75080b6740 2021-11-12T05:50:12.001 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f75077fe700 1 -- 172.21.2.105:0/1104650426 >> v1:172.21.2.105:6789/0 conn(0x7f75080b6740 legacy=0x7f75080b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:12.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f75077fe700 1 --2- 172.21.2.105:0/1104650426 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f74f4003750 0x7f74f4003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:12.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f75077fe700 1 --2- 172.21.2.105:0/1104650426 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f74f4004500 0x7f74f4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:12.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f75077fe700 1 --2- 172.21.2.105:0/1104650426 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f74f4004ec0 0x7f74f400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:12.002 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f75077fe700 1 -- 172.21.2.105:0/1104650426 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f400bd50 con 0x7f74f4003750 2021-11-12T05:50:12.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f75077fe700 1 -- 172.21.2.105:0/1104650426 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f400bec0 con 0x7f74f4004500 2021-11-12T05:50:12.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f75077fe700 1 -- 172.21.2.105:0/1104650426 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74f400c080 con 0x7f74f4004ec0 2021-11-12T05:50:12.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f750caf5700 1 --2- 172.21.2.105:0/1104650426 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f74f4003750 0x7f74f4003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:12.003 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f7507fff700 1 --2- 172.21.2.105:0/1104650426 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f74f4004500 0x7f74f4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:12.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f750d2f6700 1 --2- 172.21.2.105:0/1104650426 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f74f4004ec0 0x7f74f400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:12.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f750caf5700 1 -- 172.21.2.105:0/1104650426 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f74f4004ec0 msgr2=0x7f74f400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:50:12.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f750caf5700 1 --2- 172.21.2.105:0/1104650426 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f74f4004ec0 0x7f74f400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:12.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f750caf5700 1 -- 172.21.2.105:0/1104650426 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f74f4004500 msgr2=0x7f74f4004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:50:12.004 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f750caf5700 1 --2- 172.21.2.105:0/1104650426 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f74f4004500 0x7f74f4004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:12.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f750caf5700 1 -- 172.21.2.105:0/1104650426 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f4003260 con 0x7f74f4003750 2021-11-12T05:50:12.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f750d2f6700 1 -- 172.21.2.105:0/1104650426 reap_dead start 2021-11-12T05:50:12.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f750caf5700 1 --2- 172.21.2.105:0/1104650426 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f74f4003750 0x7f74f4003b50 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 rx=0x7f75080b6140 tx=0x7f75080af790).ready entity=mon.0 client_cookie=ab6a5f57fb8c5475 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:12.005 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f75077fe700 1 -- 172.21.2.105:0/1104650426 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74fc0071a0 con 0x7f74f4003750 2021-11-12T05:50:12.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f75077fe700 1 -- 172.21.2.105:0/1104650426 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74fc007300 con 0x7f74f4003750 2021-11-12T05:50:12.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f75077fe700 1 -- 172.21.2.105:0/1104650426 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74fc00ca60 con 0x7f74f4003750 2021-11-12T05:50:12.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f750daf7700 1 -- 172.21.2.105:0/1104650426 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f74f4003750 msgr2=0x7f74f4003b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:12.006 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f750daf7700 1 --2- 172.21.2.105:0/1104650426 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f74f4003750 0x7f74f4003b50 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 rx=0x7f75080b6140 tx=0x7f75080af790).stop 2021-11-12T05:50:12.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f750daf7700 1 -- 172.21.2.105:0/1104650426 shutdown_connections 2021-11-12T05:50:12.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f750daf7700 1 --2- 172.21.2.105:0/1104650426 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f74f4003750 0x7f74f4003b50 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:12.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f750daf7700 1 -- 172.21.2.105:0/1104650426 >> 172.21.2.105:0/1104650426 conn(0x7f75080613f0 msgr2=0x7f75080617d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:50:12.007 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f750daf7700 1 -- 172.21.2.105:0/1104650426 shutdown_connections 2021-11-12T05:50:12.008 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f750daf7700 1 -- 172.21.2.105:0/1104650426 wait complete. 2021-11-12T05:50:12.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f750daf7700 1 Processor -- start 2021-11-12T05:50:12.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.993+0000 7f750daf7700 1 -- start start 2021-11-12T05:50:12.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.997+0000 7f750daf7700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f74f4003750 0x7f750813e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:12.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.997+0000 7f750daf7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f750814fce0 0x7f7508150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:12.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.997+0000 7f750daf7700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7508066ca0 0x7f7508150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:12.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.997+0000 7f750daf7700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750813d580 con 0x7f750814fce0 2021-11-12T05:50:12.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.997+0000 7f750daf7700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7508065270 con 0x7f7508066ca0 2021-11-12T05:50:12.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.997+0000 7f750daf7700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7508065510 con 0x7f74f4003750 2021-11-12T05:50:12.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.997+0000 7f7507fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f750814fce0 0x7f7508150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:12.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.997+0000 7f7507fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f750814fce0 0x7f7508150370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53296/0 (socket says 172.21.2.105:53296) 2021-11-12T05:50:12.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.997+0000 7f7507fff700 1 -- 172.21.2.105:0/1013904769 learned_addr learned my addr 172.21.2.105:0/1013904769 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:50:12.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.997+0000 7f7507fff700 1 -- 172.21.2.105:0/1013904769 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f74f4003750 msgr2=0x7f750813e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:12.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.997+0000 7f7507fff700 1 --2- 172.21.2.105:0/1013904769 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f74f4003750 0x7f750813e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:12.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.997+0000 7f7507fff700 1 -- 172.21.2.105:0/1013904769 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7508066ca0 msgr2=0x7f7508150860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:12.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.997+0000 7f7507fff700 1 --2- 172.21.2.105:0/1013904769 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7508066ca0 0x7f7508150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:12.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.997+0000 7f7507fff700 1 -- 172.21.2.105:0/1013904769 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750813e930 con 0x7f750814fce0 2021-11-12T05:50:12.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.997+0000 7f7507fff700 1 --2- 172.21.2.105:0/1013904769 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f750814fce0 0x7f7508150370 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 rx=0x7f74f800b000 tx=0x7f74f8009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:12.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.997+0000 7f7505ffb700 1 -- 172.21.2.105:0/1013904769 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74f80116e0 con 0x7f750814fce0 2021-11-12T05:50:12.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.997+0000 7f7505ffb700 1 -- 172.21.2.105:0/1013904769 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f8000e90 con 0x7f750814fce0 2021-11-12T05:50:12.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.997+0000 7f750daf7700 1 -- 172.21.2.105:0/1013904769 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f750805cac0 con 0x7f750814fce0 2021-11-12T05:50:12.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.997+0000 7f7505ffb700 1 -- 172.21.2.105:0/1013904769 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74f8011a30 con 0x7f750814fce0 2021-11-12T05:50:12.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.997+0000 7f750daf7700 1 -- 172.21.2.105:0/1013904769 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7508150d50 con 0x7f750814fce0 2021-11-12T05:50:12.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.997+0000 7f750daf7700 1 -- 172.21.2.105:0/1013904769 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f750813d3a0 con 0x7f750814fce0 2021-11-12T05:50:12.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.997+0000 7f7505ffb700 1 -- 172.21.2.105:0/1013904769 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f74f801a030 con 0x7f750814fce0 2021-11-12T05:50:12.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.997+0000 7f7505ffb700 1 --2- 172.21.2.105:0/1013904769 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f74e80534f0 0x7f74e80559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:12.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.997+0000 7f7505ffb700 1 -- 172.21.2.105:0/1013904769 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f74f806b2e0 con 0x7f750814fce0 2021-11-12T05:50:12.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.997+0000 7f750caf5700 1 --2- 172.21.2.105:0/1013904769 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f74e80534f0 0x7f74e80559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:12.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:11.997+0000 7f750caf5700 1 --2- 172.21.2.105:0/1013904769 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f74e80534f0 0x7f74e80559b0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7f75080b6140 tx=0x7f74fc013000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:12.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.001+0000 7f7505ffb700 1 -- 172.21.2.105:0/1013904769 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f74f80422f0 con 0x7f750814fce0 2021-11-12T05:50:12.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.109+0000 7f750daf7700 1 -- 172.21.2.105:0/1013904769 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75080af8a0 con 0x7f750814fce0 2021-11-12T05:50:12.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.109+0000 7f7505ffb700 1 -- 172.21.2.105:0/1013904769 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+2139 (secure 0 0 0) 0x7f74f8045910 con 0x7f750814fce0 2021-11-12T05:50:12.114 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:50:12.114 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":74,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5596,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/460551031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":460551031},{"type":"v1","addr":"172.21.2.115:6833","nonce":460551031}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":73}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:49:57.435843+0000","modified":"2021-11-12T05:49:58.439104+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8829},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8829":{"gid":8829,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.2.105:6835/4094714006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6834","nonce":4094714006},{"type":"v1","addr":"172.21.2.105:6835","nonce":4094714006}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-11-12T05:50:12.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.109+0000 7f750daf7700 1 -- 172.21.2.105:0/1013904769 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f74e80534f0 msgr2=0x7f74e80559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:12.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.109+0000 7f750daf7700 1 --2- 172.21.2.105:0/1013904769 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f74e80534f0 0x7f74e80559b0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7f75080b6140 tx=0x7f74fc013000).stop 2021-11-12T05:50:12.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.109+0000 7f750daf7700 1 -- 172.21.2.105:0/1013904769 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f750814fce0 msgr2=0x7f7508150370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:12.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.109+0000 7f750daf7700 1 --2- 172.21.2.105:0/1013904769 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f750814fce0 0x7f7508150370 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 rx=0x7f74f800b000 tx=0x7f74f8009040).stop 2021-11-12T05:50:12.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.109+0000 7f750daf7700 1 -- 172.21.2.105:0/1013904769 shutdown_connections 2021-11-12T05:50:12.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.109+0000 7f750daf7700 1 --2- 172.21.2.105:0/1013904769 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f74e80534f0 0x7f74e80559b0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:12.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.109+0000 7f750daf7700 1 --2- 172.21.2.105:0/1013904769 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7508066ca0 0x7f7508150860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:12.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.109+0000 7f750daf7700 1 --2- 172.21.2.105:0/1013904769 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f750814fce0 0x7f7508150370 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:12.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.109+0000 7f750daf7700 1 --2- 172.21.2.105:0/1013904769 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f74f4003750 0x7f750813e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:12.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.109+0000 7f750daf7700 1 -- 172.21.2.105:0/1013904769 >> 172.21.2.105:0/1013904769 conn(0x7f75080613f0 msgr2=0x7f75080b4130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:50:12.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.109+0000 7f750daf7700 1 -- 172.21.2.105:0/1013904769 shutdown_connections 2021-11-12T05:50:12.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.109+0000 7f750daf7700 1 -- 172.21.2.105:0/1013904769 wait complete. 2021-11-12T05:50:12.118 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 74 2021-11-12T05:50:12.121 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2021-11-12T05:50:12.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.169+0000 7f0a38659700 1 Processor -- start 2021-11-12T05:50:12.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.169+0000 7f0a38659700 1 -- start start 2021-11-12T05:50:12.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.169+0000 7f0a38659700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f0a3005f9f0 0x7f0a30141090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:12.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.169+0000 7f0a38659700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0a30141a10 0x7f0a300b3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:12.175 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.169+0000 7f0a38659700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a3005fdd0 con 0x7f0a30141580 2021-11-12T05:50:12.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.169+0000 7f0a38659700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a30144ee0 con 0x7f0a3005f9f0 2021-11-12T05:50:12.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.169+0000 7f0a38659700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a30145180 con 0x7f0a30141a10 2021-11-12T05:50:12.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.169+0000 7f0a363f5700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f0a3005f9f0 0x7f0a30141090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:12.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.169+0000 7f0a35bf4700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f0a30141580 0x7f0a300b2ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:35468/0 (socket says 172.21.2.105:35468) 2021-11-12T05:50:12.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.169+0000 7f0a35bf4700 1 -- 172.21.2.105:0/583622283 learned_addr learned my addr 172.21.2.105:0/583622283 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:50:12.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.169+0000 7f0a36bf6700 1 --2- 172.21.2.105:0/583622283 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0a30141a10 0x7f0a300b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:12.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.169+0000 7f0a363f5700 1 -- 172.21.2.105:0/583622283 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0a30141a10 msgr2=0x7f0a300b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:50:12.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.169+0000 7f0a363f5700 1 --2- 172.21.2.105:0/583622283 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0a30141a10 0x7f0a300b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:12.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.169+0000 7f0a363f5700 1 -- 172.21.2.105:0/583622283 >> v1:172.21.2.105:6789/0 conn(0x7f0a30141580 legacy=0x7f0a300b2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:12.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.169+0000 7f0a363f5700 1 -- 172.21.2.105:0/583622283 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a300afb10 con 0x7f0a3005f9f0 2021-11-12T05:50:12.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.169+0000 7f0a36bf6700 1 --2- 172.21.2.105:0/583622283 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0a30141a10 0x7f0a300b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:50:12.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.169+0000 7f0a363f5700 1 --2- 172.21.2.105:0/583622283 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a3005f9f0 0x7f0a30141090 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 rx=0x7f0a280032f0 tx=0x7f0a280091d0).ready entity=mon.0 client_cookie=924dd22f9d0f71d8 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:12.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.169+0000 7f0a353f3700 1 -- 172.21.2.105:0/583622283 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a28009ea0 con 0x7f0a3005f9f0 2021-11-12T05:50:12.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.169+0000 7f0a353f3700 1 -- 172.21.2.105:0/583622283 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2800b8a0 con 0x7f0a3005f9f0 2021-11-12T05:50:12.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.169+0000 7f0a353f3700 1 -- 172.21.2.105:0/583622283 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a2800ba10 con 0x7f0a3005f9f0 2021-11-12T05:50:12.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.169+0000 7f0a38659700 1 -- 172.21.2.105:0/583622283 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a3005f9f0 msgr2=0x7f0a30141090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:12.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.169+0000 7f0a38659700 1 --2- 172.21.2.105:0/583622283 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a3005f9f0 0x7f0a30141090 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 rx=0x7f0a280032f0 tx=0x7f0a280091d0).stop 2021-11-12T05:50:12.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.169+0000 7f0a38659700 1 -- 172.21.2.105:0/583622283 shutdown_connections 2021-11-12T05:50:12.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.169+0000 7f0a38659700 1 --2- 172.21.2.105:0/583622283 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0a30141a10 0x7f0a300b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:12.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.169+0000 7f0a38659700 1 --2- 172.21.2.105:0/583622283 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a3005f9f0 0x7f0a30141090 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:12.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.169+0000 7f0a38659700 1 -- 172.21.2.105:0/583622283 >> 172.21.2.105:0/583622283 conn(0x7f0a3005c490 msgr2=0x7f0a3005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:50:12.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.169+0000 7f0a38659700 1 -- 172.21.2.105:0/583622283 shutdown_connections 2021-11-12T05:50:12.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.169+0000 7f0a38659700 1 -- 172.21.2.105:0/583622283 wait complete. 2021-11-12T05:50:12.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.173+0000 7f0a38659700 1 Processor -- start 2021-11-12T05:50:12.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.173+0000 7f0a38659700 1 -- start start 2021-11-12T05:50:12.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.173+0000 7f0a38659700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0a3005f9f0 0x7f0a300b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:12.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.173+0000 7f0a38659700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a30141580 0x7f0a3013ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:12.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.173+0000 7f0a38659700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0a30141a10 0x7f0a3013d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:12.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.173+0000 7f0a38659700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a30110fc0 con 0x7f0a30141580 2021-11-12T05:50:12.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.173+0000 7f0a38659700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a30156900 con 0x7f0a30141a10 2021-11-12T05:50:12.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.173+0000 7f0a38659700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a301563f0 con 0x7f0a3005f9f0 2021-11-12T05:50:12.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.173+0000 7f0a35bf4700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a30141580 0x7f0a3013ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:12.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.173+0000 7f0a35bf4700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a30141580 0x7f0a3013ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53310/0 (socket says 172.21.2.105:53310) 2021-11-12T05:50:12.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.173+0000 7f0a35bf4700 1 -- 172.21.2.105:0/1974825742 learned_addr learned my addr 172.21.2.105:0/1974825742 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:50:12.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.173+0000 7f0a363f5700 1 --2- 172.21.2.105:0/1974825742 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0a3005f9f0 0x7f0a300b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:12.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.173+0000 7f0a36bf6700 1 --2- 172.21.2.105:0/1974825742 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0a30141a10 0x7f0a3013d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:12.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.173+0000 7f0a35bf4700 1 -- 172.21.2.105:0/1974825742 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0a3005f9f0 msgr2=0x7f0a300b33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:12.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.173+0000 7f0a35bf4700 1 --2- 172.21.2.105:0/1974825742 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0a3005f9f0 0x7f0a300b33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:12.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.173+0000 7f0a35bf4700 1 -- 172.21.2.105:0/1974825742 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0a30141a10 msgr2=0x7f0a3013d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:12.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.173+0000 7f0a35bf4700 1 --2- 172.21.2.105:0/1974825742 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0a30141a10 0x7f0a3013d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:12.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.173+0000 7f0a35bf4700 1 -- 172.21.2.105:0/1974825742 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a28009470 con 0x7f0a30141580 2021-11-12T05:50:12.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.173+0000 7f0a35bf4700 1 --2- 172.21.2.105:0/1974825742 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a30141580 0x7f0a3013ce70 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 rx=0x7f0a30156580 tx=0x7f0a20007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:12.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.173+0000 7f0a1f7fe700 1 -- 172.21.2.105:0/1974825742 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a200070d0 con 0x7f0a30141580 2021-11-12T05:50:12.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.173+0000 7f0a1f7fe700 1 -- 172.21.2.105:0/1974825742 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a20007230 con 0x7f0a30141580 2021-11-12T05:50:12.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.173+0000 7f0a1f7fe700 1 -- 172.21.2.105:0/1974825742 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a20005610 con 0x7f0a30141580 2021-11-12T05:50:12.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.173+0000 7f0a38659700 1 -- 172.21.2.105:0/1974825742 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a30156660 con 0x7f0a30141580 2021-11-12T05:50:12.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.173+0000 7f0a38659700 1 -- 172.21.2.105:0/1974825742 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a300ae9d0 con 0x7f0a30141580 2021-11-12T05:50:12.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.173+0000 7f0a38659700 1 -- 172.21.2.105:0/1974825742 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a3005cf80 con 0x7f0a30141580 2021-11-12T05:50:12.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.173+0000 7f0a1f7fe700 1 -- 172.21.2.105:0/1974825742 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0a20010070 con 0x7f0a30141580 2021-11-12T05:50:12.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.173+0000 7f0a1f7fe700 1 --2- 172.21.2.105:0/1974825742 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0a10053640 0x7f0a10055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:12.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.173+0000 7f0a1f7fe700 1 -- 172.21.2.105:0/1974825742 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6416+0+0 (secure 0 0 0) 0x7f0a2006b110 con 0x7f0a30141580 2021-11-12T05:50:12.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.173+0000 7f0a363f5700 1 --2- 172.21.2.105:0/1974825742 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0a10053640 0x7f0a10055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:12.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.173+0000 7f0a363f5700 1 --2- 172.21.2.105:0/1974825742 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0a10053640 0x7f0a10055b00 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f0a2801b000 tx=0x7f0a28016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:12.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.177+0000 7f0a1f7fe700 1 -- 172.21.2.105:0/1974825742 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0a20042010 con 0x7f0a30141580 2021-11-12T05:50:12.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:12.285+0000 7f0a38659700 1 -- 172.21.2.105:0/1974825742 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0a30140b60 con 0x7f0a30141580 2021-11-12T05:50:13.171 INFO:tasks.ceph.mon.a.gibba005.stderr:2021-11-12T05:50:13.169+0000 7fe9772b2700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-11-12T05:50:13.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.181+0000 7f0a1f7fe700 1 -- 172.21.2.105:0/1974825742 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v75) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0a20018070 con 0x7f0a30141580 2021-11-12T05:50:13.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.181+0000 7f0a38659700 1 -- 172.21.2.105:0/1974825742 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0a10053640 msgr2=0x7f0a10055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:13.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.181+0000 7f0a38659700 1 --2- 172.21.2.105:0/1974825742 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0a10053640 0x7f0a10055b00 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f0a2801b000 tx=0x7f0a28016000).stop 2021-11-12T05:50:13.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.181+0000 7f0a38659700 1 -- 172.21.2.105:0/1974825742 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a30141580 msgr2=0x7f0a3013ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:13.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.181+0000 7f0a38659700 1 --2- 172.21.2.105:0/1974825742 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a30141580 0x7f0a3013ce70 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 rx=0x7f0a30156580 tx=0x7f0a20007c40).stop 2021-11-12T05:50:13.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.181+0000 7f0a38659700 1 -- 172.21.2.105:0/1974825742 shutdown_connections 2021-11-12T05:50:13.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.181+0000 7f0a38659700 1 --2- 172.21.2.105:0/1974825742 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f0a10053640 0x7f0a10055b00 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:13.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.181+0000 7f0a38659700 1 --2- 172.21.2.105:0/1974825742 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0a30141a10 0x7f0a3013d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:13.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.181+0000 7f0a38659700 1 --2- 172.21.2.105:0/1974825742 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a30141580 0x7f0a3013ce70 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:13.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.181+0000 7f0a38659700 1 --2- 172.21.2.105:0/1974825742 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0a3005f9f0 0x7f0a300b33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:13.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.181+0000 7f0a38659700 1 -- 172.21.2.105:0/1974825742 >> 172.21.2.105:0/1974825742 conn(0x7f0a3005c490 msgr2=0x7f0a301477d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:50:13.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.181+0000 7f0a38659700 1 -- 172.21.2.105:0/1974825742 shutdown_connections 2021-11-12T05:50:13.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.181+0000 7f0a38659700 1 -- 172.21.2.105:0/1974825742 wait complete. 2021-11-12T05:50:13.188 INFO:teuthology.orchestra.run.gibba005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-11-12T05:50:13.192 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2021-11-12T05:50:13.196 INFO:tasks.ceph.mds.a.gibba005.stdout:starting mds.a at 2021-11-12T05:50:13.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.241+0000 7fd25e2eb700 1 Processor -- start 2021-11-12T05:50:13.244 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.241+0000 7fd25e2eb700 1 -- start start 2021-11-12T05:50:13.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.241+0000 7fd25e2eb700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd2580ad080 0x7fd2580af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:13.246 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.241+0000 7fd25e2eb700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd25814b2f0 0x7fd2580ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:13.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.241+0000 7fd25e2eb700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2580ac7b0 con 0x7fd2580ac280 2021-11-12T05:50:13.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.241+0000 7fd25e2eb700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2581488a0 con 0x7fd2580ad080 2021-11-12T05:50:13.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.241+0000 7fd25e2eb700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2580ac9e0 con 0x7fd25814b2f0 2021-11-12T05:50:13.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.241+0000 7fd2577fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fd2580ac280 0x7fd25814abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:35496/0 (socket says 172.21.2.105:35496) 2021-11-12T05:50:13.247 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.241+0000 7fd2577fe700 1 -- 172.21.2.105:0/891934212 learned_addr learned my addr 172.21.2.105:0/891934212 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:50:13.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.241+0000 7fd257fff700 1 --2- 172.21.2.105:0/891934212 >> v2:172.21.2.105:3300/0 conn(0x7fd2580ad080 0x7fd2580af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:13.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.241+0000 7fd257fff700 1 -- 172.21.2.105:0/891934212 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd25814b2f0 msgr2=0x7fd2580ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:50:13.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.241+0000 7fd257fff700 1 --2- 172.21.2.105:0/891934212 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd25814b2f0 0x7fd2580ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:13.248 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.241+0000 7fd257fff700 1 -- 172.21.2.105:0/891934212 >> v1:172.21.2.105:6789/0 conn(0x7fd2580ac280 legacy=0x7fd25814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:13.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.241+0000 7fd257fff700 1 -- 172.21.2.105:0/891934212 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2580b0b30 con 0x7fd2580ad080 2021-11-12T05:50:13.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.241+0000 7fd257fff700 1 --2- 172.21.2.105:0/891934212 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd2580ad080 0x7fd2580af730 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 rx=0x7fd240002f70 tx=0x7fd240006df0).ready entity=mon.0 client_cookie=7c5c6261b90e5e23 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:13.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.241+0000 7fd256ffd700 1 -- 172.21.2.105:0/891934212 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd24000d570 con 0x7fd2580ad080 2021-11-12T05:50:13.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.241+0000 7fd256ffd700 1 -- 172.21.2.105:0/891934212 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd240000e90 con 0x7fd2580ad080 2021-11-12T05:50:13.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.241+0000 7fd256ffd700 1 -- 172.21.2.105:0/891934212 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd24000d8c0 con 0x7fd2580ad080 2021-11-12T05:50:13.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.241+0000 7fd25e2eb700 1 -- 172.21.2.105:0/891934212 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd2580ad080 msgr2=0x7fd2580af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:13.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.241+0000 7fd25e2eb700 1 --2- 172.21.2.105:0/891934212 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd2580ad080 0x7fd2580af730 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 rx=0x7fd240002f70 tx=0x7fd240006df0).stop 2021-11-12T05:50:13.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.241+0000 7fd25e2eb700 1 -- 172.21.2.105:0/891934212 shutdown_connections 2021-11-12T05:50:13.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.241+0000 7fd25e2eb700 1 --2- 172.21.2.105:0/891934212 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd25814b2f0 0x7fd2580ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:13.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.241+0000 7fd25e2eb700 1 --2- 172.21.2.105:0/891934212 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd2580ad080 0x7fd2580af730 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:13.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.241+0000 7fd25e2eb700 1 -- 172.21.2.105:0/891934212 >> 172.21.2.105:0/891934212 conn(0x7fd2580b5370 msgr2=0x7fd2580b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:50:13.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.241+0000 7fd25e2eb700 1 -- 172.21.2.105:0/891934212 shutdown_connections 2021-11-12T05:50:13.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.241+0000 7fd25e2eb700 1 -- 172.21.2.105:0/891934212 wait complete. 2021-11-12T05:50:13.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.241+0000 7fd25e2eb700 1 Processor -- start 2021-11-12T05:50:13.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.241+0000 7fd25e2eb700 1 -- start start 2021-11-12T05:50:13.254 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.245+0000 7fd25e2eb700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd2580ac280 0x7fd2580ab4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:13.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.245+0000 7fd25e2eb700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd2580ad080 0x7fd2580a7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:13.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.245+0000 7fd25e2eb700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd25814b2f0 0x7fd2580a7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:13.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.245+0000 7fd25e2eb700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2580629c0 con 0x7fd2580ac280 2021-11-12T05:50:13.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.245+0000 7fd25e2eb700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2580aaa60 con 0x7fd25814b2f0 2021-11-12T05:50:13.255 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.245+0000 7fd25e2eb700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2580a98c0 con 0x7fd2580ad080 2021-11-12T05:50:13.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.245+0000 7fd257fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd2580ac280 0x7fd2580ab4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:13.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.245+0000 7fd257fff700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd2580ac280 0x7fd2580ab4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53334/0 (socket says 172.21.2.105:53334) 2021-11-12T05:50:13.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.245+0000 7fd257fff700 1 -- 172.21.2.105:0/1335517397 learned_addr learned my addr 172.21.2.105:0/1335517397 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:50:13.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.245+0000 7fd257fff700 1 -- 172.21.2.105:0/1335517397 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd2580ad080 msgr2=0x7fd2580a7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:13.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.245+0000 7fd257fff700 1 --2- 172.21.2.105:0/1335517397 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd2580ad080 0x7fd2580a7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:13.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.245+0000 7fd257fff700 1 -- 172.21.2.105:0/1335517397 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd25814b2f0 msgr2=0x7fd2580a7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:13.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.245+0000 7fd257fff700 1 --2- 172.21.2.105:0/1335517397 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd25814b2f0 0x7fd2580a7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:13.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.245+0000 7fd257fff700 1 -- 172.21.2.105:0/1335517397 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24000b180 con 0x7fd2580ac280 2021-11-12T05:50:13.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.245+0000 7fd257fff700 1 --2- 172.21.2.105:0/1335517397 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd2580ac280 0x7fd2580ab4f0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 rx=0x7fd240002f70 tx=0x7fd240015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:13.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.245+0000 7fd2557fa700 1 -- 172.21.2.105:0/1335517397 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd24000de40 con 0x7fd2580ac280 2021-11-12T05:50:13.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.245+0000 7fd2557fa700 1 -- 172.21.2.105:0/1335517397 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd240011ca0 con 0x7fd2580ac280 2021-11-12T05:50:13.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.245+0000 7fd25e2eb700 1 -- 172.21.2.105:0/1335517397 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2580a9b60 con 0x7fd2580ac280 2021-11-12T05:50:13.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.245+0000 7fd2557fa700 1 -- 172.21.2.105:0/1335517397 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd24001e460 con 0x7fd2580ac280 2021-11-12T05:50:13.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.245+0000 7fd25e2eb700 1 -- 172.21.2.105:0/1335517397 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2580640e0 con 0x7fd2580ac280 2021-11-12T05:50:13.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.245+0000 7fd25e2eb700 1 -- 172.21.2.105:0/1335517397 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd258064300 con 0x7fd2580ac280 2021-11-12T05:50:13.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.245+0000 7fd2557fa700 1 -- 172.21.2.105:0/1335517397 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd240025030 con 0x7fd2580ac280 2021-11-12T05:50:13.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.245+0000 7fd2557fa700 1 --2- 172.21.2.105:0/1335517397 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd23c053610 0x7fd23c055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:13.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.245+0000 7fd2557fa700 1 -- 172.21.2.105:0/1335517397 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6502+0+0 (secure 0 0 0) 0x7fd24006ce80 con 0x7fd2580ac280 2021-11-12T05:50:13.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.245+0000 7fd2577fe700 1 --2- 172.21.2.105:0/1335517397 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd23c053610 0x7fd23c055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:13.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.245+0000 7fd2577fe700 1 --2- 172.21.2.105:0/1335517397 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd23c053610 0x7fd23c055ad0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7fd2580b6060 tx=0x7fd248007800).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:13.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.249+0000 7fd2557fa700 1 -- 172.21.2.105:0/1335517397 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd240043d20 con 0x7fd2580ac280 2021-11-12T05:50:13.361 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.357+0000 7fd25e2eb700 1 -- 172.21.2.105:0/1335517397 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd2580b1440 con 0x7fd2580ac280 2021-11-12T05:50:13.362 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.357+0000 7fd2557fa700 1 -- 172.21.2.105:0/1335517397 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+1779 (secure 0 0 0) 0x7fd240023070 con 0x7fd2580ac280 2021-11-12T05:50:13.362 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T05:50:13.362 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":75,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5596,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.2.115:6833/460551031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6832","nonce":460551031},{"type":"v1","addr":"172.21.2.115:6833","nonce":460551031}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":73}],"filesystems":[{"mdsmap":{"epoch":75,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-11-12T05:49:57.435843+0000","modified":"2021-11-12T05:50:13.171473+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":157,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-11-12T05:50:13.363 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.357+0000 7fd25e2eb700 1 -- 172.21.2.105:0/1335517397 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd23c053610 msgr2=0x7fd23c055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:13.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.357+0000 7fd25e2eb700 1 --2- 172.21.2.105:0/1335517397 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd23c053610 0x7fd23c055ad0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7fd2580b6060 tx=0x7fd248007800).stop 2021-11-12T05:50:13.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.357+0000 7fd25e2eb700 1 -- 172.21.2.105:0/1335517397 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd2580ac280 msgr2=0x7fd2580ab4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:13.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.357+0000 7fd25e2eb700 1 --2- 172.21.2.105:0/1335517397 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd2580ac280 0x7fd2580ab4f0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 rx=0x7fd240002f70 tx=0x7fd240015000).stop 2021-11-12T05:50:13.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.357+0000 7fd25e2eb700 1 -- 172.21.2.105:0/1335517397 shutdown_connections 2021-11-12T05:50:13.364 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.357+0000 7fd25e2eb700 1 --2- 172.21.2.105:0/1335517397 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd23c053610 0x7fd23c055ad0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:13.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.357+0000 7fd25e2eb700 1 --2- 172.21.2.105:0/1335517397 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd25814b2f0 0x7fd2580a7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:13.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.357+0000 7fd25e2eb700 1 --2- 172.21.2.105:0/1335517397 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd2580ad080 0x7fd2580a7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:13.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.357+0000 7fd25e2eb700 1 --2- 172.21.2.105:0/1335517397 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd2580ac280 0x7fd2580ab4f0 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:13.365 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.357+0000 7fd25e2eb700 1 -- 172.21.2.105:0/1335517397 >> 172.21.2.105:0/1335517397 conn(0x7fd2580b5370 msgr2=0x7fd25814aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:50:13.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.357+0000 7fd25e2eb700 1 -- 172.21.2.105:0/1335517397 shutdown_connections 2021-11-12T05:50:13.366 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.357+0000 7fd25e2eb700 1 -- 172.21.2.105:0/1335517397 wait complete. 2021-11-12T05:50:13.366 INFO:teuthology.orchestra.run.gibba005.stderr:dumped fsmap epoch 75 2021-11-12T05:50:13.369 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2021-11-12T05:50:13.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.417+0000 7f4c9c2b7700 1 Processor -- start 2021-11-12T05:50:13.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.417+0000 7f4c9c2b7700 1 -- start start 2021-11-12T05:50:13.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.417+0000 7f4c9c2b7700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4c940b2290 0x7f4c940b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:13.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.417+0000 7f4c9c2b7700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c940aa0b0 con 0x7f4c940b2cc0 2021-11-12T05:50:13.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.417+0000 7f4c9c2b7700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c940a9b70 con 0x7f4c94143da0 2021-11-12T05:50:13.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.417+0000 7f4c9c2b7700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c940a9e10 con 0x7f4c940b2290 2021-11-12T05:50:13.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.417+0000 7f4c9a053700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f4c940b2cc0 0x7f4c94143690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:35506/0 (socket says 172.21.2.105:35506) 2021-11-12T05:50:13.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.417+0000 7f4c9a053700 1 -- 172.21.2.105:0/2720228605 learned_addr learned my addr 172.21.2.105:0/2720228605 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:50:13.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.417+0000 7f4c99051700 1 -- 172.21.2.105:0/2720228605 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 949358645 0 0) 0x7f4c940aa0b0 con 0x7f4c940b2cc0 2021-11-12T05:50:13.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.417+0000 7f4c99051700 1 -- 172.21.2.105:0/2720228605 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c7c003260 con 0x7f4c940b2cc0 2021-11-12T05:50:13.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.417+0000 7f4c99852700 1 --2- 172.21.2.105:0/2720228605 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4c940b2290 0x7f4c940b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:13.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.417+0000 7f4c99051700 1 -- 172.21.2.105:0/2720228605 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1209324792 0 0) 0x7f4c7c003260 con 0x7f4c940b2cc0 2021-11-12T05:50:13.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.417+0000 7f4c99051700 1 -- 172.21.2.105:0/2720228605 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4c940b2290 msgr2=0x7f4c940b30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:50:13.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.417+0000 7f4c99051700 1 --2- 172.21.2.105:0/2720228605 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4c940b2290 0x7f4c940b30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:13.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.417+0000 7f4c99051700 1 -- 172.21.2.105:0/2720228605 >> v1:172.21.2.115:6789/0 conn(0x7f4c94143da0 legacy=0x7f4c94140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:50:13.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.417+0000 7f4c99051700 1 -- 172.21.2.105:0/2720228605 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c940b0800 con 0x7f4c940b2cc0 2021-11-12T05:50:13.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.417+0000 7f4c99051700 1 -- 172.21.2.105:0/2720228605 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f4c84001660 con 0x7f4c940b2cc0 2021-11-12T05:50:13.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.417+0000 7f4c99051700 1 -- 172.21.2.105:0/2720228605 >> v1:172.21.2.105:6789/0 conn(0x7f4c940b2cc0 legacy=0x7f4c94143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:13.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.417+0000 7f4c99051700 1 --2- 172.21.2.105:0/2720228605 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4c7c003800 0x7f4c7c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:13.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.417+0000 7f4c99051700 1 --2- 172.21.2.105:0/2720228605 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4c7c004500 0x7f4c7c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:13.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.417+0000 7f4c99051700 1 --2- 172.21.2.105:0/2720228605 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4c7c005050 0x7f4c7c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:13.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.417+0000 7f4c99051700 1 -- 172.21.2.105:0/2720228605 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c940a9e10 con 0x7f4c7c003800 2021-11-12T05:50:13.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.417+0000 7f4c99051700 1 -- 172.21.2.105:0/2720228605 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c00beb0 con 0x7f4c7c004500 2021-11-12T05:50:13.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.417+0000 7f4c99051700 1 -- 172.21.2.105:0/2720228605 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c00e280 con 0x7f4c7c005050 2021-11-12T05:50:13.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.417+0000 7f4c99852700 1 --2- 172.21.2.105:0/2720228605 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4c940b2290 0x7f4c940b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:50:13.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.417+0000 7f4c9a053700 1 --2- 172.21.2.105:0/2720228605 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4c7c003800 0x7f4c7c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:13.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.417+0000 7f4c9a053700 1 -- 172.21.2.105:0/2720228605 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4c7c005050 msgr2=0x7f4c7c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:50:13.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.417+0000 7f4c9a053700 1 --2- 172.21.2.105:0/2720228605 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4c7c005050 0x7f4c7c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:13.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.417+0000 7f4c9a053700 1 -- 172.21.2.105:0/2720228605 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4c7c004500 msgr2=0x7f4c7c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T05:50:13.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.417+0000 7f4c9a053700 1 --2- 172.21.2.105:0/2720228605 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4c7c004500 0x7f4c7c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:13.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.421+0000 7f4c9a053700 1 -- 172.21.2.105:0/2720228605 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7c003260 con 0x7f4c7c003800 2021-11-12T05:50:13.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.421+0000 7f4c9a053700 1 --2- 172.21.2.105:0/2720228605 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4c7c003800 0x7f4c7c003c20 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 rx=0x7f4c84001370 tx=0x7f4c940a9d00).ready entity=mon.0 client_cookie=3b39ec6d42bb2034 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:13.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.421+0000 7f4c99051700 1 -- 172.21.2.105:0/2720228605 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c840070d0 con 0x7f4c7c003800 2021-11-12T05:50:13.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.421+0000 7f4c99051700 1 -- 172.21.2.105:0/2720228605 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c84007230 con 0x7f4c7c003800 2021-11-12T05:50:13.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.421+0000 7f4c99051700 1 -- 172.21.2.105:0/2720228605 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c8400c8f0 con 0x7f4c7c003800 2021-11-12T05:50:13.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.421+0000 7f4c9c2b7700 1 -- 172.21.2.105:0/2720228605 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4c7c003800 msgr2=0x7f4c7c003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:13.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.421+0000 7f4c9c2b7700 1 --2- 172.21.2.105:0/2720228605 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4c7c003800 0x7f4c7c003c20 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 rx=0x7f4c84001370 tx=0x7f4c940a9d00).stop 2021-11-12T05:50:13.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.421+0000 7f4c9a854700 1 -- 172.21.2.105:0/2720228605 reap_dead start 2021-11-12T05:50:13.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.421+0000 7f4c9c2b7700 1 -- 172.21.2.105:0/2720228605 shutdown_connections 2021-11-12T05:50:13.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.421+0000 7f4c9c2b7700 1 -- 172.21.2.105:0/2720228605 >> 172.21.2.105:0/2720228605 conn(0x7f4c9405c490 msgr2=0x7f4c9405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:50:13.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.421+0000 7f4c9c2b7700 1 -- 172.21.2.105:0/2720228605 shutdown_connections 2021-11-12T05:50:13.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.421+0000 7f4c9c2b7700 1 -- 172.21.2.105:0/2720228605 wait complete. 2021-11-12T05:50:13.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.421+0000 7f4c9c2b7700 1 Processor -- start 2021-11-12T05:50:13.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.421+0000 7f4c9c2b7700 1 -- start start 2021-11-12T05:50:13.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.421+0000 7f4c9c2b7700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4c7c003800 0x7f4c9409f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:13.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.421+0000 7f4c9c2b7700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4c94064e30 0x7f4c94063d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:13.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.421+0000 7f4c9c2b7700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4c9413d7a0 0x7f4c9413dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:13.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.421+0000 7f4c9c2b7700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c94065870 con 0x7f4c94064e30 2021-11-12T05:50:13.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.421+0000 7f4c9c2b7700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c94065b10 con 0x7f4c7c003800 2021-11-12T05:50:13.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.421+0000 7f4c9c2b7700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c94065db0 con 0x7f4c9413d7a0 2021-11-12T05:50:13.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.421+0000 7f4c99852700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4c94064e30 0x7f4c94063d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:13.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.421+0000 7f4c99852700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4c94064e30 0x7f4c94063d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53356/0 (socket says 172.21.2.105:53356) 2021-11-12T05:50:13.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.421+0000 7f4c99852700 1 -- 172.21.2.105:0/2081164100 learned_addr learned my addr 172.21.2.105:0/2081164100 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:50:13.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.421+0000 7f4c9a053700 1 --2- 172.21.2.105:0/2081164100 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4c7c003800 0x7f4c9409f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:13.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.421+0000 7f4c99852700 1 -- 172.21.2.105:0/2081164100 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4c9413d7a0 msgr2=0x7f4c9413dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:13.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.421+0000 7f4c99852700 1 --2- 172.21.2.105:0/2081164100 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4c9413d7a0 0x7f4c9413dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:13.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.421+0000 7f4c99852700 1 -- 172.21.2.105:0/2081164100 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4c7c003800 msgr2=0x7f4c9409f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:13.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.421+0000 7f4c99852700 1 --2- 172.21.2.105:0/2081164100 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4c7c003800 0x7f4c9409f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:13.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.421+0000 7f4c99852700 1 -- 172.21.2.105:0/2081164100 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c94065580 con 0x7f4c94064e30 2021-11-12T05:50:13.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.421+0000 7f4c9a053700 1 --2- 172.21.2.105:0/2081164100 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4c7c003800 0x7f4c9409f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T05:50:13.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.421+0000 7f4c99852700 1 --2- 172.21.2.105:0/2081164100 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4c94064e30 0x7f4c94063d50 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 rx=0x7f4c90000b60 tx=0x7f4c90008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:13.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.421+0000 7f4c837fe700 1 -- 172.21.2.105:0/2081164100 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c9000f4e0 con 0x7f4c94064e30 2021-11-12T05:50:13.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.421+0000 7f4c837fe700 1 -- 172.21.2.105:0/2081164100 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9000c030 con 0x7f4c94064e30 2021-11-12T05:50:13.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.421+0000 7f4c837fe700 1 -- 172.21.2.105:0/2081164100 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c9000f830 con 0x7f4c94064e30 2021-11-12T05:50:13.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.421+0000 7f4c9c2b7700 1 -- 172.21.2.105:0/2081164100 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c9413e120 con 0x7f4c94064e30 2021-11-12T05:50:13.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.421+0000 7f4c9c2b7700 1 -- 172.21.2.105:0/2081164100 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c94152020 con 0x7f4c94064e30 2021-11-12T05:50:13.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.421+0000 7f4c9c2b7700 1 -- 172.21.2.105:0/2081164100 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c94065f70 con 0x7f4c94064e30 2021-11-12T05:50:13.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.425+0000 7f4c837fe700 1 -- 172.21.2.105:0/2081164100 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f4c90019030 con 0x7f4c94064e30 2021-11-12T05:50:13.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.425+0000 7f4c837fe700 1 --2- 172.21.2.105:0/2081164100 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4c740536a0 0x7f4c74055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:13.443 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.425+0000 7f4c837fe700 1 -- 172.21.2.105:0/2081164100 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f4c9006b540 con 0x7f4c94064e30 2021-11-12T05:50:13.443 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.425+0000 7f4c9a053700 1 --2- 172.21.2.105:0/2081164100 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4c740536a0 0x7f4c74055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:13.443 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.425+0000 7f4c9a053700 1 --2- 172.21.2.105:0/2081164100 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4c740536a0 0x7f4c74055b60 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f4c84016000 tx=0x7f4c84015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:13.443 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.425+0000 7f4c837fe700 1 -- 172.21.2.105:0/2081164100 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4c900423e0 con 0x7f4c94064e30 2021-11-12T05:50:13.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:13.537+0000 7f4c9c2b7700 1 -- 172.21.2.105:0/2081164100 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4c94144230 con 0x7f4c94064e30 2021-11-12T05:50:14.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.193+0000 7f4c837fe700 1 -- 172.21.2.105:0/2081164100 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v76) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4c90045a00 con 0x7f4c94064e30 2021-11-12T05:50:14.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.193+0000 7f4c9c2b7700 1 -- 172.21.2.105:0/2081164100 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4c740536a0 msgr2=0x7f4c74055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:14.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.193+0000 7f4c9c2b7700 1 --2- 172.21.2.105:0/2081164100 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4c740536a0 0x7f4c74055b60 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f4c84016000 tx=0x7f4c84015000).stop 2021-11-12T05:50:14.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.193+0000 7f4c9c2b7700 1 -- 172.21.2.105:0/2081164100 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4c94064e30 msgr2=0x7f4c94063d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:14.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.193+0000 7f4c9c2b7700 1 --2- 172.21.2.105:0/2081164100 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4c94064e30 0x7f4c94063d50 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 rx=0x7f4c90000b60 tx=0x7f4c90008040).stop 2021-11-12T05:50:14.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.193+0000 7f4c9c2b7700 1 -- 172.21.2.105:0/2081164100 shutdown_connections 2021-11-12T05:50:14.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.193+0000 7f4c9c2b7700 1 --2- 172.21.2.105:0/2081164100 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f4c740536a0 0x7f4c74055b60 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:14.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.193+0000 7f4c9c2b7700 1 --2- 172.21.2.105:0/2081164100 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f4c9413d7a0 0x7f4c9413dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:14.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.193+0000 7f4c9c2b7700 1 --2- 172.21.2.105:0/2081164100 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f4c94064e30 0x7f4c94063d50 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:14.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.193+0000 7f4c9c2b7700 1 --2- 172.21.2.105:0/2081164100 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f4c7c003800 0x7f4c9409f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:14.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.193+0000 7f4c9c2b7700 1 -- 172.21.2.105:0/2081164100 >> 172.21.2.105:0/2081164100 conn(0x7f4c9405c490 msgr2=0x7f4c940afca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:50:14.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.193+0000 7f4c9c2b7700 1 -- 172.21.2.105:0/2081164100 shutdown_connections 2021-11-12T05:50:14.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.193+0000 7f4c9c2b7700 1 -- 172.21.2.105:0/2081164100 wait complete. 2021-11-12T05:50:14.205 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-11-12T05:50:14.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.253+0000 7f89f4919700 1 Processor -- start 2021-11-12T05:50:14.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.253+0000 7f89f4919700 1 -- start start 2021-11-12T05:50:14.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.253+0000 7f89f4919700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f89f014b2f0 0x7f89f00af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:14.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.253+0000 7f89f4919700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f00ac7b0 con 0x7f89f00ac280 2021-11-12T05:50:14.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.253+0000 7f89f4919700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f00ac9e0 con 0x7f89f00ad080 2021-11-12T05:50:14.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.253+0000 7f89f4919700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f01488a0 con 0x7f89f014b2f0 2021-11-12T05:50:14.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89eed9d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f89f014b2f0 0x7f89f00af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:14.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89edd9b700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f89f00ac280 0x7f89f0147a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:35530/0 (socket says 172.21.2.105:35530) 2021-11-12T05:50:14.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89edd9b700 1 -- 172.21.2.105:0/1610307887 learned_addr learned my addr 172.21.2.105:0/1610307887 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T05:50:14.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89eed9d700 1 -- 172.21.2.105:0/1610307887 >> v1:172.21.2.115:6789/0 conn(0x7f89f00ad080 legacy=0x7f89f014abe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:50:14.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89eed9d700 1 -- 172.21.2.105:0/1610307887 >> v1:172.21.2.105:6789/0 conn(0x7f89f00ac280 legacy=0x7f89f0147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:14.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89eed9d700 1 -- 172.21.2.105:0/1610307887 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f00b0b30 con 0x7f89f014b2f0 2021-11-12T05:50:14.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89eed9d700 1 --2- 172.21.2.105:0/1610307887 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89f014b2f0 0x7f89f00af730 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 rx=0x7f89f00ac6a0 tx=0x7f89e80091d0).ready entity=mon.0 client_cookie=5c7cb3338bc08cda server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:14.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89ed59a700 1 -- 172.21.2.105:0/1610307887 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89e8009ea0 con 0x7f89f014b2f0 2021-11-12T05:50:14.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89ed59a700 1 -- 172.21.2.105:0/1610307887 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e800b860 con 0x7f89f014b2f0 2021-11-12T05:50:14.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89ed59a700 1 -- 172.21.2.105:0/1610307887 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89e800b9d0 con 0x7f89f014b2f0 2021-11-12T05:50:14.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89f4919700 1 -- 172.21.2.105:0/1610307887 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89f014b2f0 msgr2=0x7f89f00af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:14.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89f4919700 1 --2- 172.21.2.105:0/1610307887 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89f014b2f0 0x7f89f00af730 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 rx=0x7f89f00ac6a0 tx=0x7f89e80091d0).stop 2021-11-12T05:50:14.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89f4919700 1 -- 172.21.2.105:0/1610307887 shutdown_connections 2021-11-12T05:50:14.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89f4919700 1 --2- 172.21.2.105:0/1610307887 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89f014b2f0 0x7f89f00af730 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:14.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89f4919700 1 -- 172.21.2.105:0/1610307887 >> 172.21.2.105:0/1610307887 conn(0x7f89f00b5370 msgr2=0x7f89f00b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:50:14.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89f4919700 1 -- 172.21.2.105:0/1610307887 shutdown_connections 2021-11-12T05:50:14.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89f4919700 1 -- 172.21.2.105:0/1610307887 wait complete. 2021-11-12T05:50:14.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89f4919700 1 Processor -- start 2021-11-12T05:50:14.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89f4919700 1 -- start start 2021-11-12T05:50:14.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89f4919700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f89f00ac280 0x7f89f00a9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:14.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89f4919700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f89f00ad080 0x7f89f0156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:14.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89f4919700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89f014b2f0 0x7f89f00a8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:14.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89f4919700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f01572f0 con 0x7f89f014b2f0 2021-11-12T05:50:14.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89f4919700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f0157590 con 0x7f89f00ac280 2021-11-12T05:50:14.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89f4919700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f0157830 con 0x7f89f00ad080 2021-11-12T05:50:14.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89eed9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89f014b2f0 0x7f89f00a8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:14.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89eed9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89f014b2f0 0x7f89f00a8030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53368/0 (socket says 172.21.2.105:53368) 2021-11-12T05:50:14.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89eed9d700 1 -- 172.21.2.105:0/550198684 learned_addr learned my addr 172.21.2.105:0/550198684 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:50:14.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89eed9d700 1 -- 172.21.2.105:0/550198684 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f89f00ad080 msgr2=0x7f89f0156c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:14.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89eed9d700 1 --2- 172.21.2.105:0/550198684 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f89f00ad080 0x7f89f0156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:14.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89eed9d700 1 -- 172.21.2.105:0/550198684 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f89f00ac280 msgr2=0x7f89f00a9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:14.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89eed9d700 1 --2- 172.21.2.105:0/550198684 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f89f00ac280 0x7f89f00a9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:14.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89eed9d700 1 -- 172.21.2.105:0/550198684 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e8009470 con 0x7f89f014b2f0 2021-11-12T05:50:14.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89eed9d700 1 --2- 172.21.2.105:0/550198684 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89f014b2f0 0x7f89f00a8030 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 rx=0x7f89f00ac6a0 tx=0x7f89e8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:14.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89df7fe700 1 -- 172.21.2.105:0/550198684 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89e8009ea0 con 0x7f89f014b2f0 2021-11-12T05:50:14.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89df7fe700 1 -- 172.21.2.105:0/550198684 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e801f5e0 con 0x7f89f014b2f0 2021-11-12T05:50:14.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89df7fe700 1 -- 172.21.2.105:0/550198684 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89e801f940 con 0x7f89f014b2f0 2021-11-12T05:50:14.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89f4919700 1 -- 172.21.2.105:0/550198684 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f00633c0 con 0x7f89f014b2f0 2021-11-12T05:50:14.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.257+0000 7f89f4919700 1 -- 172.21.2.105:0/550198684 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f00a8520 con 0x7f89f014b2f0 2021-11-12T05:50:14.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.261+0000 7f89f4919700 1 -- 172.21.2.105:0/550198684 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f0157140 con 0x7f89f014b2f0 2021-11-12T05:50:14.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.261+0000 7f89df7fe700 1 -- 172.21.2.105:0/550198684 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f89e8026030 con 0x7f89f014b2f0 2021-11-12T05:50:14.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.261+0000 7f89df7fe700 1 --2- 172.21.2.105:0/550198684 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f89cc0536a0 0x7f89cc055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:14.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.261+0000 7f89df7fe700 1 -- 172.21.2.105:0/550198684 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6502+0+0 (secure 0 0 0) 0x7f89e806c980 con 0x7f89f014b2f0 2021-11-12T05:50:14.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.261+0000 7f89ee59c700 1 --2- 172.21.2.105:0/550198684 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f89cc0536a0 0x7f89cc055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:14.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.261+0000 7f89ee59c700 1 --2- 172.21.2.105:0/550198684 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f89cc0536a0 0x7f89cc055b60 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f89e0002fb0 tx=0x7f89e00069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:14.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.261+0000 7f89df7fe700 1 -- 172.21.2.105:0/550198684 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f89e8043820 con 0x7f89f014b2f0 2021-11-12T05:50:14.349 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:14.345+0000 7f89f4919700 1 -- 172.21.2.105:0/550198684 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f89f01579f0 con 0x7f89f014b2f0 2021-11-12T05:50:15.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.197+0000 7f89df7fe700 1 -- 172.21.2.105:0/550198684 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v158) v1 ==== 185+0+0 (secure 0 0 0) 0x7f89e80150e0 con 0x7f89f014b2f0 2021-11-12T05:50:15.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.201+0000 7f89f4919700 1 -- 172.21.2.105:0/550198684 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f89cc0536a0 msgr2=0x7f89cc055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:15.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.201+0000 7f89f4919700 1 --2- 172.21.2.105:0/550198684 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f89cc0536a0 0x7f89cc055b60 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f89e0002fb0 tx=0x7f89e00069b0).stop 2021-11-12T05:50:15.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.201+0000 7f89f4919700 1 -- 172.21.2.105:0/550198684 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89f014b2f0 msgr2=0x7f89f00a8030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:15.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.201+0000 7f89f4919700 1 --2- 172.21.2.105:0/550198684 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89f014b2f0 0x7f89f00a8030 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 rx=0x7f89f00ac6a0 tx=0x7f89e8016000).stop 2021-11-12T05:50:15.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.201+0000 7f89f4919700 1 -- 172.21.2.105:0/550198684 shutdown_connections 2021-11-12T05:50:15.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.201+0000 7f89f4919700 1 --2- 172.21.2.105:0/550198684 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f89cc0536a0 0x7f89cc055b60 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:15.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.201+0000 7f89f4919700 1 --2- 172.21.2.105:0/550198684 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f89f014b2f0 0x7f89f00a8030 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:15.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.201+0000 7f89f4919700 1 --2- 172.21.2.105:0/550198684 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f89f00ad080 0x7f89f0156c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:15.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.201+0000 7f89f4919700 1 --2- 172.21.2.105:0/550198684 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f89f00ac280 0x7f89f00a9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:15.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.201+0000 7f89f4919700 1 -- 172.21.2.105:0/550198684 >> 172.21.2.105:0/550198684 conn(0x7f89f00b5370 msgr2=0x7f89f014aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:50:15.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.201+0000 7f89f4919700 1 -- 172.21.2.105:0/550198684 shutdown_connections 2021-11-12T05:50:15.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.201+0000 7f89f4919700 1 -- 172.21.2.105:0/550198684 wait complete. 2021-11-12T05:50:15.207 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_metadata' removed 2021-11-12T05:50:15.212 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-11-12T05:50:15.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.261+0000 7f9b8c7c6700 1 Processor -- start 2021-11-12T05:50:15.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.261+0000 7f9b8c7c6700 1 -- start start 2021-11-12T05:50:15.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.261+0000 7f9b8c7c6700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f9b840ac280 0x7f9b8414b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:15.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.261+0000 7f9b8c7c6700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f9b840af730 0x7f9b840ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:15.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.261+0000 7f9b8c7c6700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b840ac7b0 con 0x7f9b840ad080 2021-11-12T05:50:15.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.261+0000 7f9b8c7c6700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b841488a0 con 0x7f9b840ac280 2021-11-12T05:50:15.272 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.261+0000 7f9b8c7c6700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b840ac9e0 con 0x7f9b840af730 2021-11-12T05:50:15.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.261+0000 7f9b89d61700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f9b840ac280 0x7f9b8414b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:15.273 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.261+0000 7f9b89d61700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f9b840ac280 0x7f9b8414b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53380/0 (socket says 172.21.2.105:53380) 2021-11-12T05:50:15.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.261+0000 7f9b89d61700 1 -- 172.21.2.105:0/1413731416 learned_addr learned my addr 172.21.2.105:0/1413731416 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:50:15.274 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.261+0000 7f9b89d61700 1 -- 172.21.2.105:0/1413731416 >> v2:172.21.2.115:3300/0 conn(0x7f9b840af730 msgr2=0x7f9b840ad460 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:50:15.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.261+0000 7f9b89d61700 1 --2- 172.21.2.105:0/1413731416 >> v2:172.21.2.115:3300/0 conn(0x7f9b840af730 0x7f9b840ad460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:15.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.261+0000 7f9b89d61700 1 -- 172.21.2.105:0/1413731416 >> v1:172.21.2.115:6789/0 conn(0x7f9b840ad080 legacy=0x7f9b8414abe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T05:50:15.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.261+0000 7f9b89d61700 1 -- 172.21.2.105:0/1413731416 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b840b0b30 con 0x7f9b840ac280 2021-11-12T05:50:15.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.261+0000 7f9b89d61700 1 --2- 172.21.2.105:0/1413731416 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9b840ac280 0x7f9b8414b2f0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 rx=0x7f9b840b0eb0 tx=0x7f9b74006eb0).ready entity=mon.0 client_cookie=c3ad78f5d50df0ab server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:15.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.265+0000 7f9b89560700 1 -- 172.21.2.105:0/1413731416 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b7400d5c0 con 0x7f9b840ac280 2021-11-12T05:50:15.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.265+0000 7f9b89560700 1 -- 172.21.2.105:0/1413731416 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b74000e90 con 0x7f9b840ac280 2021-11-12T05:50:15.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.265+0000 7f9b89560700 1 -- 172.21.2.105:0/1413731416 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b7400d950 con 0x7f9b840ac280 2021-11-12T05:50:15.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.265+0000 7f9b8c7c6700 1 -- 172.21.2.105:0/1413731416 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9b840ac280 msgr2=0x7f9b8414b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:15.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.265+0000 7f9b8c7c6700 1 --2- 172.21.2.105:0/1413731416 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9b840ac280 0x7f9b8414b2f0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 rx=0x7f9b840b0eb0 tx=0x7f9b74006eb0).stop 2021-11-12T05:50:15.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.265+0000 7f9b8c7c6700 1 -- 172.21.2.105:0/1413731416 shutdown_connections 2021-11-12T05:50:15.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.265+0000 7f9b8c7c6700 1 --2- 172.21.2.105:0/1413731416 >> v2:172.21.2.115:3300/0 conn(0x7f9b840af730 0x7f9b840ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:15.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.265+0000 7f9b8c7c6700 1 --2- 172.21.2.105:0/1413731416 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9b840ac280 0x7f9b8414b2f0 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:15.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.265+0000 7f9b8c7c6700 1 -- 172.21.2.105:0/1413731416 >> 172.21.2.105:0/1413731416 conn(0x7f9b840b5370 msgr2=0x7f9b840b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:50:15.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.265+0000 7f9b8c7c6700 1 -- 172.21.2.105:0/1413731416 shutdown_connections 2021-11-12T05:50:15.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.265+0000 7f9b8c7c6700 1 -- 172.21.2.105:0/1413731416 wait complete. 2021-11-12T05:50:15.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.265+0000 7f9b8c7c6700 1 Processor -- start 2021-11-12T05:50:15.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.265+0000 7f9b8c7c6700 1 -- start start 2021-11-12T05:50:15.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.265+0000 7f9b8c7c6700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9b840ac280 0x7f9b8415a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:15.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.265+0000 7f9b8c7c6700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9b840ad080 0x7f9b840aa530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:15.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.265+0000 7f9b8c7c6700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9b840af730 0x7f9b84064540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:15.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.265+0000 7f9b8c7c6700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8414aaf0 con 0x7f9b840ac280 2021-11-12T05:50:15.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.265+0000 7f9b8c7c6700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8414ad90 con 0x7f9b840af730 2021-11-12T05:50:15.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.265+0000 7f9b8c7c6700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8414b030 con 0x7f9b840ad080 2021-11-12T05:50:15.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.265+0000 7f9b8a562700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9b840ac280 0x7f9b8415a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:15.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.265+0000 7f9b8a562700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9b840ac280 0x7f9b8415a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53382/0 (socket says 172.21.2.105:53382) 2021-11-12T05:50:15.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.265+0000 7f9b8a562700 1 -- 172.21.2.105:0/3757754341 learned_addr learned my addr 172.21.2.105:0/3757754341 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T05:50:15.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.265+0000 7f9b8a562700 1 -- 172.21.2.105:0/3757754341 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9b840ad080 msgr2=0x7f9b840aa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:15.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.265+0000 7f9b8a562700 1 --2- 172.21.2.105:0/3757754341 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9b840ad080 0x7f9b840aa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:15.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.265+0000 7f9b8a562700 1 -- 172.21.2.105:0/3757754341 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9b840af730 msgr2=0x7f9b84064540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:15.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.265+0000 7f9b8a562700 1 --2- 172.21.2.105:0/3757754341 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9b840af730 0x7f9b84064540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:15.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.265+0000 7f9b8a562700 1 -- 172.21.2.105:0/3757754341 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b7400b1e0 con 0x7f9b840ac280 2021-11-12T05:50:15.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.265+0000 7f9b8a562700 1 --2- 172.21.2.105:0/3757754341 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9b840ac280 0x7f9b8415a320 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 rx=0x7f9b80002fb0 tx=0x7f9b80006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:15.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.265+0000 7f9b737fe700 1 -- 172.21.2.105:0/3757754341 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b80013460 con 0x7f9b840ac280 2021-11-12T05:50:15.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.265+0000 7f9b737fe700 1 -- 172.21.2.105:0/3757754341 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b800135c0 con 0x7f9b840ac280 2021-11-12T05:50:15.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.265+0000 7f9b8c7c6700 1 -- 172.21.2.105:0/3757754341 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b840aaff0 con 0x7f9b840ac280 2021-11-12T05:50:15.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.265+0000 7f9b737fe700 1 -- 172.21.2.105:0/3757754341 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b80013920 con 0x7f9b840ac280 2021-11-12T05:50:15.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.265+0000 7f9b8c7c6700 1 -- 172.21.2.105:0/3757754341 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b840627d0 con 0x7f9b840ac280 2021-11-12T05:50:15.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.265+0000 7f9b8c7c6700 1 -- 172.21.2.105:0/3757754341 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b8414b1f0 con 0x7f9b840ac280 2021-11-12T05:50:15.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.265+0000 7f9b737fe700 1 -- 172.21.2.105:0/3757754341 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9b8000f070 con 0x7f9b840ac280 2021-11-12T05:50:15.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.269+0000 7f9b737fe700 1 --2- 172.21.2.105:0/3757754341 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9b64053610 0x7f9b64055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T05:50:15.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.269+0000 7f9b737fe700 1 -- 172.21.2.105:0/3757754341 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6064+0+0 (secure 0 0 0) 0x7f9b8006b0d0 con 0x7f9b840ac280 2021-11-12T05:50:15.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.269+0000 7f9b89d61700 1 --2- 172.21.2.105:0/3757754341 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9b64053610 0x7f9b64055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T05:50:15.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.269+0000 7f9b89d61700 1 --2- 172.21.2.105:0/3757754341 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9b64053610 0x7f9b64055ad0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f9b840b0eb0 tx=0x7f9b74015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T05:50:15.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.269+0000 7f9b737fe700 1 -- 172.21.2.105:0/3757754341 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9b80042240 con 0x7f9b840ac280 2021-11-12T05:50:15.356 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:15.353+0000 7f9b8c7c6700 1 -- 172.21.2.105:0/3757754341 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9b840b1440 con 0x7f9b840ac280 2021-11-12T05:50:16.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:16.209+0000 7f9b737fe700 1 -- 172.21.2.105:0/3757754341 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v159) v1 ==== 173+0+0 (secure 0 0 0) 0x7f9b80018030 con 0x7f9b840ac280 2021-11-12T05:50:16.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:16.209+0000 7f9b8c7c6700 1 -- 172.21.2.105:0/3757754341 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9b64053610 msgr2=0x7f9b64055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:16.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:16.209+0000 7f9b8c7c6700 1 --2- 172.21.2.105:0/3757754341 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9b64053610 0x7f9b64055ad0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f9b840b0eb0 tx=0x7f9b74015000).stop 2021-11-12T05:50:16.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:16.209+0000 7f9b8c7c6700 1 -- 172.21.2.105:0/3757754341 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9b840ac280 msgr2=0x7f9b8415a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T05:50:16.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:16.209+0000 7f9b8c7c6700 1 --2- 172.21.2.105:0/3757754341 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9b840ac280 0x7f9b8415a320 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 rx=0x7f9b80002fb0 tx=0x7f9b80006df0).stop 2021-11-12T05:50:16.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:16.209+0000 7f9b8c7c6700 1 -- 172.21.2.105:0/3757754341 shutdown_connections 2021-11-12T05:50:16.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:16.209+0000 7f9b8c7c6700 1 --2- 172.21.2.105:0/3757754341 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9b64053610 0x7f9b64055ad0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:16.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:16.209+0000 7f9b8c7c6700 1 --2- 172.21.2.105:0/3757754341 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9b840af730 0x7f9b84064540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:16.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:16.209+0000 7f9b8c7c6700 1 --2- 172.21.2.105:0/3757754341 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9b840ad080 0x7f9b840aa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T05:50:16.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:16.209+0000 7f9b8c7c6700 1 --2- 172.21.2.105:0/3757754341 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9b840ac280 0x7f9b8415a320 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T05:50:16.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:16.209+0000 7f9b8c7c6700 1 -- 172.21.2.105:0/3757754341 >> 172.21.2.105:0/3757754341 conn(0x7f9b840b5370 msgr2=0x7f9b84060700 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T05:50:16.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:16.209+0000 7f9b8c7c6700 1 -- 172.21.2.105:0/3757754341 shutdown_connections 2021-11-12T05:50:16.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T05:50:16.209+0000 7f9b8c7c6700 1 -- 172.21.2.105:0/3757754341 wait complete. 2021-11-12T05:50:16.217 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'cephfs_data' removed 2021-11-12T05:50:16.221 INFO:teuthology.orchestra.run:Running command with timeout 60 2021-11-12T05:50:16.221 DEBUG:teuthology.orchestra.run.gibba016:> cd /home/ubuntu/cephtest/mnt.0 && sudo bash -c 'stat -f .' 2021-11-12T05:50:25.398 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:50:25.402 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:50:25.406 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:50:25.409 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:50:25.412 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:50:46.326 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T05:50:46.327 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T05:50:46.327 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T05:50:55.464 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:50:55.468 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:50:55.471 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:50:55.475 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:50:55.478 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:51:16.229 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-11-12T05:51:16.231 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2021-11-12T05:51:25.525 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:51:25.528 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:51:25.532 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:51:25.536 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:51:25.539 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:51:55.585 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:51:55.589 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:51:55.592 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:51:55.595 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:51:55.599 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:52:25.643 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:52:25.646 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:52:25.650 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:52:25.653 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:52:25.656 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:52:55.702 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:52:55.706 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:52:55.710 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:52:55.713 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:52:55.717 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:53:25.774 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:53:25.778 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:53:25.780 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:53:25.784 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:53:25.787 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:53:55.851 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:53:55.855 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:53:55.859 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:53:55.862 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:53:55.866 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:54:25.904 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:54:25.909 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:54:25.913 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:54:25.916 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:54:25.919 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:54:55.980 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:54:55.985 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:54:55.988 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:54:55.991 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:54:55.995 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:55:26.040 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:55:26.047 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:55:26.051 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:55:26.054 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:55:26.059 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:55:56.131 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:55:56.135 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:55:56.138 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:55:56.142 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:55:56.145 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:56:26.190 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:56:26.194 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:56:26.197 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:56:26.200 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:56:26.204 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:56:56.251 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:56:56.255 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:56:56.258 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:56:56.261 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:56:56.265 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:57:26.341 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:57:26.345 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:57:26.348 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:57:26.351 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:57:26.355 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:57:56.402 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:57:56.406 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:57:56.409 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:57:56.413 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:57:56.416 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:58:26.462 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:58:26.466 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:58:26.469 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:58:26.472 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:58:26.476 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:58:56.588 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:58:56.592 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:58:56.596 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:58:56.599 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:58:56.603 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:59:26.672 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:59:26.676 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:59:26.679 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:59:26.683 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:59:26.686 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:59:56.747 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:59:56.751 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:59:56.755 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:59:56.758 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T05:59:56.762 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:00:26.835 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:00:26.839 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:00:26.842 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:00:26.846 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:00:26.849 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:00:56.900 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:00:56.905 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:00:56.908 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:00:56.911 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:00:56.915 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:01:26.959 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:01:26.964 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:01:26.967 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:01:26.970 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:01:26.974 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:01:57.018 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:01:57.022 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:01:57.025 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:01:57.028 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:01:57.032 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:02:27.076 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:02:27.081 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:02:27.084 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:02:27.087 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:02:27.090 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:02:57.136 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:02:57.140 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:02:57.143 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:02:57.146 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:02:57.151 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:03:27.195 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:03:27.199 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:03:27.202 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:03:27.206 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:03:27.209 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:03:57.272 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:03:57.276 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:03:57.280 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:03:57.283 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:03:57.287 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:04:27.340 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:04:27.344 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:04:27.347 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:04:27.350 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:04:27.353 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:04:57.423 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:04:57.427 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:04:57.431 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:04:57.434 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:04:57.438 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:05:27.482 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:05:27.485 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:05:27.488 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:05:27.492 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:05:27.495 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:05:46.332 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-11-12T06:05:46.333 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2021-11-12T06:05:46.340 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T06:05:46.342 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-11-12T06:05:46.343 DEBUG:teuthology.orchestra.run.gibba005:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T06:05:46.356 DEBUG:teuthology.orchestra.run.gibba015:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T06:05:46.370 DEBUG:teuthology.orchestra.run.gibba016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T06:05:46.383 DEBUG:teuthology.orchestra.run.gibba038:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T06:05:46.396 DEBUG:teuthology.orchestra.run.gibba044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-11-12T06:05:46.409 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-11-12T06:05:46.410 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T06:05:46.410 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T06:05:46.411 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T06:05:57.575 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:05:57.579 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:05:57.581 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:05:57.585 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:05:57.588 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:06:27.634 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:06:27.638 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:06:27.641 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:06:27.644 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:06:27.648 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:06:57.694 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:06:57.698 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:06:57.702 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:06:57.705 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:06:57.708 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:07:27.752 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:07:27.756 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:07:27.760 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:07:27.763 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:07:27.767 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:07:57.811 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:07:57.815 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:07:57.819 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:07:57.822 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:07:57.825 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:08:27.870 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:08:27.873 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:08:27.876 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:08:27.880 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:08:27.883 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:08:57.950 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:08:57.954 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:08:57.957 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:08:57.960 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:08:57.964 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:09:28.013 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:09:28.017 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:09:28.019 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:09:28.023 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:09:28.026 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:09:58.098 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:09:58.102 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:09:58.105 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:09:58.109 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:09:58.112 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:10:28.156 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:10:28.161 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:10:28.164 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:10:28.168 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:10:28.171 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:10:58.221 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:10:58.225 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:10:58.228 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:10:58.232 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:10:58.235 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:11:28.283 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:11:28.288 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:11:28.292 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:11:28.297 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:11:28.300 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:11:58.348 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:11:58.352 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:11:58.356 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:11:58.359 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:11:58.363 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:12:28.416 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:12:28.420 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:12:28.423 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:12:28.427 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:12:28.431 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:12:58.474 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:12:58.478 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:12:58.482 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:12:58.485 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:12:58.489 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:13:28.534 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:13:28.537 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:13:28.541 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:13:28.544 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:13:28.547 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:13:58.604 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:13:58.608 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:13:58.611 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:13:58.614 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:13:58.618 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:14:28.688 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:14:28.692 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:14:28.695 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:14:28.699 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:14:28.702 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:14:58.769 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:14:58.773 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:14:58.777 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:14:58.780 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:14:58.784 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:15:28.839 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:15:28.843 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:15:28.846 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:15:28.850 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:15:28.853 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:15:58.915 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:15:58.919 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:15:58.922 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:15:58.926 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:15:58.929 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:16:28.983 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:16:28.987 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:16:28.990 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:16:28.994 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:16:28.997 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:16:59.049 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:16:59.053 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:16:59.056 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:16:59.060 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:16:59.063 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:17:29.205 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:17:29.209 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:17:29.212 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:17:29.215 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:17:29.218 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:17:59.270 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:17:59.274 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:17:59.278 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:17:59.281 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:17:59.284 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:18:29.335 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:18:29.340 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:18:29.344 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:18:29.348 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:18:29.352 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:18:59.445 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:18:59.449 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:18:59.452 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:18:59.456 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:18:59.459 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:19:29.504 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:19:29.508 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:19:29.512 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:19:29.516 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:19:29.519 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:19:59.628 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:19:59.632 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:19:59.635 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:19:59.639 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:19:59.642 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:20:29.715 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:20:29.721 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:20:29.725 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:20:29.729 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:20:29.733 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:20:46.414 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-11-12T06:20:46.416 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2021-11-12T06:20:46.421 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T06:20:46.425 INFO:tasks.cephfs_test_runner:test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) ... ERROR 2021-11-12T06:20:46.426 INFO:tasks.cephfs_test_runner:ERROR 2021-11-12T06:20:46.427 INFO:tasks.cephfs_test_runner: 2021-11-12T06:20:46.427 INFO:tasks.cephfs_test_runner:====================================================================== 2021-11-12T06:20:46.427 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-11-12T06:20:46.428 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-11-12T06:20:46.428 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-11-12T06:20:46.428 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2021-11-12T06:20:46.429 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2021-11-12T06:20:46.429 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2021-11-12T06:20:46.429 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2021-11-12T06:20:46.430 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2021-11-12T06:20:46.430 INFO:tasks.cephfs_test_runner: 2021-11-12T06:20:46.430 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2021-11-12T06:20:46.430 INFO:tasks.cephfs_test_runner: 2021-11-12T06:20:46.431 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-11-12T06:20:46.431 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_a81ee2815de5acae59ead5b8c9137b6766fc8ea8/qa/tasks/cephfs/test_misc.py", line 28, in test_statfs_on_deleted_fs 2021-11-12T06:20:46.431 INFO:tasks.cephfs_test_runner: self.mount_a.umount_wait(force=True) 2021-11-12T06:20:46.432 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_a81ee2815de5acae59ead5b8c9137b6766fc8ea8/qa/tasks/cephfs/fuse_mount.py", line 326, in umount_wait 2021-11-12T06:20:46.432 INFO:tasks.cephfs_test_runner: if not (self.is_mounted() and self.fuse_daemon): 2021-11-12T06:20:46.432 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_a81ee2815de5acae59ead5b8c9137b6766fc8ea8/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2021-11-12T06:20:46.433 INFO:tasks.cephfs_test_runner: proc.wait() 2021-11-12T06:20:46.433 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/orchestra/run.py", line 148, in wait 2021-11-12T06:20:46.433 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2021-11-12T06:20:46.434 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get 2021-11-12T06:20:46.434 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2021-11-12T06:20:46.434 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise 2021-11-12T06:20:46.435 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2021-11-12T06:20:46.435 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run 2021-11-12T06:20:46.435 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/orchestra/run.py", line 323, in copy_file_to 2021-11-12T06:20:46.436 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2021-11-12T06:20:46.436 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/orchestra/run.py", line 276, in copy_to_log 2021-11-12T06:20:46.436 INFO:tasks.cephfs_test_runner: for line in f: 2021-11-12T06:20:46.437 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2021-11-12T06:20:46.437 INFO:tasks.cephfs_test_runner: line = self.readline() 2021-11-12T06:20:46.437 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2021-11-12T06:20:46.438 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2021-11-12T06:20:46.438 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2021-11-12T06:20:46.438 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2021-11-12T06:20:46.439 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2021-11-12T06:20:46.439 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2021-11-12T06:20:46.439 INFO:tasks.cephfs_test_runner:socket.timeout 2021-11-12T06:20:46.440 INFO:tasks.cephfs_test_runner: 2021-11-12T06:20:46.440 INFO:tasks.cephfs_test_runner:====================================================================== 2021-11-12T06:20:46.441 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-11-12T06:20:46.441 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-11-12T06:20:46.441 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-11-12T06:20:46.442 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2021-11-12T06:20:46.442 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2021-11-12T06:20:46.442 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2021-11-12T06:20:46.443 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2021-11-12T06:20:46.443 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2021-11-12T06:20:46.443 INFO:tasks.cephfs_test_runner: 2021-11-12T06:20:46.444 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2021-11-12T06:20:46.444 INFO:tasks.cephfs_test_runner: 2021-11-12T06:20:46.444 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-11-12T06:20:46.445 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_a81ee2815de5acae59ead5b8c9137b6766fc8ea8/qa/tasks/cephfs/cephfs_test_case.py", line 175, in tearDown 2021-11-12T06:20:46.445 INFO:tasks.cephfs_test_runner: m.teardown() 2021-11-12T06:20:46.445 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_a81ee2815de5acae59ead5b8c9137b6766fc8ea8/qa/tasks/cephfs/fuse_mount.py", line 408, in teardown 2021-11-12T06:20:46.446 INFO:tasks.cephfs_test_runner: self.umount() 2021-11-12T06:20:46.446 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_a81ee2815de5acae59ead5b8c9137b6766fc8ea8/qa/tasks/cephfs/fuse_mount.py", line 261, in umount 2021-11-12T06:20:46.446 INFO:tasks.cephfs_test_runner: if not self.is_mounted(): 2021-11-12T06:20:46.446 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_a81ee2815de5acae59ead5b8c9137b6766fc8ea8/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2021-11-12T06:20:46.447 INFO:tasks.cephfs_test_runner: proc.wait() 2021-11-12T06:20:46.447 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/orchestra/run.py", line 148, in wait 2021-11-12T06:20:46.448 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2021-11-12T06:20:46.448 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get 2021-11-12T06:20:46.448 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2021-11-12T06:20:46.448 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise 2021-11-12T06:20:46.449 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2021-11-12T06:20:46.449 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run 2021-11-12T06:20:46.449 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/orchestra/run.py", line 323, in copy_file_to 2021-11-12T06:20:46.450 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2021-11-12T06:20:46.450 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/orchestra/run.py", line 276, in copy_to_log 2021-11-12T06:20:46.451 INFO:tasks.cephfs_test_runner: for line in f: 2021-11-12T06:20:46.451 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2021-11-12T06:20:46.451 INFO:tasks.cephfs_test_runner: line = self.readline() 2021-11-12T06:20:46.451 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2021-11-12T06:20:46.452 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2021-11-12T06:20:46.452 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2021-11-12T06:20:46.452 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2021-11-12T06:20:46.453 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2021-11-12T06:20:46.453 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2021-11-12T06:20:46.453 INFO:tasks.cephfs_test_runner:socket.timeout 2021-11-12T06:20:46.454 INFO:tasks.cephfs_test_runner: 2021-11-12T06:20:46.454 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-11-12T06:20:46.454 INFO:tasks.cephfs_test_runner:Ran 12 tests in 2390.361s 2021-11-12T06:20:46.455 INFO:tasks.cephfs_test_runner: 2021-11-12T06:20:46.455 INFO:tasks.cephfs_test_runner:FAILED (errors=2) 2021-11-12T06:20:46.456 INFO:tasks.cephfs_test_runner: 2021-11-12T06:20:46.456 INFO:tasks.cephfs_test_runner:====================================================================== 2021-11-12T06:20:46.456 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-11-12T06:20:46.457 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-11-12T06:20:46.457 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-11-12T06:20:46.457 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2021-11-12T06:20:46.458 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2021-11-12T06:20:46.458 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2021-11-12T06:20:46.458 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2021-11-12T06:20:46.459 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2021-11-12T06:20:46.459 INFO:tasks.cephfs_test_runner: 2021-11-12T06:20:46.459 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2021-11-12T06:20:46.459 INFO:tasks.cephfs_test_runner: 2021-11-12T06:20:46.460 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-11-12T06:20:46.460 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_a81ee2815de5acae59ead5b8c9137b6766fc8ea8/qa/tasks/cephfs/test_misc.py", line 28, in test_statfs_on_deleted_fs 2021-11-12T06:20:46.460 INFO:tasks.cephfs_test_runner: self.mount_a.umount_wait(force=True) 2021-11-12T06:20:46.461 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_a81ee2815de5acae59ead5b8c9137b6766fc8ea8/qa/tasks/cephfs/fuse_mount.py", line 326, in umount_wait 2021-11-12T06:20:46.461 INFO:tasks.cephfs_test_runner: if not (self.is_mounted() and self.fuse_daemon): 2021-11-12T06:20:46.461 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_a81ee2815de5acae59ead5b8c9137b6766fc8ea8/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2021-11-12T06:20:46.462 INFO:tasks.cephfs_test_runner: proc.wait() 2021-11-12T06:20:46.462 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/orchestra/run.py", line 148, in wait 2021-11-12T06:20:46.462 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2021-11-12T06:20:46.463 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get 2021-11-12T06:20:46.463 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2021-11-12T06:20:46.463 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise 2021-11-12T06:20:46.464 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2021-11-12T06:20:46.464 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run 2021-11-12T06:20:46.464 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/orchestra/run.py", line 323, in copy_file_to 2021-11-12T06:20:46.465 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2021-11-12T06:20:46.465 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/orchestra/run.py", line 276, in copy_to_log 2021-11-12T06:20:46.465 INFO:tasks.cephfs_test_runner: for line in f: 2021-11-12T06:20:46.466 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2021-11-12T06:20:46.466 INFO:tasks.cephfs_test_runner: line = self.readline() 2021-11-12T06:20:46.466 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2021-11-12T06:20:46.467 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2021-11-12T06:20:46.467 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2021-11-12T06:20:46.467 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2021-11-12T06:20:46.468 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2021-11-12T06:20:46.468 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2021-11-12T06:20:46.468 INFO:tasks.cephfs_test_runner:socket.timeout 2021-11-12T06:20:46.469 INFO:tasks.cephfs_test_runner: 2021-11-12T06:20:46.469 INFO:tasks.cephfs_test_runner:====================================================================== 2021-11-12T06:20:46.469 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-11-12T06:20:46.469 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-11-12T06:20:46.470 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-11-12T06:20:46.470 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2021-11-12T06:20:46.471 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2021-11-12T06:20:46.471 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2021-11-12T06:20:46.472 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2021-11-12T06:20:46.472 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2021-11-12T06:20:46.473 INFO:tasks.cephfs_test_runner: 2021-11-12T06:20:46.473 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2021-11-12T06:20:46.474 INFO:tasks.cephfs_test_runner: 2021-11-12T06:20:46.474 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-11-12T06:20:46.475 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_a81ee2815de5acae59ead5b8c9137b6766fc8ea8/qa/tasks/cephfs/cephfs_test_case.py", line 175, in tearDown 2021-11-12T06:20:46.475 INFO:tasks.cephfs_test_runner: m.teardown() 2021-11-12T06:20:46.481 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_a81ee2815de5acae59ead5b8c9137b6766fc8ea8/qa/tasks/cephfs/fuse_mount.py", line 408, in teardown 2021-11-12T06:20:46.482 INFO:tasks.cephfs_test_runner: self.umount() 2021-11-12T06:20:46.482 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_a81ee2815de5acae59ead5b8c9137b6766fc8ea8/qa/tasks/cephfs/fuse_mount.py", line 261, in umount 2021-11-12T06:20:46.483 INFO:tasks.cephfs_test_runner: if not self.is_mounted(): 2021-11-12T06:20:46.483 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_a81ee2815de5acae59ead5b8c9137b6766fc8ea8/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2021-11-12T06:20:46.483 INFO:tasks.cephfs_test_runner: proc.wait() 2021-11-12T06:20:46.484 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/orchestra/run.py", line 148, in wait 2021-11-12T06:20:46.484 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2021-11-12T06:20:46.485 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get 2021-11-12T06:20:46.485 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2021-11-12T06:20:46.486 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise 2021-11-12T06:20:46.486 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2021-11-12T06:20:46.487 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run 2021-11-12T06:20:46.487 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/orchestra/run.py", line 323, in copy_file_to 2021-11-12T06:20:46.488 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2021-11-12T06:20:46.488 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/orchestra/run.py", line 276, in copy_to_log 2021-11-12T06:20:46.488 INFO:tasks.cephfs_test_runner: for line in f: 2021-11-12T06:20:46.488 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2021-11-12T06:20:46.489 INFO:tasks.cephfs_test_runner: line = self.readline() 2021-11-12T06:20:46.489 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2021-11-12T06:20:46.489 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2021-11-12T06:20:46.489 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2021-11-12T06:20:46.490 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2021-11-12T06:20:46.490 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2021-11-12T06:20:46.491 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2021-11-12T06:20:46.491 INFO:tasks.cephfs_test_runner:socket.timeout 2021-11-12T06:20:46.491 INFO:tasks.cephfs_test_runner: 2021-11-12T06:20:46.492 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/run_tasks.py", line 94, in run_tasks manager.__enter__() File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_a81ee2815de5acae59ead5b8c9137b6766fc8ea8/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc), test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-11-12T06:20:46.595 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=cf13c566c3b24555a56035162d1b8b62 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/run_tasks.py", line 94, in run_tasks manager.__enter__() File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_a81ee2815de5acae59ead5b8c9137b6766fc8ea8/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc), test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-11-12T06:20:46.597 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2021-11-12T06:20:46.608 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2021-11-12T06:20:46.645 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2021-11-12T06:20:46.646 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-11-12T06:20:46.646 DEBUG:teuthology.orchestra.run.gibba016:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-11-12T06:20:46.647 DEBUG:teuthology.orchestra.run.gibba016:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-11-12T06:20:59.797 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:20:59.801 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:20:59.804 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:20:59.807 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:20:59.811 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:21:29.866 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:21:29.870 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:21:29.873 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:21:29.875 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:21:29.879 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:21:59.961 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:21:59.966 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:21:59.969 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:21:59.973 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:21:59.976 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:22:30.106 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:22:30.110 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:22:30.113 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:22:30.116 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:22:30.119 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:23:00.160 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:23:00.164 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:23:00.169 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:23:00.172 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:23:00.175 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:23:30.219 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:23:30.223 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:23:30.227 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:23:30.230 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:23:30.234 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:24:00.296 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:24:00.301 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:24:00.305 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:24:00.307 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:24:00.311 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:24:30.358 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:24:30.363 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:24:30.368 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:24:30.372 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:24:30.376 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:25:00.439 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:25:00.442 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:25:00.446 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:25:00.449 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:25:00.453 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:25:30.514 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:25:30.517 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:25:30.520 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:25:30.523 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:25:30.527 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:26:00.581 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:26:00.586 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:26:00.590 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:26:00.594 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:26:00.598 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:26:30.649 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:26:30.654 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:26:30.657 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:26:30.661 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:26:30.665 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:27:00.709 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:27:00.715 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:27:00.719 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:27:00.723 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:27:00.727 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:27:30.767 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:27:30.772 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:27:30.775 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:27:30.778 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:27:30.782 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:28:00.844 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:28:00.849 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:28:00.852 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:28:00.856 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:28:00.859 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:28:30.900 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:28:30.904 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:28:30.907 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:28:30.911 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:28:30.914 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:29:00.987 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:29:00.991 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:29:00.994 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:29:00.997 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:29:01.000 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:29:31.053 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:29:31.057 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:29:31.061 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:29:31.064 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:29:31.067 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:30:01.129 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:30:01.133 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:30:01.136 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:30:01.140 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:30:01.143 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:30:31.196 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:30:31.202 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:30:31.206 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:30:31.209 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:30:31.214 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:31:01.271 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:31:01.280 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:31:01.284 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:31:01.287 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:31:01.290 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:31:31.365 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:31:31.370 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:31:31.373 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:31:31.377 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:31:31.380 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:32:01.477 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:32:01.481 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:32:01.485 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:32:01.488 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:32:01.491 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:32:31.624 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:32:31.629 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:32:31.633 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:32:31.636 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:32:31.640 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:33:01.699 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:33:01.703 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:33:01.707 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:33:01.711 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:33:01.714 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:33:31.769 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:33:31.773 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:33:31.776 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:33:31.780 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:33:31.783 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:34:01.848 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:34:01.853 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:34:01.863 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:34:01.872 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:34:01.879 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:34:31.934 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:34:31.938 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:34:31.941 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:34:31.945 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:34:31.948 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:35:01.995 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:35:01.999 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:35:02.002 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:35:02.005 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:35:02.008 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:35:32.053 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:35:32.057 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:35:32.061 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:35:32.067 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:35:32.070 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:35:46.678 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-11-12T06:35:46.691 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2021-11-12T06:35:46.717 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T06:35:46.718 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/run_tasks.py", line 176, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_a81ee2815de5acae59ead5b8c9137b6766fc8ea8/qa/tasks/ceph_fuse.py", line 159, in task if mount.is_mounted(): File "/home/teuthworker/src/github.com_ceph_ceph_a81ee2815de5acae59ead5b8c9137b6766fc8ea8/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/orchestra/run.py", line 148, in wait greenlet.get(block=True,timeout=60) File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-11-12T06:35:46.730 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2021-11-12T06:35:46.738 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2021-11-12T06:35:46.739 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T06:35:46.805 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.803+0000 7fdeb8a52700 1 Processor -- start 2021-11-12T06:35:46.806 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.803+0000 7fdeb8a52700 1 -- start start 2021-11-12T06:35:46.811 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.803+0000 7fdeb8a52700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fdeb40ad080 0x7fdeb40af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:46.811 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.803+0000 7fdeb8a52700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdeb414b2f0 0x7fdeb40ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:46.812 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.803+0000 7fdeb8a52700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeb40ac7b0 con 0x7fdeb40ac280 2021-11-12T06:35:46.812 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.803+0000 7fdeb8a52700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeb41488a0 con 0x7fdeb40ad080 2021-11-12T06:35:46.812 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.803+0000 7fdeb8a52700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb40ac9e0 con 0x7fdeb414b2f0 2021-11-12T06:35:46.813 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.803+0000 7fdeb1d9b700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fdeb40ac280 0x7fdeb414abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:35606/0 (socket says 172.21.2.105:35606) 2021-11-12T06:35:46.813 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.803+0000 7fdeb1d9b700 1 -- 172.21.2.105:0/2674006889 learned_addr learned my addr 172.21.2.105:0/2674006889 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T06:35:46.813 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.803+0000 7fdeb159a700 1 -- 172.21.2.105:0/2674006889 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2649129693 0 0) 0x7fdeb40ac7b0 con 0x7fdeb40ac280 2021-11-12T06:35:46.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.803+0000 7fdeb159a700 1 -- 172.21.2.105:0/2674006889 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde94003260 con 0x7fdeb40ac280 2021-11-12T06:35:46.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.803+0000 7fdeb259c700 1 --2- 172.21.2.105:0/2674006889 >> v2:172.21.2.115:3300/0 conn(0x7fdeb40ad080 0x7fdeb40af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:46.814 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.803+0000 7fdeb2d9d700 1 --2- 172.21.2.105:0/2674006889 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdeb414b2f0 0x7fdeb40ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:46.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.803+0000 7fdeb159a700 1 -- 172.21.2.105:0/2674006889 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3609315462 0 0) 0x7fde94003260 con 0x7fdeb40ac280 2021-11-12T06:35:46.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.803+0000 7fdeb159a700 1 -- 172.21.2.105:0/2674006889 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdeb414b2f0 msgr2=0x7fdeb40ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T06:35:46.815 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.803+0000 7fdeb159a700 1 --2- 172.21.2.105:0/2674006889 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdeb414b2f0 0x7fdeb40ad460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:46.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.803+0000 7fdeb159a700 1 -- 172.21.2.105:0/2674006889 >> v2:172.21.2.115:3300/0 conn(0x7fdeb40ad080 msgr2=0x7fdeb40af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T06:35:46.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.803+0000 7fdeb159a700 1 --2- 172.21.2.105:0/2674006889 >> v2:172.21.2.115:3300/0 conn(0x7fdeb40ad080 0x7fdeb40af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:46.816 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.803+0000 7fdeb159a700 1 -- 172.21.2.105:0/2674006889 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb40b0b30 con 0x7fdeb40ac280 2021-11-12T06:35:46.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.803+0000 7fdeb159a700 1 -- 172.21.2.105:0/2674006889 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fde9c001660 con 0x7fdeb40ac280 2021-11-12T06:35:46.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.803+0000 7fdeb2d9d700 1 --2- 172.21.2.105:0/2674006889 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdeb414b2f0 0x7fdeb40ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T06:35:46.817 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.803+0000 7fdeb159a700 1 -- 172.21.2.105:0/2674006889 >> v1:172.21.2.105:6789/0 conn(0x7fdeb40ac280 legacy=0x7fdeb414abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:46.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.803+0000 7fdeb159a700 1 --2- 172.21.2.105:0/2674006889 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdeb414b2f0 0x7fde940037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:46.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.803+0000 7fdeb159a700 1 --2- 172.21.2.105:0/2674006889 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fde94003de0 0x7fde94004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:46.818 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.803+0000 7fdeb159a700 1 --2- 172.21.2.105:0/2674006889 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde940049f0 0x7fde94004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:46.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.803+0000 7fdeb159a700 1 -- 172.21.2.105:0/2674006889 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb41488a0 con 0x7fde940049f0 2021-11-12T06:35:46.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.803+0000 7fdeb159a700 1 -- 172.21.2.105:0/2674006889 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb40ac9e0 con 0x7fde94003de0 2021-11-12T06:35:46.819 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.803+0000 7fdeb159a700 1 -- 172.21.2.105:0/2674006889 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde9400b8b0 con 0x7fdeb414b2f0 2021-11-12T06:35:46.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.803+0000 7fdeb2d9d700 1 --2- 172.21.2.105:0/2674006889 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde940049f0 0x7fde94004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:46.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeb2d9d700 1 -- 172.21.2.105:0/2674006889 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdeb414b2f0 msgr2=0x7fde940037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T06:35:46.820 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeb2d9d700 1 --2- 172.21.2.105:0/2674006889 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdeb414b2f0 0x7fde940037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:46.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeb2d9d700 1 -- 172.21.2.105:0/2674006889 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fde94003de0 msgr2=0x7fde94004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T06:35:46.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeb2d9d700 1 --2- 172.21.2.105:0/2674006889 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fde94003de0 0x7fde94004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:46.821 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeb2d9d700 1 -- 172.21.2.105:0/2674006889 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde94003260 con 0x7fde940049f0 2021-11-12T06:35:46.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeb2d9d700 1 --2- 172.21.2.105:0/2674006889 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde940049f0 0x7fde94004e70 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 rx=0x7fdeac00a000 tx=0x7fdeac008040).ready entity=mon.0 client_cookie=654dbfec11b1b36 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:46.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeb159a700 1 -- 172.21.2.105:0/2674006889 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdeac00c070 con 0x7fde940049f0 2021-11-12T06:35:46.822 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeb159a700 1 -- 172.21.2.105:0/2674006889 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeac00e620 con 0x7fde940049f0 2021-11-12T06:35:46.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeb159a700 1 -- 172.21.2.105:0/2674006889 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdeac00e980 con 0x7fde940049f0 2021-11-12T06:35:46.823 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeb8a52700 1 -- 172.21.2.105:0/2674006889 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde940049f0 msgr2=0x7fde94004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:46.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeb8a52700 1 --2- 172.21.2.105:0/2674006889 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde940049f0 0x7fde94004e70 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 rx=0x7fdeac00a000 tx=0x7fdeac008040).stop 2021-11-12T06:35:46.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeb2d9d700 1 -- 172.21.2.105:0/2674006889 reap_dead start 2021-11-12T06:35:46.824 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeb8a52700 1 -- 172.21.2.105:0/2674006889 shutdown_connections 2021-11-12T06:35:46.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeb8a52700 1 -- 172.21.2.105:0/2674006889 >> 172.21.2.105:0/2674006889 conn(0x7fdeb40b5370 msgr2=0x7fdeb40b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:46.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeb8a52700 1 -- 172.21.2.105:0/2674006889 shutdown_connections 2021-11-12T06:35:46.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeb8a52700 1 -- 172.21.2.105:0/2674006889 wait complete. 2021-11-12T06:35:46.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeb8a52700 1 Processor -- start 2021-11-12T06:35:46.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeb8a52700 1 -- start start 2021-11-12T06:35:46.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeb8a52700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde940049f0 0x7fdeb41470c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:46.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeb8a52700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdeb40aa940 0x7fdeb415a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:46.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeb8a52700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdeb40abc00 0x7fdeb40638f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:46.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeb8a52700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb40634c0 con 0x7fde940049f0 2021-11-12T06:35:46.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeb8a52700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb40a9590 con 0x7fdeb40abc00 2021-11-12T06:35:46.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeb8a52700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb40a9830 con 0x7fdeb40aa940 2021-11-12T06:35:46.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeb259c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde940049f0 0x7fdeb41470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:46.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeb259c700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde940049f0 0x7fdeb41470c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53454/0 (socket says 172.21.2.105:53454) 2021-11-12T06:35:46.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeb259c700 1 -- 172.21.2.105:0/3538553743 learned_addr learned my addr 172.21.2.105:0/3538553743 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T06:35:46.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeb1d9b700 1 --2- 172.21.2.105:0/3538553743 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdeb40aa940 0x7fdeb415a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:46.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeb259c700 1 -- 172.21.2.105:0/3538553743 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdeb40aa940 msgr2=0x7fdeb415a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:46.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeb259c700 1 --2- 172.21.2.105:0/3538553743 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdeb40aa940 0x7fdeb415a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:46.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeb2d9d700 1 --2- 172.21.2.105:0/3538553743 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdeb40abc00 0x7fdeb40638f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:46.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeb259c700 1 -- 172.21.2.105:0/3538553743 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdeb40abc00 msgr2=0x7fdeb40638f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:46.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeb259c700 1 --2- 172.21.2.105:0/3538553743 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdeb40abc00 0x7fdeb40638f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:46.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeb259c700 1 -- 172.21.2.105:0/3538553743 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb4060a20 con 0x7fde940049f0 2021-11-12T06:35:46.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeb259c700 1 --2- 172.21.2.105:0/3538553743 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde940049f0 0x7fdeb41470c0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 rx=0x7fdea400a000 tx=0x7fdea4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:46.832 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeab7fe700 1 -- 172.21.2.105:0/3538553743 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdea400de40 con 0x7fde940049f0 2021-11-12T06:35:46.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeab7fe700 1 -- 172.21.2.105:0/3538553743 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea4000e90 con 0x7fde940049f0 2021-11-12T06:35:46.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeb8a52700 1 -- 172.21.2.105:0/3538553743 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeb4063de0 con 0x7fde940049f0 2021-11-12T06:35:46.833 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeab7fe700 1 -- 172.21.2.105:0/3538553743 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdea40116f0 con 0x7fde940049f0 2021-11-12T06:35:46.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeb8a52700 1 -- 172.21.2.105:0/3538553743 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeb40a7fb0 con 0x7fde940049f0 2021-11-12T06:35:46.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.807+0000 7fdeb8a52700 1 -- 172.21.2.105:0/3538553743 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeb40b1440 con 0x7fde940049f0 2021-11-12T06:35:46.834 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.811+0000 7fdeab7fe700 1 -- 172.21.2.105:0/3538553743 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fdea4019020 con 0x7fde940049f0 2021-11-12T06:35:46.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.811+0000 7fdeab7fe700 1 --2- 172.21.2.105:0/3538553743 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fde98053600 0x7fde98055ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:46.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.811+0000 7fdeab7fe700 1 -- 172.21.2.105:0/3538553743 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fdea406afa0 con 0x7fde940049f0 2021-11-12T06:35:46.836 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.811+0000 7fdeb1d9b700 1 --2- 172.21.2.105:0/3538553743 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fde98053600 0x7fde98055ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:46.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.811+0000 7fdeb1d9b700 1 --2- 172.21.2.105:0/3538553743 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fde98053600 0x7fde98055ac0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7fde9c008000 tx=0x7fde9c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:46.837 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.811+0000 7fdeab7fe700 1 -- 172.21.2.105:0/3538553743 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdea4042170 con 0x7fde940049f0 2021-11-12T06:35:46.895 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.895+0000 7fdeb8a52700 1 -- 172.21.2.105:0/3538553743 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdeb4057350 con 0x7fde940049f0 2021-11-12T06:35:46.896 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.895+0000 7fdeab7fe700 1 -- 172.21.2.105:0/3538553743 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) v1 ==== 74+0+13553 (secure 0 0 0) 0x7fdea4045790 con 0x7fde940049f0 2021-11-12T06:35:46.897 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T06:35:46.897 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":159,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:50:16.200531+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.2.105:6835/4094714006":"2021-11-13T05:50:12.291195+0000","172.21.2.105:6834/4094714006":"2021-11-13T05:50:12.291195+0000"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T06:35:46.898 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.895+0000 7fdeb8a52700 1 -- 172.21.2.105:0/3538553743 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fde98053600 msgr2=0x7fde98055ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:46.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.895+0000 7fdeb8a52700 1 --2- 172.21.2.105:0/3538553743 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fde98053600 0x7fde98055ac0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7fde9c008000 tx=0x7fde9c009040).stop 2021-11-12T06:35:46.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.895+0000 7fdeb8a52700 1 -- 172.21.2.105:0/3538553743 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde940049f0 msgr2=0x7fdeb41470c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:46.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.895+0000 7fdeb8a52700 1 --2- 172.21.2.105:0/3538553743 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde940049f0 0x7fdeb41470c0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 rx=0x7fdea400a000 tx=0x7fdea4008040).stop 2021-11-12T06:35:46.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.895+0000 7fdeb8a52700 1 -- 172.21.2.105:0/3538553743 shutdown_connections 2021-11-12T06:35:46.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.895+0000 7fdeb8a52700 1 --2- 172.21.2.105:0/3538553743 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fde98053600 0x7fde98055ac0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:46.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.895+0000 7fdeb8a52700 1 --2- 172.21.2.105:0/3538553743 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fdeb40abc00 0x7fdeb40638f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:46.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.895+0000 7fdeb8a52700 1 --2- 172.21.2.105:0/3538553743 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fdeb40aa940 0x7fdeb415a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:46.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.895+0000 7fdeb8a52700 1 --2- 172.21.2.105:0/3538553743 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fde940049f0 0x7fdeb41470c0 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:46.902 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.895+0000 7fdeb8a52700 1 -- 172.21.2.105:0/3538553743 >> 172.21.2.105:0/3538553743 conn(0x7fdeb40b5370 msgr2=0x7fdeb405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:46.902 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.895+0000 7fdeb8a52700 1 -- 172.21.2.105:0/3538553743 shutdown_connections 2021-11-12T06:35:46.902 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.895+0000 7fdeb8a52700 1 -- 172.21.2.105:0/3538553743 wait complete. 2021-11-12T06:35:46.904 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-11-12T06:35:46.955 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.951+0000 7f3a5c156700 1 Processor -- start 2021-11-12T06:35:46.956 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.951+0000 7f3a5c156700 1 -- start start 2021-11-12T06:35:46.956 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a5c156700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3a540ad080 0x7f3a540af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:46.957 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a5c156700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f3a540ac280 0x7f3a540ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:46.957 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a5c156700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f3a5414abe0 0x7f3a5414b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:46.957 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a5c156700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a541488a0 con 0x7f3a5414abe0 2021-11-12T06:35:46.958 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a5c156700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a540ac7b0 con 0x7f3a540ac280 2021-11-12T06:35:46.958 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a5c156700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a540ac9e0 con 0x7f3a540ad080 2021-11-12T06:35:46.959 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a5a6f3700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f3a5414abe0 0x7f3a5414b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:46.959 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a5a6f3700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f3a5414abe0 0x7f3a5414b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53466/0 (socket says 172.21.2.105:53466) 2021-11-12T06:35:46.959 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a5a6f3700 1 -- 172.21.2.105:0/64233795 learned_addr learned my addr 172.21.2.105:0/64233795 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T06:35:46.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a5a6f3700 1 -- 172.21.2.105:0/64233795 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3a540ad080 msgr2=0x7f3a540af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T06:35:46.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a5a6f3700 1 --2- 172.21.2.105:0/64233795 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3a540ad080 0x7f3a540af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:46.963 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a5a6f3700 1 -- 172.21.2.105:0/64233795 >> v2:172.21.2.115:3300/0 conn(0x7f3a540ac280 msgr2=0x7f3a540ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T06:35:46.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a5a6f3700 1 --2- 172.21.2.105:0/64233795 >> v2:172.21.2.115:3300/0 conn(0x7f3a540ac280 0x7f3a540ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:46.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a5a6f3700 1 -- 172.21.2.105:0/64233795 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a540b0b30 con 0x7f3a5414abe0 2021-11-12T06:35:46.964 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a5a6f3700 1 --2- 172.21.2.105:0/64233795 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a5414abe0 0x7f3a5414b090 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 rx=0x7f3a540ac6a0 tx=0x7f3a4c009290).ready entity=mon.0 client_cookie=fb0b4628d62d167f server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:46.965 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a58ef0700 1 -- 172.21.2.105:0/64233795 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a4c00b830 con 0x7f3a5414abe0 2021-11-12T06:35:46.965 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a58ef0700 1 -- 172.21.2.105:0/64233795 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a4c00b990 con 0x7f3a5414abe0 2021-11-12T06:35:46.965 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a58ef0700 1 -- 172.21.2.105:0/64233795 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a4c00bb00 con 0x7f3a5414abe0 2021-11-12T06:35:46.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a5c156700 1 -- 172.21.2.105:0/64233795 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a5414abe0 msgr2=0x7f3a5414b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:46.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a5c156700 1 --2- 172.21.2.105:0/64233795 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a5414abe0 0x7f3a5414b090 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 rx=0x7f3a540ac6a0 tx=0x7f3a4c009290).stop 2021-11-12T06:35:46.966 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a5c156700 1 -- 172.21.2.105:0/64233795 shutdown_connections 2021-11-12T06:35:46.967 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a5c156700 1 --2- 172.21.2.105:0/64233795 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a5414abe0 0x7f3a5414b090 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:46.967 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a5c156700 1 --2- 172.21.2.105:0/64233795 >> v2:172.21.2.115:3300/0 conn(0x7f3a540ac280 0x7f3a540ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:46.967 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a5c156700 1 --2- 172.21.2.105:0/64233795 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3a540ad080 0x7f3a540af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:46.968 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a5c156700 1 -- 172.21.2.105:0/64233795 >> 172.21.2.105:0/64233795 conn(0x7f3a540b5370 msgr2=0x7f3a540b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:46.968 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a5c156700 1 -- 172.21.2.105:0/64233795 shutdown_connections 2021-11-12T06:35:46.968 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a5c156700 1 -- 172.21.2.105:0/64233795 wait complete. 2021-11-12T06:35:46.969 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a5c156700 1 Processor -- start 2021-11-12T06:35:46.969 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a5c156700 1 -- start start 2021-11-12T06:35:46.969 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a5c156700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a540ac280 0x7f3a540ab0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:46.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a5c156700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3a540ad080 0x7f3a540ab5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:46.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a5c156700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3a5414abe0 0x7f3a54142970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:46.970 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a5c156700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a540abaa0 con 0x7f3a540ac280 2021-11-12T06:35:46.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a5c156700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a54157750 con 0x7f3a540ad080 2021-11-12T06:35:46.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a5c156700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a541579f0 con 0x7f3a5414abe0 2021-11-12T06:35:46.971 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a59ef2700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a540ac280 0x7f3a540ab0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:46.972 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a59ef2700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a540ac280 0x7f3a540ab0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53470/0 (socket says 172.21.2.105:53470) 2021-11-12T06:35:46.972 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a59ef2700 1 -- 172.21.2.105:0/1741032629 learned_addr learned my addr 172.21.2.105:0/1741032629 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T06:35:46.972 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a59ef2700 1 -- 172.21.2.105:0/1741032629 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3a5414abe0 msgr2=0x7f3a54142970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:46.973 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a59ef2700 1 --2- 172.21.2.105:0/1741032629 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3a5414abe0 0x7f3a54142970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:46.973 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a59ef2700 1 -- 172.21.2.105:0/1741032629 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3a540ad080 msgr2=0x7f3a540ab5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:46.973 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a59ef2700 1 --2- 172.21.2.105:0/1741032629 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3a540ad080 0x7f3a540ab5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:46.974 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a59ef2700 1 -- 172.21.2.105:0/1741032629 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4c009530 con 0x7f3a540ac280 2021-11-12T06:35:46.974 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a59ef2700 1 --2- 172.21.2.105:0/1741032629 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a540ac280 0x7f3a540ab0c0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 rx=0x7f3a48002f70 tx=0x7f3a48006e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:46.974 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a46ffd700 1 -- 172.21.2.105:0/1741032629 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a48013460 con 0x7f3a540ac280 2021-11-12T06:35:46.975 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a46ffd700 1 -- 172.21.2.105:0/1741032629 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a480135c0 con 0x7f3a540ac280 2021-11-12T06:35:46.975 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a5c156700 1 -- 172.21.2.105:0/1741032629 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a540a9bd0 con 0x7f3a540ac280 2021-11-12T06:35:46.975 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a46ffd700 1 -- 172.21.2.105:0/1741032629 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a48013920 con 0x7f3a540ac280 2021-11-12T06:35:46.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.955+0000 7f3a5c156700 1 -- 172.21.2.105:0/1741032629 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a540aa9e0 con 0x7f3a540ac280 2021-11-12T06:35:46.976 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.959+0000 7f3a5c156700 1 -- 172.21.2.105:0/1741032629 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a54157bb0 con 0x7f3a540ac280 2021-11-12T06:35:46.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.959+0000 7f3a46ffd700 1 -- 172.21.2.105:0/1741032629 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3a4801a060 con 0x7f3a540ac280 2021-11-12T06:35:46.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.959+0000 7f3a46ffd700 1 --2- 172.21.2.105:0/1741032629 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3a340535d0 0x7f3a34055a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:46.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.959+0000 7f3a46ffd700 1 -- 172.21.2.105:0/1741032629 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f3a4806b340 con 0x7f3a540ac280 2021-11-12T06:35:46.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.959+0000 7f3a596f1700 1 --2- 172.21.2.105:0/1741032629 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3a340535d0 0x7f3a34055a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:46.978 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.959+0000 7f3a596f1700 1 --2- 172.21.2.105:0/1741032629 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3a340535d0 0x7f3a34055a90 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f3a50002f70 tx=0x7f3a50006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:46.978 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:46.959+0000 7f3a46ffd700 1 -- 172.21.2.105:0/1741032629 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3a48042510 con 0x7f3a540ac280 2021-11-12T06:35:47.043 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.039+0000 7f3a5c156700 1 -- 172.21.2.105:0/1741032629 --> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3a5414b580 con 0x7f3a340535d0 2021-11-12T06:35:47.044 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.043+0000 7f3a46ffd700 1 -- 172.21.2.105:0/1741032629 <== mgr.4107 v2:172.21.2.105:6800/14730 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+65870 (secure 0 0 0) 0x7f3a5414b580 con 0x7f3a340535d0 2021-11-12T06:35:47.046 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T06:35:47.047 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.043+0000 7f3a5c156700 1 -- 172.21.2.105:0/1741032629 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3a340535d0 msgr2=0x7f3a34055a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:47.048 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.043+0000 7f3a5c156700 1 --2- 172.21.2.105:0/1741032629 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3a340535d0 0x7f3a34055a90 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f3a50002f70 tx=0x7f3a50006a80).stop 2021-11-12T06:35:47.048 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.043+0000 7f3a5c156700 1 -- 172.21.2.105:0/1741032629 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a540ac280 msgr2=0x7f3a540ab0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:47.048 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.043+0000 7f3a5c156700 1 --2- 172.21.2.105:0/1741032629 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a540ac280 0x7f3a540ab0c0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 rx=0x7f3a48002f70 tx=0x7f3a48006e40).stop 2021-11-12T06:35:47.049 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.043+0000 7f3a5c156700 1 -- 172.21.2.105:0/1741032629 shutdown_connections 2021-11-12T06:35:47.049 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.043+0000 7f3a5c156700 1 --2- 172.21.2.105:0/1741032629 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3a340535d0 0x7f3a34055a90 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:47.050 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.043+0000 7f3a5c156700 1 --2- 172.21.2.105:0/1741032629 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3a5414abe0 0x7f3a54142970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:47.050 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.043+0000 7f3a5c156700 1 --2- 172.21.2.105:0/1741032629 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3a540ad080 0x7f3a540ab5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:47.050 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.043+0000 7f3a5c156700 1 --2- 172.21.2.105:0/1741032629 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3a540ac280 0x7f3a540ab0c0 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:47.051 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.043+0000 7f3a5c156700 1 -- 172.21.2.105:0/1741032629 >> 172.21.2.105:0/1741032629 conn(0x7f3a540b5370 msgr2=0x7f3a54144fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:47.051 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.043+0000 7f3a5c156700 1 -- 172.21.2.105:0/1741032629 shutdown_connections 2021-11-12T06:35:47.051 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.043+0000 7f3a5c156700 1 -- 172.21.2.105:0/1741032629 wait complete. 2021-11-12T06:35:47.052 INFO:teuthology.orchestra.run.gibba005.stderr:dumped all 2021-11-12T06:35:47.053 INFO:teuthology.orchestra.run.gibba005.stdout:{"pg_ready":true,"pg_map":{"version":1811,"stamp":"2021-11-12T06:35:45.423275+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":8404480,"kb_used_data":15808,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746570240,"statfs":{"total":773094113280,"available":764487925760,"internally_reserved":8589934592,"allocated":16187392,"data_stored":7961344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005545"},"pg_stats":[{"pgid":"1.0","version":"16'2","reported_seq":143,"reported_epoch":158,"state":"active+clean","last_fresh":"2021-11-12T05:50:15.403031+0000","last_change":"2021-11-12T05:40:27.633039+0000","last_active":"2021-11-12T05:50:15.403031+0000","last_peered":"2021-11-12T05:50:15.403031+0000","last_clean":"2021-11-12T05:50:15.403031+0000","last_became_active":"2021-11-12T05:40:27.631630+0000","last_became_peered":"2021-11-12T05:40:27.631630+0000","last_unstale":"2021-11-12T05:50:15.403031+0000","last_undegraded":"2021-11-12T05:50:15.403031+0000","last_fullsized":"2021-11-12T05:50:15.403031+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:23.018147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:23.018147+0000","last_clean_scrub_stamp":"2021-11-12T05:40:23.018147+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":142,"reported_epoch":158,"state":"active+clean","last_fresh":"2021-11-12T05:50:15.199644+0000","last_change":"2021-11-12T05:40:31.959167+0000","last_active":"2021-11-12T05:50:15.199644+0000","last_peered":"2021-11-12T05:50:15.199644+0000","last_clean":"2021-11-12T05:50:15.199644+0000","last_became_active":"2021-11-12T05:40:31.958938+0000","last_became_peered":"2021-11-12T05:40:31.958938+0000","last_unstale":"2021-11-12T05:50:15.199644+0000","last_undegraded":"2021-11-12T05:50:15.199644+0000","last_fullsized":"2021-11-12T05:50:15.199644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_clean_scrub_stamp":"2021-11-12T05:40:30.930115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":138,"reported_epoch":158,"state":"active+clean","last_fresh":"2021-11-12T05:50:15.402804+0000","last_change":"2021-11-12T05:40:31.957870+0000","last_active":"2021-11-12T05:50:15.402804+0000","last_peered":"2021-11-12T05:50:15.402804+0000","last_clean":"2021-11-12T05:50:15.402804+0000","last_became_active":"2021-11-12T05:40:31.957678+0000","last_became_peered":"2021-11-12T05:40:31.957678+0000","last_unstale":"2021-11-12T05:50:15.402804+0000","last_undegraded":"2021-11-12T05:50:15.402804+0000","last_fullsized":"2021-11-12T05:50:15.402804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_clean_scrub_stamp":"2021-11-12T05:40:30.930115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":134,"reported_epoch":158,"state":"active+clean","last_fresh":"2021-11-12T05:50:15.402167+0000","last_change":"2021-11-12T05:40:31.957439+0000","last_active":"2021-11-12T05:50:15.402167+0000","last_peered":"2021-11-12T05:50:15.402167+0000","last_clean":"2021-11-12T05:50:15.402167+0000","last_became_active":"2021-11-12T05:40:31.957234+0000","last_became_peered":"2021-11-12T05:40:31.957234+0000","last_unstale":"2021-11-12T05:50:15.402167+0000","last_undegraded":"2021-11-12T05:50:15.402167+0000","last_fullsized":"2021-11-12T05:50:15.402167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_clean_scrub_stamp":"2021-11-12T05:40:30.930115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":142,"reported_epoch":158,"state":"active+clean","last_fresh":"2021-11-12T05:50:15.199634+0000","last_change":"2021-11-12T05:40:31.959024+0000","last_active":"2021-11-12T05:50:15.199634+0000","last_peered":"2021-11-12T05:50:15.199634+0000","last_clean":"2021-11-12T05:50:15.199634+0000","last_became_active":"2021-11-12T05:40:31.958760+0000","last_became_peered":"2021-11-12T05:40:31.958760+0000","last_unstale":"2021-11-12T05:50:15.199634+0000","last_undegraded":"2021-11-12T05:50:15.199634+0000","last_fullsized":"2021-11-12T05:50:15.199634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_clean_scrub_stamp":"2021-11-12T05:40:30.930115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":140,"reported_epoch":158,"state":"active+clean","last_fresh":"2021-11-12T05:50:15.401967+0000","last_change":"2021-11-12T05:40:31.966265+0000","last_active":"2021-11-12T05:50:15.401967+0000","last_peered":"2021-11-12T05:50:15.401967+0000","last_clean":"2021-11-12T05:50:15.401967+0000","last_became_active":"2021-11-12T05:40:31.966094+0000","last_became_peered":"2021-11-12T05:40:31.966094+0000","last_unstale":"2021-11-12T05:50:15.401967+0000","last_undegraded":"2021-11-12T05:50:15.401967+0000","last_fullsized":"2021-11-12T05:50:15.401967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_clean_scrub_stamp":"2021-11-12T05:40:30.930115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":138,"reported_epoch":158,"state":"active+clean","last_fresh":"2021-11-12T05:50:15.402970+0000","last_change":"2021-11-12T05:40:31.966703+0000","last_active":"2021-11-12T05:50:15.402970+0000","last_peered":"2021-11-12T05:50:15.402970+0000","last_clean":"2021-11-12T05:50:15.402970+0000","last_became_active":"2021-11-12T05:40:31.966492+0000","last_became_peered":"2021-11-12T05:40:31.966492+0000","last_unstale":"2021-11-12T05:50:15.402970+0000","last_undegraded":"2021-11-12T05:50:15.402970+0000","last_fullsized":"2021-11-12T05:50:15.402970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_clean_scrub_stamp":"2021-11-12T05:40:30.930115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":140,"reported_epoch":158,"state":"active+clean","last_fresh":"2021-11-12T05:50:15.401990+0000","last_change":"2021-11-12T05:40:31.958555+0000","last_active":"2021-11-12T05:50:15.401990+0000","last_peered":"2021-11-12T05:50:15.401990+0000","last_clean":"2021-11-12T05:50:15.401990+0000","last_became_active":"2021-11-12T05:40:31.958357+0000","last_became_peered":"2021-11-12T05:40:31.958357+0000","last_unstale":"2021-11-12T05:50:15.401990+0000","last_undegraded":"2021-11-12T05:50:15.401990+0000","last_fullsized":"2021-11-12T05:50:15.401990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_clean_scrub_stamp":"2021-11-12T05:40:30.930115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":138,"reported_epoch":158,"state":"active+clean","last_fresh":"2021-11-12T05:50:15.403233+0000","last_change":"2021-11-12T05:40:31.959219+0000","last_active":"2021-11-12T05:50:15.403233+0000","last_peered":"2021-11-12T05:50:15.403233+0000","last_clean":"2021-11-12T05:50:15.403233+0000","last_became_active":"2021-11-12T05:40:31.958961+0000","last_became_peered":"2021-11-12T05:40:31.958961+0000","last_unstale":"2021-11-12T05:50:15.403233+0000","last_undegraded":"2021-11-12T05:50:15.403233+0000","last_fullsized":"2021-11-12T05:50:15.403233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_clean_scrub_stamp":"2021-11-12T05:40:30.930115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542811,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050560,"kb_used_data":1976,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321280,"statfs":{"total":96636764160,"available":95560990720,"internally_reserved":1073741824,"allocated":2023424,"data_stored":995168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 12 06:35:06 2021","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.3540000000000001,"15min":1.3149999999999999},"min":{"1min":0.99199999999999999,"5min":0.628,"15min":0.33800000000000002},"max":{"1min":1.6819999999999999,"5min":1.843,"15min":1.843},"last":1.383},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.2789999999999999,"15min":1.2649999999999999},"min":{"1min":1.083,"5min":0.60199999999999998,"15min":0.39300000000000002},"max":{"1min":1.5189999999999999,"5min":1.7150000000000001,"15min":1.8140000000000001},"last":0.90800000000000003}]},{"osd":1,"last update":"Fri Nov 12 06:35:06 2021","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.218,"15min":1.2110000000000001},"min":{"1min":0.92800000000000005,"5min":0.56699999999999995,"15min":0.35399999999999998},"max":{"1min":1.587,"5min":1.76,"15min":1.8779999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.333,"5min":1.258,"15min":1.23},"min":{"1min":1.048,"5min":0.60799999999999998,"15min":0.32600000000000001},"max":{"1min":1.7230000000000001,"5min":1.788,"15min":1.788},"last":1.1899999999999999}]},{"osd":2,"last update":"Fri Nov 12 06:35:06 2021","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.2849999999999999,"15min":1.2589999999999999},"min":{"1min":0.877,"5min":0.60999999999999999,"15min":0.30499999999999999},"max":{"1min":1.728,"5min":1.7849999999999999,"15min":1.7909999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2270000000000001,"15min":1.224},"min":{"1min":1.0189999999999999,"5min":0.58399999999999996,"15min":0.36899999999999999},"max":{"1min":1.635,"5min":1.635,"15min":1.722},"last":1.101}]},{"osd":3,"last update":"Fri Nov 12 06:35:06 2021","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.212,"15min":1.2070000000000001},"min":{"1min":1.018,"5min":0.59299999999999997,"15min":0.34300000000000003},"max":{"1min":1.4650000000000001,"5min":1.5469999999999999,"15min":1.6859999999999999},"last":1.143},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.288,"15min":1.2629999999999999},"min":{"1min":1.0389999999999999,"5min":0.57499999999999996,"15min":0.34799999999999998},"max":{"1min":1.635,"5min":1.873,"15min":1.9279999999999999},"last":1.0620000000000001}]},{"osd":4,"last update":"Fri Nov 12 06:35:06 2021","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.85899999999999999,"15min":0.875},"min":{"1min":0.72999999999999998,"5min":0.22,"15min":0.22},"max":{"1min":1.3180000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.298},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.92600000000000005,"15min":0.91800000000000004},"min":{"1min":0.753,"5min":0.27200000000000002,"15min":0.223},"max":{"1min":1.4410000000000001,"5min":1.5129999999999999,"15min":1.6399999999999999},"last":1.347}]},{"osd":5,"last update":"Fri Nov 12 06:35:06 2021","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.92000000000000004,"15min":0.91700000000000004},"min":{"1min":0.76700000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.4890000000000001,"5min":1.6759999999999999,"15min":1.7589999999999999},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.006,"5min":0.96799999999999997,"15min":0.98099999999999998},"min":{"1min":0.79700000000000004,"5min":0.26600000000000001,"15min":0.253},"max":{"1min":1.341,"5min":1.6100000000000001,"15min":1.724},"last":1.014}]},{"osd":6,"last update":"Fri Nov 12 06:35:06 2021","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0029999999999999,"15min":1.0209999999999999},"min":{"1min":0.81899999999999995,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.2190000000000001,"5min":1.661,"15min":1.7},"last":1.4239999999999999},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.008,"15min":1.006},"min":{"1min":0.73799999999999999,"5min":0.246,"15min":0.24199999999999999},"max":{"1min":1.339,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.2649999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542810,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050560,"kb_used_data":1976,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321280,"statfs":{"total":96636764160,"available":95560990720,"internally_reserved":1073741824,"allocated":2023424,"data_stored":995168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 12 06:35:06 2021","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.272,"15min":1.242},"min":{"1min":0.92500000000000004,"5min":0.48299999999999998,"15min":0.35499999999999998},"max":{"1min":1.663,"5min":1.794,"15min":1.794},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.327,"5min":1.2889999999999999,"15min":1.26},"min":{"1min":1.133,"5min":0.52700000000000002,"15min":0.441},"max":{"1min":1.6439999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":1.4279999999999999}]},{"osd":1,"last update":"Fri Nov 12 06:35:06 2021","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.272,"15min":1.2470000000000001},"min":{"1min":0.88900000000000001,"5min":0.46400000000000002,"15min":0.36799999999999999},"max":{"1min":1.607,"5min":1.8360000000000001,"15min":1.907},"last":1.365},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.244,"15min":1.238},"min":{"1min":0.89900000000000002,"5min":0.53600000000000003,"15min":0.33800000000000002},"max":{"1min":1.6439999999999999,"5min":1.6519999999999999,"15min":1.8580000000000001},"last":1.3069999999999999}]},{"osd":2,"last update":"Fri Nov 12 06:35:06 2021","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.2070000000000001,"15min":1.1930000000000001},"min":{"1min":0.91500000000000004,"5min":0.48799999999999999,"15min":0.255},"max":{"1min":1.3979999999999999,"5min":1.895,"15min":1.895},"last":1.272},{"interface":"front","average":{"1min":1.246,"5min":1.258,"15min":1.248},"min":{"1min":0.97499999999999998,"5min":0.49399999999999999,"15min":0.308},"max":{"1min":1.534,"5min":1.8580000000000001,"15min":1.958},"last":1.208}]},{"osd":3,"last update":"Fri Nov 12 06:35:06 2021","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.3149999999999999,"15min":1.2989999999999999},"min":{"1min":0.83499999999999996,"5min":0.502,"15min":0.42999999999999999},"max":{"1min":1.52,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.54},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.282,"15min":1.2629999999999999},"min":{"1min":1.0920000000000001,"5min":0.47099999999999997,"15min":0.36399999999999999},"max":{"1min":1.5680000000000001,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.407}]},{"osd":4,"last update":"Fri Nov 12 06:35:06 2021","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":0.96499999999999997,"15min":0.93200000000000005},"min":{"1min":0.73599999999999999,"5min":0.27900000000000003,"15min":0.216},"max":{"1min":1.7210000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.008,"5min":1.0369999999999999,"15min":1.0089999999999999},"min":{"1min":0.78900000000000003,"5min":0.24099999999999999,"15min":0.20799999999999999},"max":{"1min":1.3660000000000001,"5min":1.766,"15min":1.766},"last":1.48}]},{"osd":5,"last update":"Fri Nov 12 06:35:06 2021","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.93100000000000005,"15min":0.90400000000000003},"min":{"1min":0.80600000000000005,"5min":0.21099999999999999,"15min":0.193},"max":{"1min":1.103,"5min":1.738,"15min":1.7569999999999999},"last":1.159},{"interface":"front","average":{"1min":1.0509999999999999,"5min":0.96199999999999997,"15min":0.93799999999999994},"min":{"1min":0.77900000000000003,"5min":0.26000000000000001,"15min":0.23300000000000001},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.768},"last":0.98899999999999999}]},{"osd":7,"last update":"Fri Nov 12 06:35:06 2021","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.96299999999999997,"15min":0.95799999999999996},"min":{"1min":0.83999999999999997,"5min":0.223,"15min":0.223},"max":{"1min":1.49,"5min":1.7130000000000001,"15min":1.726},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.996,"5min":1.0009999999999999,"15min":0.98699999999999999},"min":{"1min":0.78800000000000003,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.389,"5min":1.8,"15min":1.8},"last":1.036}]}]},{"osd":5,"up_from":14,"seq":60129542811,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050560,"kb_used_data":1976,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321280,"statfs":{"total":96636764160,"available":95560990720,"internally_reserved":1073741824,"allocated":2023424,"data_stored":995168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.2130000000000001,"15min":1.2250000000000001},"min":{"1min":0.48099999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6859999999999999},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.258,"5min":1.2270000000000001,"15min":1.2609999999999999},"min":{"1min":0.41199999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.663,"5min":1.821,"15min":1.821},"last":1.1919999999999999}]},{"osd":1,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.22,"15min":1.254},"min":{"1min":0.41999999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.5189999999999999,"5min":1.6299999999999999,"15min":1.802},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.179,"5min":1.2270000000000001,"15min":1.2569999999999999},"min":{"1min":0.496,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.5329999999999999,"5min":1.671,"15min":1.899},"last":1.25}]},{"osd":2,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.1719999999999999,"15min":1.202},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.4570000000000001,"5min":1.6299999999999999,"15min":1.7589999999999999},"last":1.21},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.22,"15min":1.252},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.8169999999999999},"last":1.395}]},{"osd":3,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.2250000000000001,"15min":1.2490000000000001},"min":{"1min":0.43099999999999999,"5min":0.374,"15min":0.374},"max":{"1min":1.5609999999999999,"5min":1.7250000000000001,"15min":1.845},"last":1.133},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1639999999999999,"15min":1.2230000000000001},"min":{"1min":0.46600000000000003,"5min":0.436,"15min":0.40100000000000002},"max":{"1min":1.5489999999999999,"5min":1.5640000000000001,"15min":1.742},"last":1.274}]},{"osd":4,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.85699999999999998,"15min":0.89900000000000002},"min":{"1min":0.28000000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.399,"5min":1.4339999999999999,"15min":1.76},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.89600000000000002,"15min":0.94499999999999995},"min":{"1min":0.255,"5min":0.251,"15min":0.246},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.6379999999999999},"last":0.93400000000000005}]},{"osd":6,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.88400000000000001,"15min":0.92100000000000004},"min":{"1min":0.29599999999999999,"5min":0.224,"15min":0.224},"max":{"1min":1.2490000000000001,"5min":1.5049999999999999,"15min":1.6719999999999999},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.95499999999999996,"15min":0.98999999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.24199999999999999},"max":{"1min":1.77,"5min":1.77,"15min":1.8620000000000001},"last":1.036}]},{"osd":7,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.97499999999999998,"15min":1.0029999999999999},"min":{"1min":0.23799999999999999,"5min":0.23699999999999999,"15min":0.23300000000000001},"max":{"1min":1.718,"5min":1.718,"15min":1.7410000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.97599999999999998,"15min":1.024},"min":{"1min":0.30399999999999999,"5min":0.26100000000000001,"15min":0.221},"max":{"1min":1.518,"5min":1.518,"15min":1.8360000000000001},"last":1.1499999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542810,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1050560,"kb_used_data":1976,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321280,"statfs":{"total":96636764160,"available":95560990720,"internally_reserved":1073741824,"allocated":2023424,"data_stored":995168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 12 06:35:22 2021","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.3320000000000001,"15min":1.2649999999999999},"min":{"1min":1.0920000000000001,"5min":0.56999999999999995,"15min":0.41999999999999998},"max":{"1min":1.722,"5min":1.7749999999999999,"15min":1.986},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.238,"15min":1.2310000000000001},"min":{"1min":0.92300000000000004,"5min":0.64300000000000002,"15min":0.433},"max":{"1min":1.4610000000000001,"5min":1.7130000000000001,"15min":1.77},"last":1.254}]},{"osd":1,"last update":"Fri Nov 12 06:35:22 2021","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.345,"15min":1.3220000000000001},"min":{"1min":1.0860000000000001,"5min":0.55800000000000005,"15min":0.435},"max":{"1min":1.657,"5min":1.732,"15min":1.9219999999999999},"last":1.163},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.278,"15min":1.2629999999999999},"min":{"1min":1.121,"5min":0.626,"15min":0.44400000000000001},"max":{"1min":1.5269999999999999,"5min":1.7709999999999999,"15min":1.841},"last":1.1459999999999999}]},{"osd":2,"last update":"Fri Nov 12 06:35:22 2021","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.3140000000000001,"15min":1.274},"min":{"1min":1.044,"5min":0.58299999999999996,"15min":0.40600000000000003},"max":{"1min":1.5920000000000001,"5min":1.6879999999999999,"15min":1.732},"last":1.47},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.256,"15min":1.2490000000000001},"min":{"1min":1.1599999999999999,"5min":0.54500000000000004,"15min":0.45300000000000001},"max":{"1min":1.575,"5min":1.7250000000000001,"15min":2.2490000000000001},"last":1.355}]},{"osd":3,"last update":"Fri Nov 12 06:35:22 2021","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2789999999999999,"15min":1.254},"min":{"1min":0.95599999999999996,"5min":0.60899999999999999,"15min":0.46300000000000002},"max":{"1min":1.6599999999999999,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.212},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.361,"15min":1.3089999999999999},"min":{"1min":1.248,"5min":0.61699999999999999,"15min":0.43099999999999999},"max":{"1min":1.726,"5min":1.821,"15min":1.8700000000000001},"last":1.282}]},{"osd":5,"last update":"Fri Nov 12 06:35:22 2021","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.874,"15min":0.86599999999999999},"min":{"1min":0.73199999999999998,"5min":0.248,"15min":0.23300000000000001},"max":{"1min":1.101,"5min":1.4299999999999999,"15min":2.1400000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.91400000000000003,"15min":0.90100000000000002},"min":{"1min":0.76600000000000001,"5min":0.28199999999999997,"15min":0.214},"max":{"1min":1.2629999999999999,"5min":1.5409999999999999,"15min":1.677},"last":0.874}]},{"osd":6,"last update":"Fri Nov 12 06:35:22 2021","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":0.95099999999999996,"15min":0.92600000000000005},"min":{"1min":0.78800000000000003,"5min":0.28100000000000003,"15min":0.21299999999999999},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.052,"5min":1.036,"15min":1.04},"min":{"1min":0.88900000000000001,"5min":0.316,"15min":0.246},"max":{"1min":1.29,"5min":1.5649999999999999,"15min":2.2029999999999998},"last":1.4379999999999999}]},{"osd":7,"last update":"Fri Nov 12 06:35:22 2021","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.95999999999999996,"15min":0.94599999999999995},"min":{"1min":0.85999999999999999,"5min":0.26600000000000001,"15min":0.224},"max":{"1min":1.1319999999999999,"5min":1.4099999999999999,"15min":1.6000000000000001},"last":1.073},{"interface":"front","average":{"1min":1.091,"5min":1.012,"15min":1.002},"min":{"1min":0.88100000000000001,"5min":0.26000000000000001,"15min":0.23100000000000001},"max":{"1min":1.4670000000000001,"5min":1.5449999999999999,"15min":1.9259999999999999},"last":1.107}]}]},{"osd":3,"up_from":14,"seq":60129542810,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050560,"kb_used_data":1976,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321280,"statfs":{"total":96636764160,"available":95560990720,"internally_reserved":1073741824,"allocated":2023424,"data_stored":995168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 12 06:35:13 2021","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.72099999999999997,"15min":0.70199999999999996},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.75700000000000001,"15min":0.748},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":1.28,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.71599999999999997}]},{"osd":1,"last update":"Fri Nov 12 06:35:13 2021","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.753,"15min":0.752},"min":{"1min":0.16800000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":1.026,"5min":1.1619999999999999,"15min":1.343},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.82399999999999995,"15min":0.80800000000000005},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":1.248,"5min":1.248,"15min":1.3120000000000001},"last":0.998}]},{"osd":2,"last update":"Fri Nov 12 06:35:13 2021","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.86099999999999999,"15min":0.83999999999999997},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":1.216,"5min":1.258,"15min":1.2769999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.83099999999999996,"15min":0.82599999999999996},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.1799999999999999,"5min":1.1930000000000001,"15min":1.2090000000000001},"last":0.93200000000000005}]},{"osd":4,"last update":"Fri Nov 12 06:35:13 2021","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.3149999999999999,"15min":1.337},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.59699999999999998},"max":{"1min":1.653,"5min":1.7470000000000001,"15min":1.859},"last":1.6899999999999999},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.321,"15min":1.319},"min":{"1min":0.71499999999999997,"5min":0.70699999999999996,"15min":0.41499999999999998},"max":{"1min":1.4810000000000001,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.78}]},{"osd":5,"last update":"Fri Nov 12 06:35:13 2021","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.3009999999999999,"15min":1.2969999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.38900000000000001},"max":{"1min":1.5780000000000001,"5min":2.121,"15min":2.121},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.347,"5min":1.321,"15min":1.335},"min":{"1min":0.70699999999999996,"5min":0.67700000000000005,"15min":0.54900000000000004},"max":{"1min":1.6890000000000001,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.4390000000000001}]},{"osd":6,"last update":"Fri Nov 12 06:35:13 2021","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.3080000000000001,"15min":1.3149999999999999},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.45400000000000001},"max":{"1min":1.6100000000000001,"5min":1.8009999999999999,"15min":1.804},"last":1.48},{"interface":"front","average":{"1min":1.246,"5min":1.292,"15min":1.2949999999999999},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.53700000000000003},"max":{"1min":1.575,"5min":1.6659999999999999,"15min":1.7789999999999999},"last":1.5780000000000001}]},{"osd":7,"last update":"Fri Nov 12 06:35:13 2021","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.3300000000000001,"15min":1.3380000000000001},"min":{"1min":0.72599999999999998,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.708,"5min":1.708,"15min":1.7629999999999999},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.331,"15min":1.3340000000000001},"min":{"1min":0.69299999999999995,"5min":0.66000000000000003,"15min":0.55700000000000005},"max":{"1min":1.6699999999999999,"5min":1.8240000000000001,"15min":1.8300000000000001},"last":1.907}]}]},{"osd":2,"up_from":14,"seq":60129542809,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050560,"kb_used_data":1976,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321280,"statfs":{"total":96636764160,"available":95560990720,"internally_reserved":1073741824,"allocated":2023424,"data_stored":995168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72299999999999998,"15min":0.70799999999999996},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":1.212,"5min":1.212,"15min":1.246},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.77000000000000002,"15min":0.78200000000000003},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.19},"max":{"1min":0.97199999999999998,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.66100000000000003}]},{"osd":1,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.78200000000000003,"15min":0.79000000000000004},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.2110000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.75700000000000001,"15min":0.76800000000000002},"min":{"1min":0.27000000000000002,"5min":0.26900000000000002,"15min":0.17000000000000001},"max":{"1min":1.002,"5min":1.135,"15min":1.3120000000000001},"last":1.002}]},{"osd":3,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.84699999999999998,"15min":0.85499999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.20699999999999999},"max":{"1min":1.1020000000000001,"5min":1.1639999999999999,"15min":1.2350000000000001},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78800000000000003,"15min":0.80000000000000004},"min":{"1min":0.245,"5min":0.245,"15min":0.23000000000000001},"max":{"1min":1.026,"5min":1.0620000000000001,"15min":1.4319999999999999},"last":0.81699999999999995}]},{"osd":4,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.373,"15min":1.371},"min":{"1min":0.94999999999999996,"5min":0.61499999999999999,"15min":0.39400000000000002},"max":{"1min":1.742,"5min":1.742,"15min":1.8580000000000001},"last":1.51},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.331,"15min":1.3380000000000001},"min":{"1min":0.86799999999999999,"5min":0.68000000000000005,"15min":0.52500000000000002},"max":{"1min":1.659,"5min":1.8180000000000001,"15min":1.8260000000000001},"last":1.4610000000000001}]},{"osd":5,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.413,"15min":1.381},"min":{"1min":0.93899999999999995,"5min":0.63500000000000001,"15min":0.35999999999999999},"max":{"1min":1.8089999999999999,"5min":1.835,"15min":1.835},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.331,"15min":1.341},"min":{"1min":0.84799999999999998,"5min":0.69399999999999995,"15min":0.38600000000000001},"max":{"1min":1.7310000000000001,"5min":1.804,"15min":1.8380000000000001},"last":1.641}]},{"osd":6,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.3640000000000001,"15min":1.3660000000000001},"min":{"1min":0.90400000000000003,"5min":0.67400000000000004,"15min":0.48399999999999999},"max":{"1min":1.798,"5min":1.837,"15min":1.837},"last":1.421},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.355,"15min":1.3540000000000001},"min":{"1min":0.879,"5min":0.64300000000000002,"15min":0.36599999999999999},"max":{"1min":1.6559999999999999,"5min":1.748,"15min":1.8839999999999999},"last":1.728}]},{"osd":7,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.3,"15min":1.3069999999999999},"min":{"1min":0.85399999999999998,"5min":0.64500000000000002,"15min":0.372},"max":{"1min":1.5980000000000001,"5min":1.744,"15min":1.744},"last":1.385},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.367,"15min":1.373},"min":{"1min":0.84199999999999997,"5min":0.64600000000000002,"15min":0.376},"max":{"1min":1.829,"5min":1.829,"15min":1.8600000000000001},"last":1.599}]}]},{"osd":1,"up_from":14,"seq":60129542810,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050560,"kb_used_data":1976,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321280,"statfs":{"total":96636764160,"available":95560990720,"internally_reserved":1073741824,"allocated":2023424,"data_stored":995168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 12 06:35:14 2021","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65800000000000003,"15min":0.68100000000000005},"min":{"1min":0.214,"5min":0.214,"15min":0.20300000000000001},"max":{"1min":0.79600000000000004,"5min":1.151,"15min":1.1990000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77500000000000002},"min":{"1min":0.248,"5min":0.219,"15min":0.20000000000000001},"max":{"1min":1.1919999999999999,"5min":1.204,"15min":1.4359999999999999},"last":0.751}]},{"osd":2,"last update":"Fri Nov 12 06:35:14 2021","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.80600000000000005,"15min":0.82699999999999996},"min":{"1min":0.30099999999999999,"5min":0.216,"15min":0.216},"max":{"1min":1.032,"5min":1.175,"15min":1.24},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78600000000000003,"15min":0.80400000000000005},"min":{"1min":0.27300000000000002,"5min":0.22900000000000001,"15min":0.216},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.3120000000000001},"last":0.82899999999999996}]},{"osd":3,"last update":"Fri Nov 12 06:35:14 2021","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.82399999999999995,"15min":0.82499999999999996},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":1.014,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.88900000000000001,"15min":0.90400000000000003},"min":{"1min":0.313,"5min":0.245,"15min":0.23000000000000001},"max":{"1min":1.0940000000000001,"5min":1.996,"15min":1.996},"last":1.1140000000000001}]},{"osd":4,"last update":"Fri Nov 12 06:35:14 2021","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.379,"15min":1.341},"min":{"1min":0.77100000000000002,"5min":0.49199999999999999,"15min":0.36899999999999999},"max":{"1min":1.6819999999999999,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.363,"15min":1.3500000000000001},"min":{"1min":0.80700000000000005,"5min":0.47899999999999998,"15min":0.33600000000000002},"max":{"1min":1.681,"5min":1.827,"15min":1.827},"last":1.177}]},{"osd":5,"last update":"Fri Nov 12 06:35:14 2021","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3740000000000001,"15min":1.363},"min":{"1min":0.72599999999999998,"5min":0.46899999999999997,"15min":0.35299999999999998},"max":{"1min":1.7549999999999999,"5min":1.8440000000000001,"15min":2.1019999999999999},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.369,"15min":1.357},"min":{"1min":0.79700000000000004,"5min":0.50900000000000001,"15min":0.34799999999999998},"max":{"1min":1.6299999999999999,"5min":1.748,"15min":2.169},"last":1.2210000000000001}]},{"osd":6,"last update":"Fri Nov 12 06:35:14 2021","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.323,"15min":1.3180000000000001},"min":{"1min":0.75800000000000001,"5min":0.54800000000000004,"15min":0.40699999999999997},"max":{"1min":1.629,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.365,"5min":1.3799999999999999,"15min":1.3560000000000001},"min":{"1min":0.77900000000000003,"5min":0.44600000000000001,"15min":0.377},"max":{"1min":1.6950000000000001,"5min":1.8109999999999999,"15min":1.952},"last":1.25}]},{"osd":7,"last update":"Fri Nov 12 06:35:14 2021","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.349,"15min":1.3520000000000001},"min":{"1min":0.76700000000000002,"5min":0.53400000000000003,"15min":0.36199999999999999},"max":{"1min":1.605,"5min":1.79,"15min":1.9159999999999999},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.3480000000000001,"15min":1.3149999999999999},"min":{"1min":0.78700000000000003,"5min":0.46100000000000002,"15min":0.39200000000000002},"max":{"1min":1.5980000000000001,"5min":1.716,"15min":1.8540000000000001},"last":1.135}]}]},{"osd":0,"up_from":14,"seq":60129542810,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050560,"kb_used_data":1976,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321280,"statfs":{"total":96636764160,"available":95560990720,"internally_reserved":1073741824,"allocated":2023424,"data_stored":995168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 12 06:35:08 2021","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.71699999999999997,"15min":0.70199999999999996},"min":{"1min":0.30099999999999999,"5min":0.253,"15min":0.11899999999999999},"max":{"1min":0.96799999999999997,"5min":1.083,"15min":1.083},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73399999999999999,"15min":0.754},"min":{"1min":0.30399999999999999,"5min":0.22600000000000001,"15min":0.19700000000000001},"max":{"1min":0.96399999999999997,"5min":1.1559999999999999,"15min":1.2090000000000001},"last":0.60499999999999998}]},{"osd":2,"last update":"Fri Nov 12 06:35:08 2021","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.748,"15min":0.755},"min":{"1min":0.27300000000000002,"5min":0.20899999999999999,"15min":0.13400000000000001},"max":{"1min":0.94099999999999995,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.879,"5min":0.81999999999999995,"15min":0.83099999999999996},"min":{"1min":0.34000000000000002,"5min":0.254,"15min":0.21199999999999999},"max":{"1min":1.1399999999999999,"5min":1.2729999999999999,"15min":1.3520000000000001},"last":0.66800000000000004}]},{"osd":3,"last update":"Fri Nov 12 06:35:08 2021","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.78800000000000003,"15min":0.80100000000000005},"min":{"1min":0.34499999999999997,"5min":0.215,"15min":0.215},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88500000000000001,"15min":0.88600000000000001},"min":{"1min":0.316,"5min":0.245,"15min":0.14499999999999999},"max":{"1min":1.143,"5min":1.3029999999999999,"15min":1.3520000000000001},"last":0.81599999999999995}]},{"osd":4,"last update":"Fri Nov 12 06:35:08 2021","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.3500000000000001,"15min":1.345},"min":{"1min":0.83399999999999996,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.877,"5min":1.8799999999999999,"15min":1.881},"last":1.298},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3180000000000001,"15min":1.3300000000000001},"min":{"1min":0.878,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.619,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.208}]},{"osd":5,"last update":"Fri Nov 12 06:35:08 2021","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.3640000000000001,"15min":1.3600000000000001},"min":{"1min":0.85099999999999998,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.7909999999999999,"5min":1.972,"15min":1.972},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.337,"5min":1.3420000000000001,"15min":1.3600000000000001},"min":{"1min":0.876,"5min":0.435,"15min":0.435},"max":{"1min":1.722,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.2350000000000001}]},{"osd":6,"last update":"Fri Nov 12 06:35:08 2021","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3200000000000001,"15min":1.337},"min":{"1min":0.84399999999999997,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.694,"5min":1.736,"15min":1.8600000000000001},"last":1.111},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3580000000000001,"15min":1.371},"min":{"1min":0.93899999999999995,"5min":0.502,"15min":0.502},"max":{"1min":1.6619999999999999,"5min":1.927,"15min":1.927},"last":1.0740000000000001}]},{"osd":7,"last update":"Fri Nov 12 06:35:08 2021","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.373,"15min":1.375},"min":{"1min":0.89600000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.788,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.179},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.359,"15min":1.3700000000000001},"min":{"1min":0.86899999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.718,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.1579999999999999}]}]}]}} 2021-11-12T06:35:47.056 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-11-12T06:35:47.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.103+0000 7f32fb955700 1 Processor -- start 2021-11-12T06:35:47.108 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.103+0000 7f32fb955700 1 -- start start 2021-11-12T06:35:47.112 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32fb955700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f32f40aed00 0x7f32f40b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:47.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32fb955700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32f40af0e0 con 0x7f32f4064280 2021-11-12T06:35:47.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32fb955700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32f40638a0 con 0x7f32f40671d0 2021-11-12T06:35:47.113 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32fb955700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32f4063b40 con 0x7f32f40aed00 2021-11-12T06:35:47.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32f96f1700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f32f40aed00 0x7f32f40b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:47.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32f8ef0700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f32f4064280 0x7f32f4066ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:35640/0 (socket says 172.21.2.105:35640) 2021-11-12T06:35:47.114 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32f96f1700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f32f40aed00 0x7f32f40b04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53476/0 (socket says 172.21.2.105:53476) 2021-11-12T06:35:47.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32f8ef0700 1 -- 172.21.2.105:0/3662832502 learned_addr learned my addr 172.21.2.105:0/3662832502 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T06:35:47.115 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32f96f1700 1 -- 172.21.2.105:0/3662832502 >> v1:172.21.2.115:6789/0 conn(0x7f32f40671d0 legacy=0x7f32f405f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T06:35:47.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32f96f1700 1 -- 172.21.2.105:0/3662832502 >> v1:172.21.2.105:6789/0 conn(0x7f32f4064280 legacy=0x7f32f4066ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:47.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32f96f1700 1 -- 172.21.2.105:0/3662832502 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f4063de0 con 0x7f32f40aed00 2021-11-12T06:35:47.116 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32f96f1700 1 --2- 172.21.2.105:0/3662832502 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f32f40aed00 0x7f32f40b04a0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 rx=0x7f32f40b62e0 tx=0x7f32ec0091d0).ready entity=mon.0 client_cookie=ac21aec6fe2f1847 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:47.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32e3fff700 1 -- 172.21.2.105:0/3662832502 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32ec009ea0 con 0x7f32f40aed00 2021-11-12T06:35:47.117 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32e3fff700 1 -- 172.21.2.105:0/3662832502 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32ec00b860 con 0x7f32f40aed00 2021-11-12T06:35:47.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32e3fff700 1 -- 172.21.2.105:0/3662832502 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32ec00b9d0 con 0x7f32f40aed00 2021-11-12T06:35:47.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32fb955700 1 -- 172.21.2.105:0/3662832502 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f32f40aed00 msgr2=0x7f32f40b04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:47.118 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32fb955700 1 --2- 172.21.2.105:0/3662832502 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f32f40aed00 0x7f32f40b04a0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 rx=0x7f32f40b62e0 tx=0x7f32ec0091d0).stop 2021-11-12T06:35:47.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32fb955700 1 -- 172.21.2.105:0/3662832502 shutdown_connections 2021-11-12T06:35:47.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32fb955700 1 --2- 172.21.2.105:0/3662832502 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f32f40aed00 0x7f32f40b04a0 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:47.119 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32fb955700 1 -- 172.21.2.105:0/3662832502 >> 172.21.2.105:0/3662832502 conn(0x7f32f40b5370 msgr2=0x7f32f40b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:47.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32fb955700 1 -- 172.21.2.105:0/3662832502 shutdown_connections 2021-11-12T06:35:47.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32fb955700 1 -- 172.21.2.105:0/3662832502 wait complete. 2021-11-12T06:35:47.120 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32fb955700 1 Processor -- start 2021-11-12T06:35:47.121 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32fb955700 1 -- start start 2021-11-12T06:35:47.121 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32fb955700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f32f4064280 0x7f32f40abe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:47.121 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32fb955700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f32f40671d0 0x7f32f409fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:47.122 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32fb955700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f32f40aed00 0x7f32f40a0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:47.122 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32fb955700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f40a1480 con 0x7f32f4064280 2021-11-12T06:35:47.122 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32fb955700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f409ee40 con 0x7f32f40aed00 2021-11-12T06:35:47.123 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32fb955700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32f409f0a0 con 0x7f32f40671d0 2021-11-12T06:35:47.123 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32f96f1700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f32f4064280 0x7f32f40abe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:47.123 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32f96f1700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f32f4064280 0x7f32f40abe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53482/0 (socket says 172.21.2.105:53482) 2021-11-12T06:35:47.124 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32f96f1700 1 -- 172.21.2.105:0/3335758775 learned_addr learned my addr 172.21.2.105:0/3335758775 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T06:35:47.124 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32f96f1700 1 -- 172.21.2.105:0/3335758775 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f32f40671d0 msgr2=0x7f32f409fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:47.124 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32f96f1700 1 --2- 172.21.2.105:0/3335758775 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f32f40671d0 0x7f32f409fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:47.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32f96f1700 1 -- 172.21.2.105:0/3335758775 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f32f40aed00 msgr2=0x7f32f40a0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:47.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32f96f1700 1 --2- 172.21.2.105:0/3335758775 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f32f40aed00 0x7f32f40a0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:47.125 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32f96f1700 1 -- 172.21.2.105:0/3335758775 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ec009470 con 0x7f32f4064280 2021-11-12T06:35:47.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32f96f1700 1 --2- 172.21.2.105:0/3335758775 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f32f4064280 0x7f32f40abe50 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 rx=0x7f32f40b62e0 tx=0x7f32ec016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:47.126 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32e27fc700 1 -- 172.21.2.105:0/3335758775 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32ec01f5e0 con 0x7f32f4064280 2021-11-12T06:35:47.127 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32e27fc700 1 -- 172.21.2.105:0/3335758775 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32ec01f740 con 0x7f32f4064280 2021-11-12T06:35:47.127 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32e27fc700 1 -- 172.21.2.105:0/3335758775 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32ec01faa0 con 0x7f32f4064280 2021-11-12T06:35:47.127 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32fb955700 1 -- 172.21.2.105:0/3335758775 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32f409f340 con 0x7f32f4064280 2021-11-12T06:35:47.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.107+0000 7f32fb955700 1 -- 172.21.2.105:0/3335758775 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32f4150a90 con 0x7f32f4064280 2021-11-12T06:35:47.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.111+0000 7f32fb955700 1 -- 172.21.2.105:0/3335758775 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32f4057350 con 0x7f32f4064280 2021-11-12T06:35:47.128 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.111+0000 7f32e27fc700 1 -- 172.21.2.105:0/3335758775 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f32ec026030 con 0x7f32f4064280 2021-11-12T06:35:47.129 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.111+0000 7f32e27fc700 1 --2- 172.21.2.105:0/3335758775 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f32d4053690 0x7f32d4055b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:47.129 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.111+0000 7f32e27fc700 1 -- 172.21.2.105:0/3335758775 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f32ec06ca70 con 0x7f32f4064280 2021-11-12T06:35:47.129 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.111+0000 7f32f8ef0700 1 --2- 172.21.2.105:0/3335758775 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f32d4053690 0x7f32d4055b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:47.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.111+0000 7f32f8ef0700 1 --2- 172.21.2.105:0/3335758775 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f32d4053690 0x7f32d4055b50 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f32f40b2f10 tx=0x7f32e4007800).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:47.130 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.111+0000 7f32e27fc700 1 -- 172.21.2.105:0/3335758775 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f32ec043c40 con 0x7f32f4064280 2021-11-12T06:35:47.197 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.195+0000 7f32fb955700 1 -- 172.21.2.105:0/3335758775 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f32f4068700 con 0x7f32f4064280 2021-11-12T06:35:47.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.195+0000 7f32e27fc700 1 -- 172.21.2.105:0/3335758775 <== mon.0 v2:172.21.2.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) v1 ==== 74+0+13553 (secure 0 0 0) 0x7f32ec024090 con 0x7f32f4064280 2021-11-12T06:35:47.198 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T06:35:47.199 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":159,"fsid":"22928e10-9f3c-479a-96ca-77d6ddf80f9f","created":"2021-11-12T05:40:19.986390+0000","modified":"2021-11-12T05:50:16.200531+0000","last_up_change":"2021-11-12T05:40:26.043478+0000","last_in_change":"2021-11-12T05:40:26.043478+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-11-12T05:40:22.022116+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-12T05:40:29.953617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ee8e30a0-4819-4475-80ec-dd3ee7d01322","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":14874},{"type":"v1","addr":"172.21.2.105:6803","nonce":14874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":14874},{"type":"v1","addr":"172.21.2.105:6805","nonce":14874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":14874},{"type":"v1","addr":"172.21.2.105:6809","nonce":14874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":14874},{"type":"v1","addr":"172.21.2.105:6807","nonce":14874}]},"public_addr":"172.21.2.105:6803/14874","cluster_addr":"172.21.2.105:6805/14874","heartbeat_back_addr":"172.21.2.105:6809/14874","heartbeat_front_addr":"172.21.2.105:6807/14874","state":["exists","up"]},{"osd":1,"uuid":"b1bb06c3-26d0-4d92-82f8-b3e882242785","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6810","nonce":14875},{"type":"v1","addr":"172.21.2.105:6811","nonce":14875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":14875},{"type":"v1","addr":"172.21.2.105:6813","nonce":14875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":14875},{"type":"v1","addr":"172.21.2.105:6817","nonce":14875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6814","nonce":14875},{"type":"v1","addr":"172.21.2.105:6815","nonce":14875}]},"public_addr":"172.21.2.105:6811/14875","cluster_addr":"172.21.2.105:6813/14875","heartbeat_back_addr":"172.21.2.105:6817/14875","heartbeat_front_addr":"172.21.2.105:6815/14875","state":["exists","up"]},{"osd":2,"uuid":"837b2c60-c335-4382-9f47-d86543a14022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6818","nonce":14905},{"type":"v1","addr":"172.21.2.105:6819","nonce":14905}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":14905},{"type":"v1","addr":"172.21.2.105:6821","nonce":14905}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":14905},{"type":"v1","addr":"172.21.2.105:6825","nonce":14905}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6822","nonce":14905},{"type":"v1","addr":"172.21.2.105:6823","nonce":14905}]},"public_addr":"172.21.2.105:6819/14905","cluster_addr":"172.21.2.105:6821/14905","heartbeat_back_addr":"172.21.2.105:6825/14905","heartbeat_front_addr":"172.21.2.105:6823/14905","state":["exists","up"]},{"osd":3,"uuid":"eb2b737b-dda6-444b-a306-f33cbbd51f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":14876},{"type":"v1","addr":"172.21.2.105:6827","nonce":14876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6828","nonce":14876},{"type":"v1","addr":"172.21.2.105:6829","nonce":14876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6832","nonce":14876},{"type":"v1","addr":"172.21.2.105:6833","nonce":14876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6830","nonce":14876},{"type":"v1","addr":"172.21.2.105:6831","nonce":14876}]},"public_addr":"172.21.2.105:6827/14876","cluster_addr":"172.21.2.105:6829/14876","heartbeat_back_addr":"172.21.2.105:6833/14876","heartbeat_front_addr":"172.21.2.105:6831/14876","state":["exists","up"]},{"osd":4,"uuid":"721529a1-c047-486a-a7ca-ddc15d80cdde","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6800","nonce":15096},{"type":"v1","addr":"172.21.2.115:6801","nonce":15096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6802","nonce":15096},{"type":"v1","addr":"172.21.2.115:6803","nonce":15096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6806","nonce":15096},{"type":"v1","addr":"172.21.2.115:6807","nonce":15096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6804","nonce":15096},{"type":"v1","addr":"172.21.2.115:6805","nonce":15096}]},"public_addr":"172.21.2.115:6801/15096","cluster_addr":"172.21.2.115:6803/15096","heartbeat_back_addr":"172.21.2.115:6807/15096","heartbeat_front_addr":"172.21.2.115:6805/15096","state":["exists","up"]},{"osd":5,"uuid":"68b72ab2-fa82-4b5c-bf33-528f002e4950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6808","nonce":15097},{"type":"v1","addr":"172.21.2.115:6809","nonce":15097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6810","nonce":15097},{"type":"v1","addr":"172.21.2.115:6811","nonce":15097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6814","nonce":15097},{"type":"v1","addr":"172.21.2.115:6815","nonce":15097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6812","nonce":15097},{"type":"v1","addr":"172.21.2.115:6813","nonce":15097}]},"public_addr":"172.21.2.115:6809/15097","cluster_addr":"172.21.2.115:6811/15097","heartbeat_back_addr":"172.21.2.115:6815/15097","heartbeat_front_addr":"172.21.2.115:6813/15097","state":["exists","up"]},{"osd":6,"uuid":"a2c83b5d-8d37-4d30-ac04-30d89a76e485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6816","nonce":15098},{"type":"v1","addr":"172.21.2.115:6817","nonce":15098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6818","nonce":15098},{"type":"v1","addr":"172.21.2.115:6819","nonce":15098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6822","nonce":15098},{"type":"v1","addr":"172.21.2.115:6823","nonce":15098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6820","nonce":15098},{"type":"v1","addr":"172.21.2.115:6821","nonce":15098}]},"public_addr":"172.21.2.115:6817/15098","cluster_addr":"172.21.2.115:6819/15098","heartbeat_back_addr":"172.21.2.115:6823/15098","heartbeat_front_addr":"172.21.2.115:6821/15098","state":["exists","up"]},{"osd":7,"uuid":"786ce966-d0fb-4181-aed4-c26e3ef61c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":153,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6824","nonce":15099},{"type":"v1","addr":"172.21.2.115:6825","nonce":15099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6826","nonce":15099},{"type":"v1","addr":"172.21.2.115:6827","nonce":15099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6830","nonce":15099},{"type":"v1","addr":"172.21.2.115:6831","nonce":15099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.115:6828","nonce":15099},{"type":"v1","addr":"172.21.2.115:6829","nonce":15099}]},"public_addr":"172.21.2.115:6825/15099","cluster_addr":"172.21.2.115:6827/15099","heartbeat_back_addr":"172.21.2.115:6831/15099","heartbeat_front_addr":"172.21.2.115:6829/15099","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.615112+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.665935+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.715877+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.489234+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.413776+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.507960+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.635696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-11-12T05:40:24.746949+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.2.105:6835/4094714006":"2021-11-13T05:50:12.291195+0000","172.21.2.105:6834/4094714006":"2021-11-13T05:50:12.291195+0000"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-11-12T06:35:47.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.195+0000 7f32fb955700 1 -- 172.21.2.105:0/3335758775 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f32d4053690 msgr2=0x7f32d4055b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:47.200 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.195+0000 7f32fb955700 1 --2- 172.21.2.105:0/3335758775 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f32d4053690 0x7f32d4055b50 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f32f40b2f10 tx=0x7f32e4007800).stop 2021-11-12T06:35:47.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.195+0000 7f32fb955700 1 -- 172.21.2.105:0/3335758775 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f32f4064280 msgr2=0x7f32f40abe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:47.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.195+0000 7f32fb955700 1 --2- 172.21.2.105:0/3335758775 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f32f4064280 0x7f32f40abe50 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 rx=0x7f32f40b62e0 tx=0x7f32ec016000).stop 2021-11-12T06:35:47.201 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.195+0000 7f32fb955700 1 -- 172.21.2.105:0/3335758775 shutdown_connections 2021-11-12T06:35:47.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.195+0000 7f32fb955700 1 --2- 172.21.2.105:0/3335758775 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f32d4053690 0x7f32d4055b50 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:47.202 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.195+0000 7f32fb955700 1 --2- 172.21.2.105:0/3335758775 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f32f40aed00 0x7f32f40a0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:47.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.195+0000 7f32fb955700 1 --2- 172.21.2.105:0/3335758775 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f32f40671d0 0x7f32f409fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:47.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.195+0000 7f32fb955700 1 --2- 172.21.2.105:0/3335758775 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f32f4064280 0x7f32f40abe50 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:47.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.195+0000 7f32fb955700 1 -- 172.21.2.105:0/3335758775 >> 172.21.2.105:0/3335758775 conn(0x7f32f40b5370 msgr2=0x7f32f40b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:47.203 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.195+0000 7f32fb955700 1 -- 172.21.2.105:0/3335758775 shutdown_connections 2021-11-12T06:35:47.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:47.195+0000 7f32fb955700 1 -- 172.21.2.105:0/3335758775 wait complete. 2021-11-12T06:35:48.207 INFO:tasks.ceph:Scrubbing osd.0 2021-11-12T06:35:48.208 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2021-11-12T06:35:48.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.263+0000 7fc228b41700 1 Processor -- start 2021-11-12T06:35:48.275 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.263+0000 7fc228b41700 1 -- start start 2021-11-12T06:35:48.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc228b41700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fc2240b14f0 0x7fc2240b68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:48.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc228b41700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc22413fd30 con 0x7fc2240b64d0 2021-11-12T06:35:48.276 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc228b41700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc22413ffd0 con 0x7fc2240ade50 2021-11-12T06:35:48.277 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc228b41700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2240ae820 con 0x7fc2240b14f0 2021-11-12T06:35:48.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc2237fe700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fc2240b64d0 0x7fc224140470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:35654/0 (socket says 172.21.2.105:35654) 2021-11-12T06:35:48.278 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc2237fe700 1 -- 172.21.2.105:0/792733802 learned_addr learned my addr 172.21.2.105:0/792733802 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T06:35:48.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc2227fc700 1 -- 172.21.2.105:0/792733802 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4142140318 0 0) 0x7fc22413fd30 con 0x7fc2240b64d0 2021-11-12T06:35:48.279 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc2227fc700 1 -- 172.21.2.105:0/792733802 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc204003260 con 0x7fc2240b64d0 2021-11-12T06:35:48.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc2227fc700 1 -- 172.21.2.105:0/792733802 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 893964695 0 0) 0x7fc204003260 con 0x7fc2240b64d0 2021-11-12T06:35:48.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc2227fc700 1 -- 172.21.2.105:0/792733802 >> v2:172.21.2.115:3300/0 conn(0x7fc2240b14f0 msgr2=0x7fc2240b68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T06:35:48.280 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc2227fc700 1 --2- 172.21.2.105:0/792733802 >> v2:172.21.2.115:3300/0 conn(0x7fc2240b14f0 0x7fc2240b68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:48.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc2227fc700 1 -- 172.21.2.105:0/792733802 >> v1:172.21.2.115:6789/0 conn(0x7fc2240ade50 legacy=0x7fc2241396c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T06:35:48.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc2227fc700 1 -- 172.21.2.105:0/792733802 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2240b1b50 con 0x7fc2240b64d0 2021-11-12T06:35:48.281 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc2227fc700 1 -- 172.21.2.105:0/792733802 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fc20c001660 con 0x7fc2240b64d0 2021-11-12T06:35:48.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc2227fc700 1 -- 172.21.2.105:0/792733802 >> v1:172.21.2.105:6789/0 conn(0x7fc2240b64d0 legacy=0x7fc224140470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:48.282 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc2227fc700 1 --2- 172.21.2.105:0/792733802 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc204003750 0x7fc204003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:48.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc2227fc700 1 --2- 172.21.2.105:0/792733802 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc204004500 0x7fc204004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:48.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc2227fc700 1 --2- 172.21.2.105:0/792733802 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc204004f90 0x7fc20400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:48.283 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc2227fc700 1 -- 172.21.2.105:0/792733802 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2240ae820 con 0x7fc204003750 2021-11-12T06:35:48.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc2227fc700 1 -- 172.21.2.105:0/792733802 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20400be80 con 0x7fc204004f90 2021-11-12T06:35:48.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc2227fc700 1 -- 172.21.2.105:0/792733802 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc20400c040 con 0x7fc204004500 2021-11-12T06:35:48.284 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc2237fe700 1 --2- 172.21.2.105:0/792733802 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc204003750 0x7fc204003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:48.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc2237fe700 1 -- 172.21.2.105:0/792733802 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc204004500 msgr2=0x7fc204004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T06:35:48.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc2237fe700 1 --2- 172.21.2.105:0/792733802 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc204004500 0x7fc204004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:48.285 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc2237fe700 1 -- 172.21.2.105:0/792733802 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc204004f90 msgr2=0x7fc20400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T06:35:48.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc2237fe700 1 --2- 172.21.2.105:0/792733802 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc204004f90 0x7fc20400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:48.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc2237fe700 1 -- 172.21.2.105:0/792733802 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc204003260 con 0x7fc204003750 2021-11-12T06:35:48.286 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc223fff700 1 -- 172.21.2.105:0/792733802 reap_dead start 2021-11-12T06:35:48.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc2237fe700 1 --2- 172.21.2.105:0/792733802 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc204003750 0x7fc204003b50 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 rx=0x7fc2240b3f50 tx=0x7fc22413fec0).ready entity=mon.0 client_cookie=8fdbd2671237e5e1 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:48.287 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc2227fc700 1 -- 172.21.2.105:0/792733802 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc20c0071a0 con 0x7fc204003750 2021-11-12T06:35:48.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc2227fc700 1 -- 172.21.2.105:0/792733802 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20c007300 con 0x7fc204003750 2021-11-12T06:35:48.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc2227fc700 1 -- 172.21.2.105:0/792733802 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc20c00c8f0 con 0x7fc204003750 2021-11-12T06:35:48.288 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc228b41700 1 -- 172.21.2.105:0/792733802 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc204003750 msgr2=0x7fc204003b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:48.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc228b41700 1 --2- 172.21.2.105:0/792733802 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc204003750 0x7fc204003b50 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 rx=0x7fc2240b3f50 tx=0x7fc22413fec0).stop 2021-11-12T06:35:48.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc228b41700 1 -- 172.21.2.105:0/792733802 shutdown_connections 2021-11-12T06:35:48.289 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc228b41700 1 --2- 172.21.2.105:0/792733802 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc204003750 0x7fc204003b50 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:48.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc228b41700 1 -- 172.21.2.105:0/792733802 >> 172.21.2.105:0/792733802 conn(0x7fc2240613f0 msgr2=0x7fc2240617d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:48.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc228b41700 1 -- 172.21.2.105:0/792733802 shutdown_connections 2021-11-12T06:35:48.290 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc228b41700 1 -- 172.21.2.105:0/792733802 wait complete. 2021-11-12T06:35:48.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc228b41700 1 Processor -- start 2021-11-12T06:35:48.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc228b41700 1 -- start start 2021-11-12T06:35:48.291 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc228b41700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc204003750 0x7fc224136300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:48.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc228b41700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc224064b40 0x7fc224063cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:48.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc228b41700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc224065520 0x7fc22412f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:48.292 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc228b41700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc224130a50 con 0x7fc224064b40 2021-11-12T06:35:48.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc228b41700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc224065d70 con 0x7fc204003750 2021-11-12T06:35:48.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc228b41700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc224066010 con 0x7fc224065520 2021-11-12T06:35:48.293 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc222ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc224064b40 0x7fc224063cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:48.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc222ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc224064b40 0x7fc224063cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53502/0 (socket says 172.21.2.105:53502) 2021-11-12T06:35:48.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.267+0000 7fc222ffd700 1 -- 172.21.2.105:0/2495415329 learned_addr learned my addr 172.21.2.105:0/2495415329 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T06:35:48.294 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.271+0000 7fc222ffd700 1 -- 172.21.2.105:0/2495415329 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc224065520 msgr2=0x7fc22412f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:48.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.271+0000 7fc222ffd700 1 --2- 172.21.2.105:0/2495415329 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fc224065520 0x7fc22412f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:48.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.271+0000 7fc222ffd700 1 -- 172.21.2.105:0/2495415329 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc204003750 msgr2=0x7fc224136300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:48.295 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.271+0000 7fc222ffd700 1 --2- 172.21.2.105:0/2495415329 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fc204003750 0x7fc224136300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:48.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.271+0000 7fc222ffd700 1 -- 172.21.2.105:0/2495415329 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2240659a0 con 0x7fc224064b40 2021-11-12T06:35:48.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.271+0000 7fc222ffd700 1 --2- 172.21.2.105:0/2495415329 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc224064b40 0x7fc224063cb0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 rx=0x7fc214000fc0 tx=0x7fc214006db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:48.296 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.271+0000 7fc220ff9700 1 -- 172.21.2.105:0/2495415329 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc214013460 con 0x7fc224064b40 2021-11-12T06:35:48.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.271+0000 7fc220ff9700 1 -- 172.21.2.105:0/2495415329 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2140135c0 con 0x7fc224064b40 2021-11-12T06:35:48.297 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.271+0000 7fc220ff9700 1 -- 172.21.2.105:0/2495415329 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc214013920 con 0x7fc224064b40 2021-11-12T06:35:48.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.271+0000 7fc228b41700 1 -- 172.21.2.105:0/2495415329 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc22412fb10 con 0x7fc224064b40 2021-11-12T06:35:48.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.271+0000 7fc228b41700 1 -- 172.21.2.105:0/2495415329 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc22412ffc0 con 0x7fc224064b40 2021-11-12T06:35:48.298 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.271+0000 7fc228b41700 1 -- 172.21.2.105:0/2495415329 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc224065b90 con 0x7fc224064b40 2021-11-12T06:35:48.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.271+0000 7fc220ff9700 1 -- 172.21.2.105:0/2495415329 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fc21400f070 con 0x7fc224064b40 2021-11-12T06:35:48.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.271+0000 7fc220ff9700 1 --2- 172.21.2.105:0/2495415329 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc208053610 0x7fc208055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:48.299 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.271+0000 7fc220ff9700 1 -- 172.21.2.105:0/2495415329 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fc21406b0a0 con 0x7fc224064b40 2021-11-12T06:35:48.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.271+0000 7fc220ff9700 1 --2- 172.21.2.105:0/2495415329 >> [v2:172.21.2.105:6802/14874,v1:172.21.2.105:6803/14874] conn(0x7fc20805a3a0 0x7fc20805c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:48.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.271+0000 7fc220ff9700 1 -- 172.21.2.105:0/2495415329 --> [v2:172.21.2.105:6802/14874,v1:172.21.2.105:6803/14874] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc20805cd80 con 0x7fc20805a3a0 2021-11-12T06:35:48.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.271+0000 7fc220ff9700 1 -- 172.21.2.105:0/2495415329 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=159) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc21406d660 con 0x7fc224064b40 2021-11-12T06:35:48.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.271+0000 7fc2237fe700 1 --2- 172.21.2.105:0/2495415329 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc208053610 0x7fc208055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:48.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.271+0000 7fc223fff700 1 --2- 172.21.2.105:0/2495415329 >> [v2:172.21.2.105:6802/14874,v1:172.21.2.105:6803/14874] conn(0x7fc20805a3a0 0x7fc20805c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:48.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.271+0000 7fc2237fe700 1 --2- 172.21.2.105:0/2495415329 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc208053610 0x7fc208055ad0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7fc2240b3f50 tx=0x7fc20c015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:48.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.271+0000 7fc223fff700 1 --2- 172.21.2.105:0/2495415329 >> [v2:172.21.2.105:6802/14874,v1:172.21.2.105:6803/14874] conn(0x7fc20805a3a0 0x7fc20805c7c0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:48.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.271+0000 7fc220ff9700 1 -- 172.21.2.105:0/2495415329 <== osd.0 v2:172.21.2.105:6802/14874 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7fc20805cd80 con 0x7fc20805a3a0 2021-11-12T06:35:48.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.279+0000 7fc228b41700 1 -- 172.21.2.105:0/2495415329 --> [v2:172.21.2.105:6802/14874,v1:172.21.2.105:6803/14874] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc22413fa20 con 0x7fc20805a3a0 2021-11-12T06:35:48.305 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T06:35:48.305 INFO:teuthology.orchestra.run.gibba005.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-11-12T06:35:48.306 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T06:35:48.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.279+0000 7fc220ff9700 1 -- 172.21.2.105:0/2495415329 <== osd.0 v2:172.21.2.105:6802/14874 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc22413fa20 con 0x7fc20805a3a0 2021-11-12T06:35:48.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.279+0000 7fc228b41700 1 -- 172.21.2.105:0/2495415329 >> [v2:172.21.2.105:6802/14874,v1:172.21.2.105:6803/14874] conn(0x7fc20805a3a0 msgr2=0x7fc20805c7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:48.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.279+0000 7fc228b41700 1 --2- 172.21.2.105:0/2495415329 >> [v2:172.21.2.105:6802/14874,v1:172.21.2.105:6803/14874] conn(0x7fc20805a3a0 0x7fc20805c7c0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:48.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.279+0000 7fc228b41700 1 -- 172.21.2.105:0/2495415329 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc208053610 msgr2=0x7fc208055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:48.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.279+0000 7fc228b41700 1 --2- 172.21.2.105:0/2495415329 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fc208053610 0x7fc208055ad0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7fc2240b3f50 tx=0x7fc20c015000).stop 2021-11-12T06:35:48.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.279+0000 7fc228b41700 1 -- 172.21.2.105:0/2495415329 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc224064b40 msgr2=0x7fc224063cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:48.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.279+0000 7fc228b41700 1 --2- 172.21.2.105:0/2495415329 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fc224064b40 0x7fc224063cb0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 rx=0x7fc214000fc0 tx=0x7fc214006db0).stop 2021-11-12T06:35:48.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.279+0000 7fc223fff700 1 -- 172.21.2.105:0/2495415329 reap_dead start 2021-11-12T06:35:48.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.279+0000 7fc228b41700 1 -- 172.21.2.105:0/2495415329 shutdown_connections 2021-11-12T06:35:48.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.279+0000 7fc228b41700 1 -- 172.21.2.105:0/2495415329 >> 172.21.2.105:0/2495415329 conn(0x7fc2240613f0 msgr2=0x7fc2240b52f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:48.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.283+0000 7fc228b41700 1 -- 172.21.2.105:0/2495415329 shutdown_connections 2021-11-12T06:35:48.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.283+0000 7fc228b41700 1 -- 172.21.2.105:0/2495415329 wait complete. 2021-11-12T06:35:48.313 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2021-11-12T06:35:48.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.419+0000 7fef5f9fe700 1 Processor -- start 2021-11-12T06:35:48.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.419+0000 7fef5f9fe700 1 -- start start 2021-11-12T06:35:48.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef5f9fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fef580ad080 0x7fef580af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:48.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef5f9fe700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef580ac7b0 con 0x7fef5814b2f0 2021-11-12T06:35:48.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef5f9fe700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef580ac9e0 con 0x7fef580ac280 2021-11-12T06:35:48.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef5f9fe700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef581488a0 con 0x7fef580ad080 2021-11-12T06:35:48.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef5df9b700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fef5814b2f0 0x7fef58147a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:35680/0 (socket says 172.21.2.105:35680) 2021-11-12T06:35:48.428 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef5d79a700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fef580ad080 0x7fef580af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:48.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef5df9b700 1 -- 172.21.2.105:0/3753948160 learned_addr learned my addr 172.21.2.105:0/3753948160 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T06:35:48.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef5d79a700 1 -- 172.21.2.105:0/3753948160 >> v1:172.21.2.115:6789/0 conn(0x7fef580ac280 legacy=0x7fef5814abe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T06:35:48.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef5d79a700 1 -- 172.21.2.105:0/3753948160 >> v1:172.21.2.105:6789/0 conn(0x7fef5814b2f0 legacy=0x7fef58147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:48.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef5d79a700 1 -- 172.21.2.105:0/3753948160 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef580b0b30 con 0x7fef580ad080 2021-11-12T06:35:48.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef5d79a700 1 --2- 172.21.2.105:0/3753948160 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fef580ad080 0x7fef580af730 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 rx=0x7fef580b0eb0 tx=0x7fef54006df0).ready entity=mon.0 client_cookie=4f2eaa9dc4cd837e server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:48.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef4bfff700 1 -- 172.21.2.105:0/3753948160 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef5400d5c0 con 0x7fef580ad080 2021-11-12T06:35:48.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef4bfff700 1 -- 172.21.2.105:0/3753948160 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef54000e90 con 0x7fef580ad080 2021-11-12T06:35:48.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef4bfff700 1 -- 172.21.2.105:0/3753948160 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef5400d910 con 0x7fef580ad080 2021-11-12T06:35:48.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef5f9fe700 1 -- 172.21.2.105:0/3753948160 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fef580ad080 msgr2=0x7fef580af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:48.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef5f9fe700 1 --2- 172.21.2.105:0/3753948160 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fef580ad080 0x7fef580af730 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 rx=0x7fef580b0eb0 tx=0x7fef54006df0).stop 2021-11-12T06:35:48.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef5f9fe700 1 -- 172.21.2.105:0/3753948160 shutdown_connections 2021-11-12T06:35:48.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef5f9fe700 1 --2- 172.21.2.105:0/3753948160 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fef580ad080 0x7fef580af730 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:48.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef5f9fe700 1 -- 172.21.2.105:0/3753948160 >> 172.21.2.105:0/3753948160 conn(0x7fef580b5370 msgr2=0x7fef580b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:48.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef5f9fe700 1 -- 172.21.2.105:0/3753948160 shutdown_connections 2021-11-12T06:35:48.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef5f9fe700 1 -- 172.21.2.105:0/3753948160 wait complete. 2021-11-12T06:35:48.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef5f9fe700 1 Processor -- start 2021-11-12T06:35:48.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef5f9fe700 1 -- start start 2021-11-12T06:35:48.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef5f9fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fef580ac280 0x7fef580aac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:48.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef5f9fe700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fef580ad080 0x7fef580a9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:48.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef5f9fe700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fef5814b2f0 0x7fef580ab3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:48.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef5f9fe700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef580641f0 con 0x7fef580ac280 2021-11-12T06:35:48.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef5f9fe700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef58064490 con 0x7fef5814b2f0 2021-11-12T06:35:48.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef5f9fe700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef580a97a0 con 0x7fef580ad080 2021-11-12T06:35:48.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef5d79a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fef580ac280 0x7fef580aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:48.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef5d79a700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fef580ac280 0x7fef580aac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53520/0 (socket says 172.21.2.105:53520) 2021-11-12T06:35:48.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef5d79a700 1 -- 172.21.2.105:0/3136672294 learned_addr learned my addr 172.21.2.105:0/3136672294 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T06:35:48.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef5d79a700 1 -- 172.21.2.105:0/3136672294 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fef580ad080 msgr2=0x7fef580a9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:48.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef5d79a700 1 --2- 172.21.2.105:0/3136672294 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fef580ad080 0x7fef580a9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:48.443 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef5d79a700 1 -- 172.21.2.105:0/3136672294 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fef5814b2f0 msgr2=0x7fef580ab3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:48.443 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef5d79a700 1 --2- 172.21.2.105:0/3136672294 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fef5814b2f0 0x7fef580ab3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:48.444 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef5d79a700 1 -- 172.21.2.105:0/3136672294 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5400b180 con 0x7fef580ac280 2021-11-12T06:35:48.444 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef5d79a700 1 --2- 172.21.2.105:0/3136672294 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fef580ac280 0x7fef580aac80 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 rx=0x7fef580b0eb0 tx=0x7fef54012000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:48.445 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef4a7fc700 1 -- 172.21.2.105:0/3136672294 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef54016070 con 0x7fef580ac280 2021-11-12T06:35:48.445 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef4a7fc700 1 -- 172.21.2.105:0/3136672294 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef54002f50 con 0x7fef580ac280 2021-11-12T06:35:48.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef5f9fe700 1 -- 172.21.2.105:0/3136672294 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef580a9c40 con 0x7fef580ac280 2021-11-12T06:35:48.446 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef4a7fc700 1 -- 172.21.2.105:0/3136672294 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef5401e450 con 0x7fef580ac280 2021-11-12T06:35:48.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.423+0000 7fef5f9fe700 1 -- 172.21.2.105:0/3136672294 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef58066a90 con 0x7fef580ac280 2021-11-12T06:35:48.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.427+0000 7fef5f9fe700 1 -- 172.21.2.105:0/3136672294 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef580a9960 con 0x7fef580ac280 2021-11-12T06:35:48.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.427+0000 7fef4a7fc700 1 -- 172.21.2.105:0/3136672294 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fef54025030 con 0x7fef580ac280 2021-11-12T06:35:48.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.427+0000 7fef4a7fc700 1 --2- 172.21.2.105:0/3136672294 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fef380536a0 0x7fef38055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:48.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.427+0000 7fef4a7fc700 1 -- 172.21.2.105:0/3136672294 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fef5406c8c0 con 0x7fef580ac280 2021-11-12T06:35:48.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.427+0000 7fef5cf99700 1 --2- 172.21.2.105:0/3136672294 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fef380536a0 0x7fef38055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:48.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.427+0000 7fef5cf99700 1 --2- 172.21.2.105:0/3136672294 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fef380536a0 0x7fef38055b60 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7fef4c002fb0 tx=0x7fef4c0069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:48.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.427+0000 7fef4a7fc700 1 -- 172.21.2.105:0/3136672294 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fef54043ba0 con 0x7fef580ac280 2021-11-12T06:35:48.513 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.511+0000 7fef5f9fe700 1 -- 172.21.2.105:0/3136672294 --> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fef58057350 con 0x7fef380536a0 2021-11-12T06:35:48.514 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.511+0000 7fef4a7fc700 1 -- 172.21.2.105:0/3136672294 <== mgr.4107 v2:172.21.2.105:6800/14730 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fef58057350 con 0x7fef380536a0 2021-11-12T06:35:48.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.511+0000 7fef5f9fe700 1 -- 172.21.2.105:0/3136672294 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fef380536a0 msgr2=0x7fef38055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:48.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.511+0000 7fef5f9fe700 1 --2- 172.21.2.105:0/3136672294 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fef380536a0 0x7fef38055b60 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7fef4c002fb0 tx=0x7fef4c0069b0).stop 2021-11-12T06:35:48.515 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.511+0000 7fef5f9fe700 1 -- 172.21.2.105:0/3136672294 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fef580ac280 msgr2=0x7fef580aac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:48.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.511+0000 7fef5f9fe700 1 --2- 172.21.2.105:0/3136672294 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fef580ac280 0x7fef580aac80 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 rx=0x7fef580b0eb0 tx=0x7fef54012000).stop 2021-11-12T06:35:48.516 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.511+0000 7fef5f9fe700 1 -- 172.21.2.105:0/3136672294 shutdown_connections 2021-11-12T06:35:48.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.511+0000 7fef5f9fe700 1 --2- 172.21.2.105:0/3136672294 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fef380536a0 0x7fef38055b60 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:48.517 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.511+0000 7fef5f9fe700 1 --2- 172.21.2.105:0/3136672294 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fef5814b2f0 0x7fef580ab3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:48.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.511+0000 7fef5f9fe700 1 --2- 172.21.2.105:0/3136672294 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fef580ad080 0x7fef580a9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:48.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.511+0000 7fef5f9fe700 1 --2- 172.21.2.105:0/3136672294 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fef580ac280 0x7fef580aac80 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:48.518 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.511+0000 7fef5f9fe700 1 -- 172.21.2.105:0/3136672294 >> 172.21.2.105:0/3136672294 conn(0x7fef580b5370 msgr2=0x7fef5814aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:48.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.511+0000 7fef5f9fe700 1 -- 172.21.2.105:0/3136672294 shutdown_connections 2021-11-12T06:35:48.519 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.511+0000 7fef5f9fe700 1 -- 172.21.2.105:0/3136672294 wait complete. 2021-11-12T06:35:48.519 INFO:teuthology.orchestra.run.gibba005.stderr:instructed osd(s) 0 to deep-scrub 2021-11-12T06:35:48.521 INFO:tasks.ceph:Scrubbing osd.1 2021-11-12T06:35:48.521 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2021-11-12T06:35:48.577 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.575+0000 7fa8d5a0e700 1 Processor -- start 2021-11-12T06:35:48.578 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.575+0000 7fa8d5a0e700 1 -- start start 2021-11-12T06:35:48.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.575+0000 7fa8d5a0e700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fa8d014b2f0 0x7fa8d00af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:48.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.575+0000 7fa8d5a0e700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d00ac7b0 con 0x7fa8d00ac280 2021-11-12T06:35:48.579 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.575+0000 7fa8d5a0e700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d00ac9e0 con 0x7fa8d00ad080 2021-11-12T06:35:48.580 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.575+0000 7fa8d5a0e700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d01488a0 con 0x7fa8d014b2f0 2021-11-12T06:35:48.585 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.575+0000 7fa8ce7fc700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fa8d00ac280 0x7fa8d0147a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:35694/0 (socket says 172.21.2.105:35694) 2021-11-12T06:35:48.586 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.575+0000 7fa8ce7fc700 1 -- 172.21.2.105:0/2325060105 learned_addr learned my addr 172.21.2.105:0/2325060105 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T06:35:48.586 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.575+0000 7fa8cdffb700 1 -- 172.21.2.105:0/2325060105 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 192751584 0 0) 0x7fa8d00ac7b0 con 0x7fa8d00ac280 2021-11-12T06:35:48.586 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.575+0000 7fa8cdffb700 1 -- 172.21.2.105:0/2325060105 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8b4003260 con 0x7fa8d00ac280 2021-11-12T06:35:48.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.575+0000 7fa8cf7fe700 1 --2- 172.21.2.105:0/2325060105 >> v2:172.21.2.115:3300/0 conn(0x7fa8d014b2f0 0x7fa8d00af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:48.587 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.575+0000 7fa8cdffb700 1 -- 172.21.2.105:0/2325060105 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1769464134 0 0) 0x7fa8b4003260 con 0x7fa8d00ac280 2021-11-12T06:35:48.588 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.575+0000 7fa8cdffb700 1 -- 172.21.2.105:0/2325060105 >> v2:172.21.2.115:3300/0 conn(0x7fa8d014b2f0 msgr2=0x7fa8d00af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T06:35:48.588 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.575+0000 7fa8cdffb700 1 --2- 172.21.2.105:0/2325060105 >> v2:172.21.2.115:3300/0 conn(0x7fa8d014b2f0 0x7fa8d00af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:48.588 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.575+0000 7fa8cdffb700 1 -- 172.21.2.105:0/2325060105 >> v1:172.21.2.115:6789/0 conn(0x7fa8d00ad080 legacy=0x7fa8d014abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T06:35:48.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.575+0000 7fa8cdffb700 1 -- 172.21.2.105:0/2325060105 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d00b0b30 con 0x7fa8d00ac280 2021-11-12T06:35:48.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.575+0000 7fa8cdffb700 1 -- 172.21.2.105:0/2325060105 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fa8c0001660 con 0x7fa8d00ac280 2021-11-12T06:35:48.589 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.575+0000 7fa8cdffb700 1 -- 172.21.2.105:0/2325060105 >> v1:172.21.2.105:6789/0 conn(0x7fa8d00ac280 legacy=0x7fa8d0147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:48.590 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.575+0000 7fa8cdffb700 1 --2- 172.21.2.105:0/2325060105 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa8b4003820 0x7fa8b4003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:48.590 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.575+0000 7fa8cdffb700 1 --2- 172.21.2.105:0/2325060105 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa8b4004500 0x7fa8b4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:48.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.575+0000 7fa8cdffb700 1 --2- 172.21.2.105:0/2325060105 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa8b4005050 0x7fa8b400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:48.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.575+0000 7fa8cdffb700 1 -- 172.21.2.105:0/2325060105 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d01488a0 con 0x7fa8b4003820 2021-11-12T06:35:48.591 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.575+0000 7fa8cdffb700 1 -- 172.21.2.105:0/2325060105 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b400bf40 con 0x7fa8b4004500 2021-11-12T06:35:48.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.575+0000 7fa8cdffb700 1 -- 172.21.2.105:0/2325060105 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b400c100 con 0x7fa8b4005050 2021-11-12T06:35:48.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.575+0000 7fa8ceffd700 1 --2- 172.21.2.105:0/2325060105 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa8b4003820 0x7fa8b4003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:48.592 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.575+0000 7fa8ceffd700 1 -- 172.21.2.105:0/2325060105 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa8b4005050 msgr2=0x7fa8b400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T06:35:48.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.575+0000 7fa8ceffd700 1 --2- 172.21.2.105:0/2325060105 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa8b4005050 0x7fa8b400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:48.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.575+0000 7fa8ceffd700 1 -- 172.21.2.105:0/2325060105 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa8b4004500 msgr2=0x7fa8b4004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T06:35:48.593 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.575+0000 7fa8ceffd700 1 --2- 172.21.2.105:0/2325060105 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa8b4004500 0x7fa8b4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:48.594 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.579+0000 7fa8cf7fe700 1 -- 172.21.2.105:0/2325060105 reap_dead start 2021-11-12T06:35:48.594 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.579+0000 7fa8ceffd700 1 -- 172.21.2.105:0/2325060105 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b4003260 con 0x7fa8b4003820 2021-11-12T06:35:48.594 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.579+0000 7fa8ceffd700 1 --2- 172.21.2.105:0/2325060105 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa8b4003820 0x7fa8b4003c20 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 rx=0x7fa8c4000f70 tx=0x7fa8c40079e0).ready entity=mon.0 client_cookie=585912731e318f76 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:48.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.579+0000 7fa8cdffb700 1 -- 172.21.2.105:0/2325060105 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8c4007cf0 con 0x7fa8b4003820 2021-11-12T06:35:48.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.579+0000 7fa8cdffb700 1 -- 172.21.2.105:0/2325060105 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c4014410 con 0x7fa8b4003820 2021-11-12T06:35:48.595 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.579+0000 7fa8cdffb700 1 -- 172.21.2.105:0/2325060105 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8c4014770 con 0x7fa8b4003820 2021-11-12T06:35:48.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.579+0000 7fa8d5a0e700 1 -- 172.21.2.105:0/2325060105 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa8b4003820 msgr2=0x7fa8b4003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:48.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.579+0000 7fa8d5a0e700 1 --2- 172.21.2.105:0/2325060105 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa8b4003820 0x7fa8b4003c20 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 rx=0x7fa8c4000f70 tx=0x7fa8c40079e0).stop 2021-11-12T06:35:48.596 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.579+0000 7fa8d5a0e700 1 -- 172.21.2.105:0/2325060105 shutdown_connections 2021-11-12T06:35:48.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.579+0000 7fa8d5a0e700 1 --2- 172.21.2.105:0/2325060105 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa8b4003820 0x7fa8b4003c20 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:48.597 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.579+0000 7fa8d5a0e700 1 -- 172.21.2.105:0/2325060105 >> 172.21.2.105:0/2325060105 conn(0x7fa8d00b5370 msgr2=0x7fa8d00b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:48.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.579+0000 7fa8d5a0e700 1 -- 172.21.2.105:0/2325060105 shutdown_connections 2021-11-12T06:35:48.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.579+0000 7fa8d5a0e700 1 -- 172.21.2.105:0/2325060105 wait complete. 2021-11-12T06:35:48.598 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.579+0000 7fa8d5a0e700 1 Processor -- start 2021-11-12T06:35:48.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.579+0000 7fa8d5a0e700 1 -- start start 2021-11-12T06:35:48.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.579+0000 7fa8d5a0e700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa8b4003820 0x7fa8d015a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:48.599 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.579+0000 7fa8d5a0e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa8d00ab2b0 0x7fa8d015aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:48.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.579+0000 7fa8d5a0e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa8d00a8080 0x7fa8d00a8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:48.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.579+0000 7fa8d5a0e700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d015b1a0 con 0x7fa8d00ab2b0 2021-11-12T06:35:48.600 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.579+0000 7fa8d5a0e700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d00aae80 con 0x7fa8b4003820 2021-11-12T06:35:48.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.579+0000 7fa8d5a0e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d00a9630 con 0x7fa8d00a8080 2021-11-12T06:35:48.601 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.579+0000 7fa8ce7fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa8d00ab2b0 0x7fa8d015aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:48.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.579+0000 7fa8ce7fc700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa8d00ab2b0 0x7fa8d015aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53540/0 (socket says 172.21.2.105:53540) 2021-11-12T06:35:48.602 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.579+0000 7fa8ce7fc700 1 -- 172.21.2.105:0/2588339638 learned_addr learned my addr 172.21.2.105:0/2588339638 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T06:35:48.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.579+0000 7fa8ce7fc700 1 -- 172.21.2.105:0/2588339638 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa8d00a8080 msgr2=0x7fa8d00a8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:48.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.579+0000 7fa8ce7fc700 1 --2- 172.21.2.105:0/2588339638 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa8d00a8080 0x7fa8d00a8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:48.603 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.579+0000 7fa8ce7fc700 1 -- 172.21.2.105:0/2588339638 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa8b4003820 msgr2=0x7fa8d015a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:48.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.579+0000 7fa8ce7fc700 1 --2- 172.21.2.105:0/2588339638 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa8b4003820 0x7fa8d015a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:48.604 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.579+0000 7fa8ce7fc700 1 -- 172.21.2.105:0/2588339638 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d00a8a00 con 0x7fa8d00ab2b0 2021-11-12T06:35:48.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.579+0000 7fa8ce7fc700 1 --2- 172.21.2.105:0/2588339638 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa8d00ab2b0 0x7fa8d015aa80 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 rx=0x7fa8d0154810 tx=0x7fa8d00ada20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:48.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.579+0000 7fa8bffff700 1 -- 172.21.2.105:0/2588339638 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8c0007170 con 0x7fa8d00ab2b0 2021-11-12T06:35:48.605 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.579+0000 7fa8bffff700 1 -- 172.21.2.105:0/2588339638 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c00072d0 con 0x7fa8d00ab2b0 2021-11-12T06:35:48.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.579+0000 7fa8d5a0e700 1 -- 172.21.2.105:0/2588339638 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d0157db0 con 0x7fa8d00ab2b0 2021-11-12T06:35:48.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.579+0000 7fa8bffff700 1 -- 172.21.2.105:0/2588339638 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8c0004920 con 0x7fa8d00ab2b0 2021-11-12T06:35:48.606 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.579+0000 7fa8d5a0e700 1 -- 172.21.2.105:0/2588339638 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d00a92b0 con 0x7fa8d00ab2b0 2021-11-12T06:35:48.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.579+0000 7fa8d5a0e700 1 -- 172.21.2.105:0/2588339638 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa8d00ab010 con 0x7fa8d00ab2b0 2021-11-12T06:35:48.607 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.583+0000 7fa8bffff700 1 -- 172.21.2.105:0/2588339638 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa8c0004a80 con 0x7fa8d00ab2b0 2021-11-12T06:35:48.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.583+0000 7fa8bffff700 1 --2- 172.21.2.105:0/2588339638 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa8ac053640 0x7fa8ac055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:48.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.583+0000 7fa8bffff700 1 -- 172.21.2.105:0/2588339638 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fa8c006be10 con 0x7fa8d00ab2b0 2021-11-12T06:35:48.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.583+0000 7fa8bffff700 1 --2- 172.21.2.105:0/2588339638 >> [v2:172.21.2.105:6810/14875,v1:172.21.2.105:6811/14875] conn(0x7fa8ac05a450 0x7fa8ac05c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:48.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.583+0000 7fa8bffff700 1 -- 172.21.2.105:0/2588339638 --> [v2:172.21.2.105:6810/14875,v1:172.21.2.105:6811/14875] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa8ac05ce30 con 0x7fa8ac05a450 2021-11-12T06:35:48.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.583+0000 7fa8bffff700 1 -- 172.21.2.105:0/2588339638 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=159) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa8c006c120 con 0x7fa8d00ab2b0 2021-11-12T06:35:48.609 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.583+0000 7fa8ceffd700 1 --2- 172.21.2.105:0/2588339638 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa8ac053640 0x7fa8ac055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:48.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.583+0000 7fa8cf7fe700 1 --2- 172.21.2.105:0/2588339638 >> [v2:172.21.2.105:6810/14875,v1:172.21.2.105:6811/14875] conn(0x7fa8ac05a450 0x7fa8ac05c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:48.610 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.583+0000 7fa8ceffd700 1 --2- 172.21.2.105:0/2588339638 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa8ac053640 0x7fa8ac055b00 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7fa8c4000f70 tx=0x7fa8c4015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:48.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.583+0000 7fa8cf7fe700 1 --2- 172.21.2.105:0/2588339638 >> [v2:172.21.2.105:6810/14875,v1:172.21.2.105:6811/14875] conn(0x7fa8ac05a450 0x7fa8ac05c870 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:48.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.583+0000 7fa8bffff700 1 -- 172.21.2.105:0/2588339638 <== osd.1 v2:172.21.2.105:6810/14875 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7fa8ac05ce30 con 0x7fa8ac05a450 2021-11-12T06:35:48.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.591+0000 7fa8d5a0e700 1 -- 172.21.2.105:0/2588339638 --> [v2:172.21.2.105:6810/14875,v1:172.21.2.105:6811/14875] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa8d00b1440 con 0x7fa8ac05a450 2021-11-12T06:35:48.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.591+0000 7fa8bffff700 1 -- 172.21.2.105:0/2588339638 <== osd.1 v2:172.21.2.105:6810/14875 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa8d00b1440 con 0x7fa8ac05a450 2021-11-12T06:35:48.614 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T06:35:48.614 INFO:teuthology.orchestra.run.gibba005.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-11-12T06:35:48.615 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T06:35:48.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.591+0000 7fa8d5a0e700 1 -- 172.21.2.105:0/2588339638 >> [v2:172.21.2.105:6810/14875,v1:172.21.2.105:6811/14875] conn(0x7fa8ac05a450 msgr2=0x7fa8ac05c870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:48.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.591+0000 7fa8d5a0e700 1 --2- 172.21.2.105:0/2588339638 >> [v2:172.21.2.105:6810/14875,v1:172.21.2.105:6811/14875] conn(0x7fa8ac05a450 0x7fa8ac05c870 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:48.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.591+0000 7fa8d5a0e700 1 -- 172.21.2.105:0/2588339638 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa8ac053640 msgr2=0x7fa8ac055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:48.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.591+0000 7fa8d5a0e700 1 --2- 172.21.2.105:0/2588339638 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa8ac053640 0x7fa8ac055b00 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7fa8c4000f70 tx=0x7fa8c4015000).stop 2021-11-12T06:35:48.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.591+0000 7fa8d5a0e700 1 -- 172.21.2.105:0/2588339638 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa8d00ab2b0 msgr2=0x7fa8d015aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:48.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.591+0000 7fa8d5a0e700 1 --2- 172.21.2.105:0/2588339638 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa8d00ab2b0 0x7fa8d015aa80 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 rx=0x7fa8d0154810 tx=0x7fa8d00ada20).stop 2021-11-12T06:35:48.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.591+0000 7fa8cf7fe700 1 -- 172.21.2.105:0/2588339638 reap_dead start 2021-11-12T06:35:48.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.591+0000 7fa8d5a0e700 1 -- 172.21.2.105:0/2588339638 shutdown_connections 2021-11-12T06:35:48.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.591+0000 7fa8d5a0e700 1 -- 172.21.2.105:0/2588339638 >> 172.21.2.105:0/2588339638 conn(0x7fa8d00b5370 msgr2=0x7fa8d0143c60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:48.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.591+0000 7fa8d5a0e700 1 -- 172.21.2.105:0/2588339638 shutdown_connections 2021-11-12T06:35:48.621 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.591+0000 7fa8d5a0e700 1 -- 172.21.2.105:0/2588339638 wait complete. 2021-11-12T06:35:48.621 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2021-11-12T06:35:48.735 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.731+0000 7eff08c59700 1 Processor -- start 2021-11-12T06:35:48.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.731+0000 7eff08c59700 1 -- start start 2021-11-12T06:35:48.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff08c59700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7eff040ad080 0x7eff040af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:48.736 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff08c59700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7eff040ac280 0x7eff040ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:48.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff08c59700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff040ac7b0 con 0x7eff0414abe0 2021-11-12T06:35:48.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff08c59700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff041488a0 con 0x7eff040ad080 2021-11-12T06:35:48.737 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff08c59700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff040ac9e0 con 0x7eff040ac280 2021-11-12T06:35:48.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff0259c700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7eff040ad080 0x7eff040af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:48.742 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff02d9d700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7eff0414abe0 0x7eff0414b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:35714/0 (socket says 172.21.2.105:35714) 2021-11-12T06:35:48.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff02d9d700 1 -- 172.21.2.105:0/3376972258 learned_addr learned my addr 172.21.2.105:0/3376972258 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T06:35:48.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff0259c700 1 -- 172.21.2.105:0/3376972258 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7eff040ac280 msgr2=0x7eff040ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T06:35:48.743 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff0259c700 1 --2- 172.21.2.105:0/3376972258 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7eff040ac280 0x7eff040ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:48.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff0259c700 1 -- 172.21.2.105:0/3376972258 >> v1:172.21.2.105:6789/0 conn(0x7eff0414abe0 legacy=0x7eff0414b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:48.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff0259c700 1 -- 172.21.2.105:0/3376972258 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff040b0b30 con 0x7eff040ad080 2021-11-12T06:35:48.744 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff0259c700 1 --2- 172.21.2.105:0/3376972258 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7eff040ad080 0x7eff040af730 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 rx=0x7efef4002f70 tx=0x7efef4006df0).ready entity=mon.0 client_cookie=e0e6ab188c3eb769 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:48.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff0159a700 1 -- 172.21.2.105:0/3376972258 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efef400d570 con 0x7eff040ad080 2021-11-12T06:35:48.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff0159a700 1 -- 172.21.2.105:0/3376972258 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef4000e90 con 0x7eff040ad080 2021-11-12T06:35:48.745 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff0159a700 1 -- 172.21.2.105:0/3376972258 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efef400d8c0 con 0x7eff040ad080 2021-11-12T06:35:48.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff08c59700 1 -- 172.21.2.105:0/3376972258 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7eff040ad080 msgr2=0x7eff040af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:48.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff08c59700 1 --2- 172.21.2.105:0/3376972258 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7eff040ad080 0x7eff040af730 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 rx=0x7efef4002f70 tx=0x7efef4006df0).stop 2021-11-12T06:35:48.746 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff08c59700 1 -- 172.21.2.105:0/3376972258 shutdown_connections 2021-11-12T06:35:48.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff08c59700 1 --2- 172.21.2.105:0/3376972258 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7eff040ac280 0x7eff040ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:48.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff08c59700 1 --2- 172.21.2.105:0/3376972258 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7eff040ad080 0x7eff040af730 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:48.747 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff08c59700 1 -- 172.21.2.105:0/3376972258 >> 172.21.2.105:0/3376972258 conn(0x7eff040b5370 msgr2=0x7eff040b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:48.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff08c59700 1 -- 172.21.2.105:0/3376972258 shutdown_connections 2021-11-12T06:35:48.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff08c59700 1 -- 172.21.2.105:0/3376972258 wait complete. 2021-11-12T06:35:48.748 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff08c59700 1 Processor -- start 2021-11-12T06:35:48.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff08c59700 1 -- start start 2021-11-12T06:35:48.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff08c59700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7eff040ac280 0x7eff040a7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:48.749 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff08c59700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7eff040ad080 0x7eff04145040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:48.750 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff08c59700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7eff0414abe0 0x7eff04066b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:48.750 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff08c59700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff040a9d40 con 0x7eff0414abe0 2021-11-12T06:35:48.750 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff08c59700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff040b5050 con 0x7eff040ac280 2021-11-12T06:35:48.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff08c59700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff04145530 con 0x7eff040ad080 2021-11-12T06:35:48.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff02d9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7eff0414abe0 0x7eff04066b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:48.751 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff02d9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7eff0414abe0 0x7eff04066b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53558/0 (socket says 172.21.2.105:53558) 2021-11-12T06:35:48.752 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff02d9d700 1 -- 172.21.2.105:0/4257418570 learned_addr learned my addr 172.21.2.105:0/4257418570 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T06:35:48.752 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff02d9d700 1 -- 172.21.2.105:0/4257418570 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7eff040ad080 msgr2=0x7eff04145040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:48.752 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff02d9d700 1 --2- 172.21.2.105:0/4257418570 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7eff040ad080 0x7eff04145040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:48.753 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff02d9d700 1 -- 172.21.2.105:0/4257418570 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7eff040ac280 msgr2=0x7eff040a7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:48.753 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff02d9d700 1 --2- 172.21.2.105:0/4257418570 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7eff040ac280 0x7eff040a7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:48.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff02d9d700 1 -- 172.21.2.105:0/4257418570 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef400b180 con 0x7eff0414abe0 2021-11-12T06:35:48.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff02d9d700 1 --2- 172.21.2.105:0/4257418570 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7eff0414abe0 0x7eff04066b30 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 rx=0x7eff040b6060 tx=0x7efefc007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:48.754 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7efefb7fe700 1 -- 172.21.2.105:0/4257418570 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efefc005ba0 con 0x7eff0414abe0 2021-11-12T06:35:48.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7efefb7fe700 1 -- 172.21.2.105:0/4257418570 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efefc005d00 con 0x7eff0414abe0 2021-11-12T06:35:48.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff08c59700 1 -- 172.21.2.105:0/4257418570 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff040aab40 con 0x7eff0414abe0 2021-11-12T06:35:48.755 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7efefb7fe700 1 -- 172.21.2.105:0/4257418570 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efefc0072c0 con 0x7eff0414abe0 2021-11-12T06:35:48.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.735+0000 7eff08c59700 1 -- 172.21.2.105:0/4257418570 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff040a9960 con 0x7eff0414abe0 2021-11-12T06:35:48.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.739+0000 7eff08c59700 1 -- 172.21.2.105:0/4257418570 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff040aae20 con 0x7eff0414abe0 2021-11-12T06:35:48.756 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.739+0000 7efefb7fe700 1 -- 172.21.2.105:0/4257418570 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7efefc010070 con 0x7eff0414abe0 2021-11-12T06:35:48.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.739+0000 7efefb7fe700 1 --2- 172.21.2.105:0/4257418570 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efee80536a0 0x7efee8055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:48.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.739+0000 7efefb7fe700 1 -- 172.21.2.105:0/4257418570 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5682+0+0 (secure 0 0 0) 0x7efefc06b0c0 con 0x7eff0414abe0 2021-11-12T06:35:48.757 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.739+0000 7eff0259c700 1 --2- 172.21.2.105:0/4257418570 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efee80536a0 0x7efee8055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:48.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.739+0000 7eff0259c700 1 --2- 172.21.2.105:0/4257418570 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efee80536a0 0x7efee8055b60 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7efef4002f70 tx=0x7efef4015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:48.758 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.739+0000 7efefb7fe700 1 -- 172.21.2.105:0/4257418570 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efefc042290 con 0x7eff0414abe0 2021-11-12T06:35:48.825 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.823+0000 7eff08c59700 1 -- 172.21.2.105:0/4257418570 --> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7eff040b1440 con 0x7efee80536a0 2021-11-12T06:35:48.826 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.823+0000 7efefb7fe700 1 -- 172.21.2.105:0/4257418570 <== mgr.4107 v2:172.21.2.105:6800/14730 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7eff040b1440 con 0x7efee80536a0 2021-11-12T06:35:48.827 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.823+0000 7eff08c59700 1 -- 172.21.2.105:0/4257418570 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efee80536a0 msgr2=0x7efee8055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:48.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.823+0000 7eff08c59700 1 --2- 172.21.2.105:0/4257418570 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efee80536a0 0x7efee8055b60 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7efef4002f70 tx=0x7efef4015000).stop 2021-11-12T06:35:48.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.823+0000 7eff08c59700 1 -- 172.21.2.105:0/4257418570 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7eff0414abe0 msgr2=0x7eff04066b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:48.828 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.823+0000 7eff08c59700 1 --2- 172.21.2.105:0/4257418570 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7eff0414abe0 0x7eff04066b30 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 rx=0x7eff040b6060 tx=0x7efefc007f60).stop 2021-11-12T06:35:48.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.823+0000 7eff08c59700 1 -- 172.21.2.105:0/4257418570 shutdown_connections 2021-11-12T06:35:48.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.823+0000 7eff08c59700 1 --2- 172.21.2.105:0/4257418570 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7efee80536a0 0x7efee8055b60 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:48.829 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.823+0000 7eff08c59700 1 --2- 172.21.2.105:0/4257418570 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7eff0414abe0 0x7eff04066b30 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:48.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.823+0000 7eff08c59700 1 --2- 172.21.2.105:0/4257418570 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7eff040ad080 0x7eff04145040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:48.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.823+0000 7eff08c59700 1 --2- 172.21.2.105:0/4257418570 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7eff040ac280 0x7eff040a7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:48.830 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.823+0000 7eff08c59700 1 -- 172.21.2.105:0/4257418570 >> 172.21.2.105:0/4257418570 conn(0x7eff040b5370 msgr2=0x7eff040ae880 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:48.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.823+0000 7eff08c59700 1 -- 172.21.2.105:0/4257418570 shutdown_connections 2021-11-12T06:35:48.831 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.823+0000 7eff08c59700 1 -- 172.21.2.105:0/4257418570 wait complete. 2021-11-12T06:35:48.831 INFO:teuthology.orchestra.run.gibba005.stderr:instructed osd(s) 1 to deep-scrub 2021-11-12T06:35:48.834 INFO:tasks.ceph:Scrubbing osd.2 2021-11-12T06:35:48.835 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2021-11-12T06:35:48.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f30a0077700 1 Processor -- start 2021-11-12T06:35:48.889 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f30a0077700 1 -- start start 2021-11-12T06:35:48.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f30a0077700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f309814b2f0 0x7f30980af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:48.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f30a0077700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30980ac7b0 con 0x7f30980ac280 2021-11-12T06:35:48.890 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f30a0077700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30980ac9e0 con 0x7f30980ad080 2021-11-12T06:35:48.891 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f30a0077700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30981488a0 con 0x7f309814b2f0 2021-11-12T06:35:48.891 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f309d612700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f30980ac280 0x7f3098147a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:35730/0 (socket says 172.21.2.105:35730) 2021-11-12T06:35:48.892 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f309d612700 1 -- 172.21.2.105:0/3638010393 learned_addr learned my addr 172.21.2.105:0/3638010393 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T06:35:48.896 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f309ce11700 1 -- 172.21.2.105:0/3638010393 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2355411219 0 0) 0x7f30980ac7b0 con 0x7f30980ac280 2021-11-12T06:35:48.897 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f309ce11700 1 -- 172.21.2.105:0/3638010393 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3080003260 con 0x7f30980ac280 2021-11-12T06:35:48.897 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f309e614700 1 --2- 172.21.2.105:0/3638010393 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f309814b2f0 0x7f30980af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:48.897 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f309ce11700 1 -- 172.21.2.105:0/3638010393 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2776354727 0 0) 0x7f3080003260 con 0x7f30980ac280 2021-11-12T06:35:48.898 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f309ce11700 1 -- 172.21.2.105:0/3638010393 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f309814b2f0 msgr2=0x7f30980af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T06:35:48.898 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f309ce11700 1 --2- 172.21.2.105:0/3638010393 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f309814b2f0 0x7f30980af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:48.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f309ce11700 1 -- 172.21.2.105:0/3638010393 >> v1:172.21.2.115:6789/0 conn(0x7f30980ad080 legacy=0x7f309814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T06:35:48.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f309ce11700 1 -- 172.21.2.105:0/3638010393 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30980b0b30 con 0x7f30980ac280 2021-11-12T06:35:48.899 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f309ce11700 1 -- 172.21.2.105:0/3638010393 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f3088001660 con 0x7f30980ac280 2021-11-12T06:35:48.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f309ce11700 1 -- 172.21.2.105:0/3638010393 >> v1:172.21.2.105:6789/0 conn(0x7f30980ac280 legacy=0x7f3098147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:48.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f309ce11700 1 --2- 172.21.2.105:0/3638010393 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f309814b2f0 0x7f3080003780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:48.900 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f309ce11700 1 --2- 172.21.2.105:0/3638010393 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3080003e20 0x7f3080004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:48.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f309ce11700 1 --2- 172.21.2.105:0/3638010393 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3080004a60 0x7f3080004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:48.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f309ce11700 1 -- 172.21.2.105:0/3638010393 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30981488a0 con 0x7f3080003e20 2021-11-12T06:35:48.901 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f309ce11700 1 -- 172.21.2.105:0/3638010393 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308000b910 con 0x7f3080004a60 2021-11-12T06:35:48.902 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f309ce11700 1 -- 172.21.2.105:0/3638010393 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f308000bad0 con 0x7f309814b2f0 2021-11-12T06:35:48.902 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f309d612700 1 --2- 172.21.2.105:0/3638010393 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3080003e20 0x7f3080004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:48.903 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f309e614700 1 --2- 172.21.2.105:0/3638010393 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3080004a60 0x7f3080004ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:48.903 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f309de13700 1 --2- 172.21.2.105:0/3638010393 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f309814b2f0 0x7f3080003780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:48.903 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f309d612700 1 -- 172.21.2.105:0/3638010393 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f309814b2f0 msgr2=0x7f3080003780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T06:35:48.904 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f309d612700 1 --2- 172.21.2.105:0/3638010393 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f309814b2f0 0x7f3080003780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:48.904 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f309d612700 1 -- 172.21.2.105:0/3638010393 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3080004a60 msgr2=0x7f3080004ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T06:35:48.904 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f309d612700 1 --2- 172.21.2.105:0/3638010393 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3080004a60 0x7f3080004ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:48.905 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f309d612700 1 -- 172.21.2.105:0/3638010393 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30980b0b30 con 0x7f3080003e20 2021-11-12T06:35:48.905 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f309e614700 1 --2- 172.21.2.105:0/3638010393 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3080004a60 0x7f3080004ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T06:35:48.905 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f309d612700 1 --2- 172.21.2.105:0/3638010393 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3080003e20 0x7f3080004500 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 rx=0x7f3088001020 tx=0x7f3088007630).ready entity=mon.0 client_cookie=ad4cf415f9288f50 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:48.906 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f309ce11700 1 -- 172.21.2.105:0/3638010393 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30880070d0 con 0x7f3080003e20 2021-11-12T06:35:48.906 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f309ce11700 1 -- 172.21.2.105:0/3638010393 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3088007230 con 0x7f3080003e20 2021-11-12T06:35:48.907 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f309ce11700 1 -- 172.21.2.105:0/3638010393 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f308800ca20 con 0x7f3080003e20 2021-11-12T06:35:48.907 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f30a0077700 1 -- 172.21.2.105:0/3638010393 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3080003e20 msgr2=0x7f3080004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:48.907 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f30a0077700 1 --2- 172.21.2.105:0/3638010393 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3080003e20 0x7f3080004500 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 rx=0x7f3088001020 tx=0x7f3088007630).stop 2021-11-12T06:35:48.908 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f309e614700 1 -- 172.21.2.105:0/3638010393 reap_dead start 2021-11-12T06:35:48.908 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f30a0077700 1 -- 172.21.2.105:0/3638010393 shutdown_connections 2021-11-12T06:35:48.908 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.887+0000 7f30a0077700 1 -- 172.21.2.105:0/3638010393 >> 172.21.2.105:0/3638010393 conn(0x7f30980b5370 msgr2=0x7f30980b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:48.909 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.891+0000 7f30a0077700 1 -- 172.21.2.105:0/3638010393 shutdown_connections 2021-11-12T06:35:48.909 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.891+0000 7f30a0077700 1 -- 172.21.2.105:0/3638010393 wait complete. 2021-11-12T06:35:48.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.891+0000 7f30a0077700 1 Processor -- start 2021-11-12T06:35:48.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.891+0000 7f30a0077700 1 -- start start 2021-11-12T06:35:48.910 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.891+0000 7f30a0077700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3098147bb0 0x7f30980ab870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:48.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.891+0000 7f30a0077700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f309815a310 0x7f309815a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:48.911 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.891+0000 7f30a0077700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f309815ac60 0x7f3098149a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:48.912 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.891+0000 7f30a0077700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309814acd0 con 0x7f309815ac60 2021-11-12T06:35:48.912 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.891+0000 7f30a0077700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30981414d0 con 0x7f309815a310 2021-11-12T06:35:48.912 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.891+0000 7f30a0077700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30980a7ab0 con 0x7f3098147bb0 2021-11-12T06:35:48.913 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.891+0000 7f309e614700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f309815ac60 0x7f3098149a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:48.913 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.891+0000 7f309e614700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f309815ac60 0x7f3098149a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53576/0 (socket says 172.21.2.105:53576) 2021-11-12T06:35:48.913 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.891+0000 7f309e614700 1 -- 172.21.2.105:0/3903190308 learned_addr learned my addr 172.21.2.105:0/3903190308 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T06:35:48.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.891+0000 7f309e614700 1 -- 172.21.2.105:0/3903190308 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3098147bb0 msgr2=0x7f30980ab870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:48.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.891+0000 7f309e614700 1 --2- 172.21.2.105:0/3903190308 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3098147bb0 0x7f30980ab870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:48.914 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.891+0000 7f309e614700 1 -- 172.21.2.105:0/3903190308 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f309815a310 msgr2=0x7f309815a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:48.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.891+0000 7f309e614700 1 --2- 172.21.2.105:0/3903190308 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f309815a310 0x7f309815a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:48.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.891+0000 7f309e614700 1 -- 172.21.2.105:0/3903190308 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3098147f90 con 0x7f309815ac60 2021-11-12T06:35:48.915 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.891+0000 7f309e614700 1 --2- 172.21.2.105:0/3903190308 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f309815ac60 0x7f3098149a70 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 rx=0x7f309814af70 tx=0x7f3090008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:48.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.891+0000 7f3086ffd700 1 -- 172.21.2.105:0/3903190308 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30900115f0 con 0x7f309815ac60 2021-11-12T06:35:48.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.891+0000 7f3086ffd700 1 -- 172.21.2.105:0/3903190308 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309000c040 con 0x7f309815ac60 2021-11-12T06:35:48.916 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.891+0000 7f30a0077700 1 -- 172.21.2.105:0/3903190308 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30980a7570 con 0x7f309815ac60 2021-11-12T06:35:48.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.891+0000 7f3086ffd700 1 -- 172.21.2.105:0/3903190308 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3090011940 con 0x7f309815ac60 2021-11-12T06:35:48.917 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.891+0000 7f30a0077700 1 -- 172.21.2.105:0/3903190308 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30980a7cc0 con 0x7f309815ac60 2021-11-12T06:35:48.918 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.891+0000 7f30a0077700 1 -- 172.21.2.105:0/3903190308 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f309815a070 con 0x7f309815ac60 2021-11-12T06:35:48.918 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.891+0000 7f3086ffd700 1 -- 172.21.2.105:0/3903190308 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3090011aa0 con 0x7f309815ac60 2021-11-12T06:35:48.918 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.891+0000 7f3086ffd700 1 --2- 172.21.2.105:0/3903190308 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3078053640 0x7f3078055b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:48.919 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.891+0000 7f3086ffd700 1 -- 172.21.2.105:0/3903190308 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f309006ba80 con 0x7f309815ac60 2021-11-12T06:35:48.919 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.891+0000 7f3086ffd700 1 --2- 172.21.2.105:0/3903190308 >> [v2:172.21.2.105:6818/14905,v1:172.21.2.105:6819/14905] conn(0x7f307805a420 0x7f307805c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:48.919 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.891+0000 7f3086ffd700 1 -- 172.21.2.105:0/3903190308 --> [v2:172.21.2.105:6818/14905,v1:172.21.2.105:6819/14905] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f307805ce00 con 0x7f307805a420 2021-11-12T06:35:48.920 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.891+0000 7f3086ffd700 1 -- 172.21.2.105:0/3903190308 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=159) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3090070240 con 0x7f309815ac60 2021-11-12T06:35:48.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.891+0000 7f309de13700 1 --2- 172.21.2.105:0/3903190308 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3078053640 0x7f3078055b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:48.921 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.891+0000 7f309d612700 1 --2- 172.21.2.105:0/3903190308 >> [v2:172.21.2.105:6818/14905,v1:172.21.2.105:6819/14905] conn(0x7f307805a420 0x7f307805c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:48.922 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.891+0000 7f309de13700 1 --2- 172.21.2.105:0/3903190308 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3078053640 0x7f3078055b00 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f3094008000 tx=0x7f3094009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:48.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.891+0000 7f309d612700 1 --2- 172.21.2.105:0/3903190308 >> [v2:172.21.2.105:6818/14905,v1:172.21.2.105:6819/14905] conn(0x7f307805a420 0x7f307805c840 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:48.923 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.895+0000 7f3086ffd700 1 -- 172.21.2.105:0/3903190308 <== osd.2 v2:172.21.2.105:6818/14905 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f307805ce00 con 0x7f307805a420 2021-11-12T06:35:48.925 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.903+0000 7f30a0077700 1 -- 172.21.2.105:0/3903190308 --> [v2:172.21.2.105:6818/14905,v1:172.21.2.105:6819/14905] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f30980b1440 con 0x7f307805a420 2021-11-12T06:35:48.926 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T06:35:48.927 INFO:teuthology.orchestra.run.gibba005.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-11-12T06:35:48.927 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T06:35:48.931 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.903+0000 7f3086ffd700 1 -- 172.21.2.105:0/3903190308 <== osd.2 v2:172.21.2.105:6818/14905 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f30980b1440 con 0x7f307805a420 2021-11-12T06:35:48.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.903+0000 7f30a0077700 1 -- 172.21.2.105:0/3903190308 >> [v2:172.21.2.105:6818/14905,v1:172.21.2.105:6819/14905] conn(0x7f307805a420 msgr2=0x7f307805c840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:48.932 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.903+0000 7f30a0077700 1 --2- 172.21.2.105:0/3903190308 >> [v2:172.21.2.105:6818/14905,v1:172.21.2.105:6819/14905] conn(0x7f307805a420 0x7f307805c840 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:48.933 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.903+0000 7f30a0077700 1 -- 172.21.2.105:0/3903190308 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3078053640 msgr2=0x7f3078055b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:48.934 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.903+0000 7f30a0077700 1 --2- 172.21.2.105:0/3903190308 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3078053640 0x7f3078055b00 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f3094008000 tx=0x7f3094009040).stop 2021-11-12T06:35:48.934 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.903+0000 7f30a0077700 1 -- 172.21.2.105:0/3903190308 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f309815ac60 msgr2=0x7f3098149a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:48.935 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.903+0000 7f30a0077700 1 --2- 172.21.2.105:0/3903190308 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f309815ac60 0x7f3098149a70 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 rx=0x7f309814af70 tx=0x7f3090008040).stop 2021-11-12T06:35:48.936 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.903+0000 7f309e614700 1 -- 172.21.2.105:0/3903190308 reap_dead start 2021-11-12T06:35:48.936 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.903+0000 7f30a0077700 1 -- 172.21.2.105:0/3903190308 shutdown_connections 2021-11-12T06:35:48.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.903+0000 7f30a0077700 1 -- 172.21.2.105:0/3903190308 >> 172.21.2.105:0/3903190308 conn(0x7f30980b5370 msgr2=0x7f30980608a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:48.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.903+0000 7f30a0077700 1 -- 172.21.2.105:0/3903190308 shutdown_connections 2021-11-12T06:35:48.938 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:48.903+0000 7f30a0077700 1 -- 172.21.2.105:0/3903190308 wait complete. 2021-11-12T06:35:48.939 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2021-11-12T06:35:49.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.007+0000 7f7efc383700 1 Processor -- start 2021-11-12T06:35:49.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.007+0000 7f7efc383700 1 -- start start 2021-11-12T06:35:49.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.007+0000 7f7efc383700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7ef40b0780 0x7f7ef41434d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.012 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.007+0000 7f7efc383700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef40b2d20 con 0x7f7ef40b0cc0 2021-11-12T06:35:49.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.007+0000 7f7efc383700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef40b1fc0 con 0x7f7ef40b2940 2021-11-12T06:35:49.013 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.007+0000 7f7efc383700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef40b15e0 con 0x7f7ef40b0780 2021-11-12T06:35:49.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7efa920700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f7ef40b0cc0 0x7f7ef405f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:35748/0 (socket says 172.21.2.105:35748) 2021-11-12T06:35:49.014 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7efa920700 1 -- 172.21.2.105:0/4278351182 learned_addr learned my addr 172.21.2.105:0/4278351182 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T06:35:49.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7ef911d700 1 -- 172.21.2.105:0/4278351182 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2772285090 0 0) 0x7f7ef40b2d20 con 0x7f7ef40b0cc0 2021-11-12T06:35:49.021 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7ef911d700 1 -- 172.21.2.105:0/4278351182 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7edc004370 con 0x7f7ef40b0cc0 2021-11-12T06:35:49.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7ef911d700 1 -- 172.21.2.105:0/4278351182 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1631864119 0 0) 0x7f7edc004370 con 0x7f7ef40b0cc0 2021-11-12T06:35:49.022 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7ef911d700 1 -- 172.21.2.105:0/4278351182 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7ef40b0780 msgr2=0x7f7ef41434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T06:35:49.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7ef911d700 1 --2- 172.21.2.105:0/4278351182 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7ef40b0780 0x7f7ef41434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7ef911d700 1 -- 172.21.2.105:0/4278351182 >> v1:172.21.2.115:6789/0 conn(0x7f7ef40b2940 legacy=0x7f7ef4142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T06:35:49.023 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7ef911d700 1 -- 172.21.2.105:0/4278351182 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef40b1880 con 0x7f7ef40b0cc0 2021-11-12T06:35:49.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7ef911d700 1 -- 172.21.2.105:0/4278351182 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f7eec0019e0 con 0x7f7ef40b0cc0 2021-11-12T06:35:49.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7ef911d700 1 -- 172.21.2.105:0/4278351182 >> v1:172.21.2.105:6789/0 conn(0x7f7ef40b0cc0 legacy=0x7f7ef405f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.024 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7ef911d700 1 --2- 172.21.2.105:0/4278351182 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7edc004890 0x7f7edc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7ef911d700 1 --2- 172.21.2.105:0/4278351182 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7ef40b0780 0x7f7edc005610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7ef911d700 1 --2- 172.21.2.105:0/4278351182 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7edc005c20 0x7f7edc0060a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.025 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7ef911d700 1 -- 172.21.2.105:0/4278351182 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef40b15e0 con 0x7f7edc005c20 2021-11-12T06:35:49.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7ef911d700 1 -- 172.21.2.105:0/4278351182 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc003390 con 0x7f7edc004890 2021-11-12T06:35:49.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7ef911d700 1 -- 172.21.2.105:0/4278351182 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc003550 con 0x7f7ef40b0780 2021-11-12T06:35:49.026 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7efa920700 1 --2- 172.21.2.105:0/4278351182 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7edc005c20 0x7f7edc0060a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:49.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7efa920700 1 -- 172.21.2.105:0/4278351182 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7ef40b0780 msgr2=0x7f7edc005610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T06:35:49.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7efa920700 1 --2- 172.21.2.105:0/4278351182 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7ef40b0780 0x7f7edc005610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.027 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7efa920700 1 -- 172.21.2.105:0/4278351182 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7edc004890 msgr2=0x7f7edc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T06:35:49.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7efa920700 1 --2- 172.21.2.105:0/4278351182 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7edc004890 0x7f7edc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7efa920700 1 -- 172.21.2.105:0/4278351182 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7edc004370 con 0x7f7edc005c20 2021-11-12T06:35:49.028 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7efa920700 1 --2- 172.21.2.105:0/4278351182 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7edc005c20 0x7f7edc0060a0 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 rx=0x7f7ef40b1ea0 tx=0x7f7ef40ae6d0).ready entity=mon.0 client_cookie=c0b6fc81d81e9819 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:49.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7ef911d700 1 -- 172.21.2.105:0/4278351182 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7eec00cd70 con 0x7f7edc005c20 2021-11-12T06:35:49.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7ef911d700 1 -- 172.21.2.105:0/4278351182 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eec005990 con 0x7f7edc005c20 2021-11-12T06:35:49.029 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7ef911d700 1 -- 172.21.2.105:0/4278351182 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7eec005cf0 con 0x7f7edc005c20 2021-11-12T06:35:49.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7efc383700 1 -- 172.21.2.105:0/4278351182 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7edc005c20 msgr2=0x7f7edc0060a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7efc383700 1 --2- 172.21.2.105:0/4278351182 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7edc005c20 0x7f7edc0060a0 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 rx=0x7f7ef40b1ea0 tx=0x7f7ef40ae6d0).stop 2021-11-12T06:35:49.030 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7efa920700 1 -- 172.21.2.105:0/4278351182 reap_dead start 2021-11-12T06:35:49.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7efc383700 1 -- 172.21.2.105:0/4278351182 shutdown_connections 2021-11-12T06:35:49.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7efc383700 1 -- 172.21.2.105:0/4278351182 >> 172.21.2.105:0/4278351182 conn(0x7f7ef4068440 msgr2=0x7f7ef4062dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:49.031 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7efc383700 1 -- 172.21.2.105:0/4278351182 shutdown_connections 2021-11-12T06:35:49.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7efc383700 1 -- 172.21.2.105:0/4278351182 wait complete. 2021-11-12T06:35:49.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7efc383700 1 Processor -- start 2021-11-12T06:35:49.032 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7efc383700 1 -- start start 2021-11-12T06:35:49.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7efc383700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7ef4141a80 0x7f7ef415a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7efc383700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7ef4064800 0x7f7ef415a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.033 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7efc383700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7ef4066750 0x7f7ef415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7efc383700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef415b0c0 con 0x7f7ef4066750 2021-11-12T06:35:49.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7efc383700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef41423e0 con 0x7f7ef4064800 2021-11-12T06:35:49.034 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7efc383700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef4065830 con 0x7f7ef4141a80 2021-11-12T06:35:49.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7efa920700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7ef4066750 0x7f7ef415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:49.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7efa920700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7ef4066750 0x7f7ef415abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53598/0 (socket says 172.21.2.105:53598) 2021-11-12T06:35:49.035 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7efa920700 1 -- 172.21.2.105:0/2205364139 learned_addr learned my addr 172.21.2.105:0/2205364139 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T06:35:49.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7efa920700 1 -- 172.21.2.105:0/2205364139 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7ef4141a80 msgr2=0x7f7ef415a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7efa920700 1 --2- 172.21.2.105:0/2205364139 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7ef4141a80 0x7f7ef415a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.036 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7efa920700 1 -- 172.21.2.105:0/2205364139 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7ef4064800 msgr2=0x7f7ef415a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7ef991e700 1 --2- 172.21.2.105:0/2205364139 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7ef4064800 0x7f7ef415a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:49.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7efa920700 1 --2- 172.21.2.105:0/2205364139 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7ef4064800 0x7f7ef415a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:49.037 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7efa920700 1 -- 172.21.2.105:0/2205364139 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef4142140 con 0x7f7ef4066750 2021-11-12T06:35:49.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7ef991e700 1 --2- 172.21.2.105:0/2205364139 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7ef4064800 0x7f7ef415a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-11-12T06:35:49.038 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7efa920700 1 --2- 172.21.2.105:0/2205364139 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7ef4066750 0x7f7ef415abd0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 rx=0x7f7ef40ae740 tx=0x7f7eec015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:49.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.011+0000 7f7ee77fe700 1 -- 172.21.2.105:0/2205364139 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7eec001f70 con 0x7f7ef4066750 2021-11-12T06:35:49.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.015+0000 7f7ee77fe700 1 -- 172.21.2.105:0/2205364139 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eec0074d0 con 0x7f7ef4066750 2021-11-12T06:35:49.039 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.015+0000 7f7efc383700 1 -- 172.21.2.105:0/2205364139 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef4141e60 con 0x7f7ef4066750 2021-11-12T06:35:49.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.015+0000 7f7ee77fe700 1 -- 172.21.2.105:0/2205364139 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7eec007830 con 0x7f7ef4066750 2021-11-12T06:35:49.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.015+0000 7f7efc383700 1 -- 172.21.2.105:0/2205364139 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef4065520 con 0x7f7ef4066750 2021-11-12T06:35:49.040 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.015+0000 7f7efc383700 1 -- 172.21.2.105:0/2205364139 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ef40b1b20 con 0x7f7ef4066750 2021-11-12T06:35:49.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.015+0000 7f7ee77fe700 1 -- 172.21.2.105:0/2205364139 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f7eec027070 con 0x7f7ef4066750 2021-11-12T06:35:49.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.015+0000 7f7ee77fe700 1 --2- 172.21.2.105:0/2205364139 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7ed4053610 0x7f7ed4055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.041 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.015+0000 7f7ee77fe700 1 -- 172.21.2.105:0/2205364139 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f7eec06c400 con 0x7f7ef4066750 2021-11-12T06:35:49.042 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.015+0000 7f7efa11f700 1 --2- 172.21.2.105:0/2205364139 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7ed4053610 0x7f7ed4055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:49.042 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.015+0000 7f7efa11f700 1 --2- 172.21.2.105:0/2205364139 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7ed4053610 0x7f7ed4055ad0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f7ef0001fa0 tx=0x7f7ef00077f0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:49.042 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.015+0000 7f7ee77fe700 1 -- 172.21.2.105:0/2205364139 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7eec043640 con 0x7f7ef4066750 2021-11-12T06:35:49.101 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.099+0000 7f7efc383700 1 -- 172.21.2.105:0/2205364139 --> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ef4057350 con 0x7f7ed4053610 2021-11-12T06:35:49.102 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.099+0000 7f7ee77fe700 1 -- 172.21.2.105:0/2205364139 <== mgr.4107 v2:172.21.2.105:6800/14730 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7ef4057350 con 0x7f7ed4053610 2021-11-12T06:35:49.103 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.099+0000 7f7efc383700 1 -- 172.21.2.105:0/2205364139 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7ed4053610 msgr2=0x7f7ed4055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.099+0000 7f7efc383700 1 --2- 172.21.2.105:0/2205364139 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7ed4053610 0x7f7ed4055ad0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f7ef0001fa0 tx=0x7f7ef00077f0).stop 2021-11-12T06:35:49.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.099+0000 7f7efc383700 1 -- 172.21.2.105:0/2205364139 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7ef4066750 msgr2=0x7f7ef415abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.104 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.099+0000 7f7efc383700 1 --2- 172.21.2.105:0/2205364139 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7ef4066750 0x7f7ef415abd0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 rx=0x7f7ef40ae740 tx=0x7f7eec015000).stop 2021-11-12T06:35:49.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.099+0000 7f7efc383700 1 -- 172.21.2.105:0/2205364139 shutdown_connections 2021-11-12T06:35:49.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.099+0000 7f7efc383700 1 --2- 172.21.2.105:0/2205364139 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f7ed4053610 0x7f7ed4055ad0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:49.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.099+0000 7f7efc383700 1 --2- 172.21.2.105:0/2205364139 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f7ef4066750 0x7f7ef415abd0 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:49.105 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.099+0000 7f7efc383700 1 --2- 172.21.2.105:0/2205364139 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f7ef4064800 0x7f7ef415a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:49.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.099+0000 7f7efc383700 1 --2- 172.21.2.105:0/2205364139 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f7ef4141a80 0x7f7ef415a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.106 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.099+0000 7f7efc383700 1 -- 172.21.2.105:0/2205364139 >> 172.21.2.105:0/2205364139 conn(0x7f7ef4068440 msgr2=0x7f7ef40b39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:49.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.099+0000 7f7efc383700 1 -- 172.21.2.105:0/2205364139 shutdown_connections 2021-11-12T06:35:49.107 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.099+0000 7f7efc383700 1 -- 172.21.2.105:0/2205364139 wait complete. 2021-11-12T06:35:49.107 INFO:teuthology.orchestra.run.gibba005.stderr:instructed osd(s) 2 to deep-scrub 2021-11-12T06:35:49.109 INFO:tasks.ceph:Scrubbing osd.3 2021-11-12T06:35:49.110 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2021-11-12T06:35:49.165 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb08424b700 1 Processor -- start 2021-11-12T06:35:49.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb08424b700 1 -- start start 2021-11-12T06:35:49.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb08424b700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fb07c0ad080 0x7fb07c0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.166 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb08424b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb07c14b2f0 0x7fb07c0ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb08424b700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb07c0ac7b0 con 0x7fb07c0ac280 2021-11-12T06:35:49.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb08424b700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb07c1488a0 con 0x7fb07c14b2f0 2021-11-12T06:35:49.167 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb08424b700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb07c0ac9e0 con 0x7fb07c0ad080 2021-11-12T06:35:49.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb0827e8700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb07c14b2f0 0x7fb07c0ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:49.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb0827e8700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb07c14b2f0 0x7fb07c0ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53608/0 (socket says 172.21.2.105:53608) 2021-11-12T06:35:49.168 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb0827e8700 1 -- 172.21.2.105:0/866076271 learned_addr learned my addr 172.21.2.105:0/866076271 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T06:35:49.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb0827e8700 1 -- 172.21.2.105:0/866076271 >> v2:172.21.2.115:3300/0 conn(0x7fb07c0ad080 msgr2=0x7fb07c0af730 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T06:35:49.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb0827e8700 1 --2- 172.21.2.105:0/866076271 >> v2:172.21.2.115:3300/0 conn(0x7fb07c0ad080 0x7fb07c0af730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.169 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb0827e8700 1 -- 172.21.2.105:0/866076271 >> v1:172.21.2.115:6789/0 conn(0x7fb07c0ac280 legacy=0x7fb07c14abe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T06:35:49.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb0827e8700 1 -- 172.21.2.105:0/866076271 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07c0b0b30 con 0x7fb07c14b2f0 2021-11-12T06:35:49.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb0827e8700 1 --2- 172.21.2.105:0/866076271 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb07c14b2f0 0x7fb07c0ad460 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 rx=0x7fb07c0b06e0 tx=0x7fb074009290).ready entity=mon.0 client_cookie=77f36a9fbbee7589 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:49.170 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb080fe5700 1 -- 172.21.2.105:0/866076271 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb07400b830 con 0x7fb07c14b2f0 2021-11-12T06:35:49.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb080fe5700 1 -- 172.21.2.105:0/866076271 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07400b990 con 0x7fb07c14b2f0 2021-11-12T06:35:49.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb080fe5700 1 -- 172.21.2.105:0/866076271 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb07400bb40 con 0x7fb07c14b2f0 2021-11-12T06:35:49.171 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb08424b700 1 -- 172.21.2.105:0/866076271 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb07c14b2f0 msgr2=0x7fb07c0ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb08424b700 1 --2- 172.21.2.105:0/866076271 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb07c14b2f0 0x7fb07c0ad460 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 rx=0x7fb07c0b06e0 tx=0x7fb074009290).stop 2021-11-12T06:35:49.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb08424b700 1 -- 172.21.2.105:0/866076271 shutdown_connections 2021-11-12T06:35:49.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb08424b700 1 --2- 172.21.2.105:0/866076271 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb07c14b2f0 0x7fb07c0ad460 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:49.172 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb08424b700 1 --2- 172.21.2.105:0/866076271 >> v2:172.21.2.115:3300/0 conn(0x7fb07c0ad080 0x7fb07c0af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.173 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb08424b700 1 -- 172.21.2.105:0/866076271 >> 172.21.2.105:0/866076271 conn(0x7fb07c0b5370 msgr2=0x7fb07c0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:49.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb08424b700 1 -- 172.21.2.105:0/866076271 shutdown_connections 2021-11-12T06:35:49.176 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb08424b700 1 -- 172.21.2.105:0/866076271 wait complete. 2021-11-12T06:35:49.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb08424b700 1 Processor -- start 2021-11-12T06:35:49.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb08424b700 1 -- start start 2021-11-12T06:35:49.177 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb08424b700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb07c0ac280 0x7fb07c15a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb08424b700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb07c0ad080 0x7fb07c0a8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb08424b700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb07c14b2f0 0x7fb07c0a8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.178 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb08424b700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c15af00 con 0x7fb07c14b2f0 2021-11-12T06:35:49.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb08424b700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c0ab380 con 0x7fb07c0ad080 2021-11-12T06:35:49.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb08424b700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c0a8b70 con 0x7fb07c0ac280 2021-11-12T06:35:49.179 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb0827e8700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb07c14b2f0 0x7fb07c0a8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:49.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb0827e8700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb07c14b2f0 0x7fb07c0a8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53610/0 (socket says 172.21.2.105:53610) 2021-11-12T06:35:49.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb0827e8700 1 -- 172.21.2.105:0/2611240060 learned_addr learned my addr 172.21.2.105:0/2611240060 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T06:35:49.180 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb0827e8700 1 -- 172.21.2.105:0/2611240060 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb07c0ac280 msgr2=0x7fb07c15a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb0827e8700 1 --2- 172.21.2.105:0/2611240060 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb07c0ac280 0x7fb07c15a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb0827e8700 1 -- 172.21.2.105:0/2611240060 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb07c0ad080 msgr2=0x7fb07c0a8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.181 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb0827e8700 1 --2- 172.21.2.105:0/2611240060 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb07c0ad080 0x7fb07c0a8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb0827e8700 1 -- 172.21.2.105:0/2611240060 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb074009530 con 0x7fb07c14b2f0 2021-11-12T06:35:49.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.163+0000 7fb0827e8700 1 --2- 172.21.2.105:0/2611240060 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb07c14b2f0 0x7fb07c0a8680 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 rx=0x7fb07c0b06e0 tx=0x7fb074016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:49.182 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.167+0000 7fb06effd700 1 -- 172.21.2.105:0/2611240060 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb07400b830 con 0x7fb07c14b2f0 2021-11-12T06:35:49.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.167+0000 7fb06effd700 1 -- 172.21.2.105:0/2611240060 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0740107a0 con 0x7fb07c14b2f0 2021-11-12T06:35:49.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.167+0000 7fb08424b700 1 -- 172.21.2.105:0/2611240060 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb07c0a9470 con 0x7fb07c14b2f0 2021-11-12T06:35:49.183 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.167+0000 7fb06effd700 1 -- 172.21.2.105:0/2611240060 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb074010b00 con 0x7fb07c14b2f0 2021-11-12T06:35:49.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.167+0000 7fb08424b700 1 -- 172.21.2.105:0/2611240060 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb07c0ab9c0 con 0x7fb07c14b2f0 2021-11-12T06:35:49.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.167+0000 7fb08424b700 1 -- 172.21.2.105:0/2611240060 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb07c15ad50 con 0x7fb07c14b2f0 2021-11-12T06:35:49.184 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.167+0000 7fb06effd700 1 -- 172.21.2.105:0/2611240060 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb07400f070 con 0x7fb07c14b2f0 2021-11-12T06:35:49.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.167+0000 7fb06effd700 1 --2- 172.21.2.105:0/2611240060 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb05c053720 0x7fb05c055be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.167+0000 7fb06effd700 1 -- 172.21.2.105:0/2611240060 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fb07406cce0 con 0x7fb07c14b2f0 2021-11-12T06:35:49.185 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.167+0000 7fb081fe7700 1 --2- 172.21.2.105:0/2611240060 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb05c053720 0x7fb05c055be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:49.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.167+0000 7fb06effd700 1 --2- 172.21.2.105:0/2611240060 >> [v2:172.21.2.105:6826/14876,v1:172.21.2.105:6827/14876] conn(0x7fb05c05a5b0 0x7fb05c05c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.167+0000 7fb06effd700 1 -- 172.21.2.105:0/2611240060 --> [v2:172.21.2.105:6826/14876,v1:172.21.2.105:6827/14876] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb05c05cf90 con 0x7fb05c05a5b0 2021-11-12T06:35:49.186 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.167+0000 7fb06effd700 1 -- 172.21.2.105:0/2611240060 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=159) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb07406f240 con 0x7fb07c14b2f0 2021-11-12T06:35:49.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.167+0000 7fb0817e6700 1 --2- 172.21.2.105:0/2611240060 >> [v2:172.21.2.105:6826/14876,v1:172.21.2.105:6827/14876] conn(0x7fb05c05a5b0 0x7fb05c05c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:49.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.167+0000 7fb0817e6700 1 --2- 172.21.2.105:0/2611240060 >> [v2:172.21.2.105:6826/14876,v1:172.21.2.105:6827/14876] conn(0x7fb05c05a5b0 0x7fb05c05c9d0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:49.187 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.167+0000 7fb081fe7700 1 --2- 172.21.2.105:0/2611240060 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb05c053720 0x7fb05c055be0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7fb078002fb0 tx=0x7fb0780069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:49.188 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.167+0000 7fb06effd700 1 -- 172.21.2.105:0/2611240060 <== osd.3 v2:172.21.2.105:6826/14876 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7fb05c05cf90 con 0x7fb05c05a5b0 2021-11-12T06:35:49.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.175+0000 7fb08424b700 1 -- 172.21.2.105:0/2611240060 --> [v2:172.21.2.105:6826/14876,v1:172.21.2.105:6827/14876] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb07c0ab540 con 0x7fb05c05a5b0 2021-11-12T06:35:49.189 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.175+0000 7fb06effd700 1 -- 172.21.2.105:0/2611240060 <== osd.3 v2:172.21.2.105:6826/14876 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb07c0ab540 con 0x7fb05c05a5b0 2021-11-12T06:35:49.190 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T06:35:49.190 INFO:teuthology.orchestra.run.gibba005.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-11-12T06:35:49.191 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T06:35:49.192 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.175+0000 7fb08424b700 1 -- 172.21.2.105:0/2611240060 >> [v2:172.21.2.105:6826/14876,v1:172.21.2.105:6827/14876] conn(0x7fb05c05a5b0 msgr2=0x7fb05c05c9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.175+0000 7fb08424b700 1 --2- 172.21.2.105:0/2611240060 >> [v2:172.21.2.105:6826/14876,v1:172.21.2.105:6827/14876] conn(0x7fb05c05a5b0 0x7fb05c05c9d0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:49.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.175+0000 7fb08424b700 1 -- 172.21.2.105:0/2611240060 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb05c053720 msgr2=0x7fb05c055be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.193 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.175+0000 7fb08424b700 1 --2- 172.21.2.105:0/2611240060 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb05c053720 0x7fb05c055be0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7fb078002fb0 tx=0x7fb0780069b0).stop 2021-11-12T06:35:49.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.175+0000 7fb08424b700 1 -- 172.21.2.105:0/2611240060 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb07c14b2f0 msgr2=0x7fb07c0a8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.175+0000 7fb08424b700 1 --2- 172.21.2.105:0/2611240060 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb07c14b2f0 0x7fb07c0a8680 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 rx=0x7fb07c0b06e0 tx=0x7fb074016000).stop 2021-11-12T06:35:49.194 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.175+0000 7fb0827e8700 1 -- 172.21.2.105:0/2611240060 reap_dead start 2021-11-12T06:35:49.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.175+0000 7fb08424b700 1 -- 172.21.2.105:0/2611240060 shutdown_connections 2021-11-12T06:35:49.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.175+0000 7fb08424b700 1 -- 172.21.2.105:0/2611240060 >> 172.21.2.105:0/2611240060 conn(0x7fb07c0b5370 msgr2=0x7fb07c14aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:49.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.175+0000 7fb08424b700 1 -- 172.21.2.105:0/2611240060 shutdown_connections 2021-11-12T06:35:49.195 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.175+0000 7fb08424b700 1 -- 172.21.2.105:0/2611240060 wait complete. 2021-11-12T06:35:49.196 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2021-11-12T06:35:49.249 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.247+0000 7f9bb976e700 1 Processor -- start 2021-11-12T06:35:49.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.247+0000 7f9bb976e700 1 -- start start 2021-11-12T06:35:49.250 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.247+0000 7f9bb976e700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f9bb40ad080 0x7f9bb40af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.247+0000 7f9bb976e700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f9bb40ac280 0x7f9bb40ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.247+0000 7f9bb976e700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb40ac7b0 con 0x7f9bb414abe0 2021-11-12T06:35:49.251 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.247+0000 7f9bb976e700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb41488a0 con 0x7f9bb40ad080 2021-11-12T06:35:49.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.247+0000 7f9bb976e700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb40ac9e0 con 0x7f9bb40ac280 2021-11-12T06:35:49.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.247+0000 7f9bb2ffd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f9bb40ad080 0x7f9bb40af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:49.252 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.247+0000 7f9bb2ffd700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f9bb40ad080 0x7f9bb40af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53620/0 (socket says 172.21.2.105:53620) 2021-11-12T06:35:49.253 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.247+0000 7f9bb2ffd700 1 -- 172.21.2.105:0/170544546 learned_addr learned my addr 172.21.2.105:0/170544546 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T06:35:49.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.247+0000 7f9bb2ffd700 1 -- 172.21.2.105:0/170544546 >> v2:172.21.2.115:3300/0 conn(0x7f9bb40ac280 msgr2=0x7f9bb40ad460 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T06:35:49.256 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.247+0000 7f9bb2ffd700 1 --2- 172.21.2.105:0/170544546 >> v2:172.21.2.115:3300/0 conn(0x7f9bb40ac280 0x7f9bb40ad460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.247+0000 7f9bb2ffd700 1 -- 172.21.2.105:0/170544546 >> v1:172.21.2.115:6789/0 conn(0x7f9bb414abe0 legacy=0x7f9bb414b090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T06:35:49.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.247+0000 7f9bb2ffd700 1 -- 172.21.2.105:0/170544546 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb40b0b30 con 0x7f9bb40ad080 2021-11-12T06:35:49.257 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.247+0000 7f9bb2ffd700 1 --2- 172.21.2.105:0/170544546 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9bb40ad080 0x7f9bb40af730 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 rx=0x7f9bb414bc40 tx=0x7f9ba4006eb0).ready entity=mon.0 client_cookie=b267bb4d26d74f72 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:49.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.247+0000 7f9bb1ffb700 1 -- 172.21.2.105:0/170544546 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ba400d5c0 con 0x7f9bb40ad080 2021-11-12T06:35:49.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.247+0000 7f9bb1ffb700 1 -- 172.21.2.105:0/170544546 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba4000e90 con 0x7f9bb40ad080 2021-11-12T06:35:49.258 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.247+0000 7f9bb1ffb700 1 -- 172.21.2.105:0/170544546 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ba400d910 con 0x7f9bb40ad080 2021-11-12T06:35:49.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.247+0000 7f9bb976e700 1 -- 172.21.2.105:0/170544546 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9bb40ad080 msgr2=0x7f9bb40af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.247+0000 7f9bb976e700 1 --2- 172.21.2.105:0/170544546 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9bb40ad080 0x7f9bb40af730 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 rx=0x7f9bb414bc40 tx=0x7f9ba4006eb0).stop 2021-11-12T06:35:49.259 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.247+0000 7f9bb976e700 1 -- 172.21.2.105:0/170544546 shutdown_connections 2021-11-12T06:35:49.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.247+0000 7f9bb976e700 1 --2- 172.21.2.105:0/170544546 >> v2:172.21.2.115:3300/0 conn(0x7f9bb40ac280 0x7f9bb40ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.260 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.247+0000 7f9bb976e700 1 --2- 172.21.2.105:0/170544546 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9bb40ad080 0x7f9bb40af730 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:49.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.247+0000 7f9bb976e700 1 -- 172.21.2.105:0/170544546 >> 172.21.2.105:0/170544546 conn(0x7f9bb40b5370 msgr2=0x7f9bb40b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:49.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.247+0000 7f9bb976e700 1 -- 172.21.2.105:0/170544546 shutdown_connections 2021-11-12T06:35:49.261 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.247+0000 7f9bb976e700 1 -- 172.21.2.105:0/170544546 wait complete. 2021-11-12T06:35:49.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.251+0000 7f9bb976e700 1 Processor -- start 2021-11-12T06:35:49.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.251+0000 7f9bb976e700 1 -- start start 2021-11-12T06:35:49.262 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.251+0000 7f9bb976e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9bb40ac280 0x7f9bb415a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.251+0000 7f9bb976e700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9bb40ad080 0x7f9bb415a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.251+0000 7f9bb976e700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9bb414abe0 0x7f9bb40a7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.263 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.251+0000 7f9bb976e700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb40ab1f0 con 0x7f9bb40ac280 2021-11-12T06:35:49.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.251+0000 7f9bb976e700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb40a9d10 con 0x7f9bb40ad080 2021-11-12T06:35:49.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.251+0000 7f9bb976e700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb40ab410 con 0x7f9bb414abe0 2021-11-12T06:35:49.264 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.251+0000 7f9bb2ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9bb40ac280 0x7f9bb415a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:49.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.251+0000 7f9bb2ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9bb40ac280 0x7f9bb415a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53626/0 (socket says 172.21.2.105:53626) 2021-11-12T06:35:49.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.251+0000 7f9bb2ffd700 1 -- 172.21.2.105:0/156513866 learned_addr learned my addr 172.21.2.105:0/156513866 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T06:35:49.265 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.251+0000 7f9bb2ffd700 1 -- 172.21.2.105:0/156513866 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9bb414abe0 msgr2=0x7f9bb40a7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.251+0000 7f9bb2ffd700 1 --2- 172.21.2.105:0/156513866 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9bb414abe0 0x7f9bb40a7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.251+0000 7f9bb2ffd700 1 -- 172.21.2.105:0/156513866 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9bb40ad080 msgr2=0x7f9bb415a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.266 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.251+0000 7f9bb2ffd700 1 --2- 172.21.2.105:0/156513866 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9bb40ad080 0x7f9bb415a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.251+0000 7f9bb2ffd700 1 -- 172.21.2.105:0/156513866 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba400b1e0 con 0x7f9bb40ac280 2021-11-12T06:35:49.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.251+0000 7f9bb2ffd700 1 --2- 172.21.2.105:0/156513866 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9bb40ac280 0x7f9bb415a4d0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 rx=0x7f9bb414bc40 tx=0x7f9ba4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:49.267 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.251+0000 7f9babfff700 1 -- 172.21.2.105:0/156513866 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ba4002f70 con 0x7f9bb40ac280 2021-11-12T06:35:49.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.251+0000 7f9babfff700 1 -- 172.21.2.105:0/156513866 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba400de70 con 0x7f9bb40ac280 2021-11-12T06:35:49.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.251+0000 7f9babfff700 1 -- 172.21.2.105:0/156513866 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ba401e460 con 0x7f9bb40ac280 2021-11-12T06:35:49.268 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.251+0000 7f9bb976e700 1 -- 172.21.2.105:0/156513866 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb40a9550 con 0x7f9bb40ac280 2021-11-12T06:35:49.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.251+0000 7f9bb976e700 1 -- 172.21.2.105:0/156513866 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb40a9a90 con 0x7f9bb40ac280 2021-11-12T06:35:49.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.251+0000 7f9bb976e700 1 -- 172.21.2.105:0/156513866 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb40ab5d0 con 0x7f9bb40ac280 2021-11-12T06:35:49.269 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.251+0000 7f9babfff700 1 -- 172.21.2.105:0/156513866 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f9ba4025030 con 0x7f9bb40ac280 2021-11-12T06:35:49.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.251+0000 7f9babfff700 1 --2- 172.21.2.105:0/156513866 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9b98053610 0x7f9b98055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.251+0000 7f9babfff700 1 -- 172.21.2.105:0/156513866 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f9ba406cba0 con 0x7f9bb40ac280 2021-11-12T06:35:49.270 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.251+0000 7f9bb27fc700 1 --2- 172.21.2.105:0/156513866 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9b98053610 0x7f9b98055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:49.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.251+0000 7f9bb27fc700 1 --2- 172.21.2.105:0/156513866 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9b98053610 0x7f9b98055ad0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7f9b9c002fb0 tx=0x7f9b9c0069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:49.271 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.255+0000 7f9babfff700 1 -- 172.21.2.105:0/156513866 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9ba4043e80 con 0x7f9bb40ac280 2021-11-12T06:35:49.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.339+0000 7f9bb976e700 1 -- 172.21.2.105:0/156513866 --> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f9bb40b1440 con 0x7f9b98053610 2021-11-12T06:35:49.341 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.339+0000 7f9babfff700 1 -- 172.21.2.105:0/156513866 <== mgr.4107 v2:172.21.2.105:6800/14730 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9bb40b1440 con 0x7f9b98053610 2021-11-12T06:35:49.342 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.339+0000 7f9bb976e700 1 -- 172.21.2.105:0/156513866 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9b98053610 msgr2=0x7f9b98055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.339+0000 7f9bb976e700 1 --2- 172.21.2.105:0/156513866 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9b98053610 0x7f9b98055ad0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7f9b9c002fb0 tx=0x7f9b9c0069b0).stop 2021-11-12T06:35:49.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.339+0000 7f9bb976e700 1 -- 172.21.2.105:0/156513866 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9bb40ac280 msgr2=0x7f9bb415a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.343 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.339+0000 7f9bb976e700 1 --2- 172.21.2.105:0/156513866 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9bb40ac280 0x7f9bb415a4d0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 rx=0x7f9bb414bc40 tx=0x7f9ba4015000).stop 2021-11-12T06:35:49.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.339+0000 7f9bb976e700 1 -- 172.21.2.105:0/156513866 shutdown_connections 2021-11-12T06:35:49.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.339+0000 7f9bb976e700 1 --2- 172.21.2.105:0/156513866 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f9b98053610 0x7f9b98055ad0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:49.344 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.339+0000 7f9bb976e700 1 --2- 172.21.2.105:0/156513866 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f9bb414abe0 0x7f9bb40a7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.339+0000 7f9bb976e700 1 --2- 172.21.2.105:0/156513866 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f9bb40ad080 0x7f9bb415a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.339+0000 7f9bb976e700 1 --2- 172.21.2.105:0/156513866 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f9bb40ac280 0x7f9bb415a4d0 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:49.345 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.339+0000 7f9bb976e700 1 -- 172.21.2.105:0/156513866 >> 172.21.2.105:0/156513866 conn(0x7f9bb40b5370 msgr2=0x7f9bb4060640 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:49.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.339+0000 7f9bb976e700 1 -- 172.21.2.105:0/156513866 shutdown_connections 2021-11-12T06:35:49.346 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.339+0000 7f9bb976e700 1 -- 172.21.2.105:0/156513866 wait complete. 2021-11-12T06:35:49.347 INFO:teuthology.orchestra.run.gibba005.stderr:instructed osd(s) 3 to deep-scrub 2021-11-12T06:35:49.348 INFO:tasks.ceph:Scrubbing osd.4 2021-11-12T06:35:49.349 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2021-11-12T06:35:49.403 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.399+0000 7f87ab1f1700 1 Processor -- start 2021-11-12T06:35:49.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.399+0000 7f87ab1f1700 1 -- start start 2021-11-12T06:35:49.404 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87ab1f1700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f87a4143b40 0x7f87a4143f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87ab1f1700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a4067860 con 0x7f87a40adaf0 2021-11-12T06:35:49.405 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87ab1f1700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a41404a0 con 0x7f87a40aded0 2021-11-12T06:35:49.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87ab1f1700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a4143400 con 0x7f87a4143b40 2021-11-12T06:35:49.406 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a8f8d700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f87a40adaf0 0x7f87a413fd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:35798/0 (socket says 172.21.2.105:35798) 2021-11-12T06:35:49.407 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a8f8d700 1 -- 172.21.2.105:0/3106336537 learned_addr learned my addr 172.21.2.105:0/3106336537 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T06:35:49.413 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a37fe700 1 -- 172.21.2.105:0/3106336537 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1115792354 0 0) 0x7f87a4067860 con 0x7f87a40adaf0 2021-11-12T06:35:49.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a37fe700 1 -- 172.21.2.105:0/3106336537 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8790003260 con 0x7f87a40adaf0 2021-11-12T06:35:49.414 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a37fe700 1 -- 172.21.2.105:0/3106336537 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1646131809 0 0) 0x7f8790003260 con 0x7f87a40adaf0 2021-11-12T06:35:49.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a37fe700 1 -- 172.21.2.105:0/3106336537 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f87a4143b40 msgr2=0x7f87a4143f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T06:35:49.415 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a37fe700 1 --2- 172.21.2.105:0/3106336537 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f87a4143b40 0x7f87a4143f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a37fe700 1 -- 172.21.2.105:0/3106336537 >> v1:172.21.2.115:6789/0 conn(0x7f87a40aded0 legacy=0x7f87a40afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T06:35:49.416 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a37fe700 1 -- 172.21.2.105:0/3106336537 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a41436a0 con 0x7f87a40adaf0 2021-11-12T06:35:49.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a37fe700 1 -- 172.21.2.105:0/3106336537 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7f8798001660 con 0x7f87a40adaf0 2021-11-12T06:35:49.417 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a37fe700 1 -- 172.21.2.105:0/3106336537 >> v1:172.21.2.105:6789/0 conn(0x7f87a40adaf0 legacy=0x7f87a413fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a37fe700 1 --2- 172.21.2.105:0/3106336537 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f87a4143b40 0x7f8790003800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a37fe700 1 --2- 172.21.2.105:0/3106336537 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8790003ef0 0x7f8790004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.418 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a37fe700 1 --2- 172.21.2.105:0/3106336537 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8790004bf0 0x7f879000d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a37fe700 1 -- 172.21.2.105:0/3106336537 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a4143400 con 0x7f8790004bf0 2021-11-12T06:35:49.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a37fe700 1 -- 172.21.2.105:0/3106336537 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87900052f0 con 0x7f8790003ef0 2021-11-12T06:35:49.419 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a37fe700 1 -- 172.21.2.105:0/3106336537 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f879000de50 con 0x7f87a4143b40 2021-11-12T06:35:49.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a978e700 1 --2- 172.21.2.105:0/3106336537 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8790004bf0 0x7f879000d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:49.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a978e700 1 -- 172.21.2.105:0/3106336537 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f87a4143b40 msgr2=0x7f8790003800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T06:35:49.420 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a978e700 1 --2- 172.21.2.105:0/3106336537 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f87a4143b40 0x7f8790003800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a978e700 1 -- 172.21.2.105:0/3106336537 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8790003ef0 msgr2=0x7f8790004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T06:35:49.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a978e700 1 --2- 172.21.2.105:0/3106336537 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8790003ef0 0x7f8790004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.421 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a978e700 1 -- 172.21.2.105:0/3106336537 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8790003260 con 0x7f8790004bf0 2021-11-12T06:35:49.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a978e700 1 --2- 172.21.2.105:0/3106336537 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8790004bf0 0x7f879000d960 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 rx=0x7f879c0012f0 tx=0x7f879c007d60).ready entity=mon.0 client_cookie=846608e0fc0c0764 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:49.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a37fe700 1 -- 172.21.2.105:0/3106336537 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f879c0014c0 con 0x7f8790004bf0 2021-11-12T06:35:49.422 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a37fe700 1 -- 172.21.2.105:0/3106336537 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879c006870 con 0x7f8790004bf0 2021-11-12T06:35:49.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a37fe700 1 -- 172.21.2.105:0/3106336537 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f879c006bd0 con 0x7f8790004bf0 2021-11-12T06:35:49.423 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87ab1f1700 1 -- 172.21.2.105:0/3106336537 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8790004bf0 msgr2=0x7f879000d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87ab1f1700 1 --2- 172.21.2.105:0/3106336537 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8790004bf0 0x7f879000d960 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 rx=0x7f879c0012f0 tx=0x7f879c007d60).stop 2021-11-12T06:35:49.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a978e700 1 -- 172.21.2.105:0/3106336537 reap_dead start 2021-11-12T06:35:49.424 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87ab1f1700 1 -- 172.21.2.105:0/3106336537 shutdown_connections 2021-11-12T06:35:49.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87ab1f1700 1 -- 172.21.2.105:0/3106336537 >> 172.21.2.105:0/3106336537 conn(0x7f87a405c490 msgr2=0x7f87a405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:49.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87ab1f1700 1 -- 172.21.2.105:0/3106336537 shutdown_connections 2021-11-12T06:35:49.425 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87ab1f1700 1 -- 172.21.2.105:0/3106336537 wait complete. 2021-11-12T06:35:49.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87ab1f1700 1 Processor -- start 2021-11-12T06:35:49.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87ab1f1700 1 -- start start 2021-11-12T06:35:49.426 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87ab1f1700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8790004bf0 0x7f87a40b1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87ab1f1700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f87a415a930 0x7f87a4157260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.427 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87ab1f1700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f87a40a7020 0x7f87a40a79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87ab1f1700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a415ae20 con 0x7f87a40a7020 2021-11-12T06:35:49.429 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87ab1f1700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a4156b20 con 0x7f8790004bf0 2021-11-12T06:35:49.430 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87ab1f1700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a4156dc0 con 0x7f87a415a930 2021-11-12T06:35:49.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a978e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f87a40a7020 0x7f87a40a79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:49.431 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a978e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f87a40a7020 0x7f87a40a79a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53646/0 (socket says 172.21.2.105:53646) 2021-11-12T06:35:49.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a978e700 1 -- 172.21.2.105:0/3954046056 learned_addr learned my addr 172.21.2.105:0/3954046056 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T06:35:49.432 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a978e700 1 -- 172.21.2.105:0/3954046056 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f87a415a930 msgr2=0x7f87a4157260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a978e700 1 --2- 172.21.2.105:0/3954046056 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f87a415a930 0x7f87a4157260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.433 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a978e700 1 -- 172.21.2.105:0/3954046056 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8790004bf0 msgr2=0x7f87a40b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.434 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a978e700 1 --2- 172.21.2.105:0/3954046056 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8790004bf0 0x7f87a40b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a978e700 1 -- 172.21.2.105:0/3954046056 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a40b6760 con 0x7f87a40a7020 2021-11-12T06:35:49.435 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a978e700 1 --2- 172.21.2.105:0/3954046056 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f87a40a7020 0x7f87a40a79a0 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 rx=0x7f87a40621d0 tx=0x7f879c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:49.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a1ffb700 1 -- 172.21.2.105:0/3954046056 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f879c0014c0 con 0x7f87a40a7020 2021-11-12T06:35:49.436 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a1ffb700 1 -- 172.21.2.105:0/3954046056 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879c019070 con 0x7f87a40a7020 2021-11-12T06:35:49.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87ab1f1700 1 -- 172.21.2.105:0/3954046056 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87a4157750 con 0x7f87a40a7020 2021-11-12T06:35:49.437 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87a1ffb700 1 -- 172.21.2.105:0/3954046056 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f879c014860 con 0x7f87a40a7020 2021-11-12T06:35:49.438 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.403+0000 7f87ab1f1700 1 -- 172.21.2.105:0/3954046056 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87a40a8030 con 0x7f87a40a7020 2021-11-12T06:35:49.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.407+0000 7f87ab1f1700 1 -- 172.21.2.105:0/3954046056 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f87a4156960 con 0x7f87a40a7020 2021-11-12T06:35:49.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.407+0000 7f87a1ffb700 1 -- 172.21.2.105:0/3954046056 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f879c01e070 con 0x7f87a40a7020 2021-11-12T06:35:49.439 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.407+0000 7f87a1ffb700 1 --2- 172.21.2.105:0/3954046056 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8784053520 0x7f87840559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.407+0000 7f87a8f8d700 1 --2- 172.21.2.105:0/3954046056 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8784053520 0x7f87840559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:49.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.407+0000 7f87a1ffb700 1 -- 172.21.2.105:0/3954046056 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f879c046aa0 con 0x7f87a40a7020 2021-11-12T06:35:49.440 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.407+0000 7f87a1ffb700 1 --2- 172.21.2.105:0/3954046056 >> [v2:172.21.2.115:6800/15096,v1:172.21.2.115:6801/15096] conn(0x7f878405a350 0x7f878405c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.407+0000 7f87a1ffb700 1 -- 172.21.2.105:0/3954046056 --> [v2:172.21.2.115:6800/15096,v1:172.21.2.115:6801/15096] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f878405cdd0 con 0x7f878405a350 2021-11-12T06:35:49.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.407+0000 7f87a1ffb700 1 -- 172.21.2.105:0/3954046056 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=159) v2 ==== 24+0+0 (secure 0 0 0) 0x7f879c046c60 con 0x7f87a40a7020 2021-11-12T06:35:49.441 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.407+0000 7f87a8f8d700 1 --2- 172.21.2.105:0/3954046056 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8784053520 0x7f87840559e0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7f87a40b40a0 tx=0x7f87a4143830).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:49.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.407+0000 7f87a3fff700 1 --2- 172.21.2.105:0/3954046056 >> [v2:172.21.2.115:6800/15096,v1:172.21.2.115:6801/15096] conn(0x7f878405a350 0x7f878405c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:49.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.407+0000 7f87a3fff700 1 --2- 172.21.2.105:0/3954046056 >> [v2:172.21.2.115:6800/15096,v1:172.21.2.115:6801/15096] conn(0x7f878405a350 0x7f878405c770 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:49.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.411+0000 7f87a1ffb700 1 -- 172.21.2.105:0/3954046056 <== osd.4 v2:172.21.2.115:6800/15096 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f878405cdd0 con 0x7f878405a350 2021-11-12T06:35:49.443 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.419+0000 7f87ab1f1700 1 -- 172.21.2.105:0/3954046056 --> [v2:172.21.2.115:6800/15096,v1:172.21.2.115:6801/15096] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f87a4156f80 con 0x7f878405a350 2021-11-12T06:35:49.444 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.419+0000 7f87a1ffb700 1 -- 172.21.2.105:0/3954046056 <== osd.4 v2:172.21.2.115:6800/15096 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f87a4156f80 con 0x7f878405a350 2021-11-12T06:35:49.444 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T06:35:49.445 INFO:teuthology.orchestra.run.gibba005.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-11-12T06:35:49.445 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T06:35:49.447 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.419+0000 7f87ab1f1700 1 -- 172.21.2.105:0/3954046056 >> [v2:172.21.2.115:6800/15096,v1:172.21.2.115:6801/15096] conn(0x7f878405a350 msgr2=0x7f878405c770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.419+0000 7f87ab1f1700 1 --2- 172.21.2.105:0/3954046056 >> [v2:172.21.2.115:6800/15096,v1:172.21.2.115:6801/15096] conn(0x7f878405a350 0x7f878405c770 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:49.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.419+0000 7f87ab1f1700 1 -- 172.21.2.105:0/3954046056 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8784053520 msgr2=0x7f87840559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.419+0000 7f87ab1f1700 1 --2- 172.21.2.105:0/3954046056 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8784053520 0x7f87840559e0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7f87a40b40a0 tx=0x7f87a4143830).stop 2021-11-12T06:35:49.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.419+0000 7f87ab1f1700 1 -- 172.21.2.105:0/3954046056 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f87a40a7020 msgr2=0x7f87a40a79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.419+0000 7f87ab1f1700 1 --2- 172.21.2.105:0/3954046056 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f87a40a7020 0x7f87a40a79a0 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 rx=0x7f87a40621d0 tx=0x7f879c016000).stop 2021-11-12T06:35:49.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.419+0000 7f87a978e700 1 -- 172.21.2.105:0/3954046056 reap_dead start 2021-11-12T06:35:49.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.419+0000 7f87ab1f1700 1 -- 172.21.2.105:0/3954046056 shutdown_connections 2021-11-12T06:35:49.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.419+0000 7f87ab1f1700 1 -- 172.21.2.105:0/3954046056 >> 172.21.2.105:0/3954046056 conn(0x7f87a405c490 msgr2=0x7f87a41417a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:49.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.419+0000 7f87ab1f1700 1 -- 172.21.2.105:0/3954046056 shutdown_connections 2021-11-12T06:35:49.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.419+0000 7f87ab1f1700 1 -- 172.21.2.105:0/3954046056 wait complete. 2021-11-12T06:35:49.452 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2021-11-12T06:35:49.521 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0ac697700 1 Processor -- start 2021-11-12T06:35:49.521 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0ac697700 1 -- start start 2021-11-12T06:35:49.527 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0ac697700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fe0a40adaf0 0x7fe0a413fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0ac697700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a4067860 con 0x7fe0a4143b40 2021-11-12T06:35:49.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0ac697700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a4143400 con 0x7fe0a4143fb0 2021-11-12T06:35:49.528 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0ac697700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a41436a0 con 0x7fe0a40adaf0 2021-11-12T06:35:49.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0a9c32700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fe0a4143b40 0x7fe0a40aded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:35822/0 (socket says 172.21.2.105:35822) 2021-11-12T06:35:49.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0a9c32700 1 -- 172.21.2.105:0/4110759885 learned_addr learned my addr 172.21.2.105:0/4110759885 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T06:35:49.529 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0a9431700 1 -- 172.21.2.105:0/4110759885 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2785615285 0 0) 0x7fe0a4067860 con 0x7fe0a4143b40 2021-11-12T06:35:49.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0a9431700 1 -- 172.21.2.105:0/4110759885 --> v1:172.21.2.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe08c003260 con 0x7fe0a4143b40 2021-11-12T06:35:49.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0a9431700 1 -- 172.21.2.105:0/4110759885 <== mon.0 v1:172.21.2.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1908362348 0 0) 0x7fe08c003260 con 0x7fe0a4143b40 2021-11-12T06:35:49.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0a9431700 1 -- 172.21.2.105:0/4110759885 >> v2:172.21.2.115:3300/0 conn(0x7fe0a40adaf0 msgr2=0x7fe0a413fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T06:35:49.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0a9431700 1 --2- 172.21.2.105:0/4110759885 >> v2:172.21.2.115:3300/0 conn(0x7fe0a40adaf0 0x7fe0a413fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0a9431700 1 -- 172.21.2.105:0/4110759885 >> v1:172.21.2.115:6789/0 conn(0x7fe0a4143fb0 legacy=0x7fe0a40afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T06:35:49.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0a9431700 1 -- 172.21.2.105:0/4110759885 --> v1:172.21.2.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a40b2b40 con 0x7fe0a4143b40 2021-11-12T06:35:49.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0a9431700 1 -- 172.21.2.105:0/4110759885 <== mon.0 v1:172.21.2.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4231782477 0 0) 0x7fe098001660 con 0x7fe0a4143b40 2021-11-12T06:35:49.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0a9431700 1 -- 172.21.2.105:0/4110759885 >> v1:172.21.2.105:6789/0 conn(0x7fe0a4143b40 legacy=0x7fe0a40aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.532 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0a9431700 1 --2- 172.21.2.105:0/4110759885 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe08c003750 0x7fe08c003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0a9431700 1 --2- 172.21.2.105:0/4110759885 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe08c004500 0x7fe08c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.533 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0a9431700 1 --2- 172.21.2.105:0/4110759885 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe08c004f90 0x7fe08c00d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0a9431700 1 -- 172.21.2.105:0/4110759885 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a41436a0 con 0x7fe08c004500 2021-11-12T06:35:49.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0a9431700 1 -- 172.21.2.105:0/4110759885 --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08c00e090 con 0x7fe08c004f90 2021-11-12T06:35:49.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0a9431700 1 -- 172.21.2.105:0/4110759885 --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe08c00e250 con 0x7fe08c003750 2021-11-12T06:35:49.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0a9c32700 1 --2- 172.21.2.105:0/4110759885 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe08c004500 0x7fe08c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:49.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0a9c32700 1 -- 172.21.2.105:0/4110759885 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe08c003750 msgr2=0x7fe08c003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T06:35:49.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0a9c32700 1 --2- 172.21.2.105:0/4110759885 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe08c003750 0x7fe08c003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0a9c32700 1 -- 172.21.2.105:0/4110759885 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe08c004f90 msgr2=0x7fe08c00d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T06:35:49.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0a9c32700 1 --2- 172.21.2.105:0/4110759885 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe08c004f90 0x7fe08c00d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0a9c32700 1 -- 172.21.2.105:0/4110759885 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe08c003260 con 0x7fe08c004500 2021-11-12T06:35:49.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0aac34700 1 -- 172.21.2.105:0/4110759885 reap_dead start 2021-11-12T06:35:49.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0a9c32700 1 --2- 172.21.2.105:0/4110759885 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe08c004500 0x7fe08c004980 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 rx=0x7fe0a40625f0 tx=0x7fe0a4143590).ready entity=mon.0 client_cookie=176031bffb43fb21 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:49.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0a9431700 1 -- 172.21.2.105:0/4110759885 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0980071a0 con 0x7fe08c004500 2021-11-12T06:35:49.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0a9431700 1 -- 172.21.2.105:0/4110759885 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe098007300 con 0x7fe08c004500 2021-11-12T06:35:49.538 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0a9431700 1 -- 172.21.2.105:0/4110759885 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe09800c8f0 con 0x7fe08c004500 2021-11-12T06:35:49.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0ac697700 1 -- 172.21.2.105:0/4110759885 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe08c004500 msgr2=0x7fe08c004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0ac697700 1 --2- 172.21.2.105:0/4110759885 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe08c004500 0x7fe08c004980 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 rx=0x7fe0a40625f0 tx=0x7fe0a4143590).stop 2021-11-12T06:35:49.539 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0ac697700 1 -- 172.21.2.105:0/4110759885 shutdown_connections 2021-11-12T06:35:49.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0ac697700 1 --2- 172.21.2.105:0/4110759885 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe08c004500 0x7fe08c004980 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:49.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0ac697700 1 -- 172.21.2.105:0/4110759885 >> 172.21.2.105:0/4110759885 conn(0x7fe0a405c490 msgr2=0x7fe0a405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:49.540 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0ac697700 1 -- 172.21.2.105:0/4110759885 shutdown_connections 2021-11-12T06:35:49.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.519+0000 7fe0ac697700 1 -- 172.21.2.105:0/4110759885 wait complete. 2021-11-12T06:35:49.541 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.523+0000 7fe0ac697700 1 Processor -- start 2021-11-12T06:35:49.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.523+0000 7fe0ac697700 1 -- start start 2021-11-12T06:35:49.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.523+0000 7fe0ac697700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe08c004500 0x7fe0a40647c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.542 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.523+0000 7fe0ac697700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe0a4064cb0 0x7fe0a40ac880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.523+0000 7fe0ac697700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe0a40acd70 0x7fe0a41518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.523+0000 7fe0ac697700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a414f0f0 con 0x7fe0a40acd70 2021-11-12T06:35:49.543 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.523+0000 7fe0ac697700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a413db00 con 0x7fe0a4064cb0 2021-11-12T06:35:49.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.523+0000 7fe0ac697700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a40ad220 con 0x7fe08c004500 2021-11-12T06:35:49.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.523+0000 7fe0aac34700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe0a40acd70 0x7fe0a41518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:49.544 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.523+0000 7fe0aac34700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe0a40acd70 0x7fe0a41518c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53668/0 (socket says 172.21.2.105:53668) 2021-11-12T06:35:49.545 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.523+0000 7fe0aac34700 1 -- 172.21.2.105:0/2897860495 learned_addr learned my addr 172.21.2.105:0/2897860495 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T06:35:49.545 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.523+0000 7fe0aac34700 1 -- 172.21.2.105:0/2897860495 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe08c004500 msgr2=0x7fe0a40647c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.545 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.523+0000 7fe0aac34700 1 --2- 172.21.2.105:0/2897860495 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe08c004500 0x7fe0a40647c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.546 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.523+0000 7fe0aac34700 1 -- 172.21.2.105:0/2897860495 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe0a4064cb0 msgr2=0x7fe0a40ac880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.546 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.523+0000 7fe0aac34700 1 --2- 172.21.2.105:0/2897860495 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe0a4064cb0 0x7fe0a40ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.546 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.523+0000 7fe0aac34700 1 -- 172.21.2.105:0/2897860495 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a413f8b0 con 0x7fe0a40acd70 2021-11-12T06:35:49.547 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.523+0000 7fe0aac34700 1 --2- 172.21.2.105:0/2897860495 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe0a40acd70 0x7fe0a41518c0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 rx=0x7fe0a4062590 tx=0x7fe09c007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:49.547 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.523+0000 7fe0977fe700 1 -- 172.21.2.105:0/2897860495 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe09c004850 con 0x7fe0a40acd70 2021-11-12T06:35:49.547 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.523+0000 7fe0977fe700 1 -- 172.21.2.105:0/2897860495 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09c0049b0 con 0x7fe0a40acd70 2021-11-12T06:35:49.548 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.523+0000 7fe0977fe700 1 -- 172.21.2.105:0/2897860495 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe09c004d10 con 0x7fe0a40acd70 2021-11-12T06:35:49.548 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.523+0000 7fe0ac697700 1 -- 172.21.2.105:0/2897860495 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a414ecc0 con 0x7fe0a40acd70 2021-11-12T06:35:49.548 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.523+0000 7fe0ac697700 1 -- 172.21.2.105:0/2897860495 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a4151f50 con 0x7fe0a40acd70 2021-11-12T06:35:49.549 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.523+0000 7fe0ac697700 1 -- 172.21.2.105:0/2897860495 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a413dcc0 con 0x7fe0a40acd70 2021-11-12T06:35:49.549 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.523+0000 7fe0977fe700 1 -- 172.21.2.105:0/2897860495 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe09c01c070 con 0x7fe0a40acd70 2021-11-12T06:35:49.549 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.523+0000 7fe0977fe700 1 --2- 172.21.2.105:0/2897860495 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe0840579c0 0x7fe084059e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.550 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.523+0000 7fe0977fe700 1 -- 172.21.2.105:0/2897860495 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fe09c06aa00 con 0x7fe0a40acd70 2021-11-12T06:35:49.550 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.523+0000 7fe0aa433700 1 --2- 172.21.2.105:0/2897860495 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe0840579c0 0x7fe084059e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:49.550 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.523+0000 7fe0aa433700 1 --2- 172.21.2.105:0/2897860495 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe0840579c0 0x7fe084059e80 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7fe0a0002f70 tx=0x7fe0a0006a80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:49.551 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.527+0000 7fe0977fe700 1 -- 172.21.2.105:0/2897860495 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe09c041bd0 con 0x7fe0a40acd70 2021-11-12T06:35:49.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.611+0000 7fe0ac697700 1 -- 172.21.2.105:0/2897860495 --> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0a413d980 con 0x7fe0840579c0 2021-11-12T06:35:49.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.611+0000 7fe0977fe700 1 -- 172.21.2.105:0/2897860495 <== mgr.4107 v2:172.21.2.105:6800/14730 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe0a0012450 con 0x7fe0840579c0 2021-11-12T06:35:49.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.611+0000 7fe0ac697700 1 -- 172.21.2.105:0/2897860495 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe0840579c0 msgr2=0x7fe084059e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.611+0000 7fe0ac697700 1 --2- 172.21.2.105:0/2897860495 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe0840579c0 0x7fe084059e80 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7fe0a0002f70 tx=0x7fe0a0006a80).stop 2021-11-12T06:35:49.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.611+0000 7fe0ac697700 1 -- 172.21.2.105:0/2897860495 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe0a40acd70 msgr2=0x7fe0a41518c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.611+0000 7fe0ac697700 1 --2- 172.21.2.105:0/2897860495 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe0a40acd70 0x7fe0a41518c0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 rx=0x7fe0a4062590 tx=0x7fe09c007e10).stop 2021-11-12T06:35:49.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.611+0000 7fe0ac697700 1 -- 172.21.2.105:0/2897860495 shutdown_connections 2021-11-12T06:35:49.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.611+0000 7fe0ac697700 1 --2- 172.21.2.105:0/2897860495 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe0840579c0 0x7fe084059e80 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:49.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.611+0000 7fe0ac697700 1 --2- 172.21.2.105:0/2897860495 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe0a40acd70 0x7fe0a41518c0 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:49.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.611+0000 7fe0ac697700 1 --2- 172.21.2.105:0/2897860495 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe0a4064cb0 0x7fe0a40ac880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.611+0000 7fe0ac697700 1 --2- 172.21.2.105:0/2897860495 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe08c004500 0x7fe0a40647c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.611+0000 7fe0ac697700 1 -- 172.21.2.105:0/2897860495 >> 172.21.2.105:0/2897860495 conn(0x7fe0a405c490 msgr2=0x7fe0a413cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:49.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.611+0000 7fe0ac697700 1 -- 172.21.2.105:0/2897860495 shutdown_connections 2021-11-12T06:35:49.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.611+0000 7fe0ac697700 1 -- 172.21.2.105:0/2897860495 wait complete. 2021-11-12T06:35:49.619 INFO:teuthology.orchestra.run.gibba005.stderr:instructed osd(s) 4 to deep-scrub 2021-11-12T06:35:49.621 INFO:tasks.ceph:Scrubbing osd.5 2021-11-12T06:35:49.622 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2021-11-12T06:35:49.686 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.683+0000 7fb694bb3700 1 Processor -- start 2021-11-12T06:35:49.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.683+0000 7fb694bb3700 1 -- start start 2021-11-12T06:35:49.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.683+0000 7fb694bb3700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb6900ac280 0x7fb69014b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.687 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.683+0000 7fb694bb3700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7fb6900af730 0x7fb6900ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.683+0000 7fb694bb3700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6900ac7b0 con 0x7fb6900ad080 2021-11-12T06:35:49.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.683+0000 7fb694bb3700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6901488a0 con 0x7fb6900ac280 2021-11-12T06:35:49.688 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.683+0000 7fb694bb3700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6900ac9e0 con 0x7fb6900af730 2021-11-12T06:35:49.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.683+0000 7fb68dd9b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb6900ac280 0x7fb69014b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:49.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.683+0000 7fb68dd9b700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fb6900ac280 0x7fb69014b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53680/0 (socket says 172.21.2.105:53680) 2021-11-12T06:35:49.689 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.683+0000 7fb68dd9b700 1 -- 172.21.2.105:0/3645563462 learned_addr learned my addr 172.21.2.105:0/3645563462 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T06:35:49.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.683+0000 7fb68dd9b700 1 -- 172.21.2.105:0/3645563462 >> v2:172.21.2.115:3300/0 conn(0x7fb6900af730 msgr2=0x7fb6900ad460 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T06:35:49.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.683+0000 7fb68dd9b700 1 --2- 172.21.2.105:0/3645563462 >> v2:172.21.2.115:3300/0 conn(0x7fb6900af730 0x7fb6900ad460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.690 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.683+0000 7fb68dd9b700 1 -- 172.21.2.105:0/3645563462 >> v1:172.21.2.115:6789/0 conn(0x7fb6900ad080 legacy=0x7fb69014abe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T06:35:49.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.683+0000 7fb68dd9b700 1 -- 172.21.2.105:0/3645563462 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6900b0b30 con 0x7fb6900ac280 2021-11-12T06:35:49.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.683+0000 7fb68dd9b700 1 --2- 172.21.2.105:0/3645563462 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6900ac280 0x7fb69014b2f0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 rx=0x7fb6900b0eb0 tx=0x7fb680006eb0).ready entity=mon.0 client_cookie=83852217a4f033be server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:49.691 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.683+0000 7fb68d59a700 1 -- 172.21.2.105:0/3645563462 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb68000d5c0 con 0x7fb6900ac280 2021-11-12T06:35:49.692 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.683+0000 7fb68d59a700 1 -- 172.21.2.105:0/3645563462 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb680000e90 con 0x7fb6900ac280 2021-11-12T06:35:49.692 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.683+0000 7fb68d59a700 1 -- 172.21.2.105:0/3645563462 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb68000d950 con 0x7fb6900ac280 2021-11-12T06:35:49.692 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.683+0000 7fb694bb3700 1 -- 172.21.2.105:0/3645563462 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6900ac280 msgr2=0x7fb69014b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.683+0000 7fb694bb3700 1 --2- 172.21.2.105:0/3645563462 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6900ac280 0x7fb69014b2f0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 rx=0x7fb6900b0eb0 tx=0x7fb680006eb0).stop 2021-11-12T06:35:49.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.683+0000 7fb694bb3700 1 -- 172.21.2.105:0/3645563462 shutdown_connections 2021-11-12T06:35:49.693 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.683+0000 7fb694bb3700 1 --2- 172.21.2.105:0/3645563462 >> v2:172.21.2.115:3300/0 conn(0x7fb6900af730 0x7fb6900ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.683+0000 7fb694bb3700 1 --2- 172.21.2.105:0/3645563462 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6900ac280 0x7fb69014b2f0 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:49.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.683+0000 7fb694bb3700 1 -- 172.21.2.105:0/3645563462 >> 172.21.2.105:0/3645563462 conn(0x7fb6900b5370 msgr2=0x7fb6900b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:49.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.683+0000 7fb694bb3700 1 -- 172.21.2.105:0/3645563462 shutdown_connections 2021-11-12T06:35:49.695 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.683+0000 7fb694bb3700 1 -- 172.21.2.105:0/3645563462 wait complete. 2021-11-12T06:35:49.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.683+0000 7fb694bb3700 1 Processor -- start 2021-11-12T06:35:49.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.683+0000 7fb694bb3700 1 -- start start 2021-11-12T06:35:49.698 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.683+0000 7fb694bb3700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb6900ac280 0x7fb6900a8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.683+0000 7fb694bb3700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb6900ad080 0x7fb6900a7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.683+0000 7fb694bb3700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6900af730 0x7fb690157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.683+0000 7fb694bb3700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6900aa0f0 con 0x7fb6900af730 2021-11-12T06:35:49.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.683+0000 7fb694bb3700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb690156dc0 con 0x7fb6900ac280 2021-11-12T06:35:49.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.683+0000 7fb694bb3700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6900aae70 con 0x7fb6900ad080 2021-11-12T06:35:49.701 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.683+0000 7fb68ed9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6900af730 0x7fb690157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:49.701 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.683+0000 7fb68ed9d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6900af730 0x7fb690157490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53686/0 (socket says 172.21.2.105:53686) 2021-11-12T06:35:49.701 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.683+0000 7fb68ed9d700 1 -- 172.21.2.105:0/4241907767 learned_addr learned my addr 172.21.2.105:0/4241907767 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T06:35:49.702 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.687+0000 7fb68ed9d700 1 -- 172.21.2.105:0/4241907767 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb6900ad080 msgr2=0x7fb6900a7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.702 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.687+0000 7fb68ed9d700 1 --2- 172.21.2.105:0/4241907767 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fb6900ad080 0x7fb6900a7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.703 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.687+0000 7fb68ed9d700 1 -- 172.21.2.105:0/4241907767 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb6900ac280 msgr2=0x7fb6900a8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.703 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.687+0000 7fb68ed9d700 1 --2- 172.21.2.105:0/4241907767 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fb6900ac280 0x7fb6900a8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.703 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.687+0000 7fb68ed9d700 1 -- 172.21.2.105:0/4241907767 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb68000b1e0 con 0x7fb6900af730 2021-11-12T06:35:49.704 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.687+0000 7fb68ed9d700 1 --2- 172.21.2.105:0/4241907767 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6900af730 0x7fb690157490 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 rx=0x7fb688001250 tx=0x7fb6880090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:49.704 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.687+0000 7fb6877fe700 1 -- 172.21.2.105:0/4241907767 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6880014e0 con 0x7fb6900af730 2021-11-12T06:35:49.705 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.687+0000 7fb6877fe700 1 -- 172.21.2.105:0/4241907767 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb688001640 con 0x7fb6900af730 2021-11-12T06:35:49.705 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.687+0000 7fb694bb3700 1 -- 172.21.2.105:0/4241907767 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb690156ff0 con 0x7fb6900af730 2021-11-12T06:35:49.705 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.687+0000 7fb694bb3700 1 -- 172.21.2.105:0/4241907767 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6900a8780 con 0x7fb6900af730 2021-11-12T06:35:49.706 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.687+0000 7fb6877fe700 1 -- 172.21.2.105:0/4241907767 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6880019a0 con 0x7fb6900af730 2021-11-12T06:35:49.706 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.687+0000 7fb694bb3700 1 -- 172.21.2.105:0/4241907767 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb690157180 con 0x7fb6900af730 2021-11-12T06:35:49.706 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.687+0000 7fb6877fe700 1 -- 172.21.2.105:0/4241907767 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fb688018030 con 0x7fb6900af730 2021-11-12T06:35:49.707 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.687+0000 7fb6877fe700 1 --2- 172.21.2.105:0/4241907767 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb674053660 0x7fb674055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.707 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.687+0000 7fb6877fe700 1 -- 172.21.2.105:0/4241907767 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fb68806ba50 con 0x7fb6900af730 2021-11-12T06:35:49.708 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.687+0000 7fb6877fe700 1 --2- 172.21.2.105:0/4241907767 >> [v2:172.21.2.115:6808/15097,v1:172.21.2.115:6809/15097] conn(0x7fb67405a4f0 0x7fb67405c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.708 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.687+0000 7fb68e59c700 1 --2- 172.21.2.105:0/4241907767 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb674053660 0x7fb674055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:49.708 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.687+0000 7fb6877fe700 1 -- 172.21.2.105:0/4241907767 --> [v2:172.21.2.115:6808/15097,v1:172.21.2.115:6809/15097] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb67405ced0 con 0x7fb67405a4f0 2021-11-12T06:35:49.709 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.687+0000 7fb6877fe700 1 -- 172.21.2.105:0/4241907767 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=159) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb68806bd60 con 0x7fb6900af730 2021-11-12T06:35:49.709 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.687+0000 7fb68e59c700 1 --2- 172.21.2.105:0/4241907767 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb674053660 0x7fb674055b20 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7fb678002fb0 tx=0x7fb6780069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:49.710 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.687+0000 7fb68dd9b700 1 --2- 172.21.2.105:0/4241907767 >> [v2:172.21.2.115:6808/15097,v1:172.21.2.115:6809/15097] conn(0x7fb67405a4f0 0x7fb67405c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:49.710 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.687+0000 7fb68dd9b700 1 --2- 172.21.2.105:0/4241907767 >> [v2:172.21.2.115:6808/15097,v1:172.21.2.115:6809/15097] conn(0x7fb67405a4f0 0x7fb67405c910 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:49.710 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.691+0000 7fb6877fe700 1 -- 172.21.2.105:0/4241907767 <== osd.5 v2:172.21.2.115:6808/15097 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7fb67405ced0 con 0x7fb67405a4f0 2021-11-12T06:35:49.711 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.699+0000 7fb694bb3700 1 -- 172.21.2.105:0/4241907767 --> [v2:172.21.2.115:6808/15097,v1:172.21.2.115:6809/15097] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb690057350 con 0x7fb67405a4f0 2021-11-12T06:35:49.712 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.699+0000 7fb6877fe700 1 -- 172.21.2.105:0/4241907767 <== osd.5 v2:172.21.2.115:6808/15097 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb690057350 con 0x7fb67405a4f0 2021-11-12T06:35:49.712 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T06:35:49.713 INFO:teuthology.orchestra.run.gibba005.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-11-12T06:35:49.713 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T06:35:49.714 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.699+0000 7fb694bb3700 1 -- 172.21.2.105:0/4241907767 >> [v2:172.21.2.115:6808/15097,v1:172.21.2.115:6809/15097] conn(0x7fb67405a4f0 msgr2=0x7fb67405c910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.715 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.699+0000 7fb694bb3700 1 --2- 172.21.2.105:0/4241907767 >> [v2:172.21.2.115:6808/15097,v1:172.21.2.115:6809/15097] conn(0x7fb67405a4f0 0x7fb67405c910 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:49.715 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.699+0000 7fb694bb3700 1 -- 172.21.2.105:0/4241907767 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb674053660 msgr2=0x7fb674055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.715 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.699+0000 7fb694bb3700 1 --2- 172.21.2.105:0/4241907767 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fb674053660 0x7fb674055b20 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7fb678002fb0 tx=0x7fb6780069b0).stop 2021-11-12T06:35:49.716 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.699+0000 7fb694bb3700 1 -- 172.21.2.105:0/4241907767 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6900af730 msgr2=0x7fb690157490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.716 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.699+0000 7fb694bb3700 1 --2- 172.21.2.105:0/4241907767 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fb6900af730 0x7fb690157490 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 rx=0x7fb688001250 tx=0x7fb6880090f0).stop 2021-11-12T06:35:49.716 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.699+0000 7fb68ed9d700 1 -- 172.21.2.105:0/4241907767 reap_dead start 2021-11-12T06:35:49.717 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.699+0000 7fb694bb3700 1 -- 172.21.2.105:0/4241907767 shutdown_connections 2021-11-12T06:35:49.717 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.699+0000 7fb694bb3700 1 -- 172.21.2.105:0/4241907767 >> 172.21.2.105:0/4241907767 conn(0x7fb6900b5370 msgr2=0x7fb6900b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:49.717 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.699+0000 7fb694bb3700 1 -- 172.21.2.105:0/4241907767 shutdown_connections 2021-11-12T06:35:49.718 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.699+0000 7fb694bb3700 1 -- 172.21.2.105:0/4241907767 wait complete. 2021-11-12T06:35:49.718 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2021-11-12T06:35:49.776 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe122143700 1 Processor -- start 2021-11-12T06:35:49.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe122143700 1 -- start start 2021-11-12T06:35:49.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe122143700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fe11c0ad080 0x7fe11c0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe122143700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe11c0ac7b0 con 0x7fe11c0ac280 2021-11-12T06:35:49.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe122143700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe11c0ac9e0 con 0x7fe11c14b2f0 2021-11-12T06:35:49.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe122143700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe11c1488a0 con 0x7fe11c0ad080 2021-11-12T06:35:49.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe11affd700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fe11c0ac280 0x7fe11c14abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:35860/0 (socket says 172.21.2.105:35860) 2021-11-12T06:35:49.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe11affd700 1 -- 172.21.2.105:0/4095476887 learned_addr learned my addr 172.21.2.105:0/4095476887 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T06:35:49.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe11b7fe700 1 --2- 172.21.2.105:0/4095476887 >> v2:172.21.2.105:3300/0 conn(0x7fe11c0ad080 0x7fe11c0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:49.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe11b7fe700 1 -- 172.21.2.105:0/4095476887 >> v1:172.21.2.115:6789/0 conn(0x7fe11c14b2f0 legacy=0x7fe11c147a60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T06:35:49.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe11b7fe700 1 -- 172.21.2.105:0/4095476887 >> v1:172.21.2.105:6789/0 conn(0x7fe11c0ac280 legacy=0x7fe11c14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.781 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe11b7fe700 1 -- 172.21.2.105:0/4095476887 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11c0b0b30 con 0x7fe11c0ad080 2021-11-12T06:35:49.781 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe11b7fe700 1 --2- 172.21.2.105:0/4095476887 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe11c0ad080 0x7fe11c0af730 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 rx=0x7fe11c0b0eb0 tx=0x7fe104006df0).ready entity=mon.0 client_cookie=b71333453ecc2b92 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:49.781 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe11a7fc700 1 -- 172.21.2.105:0/4095476887 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe10400d5c0 con 0x7fe11c0ad080 2021-11-12T06:35:49.782 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe11a7fc700 1 -- 172.21.2.105:0/4095476887 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe104000e90 con 0x7fe11c0ad080 2021-11-12T06:35:49.782 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe11a7fc700 1 -- 172.21.2.105:0/4095476887 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe10400d910 con 0x7fe11c0ad080 2021-11-12T06:35:49.786 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe122143700 1 -- 172.21.2.105:0/4095476887 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe11c0ad080 msgr2=0x7fe11c0af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.786 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe122143700 1 --2- 172.21.2.105:0/4095476887 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe11c0ad080 0x7fe11c0af730 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 rx=0x7fe11c0b0eb0 tx=0x7fe104006df0).stop 2021-11-12T06:35:49.787 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe122143700 1 -- 172.21.2.105:0/4095476887 shutdown_connections 2021-11-12T06:35:49.787 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe122143700 1 --2- 172.21.2.105:0/4095476887 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe11c0ad080 0x7fe11c0af730 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:49.787 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe122143700 1 -- 172.21.2.105:0/4095476887 >> 172.21.2.105:0/4095476887 conn(0x7fe11c0b5370 msgr2=0x7fe11c0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:49.788 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe122143700 1 -- 172.21.2.105:0/4095476887 shutdown_connections 2021-11-12T06:35:49.788 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe122143700 1 -- 172.21.2.105:0/4095476887 wait complete. 2021-11-12T06:35:49.788 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe122143700 1 Processor -- start 2021-11-12T06:35:49.789 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe122143700 1 -- start start 2021-11-12T06:35:49.789 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe122143700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe11c0ac280 0x7fe11c1450c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.789 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe122143700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe11c0ad080 0x7fe11c066900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.790 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe122143700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe11c14b2f0 0x7fe11c066df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.790 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe122143700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c0aa470 con 0x7fe11c0ac280 2021-11-12T06:35:49.790 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe122143700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c0a7b20 con 0x7fe11c14b2f0 2021-11-12T06:35:49.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe122143700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c0a75e0 con 0x7fe11c0ad080 2021-11-12T06:35:49.791 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe11b7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe11c0ac280 0x7fe11c1450c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:49.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe11b7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe11c0ac280 0x7fe11c1450c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53700/0 (socket says 172.21.2.105:53700) 2021-11-12T06:35:49.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe11b7fe700 1 -- 172.21.2.105:0/928331723 learned_addr learned my addr 172.21.2.105:0/928331723 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T06:35:49.792 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe11b7fe700 1 -- 172.21.2.105:0/928331723 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe11c0ad080 msgr2=0x7fe11c066900 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T06:35:49.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe11b7fe700 1 --2- 172.21.2.105:0/928331723 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe11c0ad080 0x7fe11c066900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe11b7fe700 1 -- 172.21.2.105:0/928331723 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe11c14b2f0 msgr2=0x7fe11c066df0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T06:35:49.793 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe11b7fe700 1 --2- 172.21.2.105:0/928331723 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe11c14b2f0 0x7fe11c066df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe11b7fe700 1 -- 172.21.2.105:0/928331723 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10400b180 con 0x7fe11c0ac280 2021-11-12T06:35:49.794 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe11b7fe700 1 --2- 172.21.2.105:0/928331723 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe11c0ac280 0x7fe11c1450c0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 rx=0x7fe11c14b040 tx=0x7fe104012000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:49.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe118ff9700 1 -- 172.21.2.105:0/928331723 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe104002f50 con 0x7fe11c0ac280 2021-11-12T06:35:49.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe118ff9700 1 -- 172.21.2.105:0/928331723 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe104013d10 con 0x7fe11c0ac280 2021-11-12T06:35:49.795 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe118ff9700 1 -- 172.21.2.105:0/928331723 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe10401f640 con 0x7fe11c0ac280 2021-11-12T06:35:49.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe122143700 1 -- 172.21.2.105:0/928331723 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe11c0a7880 con 0x7fe11c0ac280 2021-11-12T06:35:49.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.775+0000 7fe122143700 1 -- 172.21.2.105:0/928331723 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11c0672e0 con 0x7fe11c0ac280 2021-11-12T06:35:49.796 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.779+0000 7fe122143700 1 -- 172.21.2.105:0/928331723 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe11c0b1440 con 0x7fe11c0ac280 2021-11-12T06:35:49.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.779+0000 7fe118ff9700 1 -- 172.21.2.105:0/928331723 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fe104026070 con 0x7fe11c0ac280 2021-11-12T06:35:49.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.779+0000 7fe118ff9700 1 --2- 172.21.2.105:0/928331723 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe100053610 0x7fe100055ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.797 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.779+0000 7fe118ff9700 1 -- 172.21.2.105:0/928331723 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fe10406c2e0 con 0x7fe11c0ac280 2021-11-12T06:35:49.798 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.779+0000 7fe11affd700 1 --2- 172.21.2.105:0/928331723 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe100053610 0x7fe100055ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:49.798 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.779+0000 7fe11affd700 1 --2- 172.21.2.105:0/928331723 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe100053610 0x7fe100055ad0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7fe11c0b06e0 tx=0x7fe10c007790).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:49.798 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.779+0000 7fe118ff9700 1 -- 172.21.2.105:0/928331723 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe1040434b0 con 0x7fe11c0ac280 2021-11-12T06:35:49.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.863+0000 7fe122143700 1 -- 172.21.2.105:0/928331723 --> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fe11c057350 con 0x7fe100053610 2021-11-12T06:35:49.866 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.863+0000 7fe118ff9700 1 -- 172.21.2.105:0/928331723 <== mgr.4107 v2:172.21.2.105:6800/14730 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe11c057350 con 0x7fe100053610 2021-11-12T06:35:49.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.863+0000 7fe122143700 1 -- 172.21.2.105:0/928331723 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe100053610 msgr2=0x7fe100055ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.863+0000 7fe122143700 1 --2- 172.21.2.105:0/928331723 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe100053610 0x7fe100055ad0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7fe11c0b06e0 tx=0x7fe10c007790).stop 2021-11-12T06:35:49.868 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.863+0000 7fe122143700 1 -- 172.21.2.105:0/928331723 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe11c0ac280 msgr2=0x7fe11c1450c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.863+0000 7fe122143700 1 --2- 172.21.2.105:0/928331723 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe11c0ac280 0x7fe11c1450c0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 rx=0x7fe11c14b040 tx=0x7fe104012000).stop 2021-11-12T06:35:49.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.863+0000 7fe122143700 1 -- 172.21.2.105:0/928331723 shutdown_connections 2021-11-12T06:35:49.869 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.863+0000 7fe122143700 1 --2- 172.21.2.105:0/928331723 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fe100053610 0x7fe100055ad0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:49.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.863+0000 7fe122143700 1 --2- 172.21.2.105:0/928331723 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fe11c14b2f0 0x7fe11c066df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.870 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.863+0000 7fe122143700 1 --2- 172.21.2.105:0/928331723 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fe11c0ad080 0x7fe11c066900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.863+0000 7fe122143700 1 --2- 172.21.2.105:0/928331723 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fe11c0ac280 0x7fe11c1450c0 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:49.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.863+0000 7fe122143700 1 -- 172.21.2.105:0/928331723 >> 172.21.2.105:0/928331723 conn(0x7fe11c0b5370 msgr2=0x7fe11c147090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:49.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.867+0000 7fe122143700 1 -- 172.21.2.105:0/928331723 shutdown_connections 2021-11-12T06:35:49.871 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.867+0000 7fe122143700 1 -- 172.21.2.105:0/928331723 wait complete. 2021-11-12T06:35:49.872 INFO:teuthology.orchestra.run.gibba005.stderr:instructed osd(s) 5 to deep-scrub 2021-11-12T06:35:49.874 INFO:tasks.ceph:Scrubbing osd.6 2021-11-12T06:35:49.875 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2021-11-12T06:35:49.935 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.927+0000 7f8ff2bc2700 1 Processor -- start 2021-11-12T06:35:49.936 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.927+0000 7f8ff2bc2700 1 -- start start 2021-11-12T06:35:49.936 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.927+0000 7f8ff2bc2700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f8fec0ad080 0x7f8fec0af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.936 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.927+0000 7f8ff2bc2700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8fec14b2f0 0x7f8fec0ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.927+0000 7f8ff2bc2700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fec0ac7b0 con 0x7f8fec0ac280 2021-11-12T06:35:49.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.927+0000 7f8ff2bc2700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fec1488a0 con 0x7f8fec0ad080 2021-11-12T06:35:49.937 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.927+0000 7f8ff2bc2700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec0ac9e0 con 0x7f8fec14b2f0 2021-11-12T06:35:49.938 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.927+0000 7f8ff095e700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f8fec0ad080 0x7f8fec0af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:49.938 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.927+0000 7f8ff095e700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f8fec0ad080 0x7f8fec0af730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53706/0 (socket says 172.21.2.105:53706) 2021-11-12T06:35:49.938 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.927+0000 7f8ff095e700 1 -- 172.21.2.105:0/3711106057 learned_addr learned my addr 172.21.2.105:0/3711106057 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T06:35:49.939 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.927+0000 7f8ff095e700 1 -- 172.21.2.105:0/3711106057 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8fec14b2f0 msgr2=0x7f8fec0ad460 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T06:35:49.939 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.927+0000 7f8ff095e700 1 --2- 172.21.2.105:0/3711106057 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8fec14b2f0 0x7f8fec0ad460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.939 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.927+0000 7f8ff095e700 1 -- 172.21.2.105:0/3711106057 >> v1:172.21.2.115:6789/0 conn(0x7f8fec0ac280 legacy=0x7f8fec14abe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T06:35:49.940 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.927+0000 7f8ff095e700 1 -- 172.21.2.105:0/3711106057 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fec0b0b30 con 0x7f8fec0ad080 2021-11-12T06:35:49.940 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.927+0000 7f8ff095e700 1 --2- 172.21.2.105:0/3711106057 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8fec0ad080 0x7f8fec0af730 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 rx=0x7f8fec0b6060 tx=0x7f8fdc006eb0).ready entity=mon.0 client_cookie=5f86214c3fd12e32 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:49.940 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.927+0000 7f8feb7fe700 1 -- 172.21.2.105:0/3711106057 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fdc00d570 con 0x7f8fec0ad080 2021-11-12T06:35:49.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.927+0000 7f8feb7fe700 1 -- 172.21.2.105:0/3711106057 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fdc000e90 con 0x7f8fec0ad080 2021-11-12T06:35:49.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.927+0000 7f8feb7fe700 1 -- 172.21.2.105:0/3711106057 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fdc00d8c0 con 0x7f8fec0ad080 2021-11-12T06:35:49.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.927+0000 7f8ff2bc2700 1 -- 172.21.2.105:0/3711106057 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8fec0ad080 msgr2=0x7f8fec0af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.941 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.927+0000 7f8ff2bc2700 1 --2- 172.21.2.105:0/3711106057 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8fec0ad080 0x7f8fec0af730 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 rx=0x7f8fec0b6060 tx=0x7f8fdc006eb0).stop 2021-11-12T06:35:49.942 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.927+0000 7f8ff2bc2700 1 -- 172.21.2.105:0/3711106057 shutdown_connections 2021-11-12T06:35:49.942 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.927+0000 7f8ff2bc2700 1 --2- 172.21.2.105:0/3711106057 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8fec14b2f0 0x7f8fec0ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.927+0000 7f8ff2bc2700 1 --2- 172.21.2.105:0/3711106057 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8fec0ad080 0x7f8fec0af730 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:49.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.927+0000 7f8ff2bc2700 1 -- 172.21.2.105:0/3711106057 >> 172.21.2.105:0/3711106057 conn(0x7f8fec0b5370 msgr2=0x7f8fec0b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:49.943 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.927+0000 7f8ff2bc2700 1 -- 172.21.2.105:0/3711106057 shutdown_connections 2021-11-12T06:35:49.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.927+0000 7f8ff2bc2700 1 -- 172.21.2.105:0/3711106057 wait complete. 2021-11-12T06:35:49.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.931+0000 7f8ff2bc2700 1 Processor -- start 2021-11-12T06:35:49.944 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.931+0000 7f8ff2bc2700 1 -- start start 2021-11-12T06:35:49.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.931+0000 7f8ff2bc2700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8fec0ac280 0x7f8fec063a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.931+0000 7f8ff2bc2700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8fec0ad080 0x7f8fec066a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.931+0000 7f8ff2bc2700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8fec14b2f0 0x7f8fec066f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.945 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.931+0000 7f8ff2bc2700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec0a8d40 con 0x7f8fec0ac280 2021-11-12T06:35:49.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.931+0000 7f8ff2bc2700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec0ab530 con 0x7f8fec14b2f0 2021-11-12T06:35:49.946 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.931+0000 7f8ff2bc2700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec0642d0 con 0x7f8fec0ad080 2021-11-12T06:35:49.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.931+0000 7f8ff095e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8fec0ac280 0x7f8fec063a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:49.947 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.931+0000 7f8ff095e700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8fec0ac280 0x7f8fec063a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53712/0 (socket says 172.21.2.105:53712) 2021-11-12T06:35:49.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.931+0000 7f8ff095e700 1 -- 172.21.2.105:0/2884867530 learned_addr learned my addr 172.21.2.105:0/2884867530 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T06:35:49.948 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.931+0000 7f8ff095e700 1 -- 172.21.2.105:0/2884867530 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8fec0ad080 msgr2=0x7f8fec066a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.931+0000 7f8ff095e700 1 --2- 172.21.2.105:0/2884867530 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f8fec0ad080 0x7f8fec066a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.931+0000 7f8ff095e700 1 -- 172.21.2.105:0/2884867530 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8fec14b2f0 msgr2=0x7f8fec066f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.949 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.931+0000 7f8ff095e700 1 --2- 172.21.2.105:0/2884867530 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f8fec14b2f0 0x7f8fec066f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:49.950 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.931+0000 7f8ff095e700 1 -- 172.21.2.105:0/2884867530 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fdc00b1e0 con 0x7f8fec0ac280 2021-11-12T06:35:49.950 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.931+0000 7f8ff095e700 1 --2- 172.21.2.105:0/2884867530 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8fec0ac280 0x7f8fec063a30 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 rx=0x7f8fec0a8e80 tx=0x7f8fdc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:49.951 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.931+0000 7f8fe9ffb700 1 -- 172.21.2.105:0/2884867530 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fdc006b60 con 0x7f8fec0ac280 2021-11-12T06:35:49.951 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.931+0000 7f8fe9ffb700 1 -- 172.21.2.105:0/2884867530 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fdc002f70 con 0x7f8fec0ac280 2021-11-12T06:35:49.951 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.931+0000 7f8fe9ffb700 1 -- 172.21.2.105:0/2884867530 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8fdc00de20 con 0x7f8fec0ac280 2021-11-12T06:35:49.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.931+0000 7f8ff2bc2700 1 -- 172.21.2.105:0/2884867530 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fec0673f0 con 0x7f8fec0ac280 2021-11-12T06:35:49.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.931+0000 7f8ff2bc2700 1 -- 172.21.2.105:0/2884867530 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fec0abd50 con 0x7f8fec0ac280 2021-11-12T06:35:49.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.931+0000 7f8ff2bc2700 1 -- 172.21.2.105:0/2884867530 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8fec0ab6c0 con 0x7f8fec0ac280 2021-11-12T06:35:49.952 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.931+0000 7f8fe9ffb700 1 -- 172.21.2.105:0/2884867530 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f8fdc025030 con 0x7f8fec0ac280 2021-11-12T06:35:49.953 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.931+0000 7f8fe9ffb700 1 --2- 172.21.2.105:0/2884867530 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8fd00536a0 0x7f8fd0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.953 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.931+0000 7f8fe9ffb700 1 -- 172.21.2.105:0/2884867530 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f8fdc06cc40 con 0x7f8fec0ac280 2021-11-12T06:35:49.953 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.931+0000 7f8fe9ffb700 1 --2- 172.21.2.105:0/2884867530 >> [v2:172.21.2.115:6816/15098,v1:172.21.2.115:6817/15098] conn(0x7f8fd005a4b0 0x7f8fd005c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:49.954 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.931+0000 7f8fe9ffb700 1 -- 172.21.2.105:0/2884867530 --> [v2:172.21.2.115:6816/15098,v1:172.21.2.115:6817/15098] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8fd005ce90 con 0x7f8fd005a4b0 2021-11-12T06:35:49.954 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.931+0000 7f8fe9ffb700 1 -- 172.21.2.105:0/2884867530 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=159) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8fdc071220 con 0x7f8fec0ac280 2021-11-12T06:35:49.954 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.931+0000 7f8febfff700 1 --2- 172.21.2.105:0/2884867530 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8fd00536a0 0x7f8fd0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:49.955 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.931+0000 7f8febfff700 1 --2- 172.21.2.105:0/2884867530 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8fd00536a0 0x7f8fd0055b60 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f8fd4002fb0 tx=0x7f8fd40069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:49.955 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.931+0000 7f8ff115f700 1 --2- 172.21.2.105:0/2884867530 >> [v2:172.21.2.115:6816/15098,v1:172.21.2.115:6817/15098] conn(0x7f8fd005a4b0 0x7f8fd005c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:49.956 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.935+0000 7f8ff115f700 1 --2- 172.21.2.105:0/2884867530 >> [v2:172.21.2.115:6816/15098,v1:172.21.2.115:6817/15098] conn(0x7f8fd005a4b0 0x7f8fd005c8d0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:49.957 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.935+0000 7f8fe9ffb700 1 -- 172.21.2.105:0/2884867530 <== osd.6 v2:172.21.2.115:6816/15098 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f8fd005ce90 con 0x7f8fd005a4b0 2021-11-12T06:35:49.972 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.971+0000 7f8ff2bc2700 1 -- 172.21.2.105:0/2884867530 --> [v2:172.21.2.115:6816/15098,v1:172.21.2.115:6817/15098] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8fec064140 con 0x7f8fd005a4b0 2021-11-12T06:35:49.974 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.971+0000 7f8fe9ffb700 1 -- 172.21.2.105:0/2884867530 <== osd.6 v2:172.21.2.115:6816/15098 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8fec064140 con 0x7f8fd005a4b0 2021-11-12T06:35:49.975 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T06:35:49.975 INFO:teuthology.orchestra.run.gibba005.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-11-12T06:35:49.975 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T06:35:49.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.971+0000 7f8ff2bc2700 1 -- 172.21.2.105:0/2884867530 >> [v2:172.21.2.115:6816/15098,v1:172.21.2.115:6817/15098] conn(0x7f8fd005a4b0 msgr2=0x7f8fd005c8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.971+0000 7f8ff2bc2700 1 --2- 172.21.2.105:0/2884867530 >> [v2:172.21.2.115:6816/15098,v1:172.21.2.115:6817/15098] conn(0x7f8fd005a4b0 0x7f8fd005c8d0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:49.977 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.971+0000 7f8ff2bc2700 1 -- 172.21.2.105:0/2884867530 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8fd00536a0 msgr2=0x7f8fd0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.978 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.971+0000 7f8ff2bc2700 1 --2- 172.21.2.105:0/2884867530 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f8fd00536a0 0x7f8fd0055b60 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f8fd4002fb0 tx=0x7f8fd40069b0).stop 2021-11-12T06:35:49.978 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.971+0000 7f8ff2bc2700 1 -- 172.21.2.105:0/2884867530 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8fec0ac280 msgr2=0x7f8fec063a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:49.978 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.971+0000 7f8ff2bc2700 1 --2- 172.21.2.105:0/2884867530 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f8fec0ac280 0x7f8fec063a30 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 rx=0x7f8fec0a8e80 tx=0x7f8fdc015000).stop 2021-11-12T06:35:49.979 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.971+0000 7f8ff115f700 1 -- 172.21.2.105:0/2884867530 reap_dead start 2021-11-12T06:35:49.979 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.971+0000 7f8ff2bc2700 1 -- 172.21.2.105:0/2884867530 shutdown_connections 2021-11-12T06:35:49.980 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.971+0000 7f8ff2bc2700 1 -- 172.21.2.105:0/2884867530 >> 172.21.2.105:0/2884867530 conn(0x7f8fec0b5370 msgr2=0x7f8fec14aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:49.980 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.975+0000 7f8ff2bc2700 1 -- 172.21.2.105:0/2884867530 shutdown_connections 2021-11-12T06:35:49.980 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:49.975+0000 7f8ff2bc2700 1 -- 172.21.2.105:0/2884867530 wait complete. 2021-11-12T06:35:49.984 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2021-11-12T06:35:50.045 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.043+0000 7f3cab248700 1 Processor -- start 2021-11-12T06:35:50.045 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.043+0000 7f3cab248700 1 -- start start 2021-11-12T06:35:50.046 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.043+0000 7f3cab248700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f3ca414b2f0 0x7f3ca40af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:50.046 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.043+0000 7f3cab248700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ca40ac7b0 con 0x7f3ca40ac280 2021-11-12T06:35:50.046 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.043+0000 7f3cab248700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ca40ac9e0 con 0x7f3ca40ad080 2021-11-12T06:35:50.047 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.043+0000 7f3cab248700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ca41488a0 con 0x7f3ca414b2f0 2021-11-12T06:35:50.051 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.043+0000 7f3ca3fff700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f3ca40ac280 0x7f3ca4147a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:35890/0 (socket says 172.21.2.105:35890) 2021-11-12T06:35:50.051 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.043+0000 7f3ca3fff700 1 -- 172.21.2.105:0/238876791 learned_addr learned my addr 172.21.2.105:0/238876791 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T06:35:50.051 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.043+0000 7f3ca97e5700 1 --2- 172.21.2.105:0/238876791 >> v2:172.21.2.105:3300/0 conn(0x7f3ca414b2f0 0x7f3ca40af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:50.052 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.043+0000 7f3ca37fe700 1 -- 172.21.2.105:0/238876791 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2048654590 0 0) 0x7f3ca40ac7b0 con 0x7f3ca40ac280 2021-11-12T06:35:50.052 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.043+0000 7f3ca97e5700 1 -- 172.21.2.105:0/238876791 >> v1:172.21.2.115:6789/0 conn(0x7f3ca40ad080 legacy=0x7f3ca414abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:50.052 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.043+0000 7f3ca97e5700 1 -- 172.21.2.105:0/238876791 >> v1:172.21.2.105:6789/0 conn(0x7f3ca40ac280 legacy=0x7f3ca4147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:50.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.043+0000 7f3ca97e5700 1 -- 172.21.2.105:0/238876791 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca40b0b30 con 0x7f3ca414b2f0 2021-11-12T06:35:50.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.043+0000 7f3ca97e5700 1 --2- 172.21.2.105:0/238876791 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3ca414b2f0 0x7f3ca40af730 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 rx=0x7f3c9c0032f0 tx=0x7f3c9c0091d0).ready entity=mon.0 client_cookie=70b53ecd53890bc2 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:50.053 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.043+0000 7f3ca37fe700 1 -- 172.21.2.105:0/238876791 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c9c009ea0 con 0x7f3ca414b2f0 2021-11-12T06:35:50.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.043+0000 7f3ca37fe700 1 -- 172.21.2.105:0/238876791 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c9c00b8a0 con 0x7f3ca414b2f0 2021-11-12T06:35:50.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.043+0000 7f3ca37fe700 1 -- 172.21.2.105:0/238876791 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c9c00ba10 con 0x7f3ca414b2f0 2021-11-12T06:35:50.054 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.043+0000 7f3cab248700 1 -- 172.21.2.105:0/238876791 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3ca414b2f0 msgr2=0x7f3ca40af730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:50.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.043+0000 7f3cab248700 1 --2- 172.21.2.105:0/238876791 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3ca414b2f0 0x7f3ca40af730 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 rx=0x7f3c9c0032f0 tx=0x7f3c9c0091d0).stop 2021-11-12T06:35:50.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.043+0000 7f3cab248700 1 -- 172.21.2.105:0/238876791 shutdown_connections 2021-11-12T06:35:50.055 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.043+0000 7f3cab248700 1 --2- 172.21.2.105:0/238876791 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3ca414b2f0 0x7f3ca40af730 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:50.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.043+0000 7f3cab248700 1 -- 172.21.2.105:0/238876791 >> 172.21.2.105:0/238876791 conn(0x7f3ca40b5370 msgr2=0x7f3ca40b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:50.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.043+0000 7f3cab248700 1 -- 172.21.2.105:0/238876791 shutdown_connections 2021-11-12T06:35:50.056 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.043+0000 7f3cab248700 1 -- 172.21.2.105:0/238876791 wait complete. 2021-11-12T06:35:50.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.043+0000 7f3cab248700 1 Processor -- start 2021-11-12T06:35:50.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.043+0000 7f3cab248700 1 -- start start 2021-11-12T06:35:50.057 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.047+0000 7f3cab248700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3ca40ac280 0x7f3ca4060980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:50.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.047+0000 7f3cab248700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3ca40ad080 0x7f3ca40a7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:50.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.047+0000 7f3cab248700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3ca414b2f0 0x7f3ca4157040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:50.058 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.047+0000 7f3cab248700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca41569f0 con 0x7f3ca414b2f0 2021-11-12T06:35:50.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.047+0000 7f3cab248700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca415a370 con 0x7f3ca40ad080 2021-11-12T06:35:50.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.047+0000 7f3cab248700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca4156be0 con 0x7f3ca40ac280 2021-11-12T06:35:50.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.047+0000 7f3ca97e5700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3ca414b2f0 0x7f3ca4157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:50.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.047+0000 7f3ca97e5700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3ca414b2f0 0x7f3ca4157040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53730/0 (socket says 172.21.2.105:53730) 2021-11-12T06:35:50.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.047+0000 7f3ca97e5700 1 -- 172.21.2.105:0/4021947590 learned_addr learned my addr 172.21.2.105:0/4021947590 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T06:35:50.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.047+0000 7f3ca8fe4700 1 --2- 172.21.2.105:0/4021947590 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3ca40ac280 0x7f3ca4060980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:50.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.047+0000 7f3ca3fff700 1 --2- 172.21.2.105:0/4021947590 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3ca40ad080 0x7f3ca40a7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:50.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.047+0000 7f3ca97e5700 1 -- 172.21.2.105:0/4021947590 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3ca40ac280 msgr2=0x7f3ca4060980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:50.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.047+0000 7f3ca97e5700 1 --2- 172.21.2.105:0/4021947590 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3ca40ac280 0x7f3ca4060980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:50.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.047+0000 7f3ca97e5700 1 -- 172.21.2.105:0/4021947590 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3ca40ad080 msgr2=0x7f3ca40a7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:50.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.047+0000 7f3ca97e5700 1 --2- 172.21.2.105:0/4021947590 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3ca40ad080 0x7f3ca40a7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:50.062 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.047+0000 7f3ca97e5700 1 -- 172.21.2.105:0/4021947590 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c9c009470 con 0x7f3ca414b2f0 2021-11-12T06:35:50.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.047+0000 7f3ca3fff700 1 --2- 172.21.2.105:0/4021947590 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3ca40ad080 0x7f3ca40a7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-11-12T06:35:50.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.047+0000 7f3ca97e5700 1 --2- 172.21.2.105:0/4021947590 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3ca414b2f0 0x7f3ca4157040 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 rx=0x7f3c9c0032f0 tx=0x7f3c9c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:50.063 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.047+0000 7f3ca1ffb700 1 -- 172.21.2.105:0/4021947590 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c9c009ea0 con 0x7f3ca414b2f0 2021-11-12T06:35:50.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.047+0000 7f3ca1ffb700 1 -- 172.21.2.105:0/4021947590 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c9c01f5e0 con 0x7f3ca414b2f0 2021-11-12T06:35:50.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.047+0000 7f3cab248700 1 -- 172.21.2.105:0/4021947590 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ca415a0d0 con 0x7f3ca414b2f0 2021-11-12T06:35:50.064 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.047+0000 7f3ca1ffb700 1 -- 172.21.2.105:0/4021947590 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c9c01f940 con 0x7f3ca414b2f0 2021-11-12T06:35:50.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.047+0000 7f3cab248700 1 -- 172.21.2.105:0/4021947590 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ca414a060 con 0x7f3ca414b2f0 2021-11-12T06:35:50.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.047+0000 7f3cab248700 1 -- 172.21.2.105:0/4021947590 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ca40b1440 con 0x7f3ca414b2f0 2021-11-12T06:35:50.065 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.047+0000 7f3ca1ffb700 1 -- 172.21.2.105:0/4021947590 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f3c9c026030 con 0x7f3ca414b2f0 2021-11-12T06:35:50.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.047+0000 7f3ca1ffb700 1 --2- 172.21.2.105:0/4021947590 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3c880535b0 0x7f3c88055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:50.066 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.047+0000 7f3ca1ffb700 1 -- 172.21.2.105:0/4021947590 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f3c9c06c530 con 0x7f3ca414b2f0 2021-11-12T06:35:50.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.047+0000 7f3ca8fe4700 1 --2- 172.21.2.105:0/4021947590 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3c880535b0 0x7f3c88055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:50.067 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.047+0000 7f3ca8fe4700 1 --2- 172.21.2.105:0/4021947590 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3c880535b0 0x7f3c88055a70 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f3c8c00b000 tx=0x7f3c8c009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:50.068 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.051+0000 7f3ca1ffb700 1 -- 172.21.2.105:0/4021947590 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3c9c043810 con 0x7f3ca414b2f0 2021-11-12T06:35:50.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.131+0000 7f3cab248700 1 -- 172.21.2.105:0/4021947590 --> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ca4057350 con 0x7f3c880535b0 2021-11-12T06:35:50.135 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.135+0000 7f3ca1ffb700 1 -- 172.21.2.105:0/4021947590 <== mgr.4107 v2:172.21.2.105:6800/14730 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3ca4057350 con 0x7f3c880535b0 2021-11-12T06:35:50.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.135+0000 7f3cab248700 1 -- 172.21.2.105:0/4021947590 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3c880535b0 msgr2=0x7f3c88055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:50.137 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.135+0000 7f3cab248700 1 --2- 172.21.2.105:0/4021947590 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3c880535b0 0x7f3c88055a70 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f3c8c00b000 tx=0x7f3c8c009040).stop 2021-11-12T06:35:50.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.135+0000 7f3cab248700 1 -- 172.21.2.105:0/4021947590 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3ca414b2f0 msgr2=0x7f3ca4157040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:50.138 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.135+0000 7f3cab248700 1 --2- 172.21.2.105:0/4021947590 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3ca414b2f0 0x7f3ca4157040 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 rx=0x7f3c9c0032f0 tx=0x7f3c9c016000).stop 2021-11-12T06:35:50.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.135+0000 7f3cab248700 1 -- 172.21.2.105:0/4021947590 shutdown_connections 2021-11-12T06:35:50.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.135+0000 7f3cab248700 1 --2- 172.21.2.105:0/4021947590 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f3c880535b0 0x7f3c88055a70 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:50.139 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.135+0000 7f3cab248700 1 --2- 172.21.2.105:0/4021947590 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f3ca414b2f0 0x7f3ca4157040 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:50.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.135+0000 7f3cab248700 1 --2- 172.21.2.105:0/4021947590 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f3ca40ad080 0x7f3ca40a7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:50.140 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.135+0000 7f3cab248700 1 --2- 172.21.2.105:0/4021947590 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f3ca40ac280 0x7f3ca4060980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:50.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.135+0000 7f3cab248700 1 -- 172.21.2.105:0/4021947590 >> 172.21.2.105:0/4021947590 conn(0x7f3ca40b5370 msgr2=0x7f3ca40b4730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:50.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.135+0000 7f3cab248700 1 -- 172.21.2.105:0/4021947590 shutdown_connections 2021-11-12T06:35:50.141 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.135+0000 7f3cab248700 1 -- 172.21.2.105:0/4021947590 wait complete. 2021-11-12T06:35:50.142 INFO:teuthology.orchestra.run.gibba005.stderr:instructed osd(s) 6 to deep-scrub 2021-11-12T06:35:50.143 INFO:tasks.ceph:Scrubbing osd.7 2021-11-12T06:35:50.144 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2021-11-12T06:35:50.198 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.195+0000 7fd37e3fb700 1 Processor -- start 2021-11-12T06:35:50.199 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.195+0000 7fd37e3fb700 1 -- start start 2021-11-12T06:35:50.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.195+0000 7fd37e3fb700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd3780ac280 0x7fd37814b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:50.204 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.195+0000 7fd37e3fb700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3780af730 0x7fd3780ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:50.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.195+0000 7fd37e3fb700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3780ac7b0 con 0x7fd3780ad080 2021-11-12T06:35:50.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.195+0000 7fd37e3fb700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3781488a0 con 0x7fd3780ac280 2021-11-12T06:35:50.205 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.195+0000 7fd37e3fb700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3780ac9e0 con 0x7fd3780af730 2021-11-12T06:35:50.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.195+0000 7fd3777fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd3780ac280 0x7fd37814b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:50.206 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.195+0000 7fd3777fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fd3780ac280 0x7fd37814b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53738/0 (socket says 172.21.2.105:53738) 2021-11-12T06:35:50.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.195+0000 7fd3777fe700 1 -- 172.21.2.105:0/3827847808 learned_addr learned my addr 172.21.2.105:0/3827847808 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T06:35:50.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.195+0000 7fd3777fe700 1 -- 172.21.2.105:0/3827847808 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3780af730 msgr2=0x7fd3780ad460 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T06:35:50.207 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.195+0000 7fd3777fe700 1 --2- 172.21.2.105:0/3827847808 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3780af730 0x7fd3780ad460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:50.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.195+0000 7fd3777fe700 1 -- 172.21.2.105:0/3827847808 >> v1:172.21.2.115:6789/0 conn(0x7fd3780ad080 legacy=0x7fd37814abe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T06:35:50.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.195+0000 7fd3777fe700 1 -- 172.21.2.105:0/3827847808 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3780b0b30 con 0x7fd3780ac280 2021-11-12T06:35:50.208 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd3777fe700 1 --2- 172.21.2.105:0/3827847808 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3780ac280 0x7fd37814b2f0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 rx=0x7fd3780b6060 tx=0x7fd360006eb0).ready entity=mon.0 client_cookie=4d67634b47b36aac server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:50.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd376ffd700 1 -- 172.21.2.105:0/3827847808 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd36000d570 con 0x7fd3780ac280 2021-11-12T06:35:50.209 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd376ffd700 1 -- 172.21.2.105:0/3827847808 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd360000e90 con 0x7fd3780ac280 2021-11-12T06:35:50.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd376ffd700 1 -- 172.21.2.105:0/3827847808 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd36000d8c0 con 0x7fd3780ac280 2021-11-12T06:35:50.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd37e3fb700 1 -- 172.21.2.105:0/3827847808 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3780ac280 msgr2=0x7fd37814b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:50.210 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd37e3fb700 1 --2- 172.21.2.105:0/3827847808 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3780ac280 0x7fd37814b2f0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 rx=0x7fd3780b6060 tx=0x7fd360006eb0).stop 2021-11-12T06:35:50.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd37e3fb700 1 -- 172.21.2.105:0/3827847808 shutdown_connections 2021-11-12T06:35:50.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd37e3fb700 1 --2- 172.21.2.105:0/3827847808 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3780af730 0x7fd3780ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:50.211 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd37e3fb700 1 --2- 172.21.2.105:0/3827847808 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3780ac280 0x7fd37814b2f0 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:50.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd37e3fb700 1 -- 172.21.2.105:0/3827847808 >> 172.21.2.105:0/3827847808 conn(0x7fd3780b5370 msgr2=0x7fd3780b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:50.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd37e3fb700 1 -- 172.21.2.105:0/3827847808 shutdown_connections 2021-11-12T06:35:50.212 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd37e3fb700 1 -- 172.21.2.105:0/3827847808 wait complete. 2021-11-12T06:35:50.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd37e3fb700 1 Processor -- start 2021-11-12T06:35:50.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd37e3fb700 1 -- start start 2021-11-12T06:35:50.213 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd37e3fb700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd3780ac280 0x7fd378063750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:50.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd37e3fb700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3780ad080 0x7fd378063c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:50.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd37e3fb700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3780af730 0x7fd3780668e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:50.214 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd37e3fb700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd378064130 con 0x7fd3780ad080 2021-11-12T06:35:50.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd37e3fb700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3780ab5b0 con 0x7fd3780ac280 2021-11-12T06:35:50.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd37e3fb700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3780ab850 con 0x7fd3780af730 2021-11-12T06:35:50.215 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd3777fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3780ad080 0x7fd378063c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:50.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd3777fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3780ad080 0x7fd378063c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53740/0 (socket says 172.21.2.105:53740) 2021-11-12T06:35:50.216 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd3777fe700 1 -- 172.21.2.105:0/653019361 learned_addr learned my addr 172.21.2.105:0/653019361 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T06:35:50.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd3777fe700 1 -- 172.21.2.105:0/653019361 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3780af730 msgr2=0x7fd3780668e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T06:35:50.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd3777fe700 1 --2- 172.21.2.105:0/653019361 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fd3780af730 0x7fd3780668e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:50.217 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd3777fe700 1 -- 172.21.2.105:0/653019361 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd3780ac280 msgr2=0x7fd378063750 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T06:35:50.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd3777fe700 1 --2- 172.21.2.105:0/653019361 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fd3780ac280 0x7fd378063750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:50.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd3777fe700 1 -- 172.21.2.105:0/653019361 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36000b1e0 con 0x7fd3780ad080 2021-11-12T06:35:50.218 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd3777fe700 1 --2- 172.21.2.105:0/653019361 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3780ad080 0x7fd378063c40 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 rx=0x7fd3780b6060 tx=0x7fd360015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:50.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd3757fa700 1 -- 172.21.2.105:0/653019361 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd360002f70 con 0x7fd3780ad080 2021-11-12T06:35:50.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd3757fa700 1 -- 172.21.2.105:0/653019361 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36000de20 con 0x7fd3780ad080 2021-11-12T06:35:50.219 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd3757fa700 1 -- 172.21.2.105:0/653019361 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd36001e460 con 0x7fd3780ad080 2021-11-12T06:35:50.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd37e3fb700 1 -- 172.21.2.105:0/653019361 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3780ab2d0 con 0x7fd3780ad080 2021-11-12T06:35:50.220 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd37e3fb700 1 -- 172.21.2.105:0/653019361 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3780abcf0 con 0x7fd3780ad080 2021-11-12T06:35:50.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd37e3fb700 1 -- 172.21.2.105:0/653019361 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd3780aba10 con 0x7fd3780ad080 2021-11-12T06:35:50.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd3757fa700 1 -- 172.21.2.105:0/653019361 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fd360025030 con 0x7fd3780ad080 2021-11-12T06:35:50.221 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd3757fa700 1 --2- 172.21.2.105:0/653019361 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd35c0536a0 0x7fd35c055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:50.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd3757fa700 1 -- 172.21.2.105:0/653019361 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fd36006d300 con 0x7fd3780ad080 2021-11-12T06:35:50.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd3757fa700 1 --2- 172.21.2.105:0/653019361 >> [v2:172.21.2.115:6824/15099,v1:172.21.2.115:6825/15099] conn(0x7fd35c05a430 0x7fd35c05c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:50.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd3757fa700 1 -- 172.21.2.105:0/653019361 --> [v2:172.21.2.115:6824/15099,v1:172.21.2.115:6825/15099] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd35c05ce10 con 0x7fd35c05a430 2021-11-12T06:35:50.222 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd3757fa700 1 -- 172.21.2.105:0/653019361 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=159) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd36006d6e0 con 0x7fd3780ad080 2021-11-12T06:35:50.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd377fff700 1 --2- 172.21.2.105:0/653019361 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd35c0536a0 0x7fd35c055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:50.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.199+0000 7fd377fff700 1 --2- 172.21.2.105:0/653019361 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd35c0536a0 0x7fd35c055b60 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7fd368002fb0 tx=0x7fd368006930).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:50.223 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.203+0000 7fd37c998700 1 --2- 172.21.2.105:0/653019361 >> [v2:172.21.2.115:6824/15099,v1:172.21.2.115:6825/15099] conn(0x7fd35c05a430 0x7fd35c05c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:50.224 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.203+0000 7fd37c998700 1 --2- 172.21.2.105:0/653019361 >> [v2:172.21.2.115:6824/15099,v1:172.21.2.115:6825/15099] conn(0x7fd35c05a430 0x7fd35c05c850 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:50.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.203+0000 7fd3757fa700 1 -- 172.21.2.105:0/653019361 <== osd.7 v2:172.21.2.115:6824/15099 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7fd35c05ce10 con 0x7fd35c05a430 2021-11-12T06:35:50.225 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.211+0000 7fd37e3fb700 1 -- 172.21.2.105:0/653019361 --> [v2:172.21.2.115:6824/15099,v1:172.21.2.115:6825/15099] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd3780b1440 con 0x7fd35c05a430 2021-11-12T06:35:50.226 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.211+0000 7fd3757fa700 1 -- 172.21.2.105:0/653019361 <== osd.7 v2:172.21.2.115:6824/15099 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd3780b1440 con 0x7fd35c05a430 2021-11-12T06:35:50.226 INFO:teuthology.orchestra.run.gibba005.stdout:{ 2021-11-12T06:35:50.227 INFO:teuthology.orchestra.run.gibba005.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-11-12T06:35:50.227 INFO:teuthology.orchestra.run.gibba005.stdout:} 2021-11-12T06:35:50.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.215+0000 7fd37e3fb700 1 -- 172.21.2.105:0/653019361 >> [v2:172.21.2.115:6824/15099,v1:172.21.2.115:6825/15099] conn(0x7fd35c05a430 msgr2=0x7fd35c05c850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:50.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.215+0000 7fd37e3fb700 1 --2- 172.21.2.105:0/653019361 >> [v2:172.21.2.115:6824/15099,v1:172.21.2.115:6825/15099] conn(0x7fd35c05a430 0x7fd35c05c850 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:50.229 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.215+0000 7fd37e3fb700 1 -- 172.21.2.105:0/653019361 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd35c0536a0 msgr2=0x7fd35c055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:50.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.215+0000 7fd37e3fb700 1 --2- 172.21.2.105:0/653019361 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fd35c0536a0 0x7fd35c055b60 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7fd368002fb0 tx=0x7fd368006930).stop 2021-11-12T06:35:50.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.215+0000 7fd37e3fb700 1 -- 172.21.2.105:0/653019361 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3780ad080 msgr2=0x7fd378063c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:50.230 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.215+0000 7fd37e3fb700 1 --2- 172.21.2.105:0/653019361 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fd3780ad080 0x7fd378063c40 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 rx=0x7fd3780b6060 tx=0x7fd360015000).stop 2021-11-12T06:35:50.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.215+0000 7fd37c998700 1 -- 172.21.2.105:0/653019361 reap_dead start 2021-11-12T06:35:50.231 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.215+0000 7fd37e3fb700 1 -- 172.21.2.105:0/653019361 shutdown_connections 2021-11-12T06:35:50.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.215+0000 7fd37e3fb700 1 -- 172.21.2.105:0/653019361 >> 172.21.2.105:0/653019361 conn(0x7fd3780b5370 msgr2=0x7fd3780ae880 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:50.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.215+0000 7fd37e3fb700 1 -- 172.21.2.105:0/653019361 shutdown_connections 2021-11-12T06:35:50.232 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.215+0000 7fd37e3fb700 1 -- 172.21.2.105:0/653019361 wait complete. 2021-11-12T06:35:50.233 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2021-11-12T06:35:50.300 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.291+0000 7f0817b2d700 1 Processor -- start 2021-11-12T06:35:50.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.291+0000 7f0817b2d700 1 -- start start 2021-11-12T06:35:50.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.291+0000 7f0817b2d700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f08100ac280 0x7f081014b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:50.301 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.291+0000 7f0817b2d700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08100ac7b0 con 0x7f08100af730 2021-11-12T06:35:50.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.291+0000 7f0817b2d700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08100ac9e0 con 0x7f08100ad080 2021-11-12T06:35:50.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.291+0000 7f0817b2d700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08101488a0 con 0x7f08100ac280 2021-11-12T06:35:50.302 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.291+0000 7f08160ca700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7f08100af730 0x7f0810147a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:35916/0 (socket says 172.21.2.105:35916) 2021-11-12T06:35:50.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.291+0000 7f08160ca700 1 -- 172.21.2.105:0/4108983835 learned_addr learned my addr 172.21.2.105:0/4108983835 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T06:35:50.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.291+0000 7f08150c8700 1 --2- 172.21.2.105:0/4108983835 >> v2:172.21.2.105:3300/0 conn(0x7f08100ac280 0x7f081014b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:50.303 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.291+0000 7f08150c8700 1 -- 172.21.2.105:0/4108983835 >> v1:172.21.2.115:6789/0 conn(0x7f08100ad080 legacy=0x7f081014abe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T06:35:50.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.291+0000 7f08150c8700 1 -- 172.21.2.105:0/4108983835 >> v1:172.21.2.105:6789/0 conn(0x7f08100af730 legacy=0x7f0810147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:50.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.291+0000 7f08150c8700 1 -- 172.21.2.105:0/4108983835 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08100b0b30 con 0x7f08100ac280 2021-11-12T06:35:50.304 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.291+0000 7f08150c8700 1 --2- 172.21.2.105:0/4108983835 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f08100ac280 0x7f081014b2f0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 rx=0x7f08100ac6a0 tx=0x7f0804006df0).ready entity=mon.0 client_cookie=9546d6cb66669dfd server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:50.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.291+0000 7f08148c7700 1 -- 172.21.2.105:0/4108983835 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f080400d5c0 con 0x7f08100ac280 2021-11-12T06:35:50.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.291+0000 7f08148c7700 1 -- 172.21.2.105:0/4108983835 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0804000e90 con 0x7f08100ac280 2021-11-12T06:35:50.305 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.291+0000 7f08148c7700 1 -- 172.21.2.105:0/4108983835 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f080400d910 con 0x7f08100ac280 2021-11-12T06:35:50.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.291+0000 7f0817b2d700 1 -- 172.21.2.105:0/4108983835 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f08100ac280 msgr2=0x7f081014b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:50.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.291+0000 7f0817b2d700 1 --2- 172.21.2.105:0/4108983835 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f08100ac280 0x7f081014b2f0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 rx=0x7f08100ac6a0 tx=0x7f0804006df0).stop 2021-11-12T06:35:50.306 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.295+0000 7f0817b2d700 1 -- 172.21.2.105:0/4108983835 shutdown_connections 2021-11-12T06:35:50.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.295+0000 7f0817b2d700 1 --2- 172.21.2.105:0/4108983835 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f08100ac280 0x7f081014b2f0 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:50.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.295+0000 7f0817b2d700 1 -- 172.21.2.105:0/4108983835 >> 172.21.2.105:0/4108983835 conn(0x7f08100b5370 msgr2=0x7f08100b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:50.307 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.295+0000 7f0817b2d700 1 -- 172.21.2.105:0/4108983835 shutdown_connections 2021-11-12T06:35:50.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.295+0000 7f0817b2d700 1 -- 172.21.2.105:0/4108983835 wait complete. 2021-11-12T06:35:50.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.295+0000 7f0817b2d700 1 Processor -- start 2021-11-12T06:35:50.308 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.295+0000 7f0817b2d700 1 -- start start 2021-11-12T06:35:50.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.295+0000 7f0817b2d700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f08100ac280 0x7f08100637b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:50.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.295+0000 7f0817b2d700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f08100ad080 0x7f0810063ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:50.309 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.295+0000 7f0817b2d700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f08100af730 0x7f0810156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:50.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.295+0000 7f0817b2d700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08101433e0 con 0x7f08100ad080 2021-11-12T06:35:50.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.295+0000 7f0817b2d700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0810157fc0 con 0x7f08100af730 2021-11-12T06:35:50.310 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.295+0000 7f0817b2d700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08100a9eb0 con 0x7f08100ac280 2021-11-12T06:35:50.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.295+0000 7f08150c8700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f08100ad080 0x7f0810063ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:50.311 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.295+0000 7f08150c8700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f08100ad080 0x7f0810063ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53756/0 (socket says 172.21.2.105:53756) 2021-11-12T06:35:50.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.295+0000 7f08150c8700 1 -- 172.21.2.105:0/2684614390 learned_addr learned my addr 172.21.2.105:0/2684614390 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T06:35:50.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.295+0000 7f08150c8700 1 -- 172.21.2.105:0/2684614390 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f08100ac280 msgr2=0x7f08100637b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T06:35:50.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.295+0000 7f08150c8700 1 --2- 172.21.2.105:0/2684614390 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f08100ac280 0x7f08100637b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:50.312 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.295+0000 7f08150c8700 1 -- 172.21.2.105:0/2684614390 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f08100af730 msgr2=0x7f0810156d40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T06:35:50.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.295+0000 7f08150c8700 1 --2- 172.21.2.105:0/2684614390 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f08100af730 0x7f0810156d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:50.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.295+0000 7f08150c8700 1 -- 172.21.2.105:0/2684614390 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f080400b180 con 0x7f08100ad080 2021-11-12T06:35:50.313 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.295+0000 7f08150c8700 1 --2- 172.21.2.105:0/2684614390 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f08100ad080 0x7f0810063ca0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 rx=0x7f08100a9ff0 tx=0x7f0804012000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:50.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.295+0000 7f0802ffd700 1 -- 172.21.2.105:0/2684614390 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0804016070 con 0x7f08100ad080 2021-11-12T06:35:50.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.295+0000 7f0802ffd700 1 -- 172.21.2.105:0/2684614390 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0804002f50 con 0x7f08100ad080 2021-11-12T06:35:50.314 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.295+0000 7f0817b2d700 1 -- 172.21.2.105:0/2684614390 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08100a8790 con 0x7f08100ad080 2021-11-12T06:35:50.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.295+0000 7f0802ffd700 1 -- 172.21.2.105:0/2684614390 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0804013f00 con 0x7f08100ad080 2021-11-12T06:35:50.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.295+0000 7f0817b2d700 1 -- 172.21.2.105:0/2684614390 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08100a9a10 con 0x7f08100ad080 2021-11-12T06:35:50.315 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.295+0000 7f0817b2d700 1 -- 172.21.2.105:0/2684614390 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0810157c60 con 0x7f08100ad080 2021-11-12T06:35:50.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.295+0000 7f0802ffd700 1 -- 172.21.2.105:0/2684614390 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0804025030 con 0x7f08100ad080 2021-11-12T06:35:50.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.295+0000 7f0802ffd700 1 --2- 172.21.2.105:0/2684614390 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f07f00536a0 0x7f07f0055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:50.316 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.295+0000 7f0802ffd700 1 -- 172.21.2.105:0/2684614390 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f080406ca30 con 0x7f08100ad080 2021-11-12T06:35:50.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.295+0000 7f08158c9700 1 --2- 172.21.2.105:0/2684614390 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f07f00536a0 0x7f07f0055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:50.317 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.295+0000 7f08158c9700 1 --2- 172.21.2.105:0/2684614390 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f07f00536a0 0x7f07f0055b60 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7f080c002fb0 tx=0x7f080c006930).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:50.318 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.299+0000 7f0802ffd700 1 -- 172.21.2.105:0/2684614390 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0804043c00 con 0x7f08100ad080 2021-11-12T06:35:50.384 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.383+0000 7f0817b2d700 1 -- 172.21.2.105:0/2684614390 --> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f08100b1440 con 0x7f07f00536a0 2021-11-12T06:35:50.385 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.383+0000 7f0802ffd700 1 -- 172.21.2.105:0/2684614390 <== mgr.4107 v2:172.21.2.105:6800/14730 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f08100b1440 con 0x7f07f00536a0 2021-11-12T06:35:50.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.383+0000 7f0817b2d700 1 -- 172.21.2.105:0/2684614390 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f07f00536a0 msgr2=0x7f07f0055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:50.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.383+0000 7f0817b2d700 1 --2- 172.21.2.105:0/2684614390 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f07f00536a0 0x7f07f0055b60 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7f080c002fb0 tx=0x7f080c006930).stop 2021-11-12T06:35:50.386 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.383+0000 7f0817b2d700 1 -- 172.21.2.105:0/2684614390 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f08100ad080 msgr2=0x7f0810063ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:50.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.383+0000 7f0817b2d700 1 --2- 172.21.2.105:0/2684614390 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f08100ad080 0x7f0810063ca0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 rx=0x7f08100a9ff0 tx=0x7f0804012000).stop 2021-11-12T06:35:50.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.383+0000 7f0817b2d700 1 -- 172.21.2.105:0/2684614390 shutdown_connections 2021-11-12T06:35:50.387 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.383+0000 7f0817b2d700 1 --2- 172.21.2.105:0/2684614390 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f07f00536a0 0x7f07f0055b60 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:50.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.383+0000 7f0817b2d700 1 --2- 172.21.2.105:0/2684614390 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f08100af730 0x7f0810156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:50.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.383+0000 7f0817b2d700 1 --2- 172.21.2.105:0/2684614390 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f08100ad080 0x7f0810063ca0 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:50.388 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.383+0000 7f0817b2d700 1 --2- 172.21.2.105:0/2684614390 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f08100ac280 0x7f08100637b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:50.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.383+0000 7f0817b2d700 1 -- 172.21.2.105:0/2684614390 >> 172.21.2.105:0/2684614390 conn(0x7f08100b5370 msgr2=0x7f0810143da0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:50.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.383+0000 7f0817b2d700 1 -- 172.21.2.105:0/2684614390 shutdown_connections 2021-11-12T06:35:50.389 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.383+0000 7f0817b2d700 1 -- 172.21.2.105:0/2684614390 wait complete. 2021-11-12T06:35:50.390 INFO:teuthology.orchestra.run.gibba005.stderr:instructed osd(s) 7 to deep-scrub 2021-11-12T06:35:50.392 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-11-12T06:35:50.442 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.439+0000 7fa1f7ae8700 1 Processor -- start 2021-11-12T06:35:50.443 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.439+0000 7fa1f7ae8700 1 -- start start 2021-11-12T06:35:50.443 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.439+0000 7fa1f7ae8700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa1f00ac280 0x7fa1f014b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:50.444 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.439+0000 7fa1f7ae8700 1 -- --> v1:172.21.2.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f00ac7b0 con 0x7fa1f00ad080 2021-11-12T06:35:50.444 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.439+0000 7fa1f7ae8700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f00ac9e0 con 0x7fa1f00af730 2021-11-12T06:35:50.444 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.439+0000 7fa1f7ae8700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f01488a0 con 0x7fa1f00ac280 2021-11-12T06:35:50.448 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.439+0000 7fa1f5884700 1 --1- >> v1:172.21.2.105:6789/0 conn(0x7fa1f00ad080 0x7fa1f014abe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.2.105:6789/0 says I am v1:172.21.2.105:35928/0 (socket says 172.21.2.105:35928) 2021-11-12T06:35:50.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.439+0000 7fa1f5083700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7fa1f00ac280 0x7fa1f014b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:50.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.439+0000 7fa1f5884700 1 -- 172.21.2.105:0/1496284892 learned_addr learned my addr 172.21.2.105:0/1496284892 (peer_addr_for_me v1:172.21.2.105:0/0) 2021-11-12T06:35:50.449 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.439+0000 7fa1f5083700 1 -- 172.21.2.105:0/1496284892 >> v1:172.21.2.115:6789/0 conn(0x7fa1f00af730 legacy=0x7fa1f0147a60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-11-12T06:35:50.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.439+0000 7fa1f5083700 1 -- 172.21.2.105:0/1496284892 >> v1:172.21.2.105:6789/0 conn(0x7fa1f00ad080 legacy=0x7fa1f014abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:50.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.439+0000 7fa1f5083700 1 -- 172.21.2.105:0/1496284892 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f00b0b30 con 0x7fa1f00ac280 2021-11-12T06:35:50.450 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.439+0000 7fa1f4882700 1 -- 172.21.2.105:0/1496284892 <== mon.0 v1:172.21.2.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 425525878 0 0) 0x7fa1f00ac7b0 con 0x7fa1f00ad080 2021-11-12T06:35:50.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.443+0000 7fa1f5083700 1 --2- 172.21.2.105:0/1496284892 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1f00ac280 0x7fa1f014b2f0 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 rx=0x7fa1f00ac6a0 tx=0x7fa1ec006df0).ready entity=mon.0 client_cookie=4e74ef3a84396d7c server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:50.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.443+0000 7fa1f4882700 1 -- 172.21.2.105:0/1496284892 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1ec00d5c0 con 0x7fa1f00ac280 2021-11-12T06:35:50.451 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.443+0000 7fa1f4882700 1 -- 172.21.2.105:0/1496284892 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ec000e90 con 0x7fa1f00ac280 2021-11-12T06:35:50.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.443+0000 7fa1f4882700 1 -- 172.21.2.105:0/1496284892 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1ec00d910 con 0x7fa1f00ac280 2021-11-12T06:35:50.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.443+0000 7fa1f7ae8700 1 -- 172.21.2.105:0/1496284892 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1f00ac280 msgr2=0x7fa1f014b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:50.452 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.443+0000 7fa1f7ae8700 1 --2- 172.21.2.105:0/1496284892 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1f00ac280 0x7fa1f014b2f0 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 rx=0x7fa1f00ac6a0 tx=0x7fa1ec006df0).stop 2021-11-12T06:35:50.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.443+0000 7fa1f7ae8700 1 -- 172.21.2.105:0/1496284892 shutdown_connections 2021-11-12T06:35:50.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.443+0000 7fa1f7ae8700 1 --2- 172.21.2.105:0/1496284892 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1f00ac280 0x7fa1f014b2f0 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:50.453 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.443+0000 7fa1f7ae8700 1 -- 172.21.2.105:0/1496284892 >> 172.21.2.105:0/1496284892 conn(0x7fa1f00b5370 msgr2=0x7fa1f00b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:50.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.443+0000 7fa1f7ae8700 1 -- 172.21.2.105:0/1496284892 shutdown_connections 2021-11-12T06:35:50.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.443+0000 7fa1f7ae8700 1 -- 172.21.2.105:0/1496284892 wait complete. 2021-11-12T06:35:50.454 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.443+0000 7fa1f7ae8700 1 Processor -- start 2021-11-12T06:35:50.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.443+0000 7fa1f7ae8700 1 -- start start 2021-11-12T06:35:50.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.443+0000 7fa1f7ae8700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1f00ac280 0x7fa1f0063900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:50.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.443+0000 7fa1f7ae8700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa1f00ad080 0x7fa1f0060980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:50.455 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.443+0000 7fa1f7ae8700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1f00af730 0x7fa1f015a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:50.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.443+0000 7fa1f7ae8700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f0159fc0 con 0x7fa1f00ac280 2021-11-12T06:35:50.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.443+0000 7fa1f7ae8700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f00a9240 con 0x7fa1f00ad080 2021-11-12T06:35:50.456 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.443+0000 7fa1f7ae8700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f015a1f0 con 0x7fa1f00af730 2021-11-12T06:35:50.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.443+0000 7fa1f5884700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1f00ac280 0x7fa1f0063900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:50.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.443+0000 7fa1f5884700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1f00ac280 0x7fa1f0063900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53770/0 (socket says 172.21.2.105:53770) 2021-11-12T06:35:50.457 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.443+0000 7fa1f5884700 1 -- 172.21.2.105:0/3395473731 learned_addr learned my addr 172.21.2.105:0/3395473731 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T06:35:50.458 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.443+0000 7fa1f5884700 1 -- 172.21.2.105:0/3395473731 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1f00af730 msgr2=0x7fa1f015a930 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T06:35:50.458 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.443+0000 7fa1f5884700 1 --2- 172.21.2.105:0/3395473731 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1f00af730 0x7fa1f015a930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:50.458 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.443+0000 7fa1f5884700 1 -- 172.21.2.105:0/3395473731 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa1f00ad080 msgr2=0x7fa1f0060980 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2021-11-12T06:35:50.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.443+0000 7fa1f5884700 1 --2- 172.21.2.105:0/3395473731 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa1f00ad080 0x7fa1f0060980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:50.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.443+0000 7fa1f5884700 1 -- 172.21.2.105:0/3395473731 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ec00b180 con 0x7fa1f00ac280 2021-11-12T06:35:50.459 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.443+0000 7fa1f5884700 1 --2- 172.21.2.105:0/3395473731 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1f00ac280 0x7fa1f0063900 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 rx=0x7fa1e4000ed0 tx=0x7fa1e4007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:50.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.443+0000 7fa1e2ffd700 1 -- 172.21.2.105:0/3395473731 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1e400ce50 con 0x7fa1f00ac280 2021-11-12T06:35:50.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.443+0000 7fa1e2ffd700 1 -- 172.21.2.105:0/3395473731 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e40072e0 con 0x7fa1f00ac280 2021-11-12T06:35:50.460 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.443+0000 7fa1f7ae8700 1 -- 172.21.2.105:0/3395473731 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f015a490 con 0x7fa1f00ac280 2021-11-12T06:35:50.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.443+0000 7fa1e2ffd700 1 -- 172.21.2.105:0/3395473731 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1e4005610 con 0x7fa1f00ac280 2021-11-12T06:35:50.461 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.443+0000 7fa1f7ae8700 1 -- 172.21.2.105:0/3395473731 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f00a9420 con 0x7fa1f00ac280 2021-11-12T06:35:50.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.443+0000 7fa1f7ae8700 1 -- 172.21.2.105:0/3395473731 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1f015a620 con 0x7fa1f00ac280 2021-11-12T06:35:50.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.443+0000 7fa1e2ffd700 1 -- 172.21.2.105:0/3395473731 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7fa1e401a060 con 0x7fa1f00ac280 2021-11-12T06:35:50.462 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.443+0000 7fa1e2ffd700 1 --2- 172.21.2.105:0/3395473731 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa1d0053660 0x7fa1d0055b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:35:50.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.447+0000 7fa1e2ffd700 1 -- 172.21.2.105:0/3395473731 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5682+0+0 (secure 0 0 0) 0x7fa1e406b030 con 0x7fa1f00ac280 2021-11-12T06:35:50.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.447+0000 7fa1f5083700 1 --2- 172.21.2.105:0/3395473731 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa1d0053660 0x7fa1d0055b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:35:50.463 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.447+0000 7fa1f5083700 1 --2- 172.21.2.105:0/3395473731 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa1d0053660 0x7fa1d0055b20 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7fa1f00ac6a0 tx=0x7fa1ec012000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:35:50.464 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.447+0000 7fa1e2ffd700 1 -- 172.21.2.105:0/3395473731 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa1e4042310 con 0x7fa1f00ac280 2021-11-12T06:35:50.530 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.527+0000 7fa1f7ae8700 1 -- 172.21.2.105:0/3395473731 --> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa1f0057350 con 0x7fa1d0053660 2021-11-12T06:35:50.531 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.531+0000 7fa1e2ffd700 1 -- 172.21.2.105:0/3395473731 <== mgr.4107 v2:172.21.2.105:6800/14730 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+66079 (secure 0 0 0) 0x7fa1f0057350 con 0x7fa1d0053660 2021-11-12T06:35:50.533 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T06:35:50.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.531+0000 7fa1f7ae8700 1 -- 172.21.2.105:0/3395473731 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa1d0053660 msgr2=0x7fa1d0055b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:50.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.531+0000 7fa1f7ae8700 1 --2- 172.21.2.105:0/3395473731 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa1d0053660 0x7fa1d0055b20 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7fa1f00ac6a0 tx=0x7fa1ec012000).stop 2021-11-12T06:35:50.534 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.531+0000 7fa1f7ae8700 1 -- 172.21.2.105:0/3395473731 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1f00ac280 msgr2=0x7fa1f0063900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:35:50.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.531+0000 7fa1f7ae8700 1 --2- 172.21.2.105:0/3395473731 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1f00ac280 0x7fa1f0063900 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 rx=0x7fa1e4000ed0 tx=0x7fa1e4007ac0).stop 2021-11-12T06:35:50.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.531+0000 7fa1f7ae8700 1 -- 172.21.2.105:0/3395473731 shutdown_connections 2021-11-12T06:35:50.535 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.531+0000 7fa1f7ae8700 1 --2- 172.21.2.105:0/3395473731 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7fa1d0053660 0x7fa1d0055b20 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:50.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.531+0000 7fa1f7ae8700 1 --2- 172.21.2.105:0/3395473731 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7fa1f00af730 0x7fa1f015a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:50.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.531+0000 7fa1f7ae8700 1 --2- 172.21.2.105:0/3395473731 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7fa1f00ad080 0x7fa1f0060980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:35:50.536 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.531+0000 7fa1f7ae8700 1 --2- 172.21.2.105:0/3395473731 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7fa1f00ac280 0x7fa1f0063900 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:35:50.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.531+0000 7fa1f7ae8700 1 -- 172.21.2.105:0/3395473731 >> 172.21.2.105:0/3395473731 conn(0x7fa1f00b5370 msgr2=0x7fa1f0143c40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:35:50.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.531+0000 7fa1f7ae8700 1 -- 172.21.2.105:0/3395473731 shutdown_connections 2021-11-12T06:35:50.537 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:35:50.531+0000 7fa1f7ae8700 1 -- 172.21.2.105:0/3395473731 wait complete. 2021-11-12T06:35:50.538 INFO:teuthology.orchestra.run.gibba005.stderr:dumped all 2021-11-12T06:35:50.539 INFO:teuthology.orchestra.run.gibba005.stdout:{"pg_ready":true,"pg_map":{"version":1813,"stamp":"2021-11-12T06:35:49.424916+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":8404480,"kb_used_data":15808,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746570240,"statfs":{"total":773094113280,"available":764487925760,"internally_reserved":8589934592,"allocated":16187392,"data_stored":7961344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005361"},"pg_stats":[{"pgid":"1.0","version":"16'2","reported_seq":143,"reported_epoch":158,"state":"active+clean","last_fresh":"2021-11-12T05:50:15.403031+0000","last_change":"2021-11-12T05:40:27.633039+0000","last_active":"2021-11-12T05:50:15.403031+0000","last_peered":"2021-11-12T05:50:15.403031+0000","last_clean":"2021-11-12T05:50:15.403031+0000","last_became_active":"2021-11-12T05:40:27.631630+0000","last_became_peered":"2021-11-12T05:40:27.631630+0000","last_unstale":"2021-11-12T05:50:15.403031+0000","last_undegraded":"2021-11-12T05:50:15.403031+0000","last_fullsized":"2021-11-12T05:50:15.403031+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:23.018147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:23.018147+0000","last_clean_scrub_stamp":"2021-11-12T05:40:23.018147+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":142,"reported_epoch":158,"state":"active+clean","last_fresh":"2021-11-12T05:50:15.199644+0000","last_change":"2021-11-12T05:40:31.959167+0000","last_active":"2021-11-12T05:50:15.199644+0000","last_peered":"2021-11-12T05:50:15.199644+0000","last_clean":"2021-11-12T05:50:15.199644+0000","last_became_active":"2021-11-12T05:40:31.958938+0000","last_became_peered":"2021-11-12T05:40:31.958938+0000","last_unstale":"2021-11-12T05:50:15.199644+0000","last_undegraded":"2021-11-12T05:50:15.199644+0000","last_fullsized":"2021-11-12T05:50:15.199644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_clean_scrub_stamp":"2021-11-12T05:40:30.930115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":138,"reported_epoch":158,"state":"active+clean","last_fresh":"2021-11-12T05:50:15.402804+0000","last_change":"2021-11-12T05:40:31.957870+0000","last_active":"2021-11-12T05:50:15.402804+0000","last_peered":"2021-11-12T05:50:15.402804+0000","last_clean":"2021-11-12T05:50:15.402804+0000","last_became_active":"2021-11-12T05:40:31.957678+0000","last_became_peered":"2021-11-12T05:40:31.957678+0000","last_unstale":"2021-11-12T05:50:15.402804+0000","last_undegraded":"2021-11-12T05:50:15.402804+0000","last_fullsized":"2021-11-12T05:50:15.402804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_clean_scrub_stamp":"2021-11-12T05:40:30.930115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":134,"reported_epoch":158,"state":"active+clean","last_fresh":"2021-11-12T05:50:15.402167+0000","last_change":"2021-11-12T05:40:31.957439+0000","last_active":"2021-11-12T05:50:15.402167+0000","last_peered":"2021-11-12T05:50:15.402167+0000","last_clean":"2021-11-12T05:50:15.402167+0000","last_became_active":"2021-11-12T05:40:31.957234+0000","last_became_peered":"2021-11-12T05:40:31.957234+0000","last_unstale":"2021-11-12T05:50:15.402167+0000","last_undegraded":"2021-11-12T05:50:15.402167+0000","last_fullsized":"2021-11-12T05:50:15.402167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_clean_scrub_stamp":"2021-11-12T05:40:30.930115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":142,"reported_epoch":158,"state":"active+clean","last_fresh":"2021-11-12T05:50:15.199634+0000","last_change":"2021-11-12T05:40:31.959024+0000","last_active":"2021-11-12T05:50:15.199634+0000","last_peered":"2021-11-12T05:50:15.199634+0000","last_clean":"2021-11-12T05:50:15.199634+0000","last_became_active":"2021-11-12T05:40:31.958760+0000","last_became_peered":"2021-11-12T05:40:31.958760+0000","last_unstale":"2021-11-12T05:50:15.199634+0000","last_undegraded":"2021-11-12T05:50:15.199634+0000","last_fullsized":"2021-11-12T05:50:15.199634+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_clean_scrub_stamp":"2021-11-12T05:40:30.930115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":140,"reported_epoch":158,"state":"active+clean","last_fresh":"2021-11-12T05:50:15.401967+0000","last_change":"2021-11-12T05:40:31.966265+0000","last_active":"2021-11-12T05:50:15.401967+0000","last_peered":"2021-11-12T05:50:15.401967+0000","last_clean":"2021-11-12T05:50:15.401967+0000","last_became_active":"2021-11-12T05:40:31.966094+0000","last_became_peered":"2021-11-12T05:40:31.966094+0000","last_unstale":"2021-11-12T05:50:15.401967+0000","last_undegraded":"2021-11-12T05:50:15.401967+0000","last_fullsized":"2021-11-12T05:50:15.401967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_clean_scrub_stamp":"2021-11-12T05:40:30.930115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":138,"reported_epoch":158,"state":"active+clean","last_fresh":"2021-11-12T05:50:15.402970+0000","last_change":"2021-11-12T05:40:31.966703+0000","last_active":"2021-11-12T05:50:15.402970+0000","last_peered":"2021-11-12T05:50:15.402970+0000","last_clean":"2021-11-12T05:50:15.402970+0000","last_became_active":"2021-11-12T05:40:31.966492+0000","last_became_peered":"2021-11-12T05:40:31.966492+0000","last_unstale":"2021-11-12T05:50:15.402970+0000","last_undegraded":"2021-11-12T05:50:15.402970+0000","last_fullsized":"2021-11-12T05:50:15.402970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_clean_scrub_stamp":"2021-11-12T05:40:30.930115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":140,"reported_epoch":158,"state":"active+clean","last_fresh":"2021-11-12T05:50:15.401990+0000","last_change":"2021-11-12T05:40:31.958555+0000","last_active":"2021-11-12T05:50:15.401990+0000","last_peered":"2021-11-12T05:50:15.401990+0000","last_clean":"2021-11-12T05:50:15.401990+0000","last_became_active":"2021-11-12T05:40:31.958357+0000","last_became_peered":"2021-11-12T05:40:31.958357+0000","last_unstale":"2021-11-12T05:50:15.401990+0000","last_undegraded":"2021-11-12T05:50:15.401990+0000","last_fullsized":"2021-11-12T05:50:15.401990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_clean_scrub_stamp":"2021-11-12T05:40:30.930115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":138,"reported_epoch":158,"state":"active+clean","last_fresh":"2021-11-12T05:50:15.403233+0000","last_change":"2021-11-12T05:40:31.959219+0000","last_active":"2021-11-12T05:50:15.403233+0000","last_peered":"2021-11-12T05:50:15.403233+0000","last_clean":"2021-11-12T05:50:15.403233+0000","last_became_active":"2021-11-12T05:40:31.958961+0000","last_became_peered":"2021-11-12T05:40:31.958961+0000","last_unstale":"2021-11-12T05:50:15.403233+0000","last_undegraded":"2021-11-12T05:50:15.403233+0000","last_fullsized":"2021-11-12T05:50:15.403233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T05:40:30.930115+0000","last_clean_scrub_stamp":"2021-11-12T05:40:30.930115+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542812,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050560,"kb_used_data":1976,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321280,"statfs":{"total":96636764160,"available":95560990720,"internally_reserved":1073741824,"allocated":2023424,"data_stored":995168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 12 06:35:06 2021","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.3540000000000001,"15min":1.3149999999999999},"min":{"1min":0.99199999999999999,"5min":0.628,"15min":0.33800000000000002},"max":{"1min":1.6819999999999999,"5min":1.843,"15min":1.843},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.2789999999999999,"15min":1.2649999999999999},"min":{"1min":1.083,"5min":0.60199999999999998,"15min":0.39300000000000002},"max":{"1min":1.5189999999999999,"5min":1.7150000000000001,"15min":1.8140000000000001},"last":1.2769999999999999}]},{"osd":1,"last update":"Fri Nov 12 06:35:06 2021","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.218,"15min":1.2110000000000001},"min":{"1min":0.92800000000000005,"5min":0.56699999999999995,"15min":0.35399999999999998},"max":{"1min":1.587,"5min":1.76,"15min":1.8779999999999999},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.333,"5min":1.258,"15min":1.23},"min":{"1min":1.048,"5min":0.60799999999999998,"15min":0.32600000000000001},"max":{"1min":1.7230000000000001,"5min":1.788,"15min":1.788},"last":1.4530000000000001}]},{"osd":2,"last update":"Fri Nov 12 06:35:06 2021","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.2849999999999999,"15min":1.2589999999999999},"min":{"1min":0.877,"5min":0.60999999999999999,"15min":0.30499999999999999},"max":{"1min":1.728,"5min":1.7849999999999999,"15min":1.7909999999999999},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2270000000000001,"15min":1.224},"min":{"1min":1.0189999999999999,"5min":0.58399999999999996,"15min":0.36899999999999999},"max":{"1min":1.635,"5min":1.635,"15min":1.722},"last":1.177}]},{"osd":3,"last update":"Fri Nov 12 06:35:06 2021","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.212,"15min":1.2070000000000001},"min":{"1min":1.018,"5min":0.59299999999999997,"15min":0.34300000000000003},"max":{"1min":1.4650000000000001,"5min":1.5469999999999999,"15min":1.6859999999999999},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.288,"15min":1.2629999999999999},"min":{"1min":1.0389999999999999,"5min":0.57499999999999996,"15min":0.34799999999999998},"max":{"1min":1.635,"5min":1.873,"15min":1.9279999999999999},"last":1.498}]},{"osd":4,"last update":"Fri Nov 12 06:35:06 2021","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.85899999999999999,"15min":0.875},"min":{"1min":0.72999999999999998,"5min":0.22,"15min":0.22},"max":{"1min":1.3180000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.92600000000000005,"15min":0.91800000000000004},"min":{"1min":0.753,"5min":0.27200000000000002,"15min":0.223},"max":{"1min":1.4410000000000001,"5min":1.5129999999999999,"15min":1.6399999999999999},"last":0.94399999999999995}]},{"osd":5,"last update":"Fri Nov 12 06:35:06 2021","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.92000000000000004,"15min":0.91700000000000004},"min":{"1min":0.76700000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.4890000000000001,"5min":1.6759999999999999,"15min":1.7589999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.006,"5min":0.96799999999999997,"15min":0.98099999999999998},"min":{"1min":0.79700000000000004,"5min":0.26600000000000001,"15min":0.253},"max":{"1min":1.341,"5min":1.6100000000000001,"15min":1.724},"last":0.96899999999999997}]},{"osd":6,"last update":"Fri Nov 12 06:35:06 2021","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0029999999999999,"15min":1.0209999999999999},"min":{"1min":0.81899999999999995,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":1.2190000000000001,"5min":1.661,"15min":1.7},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.008,"15min":1.006},"min":{"1min":0.73799999999999999,"5min":0.246,"15min":0.24199999999999999},"max":{"1min":1.339,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.81699999999999995}]}]},{"osd":6,"up_from":14,"seq":60129542811,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050560,"kb_used_data":1976,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321280,"statfs":{"total":96636764160,"available":95560990720,"internally_reserved":1073741824,"allocated":2023424,"data_stored":995168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 12 06:35:06 2021","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.272,"15min":1.242},"min":{"1min":0.92500000000000004,"5min":0.48299999999999998,"15min":0.35499999999999998},"max":{"1min":1.663,"5min":1.794,"15min":1.794},"last":1.421},{"interface":"front","average":{"1min":1.327,"5min":1.2889999999999999,"15min":1.26},"min":{"1min":1.133,"5min":0.52700000000000002,"15min":0.441},"max":{"1min":1.6439999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":1.306}]},{"osd":1,"last update":"Fri Nov 12 06:35:06 2021","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.272,"15min":1.2470000000000001},"min":{"1min":0.88900000000000001,"5min":0.46400000000000002,"15min":0.36799999999999999},"max":{"1min":1.607,"5min":1.8360000000000001,"15min":1.907},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.244,"15min":1.238},"min":{"1min":0.89900000000000002,"5min":0.53600000000000003,"15min":0.33800000000000002},"max":{"1min":1.6439999999999999,"5min":1.6519999999999999,"15min":1.8580000000000001},"last":1.208}]},{"osd":2,"last update":"Fri Nov 12 06:35:06 2021","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.2070000000000001,"15min":1.1930000000000001},"min":{"1min":0.91500000000000004,"5min":0.48799999999999999,"15min":0.255},"max":{"1min":1.3979999999999999,"5min":1.895,"15min":1.895},"last":1.369},{"interface":"front","average":{"1min":1.246,"5min":1.258,"15min":1.248},"min":{"1min":0.97499999999999998,"5min":0.49399999999999999,"15min":0.308},"max":{"1min":1.534,"5min":1.8580000000000001,"15min":1.958},"last":1.232}]},{"osd":3,"last update":"Fri Nov 12 06:35:06 2021","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.3149999999999999,"15min":1.2989999999999999},"min":{"1min":0.83499999999999996,"5min":0.502,"15min":0.42999999999999999},"max":{"1min":1.52,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.282,"15min":1.2629999999999999},"min":{"1min":1.0920000000000001,"5min":0.47099999999999997,"15min":0.36399999999999999},"max":{"1min":1.5680000000000001,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.272}]},{"osd":4,"last update":"Fri Nov 12 06:35:06 2021","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":0.96499999999999997,"15min":0.93200000000000005},"min":{"1min":0.73599999999999999,"5min":0.27900000000000003,"15min":0.216},"max":{"1min":1.7210000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.008,"5min":1.0369999999999999,"15min":1.0089999999999999},"min":{"1min":0.78900000000000003,"5min":0.24099999999999999,"15min":0.20799999999999999},"max":{"1min":1.3660000000000001,"5min":1.766,"15min":1.766},"last":1.077}]},{"osd":5,"last update":"Fri Nov 12 06:35:06 2021","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.93100000000000005,"15min":0.90400000000000003},"min":{"1min":0.80600000000000005,"5min":0.21099999999999999,"15min":0.193},"max":{"1min":1.103,"5min":1.738,"15min":1.7569999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.0509999999999999,"5min":0.96199999999999997,"15min":0.93799999999999994},"min":{"1min":0.77900000000000003,"5min":0.26000000000000001,"15min":0.23300000000000001},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.768},"last":1.0109999999999999}]},{"osd":7,"last update":"Fri Nov 12 06:35:06 2021","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.96299999999999997,"15min":0.95799999999999996},"min":{"1min":0.83999999999999997,"5min":0.223,"15min":0.223},"max":{"1min":1.49,"5min":1.7130000000000001,"15min":1.726},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.996,"5min":1.0009999999999999,"15min":0.98699999999999999},"min":{"1min":0.78800000000000003,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.389,"5min":1.8,"15min":1.8},"last":1.1299999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542812,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050560,"kb_used_data":1976,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321280,"statfs":{"total":96636764160,"available":95560990720,"internally_reserved":1073741824,"allocated":2023424,"data_stored":995168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.2130000000000001,"15min":1.2250000000000001},"min":{"1min":0.48099999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6859999999999999},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.258,"5min":1.2270000000000001,"15min":1.2609999999999999},"min":{"1min":0.41199999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.663,"5min":1.821,"15min":1.821},"last":1.1439999999999999}]},{"osd":1,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.22,"15min":1.254},"min":{"1min":0.41999999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.5189999999999999,"5min":1.6299999999999999,"15min":1.802},"last":1.087},{"interface":"front","average":{"1min":1.179,"5min":1.2270000000000001,"15min":1.2569999999999999},"min":{"1min":0.496,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.5329999999999999,"5min":1.671,"15min":1.899},"last":1.3480000000000001}]},{"osd":2,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.1719999999999999,"15min":1.202},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.4570000000000001,"5min":1.6299999999999999,"15min":1.7589999999999999},"last":1.319},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.22,"15min":1.252},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.8169999999999999},"last":1.0049999999999999}]},{"osd":3,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.2250000000000001,"15min":1.2490000000000001},"min":{"1min":0.43099999999999999,"5min":0.374,"15min":0.374},"max":{"1min":1.5609999999999999,"5min":1.7250000000000001,"15min":1.845},"last":1.294},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1639999999999999,"15min":1.2230000000000001},"min":{"1min":0.46600000000000003,"5min":0.436,"15min":0.40100000000000002},"max":{"1min":1.5489999999999999,"5min":1.5640000000000001,"15min":1.742},"last":1.385}]},{"osd":4,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.85699999999999998,"15min":0.89900000000000002},"min":{"1min":0.28000000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.399,"5min":1.4339999999999999,"15min":1.76},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.89600000000000002,"15min":0.94499999999999995},"min":{"1min":0.255,"5min":0.251,"15min":0.246},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.6379999999999999},"last":1.4019999999999999}]},{"osd":6,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.88400000000000001,"15min":0.92100000000000004},"min":{"1min":0.29599999999999999,"5min":0.224,"15min":0.224},"max":{"1min":1.2490000000000001,"5min":1.5049999999999999,"15min":1.6719999999999999},"last":1.2090000000000001},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.95499999999999996,"15min":0.98999999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.24199999999999999},"max":{"1min":1.77,"5min":1.77,"15min":1.8620000000000001},"last":0.90300000000000002}]},{"osd":7,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.97499999999999998,"15min":1.0029999999999999},"min":{"1min":0.23799999999999999,"5min":0.23699999999999999,"15min":0.23300000000000001},"max":{"1min":1.718,"5min":1.718,"15min":1.7410000000000001},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.97599999999999998,"15min":1.024},"min":{"1min":0.30399999999999999,"5min":0.26100000000000001,"15min":0.221},"max":{"1min":1.518,"5min":1.518,"15min":1.8360000000000001},"last":1.03}]}]},{"osd":4,"up_from":14,"seq":60129542811,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1050560,"kb_used_data":1976,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321280,"statfs":{"total":96636764160,"available":95560990720,"internally_reserved":1073741824,"allocated":2023424,"data_stored":995168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 12 06:35:22 2021","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.3320000000000001,"15min":1.2649999999999999},"min":{"1min":1.0920000000000001,"5min":0.56999999999999995,"15min":0.41999999999999998},"max":{"1min":1.722,"5min":1.7749999999999999,"15min":1.986},"last":1.294},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.238,"15min":1.2310000000000001},"min":{"1min":0.92300000000000004,"5min":0.64300000000000002,"15min":0.433},"max":{"1min":1.4610000000000001,"5min":1.7130000000000001,"15min":1.77},"last":1.327}]},{"osd":1,"last update":"Fri Nov 12 06:35:22 2021","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.345,"15min":1.3220000000000001},"min":{"1min":1.0860000000000001,"5min":0.55800000000000005,"15min":0.435},"max":{"1min":1.657,"5min":1.732,"15min":1.9219999999999999},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.278,"15min":1.2629999999999999},"min":{"1min":1.121,"5min":0.626,"15min":0.44400000000000001},"max":{"1min":1.5269999999999999,"5min":1.7709999999999999,"15min":1.841},"last":1.5720000000000001}]},{"osd":2,"last update":"Fri Nov 12 06:35:22 2021","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.3140000000000001,"15min":1.274},"min":{"1min":1.044,"5min":0.58299999999999996,"15min":0.40600000000000003},"max":{"1min":1.5920000000000001,"5min":1.6879999999999999,"15min":1.732},"last":1.363},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.256,"15min":1.2490000000000001},"min":{"1min":1.1599999999999999,"5min":0.54500000000000004,"15min":0.45300000000000001},"max":{"1min":1.575,"5min":1.7250000000000001,"15min":2.2490000000000001},"last":1.395}]},{"osd":3,"last update":"Fri Nov 12 06:35:22 2021","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2789999999999999,"15min":1.254},"min":{"1min":0.95599999999999996,"5min":0.60899999999999999,"15min":0.46300000000000002},"max":{"1min":1.6599999999999999,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.444},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.361,"15min":1.3089999999999999},"min":{"1min":1.248,"5min":0.61699999999999999,"15min":0.43099999999999999},"max":{"1min":1.726,"5min":1.821,"15min":1.8700000000000001},"last":1.4119999999999999}]},{"osd":5,"last update":"Fri Nov 12 06:35:22 2021","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.874,"15min":0.86599999999999999},"min":{"1min":0.73199999999999998,"5min":0.248,"15min":0.23300000000000001},"max":{"1min":1.101,"5min":1.4299999999999999,"15min":2.1400000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.91400000000000003,"15min":0.90100000000000002},"min":{"1min":0.76600000000000001,"5min":0.28199999999999997,"15min":0.214},"max":{"1min":1.2629999999999999,"5min":1.5409999999999999,"15min":1.677},"last":0.92800000000000005}]},{"osd":6,"last update":"Fri Nov 12 06:35:22 2021","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":0.95099999999999996,"15min":0.92600000000000005},"min":{"1min":0.78800000000000003,"5min":0.28100000000000003,"15min":0.21299999999999999},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.052,"5min":1.036,"15min":1.04},"min":{"1min":0.88900000000000001,"5min":0.316,"15min":0.246},"max":{"1min":1.29,"5min":1.5649999999999999,"15min":2.2029999999999998},"last":1.0760000000000001}]},{"osd":7,"last update":"Fri Nov 12 06:35:22 2021","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.95999999999999996,"15min":0.94599999999999995},"min":{"1min":0.85999999999999999,"5min":0.26600000000000001,"15min":0.224},"max":{"1min":1.1319999999999999,"5min":1.4099999999999999,"15min":1.6000000000000001},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.091,"5min":1.012,"15min":1.002},"min":{"1min":0.88100000000000001,"5min":0.26000000000000001,"15min":0.23100000000000001},"max":{"1min":1.4670000000000001,"5min":1.5449999999999999,"15min":1.9259999999999999},"last":0.996}]}]},{"osd":3,"up_from":14,"seq":60129542811,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050560,"kb_used_data":1976,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321280,"statfs":{"total":96636764160,"available":95560990720,"internally_reserved":1073741824,"allocated":2023424,"data_stored":995168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 12 06:35:13 2021","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.72099999999999997,"15min":0.70199999999999996},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.75700000000000001,"15min":0.748},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":1.28,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.749}]},{"osd":1,"last update":"Fri Nov 12 06:35:13 2021","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.753,"15min":0.752},"min":{"1min":0.16800000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":1.026,"5min":1.1619999999999999,"15min":1.343},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.82399999999999995,"15min":0.80800000000000005},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":1.248,"5min":1.248,"15min":1.3120000000000001},"last":0.78100000000000003}]},{"osd":2,"last update":"Fri Nov 12 06:35:13 2021","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.86099999999999999,"15min":0.83999999999999997},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":1.216,"5min":1.258,"15min":1.2769999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.83099999999999996,"15min":0.82599999999999996},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.1799999999999999,"5min":1.1930000000000001,"15min":1.2090000000000001},"last":0.95799999999999996}]},{"osd":4,"last update":"Fri Nov 12 06:35:13 2021","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.3149999999999999,"15min":1.337},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.59699999999999998},"max":{"1min":1.653,"5min":1.7470000000000001,"15min":1.859},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.321,"15min":1.319},"min":{"1min":0.71499999999999997,"5min":0.70699999999999996,"15min":0.41499999999999998},"max":{"1min":1.4810000000000001,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.3580000000000001}]},{"osd":5,"last update":"Fri Nov 12 06:35:13 2021","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.3009999999999999,"15min":1.2969999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.38900000000000001},"max":{"1min":1.5780000000000001,"5min":2.121,"15min":2.121},"last":1.387},{"interface":"front","average":{"1min":1.347,"5min":1.321,"15min":1.335},"min":{"1min":0.70699999999999996,"5min":0.67700000000000005,"15min":0.54900000000000004},"max":{"1min":1.6890000000000001,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.607}]},{"osd":6,"last update":"Fri Nov 12 06:35:13 2021","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.3080000000000001,"15min":1.3149999999999999},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.45400000000000001},"max":{"1min":1.6100000000000001,"5min":1.8009999999999999,"15min":1.804},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.246,"5min":1.292,"15min":1.2949999999999999},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.53700000000000003},"max":{"1min":1.575,"5min":1.6659999999999999,"15min":1.7789999999999999},"last":1.3149999999999999}]},{"osd":7,"last update":"Fri Nov 12 06:35:13 2021","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.3300000000000001,"15min":1.3380000000000001},"min":{"1min":0.72599999999999998,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.708,"5min":1.708,"15min":1.7629999999999999},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.331,"15min":1.3340000000000001},"min":{"1min":0.69299999999999995,"5min":0.66000000000000003,"15min":0.55700000000000005},"max":{"1min":1.6699999999999999,"5min":1.8240000000000001,"15min":1.8300000000000001},"last":1.4450000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542810,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050560,"kb_used_data":1976,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321280,"statfs":{"total":96636764160,"available":95560990720,"internally_reserved":1073741824,"allocated":2023424,"data_stored":995168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72299999999999998,"15min":0.70799999999999996},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":1.212,"5min":1.212,"15min":1.246},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.77000000000000002,"15min":0.78200000000000003},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.19},"max":{"1min":0.97199999999999998,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.80900000000000005}]},{"osd":1,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.78200000000000003,"15min":0.79000000000000004},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.2110000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.75700000000000001,"15min":0.76800000000000002},"min":{"1min":0.27000000000000002,"5min":0.26900000000000002,"15min":0.17000000000000001},"max":{"1min":1.002,"5min":1.135,"15min":1.3120000000000001},"last":0.74399999999999999}]},{"osd":3,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.84699999999999998,"15min":0.85499999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.20699999999999999},"max":{"1min":1.1020000000000001,"5min":1.1639999999999999,"15min":1.2350000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78800000000000003,"15min":0.80000000000000004},"min":{"1min":0.245,"5min":0.245,"15min":0.23000000000000001},"max":{"1min":1.026,"5min":1.0620000000000001,"15min":1.4319999999999999},"last":0.92800000000000005}]},{"osd":4,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.373,"15min":1.371},"min":{"1min":0.94999999999999996,"5min":0.61499999999999999,"15min":0.39400000000000002},"max":{"1min":1.742,"5min":1.742,"15min":1.8580000000000001},"last":1.397},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.331,"15min":1.3380000000000001},"min":{"1min":0.86799999999999999,"5min":0.68000000000000005,"15min":0.52500000000000002},"max":{"1min":1.659,"5min":1.8180000000000001,"15min":1.8260000000000001},"last":1.3700000000000001}]},{"osd":5,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.413,"15min":1.381},"min":{"1min":0.93899999999999995,"5min":0.63500000000000001,"15min":0.35999999999999999},"max":{"1min":1.8089999999999999,"5min":1.835,"15min":1.835},"last":1.5660000000000001},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.331,"15min":1.341},"min":{"1min":0.84799999999999998,"5min":0.69399999999999995,"15min":0.38600000000000001},"max":{"1min":1.7310000000000001,"5min":1.804,"15min":1.8380000000000001},"last":1.4470000000000001}]},{"osd":6,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.3640000000000001,"15min":1.3660000000000001},"min":{"1min":0.90400000000000003,"5min":0.67400000000000004,"15min":0.48399999999999999},"max":{"1min":1.798,"5min":1.837,"15min":1.837},"last":1.615},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.355,"15min":1.3540000000000001},"min":{"1min":0.879,"5min":0.64300000000000002,"15min":0.36599999999999999},"max":{"1min":1.6559999999999999,"5min":1.748,"15min":1.8839999999999999},"last":1.3049999999999999}]},{"osd":7,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.3,"15min":1.3069999999999999},"min":{"1min":0.85399999999999998,"5min":0.64500000000000002,"15min":0.372},"max":{"1min":1.5980000000000001,"5min":1.744,"15min":1.744},"last":1.333},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.367,"15min":1.373},"min":{"1min":0.84199999999999997,"5min":0.64600000000000002,"15min":0.376},"max":{"1min":1.829,"5min":1.829,"15min":1.8600000000000001},"last":1.5049999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542811,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050560,"kb_used_data":1976,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321280,"statfs":{"total":96636764160,"available":95560990720,"internally_reserved":1073741824,"allocated":2023424,"data_stored":995168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 12 06:35:14 2021","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65800000000000003,"15min":0.68100000000000005},"min":{"1min":0.214,"5min":0.214,"15min":0.20300000000000001},"max":{"1min":0.79600000000000004,"5min":1.151,"15min":1.1990000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77500000000000002},"min":{"1min":0.248,"5min":0.219,"15min":0.20000000000000001},"max":{"1min":1.1919999999999999,"5min":1.204,"15min":1.4359999999999999},"last":0.88700000000000001}]},{"osd":2,"last update":"Fri Nov 12 06:35:14 2021","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.80600000000000005,"15min":0.82699999999999996},"min":{"1min":0.30099999999999999,"5min":0.216,"15min":0.216},"max":{"1min":1.032,"5min":1.175,"15min":1.24},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78600000000000003,"15min":0.80400000000000005},"min":{"1min":0.27300000000000002,"5min":0.22900000000000001,"15min":0.216},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.3120000000000001},"last":0.84199999999999997}]},{"osd":3,"last update":"Fri Nov 12 06:35:14 2021","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.82399999999999995,"15min":0.82499999999999996},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":1.014,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":0.751},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.88900000000000001,"15min":0.90400000000000003},"min":{"1min":0.313,"5min":0.245,"15min":0.23000000000000001},"max":{"1min":1.0940000000000001,"5min":1.996,"15min":1.996},"last":0.93799999999999994}]},{"osd":4,"last update":"Fri Nov 12 06:35:14 2021","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.379,"15min":1.341},"min":{"1min":0.77100000000000002,"5min":0.49199999999999999,"15min":0.36899999999999999},"max":{"1min":1.6819999999999999,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":1.6659999999999999},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.363,"15min":1.3500000000000001},"min":{"1min":0.80700000000000005,"5min":0.47899999999999998,"15min":0.33600000000000002},"max":{"1min":1.681,"5min":1.827,"15min":1.827},"last":1.6279999999999999}]},{"osd":5,"last update":"Fri Nov 12 06:35:14 2021","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3740000000000001,"15min":1.363},"min":{"1min":0.72599999999999998,"5min":0.46899999999999997,"15min":0.35299999999999998},"max":{"1min":1.7549999999999999,"5min":1.8440000000000001,"15min":2.1019999999999999},"last":1.5960000000000001},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.369,"15min":1.357},"min":{"1min":0.79700000000000004,"5min":0.50900000000000001,"15min":0.34799999999999998},"max":{"1min":1.6299999999999999,"5min":1.748,"15min":2.169},"last":1.413}]},{"osd":6,"last update":"Fri Nov 12 06:35:14 2021","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.323,"15min":1.3180000000000001},"min":{"1min":0.75800000000000001,"5min":0.54800000000000004,"15min":0.40699999999999997},"max":{"1min":1.629,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.365,"5min":1.3799999999999999,"15min":1.3560000000000001},"min":{"1min":0.77900000000000003,"5min":0.44600000000000001,"15min":0.377},"max":{"1min":1.6950000000000001,"5min":1.8109999999999999,"15min":1.952},"last":1.4490000000000001}]},{"osd":7,"last update":"Fri Nov 12 06:35:14 2021","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.349,"15min":1.3520000000000001},"min":{"1min":0.76700000000000002,"5min":0.53400000000000003,"15min":0.36199999999999999},"max":{"1min":1.605,"5min":1.79,"15min":1.9159999999999999},"last":1.5449999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.3480000000000001,"15min":1.3149999999999999},"min":{"1min":0.78700000000000003,"5min":0.46100000000000002,"15min":0.39200000000000002},"max":{"1min":1.5980000000000001,"5min":1.716,"15min":1.8540000000000001},"last":1.3859999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542811,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050560,"kb_used_data":1976,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321280,"statfs":{"total":96636764160,"available":95560990720,"internally_reserved":1073741824,"allocated":2023424,"data_stored":995168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 12 06:35:08 2021","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.71699999999999997,"15min":0.70199999999999996},"min":{"1min":0.30099999999999999,"5min":0.253,"15min":0.11899999999999999},"max":{"1min":0.96799999999999997,"5min":1.083,"15min":1.083},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73399999999999999,"15min":0.754},"min":{"1min":0.30399999999999999,"5min":0.22600000000000001,"15min":0.19700000000000001},"max":{"1min":0.96399999999999997,"5min":1.1559999999999999,"15min":1.2090000000000001},"last":0.23100000000000001}]},{"osd":2,"last update":"Fri Nov 12 06:35:08 2021","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.748,"15min":0.755},"min":{"1min":0.27300000000000002,"5min":0.20899999999999999,"15min":0.13400000000000001},"max":{"1min":0.94099999999999995,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.879,"5min":0.81999999999999995,"15min":0.83099999999999996},"min":{"1min":0.34000000000000002,"5min":0.254,"15min":0.21199999999999999},"max":{"1min":1.1399999999999999,"5min":1.2729999999999999,"15min":1.3520000000000001},"last":0.255}]},{"osd":3,"last update":"Fri Nov 12 06:35:08 2021","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.78800000000000003,"15min":0.80100000000000005},"min":{"1min":0.34499999999999997,"5min":0.215,"15min":0.215},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.218},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88500000000000001,"15min":0.88600000000000001},"min":{"1min":0.316,"5min":0.245,"15min":0.14499999999999999},"max":{"1min":1.143,"5min":1.3029999999999999,"15min":1.3520000000000001},"last":0.248}]},{"osd":4,"last update":"Fri Nov 12 06:35:08 2021","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.3500000000000001,"15min":1.345},"min":{"1min":0.83399999999999996,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.877,"5min":1.8799999999999999,"15min":1.881},"last":1.159},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3180000000000001,"15min":1.3300000000000001},"min":{"1min":0.878,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.619,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.0980000000000001}]},{"osd":5,"last update":"Fri Nov 12 06:35:08 2021","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.3640000000000001,"15min":1.3600000000000001},"min":{"1min":0.85099999999999998,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.7909999999999999,"5min":1.972,"15min":1.972},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.337,"5min":1.3420000000000001,"15min":1.3600000000000001},"min":{"1min":0.876,"5min":0.435,"15min":0.435},"max":{"1min":1.722,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.0640000000000001}]},{"osd":6,"last update":"Fri Nov 12 06:35:08 2021","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3200000000000001,"15min":1.337},"min":{"1min":0.84399999999999997,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.694,"5min":1.736,"15min":1.8600000000000001},"last":1.133},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3580000000000001,"15min":1.371},"min":{"1min":0.93899999999999995,"5min":0.502,"15min":0.502},"max":{"1min":1.6619999999999999,"5min":1.927,"15min":1.927},"last":1.2050000000000001}]},{"osd":7,"last update":"Fri Nov 12 06:35:08 2021","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.373,"15min":1.375},"min":{"1min":0.89600000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.788,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.359,"15min":1.3700000000000001},"min":{"1min":0.86899999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.718,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.0800000000000001}]}]}]}} 2021-11-12T06:35:50.544 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2021-11-12T05:40:23.018147+0000 time.struct_time(tm_year=2021, tm_mon=11, tm_mday=12, tm_hour=5, tm_min=40, tm_sec=23, tm_wday=4, tm_yday=316, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=11, tm_mday=12, tm_hour=6, tm_min=35, tm_sec=47, tm_wday=4, tm_yday=316, tm_isdst=0) 2021-11-12T06:35:50.545 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2021-11-12T05:40:30.930115+0000 time.struct_time(tm_year=2021, tm_mon=11, tm_mday=12, tm_hour=5, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=316, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=11, tm_mday=12, tm_hour=6, tm_min=35, tm_sec=47, tm_wday=4, tm_yday=316, tm_isdst=0) 2021-11-12T06:35:50.546 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2021-11-12T05:40:30.930115+0000 time.struct_time(tm_year=2021, tm_mon=11, tm_mday=12, tm_hour=5, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=316, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=11, tm_mday=12, tm_hour=6, tm_min=35, tm_sec=47, tm_wday=4, tm_yday=316, tm_isdst=0) 2021-11-12T06:35:50.547 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2021-11-12T05:40:30.930115+0000 time.struct_time(tm_year=2021, tm_mon=11, tm_mday=12, tm_hour=5, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=316, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=11, tm_mday=12, tm_hour=6, tm_min=35, tm_sec=47, tm_wday=4, tm_yday=316, tm_isdst=0) 2021-11-12T06:35:50.547 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2021-11-12T05:40:30.930115+0000 time.struct_time(tm_year=2021, tm_mon=11, tm_mday=12, tm_hour=5, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=316, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=11, tm_mday=12, tm_hour=6, tm_min=35, tm_sec=47, tm_wday=4, tm_yday=316, tm_isdst=0) 2021-11-12T06:35:50.548 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2021-11-12T05:40:30.930115+0000 time.struct_time(tm_year=2021, tm_mon=11, tm_mday=12, tm_hour=5, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=316, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=11, tm_mday=12, tm_hour=6, tm_min=35, tm_sec=47, tm_wday=4, tm_yday=316, tm_isdst=0) 2021-11-12T06:35:50.548 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2021-11-12T05:40:30.930115+0000 time.struct_time(tm_year=2021, tm_mon=11, tm_mday=12, tm_hour=5, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=316, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=11, tm_mday=12, tm_hour=6, tm_min=35, tm_sec=47, tm_wday=4, tm_yday=316, tm_isdst=0) 2021-11-12T06:35:50.549 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2021-11-12T05:40:30.930115+0000 time.struct_time(tm_year=2021, tm_mon=11, tm_mday=12, tm_hour=5, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=316, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=11, tm_mday=12, tm_hour=6, tm_min=35, tm_sec=47, tm_wday=4, tm_yday=316, tm_isdst=0) 2021-11-12T06:35:50.550 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2021-11-12T05:40:30.930115+0000 time.struct_time(tm_year=2021, tm_mon=11, tm_mday=12, tm_hour=5, tm_min=40, tm_sec=30, tm_wday=4, tm_yday=316, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=11, tm_mday=12, tm_hour=6, tm_min=35, tm_sec=47, tm_wday=4, tm_yday=316, tm_isdst=0) 2021-11-12T06:35:50.550 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2021-11-12T06:36:02.128 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:36:02.132 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:36:02.135 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:36:02.139 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:36:02.143 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:36:10.552 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-11-12T06:36:10.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.607+0000 7f0a1d995700 1 Processor -- start 2021-11-12T06:36:10.608 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.607+0000 7f0a1d995700 1 -- start start 2021-11-12T06:36:10.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.607+0000 7f0a1d995700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0a180ad080 0x7f0a180af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:36:10.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.607+0000 7f0a1d995700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f0a180ac280 0x7f0a180ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:36:10.611 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.607+0000 7f0a1d995700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a180ac7b0 con 0x7f0a1814abe0 2021-11-12T06:36:10.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.607+0000 7f0a1d995700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a181488a0 con 0x7f0a180ac280 2021-11-12T06:36:10.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.607+0000 7f0a1d995700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a180ac9e0 con 0x7f0a180ad080 2021-11-12T06:36:10.612 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.607+0000 7f0a167fc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f0a180ac280 0x7f0a180ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:36:10.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.607+0000 7f0a167fc700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f0a180ac280 0x7f0a180ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53780/0 (socket says 172.21.2.105:53780) 2021-11-12T06:36:10.613 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.607+0000 7f0a167fc700 1 -- 172.21.2.105:0/3848521328 learned_addr learned my addr 172.21.2.105:0/3848521328 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T06:36:10.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.607+0000 7f0a167fc700 1 -- 172.21.2.105:0/3848521328 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0a180ad080 msgr2=0x7f0a180af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T06:36:10.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.607+0000 7f0a167fc700 1 --2- 172.21.2.105:0/3848521328 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0a180ad080 0x7f0a180af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T06:36:10.614 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.607+0000 7f0a167fc700 1 -- 172.21.2.105:0/3848521328 >> v1:172.21.2.115:6789/0 conn(0x7f0a1814abe0 legacy=0x7f0a1814b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T06:36:10.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.607+0000 7f0a167fc700 1 -- 172.21.2.105:0/3848521328 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a180b0b30 con 0x7f0a180ac280 2021-11-12T06:36:10.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.607+0000 7f0a167fc700 1 --2- 172.21.2.105:0/3848521328 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a180ac280 0x7f0a180ad460 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 rx=0x7f0a180b6060 tx=0x7f0a0c006eb0).ready entity=mon.0 client_cookie=610709aba5fd39d8 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:36:10.615 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.607+0000 7f0a15ffb700 1 -- 172.21.2.105:0/3848521328 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a0c00d570 con 0x7f0a180ac280 2021-11-12T06:36:10.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.607+0000 7f0a15ffb700 1 -- 172.21.2.105:0/3848521328 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0c000e90 con 0x7f0a180ac280 2021-11-12T06:36:10.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.607+0000 7f0a15ffb700 1 -- 172.21.2.105:0/3848521328 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a0c00d8c0 con 0x7f0a180ac280 2021-11-12T06:36:10.616 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.607+0000 7f0a1d995700 1 -- 172.21.2.105:0/3848521328 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a180ac280 msgr2=0x7f0a180ad460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:36:10.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.607+0000 7f0a1d995700 1 --2- 172.21.2.105:0/3848521328 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a180ac280 0x7f0a180ad460 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 rx=0x7f0a180b6060 tx=0x7f0a0c006eb0).stop 2021-11-12T06:36:10.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.607+0000 7f0a1d995700 1 -- 172.21.2.105:0/3848521328 shutdown_connections 2021-11-12T06:36:10.617 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.607+0000 7f0a1d995700 1 --2- 172.21.2.105:0/3848521328 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a180ac280 0x7f0a180ad460 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:36:10.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.607+0000 7f0a1d995700 1 --2- 172.21.2.105:0/3848521328 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0a180ad080 0x7f0a180af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T06:36:10.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.607+0000 7f0a1d995700 1 -- 172.21.2.105:0/3848521328 >> 172.21.2.105:0/3848521328 conn(0x7f0a180b5370 msgr2=0x7f0a180b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:36:10.618 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.607+0000 7f0a1d995700 1 -- 172.21.2.105:0/3848521328 shutdown_connections 2021-11-12T06:36:10.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.607+0000 7f0a1d995700 1 -- 172.21.2.105:0/3848521328 wait complete. 2021-11-12T06:36:10.619 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.607+0000 7f0a1d995700 1 Processor -- start 2021-11-12T06:36:10.620 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.607+0000 7f0a1d995700 1 -- start start 2021-11-12T06:36:10.622 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.611+0000 7f0a1d995700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a180ac280 0x7f0a180a9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:36:10.622 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.611+0000 7f0a1d995700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0a180ad080 0x7f0a180637c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:36:10.622 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.611+0000 7f0a1d995700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0a1814abe0 0x7f0a180669c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:36:10.623 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.611+0000 7f0a1d995700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a180628c0 con 0x7f0a180ac280 2021-11-12T06:36:10.623 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.611+0000 7f0a1d995700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a18064280 con 0x7f0a1814abe0 2021-11-12T06:36:10.623 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.611+0000 7f0a1d995700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a180aa010 con 0x7f0a180ad080 2021-11-12T06:36:10.624 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.611+0000 7f0a16ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a180ac280 0x7f0a180a9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:36:10.624 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.611+0000 7f0a16ffd700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a180ac280 0x7f0a180a9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53786/0 (socket says 172.21.2.105:53786) 2021-11-12T06:36:10.624 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.611+0000 7f0a16ffd700 1 -- 172.21.2.105:0/3664119516 learned_addr learned my addr 172.21.2.105:0/3664119516 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T06:36:10.625 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.611+0000 7f0a16ffd700 1 -- 172.21.2.105:0/3664119516 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0a180ad080 msgr2=0x7f0a180637c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:36:10.625 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.611+0000 7f0a16ffd700 1 --2- 172.21.2.105:0/3664119516 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0a180ad080 0x7f0a180637c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:36:10.625 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.611+0000 7f0a16ffd700 1 -- 172.21.2.105:0/3664119516 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0a1814abe0 msgr2=0x7f0a180669c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:36:10.626 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.611+0000 7f0a16ffd700 1 --2- 172.21.2.105:0/3664119516 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0a1814abe0 0x7f0a180669c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:36:10.626 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.611+0000 7f0a16ffd700 1 -- 172.21.2.105:0/3664119516 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0c00b1e0 con 0x7f0a180ac280 2021-11-12T06:36:10.626 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.611+0000 7f0a16ffd700 1 --2- 172.21.2.105:0/3664119516 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a180ac280 0x7f0a180a9af0 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 rx=0x7f0a08002f70 tx=0x7f0a08006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:36:10.627 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.611+0000 7f0a07fff700 1 -- 172.21.2.105:0/3664119516 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a08013460 con 0x7f0a180ac280 2021-11-12T06:36:10.627 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.611+0000 7f0a07fff700 1 -- 172.21.2.105:0/3664119516 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a080135c0 con 0x7f0a180ac280 2021-11-12T06:36:10.627 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.611+0000 7f0a07fff700 1 -- 172.21.2.105:0/3664119516 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a08013920 con 0x7f0a180ac280 2021-11-12T06:36:10.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.611+0000 7f0a1d995700 1 -- 172.21.2.105:0/3664119516 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a180aac50 con 0x7f0a180ac280 2021-11-12T06:36:10.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.611+0000 7f0a1d995700 1 -- 172.21.2.105:0/3664119516 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a1815b120 con 0x7f0a180ac280 2021-11-12T06:36:10.628 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.611+0000 7f0a1d995700 1 -- 172.21.2.105:0/3664119516 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a180aaaa0 con 0x7f0a180ac280 2021-11-12T06:36:10.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.611+0000 7f0a07fff700 1 -- 172.21.2.105:0/3664119516 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f0a0800f070 con 0x7f0a180ac280 2021-11-12T06:36:10.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.611+0000 7f0a07fff700 1 --2- 172.21.2.105:0/3664119516 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f09f40536a0 0x7f09f4055b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:36:10.629 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.611+0000 7f0a07fff700 1 -- 172.21.2.105:0/3664119516 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f0a0806b040 con 0x7f0a180ac280 2021-11-12T06:36:10.630 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.611+0000 7f0a167fc700 1 --2- 172.21.2.105:0/3664119516 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f09f40536a0 0x7f09f4055b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:36:10.630 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.611+0000 7f0a167fc700 1 --2- 172.21.2.105:0/3664119516 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f09f40536a0 0x7f09f4055b60 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7f0a180b6060 tx=0x7f0a0c015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:36:10.631 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.615+0000 7f0a07fff700 1 -- 172.21.2.105:0/3664119516 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0a08042320 con 0x7f0a180ac280 2021-11-12T06:36:10.694 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.691+0000 7f0a1d995700 1 -- 172.21.2.105:0/3664119516 --> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0a180a97b0 con 0x7f09f40536a0 2021-11-12T06:36:10.696 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.695+0000 7f0a07fff700 1 -- 172.21.2.105:0/3664119516 <== mgr.4107 v2:172.21.2.105:6800/14730 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+65793 (secure 0 0 0) 0x7f0a0c00d570 con 0x7f09f40536a0 2021-11-12T06:36:10.697 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-12T06:36:10.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.695+0000 7f0a1d995700 1 -- 172.21.2.105:0/3664119516 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f09f40536a0 msgr2=0x7f09f4055b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:36:10.699 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.695+0000 7f0a1d995700 1 --2- 172.21.2.105:0/3664119516 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f09f40536a0 0x7f09f4055b60 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7f0a180b6060 tx=0x7f0a0c015000).stop 2021-11-12T06:36:10.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.695+0000 7f0a1d995700 1 -- 172.21.2.105:0/3664119516 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a180ac280 msgr2=0x7f0a180a9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:36:10.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.695+0000 7f0a1d995700 1 --2- 172.21.2.105:0/3664119516 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a180ac280 0x7f0a180a9af0 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 rx=0x7f0a08002f70 tx=0x7f0a08006ec0).stop 2021-11-12T06:36:10.700 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.695+0000 7f0a1d995700 1 -- 172.21.2.105:0/3664119516 shutdown_connections 2021-11-12T06:36:10.701 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.695+0000 7f0a1d995700 1 --2- 172.21.2.105:0/3664119516 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f09f40536a0 0x7f09f4055b60 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:36:10.702 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.695+0000 7f0a1d995700 1 --2- 172.21.2.105:0/3664119516 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f0a1814abe0 0x7f0a180669c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:36:10.702 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.695+0000 7f0a1d995700 1 --2- 172.21.2.105:0/3664119516 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f0a180ad080 0x7f0a180637c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:36:10.702 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.695+0000 7f0a1d995700 1 --2- 172.21.2.105:0/3664119516 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f0a180ac280 0x7f0a180a9af0 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:36:10.703 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.695+0000 7f0a1d995700 1 -- 172.21.2.105:0/3664119516 >> 172.21.2.105:0/3664119516 conn(0x7f0a180b5370 msgr2=0x7f0a180ae880 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:36:10.703 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.695+0000 7f0a1d995700 1 -- 172.21.2.105:0/3664119516 shutdown_connections 2021-11-12T06:36:10.703 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.695+0000 7f0a1d995700 1 -- 172.21.2.105:0/3664119516 wait complete. 2021-11-12T06:36:10.704 INFO:teuthology.orchestra.run.gibba005.stderr:dumped all 2021-11-12T06:36:10.705 INFO:teuthology.orchestra.run.gibba005.stdout:{"pg_ready":true,"pg_map":{"version":1823,"stamp":"2021-11-12T06:36:09.433830+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9844,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":8404480,"kb_used_data":15808,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746570240,"statfs":{"total":773094113280,"available":764487925760,"internally_reserved":8589934592,"allocated":16187392,"data_stored":7961344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005596"},"pg_stats":[{"pgid":"1.0","version":"159'4","reported_seq":148,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-11-12T06:35:50.835498+0000","last_change":"2021-11-12T06:35:50.835748+0000","last_active":"2021-11-12T06:35:50.835498+0000","last_peered":"2021-11-12T06:35:50.835498+0000","last_clean":"2021-11-12T06:35:50.835498+0000","last_became_active":"2021-11-12T05:40:27.631630+0000","last_became_peered":"2021-11-12T05:40:27.631630+0000","last_unstale":"2021-11-12T06:35:50.835498+0000","last_undegraded":"2021-11-12T06:35:50.835498+0000","last_fullsized":"2021-11-12T06:35:50.835498+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'4","last_scrub_stamp":"2021-11-12T06:35:50.835498+0000","last_deep_scrub":"159'4","last_deep_scrub_stamp":"2021-11-12T06:35:50.835498+0000","last_clean_scrub_stamp":"2021-11-12T06:35:50.835498+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9844,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":145,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-11-12T06:35:51.554355+0000","last_change":"2021-11-12T06:35:51.554424+0000","last_active":"2021-11-12T06:35:51.554355+0000","last_peered":"2021-11-12T06:35:51.554355+0000","last_clean":"2021-11-12T06:35:51.554355+0000","last_became_active":"2021-11-12T05:40:31.958938+0000","last_became_peered":"2021-11-12T05:40:31.958938+0000","last_unstale":"2021-11-12T06:35:51.554355+0000","last_undegraded":"2021-11-12T06:35:51.554355+0000","last_fullsized":"2021-11-12T06:35:51.554355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T06:35:51.554354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T06:35:51.554354+0000","last_clean_scrub_stamp":"2021-11-12T06:35:51.554354+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":141,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-11-12T06:35:51.858404+0000","last_change":"2021-11-12T06:35:51.858654+0000","last_active":"2021-11-12T06:35:51.858404+0000","last_peered":"2021-11-12T06:35:51.858404+0000","last_clean":"2021-11-12T06:35:51.858404+0000","last_became_active":"2021-11-12T05:40:31.957678+0000","last_became_peered":"2021-11-12T05:40:31.957678+0000","last_unstale":"2021-11-12T06:35:51.858404+0000","last_undegraded":"2021-11-12T06:35:51.858404+0000","last_fullsized":"2021-11-12T06:35:51.858404+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T06:35:51.858403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T06:35:51.858403+0000","last_clean_scrub_stamp":"2021-11-12T06:35:51.858403+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":137,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-11-12T06:35:50.140454+0000","last_change":"2021-11-12T06:35:50.140503+0000","last_active":"2021-11-12T06:35:50.140454+0000","last_peered":"2021-11-12T06:35:50.140454+0000","last_clean":"2021-11-12T06:35:50.140454+0000","last_became_active":"2021-11-12T05:40:31.957234+0000","last_became_peered":"2021-11-12T05:40:31.957234+0000","last_unstale":"2021-11-12T06:35:50.140454+0000","last_undegraded":"2021-11-12T06:35:50.140454+0000","last_fullsized":"2021-11-12T06:35:50.140454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T06:35:50.140454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T06:35:50.140454+0000","last_clean_scrub_stamp":"2021-11-12T06:35:50.140454+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":145,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-11-12T06:35:50.553911+0000","last_change":"2021-11-12T06:35:50.553982+0000","last_active":"2021-11-12T06:35:50.553911+0000","last_peered":"2021-11-12T06:35:50.553911+0000","last_clean":"2021-11-12T06:35:50.553911+0000","last_became_active":"2021-11-12T05:40:31.958760+0000","last_became_peered":"2021-11-12T05:40:31.958760+0000","last_unstale":"2021-11-12T06:35:50.553911+0000","last_undegraded":"2021-11-12T06:35:50.553911+0000","last_fullsized":"2021-11-12T06:35:50.553911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T06:35:50.553911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T06:35:50.553911+0000","last_clean_scrub_stamp":"2021-11-12T06:35:50.553911+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":143,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-11-12T06:35:49.260512+0000","last_change":"2021-11-12T06:35:49.260557+0000","last_active":"2021-11-12T06:35:49.260512+0000","last_peered":"2021-11-12T06:35:49.260512+0000","last_clean":"2021-11-12T06:35:49.260512+0000","last_became_active":"2021-11-12T05:40:31.966094+0000","last_became_peered":"2021-11-12T05:40:31.966094+0000","last_unstale":"2021-11-12T06:35:49.260512+0000","last_undegraded":"2021-11-12T06:35:49.260512+0000","last_fullsized":"2021-11-12T06:35:49.260512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T06:35:49.260512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T06:35:49.260512+0000","last_clean_scrub_stamp":"2021-11-12T06:35:49.260512+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":141,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-11-12T06:35:52.857339+0000","last_change":"2021-11-12T06:35:52.857408+0000","last_active":"2021-11-12T06:35:52.857339+0000","last_peered":"2021-11-12T06:35:52.857339+0000","last_clean":"2021-11-12T06:35:52.857339+0000","last_became_active":"2021-11-12T05:40:31.966492+0000","last_became_peered":"2021-11-12T05:40:31.966492+0000","last_unstale":"2021-11-12T06:35:52.857339+0000","last_undegraded":"2021-11-12T06:35:52.857339+0000","last_fullsized":"2021-11-12T06:35:52.857339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T06:35:52.857338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T06:35:52.857338+0000","last_clean_scrub_stamp":"2021-11-12T06:35:52.857338+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":143,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-11-12T06:35:54.190103+0000","last_change":"2021-11-12T06:35:54.190195+0000","last_active":"2021-11-12T06:35:54.190103+0000","last_peered":"2021-11-12T06:35:54.190103+0000","last_clean":"2021-11-12T06:35:54.190103+0000","last_became_active":"2021-11-12T05:40:31.958357+0000","last_became_peered":"2021-11-12T05:40:31.958357+0000","last_unstale":"2021-11-12T06:35:54.190103+0000","last_undegraded":"2021-11-12T06:35:54.190103+0000","last_fullsized":"2021-11-12T06:35:54.190103+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T06:35:54.190103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T06:35:54.190103+0000","last_clean_scrub_stamp":"2021-11-12T06:35:54.190103+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":141,"reported_epoch":159,"state":"active+clean","last_fresh":"2021-11-12T06:35:51.033663+0000","last_change":"2021-11-12T06:35:51.033710+0000","last_active":"2021-11-12T06:35:51.033663+0000","last_peered":"2021-11-12T06:35:51.033663+0000","last_clean":"2021-11-12T06:35:51.033663+0000","last_became_active":"2021-11-12T05:40:31.958961+0000","last_became_peered":"2021-11-12T05:40:31.958961+0000","last_unstale":"2021-11-12T06:35:51.033663+0000","last_undegraded":"2021-11-12T06:35:51.033663+0000","last_fullsized":"2021-11-12T06:35:51.033663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-12T06:35:51.033663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-12T06:35:51.033663+0000","last_clean_scrub_stamp":"2021-11-12T06:35:51.033663+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9844,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542816,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050560,"kb_used_data":1976,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321280,"statfs":{"total":96636764160,"available":95560990720,"internally_reserved":1073741824,"allocated":2023424,"data_stored":995168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 12 06:36:06 2021","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.3400000000000001,"15min":1.3160000000000001},"min":{"1min":0.78000000000000003,"5min":0.628,"15min":0.33800000000000002},"max":{"1min":1.679,"5min":1.843,"15min":1.843},"last":1.409},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.274,"15min":1.262},"min":{"1min":0.73199999999999998,"5min":0.60199999999999998,"15min":0.39300000000000002},"max":{"1min":1.732,"5min":1.732,"15min":1.8140000000000001},"last":1.3460000000000001}]},{"osd":1,"last update":"Fri Nov 12 06:36:06 2021","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.1910000000000001,"15min":1.21},"min":{"1min":0.63600000000000001,"5min":0.56699999999999995,"15min":0.35399999999999998},"max":{"1min":1.5389999999999999,"5min":1.587,"15min":1.8779999999999999},"last":1.319},{"interface":"front","average":{"1min":1.226,"5min":1.238,"15min":1.232},"min":{"1min":0.755,"5min":0.60799999999999998,"15min":0.32600000000000001},"max":{"1min":1.5089999999999999,"5min":1.7230000000000001,"15min":1.788},"last":1.292}]},{"osd":2,"last update":"Fri Nov 12 06:36:06 2021","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.2729999999999999,"15min":1.2569999999999999},"min":{"1min":0.67000000000000004,"5min":0.60999999999999999,"15min":0.30499999999999999},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":1.544},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.204,"15min":1.2250000000000001},"min":{"1min":0.627,"5min":0.58399999999999996,"15min":0.36899999999999999},"max":{"1min":1.45,"5min":1.635,"15min":1.722},"last":1.2769999999999999}]},{"osd":3,"last update":"Fri Nov 12 06:36:06 2021","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.1930000000000001,"15min":1.2010000000000001},"min":{"1min":0.65700000000000003,"5min":0.59299999999999997,"15min":0.34300000000000003},"max":{"1min":1.47,"5min":1.496,"15min":1.6859999999999999},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.25,"15min":1.2629999999999999},"min":{"1min":0.71499999999999997,"5min":0.57499999999999996,"15min":0.34799999999999998},"max":{"1min":1.498,"5min":1.635,"15min":1.9279999999999999},"last":1.2090000000000001}]},{"osd":4,"last update":"Fri Nov 12 06:36:06 2021","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.877,"15min":0.88},"min":{"1min":0.41099999999999998,"5min":0.28499999999999998,"15min":0.22},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.93500000000000005,"15min":0.91500000000000004},"min":{"1min":0.377,"5min":0.29199999999999998,"15min":0.223},"max":{"1min":1.377,"5min":1.5129999999999999,"15min":1.518},"last":1.012}]},{"osd":5,"last update":"Fri Nov 12 06:36:06 2021","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.93999999999999995,"15min":0.92000000000000004},"min":{"1min":0.39700000000000002,"5min":0.28199999999999997,"15min":0.23799999999999999},"max":{"1min":1.4770000000000001,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.97399999999999998,"15min":0.97199999999999998},"min":{"1min":0.45500000000000002,"5min":0.26600000000000001,"15min":0.253},"max":{"1min":1.583,"5min":1.6100000000000001,"15min":1.6539999999999999},"last":0.875}]},{"osd":6,"last update":"Fri Nov 12 06:36:06 2021","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.014,"15min":1.022},"min":{"1min":0.47699999999999998,"5min":0.28399999999999997,"15min":0.23499999999999999},"max":{"1min":1.486,"5min":1.661,"15min":1.7},"last":1.101},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1.004,"15min":1.006},"min":{"1min":0.434,"5min":0.316,"15min":0.24199999999999999},"max":{"1min":1.2649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.85599999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542815,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050560,"kb_used_data":1976,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321280,"statfs":{"total":96636764160,"available":95560990720,"internally_reserved":1073741824,"allocated":2023424,"data_stored":995168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 12 06:36:07 2021","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.284,"15min":1.2430000000000001},"min":{"1min":0.66000000000000003,"5min":0.48299999999999998,"15min":0.35499999999999998},"max":{"1min":1.581,"5min":1.794,"15min":1.794},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.266,"15min":1.254},"min":{"1min":0.59199999999999997,"5min":0.52700000000000002,"15min":0.441},"max":{"1min":1.611,"5min":1.7270000000000001,"15min":1.9399999999999999},"last":1.1639999999999999}]},{"osd":1,"last update":"Fri Nov 12 06:36:07 2021","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.2609999999999999,"15min":1.244},"min":{"1min":0.61799999999999999,"5min":0.46400000000000002,"15min":0.36799999999999999},"max":{"1min":1.6879999999999999,"5min":1.718,"15min":1.907},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.25,"15min":1.24},"min":{"1min":0.60399999999999998,"5min":0.53600000000000003,"15min":0.33800000000000002},"max":{"1min":1.5760000000000001,"5min":1.6519999999999999,"15min":1.8580000000000001},"last":1.48}]},{"osd":2,"last update":"Fri Nov 12 06:36:07 2021","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.212,"15min":1.196},"min":{"1min":0.60699999999999998,"5min":0.48799999999999999,"15min":0.255},"max":{"1min":1.651,"5min":1.651,"15min":1.895},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.274,"15min":1.2430000000000001},"min":{"1min":0.64400000000000002,"5min":0.49399999999999999,"15min":0.308},"max":{"1min":1.6160000000000001,"5min":1.8580000000000001,"15min":1.958},"last":1.2589999999999999}]},{"osd":3,"last update":"Fri Nov 12 06:36:07 2021","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.2829999999999999,"15min":1.292},"min":{"1min":0.56999999999999995,"5min":0.502,"15min":0.42999999999999999},"max":{"1min":1.542,"5min":1.833,"15min":2.0750000000000002},"last":1.242},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.2869999999999999,"15min":1.262},"min":{"1min":0.63400000000000001,"5min":0.47099999999999997,"15min":0.36399999999999999},"max":{"1min":1.623,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.4019999999999999}]},{"osd":4,"last update":"Fri Nov 12 06:36:07 2021","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.98099999999999998,"15min":0.92900000000000005},"min":{"1min":0.41799999999999998,"5min":0.30099999999999999,"15min":0.216},"max":{"1min":1.4870000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.98199999999999998,"5min":1.042,"15min":1.006},"min":{"1min":0.38900000000000001,"5min":0.24099999999999999,"15min":0.20799999999999999},"max":{"1min":1.48,"5min":1.766,"15min":1.766},"last":0.92600000000000005}]},{"osd":5,"last update":"Fri Nov 12 06:36:07 2021","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.95399999999999996,"15min":0.91100000000000003},"min":{"1min":0.317,"5min":0.21099999999999999,"15min":0.193},"max":{"1min":1.397,"5min":1.621,"15min":1.7569999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.98699999999999999,"15min":0.94099999999999995},"min":{"1min":0.45200000000000001,"5min":0.28000000000000003,"15min":0.23300000000000001},"max":{"1min":1.407,"5min":1.5840000000000001,"15min":1.768},"last":0.82399999999999995}]},{"osd":7,"last update":"Fri Nov 12 06:36:07 2021","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.96299999999999997,"15min":0.95399999999999996},"min":{"1min":0.35899999999999999,"5min":0.223,"15min":0.223},"max":{"1min":1.23,"5min":1.7130000000000001,"15min":1.726},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.008,"15min":0.98799999999999999},"min":{"1min":0.35199999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.3440000000000001,"5min":1.8,"15min":1.8},"last":0.84299999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542816,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050560,"kb_used_data":1976,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321280,"statfs":{"total":96636764160,"available":95560990720,"internally_reserved":1073741824,"allocated":2023424,"data_stored":995168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.2130000000000001,"15min":1.2250000000000001},"min":{"1min":0.48099999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6859999999999999},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.258,"5min":1.2270000000000001,"15min":1.2609999999999999},"min":{"1min":0.41199999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.663,"5min":1.821,"15min":1.821},"last":0.94399999999999995}]},{"osd":1,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.22,"15min":1.254},"min":{"1min":0.41999999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.5189999999999999,"5min":1.6299999999999999,"15min":1.802},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.179,"5min":1.2270000000000001,"15min":1.2569999999999999},"min":{"1min":0.496,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.5329999999999999,"5min":1.671,"15min":1.899},"last":0.84899999999999998}]},{"osd":2,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.1719999999999999,"15min":1.202},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.4570000000000001,"5min":1.6299999999999999,"15min":1.7589999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.22,"15min":1.252},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.8169999999999999},"last":0.879}]},{"osd":3,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.2250000000000001,"15min":1.2490000000000001},"min":{"1min":0.43099999999999999,"5min":0.374,"15min":0.374},"max":{"1min":1.5609999999999999,"5min":1.7250000000000001,"15min":1.845},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.1519999999999999,"5min":1.1639999999999999,"15min":1.2230000000000001},"min":{"1min":0.46600000000000003,"5min":0.436,"15min":0.40100000000000002},"max":{"1min":1.5489999999999999,"5min":1.5640000000000001,"15min":1.742},"last":0.96999999999999997}]},{"osd":4,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.85699999999999998,"15min":0.89900000000000002},"min":{"1min":0.28000000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.399,"5min":1.4339999999999999,"15min":1.76},"last":0.442},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.89600000000000002,"15min":0.94499999999999995},"min":{"1min":0.255,"5min":0.251,"15min":0.246},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.6379999999999999},"last":0.623}]},{"osd":6,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.88400000000000001,"15min":0.92100000000000004},"min":{"1min":0.29599999999999999,"5min":0.224,"15min":0.224},"max":{"1min":1.2490000000000001,"5min":1.5049999999999999,"15min":1.6719999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.95499999999999996,"15min":0.98999999999999999},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.24199999999999999},"max":{"1min":1.77,"5min":1.77,"15min":1.8620000000000001},"last":0.56399999999999995}]},{"osd":7,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.97499999999999998,"15min":1.0029999999999999},"min":{"1min":0.23799999999999999,"5min":0.23699999999999999,"15min":0.23300000000000001},"max":{"1min":1.718,"5min":1.718,"15min":1.7410000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.97599999999999998,"15min":1.024},"min":{"1min":0.30399999999999999,"5min":0.26100000000000001,"15min":0.221},"max":{"1min":1.518,"5min":1.518,"15min":1.8360000000000001},"last":0.51000000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542815,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1050560,"kb_used_data":1976,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321280,"statfs":{"total":96636764160,"available":95560990720,"internally_reserved":1073741824,"allocated":2023424,"data_stored":995168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 12 06:35:22 2021","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.3320000000000001,"15min":1.2649999999999999},"min":{"1min":1.0920000000000001,"5min":0.56999999999999995,"15min":0.41999999999999998},"max":{"1min":1.722,"5min":1.7749999999999999,"15min":1.986},"last":1.298},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.238,"15min":1.2310000000000001},"min":{"1min":0.92300000000000004,"5min":0.64300000000000002,"15min":0.433},"max":{"1min":1.4610000000000001,"5min":1.7130000000000001,"15min":1.77},"last":1.4119999999999999}]},{"osd":1,"last update":"Fri Nov 12 06:35:22 2021","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.345,"15min":1.3220000000000001},"min":{"1min":1.0860000000000001,"5min":0.55800000000000005,"15min":0.435},"max":{"1min":1.657,"5min":1.732,"15min":1.9219999999999999},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.278,"15min":1.2629999999999999},"min":{"1min":1.121,"5min":0.626,"15min":0.44400000000000001},"max":{"1min":1.5269999999999999,"5min":1.7709999999999999,"15min":1.841},"last":1.3240000000000001}]},{"osd":2,"last update":"Fri Nov 12 06:35:22 2021","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.3140000000000001,"15min":1.274},"min":{"1min":1.044,"5min":0.58299999999999996,"15min":0.40600000000000003},"max":{"1min":1.5920000000000001,"5min":1.6879999999999999,"15min":1.732},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.256,"15min":1.2490000000000001},"min":{"1min":1.1599999999999999,"5min":0.54500000000000004,"15min":0.45300000000000001},"max":{"1min":1.575,"5min":1.7250000000000001,"15min":2.2490000000000001},"last":1.498}]},{"osd":3,"last update":"Fri Nov 12 06:35:22 2021","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2789999999999999,"15min":1.254},"min":{"1min":0.95599999999999996,"5min":0.60899999999999999,"15min":0.46300000000000002},"max":{"1min":1.6599999999999999,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.196},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.361,"15min":1.3089999999999999},"min":{"1min":1.248,"5min":0.61699999999999999,"15min":0.43099999999999999},"max":{"1min":1.726,"5min":1.821,"15min":1.8700000000000001},"last":1.21}]},{"osd":5,"last update":"Fri Nov 12 06:35:22 2021","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.874,"15min":0.86599999999999999},"min":{"1min":0.73199999999999998,"5min":0.248,"15min":0.23300000000000001},"max":{"1min":1.101,"5min":1.4299999999999999,"15min":2.1400000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.91400000000000003,"15min":0.90100000000000002},"min":{"1min":0.76600000000000001,"5min":0.28199999999999997,"15min":0.214},"max":{"1min":1.2629999999999999,"5min":1.5409999999999999,"15min":1.677},"last":0.88700000000000001}]},{"osd":6,"last update":"Fri Nov 12 06:35:22 2021","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":0.95099999999999996,"15min":0.92600000000000005},"min":{"1min":0.78800000000000003,"5min":0.28100000000000003,"15min":0.21299999999999999},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.052,"5min":1.036,"15min":1.04},"min":{"1min":0.88900000000000001,"5min":0.316,"15min":0.246},"max":{"1min":1.29,"5min":1.5649999999999999,"15min":2.2029999999999998},"last":1.2629999999999999}]},{"osd":7,"last update":"Fri Nov 12 06:35:22 2021","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.95999999999999996,"15min":0.94599999999999995},"min":{"1min":0.85999999999999999,"5min":0.26600000000000001,"15min":0.224},"max":{"1min":1.1319999999999999,"5min":1.4099999999999999,"15min":1.6000000000000001},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.091,"5min":1.012,"15min":1.002},"min":{"1min":0.88100000000000001,"5min":0.26000000000000001,"15min":0.23100000000000001},"max":{"1min":1.4670000000000001,"5min":1.5449999999999999,"15min":1.9259999999999999},"last":0.84699999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542815,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050560,"kb_used_data":1976,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321280,"statfs":{"total":96636764160,"available":95560990720,"internally_reserved":1073741824,"allocated":2023424,"data_stored":995168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 12 06:35:13 2021","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.72099999999999997,"15min":0.70199999999999996},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.75700000000000001,"15min":0.748},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":1.28,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.83699999999999997}]},{"osd":1,"last update":"Fri Nov 12 06:35:13 2021","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.753,"15min":0.752},"min":{"1min":0.16800000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":1.026,"5min":1.1619999999999999,"15min":1.343},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.754,"5min":0.82399999999999995,"15min":0.80800000000000005},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":1.248,"5min":1.248,"15min":1.3120000000000001},"last":0.94099999999999995}]},{"osd":2,"last update":"Fri Nov 12 06:35:13 2021","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.86099999999999999,"15min":0.83999999999999997},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":1.216,"5min":1.258,"15min":1.2769999999999999},"last":1.044},{"interface":"front","average":{"1min":0.749,"5min":0.83099999999999996,"15min":0.82599999999999996},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.1799999999999999,"5min":1.1930000000000001,"15min":1.2090000000000001},"last":0.98599999999999999}]},{"osd":4,"last update":"Fri Nov 12 06:35:13 2021","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.3149999999999999,"15min":1.337},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.59699999999999998},"max":{"1min":1.653,"5min":1.7470000000000001,"15min":1.859},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.321,"15min":1.319},"min":{"1min":0.71499999999999997,"5min":0.70699999999999996,"15min":0.41499999999999998},"max":{"1min":1.4810000000000001,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.4770000000000001}]},{"osd":5,"last update":"Fri Nov 12 06:35:13 2021","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.3009999999999999,"15min":1.2969999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.38900000000000001},"max":{"1min":1.5780000000000001,"5min":2.121,"15min":2.121},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.347,"5min":1.321,"15min":1.335},"min":{"1min":0.70699999999999996,"5min":0.67700000000000005,"15min":0.54900000000000004},"max":{"1min":1.6890000000000001,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.4510000000000001}]},{"osd":6,"last update":"Fri Nov 12 06:35:13 2021","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.3080000000000001,"15min":1.3149999999999999},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.45400000000000001},"max":{"1min":1.6100000000000001,"5min":1.8009999999999999,"15min":1.804},"last":1.554},{"interface":"front","average":{"1min":1.246,"5min":1.292,"15min":1.2949999999999999},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.53700000000000003},"max":{"1min":1.575,"5min":1.6659999999999999,"15min":1.7789999999999999},"last":1.345}]},{"osd":7,"last update":"Fri Nov 12 06:35:13 2021","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.3300000000000001,"15min":1.3380000000000001},"min":{"1min":0.72599999999999998,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.708,"5min":1.708,"15min":1.7629999999999999},"last":1.623},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.331,"15min":1.3340000000000001},"min":{"1min":0.69299999999999995,"5min":0.66000000000000003,"15min":0.55700000000000005},"max":{"1min":1.6699999999999999,"5min":1.8240000000000001,"15min":1.8300000000000001},"last":1.391}]}]},{"osd":2,"up_from":14,"seq":60129542814,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050560,"kb_used_data":1976,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321280,"statfs":{"total":96636764160,"available":95560990720,"internally_reserved":1073741824,"allocated":2023424,"data_stored":995168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72299999999999998,"15min":0.70799999999999996},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":1.212,"5min":1.212,"15min":1.246},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.77000000000000002,"15min":0.78200000000000003},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.19},"max":{"1min":0.97199999999999998,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.82899999999999996}]},{"osd":1,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.78200000000000003,"15min":0.79000000000000004},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.2110000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.75700000000000001,"15min":0.76800000000000002},"min":{"1min":0.27000000000000002,"5min":0.26900000000000002,"15min":0.17000000000000001},"max":{"1min":1.002,"5min":1.135,"15min":1.3120000000000001},"last":0.69499999999999995}]},{"osd":3,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.84699999999999998,"15min":0.85499999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.20699999999999999},"max":{"1min":1.1020000000000001,"5min":1.1639999999999999,"15min":1.2350000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78800000000000003,"15min":0.80000000000000004},"min":{"1min":0.245,"5min":0.245,"15min":0.23000000000000001},"max":{"1min":1.026,"5min":1.0620000000000001,"15min":1.4319999999999999},"last":0.96899999999999997}]},{"osd":4,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.373,"15min":1.371},"min":{"1min":0.94999999999999996,"5min":0.61499999999999999,"15min":0.39400000000000002},"max":{"1min":1.742,"5min":1.742,"15min":1.8580000000000001},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.331,"15min":1.3380000000000001},"min":{"1min":0.86799999999999999,"5min":0.68000000000000005,"15min":0.52500000000000002},"max":{"1min":1.659,"5min":1.8180000000000001,"15min":1.8260000000000001},"last":1.4470000000000001}]},{"osd":5,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.413,"15min":1.381},"min":{"1min":0.93899999999999995,"5min":0.63500000000000001,"15min":0.35999999999999999},"max":{"1min":1.8089999999999999,"5min":1.835,"15min":1.835},"last":1.474},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.331,"15min":1.341},"min":{"1min":0.84799999999999998,"5min":0.69399999999999995,"15min":0.38600000000000001},"max":{"1min":1.7310000000000001,"5min":1.804,"15min":1.8380000000000001},"last":1.3680000000000001}]},{"osd":6,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.3640000000000001,"15min":1.3660000000000001},"min":{"1min":0.90400000000000003,"5min":0.67400000000000004,"15min":0.48399999999999999},"max":{"1min":1.798,"5min":1.837,"15min":1.837},"last":1.327},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.355,"15min":1.3540000000000001},"min":{"1min":0.879,"5min":0.64300000000000002,"15min":0.36599999999999999},"max":{"1min":1.6559999999999999,"5min":1.748,"15min":1.8839999999999999},"last":1.524}]},{"osd":7,"last update":"Fri Nov 12 06:35:10 2021","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.3,"15min":1.3069999999999999},"min":{"1min":0.85399999999999998,"5min":0.64500000000000002,"15min":0.372},"max":{"1min":1.5980000000000001,"5min":1.744,"15min":1.744},"last":1.415},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.367,"15min":1.373},"min":{"1min":0.84199999999999997,"5min":0.64600000000000002,"15min":0.376},"max":{"1min":1.829,"5min":1.829,"15min":1.8600000000000001},"last":1.5589999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542815,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050560,"kb_used_data":1976,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321280,"statfs":{"total":96636764160,"available":95560990720,"internally_reserved":1073741824,"allocated":2023424,"data_stored":995168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 12 06:35:14 2021","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65800000000000003,"15min":0.68100000000000005},"min":{"1min":0.214,"5min":0.214,"15min":0.20300000000000001},"max":{"1min":0.79600000000000004,"5min":1.151,"15min":1.1990000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77500000000000002},"min":{"1min":0.248,"5min":0.219,"15min":0.20000000000000001},"max":{"1min":1.1919999999999999,"5min":1.204,"15min":1.4359999999999999},"last":1.006}]},{"osd":2,"last update":"Fri Nov 12 06:35:14 2021","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.80600000000000005,"15min":0.82699999999999996},"min":{"1min":0.30099999999999999,"5min":0.216,"15min":0.216},"max":{"1min":1.032,"5min":1.175,"15min":1.24},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78600000000000003,"15min":0.80400000000000005},"min":{"1min":0.27300000000000002,"5min":0.22900000000000001,"15min":0.216},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.3120000000000001},"last":0.96699999999999997}]},{"osd":3,"last update":"Fri Nov 12 06:35:14 2021","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.82399999999999995,"15min":0.82499999999999996},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":1.014,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.88900000000000001,"15min":0.90400000000000003},"min":{"1min":0.313,"5min":0.245,"15min":0.23000000000000001},"max":{"1min":1.0940000000000001,"5min":1.996,"15min":1.996},"last":0.87}]},{"osd":4,"last update":"Fri Nov 12 06:35:14 2021","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.379,"15min":1.341},"min":{"1min":0.77100000000000002,"5min":0.49199999999999999,"15min":0.36899999999999999},"max":{"1min":1.6819999999999999,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":1.494},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.363,"15min":1.3500000000000001},"min":{"1min":0.80700000000000005,"5min":0.47899999999999998,"15min":0.33600000000000002},"max":{"1min":1.681,"5min":1.827,"15min":1.827},"last":1.5309999999999999}]},{"osd":5,"last update":"Fri Nov 12 06:35:14 2021","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3740000000000001,"15min":1.363},"min":{"1min":0.72599999999999998,"5min":0.46899999999999997,"15min":0.35299999999999998},"max":{"1min":1.7549999999999999,"5min":1.8440000000000001,"15min":2.1019999999999999},"last":1.571},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.369,"15min":1.357},"min":{"1min":0.79700000000000004,"5min":0.50900000000000001,"15min":0.34799999999999998},"max":{"1min":1.6299999999999999,"5min":1.748,"15min":2.169},"last":1.389}]},{"osd":6,"last update":"Fri Nov 12 06:35:14 2021","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.323,"15min":1.3180000000000001},"min":{"1min":0.75800000000000001,"5min":0.54800000000000004,"15min":0.40699999999999997},"max":{"1min":1.629,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.617},{"interface":"front","average":{"1min":1.365,"5min":1.3799999999999999,"15min":1.3560000000000001},"min":{"1min":0.77900000000000003,"5min":0.44600000000000001,"15min":0.377},"max":{"1min":1.6950000000000001,"5min":1.8109999999999999,"15min":1.952},"last":1.4279999999999999}]},{"osd":7,"last update":"Fri Nov 12 06:35:14 2021","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.349,"15min":1.3520000000000001},"min":{"1min":0.76700000000000002,"5min":0.53400000000000003,"15min":0.36199999999999999},"max":{"1min":1.605,"5min":1.79,"15min":1.9159999999999999},"last":1.7},{"interface":"front","average":{"1min":1.339,"5min":1.3480000000000001,"15min":1.3149999999999999},"min":{"1min":0.78700000000000003,"5min":0.46100000000000002,"15min":0.39200000000000002},"max":{"1min":1.5980000000000001,"5min":1.716,"15min":1.8540000000000001},"last":1.4570000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542815,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050560,"kb_used_data":1976,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321280,"statfs":{"total":96636764160,"available":95560990720,"internally_reserved":1073741824,"allocated":2023424,"data_stored":995168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 12 06:35:08 2021","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.71699999999999997,"15min":0.70199999999999996},"min":{"1min":0.30099999999999999,"5min":0.253,"15min":0.11899999999999999},"max":{"1min":0.96799999999999997,"5min":1.083,"15min":1.083},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73399999999999999,"15min":0.754},"min":{"1min":0.30399999999999999,"5min":0.22600000000000001,"15min":0.19700000000000001},"max":{"1min":0.96399999999999997,"5min":1.1559999999999999,"15min":1.2090000000000001},"last":0.71799999999999997}]},{"osd":2,"last update":"Fri Nov 12 06:35:08 2021","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.748,"15min":0.755},"min":{"1min":0.27300000000000002,"5min":0.20899999999999999,"15min":0.13400000000000001},"max":{"1min":0.94099999999999995,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.872},{"interface":"front","average":{"1min":0.879,"5min":0.81999999999999995,"15min":0.83099999999999996},"min":{"1min":0.34000000000000002,"5min":0.254,"15min":0.21199999999999999},"max":{"1min":1.1399999999999999,"5min":1.2729999999999999,"15min":1.3520000000000001},"last":0.82399999999999995}]},{"osd":3,"last update":"Fri Nov 12 06:35:08 2021","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.78800000000000003,"15min":0.80100000000000005},"min":{"1min":0.34499999999999997,"5min":0.215,"15min":0.215},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88500000000000001,"15min":0.88600000000000001},"min":{"1min":0.316,"5min":0.245,"15min":0.14499999999999999},"max":{"1min":1.143,"5min":1.3029999999999999,"15min":1.3520000000000001},"last":0.93600000000000005}]},{"osd":4,"last update":"Fri Nov 12 06:35:08 2021","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.3500000000000001,"15min":1.345},"min":{"1min":0.83399999999999996,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.877,"5min":1.8799999999999999,"15min":1.881},"last":1.395},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3180000000000001,"15min":1.3300000000000001},"min":{"1min":0.878,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.619,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.2230000000000001}]},{"osd":5,"last update":"Fri Nov 12 06:35:08 2021","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.3640000000000001,"15min":1.3600000000000001},"min":{"1min":0.85099999999999998,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.7909999999999999,"5min":1.972,"15min":1.972},"last":1.425},{"interface":"front","average":{"1min":1.337,"5min":1.3420000000000001,"15min":1.3600000000000001},"min":{"1min":0.876,"5min":0.435,"15min":0.435},"max":{"1min":1.722,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.256}]},{"osd":6,"last update":"Fri Nov 12 06:35:08 2021","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3200000000000001,"15min":1.337},"min":{"1min":0.84399999999999997,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.694,"5min":1.736,"15min":1.8600000000000001},"last":1.321},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3580000000000001,"15min":1.371},"min":{"1min":0.93899999999999995,"5min":0.502,"15min":0.502},"max":{"1min":1.6619999999999999,"5min":1.927,"15min":1.927},"last":1.5029999999999999}]},{"osd":7,"last update":"Fri Nov 12 06:35:08 2021","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":1.373,"15min":1.375},"min":{"1min":0.89600000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.788,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":1.337},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.359,"15min":1.3700000000000001},"min":{"1min":0.86899999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.718,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.478}]}]}]}} 2021-11-12T06:36:10.708 DEBUG:teuthology.orchestra.run.gibba005:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2021-11-12T06:36:10.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.759+0000 7f2e924e0700 1 Processor -- start 2021-11-12T06:36:10.760 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.759+0000 7f2e924e0700 1 -- start start 2021-11-12T06:36:10.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.759+0000 7f2e924e0700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f2e8c0ace20 0x7f2e8c0b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:36:10.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.759+0000 7f2e924e0700 1 --2- >> v2:172.21.2.115:3300/0 conn(0x7f2e8c144180 0x7f2e8c1445f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-11-12T06:36:10.761 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.759+0000 7f2e924e0700 1 -- --> v1:172.21.2.115:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e8c0b1840 con 0x7f2e8c0aca40 2021-11-12T06:36:10.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.759+0000 7f2e924e0700 1 -- --> v2:172.21.2.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e8c0b0a10 con 0x7f2e8c0ace20 2021-11-12T06:36:10.762 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.759+0000 7f2e924e0700 1 -- --> v2:172.21.2.115:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e8c0af2b0 con 0x7f2e8c144180 2021-11-12T06:36:10.766 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.759+0000 7f2e8b7fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f2e8c0ace20 0x7f2e8c0b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:36:10.767 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.759+0000 7f2e8b7fe700 1 --2- >> v2:172.21.2.105:3300/0 conn(0x7f2e8c0ace20 0x7f2e8c0b0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53794/0 (socket says 172.21.2.105:53794) 2021-11-12T06:36:10.767 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.759+0000 7f2e8b7fe700 1 -- 172.21.2.105:0/114017092 learned_addr learned my addr 172.21.2.105:0/114017092 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T06:36:10.768 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.759+0000 7f2e8b7fe700 1 -- 172.21.2.105:0/114017092 >> v2:172.21.2.115:3300/0 conn(0x7f2e8c144180 msgr2=0x7f2e8c1445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T06:36:10.768 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.759+0000 7f2e8b7fe700 1 --2- 172.21.2.105:0/114017092 >> v2:172.21.2.115:3300/0 conn(0x7f2e8c144180 0x7f2e8c1445f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T06:36:10.768 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.759+0000 7f2e8b7fe700 1 -- 172.21.2.105:0/114017092 >> v1:172.21.2.115:6789/0 conn(0x7f2e8c0aca40 legacy=0x7f2e8c1473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-11-12T06:36:10.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.759+0000 7f2e8b7fe700 1 -- 172.21.2.105:0/114017092 --> v2:172.21.2.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e8c0b1a70 con 0x7f2e8c0ace20 2021-11-12T06:36:10.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.759+0000 7f2e8b7fe700 1 --2- 172.21.2.105:0/114017092 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2e8c0ace20 0x7f2e8c0b0520 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 rx=0x7f2e8c061140 tx=0x7f2e7c006eb0).ready entity=mon.0 client_cookie=bb33f58833aca02c server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:36:10.769 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.759+0000 7f2e8affd700 1 -- 172.21.2.105:0/114017092 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e7c00d5c0 con 0x7f2e8c0ace20 2021-11-12T06:36:10.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.759+0000 7f2e8affd700 1 -- 172.21.2.105:0/114017092 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e7c000e90 con 0x7f2e8c0ace20 2021-11-12T06:36:10.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.759+0000 7f2e8affd700 1 -- 172.21.2.105:0/114017092 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e7c00d910 con 0x7f2e8c0ace20 2021-11-12T06:36:10.770 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.759+0000 7f2e924e0700 1 -- 172.21.2.105:0/114017092 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2e8c0ace20 msgr2=0x7f2e8c0b0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:36:10.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.759+0000 7f2e924e0700 1 --2- 172.21.2.105:0/114017092 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2e8c0ace20 0x7f2e8c0b0520 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 rx=0x7f2e8c061140 tx=0x7f2e7c006eb0).stop 2021-11-12T06:36:10.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.759+0000 7f2e924e0700 1 -- 172.21.2.105:0/114017092 shutdown_connections 2021-11-12T06:36:10.771 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.759+0000 7f2e924e0700 1 --2- 172.21.2.105:0/114017092 >> v2:172.21.2.115:3300/0 conn(0x7f2e8c144180 0x7f2e8c1445f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-11-12T06:36:10.772 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.759+0000 7f2e924e0700 1 --2- 172.21.2.105:0/114017092 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2e8c0ace20 0x7f2e8c0b0520 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:36:10.772 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.759+0000 7f2e924e0700 1 -- 172.21.2.105:0/114017092 >> 172.21.2.105:0/114017092 conn(0x7f2e8c05c490 msgr2=0x7f2e8c0b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:36:10.772 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.759+0000 7f2e924e0700 1 -- 172.21.2.105:0/114017092 shutdown_connections 2021-11-12T06:36:10.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.759+0000 7f2e924e0700 1 -- 172.21.2.105:0/114017092 wait complete. 2021-11-12T06:36:10.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.759+0000 7f2e924e0700 1 Processor -- start 2021-11-12T06:36:10.773 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.759+0000 7f2e924e0700 1 -- start start 2021-11-12T06:36:10.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.759+0000 7f2e924e0700 1 --2- >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2e8c0aca40 0x7f2e8c0625b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:36:10.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.759+0000 7f2e924e0700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2e8c0ace20 0x7f2e8c140530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:36:10.774 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.759+0000 7f2e924e0700 1 --2- >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2e8c144180 0x7f2e8c13f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:36:10.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.759+0000 7f2e924e0700 1 -- --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c0b1c60 con 0x7f2e8c0ace20 2021-11-12T06:36:10.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.759+0000 7f2e924e0700 1 -- --> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c0b1e90 con 0x7f2e8c144180 2021-11-12T06:36:10.775 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.759+0000 7f2e924e0700 1 -- --> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c0b2130 con 0x7f2e8c0aca40 2021-11-12T06:36:10.776 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.759+0000 7f2e8b7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2e8c0ace20 0x7f2e8c140530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:36:10.776 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.759+0000 7f2e8b7fe700 1 --2- >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2e8c0ace20 0x7f2e8c140530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.2.105:3300/0 says I am v2:172.21.2.105:53798/0 (socket says 172.21.2.105:53798) 2021-11-12T06:36:10.776 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.759+0000 7f2e8b7fe700 1 -- 172.21.2.105:0/1676745417 learned_addr learned my addr 172.21.2.105:0/1676745417 (peer_addr_for_me v2:172.21.2.105:0/0) 2021-11-12T06:36:10.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.763+0000 7f2e8b7fe700 1 -- 172.21.2.105:0/1676745417 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2e8c0aca40 msgr2=0x7f2e8c0625b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:36:10.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.763+0000 7f2e8b7fe700 1 --2- 172.21.2.105:0/1676745417 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2e8c0aca40 0x7f2e8c0625b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:36:10.777 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.763+0000 7f2e8b7fe700 1 -- 172.21.2.105:0/1676745417 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2e8c144180 msgr2=0x7f2e8c13f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:36:10.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.763+0000 7f2e8b7fe700 1 --2- 172.21.2.105:0/1676745417 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2e8c144180 0x7f2e8c13f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:36:10.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.763+0000 7f2e8b7fe700 1 -- 172.21.2.105:0/1676745417 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e7c00b1e0 con 0x7f2e8c0ace20 2021-11-12T06:36:10.778 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.763+0000 7f2e8b7fe700 1 --2- 172.21.2.105:0/1676745417 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2e8c0ace20 0x7f2e8c140530 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 rx=0x7f2e8c061140 tx=0x7f2e7c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:36:10.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.763+0000 7f2e897fa700 1 -- 172.21.2.105:0/1676745417 <== mon.0 v2:172.21.2.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e7c006be0 con 0x7f2e8c0ace20 2021-11-12T06:36:10.779 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.763+0000 7f2e897fa700 1 -- 172.21.2.105:0/1676745417 <== mon.0 v2:172.21.2.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e7c00de90 con 0x7f2e8c0ace20 2021-11-12T06:36:10.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.763+0000 7f2e897fa700 1 -- 172.21.2.105:0/1676745417 <== mon.0 v2:172.21.2.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e7c002f70 con 0x7f2e8c0ace20 2021-11-12T06:36:10.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.763+0000 7f2e924e0700 1 -- 172.21.2.105:0/1676745417 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e8c065c40 con 0x7f2e8c0ace20 2021-11-12T06:36:10.780 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.763+0000 7f2e924e0700 1 -- 172.21.2.105:0/1676745417 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e8c065f50 con 0x7f2e8c0ace20 2021-11-12T06:36:10.781 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.763+0000 7f2e924e0700 1 -- 172.21.2.105:0/1676745417 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e8c062aa0 con 0x7f2e8c0ace20 2021-11-12T06:36:10.781 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.763+0000 7f2e897fa700 1 -- 172.21.2.105:0/1676745417 <== mon.0 v2:172.21.2.105:3300/0 4 ==== mgrmap(e 5) v1 ==== 65700+0+0 (secure 0 0 0) 0x7f2e7c01a040 con 0x7f2e8c0ace20 2021-11-12T06:36:10.781 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.763+0000 7f2e897fa700 1 --2- 172.21.2.105:0/1676745417 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2e700535b0 0x7f2e70055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-11-12T06:36:10.782 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.763+0000 7f2e897fa700 1 -- 172.21.2.105:0/1676745417 <== mon.0 v2:172.21.2.105:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5682+0+0 (secure 0 0 0) 0x7f2e7c06c6f0 con 0x7f2e8c0ace20 2021-11-12T06:36:10.782 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.763+0000 7f2e8bfff700 1 --2- 172.21.2.105:0/1676745417 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2e700535b0 0x7f2e70055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-11-12T06:36:10.783 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.763+0000 7f2e8bfff700 1 --2- 172.21.2.105:0/1676745417 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2e700535b0 0x7f2e70055a70 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7f2e74002f90 tx=0x7f2e740069b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-11-12T06:36:10.783 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.767+0000 7f2e897fa700 1 -- 172.21.2.105:0/1676745417 <== mon.0 v2:172.21.2.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2e7c0439d0 con 0x7f2e8c0ace20 2021-11-12T06:36:10.850 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.847+0000 7f2e924e0700 1 -- 172.21.2.105:0/1676745417 --> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f2e8c0b22f0 con 0x7f2e8c0ace20 2021-11-12T06:36:10.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.851+0000 7f2e897fa700 1 -- 172.21.2.105:0/1676745417 <== mon.0 v2:172.21.2.105:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2e7c0439d0 con 0x7f2e8c0ace20 2021-11-12T06:36:10.855 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.851+0000 7f2e897fa700 1 -- 172.21.2.105:0/1676745417 <== mon.0 v2:172.21.2.105:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v25)=0 v25) v1 ==== 123+0+0 (secure 0 0 0) 0x7f2e7c046ff0 con 0x7f2e8c0ace20 2021-11-12T06:36:10.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.855+0000 7f2e924e0700 1 -- 172.21.2.105:0/1676745417 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2e700535b0 msgr2=0x7f2e70055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:36:10.857 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.855+0000 7f2e924e0700 1 --2- 172.21.2.105:0/1676745417 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2e700535b0 0x7f2e70055a70 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7f2e74002f90 tx=0x7f2e740069b0).stop 2021-11-12T06:36:10.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.855+0000 7f2e924e0700 1 -- 172.21.2.105:0/1676745417 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2e8c0ace20 msgr2=0x7f2e8c140530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-11-12T06:36:10.858 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.855+0000 7f2e924e0700 1 --2- 172.21.2.105:0/1676745417 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2e8c0ace20 0x7f2e8c140530 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 rx=0x7f2e8c061140 tx=0x7f2e7c015000).stop 2021-11-12T06:36:10.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.855+0000 7f2e924e0700 1 -- 172.21.2.105:0/1676745417 shutdown_connections 2021-11-12T06:36:10.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.855+0000 7f2e924e0700 1 --2- 172.21.2.105:0/1676745417 >> [v2:172.21.2.105:6800/14730,v1:172.21.2.105:6801/14730] conn(0x7f2e700535b0 0x7f2e70055a70 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:36:10.859 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.855+0000 7f2e924e0700 1 --2- 172.21.2.105:0/1676745417 >> [v2:172.21.2.115:3300/0,v1:172.21.2.115:6789/0] conn(0x7f2e8c144180 0x7f2e8c13f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:36:10.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.855+0000 7f2e924e0700 1 --2- 172.21.2.105:0/1676745417 >> [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] conn(0x7f2e8c0ace20 0x7f2e8c140530 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-11-12T06:36:10.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.855+0000 7f2e924e0700 1 --2- 172.21.2.105:0/1676745417 >> [v2:172.21.2.115:3301/0,v1:172.21.2.115:6790/0] conn(0x7f2e8c0aca40 0x7f2e8c0625b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-11-12T06:36:10.860 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.855+0000 7f2e924e0700 1 -- 172.21.2.105:0/1676745417 >> 172.21.2.105:0/1676745417 conn(0x7f2e8c05c490 msgr2=0x7f2e8c0b5100 unknown :-1 s=STATE_NONE l=0).mark_down 2021-11-12T06:36:10.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.855+0000 7f2e924e0700 1 -- 172.21.2.105:0/1676745417 shutdown_connections 2021-11-12T06:36:10.861 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-12T06:36:10.855+0000 7f2e924e0700 1 -- 172.21.2.105:0/1676745417 wait complete. 2021-11-12T06:36:10.863 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph_a81ee2815de5acae59ead5b8c9137b6766fc8ea8/qa/tasks/ceph.py", line 1839, in task yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/run_tasks.py", line 176, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_a81ee2815de5acae59ead5b8c9137b6766fc8ea8/qa/tasks/ceph_fuse.py", line 159, in task if mount.is_mounted(): File "/home/teuthworker/src/github.com_ceph_ceph_a81ee2815de5acae59ead5b8c9137b6766fc8ea8/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/orchestra/run.py", line 148, in wait greenlet.get(block=True,timeout=60) File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-11-12T06:36:10.866 INFO:teuthology.misc:Shutting down mds daemons... 2021-11-12T06:36:10.867 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-11-12T06:36:10.868 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T06:36:10.873 INFO:tasks.ceph.mds.a:Stopped 2021-11-12T06:36:10.874 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-11-12T06:36:10.875 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T06:36:10.881 INFO:tasks.ceph.mds.b:Stopped 2021-11-12T06:36:10.882 INFO:teuthology.misc:Shutting down osd daemons... 2021-11-12T06:36:10.883 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2021-11-12T06:36:10.884 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T06:36:14.688 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2021-11-12T06:36:16.986 INFO:tasks.ceph.osd.0:Stopped 2021-11-12T06:36:16.988 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2021-11-12T06:36:16.989 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T06:36:17.047 INFO:tasks.ceph.osd.1:Stopped 2021-11-12T06:36:17.048 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2021-11-12T06:36:17.048 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T06:36:20.692 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2021-11-12T06:36:20.692 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2021-11-12T06:36:23.151 INFO:tasks.ceph.osd.2:Stopped 2021-11-12T06:36:23.152 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2021-11-12T06:36:23.153 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T06:36:23.223 INFO:tasks.ceph.osd.3:Stopped 2021-11-12T06:36:23.224 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2021-11-12T06:36:23.225 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T06:36:23.327 INFO:tasks.ceph.osd.4:Stopped 2021-11-12T06:36:23.329 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2021-11-12T06:36:23.330 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T06:36:26.396 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2021-11-12T06:36:26.397 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2021-11-12T06:36:29.432 INFO:tasks.ceph.osd.5:Stopped 2021-11-12T06:36:29.433 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2021-11-12T06:36:29.434 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T06:36:32.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2021-11-12T06:36:32.004 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2021-11-12T06:36:32.196 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:36:32.199 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:36:32.203 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:36:32.206 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:36:32.210 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:36:35.537 INFO:tasks.ceph.osd.6:Stopped 2021-11-12T06:36:35.538 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2021-11-12T06:36:35.539 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T06:36:35.602 INFO:tasks.ceph.osd.7:Stopped 2021-11-12T06:36:35.603 INFO:teuthology.misc:Shutting down mgr daemons... 2021-11-12T06:36:35.604 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2021-11-12T06:36:35.604 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T06:36:35.619 INFO:tasks.ceph.mgr.y:Stopped 2021-11-12T06:36:35.620 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2021-11-12T06:36:35.620 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T06:36:35.630 INFO:tasks.ceph.mgr.x:Stopped 2021-11-12T06:36:35.631 INFO:teuthology.misc:Shutting down mon daemons... 2021-11-12T06:36:35.632 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2021-11-12T06:36:35.632 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T06:36:35.643 INFO:tasks.ceph.mon.a:Stopped 2021-11-12T06:36:35.644 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2021-11-12T06:36:35.645 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T06:36:35.652 INFO:tasks.ceph.mon.b:Stopped 2021-11-12T06:36:35.653 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2021-11-12T06:36:35.654 INFO:teuthology.orchestra.run:waiting for 300 2021-11-12T06:36:35.662 INFO:tasks.ceph.mon.c:Stopped 2021-11-12T06:36:35.663 INFO:tasks.ceph:Checking cluster log for badness... 2021-11-12T06:36:35.664 DEBUG:teuthology.orchestra.run.gibba005:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'evicting unresponsive client' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'has not responded to cap revoke by MDS for over' | egrep -v MDS_CLIENT_LATE_RELEASE | egrep -v 'responding to mclientcaps' | head -n 1 2021-11-12T06:36:35.678 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@gibba005.front.sepia.ceph.com 2021-11-12T06:36:35.679 DEBUG:teuthology.orchestra.run.gibba005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2021-11-12T06:36:35.923 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@gibba005.front.sepia.ceph.com 2021-11-12T06:36:35.924 DEBUG:teuthology.orchestra.run.gibba005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2021-11-12T06:36:36.142 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@gibba005.front.sepia.ceph.com 2021-11-12T06:36:36.143 DEBUG:teuthology.orchestra.run.gibba005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2021-11-12T06:36:36.330 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@gibba005.front.sepia.ceph.com 2021-11-12T06:36:36.331 DEBUG:teuthology.orchestra.run.gibba005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2021-11-12T06:36:36.487 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@gibba015.front.sepia.ceph.com 2021-11-12T06:36:36.488 DEBUG:teuthology.orchestra.run.gibba015:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2021-11-12T06:36:36.671 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@gibba015.front.sepia.ceph.com 2021-11-12T06:36:36.672 DEBUG:teuthology.orchestra.run.gibba015:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2021-11-12T06:36:36.917 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@gibba015.front.sepia.ceph.com 2021-11-12T06:36:36.918 DEBUG:teuthology.orchestra.run.gibba015:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2021-11-12T06:36:37.005 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2021-11-12T06:36:37.094 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@gibba015.front.sepia.ceph.com 2021-11-12T06:36:37.095 DEBUG:teuthology.orchestra.run.gibba015:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2021-11-12T06:36:37.248 INFO:tasks.ceph:Archiving mon data... 2021-11-12T06:36:37.250 DEBUG:teuthology.misc:Transferring archived files from gibba005:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2021-11-05_04:10:01-fs-octopus-distro-default-gibba/6486492/data/mon.a.tgz 2021-11-12T06:36:37.251 DEBUG:teuthology.orchestra.run.gibba005:> mktemp 2021-11-12T06:36:37.261 INFO:teuthology.orchestra.run.gibba005.stdout:/tmp/tmp.HEKRGirQat 2021-11-12T06:36:37.262 DEBUG:teuthology.orchestra.run.gibba005:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.HEKRGirQat 2021-11-12T06:36:37.389 DEBUG:teuthology.orchestra.run.gibba005:> sudo chmod 0666 /tmp/tmp.HEKRGirQat 2021-11-12T06:36:37.403 DEBUG:teuthology.orchestra.remote:gibba005:/tmp/tmp.HEKRGirQat is 478KB 2021-11-12T06:36:37.510 DEBUG:teuthology.orchestra.run.gibba005:> rm -fr /tmp/tmp.HEKRGirQat 2021-11-12T06:36:37.520 DEBUG:teuthology.misc:Transferring archived files from gibba015:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2021-11-05_04:10:01-fs-octopus-distro-default-gibba/6486492/data/mon.b.tgz 2021-11-12T06:36:37.521 DEBUG:teuthology.orchestra.run.gibba015:> mktemp 2021-11-12T06:36:37.530 INFO:teuthology.orchestra.run.gibba015.stdout:/tmp/tmp.J8qNgbhNZW 2021-11-12T06:36:37.531 DEBUG:teuthology.orchestra.run.gibba015:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.J8qNgbhNZW 2021-11-12T06:36:37.663 DEBUG:teuthology.orchestra.run.gibba015:> sudo chmod 0666 /tmp/tmp.J8qNgbhNZW 2021-11-12T06:36:37.676 DEBUG:teuthology.orchestra.remote:gibba015:/tmp/tmp.J8qNgbhNZW is 486KB 2021-11-12T06:36:37.736 DEBUG:teuthology.orchestra.run.gibba015:> rm -fr /tmp/tmp.J8qNgbhNZW 2021-11-12T06:36:37.741 DEBUG:teuthology.misc:Transferring archived files from gibba015:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2021-11-05_04:10:01-fs-octopus-distro-default-gibba/6486492/data/mon.c.tgz 2021-11-12T06:36:37.741 DEBUG:teuthology.orchestra.run.gibba015:> mktemp 2021-11-12T06:36:37.796 INFO:teuthology.orchestra.run.gibba015.stdout:/tmp/tmp.zELbLd0rBj 2021-11-12T06:36:37.796 DEBUG:teuthology.orchestra.run.gibba015:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.zELbLd0rBj 2021-11-12T06:36:37.922 DEBUG:teuthology.orchestra.run.gibba015:> sudo chmod 0666 /tmp/tmp.zELbLd0rBj 2021-11-12T06:36:37.981 DEBUG:teuthology.orchestra.remote:gibba015:/tmp/tmp.zELbLd0rBj is 486KB 2021-11-12T06:36:38.091 DEBUG:teuthology.orchestra.run.gibba015:> rm -fr /tmp/tmp.zELbLd0rBj 2021-11-12T06:36:38.101 INFO:tasks.ceph:Cleaning ceph cluster... 2021-11-12T06:36:38.102 DEBUG:teuthology.orchestra.run.gibba005:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-11-12T06:36:38.106 DEBUG:teuthology.orchestra.run.gibba015:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-11-12T06:36:38.145 DEBUG:teuthology.orchestra.run.gibba016:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-11-12T06:36:38.149 DEBUG:teuthology.orchestra.run.gibba038:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-11-12T06:36:38.153 DEBUG:teuthology.orchestra.run.gibba044:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-11-12T06:36:38.165 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2021-11-12T06:36:38.166 DEBUG:teuthology.orchestra.run.gibba005:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-11-12T06:36:38.169 DEBUG:teuthology.orchestra.run.gibba015:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-11-12T06:36:38.172 DEBUG:teuthology.orchestra.run.gibba016:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-11-12T06:36:38.174 DEBUG:teuthology.orchestra.run.gibba038:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-11-12T06:36:38.177 DEBUG:teuthology.orchestra.run.gibba044:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-11-12T06:36:38.184 INFO:teuthology.orchestra.run.gibba005.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-11-12T06:36:38.189 INFO:teuthology.orchestra.run.gibba044.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-11-12T06:36:38.190 INFO:teuthology.orchestra.run.gibba015.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-11-12T06:36:38.191 INFO:teuthology.orchestra.run.gibba016.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-11-12T06:36:38.192 INFO:teuthology.orchestra.run.gibba038.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-11-12T06:36:38.201 INFO:tasks.ceph:Archiving crash dumps... 2021-11-12T06:36:38.204 DEBUG:teuthology.misc:Transferring archived files from gibba005:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2021-11-05_04:10:01-fs-octopus-distro-default-gibba/6486492/remote/gibba005/crash 2021-11-12T06:36:38.205 DEBUG:teuthology.orchestra.run.gibba005:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-11-12T06:36:38.251 DEBUG:teuthology.misc:Transferring archived files from gibba015:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2021-11-05_04:10:01-fs-octopus-distro-default-gibba/6486492/remote/gibba015/crash 2021-11-12T06:36:38.253 DEBUG:teuthology.orchestra.run.gibba015:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-11-12T06:36:38.280 DEBUG:teuthology.misc:Transferring archived files from gibba016:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2021-11-05_04:10:01-fs-octopus-distro-default-gibba/6486492/remote/gibba016/crash 2021-11-12T06:36:38.282 DEBUG:teuthology.orchestra.run.gibba016:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-11-12T06:36:38.295 DEBUG:teuthology.misc:Transferring archived files from gibba038:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2021-11-05_04:10:01-fs-octopus-distro-default-gibba/6486492/remote/gibba038/crash 2021-11-12T06:36:38.296 DEBUG:teuthology.orchestra.run.gibba038:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-11-12T06:36:38.309 DEBUG:teuthology.misc:Transferring archived files from gibba044:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2021-11-05_04:10:01-fs-octopus-distro-default-gibba/6486492/remote/gibba044/crash 2021-11-12T06:36:38.311 DEBUG:teuthology.orchestra.run.gibba044:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-11-12T06:36:38.337 INFO:tasks.ceph:Shutting down logrotate 2021-11-12T06:36:38.338 DEBUG:teuthology.orchestra.run.gibba005:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:36:38.341 DEBUG:teuthology.orchestra.run.gibba015:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:36:38.344 DEBUG:teuthology.orchestra.run.gibba016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:36:38.347 DEBUG:teuthology.orchestra.run.gibba038:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:36:38.349 DEBUG:teuthology.orchestra.run.gibba044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-11-12T06:36:38.404 DEBUG:teuthology.orchestra.run.gibba005:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-11-12T06:36:38.413 DEBUG:teuthology.orchestra.run.gibba015:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-11-12T06:36:38.436 DEBUG:teuthology.orchestra.run.gibba016:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-11-12T06:36:38.457 DEBUG:teuthology.orchestra.run.gibba038:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-11-12T06:36:38.479 DEBUG:teuthology.orchestra.run.gibba044:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-11-12T06:36:38.501 INFO:tasks.ceph:Compressing logs... 2021-11-12T06:36:38.502 DEBUG:teuthology.orchestra.run.gibba005:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-11-12T06:36:38.506 DEBUG:teuthology.orchestra.run.gibba015:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-11-12T06:36:38.509 DEBUG:teuthology.orchestra.run.gibba016:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-11-12T06:36:38.513 DEBUG:teuthology.orchestra.run.gibba038:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-11-12T06:36:38.516 DEBUG:teuthology.orchestra.run.gibba044:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-11-12T06:36:49.939 INFO:tasks.ceph:Archiving logs... 2021-11-12T06:36:49.941 DEBUG:teuthology.misc:Transferring archived files from gibba005:/var/log/ceph to /home/teuthworker/archive/teuthology-2021-11-05_04:10:01-fs-octopus-distro-default-gibba/6486492/remote/gibba005/log 2021-11-12T06:36:49.942 DEBUG:teuthology.orchestra.run.gibba005:> sudo tar cz -f - -C /var/log/ceph -- . 2021-11-12T06:36:52.863 DEBUG:teuthology.misc:Transferring archived files from gibba015:/var/log/ceph to /home/teuthworker/archive/teuthology-2021-11-05_04:10:01-fs-octopus-distro-default-gibba/6486492/remote/gibba015/log 2021-11-12T06:36:52.865 DEBUG:teuthology.orchestra.run.gibba015:> sudo tar cz -f - -C /var/log/ceph -- . 2021-11-12T06:36:54.341 DEBUG:teuthology.misc:Transferring archived files from gibba016:/var/log/ceph to /home/teuthworker/archive/teuthology-2021-11-05_04:10:01-fs-octopus-distro-default-gibba/6486492/remote/gibba016/log 2021-11-12T06:36:54.343 DEBUG:teuthology.orchestra.run.gibba016:> sudo tar cz -f - -C /var/log/ceph -- . 2021-11-12T06:36:54.627 DEBUG:teuthology.misc:Transferring archived files from gibba038:/var/log/ceph to /home/teuthworker/archive/teuthology-2021-11-05_04:10:01-fs-octopus-distro-default-gibba/6486492/remote/gibba038/log 2021-11-12T06:36:54.628 DEBUG:teuthology.orchestra.run.gibba038:> sudo tar cz -f - -C /var/log/ceph -- . 2021-11-12T06:36:54.652 DEBUG:teuthology.misc:Transferring archived files from gibba044:/var/log/ceph to /home/teuthworker/archive/teuthology-2021-11-05_04:10:01-fs-octopus-distro-default-gibba/6486492/remote/gibba044/log 2021-11-12T06:36:54.654 DEBUG:teuthology.orchestra.run.gibba044:> sudo tar cz -f - -C /var/log/ceph -- . 2021-11-12T06:36:54.668 DEBUG:teuthology.run_tasks:Unwinding manager install 2021-11-12T06:36:54.679 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/task/install/__init__.py", line 619, in task yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/run_tasks.py", line 176, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_a81ee2815de5acae59ead5b8c9137b6766fc8ea8/qa/tasks/ceph_fuse.py", line 159, in task if mount.is_mounted(): File "/home/teuthworker/src/github.com_ceph_ceph_a81ee2815de5acae59ead5b8c9137b6766fc8ea8/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/orchestra/run.py", line 148, in wait greenlet.get(block=True,timeout=60) File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-11-12T06:36:54.682 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits... 2021-11-12T06:36:54.683 DEBUG:teuthology.orchestra.run.gibba005:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-11-12T06:36:54.687 DEBUG:teuthology.orchestra.run.gibba015:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-11-12T06:36:54.691 DEBUG:teuthology.orchestra.run.gibba016:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-11-12T06:36:54.694 DEBUG:teuthology.orchestra.run.gibba038:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-11-12T06:36:54.697 DEBUG:teuthology.orchestra.run.gibba044:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-11-12T06:36:54.845 DEBUG:teuthology.run_tasks:Unwinding manager clock 2021-11-12T06:36:54.856 INFO:teuthology.task.clock:Checking final clock skew... 2021-11-12T06:36:54.856 DEBUG:teuthology.orchestra.run.gibba005:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-11-12T06:36:54.876 INFO:teuthology.orchestra.run.gibba005.stdout: remote refid st t when poll reach delay offset jitter 2021-11-12T06:36:54.876 INFO:teuthology.orchestra.run.gibba005.stdout:============================================================================== 2021-11-12T06:36:54.877 INFO:teuthology.orchestra.run.gibba005.stdout:-hv01.front.sepi 216.240.36.24 3 u 94 128 377 0.268 8.097 0.289 2021-11-12T06:36:54.877 INFO:teuthology.orchestra.run.gibba005.stdout:*hv02.front.sepi 163.237.218.18 2 u 110 128 377 0.223 1.386 0.281 2021-11-12T06:36:54.878 INFO:teuthology.orchestra.run.gibba005.stdout:+hv03.front.sepi 216.229.4.69 3 u 39 128 377 0.237 1.134 0.112 2021-11-12T06:36:54.878 INFO:teuthology.orchestra.run.gibba005.stdout:+hv04.front.sepi 144.172.126.201 3 u 19 128 377 0.223 0.192 0.251 2021-11-12T06:36:54.878 DEBUG:teuthology.orchestra.run.gibba015:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-11-12T06:36:54.899 INFO:teuthology.orchestra.run.gibba015.stdout: remote refid st t when poll reach delay offset jitter 2021-11-12T06:36:54.899 INFO:teuthology.orchestra.run.gibba015.stdout:============================================================================== 2021-11-12T06:36:54.900 INFO:teuthology.orchestra.run.gibba015.stdout:-hv01.front.sepi 216.240.36.24 3 u 38 128 377 0.225 8.480 0.228 2021-11-12T06:36:54.900 INFO:teuthology.orchestra.run.gibba015.stdout:*hv02.front.sepi 163.237.218.18 2 u 98 128 377 0.261 1.442 0.198 2021-11-12T06:36:54.900 INFO:teuthology.orchestra.run.gibba015.stdout:+hv03.front.sepi 216.229.4.69 3 u 81 128 377 0.214 1.467 0.146 2021-11-12T06:36:54.901 INFO:teuthology.orchestra.run.gibba015.stdout:+hv04.front.sepi 144.172.126.201 3 u 85 128 377 0.231 0.454 0.196 2021-11-12T06:36:54.901 DEBUG:teuthology.orchestra.run.gibba016:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-11-12T06:36:54.921 INFO:teuthology.orchestra.run.gibba016.stdout: remote refid st t when poll reach delay offset jitter 2021-11-12T06:36:54.922 INFO:teuthology.orchestra.run.gibba016.stdout:============================================================================== 2021-11-12T06:36:54.922 INFO:teuthology.orchestra.run.gibba016.stdout:-hv01.front.sepi 216.240.36.24 3 u 24 128 377 0.251 12.642 0.333 2021-11-12T06:36:54.923 INFO:teuthology.orchestra.run.gibba016.stdout:*hv02.front.sepi 163.237.218.18 2 u 85 128 377 0.165 5.699 0.520 2021-11-12T06:36:54.923 INFO:teuthology.orchestra.run.gibba016.stdout:+hv03.front.sepi 216.229.4.69 3 u 18 128 377 0.275 6.816 1.166 2021-11-12T06:36:54.923 INFO:teuthology.orchestra.run.gibba016.stdout:+hv04.front.sepi 144.172.126.201 3 u 91 128 377 0.242 4.841 0.520 2021-11-12T06:36:54.924 DEBUG:teuthology.orchestra.run.gibba038:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-11-12T06:36:54.944 INFO:teuthology.orchestra.run.gibba038.stdout: remote refid st t when poll reach delay offset jitter 2021-11-12T06:36:54.945 INFO:teuthology.orchestra.run.gibba038.stdout:============================================================================== 2021-11-12T06:36:54.945 INFO:teuthology.orchestra.run.gibba038.stdout:-hv01.front.sepi 216.240.36.24 3 u 72 128 377 0.145 6.921 0.334 2021-11-12T06:36:54.946 INFO:teuthology.orchestra.run.gibba038.stdout:*hv02.front.sepi 163.237.218.18 2 u 90 128 377 0.151 -0.247 0.079 2021-11-12T06:36:54.946 INFO:teuthology.orchestra.run.gibba038.stdout:+hv03.front.sepi 216.229.4.69 3 u 91 128 377 0.118 -0.273 0.028 2021-11-12T06:36:54.946 INFO:teuthology.orchestra.run.gibba038.stdout:+hv04.front.sepi 144.172.126.201 3 u 91 128 377 0.139 -1.127 0.076 2021-11-12T06:36:54.947 DEBUG:teuthology.orchestra.run.gibba044:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-11-12T06:36:54.967 INFO:teuthology.orchestra.run.gibba044.stdout: remote refid st t when poll reach delay offset jitter 2021-11-12T06:36:54.967 INFO:teuthology.orchestra.run.gibba044.stdout:============================================================================== 2021-11-12T06:36:54.968 INFO:teuthology.orchestra.run.gibba044.stdout:-hv01.front.sepi 216.240.36.24 3 u 66 128 377 0.150 9.149 0.855 2021-11-12T06:36:54.969 INFO:teuthology.orchestra.run.gibba044.stdout:*hv02.front.sepi 163.237.218.18 2 u 86 128 377 0.099 1.603 0.274 2021-11-12T06:36:54.970 INFO:teuthology.orchestra.run.gibba044.stdout:+hv03.front.sepi 216.229.4.69 3 u 15 128 377 0.161 1.365 0.234 2021-11-12T06:36:54.970 INFO:teuthology.orchestra.run.gibba044.stdout:+hv04.front.sepi 144.172.126.201 3 u 6 128 377 0.158 1.019 0.444 2021-11-12T06:36:54.971 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2021-11-12T06:36:54.981 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2021-11-12T06:36:54.982 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2021-11-12T06:36:54.998 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2021-11-12T06:36:55.016 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2021-11-12T06:36:55.042 INFO:teuthology.task.internal:Duration was 3767.131267 seconds 2021-11-12T06:36:55.043 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2021-11-12T06:36:55.066 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2021-11-12T06:36:55.067 DEBUG:teuthology.orchestra.run.gibba005:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-11-12T06:36:55.071 DEBUG:teuthology.orchestra.run.gibba015:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-11-12T06:36:55.075 DEBUG:teuthology.orchestra.run.gibba016:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-11-12T06:36:55.079 DEBUG:teuthology.orchestra.run.gibba038:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-11-12T06:36:55.083 DEBUG:teuthology.orchestra.run.gibba044:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-11-12T06:36:55.143 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2021-11-12T06:36:55.144 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@gibba005.front.sepia.ceph.com 2021-11-12T06:36:55.145 DEBUG:teuthology.orchestra.run.gibba005:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-11-12T06:36:55.153 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@gibba015.front.sepia.ceph.com 2021-11-12T06:36:55.154 DEBUG:teuthology.orchestra.run.gibba015:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-11-12T06:36:55.167 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@gibba016.front.sepia.ceph.com 2021-11-12T06:36:55.169 DEBUG:teuthology.orchestra.run.gibba016:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-11-12T06:36:55.179 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@gibba038.front.sepia.ceph.com 2021-11-12T06:36:55.180 DEBUG:teuthology.orchestra.run.gibba038:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-11-12T06:36:55.195 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@gibba044.front.sepia.ceph.com 2021-11-12T06:36:55.196 DEBUG:teuthology.orchestra.run.gibba044:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-11-12T06:36:55.211 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2021-11-12T06:36:55.212 DEBUG:teuthology.orchestra.run.gibba005:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-11-12T06:36:55.215 DEBUG:teuthology.orchestra.run.gibba015:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-11-12T06:36:55.218 DEBUG:teuthology.orchestra.run.gibba016:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-11-12T06:36:55.221 DEBUG:teuthology.orchestra.run.gibba038:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-11-12T06:36:55.224 DEBUG:teuthology.orchestra.run.gibba044:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-11-12T06:36:55.246 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2021-11-12T06:36:55.261 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2021-11-12T06:36:55.262 DEBUG:teuthology.orchestra.run.gibba005:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-11-12T06:36:55.294 DEBUG:teuthology.orchestra.run.gibba015:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-11-12T06:36:55.307 DEBUG:teuthology.orchestra.run.gibba016:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-11-12T06:36:55.319 DEBUG:teuthology.orchestra.run.gibba038:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-11-12T06:36:55.342 DEBUG:teuthology.orchestra.run.gibba044:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-11-12T06:36:55.354 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2021-11-12T06:36:55.372 DEBUG:teuthology.orchestra.run.gibba005:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-11-12T06:36:55.376 DEBUG:teuthology.orchestra.run.gibba015:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-11-12T06:36:55.380 DEBUG:teuthology.orchestra.run.gibba016:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-11-12T06:36:55.383 DEBUG:teuthology.orchestra.run.gibba038:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-11-12T06:36:55.387 DEBUG:teuthology.orchestra.run.gibba044:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-11-12T06:36:55.389 INFO:teuthology.orchestra.run.gibba005.stdout:kernel.core_pattern = core 2021-11-12T06:36:55.390 INFO:teuthology.orchestra.run.gibba016.stdout:kernel.core_pattern = core 2021-11-12T06:36:55.391 INFO:teuthology.orchestra.run.gibba015.stdout:kernel.core_pattern = core 2021-11-12T06:36:55.395 INFO:teuthology.orchestra.run.gibba044.stdout:kernel.core_pattern = core 2021-11-12T06:36:55.403 INFO:teuthology.orchestra.run.gibba038.stdout:kernel.core_pattern = core 2021-11-12T06:36:55.414 DEBUG:teuthology.orchestra.run.gibba005:> test -e /home/ubuntu/cephtest/archive/coredump 2021-11-12T06:36:55.442 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T06:36:55.444 DEBUG:teuthology.orchestra.run.gibba015:> test -e /home/ubuntu/cephtest/archive/coredump 2021-11-12T06:36:55.448 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T06:36:55.449 DEBUG:teuthology.orchestra.run.gibba016:> test -e /home/ubuntu/cephtest/archive/coredump 2021-11-12T06:36:55.457 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T06:36:55.458 DEBUG:teuthology.orchestra.run.gibba038:> test -e /home/ubuntu/cephtest/archive/coredump 2021-11-12T06:36:55.463 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T06:36:55.464 DEBUG:teuthology.orchestra.run.gibba044:> test -e /home/ubuntu/cephtest/archive/coredump 2021-11-12T06:36:55.471 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-12T06:36:55.473 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2021-11-12T06:36:55.486 INFO:teuthology.task.internal:Transferring archived files... 2021-11-12T06:36:55.487 DEBUG:teuthology.misc:Transferring archived files from gibba005:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2021-11-05_04:10:01-fs-octopus-distro-default-gibba/6486492/remote/gibba005 2021-11-12T06:36:55.488 DEBUG:teuthology.orchestra.run.gibba005:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-11-12T06:36:55.506 DEBUG:teuthology.misc:Transferring archived files from gibba015:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2021-11-05_04:10:01-fs-octopus-distro-default-gibba/6486492/remote/gibba015 2021-11-12T06:36:55.510 DEBUG:teuthology.orchestra.run.gibba015:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-11-12T06:36:55.527 DEBUG:teuthology.misc:Transferring archived files from gibba016:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2021-11-05_04:10:01-fs-octopus-distro-default-gibba/6486492/remote/gibba016 2021-11-12T06:36:55.528 DEBUG:teuthology.orchestra.run.gibba016:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-11-12T06:36:55.545 DEBUG:teuthology.misc:Transferring archived files from gibba038:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2021-11-05_04:10:01-fs-octopus-distro-default-gibba/6486492/remote/gibba038 2021-11-12T06:36:55.546 DEBUG:teuthology.orchestra.run.gibba038:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-11-12T06:36:55.578 DEBUG:teuthology.misc:Transferring archived files from gibba044:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2021-11-05_04:10:01-fs-octopus-distro-default-gibba/6486492/remote/gibba044 2021-11-12T06:36:55.579 DEBUG:teuthology.orchestra.run.gibba044:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-11-12T06:36:55.612 INFO:teuthology.task.internal:Removing archive directory... 2021-11-12T06:36:55.613 DEBUG:teuthology.orchestra.run.gibba005:> rm -rf -- /home/ubuntu/cephtest/archive 2021-11-12T06:36:55.616 DEBUG:teuthology.orchestra.run.gibba015:> rm -rf -- /home/ubuntu/cephtest/archive 2021-11-12T06:36:55.620 DEBUG:teuthology.orchestra.run.gibba016:> rm -rf -- /home/ubuntu/cephtest/archive 2021-11-12T06:36:55.623 DEBUG:teuthology.orchestra.run.gibba038:> rm -rf -- /home/ubuntu/cephtest/archive 2021-11-12T06:36:55.626 DEBUG:teuthology.orchestra.run.gibba044:> rm -rf -- /home/ubuntu/cephtest/archive 2021-11-12T06:36:55.655 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2021-11-12T06:36:55.670 INFO:teuthology.task.internal:Not uploading archives. 2021-11-12T06:36:55.671 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2021-11-12T06:36:55.694 INFO:teuthology.task.internal:Tidying up after the test... 2021-11-12T06:36:55.695 DEBUG:teuthology.orchestra.run.gibba005:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-11-12T06:36:55.699 DEBUG:teuthology.orchestra.run.gibba015:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-11-12T06:36:55.703 DEBUG:teuthology.orchestra.run.gibba016:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-11-12T06:36:55.706 INFO:teuthology.orchestra.run.gibba015.stdout: 655382 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 12 06:36 /home/ubuntu/cephtest 2021-11-12T06:36:55.707 INFO:teuthology.orchestra.run.gibba005.stdout: 655402 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 12 06:36 /home/ubuntu/cephtest 2021-11-12T06:36:55.708 DEBUG:teuthology.orchestra.run.gibba038:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-11-12T06:36:55.713 DEBUG:teuthology.orchestra.run.gibba044:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-11-12T06:36:55.719 INFO:teuthology.orchestra.run.gibba038.stdout: 655402 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 12 06:36 /home/ubuntu/cephtest 2021-11-12T06:36:55.723 INFO:teuthology.orchestra.run.gibba044.stdout: 655395 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 12 06:36 /home/ubuntu/cephtest 2021-11-12T17:26:35.341 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2021-11-12T17:26:35.386 DEBUG:teuthology.task.console_log:Killing console logger for gibba005 2021-11-12T17:26:35.387 DEBUG:teuthology.task.console_log:Killing console logger for gibba015 2021-11-12T17:26:35.387 DEBUG:teuthology.task.console_log:Killing console logger for gibba016 2021-11-12T17:26:35.388 DEBUG:teuthology.task.console_log:Killing console logger for gibba038 2021-11-12T17:26:35.388 DEBUG:teuthology.task.console_log:Killing console logger for gibba044 2021-11-12T17:26:35.389 DEBUG:teuthology.exit:Finished running handlers